-- Logs begin at Wed 2022-10-05 01:44:34 UTC, end at Wed 2022-10-05 04:26:46 UTC. -- Oct 05 02:16:17.816583 n-d-858272-3 systemd[1]: Starting Devstack devstack@n-api.service... Oct 05 02:16:17.827312 n-d-858272-3 devstack@n-api.service[106279]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 05 02:16:17.829413 n-d-858272-3 devstack@n-api.service[106279]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 5 02:16:17 2022] *** Oct 05 02:16:17.829413 n-d-858272-3 devstack@n-api.service[106279]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 05 02:16:17.829413 n-d-858272-3 devstack@n-api.service[106279]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 05 02:16:17.829413 n-d-858272-3 devstack@n-api.service[106279]: nodename: n-d-858272-3 Oct 05 02:16:17.829413 n-d-858272-3 devstack@n-api.service[106279]: machine: x86_64 Oct 05 02:16:17.829413 n-d-858272-3 devstack@n-api.service[106279]: clock source: unix Oct 05 02:16:17.829413 n-d-858272-3 devstack@n-api.service[106279]: pcre jit disabled Oct 05 02:16:17.829413 n-d-858272-3 devstack@n-api.service[106279]: detected number of CPU cores: 4 Oct 05 02:16:17.829413 n-d-858272-3 devstack@n-api.service[106279]: current working directory: / Oct 05 02:16:17.829413 n-d-858272-3 devstack@n-api.service[106279]: detected binary path: /usr/bin/uwsgi-core Oct 05 02:16:17.829413 n-d-858272-3 devstack@n-api.service[106279]: your processes number limit is 47680 Oct 05 02:16:17.829413 n-d-858272-3 devstack@n-api.service[106279]: your memory page size is 4096 bytes Oct 05 02:16:17.829413 n-d-858272-3 devstack@n-api.service[106279]: detected max file descriptor number: 2048 Oct 05 02:16:17.829413 n-d-858272-3 devstack@n-api.service[106279]: lock engine: pthread robust mutexes Oct 05 02:16:17.831264 n-d-858272-3 devstack@n-api.service[106279]: thunder lock: enabled Oct 05 02:16:17.831264 n-d-858272-3 devstack@n-api.service[106279]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 05 02:16:17.831264 n-d-858272-3 devstack@n-api.service[106279]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 05 02:16:17.869069 n-d-858272-3 devstack@n-api.service[106279]: Python main interpreter initialized at 0x55ddf24409c0 Oct 05 02:16:17.869069 n-d-858272-3 devstack@n-api.service[106279]: python threads support enabled Oct 05 02:16:17.869069 n-d-858272-3 devstack@n-api.service[106279]: your server socket listen backlog is limited to 100 connections Oct 05 02:16:17.869069 n-d-858272-3 devstack@n-api.service[106279]: your mercy for graceful operations on workers is 90 seconds Oct 05 02:16:17.869395 n-d-858272-3 devstack@n-api.service[106279]: mapped 403077 bytes (393 KB) for 2 cores Oct 05 02:16:17.869479 n-d-858272-3 devstack@n-api.service[106279]: *** Operational MODE: preforking *** Oct 05 02:16:17.869724 n-d-858272-3 devstack@n-api.service[106279]: *** uWSGI is running in multiple interpreter mode *** Oct 05 02:16:17.869724 n-d-858272-3 devstack@n-api.service[106279]: spawned uWSGI master process (pid: 106279) Oct 05 02:16:17.869920 n-d-858272-3 systemd[1]: Started Devstack devstack@n-api.service. Oct 05 02:16:17.875297 n-d-858272-3 devstack@n-api.service[106279]: spawned uWSGI worker 1 (pid: 106280, cores: 1) Oct 05 02:16:17.875297 n-d-858272-3 devstack@n-api.service[106279]: spawned uWSGI worker 2 (pid: 106281, cores: 1) Oct 05 02:16:17.875297 n-d-858272-3 devstack@n-api.service[106279]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 05 02:16:18.532923 n-d-858272-3 devstack@n-api.service[106281]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 05 02:16:18.535860 n-d-858272-3 devstack@n-api.service[106280]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 05 02:16:19.624647 n-d-858272-3 devstack@n-api.service[106280]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 02:16:19.624647 n-d-858272-3 devstack@n-api.service[106280]: from cryptography.utils import int_from_bytes Oct 05 02:16:19.625367 n-d-858272-3 devstack@n-api.service[106281]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 02:16:19.625367 n-d-858272-3 devstack@n-api.service[106281]: from cryptography.utils import int_from_bytes Oct 05 02:16:19.625891 n-d-858272-3 devstack@n-api.service[106280]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 02:16:19.625891 n-d-858272-3 devstack@n-api.service[106280]: from cryptography.utils import int_from_bytes Oct 05 02:16:19.626013 n-d-858272-3 devstack@n-api.service[106281]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 02:16:19.626013 n-d-858272-3 devstack@n-api.service[106281]: from cryptography.utils import int_from_bytes Oct 05 02:16:22.138644 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 05 02:16:22.139309 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 05 02:16:22.139410 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 05 02:16:22.139410 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 05 02:16:22.139830 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 05 02:16:22.139924 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 05 02:16:22.140005 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 05 02:16:22.140005 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 05 02:16:22.140156 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 05 02:16:22.140272 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 05 02:16:22.140370 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.140656 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.140767 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.141004 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.141623 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.141835 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.141942 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.142238 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.142332 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.142549 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.142649 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.142869 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.142954 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.143184 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.143275 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.143500 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.143592 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.143756 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.143841 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.144070 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.144163 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.144380 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.144478 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858272-3 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.144695 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.144780 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858272-3 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.145037 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.145124 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.145343 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.145443 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.145649 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.145736 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.145967 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.146121 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.146270 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.146383 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.146575 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.146667 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.146877 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.147069 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.147465 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.147613 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.147728 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.147833 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.147965 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.148089 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.148273 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.148384 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.148591 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.148687 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.148926 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.149033 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.149230 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.149317 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.149547 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.149678 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.149852 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.149946 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.150169 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.150262 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.150486 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.150616 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858272-3 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.150865 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858272-3 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.150982 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.151174 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.151268 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.151480 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.151571 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.151789 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.151874 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.152177 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.152272 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.152483 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.152571 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.152784 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.152871 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.153140 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.153236 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.153434 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.153523 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.153737 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.153831 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.154057 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.154143 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.154374 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.154493 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.154689 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.154794 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.154986 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.155073 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.155292 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.155391 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.155596 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.155681 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.155900 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.155986 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.156200 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.156292 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.156500 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.156601 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.157341 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.157440 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.157610 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.157843 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.157937 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.158026 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.158223 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.158311 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.158541 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.158632 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.158823 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.158931 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.159074 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.159162 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.159343 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.159430 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.159661 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.159753 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.159979 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.160079 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.160280 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.160365 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.160582 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.160669 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.160883 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.161044 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.161206 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.161291 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.161506 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.161592 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.161808 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.161900 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.162107 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.162192 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.162410 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.162495 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.162720 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.162813 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.163027 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.163119 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.163328 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.163424 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.163634 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.163721 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.163950 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.164043 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.164267 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.164359 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.164577 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.164675 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.164878 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.165051 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.165234 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.165331 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.165539 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.165632 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.165843 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.165927 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.166159 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.166252 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.166462 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.166555 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.166765 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.166850 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.167067 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.167164 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.167369 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.167454 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.167687 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.167779 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.167986 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.168089 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.168238 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.168335 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.168536 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.168623 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.168832 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.168944 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.169163 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.169260 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.169462 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.169548 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.169764 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.169853 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.170063 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.170148 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.170361 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.170448 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.170656 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.170786 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.170956 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.171047 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.171255 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.171340 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.171554 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.171640 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.171852 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.171943 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.172151 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.172237 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.172563 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.172763 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.172881 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.173003 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.173214 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.173392 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.173521 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.173607 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.173825 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.173911 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.174143 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.174244 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.174462 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.174557 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.174767 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.174865 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.175071 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.175172 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.175374 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.175461 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.175676 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.175772 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.175983 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.176068 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.176284 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.176371 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.176586 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.176672 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.176885 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.177042 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.177211 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.177304 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.177526 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.177625 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.177830 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.177929 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.178131 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.178226 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.178447 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.178534 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.178745 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.178852 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.179045 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.179139 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.179348 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.179443 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.179649 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.179747 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.179950 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.180035 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.180247 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.180334 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.180544 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.180631 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.180840 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.180957 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.181162 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.181247 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.181457 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.181559 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.181754 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.181852 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.182046 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.182141 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.182341 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.182427 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.182655 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.182751 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.182955 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.183041 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.183256 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.183350 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.183556 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.183647 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.183853 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.183937 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.184168 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:16:22.184256 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.184501 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.184588 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.184831 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.185079 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.185167 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.185252 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.185489 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.185578 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.185817 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.185912 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.186131 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.186225 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.186443 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.186530 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.186753 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.186841 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.187064 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.187149 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.187370 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.187455 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.187679 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.187766 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.188010 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.188094 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.188319 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.188621 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.188732 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.188957 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.189049 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.189288 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.189374 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.189597 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.189694 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.189907 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.189993 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.190217 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.190302 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.190523 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.190627 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.190836 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.190958 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.191156 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.191294 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.191470 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.191571 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.191777 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.191862 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.192121 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.192206 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.192454 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.192549 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.192764 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.192849 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.193108 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.193195 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.193426 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.193513 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.193732 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.193832 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.194037 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.194129 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.194342 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.194428 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.194679 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.194771 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.194987 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.195076 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.195294 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.195387 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.195604 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.195697 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.195909 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.196003 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.196224 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.196317 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.196530 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.196622 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.196835 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.197028 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.197174 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.197310 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.197468 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.197602 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.197736 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.197877 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.198070 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.198205 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.198379 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.198514 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.198695 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.198842 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.199007 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.199144 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.199313 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.199460 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.199624 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.199772 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.199928 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.200062 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.200233 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.200368 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.200535 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.200677 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.200833 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.200996 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.201160 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.201308 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.201449 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.201587 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.201755 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.201891 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.202054 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.202190 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.202372 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.202508 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.202693 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.202829 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.202995 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.203130 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.203323 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.203461 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.204129 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.204271 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.204440 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.204630 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.204770 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.204968 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.205116 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.205278 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.205414 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.205583 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.205726 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.205893 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.206037 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.206206 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.206349 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.206511 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.206647 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.206825 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.206954 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.207127 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.207263 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.207422 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.207561 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.207732 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.207822 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.208032 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.208118 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.208591 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.208685 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.208924 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.209015 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.209232 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.209332 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.209539 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.209625 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.209844 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.209938 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.210149 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.210243 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.210462 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.210549 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.210769 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.210855 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.211078 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.211175 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.211406 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.211493 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.211708 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.211794 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.212026 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.212121 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.212346 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.212431 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.212659 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.212745 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.212984 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.213077 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.213288 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.213374 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.213586 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.213673 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.213887 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.213981 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.214184 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.214277 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.214486 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.214579 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.214787 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.214875 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.215086 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.215172 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.215385 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.215476 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.215686 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.215780 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.215983 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.216070 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.216296 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.216390 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.216597 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.216683 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.216939 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.217030 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.217228 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.217326 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.217520 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.217606 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.217821 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.217909 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.218148 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.218245 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.218451 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.218537 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.218788 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.218875 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.219106 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.219199 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.219983 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.220075 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.220295 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.220383 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.220609 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.220697 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.220930 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.221032 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.221245 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.221332 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.221554 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.221643 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.221860 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.221945 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.222170 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.222257 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.222477 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.222564 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.222782 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.222877 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.223086 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.223179 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.223391 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.223478 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.223699 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.223784 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.224007 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.224174 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.224308 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.224395 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.224614 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.224701 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.224945 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.225051 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.225286 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.225425 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.225606 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.225742 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.225918 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.226062 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.226213 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.226340 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.226521 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.226652 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.226827 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.226971 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.227114 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.227244 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.227425 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.227564 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.227731 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.227869 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.228036 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.228166 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.228340 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.228477 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.228645 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.228776 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.228965 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.229106 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.229276 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.229419 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.229583 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.229721 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.229887 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.230027 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.230194 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.230356 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.230500 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.230641 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.230779 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.230915 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.231099 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.231243 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.231422 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.231512 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.231726 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.231861 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.232034 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.232179 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.232342 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.232477 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.232651 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.232793 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.232979 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.233124 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.233282 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.233416 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.233582 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.233723 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.233884 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.234029 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.234186 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.234335 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.234493 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.234622 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.234949 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.235063 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.235200 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.235345 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.235489 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.235626 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.235764 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.235900 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.236057 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.236190 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.236346 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.236483 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.236649 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.236785 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.236967 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.237101 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.237290 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.237380 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.237599 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.237697 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.237918 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.238006 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.238225 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.238312 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.238527 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.238614 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.238833 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.238921 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.239138 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.239223 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.239482 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.239587 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.239744 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.239837 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.240050 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.240150 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.240353 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.240440 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.240684 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.240777 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.241014 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.241119 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.241324 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.241450 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.241640 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.241759 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.241946 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.242042 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.242252 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.242338 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.242556 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.242641 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.242859 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.242953 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.243168 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.243262 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.243479 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.243565 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.243785 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.243874 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.244089 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.244175 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.244394 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.244481 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.244700 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.244787 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.245030 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.245121 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.245343 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.245429 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.245646 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.245733 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.245953 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.246048 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.246260 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.246346 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.246561 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.246655 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.246862 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.246954 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.247188 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.247328 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.247490 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.247736 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.248047 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.248136 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.248364 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.248459 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.248677 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.248763 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.249018 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.249111 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.249345 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.249446 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.249666 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.249771 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.249995 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.250093 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.250307 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.250394 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.250641 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.250736 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.250948 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.251106 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.251255 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.251421 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.251546 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.251728 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.251853 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.252038 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.252145 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.252344 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.252451 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.252648 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.252736 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.252977 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.253077 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.253286 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.253373 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.253589 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.253677 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.253892 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.253979 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.254195 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.254296 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.254498 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.254593 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.254810 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.254897 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.255113 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.255207 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.255420 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.255557 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.255720 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.255807 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.256039 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.256139 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.256342 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.256427 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.256642 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.256728 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.256960 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.257064 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.257263 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.257358 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.257601 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.257687 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.257903 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.257989 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.258236 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.258321 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.258559 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.258644 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.258895 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.258990 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.259197 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.259283 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.259498 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.259585 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.259815 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.259901 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.260115 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.260201 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.260415 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.260509 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.260714 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.260807 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.261039 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.261127 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.261345 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.261518 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.261648 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.261759 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.261936 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.262033 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.262237 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.262331 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.262540 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.262625 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.262841 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.262925 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.263138 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.263236 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.263440 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.263533 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.263737 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.263822 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.264047 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.264135 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.264351 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.264436 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.264649 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.264741 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.264970 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.265062 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.265277 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.265377 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.265580 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.265666 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.265878 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.265966 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.266693 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.266786 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.266996 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.267128 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.267310 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.267448 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.267613 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.267737 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.267915 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.268038 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.268215 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.268339 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.268521 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.268644 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.268831 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.268986 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.269171 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.269272 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.269492 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.269590 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.269799 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.269910 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.270101 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.270199 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.270403 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.270510 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.270711 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.270818 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.271012 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.271115 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.271310 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.271405 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.271612 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.271724 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.271928 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.272035 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.272238 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.272333 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.272536 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.272624 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.272840 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.272948 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.273162 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.273248 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.273462 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.273550 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.273759 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.273844 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.274060 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.274146 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.274357 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.274443 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.274654 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.274748 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.274950 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.275045 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.275249 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.275343 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.275546 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.275646 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.275866 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.275977 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.276166 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.276252 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.276465 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.276551 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.276764 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.276858 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.277087 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.277186 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.277426 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.277514 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.277744 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.277839 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.278082 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.278177 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.278382 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.278476 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.278692 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.278780 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.279007 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.279092 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.279313 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.279406 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.279617 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.279704 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.279928 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.280014 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.280231 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.280324 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.280542 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.280640 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.280850 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.280958 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.281187 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.281273 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.281489 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.281574 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.281842 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.281940 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.282203 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.282368 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.282502 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.282664 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.282900 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.283040 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.283176 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.283464 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.283715 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.283854 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.283999 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.284132 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.284265 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.284414 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.284547 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.284689 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.284822 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.284928 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.285056 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.285154 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.285245 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.285406 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.285495 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.285714 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.285802 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.286030 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.286126 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.286327 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.286419 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.286632 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.286735 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.286940 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.287027 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.287244 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.287338 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.287551 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.287688 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.287924 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.288159 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.288245 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.288483 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.288770 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.288870 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.289114 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.289329 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.289420 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.289676 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.289769 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.289998 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.290089 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.290304 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.290392 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.290620 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.290790 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.290933 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.291020 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.291252 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.291341 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.291561 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.291663 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.291903 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.291988 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.292211 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.292425 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.292516 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.292605 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.292822 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.292936 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.293149 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.293237 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.293506 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.293605 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.293823 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.293912 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.294137 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.294224 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.294594 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.294706 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.294791 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.294920 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.295031 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.295315 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.295412 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.295636 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.295724 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.295936 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.296029 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.296239 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.296336 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.296542 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.296629 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.296853 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.296960 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.297192 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.297288 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.298083 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.298181 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.298393 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.298524 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.298701 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.298836 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.299025 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.299142 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.299333 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.299553 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.299649 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.299863 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.300059 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.300154 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.300370 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.300464 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.300678 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.300793 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.301116 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.301225 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.301428 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.301517 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.301737 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.301823 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.302044 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.302133 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.302363 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.302464 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.302685 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.302783 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.302988 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.303082 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.303300 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.303386 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.303601 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.303695 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.303920 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.304007 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.304238 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.304335 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.304549 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.304648 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.304861 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.304979 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.305190 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.305279 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.305511 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.305607 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.305837 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.305933 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.306150 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.306237 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.306468 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.306564 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.306804 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.306897 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.307110 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.307197 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.307421 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.307510 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.307726 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.307816 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.308030 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.308139 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.308352 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.308453 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.308656 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.308745 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.308998 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.309089 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.309302 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.309390 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.309606 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.309692 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.309910 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.309997 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.310213 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.310302 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.310523 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.310609 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.310830 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.310923 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.311136 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.311224 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.311442 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.311530 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.311746 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.311842 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.312064 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.312150 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.312365 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.312458 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.312686 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.312823 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.313060 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.313660 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.313866 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.313990 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.314170 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.314315 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.314473 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.314624 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.314812 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.314948 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.315117 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.315256 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.315435 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.315561 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.315763 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.315860 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.316091 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.316187 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.316400 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.316490 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.316730 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.316826 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.317080 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.317183 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.317400 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.317498 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.317711 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.317799 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.318030 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.318125 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.318406 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.318505 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.318654 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.318755 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.318959 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.319047 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.319266 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.319353 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.319568 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.319663 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.319872 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.319960 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.320174 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.320262 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.320475 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.320578 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.320780 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.320866 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.321106 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.321194 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.321406 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.321509 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.321708 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.321803 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.322015 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.322109 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.322316 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.322411 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.322619 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.322713 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.322922 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.323020 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.323220 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.323317 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.323520 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.323607 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.323836 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.323922 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.324144 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.324233 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.324448 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.324535 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.324750 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.324838 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.325077 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.325240 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.325399 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.325493 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.325715 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.325815 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.326029 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.326115 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.326331 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.326425 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.326648 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.326748 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.326964 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.327051 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.327277 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.327417 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.327587 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.327684 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.327899 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.327986 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.328212 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.328299 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.328525 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.328654 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.328951 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.329175 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.329263 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.329509 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.329611 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.329824 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.329918 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.330135 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.330222 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.330445 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.330688 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.330778 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.331015 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.331103 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.331329 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.331416 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.331640 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.331731 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.331949 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.332036 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.332258 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.332352 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.332569 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.332657 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.332877 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.333042 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.333212 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.333310 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.333787 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.333875 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.334097 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.334185 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.334407 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.334501 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.334720 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.334808 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.335031 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.335119 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.335363 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.335459 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.335685 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.335774 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.335989 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.336082 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.336299 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.336394 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.336610 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.336701 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.336941 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.337072 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.337258 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.337359 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.337570 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.337668 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.337882 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.337995 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.338195 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.338292 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.338502 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.338597 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.338809 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.338916 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.339116 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.339211 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.339424 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.339518 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.339731 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.339828 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.340041 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.340140 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.340348 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.340445 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.340659 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.340756 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.340992 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.341091 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.341305 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.341399 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.341637 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.341823 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.341959 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.342142 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.342271 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.342477 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.342566 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.342805 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.342894 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.343131 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.343387 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.343483 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.343700 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.343789 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.344032 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.344120 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.344389 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.344492 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.344708 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.344928 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.345029 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.345114 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.345336 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.345434 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.345642 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.345731 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.345957 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.346052 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.346263 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.346361 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.346565 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.346652 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.346871 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.346966 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.347175 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.347265 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.347503 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.347698 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.347790 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.348041 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.348139 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.348355 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.348451 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.348682 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.348783 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.349032 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.349234 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.349349 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.349579 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.349675 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.349892 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.349993 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.350215 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.350303 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.350537 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.350633 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.350852 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.350950 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.351159 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.351247 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.351460 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.351548 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.351766 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.351862 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.352068 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.352155 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.352372 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.352458 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.352677 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.352766 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.353000 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.353093 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.353304 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.353410 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.353609 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.353698 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.353916 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.354004 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.354216 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.354310 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.354520 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.354611 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.354819 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.354906 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.355121 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.355215 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.355428 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.355530 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.355727 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.355816 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.356026 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.356114 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.356333 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.356420 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.356637 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.356807 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.356963 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.357109 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.357246 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.357381 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.357544 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.357677 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.357853 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.357998 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.358158 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.358309 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.358465 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.358603 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.358781 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.358928 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.359074 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.359169 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.359375 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.359462 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.359689 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.359788 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.360643 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.360960 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.361109 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.361274 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.361440 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.361587 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.361737 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.361932 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.362046 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.362248 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.362348 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.362661 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.362778 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.362984 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.363109 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.363300 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.363422 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.363610 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.363746 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.363950 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.364074 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.364264 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.364383 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.364689 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.364797 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.365017 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.365154 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.365346 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.365478 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.365652 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.365807 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.365963 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.366141 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.366273 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.366450 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.366580 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.366757 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.366886 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.367062 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.367193 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.367385 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.367481 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.367694 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.367818 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.368004 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.368094 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.368312 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.368400 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.368620 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.368708 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.368955 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.369052 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.369268 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.369355 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.369574 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.369669 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.369883 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.369971 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.370187 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.370274 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.370492 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.370590 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.370799 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.370889 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.371102 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.371190 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.371410 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.371507 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.371717 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.371805 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.372021 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.372116 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.372330 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.372427 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.372638 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.372725 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.372972 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.373064 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.373283 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.373394 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.373599 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.373700 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.373897 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.373991 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.374205 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.374514 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.374601 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.374821 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.374909 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.375136 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.375237 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.375548 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.376162 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.376380 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.376531 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.376786 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.376882 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.377198 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.377499 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.377588 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.377816 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.377963 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.378125 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.378219 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.378447 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.378533 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.378756 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.378855 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.379078 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.379173 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.379399 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.379488 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.379704 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.379800 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.380011 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.380098 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.380320 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.380406 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.380625 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.380713 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.380966 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.381058 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.381277 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.381365 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.381583 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.381694 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.381889 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.381988 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.382194 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.382281 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.382496 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.382584 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.382795 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.382882 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.383098 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.383194 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.383400 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.383487 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.383707 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.383822 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.384006 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.384116 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.384308 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.384414 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.384611 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.384706 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.384921 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.385032 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.385229 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.385327 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.385531 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.385628 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.385837 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.385942 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.386136 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.386230 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.386438 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.386532 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.386736 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.386831 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.387036 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.387140 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.387336 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.387437 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.387635 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.387741 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.387940 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.388077 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.388241 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.388330 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.388544 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.388633 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.388893 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.389020 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.389172 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.389263 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.389476 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.389565 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.389806 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.389892 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.390125 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.390222 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.390434 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.390520 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.390738 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.390824 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.391073 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.391237 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.391385 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.391521 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.391734 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.391842 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.392080 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.392184 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.392388 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.392476 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.392696 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.392784 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.393025 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.393129 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.393350 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.393446 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.393673 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.393825 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.393978 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.394068 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.394294 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.394381 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.394602 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.394690 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.394909 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.394999 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.395218 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.395313 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.395523 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.395626 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.395851 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.395941 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.396160 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.396254 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.396468 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.396565 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.396776 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.396869 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.397113 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.397237 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.397422 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.397530 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.397730 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.397828 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.398043 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.398136 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.398340 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.398446 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.398648 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.398745 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.398955 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.399044 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.399263 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.399353 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.399573 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.399671 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.399880 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.399966 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.400184 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.400272 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.400492 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.400581 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.400806 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.400930 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.401144 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.401235 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.401469 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.401565 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.401796 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.401893 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.402104 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.402193 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.402411 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.402497 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.402715 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.402813 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.402957 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 05 02:16:22.403069 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.403379 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.403722 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.404051 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.404363 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.404672 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.404998 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:16:22.405241 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 05 02:16:22.557458 n-d-858272-3 devstack@n-api.service[106280]: INFO dbcounter [None req-40ffd3ca-443c-4b75-a473-e9316fe52234 None None] Registered counter for database nova_api Oct 05 02:16:22.559955 n-d-858272-3 devstack@n-api.service[106281]: INFO dbcounter [None req-ffb58930-db78-431a-a193-836a098b0e64 None None] Registered counter for database nova_api Oct 05 02:16:22.579311 n-d-858272-3 devstack@n-api.service[106280]: DEBUG oslo_db.sqlalchemy.engines [None req-40ffd3ca-443c-4b75-a473-e9316fe52234 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106280) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 02:16:22.580931 n-d-858272-3 devstack@n-api.service[106281]: DEBUG oslo_db.sqlalchemy.engines [None req-ffb58930-db78-431a-a193-836a098b0e64 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106281) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 02:16:22.586250 n-d-858272-3 devstack@n-api.service[106280]: DEBUG dbcounter [-] [106280] Writer thread running {{(pid=106280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 02:16:22.587612 n-d-858272-3 devstack@n-api.service[106281]: DEBUG dbcounter [-] [106281] Writer thread running {{(pid=106281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 02:16:22.643071 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.context [None req-40ffd3ca-443c-4b75-a473-e9316fe52234 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d1723b23-1631-4a56-b9ad-72e4c39197cb(cell1) {{(pid=106280) load_cells /opt/stack/nova/nova/context.py:464}} Oct 05 02:16:22.643887 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.context [None req-ffb58930-db78-431a-a193-836a098b0e64 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d1723b23-1631-4a56-b9ad-72e4c39197cb(cell1) {{(pid=106281) load_cells /opt/stack/nova/nova/context.py:464}} Oct 05 02:16:22.646914 n-d-858272-3 devstack@n-api.service[106280]: DEBUG oslo_concurrency.lockutils [None req-40ffd3ca-443c-4b75-a473-e9316fe52234 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:16:22.647400 n-d-858272-3 devstack@n-api.service[106280]: DEBUG oslo_concurrency.lockutils [None req-40ffd3ca-443c-4b75-a473-e9316fe52234 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:16:22.647736 n-d-858272-3 devstack@n-api.service[106281]: DEBUG oslo_concurrency.lockutils [None req-ffb58930-db78-431a-a193-836a098b0e64 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:16:22.648210 n-d-858272-3 devstack@n-api.service[106281]: DEBUG oslo_concurrency.lockutils [None req-ffb58930-db78-431a-a193-836a098b0e64 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:16:22.648957 n-d-858272-3 devstack@n-api.service[106280]: DEBUG oslo_concurrency.lockutils [None req-40ffd3ca-443c-4b75-a473-e9316fe52234 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:16:22.649686 n-d-858272-3 devstack@n-api.service[106280]: DEBUG oslo_concurrency.lockutils [None req-40ffd3ca-443c-4b75-a473-e9316fe52234 None None] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:16:22.649786 n-d-858272-3 devstack@n-api.service[106281]: DEBUG oslo_concurrency.lockutils [None req-ffb58930-db78-431a-a193-836a098b0e64 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:16:22.650130 n-d-858272-3 devstack@n-api.service[106280]: DEBUG oslo_concurrency.lockutils [None req-40ffd3ca-443c-4b75-a473-e9316fe52234 None None] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:16:22.650507 n-d-858272-3 devstack@n-api.service[106281]: DEBUG oslo_concurrency.lockutils [None req-ffb58930-db78-431a-a193-836a098b0e64 None None] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:16:22.650937 n-d-858272-3 devstack@n-api.service[106281]: DEBUG oslo_concurrency.lockutils [None req-ffb58930-db78-431a-a193-836a098b0e64 None None] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:16:22.652127 n-d-858272-3 devstack@n-api.service[106280]: DEBUG oslo_concurrency.lockutils [None req-40ffd3ca-443c-4b75-a473-e9316fe52234 None None] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:16:22.652952 n-d-858272-3 devstack@n-api.service[106281]: DEBUG oslo_concurrency.lockutils [None req-ffb58930-db78-431a-a193-836a098b0e64 None None] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:16:22.654147 n-d-858272-3 devstack@n-api.service[106280]: INFO dbcounter [None req-40ffd3ca-443c-4b75-a473-e9316fe52234 None None] Registered counter for database nova_cell0 Oct 05 02:16:22.654936 n-d-858272-3 devstack@n-api.service[106281]: INFO dbcounter [None req-ffb58930-db78-431a-a193-836a098b0e64 None None] Registered counter for database nova_cell0 Oct 05 02:16:22.658727 n-d-858272-3 devstack@n-api.service[106280]: INFO dbcounter [None req-40ffd3ca-443c-4b75-a473-e9316fe52234 None None] Registered counter for database nova_cell1 Oct 05 02:16:22.660005 n-d-858272-3 devstack@n-api.service[106281]: INFO dbcounter [None req-ffb58930-db78-431a-a193-836a098b0e64 None None] Registered counter for database nova_cell1 Oct 05 02:16:22.665917 n-d-858272-3 devstack@n-api.service[106280]: DEBUG oslo_db.sqlalchemy.engines [None req-40ffd3ca-443c-4b75-a473-e9316fe52234 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106280) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 02:16:22.667410 n-d-858272-3 devstack@n-api.service[106281]: DEBUG oslo_db.sqlalchemy.engines [None req-ffb58930-db78-431a-a193-836a098b0e64 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106281) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 02:16:22.671964 n-d-858272-3 devstack@n-api.service[106281]: DEBUG dbcounter [-] [106281] Writer thread running {{(pid=106281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 02:16:22.673255 n-d-858272-3 devstack@n-api.service[106281]: DEBUG oslo_db.sqlalchemy.engines [None req-ffb58930-db78-431a-a193-836a098b0e64 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106281) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 02:16:22.675009 n-d-858272-3 devstack@n-api.service[106280]: DEBUG oslo_db.sqlalchemy.engines [None req-40ffd3ca-443c-4b75-a473-e9316fe52234 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106280) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 02:16:22.675654 n-d-858272-3 devstack@n-api.service[106280]: DEBUG dbcounter [-] [106280] Writer thread running {{(pid=106280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 02:16:22.814767 n-d-858272-3 devstack@n-api.service[106281]: DEBUG dbcounter [-] [106281] Writer thread running {{(pid=106281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 02:16:22.817687 n-d-858272-3 devstack@n-api.service[106280]: DEBUG dbcounter [-] [106280] Writer thread running {{(pid=106280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 02:16:22.823236 n-d-858272-3 devstack@n-api.service[106281]: INFO dbcounter [None req-ffb58930-db78-431a-a193-836a098b0e64 None None] Registered counter for database nova_cell0 Oct 05 02:16:22.826148 n-d-858272-3 devstack@n-api.service[106280]: INFO dbcounter [None req-40ffd3ca-443c-4b75-a473-e9316fe52234 None None] Registered counter for database nova_cell0 Oct 05 02:16:22.832655 n-d-858272-3 devstack@n-api.service[106281]: DEBUG oslo_db.sqlalchemy.engines [None req-ffb58930-db78-431a-a193-836a098b0e64 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106281) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 02:16:22.836211 n-d-858272-3 devstack@n-api.service[106280]: DEBUG oslo_db.sqlalchemy.engines [None req-40ffd3ca-443c-4b75-a473-e9316fe52234 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106280) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 02:16:22.837732 n-d-858272-3 devstack@n-api.service[106281]: DEBUG dbcounter [-] [106281] Writer thread running {{(pid=106281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 02:16:22.840773 n-d-858272-3 devstack@n-api.service[106280]: DEBUG dbcounter [-] [106280] Writer thread running {{(pid=106280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 02:16:23.174594 n-d-858272-3 devstack@n-api.service[106280]: WARNING keystonemiddleware.auth_token [None req-40ffd3ca-443c-4b75-a473-e9316fe52234 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 05 02:16:23.181879 n-d-858272-3 devstack@n-api.service[106280]: WARNING keystonemiddleware.auth_token [None req-40ffd3ca-443c-4b75-a473-e9316fe52234 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 05 02:16:23.185826 n-d-858272-3 devstack@n-api.service[106281]: WARNING keystonemiddleware.auth_token [None req-ffb58930-db78-431a-a193-836a098b0e64 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 05 02:16:23.193784 n-d-858272-3 devstack@n-api.service[106281]: WARNING keystonemiddleware.auth_token [None req-ffb58930-db78-431a-a193-836a098b0e64 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 05 02:16:23.523160 n-d-858272-3 devstack@n-api.service[106280]: WARNING keystonemiddleware.auth_token [None req-40ffd3ca-443c-4b75-a473-e9316fe52234 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 05 02:16:23.529020 n-d-858272-3 devstack@n-api.service[106280]: WARNING keystonemiddleware.auth_token [None req-40ffd3ca-443c-4b75-a473-e9316fe52234 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 05 02:16:23.534894 n-d-858272-3 devstack@n-api.service[106280]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ddf24409c0 pid: 106280 (default app) Oct 05 02:16:23.536952 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-40ffd3ca-443c-4b75-a473-e9316fe52234 None None] Calling method '>' {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:16:23.538133 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-40ffd3ca-443c-4b75-a473-e9316fe52234 None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001741 Oct 05 02:16:23.538540 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Wed Oct 5 02:16:23 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:16:23.542816 n-d-858272-3 devstack@n-api.service[106281]: WARNING keystonemiddleware.auth_token [None req-ffb58930-db78-431a-a193-836a098b0e64 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 05 02:16:23.549325 n-d-858272-3 devstack@n-api.service[106281]: WARNING keystonemiddleware.auth_token [None req-ffb58930-db78-431a-a193-836a098b0e64 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 05 02:16:23.554585 n-d-858272-3 devstack@n-api.service[106281]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ddf24409c0 pid: 106281 (default app) Oct 05 02:17:45.216314 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-40ffd3ca-443c-4b75-a473-e9316fe52234 None None] Calling method '>' {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:17:45.217952 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-40ffd3ca-443c-4b75-a473-e9316fe52234 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002053 Oct 05 02:17:45.218475 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 5 02:17:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:17:45.230949 n-d-858272-3 devstack@n-api.service[106281]: DEBUG dbcounter [-] [106281] Writing DB stats nova_api:SELECT=3 {{(pid=106281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:45.231854 n-d-858272-3 devstack@n-api.service[106281]: DEBUG dbcounter [-] [106281] Writing DB stats nova_cell0:SELECT=3 {{(pid=106281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:45.233083 n-d-858272-3 devstack@n-api.service[106281]: DEBUG dbcounter [-] [106281] Writing DB stats nova_cell1:SELECT=3 {{(pid=106281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:45.235044 n-d-858272-3 devstack@n-api.service[106281]: DEBUG dbcounter [-] [106281] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:46.094580 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-6dc58925-80be-44cf-8f43-c709a28d9394 admin admin] Calling method '>' {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:17:46.128351 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-6dc58925-80be-44cf-8f43-c709a28d9394 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.902504 Oct 05 02:17:46.130073 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Oct 5 02:17:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:17:48.738446 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-40ffd3ca-443c-4b75-a473-e9316fe52234 None None] Calling method '>' {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:17:48.739449 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-40ffd3ca-443c-4b75-a473-e9316fe52234 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Oct 05 02:17:48.739999 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 3/4] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 5 02:17:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:17:49.183648 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-3af13e47-f33f-4d5d-97f3-f3a3b1a9261e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "cirros256", "ram": 256, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 1}} {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:17:49.230147 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-3af13e47-f33f-4d5d-97f3-f3a3b1a9261e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.483926 Oct 05 02:17:49.230717 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 2/5] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 5 02:17:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:17:49.244860 n-d-858272-3 devstack@n-api.service[106280]: DEBUG dbcounter [-] [106280] Writing DB stats nova_api:SELECT=3 {{(pid=106280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:49.246980 n-d-858272-3 devstack@n-api.service[106280]: DEBUG dbcounter [-] [106280] Writing DB stats nova_cell1:SELECT=3 {{(pid=106280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:49.247703 n-d-858272-3 devstack@n-api.service[106280]: DEBUG dbcounter [-] [106280] Writing DB stats nova_cell0:SELECT=3 {{(pid=106280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:49.248431 n-d-858272-3 devstack@n-api.service[106280]: DEBUG dbcounter [-] [106280] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:49.456477 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-e0d073ee-4456-4ae7-94a2-fec5d82dd05f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:17:49.526331 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-e0d073ee-4456-4ae7-94a2-fec5d82dd05f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.286677 Oct 05 02:17:49.527001 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 4/6] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Oct 5 02:17:49 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:17:52.196240 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-3af13e47-f33f-4d5d-97f3-f3a3b1a9261e admin admin] Calling method '>' {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:17:52.197301 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-3af13e47-f33f-4d5d-97f3-f3a3b1a9261e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Oct 05 02:17:52.197709 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 3/7] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 5 02:17:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:17:52.997435 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-37376f8e-629c-46ed-8121-a6bd2fe1dea1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "name": "ds512M", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "os-flavor-access:is_public": true, "vcpus": 1, "id": "d1"}} {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:17:53.055246 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-37376f8e-629c-46ed-8121-a6bd2fe1dea1 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.848255 Oct 05 02:17:53.056479 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 5/8] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 5 02:17:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:17:53.077049 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-281f0598-2412-48c2-b11f-993423ee4167 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:17:53.132663 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-281f0598-2412-48c2-b11f-993423ee4167 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.059599 Oct 05 02:17:53.134003 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 4/9] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Oct 5 02:17:53 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:17:56.114969 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-37376f8e-629c-46ed-8121-a6bd2fe1dea1 admin admin] Calling method '>' {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:17:56.115994 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-37376f8e-629c-46ed-8121-a6bd2fe1dea1 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001613 Oct 05 02:17:56.117371 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 5 02:17:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:17:56.678926 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-86f09d8b-5758-4e05-ac37-0d7054808cde admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "vcpus": 1, "id": "d2", "swap": 0, "rxtx_factor": 1.0, "ram": 1024}} {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:17:56.701019 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-86f09d8b-5758-4e05-ac37-0d7054808cde admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.577054 Oct 05 02:17:56.703223 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 5/11] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 5 02:17:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:17:56.716350 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-60d1442c-d5fa-4f3a-88d7-32d7c9ea6821 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:17:56.748609 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-60d1442c-d5fa-4f3a-88d7-32d7c9ea6821 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036046 Oct 05 02:17:56.753251 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 7/12] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Oct 5 02:17:56 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:17:59.376158 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-86f09d8b-5758-4e05-ac37-0d7054808cde admin admin] Calling method '>' {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:17:59.377199 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-86f09d8b-5758-4e05-ac37-0d7054808cde admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001592 Oct 05 02:17:59.377929 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 6/13] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 5 02:17:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:17:59.842584 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-f0d7aea9-8de8-4233-83c5-4d4a65a01a47 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "name": "ds2G", "vcpus": 2, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d3", "ram": 2048}} {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:17:59.869291 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-f0d7aea9-8de8-4233-83c5-4d4a65a01a47 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.484384 Oct 05 02:17:59.870411 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 8/14] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 5 02:17:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:17:59.882152 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-5fbb1245-211d-4402-a442-69e1421425b9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:17:59.914326 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-5fbb1245-211d-4402-a442-69e1421425b9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035878 Oct 05 02:17:59.914742 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 7/15] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Oct 5 02:17:59 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:18:02.654061 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-f0d7aea9-8de8-4233-83c5-4d4a65a01a47 admin admin] Calling method '>' {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:18:02.655702 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-f0d7aea9-8de8-4233-83c5-4d4a65a01a47 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002046 Oct 05 02:18:02.667320 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 9/16] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 5 02:18:02 2022] GET /compute/v2.1 => generated 388 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:18:03.088305 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-f4811527-83c9-4467-8a84-4091f644fae4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "ds4G", "vcpus": 4, "rxtx_factor": 1.0, "disk": 20, "id": "d4", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:18:03.120369 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-f4811527-83c9-4467-8a84-4091f644fae4 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.457267 Oct 05 02:18:03.124939 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 8/17] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 5 02:18:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:18:03.133252 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-9308b4bd-afec-44f0-b9bd-c722bbc936fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:18:03.158485 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-9308b4bd-afec-44f0-b9bd-c722bbc936fb admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028779 Oct 05 02:18:03.159058 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 10/18] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Oct 5 02:18:03 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:18:05.846973 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-f4811527-83c9-4467-8a84-4091f644fae4 admin admin] Calling method '>' {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:18:05.847988 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-f4811527-83c9-4467-8a84-4091f644fae4 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Oct 05 02:18:05.848542 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 9/19] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 5 02:18:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:18:06.300096 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-29b3e4fc-3f3d-4d5c-bd50-a7e186559cff admin admin] Calling method '>' {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:18:06.326816 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-29b3e4fc-3f3d-4d5c-bd50-a7e186559cff admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.472152 Oct 05 02:18:06.328353 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 11/20] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Oct 5 02:18:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:18:09.416779 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-f4811527-83c9-4467-8a84-4091f644fae4 admin admin] Calling method '>' {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:18:09.417832 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-f4811527-83c9-4467-8a84-4091f644fae4 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Oct 05 02:18:09.418242 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 10/21] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 5 02:18:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:18:09.869040 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-aef9aa1e-38d0-4e34-af31-855dd457b4dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "rxtx_factor": 1.0, "id": "1", "name": "m1.tiny", "vcpus": 1, "ram": 512, "os-flavor-access:is_public": true}} {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:18:09.893954 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-aef9aa1e-38d0-4e34-af31-855dd457b4dc admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.469505 Oct 05 02:18:09.894506 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 12/22] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 5 02:18:09 2022] POST /compute/v2.1/flavors => generated 402 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:18:09.906834 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-5f62d7eb-eba8-4f3c-8942-5962c12d67e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:18:09.935087 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-5f62d7eb-eba8-4f3c-8942-5962c12d67e9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032119 Oct 05 02:18:09.935672 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 11/23] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Oct 5 02:18:09 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:18:12.596934 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-aef9aa1e-38d0-4e34-af31-855dd457b4dc admin admin] Calling method '>' {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:18:12.597936 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-aef9aa1e-38d0-4e34-af31-855dd457b4dc admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Oct 05 02:18:12.598354 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 5 02:18:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:18:13.008512 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-36480762-1fca-4d62-a572-910423e5a598 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "swap": 0, "rxtx_factor": 1.0, "disk": 20, "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2"}} {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:18:13.029057 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-36480762-1fca-4d62-a572-910423e5a598 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.424437 Oct 05 02:18:13.029737 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 12/25] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 5 02:18:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:18:13.041961 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-669f94fb-e605-4338-bb70-2c56b5082522 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:18:13.065876 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-669f94fb-e605-4338-bb70-2c56b5082522 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027584 Oct 05 02:18:13.066631 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 14/26] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Oct 5 02:18:13 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:18:15.713932 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-36480762-1fca-4d62-a572-910423e5a598 admin admin] Calling method '>' {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:18:15.714932 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-36480762-1fca-4d62-a572-910423e5a598 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Oct 05 02:18:15.715489 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 5 02:18:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:18:16.137870 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-f313a8f6-a5e6-44e4-a6a4-b31e034a5ac2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "ram": 4096, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "id": "3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:18:16.158223 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-f313a8f6-a5e6-44e4-a6a4-b31e034a5ac2 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.435945 Oct 05 02:18:16.165460 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 15/28] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 5 02:18:15 2022] POST /compute/v2.1/flavors => generated 406 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 02:18:16.170584 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-2754eb1b-af51-438a-a903-75156fe4ffd0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:18:16.183028 n-d-858272-3 devstack@n-api.service[106281]: DEBUG dbcounter [-] [106281] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:16.201375 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-2754eb1b-af51-438a-a903-75156fe4ffd0 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034300 Oct 05 02:18:16.210092 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 14/29] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Oct 5 02:18:16 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:18:18.865825 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-f313a8f6-a5e6-44e4-a6a4-b31e034a5ac2 admin admin] Calling method '>' {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:18:18.868163 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-f313a8f6-a5e6-44e4-a6a4-b31e034a5ac2 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002866 Oct 05 02:18:18.868824 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 5 02:18:18 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:18:19.314742 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-eacb90d3-2614-451b-b8f9-d27013624f97 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "disk": 80, "ram": 8192, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4}} {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:18:19.338687 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-eacb90d3-2614-451b-b8f9-d27013624f97 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.462435 Oct 05 02:18:19.339523 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 15/31] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 5 02:18:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:18:19.351866 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-0d2c26bf-b152-43d3-adc9-294541fd9ea3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:18:19.376020 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-0d2c26bf-b152-43d3-adc9-294541fd9ea3 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027794 Oct 05 02:18:19.376623 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 17/32] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Oct 5 02:18:19 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:18:22.016225 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-eacb90d3-2614-451b-b8f9-d27013624f97 admin admin] Calling method '>' {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:18:22.017269 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-eacb90d3-2614-451b-b8f9-d27013624f97 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Oct 05 02:18:22.022614 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 5 02:18:22 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:18:22.459447 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-b32812ce-ae39-407e-b9d7-dc3c25d71ecb admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "id": "5", "name": "m1.xlarge", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 160}} {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:18:22.469693 n-d-858272-3 devstack@n-api.service[106280]: DEBUG dbcounter [-] [106280] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:22.484162 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-b32812ce-ae39-407e-b9d7-dc3c25d71ecb admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.460455 Oct 05 02:18:22.484889 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 18/34] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Oct 5 02:18:22 2022] POST /compute/v2.1/flavors => generated 408 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:18:22.496578 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-4863add7-d406-499c-a521-a27582a4ce43 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:18:22.523113 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-4863add7-d406-499c-a521-a27582a4ce43 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030043 Oct 05 02:18:22.523701 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 17/35] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Oct 5 02:18:22 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:18:43.080794 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-b32812ce-ae39-407e-b9d7-dc3c25d71ecb admin admin] Calling method '>' {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:18:43.081828 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-b32812ce-ae39-407e-b9d7-dc3c25d71ecb admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Oct 05 02:18:43.082222 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 5 02:18:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:18:43.093268 n-d-858272-3 devstack@n-api.service[106281]: DEBUG dbcounter [-] [106281] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:43.467433 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-e64bf6e0-b4e7-42cc-9581-9a4674a4033f admin admin] Calling method '>' {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:18:43.485410 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-e64bf6e0-b4e7-42cc-9581-9a4674a4033f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.397037 Oct 05 02:18:43.485946 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Oct 5 02:18:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:18:44.806655 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-b32812ce-ae39-407e-b9d7-dc3c25d71ecb admin admin] Calling method '>' {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:18:44.807674 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-b32812ce-ae39-407e-b9d7-dc3c25d71ecb admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Oct 05 02:18:44.808075 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 5 02:18:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:18:45.355738 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-902008a5-79d4-425d-a1b3-bdef2c4ad6e2 admin admin] Calling method '>' {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:18:45.361720 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.wsgi [None req-902008a5-79d4-425d-a1b3-bdef2c4ad6e2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 05 02:18:45.364892 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-902008a5-79d4-425d-a1b3-bdef2c4ad6e2 admin admin] Request method failure captured: Oct 05 02:18:45.364892 n-d-858272-3 devstack@n-api.service[106281]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 05 02:18:45.364892 n-d-858272-3 devstack@n-api.service[106281]: Accept: application/json Oct 05 02:18:45.364892 n-d-858272-3 devstack@n-api.service[106281]: Accept-Encoding: gzip, deflate Oct 05 02:18:45.364892 n-d-858272-3 devstack@n-api.service[106281]: Connection: keep-alive Oct 05 02:18:45.364892 n-d-858272-3 devstack@n-api.service[106281]: Content-Length: 0 Oct 05 02:18:45.364892 n-d-858272-3 devstack@n-api.service[106281]: Host: 10.222.0.16 Oct 05 02:18:45.364892 n-d-858272-3 devstack@n-api.service[106281]: Openstack-Api-Version: compute 2.92 Oct 05 02:18:45.364892 n-d-858272-3 devstack@n-api.service[106281]: Openstack-System-Scope: None Oct 05 02:18:45.364892 n-d-858272-3 devstack@n-api.service[106281]: User-Agent: python-novaclient Oct 05 02:18:45.364892 n-d-858272-3 devstack@n-api.service[106281]: X-Auth-Token: gAAAAABjPOmEjwetjVT3g9M85zZm_4IWl-p5_Hyj0kcV2SPLBnsNdmbLVI3zX6M66RykeXb1QQdzk6ryNQHHl7rz0hLhaZBzFXH7H8JWqI8rou5MRu0VjdjW8AxEIR66YIkKAwXIVsU5rOc8M3C-dTKDPTPhiGeYAtX06FyRCi-zuauAWT1apio Oct 05 02:18:45.364892 n-d-858272-3 devstack@n-api.service[106281]: X-Domain-Id: None Oct 05 02:18:45.364892 n-d-858272-3 devstack@n-api.service[106281]: X-Domain-Name: None Oct 05 02:18:45.364892 n-d-858272-3 devstack@n-api.service[106281]: X-Identity-Status: Confirmed Oct 05 02:18:45.364892 n-d-858272-3 devstack@n-api.service[106281]: X-Is-Admin-Project: True Oct 05 02:18:45.364892 n-d-858272-3 devstack@n-api.service[106281]: X-Openstack-Nova-Api-Version: 2.92 Oct 05 02:18:45.364892 n-d-858272-3 devstack@n-api.service[106281]: X-Project-Domain-Id: default Oct 05 02:18:45.364892 n-d-858272-3 devstack@n-api.service[106281]: X-Project-Domain-Name: Default Oct 05 02:18:45.364892 n-d-858272-3 devstack@n-api.service[106281]: X-Project-Id: d86c8465865f42a8aed631f648876892 Oct 05 02:18:45.364892 n-d-858272-3 devstack@n-api.service[106281]: X-Project-Name: admin Oct 05 02:18:45.364892 n-d-858272-3 devstack@n-api.service[106281]: X-Role: admin,member,reader Oct 05 02:18:45.364892 n-d-858272-3 devstack@n-api.service[106281]: X-Roles: admin,member,reader Oct 05 02:18:45.366488 n-d-858272-3 devstack@n-api.service[106281]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d86c8465865f42a8aed631f648876892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d86c8465865f42a8aed631f648876892"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d86c8465865f42a8aed631f648876892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d86c8465865f42a8aed631f648876892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:18:45.366488 n-d-858272-3 devstack@n-api.service[106281]: X-Tenant: admin Oct 05 02:18:45.366488 n-d-858272-3 devstack@n-api.service[106281]: X-Tenant-Id: d86c8465865f42a8aed631f648876892 Oct 05 02:18:45.366488 n-d-858272-3 devstack@n-api.service[106281]: X-Tenant-Name: admin Oct 05 02:18:45.366488 n-d-858272-3 devstack@n-api.service[106281]: X-User: admin Oct 05 02:18:45.366488 n-d-858272-3 devstack@n-api.service[106281]: X-User-Domain-Id: default Oct 05 02:18:45.366488 n-d-858272-3 devstack@n-api.service[106281]: X-User-Domain-Name: Default Oct 05 02:18:45.366488 n-d-858272-3 devstack@n-api.service[106281]: X-User-Id: ed98d68710e84d4fbf59928bc3712add Oct 05 02:18:45.366488 n-d-858272-3 devstack@n-api.service[106281]: X-User-Name: admin Oct 05 02:18:45.366488 n-d-858272-3 devstack@n-api.service[106281]: method: > Oct 05 02:18:45.366488 n-d-858272-3 devstack@n-api.service[106281]: exception: Flavor 42 could not be found. Oct 05 02:18:45.366488 n-d-858272-3 devstack@n-api.service[106281]: action_args: {'id': '42'} Oct 05 02:18:45.366488 n-d-858272-3 devstack@n-api.service[106281]: {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:18:45.366488 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:18:45.367380 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 05 02:18:45.367380 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 05 02:18:45.367380 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 05 02:18:45.367380 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 05 02:18:45.367380 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:18:45.367380 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:18:45.367380 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 05 02:18:45.367380 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 05 02:18:45.367380 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 05 02:18:45.367380 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:18:45.367380 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 05 02:18:45.367380 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 05 02:18:45.367380 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 05 02:18:45.367380 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi Oct 05 02:18:45.367380 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:18:45.367380 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi Oct 05 02:18:45.367380 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:18:45.367380 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:18:45.367380 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:18:45.368623 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:18:45.368623 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:18:45.368623 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:18:45.368623 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:18:45.368623 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 05 02:18:45.368623 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:18:45.368623 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 05 02:18:45.368623 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi Oct 05 02:18:45.368623 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:18:45.368623 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi Oct 05 02:18:45.368623 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:18:45.368623 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:18:45.368623 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:18:45.368623 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:18:45.368623 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:18:45.368623 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 05 02:18:45.368623 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi Oct 05 02:18:45.368623 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-902008a5-79d4-425d-a1b3-bdef2c4ad6e2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:18:45.369795 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-902008a5-79d4-425d-a1b3-bdef2c4ad6e2 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.404195 Oct 05 02:18:45.369795 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1190 bytes} [Wed Oct 5 02:18:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 405 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 05 02:18:45.377271 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-395cfbf2-6999-4c5a-8d5a-2dd635ffe989 admin admin] Calling method '>' {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:18:45.399557 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-395cfbf2-6999-4c5a-8d5a-2dd635ffe989 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026966 Oct 05 02:18:45.400088 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Oct 5 02:18:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:18:45.415857 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-ab2aa8b3-0c9f-40b8-95b5-e04db5a742d8 admin admin] Calling method '>' {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:18:45.438996 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-ab2aa8b3-0c9f-40b8-95b5-e04db5a742d8 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027752 Oct 05 02:18:45.439542 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Oct 5 02:18:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:18:45.448996 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-5181fee3-da2e-4858-bb44-ecbccf7f7364 admin admin] Calling method '>' {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:18:45.455734 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.wsgi [None req-5181fee3-da2e-4858-bb44-ecbccf7f7364 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 05 02:18:45.458988 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-5181fee3-da2e-4858-bb44-ecbccf7f7364 admin admin] Request method failure captured: Oct 05 02:18:45.458988 n-d-858272-3 devstack@n-api.service[106280]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 05 02:18:45.458988 n-d-858272-3 devstack@n-api.service[106280]: Accept: application/json Oct 05 02:18:45.458988 n-d-858272-3 devstack@n-api.service[106280]: Accept-Encoding: gzip, deflate Oct 05 02:18:45.458988 n-d-858272-3 devstack@n-api.service[106280]: Connection: keep-alive Oct 05 02:18:45.458988 n-d-858272-3 devstack@n-api.service[106280]: Content-Length: 0 Oct 05 02:18:45.458988 n-d-858272-3 devstack@n-api.service[106280]: Host: 10.222.0.16 Oct 05 02:18:45.458988 n-d-858272-3 devstack@n-api.service[106280]: Openstack-Api-Version: compute 2.92 Oct 05 02:18:45.458988 n-d-858272-3 devstack@n-api.service[106280]: Openstack-System-Scope: None Oct 05 02:18:45.458988 n-d-858272-3 devstack@n-api.service[106280]: User-Agent: python-novaclient Oct 05 02:18:45.458988 n-d-858272-3 devstack@n-api.service[106280]: X-Auth-Token: gAAAAABjPOmEjwetjVT3g9M85zZm_4IWl-p5_Hyj0kcV2SPLBnsNdmbLVI3zX6M66RykeXb1QQdzk6ryNQHHl7rz0hLhaZBzFXH7H8JWqI8rou5MRu0VjdjW8AxEIR66YIkKAwXIVsU5rOc8M3C-dTKDPTPhiGeYAtX06FyRCi-zuauAWT1apio Oct 05 02:18:45.458988 n-d-858272-3 devstack@n-api.service[106280]: X-Domain-Id: None Oct 05 02:18:45.458988 n-d-858272-3 devstack@n-api.service[106280]: X-Domain-Name: None Oct 05 02:18:45.458988 n-d-858272-3 devstack@n-api.service[106280]: X-Identity-Status: Confirmed Oct 05 02:18:45.458988 n-d-858272-3 devstack@n-api.service[106280]: X-Is-Admin-Project: True Oct 05 02:18:45.458988 n-d-858272-3 devstack@n-api.service[106280]: X-Openstack-Nova-Api-Version: 2.92 Oct 05 02:18:45.458988 n-d-858272-3 devstack@n-api.service[106280]: X-Project-Domain-Id: default Oct 05 02:18:45.458988 n-d-858272-3 devstack@n-api.service[106280]: X-Project-Domain-Name: Default Oct 05 02:18:45.458988 n-d-858272-3 devstack@n-api.service[106280]: X-Project-Id: d86c8465865f42a8aed631f648876892 Oct 05 02:18:45.458988 n-d-858272-3 devstack@n-api.service[106280]: X-Project-Name: admin Oct 05 02:18:45.458988 n-d-858272-3 devstack@n-api.service[106280]: X-Role: admin,member,reader Oct 05 02:18:45.458988 n-d-858272-3 devstack@n-api.service[106280]: X-Roles: admin,member,reader Oct 05 02:18:45.460585 n-d-858272-3 devstack@n-api.service[106280]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d86c8465865f42a8aed631f648876892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d86c8465865f42a8aed631f648876892"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d86c8465865f42a8aed631f648876892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d86c8465865f42a8aed631f648876892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:18:45.460585 n-d-858272-3 devstack@n-api.service[106280]: X-Tenant: admin Oct 05 02:18:45.460585 n-d-858272-3 devstack@n-api.service[106280]: X-Tenant-Id: d86c8465865f42a8aed631f648876892 Oct 05 02:18:45.460585 n-d-858272-3 devstack@n-api.service[106280]: X-Tenant-Name: admin Oct 05 02:18:45.460585 n-d-858272-3 devstack@n-api.service[106280]: X-User: admin Oct 05 02:18:45.460585 n-d-858272-3 devstack@n-api.service[106280]: X-User-Domain-Id: default Oct 05 02:18:45.460585 n-d-858272-3 devstack@n-api.service[106280]: X-User-Domain-Name: Default Oct 05 02:18:45.460585 n-d-858272-3 devstack@n-api.service[106280]: X-User-Id: ed98d68710e84d4fbf59928bc3712add Oct 05 02:18:45.460585 n-d-858272-3 devstack@n-api.service[106280]: X-User-Name: admin Oct 05 02:18:45.460585 n-d-858272-3 devstack@n-api.service[106280]: method: > Oct 05 02:18:45.460585 n-d-858272-3 devstack@n-api.service[106280]: exception: Flavor 42 could not be found. Oct 05 02:18:45.460585 n-d-858272-3 devstack@n-api.service[106280]: action_args: {'id': '42'} Oct 05 02:18:45.460585 n-d-858272-3 devstack@n-api.service[106280]: {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:18:45.460585 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:18:45.461866 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 05 02:18:45.461866 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 05 02:18:45.461866 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 05 02:18:45.461866 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 05 02:18:45.461866 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:18:45.461866 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:18:45.461866 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 05 02:18:45.461866 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 05 02:18:45.461866 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 05 02:18:45.461866 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:18:45.461866 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 05 02:18:45.461866 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 05 02:18:45.461866 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 05 02:18:45.461866 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi Oct 05 02:18:45.461866 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:18:45.461866 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi Oct 05 02:18:45.461866 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:18:45.461866 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:18:45.461866 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:18:45.463190 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:18:45.463190 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:18:45.463190 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:18:45.463190 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:18:45.463190 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 05 02:18:45.463190 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:18:45.463190 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 05 02:18:45.463190 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi Oct 05 02:18:45.463190 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:18:45.463190 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi Oct 05 02:18:45.463190 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:18:45.463190 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:18:45.463190 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:18:45.463190 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:18:45.463190 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:18:45.463190 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 05 02:18:45.463190 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi Oct 05 02:18:45.463190 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-5181fee3-da2e-4858-bb44-ecbccf7f7364 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:18:45.464465 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-5181fee3-da2e-4858-bb44-ecbccf7f7364 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014898 Oct 05 02:18:45.464465 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1190 bytes} [Wed Oct 5 02:18:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 05 02:18:46.666483 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-ab2aa8b3-0c9f-40b8-95b5-e04db5a742d8 admin admin] Calling method '>' {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:18:46.667554 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-ab2aa8b3-0c9f-40b8-95b5-e04db5a742d8 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 05 02:18:46.667949 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 21/43] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 5 02:18:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:18:47.182068 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-4d713d5e-77d9-4631-8fa2-cc29b44be01e admin admin] Calling method '>' {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:18:47.187130 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.wsgi [None req-4d713d5e-77d9-4631-8fa2-cc29b44be01e admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 05 02:18:47.188619 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-4d713d5e-77d9-4631-8fa2-cc29b44be01e admin admin] Request method failure captured: Oct 05 02:18:47.188619 n-d-858272-3 devstack@n-api.service[106280]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 05 02:18:47.188619 n-d-858272-3 devstack@n-api.service[106280]: Accept: application/json Oct 05 02:18:47.188619 n-d-858272-3 devstack@n-api.service[106280]: Accept-Encoding: gzip, deflate Oct 05 02:18:47.188619 n-d-858272-3 devstack@n-api.service[106280]: Connection: keep-alive Oct 05 02:18:47.188619 n-d-858272-3 devstack@n-api.service[106280]: Content-Length: 0 Oct 05 02:18:47.188619 n-d-858272-3 devstack@n-api.service[106280]: Host: 10.222.0.16 Oct 05 02:18:47.188619 n-d-858272-3 devstack@n-api.service[106280]: Openstack-Api-Version: compute 2.92 Oct 05 02:18:47.188619 n-d-858272-3 devstack@n-api.service[106280]: Openstack-System-Scope: None Oct 05 02:18:47.188619 n-d-858272-3 devstack@n-api.service[106280]: User-Agent: python-novaclient Oct 05 02:18:47.188619 n-d-858272-3 devstack@n-api.service[106280]: X-Auth-Token: gAAAAABjPOmGlLG_1HQPCjW3ZkB43Q3poFFwjdLXX__K8OGjplprnyaY7_y2fk2j1seTdxjwfhWCONKsOd3paep1J8dcL823ucD77xmjqiJZxzvSNT6WgcvM2fWJAdRVcCQUmWbea7IYU5vcCEmZlrHe6vI6tfJ9cim67CzDVTMbZOe4LJoQgcI Oct 05 02:18:47.188619 n-d-858272-3 devstack@n-api.service[106280]: X-Domain-Id: None Oct 05 02:18:47.188619 n-d-858272-3 devstack@n-api.service[106280]: X-Domain-Name: None Oct 05 02:18:47.188619 n-d-858272-3 devstack@n-api.service[106280]: X-Identity-Status: Confirmed Oct 05 02:18:47.188619 n-d-858272-3 devstack@n-api.service[106280]: X-Is-Admin-Project: True Oct 05 02:18:47.188619 n-d-858272-3 devstack@n-api.service[106280]: X-Openstack-Nova-Api-Version: 2.92 Oct 05 02:18:47.188619 n-d-858272-3 devstack@n-api.service[106280]: X-Project-Domain-Id: default Oct 05 02:18:47.188619 n-d-858272-3 devstack@n-api.service[106280]: X-Project-Domain-Name: Default Oct 05 02:18:47.188619 n-d-858272-3 devstack@n-api.service[106280]: X-Project-Id: d86c8465865f42a8aed631f648876892 Oct 05 02:18:47.188619 n-d-858272-3 devstack@n-api.service[106280]: X-Project-Name: admin Oct 05 02:18:47.188619 n-d-858272-3 devstack@n-api.service[106280]: X-Role: admin,member,reader Oct 05 02:18:47.188619 n-d-858272-3 devstack@n-api.service[106280]: X-Roles: admin,member,reader Oct 05 02:18:47.190207 n-d-858272-3 devstack@n-api.service[106280]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d86c8465865f42a8aed631f648876892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d86c8465865f42a8aed631f648876892"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d86c8465865f42a8aed631f648876892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d86c8465865f42a8aed631f648876892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:18:47.190207 n-d-858272-3 devstack@n-api.service[106280]: X-Tenant: admin Oct 05 02:18:47.190207 n-d-858272-3 devstack@n-api.service[106280]: X-Tenant-Id: d86c8465865f42a8aed631f648876892 Oct 05 02:18:47.190207 n-d-858272-3 devstack@n-api.service[106280]: X-Tenant-Name: admin Oct 05 02:18:47.190207 n-d-858272-3 devstack@n-api.service[106280]: X-User: admin Oct 05 02:18:47.190207 n-d-858272-3 devstack@n-api.service[106280]: X-User-Domain-Id: default Oct 05 02:18:47.190207 n-d-858272-3 devstack@n-api.service[106280]: X-User-Domain-Name: Default Oct 05 02:18:47.190207 n-d-858272-3 devstack@n-api.service[106280]: X-User-Id: ed98d68710e84d4fbf59928bc3712add Oct 05 02:18:47.190207 n-d-858272-3 devstack@n-api.service[106280]: X-User-Name: admin Oct 05 02:18:47.190207 n-d-858272-3 devstack@n-api.service[106280]: method: > Oct 05 02:18:47.190207 n-d-858272-3 devstack@n-api.service[106280]: exception: Flavor 84 could not be found. Oct 05 02:18:47.190207 n-d-858272-3 devstack@n-api.service[106280]: action_args: {'id': '84'} Oct 05 02:18:47.190207 n-d-858272-3 devstack@n-api.service[106280]: {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:18:47.190207 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:18:47.191040 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 05 02:18:47.191040 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 05 02:18:47.191040 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 05 02:18:47.191040 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 05 02:18:47.191040 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:18:47.191040 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:18:47.191040 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 05 02:18:47.191040 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 05 02:18:47.191040 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 05 02:18:47.191040 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:18:47.191040 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 05 02:18:47.191040 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 05 02:18:47.191040 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 05 02:18:47.191040 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi Oct 05 02:18:47.191040 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:18:47.191040 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi Oct 05 02:18:47.191040 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:18:47.191040 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:18:47.191040 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:18:47.192109 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:18:47.192109 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:18:47.192109 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:18:47.192109 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:18:47.192109 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 05 02:18:47.192109 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:18:47.192109 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 05 02:18:47.192109 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi Oct 05 02:18:47.192109 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:18:47.192109 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi Oct 05 02:18:47.192109 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:18:47.192109 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:18:47.192109 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:18:47.192109 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:18:47.192109 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:18:47.192109 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 05 02:18:47.192109 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi Oct 05 02:18:47.192109 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-4d713d5e-77d9-4631-8fa2-cc29b44be01e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:18:47.193186 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-4d713d5e-77d9-4631-8fa2-cc29b44be01e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.386559 Oct 05 02:18:47.193186 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1190 bytes} [Wed Oct 5 02:18:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 05 02:18:47.199769 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-bb109dbe-5add-4107-945b-a18fe4d9eee6 admin admin] Calling method '>' {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:18:47.215245 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-bb109dbe-5add-4107-945b-a18fe4d9eee6 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019054 Oct 05 02:18:47.215763 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Oct 5 02:18:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:18:47.225432 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-d9e8ecae-9bb3-45d7-ace5-cd7bd98aa0ce admin admin] Calling method '>' {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:18:47.241467 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-d9e8ecae-9bb3-45d7-ace5-cd7bd98aa0ce admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019474 Oct 05 02:18:47.241982 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Oct 5 02:18:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:18:47.250924 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-006fc52c-8dec-4265-9f14-95d8f2015fa8 admin admin] Calling method '>' {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:18:47.255765 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.wsgi [None req-006fc52c-8dec-4265-9f14-95d8f2015fa8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 05 02:18:47.257292 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-006fc52c-8dec-4265-9f14-95d8f2015fa8 admin admin] Request method failure captured: Oct 05 02:18:47.257292 n-d-858272-3 devstack@n-api.service[106281]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 05 02:18:47.257292 n-d-858272-3 devstack@n-api.service[106281]: Accept: application/json Oct 05 02:18:47.257292 n-d-858272-3 devstack@n-api.service[106281]: Accept-Encoding: gzip, deflate Oct 05 02:18:47.257292 n-d-858272-3 devstack@n-api.service[106281]: Connection: keep-alive Oct 05 02:18:47.257292 n-d-858272-3 devstack@n-api.service[106281]: Content-Length: 0 Oct 05 02:18:47.257292 n-d-858272-3 devstack@n-api.service[106281]: Host: 10.222.0.16 Oct 05 02:18:47.257292 n-d-858272-3 devstack@n-api.service[106281]: Openstack-Api-Version: compute 2.92 Oct 05 02:18:47.257292 n-d-858272-3 devstack@n-api.service[106281]: Openstack-System-Scope: None Oct 05 02:18:47.257292 n-d-858272-3 devstack@n-api.service[106281]: User-Agent: python-novaclient Oct 05 02:18:47.257292 n-d-858272-3 devstack@n-api.service[106281]: X-Auth-Token: gAAAAABjPOmGlLG_1HQPCjW3ZkB43Q3poFFwjdLXX__K8OGjplprnyaY7_y2fk2j1seTdxjwfhWCONKsOd3paep1J8dcL823ucD77xmjqiJZxzvSNT6WgcvM2fWJAdRVcCQUmWbea7IYU5vcCEmZlrHe6vI6tfJ9cim67CzDVTMbZOe4LJoQgcI Oct 05 02:18:47.257292 n-d-858272-3 devstack@n-api.service[106281]: X-Domain-Id: None Oct 05 02:18:47.257292 n-d-858272-3 devstack@n-api.service[106281]: X-Domain-Name: None Oct 05 02:18:47.257292 n-d-858272-3 devstack@n-api.service[106281]: X-Identity-Status: Confirmed Oct 05 02:18:47.257292 n-d-858272-3 devstack@n-api.service[106281]: X-Is-Admin-Project: True Oct 05 02:18:47.257292 n-d-858272-3 devstack@n-api.service[106281]: X-Openstack-Nova-Api-Version: 2.92 Oct 05 02:18:47.257292 n-d-858272-3 devstack@n-api.service[106281]: X-Project-Domain-Id: default Oct 05 02:18:47.257292 n-d-858272-3 devstack@n-api.service[106281]: X-Project-Domain-Name: Default Oct 05 02:18:47.257292 n-d-858272-3 devstack@n-api.service[106281]: X-Project-Id: d86c8465865f42a8aed631f648876892 Oct 05 02:18:47.257292 n-d-858272-3 devstack@n-api.service[106281]: X-Project-Name: admin Oct 05 02:18:47.257292 n-d-858272-3 devstack@n-api.service[106281]: X-Role: admin,member,reader Oct 05 02:18:47.257292 n-d-858272-3 devstack@n-api.service[106281]: X-Roles: admin,member,reader Oct 05 02:18:47.258792 n-d-858272-3 devstack@n-api.service[106281]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d86c8465865f42a8aed631f648876892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d86c8465865f42a8aed631f648876892"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d86c8465865f42a8aed631f648876892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d86c8465865f42a8aed631f648876892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:18:47.258792 n-d-858272-3 devstack@n-api.service[106281]: X-Tenant: admin Oct 05 02:18:47.258792 n-d-858272-3 devstack@n-api.service[106281]: X-Tenant-Id: d86c8465865f42a8aed631f648876892 Oct 05 02:18:47.258792 n-d-858272-3 devstack@n-api.service[106281]: X-Tenant-Name: admin Oct 05 02:18:47.258792 n-d-858272-3 devstack@n-api.service[106281]: X-User: admin Oct 05 02:18:47.258792 n-d-858272-3 devstack@n-api.service[106281]: X-User-Domain-Id: default Oct 05 02:18:47.258792 n-d-858272-3 devstack@n-api.service[106281]: X-User-Domain-Name: Default Oct 05 02:18:47.258792 n-d-858272-3 devstack@n-api.service[106281]: X-User-Id: ed98d68710e84d4fbf59928bc3712add Oct 05 02:18:47.258792 n-d-858272-3 devstack@n-api.service[106281]: X-User-Name: admin Oct 05 02:18:47.258792 n-d-858272-3 devstack@n-api.service[106281]: method: > Oct 05 02:18:47.258792 n-d-858272-3 devstack@n-api.service[106281]: exception: Flavor 84 could not be found. Oct 05 02:18:47.258792 n-d-858272-3 devstack@n-api.service[106281]: action_args: {'id': '84'} Oct 05 02:18:47.258792 n-d-858272-3 devstack@n-api.service[106281]: {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:18:47.258792 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:18:47.259700 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 05 02:18:47.259700 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 05 02:18:47.259700 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 05 02:18:47.259700 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 05 02:18:47.259700 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:18:47.259700 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:18:47.259700 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 05 02:18:47.259700 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 05 02:18:47.259700 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 05 02:18:47.259700 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:18:47.259700 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 05 02:18:47.259700 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 05 02:18:47.259700 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 05 02:18:47.259700 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi Oct 05 02:18:47.259700 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:18:47.259700 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi Oct 05 02:18:47.259700 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:18:47.259700 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:18:47.259700 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:18:47.261046 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:18:47.261046 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:18:47.261046 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:18:47.261046 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:18:47.261046 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 05 02:18:47.261046 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:18:47.261046 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 05 02:18:47.261046 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi Oct 05 02:18:47.261046 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:18:47.261046 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi Oct 05 02:18:47.261046 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:18:47.261046 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:18:47.261046 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:18:47.261046 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:18:47.261046 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:18:47.261046 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 05 02:18:47.261046 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi Oct 05 02:18:47.261046 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-006fc52c-8dec-4265-9f14-95d8f2015fa8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:18:47.262302 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-006fc52c-8dec-4265-9f14-95d8f2015fa8 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011167 Oct 05 02:18:47.262302 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 23/47] 10.222.0.16 () {60 vars in 1190 bytes} [Wed Oct 5 02:18:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 05 02:18:48.490885 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-d9e8ecae-9bb3-45d7-ace5-cd7bd98aa0ce admin admin] Calling method '>' {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:18:48.491964 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-d9e8ecae-9bb3-45d7-ace5-cd7bd98aa0ce admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Oct 05 02:18:48.492357 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 25/48] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 5 02:18:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:18:49.031509 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-4eb4d27f-6446-49bc-b3e4-9b6293068d86 admin admin] Calling method '>' {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:18:49.039392 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.wsgi [None req-4eb4d27f-6446-49bc-b3e4-9b6293068d86 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 05 02:18:49.040888 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-4eb4d27f-6446-49bc-b3e4-9b6293068d86 admin admin] Request method failure captured: Oct 05 02:18:49.040888 n-d-858272-3 devstack@n-api.service[106281]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 05 02:18:49.040888 n-d-858272-3 devstack@n-api.service[106281]: Accept: application/json Oct 05 02:18:49.040888 n-d-858272-3 devstack@n-api.service[106281]: Accept-Encoding: gzip, deflate Oct 05 02:18:49.040888 n-d-858272-3 devstack@n-api.service[106281]: Connection: keep-alive Oct 05 02:18:49.040888 n-d-858272-3 devstack@n-api.service[106281]: Content-Length: 0 Oct 05 02:18:49.040888 n-d-858272-3 devstack@n-api.service[106281]: Host: 10.222.0.16 Oct 05 02:18:49.040888 n-d-858272-3 devstack@n-api.service[106281]: Openstack-Api-Version: compute 2.92 Oct 05 02:18:49.040888 n-d-858272-3 devstack@n-api.service[106281]: Openstack-System-Scope: None Oct 05 02:18:49.040888 n-d-858272-3 devstack@n-api.service[106281]: User-Agent: python-novaclient Oct 05 02:18:49.040888 n-d-858272-3 devstack@n-api.service[106281]: X-Auth-Token: gAAAAABjPOmIWw4tq2Y3YPrx8QTt740LuRwv__Keqlkoj3ISHN2Hb0ezXdPb4Jv43j3lebxWiILbnW9PMLXjJGO4EvPC7PL5iy9kRKYCTnsHfuzSPbml7vnK_ZwC8FXnH66X0oH3dDrRfyMtiTHBAscSAtEXsqa6ksyLhMQZf12pkESDBocqqXQ Oct 05 02:18:49.040888 n-d-858272-3 devstack@n-api.service[106281]: X-Domain-Id: None Oct 05 02:18:49.040888 n-d-858272-3 devstack@n-api.service[106281]: X-Domain-Name: None Oct 05 02:18:49.040888 n-d-858272-3 devstack@n-api.service[106281]: X-Identity-Status: Confirmed Oct 05 02:18:49.040888 n-d-858272-3 devstack@n-api.service[106281]: X-Is-Admin-Project: True Oct 05 02:18:49.040888 n-d-858272-3 devstack@n-api.service[106281]: X-Openstack-Nova-Api-Version: 2.92 Oct 05 02:18:49.040888 n-d-858272-3 devstack@n-api.service[106281]: X-Project-Domain-Id: default Oct 05 02:18:49.040888 n-d-858272-3 devstack@n-api.service[106281]: X-Project-Domain-Name: Default Oct 05 02:18:49.040888 n-d-858272-3 devstack@n-api.service[106281]: X-Project-Id: d86c8465865f42a8aed631f648876892 Oct 05 02:18:49.040888 n-d-858272-3 devstack@n-api.service[106281]: X-Project-Name: admin Oct 05 02:18:49.040888 n-d-858272-3 devstack@n-api.service[106281]: X-Role: admin,member,reader Oct 05 02:18:49.040888 n-d-858272-3 devstack@n-api.service[106281]: X-Roles: admin,member,reader Oct 05 02:18:49.042466 n-d-858272-3 devstack@n-api.service[106281]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d86c8465865f42a8aed631f648876892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d86c8465865f42a8aed631f648876892"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d86c8465865f42a8aed631f648876892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d86c8465865f42a8aed631f648876892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:18:49.042466 n-d-858272-3 devstack@n-api.service[106281]: X-Tenant: admin Oct 05 02:18:49.042466 n-d-858272-3 devstack@n-api.service[106281]: X-Tenant-Id: d86c8465865f42a8aed631f648876892 Oct 05 02:18:49.042466 n-d-858272-3 devstack@n-api.service[106281]: X-Tenant-Name: admin Oct 05 02:18:49.042466 n-d-858272-3 devstack@n-api.service[106281]: X-User: admin Oct 05 02:18:49.042466 n-d-858272-3 devstack@n-api.service[106281]: X-User-Domain-Id: default Oct 05 02:18:49.042466 n-d-858272-3 devstack@n-api.service[106281]: X-User-Domain-Name: Default Oct 05 02:18:49.042466 n-d-858272-3 devstack@n-api.service[106281]: X-User-Id: ed98d68710e84d4fbf59928bc3712add Oct 05 02:18:49.042466 n-d-858272-3 devstack@n-api.service[106281]: X-User-Name: admin Oct 05 02:18:49.042466 n-d-858272-3 devstack@n-api.service[106281]: method: > Oct 05 02:18:49.042466 n-d-858272-3 devstack@n-api.service[106281]: exception: Flavor 451 could not be found. Oct 05 02:18:49.042466 n-d-858272-3 devstack@n-api.service[106281]: action_args: {'id': '451'} Oct 05 02:18:49.042466 n-d-858272-3 devstack@n-api.service[106281]: {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:18:49.042466 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:18:49.043559 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 05 02:18:49.043559 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 05 02:18:49.043559 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 05 02:18:49.043559 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 05 02:18:49.043559 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:18:49.043559 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:18:49.043559 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 05 02:18:49.043559 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 05 02:18:49.043559 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 05 02:18:49.043559 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:18:49.043559 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 05 02:18:49.043559 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 05 02:18:49.043559 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 05 02:18:49.043559 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi Oct 05 02:18:49.043559 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:18:49.043559 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi Oct 05 02:18:49.043559 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:18:49.043559 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:18:49.043559 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:18:49.044943 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:18:49.044943 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:18:49.044943 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:18:49.044943 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:18:49.044943 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 05 02:18:49.044943 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:18:49.044943 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 05 02:18:49.044943 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi Oct 05 02:18:49.044943 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:18:49.044943 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi Oct 05 02:18:49.044943 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:18:49.044943 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:18:49.044943 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:18:49.044943 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:18:49.044943 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:18:49.044943 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 05 02:18:49.044943 n-d-858272-3 devstack@n-api.service[106281]: ERROR nova.api.openstack.wsgi Oct 05 02:18:49.044943 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-4eb4d27f-6446-49bc-b3e4-9b6293068d86 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:18:49.048209 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-4eb4d27f-6446-49bc-b3e4-9b6293068d86 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.412461 Oct 05 02:18:49.048209 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 24/49] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Oct 5 02:18:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 413 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 05 02:18:49.053991 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-d3750a19-e90b-4e11-afe1-7f1242e6a2cd admin admin] Calling method '>' {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:18:49.069393 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-d3750a19-e90b-4e11-afe1-7f1242e6a2cd admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019039 Oct 05 02:18:49.069913 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Oct 5 02:18:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:18:49.079584 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-1d6e6ca7-c483-46b2-bfe5-2d9090b3f98f admin admin] Calling method '>' {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:18:49.094449 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-1d6e6ca7-c483-46b2-bfe5-2d9090b3f98f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018577 Oct 05 02:18:49.094968 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 25/51] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Oct 5 02:18:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:18:49.104172 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-959de464-37b1-48e6-a9db-5324bc59171c admin admin] Calling method '>' {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:18:49.110690 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.wsgi [None req-959de464-37b1-48e6-a9db-5324bc59171c admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 05 02:18:49.112185 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-959de464-37b1-48e6-a9db-5324bc59171c admin admin] Request method failure captured: Oct 05 02:18:49.112185 n-d-858272-3 devstack@n-api.service[106280]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 05 02:18:49.112185 n-d-858272-3 devstack@n-api.service[106280]: Accept: application/json Oct 05 02:18:49.112185 n-d-858272-3 devstack@n-api.service[106280]: Accept-Encoding: gzip, deflate Oct 05 02:18:49.112185 n-d-858272-3 devstack@n-api.service[106280]: Connection: keep-alive Oct 05 02:18:49.112185 n-d-858272-3 devstack@n-api.service[106280]: Content-Length: 0 Oct 05 02:18:49.112185 n-d-858272-3 devstack@n-api.service[106280]: Host: 10.222.0.16 Oct 05 02:18:49.112185 n-d-858272-3 devstack@n-api.service[106280]: Openstack-Api-Version: compute 2.92 Oct 05 02:18:49.112185 n-d-858272-3 devstack@n-api.service[106280]: Openstack-System-Scope: None Oct 05 02:18:49.112185 n-d-858272-3 devstack@n-api.service[106280]: User-Agent: python-novaclient Oct 05 02:18:49.112185 n-d-858272-3 devstack@n-api.service[106280]: X-Auth-Token: gAAAAABjPOmIWw4tq2Y3YPrx8QTt740LuRwv__Keqlkoj3ISHN2Hb0ezXdPb4Jv43j3lebxWiILbnW9PMLXjJGO4EvPC7PL5iy9kRKYCTnsHfuzSPbml7vnK_ZwC8FXnH66X0oH3dDrRfyMtiTHBAscSAtEXsqa6ksyLhMQZf12pkESDBocqqXQ Oct 05 02:18:49.112185 n-d-858272-3 devstack@n-api.service[106280]: X-Domain-Id: None Oct 05 02:18:49.112185 n-d-858272-3 devstack@n-api.service[106280]: X-Domain-Name: None Oct 05 02:18:49.112185 n-d-858272-3 devstack@n-api.service[106280]: X-Identity-Status: Confirmed Oct 05 02:18:49.112185 n-d-858272-3 devstack@n-api.service[106280]: X-Is-Admin-Project: True Oct 05 02:18:49.112185 n-d-858272-3 devstack@n-api.service[106280]: X-Openstack-Nova-Api-Version: 2.92 Oct 05 02:18:49.112185 n-d-858272-3 devstack@n-api.service[106280]: X-Project-Domain-Id: default Oct 05 02:18:49.112185 n-d-858272-3 devstack@n-api.service[106280]: X-Project-Domain-Name: Default Oct 05 02:18:49.112185 n-d-858272-3 devstack@n-api.service[106280]: X-Project-Id: d86c8465865f42a8aed631f648876892 Oct 05 02:18:49.112185 n-d-858272-3 devstack@n-api.service[106280]: X-Project-Name: admin Oct 05 02:18:49.112185 n-d-858272-3 devstack@n-api.service[106280]: X-Role: admin,member,reader Oct 05 02:18:49.112185 n-d-858272-3 devstack@n-api.service[106280]: X-Roles: admin,member,reader Oct 05 02:18:49.113737 n-d-858272-3 devstack@n-api.service[106280]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d86c8465865f42a8aed631f648876892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d86c8465865f42a8aed631f648876892"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d86c8465865f42a8aed631f648876892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d86c8465865f42a8aed631f648876892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:18:49.113737 n-d-858272-3 devstack@n-api.service[106280]: X-Tenant: admin Oct 05 02:18:49.113737 n-d-858272-3 devstack@n-api.service[106280]: X-Tenant-Id: d86c8465865f42a8aed631f648876892 Oct 05 02:18:49.113737 n-d-858272-3 devstack@n-api.service[106280]: X-Tenant-Name: admin Oct 05 02:18:49.113737 n-d-858272-3 devstack@n-api.service[106280]: X-User: admin Oct 05 02:18:49.113737 n-d-858272-3 devstack@n-api.service[106280]: X-User-Domain-Id: default Oct 05 02:18:49.113737 n-d-858272-3 devstack@n-api.service[106280]: X-User-Domain-Name: Default Oct 05 02:18:49.113737 n-d-858272-3 devstack@n-api.service[106280]: X-User-Id: ed98d68710e84d4fbf59928bc3712add Oct 05 02:18:49.113737 n-d-858272-3 devstack@n-api.service[106280]: X-User-Name: admin Oct 05 02:18:49.113737 n-d-858272-3 devstack@n-api.service[106280]: method: > Oct 05 02:18:49.113737 n-d-858272-3 devstack@n-api.service[106280]: exception: Flavor 451 could not be found. Oct 05 02:18:49.113737 n-d-858272-3 devstack@n-api.service[106280]: action_args: {'id': '451'} Oct 05 02:18:49.113737 n-d-858272-3 devstack@n-api.service[106280]: {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:18:49.113737 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:18:49.114776 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 05 02:18:49.114776 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 05 02:18:49.114776 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 05 02:18:49.114776 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 05 02:18:49.114776 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:18:49.114776 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:18:49.114776 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 05 02:18:49.114776 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 05 02:18:49.114776 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 05 02:18:49.114776 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:18:49.114776 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 05 02:18:49.114776 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 05 02:18:49.114776 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 05 02:18:49.114776 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi Oct 05 02:18:49.114776 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:18:49.114776 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi Oct 05 02:18:49.114776 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:18:49.114776 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:18:49.114776 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:18:49.116220 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:18:49.116220 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:18:49.116220 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:18:49.116220 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:18:49.116220 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 05 02:18:49.116220 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:18:49.116220 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 05 02:18:49.116220 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi Oct 05 02:18:49.116220 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:18:49.116220 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi Oct 05 02:18:49.116220 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:18:49.116220 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:18:49.116220 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:18:49.116220 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:18:49.116220 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:18:49.116220 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 05 02:18:49.116220 n-d-858272-3 devstack@n-api.service[106280]: ERROR nova.api.openstack.wsgi Oct 05 02:18:49.116220 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-959de464-37b1-48e6-a9db-5324bc59171c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:18:49.117511 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-959de464-37b1-48e6-a9db-5324bc59171c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012958 Oct 05 02:18:49.117511 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 27/52] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Oct 5 02:18:49 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 05 02:18:50.328926 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-1d6e6ca7-c483-46b2-bfe5-2d9090b3f98f admin admin] Calling method '>' {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:18:50.329968 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-1d6e6ca7-c483-46b2-bfe5-2d9090b3f98f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 05 02:18:50.330350 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 5 02:18:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:18:50.851598 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-96c1806b-3bc1-40b8-bbc5-298c4dd7c23a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:18:50.870663 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-96c1806b-3bc1-40b8-bbc5-298c4dd7c23a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.404030 Oct 05 02:18:50.871224 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 28/54] 10.222.0.16 () {64 vars in 1235 bytes} [Wed Oct 5 02:18:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:18:52.092471 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-1d6e6ca7-c483-46b2-bfe5-2d9090b3f98f admin admin] Calling method '>' {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:18:52.093577 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-1d6e6ca7-c483-46b2-bfe5-2d9090b3f98f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001712 Oct 05 02:18:52.093986 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 5 02:18:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:18:52.612833 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-0358c801-6eb7-474c-9cf2-6640e8cb8dbb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:18:52.630895 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-0358c801-6eb7-474c-9cf2-6640e8cb8dbb admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.401280 Oct 05 02:18:52.631441 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1235 bytes} [Wed Oct 5 02:18:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:18:53.845533 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-1d6e6ca7-c483-46b2-bfe5-2d9090b3f98f admin admin] Calling method '>' {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:18:53.846535 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-1d6e6ca7-c483-46b2-bfe5-2d9090b3f98f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Oct 05 02:18:53.846928 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 5 02:18:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:18:54.362631 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-fbe0df47-e00b-4393-9a68-47e095b5815b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:18:54.381886 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-fbe0df47-e00b-4393-9a68-47e095b5815b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.399181 Oct 05 02:18:54.382421 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 30/58] 10.222.0.16 () {64 vars in 1235 bytes} [Wed Oct 5 02:18:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 02:18:55.600064 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-1d6e6ca7-c483-46b2-bfe5-2d9090b3f98f admin admin] Calling method '>' {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:18:55.601093 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-1d6e6ca7-c483-46b2-bfe5-2d9090b3f98f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Oct 05 02:18:55.601487 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 29/59] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 5 02:18:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:18:56.123411 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-f427e97e-7a5e-4700-be7f-9d85c6d889e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:18:56.143059 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-f427e97e-7a5e-4700-be7f-9d85c6d889e6 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.405154 Oct 05 02:18:56.143600 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 31/60] 10.222.0.16 () {64 vars in 1235 bytes} [Wed Oct 5 02:18:55 2022] POST /compute/v2.1/flavors => generated 409 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:18:57.354138 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-1d6e6ca7-c483-46b2-bfe5-2d9090b3f98f admin admin] Calling method '>' {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:18:57.355141 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-1d6e6ca7-c483-46b2-bfe5-2d9090b3f98f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Oct 05 02:18:57.355534 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 30/61] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 5 02:18:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:18:57.873427 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-7a2eee69-8816-4717-b7c0-db8ea031aa6b admin admin] Calling method '>' {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:18:57.893690 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-7a2eee69-8816-4717-b7c0-db8ea031aa6b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.401349 Oct 05 02:18:57.894232 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1202 bytes} [Wed Oct 5 02:18:57 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:19:54.809223 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-1d6e6ca7-c483-46b2-bfe5-2d9090b3f98f admin admin] Calling method '>' {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:19:54.810749 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-1d6e6ca7-c483-46b2-bfe5-2d9090b3f98f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Oct 05 02:19:54.811150 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 31/63] 10.222.0.16 () {54 vars in 931 bytes} [Wed Oct 5 02:19:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:19:54.821490 n-d-858272-3 devstack@n-api.service[106280]: DEBUG dbcounter [-] [106280] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:19:55.203801 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-f0849e67-2ddf-4039-8440-d3a150a32294 admin admin] Calling method '>' {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:19:55.226967 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-f0849e67-2ddf-4039-8440-d3a150a32294 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.409797 Oct 05 02:19:55.227443 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 33/64] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Oct 5 02:19:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:19:55.249129 n-d-858272-3 devstack@n-api.service[106281]: DEBUG dbcounter [-] [106281] Writing DB stats nova_api:SELECT=14 {{(pid=106281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:19:55.252807 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-da5c5c54-713d-41d7-82a2-92a1ed2ac49d admin admin] Calling method '>' {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:19:55.260058 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-da5c5c54-713d-41d7-82a2-92a1ed2ac49d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012446 Oct 05 02:19:55.260573 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 32/65] 10.222.0.16 () {60 vars in 1283 bytes} [Wed Oct 5 02:19:55 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:19:55.272657 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-5cace763-4f13-4907-8fd2-c5865e7d2da3 admin admin] Calling method '>' {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:19:55.281152 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-5cace763-4f13-4907-8fd2-c5865e7d2da3 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011961 Oct 05 02:19:55.281662 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 34/66] 10.222.0.16 () {60 vars in 1286 bytes} [Wed Oct 5 02:19:55 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:19:55.292919 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-c2a22b00-073a-4780-b360-4046e9bb10a1 admin admin] Calling method '>' {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:19:55.300032 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-c2a22b00-073a-4780-b360-4046e9bb10a1 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010556 Oct 05 02:19:55.300536 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 33/67] 10.222.0.16 () {60 vars in 1286 bytes} [Wed Oct 5 02:19:55 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:19:55.311982 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-69114d49-0289-4231-8d11-0b4b7b1c3917 admin admin] Calling method '>' {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:19:55.319271 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-69114d49-0289-4231-8d11-0b4b7b1c3917 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011174 Oct 05 02:19:55.319776 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 35/68] 10.222.0.16 () {60 vars in 1283 bytes} [Wed Oct 5 02:19:55 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:25:10.394101 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-c2a22b00-073a-4780-b360-4046e9bb10a1 admin admin] Calling method '>' {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:25:10.395123 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-c2a22b00-073a-4780-b360-4046e9bb10a1 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Oct 05 02:25:10.395510 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 34/69] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 5 02:25:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:25:10.535442 n-d-858272-3 devstack@n-api.service[106280]: DEBUG dbcounter [-] [106280] Writing DB stats nova_api:SELECT=6 {{(pid=106280) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:25:10.680756 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-ac02591b-a1fd-4058-a67a-39250170e76e admin admin] Calling method '>' {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:25:10.685493 n-d-858272-3 devstack@n-api.service[106280]: DEBUG oslo_concurrency.lockutils [None req-ac02591b-a1fd-4058-a67a-39250170e76e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:25:10.685970 n-d-858272-3 devstack@n-api.service[106280]: DEBUG oslo_concurrency.lockutils [None req-ac02591b-a1fd-4058-a67a-39250170e76e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:25:10.686402 n-d-858272-3 devstack@n-api.service[106280]: DEBUG oslo_concurrency.lockutils [None req-ac02591b-a1fd-4058-a67a-39250170e76e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:25:10.687113 n-d-858272-3 devstack@n-api.service[106280]: DEBUG oslo_concurrency.lockutils [None req-ac02591b-a1fd-4058-a67a-39250170e76e admin admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:25:10.687559 n-d-858272-3 devstack@n-api.service[106280]: DEBUG oslo_concurrency.lockutils [None req-ac02591b-a1fd-4058-a67a-39250170e76e admin admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:25:10.687976 n-d-858272-3 devstack@n-api.service[106280]: DEBUG oslo_concurrency.lockutils [None req-ac02591b-a1fd-4058-a67a-39250170e76e admin admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:25:10.727563 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-ac02591b-a1fd-4058-a67a-39250170e76e admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.193231 Oct 05 02:25:10.728127 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 36/70] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Oct 5 02:25:10 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:25:11.806077 n-d-858272-3 devstack@n-api.service[106281]: DEBUG nova.api.openstack.wsgi [None req-c2a22b00-073a-4780-b360-4046e9bb10a1 admin admin] Calling method '>' {{(pid=106281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:25:11.807103 n-d-858272-3 devstack@n-api.service[106281]: INFO nova.api.openstack.requestlog [None req-c2a22b00-073a-4780-b360-4046e9bb10a1 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Oct 05 02:25:11.807511 n-d-858272-3 devstack@n-api.service[106281]: [pid: 106281|app: 0|req: 35/71] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Oct 5 02:25:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:25:11.999076 n-d-858272-3 devstack@n-api.service[106280]: DEBUG nova.api.openstack.wsgi [None req-85aba211-791d-4cb7-8b8c-3116d31693eb admin admin] Calling method '>' {{(pid=106280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:25:12.002469 n-d-858272-3 devstack@n-api.service[106280]: DEBUG oslo_concurrency.lockutils [None req-85aba211-791d-4cb7-8b8c-3116d31693eb admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:25:12.002940 n-d-858272-3 devstack@n-api.service[106280]: DEBUG oslo_concurrency.lockutils [None req-85aba211-791d-4cb7-8b8c-3116d31693eb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:25:12.003358 n-d-858272-3 devstack@n-api.service[106280]: DEBUG oslo_concurrency.lockutils [None req-85aba211-791d-4cb7-8b8c-3116d31693eb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:25:12.004060 n-d-858272-3 devstack@n-api.service[106280]: DEBUG oslo_concurrency.lockutils [None req-85aba211-791d-4cb7-8b8c-3116d31693eb admin admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:25:12.004497 n-d-858272-3 devstack@n-api.service[106280]: DEBUG oslo_concurrency.lockutils [None req-85aba211-791d-4cb7-8b8c-3116d31693eb admin admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:25:12.004926 n-d-858272-3 devstack@n-api.service[106280]: DEBUG oslo_concurrency.lockutils [None req-85aba211-791d-4cb7-8b8c-3116d31693eb admin admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:25:12.028267 n-d-858272-3 devstack@n-api.service[106280]: INFO nova.api.openstack.requestlog [None req-85aba211-791d-4cb7-8b8c-3116d31693eb admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.082190 Oct 05 02:25:12.028798 n-d-858272-3 devstack@n-api.service[106280]: [pid: 106280|app: 0|req: 37/72] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Oct 5 02:25:11 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:25:55.978912 n-d-858272-3 devstack@n-api.service[106279]: Wed Oct 5 02:25:55 2022 - graceful shutdown triggered... Oct 05 02:25:55.979428 n-d-858272-3 devstack@n-api.service[106280]: Gracefully killing worker 1 (pid: 106280)... Oct 05 02:25:55.979788 n-d-858272-3 devstack@n-api.service[106281]: Gracefully killing worker 2 (pid: 106281)... Oct 05 02:25:55.980695 n-d-858272-3 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 05 02:25:56.106696 n-d-858272-3 devstack@n-api.service[106281]: DEBUG dbcounter [-] [106281] Writing DB stats nova_api:SELECT=4 {{(pid=106281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:25:56.980124 n-d-858272-3 devstack@n-api.service[106279]: worker 1 buried after 1 seconds Oct 05 02:25:56.980124 n-d-858272-3 devstack@n-api.service[106279]: worker 2 buried after 1 seconds Oct 05 02:25:56.980124 n-d-858272-3 devstack@n-api.service[106279]: goodbye to uWSGI. Oct 05 02:25:56.981748 n-d-858272-3 systemd[1]: devstack@n-api.service: Succeeded. Oct 05 02:25:56.982307 n-d-858272-3 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 05 02:25:56.985093 n-d-858272-3 systemd[1]: Starting Devstack devstack@n-api.service... Oct 05 02:25:57.006935 n-d-858272-3 devstack@n-api.service[122305]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 05 02:25:57.027005 n-d-858272-3 devstack@n-api.service[122305]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 5 02:25:57 2022] *** Oct 05 02:25:57.027005 n-d-858272-3 devstack@n-api.service[122305]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 05 02:25:57.027005 n-d-858272-3 devstack@n-api.service[122305]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 05 02:25:57.027005 n-d-858272-3 devstack@n-api.service[122305]: nodename: n-d-858272-3 Oct 05 02:25:57.027005 n-d-858272-3 devstack@n-api.service[122305]: machine: x86_64 Oct 05 02:25:57.027005 n-d-858272-3 devstack@n-api.service[122305]: clock source: unix Oct 05 02:25:57.027005 n-d-858272-3 devstack@n-api.service[122305]: pcre jit disabled Oct 05 02:25:57.027005 n-d-858272-3 devstack@n-api.service[122305]: detected number of CPU cores: 4 Oct 05 02:25:57.027005 n-d-858272-3 devstack@n-api.service[122305]: current working directory: / Oct 05 02:25:57.027005 n-d-858272-3 devstack@n-api.service[122305]: detected binary path: /usr/bin/uwsgi-core Oct 05 02:25:57.027005 n-d-858272-3 devstack@n-api.service[122305]: your processes number limit is 47680 Oct 05 02:25:57.027005 n-d-858272-3 devstack@n-api.service[122305]: your memory page size is 4096 bytes Oct 05 02:25:57.027999 n-d-858272-3 devstack@n-api.service[122305]: detected max file descriptor number: 2048 Oct 05 02:25:57.027999 n-d-858272-3 devstack@n-api.service[122305]: lock engine: pthread robust mutexes Oct 05 02:25:57.027999 n-d-858272-3 devstack@n-api.service[122305]: thunder lock: enabled Oct 05 02:25:57.027999 n-d-858272-3 devstack@n-api.service[122305]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 05 02:25:57.027999 n-d-858272-3 devstack@n-api.service[122305]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 05 02:25:57.067404 n-d-858272-3 devstack@n-api.service[122305]: Python main interpreter initialized at 0x562c53d549c0 Oct 05 02:25:57.067404 n-d-858272-3 devstack@n-api.service[122305]: python threads support enabled Oct 05 02:25:57.067404 n-d-858272-3 devstack@n-api.service[122305]: your server socket listen backlog is limited to 100 connections Oct 05 02:25:57.067404 n-d-858272-3 devstack@n-api.service[122305]: your mercy for graceful operations on workers is 90 seconds Oct 05 02:25:57.068434 n-d-858272-3 devstack@n-api.service[122305]: mapped 403077 bytes (393 KB) for 2 cores Oct 05 02:25:57.068530 n-d-858272-3 devstack@n-api.service[122305]: *** Operational MODE: preforking *** Oct 05 02:25:57.068780 n-d-858272-3 devstack@n-api.service[122305]: *** uWSGI is running in multiple interpreter mode *** Oct 05 02:25:57.068780 n-d-858272-3 devstack@n-api.service[122305]: spawned uWSGI master process (pid: 122305) Oct 05 02:25:57.069030 n-d-858272-3 systemd[1]: Started Devstack devstack@n-api.service. Oct 05 02:25:57.071281 n-d-858272-3 devstack@n-api.service[122305]: spawned uWSGI worker 1 (pid: 122319, cores: 1) Oct 05 02:25:57.071281 n-d-858272-3 devstack@n-api.service[122305]: spawned uWSGI worker 2 (pid: 122320, cores: 1) Oct 05 02:25:57.071281 n-d-858272-3 devstack@n-api.service[122305]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 05 02:25:57.728411 n-d-858272-3 devstack@n-api.service[122319]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 05 02:25:57.729167 n-d-858272-3 devstack@n-api.service[122320]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 05 02:25:58.907371 n-d-858272-3 devstack@n-api.service[122320]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 02:25:58.907371 n-d-858272-3 devstack@n-api.service[122320]: from cryptography.utils import int_from_bytes Oct 05 02:25:58.908234 n-d-858272-3 devstack@n-api.service[122320]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 02:25:58.908234 n-d-858272-3 devstack@n-api.service[122320]: from cryptography.utils import int_from_bytes Oct 05 02:25:58.911933 n-d-858272-3 devstack@n-api.service[122319]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 02:25:58.911933 n-d-858272-3 devstack@n-api.service[122319]: from cryptography.utils import int_from_bytes Oct 05 02:25:58.912557 n-d-858272-3 devstack@n-api.service[122319]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 02:25:58.912557 n-d-858272-3 devstack@n-api.service[122319]: from cryptography.utils import int_from_bytes Oct 05 02:26:01.392716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 05 02:26:01.393310 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 05 02:26:01.393440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 05 02:26:01.393812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 05 02:26:01.394075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 05 02:26:01.394467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.394799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.395126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.395458 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.395882 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.396202 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.396525 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.396964 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.397306 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.397572 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.397894 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.398366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858272-3 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.398699 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.399014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.399333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.399445 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 05 02:26:01.399805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.399882 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 05 02:26:01.399962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.400232 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 05 02:26:01.400379 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.400589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.400740 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 05 02:26:01.400848 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 05 02:26:01.401125 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.401250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.401563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.401673 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.401862 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.401952 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.402176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.402264 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.402504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.402614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.402817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.402915 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.403125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.403243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.403441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.403542 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.403752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.403860 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.404011 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.404117 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.404323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.404425 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.404770 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858272-3 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.404881 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858272-3 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.405118 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.405220 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.405424 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.405526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.405740 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.405988 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.406091 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.406176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.406355 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.406477 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.406686 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.406817 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.407001 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.407202 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.407393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.407493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.407710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.407814 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.408044 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.408146 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.408385 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.408524 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.408702 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.408821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.409035 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.409147 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.409345 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.409464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.409660 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.409764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.409966 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.410127 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.410288 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.410388 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.410595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.410700 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.410906 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.411012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858272-3 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.411701 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.411816 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.412036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.412128 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.412366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.412586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.412756 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.413031 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.413162 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.413271 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.413361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.413531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.413654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.413857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.413968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.414182 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.414284 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.414496 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.414598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.414807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.414914 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.415119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.415228 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.415431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.415527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.415743 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.415854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.416057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.416160 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.416342 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.416436 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.416652 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.416751 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.416997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.417106 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.417303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.417411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.417599 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.417693 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.417848 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.417942 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.418153 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.418247 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.418471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.418631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.418779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.418890 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.419126 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.419234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.419343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.419533 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.419633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.419860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.419954 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.420178 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.420286 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.420488 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.420591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.420791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.420967 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.421119 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.421219 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.421424 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.421534 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.421728 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.421826 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.422030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.422131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.422334 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.422440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.422637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.422739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.422915 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.423014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.423223 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.423390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.423532 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.423632 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.423849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.423940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.424160 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.424260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.424473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.424577 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.424785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.424948 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.425114 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.425214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.425429 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.425539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.425745 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.425845 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.426051 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.426196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.426360 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.426462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.426673 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.426777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.427521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.427628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.427901 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.428065 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.428214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.428375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.428527 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.428695 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.428838 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.429056 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.429188 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.429363 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.429518 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.429618 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.429832 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.429933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.430146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.430253 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.430459 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.430566 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.430772 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.430866 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.431073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.431172 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.431379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.431477 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.431680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.431782 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.431987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.432086 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.432292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.432391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.432599 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.432699 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.432924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.433032 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.433238 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.433339 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.433545 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.433648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.433847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.433940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.434156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.434286 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.434454 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.434561 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.434760 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.434878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.435080 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.435204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.435390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.435493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.435692 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.435795 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.435998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.436103 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.436302 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.436406 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.436612 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.436706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.436932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.437041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.437248 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.437351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.437552 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.437655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.437873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.437976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.438179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.438272 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.438484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.438584 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.438798 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.438897 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.439102 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.439202 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.439407 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.439551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.439725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.439826 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.440025 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.440128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.440332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.440475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.440649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.440750 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.440974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.441088 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.441283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.441427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.441587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.441756 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.441889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.442077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.442191 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.442401 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.442573 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.442781 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.442993 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.443153 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.443301 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.443402 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.443603 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.443704 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.443922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.444024 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.444243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.444337 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.444554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.444653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.444860 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.444998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.445189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.445326 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.445507 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:26:01.445635 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.445846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.445946 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.446181 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.446281 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.446531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.446640 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.446846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.446939 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.447181 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.447289 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.447513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.447642 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.447835 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.447965 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.448148 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.448244 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.448464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.448565 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.448792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.448885 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.449133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.449281 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.449449 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.449550 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.449763 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.449866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.450086 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.450179 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.450406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.450507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.450738 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.450845 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.451057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.451151 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.451375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.451480 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.451694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.451787 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.452008 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.452102 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.452329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.452429 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.452650 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.452753 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.452993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.453134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.453308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.453452 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.453651 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.453746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.453973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.454067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.454299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.454407 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.454619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.454711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.454939 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.455039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.455253 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.455387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.455570 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.455664 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.455885 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.455986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.456204 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.456302 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.456520 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.456613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.456835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.456963 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.457173 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.457268 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.457486 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.457577 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.457797 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.457889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.458639 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.458770 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.458990 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.459094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.459325 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.459481 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.459668 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.459809 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.459985 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.460089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.460310 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.460411 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.460627 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.460718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.460974 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.461081 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.461285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.461392 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.461599 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.461700 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.461916 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.462008 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.462229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.462329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.462542 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.462643 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.462854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.462954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.463163 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.463257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.463472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.463576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.463779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.463876 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.464092 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.464193 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.464399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.464501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.464720 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.464819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.465075 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.465180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.465385 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.465479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.465717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.465815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.466023 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.466122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.466338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.466440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.466652 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.466762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.466980 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.467074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.467278 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.467378 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.467590 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.467692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.467904 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.467997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.468214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.468343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.468542 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.468655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.468857 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.468981 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.469190 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.469584 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.469765 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.469873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.470077 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.470233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.470385 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.470479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.470699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.470838 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.471006 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.471098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.471317 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.471415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.471627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.471727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.471937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.472041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.472249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.472341 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.472561 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.472655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.473419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.473545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.473545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.473763 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.473868 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.474008 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.474097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.474189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.474284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.474379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.474698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.474800 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.475017 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.475116 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.475324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.475425 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.475637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.475740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.475943 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.476043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.476249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.476349 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.476552 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.476652 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.476869 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.477023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.477199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.477314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.477505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.477630 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.477811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.477954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.478116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.478285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.478419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.478608 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.478741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.478940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.479042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.479267 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.479386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.479603 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.479723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.479923 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.480044 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.480248 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.480387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.480551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.480642 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.480876 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.481048 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.481246 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.481337 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.481596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.481731 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.481891 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.481994 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.482208 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.482301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.482529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.482621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.482842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.482941 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.483155 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.483255 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.483469 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.483572 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.483783 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.483876 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.484100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.484192 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.484413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.484504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.484734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.484835 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.485070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.485166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.485392 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.485485 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.485705 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.485806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.486029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.486127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.486332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.486439 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.486651 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.486745 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.486974 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.487075 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.487312 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.487413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.487627 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.487725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.487952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.488052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.488266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.488367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.488584 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.488677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.488915 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.489022 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.489232 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.489850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.490076 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.490194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.490395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.490562 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.490717 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.490882 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.491018 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.491206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.491337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.491531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.491637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.491855 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.491956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.492178 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.492277 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.492495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.492597 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.492823 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.492963 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.493170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.493272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.493490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.493619 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.493804 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.493914 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.494130 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.495149 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.495300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.495431 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.495593 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.495593 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.495866 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.497100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.497100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.497415 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.497568 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.497719 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.497882 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.498041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.498205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.498378 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.498529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.498686 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.498845 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.499003 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.499162 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.499319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.499470 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.499628 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.499779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.499930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.500111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.500457 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.500639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.500797 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.500978 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.501153 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.501304 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.501494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.501494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.501806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.501958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.502122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.502281 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.502431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.502431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.502431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.502431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.503016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.503176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.503336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.503719 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.503886 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.504037 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.504198 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.504349 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.504508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.504787 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.504993 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.505750 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.505914 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.506549 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.506717 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.506869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.507019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.507185 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.507338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.507487 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.507646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.507803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.507953 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.507953 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.507953 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.508402 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.508692 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.508692 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.509142 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.509312 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.510049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.510216 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.511021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.511205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.511376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.511546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.511723 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.511829 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.511829 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.512007 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.512102 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.512237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.512368 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.512458 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.512563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.512651 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.512744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.512943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.513048 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.513148 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.513148 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.513305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.513661 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.513764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.513851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.513952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.514040 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.514125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.514211 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.514304 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.514445 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.514546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.514681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.514681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.514841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.514933 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.515033 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.515121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.515213 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.515305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.515398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.515492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.515591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.515679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.515776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.515863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.515956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.516050 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.516143 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.516238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.516331 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.516465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.516569 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.516658 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.516743 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.516834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.516938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.517040 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.517135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.517229 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.517406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.517546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.517713 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.517821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.518019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.518165 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.518326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.518482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.518641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.518799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.518949 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.519139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.519240 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.519455 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.519563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.519878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.520034 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.520167 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.520306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.520444 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.520626 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.520847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.521223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.521368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.521459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.521545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.521646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.521735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.521828 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.522013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.522115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.522335 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.522487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.522650 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.522801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.522973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.523115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.523288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.523434 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.523616 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.523713 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.523938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.524034 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.524254 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.524349 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.524594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.524701 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.524875 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.525080 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.525217 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.525338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.525524 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.525835 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.526143 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.526341 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.526471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.526684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.526814 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.527010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.527139 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.527336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.527456 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.527649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.527776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.527965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.528093 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.528279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.528399 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.528584 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.528712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.528924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.529048 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.529207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.529306 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.529529 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.529623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.529840 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.529932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.530147 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.530249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.530454 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.530553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.530768 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.530875 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.531080 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.531191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.531447 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.531589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.531679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.531780 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.531976 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.532070 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.532297 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.532391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.532610 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.532748 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.532934 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.533305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.533457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.533561 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.533656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.533852 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.533954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.534157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.534252 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.534481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.534587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.534795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.534932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.535102 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.535204 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.535410 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.535516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.535723 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.535823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.536026 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.536125 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.536390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.536518 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.536711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.536851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.537086 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.537381 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.537689 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.538002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.538308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.538785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.538924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.539039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.539170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.539273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.539456 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.539551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.539796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.539895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.540101 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.540208 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.540406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.540524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.540710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.540854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.541179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.541301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.541497 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.541641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.541864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.542111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.542236 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.542431 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.542549 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.542740 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.542838 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.543106 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.543291 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.543435 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.543527 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.543757 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.543892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.544069 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.544210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.544384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.544477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.544704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.544804 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.545048 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.545146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.545365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.545457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.545687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.545782 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.545998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.546095 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.546318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.546411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.546638 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.546732 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.546954 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.547055 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.547260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.547370 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.547565 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.547667 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.547895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.547988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.548220 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.548315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.548545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.548647 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.548869 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.548984 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.549217 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.549322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.549542 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.549645 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.549847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.549941 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.550163 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.550257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.550477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.550579 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.550791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.550884 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.551104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.551201 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.551419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.551516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.551733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.552474 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.552573 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.552703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.552889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.553068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.553231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.553367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.553546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.553693 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.553858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.554013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.554176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.554468 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.554571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.554788 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.554890 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.555156 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.555266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.555419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.555511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.555728 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.555830 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.556042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.556144 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.556351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.556445 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.556665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.556765 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.557000 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.557096 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.557435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.557535 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.557748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.557847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.558064 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.558165 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.558372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.558466 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.558686 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.558789 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.558999 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.559098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.559317 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.559422 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.559636 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.559729 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.559944 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.560036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.560258 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.560362 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.560577 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.560678 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.560977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.561122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.561272 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.561377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.561601 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.561696 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.561910 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.562031 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.562223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.562373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.562551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.562696 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.562855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.563080 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.563195 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.563405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.563545 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.563731 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.563824 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.564064 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.564171 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.564389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.564490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.564722 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.564824 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.565062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.565181 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.565390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.565500 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.565713 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.565847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.566052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.566166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.566388 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.566483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.566713 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.566815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.567044 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.567142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.567363 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.567515 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.567824 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.567929 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.568146 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.568323 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.568463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.568656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.568793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.569018 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.569149 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.569450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.569547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.569773 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.569906 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.570085 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.570229 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.570413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.571170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.571309 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.571434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.571549 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.571668 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.571668 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.571877 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.571988 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.572114 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.572237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.572349 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.572467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.572755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.572891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.573078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.573271 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.573401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.573514 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.573624 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.573749 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.573872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.573985 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.574096 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.574206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.574324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.574445 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.574558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.574781 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.574902 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.575097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.575224 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.575433 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.575562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.575746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.575872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.576059 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.576192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.576365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.576493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.576671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.576792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.577026 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.577171 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.577335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.577479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.577660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.577795 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.578007 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.578189 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.578345 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.578494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.578667 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.578825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.578921 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.579018 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.579220 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.579314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.579534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.579709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.579863 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.580014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.580273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.580443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.580539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.580622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.580786 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.580883 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.581076 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.581219 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.581404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.581546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.581739 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.581878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.582072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.582216 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.582370 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.582535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.582708 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.583765 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.583856 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.583943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.584028 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.584158 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.584325 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.584460 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.584931 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.585066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.585066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.585271 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.585463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.585587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.585799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.585895 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.586123 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.586231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.586446 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.586548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.586763 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.586866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.587078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.587186 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.587714 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.587875 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.587977 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.588065 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.588160 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.588255 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.588425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.588538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.588636 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.588730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.589240 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.589334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.589507 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.589629 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.589742 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.589853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.589955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.590040 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.590174 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.590304 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.590444 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.590749 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.590947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.591091 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.591235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.591452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.591630 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.591792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.591947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.592115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.592290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.592381 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.592467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.592619 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.592715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.592968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.593067 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.593292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.593396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.593614 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.593827 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.593920 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.594013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.594235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.594781 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.594885 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.595128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.595250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.595453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.595557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.595779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.596011 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.596105 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.596343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.596445 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.596665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.596767 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.597007 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.597117 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.597334 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.597429 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.597654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.597794 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.597972 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.598066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.598289 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.598384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.598604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.598780 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.599607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.599715 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.599962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.600073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.600298 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.600401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.600628 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.600721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.600977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.601076 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.601308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.601413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.601652 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.601747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.601975 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.602087 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.602297 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.602391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.602618 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.602712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.602949 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.603097 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.603275 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.603368 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.603583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.603682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.603900 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.604002 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.604219 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.604320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.604538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.604630 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.604849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.604978 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.605224 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.605470 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.605619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.605786 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.605893 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.606118 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.606215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.606421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.606515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.606738 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.606869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.607058 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.607162 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.607382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.607484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.607712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.607849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.608050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.608304 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.608408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.608637 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.608746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.609009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.609156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.609330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.609456 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.609669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.609857 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.609998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.610175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.610326 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.610512 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.639383 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.639795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.640021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.640220 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.640398 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.640398 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.640762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.640868 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.641045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.641142 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.641142 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.641331 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.641425 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.641531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.641624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.641723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.641817 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.641817 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.642015 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.642015 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.642239 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.642387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.642560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.642895 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.642895 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.643345 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.643744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.643923 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.644042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.644208 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.644369 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.644544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.644544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.644544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.644544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.644544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.644544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.644544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.644544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.648468 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.648643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.648821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.648821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.649264 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.649526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.649787 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.650020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.650020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.650320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.650438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.650534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.650628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.650721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.650814 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.650924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.651021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.651021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.651021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.651021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.651021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.651547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.651721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.653598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.653794 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.653954 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.654135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.654308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.654479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.654718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.654939 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.655177 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.655387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.655593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.655820 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.655820 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.656286 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.656580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.656837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.657118 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.657227 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.657322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.657322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.657515 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.657611 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.657703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.657797 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.657889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.657991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.658097 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.658194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.658288 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.658381 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.658473 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.658575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.658669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.658763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.658855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.658955 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.659050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.659143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.659143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.659315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.659415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.659510 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.659602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.659694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.659786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.659878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.659978 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.660072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.660164 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.660256 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.660349 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.660442 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.660541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.660635 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.660728 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.660861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.660986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.661126 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.661318 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.661984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.662211 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.662332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.662437 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.662583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.662753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.662863 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.662977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.663090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.663090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.663326 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.663484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.663484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.663700 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.663814 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.663814 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.664025 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.664185 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.664315 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.664429 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.664545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.664677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.664803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.664937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.665056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.665056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.665270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.665382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.665556 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.665714 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.665846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.665961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.666093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.666237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.666237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.666463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.666577 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.666691 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.666838 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.666970 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.667093 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.667208 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.667320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.667433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.667544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.667544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.667544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.667915 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.667915 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.668140 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.668255 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.668377 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.668377 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.668590 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.668705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.668705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.669002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.669002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.669002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.669002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.669002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.669002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.669002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.669002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.669962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.669962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.669962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.669962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.670501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.670633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.670633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.671450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.671586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.671714 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.671844 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.671971 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.672098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.672336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.672471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.672601 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.672728 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.672728 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.673005 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.673005 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.673260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.673387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.673514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.673514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.673514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.673514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.673514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.674099 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.674226 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.674353 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.674501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.674501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.674742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.674869 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.674996 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.675124 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.675265 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.675395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.675395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.675633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.675761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.675887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.676023 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.676023 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.676274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.676401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.676401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.676647 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.676776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.676776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.676776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.676776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.677527 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.677666 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.677666 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.677922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.678066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.678195 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.678322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.678449 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.678584 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.678712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.678838 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.678964 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.679091 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.679225 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.679371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.679371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.679677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.679806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.679806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.680054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.680182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.680182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.680421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.680548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.680674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.680808 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.680953 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.681087 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.681317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.681455 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.681668 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.681815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.681944 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.682071 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.682198 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.682326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.682462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.682590 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.682716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.682843 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.682969 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.683096 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.683241 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.683371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.683497 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.683624 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.683750 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.683878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.684012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.684140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.684267 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.684393 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.684521 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.684648 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.684785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.684941 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.685076 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.685256 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.685384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.685523 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.685523 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.685764 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.685890 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.686017 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.686142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.686277 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.686405 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.686543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.686671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.686798 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.686924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.687059 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.687187 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.687314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.687441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.687441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.687441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.687441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.687927 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.688064 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.688192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.688320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.688454 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.688582 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.688710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.688837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.689078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.689215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.689215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.689469 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.689596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.689724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.689861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.689997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.690125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.690251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.690378 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.690505 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.690632 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.690768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.690897 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.691024 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.691150 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.691276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.691412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.691548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.691676 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.691803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.691930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.692056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.692189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.692317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.692489 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.692763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.693068 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.693313 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.693492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.693684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.693948 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.694148 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.694329 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.694527 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.694716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.694883 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.695017 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.695017 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 05 02:26:01.695260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.695260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.695260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.695260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.695260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.695260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.695260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.695260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:26:01.696258 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 05 02:26:01.753311 n-d-858272-3 devstack@n-api.service[122319]: INFO dbcounter [None req-aa7e2c46-2cb1-4224-b7d5-7e35c1ee6eca None None] Registered counter for database nova_api Oct 05 02:26:01.759548 n-d-858272-3 devstack@n-api.service[122320]: INFO dbcounter [None req-01f15ca5-b9b1-4614-8e3a-c81978c7af74 None None] Registered counter for database nova_api Oct 05 02:26:01.776171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_db.sqlalchemy.engines [None req-aa7e2c46-2cb1-4224-b7d5-7e35c1ee6eca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 02:26:01.782427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_db.sqlalchemy.engines [None req-01f15ca5-b9b1-4614-8e3a-c81978c7af74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122320) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 02:26:01.783775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writer thread running {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 02:26:01.790161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writer thread running {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 02:26:01.842302 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.context [None req-aa7e2c46-2cb1-4224-b7d5-7e35c1ee6eca None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d1723b23-1631-4a56-b9ad-72e4c39197cb(cell1) {{(pid=122319) load_cells /opt/stack/nova/nova/context.py:464}} Oct 05 02:26:01.846606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa7e2c46-2cb1-4224-b7d5-7e35c1ee6eca None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:01.847097 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa7e2c46-2cb1-4224-b7d5-7e35c1ee6eca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:01.848102 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.context [None req-01f15ca5-b9b1-4614-8e3a-c81978c7af74 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d1723b23-1631-4a56-b9ad-72e4c39197cb(cell1) {{(pid=122320) load_cells /opt/stack/nova/nova/context.py:464}} Oct 05 02:26:01.848673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa7e2c46-2cb1-4224-b7d5-7e35c1ee6eca None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:01.849609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa7e2c46-2cb1-4224-b7d5-7e35c1ee6eca None None] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:01.850138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa7e2c46-2cb1-4224-b7d5-7e35c1ee6eca None None] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:01.852634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-01f15ca5-b9b1-4614-8e3a-c81978c7af74 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:01.852711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa7e2c46-2cb1-4224-b7d5-7e35c1ee6eca None None] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:01.852812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-01f15ca5-b9b1-4614-8e3a-c81978c7af74 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:01.854243 n-d-858272-3 devstack@n-api.service[122319]: INFO dbcounter [None req-aa7e2c46-2cb1-4224-b7d5-7e35c1ee6eca None None] Registered counter for database nova_cell0 Oct 05 02:26:01.854472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-01f15ca5-b9b1-4614-8e3a-c81978c7af74 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:01.855236 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-01f15ca5-b9b1-4614-8e3a-c81978c7af74 None None] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:01.855687 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-01f15ca5-b9b1-4614-8e3a-c81978c7af74 None None] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:01.858442 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-01f15ca5-b9b1-4614-8e3a-c81978c7af74 None None] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:01.858640 n-d-858272-3 devstack@n-api.service[122319]: INFO dbcounter [None req-aa7e2c46-2cb1-4224-b7d5-7e35c1ee6eca None None] Registered counter for database nova_cell1 Oct 05 02:26:01.860483 n-d-858272-3 devstack@n-api.service[122320]: INFO dbcounter [None req-01f15ca5-b9b1-4614-8e3a-c81978c7af74 None None] Registered counter for database nova_cell0 Oct 05 02:26:01.865010 n-d-858272-3 devstack@n-api.service[122320]: INFO dbcounter [None req-01f15ca5-b9b1-4614-8e3a-c81978c7af74 None None] Registered counter for database nova_cell1 Oct 05 02:26:01.869179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_db.sqlalchemy.engines [None req-aa7e2c46-2cb1-4224-b7d5-7e35c1ee6eca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 02:26:01.870005 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_db.sqlalchemy.engines [None req-aa7e2c46-2cb1-4224-b7d5-7e35c1ee6eca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 02:26:01.872132 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_db.sqlalchemy.engines [None req-01f15ca5-b9b1-4614-8e3a-c81978c7af74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122320) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 02:26:01.874501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_db.sqlalchemy.engines [None req-01f15ca5-b9b1-4614-8e3a-c81978c7af74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122320) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 02:26:01.877347 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writer thread running {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 02:26:01.878726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writer thread running {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 02:26:01.880567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writer thread running {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 02:26:01.883440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writer thread running {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 02:26:02.032941 n-d-858272-3 devstack@n-api.service[122319]: INFO dbcounter [None req-aa7e2c46-2cb1-4224-b7d5-7e35c1ee6eca None None] Registered counter for database nova_cell0 Oct 05 02:26:02.039832 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_db.sqlalchemy.engines [None req-aa7e2c46-2cb1-4224-b7d5-7e35c1ee6eca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 02:26:02.041889 n-d-858272-3 devstack@n-api.service[122320]: INFO dbcounter [None req-01f15ca5-b9b1-4614-8e3a-c81978c7af74 None None] Registered counter for database nova_cell0 Oct 05 02:26:02.044781 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writer thread running {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 02:26:02.048703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_db.sqlalchemy.engines [None req-01f15ca5-b9b1-4614-8e3a-c81978c7af74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122320) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 02:26:02.053381 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writer thread running {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 02:26:02.367374 n-d-858272-3 devstack@n-api.service[122319]: WARNING keystonemiddleware.auth_token [None req-aa7e2c46-2cb1-4224-b7d5-7e35c1ee6eca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 05 02:26:02.372539 n-d-858272-3 devstack@n-api.service[122320]: WARNING keystonemiddleware.auth_token [None req-01f15ca5-b9b1-4614-8e3a-c81978c7af74 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 05 02:26:02.374018 n-d-858272-3 devstack@n-api.service[122319]: WARNING keystonemiddleware.auth_token [None req-aa7e2c46-2cb1-4224-b7d5-7e35c1ee6eca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 05 02:26:02.379821 n-d-858272-3 devstack@n-api.service[122320]: WARNING keystonemiddleware.auth_token [None req-01f15ca5-b9b1-4614-8e3a-c81978c7af74 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 05 02:26:02.717233 n-d-858272-3 devstack@n-api.service[122319]: WARNING keystonemiddleware.auth_token [None req-aa7e2c46-2cb1-4224-b7d5-7e35c1ee6eca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 05 02:26:02.723492 n-d-858272-3 devstack@n-api.service[122319]: WARNING keystonemiddleware.auth_token [None req-aa7e2c46-2cb1-4224-b7d5-7e35c1ee6eca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 05 02:26:02.725084 n-d-858272-3 devstack@n-api.service[122320]: WARNING keystonemiddleware.auth_token [None req-01f15ca5-b9b1-4614-8e3a-c81978c7af74 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 05 02:26:02.729345 n-d-858272-3 devstack@n-api.service[122319]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562c53d549c0 pid: 122319 (default app) Oct 05 02:26:02.731216 n-d-858272-3 devstack@n-api.service[122320]: WARNING keystonemiddleware.auth_token [None req-01f15ca5-b9b1-4614-8e3a-c81978c7af74 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 05 02:26:02.736522 n-d-858272-3 devstack@n-api.service[122320]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562c53d549c0 pid: 122320 (default app) Oct 05 02:26:42.841338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:42.842427 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:42.843226 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:42.843900 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:43.806037 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:43.807786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:43.808772 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:43.810409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:44.162462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1baec834-c6d8-4d07-af33-26b9a7890217 tempest-FlavorsAccessTestJSON-1623173671 tempest-FlavorsAccessTestJSON-1623173671-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-258071550", "id": 2120621521, "os-flavor-access:is_public": "False"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:26:44.213935 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1baec834-c6d8-4d07-af33-26b9a7890217 tempest-FlavorsAccessTestJSON-1623173671 tempest-FlavorsAccessTestJSON-1623173671-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 1.381858 Oct 05 02:26:44.214526 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:26:42 2022] POST /compute/v2.1/flavors => generated 430 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:26:44.594041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-22aab5bf-dd76-4fcb-abd1-7ea6ccced7d2 tempest-AZAdminNegativeTestJSON-98049805 tempest-AZAdminNegativeTestJSON-98049805-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:44.595812 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-22aab5bf-dd76-4fcb-abd1-7ea6ccced7d2 tempest-AZAdminNegativeTestJSON-98049805 tempest-AZAdminNegativeTestJSON-98049805-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '93536c51174c404b9fe239b677745297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c559be1425fc4ffdbf91dcf07b9046b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:26:44.599771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-22aab5bf-dd76-4fcb-abd1-7ea6ccced7d2 tempest-AZAdminNegativeTestJSON-98049805 tempest-AZAdminNegativeTestJSON-98049805-project] Request method failure captured: Oct 05 02:26:44.599771 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 05 02:26:44.599771 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:26:44.599771 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:26:44.599771 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:26:44.599771 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:26:44.599771 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:26:44.599771 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:26:44.599771 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:26:44.599771 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:26:44.599771 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOthWCrlA9hg0jdb-m4qY78RAeR7AqkaaBaEW0pw7P4BmmTXtkunwx2qimd1Nmf7vN_yqoJZQk5J6YbDRVY9k7J341nVWWghHZmPdD_UhVwOe8uZBqyJJfHDKmoC5FepUNZp3p75_XeWTxTqhDLlZxbCzQ7EM7dmRggYvLaKkPjQiFE Oct 05 02:26:44.599771 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:26:44.599771 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:26:44.599771 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:26:44.599771 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:26:44.599771 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:26:44.599771 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:26:44.599771 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: c559be1425fc4ffdbf91dcf07b9046b6 Oct 05 02:26:44.599771 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-AZAdminNegativeTestJSON-98049805 Oct 05 02:26:44.599771 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:26:44.599771 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:26:44.601077 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c559be1425fc4ffdbf91dcf07b9046b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c559be1425fc4ffdbf91dcf07b9046b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c559be1425fc4ffdbf91dcf07b9046b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c559be1425fc4ffdbf91dcf07b9046b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:26:44.601077 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-AZAdminNegativeTestJSON-98049805 Oct 05 02:26:44.601077 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: c559be1425fc4ffdbf91dcf07b9046b6 Oct 05 02:26:44.601077 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-98049805 Oct 05 02:26:44.601077 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-AZAdminNegativeTestJSON-98049805-project Oct 05 02:26:44.601077 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:26:44.601077 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:26:44.601077 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 93536c51174c404b9fe239b677745297 Oct 05 02:26:44.601077 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-AZAdminNegativeTestJSON-98049805-project Oct 05 02:26:44.601077 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:26:44.601077 n-d-858272-3 devstack@n-api.service[122319]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 05 02:26:44.601077 n-d-858272-3 devstack@n-api.service[122319]: action_args: {} Oct 05 02:26:44.601805 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:26:44.601805 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:26:44.601805 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:26:44.601805 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:26:44.601805 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:26:44.601805 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:26:44.601805 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:26:44.601805 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:26:44.601805 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 05 02:26:44.601805 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 05 02:26:44.601805 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 02:26:44.601805 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 02:26:44.601805 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 02:26:44.601805 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 02:26:44.601805 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:26:44.601805 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:26:44.601805 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:26:44.601805 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:26:44.601805 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 02:26:44.603001 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 02:26:44.603001 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 02:26:44.603001 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 02:26:44.603001 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:26:44.603001 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 02:26:44.603001 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 05 02:26:44.603001 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:26:44.603001 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:26:44.603001 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:26:44.603001 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:26:44.603001 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:26:44.603001 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:26:44.603001 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 02:26:44.603001 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 02:26:44.603001 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 05 02:26:44.603001 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:26:44.603001 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-22aab5bf-dd76-4fcb-abd1-7ea6ccced7d2 tempest-AZAdminNegativeTestJSON-98049805 tempest-AZAdminNegativeTestJSON-98049805-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:26:44.604064 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-22aab5bf-dd76-4fcb-abd1-7ea6ccced7d2 tempest-AZAdminNegativeTestJSON-98049805 tempest-AZAdminNegativeTestJSON-98049805-project] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.385195 Oct 05 02:26:44.606224 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2/2] 10.222.0.16 () {58 vars in 1185 bytes} [Wed Oct 5 02:26:44 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 391 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:26:44.778722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4a013a8a-d009-420d-8489-9448919afb44 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Calling method '.version_select at 0x7fcce57faee0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:44.796316 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4a013a8a-d009-420d-8489-9448919afb44 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d1723b23-1631-4a56-b9ad-72e4c39197cb(cell1) {{(pid=122319) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 05 02:26:44.797085 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a013a8a-d009-420d-8489-9448919afb44 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:44.797563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a013a8a-d009-420d-8489-9448919afb44 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:44.797991 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a013a8a-d009-420d-8489-9448919afb44 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:44.851909 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a013a8a-d009-420d-8489-9448919afb44 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:44.853173 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a013a8a-d009-420d-8489-9448919afb44 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:44.854169 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a013a8a-d009-420d-8489-9448919afb44 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:44.880013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a013a8a-d009-420d-8489-9448919afb44 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:44.881428 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a013a8a-d009-420d-8489-9448919afb44 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:44.882490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a013a8a-d009-420d-8489-9448919afb44 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:44.887302 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4fd49c23-c37f-4637-9f57-33fa8672b35a tempest-AZAdminV2TestJSON-1083818482 tempest-AZAdminV2TestJSON-1083818482-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:44.889040 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4fd49c23-c37f-4637-9f57-33fa8672b35a tempest-AZAdminV2TestJSON-1083818482 tempest-AZAdminV2TestJSON-1083818482-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:44.889682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4fd49c23-c37f-4637-9f57-33fa8672b35a tempest-AZAdminV2TestJSON-1083818482 tempest-AZAdminV2TestJSON-1083818482-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:44.890266 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4fd49c23-c37f-4637-9f57-33fa8672b35a tempest-AZAdminV2TestJSON-1083818482 tempest-AZAdminV2TestJSON-1083818482-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:44.891347 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4fd49c23-c37f-4637-9f57-33fa8672b35a tempest-AZAdminV2TestJSON-1083818482 tempest-AZAdminV2TestJSON-1083818482-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:44.891945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4fd49c23-c37f-4637-9f57-33fa8672b35a tempest-AZAdminV2TestJSON-1083818482 tempest-AZAdminV2TestJSON-1083818482-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:44.892520 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4fd49c23-c37f-4637-9f57-33fa8672b35a tempest-AZAdminV2TestJSON-1083818482 tempest-AZAdminV2TestJSON-1083818482-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:44.893445 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4a013a8a-d009-420d-8489-9448919afb44 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.286129 Oct 05 02:26:44.894102 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3/3] 10.222.0.16 () {58 vars in 1167 bytes} [Wed Oct 5 02:26:44 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:26:44.941324 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4fd49c23-c37f-4637-9f57-33fa8672b35a tempest-AZAdminV2TestJSON-1083818482 tempest-AZAdminV2TestJSON-1083818482-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.147159 Oct 05 02:26:44.942628 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1/4] 10.222.0.16 () {58 vars in 1164 bytes} [Wed Oct 5 02:26:43 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:26:44.950741 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-22eacc63-fa7c-48cf-8314-be584254cc80 tempest-FlavorsAccessTestJSON-1623173671 tempest-FlavorsAccessTestJSON-1623173671-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "385cb9af38684f89a84b6b38145be97f"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:26:45.154411 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c6515b8e-a192-45f0-98f0-6989c6c31efd tempest-AggregatesAdminTestV241-1249617779 tempest-AggregatesAdminTestV241-1249617779-project-admin] Calling method '.version_select at 0x7fcce57fadc0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:45.160218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6515b8e-a192-45f0-98f0-6989c6c31efd tempest-AggregatesAdminTestV241-1249617779 tempest-AggregatesAdminTestV241-1249617779-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:45.160745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6515b8e-a192-45f0-98f0-6989c6c31efd tempest-AggregatesAdminTestV241-1249617779 tempest-AggregatesAdminTestV241-1249617779-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:45.161220 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6515b8e-a192-45f0-98f0-6989c6c31efd tempest-AggregatesAdminTestV241-1249617779 tempest-AggregatesAdminTestV241-1249617779-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:45.184604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6515b8e-a192-45f0-98f0-6989c6c31efd tempest-AggregatesAdminTestV241-1249617779 tempest-AggregatesAdminTestV241-1249617779-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:45.185622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6515b8e-a192-45f0-98f0-6989c6c31efd tempest-AggregatesAdminTestV241-1249617779 tempest-AggregatesAdminTestV241-1249617779-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:45.186522 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6515b8e-a192-45f0-98f0-6989c6c31efd tempest-AggregatesAdminTestV241-1249617779 tempest-AggregatesAdminTestV241-1249617779-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:45.202106 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6515b8e-a192-45f0-98f0-6989c6c31efd tempest-AggregatesAdminTestV241-1249617779 tempest-AggregatesAdminTestV241-1249617779-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:45.202670 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6515b8e-a192-45f0-98f0-6989c6c31efd tempest-AggregatesAdminTestV241-1249617779 tempest-AggregatesAdminTestV241-1249617779-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:45.203382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6515b8e-a192-45f0-98f0-6989c6c31efd tempest-AggregatesAdminTestV241-1249617779 tempest-AggregatesAdminTestV241-1249617779-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:45.213868 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c6515b8e-a192-45f0-98f0-6989c6c31efd tempest-AggregatesAdminTestV241-1249617779 tempest-AggregatesAdminTestV241-1249617779-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.317824 Oct 05 02:26:45.214600 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4/5] 10.222.0.16 () {60 vars in 1208 bytes} [Wed Oct 5 02:26:44 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:26:45.362486 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-22eacc63-fa7c-48cf-8314-be584254cc80 tempest-FlavorsAccessTestJSON-1623173671 tempest-FlavorsAccessTestJSON-1623173671-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/2120621521/action" status: 200 len: 97 microversion: 2.1 time: 0.418566 Oct 05 02:26:45.363170 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2/6] 10.222.0.16 () {60 vars in 1200 bytes} [Wed Oct 5 02:26:44 2022] POST /compute/v2.1/flavors/2120621521/action => generated 97 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:26:45.383881 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0eebad86-acd5-475b-9473-b4d348b205d8 tempest-HypervisorAdminV228Test-1351665848 tempest-HypervisorAdminV228Test-1351665848-project-admin] Calling method '.version_select at 0x7fcce619db80>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:45.386173 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0eebad86-acd5-475b-9473-b4d348b205d8 tempest-HypervisorAdminV228Test-1351665848 tempest-HypervisorAdminV228Test-1351665848-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:45.387451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0eebad86-acd5-475b-9473-b4d348b205d8 tempest-HypervisorAdminV228Test-1351665848 tempest-HypervisorAdminV228Test-1351665848-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:45.388036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0eebad86-acd5-475b-9473-b4d348b205d8 tempest-HypervisorAdminV228Test-1351665848 tempest-HypervisorAdminV228Test-1351665848-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:45.406333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0eebad86-acd5-475b-9473-b4d348b205d8 tempest-HypervisorAdminV228Test-1351665848 tempest-HypervisorAdminV228Test-1351665848-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:45.406817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0eebad86-acd5-475b-9473-b4d348b205d8 tempest-HypervisorAdminV228Test-1351665848 tempest-HypervisorAdminV228Test-1351665848-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:45.407416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0eebad86-acd5-475b-9473-b4d348b205d8 tempest-HypervisorAdminV228Test-1351665848 tempest-HypervisorAdminV228Test-1351665848-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:45.440330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0eebad86-acd5-475b-9473-b4d348b205d8 tempest-HypervisorAdminV228Test-1351665848 tempest-HypervisorAdminV228Test-1351665848-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:45.441299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0eebad86-acd5-475b-9473-b4d348b205d8 tempest-HypervisorAdminV228Test-1351665848 tempest-HypervisorAdminV228Test-1351665848-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:45.441838 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0eebad86-acd5-475b-9473-b4d348b205d8 tempest-HypervisorAdminV228Test-1351665848 tempest-HypervisorAdminV228Test-1351665848-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:45.452033 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0eebad86-acd5-475b-9473-b4d348b205d8 tempest-HypervisorAdminV228Test-1351665848 tempest-HypervisorAdminV228Test-1351665848-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.235123 Oct 05 02:26:45.453069 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 5/7] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Oct 5 02:26:45 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:26:45.459809 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-31936653-8c24-4547-992a-e3cd69a7210f tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1409332565", "name": "tempest-test_aggregate-1484067685"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:26:45.485682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.aggregate [None req-31936653-8c24-4547-992a-e3cd69a7210f tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Generated uuid aeaee344-66f8-40c7-b14e-468f3917121e for aggregate {{(pid=122319) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 02:26:45.567206 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-31936653-8c24-4547-992a-e3cd69a7210f tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.112068 Oct 05 02:26:45.568135 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 6/8] 10.222.0.16 () {60 vars in 1165 bytes} [Wed Oct 5 02:26:45 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:26:45.574126 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2559dec8-bf02-4e99-9265-174f4014afe6 tempest-AZAdminV2TestJSON-1083818482 tempest-AZAdminV2TestJSON-1083818482-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:45.577180 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2559dec8-bf02-4e99-9265-174f4014afe6 tempest-AZAdminV2TestJSON-1083818482 tempest-AZAdminV2TestJSON-1083818482-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:45.578158 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2559dec8-bf02-4e99-9265-174f4014afe6 tempest-AZAdminV2TestJSON-1083818482 tempest-AZAdminV2TestJSON-1083818482-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:45.578913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2559dec8-bf02-4e99-9265-174f4014afe6 tempest-AZAdminV2TestJSON-1083818482 tempest-AZAdminV2TestJSON-1083818482-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:45.579851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2559dec8-bf02-4e99-9265-174f4014afe6 tempest-AZAdminV2TestJSON-1083818482 tempest-AZAdminV2TestJSON-1083818482-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:45.580736 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2559dec8-bf02-4e99-9265-174f4014afe6 tempest-AZAdminV2TestJSON-1083818482 tempest-AZAdminV2TestJSON-1083818482-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:45.580952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2559dec8-bf02-4e99-9265-174f4014afe6 tempest-AZAdminV2TestJSON-1083818482 tempest-AZAdminV2TestJSON-1083818482-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:45.600894 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-58b951db-af0e-443a-9fd0-441223929075 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:45.604877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58b951db-af0e-443a-9fd0-441223929075 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:45.605807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58b951db-af0e-443a-9fd0-441223929075 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:45.606441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58b951db-af0e-443a-9fd0-441223929075 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:45.607139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58b951db-af0e-443a-9fd0-441223929075 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:45.607735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58b951db-af0e-443a-9fd0-441223929075 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:45.608749 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58b951db-af0e-443a-9fd0-441223929075 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:45.650859 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-58b951db-af0e-443a-9fd0-441223929075 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.285781 Oct 05 02:26:45.655865 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2559dec8-bf02-4e99-9265-174f4014afe6 tempest-AZAdminV2TestJSON-1083818482 tempest-AZAdminV2TestJSON-1083818482-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.078928 Oct 05 02:26:45.657241 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 7/9] 10.222.0.16 () {58 vars in 1185 bytes} [Wed Oct 5 02:26:45 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:26:45.660083 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3/10] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Oct 5 02:26:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:26:45.666417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-597a5d1a-6300-422d-9f99-7f9747fc0395 tempest-HypervisorAdminV228Test-1351665848 tempest-HypervisorAdminV228Test-1351665848-project-admin] Calling method '.version_select at 0x7fcce5894310>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:45.674471 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-597a5d1a-6300-422d-9f99-7f9747fc0395 tempest-HypervisorAdminV228Test-1351665848 tempest-HypervisorAdminV228Test-1351665848-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d1723b23-1631-4a56-b9ad-72e4c39197cb(cell1) {{(pid=122320) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 05 02:26:45.675196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-597a5d1a-6300-422d-9f99-7f9747fc0395 tempest-HypervisorAdminV228Test-1351665848 tempest-HypervisorAdminV228Test-1351665848-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:45.675664 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-597a5d1a-6300-422d-9f99-7f9747fc0395 tempest-HypervisorAdminV228Test-1351665848 tempest-HypervisorAdminV228Test-1351665848-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:45.676721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-597a5d1a-6300-422d-9f99-7f9747fc0395 tempest-HypervisorAdminV228Test-1351665848 tempest-HypervisorAdminV228Test-1351665848-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:45.704501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-597a5d1a-6300-422d-9f99-7f9747fc0395 tempest-HypervisorAdminV228Test-1351665848 tempest-HypervisorAdminV228Test-1351665848-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:45.705020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-597a5d1a-6300-422d-9f99-7f9747fc0395 tempest-HypervisorAdminV228Test-1351665848 tempest-HypervisorAdminV228Test-1351665848-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:45.705602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-597a5d1a-6300-422d-9f99-7f9747fc0395 tempest-HypervisorAdminV228Test-1351665848 tempest-HypervisorAdminV228Test-1351665848-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:45.716367 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-597a5d1a-6300-422d-9f99-7f9747fc0395 tempest-HypervisorAdminV228Test-1351665848 tempest-HypervisorAdminV228Test-1351665848-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 717 microversion: 2.28 time: 0.054176 Oct 05 02:26:45.717502 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 4/11] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Oct 5 02:26:45 2022] GET /compute/v2.1/os-hypervisors/1 => generated 717 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:26:45.722189 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-41fa63d4-54d5-4cd0-a3f1-a00010e6e733 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:45.735640 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-41fa63d4-54d5-4cd0-a3f1-a00010e6e733 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.016946 Oct 05 02:26:45.736880 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 5/12] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 5 02:26:45 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:26:45.749299 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2e1e6672-8ad0-4562-bc53-84dcbfe7bfb8 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858272-3"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:26:45.786406 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2e1e6672-8ad0-4562-bc53-84dcbfe7bfb8 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:45.787044 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2e1e6672-8ad0-4562-bc53-84dcbfe7bfb8 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:45.787672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2e1e6672-8ad0-4562-bc53-84dcbfe7bfb8 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:46.042578 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-777cfd9a-bfbb-4520-a041-aec01a2b5fb0 tempest-FlavorsAccessTestJSON-1293447549 tempest-FlavorsAccessTestJSON-1293447549-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:46.079241 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-777cfd9a-bfbb-4520-a041-aec01a2b5fb0 tempest-FlavorsAccessTestJSON-1293447549 tempest-FlavorsAccessTestJSON-1293447549-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5411 microversion: 2.1 time: 0.420636 Oct 05 02:26:46.079830 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 8/13] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:26:45 2022] GET /compute/v2.1/flavors/detail => generated 5411 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:26:46.099180 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f6a89120-8ee9-47b9-80f7-cfcf652026d0 tempest-FlavorsAccessTestJSON-1623173671 tempest-FlavorsAccessTestJSON-1623173671-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "385cb9af38684f89a84b6b38145be97f"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:26:46.620304 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f6a89120-8ee9-47b9-80f7-cfcf652026d0 tempest-FlavorsAccessTestJSON-1623173671 tempest-FlavorsAccessTestJSON-1623173671-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/2120621521/action" status: 200 len: 21 microversion: 2.1 time: 0.524705 Oct 05 02:26:46.626410 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 9/14] 10.222.0.16 () {60 vars in 1200 bytes} [Wed Oct 5 02:26:46 2022] POST /compute/v2.1/flavors/2120621521/action => generated 21 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 05 02:26:46.634139 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5833b634-6ae1-42b0-8872-a545cc457eb7 tempest-FlavorsAccessTestJSON-1293447549 tempest-FlavorsAccessTestJSON-1293447549-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:46.664592 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5833b634-6ae1-42b0-8872-a545cc457eb7 tempest-FlavorsAccessTestJSON-1293447549 tempest-FlavorsAccessTestJSON-1293447549-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036130 Oct 05 02:26:46.665515 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 10/15] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:26:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:26:46.692112 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7180e007-2dce-481a-a737-84a0c236a46f tempest-FlavorsAccessTestJSON-1623173671 tempest-FlavorsAccessTestJSON-1623173671-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:46.725688 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7180e007-2dce-481a-a737-84a0c236a46f tempest-FlavorsAccessTestJSON-1623173671 tempest-FlavorsAccessTestJSON-1623173671-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/2120621521" status: 202 len: 0 microversion: 2.1 time: 0.040092 Oct 05 02:26:46.731170 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 11/16] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 5 02:26:46 2022] DELETE /compute/v2.1/flavors/2120621521 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:26:46.738928 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-81d0179e-d8f8-4bf6-9903-d4f3d9b1ae53 tempest-FlavorsAccessTestJSON-1623173671 tempest-FlavorsAccessTestJSON-1623173671-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:46.776814 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-81d0179e-d8f8-4bf6-9903-d4f3d9b1ae53 tempest-FlavorsAccessTestJSON-1623173671 tempest-FlavorsAccessTestJSON-1623173671-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044489 Oct 05 02:26:46.781034 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 12/17] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:26:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:26:46.798725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8fbf299e-48c0-4dfd-8687-b4c3dfd907d2 tempest-FlavorsAccessTestJSON-1623173671 tempest-FlavorsAccessTestJSON-1623173671-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1344812549", "id": 1774211222, "os-flavor-access:is_public": "False"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:26:46.821039 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8fbf299e-48c0-4dfd-8687-b4c3dfd907d2 tempest-FlavorsAccessTestJSON-1623173671 tempest-FlavorsAccessTestJSON-1623173671-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.025733 Oct 05 02:26:46.836937 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 13/18] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:26:46 2022] POST /compute/v2.1/flavors => generated 431 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:26:46.853015 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-03da104e-04e9-4b7f-a5b8-5a4df6859c0a tempest-FlavorsAccessTestJSON-1623173671 tempest-FlavorsAccessTestJSON-1623173671-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:46.872598 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-03da104e-04e9-4b7f-a5b8-5a4df6859c0a tempest-FlavorsAccessTestJSON-1623173671 tempest-FlavorsAccessTestJSON-1623173671-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1774211222/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.031905 Oct 05 02:26:46.873987 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 14/19] 10.222.0.16 () {58 vars in 1209 bytes} [Wed Oct 5 02:26:46 2022] GET /compute/v2.1/flavors/1774211222/os-flavor-access => generated 21 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:26:46.886554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5ab10768-b4db-493e-a447-f5a4f6ac6eda tempest-FlavorsAccessTestJSON-1623173671 tempest-FlavorsAccessTestJSON-1623173671-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:46.915638 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5ab10768-b4db-493e-a447-f5a4f6ac6eda tempest-FlavorsAccessTestJSON-1623173671 tempest-FlavorsAccessTestJSON-1623173671-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1774211222" status: 202 len: 0 microversion: 2.1 time: 0.035691 Oct 05 02:26:46.916592 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 15/20] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 5 02:26:46 2022] DELETE /compute/v2.1/flavors/1774211222 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:26:46.929261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-87900a23-c566-4808-98b9-1f683f8fb9c1 tempest-FlavorsAccessTestJSON-1623173671 tempest-FlavorsAccessTestJSON-1623173671-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:46.988473 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-87900a23-c566-4808-98b9-1f683f8fb9c1 tempest-FlavorsAccessTestJSON-1623173671 tempest-FlavorsAccessTestJSON-1623173671-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064751 Oct 05 02:26:46.990483 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 16/21] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:26:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:26:47.026185 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2e1e6672-8ad0-4562-bc53-84dcbfe7bfb8 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.1 time: 1.280191 Oct 05 02:26:47.028309 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 6/22] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 5 02:26:45 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:26:47.584555 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8d2ec96b-4970-435b-bea1-cd89c148e739 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1508971804", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "availability_zone": "tempest-test_az-1409332565"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:26:47.603220 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f43ab109-d7ea-4be8-a366-4f836044d29c tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Calling method '.version_select at 0x7fcce4efaca0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:47.606505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f43ab109-d7ea-4be8-a366-4f836044d29c tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:47.606996 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f43ab109-d7ea-4be8-a366-4f836044d29c tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:47.607430 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f43ab109-d7ea-4be8-a366-4f836044d29c tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:47.608158 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f43ab109-d7ea-4be8-a366-4f836044d29c tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:47.608611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f43ab109-d7ea-4be8-a366-4f836044d29c tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:47.616616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f43ab109-d7ea-4be8-a366-4f836044d29c tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:47.664142 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d2ec96b-4970-435b-bea1-cd89c148e739 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:47.664626 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d2ec96b-4970-435b-bea1-cd89c148e739 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:47.665114 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d2ec96b-4970-435b-bea1-cd89c148e739 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:47.665839 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d2ec96b-4970-435b-bea1-cd89c148e739 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:47.666294 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d2ec96b-4970-435b-bea1-cd89c148e739 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:47.666775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d2ec96b-4970-435b-bea1-cd89c148e739 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:47.669203 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f43ab109-d7ea-4be8-a366-4f836044d29c tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.535718 Oct 05 02:26:47.670551 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 17/23] 10.222.0.16 () {58 vars in 1128 bytes} [Wed Oct 5 02:26:47 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:26:47.686541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8c948134-47db-47a2-8541-1f89318f70d1 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Calling method '.version_select at 0x7fcce4ef1940>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:47.690304 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c948134-47db-47a2-8541-1f89318f70d1 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:47.690790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c948134-47db-47a2-8541-1f89318f70d1 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:47.692324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c948134-47db-47a2-8541-1f89318f70d1 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:47.693919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c948134-47db-47a2-8541-1f89318f70d1 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:47.695510 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c948134-47db-47a2-8541-1f89318f70d1 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:47.696151 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c948134-47db-47a2-8541-1f89318f70d1 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:47.726017 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8c948134-47db-47a2-8541-1f89318f70d1 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 398 microversion: 2.1 time: 0.044799 Oct 05 02:26:47.726929 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 18/24] 10.222.0.16 () {58 vars in 1139 bytes} [Wed Oct 5 02:26:47 2022] GET /compute/v2.1/os-hosts?zone= => generated 398 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:26:47.738802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-038bc0af-6332-4a6f-9a77-b258ca3498e8 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Calling method '.version_select at 0x7fcce4efaaf0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:47.743423 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-038bc0af-6332-4a6f-9a77-b258ca3498e8 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:47.744140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-038bc0af-6332-4a6f-9a77-b258ca3498e8 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:47.744752 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-038bc0af-6332-4a6f-9a77-b258ca3498e8 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:47.745656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-038bc0af-6332-4a6f-9a77-b258ca3498e8 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:47.746118 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-038bc0af-6332-4a6f-9a77-b258ca3498e8 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:47.747082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-038bc0af-6332-4a6f-9a77-b258ca3498e8 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:47.774824 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-038bc0af-6332-4a6f-9a77-b258ca3498e8 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.040085 Oct 05 02:26:47.775457 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 19/25] 10.222.0.16 () {58 vars in 1145 bytes} [Wed Oct 5 02:26:47 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:26:48.529563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-8d2ec96b-4970-435b-bea1-cd89c148e739 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] validate_networks() for None {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:26:48.894881 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-8d2ec96b-4970-435b-bea1-cd89c148e739 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:26:48.895493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-8d2ec96b-4970-435b-bea1-cd89c148e739 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:26:48.896472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-8d2ec96b-4970-435b-bea1-cd89c148e739 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:26:48.896945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-8d2ec96b-4970-435b-bea1-cd89c148e739 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:26:48.897525 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-8d2ec96b-4970-435b-bea1-cd89c148e739 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:26:48.910864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d2ec96b-4970-435b-bea1-cd89c148e739 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:48.911790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d2ec96b-4970-435b-bea1-cd89c148e739 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:48.912371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d2ec96b-4970-435b-bea1-cd89c148e739 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:48.913312 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d2ec96b-4970-435b-bea1-cd89c148e739 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:48.913818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d2ec96b-4970-435b-bea1-cd89c148e739 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:48.914246 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d2ec96b-4970-435b-bea1-cd89c148e739 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:48.946613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-8d2ec96b-4970-435b-bea1-cd89c148e739 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Getting quotas for project 71b7bb601bea47d88c9ad68be2651451. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:26:48.955836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-8d2ec96b-4970-435b-bea1-cd89c148e739 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Getting quotas for user f4aebce7113c4e8980490aa0b0fbb296 and project 71b7bb601bea47d88c9ad68be2651451. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:26:48.970966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8d2ec96b-4970-435b-bea1-cd89c148e739 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:26:48.974729 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8d2ec96b-4970-435b-bea1-cd89c148e739 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:26:49.039191 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8d2ec96b-4970-435b-bea1-cd89c148e739 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.795019 Oct 05 02:26:49.039922 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 7/26] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:26:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 02:26:49.054141 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-da85fdce-8181-4a2a-99b8-c67661e1110a tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:49.056189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-da85fdce-8181-4a2a-99b8-c67661e1110a tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:26:49.927947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-da85fdce-8181-4a2a-99b8-c67661e1110a tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aebce7113c4e8980490aa0b0fbb296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b7bb601bea47d88c9ad68be2651451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:26:49.943294 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-da85fdce-8181-4a2a-99b8-c67661e1110a tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] 10.222.0.16 "GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9" status: 200 len: 1243 microversion: 2.1 time: 0.895626 Oct 05 02:26:49.944543 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 20/27] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:26:49 2022] GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 => generated 1243 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:26:50.948388 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ecfb21c5-74ab-4431-aa15-2f7c6faed9fb tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1716701395", "id": 1408138048, "os-flavor-access:is_public": "True"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:26:50.968095 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-221b5af7-2ad3-4211-b454-d1735437cf2b tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:50.968827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-221b5af7-2ad3-4211-b454-d1735437cf2b tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:26:50.979330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-221b5af7-2ad3-4211-b454-d1735437cf2b tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:50.980050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-221b5af7-2ad3-4211-b454-d1735437cf2b tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:50.980813 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-221b5af7-2ad3-4211-b454-d1735437cf2b tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:50.980937 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ecfb21c5-74ab-4431-aa15-2f7c6faed9fb tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.316746 Oct 05 02:26:50.987985 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 8/28] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:26:50 2022] POST /compute/v2.1/flavors => generated 430 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:26:50.989088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-221b5af7-2ad3-4211-b454-d1735437cf2b tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:50.989573 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-221b5af7-2ad3-4211-b454-d1735437cf2b tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:50.990004 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-221b5af7-2ad3-4211-b454-d1735437cf2b tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:50.995247 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5ba0c67a-73c7-45ad-93be-a84a81991735 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:51.037671 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5ba0c67a-73c7-45ad-93be-a84a81991735 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1408138048" status: 202 len: 0 microversion: 2.1 time: 0.045681 Oct 05 02:26:51.038571 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 9/29] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 5 02:26:50 2022] DELETE /compute/v2.1/flavors/1408138048 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 02:26:51.049332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-319decf9-66b2-4619-898f-f2b63560133c tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:51.078767 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-319decf9-66b2-4619-898f-f2b63560133c tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033854 Oct 05 02:26:51.079800 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 10/30] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:26:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:26:51.109117 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-15957c18-90ce-4f30-816e-aad6a926dfd8 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1767610561", "id": 1291045912, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:26:51.136819 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-15957c18-90ce-4f30-816e-aad6a926dfd8 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.031432 Oct 05 02:26:51.138544 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 11/31] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:26:51 2022] POST /compute/v2.1/flavors => generated 417 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:26:51.153164 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8e2270e2-6002-488e-bd1c-dae6e74edf48 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:51.182278 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8e2270e2-6002-488e-bd1c-dae6e74edf48 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5398 microversion: 2.1 time: 0.034902 Oct 05 02:26:51.183428 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 12/32] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:26:51 2022] GET /compute/v2.1/flavors/detail => generated 5398 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:26:51.201238 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-221b5af7-2ad3-4211-b454-d1735437cf2b tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aebce7113c4e8980490aa0b0fbb296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b7bb601bea47d88c9ad68be2651451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:26:51.201448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7ceaad7f-b335-49e3-a440-37b1d23ead19 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:51.221612 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-221b5af7-2ad3-4211-b454-d1735437cf2b tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] 10.222.0.16 "GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9" status: 200 len: 1291 microversion: 2.1 time: 0.256924 Oct 05 02:26:51.222660 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 21/33] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:26:50 2022] GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 => generated 1291 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:26:51.236758 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7ceaad7f-b335-49e3-a440-37b1d23ead19 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1291045912" status: 202 len: 0 microversion: 2.1 time: 0.039105 Oct 05 02:26:51.244189 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 13/34] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 5 02:26:51 2022] DELETE /compute/v2.1/flavors/1291045912 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:26:51.252550 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2232d09b-755e-4a5c-bd47-7db5833e3da8 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:51.288033 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2232d09b-755e-4a5c-bd47-7db5833e3da8 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039468 Oct 05 02:26:51.289015 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 22/35] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:26:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:26:51.312284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4c713ff1-16e3-480e-a0c6-f27c8cf47b9c tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-766815987", "id": 647478113, "os-flavor-access:is_public": "True"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:26:51.337936 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4c713ff1-16e3-480e-a0c6-f27c8cf47b9c tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.029593 Oct 05 02:26:51.347371 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 14/36] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:26:51 2022] POST /compute/v2.1/flavors => generated 425 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:26:51.352882 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-21bf6cb2-e500-4ea3-8707-558d6a39030e tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:51.386008 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-21bf6cb2-e500-4ea3-8707-558d6a39030e tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/647478113" status: 202 len: 0 microversion: 2.1 time: 0.038334 Oct 05 02:26:51.387156 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 23/37] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 5 02:26:51 2022] DELETE /compute/v2.1/flavors/647478113 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:26:51.396368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ad213810-eebd-46e3-9e53-fed730bcd729 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:51.424412 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ad213810-eebd-46e3-9e53-fed730bcd729 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032976 Oct 05 02:26:51.425383 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 15/38] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:26:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:26:51.446686 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f8cea66f-2359-43c7-81d8-58f6bc22c7fe tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-957085217", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:26:51.471918 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f8cea66f-2359-43c7-81d8-58f6bc22c7fe tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.028903 Oct 05 02:26:51.472538 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 24/39] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:26:51 2022] POST /compute/v2.1/flavors => generated 506 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:26:51.485587 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f69b4e56-b310-4d2c-9fe7-73f98a7b8a97 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:51.505553 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f69b4e56-b310-4d2c-9fe7-73f98a7b8a97 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/5c29ab23-f87a-4a4b-9016-8186317bde9a" status: 202 len: 0 microversion: 2.1 time: 0.024223 Oct 05 02:26:51.506230 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 16/40] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:26:51 2022] DELETE /compute/v2.1/flavors/5c29ab23-f87a-4a4b-9016-8186317bde9a => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:26:51.515572 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f746155f-8b05-4dd1-a23a-e4bbbc3c3f1e tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:51.537647 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f746155f-8b05-4dd1-a23a-e4bbbc3c3f1e tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027007 Oct 05 02:26:51.538304 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 25/41] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:26:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:26:51.559704 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c424a236-03fe-41ff-b51a-fa3d31251bb7 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2063928431", "id": "810c472a-e72d-4f11-8d96-357cb89168c8", "os-flavor-access:is_public": "True"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:26:51.578897 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c424a236-03fe-41ff-b51a-fa3d31251bb7 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.022827 Oct 05 02:26:51.580169 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 17/42] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:26:51 2022] POST /compute/v2.1/flavors => generated 507 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:26:51.593656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-81b0d761-0516-4a64-b266-d21eb3c92488 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:51.598694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5,nova_api:DELETE=10 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:51.622169 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-81b0d761-0516-4a64-b266-d21eb3c92488 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/810c472a-e72d-4f11-8d96-357cb89168c8" status: 202 len: 0 microversion: 2.1 time: 0.033036 Oct 05 02:26:51.626155 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 26/43] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:26:51 2022] DELETE /compute/v2.1/flavors/810c472a-e72d-4f11-8d96-357cb89168c8 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:26:51.641784 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9fbd0d85-3239-4945-924d-22d5181fece1 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:51.668338 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9fbd0d85-3239-4945-924d-22d5181fece1 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031541 Oct 05 02:26:51.669158 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 18/44] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:26:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:26:51.691324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-39236670-17df-4770-a504-24129c11cb91 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1409079577", "id": 95642798, "os-flavor-access:is_public": "True"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:26:51.720633 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-39236670-17df-4770-a504-24129c11cb91 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.1 time: 0.032981 Oct 05 02:26:51.721609 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 27/45] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:26:51 2022] POST /compute/v2.1/flavors => generated 408 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:26:51.733085 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5f06f2c0-37da-40d0-8c47-b1d670c9a857 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:51.740881 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5f06f2c0-37da-40d0-8c47-b1d670c9a857 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/95642798" status: 200 len: 408 microversion: 2.1 time: 0.011403 Oct 05 02:26:51.741490 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 19/46] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 5 02:26:51 2022] GET /compute/v2.1/flavors/95642798 => generated 408 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:26:52.086755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d61870d6-7c5d-4dfe-ac96-fad35507ebf4 tempest-FlavorsAdminTestJSON-576867606 tempest-FlavorsAdminTestJSON-576867606-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:52.126465 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d61870d6-7c5d-4dfe-ac96-fad35507ebf4 tempest-FlavorsAdminTestJSON-576867606 tempest-FlavorsAdminTestJSON-576867606-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5389 microversion: 2.1 time: 0.376238 Oct 05 02:26:52.127786 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 28/47] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:26:51 2022] GET /compute/v2.1/flavors/detail => generated 5389 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:26:52.147645 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-75395434-7a8f-4950-b3c9-48afab2962c8 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:52.170981 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-75395434-7a8f-4950-b3c9-48afab2962c8 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/95642798" status: 202 len: 0 microversion: 2.1 time: 0.027986 Oct 05 02:26:52.173702 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 29/48] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 5 02:26:52 2022] DELETE /compute/v2.1/flavors/95642798 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 02:26:52.190583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-365fa2ff-ae8e-4373-95d6-22a46e9ca20d tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:52.221329 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-365fa2ff-ae8e-4373-95d6-22a46e9ca20d tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038171 Oct 05 02:26:52.222647 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 30/49] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:26:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:26:52.246872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bb92ffda-2bca-4572-9e39-e73da73d9e68 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1979459332", "id": 1706382479, "os-flavor-access:is_public": "False"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:26:52.262339 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5ae8c6c1-9b86-4fec-b902-133cd8d0cbd1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1715764795", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:26:52.272183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=9,nova_api:DELETE=9 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:52.275360 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bb92ffda-2bca-4572-9e39-e73da73d9e68 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.036469 Oct 05 02:26:52.276514 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 31/50] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:26:52 2022] POST /compute/v2.1/flavors => generated 430 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:26:52.302230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8b72b03c-49a4-4d8d-b721-6fd9c01f8ee2 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:52.304776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8b72b03c-49a4-4d8d-b721-6fd9c01f8ee2 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:26:52.321607 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b72b03c-49a4-4d8d-b721-6fd9c01f8ee2 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:52.322334 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b72b03c-49a4-4d8d-b721-6fd9c01f8ee2 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:52.322912 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b72b03c-49a4-4d8d-b721-6fd9c01f8ee2 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:52.325218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b72b03c-49a4-4d8d-b721-6fd9c01f8ee2 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:52.325828 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b72b03c-49a4-4d8d-b721-6fd9c01f8ee2 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:52.329747 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b72b03c-49a4-4d8d-b721-6fd9c01f8ee2 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:52.365922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-5ae8c6c1-9b86-4fec-b902-133cd8d0cbd1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] validate_networks() for None {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:26:52.517837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8b72b03c-49a4-4d8d-b721-6fd9c01f8ee2 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aebce7113c4e8980490aa0b0fbb296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b7bb601bea47d88c9ad68be2651451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:26:52.543356 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8b72b03c-49a4-4d8d-b721-6fd9c01f8ee2 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] 10.222.0.16 "GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9" status: 200 len: 1297 microversion: 2.1 time: 0.260074 Oct 05 02:26:52.558864 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 32/51] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:26:52 2022] GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 => generated 1297 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:26:52.577396 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-73db3e11-cc65-4b74-8072-0244a4d975db tempest-FlavorsAdminTestJSON-576867606 tempest-FlavorsAdminTestJSON-576867606-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "1706382479"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:26:52.598255 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-73db3e11-cc65-4b74-8072-0244a4d975db tempest-FlavorsAdminTestJSON-576867606 tempest-FlavorsAdminTestJSON-576867606-project] HTTP exception thrown: Flavor 1706382479 could not be found. Oct 05 02:26:52.602438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-73db3e11-cc65-4b74-8072-0244a4d975db tempest-FlavorsAdminTestJSON-576867606 tempest-FlavorsAdminTestJSON-576867606-project] Request method failure captured: Oct 05 02:26:52.602438 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 02:26:52.602438 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:26:52.602438 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:26:52.602438 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:26:52.602438 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 107 Oct 05 02:26:52.602438 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:26:52.602438 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:26:52.602438 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:26:52.602438 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:26:52.602438 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOtpR7TfO9wDWPDzaGncWoeTU5a6WOQe-Dd8JydqTTbnspzpmAZlsw4Fn-A7K5aV1L5fCdqtZXoSl7zGxtzvE-gdhb6iDeQ1BxyFgAC4qxWC7DBYCYuiVelTeZk7pBc2zImdn1m9m76sAdlsW56O1tLlv3sNKsnheFbwAKj6uXhxeGs Oct 05 02:26:52.602438 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:26:52.602438 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:26:52.602438 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:26:52.602438 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:26:52.602438 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:26:52.602438 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:26:52.602438 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 205b2ecb09f94f48a682a22555b084e6 Oct 05 02:26:52.602438 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-FlavorsAdminTestJSON-576867606 Oct 05 02:26:52.602438 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:26:52.602438 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:26:52.603511 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/205b2ecb09f94f48a682a22555b084e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/205b2ecb09f94f48a682a22555b084e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/205b2ecb09f94f48a682a22555b084e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_205b2ecb09f94f48a682a22555b084e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:26:52.603511 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-FlavorsAdminTestJSON-576867606 Oct 05 02:26:52.603511 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 205b2ecb09f94f48a682a22555b084e6 Oct 05 02:26:52.603511 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-576867606 Oct 05 02:26:52.603511 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-FlavorsAdminTestJSON-576867606-project Oct 05 02:26:52.603511 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:26:52.603511 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:26:52.603511 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 1a6e771a42484ae09e43df3007b5e3c6 Oct 05 02:26:52.603511 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-FlavorsAdminTestJSON-576867606-project Oct 05 02:26:52.603511 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:26:52.603511 n-d-858272-3 devstack@n-api.service[122319]: {"server": {"name": "test", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "1706382479"}} Oct 05 02:26:52.603511 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:26:52.603511 n-d-858272-3 devstack@n-api.service[122319]: exception: Flavor 1706382479 could not be found. Oct 05 02:26:52.604184 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'adad3215-1ca6-43bb-9981-0d01aff146ab', 'flavorRef': '1706382479'}}} Oct 05 02:26:52.604184 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:26:52.604184 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:26:52.604184 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 05 02:26:52.604184 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 05 02:26:52.604184 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 05 02:26:52.604184 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 05 02:26:52.604184 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:26:52.604184 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:26:52.604184 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 05 02:26:52.604184 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 05 02:26:52.604184 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 05 02:26:52.604184 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:26:52.604184 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 05 02:26:52.604184 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 05 02:26:52.604184 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1706382479 could not be found. Oct 05 02:26:52.604184 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:26:52.604184 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:26:52.604184 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:26:52.604184 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:26:52.605167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:26:52.605167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:26:52.605167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:26:52.605167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:26:52.605167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:26:52.605167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:26:52.605167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:26:52.605167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:26:52.605167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:26:52.605167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:26:52.605167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:26:52.605167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:26:52.605167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 05 02:26:52.605167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 05 02:26:52.605167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 05 02:26:52.605167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1706382479 could not be found. Oct 05 02:26:52.605167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:26:52.605167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:26:52.605167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:26:52.605167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:26:52.605167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:26:52.606436 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:26:52.606436 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:26:52.606436 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:26:52.606436 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1706382479 could not be found. Oct 05 02:26:52.606436 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:26:52.609126 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-73db3e11-cc65-4b74-8072-0244a4d975db tempest-FlavorsAdminTestJSON-576867606 tempest-FlavorsAdminTestJSON-576867606-project] Returning 400 to user: Flavor 1706382479 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:26:52.610153 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-73db3e11-cc65-4b74-8072-0244a4d975db tempest-FlavorsAdminTestJSON-576867606 tempest-FlavorsAdminTestJSON-576867606-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.050162 Oct 05 02:26:52.611534 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 33/52] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:26:52 2022] POST /compute/v2.1/servers => generated 81 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 05 02:26:52.625469 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-66603044-f514-4a3e-abea-75b9d5784c4b tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:52.667208 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-66603044-f514-4a3e-abea-75b9d5784c4b tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1706382479" status: 202 len: 0 microversion: 2.1 time: 0.050672 Oct 05 02:26:52.673798 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 34/53] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 5 02:26:52 2022] DELETE /compute/v2.1/flavors/1706382479 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:26:52.682888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ae4645d2-6223-4359-ad97-ee8d58c9511f tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:52.691063 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-5ae8c6c1-9b86-4fec-b902-133cd8d0cbd1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:26:52.692071 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-5ae8c6c1-9b86-4fec-b902-133cd8d0cbd1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:26:52.692740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-5ae8c6c1-9b86-4fec-b902-133cd8d0cbd1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:26:52.693330 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-5ae8c6c1-9b86-4fec-b902-133cd8d0cbd1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:26:52.693891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-5ae8c6c1-9b86-4fec-b902-133cd8d0cbd1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:26:52.706383 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ae4645d2-6223-4359-ad97-ee8d58c9511f tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029469 Oct 05 02:26:52.720928 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 35/54] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:26:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:26:52.721110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5ae8c6c1-9b86-4fec-b902-133cd8d0cbd1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:52.721110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5ae8c6c1-9b86-4fec-b902-133cd8d0cbd1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:52.721110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5ae8c6c1-9b86-4fec-b902-133cd8d0cbd1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:52.721110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5ae8c6c1-9b86-4fec-b902-133cd8d0cbd1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:52.721441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5ae8c6c1-9b86-4fec-b902-133cd8d0cbd1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:52.721441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5ae8c6c1-9b86-4fec-b902-133cd8d0cbd1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:52.729684 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1a4069da-a792-4c0c-b7ef-e1ca34d49863 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1996442882", "id": 1847358082, "os-flavor-access:is_public": "False"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:26:52.764077 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1a4069da-a792-4c0c-b7ef-e1ca34d49863 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.038214 Oct 05 02:26:52.772595 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 36/55] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:26:52 2022] POST /compute/v2.1/flavors => generated 415 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:26:52.777308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-5ae8c6c1-9b86-4fec-b902-133cd8d0cbd1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Getting quotas for project a0a161064bfc4b608dabcd8fd2b26037. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:26:52.783765 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-5ae8c6c1-9b86-4fec-b902-133cd8d0cbd1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Getting quotas for user fa65581361534943b2cda9381e3f7a8c and project a0a161064bfc4b608dabcd8fd2b26037. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:26:52.798653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5ae8c6c1-9b86-4fec-b902-133cd8d0cbd1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:26:52.801576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5ae8c6c1-9b86-4fec-b902-133cd8d0cbd1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: c9ea1283-2889-4a96-bee8-b2b99509ed59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:26:52.906234 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5ae8c6c1-9b86-4fec-b902-133cd8d0cbd1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.092975 Oct 05 02:26:52.906923 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 20/56] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:26:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 02:26:52.918524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4a57259c-aaa2-4f97-bd5d-1006496414cb tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-326189359", "id": 817125904, "os-flavor-access:is_public": "True"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:26:52.947701 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4a57259c-aaa2-4f97-bd5d-1006496414cb tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.039215 Oct 05 02:26:52.948419 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 21/57] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:26:52 2022] POST /compute/v2.1/flavors => generated 410 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:26:52.962298 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-712784b2-7cd8-44a4-87cd-ad52fd5e6302 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:52.964300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-712784b2-7cd8-44a4-87cd-ad52fd5e6302 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: c9ea1283-2889-4a96-bee8-b2b99509ed59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:26:53.088166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-712784b2-7cd8-44a4-87cd-ad52fd5e6302 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:26:53.115379 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-712784b2-7cd8-44a4-87cd-ad52fd5e6302 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59" status: 200 len: 1220 microversion: 2.1 time: 0.157652 Oct 05 02:26:53.121730 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 22/58] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:26:52 2022] GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59 => generated 1220 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:26:53.131181 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1acdbe58-0bfd-4fd5-a432-ebaeadad8e05 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:53.186649 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1acdbe58-0bfd-4fd5-a432-ebaeadad8e05 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.063160 Oct 05 02:26:53.187995 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 23/59] 10.222.0.16 () {58 vars in 1169 bytes} [Wed Oct 5 02:26:53 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:26:53.415207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-26654ad6-8436-4b23-9824-21211362e009 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1042791212", "ram": 512, "vcpus": 1, "disk": 10, "id": 1945031659, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:26:53.426444 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4d4df350-c442-491a-9acc-04931d412a4a tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Calling method '.version_select at 0x7fcce4e079d0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:53.430326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d4df350-c442-491a-9acc-04931d412a4a tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:53.430815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d4df350-c442-491a-9acc-04931d412a4a tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:53.431255 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d4df350-c442-491a-9acc-04931d412a4a tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:53.451027 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-26654ad6-8436-4b23-9824-21211362e009 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.261535 Oct 05 02:26:53.451923 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 24/60] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:26:53 2022] POST /compute/v2.1/flavors => generated 416 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:26:53.466404 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e9fbce78-b3d5-48c7-b1a2-eb534201641e tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:53.474833 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d4df350-c442-491a-9acc-04931d412a4a tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:53.476265 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d4df350-c442-491a-9acc-04931d412a4a tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:53.476718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d4df350-c442-491a-9acc-04931d412a4a tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:53.517751 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e9fbce78-b3d5-48c7-b1a2-eb534201641e tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.055665 Oct 05 02:26:53.518359 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 25/61] 10.222.0.16 () {58 vars in 1177 bytes} [Wed Oct 5 02:26:53 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:26:53.562157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d4df350-c442-491a-9acc-04931d412a4a tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:53.562764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d4df350-c442-491a-9acc-04931d412a4a tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:53.563253 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d4df350-c442-491a-9acc-04931d412a4a tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:53.585609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d4df350-c442-491a-9acc-04931d412a4a tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:53.586100 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d4df350-c442-491a-9acc-04931d412a4a tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:53.586532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d4df350-c442-491a-9acc-04931d412a4a tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:53.620665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d4df350-c442-491a-9acc-04931d412a4a tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:53.621490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d4df350-c442-491a-9acc-04931d412a4a tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:53.622237 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d4df350-c442-491a-9acc-04931d412a4a tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:53.629573 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4d4df350-c442-491a-9acc-04931d412a4a tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1664 microversion: 2.53 time: 0.861481 Oct 05 02:26:53.650401 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 37/62] 10.222.0.16 () {60 vars in 1243 bytes} [Wed Oct 5 02:26:52 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1664 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:26:53.661024 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1f6d1b8c-026a-45a7-9e73-9ebb00afe6b8 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:53.699740 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1f6d1b8c-026a-45a7-9e73-9ebb00afe6b8 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.047637 Oct 05 02:26:53.700855 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 38/63] 10.222.0.16 () {58 vars in 1171 bytes} [Wed Oct 5 02:26:53 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:26:53.714478 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6f3a97c6-e222-41a3-8dfb-49ef3df12dcf tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:53.719486 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6f3a97c6-e222-41a3-8dfb-49ef3df12dcf tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:26:53.736039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f3a97c6-e222-41a3-8dfb-49ef3df12dcf tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:53.737012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f3a97c6-e222-41a3-8dfb-49ef3df12dcf tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:53.737681 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f3a97c6-e222-41a3-8dfb-49ef3df12dcf tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:53.741245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f3a97c6-e222-41a3-8dfb-49ef3df12dcf tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:53.742160 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f3a97c6-e222-41a3-8dfb-49ef3df12dcf tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:53.742776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f3a97c6-e222-41a3-8dfb-49ef3df12dcf tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:53.808279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4e2eccc6-3a2c-4435-8eeb-042e35d324cf tempest-FlavorsExtraSpecsNegativeTestJSON-647896579 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:53.826417 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-4e2eccc6-3a2c-4435-8eeb-042e35d324cf tempest-FlavorsExtraSpecsNegativeTestJSON-647896579 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579-project] HTTP exception thrown: Flavor 1945031659 has no extra specs with key hw:cpu_thread_policy. Oct 05 02:26:53.833052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4e2eccc6-3a2c-4435-8eeb-042e35d324cf tempest-FlavorsExtraSpecsNegativeTestJSON-647896579 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579-project] Request method failure captured: Oct 05 02:26:53.833052 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/flavors/1945031659/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 05 02:26:53.833052 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:26:53.833052 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:26:53.833052 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:26:53.833052 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:26:53.833052 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:26:53.833052 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:26:53.833052 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:26:53.833052 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:26:53.833052 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOtr6XKjGd34KRS38CwStXXO1DcltmuXCzW2T3eQa7M8RYG8ESlkKmTb1tCknsEVVlyjl22VjYZqxJ4mDxekMZAh1YzQM-BlfiEzrc77tajLlOAYNgL536l8QJ67tVVbfmEPdepyLCa5bHKrAfKj6AgOPVrchCNpp_ZfhnatogYfbCU Oct 05 02:26:53.833052 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:26:53.833052 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:26:53.833052 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:26:53.833052 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:26:53.833052 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:26:53.833052 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:26:53.833052 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: f5ee302729b94af88faeeab91f24ca23 Oct 05 02:26:53.833052 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-647896579 Oct 05 02:26:53.833052 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:26:53.833052 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:26:53.834244 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5ee302729b94af88faeeab91f24ca23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5ee302729b94af88faeeab91f24ca23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f5ee302729b94af88faeeab91f24ca23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f5ee302729b94af88faeeab91f24ca23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:26:53.834244 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-647896579 Oct 05 02:26:53.834244 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: f5ee302729b94af88faeeab91f24ca23 Oct 05 02:26:53.834244 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-647896579 Oct 05 02:26:53.834244 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-647896579-project Oct 05 02:26:53.834244 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:26:53.834244 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:26:53.834244 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 2937cb376ab94fceb8ba49bab0878e68 Oct 05 02:26:53.834244 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-647896579-project Oct 05 02:26:53.834244 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:26:53.834244 n-d-858272-3 devstack@n-api.service[122320]: exception: Flavor 1945031659 has no extra specs with key hw:cpu_thread_policy. Oct 05 02:26:53.834840 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'flavor_id': '1945031659', 'id': 'hw:cpu_thread_policy'} Oct 05 02:26:53.834840 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:26:53.834840 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:26:53.834840 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 05 02:26:53.834840 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 05 02:26:53.834840 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 05 02:26:53.834840 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:26:53.834840 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:26:53.834840 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:26:53.834840 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:26:53.834840 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:26:53.834840 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:26:53.834840 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:26:53.834840 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:26:53.834840 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:26:53.834840 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:26:53.834840 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 05 02:26:53.834840 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 05 02:26:53.834840 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1945031659 has no extra specs with key hw:cpu_thread_policy. Oct 05 02:26:53.834840 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:26:53.834840 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:26:53.834840 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:26:53.835946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:26:53.835946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:26:53.835946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:26:53.835946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:26:53.835946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:26:53.835946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1945031659 has no extra specs with key hw:cpu_thread_policy. Oct 05 02:26:53.835946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:26:53.851995 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4e2eccc6-3a2c-4435-8eeb-042e35d324cf tempest-FlavorsExtraSpecsNegativeTestJSON-647896579 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579-project] Returning 404 to user: Flavor 1945031659 has no extra specs with key hw:cpu_thread_policy. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:26:53.855189 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4e2eccc6-3a2c-4435-8eeb-042e35d324cf tempest-FlavorsExtraSpecsNegativeTestJSON-647896579 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579-project] 10.222.0.16 "GET /compute/v2.1/flavors/1945031659/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.335814 Oct 05 02:26:53.858914 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 26/64] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 5 02:26:53 2022] GET /compute/v2.1/flavors/1945031659/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 340 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:26:53.871008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3e13373c-e0ef-49cc-9106-6596111fc9fd tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Calling method '.version_select at 0x7fcce4e525e0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:53.886516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e13373c-e0ef-49cc-9106-6596111fc9fd tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:53.887116 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e13373c-e0ef-49cc-9106-6596111fc9fd tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:53.890993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e13373c-e0ef-49cc-9106-6596111fc9fd tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:53.941244 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e13373c-e0ef-49cc-9106-6596111fc9fd tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:53.942122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e13373c-e0ef-49cc-9106-6596111fc9fd tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:53.942253 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e13373c-e0ef-49cc-9106-6596111fc9fd tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:54.028142 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e13373c-e0ef-49cc-9106-6596111fc9fd tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:54.028640 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e13373c-e0ef-49cc-9106-6596111fc9fd tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:54.029403 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e13373c-e0ef-49cc-9106-6596111fc9fd tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:54.044041 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e13373c-e0ef-49cc-9106-6596111fc9fd tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:54.044867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e13373c-e0ef-49cc-9106-6596111fc9fd tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:54.045335 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e13373c-e0ef-49cc-9106-6596111fc9fd tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:54.078164 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e13373c-e0ef-49cc-9106-6596111fc9fd tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:54.080847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e13373c-e0ef-49cc-9106-6596111fc9fd tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:54.083520 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e13373c-e0ef-49cc-9106-6596111fc9fd tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:54.091657 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3e13373c-e0ef-49cc-9106-6596111fc9fd tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 357 microversion: 2.53 time: 0.231076 Oct 05 02:26:54.092614 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 27/65] 10.222.0.16 () {60 vars in 1222 bytes} [Wed Oct 5 02:26:53 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 357 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:26:54.099362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-11d1a53a-588a-4410-b45c-1ade6d0dbe59 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:54.117234 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-11d1a53a-588a-4410-b45c-1ade6d0dbe59 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.022848 Oct 05 02:26:54.118026 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 28/66] 10.222.0.16 () {58 vars in 1169 bytes} [Wed Oct 5 02:26:54 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:26:54.144775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5a6845d7-49a5-4516-9f49-b31c454e7ca6 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:26:54.151558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5a6845d7-49a5-4516-9f49-b31c454e7ca6 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '2937cb376ab94fceb8ba49bab0878e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee302729b94af88faeeab91f24ca23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:26:54.152678 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6f3a97c6-e222-41a3-8dfb-49ef3df12dcf tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aebce7113c4e8980490aa0b0fbb296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b7bb601bea47d88c9ad68be2651451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:26:54.156835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5a6845d7-49a5-4516-9f49-b31c454e7ca6 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579-project] Request method failure captured: Oct 05 02:26:54.156835 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/flavors/1945031659/os-extra_specs HTTP/1.1 Oct 05 02:26:54.156835 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:26:54.156835 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:26:54.156835 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:26:54.156835 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 66 Oct 05 02:26:54.156835 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:26:54.156835 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:26:54.156835 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:26:54.156835 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:26:54.156835 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOtr6XKjGd34KRS38CwStXXO1DcltmuXCzW2T3eQa7M8RYG8ESlkKmTb1tCknsEVVlyjl22VjYZqxJ4mDxekMZAh1YzQM-BlfiEzrc77tajLlOAYNgL536l8QJ67tVVbfmEPdepyLCa5bHKrAfKj6AgOPVrchCNpp_ZfhnatogYfbCU Oct 05 02:26:54.156835 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:26:54.156835 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:26:54.156835 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:26:54.156835 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:26:54.156835 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:26:54.156835 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:26:54.156835 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: f5ee302729b94af88faeeab91f24ca23 Oct 05 02:26:54.156835 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-647896579 Oct 05 02:26:54.156835 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:26:54.156835 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:26:54.158001 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5ee302729b94af88faeeab91f24ca23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5ee302729b94af88faeeab91f24ca23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f5ee302729b94af88faeeab91f24ca23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f5ee302729b94af88faeeab91f24ca23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:26:54.158001 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-647896579 Oct 05 02:26:54.158001 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: f5ee302729b94af88faeeab91f24ca23 Oct 05 02:26:54.158001 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-647896579 Oct 05 02:26:54.158001 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-647896579-project Oct 05 02:26:54.158001 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:26:54.158001 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:26:54.158001 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 2937cb376ab94fceb8ba49bab0878e68 Oct 05 02:26:54.158001 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-647896579-project Oct 05 02:26:54.158001 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:26:54.158001 n-d-858272-3 devstack@n-api.service[122320]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 05 02:26:54.158001 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:26:54.158625 n-d-858272-3 devstack@n-api.service[122320]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 05 02:26:54.158625 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'flavor_id': '1945031659', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 05 02:26:54.158625 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:26:54.158625 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:26:54.158625 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:26:54.158625 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:26:54.158625 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:26:54.158625 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:26:54.158625 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:26:54.158625 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:26:54.158625 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:26:54.158625 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:26:54.158625 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 05 02:26:54.158625 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 05 02:26:54.158625 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 02:26:54.158625 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 02:26:54.158625 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 02:26:54.158625 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 02:26:54.158625 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:26:54.159641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:26:54.159641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:26:54.159641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:26:54.159641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 02:26:54.159641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 02:26:54.159641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 02:26:54.159641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 02:26:54.159641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:26:54.159641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 02:26:54.159641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 05 02:26:54.159641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:26:54.159641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:26:54.159641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:26:54.159641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:26:54.159641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:26:54.159641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:26:54.159641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 02:26:54.159641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 02:26:54.159641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 05 02:26:54.159641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:26:54.163778 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6f3a97c6-e222-41a3-8dfb-49ef3df12dcf tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] 10.222.0.16 "GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9" status: 200 len: 1339 microversion: 2.1 time: 0.461565 Oct 05 02:26:54.164436 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5a6845d7-49a5-4516-9f49-b31c454e7ca6 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:26:54.165857 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5a6845d7-49a5-4516-9f49-b31c454e7ca6 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579-project] 10.222.0.16 "POST /compute/v2.1/flavors/1945031659/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.029495 Oct 05 02:26:54.174822 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 29/67] 10.222.0.16 () {60 vars in 1224 bytes} [Wed Oct 5 02:26:54 2022] POST /compute/v2.1/flavors/1945031659/os-extra_specs => generated 124 bytes in 56 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:26:54.178253 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 39/68] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:26:53 2022] GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 => generated 1339 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:26:54.183891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4d420f28-eacd-404b-bf94-40e77a74174c tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Calling method '.version_select at 0x7fcce4e44f70>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:54.188710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d420f28-eacd-404b-bf94-40e77a74174c tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:54.188924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-942f5c7d-1f6a-4983-ac3f-fc2889fcfab2 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:54.189245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d420f28-eacd-404b-bf94-40e77a74174c tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:54.189693 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d420f28-eacd-404b-bf94-40e77a74174c tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:54.233358 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-942f5c7d-1f6a-4983-ac3f-fc2889fcfab2 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5797 microversion: 2.1 time: 0.053356 Oct 05 02:26:54.246491 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 40/69] 10.222.0.16 () {58 vars in 1169 bytes} [Wed Oct 5 02:26:54 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5797 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:26:54.257151 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5c43b8c0-86ff-41ab-b16f-d1dd160519b5 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:54.258068 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5c43b8c0-86ff-41ab-b16f-d1dd160519b5 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: c9ea1283-2889-4a96-bee8-b2b99509ed59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:26:54.274758 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d420f28-eacd-404b-bf94-40e77a74174c tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:54.275329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d420f28-eacd-404b-bf94-40e77a74174c tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:54.275788 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d420f28-eacd-404b-bf94-40e77a74174c tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:54.299172 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4d420f28-eacd-404b-bf94-40e77a74174c tempest-HypervisorAdminV253TestBase-393567657 tempest-HypervisorAdminV253TestBase-393567657-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/157c2ff9-af1e-4bd6-af5d-1e5fae3d7a8b" status: 200 len: 792 microversion: 2.53 time: 0.122964 Oct 05 02:26:54.316357 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 30/70] 10.222.0.16 () {60 vars in 1298 bytes} [Wed Oct 5 02:26:54 2022] GET /compute/v2.1/os-hypervisors/157c2ff9-af1e-4bd6-af5d-1e5fae3d7a8b => generated 792 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:26:54.324386 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2214a27f-2102-436f-ba0f-8fc506bec980 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:26:54.336002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5c43b8c0-86ff-41ab-b16f-d1dd160519b5 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:26:54.355727 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5c43b8c0-86ff-41ab-b16f-d1dd160519b5 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59" status: 200 len: 1220 microversion: 2.1 time: 0.107661 Oct 05 02:26:54.356955 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 41/71] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:26:54 2022] GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59 => generated 1220 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:26:54.374693 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-946ecb2d-04df-48ed-bb78-80ef6e25432b tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:54.429598 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2214a27f-2102-436f-ba0f-8fc506bec980 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1945031659/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.110071 Oct 05 02:26:54.430230 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 31/72] 10.222.0.16 () {60 vars in 1224 bytes} [Wed Oct 5 02:26:54 2022] POST /compute/v2.1/flavors/1945031659/os-extra_specs => generated 66 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:26:54.445491 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-946ecb2d-04df-48ed-bb78-80ef6e25432b tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5797 microversion: 2.1 time: 0.085720 Oct 05 02:26:54.446497 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-04f12c51-ee12-4cb4-90fb-6389f6d62908 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:54.448037 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 42/73] 10.222.0.16 () {58 vars in 1175 bytes} [Wed Oct 5 02:26:54 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5797 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:26:54.461197 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-04f12c51-ee12-4cb4-90fb-6389f6d62908 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '2937cb376ab94fceb8ba49bab0878e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee302729b94af88faeeab91f24ca23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:26:54.461197 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-04f12c51-ee12-4cb4-90fb-6389f6d62908 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579-project] Request method failure captured: Oct 05 02:26:54.461197 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/flavors/1945031659/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 05 02:26:54.461197 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:26:54.461197 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:26:54.461197 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:26:54.461197 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:26:54.461197 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:26:54.461197 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:26:54.461197 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:26:54.461197 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:26:54.461197 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOtr6XKjGd34KRS38CwStXXO1DcltmuXCzW2T3eQa7M8RYG8ESlkKmTb1tCknsEVVlyjl22VjYZqxJ4mDxekMZAh1YzQM-BlfiEzrc77tajLlOAYNgL536l8QJ67tVVbfmEPdepyLCa5bHKrAfKj6AgOPVrchCNpp_ZfhnatogYfbCU Oct 05 02:26:54.461197 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:26:54.461197 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:26:54.461197 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:26:54.461197 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:26:54.461197 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:26:54.461197 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:26:54.461197 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: f5ee302729b94af88faeeab91f24ca23 Oct 05 02:26:54.461197 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-647896579 Oct 05 02:26:54.461197 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:26:54.461197 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:26:54.462411 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5ee302729b94af88faeeab91f24ca23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5ee302729b94af88faeeab91f24ca23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f5ee302729b94af88faeeab91f24ca23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f5ee302729b94af88faeeab91f24ca23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:26:54.462411 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-647896579 Oct 05 02:26:54.462411 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: f5ee302729b94af88faeeab91f24ca23 Oct 05 02:26:54.462411 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-647896579 Oct 05 02:26:54.462411 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-647896579-project Oct 05 02:26:54.462411 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:26:54.462411 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:26:54.462411 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 2937cb376ab94fceb8ba49bab0878e68 Oct 05 02:26:54.462411 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-647896579-project Oct 05 02:26:54.462411 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:26:54.462411 n-d-858272-3 devstack@n-api.service[122320]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 05 02:26:54.462972 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'flavor_id': '1945031659', 'id': 'hw:numa_nodes'} Oct 05 02:26:54.462972 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:26:54.462972 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:26:54.462972 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:26:54.462972 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:26:54.462972 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:26:54.462972 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:26:54.462972 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:26:54.462972 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:26:54.462972 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 05 02:26:54.462972 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 05 02:26:54.462972 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 02:26:54.462972 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 02:26:54.462972 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 02:26:54.462972 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 02:26:54.462972 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:26:54.462972 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:26:54.462972 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:26:54.462972 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:26:54.462972 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 02:26:54.464016 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 02:26:54.464016 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 02:26:54.464016 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 02:26:54.464016 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:26:54.464016 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 02:26:54.464016 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 05 02:26:54.464016 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:26:54.464016 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:26:54.464016 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:26:54.464016 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:26:54.464016 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:26:54.464016 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:26:54.464016 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 02:26:54.464016 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 02:26:54.464016 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 05 02:26:54.464016 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:26:54.464016 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-04f12c51-ee12-4cb4-90fb-6389f6d62908 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:26:54.464872 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-04f12c51-ee12-4cb4-90fb-6389f6d62908 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579-project] 10.222.0.16 "DELETE /compute/v2.1/flavors/1945031659/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.016329 Oct 05 02:26:54.464872 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 32/74] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 02:26:54 2022] DELETE /compute/v2.1/flavors/1945031659/os-extra_specs/hw:numa_nodes => generated 124 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:26:54.469793 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-57f14fce-a6af-462d-9820-0c8648d8d0d4 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:26:54.475045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8e799df0-fd73-4d98-99f7-4c1f36c7d845 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:54.507021 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-57f14fce-a6af-462d-9820-0c8648d8d0d4 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1945031659/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.043793 Oct 05 02:26:54.508706 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 33/75] 10.222.0.16 () {60 vars in 1224 bytes} [Wed Oct 5 02:26:54 2022] POST /compute/v2.1/flavors/1945031659/os-extra_specs => generated 66 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:26:54.522582 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-87d56df6-7afa-4965-bdeb-57441402c9d5 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:26:54.528055 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8e799df0-fd73-4d98-99f7-4c1f36c7d845 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5797 microversion: 2.1 time: 0.056048 Oct 05 02:26:54.528616 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-87d56df6-7afa-4965-bdeb-57441402c9d5 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '2937cb376ab94fceb8ba49bab0878e68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee302729b94af88faeeab91f24ca23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:26:54.542475 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 43/76] 10.222.0.16 () {58 vars in 1173 bytes} [Wed Oct 5 02:26:54 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5797 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:26:54.542660 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-87d56df6-7afa-4965-bdeb-57441402c9d5 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579-project] Request method failure captured: Oct 05 02:26:54.542660 n-d-858272-3 devstack@n-api.service[122320]: request: PUT /compute/v2.1/flavors/1945031659/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 05 02:26:54.542660 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:26:54.542660 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:26:54.542660 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:26:54.542660 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 22 Oct 05 02:26:54.542660 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:26:54.542660 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:26:54.542660 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:26:54.542660 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:26:54.542660 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOtr6XKjGd34KRS38CwStXXO1DcltmuXCzW2T3eQa7M8RYG8ESlkKmTb1tCknsEVVlyjl22VjYZqxJ4mDxekMZAh1YzQM-BlfiEzrc77tajLlOAYNgL536l8QJ67tVVbfmEPdepyLCa5bHKrAfKj6AgOPVrchCNpp_ZfhnatogYfbCU Oct 05 02:26:54.542660 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:26:54.542660 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:26:54.542660 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:26:54.542660 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:26:54.542660 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:26:54.542660 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:26:54.542660 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: f5ee302729b94af88faeeab91f24ca23 Oct 05 02:26:54.542660 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-647896579 Oct 05 02:26:54.542660 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:26:54.542660 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:26:54.543816 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5ee302729b94af88faeeab91f24ca23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5ee302729b94af88faeeab91f24ca23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f5ee302729b94af88faeeab91f24ca23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f5ee302729b94af88faeeab91f24ca23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:26:54.543816 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-647896579 Oct 05 02:26:54.543816 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: f5ee302729b94af88faeeab91f24ca23 Oct 05 02:26:54.543816 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-647896579 Oct 05 02:26:54.543816 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-647896579-project Oct 05 02:26:54.543816 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:26:54.543816 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:26:54.543816 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 2937cb376ab94fceb8ba49bab0878e68 Oct 05 02:26:54.543816 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-647896579-project Oct 05 02:26:54.543816 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:26:54.543816 n-d-858272-3 devstack@n-api.service[122320]: {"hw:numa_nodes": "1"} Oct 05 02:26:54.543816 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:26:54.543816 n-d-858272-3 devstack@n-api.service[122320]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 05 02:26:54.544484 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'flavor_id': '1945031659', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 05 02:26:54.544484 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:26:54.544484 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:26:54.544484 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:26:54.544484 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:26:54.544484 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:26:54.544484 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:26:54.544484 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:26:54.544484 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:26:54.544484 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:26:54.544484 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:26:54.544484 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 05 02:26:54.544484 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 05 02:26:54.544484 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 02:26:54.544484 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 02:26:54.544484 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 02:26:54.544484 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 02:26:54.544484 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:26:54.544484 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:26:54.545466 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:26:54.545466 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:26:54.545466 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 02:26:54.545466 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 02:26:54.545466 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 02:26:54.545466 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 02:26:54.545466 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:26:54.545466 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 02:26:54.545466 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 05 02:26:54.545466 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:26:54.545466 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:26:54.545466 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:26:54.545466 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:26:54.545466 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:26:54.545466 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:26:54.545466 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 02:26:54.545466 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 02:26:54.545466 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 05 02:26:54.545466 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:26:54.546440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-87d56df6-7afa-4965-bdeb-57441402c9d5 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:26:54.546440 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-87d56df6-7afa-4965-bdeb-57441402c9d5 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579 tempest-FlavorsExtraSpecsNegativeTestJSON-647896579-project] 10.222.0.16 "PUT /compute/v2.1/flavors/1945031659/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.015391 Oct 05 02:26:54.546440 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 34/77] 10.222.0.16 () {60 vars in 1265 bytes} [Wed Oct 5 02:26:54 2022] PUT /compute/v2.1/flavors/1945031659/os-extra_specs/hw:numa_nodes => generated 124 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:26:54.546626 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-57cbb4ce-f190-4c52-b116-51b9e6af04d4 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:54.558453 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-57cbb4ce-f190-4c52-b116-51b9e6af04d4 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934-project-admin] HTTP exception thrown: Flavor 1945031659 has no extra specs with key hw:cpu_thread_policy. Oct 05 02:26:54.560072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-57cbb4ce-f190-4c52-b116-51b9e6af04d4 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934-project-admin] Request method failure captured: Oct 05 02:26:54.560072 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/flavors/1945031659/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 05 02:26:54.560072 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:26:54.560072 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:26:54.560072 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:26:54.560072 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:26:54.560072 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:26:54.560072 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:26:54.560072 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:26:54.560072 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:26:54.560072 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOtsXf-YHeh9HOyXKVEP7rEv3Rxd-FYXwOHplxSbYUJqPFOLxzkUKbndB7OLh5JpV8blH3jxRIFH_D1GJBtoJbFp39VmgRCJOwJWEFQzeBwiFi3AzfpsOiAMahW2PepEMHhWobIw10wvPCvbn7oUbLUqgr-Gc_PR_yPerMA75hK7ZRc Oct 05 02:26:54.560072 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:26:54.560072 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:26:54.560072 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:26:54.560072 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:26:54.560072 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:26:54.560072 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:26:54.560072 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 3a31cc939acb4e2a941ba27d4d9f0e81 Oct 05 02:26:54.560072 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934 Oct 05 02:26:54.560072 n-d-858272-3 devstack@n-api.service[122319]: X-Role: admin,member,reader Oct 05 02:26:54.560072 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: admin,member,reader Oct 05 02:26:54.561684 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3a31cc939acb4e2a941ba27d4d9f0e81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3a31cc939acb4e2a941ba27d4d9f0e81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3a31cc939acb4e2a941ba27d4d9f0e81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3a31cc939acb4e2a941ba27d4d9f0e81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:26:54.561684 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934 Oct 05 02:26:54.561684 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 3a31cc939acb4e2a941ba27d4d9f0e81 Oct 05 02:26:54.561684 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934 Oct 05 02:26:54.561684 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934-project-admin Oct 05 02:26:54.561684 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:26:54.561684 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:26:54.561684 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 6a67f5e085d4483b8679afa50fd878b5 Oct 05 02:26:54.561684 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934-project-admin Oct 05 02:26:54.561684 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:26:54.561684 n-d-858272-3 devstack@n-api.service[122319]: exception: Flavor 1945031659 has no extra specs with key hw:cpu_thread_policy. Oct 05 02:26:54.562464 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'flavor_id': '1945031659', 'id': 'hw:cpu_thread_policy'} Oct 05 02:26:54.562464 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:26:54.562464 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:26:54.562464 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 05 02:26:54.562464 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 05 02:26:54.562464 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 05 02:26:54.562464 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:26:54.562464 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:26:54.562464 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:26:54.562464 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:26:54.562464 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:26:54.562464 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:26:54.562464 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:26:54.562464 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:26:54.562464 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:26:54.562464 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:26:54.562464 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 05 02:26:54.562464 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 05 02:26:54.562464 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1945031659 has no extra specs with key hw:cpu_thread_policy. Oct 05 02:26:54.562464 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:26:54.562464 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:26:54.562464 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:26:54.563834 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:26:54.563834 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:26:54.563834 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:26:54.563834 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:26:54.563834 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:26:54.563834 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1945031659 has no extra specs with key hw:cpu_thread_policy. Oct 05 02:26:54.563834 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:26:54.563834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-57cbb4ce-f190-4c52-b116-51b9e6af04d4 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934-project-admin] Returning 404 to user: Flavor 1945031659 has no extra specs with key hw:cpu_thread_policy. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:26:54.563834 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-57cbb4ce-f190-4c52-b116-51b9e6af04d4 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1945031659/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.020986 Oct 05 02:26:54.571339 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4c1623e8-e421-4eda-ac00-d7b4da0ff020 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:54.577943 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 44/78] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 5 02:26:54 2022] DELETE /compute/v2.1/flavors/1945031659/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:26:54.583392 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-22f992fc-d460-4a24-bab2-0c6a722edd7c tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:26:54.595924 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-22f992fc-d460-4a24-bab2-0c6a722edd7c tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 05 02:26:54.597388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-22f992fc-d460-4a24-bab2-0c6a722edd7c tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934-project-admin] Request method failure captured: Oct 05 02:26:54.597388 n-d-858272-3 devstack@n-api.service[122319]: request: PUT /compute/v2.1/flavors/1945031659/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 05 02:26:54.597388 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:26:54.597388 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:26:54.597388 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:26:54.597388 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 27 Oct 05 02:26:54.597388 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:26:54.597388 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:26:54.597388 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:26:54.597388 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:26:54.597388 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOtsXf-YHeh9HOyXKVEP7rEv3Rxd-FYXwOHplxSbYUJqPFOLxzkUKbndB7OLh5JpV8blH3jxRIFH_D1GJBtoJbFp39VmgRCJOwJWEFQzeBwiFi3AzfpsOiAMahW2PepEMHhWobIw10wvPCvbn7oUbLUqgr-Gc_PR_yPerMA75hK7ZRc Oct 05 02:26:54.597388 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:26:54.597388 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:26:54.597388 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:26:54.597388 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:26:54.597388 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:26:54.597388 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:26:54.597388 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 3a31cc939acb4e2a941ba27d4d9f0e81 Oct 05 02:26:54.597388 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934 Oct 05 02:26:54.597388 n-d-858272-3 devstack@n-api.service[122319]: X-Role: admin,member,reader Oct 05 02:26:54.597388 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: admin,member,reader Oct 05 02:26:54.598765 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3a31cc939acb4e2a941ba27d4d9f0e81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3a31cc939acb4e2a941ba27d4d9f0e81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3a31cc939acb4e2a941ba27d4d9f0e81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3a31cc939acb4e2a941ba27d4d9f0e81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:26:54.598765 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934 Oct 05 02:26:54.598765 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 3a31cc939acb4e2a941ba27d4d9f0e81 Oct 05 02:26:54.598765 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934 Oct 05 02:26:54.598765 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934-project-admin Oct 05 02:26:54.598765 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:26:54.598765 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:26:54.598765 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 6a67f5e085d4483b8679afa50fd878b5 Oct 05 02:26:54.598765 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934-project-admin Oct 05 02:26:54.598765 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:26:54.598765 n-d-858272-3 devstack@n-api.service[122319]: {"hw:cpu_policy": "shared"} Oct 05 02:26:54.598765 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:26:54.598765 n-d-858272-3 devstack@n-api.service[122319]: exception: Request body and URI mismatch Oct 05 02:26:54.599455 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'flavor_id': '1945031659', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 05 02:26:54.599455 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:26:54.599455 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:26:54.599455 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:26:54.599455 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:26:54.599455 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:26:54.599455 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:26:54.599455 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:26:54.599455 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:26:54.599455 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:26:54.599455 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:26:54.599455 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 05 02:26:54.599455 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 05 02:26:54.599455 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 05 02:26:54.599455 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:26:54.599455 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:26:54.599455 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:26:54.599455 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:26:54.599455 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:26:54.599455 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:26:54.600534 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:26:54.600534 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:26:54.600534 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 05 02:26:54.600534 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:26:54.600534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-22f992fc-d460-4a24-bab2-0c6a722edd7c tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:26:54.600534 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-22f992fc-d460-4a24-bab2-0c6a722edd7c tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1945031659/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.019867 Oct 05 02:26:54.600534 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 45/79] 10.222.0.16 () {60 vars in 1265 bytes} [Wed Oct 5 02:26:54 2022] PUT /compute/v2.1/flavors/1945031659/os-extra_specs/hw:numa_nodes => generated 73 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 05 02:26:54.623197 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ddeaf566-a8bc-4c11-b59a-65c62eb75d31 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:26:54.623405 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4c1623e8-e421-4eda-ac00-d7b4da0ff020 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5797 microversion: 2.1 time: 0.071673 Oct 05 02:26:54.634890 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 35/80] 10.222.0.16 () {58 vars in 1169 bytes} [Wed Oct 5 02:26:54 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5797 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:26:54.635039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ddeaf566-a8bc-4c11-b59a-65c62eb75d31 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934-project-admin] Request method failure captured: Oct 05 02:26:54.635039 n-d-858272-3 devstack@n-api.service[122319]: request: PUT /compute/v2.1/flavors/1945031659/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 05 02:26:54.635039 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:26:54.635039 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:26:54.635039 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:26:54.635039 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 49 Oct 05 02:26:54.635039 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:26:54.635039 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:26:54.635039 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:26:54.635039 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:26:54.635039 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOtsXf-YHeh9HOyXKVEP7rEv3Rxd-FYXwOHplxSbYUJqPFOLxzkUKbndB7OLh5JpV8blH3jxRIFH_D1GJBtoJbFp39VmgRCJOwJWEFQzeBwiFi3AzfpsOiAMahW2PepEMHhWobIw10wvPCvbn7oUbLUqgr-Gc_PR_yPerMA75hK7ZRc Oct 05 02:26:54.635039 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:26:54.635039 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:26:54.635039 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:26:54.635039 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:26:54.635039 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:26:54.635039 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:26:54.635039 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 3a31cc939acb4e2a941ba27d4d9f0e81 Oct 05 02:26:54.635039 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934 Oct 05 02:26:54.635039 n-d-858272-3 devstack@n-api.service[122319]: X-Role: admin,member,reader Oct 05 02:26:54.635039 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: admin,member,reader Oct 05 02:26:54.636158 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3a31cc939acb4e2a941ba27d4d9f0e81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3a31cc939acb4e2a941ba27d4d9f0e81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3a31cc939acb4e2a941ba27d4d9f0e81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3a31cc939acb4e2a941ba27d4d9f0e81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:26:54.636158 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934 Oct 05 02:26:54.636158 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 3a31cc939acb4e2a941ba27d4d9f0e81 Oct 05 02:26:54.636158 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934 Oct 05 02:26:54.636158 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934-project-admin Oct 05 02:26:54.636158 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:26:54.636158 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:26:54.636158 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 6a67f5e085d4483b8679afa50fd878b5 Oct 05 02:26:54.636158 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934-project-admin Oct 05 02:26:54.636158 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:26:54.636158 n-d-858272-3 devstack@n-api.service[122319]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 05 02:26:54.636158 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:26:54.636768 n-d-858272-3 devstack@n-api.service[122319]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 05 02:26:54.636768 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'flavor_id': '1945031659', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 05 02:26:54.636768 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:26:54.636768 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:26:54.636768 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:26:54.636768 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:26:54.636768 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:26:54.636768 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:26:54.636768 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 05 02:26:54.636768 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:26:54.636768 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 05 02:26:54.636768 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 05 02:26:54.636768 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 05 02:26:54.636768 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 05 02:26:54.636768 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 05 02:26:54.636768 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 05 02:26:54.636768 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 05 02:26:54.636768 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 05 02:26:54.636768 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:26:54.636768 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi On instance: Oct 05 02:26:54.636768 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 05 02:26:54.636768 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:26:54.643238 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:26:54.643238 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:26:54.643238 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:26:54.643238 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:26:54.643238 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:26:54.643238 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:26:54.643238 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:26:54.643238 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:26:54.643238 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:26:54.643238 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 02:26:54.643238 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 02:26:54.643238 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:26:54.643238 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:26:54.643238 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:26:54.643238 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:26:54.643238 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 05 02:26:54.643238 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:26:54.643238 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:26:54.643238 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:26:54.643238 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:26:54.644274 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:26:54.644274 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:26:54.644274 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:26:54.644274 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:26:54.644274 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 05 02:26:54.644274 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:26:54.644274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ddeaf566-a8bc-4c11-b59a-65c62eb75d31 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:26:54.644274 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ddeaf566-a8bc-4c11-b59a-65c62eb75d31 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1945031659/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.015726 Oct 05 02:26:54.644274 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 46/81] 10.222.0.16 () {60 vars in 1265 bytes} [Wed Oct 5 02:26:54 2022] PUT /compute/v2.1/flavors/1945031659/os-extra_specs/hw:numa_nodes => generated 117 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:26:54.650282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8ea48e85-1d56-4479-8cd4-a47e0c4c05aa tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:54.679447 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e5c50e29-dbc3-430c-8a5c-1aa2ccaf19c0 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:54.690654 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8ea48e85-1d56-4479-8cd4-a47e0c4c05aa tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1945031659" status: 202 len: 0 microversion: 2.1 time: 0.054583 Oct 05 02:26:54.694810 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 36/82] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 5 02:26:54 2022] DELETE /compute/v2.1/flavors/1945031659 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:26:54.704017 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3ea1588b-4f81-421c-8d56-407f1fd97bd6 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:54.709389 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e5c50e29-dbc3-430c-8a5c-1aa2ccaf19c0 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/817125904" status: 202 len: 0 microversion: 2.1 time: 0.047070 Oct 05 02:26:54.730159 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 47/83] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 5 02:26:54 2022] DELETE /compute/v2.1/flavors/817125904 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:26:54.743502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f3381589-0d79-4086-a9c6-35de9e80e28a tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:54.744477 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3ea1588b-4f81-421c-8d56-407f1fd97bd6 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934 tempest-FlavorsExtraSpecsNegativeTestJSON-1188459934-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032146 Oct 05 02:26:54.747504 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 37/84] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:26:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:26:54.784925 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f3381589-0d79-4086-a9c6-35de9e80e28a tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048539 Oct 05 02:26:54.786228 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 48/85] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:26:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:26:54.805662 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-75fe8253-17f5-4bef-9b50-1c6993dbdd7b tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:54.826111 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-75fe8253-17f5-4bef-9b50-1c6993dbdd7b tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1847358082" status: 202 len: 0 microversion: 2.1 time: 0.023958 Oct 05 02:26:54.830146 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 38/86] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 5 02:26:54 2022] DELETE /compute/v2.1/flavors/1847358082 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:26:54.842463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ee05c3c8-eeb4-40fc-83b8-d44df1499e60 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:54.897962 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ee05c3c8-eeb4-40fc-83b8-d44df1499e60 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.066103 Oct 05 02:26:54.899395 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 49/87] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:26:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:26:54.923458 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c6264ff8-98ea-4d04-9d91-df4c297ceaa0 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1755710382", "id": 743024344, "os-flavor-access:is_public": "False"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:26:54.962447 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c6264ff8-98ea-4d04-9d91-df4c297ceaa0 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.045170 Oct 05 02:26:54.964360 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 39/88] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:26:54 2022] POST /compute/v2.1/flavors => generated 412 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:26:54.979315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-07ba207f-8edc-4ff7-b962-eb1d7e618b32 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:55.010093 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-07ba207f-8edc-4ff7-b962-eb1d7e618b32 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036033 Oct 05 02:26:55.011738 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 50/89] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:26:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:26:55.032890 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-812b8cb4-9fe7-463a-8051-a5046c639f0d tempest-FlavorsAdminTestJSON-576867606 tempest-FlavorsAdminTestJSON-576867606-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:55.129908 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-812b8cb4-9fe7-463a-8051-a5046c639f0d tempest-FlavorsAdminTestJSON-576867606 tempest-FlavorsAdminTestJSON-576867606-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.100283 Oct 05 02:26:55.137481 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 40/90] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:26:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:26:55.163987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ec4d45ae-8b66-49d1-b680-63107fb9ac3e tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:55.191326 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5eff11b0-70af-4a3e-ba87-8f22388a5092 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:55.192698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5eff11b0-70af-4a3e-ba87-8f22388a5092 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:26:55.200164 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5eff11b0-70af-4a3e-ba87-8f22388a5092 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:55.208455 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5eff11b0-70af-4a3e-ba87-8f22388a5092 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:55.210719 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5eff11b0-70af-4a3e-ba87-8f22388a5092 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:55.211433 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ec4d45ae-8b66-49d1-b680-63107fb9ac3e tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/743024344" status: 202 len: 0 microversion: 2.1 time: 0.061629 Oct 05 02:26:55.211862 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5eff11b0-70af-4a3e-ba87-8f22388a5092 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:55.212329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5eff11b0-70af-4a3e-ba87-8f22388a5092 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:55.215052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5eff11b0-70af-4a3e-ba87-8f22388a5092 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:55.229161 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 51/91] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 5 02:26:55 2022] DELETE /compute/v2.1/flavors/743024344 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:26:55.239662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dcbac227-0644-46ac-87ee-aff2a9c3d6fd tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:55.280924 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-dcbac227-0644-46ac-87ee-aff2a9c3d6fd tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050192 Oct 05 02:26:55.282031 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 52/92] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:26:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:26:55.317689 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6ced82bb-e1a5-48ea-b889-529317354133 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1468452491", "id": 1534023277, "os-flavor-access:is_public": "True"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:26:55.359355 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6ced82bb-e1a5-48ea-b889-529317354133 tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.060395 Oct 05 02:26:55.364953 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 53/93] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:26:55 2022] POST /compute/v2.1/flavors => generated 414 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:26:55.381992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cb6802e8-8007-4462-9075-b2fd70d09f5e tempest-FlavorsAdminTestJSON-576867606 tempest-FlavorsAdminTestJSON-576867606-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:55.437485 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cb6802e8-8007-4462-9075-b2fd70d09f5e tempest-FlavorsAdminTestJSON-576867606 tempest-FlavorsAdminTestJSON-576867606-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.064984 Oct 05 02:26:55.438470 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 54/94] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:26:55 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:26:55.446242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b172d13a-f136-46cf-8131-bb51ec5a65b4 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:55.447699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b172d13a-f136-46cf-8131-bb51ec5a65b4 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: c9ea1283-2889-4a96-bee8-b2b99509ed59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:26:55.482389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b172d13a-f136-46cf-8131-bb51ec5a65b4 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:55.488061 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b172d13a-f136-46cf-8131-bb51ec5a65b4 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:55.490527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b172d13a-f136-46cf-8131-bb51ec5a65b4 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:55.492403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b172d13a-f136-46cf-8131-bb51ec5a65b4 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:55.500156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b172d13a-f136-46cf-8131-bb51ec5a65b4 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:55.500959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b172d13a-f136-46cf-8131-bb51ec5a65b4 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:55.721691 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5eff11b0-70af-4a3e-ba87-8f22388a5092 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aebce7113c4e8980490aa0b0fbb296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b7bb601bea47d88c9ad68be2651451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:26:55.739884 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5eff11b0-70af-4a3e-ba87-8f22388a5092 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] 10.222.0.16 "GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9" status: 200 len: 1339 microversion: 2.1 time: 0.552338 Oct 05 02:26:55.752574 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 41/95] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:26:55 2022] GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 => generated 1339 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:26:55.760776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d9559b4b-a568-49ac-9858-719514c3da1e tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:55.801813 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d9559b4b-a568-49ac-9858-719514c3da1e tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1534023277" status: 202 len: 0 microversion: 2.1 time: 0.047815 Oct 05 02:26:55.806179 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 42/96] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 5 02:26:55 2022] DELETE /compute/v2.1/flavors/1534023277 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:26:55.811869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b485bd05-225b-49ea-b6ba-c45953c8439f tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:55.827653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=9 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:55.859125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b172d13a-f136-46cf-8131-bb51ec5a65b4 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:26:55.871553 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b485bd05-225b-49ea-b6ba-c45953c8439f tempest-FlavorsAdminTestJSON-2001781535 tempest-FlavorsAdminTestJSON-2001781535-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064058 Oct 05 02:26:55.881320 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 43/97] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:26:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:26:55.881658 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b172d13a-f136-46cf-8131-bb51ec5a65b4 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59" status: 200 len: 1272 microversion: 2.1 time: 0.430745 Oct 05 02:26:55.889293 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 55/98] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:26:55 2022] GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59 => generated 1272 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:26:56.179654 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-e3470a43-0ed9-42a4-87f3-cdf0b4c314df req-2784a4d0-766b-40ec-85d0-0e82834eb62c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9", "tag": "12fcbb82-bf50-4f96-a97d-4882d900cc55"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:26:56.205631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e3470a43-0ed9-42a4-87f3-cdf0b4c314df req-2784a4d0-766b-40ec-85d0-0e82834eb62c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:56.215347 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e3470a43-0ed9-42a4-87f3-cdf0b4c314df req-2784a4d0-766b-40ec-85d0-0e82834eb62c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:56.216169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e3470a43-0ed9-42a4-87f3-cdf0b4c314df req-2784a4d0-766b-40ec-85d0-0e82834eb62c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:56.263702 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-e3470a43-0ed9-42a4-87f3-cdf0b4c314df req-2784a4d0-766b-40ec-85d0-0e82834eb62c service nova] Creating event network-changed:12fcbb82-bf50-4f96-a97d-4882d900cc55 for instance 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 on n-h2-858272-3 Oct 05 02:26:56.265484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e3470a43-0ed9-42a4-87f3-cdf0b4c314df req-2784a4d0-766b-40ec-85d0-0e82834eb62c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122320) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 05 02:26:56.266073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e3470a43-0ed9-42a4-87f3-cdf0b4c314df req-2784a4d0-766b-40ec-85d0-0e82834eb62c service nova] Acquired lock "compute-rpcapi-router" {{(pid=122320) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 05 02:26:56.268060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3708b363-b1a6-4a5d-8361-358d9acff55a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:56.268739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3708b363-b1a6-4a5d-8361-358d9acff55a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:56.269403 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3708b363-b1a6-4a5d-8361-358d9acff55a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:56.271196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3708b363-b1a6-4a5d-8361-358d9acff55a None None] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:56.271859 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3708b363-b1a6-4a5d-8361-358d9acff55a None None] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:56.272480 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3708b363-b1a6-4a5d-8361-358d9acff55a None None] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:56.282359 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.compute.rpcapi [None req-3708b363-b1a6-4a5d-8361-358d9acff55a None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 05 02:26:56.283509 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3708b363-b1a6-4a5d-8361-358d9acff55a None None] Releasing lock "compute-rpcapi-router" {{(pid=122320) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 05 02:26:56.303586 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3708b363-b1a6-4a5d-8361-358d9acff55a None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.258751 Oct 05 02:26:56.306306 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 44/99] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:26:56.783985 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3aab78c2-4bd7-4400-b8f6-ea491e472f4d tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:56.787945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3aab78c2-4bd7-4400-b8f6-ea491e472f4d tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:26:56.824476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3aab78c2-4bd7-4400-b8f6-ea491e472f4d tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:56.825370 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3aab78c2-4bd7-4400-b8f6-ea491e472f4d tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:56.831321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3aab78c2-4bd7-4400-b8f6-ea491e472f4d tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:56.834180 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3aab78c2-4bd7-4400-b8f6-ea491e472f4d tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:56.840379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3aab78c2-4bd7-4400-b8f6-ea491e472f4d tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:56.841256 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3aab78c2-4bd7-4400-b8f6-ea491e472f4d tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:56.917573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-87719563-ac3a-4b00-91b7-4bfdfa6bb5a5 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:56.918325 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-87719563-ac3a-4b00-91b7-4bfdfa6bb5a5 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: c9ea1283-2889-4a96-bee8-b2b99509ed59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:26:56.939507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-87719563-ac3a-4b00-91b7-4bfdfa6bb5a5 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:56.940105 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-87719563-ac3a-4b00-91b7-4bfdfa6bb5a5 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:56.942244 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-87719563-ac3a-4b00-91b7-4bfdfa6bb5a5 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:56.943007 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-87719563-ac3a-4b00-91b7-4bfdfa6bb5a5 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:56.950644 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-87719563-ac3a-4b00-91b7-4bfdfa6bb5a5 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:56.951891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-87719563-ac3a-4b00-91b7-4bfdfa6bb5a5 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:57.349400 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-87719563-ac3a-4b00-91b7-4bfdfa6bb5a5 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:26:57.363003 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-87719563-ac3a-4b00-91b7-4bfdfa6bb5a5 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59" status: 200 len: 1278 microversion: 2.1 time: 0.450245 Oct 05 02:26:57.364175 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 45/100] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:26:56 2022] GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59 => generated 1278 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:26:57.546116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3aab78c2-4bd7-4400-b8f6-ea491e472f4d tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aebce7113c4e8980490aa0b0fbb296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b7bb601bea47d88c9ad68be2651451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:26:57.560854 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3aab78c2-4bd7-4400-b8f6-ea491e472f4d tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] 10.222.0.16 "GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9" status: 200 len: 1339 microversion: 2.1 time: 0.786247 Oct 05 02:26:57.561855 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 56/101] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:26:56 2022] GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 => generated 1339 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:26:58.388655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-64f4efbf-0240-4408-9ad4-6ad0af8d00d0 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:58.391174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-64f4efbf-0240-4408-9ad4-6ad0af8d00d0 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: c9ea1283-2889-4a96-bee8-b2b99509ed59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:26:58.403948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64f4efbf-0240-4408-9ad4-6ad0af8d00d0 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:58.411363 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64f4efbf-0240-4408-9ad4-6ad0af8d00d0 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:58.415641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64f4efbf-0240-4408-9ad4-6ad0af8d00d0 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:58.416678 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64f4efbf-0240-4408-9ad4-6ad0af8d00d0 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:58.422164 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64f4efbf-0240-4408-9ad4-6ad0af8d00d0 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:58.423819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64f4efbf-0240-4408-9ad4-6ad0af8d00d0 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:58.591077 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1f1e0e79-760b-42f1-833f-4893680f71b8 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:58.592534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1f1e0e79-760b-42f1-833f-4893680f71b8 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:26:58.600639 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=8 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:58.607457 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=15,nova_api:INSERT=4 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:58.618831 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f1e0e79-760b-42f1-833f-4893680f71b8 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:58.623639 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f1e0e79-760b-42f1-833f-4893680f71b8 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:58.624573 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f1e0e79-760b-42f1-833f-4893680f71b8 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:58.629300 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f1e0e79-760b-42f1-833f-4893680f71b8 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:58.638358 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f1e0e79-760b-42f1-833f-4893680f71b8 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:58.640505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f1e0e79-760b-42f1-833f-4893680f71b8 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:58.763847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-64f4efbf-0240-4408-9ad4-6ad0af8d00d0 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:26:58.781567 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-64f4efbf-0240-4408-9ad4-6ad0af8d00d0 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59" status: 200 len: 1278 microversion: 2.1 time: 0.397420 Oct 05 02:26:58.783402 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 46/102] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:26:58 2022] GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59 => generated 1278 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:26:59.213000 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1f1e0e79-760b-42f1-833f-4893680f71b8 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aebce7113c4e8980490aa0b0fbb296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b7bb601bea47d88c9ad68be2651451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:26:59.234493 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1f1e0e79-760b-42f1-833f-4893680f71b8 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] 10.222.0.16 "GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9" status: 200 len: 1339 microversion: 2.1 time: 0.648336 Oct 05 02:26:59.235666 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 57/103] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:26:58 2022] GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 => generated 1339 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:26:59.816256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-299db051-b165-479c-ad81-0441db07022a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:26:59.817560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-299db051-b165-479c-ad81-0441db07022a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: c9ea1283-2889-4a96-bee8-b2b99509ed59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:26:59.830256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-299db051-b165-479c-ad81-0441db07022a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:59.830767 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-299db051-b165-479c-ad81-0441db07022a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:59.831214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-299db051-b165-479c-ad81-0441db07022a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:26:59.832107 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-299db051-b165-479c-ad81-0441db07022a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:26:59.836690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-299db051-b165-479c-ad81-0441db07022a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:26:59.837242 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-299db051-b165-479c-ad81-0441db07022a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:00.093649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-299db051-b165-479c-ad81-0441db07022a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:00.109291 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-299db051-b165-479c-ad81-0441db07022a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59" status: 200 len: 1320 microversion: 2.1 time: 0.298013 Oct 05 02:27:00.122732 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 47/104] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:26:59 2022] GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59 => generated 1320 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:00.260485 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cee24e90-ab45-4088-8b4f-c586bb0f3759 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:00.262026 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cee24e90-ab45-4088-8b4f-c586bb0f3759 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:00.277950 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cee24e90-ab45-4088-8b4f-c586bb0f3759 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:00.289507 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cee24e90-ab45-4088-8b4f-c586bb0f3759 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:00.291022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cee24e90-ab45-4088-8b4f-c586bb0f3759 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:00.292326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cee24e90-ab45-4088-8b4f-c586bb0f3759 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:00.295053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cee24e90-ab45-4088-8b4f-c586bb0f3759 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:00.295858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cee24e90-ab45-4088-8b4f-c586bb0f3759 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:00.542990 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cee24e90-ab45-4088-8b4f-c586bb0f3759 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aebce7113c4e8980490aa0b0fbb296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b7bb601bea47d88c9ad68be2651451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:00.554460 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cee24e90-ab45-4088-8b4f-c586bb0f3759 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] 10.222.0.16 "GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9" status: 200 len: 1339 microversion: 2.1 time: 0.298474 Oct 05 02:27:00.555047 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 58/105] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:00 2022] GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 => generated 1339 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:01.136231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8b741c58-4ded-44cc-a327-cb0b8b3b3806 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:01.136932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8b741c58-4ded-44cc-a327-cb0b8b3b3806 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: c9ea1283-2889-4a96-bee8-b2b99509ed59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:01.144255 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b741c58-4ded-44cc-a327-cb0b8b3b3806 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:01.145671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b741c58-4ded-44cc-a327-cb0b8b3b3806 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:01.146336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b741c58-4ded-44cc-a327-cb0b8b3b3806 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:01.147254 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b741c58-4ded-44cc-a327-cb0b8b3b3806 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:01.147908 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b741c58-4ded-44cc-a327-cb0b8b3b3806 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:01.148546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b741c58-4ded-44cc-a327-cb0b8b3b3806 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:01.531686 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8b741c58-4ded-44cc-a327-cb0b8b3b3806 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:01.549041 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8b741c58-4ded-44cc-a327-cb0b8b3b3806 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59" status: 200 len: 1320 microversion: 2.1 time: 0.416458 Oct 05 02:27:01.555394 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 48/106] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:01 2022] GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59 => generated 1320 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:01.581792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6c4442fa-6dcc-4dea-bb11-12611b7f2b6e tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:01.583214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6c4442fa-6dcc-4dea-bb11-12611b7f2b6e tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:01.592965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c4442fa-6dcc-4dea-bb11-12611b7f2b6e tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:01.596177 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c4442fa-6dcc-4dea-bb11-12611b7f2b6e tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:01.596832 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c4442fa-6dcc-4dea-bb11-12611b7f2b6e tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:01.599944 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c4442fa-6dcc-4dea-bb11-12611b7f2b6e tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:01.600677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c4442fa-6dcc-4dea-bb11-12611b7f2b6e tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:01.601367 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c4442fa-6dcc-4dea-bb11-12611b7f2b6e tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:02.475441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6c4442fa-6dcc-4dea-bb11-12611b7f2b6e tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aebce7113c4e8980490aa0b0fbb296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b7bb601bea47d88c9ad68be2651451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:02.499613 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6c4442fa-6dcc-4dea-bb11-12611b7f2b6e tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] 10.222.0.16 "GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9" status: 200 len: 1339 microversion: 2.1 time: 0.920435 Oct 05 02:27:02.511585 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 59/107] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:01 2022] GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 => generated 1339 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:02.590274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e2ec190b-7641-41b8-8a53-bc57bd34f26f tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:02.593242 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e2ec190b-7641-41b8-8a53-bc57bd34f26f tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: c9ea1283-2889-4a96-bee8-b2b99509ed59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:02.608082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2ec190b-7641-41b8-8a53-bc57bd34f26f tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:02.610921 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2ec190b-7641-41b8-8a53-bc57bd34f26f tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:02.614757 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2ec190b-7641-41b8-8a53-bc57bd34f26f tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:02.619071 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2ec190b-7641-41b8-8a53-bc57bd34f26f tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:02.622355 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2ec190b-7641-41b8-8a53-bc57bd34f26f tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:02.624401 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2ec190b-7641-41b8-8a53-bc57bd34f26f tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:03.115008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=14 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:03.364816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e2ec190b-7641-41b8-8a53-bc57bd34f26f tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:03.393456 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e2ec190b-7641-41b8-8a53-bc57bd34f26f tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59" status: 200 len: 1320 microversion: 2.1 time: 0.802141 Oct 05 02:27:03.405440 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 49/108] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:02 2022] GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59 => generated 1320 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:03.539813 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3aee0288-f9fb-44be-b99b-dc0d610f9425 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:03.541421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3aee0288-f9fb-44be-b99b-dc0d610f9425 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:03.569419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3aee0288-f9fb-44be-b99b-dc0d610f9425 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:03.570764 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3aee0288-f9fb-44be-b99b-dc0d610f9425 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:03.573269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3aee0288-f9fb-44be-b99b-dc0d610f9425 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:03.576684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3aee0288-f9fb-44be-b99b-dc0d610f9425 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:03.578479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3aee0288-f9fb-44be-b99b-dc0d610f9425 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:03.580026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3aee0288-f9fb-44be-b99b-dc0d610f9425 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:04.086720 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c79e354a-6ba8-48b7-ab2e-3a0bd316c877 tempest-FlavorsV255TestJSON-293459074 tempest-FlavorsV255TestJSON-293459074-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-114597692", "id": 483790461, "os-flavor-access:is_public": "True"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:04.144100 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c79e354a-6ba8-48b7-ab2e-3a0bd316c877 tempest-FlavorsV255TestJSON-293459074 tempest-FlavorsV255TestJSON-293459074-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 445 microversion: 2.55 time: 0.711769 Oct 05 02:27:04.155071 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 60/109] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 5 02:27:03 2022] POST /compute/v2.1/flavors => generated 445 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:27:04.344172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=4 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:04.377644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-36b3f6f6-5393-49e2-911e-87835de9a106 tempest-HypervisorAdminNegativeTestJSON-1984407805 tempest-HypervisorAdminNegativeTestJSON-1984407805-project] Calling method '.version_select at 0x7fcce4e07430>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:04.380180 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-36b3f6f6-5393-49e2-911e-87835de9a106 tempest-HypervisorAdminNegativeTestJSON-1984407805 tempest-HypervisorAdminNegativeTestJSON-1984407805-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'e65f598908804f8d89a086f7b3ca87a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d834f24524b87874d34caeacaea89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:04.382503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-36b3f6f6-5393-49e2-911e-87835de9a106 tempest-HypervisorAdminNegativeTestJSON-1984407805 tempest-HypervisorAdminNegativeTestJSON-1984407805-project] Request method failure captured: Oct 05 02:27:04.382503 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 05 02:27:04.382503 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:27:04.382503 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:27:04.382503 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:27:04.382503 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:27:04.382503 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:27:04.382503 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:27:04.382503 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:27:04.382503 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:04.382503 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOt2RTyb6Zegzes3VhEHk6vHIW1o2n0y2ipCpPp24RTH9pr403d0H7b8TkkJq8ZNSV13oX09CICb_x-SIuQv2QQfWYmXZWKFh8oEVDC7AE6cE-soO_pAIbX_DWnM9IQ4YRN7n7h7Qz-hSSO2aUAv_EX0qTWck20jf7vu-xRTTuiLpsU Oct 05 02:27:04.382503 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:27:04.382503 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:27:04.382503 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:27:04.382503 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:27:04.382503 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:27:04.382503 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:27:04.382503 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: c63d834f24524b87874d34caeacaea89 Oct 05 02:27:04.382503 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1984407805 Oct 05 02:27:04.382503 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:27:04.382503 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:27:04.383657 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c63d834f24524b87874d34caeacaea89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c63d834f24524b87874d34caeacaea89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c63d834f24524b87874d34caeacaea89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c63d834f24524b87874d34caeacaea89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:04.383657 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1984407805 Oct 05 02:27:04.383657 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: c63d834f24524b87874d34caeacaea89 Oct 05 02:27:04.383657 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1984407805 Oct 05 02:27:04.383657 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-HypervisorAdminNegativeTestJSON-1984407805-project Oct 05 02:27:04.383657 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:27:04.383657 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:27:04.383657 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: e65f598908804f8d89a086f7b3ca87a2 Oct 05 02:27:04.383657 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1984407805-project Oct 05 02:27:04.383657 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:27:04.383657 n-d-858272-3 devstack@n-api.service[122319]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 05 02:27:04.383657 n-d-858272-3 devstack@n-api.service[122319]: action_args: {} Oct 05 02:27:04.383657 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:04.384881 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:04.384881 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:04.384881 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:04.384881 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:04.384881 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:04.384881 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:27:04.384881 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:27:04.384881 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:04.384881 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:04.384881 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 05 02:27:04.384881 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 05 02:27:04.384881 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 05 02:27:04.384881 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 05 02:27:04.384881 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 02:27:04.384881 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 02:27:04.384881 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 02:27:04.384881 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 02:27:04.384881 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:27:04.384881 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:27:04.385963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:27:04.385963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:27:04.385963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 02:27:04.385963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 02:27:04.385963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 02:27:04.385963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 02:27:04.385963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:27:04.385963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 02:27:04.385963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 05 02:27:04.385963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:04.385963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:04.385963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:04.385963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:04.385963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:04.385963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:04.385963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 02:27:04.385963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 02:27:04.385963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 05 02:27:04.385963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:04.391533 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-36b3f6f6-5393-49e2-911e-87835de9a106 tempest-HypervisorAdminNegativeTestJSON-1984407805 tempest-HypervisorAdminNegativeTestJSON-1984407805-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:04.392520 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-36b3f6f6-5393-49e2-911e-87835de9a106 tempest-HypervisorAdminNegativeTestJSON-1984407805 tempest-HypervisorAdminNegativeTestJSON-1984407805-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.236122 Oct 05 02:27:04.393470 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 61/110] 10.222.0.16 () {58 vars in 1167 bytes} [Wed Oct 5 02:27:04 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 237 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:27:04.534245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3aee0288-f9fb-44be-b99b-dc0d610f9425 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aebce7113c4e8980490aa0b0fbb296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b7bb601bea47d88c9ad68be2651451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:04.549331 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3aee0288-f9fb-44be-b99b-dc0d610f9425 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] 10.222.0.16 "GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9" status: 200 len: 1339 microversion: 2.1 time: 1.014747 Oct 05 02:27:04.551472 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 50/111] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:03 2022] GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 => generated 1339 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:27:04.586461 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c404a9a2-a24d-4530-a19b-1134c6b51748 tempest-HypervisorAdminNegativeTestJSON-1984407805 tempest-HypervisorAdminNegativeTestJSON-1984407805-project] Calling method '.version_select at 0x7fcce4d430d0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:04.592465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c404a9a2-a24d-4530-a19b-1134c6b51748 tempest-HypervisorAdminNegativeTestJSON-1984407805 tempest-HypervisorAdminNegativeTestJSON-1984407805-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'e65f598908804f8d89a086f7b3ca87a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d834f24524b87874d34caeacaea89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:04.608611 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c404a9a2-a24d-4530-a19b-1134c6b51748 tempest-HypervisorAdminNegativeTestJSON-1984407805 tempest-HypervisorAdminNegativeTestJSON-1984407805-project] Request method failure captured: Oct 05 02:27:04.608611 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 05 02:27:04.608611 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:27:04.608611 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:27:04.608611 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:27:04.608611 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:27:04.608611 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:27:04.608611 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:27:04.608611 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:27:04.608611 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:04.608611 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOt2RTyb6Zegzes3VhEHk6vHIW1o2n0y2ipCpPp24RTH9pr403d0H7b8TkkJq8ZNSV13oX09CICb_x-SIuQv2QQfWYmXZWKFh8oEVDC7AE6cE-soO_pAIbX_DWnM9IQ4YRN7n7h7Qz-hSSO2aUAv_EX0qTWck20jf7vu-xRTTuiLpsU Oct 05 02:27:04.608611 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:27:04.608611 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:27:04.608611 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:27:04.608611 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:27:04.608611 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:27:04.608611 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:27:04.608611 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c63d834f24524b87874d34caeacaea89 Oct 05 02:27:04.608611 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1984407805 Oct 05 02:27:04.608611 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:27:04.608611 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:27:04.610123 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c63d834f24524b87874d34caeacaea89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c63d834f24524b87874d34caeacaea89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c63d834f24524b87874d34caeacaea89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c63d834f24524b87874d34caeacaea89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:04.610123 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1984407805 Oct 05 02:27:04.610123 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c63d834f24524b87874d34caeacaea89 Oct 05 02:27:04.610123 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1984407805 Oct 05 02:27:04.610123 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-HypervisorAdminNegativeTestJSON-1984407805-project Oct 05 02:27:04.610123 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:27:04.610123 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:27:04.610123 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: e65f598908804f8d89a086f7b3ca87a2 Oct 05 02:27:04.610123 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1984407805-project Oct 05 02:27:04.610123 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:27:04.610123 n-d-858272-3 devstack@n-api.service[122320]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 05 02:27:04.610123 n-d-858272-3 devstack@n-api.service[122320]: action_args: {} Oct 05 02:27:04.610123 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:04.611006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:04.611006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:04.611006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:04.611006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:04.611006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:04.611006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:27:04.611006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:27:04.611006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:04.611006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:04.611006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 05 02:27:04.611006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 05 02:27:04.611006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 05 02:27:04.611006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 05 02:27:04.611006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 02:27:04.611006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 02:27:04.611006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 02:27:04.611006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 02:27:04.611006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:27:04.611006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:27:04.612761 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:27:04.612761 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:27:04.612761 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 02:27:04.612761 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 02:27:04.612761 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 02:27:04.612761 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 02:27:04.612761 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:27:04.612761 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 02:27:04.612761 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 05 02:27:04.612761 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:04.612761 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:04.612761 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:04.612761 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:04.612761 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:04.612761 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:04.612761 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 02:27:04.612761 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 02:27:04.612761 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 05 02:27:04.612761 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:04.616822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c404a9a2-a24d-4530-a19b-1134c6b51748 tempest-HypervisorAdminNegativeTestJSON-1984407805 tempest-HypervisorAdminNegativeTestJSON-1984407805-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:04.617996 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c404a9a2-a24d-4530-a19b-1134c6b51748 tempest-HypervisorAdminNegativeTestJSON-1984407805 tempest-HypervisorAdminNegativeTestJSON-1984407805-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.051827 Oct 05 02:27:04.619185 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 51/112] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:27:04 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 53 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:27:04.625470 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2f686815-1c7d-4991-abe2-199be5acfb7e tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:04.627510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2f686815-1c7d-4991-abe2-199be5acfb7e tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: c9ea1283-2889-4a96-bee8-b2b99509ed59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:04.636259 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f686815-1c7d-4991-abe2-199be5acfb7e tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:04.637688 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f686815-1c7d-4991-abe2-199be5acfb7e tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:04.638334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f686815-1c7d-4991-abe2-199be5acfb7e tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:04.639248 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f686815-1c7d-4991-abe2-199be5acfb7e tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:04.640092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f686815-1c7d-4991-abe2-199be5acfb7e tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:04.640762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f686815-1c7d-4991-abe2-199be5acfb7e tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:04.769236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d16a7722-a397-40d5-9571-cb8414b82423 tempest-FlavorsV255TestJSON-129388074 tempest-FlavorsV255TestJSON-129388074-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:04.804990 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d16a7722-a397-40d5-9571-cb8414b82423 tempest-FlavorsV255TestJSON-129388074 tempest-FlavorsV255TestJSON-129388074-project] 10.222.0.16 "GET /compute/v2.1/flavors/483790461" status: 200 len: 445 microversion: 2.55 time: 0.409963 Oct 05 02:27:04.809228 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 62/113] 10.222.0.16 () {60 vars in 1196 bytes} [Wed Oct 5 02:27:04 2022] GET /compute/v2.1/flavors/483790461 => generated 445 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:27:04.822997 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5f151eff-4621-4d76-b986-43f3c628163a tempest-HypervisorAdminNegativeTestJSON-1984407805 tempest-HypervisorAdminNegativeTestJSON-1984407805-project] Calling method '.version_select at 0x7fcce4dfc550>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:04.824774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5f151eff-4621-4d76-b986-43f3c628163a tempest-HypervisorAdminNegativeTestJSON-1984407805 tempest-HypervisorAdminNegativeTestJSON-1984407805-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'e65f598908804f8d89a086f7b3ca87a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d834f24524b87874d34caeacaea89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:04.826372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5f151eff-4621-4d76-b986-43f3c628163a tempest-HypervisorAdminNegativeTestJSON-1984407805 tempest-HypervisorAdminNegativeTestJSON-1984407805-project] Request method failure captured: Oct 05 02:27:04.826372 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 05 02:27:04.826372 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:27:04.826372 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:27:04.826372 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:27:04.826372 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:27:04.826372 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:27:04.826372 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:27:04.826372 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:27:04.826372 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:04.826372 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOt2RTyb6Zegzes3VhEHk6vHIW1o2n0y2ipCpPp24RTH9pr403d0H7b8TkkJq8ZNSV13oX09CICb_x-SIuQv2QQfWYmXZWKFh8oEVDC7AE6cE-soO_pAIbX_DWnM9IQ4YRN7n7h7Qz-hSSO2aUAv_EX0qTWck20jf7vu-xRTTuiLpsU Oct 05 02:27:04.826372 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:27:04.826372 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:27:04.826372 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:27:04.826372 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:27:04.826372 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:27:04.826372 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:27:04.826372 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: c63d834f24524b87874d34caeacaea89 Oct 05 02:27:04.826372 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1984407805 Oct 05 02:27:04.826372 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:27:04.826372 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:27:04.827772 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c63d834f24524b87874d34caeacaea89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c63d834f24524b87874d34caeacaea89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c63d834f24524b87874d34caeacaea89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c63d834f24524b87874d34caeacaea89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:04.827772 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1984407805 Oct 05 02:27:04.827772 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: c63d834f24524b87874d34caeacaea89 Oct 05 02:27:04.827772 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1984407805 Oct 05 02:27:04.827772 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-HypervisorAdminNegativeTestJSON-1984407805-project Oct 05 02:27:04.827772 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:27:04.827772 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:27:04.827772 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: e65f598908804f8d89a086f7b3ca87a2 Oct 05 02:27:04.827772 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1984407805-project Oct 05 02:27:04.827772 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:27:04.827772 n-d-858272-3 devstack@n-api.service[122319]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 05 02:27:04.827772 n-d-858272-3 devstack@n-api.service[122319]: action_args: {} Oct 05 02:27:04.827772 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:04.828554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:04.828554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:04.828554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:04.828554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:04.828554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:04.828554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:27:04.828554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:27:04.828554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:04.828554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:04.828554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 05 02:27:04.828554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 05 02:27:04.828554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 02:27:04.828554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 02:27:04.828554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 02:27:04.828554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 02:27:04.828554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:27:04.828554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:27:04.828554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:27:04.828554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:27:04.829563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 02:27:04.829563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 02:27:04.829563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 02:27:04.829563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 02:27:04.829563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:27:04.829563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 02:27:04.829563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 05 02:27:04.829563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:04.829563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:04.829563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:04.829563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:04.829563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:04.829563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:04.829563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 02:27:04.829563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 02:27:04.829563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 05 02:27:04.829563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:04.833421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5f151eff-4621-4d76-b986-43f3c628163a tempest-HypervisorAdminNegativeTestJSON-1984407805 tempest-HypervisorAdminNegativeTestJSON-1984407805-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:04.835123 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5f151eff-4621-4d76-b986-43f3c628163a tempest-HypervisorAdminNegativeTestJSON-1984407805 tempest-HypervisorAdminNegativeTestJSON-1984407805-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.024016 Oct 05 02:27:04.837106 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 63/114] 10.222.0.16 () {58 vars in 1179 bytes} [Wed Oct 5 02:27:04 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:27:04.854407 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f5289558-57b4-4f0d-8b4d-d5801388d6a5 tempest-FlavorsV255TestJSON-293459074 tempest-FlavorsV255TestJSON-293459074-project-admin] Action: 'update', calling method: .version_select at 0x7fcce5d24b80>, body: {"flavor": {"description": "new"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:04.960135 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f5289558-57b4-4f0d-8b4d-d5801388d6a5 tempest-FlavorsV255TestJSON-293459074 tempest-FlavorsV255TestJSON-293459074-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/483790461" status: 200 len: 446 microversion: 2.55 time: 0.120336 Oct 05 02:27:04.961851 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 64/115] 10.222.0.16 () {62 vars in 1216 bytes} [Wed Oct 5 02:27:04 2022] PUT /compute/v2.1/flavors/483790461 => generated 446 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:27:05.052682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-75a8c3d6-7dca-4997-ae51-223bb3c14bec tempest-HypervisorAdminNegativeTestJSON-1889193746 tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin] Calling method '.version_select at 0x7fcce4ef1700>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:05.077016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75a8c3d6-7dca-4997-ae51-223bb3c14bec tempest-HypervisorAdminNegativeTestJSON-1889193746 tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:05.078244 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75a8c3d6-7dca-4997-ae51-223bb3c14bec tempest-HypervisorAdminNegativeTestJSON-1889193746 tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:05.079679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75a8c3d6-7dca-4997-ae51-223bb3c14bec tempest-HypervisorAdminNegativeTestJSON-1889193746 tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:05.106947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2f686815-1c7d-4991-abe2-199be5acfb7e tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:05.114863 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75a8c3d6-7dca-4997-ae51-223bb3c14bec tempest-HypervisorAdminNegativeTestJSON-1889193746 tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:05.116029 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75a8c3d6-7dca-4997-ae51-223bb3c14bec tempest-HypervisorAdminNegativeTestJSON-1889193746 tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:05.119323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75a8c3d6-7dca-4997-ae51-223bb3c14bec tempest-HypervisorAdminNegativeTestJSON-1889193746 tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:05.122401 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2f686815-1c7d-4991-abe2-199be5acfb7e tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59" status: 200 len: 1320 microversion: 2.1 time: 0.499206 Oct 05 02:27:05.123030 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 52/116] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:04 2022] GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59 => generated 1320 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:05.151526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75a8c3d6-7dca-4997-ae51-223bb3c14bec tempest-HypervisorAdminNegativeTestJSON-1889193746 tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:05.168224 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75a8c3d6-7dca-4997-ae51-223bb3c14bec tempest-HypervisorAdminNegativeTestJSON-1889193746 tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:05.169295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75a8c3d6-7dca-4997-ae51-223bb3c14bec tempest-HypervisorAdminNegativeTestJSON-1889193746 tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:05.193461 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-75a8c3d6-7dca-4997-ae51-223bb3c14bec tempest-HypervisorAdminNegativeTestJSON-1889193746 tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.217152 Oct 05 02:27:05.200999 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 65/117] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:27:04 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:05.208145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9585161c-c1f1-4532-a2a7-295c55fb7c8b tempest-FlavorsV255TestJSON-129388074 tempest-FlavorsV255TestJSON-129388074-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:05.335227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-105ae5eb-a000-4ff0-ab6e-8cf62897f317 req-bc575960-5a29-4db5-a2b5-5f63c1436947 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9ea1283-2889-4a96-bee8-b2b99509ed59", "tag": "a955fb2f-e0a3-488e-9626-53db651f09eb"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:05.337782 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9585161c-c1f1-4532-a2a7-295c55fb7c8b tempest-FlavorsV255TestJSON-129388074 tempest-FlavorsV255TestJSON-129388074-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5721 microversion: 2.55 time: 0.141285 Oct 05 02:27:05.353285 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 66/118] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Oct 5 02:27:05 2022] GET /compute/v2.1/flavors/detail => generated 5721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:27:05.360256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-105ae5eb-a000-4ff0-ab6e-8cf62897f317 req-bc575960-5a29-4db5-a2b5-5f63c1436947 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:05.361475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-105ae5eb-a000-4ff0-ab6e-8cf62897f317 req-bc575960-5a29-4db5-a2b5-5f63c1436947 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:05.361923 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-105ae5eb-a000-4ff0-ab6e-8cf62897f317 req-bc575960-5a29-4db5-a2b5-5f63c1436947 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:05.365531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-90b1704c-3db7-409d-9eb8-43f9e916f33e tempest-HypervisorAdminNegativeTestJSON-1984407805 tempest-HypervisorAdminNegativeTestJSON-1984407805-project] Calling method '.version_select at 0x7fcce4d98790>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:05.376006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-90b1704c-3db7-409d-9eb8-43f9e916f33e tempest-HypervisorAdminNegativeTestJSON-1984407805 tempest-HypervisorAdminNegativeTestJSON-1984407805-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'e65f598908804f8d89a086f7b3ca87a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d834f24524b87874d34caeacaea89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:05.378200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-90b1704c-3db7-409d-9eb8-43f9e916f33e tempest-HypervisorAdminNegativeTestJSON-1984407805 tempest-HypervisorAdminNegativeTestJSON-1984407805-project] Request method failure captured: Oct 05 02:27:05.378200 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 05 02:27:05.378200 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:27:05.378200 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:27:05.378200 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:27:05.378200 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:27:05.378200 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:27:05.378200 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:27:05.378200 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:27:05.378200 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:05.378200 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOt2RTyb6Zegzes3VhEHk6vHIW1o2n0y2ipCpPp24RTH9pr403d0H7b8TkkJq8ZNSV13oX09CICb_x-SIuQv2QQfWYmXZWKFh8oEVDC7AE6cE-soO_pAIbX_DWnM9IQ4YRN7n7h7Qz-hSSO2aUAv_EX0qTWck20jf7vu-xRTTuiLpsU Oct 05 02:27:05.378200 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:27:05.378200 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:27:05.378200 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:27:05.378200 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:27:05.378200 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:27:05.378200 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:27:05.378200 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: c63d834f24524b87874d34caeacaea89 Oct 05 02:27:05.378200 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1984407805 Oct 05 02:27:05.378200 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:27:05.378200 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:27:05.379575 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c63d834f24524b87874d34caeacaea89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c63d834f24524b87874d34caeacaea89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c63d834f24524b87874d34caeacaea89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c63d834f24524b87874d34caeacaea89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:05.379575 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1984407805 Oct 05 02:27:05.379575 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: c63d834f24524b87874d34caeacaea89 Oct 05 02:27:05.379575 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1984407805 Oct 05 02:27:05.379575 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-HypervisorAdminNegativeTestJSON-1984407805-project Oct 05 02:27:05.379575 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:27:05.379575 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:27:05.379575 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: e65f598908804f8d89a086f7b3ca87a2 Oct 05 02:27:05.379575 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1984407805-project Oct 05 02:27:05.379575 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:27:05.379575 n-d-858272-3 devstack@n-api.service[122319]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 05 02:27:05.379575 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '1'} Oct 05 02:27:05.379575 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:05.380251 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:05.380251 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:05.380251 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:05.380251 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:05.380251 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:05.380251 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:27:05.380251 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:27:05.380251 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:05.380251 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:05.380251 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 05 02:27:05.380251 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 05 02:27:05.380251 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 02:27:05.380251 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 02:27:05.380251 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 02:27:05.380251 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 02:27:05.380251 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:27:05.380251 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:27:05.380251 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:27:05.380251 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:27:05.381319 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 02:27:05.381319 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 02:27:05.381319 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 02:27:05.381319 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 02:27:05.381319 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:27:05.381319 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 02:27:05.381319 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 05 02:27:05.381319 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:05.381319 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:05.381319 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:05.381319 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:05.381319 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:05.381319 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:05.381319 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 02:27:05.381319 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 02:27:05.381319 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 05 02:27:05.381319 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:05.383815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-90b1704c-3db7-409d-9eb8-43f9e916f33e tempest-HypervisorAdminNegativeTestJSON-1984407805 tempest-HypervisorAdminNegativeTestJSON-1984407805-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:05.385293 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-90b1704c-3db7-409d-9eb8-43f9e916f33e tempest-HypervisorAdminNegativeTestJSON-1984407805 tempest-HypervisorAdminNegativeTestJSON-1984407805-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.030689 Oct 05 02:27:05.386147 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 67/119] 10.222.0.16 () {58 vars in 1173 bytes} [Wed Oct 5 02:27:05 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:27:05.395963 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-105ae5eb-a000-4ff0-ab6e-8cf62897f317 req-bc575960-5a29-4db5-a2b5-5f63c1436947 service nova] Creating event network-changed:a955fb2f-e0a3-488e-9626-53db651f09eb for instance c9ea1283-2889-4a96-bee8-b2b99509ed59 on n-h1-858272-3 Oct 05 02:27:05.398519 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c8a77790-c29c-4c65-ae06-5ebe75eb33fe tempest-FlavorsV255TestJSON-129388074 tempest-FlavorsV255TestJSON-129388074-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:05.403590 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-105ae5eb-a000-4ff0-ab6e-8cf62897f317 req-bc575960-5a29-4db5-a2b5-5f63c1436947 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.259898 Oct 05 02:27:05.404750 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 53/120] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:05.418503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fdefd1d5-e18e-4500-bd05-03ab5f84f8e0 tempest-HypervisorAdminNegativeTestJSON-1889193746 tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin] Calling method '.version_select at 0x7fcce4d74040>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:05.422123 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-fdefd1d5-e18e-4500-bd05-03ab5f84f8e0 tempest-HypervisorAdminNegativeTestJSON-1889193746 tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin] HTTP exception thrown: Hypervisor with ID '49a70003-563e-4c4b-858b-24dd7df4055c' could not be found. Oct 05 02:27:05.436631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fdefd1d5-e18e-4500-bd05-03ab5f84f8e0 tempest-HypervisorAdminNegativeTestJSON-1889193746 tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin] Request method failure captured: Oct 05 02:27:05.436631 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/os-hypervisors/49a70003-563e-4c4b-858b-24dd7df4055c/uptime HTTP/1.1 Oct 05 02:27:05.436631 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:27:05.436631 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:27:05.436631 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:27:05.436631 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:27:05.436631 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:27:05.436631 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:27:05.436631 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:27:05.436631 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:05.436631 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOt3uMGw1M_98X63BF6Pk848tNCzQey_nYo0E6I41R9WOKZtQTQ8eC-sQdn5PrKT9ZX-4QHVIRn9W6iOQ1qHjPuDlNKJR3D5cdhZ8-NV6PzDdQK36M4d2GPZ9LAC1JOWjYT12l9hQge5Wl668gEeBO0H_Eqhi-3i06sa1iaB90opFjA Oct 05 02:27:05.436631 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:27:05.436631 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:27:05.436631 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:27:05.436631 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:27:05.436631 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:27:05.436631 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:27:05.436631 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: cb63164f86ee41468eaa519d5e7ba856 Oct 05 02:27:05.436631 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1889193746 Oct 05 02:27:05.436631 n-d-858272-3 devstack@n-api.service[122320]: X-Role: admin,member,reader Oct 05 02:27:05.436631 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: admin,member,reader Oct 05 02:27:05.438086 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb63164f86ee41468eaa519d5e7ba856"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb63164f86ee41468eaa519d5e7ba856"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb63164f86ee41468eaa519d5e7ba856"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb63164f86ee41468eaa519d5e7ba856"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:05.438086 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1889193746 Oct 05 02:27:05.438086 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: cb63164f86ee41468eaa519d5e7ba856 Oct 05 02:27:05.438086 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1889193746 Oct 05 02:27:05.438086 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin Oct 05 02:27:05.438086 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:27:05.438086 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:27:05.438086 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: c6d67334217342f59b05759dc85f8b46 Oct 05 02:27:05.438086 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin Oct 05 02:27:05.438086 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:27:05.438086 n-d-858272-3 devstack@n-api.service[122320]: exception: Hypervisor with ID '49a70003-563e-4c4b-858b-24dd7df4055c' could not be found. Oct 05 02:27:05.438086 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '49a70003-563e-4c4b-858b-24dd7df4055c'} Oct 05 02:27:05.438826 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:05.438826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:05.438826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 05 02:27:05.438826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 05 02:27:05.438826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '49a70003-563e-4c4b-858b-24dd7df4055c' Oct 05 02:27:05.438826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:05.438826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:05.438826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:05.438826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:05.438826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 05 02:27:05.438826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 05 02:27:05.438826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 05 02:27:05.438826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 05 02:27:05.438826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 05 02:27:05.438826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:05.438826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:05.438826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:05.438826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:05.438826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 05 02:27:05.438826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 05 02:27:05.438826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 05 02:27:05.438826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 05 02:27:05.440125 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 05 02:27:05.440125 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:05.440125 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:05.440125 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:05.440125 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:05.440125 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:05.440125 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:05.440125 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:05.440125 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:05.440125 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:27:05.440125 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:27:05.440125 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:05.440125 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:05.440125 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 05 02:27:05.440125 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 05 02:27:05.440125 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 05 02:27:05.440125 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 05 02:27:05.440125 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '49a70003-563e-4c4b-858b-24dd7df4055c' could not be found. Oct 05 02:27:05.440125 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:05.440125 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:05.440125 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:05.441862 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:05.441862 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:05.441862 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:05.441862 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:27:05.441862 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:27:05.441862 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '49a70003-563e-4c4b-858b-24dd7df4055c' could not be found. Oct 05 02:27:05.441862 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:05.445464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fdefd1d5-e18e-4500-bd05-03ab5f84f8e0 tempest-HypervisorAdminNegativeTestJSON-1889193746 tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin] Returning 404 to user: Hypervisor with ID '49a70003-563e-4c4b-858b-24dd7df4055c' could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:05.446669 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fdefd1d5-e18e-4500-bd05-03ab5f84f8e0 tempest-HypervisorAdminNegativeTestJSON-1889193746 tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/49a70003-563e-4c4b-858b-24dd7df4055c/uptime" status: 404 len: 123 microversion: 2.1 time: 0.040779 Oct 05 02:27:05.447405 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 54/121] 10.222.0.16 () {58 vars in 1278 bytes} [Wed Oct 5 02:27:05 2022] GET /compute/v2.1/os-hypervisors/49a70003-563e-4c4b-858b-24dd7df4055c/uptime => generated 123 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:27:05.451307 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c8a77790-c29c-4c65-ae06-5ebe75eb33fe tempest-FlavorsV255TestJSON-129388074 tempest-FlavorsV255TestJSON-129388074-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.55 time: 0.057700 Oct 05 02:27:05.460510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8882887c-6732-4e2c-a66f-87b39dc62d2e tempest-HypervisorAdminNegativeTestJSON-1889193746 tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin] Calling method '.version_select at 0x7fcce4cdf700>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:05.463290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8882887c-6732-4e2c-a66f-87b39dc62d2e tempest-HypervisorAdminNegativeTestJSON-1889193746 tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:05.464226 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8882887c-6732-4e2c-a66f-87b39dc62d2e tempest-HypervisorAdminNegativeTestJSON-1889193746 tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:05.464877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8882887c-6732-4e2c-a66f-87b39dc62d2e tempest-HypervisorAdminNegativeTestJSON-1889193746 tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:05.469483 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 68/122] 10.222.0.16 () {60 vars in 1166 bytes} [Wed Oct 5 02:27:05 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:27:05.482198 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-515d33ea-022e-4e65-8008-8e59fbbf14ac tempest-FlavorsV255TestJSON-293459074 tempest-FlavorsV255TestJSON-293459074-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:05.494279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8882887c-6732-4e2c-a66f-87b39dc62d2e tempest-HypervisorAdminNegativeTestJSON-1889193746 tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:05.494782 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8882887c-6732-4e2c-a66f-87b39dc62d2e tempest-HypervisorAdminNegativeTestJSON-1889193746 tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:05.495373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8882887c-6732-4e2c-a66f-87b39dc62d2e tempest-HypervisorAdminNegativeTestJSON-1889193746 tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:05.508506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8882887c-6732-4e2c-a66f-87b39dc62d2e tempest-HypervisorAdminNegativeTestJSON-1889193746 tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:05.509369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8882887c-6732-4e2c-a66f-87b39dc62d2e tempest-HypervisorAdminNegativeTestJSON-1889193746 tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:05.509546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8882887c-6732-4e2c-a66f-87b39dc62d2e tempest-HypervisorAdminNegativeTestJSON-1889193746 tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:05.516603 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8882887c-6732-4e2c-a66f-87b39dc62d2e tempest-HypervisorAdminNegativeTestJSON-1889193746 tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.063722 Oct 05 02:27:05.517565 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 55/123] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:27:05 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:27:05.520066 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-515d33ea-022e-4e65-8008-8e59fbbf14ac tempest-FlavorsV255TestJSON-293459074 tempest-FlavorsV255TestJSON-293459074-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/483790461" status: 202 len: 0 microversion: 2.55 time: 0.049366 Oct 05 02:27:05.520662 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 69/124] 10.222.0.16 () {60 vars in 1199 bytes} [Wed Oct 5 02:27:05 2022] DELETE /compute/v2.1/flavors/483790461 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:27:05.528511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4efff574-7f4d-46e3-bf6b-43f250f19f0b tempest-HypervisorAdminNegativeTestJSON-1984407805 tempest-HypervisorAdminNegativeTestJSON-1984407805-project] Calling method '.version_select at 0x7fcce4be3a60>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:05.528933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6a6c3a16-f295-4906-8c88-7e533241998b tempest-FlavorsV255TestJSON-293459074 tempest-FlavorsV255TestJSON-293459074-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:05.530364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4efff574-7f4d-46e3-bf6b-43f250f19f0b tempest-HypervisorAdminNegativeTestJSON-1984407805 tempest-HypervisorAdminNegativeTestJSON-1984407805-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'e65f598908804f8d89a086f7b3ca87a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d834f24524b87874d34caeacaea89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:05.538274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4efff574-7f4d-46e3-bf6b-43f250f19f0b tempest-HypervisorAdminNegativeTestJSON-1984407805 tempest-HypervisorAdminNegativeTestJSON-1984407805-project] Request method failure captured: Oct 05 02:27:05.538274 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 05 02:27:05.538274 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:27:05.538274 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:27:05.538274 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:27:05.538274 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:27:05.538274 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:27:05.538274 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:27:05.538274 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:27:05.538274 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:05.538274 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOt2RTyb6Zegzes3VhEHk6vHIW1o2n0y2ipCpPp24RTH9pr403d0H7b8TkkJq8ZNSV13oX09CICb_x-SIuQv2QQfWYmXZWKFh8oEVDC7AE6cE-soO_pAIbX_DWnM9IQ4YRN7n7h7Qz-hSSO2aUAv_EX0qTWck20jf7vu-xRTTuiLpsU Oct 05 02:27:05.538274 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:27:05.538274 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:27:05.538274 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:27:05.538274 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:27:05.538274 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:27:05.538274 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:27:05.538274 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c63d834f24524b87874d34caeacaea89 Oct 05 02:27:05.538274 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1984407805 Oct 05 02:27:05.538274 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:27:05.538274 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:27:05.541015 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c63d834f24524b87874d34caeacaea89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c63d834f24524b87874d34caeacaea89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c63d834f24524b87874d34caeacaea89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c63d834f24524b87874d34caeacaea89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:05.541015 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1984407805 Oct 05 02:27:05.541015 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c63d834f24524b87874d34caeacaea89 Oct 05 02:27:05.541015 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1984407805 Oct 05 02:27:05.541015 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-HypervisorAdminNegativeTestJSON-1984407805-project Oct 05 02:27:05.541015 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:27:05.541015 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:27:05.541015 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: e65f598908804f8d89a086f7b3ca87a2 Oct 05 02:27:05.541015 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1984407805-project Oct 05 02:27:05.541015 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:27:05.541015 n-d-858272-3 devstack@n-api.service[122320]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 05 02:27:05.541015 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '1'} Oct 05 02:27:05.541015 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:05.541694 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:05.541694 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:05.541694 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:05.541694 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:05.541694 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:05.541694 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:27:05.541694 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:27:05.541694 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:05.541694 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:05.541694 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 05 02:27:05.541694 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 05 02:27:05.541694 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 05 02:27:05.541694 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 05 02:27:05.541694 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 02:27:05.541694 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 02:27:05.541694 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 02:27:05.541694 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 02:27:05.541694 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:27:05.541694 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:27:05.542645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:27:05.542645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:27:05.542645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 02:27:05.542645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 02:27:05.542645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 02:27:05.542645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 02:27:05.542645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:27:05.542645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 02:27:05.542645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 05 02:27:05.542645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:05.542645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:05.542645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:05.542645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:05.542645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:05.542645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:05.542645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 02:27:05.542645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 02:27:05.542645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 05 02:27:05.542645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:05.543625 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4efff574-7f4d-46e3-bf6b-43f250f19f0b tempest-HypervisorAdminNegativeTestJSON-1984407805 tempest-HypervisorAdminNegativeTestJSON-1984407805-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:05.543625 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4efff574-7f4d-46e3-bf6b-43f250f19f0b tempest-HypervisorAdminNegativeTestJSON-1984407805 tempest-HypervisorAdminNegativeTestJSON-1984407805-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.015096 Oct 05 02:27:05.543625 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 56/125] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 5 02:27:05 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:27:05.549996 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4527b2bb-294b-4a49-9efd-7c6df5918668 tempest-HypervisorAdminNegativeTestJSON-1889193746 tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin] Calling method '.version_select at 0x7fcce4cfca60>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:05.552125 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-4527b2bb-294b-4a49-9efd-7c6df5918668 tempest-HypervisorAdminNegativeTestJSON-1889193746 tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin] HTTP exception thrown: Hypervisor with ID '84cbd894-5a8a-4d3d-b742-ed96b2b911c5' could not be found. Oct 05 02:27:05.554016 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4527b2bb-294b-4a49-9efd-7c6df5918668 tempest-HypervisorAdminNegativeTestJSON-1889193746 tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin] Request method failure captured: Oct 05 02:27:05.554016 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/os-hypervisors/84cbd894-5a8a-4d3d-b742-ed96b2b911c5 HTTP/1.1 Oct 05 02:27:05.554016 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:27:05.554016 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:27:05.554016 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:27:05.554016 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:27:05.554016 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:27:05.554016 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:27:05.554016 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:27:05.554016 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:05.554016 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOt3uMGw1M_98X63BF6Pk848tNCzQey_nYo0E6I41R9WOKZtQTQ8eC-sQdn5PrKT9ZX-4QHVIRn9W6iOQ1qHjPuDlNKJR3D5cdhZ8-NV6PzDdQK36M4d2GPZ9LAC1JOWjYT12l9hQge5Wl668gEeBO0H_Eqhi-3i06sa1iaB90opFjA Oct 05 02:27:05.554016 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:27:05.554016 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:27:05.554016 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:27:05.554016 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:27:05.554016 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:27:05.554016 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:27:05.554016 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: cb63164f86ee41468eaa519d5e7ba856 Oct 05 02:27:05.554016 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1889193746 Oct 05 02:27:05.554016 n-d-858272-3 devstack@n-api.service[122320]: X-Role: admin,member,reader Oct 05 02:27:05.554016 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: admin,member,reader Oct 05 02:27:05.555174 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb63164f86ee41468eaa519d5e7ba856"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb63164f86ee41468eaa519d5e7ba856"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb63164f86ee41468eaa519d5e7ba856"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb63164f86ee41468eaa519d5e7ba856"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:05.555174 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1889193746 Oct 05 02:27:05.555174 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: cb63164f86ee41468eaa519d5e7ba856 Oct 05 02:27:05.555174 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1889193746 Oct 05 02:27:05.555174 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin Oct 05 02:27:05.555174 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:27:05.555174 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:27:05.555174 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: c6d67334217342f59b05759dc85f8b46 Oct 05 02:27:05.555174 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin Oct 05 02:27:05.555174 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:27:05.555174 n-d-858272-3 devstack@n-api.service[122320]: exception: Hypervisor with ID '84cbd894-5a8a-4d3d-b742-ed96b2b911c5' could not be found. Oct 05 02:27:05.555174 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '84cbd894-5a8a-4d3d-b742-ed96b2b911c5'} Oct 05 02:27:05.555792 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:05.555792 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:05.555792 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 05 02:27:05.555792 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 05 02:27:05.555792 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '84cbd894-5a8a-4d3d-b742-ed96b2b911c5' Oct 05 02:27:05.555792 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:05.555792 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:05.555792 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:05.555792 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:05.555792 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 05 02:27:05.555792 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 05 02:27:05.555792 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 05 02:27:05.555792 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 05 02:27:05.555792 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 05 02:27:05.555792 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:05.555792 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:05.555792 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:05.555792 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:05.555792 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 05 02:27:05.555792 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 05 02:27:05.555792 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 05 02:27:05.555792 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 05 02:27:05.556870 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 05 02:27:05.556870 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:05.556870 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:05.556870 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:05.556870 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:05.556870 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:05.556870 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:05.556870 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:05.556870 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:05.556870 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:27:05.556870 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:27:05.556870 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:05.556870 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:05.556870 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 05 02:27:05.556870 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 05 02:27:05.556870 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 05 02:27:05.556870 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 05 02:27:05.556870 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 05 02:27:05.556870 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 05 02:27:05.556870 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '84cbd894-5a8a-4d3d-b742-ed96b2b911c5' could not be found. Oct 05 02:27:05.558093 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:05.558093 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:05.558093 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:05.558093 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:05.558093 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:05.558093 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:05.558093 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:27:05.558093 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:27:05.558093 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '84cbd894-5a8a-4d3d-b742-ed96b2b911c5' could not be found. Oct 05 02:27:05.558093 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:05.559704 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4527b2bb-294b-4a49-9efd-7c6df5918668 tempest-HypervisorAdminNegativeTestJSON-1889193746 tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin] Returning 404 to user: Hypervisor with ID '84cbd894-5a8a-4d3d-b742-ed96b2b911c5' could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:05.560746 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4527b2bb-294b-4a49-9efd-7c6df5918668 tempest-HypervisorAdminNegativeTestJSON-1889193746 tempest-HypervisorAdminNegativeTestJSON-1889193746-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/84cbd894-5a8a-4d3d-b742-ed96b2b911c5" status: 404 len: 123 microversion: 2.1 time: 0.014448 Oct 05 02:27:05.565879 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 57/126] 10.222.0.16 () {58 vars in 1257 bytes} [Wed Oct 5 02:27:05 2022] GET /compute/v2.1/os-hypervisors/84cbd894-5a8a-4d3d-b742-ed96b2b911c5 => generated 123 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:27:05.579744 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2b101e37-9987-4ac3-8561-df174d84424b tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:05.581028 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2b101e37-9987-4ac3-8561-df174d84424b tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:05.583326 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6a6c3a16-f295-4906-8c88-7e533241998b tempest-FlavorsV255TestJSON-293459074 tempest-FlavorsV255TestJSON-293459074-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.058286 Oct 05 02:27:05.585017 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 70/127] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Oct 5 02:27:05 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:27:05.597315 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b101e37-9987-4ac3-8561-df174d84424b tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:05.598783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b101e37-9987-4ac3-8561-df174d84424b tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:05.599396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b101e37-9987-4ac3-8561-df174d84424b tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:05.601678 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b101e37-9987-4ac3-8561-df174d84424b tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:05.602312 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b101e37-9987-4ac3-8561-df174d84424b tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:05.602882 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b101e37-9987-4ac3-8561-df174d84424b tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:06.125680 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2b101e37-9987-4ac3-8561-df174d84424b tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aebce7113c4e8980490aa0b0fbb296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b7bb601bea47d88c9ad68be2651451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:06.134961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:06.141796 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2b101e37-9987-4ac3-8561-df174d84424b tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] 10.222.0.16 "GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9" status: 200 len: 1339 microversion: 2.1 time: 0.566615 Oct 05 02:27:06.147633 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 58/128] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:05 2022] GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 => generated 1339 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:06.164669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ea22025b-9e34-477d-b973-15918e424249 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:06.165879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ea22025b-9e34-477d-b973-15918e424249 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: c9ea1283-2889-4a96-bee8-b2b99509ed59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:06.179530 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ea22025b-9e34-477d-b973-15918e424249 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:06.182051 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ea22025b-9e34-477d-b973-15918e424249 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:06.182872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ea22025b-9e34-477d-b973-15918e424249 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:06.186246 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ea22025b-9e34-477d-b973-15918e424249 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:06.187697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ea22025b-9e34-477d-b973-15918e424249 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:06.189798 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ea22025b-9e34-477d-b973-15918e424249 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:07.170288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d5b31f86-3b84-4f3c-959f-ce538b4d8c7e tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:07.171093 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d5b31f86-3b84-4f3c-959f-ce538b4d8c7e tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:07.175964 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=12 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:07.192212 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5b31f86-3b84-4f3c-959f-ce538b4d8c7e tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:07.193278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5b31f86-3b84-4f3c-959f-ce538b4d8c7e tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:07.193937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5b31f86-3b84-4f3c-959f-ce538b4d8c7e tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:07.194874 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5b31f86-3b84-4f3c-959f-ce538b4d8c7e tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:07.195516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5b31f86-3b84-4f3c-959f-ce538b4d8c7e tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:07.196077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5b31f86-3b84-4f3c-959f-ce538b4d8c7e tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:07.230942 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ea22025b-9e34-477d-b973-15918e424249 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:07.239017 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ea22025b-9e34-477d-b973-15918e424249 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59" status: 200 len: 1320 microversion: 2.1 time: 1.084507 Oct 05 02:27:07.239602 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 71/129] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:06 2022] GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59 => generated 1320 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:07.500380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d5b31f86-3b84-4f3c-959f-ce538b4d8c7e tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aebce7113c4e8980490aa0b0fbb296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b7bb601bea47d88c9ad68be2651451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:07.508883 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d5b31f86-3b84-4f3c-959f-ce538b4d8c7e tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] 10.222.0.16 "GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9" status: 200 len: 1339 microversion: 2.1 time: 0.343753 Oct 05 02:27:07.513419 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 59/130] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:07 2022] GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 => generated 1339 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:27:08.262607 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-741642d5-0bcd-457e-94e5-94f8b4024c7f tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:08.263907 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-741642d5-0bcd-457e-94e5-94f8b4024c7f tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: c9ea1283-2889-4a96-bee8-b2b99509ed59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:08.272075 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-741642d5-0bcd-457e-94e5-94f8b4024c7f tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:08.277922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-741642d5-0bcd-457e-94e5-94f8b4024c7f tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:08.278989 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-741642d5-0bcd-457e-94e5-94f8b4024c7f tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:08.280171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-741642d5-0bcd-457e-94e5-94f8b4024c7f tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:08.287168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-741642d5-0bcd-457e-94e5-94f8b4024c7f tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:08.287775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-741642d5-0bcd-457e-94e5-94f8b4024c7f tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:08.292953 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:08.541126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-40c205df-d2be-46c0-beb8-aca2f4c3c653 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:08.542529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-40c205df-d2be-46c0-beb8-aca2f4c3c653 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:08.555720 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-40c205df-d2be-46c0-beb8-aca2f4c3c653 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:08.557487 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-40c205df-d2be-46c0-beb8-aca2f4c3c653 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:08.568433 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-40c205df-d2be-46c0-beb8-aca2f4c3c653 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:08.572234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-40c205df-d2be-46c0-beb8-aca2f4c3c653 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:08.577735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-40c205df-d2be-46c0-beb8-aca2f4c3c653 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:08.578575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-40c205df-d2be-46c0-beb8-aca2f4c3c653 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:08.691250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-741642d5-0bcd-457e-94e5-94f8b4024c7f tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:08.702280 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-741642d5-0bcd-457e-94e5-94f8b4024c7f tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59" status: 200 len: 1320 microversion: 2.1 time: 0.442940 Oct 05 02:27:08.710116 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 72/131] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:08 2022] GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59 => generated 1320 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:09.128215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-40c205df-d2be-46c0-beb8-aca2f4c3c653 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aebce7113c4e8980490aa0b0fbb296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b7bb601bea47d88c9ad68be2651451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:09.136610 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-40c205df-d2be-46c0-beb8-aca2f4c3c653 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] 10.222.0.16 "GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9" status: 200 len: 1339 microversion: 2.1 time: 0.600474 Oct 05 02:27:09.149340 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 60/132] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:08 2022] GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 => generated 1339 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:09.731129 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-69518aa0-fba9-4f78-a318-7b7b94d4b1ca tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:09.731927 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-69518aa0-fba9-4f78-a318-7b7b94d4b1ca tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: c9ea1283-2889-4a96-bee8-b2b99509ed59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:09.743984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69518aa0-fba9-4f78-a318-7b7b94d4b1ca tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:09.759209 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69518aa0-fba9-4f78-a318-7b7b94d4b1ca tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:09.759671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69518aa0-fba9-4f78-a318-7b7b94d4b1ca tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:09.760425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69518aa0-fba9-4f78-a318-7b7b94d4b1ca tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:09.760885 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69518aa0-fba9-4f78-a318-7b7b94d4b1ca tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:09.761437 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69518aa0-fba9-4f78-a318-7b7b94d4b1ca tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:10.166696 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e8b89a19-1329-480a-b803-5868ab35571c tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:10.168176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e8b89a19-1329-480a-b803-5868ab35571c tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:10.187166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8b89a19-1329-480a-b803-5868ab35571c tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:10.190631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8b89a19-1329-480a-b803-5868ab35571c tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:10.192812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8b89a19-1329-480a-b803-5868ab35571c tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:10.196733 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8b89a19-1329-480a-b803-5868ab35571c tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:10.207104 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8b89a19-1329-480a-b803-5868ab35571c tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:10.210051 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8b89a19-1329-480a-b803-5868ab35571c tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:10.232408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-69518aa0-fba9-4f78-a318-7b7b94d4b1ca tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:10.247774 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-69518aa0-fba9-4f78-a318-7b7b94d4b1ca tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59" status: 200 len: 1320 microversion: 2.1 time: 0.525668 Oct 05 02:27:10.263667 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 73/133] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:09 2022] GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59 => generated 1320 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:10.464467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e8b89a19-1329-480a-b803-5868ab35571c tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aebce7113c4e8980490aa0b0fbb296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b7bb601bea47d88c9ad68be2651451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:10.484277 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e8b89a19-1329-480a-b803-5868ab35571c tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] 10.222.0.16 "GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9" status: 200 len: 1339 microversion: 2.1 time: 0.322203 Oct 05 02:27:10.497643 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 61/134] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:10 2022] GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 => generated 1339 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:11.273535 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bd7bcd09-103a-44aa-843f-6f520338e80b tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:11.274700 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bd7bcd09-103a-44aa-843f-6f520338e80b tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: c9ea1283-2889-4a96-bee8-b2b99509ed59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:11.281241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd7bcd09-103a-44aa-843f-6f520338e80b tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:11.282149 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd7bcd09-103a-44aa-843f-6f520338e80b tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:11.282741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd7bcd09-103a-44aa-843f-6f520338e80b tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:11.283868 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd7bcd09-103a-44aa-843f-6f520338e80b tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:11.284470 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd7bcd09-103a-44aa-843f-6f520338e80b tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:11.286006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd7bcd09-103a-44aa-843f-6f520338e80b tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:11.524206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ce4cd669-72f7-4663-b330-94ea9e47536d tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:11.524821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ce4cd669-72f7-4663-b330-94ea9e47536d tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:11.541352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce4cd669-72f7-4663-b330-94ea9e47536d tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:11.543709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce4cd669-72f7-4663-b330-94ea9e47536d tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:11.544145 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce4cd669-72f7-4663-b330-94ea9e47536d tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:11.544874 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce4cd669-72f7-4663-b330-94ea9e47536d tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:11.545354 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce4cd669-72f7-4663-b330-94ea9e47536d tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:11.545777 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce4cd669-72f7-4663-b330-94ea9e47536d tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:11.605927 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bd7bcd09-103a-44aa-843f-6f520338e80b tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:11.622041 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bd7bcd09-103a-44aa-843f-6f520338e80b tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59" status: 200 len: 1320 microversion: 2.1 time: 0.352097 Oct 05 02:27:11.623718 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 74/135] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:11 2022] GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59 => generated 1320 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:11.819424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ce4cd669-72f7-4663-b330-94ea9e47536d tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aebce7113c4e8980490aa0b0fbb296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b7bb601bea47d88c9ad68be2651451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:11.828141 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ce4cd669-72f7-4663-b330-94ea9e47536d tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] 10.222.0.16 "GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9" status: 200 len: 1339 microversion: 2.1 time: 0.307724 Oct 05 02:27:11.829363 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 62/136] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:11 2022] GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 => generated 1339 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:27:12.649977 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4c5f9099-8da5-477f-8f23-d7eb35fa2b28 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:12.652019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4c5f9099-8da5-477f-8f23-d7eb35fa2b28 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: c9ea1283-2889-4a96-bee8-b2b99509ed59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:12.661165 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c5f9099-8da5-477f-8f23-d7eb35fa2b28 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:12.663812 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c5f9099-8da5-477f-8f23-d7eb35fa2b28 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:12.667236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c5f9099-8da5-477f-8f23-d7eb35fa2b28 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:12.668191 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c5f9099-8da5-477f-8f23-d7eb35fa2b28 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:12.668653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c5f9099-8da5-477f-8f23-d7eb35fa2b28 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:12.669118 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c5f9099-8da5-477f-8f23-d7eb35fa2b28 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:12.856306 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1c6a3bfe-797c-41f9-907a-d2f44208e695 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:12.857028 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1c6a3bfe-797c-41f9-907a-d2f44208e695 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:12.866890 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c6a3bfe-797c-41f9-907a-d2f44208e695 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:12.869322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c6a3bfe-797c-41f9-907a-d2f44208e695 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:12.869847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c6a3bfe-797c-41f9-907a-d2f44208e695 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:12.870863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c6a3bfe-797c-41f9-907a-d2f44208e695 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:12.871336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c6a3bfe-797c-41f9-907a-d2f44208e695 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:12.871762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c6a3bfe-797c-41f9-907a-d2f44208e695 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:13.097294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4c5f9099-8da5-477f-8f23-d7eb35fa2b28 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:13.107898 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4c5f9099-8da5-477f-8f23-d7eb35fa2b28 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59" status: 200 len: 1320 microversion: 2.1 time: 0.463932 Oct 05 02:27:13.109587 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 75/137] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:12 2022] GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59 => generated 1320 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:13.171436 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1c6a3bfe-797c-41f9-907a-d2f44208e695 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aebce7113c4e8980490aa0b0fbb296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b7bb601bea47d88c9ad68be2651451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:13.183760 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1c6a3bfe-797c-41f9-907a-d2f44208e695 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] 10.222.0.16 "GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9" status: 200 len: 1339 microversion: 2.1 time: 0.334814 Oct 05 02:27:13.185908 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 63/138] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:12 2022] GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 => generated 1339 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:27:13.259018 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-69104125-4fec-4ad0-abef-228fa01c3bc6 tempest-ServicesAdminTestJSON-1736352408 tempest-ServicesAdminTestJSON-1736352408-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:13.262861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69104125-4fec-4ad0-abef-228fa01c3bc6 tempest-ServicesAdminTestJSON-1736352408 tempest-ServicesAdminTestJSON-1736352408-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:13.263689 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69104125-4fec-4ad0-abef-228fa01c3bc6 tempest-ServicesAdminTestJSON-1736352408 tempest-ServicesAdminTestJSON-1736352408-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:13.264332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69104125-4fec-4ad0-abef-228fa01c3bc6 tempest-ServicesAdminTestJSON-1736352408 tempest-ServicesAdminTestJSON-1736352408-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:13.265343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69104125-4fec-4ad0-abef-228fa01c3bc6 tempest-ServicesAdminTestJSON-1736352408 tempest-ServicesAdminTestJSON-1736352408-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:13.266346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69104125-4fec-4ad0-abef-228fa01c3bc6 tempest-ServicesAdminTestJSON-1736352408 tempest-ServicesAdminTestJSON-1736352408-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:13.266990 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69104125-4fec-4ad0-abef-228fa01c3bc6 tempest-ServicesAdminTestJSON-1736352408 tempest-ServicesAdminTestJSON-1736352408-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:13.302433 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-69104125-4fec-4ad0-abef-228fa01c3bc6 tempest-ServicesAdminTestJSON-1736352408 tempest-ServicesAdminTestJSON-1736352408-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 966 microversion: 2.1 time: 0.191464 Oct 05 02:27:13.311571 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 76/139] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 5 02:27:13 2022] GET /compute/v2.1/os-services => generated 966 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:13.318541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c65c50f7-799b-40f2-847a-d33654629582 tempest-ServicesAdminTestJSON-1736352408 tempest-ServicesAdminTestJSON-1736352408-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:13.323482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c65c50f7-799b-40f2-847a-d33654629582 tempest-ServicesAdminTestJSON-1736352408 tempest-ServicesAdminTestJSON-1736352408-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:13.324570 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c65c50f7-799b-40f2-847a-d33654629582 tempest-ServicesAdminTestJSON-1736352408 tempest-ServicesAdminTestJSON-1736352408-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:13.325382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c65c50f7-799b-40f2-847a-d33654629582 tempest-ServicesAdminTestJSON-1736352408 tempest-ServicesAdminTestJSON-1736352408-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:13.326571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c65c50f7-799b-40f2-847a-d33654629582 tempest-ServicesAdminTestJSON-1736352408 tempest-ServicesAdminTestJSON-1736352408-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:13.327294 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c65c50f7-799b-40f2-847a-d33654629582 tempest-ServicesAdminTestJSON-1736352408 tempest-ServicesAdminTestJSON-1736352408-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:13.328041 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c65c50f7-799b-40f2-847a-d33654629582 tempest-ServicesAdminTestJSON-1736352408 tempest-ServicesAdminTestJSON-1736352408-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:13.359759 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c65c50f7-799b-40f2-847a-d33654629582 tempest-ServicesAdminTestJSON-1736352408 tempest-ServicesAdminTestJSON-1736352408-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=n-d-858272-3" status: 200 len: 578 microversion: 2.1 time: 0.046834 Oct 05 02:27:13.361058 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 64/140] 10.222.0.16 () {58 vars in 1172 bytes} [Wed Oct 5 02:27:13 2022] GET /compute/v2.1/os-services?host=n-d-858272-3 => generated 578 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:13.373535 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a6fe68f4-6f98-43f0-96d0-06a7de3c3296 tempest-ServicesAdminTestJSON-1736352408 tempest-ServicesAdminTestJSON-1736352408-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:13.377659 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6fe68f4-6f98-43f0-96d0-06a7de3c3296 tempest-ServicesAdminTestJSON-1736352408 tempest-ServicesAdminTestJSON-1736352408-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:13.379598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6fe68f4-6f98-43f0-96d0-06a7de3c3296 tempest-ServicesAdminTestJSON-1736352408 tempest-ServicesAdminTestJSON-1736352408-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:13.380280 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6fe68f4-6f98-43f0-96d0-06a7de3c3296 tempest-ServicesAdminTestJSON-1736352408 tempest-ServicesAdminTestJSON-1736352408-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:13.381333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6fe68f4-6f98-43f0-96d0-06a7de3c3296 tempest-ServicesAdminTestJSON-1736352408 tempest-ServicesAdminTestJSON-1736352408-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:13.381990 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6fe68f4-6f98-43f0-96d0-06a7de3c3296 tempest-ServicesAdminTestJSON-1736352408 tempest-ServicesAdminTestJSON-1736352408-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:13.382627 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6fe68f4-6f98-43f0-96d0-06a7de3c3296 tempest-ServicesAdminTestJSON-1736352408 tempest-ServicesAdminTestJSON-1736352408-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:13.411832 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a6fe68f4-6f98-43f0-96d0-06a7de3c3296 tempest-ServicesAdminTestJSON-1736352408 tempest-ServicesAdminTestJSON-1736352408-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 402 microversion: 2.1 time: 0.041820 Oct 05 02:27:13.413167 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 77/141] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Oct 5 02:27:13 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 402 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:27:13.426590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-adc4c37d-7e38-4e26-9517-b5ba552252e7 tempest-ServicesAdminTestJSON-1736352408 tempest-ServicesAdminTestJSON-1736352408-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:13.433196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-adc4c37d-7e38-4e26-9517-b5ba552252e7 tempest-ServicesAdminTestJSON-1736352408 tempest-ServicesAdminTestJSON-1736352408-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:13.434051 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-adc4c37d-7e38-4e26-9517-b5ba552252e7 tempest-ServicesAdminTestJSON-1736352408 tempest-ServicesAdminTestJSON-1736352408-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:13.434698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-adc4c37d-7e38-4e26-9517-b5ba552252e7 tempest-ServicesAdminTestJSON-1736352408 tempest-ServicesAdminTestJSON-1736352408-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:13.435633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-adc4c37d-7e38-4e26-9517-b5ba552252e7 tempest-ServicesAdminTestJSON-1736352408 tempest-ServicesAdminTestJSON-1736352408-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:13.437241 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-adc4c37d-7e38-4e26-9517-b5ba552252e7 tempest-ServicesAdminTestJSON-1736352408 tempest-ServicesAdminTestJSON-1736352408-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:13.438183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-adc4c37d-7e38-4e26-9517-b5ba552252e7 tempest-ServicesAdminTestJSON-1736352408 tempest-ServicesAdminTestJSON-1736352408-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:13.477006 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-adc4c37d-7e38-4e26-9517-b5ba552252e7 tempest-ServicesAdminTestJSON-1736352408 tempest-ServicesAdminTestJSON-1736352408-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 966 microversion: 2.1 time: 0.055095 Oct 05 02:27:13.478894 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 65/142] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 5 02:27:13 2022] GET /compute/v2.1/os-services => generated 966 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:14.131957 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-916a443a-f0b0-4ecd-a15a-321e8c9d720e tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:14.132571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-916a443a-f0b0-4ecd-a15a-321e8c9d720e tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: c9ea1283-2889-4a96-bee8-b2b99509ed59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:14.139201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-916a443a-f0b0-4ecd-a15a-321e8c9d720e tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:14.139896 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-916a443a-f0b0-4ecd-a15a-321e8c9d720e tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:14.140508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-916a443a-f0b0-4ecd-a15a-321e8c9d720e tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:14.141384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-916a443a-f0b0-4ecd-a15a-321e8c9d720e tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:14.141990 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-916a443a-f0b0-4ecd-a15a-321e8c9d720e tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:14.142558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-916a443a-f0b0-4ecd-a15a-321e8c9d720e tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:14.214970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-825647c8-09ff-43c3-9be9-78d51b525fc4 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:14.216290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-825647c8-09ff-43c3-9be9-78d51b525fc4 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:14.226239 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-825647c8-09ff-43c3-9be9-78d51b525fc4 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:14.226986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-825647c8-09ff-43c3-9be9-78d51b525fc4 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:14.229060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-825647c8-09ff-43c3-9be9-78d51b525fc4 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:14.231363 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-825647c8-09ff-43c3-9be9-78d51b525fc4 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:14.232023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-825647c8-09ff-43c3-9be9-78d51b525fc4 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:14.232671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-825647c8-09ff-43c3-9be9-78d51b525fc4 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:14.408818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-916a443a-f0b0-4ecd-a15a-321e8c9d720e tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:14.432801 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-916a443a-f0b0-4ecd-a15a-321e8c9d720e tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59" status: 200 len: 1320 microversion: 2.1 time: 0.304184 Oct 05 02:27:14.433799 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 78/143] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:14 2022] GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59 => generated 1320 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:14.548756 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-825647c8-09ff-43c3-9be9-78d51b525fc4 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aebce7113c4e8980490aa0b0fbb296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b7bb601bea47d88c9ad68be2651451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:14.564656 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-825647c8-09ff-43c3-9be9-78d51b525fc4 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] 10.222.0.16 "GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9" status: 200 len: 1339 microversion: 2.1 time: 0.354526 Oct 05 02:27:14.566855 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 66/144] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:14 2022] GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 => generated 1339 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:27:15.459623 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-560f2c56-7472-4cca-88db-1de97374c6b8 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:15.462321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-560f2c56-7472-4cca-88db-1de97374c6b8 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: c9ea1283-2889-4a96-bee8-b2b99509ed59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:15.476144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-560f2c56-7472-4cca-88db-1de97374c6b8 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:15.476843 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-560f2c56-7472-4cca-88db-1de97374c6b8 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:15.481515 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-560f2c56-7472-4cca-88db-1de97374c6b8 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:15.485819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-560f2c56-7472-4cca-88db-1de97374c6b8 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:15.486448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-560f2c56-7472-4cca-88db-1de97374c6b8 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:15.486982 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-560f2c56-7472-4cca-88db-1de97374c6b8 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:15.593949 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2b309642-c38f-4838-85da-d6ab518b384e tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:15.595001 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2b309642-c38f-4838-85da-d6ab518b384e tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:15.609449 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b309642-c38f-4838-85da-d6ab518b384e tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:15.610210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b309642-c38f-4838-85da-d6ab518b384e tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:15.610840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b309642-c38f-4838-85da-d6ab518b384e tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:15.611935 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b309642-c38f-4838-85da-d6ab518b384e tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:15.612545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b309642-c38f-4838-85da-d6ab518b384e tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:15.614060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b309642-c38f-4838-85da-d6ab518b384e tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:16.030201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-560f2c56-7472-4cca-88db-1de97374c6b8 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:16.042725 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-560f2c56-7472-4cca-88db-1de97374c6b8 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59" status: 200 len: 1320 microversion: 2.1 time: 0.587630 Oct 05 02:27:16.058053 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 79/145] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:15 2022] GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59 => generated 1320 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:16.090496 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2b309642-c38f-4838-85da-d6ab518b384e tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aebce7113c4e8980490aa0b0fbb296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b7bb601bea47d88c9ad68be2651451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:16.108094 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2b309642-c38f-4838-85da-d6ab518b384e tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] 10.222.0.16 "GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9" status: 200 len: 1339 microversion: 2.1 time: 0.520137 Oct 05 02:27:16.126814 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 67/146] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:15 2022] GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 => generated 1339 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:27:17.080872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5ed0c4ea-9385-4c8a-a09c-5992b32fc549 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:17.081508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5ed0c4ea-9385-4c8a-a09c-5992b32fc549 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: c9ea1283-2889-4a96-bee8-b2b99509ed59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:17.098635 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ed0c4ea-9385-4c8a-a09c-5992b32fc549 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:17.099565 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ed0c4ea-9385-4c8a-a09c-5992b32fc549 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:17.099927 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ed0c4ea-9385-4c8a-a09c-5992b32fc549 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:17.100644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ed0c4ea-9385-4c8a-a09c-5992b32fc549 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:17.101120 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ed0c4ea-9385-4c8a-a09c-5992b32fc549 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:17.107975 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ed0c4ea-9385-4c8a-a09c-5992b32fc549 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:17.140702 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-308d6a33-8232-472d-b4f3-ca57e95ae2eb tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:17.143244 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-308d6a33-8232-472d-b4f3-ca57e95ae2eb tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:17.167384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-308d6a33-8232-472d-b4f3-ca57e95ae2eb tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:17.168043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-308d6a33-8232-472d-b4f3-ca57e95ae2eb tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:17.168490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-308d6a33-8232-472d-b4f3-ca57e95ae2eb tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:17.170062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-308d6a33-8232-472d-b4f3-ca57e95ae2eb tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:17.170725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-308d6a33-8232-472d-b4f3-ca57e95ae2eb tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:17.171496 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-308d6a33-8232-472d-b4f3-ca57e95ae2eb tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:17.348464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5ed0c4ea-9385-4c8a-a09c-5992b32fc549 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:17.359755 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5ed0c4ea-9385-4c8a-a09c-5992b32fc549 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59" status: 200 len: 1320 microversion: 2.1 time: 0.283257 Oct 05 02:27:17.363282 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 80/147] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:17 2022] GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59 => generated 1320 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:17.452675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-308d6a33-8232-472d-b4f3-ca57e95ae2eb tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aebce7113c4e8980490aa0b0fbb296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b7bb601bea47d88c9ad68be2651451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:17.463909 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-308d6a33-8232-472d-b4f3-ca57e95ae2eb tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] 10.222.0.16 "GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9" status: 200 len: 1339 microversion: 2.1 time: 0.329867 Oct 05 02:27:17.464948 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 68/148] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:17 2022] GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 => generated 1339 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:27:18.383775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-586a55ca-c015-41cd-a77f-0eb3afe51153 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:18.384392 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-586a55ca-c015-41cd-a77f-0eb3afe51153 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: c9ea1283-2889-4a96-bee8-b2b99509ed59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:18.393496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-586a55ca-c015-41cd-a77f-0eb3afe51153 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:18.393981 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-586a55ca-c015-41cd-a77f-0eb3afe51153 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:18.394515 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-586a55ca-c015-41cd-a77f-0eb3afe51153 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:18.407979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-586a55ca-c015-41cd-a77f-0eb3afe51153 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:18.411644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-586a55ca-c015-41cd-a77f-0eb3afe51153 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:18.412484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-586a55ca-c015-41cd-a77f-0eb3afe51153 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:18.499537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-21c09192-a054-4bb9-8af7-f70ec22a3c83 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:18.500642 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-21c09192-a054-4bb9-8af7-f70ec22a3c83 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:18.510188 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-21c09192-a054-4bb9-8af7-f70ec22a3c83 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:18.513102 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-21c09192-a054-4bb9-8af7-f70ec22a3c83 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:18.515884 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-21c09192-a054-4bb9-8af7-f70ec22a3c83 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:18.529605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-21c09192-a054-4bb9-8af7-f70ec22a3c83 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:18.533734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-21c09192-a054-4bb9-8af7-f70ec22a3c83 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:18.541106 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-21c09192-a054-4bb9-8af7-f70ec22a3c83 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:18.824339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-586a55ca-c015-41cd-a77f-0eb3afe51153 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:18.850492 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-586a55ca-c015-41cd-a77f-0eb3afe51153 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59" status: 200 len: 1320 microversion: 2.1 time: 0.469379 Oct 05 02:27:18.872341 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 81/149] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:18 2022] GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59 => generated 1320 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:18.968223 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-21c09192-a054-4bb9-8af7-f70ec22a3c83 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aebce7113c4e8980490aa0b0fbb296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b7bb601bea47d88c9ad68be2651451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:18.978185 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-21c09192-a054-4bb9-8af7-f70ec22a3c83 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] 10.222.0.16 "GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9" status: 200 len: 1339 microversion: 2.1 time: 0.490293 Oct 05 02:27:18.979026 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 69/150] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:18 2022] GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 => generated 1339 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:19.142208 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c1843e8c-ef3f-476f-8302-e52e65aca8ee tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Action: 'update', calling method: .version_select at 0x7fcce4d66940>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:19.153349 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1843e8c-ef3f-476f-8302-e52e65aca8ee tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:19.154191 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1843e8c-ef3f-476f-8302-e52e65aca8ee tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:19.154526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1843e8c-ef3f-476f-8302-e52e65aca8ee tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:19.164693 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1843e8c-ef3f-476f-8302-e52e65aca8ee tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:19.165240 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1843e8c-ef3f-476f-8302-e52e65aca8ee tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:19.165670 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1843e8c-ef3f-476f-8302-e52e65aca8ee tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:19.174570 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-c1843e8c-ef3f-476f-8302-e52e65aca8ee tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] HTTP exception thrown: Service 75cc31da-e7e5-4240-a210-5eb77dff70d3 could not be found. Oct 05 02:27:19.180308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c1843e8c-ef3f-476f-8302-e52e65aca8ee tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Request method failure captured: Oct 05 02:27:19.180308 n-d-858272-3 devstack@n-api.service[122319]: request: PUT /compute/v2.1/os-services/75cc31da-e7e5-4240-a210-5eb77dff70d3 HTTP/1.1 Oct 05 02:27:19.180308 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:27:19.180308 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:27:19.180308 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:27:19.180308 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 56 Oct 05 02:27:19.180308 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:27:19.180308 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:27:19.180308 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:27:19.180308 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:19.180308 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOuGAWXI0-gf7nNAuvXDMkLXlIvCebDCSjC1f1aGW0NA4Evrwehut8mwDDwIdGwNyzc43fKKFMdC590FQrc17oGGQEtSDP6UMzMkbmDWvSIBnai_5V2WCZNBpvJcDgpmbQxDAdVjPO_QG3rcfH6baeB82SA5kCm5pCkM9rul1xS5C7s Oct 05 02:27:19.180308 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:27:19.180308 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:27:19.180308 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:27:19.180308 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:27:19.180308 n-d-858272-3 devstack@n-api.service[122319]: X-Openstack-Nova-Api-Version: 2.53 Oct 05 02:27:19.180308 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:27:19.180308 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:27:19.180308 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 3c48ec22ea5343f09d2e834aa1fefc4e Oct 05 02:27:19.180308 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2031564725 Oct 05 02:27:19.180308 n-d-858272-3 devstack@n-api.service[122319]: X-Role: admin,member,reader Oct 05 02:27:19.180308 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: admin,member,reader Oct 05 02:27:19.181884 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3c48ec22ea5343f09d2e834aa1fefc4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3c48ec22ea5343f09d2e834aa1fefc4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3c48ec22ea5343f09d2e834aa1fefc4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3c48ec22ea5343f09d2e834aa1fefc4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:19.181884 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2031564725 Oct 05 02:27:19.181884 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 3c48ec22ea5343f09d2e834aa1fefc4e Oct 05 02:27:19.181884 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2031564725 Oct 05 02:27:19.181884 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin Oct 05 02:27:19.181884 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:27:19.181884 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:27:19.181884 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 091eb9f59fd1404cb3376b71607a9a6b Oct 05 02:27:19.181884 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin Oct 05 02:27:19.181884 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:27:19.181884 n-d-858272-3 devstack@n-api.service[122319]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 05 02:27:19.181884 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:27:19.181884 n-d-858272-3 devstack@n-api.service[122319]: exception: Service 75cc31da-e7e5-4240-a210-5eb77dff70d3 could not be found. Oct 05 02:27:19.183250 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '75cc31da-e7e5-4240-a210-5eb77dff70d3', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 05 02:27:19.183250 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:19.183250 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:19.183250 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 05 02:27:19.183250 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 05 02:27:19.183250 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 05 02:27:19.183250 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 05 02:27:19.183250 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 05 02:27:19.183250 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:19.183250 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:19.183250 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:19.183250 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:19.183250 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 05 02:27:19.183250 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 05 02:27:19.183250 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 05 02:27:19.183250 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:27:19.183250 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 75cc31da-e7e5-4240-a210-5eb77dff70d3 could not be found. Oct 05 02:27:19.183250 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:19.183250 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:19.183250 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:19.183250 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:19.184617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:19.184617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:19.184617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:19.184617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:19.184617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:27:19.184617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:27:19.184617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:19.184617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:19.184617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:27:19.184617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:27:19.184617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 05 02:27:19.184617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:27:19.184617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 75cc31da-e7e5-4240-a210-5eb77dff70d3 could not be found. Oct 05 02:27:19.184617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:19.184617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:19.184617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:19.184617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:19.184617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:19.184617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:19.184617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:27:19.185942 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:27:19.185942 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 75cc31da-e7e5-4240-a210-5eb77dff70d3 could not be found. Oct 05 02:27:19.185942 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:19.189476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c1843e8c-ef3f-476f-8302-e52e65aca8ee tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Returning 404 to user: Service 75cc31da-e7e5-4240-a210-5eb77dff70d3 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:19.190753 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c1843e8c-ef3f-476f-8302-e52e65aca8ee tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/75cc31da-e7e5-4240-a210-5eb77dff70d3" status: 404 len: 110 microversion: 2.53 time: 0.316057 Oct 05 02:27:19.192340 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 82/151] 10.222.0.16 () {62 vars in 1309 bytes} [Wed Oct 5 02:27:18 2022] PUT /compute/v2.1/os-services/75cc31da-e7e5-4240-a210-5eb77dff70d3 => generated 110 bytes in 320 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:27:19.202559 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-13d717b6-ede3-40fe-9f86-4067d413fb7b tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Action: 'update', calling method: .version_select at 0x7fcce4cfc8b0>, body: {"status": "disabled"} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:19.206278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13d717b6-ede3-40fe-9f86-4067d413fb7b tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:19.207732 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13d717b6-ede3-40fe-9f86-4067d413fb7b tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:19.208436 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13d717b6-ede3-40fe-9f86-4067d413fb7b tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:19.218955 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13d717b6-ede3-40fe-9f86-4067d413fb7b tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:19.219450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13d717b6-ede3-40fe-9f86-4067d413fb7b tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:19.219887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13d717b6-ede3-40fe-9f86-4067d413fb7b tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:19.228958 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-13d717b6-ede3-40fe-9f86-4067d413fb7b tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] HTTP exception thrown: Service 75cc31da-e7e5-4240-a210-5eb77dff70d3 could not be found. Oct 05 02:27:19.236229 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-13d717b6-ede3-40fe-9f86-4067d413fb7b tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Request method failure captured: Oct 05 02:27:19.236229 n-d-858272-3 devstack@n-api.service[122320]: request: PUT /compute/v2.1/os-services/75cc31da-e7e5-4240-a210-5eb77dff70d3 HTTP/1.1 Oct 05 02:27:19.236229 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:27:19.236229 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:27:19.236229 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:27:19.236229 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 22 Oct 05 02:27:19.236229 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:27:19.236229 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:27:19.236229 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:27:19.236229 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:19.236229 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOuGAWXI0-gf7nNAuvXDMkLXlIvCebDCSjC1f1aGW0NA4Evrwehut8mwDDwIdGwNyzc43fKKFMdC590FQrc17oGGQEtSDP6UMzMkbmDWvSIBnai_5V2WCZNBpvJcDgpmbQxDAdVjPO_QG3rcfH6baeB82SA5kCm5pCkM9rul1xS5C7s Oct 05 02:27:19.236229 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:27:19.236229 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:27:19.236229 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:27:19.236229 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:27:19.236229 n-d-858272-3 devstack@n-api.service[122320]: X-Openstack-Nova-Api-Version: 2.53 Oct 05 02:27:19.236229 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:27:19.236229 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:27:19.236229 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 3c48ec22ea5343f09d2e834aa1fefc4e Oct 05 02:27:19.236229 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2031564725 Oct 05 02:27:19.236229 n-d-858272-3 devstack@n-api.service[122320]: X-Role: admin,member,reader Oct 05 02:27:19.236229 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: admin,member,reader Oct 05 02:27:19.238125 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3c48ec22ea5343f09d2e834aa1fefc4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3c48ec22ea5343f09d2e834aa1fefc4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3c48ec22ea5343f09d2e834aa1fefc4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3c48ec22ea5343f09d2e834aa1fefc4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:19.238125 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2031564725 Oct 05 02:27:19.238125 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 3c48ec22ea5343f09d2e834aa1fefc4e Oct 05 02:27:19.238125 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2031564725 Oct 05 02:27:19.238125 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin Oct 05 02:27:19.238125 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:27:19.238125 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:27:19.238125 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 091eb9f59fd1404cb3376b71607a9a6b Oct 05 02:27:19.238125 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin Oct 05 02:27:19.238125 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:27:19.238125 n-d-858272-3 devstack@n-api.service[122320]: {"status": "disabled"} Oct 05 02:27:19.238125 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:27:19.238125 n-d-858272-3 devstack@n-api.service[122320]: exception: Service 75cc31da-e7e5-4240-a210-5eb77dff70d3 could not be found. Oct 05 02:27:19.238125 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '75cc31da-e7e5-4240-a210-5eb77dff70d3', 'body': {'status': 'disabled'}} Oct 05 02:27:19.239038 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:19.239038 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:19.239038 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 05 02:27:19.239038 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 05 02:27:19.239038 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 05 02:27:19.239038 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 05 02:27:19.239038 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 05 02:27:19.239038 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:19.239038 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:19.239038 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:19.239038 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:19.239038 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 05 02:27:19.239038 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 05 02:27:19.239038 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 05 02:27:19.239038 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:27:19.239038 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 75cc31da-e7e5-4240-a210-5eb77dff70d3 could not be found. Oct 05 02:27:19.239038 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:19.239038 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:19.239038 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:19.239038 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:19.239038 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:19.240391 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:19.240391 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:19.240391 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:19.240391 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:27:19.240391 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:27:19.240391 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:19.240391 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:19.240391 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:27:19.240391 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:27:19.240391 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 05 02:27:19.240391 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:27:19.240391 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 75cc31da-e7e5-4240-a210-5eb77dff70d3 could not be found. Oct 05 02:27:19.240391 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:19.240391 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:19.240391 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:19.240391 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:19.240391 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:19.240391 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:19.240391 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:27:19.240391 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:27:19.241682 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 75cc31da-e7e5-4240-a210-5eb77dff70d3 could not be found. Oct 05 02:27:19.241682 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:19.246909 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-13d717b6-ede3-40fe-9f86-4067d413fb7b tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Returning 404 to user: Service 75cc31da-e7e5-4240-a210-5eb77dff70d3 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:19.248791 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-13d717b6-ede3-40fe-9f86-4067d413fb7b tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/75cc31da-e7e5-4240-a210-5eb77dff70d3" status: 404 len: 110 microversion: 2.53 time: 0.050238 Oct 05 02:27:19.249922 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 70/152] 10.222.0.16 () {62 vars in 1309 bytes} [Wed Oct 5 02:27:19 2022] PUT /compute/v2.1/os-services/75cc31da-e7e5-4240-a210-5eb77dff70d3 => generated 110 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:27:19.261183 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-92843ee1-bbb5-47ed-b753-61cc6a35a601 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Action: 'update', calling method: .version_select at 0x7fcce4bbe670>, body: {"status": "enabled"} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:19.264719 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92843ee1-bbb5-47ed-b753-61cc6a35a601 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:19.265240 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92843ee1-bbb5-47ed-b753-61cc6a35a601 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:19.265752 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92843ee1-bbb5-47ed-b753-61cc6a35a601 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:19.272752 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92843ee1-bbb5-47ed-b753-61cc6a35a601 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:19.273362 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92843ee1-bbb5-47ed-b753-61cc6a35a601 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:19.273881 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92843ee1-bbb5-47ed-b753-61cc6a35a601 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:19.280132 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-92843ee1-bbb5-47ed-b753-61cc6a35a601 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] HTTP exception thrown: Service 75cc31da-e7e5-4240-a210-5eb77dff70d3 could not be found. Oct 05 02:27:19.282253 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-92843ee1-bbb5-47ed-b753-61cc6a35a601 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Request method failure captured: Oct 05 02:27:19.282253 n-d-858272-3 devstack@n-api.service[122319]: request: PUT /compute/v2.1/os-services/75cc31da-e7e5-4240-a210-5eb77dff70d3 HTTP/1.1 Oct 05 02:27:19.282253 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:27:19.282253 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:27:19.282253 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:27:19.282253 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 21 Oct 05 02:27:19.282253 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:27:19.282253 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:27:19.282253 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:27:19.282253 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:19.282253 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOuGAWXI0-gf7nNAuvXDMkLXlIvCebDCSjC1f1aGW0NA4Evrwehut8mwDDwIdGwNyzc43fKKFMdC590FQrc17oGGQEtSDP6UMzMkbmDWvSIBnai_5V2WCZNBpvJcDgpmbQxDAdVjPO_QG3rcfH6baeB82SA5kCm5pCkM9rul1xS5C7s Oct 05 02:27:19.282253 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:27:19.282253 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:27:19.282253 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:27:19.282253 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:27:19.282253 n-d-858272-3 devstack@n-api.service[122319]: X-Openstack-Nova-Api-Version: 2.53 Oct 05 02:27:19.282253 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:27:19.282253 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:27:19.282253 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 3c48ec22ea5343f09d2e834aa1fefc4e Oct 05 02:27:19.282253 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2031564725 Oct 05 02:27:19.282253 n-d-858272-3 devstack@n-api.service[122319]: X-Role: admin,member,reader Oct 05 02:27:19.282253 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: admin,member,reader Oct 05 02:27:19.283821 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3c48ec22ea5343f09d2e834aa1fefc4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3c48ec22ea5343f09d2e834aa1fefc4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3c48ec22ea5343f09d2e834aa1fefc4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3c48ec22ea5343f09d2e834aa1fefc4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:19.283821 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2031564725 Oct 05 02:27:19.283821 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 3c48ec22ea5343f09d2e834aa1fefc4e Oct 05 02:27:19.283821 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2031564725 Oct 05 02:27:19.283821 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin Oct 05 02:27:19.283821 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:27:19.283821 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:27:19.283821 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 091eb9f59fd1404cb3376b71607a9a6b Oct 05 02:27:19.283821 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin Oct 05 02:27:19.283821 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:27:19.283821 n-d-858272-3 devstack@n-api.service[122319]: {"status": "enabled"} Oct 05 02:27:19.283821 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:27:19.283821 n-d-858272-3 devstack@n-api.service[122319]: exception: Service 75cc31da-e7e5-4240-a210-5eb77dff70d3 could not be found. Oct 05 02:27:19.283821 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '75cc31da-e7e5-4240-a210-5eb77dff70d3', 'body': {'status': 'enabled'}} Oct 05 02:27:19.284820 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:19.284820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:19.284820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 05 02:27:19.284820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 05 02:27:19.284820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 05 02:27:19.284820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 05 02:27:19.284820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 05 02:27:19.284820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:19.284820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:19.284820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:19.284820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:19.284820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 05 02:27:19.284820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 05 02:27:19.284820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 05 02:27:19.284820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:27:19.284820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 75cc31da-e7e5-4240-a210-5eb77dff70d3 could not be found. Oct 05 02:27:19.284820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:19.284820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:19.284820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:19.284820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:19.284820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:19.285996 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:19.285996 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:19.285996 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:19.285996 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:27:19.285996 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:27:19.285996 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:19.285996 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:19.285996 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:27:19.285996 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:27:19.285996 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 05 02:27:19.285996 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:27:19.285996 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 75cc31da-e7e5-4240-a210-5eb77dff70d3 could not be found. Oct 05 02:27:19.285996 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:19.285996 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:19.285996 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:19.285996 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:19.285996 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:19.285996 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:19.285996 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:27:19.285996 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:27:19.287278 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 75cc31da-e7e5-4240-a210-5eb77dff70d3 could not be found. Oct 05 02:27:19.287278 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:19.287278 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-92843ee1-bbb5-47ed-b753-61cc6a35a601 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Returning 404 to user: Service 75cc31da-e7e5-4240-a210-5eb77dff70d3 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:19.287278 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-92843ee1-bbb5-47ed-b753-61cc6a35a601 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/75cc31da-e7e5-4240-a210-5eb77dff70d3" status: 404 len: 110 microversion: 2.53 time: 0.027226 Oct 05 02:27:19.287278 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 83/153] 10.222.0.16 () {62 vars in 1309 bytes} [Wed Oct 5 02:27:19 2022] PUT /compute/v2.1/os-services/75cc31da-e7e5-4240-a210-5eb77dff70d3 => generated 110 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:27:19.295435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-92d3fcef-fdb9-483a-a428-d9573b919bb9 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:19.299786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92d3fcef-fdb9-483a-a428-d9573b919bb9 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:19.301752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92d3fcef-fdb9-483a-a428-d9573b919bb9 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:19.302385 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92d3fcef-fdb9-483a-a428-d9573b919bb9 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:19.303155 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92d3fcef-fdb9-483a-a428-d9573b919bb9 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:19.304936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92d3fcef-fdb9-483a-a428-d9573b919bb9 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:19.305556 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92d3fcef-fdb9-483a-a428-d9573b919bb9 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:19.338530 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-92d3fcef-fdb9-483a-a428-d9573b919bb9 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1261 microversion: 2.53 time: 0.047521 Oct 05 02:27:19.339480 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 71/154] 10.222.0.16 () {60 vars in 1178 bytes} [Wed Oct 5 02:27:19 2022] GET /compute/v2.1/os-services => generated 1261 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:27:19.358532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d01a7a5e-986d-4f10-8bf9-6a624eac6b07 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:19.365847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d01a7a5e-986d-4f10-8bf9-6a624eac6b07 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:19.366609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d01a7a5e-986d-4f10-8bf9-6a624eac6b07 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:19.367287 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d01a7a5e-986d-4f10-8bf9-6a624eac6b07 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:19.368332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d01a7a5e-986d-4f10-8bf9-6a624eac6b07 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:19.369409 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d01a7a5e-986d-4f10-8bf9-6a624eac6b07 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:19.370023 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d01a7a5e-986d-4f10-8bf9-6a624eac6b07 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:19.407995 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d01a7a5e-986d-4f10-8bf9-6a624eac6b07 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1261 microversion: 2.53 time: 0.053099 Oct 05 02:27:19.417098 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 84/155] 10.222.0.16 () {60 vars in 1211 bytes} [Wed Oct 5 02:27:19 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1261 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:27:19.424788 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ad0c9188-6ab4-474b-b25d-8c8bd9fda022 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:19.429103 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad0c9188-6ab4-474b-b25d-8c8bd9fda022 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:19.429604 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad0c9188-6ab4-474b-b25d-8c8bd9fda022 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:19.430049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad0c9188-6ab4-474b-b25d-8c8bd9fda022 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:19.430786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad0c9188-6ab4-474b-b25d-8c8bd9fda022 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:19.431240 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad0c9188-6ab4-474b-b25d-8c8bd9fda022 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:19.437356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad0c9188-6ab4-474b-b25d-8c8bd9fda022 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:19.480969 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ad0c9188-6ab4-474b-b25d-8c8bd9fda022 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1261 microversion: 2.53 time: 0.059766 Oct 05 02:27:19.481986 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 72/156] 10.222.0.16 () {60 vars in 1178 bytes} [Wed Oct 5 02:27:19 2022] GET /compute/v2.1/os-services => generated 1261 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:27:19.500399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9193c1d9-7b84-4299-b7b0-580d6ebc67b2 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:19.505259 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9193c1d9-7b84-4299-b7b0-580d6ebc67b2 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:19.505970 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9193c1d9-7b84-4299-b7b0-580d6ebc67b2 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:19.506660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9193c1d9-7b84-4299-b7b0-580d6ebc67b2 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:19.507601 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9193c1d9-7b84-4299-b7b0-580d6ebc67b2 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:19.508387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9193c1d9-7b84-4299-b7b0-580d6ebc67b2 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:19.509178 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9193c1d9-7b84-4299-b7b0-580d6ebc67b2 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:19.537354 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9193c1d9-7b84-4299-b7b0-580d6ebc67b2 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=n-d-858272-3&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.040517 Oct 05 02:27:19.538555 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 85/157] 10.222.0.16 () {60 vars in 1235 bytes} [Wed Oct 5 02:27:19 2022] GET /compute/v2.1/os-services?host=n-d-858272-3&binary=xxx => generated 16 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:19.550610 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b4543c11-b22c-4642-b3f8-d8cdacfff998 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:19.555721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4543c11-b22c-4642-b3f8-d8cdacfff998 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:19.556561 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4543c11-b22c-4642-b3f8-d8cdacfff998 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:19.557259 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4543c11-b22c-4642-b3f8-d8cdacfff998 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:19.558817 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4543c11-b22c-4642-b3f8-d8cdacfff998 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:19.559385 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4543c11-b22c-4642-b3f8-d8cdacfff998 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:19.559917 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4543c11-b22c-4642-b3f8-d8cdacfff998 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:19.587064 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b4543c11-b22c-4642-b3f8-d8cdacfff998 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1261 microversion: 2.53 time: 0.040087 Oct 05 02:27:19.588190 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 73/158] 10.222.0.16 () {60 vars in 1178 bytes} [Wed Oct 5 02:27:19 2022] GET /compute/v2.1/os-services => generated 1261 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:27:19.603130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b7fbf3ad-525c-44d3-a2cc-c6141d70edd5 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:19.607088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7fbf3ad-525c-44d3-a2cc-c6141d70edd5 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:19.608748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7fbf3ad-525c-44d3-a2cc-c6141d70edd5 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:19.617604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7fbf3ad-525c-44d3-a2cc-c6141d70edd5 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:19.619515 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7fbf3ad-525c-44d3-a2cc-c6141d70edd5 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:19.621200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7fbf3ad-525c-44d3-a2cc-c6141d70edd5 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:19.621751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7fbf3ad-525c-44d3-a2cc-c6141d70edd5 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:19.672427 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b7fbf3ad-525c-44d3-a2cc-c6141d70edd5 tempest-ServicesAdminNegativeV253TestJSON-2031564725 tempest-ServicesAdminNegativeV253TestJSON-2031564725-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.53 time: 0.072795 Oct 05 02:27:19.683679 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 86/159] 10.222.0.16 () {60 vars in 1239 bytes} [Wed Oct 5 02:27:19 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:19.884963 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-aefadbb1-da78-4f6b-a932-6d8eb5da7e3a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:19.886105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-aefadbb1-da78-4f6b-a932-6d8eb5da7e3a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: c9ea1283-2889-4a96-bee8-b2b99509ed59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:19.901203 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aefadbb1-da78-4f6b-a932-6d8eb5da7e3a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:19.901767 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aefadbb1-da78-4f6b-a932-6d8eb5da7e3a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:19.904059 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aefadbb1-da78-4f6b-a932-6d8eb5da7e3a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:19.904815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aefadbb1-da78-4f6b-a932-6d8eb5da7e3a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:19.909472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aefadbb1-da78-4f6b-a932-6d8eb5da7e3a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:19.910653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f521fd0b-91a3-4f04-b239-164e0910acfd tempest-ServicesAdminNegativeV253TestJSON-1495970410 tempest-ServicesAdminNegativeV253TestJSON-1495970410-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:19.912404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aefadbb1-da78-4f6b-a932-6d8eb5da7e3a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:19.918121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f521fd0b-91a3-4f04-b239-164e0910acfd tempest-ServicesAdminNegativeV253TestJSON-1495970410 tempest-ServicesAdminNegativeV253TestJSON-1495970410-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'b08ae6abe63f453b892ddfc294e00044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a93c3456d1044bdb8051a602034f222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:19.920298 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f521fd0b-91a3-4f04-b239-164e0910acfd tempest-ServicesAdminNegativeV253TestJSON-1495970410 tempest-ServicesAdminNegativeV253TestJSON-1495970410-project] Request method failure captured: Oct 05 02:27:19.920298 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 05 02:27:19.920298 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:27:19.920298 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:27:19.920298 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:27:19.920298 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:27:19.920298 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:27:19.920298 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:27:19.920298 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:27:19.920298 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:19.920298 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOuF26mHLe-_Dt4G8boxWS_gNQ9uZ2MkE6JLmBfPDTJrIFsWQpp7jkH7t5Scy8-lrICAoGl5vePCruIAPJJQVKpxGNvItLRGYYK_VwIfutj4vJhqWpDxrgOO_dLbPlgs4lva464p8tQVK58a8WIxdaOsQV4ZOrfR80Bo4HvQTDCMr3o Oct 05 02:27:19.920298 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:27:19.920298 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:27:19.920298 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:27:19.920298 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:27:19.920298 n-d-858272-3 devstack@n-api.service[122320]: X-Openstack-Nova-Api-Version: 2.53 Oct 05 02:27:19.920298 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:27:19.920298 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:27:19.920298 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 5a93c3456d1044bdb8051a602034f222 Oct 05 02:27:19.920298 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1495970410 Oct 05 02:27:19.920298 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:27:19.920298 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:27:19.921838 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a93c3456d1044bdb8051a602034f222"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a93c3456d1044bdb8051a602034f222"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a93c3456d1044bdb8051a602034f222"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a93c3456d1044bdb8051a602034f222"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:19.921838 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1495970410 Oct 05 02:27:19.921838 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 5a93c3456d1044bdb8051a602034f222 Oct 05 02:27:19.921838 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1495970410 Oct 05 02:27:19.921838 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1495970410-project Oct 05 02:27:19.921838 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:27:19.921838 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:27:19.921838 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: b08ae6abe63f453b892ddfc294e00044 Oct 05 02:27:19.921838 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1495970410-project Oct 05 02:27:19.921838 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:27:19.921838 n-d-858272-3 devstack@n-api.service[122320]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 05 02:27:19.921838 n-d-858272-3 devstack@n-api.service[122320]: action_args: {} Oct 05 02:27:19.922653 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:19.922653 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:19.922653 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:19.922653 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:19.922653 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:19.922653 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:19.922653 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 02:27:19.922653 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:27:19.922653 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 02:27:19.922653 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:27:19.922653 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:19.922653 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:19.922653 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 05 02:27:19.922653 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 05 02:27:19.922653 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 02:27:19.922653 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 02:27:19.922653 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 02:27:19.922653 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 02:27:19.922653 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:27:19.923866 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:27:19.923866 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:27:19.923866 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:27:19.923866 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 02:27:19.923866 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 02:27:19.923866 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 02:27:19.923866 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 02:27:19.923866 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:27:19.923866 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 02:27:19.923866 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 05 02:27:19.923866 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:19.923866 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:19.923866 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:19.923866 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:19.923866 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:19.923866 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:19.923866 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 02:27:19.923866 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 02:27:19.923866 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 05 02:27:19.923866 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:19.928675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f521fd0b-91a3-4f04-b239-164e0910acfd tempest-ServicesAdminNegativeV253TestJSON-1495970410 tempest-ServicesAdminNegativeV253TestJSON-1495970410-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:19.930655 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f521fd0b-91a3-4f04-b239-164e0910acfd tempest-ServicesAdminNegativeV253TestJSON-1495970410 tempest-ServicesAdminNegativeV253TestJSON-1495970410-project] 10.222.0.16 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.246803 Oct 05 02:27:19.932522 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 74/160] 10.222.0.16 () {60 vars in 1178 bytes} [Wed Oct 5 02:27:19 2022] GET /compute/v2.1/os-services => generated 112 bytes in 250 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:27:20.013478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-80178a8c-9e9a-4555-8958-6bde97215cf8 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:20.019793 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-80178a8c-9e9a-4555-8958-6bde97215cf8 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:20.039191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-80178a8c-9e9a-4555-8958-6bde97215cf8 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:20.040511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-80178a8c-9e9a-4555-8958-6bde97215cf8 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:20.041946 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-80178a8c-9e9a-4555-8958-6bde97215cf8 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:20.046550 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-80178a8c-9e9a-4555-8958-6bde97215cf8 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:20.047260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-80178a8c-9e9a-4555-8958-6bde97215cf8 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:20.048177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-80178a8c-9e9a-4555-8958-6bde97215cf8 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:20.348570 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-aefadbb1-da78-4f6b-a932-6d8eb5da7e3a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:20.357860 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-aefadbb1-da78-4f6b-a932-6d8eb5da7e3a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59" status: 200 len: 1320 microversion: 2.1 time: 0.477286 Oct 05 02:27:20.369480 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 87/161] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:19 2022] GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59 => generated 1320 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:20.449779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-80178a8c-9e9a-4555-8958-6bde97215cf8 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aebce7113c4e8980490aa0b0fbb296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b7bb601bea47d88c9ad68be2651451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:20.464924 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-80178a8c-9e9a-4555-8958-6bde97215cf8 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] 10.222.0.16 "GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9" status: 200 len: 1339 microversion: 2.1 time: 0.465428 Oct 05 02:27:20.468012 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 75/162] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:19 2022] GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 => generated 1339 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:21.397530 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-551858d7-0360-4902-96d9-19946079357c tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:21.398227 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-551858d7-0360-4902-96d9-19946079357c tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: c9ea1283-2889-4a96-bee8-b2b99509ed59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:21.406972 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-551858d7-0360-4902-96d9-19946079357c tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:21.407691 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-551858d7-0360-4902-96d9-19946079357c tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:21.408993 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-551858d7-0360-4902-96d9-19946079357c tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:21.411836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-551858d7-0360-4902-96d9-19946079357c tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:21.413115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-551858d7-0360-4902-96d9-19946079357c tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:21.413737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-551858d7-0360-4902-96d9-19946079357c tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:21.494492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-401756bd-4564-4b02-982d-ccdfd064fd82 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:21.496257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-401756bd-4564-4b02-982d-ccdfd064fd82 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:21.506770 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-401756bd-4564-4b02-982d-ccdfd064fd82 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:21.508112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-401756bd-4564-4b02-982d-ccdfd064fd82 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:21.508824 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-401756bd-4564-4b02-982d-ccdfd064fd82 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:21.510588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-401756bd-4564-4b02-982d-ccdfd064fd82 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:21.511249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-401756bd-4564-4b02-982d-ccdfd064fd82 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:21.512699 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-401756bd-4564-4b02-982d-ccdfd064fd82 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:21.981775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-551858d7-0360-4902-96d9-19946079357c tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:21.991526 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-551858d7-0360-4902-96d9-19946079357c tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59" status: 200 len: 1320 microversion: 2.1 time: 0.598068 Oct 05 02:27:22.014849 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 88/163] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:21 2022] GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59 => generated 1320 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:22.052574 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-401756bd-4564-4b02-982d-ccdfd064fd82 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aebce7113c4e8980490aa0b0fbb296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b7bb601bea47d88c9ad68be2651451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:22.065284 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-401756bd-4564-4b02-982d-ccdfd064fd82 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] 10.222.0.16 "GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9" status: 200 len: 1339 microversion: 2.1 time: 0.572450 Oct 05 02:27:22.067611 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 76/164] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:21 2022] GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 => generated 1339 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:27:22.328744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-55ab5e15-1636-4a88-9410-e62384c17937 req-d973fcc8-67d5-4f1c-b232-4dad9ff688b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9ea1283-2889-4a96-bee8-b2b99509ed59", "name": "network-vif-plugged", "status": "completed", "tag": "a955fb2f-e0a3-488e-9626-53db651f09eb"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:22.388712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-55ab5e15-1636-4a88-9410-e62384c17937 req-d973fcc8-67d5-4f1c-b232-4dad9ff688b6 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:22.392264 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-55ab5e15-1636-4a88-9410-e62384c17937 req-d973fcc8-67d5-4f1c-b232-4dad9ff688b6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:22.394135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-55ab5e15-1636-4a88-9410-e62384c17937 req-d973fcc8-67d5-4f1c-b232-4dad9ff688b6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:22.470168 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-55ab5e15-1636-4a88-9410-e62384c17937 req-d973fcc8-67d5-4f1c-b232-4dad9ff688b6 service nova] Creating event network-vif-plugged:a955fb2f-e0a3-488e-9626-53db651f09eb for instance c9ea1283-2889-4a96-bee8-b2b99509ed59 on n-h1-858272-3 Oct 05 02:27:22.471042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-55ab5e15-1636-4a88-9410-e62384c17937 req-d973fcc8-67d5-4f1c-b232-4dad9ff688b6 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122319) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 05 02:27:22.477286 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-55ab5e15-1636-4a88-9410-e62384c17937 req-d973fcc8-67d5-4f1c-b232-4dad9ff688b6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122319) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 05 02:27:22.482652 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2efb91de-9b8b-4826-a918-db8264469ddc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:22.483160 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2efb91de-9b8b-4826-a918-db8264469ddc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:22.483609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2efb91de-9b8b-4826-a918-db8264469ddc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:22.484495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2efb91de-9b8b-4826-a918-db8264469ddc None None] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:22.485027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2efb91de-9b8b-4826-a918-db8264469ddc None None] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:22.485466 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2efb91de-9b8b-4826-a918-db8264469ddc None None] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:22.508228 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.compute.rpcapi [None req-2efb91de-9b8b-4826-a918-db8264469ddc None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 05 02:27:22.509169 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2efb91de-9b8b-4826-a918-db8264469ddc None None] Releasing lock "compute-rpcapi-router" {{(pid=122319) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 05 02:27:22.546942 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2efb91de-9b8b-4826-a918-db8264469ddc None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.529914 Oct 05 02:27:22.547686 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 89/165] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:23.019938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-73b8113e-6e4d-41ea-9567-06eda1fb11ed tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:23.021905 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-73b8113e-6e4d-41ea-9567-06eda1fb11ed tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: c9ea1283-2889-4a96-bee8-b2b99509ed59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:23.028679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-73b8113e-6e4d-41ea-9567-06eda1fb11ed tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:23.029405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-73b8113e-6e4d-41ea-9567-06eda1fb11ed tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:23.030008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-73b8113e-6e4d-41ea-9567-06eda1fb11ed tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:23.033364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-73b8113e-6e4d-41ea-9567-06eda1fb11ed tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:23.034032 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-73b8113e-6e4d-41ea-9567-06eda1fb11ed tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:23.034749 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-73b8113e-6e4d-41ea-9567-06eda1fb11ed tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:23.093776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-20794b72-b3fc-4c26-b3b8-69794f9d337f tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:23.094756 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-20794b72-b3fc-4c26-b3b8-69794f9d337f tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:23.109024 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20794b72-b3fc-4c26-b3b8-69794f9d337f tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:23.115193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20794b72-b3fc-4c26-b3b8-69794f9d337f tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:23.118763 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20794b72-b3fc-4c26-b3b8-69794f9d337f tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:23.121041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20794b72-b3fc-4c26-b3b8-69794f9d337f tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:23.125823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20794b72-b3fc-4c26-b3b8-69794f9d337f tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:23.128968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20794b72-b3fc-4c26-b3b8-69794f9d337f tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:23.639270 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-73b8113e-6e4d-41ea-9567-06eda1fb11ed tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:23.648244 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-73b8113e-6e4d-41ea-9567-06eda1fb11ed tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59" status: 200 len: 1320 microversion: 2.1 time: 0.632870 Oct 05 02:27:23.649531 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 77/166] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:23 2022] GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59 => generated 1320 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:23.687222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-20794b72-b3fc-4c26-b3b8-69794f9d337f tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aebce7113c4e8980490aa0b0fbb296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b7bb601bea47d88c9ad68be2651451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:23.705549 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-20794b72-b3fc-4c26-b3b8-69794f9d337f tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] 10.222.0.16 "GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9" status: 200 len: 1339 microversion: 2.1 time: 0.616428 Oct 05 02:27:23.717327 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 90/167] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:23 2022] GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 => generated 1339 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:24.663865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-e3901823-ff43-4a6f-997b-466d8a37467b req-2d669cd5-5927-49bd-bdb2-6e9abe295cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9", "name": "network-vif-plugged", "status": "completed", "tag": "12fcbb82-bf50-4f96-a97d-4882d900cc55"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:24.672136 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a33b018d-f98e-46ec-b032-68921c20c114 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:24.673121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a33b018d-f98e-46ec-b032-68921c20c114 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: c9ea1283-2889-4a96-bee8-b2b99509ed59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:24.697868 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a33b018d-f98e-46ec-b032-68921c20c114 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:24.698425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a33b018d-f98e-46ec-b032-68921c20c114 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:24.698804 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a33b018d-f98e-46ec-b032-68921c20c114 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:24.699444 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e3901823-ff43-4a6f-997b-466d8a37467b req-2d669cd5-5927-49bd-bdb2-6e9abe295cf4 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:24.699950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e3901823-ff43-4a6f-997b-466d8a37467b req-2d669cd5-5927-49bd-bdb2-6e9abe295cf4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:24.700385 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e3901823-ff43-4a6f-997b-466d8a37467b req-2d669cd5-5927-49bd-bdb2-6e9abe295cf4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:24.703267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a33b018d-f98e-46ec-b032-68921c20c114 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:24.703764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a33b018d-f98e-46ec-b032-68921c20c114 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:24.704193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a33b018d-f98e-46ec-b032-68921c20c114 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:24.730566 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-e3901823-ff43-4a6f-997b-466d8a37467b req-2d669cd5-5927-49bd-bdb2-6e9abe295cf4 service nova] Creating event network-vif-plugged:12fcbb82-bf50-4f96-a97d-4882d900cc55 for instance 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 on n-h2-858272-3 Oct 05 02:27:24.750891 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-e3901823-ff43-4a6f-997b-466d8a37467b req-2d669cd5-5927-49bd-bdb2-6e9abe295cf4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091403 Oct 05 02:27:24.752161 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 78/168] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:24.761693 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-24afd4a6-c94c-4bc5-8b4c-9c78d461b79b tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:24.763027 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-24afd4a6-c94c-4bc5-8b4c-9c78d461b79b tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:24.771374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24afd4a6-c94c-4bc5-8b4c-9c78d461b79b tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:24.771971 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24afd4a6-c94c-4bc5-8b4c-9c78d461b79b tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:24.772778 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24afd4a6-c94c-4bc5-8b4c-9c78d461b79b tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:24.773710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24afd4a6-c94c-4bc5-8b4c-9c78d461b79b tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:24.774391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24afd4a6-c94c-4bc5-8b4c-9c78d461b79b tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:24.775207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24afd4a6-c94c-4bc5-8b4c-9c78d461b79b tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:25.025321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a33b018d-f98e-46ec-b032-68921c20c114 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:25.037069 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a33b018d-f98e-46ec-b032-68921c20c114 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59" status: 200 len: 1320 microversion: 2.1 time: 0.368696 Oct 05 02:27:25.048925 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 91/169] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:24 2022] GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59 => generated 1320 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:25.057078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-24afd4a6-c94c-4bc5-8b4c-9c78d461b79b tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aebce7113c4e8980490aa0b0fbb296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b7bb601bea47d88c9ad68be2651451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:25.065633 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-24afd4a6-c94c-4bc5-8b4c-9c78d461b79b tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] 10.222.0.16 "GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9" status: 200 len: 1339 microversion: 2.1 time: 0.312124 Oct 05 02:27:25.073793 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 79/170] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:24 2022] GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 => generated 1339 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:25.225502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0b6ab8cf-1cd1-45ad-bf2a-988bfc6d2ab3 tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:25.237627 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0b6ab8cf-1cd1-45ad-bf2a-988bfc6d2ab3 tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.196875 Oct 05 02:27:25.239185 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 92/171] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 5 02:27:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:25.252321 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2a39d060-e93d-4b28-8145-29e4deefc2b6 tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:25.274613 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2a39d060-e93d-4b28-8145-29e4deefc2b6 tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.026273 Oct 05 02:27:25.290054 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-acfd1bc0-2870-49b0-bab8-9c8c0f619038 tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:25.296593 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 80/172] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 5 02:27:25 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:25.302567 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-acfd1bc0-2870-49b0-bab8-9c8c0f619038 tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015922 Oct 05 02:27:25.317289 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d9af01d6-0d56-40ee-8839-973e938e0dcf tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:25.320266 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 93/173] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 5 02:27:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:25.326184 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d9af01d6-0d56-40ee-8839-973e938e0dcf tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013306 Oct 05 02:27:25.340314 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b8b8d085-7993-45da-9fcc-5903d3f28f00 tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:25.345360 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 81/174] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 5 02:27:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:25.372325 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b8b8d085-7993-45da-9fcc-5903d3f28f00 tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.035808 Oct 05 02:27:25.392664 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-df49874b-aa1c-4884-aa35-ccc08e3cd982 tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:25.399696 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 94/175] 10.222.0.16 () {58 vars in 1165 bytes} [Wed Oct 5 02:27:25 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:25.403553 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-df49874b-aa1c-4884-aa35-ccc08e3cd982 tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016200 Oct 05 02:27:25.418098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cc8c7e25-f1f4-4614-964c-7383b3ada687 tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:25.418592 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 82/176] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 5 02:27:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:25.452231 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cc8c7e25-f1f4-4614-964c-7383b3ada687 tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.038883 Oct 05 02:27:25.462658 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 95/177] 10.222.0.16 () {58 vars in 1169 bytes} [Wed Oct 5 02:27:25 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:25.470673 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7b5eec4b-e368-4eb8-a0f2-449823fa6612 tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:25.484875 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7b5eec4b-e368-4eb8-a0f2-449823fa6612 tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.018158 Oct 05 02:27:25.500083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7179fe93-b725-42b0-8d68-53c12b469f3a tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:25.506589 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 83/178] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 5 02:27:25 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:25.509295 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7179fe93-b725-42b0-8d68-53c12b469f3a tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013109 Oct 05 02:27:25.522317 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 96/179] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 5 02:27:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:25.524201 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3ecc8c31-d3d8-405b-8197-c33233ea65cc tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:25.564627 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3ecc8c31-d3d8-405b-8197-c33233ea65cc tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.046134 Oct 05 02:27:25.583552 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-788e11fd-509d-4c38-a734-a3e8142ab2ed tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:25.589001 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 84/180] 10.222.0.16 () {58 vars in 1167 bytes} [Wed Oct 5 02:27:25 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:27:25.593557 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-788e11fd-509d-4c38-a734-a3e8142ab2ed tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015348 Oct 05 02:27:25.601931 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 97/181] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 5 02:27:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:25.627916 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-59dcbcfb-7419-4dc8-9d77-3eb333281e3e tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:25.684779 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-59dcbcfb-7419-4dc8-9d77-3eb333281e3e tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] 10.222.0.16 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.073847 Oct 05 02:27:25.695352 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 85/182] 10.222.0.16 () {58 vars in 1144 bytes} [Wed Oct 5 02:27:25 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:25.703158 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-204a9932-b9fa-4d04-9e46-5aa8ffcd12b4 tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:25.727619 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-204a9932-b9fa-4d04-9e46-5aa8ffcd12b4 tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023189 Oct 05 02:27:25.735404 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 98/183] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 5 02:27:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:25.750595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-be3d5798-a0a2-4fce-82ef-7c7218971933 tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:25.824833 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-be3d5798-a0a2-4fce-82ef-7c7218971933 tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] 10.222.0.16 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.088154 Oct 05 02:27:25.828609 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 86/184] 10.222.0.16 () {58 vars in 1148 bytes} [Wed Oct 5 02:27:25 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:25.844477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ee5a1e24-726d-45ac-a040-928050402073 tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:25.871501 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ee5a1e24-726d-45ac-a040-928050402073 tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] 10.222.0.16 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.031013 Oct 05 02:27:25.872681 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 99/185] 10.222.0.16 () {58 vars in 1140 bytes} [Wed Oct 5 02:27:25 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:25.885862 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1a692e35-24e7-4c7f-8ff2-6789a8819bc3 tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:25.903193 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1a692e35-24e7-4c7f-8ff2-6789a8819bc3 tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020478 Oct 05 02:27:25.905656 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 87/186] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 5 02:27:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:25.918386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4a6a5a93-51a3-4f3c-93fb-86f6435285ce tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:25.946383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:26.004055 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4a6a5a93-51a3-4f3c-93fb-86f6435285ce tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] 10.222.0.16 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.089127 Oct 05 02:27:26.012275 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 100/187] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:27:25 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:26.025913 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3d8bfc31-ae30-4623-9444-19fd9260ad91 tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:26.062441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-32e1697f-5939-4550-ad85-217db744848a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:26.063748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-32e1697f-5939-4550-ad85-217db744848a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: c9ea1283-2889-4a96-bee8-b2b99509ed59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:26.079483 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3d8bfc31-ae30-4623-9444-19fd9260ad91 tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058457 Oct 05 02:27:26.081077 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 88/188] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:27:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:26.085692 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32e1697f-5939-4550-ad85-217db744848a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:26.086280 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32e1697f-5939-4550-ad85-217db744848a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:26.086732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32e1697f-5939-4550-ad85-217db744848a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:26.087473 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32e1697f-5939-4550-ad85-217db744848a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:26.087929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32e1697f-5939-4550-ad85-217db744848a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:26.092700 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32e1697f-5939-4550-ad85-217db744848a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:26.099857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1e8248ca-abae-4a06-97a6-1a2c5931becb tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:26.100466 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1e8248ca-abae-4a06-97a6-1a2c5931becb tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:26.126517 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=93 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:26.128011 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e8248ca-abae-4a06-97a6-1a2c5931becb tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:26.128540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e8248ca-abae-4a06-97a6-1a2c5931becb tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:26.128990 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e8248ca-abae-4a06-97a6-1a2c5931becb tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:26.129697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e8248ca-abae-4a06-97a6-1a2c5931becb tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:26.130200 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e8248ca-abae-4a06-97a6-1a2c5931becb tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:26.130618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e8248ca-abae-4a06-97a6-1a2c5931becb tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:26.587322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-32e1697f-5939-4550-ad85-217db744848a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:26.595310 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-32e1697f-5939-4550-ad85-217db744848a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59" status: 200 len: 1469 microversion: 2.1 time: 0.538278 Oct 05 02:27:26.614278 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 101/189] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:26 2022] GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59 => generated 1469 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:26.619475 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0ad7a2af-e2d7-4251-b5de-80b35596d5d4 tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:26.626747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1e8248ca-abae-4a06-97a6-1a2c5931becb tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aebce7113c4e8980490aa0b0fbb296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b7bb601bea47d88c9ad68be2651451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:26.628061 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0ad7a2af-e2d7-4251-b5de-80b35596d5d4 tempest-FlavorsV2TestJSON-508806917 tempest-FlavorsV2TestJSON-508806917-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012391 Oct 05 02:27:26.637492 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 102/190] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 5 02:27:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:26.640827 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1e8248ca-abae-4a06-97a6-1a2c5931becb tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] 10.222.0.16 "GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9" status: 200 len: 1339 microversion: 2.1 time: 0.543610 Oct 05 02:27:26.649499 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 89/191] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:26 2022] GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 => generated 1339 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:26.865300 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9005547e-b2f3-4fd0-812c-8f0ea137615a tempest-DeleteServersAdminTestJSON-1521400760 tempest-DeleteServersAdminTestJSON-1521400760-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:26.866148 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9005547e-b2f3-4fd0-812c-8f0ea137615a tempest-DeleteServersAdminTestJSON-1521400760 tempest-DeleteServersAdminTestJSON-1521400760-project-admin] [instance: c9ea1283-2889-4a96-bee8-b2b99509ed59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:26.900427 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9005547e-b2f3-4fd0-812c-8f0ea137615a tempest-DeleteServersAdminTestJSON-1521400760 tempest-DeleteServersAdminTestJSON-1521400760-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:26.901959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9005547e-b2f3-4fd0-812c-8f0ea137615a tempest-DeleteServersAdminTestJSON-1521400760 tempest-DeleteServersAdminTestJSON-1521400760-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:26.905826 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9005547e-b2f3-4fd0-812c-8f0ea137615a tempest-DeleteServersAdminTestJSON-1521400760 tempest-DeleteServersAdminTestJSON-1521400760-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:26.906867 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9005547e-b2f3-4fd0-812c-8f0ea137615a tempest-DeleteServersAdminTestJSON-1521400760 tempest-DeleteServersAdminTestJSON-1521400760-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:26.907505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9005547e-b2f3-4fd0-812c-8f0ea137615a tempest-DeleteServersAdminTestJSON-1521400760 tempest-DeleteServersAdminTestJSON-1521400760-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:26.908978 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9005547e-b2f3-4fd0-812c-8f0ea137615a tempest-DeleteServersAdminTestJSON-1521400760 tempest-DeleteServersAdminTestJSON-1521400760-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:27.088749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9005547e-b2f3-4fd0-812c-8f0ea137615a tempest-DeleteServersAdminTestJSON-1521400760 tempest-DeleteServersAdminTestJSON-1521400760-project-admin] [instance: c9ea1283-2889-4a96-bee8-b2b99509ed59] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:27:27.106065 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:27.425291 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9005547e-b2f3-4fd0-812c-8f0ea137615a tempest-DeleteServersAdminTestJSON-1521400760 tempest-DeleteServersAdminTestJSON-1521400760-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59" status: 204 len: 0 microversion: 2.1 time: 0.784895 Oct 05 02:27:27.431897 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 103/192] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:27:26 2022] DELETE /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59 => generated 0 bytes in 791 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:27:27.437151 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4b6a5353-1594-4533-a15c-225b7af21695 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:27.437763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4b6a5353-1594-4533-a15c-225b7af21695 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: c9ea1283-2889-4a96-bee8-b2b99509ed59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:27.447517 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b6a5353-1594-4533-a15c-225b7af21695 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:27.452337 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b6a5353-1594-4533-a15c-225b7af21695 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:27.454419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b6a5353-1594-4533-a15c-225b7af21695 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:27.457892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b6a5353-1594-4533-a15c-225b7af21695 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:27.458374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b6a5353-1594-4533-a15c-225b7af21695 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:27.458807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b6a5353-1594-4533-a15c-225b7af21695 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:27.672339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-68e6d55d-e30b-4669-91d3-f41fd02fbe23 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:27.673305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-68e6d55d-e30b-4669-91d3-f41fd02fbe23 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:27.689749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68e6d55d-e30b-4669-91d3-f41fd02fbe23 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:27.690717 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68e6d55d-e30b-4669-91d3-f41fd02fbe23 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:27.691557 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68e6d55d-e30b-4669-91d3-f41fd02fbe23 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:27.692701 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68e6d55d-e30b-4669-91d3-f41fd02fbe23 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:27.694616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68e6d55d-e30b-4669-91d3-f41fd02fbe23 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:27.696388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68e6d55d-e30b-4669-91d3-f41fd02fbe23 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:27.857569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:28.201295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-68e6d55d-e30b-4669-91d3-f41fd02fbe23 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aebce7113c4e8980490aa0b0fbb296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b7bb601bea47d88c9ad68be2651451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:28.213678 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-68e6d55d-e30b-4669-91d3-f41fd02fbe23 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] 10.222.0.16 "GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9" status: 200 len: 1489 microversion: 2.1 time: 0.550104 Oct 05 02:27:28.214609 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 104/193] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:27 2022] GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 => generated 1489 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:27:28.232788 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4b6a5353-1594-4533-a15c-225b7af21695 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:28.241045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-94dbe606-cce8-4d34-88e9-19e9e0574c68 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:28.241576 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-94dbe606-cce8-4d34-88e9-19e9e0574c68 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:28.243108 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4b6a5353-1594-4533-a15c-225b7af21695 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59" status: 200 len: 1475 microversion: 2.1 time: 0.809862 Oct 05 02:27:28.244825 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 90/194] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:27 2022] GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59 => generated 1475 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:28.254452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94dbe606-cce8-4d34-88e9-19e9e0574c68 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:28.254931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94dbe606-cce8-4d34-88e9-19e9e0574c68 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:28.255571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94dbe606-cce8-4d34-88e9-19e9e0574c68 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:28.257497 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94dbe606-cce8-4d34-88e9-19e9e0574c68 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:28.261237 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94dbe606-cce8-4d34-88e9-19e9e0574c68 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:28.261859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94dbe606-cce8-4d34-88e9-19e9e0574c68 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:28.834292 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-94dbe606-cce8-4d34-88e9-19e9e0574c68 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9" status: 200 len: 1640 microversion: 2.1 time: 0.599507 Oct 05 02:27:28.837265 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 105/195] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:28 2022] GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 => generated 1640 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:28.858853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8e0d5726-d4b5-4a78-b152-e44a9c58878c tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:28.859414 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8e0d5726-d4b5-4a78-b152-e44a9c58878c tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:28.872115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e0d5726-d4b5-4a78-b152-e44a9c58878c tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:28.872614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e0d5726-d4b5-4a78-b152-e44a9c58878c tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:28.885814 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e0d5726-d4b5-4a78-b152-e44a9c58878c tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:28.886904 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e0d5726-d4b5-4a78-b152-e44a9c58878c tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:28.887807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e0d5726-d4b5-4a78-b152-e44a9c58878c tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:28.888478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e0d5726-d4b5-4a78-b152-e44a9c58878c tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:29.007840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8e0d5726-d4b5-4a78-b152-e44a9c58878c tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:27:29.269762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-88c3b50e-539f-4531-b8cb-2f65e1b4fbeb tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:29.270445 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-88c3b50e-539f-4531-b8cb-2f65e1b4fbeb tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: c9ea1283-2889-4a96-bee8-b2b99509ed59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:29.283011 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88c3b50e-539f-4531-b8cb-2f65e1b4fbeb tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:29.283518 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88c3b50e-539f-4531-b8cb-2f65e1b4fbeb tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:29.283955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88c3b50e-539f-4531-b8cb-2f65e1b4fbeb tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:29.287383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88c3b50e-539f-4531-b8cb-2f65e1b4fbeb tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:29.290602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88c3b50e-539f-4531-b8cb-2f65e1b4fbeb tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:29.292818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88c3b50e-539f-4531-b8cb-2f65e1b4fbeb tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:29.399596 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8e0d5726-d4b5-4a78-b152-e44a9c58878c tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] 10.222.0.16 "DELETE /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9" status: 204 len: 0 microversion: 2.1 time: 0.546082 Oct 05 02:27:29.400578 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 91/196] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:27:28 2022] DELETE /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:27:29.412639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a25d8256-4767-4207-ac48-41bdcf3472f8 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:29.415543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a25d8256-4767-4207-ac48-41bdcf3472f8 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:29.429762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a25d8256-4767-4207-ac48-41bdcf3472f8 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:29.430266 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a25d8256-4767-4207-ac48-41bdcf3472f8 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:29.430703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a25d8256-4767-4207-ac48-41bdcf3472f8 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:29.431414 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a25d8256-4767-4207-ac48-41bdcf3472f8 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:29.431870 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a25d8256-4767-4207-ac48-41bdcf3472f8 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:29.432292 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a25d8256-4767-4207-ac48-41bdcf3472f8 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:29.566854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=12 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:29.850072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-88c3b50e-539f-4531-b8cb-2f65e1b4fbeb tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:29.866816 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-88c3b50e-539f-4531-b8cb-2f65e1b4fbeb tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59" status: 200 len: 1475 microversion: 2.1 time: 0.602095 Oct 05 02:27:29.869850 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 106/197] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:29 2022] GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59 => generated 1475 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:27:30.172249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a25d8256-4767-4207-ac48-41bdcf3472f8 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aebce7113c4e8980490aa0b0fbb296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b7bb601bea47d88c9ad68be2651451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:30.183944 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a25d8256-4767-4207-ac48-41bdcf3472f8 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] 10.222.0.16 "GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9" status: 200 len: 1495 microversion: 2.1 time: 0.779016 Oct 05 02:27:30.188615 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 92/198] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:29 2022] GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 => generated 1495 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:30.497106 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-f6f23086-cb13-42ba-874d-233c412e4d1f req-791cd22e-7df4-47b8-87c2-61f38d452aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9ea1283-2889-4a96-bee8-b2b99509ed59", "name": "network-vif-deleted", "tag": "a955fb2f-e0a3-488e-9626-53db651f09eb"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:30.540927 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f6f23086-cb13-42ba-874d-233c412e4d1f req-791cd22e-7df4-47b8-87c2-61f38d452aa4 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:30.547595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f6f23086-cb13-42ba-874d-233c412e4d1f req-791cd22e-7df4-47b8-87c2-61f38d452aa4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:30.548694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f6f23086-cb13-42ba-874d-233c412e4d1f req-791cd22e-7df4-47b8-87c2-61f38d452aa4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:30.577275 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-f6f23086-cb13-42ba-874d-233c412e4d1f req-791cd22e-7df4-47b8-87c2-61f38d452aa4 service nova] Creating event network-vif-deleted:a955fb2f-e0a3-488e-9626-53db651f09eb for instance c9ea1283-2889-4a96-bee8-b2b99509ed59 on n-h1-858272-3 Oct 05 02:27:30.609461 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-f6f23086-cb13-42ba-874d-233c412e4d1f req-791cd22e-7df4-47b8-87c2-61f38d452aa4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116767 Oct 05 02:27:30.610137 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 107/199] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:30.897331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9eb16d93-146b-4f81-8bfc-a8a49c2f1abd tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:30.898088 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9eb16d93-146b-4f81-8bfc-a8a49c2f1abd tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: c9ea1283-2889-4a96-bee8-b2b99509ed59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:30.915609 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9eb16d93-146b-4f81-8bfc-a8a49c2f1abd tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:30.918824 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9eb16d93-146b-4f81-8bfc-a8a49c2f1abd tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:30.919375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9eb16d93-146b-4f81-8bfc-a8a49c2f1abd tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:30.920819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9eb16d93-146b-4f81-8bfc-a8a49c2f1abd tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:30.922852 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9eb16d93-146b-4f81-8bfc-a8a49c2f1abd tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:30.923380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9eb16d93-146b-4f81-8bfc-a8a49c2f1abd tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:30.969082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9eb16d93-146b-4f81-8bfc-a8a49c2f1abd tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:30.969569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9eb16d93-146b-4f81-8bfc-a8a49c2f1abd tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:30.969998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9eb16d93-146b-4f81-8bfc-a8a49c2f1abd tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:30.970457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-9eb16d93-146b-4f81-8bfc-a8a49c2f1abd tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lazy-loading 'fault' on Instance uuid c9ea1283-2889-4a96-bee8-b2b99509ed59 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:27:31.039721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9eb16d93-146b-4f81-8bfc-a8a49c2f1abd tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:31.047771 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9eb16d93-146b-4f81-8bfc-a8a49c2f1abd tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59" status: 200 len: 1310 microversion: 2.1 time: 0.155525 Oct 05 02:27:31.048365 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 93/200] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:30 2022] GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59 => generated 1310 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:31.219712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-02ec862d-8cf2-4e1b-8abc-0b3917be1233 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:31.220618 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-02ec862d-8cf2-4e1b-8abc-0b3917be1233 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:31.231715 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-02ec862d-8cf2-4e1b-8abc-0b3917be1233 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:31.232653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-02ec862d-8cf2-4e1b-8abc-0b3917be1233 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:31.233312 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-02ec862d-8cf2-4e1b-8abc-0b3917be1233 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:31.235103 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-02ec862d-8cf2-4e1b-8abc-0b3917be1233 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:31.235880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-02ec862d-8cf2-4e1b-8abc-0b3917be1233 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:31.237877 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-02ec862d-8cf2-4e1b-8abc-0b3917be1233 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:31.454638 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-02ec862d-8cf2-4e1b-8abc-0b3917be1233 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aebce7113c4e8980490aa0b0fbb296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b7bb601bea47d88c9ad68be2651451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:31.482278 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-02ec862d-8cf2-4e1b-8abc-0b3917be1233 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] 10.222.0.16 "GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9" status: 200 len: 1495 microversion: 2.1 time: 0.268730 Oct 05 02:27:31.493805 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 108/201] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:31 2022] GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 => generated 1495 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:27:32.074694 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-51995409-3eb7-42f9-8109-0de526015526 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:32.075876 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-51995409-3eb7-42f9-8109-0de526015526 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: c9ea1283-2889-4a96-bee8-b2b99509ed59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:32.090475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51995409-3eb7-42f9-8109-0de526015526 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:32.091701 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51995409-3eb7-42f9-8109-0de526015526 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:32.092342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51995409-3eb7-42f9-8109-0de526015526 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:32.093308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51995409-3eb7-42f9-8109-0de526015526 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:32.093949 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51995409-3eb7-42f9-8109-0de526015526 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:32.095194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51995409-3eb7-42f9-8109-0de526015526 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:32.124689 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-51995409-3eb7-42f9-8109-0de526015526 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] HTTP exception thrown: Instance c9ea1283-2889-4a96-bee8-b2b99509ed59 could not be found. Oct 05 02:27:32.130302 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-51995409-3eb7-42f9-8109-0de526015526 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Request method failure captured: Oct 05 02:27:32.130302 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59 HTTP/1.1 Oct 05 02:27:32.130302 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:27:32.130302 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:27:32.130302 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:27:32.130302 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:27:32.130302 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:27:32.130302 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:27:32.130302 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:27:32.130302 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:32.130302 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOtqPmvi9uTht4ekOO_xj3gCk7E-OyaERF8G5rMI7GtL1nAMiZWSUBCLDuZX6U0chPEX_c9j-23x28vsgD54o_OrpFiRo5Af34xUY_XRPU8OS8kFLwO0HbibuHgOxuCAlmGMb4CFGSjhqEQNQ5qM4BPfMv71aJZtRZ90onz4_CputqI Oct 05 02:27:32.130302 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:27:32.130302 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:27:32.130302 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:27:32.130302 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:27:32.130302 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:27:32.130302 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:27:32.130302 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: a0a161064bfc4b608dabcd8fd2b26037 Oct 05 02:27:32.130302 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1872816975 Oct 05 02:27:32.130302 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:27:32.130302 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:27:32.131814 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a0a161064bfc4b608dabcd8fd2b26037"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a0a161064bfc4b608dabcd8fd2b26037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a0a161064bfc4b608dabcd8fd2b26037"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a0a161064bfc4b608dabcd8fd2b26037"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:32.131814 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-DeleteServersAdminTestJSON-1872816975 Oct 05 02:27:32.131814 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: a0a161064bfc4b608dabcd8fd2b26037 Oct 05 02:27:32.131814 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1872816975 Oct 05 02:27:32.131814 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-DeleteServersAdminTestJSON-1872816975-project Oct 05 02:27:32.131814 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:27:32.131814 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:27:32.131814 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: fa65581361534943b2cda9381e3f7a8c Oct 05 02:27:32.131814 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-DeleteServersAdminTestJSON-1872816975-project Oct 05 02:27:32.131814 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:27:32.131814 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance c9ea1283-2889-4a96-bee8-b2b99509ed59 could not be found. Oct 05 02:27:32.131814 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'c9ea1283-2889-4a96-bee8-b2b99509ed59'} Oct 05 02:27:32.132659 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:32.132659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:32.132659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:27:32.132659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:27:32.132659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:27:32.132659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:27:32.132659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:27:32.132659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:27:32.132659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:27:32.132659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:27:32.132659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9ea1283-2889-4a96-bee8-b2b99509ed59 could not be found. Oct 05 02:27:32.132659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:32.132659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:32.132659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:32.132659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:32.132659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:32.132659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:32.132659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:32.132659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:32.132659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:32.134000 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:32.134000 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:27:32.134000 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:27:32.134000 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:27:32.134000 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:27:32.134000 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:27:32.134000 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:27:32.134000 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9ea1283-2889-4a96-bee8-b2b99509ed59 could not be found. Oct 05 02:27:32.134000 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:32.134000 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:32.134000 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:32.134000 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:32.134000 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:32.134000 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:32.134000 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:27:32.134000 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:27:32.134000 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9ea1283-2889-4a96-bee8-b2b99509ed59 could not be found. Oct 05 02:27:32.134000 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:32.142176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-51995409-3eb7-42f9-8109-0de526015526 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Returning 404 to user: Instance c9ea1283-2889-4a96-bee8-b2b99509ed59 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:32.143298 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-51995409-3eb7-42f9-8109-0de526015526 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59" status: 404 len: 111 microversion: 2.1 time: 0.074479 Oct 05 02:27:32.146214 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 94/202] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:32 2022] GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:27:32.385018 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-80c988bf-a812-408b-8994-188c51979773 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-9969238", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:32.484613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-80c988bf-a812-408b-8994-188c51979773 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] validate_networks() for None {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:27:32.504609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=16 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:32.600420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7316cb15-abb8-4ab9-8744-58edf496eef7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-929292258", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "9671ab97-ec52-4c80-a228-74cde59af3af"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:32.797074 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-7316cb15-abb8-4ab9-8744-58edf496eef7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] validate_networks() for [('9671ab97-ec52-4c80-a228-74cde59af3af', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:27:33.187246 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-80c988bf-a812-408b-8994-188c51979773 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:27:33.187787 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-80c988bf-a812-408b-8994-188c51979773 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:27:33.188124 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-80c988bf-a812-408b-8994-188c51979773 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:27:33.188810 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-80c988bf-a812-408b-8994-188c51979773 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:27:33.189467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-80c988bf-a812-408b-8994-188c51979773 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:27:33.205138 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-80c988bf-a812-408b-8994-188c51979773 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:33.205744 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-80c988bf-a812-408b-8994-188c51979773 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:33.206775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-80c988bf-a812-408b-8994-188c51979773 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:33.207716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-80c988bf-a812-408b-8994-188c51979773 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:33.208373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-80c988bf-a812-408b-8994-188c51979773 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:33.209103 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-80c988bf-a812-408b-8994-188c51979773 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:33.234897 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-80c988bf-a812-408b-8994-188c51979773 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Getting quotas for project a0a161064bfc4b608dabcd8fd2b26037. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:27:33.241571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-80c988bf-a812-408b-8994-188c51979773 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Getting quotas for user fa65581361534943b2cda9381e3f7a8c and project a0a161064bfc4b608dabcd8fd2b26037. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:27:33.257157 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-80c988bf-a812-408b-8994-188c51979773 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:27:33.260072 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-80c988bf-a812-408b-8994-188c51979773 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: 1a0dac23-a7fb-40cf-b2bc-849859ea8197] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:27:33.381683 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-80c988bf-a812-408b-8994-188c51979773 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.000985 Oct 05 02:27:33.383063 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 95/203] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:27:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:27:33.395688 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fe48d232-5dd6-4536-b279-68a4313088fc tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:33.397480 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fe48d232-5dd6-4536-b279-68a4313088fc tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:33.405697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe48d232-5dd6-4536-b279-68a4313088fc tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:33.406430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe48d232-5dd6-4536-b279-68a4313088fc tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:33.407083 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe48d232-5dd6-4536-b279-68a4313088fc tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:33.408155 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe48d232-5dd6-4536-b279-68a4313088fc tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:33.408816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe48d232-5dd6-4536-b279-68a4313088fc tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:33.420536 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe48d232-5dd6-4536-b279-68a4313088fc tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:33.535412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe48d232-5dd6-4536-b279-68a4313088fc tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:33.536293 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe48d232-5dd6-4536-b279-68a4313088fc tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:33.536895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe48d232-5dd6-4536-b279-68a4313088fc tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:33.537592 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-fe48d232-5dd6-4536-b279-68a4313088fc tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lazy-loading 'fault' on Instance uuid 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:27:33.695229 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fe48d232-5dd6-4536-b279-68a4313088fc tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aebce7113c4e8980490aa0b0fbb296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b7bb601bea47d88c9ad68be2651451', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:33.710166 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fe48d232-5dd6-4536-b279-68a4313088fc tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] 10.222.0.16 "GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9" status: 200 len: 1329 microversion: 2.1 time: 0.325327 Oct 05 02:27:33.710395 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 96/204] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:33 2022] GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 => generated 1329 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:33.731396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-424a6ffa-439d-47db-a1fb-12f59406736e req-01e329cc-57d2-4745-9c50-07d136620887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9", "name": "network-vif-deleted", "tag": "12fcbb82-bf50-4f96-a97d-4882d900cc55"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:33.778119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-424a6ffa-439d-47db-a1fb-12f59406736e req-01e329cc-57d2-4745-9c50-07d136620887 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:33.778618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-424a6ffa-439d-47db-a1fb-12f59406736e req-01e329cc-57d2-4745-9c50-07d136620887 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:33.779047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-424a6ffa-439d-47db-a1fb-12f59406736e req-01e329cc-57d2-4745-9c50-07d136620887 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:33.846493 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-424a6ffa-439d-47db-a1fb-12f59406736e req-01e329cc-57d2-4745-9c50-07d136620887 service nova] Creating event network-vif-deleted:12fcbb82-bf50-4f96-a97d-4882d900cc55 for instance 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 on n-h2-858272-3 Oct 05 02:27:33.897826 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-424a6ffa-439d-47db-a1fb-12f59406736e req-01e329cc-57d2-4745-9c50-07d136620887 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186120 Oct 05 02:27:33.898481 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 97/205] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:33.910627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c6a84071-9d7c-404c-9a3b-79f8f02dcbf7 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:33.918128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c6a84071-9d7c-404c-9a3b-79f8f02dcbf7 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: 1a0dac23-a7fb-40cf-b2bc-849859ea8197] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:34.095229 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c6a84071-9d7c-404c-9a3b-79f8f02dcbf7 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:34.105784 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c6a84071-9d7c-404c-9a3b-79f8f02dcbf7 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197" status: 200 len: 1217 microversion: 2.1 time: 0.201920 Oct 05 02:27:34.126212 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 98/206] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:33 2022] GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197 => generated 1217 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:34.211381 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-7316cb15-abb8-4ab9-8744-58edf496eef7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:27:34.211827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-7316cb15-abb8-4ab9-8744-58edf496eef7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:27:34.212270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-7316cb15-abb8-4ab9-8744-58edf496eef7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:27:34.212677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-7316cb15-abb8-4ab9-8744-58edf496eef7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:27:34.213111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-7316cb15-abb8-4ab9-8744-58edf496eef7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:27:34.228638 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7316cb15-abb8-4ab9-8744-58edf496eef7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:34.229171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7316cb15-abb8-4ab9-8744-58edf496eef7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:34.229600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7316cb15-abb8-4ab9-8744-58edf496eef7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:34.230534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7316cb15-abb8-4ab9-8744-58edf496eef7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:34.231140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7316cb15-abb8-4ab9-8744-58edf496eef7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:34.231880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7316cb15-abb8-4ab9-8744-58edf496eef7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:34.266705 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-7316cb15-abb8-4ab9-8744-58edf496eef7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Getting quotas for project bbd25b0a68f749029eeed701c77462ce. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:27:34.275554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-7316cb15-abb8-4ab9-8744-58edf496eef7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Getting quotas for user 39671ba0b86847f995c96013947fee65 and project bbd25b0a68f749029eeed701c77462ce. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:27:34.292275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7316cb15-abb8-4ab9-8744-58edf496eef7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:27:34.295971 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7316cb15-abb8-4ab9-8744-58edf496eef7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:27:34.369188 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7316cb15-abb8-4ab9-8744-58edf496eef7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.059566 Oct 05 02:27:34.370640 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 109/207] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 5 02:27:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2062 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 05 02:27:34.383253 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a7e29fa0-c099-42dd-b7e4-5061b0ae91ad tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:34.388518 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a7e29fa0-c099-42dd-b7e4-5061b0ae91ad tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:34.480492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a7e29fa0-c099-42dd-b7e4-5061b0ae91ad tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:34.492024 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a7e29fa0-c099-42dd-b7e4-5061b0ae91ad tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:34.494131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a7e29fa0-c099-42dd-b7e4-5061b0ae91ad tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:34.495884 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a7e29fa0-c099-42dd-b7e4-5061b0ae91ad tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 200 len: 1261 microversion: 2.25 time: 0.117986 Oct 05 02:27:34.497361 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 99/208] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:27:34 2022] GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 1261 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:27:34.736951 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6844c4c3-6cd4-4e35-a332-855b0a9a9984 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:34.737981 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6844c4c3-6cd4-4e35-a332-855b0a9a9984 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:34.764076 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6844c4c3-6cd4-4e35-a332-855b0a9a9984 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:34.764852 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6844c4c3-6cd4-4e35-a332-855b0a9a9984 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:34.765562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6844c4c3-6cd4-4e35-a332-855b0a9a9984 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:34.766446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6844c4c3-6cd4-4e35-a332-855b0a9a9984 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:34.767117 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6844c4c3-6cd4-4e35-a332-855b0a9a9984 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:34.767764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6844c4c3-6cd4-4e35-a332-855b0a9a9984 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:34.826410 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-6844c4c3-6cd4-4e35-a332-855b0a9a9984 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] HTTP exception thrown: Instance 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 could not be found. Oct 05 02:27:34.839392 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6844c4c3-6cd4-4e35-a332-855b0a9a9984 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Request method failure captured: Oct 05 02:27:34.839392 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 HTTP/1.1 Oct 05 02:27:34.839392 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:27:34.839392 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:27:34.839392 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:27:34.839392 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:27:34.839392 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:27:34.839392 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:27:34.839392 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:27:34.839392 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:34.839392 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOtheyyEcnHUGF4aq7DRLPFplPfXfYmhaMe5VsqFN1RXvhMVUhpB9xOXAbUV78yupLoVDqGtfpW29TceXmmD2KFo3zF9jnvtwKtqO9kA3Xymy4a2B2LoM7j67Fkql_-rJojFwtzCT_fVmH27_jUweU7lpv5uH0A9q4DYv0oF27QH_u8 Oct 05 02:27:34.839392 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:27:34.839392 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:27:34.839392 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:27:34.839392 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:27:34.839392 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:27:34.839392 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:27:34.839392 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 71b7bb601bea47d88c9ad68be2651451 Oct 05 02:27:34.839392 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-AggregatesAdminTestJSON-174369115 Oct 05 02:27:34.839392 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:27:34.839392 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:27:34.840996 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/71b7bb601bea47d88c9ad68be2651451"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/71b7bb601bea47d88c9ad68be2651451"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/71b7bb601bea47d88c9ad68be2651451"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_71b7bb601bea47d88c9ad68be2651451"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:34.840996 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-AggregatesAdminTestJSON-174369115 Oct 05 02:27:34.840996 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 71b7bb601bea47d88c9ad68be2651451 Oct 05 02:27:34.840996 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-174369115 Oct 05 02:27:34.840996 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-AggregatesAdminTestJSON-174369115-project Oct 05 02:27:34.840996 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:27:34.840996 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:27:34.840996 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: f4aebce7113c4e8980490aa0b0fbb296 Oct 05 02:27:34.840996 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-AggregatesAdminTestJSON-174369115-project Oct 05 02:27:34.840996 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:27:34.840996 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 could not be found. Oct 05 02:27:34.840996 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9'} Oct 05 02:27:34.841677 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:34.841677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:34.841677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:27:34.841677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:27:34.841677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:27:34.841677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:27:34.841677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:27:34.841677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:27:34.841677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:27:34.841677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:27:34.841677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 could not be found. Oct 05 02:27:34.841677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:34.841677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:34.841677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:34.841677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:34.841677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:34.841677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:34.841677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:34.841677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:34.841677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:34.842756 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:34.842756 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:27:34.842756 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:27:34.842756 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:27:34.842756 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:27:34.842756 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:27:34.842756 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:27:34.842756 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 could not be found. Oct 05 02:27:34.842756 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:34.842756 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:34.842756 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:34.842756 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:34.842756 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:34.842756 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:34.842756 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:27:34.842756 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:27:34.842756 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 could not be found. Oct 05 02:27:34.842756 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:34.843718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6844c4c3-6cd4-4e35-a332-855b0a9a9984 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Returning 404 to user: Instance 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:34.843718 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6844c4c3-6cd4-4e35-a332-855b0a9a9984 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] 10.222.0.16 "GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9" status: 404 len: 111 microversion: 2.1 time: 0.109821 Oct 05 02:27:34.852790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fe4c975d-32d0-4bcf-9d4f-215c7dac21ba tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858272-3"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:34.857875 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 110/209] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:34 2022] GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:27:34.888183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe4c975d-32d0-4bcf-9d4f-215c7dac21ba tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:34.889391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe4c975d-32d0-4bcf-9d4f-215c7dac21ba tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:34.891490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe4c975d-32d0-4bcf-9d4f-215c7dac21ba tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:35.134347 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-23236560-258f-4652-bf43-8c7004b489d1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:35.135735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-23236560-258f-4652-bf43-8c7004b489d1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: 1a0dac23-a7fb-40cf-b2bc-849859ea8197] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:35.151419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23236560-258f-4652-bf43-8c7004b489d1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:35.152037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23236560-258f-4652-bf43-8c7004b489d1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:35.152559 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23236560-258f-4652-bf43-8c7004b489d1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:35.154122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23236560-258f-4652-bf43-8c7004b489d1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:35.155492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23236560-258f-4652-bf43-8c7004b489d1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:35.157994 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23236560-258f-4652-bf43-8c7004b489d1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:35.181972 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fe4c975d-32d0-4bcf-9d4f-215c7dac21ba tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 300 microversion: 2.1 time: 0.332990 Oct 05 02:27:35.182554 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 100/210] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 5 02:27:34 2022] POST /compute/v2.1/os-aggregates/1/action => generated 300 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:35.216068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d384dd1b-b28f-48d7-a236-609febcbcdf4 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:35.289335 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d384dd1b-b28f-48d7-a236-609febcbcdf4 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.086766 Oct 05 02:27:35.292738 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 101/211] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 5 02:27:35 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 02:27:35.317841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-20ff9241-71bd-4b99-828c-13ef2572f322 tempest-AggregatesAdminTestV241-1249617779 tempest-AggregatesAdminTestV241-1249617779-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1981120100"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:35.329032 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.aggregate [None req-20ff9241-71bd-4b99-828c-13ef2572f322 tempest-AggregatesAdminTestV241-1249617779 tempest-AggregatesAdminTestV241-1249617779-project-admin] Generated uuid 3387b77d-40ac-4a7f-85b8-f8338d5b0a72 for aggregate {{(pid=122320) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 02:27:35.343720 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-23236560-258f-4652-bf43-8c7004b489d1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:35.354935 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-23236560-258f-4652-bf43-8c7004b489d1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197" status: 200 len: 1269 microversion: 2.1 time: 0.224394 Oct 05 02:27:35.372397 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 111/212] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:35 2022] GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197 => generated 1269 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:27:35.439485 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-20ff9241-71bd-4b99-828c-13ef2572f322 tempest-AggregatesAdminTestV241-1249617779 tempest-AggregatesAdminTestV241-1249617779-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.133587 Oct 05 02:27:35.440335 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 102/213] 10.222.0.16 () {62 vars in 1205 bytes} [Wed Oct 5 02:27:35 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:27:35.454060 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3404f447-14e9-42de-8a7f-3d3ff0399f7b tempest-AggregatesAdminTestV241-1249617779 tempest-AggregatesAdminTestV241-1249617779-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-156446185"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:35.524291 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c963db41-061f-405b-9006-8c17c98f5999 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:35.525184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c963db41-061f-405b-9006-8c17c98f5999 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:35.538041 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c963db41-061f-405b-9006-8c17c98f5999 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:35.538581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c963db41-061f-405b-9006-8c17c98f5999 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:35.539016 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c963db41-061f-405b-9006-8c17c98f5999 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:35.539725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c963db41-061f-405b-9006-8c17c98f5999 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:35.540177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c963db41-061f-405b-9006-8c17c98f5999 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:35.540592 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c963db41-061f-405b-9006-8c17c98f5999 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:35.652290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c963db41-061f-405b-9006-8c17c98f5999 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:35.663507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c963db41-061f-405b-9006-8c17c98f5999 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:35.671756 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c963db41-061f-405b-9006-8c17c98f5999 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:35.673024 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c963db41-061f-405b-9006-8c17c98f5999 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 200 len: 1279 microversion: 2.25 time: 0.154205 Oct 05 02:27:35.689354 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 103/214] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:27:35 2022] GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 1279 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:27:35.724522 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3404f447-14e9-42de-8a7f-3d3ff0399f7b tempest-AggregatesAdminTestV241-1249617779 tempest-AggregatesAdminTestV241-1249617779-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/2" status: 200 len: 298 microversion: 2.41 time: 0.274175 Oct 05 02:27:35.732958 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 112/215] 10.222.0.16 () {62 vars in 1210 bytes} [Wed Oct 5 02:27:35 2022] PUT /compute/v2.1/os-aggregates/2 => generated 298 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 02:27:35.742707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e70c9350-ada8-42f9-b416-562d79afb155 tempest-AggregatesAdminTestV241-1249617779 tempest-AggregatesAdminTestV241-1249617779-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:35.762905 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e70c9350-ada8-42f9-b416-562d79afb155 tempest-AggregatesAdminTestV241-1249617779 tempest-AggregatesAdminTestV241-1249617779-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 298 microversion: 2.41 time: 0.028505 Oct 05 02:27:35.765737 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 104/216] 10.222.0.16 () {60 vars in 1190 bytes} [Wed Oct 5 02:27:35 2022] GET /compute/v2.1/os-aggregates/2 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 02:27:35.778569 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-536c72d2-cb27-49c4-9dc7-eebd09a93b8a tempest-AggregatesAdminTestV241-1249617779 tempest-AggregatesAdminTestV241-1249617779-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858272-3"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:35.803263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-536c72d2-cb27-49c4-9dc7-eebd09a93b8a tempest-AggregatesAdminTestV241-1249617779 tempest-AggregatesAdminTestV241-1249617779-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:35.803761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-536c72d2-cb27-49c4-9dc7-eebd09a93b8a tempest-AggregatesAdminTestV241-1249617779 tempest-AggregatesAdminTestV241-1249617779-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:35.804373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-536c72d2-cb27-49c4-9dc7-eebd09a93b8a tempest-AggregatesAdminTestV241-1249617779 tempest-AggregatesAdminTestV241-1249617779-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:36.366668 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-536c72d2-cb27-49c4-9dc7-eebd09a93b8a tempest-AggregatesAdminTestV241-1249617779 tempest-AggregatesAdminTestV241-1249617779-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 313 microversion: 2.41 time: 0.591571 Oct 05 02:27:36.368564 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 113/217] 10.222.0.16 () {62 vars in 1232 bytes} [Wed Oct 5 02:27:35 2022] POST /compute/v2.1/os-aggregates/2/action => generated 313 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:27:36.382285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2ef52151-1682-4890-ba8e-5a3cdf6fc671 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:36.383465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2ef52151-1682-4890-ba8e-5a3cdf6fc671 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: 1a0dac23-a7fb-40cf-b2bc-849859ea8197] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:36.390347 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6710b1d3-edf0-42eb-9852-35f0ca213f8a tempest-AggregatesAdminTestV241-1249617779 tempest-AggregatesAdminTestV241-1249617779-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858272-3"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:36.392495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ef52151-1682-4890-ba8e-5a3cdf6fc671 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:36.394183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ef52151-1682-4890-ba8e-5a3cdf6fc671 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:36.394924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ef52151-1682-4890-ba8e-5a3cdf6fc671 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:36.396112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ef52151-1682-4890-ba8e-5a3cdf6fc671 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:36.397600 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ef52151-1682-4890-ba8e-5a3cdf6fc671 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:36.398363 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ef52151-1682-4890-ba8e-5a3cdf6fc671 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:36.412387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6710b1d3-edf0-42eb-9852-35f0ca213f8a tempest-AggregatesAdminTestV241-1249617779 tempest-AggregatesAdminTestV241-1249617779-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:36.413124 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6710b1d3-edf0-42eb-9852-35f0ca213f8a tempest-AggregatesAdminTestV241-1249617779 tempest-AggregatesAdminTestV241-1249617779-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:36.413987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6710b1d3-edf0-42eb-9852-35f0ca213f8a tempest-AggregatesAdminTestV241-1249617779 tempest-AggregatesAdminTestV241-1249617779-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:36.632268 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6710b1d3-edf0-42eb-9852-35f0ca213f8a tempest-AggregatesAdminTestV241-1249617779 tempest-AggregatesAdminTestV241-1249617779-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 298 microversion: 2.41 time: 0.249638 Oct 05 02:27:36.633132 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 114/218] 10.222.0.16 () {62 vars in 1232 bytes} [Wed Oct 5 02:27:36 2022] POST /compute/v2.1/os-aggregates/2/action => generated 298 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:27:36.646931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-029c14de-c41c-4522-bb99-0b54bcb17c34 tempest-AggregatesAdminTestV241-1249617779 tempest-AggregatesAdminTestV241-1249617779-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:36.726211 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-029c14de-c41c-4522-bb99-0b54bcb17c34 tempest-AggregatesAdminTestV241-1249617779 tempest-AggregatesAdminTestV241-1249617779-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.41 time: 0.085049 Oct 05 02:27:36.727164 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 115/219] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Oct 5 02:27:36 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:27:36.735763 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-54a107e7-ae00-47aa-bb30-fddb1c0bf2c0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:36.736634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-54a107e7-ae00-47aa-bb30-fddb1c0bf2c0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:36.754879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-54a107e7-ae00-47aa-bb30-fddb1c0bf2c0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:36.757554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-54a107e7-ae00-47aa-bb30-fddb1c0bf2c0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:36.758015 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-54a107e7-ae00-47aa-bb30-fddb1c0bf2c0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:36.758855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-54a107e7-ae00-47aa-bb30-fddb1c0bf2c0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:36.762059 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-54a107e7-ae00-47aa-bb30-fddb1c0bf2c0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:36.762533 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-54a107e7-ae00-47aa-bb30-fddb1c0bf2c0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:36.798477 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2ef52151-1682-4890-ba8e-5a3cdf6fc671 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:36.813159 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2ef52151-1682-4890-ba8e-5a3cdf6fc671 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197" status: 200 len: 1275 microversion: 2.1 time: 0.431551 Oct 05 02:27:36.814244 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 105/220] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:36 2022] GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197 => generated 1275 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:36.833690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0bda2bb8-1d20-4a43-b367-fe324b8b631c tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Calling method '.version_select at 0x7fcce4c5bdc0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:36.846051 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0bda2bb8-1d20-4a43-b367-fe324b8b631c tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:36.849554 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0bda2bb8-1d20-4a43-b367-fe324b8b631c tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:36.852353 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0bda2bb8-1d20-4a43-b367-fe324b8b631c tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:36.855340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0bda2bb8-1d20-4a43-b367-fe324b8b631c tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:36.855837 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0bda2bb8-1d20-4a43-b367-fe324b8b631c tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:36.856272 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0bda2bb8-1d20-4a43-b367-fe324b8b631c tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:36.918473 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0bda2bb8-1d20-4a43-b367-fe324b8b631c tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.100091 Oct 05 02:27:36.920515 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 106/221] 10.222.0.16 () {58 vars in 1128 bytes} [Wed Oct 5 02:27:36 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:36.942108 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-eb4d64bc-b8ee-4993-ae8c-8db2378e13d6 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Calling method '.version_select at 0x7fcce4a973a0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:36.960473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb4d64bc-b8ee-4993-ae8c-8db2378e13d6 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:36.963248 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb4d64bc-b8ee-4993-ae8c-8db2378e13d6 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:36.967060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb4d64bc-b8ee-4993-ae8c-8db2378e13d6 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:36.968479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb4d64bc-b8ee-4993-ae8c-8db2378e13d6 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:36.972872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb4d64bc-b8ee-4993-ae8c-8db2378e13d6 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:36.974706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb4d64bc-b8ee-4993-ae8c-8db2378e13d6 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:37.004984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-54a107e7-ae00-47aa-bb30-fddb1c0bf2c0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:37.017478 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-54a107e7-ae00-47aa-bb30-fddb1c0bf2c0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:37.024945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-54a107e7-ae00-47aa-bb30-fddb1c0bf2c0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:37.031909 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-54a107e7-ae00-47aa-bb30-fddb1c0bf2c0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 200 len: 1331 microversion: 2.25 time: 0.303601 Oct 05 02:27:37.032865 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 116/222] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:27:36 2022] GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 1331 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:27:37.044883 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-eb4d64bc-b8ee-4993-ae8c-8db2378e13d6 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.107005 Oct 05 02:27:37.046997 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 107/223] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 5 02:27:36 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:27:37.060354 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d5aff2d3-df9d-4ef3-a5d7-74b58d3a3e2f tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-967585197"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:37.063439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-14f4e71d-73d4-42e7-b60b-231aa7e6c2f4 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Calling method '.version_select at 0x7fcce6201310>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:37.063944 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.aggregate [None req-d5aff2d3-df9d-4ef3-a5d7-74b58d3a3e2f tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Generated uuid 5ed1ad0c-ad46-4095-8bee-ed8438f370aa for aggregate {{(pid=122320) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 02:27:37.069418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-14f4e71d-73d4-42e7-b60b-231aa7e6c2f4 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:37.070218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-14f4e71d-73d4-42e7-b60b-231aa7e6c2f4 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:37.070872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-14f4e71d-73d4-42e7-b60b-231aa7e6c2f4 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:37.071807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-14f4e71d-73d4-42e7-b60b-231aa7e6c2f4 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:37.072475 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-14f4e71d-73d4-42e7-b60b-231aa7e6c2f4 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:37.073161 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-14f4e71d-73d4-42e7-b60b-231aa7e6c2f4 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:37.111214 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d5aff2d3-df9d-4ef3-a5d7-74b58d3a3e2f tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.054284 Oct 05 02:27:37.113554 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 108/224] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 5 02:27:37 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:37.124294 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-56b99aa4-a666-4a8b-be5b-5bd5d00d39a2 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858272-3"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:37.126590 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-14f4e71d-73d4-42e7-b60b-231aa7e6c2f4 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.069898 Oct 05 02:27:37.127483 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 117/225] 10.222.0.16 () {58 vars in 1128 bytes} [Wed Oct 5 02:27:37 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:37.146928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56b99aa4-a666-4a8b-be5b-5bd5d00d39a2 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:37.148321 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56b99aa4-a666-4a8b-be5b-5bd5d00d39a2 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:37.148943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56b99aa4-a666-4a8b-be5b-5bd5d00d39a2 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:37.158355 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-381f67d4-08fb-4a6e-9505-dd641818854e tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Calling method '.version_select at 0x7fcce4a03e50>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:37.175424 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-381f67d4-08fb-4a6e-9505-dd641818854e tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:37.176400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-381f67d4-08fb-4a6e-9505-dd641818854e tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:37.177085 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-381f67d4-08fb-4a6e-9505-dd641818854e tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:37.194138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-381f67d4-08fb-4a6e-9505-dd641818854e tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:37.195341 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-381f67d4-08fb-4a6e-9505-dd641818854e tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:37.196804 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-381f67d4-08fb-4a6e-9505-dd641818854e tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:37.223663 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-381f67d4-08fb-4a6e-9505-dd641818854e tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-h2-858272-3" status: 200 len: 598 microversion: 2.1 time: 0.077312 Oct 05 02:27:37.229152 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 118/226] 10.222.0.16 () {58 vars in 1170 bytes} [Wed Oct 5 02:27:37 2022] GET /compute/v2.1/os-hosts/n-h2-858272-3 => generated 598 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:37.234012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0aaee491-c8c6-4226-a6da-6fe75b24fbb9 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Calling method '.version_select at 0x7fcce4a1b280>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:37.249730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0aaee491-c8c6-4226-a6da-6fe75b24fbb9 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:37.250305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0aaee491-c8c6-4226-a6da-6fe75b24fbb9 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:37.250808 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0aaee491-c8c6-4226-a6da-6fe75b24fbb9 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:37.290669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0aaee491-c8c6-4226-a6da-6fe75b24fbb9 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:37.291254 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0aaee491-c8c6-4226-a6da-6fe75b24fbb9 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:37.291851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0aaee491-c8c6-4226-a6da-6fe75b24fbb9 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:37.314712 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0aaee491-c8c6-4226-a6da-6fe75b24fbb9 tempest-HostsAdminTestJSON-1249078835 tempest-HostsAdminTestJSON-1249078835-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-h1-858272-3" status: 200 len: 332 microversion: 2.1 time: 0.084278 Oct 05 02:27:37.329426 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 119/227] 10.222.0.16 () {58 vars in 1170 bytes} [Wed Oct 5 02:27:37 2022] GET /compute/v2.1/os-hosts/n-h1-858272-3 => generated 332 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:37.363154 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-56b99aa4-a666-4a8b-be5b-5bd5d00d39a2 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 0.241963 Oct 05 02:27:37.364194 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 109/228] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 5 02:27:37 2022] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:27:37.375655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bd53dcd5-ae6f-4402-97d9-45cf0c517be8 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:37.392745 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bd53dcd5-ae6f-4402-97d9-45cf0c517be8 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 241 microversion: 2.1 time: 0.020911 Oct 05 02:27:37.394910 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 120/229] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Oct 5 02:27:37 2022] GET /compute/v2.1/os-aggregates/3 => generated 241 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:37.406907 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f8093ab0-6474-4e4d-8345-9e2f111f9d76 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858272-3"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:37.433194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8093ab0-6474-4e4d-8345-9e2f111f9d76 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:37.433748 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8093ab0-6474-4e4d-8345-9e2f111f9d76 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:37.434198 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8093ab0-6474-4e4d-8345-9e2f111f9d76 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:37.467561 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:37.657483 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f8093ab0-6474-4e4d-8345-9e2f111f9d76 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.254124 Oct 05 02:27:37.659160 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 110/230] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 5 02:27:37 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:37.670662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8777c443-8a99-4e71-8dc0-b1fb776b4e05 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:37.728838 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8777c443-8a99-4e71-8dc0-b1fb776b4e05 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.061906 Oct 05 02:27:37.735878 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 121/231] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 5 02:27:37 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 02:27:37.744776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-88c52442-08c5-41fa-9135-e654c70437c7 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2111203776"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:37.752380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.aggregate [None req-88c52442-08c5-41fa-9135-e654c70437c7 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Generated uuid c5ad4051-c161-4e8d-8599-bc5819d8218a for aggregate {{(pid=122320) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 02:27:37.791595 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-88c52442-08c5-41fa-9135-e654c70437c7 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.053256 Oct 05 02:27:37.792222 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 111/232] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 5 02:27:37 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:27:37.807968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c8bbaa60-7e44-4a67-b203-0a9886988986 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858272-3"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:37.843968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e852f0c1-83b1-4736-9570-16e392e17d78 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:37.845505 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e852f0c1-83b1-4736-9570-16e392e17d78 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: 1a0dac23-a7fb-40cf-b2bc-849859ea8197] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:37.851806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c8bbaa60-7e44-4a67-b203-0a9886988986 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:37.854439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c8bbaa60-7e44-4a67-b203-0a9886988986 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:37.857074 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c8bbaa60-7e44-4a67-b203-0a9886988986 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:37.863750 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e852f0c1-83b1-4736-9570-16e392e17d78 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:37.864928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e852f0c1-83b1-4736-9570-16e392e17d78 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:37.866896 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e852f0c1-83b1-4736-9570-16e392e17d78 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:37.867961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e852f0c1-83b1-4736-9570-16e392e17d78 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:37.868084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e852f0c1-83b1-4736-9570-16e392e17d78 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:37.870466 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e852f0c1-83b1-4736-9570-16e392e17d78 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:37.912659 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:INSERT=5,nova_api:DELETE=5 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:38.061261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e852f0c1-83b1-4736-9570-16e392e17d78 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:38.070937 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e852f0c1-83b1-4736-9570-16e392e17d78 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197" status: 200 len: 1275 microversion: 2.1 time: 0.233234 Oct 05 02:27:38.085795 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 112/233] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:37 2022] GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197 => generated 1275 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:27:38.117370 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0ca4c7cb-1a8f-49a8-8f6b-697b936bdea0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:38.119394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0ca4c7cb-1a8f-49a8-8f6b-697b936bdea0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:38.141482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ca4c7cb-1a8f-49a8-8f6b-697b936bdea0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:38.142266 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ca4c7cb-1a8f-49a8-8f6b-697b936bdea0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:38.142707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ca4c7cb-1a8f-49a8-8f6b-697b936bdea0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:38.143433 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ca4c7cb-1a8f-49a8-8f6b-697b936bdea0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:38.149423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ca4c7cb-1a8f-49a8-8f6b-697b936bdea0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:38.150085 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ca4c7cb-1a8f-49a8-8f6b-697b936bdea0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:38.154049 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c8bbaa60-7e44-4a67-b203-0a9886988986 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.354009 Oct 05 02:27:38.155830 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 122/234] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 5 02:27:37 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:38.172774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-13580d20-a5f3-418b-89e1-5f8a8940ff82 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:38.196728 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-13580d20-a5f3-418b-89e1-5f8a8940ff82 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.031842 Oct 05 02:27:38.199145 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 123/235] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 5 02:27:38 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:38.217091 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7bba3d47-04b4-4339-ac47-c0563e8a4598 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858272-3"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:38.236763 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7bba3d47-04b4-4339-ac47-c0563e8a4598 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:38.238194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7bba3d47-04b4-4339-ac47-c0563e8a4598 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:38.238848 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7bba3d47-04b4-4339-ac47-c0563e8a4598 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:38.463340 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7bba3d47-04b4-4339-ac47-c0563e8a4598 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.256123 Oct 05 02:27:38.467887 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 124/236] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 5 02:27:38 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:27:38.484877 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4934f76a-ed68-49d4-a162-7619b8b880fc tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:38.548371 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4934f76a-ed68-49d4-a162-7619b8b880fc tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.071800 Oct 05 02:27:38.551262 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 125/237] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 5 02:27:38 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 02:27:38.567440 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-33bcd77e-ccf0-4c46-b680-1d192d6d71f8 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2087461202"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:38.572195 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.aggregate [None req-33bcd77e-ccf0-4c46-b680-1d192d6d71f8 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Generated uuid 1be96c29-f261-4050-a861-256f99f1ef57 for aggregate {{(pid=122319) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 02:27:38.622758 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-33bcd77e-ccf0-4c46-b680-1d192d6d71f8 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.065221 Oct 05 02:27:38.623363 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 126/238] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 5 02:27:38 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:38.639842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-08deb97b-4c7b-405c-93ba-94ac4c6c25b4 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858272-3"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:38.671833 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08deb97b-4c7b-405c-93ba-94ac4c6c25b4 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:38.672587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08deb97b-4c7b-405c-93ba-94ac4c6c25b4 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:38.673122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08deb97b-4c7b-405c-93ba-94ac4c6c25b4 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:38.977537 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-08deb97b-4c7b-405c-93ba-94ac4c6c25b4 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 242 microversion: 2.1 time: 0.343632 Oct 05 02:27:38.985775 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 127/239] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 5 02:27:38 2022] POST /compute/v2.1/os-aggregates/5/action => generated 242 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:27:38.994382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f14331a8-2f20-4ea6-ad99-a084b77034a1 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858272-3"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:39.029300 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f14331a8-2f20-4ea6-ad99-a084b77034a1 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:39.035960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f14331a8-2f20-4ea6-ad99-a084b77034a1 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:39.036586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f14331a8-2f20-4ea6-ad99-a084b77034a1 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:39.288812 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f14331a8-2f20-4ea6-ad99-a084b77034a1 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 227 microversion: 2.1 time: 0.297442 Oct 05 02:27:39.296801 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 128/240] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 5 02:27:38 2022] POST /compute/v2.1/os-aggregates/5/action => generated 227 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:39.307114 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-645d0b52-9d66-4b5f-8397-d0676dae799d tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:39.307748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-645d0b52-9d66-4b5f-8397-d0676dae799d tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: 1a0dac23-a7fb-40cf-b2bc-849859ea8197] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:39.325708 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-645d0b52-9d66-4b5f-8397-d0676dae799d tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:39.326018 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-645d0b52-9d66-4b5f-8397-d0676dae799d tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:39.326459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-645d0b52-9d66-4b5f-8397-d0676dae799d tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:39.328014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-645d0b52-9d66-4b5f-8397-d0676dae799d tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:39.328490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-645d0b52-9d66-4b5f-8397-d0676dae799d tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:39.328931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-645d0b52-9d66-4b5f-8397-d0676dae799d tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:39.691664 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0ca4c7cb-1a8f-49a8-8f6b-697b936bdea0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:39.704588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0ca4c7cb-1a8f-49a8-8f6b-697b936bdea0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:39.707678 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0ca4c7cb-1a8f-49a8-8f6b-697b936bdea0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:39.710291 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0ca4c7cb-1a8f-49a8-8f6b-697b936bdea0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 200 len: 1361 microversion: 2.25 time: 1.606924 Oct 05 02:27:39.710994 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 113/241] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:27:38 2022] GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 1361 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:27:39.715734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-96784e9f-6b5f-4d38-a8d7-2193928a8e32 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:39.780837 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-96784e9f-6b5f-4d38-a8d7-2193928a8e32 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.068593 Oct 05 02:27:39.788461 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 114/242] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 5 02:27:39 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 02:27:39.794739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7d677e70-4fe3-4c6c-afff-b66077b08a5d tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1809862960"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:39.799410 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.aggregate [None req-7d677e70-4fe3-4c6c-afff-b66077b08a5d tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Generated uuid 03503c38-58b2-450f-a5f5-faf774775ac1 for aggregate {{(pid=122320) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 02:27:39.838310 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7d677e70-4fe3-4c6c-afff-b66077b08a5d tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.048152 Oct 05 02:27:39.845065 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 115/243] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 5 02:27:39 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:39.846735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8f670019-62b6-4dcf-846e-b312def381f1 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-916562992"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:39.852000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.aggregate [None req-8f670019-62b6-4dcf-846e-b312def381f1 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Generated uuid 34f0ae80-ee62-4f0e-bc62-0b3822c351ac for aggregate {{(pid=122320) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 02:27:39.889568 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8f670019-62b6-4dcf-846e-b312def381f1 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.048443 Oct 05 02:27:39.890471 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 116/244] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 5 02:27:39 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:39.907113 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ed98edf6-b14e-49f1-a368-4d14769cc993 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:39.973646 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ed98edf6-b14e-49f1-a368-4d14769cc993 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.080038 Oct 05 02:27:39.977053 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 117/245] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 5 02:27:39 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 02:27:39.982359 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f157954d-b122-41b4-b82a-53ba56df0606 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858272-3"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:39.998794 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f157954d-b122-41b4-b82a-53ba56df0606 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:39.999520 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f157954d-b122-41b4-b82a-53ba56df0606 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:40.000485 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f157954d-b122-41b4-b82a-53ba56df0606 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:40.238177 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-645d0b52-9d66-4b5f-8397-d0676dae799d tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:40.257851 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-645d0b52-9d66-4b5f-8397-d0676dae799d tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197" status: 200 len: 1317 microversion: 2.1 time: 0.956978 Oct 05 02:27:40.258668 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 129/246] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:39 2022] GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197 => generated 1317 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:40.267759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ec7990f6-0caa-47ff-8dc0-faee969a8e1e tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:40.289276 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f157954d-b122-41b4-b82a-53ba56df0606 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 241 microversion: 2.1 time: 0.313615 Oct 05 02:27:40.290482 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 118/247] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 5 02:27:39 2022] POST /compute/v2.1/os-aggregates/7/action => generated 241 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:40.297306 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-ec7990f6-0caa-47ff-8dc0-faee969a8e1e tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Oct 05 02:27:40.302974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ec7990f6-0caa-47ff-8dc0-faee969a8e1e tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Request method failure captured: Oct 05 02:27:40.302974 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 05 02:27:40.302974 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:27:40.302974 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:27:40.302974 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:27:40.302974 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:27:40.302974 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:27:40.302974 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:27:40.302974 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:27:40.302974 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:40.302974 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOtki3pYg1EcZ3TMCtpM0KN2C1AM4b8rJPMgNpjvzjYwIkGgPHp23Tnt0qOG_WDUQTpMx8FDtJ955Ead3Z0sNioRQ0wqSdPYz5_pUidlVu5qp_1pdoQxe5TSTsMXTJjwR2qFJJ_xaqJJ_-ZxZm88H3BA2nVBgBCdmD2UhCXNRis2ex8 Oct 05 02:27:40.302974 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:27:40.302974 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:27:40.302974 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:27:40.302974 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:27:40.302974 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:27:40.302974 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:27:40.302974 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 9dfcd8da86654d8985bf3ce1d8bbca81 Oct 05 02:27:40.302974 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-AggregatesAdminTestJSON-1727748590 Oct 05 02:27:40.302974 n-d-858272-3 devstack@n-api.service[122319]: X-Role: admin,member,reader Oct 05 02:27:40.302974 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: admin,member,reader Oct 05 02:27:40.304517 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9dfcd8da86654d8985bf3ce1d8bbca81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9dfcd8da86654d8985bf3ce1d8bbca81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9dfcd8da86654d8985bf3ce1d8bbca81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9dfcd8da86654d8985bf3ce1d8bbca81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:40.304517 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-AggregatesAdminTestJSON-1727748590 Oct 05 02:27:40.304517 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 9dfcd8da86654d8985bf3ce1d8bbca81 Oct 05 02:27:40.304517 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1727748590 Oct 05 02:27:40.304517 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-AggregatesAdminTestJSON-1727748590-project-admin Oct 05 02:27:40.304517 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:27:40.304517 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:27:40.304517 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 32299f2021c340b5b27d2dc4919299cf Oct 05 02:27:40.304517 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-AggregatesAdminTestJSON-1727748590-project-admin Oct 05 02:27:40.304517 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:27:40.304517 n-d-858272-3 devstack@n-api.service[122319]: exception: Aggregate 6 could not be found. Oct 05 02:27:40.304517 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '6'} Oct 05 02:27:40.304517 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:40.305471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:40.305471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 05 02:27:40.305471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 05 02:27:40.305471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 05 02:27:40.305471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 05 02:27:40.305471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:27:40.305471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:27:40.305471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 05 02:27:40.305471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 05 02:27:40.305471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 02:27:40.305471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 02:27:40.305471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 05 02:27:40.305471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 05 02:27:40.305471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Oct 05 02:27:40.305471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:40.305471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:40.305471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:40.305471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:40.305471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:40.307401 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:40.307401 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:40.307401 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:40.307401 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:40.307401 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:40.307401 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 05 02:27:40.307401 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:27:40.307401 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Oct 05 02:27:40.307401 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:40.307401 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:40.307401 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:40.307401 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:40.307401 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:40.307401 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:40.307401 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:27:40.307401 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:27:40.307401 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Oct 05 02:27:40.307401 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:40.309950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fea7d882-f806-408a-bc47-ae66a4a96ed8 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858272-3"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:40.314560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ec7990f6-0caa-47ff-8dc0-faee969a8e1e tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:40.322006 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ec7990f6-0caa-47ff-8dc0-faee969a8e1e tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.057923 Oct 05 02:27:40.322893 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 130/248] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Oct 5 02:27:40 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:27:40.332790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2a4621ed-9034-4dd9-bfee-97ac21d03bb7 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:40.364416 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-2a4621ed-9034-4dd9-bfee-97ac21d03bb7 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Oct 05 02:27:40.366733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2a4621ed-9034-4dd9-bfee-97ac21d03bb7 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Request method failure captured: Oct 05 02:27:40.366733 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 05 02:27:40.366733 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:27:40.366733 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:27:40.366733 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:27:40.366733 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:27:40.366733 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:27:40.366733 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:27:40.366733 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:27:40.366733 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:40.366733 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOtki3pYg1EcZ3TMCtpM0KN2C1AM4b8rJPMgNpjvzjYwIkGgPHp23Tnt0qOG_WDUQTpMx8FDtJ955Ead3Z0sNioRQ0wqSdPYz5_pUidlVu5qp_1pdoQxe5TSTsMXTJjwR2qFJJ_xaqJJ_-ZxZm88H3BA2nVBgBCdmD2UhCXNRis2ex8 Oct 05 02:27:40.366733 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:27:40.366733 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:27:40.366733 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:27:40.366733 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:27:40.366733 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:27:40.366733 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:27:40.366733 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 9dfcd8da86654d8985bf3ce1d8bbca81 Oct 05 02:27:40.366733 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-AggregatesAdminTestJSON-1727748590 Oct 05 02:27:40.366733 n-d-858272-3 devstack@n-api.service[122319]: X-Role: admin,member,reader Oct 05 02:27:40.366733 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: admin,member,reader Oct 05 02:27:40.367899 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9dfcd8da86654d8985bf3ce1d8bbca81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9dfcd8da86654d8985bf3ce1d8bbca81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9dfcd8da86654d8985bf3ce1d8bbca81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9dfcd8da86654d8985bf3ce1d8bbca81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:40.367899 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-AggregatesAdminTestJSON-1727748590 Oct 05 02:27:40.367899 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 9dfcd8da86654d8985bf3ce1d8bbca81 Oct 05 02:27:40.367899 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1727748590 Oct 05 02:27:40.367899 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-AggregatesAdminTestJSON-1727748590-project-admin Oct 05 02:27:40.367899 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:27:40.367899 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:27:40.367899 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 32299f2021c340b5b27d2dc4919299cf Oct 05 02:27:40.367899 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-AggregatesAdminTestJSON-1727748590-project-admin Oct 05 02:27:40.367899 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:27:40.367899 n-d-858272-3 devstack@n-api.service[122319]: exception: Aggregate 6 could not be found. Oct 05 02:27:40.367899 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '6'} Oct 05 02:27:40.367899 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:40.368589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:40.368589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 05 02:27:40.368589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 05 02:27:40.368589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 05 02:27:40.368589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 05 02:27:40.368589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:27:40.368589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:27:40.368589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:27:40.368589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:27:40.368589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 05 02:27:40.368589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 05 02:27:40.368589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 05 02:27:40.368589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 05 02:27:40.368589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:27:40.368589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:27:40.368589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 05 02:27:40.368589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 05 02:27:40.368589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 02:27:40.368589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 02:27:40.369677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 05 02:27:40.369677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 05 02:27:40.369677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Oct 05 02:27:40.369677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:40.369677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:40.369677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:40.369677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:40.369677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:40.369677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:40.369677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:40.369677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:40.369677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:40.369677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:40.369677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 05 02:27:40.369677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:27:40.369677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Oct 05 02:27:40.369677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:40.369677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:40.369677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:40.369677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:40.369677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:40.370787 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:40.370787 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:27:40.370787 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:27:40.370787 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Oct 05 02:27:40.370787 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:40.371055 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fea7d882-f806-408a-bc47-ae66a4a96ed8 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:40.371055 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fea7d882-f806-408a-bc47-ae66a4a96ed8 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:40.371055 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fea7d882-f806-408a-bc47-ae66a4a96ed8 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:40.375371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2a4621ed-9034-4dd9-bfee-97ac21d03bb7 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:40.376510 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2a4621ed-9034-4dd9-bfee-97ac21d03bb7 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.049133 Oct 05 02:27:40.377647 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 131/249] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 5 02:27:40 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:27:40.389216 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-46dc3e64-86a6-4f19-9328-cd732742c532 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1011356234", "name": "tempest-test_aggregate-1685136524"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:40.399105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.aggregate [None req-46dc3e64-86a6-4f19-9328-cd732742c532 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Generated uuid e7882712-5585-4b69-8e51-b38e61e1fbf6 for aggregate {{(pid=122319) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 02:27:40.452102 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-fea7d882-f806-408a-bc47-ae66a4a96ed8 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] HTTP exception thrown: Aggregate 7 already has host n-h2-858272-3. Oct 05 02:27:40.458014 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-46dc3e64-86a6-4f19-9328-cd732742c532 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.073909 Oct 05 02:27:40.459245 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 132/250] 10.222.0.16 () {60 vars in 1165 bytes} [Wed Oct 5 02:27:40 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:27:40.471508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0669ffb4-75ba-4589-86c0-bfd148004011 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:40.473562 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fea7d882-f806-408a-bc47-ae66a4a96ed8 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Request method failure captured: Oct 05 02:27:40.473562 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/os-aggregates/7/action HTTP/1.1 Oct 05 02:27:40.473562 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:27:40.473562 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:27:40.473562 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:27:40.473562 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 39 Oct 05 02:27:40.473562 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:27:40.473562 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:27:40.473562 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:27:40.473562 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:40.473562 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOtkEhzREfPXqLqI8d6-zMRFJKz1RRQHVMgEvHtZD2MetvSbN6IHdZD8h9jZyiP7lH7K6I-_rAbq9lId8IWT1L0VYq8IJs9P92HgwBzDC1nkF5J0_4GtJX9m1EevDZT8JvoanJrHNKnshymTig0StdHjFnAqWIywDgpFL8PWzLVnNms Oct 05 02:27:40.473562 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:27:40.473562 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:27:40.473562 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:27:40.473562 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:27:40.473562 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:27:40.473562 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:27:40.473562 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 58b7759803984da1ae71aa71f3ca3380 Oct 05 02:27:40.473562 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-506305802 Oct 05 02:27:40.473562 n-d-858272-3 devstack@n-api.service[122320]: X-Role: admin,member,reader Oct 05 02:27:40.473562 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: admin,member,reader Oct 05 02:27:40.475141 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58b7759803984da1ae71aa71f3ca3380"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58b7759803984da1ae71aa71f3ca3380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/58b7759803984da1ae71aa71f3ca3380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_58b7759803984da1ae71aa71f3ca3380"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:40.475141 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-506305802 Oct 05 02:27:40.475141 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 58b7759803984da1ae71aa71f3ca3380 Oct 05 02:27:40.475141 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-506305802 Oct 05 02:27:40.475141 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin Oct 05 02:27:40.475141 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:27:40.475141 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:27:40.475141 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: e1ec0ed07d184f4dabc88050c82423f2 Oct 05 02:27:40.475141 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin Oct 05 02:27:40.475141 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:27:40.475141 n-d-858272-3 devstack@n-api.service[122320]: {"add_host": {"host": "n-h2-858272-3"}} Oct 05 02:27:40.475141 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:27:40.475141 n-d-858272-3 devstack@n-api.service[122320]: exception: Aggregate 7 already has host n-h2-858272-3. Oct 05 02:27:40.476006 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '7', 'body': {'add_host': {'host': 'n-h2-858272-3'}}} Oct 05 02:27:40.476006 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:40.476006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:40.476006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 05 02:27:40.476006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 05 02:27:40.476006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 05 02:27:40.476006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 05 02:27:40.476006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 05 02:27:40.476006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 05 02:27:40.476006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 05 02:27:40.476006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 05 02:27:40.476006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 05 02:27:40.476006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 05 02:27:40.476006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 05 02:27:40.476006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result.read() Oct 05 02:27:40.476006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 05 02:27:40.476006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 05 02:27:40.476006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 05 02:27:40.476006 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 05 02:27:40.477383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 05 02:27:40.477383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 05 02:27:40.477383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 05 02:27:40.477383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 05 02:27:40.477383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-858272-3-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 05 02:27:40.477383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:40.477383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 05 02:27:40.477383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:40.477383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:40.477383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 05 02:27:40.477383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 05 02:27:40.477383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 05 02:27:40.477383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi session.flush() Oct 05 02:27:40.477383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 05 02:27:40.477383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 05 02:27:40.477383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 05 02:27:40.477383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 05 02:27:40.477383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 05 02:27:40.477383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 05 02:27:40.478735 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 05 02:27:40.478735 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception Oct 05 02:27:40.478735 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 05 02:27:40.478735 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 05 02:27:40.478735 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 05 02:27:40.478735 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 05 02:27:40.478735 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 05 02:27:40.478735 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 05 02:27:40.478735 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 05 02:27:40.478735 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 05 02:27:40.478735 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 05 02:27:40.478735 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 05 02:27:40.478735 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 05 02:27:40.478735 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 05 02:27:40.478735 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 05 02:27:40.478735 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 05 02:27:40.478735 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 05 02:27:40.478735 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 05 02:27:40.480032 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 05 02:27:40.480032 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 05 02:27:40.480032 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 05 02:27:40.480032 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 05 02:27:40.480032 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 05 02:27:40.480032 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception Oct 05 02:27:40.480032 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 05 02:27:40.480032 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 05 02:27:40.480032 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 05 02:27:40.480032 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 05 02:27:40.480032 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 05 02:27:40.480032 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 05 02:27:40.480032 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 05 02:27:40.480032 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 05 02:27:40.480032 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 05 02:27:40.480032 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 05 02:27:40.480032 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 05 02:27:40.480032 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result.read() Oct 05 02:27:40.481584 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 05 02:27:40.481584 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 05 02:27:40.481584 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 05 02:27:40.481584 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 05 02:27:40.481584 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 05 02:27:40.481584 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 05 02:27:40.481584 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 05 02:27:40.481584 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 05 02:27:40.481584 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-858272-3-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 05 02:27:40.481584 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 05 02:27:40.481584 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 5, 2, 27, 40, 419147), 'updated_at': None, 'host': 'n-h2-858272-3', 'aggregate_id': 7}] Oct 05 02:27:40.481584 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 05 02:27:40.481584 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:40.481584 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:40.481584 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:40.481584 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:40.481584 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 05 02:27:40.484046 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 05 02:27:40.484046 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 05 02:27:40.484046 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 05 02:27:40.484046 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:27:40.484046 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:27:40.484046 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:27:40.484046 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:27:40.484046 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 05 02:27:40.484046 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 05 02:27:40.484046 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 05 02:27:40.484046 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 05 02:27:40.484046 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 05 02:27:40.484046 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 05 02:27:40.484046 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 05 02:27:40.484046 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 05 02:27:40.484046 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 05 02:27:40.484046 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 05 02:27:40.484046 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 7 already has host n-h2-858272-3. Oct 05 02:27:40.484046 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:40.484046 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:40.485633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:40.485633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:40.485633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:40.485633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:40.485633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:40.485633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:40.485633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:40.485633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:40.485633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:27:40.485633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:27:40.485633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 05 02:27:40.485633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 05 02:27:40.485633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 7 already has host n-h2-858272-3. Oct 05 02:27:40.485633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:40.485633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:40.485633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:40.485633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:40.485633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:40.485633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:40.485633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:27:40.485633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:27:40.487263 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 already has host n-h2-858272-3. Oct 05 02:27:40.487263 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:40.489011 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fea7d882-f806-408a-bc47-ae66a4a96ed8 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Returning 409 to user: Aggregate 7 already has host n-h2-858272-3. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:40.490070 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fea7d882-f806-408a-bc47-ae66a4a96ed8 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/7/action" status: 409 len: 95 microversion: 2.1 time: 0.191244 Oct 05 02:27:40.490831 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 119/251] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 5 02:27:40 2022] POST /compute/v2.1/os-aggregates/7/action => generated 95 bytes in 193 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 05 02:27:40.500417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f0eb9bcc-b89d-48e8-bae3-059305c0c880 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858272-3"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:40.524141 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0eb9bcc-b89d-48e8-bae3-059305c0c880 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:40.525092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0eb9bcc-b89d-48e8-bae3-059305c0c880 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:40.525717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0eb9bcc-b89d-48e8-bae3-059305c0c880 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:40.531847 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0669ffb4-75ba-4589-86c0-bfd148004011 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.064973 Oct 05 02:27:40.532585 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 133/252] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 5 02:27:40 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 05 02:27:40.541014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8d8d856f-3954-4cfd-a6fa-45f6625b4b52 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:40.563816 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-8d8d856f-3954-4cfd-a6fa-45f6625b4b52 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Oct 05 02:27:40.566576 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8d8d856f-3954-4cfd-a6fa-45f6625b4b52 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Request method failure captured: Oct 05 02:27:40.566576 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 05 02:27:40.566576 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:27:40.566576 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:27:40.566576 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:27:40.566576 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:27:40.566576 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:27:40.566576 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:27:40.566576 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:27:40.566576 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:40.566576 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOtki3pYg1EcZ3TMCtpM0KN2C1AM4b8rJPMgNpjvzjYwIkGgPHp23Tnt0qOG_WDUQTpMx8FDtJ955Ead3Z0sNioRQ0wqSdPYz5_pUidlVu5qp_1pdoQxe5TSTsMXTJjwR2qFJJ_xaqJJ_-ZxZm88H3BA2nVBgBCdmD2UhCXNRis2ex8 Oct 05 02:27:40.566576 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:27:40.566576 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:27:40.566576 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:27:40.566576 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:27:40.566576 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:27:40.566576 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:27:40.566576 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 9dfcd8da86654d8985bf3ce1d8bbca81 Oct 05 02:27:40.566576 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-AggregatesAdminTestJSON-1727748590 Oct 05 02:27:40.566576 n-d-858272-3 devstack@n-api.service[122319]: X-Role: admin,member,reader Oct 05 02:27:40.566576 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: admin,member,reader Oct 05 02:27:40.568073 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9dfcd8da86654d8985bf3ce1d8bbca81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9dfcd8da86654d8985bf3ce1d8bbca81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9dfcd8da86654d8985bf3ce1d8bbca81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9dfcd8da86654d8985bf3ce1d8bbca81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:40.568073 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-AggregatesAdminTestJSON-1727748590 Oct 05 02:27:40.568073 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 9dfcd8da86654d8985bf3ce1d8bbca81 Oct 05 02:27:40.568073 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1727748590 Oct 05 02:27:40.568073 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-AggregatesAdminTestJSON-1727748590-project-admin Oct 05 02:27:40.568073 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:27:40.568073 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:27:40.568073 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 32299f2021c340b5b27d2dc4919299cf Oct 05 02:27:40.568073 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-AggregatesAdminTestJSON-1727748590-project-admin Oct 05 02:27:40.568073 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:27:40.568073 n-d-858272-3 devstack@n-api.service[122319]: exception: Aggregate 8 could not be found. Oct 05 02:27:40.568073 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '8'} Oct 05 02:27:40.568073 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:40.568790 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:40.568790 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 05 02:27:40.568790 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 05 02:27:40.568790 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 05 02:27:40.568790 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 05 02:27:40.568790 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:27:40.568790 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:27:40.568790 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 05 02:27:40.568790 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 05 02:27:40.568790 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 02:27:40.568790 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 02:27:40.568790 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 05 02:27:40.568790 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 05 02:27:40.568790 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Oct 05 02:27:40.568790 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:40.568790 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:40.568790 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:40.568790 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:40.568790 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:40.569833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:40.569833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:40.569833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:40.569833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:40.569833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:40.569833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 05 02:27:40.569833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:27:40.569833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Oct 05 02:27:40.569833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:40.569833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:40.569833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:40.569833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:40.569833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:40.569833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:40.569833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:27:40.569833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:27:40.569833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Oct 05 02:27:40.569833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:40.572339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8d8d856f-3954-4cfd-a6fa-45f6625b4b52 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:40.574863 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8d8d856f-3954-4cfd-a6fa-45f6625b4b52 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.037445 Oct 05 02:27:40.577901 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 134/253] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Oct 5 02:27:40 2022] GET /compute/v2.1/os-aggregates/8 => generated 77 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:27:40.586333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0a078a17-4eb4-40a3-a26d-91c97cfaba9b tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:40.609215 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-0a078a17-4eb4-40a3-a26d-91c97cfaba9b tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Oct 05 02:27:40.615900 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0a078a17-4eb4-40a3-a26d-91c97cfaba9b tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Request method failure captured: Oct 05 02:27:40.615900 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 05 02:27:40.615900 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:27:40.615900 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:27:40.615900 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:27:40.615900 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:27:40.615900 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:27:40.615900 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:27:40.615900 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:27:40.615900 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:40.615900 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOtki3pYg1EcZ3TMCtpM0KN2C1AM4b8rJPMgNpjvzjYwIkGgPHp23Tnt0qOG_WDUQTpMx8FDtJ955Ead3Z0sNioRQ0wqSdPYz5_pUidlVu5qp_1pdoQxe5TSTsMXTJjwR2qFJJ_xaqJJ_-ZxZm88H3BA2nVBgBCdmD2UhCXNRis2ex8 Oct 05 02:27:40.615900 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:27:40.615900 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:27:40.615900 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:27:40.615900 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:27:40.615900 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:27:40.615900 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:27:40.615900 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 9dfcd8da86654d8985bf3ce1d8bbca81 Oct 05 02:27:40.615900 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-AggregatesAdminTestJSON-1727748590 Oct 05 02:27:40.615900 n-d-858272-3 devstack@n-api.service[122319]: X-Role: admin,member,reader Oct 05 02:27:40.615900 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: admin,member,reader Oct 05 02:27:40.617133 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9dfcd8da86654d8985bf3ce1d8bbca81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9dfcd8da86654d8985bf3ce1d8bbca81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9dfcd8da86654d8985bf3ce1d8bbca81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9dfcd8da86654d8985bf3ce1d8bbca81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:40.617133 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-AggregatesAdminTestJSON-1727748590 Oct 05 02:27:40.617133 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 9dfcd8da86654d8985bf3ce1d8bbca81 Oct 05 02:27:40.617133 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1727748590 Oct 05 02:27:40.617133 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-AggregatesAdminTestJSON-1727748590-project-admin Oct 05 02:27:40.617133 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:27:40.617133 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:27:40.617133 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 32299f2021c340b5b27d2dc4919299cf Oct 05 02:27:40.617133 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-AggregatesAdminTestJSON-1727748590-project-admin Oct 05 02:27:40.617133 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:27:40.617133 n-d-858272-3 devstack@n-api.service[122319]: exception: Aggregate 8 could not be found. Oct 05 02:27:40.617133 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '8'} Oct 05 02:27:40.617133 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:40.617828 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:40.617828 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 05 02:27:40.617828 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 05 02:27:40.617828 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 05 02:27:40.617828 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 05 02:27:40.617828 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:27:40.617828 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:27:40.617828 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:27:40.617828 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:27:40.617828 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 05 02:27:40.617828 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 05 02:27:40.617828 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 05 02:27:40.617828 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 05 02:27:40.617828 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:27:40.617828 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:27:40.617828 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 05 02:27:40.617828 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 05 02:27:40.617828 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 02:27:40.617828 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 02:27:40.618878 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 05 02:27:40.618878 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 05 02:27:40.618878 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Oct 05 02:27:40.618878 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:40.618878 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:40.618878 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:40.618878 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:40.618878 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:40.618878 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:40.618878 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:40.618878 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:40.618878 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:40.618878 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:40.618878 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 05 02:27:40.618878 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:27:40.618878 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Oct 05 02:27:40.618878 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:40.618878 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:40.618878 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:40.618878 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:40.618878 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:40.621255 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:40.621255 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:27:40.621255 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:27:40.621255 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Oct 05 02:27:40.621255 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:40.623929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0a078a17-4eb4-40a3-a26d-91c97cfaba9b tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:40.629146 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0a078a17-4eb4-40a3-a26d-91c97cfaba9b tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.045515 Oct 05 02:27:40.630376 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 135/254] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 5 02:27:40 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 77 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 05 02:27:40.642395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-aaead3b9-8c33-4a0a-ba1f-e1f33552ffd3 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-817635451"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:40.646524 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.aggregate [None req-aaead3b9-8c33-4a0a-ba1f-e1f33552ffd3 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Generated uuid 7402e73d-2c33-4ee4-b4f5-91b7a4211702 for aggregate {{(pid=122319) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 02:27:40.708751 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-aaead3b9-8c33-4a0a-ba1f-e1f33552ffd3 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.072843 Oct 05 02:27:40.714277 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 136/255] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 5 02:27:40 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:40.728944 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-41103901-8c0d-44ee-aa17-9d2fe9da37b1 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:40.759212 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-41103901-8c0d-44ee-aa17-9d2fe9da37b1 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 226 microversion: 2.1 time: 0.037700 Oct 05 02:27:40.766695 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 137/256] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Oct 5 02:27:40 2022] GET /compute/v2.1/os-aggregates/9 => generated 226 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:40.778705 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f0eb9bcc-b89d-48e8-bae3-059305c0c880 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 226 microversion: 2.1 time: 0.282647 Oct 05 02:27:40.788437 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 120/257] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 5 02:27:40 2022] POST /compute/v2.1/os-aggregates/7/action => generated 226 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:27:40.789450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5ed3c442-b367-4f73-8853-c1bd502dee60 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:40.793287 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a21bdae0-c780-460b-91fb-3e9a18f5212d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:40.794020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a21bdae0-c780-460b-91fb-3e9a18f5212d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:40.800837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a21bdae0-c780-460b-91fb-3e9a18f5212d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:40.801112 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a21bdae0-c780-460b-91fb-3e9a18f5212d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:40.801528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a21bdae0-c780-460b-91fb-3e9a18f5212d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:40.802241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a21bdae0-c780-460b-91fb-3e9a18f5212d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:40.802699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a21bdae0-c780-460b-91fb-3e9a18f5212d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:40.803129 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a21bdae0-c780-460b-91fb-3e9a18f5212d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:40.852120 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5ed3c442-b367-4f73-8853-c1bd502dee60 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 264 microversion: 2.1 time: 0.071560 Oct 05 02:27:40.852733 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 121/258] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Oct 5 02:27:40 2022] POST /compute/v2.1/os-aggregates/9/action => generated 264 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:40.858452 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5cae3828-3aa3-4775-bafc-af98929248ad tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:40.901209 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5cae3828-3aa3-4775-bafc-af98929248ad tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.047167 Oct 05 02:27:40.904016 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 122/259] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 5 02:27:40 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 02:27:40.925925 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-64fec0a3-268a-456c-88f2-8cefe1066b8c tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:40.939041 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-64fec0a3-268a-456c-88f2-8cefe1066b8c tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 240 microversion: 2.1 time: 0.033792 Oct 05 02:27:40.939820 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 123/260] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Oct 5 02:27:40 2022] GET /compute/v2.1/os-aggregates/9 => generated 240 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:40.959934 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-44bfda4a-506e-4051-b97c-8919f0a6b7dc tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-76803502"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:40.964172 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.aggregate [None req-44bfda4a-506e-4051-b97c-8919f0a6b7dc tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Generated uuid 306ad16f-411d-46a8-9626-6ee50c0123f0 for aggregate {{(pid=122320) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 02:27:40.998256 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-44bfda4a-506e-4051-b97c-8919f0a6b7dc tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.054015 Oct 05 02:27:41.004420 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 124/261] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 5 02:27:40 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:41.009619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2cd503a4-d30c-450a-a722-304c58327d20 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:41.078590 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2cd503a4-d30c-450a-a722-304c58327d20 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.072159 Oct 05 02:27:41.083324 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 125/262] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 5 02:27:41 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 02:27:41.371027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a21bdae0-c780-460b-91fb-3e9a18f5212d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:41.378411 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:41.388072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a21bdae0-c780-460b-91fb-3e9a18f5212d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:41.390834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a21bdae0-c780-460b-91fb-3e9a18f5212d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:41.393096 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a21bdae0-c780-460b-91fb-3e9a18f5212d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 200 len: 1361 microversion: 2.25 time: 0.631548 Oct 05 02:27:41.397219 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 138/263] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:27:40 2022] GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 1361 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:27:41.406167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-72be5d88-e38c-4549-a950-96606ac20d06 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-898083753", "availability_zone": "tempest-test_az-1245449404"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:41.416487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.aggregate [None req-72be5d88-e38c-4549-a950-96606ac20d06 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Generated uuid 425cdcc8-3718-4f68-9e00-00c11a2bf85c for aggregate {{(pid=122319) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 02:27:41.479034 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-72be5d88-e38c-4549-a950-96606ac20d06 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.076440 Oct 05 02:27:41.483534 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 139/264] 10.222.0.16 () {60 vars in 1165 bytes} [Wed Oct 5 02:27:41 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:41.491177 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c9ade55c-56cd-425d-90c0-b4a41d23646c tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:41.495834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c9ade55c-56cd-425d-90c0-b4a41d23646c tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: 1a0dac23-a7fb-40cf-b2bc-849859ea8197] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:41.504165 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-604090b8-5f32-4846-a1ea-e07f71b44cfb tempest-AggregatesAdminNegativeTestJSON-795497844 tempest-AggregatesAdminNegativeTestJSON-795497844-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858272-3"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:41.508722 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-604090b8-5f32-4846-a1ea-e07f71b44cfb tempest-AggregatesAdminNegativeTestJSON-795497844 tempest-AggregatesAdminNegativeTestJSON-795497844-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'b9f07b094c2b47638554b9271e74d053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59141ab746f4d1f9f9ddf9f5a2d3d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:41.510479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-604090b8-5f32-4846-a1ea-e07f71b44cfb tempest-AggregatesAdminNegativeTestJSON-795497844 tempest-AggregatesAdminNegativeTestJSON-795497844-project] Request method failure captured: Oct 05 02:27:41.510479 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Oct 05 02:27:41.510479 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:27:41.510479 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:27:41.510479 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:27:41.510479 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 39 Oct 05 02:27:41.510479 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:27:41.510479 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:27:41.510479 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:27:41.510479 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:41.510479 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOth79u85F--3nF2Qh7WF45l6GuGKdnA3SIyAKVB0hhDRdlZ6vTfKT7986qaO5ZnYc7JpHFCa2gH5kP-1ZFLd8nKDjSMaAajpTq8JuAWNXUmu5w4uuL8AQGuXwuLMvJmHRiBgVwIbjFd2ysOtFEcp7d7vYQzhyMYwabZkqxA1nXCkW4 Oct 05 02:27:41.510479 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:27:41.510479 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:27:41.510479 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:27:41.510479 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:27:41.510479 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:27:41.510479 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:27:41.510479 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: b59141ab746f4d1f9f9ddf9f5a2d3d60 Oct 05 02:27:41.510479 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-795497844 Oct 05 02:27:41.510479 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:27:41.510479 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:27:41.511915 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b59141ab746f4d1f9f9ddf9f5a2d3d60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b59141ab746f4d1f9f9ddf9f5a2d3d60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b59141ab746f4d1f9f9ddf9f5a2d3d60"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b59141ab746f4d1f9f9ddf9f5a2d3d60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:41.511915 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-795497844 Oct 05 02:27:41.511915 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: b59141ab746f4d1f9f9ddf9f5a2d3d60 Oct 05 02:27:41.511915 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-795497844 Oct 05 02:27:41.511915 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-AggregatesAdminNegativeTestJSON-795497844-project Oct 05 02:27:41.511915 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:27:41.511915 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:27:41.511915 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: b9f07b094c2b47638554b9271e74d053 Oct 05 02:27:41.511915 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-795497844-project Oct 05 02:27:41.511915 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:27:41.511915 n-d-858272-3 devstack@n-api.service[122320]: {"add_host": {"host": "n-h2-858272-3"}} Oct 05 02:27:41.511915 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:27:41.511915 n-d-858272-3 devstack@n-api.service[122320]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 05 02:27:41.512877 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '10', 'body': {'add_host': {'host': 'n-h2-858272-3'}}} Oct 05 02:27:41.512877 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:41.512877 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:41.512877 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:41.512877 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:41.512877 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:41.512877 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:41.512877 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:41.512877 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:41.512877 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:27:41.512877 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:27:41.512877 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 05 02:27:41.512877 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 05 02:27:41.512877 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 02:27:41.512877 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 02:27:41.512877 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 02:27:41.512877 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 02:27:41.512877 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:27:41.512877 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:27:41.513918 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:27:41.513918 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:27:41.513918 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 02:27:41.513918 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 02:27:41.513918 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 02:27:41.513918 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 02:27:41.513918 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:27:41.513918 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 02:27:41.513918 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 05 02:27:41.513918 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:41.513918 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:41.513918 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:41.513918 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:41.513918 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:41.513918 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:41.513918 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 02:27:41.513918 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 02:27:41.513918 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 05 02:27:41.513918 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:41.516924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-604090b8-5f32-4846-a1ea-e07f71b44cfb tempest-AggregatesAdminNegativeTestJSON-795497844 tempest-AggregatesAdminNegativeTestJSON-795497844-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:41.517811 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-604090b8-5f32-4846-a1ea-e07f71b44cfb tempest-AggregatesAdminNegativeTestJSON-795497844 tempest-AggregatesAdminNegativeTestJSON-795497844-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates/10/action" status: 403 len: 118 microversion: 2.1 time: 0.430950 Oct 05 02:27:41.518376 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9ade55c-56cd-425d-90c0-b4a41d23646c tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:41.518488 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 126/265] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Oct 5 02:27:41 2022] POST /compute/v2.1/os-aggregates/10/action => generated 118 bytes in 434 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:27:41.519825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9ade55c-56cd-425d-90c0-b4a41d23646c tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:41.524224 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9ade55c-56cd-425d-90c0-b4a41d23646c tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:41.525266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9ade55c-56cd-425d-90c0-b4a41d23646c tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:41.525953 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9ade55c-56cd-425d-90c0-b4a41d23646c tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:41.526604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9ade55c-56cd-425d-90c0-b4a41d23646c tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:41.535391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-afdb84fe-3c47-4888-ae33-4b0a9fdc0593 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-898083753_new", "availability_zone": "tempest-test_az-1245449404_new"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:41.799729 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afdb84fe-3c47-4888-ae33-4b0a9fdc0593 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:41.801730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afdb84fe-3c47-4888-ae33-4b0a9fdc0593 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:41.802205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afdb84fe-3c47-4888-ae33-4b0a9fdc0593 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:41.832384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:41.873530 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-afdb84fe-3c47-4888-ae33-4b0a9fdc0593 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/11" status: 200 len: 336 microversion: 2.1 time: 0.352735 Oct 05 02:27:41.882357 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 127/266] 10.222.0.16 () {60 vars in 1173 bytes} [Wed Oct 5 02:27:41 2022] PUT /compute/v2.1/os-aggregates/11 => generated 336 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:41.891571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2b29a292-50b6-48cb-bb83-22dda2bb3c67 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:41.933190 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2b29a292-50b6-48cb-bb83-22dda2bb3c67 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.054606 Oct 05 02:27:41.934202 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 128/267] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 5 02:27:41 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 02:27:41.946849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-aa33302e-c21f-48d0-956f-c7c0c9d9c70f tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:41.965248 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-aa33302e-c21f-48d0-956f-c7c0c9d9c70f tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 339 microversion: 2.1 time: 0.028592 Oct 05 02:27:41.970804 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 129/268] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 5 02:27:41 2022] GET /compute/v2.1/os-aggregates => generated 339 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:41.982134 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9d5d536e-357a-4bef-89ef-bac794a06854 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-233413981"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:41.989199 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.aggregate [None req-9d5d536e-357a-4bef-89ef-bac794a06854 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Generated uuid 4f09050d-fcd1-456d-b4ca-6fdf9ad654b9 for aggregate {{(pid=122320) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 02:27:42.009405 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c9ade55c-56cd-425d-90c0-b4a41d23646c tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:42.021553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=12,nova_api:INSERT=8,nova_api:UPDATE=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:42.040147 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9d5d536e-357a-4bef-89ef-bac794a06854 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.064301 Oct 05 02:27:42.044636 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c9ade55c-56cd-425d-90c0-b4a41d23646c tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197" status: 200 len: 1317 microversion: 2.1 time: 0.559686 Oct 05 02:27:42.047417 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 140/269] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:41 2022] GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197 => generated 1317 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:42.048336 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 130/270] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 5 02:27:41 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:42.063077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c7963ad9-9cd6-41b1-a699-225ace6accb7 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1339454253"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:42.080164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ea7c4cd0-a4fa-4e87-b3b8-e4a8df079929 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:42.084627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7963ad9-9cd6-41b1-a699-225ace6accb7 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:42.085435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7963ad9-9cd6-41b1-a699-225ace6accb7 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:42.086117 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7963ad9-9cd6-41b1-a699-225ace6accb7 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:42.096493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7963ad9-9cd6-41b1-a699-225ace6accb7 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:42.098264 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7963ad9-9cd6-41b1-a699-225ace6accb7 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:42.099108 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7963ad9-9cd6-41b1-a699-225ace6accb7 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:42.109134 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-c7963ad9-9cd6-41b1-a699-225ace6accb7 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1339454253 could not be found. Oct 05 02:27:42.112133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c7963ad9-9cd6-41b1-a699-225ace6accb7 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Request method failure captured: Oct 05 02:27:42.112133 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Oct 05 02:27:42.112133 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:27:42.112133 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:27:42.112133 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:27:42.112133 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 58 Oct 05 02:27:42.112133 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:27:42.112133 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:27:42.112133 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:27:42.112133 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:42.112133 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOtkEhzREfPXqLqI8d6-zMRFJKz1RRQHVMgEvHtZD2MetvSbN6IHdZD8h9jZyiP7lH7K6I-_rAbq9lId8IWT1L0VYq8IJs9P92HgwBzDC1nkF5J0_4GtJX9m1EevDZT8JvoanJrHNKnshymTig0StdHjFnAqWIywDgpFL8PWzLVnNms Oct 05 02:27:42.112133 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:27:42.112133 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:27:42.112133 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:27:42.112133 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:27:42.112133 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:27:42.112133 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:27:42.112133 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 58b7759803984da1ae71aa71f3ca3380 Oct 05 02:27:42.112133 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-506305802 Oct 05 02:27:42.112133 n-d-858272-3 devstack@n-api.service[122320]: X-Role: admin,member,reader Oct 05 02:27:42.112133 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: admin,member,reader Oct 05 02:27:42.113499 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58b7759803984da1ae71aa71f3ca3380"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58b7759803984da1ae71aa71f3ca3380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/58b7759803984da1ae71aa71f3ca3380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_58b7759803984da1ae71aa71f3ca3380"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:42.113499 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-506305802 Oct 05 02:27:42.113499 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 58b7759803984da1ae71aa71f3ca3380 Oct 05 02:27:42.113499 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-506305802 Oct 05 02:27:42.113499 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin Oct 05 02:27:42.113499 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:27:42.113499 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:27:42.113499 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: e1ec0ed07d184f4dabc88050c82423f2 Oct 05 02:27:42.113499 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin Oct 05 02:27:42.113499 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:27:42.113499 n-d-858272-3 devstack@n-api.service[122320]: {"add_host": {"host": "tempest-nonexist_host-1339454253"}} Oct 05 02:27:42.113499 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:27:42.113499 n-d-858272-3 devstack@n-api.service[122320]: exception: Compute host tempest-nonexist_host-1339454253 could not be found. Oct 05 02:27:42.114289 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '12', 'body': {'add_host': {'host': 'tempest-nonexist_host-1339454253'}}} Oct 05 02:27:42.114289 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:42.114289 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:42.114289 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 05 02:27:42.114289 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 05 02:27:42.114289 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:27:42.114289 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:27:42.114289 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 05 02:27:42.114289 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 05 02:27:42.114289 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 02:27:42.114289 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 02:27:42.114289 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 05 02:27:42.114289 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 05 02:27:42.114289 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1339454253' is not mapped to any cell Oct 05 02:27:42.114289 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.114289 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:42.114289 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.114289 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:42.114289 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 05 02:27:42.115321 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 05 02:27:42.115321 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 05 02:27:42.115321 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 05 02:27:42.115321 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 05 02:27:42.115321 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.115321 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:42.115321 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.115321 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:42.115321 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 05 02:27:42.115321 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 05 02:27:42.115321 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 05 02:27:42.115321 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 05 02:27:42.115321 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:27:42.115321 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:27:42.115321 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:27:42.115321 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:27:42.115321 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 05 02:27:42.115321 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 05 02:27:42.115321 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 05 02:27:42.115321 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 05 02:27:42.116645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 05 02:27:42.116645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 05 02:27:42.116645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1339454253 could not be found. Oct 05 02:27:42.116645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.116645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:42.116645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.116645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:42.116645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:42.116645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:42.116645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:42.116645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:42.116645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:42.116645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:42.116645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:27:42.116645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:27:42.116645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 05 02:27:42.116645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:27:42.116645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1339454253 could not be found. Oct 05 02:27:42.116645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.116645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:42.116645 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.120545 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:42.120545 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:42.120545 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:42.120545 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:27:42.120545 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:27:42.120545 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1339454253 could not be found. Oct 05 02:27:42.120545 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.122598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c7963ad9-9cd6-41b1-a699-225ace6accb7 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1339454253 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:42.123684 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c7963ad9-9cd6-41b1-a699-225ace6accb7 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/12/action" status: 404 len: 111 microversion: 2.1 time: 0.065001 Oct 05 02:27:42.124793 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 131/271] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Oct 5 02:27:42 2022] POST /compute/v2.1/os-aggregates/12/action => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:27:42.131640 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ea7c4cd0-a4fa-4e87-b3b8-e4a8df079929 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.073875 Oct 05 02:27:42.132624 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 141/272] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 5 02:27:42 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 02:27:42.139102 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ccbe8a37-72a1-47a4-b7f8-40fdfa7c9848 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:42.145728 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f2a7f0e5-ff3e-45cf-8403-2e1861899099 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-796725684"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:42.153331 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.aggregate [None req-f2a7f0e5-ff3e-45cf-8403-2e1861899099 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Generated uuid 67f8c846-6466-49ef-8e96-58e3f7e92f7f for aggregate {{(pid=122319) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 02:27:42.174540 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ccbe8a37-72a1-47a4-b7f8-40fdfa7c9848 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.044446 Oct 05 02:27:42.176583 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 132/273] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 5 02:27:42 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 02:27:42.186850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7bc416fc-859c-45a2-ae77-634da6992bba tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:42.203881 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7bc416fc-859c-45a2-ae77-634da6992bba tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Request method failure captured: Oct 05 02:27:42.203881 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 05 02:27:42.203881 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:27:42.203881 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:27:42.203881 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:27:42.203881 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 283 Oct 05 02:27:42.203881 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:27:42.203881 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:27:42.203881 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:27:42.203881 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:42.203881 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOtkEhzREfPXqLqI8d6-zMRFJKz1RRQHVMgEvHtZD2MetvSbN6IHdZD8h9jZyiP7lH7K6I-_rAbq9lId8IWT1L0VYq8IJs9P92HgwBzDC1nkF5J0_4GtJX9m1EevDZT8JvoanJrHNKnshymTig0StdHjFnAqWIywDgpFL8PWzLVnNms Oct 05 02:27:42.203881 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:27:42.203881 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:27:42.203881 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:27:42.203881 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:27:42.203881 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:27:42.203881 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:27:42.203881 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 58b7759803984da1ae71aa71f3ca3380 Oct 05 02:27:42.203881 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-506305802 Oct 05 02:27:42.203881 n-d-858272-3 devstack@n-api.service[122320]: X-Role: admin,member,reader Oct 05 02:27:42.203881 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: admin,member,reader Oct 05 02:27:42.205263 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58b7759803984da1ae71aa71f3ca3380"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58b7759803984da1ae71aa71f3ca3380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/58b7759803984da1ae71aa71f3ca3380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_58b7759803984da1ae71aa71f3ca3380"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:42.205263 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-506305802 Oct 05 02:27:42.205263 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 58b7759803984da1ae71aa71f3ca3380 Oct 05 02:27:42.205263 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-506305802 Oct 05 02:27:42.205263 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin Oct 05 02:27:42.205263 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:27:42.205263 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:27:42.205263 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: e1ec0ed07d184f4dabc88050c82423f2 Oct 05 02:27:42.205263 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin Oct 05 02:27:42.205263 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:27:42.205836 n-d-858272-3 devstack@n-api.service[122320]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 05 02:27:42.205836 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:27:42.205836 n-d-858272-3 devstack@n-api.service[122320]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 02:27:42.205836 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 05 02:27:42.205836 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:42.205836 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:42.205836 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:27:42.205836 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:27:42.205836 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:27:42.205836 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:27:42.206978 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 02:27:42.206978 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.206978 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 05 02:27:42.206978 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 05 02:27:42.206978 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.206978 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 05 02:27:42.206978 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 05 02:27:42.206978 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.206978 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:42.206978 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.206978 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:42.206978 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:42.206978 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:42.206978 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:42.206978 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:42.206978 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:42.206978 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:42.207891 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:27:42.207891 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:27:42.207891 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 02:27:42.207891 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 02:27:42.207891 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:27:42.207891 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:27:42.207891 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:27:42.207891 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:27:42.207891 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 02:27:42.207891 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.207891 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:42.207891 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.207891 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:42.207891 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:42.207891 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:42.208780 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:27:42.208780 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:27:42.208780 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 02:27:42.208780 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.210880 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7bc416fc-859c-45a2-ae77-634da6992bba tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:42.212153 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7bc416fc-859c-45a2-ae77-634da6992bba tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.030605 Oct 05 02:27:42.214150 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 133/274] 10.222.0.16 () {60 vars in 1165 bytes} [Wed Oct 5 02:27:42 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 05 02:27:42.227308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c09eebab-2251-46dd-a964-37e2f31bde66 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:42.232125 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f2a7f0e5-ff3e-45cf-8403-2e1861899099 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.091094 Oct 05 02:27:42.234669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c09eebab-2251-46dd-a964-37e2f31bde66 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Request method failure captured: Oct 05 02:27:42.234669 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 05 02:27:42.234669 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:27:42.234669 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:27:42.234669 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:27:42.234669 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 27 Oct 05 02:27:42.234669 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:27:42.234669 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:27:42.234669 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:27:42.234669 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:42.234669 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOtkEhzREfPXqLqI8d6-zMRFJKz1RRQHVMgEvHtZD2MetvSbN6IHdZD8h9jZyiP7lH7K6I-_rAbq9lId8IWT1L0VYq8IJs9P92HgwBzDC1nkF5J0_4GtJX9m1EevDZT8JvoanJrHNKnshymTig0StdHjFnAqWIywDgpFL8PWzLVnNms Oct 05 02:27:42.234669 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:27:42.234669 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:27:42.234669 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:27:42.234669 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:27:42.234669 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:27:42.234669 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:27:42.234669 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 58b7759803984da1ae71aa71f3ca3380 Oct 05 02:27:42.234669 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-506305802 Oct 05 02:27:42.234669 n-d-858272-3 devstack@n-api.service[122320]: X-Role: admin,member,reader Oct 05 02:27:42.234669 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: admin,member,reader Oct 05 02:27:42.235857 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58b7759803984da1ae71aa71f3ca3380"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58b7759803984da1ae71aa71f3ca3380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/58b7759803984da1ae71aa71f3ca3380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_58b7759803984da1ae71aa71f3ca3380"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:42.235857 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-506305802 Oct 05 02:27:42.235857 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 58b7759803984da1ae71aa71f3ca3380 Oct 05 02:27:42.235857 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-506305802 Oct 05 02:27:42.235857 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin Oct 05 02:27:42.235857 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:27:42.235857 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:27:42.235857 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: e1ec0ed07d184f4dabc88050c82423f2 Oct 05 02:27:42.235857 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin Oct 05 02:27:42.235857 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:27:42.235857 n-d-858272-3 devstack@n-api.service[122320]: {"aggregate": {"name": ""}} Oct 05 02:27:42.235857 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:27:42.235857 n-d-858272-3 devstack@n-api.service[122320]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 05 02:27:42.236575 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 05 02:27:42.236575 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:42.236575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:42.236575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:27:42.236575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:27:42.236575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:27:42.236575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:27:42.236575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 05 02:27:42.236575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.236575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 05 02:27:42.236575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 05 02:27:42.236575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.236575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 05 02:27:42.236575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi '' Oct 05 02:27:42.236575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.236575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:42.236575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.236575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:42.236575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:42.236575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:42.236575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:42.236575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:42.236575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:42.238452 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:42.238452 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:27:42.238452 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:27:42.238452 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 02:27:42.238452 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 02:27:42.238452 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:27:42.238452 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:27:42.238452 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:27:42.238452 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:27:42.238452 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 05 02:27:42.238452 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.238452 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:42.238452 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.238452 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:42.238452 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:42.238452 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:42.238452 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:27:42.238452 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:27:42.238452 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 05 02:27:42.238452 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.244841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c09eebab-2251-46dd-a964-37e2f31bde66 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:42.246155 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c09eebab-2251-46dd-a964-37e2f31bde66 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.026685 Oct 05 02:27:42.247121 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 142/276] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 5 02:27:42 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:42.247307 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 134/276] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 5 02:27:42 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:27:42.255706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-483e6b32-a432-49de-8c1c-7ab91196ba93 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:42.263567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3e415850-9ea1-45f6-bba6-88cb9cf3ecd2 tempest-AggregatesAdminNegativeTestJSON-795497844 tempest-AggregatesAdminNegativeTestJSON-795497844-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1657418667"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:42.265966 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-483e6b32-a432-49de-8c1c-7ab91196ba93 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.017530 Oct 05 02:27:42.268126 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 135/277] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 5 02:27:42 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:42.280415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-da589092-f22d-4d87-9f3d-716492b77d71 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:42.284287 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3e415850-9ea1-45f6-bba6-88cb9cf3ecd2 tempest-AggregatesAdminNegativeTestJSON-795497844 tempest-AggregatesAdminNegativeTestJSON-795497844-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'b9f07b094c2b47638554b9271e74d053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59141ab746f4d1f9f9ddf9f5a2d3d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:42.293598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3e415850-9ea1-45f6-bba6-88cb9cf3ecd2 tempest-AggregatesAdminNegativeTestJSON-795497844 tempest-AggregatesAdminNegativeTestJSON-795497844-project] Request method failure captured: Oct 05 02:27:42.293598 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 05 02:27:42.293598 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:27:42.293598 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:27:42.293598 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:27:42.293598 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 60 Oct 05 02:27:42.293598 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:27:42.293598 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:27:42.293598 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:27:42.293598 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:42.293598 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOth79u85F--3nF2Qh7WF45l6GuGKdnA3SIyAKVB0hhDRdlZ6vTfKT7986qaO5ZnYc7JpHFCa2gH5kP-1ZFLd8nKDjSMaAajpTq8JuAWNXUmu5w4uuL8AQGuXwuLMvJmHRiBgVwIbjFd2ysOtFEcp7d7vYQzhyMYwabZkqxA1nXCkW4 Oct 05 02:27:42.293598 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:27:42.293598 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:27:42.293598 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:27:42.293598 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:27:42.293598 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:27:42.293598 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:27:42.293598 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: b59141ab746f4d1f9f9ddf9f5a2d3d60 Oct 05 02:27:42.293598 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-795497844 Oct 05 02:27:42.293598 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:27:42.293598 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:27:42.294783 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b59141ab746f4d1f9f9ddf9f5a2d3d60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b59141ab746f4d1f9f9ddf9f5a2d3d60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b59141ab746f4d1f9f9ddf9f5a2d3d60"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b59141ab746f4d1f9f9ddf9f5a2d3d60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:42.294783 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-795497844 Oct 05 02:27:42.294783 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: b59141ab746f4d1f9f9ddf9f5a2d3d60 Oct 05 02:27:42.294783 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-795497844 Oct 05 02:27:42.294783 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-AggregatesAdminNegativeTestJSON-795497844-project Oct 05 02:27:42.294783 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:27:42.294783 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:27:42.294783 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: b9f07b094c2b47638554b9271e74d053 Oct 05 02:27:42.294783 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-795497844-project Oct 05 02:27:42.294783 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:27:42.294783 n-d-858272-3 devstack@n-api.service[122319]: {"aggregate": {"name": "tempest-test_aggregate-1657418667"}} Oct 05 02:27:42.294783 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:27:42.294783 n-d-858272-3 devstack@n-api.service[122319]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 05 02:27:42.295483 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1657418667'}}} Oct 05 02:27:42.295483 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:42.295483 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:42.295483 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:42.295483 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:42.295483 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:42.295483 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:42.295483 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:42.295483 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:42.295483 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:27:42.295483 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:27:42.295483 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:27:42.295483 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:27:42.295483 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 05 02:27:42.295483 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 05 02:27:42.295483 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 02:27:42.295483 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 02:27:42.295483 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 02:27:42.295483 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 02:27:42.296589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:27:42.296589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:27:42.296589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:27:42.296589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:27:42.296589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 02:27:42.296589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 02:27:42.296589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 02:27:42.296589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 02:27:42.296589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:27:42.296589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 02:27:42.296589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 05 02:27:42.296589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.296589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:42.296589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.296589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:42.296589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:42.296589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:42.296589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 02:27:42.296589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 02:27:42.296589 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 05 02:27:42.297709 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.297709 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3e415850-9ea1-45f6-bba6-88cb9cf3ecd2 tempest-AggregatesAdminNegativeTestJSON-795497844 tempest-AggregatesAdminNegativeTestJSON-795497844-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:42.306191 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3e415850-9ea1-45f6-bba6-88cb9cf3ecd2 tempest-AggregatesAdminNegativeTestJSON-795497844 tempest-AggregatesAdminNegativeTestJSON-795497844-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.039908 Oct 05 02:27:42.306864 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 143/278] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 5 02:27:42 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 54 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:27:42.321071 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-da589092-f22d-4d87-9f3d-716492b77d71 tempest-AggregatesAdminTestJSON-1727748590 tempest-AggregatesAdminTestJSON-1727748590-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.044453 Oct 05 02:27:42.322452 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 136/279] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 5 02:27:42 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 02:27:42.327274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-046023e2-c8da-4462-80f8-614eb352fa8a tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-609415543"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:42.332010 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.aggregate [None req-046023e2-c8da-4462-80f8-614eb352fa8a tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Generated uuid 9a426dbd-016d-4b94-aa5b-45976554b3f7 for aggregate {{(pid=122319) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 02:27:42.338012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c998cec9-f53a-4e92-815a-adec37ac5dd7 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:42.339124 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c998cec9-f53a-4e92-815a-adec37ac5dd7 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:42.355948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c998cec9-f53a-4e92-815a-adec37ac5dd7 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:42.361867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c998cec9-f53a-4e92-815a-adec37ac5dd7 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:42.363311 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c998cec9-f53a-4e92-815a-adec37ac5dd7 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:42.364321 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c998cec9-f53a-4e92-815a-adec37ac5dd7 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:42.364936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c998cec9-f53a-4e92-815a-adec37ac5dd7 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:42.365471 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c998cec9-f53a-4e92-815a-adec37ac5dd7 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:42.398585 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-c998cec9-f53a-4e92-815a-adec37ac5dd7 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] HTTP exception thrown: Instance 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 could not be found. Oct 05 02:27:42.400716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c998cec9-f53a-4e92-815a-adec37ac5dd7 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Request method failure captured: Oct 05 02:27:42.400716 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 HTTP/1.1 Oct 05 02:27:42.400716 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:27:42.400716 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:27:42.400716 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:27:42.400716 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:27:42.400716 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:27:42.400716 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:27:42.400716 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:27:42.400716 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:42.400716 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOtheyyEcnHUGF4aq7DRLPFplPfXfYmhaMe5VsqFN1RXvhMVUhpB9xOXAbUV78yupLoVDqGtfpW29TceXmmD2KFo3zF9jnvtwKtqO9kA3Xymy4a2B2LoM7j67Fkql_-rJojFwtzCT_fVmH27_jUweU7lpv5uH0A9q4DYv0oF27QH_u8 Oct 05 02:27:42.400716 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:27:42.400716 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:27:42.400716 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:27:42.400716 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:27:42.400716 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:27:42.400716 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:27:42.400716 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 71b7bb601bea47d88c9ad68be2651451 Oct 05 02:27:42.400716 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-AggregatesAdminTestJSON-174369115 Oct 05 02:27:42.400716 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:27:42.400716 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:27:42.402022 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/71b7bb601bea47d88c9ad68be2651451"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/71b7bb601bea47d88c9ad68be2651451"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/71b7bb601bea47d88c9ad68be2651451"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_71b7bb601bea47d88c9ad68be2651451"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:42.402022 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-AggregatesAdminTestJSON-174369115 Oct 05 02:27:42.402022 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 71b7bb601bea47d88c9ad68be2651451 Oct 05 02:27:42.402022 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-174369115 Oct 05 02:27:42.402022 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-AggregatesAdminTestJSON-174369115-project Oct 05 02:27:42.402022 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:27:42.402022 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:27:42.402022 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: f4aebce7113c4e8980490aa0b0fbb296 Oct 05 02:27:42.402022 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-AggregatesAdminTestJSON-174369115-project Oct 05 02:27:42.402022 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:27:42.402022 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 could not be found. Oct 05 02:27:42.402022 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9'} Oct 05 02:27:42.402723 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:42.402723 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:42.402723 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:27:42.402723 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:27:42.402723 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:27:42.402723 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:27:42.402723 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:27:42.402723 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:27:42.402723 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:27:42.402723 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:27:42.402723 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 could not be found. Oct 05 02:27:42.402723 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.402723 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:42.402723 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.402723 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:42.402723 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:42.402723 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:42.402723 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:42.402723 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:42.402723 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:42.403820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:42.403820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:27:42.403820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:27:42.403820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:27:42.403820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:27:42.403820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:27:42.403820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:27:42.403820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:27:42.403820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:27:42.403820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 could not be found. Oct 05 02:27:42.403820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.403820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:42.403820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.403820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:42.403820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:42.403820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:42.403820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:27:42.403820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:27:42.403820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 could not be found. Oct 05 02:27:42.403820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.404934 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-046023e2-c8da-4462-80f8-614eb352fa8a tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.085242 Oct 05 02:27:42.407539 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 144/280] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 5 02:27:42 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:42.415038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c998cec9-f53a-4e92-815a-adec37ac5dd7 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Returning 404 to user: Instance 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:42.417021 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c998cec9-f53a-4e92-815a-adec37ac5dd7 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] 10.222.0.16 "DELETE /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9" status: 404 len: 111 microversion: 2.1 time: 0.088737 Oct 05 02:27:42.418063 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 137/281] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:27:42 2022] DELETE /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:27:42.420702 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8534c8bb-ca6a-4e95-a411-50dcdacb9e75 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-609415543"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:42.424257 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.aggregate [None req-8534c8bb-ca6a-4e95-a411-50dcdacb9e75 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Generated uuid 098f57ec-466f-4cae-bf0d-a0ddd23e23b9 for aggregate {{(pid=122319) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 02:27:42.426840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-eaa244d8-5839-4944-8fe0-0ab4f7f23565 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:42.427463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-eaa244d8-5839-4944-8fe0-0ab4f7f23565 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] [instance: 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:42.434510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eaa244d8-5839-4944-8fe0-0ab4f7f23565 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:42.435243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eaa244d8-5839-4944-8fe0-0ab4f7f23565 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:42.435852 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eaa244d8-5839-4944-8fe0-0ab4f7f23565 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:42.436715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eaa244d8-5839-4944-8fe0-0ab4f7f23565 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:42.437366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eaa244d8-5839-4944-8fe0-0ab4f7f23565 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:42.437946 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eaa244d8-5839-4944-8fe0-0ab4f7f23565 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:42.461690 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-8534c8bb-ca6a-4e95-a411-50dcdacb9e75 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-609415543 already exists. Oct 05 02:27:42.463799 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-eaa244d8-5839-4944-8fe0-0ab4f7f23565 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] HTTP exception thrown: Instance 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 could not be found. Oct 05 02:27:42.465590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-eaa244d8-5839-4944-8fe0-0ab4f7f23565 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Request method failure captured: Oct 05 02:27:42.465590 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 HTTP/1.1 Oct 05 02:27:42.465590 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:27:42.465590 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:27:42.465590 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:27:42.465590 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:27:42.465590 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:27:42.465590 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:27:42.465590 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:27:42.465590 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:42.465590 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOtheyyEcnHUGF4aq7DRLPFplPfXfYmhaMe5VsqFN1RXvhMVUhpB9xOXAbUV78yupLoVDqGtfpW29TceXmmD2KFo3zF9jnvtwKtqO9kA3Xymy4a2B2LoM7j67Fkql_-rJojFwtzCT_fVmH27_jUweU7lpv5uH0A9q4DYv0oF27QH_u8 Oct 05 02:27:42.465590 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:27:42.465590 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:27:42.465590 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:27:42.465590 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:27:42.465590 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:27:42.465590 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:27:42.465590 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 71b7bb601bea47d88c9ad68be2651451 Oct 05 02:27:42.465590 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-AggregatesAdminTestJSON-174369115 Oct 05 02:27:42.465590 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:27:42.465590 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:27:42.466870 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/71b7bb601bea47d88c9ad68be2651451"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/71b7bb601bea47d88c9ad68be2651451"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/71b7bb601bea47d88c9ad68be2651451"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_71b7bb601bea47d88c9ad68be2651451"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:42.466870 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-AggregatesAdminTestJSON-174369115 Oct 05 02:27:42.466870 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 71b7bb601bea47d88c9ad68be2651451 Oct 05 02:27:42.466870 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-174369115 Oct 05 02:27:42.466870 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-AggregatesAdminTestJSON-174369115-project Oct 05 02:27:42.466870 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:27:42.466870 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:27:42.466870 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: f4aebce7113c4e8980490aa0b0fbb296 Oct 05 02:27:42.466870 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-AggregatesAdminTestJSON-174369115-project Oct 05 02:27:42.466870 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:27:42.466870 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 could not be found. Oct 05 02:27:42.466870 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9'} Oct 05 02:27:42.467536 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:42.467536 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:42.467536 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:27:42.467536 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:27:42.467536 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:27:42.467536 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:27:42.467536 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:27:42.467536 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:27:42.467536 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:27:42.467536 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:27:42.467536 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 could not be found. Oct 05 02:27:42.467536 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.467536 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:42.467536 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.467536 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:42.467536 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:42.467536 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:42.467536 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:42.467536 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:42.467536 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:42.468592 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:42.468592 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:27:42.468592 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:27:42.468592 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:27:42.468592 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:27:42.468592 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:27:42.468592 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:27:42.468592 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 could not be found. Oct 05 02:27:42.468592 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.468592 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:42.468592 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.468592 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:42.468592 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:42.468592 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:42.468592 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:27:42.468592 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:27:42.468592 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 could not be found. Oct 05 02:27:42.468592 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.469630 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8534c8bb-ca6a-4e95-a411-50dcdacb9e75 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Request method failure captured: Oct 05 02:27:42.469630 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 05 02:27:42.469630 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:27:42.469630 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:27:42.469630 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:27:42.469630 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 59 Oct 05 02:27:42.469630 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:27:42.469630 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:27:42.469630 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:27:42.469630 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:42.469630 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOtkEhzREfPXqLqI8d6-zMRFJKz1RRQHVMgEvHtZD2MetvSbN6IHdZD8h9jZyiP7lH7K6I-_rAbq9lId8IWT1L0VYq8IJs9P92HgwBzDC1nkF5J0_4GtJX9m1EevDZT8JvoanJrHNKnshymTig0StdHjFnAqWIywDgpFL8PWzLVnNms Oct 05 02:27:42.469630 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:27:42.469630 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:27:42.469630 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:27:42.469630 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:27:42.469630 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:27:42.469630 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:27:42.469630 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 58b7759803984da1ae71aa71f3ca3380 Oct 05 02:27:42.469630 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-506305802 Oct 05 02:27:42.469630 n-d-858272-3 devstack@n-api.service[122319]: X-Role: admin,member,reader Oct 05 02:27:42.469630 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: admin,member,reader Oct 05 02:27:42.470720 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58b7759803984da1ae71aa71f3ca3380"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58b7759803984da1ae71aa71f3ca3380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/58b7759803984da1ae71aa71f3ca3380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_58b7759803984da1ae71aa71f3ca3380"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:42.470720 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-506305802 Oct 05 02:27:42.470720 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 58b7759803984da1ae71aa71f3ca3380 Oct 05 02:27:42.470720 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-506305802 Oct 05 02:27:42.470720 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin Oct 05 02:27:42.470720 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:27:42.470720 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:27:42.470720 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: e1ec0ed07d184f4dabc88050c82423f2 Oct 05 02:27:42.470720 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin Oct 05 02:27:42.470720 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:27:42.470720 n-d-858272-3 devstack@n-api.service[122319]: {"aggregate": {"name": "tempest-test_aggregate-609415543"}} Oct 05 02:27:42.470720 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:27:42.470720 n-d-858272-3 devstack@n-api.service[122319]: exception: Aggregate tempest-test_aggregate-609415543 already exists. Oct 05 02:27:42.471698 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-609415543'}}} Oct 05 02:27:42.471698 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:42.471698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:42.471698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 05 02:27:42.471698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 05 02:27:42.471698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 05 02:27:42.471698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 05 02:27:42.471698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:27:42.471698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:27:42.471698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:27:42.471698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:27:42.471698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 05 02:27:42.471698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 05 02:27:42.471698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 05 02:27:42.471698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 05 02:27:42.471698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 05 02:27:42.471698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 05 02:27:42.471698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 05 02:27:42.471698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 05 02:27:42.473290 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 02:27:42.473290 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 02:27:42.473290 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 05 02:27:42.473290 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 05 02:27:42.473290 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-609415543 already exists. Oct 05 02:27:42.473290 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.473290 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:42.473290 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.473290 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:42.473290 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:42.473290 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:42.473290 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:42.473290 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:42.473290 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:42.473290 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:42.473290 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:27:42.473290 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:27:42.473290 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:27:42.473290 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:27:42.473290 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 05 02:27:42.474374 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 05 02:27:42.474374 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-609415543 already exists. Oct 05 02:27:42.474374 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.474374 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:42.474374 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.474374 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:42.474374 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:42.474374 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:42.474374 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:27:42.474374 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:27:42.474374 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-609415543 already exists. Oct 05 02:27:42.474374 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.474374 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8534c8bb-ca6a-4e95-a411-50dcdacb9e75 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-609415543 already exists. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:42.474374 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8534c8bb-ca6a-4e95-a411-50dcdacb9e75 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.054513 Oct 05 02:27:42.477799 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 145/282] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 5 02:27:42 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 05 02:27:42.477893 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-eaa244d8-5839-4944-8fe0-0ab4f7f23565 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] Returning 404 to user: Instance 26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:42.477893 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-eaa244d8-5839-4944-8fe0-0ab4f7f23565 tempest-AggregatesAdminTestJSON-174369115 tempest-AggregatesAdminTestJSON-174369115-project] 10.222.0.16 "GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9" status: 404 len: 111 microversion: 2.1 time: 0.055051 Oct 05 02:27:42.478292 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 138/283] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:42 2022] GET /compute/v2.1/servers/26f5c8ce-da4e-4ad8-9cab-6bb4d3f13ea9 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:27:42.484193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-99a07351-576c-4e20-a39c-bb61ec8f69f7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:42.484516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dbedfd4b-c04f-4bdf-b8a3-328ee164a737 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:42.484823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-99a07351-576c-4e20-a39c-bb61ec8f69f7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:42.496282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=8,nova_api:INSERT=9 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:42.505283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99a07351-576c-4e20-a39c-bb61ec8f69f7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:42.505782 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99a07351-576c-4e20-a39c-bb61ec8f69f7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:42.506223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99a07351-576c-4e20-a39c-bb61ec8f69f7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:42.506950 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99a07351-576c-4e20-a39c-bb61ec8f69f7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:42.507403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99a07351-576c-4e20-a39c-bb61ec8f69f7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:42.507826 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99a07351-576c-4e20-a39c-bb61ec8f69f7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:42.514790 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dbedfd4b-c04f-4bdf-b8a3-328ee164a737 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.035199 Oct 05 02:27:42.516223 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 139/284] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 5 02:27:42 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 02:27:42.528207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-59659fd3-7483-4029-b4ab-4c9e5fb9a039 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1267133683"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:42.545665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.aggregate [None req-59659fd3-7483-4029-b4ab-4c9e5fb9a039 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Generated uuid cc89a036-750b-4731-87e3-875d4decabd3 for aggregate {{(pid=122320) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 02:27:42.615159 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-59659fd3-7483-4029-b4ab-4c9e5fb9a039 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.093443 Oct 05 02:27:42.657354 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 140/285] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 5 02:27:42 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:42.686481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-95730c81-e0e1-41c5-8235-a871a0110c9f req-1420a229-f8cd-4cfc-9b02-2f367fe95e37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eddae3fc-f975-45e3-8592-01b10bcf32ad", "tag": "76ca6ca5-722f-44bd-ab65-b8f77ef0027e"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:42.744689 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-95730c81-e0e1-41c5-8235-a871a0110c9f req-1420a229-f8cd-4cfc-9b02-2f367fe95e37 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:42.746360 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-95730c81-e0e1-41c5-8235-a871a0110c9f req-1420a229-f8cd-4cfc-9b02-2f367fe95e37 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:42.747799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-95730c81-e0e1-41c5-8235-a871a0110c9f req-1420a229-f8cd-4cfc-9b02-2f367fe95e37 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:42.808133 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-95730c81-e0e1-41c5-8235-a871a0110c9f req-1420a229-f8cd-4cfc-9b02-2f367fe95e37 service nova] Creating event network-changed:76ca6ca5-722f-44bd-ab65-b8f77ef0027e for instance eddae3fc-f975-45e3-8592-01b10bcf32ad on n-h2-858272-3 Oct 05 02:27:42.828397 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-95730c81-e0e1-41c5-8235-a871a0110c9f req-1420a229-f8cd-4cfc-9b02-2f367fe95e37 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165477 Oct 05 02:27:42.829167 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 141/286] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:42.847356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-891ffa33-41d3-473a-8a4e-5fb97cec9739 tempest-AggregatesAdminNegativeTestJSON-795497844 tempest-AggregatesAdminNegativeTestJSON-795497844-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:42.849387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-891ffa33-41d3-473a-8a4e-5fb97cec9739 tempest-AggregatesAdminNegativeTestJSON-795497844 tempest-AggregatesAdminNegativeTestJSON-795497844-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'b9f07b094c2b47638554b9271e74d053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59141ab746f4d1f9f9ddf9f5a2d3d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:42.851044 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-891ffa33-41d3-473a-8a4e-5fb97cec9739 tempest-AggregatesAdminNegativeTestJSON-795497844 tempest-AggregatesAdminNegativeTestJSON-795497844-project] Request method failure captured: Oct 05 02:27:42.851044 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 05 02:27:42.851044 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:27:42.851044 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:27:42.851044 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:27:42.851044 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:27:42.851044 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:27:42.851044 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:27:42.851044 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:27:42.851044 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:42.851044 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOth79u85F--3nF2Qh7WF45l6GuGKdnA3SIyAKVB0hhDRdlZ6vTfKT7986qaO5ZnYc7JpHFCa2gH5kP-1ZFLd8nKDjSMaAajpTq8JuAWNXUmu5w4uuL8AQGuXwuLMvJmHRiBgVwIbjFd2ysOtFEcp7d7vYQzhyMYwabZkqxA1nXCkW4 Oct 05 02:27:42.851044 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:27:42.851044 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:27:42.851044 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:27:42.851044 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:27:42.851044 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:27:42.851044 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:27:42.851044 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: b59141ab746f4d1f9f9ddf9f5a2d3d60 Oct 05 02:27:42.851044 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-795497844 Oct 05 02:27:42.851044 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:27:42.851044 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:27:42.852648 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b59141ab746f4d1f9f9ddf9f5a2d3d60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b59141ab746f4d1f9f9ddf9f5a2d3d60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b59141ab746f4d1f9f9ddf9f5a2d3d60"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b59141ab746f4d1f9f9ddf9f5a2d3d60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:42.852648 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-795497844 Oct 05 02:27:42.852648 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: b59141ab746f4d1f9f9ddf9f5a2d3d60 Oct 05 02:27:42.852648 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-795497844 Oct 05 02:27:42.852648 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-AggregatesAdminNegativeTestJSON-795497844-project Oct 05 02:27:42.852648 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:27:42.852648 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:27:42.852648 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: b9f07b094c2b47638554b9271e74d053 Oct 05 02:27:42.852648 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-795497844-project Oct 05 02:27:42.852648 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:27:42.852648 n-d-858272-3 devstack@n-api.service[122320]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 05 02:27:42.852648 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '15'} Oct 05 02:27:42.853497 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:42.853497 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:42.853497 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:42.853497 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:42.853497 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:42.853497 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:42.853497 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:42.853497 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:42.853497 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 05 02:27:42.853497 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 05 02:27:42.853497 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 02:27:42.853497 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 02:27:42.853497 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 02:27:42.853497 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 02:27:42.853497 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:27:42.853497 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:27:42.853497 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:27:42.853497 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:27:42.853497 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 02:27:42.855040 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 02:27:42.855040 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 02:27:42.855040 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 02:27:42.855040 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:27:42.855040 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 02:27:42.855040 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 05 02:27:42.855040 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.855040 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:42.855040 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.855040 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:42.855040 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:42.855040 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:42.855040 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 02:27:42.855040 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 02:27:42.855040 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 05 02:27:42.855040 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:42.855040 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-891ffa33-41d3-473a-8a4e-5fb97cec9739 tempest-AggregatesAdminNegativeTestJSON-795497844 tempest-AggregatesAdminNegativeTestJSON-795497844-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:42.856209 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-891ffa33-41d3-473a-8a4e-5fb97cec9739 tempest-AggregatesAdminNegativeTestJSON-795497844 tempest-AggregatesAdminNegativeTestJSON-795497844-project] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.010589 Oct 05 02:27:42.861246 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 142/287] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 5 02:27:42 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:27:42.866247 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-602e08e6-0763-447f-b6e0-b586775ffd3e tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:42.939203 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-602e08e6-0763-447f-b6e0-b586775ffd3e tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.076803 Oct 05 02:27:42.939786 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 143/288] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 5 02:27:42 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 02:27:42.948989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e94a89c8-84f9-43ff-94b5-8573d5b49a41 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:42.987092 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-e94a89c8-84f9-43ff-94b5-8573d5b49a41 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 05 02:27:43.001934 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e94a89c8-84f9-43ff-94b5-8573d5b49a41 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Request method failure captured: Oct 05 02:27:43.001934 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 05 02:27:43.001934 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:27:43.001934 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:27:43.001934 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:27:43.001934 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:27:43.001934 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:27:43.001934 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:27:43.001934 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:27:43.001934 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:43.001934 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOtkEhzREfPXqLqI8d6-zMRFJKz1RRQHVMgEvHtZD2MetvSbN6IHdZD8h9jZyiP7lH7K6I-_rAbq9lId8IWT1L0VYq8IJs9P92HgwBzDC1nkF5J0_4GtJX9m1EevDZT8JvoanJrHNKnshymTig0StdHjFnAqWIywDgpFL8PWzLVnNms Oct 05 02:27:43.001934 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:27:43.001934 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:27:43.001934 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:27:43.001934 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:27:43.001934 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:27:43.001934 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:27:43.001934 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 58b7759803984da1ae71aa71f3ca3380 Oct 05 02:27:43.001934 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-506305802 Oct 05 02:27:43.001934 n-d-858272-3 devstack@n-api.service[122320]: X-Role: admin,member,reader Oct 05 02:27:43.001934 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: admin,member,reader Oct 05 02:27:43.004038 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58b7759803984da1ae71aa71f3ca3380"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58b7759803984da1ae71aa71f3ca3380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/58b7759803984da1ae71aa71f3ca3380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_58b7759803984da1ae71aa71f3ca3380"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:43.004038 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-506305802 Oct 05 02:27:43.004038 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 58b7759803984da1ae71aa71f3ca3380 Oct 05 02:27:43.004038 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-506305802 Oct 05 02:27:43.004038 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin Oct 05 02:27:43.004038 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:27:43.004038 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:27:43.004038 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: e1ec0ed07d184f4dabc88050c82423f2 Oct 05 02:27:43.004038 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin Oct 05 02:27:43.004038 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:27:43.004038 n-d-858272-3 devstack@n-api.service[122320]: exception: Aggregate -1 could not be found. Oct 05 02:27:43.004038 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '-1'} Oct 05 02:27:43.004853 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:43.004853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:43.004853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 05 02:27:43.004853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 05 02:27:43.004853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 05 02:27:43.004853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 05 02:27:43.004853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:27:43.004853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:27:43.004853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:27:43.004853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:27:43.004853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 05 02:27:43.004853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 05 02:27:43.004853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 05 02:27:43.004853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 05 02:27:43.004853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:27:43.004853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:27:43.004853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 05 02:27:43.004853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 05 02:27:43.004853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 02:27:43.006126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 02:27:43.006126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 05 02:27:43.006126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 05 02:27:43.006126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 05 02:27:43.006126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:43.006126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:43.006126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:43.006126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:43.006126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:43.006126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:43.006126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:43.006126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:43.006126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:43.006126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:43.006126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 05 02:27:43.006126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:27:43.006126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 05 02:27:43.006126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:43.006126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:43.006126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:43.006126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:43.007516 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:43.007516 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:43.007516 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:27:43.007516 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:27:43.007516 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 05 02:27:43.007516 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:43.014899 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e94a89c8-84f9-43ff-94b5-8573d5b49a41 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:43.019391 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e94a89c8-84f9-43ff-94b5-8573d5b49a41 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.073993 Oct 05 02:27:43.022943 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 144/289] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 5 02:27:42 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:27:43.034249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b00afc17-3447-4c1a-9dd2-972916a08035 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-767820548"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:43.056207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.aggregate [None req-b00afc17-3447-4c1a-9dd2-972916a08035 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Generated uuid f8a7b281-db36-4cde-9f87-06c4b1bcb237 for aggregate {{(pid=122320) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 02:27:43.129475 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b00afc17-3447-4c1a-9dd2-972916a08035 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.101559 Oct 05 02:27:43.138333 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 145/290] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 5 02:27:43 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:43.148875 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-95656ab8-36ae-42b8-89c7-d23af18468a4 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:43.150969 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-95656ab8-36ae-42b8-89c7-d23af18468a4 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: 1a0dac23-a7fb-40cf-b2bc-849859ea8197] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:43.174682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-95656ab8-36ae-42b8-89c7-d23af18468a4 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:43.176411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-95656ab8-36ae-42b8-89c7-d23af18468a4 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:43.176840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-95656ab8-36ae-42b8-89c7-d23af18468a4 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:43.178797 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-95656ab8-36ae-42b8-89c7-d23af18468a4 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:43.181046 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-95656ab8-36ae-42b8-89c7-d23af18468a4 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:43.181679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-95656ab8-36ae-42b8-89c7-d23af18468a4 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:43.651628 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-99a07351-576c-4e20-a39c-bb61ec8f69f7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:43.662206 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-99a07351-576c-4e20-a39c-bb61ec8f69f7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:43.667084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-99a07351-576c-4e20-a39c-bb61ec8f69f7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:43.668993 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-99a07351-576c-4e20-a39c-bb61ec8f69f7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 200 len: 1361 microversion: 2.25 time: 1.195844 Oct 05 02:27:43.677673 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 146/291] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:27:42 2022] GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 1361 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:27:43.697526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-6be70ad4-bc5f-42f6-bbba-5e753e574dba req-28a828bd-283b-4a5c-94ff-f11c49db0a0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a0dac23-a7fb-40cf-b2bc-849859ea8197", "tag": "11730f85-c18f-4aec-94a4-7d16b357eacb"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:43.729569 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6be70ad4-bc5f-42f6-bbba-5e753e574dba req-28a828bd-283b-4a5c-94ff-f11c49db0a0b service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:43.730325 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6be70ad4-bc5f-42f6-bbba-5e753e574dba req-28a828bd-283b-4a5c-94ff-f11c49db0a0b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:43.731444 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6be70ad4-bc5f-42f6-bbba-5e753e574dba req-28a828bd-283b-4a5c-94ff-f11c49db0a0b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:43.765488 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-6be70ad4-bc5f-42f6-bbba-5e753e574dba req-28a828bd-283b-4a5c-94ff-f11c49db0a0b service nova] Creating event network-changed:11730f85-c18f-4aec-94a4-7d16b357eacb for instance 1a0dac23-a7fb-40cf-b2bc-849859ea8197 on n-h2-858272-3 Oct 05 02:27:43.786435 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-6be70ad4-bc5f-42f6-bbba-5e753e574dba req-28a828bd-283b-4a5c-94ff-f11c49db0a0b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106979 Oct 05 02:27:43.788446 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 147/292] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:43.803400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ac92fe25-84e0-4469-b6ff-01529e3bd580 tempest-AggregatesAdminNegativeTestJSON-795497844 tempest-AggregatesAdminNegativeTestJSON-795497844-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:43.806299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ac92fe25-84e0-4469-b6ff-01529e3bd580 tempest-AggregatesAdminNegativeTestJSON-795497844 tempest-AggregatesAdminNegativeTestJSON-795497844-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'b9f07b094c2b47638554b9271e74d053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59141ab746f4d1f9f9ddf9f5a2d3d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:43.810049 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ac92fe25-84e0-4469-b6ff-01529e3bd580 tempest-AggregatesAdminNegativeTestJSON-795497844 tempest-AggregatesAdminNegativeTestJSON-795497844-project] Request method failure captured: Oct 05 02:27:43.810049 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Oct 05 02:27:43.810049 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:27:43.810049 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:27:43.810049 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:27:43.810049 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:27:43.810049 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:27:43.810049 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:27:43.810049 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:27:43.810049 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:43.810049 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOth79u85F--3nF2Qh7WF45l6GuGKdnA3SIyAKVB0hhDRdlZ6vTfKT7986qaO5ZnYc7JpHFCa2gH5kP-1ZFLd8nKDjSMaAajpTq8JuAWNXUmu5w4uuL8AQGuXwuLMvJmHRiBgVwIbjFd2ysOtFEcp7d7vYQzhyMYwabZkqxA1nXCkW4 Oct 05 02:27:43.810049 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:27:43.810049 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:27:43.810049 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:27:43.810049 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:27:43.810049 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:27:43.810049 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:27:43.810049 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: b59141ab746f4d1f9f9ddf9f5a2d3d60 Oct 05 02:27:43.810049 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-795497844 Oct 05 02:27:43.810049 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:27:43.810049 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:27:43.811240 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b59141ab746f4d1f9f9ddf9f5a2d3d60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b59141ab746f4d1f9f9ddf9f5a2d3d60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b59141ab746f4d1f9f9ddf9f5a2d3d60"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b59141ab746f4d1f9f9ddf9f5a2d3d60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:43.811240 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-795497844 Oct 05 02:27:43.811240 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: b59141ab746f4d1f9f9ddf9f5a2d3d60 Oct 05 02:27:43.811240 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-795497844 Oct 05 02:27:43.811240 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-AggregatesAdminNegativeTestJSON-795497844-project Oct 05 02:27:43.811240 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:27:43.811240 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:27:43.811240 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: b9f07b094c2b47638554b9271e74d053 Oct 05 02:27:43.811240 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-795497844-project Oct 05 02:27:43.811240 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:27:43.811240 n-d-858272-3 devstack@n-api.service[122319]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 05 02:27:43.811240 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '16'} Oct 05 02:27:43.811883 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:43.811883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:43.811883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:43.811883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:43.811883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:43.811883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:43.811883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:43.811883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:43.811883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 05 02:27:43.811883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 05 02:27:43.811883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 02:27:43.811883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 02:27:43.811883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 02:27:43.811883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 02:27:43.811883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:27:43.811883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:27:43.811883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:27:43.811883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:27:43.811883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 02:27:43.812872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 02:27:43.812872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 02:27:43.812872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 02:27:43.812872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:27:43.812872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 02:27:43.812872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 05 02:27:43.812872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:43.812872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:43.812872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:43.812872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:43.812872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:43.812872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:43.812872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 02:27:43.812872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 02:27:43.812872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 05 02:27:43.812872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:43.821332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ac92fe25-84e0-4469-b6ff-01529e3bd580 tempest-AggregatesAdminNegativeTestJSON-795497844 tempest-AggregatesAdminNegativeTestJSON-795497844-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:43.834629 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ac92fe25-84e0-4469-b6ff-01529e3bd580 tempest-AggregatesAdminNegativeTestJSON-795497844 tempest-AggregatesAdminNegativeTestJSON-795497844-project] 10.222.0.16 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.025187 Oct 05 02:27:43.838278 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 148/293] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 5 02:27:43 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:27:43.843700 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-71442b5d-5bd0-4085-910e-a7d27f0c1d3e tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:43.892734 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-71442b5d-5bd0-4085-910e-a7d27f0c1d3e tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.053142 Oct 05 02:27:43.894099 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 149/294] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 5 02:27:43 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 05 02:27:43.912181 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a39f3a91-3e41-41ca-9cc1-63f884255a8f tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:43.929317 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-a39f3a91-3e41-41ca-9cc1-63f884255a8f tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 05 02:27:43.934283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a39f3a91-3e41-41ca-9cc1-63f884255a8f tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Request method failure captured: Oct 05 02:27:43.934283 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 05 02:27:43.934283 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:27:43.934283 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:27:43.934283 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:27:43.934283 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:27:43.934283 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:27:43.934283 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:27:43.934283 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:27:43.934283 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:43.934283 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOtkEhzREfPXqLqI8d6-zMRFJKz1RRQHVMgEvHtZD2MetvSbN6IHdZD8h9jZyiP7lH7K6I-_rAbq9lId8IWT1L0VYq8IJs9P92HgwBzDC1nkF5J0_4GtJX9m1EevDZT8JvoanJrHNKnshymTig0StdHjFnAqWIywDgpFL8PWzLVnNms Oct 05 02:27:43.934283 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:27:43.934283 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:27:43.934283 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:27:43.934283 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:27:43.934283 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:27:43.934283 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:27:43.934283 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 58b7759803984da1ae71aa71f3ca3380 Oct 05 02:27:43.934283 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-506305802 Oct 05 02:27:43.934283 n-d-858272-3 devstack@n-api.service[122319]: X-Role: admin,member,reader Oct 05 02:27:43.934283 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: admin,member,reader Oct 05 02:27:43.935462 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58b7759803984da1ae71aa71f3ca3380"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58b7759803984da1ae71aa71f3ca3380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/58b7759803984da1ae71aa71f3ca3380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_58b7759803984da1ae71aa71f3ca3380"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:43.935462 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-506305802 Oct 05 02:27:43.935462 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 58b7759803984da1ae71aa71f3ca3380 Oct 05 02:27:43.935462 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-506305802 Oct 05 02:27:43.935462 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin Oct 05 02:27:43.935462 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:27:43.935462 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:27:43.935462 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: e1ec0ed07d184f4dabc88050c82423f2 Oct 05 02:27:43.935462 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin Oct 05 02:27:43.935462 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:27:43.935462 n-d-858272-3 devstack@n-api.service[122319]: exception: Aggregate -1 could not be found. Oct 05 02:27:43.935462 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '-1'} Oct 05 02:27:43.936109 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:43.936109 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:43.936109 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 05 02:27:43.936109 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 05 02:27:43.936109 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 05 02:27:43.936109 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 05 02:27:43.936109 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:27:43.936109 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:27:43.936109 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 05 02:27:43.936109 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 05 02:27:43.936109 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 02:27:43.936109 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 02:27:43.936109 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 05 02:27:43.936109 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 05 02:27:43.936109 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 05 02:27:43.936109 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:43.936109 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:43.936109 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:43.936109 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:43.936109 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:43.937176 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:43.937176 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:43.937176 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:43.937176 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:43.937176 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:43.937176 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 05 02:27:43.937176 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:27:43.937176 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 05 02:27:43.937176 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:43.937176 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:43.937176 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:43.937176 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:43.937176 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:43.937176 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:43.937176 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:27:43.937176 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:27:43.937176 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 05 02:27:43.937176 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:43.944085 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a39f3a91-3e41-41ca-9cc1-63f884255a8f tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:43.945174 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a39f3a91-3e41-41ca-9cc1-63f884255a8f tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.045254 Oct 05 02:27:43.953619 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 150/295] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 5 02:27:43 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:27:43.966065 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3c4a7354-6c78-43e9-a38e-9c734d9a652d tempest-AggregatesAdminNegativeTestJSON-795497844 tempest-AggregatesAdminNegativeTestJSON-795497844-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:43.967850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3c4a7354-6c78-43e9-a38e-9c734d9a652d tempest-AggregatesAdminNegativeTestJSON-795497844 tempest-AggregatesAdminNegativeTestJSON-795497844-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'b9f07b094c2b47638554b9271e74d053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59141ab746f4d1f9f9ddf9f5a2d3d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:43.974356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3c4a7354-6c78-43e9-a38e-9c734d9a652d tempest-AggregatesAdminNegativeTestJSON-795497844 tempest-AggregatesAdminNegativeTestJSON-795497844-project] Request method failure captured: Oct 05 02:27:43.974356 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 05 02:27:43.974356 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:27:43.974356 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:27:43.974356 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:27:43.974356 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:27:43.974356 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:27:43.974356 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:27:43.974356 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:27:43.974356 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:43.974356 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOth79u85F--3nF2Qh7WF45l6GuGKdnA3SIyAKVB0hhDRdlZ6vTfKT7986qaO5ZnYc7JpHFCa2gH5kP-1ZFLd8nKDjSMaAajpTq8JuAWNXUmu5w4uuL8AQGuXwuLMvJmHRiBgVwIbjFd2ysOtFEcp7d7vYQzhyMYwabZkqxA1nXCkW4 Oct 05 02:27:43.974356 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:27:43.974356 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:27:43.974356 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:27:43.974356 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:27:43.974356 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:27:43.974356 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:27:43.974356 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: b59141ab746f4d1f9f9ddf9f5a2d3d60 Oct 05 02:27:43.974356 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-795497844 Oct 05 02:27:43.974356 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:27:43.974356 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:27:43.975829 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b59141ab746f4d1f9f9ddf9f5a2d3d60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b59141ab746f4d1f9f9ddf9f5a2d3d60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b59141ab746f4d1f9f9ddf9f5a2d3d60"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b59141ab746f4d1f9f9ddf9f5a2d3d60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:43.975829 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-795497844 Oct 05 02:27:43.975829 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: b59141ab746f4d1f9f9ddf9f5a2d3d60 Oct 05 02:27:43.975829 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-795497844 Oct 05 02:27:43.975829 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-AggregatesAdminNegativeTestJSON-795497844-project Oct 05 02:27:43.975829 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:27:43.975829 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:27:43.975829 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: b9f07b094c2b47638554b9271e74d053 Oct 05 02:27:43.975829 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-795497844-project Oct 05 02:27:43.975829 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:27:43.975829 n-d-858272-3 devstack@n-api.service[122319]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 05 02:27:43.975829 n-d-858272-3 devstack@n-api.service[122319]: action_args: {} Oct 05 02:27:43.978437 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:43.978437 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:43.978437 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:43.978437 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:43.978437 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:43.978437 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:43.978437 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:43.978437 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:43.978437 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 05 02:27:43.978437 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 05 02:27:43.978437 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 02:27:43.978437 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 02:27:43.978437 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 02:27:43.978437 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 02:27:43.978437 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:27:43.978437 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:27:43.978437 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:27:43.978437 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:27:43.978437 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 02:27:43.979522 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 02:27:43.979522 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 02:27:43.979522 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 02:27:43.979522 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:27:43.979522 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 02:27:43.979522 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 05 02:27:43.979522 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:43.979522 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:43.979522 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:43.979522 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:43.979522 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:43.979522 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:43.979522 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 02:27:43.979522 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 02:27:43.979522 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 05 02:27:43.979522 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:43.981568 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3c4a7354-6c78-43e9-a38e-9c734d9a652d tempest-AggregatesAdminNegativeTestJSON-795497844 tempest-AggregatesAdminNegativeTestJSON-795497844-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:43.983119 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3c4a7354-6c78-43e9-a38e-9c734d9a652d tempest-AggregatesAdminNegativeTestJSON-795497844 tempest-AggregatesAdminNegativeTestJSON-795497844-project] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.027335 Oct 05 02:27:43.983842 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 151/296] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 5 02:27:43 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:27:43.999361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-172918a5-038c-4583-bb29-e8e83475455d tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1012561146"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:44.003390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.aggregate [None req-172918a5-038c-4583-bb29-e8e83475455d tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Generated uuid 20f90ffc-ed7c-4053-aa8a-ea1a6afbd9e5 for aggregate {{(pid=122319) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 02:27:44.059147 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-172918a5-038c-4583-bb29-e8e83475455d tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.062363 Oct 05 02:27:44.059882 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 152/297] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 5 02:27:43 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:44.081888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-62359f88-1301-4bfb-94ad-6eb4aa884aaa tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858272-3"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:44.098727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62359f88-1301-4bfb-94ad-6eb4aa884aaa tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:44.099260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62359f88-1301-4bfb-94ad-6eb4aa884aaa tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:44.099727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62359f88-1301-4bfb-94ad-6eb4aa884aaa tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:44.134250 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-95656ab8-36ae-42b8-89c7-d23af18468a4 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:44.142543 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-95656ab8-36ae-42b8-89c7-d23af18468a4 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197" status: 200 len: 1317 microversion: 2.1 time: 1.007742 Oct 05 02:27:44.147614 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 146/298] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:43 2022] GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197 => generated 1317 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:44.288413 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-62359f88-1301-4bfb-94ad-6eb4aa884aaa tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.218136 Oct 05 02:27:44.289561 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 153/299] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Oct 5 02:27:44 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:27:44.301695 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b993bf33-96a6-48b2-8224-0cda2584b5f2 tempest-AggregatesAdminNegativeTestJSON-795497844 tempest-AggregatesAdminNegativeTestJSON-795497844-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858272-3"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:44.305134 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b993bf33-96a6-48b2-8224-0cda2584b5f2 tempest-AggregatesAdminNegativeTestJSON-795497844 tempest-AggregatesAdminNegativeTestJSON-795497844-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'b9f07b094c2b47638554b9271e74d053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59141ab746f4d1f9f9ddf9f5a2d3d60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:44.307103 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b993bf33-96a6-48b2-8224-0cda2584b5f2 tempest-AggregatesAdminNegativeTestJSON-795497844 tempest-AggregatesAdminNegativeTestJSON-795497844-project] Request method failure captured: Oct 05 02:27:44.307103 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 05 02:27:44.307103 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:27:44.307103 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:27:44.307103 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:27:44.307103 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 42 Oct 05 02:27:44.307103 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:27:44.307103 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:27:44.307103 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:27:44.307103 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:44.307103 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOth79u85F--3nF2Qh7WF45l6GuGKdnA3SIyAKVB0hhDRdlZ6vTfKT7986qaO5ZnYc7JpHFCa2gH5kP-1ZFLd8nKDjSMaAajpTq8JuAWNXUmu5w4uuL8AQGuXwuLMvJmHRiBgVwIbjFd2ysOtFEcp7d7vYQzhyMYwabZkqxA1nXCkW4 Oct 05 02:27:44.307103 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:27:44.307103 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:27:44.307103 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:27:44.307103 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:27:44.307103 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:27:44.307103 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:27:44.307103 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: b59141ab746f4d1f9f9ddf9f5a2d3d60 Oct 05 02:27:44.307103 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-795497844 Oct 05 02:27:44.307103 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:27:44.307103 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:27:44.308301 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b59141ab746f4d1f9f9ddf9f5a2d3d60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b59141ab746f4d1f9f9ddf9f5a2d3d60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b59141ab746f4d1f9f9ddf9f5a2d3d60"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b59141ab746f4d1f9f9ddf9f5a2d3d60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:44.308301 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-795497844 Oct 05 02:27:44.308301 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: b59141ab746f4d1f9f9ddf9f5a2d3d60 Oct 05 02:27:44.308301 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-795497844 Oct 05 02:27:44.308301 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-AggregatesAdminNegativeTestJSON-795497844-project Oct 05 02:27:44.308301 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:27:44.308301 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:27:44.308301 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: b9f07b094c2b47638554b9271e74d053 Oct 05 02:27:44.308301 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-795497844-project Oct 05 02:27:44.308301 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:27:44.308301 n-d-858272-3 devstack@n-api.service[122320]: {"remove_host": {"host": "n-h2-858272-3"}} Oct 05 02:27:44.308301 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:27:44.308301 n-d-858272-3 devstack@n-api.service[122320]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 05 02:27:44.309088 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-858272-3'}}} Oct 05 02:27:44.309088 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:44.309088 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:44.309088 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:44.309088 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:44.309088 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:44.309088 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:44.309088 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:44.309088 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:44.309088 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:27:44.309088 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:27:44.309088 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 05 02:27:44.309088 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 05 02:27:44.309088 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 02:27:44.309088 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 02:27:44.309088 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 02:27:44.309088 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 02:27:44.309088 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:27:44.309088 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:27:44.310475 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:27:44.310475 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:27:44.310475 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 02:27:44.310475 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 02:27:44.310475 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 02:27:44.310475 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 02:27:44.310475 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:27:44.310475 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 02:27:44.310475 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 05 02:27:44.310475 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:44.310475 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:44.310475 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:44.310475 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:44.310475 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:44.310475 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:44.310475 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 02:27:44.310475 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 02:27:44.310475 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 05 02:27:44.310475 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:44.312982 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b993bf33-96a6-48b2-8224-0cda2584b5f2 tempest-AggregatesAdminNegativeTestJSON-795497844 tempest-AggregatesAdminNegativeTestJSON-795497844-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:44.312982 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b993bf33-96a6-48b2-8224-0cda2584b5f2 tempest-AggregatesAdminNegativeTestJSON-795497844 tempest-AggregatesAdminNegativeTestJSON-795497844-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.011248 Oct 05 02:27:44.314882 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:44.319508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8836a1f8-37d2-4ecd-8870-63bbded1677b tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858272-3"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:44.326201 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 147/300] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Oct 5 02:27:44 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:27:44.333171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8836a1f8-37d2-4ecd-8870-63bbded1677b tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:44.333814 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8836a1f8-37d2-4ecd-8870-63bbded1677b tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:44.334257 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8836a1f8-37d2-4ecd-8870-63bbded1677b tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:44.555229 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8836a1f8-37d2-4ecd-8870-63bbded1677b tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.241377 Oct 05 02:27:44.556522 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 154/301] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Oct 5 02:27:44 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:44.564266 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=10 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:44.570281 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e329bc7a-671b-42eb-9c18-52827ac07cfc tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:44.610102 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e329bc7a-671b-42eb-9c18-52827ac07cfc tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.046527 Oct 05 02:27:44.611156 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 148/302] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 5 02:27:44 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 02:27:44.620859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f63cc34b-01e8-4655-8948-92f46ee37756 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1542682218"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:44.624980 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.aggregate [None req-f63cc34b-01e8-4655-8948-92f46ee37756 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Generated uuid 49fefd40-86e8-4544-b2bc-a9108d7d37f1 for aggregate {{(pid=122319) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 02:27:44.678812 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f63cc34b-01e8-4655-8948-92f46ee37756 tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.055707 Oct 05 02:27:44.685722 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 155/303] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 5 02:27:44 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:44.696616 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9236605d-3149-45d9-bd4a-9c15c516331f tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:44.709417 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b9b0d1e8-8834-46fc-aa7d-651544040972 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:44.711764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b9b0d1e8-8834-46fc-aa7d-651544040972 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:44.725469 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9236605d-3149-45d9-bd4a-9c15c516331f tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:44.726086 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9236605d-3149-45d9-bd4a-9c15c516331f tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:44.727216 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9236605d-3149-45d9-bd4a-9c15c516331f tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:44.728214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9b0d1e8-8834-46fc-aa7d-651544040972 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:44.728737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9b0d1e8-8834-46fc-aa7d-651544040972 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:44.729157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9b0d1e8-8834-46fc-aa7d-651544040972 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:44.729872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9b0d1e8-8834-46fc-aa7d-651544040972 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:44.736536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9b0d1e8-8834-46fc-aa7d-651544040972 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:44.737262 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9b0d1e8-8834-46fc-aa7d-651544040972 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:44.742303 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9236605d-3149-45d9-bd4a-9c15c516331f tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:44.744847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9236605d-3149-45d9-bd4a-9c15c516331f tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:44.745424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9236605d-3149-45d9-bd4a-9c15c516331f tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:44.766789 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.compute.aggregates [None req-9236605d-3149-45d9-bd4a-9c15c516331f tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 05 02:27:44.767619 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-9236605d-3149-45d9-bd4a-9c15c516331f tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Oct 05 02:27:44.771552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9236605d-3149-45d9-bd4a-9c15c516331f tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Request method failure captured: Oct 05 02:27:44.771552 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Oct 05 02:27:44.771552 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:27:44.771552 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:27:44.771552 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:27:44.771552 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 42 Oct 05 02:27:44.771552 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:27:44.771552 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:27:44.771552 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:27:44.771552 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:44.771552 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOtkEhzREfPXqLqI8d6-zMRFJKz1RRQHVMgEvHtZD2MetvSbN6IHdZD8h9jZyiP7lH7K6I-_rAbq9lId8IWT1L0VYq8IJs9P92HgwBzDC1nkF5J0_4GtJX9m1EevDZT8JvoanJrHNKnshymTig0StdHjFnAqWIywDgpFL8PWzLVnNms Oct 05 02:27:44.771552 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:27:44.771552 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:27:44.771552 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:27:44.771552 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:27:44.771552 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:27:44.771552 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:27:44.771552 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 58b7759803984da1ae71aa71f3ca3380 Oct 05 02:27:44.771552 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-506305802 Oct 05 02:27:44.771552 n-d-858272-3 devstack@n-api.service[122320]: X-Role: admin,member,reader Oct 05 02:27:44.771552 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: admin,member,reader Oct 05 02:27:44.772750 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58b7759803984da1ae71aa71f3ca3380"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58b7759803984da1ae71aa71f3ca3380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/58b7759803984da1ae71aa71f3ca3380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_58b7759803984da1ae71aa71f3ca3380"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:44.772750 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-506305802 Oct 05 02:27:44.772750 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 58b7759803984da1ae71aa71f3ca3380 Oct 05 02:27:44.772750 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-506305802 Oct 05 02:27:44.772750 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin Oct 05 02:27:44.772750 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:27:44.772750 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:27:44.772750 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: e1ec0ed07d184f4dabc88050c82423f2 Oct 05 02:27:44.772750 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin Oct 05 02:27:44.772750 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:27:44.772750 n-d-858272-3 devstack@n-api.service[122320]: {"remove_host": {"host": "nonexist_host"}} Oct 05 02:27:44.772750 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:27:44.772750 n-d-858272-3 devstack@n-api.service[122320]: exception: Cannot remove host nonexist_host in aggregate 18 Oct 05 02:27:44.773488 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 05 02:27:44.773488 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:44.773488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:44.773488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 05 02:27:44.773488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 05 02:27:44.773488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:27:44.773488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:27:44.773488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 05 02:27:44.773488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 05 02:27:44.773488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 02:27:44.773488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 02:27:44.773488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 05 02:27:44.773488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 05 02:27:44.773488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 05 02:27:44.773488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:44.773488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:44.773488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:44.773488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:44.773488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 05 02:27:44.773488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 05 02:27:44.774602 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 05 02:27:44.774602 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 05 02:27:44.774602 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 05 02:27:44.774602 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:44.774602 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:44.774602 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:44.774602 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:44.774602 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 05 02:27:44.774602 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 05 02:27:44.774602 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 05 02:27:44.774602 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 05 02:27:44.774602 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:27:44.774602 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:27:44.774602 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:27:44.774602 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:27:44.774602 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 05 02:27:44.774602 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 05 02:27:44.774602 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 05 02:27:44.774602 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 05 02:27:44.774602 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 05 02:27:44.775720 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 05 02:27:44.775720 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 05 02:27:44.775720 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:44.775720 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:44.775720 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:44.775720 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:44.775720 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:44.775720 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:44.775720 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:44.775720 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:44.775720 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:44.775720 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:44.775720 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:27:44.775720 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:27:44.775720 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 05 02:27:44.775720 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 05 02:27:44.775720 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Oct 05 02:27:44.775720 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:44.775720 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:44.775720 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:44.775720 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:44.776799 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:44.776799 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:44.776799 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:27:44.776799 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:27:44.776799 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Oct 05 02:27:44.776799 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:44.782905 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9236605d-3149-45d9-bd4a-9c15c516331f tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:44.784751 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9236605d-3149-45d9-bd4a-9c15c516331f tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.091431 Oct 05 02:27:44.788536 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 149/304] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Oct 5 02:27:44 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:27:44.807936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f3b4eef5-f335-4074-85e7-67885576c2cc tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:44.865363 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f3b4eef5-f335-4074-85e7-67885576c2cc tempest-AggregatesAdminNegativeTestJSON-506305802 tempest-AggregatesAdminNegativeTestJSON-506305802-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.063523 Oct 05 02:27:44.866020 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 150/305] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 5 02:27:44 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 02:27:45.170562 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6e4c7df0-046c-4ede-9d9a-1ff341260b9a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:45.172174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6e4c7df0-046c-4ede-9d9a-1ff341260b9a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: 1a0dac23-a7fb-40cf-b2bc-849859ea8197] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:45.179753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e4c7df0-046c-4ede-9d9a-1ff341260b9a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:45.180712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e4c7df0-046c-4ede-9d9a-1ff341260b9a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:45.181373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e4c7df0-046c-4ede-9d9a-1ff341260b9a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:45.182352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e4c7df0-046c-4ede-9d9a-1ff341260b9a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:45.183113 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e4c7df0-046c-4ede-9d9a-1ff341260b9a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:45.183861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e4c7df0-046c-4ede-9d9a-1ff341260b9a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:45.334531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b9b0d1e8-8834-46fc-aa7d-651544040972 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:45.349364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b9b0d1e8-8834-46fc-aa7d-651544040972 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:45.352965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b9b0d1e8-8834-46fc-aa7d-651544040972 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:45.356942 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b9b0d1e8-8834-46fc-aa7d-651544040972 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 200 len: 1361 microversion: 2.25 time: 0.655665 Oct 05 02:27:45.379875 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 156/306] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:27:44 2022] GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 1361 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:27:45.601413 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6e4c7df0-046c-4ede-9d9a-1ff341260b9a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:45.609748 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6e4c7df0-046c-4ede-9d9a-1ff341260b9a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197" status: 200 len: 1317 microversion: 2.1 time: 0.442389 Oct 05 02:27:45.610325 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 151/307] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:45 2022] GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197 => generated 1317 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:27:46.387085 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-691015e2-83fc-4b5c-8907-2d0264898f96 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:46.387916 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-691015e2-83fc-4b5c-8907-2d0264898f96 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:46.397588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-691015e2-83fc-4b5c-8907-2d0264898f96 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:46.399826 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-691015e2-83fc-4b5c-8907-2d0264898f96 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:46.400376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-691015e2-83fc-4b5c-8907-2d0264898f96 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:46.401753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-691015e2-83fc-4b5c-8907-2d0264898f96 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:46.404025 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-691015e2-83fc-4b5c-8907-2d0264898f96 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:46.404816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-691015e2-83fc-4b5c-8907-2d0264898f96 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:46.450305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bc22466a-62cf-44b6-84c6-9a75ddf2f1fc tempest-FloatingIPsNegativeTestJSON-1788723410 tempest-FloatingIPsNegativeTestJSON-1788723410-project] Calling method '.version_select at 0x7fcce48a4160>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:46.573594 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bc22466a-62cf-44b6-84c6-9a75ddf2f1fc tempest-FloatingIPsNegativeTestJSON-1788723410 tempest-FloatingIPsNegativeTestJSON-1788723410-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.676786 Oct 05 02:27:46.574246 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 157/308] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Oct 5 02:27:45 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:27:46.588774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d9ff5fe3-9264-4b0a-a10b-2975585e7392 tempest-FloatingIPsNegativeTestJSON-1788723410 tempest-FloatingIPsNegativeTestJSON-1788723410-project] Action: 'create', calling method: .version_select at 0x7fcce6201550>, body: {"pool": "non_exist_pool"} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:46.653113 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-d9ff5fe3-9264-4b0a-a10b-2975585e7392 tempest-FloatingIPsNegativeTestJSON-1788723410 tempest-FloatingIPsNegativeTestJSON-1788723410-project] HTTP exception thrown: Floating IP pool not found. Oct 05 02:27:46.655514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d9ff5fe3-9264-4b0a-a10b-2975585e7392 tempest-FloatingIPsNegativeTestJSON-1788723410 tempest-FloatingIPsNegativeTestJSON-1788723410-project] Request method failure captured: Oct 05 02:27:46.655514 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 05 02:27:46.655514 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:27:46.655514 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:27:46.655514 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:27:46.655514 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 26 Oct 05 02:27:46.655514 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:27:46.655514 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:27:46.655514 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:27:46.655514 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:46.655514 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOuha9IpVEOs8ZoKa0w1j_5rFmhIVoALN4DQkfCw5TWAn7Do5xMRr3A0mgF9YHu8OGr7x-Kh4roPF1e8ZzY-F65_67082UO2X4MwSopFAWyvxroNcPtFqKIbqnagC1PRjxRoBBrMw4Sn7Gb6keyn8UsS0joYHLIRgqTfJgGJTlRm4N0 Oct 05 02:27:46.655514 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:27:46.655514 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:27:46.655514 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:27:46.655514 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:27:46.655514 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:27:46.655514 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:27:46.655514 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 0b4365a5fbc549aaa81cf1c786b52591 Oct 05 02:27:46.655514 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1788723410 Oct 05 02:27:46.655514 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:27:46.655514 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:27:46.656710 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b4365a5fbc549aaa81cf1c786b52591"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b4365a5fbc549aaa81cf1c786b52591"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0b4365a5fbc549aaa81cf1c786b52591"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0b4365a5fbc549aaa81cf1c786b52591"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:46.656710 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1788723410 Oct 05 02:27:46.656710 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 0b4365a5fbc549aaa81cf1c786b52591 Oct 05 02:27:46.656710 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1788723410 Oct 05 02:27:46.656710 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-FloatingIPsNegativeTestJSON-1788723410-project Oct 05 02:27:46.656710 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:27:46.656710 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:27:46.656710 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: d477f91de9224b76b40880623a8c4a18 Oct 05 02:27:46.656710 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1788723410-project Oct 05 02:27:46.656710 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:27:46.656710 n-d-858272-3 devstack@n-api.service[122319]: {"pool": "non_exist_pool"} Oct 05 02:27:46.656710 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:27:46.656710 n-d-858272-3 devstack@n-api.service[122319]: exception: Floating IP pool not found. Oct 05 02:27:46.656710 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 05 02:27:46.656710 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:46.657587 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:46.657587 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 05 02:27:46.657587 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 05 02:27:46.657587 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 05 02:27:46.657587 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 05 02:27:46.657587 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 05 02:27:46.657587 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 05 02:27:46.657587 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 05 02:27:46.657587 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:46.657587 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:46.657587 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:46.657587 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:46.657587 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:46.657587 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:46.657587 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:46.657587 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:46.657587 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:27:46.657587 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:27:46.657587 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:46.657587 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:46.658649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 05 02:27:46.658649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:27:46.658649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 05 02:27:46.658649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:46.658649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:46.658649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:46.658649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:46.658649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:46.658649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:46.658649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:27:46.658649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:27:46.658649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 05 02:27:46.658649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:46.661125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d9ff5fe3-9264-4b0a-a10b-2975585e7392 tempest-FloatingIPsNegativeTestJSON-1788723410 tempest-FloatingIPsNegativeTestJSON-1788723410-project] Returning 404 to user: Floating IP pool not found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:46.662407 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d9ff5fe3-9264-4b0a-a10b-2975585e7392 tempest-FloatingIPsNegativeTestJSON-1788723410 tempest-FloatingIPsNegativeTestJSON-1788723410-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.079041 Oct 05 02:27:46.664108 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 158/309] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Oct 5 02:27:46 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:27:46.670661 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6249d696-c9d0-4a5d-9412-6cc60f30f194 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:46.677401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6249d696-c9d0-4a5d-9412-6cc60f30f194 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: 1a0dac23-a7fb-40cf-b2bc-849859ea8197] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:46.696580 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6249d696-c9d0-4a5d-9412-6cc60f30f194 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:46.697400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6249d696-c9d0-4a5d-9412-6cc60f30f194 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:46.698048 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6249d696-c9d0-4a5d-9412-6cc60f30f194 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:46.699056 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6249d696-c9d0-4a5d-9412-6cc60f30f194 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:46.702397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6249d696-c9d0-4a5d-9412-6cc60f30f194 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:46.703134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6249d696-c9d0-4a5d-9412-6cc60f30f194 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:46.804245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-691015e2-83fc-4b5c-8907-2d0264898f96 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:46.819078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-691015e2-83fc-4b5c-8907-2d0264898f96 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:46.822328 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-691015e2-83fc-4b5c-8907-2d0264898f96 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:46.823470 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-691015e2-83fc-4b5c-8907-2d0264898f96 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 200 len: 1361 microversion: 2.25 time: 0.441913 Oct 05 02:27:46.824029 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 152/310] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:27:46 2022] GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 1361 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:27:46.833288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-27784f4e-cafa-43c6-b2ad-1811b57f03d0 tempest-FloatingIPsNegativeTestJSON-1788723410 tempest-FloatingIPsNegativeTestJSON-1788723410-project] Calling method '.version_select at 0x7fcce46e5160>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:46.924464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG neutronclient.v2_0.client [None req-27784f4e-cafa-43c6-b2ad-1811b57f03d0 tempest-FloatingIPsNegativeTestJSON-1788723410 tempest-FloatingIPsNegativeTestJSON-1788723410-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d9581fe5-50c6-44c2-b23c-1d2a0f87324c could not be found", "detail": ""}} {{(pid=122320) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 02:27:46.925546 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-27784f4e-cafa-43c6-b2ad-1811b57f03d0 tempest-FloatingIPsNegativeTestJSON-1788723410 tempest-FloatingIPsNegativeTestJSON-1788723410-project] HTTP exception thrown: Floating IP not found for ID d9581fe5-50c6-44c2-b23c-1d2a0f87324c Oct 05 02:27:46.938829 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-27784f4e-cafa-43c6-b2ad-1811b57f03d0 tempest-FloatingIPsNegativeTestJSON-1788723410 tempest-FloatingIPsNegativeTestJSON-1788723410-project] Request method failure captured: Oct 05 02:27:46.938829 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/os-floating-ips/d9581fe5-50c6-44c2-b23c-1d2a0f87324c HTTP/1.1 Oct 05 02:27:46.938829 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:27:46.938829 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:27:46.938829 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:27:46.938829 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:27:46.938829 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:27:46.938829 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:27:46.938829 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:27:46.938829 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:46.938829 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOuha9IpVEOs8ZoKa0w1j_5rFmhIVoALN4DQkfCw5TWAn7Do5xMRr3A0mgF9YHu8OGr7x-Kh4roPF1e8ZzY-F65_67082UO2X4MwSopFAWyvxroNcPtFqKIbqnagC1PRjxRoBBrMw4Sn7Gb6keyn8UsS0joYHLIRgqTfJgGJTlRm4N0 Oct 05 02:27:46.938829 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:27:46.938829 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:27:46.938829 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:27:46.938829 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:27:46.938829 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:27:46.938829 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:27:46.938829 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 0b4365a5fbc549aaa81cf1c786b52591 Oct 05 02:27:46.938829 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1788723410 Oct 05 02:27:46.938829 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:27:46.938829 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:27:46.940039 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b4365a5fbc549aaa81cf1c786b52591"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0b4365a5fbc549aaa81cf1c786b52591"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0b4365a5fbc549aaa81cf1c786b52591"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0b4365a5fbc549aaa81cf1c786b52591"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:46.940039 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1788723410 Oct 05 02:27:46.940039 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 0b4365a5fbc549aaa81cf1c786b52591 Oct 05 02:27:46.940039 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1788723410 Oct 05 02:27:46.940039 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-FloatingIPsNegativeTestJSON-1788723410-project Oct 05 02:27:46.940039 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:27:46.940039 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:27:46.940039 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: d477f91de9224b76b40880623a8c4a18 Oct 05 02:27:46.940039 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1788723410-project Oct 05 02:27:46.940039 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:27:46.940039 n-d-858272-3 devstack@n-api.service[122320]: exception: Floating IP not found for ID d9581fe5-50c6-44c2-b23c-1d2a0f87324c Oct 05 02:27:46.940039 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'd9581fe5-50c6-44c2-b23c-1d2a0f87324c'} Oct 05 02:27:46.940039 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:46.941312 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:46.941312 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 05 02:27:46.941312 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 05 02:27:46.941312 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:27:46.941312 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:27:46.941312 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 05 02:27:46.941312 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 05 02:27:46.941312 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:27:46.941312 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:27:46.941312 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 02:27:46.941312 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 02:27:46.941312 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:27:46.941312 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:27:46.941312 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 02:27:46.941312 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 02:27:46.941312 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:27:46.941312 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:27:46.941312 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 02:27:46.941312 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 02:27:46.942325 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:27:46.942325 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:27:46.942325 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 02:27:46.942325 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 02:27:46.942325 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 02:27:46.942325 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 02:27:46.942325 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d9581fe5-50c6-44c2-b23c-1d2a0f87324c could not be found Oct 05 02:27:46.942325 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f75ed4aa-68c6-4e28-a296-f28257a06617'] Oct 05 02:27:46.942325 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:46.942325 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:46.942325 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:46.942325 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:46.942325 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 05 02:27:46.942325 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 05 02:27:46.942325 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 05 02:27:46.942325 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 05 02:27:46.942325 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d9581fe5-50c6-44c2-b23c-1d2a0f87324c. Oct 05 02:27:46.942325 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:46.942325 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:46.942325 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:46.943384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:46.943384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:46.943384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:46.943384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:46.943384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:46.943384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:27:46.943384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:27:46.943384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:46.943384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:46.943384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 05 02:27:46.943384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 05 02:27:46.943384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d9581fe5-50c6-44c2-b23c-1d2a0f87324c Oct 05 02:27:46.943384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:46.943384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:46.943384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:46.943384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:46.943384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:46.943384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:46.943384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:27:46.943384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:27:46.944476 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d9581fe5-50c6-44c2-b23c-1d2a0f87324c Oct 05 02:27:46.944476 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:46.944476 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-27784f4e-cafa-43c6-b2ad-1811b57f03d0 tempest-FloatingIPsNegativeTestJSON-1788723410 tempest-FloatingIPsNegativeTestJSON-1788723410-project] Returning 404 to user: Floating IP not found for ID d9581fe5-50c6-44c2-b23c-1d2a0f87324c {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:46.944476 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-27784f4e-cafa-43c6-b2ad-1811b57f03d0 tempest-FloatingIPsNegativeTestJSON-1788723410 tempest-FloatingIPsNegativeTestJSON-1788723410-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/d9581fe5-50c6-44c2-b23c-1d2a0f87324c" status: 404 len: 111 microversion: 2.1 time: 0.113409 Oct 05 02:27:46.944476 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 153/311] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 5 02:27:46 2022] DELETE /compute/v2.1/os-floating-ips/d9581fe5-50c6-44c2-b23c-1d2a0f87324c => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:27:46.983390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6249d696-c9d0-4a5d-9412-6cc60f30f194 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:46.992648 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6249d696-c9d0-4a5d-9412-6cc60f30f194 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197" status: 200 len: 1317 microversion: 2.1 time: 0.327042 Oct 05 02:27:46.993825 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 159/312] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:46 2022] GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197 => generated 1317 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:47.776925 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=4 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:47.901090 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-33adbf92-7dca-48a2-85c9-55b26f5709e4 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-72467636", "id": 1254483345, "os-flavor-access:is_public": "False"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:47.934153 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-33adbf92-7dca-48a2-85c9-55b26f5709e4 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.612467 Oct 05 02:27:47.937916 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 154/313] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:27:47 2022] POST /compute/v2.1/flavors => generated 437 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:47.948135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2338c503-2731-42a1-be0d-c7d48998a37d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:47.950998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2338c503-2731-42a1-be0d-c7d48998a37d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:47.966709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2338c503-2731-42a1-be0d-c7d48998a37d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:47.967396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2338c503-2731-42a1-be0d-c7d48998a37d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:47.967821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2338c503-2731-42a1-be0d-c7d48998a37d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:47.968534 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2338c503-2731-42a1-be0d-c7d48998a37d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:47.973269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2338c503-2731-42a1-be0d-c7d48998a37d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:47.974014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2338c503-2731-42a1-be0d-c7d48998a37d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:48.119097 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9d3b66f2-ae17-4f8f-a4b1-6ac4f87c5b61 tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Calling method '.version_select at 0x7fcce4890040>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:48.121049 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d3b66f2-ae17-4f8f-a4b1-6ac4f87c5b61 tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:48.121661 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d3b66f2-ae17-4f8f-a4b1-6ac4f87c5b61 tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:48.122099 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d3b66f2-ae17-4f8f-a4b1-6ac4f87c5b61 tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:48.155665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d3b66f2-ae17-4f8f-a4b1-6ac4f87c5b61 tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:48.156209 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d3b66f2-ae17-4f8f-a4b1-6ac4f87c5b61 tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:48.170311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d3b66f2-ae17-4f8f-a4b1-6ac4f87c5b61 tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:48.208387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d3b66f2-ae17-4f8f-a4b1-6ac4f87c5b61 tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:48.209070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d3b66f2-ae17-4f8f-a4b1-6ac4f87c5b61 tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:48.209512 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d3b66f2-ae17-4f8f-a4b1-6ac4f87c5b61 tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:48.222943 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9d3b66f2-ae17-4f8f-a4b1-6ac4f87c5b61 tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.447165 Oct 05 02:27:48.233757 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 160/314] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:27:47 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:48.247899 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3062ece1-4a95-4a38-a414-fc83d169ab5f tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "c65073d0fb914f13b382c660b200bbfb"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:48.299396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2338c503-2731-42a1-be0d-c7d48998a37d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:48.326388 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2338c503-2731-42a1-be0d-c7d48998a37d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:48.336587 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2338c503-2731-42a1-be0d-c7d48998a37d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:48.339973 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2338c503-2731-42a1-be0d-c7d48998a37d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 200 len: 1361 microversion: 2.25 time: 0.399391 Oct 05 02:27:48.341386 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 155/315] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:27:47 2022] GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 1361 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:27:48.349256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-20d38b61-ef46-4728-a7d1-57b356d676c8 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:48.350177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-20d38b61-ef46-4728-a7d1-57b356d676c8 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: 1a0dac23-a7fb-40cf-b2bc-849859ea8197] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:48.365726 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-20d38b61-ef46-4728-a7d1-57b356d676c8 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:48.367645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-20d38b61-ef46-4728-a7d1-57b356d676c8 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:48.369896 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-20d38b61-ef46-4728-a7d1-57b356d676c8 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:48.370602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-20d38b61-ef46-4728-a7d1-57b356d676c8 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:48.371074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-20d38b61-ef46-4728-a7d1-57b356d676c8 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:48.371487 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-20d38b61-ef46-4728-a7d1-57b356d676c8 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:48.630801 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-20d38b61-ef46-4728-a7d1-57b356d676c8 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:48.641955 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-20d38b61-ef46-4728-a7d1-57b356d676c8 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197" status: 200 len: 1317 microversion: 2.1 time: 0.296512 Oct 05 02:27:48.645814 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 156/316] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:48 2022] GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197 => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:48.685185 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3cc5b971-f63f-42cd-93de-5276561ea5eb tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Calling method '.version_select at 0x7fcce4766ee0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:48.688406 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3cc5b971-f63f-42cd-93de-5276561ea5eb tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:48.691406 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3cc5b971-f63f-42cd-93de-5276561ea5eb tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:48.691916 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3cc5b971-f63f-42cd-93de-5276561ea5eb tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:48.750281 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3cc5b971-f63f-42cd-93de-5276561ea5eb tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:48.751959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3cc5b971-f63f-42cd-93de-5276561ea5eb tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:48.752411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3cc5b971-f63f-42cd-93de-5276561ea5eb tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:48.803711 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3cc5b971-f63f-42cd-93de-5276561ea5eb tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:48.804286 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3cc5b971-f63f-42cd-93de-5276561ea5eb tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:48.804647 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3cc5b971-f63f-42cd-93de-5276561ea5eb tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:48.829563 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3cc5b971-f63f-42cd-93de-5276561ea5eb tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/n-h2-858272-3/servers" status: 200 len: 275 microversion: 2.1 time: 0.181958 Oct 05 02:27:48.841268 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 157/317] 10.222.0.16 () {58 vars in 1212 bytes} [Wed Oct 5 02:27:48 2022] GET /compute/v2.1/os-hypervisors/n-h2-858272-3/servers => generated 275 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:48.860478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2bdd9369-8537-4968-bd8d-6dd4f7baf8cd tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Calling method '.version_select at 0x7fcce4a97160>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:48.866647 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bdd9369-8537-4968-bd8d-6dd4f7baf8cd tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:48.868178 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bdd9369-8537-4968-bd8d-6dd4f7baf8cd tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:48.868875 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bdd9369-8537-4968-bd8d-6dd4f7baf8cd tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:48.906830 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bdd9369-8537-4968-bd8d-6dd4f7baf8cd tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:48.911122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bdd9369-8537-4968-bd8d-6dd4f7baf8cd tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:48.916635 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bdd9369-8537-4968-bd8d-6dd4f7baf8cd tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:48.949121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bdd9369-8537-4968-bd8d-6dd4f7baf8cd tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:48.950378 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bdd9369-8537-4968-bd8d-6dd4f7baf8cd tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:48.953732 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bdd9369-8537-4968-bd8d-6dd4f7baf8cd tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:48.969960 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2bdd9369-8537-4968-bd8d-6dd4f7baf8cd tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.113589 Oct 05 02:27:48.974417 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 158/318] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:27:48 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:27:48.993729 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8f8aebfe-d9b9-450f-8b92-b38956c8d7ff tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Calling method '.version_select at 0x7fcce4c5b430>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:49.000260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f8aebfe-d9b9-450f-8b92-b38956c8d7ff tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:49.002069 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f8aebfe-d9b9-450f-8b92-b38956c8d7ff tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:49.002746 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f8aebfe-d9b9-450f-8b92-b38956c8d7ff tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:49.033232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f8aebfe-d9b9-450f-8b92-b38956c8d7ff tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:49.038194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f8aebfe-d9b9-450f-8b92-b38956c8d7ff tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:49.039155 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f8aebfe-d9b9-450f-8b92-b38956c8d7ff tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:49.046421 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3062ece1-4a95-4a38-a414-fc83d169ab5f tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1254483345/action" status: 200 len: 97 microversion: 2.1 time: 0.810497 Oct 05 02:27:49.049548 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 161/319] 10.222.0.16 () {60 vars in 1200 bytes} [Wed Oct 5 02:27:48 2022] POST /compute/v2.1/flavors/1254483345/action => generated 97 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:27:49.055627 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8f8aebfe-d9b9-450f-8b92-b38956c8d7ff tempest-HypervisorAdminUnderV252Test-237423525 tempest-HypervisorAdminUnderV252Test-237423525-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/n-h2-858272-3/search" status: 200 len: 104 microversion: 2.1 time: 0.073576 Oct 05 02:27:49.056248 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 159/320] 10.222.0.16 () {58 vars in 1209 bytes} [Wed Oct 5 02:27:48 2022] GET /compute/v2.1/os-hypervisors/n-h2-858272-3/search => generated 104 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:49.067940 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fa473683-ab8e-4dc0-80ea-49592206a3ae tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "c65073d0fb914f13b382c660b200bbfb"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:49.367641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fca3b0fb-1eba-48f9-bb9c-01463e8d3fd0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:49.369192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fca3b0fb-1eba-48f9-bb9c-01463e8d3fd0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:49.378562 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fca3b0fb-1eba-48f9-bb9c-01463e8d3fd0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:49.379712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fca3b0fb-1eba-48f9-bb9c-01463e8d3fd0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:49.384660 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fca3b0fb-1eba-48f9-bb9c-01463e8d3fd0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:49.386526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fca3b0fb-1eba-48f9-bb9c-01463e8d3fd0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:49.387874 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fca3b0fb-1eba-48f9-bb9c-01463e8d3fd0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:49.389361 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fca3b0fb-1eba-48f9-bb9c-01463e8d3fd0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:49.684249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fca3b0fb-1eba-48f9-bb9c-01463e8d3fd0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:49.697632 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fca3b0fb-1eba-48f9-bb9c-01463e8d3fd0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:49.699090 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fca3b0fb-1eba-48f9-bb9c-01463e8d3fd0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:49.702641 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fca3b0fb-1eba-48f9-bb9c-01463e8d3fd0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 200 len: 1361 microversion: 2.25 time: 0.338833 Oct 05 02:27:49.705717 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 160/321] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:27:49 2022] GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 1361 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:27:49.710627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-473a0cc7-e19f-4cdf-910c-642c58ad8830 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:49.711234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-473a0cc7-e19f-4cdf-910c-642c58ad8830 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: 1a0dac23-a7fb-40cf-b2bc-849859ea8197] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:49.728111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-473a0cc7-e19f-4cdf-910c-642c58ad8830 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:49.729917 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-473a0cc7-e19f-4cdf-910c-642c58ad8830 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:49.730507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-473a0cc7-e19f-4cdf-910c-642c58ad8830 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:49.731973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-473a0cc7-e19f-4cdf-910c-642c58ad8830 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:49.734520 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-473a0cc7-e19f-4cdf-910c-642c58ad8830 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:49.735151 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-473a0cc7-e19f-4cdf-910c-642c58ad8830 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:49.917869 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-fa473683-ab8e-4dc0-80ea-49592206a3ae tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] HTTP exception thrown: Flavor access already exists for flavor 30 and project c65073d0fb914f13b382c660b200bbfb combination. Oct 05 02:27:49.959521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fa473683-ab8e-4dc0-80ea-49592206a3ae tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Request method failure captured: Oct 05 02:27:49.959521 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/flavors/1254483345/action HTTP/1.1 Oct 05 02:27:49.959521 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:27:49.959521 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:27:49.959521 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:27:49.959521 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 67 Oct 05 02:27:49.959521 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:27:49.959521 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:27:49.959521 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:27:49.959521 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:49.959521 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOuhsJUfErpWTO31CdXTme1POftxspjKW6VfbgecAeiYVyhj8096ZMo5OOvkk5SugVStFLQTtTgTuwCrIpy6H7ZN05gMy6cLlY4_VRXcfevzvg3CoV-w_xycHyjVcbdY6TjlLb_ZBSsI6ZiiJ_cTUDT6-GoKcYIStnCqKIxJ2gWwtns Oct 05 02:27:49.959521 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:27:49.959521 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:27:49.959521 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:27:49.959521 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:27:49.959521 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:27:49.959521 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:27:49.959521 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 7225ec592cee45a9842e24c94626072c Oct 05 02:27:49.959521 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-852576076 Oct 05 02:27:49.959521 n-d-858272-3 devstack@n-api.service[122319]: X-Role: admin,member,reader Oct 05 02:27:49.959521 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: admin,member,reader Oct 05 02:27:49.960779 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7225ec592cee45a9842e24c94626072c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7225ec592cee45a9842e24c94626072c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7225ec592cee45a9842e24c94626072c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7225ec592cee45a9842e24c94626072c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:49.960779 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-852576076 Oct 05 02:27:49.960779 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 7225ec592cee45a9842e24c94626072c Oct 05 02:27:49.960779 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-852576076 Oct 05 02:27:49.960779 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin Oct 05 02:27:49.960779 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:27:49.960779 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:27:49.960779 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: fcb4fff49dcf46dc953f2cff8f2f25f0 Oct 05 02:27:49.960779 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin Oct 05 02:27:49.960779 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:27:49.960779 n-d-858272-3 devstack@n-api.service[122319]: {"addTenantAccess": {"tenant": "c65073d0fb914f13b382c660b200bbfb"}} Oct 05 02:27:49.960779 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:27:49.961664 n-d-858272-3 devstack@n-api.service[122319]: exception: Flavor access already exists for flavor 30 and project c65073d0fb914f13b382c660b200bbfb combination. Oct 05 02:27:49.961664 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '1254483345', 'body': {'addTenantAccess': {'tenant': 'c65073d0fb914f13b382c660b200bbfb'}}} Oct 05 02:27:49.961664 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:49.961664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:49.961664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 05 02:27:49.961664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 05 02:27:49.961664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 05 02:27:49.961664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 05 02:27:49.961664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 05 02:27:49.961664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 05 02:27:49.961664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 05 02:27:49.961664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 05 02:27:49.961664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 05 02:27:49.961664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 05 02:27:49.961664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 05 02:27:49.961664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result.read() Oct 05 02:27:49.961664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 05 02:27:49.961664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 05 02:27:49.962645 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 05 02:27:49.962645 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 05 02:27:49.962645 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 05 02:27:49.962645 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 05 02:27:49.962645 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 05 02:27:49.962645 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 05 02:27:49.962645 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '30-c65073d0fb914f13b382c660b200bbfb' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 05 02:27:49.962645 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:49.962645 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 05 02:27:49.962645 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:49.962645 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:49.962645 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 05 02:27:49.962645 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 05 02:27:49.962645 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 05 02:27:49.962645 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi session.flush() Oct 05 02:27:49.962645 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 05 02:27:49.962645 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 05 02:27:49.962645 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 05 02:27:49.962645 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 05 02:27:49.963639 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 05 02:27:49.963639 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 05 02:27:49.963639 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 05 02:27:49.963639 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception Oct 05 02:27:49.963639 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 05 02:27:49.963639 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 05 02:27:49.963639 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 05 02:27:49.963639 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 05 02:27:49.963639 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 05 02:27:49.963639 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 05 02:27:49.963639 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 05 02:27:49.963639 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 05 02:27:49.963639 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 05 02:27:49.963639 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 05 02:27:49.963639 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 05 02:27:49.963639 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 05 02:27:49.963639 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 05 02:27:49.963639 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 05 02:27:49.964563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 05 02:27:49.964563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 05 02:27:49.964563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 05 02:27:49.964563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 05 02:27:49.964563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 05 02:27:49.964563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 05 02:27:49.964563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 05 02:27:49.964563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception Oct 05 02:27:49.964563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 05 02:27:49.964563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 05 02:27:49.964563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 05 02:27:49.964563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 05 02:27:49.964563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 05 02:27:49.964563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 05 02:27:49.964563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 05 02:27:49.964563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 05 02:27:49.964563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 05 02:27:49.964563 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 05 02:27:49.965536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 05 02:27:49.965536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result.read() Oct 05 02:27:49.965536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 05 02:27:49.965536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 05 02:27:49.965536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 05 02:27:49.965536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 05 02:27:49.965536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 05 02:27:49.965536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 05 02:27:49.965536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 05 02:27:49.965536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 05 02:27:49.965536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '30-c65073d0fb914f13b382c660b200bbfb' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 05 02:27:49.965536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 05 02:27:49.965536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 5, 2, 27, 49, 909426), 'updated_at': None, 'flavor_id': 30, 'project_id': 'c65073d0fb914f13b382c660b200bbfb'}] Oct 05 02:27:49.965536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 05 02:27:49.965536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:49.965536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:49.965536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:49.966683 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:49.966683 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 05 02:27:49.966683 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 05 02:27:49.966683 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 05 02:27:49.966683 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 05 02:27:49.966683 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 05 02:27:49.966683 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 05 02:27:49.966683 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 05 02:27:49.966683 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 05 02:27:49.966683 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 05 02:27:49.966683 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 05 02:27:49.966683 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 02:27:49.966683 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 02:27:49.966683 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 05 02:27:49.966683 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 05 02:27:49.966683 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 30 and project c65073d0fb914f13b382c660b200bbfb combination. Oct 05 02:27:49.966683 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:49.966683 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:49.966683 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:49.967748 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:49.967748 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:49.967748 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:49.967748 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:49.967748 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:49.967748 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:49.967748 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:49.967748 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:27:49.967748 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:27:49.967748 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 05 02:27:49.967748 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 05 02:27:49.967748 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 30 and project c65073d0fb914f13b382c660b200bbfb combination. Oct 05 02:27:49.967748 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:49.967748 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:49.967748 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:49.967748 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:49.967748 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:49.967748 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:49.967748 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:27:49.967748 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:27:49.972984 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 30 and project c65073d0fb914f13b382c660b200bbfb combination. Oct 05 02:27:49.972984 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:49.974226 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fa473683-ab8e-4dc0-80ea-49592206a3ae tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Returning 409 to user: Flavor access already exists for flavor 30 and project c65073d0fb914f13b382c660b200bbfb combination. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:49.975108 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fa473683-ab8e-4dc0-80ea-49592206a3ae tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1254483345/action" status: 409 len: 152 microversion: 2.1 time: 0.919216 Oct 05 02:27:49.978925 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 162/322] 10.222.0.16 () {60 vars in 1200 bytes} [Wed Oct 5 02:27:49 2022] POST /compute/v2.1/flavors/1254483345/action => generated 152 bytes in 921 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 05 02:27:49.990076 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-812f3395-3bda-4c60-93ba-30afdc5a2818 req-e3358100-525b-4b4d-9757-3bb433c93f9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a0dac23-a7fb-40cf-b2bc-849859ea8197", "name": "network-vif-plugged", "status": "completed", "tag": "11730f85-c18f-4aec-94a4-7d16b357eacb"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:50.008593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-812f3395-3bda-4c60-93ba-30afdc5a2818 req-e3358100-525b-4b4d-9757-3bb433c93f9f service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:50.009115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-812f3395-3bda-4c60-93ba-30afdc5a2818 req-e3358100-525b-4b4d-9757-3bb433c93f9f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:50.009564 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-812f3395-3bda-4c60-93ba-30afdc5a2818 req-e3358100-525b-4b4d-9757-3bb433c93f9f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:50.013728 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-473a0cc7-e19f-4cdf-910c-642c58ad8830 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:50.025206 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-473a0cc7-e19f-4cdf-910c-642c58ad8830 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197" status: 200 len: 1317 microversion: 2.1 time: 0.316850 Oct 05 02:27:50.026327 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 161/323] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:49 2022] GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197 => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:50.032498 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-186c9d92-0731-4ff4-9d5f-e33b551d200e tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "c65073d0fb914f13b382c660b200bbfb"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:50.043530 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-812f3395-3bda-4c60-93ba-30afdc5a2818 req-e3358100-525b-4b4d-9757-3bb433c93f9f service nova] Creating event network-vif-plugged:11730f85-c18f-4aec-94a4-7d16b357eacb for instance 1a0dac23-a7fb-40cf-b2bc-849859ea8197 on n-h2-858272-3 Oct 05 02:27:50.068444 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-812f3395-3bda-4c60-93ba-30afdc5a2818 req-e3358100-525b-4b4d-9757-3bb433c93f9f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091130 Oct 05 02:27:50.076506 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 163/324] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:50.734444 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8c156db6-ef96-4f32-86d3-2bbb2384f49f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:50.735086 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8c156db6-ef96-4f32-86d3-2bbb2384f49f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:50.747291 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c156db6-ef96-4f32-86d3-2bbb2384f49f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:50.749191 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c156db6-ef96-4f32-86d3-2bbb2384f49f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:50.751048 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c156db6-ef96-4f32-86d3-2bbb2384f49f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:50.752165 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c156db6-ef96-4f32-86d3-2bbb2384f49f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:50.754992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c156db6-ef96-4f32-86d3-2bbb2384f49f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:50.755783 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c156db6-ef96-4f32-86d3-2bbb2384f49f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:50.785508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=12,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:50.826517 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-186c9d92-0731-4ff4-9d5f-e33b551d200e tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1254483345/action" status: 200 len: 21 microversion: 2.1 time: 0.798348 Oct 05 02:27:50.833034 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 162/325] 10.222.0.16 () {60 vars in 1200 bytes} [Wed Oct 5 02:27:50 2022] POST /compute/v2.1/flavors/1254483345/action => generated 21 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:27:50.840746 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-83aff051-ae82-4a58-9d2a-6fcb146ec9b9 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:50.872481 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-83aff051-ae82-4a58-9d2a-6fcb146ec9b9 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1254483345" status: 202 len: 0 microversion: 2.1 time: 0.037018 Oct 05 02:27:50.873462 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 163/326] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 5 02:27:50 2022] DELETE /compute/v2.1/flavors/1254483345 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:27:50.884503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-86a0d66b-29ee-42d9-bf14-4231b57d2c34 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:50.915009 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-86a0d66b-29ee-42d9-bf14-4231b57d2c34 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037162 Oct 05 02:27:50.916335 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 164/327] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:27:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:27:50.943141 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ed032ee6-aeef-43a0-8329-6aa544de1ee7 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-560866970", "id": 2059504833, "os-flavor-access:is_public": "True"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:50.985091 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ed032ee6-aeef-43a0-8329-6aa544de1ee7 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.050142 Oct 05 02:27:50.986451 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 165/328] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:27:50 2022] POST /compute/v2.1/flavors => generated 437 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:51.162919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8c156db6-ef96-4f32-86d3-2bbb2384f49f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:51.171402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8c156db6-ef96-4f32-86d3-2bbb2384f49f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:51.172846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8c156db6-ef96-4f32-86d3-2bbb2384f49f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:51.173982 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8c156db6-ef96-4f32-86d3-2bbb2384f49f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 200 len: 1361 microversion: 2.25 time: 0.444091 Oct 05 02:27:51.181369 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 164/329] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:27:50 2022] GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 1361 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:27:51.186795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6ad88b2e-5d6a-4921-8acd-7b9727eb9df8 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:51.202767 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-6ad88b2e-5d6a-4921-8acd-7b9727eb9df8 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 05 02:27:51.204242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6ad88b2e-5d6a-4921-8acd-7b9727eb9df8 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Request method failure captured: Oct 05 02:27:51.204242 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/flavors/2059504833/os-flavor-access HTTP/1.1 Oct 05 02:27:51.204242 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:27:51.204242 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:27:51.204242 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:27:51.204242 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:27:51.204242 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:27:51.204242 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:27:51.204242 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:27:51.204242 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:51.204242 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOuhsJUfErpWTO31CdXTme1POftxspjKW6VfbgecAeiYVyhj8096ZMo5OOvkk5SugVStFLQTtTgTuwCrIpy6H7ZN05gMy6cLlY4_VRXcfevzvg3CoV-w_xycHyjVcbdY6TjlLb_ZBSsI6ZiiJ_cTUDT6-GoKcYIStnCqKIxJ2gWwtns Oct 05 02:27:51.204242 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:27:51.204242 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:27:51.204242 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:27:51.204242 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:27:51.204242 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:27:51.204242 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:27:51.204242 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 7225ec592cee45a9842e24c94626072c Oct 05 02:27:51.204242 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-852576076 Oct 05 02:27:51.204242 n-d-858272-3 devstack@n-api.service[122319]: X-Role: admin,member,reader Oct 05 02:27:51.204242 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: admin,member,reader Oct 05 02:27:51.205839 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7225ec592cee45a9842e24c94626072c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7225ec592cee45a9842e24c94626072c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7225ec592cee45a9842e24c94626072c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7225ec592cee45a9842e24c94626072c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:51.205839 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-852576076 Oct 05 02:27:51.205839 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 7225ec592cee45a9842e24c94626072c Oct 05 02:27:51.205839 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-852576076 Oct 05 02:27:51.205839 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin Oct 05 02:27:51.205839 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:27:51.205839 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:27:51.205839 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: fcb4fff49dcf46dc953f2cff8f2f25f0 Oct 05 02:27:51.205839 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin Oct 05 02:27:51.205839 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:27:51.205839 n-d-858272-3 devstack@n-api.service[122319]: exception: Access list not available for public flavors. Oct 05 02:27:51.205839 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'flavor_id': '2059504833'} Oct 05 02:27:51.206883 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:51.206883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:51.206883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:51.206883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:51.206883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:51.206883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:51.206883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:51.206883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:51.206883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 05 02:27:51.206883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 05 02:27:51.206883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 05 02:27:51.206883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:51.206883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:51.206883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:51.206883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:51.206883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:51.206883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:51.206883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:27:51.206883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:27:51.206883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 05 02:27:51.206883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:51.209491 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6ad88b2e-5d6a-4921-8acd-7b9727eb9df8 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:51.210704 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6ad88b2e-5d6a-4921-8acd-7b9727eb9df8 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/2059504833/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.034258 Oct 05 02:27:51.211541 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 165/330] 10.222.0.16 () {58 vars in 1209 bytes} [Wed Oct 5 02:27:51 2022] GET /compute/v2.1/flavors/2059504833/os-flavor-access => generated 91 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:27:51.216663 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-aa32f368-3b30-4b4d-9fe0-44fbc40966ab tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:51.217564 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-aa32f368-3b30-4b4d-9fe0-44fbc40966ab tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: 1a0dac23-a7fb-40cf-b2bc-849859ea8197] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:51.228302 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa32f368-3b30-4b4d-9fe0-44fbc40966ab tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:51.232041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa32f368-3b30-4b4d-9fe0-44fbc40966ab tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:51.232576 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa32f368-3b30-4b4d-9fe0-44fbc40966ab tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:51.233476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa32f368-3b30-4b4d-9fe0-44fbc40966ab tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:51.234105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa32f368-3b30-4b4d-9fe0-44fbc40966ab tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:51.239025 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa32f368-3b30-4b4d-9fe0-44fbc40966ab tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:51.303204 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d5709554-c264-4fd8-8154-c06358e3a72a tempest-NetworksTest-2073399481 tempest-NetworksTest-2073399481-project-admin] Calling method '.version_select at 0x7fcce466fe50>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:51.523799 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d5709554-c264-4fd8-8154-c06358e3a72a tempest-NetworksTest-2073399481 tempest-NetworksTest-2073399481-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks" status: 200 len: 4011 microversion: 2.1 time: 0.536181 Oct 05 02:27:51.527574 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 166/331] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 5 02:27:50 2022] GET /compute/v2.1/os-networks => generated 4011 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:51.535267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-aa32f368-3b30-4b4d-9fe0-44fbc40966ab tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:51.543220 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-aa32f368-3b30-4b4d-9fe0-44fbc40966ab tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197" status: 200 len: 1317 microversion: 2.1 time: 0.330475 Oct 05 02:27:51.543974 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 166/332] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:51 2022] GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197 => generated 1317 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:51.548206 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fe03d8f0-9ff3-422f-8441-2f22d9bec598 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:51.585054 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fe03d8f0-9ff3-422f-8441-2f22d9bec598 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/2059504833" status: 202 len: 0 microversion: 2.1 time: 0.040168 Oct 05 02:27:51.585660 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 167/333] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 5 02:27:51 2022] DELETE /compute/v2.1/flavors/2059504833 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:27:51.601356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e1703de6-d3f1-40c7-96d7-0a2e8e79cdb9 tempest-NetworksTest-2073399481 tempest-NetworksTest-2073399481-project-admin] Calling method '.version_select at 0x7fcce4890b80>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:51.958205 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e1703de6-d3f1-40c7-96d7-0a2e8e79cdb9 tempest-NetworksTest-2073399481 tempest-NetworksTest-2073399481-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks/8822eb34-3330-4956-843b-08d392361d41" status: 200 len: 652 microversion: 2.1 time: 0.368100 Oct 05 02:27:51.958777 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 168/334] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 02:27:51 2022] GET /compute/v2.1/os-networks/8822eb34-3330-4956-843b-08d392361d41 => generated 652 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:51.964331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b526dbbd-25d4-41da-965f-8b58694491c2 tempest-FlavorsV261TestJSON-1776245064 tempest-FlavorsV261TestJSON-1776245064-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-416235818", "id": 2019073377, "os-flavor-access:is_public": "True"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:51.969073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-37efe65a-5555-4f48-9798-1060d2f4e4b1 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:52.006781 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-37efe65a-5555-4f48-9798-1060d2f4e4b1 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045734 Oct 05 02:27:52.007739 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 169/335] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:27:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:52.024597 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-019a9f5e-c348-4315-8404-8d46741a2261 tempest-NetworksTest-2073399481 tempest-NetworksTest-2073399481-project-admin] Calling method '.version_select at 0x7fcce465f280>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:52.032229 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b526dbbd-25d4-41da-965f-8b58694491c2 tempest-FlavorsV261TestJSON-1776245064 tempest-FlavorsV261TestJSON-1776245064-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 0.498232 Oct 05 02:27:52.047475 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 167/336] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 5 02:27:51 2022] POST /compute/v2.1/flavors => generated 467 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:27:52.072775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-74470674-05af-4674-a587-34185ee8ca2c tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1845412254", "id": 552822298, "os-flavor-access:is_public": "False"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:52.110565 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-74470674-05af-4674-a587-34185ee8ca2c tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.057002 Oct 05 02:27:52.120718 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 168/337] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:27:52 2022] POST /compute/v2.1/flavors => generated 436 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:52.373331 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-019a9f5e-c348-4315-8404-8d46741a2261 tempest-NetworksTest-2073399481 tempest-NetworksTest-2073399481-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks" status: 200 len: 4011 microversion: 2.1 time: 0.364230 Oct 05 02:27:52.374945 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 170/338] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 5 02:27:52 2022] GET /compute/v2.1/os-networks => generated 4011 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:52.549251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c224d4e8-5bb8-4804-9662-8cd4080200e6 tempest-FlavorsV261TestJSON-1428525078 tempest-FlavorsV261TestJSON-1428525078-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:52.568773 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c224d4e8-5bb8-4804-9662-8cd4080200e6 tempest-FlavorsV261TestJSON-1428525078 tempest-FlavorsV261TestJSON-1428525078-project] 10.222.0.16 "GET /compute/v2.1/flavors/2019073377" status: 200 len: 467 microversion: 2.61 time: 0.445113 Oct 05 02:27:52.570218 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 169/339] 10.222.0.16 () {60 vars in 1199 bytes} [Wed Oct 5 02:27:52 2022] GET /compute/v2.1/flavors/2019073377 => generated 467 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:27:52.575950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-11117ce4-ade8-4464-bbbe-959345cffe00 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:52.576825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-11117ce4-ade8-4464-bbbe-959345cffe00 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:52.593364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11117ce4-ade8-4464-bbbe-959345cffe00 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:52.594140 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11117ce4-ade8-4464-bbbe-959345cffe00 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:52.595400 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11117ce4-ade8-4464-bbbe-959345cffe00 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:52.599763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11117ce4-ade8-4464-bbbe-959345cffe00 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:52.600548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11117ce4-ade8-4464-bbbe-959345cffe00 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:52.603560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11117ce4-ade8-4464-bbbe-959345cffe00 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:52.842394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c381f8a3-ce3c-4b18-99bc-00efd0a758cd tempest-FlavorsAccessNegativeTestJSON-922829732 tempest-FlavorsAccessNegativeTestJSON-922829732-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "c65073d0fb914f13b382c660b200bbfb"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:52.846136 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c381f8a3-ce3c-4b18-99bc-00efd0a758cd tempest-FlavorsAccessNegativeTestJSON-922829732 tempest-FlavorsAccessNegativeTestJSON-922829732-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '5abef17f2c2e4ce980b10ec4a3de8ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65073d0fb914f13b382c660b200bbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:52.851527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c381f8a3-ce3c-4b18-99bc-00efd0a758cd tempest-FlavorsAccessNegativeTestJSON-922829732 tempest-FlavorsAccessNegativeTestJSON-922829732-project] Request method failure captured: Oct 05 02:27:52.851527 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/flavors/552822298/action HTTP/1.1 Oct 05 02:27:52.851527 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:27:52.851527 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:27:52.851527 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:27:52.851527 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 67 Oct 05 02:27:52.851527 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:27:52.851527 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:27:52.851527 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:27:52.851527 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:52.851527 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOuff7G0hegh24ixVu8LA19bQA-sHcMyGYqmGuQf7RmLKdP72N4ijbZry1Iz4ZurMpJ7P6acn9ygWDu7UoioIt8q7sG19edzcgO6z4QSks6KCCS94IaXh4NfejiXXXGvoU1JIz1jSJTuC7lzONXoAN_Re5A62vXABE8NRK_Wtla6pQ0 Oct 05 02:27:52.851527 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:27:52.851527 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:27:52.851527 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:27:52.851527 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:27:52.851527 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:27:52.851527 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:27:52.851527 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: c65073d0fb914f13b382c660b200bbfb Oct 05 02:27:52.851527 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-922829732 Oct 05 02:27:52.851527 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:27:52.851527 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:27:52.853049 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c65073d0fb914f13b382c660b200bbfb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c65073d0fb914f13b382c660b200bbfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c65073d0fb914f13b382c660b200bbfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c65073d0fb914f13b382c660b200bbfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:52.853049 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-922829732 Oct 05 02:27:52.853049 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: c65073d0fb914f13b382c660b200bbfb Oct 05 02:27:52.853049 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-922829732 Oct 05 02:27:52.853049 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-FlavorsAccessNegativeTestJSON-922829732-project Oct 05 02:27:52.853049 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:27:52.853049 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:27:52.853049 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 5abef17f2c2e4ce980b10ec4a3de8ea4 Oct 05 02:27:52.853049 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-922829732-project Oct 05 02:27:52.853049 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:27:52.853049 n-d-858272-3 devstack@n-api.service[122319]: {"addTenantAccess": {"tenant": "c65073d0fb914f13b382c660b200bbfb"}} Oct 05 02:27:52.853049 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:27:52.853885 n-d-858272-3 devstack@n-api.service[122319]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 05 02:27:52.853885 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '552822298', 'body': {'addTenantAccess': {'tenant': 'c65073d0fb914f13b382c660b200bbfb'}}} Oct 05 02:27:52.853885 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:52.853885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:52.853885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:52.853885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:52.853885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:52.853885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:52.853885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:52.853885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:52.853885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:27:52.853885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:27:52.853885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 05 02:27:52.853885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 05 02:27:52.853885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 02:27:52.853885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 02:27:52.853885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 02:27:52.853885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 02:27:52.853885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:27:52.855247 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:27:52.855247 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:27:52.855247 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:27:52.855247 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 02:27:52.855247 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 02:27:52.855247 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 02:27:52.855247 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 02:27:52.855247 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:27:52.855247 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 02:27:52.855247 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 05 02:27:52.855247 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:52.855247 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:52.855247 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:52.855247 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:52.855247 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:52.855247 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:52.855247 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 02:27:52.855247 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 02:27:52.855247 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 05 02:27:52.855247 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:27:52.858951 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c381f8a3-ce3c-4b18-99bc-00efd0a758cd tempest-FlavorsAccessNegativeTestJSON-922829732 tempest-FlavorsAccessNegativeTestJSON-922829732-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:52.860184 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c381f8a3-ce3c-4b18-99bc-00efd0a758cd tempest-FlavorsAccessNegativeTestJSON-922829732 tempest-FlavorsAccessNegativeTestJSON-922829732-project] 10.222.0.16 "POST /compute/v2.1/flavors/552822298/action" status: 403 len: 130 microversion: 2.1 time: 0.484098 Oct 05 02:27:52.864095 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 171/340] 10.222.0.16 () {60 vars in 1197 bytes} [Wed Oct 5 02:27:52 2022] POST /compute/v2.1/flavors/552822298/action => generated 130 bytes in 488 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:27:52.878405 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-364a965d-6252-42be-9e8d-3a058b555903 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:52.879388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-364a965d-6252-42be-9e8d-3a058b555903 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: 1a0dac23-a7fb-40cf-b2bc-849859ea8197] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:52.897583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-364a965d-6252-42be-9e8d-3a058b555903 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:52.900565 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-364a965d-6252-42be-9e8d-3a058b555903 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:52.903685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-364a965d-6252-42be-9e8d-3a058b555903 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:52.905517 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-364a965d-6252-42be-9e8d-3a058b555903 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:52.906664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-364a965d-6252-42be-9e8d-3a058b555903 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:52.908839 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-364a965d-6252-42be-9e8d-3a058b555903 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:53.074128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-11117ce4-ade8-4464-bbbe-959345cffe00 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:53.083575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-11117ce4-ade8-4464-bbbe-959345cffe00 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:53.088427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-11117ce4-ade8-4464-bbbe-959345cffe00 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:53.095390 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-11117ce4-ade8-4464-bbbe-959345cffe00 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 200 len: 1361 microversion: 2.25 time: 0.523849 Oct 05 02:27:53.097353 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 170/341] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:27:52 2022] GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 1361 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:27:53.113300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e9bf8b56-da9a-4a03-9477-9451c2ea0e22 tempest-FlavorsV261TestJSON-1776245064 tempest-FlavorsV261TestJSON-1776245064-project-admin] Action: 'update', calling method: .version_select at 0x7fcce5d2bb80>, body: {"flavor": {"description": "new"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:53.173181 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e9bf8b56-da9a-4a03-9477-9451c2ea0e22 tempest-FlavorsV261TestJSON-1776245064 tempest-FlavorsV261TestJSON-1776245064-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/2019073377" status: 200 len: 468 microversion: 2.61 time: 0.072622 Oct 05 02:27:53.174479 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 171/342] 10.222.0.16 () {62 vars in 1219 bytes} [Wed Oct 5 02:27:53 2022] PUT /compute/v2.1/flavors/2019073377 => generated 468 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:27:53.182927 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ce8428f0-17e0-4118-b13d-17fdd818ceb1 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:53.210384 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ce8428f0-17e0-4118-b13d-17fdd818ceb1 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/552822298" status: 202 len: 0 microversion: 2.1 time: 0.033431 Oct 05 02:27:53.211371 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 172/343] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 5 02:27:53 2022] DELETE /compute/v2.1/flavors/552822298 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:27:53.226242 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1b5be754-50c3-4c19-8f86-218664e8b590 tempest-FlavorsV261TestJSON-1428525078 tempest-FlavorsV261TestJSON-1428525078-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:53.255219 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1b5be754-50c3-4c19-8f86-218664e8b590 tempest-FlavorsV261TestJSON-1428525078 tempest-FlavorsV261TestJSON-1428525078-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6249 microversion: 2.61 time: 0.042401 Oct 05 02:27:53.255812 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 173/344] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Oct 5 02:27:53 2022] GET /compute/v2.1/flavors/detail => generated 6249 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:27:53.279581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1a345e8f-3ab4-413a-8c5e-bc2b1890be45 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:53.308629 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1a345e8f-3ab4-413a-8c5e-bc2b1890be45 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.036589 Oct 05 02:27:53.309471 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 174/345] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:27:53 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:53.326036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fd36c63a-a773-4d72-ab5d-84f1ea854f70 tempest-FlavorsV261TestJSON-1428525078 tempest-FlavorsV261TestJSON-1428525078-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:53.382755 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fd36c63a-a773-4d72-ab5d-84f1ea854f70 tempest-FlavorsV261TestJSON-1428525078 tempest-FlavorsV261TestJSON-1428525078-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.61 time: 0.071873 Oct 05 02:27:53.383365 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 175/346] 10.222.0.16 () {60 vars in 1166 bytes} [Wed Oct 5 02:27:53 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:27:53.393729 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ff11df09-018e-4012-9a01-ac03643017cf tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-3344583", "id": 295349555, "os-flavor-access:is_public": "False"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:53.402528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-364a965d-6252-42be-9e8d-3a058b555903 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:53.417937 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-364a965d-6252-42be-9e8d-3a058b555903 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197" status: 200 len: 1467 microversion: 2.1 time: 0.552541 Oct 05 02:27:53.442356 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 172/347] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:52 2022] GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197 => generated 1467 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:53.447281 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ff11df09-018e-4012-9a01-ac03643017cf tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.060688 Oct 05 02:27:53.447895 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 176/348] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:27:53 2022] POST /compute/v2.1/flavors => generated 433 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:53.460936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b684bb79-7907-49aa-9b6c-e580c52c398d tempest-DeleteServersAdminTestJSON-1521400760 tempest-DeleteServersAdminTestJSON-1521400760-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:53.472788 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ec5d3a23-298f-4dce-9be3-65faf303f3f2 tempest-FlavorsV261TestJSON-1776245064 tempest-FlavorsV261TestJSON-1776245064-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:53.477286 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b684bb79-7907-49aa-9b6c-e580c52c398d tempest-DeleteServersAdminTestJSON-1521400760 tempest-DeleteServersAdminTestJSON-1521400760-project-admin] [instance: 1a0dac23-a7fb-40cf-b2bc-849859ea8197] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:53.492268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b684bb79-7907-49aa-9b6c-e580c52c398d tempest-DeleteServersAdminTestJSON-1521400760 tempest-DeleteServersAdminTestJSON-1521400760-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:53.492768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b684bb79-7907-49aa-9b6c-e580c52c398d tempest-DeleteServersAdminTestJSON-1521400760 tempest-DeleteServersAdminTestJSON-1521400760-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:53.493334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b684bb79-7907-49aa-9b6c-e580c52c398d tempest-DeleteServersAdminTestJSON-1521400760 tempest-DeleteServersAdminTestJSON-1521400760-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:53.494061 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b684bb79-7907-49aa-9b6c-e580c52c398d tempest-DeleteServersAdminTestJSON-1521400760 tempest-DeleteServersAdminTestJSON-1521400760-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:53.494522 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b684bb79-7907-49aa-9b6c-e580c52c398d tempest-DeleteServersAdminTestJSON-1521400760 tempest-DeleteServersAdminTestJSON-1521400760-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:53.494947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b684bb79-7907-49aa-9b6c-e580c52c398d tempest-DeleteServersAdminTestJSON-1521400760 tempest-DeleteServersAdminTestJSON-1521400760-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:53.529741 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ec5d3a23-298f-4dce-9be3-65faf303f3f2 tempest-FlavorsV261TestJSON-1776245064 tempest-FlavorsV261TestJSON-1776245064-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/2019073377" status: 202 len: 0 microversion: 2.61 time: 0.085223 Oct 05 02:27:53.533789 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 173/349] 10.222.0.16 () {60 vars in 1202 bytes} [Wed Oct 5 02:27:53 2022] DELETE /compute/v2.1/flavors/2019073377 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:27:53.542514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-75f882a3-6d7e-4ba8-97e8-675d7a1a91fa tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "c65073d0fb914f13b382c660b200bbfb"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:53.750147 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b684bb79-7907-49aa-9b6c-e580c52c398d tempest-DeleteServersAdminTestJSON-1521400760 tempest-DeleteServersAdminTestJSON-1521400760-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197/action" status: 202 len: 0 microversion: 2.1 time: 0.298033 Oct 05 02:27:53.751697 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 177/350] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:27:53 2022] POST /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:27:53.758705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a8d4db24-59d5-4767-bf9f-f54583f22865 tempest-FlavorsV261TestJSON-1776245064 tempest-FlavorsV261TestJSON-1776245064-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:53.796821 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a8d4db24-59d5-4767-bf9f-f54583f22865 tempest-FlavorsV261TestJSON-1776245064 tempest-FlavorsV261TestJSON-1776245064-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.043737 Oct 05 02:27:53.797978 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 178/351] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Oct 5 02:27:53 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:27:53.803626 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-212cc077-b39a-49d5-a262-fa066aebf439 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:53.804282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-212cc077-b39a-49d5-a262-fa066aebf439 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: 1a0dac23-a7fb-40cf-b2bc-849859ea8197] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:53.811109 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-212cc077-b39a-49d5-a262-fa066aebf439 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:53.812290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-212cc077-b39a-49d5-a262-fa066aebf439 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:53.813310 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-212cc077-b39a-49d5-a262-fa066aebf439 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:53.817447 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-212cc077-b39a-49d5-a262-fa066aebf439 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:53.818218 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-212cc077-b39a-49d5-a262-fa066aebf439 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:53.818799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-212cc077-b39a-49d5-a262-fa066aebf439 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:53.875222 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-212cc077-b39a-49d5-a262-fa066aebf439 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:53.875428 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-212cc077-b39a-49d5-a262-fa066aebf439 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:53.876080 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-212cc077-b39a-49d5-a262-fa066aebf439 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:53.876482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-212cc077-b39a-49d5-a262-fa066aebf439 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lazy-loading 'fault' on Instance uuid 1a0dac23-a7fb-40cf-b2bc-849859ea8197 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:27:54.104276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-212cc077-b39a-49d5-a262-fa066aebf439 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:54.115061 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-212cc077-b39a-49d5-a262-fa066aebf439 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197" status: 200 len: 1450 microversion: 2.1 time: 0.315983 Oct 05 02:27:54.115746 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 179/352] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:53 2022] GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197 => generated 1450 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:54.129411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-23466ebb-0d5f-4a46-97b4-08387c4eb385 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:54.129411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-23466ebb-0d5f-4a46-97b4-08387c4eb385 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:54.131661 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23466ebb-0d5f-4a46-97b4-08387c4eb385 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:54.132378 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23466ebb-0d5f-4a46-97b4-08387c4eb385 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:54.133077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23466ebb-0d5f-4a46-97b4-08387c4eb385 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:54.134174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23466ebb-0d5f-4a46-97b4-08387c4eb385 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:54.135216 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23466ebb-0d5f-4a46-97b4-08387c4eb385 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:54.136068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23466ebb-0d5f-4a46-97b4-08387c4eb385 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:54.142272 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:54.334202 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-75f882a3-6d7e-4ba8-97e8-675d7a1a91fa tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/295349555/action" status: 200 len: 96 microversion: 2.1 time: 0.796031 Oct 05 02:27:54.336018 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 174/353] 10.222.0.16 () {60 vars in 1197 bytes} [Wed Oct 5 02:27:53 2022] POST /compute/v2.1/flavors/295349555/action => generated 96 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:27:54.351383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e24a5bf8-3fc2-4943-bb0c-3a5fc8848c76 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:54.352049 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e24a5bf8-3fc2-4943-bb0c-3a5fc8848c76 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: 1a0dac23-a7fb-40cf-b2bc-849859ea8197] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:54.366448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e24a5bf8-3fc2-4943-bb0c-3a5fc8848c76 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:54.367220 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e24a5bf8-3fc2-4943-bb0c-3a5fc8848c76 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:54.367817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e24a5bf8-3fc2-4943-bb0c-3a5fc8848c76 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:54.371975 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e24a5bf8-3fc2-4943-bb0c-3a5fc8848c76 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:54.376533 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e24a5bf8-3fc2-4943-bb0c-3a5fc8848c76 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:54.377277 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e24a5bf8-3fc2-4943-bb0c-3a5fc8848c76 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:54.441515 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e24a5bf8-3fc2-4943-bb0c-3a5fc8848c76 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: 1a0dac23-a7fb-40cf-b2bc-849859ea8197] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:27:54.456657 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-23466ebb-0d5f-4a46-97b4-08387c4eb385 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:54.469448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-23466ebb-0d5f-4a46-97b4-08387c4eb385 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:54.470785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-23466ebb-0d5f-4a46-97b4-08387c4eb385 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:54.472693 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-23466ebb-0d5f-4a46-97b4-08387c4eb385 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 200 len: 1361 microversion: 2.25 time: 0.354322 Oct 05 02:27:54.473284 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 180/354] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:27:54 2022] GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 1361 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:27:54.488582 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-56814052-d0a2-4214-b801-172621d95b35 tempest-FlavorsAccessNegativeTestJSON-922829732 tempest-FlavorsAccessNegativeTestJSON-922829732-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "c65073d0fb914f13b382c660b200bbfb"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:54.492021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-56814052-d0a2-4214-b801-172621d95b35 tempest-FlavorsAccessNegativeTestJSON-922829732 tempest-FlavorsAccessNegativeTestJSON-922829732-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '5abef17f2c2e4ce980b10ec4a3de8ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65073d0fb914f13b382c660b200bbfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:54.493854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-56814052-d0a2-4214-b801-172621d95b35 tempest-FlavorsAccessNegativeTestJSON-922829732 tempest-FlavorsAccessNegativeTestJSON-922829732-project] Request method failure captured: Oct 05 02:27:54.493854 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/flavors/295349555/action HTTP/1.1 Oct 05 02:27:54.493854 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:27:54.493854 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:27:54.493854 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:27:54.493854 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 70 Oct 05 02:27:54.493854 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:27:54.493854 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:27:54.493854 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:27:54.493854 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:54.493854 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOuff7G0hegh24ixVu8LA19bQA-sHcMyGYqmGuQf7RmLKdP72N4ijbZry1Iz4ZurMpJ7P6acn9ygWDu7UoioIt8q7sG19edzcgO6z4QSks6KCCS94IaXh4NfejiXXXGvoU1JIz1jSJTuC7lzONXoAN_Re5A62vXABE8NRK_Wtla6pQ0 Oct 05 02:27:54.493854 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:27:54.493854 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:27:54.493854 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:27:54.493854 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:27:54.493854 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:27:54.493854 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:27:54.493854 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c65073d0fb914f13b382c660b200bbfb Oct 05 02:27:54.493854 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-922829732 Oct 05 02:27:54.493854 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:27:54.493854 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:27:54.495869 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c65073d0fb914f13b382c660b200bbfb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c65073d0fb914f13b382c660b200bbfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c65073d0fb914f13b382c660b200bbfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c65073d0fb914f13b382c660b200bbfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:54.495869 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-922829732 Oct 05 02:27:54.495869 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c65073d0fb914f13b382c660b200bbfb Oct 05 02:27:54.495869 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-922829732 Oct 05 02:27:54.495869 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-FlavorsAccessNegativeTestJSON-922829732-project Oct 05 02:27:54.495869 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:27:54.495869 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:27:54.495869 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 5abef17f2c2e4ce980b10ec4a3de8ea4 Oct 05 02:27:54.495869 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-922829732-project Oct 05 02:27:54.495869 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:27:54.495869 n-d-858272-3 devstack@n-api.service[122320]: {"removeTenantAccess": {"tenant": "c65073d0fb914f13b382c660b200bbfb"}} Oct 05 02:27:54.495869 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:27:54.496556 n-d-858272-3 devstack@n-api.service[122320]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 05 02:27:54.496556 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '295349555', 'body': {'removeTenantAccess': {'tenant': 'c65073d0fb914f13b382c660b200bbfb'}}} Oct 05 02:27:54.496556 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:54.496556 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:54.496556 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:54.496556 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:54.496556 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:54.496556 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:54.496556 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:54.496556 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:54.496556 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:27:54.496556 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:27:54.496556 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 05 02:27:54.496556 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi context.can( Oct 05 02:27:54.496556 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 02:27:54.496556 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 02:27:54.496556 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 02:27:54.496556 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 02:27:54.496556 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:27:54.496556 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:27:54.497746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:27:54.497746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:27:54.497746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 02:27:54.497746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 02:27:54.497746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 02:27:54.497746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 02:27:54.497746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:27:54.497746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 02:27:54.497746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 05 02:27:54.497746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:54.497746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:54.497746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:54.497746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:54.497746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:54.497746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:54.497746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 02:27:54.497746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 02:27:54.497746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 05 02:27:54.497746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:54.499621 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-56814052-d0a2-4214-b801-172621d95b35 tempest-FlavorsAccessNegativeTestJSON-922829732 tempest-FlavorsAccessNegativeTestJSON-922829732-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:54.499621 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-56814052-d0a2-4214-b801-172621d95b35 tempest-FlavorsAccessNegativeTestJSON-922829732 tempest-FlavorsAccessNegativeTestJSON-922829732-project] 10.222.0.16 "POST /compute/v2.1/flavors/295349555/action" status: 403 len: 133 microversion: 2.1 time: 0.023489 Oct 05 02:27:54.506906 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 181/355] 10.222.0.16 () {60 vars in 1197 bytes} [Wed Oct 5 02:27:54 2022] POST /compute/v2.1/flavors/295349555/action => generated 133 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:27:54.521204 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-97bb9cfd-15da-4b3b-be80-08220f038854 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "c65073d0fb914f13b382c660b200bbfb"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:54.690822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=9,nova_api:INSERT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:54.722443 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e24a5bf8-3fc2-4943-bb0c-3a5fc8848c76 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197" status: 204 len: 0 microversion: 2.1 time: 0.379711 Oct 05 02:27:54.725637 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 175/356] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:27:54 2022] DELETE /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:27:54.734257 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f0af24d2-69a4-4261-b128-ea01008a18ea tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:54.735132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f0af24d2-69a4-4261-b128-ea01008a18ea tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: 1a0dac23-a7fb-40cf-b2bc-849859ea8197] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:54.736582 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=10 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:54.744956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0af24d2-69a4-4261-b128-ea01008a18ea tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:54.745653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0af24d2-69a4-4261-b128-ea01008a18ea tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:54.746546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0af24d2-69a4-4261-b128-ea01008a18ea tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:54.747274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0af24d2-69a4-4261-b128-ea01008a18ea tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:54.747724 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0af24d2-69a4-4261-b128-ea01008a18ea tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:54.748416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0af24d2-69a4-4261-b128-ea01008a18ea tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:54.791061 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0af24d2-69a4-4261-b128-ea01008a18ea tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:54.792138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0af24d2-69a4-4261-b128-ea01008a18ea tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:54.792723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0af24d2-69a4-4261-b128-ea01008a18ea tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:54.793509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-f0af24d2-69a4-4261-b128-ea01008a18ea tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lazy-loading 'fault' on Instance uuid 1a0dac23-a7fb-40cf-b2bc-849859ea8197 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:27:55.157632 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f0af24d2-69a4-4261-b128-ea01008a18ea tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:55.171473 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f0af24d2-69a4-4261-b128-ea01008a18ea tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197" status: 200 len: 1456 microversion: 2.1 time: 0.443873 Oct 05 02:27:55.172060 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 176/357] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:54 2022] GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197 => generated 1456 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:27:55.443025 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-97bb9cfd-15da-4b3b-be80-08220f038854 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/295349555/action" status: 200 len: 21 microversion: 2.1 time: 0.934240 Oct 05 02:27:55.447015 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 182/358] 10.222.0.16 () {60 vars in 1197 bytes} [Wed Oct 5 02:27:54 2022] POST /compute/v2.1/flavors/295349555/action => generated 21 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:27:55.455650 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d4db7025-c80c-4fed-82f3-0a2262f2ff9f tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:55.493419 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d4db7025-c80c-4fed-82f3-0a2262f2ff9f tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/295349555" status: 202 len: 0 microversion: 2.1 time: 0.041254 Oct 05 02:27:55.497123 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 177/359] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 5 02:27:55 2022] DELETE /compute/v2.1/flavors/295349555 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:27:55.505500 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ed676532-499b-45c9-933a-cba7d7b4f616 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:55.506121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ed676532-499b-45c9-933a-cba7d7b4f616 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:55.512346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2c29e312-7769-4942-aaa9-bdd13965f7cf tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:55.546707 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed676532-499b-45c9-933a-cba7d7b4f616 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:55.547274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed676532-499b-45c9-933a-cba7d7b4f616 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:55.547726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed676532-499b-45c9-933a-cba7d7b4f616 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:55.548469 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed676532-499b-45c9-933a-cba7d7b4f616 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:55.549053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed676532-499b-45c9-933a-cba7d7b4f616 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:55.552536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed676532-499b-45c9-933a-cba7d7b4f616 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:55.594935 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2c29e312-7769-4942-aaa9-bdd13965f7cf tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.096342 Oct 05 02:27:55.606041 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 183/360] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:27:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:55.625522 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1abbd740-b0c7-410c-924e-9d0698d7f164 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-474557322", "id": 938715597, "os-flavor-access:is_public": "False"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:55.675016 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1abbd740-b0c7-410c-924e-9d0698d7f164 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.053486 Oct 05 02:27:55.676201 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 184/361] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:27:55 2022] POST /compute/v2.1/flavors => generated 435 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:55.695606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ff90a359-e096-46fd-a4ef-dbda045fd867 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "3eb0d0a55478414c83dd8345b60903aa"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:55.912112 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ed676532-499b-45c9-933a-cba7d7b4f616 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:55.923828 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ed676532-499b-45c9-933a-cba7d7b4f616 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:55.937881 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ed676532-499b-45c9-933a-cba7d7b4f616 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:55.939127 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ed676532-499b-45c9-933a-cba7d7b4f616 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 200 len: 1361 microversion: 2.25 time: 0.437859 Oct 05 02:27:55.939725 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 178/362] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:27:55 2022] GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 1361 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:27:56.098753 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-e7f820c4-f61b-4882-bcfd-2f99645fe47d req-4c304658-c888-4813-8fff-1675f7b46eba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eddae3fc-f975-45e3-8592-01b10bcf32ad", "name": "network-vif-plugged", "status": "completed", "tag": "76ca6ca5-722f-44bd-ab65-b8f77ef0027e"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:56.121412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e7f820c4-f61b-4882-bcfd-2f99645fe47d req-4c304658-c888-4813-8fff-1675f7b46eba service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:56.121899 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e7f820c4-f61b-4882-bcfd-2f99645fe47d req-4c304658-c888-4813-8fff-1675f7b46eba service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:56.125033 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e7f820c4-f61b-4882-bcfd-2f99645fe47d req-4c304658-c888-4813-8fff-1675f7b46eba service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:56.151177 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-e7f820c4-f61b-4882-bcfd-2f99645fe47d req-4c304658-c888-4813-8fff-1675f7b46eba service nova] Creating event network-vif-plugged:76ca6ca5-722f-44bd-ab65-b8f77ef0027e for instance eddae3fc-f975-45e3-8592-01b10bcf32ad on n-h2-858272-3 Oct 05 02:27:56.156728 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-e7f820c4-f61b-4882-bcfd-2f99645fe47d req-4c304658-c888-4813-8fff-1675f7b46eba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063419 Oct 05 02:27:56.157906 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 179/363] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:27:56.202525 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-65bf7bd7-1517-48ef-908a-66ce41a57276 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:56.203568 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-65bf7bd7-1517-48ef-908a-66ce41a57276 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: 1a0dac23-a7fb-40cf-b2bc-849859ea8197] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:56.214061 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65bf7bd7-1517-48ef-908a-66ce41a57276 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:56.214546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65bf7bd7-1517-48ef-908a-66ce41a57276 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:56.217014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65bf7bd7-1517-48ef-908a-66ce41a57276 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:56.217889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65bf7bd7-1517-48ef-908a-66ce41a57276 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:56.220612 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65bf7bd7-1517-48ef-908a-66ce41a57276 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:56.222361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65bf7bd7-1517-48ef-908a-66ce41a57276 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:56.299307 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65bf7bd7-1517-48ef-908a-66ce41a57276 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:56.300555 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65bf7bd7-1517-48ef-908a-66ce41a57276 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:56.301350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65bf7bd7-1517-48ef-908a-66ce41a57276 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:56.301952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-65bf7bd7-1517-48ef-908a-66ce41a57276 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lazy-loading 'fault' on Instance uuid 1a0dac23-a7fb-40cf-b2bc-849859ea8197 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:27:56.370878 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-ff90a359-e096-46fd-a4ef-dbda045fd867 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] HTTP exception thrown: Flavor access not found for 35 / 3eb0d0a55478414c83dd8345b60903aa combination. Oct 05 02:27:56.376694 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ff90a359-e096-46fd-a4ef-dbda045fd867 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Request method failure captured: Oct 05 02:27:56.376694 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/flavors/938715597/action HTTP/1.1 Oct 05 02:27:56.376694 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:27:56.376694 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:27:56.376694 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:27:56.376694 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 70 Oct 05 02:27:56.376694 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:27:56.376694 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:27:56.376694 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:27:56.376694 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:27:56.376694 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOuhsJUfErpWTO31CdXTme1POftxspjKW6VfbgecAeiYVyhj8096ZMo5OOvkk5SugVStFLQTtTgTuwCrIpy6H7ZN05gMy6cLlY4_VRXcfevzvg3CoV-w_xycHyjVcbdY6TjlLb_ZBSsI6ZiiJ_cTUDT6-GoKcYIStnCqKIxJ2gWwtns Oct 05 02:27:56.376694 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:27:56.376694 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:27:56.376694 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:27:56.376694 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:27:56.376694 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:27:56.376694 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:27:56.376694 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 7225ec592cee45a9842e24c94626072c Oct 05 02:27:56.376694 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-852576076 Oct 05 02:27:56.376694 n-d-858272-3 devstack@n-api.service[122320]: X-Role: admin,member,reader Oct 05 02:27:56.376694 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: admin,member,reader Oct 05 02:27:56.379172 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7225ec592cee45a9842e24c94626072c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7225ec592cee45a9842e24c94626072c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7225ec592cee45a9842e24c94626072c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7225ec592cee45a9842e24c94626072c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:27:56.379172 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-852576076 Oct 05 02:27:56.379172 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 7225ec592cee45a9842e24c94626072c Oct 05 02:27:56.379172 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-852576076 Oct 05 02:27:56.379172 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin Oct 05 02:27:56.379172 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:27:56.379172 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:27:56.379172 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: fcb4fff49dcf46dc953f2cff8f2f25f0 Oct 05 02:27:56.379172 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin Oct 05 02:27:56.379172 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:27:56.379172 n-d-858272-3 devstack@n-api.service[122320]: {"removeTenantAccess": {"tenant": "3eb0d0a55478414c83dd8345b60903aa"}} Oct 05 02:27:56.379172 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:27:56.379826 n-d-858272-3 devstack@n-api.service[122320]: exception: Flavor access not found for 35 / 3eb0d0a55478414c83dd8345b60903aa combination. Oct 05 02:27:56.379826 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '938715597', 'body': {'removeTenantAccess': {'tenant': '3eb0d0a55478414c83dd8345b60903aa'}}} Oct 05 02:27:56.379826 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:27:56.379826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:56.379826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 05 02:27:56.379826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 05 02:27:56.379826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 05 02:27:56.379826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 05 02:27:56.379826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 05 02:27:56.379826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 05 02:27:56.379826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 05 02:27:56.379826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 05 02:27:56.379826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 05 02:27:56.379826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 05 02:27:56.379826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 02:27:56.379826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 02:27:56.379826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 05 02:27:56.379826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 05 02:27:56.380820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 35 / 3eb0d0a55478414c83dd8345b60903aa combination. Oct 05 02:27:56.380820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:56.380820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:56.380820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:56.380820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:56.380820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:56.380820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:56.380820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:27:56.380820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:27:56.380820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:27:56.380820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:27:56.380820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:27:56.380820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:27:56.380820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 05 02:27:56.380820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:27:56.380820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 35 / 3eb0d0a55478414c83dd8345b60903aa combination. Oct 05 02:27:56.380820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:56.380820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:27:56.380820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:56.380820 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:27:56.382502 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:27:56.382502 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:27:56.382502 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:27:56.382502 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:27:56.382502 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 35 / 3eb0d0a55478414c83dd8345b60903aa combination. Oct 05 02:27:56.382502 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:27:56.388096 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ff90a359-e096-46fd-a4ef-dbda045fd867 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Returning 404 to user: Flavor access not found for 35 / 3eb0d0a55478414c83dd8345b60903aa combination. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:27:56.391095 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ff90a359-e096-46fd-a4ef-dbda045fd867 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/938715597/action" status: 404 len: 124 microversion: 2.1 time: 0.700095 Oct 05 02:27:56.392187 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 185/364] 10.222.0.16 () {60 vars in 1197 bytes} [Wed Oct 5 02:27:55 2022] POST /compute/v2.1/flavors/938715597/action => generated 124 bytes in 703 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:27:56.411511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d7e71079-cf89-4542-8c12-75b0cce6c421 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:56.453304 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d7e71079-cf89-4542-8c12-75b0cce6c421 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/938715597" status: 202 len: 0 microversion: 2.1 time: 0.054407 Oct 05 02:27:56.459263 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 186/365] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 5 02:27:56 2022] DELETE /compute/v2.1/flavors/938715597 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:27:56.470182 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f5d4297a-6856-421b-bc9e-122533160317 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:56.526830 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f5d4297a-6856-421b-bc9e-122533160317 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.066126 Oct 05 02:27:56.549222 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 187/366] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:27:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:56.649156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-65bf7bd7-1517-48ef-908a-66ce41a57276 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:56.653054 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:56.678003 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-65bf7bd7-1517-48ef-908a-66ce41a57276 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197" status: 200 len: 1456 microversion: 2.1 time: 0.481178 Oct 05 02:27:56.693666 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 180/367] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:56 2022] GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197 => generated 1456 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:27:56.978313 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-75156b0e-318c-455f-b564-3beec71c0db7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:56.979070 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-75156b0e-318c-455f-b564-3beec71c0db7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:56.997756 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75156b0e-318c-455f-b564-3beec71c0db7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:56.999805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75156b0e-318c-455f-b564-3beec71c0db7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:57.001745 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75156b0e-318c-455f-b564-3beec71c0db7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:57.004457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75156b0e-318c-455f-b564-3beec71c0db7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:57.006219 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75156b0e-318c-455f-b564-3beec71c0db7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:57.006948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75156b0e-318c-455f-b564-3beec71c0db7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:57.668638 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-75156b0e-318c-455f-b564-3beec71c0db7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:57.683972 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-75156b0e-318c-455f-b564-3beec71c0db7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:57.687030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-75156b0e-318c-455f-b564-3beec71c0db7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:57.688586 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-75156b0e-318c-455f-b564-3beec71c0db7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 200 len: 1361 microversion: 2.25 time: 0.719985 Oct 05 02:27:57.702658 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 188/368] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:27:56 2022] GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 1361 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:27:57.715158 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a53e0f7d-e698-45d1-a3c9-df02b52184a1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:57.716965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a53e0f7d-e698-45d1-a3c9-df02b52184a1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: 1a0dac23-a7fb-40cf-b2bc-849859ea8197] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:57.727986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a53e0f7d-e698-45d1-a3c9-df02b52184a1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:57.733897 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a53e0f7d-e698-45d1-a3c9-df02b52184a1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:57.734734 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a53e0f7d-e698-45d1-a3c9-df02b52184a1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:57.735865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a53e0f7d-e698-45d1-a3c9-df02b52184a1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:57.736469 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a53e0f7d-e698-45d1-a3c9-df02b52184a1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:57.737200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a53e0f7d-e698-45d1-a3c9-df02b52184a1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:57.806481 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a53e0f7d-e698-45d1-a3c9-df02b52184a1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:57.806900 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a53e0f7d-e698-45d1-a3c9-df02b52184a1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:57.807335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a53e0f7d-e698-45d1-a3c9-df02b52184a1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:57.807780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-a53e0f7d-e698-45d1-a3c9-df02b52184a1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lazy-loading 'fault' on Instance uuid 1a0dac23-a7fb-40cf-b2bc-849859ea8197 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:27:58.110654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a53e0f7d-e698-45d1-a3c9-df02b52184a1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:58.133409 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a53e0f7d-e698-45d1-a3c9-df02b52184a1 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197" status: 200 len: 1414 microversion: 2.1 time: 0.423270 Oct 05 02:27:58.152539 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 181/369] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:57 2022] GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197 => generated 1414 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:27:58.163840 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-8ca19f2a-23c0-46a7-b6b3-e4009cacaa9e req-db08a06a-0631-4ccd-8096-c16ad2023c51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a0dac23-a7fb-40cf-b2bc-849859ea8197", "name": "network-vif-deleted", "tag": "11730f85-c18f-4aec-94a4-7d16b357eacb"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:27:58.184826 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-8ca19f2a-23c0-46a7-b6b3-e4009cacaa9e req-db08a06a-0631-4ccd-8096-c16ad2023c51 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:58.185334 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-8ca19f2a-23c0-46a7-b6b3-e4009cacaa9e req-db08a06a-0631-4ccd-8096-c16ad2023c51 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:58.185764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-8ca19f2a-23c0-46a7-b6b3-e4009cacaa9e req-db08a06a-0631-4ccd-8096-c16ad2023c51 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:58.212060 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-8ca19f2a-23c0-46a7-b6b3-e4009cacaa9e req-db08a06a-0631-4ccd-8096-c16ad2023c51 service nova] Creating event network-vif-deleted:11730f85-c18f-4aec-94a4-7d16b357eacb for instance 1a0dac23-a7fb-40cf-b2bc-849859ea8197 on n-h2-858272-3 Oct 05 02:27:58.218497 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-8ca19f2a-23c0-46a7-b6b3-e4009cacaa9e req-db08a06a-0631-4ccd-8096-c16ad2023c51 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064620 Oct 05 02:27:58.219814 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 182/370] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:58.248855 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0a3e0b9e-ca43-4499-8533-eaafa770fcb4 tempest-InstanceUsageAuditLogTestJSON-82174656 tempest-InstanceUsageAuditLogTestJSON-82174656-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:58.272170 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0a3e0b9e-ca43-4499-8533-eaafa770fcb4 tempest-InstanceUsageAuditLogTestJSON-82174656 tempest-InstanceUsageAuditLogTestJSON-82174656-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-05 02:27:57" status: 200 len: 318 microversion: 2.1 time: 0.559811 Oct 05 02:27:58.282183 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 189/371] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 5 02:27:57 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-05%2002%3A27%3A57 => generated 318 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:27:58.294331 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2a8031cc-1ef9-4b06-98a4-70a4e098630c tempest-InstanceUsageAuditLogTestJSON-82174656 tempest-InstanceUsageAuditLogTestJSON-82174656-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:58.342020 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2a8031cc-1ef9-4b06-98a4-70a4e098630c tempest-InstanceUsageAuditLogTestJSON-82174656 tempest-InstanceUsageAuditLogTestJSON-82174656-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.059321 Oct 05 02:27:58.342604 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 183/372] 10.222.0.16 () {58 vars in 1185 bytes} [Wed Oct 5 02:27:58 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:27:58.718129 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-131bce3c-9fb2-4a08-9175-ff52fd9d6fcd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:58.719239 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-131bce3c-9fb2-4a08-9175-ff52fd9d6fcd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:58.723109 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=12,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:58.749736 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-131bce3c-9fb2-4a08-9175-ff52fd9d6fcd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:58.753855 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-131bce3c-9fb2-4a08-9175-ff52fd9d6fcd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:58.754591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-131bce3c-9fb2-4a08-9175-ff52fd9d6fcd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:58.755511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-131bce3c-9fb2-4a08-9175-ff52fd9d6fcd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:58.756144 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-131bce3c-9fb2-4a08-9175-ff52fd9d6fcd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:58.756574 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-131bce3c-9fb2-4a08-9175-ff52fd9d6fcd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:59.058470 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-131bce3c-9fb2-4a08-9175-ff52fd9d6fcd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:59.067529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-131bce3c-9fb2-4a08-9175-ff52fd9d6fcd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:59.068873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-131bce3c-9fb2-4a08-9175-ff52fd9d6fcd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:59.070036 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-131bce3c-9fb2-4a08-9175-ff52fd9d6fcd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 200 len: 1361 microversion: 2.25 time: 0.356965 Oct 05 02:27:59.077542 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 190/373] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:27:58 2022] GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 1361 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:27:59.162173 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ca0a6b8f-efc3-4423-b119-2a82597bd691 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:27:59.163709 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ca0a6b8f-efc3-4423-b119-2a82597bd691 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: 1a0dac23-a7fb-40cf-b2bc-849859ea8197] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:27:59.176712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca0a6b8f-efc3-4423-b119-2a82597bd691 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:59.177518 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca0a6b8f-efc3-4423-b119-2a82597bd691 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:59.178043 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca0a6b8f-efc3-4423-b119-2a82597bd691 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:59.179201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca0a6b8f-efc3-4423-b119-2a82597bd691 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:59.179917 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca0a6b8f-efc3-4423-b119-2a82597bd691 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:59.180606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca0a6b8f-efc3-4423-b119-2a82597bd691 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:59.283128 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca0a6b8f-efc3-4423-b119-2a82597bd691 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:27:59.283880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca0a6b8f-efc3-4423-b119-2a82597bd691 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:27:59.296250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca0a6b8f-efc3-4423-b119-2a82597bd691 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:27:59.303553 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-ca0a6b8f-efc3-4423-b119-2a82597bd691 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lazy-loading 'fault' on Instance uuid 1a0dac23-a7fb-40cf-b2bc-849859ea8197 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:27:59.451236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ca0a6b8f-efc3-4423-b119-2a82597bd691 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65581361534943b2cda9381e3f7a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a161064bfc4b608dabcd8fd2b26037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:27:59.466115 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ca0a6b8f-efc3-4423-b119-2a82597bd691 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197" status: 200 len: 1307 microversion: 2.1 time: 0.305409 Oct 05 02:27:59.467175 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 184/374] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:27:59 2022] GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197 => generated 1307 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:00.095224 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c29644f7-a853-4fc6-a384-9ec6c4ba78b7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:00.095762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c29644f7-a853-4fc6-a384-9ec6c4ba78b7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:00.106249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c29644f7-a853-4fc6-a384-9ec6c4ba78b7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:00.106747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c29644f7-a853-4fc6-a384-9ec6c4ba78b7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:00.107185 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c29644f7-a853-4fc6-a384-9ec6c4ba78b7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:00.107884 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c29644f7-a853-4fc6-a384-9ec6c4ba78b7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:00.118297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c29644f7-a853-4fc6-a384-9ec6c4ba78b7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:00.118983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c29644f7-a853-4fc6-a384-9ec6c4ba78b7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:00.423234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c29644f7-a853-4fc6-a384-9ec6c4ba78b7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:00.435666 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c29644f7-a853-4fc6-a384-9ec6c4ba78b7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:00.437131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c29644f7-a853-4fc6-a384-9ec6c4ba78b7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:00.438290 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c29644f7-a853-4fc6-a384-9ec6c4ba78b7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 200 len: 1557 microversion: 2.25 time: 0.346959 Oct 05 02:28:00.440331 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 191/375] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:28:00 2022] GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 1557 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:28:00.475316 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7c08d4f5-c80e-47c4-b5a7-e9359038b5f3 tempest-QuotaClassesAdminTestJSON-714050034 tempest-QuotaClassesAdminTestJSON-714050034-project-admin] Calling method '.version_select at 0x7fcce4890f70>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:00.517697 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7c08d4f5-c80e-47c4-b5a7-e9359038b5f3 tempest-QuotaClassesAdminTestJSON-714050034 tempest-QuotaClassesAdminTestJSON-714050034-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.402795 Oct 05 02:28:00.519662 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 185/376] 10.222.0.16 () {58 vars in 1185 bytes} [Wed Oct 5 02:28:00 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:28:00.535442 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7bffa159-e2bc-406d-baba-1f679d7daa09 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:00.536315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7bffa159-e2bc-406d-baba-1f679d7daa09 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: 1a0dac23-a7fb-40cf-b2bc-849859ea8197] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:00.543873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7bffa159-e2bc-406d-baba-1f679d7daa09 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:00.544849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7bffa159-e2bc-406d-baba-1f679d7daa09 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:00.545727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7bffa159-e2bc-406d-baba-1f679d7daa09 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:00.546587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7bffa159-e2bc-406d-baba-1f679d7daa09 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:00.548683 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7bffa159-e2bc-406d-baba-1f679d7daa09 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:00.549425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7bffa159-e2bc-406d-baba-1f679d7daa09 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:00.566107 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-7bffa159-e2bc-406d-baba-1f679d7daa09 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] HTTP exception thrown: Instance 1a0dac23-a7fb-40cf-b2bc-849859ea8197 could not be found. Oct 05 02:28:00.568565 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7bffa159-e2bc-406d-baba-1f679d7daa09 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Request method failure captured: Oct 05 02:28:00.568565 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197 HTTP/1.1 Oct 05 02:28:00.568565 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:28:00.568565 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:28:00.568565 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:28:00.568565 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:28:00.568565 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:28:00.568565 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:28:00.568565 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:28:00.568565 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:00.568565 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOtqPmvi9uTht4ekOO_xj3gCk7E-OyaERF8G5rMI7GtL1nAMiZWSUBCLDuZX6U0chPEX_c9j-23x28vsgD54o_OrpFiRo5Af34xUY_XRPU8OS8kFLwO0HbibuHgOxuCAlmGMb4CFGSjhqEQNQ5qM4BPfMv71aJZtRZ90onz4_CputqI Oct 05 02:28:00.568565 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:28:00.568565 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:28:00.568565 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:28:00.568565 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:28:00.568565 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:28:00.568565 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:28:00.568565 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: a0a161064bfc4b608dabcd8fd2b26037 Oct 05 02:28:00.568565 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1872816975 Oct 05 02:28:00.568565 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:28:00.568565 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:28:00.569974 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a0a161064bfc4b608dabcd8fd2b26037"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a0a161064bfc4b608dabcd8fd2b26037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a0a161064bfc4b608dabcd8fd2b26037"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a0a161064bfc4b608dabcd8fd2b26037"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:00.569974 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-DeleteServersAdminTestJSON-1872816975 Oct 05 02:28:00.569974 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: a0a161064bfc4b608dabcd8fd2b26037 Oct 05 02:28:00.569974 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1872816975 Oct 05 02:28:00.569974 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-DeleteServersAdminTestJSON-1872816975-project Oct 05 02:28:00.569974 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:28:00.569974 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:28:00.569974 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: fa65581361534943b2cda9381e3f7a8c Oct 05 02:28:00.569974 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-DeleteServersAdminTestJSON-1872816975-project Oct 05 02:28:00.569974 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:28:00.569974 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 1a0dac23-a7fb-40cf-b2bc-849859ea8197 could not be found. Oct 05 02:28:00.569974 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '1a0dac23-a7fb-40cf-b2bc-849859ea8197'} Oct 05 02:28:00.570765 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:00.570765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:00.570765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:28:00.570765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:28:00.570765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:28:00.570765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:28:00.570765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:28:00.570765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:28:00.570765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:28:00.570765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:28:00.570765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a0dac23-a7fb-40cf-b2bc-849859ea8197 could not be found. Oct 05 02:28:00.570765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:00.570765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:00.570765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:00.570765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:00.570765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:00.570765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:00.570765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:00.570765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:00.570765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:00.572148 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:00.572148 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:28:00.572148 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:28:00.572148 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:28:00.572148 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:28:00.572148 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:28:00.572148 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:28:00.572148 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a0dac23-a7fb-40cf-b2bc-849859ea8197 could not be found. Oct 05 02:28:00.572148 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:00.572148 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:00.572148 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:00.572148 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:00.572148 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:00.572148 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:00.572148 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:28:00.572148 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:28:00.572148 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a0dac23-a7fb-40cf-b2bc-849859ea8197 could not be found. Oct 05 02:28:00.572148 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:00.573539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7bffa159-e2bc-406d-baba-1f679d7daa09 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Returning 404 to user: Instance 1a0dac23-a7fb-40cf-b2bc-849859ea8197 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:00.574476 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7bffa159-e2bc-406d-baba-1f679d7daa09 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197" status: 404 len: 111 microversion: 2.1 time: 0.053216 Oct 05 02:28:00.575150 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 186/377] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:00 2022] GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:28:00.587221 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-909b4dd4-adb6-4966-af1e-5e1d70dae497 tempest-QuotaClassesAdminTestJSON-714050034 tempest-QuotaClassesAdminTestJSON-714050034-project-admin] Action: 'update', calling method: .version_select at 0x7fcce45de790>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:00.921895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a04d5da9-f8df-4d8c-8b2e-dafdae458e30 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:00.923694 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a04d5da9-f8df-4d8c-8b2e-dafdae458e30 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:00.944382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a04d5da9-f8df-4d8c-8b2e-dafdae458e30 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:00.946959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a04d5da9-f8df-4d8c-8b2e-dafdae458e30 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:00.947663 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a04d5da9-f8df-4d8c-8b2e-dafdae458e30 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:00.948401 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a04d5da9-f8df-4d8c-8b2e-dafdae458e30 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:00.948864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a04d5da9-f8df-4d8c-8b2e-dafdae458e30 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:00.950843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a04d5da9-f8df-4d8c-8b2e-dafdae458e30 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:01.104318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=12,nova_api:DELETE=3,nova_api:INSERT=10 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:01.174873 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-909b4dd4-adb6-4966-af1e-5e1d70dae497 tempest-QuotaClassesAdminTestJSON-714050034 tempest-QuotaClassesAdminTestJSON-714050034-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.591661 Oct 05 02:28:01.176239 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 187/378] 10.222.0.16 () {60 vars in 1206 bytes} [Wed Oct 5 02:28:00 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:01.181705 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-410b2c22-ddc5-4cca-a345-da6fa953fcd3 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:01.182858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-410b2c22-ddc5-4cca-a345-da6fa953fcd3 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: 1a0dac23-a7fb-40cf-b2bc-849859ea8197] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:01.192084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-410b2c22-ddc5-4cca-a345-da6fa953fcd3 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:01.193050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-410b2c22-ddc5-4cca-a345-da6fa953fcd3 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:01.193731 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-410b2c22-ddc5-4cca-a345-da6fa953fcd3 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:01.194550 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-410b2c22-ddc5-4cca-a345-da6fa953fcd3 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:01.195444 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-410b2c22-ddc5-4cca-a345-da6fa953fcd3 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:01.195592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-410b2c22-ddc5-4cca-a345-da6fa953fcd3 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:01.219013 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-410b2c22-ddc5-4cca-a345-da6fa953fcd3 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] HTTP exception thrown: Instance 1a0dac23-a7fb-40cf-b2bc-849859ea8197 could not be found. Oct 05 02:28:01.223307 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-410b2c22-ddc5-4cca-a345-da6fa953fcd3 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Request method failure captured: Oct 05 02:28:01.223307 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197 HTTP/1.1 Oct 05 02:28:01.223307 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:28:01.223307 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:28:01.223307 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:28:01.223307 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:28:01.223307 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:28:01.223307 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:28:01.223307 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:28:01.223307 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:01.223307 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOtqPmvi9uTht4ekOO_xj3gCk7E-OyaERF8G5rMI7GtL1nAMiZWSUBCLDuZX6U0chPEX_c9j-23x28vsgD54o_OrpFiRo5Af34xUY_XRPU8OS8kFLwO0HbibuHgOxuCAlmGMb4CFGSjhqEQNQ5qM4BPfMv71aJZtRZ90onz4_CputqI Oct 05 02:28:01.223307 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:28:01.223307 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:28:01.223307 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:28:01.223307 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:28:01.223307 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:28:01.223307 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:28:01.223307 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: a0a161064bfc4b608dabcd8fd2b26037 Oct 05 02:28:01.223307 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1872816975 Oct 05 02:28:01.223307 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:28:01.223307 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:28:01.224837 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a0a161064bfc4b608dabcd8fd2b26037"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a0a161064bfc4b608dabcd8fd2b26037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a0a161064bfc4b608dabcd8fd2b26037"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a0a161064bfc4b608dabcd8fd2b26037"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:01.224837 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-DeleteServersAdminTestJSON-1872816975 Oct 05 02:28:01.224837 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: a0a161064bfc4b608dabcd8fd2b26037 Oct 05 02:28:01.224837 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1872816975 Oct 05 02:28:01.224837 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-DeleteServersAdminTestJSON-1872816975-project Oct 05 02:28:01.224837 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:28:01.224837 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:28:01.224837 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: fa65581361534943b2cda9381e3f7a8c Oct 05 02:28:01.224837 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-DeleteServersAdminTestJSON-1872816975-project Oct 05 02:28:01.224837 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:28:01.224837 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 1a0dac23-a7fb-40cf-b2bc-849859ea8197 could not be found. Oct 05 02:28:01.224837 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '1a0dac23-a7fb-40cf-b2bc-849859ea8197'} Oct 05 02:28:01.225844 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:01.225844 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:01.225844 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:28:01.225844 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:28:01.225844 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:28:01.225844 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:28:01.225844 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:28:01.225844 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:28:01.225844 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:28:01.225844 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:28:01.225844 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a0dac23-a7fb-40cf-b2bc-849859ea8197 could not be found. Oct 05 02:28:01.225844 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:01.225844 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:01.225844 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:01.225844 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:01.225844 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:01.225844 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:01.225844 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:01.225844 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:01.225844 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:01.228341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:01.228341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:28:01.228341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:28:01.228341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:28:01.228341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:28:01.228341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:28:01.228341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:28:01.228341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:28:01.228341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:28:01.228341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a0dac23-a7fb-40cf-b2bc-849859ea8197 could not be found. Oct 05 02:28:01.228341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:01.228341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:01.228341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:01.228341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:01.228341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:01.228341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:01.228341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:28:01.228341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:28:01.228341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a0dac23-a7fb-40cf-b2bc-849859ea8197 could not be found. Oct 05 02:28:01.228341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:01.229813 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-410b2c22-ddc5-4cca-a345-da6fa953fcd3 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Returning 404 to user: Instance 1a0dac23-a7fb-40cf-b2bc-849859ea8197 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:01.229813 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-410b2c22-ddc5-4cca-a345-da6fa953fcd3 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197" status: 404 len: 111 microversion: 2.1 time: 0.049800 Oct 05 02:28:01.231920 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 188/379] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:28:01 2022] DELETE /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:28:01.245162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bfe3e7d1-e11b-4c30-8717-8b5703d75526 tempest-QuotaClassesAdminTestJSON-714050034 tempest-QuotaClassesAdminTestJSON-714050034-project-admin] Calling method '.version_select at 0x7fcce45fb940>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:01.275780 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bfe3e7d1-e11b-4c30-8717-8b5703d75526 tempest-QuotaClassesAdminTestJSON-714050034 tempest-QuotaClassesAdminTestJSON-714050034-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.041545 Oct 05 02:28:01.276379 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 189/380] 10.222.0.16 () {58 vars in 1185 bytes} [Wed Oct 5 02:28:01 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:01.281611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-442e26e9-55df-4a31-840f-ea74ad997a06 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:01.282214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-442e26e9-55df-4a31-840f-ea74ad997a06 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: 1a0dac23-a7fb-40cf-b2bc-849859ea8197] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:01.300989 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-442e26e9-55df-4a31-840f-ea74ad997a06 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:01.301498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-442e26e9-55df-4a31-840f-ea74ad997a06 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:01.305985 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-442e26e9-55df-4a31-840f-ea74ad997a06 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:01.306825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-442e26e9-55df-4a31-840f-ea74ad997a06 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:01.307315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-442e26e9-55df-4a31-840f-ea74ad997a06 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:01.307756 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-442e26e9-55df-4a31-840f-ea74ad997a06 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:01.356295 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-442e26e9-55df-4a31-840f-ea74ad997a06 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] HTTP exception thrown: Instance 1a0dac23-a7fb-40cf-b2bc-849859ea8197 could not be found. Oct 05 02:28:01.360400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-442e26e9-55df-4a31-840f-ea74ad997a06 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Request method failure captured: Oct 05 02:28:01.360400 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197 HTTP/1.1 Oct 05 02:28:01.360400 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:28:01.360400 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:28:01.360400 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:28:01.360400 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:28:01.360400 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:28:01.360400 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:28:01.360400 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:28:01.360400 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:01.360400 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOtqPmvi9uTht4ekOO_xj3gCk7E-OyaERF8G5rMI7GtL1nAMiZWSUBCLDuZX6U0chPEX_c9j-23x28vsgD54o_OrpFiRo5Af34xUY_XRPU8OS8kFLwO0HbibuHgOxuCAlmGMb4CFGSjhqEQNQ5qM4BPfMv71aJZtRZ90onz4_CputqI Oct 05 02:28:01.360400 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:28:01.360400 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:28:01.360400 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:28:01.360400 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:28:01.360400 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:28:01.360400 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:28:01.360400 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: a0a161064bfc4b608dabcd8fd2b26037 Oct 05 02:28:01.360400 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1872816975 Oct 05 02:28:01.360400 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:28:01.360400 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:28:01.361865 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a0a161064bfc4b608dabcd8fd2b26037"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a0a161064bfc4b608dabcd8fd2b26037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a0a161064bfc4b608dabcd8fd2b26037"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a0a161064bfc4b608dabcd8fd2b26037"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:01.361865 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-DeleteServersAdminTestJSON-1872816975 Oct 05 02:28:01.361865 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: a0a161064bfc4b608dabcd8fd2b26037 Oct 05 02:28:01.361865 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1872816975 Oct 05 02:28:01.361865 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-DeleteServersAdminTestJSON-1872816975-project Oct 05 02:28:01.361865 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:28:01.361865 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:28:01.361865 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: fa65581361534943b2cda9381e3f7a8c Oct 05 02:28:01.361865 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-DeleteServersAdminTestJSON-1872816975-project Oct 05 02:28:01.361865 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:28:01.361865 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 1a0dac23-a7fb-40cf-b2bc-849859ea8197 could not be found. Oct 05 02:28:01.361865 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '1a0dac23-a7fb-40cf-b2bc-849859ea8197'} Oct 05 02:28:01.363345 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:01.363345 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:01.363345 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:28:01.363345 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:28:01.363345 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:28:01.363345 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:28:01.363345 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:28:01.363345 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:28:01.363345 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:28:01.363345 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:28:01.363345 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a0dac23-a7fb-40cf-b2bc-849859ea8197 could not be found. Oct 05 02:28:01.363345 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:01.363345 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:01.363345 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:01.363345 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:01.363345 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:01.363345 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:01.363345 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:01.363345 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:01.363345 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:01.365837 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:01.365837 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:28:01.365837 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:28:01.365837 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:28:01.365837 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:28:01.365837 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:28:01.365837 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:28:01.365837 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a0dac23-a7fb-40cf-b2bc-849859ea8197 could not be found. Oct 05 02:28:01.365837 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:01.365837 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:01.365837 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:01.365837 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:01.365837 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:01.365837 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:01.365837 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:28:01.365837 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:28:01.365837 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a0dac23-a7fb-40cf-b2bc-849859ea8197 could not be found. Oct 05 02:28:01.365837 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:01.372050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-442e26e9-55df-4a31-840f-ea74ad997a06 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Returning 404 to user: Instance 1a0dac23-a7fb-40cf-b2bc-849859ea8197 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:01.372050 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-442e26e9-55df-4a31-840f-ea74ad997a06 tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197" status: 404 len: 111 microversion: 2.1 time: 0.083585 Oct 05 02:28:01.372050 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 190/381] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:01 2022] GET /compute/v2.1/servers/1a0dac23-a7fb-40cf-b2bc-849859ea8197 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:28:01.375726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-839f7479-00f3-4ee1-af3f-99ff70a5b4f9 tempest-QuotaClassesAdminTestJSON-714050034 tempest-QuotaClassesAdminTestJSON-714050034-project-admin] Action: 'update', calling method: .version_select at 0x7fcce45de160>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:01.552133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-a04d5da9-f8df-4d8c-8b2e-dafdae458e30 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lazy-loading 'services' on Instance uuid eddae3fc-f975-45e3-8592-01b10bcf32ad {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:28:01.613761 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-839f7479-00f3-4ee1-af3f-99ff70a5b4f9 tempest-QuotaClassesAdminTestJSON-714050034 tempest-QuotaClassesAdminTestJSON-714050034-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.240885 Oct 05 02:28:01.624798 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 191/382] 10.222.0.16 () {60 vars in 1206 bytes} [Wed Oct 5 02:28:01 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:01.643786 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dc1b9e02-a6b2-423d-948d-37a8a1ac9c8a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:01.646244 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-dc1b9e02-a6b2-423d-948d-37a8a1ac9c8a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: c9ea1283-2889-4a96-bee8-b2b99509ed59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:01.666761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc1b9e02-a6b2-423d-948d-37a8a1ac9c8a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:01.669828 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc1b9e02-a6b2-423d-948d-37a8a1ac9c8a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:01.670559 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc1b9e02-a6b2-423d-948d-37a8a1ac9c8a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:01.678045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc1b9e02-a6b2-423d-948d-37a8a1ac9c8a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:01.688615 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc1b9e02-a6b2-423d-948d-37a8a1ac9c8a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:01.691377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc1b9e02-a6b2-423d-948d-37a8a1ac9c8a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:01.710438 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a04d5da9-f8df-4d8c-8b2e-dafdae458e30 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 200 len: 2049 microversion: 2.25 time: 1.245577 Oct 05 02:28:01.711307 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 192/383] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:28:00 2022] GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 2049 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:28:01.738162 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-dc1b9e02-a6b2-423d-948d-37a8a1ac9c8a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] HTTP exception thrown: Instance c9ea1283-2889-4a96-bee8-b2b99509ed59 could not be found. Oct 05 02:28:01.740504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dc1b9e02-a6b2-423d-948d-37a8a1ac9c8a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Request method failure captured: Oct 05 02:28:01.740504 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59 HTTP/1.1 Oct 05 02:28:01.740504 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:28:01.740504 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:28:01.740504 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:28:01.740504 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:28:01.740504 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:28:01.740504 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:28:01.740504 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:28:01.740504 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:01.740504 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOtqPmvi9uTht4ekOO_xj3gCk7E-OyaERF8G5rMI7GtL1nAMiZWSUBCLDuZX6U0chPEX_c9j-23x28vsgD54o_OrpFiRo5Af34xUY_XRPU8OS8kFLwO0HbibuHgOxuCAlmGMb4CFGSjhqEQNQ5qM4BPfMv71aJZtRZ90onz4_CputqI Oct 05 02:28:01.740504 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:28:01.740504 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:28:01.740504 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:28:01.740504 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:28:01.740504 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:28:01.740504 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:28:01.740504 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: a0a161064bfc4b608dabcd8fd2b26037 Oct 05 02:28:01.740504 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1872816975 Oct 05 02:28:01.740504 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:28:01.740504 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:28:01.741969 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a0a161064bfc4b608dabcd8fd2b26037"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a0a161064bfc4b608dabcd8fd2b26037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a0a161064bfc4b608dabcd8fd2b26037"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a0a161064bfc4b608dabcd8fd2b26037"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:01.741969 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-DeleteServersAdminTestJSON-1872816975 Oct 05 02:28:01.741969 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: a0a161064bfc4b608dabcd8fd2b26037 Oct 05 02:28:01.741969 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1872816975 Oct 05 02:28:01.741969 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-DeleteServersAdminTestJSON-1872816975-project Oct 05 02:28:01.741969 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:28:01.741969 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:28:01.741969 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: fa65581361534943b2cda9381e3f7a8c Oct 05 02:28:01.741969 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-DeleteServersAdminTestJSON-1872816975-project Oct 05 02:28:01.741969 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:28:01.741969 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance c9ea1283-2889-4a96-bee8-b2b99509ed59 could not be found. Oct 05 02:28:01.741969 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'c9ea1283-2889-4a96-bee8-b2b99509ed59'} Oct 05 02:28:01.742765 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:01.742765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:01.742765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:28:01.742765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:28:01.742765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:28:01.742765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:28:01.742765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:28:01.742765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:28:01.742765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:28:01.742765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:28:01.742765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9ea1283-2889-4a96-bee8-b2b99509ed59 could not be found. Oct 05 02:28:01.742765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:01.742765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:01.742765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:01.742765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:01.742765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:01.742765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:01.742765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:01.742765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:01.742765 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:01.744221 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:01.744221 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:28:01.744221 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:28:01.744221 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:28:01.744221 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:28:01.744221 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:28:01.744221 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:28:01.744221 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:28:01.744221 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:28:01.744221 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9ea1283-2889-4a96-bee8-b2b99509ed59 could not be found. Oct 05 02:28:01.744221 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:01.744221 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:01.744221 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:01.744221 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:01.744221 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:01.744221 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:01.744221 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:28:01.744221 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:28:01.744221 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9ea1283-2889-4a96-bee8-b2b99509ed59 could not be found. Oct 05 02:28:01.744221 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:01.745626 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-af0c5895-e979-4904-a705-a059b39cdd25 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:01.745626 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-af0c5895-e979-4904-a705-a059b39cdd25 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:01.747090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dc1b9e02-a6b2-423d-948d-37a8a1ac9c8a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Returning 404 to user: Instance c9ea1283-2889-4a96-bee8-b2b99509ed59 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:01.748969 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-dc1b9e02-a6b2-423d-948d-37a8a1ac9c8a tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59" status: 404 len: 111 microversion: 2.1 time: 0.120154 Oct 05 02:28:01.750135 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 192/384] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:28:01 2022] DELETE /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:28:01.752626 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af0c5895-e979-4904-a705-a059b39cdd25 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:01.753316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af0c5895-e979-4904-a705-a059b39cdd25 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:01.753869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af0c5895-e979-4904-a705-a059b39cdd25 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:01.754579 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af0c5895-e979-4904-a705-a059b39cdd25 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:01.755043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af0c5895-e979-4904-a705-a059b39cdd25 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:01.755459 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af0c5895-e979-4904-a705-a059b39cdd25 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:01.770980 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-34c3c2d3-f45d-4952-b60b-c7f33651f88b tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:01.771694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-34c3c2d3-f45d-4952-b60b-c7f33651f88b tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] [instance: c9ea1283-2889-4a96-bee8-b2b99509ed59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:01.792232 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-34c3c2d3-f45d-4952-b60b-c7f33651f88b tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:01.792744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-34c3c2d3-f45d-4952-b60b-c7f33651f88b tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:01.793211 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-34c3c2d3-f45d-4952-b60b-c7f33651f88b tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:01.795551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-34c3c2d3-f45d-4952-b60b-c7f33651f88b tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:01.796021 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-34c3c2d3-f45d-4952-b60b-c7f33651f88b tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:01.796451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-34c3c2d3-f45d-4952-b60b-c7f33651f88b tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:01.842513 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-34c3c2d3-f45d-4952-b60b-c7f33651f88b tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] HTTP exception thrown: Instance c9ea1283-2889-4a96-bee8-b2b99509ed59 could not be found. Oct 05 02:28:01.847771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-34c3c2d3-f45d-4952-b60b-c7f33651f88b tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Request method failure captured: Oct 05 02:28:01.847771 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59 HTTP/1.1 Oct 05 02:28:01.847771 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:28:01.847771 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:28:01.847771 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:28:01.847771 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:28:01.847771 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:28:01.847771 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:28:01.847771 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:28:01.847771 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:01.847771 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOtqPmvi9uTht4ekOO_xj3gCk7E-OyaERF8G5rMI7GtL1nAMiZWSUBCLDuZX6U0chPEX_c9j-23x28vsgD54o_OrpFiRo5Af34xUY_XRPU8OS8kFLwO0HbibuHgOxuCAlmGMb4CFGSjhqEQNQ5qM4BPfMv71aJZtRZ90onz4_CputqI Oct 05 02:28:01.847771 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:28:01.847771 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:28:01.847771 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:28:01.847771 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:28:01.847771 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:28:01.847771 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:28:01.847771 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: a0a161064bfc4b608dabcd8fd2b26037 Oct 05 02:28:01.847771 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1872816975 Oct 05 02:28:01.847771 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:28:01.847771 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:28:01.849169 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a0a161064bfc4b608dabcd8fd2b26037"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a0a161064bfc4b608dabcd8fd2b26037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a0a161064bfc4b608dabcd8fd2b26037"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a0a161064bfc4b608dabcd8fd2b26037"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:01.849169 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-DeleteServersAdminTestJSON-1872816975 Oct 05 02:28:01.849169 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: a0a161064bfc4b608dabcd8fd2b26037 Oct 05 02:28:01.849169 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1872816975 Oct 05 02:28:01.849169 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-DeleteServersAdminTestJSON-1872816975-project Oct 05 02:28:01.849169 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:28:01.849169 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:28:01.849169 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: fa65581361534943b2cda9381e3f7a8c Oct 05 02:28:01.849169 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-DeleteServersAdminTestJSON-1872816975-project Oct 05 02:28:01.849169 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:28:01.849169 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance c9ea1283-2889-4a96-bee8-b2b99509ed59 could not be found. Oct 05 02:28:01.849169 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'c9ea1283-2889-4a96-bee8-b2b99509ed59'} Oct 05 02:28:01.849855 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:01.849855 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:01.849855 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:28:01.849855 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:28:01.849855 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:28:01.849855 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:28:01.849855 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:28:01.849855 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:28:01.849855 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:28:01.849855 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:28:01.849855 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9ea1283-2889-4a96-bee8-b2b99509ed59 could not be found. Oct 05 02:28:01.849855 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:01.849855 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:01.849855 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:01.849855 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:01.849855 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:01.849855 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:01.849855 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:01.849855 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:01.849855 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:01.851255 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:01.851255 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:28:01.851255 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:28:01.851255 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:28:01.851255 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:28:01.851255 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:28:01.851255 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:28:01.851255 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9ea1283-2889-4a96-bee8-b2b99509ed59 could not be found. Oct 05 02:28:01.851255 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:01.851255 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:01.851255 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:01.851255 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:01.851255 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:01.851255 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:01.851255 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:28:01.851255 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:28:01.851255 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9ea1283-2889-4a96-bee8-b2b99509ed59 could not be found. Oct 05 02:28:01.851255 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:01.854227 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-34c3c2d3-f45d-4952-b60b-c7f33651f88b tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] Returning 404 to user: Instance c9ea1283-2889-4a96-bee8-b2b99509ed59 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:01.858060 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-34c3c2d3-f45d-4952-b60b-c7f33651f88b tempest-DeleteServersAdminTestJSON-1872816975 tempest-DeleteServersAdminTestJSON-1872816975-project] 10.222.0.16 "GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59" status: 404 len: 111 microversion: 2.1 time: 0.103323 Oct 05 02:28:01.859107 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 193/385] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:01 2022] GET /compute/v2.1/servers/c9ea1283-2889-4a96-bee8-b2b99509ed59 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:28:02.118973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-af0c5895-e979-4904-a705-a059b39cdd25 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lazy-loading 'services' on Instance uuid eddae3fc-f975-45e3-8592-01b10bcf32ad {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:28:02.146121 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-af0c5895-e979-4904-a705-a059b39cdd25 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 200 len: 2049 microversion: 2.25 time: 0.410330 Oct 05 02:28:02.163325 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 193/386] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:28:01 2022] GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 2049 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:28:02.186183 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f014e39f-9c00-4250-bf9e-23070aa864e5 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:02.195453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f014e39f-9c00-4250-bf9e-23070aa864e5 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:02.196239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f014e39f-9c00-4250-bf9e-23070aa864e5 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:02.197383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f014e39f-9c00-4250-bf9e-23070aa864e5 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:02.198989 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f014e39f-9c00-4250-bf9e-23070aa864e5 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:02.199675 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f014e39f-9c00-4250-bf9e-23070aa864e5 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:02.200166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f014e39f-9c00-4250-bf9e-23070aa864e5 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:02.239448 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f014e39f-9c00-4250-bf9e-23070aa864e5 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.067314 Oct 05 02:28:02.249867 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 194/387] 10.222.0.16 () {60 vars in 1217 bytes} [Wed Oct 5 02:28:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:28:02.258065 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fff250d4-bb5b-40e0-afd0-b31c9955dc8c tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858272-3", "block_migration": "auto"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:02.261285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fff250d4-bb5b-40e0-afd0-b31c9955dc8c tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:02.275879 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fff250d4-bb5b-40e0-afd0-b31c9955dc8c tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:02.276551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fff250d4-bb5b-40e0-afd0-b31c9955dc8c tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:02.277115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fff250d4-bb5b-40e0-afd0-b31c9955dc8c tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:02.278031 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fff250d4-bb5b-40e0-afd0-b31c9955dc8c tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:02.278571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fff250d4-bb5b-40e0-afd0-b31c9955dc8c tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:02.285357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fff250d4-bb5b-40e0-afd0-b31c9955dc8c tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:03.477821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-fff250d4-bb5b-40e0-afd0-b31c9955dc8c tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lazy-loading 'flavor' on Instance uuid eddae3fc-f975-45e3-8592-01b10bcf32ad {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:28:03.573177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fff250d4-bb5b-40e0-afd0-b31c9955dc8c tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Going to try to live migrate instance to n-h1-858272-3 {{(pid=122320) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 05 02:28:04.943805 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2fff00ac-cee1-4410-ad82-f5fbb35f9aa9 tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] Calling method '.version_select at 0x7fcce45ffb80>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:04.949486 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fff00ac-cee1-4410-ad82-f5fbb35f9aa9 tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:04.950269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fff00ac-cee1-4410-ad82-f5fbb35f9aa9 tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:04.952021 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fff00ac-cee1-4410-ad82-f5fbb35f9aa9 tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:04.955381 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fff00ac-cee1-4410-ad82-f5fbb35f9aa9 tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:04.956466 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fff00ac-cee1-4410-ad82-f5fbb35f9aa9 tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:04.957324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fff00ac-cee1-4410-ad82-f5fbb35f9aa9 tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:05.038436 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2fff00ac-cee1-4410-ad82-f5fbb35f9aa9 tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.750292 Oct 05 02:28:05.039082 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 195/388] 10.222.0.16 () {58 vars in 1128 bytes} [Wed Oct 5 02:28:04 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:06.145119 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8ea76e90-9305-439a-81ba-0cf4c1f19172 tempest-HostsAdminNegativeTestJSON-1314724707 tempest-HostsAdminNegativeTestJSON-1314724707-project] Calling method '.version_select at 0x7fcce462b550>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:06.150817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8ea76e90-9305-439a-81ba-0cf4c1f19172 tempest-HostsAdminNegativeTestJSON-1314724707 tempest-HostsAdminNegativeTestJSON-1314724707-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '6b8dbdec9e87496b868d58ca08515bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966924b122294514bc98da18682e7c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:06.154272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8ea76e90-9305-439a-81ba-0cf4c1f19172 tempest-HostsAdminNegativeTestJSON-1314724707 tempest-HostsAdminNegativeTestJSON-1314724707-project] Request method failure captured: Oct 05 02:28:06.154272 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 05 02:28:06.154272 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:28:06.154272 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:28:06.154272 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:28:06.154272 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:28:06.154272 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:28:06.154272 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:28:06.154272 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:28:06.154272 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:06.154272 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOuxnGKf2bNCi256qbz1HQXfQnDyg0Gu88FzehT7_fV-LGUslsSIrhaDh1tE_AB98IIc79v1nHGVux_prZM638OYSfPUYsu_usuv71CbLKb3C1jzWin6kWJdEQKq00MJBi_hJWoVD-QfwQjJOYR2e7FGR-OEyy55ZK1Atm4azusY23o Oct 05 02:28:06.154272 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:28:06.154272 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:28:06.154272 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:28:06.154272 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:28:06.154272 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:28:06.154272 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:28:06.154272 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 966924b122294514bc98da18682e7c54 Oct 05 02:28:06.154272 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1314724707 Oct 05 02:28:06.154272 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:28:06.154272 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:28:06.155547 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/966924b122294514bc98da18682e7c54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/966924b122294514bc98da18682e7c54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/966924b122294514bc98da18682e7c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_966924b122294514bc98da18682e7c54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:06.155547 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1314724707 Oct 05 02:28:06.155547 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 966924b122294514bc98da18682e7c54 Oct 05 02:28:06.155547 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1314724707 Oct 05 02:28:06.155547 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-HostsAdminNegativeTestJSON-1314724707-project Oct 05 02:28:06.155547 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:28:06.155547 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:28:06.155547 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 6b8dbdec9e87496b868d58ca08515bc6 Oct 05 02:28:06.155547 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1314724707-project Oct 05 02:28:06.155547 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:28:06.155547 n-d-858272-3 devstack@n-api.service[122319]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 05 02:28:06.155547 n-d-858272-3 devstack@n-api.service[122319]: action_args: {} Oct 05 02:28:06.155547 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:06.156281 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.156281 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:06.156281 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:06.156281 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:06.156281 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:06.156281 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:28:06.156281 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:28:06.156281 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 02:28:06.156281 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:28:06.156281 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:06.156281 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:06.156281 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 05 02:28:06.156281 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 05 02:28:06.156281 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 02:28:06.156281 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 02:28:06.156281 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 02:28:06.156281 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 02:28:06.156281 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:28:06.156281 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:28:06.157365 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:28:06.157365 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:28:06.157365 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 02:28:06.157365 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 02:28:06.157365 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 02:28:06.157365 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 02:28:06.157365 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:28:06.157365 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 02:28:06.157365 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 05 02:28:06.157365 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.157365 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:06.157365 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.157365 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.157365 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:06.157365 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:06.157365 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 02:28:06.157365 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 02:28:06.157365 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 05 02:28:06.157365 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.162687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8ea76e90-9305-439a-81ba-0cf4c1f19172 tempest-HostsAdminNegativeTestJSON-1314724707 tempest-HostsAdminNegativeTestJSON-1314724707-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:06.169648 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8ea76e90-9305-439a-81ba-0cf4c1f19172 tempest-HostsAdminNegativeTestJSON-1314724707 tempest-HostsAdminNegativeTestJSON-1314724707-project] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 1.118470 Oct 05 02:28:06.170955 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 196/389] 10.222.0.16 () {58 vars in 1128 bytes} [Wed Oct 5 02:28:05 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 1125 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:28:06.182346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-08976597-1938-40b8-a921-716eaebe5646 tempest-HostsAdminNegativeTestJSON-1314724707 tempest-HostsAdminNegativeTestJSON-1314724707-project] Calling method '.version_select at 0x7fcce46cef70>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:06.184820 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-08976597-1938-40b8-a921-716eaebe5646 tempest-HostsAdminNegativeTestJSON-1314724707 tempest-HostsAdminNegativeTestJSON-1314724707-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '6b8dbdec9e87496b868d58ca08515bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966924b122294514bc98da18682e7c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:06.194802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-08976597-1938-40b8-a921-716eaebe5646 tempest-HostsAdminNegativeTestJSON-1314724707 tempest-HostsAdminNegativeTestJSON-1314724707-project] Request method failure captured: Oct 05 02:28:06.194802 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/os-hosts/n-d-858272-3/reboot HTTP/1.1 Oct 05 02:28:06.194802 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:28:06.194802 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:28:06.194802 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:28:06.194802 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:28:06.194802 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:28:06.194802 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:28:06.194802 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:28:06.194802 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:06.194802 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOuxnGKf2bNCi256qbz1HQXfQnDyg0Gu88FzehT7_fV-LGUslsSIrhaDh1tE_AB98IIc79v1nHGVux_prZM638OYSfPUYsu_usuv71CbLKb3C1jzWin6kWJdEQKq00MJBi_hJWoVD-QfwQjJOYR2e7FGR-OEyy55ZK1Atm4azusY23o Oct 05 02:28:06.194802 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:28:06.194802 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:28:06.194802 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:28:06.194802 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:28:06.194802 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:28:06.194802 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:28:06.194802 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 966924b122294514bc98da18682e7c54 Oct 05 02:28:06.194802 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1314724707 Oct 05 02:28:06.194802 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:28:06.194802 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:28:06.196178 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/966924b122294514bc98da18682e7c54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/966924b122294514bc98da18682e7c54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/966924b122294514bc98da18682e7c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_966924b122294514bc98da18682e7c54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:06.196178 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1314724707 Oct 05 02:28:06.196178 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 966924b122294514bc98da18682e7c54 Oct 05 02:28:06.196178 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1314724707 Oct 05 02:28:06.196178 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-HostsAdminNegativeTestJSON-1314724707-project Oct 05 02:28:06.196178 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:28:06.196178 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:28:06.196178 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 6b8dbdec9e87496b868d58ca08515bc6 Oct 05 02:28:06.196178 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1314724707-project Oct 05 02:28:06.196178 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:28:06.196178 n-d-858272-3 devstack@n-api.service[122319]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 05 02:28:06.196178 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'n-d-858272-3'} Oct 05 02:28:06.196178 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:06.197697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.197697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:06.197697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:06.197697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:06.197697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:06.197697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:28:06.197697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:28:06.197697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:06.197697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:06.197697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 05 02:28:06.197697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 05 02:28:06.197697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 02:28:06.197697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 02:28:06.197697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 02:28:06.197697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 02:28:06.197697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:28:06.197697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:28:06.197697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:28:06.197697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:28:06.199010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 02:28:06.199010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 02:28:06.199010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 02:28:06.199010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 02:28:06.199010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:28:06.199010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 02:28:06.199010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 05 02:28:06.199010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.199010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:06.199010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.199010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.199010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:06.199010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:06.199010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 02:28:06.199010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 02:28:06.199010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 05 02:28:06.199010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.201532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-08976597-1938-40b8-a921-716eaebe5646 tempest-HostsAdminNegativeTestJSON-1314724707 tempest-HostsAdminNegativeTestJSON-1314724707-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:06.202814 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-08976597-1938-40b8-a921-716eaebe5646 tempest-HostsAdminNegativeTestJSON-1314724707 tempest-HostsAdminNegativeTestJSON-1314724707-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-858272-3/reboot" status: 403 len: 111 microversion: 2.1 time: 0.024268 Oct 05 02:28:06.203645 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 197/390] 10.222.0.16 () {58 vars in 1188 bytes} [Wed Oct 5 02:28:06 2022] GET /compute/v2.1/os-hosts/n-d-858272-3/reboot => generated 111 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:28:06.218596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2b1ce592-c196-441f-82e3-d4ea916e84d2 tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] Calling method '.version_select at 0x7fcce463fc10>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:06.246521 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-2b1ce592-c196-441f-82e3-d4ea916e84d2 tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 02:28:06.251861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2b1ce592-c196-441f-82e3-d4ea916e84d2 tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] Request method failure captured: Oct 05 02:28:06.251861 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 05 02:28:06.251861 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:28:06.251861 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:28:06.251861 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:28:06.251861 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:28:06.251861 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:28:06.251861 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:28:06.251861 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:28:06.251861 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:06.251861 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOu0LQyYpo4TeE8hMqng62ImVBNhwv0kFVVqKZwlTKbADLWTMuu_MvqEgW43734V8gvEfM30LMIPvZ4tfGm9lAsRKFzDQ0r7sottodcGcnncjJcqfCx274owm3KohTKxekkgAfSln1thfwIOyiE9iA0WNLDiRwcPKjlFNmJ-ThWXtR8 Oct 05 02:28:06.251861 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:28:06.251861 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:28:06.251861 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:28:06.251861 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:28:06.251861 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:28:06.251861 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:28:06.251861 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: b85f6bbc881c42489f3f49f57933f6a2 Oct 05 02:28:06.251861 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1491975325 Oct 05 02:28:06.251861 n-d-858272-3 devstack@n-api.service[122319]: X-Role: admin,member,reader Oct 05 02:28:06.251861 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: admin,member,reader Oct 05 02:28:06.253394 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b85f6bbc881c42489f3f49f57933f6a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b85f6bbc881c42489f3f49f57933f6a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b85f6bbc881c42489f3f49f57933f6a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b85f6bbc881c42489f3f49f57933f6a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:06.253394 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1491975325 Oct 05 02:28:06.253394 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: b85f6bbc881c42489f3f49f57933f6a2 Oct 05 02:28:06.253394 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1491975325 Oct 05 02:28:06.253394 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-HostsAdminNegativeTestJSON-1491975325-project-admin Oct 05 02:28:06.253394 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:28:06.253394 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:28:06.253394 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 7a95981ee6314d76bbf361b194d67cb7 Oct 05 02:28:06.253394 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1491975325-project-admin Oct 05 02:28:06.253394 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:28:06.253394 n-d-858272-3 devstack@n-api.service[122319]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 02:28:06.253394 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'nonexistent_hostname'} Oct 05 02:28:06.253394 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:06.254120 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.254120 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 05 02:28:06.254120 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 05 02:28:06.254120 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 05 02:28:06.254120 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 05 02:28:06.254120 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:28:06.254120 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:28:06.254120 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:28:06.254120 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:28:06.254120 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 05 02:28:06.254120 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 05 02:28:06.254120 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 05 02:28:06.254120 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 05 02:28:06.254120 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:28:06.254120 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:28:06.254120 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 05 02:28:06.254120 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 05 02:28:06.254120 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 02:28:06.254120 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 02:28:06.255204 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 05 02:28:06.255204 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 05 02:28:06.255204 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 02:28:06.255204 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.255204 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:06.255204 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.255204 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.255204 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:06.255204 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:06.255204 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:06.255204 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:06.255204 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:28:06.255204 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:28:06.255204 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:06.255204 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:06.255204 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 05 02:28:06.255204 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 05 02:28:06.255204 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 05 02:28:06.255204 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:28:06.256254 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 02:28:06.256254 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.256254 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:06.256254 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.256254 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.256254 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:06.256254 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:06.256254 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:28:06.256254 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:28:06.256254 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 02:28:06.256254 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.262337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2b1ce592-c196-441f-82e3-d4ea916e84d2 tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:06.263481 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2b1ce592-c196-441f-82e3-d4ea916e84d2 tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.052806 Oct 05 02:28:06.266525 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 198/391] 10.222.0.16 () {58 vars in 1212 bytes} [Wed Oct 5 02:28:06 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 05 02:28:06.275899 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e84d776a-c6c6-48f3-ae27-0e0b417c1b00 tempest-HostsAdminNegativeTestJSON-1314724707 tempest-HostsAdminNegativeTestJSON-1314724707-project] Calling method '.version_select at 0x7fcce45ffc10>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:06.280077 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e84d776a-c6c6-48f3-ae27-0e0b417c1b00 tempest-HostsAdminNegativeTestJSON-1314724707 tempest-HostsAdminNegativeTestJSON-1314724707-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '6b8dbdec9e87496b868d58ca08515bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966924b122294514bc98da18682e7c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:06.285141 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e84d776a-c6c6-48f3-ae27-0e0b417c1b00 tempest-HostsAdminNegativeTestJSON-1314724707 tempest-HostsAdminNegativeTestJSON-1314724707-project] Request method failure captured: Oct 05 02:28:06.285141 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/os-hosts/n-d-858272-3 HTTP/1.1 Oct 05 02:28:06.285141 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:28:06.285141 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:28:06.285141 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:28:06.285141 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:28:06.285141 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:28:06.285141 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:28:06.285141 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:28:06.285141 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:06.285141 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOuxnGKf2bNCi256qbz1HQXfQnDyg0Gu88FzehT7_fV-LGUslsSIrhaDh1tE_AB98IIc79v1nHGVux_prZM638OYSfPUYsu_usuv71CbLKb3C1jzWin6kWJdEQKq00MJBi_hJWoVD-QfwQjJOYR2e7FGR-OEyy55ZK1Atm4azusY23o Oct 05 02:28:06.285141 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:28:06.285141 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:28:06.285141 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:28:06.285141 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:28:06.285141 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:28:06.285141 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:28:06.285141 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 966924b122294514bc98da18682e7c54 Oct 05 02:28:06.285141 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1314724707 Oct 05 02:28:06.285141 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:28:06.285141 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:28:06.286429 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/966924b122294514bc98da18682e7c54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/966924b122294514bc98da18682e7c54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/966924b122294514bc98da18682e7c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_966924b122294514bc98da18682e7c54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:06.286429 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1314724707 Oct 05 02:28:06.286429 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 966924b122294514bc98da18682e7c54 Oct 05 02:28:06.286429 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1314724707 Oct 05 02:28:06.286429 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-HostsAdminNegativeTestJSON-1314724707-project Oct 05 02:28:06.286429 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:28:06.286429 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:28:06.286429 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 6b8dbdec9e87496b868d58ca08515bc6 Oct 05 02:28:06.286429 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1314724707-project Oct 05 02:28:06.286429 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:28:06.286429 n-d-858272-3 devstack@n-api.service[122319]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 05 02:28:06.286429 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'n-d-858272-3'} Oct 05 02:28:06.286429 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:06.287198 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.287198 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:06.287198 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:06.287198 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:06.287198 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:06.287198 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:28:06.287198 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:28:06.287198 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:06.287198 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:06.287198 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 05 02:28:06.287198 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 05 02:28:06.287198 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 02:28:06.287198 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 02:28:06.287198 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 02:28:06.287198 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 02:28:06.287198 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:28:06.287198 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:28:06.287198 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:28:06.287198 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:28:06.288396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 02:28:06.288396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 02:28:06.288396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 02:28:06.288396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 02:28:06.288396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:28:06.288396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 02:28:06.288396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 05 02:28:06.288396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.288396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:06.288396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.288396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.288396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:06.288396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:06.288396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 02:28:06.288396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 02:28:06.288396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 05 02:28:06.288396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.294286 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e84d776a-c6c6-48f3-ae27-0e0b417c1b00 tempest-HostsAdminNegativeTestJSON-1314724707 tempest-HostsAdminNegativeTestJSON-1314724707-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:06.297956 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e84d776a-c6c6-48f3-ae27-0e0b417c1b00 tempest-HostsAdminNegativeTestJSON-1314724707 tempest-HostsAdminNegativeTestJSON-1314724707-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-858272-3" status: 403 len: 109 microversion: 2.1 time: 0.025858 Oct 05 02:28:06.298852 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 199/392] 10.222.0.16 () {58 vars in 1167 bytes} [Wed Oct 5 02:28:06 2022] GET /compute/v2.1/os-hosts/n-d-858272-3 => generated 109 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:28:06.310066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ba227e17-0cf1-4a11-a750-2a702ed600e6 tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] Calling method '.version_select at 0x7fcce45a4c10>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:06.333234 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-ba227e17-0cf1-4a11-a750-2a702ed600e6 tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 02:28:06.335134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ba227e17-0cf1-4a11-a750-2a702ed600e6 tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] Request method failure captured: Oct 05 02:28:06.335134 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 05 02:28:06.335134 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:28:06.335134 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:28:06.335134 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:28:06.335134 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:28:06.335134 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:28:06.335134 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:28:06.335134 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:28:06.335134 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:06.335134 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOu0LQyYpo4TeE8hMqng62ImVBNhwv0kFVVqKZwlTKbADLWTMuu_MvqEgW43734V8gvEfM30LMIPvZ4tfGm9lAsRKFzDQ0r7sottodcGcnncjJcqfCx274owm3KohTKxekkgAfSln1thfwIOyiE9iA0WNLDiRwcPKjlFNmJ-ThWXtR8 Oct 05 02:28:06.335134 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:28:06.335134 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:28:06.335134 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:28:06.335134 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:28:06.335134 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:28:06.335134 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:28:06.335134 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: b85f6bbc881c42489f3f49f57933f6a2 Oct 05 02:28:06.335134 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1491975325 Oct 05 02:28:06.335134 n-d-858272-3 devstack@n-api.service[122319]: X-Role: admin,member,reader Oct 05 02:28:06.335134 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: admin,member,reader Oct 05 02:28:06.336437 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b85f6bbc881c42489f3f49f57933f6a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b85f6bbc881c42489f3f49f57933f6a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b85f6bbc881c42489f3f49f57933f6a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b85f6bbc881c42489f3f49f57933f6a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:06.336437 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1491975325 Oct 05 02:28:06.336437 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: b85f6bbc881c42489f3f49f57933f6a2 Oct 05 02:28:06.336437 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1491975325 Oct 05 02:28:06.336437 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-HostsAdminNegativeTestJSON-1491975325-project-admin Oct 05 02:28:06.336437 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:28:06.336437 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:28:06.336437 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 7a95981ee6314d76bbf361b194d67cb7 Oct 05 02:28:06.336437 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1491975325-project-admin Oct 05 02:28:06.336437 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:28:06.336437 n-d-858272-3 devstack@n-api.service[122319]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 02:28:06.336437 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'nonexistent_hostname'} Oct 05 02:28:06.336437 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:06.337662 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.337662 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 05 02:28:06.337662 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 05 02:28:06.337662 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:28:06.337662 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:28:06.337662 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 05 02:28:06.337662 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 05 02:28:06.337662 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 02:28:06.337662 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 02:28:06.337662 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 05 02:28:06.337662 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 05 02:28:06.337662 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 02:28:06.337662 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.337662 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:06.337662 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.337662 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.337662 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:06.337662 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:06.337662 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:06.338718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:06.338718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:28:06.338718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:28:06.338718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:06.338718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:06.338718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 05 02:28:06.338718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:28:06.338718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 02:28:06.338718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.338718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:06.338718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.338718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.338718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:06.338718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:06.338718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:28:06.338718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:28:06.338718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 02:28:06.338718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.350167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ba227e17-0cf1-4a11-a750-2a702ed600e6 tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:06.351734 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ba227e17-0cf1-4a11-a750-2a702ed600e6 tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.046586 Oct 05 02:28:06.352834 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 200/393] 10.222.0.16 () {58 vars in 1191 bytes} [Wed Oct 5 02:28:06 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 05 02:28:06.362852 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-82456556-c966-411e-bb1c-501faebb779a tempest-HostsAdminNegativeTestJSON-1314724707 tempest-HostsAdminNegativeTestJSON-1314724707-project] Calling method '.version_select at 0x7fcce45de700>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:06.364978 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-82456556-c966-411e-bb1c-501faebb779a tempest-HostsAdminNegativeTestJSON-1314724707 tempest-HostsAdminNegativeTestJSON-1314724707-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '6b8dbdec9e87496b868d58ca08515bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966924b122294514bc98da18682e7c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:06.366770 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-82456556-c966-411e-bb1c-501faebb779a tempest-HostsAdminNegativeTestJSON-1314724707 tempest-HostsAdminNegativeTestJSON-1314724707-project] Request method failure captured: Oct 05 02:28:06.366770 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/os-hosts/n-d-858272-3/shutdown HTTP/1.1 Oct 05 02:28:06.366770 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:28:06.366770 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:28:06.366770 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:28:06.366770 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:28:06.366770 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:28:06.366770 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:28:06.366770 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:28:06.366770 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:06.366770 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOuxnGKf2bNCi256qbz1HQXfQnDyg0Gu88FzehT7_fV-LGUslsSIrhaDh1tE_AB98IIc79v1nHGVux_prZM638OYSfPUYsu_usuv71CbLKb3C1jzWin6kWJdEQKq00MJBi_hJWoVD-QfwQjJOYR2e7FGR-OEyy55ZK1Atm4azusY23o Oct 05 02:28:06.366770 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:28:06.366770 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:28:06.366770 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:28:06.366770 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:28:06.366770 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:28:06.366770 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:28:06.366770 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 966924b122294514bc98da18682e7c54 Oct 05 02:28:06.366770 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1314724707 Oct 05 02:28:06.366770 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:28:06.366770 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:28:06.368005 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/966924b122294514bc98da18682e7c54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/966924b122294514bc98da18682e7c54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/966924b122294514bc98da18682e7c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_966924b122294514bc98da18682e7c54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:06.368005 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1314724707 Oct 05 02:28:06.368005 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 966924b122294514bc98da18682e7c54 Oct 05 02:28:06.368005 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1314724707 Oct 05 02:28:06.368005 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-HostsAdminNegativeTestJSON-1314724707-project Oct 05 02:28:06.368005 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:28:06.368005 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:28:06.368005 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 6b8dbdec9e87496b868d58ca08515bc6 Oct 05 02:28:06.368005 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1314724707-project Oct 05 02:28:06.368005 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:28:06.368005 n-d-858272-3 devstack@n-api.service[122319]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 05 02:28:06.368005 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'n-d-858272-3'} Oct 05 02:28:06.368005 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:06.368722 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.368722 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:06.368722 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:06.368722 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:06.368722 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:06.368722 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:28:06.368722 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:28:06.368722 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:06.368722 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:06.368722 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 05 02:28:06.368722 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 05 02:28:06.368722 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 02:28:06.368722 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 02:28:06.368722 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 02:28:06.368722 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 02:28:06.368722 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:28:06.368722 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:28:06.368722 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:28:06.368722 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:28:06.369822 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 02:28:06.369822 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 02:28:06.369822 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 02:28:06.369822 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 02:28:06.369822 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:28:06.369822 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 02:28:06.369822 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 05 02:28:06.369822 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.369822 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:06.369822 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.369822 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.369822 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:06.369822 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:06.369822 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 02:28:06.369822 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 02:28:06.369822 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 05 02:28:06.369822 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.374886 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-82456556-c966-411e-bb1c-501faebb779a tempest-HostsAdminNegativeTestJSON-1314724707 tempest-HostsAdminNegativeTestJSON-1314724707-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:06.375959 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-82456556-c966-411e-bb1c-501faebb779a tempest-HostsAdminNegativeTestJSON-1314724707 tempest-HostsAdminNegativeTestJSON-1314724707-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-858272-3/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.017939 Oct 05 02:28:06.380509 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 201/394] 10.222.0.16 () {58 vars in 1194 bytes} [Wed Oct 5 02:28:06 2022] GET /compute/v2.1/os-hosts/n-d-858272-3/shutdown => generated 113 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:28:06.391976 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-067a7f44-dba7-4c14-9b4f-ba6bb5b5581e tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] Calling method '.version_select at 0x7fcce45a4940>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:06.413334 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-067a7f44-dba7-4c14-9b4f-ba6bb5b5581e tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 02:28:06.415059 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-067a7f44-dba7-4c14-9b4f-ba6bb5b5581e tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] Request method failure captured: Oct 05 02:28:06.415059 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 05 02:28:06.415059 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:28:06.415059 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:28:06.415059 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:28:06.415059 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:28:06.415059 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:28:06.415059 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:28:06.415059 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:28:06.415059 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:06.415059 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOu0LQyYpo4TeE8hMqng62ImVBNhwv0kFVVqKZwlTKbADLWTMuu_MvqEgW43734V8gvEfM30LMIPvZ4tfGm9lAsRKFzDQ0r7sottodcGcnncjJcqfCx274owm3KohTKxekkgAfSln1thfwIOyiE9iA0WNLDiRwcPKjlFNmJ-ThWXtR8 Oct 05 02:28:06.415059 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:28:06.415059 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:28:06.415059 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:28:06.415059 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:28:06.415059 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:28:06.415059 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:28:06.415059 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: b85f6bbc881c42489f3f49f57933f6a2 Oct 05 02:28:06.415059 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1491975325 Oct 05 02:28:06.415059 n-d-858272-3 devstack@n-api.service[122319]: X-Role: admin,member,reader Oct 05 02:28:06.415059 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: admin,member,reader Oct 05 02:28:06.416248 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b85f6bbc881c42489f3f49f57933f6a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b85f6bbc881c42489f3f49f57933f6a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b85f6bbc881c42489f3f49f57933f6a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b85f6bbc881c42489f3f49f57933f6a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:06.416248 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1491975325 Oct 05 02:28:06.416248 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: b85f6bbc881c42489f3f49f57933f6a2 Oct 05 02:28:06.416248 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1491975325 Oct 05 02:28:06.416248 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-HostsAdminNegativeTestJSON-1491975325-project-admin Oct 05 02:28:06.416248 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:28:06.416248 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:28:06.416248 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 7a95981ee6314d76bbf361b194d67cb7 Oct 05 02:28:06.416248 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1491975325-project-admin Oct 05 02:28:06.416248 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:28:06.416248 n-d-858272-3 devstack@n-api.service[122319]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 02:28:06.416248 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'nonexistent_hostname'} Oct 05 02:28:06.416248 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:06.417075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.417075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 05 02:28:06.417075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 05 02:28:06.417075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 05 02:28:06.417075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 05 02:28:06.417075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:28:06.417075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:28:06.417075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:28:06.417075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:28:06.417075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 05 02:28:06.417075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 05 02:28:06.417075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 05 02:28:06.417075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 05 02:28:06.417075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:28:06.417075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:28:06.417075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 05 02:28:06.417075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 05 02:28:06.417075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 02:28:06.417075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 02:28:06.418111 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 05 02:28:06.418111 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 05 02:28:06.418111 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 02:28:06.418111 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.418111 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:06.418111 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.418111 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.418111 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:06.418111 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:06.418111 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:06.418111 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:06.418111 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:28:06.418111 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:28:06.418111 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:06.418111 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:06.418111 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 05 02:28:06.418111 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 05 02:28:06.418111 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 05 02:28:06.418111 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:28:06.419151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 02:28:06.419151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.419151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:06.419151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.419151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.419151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:06.419151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:06.419151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:28:06.419151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:28:06.419151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 02:28:06.419151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.419151 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-067a7f44-dba7-4c14-9b4f-ba6bb5b5581e tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:06.420431 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-067a7f44-dba7-4c14-9b4f-ba6bb5b5581e tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.035968 Oct 05 02:28:06.426010 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 202/395] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 5 02:28:06 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:28:06.434084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e4a25753-a122-4a3a-8af0-64f0460c8eed tempest-HostsAdminNegativeTestJSON-1314724707 tempest-HostsAdminNegativeTestJSON-1314724707-project] Calling method '.version_select at 0x7fcce45ff3a0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:06.444792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e4a25753-a122-4a3a-8af0-64f0460c8eed tempest-HostsAdminNegativeTestJSON-1314724707 tempest-HostsAdminNegativeTestJSON-1314724707-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '6b8dbdec9e87496b868d58ca08515bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966924b122294514bc98da18682e7c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:06.448332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e4a25753-a122-4a3a-8af0-64f0460c8eed tempest-HostsAdminNegativeTestJSON-1314724707 tempest-HostsAdminNegativeTestJSON-1314724707-project] Request method failure captured: Oct 05 02:28:06.448332 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/os-hosts/n-d-858272-3/startup HTTP/1.1 Oct 05 02:28:06.448332 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:28:06.448332 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:28:06.448332 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:28:06.448332 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:28:06.448332 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:28:06.448332 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:28:06.448332 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:28:06.448332 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:06.448332 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOuxnGKf2bNCi256qbz1HQXfQnDyg0Gu88FzehT7_fV-LGUslsSIrhaDh1tE_AB98IIc79v1nHGVux_prZM638OYSfPUYsu_usuv71CbLKb3C1jzWin6kWJdEQKq00MJBi_hJWoVD-QfwQjJOYR2e7FGR-OEyy55ZK1Atm4azusY23o Oct 05 02:28:06.448332 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:28:06.448332 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:28:06.448332 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:28:06.448332 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:28:06.448332 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:28:06.448332 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:28:06.448332 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 966924b122294514bc98da18682e7c54 Oct 05 02:28:06.448332 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1314724707 Oct 05 02:28:06.448332 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:28:06.448332 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:28:06.449793 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/966924b122294514bc98da18682e7c54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/966924b122294514bc98da18682e7c54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/966924b122294514bc98da18682e7c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_966924b122294514bc98da18682e7c54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:06.449793 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1314724707 Oct 05 02:28:06.449793 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 966924b122294514bc98da18682e7c54 Oct 05 02:28:06.449793 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1314724707 Oct 05 02:28:06.449793 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-HostsAdminNegativeTestJSON-1314724707-project Oct 05 02:28:06.449793 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:28:06.449793 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:28:06.449793 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 6b8dbdec9e87496b868d58ca08515bc6 Oct 05 02:28:06.449793 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1314724707-project Oct 05 02:28:06.449793 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:28:06.449793 n-d-858272-3 devstack@n-api.service[122319]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 05 02:28:06.449793 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'n-d-858272-3'} Oct 05 02:28:06.449793 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:06.450742 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.450742 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:06.450742 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:06.450742 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:06.450742 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:06.450742 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:28:06.450742 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:28:06.450742 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:06.450742 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:06.450742 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 05 02:28:06.450742 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 05 02:28:06.450742 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 02:28:06.450742 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 02:28:06.450742 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 02:28:06.450742 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 02:28:06.450742 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:28:06.450742 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:28:06.450742 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:28:06.450742 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:28:06.451989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 02:28:06.451989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 02:28:06.451989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 02:28:06.451989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 02:28:06.451989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:28:06.451989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 02:28:06.451989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 05 02:28:06.451989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.451989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:06.451989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.451989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.451989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:06.451989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:06.451989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 02:28:06.451989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 02:28:06.451989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 05 02:28:06.451989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.454758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e4a25753-a122-4a3a-8af0-64f0460c8eed tempest-HostsAdminNegativeTestJSON-1314724707 tempest-HostsAdminNegativeTestJSON-1314724707-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:06.457503 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e4a25753-a122-4a3a-8af0-64f0460c8eed tempest-HostsAdminNegativeTestJSON-1314724707 tempest-HostsAdminNegativeTestJSON-1314724707-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-858272-3/startup" status: 403 len: 110 microversion: 2.1 time: 0.025561 Oct 05 02:28:06.458689 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 203/396] 10.222.0.16 () {58 vars in 1191 bytes} [Wed Oct 5 02:28:06 2022] GET /compute/v2.1/os-hosts/n-d-858272-3/startup => generated 110 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:28:06.469329 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-06c43b7e-2ff3-4b4e-924f-e5d748f1127b tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] Calling method '.version_select at 0x7fcce45a4040>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:06.482032 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-06c43b7e-2ff3-4b4e-924f-e5d748f1127b tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 02:28:06.484303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-06c43b7e-2ff3-4b4e-924f-e5d748f1127b tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] Request method failure captured: Oct 05 02:28:06.484303 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 05 02:28:06.484303 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:28:06.484303 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:28:06.484303 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:28:06.484303 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:28:06.484303 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:28:06.484303 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:28:06.484303 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:28:06.484303 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:06.484303 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOu0LQyYpo4TeE8hMqng62ImVBNhwv0kFVVqKZwlTKbADLWTMuu_MvqEgW43734V8gvEfM30LMIPvZ4tfGm9lAsRKFzDQ0r7sottodcGcnncjJcqfCx274owm3KohTKxekkgAfSln1thfwIOyiE9iA0WNLDiRwcPKjlFNmJ-ThWXtR8 Oct 05 02:28:06.484303 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:28:06.484303 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:28:06.484303 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:28:06.484303 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:28:06.484303 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:28:06.484303 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:28:06.484303 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: b85f6bbc881c42489f3f49f57933f6a2 Oct 05 02:28:06.484303 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1491975325 Oct 05 02:28:06.484303 n-d-858272-3 devstack@n-api.service[122319]: X-Role: admin,member,reader Oct 05 02:28:06.484303 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: admin,member,reader Oct 05 02:28:06.485906 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b85f6bbc881c42489f3f49f57933f6a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b85f6bbc881c42489f3f49f57933f6a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b85f6bbc881c42489f3f49f57933f6a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b85f6bbc881c42489f3f49f57933f6a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:06.485906 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1491975325 Oct 05 02:28:06.485906 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: b85f6bbc881c42489f3f49f57933f6a2 Oct 05 02:28:06.485906 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1491975325 Oct 05 02:28:06.485906 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-HostsAdminNegativeTestJSON-1491975325-project-admin Oct 05 02:28:06.485906 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:28:06.485906 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:28:06.485906 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 7a95981ee6314d76bbf361b194d67cb7 Oct 05 02:28:06.485906 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1491975325-project-admin Oct 05 02:28:06.485906 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:28:06.485906 n-d-858272-3 devstack@n-api.service[122319]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 02:28:06.485906 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'nonexistent_hostname'} Oct 05 02:28:06.485906 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:06.487085 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.487085 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 05 02:28:06.487085 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 05 02:28:06.487085 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 05 02:28:06.487085 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 05 02:28:06.487085 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:28:06.487085 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:28:06.487085 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:28:06.487085 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:28:06.487085 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 05 02:28:06.487085 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 05 02:28:06.487085 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 05 02:28:06.487085 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 05 02:28:06.487085 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:28:06.487085 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:28:06.487085 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 05 02:28:06.487085 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 05 02:28:06.487085 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 02:28:06.487085 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 02:28:06.489297 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 05 02:28:06.489297 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 05 02:28:06.489297 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 02:28:06.489297 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.489297 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:06.489297 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.489297 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.489297 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:06.489297 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:06.489297 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:06.489297 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:06.489297 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:28:06.489297 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:28:06.489297 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:06.489297 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:06.489297 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 05 02:28:06.489297 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 05 02:28:06.489297 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 05 02:28:06.489297 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:28:06.490836 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 02:28:06.490836 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.490836 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:06.490836 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.490836 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.490836 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:06.490836 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:06.490836 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:28:06.490836 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:28:06.490836 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 02:28:06.490836 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.492803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-06c43b7e-2ff3-4b4e-924f-e5d748f1127b tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:06.493829 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-06c43b7e-2ff3-4b4e-924f-e5d748f1127b tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.030190 Oct 05 02:28:06.494874 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 204/397] 10.222.0.16 () {58 vars in 1215 bytes} [Wed Oct 5 02:28:06 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 05 02:28:06.506223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fa8db8a4-130d-4f2d-81a4-8b316e5d0ceb tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] Action: 'update', calling method: .version_select at 0x7fcce463fc10>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:06.510889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fa8db8a4-130d-4f2d-81a4-8b316e5d0ceb tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] Request method failure captured: Oct 05 02:28:06.510889 n-d-858272-3 devstack@n-api.service[122319]: request: PUT /compute/v2.1/os-hosts/n-d-858272-3 HTTP/1.1 Oct 05 02:28:06.510889 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:28:06.510889 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:28:06.510889 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:28:06.510889 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 51 Oct 05 02:28:06.510889 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:28:06.510889 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:28:06.510889 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:28:06.510889 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:06.510889 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOu0LQyYpo4TeE8hMqng62ImVBNhwv0kFVVqKZwlTKbADLWTMuu_MvqEgW43734V8gvEfM30LMIPvZ4tfGm9lAsRKFzDQ0r7sottodcGcnncjJcqfCx274owm3KohTKxekkgAfSln1thfwIOyiE9iA0WNLDiRwcPKjlFNmJ-ThWXtR8 Oct 05 02:28:06.510889 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:28:06.510889 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:28:06.510889 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:28:06.510889 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:28:06.510889 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:28:06.510889 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:28:06.510889 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: b85f6bbc881c42489f3f49f57933f6a2 Oct 05 02:28:06.510889 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1491975325 Oct 05 02:28:06.510889 n-d-858272-3 devstack@n-api.service[122319]: X-Role: admin,member,reader Oct 05 02:28:06.510889 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: admin,member,reader Oct 05 02:28:06.512464 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b85f6bbc881c42489f3f49f57933f6a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b85f6bbc881c42489f3f49f57933f6a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b85f6bbc881c42489f3f49f57933f6a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b85f6bbc881c42489f3f49f57933f6a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:06.512464 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1491975325 Oct 05 02:28:06.512464 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: b85f6bbc881c42489f3f49f57933f6a2 Oct 05 02:28:06.512464 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1491975325 Oct 05 02:28:06.512464 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-HostsAdminNegativeTestJSON-1491975325-project-admin Oct 05 02:28:06.512464 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:28:06.512464 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:28:06.512464 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 7a95981ee6314d76bbf361b194d67cb7 Oct 05 02:28:06.512464 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1491975325-project-admin Oct 05 02:28:06.512464 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:28:06.512464 n-d-858272-3 devstack@n-api.service[122319]: {"status": "enable", "maintenance_mode": "invalid"} Oct 05 02:28:06.512464 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:28:06.512464 n-d-858272-3 devstack@n-api.service[122319]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 05 02:28:06.513835 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'n-d-858272-3', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 05 02:28:06.513835 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:06.513835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.513835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:28:06.513835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:28:06.513835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:28:06.513835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:28:06.513835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 05 02:28:06.513835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.513835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 05 02:28:06.513835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 05 02:28:06.513835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'disable', Oct 05 02:28:06.513835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'Enable', Oct 05 02:28:06.513835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'Disable', Oct 05 02:28:06.513835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 05 02:28:06.513835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 05 02:28:06.513835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 05 02:28:06.513835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.513835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi On instance: Oct 05 02:28:06.513835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'invalid' Oct 05 02:28:06.513835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.513835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:06.513835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.513835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.513835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:06.515551 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:06.515551 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:06.515551 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:06.515551 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:28:06.515551 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:28:06.515551 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:06.515551 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:06.515551 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 02:28:06.515551 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 02:28:06.515551 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:28:06.515551 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:28:06.515551 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:28:06.515551 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:28:06.515551 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 05 02:28:06.515551 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.515551 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:06.515551 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.515551 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.515551 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:06.516832 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:06.516832 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:28:06.516832 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:28:06.516832 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 05 02:28:06.516832 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.519124 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fa8db8a4-130d-4f2d-81a4-8b316e5d0ceb tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:06.520655 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fa8db8a4-130d-4f2d-81a4-8b316e5d0ceb tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-858272-3" status: 400 len: 199 microversion: 2.1 time: 0.020483 Oct 05 02:28:06.522147 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 205/398] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Oct 5 02:28:06 2022] PUT /compute/v2.1/os-hosts/n-d-858272-3 => generated 199 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 05 02:28:06.538993 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ec92e557-d3d7-4e91-bb01-03184dcfb24d tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] Action: 'update', calling method: .version_select at 0x7fcce4673160>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:06.545405 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ec92e557-d3d7-4e91-bb01-03184dcfb24d tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] Request method failure captured: Oct 05 02:28:06.545405 n-d-858272-3 devstack@n-api.service[122319]: request: PUT /compute/v2.1/os-hosts/n-d-858272-3 HTTP/1.1 Oct 05 02:28:06.545405 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:28:06.545405 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:28:06.545405 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:28:06.545405 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 51 Oct 05 02:28:06.545405 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:28:06.545405 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:28:06.545405 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:28:06.545405 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:06.545405 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOu0LQyYpo4TeE8hMqng62ImVBNhwv0kFVVqKZwlTKbADLWTMuu_MvqEgW43734V8gvEfM30LMIPvZ4tfGm9lAsRKFzDQ0r7sottodcGcnncjJcqfCx274owm3KohTKxekkgAfSln1thfwIOyiE9iA0WNLDiRwcPKjlFNmJ-ThWXtR8 Oct 05 02:28:06.545405 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:28:06.545405 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:28:06.545405 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:28:06.545405 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:28:06.545405 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:28:06.545405 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:28:06.545405 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: b85f6bbc881c42489f3f49f57933f6a2 Oct 05 02:28:06.545405 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1491975325 Oct 05 02:28:06.545405 n-d-858272-3 devstack@n-api.service[122319]: X-Role: admin,member,reader Oct 05 02:28:06.545405 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: admin,member,reader Oct 05 02:28:06.547126 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b85f6bbc881c42489f3f49f57933f6a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b85f6bbc881c42489f3f49f57933f6a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b85f6bbc881c42489f3f49f57933f6a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b85f6bbc881c42489f3f49f57933f6a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:06.547126 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1491975325 Oct 05 02:28:06.547126 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: b85f6bbc881c42489f3f49f57933f6a2 Oct 05 02:28:06.547126 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1491975325 Oct 05 02:28:06.547126 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-HostsAdminNegativeTestJSON-1491975325-project-admin Oct 05 02:28:06.547126 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:28:06.547126 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:28:06.547126 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 7a95981ee6314d76bbf361b194d67cb7 Oct 05 02:28:06.547126 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1491975325-project-admin Oct 05 02:28:06.547126 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:28:06.547126 n-d-858272-3 devstack@n-api.service[122319]: {"status": "invalid", "maintenance_mode": "enable"} Oct 05 02:28:06.547126 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:28:06.547126 n-d-858272-3 devstack@n-api.service[122319]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 05 02:28:06.548005 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'n-d-858272-3', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 05 02:28:06.548005 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:06.548005 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.548005 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:28:06.548005 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:28:06.548005 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:28:06.548005 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:28:06.548005 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 05 02:28:06.548005 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.548005 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 05 02:28:06.548005 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 05 02:28:06.548005 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'disable', Oct 05 02:28:06.548005 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'Enable', Oct 05 02:28:06.548005 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'Disable', Oct 05 02:28:06.548005 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 05 02:28:06.548005 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 05 02:28:06.548005 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 05 02:28:06.548005 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.548005 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi On instance: Oct 05 02:28:06.548005 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'invalid' Oct 05 02:28:06.548005 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.548005 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:06.548005 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.548005 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.548005 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:06.549988 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:06.549988 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:06.549988 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:06.549988 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:28:06.549988 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:28:06.549988 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:06.549988 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:06.549988 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 02:28:06.549988 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 02:28:06.549988 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:28:06.549988 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:28:06.549988 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:28:06.549988 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:28:06.549988 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 05 02:28:06.549988 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.549988 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:06.549988 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.549988 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.549988 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:06.551748 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:06.551748 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:28:06.551748 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:28:06.551748 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 05 02:28:06.551748 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.557253 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ec92e557-d3d7-4e91-bb01-03184dcfb24d tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:06.560479 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ec92e557-d3d7-4e91-bb01-03184dcfb24d tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-858272-3" status: 400 len: 189 microversion: 2.1 time: 0.031779 Oct 05 02:28:06.565496 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 206/399] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Oct 5 02:28:06 2022] PUT /compute/v2.1/os-hosts/n-d-858272-3 => generated 189 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 05 02:28:06.576738 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8865a126-97a3-4f45-a3bf-5041973e1bfc tempest-HostsAdminNegativeTestJSON-1314724707 tempest-HostsAdminNegativeTestJSON-1314724707-project] Action: 'update', calling method: .version_select at 0x7fcce465f8b0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:06.585081 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8865a126-97a3-4f45-a3bf-5041973e1bfc tempest-HostsAdminNegativeTestJSON-1314724707 tempest-HostsAdminNegativeTestJSON-1314724707-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '6b8dbdec9e87496b868d58ca08515bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966924b122294514bc98da18682e7c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:06.586643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8865a126-97a3-4f45-a3bf-5041973e1bfc tempest-HostsAdminNegativeTestJSON-1314724707 tempest-HostsAdminNegativeTestJSON-1314724707-project] Request method failure captured: Oct 05 02:28:06.586643 n-d-858272-3 devstack@n-api.service[122319]: request: PUT /compute/v2.1/os-hosts/n-d-858272-3 HTTP/1.1 Oct 05 02:28:06.586643 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:28:06.586643 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:28:06.586643 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:28:06.586643 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 50 Oct 05 02:28:06.586643 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:28:06.586643 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:28:06.586643 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:28:06.586643 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:06.586643 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOuxnGKf2bNCi256qbz1HQXfQnDyg0Gu88FzehT7_fV-LGUslsSIrhaDh1tE_AB98IIc79v1nHGVux_prZM638OYSfPUYsu_usuv71CbLKb3C1jzWin6kWJdEQKq00MJBi_hJWoVD-QfwQjJOYR2e7FGR-OEyy55ZK1Atm4azusY23o Oct 05 02:28:06.586643 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:28:06.586643 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:28:06.586643 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:28:06.586643 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:28:06.586643 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:28:06.586643 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:28:06.586643 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 966924b122294514bc98da18682e7c54 Oct 05 02:28:06.586643 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1314724707 Oct 05 02:28:06.586643 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:28:06.586643 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:28:06.588067 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/966924b122294514bc98da18682e7c54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/966924b122294514bc98da18682e7c54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/966924b122294514bc98da18682e7c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_966924b122294514bc98da18682e7c54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:06.588067 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1314724707 Oct 05 02:28:06.588067 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 966924b122294514bc98da18682e7c54 Oct 05 02:28:06.588067 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1314724707 Oct 05 02:28:06.588067 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-HostsAdminNegativeTestJSON-1314724707-project Oct 05 02:28:06.588067 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:28:06.588067 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:28:06.588067 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 6b8dbdec9e87496b868d58ca08515bc6 Oct 05 02:28:06.588067 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1314724707-project Oct 05 02:28:06.588067 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:28:06.588067 n-d-858272-3 devstack@n-api.service[122319]: {"status": "enable", "maintenance_mode": "enable"} Oct 05 02:28:06.588067 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:28:06.588067 n-d-858272-3 devstack@n-api.service[122319]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 05 02:28:06.588067 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'n-d-858272-3', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 05 02:28:06.588972 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:06.588972 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.588972 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:06.588972 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:06.588972 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:06.588972 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:06.588972 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:28:06.588972 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:28:06.588972 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:06.588972 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:06.588972 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:28:06.588972 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:28:06.588972 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 05 02:28:06.588972 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 05 02:28:06.588972 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 02:28:06.588972 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 02:28:06.588972 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 02:28:06.588972 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 02:28:06.588972 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:28:06.588972 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:28:06.590129 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:28:06.590129 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:28:06.590129 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 02:28:06.590129 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 02:28:06.590129 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 02:28:06.590129 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 02:28:06.590129 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:28:06.590129 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 02:28:06.590129 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 05 02:28:06.590129 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.590129 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:06.590129 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.590129 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.590129 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:06.590129 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:06.590129 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 02:28:06.590129 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 02:28:06.590129 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 05 02:28:06.590129 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.591413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8865a126-97a3-4f45-a3bf-5041973e1bfc tempest-HostsAdminNegativeTestJSON-1314724707 tempest-HostsAdminNegativeTestJSON-1314724707-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:06.593873 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8865a126-97a3-4f45-a3bf-5041973e1bfc tempest-HostsAdminNegativeTestJSON-1314724707 tempest-HostsAdminNegativeTestJSON-1314724707-project] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-858272-3" status: 403 len: 111 microversion: 2.1 time: 0.019428 Oct 05 02:28:06.595236 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 207/400] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Oct 5 02:28:06 2022] PUT /compute/v2.1/os-hosts/n-d-858272-3 => generated 111 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:28:06.604329 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a1cfbf2d-c203-4efd-b678-e506e6ec806a tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] Action: 'update', calling method: .version_select at 0x7fcce463fa60>, body: {"status": null, "maintenance_mode": null} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:06.613539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a1cfbf2d-c203-4efd-b678-e506e6ec806a tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] Request method failure captured: Oct 05 02:28:06.613539 n-d-858272-3 devstack@n-api.service[122319]: request: PUT /compute/v2.1/os-hosts/n-d-858272-3 HTTP/1.1 Oct 05 02:28:06.613539 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:28:06.613539 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:28:06.613539 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:28:06.613539 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 42 Oct 05 02:28:06.613539 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:28:06.613539 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:28:06.613539 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:28:06.613539 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:06.613539 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOu0LQyYpo4TeE8hMqng62ImVBNhwv0kFVVqKZwlTKbADLWTMuu_MvqEgW43734V8gvEfM30LMIPvZ4tfGm9lAsRKFzDQ0r7sottodcGcnncjJcqfCx274owm3KohTKxekkgAfSln1thfwIOyiE9iA0WNLDiRwcPKjlFNmJ-ThWXtR8 Oct 05 02:28:06.613539 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:28:06.613539 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:28:06.613539 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:28:06.613539 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:28:06.613539 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:28:06.613539 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:28:06.613539 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: b85f6bbc881c42489f3f49f57933f6a2 Oct 05 02:28:06.613539 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1491975325 Oct 05 02:28:06.613539 n-d-858272-3 devstack@n-api.service[122319]: X-Role: admin,member,reader Oct 05 02:28:06.613539 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: admin,member,reader Oct 05 02:28:06.615401 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b85f6bbc881c42489f3f49f57933f6a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b85f6bbc881c42489f3f49f57933f6a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b85f6bbc881c42489f3f49f57933f6a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b85f6bbc881c42489f3f49f57933f6a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:06.615401 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1491975325 Oct 05 02:28:06.615401 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: b85f6bbc881c42489f3f49f57933f6a2 Oct 05 02:28:06.615401 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1491975325 Oct 05 02:28:06.615401 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-HostsAdminNegativeTestJSON-1491975325-project-admin Oct 05 02:28:06.615401 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:28:06.615401 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:28:06.615401 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 7a95981ee6314d76bbf361b194d67cb7 Oct 05 02:28:06.615401 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1491975325-project-admin Oct 05 02:28:06.615401 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:28:06.615401 n-d-858272-3 devstack@n-api.service[122319]: {"status": null, "maintenance_mode": null} Oct 05 02:28:06.615401 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:28:06.615401 n-d-858272-3 devstack@n-api.service[122319]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 05 02:28:06.615401 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'n-d-858272-3', 'body': {'status': None, 'maintenance_mode': None}} Oct 05 02:28:06.616342 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:06.616342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.616342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:28:06.616342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:28:06.616342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:28:06.616342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:28:06.616342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 05 02:28:06.616342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.616342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 05 02:28:06.616342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 05 02:28:06.616342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'disable', Oct 05 02:28:06.616342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'Enable', Oct 05 02:28:06.616342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'Disable', Oct 05 02:28:06.616342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 05 02:28:06.616342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 05 02:28:06.616342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 05 02:28:06.616342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.616342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi On instance: Oct 05 02:28:06.616342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi None Oct 05 02:28:06.616342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.616342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:06.616342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.616342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.616342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:06.616342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:06.618002 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:06.618002 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:06.618002 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:28:06.618002 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:28:06.618002 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:06.618002 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:06.618002 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 02:28:06.618002 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 02:28:06.618002 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:28:06.618002 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:28:06.618002 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:28:06.618002 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:28:06.618002 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 05 02:28:06.618002 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.618002 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:06.618002 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.618002 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.618002 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:06.618002 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:06.619078 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:28:06.619078 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:28:06.619078 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 05 02:28:06.619078 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.621329 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a1cfbf2d-c203-4efd-b678-e506e6ec806a tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:06.623287 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a1cfbf2d-c203-4efd-b678-e506e6ec806a tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-858272-3" status: 400 len: 127 microversion: 2.1 time: 0.022752 Oct 05 02:28:06.626036 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 208/401] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Oct 5 02:28:06 2022] PUT /compute/v2.1/os-hosts/n-d-858272-3 => generated 127 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:28:06.636966 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a7fbb969-54af-4e12-a6dd-d96b1d8519c0 tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] Action: 'update', calling method: .version_select at 0x7fcce463fa60>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:06.651620 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.hosts [None req-a7fbb969-54af-4e12-a6dd-d96b1d8519c0 tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] Enabling host nonexistent_hostname. Oct 05 02:28:06.661014 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-a7fbb969-54af-4e12-a6dd-d96b1d8519c0 tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 02:28:06.662953 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a7fbb969-54af-4e12-a6dd-d96b1d8519c0 tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] Request method failure captured: Oct 05 02:28:06.662953 n-d-858272-3 devstack@n-api.service[122319]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 05 02:28:06.662953 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:28:06.662953 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:28:06.662953 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:28:06.662953 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 50 Oct 05 02:28:06.662953 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:28:06.662953 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:28:06.662953 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:28:06.662953 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:06.662953 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOu0LQyYpo4TeE8hMqng62ImVBNhwv0kFVVqKZwlTKbADLWTMuu_MvqEgW43734V8gvEfM30LMIPvZ4tfGm9lAsRKFzDQ0r7sottodcGcnncjJcqfCx274owm3KohTKxekkgAfSln1thfwIOyiE9iA0WNLDiRwcPKjlFNmJ-ThWXtR8 Oct 05 02:28:06.662953 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:28:06.662953 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:28:06.662953 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:28:06.662953 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:28:06.662953 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:28:06.662953 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:28:06.662953 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: b85f6bbc881c42489f3f49f57933f6a2 Oct 05 02:28:06.662953 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1491975325 Oct 05 02:28:06.662953 n-d-858272-3 devstack@n-api.service[122319]: X-Role: admin,member,reader Oct 05 02:28:06.662953 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: admin,member,reader Oct 05 02:28:06.664297 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b85f6bbc881c42489f3f49f57933f6a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b85f6bbc881c42489f3f49f57933f6a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b85f6bbc881c42489f3f49f57933f6a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b85f6bbc881c42489f3f49f57933f6a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:06.664297 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1491975325 Oct 05 02:28:06.664297 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: b85f6bbc881c42489f3f49f57933f6a2 Oct 05 02:28:06.664297 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1491975325 Oct 05 02:28:06.664297 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-HostsAdminNegativeTestJSON-1491975325-project-admin Oct 05 02:28:06.664297 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:28:06.664297 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:28:06.664297 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 7a95981ee6314d76bbf361b194d67cb7 Oct 05 02:28:06.664297 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1491975325-project-admin Oct 05 02:28:06.664297 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:28:06.664297 n-d-858272-3 devstack@n-api.service[122319]: {"status": "enable", "maintenance_mode": "enable"} Oct 05 02:28:06.664297 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:28:06.664297 n-d-858272-3 devstack@n-api.service[122319]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 02:28:06.664297 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 05 02:28:06.665217 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:06.665217 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.665217 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 05 02:28:06.665217 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 05 02:28:06.665217 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 05 02:28:06.665217 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 05 02:28:06.665217 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:28:06.665217 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:28:06.665217 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:28:06.665217 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:28:06.665217 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 05 02:28:06.665217 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 05 02:28:06.665217 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 05 02:28:06.665217 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 05 02:28:06.665217 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:28:06.665217 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:28:06.665217 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 05 02:28:06.665217 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 05 02:28:06.666189 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 02:28:06.666189 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 02:28:06.666189 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 05 02:28:06.666189 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 05 02:28:06.666189 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 02:28:06.666189 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.666189 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:06.666189 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.666189 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.666189 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:06.666189 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:06.666189 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:06.666189 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:06.666189 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:28:06.666189 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:28:06.666189 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:06.666189 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:06.666189 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:28:06.666189 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:28:06.666189 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 05 02:28:06.667318 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 05 02:28:06.667318 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 05 02:28:06.667318 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:28:06.667318 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 02:28:06.667318 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.667318 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:06.667318 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.667318 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:06.667318 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:06.667318 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:06.667318 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:28:06.667318 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:28:06.667318 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 02:28:06.667318 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:06.667318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a7fbb969-54af-4e12-a6dd-d96b1d8519c0 tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:06.668185 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a7fbb969-54af-4e12-a6dd-d96b1d8519c0 tempest-HostsAdminNegativeTestJSON-1491975325 tempest-HostsAdminNegativeTestJSON-1491975325-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.032250 Oct 05 02:28:06.668185 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 209/402] 10.222.0.16 () {60 vars in 1211 bytes} [Wed Oct 5 02:28:06 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 05 02:28:08.273483 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:09.391273 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fff250d4-bb5b-40e0-afd0-b31c9955dc8c tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad/action" status: 202 len: 0 microversion: 2.25 time: 7.139434 Oct 05 02:28:09.393224 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 194/403] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 5 02:28:02 2022] POST /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad/action => generated 0 bytes in 7142 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:28:09.410214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a8df3cdb-590d-46a9-a0d8-ce9da7dc95c2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:09.411460 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a8df3cdb-590d-46a9-a0d8-ce9da7dc95c2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:09.438517 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8df3cdb-590d-46a9-a0d8-ce9da7dc95c2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:09.440566 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8df3cdb-590d-46a9-a0d8-ce9da7dc95c2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:09.442655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8df3cdb-590d-46a9-a0d8-ce9da7dc95c2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:09.447481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8df3cdb-590d-46a9-a0d8-ce9da7dc95c2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:09.450463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8df3cdb-590d-46a9-a0d8-ce9da7dc95c2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:09.451089 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8df3cdb-590d-46a9-a0d8-ce9da7dc95c2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:09.483334 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0dabbe6b-5494-4d08-8825-fb0fdcc0efe4 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Action: 'create', calling method: .version_select at 0x7fcce4870ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1507005131", "description": "tempest-description-2037679959"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:10.327391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a8df3cdb-590d-46a9-a0d8-ce9da7dc95c2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:10.351148 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a8df3cdb-590d-46a9-a0d8-ce9da7dc95c2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:10.356499 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a8df3cdb-590d-46a9-a0d8-ce9da7dc95c2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:10.357753 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a8df3cdb-590d-46a9-a0d8-ce9da7dc95c2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 200 len: 1567 microversion: 2.25 time: 0.960063 Oct 05 02:28:10.363763 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 195/404] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:28:09 2022] GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 1567 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:28:10.426276 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0dabbe6b-5494-4d08-8825-fb0fdcc0efe4 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.731029 Oct 05 02:28:10.426842 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 210/405] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 5 02:28:08 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:28:10.441285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ab3aabc0-fe86-4f7b-ae2c-92545987680d tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Action: 'create', calling method: .version_select at 0x7fcce4595a60>, body: {"security_group_rule": {"parent_group_id": "d2421dfd-65ee-49fe-a2d6-87b91588f787", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:11.033860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5e7747d5-9bb5-4ad2-90a1-e488d202b495 tempest-KeyPairsV210TestJSON-1252521421 tempest-KeyPairsV210TestJSON-1252521421-project-admin] Action: 'create', calling method: .version_select at 0x7fcce45afdc0>, body: {"keypair": {"name": "tempest-keypair-116346057", "type": "ssh", "user_id": "9818a590441c42d1a924fb2daf4323d2", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEf6VsQqz87FwEPUVKAW0hxKNs5jHpaClh8Gq6DL9BF2HB9ZNldSfxWHnsF7Rc4Od+5W7kX5VJi+ELNSrss9D7qohvbO3GQj5sdWvtZTQWCw1qwJFHiPHzL826XEBYnjtg=="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:11.108453 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-5e7747d5-9bb5-4ad2-90a1-e488d202b495 tempest-KeyPairsV210TestJSON-1252521421 tempest-KeyPairsV210TestJSON-1252521421-project-admin] Getting quotas for project 0d729f232d2f4815828d4233636e76f2. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:28:11.126971 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-5e7747d5-9bb5-4ad2-90a1-e488d202b495 tempest-KeyPairsV210TestJSON-1252521421 tempest-KeyPairsV210TestJSON-1252521421-project-admin] Getting quotas for user 2624f848646e4beabd8f88006cee96d9 and project 0d729f232d2f4815828d4233636e76f2. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:28:11.192993 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5e7747d5-9bb5-4ad2-90a1-e488d202b495 tempest-KeyPairsV210TestJSON-1252521421 tempest-KeyPairsV210TestJSON-1252521421-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.825743 Oct 05 02:28:11.195289 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 196/406] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Oct 5 02:28:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 829 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 05 02:28:11.213109 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5567f1dd-a13f-4439-b159-c7be7bbe0aaf tempest-KeyPairsV210TestJSON-1252521421 tempest-KeyPairsV210TestJSON-1252521421-project-admin] Action: 'create', calling method: .version_select at 0x7fcce45af5e0>, body: {"keypair": {"name": "tempest-keypair-1998436329", "type": "ssh", "user_id": "9818a590441c42d1a924fb2daf4323d2", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBF421daefUYCi6HXKnLEJiFPlDce5b5BCRbSfH0OaMagpxBnXr90wJYkEoiVFtWN9fj0/qpDIfE0rFuQe6F3XyvzzdY3szhMTRqpOD0o/aCVwgxKKUVitJM6QEYGZaKUQ=="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:11.280871 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-5567f1dd-a13f-4439-b159-c7be7bbe0aaf tempest-KeyPairsV210TestJSON-1252521421 tempest-KeyPairsV210TestJSON-1252521421-project-admin] Getting quotas for project 0d729f232d2f4815828d4233636e76f2. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:28:11.285624 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ab3aabc0-fe86-4f7b-ae2c-92545987680d tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.849024 Oct 05 02:28:11.286819 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 211/407] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 5 02:28:10 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:28:11.298553 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8c02a2fb-df5b-4c82-b5d8-6ea940757e45 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Action: 'create', calling method: .version_select at 0x7fcce4595310>, body: {"security_group_rule": {"parent_group_id": "d2421dfd-65ee-49fe-a2d6-87b91588f787", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:11.315917 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-5567f1dd-a13f-4439-b159-c7be7bbe0aaf tempest-KeyPairsV210TestJSON-1252521421 tempest-KeyPairsV210TestJSON-1252521421-project-admin] Getting quotas for user 2624f848646e4beabd8f88006cee96d9 and project 0d729f232d2f4815828d4233636e76f2. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:28:11.381260 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5567f1dd-a13f-4439-b159-c7be7bbe0aaf tempest-KeyPairsV210TestJSON-1252521421 tempest-KeyPairsV210TestJSON-1252521421-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.165562 Oct 05 02:28:11.382722 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 197/408] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Oct 5 02:28:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 179 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 05 02:28:11.389242 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-afc84de6-7834-4d4a-b0cc-9738336c5a14 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:11.390916 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-afc84de6-7834-4d4a-b0cc-9738336c5a14 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:11.406375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afc84de6-7834-4d4a-b0cc-9738336c5a14 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:11.407135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afc84de6-7834-4d4a-b0cc-9738336c5a14 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:11.408139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afc84de6-7834-4d4a-b0cc-9738336c5a14 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:11.409695 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afc84de6-7834-4d4a-b0cc-9738336c5a14 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:11.410500 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afc84de6-7834-4d4a-b0cc-9738336c5a14 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:11.411231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afc84de6-7834-4d4a-b0cc-9738336c5a14 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:11.506041 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-8c02a2fb-df5b-4c82-b5d8-6ea940757e45 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] HTTP exception thrown: This rule already exists in group d2421dfd-65ee-49fe-a2d6-87b91588f787 Oct 05 02:28:11.508978 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8c02a2fb-df5b-4c82-b5d8-6ea940757e45 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Request method failure captured: Oct 05 02:28:11.508978 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 05 02:28:11.508978 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:28:11.508978 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:28:11.508978 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:28:11.508978 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 138 Oct 05 02:28:11.508978 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:28:11.508978 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:28:11.508978 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:28:11.508978 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:11.508978 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOu4QRzql4neZ-qv2EOSBOO1t6F4FqBz_ygI562BWLQGQsRxIxBIAYwwtpX2Bb4qKYGPlnnrolPzhgvfy5kH7bP5hoO4zHmLFmTT8FksiUyycNW-LOXBcaX72rz31OileJ-QSl1XVJCe63dPkyPsGpdvmRU4EeP9AQHj76oi2k0Qz7U Oct 05 02:28:11.508978 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:28:11.508978 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:28:11.508978 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:28:11.508978 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:28:11.508978 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:28:11.508978 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:28:11.508978 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: d3873ebc54394a6d8684fb95f30247fa Oct 05 02:28:11.508978 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-593482215 Oct 05 02:28:11.508978 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:28:11.508978 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:28:11.510287 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d3873ebc54394a6d8684fb95f30247fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d3873ebc54394a6d8684fb95f30247fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d3873ebc54394a6d8684fb95f30247fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d3873ebc54394a6d8684fb95f30247fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:11.510287 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-593482215 Oct 05 02:28:11.510287 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: d3873ebc54394a6d8684fb95f30247fa Oct 05 02:28:11.510287 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-593482215 Oct 05 02:28:11.510287 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-593482215-project Oct 05 02:28:11.510287 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:28:11.510287 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:28:11.510287 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: f59ec872768d453a94a0dc3accf81642 Oct 05 02:28:11.510287 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-593482215-project Oct 05 02:28:11.510287 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:28:11.510287 n-d-858272-3 devstack@n-api.service[122319]: {"security_group_rule": {"parent_group_id": "d2421dfd-65ee-49fe-a2d6-87b91588f787", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 05 02:28:11.510287 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:28:11.512068 n-d-858272-3 devstack@n-api.service[122319]: exception: This rule already exists in group d2421dfd-65ee-49fe-a2d6-87b91588f787 Oct 05 02:28:11.512068 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd2421dfd-65ee-49fe-a2d6-87b91588f787', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 05 02:28:11.512068 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:11.512068 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:11.512068 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 05 02:28:11.512068 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 05 02:28:11.512068 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 05 02:28:11.512068 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 05 02:28:11.512068 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group d2421dfd-65ee-49fe-a2d6-87b91588f787 Oct 05 02:28:11.512068 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:11.512068 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:11.512068 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:11.512068 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:11.512068 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:11.512068 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:11.512068 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:11.512068 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:11.512068 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:28:11.512068 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:28:11.512068 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:11.513451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:11.513451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 05 02:28:11.513451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 05 02:28:11.513451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group d2421dfd-65ee-49fe-a2d6-87b91588f787 Oct 05 02:28:11.513451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:11.513451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:11.513451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:11.513451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:11.513451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:11.513451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:11.513451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:28:11.513451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:28:11.513451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group d2421dfd-65ee-49fe-a2d6-87b91588f787 Oct 05 02:28:11.513451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:11.513451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8c02a2fb-df5b-4c82-b5d8-6ea940757e45 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Returning 400 to user: This rule already exists in group d2421dfd-65ee-49fe-a2d6-87b91588f787 {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:11.515295 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8c02a2fb-df5b-4c82-b5d8-6ea940757e45 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.216055 Oct 05 02:28:11.515295 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 212/409] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 5 02:28:11 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 217 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 05 02:28:11.522520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-503dbb8c-f65f-47a3-aa4b-20230dcca2ad tempest-KeyPairsV210TestJSON-1252521421 tempest-KeyPairsV210TestJSON-1252521421-project-admin] Calling method '.version_select at 0x7fcce459fca0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:11.553173 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-503dbb8c-f65f-47a3-aa4b-20230dcca2ad tempest-KeyPairsV210TestJSON-1252521421 tempest-KeyPairsV210TestJSON-1252521421-project-admin] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-116346057?user_id=9818a590441c42d1a924fb2daf4323d2" status: 200 len: 511 microversion: 2.10 time: 0.040099 Oct 05 02:28:11.563550 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 213/410] 10.222.0.16 () {60 vars in 1337 bytes} [Wed Oct 5 02:28:11 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-116346057?user_id=9818a590441c42d1a924fb2daf4323d2 => generated 511 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:28:11.582051 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9297039f-be63-4962-b642-dce0473bcf77 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Calling method '.version_select at 0x7fcce459faf0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:11.606328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=48,nova_cell0:UPDATE=12 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:11.875801 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-afc84de6-7834-4d4a-b0cc-9738336c5a14 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:11.892840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-afc84de6-7834-4d4a-b0cc-9738336c5a14 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:11.896014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-afc84de6-7834-4d4a-b0cc-9738336c5a14 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:11.900716 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-afc84de6-7834-4d4a-b0cc-9738336c5a14 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 200 len: 1567 microversion: 2.25 time: 0.513253 Oct 05 02:28:11.901373 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 198/411] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:28:11 2022] GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 1567 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:28:11.930037 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5130f335-a3b7-4ef0-8f89-2d39589270ec tempest-KeyPairsV210TestJSON-1252521421 tempest-KeyPairsV210TestJSON-1252521421-project-admin] Action: 'create', calling method: .version_select at 0x7fcce43e1040>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-434010135", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmVI6KB9Lguw2rg8dWX1e85XxQO/6WlUrWINnAehl3OvEFA7HyxTMaW6K8y+7AA+sq4+iz/qAHEtvwFeuhXTJ680TCHOnJ6Y6uLzYAOUxEUl91KBip95isb9HLG2Xl4mQ=="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:11.969496 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-5130f335-a3b7-4ef0-8f89-2d39589270ec tempest-KeyPairsV210TestJSON-1252521421 tempest-KeyPairsV210TestJSON-1252521421-project-admin] Getting quotas for project 0d729f232d2f4815828d4233636e76f2. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:28:11.977291 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-5130f335-a3b7-4ef0-8f89-2d39589270ec tempest-KeyPairsV210TestJSON-1252521421 tempest-KeyPairsV210TestJSON-1252521421-project-admin] Getting quotas for user 2624f848646e4beabd8f88006cee96d9 and project 0d729f232d2f4815828d4233636e76f2. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:28:12.024254 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5130f335-a3b7-4ef0-8f89-2d39589270ec tempest-KeyPairsV210TestJSON-1252521421 tempest-KeyPairsV210TestJSON-1252521421-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.104749 Oct 05 02:28:12.025498 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 199/412] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Oct 5 02:28:11 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 124 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 05 02:28:12.043867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-eb84f6b8-bdac-4a96-a341-504cc9efe843 tempest-KeyPairsV210TestJSON-1252521421 tempest-KeyPairsV210TestJSON-1252521421-project-admin] Calling method '.version_select at 0x7fcce444d940>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:12.056557 n-d-858272-3 devstack@n-api.service[122320]: WARNING oslo_db.sqlalchemy.utils [None req-eb84f6b8-bdac-4a96-a341-504cc9efe843 tempest-KeyPairsV210TestJSON-1252521421 tempest-KeyPairsV210TestJSON-1252521421-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 05 02:28:12.075938 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-eb84f6b8-bdac-4a96-a341-504cc9efe843 tempest-KeyPairsV210TestJSON-1252521421 tempest-KeyPairsV210TestJSON-1252521421-project-admin] 10.222.0.16 "GET /compute/v2.1/os-keypairs?user_id=9818a590441c42d1a924fb2daf4323d2" status: 200 len: 725 microversion: 2.10 time: 0.043287 Oct 05 02:28:12.081089 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 200/413] 10.222.0.16 () {60 vars in 1259 bytes} [Wed Oct 5 02:28:12 2022] GET /compute/v2.1/os-keypairs?user_id=9818a590441c42d1a924fb2daf4323d2 => generated 725 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:28:12.097971 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7f2c0caa-5604-4e39-8b4c-05c1fc63e5ee tempest-KeyPairsV210TestJSON-1252521421 tempest-KeyPairsV210TestJSON-1252521421-project-admin] Calling method '.version_select at 0x7fcce43eadc0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:12.155818 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7f2c0caa-5604-4e39-8b4c-05c1fc63e5ee tempest-KeyPairsV210TestJSON-1252521421 tempest-KeyPairsV210TestJSON-1252521421-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-434010135" status: 204 len: 0 microversion: 2.10 time: 0.063114 Oct 05 02:28:12.161054 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 201/414] 10.222.0.16 () {60 vars in 1322 bytes} [Wed Oct 5 02:28:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-434010135 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 02:28:12.179317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-012f5687-ab13-498e-8323-d270172b33e9 tempest-KeyPairsV210TestJSON-1252521421 tempest-KeyPairsV210TestJSON-1252521421-project-admin] Calling method '.version_select at 0x7fcce45af9d0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:12.198382 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9297039f-be63-4962-b642-dce0473bcf77 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/70a6e8d5-2892-4473-b0e4-0f397342c227" status: 202 len: 0 microversion: 2.1 time: 0.638572 Oct 05 02:28:12.199235 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 214/415] 10.222.0.16 () {58 vars in 1287 bytes} [Wed Oct 5 02:28:11 2022] DELETE /compute/v2.1/os-security-group-rules/70a6e8d5-2892-4473-b0e4-0f397342c227 => generated 0 bytes in 644 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:28:12.217111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-399e6618-b33e-4c56-b51a-e56cd13c8b0c tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Action: 'create', calling method: .version_select at 0x7fcce4607670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1976569819", "description": "tempest-description-480398203"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:12.251657 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-012f5687-ab13-498e-8323-d270172b33e9 tempest-KeyPairsV210TestJSON-1252521421 tempest-KeyPairsV210TestJSON-1252521421-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1998436329?user_id=9818a590441c42d1a924fb2daf4323d2" status: 204 len: 0 microversion: 2.10 time: 0.085495 Oct 05 02:28:12.254794 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 202/416] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 5 02:28:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1998436329?user_id=9818a590441c42d1a924fb2daf4323d2 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 02:28:12.854934 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-399e6618-b33e-4c56-b51a-e56cd13c8b0c tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.650295 Oct 05 02:28:12.856184 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 215/417] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 5 02:28:12 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:28:12.864478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-40c7333d-d2ba-4e57-b25f-f655263a6967 tempest-FlavorMetadataValidation-980447568 tempest-FlavorMetadataValidation-980447568-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-239563938", "id": 381730372, "os-flavor-access:is_public": "True"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:12.869933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-053dcd83-2a24-46a2-8444-3e05f152f128 tempest-KeyPairsV210TestJSON-1252521421 tempest-KeyPairsV210TestJSON-1252521421-project-admin] Calling method '.version_select at 0x7fcce4607af0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:12.933399 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-40c7333d-d2ba-4e57-b25f-f655263a6967 tempest-FlavorMetadataValidation-980447568 tempest-FlavorMetadataValidation-980447568-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.675590 Oct 05 02:28:12.939238 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 203/418] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 5 02:28:12 2022] POST /compute/v2.1/flavors => generated 467 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:28:12.961342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-cc67c004-da52-4081-8091-27ecf7998513 req-c2b3474b-691b-45ae-aee9-830ef205813e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eddae3fc-f975-45e3-8592-01b10bcf32ad", "name": "network-vif-unplugged", "status": "completed", "tag": "76ca6ca5-722f-44bd-ab65-b8f77ef0027e"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:12.963325 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-053dcd83-2a24-46a2-8444-3e05f152f128 tempest-KeyPairsV210TestJSON-1252521421 tempest-KeyPairsV210TestJSON-1252521421-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-116346057?user_id=9818a590441c42d1a924fb2daf4323d2" status: 204 len: 0 microversion: 2.10 time: 0.105432 Oct 05 02:28:12.964610 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 216/419] 10.222.0.16 () {60 vars in 1340 bytes} [Wed Oct 5 02:28:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-116346057?user_id=9818a590441c42d1a924fb2daf4323d2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 02:28:12.976376 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fa949d8d-df32-42d0-9f0a-7188e2b6ebdd tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Action: 'create', calling method: .version_select at 0x7fcce46073a0>, body: {"security_group_rule": {"parent_group_id": "f8be9142-f615-40b4-a0f8-37f510b05661", "ip_protocol": "tcp", "from_port": 868884566, "to_port": 22}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:12.992325 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-cc67c004-da52-4081-8091-27ecf7998513 req-c2b3474b-691b-45ae-aee9-830ef205813e service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:12.994959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-cc67c004-da52-4081-8091-27ecf7998513 req-c2b3474b-691b-45ae-aee9-830ef205813e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:12.995936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-cc67c004-da52-4081-8091-27ecf7998513 req-c2b3474b-691b-45ae-aee9-830ef205813e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:13.010915 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-cc67c004-da52-4081-8091-27ecf7998513 req-c2b3474b-691b-45ae-aee9-830ef205813e service nova] Creating event network-vif-unplugged:76ca6ca5-722f-44bd-ab65-b8f77ef0027e for instance eddae3fc-f975-45e3-8592-01b10bcf32ad on n-h2-858272-3 Oct 05 02:28:13.017663 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-cc67c004-da52-4081-8091-27ecf7998513 req-c2b3474b-691b-45ae-aee9-830ef205813e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065766 Oct 05 02:28:13.019566 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 204/420] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:13.033216 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9456dee2-0f1e-4d76-9a0a-6d7c03870013 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:13.034687 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9456dee2-0f1e-4d76-9a0a-6d7c03870013 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:13.066422 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9456dee2-0f1e-4d76-9a0a-6d7c03870013 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:13.067359 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9456dee2-0f1e-4d76-9a0a-6d7c03870013 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:13.068855 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9456dee2-0f1e-4d76-9a0a-6d7c03870013 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:13.077882 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9456dee2-0f1e-4d76-9a0a-6d7c03870013 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:13.086274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9456dee2-0f1e-4d76-9a0a-6d7c03870013 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:13.086737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9456dee2-0f1e-4d76-9a0a-6d7c03870013 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:13.241700 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-fa949d8d-df32-42d0-9f0a-7188e2b6ebdd tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] HTTP exception thrown: Invalid port range 868884566:22. Former value cannot be greater than the later Oct 05 02:28:13.244841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fa949d8d-df32-42d0-9f0a-7188e2b6ebdd tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Request method failure captured: Oct 05 02:28:13.244841 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 05 02:28:13.244841 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:28:13.244841 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:28:13.244841 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:28:13.244841 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 145 Oct 05 02:28:13.244841 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:28:13.244841 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:28:13.244841 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:28:13.244841 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:13.244841 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOu4QRzql4neZ-qv2EOSBOO1t6F4FqBz_ygI562BWLQGQsRxIxBIAYwwtpX2Bb4qKYGPlnnrolPzhgvfy5kH7bP5hoO4zHmLFmTT8FksiUyycNW-LOXBcaX72rz31OileJ-QSl1XVJCe63dPkyPsGpdvmRU4EeP9AQHj76oi2k0Qz7U Oct 05 02:28:13.244841 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:28:13.244841 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:28:13.244841 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:28:13.244841 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:28:13.244841 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:28:13.244841 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:28:13.244841 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: d3873ebc54394a6d8684fb95f30247fa Oct 05 02:28:13.244841 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-593482215 Oct 05 02:28:13.244841 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:28:13.244841 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:28:13.246335 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d3873ebc54394a6d8684fb95f30247fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d3873ebc54394a6d8684fb95f30247fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d3873ebc54394a6d8684fb95f30247fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d3873ebc54394a6d8684fb95f30247fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:13.246335 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-593482215 Oct 05 02:28:13.246335 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: d3873ebc54394a6d8684fb95f30247fa Oct 05 02:28:13.246335 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-593482215 Oct 05 02:28:13.246335 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-593482215-project Oct 05 02:28:13.246335 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:28:13.246335 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:28:13.246335 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: f59ec872768d453a94a0dc3accf81642 Oct 05 02:28:13.246335 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-593482215-project Oct 05 02:28:13.246335 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:28:13.246335 n-d-858272-3 devstack@n-api.service[122319]: {"security_group_rule": {"parent_group_id": "f8be9142-f615-40b4-a0f8-37f510b05661", "ip_protocol": "tcp", "from_port": 868884566, "to_port": 22}} Oct 05 02:28:13.246335 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:28:13.247405 n-d-858272-3 devstack@n-api.service[122319]: exception: Invalid port range 868884566:22. Former value cannot be greater than the later Oct 05 02:28:13.247405 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f8be9142-f615-40b4-a0f8-37f510b05661', 'ip_protocol': 'tcp', 'from_port': 868884566, 'to_port': 22}}} Oct 05 02:28:13.247405 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:13.247405 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:13.247405 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 05 02:28:13.247405 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 05 02:28:13.247405 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 05 02:28:13.247405 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 05 02:28:13.247405 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 05 02:28:13.247405 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 05 02:28:13.247405 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 05 02:28:13.247405 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 05 02:28:13.247405 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 868884566:22. Former value cannot be greater than the later Oct 05 02:28:13.247405 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:13.247405 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:13.247405 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:13.247405 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:13.247405 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:13.247405 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:13.249321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:13.249321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:13.249321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:28:13.249321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:28:13.249321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:13.249321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:13.249321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 05 02:28:13.249321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 05 02:28:13.249321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 868884566:22. Former value cannot be greater than the later Oct 05 02:28:13.249321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:13.249321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:13.249321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:13.249321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:13.249321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:13.249321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:13.249321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:28:13.249321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:28:13.249321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 868884566:22. Former value cannot be greater than the later Oct 05 02:28:13.249321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:13.251584 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fa949d8d-df32-42d0-9f0a-7188e2b6ebdd tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Returning 400 to user: Invalid port range 868884566:22. Former value cannot be greater than the later {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:13.253148 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fa949d8d-df32-42d0-9f0a-7188e2b6ebdd tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.286754 Oct 05 02:28:13.258598 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 217/421] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 5 02:28:12 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 289 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:28:13.269796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1f2de41b-8302-4437-aba4-7b2c505963b7 tempest-FlavorMetadataValidation-980447568 tempest-FlavorMetadataValidation-980447568-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:13.696895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9456dee2-0f1e-4d76-9a0a-6d7c03870013 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:13.732663 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9456dee2-0f1e-4d76-9a0a-6d7c03870013 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:13.734916 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9456dee2-0f1e-4d76-9a0a-6d7c03870013 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:13.740172 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9456dee2-0f1e-4d76-9a0a-6d7c03870013 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 200 len: 1567 microversion: 2.25 time: 0.717208 Oct 05 02:28:13.744210 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 205/422] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:28:13 2022] GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 1567 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:28:13.763348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cdf328d9-b4a8-44eb-8511-9255c13d4376 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Action: 'create', calling method: .version_select at 0x7fcce44000d0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-672980496", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:13.766372 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-cdf328d9-b4a8-44eb-8511-9255c13d4376 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] HTTP exception thrown: Security group id should be uuid Oct 05 02:28:13.771984 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cdf328d9-b4a8-44eb-8511-9255c13d4376 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Request method failure captured: Oct 05 02:28:13.771984 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 05 02:28:13.771984 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:28:13.771984 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:28:13.771984 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:28:13.771984 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 130 Oct 05 02:28:13.771984 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:28:13.771984 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:28:13.771984 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:28:13.771984 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:13.771984 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOu4QRzql4neZ-qv2EOSBOO1t6F4FqBz_ygI562BWLQGQsRxIxBIAYwwtpX2Bb4qKYGPlnnrolPzhgvfy5kH7bP5hoO4zHmLFmTT8FksiUyycNW-LOXBcaX72rz31OileJ-QSl1XVJCe63dPkyPsGpdvmRU4EeP9AQHj76oi2k0Qz7U Oct 05 02:28:13.771984 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:28:13.771984 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:28:13.771984 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:28:13.771984 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:28:13.771984 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:28:13.771984 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:28:13.771984 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: d3873ebc54394a6d8684fb95f30247fa Oct 05 02:28:13.771984 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-593482215 Oct 05 02:28:13.771984 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:28:13.771984 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:28:13.773584 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d3873ebc54394a6d8684fb95f30247fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d3873ebc54394a6d8684fb95f30247fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d3873ebc54394a6d8684fb95f30247fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d3873ebc54394a6d8684fb95f30247fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:13.773584 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-593482215 Oct 05 02:28:13.773584 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: d3873ebc54394a6d8684fb95f30247fa Oct 05 02:28:13.773584 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-593482215 Oct 05 02:28:13.773584 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-593482215-project Oct 05 02:28:13.773584 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:28:13.773584 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:28:13.773584 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: f59ec872768d453a94a0dc3accf81642 Oct 05 02:28:13.773584 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-593482215-project Oct 05 02:28:13.773584 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:28:13.773584 n-d-858272-3 devstack@n-api.service[122320]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-672980496", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 05 02:28:13.773584 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:28:13.773584 n-d-858272-3 devstack@n-api.service[122320]: exception: Security group id should be uuid Oct 05 02:28:13.774566 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-672980496', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 05 02:28:13.774566 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:13.774566 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:13.774566 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 05 02:28:13.774566 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 05 02:28:13.774566 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 05 02:28:13.774566 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 05 02:28:13.774566 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 05 02:28:13.774566 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:28:13.774566 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:13.774566 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:28:13.774566 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:13.774566 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:13.774566 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:13.774566 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:13.774566 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:13.774566 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:28:13.774566 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:28:13.774566 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:13.774566 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:13.776155 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 05 02:28:13.776155 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 05 02:28:13.776155 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 05 02:28:13.776155 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:28:13.776155 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:13.776155 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:28:13.776155 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:13.776155 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:13.776155 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:13.776155 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:28:13.776155 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:28:13.776155 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 05 02:28:13.776155 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:28:13.780388 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cdf328d9-b4a8-44eb-8511-9255c13d4376 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Returning 400 to user: Security group id should be uuid {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:13.783437 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cdf328d9-b4a8-44eb-8511-9255c13d4376 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.037919 Oct 05 02:28:13.789045 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 206/423] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 5 02:28:13 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:13.807123 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7cb63993-9006-4b51-a700-6f0f20824164 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Action: 'create', calling method: .version_select at 0x7fcce444daf0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1885359977", "description": "tempest-description-394981464"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:13.810803 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1f2de41b-8302-4437-aba4-7b2c505963b7 tempest-FlavorMetadataValidation-980447568 tempest-FlavorMetadataValidation-980447568-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/381730372/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.554991 Oct 05 02:28:13.814662 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 218/424] 10.222.0.16 () {62 vars in 1262 bytes} [Wed Oct 5 02:28:13 2022] POST /compute/v2.1/flavors/381730372/os-extra_specs => generated 62 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:13.836117 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9f183dd0-3163-4ebd-84e1-c4425e99bdd5 tempest-FlavorMetadataValidation-980447568 tempest-FlavorMetadataValidation-980447568-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:13.907089 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9f183dd0-3163-4ebd-84e1-c4425e99bdd5 tempest-FlavorMetadataValidation-980447568 tempest-FlavorMetadataValidation-980447568-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/381730372" status: 202 len: 0 microversion: 2.86 time: 0.079587 Oct 05 02:28:13.910594 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 219/425] 10.222.0.16 () {60 vars in 1199 bytes} [Wed Oct 5 02:28:13 2022] DELETE /compute/v2.1/flavors/381730372 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:28:13.926017 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-99e7bc83-d907-4866-bd4e-08de68c14ae4 tempest-FlavorMetadataValidation-980447568 tempest-FlavorMetadataValidation-980447568-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:14.019649 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-99e7bc83-d907-4866-bd4e-08de68c14ae4 tempest-FlavorMetadataValidation-980447568 tempest-FlavorMetadataValidation-980447568-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.104439 Oct 05 02:28:14.020333 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 220/426] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Oct 5 02:28:13 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:28:14.265655 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7cb63993-9006-4b51-a700-6f0f20824164 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.471130 Oct 05 02:28:14.270851 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 207/427] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 5 02:28:13 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:14.281358 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4da6ce15-2996-4461-b029-0ff8c5482988 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Action: 'create', calling method: .version_select at 0x7fcce4607820>, body: {"security_group_rule": {"parent_group_id": "a5a0048b-d33f-4c88-b8fd-546ce1fa0350", "ip_protocol": "tempest-999-1464240108", "from_port": 22, "to_port": 22}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:14.371143 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-4da6ce15-2996-4461-b029-0ff8c5482988 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] HTTP exception thrown: Invalid IP protocol tempest-999-1464240108. Oct 05 02:28:14.372955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4da6ce15-2996-4461-b029-0ff8c5482988 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Request method failure captured: Oct 05 02:28:14.372955 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 05 02:28:14.372955 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:28:14.372955 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:28:14.372955 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:28:14.372955 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 157 Oct 05 02:28:14.372955 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:28:14.372955 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:28:14.372955 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:28:14.372955 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:14.372955 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOu4QRzql4neZ-qv2EOSBOO1t6F4FqBz_ygI562BWLQGQsRxIxBIAYwwtpX2Bb4qKYGPlnnrolPzhgvfy5kH7bP5hoO4zHmLFmTT8FksiUyycNW-LOXBcaX72rz31OileJ-QSl1XVJCe63dPkyPsGpdvmRU4EeP9AQHj76oi2k0Qz7U Oct 05 02:28:14.372955 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:28:14.372955 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:28:14.372955 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:28:14.372955 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:28:14.372955 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:28:14.372955 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:28:14.372955 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: d3873ebc54394a6d8684fb95f30247fa Oct 05 02:28:14.372955 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-593482215 Oct 05 02:28:14.372955 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:28:14.372955 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:28:14.374248 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d3873ebc54394a6d8684fb95f30247fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d3873ebc54394a6d8684fb95f30247fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d3873ebc54394a6d8684fb95f30247fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d3873ebc54394a6d8684fb95f30247fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:14.374248 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-593482215 Oct 05 02:28:14.374248 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: d3873ebc54394a6d8684fb95f30247fa Oct 05 02:28:14.374248 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-593482215 Oct 05 02:28:14.374248 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-593482215-project Oct 05 02:28:14.374248 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:28:14.374248 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:28:14.374248 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: f59ec872768d453a94a0dc3accf81642 Oct 05 02:28:14.374248 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-593482215-project Oct 05 02:28:14.374248 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:28:14.374248 n-d-858272-3 devstack@n-api.service[122319]: {"security_group_rule": {"parent_group_id": "a5a0048b-d33f-4c88-b8fd-546ce1fa0350", "ip_protocol": "tempest-999-1464240108", "from_port": 22, "to_port": 22}} Oct 05 02:28:14.374248 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:28:14.374961 n-d-858272-3 devstack@n-api.service[122319]: exception: Invalid IP protocol tempest-999-1464240108. Oct 05 02:28:14.374961 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a5a0048b-d33f-4c88-b8fd-546ce1fa0350', 'ip_protocol': 'tempest-999-1464240108', 'from_port': 22, 'to_port': 22}}} Oct 05 02:28:14.374961 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:14.374961 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:14.374961 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 05 02:28:14.374961 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 05 02:28:14.374961 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 05 02:28:14.374961 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 05 02:28:14.374961 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 05 02:28:14.374961 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 05 02:28:14.374961 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 05 02:28:14.374961 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 05 02:28:14.374961 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1464240108. Oct 05 02:28:14.374961 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:14.374961 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:14.374961 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:14.374961 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:14.374961 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:14.374961 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:14.376050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:14.376050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:14.376050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:28:14.376050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:28:14.376050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:14.376050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:14.376050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 05 02:28:14.376050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 05 02:28:14.376050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1464240108. Oct 05 02:28:14.376050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:14.376050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:14.376050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:14.376050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:14.376050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:14.376050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:14.376050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:28:14.376050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:28:14.376050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1464240108. Oct 05 02:28:14.376050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:14.386494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4da6ce15-2996-4461-b029-0ff8c5482988 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Returning 400 to user: Invalid IP protocol tempest-999-1464240108. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:14.389533 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4da6ce15-2996-4461-b029-0ff8c5482988 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.112898 Oct 05 02:28:14.391508 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 221/428] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 5 02:28:14 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:14.403907 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9feb00f3-1534-4d1f-93a2-e3b9035ca770 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Action: 'create', calling method: .version_select at 0x7fcce4ba64c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-955103274", "description": "tempest-description-2029875429"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:14.774948 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-299c51b0-1193-4f23-81ee-120afe1ad52c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:14.775899 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-299c51b0-1193-4f23-81ee-120afe1ad52c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:14.786877 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-299c51b0-1193-4f23-81ee-120afe1ad52c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:14.787817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-299c51b0-1193-4f23-81ee-120afe1ad52c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:14.789273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-299c51b0-1193-4f23-81ee-120afe1ad52c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:14.793151 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-299c51b0-1193-4f23-81ee-120afe1ad52c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:14.794035 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-299c51b0-1193-4f23-81ee-120afe1ad52c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:14.794719 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-299c51b0-1193-4f23-81ee-120afe1ad52c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:14.879332 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9feb00f3-1534-4d1f-93a2-e3b9035ca770 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.480941 Oct 05 02:28:14.880837 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 208/429] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 5 02:28:14 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:14.896659 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-15bac93a-68c1-4eef-be93-8d383ad0c48e tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Action: 'create', calling method: .version_select at 0x7fcce45b70d0>, body: {"security_group_rule": {"parent_group_id": "2ee70e25-7d57-46be-8fb3-b358078b96c9", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:14.997983 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=4 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:15.064344 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-15bac93a-68c1-4eef-be93-8d383ad0c48e tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 05 02:28:15.068322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-15bac93a-68c1-4eef-be93-8d383ad0c48e tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Request method failure captured: Oct 05 02:28:15.068322 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 05 02:28:15.068322 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:28:15.068322 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:28:15.068322 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:28:15.068322 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 138 Oct 05 02:28:15.068322 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:28:15.068322 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:28:15.068322 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:28:15.068322 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:15.068322 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOu4QRzql4neZ-qv2EOSBOO1t6F4FqBz_ygI562BWLQGQsRxIxBIAYwwtpX2Bb4qKYGPlnnrolPzhgvfy5kH7bP5hoO4zHmLFmTT8FksiUyycNW-LOXBcaX72rz31OileJ-QSl1XVJCe63dPkyPsGpdvmRU4EeP9AQHj76oi2k0Qz7U Oct 05 02:28:15.068322 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:28:15.068322 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:28:15.068322 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:28:15.068322 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:28:15.068322 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:28:15.068322 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:28:15.068322 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: d3873ebc54394a6d8684fb95f30247fa Oct 05 02:28:15.068322 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-593482215 Oct 05 02:28:15.068322 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:28:15.068322 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:28:15.070603 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d3873ebc54394a6d8684fb95f30247fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d3873ebc54394a6d8684fb95f30247fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d3873ebc54394a6d8684fb95f30247fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d3873ebc54394a6d8684fb95f30247fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:15.070603 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-593482215 Oct 05 02:28:15.070603 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: d3873ebc54394a6d8684fb95f30247fa Oct 05 02:28:15.070603 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-593482215 Oct 05 02:28:15.070603 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-593482215-project Oct 05 02:28:15.070603 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:28:15.070603 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:28:15.070603 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: f59ec872768d453a94a0dc3accf81642 Oct 05 02:28:15.070603 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-593482215-project Oct 05 02:28:15.070603 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:28:15.070603 n-d-858272-3 devstack@n-api.service[122320]: {"security_group_rule": {"parent_group_id": "2ee70e25-7d57-46be-8fb3-b358078b96c9", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 05 02:28:15.070603 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:28:15.072320 n-d-858272-3 devstack@n-api.service[122320]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 05 02:28:15.072320 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2ee70e25-7d57-46be-8fb3-b358078b96c9', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 05 02:28:15.072320 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:15.072320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:15.072320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 05 02:28:15.072320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 05 02:28:15.072320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 05 02:28:15.072320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 05 02:28:15.072320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 05 02:28:15.072320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 05 02:28:15.072320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 05 02:28:15.072320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 05 02:28:15.072320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 05 02:28:15.072320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:28:15.072320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:15.072320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:28:15.072320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:15.072320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:15.072320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:15.075838 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:15.075838 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:15.075838 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:28:15.075838 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:28:15.075838 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:15.075838 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:15.075838 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 05 02:28:15.075838 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 05 02:28:15.075838 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 05 02:28:15.075838 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:28:15.075838 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:15.075838 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:28:15.075838 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:15.075838 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:15.075838 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:15.075838 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:28:15.075838 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:28:15.075838 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 05 02:28:15.075838 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:28:15.079200 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-15bac93a-68c1-4eef-be93-8d383ad0c48e tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:15.080710 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-15bac93a-68c1-4eef-be93-8d383ad0c48e tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.188570 Oct 05 02:28:15.082119 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 209/430] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 5 02:28:14 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 192 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:28:15.113099 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-84955d56-9d7e-4d5f-9b0c-8f502f11baf3 req-f6ea89ad-28a0-4dce-8ed5-3592e33b68ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eddae3fc-f975-45e3-8592-01b10bcf32ad", "tag": "76ca6ca5-722f-44bd-ab65-b8f77ef0027e"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:15.161229 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-84955d56-9d7e-4d5f-9b0c-8f502f11baf3 req-f6ea89ad-28a0-4dce-8ed5-3592e33b68ec service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:15.165083 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-84955d56-9d7e-4d5f-9b0c-8f502f11baf3 req-f6ea89ad-28a0-4dce-8ed5-3592e33b68ec service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:15.167267 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-84955d56-9d7e-4d5f-9b0c-8f502f11baf3 req-f6ea89ad-28a0-4dce-8ed5-3592e33b68ec service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:15.202028 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-84955d56-9d7e-4d5f-9b0c-8f502f11baf3 req-f6ea89ad-28a0-4dce-8ed5-3592e33b68ec service nova] Creating event network-changed:76ca6ca5-722f-44bd-ab65-b8f77ef0027e for instance eddae3fc-f975-45e3-8592-01b10bcf32ad on n-h2-858272-3 Oct 05 02:28:15.220760 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-84955d56-9d7e-4d5f-9b0c-8f502f11baf3 req-f6ea89ad-28a0-4dce-8ed5-3592e33b68ec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137051 Oct 05 02:28:15.222146 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 210/431] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:15.231318 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-687b38ea-3c7b-4268-b998-cee14899a8bb tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Action: 'create', calling method: .version_select at 0x7fcce444ddc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1810904805", "description": "tempest-description-2099538978"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:15.833760 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-299c51b0-1193-4f23-81ee-120afe1ad52c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:15.848850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-299c51b0-1193-4f23-81ee-120afe1ad52c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:15.861232 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-299c51b0-1193-4f23-81ee-120afe1ad52c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:15.868086 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-299c51b0-1193-4f23-81ee-120afe1ad52c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 200 len: 1567 microversion: 2.25 time: 1.096148 Oct 05 02:28:15.870928 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 222/432] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:28:14 2022] GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 1567 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:28:16.336878 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-687b38ea-3c7b-4268-b998-cee14899a8bb tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.113083 Oct 05 02:28:16.348243 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 211/433] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 5 02:28:15 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:16.898422 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bfd72ebd-6beb-4278-bf6e-ab420218a028 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1338993717", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:17.051561 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2510c8ee-ddcc-4471-b3b6-2c657bc1ac3d tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Calling method '.version_select at 0x7fcce435b280>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:17.068864 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-bfd72ebd-6beb-4278-bf6e-ab420218a028 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] validate_networks() for None {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:28:17.473956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-bfd72ebd-6beb-4278-bf6e-ab420218a028 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:28:17.474970 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-bfd72ebd-6beb-4278-bf6e-ab420218a028 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:28:17.475450 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-bfd72ebd-6beb-4278-bf6e-ab420218a028 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:28:17.475855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-bfd72ebd-6beb-4278-bf6e-ab420218a028 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:28:17.476634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-bfd72ebd-6beb-4278-bf6e-ab420218a028 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:28:17.515840 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bfd72ebd-6beb-4278-bf6e-ab420218a028 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:17.519766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bfd72ebd-6beb-4278-bf6e-ab420218a028 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:17.520205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bfd72ebd-6beb-4278-bf6e-ab420218a028 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:17.521701 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bfd72ebd-6beb-4278-bf6e-ab420218a028 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:17.522564 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bfd72ebd-6beb-4278-bf6e-ab420218a028 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:17.523007 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bfd72ebd-6beb-4278-bf6e-ab420218a028 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:17.563893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-bfd72ebd-6beb-4278-bf6e-ab420218a028 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Getting quotas for project 10beeb5ff94e4c9c9c8b801fd3c56c66. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:28:17.571121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=75,nova_api:UPDATE=13,nova_api:DELETE=4,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:17.575357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-bfd72ebd-6beb-4278-bf6e-ab420218a028 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Getting quotas for user 3175c74d670a49e0a7efff04e7d4e9a0 and project 10beeb5ff94e4c9c9c8b801fd3c56c66. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:28:17.603253 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bfd72ebd-6beb-4278-bf6e-ab420218a028 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:28:17.606718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bfd72ebd-6beb-4278-bf6e-ab420218a028 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] [instance: a78fb515-3979-4134-928b-9552c036e8b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:28:17.734625 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bfd72ebd-6beb-4278-bf6e-ab420218a028 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.793432 Oct 05 02:28:17.738272 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 223/434] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:28:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:28:17.765076 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4c675f44-4439-42c3-bb68-ba9e708036b1 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Action: 'create', calling method: .version_select at 0x7fcce45de820>, body: {"security_group_rule": {"parent_group_id": "72b49f45-598b-40c0-a73c-758616976993", "ip_protocol": "tcp", "from_port": 22, "to_port": 1995953647}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:17.897220 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-4c675f44-4439-42c3-bb68-ba9e708036b1 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] HTTP exception thrown: Invalid port range 22:1995953647. Valid TCP ports should be between 1-65535 Oct 05 02:28:17.899079 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4c675f44-4439-42c3-bb68-ba9e708036b1 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Request method failure captured: Oct 05 02:28:17.899079 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 05 02:28:17.899079 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:28:17.899079 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:28:17.899079 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:28:17.899079 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 146 Oct 05 02:28:17.899079 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:28:17.899079 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:28:17.899079 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:28:17.899079 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:17.899079 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOu4QRzql4neZ-qv2EOSBOO1t6F4FqBz_ygI562BWLQGQsRxIxBIAYwwtpX2Bb4qKYGPlnnrolPzhgvfy5kH7bP5hoO4zHmLFmTT8FksiUyycNW-LOXBcaX72rz31OileJ-QSl1XVJCe63dPkyPsGpdvmRU4EeP9AQHj76oi2k0Qz7U Oct 05 02:28:17.899079 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:28:17.899079 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:28:17.899079 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:28:17.899079 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:28:17.899079 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:28:17.899079 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:28:17.899079 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: d3873ebc54394a6d8684fb95f30247fa Oct 05 02:28:17.899079 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-593482215 Oct 05 02:28:17.899079 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:28:17.899079 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:28:17.900879 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d3873ebc54394a6d8684fb95f30247fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d3873ebc54394a6d8684fb95f30247fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d3873ebc54394a6d8684fb95f30247fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d3873ebc54394a6d8684fb95f30247fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:17.900879 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-593482215 Oct 05 02:28:17.900879 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: d3873ebc54394a6d8684fb95f30247fa Oct 05 02:28:17.900879 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-593482215 Oct 05 02:28:17.900879 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-593482215-project Oct 05 02:28:17.900879 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:28:17.900879 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:28:17.900879 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: f59ec872768d453a94a0dc3accf81642 Oct 05 02:28:17.900879 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-593482215-project Oct 05 02:28:17.900879 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:28:17.900879 n-d-858272-3 devstack@n-api.service[122319]: {"security_group_rule": {"parent_group_id": "72b49f45-598b-40c0-a73c-758616976993", "ip_protocol": "tcp", "from_port": 22, "to_port": 1995953647}} Oct 05 02:28:17.900879 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:28:17.901724 n-d-858272-3 devstack@n-api.service[122319]: exception: Invalid port range 22:1995953647. Valid TCP ports should be between 1-65535 Oct 05 02:28:17.901724 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'body': {'security_group_rule': {'parent_group_id': '72b49f45-598b-40c0-a73c-758616976993', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1995953647}}} Oct 05 02:28:17.901724 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:17.901724 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:17.901724 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 05 02:28:17.901724 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 05 02:28:17.901724 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 05 02:28:17.901724 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 05 02:28:17.901724 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 05 02:28:17.901724 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 05 02:28:17.901724 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 05 02:28:17.901724 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 05 02:28:17.901724 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1995953647. Valid TCP ports should be between 1-65535 Oct 05 02:28:17.901724 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:17.901724 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:17.901724 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:17.901724 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:17.901724 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:17.901724 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:17.902807 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:17.902807 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:17.902807 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:28:17.902807 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:28:17.902807 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:17.902807 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:17.902807 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 05 02:28:17.902807 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 05 02:28:17.902807 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1995953647. Valid TCP ports should be between 1-65535 Oct 05 02:28:17.902807 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:17.902807 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:17.902807 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:17.902807 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:17.902807 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:17.902807 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:17.902807 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:28:17.902807 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:28:17.902807 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1995953647. Valid TCP ports should be between 1-65535 Oct 05 02:28:17.902807 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:17.905542 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4c675f44-4439-42c3-bb68-ba9e708036b1 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Returning 400 to user: Invalid port range 22:1995953647. Valid TCP ports should be between 1-65535 {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:17.906509 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4c675f44-4439-42c3-bb68-ba9e708036b1 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.166998 Oct 05 02:28:17.907198 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 224/435] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 5 02:28:17 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 168 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:28:17.925319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3d795cbc-4286-4a0a-866b-f70276cee88a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:17.925319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3d795cbc-4286-4a0a-866b-f70276cee88a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:17.936463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3d795cbc-4286-4a0a-866b-f70276cee88a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:17.937706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3d795cbc-4286-4a0a-866b-f70276cee88a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:17.939397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3d795cbc-4286-4a0a-866b-f70276cee88a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:17.943133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3d795cbc-4286-4a0a-866b-f70276cee88a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:17.944804 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3d795cbc-4286-4a0a-866b-f70276cee88a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:17.945767 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3d795cbc-4286-4a0a-866b-f70276cee88a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:18.081125 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2510c8ee-ddcc-4471-b3b6-2c657bc1ac3d tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/42d0dcc9c5664f0d9a9cbc402cc50ed5" status: 200 len: 371 microversion: 2.1 time: 1.716484 Oct 05 02:28:18.083387 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 212/436] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 5 02:28:16 2022] GET /compute/v2.1/os-quota-sets/42d0dcc9c5664f0d9a9cbc402cc50ed5 => generated 371 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:18.094736 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-adeab3da-a626-4afb-aa30-f4ed60a62bfc tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:18.100933 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-adeab3da-a626-4afb-aa30-f4ed60a62bfc tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] [instance: a78fb515-3979-4134-928b-9552c036e8b2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:18.211276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-adeab3da-a626-4afb-aa30-f4ed60a62bfc tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3175c74d670a49e0a7efff04e7d4e9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10beeb5ff94e4c9c9c8b801fd3c56c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:18.223498 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-adeab3da-a626-4afb-aa30-f4ed60a62bfc tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] 10.222.0.16 "GET /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2" status: 200 len: 1214 microversion: 2.1 time: 0.138117 Oct 05 02:28:18.224087 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 213/437] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:18 2022] GET /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2 => generated 1214 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:18.228809 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1e5085a8-4024-45e3-aec8-a795828c9c0a tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Action: 'create', calling method: .version_select at 0x7fcce43b6ca0>, body: {"security_group_rule": {"parent_group_id": "d76c54d2-d18d-4871-ae05-a0d5a8831587", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:18.269209 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3d795cbc-4286-4a0a-866b-f70276cee88a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:18.277668 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3d795cbc-4286-4a0a-866b-f70276cee88a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:18.279115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3d795cbc-4286-4a0a-866b-f70276cee88a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:18.280317 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3d795cbc-4286-4a0a-866b-f70276cee88a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 200 len: 1567 microversion: 2.25 time: 0.372076 Oct 05 02:28:18.280813 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 225/438] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:28:17 2022] GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 1567 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:28:18.316013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3a4c6828-8ac1-4957-8ee3-cdbd2f2b25dc tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Action: 'update', calling method: .version_select at 0x7fcce459f8b0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:18.859983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG neutronclient.v2_0.client [None req-1e5085a8-4024-45e3-aec8-a795828c9c0a tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d76c54d2-d18d-4871-ae05-a0d5a8831587 does not exist", "detail": ""}} {{(pid=122320) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 02:28:18.860734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.security_group_api [None req-1e5085a8-4024-45e3-aec8-a795828c9c0a tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Neutron security group d76c54d2-d18d-4871-ae05-a0d5a8831587 not found {{(pid=122320) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 05 02:28:18.861387 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-1e5085a8-4024-45e3-aec8-a795828c9c0a tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] HTTP exception thrown: Security group d76c54d2-d18d-4871-ae05-a0d5a8831587 does not exist Oct 05 02:28:18.861387 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-18a43408-7cb0-4c29-9c29-602c5bec93c6'] Oct 05 02:28:18.865266 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1e5085a8-4024-45e3-aec8-a795828c9c0a tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Request method failure captured: Oct 05 02:28:18.865266 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 05 02:28:18.865266 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:28:18.865266 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:28:18.865266 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:28:18.865266 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 138 Oct 05 02:28:18.865266 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:28:18.865266 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:28:18.865266 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:28:18.865266 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:18.865266 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOu4QRzql4neZ-qv2EOSBOO1t6F4FqBz_ygI562BWLQGQsRxIxBIAYwwtpX2Bb4qKYGPlnnrolPzhgvfy5kH7bP5hoO4zHmLFmTT8FksiUyycNW-LOXBcaX72rz31OileJ-QSl1XVJCe63dPkyPsGpdvmRU4EeP9AQHj76oi2k0Qz7U Oct 05 02:28:18.865266 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:28:18.865266 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:28:18.865266 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:28:18.865266 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:28:18.865266 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:28:18.865266 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:28:18.865266 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: d3873ebc54394a6d8684fb95f30247fa Oct 05 02:28:18.865266 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-593482215 Oct 05 02:28:18.865266 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:28:18.865266 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:28:18.866582 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d3873ebc54394a6d8684fb95f30247fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d3873ebc54394a6d8684fb95f30247fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d3873ebc54394a6d8684fb95f30247fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d3873ebc54394a6d8684fb95f30247fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:18.866582 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-593482215 Oct 05 02:28:18.866582 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: d3873ebc54394a6d8684fb95f30247fa Oct 05 02:28:18.866582 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-593482215 Oct 05 02:28:18.866582 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-593482215-project Oct 05 02:28:18.866582 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:28:18.866582 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:28:18.866582 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: f59ec872768d453a94a0dc3accf81642 Oct 05 02:28:18.866582 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-593482215-project Oct 05 02:28:18.866582 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:28:18.866582 n-d-858272-3 devstack@n-api.service[122320]: {"security_group_rule": {"parent_group_id": "d76c54d2-d18d-4871-ae05-a0d5a8831587", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 05 02:28:18.866582 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:28:18.867271 n-d-858272-3 devstack@n-api.service[122320]: exception: Security group d76c54d2-d18d-4871-ae05-a0d5a8831587 does not exist Oct 05 02:28:18.867271 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-18a43408-7cb0-4c29-9c29-602c5bec93c6'] Oct 05 02:28:18.867271 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd76c54d2-d18d-4871-ae05-a0d5a8831587', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 05 02:28:18.867271 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:18.867271 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:18.867271 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 05 02:28:18.867271 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 05 02:28:18.867271 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:28:18.867271 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:28:18.867271 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 05 02:28:18.867271 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 05 02:28:18.867271 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:28:18.867271 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:28:18.867271 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 02:28:18.867271 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 02:28:18.867271 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:28:18.867271 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:28:18.867271 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 02:28:18.867271 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 02:28:18.868367 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:28:18.868367 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:28:18.868367 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 02:28:18.868367 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 02:28:18.868367 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:28:18.868367 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:28:18.868367 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 02:28:18.868367 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 02:28:18.868367 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 02:28:18.868367 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 02:28:18.868367 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d76c54d2-d18d-4871-ae05-a0d5a8831587 does not exist Oct 05 02:28:18.868367 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18a43408-7cb0-4c29-9c29-602c5bec93c6'] Oct 05 02:28:18.868367 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:28:18.868367 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:18.868367 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:28:18.868367 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:18.868367 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 05 02:28:18.868367 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 05 02:28:18.868367 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 05 02:28:18.871247 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 05 02:28:18.871247 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d76c54d2-d18d-4871-ae05-a0d5a8831587 does not exist Oct 05 02:28:18.871247 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18a43408-7cb0-4c29-9c29-602c5bec93c6'] Oct 05 02:28:18.871247 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:28:18.871247 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:18.871247 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:28:18.871247 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:18.871247 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:18.871247 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:18.871247 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:18.871247 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:18.871247 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:28:18.871247 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:28:18.871247 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:18.871247 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:18.871247 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 05 02:28:18.871247 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 05 02:28:18.871247 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d76c54d2-d18d-4871-ae05-a0d5a8831587 does not exist Oct 05 02:28:18.871247 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18a43408-7cb0-4c29-9c29-602c5bec93c6'] Oct 05 02:28:18.871247 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:28:18.873866 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:18.873866 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:28:18.873866 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:18.873866 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:18.873866 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:18.873866 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:28:18.873866 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:28:18.873866 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d76c54d2-d18d-4871-ae05-a0d5a8831587 does not exist Oct 05 02:28:18.873866 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18a43408-7cb0-4c29-9c29-602c5bec93c6'] Oct 05 02:28:18.873866 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:28:18.878783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1e5085a8-4024-45e3-aec8-a795828c9c0a tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Returning 404 to user: Security group d76c54d2-d18d-4871-ae05-a0d5a8831587 does not exist Oct 05 02:28:18.878783 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-18a43408-7cb0-4c29-9c29-602c5bec93c6'] {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:18.879986 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1e5085a8-4024-45e3-aec8-a795828c9c0a tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.654806 Oct 05 02:28:18.881186 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 214/439] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 5 02:28:18 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 656 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:28:19.122687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a4c6828-8ac1-4957-8ee3-cdbd2f2b25dc tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:19.123252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a4c6828-8ac1-4957-8ee3-cdbd2f2b25dc tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:19.128393 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a4c6828-8ac1-4957-8ee3-cdbd2f2b25dc tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:19.129744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a4c6828-8ac1-4957-8ee3-cdbd2f2b25dc tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:19.130098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a4c6828-8ac1-4957-8ee3-cdbd2f2b25dc tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:19.130595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a4c6828-8ac1-4957-8ee3-cdbd2f2b25dc tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:19.210420 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-93d7fbb9-07d2-4d59-b3f1-c855ff256f77 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:19.223295 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-93d7fbb9-07d2-4d59-b3f1-c855ff256f77 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.340696 Oct 05 02:28:19.223956 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 215/440] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 5 02:28:18 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:19.295766 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3a4c6828-8ac1-4957-8ee3-cdbd2f2b25dc tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/42d0dcc9c5664f0d9a9cbc402cc50ed5" status: 200 len: 328 microversion: 2.1 time: 0.985436 Oct 05 02:28:19.296749 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 226/441] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 5 02:28:18 2022] PUT /compute/v2.1/os-quota-sets/42d0dcc9c5664f0d9a9cbc402cc50ed5 => generated 328 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:19.309834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-77cf4508-c0ac-4865-aa7c-03fcdeaec5c9 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Calling method '.version_select at 0x7fcce456a790>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:19.347740 n-d-858272-3 devstack@n-api.service[122319]: DEBUG neutronclient.v2_0.client [None req-77cf4508-c0ac-4865-aa7c-03fcdeaec5c9 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 391e219d-ce46-4398-a0c7-da155ea2fa5d does not exist", "detail": ""}} {{(pid=122319) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 02:28:19.348308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.security_group_api [None req-77cf4508-c0ac-4865-aa7c-03fcdeaec5c9 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Neutron security group rule 391e219d-ce46-4398-a0c7-da155ea2fa5d not found {{(pid=122319) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 05 02:28:19.348846 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-77cf4508-c0ac-4865-aa7c-03fcdeaec5c9 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] HTTP exception thrown: Security group rule 391e219d-ce46-4398-a0c7-da155ea2fa5d does not exist Oct 05 02:28:19.348846 n-d-858272-3 devstack@n-api.service[122319]: Neutron server returns request_ids: ['req-d33a269a-ed14-4bec-ba6d-85ffb0c4e64a'] Oct 05 02:28:19.357007 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-77cf4508-c0ac-4865-aa7c-03fcdeaec5c9 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Request method failure captured: Oct 05 02:28:19.357007 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/os-security-group-rules/391e219d-ce46-4398-a0c7-da155ea2fa5d HTTP/1.1 Oct 05 02:28:19.357007 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:28:19.357007 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:28:19.357007 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:28:19.357007 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:28:19.357007 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:28:19.357007 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:28:19.357007 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:28:19.357007 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:19.357007 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOu4QRzql4neZ-qv2EOSBOO1t6F4FqBz_ygI562BWLQGQsRxIxBIAYwwtpX2Bb4qKYGPlnnrolPzhgvfy5kH7bP5hoO4zHmLFmTT8FksiUyycNW-LOXBcaX72rz31OileJ-QSl1XVJCe63dPkyPsGpdvmRU4EeP9AQHj76oi2k0Qz7U Oct 05 02:28:19.357007 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:28:19.357007 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:28:19.357007 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:28:19.357007 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:28:19.357007 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:28:19.357007 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:28:19.357007 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: d3873ebc54394a6d8684fb95f30247fa Oct 05 02:28:19.357007 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-593482215 Oct 05 02:28:19.357007 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:28:19.357007 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:28:19.358915 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d3873ebc54394a6d8684fb95f30247fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d3873ebc54394a6d8684fb95f30247fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d3873ebc54394a6d8684fb95f30247fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d3873ebc54394a6d8684fb95f30247fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:19.358915 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-593482215 Oct 05 02:28:19.358915 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: d3873ebc54394a6d8684fb95f30247fa Oct 05 02:28:19.358915 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-593482215 Oct 05 02:28:19.358915 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-593482215-project Oct 05 02:28:19.358915 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:28:19.358915 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:28:19.358915 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: f59ec872768d453a94a0dc3accf81642 Oct 05 02:28:19.358915 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-593482215-project Oct 05 02:28:19.358915 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:28:19.358915 n-d-858272-3 devstack@n-api.service[122319]: exception: Security group rule 391e219d-ce46-4398-a0c7-da155ea2fa5d does not exist Oct 05 02:28:19.358915 n-d-858272-3 devstack@n-api.service[122319]: Neutron server returns request_ids: ['req-d33a269a-ed14-4bec-ba6d-85ffb0c4e64a'] Oct 05 02:28:19.360573 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '391e219d-ce46-4398-a0c7-da155ea2fa5d'} Oct 05 02:28:19.360573 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:19.360573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:19.360573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 05 02:28:19.360573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 05 02:28:19.360573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:28:19.360573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:28:19.360573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 05 02:28:19.360573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 05 02:28:19.360573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:28:19.360573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:28:19.360573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 02:28:19.360573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 02:28:19.360573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:28:19.360573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:28:19.360573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 02:28:19.360573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 02:28:19.360573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:28:19.360573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:28:19.362545 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 02:28:19.362545 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 02:28:19.362545 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:28:19.362545 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:28:19.362545 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 02:28:19.362545 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 02:28:19.362545 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 02:28:19.362545 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 02:28:19.362545 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 391e219d-ce46-4398-a0c7-da155ea2fa5d does not exist Oct 05 02:28:19.362545 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d33a269a-ed14-4bec-ba6d-85ffb0c4e64a'] Oct 05 02:28:19.362545 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:19.362545 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:19.362545 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:19.362545 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:19.362545 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 05 02:28:19.362545 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 05 02:28:19.362545 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 05 02:28:19.362545 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 05 02:28:19.363774 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 391e219d-ce46-4398-a0c7-da155ea2fa5d does not exist Oct 05 02:28:19.363774 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d33a269a-ed14-4bec-ba6d-85ffb0c4e64a'] Oct 05 02:28:19.363774 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:19.363774 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:19.363774 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:19.363774 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:19.363774 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:19.363774 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:19.363774 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:19.363774 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:19.363774 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:28:19.363774 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:28:19.363774 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:19.363774 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:19.363774 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 05 02:28:19.363774 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 05 02:28:19.363774 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 391e219d-ce46-4398-a0c7-da155ea2fa5d does not exist Oct 05 02:28:19.363774 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d33a269a-ed14-4bec-ba6d-85ffb0c4e64a'] Oct 05 02:28:19.363774 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:19.363774 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:19.365524 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:19.365524 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:19.365524 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:19.365524 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:19.365524 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:28:19.365524 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:28:19.365524 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 391e219d-ce46-4398-a0c7-da155ea2fa5d does not exist Oct 05 02:28:19.365524 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d33a269a-ed14-4bec-ba6d-85ffb0c4e64a'] Oct 05 02:28:19.365524 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:19.365524 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-77cf4508-c0ac-4865-aa7c-03fcdeaec5c9 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Returning 404 to user: Security group rule 391e219d-ce46-4398-a0c7-da155ea2fa5d does not exist Oct 05 02:28:19.365524 n-d-858272-3 devstack@n-api.service[122319]: Neutron server returns request_ids: ['req-d33a269a-ed14-4bec-ba6d-85ffb0c4e64a'] {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:19.365524 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-77cf4508-c0ac-4865-aa7c-03fcdeaec5c9 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/391e219d-ce46-4398-a0c7-da155ea2fa5d" status: 404 len: 199 microversion: 2.1 time: 0.054330 Oct 05 02:28:19.365524 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 227/442] 10.222.0.16 () {58 vars in 1287 bytes} [Wed Oct 5 02:28:19 2022] DELETE /compute/v2.1/os-security-group-rules/391e219d-ce46-4398-a0c7-da155ea2fa5d => generated 199 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:28:19.598679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-94423201-d614-4d0a-9158-b89558cc4a54 tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] Calling method '.version_select at 0x7fcce435bdc0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:19.600436 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94423201-d614-4d0a-9158-b89558cc4a54 tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:19.601330 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94423201-d614-4d0a-9158-b89558cc4a54 tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:19.601772 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94423201-d614-4d0a-9158-b89558cc4a54 tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:19.618610 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94423201-d614-4d0a-9158-b89558cc4a54 tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:19.619215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94423201-d614-4d0a-9158-b89558cc4a54 tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:19.619835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94423201-d614-4d0a-9158-b89558cc4a54 tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:19.632444 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94423201-d614-4d0a-9158-b89558cc4a54 tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:19.632993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94423201-d614-4d0a-9158-b89558cc4a54 tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:19.633436 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94423201-d614-4d0a-9158-b89558cc4a54 tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:19.639637 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-94423201-d614-4d0a-9158-b89558cc4a54 tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.410522 Oct 05 02:28:19.640518 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 216/443] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:28:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:19.646088 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-490ca4b1-dea5-4d75-8d6a-e43a631c80ab tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:19.646866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-490ca4b1-dea5-4d75-8d6a-e43a631c80ab tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] [instance: a78fb515-3979-4134-928b-9552c036e8b2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:19.652635 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:19.654645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-490ca4b1-dea5-4d75-8d6a-e43a631c80ab tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:19.655368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-490ca4b1-dea5-4d75-8d6a-e43a631c80ab tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:19.656177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-490ca4b1-dea5-4d75-8d6a-e43a631c80ab tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:19.657104 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-490ca4b1-dea5-4d75-8d6a-e43a631c80ab tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:19.657746 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-490ca4b1-dea5-4d75-8d6a-e43a631c80ab tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:19.658719 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-490ca4b1-dea5-4d75-8d6a-e43a631c80ab tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:19.760320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-490ca4b1-dea5-4d75-8d6a-e43a631c80ab tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3175c74d670a49e0a7efff04e7d4e9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10beeb5ff94e4c9c9c8b801fd3c56c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:19.770526 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-490ca4b1-dea5-4d75-8d6a-e43a631c80ab tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] 10.222.0.16 "GET /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2" status: 200 len: 1266 microversion: 2.1 time: 0.128733 Oct 05 02:28:19.771500 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 217/444] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:19 2022] GET /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2 => generated 1266 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:19.781766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d97cab22-b069-45d1-8b53-1dd95626e5e4 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:19.794903 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6f580a87-230f-420d-8aaa-262e114b15fb tempest-ServersWithSpecificFlavorTestJSON-871223909 tempest-ServersWithSpecificFlavorTestJSON-871223909-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1171275254", "id": 1706217788, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:19.806850 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d97cab22-b069-45d1-8b53-1dd95626e5e4 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-quota-sets/42d0dcc9c5664f0d9a9cbc402cc50ed5" status: 202 len: 0 microversion: 2.1 time: 0.033838 Oct 05 02:28:19.807459 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 218/445] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 02:28:19 2022] DELETE /compute/v2.1/os-quota-sets/42d0dcc9c5664f0d9a9cbc402cc50ed5 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:28:19.817603 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-34d8828e-2454-4cdd-b77d-579a64d4694d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:19.820308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-34d8828e-2454-4cdd-b77d-579a64d4694d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:19.820926 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6f580a87-230f-420d-8aaa-262e114b15fb tempest-ServersWithSpecificFlavorTestJSON-871223909 tempest-ServersWithSpecificFlavorTestJSON-871223909-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.458949 Oct 05 02:28:19.829106 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 228/446] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:28:19 2022] POST /compute/v2.1/flavors => generated 425 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:19.834189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f810d418-5236-4845-bb97-6f109ef0e9a3 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Calling method '.version_select at 0x7fcce4607ee0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:19.849548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34d8828e-2454-4cdd-b77d-579a64d4694d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:19.850109 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34d8828e-2454-4cdd-b77d-579a64d4694d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:19.850622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34d8828e-2454-4cdd-b77d-579a64d4694d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:19.851358 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34d8828e-2454-4cdd-b77d-579a64d4694d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:19.851921 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34d8828e-2454-4cdd-b77d-579a64d4694d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:19.852285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34d8828e-2454-4cdd-b77d-579a64d4694d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:20.338079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-34d8828e-2454-4cdd-b77d-579a64d4694d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:20.350517 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-34d8828e-2454-4cdd-b77d-579a64d4694d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:20.357335 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-34d8828e-2454-4cdd-b77d-579a64d4694d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:20.359411 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-34d8828e-2454-4cdd-b77d-579a64d4694d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 200 len: 1567 microversion: 2.25 time: 0.550593 Oct 05 02:28:20.362204 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 219/447] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:28:19 2022] GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 1567 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:28:20.430393 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f810d418-5236-4845-bb97-6f109ef0e9a3 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/72b49f45-598b-40c0-a73c-758616976993" status: 202 len: 0 microversion: 2.1 time: 0.600104 Oct 05 02:28:20.431543 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 229/448] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:28:19 2022] DELETE /compute/v2.1/os-security-groups/72b49f45-598b-40c0-a73c-758616976993 => generated 0 bytes in 602 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:28:20.437662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f9b763f6-73cd-48f6-ad92-8458eb1e5122 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Calling method '.version_select at 0x7fcce4607e50>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:20.864429 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fdd94f08-6a23-47a9-a09d-61160915876d tempest-HypervisorAdminNegativeUnderV252Test-763816301 tempest-HypervisorAdminNegativeUnderV252Test-763816301-project] Calling method '.version_select at 0x7fcce43b6790>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:20.869021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fdd94f08-6a23-47a9-a09d-61160915876d tempest-HypervisorAdminNegativeUnderV252Test-763816301 tempest-HypervisorAdminNegativeUnderV252Test-763816301-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '3572b7cdb8c54cc18774639ae032a4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd368e9b23b79427cb89d3488a255a201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:20.874105 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fdd94f08-6a23-47a9-a09d-61160915876d tempest-HypervisorAdminNegativeUnderV252Test-763816301 tempest-HypervisorAdminNegativeUnderV252Test-763816301-project] Request method failure captured: Oct 05 02:28:20.874105 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/os-hypervisors/n-h2-858272-3/search HTTP/1.1 Oct 05 02:28:20.874105 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:28:20.874105 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:28:20.874105 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:28:20.874105 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:28:20.874105 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:28:20.874105 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:28:20.874105 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:28:20.874105 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:20.874105 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOu_eGRNof1uLGdLKThSyH9fVya4bfP9VE-PsbIUdCTSMgr6dk7Lv6saAr_wVlVqcU8ISoKyKNvsl5qST2L-nlwJ5fiebciDPyb7v20pmlIkRAVZk3GB1qWLqz-s9HyL2bgs5dSuMuS0BklFRmiA5rEoE4mumVulKdvZlbfbYqZ-qRc Oct 05 02:28:20.874105 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:28:20.874105 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:28:20.874105 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:28:20.874105 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:28:20.874105 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:28:20.874105 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:28:20.874105 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: d368e9b23b79427cb89d3488a255a201 Oct 05 02:28:20.874105 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-763816301 Oct 05 02:28:20.874105 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:28:20.874105 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:28:20.881059 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d368e9b23b79427cb89d3488a255a201"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d368e9b23b79427cb89d3488a255a201"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d368e9b23b79427cb89d3488a255a201"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d368e9b23b79427cb89d3488a255a201"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:20.881059 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-763816301 Oct 05 02:28:20.881059 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: d368e9b23b79427cb89d3488a255a201 Oct 05 02:28:20.881059 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-763816301 Oct 05 02:28:20.881059 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-763816301-project Oct 05 02:28:20.881059 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:28:20.881059 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:28:20.881059 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 3572b7cdb8c54cc18774639ae032a4c4 Oct 05 02:28:20.881059 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-763816301-project Oct 05 02:28:20.881059 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:28:20.881059 n-d-858272-3 devstack@n-api.service[122320]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 05 02:28:20.881059 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'n-h2-858272-3'} Oct 05 02:28:20.882040 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:20.882040 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:20.882040 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:20.882040 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:20.882040 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:20.882040 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:20.882040 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:28:20.882040 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:28:20.882040 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:20.882040 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:20.882040 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 05 02:28:20.882040 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 05 02:28:20.882040 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 02:28:20.882040 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 02:28:20.882040 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 02:28:20.882040 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 02:28:20.882040 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:28:20.882040 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:28:20.882040 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:28:20.883392 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:28:20.883392 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 02:28:20.883392 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 02:28:20.883392 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 02:28:20.883392 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 02:28:20.883392 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:28:20.883392 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 02:28:20.883392 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 05 02:28:20.883392 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:28:20.883392 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:20.883392 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:28:20.883392 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:20.883392 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:20.883392 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:20.883392 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 02:28:20.883392 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 02:28:20.883392 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 05 02:28:20.883392 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:28:20.884808 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fdd94f08-6a23-47a9-a09d-61160915876d tempest-HypervisorAdminNegativeUnderV252Test-763816301 tempest-HypervisorAdminNegativeUnderV252Test-763816301-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:20.888277 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fdd94f08-6a23-47a9-a09d-61160915876d tempest-HypervisorAdminNegativeUnderV252Test-763816301 tempest-HypervisorAdminNegativeUnderV252Test-763816301-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/n-h2-858272-3/search" status: 403 len: 117 microversion: 2.1 time: 0.521284 Oct 05 02:28:20.896595 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 220/449] 10.222.0.16 () {58 vars in 1209 bytes} [Wed Oct 5 02:28:20 2022] GET /compute/v2.1/os-hypervisors/n-h2-858272-3/search => generated 117 bytes in 534 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:28:20.909112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c9c6b1f9-0aa2-404e-b65c-7ce56b0845e2 tempest-ServersWithSpecificFlavorTestJSON-871223909 tempest-ServersWithSpecificFlavorTestJSON-871223909-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:20.925861 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c9c6b1f9-0aa2-404e-b65c-7ce56b0845e2 tempest-ServersWithSpecificFlavorTestJSON-871223909 tempest-ServersWithSpecificFlavorTestJSON-871223909-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.024011 Oct 05 02:28:20.927265 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 221/450] 10.222.0.16 () {58 vars in 1182 bytes} [Wed Oct 5 02:28:20 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:28:20.932223 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6b7c3521-49a9-40e6-b766-95d51dae4c9f tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Calling method '.version_select at 0x7fcce43ea700>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:21.151426 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f9b763f6-73cd-48f6-ad92-8458eb1e5122 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/42d0dcc9c5664f0d9a9cbc402cc50ed5" status: 200 len: 371 microversion: 2.1 time: 0.718573 Oct 05 02:28:21.152109 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 230/451] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 5 02:28:20 2022] GET /compute/v2.1/os-quota-sets/42d0dcc9c5664f0d9a9cbc402cc50ed5 => generated 371 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:21.165916 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7ff580f5-4332-4516-8511-73ebcc0856c4 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:21.166536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7ff580f5-4332-4516-8511-73ebcc0856c4 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] [instance: a78fb515-3979-4134-928b-9552c036e8b2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:21.179696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ff580f5-4332-4516-8511-73ebcc0856c4 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:21.180236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ff580f5-4332-4516-8511-73ebcc0856c4 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:21.180726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ff580f5-4332-4516-8511-73ebcc0856c4 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:21.181466 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ff580f5-4332-4516-8511-73ebcc0856c4 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:21.187337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ff580f5-4332-4516-8511-73ebcc0856c4 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:21.187948 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ff580f5-4332-4516-8511-73ebcc0856c4 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:21.412849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7ff580f5-4332-4516-8511-73ebcc0856c4 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3175c74d670a49e0a7efff04e7d4e9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10beeb5ff94e4c9c9c8b801fd3c56c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:21.432575 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7ff580f5-4332-4516-8511-73ebcc0856c4 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] 10.222.0.16 "GET /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2" status: 200 len: 1272 microversion: 2.1 time: 0.275222 Oct 05 02:28:21.434659 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 231/452] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:21 2022] GET /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2 => generated 1272 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:21.445484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3a41ce61-988c-4ef1-9704-f47bb9f32863 tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] Calling method '.version_select at 0x7fcce44def70>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:21.448061 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a41ce61-988c-4ef1-9704-f47bb9f32863 tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:21.448847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a41ce61-988c-4ef1-9704-f47bb9f32863 tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:21.449855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a41ce61-988c-4ef1-9704-f47bb9f32863 tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:21.503316 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-3a41ce61-988c-4ef1-9704-f47bb9f32863 tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 05 02:28:21.504742 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3a41ce61-988c-4ef1-9704-f47bb9f32863 tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] Request method failure captured: Oct 05 02:28:21.504742 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 05 02:28:21.504742 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:28:21.504742 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:28:21.504742 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:28:21.504742 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:28:21.504742 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:28:21.504742 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:28:21.504742 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:28:21.504742 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:21.504742 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOvCOrMrLGUAfe-JzW3zJGNNqQMJJrW1atMDTvtOY8OHDl9qWH1czrUqNcKuKPRZEMekFIajNzoTYMf4FLGnmuGqVqjOXYjv-nhRXIAItJef083ATKOn1wcbIEqbZjMM0oBNt_JvyySOmouh-4SOGzpEW0d_2oQxbY01NOkpT6zPSSw Oct 05 02:28:21.504742 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:28:21.504742 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:28:21.504742 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:28:21.504742 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:28:21.504742 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:28:21.504742 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:28:21.504742 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: ca12dd07f51242168e4ea0e95357e89d Oct 05 02:28:21.504742 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-345960909 Oct 05 02:28:21.504742 n-d-858272-3 devstack@n-api.service[122319]: X-Role: admin,member,reader Oct 05 02:28:21.504742 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: admin,member,reader Oct 05 02:28:21.506300 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ca12dd07f51242168e4ea0e95357e89d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ca12dd07f51242168e4ea0e95357e89d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ca12dd07f51242168e4ea0e95357e89d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ca12dd07f51242168e4ea0e95357e89d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:21.506300 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-345960909 Oct 05 02:28:21.506300 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: ca12dd07f51242168e4ea0e95357e89d Oct 05 02:28:21.506300 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-345960909 Oct 05 02:28:21.506300 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin Oct 05 02:28:21.506300 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:28:21.506300 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:28:21.506300 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 4e91d52e12124cbda21fd9c11d8aa227 Oct 05 02:28:21.506300 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin Oct 05 02:28:21.506300 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:28:21.506300 n-d-858272-3 devstack@n-api.service[122319]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 05 02:28:21.506300 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 05 02:28:21.507072 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:21.507072 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:21.507072 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:21.507072 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:21.507072 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:21.507072 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:21.507072 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:28:21.507072 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:28:21.507072 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:21.507072 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:21.507072 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 05 02:28:21.507072 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 05 02:28:21.507072 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 05 02:28:21.507072 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 05 02:28:21.507072 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 05 02:28:21.507072 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:21.507072 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:21.507072 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:21.507072 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:21.507072 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:21.508579 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:21.508579 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:28:21.508579 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:28:21.508579 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 05 02:28:21.508579 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:21.508579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3a41ce61-988c-4ef1-9704-f47bb9f32863 tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:21.512347 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3a41ce61-988c-4ef1-9704-f47bb9f32863 tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.074575 Oct 05 02:28:21.519400 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 232/453] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 5 02:28:21 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:28:21.528856 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cfdb761b-04dc-4190-8881-3f687e04961c tempest-ServersWithSpecificFlavorTestJSON-871223909 tempest-ServersWithSpecificFlavorTestJSON-871223909-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-998464598", "id": 2092938567, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:21.556446 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cfdb761b-04dc-4190-8881-3f687e04961c tempest-ServersWithSpecificFlavorTestJSON-871223909 tempest-ServersWithSpecificFlavorTestJSON-871223909-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.029623 Oct 05 02:28:21.558112 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 233/454] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:28:21 2022] POST /compute/v2.1/flavors => generated 424 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:21.565424 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-94f18434-be02-4ff9-af2d-0d3a92f49669 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:21.566416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-94f18434-be02-4ff9-af2d-0d3a92f49669 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:21.584697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94f18434-be02-4ff9-af2d-0d3a92f49669 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:21.585460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94f18434-be02-4ff9-af2d-0d3a92f49669 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:21.593619 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94f18434-be02-4ff9-af2d-0d3a92f49669 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:21.597531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94f18434-be02-4ff9-af2d-0d3a92f49669 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:21.598041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94f18434-be02-4ff9-af2d-0d3a92f49669 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:21.598483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94f18434-be02-4ff9-af2d-0d3a92f49669 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:21.707690 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6b7c3521-49a9-40e6-b766-95d51dae4c9f tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/2ee70e25-7d57-46be-8fb3-b358078b96c9" status: 202 len: 0 microversion: 2.1 time: 0.779035 Oct 05 02:28:21.711989 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 222/455] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:28:20 2022] DELETE /compute/v2.1/os-security-groups/2ee70e25-7d57-46be-8fb3-b358078b96c9 => generated 0 bytes in 780 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:28:21.713357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-342d67b6-d89c-40eb-840c-1501dcb50154 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Calling method '.version_select at 0x7fcce43b6310>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:22.071640 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-342d67b6-d89c-40eb-840c-1501dcb50154 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/c6b91e8c83c14bbd95324f08142e45ab/defaults" status: 200 len: 371 microversion: 2.1 time: 0.361547 Oct 05 02:28:22.072312 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 223/456] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 5 02:28:21 2022] GET /compute/v2.1/os-quota-sets/c6b91e8c83c14bbd95324f08142e45ab/defaults => generated 371 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:22.087208 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b81124e0-393b-4153-997f-efa737237e9a tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] Calling method '.version_select at 0x7fcce43b6280>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:22.090305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b81124e0-393b-4153-997f-efa737237e9a tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:22.090887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b81124e0-393b-4153-997f-efa737237e9a tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:22.093177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b81124e0-393b-4153-997f-efa737237e9a tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:22.124120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b81124e0-393b-4153-997f-efa737237e9a tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:22.126322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b81124e0-393b-4153-997f-efa737237e9a tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:22.129263 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b81124e0-393b-4153-997f-efa737237e9a tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:22.138014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:22.187290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b81124e0-393b-4153-997f-efa737237e9a tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:22.189880 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b81124e0-393b-4153-997f-efa737237e9a tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:22.191337 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b81124e0-393b-4153-997f-efa737237e9a tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:22.211155 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b81124e0-393b-4153-997f-efa737237e9a tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.136149 Oct 05 02:28:22.213372 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 224/457] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:28:22 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:22.228984 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d81ab4e8-b814-4afe-969f-52b9c9ba1ad6 tempest-ServersWithSpecificFlavorTestJSON-871223909 tempest-ServersWithSpecificFlavorTestJSON-871223909-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:22.255050 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d81ab4e8-b814-4afe-969f-52b9c9ba1ad6 tempest-ServersWithSpecificFlavorTestJSON-871223909 tempest-ServersWithSpecificFlavorTestJSON-871223909-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.039510 Oct 05 02:28:22.259004 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 225/458] 10.222.0.16 () {58 vars in 1182 bytes} [Wed Oct 5 02:28:22 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:28:22.272161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-aebb5da8-838a-43a2-b8c9-6a73f33dc25c tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Calling method '.version_select at 0x7fcce4578dc0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:22.448173 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-94f18434-be02-4ff9-af2d-0d3a92f49669 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:22.458314 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-94f18434-be02-4ff9-af2d-0d3a92f49669 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:22.459168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-94f18434-be02-4ff9-af2d-0d3a92f49669 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:22.462611 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-94f18434-be02-4ff9-af2d-0d3a92f49669 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 200 len: 1567 microversion: 2.25 time: 0.903319 Oct 05 02:28:22.466515 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 234/459] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:28:21 2022] GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 1567 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:28:22.859012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-eee91b99-2ea8-4c26-a49f-e1b4c85295fc tempest-FlavorsExtraSpecsTestJSON-774039850 tempest-FlavorsExtraSpecsTestJSON-774039850-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1040261556", "ram": 512, "vcpus": 1, "disk": 10, "id": 58210431, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:22.907650 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-eee91b99-2ea8-4c26-a49f-e1b4c85295fc tempest-FlavorsExtraSpecsTestJSON-774039850 tempest-FlavorsExtraSpecsTestJSON-774039850-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.437641 Oct 05 02:28:22.908252 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 235/460] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:28:22 2022] POST /compute/v2.1/flavors => generated 410 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:22.928678 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-69bf0407-adc7-4f08-b178-660f62860f0f tempest-HypervisorAdminNegativeUnderV252Test-763816301 tempest-HypervisorAdminNegativeUnderV252Test-763816301-project] Calling method '.version_select at 0x7fcce44fb9d0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:22.930497 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-69bf0407-adc7-4f08-b178-660f62860f0f tempest-HypervisorAdminNegativeUnderV252Test-763816301 tempest-HypervisorAdminNegativeUnderV252Test-763816301-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '3572b7cdb8c54cc18774639ae032a4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd368e9b23b79427cb89d3488a255a201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:22.953650 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-69bf0407-adc7-4f08-b178-660f62860f0f tempest-HypervisorAdminNegativeUnderV252Test-763816301 tempest-HypervisorAdminNegativeUnderV252Test-763816301-project] Request method failure captured: Oct 05 02:28:22.953650 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 05 02:28:22.953650 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:28:22.953650 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:28:22.953650 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:28:22.953650 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:28:22.953650 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:28:22.953650 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:28:22.953650 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:28:22.953650 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:22.953650 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOu_eGRNof1uLGdLKThSyH9fVya4bfP9VE-PsbIUdCTSMgr6dk7Lv6saAr_wVlVqcU8ISoKyKNvsl5qST2L-nlwJ5fiebciDPyb7v20pmlIkRAVZk3GB1qWLqz-s9HyL2bgs5dSuMuS0BklFRmiA5rEoE4mumVulKdvZlbfbYqZ-qRc Oct 05 02:28:22.953650 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:28:22.953650 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:28:22.953650 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:28:22.953650 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:28:22.953650 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:28:22.953650 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:28:22.953650 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: d368e9b23b79427cb89d3488a255a201 Oct 05 02:28:22.953650 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-763816301 Oct 05 02:28:22.953650 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:28:22.953650 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:28:22.955277 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d368e9b23b79427cb89d3488a255a201"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d368e9b23b79427cb89d3488a255a201"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d368e9b23b79427cb89d3488a255a201"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d368e9b23b79427cb89d3488a255a201"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:22.955277 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-763816301 Oct 05 02:28:22.955277 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: d368e9b23b79427cb89d3488a255a201 Oct 05 02:28:22.955277 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-763816301 Oct 05 02:28:22.955277 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-763816301-project Oct 05 02:28:22.955277 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:28:22.955277 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:28:22.955277 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 3572b7cdb8c54cc18774639ae032a4c4 Oct 05 02:28:22.955277 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-763816301-project Oct 05 02:28:22.955277 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:28:22.955277 n-d-858272-3 devstack@n-api.service[122319]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 05 02:28:22.955277 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '1'} Oct 05 02:28:22.956118 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:22.956118 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:22.956118 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:22.956118 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:22.956118 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:22.956118 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:22.956118 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:28:22.956118 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:28:22.956118 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:22.956118 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:22.956118 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 05 02:28:22.956118 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 05 02:28:22.956118 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 02:28:22.956118 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 02:28:22.956118 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 02:28:22.956118 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 02:28:22.956118 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:28:22.956118 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:28:22.956118 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:28:22.957460 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:28:22.957460 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 02:28:22.957460 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 02:28:22.957460 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 02:28:22.957460 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 02:28:22.957460 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:28:22.957460 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 02:28:22.957460 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 05 02:28:22.957460 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:22.957460 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:22.957460 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:22.957460 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:22.957460 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:22.957460 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:22.957460 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 02:28:22.957460 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 02:28:22.957460 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 05 02:28:22.957460 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:22.958572 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-69bf0407-adc7-4f08-b178-660f62860f0f tempest-HypervisorAdminNegativeUnderV252Test-763816301 tempest-HypervisorAdminNegativeUnderV252Test-763816301-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:22.958572 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-69bf0407-adc7-4f08-b178-660f62860f0f tempest-HypervisorAdminNegativeUnderV252Test-763816301 tempest-HypervisorAdminNegativeUnderV252Test-763816301-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.045542 Oct 05 02:28:22.959349 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 236/461] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Oct 5 02:28:22 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 50 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:28:22.970656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fe4bb781-0568-4457-835a-ce09ee8d67e1 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Action: 'create', calling method: .version_select at 0x7fcce44e2280>, body: {"keypair": {"name": "tempest-keypair-667138563", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVl0KIWQwYv4OsjJXcDgJ9Xo2X/m9aOP+3QkPQUpvSbm3NWFtFF8KQYZmHhriGCioy6INUtXKgdlsCH0SLCsnazj/h7dIzPA68Euhp7a8hDUigio4UtPLsJCpVeTRHcMw=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:23.036397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-fe4bb781-0568-4457-835a-ce09ee8d67e1 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Getting quotas for project fecbac50c16847799a85c148c6c143de. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:28:23.043251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-fe4bb781-0568-4457-835a-ce09ee8d67e1 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Getting quotas for user 368f6c3db9f24561a13f48ce02e7655e and project fecbac50c16847799a85c148c6c143de. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:28:23.128352 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fe4bb781-0568-4457-835a-ce09ee8d67e1 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.167844 Oct 05 02:28:23.129296 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 237/462] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 02:28:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:23.137155 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-98166a4a-8871-4a86-bea3-d023b1367b3b tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Action: 'update', calling method: .version_select at 0x7fcce456ab80>, body: {"quota_set": {"ram": "5120"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:23.265250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98166a4a-8871-4a86-bea3-d023b1367b3b tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:23.265743 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98166a4a-8871-4a86-bea3-d023b1367b3b tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:23.266194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98166a4a-8871-4a86-bea3-d023b1367b3b tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:23.266902 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98166a4a-8871-4a86-bea3-d023b1367b3b tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:23.267360 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98166a4a-8871-4a86-bea3-d023b1367b3b tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:23.268319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98166a4a-8871-4a86-bea3-d023b1367b3b tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:23.331735 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-98166a4a-8871-4a86-bea3-d023b1367b3b tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/4f62801fc3ac498db885f0e0a438deac" status: 200 len: 328 microversion: 2.1 time: 0.199701 Oct 05 02:28:23.333187 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 238/463] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 5 02:28:23 2022] PUT /compute/v2.1/os-quota-sets/4f62801fc3ac498db885f0e0a438deac => generated 328 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:23.350960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f606c59b-3d0c-448d-87f3-339ffcd4107a tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:23.352383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f606c59b-3d0c-448d-87f3-339ffcd4107a tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] [instance: a78fb515-3979-4134-928b-9552c036e8b2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:23.364192 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f606c59b-3d0c-448d-87f3-339ffcd4107a tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:23.364752 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f606c59b-3d0c-448d-87f3-339ffcd4107a tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:23.365270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f606c59b-3d0c-448d-87f3-339ffcd4107a tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:23.366034 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f606c59b-3d0c-448d-87f3-339ffcd4107a tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:23.366492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f606c59b-3d0c-448d-87f3-339ffcd4107a tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:23.366911 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f606c59b-3d0c-448d-87f3-339ffcd4107a tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:23.699801 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-aebb5da8-838a-43a2-b8c9-6a73f33dc25c tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/a5a0048b-d33f-4c88-b8fd-546ce1fa0350" status: 202 len: 0 microversion: 2.1 time: 1.438357 Oct 05 02:28:23.700466 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 226/464] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:28:22 2022] DELETE /compute/v2.1/os-security-groups/a5a0048b-d33f-4c88-b8fd-546ce1fa0350 => generated 0 bytes in 1440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:28:23.706509 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-facb52c5-3855-4627-b68e-6cfefdff6d78 tempest-FlavorsExtraSpecsTestJSON-774039850 tempest-FlavorsExtraSpecsTestJSON-774039850-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:23.804986 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-facb52c5-3855-4627-b68e-6cfefdff6d78 tempest-FlavorsExtraSpecsTestJSON-774039850 tempest-FlavorsExtraSpecsTestJSON-774039850-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/58210431/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.100714 Oct 05 02:28:23.806851 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 227/465] 10.222.0.16 () {60 vars in 1218 bytes} [Wed Oct 5 02:28:23 2022] POST /compute/v2.1/flavors/58210431/os-extra_specs => generated 66 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:28:23.820922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-09a0e11b-f012-414c-ae33-fd626f5c57cc tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] Calling method '.version_select at 0x7fcce43dddc0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:23.823023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09a0e11b-f012-414c-ae33-fd626f5c57cc tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:23.825889 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09a0e11b-f012-414c-ae33-fd626f5c57cc tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:23.828230 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09a0e11b-f012-414c-ae33-fd626f5c57cc tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:23.851655 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-09a0e11b-f012-414c-ae33-fd626f5c57cc tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] HTTP exception thrown: No hypervisor matching '155bb5ea-2efe-49e1-8c47-96775606ab94' could be found. Oct 05 02:28:23.858620 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-09a0e11b-f012-414c-ae33-fd626f5c57cc tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] Request method failure captured: Oct 05 02:28:23.858620 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/os-hypervisors/155bb5ea-2efe-49e1-8c47-96775606ab94/servers HTTP/1.1 Oct 05 02:28:23.858620 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:28:23.858620 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:28:23.858620 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:28:23.858620 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:28:23.858620 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:28:23.858620 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:28:23.858620 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:28:23.858620 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:23.858620 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOvCOrMrLGUAfe-JzW3zJGNNqQMJJrW1atMDTvtOY8OHDl9qWH1czrUqNcKuKPRZEMekFIajNzoTYMf4FLGnmuGqVqjOXYjv-nhRXIAItJef083ATKOn1wcbIEqbZjMM0oBNt_JvyySOmouh-4SOGzpEW0d_2oQxbY01NOkpT6zPSSw Oct 05 02:28:23.858620 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:28:23.858620 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:28:23.858620 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:28:23.858620 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:28:23.858620 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:28:23.858620 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:28:23.858620 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: ca12dd07f51242168e4ea0e95357e89d Oct 05 02:28:23.858620 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-345960909 Oct 05 02:28:23.858620 n-d-858272-3 devstack@n-api.service[122320]: X-Role: admin,member,reader Oct 05 02:28:23.858620 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: admin,member,reader Oct 05 02:28:23.860251 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ca12dd07f51242168e4ea0e95357e89d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ca12dd07f51242168e4ea0e95357e89d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ca12dd07f51242168e4ea0e95357e89d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ca12dd07f51242168e4ea0e95357e89d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:23.860251 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-345960909 Oct 05 02:28:23.860251 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: ca12dd07f51242168e4ea0e95357e89d Oct 05 02:28:23.860251 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-345960909 Oct 05 02:28:23.860251 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin Oct 05 02:28:23.860251 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:28:23.860251 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:28:23.860251 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 4e91d52e12124cbda21fd9c11d8aa227 Oct 05 02:28:23.860251 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin Oct 05 02:28:23.860251 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:28:23.860251 n-d-858272-3 devstack@n-api.service[122320]: exception: No hypervisor matching '155bb5ea-2efe-49e1-8c47-96775606ab94' could be found. Oct 05 02:28:23.860251 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '155bb5ea-2efe-49e1-8c47-96775606ab94'} Oct 05 02:28:23.860975 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:23.860975 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:23.860975 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:23.860975 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:23.860975 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:23.860975 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:23.860975 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:28:23.860975 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:28:23.860975 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:23.860975 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:23.860975 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 05 02:28:23.860975 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 05 02:28:23.860975 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 05 02:28:23.860975 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 05 02:28:23.860975 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '155bb5ea-2efe-49e1-8c47-96775606ab94' could be found. Oct 05 02:28:23.860975 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:28:23.860975 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:23.860975 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:28:23.860975 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:23.862755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:23.862755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:23.862755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:28:23.862755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:28:23.862755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '155bb5ea-2efe-49e1-8c47-96775606ab94' could be found. Oct 05 02:28:23.862755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:28:23.862755 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-09a0e11b-f012-414c-ae33-fd626f5c57cc tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] Returning 404 to user: No hypervisor matching '155bb5ea-2efe-49e1-8c47-96775606ab94' could be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:23.862755 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-09a0e11b-f012-414c-ae33-fd626f5c57cc tempest-HypervisorAdminNegativeUnderV252Test-345960909 tempest-HypervisorAdminNegativeUnderV252Test-345960909-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/155bb5ea-2efe-49e1-8c47-96775606ab94/servers" status: 404 len: 123 microversion: 2.1 time: 0.052196 Oct 05 02:28:23.864616 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 228/466] 10.222.0.16 () {58 vars in 1281 bytes} [Wed Oct 5 02:28:23 2022] GET /compute/v2.1/os-hypervisors/155bb5ea-2efe-49e1-8c47-96775606ab94/servers => generated 123 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:28:23.883534 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5297560d-de3d-469e-b24c-806955d52418 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Calling method '.version_select at 0x7fcce43dd5e0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:24.036953 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5297560d-de3d-469e-b24c-806955d52418 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:24.037658 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5297560d-de3d-469e-b24c-806955d52418 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:24.038251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5297560d-de3d-469e-b24c-806955d52418 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:24.045063 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5297560d-de3d-469e-b24c-806955d52418 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:24.046582 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5297560d-de3d-469e-b24c-806955d52418 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:24.048559 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5297560d-de3d-469e-b24c-806955d52418 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:24.114934 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5297560d-de3d-469e-b24c-806955d52418 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/4f62801fc3ac498db885f0e0a438deac/detail" status: 200 len: 916 microversion: 2.1 time: 0.234990 Oct 05 02:28:24.115993 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 229/467] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 5 02:28:23 2022] GET /compute/v2.1/os-quota-sets/4f62801fc3ac498db885f0e0a438deac/detail => generated 916 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:24.124358 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8ec906ab-576c-4691-abc2-36643e40948c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:24.126824 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8ec906ab-576c-4691-abc2-36643e40948c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:24.146251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ec906ab-576c-4691-abc2-36643e40948c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:24.150218 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ec906ab-576c-4691-abc2-36643e40948c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:24.150710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ec906ab-576c-4691-abc2-36643e40948c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:24.151473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ec906ab-576c-4691-abc2-36643e40948c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:24.151932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ec906ab-576c-4691-abc2-36643e40948c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:24.152368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ec906ab-576c-4691-abc2-36643e40948c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:24.187853 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f606c59b-3d0c-448d-87f3-339ffcd4107a tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3175c74d670a49e0a7efff04e7d4e9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10beeb5ff94e4c9c9c8b801fd3c56c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:24.198316 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f606c59b-3d0c-448d-87f3-339ffcd4107a tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] 10.222.0.16 "GET /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2" status: 200 len: 1314 microversion: 2.1 time: 0.863681 Oct 05 02:28:24.200948 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 239/468] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:23 2022] GET /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2 => generated 1314 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:24.241210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-84e82d46-3678-492f-b3a0-9e3adb47de42 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Calling method '.version_select at 0x7fcce44fb430>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:25.250832 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8ec906ab-576c-4691-abc2-36643e40948c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:25.263929 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8ec906ab-576c-4691-abc2-36643e40948c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:25.266441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8ec906ab-576c-4691-abc2-36643e40948c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:25.286138 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8ec906ab-576c-4691-abc2-36643e40948c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 200 len: 1567 microversion: 2.25 time: 1.166226 Oct 05 02:28:25.302130 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 230/469] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:28:24 2022] GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 1567 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:28:25.638875 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-84e82d46-3678-492f-b3a0-9e3adb47de42 tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/f8be9142-f615-40b4-a0f8-37f510b05661" status: 202 len: 0 microversion: 2.1 time: 1.421683 Oct 05 02:28:25.640333 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 240/470] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:28:24 2022] DELETE /compute/v2.1/os-security-groups/f8be9142-f615-40b4-a0f8-37f510b05661 => generated 0 bytes in 1424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:28:25.646736 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-389fc711-d622-45c9-8cb6-cea8f2d5a252 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Action: 'update', calling method: .version_select at 0x7fcce456a280>, body: {"quota_set": {"ram": "2048"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:25.766737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bc792033-5db7-4ad0-a9a2-20192f141dbb tempest-FlavorsExtraSpecsTestJSON-2069385534 tempest-FlavorsExtraSpecsTestJSON-2069385534-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:25.788611 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bc792033-5db7-4ad0-a9a2-20192f141dbb tempest-FlavorsExtraSpecsTestJSON-2069385534 tempest-FlavorsExtraSpecsTestJSON-2069385534-project] 10.222.0.16 "GET /compute/v2.1/flavors/58210431/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.484103 Oct 05 02:28:25.800946 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 231/471] 10.222.0.16 () {58 vars in 1197 bytes} [Wed Oct 5 02:28:25 2022] GET /compute/v2.1/flavors/58210431/os-extra_specs => generated 66 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:28:25.811932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2775da13-37a4-49ba-8f66-c1bf72b14de3 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:25.818194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2775da13-37a4-49ba-8f66-c1bf72b14de3 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] [instance: a78fb515-3979-4134-928b-9552c036e8b2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:25.834576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2775da13-37a4-49ba-8f66-c1bf72b14de3 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:25.842151 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2775da13-37a4-49ba-8f66-c1bf72b14de3 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:25.842755 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2775da13-37a4-49ba-8f66-c1bf72b14de3 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:25.843984 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2775da13-37a4-49ba-8f66-c1bf72b14de3 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:25.844672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2775da13-37a4-49ba-8f66-c1bf72b14de3 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:25.845345 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2775da13-37a4-49ba-8f66-c1bf72b14de3 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:25.975085 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-389fc711-d622-45c9-8cb6-cea8f2d5a252 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:25.975579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-389fc711-d622-45c9-8cb6-cea8f2d5a252 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:25.976006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-389fc711-d622-45c9-8cb6-cea8f2d5a252 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:25.976923 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-389fc711-d622-45c9-8cb6-cea8f2d5a252 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:25.977530 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-389fc711-d622-45c9-8cb6-cea8f2d5a252 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:25.978107 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-389fc711-d622-45c9-8cb6-cea8f2d5a252 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:26.051149 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-389fc711-d622-45c9-8cb6-cea8f2d5a252 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:26.052095 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-389fc711-d622-45c9-8cb6-cea8f2d5a252 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:26.053239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-389fc711-d622-45c9-8cb6-cea8f2d5a252 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:26.055611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-389fc711-d622-45c9-8cb6-cea8f2d5a252 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:26.057246 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-389fc711-d622-45c9-8cb6-cea8f2d5a252 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:26.057997 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-389fc711-d622-45c9-8cb6-cea8f2d5a252 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:26.188454 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:26.194446 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-389fc711-d622-45c9-8cb6-cea8f2d5a252 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/4f62801fc3ac498db885f0e0a438deac?user_id=b7bbc8407e0a487ea59842da2faff08e" status: 200 len: 328 microversion: 2.1 time: 0.552826 Oct 05 02:28:26.204277 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 241/472] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 5 02:28:25 2022] PUT /compute/v2.1/os-quota-sets/4f62801fc3ac498db885f0e0a438deac?user_id=b7bbc8407e0a487ea59842da2faff08e => generated 328 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:26.210117 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1ac7f4eb-dc5a-45e1-a76b-cbddbc48780b tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] Calling method '.version_select at 0x7fcce44fb0d0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:26.497351 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2775da13-37a4-49ba-8f66-c1bf72b14de3 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3175c74d670a49e0a7efff04e7d4e9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10beeb5ff94e4c9c9c8b801fd3c56c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:26.507513 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2775da13-37a4-49ba-8f66-c1bf72b14de3 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] 10.222.0.16 "GET /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2" status: 200 len: 1314 microversion: 2.1 time: 0.704987 Oct 05 02:28:26.530554 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 232/473] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:25 2022] GET /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2 => generated 1314 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:26.559902 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1ecf31c5-76f7-40c5-bfb1-c966ded52d74 tempest-FlavorsExtraSpecsTestJSON-774039850 tempest-FlavorsExtraSpecsTestJSON-774039850-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:26.631604 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1ecf31c5-76f7-40c5-bfb1-c966ded52d74 tempest-FlavorsExtraSpecsTestJSON-774039850 tempest-FlavorsExtraSpecsTestJSON-774039850-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/58210431/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.097872 Oct 05 02:28:26.634824 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 233/474] 10.222.0.16 () {60 vars in 1218 bytes} [Wed Oct 5 02:28:26 2022] POST /compute/v2.1/flavors/58210431/os-extra_specs => generated 66 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:28:26.646715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4c5bc504-e53c-438a-90d5-cabb1afecdea tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Calling method '.version_select at 0x7fcce43e1310>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:26.788056 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4c5bc504-e53c-438a-90d5-cabb1afecdea tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/4f62801fc3ac498db885f0e0a438deac?user_id=b7bbc8407e0a487ea59842da2faff08e" status: 200 len: 370 microversion: 2.1 time: 0.151525 Oct 05 02:28:26.789949 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 234/475] 10.222.0.16 () {58 vars in 1323 bytes} [Wed Oct 5 02:28:26 2022] GET /compute/v2.1/os-quota-sets/4f62801fc3ac498db885f0e0a438deac?user_id=b7bbc8407e0a487ea59842da2faff08e => generated 370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:26.799924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a6c9438a-a80f-4060-8e30-047797332300 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:26.801004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a6c9438a-a80f-4060-8e30-047797332300 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:26.812577 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6c9438a-a80f-4060-8e30-047797332300 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:26.814076 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6c9438a-a80f-4060-8e30-047797332300 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:26.815840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6c9438a-a80f-4060-8e30-047797332300 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:26.816867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6c9438a-a80f-4060-8e30-047797332300 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:26.818097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6c9438a-a80f-4060-8e30-047797332300 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:26.818698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6c9438a-a80f-4060-8e30-047797332300 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:27.050388 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1ac7f4eb-dc5a-45e1-a76b-cbddbc48780b tempest-SecurityGroupRulesNegativeTestJSON-593482215 tempest-SecurityGroupRulesNegativeTestJSON-593482215-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/d2421dfd-65ee-49fe-a2d6-87b91588f787" status: 202 len: 0 microversion: 2.1 time: 0.844414 Oct 05 02:28:27.051716 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 242/476] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:28:26 2022] DELETE /compute/v2.1/os-security-groups/d2421dfd-65ee-49fe-a2d6-87b91588f787 => generated 0 bytes in 847 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:28:27.057565 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-c29d1b1a-3128-43ba-9b14-beb21dbd875a req-b29125ab-26b2-459f-acbb-85c7925544e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a78fb515-3979-4134-928b-9552c036e8b2", "tag": "d569f8c8-2957-4ebb-9105-c4480d3ada02"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:27.088675 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c29d1b1a-3128-43ba-9b14-beb21dbd875a req-b29125ab-26b2-459f-acbb-85c7925544e5 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:27.090869 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c29d1b1a-3128-43ba-9b14-beb21dbd875a req-b29125ab-26b2-459f-acbb-85c7925544e5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:27.091482 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c29d1b1a-3128-43ba-9b14-beb21dbd875a req-b29125ab-26b2-459f-acbb-85c7925544e5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:27.125060 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-c29d1b1a-3128-43ba-9b14-beb21dbd875a req-b29125ab-26b2-459f-acbb-85c7925544e5 service nova] Creating event network-changed:d569f8c8-2957-4ebb-9105-c4480d3ada02 for instance a78fb515-3979-4134-928b-9552c036e8b2 on n-h1-858272-3 Oct 05 02:28:27.140388 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-c29d1b1a-3128-43ba-9b14-beb21dbd875a req-b29125ab-26b2-459f-acbb-85c7925544e5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085302 Oct 05 02:28:27.142049 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 243/477] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:27.153422 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-aafb5ecc-3576-419f-843b-dc3636b3a991 tempest-FlavorsExtraSpecsTestJSON-2069385534 tempest-FlavorsExtraSpecsTestJSON-2069385534-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:27.183158 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-aafb5ecc-3576-419f-843b-dc3636b3a991 tempest-FlavorsExtraSpecsTestJSON-2069385534 tempest-FlavorsExtraSpecsTestJSON-2069385534-project] 10.222.0.16 "GET /compute/v2.1/flavors/58210431/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.038005 Oct 05 02:28:27.190351 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 244/478] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:28:27 2022] GET /compute/v2.1/flavors/58210431/os-extra_specs/hw:numa_nodes => generated 22 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:28:27.207425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4e36ce7b-9f21-4645-ad02-6fadd2045404 tempest-FlavorsExtraSpecsTestJSON-774039850 tempest-FlavorsExtraSpecsTestJSON-774039850-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:27.267427 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4e36ce7b-9f21-4645-ad02-6fadd2045404 tempest-FlavorsExtraSpecsTestJSON-774039850 tempest-FlavorsExtraSpecsTestJSON-774039850-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/58210431/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.069407 Oct 05 02:28:27.285018 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 245/479] 10.222.0.16 () {60 vars in 1218 bytes} [Wed Oct 5 02:28:27 2022] POST /compute/v2.1/flavors/58210431/os-extra_specs => generated 66 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 05 02:28:27.301131 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-227cedd2-a464-4a3d-8d0d-8ad4543cd406 tempest-FlavorsExtraSpecsTestJSON-774039850 tempest-FlavorsExtraSpecsTestJSON-774039850-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:27.327135 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-227cedd2-a464-4a3d-8d0d-8ad4543cd406 tempest-FlavorsExtraSpecsTestJSON-774039850 tempest-FlavorsExtraSpecsTestJSON-774039850-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/58210431/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.034693 Oct 05 02:28:27.328771 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 246/480] 10.222.0.16 () {58 vars in 1197 bytes} [Wed Oct 5 02:28:27 2022] GET /compute/v2.1/flavors/58210431/os-extra_specs => generated 66 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:28:27.351998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-98c60de9-f47c-4fea-8a79-69fd4aa53d7c tempest-FlavorsExtraSpecsTestJSON-774039850 tempest-FlavorsExtraSpecsTestJSON-774039850-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:27.433708 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-98c60de9-f47c-4fea-8a79-69fd4aa53d7c tempest-FlavorsExtraSpecsTestJSON-774039850 tempest-FlavorsExtraSpecsTestJSON-774039850-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/58210431/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.098634 Oct 05 02:28:27.434629 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 247/481] 10.222.0.16 () {60 vars in 1259 bytes} [Wed Oct 5 02:28:27 2022] PUT /compute/v2.1/flavors/58210431/os-extra_specs/hw:numa_nodes => generated 22 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:28:27.441907 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ccfecce3-f64b-46b7-9785-215c99960e8c tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Calling method '.version_select at 0x7fcce44e2700>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:27.595013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a6c9438a-a80f-4060-8e30-047797332300 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:27.608326 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a6c9438a-a80f-4060-8e30-047797332300 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:27.613093 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a6c9438a-a80f-4060-8e30-047797332300 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:27.618448 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a6c9438a-a80f-4060-8e30-047797332300 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 200 len: 1567 microversion: 2.25 time: 0.824691 Oct 05 02:28:27.619453 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 235/482] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:28:26 2022] GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 1567 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:28:27.632833 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-24b920b7-5341-4fa2-9cf2-3530d8f7f6d4 tempest-FlavorsExtraSpecsTestJSON-774039850 tempest-FlavorsExtraSpecsTestJSON-774039850-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:27.654068 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-24b920b7-5341-4fa2-9cf2-3530d8f7f6d4 tempest-FlavorsExtraSpecsTestJSON-774039850 tempest-FlavorsExtraSpecsTestJSON-774039850-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/58210431/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.032177 Oct 05 02:28:27.654930 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 236/483] 10.222.0.16 () {58 vars in 1197 bytes} [Wed Oct 5 02:28:27 2022] GET /compute/v2.1/flavors/58210431/os-extra_specs => generated 66 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:28:27.669710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-94585972-2934-4181-a11b-00b92d720de6 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:27.670520 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-94585972-2934-4181-a11b-00b92d720de6 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] [instance: a78fb515-3979-4134-928b-9552c036e8b2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:27.678587 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94585972-2934-4181-a11b-00b92d720de6 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:27.680680 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94585972-2934-4181-a11b-00b92d720de6 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:27.681724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94585972-2934-4181-a11b-00b92d720de6 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:27.682609 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94585972-2934-4181-a11b-00b92d720de6 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:27.683687 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94585972-2934-4181-a11b-00b92d720de6 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:27.684273 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94585972-2934-4181-a11b-00b92d720de6 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:27.927346 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ccfecce3-f64b-46b7-9785-215c99960e8c tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/c6b91e8c83c14bbd95324f08142e45ab/defaults" status: 200 len: 371 microversion: 2.1 time: 0.491641 Oct 05 02:28:27.928181 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 248/484] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 5 02:28:27 2022] GET /compute/v2.1/os-quota-sets/c6b91e8c83c14bbd95324f08142e45ab/defaults => generated 371 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:27.946323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-21044971-cf3d-482f-b247-96ee779de991 tempest-FlavorsExtraSpecsTestJSON-774039850 tempest-FlavorsExtraSpecsTestJSON-774039850-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:28.001503 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-21044971-cf3d-482f-b247-96ee779de991 tempest-FlavorsExtraSpecsTestJSON-774039850 tempest-FlavorsExtraSpecsTestJSON-774039850-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/58210431/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.071045 Oct 05 02:28:28.003189 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 249/485] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 5 02:28:27 2022] DELETE /compute/v2.1/flavors/58210431/os-extra_specs/hw:numa_nodes => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 02:28:28.011720 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-64d0ae3c-d38e-4e76-82ba-54868183c81b tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Action: 'update', calling method: .version_select at 0x7fcce44fb9d0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:28.289693 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-94585972-2934-4181-a11b-00b92d720de6 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3175c74d670a49e0a7efff04e7d4e9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10beeb5ff94e4c9c9c8b801fd3c56c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:28.304360 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-94585972-2934-4181-a11b-00b92d720de6 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] 10.222.0.16 "GET /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2" status: 200 len: 1314 microversion: 2.1 time: 0.642024 Oct 05 02:28:28.317591 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 237/486] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:27 2022] GET /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2 => generated 1314 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:28.329198 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0ce44a4b-3b33-4ecb-a534-f897aae4ab36 tempest-FlavorsExtraSpecsTestJSON-774039850 tempest-FlavorsExtraSpecsTestJSON-774039850-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:28.404942 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0ce44a4b-3b33-4ecb-a534-f897aae4ab36 tempest-FlavorsExtraSpecsTestJSON-774039850 tempest-FlavorsExtraSpecsTestJSON-774039850-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/58210431/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.082023 Oct 05 02:28:28.409135 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 238/487] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 5 02:28:28 2022] DELETE /compute/v2.1/flavors/58210431/os-extra_specs/hw:cpu_policy => generated 0 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 02:28:28.423172 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-da93a56c-ff6a-4dc2-b587-bd80c85cad0b tempest-FlavorsExtraSpecsTestJSON-774039850 tempest-FlavorsExtraSpecsTestJSON-774039850-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:28.463456 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-da93a56c-ff6a-4dc2-b587-bd80c85cad0b tempest-FlavorsExtraSpecsTestJSON-774039850 tempest-FlavorsExtraSpecsTestJSON-774039850-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/58210431/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.050012 Oct 05 02:28:28.464047 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 239/488] 10.222.0.16 () {58 vars in 1197 bytes} [Wed Oct 5 02:28:28 2022] GET /compute/v2.1/flavors/58210431/os-extra_specs => generated 19 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:28:28.475853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7df19521-b7ff-4d2b-8c3d-1dd7cf83baaa tempest-FlavorsExtraSpecsTestJSON-774039850 tempest-FlavorsExtraSpecsTestJSON-774039850-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:28.508489 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7df19521-b7ff-4d2b-8c3d-1dd7cf83baaa tempest-FlavorsExtraSpecsTestJSON-774039850 tempest-FlavorsExtraSpecsTestJSON-774039850-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/58210431" status: 202 len: 0 microversion: 2.1 time: 0.036947 Oct 05 02:28:28.516447 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 240/489] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 5 02:28:28 2022] DELETE /compute/v2.1/flavors/58210431 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:28:28.524651 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fc474315-bd0b-4a82-8335-597af63ad7b7 tempest-FlavorsExtraSpecsTestJSON-774039850 tempest-FlavorsExtraSpecsTestJSON-774039850-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:28.560472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64d0ae3c-d38e-4e76-82ba-54868183c81b tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:28.561830 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64d0ae3c-d38e-4e76-82ba-54868183c81b tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:28.562495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64d0ae3c-d38e-4e76-82ba-54868183c81b tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:28.566318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64d0ae3c-d38e-4e76-82ba-54868183c81b tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:28.568537 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64d0ae3c-d38e-4e76-82ba-54868183c81b tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:28.569185 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64d0ae3c-d38e-4e76-82ba-54868183c81b tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:28.570513 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fc474315-bd0b-4a82-8335-597af63ad7b7 tempest-FlavorsExtraSpecsTestJSON-774039850 tempest-FlavorsExtraSpecsTestJSON-774039850-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.050070 Oct 05 02:28:28.571692 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 241/490] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:28:28 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:28.587241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=78 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:28.649785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e2f32939-cfa8-4a83-91b4-c965f3ec8b61 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:28.650408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e2f32939-cfa8-4a83-91b4-c965f3ec8b61 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:28.669398 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2f32939-cfa8-4a83-91b4-c965f3ec8b61 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:28.675772 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2f32939-cfa8-4a83-91b4-c965f3ec8b61 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:28.676232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2f32939-cfa8-4a83-91b4-c965f3ec8b61 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:28.677015 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2f32939-cfa8-4a83-91b4-c965f3ec8b61 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:28.680570 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2f32939-cfa8-4a83-91b4-c965f3ec8b61 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:28.685617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2f32939-cfa8-4a83-91b4-c965f3ec8b61 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:29.161622 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-64d0ae3c-d38e-4e76-82ba-54868183c81b tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/c6b91e8c83c14bbd95324f08142e45ab" status: 200 len: 329 microversion: 2.1 time: 1.156783 Oct 05 02:28:29.162254 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 250/491] 10.222.0.16 () {60 vars in 1263 bytes} [Wed Oct 5 02:28:28 2022] PUT /compute/v2.1/os-quota-sets/c6b91e8c83c14bbd95324f08142e45ab => generated 329 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:29.175082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9e6b9d31-a512-4702-b5cf-8ea1fb277699 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Action: 'update', calling method: .version_select at 0x7fcce456ab80>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:29.670201 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e2f32939-cfa8-4a83-91b4-c965f3ec8b61 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:29.680636 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e2f32939-cfa8-4a83-91b4-c965f3ec8b61 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:29.703788 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e2f32939-cfa8-4a83-91b4-c965f3ec8b61 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:29.710607 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e2f32939-cfa8-4a83-91b4-c965f3ec8b61 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 200 len: 1557 microversion: 2.25 time: 1.065021 Oct 05 02:28:29.714378 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 242/492] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:28:28 2022] GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 1557 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:28:29.740286 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4fc7cff7-7718-4827-83c7-964e037a5a15 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-566914867", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "2092938567", "adminPass": "***", "networks": [{"uuid": "8d99bddc-53f3-4733-9f3c-501e29e6e747"}], "security_groups": [{"name": "tempest-securitygroup--205126435"}], "key_name": "tempest-keypair-667138563", "user_data": "}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:30.030205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-4fc7cff7-7718-4827-83c7-964e037a5a15 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] validate_networks() for [('8d99bddc-53f3-4733-9f3c-501e29e6e747', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:28:30.111243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9e6b9d31-a512-4702-b5cf-8ea1fb277699 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:30.112539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9e6b9d31-a512-4702-b5cf-8ea1fb277699 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:30.115556 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9e6b9d31-a512-4702-b5cf-8ea1fb277699 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:30.118466 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9e6b9d31-a512-4702-b5cf-8ea1fb277699 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:30.120627 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9e6b9d31-a512-4702-b5cf-8ea1fb277699 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:30.122119 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9e6b9d31-a512-4702-b5cf-8ea1fb277699 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:30.287356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=68,nova_api:SAVEPOINT=5,nova_api:RELEASE=5,nova_api:UPDATE=4,nova_api:DELETE=1,nova_api:INSERT=17 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:30.547648 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:30.698961 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9e6b9d31-a512-4702-b5cf-8ea1fb277699 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/c6b91e8c83c14bbd95324f08142e45ab" status: 200 len: 329 microversion: 2.1 time: 1.528401 Oct 05 02:28:30.710382 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 251/493] 10.222.0.16 () {60 vars in 1263 bytes} [Wed Oct 5 02:28:29 2022] PUT /compute/v2.1/os-quota-sets/c6b91e8c83c14bbd95324f08142e45ab => generated 329 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:30.722861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9d1a02bc-096b-4b96-82ac-24b113fede61 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:30.727009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9d1a02bc-096b-4b96-82ac-24b113fede61 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] [instance: a78fb515-3979-4134-928b-9552c036e8b2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:30.737831 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d1a02bc-096b-4b96-82ac-24b113fede61 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:30.739372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d1a02bc-096b-4b96-82ac-24b113fede61 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:30.741604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d1a02bc-096b-4b96-82ac-24b113fede61 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:30.742476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d1a02bc-096b-4b96-82ac-24b113fede61 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:30.744333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d1a02bc-096b-4b96-82ac-24b113fede61 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:30.745908 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d1a02bc-096b-4b96-82ac-24b113fede61 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:31.339397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-4fc7cff7-7718-4827-83c7-964e037a5a15 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:28:31.339987 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-4fc7cff7-7718-4827-83c7-964e037a5a15 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:28:31.340854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-4fc7cff7-7718-4827-83c7-964e037a5a15 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:28:31.341316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-4fc7cff7-7718-4827-83c7-964e037a5a15 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:28:31.341752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-4fc7cff7-7718-4827-83c7-964e037a5a15 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:28:31.365264 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4fc7cff7-7718-4827-83c7-964e037a5a15 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:31.366019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4fc7cff7-7718-4827-83c7-964e037a5a15 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:31.366626 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4fc7cff7-7718-4827-83c7-964e037a5a15 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:31.367566 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4fc7cff7-7718-4827-83c7-964e037a5a15 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:31.368182 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4fc7cff7-7718-4827-83c7-964e037a5a15 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:31.368770 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4fc7cff7-7718-4827-83c7-964e037a5a15 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:31.417850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-4fc7cff7-7718-4827-83c7-964e037a5a15 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Getting quotas for project fecbac50c16847799a85c148c6c143de. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:28:31.428427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-4fc7cff7-7718-4827-83c7-964e037a5a15 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Getting quotas for user 368f6c3db9f24561a13f48ce02e7655e and project fecbac50c16847799a85c148c6c143de. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:28:31.435148 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9d1a02bc-096b-4b96-82ac-24b113fede61 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3175c74d670a49e0a7efff04e7d4e9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10beeb5ff94e4c9c9c8b801fd3c56c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:31.443692 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9d1a02bc-096b-4b96-82ac-24b113fede61 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] 10.222.0.16 "GET /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2" status: 200 len: 1314 microversion: 2.1 time: 0.731947 Oct 05 02:28:31.457265 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 252/494] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:30 2022] GET /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2 => generated 1314 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:31.466517 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7e41d07e-ad07-4b2e-b7b9-3db387cc0104 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Calling method '.version_select at 0x7fcce44ccca0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:31.475339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e41d07e-ad07-4b2e-b7b9-3db387cc0104 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:31.475826 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e41d07e-ad07-4b2e-b7b9-3db387cc0104 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:31.476278 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e41d07e-ad07-4b2e-b7b9-3db387cc0104 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:31.479385 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=6,nova_api:SAVEPOINT=4,nova_api:INSERT=2,nova_api:RELEASE=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:31.483290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4fc7cff7-7718-4827-83c7-964e037a5a15 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:28:31.486672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4fc7cff7-7718-4827-83c7-964e037a5a15 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 3245900a-6147-427e-86e3-b0af919523e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:28:31.504844 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7e41d07e-ad07-4b2e-b7b9-3db387cc0104 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 436 microversion: 2.25 time: 0.045831 Oct 05 02:28:31.506094 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 253/495] 10.222.0.16 () {60 vars in 1184 bytes} [Wed Oct 5 02:28:31 2022] GET /compute/v2.1/os-migrations => generated 436 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:28:31.522386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-be4aa984-0b5f-4489-aedd-2b49125b5c44 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:31.523024 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-be4aa984-0b5f-4489-aedd-2b49125b5c44 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:31.533943 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be4aa984-0b5f-4489-aedd-2b49125b5c44 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:31.534681 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be4aa984-0b5f-4489-aedd-2b49125b5c44 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:31.535314 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be4aa984-0b5f-4489-aedd-2b49125b5c44 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:31.546471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be4aa984-0b5f-4489-aedd-2b49125b5c44 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:31.547270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be4aa984-0b5f-4489-aedd-2b49125b5c44 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:31.547908 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be4aa984-0b5f-4489-aedd-2b49125b5c44 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:31.609640 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4fc7cff7-7718-4827-83c7-964e037a5a15 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.892587 Oct 05 02:28:31.619125 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 243/496] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:28:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 1903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:28:31.629930 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5d2e1b19-db8c-465b-a814-d7464ca2ea55 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:31.632740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5d2e1b19-db8c-465b-a814-d7464ca2ea55 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 3245900a-6147-427e-86e3-b0af919523e6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:32.046425 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5d2e1b19-db8c-465b-a814-d7464ca2ea55 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368f6c3db9f24561a13f48ce02e7655e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecbac50c16847799a85c148c6c143de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:32.072490 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5d2e1b19-db8c-465b-a814-d7464ca2ea55 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6" status: 200 len: 1263 microversion: 2.1 time: 0.444365 Oct 05 02:28:32.074211 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 244/497] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:31 2022] GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6 => generated 1263 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:32.326765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-be4aa984-0b5f-4489-aedd-2b49125b5c44 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lazy-loading 'services' on Instance uuid eddae3fc-f975-45e3-8592-01b10bcf32ad {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:28:32.486944 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8d0f8317-4d92-4ac8-9f0b-ccb983acfa0f tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:32.490369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8d0f8317-4d92-4ac8-9f0b-ccb983acfa0f tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] [instance: a78fb515-3979-4134-928b-9552c036e8b2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:32.498966 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-be4aa984-0b5f-4489-aedd-2b49125b5c44 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 200 len: 2049 microversion: 2.25 time: 0.982388 Oct 05 02:28:32.508222 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d0f8317-4d92-4ac8-9f0b-ccb983acfa0f tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:32.510552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d0f8317-4d92-4ac8-9f0b-ccb983acfa0f tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:32.511354 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d0f8317-4d92-4ac8-9f0b-ccb983acfa0f tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:32.513551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d0f8317-4d92-4ac8-9f0b-ccb983acfa0f tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:32.514185 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d0f8317-4d92-4ac8-9f0b-ccb983acfa0f tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:32.515945 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 254/498] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:28:31 2022] GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 2049 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:28:32.522886 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d0f8317-4d92-4ac8-9f0b-ccb983acfa0f tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:32.939915 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f2dea22f-5ca8-4798-b786-5e1834d5333e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1420993730", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "9671ab97-ec52-4c80-a228-74cde59af3af"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:33.036194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-f2dea22f-5ca8-4798-b786-5e1834d5333e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] validate_networks() for [('9671ab97-ec52-4c80-a228-74cde59af3af', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:28:33.638672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8d0f8317-4d92-4ac8-9f0b-ccb983acfa0f tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3175c74d670a49e0a7efff04e7d4e9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10beeb5ff94e4c9c9c8b801fd3c56c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:33.664224 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8d0f8317-4d92-4ac8-9f0b-ccb983acfa0f tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] 10.222.0.16 "GET /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2" status: 200 len: 1314 microversion: 2.1 time: 1.183883 Oct 05 02:28:33.670559 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 245/499] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:32 2022] GET /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2 => generated 1314 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:33.690916 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8c1afb72-01d6-4aca-9f4b-cd95b23c8b7a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:33.693219 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8c1afb72-01d6-4aca-9f4b-cd95b23c8b7a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 3245900a-6147-427e-86e3-b0af919523e6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:33.716493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c1afb72-01d6-4aca-9f4b-cd95b23c8b7a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:33.725179 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c1afb72-01d6-4aca-9f4b-cd95b23c8b7a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:33.726117 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c1afb72-01d6-4aca-9f4b-cd95b23c8b7a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:33.727143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c1afb72-01d6-4aca-9f4b-cd95b23c8b7a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:33.737900 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c1afb72-01d6-4aca-9f4b-cd95b23c8b7a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:33.738651 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c1afb72-01d6-4aca-9f4b-cd95b23c8b7a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:34.020213 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8c1afb72-01d6-4aca-9f4b-cd95b23c8b7a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368f6c3db9f24561a13f48ce02e7655e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecbac50c16847799a85c148c6c143de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:34.034681 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8c1afb72-01d6-4aca-9f4b-cd95b23c8b7a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6" status: 200 len: 1333 microversion: 2.1 time: 0.355675 Oct 05 02:28:34.037351 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 246/500] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:33 2022] GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6 => generated 1333 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:34.536549 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4e11c393-ffa6-4862-86b1-511bbac20324 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-821453235", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:34.628648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-4e11c393-ffa6-4862-86b1-511bbac20324 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] validate_networks() for None {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:28:34.987000 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-f2dea22f-5ca8-4798-b786-5e1834d5333e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:28:34.987737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-f2dea22f-5ca8-4798-b786-5e1834d5333e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:28:34.988235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-f2dea22f-5ca8-4798-b786-5e1834d5333e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:28:34.988645 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-f2dea22f-5ca8-4798-b786-5e1834d5333e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:28:34.989085 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-f2dea22f-5ca8-4798-b786-5e1834d5333e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:28:35.006426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f2dea22f-5ca8-4798-b786-5e1834d5333e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:35.007247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f2dea22f-5ca8-4798-b786-5e1834d5333e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:35.007875 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f2dea22f-5ca8-4798-b786-5e1834d5333e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:35.011757 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f2dea22f-5ca8-4798-b786-5e1834d5333e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:35.012436 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f2dea22f-5ca8-4798-b786-5e1834d5333e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:35.013070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f2dea22f-5ca8-4798-b786-5e1834d5333e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:35.061737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-f2dea22f-5ca8-4798-b786-5e1834d5333e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Getting quotas for project bbd25b0a68f749029eeed701c77462ce. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:28:35.078163 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-f2dea22f-5ca8-4798-b786-5e1834d5333e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Getting quotas for user 39671ba0b86847f995c96013947fee65 and project bbd25b0a68f749029eeed701c77462ce. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:28:35.126452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f2dea22f-5ca8-4798-b786-5e1834d5333e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:28:35.152288 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f2dea22f-5ca8-4798-b786-5e1834d5333e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:28:35.198642 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-4e11c393-ffa6-4862-86b1-511bbac20324 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:28:35.199139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-4e11c393-ffa6-4862-86b1-511bbac20324 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:28:35.199710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-4e11c393-ffa6-4862-86b1-511bbac20324 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:28:35.200157 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-4e11c393-ffa6-4862-86b1-511bbac20324 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:28:35.200587 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-4e11c393-ffa6-4862-86b1-511bbac20324 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:28:35.232701 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e11c393-ffa6-4862-86b1-511bbac20324 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:35.240252 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e11c393-ffa6-4862-86b1-511bbac20324 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:35.240730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e11c393-ffa6-4862-86b1-511bbac20324 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:35.241585 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e11c393-ffa6-4862-86b1-511bbac20324 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:35.244562 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e11c393-ffa6-4862-86b1-511bbac20324 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:35.245045 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e11c393-ffa6-4862-86b1-511bbac20324 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:35.312389 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-4e11c393-ffa6-4862-86b1-511bbac20324 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Getting quotas for project 7a87f178aedc4acbb4bd353bc09a7cb3. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:28:35.313204 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f2dea22f-5ca8-4798-b786-5e1834d5333e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.374698 Oct 05 02:28:35.325742 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 255/501] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 5 02:28:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2390 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 05 02:28:35.340567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-4e11c393-ffa6-4862-86b1-511bbac20324 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Getting quotas for user 1d5d53045696469487a6be6640b07f6e and project 7a87f178aedc4acbb4bd353bc09a7cb3. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:28:35.344881 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-89877a08-a4d1-4bdc-856d-293a324fa46a tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:35.359575 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-89877a08-a4d1-4bdc-856d-293a324fa46a tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] [instance: a78fb515-3979-4134-928b-9552c036e8b2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:35.390974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-89877a08-a4d1-4bdc-856d-293a324fa46a tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:35.391472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-89877a08-a4d1-4bdc-856d-293a324fa46a tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:35.398140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-89877a08-a4d1-4bdc-856d-293a324fa46a tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:35.400297 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-89877a08-a4d1-4bdc-856d-293a324fa46a tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:35.404567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-89877a08-a4d1-4bdc-856d-293a324fa46a tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:35.405245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-89877a08-a4d1-4bdc-856d-293a324fa46a tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:35.419776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4e11c393-ffa6-4862-86b1-511bbac20324 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:28:35.430739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4e11c393-ffa6-4862-86b1-511bbac20324 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 04eb32f6-e354-4960-8e0b-0a0e20dcfe04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:28:35.572805 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4e11c393-ffa6-4862-86b1-511bbac20324 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.522227 Oct 05 02:28:35.584587 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 247/502] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:28:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:28:35.595265 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0c4f54fc-326a-4960-89fc-565ff69df77e tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:35.598490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0c4f54fc-326a-4960-89fc-565ff69df77e tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 3245900a-6147-427e-86e3-b0af919523e6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:35.620559 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c4f54fc-326a-4960-89fc-565ff69df77e tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:35.621311 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c4f54fc-326a-4960-89fc-565ff69df77e tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:35.623277 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c4f54fc-326a-4960-89fc-565ff69df77e tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:35.625730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c4f54fc-326a-4960-89fc-565ff69df77e tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:35.626486 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c4f54fc-326a-4960-89fc-565ff69df77e tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:35.637461 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c4f54fc-326a-4960-89fc-565ff69df77e tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:35.947275 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0c4f54fc-326a-4960-89fc-565ff69df77e tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368f6c3db9f24561a13f48ce02e7655e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecbac50c16847799a85c148c6c143de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:35.956603 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0c4f54fc-326a-4960-89fc-565ff69df77e tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6" status: 200 len: 1321 microversion: 2.1 time: 0.370564 Oct 05 02:28:35.964999 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 248/503] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:35 2022] GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6 => generated 1321 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:35.976880 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-eb9553dd-f4d6-4d44-8283-894861d18a20 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:35.988628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-eb9553dd-f4d6-4d44-8283-894861d18a20 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:36.072655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-89877a08-a4d1-4bdc-856d-293a324fa46a tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3175c74d670a49e0a7efff04e7d4e9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10beeb5ff94e4c9c9c8b801fd3c56c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:36.088383 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-89877a08-a4d1-4bdc-856d-293a324fa46a tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] 10.222.0.16 "GET /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2" status: 200 len: 1314 microversion: 2.1 time: 0.761252 Oct 05 02:28:36.093277 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 256/504] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:35 2022] GET /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2 => generated 1314 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:36.106959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-68386cf3-a379-4f8d-95be-b0722bd58d5b tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:36.107720 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-68386cf3-a379-4f8d-95be-b0722bd58d5b tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 04eb32f6-e354-4960-8e0b-0a0e20dcfe04] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:36.337721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-eb9553dd-f4d6-4d44-8283-894861d18a20 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:36.356999 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-eb9553dd-f4d6-4d44-8283-894861d18a20 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:36.362567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-eb9553dd-f4d6-4d44-8283-894861d18a20 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:36.367043 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-eb9553dd-f4d6-4d44-8283-894861d18a20 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af" status: 200 len: 1262 microversion: 2.25 time: 0.397866 Oct 05 02:28:36.369907 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 249/505] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:28:35 2022] GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af => generated 1262 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:28:36.404570 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-68386cf3-a379-4f8d-95be-b0722bd58d5b tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d53045696469487a6be6640b07f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a87f178aedc4acbb4bd353bc09a7cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:36.427599 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-68386cf3-a379-4f8d-95be-b0722bd58d5b tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] 10.222.0.16 "GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04" status: 200 len: 1218 microversion: 2.1 time: 0.333194 Oct 05 02:28:36.434664 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 257/506] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:36 2022] GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04 => generated 1218 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:36.983179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5d98ea87-8182-4e8c-9d83-b93e4be6ba99 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:36.984065 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5d98ea87-8182-4e8c-9d83-b93e4be6ba99 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 3245900a-6147-427e-86e3-b0af919523e6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:36.992058 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d98ea87-8182-4e8c-9d83-b93e4be6ba99 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:36.997586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d98ea87-8182-4e8c-9d83-b93e4be6ba99 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:36.998093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d98ea87-8182-4e8c-9d83-b93e4be6ba99 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:36.998898 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d98ea87-8182-4e8c-9d83-b93e4be6ba99 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:36.999322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d98ea87-8182-4e8c-9d83-b93e4be6ba99 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:36.999748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d98ea87-8182-4e8c-9d83-b93e4be6ba99 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:37.213325 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2b223dbd-03dd-450e-be7b-b581ed6b22f9 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Calling method '.version_select at 0x7fcce437b430>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:37.228407 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b223dbd-03dd-450e-be7b-b581ed6b22f9 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:37.229427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b223dbd-03dd-450e-be7b-b581ed6b22f9 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:37.229877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b223dbd-03dd-450e-be7b-b581ed6b22f9 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:37.275042 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b223dbd-03dd-450e-be7b-b581ed6b22f9 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:37.277923 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b223dbd-03dd-450e-be7b-b581ed6b22f9 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:37.278784 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b223dbd-03dd-450e-be7b-b581ed6b22f9 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:37.295000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b223dbd-03dd-450e-be7b-b581ed6b22f9 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:37.295854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b223dbd-03dd-450e-be7b-b581ed6b22f9 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:37.296478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b223dbd-03dd-450e-be7b-b581ed6b22f9 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:37.305377 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2b223dbd-03dd-450e-be7b-b581ed6b22f9 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.933793 Oct 05 02:28:37.315873 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 250/507] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:28:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:37.322052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e11d17b1-b69c-4954-81ba-045c21120031 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:37.323100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e11d17b1-b69c-4954-81ba-045c21120031 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] [instance: a78fb515-3979-4134-928b-9552c036e8b2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:37.337274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e11d17b1-b69c-4954-81ba-045c21120031 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:37.338440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e11d17b1-b69c-4954-81ba-045c21120031 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:37.340463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e11d17b1-b69c-4954-81ba-045c21120031 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:37.342594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e11d17b1-b69c-4954-81ba-045c21120031 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:37.343991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e11d17b1-b69c-4954-81ba-045c21120031 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:37.345540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e11d17b1-b69c-4954-81ba-045c21120031 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:38.305545 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5d98ea87-8182-4e8c-9d83-b93e4be6ba99 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368f6c3db9f24561a13f48ce02e7655e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecbac50c16847799a85c148c6c143de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:38.317327 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e11d17b1-b69c-4954-81ba-045c21120031 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3175c74d670a49e0a7efff04e7d4e9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10beeb5ff94e4c9c9c8b801fd3c56c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:38.321329 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5d98ea87-8182-4e8c-9d83-b93e4be6ba99 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6" status: 200 len: 1388 microversion: 2.1 time: 1.341709 Oct 05 02:28:38.325610 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 258/508] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:36 2022] GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6 => generated 1388 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:28:38.341961 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3d447391-7e8e-4a64-a598-de939796c7b2 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Calling method '.version_select at 0x7fcce44fb310>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:38.342355 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e11d17b1-b69c-4954-81ba-045c21120031 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] 10.222.0.16 "GET /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2" status: 200 len: 1314 microversion: 2.1 time: 1.024442 Oct 05 02:28:38.346212 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 251/509] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:37 2022] GET /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2 => generated 1314 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:38.346948 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3d447391-7e8e-4a64-a598-de939796c7b2 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:38.347756 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3d447391-7e8e-4a64-a598-de939796c7b2 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:38.348265 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3d447391-7e8e-4a64-a598-de939796c7b2 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:38.360918 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f0ba849e-babd-44bf-9a0d-af61e45be236 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:38.362260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f0ba849e-babd-44bf-9a0d-af61e45be236 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:38.373795 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0ba849e-babd-44bf-9a0d-af61e45be236 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:38.375820 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0ba849e-babd-44bf-9a0d-af61e45be236 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:38.378215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0ba849e-babd-44bf-9a0d-af61e45be236 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:38.379404 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0ba849e-babd-44bf-9a0d-af61e45be236 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:38.381820 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0ba849e-babd-44bf-9a0d-af61e45be236 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:38.382415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0ba849e-babd-44bf-9a0d-af61e45be236 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:38.398938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3d447391-7e8e-4a64-a598-de939796c7b2 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:38.399442 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3d447391-7e8e-4a64-a598-de939796c7b2 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:38.399879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3d447391-7e8e-4a64-a598-de939796c7b2 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:38.432779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3d447391-7e8e-4a64-a598-de939796c7b2 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:38.436866 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3d447391-7e8e-4a64-a598-de939796c7b2 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:38.437352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3d447391-7e8e-4a64-a598-de939796c7b2 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:38.465233 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3d447391-7e8e-4a64-a598-de939796c7b2 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.132084 Oct 05 02:28:38.492447 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 259/510] 10.222.0.16 () {58 vars in 1167 bytes} [Wed Oct 5 02:28:38 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:38.501912 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7aa52508-a630-4a2c-be96-c8a05f1eae88 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:38.503546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7aa52508-a630-4a2c-be96-c8a05f1eae88 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 04eb32f6-e354-4960-8e0b-0a0e20dcfe04] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:38.511960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7aa52508-a630-4a2c-be96-c8a05f1eae88 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:38.512698 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7aa52508-a630-4a2c-be96-c8a05f1eae88 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:38.513347 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7aa52508-a630-4a2c-be96-c8a05f1eae88 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:38.514210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7aa52508-a630-4a2c-be96-c8a05f1eae88 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:38.514822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7aa52508-a630-4a2c-be96-c8a05f1eae88 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:38.515473 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7aa52508-a630-4a2c-be96-c8a05f1eae88 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:38.703993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f0ba849e-babd-44bf-9a0d-af61e45be236 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:38.717737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f0ba849e-babd-44bf-9a0d-af61e45be236 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:38.719195 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f0ba849e-babd-44bf-9a0d-af61e45be236 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:38.720316 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f0ba849e-babd-44bf-9a0d-af61e45be236 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af" status: 200 len: 1320 microversion: 2.25 time: 0.363490 Oct 05 02:28:38.726969 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 252/511] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:28:38 2022] GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af => generated 1320 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:28:38.734905 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-fefdb5c0-c355-4dc7-b276-59ab62ebb4ed req-69c59389-63c5-43e2-b38a-3e0ed1ad1697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78fb515-3979-4134-928b-9552c036e8b2", "name": "network-vif-plugged", "status": "completed", "tag": "d569f8c8-2957-4ebb-9105-c4480d3ada02"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:38.760336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-fefdb5c0-c355-4dc7-b276-59ab62ebb4ed req-69c59389-63c5-43e2-b38a-3e0ed1ad1697 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:38.764331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-fefdb5c0-c355-4dc7-b276-59ab62ebb4ed req-69c59389-63c5-43e2-b38a-3e0ed1ad1697 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:38.765045 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-fefdb5c0-c355-4dc7-b276-59ab62ebb4ed req-69c59389-63c5-43e2-b38a-3e0ed1ad1697 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:38.799798 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-fefdb5c0-c355-4dc7-b276-59ab62ebb4ed req-69c59389-63c5-43e2-b38a-3e0ed1ad1697 service nova] Creating event network-vif-plugged:d569f8c8-2957-4ebb-9105-c4480d3ada02 for instance a78fb515-3979-4134-928b-9552c036e8b2 on n-h1-858272-3 Oct 05 02:28:38.811839 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-fefdb5c0-c355-4dc7-b276-59ab62ebb4ed req-69c59389-63c5-43e2-b38a-3e0ed1ad1697 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077581 Oct 05 02:28:38.812795 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 253/512] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:38.817966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-24c64332-cc14-41d2-a43d-2eacdfe716c3 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Calling method '.version_select at 0x7fcce44009d0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:38.826111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24c64332-cc14-41d2-a43d-2eacdfe716c3 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:38.829349 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24c64332-cc14-41d2-a43d-2eacdfe716c3 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:38.829934 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24c64332-cc14-41d2-a43d-2eacdfe716c3 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:38.864098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24c64332-cc14-41d2-a43d-2eacdfe716c3 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:38.864836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24c64332-cc14-41d2-a43d-2eacdfe716c3 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:38.865475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24c64332-cc14-41d2-a43d-2eacdfe716c3 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:38.878189 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24c64332-cc14-41d2-a43d-2eacdfe716c3 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:38.878961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24c64332-cc14-41d2-a43d-2eacdfe716c3 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:38.879545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24c64332-cc14-41d2-a43d-2eacdfe716c3 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:38.884243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7aa52508-a630-4a2c-be96-c8a05f1eae88 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d53045696469487a6be6640b07f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a87f178aedc4acbb4bd353bc09a7cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:38.888110 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-24c64332-cc14-41d2-a43d-2eacdfe716c3 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.074090 Oct 05 02:28:38.888956 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 254/513] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:28:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:38.898164 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7aa52508-a630-4a2c-be96-c8a05f1eae88 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] 10.222.0.16 "GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04" status: 200 len: 1270 microversion: 2.1 time: 0.404249 Oct 05 02:28:38.898935 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 260/514] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:38 2022] GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04 => generated 1270 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:38.903494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9b547aa5-a815-4a0d-ab01-4157c0f2d135 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Calling method '.version_select at 0x7fcce44ccaf0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:38.909971 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b547aa5-a815-4a0d-ab01-4157c0f2d135 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:38.910457 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b547aa5-a815-4a0d-ab01-4157c0f2d135 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:38.911092 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b547aa5-a815-4a0d-ab01-4157c0f2d135 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:38.950197 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b547aa5-a815-4a0d-ab01-4157c0f2d135 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:38.956922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b547aa5-a815-4a0d-ab01-4157c0f2d135 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:38.957384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b547aa5-a815-4a0d-ab01-4157c0f2d135 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:38.968048 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9b547aa5-a815-4a0d-ab01-4157c0f2d135 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.067729 Oct 05 02:28:38.969435 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 261/515] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 5 02:28:38 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:38.988303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-127c4e8f-cb3f-4e28-9b02-06e49248035d tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Calling method '.version_select at 0x7fcce44cc790>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:38.990351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-127c4e8f-cb3f-4e28-9b02-06e49248035d tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:38.991040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-127c4e8f-cb3f-4e28-9b02-06e49248035d tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:38.991489 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-127c4e8f-cb3f-4e28-9b02-06e49248035d tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:39.013138 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-127c4e8f-cb3f-4e28-9b02-06e49248035d tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.030348 Oct 05 02:28:39.014065 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 262/516] 10.222.0.16 () {58 vars in 1179 bytes} [Wed Oct 5 02:28:38 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:28:39.027479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-32cffba3-3c44-4cae-86d8-080f6b89e365 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Calling method '.version_select at 0x7fcce44cc040>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:39.030019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32cffba3-3c44-4cae-86d8-080f6b89e365 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:39.030728 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32cffba3-3c44-4cae-86d8-080f6b89e365 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:39.031333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32cffba3-3c44-4cae-86d8-080f6b89e365 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:39.052882 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32cffba3-3c44-4cae-86d8-080f6b89e365 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:39.053698 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32cffba3-3c44-4cae-86d8-080f6b89e365 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:39.054140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32cffba3-3c44-4cae-86d8-080f6b89e365 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:39.068512 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32cffba3-3c44-4cae-86d8-080f6b89e365 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:39.069325 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32cffba3-3c44-4cae-86d8-080f6b89e365 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:39.069772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32cffba3-3c44-4cae-86d8-080f6b89e365 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:39.077400 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-32cffba3-3c44-4cae-86d8-080f6b89e365 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.053890 Oct 05 02:28:39.078700 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 263/517] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:28:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:28:39.092548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6e4bcdd6-3dd2-4036-9149-1ff4614015da tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Calling method '.version_select at 0x7fcce44cc820>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:39.094631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e4bcdd6-3dd2-4036-9149-1ff4614015da tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:39.095345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e4bcdd6-3dd2-4036-9149-1ff4614015da tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:39.097698 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e4bcdd6-3dd2-4036-9149-1ff4614015da tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:39.115267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e4bcdd6-3dd2-4036-9149-1ff4614015da tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:39.115770 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e4bcdd6-3dd2-4036-9149-1ff4614015da tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:39.116209 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e4bcdd6-3dd2-4036-9149-1ff4614015da tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:39.132634 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6e4bcdd6-3dd2-4036-9149-1ff4614015da tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.044506 Oct 05 02:28:39.136636 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 264/518] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 5 02:28:39 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:39.154583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-c03e5c9b-83b5-43ca-a794-8c0afe198212 req-b2e29070-86b5-4260-8587-e848c0d72ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3245900a-6147-427e-86e3-b0af919523e6", "tag": "11e57809-b0ee-4162-9bf6-2a552194ea98"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:39.162489 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f8d82adc-68e6-4d43-8668-b5d30fa304ff tempest-TenantUsagesNegativeTestJSON-59794204 tempest-TenantUsagesNegativeTestJSON-59794204-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-04T02%3A28%3A38.856723&end=2022-10-06T02%3A28%3A38.856723" status: 404 len: 112 microversion: - time: 0.272178 Oct 05 02:28:39.163012 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 255/519] 10.222.0.16 () {58 vars in 1316 bytes} [Wed Oct 5 02:28:38 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-04T02%3A28%3A38.856723&end=2022-10-06T02%3A28%3A38.856723 => generated 112 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 05 02:28:39.169778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c03e5c9b-83b5-43ca-a794-8c0afe198212 req-b2e29070-86b5-4260-8587-e848c0d72ea0 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:39.170666 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c03e5c9b-83b5-43ca-a794-8c0afe198212 req-b2e29070-86b5-4260-8587-e848c0d72ea0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:39.171279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c03e5c9b-83b5-43ca-a794-8c0afe198212 req-b2e29070-86b5-4260-8587-e848c0d72ea0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:39.173582 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-323650c0-d395-40df-8567-b114921d95c9 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Calling method '.version_select at 0x7fcce44005e0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:39.176488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-323650c0-d395-40df-8567-b114921d95c9 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:39.181799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-323650c0-d395-40df-8567-b114921d95c9 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:39.182608 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-323650c0-d395-40df-8567-b114921d95c9 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:39.193076 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-c03e5c9b-83b5-43ca-a794-8c0afe198212 req-b2e29070-86b5-4260-8587-e848c0d72ea0 service nova] Creating event network-changed:11e57809-b0ee-4162-9bf6-2a552194ea98 for instance 3245900a-6147-427e-86e3-b0af919523e6 on n-h2-858272-3 Oct 05 02:28:39.200725 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-c03e5c9b-83b5-43ca-a794-8c0afe198212 req-b2e29070-86b5-4260-8587-e848c0d72ea0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059589 Oct 05 02:28:39.208252 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 265/520] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:39.215245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-323650c0-d395-40df-8567-b114921d95c9 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:39.215430 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b86253f6-86cd-4ba6-a963-bdf05142f056 tempest-TenantUsagesNegativeTestJSON-59794204 tempest-TenantUsagesNegativeTestJSON-59794204-project-admin] Calling method '.version_select at 0x7fcce456a040>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:39.216119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-323650c0-d395-40df-8567-b114921d95c9 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:39.216742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-323650c0-d395-40df-8567-b114921d95c9 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:39.225528 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-b86253f6-86cd-4ba6-a963-bdf05142f056 tempest-TenantUsagesNegativeTestJSON-59794204 tempest-TenantUsagesNegativeTestJSON-59794204-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 05 02:28:39.226769 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-323650c0-d395-40df-8567-b114921d95c9 tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.056740 Oct 05 02:28:39.227887 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 256/521] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 5 02:28:39 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:39.240114 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b86253f6-86cd-4ba6-a963-bdf05142f056 tempest-TenantUsagesNegativeTestJSON-59794204 tempest-TenantUsagesNegativeTestJSON-59794204-project-admin] Request method failure captured: Oct 05 02:28:39.240114 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/os-simple-tenant-usage/a4e29dfc5d134b6eb25c4c35b8fcecc3?start=2022-10-06T02%3A28%3A38.856723&end=2022-10-04T02%3A28%3A38.856723 HTTP/1.1 Oct 05 02:28:39.240114 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:28:39.240114 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:28:39.240114 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:28:39.240114 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:28:39.240114 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:28:39.240114 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:28:39.240114 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:28:39.240114 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:39.240114 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOvWZ68gqRi4tQS2idV-LPHfLdvU0b5CWXbHDeyZMbLMfw9Oppt0WN36Pz-n5YBVslbSbOGXIH_SYe0HopE1LlxmGfKvUnuaVrg-GxFb_ftqeA7ZQWTRlkwZDV6F-zTqZ8Y0jWkmISa6pKbiAHmrJ8GKYD41qlUlK_iC9xKnOZNdnlw Oct 05 02:28:39.240114 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:28:39.240114 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:28:39.240114 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:28:39.240114 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:28:39.240114 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:28:39.240114 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:28:39.240114 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 63621f674d004b30a2b9fd5d4d4ffbc5 Oct 05 02:28:39.240114 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-59794204 Oct 05 02:28:39.240114 n-d-858272-3 devstack@n-api.service[122319]: X-Role: admin,member,reader Oct 05 02:28:39.240114 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: admin,member,reader Oct 05 02:28:39.241530 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/63621f674d004b30a2b9fd5d4d4ffbc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/63621f674d004b30a2b9fd5d4d4ffbc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/63621f674d004b30a2b9fd5d4d4ffbc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_63621f674d004b30a2b9fd5d4d4ffbc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:39.241530 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-59794204 Oct 05 02:28:39.241530 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 63621f674d004b30a2b9fd5d4d4ffbc5 Oct 05 02:28:39.241530 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-59794204 Oct 05 02:28:39.241530 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TenantUsagesNegativeTestJSON-59794204-project-admin Oct 05 02:28:39.241530 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:28:39.241530 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:28:39.241530 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 56726fdf38eb42109474b9eb27e3222e Oct 05 02:28:39.241530 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-59794204-project-admin Oct 05 02:28:39.241530 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:28:39.241530 n-d-858272-3 devstack@n-api.service[122319]: exception: Invalid start time. The start time cannot occur after the end time. Oct 05 02:28:39.241530 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'a4e29dfc5d134b6eb25c4c35b8fcecc3'} Oct 05 02:28:39.242299 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:39.242299 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:39.242299 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:39.242299 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:39.242299 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:39.242299 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:39.242299 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:28:39.242299 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:28:39.242299 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 02:28:39.242299 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:28:39.242299 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:39.242299 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:39.242299 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 05 02:28:39.242299 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 05 02:28:39.242299 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 05 02:28:39.242299 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 05 02:28:39.242299 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 05 02:28:39.242299 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 05 02:28:39.242299 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 05 02:28:39.243466 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:39.243466 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:39.243466 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:39.243466 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:39.243466 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:39.243466 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:39.243466 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:28:39.243466 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:28:39.243466 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 05 02:28:39.243466 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:39.243466 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b86253f6-86cd-4ba6-a963-bdf05142f056 tempest-TenantUsagesNegativeTestJSON-59794204 tempest-TenantUsagesNegativeTestJSON-59794204-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:39.243466 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b86253f6-86cd-4ba6-a963-bdf05142f056 tempest-TenantUsagesNegativeTestJSON-59794204 tempest-TenantUsagesNegativeTestJSON-59794204-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/a4e29dfc5d134b6eb25c4c35b8fcecc3?start=2022-10-06T02%3A28%3A38.856723&end=2022-10-04T02%3A28%3A38.856723" status: 400 len: 111 microversion: 2.1 time: 0.032030 Oct 05 02:28:39.244202 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 266/522] 10.222.0.16 () {58 vars in 1412 bytes} [Wed Oct 5 02:28:39 2022] GET /compute/v2.1/os-simple-tenant-usage/a4e29dfc5d134b6eb25c4c35b8fcecc3?start=2022-10-06T02%3A28%3A38.856723&end=2022-10-04T02%3A28%3A38.856723 => generated 111 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:28:39.253019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-27662077-e9e3-4231-9d65-aa79fff5663e tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Calling method '.version_select at 0x7fcce4400700>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:39.255610 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27662077-e9e3-4231-9d65-aa79fff5663e tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:39.256235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27662077-e9e3-4231-9d65-aa79fff5663e tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:39.256675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27662077-e9e3-4231-9d65-aa79fff5663e tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:39.271630 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27662077-e9e3-4231-9d65-aa79fff5663e tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:39.272112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27662077-e9e3-4231-9d65-aa79fff5663e tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:39.272544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27662077-e9e3-4231-9d65-aa79fff5663e tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:39.310584 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27662077-e9e3-4231-9d65-aa79fff5663e tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:39.311087 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27662077-e9e3-4231-9d65-aa79fff5663e tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:39.311536 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27662077-e9e3-4231-9d65-aa79fff5663e tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:39.366185 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-27662077-e9e3-4231-9d65-aa79fff5663e tempest-HypervisorAdminTestJSON-60041681 tempest-HypervisorAdminTestJSON-60041681-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.125116 Oct 05 02:28:39.367297 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 257/523] 10.222.0.16 () {58 vars in 1173 bytes} [Wed Oct 5 02:28:39 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:28:39.389790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9a32f07a-74a1-4c34-935e-a725cbea0220 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:39.393139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9a32f07a-74a1-4c34-935e-a725cbea0220 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 3245900a-6147-427e-86e3-b0af919523e6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:39.402767 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a32f07a-74a1-4c34-935e-a725cbea0220 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:39.403435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a32f07a-74a1-4c34-935e-a725cbea0220 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:39.404071 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a32f07a-74a1-4c34-935e-a725cbea0220 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:39.411134 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a32f07a-74a1-4c34-935e-a725cbea0220 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:39.411625 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a32f07a-74a1-4c34-935e-a725cbea0220 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:39.412057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a32f07a-74a1-4c34-935e-a725cbea0220 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:39.570462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2d940823-cbd3-4de8-a748-f21ffbb2a5ab tempest-TenantUsagesNegativeTestJSON-1975389579 tempest-TenantUsagesNegativeTestJSON-1975389579-project] Calling method '.version_select at 0x7fcce44de550>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:39.575053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2d940823-cbd3-4de8-a748-f21ffbb2a5ab tempest-TenantUsagesNegativeTestJSON-1975389579 tempest-TenantUsagesNegativeTestJSON-1975389579-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '80deacd67ee24d8d9ff9dfe9395b54bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e29dfc5d134b6eb25c4c35b8fcecc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:39.578425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2d940823-cbd3-4de8-a748-f21ffbb2a5ab tempest-TenantUsagesNegativeTestJSON-1975389579 tempest-TenantUsagesNegativeTestJSON-1975389579-project] Request method failure captured: Oct 05 02:28:39.578425 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-04T02%3A28%3A38.856723&end=2022-10-06T02%3A28%3A38.856723&detailed=1 HTTP/1.1 Oct 05 02:28:39.578425 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:28:39.578425 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:28:39.578425 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:28:39.578425 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:28:39.578425 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:28:39.578425 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:28:39.578425 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:28:39.578425 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:39.578425 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOvV24iVx9-dbkn-uU9lBdkpiE2XvUvKiXb62zGz1R8Mwdh1qMO28BGu-ehcxSK5HTH92D2kn8AIr6fn04GTfgdZQGnKE3N6dQElj51qC9C6gCKVlXndgGrVZHFYvWi8G84XDvloam-bfp_dPZ-2-6WEQUcDF19kA3-16DeMCfn6r9M Oct 05 02:28:39.578425 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:28:39.578425 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:28:39.578425 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:28:39.578425 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:28:39.578425 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:28:39.578425 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:28:39.578425 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: a4e29dfc5d134b6eb25c4c35b8fcecc3 Oct 05 02:28:39.578425 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1975389579 Oct 05 02:28:39.578425 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:28:39.578425 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:28:39.579834 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a4e29dfc5d134b6eb25c4c35b8fcecc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a4e29dfc5d134b6eb25c4c35b8fcecc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a4e29dfc5d134b6eb25c4c35b8fcecc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a4e29dfc5d134b6eb25c4c35b8fcecc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:39.579834 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1975389579 Oct 05 02:28:39.579834 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: a4e29dfc5d134b6eb25c4c35b8fcecc3 Oct 05 02:28:39.579834 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1975389579 Oct 05 02:28:39.579834 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TenantUsagesNegativeTestJSON-1975389579-project Oct 05 02:28:39.579834 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:28:39.579834 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:28:39.579834 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 80deacd67ee24d8d9ff9dfe9395b54bf Oct 05 02:28:39.579834 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1975389579-project Oct 05 02:28:39.579834 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:28:39.579834 n-d-858272-3 devstack@n-api.service[122319]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 05 02:28:39.579834 n-d-858272-3 devstack@n-api.service[122319]: action_args: {} Oct 05 02:28:39.579834 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:39.582747 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:39.582747 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:39.582747 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:39.582747 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:39.582747 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:39.582747 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:28:39.582747 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:28:39.582747 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 02:28:39.582747 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:28:39.582747 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:39.582747 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:39.582747 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 05 02:28:39.582747 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 05 02:28:39.582747 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 05 02:28:39.582747 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 05 02:28:39.582747 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 02:28:39.582747 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 02:28:39.582747 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 02:28:39.582747 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 02:28:39.584342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:28:39.584342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:28:39.584342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:28:39.584342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:28:39.584342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 02:28:39.584342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 02:28:39.584342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 02:28:39.584342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 02:28:39.584342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:28:39.584342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 02:28:39.584342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 05 02:28:39.584342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:39.584342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:39.584342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:39.584342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:39.584342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:39.584342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:39.584342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 02:28:39.584342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 02:28:39.585682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 05 02:28:39.585682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:39.587435 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2d940823-cbd3-4de8-a748-f21ffbb2a5ab tempest-TenantUsagesNegativeTestJSON-1975389579 tempest-TenantUsagesNegativeTestJSON-1975389579-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:39.589126 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2d940823-cbd3-4de8-a748-f21ffbb2a5ab tempest-TenantUsagesNegativeTestJSON-1975389579 tempest-TenantUsagesNegativeTestJSON-1975389579-project] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-04T02%3A28%3A38.856723&end=2022-10-06T02%3A28%3A38.856723&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.340037 Oct 05 02:28:39.592182 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 267/524] 10.222.0.16 () {58 vars in 1335 bytes} [Wed Oct 5 02:28:39 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-04T02%3A28%3A38.856723&end=2022-10-06T02%3A28%3A38.856723&detailed=1 => generated 123 bytes in 344 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:28:39.621397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-36ffdd0b-a409-48df-a895-c0a3814a8d0e tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:39.629506 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-36ffdd0b-a409-48df-a895-c0a3814a8d0e tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] [instance: a78fb515-3979-4134-928b-9552c036e8b2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:39.644531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36ffdd0b-a409-48df-a895-c0a3814a8d0e tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:39.647465 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36ffdd0b-a409-48df-a895-c0a3814a8d0e tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:39.649952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36ffdd0b-a409-48df-a895-c0a3814a8d0e tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:39.651757 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36ffdd0b-a409-48df-a895-c0a3814a8d0e tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:39.652604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36ffdd0b-a409-48df-a895-c0a3814a8d0e tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:39.653316 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36ffdd0b-a409-48df-a895-c0a3814a8d0e tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:40.633633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9a32f07a-74a1-4c34-935e-a725cbea0220 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368f6c3db9f24561a13f48ce02e7655e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecbac50c16847799a85c148c6c143de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:40.636141 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:40.650853 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9a32f07a-74a1-4c34-935e-a725cbea0220 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6" status: 200 len: 1388 microversion: 2.1 time: 1.279315 Oct 05 02:28:40.671164 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 258/525] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:39 2022] GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6 => generated 1388 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:40.684297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e544f4d9-f4d9-4027-9a69-beeb2b75d933 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:40.689412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e544f4d9-f4d9-4027-9a69-beeb2b75d933 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:40.700713 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e544f4d9-f4d9-4027-9a69-beeb2b75d933 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:40.701708 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e544f4d9-f4d9-4027-9a69-beeb2b75d933 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:40.702396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e544f4d9-f4d9-4027-9a69-beeb2b75d933 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:40.704016 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e544f4d9-f4d9-4027-9a69-beeb2b75d933 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:40.704700 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e544f4d9-f4d9-4027-9a69-beeb2b75d933 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:40.705403 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e544f4d9-f4d9-4027-9a69-beeb2b75d933 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:40.816379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-36ffdd0b-a409-48df-a895-c0a3814a8d0e tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3175c74d670a49e0a7efff04e7d4e9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10beeb5ff94e4c9c9c8b801fd3c56c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:40.825164 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-36ffdd0b-a409-48df-a895-c0a3814a8d0e tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] 10.222.0.16 "GET /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2" status: 200 len: 1314 microversion: 2.1 time: 1.231653 Oct 05 02:28:40.837535 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 268/526] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:39 2022] GET /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2 => generated 1314 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:40.853547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ec41db36-57b1-4854-bbeb-09c753027c0f tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:40.857634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ec41db36-57b1-4854-bbeb-09c753027c0f tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 04eb32f6-e354-4960-8e0b-0a0e20dcfe04] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:40.881439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec41db36-57b1-4854-bbeb-09c753027c0f tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:40.881439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec41db36-57b1-4854-bbeb-09c753027c0f tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:40.882030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec41db36-57b1-4854-bbeb-09c753027c0f tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:40.883057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec41db36-57b1-4854-bbeb-09c753027c0f tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:40.883726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec41db36-57b1-4854-bbeb-09c753027c0f tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:40.884167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec41db36-57b1-4854-bbeb-09c753027c0f tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:40.932643 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e544f4d9-f4d9-4027-9a69-beeb2b75d933 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:40.949265 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e544f4d9-f4d9-4027-9a69-beeb2b75d933 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:40.954665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e544f4d9-f4d9-4027-9a69-beeb2b75d933 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:40.958973 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e544f4d9-f4d9-4027-9a69-beeb2b75d933 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af" status: 200 len: 1320 microversion: 2.25 time: 0.286348 Oct 05 02:28:40.965023 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 259/527] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:28:40 2022] GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af => generated 1320 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:28:41.681647 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b0c41db4-67fe-4c68-8aaf-fd205e755914 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:41.689870 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b0c41db4-67fe-4c68-8aaf-fd205e755914 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 3245900a-6147-427e-86e3-b0af919523e6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:41.709238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0c41db4-67fe-4c68-8aaf-fd205e755914 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:41.712426 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0c41db4-67fe-4c68-8aaf-fd205e755914 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:41.716580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0c41db4-67fe-4c68-8aaf-fd205e755914 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:41.719213 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0c41db4-67fe-4c68-8aaf-fd205e755914 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:41.725074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0c41db4-67fe-4c68-8aaf-fd205e755914 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:41.725771 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0c41db4-67fe-4c68-8aaf-fd205e755914 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:42.469234 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ec41db36-57b1-4854-bbeb-09c753027c0f tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d53045696469487a6be6640b07f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a87f178aedc4acbb4bd353bc09a7cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:42.493932 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ec41db36-57b1-4854-bbeb-09c753027c0f tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] 10.222.0.16 "GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04" status: 200 len: 1318 microversion: 2.1 time: 1.653273 Oct 05 02:28:42.498023 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 269/528] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:40 2022] GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04 => generated 1318 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:42.507135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d37414b4-2684-4404-9c3c-0d11ff39c10e tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:42.510222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d37414b4-2684-4404-9c3c-0d11ff39c10e tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] [instance: a78fb515-3979-4134-928b-9552c036e8b2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:42.522077 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d37414b4-2684-4404-9c3c-0d11ff39c10e tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:42.526594 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d37414b4-2684-4404-9c3c-0d11ff39c10e tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:42.527346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d37414b4-2684-4404-9c3c-0d11ff39c10e tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:42.528459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d37414b4-2684-4404-9c3c-0d11ff39c10e tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:42.530057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d37414b4-2684-4404-9c3c-0d11ff39c10e tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:42.531054 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d37414b4-2684-4404-9c3c-0d11ff39c10e tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:42.639606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b0c41db4-67fe-4c68-8aaf-fd205e755914 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368f6c3db9f24561a13f48ce02e7655e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecbac50c16847799a85c148c6c143de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:42.647568 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b0c41db4-67fe-4c68-8aaf-fd205e755914 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6" status: 200 len: 1388 microversion: 2.1 time: 0.975833 Oct 05 02:28:42.670351 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 260/529] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:41 2022] GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6 => generated 1388 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:28:42.679666 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b015a2dc-c021-4473-863d-d0544fe445ea tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:42.686101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b015a2dc-c021-4473-863d-d0544fe445ea tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:42.719850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b015a2dc-c021-4473-863d-d0544fe445ea tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:42.720366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b015a2dc-c021-4473-863d-d0544fe445ea tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:42.720844 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b015a2dc-c021-4473-863d-d0544fe445ea tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:42.722279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b015a2dc-c021-4473-863d-d0544fe445ea tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:42.723107 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b015a2dc-c021-4473-863d-d0544fe445ea tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:42.723414 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b015a2dc-c021-4473-863d-d0544fe445ea tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:43.261290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d37414b4-2684-4404-9c3c-0d11ff39c10e tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3175c74d670a49e0a7efff04e7d4e9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10beeb5ff94e4c9c9c8b801fd3c56c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:43.278652 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d37414b4-2684-4404-9c3c-0d11ff39c10e tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] 10.222.0.16 "GET /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2" status: 200 len: 1464 microversion: 2.1 time: 0.779243 Oct 05 02:28:43.289042 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 270/530] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:42 2022] GET /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2 => generated 1464 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:43.473924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b015a2dc-c021-4473-863d-d0544fe445ea tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:43.494413 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b015a2dc-c021-4473-863d-d0544fe445ea tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:43.503240 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b015a2dc-c021-4473-863d-d0544fe445ea tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:43.505056 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b015a2dc-c021-4473-863d-d0544fe445ea tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af" status: 200 len: 1362 microversion: 2.25 time: 0.833159 Oct 05 02:28:43.507646 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 261/531] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:28:42 2022] GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af => generated 1362 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:28:43.524427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6ec9626f-a8d2-43d2-a89a-f58cb9798278 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:43.526479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6ec9626f-a8d2-43d2-a89a-f58cb9798278 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 04eb32f6-e354-4960-8e0b-0a0e20dcfe04] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:43.543864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ec9626f-a8d2-43d2-a89a-f58cb9798278 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:43.544361 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ec9626f-a8d2-43d2-a89a-f58cb9798278 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:43.544805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ec9626f-a8d2-43d2-a89a-f58cb9798278 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:43.545542 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ec9626f-a8d2-43d2-a89a-f58cb9798278 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:43.545998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ec9626f-a8d2-43d2-a89a-f58cb9798278 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:43.546428 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ec9626f-a8d2-43d2-a89a-f58cb9798278 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:43.838225 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-22d7708a-5be5-4141-a22e-86c93b7097af tempest-TenantUsagesTestJSON-1916060797 tempest-TenantUsagesTestJSON-1916060797-project-admin] Calling method '.version_select at 0x7fcce44fb040>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:43.880149 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22d7708a-5be5-4141-a22e-86c93b7097af tempest-TenantUsagesTestJSON-1916060797 tempest-TenantUsagesTestJSON-1916060797-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:43.881675 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22d7708a-5be5-4141-a22e-86c93b7097af tempest-TenantUsagesTestJSON-1916060797 tempest-TenantUsagesTestJSON-1916060797-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:43.883711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22d7708a-5be5-4141-a22e-86c93b7097af tempest-TenantUsagesTestJSON-1916060797 tempest-TenantUsagesTestJSON-1916060797-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:43.929819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22d7708a-5be5-4141-a22e-86c93b7097af tempest-TenantUsagesTestJSON-1916060797 tempest-TenantUsagesTestJSON-1916060797-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:43.932615 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22d7708a-5be5-4141-a22e-86c93b7097af tempest-TenantUsagesTestJSON-1916060797 tempest-TenantUsagesTestJSON-1916060797-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:43.934751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22d7708a-5be5-4141-a22e-86c93b7097af tempest-TenantUsagesTestJSON-1916060797 tempest-TenantUsagesTestJSON-1916060797-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:43.980989 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-22d7708a-5be5-4141-a22e-86c93b7097af tempest-TenantUsagesTestJSON-1916060797 tempest-TenantUsagesTestJSON-1916060797-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/10beeb5ff94e4c9c9c8b801fd3c56c66?start=2022-10-04T02%3A28%3A43.294760&end=2022-10-06T02%3A28%3A43.294760" status: 200 len: 695 microversion: 2.1 time: 0.678211 Oct 05 02:28:43.983309 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 271/532] 10.222.0.16 () {58 vars in 1412 bytes} [Wed Oct 5 02:28:43 2022] GET /compute/v2.1/os-simple-tenant-usage/10beeb5ff94e4c9c9c8b801fd3c56c66?start=2022-10-04T02%3A28%3A43.294760&end=2022-10-06T02%3A28%3A43.294760 => generated 695 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:43.991124 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7f480b0d-4559-4e00-af7c-f15243f2701b tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:43.992049 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7f480b0d-4559-4e00-af7c-f15243f2701b tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 3245900a-6147-427e-86e3-b0af919523e6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:44.004567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:INSERT=14,nova_api:SELECT=75,nova_api:UPDATE=11 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:44.013217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f480b0d-4559-4e00-af7c-f15243f2701b tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:44.013704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f480b0d-4559-4e00-af7c-f15243f2701b tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:44.014073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f480b0d-4559-4e00-af7c-f15243f2701b tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:44.014778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f480b0d-4559-4e00-af7c-f15243f2701b tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:44.015230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f480b0d-4559-4e00-af7c-f15243f2701b tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:44.015655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f480b0d-4559-4e00-af7c-f15243f2701b tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:44.304689 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6ec9626f-a8d2-43d2-a89a-f58cb9798278 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d53045696469487a6be6640b07f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a87f178aedc4acbb4bd353bc09a7cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:44.312322 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6ec9626f-a8d2-43d2-a89a-f58cb9798278 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] 10.222.0.16 "GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04" status: 200 len: 1318 microversion: 2.1 time: 0.792089 Oct 05 02:28:44.325403 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 262/533] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:43 2022] GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04 => generated 1318 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:44.334644 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dbeb6fa7-e0dd-4652-adec-5c7864f4ab5d tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Calling method '.version_select at 0x7fcce435bf70>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:44.348233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dbeb6fa7-e0dd-4652-adec-5c7864f4ab5d tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:44.348739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dbeb6fa7-e0dd-4652-adec-5c7864f4ab5d tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:44.349334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dbeb6fa7-e0dd-4652-adec-5c7864f4ab5d tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:44.372654 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dbeb6fa7-e0dd-4652-adec-5c7864f4ab5d tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:44.373203 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dbeb6fa7-e0dd-4652-adec-5c7864f4ab5d tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:44.373646 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dbeb6fa7-e0dd-4652-adec-5c7864f4ab5d tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:44.393717 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dbeb6fa7-e0dd-4652-adec-5c7864f4ab5d tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/10beeb5ff94e4c9c9c8b801fd3c56c66?start=2022-10-04T02%3A28%3A43.294760&end=2022-10-06T02%3A28%3A43.294760" status: 200 len: 694 microversion: 2.1 time: 0.066792 Oct 05 02:28:44.394644 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 263/534] 10.222.0.16 () {58 vars in 1412 bytes} [Wed Oct 5 02:28:44 2022] GET /compute/v2.1/os-simple-tenant-usage/10beeb5ff94e4c9c9c8b801fd3c56c66?start=2022-10-04T02%3A28%3A43.294760&end=2022-10-06T02%3A28%3A43.294760 => generated 694 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:44.410512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2aa2e716-7418-4b2b-bb47-eace7ea084e4 tempest-TenantUsagesTestJSON-1916060797 tempest-TenantUsagesTestJSON-1916060797-project-admin] Calling method '.version_select at 0x7fcce4400940>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:44.422655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2aa2e716-7418-4b2b-bb47-eace7ea084e4 tempest-TenantUsagesTestJSON-1916060797 tempest-TenantUsagesTestJSON-1916060797-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:44.423160 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2aa2e716-7418-4b2b-bb47-eace7ea084e4 tempest-TenantUsagesTestJSON-1916060797 tempest-TenantUsagesTestJSON-1916060797-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:44.425369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2aa2e716-7418-4b2b-bb47-eace7ea084e4 tempest-TenantUsagesTestJSON-1916060797 tempest-TenantUsagesTestJSON-1916060797-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:44.470942 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2aa2e716-7418-4b2b-bb47-eace7ea084e4 tempest-TenantUsagesTestJSON-1916060797 tempest-TenantUsagesTestJSON-1916060797-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:44.472079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2aa2e716-7418-4b2b-bb47-eace7ea084e4 tempest-TenantUsagesTestJSON-1916060797 tempest-TenantUsagesTestJSON-1916060797-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:44.474233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2aa2e716-7418-4b2b-bb47-eace7ea084e4 tempest-TenantUsagesTestJSON-1916060797 tempest-TenantUsagesTestJSON-1916060797-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:44.510304 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7f480b0d-4559-4e00-af7c-f15243f2701b tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368f6c3db9f24561a13f48ce02e7655e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecbac50c16847799a85c148c6c143de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:44.524778 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7f480b0d-4559-4e00-af7c-f15243f2701b tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6" status: 200 len: 1388 microversion: 2.1 time: 0.535885 Oct 05 02:28:44.525782 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 272/535] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:43 2022] GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6 => generated 1388 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:44.530768 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2aa2e716-7418-4b2b-bb47-eace7ea084e4 tempest-TenantUsagesTestJSON-1916060797 tempest-TenantUsagesTestJSON-1916060797-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-04T02%3A28%3A43.294760&end=2022-10-06T02%3A28%3A43.294760&detailed=1" status: 200 len: 3185 microversion: 2.1 time: 0.123780 Oct 05 02:28:44.531896 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 264/536] 10.222.0.16 () {58 vars in 1335 bytes} [Wed Oct 5 02:28:44 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-04T02%3A28%3A43.294760&end=2022-10-06T02%3A28%3A43.294760&detailed=1 => generated 3185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:44.540741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-41ba3c20-9aba-4036-8716-ea76fd9d993b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:44.542455 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-41ba3c20-9aba-4036-8716-ea76fd9d993b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:44.566922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6a0b20da-8b60-4f3e-ab63-5b7317fef10e tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:44.568778 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6a0b20da-8b60-4f3e-ab63-5b7317fef10e tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] [instance: a78fb515-3979-4134-928b-9552c036e8b2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:44.568939 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41ba3c20-9aba-4036-8716-ea76fd9d993b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:44.569529 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41ba3c20-9aba-4036-8716-ea76fd9d993b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:44.570068 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41ba3c20-9aba-4036-8716-ea76fd9d993b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:44.575395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41ba3c20-9aba-4036-8716-ea76fd9d993b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:44.576319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41ba3c20-9aba-4036-8716-ea76fd9d993b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:44.577590 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41ba3c20-9aba-4036-8716-ea76fd9d993b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:44.586316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a0b20da-8b60-4f3e-ab63-5b7317fef10e tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:44.586820 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a0b20da-8b60-4f3e-ab63-5b7317fef10e tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:44.587262 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a0b20da-8b60-4f3e-ab63-5b7317fef10e tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:44.588010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a0b20da-8b60-4f3e-ab63-5b7317fef10e tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:44.588438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a0b20da-8b60-4f3e-ab63-5b7317fef10e tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:44.596110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a0b20da-8b60-4f3e-ab63-5b7317fef10e tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:44.706549 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6a0b20da-8b60-4f3e-ab63-5b7317fef10e tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] [instance: a78fb515-3979-4134-928b-9552c036e8b2] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:28:44.925586 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6a0b20da-8b60-4f3e-ab63-5b7317fef10e tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2" status: 204 len: 0 microversion: 2.1 time: 0.362753 Oct 05 02:28:44.929211 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 265/537] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:28:44 2022] DELETE /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 02:28:44.938064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-675f6513-8916-4219-99ae-84a1a6105807 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:44.943548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-675f6513-8916-4219-99ae-84a1a6105807 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] [instance: a78fb515-3979-4134-928b-9552c036e8b2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:44.954435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-675f6513-8916-4219-99ae-84a1a6105807 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:44.956107 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-675f6513-8916-4219-99ae-84a1a6105807 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:44.957476 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-675f6513-8916-4219-99ae-84a1a6105807 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:44.960262 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-675f6513-8916-4219-99ae-84a1a6105807 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:44.964605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-675f6513-8916-4219-99ae-84a1a6105807 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:44.966401 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-675f6513-8916-4219-99ae-84a1a6105807 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:44.989098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-41ba3c20-9aba-4036-8716-ea76fd9d993b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:45.003742 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-41ba3c20-9aba-4036-8716-ea76fd9d993b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:45.005679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-41ba3c20-9aba-4036-8716-ea76fd9d993b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:45.008936 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-41ba3c20-9aba-4036-8716-ea76fd9d993b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af" status: 200 len: 1362 microversion: 2.25 time: 0.481315 Oct 05 02:28:45.013103 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 273/538] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:28:44 2022] GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af => generated 1362 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:28:45.259849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-675f6513-8916-4219-99ae-84a1a6105807 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3175c74d670a49e0a7efff04e7d4e9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10beeb5ff94e4c9c9c8b801fd3c56c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:45.272070 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-675f6513-8916-4219-99ae-84a1a6105807 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] 10.222.0.16 "GET /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2" status: 200 len: 1470 microversion: 2.1 time: 0.336671 Oct 05 02:28:45.273144 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 266/539] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:44 2022] GET /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2 => generated 1470 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:45.337623 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-214726c2-5958-4d77-9a99-d306f8f5454a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:45.338334 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-214726c2-5958-4d77-9a99-d306f8f5454a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 04eb32f6-e354-4960-8e0b-0a0e20dcfe04] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:45.350394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-214726c2-5958-4d77-9a99-d306f8f5454a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:45.351245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-214726c2-5958-4d77-9a99-d306f8f5454a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:45.353697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-214726c2-5958-4d77-9a99-d306f8f5454a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:45.354782 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-214726c2-5958-4d77-9a99-d306f8f5454a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:45.356213 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-214726c2-5958-4d77-9a99-d306f8f5454a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:45.357129 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-214726c2-5958-4d77-9a99-d306f8f5454a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:45.568641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f41fd849-fafa-46ec-850f-38c544d25a7a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:45.569336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f41fd849-fafa-46ec-850f-38c544d25a7a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 3245900a-6147-427e-86e3-b0af919523e6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:45.584459 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f41fd849-fafa-46ec-850f-38c544d25a7a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:45.584988 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f41fd849-fafa-46ec-850f-38c544d25a7a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:45.585427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f41fd849-fafa-46ec-850f-38c544d25a7a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:45.586135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f41fd849-fafa-46ec-850f-38c544d25a7a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:45.586586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f41fd849-fafa-46ec-850f-38c544d25a7a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:45.588094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f41fd849-fafa-46ec-850f-38c544d25a7a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:45.693614 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-214726c2-5958-4d77-9a99-d306f8f5454a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d53045696469487a6be6640b07f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a87f178aedc4acbb4bd353bc09a7cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:45.697072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:45.711847 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-214726c2-5958-4d77-9a99-d306f8f5454a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] 10.222.0.16 "GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04" status: 200 len: 1318 microversion: 2.1 time: 0.377083 Oct 05 02:28:45.713003 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 274/540] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:45 2022] GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04 => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:45.881463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-ae3a53d9-e947-435b-8eb1-e12b5a093e71 req-44295146-4615-43aa-8c9e-ba82111f4cfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04eb32f6-e354-4960-8e0b-0a0e20dcfe04", "tag": "93d69049-27c8-4ca0-af05-bcca725b246b"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:45.899807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ae3a53d9-e947-435b-8eb1-e12b5a093e71 req-44295146-4615-43aa-8c9e-ba82111f4cfa service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:45.902075 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ae3a53d9-e947-435b-8eb1-e12b5a093e71 req-44295146-4615-43aa-8c9e-ba82111f4cfa service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:45.902759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ae3a53d9-e947-435b-8eb1-e12b5a093e71 req-44295146-4615-43aa-8c9e-ba82111f4cfa service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:45.928416 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-ae3a53d9-e947-435b-8eb1-e12b5a093e71 req-44295146-4615-43aa-8c9e-ba82111f4cfa service nova] Creating event network-changed:93d69049-27c8-4ca0-af05-bcca725b246b for instance 04eb32f6-e354-4960-8e0b-0a0e20dcfe04 on n-h2-858272-3 Oct 05 02:28:45.946263 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-ae3a53d9-e947-435b-8eb1-e12b5a093e71 req-44295146-4615-43aa-8c9e-ba82111f4cfa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068841 Oct 05 02:28:45.947380 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 275/541] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:46.022899 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-0851e0ca-2ca1-4aca-8e49-1b2b2f274ce6 req-c42a3173-8d28-40cb-be5f-6d44bfffd71c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "079782c4-bca1-40e0-aa9f-b8afdb6a79af", "tag": "0a2b9672-d33e-4824-9498-5a3e1b415686"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:46.040600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-0851e0ca-2ca1-4aca-8e49-1b2b2f274ce6 req-c42a3173-8d28-40cb-be5f-6d44bfffd71c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:46.046686 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-0851e0ca-2ca1-4aca-8e49-1b2b2f274ce6 req-c42a3173-8d28-40cb-be5f-6d44bfffd71c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:46.047426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-0851e0ca-2ca1-4aca-8e49-1b2b2f274ce6 req-c42a3173-8d28-40cb-be5f-6d44bfffd71c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:46.077155 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-0851e0ca-2ca1-4aca-8e49-1b2b2f274ce6 req-c42a3173-8d28-40cb-be5f-6d44bfffd71c service nova] Creating event network-changed:0a2b9672-d33e-4824-9498-5a3e1b415686 for instance 079782c4-bca1-40e0-aa9f-b8afdb6a79af on n-h2-858272-3 Oct 05 02:28:46.085164 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-0851e0ca-2ca1-4aca-8e49-1b2b2f274ce6 req-c42a3173-8d28-40cb-be5f-6d44bfffd71c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066254 Oct 05 02:28:46.086454 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 276/542] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:28:46.091855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b62967c5-36ba-4adb-bf60-6bc25967d751 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:46.101981 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b62967c5-36ba-4adb-bf60-6bc25967d751 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:46.108547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f41fd849-fafa-46ec-850f-38c544d25a7a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368f6c3db9f24561a13f48ce02e7655e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecbac50c16847799a85c148c6c143de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:46.120430 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b62967c5-36ba-4adb-bf60-6bc25967d751 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:46.120587 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f41fd849-fafa-46ec-850f-38c544d25a7a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6" status: 200 len: 1388 microversion: 2.1 time: 0.554313 Oct 05 02:28:46.122813 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b62967c5-36ba-4adb-bf60-6bc25967d751 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:46.123503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b62967c5-36ba-4adb-bf60-6bc25967d751 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:46.125663 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b62967c5-36ba-4adb-bf60-6bc25967d751 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:46.135149 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 267/543] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:45 2022] GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6 => generated 1388 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:46.136239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b62967c5-36ba-4adb-bf60-6bc25967d751 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:46.137201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b62967c5-36ba-4adb-bf60-6bc25967d751 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:46.346764 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=38 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:46.427679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=16 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:46.436474 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b62967c5-36ba-4adb-bf60-6bc25967d751 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:46.447902 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b62967c5-36ba-4adb-bf60-6bc25967d751 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:46.464248 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b62967c5-36ba-4adb-bf60-6bc25967d751 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:46.465461 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b62967c5-36ba-4adb-bf60-6bc25967d751 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af" status: 200 len: 1362 microversion: 2.25 time: 0.377571 Oct 05 02:28:46.466194 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 277/544] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:28:46 2022] GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af => generated 1362 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:28:46.471635 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-636b480f-8a84-450d-a186-e50df8df2f77 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:46.481820 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-636b480f-8a84-450d-a186-e50df8df2f77 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] [instance: a78fb515-3979-4134-928b-9552c036e8b2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:46.488271 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-636b480f-8a84-450d-a186-e50df8df2f77 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:46.489016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-636b480f-8a84-450d-a186-e50df8df2f77 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:46.489600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-636b480f-8a84-450d-a186-e50df8df2f77 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:46.493516 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-636b480f-8a84-450d-a186-e50df8df2f77 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:46.494164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-636b480f-8a84-450d-a186-e50df8df2f77 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:46.494747 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-636b480f-8a84-450d-a186-e50df8df2f77 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:46.700159 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-620379fe-eb0b-4f1a-9a2b-683272275a59 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1204254744", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "eeab81fe-da30-46f9-87be-0b6dd3f4b67b"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:46.786580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-620379fe-eb0b-4f1a-9a2b-683272275a59 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] validate_networks() for [('eeab81fe-da30-46f9-87be-0b6dd3f4b67b', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:28:47.441162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-636b480f-8a84-450d-a186-e50df8df2f77 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3175c74d670a49e0a7efff04e7d4e9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10beeb5ff94e4c9c9c8b801fd3c56c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:47.454747 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-636b480f-8a84-450d-a186-e50df8df2f77 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] 10.222.0.16 "GET /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2" status: 200 len: 1470 microversion: 2.1 time: 0.986393 Oct 05 02:28:47.460801 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 278/545] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:46 2022] GET /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2 => generated 1470 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:47.466221 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3149f524-c43f-4656-b6ba-4d7737576482 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:47.469748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3149f524-c43f-4656-b6ba-4d7737576482 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 04eb32f6-e354-4960-8e0b-0a0e20dcfe04] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:47.482076 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3149f524-c43f-4656-b6ba-4d7737576482 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:47.485549 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3149f524-c43f-4656-b6ba-4d7737576482 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:47.488591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3149f524-c43f-4656-b6ba-4d7737576482 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:47.489672 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3149f524-c43f-4656-b6ba-4d7737576482 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:47.490318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3149f524-c43f-4656-b6ba-4d7737576482 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:47.490892 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3149f524-c43f-4656-b6ba-4d7737576482 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:47.906938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3149f524-c43f-4656-b6ba-4d7737576482 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d53045696469487a6be6640b07f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a87f178aedc4acbb4bd353bc09a7cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:47.918684 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3149f524-c43f-4656-b6ba-4d7737576482 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] 10.222.0.16 "GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04" status: 200 len: 1318 microversion: 2.1 time: 0.456501 Oct 05 02:28:47.923715 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 279/546] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:47 2022] GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04 => generated 1318 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:47.945118 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a348550a-f513-4d95-bbf6-59aac1f6246e tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:47.948279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a348550a-f513-4d95-bbf6-59aac1f6246e tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 3245900a-6147-427e-86e3-b0af919523e6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:47.955644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a348550a-f513-4d95-bbf6-59aac1f6246e tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:47.956579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a348550a-f513-4d95-bbf6-59aac1f6246e tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:47.957251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a348550a-f513-4d95-bbf6-59aac1f6246e tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:47.958313 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a348550a-f513-4d95-bbf6-59aac1f6246e tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:47.958945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a348550a-f513-4d95-bbf6-59aac1f6246e tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:47.959543 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a348550a-f513-4d95-bbf6-59aac1f6246e tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:48.160373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-620379fe-eb0b-4f1a-9a2b-683272275a59 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:28:48.160848 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-620379fe-eb0b-4f1a-9a2b-683272275a59 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:28:48.161282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-620379fe-eb0b-4f1a-9a2b-683272275a59 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:28:48.161688 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-620379fe-eb0b-4f1a-9a2b-683272275a59 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:28:48.162094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-620379fe-eb0b-4f1a-9a2b-683272275a59 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:28:48.176720 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-620379fe-eb0b-4f1a-9a2b-683272275a59 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:48.177983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-620379fe-eb0b-4f1a-9a2b-683272275a59 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:48.179949 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-620379fe-eb0b-4f1a-9a2b-683272275a59 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:48.184653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-620379fe-eb0b-4f1a-9a2b-683272275a59 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:48.185669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-620379fe-eb0b-4f1a-9a2b-683272275a59 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:48.187374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-620379fe-eb0b-4f1a-9a2b-683272275a59 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:48.211019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=11 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:48.234503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-620379fe-eb0b-4f1a-9a2b-683272275a59 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Getting quotas for project 6652917123e14c2797cafacc4e31f75a. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:28:48.235594 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a348550a-f513-4d95-bbf6-59aac1f6246e tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368f6c3db9f24561a13f48ce02e7655e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecbac50c16847799a85c148c6c143de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:48.245990 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a348550a-f513-4d95-bbf6-59aac1f6246e tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6" status: 200 len: 1388 microversion: 2.1 time: 0.320417 Oct 05 02:28:48.247192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-620379fe-eb0b-4f1a-9a2b-683272275a59 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Getting quotas for user 118c1425677b45b98689befb0eb55cce and project 6652917123e14c2797cafacc4e31f75a. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:28:48.257557 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 280/547] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:47 2022] GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6 => generated 1388 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:48.269534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b05ed455-4c6d-4fd1-9897-7d52981bf4bc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:48.270393 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b05ed455-4c6d-4fd1-9897-7d52981bf4bc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:48.278744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b05ed455-4c6d-4fd1-9897-7d52981bf4bc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:48.279494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b05ed455-4c6d-4fd1-9897-7d52981bf4bc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:48.280436 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b05ed455-4c6d-4fd1-9897-7d52981bf4bc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:48.281586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b05ed455-4c6d-4fd1-9897-7d52981bf4bc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:48.282361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b05ed455-4c6d-4fd1-9897-7d52981bf4bc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:48.283263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b05ed455-4c6d-4fd1-9897-7d52981bf4bc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:48.296085 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-620379fe-eb0b-4f1a-9a2b-683272275a59 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:28:48.299426 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-620379fe-eb0b-4f1a-9a2b-683272275a59 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:28:48.374612 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-620379fe-eb0b-4f1a-9a2b-683272275a59 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.238192 Oct 05 02:28:48.375311 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 268/548] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:28:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2240 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:28:48.581742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3cd88ba7-ec96-4aa1-8a52-83604f6758b3 tempest-InstanceUsageAuditLogNegativeTestJSON-802146566 tempest-InstanceUsageAuditLogNegativeTestJSON-802146566-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:48.583935 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-3cd88ba7-ec96-4aa1-8a52-83604f6758b3 tempest-InstanceUsageAuditLogNegativeTestJSON-802146566 tempest-InstanceUsageAuditLogNegativeTestJSON-802146566-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 05 02:28:48.593402 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3cd88ba7-ec96-4aa1-8a52-83604f6758b3 tempest-InstanceUsageAuditLogNegativeTestJSON-802146566 tempest-InstanceUsageAuditLogNegativeTestJSON-802146566-project-admin] Request method failure captured: Oct 05 02:28:48.593402 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 05 02:28:48.593402 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:28:48.593402 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:28:48.593402 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:28:48.593402 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:28:48.593402 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:28:48.593402 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:28:48.593402 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:28:48.593402 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:48.593402 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOvfI4wwBDGsOg2mWKdLwokjXrg_8zXOoYGAH71QdZ-3XVGm1kUdP4w_6Dw0ICwJuKHumeTZYW2HAjE_KT3zAQr6D-FOh8BAbh5biCZt_so0uwJYMlSEFRu_ooFH4yvljDydSNGBEVXVefpfeHOFypzpqxyPpl18X-OrHnAXi65U5Kk Oct 05 02:28:48.593402 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:28:48.593402 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:28:48.593402 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:28:48.593402 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:28:48.593402 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:28:48.593402 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:28:48.593402 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 1ebe1df9b02349bda979d3c281cc7a95 Oct 05 02:28:48.593402 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-802146566 Oct 05 02:28:48.593402 n-d-858272-3 devstack@n-api.service[122320]: X-Role: admin,member,reader Oct 05 02:28:48.593402 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: admin,member,reader Oct 05 02:28:48.594860 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ebe1df9b02349bda979d3c281cc7a95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ebe1df9b02349bda979d3c281cc7a95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1ebe1df9b02349bda979d3c281cc7a95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1ebe1df9b02349bda979d3c281cc7a95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:48.594860 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-802146566 Oct 05 02:28:48.594860 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 1ebe1df9b02349bda979d3c281cc7a95 Oct 05 02:28:48.594860 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-802146566 Oct 05 02:28:48.594860 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-802146566-project-admin Oct 05 02:28:48.594860 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:28:48.594860 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:28:48.594860 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: f940b2b6962c415096e54c72b6f35d6c Oct 05 02:28:48.594860 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-802146566-project-admin Oct 05 02:28:48.594860 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:28:48.594860 n-d-858272-3 devstack@n-api.service[122320]: exception: Invalid timestamp for date invalid_time Oct 05 02:28:48.595622 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'invalid_time'} Oct 05 02:28:48.595622 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:48.595622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:48.595622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 05 02:28:48.595622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 05 02:28:48.595622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 05 02:28:48.595622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 05 02:28:48.595622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 05 02:28:48.595622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 05 02:28:48.595622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 05 02:28:48.595622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:28:48.595622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:48.595622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:28:48.595622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:48.595622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:48.595622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:48.595622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:48.595622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:48.595622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:48.595622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:48.597120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 05 02:28:48.597120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 05 02:28:48.597120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 05 02:28:48.597120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:28:48.597120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:48.597120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:28:48.597120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:48.597120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:48.597120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:48.597120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:28:48.597120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:28:48.597120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 05 02:28:48.597120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:28:48.605505 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3cd88ba7-ec96-4aa1-8a52-83604f6758b3 tempest-InstanceUsageAuditLogNegativeTestJSON-802146566 tempest-InstanceUsageAuditLogNegativeTestJSON-802146566-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:48.607877 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3cd88ba7-ec96-4aa1-8a52-83604f6758b3 tempest-InstanceUsageAuditLogNegativeTestJSON-802146566 tempest-InstanceUsageAuditLogNegativeTestJSON-802146566-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.225349 Oct 05 02:28:48.610512 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 269/549] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:28:48 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 229 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:48.628474 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b05ed455-4c6d-4fd1-9897-7d52981bf4bc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:48.633888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-8b7fa7aa-943d-4640-9f3c-c601ef108c44 req-1d2a1e64-2d3a-4dd7-b0ce-973f347a0431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78fb515-3979-4134-928b-9552c036e8b2", "name": "network-vif-deleted", "tag": "d569f8c8-2957-4ebb-9105-c4480d3ada02"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:48.662784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b05ed455-4c6d-4fd1-9897-7d52981bf4bc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:48.680511 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b05ed455-4c6d-4fd1-9897-7d52981bf4bc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:48.701470 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b05ed455-4c6d-4fd1-9897-7d52981bf4bc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af" status: 200 len: 1362 microversion: 2.25 time: 0.442481 Oct 05 02:28:48.702033 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 281/550] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:28:48 2022] GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af => generated 1362 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:28:48.732267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-36204d8e-af1d-40aa-bfe4-4ff50fc56aca tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:48.738505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-36204d8e-af1d-40aa-bfe4-4ff50fc56aca tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:48.747755 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-8b7fa7aa-943d-4640-9f3c-c601ef108c44 req-1d2a1e64-2d3a-4dd7-b0ce-973f347a0431 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:48.751266 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-8b7fa7aa-943d-4640-9f3c-c601ef108c44 req-1d2a1e64-2d3a-4dd7-b0ce-973f347a0431 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:48.751974 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-8b7fa7aa-943d-4640-9f3c-c601ef108c44 req-1d2a1e64-2d3a-4dd7-b0ce-973f347a0431 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:48.771448 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-8b7fa7aa-943d-4640-9f3c-c601ef108c44 req-1d2a1e64-2d3a-4dd7-b0ce-973f347a0431 service nova] Creating event network-vif-deleted:d569f8c8-2957-4ebb-9105-c4480d3ada02 for instance a78fb515-3979-4134-928b-9552c036e8b2 on n-h1-858272-3 Oct 05 02:28:48.788617 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-8b7fa7aa-943d-4640-9f3c-c601ef108c44 req-1d2a1e64-2d3a-4dd7-b0ce-973f347a0431 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166272 Oct 05 02:28:48.790442 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 270/551] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:48.796888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-297732e4-4e7a-4924-8c6c-1ddb5aa9e7e8 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:48.798098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-297732e4-4e7a-4924-8c6c-1ddb5aa9e7e8 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] [instance: a78fb515-3979-4134-928b-9552c036e8b2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:48.802706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:48.807000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-297732e4-4e7a-4924-8c6c-1ddb5aa9e7e8 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:48.816588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-297732e4-4e7a-4924-8c6c-1ddb5aa9e7e8 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:48.817443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-297732e4-4e7a-4924-8c6c-1ddb5aa9e7e8 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:48.818435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-297732e4-4e7a-4924-8c6c-1ddb5aa9e7e8 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:48.819138 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-297732e4-4e7a-4924-8c6c-1ddb5aa9e7e8 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:48.819855 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-297732e4-4e7a-4924-8c6c-1ddb5aa9e7e8 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:48.860859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-36204d8e-af1d-40aa-bfe4-4ff50fc56aca tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:48.869635 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-297732e4-4e7a-4924-8c6c-1ddb5aa9e7e8 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:48.873146 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-36204d8e-af1d-40aa-bfe4-4ff50fc56aca tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9" status: 200 len: 1211 microversion: 2.1 time: 0.158995 Oct 05 02:28:48.873608 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-297732e4-4e7a-4924-8c6c-1ddb5aa9e7e8 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:48.874476 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-297732e4-4e7a-4924-8c6c-1ddb5aa9e7e8 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:48.876046 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-297732e4-4e7a-4924-8c6c-1ddb5aa9e7e8 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lazy-loading 'fault' on Instance uuid a78fb515-3979-4134-928b-9552c036e8b2 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:28:48.876188 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 282/552] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:48 2022] GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 => generated 1211 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:48.984684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-297732e4-4e7a-4924-8c6c-1ddb5aa9e7e8 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3175c74d670a49e0a7efff04e7d4e9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10beeb5ff94e4c9c9c8b801fd3c56c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:48.999862 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-297732e4-4e7a-4924-8c6c-1ddb5aa9e7e8 tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] 10.222.0.16 "GET /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2" status: 200 len: 1304 microversion: 2.1 time: 0.206903 Oct 05 02:28:49.003153 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 271/553] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:48 2022] GET /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2 => generated 1304 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:49.020869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0e3d3d99-3387-41e5-8b11-2cb0982c6d40 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:49.023839 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0e3d3d99-3387-41e5-8b11-2cb0982c6d40 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 04eb32f6-e354-4960-8e0b-0a0e20dcfe04] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:49.061293 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e3d3d99-3387-41e5-8b11-2cb0982c6d40 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:49.061798 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e3d3d99-3387-41e5-8b11-2cb0982c6d40 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:49.065409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e3d3d99-3387-41e5-8b11-2cb0982c6d40 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:49.066520 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e3d3d99-3387-41e5-8b11-2cb0982c6d40 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:49.067232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e3d3d99-3387-41e5-8b11-2cb0982c6d40 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:49.070023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e3d3d99-3387-41e5-8b11-2cb0982c6d40 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:49.198196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-00ba677a-2b4f-42a0-9ab8-fe436e565860 tempest-InstanceUsageAuditLogNegativeTestJSON-1439436169 tempest-InstanceUsageAuditLogNegativeTestJSON-1439436169-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:49.204207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-00ba677a-2b4f-42a0-9ab8-fe436e565860 tempest-InstanceUsageAuditLogNegativeTestJSON-1439436169 tempest-InstanceUsageAuditLogNegativeTestJSON-1439436169-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'a5b10412c5294f739bb97865e405bdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa095bb596c453b889a05906b2d472c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:49.208210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-00ba677a-2b4f-42a0-9ab8-fe436e565860 tempest-InstanceUsageAuditLogNegativeTestJSON-1439436169 tempest-InstanceUsageAuditLogNegativeTestJSON-1439436169-project] Request method failure captured: Oct 05 02:28:49.208210 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 05 02:28:49.208210 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:28:49.208210 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:28:49.208210 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:28:49.208210 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:28:49.208210 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:28:49.208210 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:28:49.208210 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:28:49.208210 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:49.208210 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOvdyas4OuGOftz0WjKpkkWwsfYa44qXOvA-74kGHpZrTruieHqv2hEZKkVG9RUD5VIQzN5wnPvbWF9DXBbWgYgXGdfKrd478DdM0q9DSrhiovT3sRJO9N0Y7gMIPzLqqALC6YqRcvUeeyHtcMHm4pUOLamMdcAJsRR4YpTEXpEs7uQ Oct 05 02:28:49.208210 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:28:49.208210 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:28:49.208210 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:28:49.208210 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:28:49.208210 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:28:49.208210 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:28:49.208210 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 9fa095bb596c453b889a05906b2d472c Oct 05 02:28:49.208210 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1439436169 Oct 05 02:28:49.208210 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:28:49.208210 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:28:49.209774 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9fa095bb596c453b889a05906b2d472c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9fa095bb596c453b889a05906b2d472c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9fa095bb596c453b889a05906b2d472c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9fa095bb596c453b889a05906b2d472c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:49.209774 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1439436169 Oct 05 02:28:49.209774 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 9fa095bb596c453b889a05906b2d472c Oct 05 02:28:49.209774 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1439436169 Oct 05 02:28:49.209774 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1439436169-project Oct 05 02:28:49.209774 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:28:49.209774 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:28:49.209774 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: a5b10412c5294f739bb97865e405bdce Oct 05 02:28:49.209774 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1439436169-project Oct 05 02:28:49.209774 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:28:49.210517 n-d-858272-3 devstack@n-api.service[122319]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 05 02:28:49.210517 n-d-858272-3 devstack@n-api.service[122319]: action_args: {} Oct 05 02:28:49.210517 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:49.210517 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:49.210517 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:49.210517 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:49.210517 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:49.210517 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:49.210517 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:49.210517 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:49.210517 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 05 02:28:49.210517 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 05 02:28:49.210517 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 02:28:49.210517 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 02:28:49.210517 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 02:28:49.210517 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 02:28:49.210517 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:28:49.210517 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:28:49.210517 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:28:49.210517 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:28:49.211925 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 02:28:49.211925 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 02:28:49.211925 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 02:28:49.211925 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 02:28:49.211925 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:28:49.211925 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 02:28:49.211925 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 05 02:28:49.211925 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:49.211925 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:49.211925 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:49.211925 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:49.211925 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:49.211925 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:49.211925 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 02:28:49.211925 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 02:28:49.211925 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 05 02:28:49.211925 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:49.214565 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-00ba677a-2b4f-42a0-9ab8-fe436e565860 tempest-InstanceUsageAuditLogNegativeTestJSON-1439436169 tempest-InstanceUsageAuditLogNegativeTestJSON-1439436169-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:49.215973 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-00ba677a-2b4f-42a0-9ab8-fe436e565860 tempest-InstanceUsageAuditLogNegativeTestJSON-1439436169 tempest-InstanceUsageAuditLogNegativeTestJSON-1439436169-project] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.336757 Oct 05 02:28:49.217034 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 283/554] 10.222.0.16 () {58 vars in 1185 bytes} [Wed Oct 5 02:28:48 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 341 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:28:49.231264 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-92b2d116-5801-44cd-8cfc-ef85682f09c4 tempest-InstanceUsageAuditLogNegativeTestJSON-1439436169 tempest-InstanceUsageAuditLogNegativeTestJSON-1439436169-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:49.233604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-92b2d116-5801-44cd-8cfc-ef85682f09c4 tempest-InstanceUsageAuditLogNegativeTestJSON-1439436169 tempest-InstanceUsageAuditLogNegativeTestJSON-1439436169-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'a5b10412c5294f739bb97865e405bdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa095bb596c453b889a05906b2d472c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:49.241242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-92b2d116-5801-44cd-8cfc-ef85682f09c4 tempest-InstanceUsageAuditLogNegativeTestJSON-1439436169 tempest-InstanceUsageAuditLogNegativeTestJSON-1439436169-project] Request method failure captured: Oct 05 02:28:49.241242 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-05%2002:28:49 HTTP/1.1 Oct 05 02:28:49.241242 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:28:49.241242 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:28:49.241242 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:28:49.241242 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:28:49.241242 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:28:49.241242 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:28:49.241242 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:28:49.241242 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:49.241242 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOvdyas4OuGOftz0WjKpkkWwsfYa44qXOvA-74kGHpZrTruieHqv2hEZKkVG9RUD5VIQzN5wnPvbWF9DXBbWgYgXGdfKrd478DdM0q9DSrhiovT3sRJO9N0Y7gMIPzLqqALC6YqRcvUeeyHtcMHm4pUOLamMdcAJsRR4YpTEXpEs7uQ Oct 05 02:28:49.241242 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:28:49.241242 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:28:49.241242 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:28:49.241242 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:28:49.241242 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:28:49.241242 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:28:49.241242 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 9fa095bb596c453b889a05906b2d472c Oct 05 02:28:49.241242 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1439436169 Oct 05 02:28:49.241242 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:28:49.241242 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:28:49.242793 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9fa095bb596c453b889a05906b2d472c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9fa095bb596c453b889a05906b2d472c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9fa095bb596c453b889a05906b2d472c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9fa095bb596c453b889a05906b2d472c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:49.242793 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1439436169 Oct 05 02:28:49.242793 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 9fa095bb596c453b889a05906b2d472c Oct 05 02:28:49.242793 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1439436169 Oct 05 02:28:49.242793 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1439436169-project Oct 05 02:28:49.242793 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:28:49.242793 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:28:49.242793 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: a5b10412c5294f739bb97865e405bdce Oct 05 02:28:49.242793 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1439436169-project Oct 05 02:28:49.242793 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:28:49.243520 n-d-858272-3 devstack@n-api.service[122319]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 05 02:28:49.243520 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '2022-10-05 02:28:49'} Oct 05 02:28:49.243520 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:49.243520 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:49.243520 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:49.243520 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:49.243520 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:49.243520 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:49.243520 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:49.243520 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:49.243520 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 05 02:28:49.243520 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 05 02:28:49.243520 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 02:28:49.243520 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 02:28:49.243520 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 02:28:49.243520 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 02:28:49.243520 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:28:49.243520 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:28:49.243520 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:28:49.243520 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:28:49.245047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 02:28:49.245047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 02:28:49.245047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 02:28:49.245047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 02:28:49.245047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:28:49.245047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 02:28:49.245047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 05 02:28:49.245047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:49.245047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:49.245047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:49.245047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:49.245047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:49.245047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:49.245047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 02:28:49.245047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 02:28:49.245047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 05 02:28:49.245047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:49.247873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-92b2d116-5801-44cd-8cfc-ef85682f09c4 tempest-InstanceUsageAuditLogNegativeTestJSON-1439436169 tempest-InstanceUsageAuditLogNegativeTestJSON-1439436169-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:49.248974 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-92b2d116-5801-44cd-8cfc-ef85682f09c4 tempest-InstanceUsageAuditLogNegativeTestJSON-1439436169 tempest-InstanceUsageAuditLogNegativeTestJSON-1439436169-project] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-05 02:28:49" status: 403 len: 128 microversion: 2.1 time: 0.024289 Oct 05 02:28:49.250573 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 284/555] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 5 02:28:49 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-05%2002%3A28%3A49 => generated 128 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:28:49.289350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2dd79edd-51b4-4474-9263-db318aabbccf tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:49.292567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2dd79edd-51b4-4474-9263-db318aabbccf tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 3245900a-6147-427e-86e3-b0af919523e6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:49.303776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2dd79edd-51b4-4474-9263-db318aabbccf tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:49.305107 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2dd79edd-51b4-4474-9263-db318aabbccf tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:49.305748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2dd79edd-51b4-4474-9263-db318aabbccf tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:49.306945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2dd79edd-51b4-4474-9263-db318aabbccf tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:49.307757 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2dd79edd-51b4-4474-9263-db318aabbccf tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:49.308349 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2dd79edd-51b4-4474-9263-db318aabbccf tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:49.626284 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2dd79edd-51b4-4474-9263-db318aabbccf tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368f6c3db9f24561a13f48ce02e7655e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecbac50c16847799a85c148c6c143de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:49.633307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0e3d3d99-3387-41e5-8b11-2cb0982c6d40 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d53045696469487a6be6640b07f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a87f178aedc4acbb4bd353bc09a7cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:49.645051 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0e3d3d99-3387-41e5-8b11-2cb0982c6d40 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] 10.222.0.16 "GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04" status: 200 len: 1318 microversion: 2.1 time: 0.639002 Oct 05 02:28:49.645494 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2dd79edd-51b4-4474-9263-db318aabbccf tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6" status: 200 len: 1388 microversion: 2.1 time: 0.368129 Oct 05 02:28:49.646000 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 272/556] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:49 2022] GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04 => generated 1318 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:49.673647 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 285/557] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:49 2022] GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6 => generated 1388 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:49.731525 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a1f878e7-e59e-4d50-95ae-d2585b186283 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:49.732151 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a1f878e7-e59e-4d50-95ae-d2585b186283 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:49.748395 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a1f878e7-e59e-4d50-95ae-d2585b186283 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:49.748911 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a1f878e7-e59e-4d50-95ae-d2585b186283 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:49.749437 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a1f878e7-e59e-4d50-95ae-d2585b186283 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:49.750144 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a1f878e7-e59e-4d50-95ae-d2585b186283 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:49.750601 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a1f878e7-e59e-4d50-95ae-d2585b186283 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:49.751016 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a1f878e7-e59e-4d50-95ae-d2585b186283 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:49.812321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-32094ee3-367b-4979-b950-3ede89693dcc req-3c7c9059-0c34-49e4-8cf3-9e78d15a61e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3245900a-6147-427e-86e3-b0af919523e6", "name": "network-vif-plugged", "status": "completed", "tag": "11e57809-b0ee-4162-9bf6-2a552194ea98"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:49.844118 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-32094ee3-367b-4979-b950-3ede89693dcc req-3c7c9059-0c34-49e4-8cf3-9e78d15a61e8 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:49.845436 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-32094ee3-367b-4979-b950-3ede89693dcc req-3c7c9059-0c34-49e4-8cf3-9e78d15a61e8 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:49.846213 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-32094ee3-367b-4979-b950-3ede89693dcc req-3c7c9059-0c34-49e4-8cf3-9e78d15a61e8 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:49.883983 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-32094ee3-367b-4979-b950-3ede89693dcc req-3c7c9059-0c34-49e4-8cf3-9e78d15a61e8 service nova] Creating event network-vif-plugged:11e57809-b0ee-4162-9bf6-2a552194ea98 for instance 3245900a-6147-427e-86e3-b0af919523e6 on n-h2-858272-3 Oct 05 02:28:49.898648 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-32094ee3-367b-4979-b950-3ede89693dcc req-3c7c9059-0c34-49e4-8cf3-9e78d15a61e8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091325 Oct 05 02:28:49.909344 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 286/558] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:28:49.915149 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-207bc74f-bc75-4281-a726-bfb6c6d8ab99 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:49.915846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-207bc74f-bc75-4281-a726-bfb6c6d8ab99 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:49.932167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-207bc74f-bc75-4281-a726-bfb6c6d8ab99 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:49.932662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-207bc74f-bc75-4281-a726-bfb6c6d8ab99 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:49.933118 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-207bc74f-bc75-4281-a726-bfb6c6d8ab99 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:49.933819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-207bc74f-bc75-4281-a726-bfb6c6d8ab99 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:49.934453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-207bc74f-bc75-4281-a726-bfb6c6d8ab99 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:49.935023 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-207bc74f-bc75-4281-a726-bfb6c6d8ab99 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:50.085685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-207bc74f-bc75-4281-a726-bfb6c6d8ab99 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:50.094786 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-207bc74f-bc75-4281-a726-bfb6c6d8ab99 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9" status: 200 len: 1207 microversion: 2.1 time: 0.183706 Oct 05 02:28:50.098099 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 287/559] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:49 2022] GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 => generated 1207 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:50.106920 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-67d4c22c-ebbb-467c-a941-38b70f83952b tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:50.111456 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-67d4c22c-ebbb-467c-a941-38b70f83952b tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] [instance: a78fb515-3979-4134-928b-9552c036e8b2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:50.123729 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-67d4c22c-ebbb-467c-a941-38b70f83952b tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:50.133930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-67d4c22c-ebbb-467c-a941-38b70f83952b tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:50.134373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-67d4c22c-ebbb-467c-a941-38b70f83952b tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:50.135277 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-67d4c22c-ebbb-467c-a941-38b70f83952b tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:50.135994 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-67d4c22c-ebbb-467c-a941-38b70f83952b tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:50.136417 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-67d4c22c-ebbb-467c-a941-38b70f83952b tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:50.168470 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-67d4c22c-ebbb-467c-a941-38b70f83952b tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] HTTP exception thrown: Instance a78fb515-3979-4134-928b-9552c036e8b2 could not be found. Oct 05 02:28:50.170155 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-67d4c22c-ebbb-467c-a941-38b70f83952b tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Request method failure captured: Oct 05 02:28:50.170155 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2 HTTP/1.1 Oct 05 02:28:50.170155 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:28:50.170155 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:28:50.170155 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:28:50.170155 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:28:50.170155 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:28:50.170155 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:28:50.170155 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:28:50.170155 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:28:50.170155 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOu7GkNFBSZiWvzh39a4mlNCFNsgisj9ByjVfRlf6Bg8LROPKTWoqOGG-iBg4QERXUE_uUWo4u6g5y3jgcNeCU6hK1ipZ03WC2UxZEFMSnfzSQgvrp1XxF0q_5geFwi2OgLHGyYzZFVTGzrlggkaqNhZYii0a6vq0FDyJaMYWk2MXb0 Oct 05 02:28:50.170155 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:28:50.170155 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:28:50.170155 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:28:50.170155 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:28:50.170155 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:28:50.170155 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:28:50.170155 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 10beeb5ff94e4c9c9c8b801fd3c56c66 Oct 05 02:28:50.170155 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TenantUsagesTestJSON-886025042 Oct 05 02:28:50.170155 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:28:50.170155 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:28:50.171692 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10beeb5ff94e4c9c9c8b801fd3c56c66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10beeb5ff94e4c9c9c8b801fd3c56c66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/10beeb5ff94e4c9c9c8b801fd3c56c66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_10beeb5ff94e4c9c9c8b801fd3c56c66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:28:50.171692 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TenantUsagesTestJSON-886025042 Oct 05 02:28:50.171692 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 10beeb5ff94e4c9c9c8b801fd3c56c66 Oct 05 02:28:50.171692 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TenantUsagesTestJSON-886025042 Oct 05 02:28:50.171692 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TenantUsagesTestJSON-886025042-project Oct 05 02:28:50.171692 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:28:50.171692 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:28:50.171692 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 3175c74d670a49e0a7efff04e7d4e9a0 Oct 05 02:28:50.171692 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TenantUsagesTestJSON-886025042-project Oct 05 02:28:50.171692 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:28:50.171692 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance a78fb515-3979-4134-928b-9552c036e8b2 could not be found. Oct 05 02:28:50.171692 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'a78fb515-3979-4134-928b-9552c036e8b2'} Oct 05 02:28:50.172479 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:28:50.172479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:50.172479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:28:50.172479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:28:50.172479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:28:50.172479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:28:50.172479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:28:50.172479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:28:50.172479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:28:50.172479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:28:50.172479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a78fb515-3979-4134-928b-9552c036e8b2 could not be found. Oct 05 02:28:50.172479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:50.172479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:50.172479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:50.172479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:50.172479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:50.172479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:50.172479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:28:50.172479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:28:50.172479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:28:50.174056 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:28:50.174056 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:28:50.174056 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:28:50.174056 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:28:50.174056 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:28:50.174056 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:28:50.174056 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:28:50.174056 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a78fb515-3979-4134-928b-9552c036e8b2 could not be found. Oct 05 02:28:50.174056 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:50.174056 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:28:50.174056 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:50.174056 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:28:50.174056 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:28:50.174056 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:28:50.174056 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:28:50.174056 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:28:50.174056 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a78fb515-3979-4134-928b-9552c036e8b2 could not be found. Oct 05 02:28:50.174056 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:28:50.175105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-67d4c22c-ebbb-467c-a941-38b70f83952b tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] Returning 404 to user: Instance a78fb515-3979-4134-928b-9552c036e8b2 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:28:50.175105 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-67d4c22c-ebbb-467c-a941-38b70f83952b tempest-TenantUsagesTestJSON-886025042 tempest-TenantUsagesTestJSON-886025042-project] 10.222.0.16 "GET /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2" status: 404 len: 111 microversion: 2.1 time: 0.072275 Oct 05 02:28:50.175105 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 288/560] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:50 2022] GET /compute/v2.1/servers/a78fb515-3979-4134-928b-9552c036e8b2 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:28:50.178019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a1f878e7-e59e-4d50-95ae-d2585b186283 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:50.196085 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a1f878e7-e59e-4d50-95ae-d2585b186283 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:50.202855 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a1f878e7-e59e-4d50-95ae-d2585b186283 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:50.207108 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a1f878e7-e59e-4d50-95ae-d2585b186283 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af" status: 200 len: 1362 microversion: 2.25 time: 0.479958 Oct 05 02:28:50.213422 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 273/561] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:28:49 2022] GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af => generated 1362 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:28:50.672556 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-286aa142-8d79-4a8f-89ca-58900ec1d729 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:50.674745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-286aa142-8d79-4a8f-89ca-58900ec1d729 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 04eb32f6-e354-4960-8e0b-0a0e20dcfe04] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:50.697911 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b2d89865-6c7e-4ed7-be0c-2bf3076029d7 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:50.698529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b2d89865-6c7e-4ed7-be0c-2bf3076029d7 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 3245900a-6147-427e-86e3-b0af919523e6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:50.706522 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2d89865-6c7e-4ed7-be0c-2bf3076029d7 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:50.707425 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2d89865-6c7e-4ed7-be0c-2bf3076029d7 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:50.708089 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2d89865-6c7e-4ed7-be0c-2bf3076029d7 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:50.709606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2d89865-6c7e-4ed7-be0c-2bf3076029d7 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:50.710338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2d89865-6c7e-4ed7-be0c-2bf3076029d7 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:50.710961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2d89865-6c7e-4ed7-be0c-2bf3076029d7 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:50.712667 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-286aa142-8d79-4a8f-89ca-58900ec1d729 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:50.719946 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-286aa142-8d79-4a8f-89ca-58900ec1d729 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:50.726375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-286aa142-8d79-4a8f-89ca-58900ec1d729 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:50.729577 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-286aa142-8d79-4a8f-89ca-58900ec1d729 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:50.734322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-286aa142-8d79-4a8f-89ca-58900ec1d729 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:50.741532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-286aa142-8d79-4a8f-89ca-58900ec1d729 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:51.257737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-286aa142-8d79-4a8f-89ca-58900ec1d729 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d53045696469487a6be6640b07f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a87f178aedc4acbb4bd353bc09a7cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:51.265789 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-286aa142-8d79-4a8f-89ca-58900ec1d729 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] 10.222.0.16 "GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04" status: 200 len: 1318 microversion: 2.1 time: 0.598126 Oct 05 02:28:51.266593 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 289/562] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:50 2022] GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04 => generated 1318 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:28:51.272424 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-da4766a5-1904-4b55-be12-4c26114e6705 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:51.273324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-da4766a5-1904-4b55-be12-4c26114e6705 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:51.281188 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da4766a5-1904-4b55-be12-4c26114e6705 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:51.282197 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da4766a5-1904-4b55-be12-4c26114e6705 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:51.282931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da4766a5-1904-4b55-be12-4c26114e6705 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:51.284467 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da4766a5-1904-4b55-be12-4c26114e6705 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:51.285119 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da4766a5-1904-4b55-be12-4c26114e6705 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:51.285694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da4766a5-1904-4b55-be12-4c26114e6705 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:51.335228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b2d89865-6c7e-4ed7-be0c-2bf3076029d7 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368f6c3db9f24561a13f48ce02e7655e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecbac50c16847799a85c148c6c143de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:51.352081 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b2d89865-6c7e-4ed7-be0c-2bf3076029d7 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6" status: 200 len: 1388 microversion: 2.1 time: 0.655349 Oct 05 02:28:51.354294 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 274/563] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:50 2022] GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6 => generated 1388 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:51.362122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-87b581a8-0bae-4e5d-9678-772a6164c94b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:51.372189 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-87b581a8-0bae-4e5d-9678-772a6164c94b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:51.380543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-87b581a8-0bae-4e5d-9678-772a6164c94b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:51.388226 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-87b581a8-0bae-4e5d-9678-772a6164c94b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:51.401517 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-87b581a8-0bae-4e5d-9678-772a6164c94b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:51.402602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-87b581a8-0bae-4e5d-9678-772a6164c94b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:51.403668 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-87b581a8-0bae-4e5d-9678-772a6164c94b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:51.404271 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-87b581a8-0bae-4e5d-9678-772a6164c94b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:51.502999 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-da4766a5-1904-4b55-be12-4c26114e6705 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:51.519863 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-da4766a5-1904-4b55-be12-4c26114e6705 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9" status: 200 len: 1269 microversion: 2.1 time: 0.247421 Oct 05 02:28:51.524466 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 290/564] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:51 2022] GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 => generated 1269 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:51.986579 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-87b581a8-0bae-4e5d-9678-772a6164c94b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:52.001675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-87b581a8-0bae-4e5d-9678-772a6164c94b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:52.003535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-87b581a8-0bae-4e5d-9678-772a6164c94b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:52.007433 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-87b581a8-0bae-4e5d-9678-772a6164c94b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af" status: 200 len: 1362 microversion: 2.25 time: 0.650176 Oct 05 02:28:52.008240 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 275/565] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:28:51 2022] GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af => generated 1362 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:28:52.293330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9209b5c1-9ee9-4851-8d4b-924c3c020d4f tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:52.293938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9209b5c1-9ee9-4851-8d4b-924c3c020d4f tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 04eb32f6-e354-4960-8e0b-0a0e20dcfe04] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:52.312445 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9209b5c1-9ee9-4851-8d4b-924c3c020d4f tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:52.312988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9209b5c1-9ee9-4851-8d4b-924c3c020d4f tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:52.313691 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9209b5c1-9ee9-4851-8d4b-924c3c020d4f tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:52.318373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9209b5c1-9ee9-4851-8d4b-924c3c020d4f tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:52.319263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9209b5c1-9ee9-4851-8d4b-924c3c020d4f tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:52.319721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9209b5c1-9ee9-4851-8d4b-924c3c020d4f tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:52.383688 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-573e9830-fd24-4bfe-ae5a-9e26b101da18 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:52.384329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-573e9830-fd24-4bfe-ae5a-9e26b101da18 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 3245900a-6147-427e-86e3-b0af919523e6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:52.393707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-573e9830-fd24-4bfe-ae5a-9e26b101da18 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:52.394559 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-573e9830-fd24-4bfe-ae5a-9e26b101da18 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:52.395164 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-573e9830-fd24-4bfe-ae5a-9e26b101da18 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:52.396064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-573e9830-fd24-4bfe-ae5a-9e26b101da18 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:52.396771 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-573e9830-fd24-4bfe-ae5a-9e26b101da18 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:52.397465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-573e9830-fd24-4bfe-ae5a-9e26b101da18 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:52.844233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9209b5c1-9ee9-4851-8d4b-924c3c020d4f tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d53045696469487a6be6640b07f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a87f178aedc4acbb4bd353bc09a7cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:52.857175 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9209b5c1-9ee9-4851-8d4b-924c3c020d4f tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] 10.222.0.16 "GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04" status: 200 len: 1318 microversion: 2.1 time: 0.567524 Oct 05 02:28:52.857767 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 291/566] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:52 2022] GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04 => generated 1318 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:52.873452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-227a80fe-15e1-4c47-b8d7-c3511944bd1d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:52.874078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-227a80fe-15e1-4c47-b8d7-c3511944bd1d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:52.880125 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-573e9830-fd24-4bfe-ae5a-9e26b101da18 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368f6c3db9f24561a13f48ce02e7655e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecbac50c16847799a85c148c6c143de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:52.888304 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-573e9830-fd24-4bfe-ae5a-9e26b101da18 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6" status: 200 len: 1388 microversion: 2.1 time: 0.510468 Oct 05 02:28:52.888882 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 276/567] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:52 2022] GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6 => generated 1388 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:28:52.913704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-227a80fe-15e1-4c47-b8d7-c3511944bd1d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:52.919181 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-227a80fe-15e1-4c47-b8d7-c3511944bd1d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:52.919717 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-227a80fe-15e1-4c47-b8d7-c3511944bd1d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:52.922861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-227a80fe-15e1-4c47-b8d7-c3511944bd1d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:52.923369 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-227a80fe-15e1-4c47-b8d7-c3511944bd1d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:52.924417 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-227a80fe-15e1-4c47-b8d7-c3511944bd1d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:53.043735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d1911713-abc5-4504-9718-382bb3151c9c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:53.046509 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d1911713-abc5-4504-9718-382bb3151c9c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:53.072685 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1911713-abc5-4504-9718-382bb3151c9c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:53.075130 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1911713-abc5-4504-9718-382bb3151c9c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:53.075586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1911713-abc5-4504-9718-382bb3151c9c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:53.076325 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1911713-abc5-4504-9718-382bb3151c9c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:53.082349 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1911713-abc5-4504-9718-382bb3151c9c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:53.082825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1911713-abc5-4504-9718-382bb3151c9c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:53.094859 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:53.914933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=19 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:54.280013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-227a80fe-15e1-4c47-b8d7-c3511944bd1d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:54.292853 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-227a80fe-15e1-4c47-b8d7-c3511944bd1d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9" status: 200 len: 1311 microversion: 2.1 time: 1.433951 Oct 05 02:28:54.313098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d1911713-abc5-4504-9718-382bb3151c9c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:54.323738 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 292/568] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:52 2022] GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 => generated 1311 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:54.340659 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d1911713-abc5-4504-9718-382bb3151c9c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:54.343488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d1911713-abc5-4504-9718-382bb3151c9c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:54.344863 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-11c17213-a0fc-4499-a5de-2a65e704608e tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:54.350457 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-11c17213-a0fc-4499-a5de-2a65e704608e tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 04eb32f6-e354-4960-8e0b-0a0e20dcfe04] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:54.353456 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d1911713-abc5-4504-9718-382bb3151c9c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af" status: 200 len: 1362 microversion: 2.25 time: 1.318275 Oct 05 02:28:54.355375 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 277/569] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:28:53 2022] GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af => generated 1362 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:28:54.370190 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a337f62d-f335-4d5e-b725-2976ac314977 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:54.370853 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11c17213-a0fc-4499-a5de-2a65e704608e tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:54.371550 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11c17213-a0fc-4499-a5de-2a65e704608e tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:54.372122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11c17213-a0fc-4499-a5de-2a65e704608e tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:54.373033 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a337f62d-f335-4d5e-b725-2976ac314977 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 3245900a-6147-427e-86e3-b0af919523e6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:54.373904 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11c17213-a0fc-4499-a5de-2a65e704608e tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:54.376854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11c17213-a0fc-4499-a5de-2a65e704608e tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:54.377616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11c17213-a0fc-4499-a5de-2a65e704608e tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:54.387926 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a337f62d-f335-4d5e-b725-2976ac314977 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:54.394212 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a337f62d-f335-4d5e-b725-2976ac314977 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:54.394897 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a337f62d-f335-4d5e-b725-2976ac314977 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:54.395962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a337f62d-f335-4d5e-b725-2976ac314977 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:54.398938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a337f62d-f335-4d5e-b725-2976ac314977 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:54.399622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a337f62d-f335-4d5e-b725-2976ac314977 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:55.234802 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a337f62d-f335-4d5e-b725-2976ac314977 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368f6c3db9f24561a13f48ce02e7655e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecbac50c16847799a85c148c6c143de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:55.238595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-11c17213-a0fc-4499-a5de-2a65e704608e tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d53045696469487a6be6640b07f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a87f178aedc4acbb4bd353bc09a7cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:55.246094 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a337f62d-f335-4d5e-b725-2976ac314977 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6" status: 200 len: 1587 microversion: 2.1 time: 0.886359 Oct 05 02:28:55.249582 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 278/570] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:54 2022] GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6 => generated 1587 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:55.254093 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-11c17213-a0fc-4499-a5de-2a65e704608e tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] 10.222.0.16 "GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04" status: 200 len: 1318 microversion: 2.1 time: 0.926420 Oct 05 02:28:55.257197 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 293/571] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:54 2022] GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04 => generated 1318 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:55.269897 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-21f682aa-afa7-4d12-8e36-3320f847974d tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:55.270643 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-21f682aa-afa7-4d12-8e36-3320f847974d tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 3245900a-6147-427e-86e3-b0af919523e6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:55.281462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-21f682aa-afa7-4d12-8e36-3320f847974d tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:55.290603 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-21f682aa-afa7-4d12-8e36-3320f847974d tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:55.291589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-21f682aa-afa7-4d12-8e36-3320f847974d tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:55.292507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-21f682aa-afa7-4d12-8e36-3320f847974d tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:55.293003 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-21f682aa-afa7-4d12-8e36-3320f847974d tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:55.293430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-21f682aa-afa7-4d12-8e36-3320f847974d tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:55.320579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-88c01ec1-59da-43bb-9d46-66a90f75c951 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:55.321302 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-88c01ec1-59da-43bb-9d46-66a90f75c951 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:55.335118 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88c01ec1-59da-43bb-9d46-66a90f75c951 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:55.340640 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88c01ec1-59da-43bb-9d46-66a90f75c951 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:55.341554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88c01ec1-59da-43bb-9d46-66a90f75c951 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:55.344600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88c01ec1-59da-43bb-9d46-66a90f75c951 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:55.345182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88c01ec1-59da-43bb-9d46-66a90f75c951 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:55.349513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88c01ec1-59da-43bb-9d46-66a90f75c951 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:55.705243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-88c01ec1-59da-43bb-9d46-66a90f75c951 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:55.718046 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-88c01ec1-59da-43bb-9d46-66a90f75c951 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9" status: 200 len: 1311 microversion: 2.1 time: 0.401983 Oct 05 02:28:55.718625 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 294/572] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:55 2022] GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 => generated 1311 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:55.729723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e45aa7f5-4848-4c16-9c37-2247a58f30ac tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:55.730554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e45aa7f5-4848-4c16-9c37-2247a58f30ac tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:55.746788 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e45aa7f5-4848-4c16-9c37-2247a58f30ac tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:55.748937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e45aa7f5-4848-4c16-9c37-2247a58f30ac tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:55.750264 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e45aa7f5-4848-4c16-9c37-2247a58f30ac tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:55.754901 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e45aa7f5-4848-4c16-9c37-2247a58f30ac tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:55.755730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e45aa7f5-4848-4c16-9c37-2247a58f30ac tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:55.756321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e45aa7f5-4848-4c16-9c37-2247a58f30ac tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:55.849271 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-21f682aa-afa7-4d12-8e36-3320f847974d tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.584325 Oct 05 02:28:55.858470 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 279/573] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 02:28:55 2022] GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6/os-interface => generated 285 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:56.395679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-72d0a051-0f3e-4b8b-a0a9-7f154d47f21f tempest-SecurityGroupsTestAdminJSON-1156252035 tempest-SecurityGroupsTestAdminJSON-1156252035-project] Action: 'create', calling method: .version_select at 0x7fcce433a040>, body: {"security_group": {"name": "tempest-securitygroup-153474433", "description": "tempest-description-2025136123"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:57.043465 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e45aa7f5-4848-4c16-9c37-2247a58f30ac tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:57.057323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e45aa7f5-4848-4c16-9c37-2247a58f30ac tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:57.059348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e45aa7f5-4848-4c16-9c37-2247a58f30ac tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:57.065198 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e45aa7f5-4848-4c16-9c37-2247a58f30ac tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af" status: 200 len: 1362 microversion: 2.25 time: 1.339705 Oct 05 02:28:57.066027 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 295/574] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:28:55 2022] GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af => generated 1362 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:28:57.080832 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-181ea398-5584-4eca-999e-17477b4c85ae tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:57.082176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-181ea398-5584-4eca-999e-17477b4c85ae tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 04eb32f6-e354-4960-8e0b-0a0e20dcfe04] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:57.098384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-181ea398-5584-4eca-999e-17477b4c85ae tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:57.099184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-181ea398-5584-4eca-999e-17477b4c85ae tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:57.099837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-181ea398-5584-4eca-999e-17477b4c85ae tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:57.100827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-181ea398-5584-4eca-999e-17477b4c85ae tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:57.101638 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-181ea398-5584-4eca-999e-17477b4c85ae tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:57.102305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-181ea398-5584-4eca-999e-17477b4c85ae tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:58.192326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-181ea398-5584-4eca-999e-17477b4c85ae tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d53045696469487a6be6640b07f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a87f178aedc4acbb4bd353bc09a7cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:58.205277 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-181ea398-5584-4eca-999e-17477b4c85ae tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] 10.222.0.16 "GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04" status: 200 len: 1318 microversion: 2.1 time: 1.134300 Oct 05 02:28:58.205985 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 296/575] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:57 2022] GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04 => generated 1318 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:58.221117 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-05915c3d-d579-4e2d-8400-187d250d17db tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:58.221117 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-05915c3d-d579-4e2d-8400-187d250d17db tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:58.221596 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:58.237111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05915c3d-d579-4e2d-8400-187d250d17db tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:58.237616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05915c3d-d579-4e2d-8400-187d250d17db tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:58.238054 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05915c3d-d579-4e2d-8400-187d250d17db tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:58.238778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05915c3d-d579-4e2d-8400-187d250d17db tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:58.239478 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05915c3d-d579-4e2d-8400-187d250d17db tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:58.240059 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05915c3d-d579-4e2d-8400-187d250d17db tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:58.246033 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:58.276136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:58.725158 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-72d0a051-0f3e-4b8b-a0a9-7f154d47f21f tempest-SecurityGroupsTestAdminJSON-1156252035 tempest-SecurityGroupsTestAdminJSON-1156252035-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.859797 Oct 05 02:28:58.726526 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 280/576] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 5 02:28:55 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:58.734408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-71eaca7a-bd21-4fab-a270-e8f5a5f4f0a5 req-78e489b3-2d21-41ac-bd80-de3cf54565b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04eb32f6-e354-4960-8e0b-0a0e20dcfe04", "name": "network-vif-plugged", "status": "completed", "tag": "93d69049-27c8-4ca0-af05-bcca725b246b"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:58.811833 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-71eaca7a-bd21-4fab-a270-e8f5a5f4f0a5 req-78e489b3-2d21-41ac-bd80-de3cf54565b4 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:58.812730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-71eaca7a-bd21-4fab-a270-e8f5a5f4f0a5 req-78e489b3-2d21-41ac-bd80-de3cf54565b4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:58.813356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-71eaca7a-bd21-4fab-a270-e8f5a5f4f0a5 req-78e489b3-2d21-41ac-bd80-de3cf54565b4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:58.854479 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-71eaca7a-bd21-4fab-a270-e8f5a5f4f0a5 req-78e489b3-2d21-41ac-bd80-de3cf54565b4 service nova] Creating event network-vif-plugged:93d69049-27c8-4ca0-af05-bcca725b246b for instance 04eb32f6-e354-4960-8e0b-0a0e20dcfe04 on n-h2-858272-3 Oct 05 02:28:58.865460 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-71eaca7a-bd21-4fab-a270-e8f5a5f4f0a5 req-78e489b3-2d21-41ac-bd80-de3cf54565b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137288 Oct 05 02:28:58.866227 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 281/577] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:58.867163 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:58.878906 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e74aa969-2d24-4f9f-b2d8-4f07acb9f182 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:58.883128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e74aa969-2d24-4f9f-b2d8-4f07acb9f182 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:58.897934 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e74aa969-2d24-4f9f-b2d8-4f07acb9f182 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:58.898612 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e74aa969-2d24-4f9f-b2d8-4f07acb9f182 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:58.899140 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e74aa969-2d24-4f9f-b2d8-4f07acb9f182 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:58.899940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e74aa969-2d24-4f9f-b2d8-4f07acb9f182 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:58.901278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e74aa969-2d24-4f9f-b2d8-4f07acb9f182 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:58.904626 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-05915c3d-d579-4e2d-8400-187d250d17db tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:58.905368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e74aa969-2d24-4f9f-b2d8-4f07acb9f182 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:58.940824 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-05915c3d-d579-4e2d-8400-187d250d17db tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9" status: 200 len: 1311 microversion: 2.1 time: 0.733548 Oct 05 02:28:58.941463 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 297/578] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:58 2022] GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 => generated 1311 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:28:58.963368 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1a8dac1d-2db8-4a61-a3d1-9f0af2150145 tempest-SecurityGroupsTestAdminJSON-1156252035 tempest-SecurityGroupsTestAdminJSON-1156252035-project] Action: 'create', calling method: .version_select at 0x7fcce44e2f70>, body: {"security_group": {"name": "tempest-securitygroup-954166630", "description": "tempest-description-2059189170"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:59.364670 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e74aa969-2d24-4f9f-b2d8-4f07acb9f182 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:59.376028 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e74aa969-2d24-4f9f-b2d8-4f07acb9f182 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:59.380213 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e74aa969-2d24-4f9f-b2d8-4f07acb9f182 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:28:59.381945 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e74aa969-2d24-4f9f-b2d8-4f07acb9f182 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af" status: 200 len: 1362 microversion: 2.25 time: 0.513365 Oct 05 02:28:59.383317 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 282/579] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:28:58 2022] GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af => generated 1362 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:28:59.388649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cd9595fd-5c6a-4031-9105-c96886575e2a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:28:59.389677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cd9595fd-5c6a-4031-9105-c96886575e2a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 04eb32f6-e354-4960-8e0b-0a0e20dcfe04] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:28:59.399662 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd9595fd-5c6a-4031-9105-c96886575e2a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:59.400368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd9595fd-5c6a-4031-9105-c96886575e2a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:59.401116 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd9595fd-5c6a-4031-9105-c96886575e2a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:59.402016 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd9595fd-5c6a-4031-9105-c96886575e2a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:59.402663 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd9595fd-5c6a-4031-9105-c96886575e2a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:59.403329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd9595fd-5c6a-4031-9105-c96886575e2a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:59.948840 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1a8dac1d-2db8-4a61-a3d1-9f0af2150145 tempest-SecurityGroupsTestAdminJSON-1156252035 tempest-SecurityGroupsTestAdminJSON-1156252035-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.006295 Oct 05 02:28:59.949728 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 298/580] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 5 02:28:58 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:28:59.954111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-62a01b98-0520-45e4-9a08-37e11b53c149 req-abdc53d1-395f-4888-b281-1967ad8ea0ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94c1a311-92cb-4a6f-9d45-32af2f3ae6e9", "tag": "235b3397-5893-46bc-98c1-77706502791c"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:28:59.968972 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-62a01b98-0520-45e4-9a08-37e11b53c149 req-abdc53d1-395f-4888-b281-1967ad8ea0ad service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:28:59.970018 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-62a01b98-0520-45e4-9a08-37e11b53c149 req-abdc53d1-395f-4888-b281-1967ad8ea0ad service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:28:59.971546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-62a01b98-0520-45e4-9a08-37e11b53c149 req-abdc53d1-395f-4888-b281-1967ad8ea0ad service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:28:59.986552 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-62a01b98-0520-45e4-9a08-37e11b53c149 req-abdc53d1-395f-4888-b281-1967ad8ea0ad service nova] Creating event network-changed:235b3397-5893-46bc-98c1-77706502791c for instance 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 on n-h1-858272-3 Oct 05 02:28:59.992748 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-62a01b98-0520-45e4-9a08-37e11b53c149 req-abdc53d1-395f-4888-b281-1967ad8ea0ad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041710 Oct 05 02:28:59.993740 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 299/581] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:00.305215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b7b614ac-a88b-4ea9-b684-5a935bae1d14 tempest-SecurityGroupsTestAdminJSON-1302567777 tempest-SecurityGroupsTestAdminJSON-1302567777-project-admin] Action: 'create', calling method: .version_select at 0x7fcce44fb280>, body: {"security_group": {"name": "tempest-securitygroup-1014555953", "description": "tempest-description-1336090289"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:00.357391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cd9595fd-5c6a-4031-9105-c96886575e2a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d53045696469487a6be6640b07f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a87f178aedc4acbb4bd353bc09a7cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:00.367166 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cd9595fd-5c6a-4031-9105-c96886575e2a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] 10.222.0.16 "GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04" status: 200 len: 1318 microversion: 2.1 time: 0.982338 Oct 05 02:29:00.369962 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 283/582] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:28:59 2022] GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04 => generated 1318 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:00.375192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9a8f055c-7dcc-48de-9986-8d3e6571ef1e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:00.375976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9a8f055c-7dcc-48de-9986-8d3e6571ef1e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:00.383723 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a8f055c-7dcc-48de-9986-8d3e6571ef1e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:00.384448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a8f055c-7dcc-48de-9986-8d3e6571ef1e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:00.385082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a8f055c-7dcc-48de-9986-8d3e6571ef1e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:00.386014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a8f055c-7dcc-48de-9986-8d3e6571ef1e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:00.386629 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a8f055c-7dcc-48de-9986-8d3e6571ef1e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:00.387211 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a8f055c-7dcc-48de-9986-8d3e6571ef1e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:00.795394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9a8f055c-7dcc-48de-9986-8d3e6571ef1e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:00.816396 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9a8f055c-7dcc-48de-9986-8d3e6571ef1e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9" status: 200 len: 1311 microversion: 2.1 time: 0.445107 Oct 05 02:29:00.817323 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 284/583] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:00 2022] GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 => generated 1311 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:00.822217 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-446bf57b-bcb3-432c-b854-9fdf1f481edb tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:00.823038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-446bf57b-bcb3-432c-b854-9fdf1f481edb tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:00.837720 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-446bf57b-bcb3-432c-b854-9fdf1f481edb tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:00.838484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-446bf57b-bcb3-432c-b854-9fdf1f481edb tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:00.839089 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-446bf57b-bcb3-432c-b854-9fdf1f481edb tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:00.839987 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-446bf57b-bcb3-432c-b854-9fdf1f481edb tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:00.840603 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-446bf57b-bcb3-432c-b854-9fdf1f481edb tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:00.853679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-446bf57b-bcb3-432c-b854-9fdf1f481edb tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:01.291338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-446bf57b-bcb3-432c-b854-9fdf1f481edb tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:01.307889 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-446bf57b-bcb3-432c-b854-9fdf1f481edb tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:01.309423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-446bf57b-bcb3-432c-b854-9fdf1f481edb tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:01.310605 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-446bf57b-bcb3-432c-b854-9fdf1f481edb tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af" status: 200 len: 1362 microversion: 2.25 time: 0.492135 Oct 05 02:29:01.311417 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 285/584] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:29:00 2022] GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af => generated 1362 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:29:01.317808 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-303d7f10-cdf3-4b77-b0ac-8f120a1efe78 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:01.328751 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-303d7f10-cdf3-4b77-b0ac-8f120a1efe78 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 3245900a-6147-427e-86e3-b0af919523e6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:01.343768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-303d7f10-cdf3-4b77-b0ac-8f120a1efe78 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:01.344654 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-303d7f10-cdf3-4b77-b0ac-8f120a1efe78 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:01.345895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-303d7f10-cdf3-4b77-b0ac-8f120a1efe78 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:01.349587 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-303d7f10-cdf3-4b77-b0ac-8f120a1efe78 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:01.350293 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-303d7f10-cdf3-4b77-b0ac-8f120a1efe78 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:01.350730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-303d7f10-cdf3-4b77-b0ac-8f120a1efe78 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:01.444307 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b7b614ac-a88b-4ea9-b684-5a935bae1d14 tempest-SecurityGroupsTestAdminJSON-1302567777 tempest-SecurityGroupsTestAdminJSON-1302567777-project-admin] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.449132 Oct 05 02:29:01.449322 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 300/585] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 5 02:28:59 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:01.453315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-0ceb5a0e-6f25-431d-9368-15379111cec9 req-5f3762b5-d99a-452d-9f70-ae4b7e9b6085 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "079782c4-bca1-40e0-aa9f-b8afdb6a79af", "name": "network-vif-plugged", "status": "completed", "tag": "0a2b9672-d33e-4824-9498-5a3e1b415686"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:01.487675 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-0ceb5a0e-6f25-431d-9368-15379111cec9 req-5f3762b5-d99a-452d-9f70-ae4b7e9b6085 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:01.488394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-0ceb5a0e-6f25-431d-9368-15379111cec9 req-5f3762b5-d99a-452d-9f70-ae4b7e9b6085 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:01.490959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-0ceb5a0e-6f25-431d-9368-15379111cec9 req-5f3762b5-d99a-452d-9f70-ae4b7e9b6085 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:01.504118 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-0ceb5a0e-6f25-431d-9368-15379111cec9 req-5f3762b5-d99a-452d-9f70-ae4b7e9b6085 service nova] Creating event network-vif-plugged:0a2b9672-d33e-4824-9498-5a3e1b415686 for instance 079782c4-bca1-40e0-aa9f-b8afdb6a79af on n-h2-858272-3 Oct 05 02:29:01.509823 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-0ceb5a0e-6f25-431d-9368-15379111cec9 req-5f3762b5-d99a-452d-9f70-ae4b7e9b6085 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063544 Oct 05 02:29:01.511128 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 301/586] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:01.520057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-228d98a0-7e33-425f-bfde-f7023b4b84c8 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:01.521144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-228d98a0-7e33-425f-bfde-f7023b4b84c8 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 04eb32f6-e354-4960-8e0b-0a0e20dcfe04] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:01.529739 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-228d98a0-7e33-425f-bfde-f7023b4b84c8 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:01.530473 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-228d98a0-7e33-425f-bfde-f7023b4b84c8 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:01.531108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-228d98a0-7e33-425f-bfde-f7023b4b84c8 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:01.532254 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-228d98a0-7e33-425f-bfde-f7023b4b84c8 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:01.534105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-228d98a0-7e33-425f-bfde-f7023b4b84c8 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:01.535088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-228d98a0-7e33-425f-bfde-f7023b4b84c8 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:01.635930 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-303d7f10-cdf3-4b77-b0ac-8f120a1efe78 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368f6c3db9f24561a13f48ce02e7655e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecbac50c16847799a85c148c6c143de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:01.646102 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-303d7f10-cdf3-4b77-b0ac-8f120a1efe78 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6" status: 200 len: 1587 microversion: 2.1 time: 0.333354 Oct 05 02:29:01.661854 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 286/587] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:01 2022] GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6 => generated 1587 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:01.661854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e5019ae7-0197-4972-b2bb-a952c7669c70 tempest-SecurityGroupsTestAdminJSON-1302567777 tempest-SecurityGroupsTestAdminJSON-1302567777-project-admin] Action: 'create', calling method: .version_select at 0x7fcce4262160>, body: {"security_group": {"name": "tempest-securitygroup-789235671", "description": "tempest-description-2043148624"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:01.898296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-228d98a0-7e33-425f-bfde-f7023b4b84c8 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d53045696469487a6be6640b07f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a87f178aedc4acbb4bd353bc09a7cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:01.911534 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-228d98a0-7e33-425f-bfde-f7023b4b84c8 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] 10.222.0.16 "GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04" status: 200 len: 1468 microversion: 2.1 time: 0.396071 Oct 05 02:29:01.917260 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 302/588] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:01 2022] GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04 => generated 1468 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:01.936828 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b290adff-7e9a-4dc1-af87-276a36253e0c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:01.937847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b290adff-7e9a-4dc1-af87-276a36253e0c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:01.951270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b290adff-7e9a-4dc1-af87-276a36253e0c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:01.954069 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b290adff-7e9a-4dc1-af87-276a36253e0c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:01.954758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b290adff-7e9a-4dc1-af87-276a36253e0c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:01.955737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b290adff-7e9a-4dc1-af87-276a36253e0c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:01.957547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b290adff-7e9a-4dc1-af87-276a36253e0c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:01.958170 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b290adff-7e9a-4dc1-af87-276a36253e0c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:02.133273 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e5019ae7-0197-4972-b2bb-a952c7669c70 tempest-SecurityGroupsTestAdminJSON-1302567777 tempest-SecurityGroupsTestAdminJSON-1302567777-project-admin] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.477959 Oct 05 02:29:02.141110 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 287/589] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 5 02:29:01 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:02.406822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b290adff-7e9a-4dc1-af87-276a36253e0c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:02.419061 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b290adff-7e9a-4dc1-af87-276a36253e0c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9" status: 200 len: 1311 microversion: 2.1 time: 0.498758 Oct 05 02:29:02.421903 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 303/590] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:01 2022] GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 => generated 1311 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:02.427091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-eb3648f6-f0d3-4d69-87c4-02ecaba67209 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-929419149", "block_migration": true, "disk_over_commit": false}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:02.430447 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-eb3648f6-f0d3-4d69-87c4-02ecaba67209 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] [instance: 04eb32f6-e354-4960-8e0b-0a0e20dcfe04] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:02.438021 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-616b79fd-2e80-47a2-bdaa-9d1f50fb05f5 req-eef934a8-3439-4ade-ad33-07e4101e36d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3245900a-6147-427e-86e3-b0af919523e6", "tag": "11e57809-b0ee-4162-9bf6-2a552194ea98"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:02.446396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb3648f6-f0d3-4d69-87c4-02ecaba67209 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:02.446895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb3648f6-f0d3-4d69-87c4-02ecaba67209 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:02.447345 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb3648f6-f0d3-4d69-87c4-02ecaba67209 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:02.448066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb3648f6-f0d3-4d69-87c4-02ecaba67209 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:02.448534 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb3648f6-f0d3-4d69-87c4-02ecaba67209 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:02.448994 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb3648f6-f0d3-4d69-87c4-02ecaba67209 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:02.478260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-616b79fd-2e80-47a2-bdaa-9d1f50fb05f5 req-eef934a8-3439-4ade-ad33-07e4101e36d9 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:02.481886 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-616b79fd-2e80-47a2-bdaa-9d1f50fb05f5 req-eef934a8-3439-4ade-ad33-07e4101e36d9 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:02.482540 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-616b79fd-2e80-47a2-bdaa-9d1f50fb05f5 req-eef934a8-3439-4ade-ad33-07e4101e36d9 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:02.503033 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-616b79fd-2e80-47a2-bdaa-9d1f50fb05f5 req-eef934a8-3439-4ade-ad33-07e4101e36d9 service nova] Creating event network-changed:11e57809-b0ee-4162-9bf6-2a552194ea98 for instance 3245900a-6147-427e-86e3-b0af919523e6 on n-h2-858272-3 Oct 05 02:29:02.503376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-eb3648f6-f0d3-4d69-87c4-02ecaba67209 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Lazy-loading 'flavor' on Instance uuid 04eb32f6-e354-4960-8e0b-0a0e20dcfe04 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:29:02.518885 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-616b79fd-2e80-47a2-bdaa-9d1f50fb05f5 req-eef934a8-3439-4ade-ad33-07e4101e36d9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094348 Oct 05 02:29:02.519511 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 304/591] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:02.530084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-eb3648f6-f0d3-4d69-87c4-02ecaba67209 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] [instance: 04eb32f6-e354-4960-8e0b-0a0e20dcfe04] Going to try to live migrate instance to tempest-host-929419149 {{(pid=122320) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 05 02:29:02.540214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3558af99-d40c-4a5c-a691-a8f8f858d432 tempest-SecurityGroupsTestAdminJSON-1302567777 tempest-SecurityGroupsTestAdminJSON-1302567777-project-admin] Calling method '.version_select at 0x7fcce43e9790>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:02.543730 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-eb3648f6-f0d3-4d69-87c4-02ecaba67209 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] HTTP exception thrown: Compute host tempest-host-929419149 could not be found. Oct 05 02:29:02.583422 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-eb3648f6-f0d3-4d69-87c4-02ecaba67209 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Request method failure captured: Oct 05 02:29:02.583422 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04/action HTTP/1.1 Oct 05 02:29:02.583422 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:29:02.583422 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:29:02.583422 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:29:02.583422 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 106 Oct 05 02:29:02.583422 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:29:02.583422 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:29:02.583422 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:29:02.583422 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:29:02.583422 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOvRsJ9oCqPKJ967BJVBiqIb6cIi7BObQZWkG7dNVAEkmKpEJSLpPZ50RPlwJ0fwKoibMLfCSjulSdmLK13w8NqaHX8hpeNUQIKbsfe5-1krC9eKTAQux8Svsj50cvqbgde2WLpAXLeL_8ifEewhLh7r2AIe1RVsAx14zoixq0l35nQ Oct 05 02:29:02.583422 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:29:02.583422 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:29:02.583422 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:29:02.583422 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:29:02.583422 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:29:02.583422 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:29:02.583422 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 19c4516dd1264ac2859de4efe1d1b65c Oct 05 02:29:02.583422 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-LiveMigrationNegativeTest-427432159 Oct 05 02:29:02.583422 n-d-858272-3 devstack@n-api.service[122320]: X-Role: admin,member,reader Oct 05 02:29:02.583422 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: admin,member,reader Oct 05 02:29:02.585146 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/19c4516dd1264ac2859de4efe1d1b65c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/19c4516dd1264ac2859de4efe1d1b65c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/19c4516dd1264ac2859de4efe1d1b65c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_19c4516dd1264ac2859de4efe1d1b65c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:29:02.585146 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-LiveMigrationNegativeTest-427432159 Oct 05 02:29:02.585146 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 19c4516dd1264ac2859de4efe1d1b65c Oct 05 02:29:02.585146 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-427432159 Oct 05 02:29:02.585146 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-LiveMigrationNegativeTest-427432159-project-admin Oct 05 02:29:02.585146 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:29:02.585146 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:29:02.585146 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 4c3c9b08350041d38262ea35c9f70812 Oct 05 02:29:02.585146 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-LiveMigrationNegativeTest-427432159-project-admin Oct 05 02:29:02.585146 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:29:02.585146 n-d-858272-3 devstack@n-api.service[122320]: {"os-migrateLive": {"host": "tempest-host-929419149", "block_migration": true, "disk_over_commit": false}} Oct 05 02:29:02.585146 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:29:02.586044 n-d-858272-3 devstack@n-api.service[122320]: exception: Compute host tempest-host-929419149 could not be found. Oct 05 02:29:02.586044 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '04eb32f6-e354-4960-8e0b-0a0e20dcfe04', 'body': {'os-migrateLive': {'host': 'tempest-host-929419149', 'block_migration': True, 'disk_over_commit': False}}} Oct 05 02:29:02.586044 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:29:02.586044 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:29:02.586044 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 05 02:29:02.586044 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 05 02:29:02.586044 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 05 02:29:02.586044 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 02:29:02.586044 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 05 02:29:02.586044 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 05 02:29:02.586044 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 05 02:29:02.586044 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 02:29:02.586044 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 05 02:29:02.586044 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 05 02:29:02.586044 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 05 02:29:02.586044 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 02:29:02.586044 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 05 02:29:02.586044 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 02:29:02.586044 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 02:29:02.587402 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 02:29:02.587402 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 05 02:29:02.587402 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 02:29:02.587402 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 05 02:29:02.587402 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 05 02:29:02.587402 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:29:02.587402 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:29:02.587402 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 05 02:29:02.587402 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 05 02:29:02.587402 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 05 02:29:02.587402 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:29:02.587402 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 05 02:29:02.587402 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 05 02:29:02.587402 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 05 02:29:02.587402 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 05 02:29:02.587402 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 05 02:29:02.587402 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 05 02:29:02.587402 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-929419149 could not be found. Oct 05 02:29:02.587402 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:29:02.588734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:29:02.588734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:29:02.588734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:29:02.588734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:29:02.588734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:29:02.588734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:29:02.588734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:29:02.588734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:29:02.588734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:29:02.588734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:29:02.588734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:29:02.588734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:29:02.588734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:29:02.588734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:29:02.588734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:29:02.588734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 05 02:29:02.588734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 05 02:29:02.588734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 05 02:29:02.588734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-929419149 could not be found. Oct 05 02:29:02.588734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:29:02.590162 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:29:02.590162 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:29:02.590162 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:29:02.590162 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:29:02.590162 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:29:02.590162 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:29:02.590162 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:29:02.590162 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-929419149 could not be found. Oct 05 02:29:02.590162 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:29:02.590162 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-eb3648f6-f0d3-4d69-87c4-02ecaba67209 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Returning 400 to user: Compute host tempest-host-929419149 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:29:02.594786 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-eb3648f6-f0d3-4d69-87c4-02ecaba67209 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04/action" status: 400 len: 99 microversion: 2.1 time: 0.452001 Oct 05 02:29:02.602843 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 288/592] 10.222.0.16 () {60 vars in 1279 bytes} [Wed Oct 5 02:29:02 2022] POST /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04/action => generated 99 bytes in 461 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 05 02:29:02.743609 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-75111876-f68f-4c54-8226-32b592263158 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Action: 'create', calling method: .version_select at 0x7fcce4262a60>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-2099383921", "policies": ["affinity"]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:02.794286 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-75111876-f68f-4c54-8226-32b592263158 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Getting quotas for project 92e7bf1499e6408da408d85bddc4d95b. Resources: {'server_groups'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:29:02.800353 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-75111876-f68f-4c54-8226-32b592263158 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Getting quotas for user 000b799366da44838465be08b88fb27d and project 92e7bf1499e6408da408d85bddc4d95b. Resources: {'server_groups'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:29:02.886189 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-75111876-f68f-4c54-8226-32b592263158 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Getting quotas for project 92e7bf1499e6408da408d85bddc4d95b. Resources: {'server_groups'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:29:02.898420 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-75111876-f68f-4c54-8226-32b592263158 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Getting quotas for user 000b799366da44838465be08b88fb27d and project 92e7bf1499e6408da408d85bddc4d95b. Resources: {'server_groups'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:29:02.948717 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-75111876-f68f-4c54-8226-32b592263158 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.344362 Oct 05 02:29:02.949696 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 289/593] 10.222.0.16 () {60 vars in 1174 bytes} [Wed Oct 5 02:29:02 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:02.960063 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-83b0b525-c970-45db-8d94-4a2b7811b375 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:02.960944 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-83b0b525-c970-45db-8d94-4a2b7811b375 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:02.983619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83b0b525-c970-45db-8d94-4a2b7811b375 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:02.985036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83b0b525-c970-45db-8d94-4a2b7811b375 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:02.985679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83b0b525-c970-45db-8d94-4a2b7811b375 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:02.987077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83b0b525-c970-45db-8d94-4a2b7811b375 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:02.988534 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83b0b525-c970-45db-8d94-4a2b7811b375 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:02.989184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83b0b525-c970-45db-8d94-4a2b7811b375 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:03.415385 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-83b0b525-c970-45db-8d94-4a2b7811b375 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:03.429205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-83b0b525-c970-45db-8d94-4a2b7811b375 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:03.434416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-83b0b525-c970-45db-8d94-4a2b7811b375 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:03.437327 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-83b0b525-c970-45db-8d94-4a2b7811b375 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af" status: 200 len: 1362 microversion: 2.25 time: 0.486564 Oct 05 02:29:03.438378 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 290/594] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:29:02 2022] GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af => generated 1362 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:29:03.450612 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4270b29b-54f2-4029-bcb3-b259388bfb54 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:03.451643 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4270b29b-54f2-4029-bcb3-b259388bfb54 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 04eb32f6-e354-4960-8e0b-0a0e20dcfe04] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:03.466515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4270b29b-54f2-4029-bcb3-b259388bfb54 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:03.467516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4270b29b-54f2-4029-bcb3-b259388bfb54 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:03.468121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4270b29b-54f2-4029-bcb3-b259388bfb54 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:03.471399 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4270b29b-54f2-4029-bcb3-b259388bfb54 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:03.472092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4270b29b-54f2-4029-bcb3-b259388bfb54 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:03.472669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4270b29b-54f2-4029-bcb3-b259388bfb54 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:04.041538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4270b29b-54f2-4029-bcb3-b259388bfb54 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d53045696469487a6be6640b07f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a87f178aedc4acbb4bd353bc09a7cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:04.057674 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4270b29b-54f2-4029-bcb3-b259388bfb54 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] 10.222.0.16 "GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04" status: 200 len: 1468 microversion: 2.1 time: 0.616167 Oct 05 02:29:04.058629 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 291/595] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:03 2022] GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04 => generated 1468 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:04.069158 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0f561517-f537-4c23-8f21-d662903bf4b6 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Action: 'create', calling method: .version_select at 0x7fcce4272f70>, body: {"server_group": {"name": "tempest-server-group-1868592781", "policies": ["affinity"]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:04.103087 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-0f561517-f537-4c23-8f21-d662903bf4b6 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Getting quotas for project 92e7bf1499e6408da408d85bddc4d95b. Resources: {'server_groups'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:29:04.118372 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-0f561517-f537-4c23-8f21-d662903bf4b6 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Getting quotas for user 000b799366da44838465be08b88fb27d and project 92e7bf1499e6408da408d85bddc4d95b. Resources: {'server_groups'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:29:04.254427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-0f561517-f537-4c23-8f21-d662903bf4b6 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Getting quotas for project 92e7bf1499e6408da408d85bddc4d95b. Resources: {'server_groups'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:29:04.278078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-0f561517-f537-4c23-8f21-d662903bf4b6 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Getting quotas for user 000b799366da44838465be08b88fb27d and project 92e7bf1499e6408da408d85bddc4d95b. Resources: {'server_groups'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:29:04.313528 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0f561517-f537-4c23-8f21-d662903bf4b6 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.248790 Oct 05 02:29:04.318018 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 292/596] 10.222.0.16 () {60 vars in 1173 bytes} [Wed Oct 5 02:29:04 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:04.330834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2a6c58a6-a024-45dc-afaa-c2b4ec79c4ad tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:04.334312 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2a6c58a6-a024-45dc-afaa-c2b4ec79c4ad tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:04.360245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2a6c58a6-a024-45dc-afaa-c2b4ec79c4ad tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:04.362325 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2a6c58a6-a024-45dc-afaa-c2b4ec79c4ad tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:04.362942 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2a6c58a6-a024-45dc-afaa-c2b4ec79c4ad tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:04.363831 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2a6c58a6-a024-45dc-afaa-c2b4ec79c4ad tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:04.366510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2a6c58a6-a024-45dc-afaa-c2b4ec79c4ad tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:04.367167 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2a6c58a6-a024-45dc-afaa-c2b4ec79c4ad tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:04.631916 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2a6c58a6-a024-45dc-afaa-c2b4ec79c4ad tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:04.640786 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2a6c58a6-a024-45dc-afaa-c2b4ec79c4ad tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9" status: 200 len: 1311 microversion: 2.1 time: 0.321282 Oct 05 02:29:04.641868 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 293/597] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:04 2022] GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 => generated 1311 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:04.662803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e2553673-7923-40f7-811b-2ac4f561c231 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2051817699", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:04.730465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-e2553673-7923-40f7-811b-2ac4f561c231 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] validate_networks() for None {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:29:05.561067 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-e2553673-7923-40f7-811b-2ac4f561c231 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:29:05.562320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-e2553673-7923-40f7-811b-2ac4f561c231 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:29:05.562774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-e2553673-7923-40f7-811b-2ac4f561c231 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:29:05.563210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-e2553673-7923-40f7-811b-2ac4f561c231 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:29:05.563686 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-e2553673-7923-40f7-811b-2ac4f561c231 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:29:05.584237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2553673-7923-40f7-811b-2ac4f561c231 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:05.585829 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2553673-7923-40f7-811b-2ac4f561c231 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:05.587258 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2553673-7923-40f7-811b-2ac4f561c231 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:05.589380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2553673-7923-40f7-811b-2ac4f561c231 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:05.590120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2553673-7923-40f7-811b-2ac4f561c231 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:05.591005 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2553673-7923-40f7-811b-2ac4f561c231 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:05.625263 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-e2553673-7923-40f7-811b-2ac4f561c231 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Getting quotas for project 7a87f178aedc4acbb4bd353bc09a7cb3. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:29:05.632523 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:05.634037 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-e2553673-7923-40f7-811b-2ac4f561c231 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Getting quotas for user 1d5d53045696469487a6be6640b07f6e and project 7a87f178aedc4acbb4bd353bc09a7cb3. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:29:05.649688 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e2553673-7923-40f7-811b-2ac4f561c231 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:29:05.652225 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e2553673-7923-40f7-811b-2ac4f561c231 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 4125f403-0514-4a60-983f-51f76c7b99cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:29:05.733728 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e2553673-7923-40f7-811b-2ac4f561c231 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.087132 Oct 05 02:29:05.736945 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 294/598] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:29:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:29:05.743182 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bc1787c8-d46d-40f5-a8a8-417c9678beac tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Action: 'create', calling method: .version_select at 0x7fcce42d0a60>, body: {"server_group": {"name": "tempest-server-group-1868592781", "policies": ["affinity"]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:05.845539 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-bc1787c8-d46d-40f5-a8a8-417c9678beac tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Getting quotas for project 92e7bf1499e6408da408d85bddc4d95b. Resources: {'server_groups'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:29:05.864797 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-bc1787c8-d46d-40f5-a8a8-417c9678beac tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Getting quotas for user 000b799366da44838465be08b88fb27d and project 92e7bf1499e6408da408d85bddc4d95b. Resources: {'server_groups'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:29:05.930214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-bc1787c8-d46d-40f5-a8a8-417c9678beac tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Getting quotas for project 92e7bf1499e6408da408d85bddc4d95b. Resources: {'server_groups'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:29:05.936704 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-bc1787c8-d46d-40f5-a8a8-417c9678beac tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Getting quotas for user 000b799366da44838465be08b88fb27d and project 92e7bf1499e6408da408d85bddc4d95b. Resources: {'server_groups'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:29:05.957004 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bc1787c8-d46d-40f5-a8a8-417c9678beac tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.218590 Oct 05 02:29:05.964981 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 295/599] 10.222.0.16 () {60 vars in 1173 bytes} [Wed Oct 5 02:29:05 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:05.964981 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8f903b9d-5699-4ff4-8310-614fc0d4902a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:05.965755 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8f903b9d-5699-4ff4-8310-614fc0d4902a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:05.985089 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f903b9d-5699-4ff4-8310-614fc0d4902a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:05.990087 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f903b9d-5699-4ff4-8310-614fc0d4902a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:05.995725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f903b9d-5699-4ff4-8310-614fc0d4902a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:05.996709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f903b9d-5699-4ff4-8310-614fc0d4902a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:05.997227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f903b9d-5699-4ff4-8310-614fc0d4902a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:05.997665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f903b9d-5699-4ff4-8310-614fc0d4902a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:06.426449 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8f903b9d-5699-4ff4-8310-614fc0d4902a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:06.442715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8f903b9d-5699-4ff4-8310-614fc0d4902a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:06.450642 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8f903b9d-5699-4ff4-8310-614fc0d4902a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:06.451735 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8f903b9d-5699-4ff4-8310-614fc0d4902a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af" status: 200 len: 1558 microversion: 2.25 time: 0.492715 Oct 05 02:29:06.452303 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 296/600] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:29:05 2022] GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af => generated 1558 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:29:06.566980 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dde52ac8-ba60-4869-9cc1-604e78180c15 tempest-FloatingIPDetailsTestJSON-65459292 tempest-FloatingIPDetailsTestJSON-65459292-project] Action: 'create', calling method: .version_select at 0x7fcce42a7550>, body: {"pool": null} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:10.615235 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3558af99-d40c-4a5c-a691-a8f8f858d432 tempest-SecurityGroupsTestAdminJSON-1302567777 tempest-SecurityGroupsTestAdminJSON-1302567777-project-admin] 10.222.0.16 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11740 microversion: 2.1 time: 8.088423 Oct 05 02:29:10.616734 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 305/601] 10.222.0.16 () {58 vars in 1191 bytes} [Wed Oct 5 02:29:02 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11740 bytes in 8091 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:29:10.621796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-943cfa5b-0f93-49c3-9a94-cdf68c9b9ea6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:10.622599 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-943cfa5b-0f93-49c3-9a94-cdf68c9b9ea6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:10.629753 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-943cfa5b-0f93-49c3-9a94-cdf68c9b9ea6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:10.630545 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-943cfa5b-0f93-49c3-9a94-cdf68c9b9ea6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:10.631187 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-943cfa5b-0f93-49c3-9a94-cdf68c9b9ea6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:10.632094 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-943cfa5b-0f93-49c3-9a94-cdf68c9b9ea6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:10.633205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-943cfa5b-0f93-49c3-9a94-cdf68c9b9ea6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:10.633848 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-943cfa5b-0f93-49c3-9a94-cdf68c9b9ea6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:10.658531 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dde52ac8-ba60-4869-9cc1-604e78180c15 tempest-FloatingIPDetailsTestJSON-65459292 tempest-FloatingIPDetailsTestJSON-65459292-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.199845 Oct 05 02:29:10.668317 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 297/602] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Oct 5 02:29:06 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:10.671975 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-47f7848a-7860-4af7-92ad-525bef98fbda tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:10.672794 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-47f7848a-7860-4af7-92ad-525bef98fbda tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 4125f403-0514-4a60-983f-51f76c7b99cb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:10.681230 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47f7848a-7860-4af7-92ad-525bef98fbda tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:10.681735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47f7848a-7860-4af7-92ad-525bef98fbda tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:10.682178 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47f7848a-7860-4af7-92ad-525bef98fbda tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:10.682897 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47f7848a-7860-4af7-92ad-525bef98fbda tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:10.683357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47f7848a-7860-4af7-92ad-525bef98fbda tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:10.683783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47f7848a-7860-4af7-92ad-525bef98fbda tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:11.037697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-943cfa5b-0f93-49c3-9a94-cdf68c9b9ea6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:11.052134 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-943cfa5b-0f93-49c3-9a94-cdf68c9b9ea6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9" status: 200 len: 1311 microversion: 2.1 time: 0.433932 Oct 05 02:29:11.052734 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 306/603] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:10 2022] GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 => generated 1311 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:11.065302 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e9a98297-4be7-414b-810b-3254e378e171 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:11.156889 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e9a98297-4be7-414b-810b-3254e378e171 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/9b4718d5-cab6-4213-97c3-6cb50e13eaa3" status: 204 len: 0 microversion: 2.1 time: 0.100935 Oct 05 02:29:11.158879 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 307/604] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 5 02:29:11 2022] DELETE /compute/v2.1/os-server-groups/9b4718d5-cab6-4213-97c3-6cb50e13eaa3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:29:11.168223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c465d074-54d5-4c21-9ed8-0373509d2583 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:11.169528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c465d074-54d5-4c21-9ed8-0373509d2583 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:11.178467 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c465d074-54d5-4c21-9ed8-0373509d2583 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:11.179538 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c465d074-54d5-4c21-9ed8-0373509d2583 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:11.180359 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c465d074-54d5-4c21-9ed8-0373509d2583 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:11.181261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c465d074-54d5-4c21-9ed8-0373509d2583 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:11.182222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c465d074-54d5-4c21-9ed8-0373509d2583 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:11.182808 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c465d074-54d5-4c21-9ed8-0373509d2583 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:11.226260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-47f7848a-7860-4af7-92ad-525bef98fbda tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d53045696469487a6be6640b07f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a87f178aedc4acbb4bd353bc09a7cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:11.236624 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-47f7848a-7860-4af7-92ad-525bef98fbda tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] 10.222.0.16 "GET /compute/v2.1/servers/4125f403-0514-4a60-983f-51f76c7b99cb" status: 200 len: 1319 microversion: 2.1 time: 0.570102 Oct 05 02:29:11.237316 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 298/605] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:10 2022] GET /compute/v2.1/servers/4125f403-0514-4a60-983f-51f76c7b99cb => generated 1319 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:11.244859 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-d28914c4-2ad9-4143-87cb-4eb2dca745f0 req-0595335d-10a9-499f-b836-7313482fdc9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94c1a311-92cb-4a6f-9d45-32af2f3ae6e9", "name": "network-vif-plugged", "status": "completed", "tag": "235b3397-5893-46bc-98c1-77706502791c"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:11.258723 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d28914c4-2ad9-4143-87cb-4eb2dca745f0 req-0595335d-10a9-499f-b836-7313482fdc9e service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:11.259097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d28914c4-2ad9-4143-87cb-4eb2dca745f0 req-0595335d-10a9-499f-b836-7313482fdc9e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:11.259519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d28914c4-2ad9-4143-87cb-4eb2dca745f0 req-0595335d-10a9-499f-b836-7313482fdc9e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:11.276174 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-d28914c4-2ad9-4143-87cb-4eb2dca745f0 req-0595335d-10a9-499f-b836-7313482fdc9e service nova] Creating event network-vif-plugged:235b3397-5893-46bc-98c1-77706502791c for instance 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 on n-h1-858272-3 Oct 05 02:29:11.284122 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-d28914c4-2ad9-4143-87cb-4eb2dca745f0 req-0595335d-10a9-499f-b836-7313482fdc9e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044403 Oct 05 02:29:11.285129 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 299/606] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:11.296233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-84c012bd-4de6-4690-8b89-65e7272e7042 tempest-SecurityGroupsTestAdminJSON-1156252035 tempest-SecurityGroupsTestAdminJSON-1156252035-project] Calling method '.version_select at 0x7fcce4203940>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:11.528917 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-c465d074-54d5-4c21-9ed8-0373509d2583 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lazy-loading 'services' on Instance uuid 079782c4-bca1-40e0-aa9f-b8afdb6a79af {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:29:11.574118 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c465d074-54d5-4c21-9ed8-0373509d2583 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af" status: 200 len: 2051 microversion: 2.25 time: 0.411583 Oct 05 02:29:11.575488 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 308/607] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:29:11 2022] GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af => generated 2051 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:29:11.581464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-89cf84ed-2f76-4828-b68b-e38f915fcc1e tempest-FloatingIPDetailsTestJSON-65459292 tempest-FloatingIPDetailsTestJSON-65459292-project] Action: 'create', calling method: .version_select at 0x7fcce43a2040>, body: {"pool": null} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:11.946492 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-84c012bd-4de6-4690-8b89-65e7272e7042 tempest-SecurityGroupsTestAdminJSON-1156252035 tempest-SecurityGroupsTestAdminJSON-1156252035-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.658062 Oct 05 02:29:11.958601 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 300/608] 10.222.0.16 () {58 vars in 1191 bytes} [Wed Oct 5 02:29:11 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:11.964652 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0e5bcb0c-0a53-4b24-9ab0-ef62449295fd tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:11.990313 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0e5bcb0c-0a53-4b24-9ab0-ef62449295fd tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.030265 Oct 05 02:29:11.997304 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 301/609] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 5 02:29:11 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:12.002971 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-67a4378f-2e81-48e5-98b8-4d0eba2dff84 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:12.003959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-67a4378f-2e81-48e5-98b8-4d0eba2dff84 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:12.012055 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-67a4378f-2e81-48e5-98b8-4d0eba2dff84 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:12.012849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-67a4378f-2e81-48e5-98b8-4d0eba2dff84 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:12.013555 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-67a4378f-2e81-48e5-98b8-4d0eba2dff84 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:12.014489 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-67a4378f-2e81-48e5-98b8-4d0eba2dff84 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:12.015154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-67a4378f-2e81-48e5-98b8-4d0eba2dff84 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:12.015790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-67a4378f-2e81-48e5-98b8-4d0eba2dff84 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:12.601887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-67a4378f-2e81-48e5-98b8-4d0eba2dff84 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lazy-loading 'services' on Instance uuid 079782c4-bca1-40e0-aa9f-b8afdb6a79af {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:29:12.645547 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-67a4378f-2e81-48e5-98b8-4d0eba2dff84 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af" status: 200 len: 2051 microversion: 2.25 time: 0.646880 Oct 05 02:29:12.653490 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 302/610] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:29:11 2022] GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af => generated 2051 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:29:12.701155 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bb440c94-b3bf-41e0-89fe-ad632773699c tempest-SecurityGroupsTestAdminJSON-1302567777 tempest-SecurityGroupsTestAdminJSON-1302567777-project-admin] Calling method '.version_select at 0x7fcce43259d0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:13.225209 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bb440c94-b3bf-41e0-89fe-ad632773699c tempest-SecurityGroupsTestAdminJSON-1302567777 tempest-SecurityGroupsTestAdminJSON-1302567777-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/df7959b9-e5cf-471e-b2a2-b83d33a0073a" status: 202 len: 0 microversion: 2.1 time: 0.566761 Oct 05 02:29:13.227937 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 303/611] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:29:12 2022] DELETE /compute/v2.1/os-security-groups/df7959b9-e5cf-471e-b2a2-b83d33a0073a => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:29:13.241104 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-82d80b2b-80a4-4157-8f0f-98b30a121c5a tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:13.329204 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-82d80b2b-80a4-4157-8f0f-98b30a121c5a tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/35ecfd2f-0920-4a3b-8c42-6426127123db" status: 204 len: 0 microversion: 2.1 time: 0.098997 Oct 05 02:29:13.337795 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 304/612] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 5 02:29:13 2022] DELETE /compute/v2.1/os-server-groups/35ecfd2f-0920-4a3b-8c42-6426127123db => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:29:13.346176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4e9e0678-075a-4a12-be74-2db069df8665 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:13.348343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4e9e0678-075a-4a12-be74-2db069df8665 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:13.358897 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e9e0678-075a-4a12-be74-2db069df8665 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:13.359717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e9e0678-075a-4a12-be74-2db069df8665 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:13.363011 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e9e0678-075a-4a12-be74-2db069df8665 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:13.364758 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e9e0678-075a-4a12-be74-2db069df8665 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:13.365463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e9e0678-075a-4a12-be74-2db069df8665 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:13.366362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e9e0678-075a-4a12-be74-2db069df8665 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:13.405603 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:13.690323 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4e9e0678-075a-4a12-be74-2db069df8665 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:13.702768 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4e9e0678-075a-4a12-be74-2db069df8665 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9" status: 200 len: 1495 microversion: 2.1 time: 0.362782 Oct 05 02:29:13.718068 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 305/613] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:13 2022] GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 => generated 1495 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:13.732097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c9fc4546-d1ab-4150-9c3c-1972b990ff6a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:13.732717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c9fc4546-d1ab-4150-9c3c-1972b990ff6a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 4125f403-0514-4a60-983f-51f76c7b99cb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:13.739513 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c9fc4546-d1ab-4150-9c3c-1972b990ff6a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:13.740257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c9fc4546-d1ab-4150-9c3c-1972b990ff6a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:13.740848 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c9fc4546-d1ab-4150-9c3c-1972b990ff6a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:13.742287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c9fc4546-d1ab-4150-9c3c-1972b990ff6a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:13.742914 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c9fc4546-d1ab-4150-9c3c-1972b990ff6a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:13.744427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c9fc4546-d1ab-4150-9c3c-1972b990ff6a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:14.058599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c9fc4546-d1ab-4150-9c3c-1972b990ff6a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d53045696469487a6be6640b07f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a87f178aedc4acbb4bd353bc09a7cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:14.069418 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c9fc4546-d1ab-4150-9c3c-1972b990ff6a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] 10.222.0.16 "GET /compute/v2.1/servers/4125f403-0514-4a60-983f-51f76c7b99cb" status: 200 len: 1319 microversion: 2.1 time: 0.349738 Oct 05 02:29:14.071230 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 306/614] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:13 2022] GET /compute/v2.1/servers/4125f403-0514-4a60-983f-51f76c7b99cb => generated 1319 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:14.076601 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-617e4432-59e4-4839-bd2e-7b0ee2e577aa req-74573c54-826b-4aa0-9433-29c35edf2315 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4125f403-0514-4a60-983f-51f76c7b99cb", "tag": "6b7ca93a-70aa-4737-9ec3-8b401a46b835"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:14.087212 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-617e4432-59e4-4839-bd2e-7b0ee2e577aa req-74573c54-826b-4aa0-9433-29c35edf2315 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:14.088079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-617e4432-59e4-4839-bd2e-7b0ee2e577aa req-74573c54-826b-4aa0-9433-29c35edf2315 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:14.088854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-617e4432-59e4-4839-bd2e-7b0ee2e577aa req-74573c54-826b-4aa0-9433-29c35edf2315 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:14.109236 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-617e4432-59e4-4839-bd2e-7b0ee2e577aa req-74573c54-826b-4aa0-9433-29c35edf2315 service nova] Creating event network-changed:6b7ca93a-70aa-4737-9ec3-8b401a46b835 for instance 4125f403-0514-4a60-983f-51f76c7b99cb on n-h1-858272-3 Oct 05 02:29:14.119242 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-617e4432-59e4-4839-bd2e-7b0ee2e577aa req-74573c54-826b-4aa0-9433-29c35edf2315 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046334 Oct 05 02:29:14.119899 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 307/615] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:14.137412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d13f46b2-085a-4261-88bd-df49fd5f3c39 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:14.141448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d13f46b2-085a-4261-88bd-df49fd5f3c39 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:14.142626 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d13f46b2-085a-4261-88bd-df49fd5f3c39 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:14.143767 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d13f46b2-085a-4261-88bd-df49fd5f3c39 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:14.144649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d13f46b2-085a-4261-88bd-df49fd5f3c39 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:14.145140 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d13f46b2-085a-4261-88bd-df49fd5f3c39 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:14.145767 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d13f46b2-085a-4261-88bd-df49fd5f3c39 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:14.178449 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d13f46b2-085a-4261-88bd-df49fd5f3c39 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.057176 Oct 05 02:29:14.179699 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 308/616] 10.222.0.16 () {60 vars in 1217 bytes} [Wed Oct 5 02:29:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:29:14.186717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-378160dd-c029-4cb7-bf90-00d943958540 tempest-SecurityGroupsTestAdminJSON-1302567777 tempest-SecurityGroupsTestAdminJSON-1302567777-project-admin] Calling method '.version_select at 0x7fcce42cc040>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:14.455239 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-89cf84ed-2f76-4828-b68b-e38f915fcc1e tempest-FloatingIPDetailsTestJSON-65459292 tempest-FloatingIPDetailsTestJSON-65459292-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.877608 Oct 05 02:29:14.456596 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 309/617] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Oct 5 02:29:11 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2880 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:14.461377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d14e1540-b00a-4b68-aeac-31411020e6a9 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:14.466756 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:14.479277 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d14e1540-b00a-4b68-aeac-31411020e6a9 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.021347 Oct 05 02:29:14.480368 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 310/618] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 5 02:29:14 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:14.546460 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-378160dd-c029-4cb7-bf90-00d943958540 tempest-SecurityGroupsTestAdminJSON-1302567777 tempest-SecurityGroupsTestAdminJSON-1302567777-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/0e1b5e36-8762-4fec-acf5-53a6fd85239f" status: 202 len: 0 microversion: 2.1 time: 0.365453 Oct 05 02:29:14.548940 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 309/619] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:29:14 2022] DELETE /compute/v2.1/os-security-groups/0e1b5e36-8762-4fec-acf5-53a6fd85239f => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:29:14.554781 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-63722388-2e35-42b4-9f91-e421aa66f0b7 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:14.555759 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-63722388-2e35-42b4-9f91-e421aa66f0b7 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:14.582763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63722388-2e35-42b4-9f91-e421aa66f0b7 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:14.585317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63722388-2e35-42b4-9f91-e421aa66f0b7 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:14.586134 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63722388-2e35-42b4-9f91-e421aa66f0b7 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:14.588052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63722388-2e35-42b4-9f91-e421aa66f0b7 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:14.590747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63722388-2e35-42b4-9f91-e421aa66f0b7 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:14.591200 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63722388-2e35-42b4-9f91-e421aa66f0b7 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:14.693844 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-63722388-2e35-42b4-9f91-e421aa66f0b7 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af/action" status: 202 len: 0 microversion: 2.25 time: 0.143314 Oct 05 02:29:14.694757 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 310/620] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 5 02:29:14 2022] POST /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:29:14.715117 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b93fd89c-357b-4def-ad73-a709582e2b9c tempest-FloatingIPDetailsTestJSON-65459292 tempest-FloatingIPDetailsTestJSON-65459292-project] Action: 'create', calling method: .version_select at 0x7fcce42d0160>, body: {"pool": null} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:14.950956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4ba566bf-447d-49f0-af46-838313e298ed tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:14.952147 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4ba566bf-447d-49f0-af46-838313e298ed tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:14.964649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ba566bf-447d-49f0-af46-838313e298ed tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:14.965469 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ba566bf-447d-49f0-af46-838313e298ed tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:14.966093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ba566bf-447d-49f0-af46-838313e298ed tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:14.967736 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ba566bf-447d-49f0-af46-838313e298ed tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:14.970499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ba566bf-447d-49f0-af46-838313e298ed tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:14.971204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ba566bf-447d-49f0-af46-838313e298ed tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:15.707055 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4ba566bf-447d-49f0-af46-838313e298ed tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9" status: 200 len: 1646 microversion: 2.1 time: 1.224941 Oct 05 02:29:15.712101 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 311/621] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:14 2022] GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 => generated 1646 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:15.728503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d66de443-333e-4448-9943-1092d72ebee7 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Action: 'create', calling method: .version_select at 0x7fcce4368d30>, body: {"server_group": {"name": "tempest-server-group-462559064", "policies": ["affinity"]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:15.776982 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-d66de443-333e-4448-9943-1092d72ebee7 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Getting quotas for project 92e7bf1499e6408da408d85bddc4d95b. Resources: {'server_groups'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:29:15.790459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-d66de443-333e-4448-9943-1092d72ebee7 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Getting quotas for user 000b799366da44838465be08b88fb27d and project 92e7bf1499e6408da408d85bddc4d95b. Resources: {'server_groups'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:29:15.927509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-d66de443-333e-4448-9943-1092d72ebee7 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Getting quotas for project 92e7bf1499e6408da408d85bddc4d95b. Resources: {'server_groups'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:29:15.940264 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-d66de443-333e-4448-9943-1092d72ebee7 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Getting quotas for user 000b799366da44838465be08b88fb27d and project 92e7bf1499e6408da408d85bddc4d95b. Resources: {'server_groups'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:29:15.949169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=30 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:15.976348 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d66de443-333e-4448-9943-1092d72ebee7 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.256946 Oct 05 02:29:15.980721 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 312/622] 10.222.0.16 () {60 vars in 1173 bytes} [Wed Oct 5 02:29:15 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:15.989734 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0d7ac614-e5cb-4821-a649-d286c1af8db2 tempest-SecurityGroupsTestAdminJSON-1156252035 tempest-SecurityGroupsTestAdminJSON-1156252035-project] Calling method '.version_select at 0x7fcce43a21f0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:16.767329 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0d7ac614-e5cb-4821-a649-d286c1af8db2 tempest-SecurityGroupsTestAdminJSON-1156252035 tempest-SecurityGroupsTestAdminJSON-1156252035-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/d6fcbf0f-a68b-462a-a35e-eae5dde2201d" status: 202 len: 0 microversion: 2.1 time: 0.784380 Oct 05 02:29:16.768553 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 313/623] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:29:15 2022] DELETE /compute/v2.1/os-security-groups/d6fcbf0f-a68b-462a-a35e-eae5dde2201d => generated 0 bytes in 787 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:29:16.774701 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-78370a26-8ba8-45a4-932d-51da46bb731e tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:16.775320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-78370a26-8ba8-45a4-932d-51da46bb731e tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:16.786306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-78370a26-8ba8-45a4-932d-51da46bb731e tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:16.788022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-78370a26-8ba8-45a4-932d-51da46bb731e tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:16.788646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-78370a26-8ba8-45a4-932d-51da46bb731e tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:16.789410 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-78370a26-8ba8-45a4-932d-51da46bb731e tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:16.789872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-78370a26-8ba8-45a4-932d-51da46bb731e tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:16.790296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-78370a26-8ba8-45a4-932d-51da46bb731e tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:17.561776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-78370a26-8ba8-45a4-932d-51da46bb731e tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lazy-loading 'services' on Instance uuid 079782c4-bca1-40e0-aa9f-b8afdb6a79af {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:29:17.596948 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-78370a26-8ba8-45a4-932d-51da46bb731e tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af" status: 200 len: 2036 microversion: 2.25 time: 0.827919 Oct 05 02:29:17.597848 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 314/624] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:29:16 2022] GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af => generated 2036 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:29:17.603470 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-eec89ee8-2250-4b24-816a-d9a7ec674afb tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:17.604094 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-eec89ee8-2250-4b24-816a-d9a7ec674afb tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 4125f403-0514-4a60-983f-51f76c7b99cb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:17.627562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eec89ee8-2250-4b24-816a-d9a7ec674afb tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:17.628074 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eec89ee8-2250-4b24-816a-d9a7ec674afb tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:17.628512 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eec89ee8-2250-4b24-816a-d9a7ec674afb tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:17.629259 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eec89ee8-2250-4b24-816a-d9a7ec674afb tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:17.629718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eec89ee8-2250-4b24-816a-d9a7ec674afb tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:17.630143 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eec89ee8-2250-4b24-816a-d9a7ec674afb tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:17.658063 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b93fd89c-357b-4def-ad73-a709582e2b9c tempest-FloatingIPDetailsTestJSON-65459292 tempest-FloatingIPDetailsTestJSON-65459292-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.961790 Oct 05 02:29:17.659212 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 311/625] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Oct 5 02:29:14 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:17.663741 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3bdda903-444b-4ea0-9a84-0fd6521030d2 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:17.664466 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3bdda903-444b-4ea0-9a84-0fd6521030d2 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:17.677357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3bdda903-444b-4ea0-9a84-0fd6521030d2 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:17.677768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3bdda903-444b-4ea0-9a84-0fd6521030d2 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:17.678205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3bdda903-444b-4ea0-9a84-0fd6521030d2 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:17.678954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3bdda903-444b-4ea0-9a84-0fd6521030d2 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:17.679406 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3bdda903-444b-4ea0-9a84-0fd6521030d2 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:17.679827 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3bdda903-444b-4ea0-9a84-0fd6521030d2 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:17.962426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-eec89ee8-2250-4b24-816a-d9a7ec674afb tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d53045696469487a6be6640b07f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a87f178aedc4acbb4bd353bc09a7cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:17.974899 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-eec89ee8-2250-4b24-816a-d9a7ec674afb tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] 10.222.0.16 "GET /compute/v2.1/servers/4125f403-0514-4a60-983f-51f76c7b99cb" status: 200 len: 1319 microversion: 2.1 time: 0.375438 Oct 05 02:29:17.976109 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 315/626] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:17 2022] GET /compute/v2.1/servers/4125f403-0514-4a60-983f-51f76c7b99cb => generated 1319 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:17.991314 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-93163f34-8db0-4e2a-aa6e-1df97a6c2d11 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:17.993831 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3bdda903-444b-4ea0-9a84-0fd6521030d2 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9" status: 200 len: 1646 microversion: 2.1 time: 0.333440 Oct 05 02:29:18.007430 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 312/627] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:17 2022] GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 => generated 1646 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:18.023858 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1809df1e-a37f-4fbc-98b8-c983487fd03f tempest-SecurityGroupsTestAdminJSON-1156252035 tempest-SecurityGroupsTestAdminJSON-1156252035-project] Calling method '.version_select at 0x7fcce42b4e50>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:18.051311 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-93163f34-8db0-4e2a-aa6e-1df97a6c2d11 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/a1a7cde3-ba65-4aff-9bb2-16b288d5102e" status: 204 len: 0 microversion: 2.1 time: 0.073460 Oct 05 02:29:18.079043 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 316/628] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 5 02:29:17 2022] DELETE /compute/v2.1/os-server-groups/a1a7cde3-ba65-4aff-9bb2-16b288d5102e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:29:18.084935 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f0e7679a-871e-4568-a11b-b709686ed89f tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858272-3", "block_migration": "auto"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:18.091267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f0e7679a-871e-4568-a11b-b709686ed89f tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:18.098984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0e7679a-871e-4568-a11b-b709686ed89f tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:18.099738 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0e7679a-871e-4568-a11b-b709686ed89f tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:18.100167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0e7679a-871e-4568-a11b-b709686ed89f tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:18.101068 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0e7679a-871e-4568-a11b-b709686ed89f tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:18.101673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0e7679a-871e-4568-a11b-b709686ed89f tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:18.102246 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0e7679a-871e-4568-a11b-b709686ed89f tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:18.196666 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-f0e7679a-871e-4568-a11b-b709686ed89f tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lazy-loading 'flavor' on Instance uuid 079782c4-bca1-40e0-aa9f-b8afdb6a79af {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:29:18.250854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f0e7679a-871e-4568-a11b-b709686ed89f tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Going to try to live migrate instance to n-h1-858272-3 {{(pid=122319) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 05 02:29:18.349372 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1809df1e-a37f-4fbc-98b8-c983487fd03f tempest-SecurityGroupsTestAdminJSON-1156252035 tempest-SecurityGroupsTestAdminJSON-1156252035-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/5712db20-da2d-4552-a78b-ce2582575699" status: 202 len: 0 microversion: 2.1 time: 0.340737 Oct 05 02:29:18.353860 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 313/629] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:29:18 2022] DELETE /compute/v2.1/os-security-groups/5712db20-da2d-4552-a78b-ce2582575699 => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:29:18.357928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ba14e378-26e3-40e2-bde5-da9915f2a5c8 tempest-FloatingIPDetailsTestJSON-65459292 tempest-FloatingIPDetailsTestJSON-65459292-project] Action: 'create', calling method: .version_select at 0x7fcce4272f70>, body: {"pool": null} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:20.973441 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ba14e378-26e3-40e2-bde5-da9915f2a5c8 tempest-FloatingIPDetailsTestJSON-65459292 tempest-FloatingIPDetailsTestJSON-65459292-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.621543 Oct 05 02:29:20.974563 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 314/630] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Oct 5 02:29:18 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:20.980450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e3ff9555-a6d1-4f41-8df6-c214488e36c9 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:20.991770 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e3ff9555-a6d1-4f41-8df6-c214488e36c9 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:20.994295 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e3ff9555-a6d1-4f41-8df6-c214488e36c9 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:20.994742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e3ff9555-a6d1-4f41-8df6-c214488e36c9 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:20.995516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e3ff9555-a6d1-4f41-8df6-c214488e36c9 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:20.995987 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e3ff9555-a6d1-4f41-8df6-c214488e36c9 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:21.001231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e3ff9555-a6d1-4f41-8df6-c214488e36c9 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:21.107474 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e3ff9555-a6d1-4f41-8df6-c214488e36c9 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.131761 Oct 05 02:29:21.121987 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 315/631] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Oct 5 02:29:20 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:21.129194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4bb839be-2f81-4c12-99d8-05e27b83c44a tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:21.142038 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4bb839be-2f81-4c12-99d8-05e27b83c44a tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.018636 Oct 05 02:29:21.150590 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 316/632] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 5 02:29:21 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:21.156698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-eaf89428-feca-4597-ae1f-79e790431e18 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:21.157720 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-eaf89428-feca-4597-ae1f-79e790431e18 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 4125f403-0514-4a60-983f-51f76c7b99cb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:21.169786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eaf89428-feca-4597-ae1f-79e790431e18 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:21.171380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eaf89428-feca-4597-ae1f-79e790431e18 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:21.173819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eaf89428-feca-4597-ae1f-79e790431e18 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:21.174880 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eaf89428-feca-4597-ae1f-79e790431e18 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:21.175521 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eaf89428-feca-4597-ae1f-79e790431e18 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:21.176221 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eaf89428-feca-4597-ae1f-79e790431e18 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:21.462639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-eaf89428-feca-4597-ae1f-79e790431e18 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d53045696469487a6be6640b07f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a87f178aedc4acbb4bd353bc09a7cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:21.465650 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f0e7679a-871e-4568-a11b-b709686ed89f tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af/action" status: 202 len: 0 microversion: 2.25 time: 3.385168 Oct 05 02:29:21.467195 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 317/633] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 5 02:29:18 2022] POST /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af/action => generated 0 bytes in 3387 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:29:21.480595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bfbd58b8-84ad-4a10-8478-7cefc32b7571 tempest-FloatingIPDetailsTestJSON-65459292 tempest-FloatingIPDetailsTestJSON-65459292-project] Calling method '.version_select at 0x7fcce43a2af0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:21.495876 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-eaf89428-feca-4597-ae1f-79e790431e18 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] 10.222.0.16 "GET /compute/v2.1/servers/4125f403-0514-4a60-983f-51f76c7b99cb" status: 200 len: 1319 microversion: 2.1 time: 0.343724 Oct 05 02:29:21.518036 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 317/634] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:21 2022] GET /compute/v2.1/servers/4125f403-0514-4a60-983f-51f76c7b99cb => generated 1319 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:21.535788 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-0f2bd976-9641-40da-880b-28a0ce37f0a1 req-2ef5c9d0-b3ae-43a6-9f08-06cbb56974c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4125f403-0514-4a60-983f-51f76c7b99cb", "name": "network-vif-plugged", "status": "completed", "tag": "6b7ca93a-70aa-4737-9ec3-8b401a46b835"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:21.557853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-0f2bd976-9641-40da-880b-28a0ce37f0a1 req-2ef5c9d0-b3ae-43a6-9f08-06cbb56974c3 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:21.559368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-0f2bd976-9641-40da-880b-28a0ce37f0a1 req-2ef5c9d0-b3ae-43a6-9f08-06cbb56974c3 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:21.560033 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-0f2bd976-9641-40da-880b-28a0ce37f0a1 req-2ef5c9d0-b3ae-43a6-9f08-06cbb56974c3 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:21.586392 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-0f2bd976-9641-40da-880b-28a0ce37f0a1 req-2ef5c9d0-b3ae-43a6-9f08-06cbb56974c3 service nova] Creating event network-vif-plugged:6b7ca93a-70aa-4737-9ec3-8b401a46b835 for instance 4125f403-0514-4a60-983f-51f76c7b99cb on n-h1-858272-3 Oct 05 02:29:21.591556 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-0f2bd976-9641-40da-880b-28a0ce37f0a1 req-2ef5c9d0-b3ae-43a6-9f08-06cbb56974c3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069638 Oct 05 02:29:21.592317 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 318/635] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:21.614874 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-60bff3d7-9078-40d5-87ad-5419fe60b500 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858272-3", "block_migration": true, "disk_over_commit": false}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:21.620305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-60bff3d7-9078-40d5-87ad-5419fe60b500 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:21.631020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60bff3d7-9078-40d5-87ad-5419fe60b500 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:21.631453 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60bff3d7-9078-40d5-87ad-5419fe60b500 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:21.631894 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60bff3d7-9078-40d5-87ad-5419fe60b500 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:21.634081 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60bff3d7-9078-40d5-87ad-5419fe60b500 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:21.634081 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60bff3d7-9078-40d5-87ad-5419fe60b500 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:21.634081 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60bff3d7-9078-40d5-87ad-5419fe60b500 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:21.731581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-60bff3d7-9078-40d5-87ad-5419fe60b500 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lazy-loading 'flavor' on Instance uuid 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:29:21.767526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-60bff3d7-9078-40d5-87ad-5419fe60b500 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] Going to try to live migrate instance to n-h2-858272-3 {{(pid=122320) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 05 02:29:21.783727 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bfbd58b8-84ad-4a10-8478-7cefc32b7571 tempest-FloatingIPDetailsTestJSON-65459292 tempest-FloatingIPDetailsTestJSON-65459292-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/1ce23fed-c922-4862-bde3-727b623d720f" status: 200 len: 141 microversion: 2.1 time: 0.314995 Oct 05 02:29:21.792379 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 318/636] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 5 02:29:21 2022] GET /compute/v2.1/os-floating-ips/1ce23fed-c922-4862-bde3-727b623d720f => generated 141 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:21.801100 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8e74a223-f8e1-4576-a3fa-568f59fe46fc tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Action: 'create', calling method: .version_select at 0x7fcce43515e0>, body: {"server_group": {"name": "tempest-server-group-335567376", "policies": ["anti-affinity"]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:21.863750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-8e74a223-f8e1-4576-a3fa-568f59fe46fc tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Getting quotas for project 92e7bf1499e6408da408d85bddc4d95b. Resources: {'server_groups'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:29:21.877986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-8e74a223-f8e1-4576-a3fa-568f59fe46fc tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Getting quotas for user 000b799366da44838465be08b88fb27d and project 92e7bf1499e6408da408d85bddc4d95b. Resources: {'server_groups'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:29:21.989721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-8e74a223-f8e1-4576-a3fa-568f59fe46fc tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Getting quotas for project 92e7bf1499e6408da408d85bddc4d95b. Resources: {'server_groups'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:29:22.003447 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-8e74a223-f8e1-4576-a3fa-568f59fe46fc tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Getting quotas for user 000b799366da44838465be08b88fb27d and project 92e7bf1499e6408da408d85bddc4d95b. Resources: {'server_groups'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:29:22.038531 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8e74a223-f8e1-4576-a3fa-568f59fe46fc tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.244947 Oct 05 02:29:22.046565 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 319/637] 10.222.0.16 () {60 vars in 1173 bytes} [Wed Oct 5 02:29:21 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:22.051857 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-af8d46ed-74be-4ef8-96e2-d234cb5ca7c4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:22.052494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-af8d46ed-74be-4ef8-96e2-d234cb5ca7c4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:22.082267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af8d46ed-74be-4ef8-96e2-d234cb5ca7c4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:22.083061 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af8d46ed-74be-4ef8-96e2-d234cb5ca7c4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:22.083654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af8d46ed-74be-4ef8-96e2-d234cb5ca7c4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:22.084509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af8d46ed-74be-4ef8-96e2-d234cb5ca7c4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:22.085139 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af8d46ed-74be-4ef8-96e2-d234cb5ca7c4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:22.085786 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af8d46ed-74be-4ef8-96e2-d234cb5ca7c4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:22.346350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-af8d46ed-74be-4ef8-96e2-d234cb5ca7c4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:22.363119 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-af8d46ed-74be-4ef8-96e2-d234cb5ca7c4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:22.367218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-af8d46ed-74be-4ef8-96e2-d234cb5ca7c4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:22.369397 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-af8d46ed-74be-4ef8-96e2-d234cb5ca7c4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af" status: 200 len: 1568 microversion: 2.25 time: 0.321202 Oct 05 02:29:22.370367 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 320/638] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:29:22 2022] GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af => generated 1568 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:29:22.375280 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-842672bb-13a2-4831-a3a5-28ed7faba20e tempest-FloatingIPDetailsTestJSON-65459292 tempest-FloatingIPDetailsTestJSON-65459292-project] Calling method '.version_select at 0x7fcce4285430>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:23.737808 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-842672bb-13a2-4831-a3a5-28ed7faba20e tempest-FloatingIPDetailsTestJSON-65459292 tempest-FloatingIPDetailsTestJSON-65459292-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/1ce23fed-c922-4862-bde3-727b623d720f" status: 202 len: 0 microversion: 2.1 time: 1.365650 Oct 05 02:29:23.740005 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 321/639] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 5 02:29:22 2022] DELETE /compute/v2.1/os-floating-ips/1ce23fed-c922-4862-bde3-727b623d720f => generated 0 bytes in 1369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:29:23.744873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7adaa7cf-1b1c-414e-8782-704c61dfc5b7 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:23.807215 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7adaa7cf-1b1c-414e-8782-704c61dfc5b7 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/c6727853-f203-4ef5-8449-7310401f6103" status: 204 len: 0 microversion: 2.1 time: 0.066064 Oct 05 02:29:23.810862 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 322/640] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 5 02:29:23 2022] DELETE /compute/v2.1/os-server-groups/c6727853-f203-4ef5-8449-7310401f6103 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:29:23.813248 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f9db84ec-cb0b-47c8-ba22-0bf8b3efe0b2 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:23.815969 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f9db84ec-cb0b-47c8-ba22-0bf8b3efe0b2 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 4125f403-0514-4a60-983f-51f76c7b99cb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:23.832058 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9db84ec-cb0b-47c8-ba22-0bf8b3efe0b2 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:23.832579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9db84ec-cb0b-47c8-ba22-0bf8b3efe0b2 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:23.833049 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9db84ec-cb0b-47c8-ba22-0bf8b3efe0b2 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:23.837266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9db84ec-cb0b-47c8-ba22-0bf8b3efe0b2 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:23.838065 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9db84ec-cb0b-47c8-ba22-0bf8b3efe0b2 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:23.838661 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9db84ec-cb0b-47c8-ba22-0bf8b3efe0b2 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:24.230491 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-60bff3d7-9078-40d5-87ad-5419fe60b500 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9/action" status: 202 len: 0 microversion: 2.1 time: 2.620506 Oct 05 02:29:24.232539 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 319/641] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:29:21 2022] POST /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9/action => generated 0 bytes in 2640 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:29:24.243982 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f9db84ec-cb0b-47c8-ba22-0bf8b3efe0b2 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d53045696469487a6be6640b07f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a87f178aedc4acbb4bd353bc09a7cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:24.263697 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f9db84ec-cb0b-47c8-ba22-0bf8b3efe0b2 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] 10.222.0.16 "GET /compute/v2.1/servers/4125f403-0514-4a60-983f-51f76c7b99cb" status: 200 len: 1469 microversion: 2.1 time: 0.454304 Oct 05 02:29:24.267504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c8d6e2ec-1b32-4465-a9bd-6acb05ce9466 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:24.270067 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c8d6e2ec-1b32-4465-a9bd-6acb05ce9466 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:24.271915 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 323/642] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:23 2022] GET /compute/v2.1/servers/4125f403-0514-4a60-983f-51f76c7b99cb => generated 1469 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:24.304858 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8d6e2ec-1b32-4465-a9bd-6acb05ce9466 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:24.307545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8d6e2ec-1b32-4465-a9bd-6acb05ce9466 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:24.309442 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8d6e2ec-1b32-4465-a9bd-6acb05ce9466 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:24.311942 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8d6e2ec-1b32-4465-a9bd-6acb05ce9466 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:24.316202 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8d6e2ec-1b32-4465-a9bd-6acb05ce9466 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:24.318669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8d6e2ec-1b32-4465-a9bd-6acb05ce9466 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:24.495178 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d8a98247-e0ab-4f17-893d-fe859f5bc0b4 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1141778521", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:24.558872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-d8a98247-e0ab-4f17-893d-fe859f5bc0b4 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] validate_networks() for None {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:29:25.112383 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c8d6e2ec-1b32-4465-a9bd-6acb05ce9466 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:25.145662 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c8d6e2ec-1b32-4465-a9bd-6acb05ce9466 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:25.153677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c8d6e2ec-1b32-4465-a9bd-6acb05ce9466 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:25.156343 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c8d6e2ec-1b32-4465-a9bd-6acb05ce9466 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af" status: 200 len: 1568 microversion: 2.25 time: 0.922065 Oct 05 02:29:25.158023 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 320/643] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:29:24 2022] GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af => generated 1568 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:29:25.175789 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8946eb7e-e63f-4f87-8255-65bbae0bfd37 tempest-FloatingIPDetailsTestJSON-65459292 tempest-FloatingIPDetailsTestJSON-65459292-project] Calling method '.version_select at 0x7fcce418a9d0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:25.770484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-d8a98247-e0ab-4f17-893d-fe859f5bc0b4 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:29:25.771532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-d8a98247-e0ab-4f17-893d-fe859f5bc0b4 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:29:25.772074 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-d8a98247-e0ab-4f17-893d-fe859f5bc0b4 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:29:25.772750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-d8a98247-e0ab-4f17-893d-fe859f5bc0b4 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:29:25.773740 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-d8a98247-e0ab-4f17-893d-fe859f5bc0b4 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:29:25.784552 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8a98247-e0ab-4f17-893d-fe859f5bc0b4 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:25.785491 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8a98247-e0ab-4f17-893d-fe859f5bc0b4 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:25.786105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8a98247-e0ab-4f17-893d-fe859f5bc0b4 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:25.786930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8a98247-e0ab-4f17-893d-fe859f5bc0b4 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:25.787459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8a98247-e0ab-4f17-893d-fe859f5bc0b4 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:25.787954 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8a98247-e0ab-4f17-893d-fe859f5bc0b4 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:25.799683 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8946eb7e-e63f-4f87-8255-65bbae0bfd37 tempest-FloatingIPDetailsTestJSON-65459292 tempest-FloatingIPDetailsTestJSON-65459292-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.640255 Oct 05 02:29:25.801270 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 321/644] 10.222.0.16 () {58 vars in 1164 bytes} [Wed Oct 5 02:29:25 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:29:25.819475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d861e2ac-46e1-4344-aa57-0f440e7900ae tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:25.824832 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-d8a98247-e0ab-4f17-893d-fe859f5bc0b4 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Getting quotas for project 449ddfb8f22f49a7a294de5f5ef08531. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:29:25.832207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-d8a98247-e0ab-4f17-893d-fe859f5bc0b4 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Getting quotas for user 005a727f85c54471b45488b0f1d394e1 and project 449ddfb8f22f49a7a294de5f5ef08531. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:29:25.832861 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d861e2ac-46e1-4344-aa57-0f440e7900ae tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.029944 Oct 05 02:29:25.834367 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 322/645] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 5 02:29:25 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:25.845541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5308ac90-bc53-426d-8faf-fc17b9394c34 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:25.849703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5308ac90-bc53-426d-8faf-fc17b9394c34 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:25.874080 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5308ac90-bc53-426d-8faf-fc17b9394c34 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:25.874893 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5308ac90-bc53-426d-8faf-fc17b9394c34 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:25.875627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5308ac90-bc53-426d-8faf-fc17b9394c34 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:25.876628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5308ac90-bc53-426d-8faf-fc17b9394c34 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:25.877459 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5308ac90-bc53-426d-8faf-fc17b9394c34 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:25.878041 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5308ac90-bc53-426d-8faf-fc17b9394c34 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:25.879963 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d8a98247-e0ab-4f17-893d-fe859f5bc0b4 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:29:25.891305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d8a98247-e0ab-4f17-893d-fe859f5bc0b4 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] [instance: 4be4b86a-17b7-49a6-b630-1972adc25deb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:29:25.966549 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:DELETE=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:25.996354 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d8a98247-e0ab-4f17-893d-fe859f5bc0b4 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.722164 Oct 05 02:29:25.997643 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 324/646] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:29:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:29:26.013757 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-808fa78f-aeef-4501-bf78-6162adf4663d tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:26.014667 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-808fa78f-aeef-4501-bf78-6162adf4663d tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] [instance: 4125f403-0514-4a60-983f-51f76c7b99cb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:26.024577 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-808fa78f-aeef-4501-bf78-6162adf4663d tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:26.025509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-808fa78f-aeef-4501-bf78-6162adf4663d tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:26.026164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-808fa78f-aeef-4501-bf78-6162adf4663d tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:26.027322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-808fa78f-aeef-4501-bf78-6162adf4663d tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:26.028030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-808fa78f-aeef-4501-bf78-6162adf4663d tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:26.028698 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-808fa78f-aeef-4501-bf78-6162adf4663d tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:26.088346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-808fa78f-aeef-4501-bf78-6162adf4663d tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Lazy-loading 'flavor' on Instance uuid 4125f403-0514-4a60-983f-51f76c7b99cb {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:29:26.172524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5308ac90-bc53-426d-8faf-fc17b9394c34 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:26.194446 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5308ac90-bc53-426d-8faf-fc17b9394c34 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9" status: 200 len: 1505 microversion: 2.1 time: 0.358725 Oct 05 02:29:26.204293 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 323/647] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:25 2022] GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 => generated 1505 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:26.205692 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:26.231882 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-f332adf1-568d-476e-9ea9-b2fdfad91133 req-c82700ec-090b-4729-bbd5-3d066268a206 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "079782c4-bca1-40e0-aa9f-b8afdb6a79af", "name": "network-vif-unplugged", "status": "completed", "tag": "0a2b9672-d33e-4824-9498-5a3e1b415686"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:26.248193 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f332adf1-568d-476e-9ea9-b2fdfad91133 req-c82700ec-090b-4729-bbd5-3d066268a206 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:26.248601 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f332adf1-568d-476e-9ea9-b2fdfad91133 req-c82700ec-090b-4729-bbd5-3d066268a206 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:26.249243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f332adf1-568d-476e-9ea9-b2fdfad91133 req-c82700ec-090b-4729-bbd5-3d066268a206 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:26.267858 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-f332adf1-568d-476e-9ea9-b2fdfad91133 req-c82700ec-090b-4729-bbd5-3d066268a206 service nova] Creating event network-vif-unplugged:0a2b9672-d33e-4824-9498-5a3e1b415686 for instance 079782c4-bca1-40e0-aa9f-b8afdb6a79af on n-h2-858272-3 Oct 05 02:29:26.268798 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-808fa78f-aeef-4501-bf78-6162adf4663d tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/4125f403-0514-4a60-983f-51f76c7b99cb/action" status: 202 len: 0 microversion: 2.1 time: 0.268944 Oct 05 02:29:26.269837 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 325/648] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:29:25 2022] POST /compute/v2.1/servers/4125f403-0514-4a60-983f-51f76c7b99cb/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:29:26.293364 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-f332adf1-568d-476e-9ea9-b2fdfad91133 req-c82700ec-090b-4729-bbd5-3d066268a206 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086572 Oct 05 02:29:26.294503 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 324/649] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:26.296414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-68a0062d-4033-4154-ae8b-bbc289e8a4a9 tempest-FloatingIPDetailsTestJSON-65459292 tempest-FloatingIPDetailsTestJSON-65459292-project] Calling method '.version_select at 0x7fcce428ec10>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:26.302735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7fe94a74-cec2-471d-a37a-4cf3cdeba7b6 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-108479551", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "05a45bee-b3a3-494d-b03c-fe3cf160a24b"}]}, "os:scheduler_hints": {"group": "67851fb0-7c17-46d0-b291-609cb196ff0c"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:26.395840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-7fe94a74-cec2-471d-a37a-4cf3cdeba7b6 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] validate_networks() for [('05a45bee-b3a3-494d-b03c-fe3cf160a24b', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:29:26.915017 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-68a0062d-4033-4154-ae8b-bbc289e8a4a9 tempest-FloatingIPDetailsTestJSON-65459292 tempest-FloatingIPDetailsTestJSON-65459292-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.643384 Oct 05 02:29:26.926318 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 326/650] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Oct 5 02:29:26 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:26.937560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d003da5b-08e7-49d6-b801-52338319b3c9 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:26.939974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d003da5b-08e7-49d6-b801-52338319b3c9 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] [instance: 4be4b86a-17b7-49a6-b630-1972adc25deb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:26.958922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d003da5b-08e7-49d6-b801-52338319b3c9 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:26.962995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d003da5b-08e7-49d6-b801-52338319b3c9 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:26.965406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d003da5b-08e7-49d6-b801-52338319b3c9 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:26.966665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d003da5b-08e7-49d6-b801-52338319b3c9 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:26.969496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d003da5b-08e7-49d6-b801-52338319b3c9 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:26.970328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d003da5b-08e7-49d6-b801-52338319b3c9 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:27.132581 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d003da5b-08e7-49d6-b801-52338319b3c9 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005a727f85c54471b45488b0f1d394e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449ddfb8f22f49a7a294de5f5ef08531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:27.142384 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d003da5b-08e7-49d6-b801-52338319b3c9 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] 10.222.0.16 "GET /compute/v2.1/servers/4be4b86a-17b7-49a6-b630-1972adc25deb" status: 200 len: 1219 microversion: 2.1 time: 0.214073 Oct 05 02:29:27.143449 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 327/651] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:26 2022] GET /compute/v2.1/servers/4be4b86a-17b7-49a6-b630-1972adc25deb => generated 1219 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:27.148323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6cd707c2-b7d2-44c9-a624-7c3c1d188809 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:27.149162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6cd707c2-b7d2-44c9-a624-7c3c1d188809 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:27.159083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6cd707c2-b7d2-44c9-a624-7c3c1d188809 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:27.160300 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6cd707c2-b7d2-44c9-a624-7c3c1d188809 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:27.160738 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6cd707c2-b7d2-44c9-a624-7c3c1d188809 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:27.161935 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6cd707c2-b7d2-44c9-a624-7c3c1d188809 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:27.162579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6cd707c2-b7d2-44c9-a624-7c3c1d188809 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:27.163004 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6cd707c2-b7d2-44c9-a624-7c3c1d188809 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:27.510158 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-7fe94a74-cec2-471d-a37a-4cf3cdeba7b6 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:29:27.511108 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-7fe94a74-cec2-471d-a37a-4cf3cdeba7b6 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:29:27.511450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-7fe94a74-cec2-471d-a37a-4cf3cdeba7b6 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:29:27.513763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-7fe94a74-cec2-471d-a37a-4cf3cdeba7b6 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:29:27.514218 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-7fe94a74-cec2-471d-a37a-4cf3cdeba7b6 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:29:27.530189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6cd707c2-b7d2-44c9-a624-7c3c1d188809 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:27.530453 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7fe94a74-cec2-471d-a37a-4cf3cdeba7b6 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:27.531296 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7fe94a74-cec2-471d-a37a-4cf3cdeba7b6 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:27.531883 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7fe94a74-cec2-471d-a37a-4cf3cdeba7b6 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:27.533338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7fe94a74-cec2-471d-a37a-4cf3cdeba7b6 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:27.534151 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7fe94a74-cec2-471d-a37a-4cf3cdeba7b6 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:27.534797 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7fe94a74-cec2-471d-a37a-4cf3cdeba7b6 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:27.542812 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6cd707c2-b7d2-44c9-a624-7c3c1d188809 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:27.545594 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6cd707c2-b7d2-44c9-a624-7c3c1d188809 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:27.547146 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6cd707c2-b7d2-44c9-a624-7c3c1d188809 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af" status: 200 len: 1568 microversion: 2.25 time: 0.402496 Oct 05 02:29:27.556938 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 328/652] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:29:27 2022] GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af => generated 1568 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:29:27.556938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ed8c0b97-60e7-4952-8def-1fb53c42f28a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:27.557457 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ed8c0b97-60e7-4952-8def-1fb53c42f28a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 4125f403-0514-4a60-983f-51f76c7b99cb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:27.565756 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed8c0b97-60e7-4952-8def-1fb53c42f28a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:27.566880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed8c0b97-60e7-4952-8def-1fb53c42f28a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:27.567538 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed8c0b97-60e7-4952-8def-1fb53c42f28a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:27.568608 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed8c0b97-60e7-4952-8def-1fb53c42f28a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:27.569309 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed8c0b97-60e7-4952-8def-1fb53c42f28a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:27.569947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed8c0b97-60e7-4952-8def-1fb53c42f28a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:27.580816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-7fe94a74-cec2-471d-a37a-4cf3cdeba7b6 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Getting quotas for project 92e7bf1499e6408da408d85bddc4d95b. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:29:27.589777 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-7fe94a74-cec2-471d-a37a-4cf3cdeba7b6 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Getting quotas for user 000b799366da44838465be08b88fb27d and project 92e7bf1499e6408da408d85bddc4d95b. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:29:27.595659 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:27.614954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7fe94a74-cec2-471d-a37a-4cf3cdeba7b6 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:29:27.619319 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7fe94a74-cec2-471d-a37a-4cf3cdeba7b6 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] [instance: 2e297761-81b8-4084-938d-7e097b32cd44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:29:27.661808 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-7fe94a74-cec2-471d-a37a-4cf3cdeba7b6 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122320) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 05 02:29:27.685342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-7fe94a74-cec2-471d-a37a-4cf3cdeba7b6 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Getting quotas for project 92e7bf1499e6408da408d85bddc4d95b. Resources: {'server_group_members'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:29:27.693267 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-7fe94a74-cec2-471d-a37a-4cf3cdeba7b6 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Getting quotas for user 000b799366da44838465be08b88fb27d and project 92e7bf1499e6408da408d85bddc4d95b. Resources: {'server_group_members'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:29:27.756243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-7fe94a74-cec2-471d-a37a-4cf3cdeba7b6 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Getting quotas for project 92e7bf1499e6408da408d85bddc4d95b. Resources: {'server_group_members'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:29:27.762146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-7fe94a74-cec2-471d-a37a-4cf3cdeba7b6 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Getting quotas for user 000b799366da44838465be08b88fb27d and project 92e7bf1499e6408da408d85bddc4d95b. Resources: {'server_group_members'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:29:27.803044 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7fe94a74-cec2-471d-a37a-4cf3cdeba7b6 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.506341 Oct 05 02:29:27.803902 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 325/653] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:29:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:29:27.810322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-030b2a4a-a728-4818-a10d-f44bbe019958 tempest-FloatingIPDetailsTestJSON-65459292 tempest-FloatingIPDetailsTestJSON-65459292-project] Calling method '.version_select at 0x7fcce4182280>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:27.873799 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ed8c0b97-60e7-4952-8def-1fb53c42f28a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d53045696469487a6be6640b07f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a87f178aedc4acbb4bd353bc09a7cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:27.882946 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ed8c0b97-60e7-4952-8def-1fb53c42f28a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] 10.222.0.16 "GET /compute/v2.1/servers/4125f403-0514-4a60-983f-51f76c7b99cb" status: 200 len: 1460 microversion: 2.1 time: 0.333138 Oct 05 02:29:27.897265 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 329/654] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:27 2022] GET /compute/v2.1/servers/4125f403-0514-4a60-983f-51f76c7b99cb => generated 1460 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:27.925958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-74daf0d3-28a1-4832-9e98-0489762020db tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:27.926603 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-74daf0d3-28a1-4832-9e98-0489762020db tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:27.935139 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74daf0d3-28a1-4832-9e98-0489762020db tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:27.935807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74daf0d3-28a1-4832-9e98-0489762020db tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:27.936255 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74daf0d3-28a1-4832-9e98-0489762020db tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:27.937349 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74daf0d3-28a1-4832-9e98-0489762020db tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:27.938919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74daf0d3-28a1-4832-9e98-0489762020db tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:27.939620 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74daf0d3-28a1-4832-9e98-0489762020db tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:28.849424 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-74daf0d3-28a1-4832-9e98-0489762020db tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:28.865346 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-74daf0d3-28a1-4832-9e98-0489762020db tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9" status: 200 len: 1505 microversion: 2.1 time: 0.962106 Oct 05 02:29:28.895305 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 330/655] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:27 2022] GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 => generated 1505 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:28.908670 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1abc7cc0-799c-4c2d-b9ed-6e0dbe20c892 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:28.909599 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1abc7cc0-799c-4c2d-b9ed-6e0dbe20c892 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] [instance: 2e297761-81b8-4084-938d-7e097b32cd44] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:28.921986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1abc7cc0-799c-4c2d-b9ed-6e0dbe20c892 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:28.922679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1abc7cc0-799c-4c2d-b9ed-6e0dbe20c892 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:28.925105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1abc7cc0-799c-4c2d-b9ed-6e0dbe20c892 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:28.925723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1abc7cc0-799c-4c2d-b9ed-6e0dbe20c892 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:28.926429 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1abc7cc0-799c-4c2d-b9ed-6e0dbe20c892 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:28.927525 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1abc7cc0-799c-4c2d-b9ed-6e0dbe20c892 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:29.079369 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1abc7cc0-799c-4c2d-b9ed-6e0dbe20c892 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000b799366da44838465be08b88fb27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e7bf1499e6408da408d85bddc4d95b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:29.091782 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1abc7cc0-799c-4c2d-b9ed-6e0dbe20c892 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44" status: 200 len: 1264 microversion: 2.1 time: 0.194578 Oct 05 02:29:29.093913 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 331/656] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:28 2022] GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44 => generated 1264 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:29.116635 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c3c66262-9ec6-40e7-99dc-26522ffbc687 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:29.116635 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c3c66262-9ec6-40e7-99dc-26522ffbc687 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] [instance: 4125f403-0514-4a60-983f-51f76c7b99cb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:29.123536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3c66262-9ec6-40e7-99dc-26522ffbc687 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:29.124028 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3c66262-9ec6-40e7-99dc-26522ffbc687 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:29.124465 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3c66262-9ec6-40e7-99dc-26522ffbc687 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:29.125194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3c66262-9ec6-40e7-99dc-26522ffbc687 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:29.125650 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3c66262-9ec6-40e7-99dc-26522ffbc687 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:29.126142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3c66262-9ec6-40e7-99dc-26522ffbc687 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:29.847222 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c3c66262-9ec6-40e7-99dc-26522ffbc687 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4125f403-0514-4a60-983f-51f76c7b99cb" status: 200 len: 1611 microversion: 2.1 time: 0.751160 Oct 05 02:29:29.849046 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 332/657] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:29 2022] GET /compute/v2.1/servers/4125f403-0514-4a60-983f-51f76c7b99cb => generated 1611 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:29.867081 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1cc4c690-eb16-4e57-9507-f1d57e7c817e tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:29.868866 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1cc4c690-eb16-4e57-9507-f1d57e7c817e tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] [instance: 4be4b86a-17b7-49a6-b630-1972adc25deb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:29.877105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1cc4c690-eb16-4e57-9507-f1d57e7c817e tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:29.877607 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1cc4c690-eb16-4e57-9507-f1d57e7c817e tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:29.878742 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1cc4c690-eb16-4e57-9507-f1d57e7c817e tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:29.879462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1cc4c690-eb16-4e57-9507-f1d57e7c817e tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:29.879955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1cc4c690-eb16-4e57-9507-f1d57e7c817e tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:29.880384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1cc4c690-eb16-4e57-9507-f1d57e7c817e tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:30.020771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1cc4c690-eb16-4e57-9507-f1d57e7c817e tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005a727f85c54471b45488b0f1d394e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449ddfb8f22f49a7a294de5f5ef08531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:30.033471 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1cc4c690-eb16-4e57-9507-f1d57e7c817e tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] 10.222.0.16 "GET /compute/v2.1/servers/4be4b86a-17b7-49a6-b630-1972adc25deb" status: 200 len: 1281 microversion: 2.1 time: 0.182961 Oct 05 02:29:30.034142 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 333/658] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:29 2022] GET /compute/v2.1/servers/4be4b86a-17b7-49a6-b630-1972adc25deb => generated 1281 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:30.039540 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-772904f2-0357-47aa-9ef4-8ec8e800b174 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:30.040468 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-772904f2-0357-47aa-9ef4-8ec8e800b174 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:30.046813 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-772904f2-0357-47aa-9ef4-8ec8e800b174 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:30.047483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-772904f2-0357-47aa-9ef4-8ec8e800b174 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:30.048193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-772904f2-0357-47aa-9ef4-8ec8e800b174 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:30.049267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-772904f2-0357-47aa-9ef4-8ec8e800b174 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:30.050210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-772904f2-0357-47aa-9ef4-8ec8e800b174 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:30.050826 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-772904f2-0357-47aa-9ef4-8ec8e800b174 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:30.433952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-772904f2-0357-47aa-9ef4-8ec8e800b174 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:30.443162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-772904f2-0357-47aa-9ef4-8ec8e800b174 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:30.443813 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-030b2a4a-a728-4818-a10d-f44bbe019958 tempest-FloatingIPDetailsTestJSON-65459292 tempest-FloatingIPDetailsTestJSON-65459292-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/2cef6c8f-741f-4fa2-ad1c-75e7878db9dc" status: 202 len: 0 microversion: 2.1 time: 2.637965 Oct 05 02:29:30.445070 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 326/659] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 5 02:29:27 2022] DELETE /compute/v2.1/os-floating-ips/2cef6c8f-741f-4fa2-ad1c-75e7878db9dc => generated 0 bytes in 2641 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:29:30.451472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-ea3cfea8-83ac-4b32-be5c-8d38395d5414 req-9932ebeb-0352-4770-b587-681fe67ee6b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "079782c4-bca1-40e0-aa9f-b8afdb6a79af", "tag": "0a2b9672-d33e-4824-9498-5a3e1b415686"}, {"server_uuid": "94c1a311-92cb-4a6f-9d45-32af2f3ae6e9", "name": "network-vif-unplugged", "status": "completed", "tag": "235b3397-5893-46bc-98c1-77706502791c"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:30.461121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-772904f2-0357-47aa-9ef4-8ec8e800b174 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:30.462333 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-772904f2-0357-47aa-9ef4-8ec8e800b174 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af" status: 200 len: 1568 microversion: 2.25 time: 0.427075 Oct 05 02:29:30.466903 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ea3cfea8-83ac-4b32-be5c-8d38395d5414 req-9932ebeb-0352-4770-b587-681fe67ee6b7 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:30.467748 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ea3cfea8-83ac-4b32-be5c-8d38395d5414 req-9932ebeb-0352-4770-b587-681fe67ee6b7 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:30.468328 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ea3cfea8-83ac-4b32-be5c-8d38395d5414 req-9932ebeb-0352-4770-b587-681fe67ee6b7 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:30.470939 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 334/660] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:29:30 2022] GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af => generated 1568 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:29:30.484010 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-20918c51-158b-42d2-ac4d-3f0383b87318 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:30.496546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20918c51-158b-42d2-ac4d-3f0383b87318 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:30.497308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20918c51-158b-42d2-ac4d-3f0383b87318 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:30.498165 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20918c51-158b-42d2-ac4d-3f0383b87318 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:30.499075 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20918c51-158b-42d2-ac4d-3f0383b87318 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:30.499714 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-ea3cfea8-83ac-4b32-be5c-8d38395d5414 req-9932ebeb-0352-4770-b587-681fe67ee6b7 service nova] Creating event network-changed:0a2b9672-d33e-4824-9498-5a3e1b415686 for instance 079782c4-bca1-40e0-aa9f-b8afdb6a79af on n-h2-858272-3 Oct 05 02:29:30.499851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20918c51-158b-42d2-ac4d-3f0383b87318 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:30.500219 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-ea3cfea8-83ac-4b32-be5c-8d38395d5414 req-9932ebeb-0352-4770-b587-681fe67ee6b7 service nova] Creating event network-vif-unplugged:235b3397-5893-46bc-98c1-77706502791c for instance 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 on n-h1-858272-3 Oct 05 02:29:30.500600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20918c51-158b-42d2-ac4d-3f0383b87318 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:30.511194 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-ea3cfea8-83ac-4b32-be5c-8d38395d5414 req-9932ebeb-0352-4770-b587-681fe67ee6b7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.064317 Oct 05 02:29:30.513851 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 327/661] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:30.524832 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-30a84353-8e8b-4ec6-b852-ffcc4e2f3e2b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:30.525637 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-30a84353-8e8b-4ec6-b852-ffcc4e2f3e2b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:30.534281 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30a84353-8e8b-4ec6-b852-ffcc4e2f3e2b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:30.535031 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30a84353-8e8b-4ec6-b852-ffcc4e2f3e2b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:30.536172 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30a84353-8e8b-4ec6-b852-ffcc4e2f3e2b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:30.537128 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-20918c51-158b-42d2-ac4d-3f0383b87318 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.059562 Oct 05 02:29:30.537299 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30a84353-8e8b-4ec6-b852-ffcc4e2f3e2b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:30.537790 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 335/662] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Oct 5 02:29:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:30.538330 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30a84353-8e8b-4ec6-b852-ffcc4e2f3e2b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:30.539016 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30a84353-8e8b-4ec6-b852-ffcc4e2f3e2b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:30.543461 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-367090eb-cf80-4e64-b5b9-75ca56bec75b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:30.544361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-367090eb-cf80-4e64-b5b9-75ca56bec75b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] [instance: 2e297761-81b8-4084-938d-7e097b32cd44] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:30.553646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-367090eb-cf80-4e64-b5b9-75ca56bec75b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:30.554338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-367090eb-cf80-4e64-b5b9-75ca56bec75b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:30.555184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-367090eb-cf80-4e64-b5b9-75ca56bec75b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:30.556092 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-367090eb-cf80-4e64-b5b9-75ca56bec75b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:30.556701 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-367090eb-cf80-4e64-b5b9-75ca56bec75b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:30.557331 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-367090eb-cf80-4e64-b5b9-75ca56bec75b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:30.725328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-367090eb-cf80-4e64-b5b9-75ca56bec75b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000b799366da44838465be08b88fb27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e7bf1499e6408da408d85bddc4d95b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:30.738704 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-367090eb-cf80-4e64-b5b9-75ca56bec75b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44" status: 200 len: 1270 microversion: 2.1 time: 0.197939 Oct 05 02:29:30.739978 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 336/663] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:30 2022] GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44 => generated 1270 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:30.750438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c840d20f-7318-44bf-a303-3d88bf3a6c55 tempest-FloatingIPDetailsTestJSON-65459292 tempest-FloatingIPDetailsTestJSON-65459292-project] Calling method '.version_select at 0x7fcce4351ee0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:31.095575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-30a84353-8e8b-4ec6-b852-ffcc4e2f3e2b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:31.105006 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-30a84353-8e8b-4ec6-b852-ffcc4e2f3e2b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9" status: 200 len: 1505 microversion: 2.1 time: 0.589691 Oct 05 02:29:31.111836 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 328/664] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:30 2022] GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 => generated 1505 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:31.117486 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-632081b1-56a9-4195-b36b-fce221ad0527 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858272-3", "block_migration": true, "disk_over_commit": false}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:31.120379 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-632081b1-56a9-4195-b36b-fce221ad0527 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] [instance: 4125f403-0514-4a60-983f-51f76c7b99cb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:31.134707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-632081b1-56a9-4195-b36b-fce221ad0527 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:31.135553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-632081b1-56a9-4195-b36b-fce221ad0527 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:31.136246 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-632081b1-56a9-4195-b36b-fce221ad0527 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:31.137694 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-632081b1-56a9-4195-b36b-fce221ad0527 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:31.139801 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-632081b1-56a9-4195-b36b-fce221ad0527 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:31.140463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-632081b1-56a9-4195-b36b-fce221ad0527 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:31.192106 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-632081b1-56a9-4195-b36b-fce221ad0527 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Lazy-loading 'flavor' on Instance uuid 4125f403-0514-4a60-983f-51f76c7b99cb {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:29:31.206788 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-632081b1-56a9-4195-b36b-fce221ad0527 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 4125f403-0514-4a60-983f-51f76c7b99cb while it is in vm_state suspended Oct 05 02:29:31.209104 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-632081b1-56a9-4195-b36b-fce221ad0527 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Request method failure captured: Oct 05 02:29:31.209104 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers/4125f403-0514-4a60-983f-51f76c7b99cb/action HTTP/1.1 Oct 05 02:29:31.209104 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:29:31.209104 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:29:31.209104 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:29:31.209104 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 97 Oct 05 02:29:31.209104 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:29:31.209104 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:29:31.209104 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:29:31.209104 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:29:31.209104 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOvRsJ9oCqPKJ967BJVBiqIb6cIi7BObQZWkG7dNVAEkmKpEJSLpPZ50RPlwJ0fwKoibMLfCSjulSdmLK13w8NqaHX8hpeNUQIKbsfe5-1krC9eKTAQux8Svsj50cvqbgde2WLpAXLeL_8ifEewhLh7r2AIe1RVsAx14zoixq0l35nQ Oct 05 02:29:31.209104 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:29:31.209104 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:29:31.209104 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:29:31.209104 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:29:31.209104 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:29:31.209104 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:29:31.209104 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 19c4516dd1264ac2859de4efe1d1b65c Oct 05 02:29:31.209104 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-LiveMigrationNegativeTest-427432159 Oct 05 02:29:31.209104 n-d-858272-3 devstack@n-api.service[122320]: X-Role: admin,member,reader Oct 05 02:29:31.209104 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: admin,member,reader Oct 05 02:29:31.210763 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/19c4516dd1264ac2859de4efe1d1b65c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/19c4516dd1264ac2859de4efe1d1b65c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/19c4516dd1264ac2859de4efe1d1b65c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_19c4516dd1264ac2859de4efe1d1b65c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:29:31.210763 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-LiveMigrationNegativeTest-427432159 Oct 05 02:29:31.210763 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 19c4516dd1264ac2859de4efe1d1b65c Oct 05 02:29:31.210763 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-427432159 Oct 05 02:29:31.210763 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-LiveMigrationNegativeTest-427432159-project-admin Oct 05 02:29:31.210763 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:29:31.210763 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:29:31.210763 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 4c3c9b08350041d38262ea35c9f70812 Oct 05 02:29:31.210763 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-LiveMigrationNegativeTest-427432159-project-admin Oct 05 02:29:31.210763 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:29:31.210763 n-d-858272-3 devstack@n-api.service[122320]: {"os-migrateLive": {"host": "n-h2-858272-3", "block_migration": true, "disk_over_commit": false}} Oct 05 02:29:31.210763 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:29:31.211666 n-d-858272-3 devstack@n-api.service[122320]: exception: Cannot 'os-migrateLive' instance 4125f403-0514-4a60-983f-51f76c7b99cb while it is in vm_state suspended Oct 05 02:29:31.211666 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '4125f403-0514-4a60-983f-51f76c7b99cb', 'body': {'os-migrateLive': {'host': 'n-h2-858272-3', 'block_migration': True, 'disk_over_commit': False}}} Oct 05 02:29:31.211666 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:29:31.211666 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:29:31.211666 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 05 02:29:31.211666 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 05 02:29:31.211666 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 05 02:29:31.211666 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 02:29:31.211666 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 05 02:29:31.211666 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 05 02:29:31.211666 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 05 02:29:31.211666 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 02:29:31.211666 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 05 02:29:31.211666 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 05 02:29:31.211666 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 05 02:29:31.211666 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 02:29:31.211666 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 05 02:29:31.211666 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 02:29:31.213022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 02:29:31.213022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 02:29:31.213022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 05 02:29:31.213022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 05 02:29:31.213022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4125f403-0514-4a60-983f-51f76c7b99cb in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 05 02:29:31.213022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:29:31.213022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:29:31.213022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:29:31.213022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:29:31.213022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:29:31.213022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:29:31.213022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:29:31.213022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:29:31.213022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:29:31.213022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:29:31.213022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:29:31.213022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:29:31.213022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:29:31.213022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:29:31.213022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:29:31.215065 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:29:31.215065 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 05 02:29:31.215065 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 05 02:29:31.215065 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 05 02:29:31.215065 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 05 02:29:31.215065 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 02:29:31.215065 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 4125f403-0514-4a60-983f-51f76c7b99cb while it is in vm_state suspended Oct 05 02:29:31.215065 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:29:31.215065 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:29:31.215065 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:29:31.215065 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:29:31.215065 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:29:31.215065 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:29:31.215065 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:29:31.215065 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:29:31.215065 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 4125f403-0514-4a60-983f-51f76c7b99cb while it is in vm_state suspended Oct 05 02:29:31.215065 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:29:31.216338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-632081b1-56a9-4195-b36b-fce221ad0527 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 4125f403-0514-4a60-983f-51f76c7b99cb while it is in vm_state suspended {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:29:31.216338 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-632081b1-56a9-4195-b36b-fce221ad0527 tempest-LiveMigrationNegativeTest-427432159 tempest-LiveMigrationNegativeTest-427432159-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/4125f403-0514-4a60-983f-51f76c7b99cb/action" status: 409 len: 155 microversion: 2.1 time: 0.101892 Oct 05 02:29:31.217796 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 329/665] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:29:31 2022] POST /compute/v2.1/servers/4125f403-0514-4a60-983f-51f76c7b99cb/action => generated 155 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:29:31.226382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-006b6874-962e-41ba-a3ab-40a8d0ff928d tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:31.227336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-006b6874-962e-41ba-a3ab-40a8d0ff928d tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] [instance: 4be4b86a-17b7-49a6-b630-1972adc25deb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:31.234485 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-006b6874-962e-41ba-a3ab-40a8d0ff928d tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:31.236292 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-006b6874-962e-41ba-a3ab-40a8d0ff928d tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:31.237000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-006b6874-962e-41ba-a3ab-40a8d0ff928d tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:31.237942 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-006b6874-962e-41ba-a3ab-40a8d0ff928d tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:31.239160 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-006b6874-962e-41ba-a3ab-40a8d0ff928d tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:31.239803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-006b6874-962e-41ba-a3ab-40a8d0ff928d tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:31.712829 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-006b6874-962e-41ba-a3ab-40a8d0ff928d tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005a727f85c54471b45488b0f1d394e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449ddfb8f22f49a7a294de5f5ef08531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:31.724564 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-006b6874-962e-41ba-a3ab-40a8d0ff928d tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] 10.222.0.16 "GET /compute/v2.1/servers/4be4b86a-17b7-49a6-b630-1972adc25deb" status: 200 len: 1323 microversion: 2.1 time: 0.505158 Oct 05 02:29:31.725427 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 330/666] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:31 2022] GET /compute/v2.1/servers/4be4b86a-17b7-49a6-b630-1972adc25deb => generated 1323 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:31.730254 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9178d6b1-0791-465d-a8d1-374483c33cfa tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:31.731011 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9178d6b1-0791-465d-a8d1-374483c33cfa tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 4125f403-0514-4a60-983f-51f76c7b99cb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:31.738672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9178d6b1-0791-465d-a8d1-374483c33cfa tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:31.739450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9178d6b1-0791-465d-a8d1-374483c33cfa tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:31.740132 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9178d6b1-0791-465d-a8d1-374483c33cfa tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:31.741149 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9178d6b1-0791-465d-a8d1-374483c33cfa tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:31.742160 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9178d6b1-0791-465d-a8d1-374483c33cfa tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:31.742792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9178d6b1-0791-465d-a8d1-374483c33cfa tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:31.779120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9178d6b1-0791-465d-a8d1-374483c33cfa tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 4125f403-0514-4a60-983f-51f76c7b99cb] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:29:31.788006 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:31.895976 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9178d6b1-0791-465d-a8d1-374483c33cfa tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4125f403-0514-4a60-983f-51f76c7b99cb" status: 204 len: 0 microversion: 2.1 time: 0.168356 Oct 05 02:29:31.897734 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 331/667] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:29:31 2022] DELETE /compute/v2.1/servers/4125f403-0514-4a60-983f-51f76c7b99cb => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:29:31.904571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f5fb90d5-ee56-4b7b-84f3-d4d7331b76a6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:31.905706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f5fb90d5-ee56-4b7b-84f3-d4d7331b76a6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:31.914613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5fb90d5-ee56-4b7b-84f3-d4d7331b76a6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:31.915567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5fb90d5-ee56-4b7b-84f3-d4d7331b76a6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:31.916092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5fb90d5-ee56-4b7b-84f3-d4d7331b76a6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:31.916861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5fb90d5-ee56-4b7b-84f3-d4d7331b76a6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:31.917484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5fb90d5-ee56-4b7b-84f3-d4d7331b76a6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:31.918630 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5fb90d5-ee56-4b7b-84f3-d4d7331b76a6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:32.625647 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f5fb90d5-ee56-4b7b-84f3-d4d7331b76a6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:32.636289 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f5fb90d5-ee56-4b7b-84f3-d4d7331b76a6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:32.646850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f5fb90d5-ee56-4b7b-84f3-d4d7331b76a6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:32.649176 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f5fb90d5-ee56-4b7b-84f3-d4d7331b76a6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af" status: 200 len: 1568 microversion: 2.25 time: 0.749839 Oct 05 02:29:32.650279 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 332/668] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:29:31 2022] GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af => generated 1568 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:29:32.658544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e4164a1a-48ce-4eaf-989f-4a57418f3f5d tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:32.663217 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e4164a1a-48ce-4eaf-989f-4a57418f3f5d tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] [instance: 2e297761-81b8-4084-938d-7e097b32cd44] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:32.674717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4164a1a-48ce-4eaf-989f-4a57418f3f5d tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:32.679839 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4164a1a-48ce-4eaf-989f-4a57418f3f5d tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:32.680488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4164a1a-48ce-4eaf-989f-4a57418f3f5d tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:32.681443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4164a1a-48ce-4eaf-989f-4a57418f3f5d tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:32.682240 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4164a1a-48ce-4eaf-989f-4a57418f3f5d tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:32.683581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4164a1a-48ce-4eaf-989f-4a57418f3f5d tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:33.122482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e4164a1a-48ce-4eaf-989f-4a57418f3f5d tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000b799366da44838465be08b88fb27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e7bf1499e6408da408d85bddc4d95b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:33.130721 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e4164a1a-48ce-4eaf-989f-4a57418f3f5d tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44" status: 200 len: 1312 microversion: 2.1 time: 0.479083 Oct 05 02:29:33.144927 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 333/669] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:32 2022] GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44 => generated 1312 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:33.144927 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-36e09e25-cc70-407e-8594-911d39292925 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:33.144927 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-36e09e25-cc70-407e-8594-911d39292925 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 4125f403-0514-4a60-983f-51f76c7b99cb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:33.145589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36e09e25-cc70-407e-8594-911d39292925 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:33.146270 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36e09e25-cc70-407e-8594-911d39292925 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:33.146901 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36e09e25-cc70-407e-8594-911d39292925 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:33.147782 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36e09e25-cc70-407e-8594-911d39292925 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:33.148401 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36e09e25-cc70-407e-8594-911d39292925 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:33.149082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36e09e25-cc70-407e-8594-911d39292925 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:33.573252 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-36e09e25-cc70-407e-8594-911d39292925 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d53045696469487a6be6640b07f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a87f178aedc4acbb4bd353bc09a7cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:33.581814 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-36e09e25-cc70-407e-8594-911d39292925 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] 10.222.0.16 "GET /compute/v2.1/servers/4125f403-0514-4a60-983f-51f76c7b99cb" status: 200 len: 1466 microversion: 2.1 time: 0.447033 Oct 05 02:29:33.582415 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 334/670] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:33 2022] GET /compute/v2.1/servers/4125f403-0514-4a60-983f-51f76c7b99cb => generated 1466 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:33.587792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5a5c9c58-7e50-47fd-ba44-c89d1a4952c2 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:33.588413 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5a5c9c58-7e50-47fd-ba44-c89d1a4952c2 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:33.602308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5a5c9c58-7e50-47fd-ba44-c89d1a4952c2 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:33.602815 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5a5c9c58-7e50-47fd-ba44-c89d1a4952c2 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:33.603262 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5a5c9c58-7e50-47fd-ba44-c89d1a4952c2 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:33.604589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5a5c9c58-7e50-47fd-ba44-c89d1a4952c2 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:33.604589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5a5c9c58-7e50-47fd-ba44-c89d1a4952c2 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:33.604882 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5a5c9c58-7e50-47fd-ba44-c89d1a4952c2 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:33.838366 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c840d20f-7318-44bf-a303-3d88bf3a6c55 tempest-FloatingIPDetailsTestJSON-65459292 tempest-FloatingIPDetailsTestJSON-65459292-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/ee844a03-a814-4a34-aeb3-e552a43b0f1f" status: 202 len: 0 microversion: 2.1 time: 3.096991 Oct 05 02:29:33.839967 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 337/671] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 5 02:29:30 2022] DELETE /compute/v2.1/os-floating-ips/ee844a03-a814-4a34-aeb3-e552a43b0f1f => generated 0 bytes in 3099 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:29:33.847598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-9fbc2611-a60b-4d10-952f-7f56fcdc20ad req-7d1675f9-6c01-4346-8a6e-a19be42f671a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94c1a311-92cb-4a6f-9d45-32af2f3ae6e9", "tag": "235b3397-5893-46bc-98c1-77706502791c"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:33.859763 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9fbc2611-a60b-4d10-952f-7f56fcdc20ad req-7d1675f9-6c01-4346-8a6e-a19be42f671a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:33.861224 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9fbc2611-a60b-4d10-952f-7f56fcdc20ad req-7d1675f9-6c01-4346-8a6e-a19be42f671a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:33.861952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9fbc2611-a60b-4d10-952f-7f56fcdc20ad req-7d1675f9-6c01-4346-8a6e-a19be42f671a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:33.874167 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-9fbc2611-a60b-4d10-952f-7f56fcdc20ad req-7d1675f9-6c01-4346-8a6e-a19be42f671a service nova] Creating event network-changed:235b3397-5893-46bc-98c1-77706502791c for instance 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 on n-h1-858272-3 Oct 05 02:29:33.881368 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-9fbc2611-a60b-4d10-952f-7f56fcdc20ad req-7d1675f9-6c01-4346-8a6e-a19be42f671a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039810 Oct 05 02:29:33.882292 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 338/672] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:33.887584 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fc4d5339-e908-4558-8894-36245ac698cd tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:33.888624 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fc4d5339-e908-4558-8894-36245ac698cd tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] [instance: 4be4b86a-17b7-49a6-b630-1972adc25deb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:33.897616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fc4d5339-e908-4558-8894-36245ac698cd tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:33.898847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fc4d5339-e908-4558-8894-36245ac698cd tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:33.899736 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fc4d5339-e908-4558-8894-36245ac698cd tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:33.901485 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fc4d5339-e908-4558-8894-36245ac698cd tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:33.902179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fc4d5339-e908-4558-8894-36245ac698cd tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:33.902834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fc4d5339-e908-4558-8894-36245ac698cd tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:33.925103 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5a5c9c58-7e50-47fd-ba44-c89d1a4952c2 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:33.946228 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5a5c9c58-7e50-47fd-ba44-c89d1a4952c2 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9" status: 200 len: 1505 microversion: 2.1 time: 0.357610 Oct 05 02:29:33.949463 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 335/673] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:33 2022] GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 => generated 1505 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:33.965302 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ffd7be5e-4a87-48cb-9658-f24ac55dcdb4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:33.969450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ffd7be5e-4a87-48cb-9658-f24ac55dcdb4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:33.983387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ffd7be5e-4a87-48cb-9658-f24ac55dcdb4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:33.983754 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ffd7be5e-4a87-48cb-9658-f24ac55dcdb4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:33.988223 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ffd7be5e-4a87-48cb-9658-f24ac55dcdb4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:33.991443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ffd7be5e-4a87-48cb-9658-f24ac55dcdb4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:33.991443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ffd7be5e-4a87-48cb-9658-f24ac55dcdb4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:33.992502 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ffd7be5e-4a87-48cb-9658-f24ac55dcdb4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:34.400306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fc4d5339-e908-4558-8894-36245ac698cd tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005a727f85c54471b45488b0f1d394e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449ddfb8f22f49a7a294de5f5ef08531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:34.415292 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fc4d5339-e908-4558-8894-36245ac698cd tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] 10.222.0.16 "GET /compute/v2.1/servers/4be4b86a-17b7-49a6-b630-1972adc25deb" status: 200 len: 1323 microversion: 2.1 time: 0.531352 Oct 05 02:29:34.416087 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 339/674] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:33 2022] GET /compute/v2.1/servers/4be4b86a-17b7-49a6-b630-1972adc25deb => generated 1323 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:34.420670 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9640e01b-e972-43a9-995f-2318694e2c4c tempest-FloatingIPDetailsTestJSON-65459292 tempest-FloatingIPDetailsTestJSON-65459292-project] Calling method '.version_select at 0x7fcce4285820>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:34.612013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ffd7be5e-4a87-48cb-9658-f24ac55dcdb4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:34.628533 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ffd7be5e-4a87-48cb-9658-f24ac55dcdb4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:34.630663 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ffd7be5e-4a87-48cb-9658-f24ac55dcdb4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:34.632406 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ffd7be5e-4a87-48cb-9658-f24ac55dcdb4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af" status: 200 len: 1568 microversion: 2.25 time: 0.681961 Oct 05 02:29:34.634406 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 336/675] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:29:33 2022] GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af => generated 1568 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:29:34.643142 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1f731f91-30b4-4582-8fcd-c351dc0c6dc9 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:34.644268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1f731f91-30b4-4582-8fcd-c351dc0c6dc9 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] [instance: 2e297761-81b8-4084-938d-7e097b32cd44] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:34.651323 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1f731f91-30b4-4582-8fcd-c351dc0c6dc9 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:34.652443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1f731f91-30b4-4582-8fcd-c351dc0c6dc9 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:34.653163 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1f731f91-30b4-4582-8fcd-c351dc0c6dc9 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:34.654124 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1f731f91-30b4-4582-8fcd-c351dc0c6dc9 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:34.654845 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1f731f91-30b4-4582-8fcd-c351dc0c6dc9 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:34.655495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1f731f91-30b4-4582-8fcd-c351dc0c6dc9 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:35.859087 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=22 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:35.864770 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1f731f91-30b4-4582-8fcd-c351dc0c6dc9 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000b799366da44838465be08b88fb27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e7bf1499e6408da408d85bddc4d95b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:35.875559 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1f731f91-30b4-4582-8fcd-c351dc0c6dc9 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44" status: 200 len: 1312 microversion: 2.1 time: 1.239142 Oct 05 02:29:35.885345 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 337/676] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:34 2022] GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44 => generated 1312 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:35.906783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5a1d2991-446f-4866-8bfd-59ab54c18742 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:35.908430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5a1d2991-446f-4866-8bfd-59ab54c18742 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 4125f403-0514-4a60-983f-51f76c7b99cb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:35.931439 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5a1d2991-446f-4866-8bfd-59ab54c18742 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:35.931935 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5a1d2991-446f-4866-8bfd-59ab54c18742 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:35.932370 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5a1d2991-446f-4866-8bfd-59ab54c18742 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:35.933102 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5a1d2991-446f-4866-8bfd-59ab54c18742 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:35.933551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5a1d2991-446f-4866-8bfd-59ab54c18742 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:35.933970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5a1d2991-446f-4866-8bfd-59ab54c18742 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:36.659695 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5a1d2991-446f-4866-8bfd-59ab54c18742 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d53045696469487a6be6640b07f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a87f178aedc4acbb4bd353bc09a7cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:36.693258 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5a1d2991-446f-4866-8bfd-59ab54c18742 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] 10.222.0.16 "GET /compute/v2.1/servers/4125f403-0514-4a60-983f-51f76c7b99cb" status: 200 len: 1466 microversion: 2.1 time: 0.805373 Oct 05 02:29:36.716316 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 338/677] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:35 2022] GET /compute/v2.1/servers/4125f403-0514-4a60-983f-51f76c7b99cb => generated 1466 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:36.729698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e57f5fdd-63ed-453a-94f2-880f27b0cee5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:36.731251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e57f5fdd-63ed-453a-94f2-880f27b0cee5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:36.753603 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e57f5fdd-63ed-453a-94f2-880f27b0cee5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:36.754134 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e57f5fdd-63ed-453a-94f2-880f27b0cee5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:36.754570 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e57f5fdd-63ed-453a-94f2-880f27b0cee5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:36.755274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e57f5fdd-63ed-453a-94f2-880f27b0cee5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:36.755724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e57f5fdd-63ed-453a-94f2-880f27b0cee5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:36.756142 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e57f5fdd-63ed-453a-94f2-880f27b0cee5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:37.174846 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e57f5fdd-63ed-453a-94f2-880f27b0cee5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:37.205190 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e57f5fdd-63ed-453a-94f2-880f27b0cee5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9" status: 200 len: 1505 microversion: 2.1 time: 0.487373 Oct 05 02:29:37.234861 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 339/678] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:36 2022] GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 => generated 1505 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:37.244365 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e530f7ef-1c68-417c-ad02-cb23eb582346 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:37.248135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e530f7ef-1c68-417c-ad02-cb23eb582346 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] [instance: 4be4b86a-17b7-49a6-b630-1972adc25deb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:37.258067 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e530f7ef-1c68-417c-ad02-cb23eb582346 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:37.258589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e530f7ef-1c68-417c-ad02-cb23eb582346 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:37.259037 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e530f7ef-1c68-417c-ad02-cb23eb582346 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:37.259725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e530f7ef-1c68-417c-ad02-cb23eb582346 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:37.265492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e530f7ef-1c68-417c-ad02-cb23eb582346 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:37.266174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e530f7ef-1c68-417c-ad02-cb23eb582346 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:37.548537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=8 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:37.673834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e530f7ef-1c68-417c-ad02-cb23eb582346 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005a727f85c54471b45488b0f1d394e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449ddfb8f22f49a7a294de5f5ef08531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:37.683261 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e530f7ef-1c68-417c-ad02-cb23eb582346 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] 10.222.0.16 "GET /compute/v2.1/servers/4be4b86a-17b7-49a6-b630-1972adc25deb" status: 200 len: 1323 microversion: 2.1 time: 0.446623 Oct 05 02:29:37.683879 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 340/679] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:37 2022] GET /compute/v2.1/servers/4be4b86a-17b7-49a6-b630-1972adc25deb => generated 1323 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:37.685511 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9640e01b-e972-43a9-995f-2318694e2c4c tempest-FloatingIPDetailsTestJSON-65459292 tempest-FloatingIPDetailsTestJSON-65459292-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/9a0c4def-6730-42bb-ac55-f4e5de9ab880" status: 202 len: 0 microversion: 2.1 time: 3.268203 Oct 05 02:29:37.686354 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 340/680] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 5 02:29:34 2022] DELETE /compute/v2.1/os-floating-ips/9a0c4def-6730-42bb-ac55-f4e5de9ab880 => generated 0 bytes in 3269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:29:37.692799 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-d3cf39e9-9a79-43ac-8948-da08101875eb req-25f92fa6-7bf1-441c-a5d1-bed573cc7d4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4be4b86a-17b7-49a6-b630-1972adc25deb", "tag": "ec1249bd-947f-457d-8a78-0483e5e79c65"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:37.711646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d3cf39e9-9a79-43ac-8948-da08101875eb req-25f92fa6-7bf1-441c-a5d1-bed573cc7d4b service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:37.714710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d3cf39e9-9a79-43ac-8948-da08101875eb req-25f92fa6-7bf1-441c-a5d1-bed573cc7d4b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:37.715507 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d3cf39e9-9a79-43ac-8948-da08101875eb req-25f92fa6-7bf1-441c-a5d1-bed573cc7d4b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:37.715914 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3cf435a3-cc63-456e-ad71-394a54138379 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:37.716879 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3cf435a3-cc63-456e-ad71-394a54138379 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:37.732923 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3cf435a3-cc63-456e-ad71-394a54138379 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:37.733811 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3cf435a3-cc63-456e-ad71-394a54138379 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:37.734505 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3cf435a3-cc63-456e-ad71-394a54138379 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:37.739099 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3cf435a3-cc63-456e-ad71-394a54138379 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:37.740072 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3cf435a3-cc63-456e-ad71-394a54138379 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:37.740787 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3cf435a3-cc63-456e-ad71-394a54138379 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:37.747645 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-d3cf39e9-9a79-43ac-8948-da08101875eb req-25f92fa6-7bf1-441c-a5d1-bed573cc7d4b service nova] Creating event network-changed:ec1249bd-947f-457d-8a78-0483e5e79c65 for instance 4be4b86a-17b7-49a6-b630-1972adc25deb on n-h1-858272-3 Oct 05 02:29:37.753814 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-d3cf39e9-9a79-43ac-8948-da08101875eb req-25f92fa6-7bf1-441c-a5d1-bed573cc7d4b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066265 Oct 05 02:29:37.754350 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 341/681] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:37.763741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-238477f0-392c-4538-946d-9d540c8a9504 req-d70e38a5-6489-45f6-83be-d930c5aea0b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "079782c4-bca1-40e0-aa9f-b8afdb6a79af", "name": "network-vif-plugged", "status": "completed", "tag": "0a2b9672-d33e-4824-9498-5a3e1b415686"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:37.776485 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-238477f0-392c-4538-946d-9d540c8a9504 req-d70e38a5-6489-45f6-83be-d930c5aea0b9 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:37.777264 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-238477f0-392c-4538-946d-9d540c8a9504 req-d70e38a5-6489-45f6-83be-d930c5aea0b9 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:37.777727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-238477f0-392c-4538-946d-9d540c8a9504 req-d70e38a5-6489-45f6-83be-d930c5aea0b9 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:37.781422 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=14 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:37.794282 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-238477f0-392c-4538-946d-9d540c8a9504 req-d70e38a5-6489-45f6-83be-d930c5aea0b9 service nova] Creating event network-vif-plugged:0a2b9672-d33e-4824-9498-5a3e1b415686 for instance 079782c4-bca1-40e0-aa9f-b8afdb6a79af on n-h1-858272-3 Oct 05 02:29:37.801593 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-238477f0-392c-4538-946d-9d540c8a9504 req-d70e38a5-6489-45f6-83be-d930c5aea0b9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042744 Oct 05 02:29:37.806439 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 342/682] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:37.811566 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3babdb5b-cf8e-491e-8c92-12ad413d7f0b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:37.812744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3babdb5b-cf8e-491e-8c92-12ad413d7f0b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] [instance: 2e297761-81b8-4084-938d-7e097b32cd44] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:37.819965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3babdb5b-cf8e-491e-8c92-12ad413d7f0b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:37.820466 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3babdb5b-cf8e-491e-8c92-12ad413d7f0b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:37.820925 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3babdb5b-cf8e-491e-8c92-12ad413d7f0b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:37.821858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3babdb5b-cf8e-491e-8c92-12ad413d7f0b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:37.822797 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3babdb5b-cf8e-491e-8c92-12ad413d7f0b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:37.823228 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3babdb5b-cf8e-491e-8c92-12ad413d7f0b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:38.084262 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3cf435a3-cc63-456e-ad71-394a54138379 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:38.098198 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3babdb5b-cf8e-491e-8c92-12ad413d7f0b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000b799366da44838465be08b88fb27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e7bf1499e6408da408d85bddc4d95b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:38.099117 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3cf435a3-cc63-456e-ad71-394a54138379 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:38.100552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3cf435a3-cc63-456e-ad71-394a54138379 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:38.101786 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3cf435a3-cc63-456e-ad71-394a54138379 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af" status: 200 len: 1543 microversion: 2.25 time: 0.416716 Oct 05 02:29:38.110284 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3babdb5b-cf8e-491e-8c92-12ad413d7f0b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44" status: 200 len: 1312 microversion: 2.1 time: 0.301855 Oct 05 02:29:38.117382 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 341/683] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:29:37 2022] GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af => generated 1543 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:29:38.124059 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 343/684] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:37 2022] GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44 => generated 1312 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:38.129804 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2046d28d-122f-40b7-8188-543f559ed947 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:38.130228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2046d28d-122f-40b7-8188-543f559ed947 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 4125f403-0514-4a60-983f-51f76c7b99cb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:38.134174 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b9b9830c-32fe-4b70-81db-8066670f69ba tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Calling method '.version_select at 0x7fcce4214700>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:38.137316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2046d28d-122f-40b7-8188-543f559ed947 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:38.137809 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2046d28d-122f-40b7-8188-543f559ed947 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:38.138238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2046d28d-122f-40b7-8188-543f559ed947 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:38.138635 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9b9830c-32fe-4b70-81db-8066670f69ba tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:38.139074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2046d28d-122f-40b7-8188-543f559ed947 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:38.139533 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2046d28d-122f-40b7-8188-543f559ed947 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:38.139760 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9b9830c-32fe-4b70-81db-8066670f69ba tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:38.139966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2046d28d-122f-40b7-8188-543f559ed947 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:38.140589 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9b9830c-32fe-4b70-81db-8066670f69ba tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:38.150608 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b9b9830c-32fe-4b70-81db-8066670f69ba tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1520 microversion: 2.25 time: 0.024934 Oct 05 02:29:38.151666 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 344/685] 10.222.0.16 () {60 vars in 1184 bytes} [Wed Oct 5 02:29:38 2022] GET /compute/v2.1/os-migrations => generated 1520 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:29:38.179150 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-84f0bdaa-9da8-4b63-987f-b1d88cbdd630 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:38.180957 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-84f0bdaa-9da8-4b63-987f-b1d88cbdd630 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:38.197102 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84f0bdaa-9da8-4b63-987f-b1d88cbdd630 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:38.199014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84f0bdaa-9da8-4b63-987f-b1d88cbdd630 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:38.200271 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84f0bdaa-9da8-4b63-987f-b1d88cbdd630 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:38.201252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84f0bdaa-9da8-4b63-987f-b1d88cbdd630 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:38.203423 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84f0bdaa-9da8-4b63-987f-b1d88cbdd630 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:38.205205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84f0bdaa-9da8-4b63-987f-b1d88cbdd630 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:38.218906 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2046d28d-122f-40b7-8188-543f559ed947 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d53045696469487a6be6640b07f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a87f178aedc4acbb4bd353bc09a7cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:38.227323 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2046d28d-122f-40b7-8188-543f559ed947 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] 10.222.0.16 "GET /compute/v2.1/servers/4125f403-0514-4a60-983f-51f76c7b99cb" status: 200 len: 1424 microversion: 2.1 time: 0.108488 Oct 05 02:29:38.241457 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 342/686] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:38 2022] GET /compute/v2.1/servers/4125f403-0514-4a60-983f-51f76c7b99cb => generated 1424 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:38.248599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-01ce8e11-a3a2-449e-9013-0dcaa0b3d80f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:38.249498 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-01ce8e11-a3a2-449e-9013-0dcaa0b3d80f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:38.256828 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-01ce8e11-a3a2-449e-9013-0dcaa0b3d80f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:38.257558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-01ce8e11-a3a2-449e-9013-0dcaa0b3d80f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:38.258151 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-01ce8e11-a3a2-449e-9013-0dcaa0b3d80f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:38.259015 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-01ce8e11-a3a2-449e-9013-0dcaa0b3d80f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:38.259473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-01ce8e11-a3a2-449e-9013-0dcaa0b3d80f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:38.259897 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-01ce8e11-a3a2-449e-9013-0dcaa0b3d80f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:38.441134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-84f0bdaa-9da8-4b63-987f-b1d88cbdd630 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lazy-loading 'services' on Instance uuid 079782c4-bca1-40e0-aa9f-b8afdb6a79af {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:29:38.466460 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-84f0bdaa-9da8-4b63-987f-b1d88cbdd630 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af" status: 200 len: 2036 microversion: 2.25 time: 0.296643 Oct 05 02:29:38.468760 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 345/687] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:29:38 2022] GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af => generated 2036 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:29:38.502766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-01ce8e11-a3a2-449e-9013-0dcaa0b3d80f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:38.510540 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b5459e73-3ebf-492e-a9df-5b2a1b305bae tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Action: 'create', calling method: .version_select at 0x7fcce447b0d0>, body: {"keypair": {"name": "tempest-keypair-1679652780", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHRwOMqoF2j3UTJSNeIYKbIBL6uGJTP0Ql+M7YnT8Rzwh1WlPqBTNGXVKcUEZnoFqO8uhkQMobEJoC+/3NDy+35bEw9CDjLbHpNBvWWeV43bCk6Ps4ZvOVhTtXttLjIGg=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:38.515752 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-01ce8e11-a3a2-449e-9013-0dcaa0b3d80f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9" status: 200 len: 1505 microversion: 2.1 time: 0.273138 Oct 05 02:29:38.516582 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 343/688] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:38 2022] GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 => generated 1505 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:38.530153 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-b5459e73-3ebf-492e-a9df-5b2a1b305bae tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Getting quotas for project bbd25b0a68f749029eeed701c77462ce. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:29:38.536606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-b5459e73-3ebf-492e-a9df-5b2a1b305bae tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Getting quotas for user 39671ba0b86847f995c96013947fee65 and project bbd25b0a68f749029eeed701c77462ce. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:29:38.568311 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b5459e73-3ebf-492e-a9df-5b2a1b305bae tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.061682 Oct 05 02:29:38.569863 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 346/689] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Oct 5 02:29:38 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 64 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 05 02:29:38.724593 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3f0ff130-e195-4263-b730-deedadf5a24b tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:38.725329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3f0ff130-e195-4263-b730-deedadf5a24b tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] [instance: 4be4b86a-17b7-49a6-b630-1972adc25deb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:38.734705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f0ff130-e195-4263-b730-deedadf5a24b tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:38.741431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f0ff130-e195-4263-b730-deedadf5a24b tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:38.742480 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f0ff130-e195-4263-b730-deedadf5a24b tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:38.743456 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f0ff130-e195-4263-b730-deedadf5a24b tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:38.744009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f0ff130-e195-4263-b730-deedadf5a24b tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:38.744520 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f0ff130-e195-4263-b730-deedadf5a24b tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:38.947830 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3f0ff130-e195-4263-b730-deedadf5a24b tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005a727f85c54471b45488b0f1d394e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449ddfb8f22f49a7a294de5f5ef08531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:38.963240 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3f0ff130-e195-4263-b730-deedadf5a24b tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] 10.222.0.16 "GET /compute/v2.1/servers/4be4b86a-17b7-49a6-b630-1972adc25deb" status: 200 len: 1323 microversion: 2.1 time: 0.246269 Oct 05 02:29:38.964533 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 344/690] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:38 2022] GET /compute/v2.1/servers/4be4b86a-17b7-49a6-b630-1972adc25deb => generated 1323 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:39.138207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-935ef807-8012-48fa-a708-76065ff79329 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:39.138828 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-935ef807-8012-48fa-a708-76065ff79329 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] [instance: 2e297761-81b8-4084-938d-7e097b32cd44] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:39.151095 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-935ef807-8012-48fa-a708-76065ff79329 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:39.158552 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-935ef807-8012-48fa-a708-76065ff79329 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:39.160130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-935ef807-8012-48fa-a708-76065ff79329 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:39.163421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-935ef807-8012-48fa-a708-76065ff79329 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:39.166399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-935ef807-8012-48fa-a708-76065ff79329 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:39.167241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-935ef807-8012-48fa-a708-76065ff79329 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:39.255536 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bc1c604f-6567-487c-b9a6-5eeee425589d tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:39.256156 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bc1c604f-6567-487c-b9a6-5eeee425589d tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 4125f403-0514-4a60-983f-51f76c7b99cb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:39.262373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bc1c604f-6567-487c-b9a6-5eeee425589d tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:39.262865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bc1c604f-6567-487c-b9a6-5eeee425589d tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:39.263304 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bc1c604f-6567-487c-b9a6-5eeee425589d tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:39.264100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bc1c604f-6567-487c-b9a6-5eeee425589d tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:39.264449 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bc1c604f-6567-487c-b9a6-5eeee425589d tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:39.264871 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bc1c604f-6567-487c-b9a6-5eeee425589d tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:39.487438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bc1c604f-6567-487c-b9a6-5eeee425589d tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d53045696469487a6be6640b07f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a87f178aedc4acbb4bd353bc09a7cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:39.497496 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bc1c604f-6567-487c-b9a6-5eeee425589d tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] 10.222.0.16 "GET /compute/v2.1/servers/4125f403-0514-4a60-983f-51f76c7b99cb" status: 200 len: 1295 microversion: 2.1 time: 0.245645 Oct 05 02:29:39.498285 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 345/691] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:39 2022] GET /compute/v2.1/servers/4125f403-0514-4a60-983f-51f76c7b99cb => generated 1295 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:29:39.545026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-96eeb415-5e6e-4244-a564-14519eb6bc71 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:39.545920 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-96eeb415-5e6e-4244-a564-14519eb6bc71 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:39.553711 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96eeb415-5e6e-4244-a564-14519eb6bc71 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:39.554501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96eeb415-5e6e-4244-a564-14519eb6bc71 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:39.555709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96eeb415-5e6e-4244-a564-14519eb6bc71 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:39.556639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96eeb415-5e6e-4244-a564-14519eb6bc71 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:39.557394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96eeb415-5e6e-4244-a564-14519eb6bc71 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:39.558016 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96eeb415-5e6e-4244-a564-14519eb6bc71 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:40.324686 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-935ef807-8012-48fa-a708-76065ff79329 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000b799366da44838465be08b88fb27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e7bf1499e6408da408d85bddc4d95b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:40.338023 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-935ef807-8012-48fa-a708-76065ff79329 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44" status: 200 len: 1312 microversion: 2.1 time: 1.201624 Oct 05 02:29:40.340462 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 347/692] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:39 2022] GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44 => generated 1312 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:40.360262 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2bb2675c-a0ac-4208-95b1-7b5e4246c8e8 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:40.362071 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2bb2675c-a0ac-4208-95b1-7b5e4246c8e8 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] [instance: 4be4b86a-17b7-49a6-b630-1972adc25deb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:40.377681 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2bb2675c-a0ac-4208-95b1-7b5e4246c8e8 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:40.381093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2bb2675c-a0ac-4208-95b1-7b5e4246c8e8 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:40.381731 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2bb2675c-a0ac-4208-95b1-7b5e4246c8e8 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:40.383646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2bb2675c-a0ac-4208-95b1-7b5e4246c8e8 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:40.385125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2bb2675c-a0ac-4208-95b1-7b5e4246c8e8 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:40.386495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2bb2675c-a0ac-4208-95b1-7b5e4246c8e8 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:40.513260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=4 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:40.590481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-96eeb415-5e6e-4244-a564-14519eb6bc71 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:40.593332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:40.607802 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-96eeb415-5e6e-4244-a564-14519eb6bc71 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9" status: 200 len: 1505 microversion: 2.1 time: 1.071150 Oct 05 02:29:40.608710 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 346/693] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:39 2022] GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 => generated 1505 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:40.620294 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-8bf4b4b0-1162-4076-b859-158b9a54a4b0 req-cd903115-8f29-4df9-8afa-41c019850513 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e297761-81b8-4084-938d-7e097b32cd44", "tag": "474e574e-c9b6-4fe3-a2ae-1181ef3204c8"}, {"server_uuid": "4125f403-0514-4a60-983f-51f76c7b99cb", "name": "network-vif-deleted", "tag": "6b7ca93a-70aa-4737-9ec3-8b401a46b835"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:40.640688 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-8bf4b4b0-1162-4076-b859-158b9a54a4b0 req-cd903115-8f29-4df9-8afa-41c019850513 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:40.644262 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-8bf4b4b0-1162-4076-b859-158b9a54a4b0 req-cd903115-8f29-4df9-8afa-41c019850513 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:40.647057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-8bf4b4b0-1162-4076-b859-158b9a54a4b0 req-cd903115-8f29-4df9-8afa-41c019850513 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:40.664402 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-8bf4b4b0-1162-4076-b859-158b9a54a4b0 req-cd903115-8f29-4df9-8afa-41c019850513 service nova] Creating event network-changed:474e574e-c9b6-4fe3-a2ae-1181ef3204c8 for instance 2e297761-81b8-4084-938d-7e097b32cd44 on n-h2-858272-3 Oct 05 02:29:40.671564 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-8bf4b4b0-1162-4076-b859-158b9a54a4b0 req-cd903115-8f29-4df9-8afa-41c019850513 service nova] Creating event network-vif-deleted:6b7ca93a-70aa-4737-9ec3-8b401a46b835 for instance 4125f403-0514-4a60-983f-51f76c7b99cb on n-h1-858272-3 Oct 05 02:29:40.694634 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-8bf4b4b0-1162-4076-b859-158b9a54a4b0 req-cd903115-8f29-4df9-8afa-41c019850513 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.084508 Oct 05 02:29:40.701231 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 347/694] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:40.706766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e1d96224-1be0-4768-a016-b7d1221d574a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:40.717075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e1d96224-1be0-4768-a016-b7d1221d574a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 4125f403-0514-4a60-983f-51f76c7b99cb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:40.722725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1d96224-1be0-4768-a016-b7d1221d574a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:40.728977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1d96224-1be0-4768-a016-b7d1221d574a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:40.729731 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1d96224-1be0-4768-a016-b7d1221d574a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:40.730627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1d96224-1be0-4768-a016-b7d1221d574a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:40.733888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2bb2675c-a0ac-4208-95b1-7b5e4246c8e8 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005a727f85c54471b45488b0f1d394e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449ddfb8f22f49a7a294de5f5ef08531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:40.736817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:40.739842 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1d96224-1be0-4768-a016-b7d1221d574a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:40.744337 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2bb2675c-a0ac-4208-95b1-7b5e4246c8e8 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] 10.222.0.16 "GET /compute/v2.1/servers/4be4b86a-17b7-49a6-b630-1972adc25deb" status: 200 len: 1323 microversion: 2.1 time: 0.402108 Oct 05 02:29:40.745262 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1d96224-1be0-4768-a016-b7d1221d574a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:40.751754 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 348/695] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:40 2022] GET /compute/v2.1/servers/4be4b86a-17b7-49a6-b630-1972adc25deb => generated 1323 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:40.785171 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-e1d96224-1be0-4768-a016-b7d1221d574a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] HTTP exception thrown: Instance 4125f403-0514-4a60-983f-51f76c7b99cb could not be found. Oct 05 02:29:40.787313 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e1d96224-1be0-4768-a016-b7d1221d574a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Request method failure captured: Oct 05 02:29:40.787313 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/4125f403-0514-4a60-983f-51f76c7b99cb HTTP/1.1 Oct 05 02:29:40.787313 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:29:40.787313 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:29:40.787313 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:29:40.787313 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:29:40.787313 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:29:40.787313 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:29:40.787313 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:29:40.787313 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:29:40.787313 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOvPq5SqPyWzzBPGtjIjMKB9r8wMt9btuKjjOs6rKhD-ukaqJFEMJB_lmF0XS6pE4S5aMKnAXsaZ-Sjf0FO-7iHc6ueCICM1rqP2aRtO5AqJkN9hOWfTcyT7KROIu90D0KygtQmRe2rSsVdmwridXRx_I06H4jxzbTKAGo9uriG3750 Oct 05 02:29:40.787313 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:29:40.787313 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:29:40.787313 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:29:40.787313 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:29:40.787313 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:29:40.787313 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:29:40.787313 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 7a87f178aedc4acbb4bd353bc09a7cb3 Oct 05 02:29:40.787313 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-LiveMigrationNegativeTest-1166587887 Oct 05 02:29:40.787313 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:29:40.787313 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:29:40.789332 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7a87f178aedc4acbb4bd353bc09a7cb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7a87f178aedc4acbb4bd353bc09a7cb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7a87f178aedc4acbb4bd353bc09a7cb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7a87f178aedc4acbb4bd353bc09a7cb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:29:40.789332 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-LiveMigrationNegativeTest-1166587887 Oct 05 02:29:40.789332 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 7a87f178aedc4acbb4bd353bc09a7cb3 Oct 05 02:29:40.789332 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1166587887 Oct 05 02:29:40.789332 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-LiveMigrationNegativeTest-1166587887-project Oct 05 02:29:40.789332 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:29:40.789332 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:29:40.789332 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 1d5d53045696469487a6be6640b07f6e Oct 05 02:29:40.789332 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-LiveMigrationNegativeTest-1166587887-project Oct 05 02:29:40.789332 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:29:40.789332 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 4125f403-0514-4a60-983f-51f76c7b99cb could not be found. Oct 05 02:29:40.789332 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '4125f403-0514-4a60-983f-51f76c7b99cb'} Oct 05 02:29:40.790265 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:29:40.790265 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:29:40.790265 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:29:40.790265 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:29:40.790265 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:29:40.790265 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:29:40.790265 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:29:40.790265 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:29:40.790265 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:29:40.790265 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:29:40.790265 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4125f403-0514-4a60-983f-51f76c7b99cb could not be found. Oct 05 02:29:40.790265 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:29:40.790265 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:29:40.790265 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:29:40.790265 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:29:40.790265 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:29:40.790265 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:29:40.790265 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:29:40.790265 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:29:40.790265 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:29:40.791665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:29:40.791665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:29:40.791665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:29:40.791665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:29:40.791665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:29:40.791665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:29:40.791665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:29:40.791665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4125f403-0514-4a60-983f-51f76c7b99cb could not be found. Oct 05 02:29:40.791665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:29:40.791665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:29:40.791665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:29:40.791665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:29:40.791665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:29:40.791665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:29:40.791665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:29:40.791665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:29:40.791665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4125f403-0514-4a60-983f-51f76c7b99cb could not be found. Oct 05 02:29:40.791665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:29:40.794048 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e1d96224-1be0-4768-a016-b7d1221d574a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Returning 404 to user: Instance 4125f403-0514-4a60-983f-51f76c7b99cb could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:29:40.806469 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e1d96224-1be0-4768-a016-b7d1221d574a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] 10.222.0.16 "GET /compute/v2.1/servers/4125f403-0514-4a60-983f-51f76c7b99cb" status: 404 len: 111 microversion: 2.1 time: 0.096549 Oct 05 02:29:40.809546 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 348/696] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:40 2022] GET /compute/v2.1/servers/4125f403-0514-4a60-983f-51f76c7b99cb => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:29:40.820012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9c523516-53c9-4fba-9a90-3c798f1f0578 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:40.821317 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9c523516-53c9-4fba-9a90-3c798f1f0578 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 04eb32f6-e354-4960-8e0b-0a0e20dcfe04] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:40.835134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c523516-53c9-4fba-9a90-3c798f1f0578 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:40.845590 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c523516-53c9-4fba-9a90-3c798f1f0578 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:40.846191 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c523516-53c9-4fba-9a90-3c798f1f0578 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:40.846958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c523516-53c9-4fba-9a90-3c798f1f0578 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:40.847428 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c523516-53c9-4fba-9a90-3c798f1f0578 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:40.847860 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c523516-53c9-4fba-9a90-3c798f1f0578 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:40.903783 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9c523516-53c9-4fba-9a90-3c798f1f0578 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 04eb32f6-e354-4960-8e0b-0a0e20dcfe04] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:29:41.119956 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9c523516-53c9-4fba-9a90-3c798f1f0578 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] 10.222.0.16 "DELETE /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04" status: 204 len: 0 microversion: 2.1 time: 0.302110 Oct 05 02:29:41.129557 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 349/697] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:29:40 2022] DELETE /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:29:41.131779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6917996f-0ac7-4b8b-863e-6729e9eeca78 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:41.132622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6917996f-0ac7-4b8b-863e-6729e9eeca78 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 04eb32f6-e354-4960-8e0b-0a0e20dcfe04] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:41.142373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6917996f-0ac7-4b8b-863e-6729e9eeca78 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:41.146698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6917996f-0ac7-4b8b-863e-6729e9eeca78 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:41.147408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6917996f-0ac7-4b8b-863e-6729e9eeca78 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:41.149439 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6917996f-0ac7-4b8b-863e-6729e9eeca78 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:41.153572 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6917996f-0ac7-4b8b-863e-6729e9eeca78 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:41.154362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6917996f-0ac7-4b8b-863e-6729e9eeca78 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:41.365886 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-48b84eda-a824-4f45-948a-425b668e683c tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:41.366597 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-48b84eda-a824-4f45-948a-425b668e683c tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] [instance: 2e297761-81b8-4084-938d-7e097b32cd44] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:41.381289 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48b84eda-a824-4f45-948a-425b668e683c tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:41.388173 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48b84eda-a824-4f45-948a-425b668e683c tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:41.390159 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48b84eda-a824-4f45-948a-425b668e683c tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:41.393744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48b84eda-a824-4f45-948a-425b668e683c tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:41.395065 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48b84eda-a824-4f45-948a-425b668e683c tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:41.398894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48b84eda-a824-4f45-948a-425b668e683c tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:41.804382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6917996f-0ac7-4b8b-863e-6729e9eeca78 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d53045696469487a6be6640b07f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a87f178aedc4acbb4bd353bc09a7cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:41.807958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-48b84eda-a824-4f45-948a-425b668e683c tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000b799366da44838465be08b88fb27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e7bf1499e6408da408d85bddc4d95b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:41.817704 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6917996f-0ac7-4b8b-863e-6729e9eeca78 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] 10.222.0.16 "GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04" status: 200 len: 1474 microversion: 2.1 time: 0.689583 Oct 05 02:29:41.822252 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 349/698] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:41 2022] GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04 => generated 1474 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:41.824276 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-48b84eda-a824-4f45-948a-425b668e683c tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44" status: 200 len: 1312 microversion: 2.1 time: 0.464182 Oct 05 02:29:41.824855 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 350/699] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:41 2022] GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44 => generated 1312 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:29:41.840858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-541be2ef-5540-4a28-a880-55ee54a4b49d tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:41.842137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-541be2ef-5540-4a28-a880-55ee54a4b49d tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] [instance: 4be4b86a-17b7-49a6-b630-1972adc25deb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:41.850569 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-541be2ef-5540-4a28-a880-55ee54a4b49d tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:41.851436 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-541be2ef-5540-4a28-a880-55ee54a4b49d tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:41.851776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1ee88422-a871-4a99-8597-0a792a729c0f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:41.852366 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-541be2ef-5540-4a28-a880-55ee54a4b49d tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:41.852488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1ee88422-a871-4a99-8597-0a792a729c0f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:41.857990 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-541be2ef-5540-4a28-a880-55ee54a4b49d tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:41.858812 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-541be2ef-5540-4a28-a880-55ee54a4b49d tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:41.859483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-541be2ef-5540-4a28-a880-55ee54a4b49d tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:41.861696 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1ee88422-a871-4a99-8597-0a792a729c0f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:41.862206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1ee88422-a871-4a99-8597-0a792a729c0f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:41.862833 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1ee88422-a871-4a99-8597-0a792a729c0f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:41.863847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1ee88422-a871-4a99-8597-0a792a729c0f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:41.864936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1ee88422-a871-4a99-8597-0a792a729c0f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:41.866004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1ee88422-a871-4a99-8597-0a792a729c0f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:42.663666 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-541be2ef-5540-4a28-a880-55ee54a4b49d tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005a727f85c54471b45488b0f1d394e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449ddfb8f22f49a7a294de5f5ef08531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:42.684105 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-541be2ef-5540-4a28-a880-55ee54a4b49d tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] 10.222.0.16 "GET /compute/v2.1/servers/4be4b86a-17b7-49a6-b630-1972adc25deb" status: 200 len: 1323 microversion: 2.1 time: 0.851454 Oct 05 02:29:42.686513 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 351/700] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:41 2022] GET /compute/v2.1/servers/4be4b86a-17b7-49a6-b630-1972adc25deb => generated 1323 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:42.703412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-74edd167-6176-45c8-9692-5104afb7e2f7 req-ad434dd2-c68f-4403-8376-31a2a237df9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be4b86a-17b7-49a6-b630-1972adc25deb", "name": "network-vif-plugged", "status": "completed", "tag": "ec1249bd-947f-457d-8a78-0483e5e79c65"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:42.710914 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1ee88422-a871-4a99-8597-0a792a729c0f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:42.727868 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1ee88422-a871-4a99-8597-0a792a729c0f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9" status: 200 len: 1505 microversion: 2.1 time: 0.897368 Oct 05 02:29:42.728659 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 350/701] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:41 2022] GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 => generated 1505 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:42.752563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c696713e-5c8b-41ce-92e5-ca0c9792822e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-442382646", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "9671ab97-ec52-4c80-a228-74cde59af3af"}], "security_groups": [{"name": "tempest-securitygroup--1839403614"}], "key_name": "tempest-keypair-1679652780", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:42.757776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-74edd167-6176-45c8-9692-5104afb7e2f7 req-ad434dd2-c68f-4403-8376-31a2a237df9d service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:42.759245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-74edd167-6176-45c8-9692-5104afb7e2f7 req-ad434dd2-c68f-4403-8376-31a2a237df9d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:42.762316 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-74edd167-6176-45c8-9692-5104afb7e2f7 req-ad434dd2-c68f-4403-8376-31a2a237df9d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:42.793831 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-74edd167-6176-45c8-9692-5104afb7e2f7 req-ad434dd2-c68f-4403-8376-31a2a237df9d service nova] Creating event network-vif-plugged:ec1249bd-947f-457d-8a78-0483e5e79c65 for instance 4be4b86a-17b7-49a6-b630-1972adc25deb on n-h1-858272-3 Oct 05 02:29:42.811336 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-74edd167-6176-45c8-9692-5104afb7e2f7 req-ad434dd2-c68f-4403-8376-31a2a237df9d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122378 Oct 05 02:29:42.812211 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 352/702] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:42.851431 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-95246a19-c1ac-48cb-a3eb-2fd9aa6d30cc tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:42.852209 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-95246a19-c1ac-48cb-a3eb-2fd9aa6d30cc tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 04eb32f6-e354-4960-8e0b-0a0e20dcfe04] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:42.867035 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-95246a19-c1ac-48cb-a3eb-2fd9aa6d30cc tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:42.867641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-95246a19-c1ac-48cb-a3eb-2fd9aa6d30cc tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:42.868173 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-95246a19-c1ac-48cb-a3eb-2fd9aa6d30cc tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:42.869006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-95246a19-c1ac-48cb-a3eb-2fd9aa6d30cc tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:42.869537 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-95246a19-c1ac-48cb-a3eb-2fd9aa6d30cc tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:42.870222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-95246a19-c1ac-48cb-a3eb-2fd9aa6d30cc tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:43.475575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-c696713e-5c8b-41ce-92e5-ca0c9792822e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] validate_networks() for [('9671ab97-ec52-4c80-a228-74cde59af3af', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:29:44.168732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-95246a19-c1ac-48cb-a3eb-2fd9aa6d30cc tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d53045696469487a6be6640b07f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a87f178aedc4acbb4bd353bc09a7cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:44.193137 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-95246a19-c1ac-48cb-a3eb-2fd9aa6d30cc tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] 10.222.0.16 "GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04" status: 200 len: 1474 microversion: 2.1 time: 1.335272 Oct 05 02:29:44.194734 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 353/703] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:42 2022] GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04 => generated 1474 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:44.208953 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-53fb86f1-5586-4700-ad8d-3cef546c194b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:44.210019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-53fb86f1-5586-4700-ad8d-3cef546c194b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] [instance: 2e297761-81b8-4084-938d-7e097b32cd44] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:44.228258 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53fb86f1-5586-4700-ad8d-3cef546c194b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:44.229273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53fb86f1-5586-4700-ad8d-3cef546c194b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:44.229904 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53fb86f1-5586-4700-ad8d-3cef546c194b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:44.231511 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53fb86f1-5586-4700-ad8d-3cef546c194b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:44.234902 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53fb86f1-5586-4700-ad8d-3cef546c194b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:44.236932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53fb86f1-5586-4700-ad8d-3cef546c194b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:44.715748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-53fb86f1-5586-4700-ad8d-3cef546c194b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000b799366da44838465be08b88fb27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e7bf1499e6408da408d85bddc4d95b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:44.733834 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-53fb86f1-5586-4700-ad8d-3cef546c194b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44" status: 200 len: 1312 microversion: 2.1 time: 0.534413 Oct 05 02:29:44.738104 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 354/704] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:44 2022] GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44 => generated 1312 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:44.750252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c606e412-ae75-4f9a-b27c-d3264df0bf20 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:44.758440 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c606e412-ae75-4f9a-b27c-d3264df0bf20 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] [instance: 4be4b86a-17b7-49a6-b630-1972adc25deb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:44.777067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c606e412-ae75-4f9a-b27c-d3264df0bf20 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:44.778874 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c606e412-ae75-4f9a-b27c-d3264df0bf20 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:44.779609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c606e412-ae75-4f9a-b27c-d3264df0bf20 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:44.780623 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c606e412-ae75-4f9a-b27c-d3264df0bf20 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:44.801958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c606e412-ae75-4f9a-b27c-d3264df0bf20 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:44.802522 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c606e412-ae75-4f9a-b27c-d3264df0bf20 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:45.177360 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-c696713e-5c8b-41ce-92e5-ca0c9792822e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:29:45.178348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-c696713e-5c8b-41ce-92e5-ca0c9792822e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:29:45.178841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-c696713e-5c8b-41ce-92e5-ca0c9792822e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:29:45.179245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-c696713e-5c8b-41ce-92e5-ca0c9792822e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:29:45.179846 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-c696713e-5c8b-41ce-92e5-ca0c9792822e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:29:45.195039 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c696713e-5c8b-41ce-92e5-ca0c9792822e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:45.203005 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c696713e-5c8b-41ce-92e5-ca0c9792822e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:45.203543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c696713e-5c8b-41ce-92e5-ca0c9792822e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:45.204874 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c696713e-5c8b-41ce-92e5-ca0c9792822e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:45.205633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c696713e-5c8b-41ce-92e5-ca0c9792822e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:45.206361 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c696713e-5c8b-41ce-92e5-ca0c9792822e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:45.290017 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-c696713e-5c8b-41ce-92e5-ca0c9792822e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Getting quotas for project bbd25b0a68f749029eeed701c77462ce. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:29:45.300022 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-c696713e-5c8b-41ce-92e5-ca0c9792822e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Getting quotas for user 39671ba0b86847f995c96013947fee65 and project bbd25b0a68f749029eeed701c77462ce. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:29:45.315313 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c606e412-ae75-4f9a-b27c-d3264df0bf20 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005a727f85c54471b45488b0f1d394e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449ddfb8f22f49a7a294de5f5ef08531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:45.320739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:45.326653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c696713e-5c8b-41ce-92e5-ca0c9792822e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:29:45.330197 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c696713e-5c8b-41ce-92e5-ca0c9792822e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:29:45.334385 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c606e412-ae75-4f9a-b27c-d3264df0bf20 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] 10.222.0.16 "GET /compute/v2.1/servers/4be4b86a-17b7-49a6-b630-1972adc25deb" status: 200 len: 1323 microversion: 2.1 time: 0.594568 Oct 05 02:29:45.341570 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 355/705] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:44 2022] GET /compute/v2.1/servers/4be4b86a-17b7-49a6-b630-1972adc25deb => generated 1323 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:45.353012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c83b785c-9cd3-42d6-a71d-b074dde43b73 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:45.356724 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c83b785c-9cd3-42d6-a71d-b074dde43b73 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:45.377113 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c83b785c-9cd3-42d6-a71d-b074dde43b73 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:45.377868 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c83b785c-9cd3-42d6-a71d-b074dde43b73 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:45.378382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c83b785c-9cd3-42d6-a71d-b074dde43b73 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:45.379050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c83b785c-9cd3-42d6-a71d-b074dde43b73 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:45.379512 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c83b785c-9cd3-42d6-a71d-b074dde43b73 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:45.379940 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c83b785c-9cd3-42d6-a71d-b074dde43b73 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:45.420754 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c696713e-5c8b-41ce-92e5-ca0c9792822e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 2.679160 Oct 05 02:29:45.423574 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 351/706] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 5 02:29:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 2693 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 05 02:29:45.487091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-325c496c-d967-4be4-8f02-79a15447e96e req-bcd13756-9895-4abe-8470-0ba4195de5ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04eb32f6-e354-4960-8e0b-0a0e20dcfe04", "name": "network-vif-deleted", "tag": "93d69049-27c8-4ca0-af05-bcca725b246b"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:45.526322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-325c496c-d967-4be4-8f02-79a15447e96e req-bcd13756-9895-4abe-8470-0ba4195de5ca service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:45.527050 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-325c496c-d967-4be4-8f02-79a15447e96e req-bcd13756-9895-4abe-8470-0ba4195de5ca service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:45.527648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-325c496c-d967-4be4-8f02-79a15447e96e req-bcd13756-9895-4abe-8470-0ba4195de5ca service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:45.546606 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-325c496c-d967-4be4-8f02-79a15447e96e req-bcd13756-9895-4abe-8470-0ba4195de5ca service nova] Creating event network-vif-deleted:93d69049-27c8-4ca0-af05-bcca725b246b for instance 04eb32f6-e354-4960-8e0b-0a0e20dcfe04 on n-h2-858272-3 Oct 05 02:29:45.560747 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-325c496c-d967-4be4-8f02-79a15447e96e req-bcd13756-9895-4abe-8470-0ba4195de5ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134803 Oct 05 02:29:45.564534 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 352/707] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:45.582292 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-58d1f7e2-7e2a-432e-967f-a4e81009030a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:45.583803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-58d1f7e2-7e2a-432e-967f-a4e81009030a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 04eb32f6-e354-4960-8e0b-0a0e20dcfe04] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:45.601200 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58d1f7e2-7e2a-432e-967f-a4e81009030a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:45.603372 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58d1f7e2-7e2a-432e-967f-a4e81009030a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:45.605538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58d1f7e2-7e2a-432e-967f-a4e81009030a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:45.606887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58d1f7e2-7e2a-432e-967f-a4e81009030a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:45.610634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58d1f7e2-7e2a-432e-967f-a4e81009030a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:45.611328 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58d1f7e2-7e2a-432e-967f-a4e81009030a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:45.732850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58d1f7e2-7e2a-432e-967f-a4e81009030a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:45.733999 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58d1f7e2-7e2a-432e-967f-a4e81009030a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:45.736392 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58d1f7e2-7e2a-432e-967f-a4e81009030a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:45.736943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-58d1f7e2-7e2a-432e-967f-a4e81009030a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lazy-loading 'fault' on Instance uuid 04eb32f6-e354-4960-8e0b-0a0e20dcfe04 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:29:46.099170 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c83b785c-9cd3-42d6-a71d-b074dde43b73 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:46.118457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-58d1f7e2-7e2a-432e-967f-a4e81009030a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5d53045696469487a6be6640b07f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a87f178aedc4acbb4bd353bc09a7cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:46.123626 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c83b785c-9cd3-42d6-a71d-b074dde43b73 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9" status: 200 len: 1505 microversion: 2.1 time: 0.780534 Oct 05 02:29:46.124786 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 356/708] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:45 2022] GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 => generated 1505 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:46.134528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ec8bc6ad-2c6b-49ea-8d3b-24a000814d86 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:46.135645 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ec8bc6ad-2c6b-49ea-8d3b-24a000814d86 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:46.150220 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-58d1f7e2-7e2a-432e-967f-a4e81009030a tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] 10.222.0.16 "GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04" status: 200 len: 1308 microversion: 2.1 time: 0.563361 Oct 05 02:29:46.163405 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 353/709] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:45 2022] GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04 => generated 1308 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:46.173157 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-48163189-2c3c-4c0b-9db0-2d0c0b52ac99 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:46.178237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-48163189-2c3c-4c0b-9db0-2d0c0b52ac99 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] [instance: 2e297761-81b8-4084-938d-7e097b32cd44] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:46.192695 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48163189-2c3c-4c0b-9db0-2d0c0b52ac99 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:46.193217 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48163189-2c3c-4c0b-9db0-2d0c0b52ac99 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:46.194813 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48163189-2c3c-4c0b-9db0-2d0c0b52ac99 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:46.197083 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48163189-2c3c-4c0b-9db0-2d0c0b52ac99 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:46.200627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48163189-2c3c-4c0b-9db0-2d0c0b52ac99 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:46.201454 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48163189-2c3c-4c0b-9db0-2d0c0b52ac99 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:46.431203 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ec8bc6ad-2c6b-49ea-8d3b-24a000814d86 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:46.443455 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ec8bc6ad-2c6b-49ea-8d3b-24a000814d86 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:46.446384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ec8bc6ad-2c6b-49ea-8d3b-24a000814d86 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:46.448015 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ec8bc6ad-2c6b-49ea-8d3b-24a000814d86 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1285 microversion: 2.25 time: 0.321605 Oct 05 02:29:46.449778 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 357/710] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:29:46 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1285 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:29:46.457933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-6c970d24-72dc-4792-8ba7-8f7d0d17ab35 req-3f4e78b0-afa7-4e49-aa1c-c86e092d6265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e297761-81b8-4084-938d-7e097b32cd44", "name": "network-vif-plugged", "status": "completed", "tag": "474e574e-c9b6-4fe3-a2ae-1181ef3204c8"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:46.472955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6c970d24-72dc-4792-8ba7-8f7d0d17ab35 req-3f4e78b0-afa7-4e49-aa1c-c86e092d6265 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:46.473832 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6c970d24-72dc-4792-8ba7-8f7d0d17ab35 req-3f4e78b0-afa7-4e49-aa1c-c86e092d6265 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:46.474336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6c970d24-72dc-4792-8ba7-8f7d0d17ab35 req-3f4e78b0-afa7-4e49-aa1c-c86e092d6265 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:46.493777 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-6c970d24-72dc-4792-8ba7-8f7d0d17ab35 req-3f4e78b0-afa7-4e49-aa1c-c86e092d6265 service nova] Creating event network-vif-plugged:474e574e-c9b6-4fe3-a2ae-1181ef3204c8 for instance 2e297761-81b8-4084-938d-7e097b32cd44 on n-h2-858272-3 Oct 05 02:29:46.503083 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-6c970d24-72dc-4792-8ba7-8f7d0d17ab35 req-3f4e78b0-afa7-4e49-aa1c-c86e092d6265 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051712 Oct 05 02:29:46.505522 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 358/711] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:46.515616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-32edb612-5015-4a9f-99a0-e384beb59cf8 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:46.517785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-32edb612-5015-4a9f-99a0-e384beb59cf8 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] [instance: 4be4b86a-17b7-49a6-b630-1972adc25deb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:46.537168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32edb612-5015-4a9f-99a0-e384beb59cf8 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:46.537950 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32edb612-5015-4a9f-99a0-e384beb59cf8 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:46.538629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32edb612-5015-4a9f-99a0-e384beb59cf8 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:46.539574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32edb612-5015-4a9f-99a0-e384beb59cf8 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:46.540260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32edb612-5015-4a9f-99a0-e384beb59cf8 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:46.542079 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32edb612-5015-4a9f-99a0-e384beb59cf8 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:46.623983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-48163189-2c3c-4c0b-9db0-2d0c0b52ac99 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000b799366da44838465be08b88fb27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e7bf1499e6408da408d85bddc4d95b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:46.640339 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-48163189-2c3c-4c0b-9db0-2d0c0b52ac99 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44" status: 200 len: 1312 microversion: 2.1 time: 0.475364 Oct 05 02:29:46.640957 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 354/712] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:46 2022] GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44 => generated 1312 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:46.873287 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-32edb612-5015-4a9f-99a0-e384beb59cf8 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005a727f85c54471b45488b0f1d394e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449ddfb8f22f49a7a294de5f5ef08531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:46.882321 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-32edb612-5015-4a9f-99a0-e384beb59cf8 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] 10.222.0.16 "GET /compute/v2.1/servers/4be4b86a-17b7-49a6-b630-1972adc25deb" status: 200 len: 1473 microversion: 2.1 time: 0.374587 Oct 05 02:29:46.882917 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 359/713] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:46 2022] GET /compute/v2.1/servers/4be4b86a-17b7-49a6-b630-1972adc25deb => generated 1473 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:46.909200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4d58f0f2-1eb1-4618-b89b-06292b705771 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:46.910476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4d58f0f2-1eb1-4618-b89b-06292b705771 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] [instance: 4be4b86a-17b7-49a6-b630-1972adc25deb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:46.920742 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d58f0f2-1eb1-4618-b89b-06292b705771 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:46.921272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d58f0f2-1eb1-4618-b89b-06292b705771 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:46.922019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d58f0f2-1eb1-4618-b89b-06292b705771 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:46.923521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d58f0f2-1eb1-4618-b89b-06292b705771 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:46.924238 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d58f0f2-1eb1-4618-b89b-06292b705771 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:46.925022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d58f0f2-1eb1-4618-b89b-06292b705771 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:46.953161 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4d58f0f2-1eb1-4618-b89b-06292b705771 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '005a727f85c54471b45488b0f1d394e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449ddfb8f22f49a7a294de5f5ef08531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:46.961413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4d58f0f2-1eb1-4618-b89b-06292b705771 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Request method failure captured: Oct 05 02:29:46.961413 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/4be4b86a-17b7-49a6-b630-1972adc25deb/diagnostics HTTP/1.1 Oct 05 02:29:46.961413 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:29:46.961413 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:29:46.961413 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:29:46.961413 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:29:46.961413 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:29:46.961413 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:29:46.961413 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:29:46.961413 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:29:46.961413 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOwCwyDuO12YozpVbwGOdNKmNlcX_Bh-dzTQ_92Aew1V2H2PqNY8Pb275lu0yUKhn2hYNWnujZ13eroQm6vVYDFxElZTZYU3tzUjmtDnbz0_NJZw2IBVlR2GExeiwJDGn6l3hsHJLgyKC9O187bHzOtrQxuYIEmPh_oc66xjI4n22s4 Oct 05 02:29:46.961413 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:29:46.961413 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:29:46.961413 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:29:46.961413 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:29:46.961413 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:29:46.961413 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:29:46.961413 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 449ddfb8f22f49a7a294de5f5ef08531 Oct 05 02:29:46.961413 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1984663008 Oct 05 02:29:46.961413 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:29:46.961413 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:29:46.963133 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/449ddfb8f22f49a7a294de5f5ef08531"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/449ddfb8f22f49a7a294de5f5ef08531"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/449ddfb8f22f49a7a294de5f5ef08531"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_449ddfb8f22f49a7a294de5f5ef08531"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:29:46.963133 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1984663008 Oct 05 02:29:46.963133 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 449ddfb8f22f49a7a294de5f5ef08531 Oct 05 02:29:46.963133 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1984663008 Oct 05 02:29:46.963133 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerDiagnosticsNegativeTest-1984663008-project Oct 05 02:29:46.963133 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:29:46.963133 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:29:46.963133 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 005a727f85c54471b45488b0f1d394e1 Oct 05 02:29:46.963133 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1984663008-project Oct 05 02:29:46.963133 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:29:46.963133 n-d-858272-3 devstack@n-api.service[122319]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 05 02:29:46.963966 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'server_id': '4be4b86a-17b7-49a6-b630-1972adc25deb'} Oct 05 02:29:46.963966 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:29:46.963966 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:29:46.963966 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:29:46.963966 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:29:46.963966 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:29:46.963966 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:29:46.963966 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:29:46.963966 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:29:46.963966 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 05 02:29:46.963966 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 05 02:29:46.963966 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 02:29:46.963966 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 02:29:46.963966 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 02:29:46.963966 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 02:29:46.963966 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:29:46.963966 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:29:46.963966 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:29:46.963966 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:29:46.963966 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 02:29:46.965341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 02:29:46.965341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 02:29:46.965341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 02:29:46.965341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:29:46.965341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 02:29:46.965341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 05 02:29:46.965341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:29:46.965341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:29:46.965341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:29:46.965341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:29:46.965341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:29:46.965341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:29:46.965341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 02:29:46.965341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 02:29:46.965341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 05 02:29:46.965341 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:29:46.965341 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4d58f0f2-1eb1-4618-b89b-06292b705771 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:29:46.966448 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4d58f0f2-1eb1-4618-b89b-06292b705771 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] 10.222.0.16 "GET /compute/v2.1/servers/4be4b86a-17b7-49a6-b630-1972adc25deb/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.059173 Oct 05 02:29:46.966448 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 360/714] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:29:46 2022] GET /compute/v2.1/servers/4be4b86a-17b7-49a6-b630-1972adc25deb/diagnostics => generated 117 bytes in 60 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:29:46.973901 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-81d68ddb-529c-4496-91c3-89fa11c88be8 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:46.974398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-81d68ddb-529c-4496-91c3-89fa11c88be8 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] [instance: 4be4b86a-17b7-49a6-b630-1972adc25deb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:46.981463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81d68ddb-529c-4496-91c3-89fa11c88be8 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:46.981969 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81d68ddb-529c-4496-91c3-89fa11c88be8 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:46.982640 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81d68ddb-529c-4496-91c3-89fa11c88be8 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:46.983361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81d68ddb-529c-4496-91c3-89fa11c88be8 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:46.984166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81d68ddb-529c-4496-91c3-89fa11c88be8 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:46.984398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81d68ddb-529c-4496-91c3-89fa11c88be8 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:47.015460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-81d68ddb-529c-4496-91c3-89fa11c88be8 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] [instance: 4be4b86a-17b7-49a6-b630-1972adc25deb] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:29:47.128824 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-81d68ddb-529c-4496-91c3-89fa11c88be8 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4be4b86a-17b7-49a6-b630-1972adc25deb" status: 204 len: 0 microversion: 2.1 time: 0.159301 Oct 05 02:29:47.129771 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 361/715] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:29:46 2022] DELETE /compute/v2.1/servers/4be4b86a-17b7-49a6-b630-1972adc25deb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 02:29:47.143616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-28a25773-8f73-48db-ac44-04e2a69e012f tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:47.144238 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-28a25773-8f73-48db-ac44-04e2a69e012f tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] [instance: 4be4b86a-17b7-49a6-b630-1972adc25deb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:47.153223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28a25773-8f73-48db-ac44-04e2a69e012f tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:47.153933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28a25773-8f73-48db-ac44-04e2a69e012f tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:47.154329 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28a25773-8f73-48db-ac44-04e2a69e012f tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:47.155117 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28a25773-8f73-48db-ac44-04e2a69e012f tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:47.155698 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28a25773-8f73-48db-ac44-04e2a69e012f tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:47.156199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28a25773-8f73-48db-ac44-04e2a69e012f tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:47.173902 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dbc3566a-a662-42bb-af22-dba6b38dae8c tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Action: 'create', calling method: .version_select at 0x7fcce418a9d0>, body: {"keypair": {"name": "tempest-keypair-208474523", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqA045JK7h593yLJVfW53dbhmX+iIoMeoMnUICTcAvDcAu+K40WSPA6nd77rNbMVICprdPi3smawK8bCinOJtIxICUcs+wwXLlF1NdvOE17xqSGWNZhx/ZUF2539dZ/Sw=="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:47.200068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-dbc3566a-a662-42bb-af22-dba6b38dae8c tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Getting quotas for project 407895b8d4e94b74a2cb652eb2c30048. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:29:47.210993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-dbc3566a-a662-42bb-af22-dba6b38dae8c tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Getting quotas for user f914ca523057422f88748746ba18b525 and project 407895b8d4e94b74a2cb652eb2c30048. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:29:47.256848 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dbc3566a-a662-42bb-af22-dba6b38dae8c tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.378663 Oct 05 02:29:47.257487 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 355/716] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 02:29:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:47.274490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-704b9a8b-5be1-486f-b617-f42646bdc444 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:47.275507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-704b9a8b-5be1-486f-b617-f42646bdc444 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:47.294720 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-704b9a8b-5be1-486f-b617-f42646bdc444 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:47.296371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-704b9a8b-5be1-486f-b617-f42646bdc444 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:47.296943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-704b9a8b-5be1-486f-b617-f42646bdc444 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:47.299195 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-704b9a8b-5be1-486f-b617-f42646bdc444 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:47.300002 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-704b9a8b-5be1-486f-b617-f42646bdc444 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:47.300632 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-704b9a8b-5be1-486f-b617-f42646bdc444 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:47.380891 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-28a25773-8f73-48db-ac44-04e2a69e012f tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005a727f85c54471b45488b0f1d394e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449ddfb8f22f49a7a294de5f5ef08531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:47.389679 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-28a25773-8f73-48db-ac44-04e2a69e012f tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] 10.222.0.16 "GET /compute/v2.1/servers/4be4b86a-17b7-49a6-b630-1972adc25deb" status: 200 len: 1479 microversion: 2.1 time: 0.254215 Oct 05 02:29:47.402392 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 362/717] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:47 2022] GET /compute/v2.1/servers/4be4b86a-17b7-49a6-b630-1972adc25deb => generated 1479 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:29:47.408471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bdfe6b87-57a8-4fb3-b80e-486b623b1af7 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:47.409105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bdfe6b87-57a8-4fb3-b80e-486b623b1af7 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] [instance: 04eb32f6-e354-4960-8e0b-0a0e20dcfe04] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:47.429475 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bdfe6b87-57a8-4fb3-b80e-486b623b1af7 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:47.430311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bdfe6b87-57a8-4fb3-b80e-486b623b1af7 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:47.431129 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bdfe6b87-57a8-4fb3-b80e-486b623b1af7 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:47.432185 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bdfe6b87-57a8-4fb3-b80e-486b623b1af7 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:47.433470 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bdfe6b87-57a8-4fb3-b80e-486b623b1af7 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:47.434672 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bdfe6b87-57a8-4fb3-b80e-486b623b1af7 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:47.451956 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-bdfe6b87-57a8-4fb3-b80e-486b623b1af7 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] HTTP exception thrown: Instance 04eb32f6-e354-4960-8e0b-0a0e20dcfe04 could not be found. Oct 05 02:29:47.454489 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bdfe6b87-57a8-4fb3-b80e-486b623b1af7 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Request method failure captured: Oct 05 02:29:47.454489 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04 HTTP/1.1 Oct 05 02:29:47.454489 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:29:47.454489 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:29:47.454489 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:29:47.454489 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:29:47.454489 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:29:47.454489 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:29:47.454489 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:29:47.454489 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:29:47.454489 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOvPq5SqPyWzzBPGtjIjMKB9r8wMt9btuKjjOs6rKhD-ukaqJFEMJB_lmF0XS6pE4S5aMKnAXsaZ-Sjf0FO-7iHc6ueCICM1rqP2aRtO5AqJkN9hOWfTcyT7KROIu90D0KygtQmRe2rSsVdmwridXRx_I06H4jxzbTKAGo9uriG3750 Oct 05 02:29:47.454489 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:29:47.454489 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:29:47.454489 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:29:47.454489 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:29:47.454489 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:29:47.454489 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:29:47.454489 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 7a87f178aedc4acbb4bd353bc09a7cb3 Oct 05 02:29:47.454489 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-LiveMigrationNegativeTest-1166587887 Oct 05 02:29:47.454489 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:29:47.454489 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:29:47.456025 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7a87f178aedc4acbb4bd353bc09a7cb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7a87f178aedc4acbb4bd353bc09a7cb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7a87f178aedc4acbb4bd353bc09a7cb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7a87f178aedc4acbb4bd353bc09a7cb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:29:47.456025 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-LiveMigrationNegativeTest-1166587887 Oct 05 02:29:47.456025 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 7a87f178aedc4acbb4bd353bc09a7cb3 Oct 05 02:29:47.456025 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1166587887 Oct 05 02:29:47.456025 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-LiveMigrationNegativeTest-1166587887-project Oct 05 02:29:47.456025 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:29:47.456025 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:29:47.456025 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 1d5d53045696469487a6be6640b07f6e Oct 05 02:29:47.456025 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-LiveMigrationNegativeTest-1166587887-project Oct 05 02:29:47.456025 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:29:47.456025 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 04eb32f6-e354-4960-8e0b-0a0e20dcfe04 could not be found. Oct 05 02:29:47.456025 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '04eb32f6-e354-4960-8e0b-0a0e20dcfe04'} Oct 05 02:29:47.456983 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:29:47.456983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:29:47.456983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:29:47.456983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:29:47.456983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:29:47.456983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:29:47.456983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:29:47.456983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:29:47.456983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:29:47.456983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:29:47.456983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04eb32f6-e354-4960-8e0b-0a0e20dcfe04 could not be found. Oct 05 02:29:47.456983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:29:47.456983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:29:47.456983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:29:47.456983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:29:47.456983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:29:47.456983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:29:47.456983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:29:47.456983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:29:47.456983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:29:47.458433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:29:47.458433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:29:47.458433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:29:47.458433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:29:47.458433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:29:47.458433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:29:47.458433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:29:47.458433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04eb32f6-e354-4960-8e0b-0a0e20dcfe04 could not be found. Oct 05 02:29:47.458433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:29:47.458433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:29:47.458433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:29:47.458433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:29:47.458433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:29:47.458433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:29:47.458433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:29:47.458433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:29:47.458433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04eb32f6-e354-4960-8e0b-0a0e20dcfe04 could not be found. Oct 05 02:29:47.458433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:29:47.462765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bdfe6b87-57a8-4fb3-b80e-486b623b1af7 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] Returning 404 to user: Instance 04eb32f6-e354-4960-8e0b-0a0e20dcfe04 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:29:47.464082 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bdfe6b87-57a8-4fb3-b80e-486b623b1af7 tempest-LiveMigrationNegativeTest-1166587887 tempest-LiveMigrationNegativeTest-1166587887-project] 10.222.0.16 "GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04" status: 404 len: 111 microversion: 2.1 time: 0.060215 Oct 05 02:29:47.468242 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 363/718] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:47 2022] GET /compute/v2.1/servers/04eb32f6-e354-4960-8e0b-0a0e20dcfe04 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:29:47.477187 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b2f3cd36-c03a-430c-a2ed-323e036d7fec tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:47.477983 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b2f3cd36-c03a-430c-a2ed-323e036d7fec tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:47.492293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2f3cd36-c03a-430c-a2ed-323e036d7fec tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:47.493215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2f3cd36-c03a-430c-a2ed-323e036d7fec tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:47.493848 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2f3cd36-c03a-430c-a2ed-323e036d7fec tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:47.494749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2f3cd36-c03a-430c-a2ed-323e036d7fec tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:47.496142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2f3cd36-c03a-430c-a2ed-323e036d7fec tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:47.497116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2f3cd36-c03a-430c-a2ed-323e036d7fec tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:47.626057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b2f3cd36-c03a-430c-a2ed-323e036d7fec tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:47.637626 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b2f3cd36-c03a-430c-a2ed-323e036d7fec tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:47.640761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b2f3cd36-c03a-430c-a2ed-323e036d7fec tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:47.642396 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b2f3cd36-c03a-430c-a2ed-323e036d7fec tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1337 microversion: 2.25 time: 0.170320 Oct 05 02:29:47.660729 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 364/719] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:29:47 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1337 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:29:47.668440 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-39e59cd3-5b74-433a-b260-28ed17a367be tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:47.669357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-39e59cd3-5b74-433a-b260-28ed17a367be tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] [instance: 2e297761-81b8-4084-938d-7e097b32cd44] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:47.672885 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=96,nova_api:UPDATE=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:47.676964 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-39e59cd3-5b74-433a-b260-28ed17a367be tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:47.677702 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-39e59cd3-5b74-433a-b260-28ed17a367be tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:47.678387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-39e59cd3-5b74-433a-b260-28ed17a367be tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:47.679290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-39e59cd3-5b74-433a-b260-28ed17a367be tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:47.680030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-39e59cd3-5b74-433a-b260-28ed17a367be tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:47.680655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-39e59cd3-5b74-433a-b260-28ed17a367be tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:47.697883 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-704b9a8b-5be1-486f-b617-f42646bdc444 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:47.706693 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:47.708274 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-704b9a8b-5be1-486f-b617-f42646bdc444 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9" status: 200 len: 1495 microversion: 2.1 time: 0.449496 Oct 05 02:29:47.711059 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 356/720] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:47 2022] GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 => generated 1495 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:47.733715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9789fe35-a59c-490f-ad67-0192751dfbc0 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Calling method '.version_select at 0x7fcce4256c10>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:47.739933 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9789fe35-a59c-490f-ad67-0192751dfbc0 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:47.741777 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9789fe35-a59c-490f-ad67-0192751dfbc0 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:47.743464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9789fe35-a59c-490f-ad67-0192751dfbc0 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:47.785066 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9789fe35-a59c-490f-ad67-0192751dfbc0 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1166 microversion: 2.1 time: 0.055072 Oct 05 02:29:47.786431 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 357/721] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 5 02:29:47 2022] GET /compute/v2.1/os-migrations => generated 1166 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:29:47.812334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f75fbe3d-8d4a-4936-92a0-c40c4815aac1 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:47.815857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f75fbe3d-8d4a-4936-92a0-c40c4815aac1 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:47.826632 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f75fbe3d-8d4a-4936-92a0-c40c4815aac1 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:47.827572 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f75fbe3d-8d4a-4936-92a0-c40c4815aac1 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:47.828221 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f75fbe3d-8d4a-4936-92a0-c40c4815aac1 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:47.833334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f75fbe3d-8d4a-4936-92a0-c40c4815aac1 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:47.834091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f75fbe3d-8d4a-4936-92a0-c40c4815aac1 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:47.834685 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f75fbe3d-8d4a-4936-92a0-c40c4815aac1 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:48.020261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-39e59cd3-5b74-433a-b260-28ed17a367be tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000b799366da44838465be08b88fb27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e7bf1499e6408da408d85bddc4d95b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:48.036075 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-39e59cd3-5b74-433a-b260-28ed17a367be tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44" status: 200 len: 1312 microversion: 2.1 time: 0.372091 Oct 05 02:29:48.036974 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 365/722] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:47 2022] GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44 => generated 1312 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:29:48.088873 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f75fbe3d-8d4a-4936-92a0-c40c4815aac1 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9" status: 200 len: 1646 microversion: 2.1 time: 0.285775 Oct 05 02:29:48.089793 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 358/723] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:47 2022] GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 => generated 1646 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:48.250332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a651fe8b-ffdc-4bdd-9915-fc83fdb1a879 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-49904325", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "eeab81fe-da30-46f9-87be-0b6dd3f4b67b"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:48.322528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-a651fe8b-ffdc-4bdd-9915-fc83fdb1a879 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] validate_networks() for [('eeab81fe-da30-46f9-87be-0b6dd3f4b67b', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:29:48.423251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2f3fbb15-3b37-4d1d-a147-bd5ab47d9301 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:48.425594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2f3fbb15-3b37-4d1d-a147-bd5ab47d9301 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] [instance: 4be4b86a-17b7-49a6-b630-1972adc25deb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:48.440536 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f3fbb15-3b37-4d1d-a147-bd5ab47d9301 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:48.443300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f3fbb15-3b37-4d1d-a147-bd5ab47d9301 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:48.444112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f3fbb15-3b37-4d1d-a147-bd5ab47d9301 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:48.445037 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f3fbb15-3b37-4d1d-a147-bd5ab47d9301 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:48.447606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f3fbb15-3b37-4d1d-a147-bd5ab47d9301 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:48.448435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f3fbb15-3b37-4d1d-a147-bd5ab47d9301 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:49.227709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2f3fbb15-3b37-4d1d-a147-bd5ab47d9301 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005a727f85c54471b45488b0f1d394e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449ddfb8f22f49a7a294de5f5ef08531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:49.242157 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2f3fbb15-3b37-4d1d-a147-bd5ab47d9301 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] 10.222.0.16 "GET /compute/v2.1/servers/4be4b86a-17b7-49a6-b630-1972adc25deb" status: 200 len: 1479 microversion: 2.1 time: 0.827285 Oct 05 02:29:49.242742 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 359/724] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:48 2022] GET /compute/v2.1/servers/4be4b86a-17b7-49a6-b630-1972adc25deb => generated 1479 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:29:49.248136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fc68dec7-3ddd-491e-8eb7-48076fdaf5ed tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:49.251940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fc68dec7-3ddd-491e-8eb7-48076fdaf5ed tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:49.258672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc68dec7-3ddd-491e-8eb7-48076fdaf5ed tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:49.259569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc68dec7-3ddd-491e-8eb7-48076fdaf5ed tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:49.260252 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc68dec7-3ddd-491e-8eb7-48076fdaf5ed tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:49.261203 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc68dec7-3ddd-491e-8eb7-48076fdaf5ed tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:49.261888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc68dec7-3ddd-491e-8eb7-48076fdaf5ed tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:49.262521 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc68dec7-3ddd-491e-8eb7-48076fdaf5ed tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:49.396034 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fc68dec7-3ddd-491e-8eb7-48076fdaf5ed tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:49.408882 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fc68dec7-3ddd-491e-8eb7-48076fdaf5ed tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:49.411346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fc68dec7-3ddd-491e-8eb7-48076fdaf5ed tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:49.417181 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fc68dec7-3ddd-491e-8eb7-48076fdaf5ed tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1343 microversion: 2.25 time: 0.172974 Oct 05 02:29:49.418980 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 360/725] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:29:49 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1343 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:29:49.427076 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3562c9b7-333f-4893-a444-546547dbcace tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Calling method '.version_select at 0x7fcce4114700>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:49.498901 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3562c9b7-333f-4893-a444-546547dbcace tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] 10.222.0.16 "GET /compute/v2.1/images/5b16c5a0-3acf-479a-b49b-3c8aa65f4da0" status: 200 len: 637 microversion: 2.1 time: 0.078063 Oct 05 02:29:49.500048 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 361/726] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:29:49 2022] GET /compute/v2.1/images/5b16c5a0-3acf-479a-b49b-3c8aa65f4da0 => generated 637 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:49.514901 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ea922f6a-ad8a-420b-a08a-5914bf7e1555 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:49.515750 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ea922f6a-ad8a-420b-a08a-5914bf7e1555 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] [instance: 2e297761-81b8-4084-938d-7e097b32cd44] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:49.528326 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea922f6a-ad8a-420b-a08a-5914bf7e1555 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:49.528832 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea922f6a-ad8a-420b-a08a-5914bf7e1555 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:49.529299 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea922f6a-ad8a-420b-a08a-5914bf7e1555 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:49.530036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea922f6a-ad8a-420b-a08a-5914bf7e1555 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:49.530785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea922f6a-ad8a-420b-a08a-5914bf7e1555 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:49.530931 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea922f6a-ad8a-420b-a08a-5914bf7e1555 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:49.560962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-a651fe8b-ffdc-4bdd-9915-fc83fdb1a879 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:29:49.561568 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-a651fe8b-ffdc-4bdd-9915-fc83fdb1a879 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:29:49.563521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-a651fe8b-ffdc-4bdd-9915-fc83fdb1a879 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:29:49.564062 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-a651fe8b-ffdc-4bdd-9915-fc83fdb1a879 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:29:49.565987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-a651fe8b-ffdc-4bdd-9915-fc83fdb1a879 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:29:49.583504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a651fe8b-ffdc-4bdd-9915-fc83fdb1a879 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:49.584619 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a651fe8b-ffdc-4bdd-9915-fc83fdb1a879 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:49.585367 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a651fe8b-ffdc-4bdd-9915-fc83fdb1a879 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:49.587102 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a651fe8b-ffdc-4bdd-9915-fc83fdb1a879 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:49.588267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a651fe8b-ffdc-4bdd-9915-fc83fdb1a879 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:49.589061 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a651fe8b-ffdc-4bdd-9915-fc83fdb1a879 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:49.615960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-a651fe8b-ffdc-4bdd-9915-fc83fdb1a879 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Getting quotas for project 6652917123e14c2797cafacc4e31f75a. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:29:49.623175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-a651fe8b-ffdc-4bdd-9915-fc83fdb1a879 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Getting quotas for user 118c1425677b45b98689befb0eb55cce and project 6652917123e14c2797cafacc4e31f75a. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:29:49.639812 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a651fe8b-ffdc-4bdd-9915-fc83fdb1a879 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:29:49.644168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a651fe8b-ffdc-4bdd-9915-fc83fdb1a879 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:29:49.723451 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a651fe8b-ffdc-4bdd-9915-fc83fdb1a879 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.476970 Oct 05 02:29:49.725939 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 366/727] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:29:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 02:29:49.734941 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-253acf64-f575-419a-8216-a65c1c34db77 tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Action: 'update_all', calling method: .version_select at 0x7fcce429eaf0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:49.735303 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ea922f6a-ad8a-420b-a08a-5914bf7e1555 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000b799366da44838465be08b88fb27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e7bf1499e6408da408d85bddc4d95b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:49.753650 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ea922f6a-ad8a-420b-a08a-5914bf7e1555 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44" status: 200 len: 1498 microversion: 2.1 time: 0.252297 Oct 05 02:29:49.754237 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 362/728] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:49 2022] GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44 => generated 1498 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:49.772216 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4cf868ec-ac23-4e65-81c8-5121be4478aa tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:49.772861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4cf868ec-ac23-4e65-81c8-5121be4478aa tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:49.850246 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4cf868ec-ac23-4e65-81c8-5121be4478aa tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:49.860983 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4cf868ec-ac23-4e65-81c8-5121be4478aa tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1209 microversion: 2.1 time: 0.105685 Oct 05 02:29:49.861758 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 363/729] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:49 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1209 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:49.877914 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c0c93137-ec4e-475e-9628-54a4a950dd24 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:49.888025 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-253acf64-f575-419a-8216-a65c1c34db77 tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Getting quotas for project 771c0fc94e084c97a1359a1827c432f3. Resources: dict_keys(['metadata_items']) {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:29:49.896663 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.compute.server_groups [None req-c0c93137-ec4e-475e-9628-54a4a950dd24 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Querying cell d1723b23-1631-4a56-b9ad-72e4c39197cb(cell1) for 1 instances {{(pid=122320) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 05 02:29:49.897668 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c0c93137-ec4e-475e-9628-54a4a950dd24 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:49.898445 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c0c93137-ec4e-475e-9628-54a4a950dd24 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:49.899189 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c0c93137-ec4e-475e-9628-54a4a950dd24 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:49.904667 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-253acf64-f575-419a-8216-a65c1c34db77 tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Getting quotas for user 2e1341253c2c40f986039ce69e1cda85 and project 771c0fc94e084c97a1359a1827c432f3. Resources: dict_keys(['metadata_items']) {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:29:49.936597 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c0c93137-ec4e-475e-9628-54a4a950dd24 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/67851fb0-7c17-46d0-b291-609cb196ff0c" status: 200 len: 222 microversion: 2.1 time: 0.073568 Oct 05 02:29:49.937634 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 364/730] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 5 02:29:49 2022] GET /compute/v2.1/os-server-groups/67851fb0-7c17-46d0-b291-609cb196ff0c => generated 222 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:49.968279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2f7c5643-a9e9-4712-bc51-b0c4d4f96dfb tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:49.968795 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2f7c5643-a9e9-4712-bc51-b0c4d4f96dfb tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] [instance: 2e297761-81b8-4084-938d-7e097b32cd44] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:49.984805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f7c5643-a9e9-4712-bc51-b0c4d4f96dfb tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:49.987131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f7c5643-a9e9-4712-bc51-b0c4d4f96dfb tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:49.987923 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f7c5643-a9e9-4712-bc51-b0c4d4f96dfb tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:49.991100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f7c5643-a9e9-4712-bc51-b0c4d4f96dfb tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:49.991836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f7c5643-a9e9-4712-bc51-b0c4d4f96dfb tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:49.993911 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f7c5643-a9e9-4712-bc51-b0c4d4f96dfb tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:50.085818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2f7c5643-a9e9-4712-bc51-b0c4d4f96dfb tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] [instance: 2e297761-81b8-4084-938d-7e097b32cd44] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:29:50.233860 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2f7c5643-a9e9-4712-bc51-b0c4d4f96dfb tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44" status: 204 len: 0 microversion: 2.1 time: 0.283860 Oct 05 02:29:50.236800 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 365/731] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:29:49 2022] DELETE /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:29:50.244266 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-86dd438c-6dea-402d-8b12-bce96e021c1e req-f188ff58-a162-43e7-b672-3d0370b09d4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be4b86a-17b7-49a6-b630-1972adc25deb", "name": "network-vif-deleted", "tag": "ec1249bd-947f-457d-8a78-0483e5e79c65"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:50.257446 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-86dd438c-6dea-402d-8b12-bce96e021c1e req-f188ff58-a162-43e7-b672-3d0370b09d4e service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:50.258426 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-86dd438c-6dea-402d-8b12-bce96e021c1e req-f188ff58-a162-43e7-b672-3d0370b09d4e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:50.260159 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-86dd438c-6dea-402d-8b12-bce96e021c1e req-f188ff58-a162-43e7-b672-3d0370b09d4e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:50.277829 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-86dd438c-6dea-402d-8b12-bce96e021c1e req-f188ff58-a162-43e7-b672-3d0370b09d4e service nova] Creating event network-vif-deleted:ec1249bd-947f-457d-8a78-0483e5e79c65 for instance 4be4b86a-17b7-49a6-b630-1972adc25deb on n-h1-858272-3 Oct 05 02:29:50.286617 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-86dd438c-6dea-402d-8b12-bce96e021c1e req-f188ff58-a162-43e7-b672-3d0370b09d4e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047886 Oct 05 02:29:50.287929 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 366/732] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:50.301664 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0859aa45-7c21-45ae-806a-ef811cd67d0a tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:50.303182 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0859aa45-7c21-45ae-806a-ef811cd67d0a tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] [instance: 2e297761-81b8-4084-938d-7e097b32cd44] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:50.350716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0859aa45-7c21-45ae-806a-ef811cd67d0a tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:50.353379 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0859aa45-7c21-45ae-806a-ef811cd67d0a tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:50.353656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0859aa45-7c21-45ae-806a-ef811cd67d0a tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:50.354782 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0859aa45-7c21-45ae-806a-ef811cd67d0a tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:50.355259 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0859aa45-7c21-45ae-806a-ef811cd67d0a tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:50.355691 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0859aa45-7c21-45ae-806a-ef811cd67d0a tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:50.648197 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-253acf64-f575-419a-8216-a65c1c34db77 tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] 10.222.0.16 "PUT /compute/v2.1/images/5b16c5a0-3acf-479a-b49b-3c8aa65f4da0/metadata" status: 200 len: 61 microversion: 2.1 time: 0.919417 Oct 05 02:29:50.649414 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 367/733] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 5 02:29:49 2022] PUT /compute/v2.1/images/5b16c5a0-3acf-479a-b49b-3c8aa65f4da0/metadata => generated 61 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:29:50.655786 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-74d5b29a-0a07-4f15-9f38-831d7fb61e2f tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:50.656394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-74d5b29a-0a07-4f15-9f38-831d7fb61e2f tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] [instance: 4be4b86a-17b7-49a6-b630-1972adc25deb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:50.675923 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0859aa45-7c21-45ae-806a-ef811cd67d0a tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000b799366da44838465be08b88fb27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e7bf1499e6408da408d85bddc4d95b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:50.680281 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74d5b29a-0a07-4f15-9f38-831d7fb61e2f tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:50.680799 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74d5b29a-0a07-4f15-9f38-831d7fb61e2f tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:50.681266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74d5b29a-0a07-4f15-9f38-831d7fb61e2f tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:50.682954 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74d5b29a-0a07-4f15-9f38-831d7fb61e2f tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:50.683425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74d5b29a-0a07-4f15-9f38-831d7fb61e2f tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:50.683853 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74d5b29a-0a07-4f15-9f38-831d7fb61e2f tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:50.684421 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0859aa45-7c21-45ae-806a-ef811cd67d0a tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44" status: 200 len: 1504 microversion: 2.1 time: 0.392621 Oct 05 02:29:50.685024 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 367/734] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:50 2022] GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44 => generated 1504 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:50.690968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-34dc0fa6-4a26-40e6-bc03-7b9b7c701ffd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:50.691679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-34dc0fa6-4a26-40e6-bc03-7b9b7c701ffd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:50.698089 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34dc0fa6-4a26-40e6-bc03-7b9b7c701ffd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:50.698579 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34dc0fa6-4a26-40e6-bc03-7b9b7c701ffd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:50.699688 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34dc0fa6-4a26-40e6-bc03-7b9b7c701ffd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:50.700857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34dc0fa6-4a26-40e6-bc03-7b9b7c701ffd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:50.701739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34dc0fa6-4a26-40e6-bc03-7b9b7c701ffd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:50.702357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34dc0fa6-4a26-40e6-bc03-7b9b7c701ffd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:50.748326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74d5b29a-0a07-4f15-9f38-831d7fb61e2f tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:50.748823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74d5b29a-0a07-4f15-9f38-831d7fb61e2f tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:50.749288 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74d5b29a-0a07-4f15-9f38-831d7fb61e2f tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:50.749742 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-74d5b29a-0a07-4f15-9f38-831d7fb61e2f tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lazy-loading 'fault' on Instance uuid 4be4b86a-17b7-49a6-b630-1972adc25deb {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:29:50.834587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-74d5b29a-0a07-4f15-9f38-831d7fb61e2f tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '005a727f85c54471b45488b0f1d394e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449ddfb8f22f49a7a294de5f5ef08531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:50.843788 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-74d5b29a-0a07-4f15-9f38-831d7fb61e2f tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] 10.222.0.16 "GET /compute/v2.1/servers/4be4b86a-17b7-49a6-b630-1972adc25deb" status: 200 len: 1313 microversion: 2.1 time: 0.192884 Oct 05 02:29:50.861983 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 368/735] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:50 2022] GET /compute/v2.1/servers/4be4b86a-17b7-49a6-b630-1972adc25deb => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:50.869798 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2d5ad666-71a4-4936-b583-73e96aca2c1a tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Calling method '.version_select at 0x7fcce4285d30>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:50.931740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-34dc0fa6-4a26-40e6-bc03-7b9b7c701ffd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:50.934689 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:50.949747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-34dc0fa6-4a26-40e6-bc03-7b9b7c701ffd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:50.951809 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-34dc0fa6-4a26-40e6-bc03-7b9b7c701ffd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:50.955150 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-34dc0fa6-4a26-40e6-bc03-7b9b7c701ffd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1411 microversion: 2.25 time: 0.267691 Oct 05 02:29:50.957330 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 368/736] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:29:50 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1411 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:29:50.962787 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-25c7da5e-1e32-4d4a-bb8e-ee442dc29741 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-260142880", "imageRef": "77563b3b-d89c-4d8c-b4d5-ee650c6b3fdf", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "ec01cb76-bfad-4a81-822f-39c88c4adbe7"}], "security_groups": [{"name": "tempest-securitygroup--2115086561"}], "key_name": "tempest-keypair-208474523", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:51.140282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-25c7da5e-1e32-4d4a-bb8e-ee442dc29741 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] validate_networks() for [('ec01cb76-bfad-4a81-822f-39c88c4adbe7', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:29:51.243459 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2d5ad666-71a4-4936-b583-73e96aca2c1a tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] 10.222.0.16 "DELETE /compute/v2.1/images/5b16c5a0-3acf-479a-b49b-3c8aa65f4da0/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.377863 Oct 05 02:29:51.244103 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 369/737] 10.222.0.16 () {58 vars in 1296 bytes} [Wed Oct 5 02:29:50 2022] DELETE /compute/v2.1/images/5b16c5a0-3acf-479a-b49b-3c8aa65f4da0/metadata/os_version => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:29:51.248715 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0cc4d7bf-0ada-45c0-a538-8a362a4d7a6b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:51.252953 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0cc4d7bf-0ada-45c0-a538-8a362a4d7a6b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:51.260298 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0cc4d7bf-0ada-45c0-a538-8a362a4d7a6b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:51.261641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0cc4d7bf-0ada-45c0-a538-8a362a4d7a6b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:51.262283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0cc4d7bf-0ada-45c0-a538-8a362a4d7a6b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:51.263224 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0cc4d7bf-0ada-45c0-a538-8a362a4d7a6b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:51.263704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0cc4d7bf-0ada-45c0-a538-8a362a4d7a6b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:51.264290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0cc4d7bf-0ada-45c0-a538-8a362a4d7a6b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:51.342184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0cc4d7bf-0ada-45c0-a538-8a362a4d7a6b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:51.351198 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0cc4d7bf-0ada-45c0-a538-8a362a4d7a6b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1261 microversion: 2.1 time: 0.105953 Oct 05 02:29:51.353313 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 370/738] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:51 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1261 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:51.358176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0d756086-12a7-43dd-bd90-b9a2a276133a tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Calling method '.version_select at 0x7fcce420d280>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:51.414223 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0d756086-12a7-43dd-bd90-b9a2a276133a tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] 10.222.0.16 "GET /compute/v2.1/images/5b16c5a0-3acf-479a-b49b-3c8aa65f4da0/metadata" status: 200 len: 37 microversion: 2.1 time: 0.059774 Oct 05 02:29:51.423514 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 371/739] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 5 02:29:51 2022] GET /compute/v2.1/images/5b16c5a0-3acf-479a-b49b-3c8aa65f4da0/metadata => generated 37 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:29:51.433825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e408a583-31ba-4b8e-b716-c6adc2ea5148 tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Action: 'update_all', calling method: .version_select at 0x7fcce42458b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:51.495117 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-e408a583-31ba-4b8e-b716-c6adc2ea5148 tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Getting quotas for project 771c0fc94e084c97a1359a1827c432f3. Resources: dict_keys(['metadata_items']) {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:29:51.502736 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-e408a583-31ba-4b8e-b716-c6adc2ea5148 tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Getting quotas for user 2e1341253c2c40f986039ce69e1cda85 and project 771c0fc94e084c97a1359a1827c432f3. Resources: dict_keys(['metadata_items']) {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:29:51.714125 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-25c7da5e-1e32-4d4a-bb8e-ee442dc29741 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:29:51.715306 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-25c7da5e-1e32-4d4a-bb8e-ee442dc29741 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:29:51.716493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-25c7da5e-1e32-4d4a-bb8e-ee442dc29741 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:29:51.717242 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-25c7da5e-1e32-4d4a-bb8e-ee442dc29741 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:29:51.718378 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-25c7da5e-1e32-4d4a-bb8e-ee442dc29741 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:29:51.732170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25c7da5e-1e32-4d4a-bb8e-ee442dc29741 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:51.733132 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25c7da5e-1e32-4d4a-bb8e-ee442dc29741 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:51.734008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25c7da5e-1e32-4d4a-bb8e-ee442dc29741 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:51.735848 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25c7da5e-1e32-4d4a-bb8e-ee442dc29741 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:51.736708 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25c7da5e-1e32-4d4a-bb8e-ee442dc29741 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:51.737264 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25c7da5e-1e32-4d4a-bb8e-ee442dc29741 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:51.758405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-25c7da5e-1e32-4d4a-bb8e-ee442dc29741 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Getting quotas for project 407895b8d4e94b74a2cb652eb2c30048. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:29:51.764243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-25c7da5e-1e32-4d4a-bb8e-ee442dc29741 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Getting quotas for user f914ca523057422f88748746ba18b525 and project 407895b8d4e94b74a2cb652eb2c30048. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:29:51.779895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-25c7da5e-1e32-4d4a-bb8e-ee442dc29741 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:29:51.784380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-25c7da5e-1e32-4d4a-bb8e-ee442dc29741 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] [instance: aaa20a8a-8a7b-42dd-9b4e-9165fba82942] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77563b3b-d89c-4d8c-b4d5-ee650c6b3fdf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:29:51.859963 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-25c7da5e-1e32-4d4a-bb8e-ee442dc29741 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.900929 Oct 05 02:29:51.866682 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 369/740] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:29:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:29:51.868653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-eddf8f48-a324-424f-9ccf-f2a7ae058bae tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:51.869728 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-eddf8f48-a324-424f-9ccf-f2a7ae058bae tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] [instance: 2e297761-81b8-4084-938d-7e097b32cd44] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:51.877695 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eddf8f48-a324-424f-9ccf-f2a7ae058bae tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:51.878690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eddf8f48-a324-424f-9ccf-f2a7ae058bae tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:51.879311 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eddf8f48-a324-424f-9ccf-f2a7ae058bae tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:51.880418 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eddf8f48-a324-424f-9ccf-f2a7ae058bae tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:51.881330 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eddf8f48-a324-424f-9ccf-f2a7ae058bae tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:51.882074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eddf8f48-a324-424f-9ccf-f2a7ae058bae tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:51.903233 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e408a583-31ba-4b8e-b716-c6adc2ea5148 tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] 10.222.0.16 "PUT /compute/v2.1/images/5b16c5a0-3acf-479a-b49b-3c8aa65f4da0/metadata" status: 200 len: 61 microversion: 2.1 time: 0.473067 Oct 05 02:29:51.903929 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 372/741] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 5 02:29:51 2022] PUT /compute/v2.1/images/5b16c5a0-3acf-479a-b49b-3c8aa65f4da0/metadata => generated 61 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:29:51.909353 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-81d6005b-4cc7-4c2b-9eb0-9a3f32c209c9 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:51.910385 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-81d6005b-4cc7-4c2b-9eb0-9a3f32c209c9 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] [instance: 4be4b86a-17b7-49a6-b630-1972adc25deb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:51.923783 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81d6005b-4cc7-4c2b-9eb0-9a3f32c209c9 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:51.924255 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81d6005b-4cc7-4c2b-9eb0-9a3f32c209c9 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:51.924695 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81d6005b-4cc7-4c2b-9eb0-9a3f32c209c9 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:51.946813 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81d6005b-4cc7-4c2b-9eb0-9a3f32c209c9 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:51.947602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81d6005b-4cc7-4c2b-9eb0-9a3f32c209c9 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:51.949757 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81d6005b-4cc7-4c2b-9eb0-9a3f32c209c9 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:51.986373 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-81d6005b-4cc7-4c2b-9eb0-9a3f32c209c9 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] HTTP exception thrown: Instance 4be4b86a-17b7-49a6-b630-1972adc25deb could not be found. Oct 05 02:29:52.001668 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-81d6005b-4cc7-4c2b-9eb0-9a3f32c209c9 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Request method failure captured: Oct 05 02:29:52.001668 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/4be4b86a-17b7-49a6-b630-1972adc25deb HTTP/1.1 Oct 05 02:29:52.001668 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:29:52.001668 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:29:52.001668 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:29:52.001668 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:29:52.001668 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:29:52.001668 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:29:52.001668 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:29:52.001668 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:29:52.001668 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOwCwyDuO12YozpVbwGOdNKmNlcX_Bh-dzTQ_92Aew1V2H2PqNY8Pb275lu0yUKhn2hYNWnujZ13eroQm6vVYDFxElZTZYU3tzUjmtDnbz0_NJZw2IBVlR2GExeiwJDGn6l3hsHJLgyKC9O187bHzOtrQxuYIEmPh_oc66xjI4n22s4 Oct 05 02:29:52.001668 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:29:52.001668 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:29:52.001668 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:29:52.001668 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:29:52.001668 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:29:52.001668 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:29:52.001668 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 449ddfb8f22f49a7a294de5f5ef08531 Oct 05 02:29:52.001668 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1984663008 Oct 05 02:29:52.001668 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:29:52.001668 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:29:52.003116 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/449ddfb8f22f49a7a294de5f5ef08531"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/449ddfb8f22f49a7a294de5f5ef08531"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/449ddfb8f22f49a7a294de5f5ef08531"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_449ddfb8f22f49a7a294de5f5ef08531"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:29:52.003116 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1984663008 Oct 05 02:29:52.003116 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 449ddfb8f22f49a7a294de5f5ef08531 Oct 05 02:29:52.003116 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1984663008 Oct 05 02:29:52.003116 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerDiagnosticsNegativeTest-1984663008-project Oct 05 02:29:52.003116 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:29:52.003116 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:29:52.003116 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 005a727f85c54471b45488b0f1d394e1 Oct 05 02:29:52.003116 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1984663008-project Oct 05 02:29:52.003116 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:29:52.003116 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 4be4b86a-17b7-49a6-b630-1972adc25deb could not be found. Oct 05 02:29:52.003116 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '4be4b86a-17b7-49a6-b630-1972adc25deb'} Oct 05 02:29:52.003861 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:29:52.003861 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:29:52.003861 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:29:52.003861 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:29:52.003861 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:29:52.003861 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:29:52.003861 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:29:52.003861 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:29:52.003861 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:29:52.003861 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:29:52.003861 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4be4b86a-17b7-49a6-b630-1972adc25deb could not be found. Oct 05 02:29:52.003861 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:29:52.003861 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:29:52.003861 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:29:52.003861 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:29:52.003861 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:29:52.003861 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:29:52.003861 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:29:52.003861 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:29:52.003861 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:29:52.005660 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:29:52.005660 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:29:52.005660 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:29:52.005660 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:29:52.005660 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:29:52.005660 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:29:52.005660 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:29:52.005660 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4be4b86a-17b7-49a6-b630-1972adc25deb could not be found. Oct 05 02:29:52.005660 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:29:52.005660 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:29:52.005660 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:29:52.005660 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:29:52.005660 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:29:52.005660 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:29:52.005660 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:29:52.005660 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:29:52.005660 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4be4b86a-17b7-49a6-b630-1972adc25deb could not be found. Oct 05 02:29:52.005660 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:29:52.008334 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-81d6005b-4cc7-4c2b-9eb0-9a3f32c209c9 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] Returning 404 to user: Instance 4be4b86a-17b7-49a6-b630-1972adc25deb could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:29:52.011798 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-81d6005b-4cc7-4c2b-9eb0-9a3f32c209c9 tempest-ServerDiagnosticsNegativeTest-1984663008 tempest-ServerDiagnosticsNegativeTest-1984663008-project] 10.222.0.16 "GET /compute/v2.1/servers/4be4b86a-17b7-49a6-b630-1972adc25deb" status: 404 len: 111 microversion: 2.1 time: 0.105673 Oct 05 02:29:52.026106 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 373/742] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:51 2022] GET /compute/v2.1/servers/4be4b86a-17b7-49a6-b630-1972adc25deb => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:29:52.033471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0034c07f-269e-43af-bd52-0e292d329de9 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:52.034478 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0034c07f-269e-43af-bd52-0e292d329de9 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] [instance: aaa20a8a-8a7b-42dd-9b4e-9165fba82942] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:52.609189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0034c07f-269e-43af-bd52-0e292d329de9 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f914ca523057422f88748746ba18b525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '407895b8d4e94b74a2cb652eb2c30048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:52.624264 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0034c07f-269e-43af-bd52-0e292d329de9 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942" status: 200 len: 1244 microversion: 2.1 time: 0.591136 Oct 05 02:29:52.625378 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 374/743] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:52 2022] GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942 => generated 1244 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:52.630591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7aea7eca-9a64-479e-86f4-1973e945fd74 tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Calling method '.version_select at 0x7fcce447b1f0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:52.728961 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7aea7eca-9a64-479e-86f4-1973e945fd74 tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] 10.222.0.16 "GET /compute/v2.1/images/5b16c5a0-3acf-479a-b49b-3c8aa65f4da0/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.102207 Oct 05 02:29:52.729979 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 375/744] 10.222.0.16 () {58 vars in 1290 bytes} [Wed Oct 5 02:29:52 2022] GET /compute/v2.1/images/5b16c5a0-3acf-479a-b49b-3c8aa65f4da0/metadata/os_distro => generated 33 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:29:52.735643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0ddf1009-af24-4878-836b-f113bc9b7ec6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:52.738955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0ddf1009-af24-4878-836b-f113bc9b7ec6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:52.751915 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ddf1009-af24-4878-836b-f113bc9b7ec6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:52.756605 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ddf1009-af24-4878-836b-f113bc9b7ec6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:52.757358 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ddf1009-af24-4878-836b-f113bc9b7ec6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:52.758201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ddf1009-af24-4878-836b-f113bc9b7ec6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:52.762810 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ddf1009-af24-4878-836b-f113bc9b7ec6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:52.763535 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ddf1009-af24-4878-836b-f113bc9b7ec6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:52.933877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-eddf8f48-a324-424f-9ccf-f2a7ae058bae tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000b799366da44838465be08b88fb27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e7bf1499e6408da408d85bddc4d95b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:52.941971 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-eddf8f48-a324-424f-9ccf-f2a7ae058bae tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44" status: 200 len: 1504 microversion: 2.1 time: 1.077724 Oct 05 02:29:52.942558 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 370/745] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:51 2022] GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44 => generated 1504 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:52.947368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-97730917-c708-444f-a483-3c6b2efb1f4a tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:52.948155 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-97730917-c708-444f-a483-3c6b2efb1f4a tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:52.964435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-97730917-c708-444f-a483-3c6b2efb1f4a tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:52.966219 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-97730917-c708-444f-a483-3c6b2efb1f4a tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:52.966919 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-97730917-c708-444f-a483-3c6b2efb1f4a tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:52.970001 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-97730917-c708-444f-a483-3c6b2efb1f4a tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:52.970479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-97730917-c708-444f-a483-3c6b2efb1f4a tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:52.970912 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-97730917-c708-444f-a483-3c6b2efb1f4a tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:53.090896 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-97730917-c708-444f-a483-3c6b2efb1f4a tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:53.106068 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-97730917-c708-444f-a483-3c6b2efb1f4a tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1267 microversion: 2.1 time: 0.161212 Oct 05 02:29:53.119297 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 371/746] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:52 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:53.128927 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-febca9da-8161-4a67-b1e6-afeb3050d7a7 req-e58cbf8f-5b43-4bd6-a2ad-5450a6ec5e4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d497c63f-2a3d-4dbd-95d5-d2b90e743ac0", "tag": "3a205846-298f-466b-b6e3-8f110f0f22de"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:53.142973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-febca9da-8161-4a67-b1e6-afeb3050d7a7 req-e58cbf8f-5b43-4bd6-a2ad-5450a6ec5e4a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:53.143791 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-febca9da-8161-4a67-b1e6-afeb3050d7a7 req-e58cbf8f-5b43-4bd6-a2ad-5450a6ec5e4a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:53.144455 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-febca9da-8161-4a67-b1e6-afeb3050d7a7 req-e58cbf8f-5b43-4bd6-a2ad-5450a6ec5e4a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:53.160026 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-febca9da-8161-4a67-b1e6-afeb3050d7a7 req-e58cbf8f-5b43-4bd6-a2ad-5450a6ec5e4a service nova] Creating event network-changed:3a205846-298f-466b-b6e3-8f110f0f22de for instance d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 on n-h2-858272-3 Oct 05 02:29:53.165795 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-febca9da-8161-4a67-b1e6-afeb3050d7a7 req-e58cbf8f-5b43-4bd6-a2ad-5450a6ec5e4a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045050 Oct 05 02:29:53.166401 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 372/747] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:53.172192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0a13eda1-7d7f-420b-abb7-5207902c36c2 tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Action: 'update_all', calling method: .version_select at 0x7fcce437baf0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:53.197431 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0ddf1009-af24-4878-836b-f113bc9b7ec6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:53.211041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0ddf1009-af24-4878-836b-f113bc9b7ec6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:53.223308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0ddf1009-af24-4878-836b-f113bc9b7ec6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:53.226655 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0ddf1009-af24-4878-836b-f113bc9b7ec6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1411 microversion: 2.25 time: 0.495594 Oct 05 02:29:53.228985 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 376/748] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:29:52 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1411 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:29:53.245341 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-0a13eda1-7d7f-420b-abb7-5207902c36c2 tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Getting quotas for project 771c0fc94e084c97a1359a1827c432f3. Resources: dict_keys(['metadata_items']) {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:29:53.252316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-0a13eda1-7d7f-420b-abb7-5207902c36c2 tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Getting quotas for user 2e1341253c2c40f986039ce69e1cda85 and project 771c0fc94e084c97a1359a1827c432f3. Resources: dict_keys(['metadata_items']) {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:29:53.449308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1e62c7de-e35b-4e48-8248-43059dc148f6 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1489514549", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:53.459403 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0a13eda1-7d7f-420b-abb7-5207902c36c2 tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] 10.222.0.16 "PUT /compute/v2.1/images/5b16c5a0-3acf-479a-b49b-3c8aa65f4da0/metadata" status: 200 len: 61 microversion: 2.1 time: 0.291482 Oct 05 02:29:53.464652 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 373/749] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 5 02:29:53 2022] PUT /compute/v2.1/images/5b16c5a0-3acf-479a-b49b-3c8aa65f4da0/metadata => generated 61 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:29:53.471545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-55039547-742b-4ade-ac4f-61a78d2d5531 tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Calling method '.version_select at 0x7fcce42b4af0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:53.536183 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-1e62c7de-e35b-4e48-8248-43059dc148f6 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] validate_networks() for None {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:29:53.541030 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-55039547-742b-4ade-ac4f-61a78d2d5531 tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] 10.222.0.16 "GET /compute/v2.1/images/5b16c5a0-3acf-479a-b49b-3c8aa65f4da0/metadata" status: 200 len: 61 microversion: 2.1 time: 0.074995 Oct 05 02:29:53.541783 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 374/750] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 5 02:29:53 2022] GET /compute/v2.1/images/5b16c5a0-3acf-479a-b49b-3c8aa65f4da0/metadata => generated 61 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:29:53.552648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-faf7a95f-635e-44f5-9c73-82d36641d70c tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Action: 'update_all', calling method: .version_select at 0x7fcce4325af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:53.654694 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-faf7a95f-635e-44f5-9c73-82d36641d70c tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Getting quotas for project 771c0fc94e084c97a1359a1827c432f3. Resources: dict_keys(['metadata_items']) {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:29:53.668484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-faf7a95f-635e-44f5-9c73-82d36641d70c tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Getting quotas for user 2e1341253c2c40f986039ce69e1cda85 and project 771c0fc94e084c97a1359a1827c432f3. Resources: dict_keys(['metadata_items']) {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:29:53.952641 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-faf7a95f-635e-44f5-9c73-82d36641d70c tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] 10.222.0.16 "PUT /compute/v2.1/images/5b16c5a0-3acf-479a-b49b-3c8aa65f4da0/metadata" status: 200 len: 61 microversion: 2.1 time: 0.403756 Oct 05 02:29:53.954271 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 375/751] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 5 02:29:53 2022] PUT /compute/v2.1/images/5b16c5a0-3acf-479a-b49b-3c8aa65f4da0/metadata => generated 61 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:29:53.962805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-16dcaf51-908a-4e6d-8bee-f20e5d47731f tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:53.963468 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-16dcaf51-908a-4e6d-8bee-f20e5d47731f tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] [instance: aaa20a8a-8a7b-42dd-9b4e-9165fba82942] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:53.974257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16dcaf51-908a-4e6d-8bee-f20e5d47731f tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:53.974785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16dcaf51-908a-4e6d-8bee-f20e5d47731f tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:53.975242 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16dcaf51-908a-4e6d-8bee-f20e5d47731f tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:53.975956 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16dcaf51-908a-4e6d-8bee-f20e5d47731f tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:53.979589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16dcaf51-908a-4e6d-8bee-f20e5d47731f tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:53.983367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16dcaf51-908a-4e6d-8bee-f20e5d47731f tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:54.119055 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-16dcaf51-908a-4e6d-8bee-f20e5d47731f tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f914ca523057422f88748746ba18b525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '407895b8d4e94b74a2cb652eb2c30048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:54.152508 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-16dcaf51-908a-4e6d-8bee-f20e5d47731f tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942" status: 200 len: 1314 microversion: 2.1 time: 0.196899 Oct 05 02:29:54.154408 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 376/752] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:53 2022] GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:54.181297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a9406d7f-8511-476a-8d6f-a3e608e02144 tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Action: 'update_all', calling method: .version_select at 0x7fcce42b4550>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:54.229343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-1e62c7de-e35b-4e48-8248-43059dc148f6 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:29:54.229950 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-1e62c7de-e35b-4e48-8248-43059dc148f6 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:29:54.231022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-1e62c7de-e35b-4e48-8248-43059dc148f6 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:29:54.231731 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-1e62c7de-e35b-4e48-8248-43059dc148f6 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:29:54.233588 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-1e62c7de-e35b-4e48-8248-43059dc148f6 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:29:54.249040 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:54.255464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e62c7de-e35b-4e48-8248-43059dc148f6 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:54.258976 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e62c7de-e35b-4e48-8248-43059dc148f6 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:54.259419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e62c7de-e35b-4e48-8248-43059dc148f6 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:54.259764 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-a9406d7f-8511-476a-8d6f-a3e608e02144 tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Getting quotas for project 771c0fc94e084c97a1359a1827c432f3. Resources: dict_keys(['metadata_items']) {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:29:54.262658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e62c7de-e35b-4e48-8248-43059dc148f6 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:54.264809 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e62c7de-e35b-4e48-8248-43059dc148f6 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:54.267942 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e62c7de-e35b-4e48-8248-43059dc148f6 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:54.268582 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-a9406d7f-8511-476a-8d6f-a3e608e02144 tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Getting quotas for user 2e1341253c2c40f986039ce69e1cda85 and project 771c0fc94e084c97a1359a1827c432f3. Resources: dict_keys(['metadata_items']) {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:29:54.314716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-1e62c7de-e35b-4e48-8248-43059dc148f6 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Getting quotas for project c6918daa4f884786b45bc88dd1e4e94a. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:29:54.321275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-1e62c7de-e35b-4e48-8248-43059dc148f6 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Getting quotas for user c73227214e404f4db779694b8c11779e and project c6918daa4f884786b45bc88dd1e4e94a. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:29:54.338036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1e62c7de-e35b-4e48-8248-43059dc148f6 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:29:54.340194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1e62c7de-e35b-4e48-8248-43059dc148f6 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:29:54.425107 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1e62c7de-e35b-4e48-8248-43059dc148f6 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.194597 Oct 05 02:29:54.425763 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 377/753] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:29:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:29:54.465570 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7b7dcba1-0a2e-4144-a0a4-79f7d72062cb tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:54.473549 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7b7dcba1-0a2e-4144-a0a4-79f7d72062cb tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] [instance: 2e297761-81b8-4084-938d-7e097b32cd44] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:54.489430 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b7dcba1-0a2e-4144-a0a4-79f7d72062cb tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:54.489925 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b7dcba1-0a2e-4144-a0a4-79f7d72062cb tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:54.490364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b7dcba1-0a2e-4144-a0a4-79f7d72062cb tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:54.491147 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b7dcba1-0a2e-4144-a0a4-79f7d72062cb tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:54.491579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b7dcba1-0a2e-4144-a0a4-79f7d72062cb tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:54.492085 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b7dcba1-0a2e-4144-a0a4-79f7d72062cb tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:54.618254 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7b7dcba1-0a2e-4144-a0a4-79f7d72062cb tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000b799366da44838465be08b88fb27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e7bf1499e6408da408d85bddc4d95b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:54.627712 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7b7dcba1-0a2e-4144-a0a4-79f7d72062cb tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44" status: 200 len: 1462 microversion: 2.1 time: 0.173066 Oct 05 02:29:54.628296 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 378/754] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:54 2022] GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44 => generated 1462 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:54.637779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-9701959b-06c6-4fe2-b940-16d7d3c0bee7 req-e2d71064-d844-471a-a919-03044caa42ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e297761-81b8-4084-938d-7e097b32cd44", "name": "network-vif-deleted", "tag": "474e574e-c9b6-4fe3-a2ae-1181ef3204c8"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:54.668484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9701959b-06c6-4fe2-b940-16d7d3c0bee7 req-e2d71064-d844-471a-a919-03044caa42ce service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:54.668996 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9701959b-06c6-4fe2-b940-16d7d3c0bee7 req-e2d71064-d844-471a-a919-03044caa42ce service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:54.669621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9701959b-06c6-4fe2-b940-16d7d3c0bee7 req-e2d71064-d844-471a-a919-03044caa42ce service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:54.683456 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-9701959b-06c6-4fe2-b940-16d7d3c0bee7 req-e2d71064-d844-471a-a919-03044caa42ce service nova] Creating event network-vif-deleted:474e574e-c9b6-4fe3-a2ae-1181ef3204c8 for instance 2e297761-81b8-4084-938d-7e097b32cd44 on n-h2-858272-3 Oct 05 02:29:54.690972 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-9701959b-06c6-4fe2-b940-16d7d3c0bee7 req-e2d71064-d844-471a-a919-03044caa42ce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060809 Oct 05 02:29:54.691790 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 379/755] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:29:54.697262 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7fc70018-16b4-438d-8840-9a87600dc722 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:54.698171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7fc70018-16b4-438d-8840-9a87600dc722 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:54.708881 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fc70018-16b4-438d-8840-9a87600dc722 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:54.709597 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fc70018-16b4-438d-8840-9a87600dc722 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:54.710514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fc70018-16b4-438d-8840-9a87600dc722 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:54.711375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fc70018-16b4-438d-8840-9a87600dc722 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:54.711975 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fc70018-16b4-438d-8840-9a87600dc722 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:54.712546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fc70018-16b4-438d-8840-9a87600dc722 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:55.002788 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a9406d7f-8511-476a-8d6f-a3e608e02144 tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] 10.222.0.16 "PUT /compute/v2.1/images/5b16c5a0-3acf-479a-b49b-3c8aa65f4da0/metadata" status: 200 len: 64 microversion: 2.1 time: 0.847018 Oct 05 02:29:55.003536 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 377/756] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 5 02:29:54 2022] PUT /compute/v2.1/images/5b16c5a0-3acf-479a-b49b-3c8aa65f4da0/metadata => generated 64 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:29:55.008489 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-83ac1442-615f-4eae-9a20-ea2ef2a477f1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:55.011055 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-83ac1442-615f-4eae-9a20-ea2ef2a477f1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:55.021209 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83ac1442-615f-4eae-9a20-ea2ef2a477f1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:55.021962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83ac1442-615f-4eae-9a20-ea2ef2a477f1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:55.022652 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83ac1442-615f-4eae-9a20-ea2ef2a477f1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:55.025598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83ac1442-615f-4eae-9a20-ea2ef2a477f1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:55.026239 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83ac1442-615f-4eae-9a20-ea2ef2a477f1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:55.026831 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83ac1442-615f-4eae-9a20-ea2ef2a477f1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:55.830338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7fc70018-16b4-438d-8840-9a87600dc722 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:55.842381 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7fc70018-16b4-438d-8840-9a87600dc722 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1309 microversion: 2.1 time: 1.149057 Oct 05 02:29:55.843742 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 380/757] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:54 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1309 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:55.857751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0487b62d-5975-4d73-99ce-40df760d8333 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-603709611", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:55.995829 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-0487b62d-5975-4d73-99ce-40df760d8333 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] validate_networks() for None {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:29:56.095034 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-83ac1442-615f-4eae-9a20-ea2ef2a477f1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:56.103887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-83ac1442-615f-4eae-9a20-ea2ef2a477f1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:56.105349 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-83ac1442-615f-4eae-9a20-ea2ef2a477f1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:56.106460 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-83ac1442-615f-4eae-9a20-ea2ef2a477f1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1411 microversion: 2.25 time: 1.101777 Oct 05 02:29:56.107016 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 378/758] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:29:55 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1411 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:29:56.130271 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-90d7e3ec-9459-484d-b189-c5a44813e913 tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Calling method '.version_select at 0x7fcce40e6a60>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:56.217064 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-90d7e3ec-9459-484d-b189-c5a44813e913 tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] 10.222.0.16 "GET /compute/v2.1/images/5b16c5a0-3acf-479a-b49b-3c8aa65f4da0/metadata" status: 200 len: 64 microversion: 2.1 time: 0.090550 Oct 05 02:29:56.217676 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 379/759] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 5 02:29:56 2022] GET /compute/v2.1/images/5b16c5a0-3acf-479a-b49b-3c8aa65f4da0/metadata => generated 64 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:29:56.234925 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a30a3fbf-0017-44c9-86c4-f53f8c7141a2 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:56.235596 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a30a3fbf-0017-44c9-86c4-f53f8c7141a2 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] [instance: aaa20a8a-8a7b-42dd-9b4e-9165fba82942] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:56.242479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a30a3fbf-0017-44c9-86c4-f53f8c7141a2 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:56.244061 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a30a3fbf-0017-44c9-86c4-f53f8c7141a2 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:56.244668 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a30a3fbf-0017-44c9-86c4-f53f8c7141a2 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:56.245678 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a30a3fbf-0017-44c9-86c4-f53f8c7141a2 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:56.246962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a30a3fbf-0017-44c9-86c4-f53f8c7141a2 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:56.247598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a30a3fbf-0017-44c9-86c4-f53f8c7141a2 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:56.856531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a30a3fbf-0017-44c9-86c4-f53f8c7141a2 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f914ca523057422f88748746ba18b525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '407895b8d4e94b74a2cb652eb2c30048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:56.868134 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a30a3fbf-0017-44c9-86c4-f53f8c7141a2 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942" status: 200 len: 1302 microversion: 2.1 time: 0.649409 Oct 05 02:29:56.873553 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 380/760] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:56 2022] GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942 => generated 1302 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:56.885451 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b921a9fe-fda1-49ac-87c9-a23a93b52469 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:56.886697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b921a9fe-fda1-49ac-87c9-a23a93b52469 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] [instance: 2e297761-81b8-4084-938d-7e097b32cd44] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:56.924857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b921a9fe-fda1-49ac-87c9-a23a93b52469 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:56.926487 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b921a9fe-fda1-49ac-87c9-a23a93b52469 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:56.927180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b921a9fe-fda1-49ac-87c9-a23a93b52469 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:56.929561 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b921a9fe-fda1-49ac-87c9-a23a93b52469 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:56.930958 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b921a9fe-fda1-49ac-87c9-a23a93b52469 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:56.931581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b921a9fe-fda1-49ac-87c9-a23a93b52469 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:57.013419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b921a9fe-fda1-49ac-87c9-a23a93b52469 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:57.014400 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b921a9fe-fda1-49ac-87c9-a23a93b52469 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:57.017490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b921a9fe-fda1-49ac-87c9-a23a93b52469 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:57.019377 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-b921a9fe-fda1-49ac-87c9-a23a93b52469 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lazy-loading 'fault' on Instance uuid 2e297761-81b8-4084-938d-7e097b32cd44 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:29:57.067841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0487b62d-5975-4d73-99ce-40df760d8333 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:29:57.069023 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0487b62d-5975-4d73-99ce-40df760d8333 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:29:57.070087 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0487b62d-5975-4d73-99ce-40df760d8333 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:29:57.070661 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0487b62d-5975-4d73-99ce-40df760d8333 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:29:57.071400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0487b62d-5975-4d73-99ce-40df760d8333 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:29:57.091031 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0487b62d-5975-4d73-99ce-40df760d8333 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:57.091767 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0487b62d-5975-4d73-99ce-40df760d8333 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:57.093425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0487b62d-5975-4d73-99ce-40df760d8333 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:57.094338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0487b62d-5975-4d73-99ce-40df760d8333 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:57.095019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0487b62d-5975-4d73-99ce-40df760d8333 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:57.098037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0487b62d-5975-4d73-99ce-40df760d8333 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:57.144700 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-0487b62d-5975-4d73-99ce-40df760d8333 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Getting quotas for project c6918daa4f884786b45bc88dd1e4e94a. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:29:57.158604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-0487b62d-5975-4d73-99ce-40df760d8333 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Getting quotas for user c73227214e404f4db779694b8c11779e and project c6918daa4f884786b45bc88dd1e4e94a. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:29:57.193562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0487b62d-5975-4d73-99ce-40df760d8333 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:29:57.196268 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0487b62d-5975-4d73-99ce-40df760d8333 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 34d20b05-afd7-4c5b-8af2-8176e33c041f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:29:57.220554 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b921a9fe-fda1-49ac-87c9-a23a93b52469 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '000b799366da44838465be08b88fb27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e7bf1499e6408da408d85bddc4d95b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:57.239292 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b921a9fe-fda1-49ac-87c9-a23a93b52469 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44" status: 200 len: 1302 microversion: 2.1 time: 0.363364 Oct 05 02:29:57.239884 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 381/761] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:56 2022] GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44 => generated 1302 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:57.257134 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c2d445de-559e-496c-9f57-ad130db1efbf tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Action: 'update_all', calling method: .version_select at 0x7fcce43dd040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:57.339847 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0487b62d-5975-4d73-99ce-40df760d8333 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.491139 Oct 05 02:29:57.339847 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 381/762] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:29:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:29:57.360754 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-eddbe761-0af2-4eca-a351-1c6c22ad5691 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:57.361544 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-eddbe761-0af2-4eca-a351-1c6c22ad5691 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:57.379194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eddbe761-0af2-4eca-a351-1c6c22ad5691 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:57.379430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-c2d445de-559e-496c-9f57-ad130db1efbf tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Getting quotas for project 771c0fc94e084c97a1359a1827c432f3. Resources: dict_keys(['metadata_items']) {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:29:57.381006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eddbe761-0af2-4eca-a351-1c6c22ad5691 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:57.381496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eddbe761-0af2-4eca-a351-1c6c22ad5691 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:57.383003 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eddbe761-0af2-4eca-a351-1c6c22ad5691 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:57.383403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eddbe761-0af2-4eca-a351-1c6c22ad5691 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:57.383829 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eddbe761-0af2-4eca-a351-1c6c22ad5691 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:57.387705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-c2d445de-559e-496c-9f57-ad130db1efbf tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Getting quotas for user 2e1341253c2c40f986039ce69e1cda85 and project 771c0fc94e084c97a1359a1827c432f3. Resources: dict_keys(['metadata_items']) {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:29:58.018989 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c2d445de-559e-496c-9f57-ad130db1efbf tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] 10.222.0.16 "PUT /compute/v2.1/images/5b16c5a0-3acf-479a-b49b-3c8aa65f4da0/metadata" status: 200 len: 61 microversion: 2.1 time: 0.777969 Oct 05 02:29:58.019988 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 382/763] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 5 02:29:57 2022] PUT /compute/v2.1/images/5b16c5a0-3acf-479a-b49b-3c8aa65f4da0/metadata => generated 61 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:29:58.024944 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d5916d6f-bbe6-487f-aebf-24e032732edf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:58.025858 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d5916d6f-bbe6-487f-aebf-24e032732edf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:58.033950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5916d6f-bbe6-487f-aebf-24e032732edf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:58.035423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5916d6f-bbe6-487f-aebf-24e032732edf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:58.036361 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5916d6f-bbe6-487f-aebf-24e032732edf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:58.040635 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5916d6f-bbe6-487f-aebf-24e032732edf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:58.041563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5916d6f-bbe6-487f-aebf-24e032732edf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:58.042977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5916d6f-bbe6-487f-aebf-24e032732edf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:58.660623 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-eddbe761-0af2-4eca-a351-1c6c22ad5691 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:58.679578 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-eddbe761-0af2-4eca-a351-1c6c22ad5691 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1309 microversion: 2.1 time: 1.338623 Oct 05 02:29:58.693513 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 382/764] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:57 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1309 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:58.705160 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9205679f-0417-4dbf-a0f2-371279e92c93 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:58.706161 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9205679f-0417-4dbf-a0f2-371279e92c93 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 34d20b05-afd7-4c5b-8af2-8176e33c041f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:58.714553 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9205679f-0417-4dbf-a0f2-371279e92c93 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:58.715434 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9205679f-0417-4dbf-a0f2-371279e92c93 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:58.716138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9205679f-0417-4dbf-a0f2-371279e92c93 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:58.717112 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9205679f-0417-4dbf-a0f2-371279e92c93 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:58.717852 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9205679f-0417-4dbf-a0f2-371279e92c93 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:58.718512 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9205679f-0417-4dbf-a0f2-371279e92c93 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:58.730435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d5916d6f-bbe6-487f-aebf-24e032732edf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:58.745117 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d5916d6f-bbe6-487f-aebf-24e032732edf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:58.749212 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d5916d6f-bbe6-487f-aebf-24e032732edf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:58.753545 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d5916d6f-bbe6-487f-aebf-24e032732edf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1411 microversion: 2.25 time: 0.732350 Oct 05 02:29:58.756739 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 383/765] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:29:58 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1411 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:29:58.784725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c472e688-e55f-46e4-bcad-c6c3bf03c7cb tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:29:58.786149 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c472e688-e55f-46e4-bcad-c6c3bf03c7cb tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] [instance: aaa20a8a-8a7b-42dd-9b4e-9165fba82942] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:29:58.813781 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c472e688-e55f-46e4-bcad-c6c3bf03c7cb tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:58.814290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c472e688-e55f-46e4-bcad-c6c3bf03c7cb tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:58.814747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c472e688-e55f-46e4-bcad-c6c3bf03c7cb tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:58.816609 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c472e688-e55f-46e4-bcad-c6c3bf03c7cb tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:29:58.817616 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c472e688-e55f-46e4-bcad-c6c3bf03c7cb tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:29:58.818216 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c472e688-e55f-46e4-bcad-c6c3bf03c7cb tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:29:59.034389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9205679f-0417-4dbf-a0f2-371279e92c93 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:29:59.052552 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9205679f-0417-4dbf-a0f2-371279e92c93 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f" status: 200 len: 1217 microversion: 2.1 time: 0.351434 Oct 05 02:29:59.053190 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 383/766] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:58 2022] GET /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f => generated 1217 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:29:59.060793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-72e604a5-a114-45c8-a181-42289144c205 tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Action: 'update', calling method: .version_select at 0x7fcce41b2dc0>, body: {"meta": {"os_version": "alt"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:29:59.197159 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-72e604a5-a114-45c8-a181-42289144c205 tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Getting quotas for project 771c0fc94e084c97a1359a1827c432f3. Resources: dict_keys(['metadata_items']) {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:29:59.225534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-72e604a5-a114-45c8-a181-42289144c205 tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Getting quotas for user 2e1341253c2c40f986039ce69e1cda85 and project 771c0fc94e084c97a1359a1827c432f3. Resources: dict_keys(['metadata_items']) {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:29:59.770078 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-72e604a5-a114-45c8-a181-42289144c205 tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] 10.222.0.16 "PUT /compute/v2.1/images/5b16c5a0-3acf-479a-b49b-3c8aa65f4da0/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.712948 Oct 05 02:29:59.772336 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 384/767] 10.222.0.16 () {60 vars in 1313 bytes} [Wed Oct 5 02:29:59 2022] PUT /compute/v2.1/images/5b16c5a0-3acf-479a-b49b-3c8aa65f4da0/metadata/os_version => generated 31 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:30:00.082451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-29236098-62af-4602-8bba-95d441c10013 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-451364665", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": "none"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:00.241777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-29236098-62af-4602-8bba-95d441c10013 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:30:00.242292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-29236098-62af-4602-8bba-95d441c10013 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:30:00.243017 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-29236098-62af-4602-8bba-95d441c10013 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:30:00.243433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-29236098-62af-4602-8bba-95d441c10013 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:30:00.243791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-29236098-62af-4602-8bba-95d441c10013 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:30:00.245889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:00.258241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-29236098-62af-4602-8bba-95d441c10013 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:00.259228 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-29236098-62af-4602-8bba-95d441c10013 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:00.260844 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-29236098-62af-4602-8bba-95d441c10013 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:00.262369 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-29236098-62af-4602-8bba-95d441c10013 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:00.263289 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-29236098-62af-4602-8bba-95d441c10013 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:00.263981 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-29236098-62af-4602-8bba-95d441c10013 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:00.304394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-29236098-62af-4602-8bba-95d441c10013 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Getting quotas for project 68c7d71b3c0143e8b5247b08cff3b280. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:30:00.310744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-29236098-62af-4602-8bba-95d441c10013 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Getting quotas for user d698bef448a74da2ac299d978c5a6c66 and project 68c7d71b3c0143e8b5247b08cff3b280. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:30:00.330865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-29236098-62af-4602-8bba-95d441c10013 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:30:00.335056 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-29236098-62af-4602-8bba-95d441c10013 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:30:00.507159 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-29236098-62af-4602-8bba-95d441c10013 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.733361 Oct 05 02:30:00.521960 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c472e688-e55f-46e4-bcad-c6c3bf03c7cb tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f914ca523057422f88748746ba18b525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '407895b8d4e94b74a2cb652eb2c30048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:00.531985 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 385/768] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 5 02:29:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 05 02:30:00.546941 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-652ea7d8-fb36-4ad5-ae9b-65af7b15ac90 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:00.547938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-652ea7d8-fb36-4ad5-ae9b-65af7b15ac90 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] [instance: 2e297761-81b8-4084-938d-7e097b32cd44] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:00.554353 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c472e688-e55f-46e4-bcad-c6c3bf03c7cb tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942" status: 200 len: 1370 microversion: 2.1 time: 1.778271 Oct 05 02:30:00.560339 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 384/769] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:29:58 2022] GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942 => generated 1370 bytes in 1802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:00.568106 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-652ea7d8-fb36-4ad5-ae9b-65af7b15ac90 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:00.568996 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-652ea7d8-fb36-4ad5-ae9b-65af7b15ac90 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:00.569553 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-652ea7d8-fb36-4ad5-ae9b-65af7b15ac90 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:00.570373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-652ea7d8-fb36-4ad5-ae9b-65af7b15ac90 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:00.570937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-652ea7d8-fb36-4ad5-ae9b-65af7b15ac90 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:00.572528 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a2095415-2502-4cea-9e12-9c36798d6db2 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:00.572937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-652ea7d8-fb36-4ad5-ae9b-65af7b15ac90 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:00.573548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a2095415-2502-4cea-9e12-9c36798d6db2 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:00.593868 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2095415-2502-4cea-9e12-9c36798d6db2 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:00.597929 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2095415-2502-4cea-9e12-9c36798d6db2 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:00.602083 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2095415-2502-4cea-9e12-9c36798d6db2 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:00.603808 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-652ea7d8-fb36-4ad5-ae9b-65af7b15ac90 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] HTTP exception thrown: Instance 2e297761-81b8-4084-938d-7e097b32cd44 could not be found. Oct 05 02:30:00.604860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2095415-2502-4cea-9e12-9c36798d6db2 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:00.607901 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-652ea7d8-fb36-4ad5-ae9b-65af7b15ac90 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Request method failure captured: Oct 05 02:30:00.607901 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44 HTTP/1.1 Oct 05 02:30:00.607901 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:30:00.607901 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:30:00.607901 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:30:00.607901 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:30:00.607901 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:30:00.607901 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:30:00.607901 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:30:00.607901 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:30:00.607901 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOvt5ABie31kmQBvA71bfR-amBCxfahjkJu1m3ADpiq5cWH23R5VKaeP1ppb1TjI1HICwto_EYD7cJ74ZnYpdWJdUuj2yKn5HuURNe-qeanM1mvinOZGA-2kqZSbZA33G80n4N2ZjkgJn4nA6OKzt0yqWjXSdVcbsT23vT2APmD80Lo Oct 05 02:30:00.607901 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:30:00.607901 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:30:00.607901 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:30:00.607901 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:30:00.607901 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:30:00.607901 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:30:00.607901 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 92e7bf1499e6408da408d85bddc4d95b Oct 05 02:30:00.607901 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerGroupTestJSON-20245682 Oct 05 02:30:00.607901 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:30:00.607901 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:30:00.610359 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/92e7bf1499e6408da408d85bddc4d95b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/92e7bf1499e6408da408d85bddc4d95b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/92e7bf1499e6408da408d85bddc4d95b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_92e7bf1499e6408da408d85bddc4d95b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:30:00.610359 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerGroupTestJSON-20245682 Oct 05 02:30:00.610359 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 92e7bf1499e6408da408d85bddc4d95b Oct 05 02:30:00.610359 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerGroupTestJSON-20245682 Oct 05 02:30:00.610359 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerGroupTestJSON-20245682-project Oct 05 02:30:00.610359 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:30:00.610359 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:30:00.610359 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 000b799366da44838465be08b88fb27d Oct 05 02:30:00.610359 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerGroupTestJSON-20245682-project Oct 05 02:30:00.610359 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:30:00.610359 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 2e297761-81b8-4084-938d-7e097b32cd44 could not be found. Oct 05 02:30:00.610359 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '2e297761-81b8-4084-938d-7e097b32cd44'} Oct 05 02:30:00.611581 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:30:00.611581 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:00.611581 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:30:00.611581 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:30:00.611581 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:30:00.611581 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:30:00.611581 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:30:00.611581 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:30:00.611581 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:30:00.611581 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:30:00.611581 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e297761-81b8-4084-938d-7e097b32cd44 could not be found. Oct 05 02:30:00.611581 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:00.611581 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:00.611581 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:00.611581 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:00.611581 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:00.611581 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:00.611581 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:30:00.611581 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:30:00.611581 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:30:00.613080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:30:00.613080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:30:00.613080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:30:00.613080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:30:00.613080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:30:00.613080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:30:00.613080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:30:00.613080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e297761-81b8-4084-938d-7e097b32cd44 could not be found. Oct 05 02:30:00.613080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:00.613080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:00.613080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:00.613080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:00.613080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:00.613080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:00.613080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:30:00.613080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:30:00.613080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e297761-81b8-4084-938d-7e097b32cd44 could not be found. Oct 05 02:30:00.613080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:00.617036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-652ea7d8-fb36-4ad5-ae9b-65af7b15ac90 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Returning 404 to user: Instance 2e297761-81b8-4084-938d-7e097b32cd44 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:30:00.617996 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2095415-2502-4cea-9e12-9c36798d6db2 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:00.618780 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2095415-2502-4cea-9e12-9c36798d6db2 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:00.619141 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-652ea7d8-fb36-4ad5-ae9b-65af7b15ac90 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44" status: 404 len: 111 microversion: 2.1 time: 0.083740 Oct 05 02:30:00.620227 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 386/770] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:00 2022] GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:30:00.630503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b4cffc2e-4ece-42b3-9599-9e3e7ee2bd8c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:00.633292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b4cffc2e-4ece-42b3-9599-9e3e7ee2bd8c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:00.649799 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4cffc2e-4ece-42b3-9599-9e3e7ee2bd8c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:00.653269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4cffc2e-4ece-42b3-9599-9e3e7ee2bd8c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:00.653825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4cffc2e-4ece-42b3-9599-9e3e7ee2bd8c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:00.654842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4cffc2e-4ece-42b3-9599-9e3e7ee2bd8c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:00.655508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4cffc2e-4ece-42b3-9599-9e3e7ee2bd8c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:00.657171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4cffc2e-4ece-42b3-9599-9e3e7ee2bd8c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:01.692316 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b4cffc2e-4ece-42b3-9599-9e3e7ee2bd8c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:01.706383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b4cffc2e-4ece-42b3-9599-9e3e7ee2bd8c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:01.708516 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b4cffc2e-4ece-42b3-9599-9e3e7ee2bd8c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:01.709993 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b4cffc2e-4ece-42b3-9599-9e3e7ee2bd8c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1411 microversion: 2.25 time: 1.087893 Oct 05 02:30:01.711176 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 387/771] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:00 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1411 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:01.727880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-33ce36ae-c32a-467a-9657-0d46d72326a0 tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Calling method '.version_select at 0x7fcce41b23a0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:01.746889 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:01.784150 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a2095415-2502-4cea-9e12-9c36798d6db2 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:01.792567 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-33ce36ae-c32a-467a-9657-0d46d72326a0 tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] 10.222.0.16 "GET /compute/v2.1/images/5b16c5a0-3acf-479a-b49b-3c8aa65f4da0/metadata" status: 200 len: 58 microversion: 2.1 time: 0.079892 Oct 05 02:30:01.793760 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 388/772] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 5 02:30:01 2022] GET /compute/v2.1/images/5b16c5a0-3acf-479a-b49b-3c8aa65f4da0/metadata => generated 58 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:30:01.796306 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a2095415-2502-4cea-9e12-9c36798d6db2 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1309 microversion: 2.1 time: 1.234635 Oct 05 02:30:01.801412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-e41c70a3-dc95-4be6-a78c-436254b8603a req-03ed1a45-850e-4ced-b021-0b888066b4c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4445875-4e03-4ee1-8905-a60ec2a9d2c8", "tag": "9fafe495-cce4-462d-af59-d2b8107ff726"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:01.805337 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 385/773] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:00 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1309 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:01.813857 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e41c70a3-dc95-4be6-a78c-436254b8603a req-03ed1a45-850e-4ced-b021-0b888066b4c4 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:01.814995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e41c70a3-dc95-4be6-a78c-436254b8603a req-03ed1a45-850e-4ced-b021-0b888066b4c4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:01.815727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e41c70a3-dc95-4be6-a78c-436254b8603a req-03ed1a45-850e-4ced-b021-0b888066b4c4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:01.829872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-457441ce-ed6b-4b06-bbd6-9ac677387d66 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:01.830551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-457441ce-ed6b-4b06-bbd6-9ac677387d66 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 34d20b05-afd7-4c5b-8af2-8176e33c041f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:01.833360 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-e41c70a3-dc95-4be6-a78c-436254b8603a req-03ed1a45-850e-4ced-b021-0b888066b4c4 service nova] Creating event network-changed:9fafe495-cce4-462d-af59-d2b8107ff726 for instance e4445875-4e03-4ee1-8905-a60ec2a9d2c8 on n-h1-858272-3 Oct 05 02:30:01.839119 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-e41c70a3-dc95-4be6-a78c-436254b8603a req-03ed1a45-850e-4ced-b021-0b888066b4c4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043525 Oct 05 02:30:01.840080 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 389/774] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:30:01.840569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-457441ce-ed6b-4b06-bbd6-9ac677387d66 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:01.841095 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-457441ce-ed6b-4b06-bbd6-9ac677387d66 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:01.841845 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-457441ce-ed6b-4b06-bbd6-9ac677387d66 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:01.842718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-457441ce-ed6b-4b06-bbd6-9ac677387d66 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:01.843335 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-457441ce-ed6b-4b06-bbd6-9ac677387d66 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:01.843916 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-457441ce-ed6b-4b06-bbd6-9ac677387d66 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:01.845970 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b5dc3bd3-530f-4b3b-9004-9fd145765f45 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:01.849756 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b5dc3bd3-530f-4b3b-9004-9fd145765f45 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:01.864096 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5dc3bd3-530f-4b3b-9004-9fd145765f45 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:01.864594 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5dc3bd3-530f-4b3b-9004-9fd145765f45 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:01.865058 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5dc3bd3-530f-4b3b-9004-9fd145765f45 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:01.867978 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5dc3bd3-530f-4b3b-9004-9fd145765f45 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:01.868591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5dc3bd3-530f-4b3b-9004-9fd145765f45 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:01.869050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5dc3bd3-530f-4b3b-9004-9fd145765f45 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:01.970836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-457441ce-ed6b-4b06-bbd6-9ac677387d66 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:01.980623 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-457441ce-ed6b-4b06-bbd6-9ac677387d66 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f" status: 200 len: 1271 microversion: 2.1 time: 0.174152 Oct 05 02:30:01.993409 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 386/775] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:01 2022] GET /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f => generated 1271 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:02.006953 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a3d66515-12cf-4d7a-ad6b-507f195ded34 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:02.025783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.compute.server_groups [None req-a3d66515-12cf-4d7a-ad6b-507f195ded34 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Querying cell d1723b23-1631-4a56-b9ad-72e4c39197cb(cell1) for 1 instances {{(pid=122320) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 05 02:30:02.026753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3d66515-12cf-4d7a-ad6b-507f195ded34 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:02.027467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3d66515-12cf-4d7a-ad6b-507f195ded34 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:02.028179 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3d66515-12cf-4d7a-ad6b-507f195ded34 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:02.040335 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a3d66515-12cf-4d7a-ad6b-507f195ded34 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.045321 Oct 05 02:30:02.041331 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 387/776] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 5 02:30:01 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:30:02.046215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-1c01c748-610d-4201-958c-7c92c5cf572f req-efb9e675-d99c-46ed-a1fe-b57c12f35f6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d497c63f-2a3d-4dbd-95d5-d2b90e743ac0", "name": "network-vif-plugged", "status": "completed", "tag": "3a205846-298f-466b-b6e3-8f110f0f22de"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:02.057132 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1c01c748-610d-4201-958c-7c92c5cf572f req-efb9e675-d99c-46ed-a1fe-b57c12f35f6d service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:02.057984 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1c01c748-610d-4201-958c-7c92c5cf572f req-efb9e675-d99c-46ed-a1fe-b57c12f35f6d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:02.058633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1c01c748-610d-4201-958c-7c92c5cf572f req-efb9e675-d99c-46ed-a1fe-b57c12f35f6d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:02.070436 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-1c01c748-610d-4201-958c-7c92c5cf572f req-efb9e675-d99c-46ed-a1fe-b57c12f35f6d service nova] Creating event network-vif-plugged:3a205846-298f-466b-b6e3-8f110f0f22de for instance d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 on n-h2-858272-3 Oct 05 02:30:02.076611 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-1c01c748-610d-4201-958c-7c92c5cf572f req-efb9e675-d99c-46ed-a1fe-b57c12f35f6d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033881 Oct 05 02:30:02.078304 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 388/777] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:30:02.090271 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bbdb0649-4c22-470d-8f3c-9ae3db63cd35 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:02.091110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bbdb0649-4c22-470d-8f3c-9ae3db63cd35 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] [instance: aaa20a8a-8a7b-42dd-9b4e-9165fba82942] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:02.102757 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bbdb0649-4c22-470d-8f3c-9ae3db63cd35 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:02.103947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bbdb0649-4c22-470d-8f3c-9ae3db63cd35 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:02.104525 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bbdb0649-4c22-470d-8f3c-9ae3db63cd35 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:02.105541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bbdb0649-4c22-470d-8f3c-9ae3db63cd35 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:02.106154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bbdb0649-4c22-470d-8f3c-9ae3db63cd35 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:02.106674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bbdb0649-4c22-470d-8f3c-9ae3db63cd35 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:02.560557 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b5dc3bd3-530f-4b3b-9004-9fd145765f45 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:02.591633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b5dc3bd3-530f-4b3b-9004-9fd145765f45 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:02.599534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b5dc3bd3-530f-4b3b-9004-9fd145765f45 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:02.613176 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b5dc3bd3-530f-4b3b-9004-9fd145765f45 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "PUT /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1362 microversion: 2.75 time: 0.771600 Oct 05 02:30:02.632916 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 390/778] 10.222.0.16 () {62 vars in 1297 bytes} [Wed Oct 5 02:30:01 2022] PUT /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1362 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:02.644034 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d1406432-2319-4c5b-af9c-d128d061b50b tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Action: 'update_all', calling method: .version_select at 0x7fcce42859d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:02.748286 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-d1406432-2319-4c5b-af9c-d128d061b50b tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Getting quotas for project 771c0fc94e084c97a1359a1827c432f3. Resources: dict_keys(['metadata_items']) {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:30:02.757162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-d1406432-2319-4c5b-af9c-d128d061b50b tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Getting quotas for user 2e1341253c2c40f986039ce69e1cda85 and project 771c0fc94e084c97a1359a1827c432f3. Resources: dict_keys(['metadata_items']) {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:30:02.979932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bbdb0649-4c22-470d-8f3c-9ae3db63cd35 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f914ca523057422f88748746ba18b525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '407895b8d4e94b74a2cb652eb2c30048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:02.994025 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bbdb0649-4c22-470d-8f3c-9ae3db63cd35 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942" status: 200 len: 1370 microversion: 2.1 time: 0.913584 Oct 05 02:30:02.995137 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 389/779] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:02 2022] GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942 => generated 1370 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:03.014679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bc6e87c4-9cd7-4ba0-b046-f888f5820699 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:03.047008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.compute.server_groups [None req-bc6e87c4-9cd7-4ba0-b046-f888f5820699 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Querying cell d1723b23-1631-4a56-b9ad-72e4c39197cb(cell1) for 1 instances {{(pid=122320) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 05 02:30:03.048688 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bc6e87c4-9cd7-4ba0-b046-f888f5820699 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:03.049523 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bc6e87c4-9cd7-4ba0-b046-f888f5820699 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:03.050144 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bc6e87c4-9cd7-4ba0-b046-f888f5820699 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:03.068686 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bc6e87c4-9cd7-4ba0-b046-f888f5820699 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/67851fb0-7c17-46d0-b291-609cb196ff0c" status: 200 len: 184 microversion: 2.1 time: 0.065355 Oct 05 02:30:03.071445 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 390/780] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 5 02:30:03 2022] GET /compute/v2.1/os-server-groups/67851fb0-7c17-46d0-b291-609cb196ff0c => generated 184 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:30:03.077323 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8183b016-69b3-45ba-8af6-8dab76605e67 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:03.078150 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8183b016-69b3-45ba-8af6-8dab76605e67 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:03.090525 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8183b016-69b3-45ba-8af6-8dab76605e67 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:03.091379 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8183b016-69b3-45ba-8af6-8dab76605e67 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:03.092003 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8183b016-69b3-45ba-8af6-8dab76605e67 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:03.093298 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8183b016-69b3-45ba-8af6-8dab76605e67 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:03.096499 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8183b016-69b3-45ba-8af6-8dab76605e67 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:03.097687 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8183b016-69b3-45ba-8af6-8dab76605e67 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:03.327914 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d1406432-2319-4c5b-af9c-d128d061b50b tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] 10.222.0.16 "PUT /compute/v2.1/images/5b16c5a0-3acf-479a-b49b-3c8aa65f4da0/metadata" status: 200 len: 61 microversion: 2.1 time: 0.693445 Oct 05 02:30:03.329129 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 391/781] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 5 02:30:02 2022] PUT /compute/v2.1/images/5b16c5a0-3acf-479a-b49b-3c8aa65f4da0/metadata => generated 61 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:30:03.334397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4836773e-3152-495b-8d27-1bed513d3ad7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:03.340252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4836773e-3152-495b-8d27-1bed513d3ad7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:03.348105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4836773e-3152-495b-8d27-1bed513d3ad7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:03.348816 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4836773e-3152-495b-8d27-1bed513d3ad7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:03.349936 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4836773e-3152-495b-8d27-1bed513d3ad7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:03.351434 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4836773e-3152-495b-8d27-1bed513d3ad7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:03.351989 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4836773e-3152-495b-8d27-1bed513d3ad7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:03.352926 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4836773e-3152-495b-8d27-1bed513d3ad7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:03.380650 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8183b016-69b3-45ba-8af6-8dab76605e67 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:03.395752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8183b016-69b3-45ba-8af6-8dab76605e67 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:03.398901 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8183b016-69b3-45ba-8af6-8dab76605e67 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:03.416474 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8183b016-69b3-45ba-8af6-8dab76605e67 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1362 microversion: 2.75 time: 0.343439 Oct 05 02:30:03.437461 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 391/782] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:03 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1362 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:03.446220 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-151ced81-39c1-47e4-8308-214158fa2178 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:03.446992 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-151ced81-39c1-47e4-8308-214158fa2178 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:03.455382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-151ced81-39c1-47e4-8308-214158fa2178 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:03.456021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-151ced81-39c1-47e4-8308-214158fa2178 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:03.456539 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-151ced81-39c1-47e4-8308-214158fa2178 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:03.457991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-151ced81-39c1-47e4-8308-214158fa2178 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:03.457991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-151ced81-39c1-47e4-8308-214158fa2178 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:03.458218 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-151ced81-39c1-47e4-8308-214158fa2178 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:03.989461 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4836773e-3152-495b-8d27-1bed513d3ad7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:04.017059 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4836773e-3152-495b-8d27-1bed513d3ad7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:04.020331 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4836773e-3152-495b-8d27-1bed513d3ad7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:04.030028 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4836773e-3152-495b-8d27-1bed513d3ad7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1411 microversion: 2.25 time: 0.694624 Oct 05 02:30:04.030748 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 392/783] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:03 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1411 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:04.039693 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b51cca98-d251-42fb-a0fd-ddec8456607b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:04.048610 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b51cca98-d251-42fb-a0fd-ddec8456607b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 34d20b05-afd7-4c5b-8af2-8176e33c041f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:04.063573 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b51cca98-d251-42fb-a0fd-ddec8456607b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:04.064560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b51cca98-d251-42fb-a0fd-ddec8456607b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:04.065204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b51cca98-d251-42fb-a0fd-ddec8456607b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:04.066100 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b51cca98-d251-42fb-a0fd-ddec8456607b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:04.066862 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b51cca98-d251-42fb-a0fd-ddec8456607b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:04.067544 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b51cca98-d251-42fb-a0fd-ddec8456607b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:04.226583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-151ced81-39c1-47e4-8308-214158fa2178 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:04.235641 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-151ced81-39c1-47e4-8308-214158fa2178 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1309 microversion: 2.1 time: 0.796397 Oct 05 02:30:04.248924 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 392/784] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:03 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1309 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:04.248924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b3ce8a45-23da-490d-8551-20b0276cbaba tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:04.248924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b3ce8a45-23da-490d-8551-20b0276cbaba tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] [instance: 2e297761-81b8-4084-938d-7e097b32cd44] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:04.248924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3ce8a45-23da-490d-8551-20b0276cbaba tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:04.248924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3ce8a45-23da-490d-8551-20b0276cbaba tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:04.249518 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3ce8a45-23da-490d-8551-20b0276cbaba tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:04.249518 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3ce8a45-23da-490d-8551-20b0276cbaba tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:04.249937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3ce8a45-23da-490d-8551-20b0276cbaba tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:04.250546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3ce8a45-23da-490d-8551-20b0276cbaba tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:04.264277 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-b3ce8a45-23da-490d-8551-20b0276cbaba tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] HTTP exception thrown: Instance 2e297761-81b8-4084-938d-7e097b32cd44 could not be found. Oct 05 02:30:04.266097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b3ce8a45-23da-490d-8551-20b0276cbaba tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Request method failure captured: Oct 05 02:30:04.266097 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44 HTTP/1.1 Oct 05 02:30:04.266097 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:30:04.266097 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:30:04.266097 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:30:04.266097 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:30:04.266097 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:30:04.266097 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:30:04.266097 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:30:04.266097 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:30:04.266097 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOvt5ABie31kmQBvA71bfR-amBCxfahjkJu1m3ADpiq5cWH23R5VKaeP1ppb1TjI1HICwto_EYD7cJ74ZnYpdWJdUuj2yKn5HuURNe-qeanM1mvinOZGA-2kqZSbZA33G80n4N2ZjkgJn4nA6OKzt0yqWjXSdVcbsT23vT2APmD80Lo Oct 05 02:30:04.266097 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:30:04.266097 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:30:04.266097 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:30:04.266097 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:30:04.266097 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:30:04.266097 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:30:04.266097 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 92e7bf1499e6408da408d85bddc4d95b Oct 05 02:30:04.266097 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServerGroupTestJSON-20245682 Oct 05 02:30:04.266097 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:30:04.266097 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:30:04.267834 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/92e7bf1499e6408da408d85bddc4d95b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/92e7bf1499e6408da408d85bddc4d95b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/92e7bf1499e6408da408d85bddc4d95b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_92e7bf1499e6408da408d85bddc4d95b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:30:04.267834 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServerGroupTestJSON-20245682 Oct 05 02:30:04.267834 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 92e7bf1499e6408da408d85bddc4d95b Oct 05 02:30:04.267834 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServerGroupTestJSON-20245682 Oct 05 02:30:04.267834 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServerGroupTestJSON-20245682-project Oct 05 02:30:04.267834 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:30:04.267834 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:30:04.267834 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 000b799366da44838465be08b88fb27d Oct 05 02:30:04.267834 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServerGroupTestJSON-20245682-project Oct 05 02:30:04.267834 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:30:04.267834 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 2e297761-81b8-4084-938d-7e097b32cd44 could not be found. Oct 05 02:30:04.267834 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '2e297761-81b8-4084-938d-7e097b32cd44'} Oct 05 02:30:04.268638 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:30:04.268638 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:04.268638 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:30:04.268638 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:30:04.268638 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:30:04.268638 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:30:04.268638 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:30:04.268638 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:30:04.268638 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:30:04.268638 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:30:04.268638 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e297761-81b8-4084-938d-7e097b32cd44 could not be found. Oct 05 02:30:04.268638 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:04.268638 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:04.268638 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:04.268638 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:04.268638 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:04.268638 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:04.268638 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:30:04.268638 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:30:04.268638 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:30:04.270004 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:30:04.270004 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:30:04.270004 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:30:04.270004 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:30:04.270004 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:30:04.270004 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:30:04.270004 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:30:04.270004 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:30:04.270004 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:30:04.270004 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e297761-81b8-4084-938d-7e097b32cd44 could not be found. Oct 05 02:30:04.270004 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:04.270004 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:04.270004 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:04.270004 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:04.270004 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:04.270004 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:04.270004 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:30:04.270004 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:30:04.270004 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e297761-81b8-4084-938d-7e097b32cd44 could not be found. Oct 05 02:30:04.270004 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:04.271526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b3ce8a45-23da-490d-8551-20b0276cbaba tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Returning 404 to user: Instance 2e297761-81b8-4084-938d-7e097b32cd44 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:30:04.271526 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b3ce8a45-23da-490d-8551-20b0276cbaba tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44" status: 404 len: 111 microversion: 2.1 time: 0.030073 Oct 05 02:30:04.271526 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 393/785] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:30:04 2022] DELETE /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:30:04.274602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f7adb827-85ca-4316-b3ff-1b7101c118f2 tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Action: 'create', calling method: .version_select at 0x7fcce4142790>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:04.333649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-f7adb827-85ca-4316-b3ff-1b7101c118f2 tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Getting quotas for project 771c0fc94e084c97a1359a1827c432f3. Resources: dict_keys(['metadata_items']) {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:30:04.340423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-f7adb827-85ca-4316-b3ff-1b7101c118f2 tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Getting quotas for user 2e1341253c2c40f986039ce69e1cda85 and project 771c0fc94e084c97a1359a1827c432f3. Resources: dict_keys(['metadata_items']) {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:30:04.462496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b51cca98-d251-42fb-a0fd-ddec8456607b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:04.475100 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b51cca98-d251-42fb-a0fd-ddec8456607b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f" status: 200 len: 1313 microversion: 2.1 time: 0.442926 Oct 05 02:30:04.478109 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 393/786] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:04 2022] GET /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f => generated 1313 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:04.506240 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d543cbef-27e5-48e9-875a-b3309669be92 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:04.506924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d543cbef-27e5-48e9-875a-b3309669be92 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] [instance: aaa20a8a-8a7b-42dd-9b4e-9165fba82942] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:04.521263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d543cbef-27e5-48e9-875a-b3309669be92 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:04.525247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d543cbef-27e5-48e9-875a-b3309669be92 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:04.525734 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d543cbef-27e5-48e9-875a-b3309669be92 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:04.527711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d543cbef-27e5-48e9-875a-b3309669be92 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:04.528189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d543cbef-27e5-48e9-875a-b3309669be92 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:04.529215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d543cbef-27e5-48e9-875a-b3309669be92 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:04.722173 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f7adb827-85ca-4316-b3ff-1b7101c118f2 tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] 10.222.0.16 "POST /compute/v2.1/images/5b16c5a0-3acf-479a-b49b-3c8aa65f4da0/metadata" status: 200 len: 85 microversion: 2.1 time: 0.452875 Oct 05 02:30:04.722801 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 394/787] 10.222.0.16 () {60 vars in 1281 bytes} [Wed Oct 5 02:30:04 2022] POST /compute/v2.1/images/5b16c5a0-3acf-479a-b49b-3c8aa65f4da0/metadata => generated 85 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:30:04.730683 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-a6c8e034-19b3-4195-9017-b533d8cf6b8f req-b7ed68e8-501a-49a4-9d31-31e1ee8dad57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34d20b05-afd7-4c5b-8af2-8176e33c041f", "tag": "b656d7a8-ccd2-4692-8b27-890477164d2a"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:04.741948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a6c8e034-19b3-4195-9017-b533d8cf6b8f req-b7ed68e8-501a-49a4-9d31-31e1ee8dad57 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:04.742491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a6c8e034-19b3-4195-9017-b533d8cf6b8f req-b7ed68e8-501a-49a4-9d31-31e1ee8dad57 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:04.742865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a6c8e034-19b3-4195-9017-b533d8cf6b8f req-b7ed68e8-501a-49a4-9d31-31e1ee8dad57 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:04.754751 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-a6c8e034-19b3-4195-9017-b533d8cf6b8f req-b7ed68e8-501a-49a4-9d31-31e1ee8dad57 service nova] Creating event network-changed:b656d7a8-ccd2-4692-8b27-890477164d2a for instance 34d20b05-afd7-4c5b-8af2-8176e33c041f on n-h2-858272-3 Oct 05 02:30:04.760122 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-a6c8e034-19b3-4195-9017-b533d8cf6b8f req-b7ed68e8-501a-49a4-9d31-31e1ee8dad57 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035985 Oct 05 02:30:04.760973 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 395/788] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:30:04.765878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4e1f8864-337b-4fb3-9424-c7041509eac9 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:04.766723 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4e1f8864-337b-4fb3-9424-c7041509eac9 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] [instance: 2e297761-81b8-4084-938d-7e097b32cd44] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:04.773184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e1f8864-337b-4fb3-9424-c7041509eac9 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:04.773901 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e1f8864-337b-4fb3-9424-c7041509eac9 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:04.774348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e1f8864-337b-4fb3-9424-c7041509eac9 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:04.775053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e1f8864-337b-4fb3-9424-c7041509eac9 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:04.775687 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e1f8864-337b-4fb3-9424-c7041509eac9 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:04.776120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e1f8864-337b-4fb3-9424-c7041509eac9 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:04.792776 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-4e1f8864-337b-4fb3-9424-c7041509eac9 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] HTTP exception thrown: Instance 2e297761-81b8-4084-938d-7e097b32cd44 could not be found. Oct 05 02:30:04.794537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4e1f8864-337b-4fb3-9424-c7041509eac9 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Request method failure captured: Oct 05 02:30:04.794537 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44 HTTP/1.1 Oct 05 02:30:04.794537 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:30:04.794537 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:30:04.794537 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:30:04.794537 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:30:04.794537 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:30:04.794537 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:30:04.794537 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:30:04.794537 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:30:04.794537 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOvt5ABie31kmQBvA71bfR-amBCxfahjkJu1m3ADpiq5cWH23R5VKaeP1ppb1TjI1HICwto_EYD7cJ74ZnYpdWJdUuj2yKn5HuURNe-qeanM1mvinOZGA-2kqZSbZA33G80n4N2ZjkgJn4nA6OKzt0yqWjXSdVcbsT23vT2APmD80Lo Oct 05 02:30:04.794537 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:30:04.794537 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:30:04.794537 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:30:04.794537 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:30:04.794537 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:30:04.794537 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:30:04.794537 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 92e7bf1499e6408da408d85bddc4d95b Oct 05 02:30:04.794537 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServerGroupTestJSON-20245682 Oct 05 02:30:04.794537 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:30:04.794537 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:30:04.795898 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/92e7bf1499e6408da408d85bddc4d95b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/92e7bf1499e6408da408d85bddc4d95b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/92e7bf1499e6408da408d85bddc4d95b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_92e7bf1499e6408da408d85bddc4d95b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:30:04.795898 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServerGroupTestJSON-20245682 Oct 05 02:30:04.795898 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 92e7bf1499e6408da408d85bddc4d95b Oct 05 02:30:04.795898 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServerGroupTestJSON-20245682 Oct 05 02:30:04.795898 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServerGroupTestJSON-20245682-project Oct 05 02:30:04.795898 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:30:04.795898 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:30:04.795898 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 000b799366da44838465be08b88fb27d Oct 05 02:30:04.795898 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServerGroupTestJSON-20245682-project Oct 05 02:30:04.795898 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:30:04.795898 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 2e297761-81b8-4084-938d-7e097b32cd44 could not be found. Oct 05 02:30:04.795898 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '2e297761-81b8-4084-938d-7e097b32cd44'} Oct 05 02:30:04.796659 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:30:04.796659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:04.796659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:30:04.796659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:30:04.796659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:30:04.796659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:30:04.796659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:30:04.796659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:30:04.796659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:30:04.796659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:30:04.796659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e297761-81b8-4084-938d-7e097b32cd44 could not be found. Oct 05 02:30:04.796659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:04.796659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:04.796659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:04.796659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:04.796659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:04.796659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:04.796659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:30:04.796659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:30:04.796659 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:30:04.798442 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:30:04.798442 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:30:04.798442 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:30:04.798442 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:30:04.798442 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:30:04.798442 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:30:04.798442 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:30:04.798442 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e297761-81b8-4084-938d-7e097b32cd44 could not be found. Oct 05 02:30:04.798442 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:04.798442 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:04.798442 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:04.798442 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:04.798442 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:04.798442 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:04.798442 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:30:04.798442 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:30:04.798442 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e297761-81b8-4084-938d-7e097b32cd44 could not be found. Oct 05 02:30:04.798442 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:04.799646 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4e1f8864-337b-4fb3-9424-c7041509eac9 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Returning 404 to user: Instance 2e297761-81b8-4084-938d-7e097b32cd44 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:30:04.799646 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4e1f8864-337b-4fb3-9424-c7041509eac9 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44" status: 404 len: 111 microversion: 2.1 time: 0.034077 Oct 05 02:30:04.799646 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 396/789] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:04 2022] GET /compute/v2.1/servers/2e297761-81b8-4084-938d-7e097b32cd44 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:30:04.802441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-922baa4b-0bdd-4c63-aeb6-6f90bc9a43a3 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:04.803482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-922baa4b-0bdd-4c63-aeb6-6f90bc9a43a3 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:04.808571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d543cbef-27e5-48e9-875a-b3309669be92 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f914ca523057422f88748746ba18b525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '407895b8d4e94b74a2cb652eb2c30048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:04.816820 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d543cbef-27e5-48e9-875a-b3309669be92 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942" status: 200 len: 1370 microversion: 2.1 time: 0.335870 Oct 05 02:30:04.817816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-922baa4b-0bdd-4c63-aeb6-6f90bc9a43a3 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:04.818324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-922baa4b-0bdd-4c63-aeb6-6f90bc9a43a3 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:04.818762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-922baa4b-0bdd-4c63-aeb6-6f90bc9a43a3 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:04.820185 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-922baa4b-0bdd-4c63-aeb6-6f90bc9a43a3 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:04.820748 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 394/790] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:04 2022] GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942 => generated 1370 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:04.821007 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-922baa4b-0bdd-4c63-aeb6-6f90bc9a43a3 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:04.821592 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-922baa4b-0bdd-4c63-aeb6-6f90bc9a43a3 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:04.835828 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-dd5240dc-2770-4fe9-afaa-5371c8c6cd61 req-e38ae228-3dd5-4e84-b60c-f92574c2b086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaa20a8a-8a7b-42dd-9b4e-9165fba82942", "tag": "a4ccf2aa-c3c8-483d-b7c6-24391c11f3bc"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:04.839141 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:04.846041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-dd5240dc-2770-4fe9-afaa-5371c8c6cd61 req-e38ae228-3dd5-4e84-b60c-f92574c2b086 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:04.846520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-dd5240dc-2770-4fe9-afaa-5371c8c6cd61 req-e38ae228-3dd5-4e84-b60c-f92574c2b086 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:04.846945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-dd5240dc-2770-4fe9-afaa-5371c8c6cd61 req-e38ae228-3dd5-4e84-b60c-f92574c2b086 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:04.858406 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-dd5240dc-2770-4fe9-afaa-5371c8c6cd61 req-e38ae228-3dd5-4e84-b60c-f92574c2b086 service nova] Creating event network-changed:a4ccf2aa-c3c8-483d-b7c6-24391c11f3bc for instance aaa20a8a-8a7b-42dd-9b4e-9165fba82942 on n-h1-858272-3 Oct 05 02:30:04.863260 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-dd5240dc-2770-4fe9-afaa-5371c8c6cd61 req-e38ae228-3dd5-4e84-b60c-f92574c2b086 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041321 Oct 05 02:30:04.864190 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 395/791] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:30:04.869121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2c7583f8-f722-484a-a01a-71d74d55ec52 tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] Calling method '.version_select at 0x7fcce41b25e0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:04.911178 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-922baa4b-0bdd-4c63-aeb6-6f90bc9a43a3 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:04.921149 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2c7583f8-f722-484a-a01a-71d74d55ec52 tempest-ImagesMetadataTestJSON-397722019 tempest-ImagesMetadataTestJSON-397722019-project] 10.222.0.16 "GET /compute/v2.1/images/5b16c5a0-3acf-479a-b49b-3c8aa65f4da0/metadata" status: 200 len: 85 microversion: 2.1 time: 0.055743 Oct 05 02:30:04.921902 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 396/792] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 5 02:30:04 2022] GET /compute/v2.1/images/5b16c5a0-3acf-479a-b49b-3c8aa65f4da0/metadata => generated 85 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:30:04.922076 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-922baa4b-0bdd-4c63-aeb6-6f90bc9a43a3 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:04.924264 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-922baa4b-0bdd-4c63-aeb6-6f90bc9a43a3 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:04.928457 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e2246c91-0b34-44d5-af9b-27c95bb0cafb tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:04.934871 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-e2246c91-0b34-44d5-af9b-27c95bb0cafb tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] HTTP exception thrown: Instance group c6727853-f203-4ef5-8449-7310401f6103 could not be found. Oct 05 02:30:04.938170 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e2246c91-0b34-44d5-af9b-27c95bb0cafb tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Request method failure captured: Oct 05 02:30:04.938170 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/os-server-groups/c6727853-f203-4ef5-8449-7310401f6103 HTTP/1.1 Oct 05 02:30:04.938170 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:30:04.938170 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:30:04.938170 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:30:04.938170 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:30:04.938170 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:30:04.938170 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:30:04.938170 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:30:04.938170 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:30:04.938170 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOvt5ABie31kmQBvA71bfR-amBCxfahjkJu1m3ADpiq5cWH23R5VKaeP1ppb1TjI1HICwto_EYD7cJ74ZnYpdWJdUuj2yKn5HuURNe-qeanM1mvinOZGA-2kqZSbZA33G80n4N2ZjkgJn4nA6OKzt0yqWjXSdVcbsT23vT2APmD80Lo Oct 05 02:30:04.938170 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:30:04.938170 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:30:04.938170 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:30:04.938170 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:30:04.938170 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:30:04.938170 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:30:04.938170 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 92e7bf1499e6408da408d85bddc4d95b Oct 05 02:30:04.938170 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerGroupTestJSON-20245682 Oct 05 02:30:04.938170 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:30:04.938170 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:30:04.939604 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/92e7bf1499e6408da408d85bddc4d95b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/92e7bf1499e6408da408d85bddc4d95b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/92e7bf1499e6408da408d85bddc4d95b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_92e7bf1499e6408da408d85bddc4d95b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:30:04.939604 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerGroupTestJSON-20245682 Oct 05 02:30:04.939604 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 92e7bf1499e6408da408d85bddc4d95b Oct 05 02:30:04.939604 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerGroupTestJSON-20245682 Oct 05 02:30:04.939604 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerGroupTestJSON-20245682-project Oct 05 02:30:04.939604 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:30:04.939604 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:30:04.939604 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 000b799366da44838465be08b88fb27d Oct 05 02:30:04.939604 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerGroupTestJSON-20245682-project Oct 05 02:30:04.939604 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:30:04.939604 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance group c6727853-f203-4ef5-8449-7310401f6103 could not be found. Oct 05 02:30:04.939604 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'c6727853-f203-4ef5-8449-7310401f6103'} Oct 05 02:30:04.940364 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:30:04.940364 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:04.940364 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 05 02:30:04.940364 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 05 02:30:04.940364 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:30:04.940364 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:30:04.940364 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 05 02:30:04.940364 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 05 02:30:04.940364 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 02:30:04.940364 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 02:30:04.940364 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 05 02:30:04.940364 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 05 02:30:04.940364 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c6727853-f203-4ef5-8449-7310401f6103 could not be found. Oct 05 02:30:04.940364 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:04.940364 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:04.940364 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:04.940364 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:04.940364 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:04.940364 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:04.942351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:30:04.942351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:30:04.942351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:30:04.942351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:30:04.942351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 05 02:30:04.942351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:30:04.942351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c6727853-f203-4ef5-8449-7310401f6103 could not be found. Oct 05 02:30:04.942351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:04.942351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:04.942351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:04.942351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:04.942351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:04.942351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:04.942351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:30:04.942351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:30:04.942351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c6727853-f203-4ef5-8449-7310401f6103 could not be found. Oct 05 02:30:04.942351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:04.943391 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e2246c91-0b34-44d5-af9b-27c95bb0cafb tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Returning 404 to user: Instance group c6727853-f203-4ef5-8449-7310401f6103 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:30:04.943391 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e2246c91-0b34-44d5-af9b-27c95bb0cafb tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/c6727853-f203-4ef5-8449-7310401f6103" status: 404 len: 117 microversion: 2.1 time: 0.016488 Oct 05 02:30:04.943541 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-922baa4b-0bdd-4c63-aeb6-6f90bc9a43a3 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1410 microversion: 2.75 time: 0.145223 Oct 05 02:30:04.944490 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 397/793] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 5 02:30:04 2022] DELETE /compute/v2.1/os-server-groups/c6727853-f203-4ef5-8449-7310401f6103 => generated 117 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:30:04.950517 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3fd60aac-8710-4531-9653-89f6433a4c44 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:04.958919 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 397/794] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:04 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1410 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:04.964991 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-3fd60aac-8710-4531-9653-89f6433a4c44 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] HTTP exception thrown: Instance group a1a7cde3-ba65-4aff-9bb2-16b288d5102e could not be found. Oct 05 02:30:04.966553 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3fd60aac-8710-4531-9653-89f6433a4c44 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Request method failure captured: Oct 05 02:30:04.966553 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/os-server-groups/a1a7cde3-ba65-4aff-9bb2-16b288d5102e HTTP/1.1 Oct 05 02:30:04.966553 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:30:04.966553 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:30:04.966553 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:30:04.966553 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:30:04.966553 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:30:04.966553 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:30:04.966553 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:30:04.966553 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:30:04.966553 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOvt5ABie31kmQBvA71bfR-amBCxfahjkJu1m3ADpiq5cWH23R5VKaeP1ppb1TjI1HICwto_EYD7cJ74ZnYpdWJdUuj2yKn5HuURNe-qeanM1mvinOZGA-2kqZSbZA33G80n4N2ZjkgJn4nA6OKzt0yqWjXSdVcbsT23vT2APmD80Lo Oct 05 02:30:04.966553 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:30:04.966553 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:30:04.966553 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:30:04.966553 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:30:04.966553 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:30:04.966553 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:30:04.966553 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 92e7bf1499e6408da408d85bddc4d95b Oct 05 02:30:04.966553 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerGroupTestJSON-20245682 Oct 05 02:30:04.966553 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:30:04.966553 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:30:04.968136 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/92e7bf1499e6408da408d85bddc4d95b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/92e7bf1499e6408da408d85bddc4d95b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/92e7bf1499e6408da408d85bddc4d95b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_92e7bf1499e6408da408d85bddc4d95b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:30:04.968136 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerGroupTestJSON-20245682 Oct 05 02:30:04.968136 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 92e7bf1499e6408da408d85bddc4d95b Oct 05 02:30:04.968136 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerGroupTestJSON-20245682 Oct 05 02:30:04.968136 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerGroupTestJSON-20245682-project Oct 05 02:30:04.968136 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:30:04.968136 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:30:04.968136 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 000b799366da44838465be08b88fb27d Oct 05 02:30:04.968136 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerGroupTestJSON-20245682-project Oct 05 02:30:04.968136 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:30:04.968136 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance group a1a7cde3-ba65-4aff-9bb2-16b288d5102e could not be found. Oct 05 02:30:04.968136 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'a1a7cde3-ba65-4aff-9bb2-16b288d5102e'} Oct 05 02:30:04.969570 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:30:04.969570 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:04.969570 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 05 02:30:04.969570 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 05 02:30:04.969570 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:30:04.969570 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:30:04.969570 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 05 02:30:04.969570 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 05 02:30:04.969570 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 02:30:04.969570 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 02:30:04.969570 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 05 02:30:04.969570 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 05 02:30:04.969570 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a1a7cde3-ba65-4aff-9bb2-16b288d5102e could not be found. Oct 05 02:30:04.969570 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:04.969570 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:04.969570 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:04.969570 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:04.969570 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:04.969570 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:04.970944 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:30:04.970944 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:30:04.970944 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:30:04.970944 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:30:04.970944 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 05 02:30:04.970944 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:30:04.970944 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a1a7cde3-ba65-4aff-9bb2-16b288d5102e could not be found. Oct 05 02:30:04.970944 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:04.970944 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:04.970944 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:04.970944 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:04.970944 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:04.970944 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:04.970944 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:30:04.970944 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:30:04.970944 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a1a7cde3-ba65-4aff-9bb2-16b288d5102e could not be found. Oct 05 02:30:04.970944 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:04.972154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3fd60aac-8710-4531-9653-89f6433a4c44 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Returning 404 to user: Instance group a1a7cde3-ba65-4aff-9bb2-16b288d5102e could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:30:04.972154 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3fd60aac-8710-4531-9653-89f6433a4c44 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/a1a7cde3-ba65-4aff-9bb2-16b288d5102e" status: 404 len: 117 microversion: 2.1 time: 0.022911 Oct 05 02:30:04.974194 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 398/795] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 5 02:30:04 2022] DELETE /compute/v2.1/os-server-groups/a1a7cde3-ba65-4aff-9bb2-16b288d5102e => generated 117 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:30:04.978845 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-081f2999-4b4b-410e-8dc1-280bc5fbbfdb tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:04.985386 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-081f2999-4b4b-410e-8dc1-280bc5fbbfdb tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] HTTP exception thrown: Instance group 35ecfd2f-0920-4a3b-8c42-6426127123db could not be found. Oct 05 02:30:04.987617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-081f2999-4b4b-410e-8dc1-280bc5fbbfdb tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Request method failure captured: Oct 05 02:30:04.987617 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/os-server-groups/35ecfd2f-0920-4a3b-8c42-6426127123db HTTP/1.1 Oct 05 02:30:04.987617 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:30:04.987617 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:30:04.987617 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:30:04.987617 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:30:04.987617 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:30:04.987617 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:30:04.987617 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:30:04.987617 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:30:04.987617 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOvt5ABie31kmQBvA71bfR-amBCxfahjkJu1m3ADpiq5cWH23R5VKaeP1ppb1TjI1HICwto_EYD7cJ74ZnYpdWJdUuj2yKn5HuURNe-qeanM1mvinOZGA-2kqZSbZA33G80n4N2ZjkgJn4nA6OKzt0yqWjXSdVcbsT23vT2APmD80Lo Oct 05 02:30:04.987617 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:30:04.987617 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:30:04.987617 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:30:04.987617 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:30:04.987617 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:30:04.987617 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:30:04.987617 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 92e7bf1499e6408da408d85bddc4d95b Oct 05 02:30:04.987617 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServerGroupTestJSON-20245682 Oct 05 02:30:04.987617 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:30:04.987617 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:30:04.988988 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/92e7bf1499e6408da408d85bddc4d95b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/92e7bf1499e6408da408d85bddc4d95b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/92e7bf1499e6408da408d85bddc4d95b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_92e7bf1499e6408da408d85bddc4d95b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:30:04.988988 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServerGroupTestJSON-20245682 Oct 05 02:30:04.988988 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 92e7bf1499e6408da408d85bddc4d95b Oct 05 02:30:04.988988 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServerGroupTestJSON-20245682 Oct 05 02:30:04.988988 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServerGroupTestJSON-20245682-project Oct 05 02:30:04.988988 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:30:04.988988 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:30:04.988988 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 000b799366da44838465be08b88fb27d Oct 05 02:30:04.988988 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServerGroupTestJSON-20245682-project Oct 05 02:30:04.988988 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:30:04.988988 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance group 35ecfd2f-0920-4a3b-8c42-6426127123db could not be found. Oct 05 02:30:04.988988 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '35ecfd2f-0920-4a3b-8c42-6426127123db'} Oct 05 02:30:04.989853 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:30:04.989853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:04.989853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 05 02:30:04.989853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 05 02:30:04.989853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:30:04.989853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:30:04.989853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 05 02:30:04.989853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 05 02:30:04.989853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 02:30:04.989853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 02:30:04.989853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 05 02:30:04.989853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 05 02:30:04.989853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 35ecfd2f-0920-4a3b-8c42-6426127123db could not be found. Oct 05 02:30:04.989853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:04.989853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:04.989853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:04.989853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:04.989853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:04.989853 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:04.992730 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:30:04.992730 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:30:04.992730 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:30:04.992730 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:30:04.992730 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 05 02:30:04.992730 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:30:04.992730 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 35ecfd2f-0920-4a3b-8c42-6426127123db could not be found. Oct 05 02:30:04.992730 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:04.992730 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:04.992730 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:04.992730 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:04.992730 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:04.992730 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:04.992730 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:30:04.992730 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:30:04.992730 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 35ecfd2f-0920-4a3b-8c42-6426127123db could not be found. Oct 05 02:30:04.992730 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:04.997107 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-081f2999-4b4b-410e-8dc1-280bc5fbbfdb tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Returning 404 to user: Instance group 35ecfd2f-0920-4a3b-8c42-6426127123db could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:30:04.997107 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-081f2999-4b4b-410e-8dc1-280bc5fbbfdb tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/35ecfd2f-0920-4a3b-8c42-6426127123db" status: 404 len: 117 microversion: 2.1 time: 0.015240 Oct 05 02:30:04.997107 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 398/796] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 5 02:30:04 2022] DELETE /compute/v2.1/os-server-groups/35ecfd2f-0920-4a3b-8c42-6426127123db => generated 117 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:30:04.998042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3c219bc1-702a-479f-b63d-3f7be2ddfc5b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:05.004351 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-3c219bc1-702a-479f-b63d-3f7be2ddfc5b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] HTTP exception thrown: Instance group 9b4718d5-cab6-4213-97c3-6cb50e13eaa3 could not be found. Oct 05 02:30:05.006024 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3c219bc1-702a-479f-b63d-3f7be2ddfc5b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Request method failure captured: Oct 05 02:30:05.006024 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/os-server-groups/9b4718d5-cab6-4213-97c3-6cb50e13eaa3 HTTP/1.1 Oct 05 02:30:05.006024 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:30:05.006024 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:30:05.006024 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:30:05.006024 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:30:05.006024 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:30:05.006024 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:30:05.006024 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:30:05.006024 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:30:05.006024 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOvt5ABie31kmQBvA71bfR-amBCxfahjkJu1m3ADpiq5cWH23R5VKaeP1ppb1TjI1HICwto_EYD7cJ74ZnYpdWJdUuj2yKn5HuURNe-qeanM1mvinOZGA-2kqZSbZA33G80n4N2ZjkgJn4nA6OKzt0yqWjXSdVcbsT23vT2APmD80Lo Oct 05 02:30:05.006024 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:30:05.006024 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:30:05.006024 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:30:05.006024 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:30:05.006024 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:30:05.006024 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:30:05.006024 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 92e7bf1499e6408da408d85bddc4d95b Oct 05 02:30:05.006024 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerGroupTestJSON-20245682 Oct 05 02:30:05.006024 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:30:05.006024 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:30:05.008342 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/92e7bf1499e6408da408d85bddc4d95b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/92e7bf1499e6408da408d85bddc4d95b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/92e7bf1499e6408da408d85bddc4d95b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_92e7bf1499e6408da408d85bddc4d95b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:30:05.008342 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerGroupTestJSON-20245682 Oct 05 02:30:05.008342 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 92e7bf1499e6408da408d85bddc4d95b Oct 05 02:30:05.008342 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerGroupTestJSON-20245682 Oct 05 02:30:05.008342 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerGroupTestJSON-20245682-project Oct 05 02:30:05.008342 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:30:05.008342 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:30:05.008342 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 000b799366da44838465be08b88fb27d Oct 05 02:30:05.008342 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerGroupTestJSON-20245682-project Oct 05 02:30:05.008342 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:30:05.008342 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance group 9b4718d5-cab6-4213-97c3-6cb50e13eaa3 could not be found. Oct 05 02:30:05.008342 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '9b4718d5-cab6-4213-97c3-6cb50e13eaa3'} Oct 05 02:30:05.009604 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:30:05.009604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:05.009604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 05 02:30:05.009604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 05 02:30:05.009604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:30:05.009604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:30:05.009604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 05 02:30:05.009604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 05 02:30:05.009604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 02:30:05.009604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 02:30:05.009604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 05 02:30:05.009604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 05 02:30:05.009604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 9b4718d5-cab6-4213-97c3-6cb50e13eaa3 could not be found. Oct 05 02:30:05.009604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:05.009604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:05.009604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:05.009604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:05.009604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:05.009604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:05.011952 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:30:05.011952 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:30:05.011952 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:30:05.011952 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:30:05.011952 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 05 02:30:05.011952 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:30:05.011952 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 9b4718d5-cab6-4213-97c3-6cb50e13eaa3 could not be found. Oct 05 02:30:05.011952 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:05.011952 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:05.011952 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:05.011952 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:05.011952 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:05.011952 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:05.011952 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:30:05.011952 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:30:05.011952 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 9b4718d5-cab6-4213-97c3-6cb50e13eaa3 could not be found. Oct 05 02:30:05.011952 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:05.014046 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3c219bc1-702a-479f-b63d-3f7be2ddfc5b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Returning 404 to user: Instance group 9b4718d5-cab6-4213-97c3-6cb50e13eaa3 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:30:05.014046 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3c219bc1-702a-479f-b63d-3f7be2ddfc5b tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/9b4718d5-cab6-4213-97c3-6cb50e13eaa3" status: 404 len: 117 microversion: 2.1 time: 0.013987 Oct 05 02:30:05.014046 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 399/797] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 5 02:30:04 2022] DELETE /compute/v2.1/os-server-groups/9b4718d5-cab6-4213-97c3-6cb50e13eaa3 => generated 117 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:30:05.016772 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e95a5acb-2f2f-47cf-8297-bee08cc72d10 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:05.056477 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e95a5acb-2f2f-47cf-8297-bee08cc72d10 tempest-ServerGroupTestJSON-20245682 tempest-ServerGroupTestJSON-20245682-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/67851fb0-7c17-46d0-b291-609cb196ff0c" status: 204 len: 0 microversion: 2.1 time: 0.042852 Oct 05 02:30:05.057056 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a27bb6b6-57da-400e-bcb0-9354b920da5e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:05.057731 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 399/798] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 5 02:30:05 2022] DELETE /compute/v2.1/os-server-groups/67851fb0-7c17-46d0-b291-609cb196ff0c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 02:30:05.058299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a27bb6b6-57da-400e-bcb0-9354b920da5e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:05.066276 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a27bb6b6-57da-400e-bcb0-9354b920da5e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:05.067096 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a27bb6b6-57da-400e-bcb0-9354b920da5e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:05.067761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a27bb6b6-57da-400e-bcb0-9354b920da5e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:05.068766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a27bb6b6-57da-400e-bcb0-9354b920da5e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:05.069835 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a27bb6b6-57da-400e-bcb0-9354b920da5e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:05.070166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a27bb6b6-57da-400e-bcb0-9354b920da5e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:05.224674 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a27bb6b6-57da-400e-bcb0-9354b920da5e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:05.228461 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:05.235150 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a27bb6b6-57da-400e-bcb0-9354b920da5e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:05.236957 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a27bb6b6-57da-400e-bcb0-9354b920da5e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:05.238136 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a27bb6b6-57da-400e-bcb0-9354b920da5e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1607 microversion: 2.25 time: 0.186007 Oct 05 02:30:05.238772 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 400/799] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:05 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1607 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:05.260630 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-963d73b6-d7e9-43c5-b45b-9649d02d293b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:05.262122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-963d73b6-d7e9-43c5-b45b-9649d02d293b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:05.268061 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a69b43d7-22a6-478f-a720-539520d8a40d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:05.268850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a69b43d7-22a6-478f-a720-539520d8a40d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:05.269844 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-963d73b6-d7e9-43c5-b45b-9649d02d293b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:05.270425 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-963d73b6-d7e9-43c5-b45b-9649d02d293b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:05.271073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-963d73b6-d7e9-43c5-b45b-9649d02d293b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:05.271979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-963d73b6-d7e9-43c5-b45b-9649d02d293b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:05.272807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-963d73b6-d7e9-43c5-b45b-9649d02d293b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:05.273298 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-963d73b6-d7e9-43c5-b45b-9649d02d293b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:05.275766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a69b43d7-22a6-478f-a720-539520d8a40d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:05.276239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a69b43d7-22a6-478f-a720-539520d8a40d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:05.276742 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a69b43d7-22a6-478f-a720-539520d8a40d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:05.277387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a69b43d7-22a6-478f-a720-539520d8a40d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:05.278066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a69b43d7-22a6-478f-a720-539520d8a40d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:05.278484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a69b43d7-22a6-478f-a720-539520d8a40d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:05.400312 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a69b43d7-22a6-478f-a720-539520d8a40d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.138474 Oct 05 02:30:05.401469 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 401/800] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Oct 5 02:30:05 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0/os-interface => generated 284 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 02:30:05.504349 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5eb6db05-7fd3-47ce-a9c6-42d9fb4f569a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:05.505381 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5eb6db05-7fd3-47ce-a9c6-42d9fb4f569a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 34d20b05-afd7-4c5b-8af2-8176e33c041f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:05.514711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5eb6db05-7fd3-47ce-a9c6-42d9fb4f569a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:05.515477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5eb6db05-7fd3-47ce-a9c6-42d9fb4f569a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:05.516606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5eb6db05-7fd3-47ce-a9c6-42d9fb4f569a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:05.517712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5eb6db05-7fd3-47ce-a9c6-42d9fb4f569a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:05.518333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5eb6db05-7fd3-47ce-a9c6-42d9fb4f569a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:05.518920 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5eb6db05-7fd3-47ce-a9c6-42d9fb4f569a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:05.614900 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-963d73b6-d7e9-43c5-b45b-9649d02d293b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:05.627738 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-963d73b6-d7e9-43c5-b45b-9649d02d293b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1309 microversion: 2.1 time: 0.371892 Oct 05 02:30:05.632806 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 400/801] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:05 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1309 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:05.817205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5eb6db05-7fd3-47ce-a9c6-42d9fb4f569a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:05.826811 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5eb6db05-7fd3-47ce-a9c6-42d9fb4f569a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f" status: 200 len: 1313 microversion: 2.1 time: 0.326674 Oct 05 02:30:05.829730 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 402/802] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:05 2022] GET /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f => generated 1313 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:30:05.849650 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-014c2950-9257-492d-97ab-66193263ccbc tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:05.850488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-014c2950-9257-492d-97ab-66193263ccbc tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] [instance: aaa20a8a-8a7b-42dd-9b4e-9165fba82942] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:05.857619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-014c2950-9257-492d-97ab-66193263ccbc tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:05.858329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-014c2950-9257-492d-97ab-66193263ccbc tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:05.858932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-014c2950-9257-492d-97ab-66193263ccbc tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:05.860392 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-014c2950-9257-492d-97ab-66193263ccbc tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:05.861038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-014c2950-9257-492d-97ab-66193263ccbc tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:05.861619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-014c2950-9257-492d-97ab-66193263ccbc tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:05.973082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-006ba3a4-2d04-47f4-84da-8566078b06d2 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:05.974502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-006ba3a4-2d04-47f4-84da-8566078b06d2 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:05.985332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-006ba3a4-2d04-47f4-84da-8566078b06d2 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:05.989547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-006ba3a4-2d04-47f4-84da-8566078b06d2 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:05.992356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-006ba3a4-2d04-47f4-84da-8566078b06d2 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:05.993367 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-006ba3a4-2d04-47f4-84da-8566078b06d2 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:05.994035 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-006ba3a4-2d04-47f4-84da-8566078b06d2 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:05.995932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-006ba3a4-2d04-47f4-84da-8566078b06d2 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:06.447464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-006ba3a4-2d04-47f4-84da-8566078b06d2 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:06.458723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-006ba3a4-2d04-47f4-84da-8566078b06d2 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:06.461112 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-006ba3a4-2d04-47f4-84da-8566078b06d2 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:06.467370 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-006ba3a4-2d04-47f4-84da-8566078b06d2 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1410 microversion: 2.75 time: 0.498617 Oct 05 02:30:06.468830 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 403/803] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:05 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1410 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:06.652072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-22f96c2c-b208-4ce1-a309-c9a007af24b5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:06.653328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-22f96c2c-b208-4ce1-a309-c9a007af24b5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:06.666679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22f96c2c-b208-4ce1-a309-c9a007af24b5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:06.673681 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22f96c2c-b208-4ce1-a309-c9a007af24b5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:06.674613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22f96c2c-b208-4ce1-a309-c9a007af24b5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:06.675613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22f96c2c-b208-4ce1-a309-c9a007af24b5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:06.680120 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22f96c2c-b208-4ce1-a309-c9a007af24b5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:06.684024 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22f96c2c-b208-4ce1-a309-c9a007af24b5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:06.692421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-014c2950-9257-492d-97ab-66193263ccbc tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f914ca523057422f88748746ba18b525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '407895b8d4e94b74a2cb652eb2c30048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:06.709365 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-014c2950-9257-492d-97ab-66193263ccbc tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942" status: 200 len: 1370 microversion: 2.1 time: 0.860729 Oct 05 02:30:06.727748 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 401/804] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:05 2022] GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942 => generated 1370 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:06.856232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-11338b21-8614-4315-a4c1-3de4d45e731f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:06.857624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-11338b21-8614-4315-a4c1-3de4d45e731f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 34d20b05-afd7-4c5b-8af2-8176e33c041f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:06.884263 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11338b21-8614-4315-a4c1-3de4d45e731f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:06.887988 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11338b21-8614-4315-a4c1-3de4d45e731f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:06.890010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11338b21-8614-4315-a4c1-3de4d45e731f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:06.892238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11338b21-8614-4315-a4c1-3de4d45e731f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:06.892877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11338b21-8614-4315-a4c1-3de4d45e731f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:06.894267 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11338b21-8614-4315-a4c1-3de4d45e731f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:07.465474 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-22f96c2c-b208-4ce1-a309-c9a007af24b5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:07.481234 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-22f96c2c-b208-4ce1-a309-c9a007af24b5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1309 microversion: 2.1 time: 0.833530 Oct 05 02:30:07.497792 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 404/805] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:06 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1309 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:07.503415 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-8f90cf5b-46ed-466f-b4f8-a76d7f54b215 req-d33429a5-04f1-4aef-8c74-65105fe1a99b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "861e3da3-98a1-4728-b218-322c9db128b3", "tag": "1414377b-0304-4553-b209-c5c3a5855cea"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:07.513907 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-8f90cf5b-46ed-466f-b4f8-a76d7f54b215 req-d33429a5-04f1-4aef-8c74-65105fe1a99b service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:07.514659 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-8f90cf5b-46ed-466f-b4f8-a76d7f54b215 req-d33429a5-04f1-4aef-8c74-65105fe1a99b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:07.515247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-8f90cf5b-46ed-466f-b4f8-a76d7f54b215 req-d33429a5-04f1-4aef-8c74-65105fe1a99b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:07.528607 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-8f90cf5b-46ed-466f-b4f8-a76d7f54b215 req-d33429a5-04f1-4aef-8c74-65105fe1a99b service nova] Creating event network-changed:1414377b-0304-4553-b209-c5c3a5855cea for instance 861e3da3-98a1-4728-b218-322c9db128b3 on n-h2-858272-3 Oct 05 02:30:07.535345 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-8f90cf5b-46ed-466f-b4f8-a76d7f54b215 req-d33429a5-04f1-4aef-8c74-65105fe1a99b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035883 Oct 05 02:30:07.536106 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 405/806] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:30:07.541883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2489e7df-6a18-481a-8fb9-2283c18fb870 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:07.542854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2489e7df-6a18-481a-8fb9-2283c18fb870 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:07.550290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2489e7df-6a18-481a-8fb9-2283c18fb870 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:07.550776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2489e7df-6a18-481a-8fb9-2283c18fb870 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:07.551381 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2489e7df-6a18-481a-8fb9-2283c18fb870 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:07.552236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2489e7df-6a18-481a-8fb9-2283c18fb870 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:07.553335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2489e7df-6a18-481a-8fb9-2283c18fb870 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:07.554316 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2489e7df-6a18-481a-8fb9-2283c18fb870 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:07.598299 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-11338b21-8614-4315-a4c1-3de4d45e731f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:07.607888 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-11338b21-8614-4315-a4c1-3de4d45e731f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f" status: 200 len: 1313 microversion: 2.1 time: 0.759830 Oct 05 02:30:07.608873 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 402/807] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:06 2022] GET /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f => generated 1313 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:07.695022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2489e7df-6a18-481a-8fb9-2283c18fb870 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:07.725831 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2489e7df-6a18-481a-8fb9-2283c18fb870 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:07.736494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fc02a52d-cbf8-43cc-9fa5-459a7eac9a0f tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:07.737134 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fc02a52d-cbf8-43cc-9fa5-459a7eac9a0f tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] [instance: aaa20a8a-8a7b-42dd-9b4e-9165fba82942] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:07.743335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2489e7df-6a18-481a-8fb9-2283c18fb870 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:07.752621 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc02a52d-cbf8-43cc-9fa5-459a7eac9a0f tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:07.753172 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc02a52d-cbf8-43cc-9fa5-459a7eac9a0f tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:07.753590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc02a52d-cbf8-43cc-9fa5-459a7eac9a0f tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:07.754299 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc02a52d-cbf8-43cc-9fa5-459a7eac9a0f tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:07.754752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc02a52d-cbf8-43cc-9fa5-459a7eac9a0f tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:07.755167 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc02a52d-cbf8-43cc-9fa5-459a7eac9a0f tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:07.755529 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2489e7df-6a18-481a-8fb9-2283c18fb870 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1416 microversion: 2.75 time: 0.217350 Oct 05 02:30:07.756592 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 406/808] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:07 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1416 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:08.361526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fc02a52d-cbf8-43cc-9fa5-459a7eac9a0f tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f914ca523057422f88748746ba18b525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '407895b8d4e94b74a2cb652eb2c30048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:08.372014 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fc02a52d-cbf8-43cc-9fa5-459a7eac9a0f tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942" status: 200 len: 1370 microversion: 2.1 time: 0.639855 Oct 05 02:30:08.378917 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 403/809] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:07 2022] GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942 => generated 1370 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:30:08.512502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-059e97c3-5c26-489a-b02e-69ffea2b8bd2 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:08.516882 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-059e97c3-5c26-489a-b02e-69ffea2b8bd2 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:08.532168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-059e97c3-5c26-489a-b02e-69ffea2b8bd2 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:08.533034 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-059e97c3-5c26-489a-b02e-69ffea2b8bd2 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:08.534612 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-059e97c3-5c26-489a-b02e-69ffea2b8bd2 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:08.536988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-059e97c3-5c26-489a-b02e-69ffea2b8bd2 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:08.537656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-059e97c3-5c26-489a-b02e-69ffea2b8bd2 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:08.539327 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-059e97c3-5c26-489a-b02e-69ffea2b8bd2 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:08.632702 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d7eeb69d-518b-48a4-9cb4-776645c25820 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:08.633642 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d7eeb69d-518b-48a4-9cb4-776645c25820 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 34d20b05-afd7-4c5b-8af2-8176e33c041f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:08.642782 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7eeb69d-518b-48a4-9cb4-776645c25820 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:08.645081 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7eeb69d-518b-48a4-9cb4-776645c25820 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:08.646119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7eeb69d-518b-48a4-9cb4-776645c25820 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:08.648052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7eeb69d-518b-48a4-9cb4-776645c25820 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:08.649763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7eeb69d-518b-48a4-9cb4-776645c25820 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:08.650440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7eeb69d-518b-48a4-9cb4-776645c25820 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:08.926964 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-059e97c3-5c26-489a-b02e-69ffea2b8bd2 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:08.938841 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-059e97c3-5c26-489a-b02e-69ffea2b8bd2 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1309 microversion: 2.1 time: 0.434258 Oct 05 02:30:08.955142 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 407/810] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:08 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1309 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:08.962735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d7eeb69d-518b-48a4-9cb4-776645c25820 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:08.974697 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d7eeb69d-518b-48a4-9cb4-776645c25820 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f" status: 200 len: 1313 microversion: 2.1 time: 0.345602 Oct 05 02:30:08.975226 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 404/811] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:08 2022] GET /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f => generated 1313 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:30:08.983529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dc9ee808-2660-439b-8c0c-02d3238ce2a5 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:08.985371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dc9ee808-2660-439b-8c0c-02d3238ce2a5 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:08.996601 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dc9ee808-2660-439b-8c0c-02d3238ce2a5 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:08.997332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dc9ee808-2660-439b-8c0c-02d3238ce2a5 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:08.997949 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dc9ee808-2660-439b-8c0c-02d3238ce2a5 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:08.998964 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dc9ee808-2660-439b-8c0c-02d3238ce2a5 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:09.000765 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dc9ee808-2660-439b-8c0c-02d3238ce2a5 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:09.001852 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dc9ee808-2660-439b-8c0c-02d3238ce2a5 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:09.115506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dc9ee808-2660-439b-8c0c-02d3238ce2a5 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:09.129665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dc9ee808-2660-439b-8c0c-02d3238ce2a5 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:09.131642 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dc9ee808-2660-439b-8c0c-02d3238ce2a5 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:09.140423 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dc9ee808-2660-439b-8c0c-02d3238ce2a5 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1416 microversion: 2.75 time: 0.160866 Oct 05 02:30:09.142971 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 405/812] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:08 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1416 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:09.230997 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f15cfa18-2a40-43b3-95f2-ddd3ac6cc8ec tempest-ImagesDeleteNegativeTestJSON-99302038 tempest-ImagesDeleteNegativeTestJSON-99302038-project] 10.222.0.16 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.274686 Oct 05 02:30:09.232361 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 408/813] 10.222.0.16 () {58 vars in 1128 bytes} [Wed Oct 5 02:30:08 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 05 02:30:09.242379 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8db0dfbd-9074-4026-83b9-05cb15001600 tempest-ImagesDeleteNegativeTestJSON-99302038 tempest-ImagesDeleteNegativeTestJSON-99302038-project] Calling method '.version_select at 0x7fcce435bb80>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:09.404441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-deea1bb9-99a5-43bf-93ff-e9d0e0761913 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:09.406816 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-deea1bb9-99a5-43bf-93ff-e9d0e0761913 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] [instance: aaa20a8a-8a7b-42dd-9b4e-9165fba82942] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:09.420024 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-deea1bb9-99a5-43bf-93ff-e9d0e0761913 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:09.423687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-deea1bb9-99a5-43bf-93ff-e9d0e0761913 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:09.424449 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-deea1bb9-99a5-43bf-93ff-e9d0e0761913 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:09.425619 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-deea1bb9-99a5-43bf-93ff-e9d0e0761913 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:09.426308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-deea1bb9-99a5-43bf-93ff-e9d0e0761913 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:09.428333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-deea1bb9-99a5-43bf-93ff-e9d0e0761913 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:09.556088 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-8db0dfbd-9074-4026-83b9-05cb15001600 tempest-ImagesDeleteNegativeTestJSON-99302038 tempest-ImagesDeleteNegativeTestJSON-99302038-project] HTTP exception thrown: Image not found. Oct 05 02:30:09.680006 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8db0dfbd-9074-4026-83b9-05cb15001600 tempest-ImagesDeleteNegativeTestJSON-99302038 tempest-ImagesDeleteNegativeTestJSON-99302038-project] Request method failure captured: Oct 05 02:30:09.680006 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 05 02:30:09.680006 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:30:09.680006 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:30:09.680006 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:30:09.680006 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:30:09.680006 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:30:09.680006 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:30:09.680006 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:30:09.680006 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:30:09.680006 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOwww8_gYENdnfDsQRSAOD_pyjnhfMh5Unq66D2jtOzNZurdIhv4_6nQuYIH5K_nx6ZYejHmUlJpYA9khRI9IL6OwTkcLGtH9zTkbhc4NKBJ7qZXCtxWGqvbbAitf0jnJYv1cXtEhx2iuBuR0qk2Pj-CySGM7oykVfLcSJPBXyAOpyc Oct 05 02:30:09.680006 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:30:09.680006 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:30:09.680006 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:30:09.680006 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:30:09.680006 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:30:09.680006 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:30:09.680006 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 8072e08fc827483684eb2f358cb0b9ac Oct 05 02:30:09.680006 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-99302038 Oct 05 02:30:09.680006 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:30:09.680006 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:30:09.681732 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8072e08fc827483684eb2f358cb0b9ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8072e08fc827483684eb2f358cb0b9ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8072e08fc827483684eb2f358cb0b9ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8072e08fc827483684eb2f358cb0b9ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:30:09.681732 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-99302038 Oct 05 02:30:09.681732 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 8072e08fc827483684eb2f358cb0b9ac Oct 05 02:30:09.681732 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-99302038 Oct 05 02:30:09.681732 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ImagesDeleteNegativeTestJSON-99302038-project Oct 05 02:30:09.681732 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:30:09.681732 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:30:09.681732 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 461c391ba5ae4e57885297bfaf4a3c5e Oct 05 02:30:09.681732 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-99302038-project Oct 05 02:30:09.681732 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:30:09.681732 n-d-858272-3 devstack@n-api.service[122320]: exception: Image not found. Oct 05 02:30:09.681732 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '-1'} Oct 05 02:30:09.681732 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:30:09.681732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:09.688467 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 05 02:30:09.688467 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 05 02:30:09.688467 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 02:30:09.688467 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 02:30:09.688467 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 02:30:09.688467 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 02:30:09.688467 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 05 02:30:09.688467 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 05 02:30:09.688467 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 05 02:30:09.688467 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 05 02:30:09.688467 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 02:30:09.688467 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 02:30:09.688467 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 02:30:09.688467 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 02:30:09.688467 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 05 02:30:09.688467 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:09.688467 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:09.688467 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:09.688467 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:09.690039 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 05 02:30:09.690039 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 05 02:30:09.690039 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 05 02:30:09.690039 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 05 02:30:09.690039 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 05 02:30:09.690039 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 05 02:30:09.690039 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 05 02:30:09.690039 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:09.690039 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:09.690039 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:09.690039 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:09.690039 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:09.690039 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:09.690039 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:30:09.690039 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:30:09.690039 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:30:09.690039 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:30:09.690039 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:30:09.690039 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:30:09.690039 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 05 02:30:09.691522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 05 02:30:09.691522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 02:30:09.691522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:09.691522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:09.691522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:09.691522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:09.691522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:09.691522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:09.691522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:30:09.691522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:30:09.691522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 02:30:09.691522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:09.691522 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8db0dfbd-9074-4026-83b9-05cb15001600 tempest-ImagesDeleteNegativeTestJSON-99302038 tempest-ImagesDeleteNegativeTestJSON-99302038-project] Returning 404 to user: Image not found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:30:09.691522 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8db0dfbd-9074-4026-83b9-05cb15001600 tempest-ImagesDeleteNegativeTestJSON-99302038 tempest-ImagesDeleteNegativeTestJSON-99302038-project] 10.222.0.16 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.443664 Oct 05 02:30:09.691522 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 406/814] 10.222.0.16 () {58 vars in 1134 bytes} [Wed Oct 5 02:30:09 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 445 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:30:09.692646 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-0374d988-c933-4d2b-a9ab-c29ff5e3b427 req-9d9540ae-5635-4b0a-abfe-a7890e620da7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d497c63f-2a3d-4dbd-95d5-d2b90e743ac0", "tag": "3a205846-298f-466b-b6e3-8f110f0f22de"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:09.731883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-deea1bb9-99a5-43bf-93ff-e9d0e0761913 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f914ca523057422f88748746ba18b525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '407895b8d4e94b74a2cb652eb2c30048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:09.732778 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-0374d988-c933-4d2b-a9ab-c29ff5e3b427 req-9d9540ae-5635-4b0a-abfe-a7890e620da7 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:09.733623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-0374d988-c933-4d2b-a9ab-c29ff5e3b427 req-9d9540ae-5635-4b0a-abfe-a7890e620da7 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:09.734054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-0374d988-c933-4d2b-a9ab-c29ff5e3b427 req-9d9540ae-5635-4b0a-abfe-a7890e620da7 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:09.744208 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-deea1bb9-99a5-43bf-93ff-e9d0e0761913 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942" status: 200 len: 1370 microversion: 2.1 time: 0.344206 Oct 05 02:30:09.759639 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 409/815] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:09 2022] GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942 => generated 1370 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:09.759639 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-be2604df-9f3d-4c36-9cd0-bfd90dc84e17 tempest-ImagesDeleteNegativeTestJSON-99302038 tempest-ImagesDeleteNegativeTestJSON-99302038-project] Calling method '.version_select at 0x7fcce429ed30>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:09.761817 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-0374d988-c933-4d2b-a9ab-c29ff5e3b427 req-9d9540ae-5635-4b0a-abfe-a7890e620da7 service nova] Creating event network-changed:3a205846-298f-466b-b6e3-8f110f0f22de for instance d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 on n-h2-858272-3 Oct 05 02:30:09.822062 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-0374d988-c933-4d2b-a9ab-c29ff5e3b427 req-9d9540ae-5635-4b0a-abfe-a7890e620da7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134735 Oct 05 02:30:09.822480 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 407/816] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:30:09.837452 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-be2604df-9f3d-4c36-9cd0-bfd90dc84e17 tempest-ImagesDeleteNegativeTestJSON-99302038 tempest-ImagesDeleteNegativeTestJSON-99302038-project] HTTP exception thrown: Image not found. Oct 05 02:30:09.846320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-be2604df-9f3d-4c36-9cd0-bfd90dc84e17 tempest-ImagesDeleteNegativeTestJSON-99302038 tempest-ImagesDeleteNegativeTestJSON-99302038-project] Request method failure captured: Oct 05 02:30:09.846320 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/images/80d8cd02-72d0-45f8-b5c8-7f17b39f432j HTTP/1.1 Oct 05 02:30:09.846320 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:30:09.846320 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:30:09.846320 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:30:09.846320 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:30:09.846320 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:30:09.846320 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:30:09.846320 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:30:09.846320 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:30:09.846320 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOwww8_gYENdnfDsQRSAOD_pyjnhfMh5Unq66D2jtOzNZurdIhv4_6nQuYIH5K_nx6ZYejHmUlJpYA9khRI9IL6OwTkcLGtH9zTkbhc4NKBJ7qZXCtxWGqvbbAitf0jnJYv1cXtEhx2iuBuR0qk2Pj-CySGM7oykVfLcSJPBXyAOpyc Oct 05 02:30:09.846320 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:30:09.846320 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:30:09.846320 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:30:09.846320 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:30:09.846320 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:30:09.846320 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:30:09.846320 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 8072e08fc827483684eb2f358cb0b9ac Oct 05 02:30:09.846320 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-99302038 Oct 05 02:30:09.846320 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:30:09.846320 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:30:09.847984 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8072e08fc827483684eb2f358cb0b9ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8072e08fc827483684eb2f358cb0b9ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8072e08fc827483684eb2f358cb0b9ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8072e08fc827483684eb2f358cb0b9ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:30:09.847984 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-99302038 Oct 05 02:30:09.847984 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 8072e08fc827483684eb2f358cb0b9ac Oct 05 02:30:09.847984 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-99302038 Oct 05 02:30:09.847984 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ImagesDeleteNegativeTestJSON-99302038-project Oct 05 02:30:09.847984 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:30:09.847984 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:30:09.847984 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 461c391ba5ae4e57885297bfaf4a3c5e Oct 05 02:30:09.847984 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-99302038-project Oct 05 02:30:09.847984 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:30:09.847984 n-d-858272-3 devstack@n-api.service[122319]: exception: Image not found. Oct 05 02:30:09.847984 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '80d8cd02-72d0-45f8-b5c8-7f17b39f432j'} Oct 05 02:30:09.847984 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:30:09.848823 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:09.848823 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 05 02:30:09.848823 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 05 02:30:09.848823 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 02:30:09.848823 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 02:30:09.848823 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 02:30:09.848823 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 02:30:09.848823 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 05 02:30:09.848823 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 05 02:30:09.848823 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 05 02:30:09.848823 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 05 02:30:09.848823 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 02:30:09.848823 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 02:30:09.848823 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 02:30:09.848823 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 02:30:09.848823 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 80d8cd02-72d0-45f8-b5c8-7f17b39f432j to delete Oct 05 02:30:09.848823 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:09.848823 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:09.848823 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:09.850524 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:09.850524 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 05 02:30:09.850524 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 05 02:30:09.850524 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 05 02:30:09.850524 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 05 02:30:09.850524 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 05 02:30:09.850524 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 05 02:30:09.850524 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 80d8cd02-72d0-45f8-b5c8-7f17b39f432j could not be found. Oct 05 02:30:09.850524 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:09.850524 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:09.850524 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:09.850524 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:09.850524 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:09.850524 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:09.850524 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:30:09.850524 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:30:09.850524 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:30:09.850524 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:30:09.850524 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:30:09.850524 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:30:09.851971 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 05 02:30:09.851971 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 05 02:30:09.851971 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 02:30:09.851971 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:09.851971 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:09.851971 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:09.851971 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:09.851971 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:09.851971 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:09.851971 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:30:09.851971 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:30:09.851971 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 02:30:09.851971 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:09.857038 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-be2604df-9f3d-4c36-9cd0-bfd90dc84e17 tempest-ImagesDeleteNegativeTestJSON-99302038 tempest-ImagesDeleteNegativeTestJSON-99302038-project] Returning 404 to user: Image not found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:30:09.861904 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-be2604df-9f3d-4c36-9cd0-bfd90dc84e17 tempest-ImagesDeleteNegativeTestJSON-99302038 tempest-ImagesDeleteNegativeTestJSON-99302038-project] 10.222.0.16 "DELETE /compute/v2.1/images/80d8cd02-72d0-45f8-b5c8-7f17b39f432j" status: 404 len: 62 microversion: 2.1 time: 0.112336 Oct 05 02:30:09.870084 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 410/817] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:09 2022] DELETE /compute/v2.1/images/80d8cd02-72d0-45f8-b5c8-7f17b39f432j => generated 62 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:30:09.875546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4787bc4e-580f-429d-960b-70f8976594fe tempest-ImagesDeleteNegativeTestJSON-99302038 tempest-ImagesDeleteNegativeTestJSON-99302038-project] Calling method '.version_select at 0x7fcce42728b0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:09.900322 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-4787bc4e-580f-429d-960b-70f8976594fe tempest-ImagesDeleteNegativeTestJSON-99302038 tempest-ImagesDeleteNegativeTestJSON-99302038-project] HTTP exception thrown: Image not found. Oct 05 02:30:09.902550 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4787bc4e-580f-429d-960b-70f8976594fe tempest-ImagesDeleteNegativeTestJSON-99302038 tempest-ImagesDeleteNegativeTestJSON-99302038-project] Request method failure captured: Oct 05 02:30:09.902550 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/images/511a2a82-d1b7-46cd-8b23-46a20e7672a21 HTTP/1.1 Oct 05 02:30:09.902550 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:30:09.902550 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:30:09.902550 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:30:09.902550 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:30:09.902550 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:30:09.902550 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:30:09.902550 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:30:09.902550 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:30:09.902550 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOwww8_gYENdnfDsQRSAOD_pyjnhfMh5Unq66D2jtOzNZurdIhv4_6nQuYIH5K_nx6ZYejHmUlJpYA9khRI9IL6OwTkcLGtH9zTkbhc4NKBJ7qZXCtxWGqvbbAitf0jnJYv1cXtEhx2iuBuR0qk2Pj-CySGM7oykVfLcSJPBXyAOpyc Oct 05 02:30:09.902550 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:30:09.902550 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:30:09.902550 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:30:09.902550 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:30:09.902550 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:30:09.902550 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:30:09.902550 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 8072e08fc827483684eb2f358cb0b9ac Oct 05 02:30:09.902550 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-99302038 Oct 05 02:30:09.902550 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:30:09.902550 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:30:09.904285 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8072e08fc827483684eb2f358cb0b9ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8072e08fc827483684eb2f358cb0b9ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8072e08fc827483684eb2f358cb0b9ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8072e08fc827483684eb2f358cb0b9ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:30:09.904285 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-99302038 Oct 05 02:30:09.904285 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 8072e08fc827483684eb2f358cb0b9ac Oct 05 02:30:09.904285 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-99302038 Oct 05 02:30:09.904285 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ImagesDeleteNegativeTestJSON-99302038-project Oct 05 02:30:09.904285 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:30:09.904285 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:30:09.904285 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 461c391ba5ae4e57885297bfaf4a3c5e Oct 05 02:30:09.904285 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-99302038-project Oct 05 02:30:09.904285 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:30:09.904285 n-d-858272-3 devstack@n-api.service[122320]: exception: Image not found. Oct 05 02:30:09.904285 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '511a2a82-d1b7-46cd-8b23-46a20e7672a21'} Oct 05 02:30:09.904285 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:30:09.905288 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:09.905288 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 05 02:30:09.905288 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 05 02:30:09.905288 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 02:30:09.905288 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 02:30:09.905288 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 02:30:09.905288 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 02:30:09.905288 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 05 02:30:09.905288 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 05 02:30:09.905288 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 05 02:30:09.905288 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 05 02:30:09.905288 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 02:30:09.905288 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 02:30:09.905288 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 02:30:09.905288 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 02:30:09.905288 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 511a2a82-d1b7-46cd-8b23-46a20e7672a21 to delete Oct 05 02:30:09.905288 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:09.905288 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:09.905288 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:09.907909 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:09.907909 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 05 02:30:09.907909 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 05 02:30:09.907909 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 05 02:30:09.907909 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 05 02:30:09.907909 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 05 02:30:09.907909 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 05 02:30:09.907909 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 511a2a82-d1b7-46cd-8b23-46a20e7672a21 could not be found. Oct 05 02:30:09.907909 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:09.907909 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:09.907909 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:09.907909 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:09.907909 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:09.907909 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:09.907909 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:30:09.907909 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:30:09.907909 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:30:09.907909 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:30:09.907909 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:30:09.907909 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:30:09.911795 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 05 02:30:09.911795 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 05 02:30:09.911795 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 02:30:09.911795 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:09.911795 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:09.911795 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:09.911795 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:09.911795 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:09.911795 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:09.911795 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:30:09.911795 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:30:09.911795 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 02:30:09.911795 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:09.914234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4787bc4e-580f-429d-960b-70f8976594fe tempest-ImagesDeleteNegativeTestJSON-99302038 tempest-ImagesDeleteNegativeTestJSON-99302038-project] Returning 404 to user: Image not found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:30:09.915115 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4787bc4e-580f-429d-960b-70f8976594fe tempest-ImagesDeleteNegativeTestJSON-99302038 tempest-ImagesDeleteNegativeTestJSON-99302038-project] 10.222.0.16 "DELETE /compute/v2.1/images/511a2a82-d1b7-46cd-8b23-46a20e7672a21" status: 404 len: 62 microversion: 2.1 time: 0.044641 Oct 05 02:30:09.918860 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 408/818] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:30:09 2022] DELETE /compute/v2.1/images/511a2a82-d1b7-46cd-8b23-46a20e7672a21 => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:30:09.925536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ad4165de-33fa-449f-bad7-665892a9dc83 tempest-ImagesDeleteNegativeTestJSON-99302038 tempest-ImagesDeleteNegativeTestJSON-99302038-project] Calling method '.version_select at 0x7fcce40a28b0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:09.982135 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-ad4165de-33fa-449f-bad7-665892a9dc83 tempest-ImagesDeleteNegativeTestJSON-99302038 tempest-ImagesDeleteNegativeTestJSON-99302038-project] HTTP exception thrown: Image not found. Oct 05 02:30:09.983301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d4412094-695b-45dc-bff5-9dc2b9398cf0 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:09.984240 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d4412094-695b-45dc-bff5-9dc2b9398cf0 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:09.987746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ad4165de-33fa-449f-bad7-665892a9dc83 tempest-ImagesDeleteNegativeTestJSON-99302038 tempest-ImagesDeleteNegativeTestJSON-99302038-project] Request method failure captured: Oct 05 02:30:09.987746 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/images/tempest-invalid-1864588387 HTTP/1.1 Oct 05 02:30:09.987746 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:30:09.987746 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:30:09.987746 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:30:09.987746 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:30:09.987746 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:30:09.987746 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:30:09.987746 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:30:09.987746 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:30:09.987746 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOwww8_gYENdnfDsQRSAOD_pyjnhfMh5Unq66D2jtOzNZurdIhv4_6nQuYIH5K_nx6ZYejHmUlJpYA9khRI9IL6OwTkcLGtH9zTkbhc4NKBJ7qZXCtxWGqvbbAitf0jnJYv1cXtEhx2iuBuR0qk2Pj-CySGM7oykVfLcSJPBXyAOpyc Oct 05 02:30:09.987746 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:30:09.987746 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:30:09.987746 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:30:09.987746 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:30:09.987746 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:30:09.987746 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:30:09.987746 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 8072e08fc827483684eb2f358cb0b9ac Oct 05 02:30:09.987746 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-99302038 Oct 05 02:30:09.987746 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:30:09.987746 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:30:09.989398 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8072e08fc827483684eb2f358cb0b9ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8072e08fc827483684eb2f358cb0b9ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8072e08fc827483684eb2f358cb0b9ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8072e08fc827483684eb2f358cb0b9ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:30:09.989398 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-99302038 Oct 05 02:30:09.989398 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 8072e08fc827483684eb2f358cb0b9ac Oct 05 02:30:09.989398 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-99302038 Oct 05 02:30:09.989398 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ImagesDeleteNegativeTestJSON-99302038-project Oct 05 02:30:09.989398 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:30:09.989398 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:30:09.989398 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 461c391ba5ae4e57885297bfaf4a3c5e Oct 05 02:30:09.989398 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-99302038-project Oct 05 02:30:09.989398 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:30:09.989398 n-d-858272-3 devstack@n-api.service[122319]: exception: Image not found. Oct 05 02:30:09.989398 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'tempest-invalid-1864588387'} Oct 05 02:30:09.989398 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:30:09.990351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:09.990351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 05 02:30:09.990351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 05 02:30:09.990351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 02:30:09.990351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 02:30:09.990351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 02:30:09.990351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 02:30:09.990351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 05 02:30:09.990351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 05 02:30:09.990351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 05 02:30:09.990351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 05 02:30:09.990351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 02:30:09.990351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 02:30:09.990351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 02:30:09.990351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 02:30:09.990351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1864588387 to delete Oct 05 02:30:09.990351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:09.990351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:09.990351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:09.991597 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:09.991597 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 05 02:30:09.991597 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 05 02:30:09.991597 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 05 02:30:09.991597 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 05 02:30:09.991597 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 05 02:30:09.991597 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 05 02:30:09.991597 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1864588387 could not be found. Oct 05 02:30:09.991597 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:09.991597 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:09.991597 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:09.991597 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:09.991597 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:09.991597 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:09.991597 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:30:09.991597 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:30:09.991597 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:30:09.991597 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:30:09.991597 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:30:09.991597 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:30:09.992779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 05 02:30:09.992779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 05 02:30:09.992779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 02:30:09.992779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:09.992779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:09.992779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:09.992779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:09.992779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:09.992779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:09.992779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:30:09.992779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:30:09.992779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 02:30:09.992779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:09.992779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ad4165de-33fa-449f-bad7-665892a9dc83 tempest-ImagesDeleteNegativeTestJSON-99302038 tempest-ImagesDeleteNegativeTestJSON-99302038-project] Returning 404 to user: Image not found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:30:09.992779 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ad4165de-33fa-449f-bad7-665892a9dc83 tempest-ImagesDeleteNegativeTestJSON-99302038 tempest-ImagesDeleteNegativeTestJSON-99302038-project] 10.222.0.16 "DELETE /compute/v2.1/images/tempest-invalid-1864588387" status: 404 len: 62 microversion: 2.1 time: 0.069142 Oct 05 02:30:09.997231 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 411/819] 10.222.0.16 () {58 vars in 1206 bytes} [Wed Oct 5 02:30:09 2022] DELETE /compute/v2.1/images/tempest-invalid-1864588387 => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:30:10.007245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-37a6ed75-c649-4f1c-8d16-553e9438a9a1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:10.007917 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-37a6ed75-c649-4f1c-8d16-553e9438a9a1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 34d20b05-afd7-4c5b-8af2-8176e33c041f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:10.011339 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4412094-695b-45dc-bff5-9dc2b9398cf0 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:10.011940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4412094-695b-45dc-bff5-9dc2b9398cf0 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:10.012287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4412094-695b-45dc-bff5-9dc2b9398cf0 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:10.013048 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4412094-695b-45dc-bff5-9dc2b9398cf0 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:10.013512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4412094-695b-45dc-bff5-9dc2b9398cf0 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:10.013951 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4412094-695b-45dc-bff5-9dc2b9398cf0 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:10.024190 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37a6ed75-c649-4f1c-8d16-553e9438a9a1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:10.024694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37a6ed75-c649-4f1c-8d16-553e9438a9a1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:10.025195 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37a6ed75-c649-4f1c-8d16-553e9438a9a1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:10.025912 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37a6ed75-c649-4f1c-8d16-553e9438a9a1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:10.026372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37a6ed75-c649-4f1c-8d16-553e9438a9a1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:10.026830 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37a6ed75-c649-4f1c-8d16-553e9438a9a1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:10.263648 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-37a6ed75-c649-4f1c-8d16-553e9438a9a1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:10.268043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d4412094-695b-45dc-bff5-9dc2b9398cf0 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:10.276316 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d4412094-695b-45dc-bff5-9dc2b9398cf0 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1309 microversion: 2.1 time: 0.299541 Oct 05 02:30:10.277275 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 409/820] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:09 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1309 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:10.282591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d32ce59f-6f33-4f96-ad3f-f02a2b683757 tempest-ImagesDeleteNegativeTestJSON-99302038 tempest-ImagesDeleteNegativeTestJSON-99302038-project] Calling method '.version_select at 0x7fcce4705dc0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:10.285854 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-37a6ed75-c649-4f1c-8d16-553e9438a9a1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f" status: 200 len: 1313 microversion: 2.1 time: 0.287550 Oct 05 02:30:10.305129 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 412/821] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:09 2022] GET /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:10.310923 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c9c100e2-29e8-4de4-a0e1-fce6bbcb1793 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:10.311654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c9c100e2-29e8-4de4-a0e1-fce6bbcb1793 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:10.317848 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=8 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:10.320476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9c100e2-29e8-4de4-a0e1-fce6bbcb1793 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:10.321489 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-d32ce59f-6f33-4f96-ad3f-f02a2b683757 tempest-ImagesDeleteNegativeTestJSON-99302038 tempest-ImagesDeleteNegativeTestJSON-99302038-project] HTTP exception thrown: Image not found. Oct 05 02:30:10.321938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9c100e2-29e8-4de4-a0e1-fce6bbcb1793 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:10.322550 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9c100e2-29e8-4de4-a0e1-fce6bbcb1793 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:10.323963 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d32ce59f-6f33-4f96-ad3f-f02a2b683757 tempest-ImagesDeleteNegativeTestJSON-99302038 tempest-ImagesDeleteNegativeTestJSON-99302038-project] Request method failure captured: Oct 05 02:30:10.323963 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/images/aa937c8f-51a5-48c4-a60f-c7cc7a906f11 HTTP/1.1 Oct 05 02:30:10.323963 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:30:10.323963 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:30:10.323963 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:30:10.323963 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:30:10.323963 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:30:10.323963 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:30:10.323963 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:30:10.323963 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:30:10.323963 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOwww8_gYENdnfDsQRSAOD_pyjnhfMh5Unq66D2jtOzNZurdIhv4_6nQuYIH5K_nx6ZYejHmUlJpYA9khRI9IL6OwTkcLGtH9zTkbhc4NKBJ7qZXCtxWGqvbbAitf0jnJYv1cXtEhx2iuBuR0qk2Pj-CySGM7oykVfLcSJPBXyAOpyc Oct 05 02:30:10.323963 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:30:10.323963 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:30:10.323963 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:30:10.323963 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:30:10.323963 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:30:10.323963 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:30:10.323963 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 8072e08fc827483684eb2f358cb0b9ac Oct 05 02:30:10.323963 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-99302038 Oct 05 02:30:10.323963 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:30:10.323963 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:30:10.325592 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8072e08fc827483684eb2f358cb0b9ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8072e08fc827483684eb2f358cb0b9ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8072e08fc827483684eb2f358cb0b9ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8072e08fc827483684eb2f358cb0b9ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:30:10.325592 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-99302038 Oct 05 02:30:10.325592 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 8072e08fc827483684eb2f358cb0b9ac Oct 05 02:30:10.325592 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-99302038 Oct 05 02:30:10.325592 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ImagesDeleteNegativeTestJSON-99302038-project Oct 05 02:30:10.325592 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:30:10.325592 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:30:10.325592 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 461c391ba5ae4e57885297bfaf4a3c5e Oct 05 02:30:10.325592 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-99302038-project Oct 05 02:30:10.325592 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:30:10.325592 n-d-858272-3 devstack@n-api.service[122320]: exception: Image not found. Oct 05 02:30:10.325592 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'aa937c8f-51a5-48c4-a60f-c7cc7a906f11'} Oct 05 02:30:10.325592 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:30:10.326544 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:10.326544 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 05 02:30:10.326544 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 05 02:30:10.326544 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 02:30:10.326544 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 02:30:10.326544 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 02:30:10.326544 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 02:30:10.326544 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 05 02:30:10.326544 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 05 02:30:10.326544 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 05 02:30:10.326544 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 05 02:30:10.326544 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 02:30:10.326544 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 02:30:10.326544 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 02:30:10.326544 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 02:30:10.326544 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image aa937c8f-51a5-48c4-a60f-c7cc7a906f11 to delete Oct 05 02:30:10.326544 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:10.326544 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:10.326544 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:10.327899 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:10.327899 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 05 02:30:10.327899 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 05 02:30:10.327899 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 05 02:30:10.327899 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 05 02:30:10.327899 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 05 02:30:10.327899 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 05 02:30:10.327899 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image aa937c8f-51a5-48c4-a60f-c7cc7a906f11 could not be found. Oct 05 02:30:10.327899 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:10.327899 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:10.327899 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:10.327899 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:10.327899 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:10.327899 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:10.327899 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:30:10.327899 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:30:10.327899 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:30:10.327899 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:30:10.327899 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:30:10.327899 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:30:10.330226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 05 02:30:10.330226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 05 02:30:10.330226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 02:30:10.330226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:10.330226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:10.330226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:10.330226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:10.330226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:10.330226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:10.330226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:30:10.330226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:30:10.330226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 02:30:10.330226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:10.330226 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d32ce59f-6f33-4f96-ad3f-f02a2b683757 tempest-ImagesDeleteNegativeTestJSON-99302038 tempest-ImagesDeleteNegativeTestJSON-99302038-project] Returning 404 to user: Image not found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:30:10.330226 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d32ce59f-6f33-4f96-ad3f-f02a2b683757 tempest-ImagesDeleteNegativeTestJSON-99302038 tempest-ImagesDeleteNegativeTestJSON-99302038-project] 10.222.0.16 "DELETE /compute/v2.1/images/aa937c8f-51a5-48c4-a60f-c7cc7a906f11" status: 404 len: 62 microversion: 2.1 time: 0.047283 Oct 05 02:30:10.331478 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 410/822] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:10 2022] DELETE /compute/v2.1/images/aa937c8f-51a5-48c4-a60f-c7cc7a906f11 => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:30:10.332463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9c100e2-29e8-4de4-a0e1-fce6bbcb1793 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:10.333344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9c100e2-29e8-4de4-a0e1-fce6bbcb1793 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:10.334554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9c100e2-29e8-4de4-a0e1-fce6bbcb1793 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:10.493571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c9c100e2-29e8-4de4-a0e1-fce6bbcb1793 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:10.507582 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c9c100e2-29e8-4de4-a0e1-fce6bbcb1793 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:10.510385 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c9c100e2-29e8-4de4-a0e1-fce6bbcb1793 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:10.519333 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c9c100e2-29e8-4de4-a0e1-fce6bbcb1793 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1416 microversion: 2.75 time: 0.212717 Oct 05 02:30:10.521695 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 413/823] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:10 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1416 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:10.773631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c5f54b1c-3dea-465a-903d-6ddabea74ff5 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:10.774382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c5f54b1c-3dea-465a-903d-6ddabea74ff5 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] [instance: aaa20a8a-8a7b-42dd-9b4e-9165fba82942] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:10.793955 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5f54b1c-3dea-465a-903d-6ddabea74ff5 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:10.795169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5f54b1c-3dea-465a-903d-6ddabea74ff5 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:10.796142 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5f54b1c-3dea-465a-903d-6ddabea74ff5 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:10.797952 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5f54b1c-3dea-465a-903d-6ddabea74ff5 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:10.798777 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5f54b1c-3dea-465a-903d-6ddabea74ff5 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:10.799544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5f54b1c-3dea-465a-903d-6ddabea74ff5 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:11.300783 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6eb9333f-52bb-4638-8421-dc6785260f38 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:11.302100 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6eb9333f-52bb-4638-8421-dc6785260f38 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:11.314152 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6eb9333f-52bb-4638-8421-dc6785260f38 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:11.314871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6eb9333f-52bb-4638-8421-dc6785260f38 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:11.315452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6eb9333f-52bb-4638-8421-dc6785260f38 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:11.316444 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6eb9333f-52bb-4638-8421-dc6785260f38 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:11.317229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6eb9333f-52bb-4638-8421-dc6785260f38 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:11.318111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6eb9333f-52bb-4638-8421-dc6785260f38 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:11.642303 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c5f54b1c-3dea-465a-903d-6ddabea74ff5 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f914ca523057422f88748746ba18b525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '407895b8d4e94b74a2cb652eb2c30048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:11.691198 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c5f54b1c-3dea-465a-903d-6ddabea74ff5 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942" status: 200 len: 1370 microversion: 2.1 time: 0.923442 Oct 05 02:30:11.693337 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 411/824] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:10 2022] GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942 => generated 1370 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:11.708052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f7a56199-69dd-401b-81ee-60f71aa46a43 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:11.712159 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f7a56199-69dd-401b-81ee-60f71aa46a43 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 34d20b05-afd7-4c5b-8af2-8176e33c041f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:11.728884 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7a56199-69dd-401b-81ee-60f71aa46a43 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:11.729416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7a56199-69dd-401b-81ee-60f71aa46a43 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:11.730111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7a56199-69dd-401b-81ee-60f71aa46a43 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:11.730827 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7a56199-69dd-401b-81ee-60f71aa46a43 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:11.731272 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7a56199-69dd-401b-81ee-60f71aa46a43 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:11.731695 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7a56199-69dd-401b-81ee-60f71aa46a43 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:11.883095 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6eb9333f-52bb-4638-8421-dc6785260f38 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:11.894010 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6eb9333f-52bb-4638-8421-dc6785260f38 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1309 microversion: 2.1 time: 0.597982 Oct 05 02:30:11.895223 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 414/825] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:11 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1309 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:30:11.902218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-62b3fecb-5396-48b5-8d38-6183e3d374af tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:11.903644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-62b3fecb-5396-48b5-8d38-6183e3d374af tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:11.914161 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62b3fecb-5396-48b5-8d38-6183e3d374af tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:11.915981 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62b3fecb-5396-48b5-8d38-6183e3d374af tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:11.916636 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62b3fecb-5396-48b5-8d38-6183e3d374af tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:11.918520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62b3fecb-5396-48b5-8d38-6183e3d374af tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:11.919374 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62b3fecb-5396-48b5-8d38-6183e3d374af tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:11.920247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62b3fecb-5396-48b5-8d38-6183e3d374af tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:12.022967 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-62b3fecb-5396-48b5-8d38-6183e3d374af tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:12.038929 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f7a56199-69dd-401b-81ee-60f71aa46a43 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:12.039559 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-62b3fecb-5396-48b5-8d38-6183e3d374af tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:12.042189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-62b3fecb-5396-48b5-8d38-6183e3d374af tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:12.080955 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-62b3fecb-5396-48b5-8d38-6183e3d374af tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1416 microversion: 2.75 time: 0.181531 Oct 05 02:30:12.081528 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 415/826] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:11 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1416 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:12.085198 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f7a56199-69dd-401b-81ee-60f71aa46a43 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f" status: 200 len: 1313 microversion: 2.1 time: 0.386149 Oct 05 02:30:12.089335 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 412/827] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:11 2022] GET /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f => generated 1313 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:12.114870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-7875cde0-89a9-41e1-a885-7eb486d743e1 req-c7a36a38-3efa-46b8-9740-c15d46043aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34d20b05-afd7-4c5b-8af2-8176e33c041f", "name": "network-vif-plugged", "status": "completed", "tag": "b656d7a8-ccd2-4692-8b27-890477164d2a"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:12.136629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7875cde0-89a9-41e1-a885-7eb486d743e1 req-c7a36a38-3efa-46b8-9740-c15d46043aa5 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:12.137143 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7875cde0-89a9-41e1-a885-7eb486d743e1 req-c7a36a38-3efa-46b8-9740-c15d46043aa5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:12.137571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7875cde0-89a9-41e1-a885-7eb486d743e1 req-c7a36a38-3efa-46b8-9740-c15d46043aa5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:12.170867 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-7875cde0-89a9-41e1-a885-7eb486d743e1 req-c7a36a38-3efa-46b8-9740-c15d46043aa5 service nova] Creating event network-vif-plugged:b656d7a8-ccd2-4692-8b27-890477164d2a for instance 34d20b05-afd7-4c5b-8af2-8176e33c041f on n-h2-858272-3 Oct 05 02:30:12.184553 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-7875cde0-89a9-41e1-a885-7eb486d743e1 req-c7a36a38-3efa-46b8-9740-c15d46043aa5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092052 Oct 05 02:30:12.185155 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 416/828] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:30:12.722600 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7bbafb6b-aba9-4648-ac31-32baa898ea6c tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:12.723470 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7bbafb6b-aba9-4648-ac31-32baa898ea6c tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] [instance: aaa20a8a-8a7b-42dd-9b4e-9165fba82942] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:12.725871 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:12.733147 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7bbafb6b-aba9-4648-ac31-32baa898ea6c tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:12.734050 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7bbafb6b-aba9-4648-ac31-32baa898ea6c tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:12.734628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7bbafb6b-aba9-4648-ac31-32baa898ea6c tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:12.735446 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7bbafb6b-aba9-4648-ac31-32baa898ea6c tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:12.735966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7bbafb6b-aba9-4648-ac31-32baa898ea6c tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:12.736475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7bbafb6b-aba9-4648-ac31-32baa898ea6c tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:12.920503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=48 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:12.924944 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1da7a188-796d-486f-8077-530e1516c03d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:12.926632 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1da7a188-796d-486f-8077-530e1516c03d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:12.935177 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1da7a188-796d-486f-8077-530e1516c03d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:12.935676 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1da7a188-796d-486f-8077-530e1516c03d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:12.936192 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1da7a188-796d-486f-8077-530e1516c03d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:12.936886 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1da7a188-796d-486f-8077-530e1516c03d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:12.937381 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1da7a188-796d-486f-8077-530e1516c03d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:12.937836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1da7a188-796d-486f-8077-530e1516c03d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:13.021462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7bbafb6b-aba9-4648-ac31-32baa898ea6c tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f914ca523057422f88748746ba18b525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '407895b8d4e94b74a2cb652eb2c30048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:13.030413 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7bbafb6b-aba9-4648-ac31-32baa898ea6c tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942" status: 200 len: 1370 microversion: 2.1 time: 0.316681 Oct 05 02:30:13.030988 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 413/829] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:12 2022] GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942 => generated 1370 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:13.113176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-81b9fe02-9c80-4636-9d8e-2759dcb1f977 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:13.114257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-81b9fe02-9c80-4636-9d8e-2759dcb1f977 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 34d20b05-afd7-4c5b-8af2-8176e33c041f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:13.122359 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81b9fe02-9c80-4636-9d8e-2759dcb1f977 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:13.123120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81b9fe02-9c80-4636-9d8e-2759dcb1f977 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:13.123814 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81b9fe02-9c80-4636-9d8e-2759dcb1f977 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:13.124892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81b9fe02-9c80-4636-9d8e-2759dcb1f977 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:13.126936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81b9fe02-9c80-4636-9d8e-2759dcb1f977 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:13.127731 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81b9fe02-9c80-4636-9d8e-2759dcb1f977 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:13.162456 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1da7a188-796d-486f-8077-530e1516c03d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:13.172379 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1da7a188-796d-486f-8077-530e1516c03d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1309 microversion: 2.1 time: 0.252850 Oct 05 02:30:13.174637 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 417/830] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:12 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1309 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:13.180640 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-75c934a6-4f00-4f51-af73-973d135fa73a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:13.181465 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-75c934a6-4f00-4f51-af73-973d135fa73a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:13.188486 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75c934a6-4f00-4f51-af73-973d135fa73a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:13.189236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75c934a6-4f00-4f51-af73-973d135fa73a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:13.189823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75c934a6-4f00-4f51-af73-973d135fa73a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:13.191011 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75c934a6-4f00-4f51-af73-973d135fa73a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:13.191701 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75c934a6-4f00-4f51-af73-973d135fa73a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:13.192765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75c934a6-4f00-4f51-af73-973d135fa73a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:13.370958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-75c934a6-4f00-4f51-af73-973d135fa73a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:13.390002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-75c934a6-4f00-4f51-af73-973d135fa73a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:13.392408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-75c934a6-4f00-4f51-af73-973d135fa73a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:13.402178 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-75c934a6-4f00-4f51-af73-973d135fa73a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1416 microversion: 2.75 time: 0.226407 Oct 05 02:30:13.418682 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 418/831] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:13 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1416 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:13.498745 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-81b9fe02-9c80-4636-9d8e-2759dcb1f977 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:13.508876 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-81b9fe02-9c80-4636-9d8e-2759dcb1f977 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f" status: 200 len: 1313 microversion: 2.1 time: 0.400480 Oct 05 02:30:13.510441 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 414/832] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:13 2022] GET /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f => generated 1313 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:14.056050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-24192689-0bb9-4f25-9ecc-655405d55fdf tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:14.057067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-24192689-0bb9-4f25-9ecc-655405d55fdf tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] [instance: aaa20a8a-8a7b-42dd-9b4e-9165fba82942] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:14.065166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-24192689-0bb9-4f25-9ecc-655405d55fdf tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:14.065975 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-24192689-0bb9-4f25-9ecc-655405d55fdf tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:14.066591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-24192689-0bb9-4f25-9ecc-655405d55fdf tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:14.067399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-24192689-0bb9-4f25-9ecc-655405d55fdf tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:14.068076 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-24192689-0bb9-4f25-9ecc-655405d55fdf tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:14.068797 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-24192689-0bb9-4f25-9ecc-655405d55fdf tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:14.196631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-923dfdb1-8c47-4366-b7ec-d562def08457 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:14.197888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-923dfdb1-8c47-4366-b7ec-d562def08457 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:14.210613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-923dfdb1-8c47-4366-b7ec-d562def08457 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:14.212639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-923dfdb1-8c47-4366-b7ec-d562def08457 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:14.214721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-923dfdb1-8c47-4366-b7ec-d562def08457 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:14.215631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-923dfdb1-8c47-4366-b7ec-d562def08457 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:14.222319 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-923dfdb1-8c47-4366-b7ec-d562def08457 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:14.223098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-923dfdb1-8c47-4366-b7ec-d562def08457 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:14.300126 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-24192689-0bb9-4f25-9ecc-655405d55fdf tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f914ca523057422f88748746ba18b525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '407895b8d4e94b74a2cb652eb2c30048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:14.312960 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-24192689-0bb9-4f25-9ecc-655405d55fdf tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942" status: 200 len: 1370 microversion: 2.1 time: 0.261986 Oct 05 02:30:14.316802 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 419/833] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:14 2022] GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942 => generated 1370 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:14.336355 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-e6ecc066-fbf9-4b52-a1b2-41dcfe1369ff req-c975cead-ec6d-43cd-a3b7-0886e662b2dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4445875-4e03-4ee1-8905-a60ec2a9d2c8", "name": "network-vif-plugged", "status": "completed", "tag": "9fafe495-cce4-462d-af59-d2b8107ff726"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:14.348043 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e6ecc066-fbf9-4b52-a1b2-41dcfe1369ff req-c975cead-ec6d-43cd-a3b7-0886e662b2dc service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:14.348991 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e6ecc066-fbf9-4b52-a1b2-41dcfe1369ff req-c975cead-ec6d-43cd-a3b7-0886e662b2dc service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:14.349540 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e6ecc066-fbf9-4b52-a1b2-41dcfe1369ff req-c975cead-ec6d-43cd-a3b7-0886e662b2dc service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:14.351407 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=38 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:14.364587 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-e6ecc066-fbf9-4b52-a1b2-41dcfe1369ff req-c975cead-ec6d-43cd-a3b7-0886e662b2dc service nova] Creating event network-vif-plugged:9fafe495-cce4-462d-af59-d2b8107ff726 for instance e4445875-4e03-4ee1-8905-a60ec2a9d2c8 on n-h1-858272-3 Oct 05 02:30:14.371121 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-e6ecc066-fbf9-4b52-a1b2-41dcfe1369ff req-c975cead-ec6d-43cd-a3b7-0886e662b2dc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052832 Oct 05 02:30:14.371986 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 420/834] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:30:14.438082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e5ab21ed-7e63-4eba-b9c9-51cafb270f7a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:14.439503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e5ab21ed-7e63-4eba-b9c9-51cafb270f7a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:14.448856 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5ab21ed-7e63-4eba-b9c9-51cafb270f7a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:14.450001 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5ab21ed-7e63-4eba-b9c9-51cafb270f7a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:14.451103 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5ab21ed-7e63-4eba-b9c9-51cafb270f7a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:14.452212 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5ab21ed-7e63-4eba-b9c9-51cafb270f7a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:14.452832 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5ab21ed-7e63-4eba-b9c9-51cafb270f7a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:14.453995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5ab21ed-7e63-4eba-b9c9-51cafb270f7a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:14.454331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-923dfdb1-8c47-4366-b7ec-d562def08457 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:14.472049 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-923dfdb1-8c47-4366-b7ec-d562def08457 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1309 microversion: 2.1 time: 0.279100 Oct 05 02:30:14.472625 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 415/835] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:14 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1309 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:30:14.544124 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c708412d-e54a-4b41-9d4a-37b4918ce7f4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:14.544124 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c708412d-e54a-4b41-9d4a-37b4918ce7f4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 34d20b05-afd7-4c5b-8af2-8176e33c041f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:14.563305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c708412d-e54a-4b41-9d4a-37b4918ce7f4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:14.564187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c708412d-e54a-4b41-9d4a-37b4918ce7f4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:14.565282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c708412d-e54a-4b41-9d4a-37b4918ce7f4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:14.566055 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c708412d-e54a-4b41-9d4a-37b4918ce7f4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:14.566520 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c708412d-e54a-4b41-9d4a-37b4918ce7f4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:14.566951 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c708412d-e54a-4b41-9d4a-37b4918ce7f4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:14.590646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e5ab21ed-7e63-4eba-b9c9-51cafb270f7a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:14.613634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e5ab21ed-7e63-4eba-b9c9-51cafb270f7a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:14.618645 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e5ab21ed-7e63-4eba-b9c9-51cafb270f7a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:14.632180 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e5ab21ed-7e63-4eba-b9c9-51cafb270f7a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1437 microversion: 2.75 time: 0.200461 Oct 05 02:30:14.633672 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 421/836] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:14 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1437 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:30:14.663253 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b43a9fbb-0eec-4a1c-a74e-b627b0acea9b tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:14.666693 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b43a9fbb-0eec-4a1c-a74e-b627b0acea9b tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:14.675845 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b43a9fbb-0eec-4a1c-a74e-b627b0acea9b tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:14.676742 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b43a9fbb-0eec-4a1c-a74e-b627b0acea9b tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:14.677424 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b43a9fbb-0eec-4a1c-a74e-b627b0acea9b tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:14.678772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b43a9fbb-0eec-4a1c-a74e-b627b0acea9b tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:14.679434 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b43a9fbb-0eec-4a1c-a74e-b627b0acea9b tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:14.680061 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b43a9fbb-0eec-4a1c-a74e-b627b0acea9b tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:14.816018 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:14.832660 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c708412d-e54a-4b41-9d4a-37b4918ce7f4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:14.841083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-b43a9fbb-0eec-4a1c-a74e-b627b0acea9b tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:30:14.841529 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-b43a9fbb-0eec-4a1c-a74e-b627b0acea9b tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:30:14.842238 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-b43a9fbb-0eec-4a1c-a74e-b627b0acea9b tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:30:14.842706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-b43a9fbb-0eec-4a1c-a74e-b627b0acea9b tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:30:14.843681 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-b43a9fbb-0eec-4a1c-a74e-b627b0acea9b tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:30:14.845893 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c708412d-e54a-4b41-9d4a-37b4918ce7f4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f" status: 200 len: 1463 microversion: 2.1 time: 0.308900 Oct 05 02:30:14.846679 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 416/837] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:14 2022] GET /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f => generated 1463 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:14.896074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2bd44c6e-5929-44ec-90e7-74f12a9f5127 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:14.898268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2bd44c6e-5929-44ec-90e7-74f12a9f5127 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:14.905801 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bd44c6e-5929-44ec-90e7-74f12a9f5127 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:14.906882 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bd44c6e-5929-44ec-90e7-74f12a9f5127 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:14.908528 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bd44c6e-5929-44ec-90e7-74f12a9f5127 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:14.909728 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bd44c6e-5929-44ec-90e7-74f12a9f5127 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:14.910354 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bd44c6e-5929-44ec-90e7-74f12a9f5127 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:14.911109 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bd44c6e-5929-44ec-90e7-74f12a9f5127 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:14.989333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b43a9fbb-0eec-4a1c-a74e-b627b0acea9b tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:14.993758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:15.015105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b43a9fbb-0eec-4a1c-a74e-b627b0acea9b tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:15.023820 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b43a9fbb-0eec-4a1c-a74e-b627b0acea9b tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:15.024536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b43a9fbb-0eec-4a1c-a74e-b627b0acea9b tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:15.029147 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b43a9fbb-0eec-4a1c-a74e-b627b0acea9b tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:15.030103 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b43a9fbb-0eec-4a1c-a74e-b627b0acea9b tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:15.033846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b43a9fbb-0eec-4a1c-a74e-b627b0acea9b tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:15.235992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b43a9fbb-0eec-4a1c-a74e-b627b0acea9b tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:15.259641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b43a9fbb-0eec-4a1c-a74e-b627b0acea9b tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:15.262650 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b43a9fbb-0eec-4a1c-a74e-b627b0acea9b tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:15.269792 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b43a9fbb-0eec-4a1c-a74e-b627b0acea9b tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "POST /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d/action" status: 202 len: 1494 microversion: 2.75 time: 0.611499 Oct 05 02:30:15.271357 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 422/838] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 5 02:30:14 2022] POST /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d/action => generated 1494 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 05 02:30:15.300498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5ada9465-9daa-4e2c-9532-b5df747b4999 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:15.301461 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5ada9465-9daa-4e2c-9532-b5df747b4999 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:15.309663 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ada9465-9daa-4e2c-9532-b5df747b4999 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:15.310371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ada9465-9daa-4e2c-9532-b5df747b4999 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:15.310986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ada9465-9daa-4e2c-9532-b5df747b4999 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:15.311849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ada9465-9daa-4e2c-9532-b5df747b4999 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:15.312615 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ada9465-9daa-4e2c-9532-b5df747b4999 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:15.313729 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ada9465-9daa-4e2c-9532-b5df747b4999 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:15.336201 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2bd44c6e-5929-44ec-90e7-74f12a9f5127 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:15.353314 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2bd44c6e-5929-44ec-90e7-74f12a9f5127 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1314 microversion: 2.1 time: 0.483276 Oct 05 02:30:15.358276 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 417/839] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:14 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:30:15.366284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4099bee1-7f0c-4738-a7ef-454aa2bb08a1 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:15.367073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4099bee1-7f0c-4738-a7ef-454aa2bb08a1 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] [instance: aaa20a8a-8a7b-42dd-9b4e-9165fba82942] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:15.412166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4099bee1-7f0c-4738-a7ef-454aa2bb08a1 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:15.412672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4099bee1-7f0c-4738-a7ef-454aa2bb08a1 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:15.413139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4099bee1-7f0c-4738-a7ef-454aa2bb08a1 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:15.413859 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4099bee1-7f0c-4738-a7ef-454aa2bb08a1 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:15.414316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4099bee1-7f0c-4738-a7ef-454aa2bb08a1 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:15.414741 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4099bee1-7f0c-4738-a7ef-454aa2bb08a1 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:15.457499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5ada9465-9daa-4e2c-9532-b5df747b4999 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:15.495309 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5ada9465-9daa-4e2c-9532-b5df747b4999 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:15.497456 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5ada9465-9daa-4e2c-9532-b5df747b4999 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:15.512146 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5ada9465-9daa-4e2c-9532-b5df747b4999 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1446 microversion: 2.75 time: 0.216405 Oct 05 02:30:15.539492 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 423/840] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:15 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1446 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:30:15.550886 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-43497100-bff2-4018-be03-3018e25b982d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:15.551685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-43497100-bff2-4018-be03-3018e25b982d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:15.559262 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43497100-bff2-4018-be03-3018e25b982d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:15.560069 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43497100-bff2-4018-be03-3018e25b982d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:15.560607 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43497100-bff2-4018-be03-3018e25b982d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:15.561470 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43497100-bff2-4018-be03-3018e25b982d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:15.562032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43497100-bff2-4018-be03-3018e25b982d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:15.563149 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43497100-bff2-4018-be03-3018e25b982d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:15.706810 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4099bee1-7f0c-4738-a7ef-454aa2bb08a1 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f914ca523057422f88748746ba18b525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '407895b8d4e94b74a2cb652eb2c30048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:15.722392 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4099bee1-7f0c-4738-a7ef-454aa2bb08a1 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942" status: 200 len: 1370 microversion: 2.1 time: 0.360010 Oct 05 02:30:15.743694 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 418/841] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:15 2022] GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942 => generated 1370 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:15.751781 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bbfdc70a-d2a5-44e7-ac39-913daa246201 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:15.752640 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bbfdc70a-d2a5-44e7-ac39-913daa246201 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 3245900a-6147-427e-86e3-b0af919523e6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:15.759247 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bbfdc70a-d2a5-44e7-ac39-913daa246201 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:15.760259 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bbfdc70a-d2a5-44e7-ac39-913daa246201 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:15.761136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bbfdc70a-d2a5-44e7-ac39-913daa246201 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:15.762577 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bbfdc70a-d2a5-44e7-ac39-913daa246201 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:15.763283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bbfdc70a-d2a5-44e7-ac39-913daa246201 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:15.763929 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bbfdc70a-d2a5-44e7-ac39-913daa246201 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:15.807311 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bbfdc70a-d2a5-44e7-ac39-913daa246201 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 3245900a-6147-427e-86e3-b0af919523e6] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:30:15.815177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:15.944377 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bbfdc70a-d2a5-44e7-ac39-913daa246201 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6" status: 204 len: 0 microversion: 2.1 time: 0.198134 Oct 05 02:30:15.955613 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 419/842] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:30:15 2022] DELETE /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:30:16.108207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ecfdc6c3-9573-43de-a1db-a1802a6caf37 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-330002687", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "1706217788", "adminPass": "***", "networks": [{"uuid": "8d99bddc-53f3-4733-9f3c-501e29e6e747"}], "security_groups": [{"name": "tempest-securitygroup--205126435"}], "key_name": "tempest-keypair-667138563", "user_data": "}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:16.347130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-43497100-bff2-4018-be03-3018e25b982d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:16.365171 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-43497100-bff2-4018-be03-3018e25b982d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1309 microversion: 2.1 time: 0.819171 Oct 05 02:30:16.366184 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 424/843] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:15 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1309 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:16.379486 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-ecfdc6c3-9573-43de-a1db-a1802a6caf37 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] validate_networks() for [('8d99bddc-53f3-4733-9f3c-501e29e6e747', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:30:16.385249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6ac49f38-91f7-405f-8251-c60b96ff1b08 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:16.389472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6ac49f38-91f7-405f-8251-c60b96ff1b08 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:16.399849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ac49f38-91f7-405f-8251-c60b96ff1b08 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:16.400429 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ac49f38-91f7-405f-8251-c60b96ff1b08 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:16.401168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ac49f38-91f7-405f-8251-c60b96ff1b08 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:16.402109 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ac49f38-91f7-405f-8251-c60b96ff1b08 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:16.402767 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ac49f38-91f7-405f-8251-c60b96ff1b08 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:16.403406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ac49f38-91f7-405f-8251-c60b96ff1b08 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:16.775547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6ac49f38-91f7-405f-8251-c60b96ff1b08 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:16.791068 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6ac49f38-91f7-405f-8251-c60b96ff1b08 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1314 microversion: 2.1 time: 0.409666 Oct 05 02:30:16.793393 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 425/844] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:16 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:16.806790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-46d5fe73-03e5-4b05-a02d-477c364e8833 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:16.807831 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-46d5fe73-03e5-4b05-a02d-477c364e8833 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:16.817395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46d5fe73-03e5-4b05-a02d-477c364e8833 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:16.818345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46d5fe73-03e5-4b05-a02d-477c364e8833 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:16.820059 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46d5fe73-03e5-4b05-a02d-477c364e8833 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:16.823870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46d5fe73-03e5-4b05-a02d-477c364e8833 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:16.827720 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46d5fe73-03e5-4b05-a02d-477c364e8833 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:16.829088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46d5fe73-03e5-4b05-a02d-477c364e8833 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:16.980567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-46d5fe73-03e5-4b05-a02d-477c364e8833 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:16.996565 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-46d5fe73-03e5-4b05-a02d-477c364e8833 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:16.998303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-46d5fe73-03e5-4b05-a02d-477c364e8833 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:17.025729 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-46d5fe73-03e5-4b05-a02d-477c364e8833 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1446 microversion: 2.75 time: 0.226606 Oct 05 02:30:17.028149 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 426/845] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:16 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1446 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:17.039319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-65a8f836-e4cd-4dbc-991b-12effe5c6580 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:17.040657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-65a8f836-e4cd-4dbc-991b-12effe5c6580 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] [instance: aaa20a8a-8a7b-42dd-9b4e-9165fba82942] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:17.056757 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65a8f836-e4cd-4dbc-991b-12effe5c6580 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:17.057466 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65a8f836-e4cd-4dbc-991b-12effe5c6580 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:17.058060 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65a8f836-e4cd-4dbc-991b-12effe5c6580 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:17.058895 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65a8f836-e4cd-4dbc-991b-12effe5c6580 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:17.059481 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65a8f836-e4cd-4dbc-991b-12effe5c6580 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:17.060020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65a8f836-e4cd-4dbc-991b-12effe5c6580 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:17.398182 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-ecfdc6c3-9573-43de-a1db-a1802a6caf37 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:30:17.399775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-ecfdc6c3-9573-43de-a1db-a1802a6caf37 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:30:17.400606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-ecfdc6c3-9573-43de-a1db-a1802a6caf37 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:30:17.402159 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-ecfdc6c3-9573-43de-a1db-a1802a6caf37 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:30:17.402777 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-ecfdc6c3-9573-43de-a1db-a1802a6caf37 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:30:17.419422 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-65a8f836-e4cd-4dbc-991b-12effe5c6580 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f914ca523057422f88748746ba18b525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '407895b8d4e94b74a2cb652eb2c30048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:17.428957 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-65a8f836-e4cd-4dbc-991b-12effe5c6580 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942" status: 200 len: 1370 microversion: 2.1 time: 0.400851 Oct 05 02:30:17.429788 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 427/846] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:17 2022] GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942 => generated 1370 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:17.434661 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-c41fbf8b-99d6-4eaa-b596-8eabcf792df0 req-8b91d3fd-88b5-405b-a810-cc38a3c7b422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "861e3da3-98a1-4728-b218-322c9db128b3", "name": "network-vif-plugged", "status": "completed", "tag": "1414377b-0304-4553-b209-c5c3a5855cea"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:17.456609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c41fbf8b-99d6-4eaa-b596-8eabcf792df0 req-8b91d3fd-88b5-405b-a810-cc38a3c7b422 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:17.457414 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ecfdc6c3-9573-43de-a1db-a1802a6caf37 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:17.457892 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c41fbf8b-99d6-4eaa-b596-8eabcf792df0 req-8b91d3fd-88b5-405b-a810-cc38a3c7b422 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:17.458841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ecfdc6c3-9573-43de-a1db-a1802a6caf37 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:17.459443 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c41fbf8b-99d6-4eaa-b596-8eabcf792df0 req-8b91d3fd-88b5-405b-a810-cc38a3c7b422 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:17.460677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ecfdc6c3-9573-43de-a1db-a1802a6caf37 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:17.465196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ecfdc6c3-9573-43de-a1db-a1802a6caf37 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:17.465955 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ecfdc6c3-9573-43de-a1db-a1802a6caf37 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:17.466575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ecfdc6c3-9573-43de-a1db-a1802a6caf37 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:17.486408 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-c41fbf8b-99d6-4eaa-b596-8eabcf792df0 req-8b91d3fd-88b5-405b-a810-cc38a3c7b422 service nova] Creating event network-vif-plugged:1414377b-0304-4553-b209-c5c3a5855cea for instance 861e3da3-98a1-4728-b218-322c9db128b3 on n-h2-858272-3 Oct 05 02:30:17.493073 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-c41fbf8b-99d6-4eaa-b596-8eabcf792df0 req-8b91d3fd-88b5-405b-a810-cc38a3c7b422 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061338 Oct 05 02:30:17.493726 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 428/847] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:30:17.502531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-71778942-5beb-4e98-85eb-d5d393780640 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:17.503372 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-ecfdc6c3-9573-43de-a1db-a1802a6caf37 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Getting quotas for project fecbac50c16847799a85c148c6c143de. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:30:17.503524 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-71778942-5beb-4e98-85eb-d5d393780640 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:17.512607 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71778942-5beb-4e98-85eb-d5d393780640 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:17.513020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-ecfdc6c3-9573-43de-a1db-a1802a6caf37 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Getting quotas for user 368f6c3db9f24561a13f48ce02e7655e and project fecbac50c16847799a85c148c6c143de. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:30:17.513870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71778942-5beb-4e98-85eb-d5d393780640 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:17.517628 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71778942-5beb-4e98-85eb-d5d393780640 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:17.518545 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71778942-5beb-4e98-85eb-d5d393780640 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:17.519112 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71778942-5beb-4e98-85eb-d5d393780640 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:17.519622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71778942-5beb-4e98-85eb-d5d393780640 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:17.536337 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ecfdc6c3-9573-43de-a1db-a1802a6caf37 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:30:17.541318 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ecfdc6c3-9573-43de-a1db-a1802a6caf37 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 6a205b3a-9fb4-4703-9368-0ab2436d60e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:30:17.639980 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ecfdc6c3-9573-43de-a1db-a1802a6caf37 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.538398 Oct 05 02:30:17.642578 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 420/848] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:30:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 1542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 02:30:17.654255 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-65045d9a-db80-4315-a583-d93ea7f7d4f8 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:17.655283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-65045d9a-db80-4315-a583-d93ea7f7d4f8 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 6a205b3a-9fb4-4703-9368-0ab2436d60e5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:18.095307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-65045d9a-db80-4315-a583-d93ea7f7d4f8 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368f6c3db9f24561a13f48ce02e7655e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecbac50c16847799a85c148c6c143de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:18.104537 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-65045d9a-db80-4315-a583-d93ea7f7d4f8 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5" status: 200 len: 1263 microversion: 2.1 time: 0.455443 Oct 05 02:30:18.117615 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 421/849] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:17 2022] GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5 => generated 1263 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:18.127082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1726c8b6-ee84-49b1-9979-f7f8a6d5a963 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:18.127973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1726c8b6-ee84-49b1-9979-f7f8a6d5a963 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:18.154203 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1726c8b6-ee84-49b1-9979-f7f8a6d5a963 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:18.154712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1726c8b6-ee84-49b1-9979-f7f8a6d5a963 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:18.155154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1726c8b6-ee84-49b1-9979-f7f8a6d5a963 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:18.158624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1726c8b6-ee84-49b1-9979-f7f8a6d5a963 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:18.159106 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1726c8b6-ee84-49b1-9979-f7f8a6d5a963 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:18.160841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1726c8b6-ee84-49b1-9979-f7f8a6d5a963 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:18.784408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-71778942-5beb-4e98-85eb-d5d393780640 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:18.795776 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-71778942-5beb-4e98-85eb-d5d393780640 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1309 microversion: 2.1 time: 1.300766 Oct 05 02:30:18.824093 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 429/850] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:17 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1309 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:18.824093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7e868dc2-68eb-4452-b033-d5ac638cc68e tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:18.824093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7e868dc2-68eb-4452-b033-d5ac638cc68e tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:18.824093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e868dc2-68eb-4452-b033-d5ac638cc68e tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:18.826153 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e868dc2-68eb-4452-b033-d5ac638cc68e tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:18.826639 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e868dc2-68eb-4452-b033-d5ac638cc68e tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:18.827387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e868dc2-68eb-4452-b033-d5ac638cc68e tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:18.827865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e868dc2-68eb-4452-b033-d5ac638cc68e tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:18.833393 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e868dc2-68eb-4452-b033-d5ac638cc68e tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:18.997076 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1726c8b6-ee84-49b1-9979-f7f8a6d5a963 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:18.998176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7e868dc2-68eb-4452-b033-d5ac638cc68e tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:19.009403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7e868dc2-68eb-4452-b033-d5ac638cc68e tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:19.010845 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7e868dc2-68eb-4452-b033-d5ac638cc68e tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:19.013069 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1726c8b6-ee84-49b1-9979-f7f8a6d5a963 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1314 microversion: 2.1 time: 0.894125 Oct 05 02:30:19.017631 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7e868dc2-68eb-4452-b033-d5ac638cc68e tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1446 microversion: 2.75 time: 0.207611 Oct 05 02:30:19.018738 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 430/851] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:18 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1446 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:19.019482 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 422/852] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:18 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1314 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:19.036936 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e2065d02-04ee-4b46-9faf-dcdcc1e65565 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:19.037527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e2065d02-04ee-4b46-9faf-dcdcc1e65565 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] [instance: aaa20a8a-8a7b-42dd-9b4e-9165fba82942] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:19.046299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e2065d02-04ee-4b46-9faf-dcdcc1e65565 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:19.047439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e2065d02-04ee-4b46-9faf-dcdcc1e65565 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:19.048095 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e2065d02-04ee-4b46-9faf-dcdcc1e65565 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:19.049018 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e2065d02-04ee-4b46-9faf-dcdcc1e65565 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:19.049666 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e2065d02-04ee-4b46-9faf-dcdcc1e65565 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:19.050254 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e2065d02-04ee-4b46-9faf-dcdcc1e65565 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:19.134577 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-373597a2-b69e-4b27-96dd-b54fc2fd5e7c tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:19.135511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-373597a2-b69e-4b27-96dd-b54fc2fd5e7c tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 6a205b3a-9fb4-4703-9368-0ab2436d60e5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:19.150947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-373597a2-b69e-4b27-96dd-b54fc2fd5e7c tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:19.154388 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-373597a2-b69e-4b27-96dd-b54fc2fd5e7c tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:19.155101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-373597a2-b69e-4b27-96dd-b54fc2fd5e7c tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:19.156103 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-373597a2-b69e-4b27-96dd-b54fc2fd5e7c tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:19.156850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-373597a2-b69e-4b27-96dd-b54fc2fd5e7c tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:19.157558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-373597a2-b69e-4b27-96dd-b54fc2fd5e7c tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:19.283480 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-373597a2-b69e-4b27-96dd-b54fc2fd5e7c tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368f6c3db9f24561a13f48ce02e7655e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecbac50c16847799a85c148c6c143de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:19.314586 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-373597a2-b69e-4b27-96dd-b54fc2fd5e7c tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5" status: 200 len: 1259 microversion: 2.1 time: 0.167376 Oct 05 02:30:19.315353 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 423/853] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:19 2022] GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5 => generated 1259 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:30:19.504818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e2065d02-04ee-4b46-9faf-dcdcc1e65565 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f914ca523057422f88748746ba18b525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '407895b8d4e94b74a2cb652eb2c30048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:19.515436 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e2065d02-04ee-4b46-9faf-dcdcc1e65565 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942" status: 200 len: 1370 microversion: 2.1 time: 0.494709 Oct 05 02:30:19.516794 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 431/854] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:19 2022] GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942 => generated 1370 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:19.836481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-54a1b891-81f1-41e0-8e43-473ec5e9401c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:19.838440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-54a1b891-81f1-41e0-8e43-473ec5e9401c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:19.848635 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54a1b891-81f1-41e0-8e43-473ec5e9401c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:19.850005 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54a1b891-81f1-41e0-8e43-473ec5e9401c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:19.850617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54a1b891-81f1-41e0-8e43-473ec5e9401c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:19.851491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54a1b891-81f1-41e0-8e43-473ec5e9401c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:19.854922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54a1b891-81f1-41e0-8e43-473ec5e9401c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:19.856243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54a1b891-81f1-41e0-8e43-473ec5e9401c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:20.042625 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b9e25f73-83fa-4506-8a6a-8962bda7a0fe tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:20.044179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b9e25f73-83fa-4506-8a6a-8962bda7a0fe tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:20.059997 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9e25f73-83fa-4506-8a6a-8962bda7a0fe tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:20.061348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9e25f73-83fa-4506-8a6a-8962bda7a0fe tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:20.061777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9e25f73-83fa-4506-8a6a-8962bda7a0fe tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:20.062612 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9e25f73-83fa-4506-8a6a-8962bda7a0fe tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:20.063105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9e25f73-83fa-4506-8a6a-8962bda7a0fe tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:20.063691 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9e25f73-83fa-4506-8a6a-8962bda7a0fe tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:20.645668 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-54a1b891-81f1-41e0-8e43-473ec5e9401c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:20.664785 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-54a1b891-81f1-41e0-8e43-473ec5e9401c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1492 microversion: 2.1 time: 0.832002 Oct 05 02:30:20.681863 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 424/855] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:19 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1492 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:20.694853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9b66ec55-1df1-4169-95d7-8a01d7895fb9 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:20.695473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9b66ec55-1df1-4169-95d7-8a01d7895fb9 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:20.722066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b66ec55-1df1-4169-95d7-8a01d7895fb9 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:20.725145 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b66ec55-1df1-4169-95d7-8a01d7895fb9 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:20.725618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b66ec55-1df1-4169-95d7-8a01d7895fb9 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:20.731293 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b66ec55-1df1-4169-95d7-8a01d7895fb9 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:20.731796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b66ec55-1df1-4169-95d7-8a01d7895fb9 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:20.760108 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b66ec55-1df1-4169-95d7-8a01d7895fb9 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:21.106054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9b66ec55-1df1-4169-95d7-8a01d7895fb9 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:21.119425 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9b66ec55-1df1-4169-95d7-8a01d7895fb9 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:21.122925 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9b66ec55-1df1-4169-95d7-8a01d7895fb9 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:21.141043 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9b66ec55-1df1-4169-95d7-8a01d7895fb9 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1446 microversion: 2.75 time: 0.470475 Oct 05 02:30:21.144848 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 425/856] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:20 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1446 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:21.155534 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d7ab8cd8-4799-42e7-93b3-51893edf4b2a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:21.157896 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d7ab8cd8-4799-42e7-93b3-51893edf4b2a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 6a205b3a-9fb4-4703-9368-0ab2436d60e5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:21.183672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7ab8cd8-4799-42e7-93b3-51893edf4b2a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:21.187199 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7ab8cd8-4799-42e7-93b3-51893edf4b2a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:21.191308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7ab8cd8-4799-42e7-93b3-51893edf4b2a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:21.193228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7ab8cd8-4799-42e7-93b3-51893edf4b2a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:21.193711 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7ab8cd8-4799-42e7-93b3-51893edf4b2a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:21.194147 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7ab8cd8-4799-42e7-93b3-51893edf4b2a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:22.077177 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b9e25f73-83fa-4506-8a6a-8962bda7a0fe tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:22.119526 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b9e25f73-83fa-4506-8a6a-8962bda7a0fe tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1314 microversion: 2.1 time: 2.081056 Oct 05 02:30:22.120151 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 432/857] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:20 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1314 bytes in 2082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:22.130803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-07c744ca-4bd4-4b94-80d0-291bd57b189d tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:22.134479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-07c744ca-4bd4-4b94-80d0-291bd57b189d tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] [instance: aaa20a8a-8a7b-42dd-9b4e-9165fba82942] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:22.142710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-07c744ca-4bd4-4b94-80d0-291bd57b189d tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:22.143857 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-07c744ca-4bd4-4b94-80d0-291bd57b189d tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:22.144491 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-07c744ca-4bd4-4b94-80d0-291bd57b189d tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:22.145647 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-07c744ca-4bd4-4b94-80d0-291bd57b189d tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:22.146317 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-07c744ca-4bd4-4b94-80d0-291bd57b189d tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:22.147289 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-07c744ca-4bd4-4b94-80d0-291bd57b189d tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:22.182823 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d7ab8cd8-4799-42e7-93b3-51893edf4b2a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368f6c3db9f24561a13f48ce02e7655e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecbac50c16847799a85c148c6c143de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:22.194195 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d7ab8cd8-4799-42e7-93b3-51893edf4b2a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5" status: 200 len: 1315 microversion: 2.1 time: 1.048242 Oct 05 02:30:22.194847 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 426/858] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:21 2022] GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5 => generated 1315 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:22.219764 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bb564286-03c1-4520-a484-9e76085991bd tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:22.220769 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bb564286-03c1-4520-a484-9e76085991bd tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:22.234982 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb564286-03c1-4520-a484-9e76085991bd tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:22.235535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb564286-03c1-4520-a484-9e76085991bd tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:22.236065 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb564286-03c1-4520-a484-9e76085991bd tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:22.237016 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb564286-03c1-4520-a484-9e76085991bd tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:22.237476 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb564286-03c1-4520-a484-9e76085991bd tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:22.237899 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb564286-03c1-4520-a484-9e76085991bd tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:22.627042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-07c744ca-4bd4-4b94-80d0-291bd57b189d tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f914ca523057422f88748746ba18b525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '407895b8d4e94b74a2cb652eb2c30048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:22.635939 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-07c744ca-4bd4-4b94-80d0-291bd57b189d tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942" status: 200 len: 1370 microversion: 2.1 time: 0.510963 Oct 05 02:30:22.636658 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 433/859] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:22 2022] GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942 => generated 1370 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:22.641967 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-c9cf5dde-f093-457b-8ea0-e7cfec86d22f req-d10b7cf7-4ea6-4470-b84d-d723da7d3513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa20a8a-8a7b-42dd-9b4e-9165fba82942", "name": "network-vif-plugged", "status": "completed", "tag": "a4ccf2aa-c3c8-483d-b7c6-24391c11f3bc"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:22.651475 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c9cf5dde-f093-457b-8ea0-e7cfec86d22f req-d10b7cf7-4ea6-4470-b84d-d723da7d3513 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:22.652374 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c9cf5dde-f093-457b-8ea0-e7cfec86d22f req-d10b7cf7-4ea6-4470-b84d-d723da7d3513 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:22.653060 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c9cf5dde-f093-457b-8ea0-e7cfec86d22f req-d10b7cf7-4ea6-4470-b84d-d723da7d3513 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:22.670156 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-c9cf5dde-f093-457b-8ea0-e7cfec86d22f req-d10b7cf7-4ea6-4470-b84d-d723da7d3513 service nova] Creating event network-vif-plugged:a4ccf2aa-c3c8-483d-b7c6-24391c11f3bc for instance aaa20a8a-8a7b-42dd-9b4e-9165fba82942 on n-h1-858272-3 Oct 05 02:30:22.677541 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-c9cf5dde-f093-457b-8ea0-e7cfec86d22f req-d10b7cf7-4ea6-4470-b84d-d723da7d3513 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038900 Oct 05 02:30:22.678353 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 434/860] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:30:22.765415 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bb564286-03c1-4520-a484-9e76085991bd tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1643 microversion: 2.1 time: 0.561244 Oct 05 02:30:22.766331 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 427/861] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:22 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1643 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:22.785000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3a7f71ff-ae40-44ee-a84a-3c6218b27fe3 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:22.787701 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3a7f71ff-ae40-44ee-a84a-3c6218b27fe3 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:22.805798 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3a7f71ff-ae40-44ee-a84a-3c6218b27fe3 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:22.806659 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3a7f71ff-ae40-44ee-a84a-3c6218b27fe3 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:22.807429 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3a7f71ff-ae40-44ee-a84a-3c6218b27fe3 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:22.808289 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3a7f71ff-ae40-44ee-a84a-3c6218b27fe3 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:22.808963 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3a7f71ff-ae40-44ee-a84a-3c6218b27fe3 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:22.809550 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3a7f71ff-ae40-44ee-a84a-3c6218b27fe3 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:22.851905 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b7947193-a829-4a58-9587-541a76c674e0 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-970325982", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "83038bd1-66ba-4292-a55b-6ad71596ed4b"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:22.915601 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-b7947193-a829-4a58-9587-541a76c674e0 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] validate_networks() for [('83038bd1-66ba-4292-a55b-6ad71596ed4b', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:30:23.048548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3a7f71ff-ae40-44ee-a84a-3c6218b27fe3 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:23.063030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3a7f71ff-ae40-44ee-a84a-3c6218b27fe3 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:23.064823 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3a7f71ff-ae40-44ee-a84a-3c6218b27fe3 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:23.070533 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3a7f71ff-ae40-44ee-a84a-3c6218b27fe3 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1446 microversion: 2.75 time: 0.303041 Oct 05 02:30:23.071352 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 428/862] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:22 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1446 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:23.076474 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-baac5d88-7532-49ca-93ca-144dccf0c000 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:23.077117 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-baac5d88-7532-49ca-93ca-144dccf0c000 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:23.083138 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-baac5d88-7532-49ca-93ca-144dccf0c000 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:23.083634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-baac5d88-7532-49ca-93ca-144dccf0c000 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:23.084729 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-baac5d88-7532-49ca-93ca-144dccf0c000 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:23.085469 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-baac5d88-7532-49ca-93ca-144dccf0c000 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:23.086126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-baac5d88-7532-49ca-93ca-144dccf0c000 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:23.086538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-baac5d88-7532-49ca-93ca-144dccf0c000 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:23.730805 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-baac5d88-7532-49ca-93ca-144dccf0c000 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1643 microversion: 2.1 time: 0.658194 Oct 05 02:30:23.744041 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 429/863] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:23 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1643 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:23.754135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-219da5db-77d3-47ec-b6dc-e69cfd6faaa8 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:23.756633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-219da5db-77d3-47ec-b6dc-e69cfd6faaa8 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:23.769709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-219da5db-77d3-47ec-b6dc-e69cfd6faaa8 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:23.770770 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-219da5db-77d3-47ec-b6dc-e69cfd6faaa8 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:23.771397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-219da5db-77d3-47ec-b6dc-e69cfd6faaa8 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:23.772501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-219da5db-77d3-47ec-b6dc-e69cfd6faaa8 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:23.773236 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-219da5db-77d3-47ec-b6dc-e69cfd6faaa8 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:23.773853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-219da5db-77d3-47ec-b6dc-e69cfd6faaa8 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:24.304196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-219da5db-77d3-47ec-b6dc-e69cfd6faaa8 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:24.324047 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-219da5db-77d3-47ec-b6dc-e69cfd6faaa8 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1463 microversion: 2.1 time: 0.578664 Oct 05 02:30:24.324969 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 430/864] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:23 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1463 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:24.331272 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4d48e399-9809-48b4-be19-89e8f5969ef1 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:24.342038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4d48e399-9809-48b4-be19-89e8f5969ef1 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 6a205b3a-9fb4-4703-9368-0ab2436d60e5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:24.350559 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d48e399-9809-48b4-be19-89e8f5969ef1 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:24.352604 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d48e399-9809-48b4-be19-89e8f5969ef1 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:24.362731 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d48e399-9809-48b4-be19-89e8f5969ef1 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:24.363562 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d48e399-9809-48b4-be19-89e8f5969ef1 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:24.364051 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d48e399-9809-48b4-be19-89e8f5969ef1 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:24.364491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d48e399-9809-48b4-be19-89e8f5969ef1 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:24.525489 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4d48e399-9809-48b4-be19-89e8f5969ef1 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368f6c3db9f24561a13f48ce02e7655e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecbac50c16847799a85c148c6c143de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:24.541971 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4d48e399-9809-48b4-be19-89e8f5969ef1 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5" status: 200 len: 1321 microversion: 2.1 time: 0.215554 Oct 05 02:30:24.542571 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 431/865] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:24 2022] GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:24.560928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-7a87019d-4d01-41c2-98d1-aae1af4a6292 req-d51b502a-c659-4923-b2be-e66e267a2966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3245900a-6147-427e-86e3-b0af919523e6", "name": "network-vif-deleted", "tag": "11e57809-b0ee-4162-9bf6-2a552194ea98"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:24.570610 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-b7947193-a829-4a58-9587-541a76c674e0 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:30:24.571109 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-b7947193-a829-4a58-9587-541a76c674e0 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:30:24.571497 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-b7947193-a829-4a58-9587-541a76c674e0 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:30:24.571902 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-b7947193-a829-4a58-9587-541a76c674e0 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:30:24.572308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-b7947193-a829-4a58-9587-541a76c674e0 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:30:24.573084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-7a87019d-4d01-41c2-98d1-aae1af4a6292 req-d51b502a-c659-4923-b2be-e66e267a2966 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:24.573933 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-7a87019d-4d01-41c2-98d1-aae1af4a6292 req-d51b502a-c659-4923-b2be-e66e267a2966 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:24.574529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-7a87019d-4d01-41c2-98d1-aae1af4a6292 req-d51b502a-c659-4923-b2be-e66e267a2966 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:24.590216 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-7a87019d-4d01-41c2-98d1-aae1af4a6292 req-d51b502a-c659-4923-b2be-e66e267a2966 service nova] Creating event network-vif-deleted:11e57809-b0ee-4162-9bf6-2a552194ea98 for instance 3245900a-6147-427e-86e3-b0af919523e6 on n-h2-858272-3 Oct 05 02:30:24.596793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7947193-a829-4a58-9587-541a76c674e0 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:24.596925 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7947193-a829-4a58-9587-541a76c674e0 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:24.597187 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-7a87019d-4d01-41c2-98d1-aae1af4a6292 req-d51b502a-c659-4923-b2be-e66e267a2966 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052422 Oct 05 02:30:24.597357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7947193-a829-4a58-9587-541a76c674e0 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:24.598183 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 432/866] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:30:24.598582 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7947193-a829-4a58-9587-541a76c674e0 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:24.599043 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7947193-a829-4a58-9587-541a76c674e0 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:24.599786 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7947193-a829-4a58-9587-541a76c674e0 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:24.605152 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b785bb9f-d9e3-4a0a-a9ed-90dff181cdc8 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:24.606179 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b785bb9f-d9e3-4a0a-a9ed-90dff181cdc8 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] [instance: aaa20a8a-8a7b-42dd-9b4e-9165fba82942] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:24.613519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b785bb9f-d9e3-4a0a-a9ed-90dff181cdc8 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:24.614425 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b785bb9f-d9e3-4a0a-a9ed-90dff181cdc8 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:24.615035 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b785bb9f-d9e3-4a0a-a9ed-90dff181cdc8 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:24.616585 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b785bb9f-d9e3-4a0a-a9ed-90dff181cdc8 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:24.617238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b785bb9f-d9e3-4a0a-a9ed-90dff181cdc8 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:24.617827 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b785bb9f-d9e3-4a0a-a9ed-90dff181cdc8 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:24.634221 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-b7947193-a829-4a58-9587-541a76c674e0 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Getting quotas for project f42fe97af30047fd999c08abc89dc2ea. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:30:24.669865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-b7947193-a829-4a58-9587-541a76c674e0 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Getting quotas for user 9af06771f33b4bff85a7ec7bb746a44b and project f42fe97af30047fd999c08abc89dc2ea. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:30:24.685942 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b7947193-a829-4a58-9587-541a76c674e0 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:30:24.690501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b7947193-a829-4a58-9587-541a76c674e0 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] [instance: e13827ed-384b-43ec-8ba8-d9ab3f96eb6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:30:24.743440 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b7947193-a829-4a58-9587-541a76c674e0 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.063862 Oct 05 02:30:24.751533 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 435/867] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:30:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:30:24.757491 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6082d449-fb60-4e18-9072-4f68a0bea694 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:24.761428 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6082d449-fb60-4e18-9072-4f68a0bea694 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:24.762284 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6082d449-fb60-4e18-9072-4f68a0bea694 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:24.762900 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6082d449-fb60-4e18-9072-4f68a0bea694 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:24.764173 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6082d449-fb60-4e18-9072-4f68a0bea694 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:24.764804 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6082d449-fb60-4e18-9072-4f68a0bea694 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:24.765548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6082d449-fb60-4e18-9072-4f68a0bea694 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:24.811356 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6082d449-fb60-4e18-9072-4f68a0bea694 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.057990 Oct 05 02:30:24.812145 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 436/868] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Oct 5 02:30:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:30:24.820211 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8be7a6bf-d571-4404-a6b7-b28bf9fc4721 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:24.821090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8be7a6bf-d571-4404-a6b7-b28bf9fc4721 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:24.828777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8be7a6bf-d571-4404-a6b7-b28bf9fc4721 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:24.829648 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8be7a6bf-d571-4404-a6b7-b28bf9fc4721 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:24.830236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8be7a6bf-d571-4404-a6b7-b28bf9fc4721 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:24.831120 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8be7a6bf-d571-4404-a6b7-b28bf9fc4721 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:24.831868 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8be7a6bf-d571-4404-a6b7-b28bf9fc4721 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:24.832447 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8be7a6bf-d571-4404-a6b7-b28bf9fc4721 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:25.129510 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8be7a6bf-d571-4404-a6b7-b28bf9fc4721 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:25.151938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8be7a6bf-d571-4404-a6b7-b28bf9fc4721 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:25.156587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8be7a6bf-d571-4404-a6b7-b28bf9fc4721 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:25.164606 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8be7a6bf-d571-4404-a6b7-b28bf9fc4721 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1446 microversion: 2.75 time: 0.350418 Oct 05 02:30:25.165617 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 437/869] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:24 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1446 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:25.171027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-19a0f3e8-e84b-44a6-b67d-7f330642174c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1733325361", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "861e3da3-98a1-4728-b218-322c9db128b3"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:25.241002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-19a0f3e8-e84b-44a6-b67d-7f330642174c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] validate_networks() for None {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:30:25.353116 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b785bb9f-d9e3-4a0a-a9ed-90dff181cdc8 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f914ca523057422f88748746ba18b525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '407895b8d4e94b74a2cb652eb2c30048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:25.363073 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b785bb9f-d9e3-4a0a-a9ed-90dff181cdc8 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942" status: 200 len: 1370 microversion: 2.1 time: 0.762756 Oct 05 02:30:25.363604 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 433/870] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:24 2022] GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942 => generated 1370 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:25.369591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-230d181c-8dec-4c63-82c8-22d73acca11a tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:25.370220 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-230d181c-8dec-4c63-82c8-22d73acca11a tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] [instance: e13827ed-384b-43ec-8ba8-d9ab3f96eb6a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:25.376945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-230d181c-8dec-4c63-82c8-22d73acca11a tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:25.377503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-230d181c-8dec-4c63-82c8-22d73acca11a tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:25.378097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-230d181c-8dec-4c63-82c8-22d73acca11a tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:25.378802 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-230d181c-8dec-4c63-82c8-22d73acca11a tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:25.380122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-230d181c-8dec-4c63-82c8-22d73acca11a tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:25.380701 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-230d181c-8dec-4c63-82c8-22d73acca11a tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:25.628555 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-230d181c-8dec-4c63-82c8-22d73acca11a tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af06771f33b4bff85a7ec7bb746a44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42fe97af30047fd999c08abc89dc2ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:25.637733 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-230d181c-8dec-4c63-82c8-22d73acca11a tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] 10.222.0.16 "GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a" status: 200 len: 1219 microversion: 2.1 time: 0.273000 Oct 05 02:30:25.657540 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 434/871] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:25 2022] GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a => generated 1219 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:25.657540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c6d36b91-11fb-4141-ba8a-0698c4dd3473 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:25.657540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c6d36b91-11fb-4141-ba8a-0698c4dd3473 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:25.673580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c6d36b91-11fb-4141-ba8a-0698c4dd3473 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:25.674084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c6d36b91-11fb-4141-ba8a-0698c4dd3473 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:25.674519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c6d36b91-11fb-4141-ba8a-0698c4dd3473 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:25.675231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c6d36b91-11fb-4141-ba8a-0698c4dd3473 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:25.675685 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c6d36b91-11fb-4141-ba8a-0698c4dd3473 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:25.676111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c6d36b91-11fb-4141-ba8a-0698c4dd3473 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:25.798557 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c6d36b91-11fb-4141-ba8a-0698c4dd3473 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8/action" status: 202 len: 0 microversion: 2.1 time: 0.150800 Oct 05 02:30:25.799688 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 435/872] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:30:25 2022] POST /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:30:25.807226 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2cb72b0f-f3db-480a-ba29-3a38737afd10 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:25.808132 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2cb72b0f-f3db-480a-ba29-3a38737afd10 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 6a205b3a-9fb4-4703-9368-0ab2436d60e5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:25.817602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cb72b0f-f3db-480a-ba29-3a38737afd10 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:25.818317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cb72b0f-f3db-480a-ba29-3a38737afd10 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:25.819235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cb72b0f-f3db-480a-ba29-3a38737afd10 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:25.820169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cb72b0f-f3db-480a-ba29-3a38737afd10 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:25.820876 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cb72b0f-f3db-480a-ba29-3a38737afd10 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:25.821457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cb72b0f-f3db-480a-ba29-3a38737afd10 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:25.827781 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:26.169794 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-19a0f3e8-e84b-44a6-b67d-7f330642174c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:30:26.170781 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-19a0f3e8-e84b-44a6-b67d-7f330642174c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:30:26.171468 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-19a0f3e8-e84b-44a6-b67d-7f330642174c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:30:26.173106 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-19a0f3e8-e84b-44a6-b67d-7f330642174c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:30:26.173539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-19a0f3e8-e84b-44a6-b67d-7f330642174c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:30:26.182932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19a0f3e8-e84b-44a6-b67d-7f330642174c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:26.183425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19a0f3e8-e84b-44a6-b67d-7f330642174c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:26.183863 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19a0f3e8-e84b-44a6-b67d-7f330642174c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:26.184791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19a0f3e8-e84b-44a6-b67d-7f330642174c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:26.185279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19a0f3e8-e84b-44a6-b67d-7f330642174c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:26.185703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19a0f3e8-e84b-44a6-b67d-7f330642174c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:26.205755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-19a0f3e8-e84b-44a6-b67d-7f330642174c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Getting quotas for project c6918daa4f884786b45bc88dd1e4e94a. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:30:26.212602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-19a0f3e8-e84b-44a6-b67d-7f330642174c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Getting quotas for user c73227214e404f4db779694b8c11779e and project c6918daa4f884786b45bc88dd1e4e94a. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:30:26.227241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-19a0f3e8-e84b-44a6-b67d-7f330642174c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:30:26.229636 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-19a0f3e8-e84b-44a6-b67d-7f330642174c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 75dd5d21-42fd-4501-9b43-1716d9e8a63c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:30:26.279486 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-19a0f3e8-e84b-44a6-b67d-7f330642174c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.112524 Oct 05 02:30:26.300692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2cb72b0f-f3db-480a-ba29-3a38737afd10 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368f6c3db9f24561a13f48ce02e7655e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecbac50c16847799a85c148c6c143de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:26.310715 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 438/873] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:30:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:30:26.312236 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2cb72b0f-f3db-480a-ba29-3a38737afd10 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5" status: 200 len: 1388 microversion: 2.1 time: 0.510810 Oct 05 02:30:26.319955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cb59d3b4-362c-478e-b1b4-affff4b8c879 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:26.320585 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cb59d3b4-362c-478e-b1b4-affff4b8c879 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:26.333040 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 436/874] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:25 2022] GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5 => generated 1388 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:26.342463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb59d3b4-362c-478e-b1b4-affff4b8c879 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:26.342977 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb59d3b4-362c-478e-b1b4-affff4b8c879 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:26.344330 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-14983f4c-4301-4862-9612-6c0fd27fb012 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:26.345348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb59d3b4-362c-478e-b1b4-affff4b8c879 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:26.346115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb59d3b4-362c-478e-b1b4-affff4b8c879 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:26.346618 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb59d3b4-362c-478e-b1b4-affff4b8c879 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:26.347064 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb59d3b4-362c-478e-b1b4-affff4b8c879 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:26.348194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-14983f4c-4301-4862-9612-6c0fd27fb012 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:26.362654 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14983f4c-4301-4862-9612-6c0fd27fb012 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:26.364658 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14983f4c-4301-4862-9612-6c0fd27fb012 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:26.365142 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14983f4c-4301-4862-9612-6c0fd27fb012 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:26.365859 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14983f4c-4301-4862-9612-6c0fd27fb012 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:26.369101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14983f4c-4301-4862-9612-6c0fd27fb012 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:26.369552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14983f4c-4301-4862-9612-6c0fd27fb012 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:26.613285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-14983f4c-4301-4862-9612-6c0fd27fb012 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:26.623092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-14983f4c-4301-4862-9612-6c0fd27fb012 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:26.624975 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-14983f4c-4301-4862-9612-6c0fd27fb012 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:26.631464 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-14983f4c-4301-4862-9612-6c0fd27fb012 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1446 microversion: 2.75 time: 0.296633 Oct 05 02:30:26.633546 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 437/875] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:26 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1446 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:26.638609 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-451d8750-736b-4f21-b690-eb463dad2a35 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:26.639398 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-451d8750-736b-4f21-b690-eb463dad2a35 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 75dd5d21-42fd-4501-9b43-1716d9e8a63c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:26.914106 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-451d8750-736b-4f21-b690-eb463dad2a35 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:26.926863 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-451d8750-736b-4f21-b690-eb463dad2a35 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c" status: 200 len: 1214 microversion: 2.1 time: 0.289880 Oct 05 02:30:26.928582 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 438/876] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:26 2022] GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c => generated 1214 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:26.944684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8a6a3cd4-2e1c-4a5c-80a1-3c34e8858234 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:26.945619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8a6a3cd4-2e1c-4a5c-80a1-3c34e8858234 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] [instance: aaa20a8a-8a7b-42dd-9b4e-9165fba82942] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:26.952692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a6a3cd4-2e1c-4a5c-80a1-3c34e8858234 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:26.954835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a6a3cd4-2e1c-4a5c-80a1-3c34e8858234 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:26.955754 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a6a3cd4-2e1c-4a5c-80a1-3c34e8858234 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:26.956070 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a6a3cd4-2e1c-4a5c-80a1-3c34e8858234 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:26.956596 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a6a3cd4-2e1c-4a5c-80a1-3c34e8858234 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:26.960291 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a6a3cd4-2e1c-4a5c-80a1-3c34e8858234 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:27.217207 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cb59d3b4-362c-478e-b1b4-affff4b8c879 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1628 microversion: 2.1 time: 0.905308 Oct 05 02:30:27.238099 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 439/877] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:26 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1628 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:27.361691 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e17453d3-eb3e-4f2c-afee-0db951b7d74c tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1743962668", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "af5ead4f-c20e-44ab-9535-9b650da7cc14"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:27.447534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-e17453d3-eb3e-4f2c-afee-0db951b7d74c tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] validate_networks() for [('af5ead4f-c20e-44ab-9535-9b650da7cc14', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:30:27.489027 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8a6a3cd4-2e1c-4a5c-80a1-3c34e8858234 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f914ca523057422f88748746ba18b525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '407895b8d4e94b74a2cb652eb2c30048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:27.492546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:27.508145 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8a6a3cd4-2e1c-4a5c-80a1-3c34e8858234 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942" status: 200 len: 1556 microversion: 2.1 time: 0.578152 Oct 05 02:30:27.515022 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 439/878] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:26 2022] GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942 => generated 1556 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:27.542853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-18dad88f-b4ee-49cf-b144-5a536e7ed07a tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:27.544221 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-18dad88f-b4ee-49cf-b144-5a536e7ed07a tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] [instance: e13827ed-384b-43ec-8ba8-d9ab3f96eb6a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:27.558599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18dad88f-b4ee-49cf-b144-5a536e7ed07a tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:27.559683 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18dad88f-b4ee-49cf-b144-5a536e7ed07a tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:27.560210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18dad88f-b4ee-49cf-b144-5a536e7ed07a tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:27.560953 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18dad88f-b4ee-49cf-b144-5a536e7ed07a tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:27.561423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18dad88f-b4ee-49cf-b144-5a536e7ed07a tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:27.561852 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18dad88f-b4ee-49cf-b144-5a536e7ed07a tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:27.743120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-18dad88f-b4ee-49cf-b144-5a536e7ed07a tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af06771f33b4bff85a7ec7bb746a44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42fe97af30047fd999c08abc89dc2ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:27.752449 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-18dad88f-b4ee-49cf-b144-5a536e7ed07a tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] 10.222.0.16 "GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a" status: 200 len: 1273 microversion: 2.1 time: 0.220978 Oct 05 02:30:27.778739 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 440/879] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:27 2022] GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a => generated 1273 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:27.787732 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-639e8bdf-de00-40c8-b900-373e8fcee330 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858272-3", "block_migration": true, "disk_over_commit": false}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:27.790483 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-639e8bdf-de00-40c8-b900-373e8fcee330 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:27.798054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-639e8bdf-de00-40c8-b900-373e8fcee330 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:27.798677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-639e8bdf-de00-40c8-b900-373e8fcee330 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:27.799127 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-639e8bdf-de00-40c8-b900-373e8fcee330 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:27.799841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-639e8bdf-de00-40c8-b900-373e8fcee330 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:27.800303 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-639e8bdf-de00-40c8-b900-373e8fcee330 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:27.800730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-639e8bdf-de00-40c8-b900-373e8fcee330 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:27.830715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-639e8bdf-de00-40c8-b900-373e8fcee330 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lazy-loading 'flavor' on Instance uuid e4445875-4e03-4ee1-8905-a60ec2a9d2c8 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:30:27.847266 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-639e8bdf-de00-40c8-b900-373e8fcee330 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Going to try to live migrate instance to n-h2-858272-3 {{(pid=122320) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 05 02:30:29.101749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e17453d3-eb3e-4f2c-afee-0db951b7d74c tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:30:29.103375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e17453d3-eb3e-4f2c-afee-0db951b7d74c tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:30:29.104593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e17453d3-eb3e-4f2c-afee-0db951b7d74c tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:30:29.105672 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e17453d3-eb3e-4f2c-afee-0db951b7d74c tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:30:29.106279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e17453d3-eb3e-4f2c-afee-0db951b7d74c tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:30:29.119359 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e17453d3-eb3e-4f2c-afee-0db951b7d74c tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:29.120338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e17453d3-eb3e-4f2c-afee-0db951b7d74c tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:29.121441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e17453d3-eb3e-4f2c-afee-0db951b7d74c tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:29.122523 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e17453d3-eb3e-4f2c-afee-0db951b7d74c tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:29.123157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e17453d3-eb3e-4f2c-afee-0db951b7d74c tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:29.123749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e17453d3-eb3e-4f2c-afee-0db951b7d74c tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:29.152020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-e17453d3-eb3e-4f2c-afee-0db951b7d74c tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Getting quotas for project 87b237b4e2594addbd899828d222aa9d. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:30:29.157864 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-e17453d3-eb3e-4f2c-afee-0db951b7d74c tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Getting quotas for user f596b5b1188a4384a2efdafbd08242ba and project 87b237b4e2594addbd899828d222aa9d. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:30:29.178776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e17453d3-eb3e-4f2c-afee-0db951b7d74c tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:30:29.181235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e17453d3-eb3e-4f2c-afee-0db951b7d74c tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] [instance: a7434499-a9a4-4c47-a5fe-5ea93c32c0ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:30:29.244049 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e17453d3-eb3e-4f2c-afee-0db951b7d74c tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.004348 Oct 05 02:30:29.244760 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 440/880] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:30:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:30:29.254746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4dc68875-7a72-4ef6-a078-f4ca31233a38 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:29.255831 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4dc68875-7a72-4ef6-a078-f4ca31233a38 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 6a205b3a-9fb4-4703-9368-0ab2436d60e5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:29.263930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4dc68875-7a72-4ef6-a078-f4ca31233a38 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:29.264439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4dc68875-7a72-4ef6-a078-f4ca31233a38 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:29.264976 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4dc68875-7a72-4ef6-a078-f4ca31233a38 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:29.266235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4dc68875-7a72-4ef6-a078-f4ca31233a38 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:29.266790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4dc68875-7a72-4ef6-a078-f4ca31233a38 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:29.267130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4dc68875-7a72-4ef6-a078-f4ca31233a38 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:29.270282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:29.572850 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-639e8bdf-de00-40c8-b900-373e8fcee330 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8/action" status: 202 len: 0 microversion: 2.1 time: 1.792293 Oct 05 02:30:29.573504 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 441/881] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:30:27 2022] POST /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8/action => generated 0 bytes in 1794 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:30:29.579043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d01578ca-113e-4bc7-a812-f3b03ea1a91e tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:29.579740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d01578ca-113e-4bc7-a812-f3b03ea1a91e tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] [instance: aaa20a8a-8a7b-42dd-9b4e-9165fba82942] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:29.587879 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d01578ca-113e-4bc7-a812-f3b03ea1a91e tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:29.589172 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d01578ca-113e-4bc7-a812-f3b03ea1a91e tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:29.589774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d01578ca-113e-4bc7-a812-f3b03ea1a91e tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:29.590759 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d01578ca-113e-4bc7-a812-f3b03ea1a91e tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:29.591371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d01578ca-113e-4bc7-a812-f3b03ea1a91e tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:29.591974 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d01578ca-113e-4bc7-a812-f3b03ea1a91e tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:29.931769 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d01578ca-113e-4bc7-a812-f3b03ea1a91e tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.357078 Oct 05 02:30:29.932418 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 442/882] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 02:30:29 2022] GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942/os-interface => generated 285 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:30:29.945450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-54069395-2323-4589-a497-84d26a1592bc tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:29.946440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-54069395-2323-4589-a497-84d26a1592bc tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:29.958225 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54069395-2323-4589-a497-84d26a1592bc tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:29.958912 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54069395-2323-4589-a497-84d26a1592bc tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:29.961908 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54069395-2323-4589-a497-84d26a1592bc tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:29.963119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54069395-2323-4589-a497-84d26a1592bc tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:29.963794 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54069395-2323-4589-a497-84d26a1592bc tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:29.965125 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54069395-2323-4589-a497-84d26a1592bc tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:30.088030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4dc68875-7a72-4ef6-a078-f4ca31233a38 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368f6c3db9f24561a13f48ce02e7655e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecbac50c16847799a85c148c6c143de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:30.117867 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4dc68875-7a72-4ef6-a078-f4ca31233a38 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5" status: 200 len: 1388 microversion: 2.1 time: 0.869173 Oct 05 02:30:30.146286 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 441/883] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:29 2022] GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5 => generated 1388 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:30.155221 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-da4c724a-3cf2-43c8-999a-3cb95b7ae1d5 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:30.160851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-da4c724a-3cf2-43c8-999a-3cb95b7ae1d5 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 75dd5d21-42fd-4501-9b43-1716d9e8a63c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:30.177382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da4c724a-3cf2-43c8-999a-3cb95b7ae1d5 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:30.178143 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da4c724a-3cf2-43c8-999a-3cb95b7ae1d5 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:30.178763 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da4c724a-3cf2-43c8-999a-3cb95b7ae1d5 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:30.182294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da4c724a-3cf2-43c8-999a-3cb95b7ae1d5 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:30.183052 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da4c724a-3cf2-43c8-999a-3cb95b7ae1d5 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:30.184131 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da4c724a-3cf2-43c8-999a-3cb95b7ae1d5 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:30.210089 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-54069395-2323-4589-a497-84d26a1592bc tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:30.224000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-54069395-2323-4589-a497-84d26a1592bc tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:30.229085 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-54069395-2323-4589-a497-84d26a1592bc tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:30.240480 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-54069395-2323-4589-a497-84d26a1592bc tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1446 microversion: 2.75 time: 0.306966 Oct 05 02:30:30.246152 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 443/884] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:29 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1446 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:30.254993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d5c6bab3-b277-48ac-ad2c-1d57a902b6e9 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:30.257644 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d5c6bab3-b277-48ac-ad2c-1d57a902b6e9 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] [instance: e13827ed-384b-43ec-8ba8-d9ab3f96eb6a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:30.281866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5c6bab3-b277-48ac-ad2c-1d57a902b6e9 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:30.282389 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5c6bab3-b277-48ac-ad2c-1d57a902b6e9 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:30.282841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5c6bab3-b277-48ac-ad2c-1d57a902b6e9 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:30.283565 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5c6bab3-b277-48ac-ad2c-1d57a902b6e9 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:30.284026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5c6bab3-b277-48ac-ad2c-1d57a902b6e9 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:30.284456 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5c6bab3-b277-48ac-ad2c-1d57a902b6e9 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:30.632427 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-da4c724a-3cf2-43c8-999a-3cb95b7ae1d5 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:30.671468 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-da4c724a-3cf2-43c8-999a-3cb95b7ae1d5 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c" status: 200 len: 1272 microversion: 2.1 time: 0.523707 Oct 05 02:30:30.678855 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 442/885] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:30 2022] GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c => generated 1272 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:30.688845 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-d3fc2cb9-aa3a-4aec-bc8e-2f464d2ded91 req-b29f0d4e-9288-4fc5-975a-6893b3d3acae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a205b3a-9fb4-4703-9368-0ab2436d60e5", "tag": "15b4abdf-070c-4e34-93c5-64406f010c79"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:30.713054 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d3fc2cb9-aa3a-4aec-bc8e-2f464d2ded91 req-b29f0d4e-9288-4fc5-975a-6893b3d3acae service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:30.714062 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d3fc2cb9-aa3a-4aec-bc8e-2f464d2ded91 req-b29f0d4e-9288-4fc5-975a-6893b3d3acae service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:30.715749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d3fc2cb9-aa3a-4aec-bc8e-2f464d2ded91 req-b29f0d4e-9288-4fc5-975a-6893b3d3acae service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:30.750946 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-d3fc2cb9-aa3a-4aec-bc8e-2f464d2ded91 req-b29f0d4e-9288-4fc5-975a-6893b3d3acae service nova] Creating event network-changed:15b4abdf-070c-4e34-93c5-64406f010c79 for instance 6a205b3a-9fb4-4703-9368-0ab2436d60e5 on n-h2-858272-3 Oct 05 02:30:30.775653 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-d3fc2cb9-aa3a-4aec-bc8e-2f464d2ded91 req-b29f0d4e-9288-4fc5-975a-6893b3d3acae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094012 Oct 05 02:30:30.776845 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 443/886] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:30:30.807702 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f57dfcb3-2a80-4197-a9cd-4fe03d53b2e2 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:30.809487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f57dfcb3-2a80-4197-a9cd-4fe03d53b2e2 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] [instance: a7434499-a9a4-4c47-a5fe-5ea93c32c0ac] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:30.838681 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f57dfcb3-2a80-4197-a9cd-4fe03d53b2e2 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:30.844621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f57dfcb3-2a80-4197-a9cd-4fe03d53b2e2 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:30.845395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f57dfcb3-2a80-4197-a9cd-4fe03d53b2e2 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:30.846493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f57dfcb3-2a80-4197-a9cd-4fe03d53b2e2 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:30.847273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f57dfcb3-2a80-4197-a9cd-4fe03d53b2e2 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:30.848191 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f57dfcb3-2a80-4197-a9cd-4fe03d53b2e2 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:30.904218 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d5c6bab3-b277-48ac-ad2c-1d57a902b6e9 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af06771f33b4bff85a7ec7bb746a44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42fe97af30047fd999c08abc89dc2ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:30.913037 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d5c6bab3-b277-48ac-ad2c-1d57a902b6e9 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] 10.222.0.16 "GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a" status: 200 len: 1315 microversion: 2.1 time: 0.665451 Oct 05 02:30:30.928721 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 444/887] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:30 2022] GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a => generated 1315 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:30.933850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4f248090-77bf-4179-98a8-4aa6f56ccf58 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:30.934468 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4f248090-77bf-4179-98a8-4aa6f56ccf58 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:30.937604 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:30.941397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f248090-77bf-4179-98a8-4aa6f56ccf58 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:30.941888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f248090-77bf-4179-98a8-4aa6f56ccf58 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:30.942567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f248090-77bf-4179-98a8-4aa6f56ccf58 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:30.943468 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f248090-77bf-4179-98a8-4aa6f56ccf58 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:30.944148 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f248090-77bf-4179-98a8-4aa6f56ccf58 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:30.944777 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f248090-77bf-4179-98a8-4aa6f56ccf58 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:31.046405 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f57dfcb3-2a80-4197-a9cd-4fe03d53b2e2 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f596b5b1188a4384a2efdafbd08242ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b237b4e2594addbd899828d222aa9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:31.054995 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f57dfcb3-2a80-4197-a9cd-4fe03d53b2e2 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] 10.222.0.16 "GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac" status: 200 len: 1276 microversion: 2.1 time: 0.274538 Oct 05 02:30:31.055573 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 444/888] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:30 2022] GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac => generated 1276 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:31.153292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-81ef751b-58c7-412d-910d-6f1d21e704cb tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:31.154599 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-81ef751b-58c7-412d-910d-6f1d21e704cb tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 6a205b3a-9fb4-4703-9368-0ab2436d60e5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:31.164279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:31.166663 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81ef751b-58c7-412d-910d-6f1d21e704cb tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:31.177397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81ef751b-58c7-412d-910d-6f1d21e704cb tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:31.178884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81ef751b-58c7-412d-910d-6f1d21e704cb tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:31.179768 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81ef751b-58c7-412d-910d-6f1d21e704cb tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:31.180394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81ef751b-58c7-412d-910d-6f1d21e704cb tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:31.188701 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81ef751b-58c7-412d-910d-6f1d21e704cb tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:31.616823 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4f248090-77bf-4179-98a8-4aa6f56ccf58 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:31.633829 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4f248090-77bf-4179-98a8-4aa6f56ccf58 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1502 microversion: 2.1 time: 0.702295 Oct 05 02:30:31.673140 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 445/889] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:30 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1502 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:31.685306 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-609847db-34dd-4c44-80e7-e6085c90da69 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:31.685937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-609847db-34dd-4c44-80e7-e6085c90da69 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:31.698030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-609847db-34dd-4c44-80e7-e6085c90da69 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:31.698540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-609847db-34dd-4c44-80e7-e6085c90da69 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:31.698978 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-609847db-34dd-4c44-80e7-e6085c90da69 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:31.704721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-609847db-34dd-4c44-80e7-e6085c90da69 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:31.705487 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-609847db-34dd-4c44-80e7-e6085c90da69 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:31.706095 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-609847db-34dd-4c44-80e7-e6085c90da69 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:31.954521 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-609847db-34dd-4c44-80e7-e6085c90da69 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:31.970421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-609847db-34dd-4c44-80e7-e6085c90da69 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:31.972241 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-609847db-34dd-4c44-80e7-e6085c90da69 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:31.982472 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-609847db-34dd-4c44-80e7-e6085c90da69 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1446 microversion: 2.75 time: 0.307949 Oct 05 02:30:31.986608 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 446/890] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:31 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1446 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:31.991839 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-81ef751b-58c7-412d-910d-6f1d21e704cb tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368f6c3db9f24561a13f48ce02e7655e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecbac50c16847799a85c148c6c143de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:32.002033 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dfc7c887-a9ee-42c6-8932-0e6df3dc7b40 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:32.004056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dfc7c887-a9ee-42c6-8932-0e6df3dc7b40 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 75dd5d21-42fd-4501-9b43-1716d9e8a63c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:32.011610 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-81ef751b-58c7-412d-910d-6f1d21e704cb tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5" status: 200 len: 1388 microversion: 2.1 time: 0.863895 Oct 05 02:30:32.012207 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 445/891] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:31 2022] GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5 => generated 1388 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:30:32.015069 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfc7c887-a9ee-42c6-8932-0e6df3dc7b40 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:32.016469 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfc7c887-a9ee-42c6-8932-0e6df3dc7b40 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:32.017226 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4e44236b-5910-414f-b378-2c847f0e5935 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:32.017467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfc7c887-a9ee-42c6-8932-0e6df3dc7b40 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:32.017839 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4e44236b-5910-414f-b378-2c847f0e5935 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] [instance: e13827ed-384b-43ec-8ba8-d9ab3f96eb6a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:32.018677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfc7c887-a9ee-42c6-8932-0e6df3dc7b40 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:32.019440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfc7c887-a9ee-42c6-8932-0e6df3dc7b40 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:32.020030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfc7c887-a9ee-42c6-8932-0e6df3dc7b40 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:32.028706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e44236b-5910-414f-b378-2c847f0e5935 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:32.030563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e44236b-5910-414f-b378-2c847f0e5935 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:32.032682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e44236b-5910-414f-b378-2c847f0e5935 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:32.033781 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e44236b-5910-414f-b378-2c847f0e5935 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:32.034481 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e44236b-5910-414f-b378-2c847f0e5935 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:32.035594 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e44236b-5910-414f-b378-2c847f0e5935 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:32.485323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4e44236b-5910-414f-b378-2c847f0e5935 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af06771f33b4bff85a7ec7bb746a44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42fe97af30047fd999c08abc89dc2ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:32.494863 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4e44236b-5910-414f-b378-2c847f0e5935 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] 10.222.0.16 "GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a" status: 200 len: 1315 microversion: 2.1 time: 0.481419 Oct 05 02:30:32.495445 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 446/892] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:32 2022] GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a => generated 1315 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:32.501511 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2744e31a-f872-4295-bd5e-cce2244f384d tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:32.502400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2744e31a-f872-4295-bd5e-cce2244f384d tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] [instance: a7434499-a9a4-4c47-a5fe-5ea93c32c0ac] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:32.514409 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2744e31a-f872-4295-bd5e-cce2244f384d tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:32.515254 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2744e31a-f872-4295-bd5e-cce2244f384d tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:32.516047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2744e31a-f872-4295-bd5e-cce2244f384d tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:32.517129 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2744e31a-f872-4295-bd5e-cce2244f384d tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:32.517832 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2744e31a-f872-4295-bd5e-cce2244f384d tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:32.518631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2744e31a-f872-4295-bd5e-cce2244f384d tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:32.540833 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dfc7c887-a9ee-42c6-8932-0e6df3dc7b40 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:32.550163 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dfc7c887-a9ee-42c6-8932-0e6df3dc7b40 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c" status: 200 len: 1314 microversion: 2.1 time: 0.561952 Oct 05 02:30:32.551843 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 447/893] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:31 2022] GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c => generated 1314 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:32.557190 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-a6c9f3a2-4c75-4a21-ad8e-42f668e1579a req-cfdc68fb-d390-42a3-850c-6b70c2dcde90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaa20a8a-8a7b-42dd-9b4e-9165fba82942", "tag": "a4ccf2aa-c3c8-483d-b7c6-24391c11f3bc"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:32.568263 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a6c9f3a2-4c75-4a21-ad8e-42f668e1579a req-cfdc68fb-d390-42a3-850c-6b70c2dcde90 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:32.569080 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a6c9f3a2-4c75-4a21-ad8e-42f668e1579a req-cfdc68fb-d390-42a3-850c-6b70c2dcde90 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:32.569570 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a6c9f3a2-4c75-4a21-ad8e-42f668e1579a req-cfdc68fb-d390-42a3-850c-6b70c2dcde90 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:32.589458 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-a6c9f3a2-4c75-4a21-ad8e-42f668e1579a req-cfdc68fb-d390-42a3-850c-6b70c2dcde90 service nova] Creating event network-changed:a4ccf2aa-c3c8-483d-b7c6-24391c11f3bc for instance aaa20a8a-8a7b-42dd-9b4e-9165fba82942 on n-h1-858272-3 Oct 05 02:30:32.595844 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-a6c9f3a2-4c75-4a21-ad8e-42f668e1579a req-cfdc68fb-d390-42a3-850c-6b70c2dcde90 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042555 Oct 05 02:30:32.596880 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 448/894] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:30:32.618743 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2744e31a-f872-4295-bd5e-cce2244f384d tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f596b5b1188a4384a2efdafbd08242ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b237b4e2594addbd899828d222aa9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:32.629887 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2744e31a-f872-4295-bd5e-cce2244f384d tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] 10.222.0.16 "GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac" status: 200 len: 1282 microversion: 2.1 time: 0.133130 Oct 05 02:30:32.630905 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 447/895] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:32 2022] GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac => generated 1282 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:32.662941 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dea8b0c7-4a11-41f4-a1cc-fb545fa316ce tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:32.665072 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dea8b0c7-4a11-41f4-a1cc-fb545fa316ce tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:32.673449 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dea8b0c7-4a11-41f4-a1cc-fb545fa316ce tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:32.673973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dea8b0c7-4a11-41f4-a1cc-fb545fa316ce tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:32.674902 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dea8b0c7-4a11-41f4-a1cc-fb545fa316ce tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:32.675755 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dea8b0c7-4a11-41f4-a1cc-fb545fa316ce tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:32.676356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dea8b0c7-4a11-41f4-a1cc-fb545fa316ce tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:32.676784 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dea8b0c7-4a11-41f4-a1cc-fb545fa316ce tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:33.016469 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-705b75da-8d04-4a21-8c84-82b44af0e3d8 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:33.017208 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-705b75da-8d04-4a21-8c84-82b44af0e3d8 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:33.024078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-705b75da-8d04-4a21-8c84-82b44af0e3d8 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:33.024666 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-705b75da-8d04-4a21-8c84-82b44af0e3d8 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:33.025399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-705b75da-8d04-4a21-8c84-82b44af0e3d8 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:33.027214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-705b75da-8d04-4a21-8c84-82b44af0e3d8 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:33.027747 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-705b75da-8d04-4a21-8c84-82b44af0e3d8 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:33.028242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-705b75da-8d04-4a21-8c84-82b44af0e3d8 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:33.397669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-705b75da-8d04-4a21-8c84-82b44af0e3d8 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:33.406080 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-705b75da-8d04-4a21-8c84-82b44af0e3d8 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:33.408234 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-705b75da-8d04-4a21-8c84-82b44af0e3d8 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:33.413539 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-705b75da-8d04-4a21-8c84-82b44af0e3d8 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1446 microversion: 2.75 time: 0.401639 Oct 05 02:30:33.429823 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 448/896] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:33 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1446 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:30:33.429823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3fdea932-7d9c-4d92-a0e7-70d740e4f1be tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:33.429823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3fdea932-7d9c-4d92-a0e7-70d740e4f1be tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 6a205b3a-9fb4-4703-9368-0ab2436d60e5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:33.429823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3fdea932-7d9c-4d92-a0e7-70d740e4f1be tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:33.430501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3fdea932-7d9c-4d92-a0e7-70d740e4f1be tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:33.430501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3fdea932-7d9c-4d92-a0e7-70d740e4f1be tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:33.430501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3fdea932-7d9c-4d92-a0e7-70d740e4f1be tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:33.430820 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3fdea932-7d9c-4d92-a0e7-70d740e4f1be tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:33.430820 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3fdea932-7d9c-4d92-a0e7-70d740e4f1be tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:33.516599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dea8b0c7-4a11-41f4-a1cc-fb545fa316ce tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:33.524580 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dea8b0c7-4a11-41f4-a1cc-fb545fa316ce tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1502 microversion: 2.1 time: 0.866736 Oct 05 02:30:33.525192 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 449/897] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:32 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1502 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:33.530170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-e05d5040-b2fd-4f6f-a301-e4bf29823d35 req-c74d755e-b2b8-411b-9ea5-7f91e944898b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e13827ed-384b-43ec-8ba8-d9ab3f96eb6a", "tag": "deeb8020-81ec-4c04-82be-82ca0029d926"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:33.539917 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e05d5040-b2fd-4f6f-a301-e4bf29823d35 req-c74d755e-b2b8-411b-9ea5-7f91e944898b service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:33.540390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e05d5040-b2fd-4f6f-a301-e4bf29823d35 req-c74d755e-b2b8-411b-9ea5-7f91e944898b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:33.541098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e05d5040-b2fd-4f6f-a301-e4bf29823d35 req-c74d755e-b2b8-411b-9ea5-7f91e944898b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:33.552824 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-e05d5040-b2fd-4f6f-a301-e4bf29823d35 req-c74d755e-b2b8-411b-9ea5-7f91e944898b service nova] Creating event network-changed:deeb8020-81ec-4c04-82be-82ca0029d926 for instance e13827ed-384b-43ec-8ba8-d9ab3f96eb6a on n-h1-858272-3 Oct 05 02:30:33.557592 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-e05d5040-b2fd-4f6f-a301-e4bf29823d35 req-c74d755e-b2b8-411b-9ea5-7f91e944898b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031117 Oct 05 02:30:33.558244 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 450/898] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:30:33.564018 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e4dbbe44-2bf9-431a-a83e-42078f14aab9 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:33.564711 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e4dbbe44-2bf9-431a-a83e-42078f14aab9 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] [instance: e13827ed-384b-43ec-8ba8-d9ab3f96eb6a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:33.570746 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4dbbe44-2bf9-431a-a83e-42078f14aab9 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:33.571236 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4dbbe44-2bf9-431a-a83e-42078f14aab9 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:33.571667 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4dbbe44-2bf9-431a-a83e-42078f14aab9 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:33.572362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4dbbe44-2bf9-431a-a83e-42078f14aab9 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:33.572821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4dbbe44-2bf9-431a-a83e-42078f14aab9 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:33.573272 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4dbbe44-2bf9-431a-a83e-42078f14aab9 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:33.914216 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3fdea932-7d9c-4d92-a0e7-70d740e4f1be tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368f6c3db9f24561a13f48ce02e7655e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecbac50c16847799a85c148c6c143de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:33.923083 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3fdea932-7d9c-4d92-a0e7-70d740e4f1be tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5" status: 200 len: 1388 microversion: 2.1 time: 0.507882 Oct 05 02:30:33.937885 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 449/899] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:33 2022] GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5 => generated 1388 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:33.937885 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-035fb766-5a38-4c16-a75b-7cae54fc5ff1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:33.937885 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-035fb766-5a38-4c16-a75b-7cae54fc5ff1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 75dd5d21-42fd-4501-9b43-1716d9e8a63c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:33.937885 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-035fb766-5a38-4c16-a75b-7cae54fc5ff1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:33.937885 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-035fb766-5a38-4c16-a75b-7cae54fc5ff1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:33.938515 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-035fb766-5a38-4c16-a75b-7cae54fc5ff1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:33.938515 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-035fb766-5a38-4c16-a75b-7cae54fc5ff1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:33.938515 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-035fb766-5a38-4c16-a75b-7cae54fc5ff1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:33.938515 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-035fb766-5a38-4c16-a75b-7cae54fc5ff1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:34.075634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e4dbbe44-2bf9-431a-a83e-42078f14aab9 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af06771f33b4bff85a7ec7bb746a44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42fe97af30047fd999c08abc89dc2ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:34.085245 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e4dbbe44-2bf9-431a-a83e-42078f14aab9 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] 10.222.0.16 "GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a" status: 200 len: 1315 microversion: 2.1 time: 0.525764 Oct 05 02:30:34.086205 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 451/900] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:33 2022] GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a => generated 1315 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:34.091026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8f34227c-730c-43a5-9b1c-ff0d5b78ae2b tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:34.091928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8f34227c-730c-43a5-9b1c-ff0d5b78ae2b tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] [instance: a7434499-a9a4-4c47-a5fe-5ea93c32c0ac] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:34.100697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f34227c-730c-43a5-9b1c-ff0d5b78ae2b tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:34.101479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f34227c-730c-43a5-9b1c-ff0d5b78ae2b tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:34.101918 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f34227c-730c-43a5-9b1c-ff0d5b78ae2b tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:34.102656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f34227c-730c-43a5-9b1c-ff0d5b78ae2b tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:34.103118 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f34227c-730c-43a5-9b1c-ff0d5b78ae2b tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:34.103547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f34227c-730c-43a5-9b1c-ff0d5b78ae2b tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:34.472195 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-035fb766-5a38-4c16-a75b-7cae54fc5ff1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:34.481466 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-035fb766-5a38-4c16-a75b-7cae54fc5ff1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c" status: 200 len: 1314 microversion: 2.1 time: 0.556850 Oct 05 02:30:34.492931 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 450/901] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:33 2022] GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:34.492931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3371566b-9206-46f7-8d9e-e44ea3b8135c tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:34.492931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3371566b-9206-46f7-8d9e-e44ea3b8135c tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:34.495606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3371566b-9206-46f7-8d9e-e44ea3b8135c tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:34.496367 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3371566b-9206-46f7-8d9e-e44ea3b8135c tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:34.497124 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3371566b-9206-46f7-8d9e-e44ea3b8135c tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:34.498065 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3371566b-9206-46f7-8d9e-e44ea3b8135c tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:34.498891 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3371566b-9206-46f7-8d9e-e44ea3b8135c tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:34.500267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3371566b-9206-46f7-8d9e-e44ea3b8135c tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:34.648228 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3371566b-9206-46f7-8d9e-e44ea3b8135c tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:34.665303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3371566b-9206-46f7-8d9e-e44ea3b8135c tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:34.665839 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8f34227c-730c-43a5-9b1c-ff0d5b78ae2b tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f596b5b1188a4384a2efdafbd08242ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b237b4e2594addbd899828d222aa9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:34.666964 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3371566b-9206-46f7-8d9e-e44ea3b8135c tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:34.673077 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3371566b-9206-46f7-8d9e-e44ea3b8135c tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1446 microversion: 2.75 time: 0.189304 Oct 05 02:30:34.692926 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 451/902] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:34 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1446 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:34.703065 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8f34227c-730c-43a5-9b1c-ff0d5b78ae2b tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] 10.222.0.16 "GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac" status: 200 len: 1324 microversion: 2.1 time: 0.613458 Oct 05 02:30:34.703901 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-676cb501-33e1-407f-8f5a-91549ae54342 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:34.704540 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-676cb501-33e1-407f-8f5a-91549ae54342 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:34.706716 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 452/903] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:34 2022] GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac => generated 1324 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:34.723054 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-676cb501-33e1-407f-8f5a-91549ae54342 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:34.723463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-676cb501-33e1-407f-8f5a-91549ae54342 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:34.723899 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-676cb501-33e1-407f-8f5a-91549ae54342 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:34.724861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-676cb501-33e1-407f-8f5a-91549ae54342 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:34.725361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-676cb501-33e1-407f-8f5a-91549ae54342 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:34.725783 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-676cb501-33e1-407f-8f5a-91549ae54342 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:34.954340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fe1fcd5e-7c07-4d96-a798-a4e637249e58 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:34.955411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fe1fcd5e-7c07-4d96-a798-a4e637249e58 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 6a205b3a-9fb4-4703-9368-0ab2436d60e5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:34.964287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe1fcd5e-7c07-4d96-a798-a4e637249e58 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:34.965121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe1fcd5e-7c07-4d96-a798-a4e637249e58 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:34.965812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe1fcd5e-7c07-4d96-a798-a4e637249e58 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:34.967182 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe1fcd5e-7c07-4d96-a798-a4e637249e58 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:34.967920 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe1fcd5e-7c07-4d96-a798-a4e637249e58 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:34.970281 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe1fcd5e-7c07-4d96-a798-a4e637249e58 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:34.992612 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:35.367089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-676cb501-33e1-407f-8f5a-91549ae54342 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:35.379779 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-676cb501-33e1-407f-8f5a-91549ae54342 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1502 microversion: 2.1 time: 0.704720 Oct 05 02:30:35.381040 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 452/904] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:34 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1502 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:35.401512 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-7042d6f7-ae0c-43f0-a987-49c05c94baae req-e0e22f50-44f2-49b0-8bb5-8d1b295b0875 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4445875-4e03-4ee1-8905-a60ec2a9d2c8", "name": "network-vif-unplugged", "status": "completed", "tag": "9fafe495-cce4-462d-af59-d2b8107ff726"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:35.414568 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7042d6f7-ae0c-43f0-a987-49c05c94baae req-e0e22f50-44f2-49b0-8bb5-8d1b295b0875 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:35.415148 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7042d6f7-ae0c-43f0-a987-49c05c94baae req-e0e22f50-44f2-49b0-8bb5-8d1b295b0875 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:35.415809 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7042d6f7-ae0c-43f0-a987-49c05c94baae req-e0e22f50-44f2-49b0-8bb5-8d1b295b0875 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:35.436289 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-7042d6f7-ae0c-43f0-a987-49c05c94baae req-e0e22f50-44f2-49b0-8bb5-8d1b295b0875 service nova] Creating event network-vif-unplugged:9fafe495-cce4-462d-af59-d2b8107ff726 for instance e4445875-4e03-4ee1-8905-a60ec2a9d2c8 on n-h1-858272-3 Oct 05 02:30:35.445204 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-7042d6f7-ae0c-43f0-a987-49c05c94baae req-e0e22f50-44f2-49b0-8bb5-8d1b295b0875 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062323 Oct 05 02:30:35.446866 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 453/905] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:30:35.456637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-686b5414-4618-43e1-9ef9-258e5e9fbc0d tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:35.458265 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-686b5414-4618-43e1-9ef9-258e5e9fbc0d tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] [instance: e13827ed-384b-43ec-8ba8-d9ab3f96eb6a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:35.468051 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-686b5414-4618-43e1-9ef9-258e5e9fbc0d tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:35.470082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-686b5414-4618-43e1-9ef9-258e5e9fbc0d tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:35.470803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-686b5414-4618-43e1-9ef9-258e5e9fbc0d tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:35.472272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-686b5414-4618-43e1-9ef9-258e5e9fbc0d tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:35.472994 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-686b5414-4618-43e1-9ef9-258e5e9fbc0d tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:35.473688 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-686b5414-4618-43e1-9ef9-258e5e9fbc0d tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:35.556544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fe1fcd5e-7c07-4d96-a798-a4e637249e58 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368f6c3db9f24561a13f48ce02e7655e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecbac50c16847799a85c148c6c143de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:35.568377 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fe1fcd5e-7c07-4d96-a798-a4e637249e58 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5" status: 200 len: 1388 microversion: 2.1 time: 0.623088 Oct 05 02:30:35.581024 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 453/906] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:34 2022] GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5 => generated 1388 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:30:35.582156 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-209c27f7-a0c5-4363-8d7c-9e86cfd36ee7 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:35.582987 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-209c27f7-a0c5-4363-8d7c-9e86cfd36ee7 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 75dd5d21-42fd-4501-9b43-1716d9e8a63c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:35.591006 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-209c27f7-a0c5-4363-8d7c-9e86cfd36ee7 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:35.591586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-209c27f7-a0c5-4363-8d7c-9e86cfd36ee7 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:35.592027 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-209c27f7-a0c5-4363-8d7c-9e86cfd36ee7 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:35.592734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-209c27f7-a0c5-4363-8d7c-9e86cfd36ee7 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:35.593232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-209c27f7-a0c5-4363-8d7c-9e86cfd36ee7 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:35.594204 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-209c27f7-a0c5-4363-8d7c-9e86cfd36ee7 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:36.372074 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-686b5414-4618-43e1-9ef9-258e5e9fbc0d tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af06771f33b4bff85a7ec7bb746a44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42fe97af30047fd999c08abc89dc2ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:36.379346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-209c27f7-a0c5-4363-8d7c-9e86cfd36ee7 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:36.380803 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-686b5414-4618-43e1-9ef9-258e5e9fbc0d tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] 10.222.0.16 "GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a" status: 200 len: 1315 microversion: 2.1 time: 0.932503 Oct 05 02:30:36.381645 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 454/907] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:35 2022] GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a => generated 1315 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:36.389928 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-209c27f7-a0c5-4363-8d7c-9e86cfd36ee7 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c" status: 200 len: 1314 microversion: 2.1 time: 0.816552 Oct 05 02:30:36.390969 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 454/908] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:35 2022] GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c => generated 1314 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:36.401388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-de24bbea-9f05-4fae-847b-0e550b4d6f8d tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:36.401840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6aa766ec-9589-439c-a133-125c60578e64 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:36.402443 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-de24bbea-9f05-4fae-847b-0e550b4d6f8d tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:36.402825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6aa766ec-9589-439c-a133-125c60578e64 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] [instance: a7434499-a9a4-4c47-a5fe-5ea93c32c0ac] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:36.411453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de24bbea-9f05-4fae-847b-0e550b4d6f8d tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:36.412585 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de24bbea-9f05-4fae-847b-0e550b4d6f8d tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:36.414164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de24bbea-9f05-4fae-847b-0e550b4d6f8d tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:36.417514 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6aa766ec-9589-439c-a133-125c60578e64 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:36.417789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de24bbea-9f05-4fae-847b-0e550b4d6f8d tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:36.418008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6aa766ec-9589-439c-a133-125c60578e64 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:36.418438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6aa766ec-9589-439c-a133-125c60578e64 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:36.418567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de24bbea-9f05-4fae-847b-0e550b4d6f8d tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:36.419075 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de24bbea-9f05-4fae-847b-0e550b4d6f8d tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:36.419213 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6aa766ec-9589-439c-a133-125c60578e64 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:36.419574 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6aa766ec-9589-439c-a133-125c60578e64 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:36.419979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6aa766ec-9589-439c-a133-125c60578e64 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:36.580974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-de24bbea-9f05-4fae-847b-0e550b4d6f8d tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:36.590781 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-de24bbea-9f05-4fae-847b-0e550b4d6f8d tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:36.592247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-de24bbea-9f05-4fae-847b-0e550b4d6f8d tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:36.598169 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-de24bbea-9f05-4fae-847b-0e550b4d6f8d tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1446 microversion: 2.75 time: 0.207853 Oct 05 02:30:36.602392 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 455/909] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:36 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1446 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:36.609027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d5fca8d2-e15f-48e2-adf5-1396faf3e0eb tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:36.610004 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d5fca8d2-e15f-48e2-adf5-1396faf3e0eb tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:36.617404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5fca8d2-e15f-48e2-adf5-1396faf3e0eb tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:36.617949 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5fca8d2-e15f-48e2-adf5-1396faf3e0eb tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:36.618523 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5fca8d2-e15f-48e2-adf5-1396faf3e0eb tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:36.619533 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5fca8d2-e15f-48e2-adf5-1396faf3e0eb tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:36.619824 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5fca8d2-e15f-48e2-adf5-1396faf3e0eb tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:36.620250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5fca8d2-e15f-48e2-adf5-1396faf3e0eb tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:36.878927 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6aa766ec-9589-439c-a133-125c60578e64 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f596b5b1188a4384a2efdafbd08242ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b237b4e2594addbd899828d222aa9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:36.892058 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6aa766ec-9589-439c-a133-125c60578e64 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] 10.222.0.16 "GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac" status: 200 len: 1324 microversion: 2.1 time: 0.498256 Oct 05 02:30:36.893354 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 455/910] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:36 2022] GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac => generated 1324 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:36.900742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-16ed22e4-c94d-476d-a5bb-ce930a63be26 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:36.901584 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-16ed22e4-c94d-476d-a5bb-ce930a63be26 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 6a205b3a-9fb4-4703-9368-0ab2436d60e5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:36.914443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16ed22e4-c94d-476d-a5bb-ce930a63be26 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:36.915482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16ed22e4-c94d-476d-a5bb-ce930a63be26 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:36.916155 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16ed22e4-c94d-476d-a5bb-ce930a63be26 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:36.917177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16ed22e4-c94d-476d-a5bb-ce930a63be26 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:36.917845 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16ed22e4-c94d-476d-a5bb-ce930a63be26 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:36.918489 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16ed22e4-c94d-476d-a5bb-ce930a63be26 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:36.923804 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=10 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:37.025299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d5fca8d2-e15f-48e2-adf5-1396faf3e0eb tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:37.035680 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d5fca8d2-e15f-48e2-adf5-1396faf3e0eb tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1502 microversion: 2.1 time: 0.433416 Oct 05 02:30:37.036961 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 456/911] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:36 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1502 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:37.042562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-badc2a42-b8ca-4577-8bf4-3ecd440439f4 req-1ae143a7-3cee-40a1-8c9d-86c03e973b7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a205b3a-9fb4-4703-9368-0ab2436d60e5", "name": "network-vif-plugged", "status": "completed", "tag": "15b4abdf-070c-4e34-93c5-64406f010c79"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:37.054581 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-badc2a42-b8ca-4577-8bf4-3ecd440439f4 req-1ae143a7-3cee-40a1-8c9d-86c03e973b7d service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:37.055154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-badc2a42-b8ca-4577-8bf4-3ecd440439f4 req-1ae143a7-3cee-40a1-8c9d-86c03e973b7d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:37.055469 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-badc2a42-b8ca-4577-8bf4-3ecd440439f4 req-1ae143a7-3cee-40a1-8c9d-86c03e973b7d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:37.070357 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-badc2a42-b8ca-4577-8bf4-3ecd440439f4 req-1ae143a7-3cee-40a1-8c9d-86c03e973b7d service nova] Creating event network-vif-plugged:15b4abdf-070c-4e34-93c5-64406f010c79 for instance 6a205b3a-9fb4-4703-9368-0ab2436d60e5 on n-h2-858272-3 Oct 05 02:30:37.075373 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-badc2a42-b8ca-4577-8bf4-3ecd440439f4 req-1ae143a7-3cee-40a1-8c9d-86c03e973b7d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037765 Oct 05 02:30:37.076156 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 457/912] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:30:37.228533 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-16ed22e4-c94d-476d-a5bb-ce930a63be26 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368f6c3db9f24561a13f48ce02e7655e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecbac50c16847799a85c148c6c143de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:37.238249 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-16ed22e4-c94d-476d-a5bb-ce930a63be26 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5" status: 200 len: 1388 microversion: 2.1 time: 0.342908 Oct 05 02:30:37.239151 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 456/913] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:36 2022] GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5 => generated 1388 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:37.361068 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-93d1ae0e-3fbb-4af0-94e6-77da7c68d702 req-0344a466-328a-4ffe-9c67-3d59b773fb41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7434499-a9a4-4c47-a5fe-5ea93c32c0ac", "tag": "939a0258-e304-4d51-8be4-5cd608c3ff90"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:37.372017 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-93d1ae0e-3fbb-4af0-94e6-77da7c68d702 req-0344a466-328a-4ffe-9c67-3d59b773fb41 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:37.372495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-93d1ae0e-3fbb-4af0-94e6-77da7c68d702 req-0344a466-328a-4ffe-9c67-3d59b773fb41 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:37.373068 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-93d1ae0e-3fbb-4af0-94e6-77da7c68d702 req-0344a466-328a-4ffe-9c67-3d59b773fb41 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:37.385584 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-93d1ae0e-3fbb-4af0-94e6-77da7c68d702 req-0344a466-328a-4ffe-9c67-3d59b773fb41 service nova] Creating event network-changed:939a0258-e304-4d51-8be4-5cd608c3ff90 for instance a7434499-a9a4-4c47-a5fe-5ea93c32c0ac on n-h1-858272-3 Oct 05 02:30:37.391884 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-93d1ae0e-3fbb-4af0-94e6-77da7c68d702 req-0344a466-328a-4ffe-9c67-3d59b773fb41 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035889 Oct 05 02:30:37.393147 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 458/914] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:30:37.404671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-60004352-45e2-4821-9407-1b1a2b77941c tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:37.405341 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-60004352-45e2-4821-9407-1b1a2b77941c tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] [instance: e13827ed-384b-43ec-8ba8-d9ab3f96eb6a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:37.412951 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60004352-45e2-4821-9407-1b1a2b77941c tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:37.413689 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60004352-45e2-4821-9407-1b1a2b77941c tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:37.414283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60004352-45e2-4821-9407-1b1a2b77941c tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:37.416936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60004352-45e2-4821-9407-1b1a2b77941c tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:37.417622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60004352-45e2-4821-9407-1b1a2b77941c tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:37.418356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60004352-45e2-4821-9407-1b1a2b77941c tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:37.426277 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b64705ba-d0a2-491d-ad61-a065a9a31395 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:37.427040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b64705ba-d0a2-491d-ad61-a065a9a31395 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 75dd5d21-42fd-4501-9b43-1716d9e8a63c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:37.438769 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b64705ba-d0a2-491d-ad61-a065a9a31395 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:37.439499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b64705ba-d0a2-491d-ad61-a065a9a31395 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:37.440164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b64705ba-d0a2-491d-ad61-a065a9a31395 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:37.441216 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b64705ba-d0a2-491d-ad61-a065a9a31395 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:37.441868 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b64705ba-d0a2-491d-ad61-a065a9a31395 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:37.442305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b64705ba-d0a2-491d-ad61-a065a9a31395 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:37.675357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-60004352-45e2-4821-9407-1b1a2b77941c tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af06771f33b4bff85a7ec7bb746a44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42fe97af30047fd999c08abc89dc2ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:37.685463 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-60004352-45e2-4821-9407-1b1a2b77941c tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] 10.222.0.16 "GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a" status: 200 len: 1315 microversion: 2.1 time: 0.285710 Oct 05 02:30:37.686052 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 457/915] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:37 2022] GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:37.692306 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-f1b3f38b-3380-4000-aba1-7641be9d1a52 req-cb8ce2ba-f437-4b58-bc7a-73671a3c9968 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4445875-4e03-4ee1-8905-a60ec2a9d2c8", "tag": "9fafe495-cce4-462d-af59-d2b8107ff726"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:37.702459 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f1b3f38b-3380-4000-aba1-7641be9d1a52 req-cb8ce2ba-f437-4b58-bc7a-73671a3c9968 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:37.703672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f1b3f38b-3380-4000-aba1-7641be9d1a52 req-cb8ce2ba-f437-4b58-bc7a-73671a3c9968 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:37.704284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f1b3f38b-3380-4000-aba1-7641be9d1a52 req-cb8ce2ba-f437-4b58-bc7a-73671a3c9968 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:37.709758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b64705ba-d0a2-491d-ad61-a065a9a31395 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:37.718830 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b64705ba-d0a2-491d-ad61-a065a9a31395 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c" status: 200 len: 1314 microversion: 2.1 time: 0.300732 Oct 05 02:30:37.719485 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 459/916] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:37 2022] GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:30:37.725088 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-f1b3f38b-3380-4000-aba1-7641be9d1a52 req-cb8ce2ba-f437-4b58-bc7a-73671a3c9968 service nova] Creating event network-changed:9fafe495-cce4-462d-af59-d2b8107ff726 for instance e4445875-4e03-4ee1-8905-a60ec2a9d2c8 on n-h1-858272-3 Oct 05 02:30:37.731402 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-f1b3f38b-3380-4000-aba1-7641be9d1a52 req-cb8ce2ba-f437-4b58-bc7a-73671a3c9968 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042614 Oct 05 02:30:37.732009 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 458/917] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:30:37.732652 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-42470dfd-f6cf-4928-bb72-6caf91dd634a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:37.734518 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-42470dfd-f6cf-4928-bb72-6caf91dd634a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:37.744752 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42470dfd-f6cf-4928-bb72-6caf91dd634a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:37.745547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42470dfd-f6cf-4928-bb72-6caf91dd634a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:37.746279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42470dfd-f6cf-4928-bb72-6caf91dd634a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:37.747095 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42470dfd-f6cf-4928-bb72-6caf91dd634a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:37.747623 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42470dfd-f6cf-4928-bb72-6caf91dd634a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:37.748116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42470dfd-f6cf-4928-bb72-6caf91dd634a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:37.770159 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:37.822722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-42470dfd-f6cf-4928-bb72-6caf91dd634a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:37.831399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-42470dfd-f6cf-4928-bb72-6caf91dd634a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:37.832943 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-42470dfd-f6cf-4928-bb72-6caf91dd634a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:37.838102 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-42470dfd-f6cf-4928-bb72-6caf91dd634a tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1446 microversion: 2.75 time: 0.111011 Oct 05 02:30:37.838673 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 460/918] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:37 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1446 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:37.916620 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c12071f5-3633-445a-8528-487bb4b8ebbf tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:37.917758 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c12071f5-3633-445a-8528-487bb4b8ebbf tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] [instance: a7434499-a9a4-4c47-a5fe-5ea93c32c0ac] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:37.925364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c12071f5-3633-445a-8528-487bb4b8ebbf tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:37.926094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c12071f5-3633-445a-8528-487bb4b8ebbf tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:37.926535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c12071f5-3633-445a-8528-487bb4b8ebbf tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:37.927285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c12071f5-3633-445a-8528-487bb4b8ebbf tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:37.927913 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c12071f5-3633-445a-8528-487bb4b8ebbf tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:37.928935 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c12071f5-3633-445a-8528-487bb4b8ebbf tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:38.059069 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d2d2b9a3-1902-4cfb-bb74-8de4eef9856b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:38.059685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d2d2b9a3-1902-4cfb-bb74-8de4eef9856b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:38.068000 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2d2b9a3-1902-4cfb-bb74-8de4eef9856b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:38.068445 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2d2b9a3-1902-4cfb-bb74-8de4eef9856b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:38.068880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2d2b9a3-1902-4cfb-bb74-8de4eef9856b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:38.069652 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2d2b9a3-1902-4cfb-bb74-8de4eef9856b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:38.070106 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2d2b9a3-1902-4cfb-bb74-8de4eef9856b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:38.070531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2d2b9a3-1902-4cfb-bb74-8de4eef9856b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:38.190243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c12071f5-3633-445a-8528-487bb4b8ebbf tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f596b5b1188a4384a2efdafbd08242ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b237b4e2594addbd899828d222aa9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:38.201224 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c12071f5-3633-445a-8528-487bb4b8ebbf tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] 10.222.0.16 "GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac" status: 200 len: 1324 microversion: 2.1 time: 0.289163 Oct 05 02:30:38.202478 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 459/919] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:37 2022] GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac => generated 1324 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:38.263653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a43370e5-93cb-4012-95bd-8bfe8f882353 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:38.265460 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a43370e5-93cb-4012-95bd-8bfe8f882353 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 6a205b3a-9fb4-4703-9368-0ab2436d60e5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:38.274128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a43370e5-93cb-4012-95bd-8bfe8f882353 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:38.279422 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a43370e5-93cb-4012-95bd-8bfe8f882353 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:38.280095 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a43370e5-93cb-4012-95bd-8bfe8f882353 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:38.280822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a43370e5-93cb-4012-95bd-8bfe8f882353 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:38.281603 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a43370e5-93cb-4012-95bd-8bfe8f882353 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:38.282720 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a43370e5-93cb-4012-95bd-8bfe8f882353 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:38.435434 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d2d2b9a3-1902-4cfb-bb74-8de4eef9856b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:38.446256 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d2d2b9a3-1902-4cfb-bb74-8de4eef9856b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1502 microversion: 2.1 time: 0.390848 Oct 05 02:30:38.448990 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 461/920] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:38 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1502 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:30:38.692552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a43370e5-93cb-4012-95bd-8bfe8f882353 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368f6c3db9f24561a13f48ce02e7655e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecbac50c16847799a85c148c6c143de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:38.702682 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a43370e5-93cb-4012-95bd-8bfe8f882353 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5" status: 200 len: 1388 microversion: 2.1 time: 0.443481 Oct 05 02:30:38.704077 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 460/921] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:38 2022] GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5 => generated 1388 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:30:38.722180 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-290c5be1-3914-4d9a-b54f-c0d442e1a3ac tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:38.722804 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-290c5be1-3914-4d9a-b54f-c0d442e1a3ac tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] [instance: e13827ed-384b-43ec-8ba8-d9ab3f96eb6a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:38.730986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-290c5be1-3914-4d9a-b54f-c0d442e1a3ac tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:38.731481 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-290c5be1-3914-4d9a-b54f-c0d442e1a3ac tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:38.731917 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-290c5be1-3914-4d9a-b54f-c0d442e1a3ac tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:38.732621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-290c5be1-3914-4d9a-b54f-c0d442e1a3ac tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:38.733108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-290c5be1-3914-4d9a-b54f-c0d442e1a3ac tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:38.733825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-290c5be1-3914-4d9a-b54f-c0d442e1a3ac tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:38.744351 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f7ae8c8c-38fa-46c1-b080-76e8412f6ba8 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:38.745040 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f7ae8c8c-38fa-46c1-b080-76e8412f6ba8 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 75dd5d21-42fd-4501-9b43-1716d9e8a63c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:38.753776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7ae8c8c-38fa-46c1-b080-76e8412f6ba8 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:38.754518 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7ae8c8c-38fa-46c1-b080-76e8412f6ba8 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:38.755348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7ae8c8c-38fa-46c1-b080-76e8412f6ba8 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:38.756393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7ae8c8c-38fa-46c1-b080-76e8412f6ba8 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:38.756860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7ae8c8c-38fa-46c1-b080-76e8412f6ba8 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:38.758120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7ae8c8c-38fa-46c1-b080-76e8412f6ba8 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:39.141558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=8 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:39.168182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=18 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:39.631947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-290c5be1-3914-4d9a-b54f-c0d442e1a3ac tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af06771f33b4bff85a7ec7bb746a44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42fe97af30047fd999c08abc89dc2ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:39.644465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f7ae8c8c-38fa-46c1-b080-76e8412f6ba8 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:39.654519 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-290c5be1-3914-4d9a-b54f-c0d442e1a3ac tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] 10.222.0.16 "GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a" status: 200 len: 1315 microversion: 2.1 time: 0.947096 Oct 05 02:30:39.661246 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f7ae8c8c-38fa-46c1-b080-76e8412f6ba8 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c" status: 200 len: 1314 microversion: 2.1 time: 0.920992 Oct 05 02:30:39.662462 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 461/922] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:38 2022] GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c => generated 1314 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:30:39.670176 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 462/923] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:38 2022] GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a => generated 1315 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:30:39.672589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8d319f23-2dde-49b3-aa07-f9e1257d0f26 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:39.673243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8d319f23-2dde-49b3-aa07-f9e1257d0f26 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:39.685566 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7db61caa-9c89-4c04-8af7-b62f925f1434 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:39.686324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7db61caa-9c89-4c04-8af7-b62f925f1434 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] [instance: a7434499-a9a4-4c47-a5fe-5ea93c32c0ac] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:39.687407 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d319f23-2dde-49b3-aa07-f9e1257d0f26 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:39.690242 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d319f23-2dde-49b3-aa07-f9e1257d0f26 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:39.692231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d319f23-2dde-49b3-aa07-f9e1257d0f26 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:39.693529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d319f23-2dde-49b3-aa07-f9e1257d0f26 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:39.694667 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d319f23-2dde-49b3-aa07-f9e1257d0f26 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:39.695398 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d319f23-2dde-49b3-aa07-f9e1257d0f26 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:39.701066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7db61caa-9c89-4c04-8af7-b62f925f1434 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:39.703861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7db61caa-9c89-4c04-8af7-b62f925f1434 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:39.703861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7db61caa-9c89-4c04-8af7-b62f925f1434 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:39.704842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7db61caa-9c89-4c04-8af7-b62f925f1434 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:39.706168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7db61caa-9c89-4c04-8af7-b62f925f1434 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:39.707724 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7db61caa-9c89-4c04-8af7-b62f925f1434 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:39.866360 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8d319f23-2dde-49b3-aa07-f9e1257d0f26 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:39.877335 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8d319f23-2dde-49b3-aa07-f9e1257d0f26 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:39.879271 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8d319f23-2dde-49b3-aa07-f9e1257d0f26 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:39.885728 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8d319f23-2dde-49b3-aa07-f9e1257d0f26 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1446 microversion: 2.75 time: 0.222095 Oct 05 02:30:39.887242 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 462/924] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:39 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1446 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:39.892367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-45394cd9-508b-4314-aca5-016521e5ea29 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:39.893464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-45394cd9-508b-4314-aca5-016521e5ea29 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:39.900730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-45394cd9-508b-4314-aca5-016521e5ea29 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:39.901517 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-45394cd9-508b-4314-aca5-016521e5ea29 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:39.902176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-45394cd9-508b-4314-aca5-016521e5ea29 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:39.903159 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-45394cd9-508b-4314-aca5-016521e5ea29 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:39.903836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-45394cd9-508b-4314-aca5-016521e5ea29 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:39.904792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-45394cd9-508b-4314-aca5-016521e5ea29 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:40.248738 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7db61caa-9c89-4c04-8af7-b62f925f1434 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f596b5b1188a4384a2efdafbd08242ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b237b4e2594addbd899828d222aa9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:40.263280 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7db61caa-9c89-4c04-8af7-b62f925f1434 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] 10.222.0.16 "GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac" status: 200 len: 1324 microversion: 2.1 time: 0.585313 Oct 05 02:30:40.264944 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 463/925] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:39 2022] GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac => generated 1324 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:40.298410 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-c11ec251-17d6-471f-8d3c-74bd85b6c61e req-14d98961-c186-46a4-8f48-1f10223287e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75dd5d21-42fd-4501-9b43-1716d9e8a63c", "tag": "a93afda1-f2bc-4e2d-b873-c7ed67a96cba"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:40.314947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c11ec251-17d6-471f-8d3c-74bd85b6c61e req-14d98961-c186-46a4-8f48-1f10223287e6 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:40.315606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c11ec251-17d6-471f-8d3c-74bd85b6c61e req-14d98961-c186-46a4-8f48-1f10223287e6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:40.316155 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c11ec251-17d6-471f-8d3c-74bd85b6c61e req-14d98961-c186-46a4-8f48-1f10223287e6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:40.334060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-45394cd9-508b-4314-aca5-016521e5ea29 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:40.337229 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-c11ec251-17d6-471f-8d3c-74bd85b6c61e req-14d98961-c186-46a4-8f48-1f10223287e6 service nova] Creating event network-changed:a93afda1-f2bc-4e2d-b873-c7ed67a96cba for instance 75dd5d21-42fd-4501-9b43-1716d9e8a63c on n-h2-858272-3 Oct 05 02:30:40.344972 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-c11ec251-17d6-471f-8d3c-74bd85b6c61e req-14d98961-c186-46a4-8f48-1f10223287e6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062862 Oct 05 02:30:40.346778 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 464/926] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:30:40.347768 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-45394cd9-508b-4314-aca5-016521e5ea29 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1502 microversion: 2.1 time: 0.459348 Oct 05 02:30:40.348889 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 463/927] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:39 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1502 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:40.357214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-19f6d71a-3d39-499b-949c-b2eb26fb1522 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:40.358083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-19f6d71a-3d39-499b-949c-b2eb26fb1522 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 6a205b3a-9fb4-4703-9368-0ab2436d60e5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:40.365454 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19f6d71a-3d39-499b-949c-b2eb26fb1522 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:40.366079 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19f6d71a-3d39-499b-949c-b2eb26fb1522 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:40.366731 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19f6d71a-3d39-499b-949c-b2eb26fb1522 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:40.367548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19f6d71a-3d39-499b-949c-b2eb26fb1522 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:40.368277 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19f6d71a-3d39-499b-949c-b2eb26fb1522 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:40.368813 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19f6d71a-3d39-499b-949c-b2eb26fb1522 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:40.568840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-5016616e-656d-4345-8805-bf0c3606eaeb req-f1cb9630-179d-418f-943c-14698dd715c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13827ed-384b-43ec-8ba8-d9ab3f96eb6a", "name": "network-vif-plugged", "status": "completed", "tag": "deeb8020-81ec-4c04-82be-82ca0029d926"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:40.586023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-5016616e-656d-4345-8805-bf0c3606eaeb req-f1cb9630-179d-418f-943c-14698dd715c1 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:40.586788 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-5016616e-656d-4345-8805-bf0c3606eaeb req-f1cb9630-179d-418f-943c-14698dd715c1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:40.587210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-5016616e-656d-4345-8805-bf0c3606eaeb req-f1cb9630-179d-418f-943c-14698dd715c1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:40.606721 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-5016616e-656d-4345-8805-bf0c3606eaeb req-f1cb9630-179d-418f-943c-14698dd715c1 service nova] Creating event network-vif-plugged:deeb8020-81ec-4c04-82be-82ca0029d926 for instance e13827ed-384b-43ec-8ba8-d9ab3f96eb6a on n-h1-858272-3 Oct 05 02:30:40.626857 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-5016616e-656d-4345-8805-bf0c3606eaeb req-f1cb9630-179d-418f-943c-14698dd715c1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061533 Oct 05 02:30:40.627775 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 464/928] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:30:40.656851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-19f6d71a-3d39-499b-949c-b2eb26fb1522 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368f6c3db9f24561a13f48ce02e7655e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecbac50c16847799a85c148c6c143de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:40.682129 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0be686e1-7e29-43e2-aeb5-3f670a132fa2 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:40.683749 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0be686e1-7e29-43e2-aeb5-3f670a132fa2 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] [instance: e13827ed-384b-43ec-8ba8-d9ab3f96eb6a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:40.691697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0be686e1-7e29-43e2-aeb5-3f670a132fa2 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:40.692463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0be686e1-7e29-43e2-aeb5-3f670a132fa2 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:40.693303 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-19f6d71a-3d39-499b-949c-b2eb26fb1522 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5" status: 200 len: 1587 microversion: 2.1 time: 0.343894 Oct 05 02:30:40.694510 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 465/929] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:40 2022] GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5 => generated 1587 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:40.701288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0be686e1-7e29-43e2-aeb5-3f670a132fa2 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:40.703889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-57ea68db-76e9-42d8-a0e3-64ad69f16f1d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:40.704385 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-57ea68db-76e9-42d8-a0e3-64ad69f16f1d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 75dd5d21-42fd-4501-9b43-1716d9e8a63c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:40.705433 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0be686e1-7e29-43e2-aeb5-3f670a132fa2 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:40.706110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0be686e1-7e29-43e2-aeb5-3f670a132fa2 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:40.706711 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0be686e1-7e29-43e2-aeb5-3f670a132fa2 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:40.711066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-57ea68db-76e9-42d8-a0e3-64ad69f16f1d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:40.711636 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-57ea68db-76e9-42d8-a0e3-64ad69f16f1d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:40.712229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-57ea68db-76e9-42d8-a0e3-64ad69f16f1d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:40.712962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-57ea68db-76e9-42d8-a0e3-64ad69f16f1d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:40.715436 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-57ea68db-76e9-42d8-a0e3-64ad69f16f1d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:40.717576 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-57ea68db-76e9-42d8-a0e3-64ad69f16f1d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:40.941425 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0be686e1-7e29-43e2-aeb5-3f670a132fa2 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af06771f33b4bff85a7ec7bb746a44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42fe97af30047fd999c08abc89dc2ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:40.951990 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-57ea68db-76e9-42d8-a0e3-64ad69f16f1d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:40.953799 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0be686e1-7e29-43e2-aeb5-3f670a132fa2 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] 10.222.0.16 "GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a" status: 200 len: 1315 microversion: 2.1 time: 0.278639 Oct 05 02:30:40.964775 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-57ea68db-76e9-42d8-a0e3-64ad69f16f1d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c" status: 200 len: 1314 microversion: 2.1 time: 0.269126 Oct 05 02:30:40.965555 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 466/930] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:40 2022] GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:40.970110 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 465/931] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:40 2022] GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:40.971270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-758159d3-61aa-46eb-8b92-3a6855ceeddb tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:40.971864 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-758159d3-61aa-46eb-8b92-3a6855ceeddb tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 6a205b3a-9fb4-4703-9368-0ab2436d60e5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:40.975863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b9414c18-b440-42e4-9254-16070a46bafb tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:40.976674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b9414c18-b440-42e4-9254-16070a46bafb tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:40.980450 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-758159d3-61aa-46eb-8b92-3a6855ceeddb tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:40.981087 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-758159d3-61aa-46eb-8b92-3a6855ceeddb tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:40.982615 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-758159d3-61aa-46eb-8b92-3a6855ceeddb tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:40.983438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-758159d3-61aa-46eb-8b92-3a6855ceeddb tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:40.984805 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-758159d3-61aa-46eb-8b92-3a6855ceeddb tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:40.984979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9414c18-b440-42e4-9254-16070a46bafb tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:40.985376 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-758159d3-61aa-46eb-8b92-3a6855ceeddb tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:40.985497 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9414c18-b440-42e4-9254-16070a46bafb tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:40.985958 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9414c18-b440-42e4-9254-16070a46bafb tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:40.986676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9414c18-b440-42e4-9254-16070a46bafb tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:40.987149 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9414c18-b440-42e4-9254-16070a46bafb tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:40.987576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9414c18-b440-42e4-9254-16070a46bafb tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:41.094285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b9414c18-b440-42e4-9254-16070a46bafb tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:41.110108 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b9414c18-b440-42e4-9254-16070a46bafb tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:41.110872 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-758159d3-61aa-46eb-8b92-3a6855ceeddb tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.143731 Oct 05 02:30:41.111744 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b9414c18-b440-42e4-9254-16070a46bafb tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:41.112787 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 467/932] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 02:30:40 2022] GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5/os-interface => generated 285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:30:41.118683 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b9414c18-b440-42e4-9254-16070a46bafb tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1446 microversion: 2.75 time: 0.147219 Oct 05 02:30:41.119509 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 466/933] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:40 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1446 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:41.303371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c6e4ce7f-0fea-40e8-81c1-7cdbba8cf00f tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:41.303981 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c6e4ce7f-0fea-40e8-81c1-7cdbba8cf00f tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] [instance: a7434499-a9a4-4c47-a5fe-5ea93c32c0ac] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:41.311377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6e4ce7f-0fea-40e8-81c1-7cdbba8cf00f tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:41.311868 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6e4ce7f-0fea-40e8-81c1-7cdbba8cf00f tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:41.312412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6e4ce7f-0fea-40e8-81c1-7cdbba8cf00f tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:41.313277 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6e4ce7f-0fea-40e8-81c1-7cdbba8cf00f tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:41.315116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6e4ce7f-0fea-40e8-81c1-7cdbba8cf00f tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:41.315241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6e4ce7f-0fea-40e8-81c1-7cdbba8cf00f tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:41.387903 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-93c91a3a-f032-40a0-80b6-256b1f9a6dfc tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:41.389613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-93c91a3a-f032-40a0-80b6-256b1f9a6dfc tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:41.397133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93c91a3a-f032-40a0-80b6-256b1f9a6dfc tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:41.397945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93c91a3a-f032-40a0-80b6-256b1f9a6dfc tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:41.398591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93c91a3a-f032-40a0-80b6-256b1f9a6dfc tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:41.399496 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93c91a3a-f032-40a0-80b6-256b1f9a6dfc tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:41.400020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93c91a3a-f032-40a0-80b6-256b1f9a6dfc tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:41.400506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93c91a3a-f032-40a0-80b6-256b1f9a6dfc tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:41.670472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c6e4ce7f-0fea-40e8-81c1-7cdbba8cf00f tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f596b5b1188a4384a2efdafbd08242ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b237b4e2594addbd899828d222aa9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:41.678652 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c6e4ce7f-0fea-40e8-81c1-7cdbba8cf00f tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] 10.222.0.16 "GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac" status: 200 len: 1324 microversion: 2.1 time: 0.379316 Oct 05 02:30:41.679577 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 468/934] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:41 2022] GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac => generated 1324 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:41.714237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-93c91a3a-f032-40a0-80b6-256b1f9a6dfc tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:41.722038 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-93c91a3a-f032-40a0-80b6-256b1f9a6dfc tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1502 microversion: 2.1 time: 0.338012 Oct 05 02:30:41.726218 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 467/935] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:41 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1502 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:41.982618 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d92c812d-884f-4a9d-b4b7-7de927994c64 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:41.983235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d92c812d-884f-4a9d-b4b7-7de927994c64 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] [instance: e13827ed-384b-43ec-8ba8-d9ab3f96eb6a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:41.995011 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d92c812d-884f-4a9d-b4b7-7de927994c64 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:41.995225 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-432719c6-af02-44f2-8dbf-d48ff22aae9d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:41.995669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-432719c6-af02-44f2-8dbf-d48ff22aae9d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 75dd5d21-42fd-4501-9b43-1716d9e8a63c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:41.996065 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d92c812d-884f-4a9d-b4b7-7de927994c64 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:41.997053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d92c812d-884f-4a9d-b4b7-7de927994c64 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:41.997979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d92c812d-884f-4a9d-b4b7-7de927994c64 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:41.998595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d92c812d-884f-4a9d-b4b7-7de927994c64 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:41.999264 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d92c812d-884f-4a9d-b4b7-7de927994c64 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:42.008079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-432719c6-af02-44f2-8dbf-d48ff22aae9d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:42.008079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-432719c6-af02-44f2-8dbf-d48ff22aae9d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:42.008079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-432719c6-af02-44f2-8dbf-d48ff22aae9d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:42.008079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-432719c6-af02-44f2-8dbf-d48ff22aae9d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:42.008515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-432719c6-af02-44f2-8dbf-d48ff22aae9d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:42.008515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-432719c6-af02-44f2-8dbf-d48ff22aae9d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:42.299661 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-432719c6-af02-44f2-8dbf-d48ff22aae9d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:42.311103 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-432719c6-af02-44f2-8dbf-d48ff22aae9d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c" status: 200 len: 1314 microversion: 2.1 time: 0.323502 Oct 05 02:30:42.311908 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 468/936] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:41 2022] GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:42.317894 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c04fec36-7aa9-438c-b5e6-5bd68c789a93 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:42.318579 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c04fec36-7aa9-438c-b5e6-5bd68c789a93 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:42.325604 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c04fec36-7aa9-438c-b5e6-5bd68c789a93 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:42.326421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c04fec36-7aa9-438c-b5e6-5bd68c789a93 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:42.326555 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c04fec36-7aa9-438c-b5e6-5bd68c789a93 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:42.327453 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c04fec36-7aa9-438c-b5e6-5bd68c789a93 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:42.328246 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d92c812d-884f-4a9d-b4b7-7de927994c64 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af06771f33b4bff85a7ec7bb746a44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42fe97af30047fd999c08abc89dc2ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:42.328398 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c04fec36-7aa9-438c-b5e6-5bd68c789a93 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:42.329156 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c04fec36-7aa9-438c-b5e6-5bd68c789a93 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:42.342584 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d92c812d-884f-4a9d-b4b7-7de927994c64 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] 10.222.0.16 "GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a" status: 200 len: 1315 microversion: 2.1 time: 0.369161 Oct 05 02:30:42.343706 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 469/937] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:41 2022] GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a => generated 1315 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:42.434917 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c04fec36-7aa9-438c-b5e6-5bd68c789a93 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:42.445659 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c04fec36-7aa9-438c-b5e6-5bd68c789a93 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:42.447546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c04fec36-7aa9-438c-b5e6-5bd68c789a93 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:42.454674 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c04fec36-7aa9-438c-b5e6-5bd68c789a93 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1446 microversion: 2.75 time: 0.141697 Oct 05 02:30:42.455758 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 469/938] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:42 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1446 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:42.509394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-faef137b-77e2-4c07-9e83-9cd7856cf066 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:42.510227 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-faef137b-77e2-4c07-9e83-9cd7856cf066 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 6a205b3a-9fb4-4703-9368-0ab2436d60e5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:42.511371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-ee8078d6-6f66-430d-8e31-bf3e922e07d0 req-f584a86b-8dc8-4adf-ac02-5cdbba75aa58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a205b3a-9fb4-4703-9368-0ab2436d60e5", "tag": "15b4abdf-070c-4e34-93c5-64406f010c79"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:42.519295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-faef137b-77e2-4c07-9e83-9cd7856cf066 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:42.520767 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-faef137b-77e2-4c07-9e83-9cd7856cf066 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:42.521387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-faef137b-77e2-4c07-9e83-9cd7856cf066 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:42.521840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ee8078d6-6f66-430d-8e31-bf3e922e07d0 req-f584a86b-8dc8-4adf-ac02-5cdbba75aa58 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:42.522335 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ee8078d6-6f66-430d-8e31-bf3e922e07d0 req-f584a86b-8dc8-4adf-ac02-5cdbba75aa58 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:42.522763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ee8078d6-6f66-430d-8e31-bf3e922e07d0 req-f584a86b-8dc8-4adf-ac02-5cdbba75aa58 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:42.523080 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-faef137b-77e2-4c07-9e83-9cd7856cf066 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:42.523794 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-faef137b-77e2-4c07-9e83-9cd7856cf066 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:42.524386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-faef137b-77e2-4c07-9e83-9cd7856cf066 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:42.536445 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-ee8078d6-6f66-430d-8e31-bf3e922e07d0 req-f584a86b-8dc8-4adf-ac02-5cdbba75aa58 service nova] Creating event network-changed:15b4abdf-070c-4e34-93c5-64406f010c79 for instance 6a205b3a-9fb4-4703-9368-0ab2436d60e5 on n-h2-858272-3 Oct 05 02:30:42.543513 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-ee8078d6-6f66-430d-8e31-bf3e922e07d0 req-f584a86b-8dc8-4adf-ac02-5cdbba75aa58 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035632 Oct 05 02:30:42.546513 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 470/939] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:30:42.677509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-faef137b-77e2-4c07-9e83-9cd7856cf066 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368f6c3db9f24561a13f48ce02e7655e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecbac50c16847799a85c148c6c143de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:42.688790 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-faef137b-77e2-4c07-9e83-9cd7856cf066 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5" status: 200 len: 1587 microversion: 2.1 time: 0.183556 Oct 05 02:30:42.689495 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 470/940] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:42 2022] GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5 => generated 1587 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:42.706984 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e5347910-560e-4dcd-a36f-f547b56728b3 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:42.707954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e5347910-560e-4dcd-a36f-f547b56728b3 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] [instance: a7434499-a9a4-4c47-a5fe-5ea93c32c0ac] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:42.718352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5347910-560e-4dcd-a36f-f547b56728b3 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:42.719857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5347910-560e-4dcd-a36f-f547b56728b3 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:42.720491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5347910-560e-4dcd-a36f-f547b56728b3 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:42.721835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5347910-560e-4dcd-a36f-f547b56728b3 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:42.722541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5347910-560e-4dcd-a36f-f547b56728b3 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:42.723301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5347910-560e-4dcd-a36f-f547b56728b3 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:42.747188 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2f4ab7d8-ff1f-4688-9b8b-54e8999b2160 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:42.748173 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2f4ab7d8-ff1f-4688-9b8b-54e8999b2160 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:42.764866 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f4ab7d8-ff1f-4688-9b8b-54e8999b2160 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:42.766291 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f4ab7d8-ff1f-4688-9b8b-54e8999b2160 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:42.766969 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f4ab7d8-ff1f-4688-9b8b-54e8999b2160 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:42.768621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f4ab7d8-ff1f-4688-9b8b-54e8999b2160 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:42.768848 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f4ab7d8-ff1f-4688-9b8b-54e8999b2160 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:42.769992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f4ab7d8-ff1f-4688-9b8b-54e8999b2160 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:42.946383 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e5347910-560e-4dcd-a36f-f547b56728b3 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f596b5b1188a4384a2efdafbd08242ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b237b4e2594addbd899828d222aa9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:42.958490 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e5347910-560e-4dcd-a36f-f547b56728b3 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] 10.222.0.16 "GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac" status: 200 len: 1324 microversion: 2.1 time: 0.256687 Oct 05 02:30:42.959644 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 471/941] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:42 2022] GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac => generated 1324 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:42.977203 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2f4ab7d8-ff1f-4688-9b8b-54e8999b2160 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:42.987601 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2f4ab7d8-ff1f-4688-9b8b-54e8999b2160 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1502 microversion: 2.1 time: 0.245695 Oct 05 02:30:42.988373 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 471/942] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:42 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1502 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:30:43.338837 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-18dbf5ec-2c13-428c-9a60-9fba064ebee1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:43.339441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-18dbf5ec-2c13-428c-9a60-9fba064ebee1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 75dd5d21-42fd-4501-9b43-1716d9e8a63c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:43.346034 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18dbf5ec-2c13-428c-9a60-9fba064ebee1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:43.346752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18dbf5ec-2c13-428c-9a60-9fba064ebee1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:43.347346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18dbf5ec-2c13-428c-9a60-9fba064ebee1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:43.347942 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18dbf5ec-2c13-428c-9a60-9fba064ebee1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:43.348418 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18dbf5ec-2c13-428c-9a60-9fba064ebee1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:43.348836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18dbf5ec-2c13-428c-9a60-9fba064ebee1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:43.353953 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:43.374278 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b4ca1881-1392-4d27-a494-9049e57f4033 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:43.375390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b4ca1881-1392-4d27-a494-9049e57f4033 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] [instance: e13827ed-384b-43ec-8ba8-d9ab3f96eb6a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:43.384676 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4ca1881-1392-4d27-a494-9049e57f4033 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:43.385586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4ca1881-1392-4d27-a494-9049e57f4033 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:43.386038 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4ca1881-1392-4d27-a494-9049e57f4033 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:43.386950 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4ca1881-1392-4d27-a494-9049e57f4033 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:43.387419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4ca1881-1392-4d27-a494-9049e57f4033 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:43.387852 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4ca1881-1392-4d27-a494-9049e57f4033 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:43.883483 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-18dbf5ec-2c13-428c-9a60-9fba064ebee1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:43.893614 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-18dbf5ec-2c13-428c-9a60-9fba064ebee1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c" status: 200 len: 1314 microversion: 2.1 time: 0.558569 Oct 05 02:30:43.894218 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 472/943] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:43 2022] GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c => generated 1314 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:43.899312 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3c33b535-22fd-4fc9-bf3a-5f30df1f9e2e tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:43.899927 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3c33b535-22fd-4fc9-bf3a-5f30df1f9e2e tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:43.908583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3c33b535-22fd-4fc9-bf3a-5f30df1f9e2e tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:43.909555 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3c33b535-22fd-4fc9-bf3a-5f30df1f9e2e tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:43.910327 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3c33b535-22fd-4fc9-bf3a-5f30df1f9e2e tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:43.911231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3c33b535-22fd-4fc9-bf3a-5f30df1f9e2e tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:43.911869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3c33b535-22fd-4fc9-bf3a-5f30df1f9e2e tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:43.912472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3c33b535-22fd-4fc9-bf3a-5f30df1f9e2e tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:43.912616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b4ca1881-1392-4d27-a494-9049e57f4033 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af06771f33b4bff85a7ec7bb746a44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42fe97af30047fd999c08abc89dc2ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:43.920871 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b4ca1881-1392-4d27-a494-9049e57f4033 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] 10.222.0.16 "GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a" status: 200 len: 1315 microversion: 2.1 time: 0.557093 Oct 05 02:30:43.921797 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 472/944] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:43 2022] GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a => generated 1315 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:30:43.981849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7b709a1b-ae03-40ae-9c90-2e5caaa21b00 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:43.983439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7b709a1b-ae03-40ae-9c90-2e5caaa21b00 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] [instance: a7434499-a9a4-4c47-a5fe-5ea93c32c0ac] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:43.990688 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b709a1b-ae03-40ae-9c90-2e5caaa21b00 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:43.991451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b709a1b-ae03-40ae-9c90-2e5caaa21b00 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:43.991858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b709a1b-ae03-40ae-9c90-2e5caaa21b00 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:43.992886 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b709a1b-ae03-40ae-9c90-2e5caaa21b00 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:43.993855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b709a1b-ae03-40ae-9c90-2e5caaa21b00 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:43.994453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b709a1b-ae03-40ae-9c90-2e5caaa21b00 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:44.021639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3c33b535-22fd-4fc9-bf3a-5f30df1f9e2e tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:44.029732 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3c33b535-22fd-4fc9-bf3a-5f30df1f9e2e tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:44.031195 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3c33b535-22fd-4fc9-bf3a-5f30df1f9e2e tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:44.037545 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3c33b535-22fd-4fc9-bf3a-5f30df1f9e2e tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1446 microversion: 2.75 time: 0.142033 Oct 05 02:30:44.038131 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 473/945] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:43 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1446 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:44.047924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e2bb518a-a158-476c-af1c-87b6482ff919 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:44.048558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e2bb518a-a158-476c-af1c-87b6482ff919 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:44.058883 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2bb518a-a158-476c-af1c-87b6482ff919 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:44.058883 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2bb518a-a158-476c-af1c-87b6482ff919 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:44.059357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2bb518a-a158-476c-af1c-87b6482ff919 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:44.061531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2bb518a-a158-476c-af1c-87b6482ff919 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:44.062554 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2bb518a-a158-476c-af1c-87b6482ff919 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:44.063175 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2bb518a-a158-476c-af1c-87b6482ff919 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:44.412995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7b709a1b-ae03-40ae-9c90-2e5caaa21b00 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f596b5b1188a4384a2efdafbd08242ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b237b4e2594addbd899828d222aa9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:44.424937 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7b709a1b-ae03-40ae-9c90-2e5caaa21b00 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] 10.222.0.16 "GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac" status: 200 len: 1324 microversion: 2.1 time: 0.446882 Oct 05 02:30:44.427516 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 473/946] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:43 2022] GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac => generated 1324 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:30:44.548568 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e2bb518a-a158-476c-af1c-87b6482ff919 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:44.557612 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e2bb518a-a158-476c-af1c-87b6482ff919 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1502 microversion: 2.1 time: 0.518445 Oct 05 02:30:44.560099 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 474/947] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:44 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1502 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:44.917448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3329ef0d-8a25-4876-aeb3-ff7361ad823e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:44.919685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3329ef0d-8a25-4876-aeb3-ff7361ad823e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 75dd5d21-42fd-4501-9b43-1716d9e8a63c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:44.932267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3329ef0d-8a25-4876-aeb3-ff7361ad823e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:44.933083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3329ef0d-8a25-4876-aeb3-ff7361ad823e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:44.933696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3329ef0d-8a25-4876-aeb3-ff7361ad823e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:44.934576 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3329ef0d-8a25-4876-aeb3-ff7361ad823e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:44.935193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3329ef0d-8a25-4876-aeb3-ff7361ad823e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:44.935791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3329ef0d-8a25-4876-aeb3-ff7361ad823e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:44.944146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2d552927-8856-40e8-81af-dab50ff047a5 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:44.944763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2d552927-8856-40e8-81af-dab50ff047a5 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] [instance: e13827ed-384b-43ec-8ba8-d9ab3f96eb6a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:44.957029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d552927-8856-40e8-81af-dab50ff047a5 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:44.957029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d552927-8856-40e8-81af-dab50ff047a5 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:44.958747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d552927-8856-40e8-81af-dab50ff047a5 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:44.959482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d552927-8856-40e8-81af-dab50ff047a5 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:44.959945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d552927-8856-40e8-81af-dab50ff047a5 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:44.960371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d552927-8856-40e8-81af-dab50ff047a5 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:45.425186 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2d552927-8856-40e8-81af-dab50ff047a5 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af06771f33b4bff85a7ec7bb746a44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42fe97af30047fd999c08abc89dc2ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:45.432512 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3329ef0d-8a25-4876-aeb3-ff7361ad823e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:45.440762 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3329ef0d-8a25-4876-aeb3-ff7361ad823e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c" status: 200 len: 1314 microversion: 2.1 time: 0.527048 Oct 05 02:30:45.452928 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2d552927-8856-40e8-81af-dab50ff047a5 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] 10.222.0.16 "GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a" status: 200 len: 1315 microversion: 2.1 time: 0.507484 Oct 05 02:30:45.452928 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 475/948] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:44 2022] GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a => generated 1315 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:45.453541 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 474/949] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:44 2022] GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c => generated 1314 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:45.477058 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-81aab98b-fc41-486e-9c47-09495c983c12 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:45.477058 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-81aab98b-fc41-486e-9c47-09495c983c12 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:45.479231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-602dba8b-3861-41cf-8fd1-6e37f5e66a6b tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:45.485001 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81aab98b-fc41-486e-9c47-09495c983c12 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:45.485001 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81aab98b-fc41-486e-9c47-09495c983c12 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:45.485303 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81aab98b-fc41-486e-9c47-09495c983c12 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:45.486113 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-602dba8b-3861-41cf-8fd1-6e37f5e66a6b tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] [instance: a7434499-a9a4-4c47-a5fe-5ea93c32c0ac] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:45.488583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81aab98b-fc41-486e-9c47-09495c983c12 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:45.490710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81aab98b-fc41-486e-9c47-09495c983c12 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:45.492238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81aab98b-fc41-486e-9c47-09495c983c12 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:45.492960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-602dba8b-3861-41cf-8fd1-6e37f5e66a6b tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:45.493620 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-602dba8b-3861-41cf-8fd1-6e37f5e66a6b tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:45.494209 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-602dba8b-3861-41cf-8fd1-6e37f5e66a6b tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:45.495072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-602dba8b-3861-41cf-8fd1-6e37f5e66a6b tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:45.495682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-602dba8b-3861-41cf-8fd1-6e37f5e66a6b tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:45.496278 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-602dba8b-3861-41cf-8fd1-6e37f5e66a6b tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:45.626319 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-81aab98b-fc41-486e-9c47-09495c983c12 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:45.638453 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-81aab98b-fc41-486e-9c47-09495c983c12 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:45.640811 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-81aab98b-fc41-486e-9c47-09495c983c12 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:45.650433 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-81aab98b-fc41-486e-9c47-09495c983c12 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1452 microversion: 2.75 time: 0.198827 Oct 05 02:30:45.651093 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 476/950] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:45 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1452 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:45.673380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-898de463-a859-4e1c-828d-c4767940d883 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:45.674145 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-898de463-a859-4e1c-828d-c4767940d883 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:45.680451 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-898de463-a859-4e1c-828d-c4767940d883 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:45.680973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-898de463-a859-4e1c-828d-c4767940d883 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:45.681408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-898de463-a859-4e1c-828d-c4767940d883 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:45.682094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-898de463-a859-4e1c-828d-c4767940d883 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:45.682541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-898de463-a859-4e1c-828d-c4767940d883 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:45.682956 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-898de463-a859-4e1c-828d-c4767940d883 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:45.869637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-602dba8b-3861-41cf-8fd1-6e37f5e66a6b tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f596b5b1188a4384a2efdafbd08242ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b237b4e2594addbd899828d222aa9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:45.877874 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-602dba8b-3861-41cf-8fd1-6e37f5e66a6b tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] 10.222.0.16 "GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac" status: 200 len: 1324 microversion: 2.1 time: 0.423097 Oct 05 02:30:45.878446 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 475/951] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:45 2022] GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac => generated 1324 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:45.929082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-898de463-a859-4e1c-828d-c4767940d883 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:45.936710 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-898de463-a859-4e1c-828d-c4767940d883 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1502 microversion: 2.1 time: 0.269084 Oct 05 02:30:45.937574 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 477/952] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:45 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1502 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:46.479374 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bcc3e91c-2494-49f2-b681-14636afd2cd2 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:46.480143 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bcc3e91c-2494-49f2-b681-14636afd2cd2 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 75dd5d21-42fd-4501-9b43-1716d9e8a63c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:46.487048 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bcc3e91c-2494-49f2-b681-14636afd2cd2 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:46.487670 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bcc3e91c-2494-49f2-b681-14636afd2cd2 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:46.488308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bcc3e91c-2494-49f2-b681-14636afd2cd2 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:46.489041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bcc3e91c-2494-49f2-b681-14636afd2cd2 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:46.489622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bcc3e91c-2494-49f2-b681-14636afd2cd2 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:46.490057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bcc3e91c-2494-49f2-b681-14636afd2cd2 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:46.495779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4c1c70e7-d5fa-4be7-af69-afe968e4c7d8 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:46.495779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4c1c70e7-d5fa-4be7-af69-afe968e4c7d8 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] [instance: e13827ed-384b-43ec-8ba8-d9ab3f96eb6a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:46.505201 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c1c70e7-d5fa-4be7-af69-afe968e4c7d8 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:46.505692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c1c70e7-d5fa-4be7-af69-afe968e4c7d8 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:46.506125 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c1c70e7-d5fa-4be7-af69-afe968e4c7d8 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:46.507412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c1c70e7-d5fa-4be7-af69-afe968e4c7d8 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:46.507546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c1c70e7-d5fa-4be7-af69-afe968e4c7d8 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:46.507893 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c1c70e7-d5fa-4be7-af69-afe968e4c7d8 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:46.690533 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bcc3e91c-2494-49f2-b681-14636afd2cd2 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:46.698254 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bcc3e91c-2494-49f2-b681-14636afd2cd2 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c" status: 200 len: 1314 microversion: 2.1 time: 0.222756 Oct 05 02:30:46.698817 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 476/953] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:46 2022] GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:46.703305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8ec43475-9e32-4646-9f19-9d7f05b90954 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:46.703913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8ec43475-9e32-4646-9f19-9d7f05b90954 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:46.710148 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ec43475-9e32-4646-9f19-9d7f05b90954 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:46.710675 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ec43475-9e32-4646-9f19-9d7f05b90954 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:46.711165 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ec43475-9e32-4646-9f19-9d7f05b90954 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:46.712393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4c1c70e7-d5fa-4be7-af69-afe968e4c7d8 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af06771f33b4bff85a7ec7bb746a44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42fe97af30047fd999c08abc89dc2ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:46.712534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ec43475-9e32-4646-9f19-9d7f05b90954 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:46.713013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ec43475-9e32-4646-9f19-9d7f05b90954 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:46.713613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ec43475-9e32-4646-9f19-9d7f05b90954 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:46.720361 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4c1c70e7-d5fa-4be7-af69-afe968e4c7d8 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] 10.222.0.16 "GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a" status: 200 len: 1315 microversion: 2.1 time: 0.231541 Oct 05 02:30:46.720965 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 478/954] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:46 2022] GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:30:46.778216 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8ec43475-9e32-4646-9f19-9d7f05b90954 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:46.786654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8ec43475-9e32-4646-9f19-9d7f05b90954 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:46.788081 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8ec43475-9e32-4646-9f19-9d7f05b90954 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:46.793894 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8ec43475-9e32-4646-9f19-9d7f05b90954 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1452 microversion: 2.75 time: 0.094136 Oct 05 02:30:46.794462 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 477/955] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:46 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1452 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:46.901049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2644af98-7c68-49ff-9e45-f006a1a2a697 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:46.901699 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2644af98-7c68-49ff-9e45-f006a1a2a697 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] [instance: a7434499-a9a4-4c47-a5fe-5ea93c32c0ac] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:46.908653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2644af98-7c68-49ff-9e45-f006a1a2a697 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:46.909192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2644af98-7c68-49ff-9e45-f006a1a2a697 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:46.909636 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2644af98-7c68-49ff-9e45-f006a1a2a697 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:46.910347 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2644af98-7c68-49ff-9e45-f006a1a2a697 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:46.910806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2644af98-7c68-49ff-9e45-f006a1a2a697 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:46.911233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2644af98-7c68-49ff-9e45-f006a1a2a697 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:46.959084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-8df6bb49-0c06-4d9f-a2ba-d1536aabbddd req-5d5a3f01-8706-45b2-afaf-a814362d5edb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75dd5d21-42fd-4501-9b43-1716d9e8a63c", "name": "network-vif-plugged", "status": "completed", "tag": "a93afda1-f2bc-4e2d-b873-c7ed67a96cba"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:46.971822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-8df6bb49-0c06-4d9f-a2ba-d1536aabbddd req-5d5a3f01-8706-45b2-afaf-a814362d5edb service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:46.972451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-8df6bb49-0c06-4d9f-a2ba-d1536aabbddd req-5d5a3f01-8706-45b2-afaf-a814362d5edb service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:46.974539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-8df6bb49-0c06-4d9f-a2ba-d1536aabbddd req-5d5a3f01-8706-45b2-afaf-a814362d5edb service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:46.979601 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:46.988491 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-8df6bb49-0c06-4d9f-a2ba-d1536aabbddd req-5d5a3f01-8706-45b2-afaf-a814362d5edb service nova] Creating event network-vif-plugged:a93afda1-f2bc-4e2d-b873-c7ed67a96cba for instance 75dd5d21-42fd-4501-9b43-1716d9e8a63c on n-h2-858272-3 Oct 05 02:30:46.995174 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-8df6bb49-0c06-4d9f-a2ba-d1536aabbddd req-5d5a3f01-8706-45b2-afaf-a814362d5edb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039903 Oct 05 02:30:46.996207 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 478/956] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:30:47.008649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c19df74f-b677-4cf1-9df1-2768a36b0a8f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:47.011717 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c19df74f-b677-4cf1-9df1-2768a36b0a8f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:47.024825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c19df74f-b677-4cf1-9df1-2768a36b0a8f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:47.025615 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c19df74f-b677-4cf1-9df1-2768a36b0a8f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:47.026304 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c19df74f-b677-4cf1-9df1-2768a36b0a8f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:47.027210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c19df74f-b677-4cf1-9df1-2768a36b0a8f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:47.027858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c19df74f-b677-4cf1-9df1-2768a36b0a8f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:47.028505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c19df74f-b677-4cf1-9df1-2768a36b0a8f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:47.136608 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2644af98-7c68-49ff-9e45-f006a1a2a697 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f596b5b1188a4384a2efdafbd08242ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b237b4e2594addbd899828d222aa9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:47.149423 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2644af98-7c68-49ff-9e45-f006a1a2a697 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] 10.222.0.16 "GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac" status: 200 len: 1324 microversion: 2.1 time: 0.252070 Oct 05 02:30:47.150486 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 479/957] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:46 2022] GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac => generated 1324 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:47.264063 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c19df74f-b677-4cf1-9df1-2768a36b0a8f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:47.272306 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c19df74f-b677-4cf1-9df1-2768a36b0a8f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1502 microversion: 2.1 time: 0.269488 Oct 05 02:30:47.273305 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 479/958] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:46 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1502 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:47.722700 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b3768626-5262-4701-ab63-b4488593b36a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:47.723312 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b3768626-5262-4701-ab63-b4488593b36a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 75dd5d21-42fd-4501-9b43-1716d9e8a63c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:47.730376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3768626-5262-4701-ab63-b4488593b36a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:47.730867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3768626-5262-4701-ab63-b4488593b36a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:47.731304 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3768626-5262-4701-ab63-b4488593b36a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:47.732008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3768626-5262-4701-ab63-b4488593b36a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:47.732462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3768626-5262-4701-ab63-b4488593b36a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:47.732885 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3768626-5262-4701-ab63-b4488593b36a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:47.743508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-64107209-56d3-4654-8177-ff1e69af917b tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:47.744217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-64107209-56d3-4654-8177-ff1e69af917b tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] [instance: e13827ed-384b-43ec-8ba8-d9ab3f96eb6a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:47.751286 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64107209-56d3-4654-8177-ff1e69af917b tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:47.751849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64107209-56d3-4654-8177-ff1e69af917b tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:47.752407 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64107209-56d3-4654-8177-ff1e69af917b tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:47.753210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64107209-56d3-4654-8177-ff1e69af917b tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:47.753737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64107209-56d3-4654-8177-ff1e69af917b tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:47.754174 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64107209-56d3-4654-8177-ff1e69af917b tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:47.933306 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b3768626-5262-4701-ab63-b4488593b36a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:47.936304 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-64107209-56d3-4654-8177-ff1e69af917b tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af06771f33b4bff85a7ec7bb746a44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42fe97af30047fd999c08abc89dc2ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:47.941305 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b3768626-5262-4701-ab63-b4488593b36a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c" status: 200 len: 1314 microversion: 2.1 time: 0.222380 Oct 05 02:30:47.941985 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 480/959] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:47 2022] GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:47.945559 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-64107209-56d3-4654-8177-ff1e69af917b tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] 10.222.0.16 "GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a" status: 200 len: 1315 microversion: 2.1 time: 0.205877 Oct 05 02:30:47.946115 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 480/960] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:47 2022] GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:30:47.951290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1e393d25-22c9-4f9b-b431-ecf31360f8c0 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:47.951984 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1e393d25-22c9-4f9b-b431-ecf31360f8c0 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:47.960220 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e393d25-22c9-4f9b-b431-ecf31360f8c0 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:47.960706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e393d25-22c9-4f9b-b431-ecf31360f8c0 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:47.961298 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e393d25-22c9-4f9b-b431-ecf31360f8c0 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:47.962868 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e393d25-22c9-4f9b-b431-ecf31360f8c0 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:47.963415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e393d25-22c9-4f9b-b431-ecf31360f8c0 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:47.963836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e393d25-22c9-4f9b-b431-ecf31360f8c0 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:48.031477 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1e393d25-22c9-4f9b-b431-ecf31360f8c0 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:48.039659 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1e393d25-22c9-4f9b-b431-ecf31360f8c0 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:48.041114 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1e393d25-22c9-4f9b-b431-ecf31360f8c0 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:48.046266 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1e393d25-22c9-4f9b-b431-ecf31360f8c0 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1452 microversion: 2.75 time: 0.103187 Oct 05 02:30:48.047023 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 481/961] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:47 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1452 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:48.173242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-19c69765-af2f-4acb-9e74-7c7472dc31cf tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:48.173968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-19c69765-af2f-4acb-9e74-7c7472dc31cf tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] [instance: a7434499-a9a4-4c47-a5fe-5ea93c32c0ac] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:48.189839 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19c69765-af2f-4acb-9e74-7c7472dc31cf tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:48.190250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19c69765-af2f-4acb-9e74-7c7472dc31cf tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:48.190682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19c69765-af2f-4acb-9e74-7c7472dc31cf tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:48.191381 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19c69765-af2f-4acb-9e74-7c7472dc31cf tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:48.191832 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19c69765-af2f-4acb-9e74-7c7472dc31cf tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:48.192252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19c69765-af2f-4acb-9e74-7c7472dc31cf tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:48.297753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2bf08e78-243b-4df8-ad30-74ad76fdd10c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:48.299060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2bf08e78-243b-4df8-ad30-74ad76fdd10c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:48.306708 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bf08e78-243b-4df8-ad30-74ad76fdd10c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:48.307696 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bf08e78-243b-4df8-ad30-74ad76fdd10c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:48.308552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bf08e78-243b-4df8-ad30-74ad76fdd10c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:48.309624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bf08e78-243b-4df8-ad30-74ad76fdd10c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:48.310490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bf08e78-243b-4df8-ad30-74ad76fdd10c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:48.311337 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bf08e78-243b-4df8-ad30-74ad76fdd10c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:48.410789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-19c69765-af2f-4acb-9e74-7c7472dc31cf tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f596b5b1188a4384a2efdafbd08242ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b237b4e2594addbd899828d222aa9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:48.422152 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-19c69765-af2f-4acb-9e74-7c7472dc31cf tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] 10.222.0.16 "GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac" status: 200 len: 1324 microversion: 2.1 time: 0.252556 Oct 05 02:30:48.423312 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 481/962] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:48 2022] GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac => generated 1324 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:48.547928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2bf08e78-243b-4df8-ad30-74ad76fdd10c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:48.555540 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2bf08e78-243b-4df8-ad30-74ad76fdd10c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1502 microversion: 2.1 time: 0.262340 Oct 05 02:30:48.556116 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 482/963] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:48 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1502 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:30:48.965129 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-09054458-90c4-4964-a4ec-87da3dc7ec5f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:48.965709 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-09054458-90c4-4964-a4ec-87da3dc7ec5f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 75dd5d21-42fd-4501-9b43-1716d9e8a63c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:48.969186 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-55dc74e9-185b-4268-96c9-74250f47e887 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:48.970025 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-55dc74e9-185b-4268-96c9-74250f47e887 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] [instance: e13827ed-384b-43ec-8ba8-d9ab3f96eb6a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:48.972104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-09054458-90c4-4964-a4ec-87da3dc7ec5f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:48.972823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-09054458-90c4-4964-a4ec-87da3dc7ec5f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:48.973285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-09054458-90c4-4964-a4ec-87da3dc7ec5f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:48.973992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-09054458-90c4-4964-a4ec-87da3dc7ec5f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:48.974447 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-09054458-90c4-4964-a4ec-87da3dc7ec5f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:48.975132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-09054458-90c4-4964-a4ec-87da3dc7ec5f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:48.977742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55dc74e9-185b-4268-96c9-74250f47e887 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:48.978522 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55dc74e9-185b-4268-96c9-74250f47e887 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:48.979024 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55dc74e9-185b-4268-96c9-74250f47e887 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:48.980001 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55dc74e9-185b-4268-96c9-74250f47e887 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:48.980700 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55dc74e9-185b-4268-96c9-74250f47e887 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:48.981304 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55dc74e9-185b-4268-96c9-74250f47e887 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:49.254383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-09054458-90c4-4964-a4ec-87da3dc7ec5f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:49.262093 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-09054458-90c4-4964-a4ec-87da3dc7ec5f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c" status: 200 len: 1463 microversion: 2.1 time: 0.301162 Oct 05 02:30:49.262840 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 482/964] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:48 2022] GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c => generated 1463 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:49.267082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-77ccb237-55af-4d46-95a4-19ba710a269a req-038da49c-5c76-4e0c-a673-f58316e1f2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7434499-a9a4-4c47-a5fe-5ea93c32c0ac", "name": "network-vif-plugged", "status": "completed", "tag": "939a0258-e304-4d51-8be4-5cd608c3ff90"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:49.274374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-55dc74e9-185b-4268-96c9-74250f47e887 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af06771f33b4bff85a7ec7bb746a44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42fe97af30047fd999c08abc89dc2ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:49.276412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-77ccb237-55af-4d46-95a4-19ba710a269a req-038da49c-5c76-4e0c-a673-f58316e1f2a1 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:49.277133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-77ccb237-55af-4d46-95a4-19ba710a269a req-038da49c-5c76-4e0c-a673-f58316e1f2a1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:49.277718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-77ccb237-55af-4d46-95a4-19ba710a269a req-038da49c-5c76-4e0c-a673-f58316e1f2a1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:49.288833 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-55dc74e9-185b-4268-96c9-74250f47e887 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] 10.222.0.16 "GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a" status: 200 len: 1502 microversion: 2.1 time: 0.324113 Oct 05 02:30:49.290786 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 483/965] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:48 2022] GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a => generated 1502 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:30:49.293705 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-77ccb237-55af-4d46-95a4-19ba710a269a req-038da49c-5c76-4e0c-a673-f58316e1f2a1 service nova] Creating event network-vif-plugged:939a0258-e304-4d51-8be4-5cd608c3ff90 for instance a7434499-a9a4-4c47-a5fe-5ea93c32c0ac on n-h1-858272-3 Oct 05 02:30:49.294463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-51ddde8e-4399-4257-94e8-28db2f5d3fa9 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:49.295163 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-51ddde8e-4399-4257-94e8-28db2f5d3fa9 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:49.299706 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-77ccb237-55af-4d46-95a4-19ba710a269a req-038da49c-5c76-4e0c-a673-f58316e1f2a1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035924 Oct 05 02:30:49.300404 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 483/966] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:30:49.309896 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51ddde8e-4399-4257-94e8-28db2f5d3fa9 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:49.310464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51ddde8e-4399-4257-94e8-28db2f5d3fa9 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:49.310837 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51ddde8e-4399-4257-94e8-28db2f5d3fa9 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:49.311546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51ddde8e-4399-4257-94e8-28db2f5d3fa9 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:49.312123 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51ddde8e-4399-4257-94e8-28db2f5d3fa9 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:49.312539 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51ddde8e-4399-4257-94e8-28db2f5d3fa9 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:49.386558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-51ddde8e-4399-4257-94e8-28db2f5d3fa9 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:49.396745 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-51ddde8e-4399-4257-94e8-28db2f5d3fa9 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:49.398233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-51ddde8e-4399-4257-94e8-28db2f5d3fa9 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:49.403918 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-51ddde8e-4399-4257-94e8-28db2f5d3fa9 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1452 microversion: 2.75 time: 0.113389 Oct 05 02:30:49.404784 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 484/967] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:49 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1452 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:49.409890 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9caa1011-0c67-414e-ab28-cfa5804c0227 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:49.410396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9caa1011-0c67-414e-ab28-cfa5804c0227 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] [instance: e13827ed-384b-43ec-8ba8-d9ab3f96eb6a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:49.416194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9caa1011-0c67-414e-ab28-cfa5804c0227 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:49.416690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9caa1011-0c67-414e-ab28-cfa5804c0227 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:49.417164 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9caa1011-0c67-414e-ab28-cfa5804c0227 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:49.417865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9caa1011-0c67-414e-ab28-cfa5804c0227 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:49.418325 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9caa1011-0c67-414e-ab28-cfa5804c0227 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:49.418751 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9caa1011-0c67-414e-ab28-cfa5804c0227 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:49.432189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-876041c4-3f35-454d-849c-db0718793656 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:49.437546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-876041c4-3f35-454d-849c-db0718793656 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Searching by: {'deleted': False, 'project_id': 'ec1802aaa2f44429947b01dc6f5b351d'} {{(pid=122319) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:30:49.444071 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-876041c4-3f35-454d-849c-db0718793656 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:49.444764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-876041c4-3f35-454d-849c-db0718793656 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:49.445419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-876041c4-3f35-454d-849c-db0718793656 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:49.446298 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-876041c4-3f35-454d-849c-db0718793656 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:49.446530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9caa1011-0c67-414e-ab28-cfa5804c0227 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] [instance: e13827ed-384b-43ec-8ba8-d9ab3f96eb6a] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:30:49.447121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-876041c4-3f35-454d-849c-db0718793656 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:49.447554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-876041c4-3f35-454d-849c-db0718793656 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:49.518470 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:49.527563 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9caa1011-0c67-414e-ab28-cfa5804c0227 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a" status: 204 len: 0 microversion: 2.1 time: 0.121681 Oct 05 02:30:49.528350 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 485/968] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:30:49 2022] DELETE /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:30:49.534154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7dabf8e6-8eac-4eef-83ee-74d734f45f29 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:49.534864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7dabf8e6-8eac-4eef-83ee-74d734f45f29 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] [instance: a7434499-a9a4-4c47-a5fe-5ea93c32c0ac] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:49.541049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7dabf8e6-8eac-4eef-83ee-74d734f45f29 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:49.541527 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7dabf8e6-8eac-4eef-83ee-74d734f45f29 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:49.541959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7dabf8e6-8eac-4eef-83ee-74d734f45f29 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:49.542646 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7dabf8e6-8eac-4eef-83ee-74d734f45f29 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:49.543096 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7dabf8e6-8eac-4eef-83ee-74d734f45f29 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:49.543504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7dabf8e6-8eac-4eef-83ee-74d734f45f29 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:49.557168 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-876041c4-3f35-454d-849c-db0718793656 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.255443 Oct 05 02:30:49.558348 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 484/969] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:30:49 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:30:49.563141 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a5b5c734-45d1-405a-859f-7e6fb347ab49 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:49.564053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a5b5c734-45d1-405a-859f-7e6fb347ab49 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] [instance: e13827ed-384b-43ec-8ba8-d9ab3f96eb6a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:49.570202 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5b5c734-45d1-405a-859f-7e6fb347ab49 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:49.570866 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5b5c734-45d1-405a-859f-7e6fb347ab49 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:49.571472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5b5c734-45d1-405a-859f-7e6fb347ab49 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:49.572315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5b5c734-45d1-405a-859f-7e6fb347ab49 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:49.572928 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5b5c734-45d1-405a-859f-7e6fb347ab49 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:49.573506 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5b5c734-45d1-405a-859f-7e6fb347ab49 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:49.802337 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7dabf8e6-8eac-4eef-83ee-74d734f45f29 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f596b5b1188a4384a2efdafbd08242ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b237b4e2594addbd899828d222aa9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:49.810266 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7dabf8e6-8eac-4eef-83ee-74d734f45f29 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] 10.222.0.16 "GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac" status: 200 len: 1324 microversion: 2.1 time: 0.280919 Oct 05 02:30:49.811050 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 486/970] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:49 2022] GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac => generated 1324 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:49.812428 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a5b5c734-45d1-405a-859f-7e6fb347ab49 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af06771f33b4bff85a7ec7bb746a44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42fe97af30047fd999c08abc89dc2ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:49.820643 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a5b5c734-45d1-405a-859f-7e6fb347ab49 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] 10.222.0.16 "GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a" status: 200 len: 1508 microversion: 2.1 time: 0.261158 Oct 05 02:30:49.832924 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 485/971] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:49 2022] GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a => generated 1508 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:49.832924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-198bfdd4-860d-4e1d-a559-d7d68d76896f tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:49.833251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-11f7041c-5006-42e9-b401-935022592ca1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:49.833251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-11f7041c-5006-42e9-b401-935022592ca1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:49.833442 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-198bfdd4-860d-4e1d-a559-d7d68d76896f tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Searching by: {'deleted': False} {{(pid=122319) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:30:49.838519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11f7041c-5006-42e9-b401-935022592ca1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:49.839014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11f7041c-5006-42e9-b401-935022592ca1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:49.839440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11f7041c-5006-42e9-b401-935022592ca1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:49.840122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11f7041c-5006-42e9-b401-935022592ca1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:49.840460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-198bfdd4-860d-4e1d-a559-d7d68d76896f tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:49.840576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11f7041c-5006-42e9-b401-935022592ca1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:49.840995 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11f7041c-5006-42e9-b401-935022592ca1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:49.841237 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-198bfdd4-860d-4e1d-a559-d7d68d76896f tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:49.841770 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-198bfdd4-860d-4e1d-a559-d7d68d76896f tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:49.842624 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-198bfdd4-860d-4e1d-a559-d7d68d76896f tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:49.843190 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-198bfdd4-860d-4e1d-a559-d7d68d76896f tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:49.843833 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-198bfdd4-860d-4e1d-a559-d7d68d76896f tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:49.845662 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:49.965999 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.multi_cell_list [None req-198bfdd4-860d-4e1d-a559-d7d68d76896f tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Listed batch of 13 results from cell out of 1000 limit. Returned 13 total so far. {{(pid=122319) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:30:50.010924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-11f7041c-5006-42e9-b401-935022592ca1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:50.019454 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-11f7041c-5006-42e9-b401-935022592ca1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1477 microversion: 2.1 time: 0.192044 Oct 05 02:30:50.020115 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 487/972] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:49 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1477 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:50.041569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7406a759-0b93-470a-a703-9dd010555481 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Calling method '.version_select at 0x7fccdff95ca0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:50.044976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7406a759-0b93-470a-a703-9dd010555481 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:50.045468 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7406a759-0b93-470a-a703-9dd010555481 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:50.045908 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7406a759-0b93-470a-a703-9dd010555481 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:50.054923 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7406a759-0b93-470a-a703-9dd010555481 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1550 microversion: 2.1 time: 0.017072 Oct 05 02:30:50.055504 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 488/973] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 5 02:30:50 2022] GET /compute/v2.1/os-migrations => generated 1550 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:30:50.069873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-427ae84b-7183-4a1b-ba3f-07d83e21be5d tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:50.070484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-427ae84b-7183-4a1b-ba3f-07d83e21be5d tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:50.076375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-427ae84b-7183-4a1b-ba3f-07d83e21be5d tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:50.076861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-427ae84b-7183-4a1b-ba3f-07d83e21be5d tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:50.077324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-427ae84b-7183-4a1b-ba3f-07d83e21be5d tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:50.078606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-427ae84b-7183-4a1b-ba3f-07d83e21be5d tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:50.079061 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-427ae84b-7183-4a1b-ba3f-07d83e21be5d tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:50.079537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-427ae84b-7183-4a1b-ba3f-07d83e21be5d tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:50.092578 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-198bfdd4-860d-4e1d-a559-d7d68d76896f tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:50.093112 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-198bfdd4-860d-4e1d-a559-d7d68d76896f tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:50.093545 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-198bfdd4-860d-4e1d-a559-d7d68d76896f tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:50.268112 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-427ae84b-7183-4a1b-ba3f-07d83e21be5d tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1628 microversion: 2.1 time: 0.201721 Oct 05 02:30:50.268685 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 489/974] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:50 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1628 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:30:50.299861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5b4c0b7b-92bc-41cf-89d4-b6673c2f934c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Action: 'create', calling method: .version_select at 0x7fcce4051430>, body: {"keypair": {"name": "tempest-keypair-727129128", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNl7RAqMdQY6pxu2fHneW6QoXsnqpyVwcW8NLpgqV53xMuCGlCeMZENccKp1WaLOT4i6iglcSpI5WLihB5FfWUcETzDwQ+L+C4B0Zk4IUtvIqtyZa1M/f3G5rtyNP1OKRg=="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:50.316437 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-5b4c0b7b-92bc-41cf-89d4-b6673c2f934c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Getting quotas for project 6652917123e14c2797cafacc4e31f75a. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:30:50.324184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-5b4c0b7b-92bc-41cf-89d4-b6673c2f934c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Getting quotas for user 118c1425677b45b98689befb0eb55cce and project 6652917123e14c2797cafacc4e31f75a. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:30:50.348132 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5b4c0b7b-92bc-41cf-89d4-b6673c2f934c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053166 Oct 05 02:30:50.348739 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 490/975] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 02:30:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:30:50.431826 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-795438d8-52a4-4169-b970-1c090f7f9014 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:50.432433 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-795438d8-52a4-4169-b970-1c090f7f9014 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:50.439711 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-795438d8-52a4-4169-b970-1c090f7f9014 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:50.440307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-795438d8-52a4-4169-b970-1c090f7f9014 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:50.440822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-795438d8-52a4-4169-b970-1c090f7f9014 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:50.441524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-795438d8-52a4-4169-b970-1c090f7f9014 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:50.441977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-795438d8-52a4-4169-b970-1c090f7f9014 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:50.442492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-795438d8-52a4-4169-b970-1c090f7f9014 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:50.510893 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-198bfdd4-860d-4e1d-a559-d7d68d76896f tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 21438 microversion: 2.1 time: 0.681371 Oct 05 02:30:50.511642 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 486/976] 10.222.0.16 () {58 vars in 1171 bytes} [Wed Oct 5 02:30:49 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 21438 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:30:50.532939 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-795438d8-52a4-4169-b970-1c090f7f9014 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:50.544091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-795438d8-52a4-4169-b970-1c090f7f9014 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:50.545959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-795438d8-52a4-4169-b970-1c090f7f9014 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:50.552569 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-795438d8-52a4-4169-b970-1c090f7f9014 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1452 microversion: 2.75 time: 0.124556 Oct 05 02:30:50.553667 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 491/977] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:50 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1452 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:30:50.555452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0eb0b0e3-ef88-4923-90db-061c114d61a8 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:50.560344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0eb0b0e3-ef88-4923-90db-061c114d61a8 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Searching by: {'deleted': False, 'project_id': 'ec1802aaa2f44429947b01dc6f5b351d'} {{(pid=122319) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:30:50.565725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0eb0b0e3-ef88-4923-90db-061c114d61a8 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:50.566202 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0eb0b0e3-ef88-4923-90db-061c114d61a8 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:50.566630 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0eb0b0e3-ef88-4923-90db-061c114d61a8 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:50.567345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0eb0b0e3-ef88-4923-90db-061c114d61a8 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:50.567795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0eb0b0e3-ef88-4923-90db-061c114d61a8 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:50.568216 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0eb0b0e3-ef88-4923-90db-061c114d61a8 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:50.595320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:50.599403 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0eb0b0e3-ef88-4923-90db-061c114d61a8 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?tenant_id=c6918daa4f884786b45bc88dd1e4e94a" status: 200 len: 15 microversion: 2.1 time: 0.047755 Oct 05 02:30:50.600220 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 487/978] 10.222.0.16 () {58 vars in 1231 bytes} [Wed Oct 5 02:30:50 2022] GET /compute/v2.1/servers/detail?tenant_id=c6918daa4f884786b45bc88dd1e4e94a => generated 15 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:30:50.621615 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-79c9370d-544d-4261-b689-8c6da74f2013 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:50.628143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-79c9370d-544d-4261-b689-8c6da74f2013 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Searching by: {'tenant_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'deleted': False} {{(pid=122320) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:30:50.635062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-79c9370d-544d-4261-b689-8c6da74f2013 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:50.635546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-79c9370d-544d-4261-b689-8c6da74f2013 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:50.635991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-79c9370d-544d-4261-b689-8c6da74f2013 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:50.636836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-79c9370d-544d-4261-b689-8c6da74f2013 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:50.638491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-79c9370d-544d-4261-b689-8c6da74f2013 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:50.638901 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-79c9370d-544d-4261-b689-8c6da74f2013 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:50.748433 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.multi_cell_list [None req-79c9370d-544d-4261-b689-8c6da74f2013 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:30:50.834549 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-75f606f3-786a-4c88-9897-25e200e2481a tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:50.835171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-75f606f3-786a-4c88-9897-25e200e2481a tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] [instance: a7434499-a9a4-4c47-a5fe-5ea93c32c0ac] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:50.844503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75f606f3-786a-4c88-9897-25e200e2481a tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:50.848677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75f606f3-786a-4c88-9897-25e200e2481a tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:50.849401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75f606f3-786a-4c88-9897-25e200e2481a tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:50.850549 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75f606f3-786a-4c88-9897-25e200e2481a tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:50.853003 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75f606f3-786a-4c88-9897-25e200e2481a tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:50.859068 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75f606f3-786a-4c88-9897-25e200e2481a tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:50.885725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-79c9370d-544d-4261-b689-8c6da74f2013 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:50.886438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-79c9370d-544d-4261-b689-8c6da74f2013 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:50.886971 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-79c9370d-544d-4261-b689-8c6da74f2013 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:51.463099 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-75f606f3-786a-4c88-9897-25e200e2481a tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f596b5b1188a4384a2efdafbd08242ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b237b4e2594addbd899828d222aa9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:51.472067 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-75f606f3-786a-4c88-9897-25e200e2481a tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] 10.222.0.16 "GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac" status: 200 len: 1324 microversion: 2.1 time: 0.641392 Oct 05 02:30:51.472679 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 488/979] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:50 2022] GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac => generated 1324 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:51.477896 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-410cae37-7b08-421c-a4a6-058b6d8a71c5 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:51.478496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-410cae37-7b08-421c-a4a6-058b6d8a71c5 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] [instance: e13827ed-384b-43ec-8ba8-d9ab3f96eb6a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:51.485778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-410cae37-7b08-421c-a4a6-058b6d8a71c5 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:51.486273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-410cae37-7b08-421c-a4a6-058b6d8a71c5 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:51.487228 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-410cae37-7b08-421c-a4a6-058b6d8a71c5 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:51.487934 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-410cae37-7b08-421c-a4a6-058b6d8a71c5 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:51.488388 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-79c9370d-544d-4261-b689-8c6da74f2013 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c6918daa4f884786b45bc88dd1e4e94a" status: 200 len: 4825 microversion: 2.1 time: 0.869721 Oct 05 02:30:51.488880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-410cae37-7b08-421c-a4a6-058b6d8a71c5 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:51.489448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-410cae37-7b08-421c-a4a6-058b6d8a71c5 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:51.489584 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 492/980] 10.222.0.16 () {58 vars in 1257 bytes} [Wed Oct 5 02:30:50 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c6918daa4f884786b45bc88dd1e4e94a => generated 4825 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:51.514692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-157dee7d-98b4-4ac0-b00c-1c56be2a61a6 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:51.520790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-157dee7d-98b4-4ac0-b00c-1c56be2a61a6 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Searching by: {'tenant_id': 'ec1802aaa2f44429947b01dc6f5b351d', 'deleted': False} {{(pid=122320) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:30:51.529843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-157dee7d-98b4-4ac0-b00c-1c56be2a61a6 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:51.530323 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-157dee7d-98b4-4ac0-b00c-1c56be2a61a6 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:51.531266 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-157dee7d-98b4-4ac0-b00c-1c56be2a61a6 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:51.531991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-157dee7d-98b4-4ac0-b00c-1c56be2a61a6 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:51.532445 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-157dee7d-98b4-4ac0-b00c-1c56be2a61a6 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:51.532862 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-157dee7d-98b4-4ac0-b00c-1c56be2a61a6 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:51.560507 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-157dee7d-98b4-4ac0-b00c-1c56be2a61a6 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=ec1802aaa2f44429947b01dc6f5b351d" status: 200 len: 15 microversion: 2.1 time: 0.049370 Oct 05 02:30:51.561190 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 493/981] 10.222.0.16 () {58 vars in 1257 bytes} [Wed Oct 5 02:30:51 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=ec1802aaa2f44429947b01dc6f5b351d => generated 15 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 05 02:30:51.582615 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-219fdabe-7c20-4357-9c9e-f9299a88eb39 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:51.587686 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-219fdabe-7c20-4357-9c9e-f9299a88eb39 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.008660 Oct 05 02:30:51.588196 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 494/982] 10.222.0.16 () {58 vars in 1189 bytes} [Wed Oct 5 02:30:51 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:30:51.593644 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-44a600da-16a2-46c4-b4dd-ee7161fdbab4 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:51.594331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-44a600da-16a2-46c4-b4dd-ee7161fdbab4 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:51.600749 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44a600da-16a2-46c4-b4dd-ee7161fdbab4 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:51.601305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44a600da-16a2-46c4-b4dd-ee7161fdbab4 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:51.601762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44a600da-16a2-46c4-b4dd-ee7161fdbab4 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:51.602448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44a600da-16a2-46c4-b4dd-ee7161fdbab4 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:51.602892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44a600da-16a2-46c4-b4dd-ee7161fdbab4 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:51.603314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44a600da-16a2-46c4-b4dd-ee7161fdbab4 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:51.695116 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-44a600da-16a2-46c4-b4dd-ee7161fdbab4 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:51.703898 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-44a600da-16a2-46c4-b4dd-ee7161fdbab4 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:51.705355 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-44a600da-16a2-46c4-b4dd-ee7161fdbab4 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:51.710422 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-44a600da-16a2-46c4-b4dd-ee7161fdbab4 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1437 microversion: 2.75 time: 0.121349 Oct 05 02:30:51.711178 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 495/983] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:51 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1437 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:51.715333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0f69dc1f-3d5e-48c0-b16a-95e575e619c6 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:51.718892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0f69dc1f-3d5e-48c0-b16a-95e575e619c6 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:51.725528 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f69dc1f-3d5e-48c0-b16a-95e575e619c6 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:51.726139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f69dc1f-3d5e-48c0-b16a-95e575e619c6 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:51.726483 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f69dc1f-3d5e-48c0-b16a-95e575e619c6 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:51.727253 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f69dc1f-3d5e-48c0-b16a-95e575e619c6 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:51.727819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f69dc1f-3d5e-48c0-b16a-95e575e619c6 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:51.728304 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f69dc1f-3d5e-48c0-b16a-95e575e619c6 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:51.740109 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-410cae37-7b08-421c-a4a6-058b6d8a71c5 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af06771f33b4bff85a7ec7bb746a44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42fe97af30047fd999c08abc89dc2ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:51.748854 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-410cae37-7b08-421c-a4a6-058b6d8a71c5 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] 10.222.0.16 "GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a" status: 200 len: 1508 microversion: 2.1 time: 0.274776 Oct 05 02:30:51.749816 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 489/984] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:51 2022] GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a => generated 1508 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:51.820997 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0f69dc1f-3d5e-48c0-b16a-95e575e619c6 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3/action" status: 202 len: 0 microversion: 2.1 time: 0.108566 Oct 05 02:30:51.824492 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 496/985] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:30:51 2022] POST /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:30:51.830774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9d531ad1-5217-42f4-84ea-bdde385afaa1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:51.836437 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9d531ad1-5217-42f4-84ea-bdde385afaa1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:51.837618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9d531ad1-5217-42f4-84ea-bdde385afaa1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a'} {{(pid=122320) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:30:51.844756 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d531ad1-5217-42f4-84ea-bdde385afaa1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:51.845274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d531ad1-5217-42f4-84ea-bdde385afaa1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:51.845706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d531ad1-5217-42f4-84ea-bdde385afaa1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:51.846478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d531ad1-5217-42f4-84ea-bdde385afaa1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:51.846928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d531ad1-5217-42f4-84ea-bdde385afaa1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:51.847349 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d531ad1-5217-42f4-84ea-bdde385afaa1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:51.896358 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c724f6de-1757-4186-8f3a-927d23fdad1b tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:51.900312 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c724f6de-1757-4186-8f3a-927d23fdad1b tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:51.909761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c724f6de-1757-4186-8f3a-927d23fdad1b tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:51.910697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c724f6de-1757-4186-8f3a-927d23fdad1b tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:51.911346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c724f6de-1757-4186-8f3a-927d23fdad1b tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:51.912232 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c724f6de-1757-4186-8f3a-927d23fdad1b tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:51.912930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c724f6de-1757-4186-8f3a-927d23fdad1b tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:51.913802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c724f6de-1757-4186-8f3a-927d23fdad1b tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:51.945917 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.multi_cell_list [None req-9d531ad1-5217-42f4-84ea-bdde385afaa1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:30:51.999047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-c724f6de-1757-4186-8f3a-927d23fdad1b tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:30:52.000456 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-c724f6de-1757-4186-8f3a-927d23fdad1b tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:30:52.000973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-c724f6de-1757-4186-8f3a-927d23fdad1b tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:30:52.001389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-c724f6de-1757-4186-8f3a-927d23fdad1b tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:30:52.001976 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-c724f6de-1757-4186-8f3a-927d23fdad1b tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:30:52.015825 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9d531ad1-5217-42f4-84ea-bdde385afaa1 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.188649 Oct 05 02:30:52.016640 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 497/986] 10.222.0.16 () {58 vars in 1150 bytes} [Wed Oct 5 02:30:51 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:30:52.027741 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-237ab73a-366e-4572-a89d-a18690b8cbfa tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:52.030002 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-237ab73a-366e-4572-a89d-a18690b8cbfa tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:52.036579 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-237ab73a-366e-4572-a89d-a18690b8cbfa tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:52.037115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-237ab73a-366e-4572-a89d-a18690b8cbfa tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:52.037548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-237ab73a-366e-4572-a89d-a18690b8cbfa tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:52.038251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-237ab73a-366e-4572-a89d-a18690b8cbfa tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:52.038708 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-237ab73a-366e-4572-a89d-a18690b8cbfa tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:52.039159 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-237ab73a-366e-4572-a89d-a18690b8cbfa tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:52.068420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c724f6de-1757-4186-8f3a-927d23fdad1b tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:52.085701 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c724f6de-1757-4186-8f3a-927d23fdad1b tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:52.086199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c724f6de-1757-4186-8f3a-927d23fdad1b tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:52.086631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c724f6de-1757-4186-8f3a-927d23fdad1b tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:52.087714 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c724f6de-1757-4186-8f3a-927d23fdad1b tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:52.088171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c724f6de-1757-4186-8f3a-927d23fdad1b tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:52.088594 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c724f6de-1757-4186-8f3a-927d23fdad1b tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:52.133604 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-237ab73a-366e-4572-a89d-a18690b8cbfa tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3/action" status: 202 len: 0 microversion: 2.1 time: 0.109354 Oct 05 02:30:52.134718 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 498/987] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:30:52 2022] POST /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 02:30:52.144185 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ef9905a2-9912-4b63-b4d5-8da760d2eb77 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:52.144957 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ef9905a2-9912-4b63-b4d5-8da760d2eb77 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:52.151135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ef9905a2-9912-4b63-b4d5-8da760d2eb77 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:52.151629 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ef9905a2-9912-4b63-b4d5-8da760d2eb77 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:52.152068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ef9905a2-9912-4b63-b4d5-8da760d2eb77 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:52.152770 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ef9905a2-9912-4b63-b4d5-8da760d2eb77 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:52.153250 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ef9905a2-9912-4b63-b4d5-8da760d2eb77 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:52.153673 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ef9905a2-9912-4b63-b4d5-8da760d2eb77 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:52.290972 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-c724f6de-1757-4186-8f3a-927d23fdad1b tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lazy-loading 'services' on Instance uuid 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:30:52.307639 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c724f6de-1757-4186-8f3a-927d23fdad1b tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d/action" status: 202 len: 1940 microversion: 2.75 time: 0.556633 Oct 05 02:30:52.308283 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 490/988] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 5 02:30:51 2022] POST /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d/action => generated 1940 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 05 02:30:52.335088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-caada614-5016-47e7-8b5a-b0cf622fcd2c tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:52.335703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-caada614-5016-47e7-8b5a-b0cf622fcd2c tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:52.341550 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-caada614-5016-47e7-8b5a-b0cf622fcd2c tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:52.342045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-caada614-5016-47e7-8b5a-b0cf622fcd2c tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:52.342480 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-caada614-5016-47e7-8b5a-b0cf622fcd2c tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:52.343181 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-caada614-5016-47e7-8b5a-b0cf622fcd2c tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:52.343644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-caada614-5016-47e7-8b5a-b0cf622fcd2c tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:52.344067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-caada614-5016-47e7-8b5a-b0cf622fcd2c tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:52.391838 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ef9905a2-9912-4b63-b4d5-8da760d2eb77 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1614 microversion: 2.1 time: 0.252901 Oct 05 02:30:52.405575 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 499/989] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:52 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1614 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:52.422377 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8ead9d29-6813-4d61-b217-8b4019289369 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:52.423154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8ead9d29-6813-4d61-b217-8b4019289369 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:52.438323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-caada614-5016-47e7-8b5a-b0cf622fcd2c tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lazy-loading 'services' on Instance uuid 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:30:52.449414 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ead9d29-6813-4d61-b217-8b4019289369 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:52.450172 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ead9d29-6813-4d61-b217-8b4019289369 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:52.450950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ead9d29-6813-4d61-b217-8b4019289369 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:52.451843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ead9d29-6813-4d61-b217-8b4019289369 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:52.453146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ead9d29-6813-4d61-b217-8b4019289369 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:52.454354 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ead9d29-6813-4d61-b217-8b4019289369 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:52.467604 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-caada614-5016-47e7-8b5a-b0cf622fcd2c tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1927 microversion: 2.75 time: 0.136077 Oct 05 02:30:52.469402 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 491/990] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:52 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1927 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:30:52.495809 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8d26b426-9235-4a42-9e99-394c33cb6b1f tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:52.496439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8d26b426-9235-4a42-9e99-394c33cb6b1f tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] [instance: a7434499-a9a4-4c47-a5fe-5ea93c32c0ac] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:52.505792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d26b426-9235-4a42-9e99-394c33cb6b1f tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:52.507155 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d26b426-9235-4a42-9e99-394c33cb6b1f tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:52.507593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d26b426-9235-4a42-9e99-394c33cb6b1f tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:52.509081 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d26b426-9235-4a42-9e99-394c33cb6b1f tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:52.509849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d26b426-9235-4a42-9e99-394c33cb6b1f tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:52.510779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d26b426-9235-4a42-9e99-394c33cb6b1f tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:52.776564 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8ead9d29-6813-4d61-b217-8b4019289369 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1614 microversion: 2.1 time: 0.364854 Oct 05 02:30:52.777226 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 500/991] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:52 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1614 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:52.790616 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-17888fb6-9381-4340-87d7-b8c517e40b96 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-57724817", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "eeab81fe-da30-46f9-87be-0b6dd3f4b67b"}], "security_groups": [{"name": "tempest-securitygroup--1254304349"}], "key_name": "tempest-keypair-727129128", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:52.810212 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8d26b426-9235-4a42-9e99-394c33cb6b1f tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f596b5b1188a4384a2efdafbd08242ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b237b4e2594addbd899828d222aa9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:52.819229 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8d26b426-9235-4a42-9e99-394c33cb6b1f tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] 10.222.0.16 "GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac" status: 200 len: 1324 microversion: 2.1 time: 0.327177 Oct 05 02:30:52.820078 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 492/992] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:52 2022] GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac => generated 1324 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:30:52.841089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-900f7d83-9605-4f53-b781-9b6a6366aa5b tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:52.842021 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-900f7d83-9605-4f53-b781-9b6a6366aa5b tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] [instance: e13827ed-384b-43ec-8ba8-d9ab3f96eb6a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:52.850218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-900f7d83-9605-4f53-b781-9b6a6366aa5b tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:52.851047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-900f7d83-9605-4f53-b781-9b6a6366aa5b tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:52.851709 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-900f7d83-9605-4f53-b781-9b6a6366aa5b tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:52.852651 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-900f7d83-9605-4f53-b781-9b6a6366aa5b tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:52.853539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-900f7d83-9605-4f53-b781-9b6a6366aa5b tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:52.854221 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-900f7d83-9605-4f53-b781-9b6a6366aa5b tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:52.995396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-17888fb6-9381-4340-87d7-b8c517e40b96 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] validate_networks() for [('eeab81fe-da30-46f9-87be-0b6dd3f4b67b', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:30:53.235823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-900f7d83-9605-4f53-b781-9b6a6366aa5b tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af06771f33b4bff85a7ec7bb746a44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42fe97af30047fd999c08abc89dc2ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:53.238051 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:53.250639 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-900f7d83-9605-4f53-b781-9b6a6366aa5b tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] 10.222.0.16 "GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a" status: 200 len: 1508 microversion: 2.1 time: 0.415930 Oct 05 02:30:53.252856 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 493/993] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:52 2022] GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a => generated 1508 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:53.260427 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5fb95c6f-6dcd-4f36-82e5-1878148b6857 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:53.268895 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5fb95c6f-6dcd-4f36-82e5-1878148b6857 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Searching by: {'host': 'n-h2-858272-3', 'deleted': False} {{(pid=122319) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:30:53.279730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5fb95c6f-6dcd-4f36-82e5-1878148b6857 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:53.281120 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5fb95c6f-6dcd-4f36-82e5-1878148b6857 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:53.281803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5fb95c6f-6dcd-4f36-82e5-1878148b6857 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:53.282685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5fb95c6f-6dcd-4f36-82e5-1878148b6857 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:53.283301 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5fb95c6f-6dcd-4f36-82e5-1878148b6857 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:53.283722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5fb95c6f-6dcd-4f36-82e5-1878148b6857 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:53.413758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.multi_cell_list [None req-5fb95c6f-6dcd-4f36-82e5-1878148b6857 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=122319) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:30:53.477836 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5fb95c6f-6dcd-4f36-82e5-1878148b6857 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] 10.222.0.16 "GET /compute/v2.1/servers?host=n-h2-858272-3&all_tenants=1" status: 200 len: 2307 microversion: 2.1 time: 0.222975 Oct 05 02:30:53.478535 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 494/994] 10.222.0.16 () {58 vars in 1190 bytes} [Wed Oct 5 02:30:53 2022] GET /compute/v2.1/servers?host=n-h2-858272-3&all_tenants=1 => generated 2307 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:53.490776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-6115991b-cfe7-44f3-af47-becd13ddbbfa req-c493ce14-8021-470a-9029-f1493d97ac52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13827ed-384b-43ec-8ba8-d9ab3f96eb6a", "name": "network-vif-deleted", "tag": "deeb8020-81ec-4c04-82be-82ca0029d926"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:53.500099 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6115991b-cfe7-44f3-af47-becd13ddbbfa req-c493ce14-8021-470a-9029-f1493d97ac52 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:53.500577 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6115991b-cfe7-44f3-af47-becd13ddbbfa req-c493ce14-8021-470a-9029-f1493d97ac52 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:53.501029 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6115991b-cfe7-44f3-af47-becd13ddbbfa req-c493ce14-8021-470a-9029-f1493d97ac52 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:53.512137 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-6115991b-cfe7-44f3-af47-becd13ddbbfa req-c493ce14-8021-470a-9029-f1493d97ac52 service nova] Creating event network-vif-deleted:deeb8020-81ec-4c04-82be-82ca0029d926 for instance e13827ed-384b-43ec-8ba8-d9ab3f96eb6a on n-h1-858272-3 Oct 05 02:30:53.517106 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-6115991b-cfe7-44f3-af47-becd13ddbbfa req-c493ce14-8021-470a-9029-f1493d97ac52 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037251 Oct 05 02:30:53.517703 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 495/995] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:30:53.522577 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c3a3d1f0-5ce7-4fed-8a08-bfec53040034 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:53.528219 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c3a3d1f0-5ce7-4fed-8a08-bfec53040034 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=122319) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:30:53.533913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3a3d1f0-5ce7-4fed-8a08-bfec53040034 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:53.534391 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3a3d1f0-5ce7-4fed-8a08-bfec53040034 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:53.534827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3a3d1f0-5ce7-4fed-8a08-bfec53040034 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:53.535541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3a3d1f0-5ce7-4fed-8a08-bfec53040034 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:53.535993 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3a3d1f0-5ce7-4fed-8a08-bfec53040034 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:53.536417 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3a3d1f0-5ce7-4fed-8a08-bfec53040034 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:53.557523 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c3a3d1f0-5ce7-4fed-8a08-bfec53040034 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] 10.222.0.16 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.038621 Oct 05 02:30:53.558098 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 496/996] 10.222.0.16 () {58 vars in 1196 bytes} [Wed Oct 5 02:30:53 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:30:53.567622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b8a4311d-441e-45a1-bdcd-ddef3e4a6010 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:53.568440 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b8a4311d-441e-45a1-bdcd-ddef3e4a6010 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:53.574776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8a4311d-441e-45a1-bdcd-ddef3e4a6010 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:53.575260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8a4311d-441e-45a1-bdcd-ddef3e4a6010 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:53.576330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8a4311d-441e-45a1-bdcd-ddef3e4a6010 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:53.577072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8a4311d-441e-45a1-bdcd-ddef3e4a6010 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:53.578075 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8a4311d-441e-45a1-bdcd-ddef3e4a6010 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:53.578647 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8a4311d-441e-45a1-bdcd-ddef3e4a6010 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:53.604313 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-17888fb6-9381-4340-87d7-b8c517e40b96 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:30:53.604735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-17888fb6-9381-4340-87d7-b8c517e40b96 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:30:53.605241 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-17888fb6-9381-4340-87d7-b8c517e40b96 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:30:53.606023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-17888fb6-9381-4340-87d7-b8c517e40b96 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:30:53.606604 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-17888fb6-9381-4340-87d7-b8c517e40b96 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:30:53.616316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17888fb6-9381-4340-87d7-b8c517e40b96 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:53.617072 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17888fb6-9381-4340-87d7-b8c517e40b96 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:53.617740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17888fb6-9381-4340-87d7-b8c517e40b96 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:53.618627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17888fb6-9381-4340-87d7-b8c517e40b96 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:53.619293 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17888fb6-9381-4340-87d7-b8c517e40b96 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:53.619873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17888fb6-9381-4340-87d7-b8c517e40b96 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:53.640407 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-17888fb6-9381-4340-87d7-b8c517e40b96 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Getting quotas for project 6652917123e14c2797cafacc4e31f75a. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:30:53.645862 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-17888fb6-9381-4340-87d7-b8c517e40b96 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Getting quotas for user 118c1425677b45b98689befb0eb55cce and project 6652917123e14c2797cafacc4e31f75a. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:30:53.663214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-17888fb6-9381-4340-87d7-b8c517e40b96 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:30:53.665998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-17888fb6-9381-4340-87d7-b8c517e40b96 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:30:53.671959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-b8a4311d-441e-45a1-bdcd-ddef3e4a6010 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lazy-loading 'services' on Instance uuid 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:30:53.699184 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b8a4311d-441e-45a1-bdcd-ddef3e4a6010 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1927 microversion: 2.75 time: 0.140040 Oct 05 02:30:53.700072 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 497/997] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:53 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1927 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:53.706542 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8155e61e-708e-43d1-9f95-66b05591d10c tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:53.708822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8155e61e-708e-43d1-9f95-66b05591d10c tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:53.714658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8155e61e-708e-43d1-9f95-66b05591d10c tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:53.715147 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8155e61e-708e-43d1-9f95-66b05591d10c tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:53.715567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8155e61e-708e-43d1-9f95-66b05591d10c tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:53.716245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8155e61e-708e-43d1-9f95-66b05591d10c tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:53.716691 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8155e61e-708e-43d1-9f95-66b05591d10c tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:53.717157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8155e61e-708e-43d1-9f95-66b05591d10c tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:53.753776 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-17888fb6-9381-4340-87d7-b8c517e40b96 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.975158 Oct 05 02:30:53.761479 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 501/998] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:30:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:30:53.769416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6d39d640-9239-43a7-93cb-a250ba30ea54 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:53.770850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6d39d640-9239-43a7-93cb-a250ba30ea54 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:53.834963 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8155e61e-708e-43d1-9f95-66b05591d10c tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3/action" status: 202 len: 0 microversion: 2.1 time: 0.133333 Oct 05 02:30:53.840920 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 498/999] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:30:53 2022] POST /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:30:53.847002 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6d39d640-9239-43a7-93cb-a250ba30ea54 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:53.851949 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ed97a38d-0192-49fd-bbf4-57eacd3268fa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:53.854983 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6d39d640-9239-43a7-93cb-a250ba30ea54 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1232 microversion: 2.1 time: 0.092205 Oct 05 02:30:53.855112 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ed97a38d-0192-49fd-bbf4-57eacd3268fa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:53.855553 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 502/1000] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:53 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1232 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:53.860837 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-319fda09-8a6e-4b56-94fa-ae66a6d7faf1 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:53.861487 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-319fda09-8a6e-4b56-94fa-ae66a6d7faf1 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] [instance: a7434499-a9a4-4c47-a5fe-5ea93c32c0ac] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:53.866333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed97a38d-0192-49fd-bbf4-57eacd3268fa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:53.866773 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed97a38d-0192-49fd-bbf4-57eacd3268fa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:53.867214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed97a38d-0192-49fd-bbf4-57eacd3268fa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:53.867525 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-319fda09-8a6e-4b56-94fa-ae66a6d7faf1 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:53.867922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed97a38d-0192-49fd-bbf4-57eacd3268fa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:53.868030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-319fda09-8a6e-4b56-94fa-ae66a6d7faf1 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:53.868381 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed97a38d-0192-49fd-bbf4-57eacd3268fa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:53.868486 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-319fda09-8a6e-4b56-94fa-ae66a6d7faf1 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:53.868807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed97a38d-0192-49fd-bbf4-57eacd3268fa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:53.869232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-319fda09-8a6e-4b56-94fa-ae66a6d7faf1 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:53.869613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-319fda09-8a6e-4b56-94fa-ae66a6d7faf1 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:53.870275 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-319fda09-8a6e-4b56-94fa-ae66a6d7faf1 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:53.959053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-ed97a38d-0192-49fd-bbf4-57eacd3268fa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:30:53.959471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-ed97a38d-0192-49fd-bbf4-57eacd3268fa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:30:53.959960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-ed97a38d-0192-49fd-bbf4-57eacd3268fa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:30:53.960341 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-ed97a38d-0192-49fd-bbf4-57eacd3268fa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:30:53.960733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-ed97a38d-0192-49fd-bbf4-57eacd3268fa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:30:54.035103 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ed97a38d-0192-49fd-bbf4-57eacd3268fa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:54.041346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed97a38d-0192-49fd-bbf4-57eacd3268fa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:54.041848 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed97a38d-0192-49fd-bbf4-57eacd3268fa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:54.042294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed97a38d-0192-49fd-bbf4-57eacd3268fa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:54.043000 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed97a38d-0192-49fd-bbf4-57eacd3268fa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:54.043464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed97a38d-0192-49fd-bbf4-57eacd3268fa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:54.044108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed97a38d-0192-49fd-bbf4-57eacd3268fa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:54.056602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-319fda09-8a6e-4b56-94fa-ae66a6d7faf1 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f596b5b1188a4384a2efdafbd08242ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b237b4e2594addbd899828d222aa9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:54.065370 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-319fda09-8a6e-4b56-94fa-ae66a6d7faf1 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] 10.222.0.16 "GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac" status: 200 len: 1520 microversion: 2.1 time: 0.208623 Oct 05 02:30:54.065930 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 503/1001] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:53 2022] GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:54.080204 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ed97a38d-0192-49fd-bbf4-57eacd3268fa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "POST /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3/action" status: 202 len: 1067 microversion: 2.1 time: 0.237803 Oct 05 02:30:54.081466 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 499/1002] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:30:53 2022] POST /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3/action => generated 1067 bytes in 240 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 05 02:30:54.099010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bcb212a2-96ec-41e4-82ba-d817b7926a06 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:54.099618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bcb212a2-96ec-41e4-82ba-d817b7926a06 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:54.105786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bcb212a2-96ec-41e4-82ba-d817b7926a06 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:54.106271 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bcb212a2-96ec-41e4-82ba-d817b7926a06 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:54.106702 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bcb212a2-96ec-41e4-82ba-d817b7926a06 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:54.107544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bcb212a2-96ec-41e4-82ba-d817b7926a06 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:54.108003 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bcb212a2-96ec-41e4-82ba-d817b7926a06 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:54.108559 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bcb212a2-96ec-41e4-82ba-d817b7926a06 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:54.151003 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-14bf493e-4238-4f2c-a952-8b49010a2d2b tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-13867931", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "af5ead4f-c20e-44ab-9535-9b650da7cc14"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:54.157450 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-14bf493e-4238-4f2c-a952-8b49010a2d2b tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Request method failure captured: Oct 05 02:30:54.157450 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 02:30:54.157450 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:30:54.157450 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:30:54.157450 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:30:54.157450 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 241 Oct 05 02:30:54.157450 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:30:54.157450 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:30:54.157450 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:30:54.157450 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:30:54.157450 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOxCSHVHqcM6UIffohzJiFY0Ng73u9F13NYk9Tnalq9Xo_YeaEvAVfmaUAOY8lBJO9ssZMeYHRyXBjVB4gMj6XX-25M-fvCKdTOZyalegralBrWUlK7Ekg9yBfFBZwTpOEpXSxuQjkOaBd-8uWJaKVElAAICzytiIfjhgwrm43febNo Oct 05 02:30:54.157450 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:30:54.157450 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:30:54.157450 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:30:54.157450 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:30:54.157450 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:30:54.157450 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:30:54.157450 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 87b237b4e2594addbd899828d222aa9d Oct 05 02:30:54.157450 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1239393906 Oct 05 02:30:54.157450 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:30:54.157450 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:30:54.158967 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/87b237b4e2594addbd899828d222aa9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/87b237b4e2594addbd899828d222aa9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/87b237b4e2594addbd899828d222aa9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_87b237b4e2594addbd899828d222aa9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:30:54.158967 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1239393906 Oct 05 02:30:54.158967 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 87b237b4e2594addbd899828d222aa9d Oct 05 02:30:54.158967 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1239393906 Oct 05 02:30:54.158967 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerMetadataNegativeTestJSON-1239393906-project Oct 05 02:30:54.158967 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:30:54.158967 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:30:54.158967 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: f596b5b1188a4384a2efdafbd08242ba Oct 05 02:30:54.158967 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1239393906-project Oct 05 02:30:54.158967 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:30:54.158967 n-d-858272-3 devstack@n-api.service[122319]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-13867931", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "af5ead4f-c20e-44ab-9535-9b650da7cc14"}]}} Oct 05 02:30:54.159754 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:30:54.159754 n-d-858272-3 devstack@n-api.service[122319]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 02:30:54.159754 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-13867931', 'imageRef': 'adad3215-1ca6-43bb-9981-0d01aff146ab', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'af5ead4f-c20e-44ab-9535-9b650da7cc14'}]}}} Oct 05 02:30:54.159754 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:30:54.159754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:54.159754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:30:54.159754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:30:54.159754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:30:54.159754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:30:54.159754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 02:30:54.159754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.159754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 05 02:30:54.159754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 05 02:30:54.159754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 05 02:30:54.159754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 05 02:30:54.159754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 05 02:30:54.159754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.159754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 05 02:30:54.159754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 05 02:30:54.161153 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.161153 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:54.161153 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.161153 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:54.161153 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:54.161153 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:54.161153 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:30:54.161153 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:30:54.161153 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:30:54.161153 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:30:54.161153 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:30:54.161153 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:30:54.161153 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 02:30:54.161153 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 02:30:54.161153 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:30:54.161153 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:30:54.161153 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:30:54.161153 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:30:54.161153 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 02:30:54.161153 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.162505 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:54.162505 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.162505 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:54.162505 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:54.162505 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:54.162505 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:30:54.162505 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:30:54.162505 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 02:30:54.162505 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.162505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-14bf493e-4238-4f2c-a952-8b49010a2d2b tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:30:54.162505 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-14bf493e-4238-4f2c-a952-8b49010a2d2b tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.013721 Oct 05 02:30:54.165544 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 500/1003] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:30:54 2022] POST /compute/v2.1/servers => generated 175 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:30:54.172091 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-96c5c2ce-5d9e-422f-a8f6-902aca4764ca tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:54.172598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-96c5c2ce-5d9e-422f-a8f6-902aca4764ca tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] [instance: 58d9f10a-4a31-4d8a-865a-326d5e9bc422] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:54.179314 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-96c5c2ce-5d9e-422f-a8f6-902aca4764ca tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] HTTP exception thrown: Instance 58d9f10a-4a31-4d8a-865a-326d5e9bc422 could not be found. Oct 05 02:30:54.184585 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-96c5c2ce-5d9e-422f-a8f6-902aca4764ca tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Request method failure captured: Oct 05 02:30:54.184585 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/58d9f10a-4a31-4d8a-865a-326d5e9bc422/metadata HTTP/1.1 Oct 05 02:30:54.184585 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:30:54.184585 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:30:54.184585 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:30:54.184585 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:30:54.184585 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:30:54.184585 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:30:54.184585 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:30:54.184585 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:30:54.184585 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOxCSHVHqcM6UIffohzJiFY0Ng73u9F13NYk9Tnalq9Xo_YeaEvAVfmaUAOY8lBJO9ssZMeYHRyXBjVB4gMj6XX-25M-fvCKdTOZyalegralBrWUlK7Ekg9yBfFBZwTpOEpXSxuQjkOaBd-8uWJaKVElAAICzytiIfjhgwrm43febNo Oct 05 02:30:54.184585 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:30:54.184585 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:30:54.184585 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:30:54.184585 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:30:54.184585 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:30:54.184585 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:30:54.184585 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 87b237b4e2594addbd899828d222aa9d Oct 05 02:30:54.184585 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1239393906 Oct 05 02:30:54.184585 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:30:54.184585 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:30:54.186072 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/87b237b4e2594addbd899828d222aa9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/87b237b4e2594addbd899828d222aa9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/87b237b4e2594addbd899828d222aa9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_87b237b4e2594addbd899828d222aa9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:30:54.186072 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1239393906 Oct 05 02:30:54.186072 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 87b237b4e2594addbd899828d222aa9d Oct 05 02:30:54.186072 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1239393906 Oct 05 02:30:54.186072 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerMetadataNegativeTestJSON-1239393906-project Oct 05 02:30:54.186072 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:30:54.186072 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:30:54.186072 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: f596b5b1188a4384a2efdafbd08242ba Oct 05 02:30:54.186072 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1239393906-project Oct 05 02:30:54.186072 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:30:54.186072 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 58d9f10a-4a31-4d8a-865a-326d5e9bc422 could not be found. Oct 05 02:30:54.187447 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'server_id': '58d9f10a-4a31-4d8a-865a-326d5e9bc422'} Oct 05 02:30:54.187447 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:30:54.187447 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:54.187447 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:30:54.187447 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:30:54.187447 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:30:54.187447 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:30:54.187447 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 02:30:54.187447 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 02:30:54.187447 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58d9f10a-4a31-4d8a-865a-326d5e9bc422 could not be found. Oct 05 02:30:54.187447 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.187447 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:54.187447 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.187447 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:54.187447 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:54.187447 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:54.187447 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:30:54.187447 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:30:54.187447 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:30:54.187447 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:30:54.188714 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 05 02:30:54.188714 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 05 02:30:54.188714 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:30:54.188714 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:30:54.188714 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58d9f10a-4a31-4d8a-865a-326d5e9bc422 could not be found. Oct 05 02:30:54.188714 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.188714 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:54.188714 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.188714 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:54.188714 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:54.188714 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:54.188714 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:30:54.188714 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:30:54.188714 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58d9f10a-4a31-4d8a-865a-326d5e9bc422 could not be found. Oct 05 02:30:54.188714 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.188714 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-96c5c2ce-5d9e-422f-a8f6-902aca4764ca tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Returning 404 to user: Instance 58d9f10a-4a31-4d8a-865a-326d5e9bc422 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:30:54.189801 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-96c5c2ce-5d9e-422f-a8f6-902aca4764ca tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] 10.222.0.16 "GET /compute/v2.1/servers/58d9f10a-4a31-4d8a-865a-326d5e9bc422/metadata" status: 404 len: 111 microversion: 2.1 time: 0.018325 Oct 05 02:30:54.189801 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 501/1004] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 5 02:30:54 2022] GET /compute/v2.1/servers/58d9f10a-4a31-4d8a-865a-326d5e9bc422/metadata => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:30:54.252823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a805d23f-2ae3-47e4-ad77-4e2775e9d08c tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1891746964", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "af5ead4f-c20e-44ab-9535-9b650da7cc14"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:54.258105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a805d23f-2ae3-47e4-ad77-4e2775e9d08c tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Request method failure captured: Oct 05 02:30:54.258105 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 02:30:54.258105 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:30:54.258105 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:30:54.258105 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:30:54.258105 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 499 Oct 05 02:30:54.258105 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:30:54.258105 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:30:54.258105 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:30:54.258105 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:30:54.258105 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOxCSHVHqcM6UIffohzJiFY0Ng73u9F13NYk9Tnalq9Xo_YeaEvAVfmaUAOY8lBJO9ssZMeYHRyXBjVB4gMj6XX-25M-fvCKdTOZyalegralBrWUlK7Ekg9yBfFBZwTpOEpXSxuQjkOaBd-8uWJaKVElAAICzytiIfjhgwrm43febNo Oct 05 02:30:54.258105 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:30:54.258105 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:30:54.258105 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:30:54.258105 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:30:54.258105 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:30:54.258105 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:30:54.258105 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 87b237b4e2594addbd899828d222aa9d Oct 05 02:30:54.258105 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1239393906 Oct 05 02:30:54.258105 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:30:54.258105 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:30:54.259739 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/87b237b4e2594addbd899828d222aa9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/87b237b4e2594addbd899828d222aa9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/87b237b4e2594addbd899828d222aa9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_87b237b4e2594addbd899828d222aa9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:30:54.259739 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1239393906 Oct 05 02:30:54.259739 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 87b237b4e2594addbd899828d222aa9d Oct 05 02:30:54.259739 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1239393906 Oct 05 02:30:54.259739 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerMetadataNegativeTestJSON-1239393906-project Oct 05 02:30:54.259739 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:30:54.259739 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:30:54.259739 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: f596b5b1188a4384a2efdafbd08242ba Oct 05 02:30:54.259739 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1239393906-project Oct 05 02:30:54.259739 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:30:54.260403 n-d-858272-3 devstack@n-api.service[122319]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1891746964", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "af5ead4f-c20e-44ab-9535-9b650da7cc14"}]}} Oct 05 02:30:54.260403 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:30:54.260403 n-d-858272-3 devstack@n-api.service[122319]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 02:30:54.260403 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1891746964', 'imageRef': 'adad3215-1ca6-43bb-9981-0d01aff146ab', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'af5ead4f-c20e-44ab-9535-9b650da7cc14'}]}}} Oct 05 02:30:54.260403 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:30:54.260403 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:54.260819 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:30:54.260819 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:30:54.260819 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:30:54.260819 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:30:54.260819 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 02:30:54.260819 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.260819 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 05 02:30:54.260819 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 05 02:30:54.260819 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 05 02:30:54.260819 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 05 02:30:54.260819 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 05 02:30:54.260819 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.260819 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 05 02:30:54.260819 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 05 02:30:54.260819 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.260819 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:54.260819 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.262103 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:54.262103 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:54.262103 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:54.262103 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:30:54.262103 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:30:54.262103 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:30:54.262103 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:30:54.262103 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:30:54.262103 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:30:54.262103 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 02:30:54.262103 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 02:30:54.262103 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:30:54.262103 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:30:54.262103 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:30:54.262103 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:30:54.263027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 02:30:54.263027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.263027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:54.263027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.263027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:54.263027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:54.263027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:54.263027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:30:54.263027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:30:54.263612 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 02:30:54.263612 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.263612 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a805d23f-2ae3-47e4-ad77-4e2775e9d08c tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:30:54.267220 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a805d23f-2ae3-47e4-ad77-4e2775e9d08c tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.012121 Oct 05 02:30:54.270946 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 502/1005] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:30:54 2022] POST /compute/v2.1/servers => generated 687 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:30:54.277036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d6273ccf-78e4-4222-a3fc-b52bf3ce79e2 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:54.277661 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d6273ccf-78e4-4222-a3fc-b52bf3ce79e2 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] [instance: e13827ed-384b-43ec-8ba8-d9ab3f96eb6a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:54.286093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d6273ccf-78e4-4222-a3fc-b52bf3ce79e2 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:54.286623 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d6273ccf-78e4-4222-a3fc-b52bf3ce79e2 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:54.287059 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d6273ccf-78e4-4222-a3fc-b52bf3ce79e2 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:54.287787 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d6273ccf-78e4-4222-a3fc-b52bf3ce79e2 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:54.288234 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d6273ccf-78e4-4222-a3fc-b52bf3ce79e2 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:54.288657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d6273ccf-78e4-4222-a3fc-b52bf3ce79e2 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:54.309673 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bcb212a2-96ec-41e4-82ba-d817b7926a06 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:54.315784 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:54.325980 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bcb212a2-96ec-41e4-82ba-d817b7926a06 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1471 microversion: 2.1 time: 0.230513 Oct 05 02:30:54.327296 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 504/1006] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:54 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1471 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:54.328817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d6273ccf-78e4-4222-a3fc-b52bf3ce79e2 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:54.329339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d6273ccf-78e4-4222-a3fc-b52bf3ce79e2 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:54.329767 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d6273ccf-78e4-4222-a3fc-b52bf3ce79e2 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:54.330218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-d6273ccf-78e4-4222-a3fc-b52bf3ce79e2 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lazy-loading 'fault' on Instance uuid e13827ed-384b-43ec-8ba8-d9ab3f96eb6a {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:30:54.387585 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-019acda2-2b94-4134-b912-0f999c80534e tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1151152735", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "af5ead4f-c20e-44ab-9535-9b650da7cc14"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:54.388819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d6273ccf-78e4-4222-a3fc-b52bf3ce79e2 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af06771f33b4bff85a7ec7bb746a44b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42fe97af30047fd999c08abc89dc2ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:54.392372 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-019acda2-2b94-4134-b912-0f999c80534e tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Request method failure captured: Oct 05 02:30:54.392372 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 02:30:54.392372 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:30:54.392372 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:30:54.392372 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:30:54.392372 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 500 Oct 05 02:30:54.392372 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:30:54.392372 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:30:54.392372 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:30:54.392372 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:30:54.392372 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOxCSHVHqcM6UIffohzJiFY0Ng73u9F13NYk9Tnalq9Xo_YeaEvAVfmaUAOY8lBJO9ssZMeYHRyXBjVB4gMj6XX-25M-fvCKdTOZyalegralBrWUlK7Ekg9yBfFBZwTpOEpXSxuQjkOaBd-8uWJaKVElAAICzytiIfjhgwrm43febNo Oct 05 02:30:54.392372 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:30:54.392372 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:30:54.392372 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:30:54.392372 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:30:54.392372 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:30:54.392372 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:30:54.392372 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 87b237b4e2594addbd899828d222aa9d Oct 05 02:30:54.392372 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1239393906 Oct 05 02:30:54.392372 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:30:54.392372 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:30:54.393895 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/87b237b4e2594addbd899828d222aa9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/87b237b4e2594addbd899828d222aa9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/87b237b4e2594addbd899828d222aa9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_87b237b4e2594addbd899828d222aa9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:30:54.393895 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1239393906 Oct 05 02:30:54.393895 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 87b237b4e2594addbd899828d222aa9d Oct 05 02:30:54.393895 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1239393906 Oct 05 02:30:54.393895 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServerMetadataNegativeTestJSON-1239393906-project Oct 05 02:30:54.393895 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:30:54.393895 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:30:54.393895 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: f596b5b1188a4384a2efdafbd08242ba Oct 05 02:30:54.393895 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1239393906-project Oct 05 02:30:54.393895 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:30:54.394512 n-d-858272-3 devstack@n-api.service[122320]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1151152735", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "af5ead4f-c20e-44ab-9535-9b650da7cc14"}]}} Oct 05 02:30:54.394512 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:30:54.394512 n-d-858272-3 devstack@n-api.service[122320]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 02:30:54.394512 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1151152735', 'imageRef': 'adad3215-1ca6-43bb-9981-0d01aff146ab', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'af5ead4f-c20e-44ab-9535-9b650da7cc14'}]}}} Oct 05 02:30:54.394512 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:30:54.394512 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:54.394940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:30:54.394940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:30:54.394940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:30:54.394940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:30:54.394940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 02:30:54.394940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.394940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 05 02:30:54.394940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 05 02:30:54.394940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 05 02:30:54.394940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 05 02:30:54.394940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 05 02:30:54.394940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.394940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 05 02:30:54.394940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 05 02:30:54.394940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.394940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:54.394940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.396026 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:54.396026 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:54.396026 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:54.396026 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:30:54.396026 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:30:54.396026 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:30:54.396026 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:30:54.396026 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:30:54.396026 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:30:54.396026 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 02:30:54.396026 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 02:30:54.396026 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:30:54.396026 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:30:54.396026 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:30:54.396026 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:30:54.397005 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 02:30:54.397005 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.397005 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:54.397005 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.397005 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:54.397005 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:54.397005 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:54.397005 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:30:54.397005 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:30:54.399007 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 02:30:54.399007 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.399007 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-019acda2-2b94-4134-b912-0f999c80534e tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:30:54.399501 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-019acda2-2b94-4134-b912-0f999c80534e tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.010238 Oct 05 02:30:54.399501 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 505/1007] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:30:54 2022] POST /compute/v2.1/servers => generated 689 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:30:54.412507 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d6273ccf-78e4-4222-a3fc-b52bf3ce79e2 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] 10.222.0.16 "GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a" status: 200 len: 1305 microversion: 2.1 time: 0.136236 Oct 05 02:30:54.413783 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 503/1008] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:54 2022] GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a => generated 1305 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:54.451967 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1c805c47-bae9-44c1-9310-8a86ac9c07fe tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1780224491", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "af5ead4f-c20e-44ab-9535-9b650da7cc14"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:54.456499 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1c805c47-bae9-44c1-9310-8a86ac9c07fe tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Request method failure captured: Oct 05 02:30:54.456499 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 02:30:54.456499 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:30:54.456499 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:30:54.456499 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:30:54.456499 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 754 Oct 05 02:30:54.456499 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:30:54.456499 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:30:54.456499 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:30:54.456499 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:30:54.456499 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOxCSHVHqcM6UIffohzJiFY0Ng73u9F13NYk9Tnalq9Xo_YeaEvAVfmaUAOY8lBJO9ssZMeYHRyXBjVB4gMj6XX-25M-fvCKdTOZyalegralBrWUlK7Ekg9yBfFBZwTpOEpXSxuQjkOaBd-8uWJaKVElAAICzytiIfjhgwrm43febNo Oct 05 02:30:54.456499 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:30:54.456499 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:30:54.456499 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:30:54.456499 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:30:54.456499 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:30:54.456499 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:30:54.456499 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 87b237b4e2594addbd899828d222aa9d Oct 05 02:30:54.456499 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1239393906 Oct 05 02:30:54.456499 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:30:54.456499 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:30:54.458368 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/87b237b4e2594addbd899828d222aa9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/87b237b4e2594addbd899828d222aa9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/87b237b4e2594addbd899828d222aa9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_87b237b4e2594addbd899828d222aa9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:30:54.458368 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1239393906 Oct 05 02:30:54.458368 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 87b237b4e2594addbd899828d222aa9d Oct 05 02:30:54.458368 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1239393906 Oct 05 02:30:54.458368 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServerMetadataNegativeTestJSON-1239393906-project Oct 05 02:30:54.458368 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:30:54.458368 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:30:54.458368 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: f596b5b1188a4384a2efdafbd08242ba Oct 05 02:30:54.458368 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1239393906-project Oct 05 02:30:54.458368 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:30:54.459092 n-d-858272-3 devstack@n-api.service[122320]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1780224491", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "af5ead4f-c20e-44ab-9535-9b650da7cc14"}]}} Oct 05 02:30:54.459092 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:30:54.459092 n-d-858272-3 devstack@n-api.service[122320]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 02:30:54.459326 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1780224491', 'imageRef': 'adad3215-1ca6-43bb-9981-0d01aff146ab', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'af5ead4f-c20e-44ab-9535-9b650da7cc14'}]}}} Oct 05 02:30:54.459326 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:30:54.459326 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:54.459326 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:30:54.459326 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:30:54.459326 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:30:54.459326 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:30:54.459326 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 02:30:54.459850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.459850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 05 02:30:54.459850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 05 02:30:54.459850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 05 02:30:54.459850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 05 02:30:54.459850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 05 02:30:54.459850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.459850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 05 02:30:54.459850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 05 02:30:54.459850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.459850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:54.459850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.459850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:54.459850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:54.459850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:54.459850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:30:54.459850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:30:54.460932 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:30:54.460932 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:30:54.460932 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:30:54.460932 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:30:54.460932 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 02:30:54.460932 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 02:30:54.460932 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:30:54.460932 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:30:54.460932 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:30:54.460932 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:30:54.462357 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 02:30:54.462357 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.462357 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:54.462357 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.462357 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:54.462357 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:54.462357 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:54.462357 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:30:54.462357 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:30:54.463721 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 02:30:54.463721 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.464038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1c805c47-bae9-44c1-9310-8a86ac9c07fe tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:30:54.464038 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1c805c47-bae9-44c1-9310-8a86ac9c07fe tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.010642 Oct 05 02:30:54.464322 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 506/1009] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:30:54 2022] POST /compute/v2.1/servers => generated 1197 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 05 02:30:54.522882 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-112b881c-38e1-4669-8c85-d68f7b8e122e tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-789353079", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "af5ead4f-c20e-44ab-9535-9b650da7cc14"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:54.529780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-112b881c-38e1-4669-8c85-d68f7b8e122e tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Request method failure captured: Oct 05 02:30:54.529780 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 02:30:54.529780 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:30:54.529780 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:30:54.529780 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:30:54.529780 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 1265 Oct 05 02:30:54.529780 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:30:54.529780 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:30:54.529780 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:30:54.529780 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:30:54.529780 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOxCSHVHqcM6UIffohzJiFY0Ng73u9F13NYk9Tnalq9Xo_YeaEvAVfmaUAOY8lBJO9ssZMeYHRyXBjVB4gMj6XX-25M-fvCKdTOZyalegralBrWUlK7Ekg9yBfFBZwTpOEpXSxuQjkOaBd-8uWJaKVElAAICzytiIfjhgwrm43febNo Oct 05 02:30:54.529780 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:30:54.529780 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:30:54.529780 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:30:54.529780 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:30:54.529780 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:30:54.529780 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:30:54.529780 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 87b237b4e2594addbd899828d222aa9d Oct 05 02:30:54.529780 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1239393906 Oct 05 02:30:54.529780 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:30:54.529780 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:30:54.531332 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/87b237b4e2594addbd899828d222aa9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/87b237b4e2594addbd899828d222aa9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/87b237b4e2594addbd899828d222aa9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_87b237b4e2594addbd899828d222aa9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:30:54.531332 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1239393906 Oct 05 02:30:54.531332 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 87b237b4e2594addbd899828d222aa9d Oct 05 02:30:54.531332 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1239393906 Oct 05 02:30:54.531332 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerMetadataNegativeTestJSON-1239393906-project Oct 05 02:30:54.531332 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:30:54.531332 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:30:54.531332 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: f596b5b1188a4384a2efdafbd08242ba Oct 05 02:30:54.531332 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1239393906-project Oct 05 02:30:54.531332 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:30:54.532026 n-d-858272-3 devstack@n-api.service[122319]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-789353079", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "af5ead4f-c20e-44ab-9535-9b650da7cc14"}]}} Oct 05 02:30:54.532026 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:30:54.532188 n-d-858272-3 devstack@n-api.service[122319]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 02:30:54.532188 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-789353079', 'imageRef': 'adad3215-1ca6-43bb-9981-0d01aff146ab', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'af5ead4f-c20e-44ab-9535-9b650da7cc14'}]}}} Oct 05 02:30:54.532188 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:30:54.532188 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:54.532188 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:30:54.532188 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:30:54.532188 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:30:54.532188 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:30:54.532188 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 02:30:54.532188 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.532188 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 05 02:30:54.532188 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 05 02:30:54.532188 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 05 02:30:54.532188 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 05 02:30:54.532188 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 05 02:30:54.532188 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.532188 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 05 02:30:54.538075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 05 02:30:54.538075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.538075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:54.538075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.538075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:54.538075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:54.538075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:54.538075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:30:54.538075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:30:54.538075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:30:54.538075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:30:54.538075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:30:54.538075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:30:54.538075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 02:30:54.538075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 02:30:54.538075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:30:54.538075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:30:54.538075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:30:54.538075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:30:54.538075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 02:30:54.538075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.538075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:54.538075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.538075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:54.538075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:54.538075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:54.538075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:30:54.538075 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:30:54.540395 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 02:30:54.540395 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.540395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-112b881c-38e1-4669-8c85-d68f7b8e122e tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:30:54.540395 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-112b881c-38e1-4669-8c85-d68f7b8e122e tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.013980 Oct 05 02:30:54.540395 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 504/1010] 10.222.0.16 () {60 vars in 1148 bytes} [Wed Oct 5 02:30:54 2022] POST /compute/v2.1/servers => generated 2221 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 05 02:30:54.548363 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c370ce15-e1d9-4066-9a47-c8bfba82563c tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:54.549002 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c370ce15-e1d9-4066-9a47-c8bfba82563c tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] [instance: db38894e-0cc6-4af4-8b5c-21c1babbe2fb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:54.555471 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-c370ce15-e1d9-4066-9a47-c8bfba82563c tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] HTTP exception thrown: Instance db38894e-0cc6-4af4-8b5c-21c1babbe2fb could not be found. Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c370ce15-e1d9-4066-9a47-c8bfba82563c tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Request method failure captured: Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/db38894e-0cc6-4af4-8b5c-21c1babbe2fb/metadata/test2 HTTP/1.1 Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOxCSHVHqcM6UIffohzJiFY0Ng73u9F13NYk9Tnalq9Xo_YeaEvAVfmaUAOY8lBJO9ssZMeYHRyXBjVB4gMj6XX-25M-fvCKdTOZyalegralBrWUlK7Ekg9yBfFBZwTpOEpXSxuQjkOaBd-8uWJaKVElAAICzytiIfjhgwrm43febNo Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 87b237b4e2594addbd899828d222aa9d Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1239393906 Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/87b237b4e2594addbd899828d222aa9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/87b237b4e2594addbd899828d222aa9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/87b237b4e2594addbd899828d222aa9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_87b237b4e2594addbd899828d222aa9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1239393906 Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 87b237b4e2594addbd899828d222aa9d Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1239393906 Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServerMetadataNegativeTestJSON-1239393906-project Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: f596b5b1188a4384a2efdafbd08242ba Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1239393906-project Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance db38894e-0cc6-4af4-8b5c-21c1babbe2fb could not be found. Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'server_id': 'db38894e-0cc6-4af4-8b5c-21c1babbe2fb', 'id': 'test2'} Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db38894e-0cc6-4af4-8b5c-21c1babbe2fb could not be found. Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db38894e-0cc6-4af4-8b5c-21c1babbe2fb could not be found. Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:54.557222 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:54.562635 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:30:54.562635 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:30:54.562635 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db38894e-0cc6-4af4-8b5c-21c1babbe2fb could not be found. Oct 05 02:30:54.562635 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:54.562635 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c370ce15-e1d9-4066-9a47-c8bfba82563c tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Returning 404 to user: Instance db38894e-0cc6-4af4-8b5c-21c1babbe2fb could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:30:54.562635 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c370ce15-e1d9-4066-9a47-c8bfba82563c tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] 10.222.0.16 "GET /compute/v2.1/servers/db38894e-0cc6-4af4-8b5c-21c1babbe2fb/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.015491 Oct 05 02:30:54.568550 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 507/1011] 10.222.0.16 () {58 vars in 1281 bytes} [Wed Oct 5 02:30:54 2022] GET /compute/v2.1/servers/db38894e-0cc6-4af4-8b5c-21c1babbe2fb/metadata/test2 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:30:54.575527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4050f697-cf43-4610-8ec4-cbb19064fd73 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:54.576123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4050f697-cf43-4610-8ec4-cbb19064fd73 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] [instance: a7434499-a9a4-4c47-a5fe-5ea93c32c0ac] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:54.583562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4050f697-cf43-4610-8ec4-cbb19064fd73 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:54.584130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4050f697-cf43-4610-8ec4-cbb19064fd73 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:54.584638 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4050f697-cf43-4610-8ec4-cbb19064fd73 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:54.585545 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4050f697-cf43-4610-8ec4-cbb19064fd73 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:54.586219 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4050f697-cf43-4610-8ec4-cbb19064fd73 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:54.586665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4050f697-cf43-4610-8ec4-cbb19064fd73 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:54.612873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4050f697-cf43-4610-8ec4-cbb19064fd73 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] [instance: a7434499-a9a4-4c47-a5fe-5ea93c32c0ac] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:30:54.693474 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4050f697-cf43-4610-8ec4-cbb19064fd73 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac" status: 204 len: 0 microversion: 2.1 time: 0.122833 Oct 05 02:30:54.693911 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 505/1012] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:30:54 2022] DELETE /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:30:54.702621 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b373b08d-c357-4286-9f6c-2db77f20c0c1 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:54.703361 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b373b08d-c357-4286-9f6c-2db77f20c0c1 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] [instance: a7434499-a9a4-4c47-a5fe-5ea93c32c0ac] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:54.709540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b373b08d-c357-4286-9f6c-2db77f20c0c1 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:54.710021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b373b08d-c357-4286-9f6c-2db77f20c0c1 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:54.710452 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b373b08d-c357-4286-9f6c-2db77f20c0c1 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:54.711173 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b373b08d-c357-4286-9f6c-2db77f20c0c1 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:54.711578 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b373b08d-c357-4286-9f6c-2db77f20c0c1 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:54.711993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b373b08d-c357-4286-9f6c-2db77f20c0c1 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:54.728198 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8d31021e-d9d5-4332-a3b4-59f0fbf7ffc4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:54.729009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8d31021e-d9d5-4332-a3b4-59f0fbf7ffc4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:54.734965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d31021e-d9d5-4332-a3b4-59f0fbf7ffc4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:54.735447 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d31021e-d9d5-4332-a3b4-59f0fbf7ffc4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:54.735875 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d31021e-d9d5-4332-a3b4-59f0fbf7ffc4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:54.736557 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d31021e-d9d5-4332-a3b4-59f0fbf7ffc4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:54.737034 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d31021e-d9d5-4332-a3b4-59f0fbf7ffc4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:54.737456 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d31021e-d9d5-4332-a3b4-59f0fbf7ffc4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:54.818541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-8d31021e-d9d5-4332-a3b4-59f0fbf7ffc4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lazy-loading 'services' on Instance uuid 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:30:54.836588 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8d31021e-d9d5-4332-a3b4-59f0fbf7ffc4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1927 microversion: 2.75 time: 0.112647 Oct 05 02:30:54.837200 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 506/1013] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:54 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1927 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:30:54.866620 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b373b08d-c357-4286-9f6c-2db77f20c0c1 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f596b5b1188a4384a2efdafbd08242ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b237b4e2594addbd899828d222aa9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:54.874989 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b373b08d-c357-4286-9f6c-2db77f20c0c1 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] 10.222.0.16 "GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac" status: 200 len: 1526 microversion: 2.1 time: 0.176369 Oct 05 02:30:54.875557 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 508/1014] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:54 2022] GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac => generated 1526 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:54.881956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-30a385f3-3753-4510-9de3-9b8310dadd57 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:54.882641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-30a385f3-3753-4510-9de3-9b8310dadd57 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:54.888455 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-30a385f3-3753-4510-9de3-9b8310dadd57 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:54.888959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-30a385f3-3753-4510-9de3-9b8310dadd57 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:54.889389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-30a385f3-3753-4510-9de3-9b8310dadd57 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:54.890690 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-30a385f3-3753-4510-9de3-9b8310dadd57 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:54.891260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-30a385f3-3753-4510-9de3-9b8310dadd57 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:54.891676 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-30a385f3-3753-4510-9de3-9b8310dadd57 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:54.950861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-30a385f3-3753-4510-9de3-9b8310dadd57 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:54.959145 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-30a385f3-3753-4510-9de3-9b8310dadd57 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1284 microversion: 2.1 time: 0.080973 Oct 05 02:30:54.959702 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 507/1015] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:54 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1284 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:55.355602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3e551d4e-580f-49c5-bb0d-ac36b302eeaa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:55.356231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3e551d4e-580f-49c5-bb0d-ac36b302eeaa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:55.364358 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e551d4e-580f-49c5-bb0d-ac36b302eeaa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:55.364358 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e551d4e-580f-49c5-bb0d-ac36b302eeaa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:55.365146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e551d4e-580f-49c5-bb0d-ac36b302eeaa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:55.365850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e551d4e-580f-49c5-bb0d-ac36b302eeaa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:55.366421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e551d4e-580f-49c5-bb0d-ac36b302eeaa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:55.366733 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e551d4e-580f-49c5-bb0d-ac36b302eeaa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:55.434992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1d00a412-38f8-499f-9e0d-bf37e601d1e1 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:55.435712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1d00a412-38f8-499f-9e0d-bf37e601d1e1 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] [instance: e13827ed-384b-43ec-8ba8-d9ab3f96eb6a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:55.442437 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d00a412-38f8-499f-9e0d-bf37e601d1e1 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:55.442929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d00a412-38f8-499f-9e0d-bf37e601d1e1 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:55.443363 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d00a412-38f8-499f-9e0d-bf37e601d1e1 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:55.444606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d00a412-38f8-499f-9e0d-bf37e601d1e1 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:55.444606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d00a412-38f8-499f-9e0d-bf37e601d1e1 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:55.444929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d00a412-38f8-499f-9e0d-bf37e601d1e1 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:55.460915 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-1d00a412-38f8-499f-9e0d-bf37e601d1e1 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] HTTP exception thrown: Instance e13827ed-384b-43ec-8ba8-d9ab3f96eb6a could not be found. Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1d00a412-38f8-499f-9e0d-bf37e601d1e1 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Request method failure captured: Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a HTTP/1.1 Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOw96xVhGgH4V5BicqMSTu-JInGXv3InAZ791iViv4dFznbqJbj7C90DFJeesO8By_k8HZyYaXLWw2_vVgFTET76nTs5R4_L4nOJSMLRMQeK8OlC6-A0Odl9onbq7xJ6wLllcemSaayIvBskU_GXSHe1ysDg4_QgiOe62v-m5QNFctA Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: f42fe97af30047fd999c08abc89dc2ea Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ImagesNegativeTestJSON-925166863 Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f42fe97af30047fd999c08abc89dc2ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f42fe97af30047fd999c08abc89dc2ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f42fe97af30047fd999c08abc89dc2ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f42fe97af30047fd999c08abc89dc2ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ImagesNegativeTestJSON-925166863 Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: f42fe97af30047fd999c08abc89dc2ea Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-925166863 Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ImagesNegativeTestJSON-925166863-project Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 9af06771f33b4bff85a7ec7bb746a44b Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ImagesNegativeTestJSON-925166863-project Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance e13827ed-384b-43ec-8ba8-d9ab3f96eb6a could not be found. Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'e13827ed-384b-43ec-8ba8-d9ab3f96eb6a'} Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e13827ed-384b-43ec-8ba8-d9ab3f96eb6a could not be found. Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e13827ed-384b-43ec-8ba8-d9ab3f96eb6a could not be found. Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:55.462611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.466851 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:55.466851 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:55.466851 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:55.466851 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:30:55.466851 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:30:55.466851 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e13827ed-384b-43ec-8ba8-d9ab3f96eb6a could not be found. Oct 05 02:30:55.466851 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.466851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1d00a412-38f8-499f-9e0d-bf37e601d1e1 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Returning 404 to user: Instance e13827ed-384b-43ec-8ba8-d9ab3f96eb6a could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:30:55.466851 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1d00a412-38f8-499f-9e0d-bf37e601d1e1 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] 10.222.0.16 "GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a" status: 404 len: 111 microversion: 2.1 time: 0.032859 Oct 05 02:30:55.466851 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 508/1016] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:55 2022] GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:30:55.473656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-19c3f24c-8d63-4fdb-ab78-1f53bf0307c5 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1000716425", "metadata": {"image_type": "test"}}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:55.476279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-19c3f24c-8d63-4fdb-ab78-1f53bf0307c5 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] [instance: e13827ed-384b-43ec-8ba8-d9ab3f96eb6a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:55.482232 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19c3f24c-8d63-4fdb-ab78-1f53bf0307c5 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:55.482718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19c3f24c-8d63-4fdb-ab78-1f53bf0307c5 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:55.483163 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19c3f24c-8d63-4fdb-ab78-1f53bf0307c5 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:55.484603 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19c3f24c-8d63-4fdb-ab78-1f53bf0307c5 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:55.485308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19c3f24c-8d63-4fdb-ab78-1f53bf0307c5 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:55.485741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19c3f24c-8d63-4fdb-ab78-1f53bf0307c5 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:55.499781 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-19c3f24c-8d63-4fdb-ab78-1f53bf0307c5 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] HTTP exception thrown: Instance e13827ed-384b-43ec-8ba8-d9ab3f96eb6a could not be found. Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-19c3f24c-8d63-4fdb-ab78-1f53bf0307c5 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Request method failure captured: Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a/action HTTP/1.1 Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 112 Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOw96xVhGgH4V5BicqMSTu-JInGXv3InAZ791iViv4dFznbqJbj7C90DFJeesO8By_k8HZyYaXLWw2_vVgFTET76nTs5R4_L4nOJSMLRMQeK8OlC6-A0Odl9onbq7xJ6wLllcemSaayIvBskU_GXSHe1ysDg4_QgiOe62v-m5QNFctA Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: f42fe97af30047fd999c08abc89dc2ea Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ImagesNegativeTestJSON-925166863 Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f42fe97af30047fd999c08abc89dc2ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f42fe97af30047fd999c08abc89dc2ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f42fe97af30047fd999c08abc89dc2ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f42fe97af30047fd999c08abc89dc2ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ImagesNegativeTestJSON-925166863 Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: f42fe97af30047fd999c08abc89dc2ea Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-925166863 Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ImagesNegativeTestJSON-925166863-project Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 9af06771f33b4bff85a7ec7bb746a44b Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ImagesNegativeTestJSON-925166863-project Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1000716425", "metadata": {"image_type": "test"}}} Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance e13827ed-384b-43ec-8ba8-d9ab3f96eb6a could not be found. Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'e13827ed-384b-43ec-8ba8-d9ab3f96eb6a', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1000716425', 'metadata': {'image_type': 'test'}}}} Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e13827ed-384b-43ec-8ba8-d9ab3f96eb6a could not be found. Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 05 02:30:55.501779 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:30:55.507142 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:30:55.507142 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:30:55.507142 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:30:55.507142 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e13827ed-384b-43ec-8ba8-d9ab3f96eb6a could not be found. Oct 05 02:30:55.507142 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.507142 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:55.507142 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.507142 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:55.507142 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:55.507142 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:55.507142 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:30:55.507142 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:30:55.507142 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e13827ed-384b-43ec-8ba8-d9ab3f96eb6a could not be found. Oct 05 02:30:55.507142 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.507142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-19c3f24c-8d63-4fdb-ab78-1f53bf0307c5 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Returning 404 to user: Instance e13827ed-384b-43ec-8ba8-d9ab3f96eb6a could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:30:55.507142 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-19c3f24c-8d63-4fdb-ab78-1f53bf0307c5 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] 10.222.0.16 "POST /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a/action" status: 404 len: 111 microversion: 2.1 time: 0.033406 Oct 05 02:30:55.509054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3e551d4e-580f-49c5-bb0d-ac36b302eeaa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:55.511406 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 509/1017] 10.222.0.16 () {60 vars in 1279 bytes} [Wed Oct 5 02:30:55 2022] POST /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:30:55.515971 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c3888d5d-1f99-466a-829a-19b666a2d69f tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-156947841", "metadata": {"image_type": "test"}}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:55.518557 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c3888d5d-1f99-466a-829a-19b666a2d69f tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Failed to fetch instance by id tempest-invalid-968584419 {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 05 02:30:55.519234 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-c3888d5d-1f99-466a-829a-19b666a2d69f tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] HTTP exception thrown: Instance tempest-invalid-968584419 could not be found. Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c3888d5d-1f99-466a-829a-19b666a2d69f tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Request method failure captured: Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers/tempest-invalid-968584419/action HTTP/1.1 Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 111 Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOw96xVhGgH4V5BicqMSTu-JInGXv3InAZ791iViv4dFznbqJbj7C90DFJeesO8By_k8HZyYaXLWw2_vVgFTET76nTs5R4_L4nOJSMLRMQeK8OlC6-A0Odl9onbq7xJ6wLllcemSaayIvBskU_GXSHe1ysDg4_QgiOe62v-m5QNFctA Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: f42fe97af30047fd999c08abc89dc2ea Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ImagesNegativeTestJSON-925166863 Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f42fe97af30047fd999c08abc89dc2ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f42fe97af30047fd999c08abc89dc2ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f42fe97af30047fd999c08abc89dc2ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f42fe97af30047fd999c08abc89dc2ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ImagesNegativeTestJSON-925166863 Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: f42fe97af30047fd999c08abc89dc2ea Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-925166863 Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ImagesNegativeTestJSON-925166863-project Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 9af06771f33b4bff85a7ec7bb746a44b Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ImagesNegativeTestJSON-925166863-project Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-156947841", "metadata": {"image_type": "test"}}} Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance tempest-invalid-968584419 could not be found. Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'tempest-invalid-968584419', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-156947841', 'metadata': {'image_type': 'test'}}}} Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-968584419 could not be found. Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:30:55.521131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-968584419 could not be found. Oct 05 02:30:55.526438 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.526438 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:55.526438 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.526438 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:55.526438 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:55.526438 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:55.526438 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:30:55.526438 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:30:55.526438 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-968584419 could not be found. Oct 05 02:30:55.526438 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.527910 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c3888d5d-1f99-466a-829a-19b666a2d69f tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Returning 404 to user: Instance tempest-invalid-968584419 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:30:55.528766 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c3888d5d-1f99-466a-829a-19b666a2d69f tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] 10.222.0.16 "POST /compute/v2.1/servers/tempest-invalid-968584419/action" status: 404 len: 100 microversion: 2.1 time: 0.017598 Oct 05 02:30:55.530021 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 510/1018] 10.222.0.16 () {60 vars in 1246 bytes} [Wed Oct 5 02:30:55 2022] POST /compute/v2.1/servers/tempest-invalid-968584419/action => generated 100 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:30:55.530926 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3e551d4e-580f-49c5-bb0d-ac36b302eeaa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1471 microversion: 2.1 time: 0.179096 Oct 05 02:30:55.531923 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 509/1019] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:55 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1471 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:55.543464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-81f3a014-4afa-4ac7-ac9f-6ab05ba75a30 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-352805717"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:55.545855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-81f3a014-4afa-4ac7-ac9f-6ab05ba75a30 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 05 02:30:55.546519 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-81f3a014-4afa-4ac7-ac9f-6ab05ba75a30 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-81f3a014-4afa-4ac7-ac9f-6ab05ba75a30 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Request method failure captured: Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 56 Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOw96xVhGgH4V5BicqMSTu-JInGXv3InAZ791iViv4dFznbqJbj7C90DFJeesO8By_k8HZyYaXLWw2_vVgFTET76nTs5R4_L4nOJSMLRMQeK8OlC6-A0Odl9onbq7xJ6wLllcemSaayIvBskU_GXSHe1ysDg4_QgiOe62v-m5QNFctA Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: f42fe97af30047fd999c08abc89dc2ea Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ImagesNegativeTestJSON-925166863 Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f42fe97af30047fd999c08abc89dc2ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f42fe97af30047fd999c08abc89dc2ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f42fe97af30047fd999c08abc89dc2ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f42fe97af30047fd999c08abc89dc2ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ImagesNegativeTestJSON-925166863 Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: f42fe97af30047fd999c08abc89dc2ea Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-925166863 Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ImagesNegativeTestJSON-925166863-project Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 9af06771f33b4bff85a7ec7bb746a44b Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ImagesNegativeTestJSON-925166863-project Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: {"createImage": {"name": "tempest-test-snap-352805717"}} Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-352805717'}}} Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 05 02:30:55.548922 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.553282 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:55.553282 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.553282 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:55.553282 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:55.553282 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:55.553282 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:30:55.553282 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:30:55.553282 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 05 02:30:55.553282 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.553282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-81f3a014-4afa-4ac7-ac9f-6ab05ba75a30 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:30:55.553282 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-81f3a014-4afa-4ac7-ac9f-6ab05ba75a30 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] 10.222.0.16 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.010750 Oct 05 02:30:55.553282 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 511/1020] 10.222.0.16 () {60 vars in 1275 bytes} [Wed Oct 5 02:30:55 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:30:55.559571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-941c321e-8ae1-4844-8c68-99dfd6e9e5fd tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1433619190"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:55.562380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-941c321e-8ae1-4844-8c68-99dfd6e9e5fd tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 05 02:30:55.563100 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-941c321e-8ae1-4844-8c68-99dfd6e9e5fd tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-941c321e-8ae1-4844-8c68-99dfd6e9e5fd tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Request method failure captured: Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 57 Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOw96xVhGgH4V5BicqMSTu-JInGXv3InAZ791iViv4dFznbqJbj7C90DFJeesO8By_k8HZyYaXLWw2_vVgFTET76nTs5R4_L4nOJSMLRMQeK8OlC6-A0Odl9onbq7xJ6wLllcemSaayIvBskU_GXSHe1ysDg4_QgiOe62v-m5QNFctA Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: f42fe97af30047fd999c08abc89dc2ea Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ImagesNegativeTestJSON-925166863 Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f42fe97af30047fd999c08abc89dc2ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f42fe97af30047fd999c08abc89dc2ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f42fe97af30047fd999c08abc89dc2ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f42fe97af30047fd999c08abc89dc2ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ImagesNegativeTestJSON-925166863 Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: f42fe97af30047fd999c08abc89dc2ea Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-925166863 Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ImagesNegativeTestJSON-925166863-project Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 9af06771f33b4bff85a7ec7bb746a44b Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ImagesNegativeTestJSON-925166863-project Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: {"createImage": {"name": "tempest-test-snap-1433619190"}} Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1433619190'}}} Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 05 02:30:55.564609 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.569512 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:55.569512 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.569512 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:55.569512 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:55.569512 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:55.569512 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:30:55.569512 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:30:55.569512 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 05 02:30:55.569512 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.569512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-941c321e-8ae1-4844-8c68-99dfd6e9e5fd tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:30:55.569512 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-941c321e-8ae1-4844-8c68-99dfd6e9e5fd tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] 10.222.0.16 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.010324 Oct 05 02:30:55.569512 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 510/1021] 10.222.0.16 () {60 vars in 1281 bytes} [Wed Oct 5 02:30:55 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:30:55.575043 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-05ff1177-a26b-4cd8-b0c5-36266dc9a485 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:55.575536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-05ff1177-a26b-4cd8-b0c5-36266dc9a485 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] [instance: e13827ed-384b-43ec-8ba8-d9ab3f96eb6a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:55.582341 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05ff1177-a26b-4cd8-b0c5-36266dc9a485 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:55.582862 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05ff1177-a26b-4cd8-b0c5-36266dc9a485 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:55.583300 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05ff1177-a26b-4cd8-b0c5-36266dc9a485 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:55.583994 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05ff1177-a26b-4cd8-b0c5-36266dc9a485 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:55.584452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05ff1177-a26b-4cd8-b0c5-36266dc9a485 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:55.584877 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05ff1177-a26b-4cd8-b0c5-36266dc9a485 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:55.599187 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-05ff1177-a26b-4cd8-b0c5-36266dc9a485 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] HTTP exception thrown: Instance e13827ed-384b-43ec-8ba8-d9ab3f96eb6a could not be found. Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-05ff1177-a26b-4cd8-b0c5-36266dc9a485 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Request method failure captured: Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a HTTP/1.1 Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOw96xVhGgH4V5BicqMSTu-JInGXv3InAZ791iViv4dFznbqJbj7C90DFJeesO8By_k8HZyYaXLWw2_vVgFTET76nTs5R4_L4nOJSMLRMQeK8OlC6-A0Odl9onbq7xJ6wLllcemSaayIvBskU_GXSHe1ysDg4_QgiOe62v-m5QNFctA Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: f42fe97af30047fd999c08abc89dc2ea Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ImagesNegativeTestJSON-925166863 Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f42fe97af30047fd999c08abc89dc2ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f42fe97af30047fd999c08abc89dc2ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f42fe97af30047fd999c08abc89dc2ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f42fe97af30047fd999c08abc89dc2ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ImagesNegativeTestJSON-925166863 Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: f42fe97af30047fd999c08abc89dc2ea Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-925166863 Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ImagesNegativeTestJSON-925166863-project Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 9af06771f33b4bff85a7ec7bb746a44b Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ImagesNegativeTestJSON-925166863-project Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance e13827ed-384b-43ec-8ba8-d9ab3f96eb6a could not be found. Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'e13827ed-384b-43ec-8ba8-d9ab3f96eb6a'} Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e13827ed-384b-43ec-8ba8-d9ab3f96eb6a could not be found. Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:30:55.600983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:30:55.605717 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e13827ed-384b-43ec-8ba8-d9ab3f96eb6a could not be found. Oct 05 02:30:55.605717 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.605717 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:55.605717 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.605717 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:55.605717 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:55.605717 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:55.605717 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:30:55.605717 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:30:55.605717 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e13827ed-384b-43ec-8ba8-d9ab3f96eb6a could not be found. Oct 05 02:30:55.605717 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.605717 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-05ff1177-a26b-4cd8-b0c5-36266dc9a485 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Returning 404 to user: Instance e13827ed-384b-43ec-8ba8-d9ab3f96eb6a could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:30:55.605717 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-05ff1177-a26b-4cd8-b0c5-36266dc9a485 tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a" status: 404 len: 111 microversion: 2.1 time: 0.031442 Oct 05 02:30:55.605717 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 512/1022] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:30:55 2022] DELETE /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:30:55.611400 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7c5efdb4-8c9e-432c-989e-0e045fdf7b3c tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:55.612004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7c5efdb4-8c9e-432c-989e-0e045fdf7b3c tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] [instance: e13827ed-384b-43ec-8ba8-d9ab3f96eb6a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:55.618606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c5efdb4-8c9e-432c-989e-0e045fdf7b3c tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:55.619085 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c5efdb4-8c9e-432c-989e-0e045fdf7b3c tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:55.619515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c5efdb4-8c9e-432c-989e-0e045fdf7b3c tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:55.620197 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c5efdb4-8c9e-432c-989e-0e045fdf7b3c tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:55.620647 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c5efdb4-8c9e-432c-989e-0e045fdf7b3c tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:55.621101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c5efdb4-8c9e-432c-989e-0e045fdf7b3c tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:55.633815 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-7c5efdb4-8c9e-432c-989e-0e045fdf7b3c tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] HTTP exception thrown: Instance e13827ed-384b-43ec-8ba8-d9ab3f96eb6a could not be found. Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7c5efdb4-8c9e-432c-989e-0e045fdf7b3c tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Request method failure captured: Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a HTTP/1.1 Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOw96xVhGgH4V5BicqMSTu-JInGXv3InAZ791iViv4dFznbqJbj7C90DFJeesO8By_k8HZyYaXLWw2_vVgFTET76nTs5R4_L4nOJSMLRMQeK8OlC6-A0Odl9onbq7xJ6wLllcemSaayIvBskU_GXSHe1ysDg4_QgiOe62v-m5QNFctA Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: f42fe97af30047fd999c08abc89dc2ea Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ImagesNegativeTestJSON-925166863 Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f42fe97af30047fd999c08abc89dc2ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f42fe97af30047fd999c08abc89dc2ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f42fe97af30047fd999c08abc89dc2ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f42fe97af30047fd999c08abc89dc2ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ImagesNegativeTestJSON-925166863 Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: f42fe97af30047fd999c08abc89dc2ea Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-925166863 Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ImagesNegativeTestJSON-925166863-project Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 9af06771f33b4bff85a7ec7bb746a44b Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ImagesNegativeTestJSON-925166863-project Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance e13827ed-384b-43ec-8ba8-d9ab3f96eb6a could not be found. Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'e13827ed-384b-43ec-8ba8-d9ab3f96eb6a'} Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e13827ed-384b-43ec-8ba8-d9ab3f96eb6a could not be found. Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e13827ed-384b-43ec-8ba8-d9ab3f96eb6a could not be found. Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:55.635302 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.640084 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:55.640084 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:55.640084 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:55.640084 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:30:55.640084 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:30:55.640084 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e13827ed-384b-43ec-8ba8-d9ab3f96eb6a could not be found. Oct 05 02:30:55.640084 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:30:55.640084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7c5efdb4-8c9e-432c-989e-0e045fdf7b3c tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] Returning 404 to user: Instance e13827ed-384b-43ec-8ba8-d9ab3f96eb6a could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:30:55.640084 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7c5efdb4-8c9e-432c-989e-0e045fdf7b3c tempest-ImagesNegativeTestJSON-925166863 tempest-ImagesNegativeTestJSON-925166863-project] 10.222.0.16 "GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a" status: 404 len: 111 microversion: 2.1 time: 0.029799 Oct 05 02:30:55.640084 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 511/1023] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:55 2022] GET /compute/v2.1/servers/e13827ed-384b-43ec-8ba8-d9ab3f96eb6a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:30:55.868090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ca477dd9-510b-4351-90ef-99d1378964c4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:55.868631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ca477dd9-510b-4351-90ef-99d1378964c4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:55.874823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca477dd9-510b-4351-90ef-99d1378964c4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:55.875779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca477dd9-510b-4351-90ef-99d1378964c4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:55.876379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca477dd9-510b-4351-90ef-99d1378964c4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:55.877108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca477dd9-510b-4351-90ef-99d1378964c4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:55.877721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca477dd9-510b-4351-90ef-99d1378964c4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:55.878306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca477dd9-510b-4351-90ef-99d1378964c4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:55.882981 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:55.898353 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d887c10c-6bc9-4a6c-8b3e-30820861d815 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:55.899225 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d887c10c-6bc9-4a6c-8b3e-30820861d815 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] [instance: a7434499-a9a4-4c47-a5fe-5ea93c32c0ac] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:55.909014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d887c10c-6bc9-4a6c-8b3e-30820861d815 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:55.910524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d887c10c-6bc9-4a6c-8b3e-30820861d815 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:55.911303 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d887c10c-6bc9-4a6c-8b3e-30820861d815 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:55.912320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d887c10c-6bc9-4a6c-8b3e-30820861d815 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:55.912986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d887c10c-6bc9-4a6c-8b3e-30820861d815 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:55.913751 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d887c10c-6bc9-4a6c-8b3e-30820861d815 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:55.968759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-ca477dd9-510b-4351-90ef-99d1378964c4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lazy-loading 'services' on Instance uuid 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:30:55.990118 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ca477dd9-510b-4351-90ef-99d1378964c4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1927 microversion: 2.75 time: 0.125668 Oct 05 02:30:55.990706 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 513/1024] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:55 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1927 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:55.995297 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-62cfd1ee-ba92-4851-81dd-512d43a4d0d4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:55.995910 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-62cfd1ee-ba92-4851-81dd-512d43a4d0d4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:56.002427 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62cfd1ee-ba92-4851-81dd-512d43a4d0d4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:56.002915 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62cfd1ee-ba92-4851-81dd-512d43a4d0d4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:56.003354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62cfd1ee-ba92-4851-81dd-512d43a4d0d4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:56.004047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62cfd1ee-ba92-4851-81dd-512d43a4d0d4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:56.004502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62cfd1ee-ba92-4851-81dd-512d43a4d0d4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:56.004988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62cfd1ee-ba92-4851-81dd-512d43a4d0d4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:56.117631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-62cfd1ee-ba92-4851-81dd-512d43a4d0d4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:56.125973 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-62cfd1ee-ba92-4851-81dd-512d43a4d0d4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1284 microversion: 2.1 time: 0.134251 Oct 05 02:30:56.126554 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 514/1025] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:55 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:56.189869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d887c10c-6bc9-4a6c-8b3e-30820861d815 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f596b5b1188a4384a2efdafbd08242ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b237b4e2594addbd899828d222aa9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:56.199415 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d887c10c-6bc9-4a6c-8b3e-30820861d815 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] 10.222.0.16 "GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac" status: 200 len: 1526 microversion: 2.1 time: 0.305164 Oct 05 02:30:56.200083 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 512/1026] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:55 2022] GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac => generated 1526 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:30:56.556850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-572a5737-9533-4bd7-b4eb-8154dec28068 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:56.558255 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-572a5737-9533-4bd7-b4eb-8154dec28068 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:56.565627 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-572a5737-9533-4bd7-b4eb-8154dec28068 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:56.566286 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-572a5737-9533-4bd7-b4eb-8154dec28068 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:56.566730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-572a5737-9533-4bd7-b4eb-8154dec28068 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:56.567675 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-572a5737-9533-4bd7-b4eb-8154dec28068 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:56.568369 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-572a5737-9533-4bd7-b4eb-8154dec28068 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:56.568808 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-572a5737-9533-4bd7-b4eb-8154dec28068 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:56.955089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-572a5737-9533-4bd7-b4eb-8154dec28068 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:56.963663 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-572a5737-9533-4bd7-b4eb-8154dec28068 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1471 microversion: 2.1 time: 0.413416 Oct 05 02:30:56.965085 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 515/1027] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:56 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1471 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:57.018392 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e46366f5-dded-46b1-8c55-06971fb03fbc tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:57.019007 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e46366f5-dded-46b1-8c55-06971fb03fbc tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:57.026067 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e46366f5-dded-46b1-8c55-06971fb03fbc tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:57.026631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e46366f5-dded-46b1-8c55-06971fb03fbc tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:57.027213 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e46366f5-dded-46b1-8c55-06971fb03fbc tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:57.028243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e46366f5-dded-46b1-8c55-06971fb03fbc tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:57.028695 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e46366f5-dded-46b1-8c55-06971fb03fbc tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:57.029229 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e46366f5-dded-46b1-8c55-06971fb03fbc tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:57.155882 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2f5852c0-758d-4c78-b4d9-cf7ee8e54171 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:57.156539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2f5852c0-758d-4c78-b4d9-cf7ee8e54171 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:57.163483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f5852c0-758d-4c78-b4d9-cf7ee8e54171 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:57.163979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f5852c0-758d-4c78-b4d9-cf7ee8e54171 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:57.164413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f5852c0-758d-4c78-b4d9-cf7ee8e54171 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:57.165136 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f5852c0-758d-4c78-b4d9-cf7ee8e54171 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:57.165592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f5852c0-758d-4c78-b4d9-cf7ee8e54171 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:57.166015 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f5852c0-758d-4c78-b4d9-cf7ee8e54171 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:57.221340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-e46366f5-dded-46b1-8c55-06971fb03fbc tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lazy-loading 'services' on Instance uuid 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:30:57.240527 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e46366f5-dded-46b1-8c55-06971fb03fbc tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1927 microversion: 2.75 time: 0.227235 Oct 05 02:30:57.241153 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 513/1028] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:57 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1927 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:57.246838 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7226cf21-af5b-4b19-883c-6ec1cd31073b tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:57.248138 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7226cf21-af5b-4b19-883c-6ec1cd31073b tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] [instance: a7434499-a9a4-4c47-a5fe-5ea93c32c0ac] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:57.258256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7226cf21-af5b-4b19-883c-6ec1cd31073b tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:57.259762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7226cf21-af5b-4b19-883c-6ec1cd31073b tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:57.260485 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7226cf21-af5b-4b19-883c-6ec1cd31073b tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:57.261409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7226cf21-af5b-4b19-883c-6ec1cd31073b tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:57.262023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7226cf21-af5b-4b19-883c-6ec1cd31073b tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:57.263100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7226cf21-af5b-4b19-883c-6ec1cd31073b tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:57.291126 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2f5852c0-758d-4c78-b4d9-cf7ee8e54171 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:57.308369 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2f5852c0-758d-4c78-b4d9-cf7ee8e54171 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1290 microversion: 2.1 time: 0.156339 Oct 05 02:30:57.309367 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 516/1029] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:57 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1290 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:57.966256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7226cf21-af5b-4b19-883c-6ec1cd31073b tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f596b5b1188a4384a2efdafbd08242ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b237b4e2594addbd899828d222aa9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:57.968141 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-91593ef7-5dc2-493c-b69e-411368dc3350 req-e5ed78c9-5b99-4aa8-a9d2-69aeb207bc5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7434499-a9a4-4c47-a5fe-5ea93c32c0ac", "name": "network-vif-deleted", "tag": "939a0258-e304-4d51-8be4-5cd608c3ff90"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:30:57.979325 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7226cf21-af5b-4b19-883c-6ec1cd31073b tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] 10.222.0.16 "GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac" status: 200 len: 1526 microversion: 2.1 time: 0.736856 Oct 05 02:30:57.981290 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 514/1030] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:57 2022] GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac => generated 1526 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:57.992743 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-91593ef7-5dc2-493c-b69e-411368dc3350 req-e5ed78c9-5b99-4aa8-a9d2-69aeb207bc5b service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:57.993975 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-91593ef7-5dc2-493c-b69e-411368dc3350 req-e5ed78c9-5b99-4aa8-a9d2-69aeb207bc5b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:57.995825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-91593ef7-5dc2-493c-b69e-411368dc3350 req-e5ed78c9-5b99-4aa8-a9d2-69aeb207bc5b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:57.999648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-34e91d6c-c82f-442e-87bd-3f4827e9d09c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:58.000290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-34e91d6c-c82f-442e-87bd-3f4827e9d09c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:58.023751 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34e91d6c-c82f-442e-87bd-3f4827e9d09c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:58.024461 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34e91d6c-c82f-442e-87bd-3f4827e9d09c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:58.024664 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34e91d6c-c82f-442e-87bd-3f4827e9d09c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:58.027918 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-91593ef7-5dc2-493c-b69e-411368dc3350 req-e5ed78c9-5b99-4aa8-a9d2-69aeb207bc5b service nova] Creating event network-vif-deleted:939a0258-e304-4d51-8be4-5cd608c3ff90 for instance a7434499-a9a4-4c47-a5fe-5ea93c32c0ac on n-h1-858272-3 Oct 05 02:30:58.029852 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34e91d6c-c82f-442e-87bd-3f4827e9d09c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:58.030743 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34e91d6c-c82f-442e-87bd-3f4827e9d09c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:58.031518 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34e91d6c-c82f-442e-87bd-3f4827e9d09c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:58.033950 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-91593ef7-5dc2-493c-b69e-411368dc3350 req-e5ed78c9-5b99-4aa8-a9d2-69aeb207bc5b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069921 Oct 05 02:30:58.035428 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 517/1031] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:30:58.273382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cffa8d07-14be-47aa-b2ec-0aa2dd8c46bf tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:58.274102 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cffa8d07-14be-47aa-b2ec-0aa2dd8c46bf tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:58.281828 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cffa8d07-14be-47aa-b2ec-0aa2dd8c46bf tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:58.282327 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cffa8d07-14be-47aa-b2ec-0aa2dd8c46bf tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:58.282766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cffa8d07-14be-47aa-b2ec-0aa2dd8c46bf tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:58.283469 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cffa8d07-14be-47aa-b2ec-0aa2dd8c46bf tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:58.283926 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cffa8d07-14be-47aa-b2ec-0aa2dd8c46bf tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:58.284350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cffa8d07-14be-47aa-b2ec-0aa2dd8c46bf tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:58.334887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-34e91d6c-c82f-442e-87bd-3f4827e9d09c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:58.347254 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-34e91d6c-c82f-442e-87bd-3f4827e9d09c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1471 microversion: 2.1 time: 0.360770 Oct 05 02:30:58.365467 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 515/1032] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:57 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1471 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:58.374198 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c24cea8d-cb32-4820-92cb-45323c4790b1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:58.376038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c24cea8d-cb32-4820-92cb-45323c4790b1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:58.382834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c24cea8d-cb32-4820-92cb-45323c4790b1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:58.383549 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c24cea8d-cb32-4820-92cb-45323c4790b1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:58.384057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c24cea8d-cb32-4820-92cb-45323c4790b1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:58.384837 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c24cea8d-cb32-4820-92cb-45323c4790b1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:58.385390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c24cea8d-cb32-4820-92cb-45323c4790b1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:58.385887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c24cea8d-cb32-4820-92cb-45323c4790b1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:58.463036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-cffa8d07-14be-47aa-b2ec-0aa2dd8c46bf tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lazy-loading 'services' on Instance uuid 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:30:58.480727 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cffa8d07-14be-47aa-b2ec-0aa2dd8c46bf tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1927 microversion: 2.75 time: 0.212202 Oct 05 02:30:58.481568 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 518/1033] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:58 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1927 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:58.487319 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c24cea8d-cb32-4820-92cb-45323c4790b1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:30:58.496468 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c24cea8d-cb32-4820-92cb-45323c4790b1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1290 microversion: 2.1 time: 0.129814 Oct 05 02:30:58.497424 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 516/1034] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:58 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1290 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:30:59.004517 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-37dac12a-ddc5-4716-b96f-68760bfc9695 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:59.005439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-37dac12a-ddc5-4716-b96f-68760bfc9695 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] [instance: a7434499-a9a4-4c47-a5fe-5ea93c32c0ac] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:59.020940 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37dac12a-ddc5-4716-b96f-68760bfc9695 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:59.022440 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37dac12a-ddc5-4716-b96f-68760bfc9695 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:59.022961 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37dac12a-ddc5-4716-b96f-68760bfc9695 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:59.024767 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37dac12a-ddc5-4716-b96f-68760bfc9695 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:59.026029 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37dac12a-ddc5-4716-b96f-68760bfc9695 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:59.028664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37dac12a-ddc5-4716-b96f-68760bfc9695 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:59.063205 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-37dac12a-ddc5-4716-b96f-68760bfc9695 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] HTTP exception thrown: Instance a7434499-a9a4-4c47-a5fe-5ea93c32c0ac could not be found. Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-37dac12a-ddc5-4716-b96f-68760bfc9695 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Request method failure captured: Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac HTTP/1.1 Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOxCSHVHqcM6UIffohzJiFY0Ng73u9F13NYk9Tnalq9Xo_YeaEvAVfmaUAOY8lBJO9ssZMeYHRyXBjVB4gMj6XX-25M-fvCKdTOZyalegralBrWUlK7Ekg9yBfFBZwTpOEpXSxuQjkOaBd-8uWJaKVElAAICzytiIfjhgwrm43febNo Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 87b237b4e2594addbd899828d222aa9d Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1239393906 Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/87b237b4e2594addbd899828d222aa9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/87b237b4e2594addbd899828d222aa9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/87b237b4e2594addbd899828d222aa9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_87b237b4e2594addbd899828d222aa9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1239393906 Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 87b237b4e2594addbd899828d222aa9d Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1239393906 Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerMetadataNegativeTestJSON-1239393906-project Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: f596b5b1188a4384a2efdafbd08242ba Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1239393906-project Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance a7434499-a9a4-4c47-a5fe-5ea93c32c0ac could not be found. Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'a7434499-a9a4-4c47-a5fe-5ea93c32c0ac'} Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7434499-a9a4-4c47-a5fe-5ea93c32c0ac could not be found. Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7434499-a9a4-4c47-a5fe-5ea93c32c0ac could not be found. Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:59.065110 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:30:59.069013 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:59.069013 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:30:59.069013 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:30:59.069013 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:30:59.069013 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:30:59.069013 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:30:59.069013 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7434499-a9a4-4c47-a5fe-5ea93c32c0ac could not be found. Oct 05 02:30:59.069013 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:30:59.069013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-37dac12a-ddc5-4716-b96f-68760bfc9695 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] Returning 404 to user: Instance a7434499-a9a4-4c47-a5fe-5ea93c32c0ac could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:30:59.069013 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-37dac12a-ddc5-4716-b96f-68760bfc9695 tempest-ServerMetadataNegativeTestJSON-1239393906 tempest-ServerMetadataNegativeTestJSON-1239393906-project] 10.222.0.16 "GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac" status: 404 len: 111 microversion: 2.1 time: 0.067825 Oct 05 02:30:59.071035 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 519/1035] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:58 2022] GET /compute/v2.1/servers/a7434499-a9a4-4c47-a5fe-5ea93c32c0ac => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:30:59.375785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-011527e9-e728-4923-999c-84fb3311abe3 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:59.377095 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-011527e9-e728-4923-999c-84fb3311abe3 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:59.384640 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-011527e9-e728-4923-999c-84fb3311abe3 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:59.385276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-011527e9-e728-4923-999c-84fb3311abe3 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:59.385814 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-011527e9-e728-4923-999c-84fb3311abe3 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:59.386717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-011527e9-e728-4923-999c-84fb3311abe3 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:59.387432 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-011527e9-e728-4923-999c-84fb3311abe3 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:59.388066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-011527e9-e728-4923-999c-84fb3311abe3 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:59.514268 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dea738b6-6ac6-413e-85cd-31ec57f90c3f tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:59.516193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-dea738b6-6ac6-413e-85cd-31ec57f90c3f tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:59.523743 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dea738b6-6ac6-413e-85cd-31ec57f90c3f tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:59.524591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dea738b6-6ac6-413e-85cd-31ec57f90c3f tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:59.525303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dea738b6-6ac6-413e-85cd-31ec57f90c3f tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:59.526165 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dea738b6-6ac6-413e-85cd-31ec57f90c3f tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:59.527210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dea738b6-6ac6-413e-85cd-31ec57f90c3f tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:59.528065 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dea738b6-6ac6-413e-85cd-31ec57f90c3f tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:59.805423 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-dea738b6-6ac6-413e-85cd-31ec57f90c3f tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lazy-loading 'services' on Instance uuid 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:30:59.823848 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-dea738b6-6ac6-413e-85cd-31ec57f90c3f tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1927 microversion: 2.75 time: 0.314019 Oct 05 02:30:59.824591 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 520/1036] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:30:59 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1927 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:30:59.829457 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ad625eed-c868-4a94-b794-928bbe021f7b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:30:59.830174 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ad625eed-c868-4a94-b794-928bbe021f7b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:30:59.835906 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad625eed-c868-4a94-b794-928bbe021f7b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:59.836684 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad625eed-c868-4a94-b794-928bbe021f7b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:59.837332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad625eed-c868-4a94-b794-928bbe021f7b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:30:59.838250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad625eed-c868-4a94-b794-928bbe021f7b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:30:59.838795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad625eed-c868-4a94-b794-928bbe021f7b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:30:59.839434 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad625eed-c868-4a94-b794-928bbe021f7b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:00.078663 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:00.198408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-011527e9-e728-4923-999c-84fb3311abe3 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:00.208477 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-011527e9-e728-4923-999c-84fb3311abe3 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1471 microversion: 2.1 time: 0.836627 Oct 05 02:31:00.226017 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 517/1037] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:59 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1471 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:00.401188 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ad625eed-c868-4a94-b794-928bbe021f7b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:00.420743 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ad625eed-c868-4a94-b794-928bbe021f7b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1358 microversion: 2.1 time: 0.594862 Oct 05 02:31:00.422050 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 521/1038] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:30:59 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1358 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:00.856413 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ced2566a-146d-462d-b265-aad4b310c3f3 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:00.857026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ced2566a-146d-462d-b265-aad4b310c3f3 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:00.864636 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ced2566a-146d-462d-b265-aad4b310c3f3 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:00.865162 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ced2566a-146d-462d-b265-aad4b310c3f3 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:00.865614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ced2566a-146d-462d-b265-aad4b310c3f3 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:00.866297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ced2566a-146d-462d-b265-aad4b310c3f3 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:00.866750 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ced2566a-146d-462d-b265-aad4b310c3f3 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:00.867184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ced2566a-146d-462d-b265-aad4b310c3f3 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:01.088412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-ced2566a-146d-462d-b265-aad4b310c3f3 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lazy-loading 'services' on Instance uuid 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:31:01.106684 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ced2566a-146d-462d-b265-aad4b310c3f3 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1927 microversion: 2.75 time: 0.254409 Oct 05 02:31:01.107311 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 518/1039] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:00 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1927 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:31:01.237972 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-68ab87d9-63da-472a-a53a-8e24f92fbfaa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:01.238913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-68ab87d9-63da-472a-a53a-8e24f92fbfaa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:01.251850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68ab87d9-63da-472a-a53a-8e24f92fbfaa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:01.252618 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68ab87d9-63da-472a-a53a-8e24f92fbfaa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:01.256487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68ab87d9-63da-472a-a53a-8e24f92fbfaa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:01.257442 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68ab87d9-63da-472a-a53a-8e24f92fbfaa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:01.257909 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68ab87d9-63da-472a-a53a-8e24f92fbfaa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:01.258340 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68ab87d9-63da-472a-a53a-8e24f92fbfaa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:01.444503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9e146ac8-4f36-4f42-bc6f-06e300726f2f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:01.445914 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9e146ac8-4f36-4f42-bc6f-06e300726f2f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:01.451959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:01.454248 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e146ac8-4f36-4f42-bc6f-06e300726f2f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:01.454908 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e146ac8-4f36-4f42-bc6f-06e300726f2f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:01.455647 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e146ac8-4f36-4f42-bc6f-06e300726f2f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:01.456500 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e146ac8-4f36-4f42-bc6f-06e300726f2f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:01.457954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e146ac8-4f36-4f42-bc6f-06e300726f2f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:01.458563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e146ac8-4f36-4f42-bc6f-06e300726f2f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:01.754547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-68ab87d9-63da-472a-a53a-8e24f92fbfaa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:01.763836 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-68ab87d9-63da-472a-a53a-8e24f92fbfaa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1471 microversion: 2.1 time: 0.530758 Oct 05 02:31:01.764602 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 522/1040] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:01 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1471 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:01.849361 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9e146ac8-4f36-4f42-bc6f-06e300726f2f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:01.859431 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9e146ac8-4f36-4f42-bc6f-06e300726f2f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1358 microversion: 2.1 time: 0.418172 Oct 05 02:31:01.860981 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 519/1041] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:01 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1358 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:31:01.975494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-24cda15c-ca3c-410a-8352-a5187ec2ad22 req-3518880c-8ef1-437f-bbb6-e08fb5018a16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a19871a-12bc-45d8-ad01-489ad68f1e00", "tag": "c4608021-f3cf-466d-92f8-ca22a3a9526d"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:01.991081 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-24cda15c-ca3c-410a-8352-a5187ec2ad22 req-3518880c-8ef1-437f-bbb6-e08fb5018a16 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:01.991081 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-24cda15c-ca3c-410a-8352-a5187ec2ad22 req-3518880c-8ef1-437f-bbb6-e08fb5018a16 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:01.991081 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-24cda15c-ca3c-410a-8352-a5187ec2ad22 req-3518880c-8ef1-437f-bbb6-e08fb5018a16 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:02.002532 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-24cda15c-ca3c-410a-8352-a5187ec2ad22 req-3518880c-8ef1-437f-bbb6-e08fb5018a16 service nova] Creating event network-changed:c4608021-f3cf-466d-92f8-ca22a3a9526d for instance 9a19871a-12bc-45d8-ad01-489ad68f1e00 on n-h1-858272-3 Oct 05 02:31:02.007874 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-24cda15c-ca3c-410a-8352-a5187ec2ad22 req-3518880c-8ef1-437f-bbb6-e08fb5018a16 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040593 Oct 05 02:31:02.008482 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 523/1042] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:31:02.135201 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d4c3dbf9-b684-49c4-986f-a4309adede22 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:02.135840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d4c3dbf9-b684-49c4-986f-a4309adede22 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:02.144305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4c3dbf9-b684-49c4-986f-a4309adede22 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:02.145060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4c3dbf9-b684-49c4-986f-a4309adede22 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:02.145501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4c3dbf9-b684-49c4-986f-a4309adede22 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:02.146192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4c3dbf9-b684-49c4-986f-a4309adede22 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:02.146672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4c3dbf9-b684-49c4-986f-a4309adede22 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:02.147090 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4c3dbf9-b684-49c4-986f-a4309adede22 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:02.258228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-d4c3dbf9-b684-49c4-986f-a4309adede22 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lazy-loading 'services' on Instance uuid 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:31:02.282608 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d4c3dbf9-b684-49c4-986f-a4309adede22 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1927 microversion: 2.75 time: 0.151635 Oct 05 02:31:02.283205 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 520/1043] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:02 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1927 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:31:02.787536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4a9284ce-fc0e-48e6-be97-82b42231f2c4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:02.788564 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4a9284ce-fc0e-48e6-be97-82b42231f2c4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:02.798995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a9284ce-fc0e-48e6-be97-82b42231f2c4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:02.799857 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a9284ce-fc0e-48e6-be97-82b42231f2c4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:02.800664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a9284ce-fc0e-48e6-be97-82b42231f2c4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:02.801643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a9284ce-fc0e-48e6-be97-82b42231f2c4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:02.802361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a9284ce-fc0e-48e6-be97-82b42231f2c4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:02.803265 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a9284ce-fc0e-48e6-be97-82b42231f2c4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:02.883587 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-57dcd0ab-68fc-45ab-a1bf-d7b6ea6db04f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:02.884980 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-57dcd0ab-68fc-45ab-a1bf-d7b6ea6db04f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:02.892101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57dcd0ab-68fc-45ab-a1bf-d7b6ea6db04f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:02.892806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57dcd0ab-68fc-45ab-a1bf-d7b6ea6db04f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:02.893630 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57dcd0ab-68fc-45ab-a1bf-d7b6ea6db04f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:02.894408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57dcd0ab-68fc-45ab-a1bf-d7b6ea6db04f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:02.895223 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57dcd0ab-68fc-45ab-a1bf-d7b6ea6db04f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:02.895868 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57dcd0ab-68fc-45ab-a1bf-d7b6ea6db04f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:03.029410 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4a9284ce-fc0e-48e6-be97-82b42231f2c4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:03.046895 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4a9284ce-fc0e-48e6-be97-82b42231f2c4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1471 microversion: 2.1 time: 0.260074 Oct 05 02:31:03.060934 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 524/1044] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:02 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1471 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:03.175171 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-57dcd0ab-68fc-45ab-a1bf-d7b6ea6db04f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:03.185344 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-57dcd0ab-68fc-45ab-a1bf-d7b6ea6db04f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1358 microversion: 2.1 time: 0.306130 Oct 05 02:31:03.203312 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 521/1045] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:02 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1358 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:03.312225 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9351d959-8c02-4780-ae4d-f3a86f3c97b1 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:03.313172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9351d959-8c02-4780-ae4d-f3a86f3c97b1 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:03.320028 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9351d959-8c02-4780-ae4d-f3a86f3c97b1 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:03.320885 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9351d959-8c02-4780-ae4d-f3a86f3c97b1 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:03.322424 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9351d959-8c02-4780-ae4d-f3a86f3c97b1 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:03.323391 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9351d959-8c02-4780-ae4d-f3a86f3c97b1 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:03.324194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9351d959-8c02-4780-ae4d-f3a86f3c97b1 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:03.324872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9351d959-8c02-4780-ae4d-f3a86f3c97b1 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:03.424992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-9351d959-8c02-4780-ae4d-f3a86f3c97b1 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lazy-loading 'services' on Instance uuid 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:31:03.475808 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9351d959-8c02-4780-ae4d-f3a86f3c97b1 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1927 microversion: 2.75 time: 0.168003 Oct 05 02:31:03.481381 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 525/1046] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:03 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1927 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:31:04.074592 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7d5c9591-380f-4537-8571-1340972e0f90 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:04.075131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7d5c9591-380f-4537-8571-1340972e0f90 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:04.086476 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=8 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:04.087227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=14 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:04.092133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7d5c9591-380f-4537-8571-1340972e0f90 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:04.093579 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7d5c9591-380f-4537-8571-1340972e0f90 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:04.094222 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7d5c9591-380f-4537-8571-1340972e0f90 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:04.096352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7d5c9591-380f-4537-8571-1340972e0f90 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:04.096770 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7d5c9591-380f-4537-8571-1340972e0f90 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:04.098787 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7d5c9591-380f-4537-8571-1340972e0f90 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:04.211941 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8374d93c-9033-4ea8-9a94-704a0f671603 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:04.213580 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8374d93c-9033-4ea8-9a94-704a0f671603 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:04.215851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=10 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:04.217930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:04.227971 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8374d93c-9033-4ea8-9a94-704a0f671603 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:04.228791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8374d93c-9033-4ea8-9a94-704a0f671603 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:04.229366 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8374d93c-9033-4ea8-9a94-704a0f671603 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:04.230243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8374d93c-9033-4ea8-9a94-704a0f671603 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:04.230900 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8374d93c-9033-4ea8-9a94-704a0f671603 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:04.231553 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8374d93c-9033-4ea8-9a94-704a0f671603 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:04.511393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7d5c9591-380f-4537-8571-1340972e0f90 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:04.535929 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7d5c9591-380f-4537-8571-1340972e0f90 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1471 microversion: 2.1 time: 0.465598 Oct 05 02:31:04.552707 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 522/1047] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:04 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1471 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:04.562092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d5349e04-8ef1-4fc2-9604-d60fd8bf4a7c tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:04.563572 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d5349e04-8ef1-4fc2-9604-d60fd8bf4a7c tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:04.571544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5349e04-8ef1-4fc2-9604-d60fd8bf4a7c tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:04.572325 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5349e04-8ef1-4fc2-9604-d60fd8bf4a7c tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:04.573532 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5349e04-8ef1-4fc2-9604-d60fd8bf4a7c tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:04.574843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5349e04-8ef1-4fc2-9604-d60fd8bf4a7c tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:04.575669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5349e04-8ef1-4fc2-9604-d60fd8bf4a7c tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:04.576290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5349e04-8ef1-4fc2-9604-d60fd8bf4a7c tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:04.609128 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8374d93c-9033-4ea8-9a94-704a0f671603 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:04.617876 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8374d93c-9033-4ea8-9a94-704a0f671603 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1358 microversion: 2.1 time: 0.410084 Oct 05 02:31:04.618816 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 526/1048] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:04 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1358 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:04.659419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-d5349e04-8ef1-4fc2-9604-d60fd8bf4a7c tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lazy-loading 'services' on Instance uuid 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:31:04.676883 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d5349e04-8ef1-4fc2-9604-d60fd8bf4a7c tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1927 microversion: 2.75 time: 0.122866 Oct 05 02:31:04.677502 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 523/1049] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:04 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1927 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:31:05.568933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1478e251-cc14-429e-ba56-c5100f4ca147 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:05.569546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1478e251-cc14-429e-ba56-c5100f4ca147 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:05.586216 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1478e251-cc14-429e-ba56-c5100f4ca147 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:05.586733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1478e251-cc14-429e-ba56-c5100f4ca147 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:05.587181 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1478e251-cc14-429e-ba56-c5100f4ca147 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:05.587914 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1478e251-cc14-429e-ba56-c5100f4ca147 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:05.588665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1478e251-cc14-429e-ba56-c5100f4ca147 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:05.589137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1478e251-cc14-429e-ba56-c5100f4ca147 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:05.643028 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-54da4613-5836-446c-bc88-62c1da411a4e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:05.643650 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-54da4613-5836-446c-bc88-62c1da411a4e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:05.654659 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54da4613-5836-446c-bc88-62c1da411a4e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:05.655970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54da4613-5836-446c-bc88-62c1da411a4e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:05.663695 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54da4613-5836-446c-bc88-62c1da411a4e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:05.664491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54da4613-5836-446c-bc88-62c1da411a4e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:05.671850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54da4613-5836-446c-bc88-62c1da411a4e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:05.672624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54da4613-5836-446c-bc88-62c1da411a4e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:06.137390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1478e251-cc14-429e-ba56-c5100f4ca147 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:06.152168 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1478e251-cc14-429e-ba56-c5100f4ca147 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1471 microversion: 2.1 time: 0.587794 Oct 05 02:31:06.153145 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 527/1050] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:05 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1471 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:06.163187 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8a968dfa-ab05-4155-8630-fcd24e631e99 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:06.166916 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8a968dfa-ab05-4155-8630-fcd24e631e99 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:06.183960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a968dfa-ab05-4155-8630-fcd24e631e99 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:06.185437 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a968dfa-ab05-4155-8630-fcd24e631e99 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:06.191305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a968dfa-ab05-4155-8630-fcd24e631e99 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:06.194517 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a968dfa-ab05-4155-8630-fcd24e631e99 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:06.197066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a968dfa-ab05-4155-8630-fcd24e631e99 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:06.197830 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a968dfa-ab05-4155-8630-fcd24e631e99 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:06.286183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-54da4613-5836-446c-bc88-62c1da411a4e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:06.288390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:06.300965 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-54da4613-5836-446c-bc88-62c1da411a4e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1358 microversion: 2.1 time: 0.663181 Oct 05 02:31:06.302046 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 524/1051] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:05 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1358 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:06.510946 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-8a968dfa-ab05-4155-8630-fcd24e631e99 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lazy-loading 'services' on Instance uuid 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:31:06.564370 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8a968dfa-ab05-4155-8630-fcd24e631e99 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1927 microversion: 2.75 time: 0.406883 Oct 05 02:31:06.565061 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 528/1052] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:06 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1927 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:31:07.178234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e7f7e245-754b-4145-b837-9eab89619a0d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:07.179687 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e7f7e245-754b-4145-b837-9eab89619a0d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:07.198441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7f7e245-754b-4145-b837-9eab89619a0d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:07.199656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7f7e245-754b-4145-b837-9eab89619a0d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:07.200514 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7f7e245-754b-4145-b837-9eab89619a0d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:07.201548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7f7e245-754b-4145-b837-9eab89619a0d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:07.205432 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7f7e245-754b-4145-b837-9eab89619a0d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:07.205950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7f7e245-754b-4145-b837-9eab89619a0d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:07.384947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-785a594e-4c25-49b1-b36d-70a4f9f1753d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:07.386844 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-785a594e-4c25-49b1-b36d-70a4f9f1753d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:07.404656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-785a594e-4c25-49b1-b36d-70a4f9f1753d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:07.407430 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-785a594e-4c25-49b1-b36d-70a4f9f1753d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:07.409205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-785a594e-4c25-49b1-b36d-70a4f9f1753d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:07.410576 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-785a594e-4c25-49b1-b36d-70a4f9f1753d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:07.412029 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-785a594e-4c25-49b1-b36d-70a4f9f1753d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:07.412671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-785a594e-4c25-49b1-b36d-70a4f9f1753d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:07.555957 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e7f7e245-754b-4145-b837-9eab89619a0d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:07.565800 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e7f7e245-754b-4145-b837-9eab89619a0d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1477 microversion: 2.1 time: 0.391934 Oct 05 02:31:07.573425 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 525/1053] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:07 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1477 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:07.599706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1dcc0607-8a8c-44fc-a9ce-9f98a3e8fb17 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:07.600567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1dcc0607-8a8c-44fc-a9ce-9f98a3e8fb17 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:07.610824 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1dcc0607-8a8c-44fc-a9ce-9f98a3e8fb17 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:07.611332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1dcc0607-8a8c-44fc-a9ce-9f98a3e8fb17 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:07.611766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1dcc0607-8a8c-44fc-a9ce-9f98a3e8fb17 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:07.612473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1dcc0607-8a8c-44fc-a9ce-9f98a3e8fb17 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:07.612946 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1dcc0607-8a8c-44fc-a9ce-9f98a3e8fb17 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:07.613367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1dcc0607-8a8c-44fc-a9ce-9f98a3e8fb17 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:07.734595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-1dcc0607-8a8c-44fc-a9ce-9f98a3e8fb17 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lazy-loading 'services' on Instance uuid 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:31:07.744858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-785a594e-4c25-49b1-b36d-70a4f9f1753d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:07.753940 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-785a594e-4c25-49b1-b36d-70a4f9f1753d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1358 microversion: 2.1 time: 0.427013 Oct 05 02:31:07.754408 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 529/1054] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:07 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1358 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:31:07.757140 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1dcc0607-8a8c-44fc-a9ce-9f98a3e8fb17 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1927 microversion: 2.75 time: 0.160965 Oct 05 02:31:07.758161 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 526/1055] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:07 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1927 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:31:08.606477 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4b597319-9539-40a1-82ac-56e56df5938a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:08.608890 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4b597319-9539-40a1-82ac-56e56df5938a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:08.625697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b597319-9539-40a1-82ac-56e56df5938a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:08.626769 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b597319-9539-40a1-82ac-56e56df5938a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:08.627309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b597319-9539-40a1-82ac-56e56df5938a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:08.628227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b597319-9539-40a1-82ac-56e56df5938a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:08.629120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b597319-9539-40a1-82ac-56e56df5938a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:08.629955 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b597319-9539-40a1-82ac-56e56df5938a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:08.709472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-190d0642-ead4-4ecb-bf35-cc9a101ce0aa tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Action: 'create', calling method: .version_select at 0x7fcce428ba60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2136439050", "description": "tempest-description-197680155"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:08.851607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4b597319-9539-40a1-82ac-56e56df5938a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:08.861181 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4b597319-9539-40a1-82ac-56e56df5938a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1477 microversion: 2.1 time: 0.258813 Oct 05 02:31:08.865038 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 527/1056] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:08 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1477 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:31:08.867553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1ad81ebb-ee4d-4a1c-bf71-386c6e1964bc tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:08.868172 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1ad81ebb-ee4d-4a1c-bf71-386c6e1964bc tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:08.874983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1ad81ebb-ee4d-4a1c-bf71-386c6e1964bc tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:08.875737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1ad81ebb-ee4d-4a1c-bf71-386c6e1964bc tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:08.876847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1ad81ebb-ee4d-4a1c-bf71-386c6e1964bc tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:08.877982 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1ad81ebb-ee4d-4a1c-bf71-386c6e1964bc tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:08.878772 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1ad81ebb-ee4d-4a1c-bf71-386c6e1964bc tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:08.879388 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1ad81ebb-ee4d-4a1c-bf71-386c6e1964bc tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:09.041330 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-190d0642-ead4-4ecb-bf35-cc9a101ce0aa tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.499307 Oct 05 02:31:09.050945 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 530/1057] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 5 02:31:08 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:31:09.056888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8706f345-8ca7-42ea-a04d-b1fd84b03c31 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:09.057617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8706f345-8ca7-42ea-a04d-b1fd84b03c31 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:09.064817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8706f345-8ca7-42ea-a04d-b1fd84b03c31 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:09.065724 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8706f345-8ca7-42ea-a04d-b1fd84b03c31 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:09.066433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8706f345-8ca7-42ea-a04d-b1fd84b03c31 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:09.067412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8706f345-8ca7-42ea-a04d-b1fd84b03c31 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:09.068091 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8706f345-8ca7-42ea-a04d-b1fd84b03c31 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:09.068765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8706f345-8ca7-42ea-a04d-b1fd84b03c31 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:09.074325 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:09.102618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1ad81ebb-ee4d-4a1c-bf71-386c6e1964bc tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:09.110908 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1ad81ebb-ee4d-4a1c-bf71-386c6e1964bc tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1358 microversion: 2.1 time: 0.247738 Oct 05 02:31:09.111633 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 528/1058] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:08 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:09.120736 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b9c921fa-db80-446f-ba91-56834b40fc37 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Action: 'create', calling method: .version_select at 0x7fccdfd9aa60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1050756724", "description": "tempest-description-830169698"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:09.190723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-8706f345-8ca7-42ea-a04d-b1fd84b03c31 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lazy-loading 'services' on Instance uuid 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:31:09.222440 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8706f345-8ca7-42ea-a04d-b1fd84b03c31 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1927 microversion: 2.75 time: 0.170002 Oct 05 02:31:09.223522 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 531/1059] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:09 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1927 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:31:09.332560 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b9c921fa-db80-446f-ba91-56834b40fc37 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.219135 Oct 05 02:31:09.333301 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 529/1060] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 5 02:31:09 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:31:09.397090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-910ac0af-09c5-41e8-944e-cb682e527bce tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1533106907", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "eb593e91-e5cb-4403-86c7-15b9bfd37416"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:09.485290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-910ac0af-09c5-41e8-944e-cb682e527bce tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] validate_networks() for [('eb593e91-e5cb-4403-86c7-15b9bfd37416', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:31:09.893221 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-29ac1d57-2a37-4405-a819-6049a8171cb9 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:09.897862 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-29ac1d57-2a37-4405-a819-6049a8171cb9 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:09.926530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29ac1d57-2a37-4405-a819-6049a8171cb9 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:09.927856 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29ac1d57-2a37-4405-a819-6049a8171cb9 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:09.928472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29ac1d57-2a37-4405-a819-6049a8171cb9 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:09.929403 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29ac1d57-2a37-4405-a819-6049a8171cb9 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:09.930602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29ac1d57-2a37-4405-a819-6049a8171cb9 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:09.931209 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29ac1d57-2a37-4405-a819-6049a8171cb9 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:09.942582 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-910ac0af-09c5-41e8-944e-cb682e527bce tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:31:09.943663 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-910ac0af-09c5-41e8-944e-cb682e527bce tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:31:09.944190 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-910ac0af-09c5-41e8-944e-cb682e527bce tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:31:09.944598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-910ac0af-09c5-41e8-944e-cb682e527bce tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:31:09.945343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-910ac0af-09c5-41e8-944e-cb682e527bce tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:31:09.960517 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-910ac0af-09c5-41e8-944e-cb682e527bce tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:09.961143 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-910ac0af-09c5-41e8-944e-cb682e527bce tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:09.961650 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-910ac0af-09c5-41e8-944e-cb682e527bce tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:09.963093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-910ac0af-09c5-41e8-944e-cb682e527bce tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:09.963636 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-910ac0af-09c5-41e8-944e-cb682e527bce tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:09.964150 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-910ac0af-09c5-41e8-944e-cb682e527bce tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:09.994250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-910ac0af-09c5-41e8-944e-cb682e527bce tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Getting quotas for project c96108fae56640b6aa0cb68523504c43. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:31:10.004594 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-910ac0af-09c5-41e8-944e-cb682e527bce tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Getting quotas for user 9925b3a9a63c4b1cb98a8adcc28f916d and project c96108fae56640b6aa0cb68523504c43. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:31:10.022195 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-910ac0af-09c5-41e8-944e-cb682e527bce tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:31:10.026838 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-910ac0af-09c5-41e8-944e-cb682e527bce tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: a9c9522c-a640-49f4-9cb9-0dcf19eea103] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:31:10.090931 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-910ac0af-09c5-41e8-944e-cb682e527bce tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.701312 Oct 05 02:31:10.091648 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 532/1061] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:31:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:31:10.103765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f59e2986-bd44-4cfd-9eb7-41a25aa2ddf9 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:10.104654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f59e2986-bd44-4cfd-9eb7-41a25aa2ddf9 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: a9c9522c-a640-49f4-9cb9-0dcf19eea103] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:10.150781 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-29ac1d57-2a37-4405-a819-6049a8171cb9 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:10.162834 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-29ac1d57-2a37-4405-a819-6049a8171cb9 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1477 microversion: 2.1 time: 0.280743 Oct 05 02:31:10.178468 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 530/1062] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:09 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1477 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:10.183991 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f59e2986-bd44-4cfd-9eb7-41a25aa2ddf9 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:10.194373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-91c6290a-82d7-472f-896f-622973928028 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:10.194589 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f59e2986-bd44-4cfd-9eb7-41a25aa2ddf9 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103" status: 200 len: 1216 microversion: 2.1 time: 0.094751 Oct 05 02:31:10.195191 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 533/1063] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:10 2022] GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103 => generated 1216 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:10.203221 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-91c6290a-82d7-472f-896f-622973928028 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:10.213494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91c6290a-82d7-472f-896f-622973928028 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:10.213984 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91c6290a-82d7-472f-896f-622973928028 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:10.214413 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91c6290a-82d7-472f-896f-622973928028 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:10.215097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91c6290a-82d7-472f-896f-622973928028 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:10.215726 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91c6290a-82d7-472f-896f-622973928028 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:10.216299 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91c6290a-82d7-472f-896f-622973928028 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:10.252839 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8cc8c491-a897-4d57-9d79-4678281e6d38 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:10.253678 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8cc8c491-a897-4d57-9d79-4678281e6d38 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:10.264799 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cc8c491-a897-4d57-9d79-4678281e6d38 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:10.266770 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cc8c491-a897-4d57-9d79-4678281e6d38 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:10.268976 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cc8c491-a897-4d57-9d79-4678281e6d38 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:10.272586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cc8c491-a897-4d57-9d79-4678281e6d38 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:10.275135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cc8c491-a897-4d57-9d79-4678281e6d38 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:10.275537 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cc8c491-a897-4d57-9d79-4678281e6d38 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:10.459476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-8cc8c491-a897-4d57-9d79-4678281e6d38 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lazy-loading 'services' on Instance uuid 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:31:10.506986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-91c6290a-82d7-472f-896f-622973928028 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:10.507165 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8cc8c491-a897-4d57-9d79-4678281e6d38 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1927 microversion: 2.75 time: 0.259484 Oct 05 02:31:10.509379 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 534/1064] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:10 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1927 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:31:10.518671 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-91c6290a-82d7-472f-896f-622973928028 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1358 microversion: 2.1 time: 0.338653 Oct 05 02:31:10.530842 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 531/1065] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:10 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1358 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:11.071305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-c39907d4-9ef3-4297-a68e-e7edd6cd0bc3 req-5d989011-271a-4888-b59e-1ebbe159bae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a19871a-12bc-45d8-ad01-489ad68f1e00", "name": "network-vif-plugged", "status": "completed", "tag": "c4608021-f3cf-466d-92f8-ca22a3a9526d"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:11.094796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c39907d4-9ef3-4297-a68e-e7edd6cd0bc3 req-5d989011-271a-4888-b59e-1ebbe159bae2 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:11.095944 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c39907d4-9ef3-4297-a68e-e7edd6cd0bc3 req-5d989011-271a-4888-b59e-1ebbe159bae2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:11.096894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c39907d4-9ef3-4297-a68e-e7edd6cd0bc3 req-5d989011-271a-4888-b59e-1ebbe159bae2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:11.110838 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-c39907d4-9ef3-4297-a68e-e7edd6cd0bc3 req-5d989011-271a-4888-b59e-1ebbe159bae2 service nova] Creating event network-vif-plugged:c4608021-f3cf-466d-92f8-ca22a3a9526d for instance 9a19871a-12bc-45d8-ad01-489ad68f1e00 on n-h1-858272-3 Oct 05 02:31:11.117380 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-c39907d4-9ef3-4297-a68e-e7edd6cd0bc3 req-5d989011-271a-4888-b59e-1ebbe159bae2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050253 Oct 05 02:31:11.119479 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 535/1066] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:31:11.196354 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1d865f81-caa8-42f5-8c69-bf02faadfae4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:11.197146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1d865f81-caa8-42f5-8c69-bf02faadfae4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:11.222039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f133d480-d191-4002-93b3-58d113ad631e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:11.225468 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f133d480-d191-4002-93b3-58d113ad631e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: a9c9522c-a640-49f4-9cb9-0dcf19eea103] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:11.234243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d865f81-caa8-42f5-8c69-bf02faadfae4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:11.237925 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d865f81-caa8-42f5-8c69-bf02faadfae4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:11.240058 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d865f81-caa8-42f5-8c69-bf02faadfae4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:11.240875 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d865f81-caa8-42f5-8c69-bf02faadfae4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:11.243256 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f133d480-d191-4002-93b3-58d113ad631e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:11.245516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d865f81-caa8-42f5-8c69-bf02faadfae4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:11.246724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d865f81-caa8-42f5-8c69-bf02faadfae4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:11.246966 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f133d480-d191-4002-93b3-58d113ad631e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:11.247597 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f133d480-d191-4002-93b3-58d113ad631e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:11.250317 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f133d480-d191-4002-93b3-58d113ad631e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:11.252464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f133d480-d191-4002-93b3-58d113ad631e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:11.254191 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f133d480-d191-4002-93b3-58d113ad631e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:11.479045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f133d480-d191-4002-93b3-58d113ad631e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:11.495741 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f133d480-d191-4002-93b3-58d113ad631e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103" status: 200 len: 1268 microversion: 2.1 time: 0.282519 Oct 05 02:31:11.505381 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 536/1067] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:11 2022] GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103 => generated 1268 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:11.543609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fa5eb6af-7d33-4c31-902c-2916dee1edd9 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:11.544062 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fa5eb6af-7d33-4c31-902c-2916dee1edd9 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:11.560817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa5eb6af-7d33-4c31-902c-2916dee1edd9 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:11.561905 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa5eb6af-7d33-4c31-902c-2916dee1edd9 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:11.562768 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa5eb6af-7d33-4c31-902c-2916dee1edd9 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:11.563209 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa5eb6af-7d33-4c31-902c-2916dee1edd9 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:11.568285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa5eb6af-7d33-4c31-902c-2916dee1edd9 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:11.568873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa5eb6af-7d33-4c31-902c-2916dee1edd9 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:11.600614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1d865f81-caa8-42f5-8c69-bf02faadfae4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:11.615804 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1d865f81-caa8-42f5-8c69-bf02faadfae4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1477 microversion: 2.1 time: 0.427364 Oct 05 02:31:11.626261 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 532/1068] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:11 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1477 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:31:11.638854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2621794b-bd14-4033-88be-0013e753c6ff tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:11.639552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2621794b-bd14-4033-88be-0013e753c6ff tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:11.683974 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2621794b-bd14-4033-88be-0013e753c6ff tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:11.684493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2621794b-bd14-4033-88be-0013e753c6ff tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:11.684995 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2621794b-bd14-4033-88be-0013e753c6ff tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:11.685722 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2621794b-bd14-4033-88be-0013e753c6ff tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:11.686183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2621794b-bd14-4033-88be-0013e753c6ff tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:11.687285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2621794b-bd14-4033-88be-0013e753c6ff tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:11.690868 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-fa5eb6af-7d33-4c31-902c-2916dee1edd9 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lazy-loading 'services' on Instance uuid 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:31:11.727985 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fa5eb6af-7d33-4c31-902c-2916dee1edd9 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1927 microversion: 2.75 time: 0.195836 Oct 05 02:31:11.728664 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 537/1069] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:11 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1927 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:31:11.966331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2621794b-bd14-4033-88be-0013e753c6ff tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:11.980829 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2621794b-bd14-4033-88be-0013e753c6ff tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1358 microversion: 2.1 time: 0.348950 Oct 05 02:31:11.990732 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 533/1070] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:11 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1358 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:12.525303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c13e1069-e078-4a6b-97aa-12412fe113de tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:12.525918 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c13e1069-e078-4a6b-97aa-12412fe113de tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: a9c9522c-a640-49f4-9cb9-0dcf19eea103] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:12.544209 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c13e1069-e078-4a6b-97aa-12412fe113de tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:12.545029 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c13e1069-e078-4a6b-97aa-12412fe113de tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:12.545641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c13e1069-e078-4a6b-97aa-12412fe113de tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:12.547024 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c13e1069-e078-4a6b-97aa-12412fe113de tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:12.547633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c13e1069-e078-4a6b-97aa-12412fe113de tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:12.548215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c13e1069-e078-4a6b-97aa-12412fe113de tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:12.659290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a2fe62dc-c018-4530-929d-281214a845d7 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:12.660158 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a2fe62dc-c018-4530-929d-281214a845d7 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:12.678491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2fe62dc-c018-4530-929d-281214a845d7 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:12.680169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2fe62dc-c018-4530-929d-281214a845d7 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:12.681509 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2fe62dc-c018-4530-929d-281214a845d7 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:12.682276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2fe62dc-c018-4530-929d-281214a845d7 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:12.684834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2fe62dc-c018-4530-929d-281214a845d7 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:12.687745 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2fe62dc-c018-4530-929d-281214a845d7 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:12.968994 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c13e1069-e078-4a6b-97aa-12412fe113de tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:12.978810 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c13e1069-e078-4a6b-97aa-12412fe113de tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103" status: 200 len: 1274 microversion: 2.1 time: 0.457290 Oct 05 02:31:12.979447 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 538/1071] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:12 2022] GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103 => generated 1274 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:13.002442 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1ff57bcc-c843-4e35-929a-421d9a13ea93 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:13.010129 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1ff57bcc-c843-4e35-929a-421d9a13ea93 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:13.023261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ff57bcc-c843-4e35-929a-421d9a13ea93 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:13.023984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ff57bcc-c843-4e35-929a-421d9a13ea93 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:13.024577 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ff57bcc-c843-4e35-929a-421d9a13ea93 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:13.025495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ff57bcc-c843-4e35-929a-421d9a13ea93 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:13.027749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ff57bcc-c843-4e35-929a-421d9a13ea93 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:13.037609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ff57bcc-c843-4e35-929a-421d9a13ea93 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:13.183338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a2fe62dc-c018-4530-929d-281214a845d7 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:13.196242 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a2fe62dc-c018-4530-929d-281214a845d7 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1477 microversion: 2.1 time: 0.546343 Oct 05 02:31:13.198086 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 534/1072] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:12 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1477 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:31:13.199059 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-1ff57bcc-c843-4e35-929a-421d9a13ea93 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lazy-loading 'services' on Instance uuid 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:31:13.214294 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a226bc0b-1070-4c64-ac01-bc93de325cc7 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:13.216231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a226bc0b-1070-4c64-ac01-bc93de325cc7 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:13.254300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a226bc0b-1070-4c64-ac01-bc93de325cc7 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:13.255300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a226bc0b-1070-4c64-ac01-bc93de325cc7 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:13.255976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a226bc0b-1070-4c64-ac01-bc93de325cc7 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:13.257147 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a226bc0b-1070-4c64-ac01-bc93de325cc7 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:13.257747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a226bc0b-1070-4c64-ac01-bc93de325cc7 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:13.263207 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1ff57bcc-c843-4e35-929a-421d9a13ea93 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1927 microversion: 2.75 time: 0.262103 Oct 05 02:31:13.263598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a226bc0b-1070-4c64-ac01-bc93de325cc7 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:13.268413 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 539/1073] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:12 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1927 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:31:13.273557 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-46dd1183-707a-4106-94f4-3987c777b445 req-cfe20847-ebb9-49d2-acf6-bd7cedec5df4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "861e3da3-98a1-4728-b218-322c9db128b3", "name": "network-vif-unplugged", "status": "completed", "tag": "1414377b-0304-4553-b209-c5c3a5855cea"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:13.311702 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-46dd1183-707a-4106-94f4-3987c777b445 req-cfe20847-ebb9-49d2-acf6-bd7cedec5df4 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:13.313120 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-46dd1183-707a-4106-94f4-3987c777b445 req-cfe20847-ebb9-49d2-acf6-bd7cedec5df4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:13.313706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-46dd1183-707a-4106-94f4-3987c777b445 req-cfe20847-ebb9-49d2-acf6-bd7cedec5df4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:13.332097 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-46dd1183-707a-4106-94f4-3987c777b445 req-cfe20847-ebb9-49d2-acf6-bd7cedec5df4 service nova] Creating event network-vif-unplugged:1414377b-0304-4553-b209-c5c3a5855cea for instance 861e3da3-98a1-4728-b218-322c9db128b3 on n-h2-858272-3 Oct 05 02:31:13.352321 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-46dd1183-707a-4106-94f4-3987c777b445 req-cfe20847-ebb9-49d2-acf6-bd7cedec5df4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082167 Oct 05 02:31:13.352968 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 540/1074] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:31:13.613191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a226bc0b-1070-4c64-ac01-bc93de325cc7 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:13.625915 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a226bc0b-1070-4c64-ac01-bc93de325cc7 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1541 microversion: 2.1 time: 0.425044 Oct 05 02:31:13.626492 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 535/1075] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:13 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1541 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:13.661644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d6bfcb34-3277-41ca-abd3-1c834fb9c9c8 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:13.664487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d6bfcb34-3277-41ca-abd3-1c834fb9c9c8 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:13.695587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d6bfcb34-3277-41ca-abd3-1c834fb9c9c8 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:13.697622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d6bfcb34-3277-41ca-abd3-1c834fb9c9c8 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:13.698114 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d6bfcb34-3277-41ca-abd3-1c834fb9c9c8 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:13.698865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d6bfcb34-3277-41ca-abd3-1c834fb9c9c8 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:13.705910 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d6bfcb34-3277-41ca-abd3-1c834fb9c9c8 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:13.706801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d6bfcb34-3277-41ca-abd3-1c834fb9c9c8 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:13.959438 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d6bfcb34-3277-41ca-abd3-1c834fb9c9c8 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.311733 Oct 05 02:31:13.960580 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 541/1076] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 02:31:13 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00/os-interface => generated 284 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:31:14.007025 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-31a10ab8-295b-4599-8de3-b33ec9f6b383 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:14.008362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-31a10ab8-295b-4599-8de3-b33ec9f6b383 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: a9c9522c-a640-49f4-9cb9-0dcf19eea103] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:14.021119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-31a10ab8-295b-4599-8de3-b33ec9f6b383 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:14.021674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-31a10ab8-295b-4599-8de3-b33ec9f6b383 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:14.022112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-31a10ab8-295b-4599-8de3-b33ec9f6b383 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:14.023216 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-31a10ab8-295b-4599-8de3-b33ec9f6b383 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:14.023887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-31a10ab8-295b-4599-8de3-b33ec9f6b383 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:14.024479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-31a10ab8-295b-4599-8de3-b33ec9f6b383 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:14.140314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-31a10ab8-295b-4599-8de3-b33ec9f6b383 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:14.154834 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-31a10ab8-295b-4599-8de3-b33ec9f6b383 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103" status: 200 len: 1274 microversion: 2.1 time: 0.152534 Oct 05 02:31:14.158774 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 536/1077] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:13 2022] GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103 => generated 1274 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:14.225629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d5da9822-383b-4a7d-9963-83370ff2473a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:14.226412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d5da9822-383b-4a7d-9963-83370ff2473a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:14.240332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5da9822-383b-4a7d-9963-83370ff2473a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:14.240829 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5da9822-383b-4a7d-9963-83370ff2473a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:14.243327 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5da9822-383b-4a7d-9963-83370ff2473a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:14.244160 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5da9822-383b-4a7d-9963-83370ff2473a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:14.244633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5da9822-383b-4a7d-9963-83370ff2473a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:14.245188 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5da9822-383b-4a7d-9963-83370ff2473a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:14.296128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-69c5e0d5-33f5-469f-a31b-7ba25ab4f808 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:14.297033 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-69c5e0d5-33f5-469f-a31b-7ba25ab4f808 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:14.306798 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69c5e0d5-33f5-469f-a31b-7ba25ab4f808 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:14.307301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69c5e0d5-33f5-469f-a31b-7ba25ab4f808 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:14.307740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69c5e0d5-33f5-469f-a31b-7ba25ab4f808 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:14.308656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69c5e0d5-33f5-469f-a31b-7ba25ab4f808 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:14.309149 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69c5e0d5-33f5-469f-a31b-7ba25ab4f808 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:14.309578 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69c5e0d5-33f5-469f-a31b-7ba25ab4f808 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:14.516972 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-69c5e0d5-33f5-469f-a31b-7ba25ab4f808 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lazy-loading 'services' on Instance uuid 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:31:14.567446 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-69c5e0d5-33f5-469f-a31b-7ba25ab4f808 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1927 microversion: 2.75 time: 0.269138 Oct 05 02:31:14.569395 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 537/1078] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:14 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1927 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:31:14.797650 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d5da9822-383b-4a7d-9963-83370ff2473a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:14.818431 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d5da9822-383b-4a7d-9963-83370ff2473a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1477 microversion: 2.1 time: 0.596816 Oct 05 02:31:14.828073 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 542/1079] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:14 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1477 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:15.183289 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a2242274-92aa-4b81-8ce1-8c63f8d8709b tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:15.183901 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a2242274-92aa-4b81-8ce1-8c63f8d8709b tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: a9c9522c-a640-49f4-9cb9-0dcf19eea103] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:15.193540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2242274-92aa-4b81-8ce1-8c63f8d8709b tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:15.194540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2242274-92aa-4b81-8ce1-8c63f8d8709b tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:15.195125 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2242274-92aa-4b81-8ce1-8c63f8d8709b tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:15.195965 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2242274-92aa-4b81-8ce1-8c63f8d8709b tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:15.196570 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2242274-92aa-4b81-8ce1-8c63f8d8709b tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:15.197183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2242274-92aa-4b81-8ce1-8c63f8d8709b tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:15.548346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a2242274-92aa-4b81-8ce1-8c63f8d8709b tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:15.556445 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a2242274-92aa-4b81-8ce1-8c63f8d8709b tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103" status: 200 len: 1316 microversion: 2.1 time: 0.378510 Oct 05 02:31:15.564584 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 538/1080] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:15 2022] GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103 => generated 1316 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:15.596622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a93be64a-ed4c-49ed-a220-23f1f10a7da4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:15.597290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a93be64a-ed4c-49ed-a220-23f1f10a7da4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:15.607831 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a93be64a-ed4c-49ed-a220-23f1f10a7da4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:15.610833 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a93be64a-ed4c-49ed-a220-23f1f10a7da4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:15.612124 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a93be64a-ed4c-49ed-a220-23f1f10a7da4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:15.613608 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a93be64a-ed4c-49ed-a220-23f1f10a7da4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:15.614089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a93be64a-ed4c-49ed-a220-23f1f10a7da4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:15.615090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a93be64a-ed4c-49ed-a220-23f1f10a7da4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:15.839118 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-a93be64a-ed4c-49ed-a220-23f1f10a7da4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lazy-loading 'services' on Instance uuid 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:31:15.849677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c86746a9-bd1b-46d9-875b-c32b93c10eba tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:15.857971 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c86746a9-bd1b-46d9-875b-c32b93c10eba tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:15.864868 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c86746a9-bd1b-46d9-875b-c32b93c10eba tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:15.865677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c86746a9-bd1b-46d9-875b-c32b93c10eba tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:15.866849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c86746a9-bd1b-46d9-875b-c32b93c10eba tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:15.867810 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c86746a9-bd1b-46d9-875b-c32b93c10eba tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:15.868430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c86746a9-bd1b-46d9-875b-c32b93c10eba tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:15.869174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c86746a9-bd1b-46d9-875b-c32b93c10eba tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:15.875598 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a93be64a-ed4c-49ed-a220-23f1f10a7da4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1927 microversion: 2.75 time: 0.283193 Oct 05 02:31:15.878924 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 543/1081] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:15 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1927 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:31:16.226385 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c86746a9-bd1b-46d9-875b-c32b93c10eba tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:16.238519 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c86746a9-bd1b-46d9-875b-c32b93c10eba tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1477 microversion: 2.1 time: 0.393164 Oct 05 02:31:16.239525 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 539/1082] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:15 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1477 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:16.342080 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-9f8777b0-5260-4a49-91a1-af175e62d75f req-3ca7b331-fbb6-4380-b67f-2d96fd782bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "861e3da3-98a1-4728-b218-322c9db128b3", "name": "network-vif-plugged", "status": "completed", "tag": "1414377b-0304-4553-b209-c5c3a5855cea"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:16.356502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9f8777b0-5260-4a49-91a1-af175e62d75f req-3ca7b331-fbb6-4380-b67f-2d96fd782bf5 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:16.357707 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9f8777b0-5260-4a49-91a1-af175e62d75f req-3ca7b331-fbb6-4380-b67f-2d96fd782bf5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:16.358457 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9f8777b0-5260-4a49-91a1-af175e62d75f req-3ca7b331-fbb6-4380-b67f-2d96fd782bf5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:16.381842 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-9f8777b0-5260-4a49-91a1-af175e62d75f req-3ca7b331-fbb6-4380-b67f-2d96fd782bf5 service nova] Creating event network-vif-plugged:1414377b-0304-4553-b209-c5c3a5855cea for instance 861e3da3-98a1-4728-b218-322c9db128b3 on n-h2-858272-3 Oct 05 02:31:16.392459 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-9f8777b0-5260-4a49-91a1-af175e62d75f req-3ca7b331-fbb6-4380-b67f-2d96fd782bf5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056517 Oct 05 02:31:16.394769 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 544/1083] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:31:16.590816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d225ba3d-178a-4a94-a35d-4511b37e47ea tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:16.591441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d225ba3d-178a-4a94-a35d-4511b37e47ea tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: a9c9522c-a640-49f4-9cb9-0dcf19eea103] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:16.602906 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d225ba3d-178a-4a94-a35d-4511b37e47ea tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:16.603409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d225ba3d-178a-4a94-a35d-4511b37e47ea tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:16.604060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d225ba3d-178a-4a94-a35d-4511b37e47ea tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:16.604774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d225ba3d-178a-4a94-a35d-4511b37e47ea tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:16.605276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d225ba3d-178a-4a94-a35d-4511b37e47ea tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:16.605715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d225ba3d-178a-4a94-a35d-4511b37e47ea tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:16.871710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-1b93fded-39bc-4910-bd57-05b815e2f1f9 req-6d815956-ca0e-4a6e-9298-a11e65d3bc50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a19871a-12bc-45d8-ad01-489ad68f1e00", "tag": "c4608021-f3cf-466d-92f8-ca22a3a9526d"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:16.902084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1b93fded-39bc-4910-bd57-05b815e2f1f9 req-6d815956-ca0e-4a6e-9298-a11e65d3bc50 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:16.904846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1b93fded-39bc-4910-bd57-05b815e2f1f9 req-6d815956-ca0e-4a6e-9298-a11e65d3bc50 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:16.908306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1b93fded-39bc-4910-bd57-05b815e2f1f9 req-6d815956-ca0e-4a6e-9298-a11e65d3bc50 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:16.947456 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-1b93fded-39bc-4910-bd57-05b815e2f1f9 req-6d815956-ca0e-4a6e-9298-a11e65d3bc50 service nova] Creating event network-changed:c4608021-f3cf-466d-92f8-ca22a3a9526d for instance 9a19871a-12bc-45d8-ad01-489ad68f1e00 on n-h1-858272-3 Oct 05 02:31:16.955901 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-1b93fded-39bc-4910-bd57-05b815e2f1f9 req-6d815956-ca0e-4a6e-9298-a11e65d3bc50 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092807 Oct 05 02:31:16.958090 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 545/1084] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:31:16.965231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-488d2945-b8cf-44c6-acfc-f8a7c67277d9 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:16.967092 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-488d2945-b8cf-44c6-acfc-f8a7c67277d9 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:16.981823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-488d2945-b8cf-44c6-acfc-f8a7c67277d9 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:16.982666 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-488d2945-b8cf-44c6-acfc-f8a7c67277d9 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:16.984283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-488d2945-b8cf-44c6-acfc-f8a7c67277d9 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:16.985296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-488d2945-b8cf-44c6-acfc-f8a7c67277d9 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:16.985967 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-488d2945-b8cf-44c6-acfc-f8a7c67277d9 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:16.987596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-488d2945-b8cf-44c6-acfc-f8a7c67277d9 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:17.036196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d225ba3d-178a-4a94-a35d-4511b37e47ea tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:17.045044 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d225ba3d-178a-4a94-a35d-4511b37e47ea tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103" status: 200 len: 1316 microversion: 2.1 time: 0.458036 Oct 05 02:31:17.047381 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 540/1085] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:16 2022] GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103 => generated 1316 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:17.164433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-488d2945-b8cf-44c6-acfc-f8a7c67277d9 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lazy-loading 'services' on Instance uuid 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:31:17.209127 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-488d2945-b8cf-44c6-acfc-f8a7c67277d9 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1927 microversion: 2.75 time: 0.249406 Oct 05 02:31:17.212189 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 546/1086] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:16 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1927 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:31:17.269976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d9b1e771-a898-4993-9a70-a5241d3e8ef4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:17.271842 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d9b1e771-a898-4993-9a70-a5241d3e8ef4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:17.282701 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d9b1e771-a898-4993-9a70-a5241d3e8ef4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:17.283633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d9b1e771-a898-4993-9a70-a5241d3e8ef4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:17.284351 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d9b1e771-a898-4993-9a70-a5241d3e8ef4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:17.285333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d9b1e771-a898-4993-9a70-a5241d3e8ef4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:17.286029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d9b1e771-a898-4993-9a70-a5241d3e8ef4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:17.287430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d9b1e771-a898-4993-9a70-a5241d3e8ef4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:18.074847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4053339b-4fd0-4537-94c7-80569075743c tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:18.076336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4053339b-4fd0-4537-94c7-80569075743c tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: a9c9522c-a640-49f4-9cb9-0dcf19eea103] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:18.097233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4053339b-4fd0-4537-94c7-80569075743c tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:18.098046 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4053339b-4fd0-4537-94c7-80569075743c tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:18.098638 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4053339b-4fd0-4537-94c7-80569075743c tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:18.099566 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4053339b-4fd0-4537-94c7-80569075743c tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:18.100183 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4053339b-4fd0-4537-94c7-80569075743c tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:18.101042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4053339b-4fd0-4537-94c7-80569075743c tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:18.255917 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d9b1e771-a898-4993-9a70-a5241d3e8ef4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:18.260543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:18.274565 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d9b1e771-a898-4993-9a70-a5241d3e8ef4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1477 microversion: 2.1 time: 1.013186 Oct 05 02:31:18.276426 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 541/1087] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:17 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1477 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:31:18.282808 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ffe26678-7aa9-4629-8c2f-22ef87c27456 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:18.283419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ffe26678-7aa9-4629-8c2f-22ef87c27456 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:18.290935 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ffe26678-7aa9-4629-8c2f-22ef87c27456 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:18.291725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ffe26678-7aa9-4629-8c2f-22ef87c27456 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:18.294407 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ffe26678-7aa9-4629-8c2f-22ef87c27456 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:18.295332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ffe26678-7aa9-4629-8c2f-22ef87c27456 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:18.296066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ffe26678-7aa9-4629-8c2f-22ef87c27456 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:18.296667 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ffe26678-7aa9-4629-8c2f-22ef87c27456 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:18.503796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-ffe26678-7aa9-4629-8c2f-22ef87c27456 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lazy-loading 'services' on Instance uuid 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:31:18.550946 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ffe26678-7aa9-4629-8c2f-22ef87c27456 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1927 microversion: 2.75 time: 0.272886 Oct 05 02:31:18.551752 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 542/1088] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:18 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1927 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:31:18.600718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4053339b-4fd0-4537-94c7-80569075743c tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:18.612616 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4053339b-4fd0-4537-94c7-80569075743c tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103" status: 200 len: 1316 microversion: 2.1 time: 0.542936 Oct 05 02:31:18.619887 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 547/1089] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:18 2022] GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103 => generated 1316 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:31:19.006787 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-ecff8061-5724-49c8-bb01-1858d76f6935 req-0ad59b17-3b5a-48f8-8595-cdecc47b623c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9c9522c-a640-49f4-9cb9-0dcf19eea103", "tag": "39bdaef6-a403-4edc-8790-c97d27f2a7ca"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:19.033524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ecff8061-5724-49c8-bb01-1858d76f6935 req-0ad59b17-3b5a-48f8-8595-cdecc47b623c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:19.034417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ecff8061-5724-49c8-bb01-1858d76f6935 req-0ad59b17-3b5a-48f8-8595-cdecc47b623c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:19.036805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ecff8061-5724-49c8-bb01-1858d76f6935 req-0ad59b17-3b5a-48f8-8595-cdecc47b623c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:19.051642 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-ecff8061-5724-49c8-bb01-1858d76f6935 req-0ad59b17-3b5a-48f8-8595-cdecc47b623c service nova] Creating event network-changed:39bdaef6-a403-4edc-8790-c97d27f2a7ca for instance a9c9522c-a640-49f4-9cb9-0dcf19eea103 on n-h2-858272-3 Oct 05 02:31:19.059078 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-ecff8061-5724-49c8-bb01-1858d76f6935 req-0ad59b17-3b5a-48f8-8595-cdecc47b623c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061426 Oct 05 02:31:19.061132 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 543/1090] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:31:19.301624 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e9ecac32-1fb1-4078-8bc1-e7d78c31184e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:19.302980 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e9ecac32-1fb1-4078-8bc1-e7d78c31184e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:19.310325 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e9ecac32-1fb1-4078-8bc1-e7d78c31184e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:19.311180 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e9ecac32-1fb1-4078-8bc1-e7d78c31184e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:19.312739 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e9ecac32-1fb1-4078-8bc1-e7d78c31184e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:19.314011 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e9ecac32-1fb1-4078-8bc1-e7d78c31184e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:19.314763 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e9ecac32-1fb1-4078-8bc1-e7d78c31184e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:19.315436 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e9ecac32-1fb1-4078-8bc1-e7d78c31184e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:19.523903 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e9ecac32-1fb1-4078-8bc1-e7d78c31184e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:19.532503 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e9ecac32-1fb1-4078-8bc1-e7d78c31184e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1463 microversion: 2.1 time: 0.237839 Oct 05 02:31:19.533857 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 548/1091] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:19 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1463 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:19.557937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-feca52ad-3830-4d16-8535-f4d0a14b5daf tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:19.560136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-feca52ad-3830-4d16-8535-f4d0a14b5daf tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:19.569245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-feca52ad-3830-4d16-8535-f4d0a14b5daf tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:19.570049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-feca52ad-3830-4d16-8535-f4d0a14b5daf tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:19.570838 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-feca52ad-3830-4d16-8535-f4d0a14b5daf tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:19.571973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-feca52ad-3830-4d16-8535-f4d0a14b5daf tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:19.572605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-feca52ad-3830-4d16-8535-f4d0a14b5daf tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:19.573257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-feca52ad-3830-4d16-8535-f4d0a14b5daf tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:19.586055 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b041df0c-0f9c-4f36-bf65-9d752664693a tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:19.586679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b041df0c-0f9c-4f36-bf65-9d752664693a tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:19.594610 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b041df0c-0f9c-4f36-bf65-9d752664693a tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:19.595092 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b041df0c-0f9c-4f36-bf65-9d752664693a tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:19.602642 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b041df0c-0f9c-4f36-bf65-9d752664693a tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:19.603728 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b041df0c-0f9c-4f36-bf65-9d752664693a tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:19.605653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b041df0c-0f9c-4f36-bf65-9d752664693a tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:19.606316 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b041df0c-0f9c-4f36-bf65-9d752664693a tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:19.805897 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-b041df0c-0f9c-4f36-bf65-9d752664693a tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lazy-loading 'services' on Instance uuid 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:31:19.834578 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b041df0c-0f9c-4f36-bf65-9d752664693a tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1927 microversion: 2.75 time: 0.252646 Oct 05 02:31:19.835859 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 549/1092] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:19 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1927 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:31:19.845188 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3f2d7e65-ba3e-425d-a4a8-e1f95498832b tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:19.846206 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3f2d7e65-ba3e-425d-a4a8-e1f95498832b tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: a9c9522c-a640-49f4-9cb9-0dcf19eea103] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:19.864576 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f2d7e65-ba3e-425d-a4a8-e1f95498832b tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:19.865505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f2d7e65-ba3e-425d-a4a8-e1f95498832b tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:19.866220 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f2d7e65-ba3e-425d-a4a8-e1f95498832b tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:19.867175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f2d7e65-ba3e-425d-a4a8-e1f95498832b tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:19.867895 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f2d7e65-ba3e-425d-a4a8-e1f95498832b tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:19.868532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f2d7e65-ba3e-425d-a4a8-e1f95498832b tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:19.877079 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:19.919666 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-feca52ad-3830-4d16-8535-f4d0a14b5daf tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:19.928789 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-feca52ad-3830-4d16-8535-f4d0a14b5daf tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1463 microversion: 2.1 time: 0.375314 Oct 05 02:31:19.952356 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 544/1093] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:19 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1463 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:19.958052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c59a864d-6057-4cc2-9f27-57ddfd2682db tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:19.962718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c59a864d-6057-4cc2-9f27-57ddfd2682db tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:19.976321 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c59a864d-6057-4cc2-9f27-57ddfd2682db tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:19.977571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:19.980638 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c59a864d-6057-4cc2-9f27-57ddfd2682db tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:19.981770 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c59a864d-6057-4cc2-9f27-57ddfd2682db tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:19.982855 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c59a864d-6057-4cc2-9f27-57ddfd2682db tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:19.984016 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c59a864d-6057-4cc2-9f27-57ddfd2682db tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:19.984459 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c59a864d-6057-4cc2-9f27-57ddfd2682db tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:20.105948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-c59a864d-6057-4cc2-9f27-57ddfd2682db tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:31:20.109077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-c59a864d-6057-4cc2-9f27-57ddfd2682db tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:31:20.109820 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-c59a864d-6057-4cc2-9f27-57ddfd2682db tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:31:20.113217 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-c59a864d-6057-4cc2-9f27-57ddfd2682db tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:31:20.114876 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-c59a864d-6057-4cc2-9f27-57ddfd2682db tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:31:20.144279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3f2d7e65-ba3e-425d-a4a8-e1f95498832b tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:20.152329 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3f2d7e65-ba3e-425d-a4a8-e1f95498832b tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103" status: 200 len: 1316 microversion: 2.1 time: 0.314948 Oct 05 02:31:20.152760 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 550/1094] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:19 2022] GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103 => generated 1316 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:20.244259 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c59a864d-6057-4cc2-9f27-57ddfd2682db tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:20.251692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c59a864d-6057-4cc2-9f27-57ddfd2682db tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:20.252189 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c59a864d-6057-4cc2-9f27-57ddfd2682db tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:20.252623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c59a864d-6057-4cc2-9f27-57ddfd2682db tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:20.253359 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c59a864d-6057-4cc2-9f27-57ddfd2682db tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:20.253814 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c59a864d-6057-4cc2-9f27-57ddfd2682db tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:20.254239 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c59a864d-6057-4cc2-9f27-57ddfd2682db tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:20.297979 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c59a864d-6057-4cc2-9f27-57ddfd2682db tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "POST /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3/action" status: 202 len: 1067 microversion: 2.1 time: 0.343838 Oct 05 02:31:20.301487 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 545/1095] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:31:19 2022] POST /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3/action => generated 1067 bytes in 348 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 05 02:31:20.321778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-274c3bc9-60bc-4714-9785-64df189c9ba4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:20.322412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-274c3bc9-60bc-4714-9785-64df189c9ba4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:20.325604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=8 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:20.329822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-274c3bc9-60bc-4714-9785-64df189c9ba4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:20.330322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-274c3bc9-60bc-4714-9785-64df189c9ba4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:20.330762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-274c3bc9-60bc-4714-9785-64df189c9ba4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:20.331470 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-274c3bc9-60bc-4714-9785-64df189c9ba4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:20.331927 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-274c3bc9-60bc-4714-9785-64df189c9ba4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:20.332354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-274c3bc9-60bc-4714-9785-64df189c9ba4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:20.524705 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-274c3bc9-60bc-4714-9785-64df189c9ba4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:20.536690 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-274c3bc9-60bc-4714-9785-64df189c9ba4 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1472 microversion: 2.1 time: 0.219293 Oct 05 02:31:20.541458 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 551/1096] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:20 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1472 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:20.850985 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b3a8502f-e876-4cc9-9781-ca90e729070d tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1038378529", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "7a6971f8-4a27-4b14-85e1-d67a9e2efe63"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:20.863808 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bae1ba5a-3f12-4967-9371-7cd5e74071f2 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:20.864404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bae1ba5a-3f12-4967-9371-7cd5e74071f2 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:20.871413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bae1ba5a-3f12-4967-9371-7cd5e74071f2 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:20.871913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bae1ba5a-3f12-4967-9371-7cd5e74071f2 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:20.872761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bae1ba5a-3f12-4967-9371-7cd5e74071f2 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:20.873223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bae1ba5a-3f12-4967-9371-7cd5e74071f2 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:20.873512 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bae1ba5a-3f12-4967-9371-7cd5e74071f2 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:20.874959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bae1ba5a-3f12-4967-9371-7cd5e74071f2 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:20.917143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-b3a8502f-e876-4cc9-9781-ca90e729070d tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] validate_networks() for [('7a6971f8-4a27-4b14-85e1-d67a9e2efe63', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:31:21.034571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-bae1ba5a-3f12-4967-9371-7cd5e74071f2 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lazy-loading 'services' on Instance uuid 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:31:21.057200 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bae1ba5a-3f12-4967-9371-7cd5e74071f2 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1927 microversion: 2.75 time: 0.196940 Oct 05 02:31:21.058864 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 552/1097] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:20 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1927 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:31:21.178973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1122a102-06da-4d62-af29-b3fec3a5a16b tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:21.181622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1122a102-06da-4d62-af29-b3fec3a5a16b tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: a9c9522c-a640-49f4-9cb9-0dcf19eea103] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:21.189854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1122a102-06da-4d62-af29-b3fec3a5a16b tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:21.190441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1122a102-06da-4d62-af29-b3fec3a5a16b tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:21.190947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1122a102-06da-4d62-af29-b3fec3a5a16b tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:21.198931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1122a102-06da-4d62-af29-b3fec3a5a16b tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:21.199520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1122a102-06da-4d62-af29-b3fec3a5a16b tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:21.200020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1122a102-06da-4d62-af29-b3fec3a5a16b tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:21.462737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1122a102-06da-4d62-af29-b3fec3a5a16b tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:21.477627 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1122a102-06da-4d62-af29-b3fec3a5a16b tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103" status: 200 len: 1316 microversion: 2.1 time: 0.302354 Oct 05 02:31:21.480861 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 553/1098] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:21 2022] GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103 => generated 1316 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:31:21.547044 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-b3a8502f-e876-4cc9-9781-ca90e729070d tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:31:21.547464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-b3a8502f-e876-4cc9-9781-ca90e729070d tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:31:21.547940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-b3a8502f-e876-4cc9-9781-ca90e729070d tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:31:21.548349 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-b3a8502f-e876-4cc9-9781-ca90e729070d tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:31:21.548762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-b3a8502f-e876-4cc9-9781-ca90e729070d tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:31:21.565226 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7c4e46cd-1e7e-4cb0-b5cc-56f7528eaa23 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:21.566042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7c4e46cd-1e7e-4cb0-b5cc-56f7528eaa23 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:21.574381 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7c4e46cd-1e7e-4cb0-b5cc-56f7528eaa23 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:21.574875 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7c4e46cd-1e7e-4cb0-b5cc-56f7528eaa23 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:21.575314 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7c4e46cd-1e7e-4cb0-b5cc-56f7528eaa23 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:21.576023 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7c4e46cd-1e7e-4cb0-b5cc-56f7528eaa23 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:21.576485 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7c4e46cd-1e7e-4cb0-b5cc-56f7528eaa23 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:21.579210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3a8502f-e876-4cc9-9781-ca90e729070d tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:21.579731 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3a8502f-e876-4cc9-9781-ca90e729070d tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:21.580193 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3a8502f-e876-4cc9-9781-ca90e729070d tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:21.580943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3a8502f-e876-4cc9-9781-ca90e729070d tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:21.581412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3a8502f-e876-4cc9-9781-ca90e729070d tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:21.581959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7c4e46cd-1e7e-4cb0-b5cc-56f7528eaa23 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:21.586988 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3a8502f-e876-4cc9-9781-ca90e729070d tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:21.658421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-b3a8502f-e876-4cc9-9781-ca90e729070d tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Getting quotas for project 1c46317b81ae456ebfb65d1d3eb0906e. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:31:21.666187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-b3a8502f-e876-4cc9-9781-ca90e729070d tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Getting quotas for user 3f6748c4cd29482ca1bcfee6781a0cf3 and project 1c46317b81ae456ebfb65d1d3eb0906e. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:31:21.681811 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b3a8502f-e876-4cc9-9781-ca90e729070d tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:31:21.684151 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b3a8502f-e876-4cc9-9781-ca90e729070d tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] [instance: e31b9992-fb63-4a85-82e7-a8a04238a6ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:31:21.827494 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b3a8502f-e876-4cc9-9781-ca90e729070d tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.129033 Oct 05 02:31:21.834751 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 546/1099] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:31:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:31:21.839976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8af59535-ca8b-4ba1-9bfc-5d32f6410cd0 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:21.840607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8af59535-ca8b-4ba1-9bfc-5d32f6410cd0 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] [instance: e31b9992-fb63-4a85-82e7-a8a04238a6ad] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:21.969207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8af59535-ca8b-4ba1-9bfc-5d32f6410cd0 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6748c4cd29482ca1bcfee6781a0cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c46317b81ae456ebfb65d1d3eb0906e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:21.978298 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8af59535-ca8b-4ba1-9bfc-5d32f6410cd0 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] 10.222.0.16 "GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad" status: 200 len: 1228 microversion: 2.1 time: 0.142209 Oct 05 02:31:21.981457 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 547/1100] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:21 2022] GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad => generated 1228 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:21.996944 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7c4e46cd-1e7e-4cb0-b5cc-56f7528eaa23 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:22.017374 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7c4e46cd-1e7e-4cb0-b5cc-56f7528eaa23 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1472 microversion: 2.1 time: 0.456432 Oct 05 02:31:22.018568 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 554/1101] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:21 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1472 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:31:22.088285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-32442ba4-1492-4acd-a6c9-9a9cb63892d0 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:22.089085 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-32442ba4-1492-4acd-a6c9-9a9cb63892d0 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:22.096296 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32442ba4-1492-4acd-a6c9-9a9cb63892d0 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:22.096996 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32442ba4-1492-4acd-a6c9-9a9cb63892d0 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:22.097790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32442ba4-1492-4acd-a6c9-9a9cb63892d0 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:22.098999 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32442ba4-1492-4acd-a6c9-9a9cb63892d0 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:22.100210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32442ba4-1492-4acd-a6c9-9a9cb63892d0 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:22.101602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32442ba4-1492-4acd-a6c9-9a9cb63892d0 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:22.231957 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-32442ba4-1492-4acd-a6c9-9a9cb63892d0 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lazy-loading 'services' on Instance uuid 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:31:22.307938 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-32442ba4-1492-4acd-a6c9-9a9cb63892d0 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1933 microversion: 2.75 time: 0.223969 Oct 05 02:31:22.312546 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 548/1102] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:22 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1933 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:31:22.505516 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-971d034a-3b82-4687-8c6d-ee66b87cb595 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:22.506083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-971d034a-3b82-4687-8c6d-ee66b87cb595 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: a9c9522c-a640-49f4-9cb9-0dcf19eea103] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:22.513712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-971d034a-3b82-4687-8c6d-ee66b87cb595 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:22.514199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-971d034a-3b82-4687-8c6d-ee66b87cb595 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:22.515507 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-971d034a-3b82-4687-8c6d-ee66b87cb595 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:22.516277 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-971d034a-3b82-4687-8c6d-ee66b87cb595 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:22.516989 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-971d034a-3b82-4687-8c6d-ee66b87cb595 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:22.517417 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-971d034a-3b82-4687-8c6d-ee66b87cb595 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:22.744203 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-971d034a-3b82-4687-8c6d-ee66b87cb595 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:22.752428 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-971d034a-3b82-4687-8c6d-ee66b87cb595 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103" status: 200 len: 1316 microversion: 2.1 time: 0.250876 Oct 05 02:31:22.753407 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 555/1103] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:22 2022] GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103 => generated 1316 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:23.004168 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b9254960-e0fc-46a0-9acf-058a38d0ca40 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:23.004833 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b9254960-e0fc-46a0-9acf-058a38d0ca40 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] [instance: e31b9992-fb63-4a85-82e7-a8a04238a6ad] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:23.011717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9254960-e0fc-46a0-9acf-058a38d0ca40 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:23.012204 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9254960-e0fc-46a0-9acf-058a38d0ca40 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:23.012636 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9254960-e0fc-46a0-9acf-058a38d0ca40 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:23.013339 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9254960-e0fc-46a0-9acf-058a38d0ca40 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:23.013784 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9254960-e0fc-46a0-9acf-058a38d0ca40 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:23.014804 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9254960-e0fc-46a0-9acf-058a38d0ca40 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:23.040755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f0590d33-49a5-4ed2-8355-a02e28a5dc44 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:23.041401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f0590d33-49a5-4ed2-8355-a02e28a5dc44 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:23.047421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0590d33-49a5-4ed2-8355-a02e28a5dc44 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:23.047907 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0590d33-49a5-4ed2-8355-a02e28a5dc44 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:23.048339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0590d33-49a5-4ed2-8355-a02e28a5dc44 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:23.049048 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0590d33-49a5-4ed2-8355-a02e28a5dc44 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:23.049499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0590d33-49a5-4ed2-8355-a02e28a5dc44 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:23.049917 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0590d33-49a5-4ed2-8355-a02e28a5dc44 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:23.075203 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b9254960-e0fc-46a0-9acf-058a38d0ca40 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6748c4cd29482ca1bcfee6781a0cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c46317b81ae456ebfb65d1d3eb0906e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:23.083586 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b9254960-e0fc-46a0-9acf-058a38d0ca40 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] 10.222.0.16 "GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad" status: 200 len: 1232 microversion: 2.1 time: 0.083239 Oct 05 02:31:23.084163 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 549/1104] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:22 2022] GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad => generated 1232 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:23.180181 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f0590d33-49a5-4ed2-8355-a02e28a5dc44 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:23.188402 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f0590d33-49a5-4ed2-8355-a02e28a5dc44 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1472 microversion: 2.1 time: 0.151448 Oct 05 02:31:23.188996 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 556/1105] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:23 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1472 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:31:23.338053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-823b1ba1-8af9-421f-8e55-33ec40b4f0c4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:23.338599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-823b1ba1-8af9-421f-8e55-33ec40b4f0c4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:23.345323 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-823b1ba1-8af9-421f-8e55-33ec40b4f0c4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:23.345807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-823b1ba1-8af9-421f-8e55-33ec40b4f0c4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:23.346268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-823b1ba1-8af9-421f-8e55-33ec40b4f0c4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:23.346951 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-823b1ba1-8af9-421f-8e55-33ec40b4f0c4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:23.347399 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-823b1ba1-8af9-421f-8e55-33ec40b4f0c4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:23.347817 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-823b1ba1-8af9-421f-8e55-33ec40b4f0c4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:23.418519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-823b1ba1-8af9-421f-8e55-33ec40b4f0c4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lazy-loading 'services' on Instance uuid 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:31:23.435248 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-823b1ba1-8af9-421f-8e55-33ec40b4f0c4 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1933 microversion: 2.75 time: 0.100961 Oct 05 02:31:23.435820 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 550/1106] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:23 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1933 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:31:23.775595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-75259f3e-2d7e-4f21-94bd-599f2a995c63 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:23.776203 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-75259f3e-2d7e-4f21-94bd-599f2a995c63 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: a9c9522c-a640-49f4-9cb9-0dcf19eea103] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:23.783060 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75259f3e-2d7e-4f21-94bd-599f2a995c63 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:23.783547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75259f3e-2d7e-4f21-94bd-599f2a995c63 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:23.783970 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75259f3e-2d7e-4f21-94bd-599f2a995c63 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:23.784654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75259f3e-2d7e-4f21-94bd-599f2a995c63 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:23.785203 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75259f3e-2d7e-4f21-94bd-599f2a995c63 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:23.785631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75259f3e-2d7e-4f21-94bd-599f2a995c63 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:23.921273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-75259f3e-2d7e-4f21-94bd-599f2a995c63 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:23.925890 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e95863b6-caea-41da-9d55-277f7fa376fd tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:23.926674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e95863b6-caea-41da-9d55-277f7fa376fd tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:23.929591 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-75259f3e-2d7e-4f21-94bd-599f2a995c63 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103" status: 200 len: 1316 microversion: 2.1 time: 0.157900 Oct 05 02:31:23.930441 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 557/1107] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:23 2022] GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103 => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:23.944773 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e95863b6-caea-41da-9d55-277f7fa376fd tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:23.948912 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e95863b6-caea-41da-9d55-277f7fa376fd tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:23.949569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e95863b6-caea-41da-9d55-277f7fa376fd tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:23.950320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e95863b6-caea-41da-9d55-277f7fa376fd tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:23.950808 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e95863b6-caea-41da-9d55-277f7fa376fd tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:23.951235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e95863b6-caea-41da-9d55-277f7fa376fd tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:24.117441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0ea84bfe-43da-4ca7-a80b-8a9601a3f505 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:24.118572 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0ea84bfe-43da-4ca7-a80b-8a9601a3f505 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] [instance: e31b9992-fb63-4a85-82e7-a8a04238a6ad] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:24.132359 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ea84bfe-43da-4ca7-a80b-8a9601a3f505 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:24.133089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ea84bfe-43da-4ca7-a80b-8a9601a3f505 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:24.135600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ea84bfe-43da-4ca7-a80b-8a9601a3f505 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:24.138795 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-e95863b6-caea-41da-9d55-277f7fa376fd tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lazy-loading 'services' on Instance uuid d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:31:24.139336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ea84bfe-43da-4ca7-a80b-8a9601a3f505 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:24.139688 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ea84bfe-43da-4ca7-a80b-8a9601a3f505 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:24.141069 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ea84bfe-43da-4ca7-a80b-8a9601a3f505 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:24.153136 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e95863b6-caea-41da-9d55-277f7fa376fd tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 2344 microversion: 2.25 time: 0.230766 Oct 05 02:31:24.153693 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 551/1108] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:23 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 2344 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:31:24.181202 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-20dd85e2-643f-463a-867b-6306cfb60c9b tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:24.185110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-20dd85e2-643f-463a-867b-6306cfb60c9b tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:24.185820 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-20dd85e2-643f-463a-867b-6306cfb60c9b tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:24.186481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-20dd85e2-643f-463a-867b-6306cfb60c9b tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:24.187469 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-20dd85e2-643f-463a-867b-6306cfb60c9b tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:24.188229 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-20dd85e2-643f-463a-867b-6306cfb60c9b tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:24.188866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-20dd85e2-643f-463a-867b-6306cfb60c9b tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:24.210481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:24.218677 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-20dd85e2-643f-463a-867b-6306cfb60c9b tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.040410 Oct 05 02:31:24.227051 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 552/1109] 10.222.0.16 () {60 vars in 1217 bytes} [Wed Oct 5 02:31:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 02:31:24.230833 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f1897db7-0f53-4936-9142-6385c941b716 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:24.231457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f1897db7-0f53-4936-9142-6385c941b716 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:24.239550 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f1897db7-0f53-4936-9142-6385c941b716 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:24.240049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f1897db7-0f53-4936-9142-6385c941b716 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:24.240326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0ea84bfe-43da-4ca7-a80b-8a9601a3f505 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6748c4cd29482ca1bcfee6781a0cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c46317b81ae456ebfb65d1d3eb0906e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:24.240485 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f1897db7-0f53-4936-9142-6385c941b716 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:24.241199 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f1897db7-0f53-4936-9142-6385c941b716 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:24.241874 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f1897db7-0f53-4936-9142-6385c941b716 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:24.242403 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f1897db7-0f53-4936-9142-6385c941b716 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:24.251393 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0ea84bfe-43da-4ca7-a80b-8a9601a3f505 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] 10.222.0.16 "GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad" status: 200 len: 1232 microversion: 2.1 time: 0.147260 Oct 05 02:31:24.268407 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 558/1110] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:24 2022] GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad => generated 1232 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:31:24.429010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f1897db7-0f53-4936-9142-6385c941b716 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:24.436940 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f1897db7-0f53-4936-9142-6385c941b716 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1472 microversion: 2.1 time: 0.213816 Oct 05 02:31:24.437744 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 553/1111] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:24 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1472 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:24.462498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a93e3f21-45e8-439b-978c-383b4d77d0f8 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:24.463207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a93e3f21-45e8-439b-978c-383b4d77d0f8 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:24.470479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a93e3f21-45e8-439b-978c-383b4d77d0f8 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:24.470969 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a93e3f21-45e8-439b-978c-383b4d77d0f8 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:24.471409 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a93e3f21-45e8-439b-978c-383b4d77d0f8 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:24.472201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a93e3f21-45e8-439b-978c-383b4d77d0f8 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:24.472657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a93e3f21-45e8-439b-978c-383b4d77d0f8 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:24.473122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a93e3f21-45e8-439b-978c-383b4d77d0f8 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:24.550333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-a93e3f21-45e8-439b-978c-383b4d77d0f8 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lazy-loading 'services' on Instance uuid 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:31:24.565894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:24.570330 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a93e3f21-45e8-439b-978c-383b4d77d0f8 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1933 microversion: 2.75 time: 0.111456 Oct 05 02:31:24.571504 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 559/1112] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:24 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1933 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:31:24.957845 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0d041bfa-91c8-4759-85f9-84e9f12ba8c7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:24.958493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0d041bfa-91c8-4759-85f9-84e9f12ba8c7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: a9c9522c-a640-49f4-9cb9-0dcf19eea103] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:24.964482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d041bfa-91c8-4759-85f9-84e9f12ba8c7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:24.965006 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d041bfa-91c8-4759-85f9-84e9f12ba8c7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:24.965427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d041bfa-91c8-4759-85f9-84e9f12ba8c7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:24.966111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d041bfa-91c8-4759-85f9-84e9f12ba8c7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:24.966564 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d041bfa-91c8-4759-85f9-84e9f12ba8c7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:24.966983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d041bfa-91c8-4759-85f9-84e9f12ba8c7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:25.108001 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0d041bfa-91c8-4759-85f9-84e9f12ba8c7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:25.125583 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0d041bfa-91c8-4759-85f9-84e9f12ba8c7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103" status: 200 len: 1316 microversion: 2.1 time: 0.165314 Oct 05 02:31:25.126269 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 554/1113] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:24 2022] GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103 => generated 1316 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:25.274851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0d00bef0-af84-47d9-abe4-d6fcc899a39c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:25.276446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0d00bef0-af84-47d9-abe4-d6fcc899a39c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] [instance: e31b9992-fb63-4a85-82e7-a8a04238a6ad] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:25.286660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0d00bef0-af84-47d9-abe4-d6fcc899a39c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:25.287480 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0d00bef0-af84-47d9-abe4-d6fcc899a39c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:25.288190 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0d00bef0-af84-47d9-abe4-d6fcc899a39c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:25.289183 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0d00bef0-af84-47d9-abe4-d6fcc899a39c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:25.289740 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0d00bef0-af84-47d9-abe4-d6fcc899a39c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:25.290517 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0d00bef0-af84-47d9-abe4-d6fcc899a39c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:25.367651 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0d00bef0-af84-47d9-abe4-d6fcc899a39c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6748c4cd29482ca1bcfee6781a0cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c46317b81ae456ebfb65d1d3eb0906e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:25.378234 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0d00bef0-af84-47d9-abe4-d6fcc899a39c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] 10.222.0.16 "GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad" status: 200 len: 1280 microversion: 2.1 time: 0.107147 Oct 05 02:31:25.386497 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 560/1114] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:25 2022] GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad => generated 1280 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:25.459987 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-76111d4f-d653-46b5-b181-e5852fcea786 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:25.460604 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-76111d4f-d653-46b5-b181-e5852fcea786 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:25.467393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-76111d4f-d653-46b5-b181-e5852fcea786 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:25.467895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-76111d4f-d653-46b5-b181-e5852fcea786 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:25.469569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-76111d4f-d653-46b5-b181-e5852fcea786 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:25.470300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-76111d4f-d653-46b5-b181-e5852fcea786 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:25.470771 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-76111d4f-d653-46b5-b181-e5852fcea786 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:25.471206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-76111d4f-d653-46b5-b181-e5852fcea786 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:25.600778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7b22f4b8-9b2c-4187-8315-860d73d35b39 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:25.601437 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7b22f4b8-9b2c-4187-8315-860d73d35b39 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:25.618900 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b22f4b8-9b2c-4187-8315-860d73d35b39 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:25.619406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b22f4b8-9b2c-4187-8315-860d73d35b39 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:25.619847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b22f4b8-9b2c-4187-8315-860d73d35b39 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:25.620753 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b22f4b8-9b2c-4187-8315-860d73d35b39 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:25.621252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b22f4b8-9b2c-4187-8315-860d73d35b39 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:25.621685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b22f4b8-9b2c-4187-8315-860d73d35b39 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:25.726932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-7b22f4b8-9b2c-4187-8315-860d73d35b39 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lazy-loading 'services' on Instance uuid 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:31:25.744573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-76111d4f-d653-46b5-b181-e5852fcea786 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:25.752234 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7b22f4b8-9b2c-4187-8315-860d73d35b39 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1933 microversion: 2.75 time: 0.155081 Oct 05 02:31:25.753505 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 561/1115] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:25 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1933 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:31:25.758217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-2cc95f9b-9a6a-477d-a3ac-ccdeda177dad req-c628193c-2045-463e-81b4-f7f7b96ef93f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9c9522c-a640-49f4-9cb9-0dcf19eea103", "name": "network-vif-plugged", "status": "completed", "tag": "39bdaef6-a403-4edc-8790-c97d27f2a7ca"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:25.766674 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-76111d4f-d653-46b5-b181-e5852fcea786 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1472 microversion: 2.1 time: 0.310438 Oct 05 02:31:25.767291 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 555/1116] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:25 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1472 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:25.768775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-2cc95f9b-9a6a-477d-a3ac-ccdeda177dad req-c628193c-2045-463e-81b4-f7f7b96ef93f service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:25.769449 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-2cc95f9b-9a6a-477d-a3ac-ccdeda177dad req-c628193c-2045-463e-81b4-f7f7b96ef93f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:25.770057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-2cc95f9b-9a6a-477d-a3ac-ccdeda177dad req-c628193c-2045-463e-81b4-f7f7b96ef93f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:25.792476 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-2cc95f9b-9a6a-477d-a3ac-ccdeda177dad req-c628193c-2045-463e-81b4-f7f7b96ef93f service nova] Creating event network-vif-plugged:39bdaef6-a403-4edc-8790-c97d27f2a7ca for instance a9c9522c-a640-49f4-9cb9-0dcf19eea103 on n-h2-858272-3 Oct 05 02:31:25.797864 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-2cc95f9b-9a6a-477d-a3ac-ccdeda177dad req-c628193c-2045-463e-81b4-f7f7b96ef93f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042878 Oct 05 02:31:25.798509 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 562/1117] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:31:26.151380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3ff3d4b7-06e0-4228-8389-65e494dd2ce4 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:26.152261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3ff3d4b7-06e0-4228-8389-65e494dd2ce4 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: a9c9522c-a640-49f4-9cb9-0dcf19eea103] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:26.159974 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3ff3d4b7-06e0-4228-8389-65e494dd2ce4 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:26.160708 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3ff3d4b7-06e0-4228-8389-65e494dd2ce4 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:26.161168 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3ff3d4b7-06e0-4228-8389-65e494dd2ce4 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:26.162030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3ff3d4b7-06e0-4228-8389-65e494dd2ce4 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:26.162623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3ff3d4b7-06e0-4228-8389-65e494dd2ce4 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:26.163193 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3ff3d4b7-06e0-4228-8389-65e494dd2ce4 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:26.319403 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3ff3d4b7-06e0-4228-8389-65e494dd2ce4 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:26.327178 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3ff3d4b7-06e0-4228-8389-65e494dd2ce4 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103" status: 200 len: 1316 microversion: 2.1 time: 0.179619 Oct 05 02:31:26.340994 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 556/1118] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:26 2022] GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103 => generated 1316 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:26.403675 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a79a6447-30aa-460f-9200-d79384e6edaf tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:26.404499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a79a6447-30aa-460f-9200-d79384e6edaf tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] [instance: e31b9992-fb63-4a85-82e7-a8a04238a6ad] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:26.411894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a79a6447-30aa-460f-9200-d79384e6edaf tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:26.412817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a79a6447-30aa-460f-9200-d79384e6edaf tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:26.413919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a79a6447-30aa-460f-9200-d79384e6edaf tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:26.414987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a79a6447-30aa-460f-9200-d79384e6edaf tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:26.415629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a79a6447-30aa-460f-9200-d79384e6edaf tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:26.416182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a79a6447-30aa-460f-9200-d79384e6edaf tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:26.516374 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a79a6447-30aa-460f-9200-d79384e6edaf tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6748c4cd29482ca1bcfee6781a0cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c46317b81ae456ebfb65d1d3eb0906e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:26.525040 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a79a6447-30aa-460f-9200-d79384e6edaf tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] 10.222.0.16 "GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad" status: 200 len: 1286 microversion: 2.1 time: 0.126127 Oct 05 02:31:26.525967 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 563/1119] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:26 2022] GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad => generated 1286 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:26.792887 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-733a6d26-73d9-4c91-b232-b7758c6e350e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:26.795708 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c61d8d4a-a40c-4fcb-80db-0cabcdab2833 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:26.797291 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c61d8d4a-a40c-4fcb-80db-0cabcdab2833 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:26.797693 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-733a6d26-73d9-4c91-b232-b7758c6e350e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:26.815910 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-733a6d26-73d9-4c91-b232-b7758c6e350e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:26.816429 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-733a6d26-73d9-4c91-b232-b7758c6e350e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:26.816873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-733a6d26-73d9-4c91-b232-b7758c6e350e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:26.817616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-733a6d26-73d9-4c91-b232-b7758c6e350e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:26.818076 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-733a6d26-73d9-4c91-b232-b7758c6e350e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:26.818501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-733a6d26-73d9-4c91-b232-b7758c6e350e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:26.820362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c61d8d4a-a40c-4fcb-80db-0cabcdab2833 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:26.821043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c61d8d4a-a40c-4fcb-80db-0cabcdab2833 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:26.821657 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c61d8d4a-a40c-4fcb-80db-0cabcdab2833 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:26.822524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c61d8d4a-a40c-4fcb-80db-0cabcdab2833 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:26.823130 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c61d8d4a-a40c-4fcb-80db-0cabcdab2833 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:26.825493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c61d8d4a-a40c-4fcb-80db-0cabcdab2833 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:26.967234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-c61d8d4a-a40c-4fcb-80db-0cabcdab2833 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] Lazy-loading 'services' on Instance uuid 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:31:26.971656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:26.992610 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c61d8d4a-a40c-4fcb-80db-0cabcdab2833 tempest-ServersAdmin275Test-2128387918 tempest-ServersAdmin275Test-2128387918-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1918 microversion: 2.75 time: 0.208162 Oct 05 02:31:26.994179 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 557/1120] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:26 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1918 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:31:27.033439 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-09453201-dd5d-4f53-b969-663f19d9ec48 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:27.034230 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-09453201-dd5d-4f53-b969-663f19d9ec48 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:27.041274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09453201-dd5d-4f53-b969-663f19d9ec48 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:27.041776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09453201-dd5d-4f53-b969-663f19d9ec48 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:27.042221 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09453201-dd5d-4f53-b969-663f19d9ec48 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:27.043083 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09453201-dd5d-4f53-b969-663f19d9ec48 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:27.043504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09453201-dd5d-4f53-b969-663f19d9ec48 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:27.043929 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09453201-dd5d-4f53-b969-663f19d9ec48 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:27.076950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-09453201-dd5d-4f53-b969-663f19d9ec48 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:31:27.139504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-733a6d26-73d9-4c91-b232-b7758c6e350e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:27.149019 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-733a6d26-73d9-4c91-b232-b7758c6e350e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1472 microversion: 2.1 time: 0.362029 Oct 05 02:31:27.149604 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 564/1121] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:26 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1472 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:27.154674 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-81c4f623-f529-4763-9170-ea63870acd87 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7d4c6fe-b19d-4440-9206-b72634329e32", "device": "/dev/xvdb"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:27.158273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-81c4f623-f529-4763-9170-ea63870acd87 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:27.165336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81c4f623-f529-4763-9170-ea63870acd87 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:27.166073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81c4f623-f529-4763-9170-ea63870acd87 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:27.166723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81c4f623-f529-4763-9170-ea63870acd87 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:27.169231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81c4f623-f529-4763-9170-ea63870acd87 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:27.169901 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81c4f623-f529-4763-9170-ea63870acd87 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:27.170445 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81c4f623-f529-4763-9170-ea63870acd87 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:27.194185 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-09453201-dd5d-4f53-b969-663f19d9ec48 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 204 len: 0 microversion: 2.75 time: 0.167380 Oct 05 02:31:27.195327 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 558/1122] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 5 02:31:27 2022] DELETE /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 05 02:31:27.206496 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-11c1252e-39e5-4908-b3a8-a7a3a60f680c tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:27.207529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-11c1252e-39e5-4908-b3a8-a7a3a60f680c tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:27.215549 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11c1252e-39e5-4908-b3a8-a7a3a60f680c tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:27.216133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11c1252e-39e5-4908-b3a8-a7a3a60f680c tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:27.216644 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11c1252e-39e5-4908-b3a8-a7a3a60f680c tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:27.217674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11c1252e-39e5-4908-b3a8-a7a3a60f680c tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:27.218733 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11c1252e-39e5-4908-b3a8-a7a3a60f680c tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:27.219232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11c1252e-39e5-4908-b3a8-a7a3a60f680c tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:27.341391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-11c1252e-39e5-4908-b3a8-a7a3a60f680c tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:27.349921 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-11c1252e-39e5-4908-b3a8-a7a3a60f680c tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:27.351606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-11c1252e-39e5-4908-b3a8-a7a3a60f680c tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:27.357065 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-11c1252e-39e5-4908-b3a8-a7a3a60f680c tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1443 microversion: 2.75 time: 0.156765 Oct 05 02:31:27.357712 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 559/1123] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:27 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1443 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:31:27.363488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8b06d9f8-0c3d-42c7-a80a-45b85ae7bb8a tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:27.364422 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8b06d9f8-0c3d-42c7-a80a-45b85ae7bb8a tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: a9c9522c-a640-49f4-9cb9-0dcf19eea103] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:27.370485 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b06d9f8-0c3d-42c7-a80a-45b85ae7bb8a tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:27.371044 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b06d9f8-0c3d-42c7-a80a-45b85ae7bb8a tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:27.371476 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b06d9f8-0c3d-42c7-a80a-45b85ae7bb8a tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:27.372167 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b06d9f8-0c3d-42c7-a80a-45b85ae7bb8a tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:27.372615 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b06d9f8-0c3d-42c7-a80a-45b85ae7bb8a tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:27.373060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b06d9f8-0c3d-42c7-a80a-45b85ae7bb8a tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:27.556651 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:27.586400 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-81c4f623-f529-4763-9170-ea63870acd87 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "POST /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.435244 Oct 05 02:31:27.597099 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 565/1124] 10.222.0.16 () {62 vars in 1364 bytes} [Wed Oct 5 02:31:27 2022] POST /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0/os-volume_attachments => generated 194 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:31:27.606467 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8bce71f0-4ac7-456b-866d-bddcee8cf6d8 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:27.607152 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8bce71f0-4ac7-456b-866d-bddcee8cf6d8 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] [instance: e31b9992-fb63-4a85-82e7-a8a04238a6ad] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:27.622334 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bce71f0-4ac7-456b-866d-bddcee8cf6d8 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:27.622835 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bce71f0-4ac7-456b-866d-bddcee8cf6d8 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:27.623276 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bce71f0-4ac7-456b-866d-bddcee8cf6d8 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:27.625079 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bce71f0-4ac7-456b-866d-bddcee8cf6d8 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:27.626058 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bce71f0-4ac7-456b-866d-bddcee8cf6d8 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:27.626503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bce71f0-4ac7-456b-866d-bddcee8cf6d8 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:27.740138 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8b06d9f8-0c3d-42c7-a80a-45b85ae7bb8a tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:27.748222 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8b06d9f8-0c3d-42c7-a80a-45b85ae7bb8a tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103" status: 200 len: 1316 microversion: 2.1 time: 0.389352 Oct 05 02:31:27.748787 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 560/1125] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:27 2022] GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103 => generated 1316 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:28.174634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-66566d04-40bf-4a11-b1e1-588d8ac49f2f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:28.176351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8bce71f0-4ac7-456b-866d-bddcee8cf6d8 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6748c4cd29482ca1bcfee6781a0cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c46317b81ae456ebfb65d1d3eb0906e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:28.179848 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-66566d04-40bf-4a11-b1e1-588d8ac49f2f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:28.188568 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8bce71f0-4ac7-456b-866d-bddcee8cf6d8 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] 10.222.0.16 "GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad" status: 200 len: 1328 microversion: 2.1 time: 0.588686 Oct 05 02:31:28.192157 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-66566d04-40bf-4a11-b1e1-588d8ac49f2f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:28.193100 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 566/1126] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:27 2022] GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad => generated 1328 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:28.193603 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-66566d04-40bf-4a11-b1e1-588d8ac49f2f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:28.194169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-66566d04-40bf-4a11-b1e1-588d8ac49f2f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:28.194931 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-66566d04-40bf-4a11-b1e1-588d8ac49f2f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:28.195627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-66566d04-40bf-4a11-b1e1-588d8ac49f2f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:28.196097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-66566d04-40bf-4a11-b1e1-588d8ac49f2f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:28.386913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2c49961e-275b-4ac9-a3ed-1f8212a0e351 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:28.387846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2c49961e-275b-4ac9-a3ed-1f8212a0e351 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:28.398356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c49961e-275b-4ac9-a3ed-1f8212a0e351 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:28.398948 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c49961e-275b-4ac9-a3ed-1f8212a0e351 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:28.399479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c49961e-275b-4ac9-a3ed-1f8212a0e351 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:28.400391 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c49961e-275b-4ac9-a3ed-1f8212a0e351 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:28.400966 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c49961e-275b-4ac9-a3ed-1f8212a0e351 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:28.401629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c49961e-275b-4ac9-a3ed-1f8212a0e351 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:28.425481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-66566d04-40bf-4a11-b1e1-588d8ac49f2f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:28.438241 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-66566d04-40bf-4a11-b1e1-588d8ac49f2f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1472 microversion: 2.1 time: 0.267662 Oct 05 02:31:28.455481 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 561/1127] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:28 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1472 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:28.529937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2c49961e-275b-4ac9-a3ed-1f8212a0e351 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:28.542484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2c49961e-275b-4ac9-a3ed-1f8212a0e351 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:28.546771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2c49961e-275b-4ac9-a3ed-1f8212a0e351 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:28.552614 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2c49961e-275b-4ac9-a3ed-1f8212a0e351 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1443 microversion: 2.75 time: 0.170239 Oct 05 02:31:28.565557 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 567/1128] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:28 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1443 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:31:28.597603 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-a9df296c-c30e-457a-9bf9-860367a63516 req-2c8c7cc0-648a-4068-a960-9bc861d5755c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e31b9992-fb63-4a85-82e7-a8a04238a6ad", "tag": "35800c36-81bb-4792-a10f-ead304df1713"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:28.619514 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a9df296c-c30e-457a-9bf9-860367a63516 req-2c8c7cc0-648a-4068-a960-9bc861d5755c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:28.620513 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a9df296c-c30e-457a-9bf9-860367a63516 req-2c8c7cc0-648a-4068-a960-9bc861d5755c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:28.621774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a9df296c-c30e-457a-9bf9-860367a63516 req-2c8c7cc0-648a-4068-a960-9bc861d5755c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:28.638579 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-a9df296c-c30e-457a-9bf9-860367a63516 req-2c8c7cc0-648a-4068-a960-9bc861d5755c service nova] Creating event network-changed:35800c36-81bb-4792-a10f-ead304df1713 for instance e31b9992-fb63-4a85-82e7-a8a04238a6ad on n-h1-858272-3 Oct 05 02:31:28.657916 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-a9df296c-c30e-457a-9bf9-860367a63516 req-2c8c7cc0-648a-4068-a960-9bc861d5755c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063982 Oct 05 02:31:28.659284 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 562/1129] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:31:28.774658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-613b04bf-e635-4fbe-9d82-cc71b19b4ef7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:28.775824 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-613b04bf-e635-4fbe-9d82-cc71b19b4ef7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: a9c9522c-a640-49f4-9cb9-0dcf19eea103] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:28.796011 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-613b04bf-e635-4fbe-9d82-cc71b19b4ef7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:28.797128 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-613b04bf-e635-4fbe-9d82-cc71b19b4ef7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:28.797571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-613b04bf-e635-4fbe-9d82-cc71b19b4ef7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:28.798741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-613b04bf-e635-4fbe-9d82-cc71b19b4ef7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:28.798741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-613b04bf-e635-4fbe-9d82-cc71b19b4ef7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:28.799139 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-613b04bf-e635-4fbe-9d82-cc71b19b4ef7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:29.047462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-613b04bf-e635-4fbe-9d82-cc71b19b4ef7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:29.060195 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-613b04bf-e635-4fbe-9d82-cc71b19b4ef7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103" status: 200 len: 1504 microversion: 2.1 time: 0.292767 Oct 05 02:31:29.061592 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 568/1130] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:28 2022] GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103 => generated 1504 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:29.084620 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4c06ba9a-dbeb-4a24-b508-141e812a4ca1 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2136439050"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:29.085302 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4c06ba9a-dbeb-4a24-b508-141e812a4ca1 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: a9c9522c-a640-49f4-9cb9-0dcf19eea103] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:29.091993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c06ba9a-dbeb-4a24-b508-141e812a4ca1 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:29.092492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c06ba9a-dbeb-4a24-b508-141e812a4ca1 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:29.093031 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c06ba9a-dbeb-4a24-b508-141e812a4ca1 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:29.094477 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c06ba9a-dbeb-4a24-b508-141e812a4ca1 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:29.094944 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c06ba9a-dbeb-4a24-b508-141e812a4ca1 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:29.095373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c06ba9a-dbeb-4a24-b508-141e812a4ca1 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:29.215875 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1b631c94-abfd-4487-b8d0-1840d61b24b8 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:29.217187 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1b631c94-abfd-4487-b8d0-1840d61b24b8 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] [instance: e31b9992-fb63-4a85-82e7-a8a04238a6ad] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:29.224354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b631c94-abfd-4487-b8d0-1840d61b24b8 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:29.225167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b631c94-abfd-4487-b8d0-1840d61b24b8 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:29.226093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b631c94-abfd-4487-b8d0-1840d61b24b8 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:29.227015 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b631c94-abfd-4487-b8d0-1840d61b24b8 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:29.227637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b631c94-abfd-4487-b8d0-1840d61b24b8 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:29.228229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b631c94-abfd-4487-b8d0-1840d61b24b8 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:29.373627 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.network.security_group_api [None req-4c06ba9a-dbeb-4a24-b508-141e812a4ca1 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Adding security group 819f388a-be3f-4126-a3bc-c10860e11269 to port 39bdaef6-a403-4edc-8790-c97d27f2a7ca Oct 05 02:31:29.668712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1b631c94-abfd-4487-b8d0-1840d61b24b8 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6748c4cd29482ca1bcfee6781a0cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c46317b81ae456ebfb65d1d3eb0906e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:29.690268 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1b631c94-abfd-4487-b8d0-1840d61b24b8 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] 10.222.0.16 "GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad" status: 200 len: 1328 microversion: 2.1 time: 0.477995 Oct 05 02:31:29.693923 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 569/1131] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:29 2022] GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad => generated 1328 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:31:29.708792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c40036d9-a90a-4ab8-af13-b909b1733f6a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:29.712390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c40036d9-a90a-4ab8-af13-b909b1733f6a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:29.727310 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c40036d9-a90a-4ab8-af13-b909b1733f6a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:29.728105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c40036d9-a90a-4ab8-af13-b909b1733f6a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:29.728703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c40036d9-a90a-4ab8-af13-b909b1733f6a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:29.729725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c40036d9-a90a-4ab8-af13-b909b1733f6a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:29.730443 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c40036d9-a90a-4ab8-af13-b909b1733f6a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:29.731125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c40036d9-a90a-4ab8-af13-b909b1733f6a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:30.097370 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c40036d9-a90a-4ab8-af13-b909b1733f6a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:30.106314 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c40036d9-a90a-4ab8-af13-b909b1733f6a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1472 microversion: 2.1 time: 0.411031 Oct 05 02:31:30.112107 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 570/1132] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:29 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1472 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:30.119446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1fccd15a-4d16-491d-a9b2-6e99a182f1b1 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:30.120052 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1fccd15a-4d16-491d-a9b2-6e99a182f1b1 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:30.131773 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1fccd15a-4d16-491d-a9b2-6e99a182f1b1 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:30.132266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1fccd15a-4d16-491d-a9b2-6e99a182f1b1 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:30.132696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1fccd15a-4d16-491d-a9b2-6e99a182f1b1 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:30.133442 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1fccd15a-4d16-491d-a9b2-6e99a182f1b1 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:30.133878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1fccd15a-4d16-491d-a9b2-6e99a182f1b1 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:30.134293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1fccd15a-4d16-491d-a9b2-6e99a182f1b1 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:30.225906 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1fccd15a-4d16-491d-a9b2-6e99a182f1b1 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:30.226564 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1fccd15a-4d16-491d-a9b2-6e99a182f1b1 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:30.227295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1fccd15a-4d16-491d-a9b2-6e99a182f1b1 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:30.227802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-1fccd15a-4d16-491d-a9b2-6e99a182f1b1 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lazy-loading 'fault' on Instance uuid 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:31:30.298053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1fccd15a-4d16-491d-a9b2-6e99a182f1b1 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:30.310992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1fccd15a-4d16-491d-a9b2-6e99a182f1b1 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:30.314156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1fccd15a-4d16-491d-a9b2-6e99a182f1b1 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd698bef448a74da2ac299d978c5a6c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c7d71b3c0143e8b5247b08cff3b280', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:30.322281 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1fccd15a-4d16-491d-a9b2-6e99a182f1b1 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 200 len: 1448 microversion: 2.75 time: 0.208851 Oct 05 02:31:30.323524 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 571/1133] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:30 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 1448 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:31:30.333338 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4c06ba9a-dbeb-4a24-b508-141e812a4ca1 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "POST /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103/action" status: 202 len: 0 microversion: 2.1 time: 1.252594 Oct 05 02:31:30.334235 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 563/1134] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:31:29 2022] POST /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103/action => generated 0 bytes in 1255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:31:30.362883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-32a2f735-c057-4aec-b8f1-23bb33bc73ba tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1050756724"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:30.364672 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-32a2f735-c057-4aec-b8f1-23bb33bc73ba tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: a9c9522c-a640-49f4-9cb9-0dcf19eea103] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:30.377719 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32a2f735-c057-4aec-b8f1-23bb33bc73ba tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:30.379064 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32a2f735-c057-4aec-b8f1-23bb33bc73ba tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:30.380087 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32a2f735-c057-4aec-b8f1-23bb33bc73ba tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:30.381931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32a2f735-c057-4aec-b8f1-23bb33bc73ba tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:30.383020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32a2f735-c057-4aec-b8f1-23bb33bc73ba tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:30.383994 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32a2f735-c057-4aec-b8f1-23bb33bc73ba tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:30.602003 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.network.security_group_api [None req-32a2f735-c057-4aec-b8f1-23bb33bc73ba tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Adding security group 19520275-b7cd-4132-8539-42a9f18fde42 to port 39bdaef6-a403-4edc-8790-c97d27f2a7ca Oct 05 02:31:30.675386 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-03ffa9e7-17f2-4fa6-a707-365ff2a718fe req-b31826f9-a7a6-46c4-80d2-4240686f853c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9c9522c-a640-49f4-9cb9-0dcf19eea103", "tag": "39bdaef6-a403-4edc-8790-c97d27f2a7ca"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:30.691045 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-03ffa9e7-17f2-4fa6-a707-365ff2a718fe req-b31826f9-a7a6-46c4-80d2-4240686f853c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:30.693468 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-03ffa9e7-17f2-4fa6-a707-365ff2a718fe req-b31826f9-a7a6-46c4-80d2-4240686f853c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:30.694187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-03ffa9e7-17f2-4fa6-a707-365ff2a718fe req-b31826f9-a7a6-46c4-80d2-4240686f853c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:30.716816 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-03ffa9e7-17f2-4fa6-a707-365ff2a718fe req-b31826f9-a7a6-46c4-80d2-4240686f853c service nova] Creating event network-changed:39bdaef6-a403-4edc-8790-c97d27f2a7ca for instance a9c9522c-a640-49f4-9cb9-0dcf19eea103 on n-h2-858272-3 Oct 05 02:31:30.725408 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-03ffa9e7-17f2-4fa6-a707-365ff2a718fe req-b31826f9-a7a6-46c4-80d2-4240686f853c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055616 Oct 05 02:31:30.726855 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 564/1135] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:31:30.735177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9e7a2234-306c-4c68-9eae-4e3b5efbd7ce tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:30.736580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9e7a2234-306c-4c68-9eae-4e3b5efbd7ce tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] [instance: e31b9992-fb63-4a85-82e7-a8a04238a6ad] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:30.745787 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e7a2234-306c-4c68-9eae-4e3b5efbd7ce tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:30.746531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e7a2234-306c-4c68-9eae-4e3b5efbd7ce tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:30.747172 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e7a2234-306c-4c68-9eae-4e3b5efbd7ce tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:30.748195 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e7a2234-306c-4c68-9eae-4e3b5efbd7ce tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:30.748844 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e7a2234-306c-4c68-9eae-4e3b5efbd7ce tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:30.749641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e7a2234-306c-4c68-9eae-4e3b5efbd7ce tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:31.145237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9e7a2234-306c-4c68-9eae-4e3b5efbd7ce tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6748c4cd29482ca1bcfee6781a0cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c46317b81ae456ebfb65d1d3eb0906e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:31.153586 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9e7a2234-306c-4c68-9eae-4e3b5efbd7ce tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] 10.222.0.16 "GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad" status: 200 len: 1328 microversion: 2.1 time: 0.425195 Oct 05 02:31:31.157956 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 565/1136] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:30 2022] GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad => generated 1328 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:31.164424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-65d91ac4-3fc1-4387-910f-9ee633193efc tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:31.168148 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-65d91ac4-3fc1-4387-910f-9ee633193efc tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:31.180591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-65d91ac4-3fc1-4387-910f-9ee633193efc tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:31.185226 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-65d91ac4-3fc1-4387-910f-9ee633193efc tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:31.192869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-65d91ac4-3fc1-4387-910f-9ee633193efc tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:31.193822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-65d91ac4-3fc1-4387-910f-9ee633193efc tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:31.194309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-65d91ac4-3fc1-4387-910f-9ee633193efc tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:31.194751 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-65d91ac4-3fc1-4387-910f-9ee633193efc tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:31.428821 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-32a2f735-c057-4aec-b8f1-23bb33bc73ba tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "POST /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103/action" status: 202 len: 0 microversion: 2.1 time: 1.077267 Oct 05 02:31:31.429945 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 572/1137] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:31:30 2022] POST /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103/action => generated 0 bytes in 1080 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:31:31.435827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-05eb2e75-dbe6-48a7-a39b-8d1811ba6292 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:31.436594 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-05eb2e75-dbe6-48a7-a39b-8d1811ba6292 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] [instance: 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:31.444719 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05eb2e75-dbe6-48a7-a39b-8d1811ba6292 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:31.445360 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05eb2e75-dbe6-48a7-a39b-8d1811ba6292 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:31.446123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05eb2e75-dbe6-48a7-a39b-8d1811ba6292 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:31.446928 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05eb2e75-dbe6-48a7-a39b-8d1811ba6292 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:31.447759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05eb2e75-dbe6-48a7-a39b-8d1811ba6292 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:31.448738 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05eb2e75-dbe6-48a7-a39b-8d1811ba6292 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:31.466254 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-05eb2e75-dbe6-48a7-a39b-8d1811ba6292 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] HTTP exception thrown: Instance 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d could not be found. Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-05eb2e75-dbe6-48a7-a39b-8d1811ba6292 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Request method failure captured: Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d HTTP/1.1 Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOwkj3xdNXTkbbPRyKN_W3_ZRu1cJY4j_kPPvpwOhbTiM2DMepTHK5v6ezchwqZs-D-P7Rsx5P0P5qGXwZxsXa3f7hiwPbs0n-l1nTeDkkeiE6AMXw4HMlY7Cs-UC8abtW-yE2WbNiqtQArbYNGManjE3qvZi81SFAmb6Bm9vOumYZc Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: X-Openstack-Nova-Api-Version: 2.75 Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 68c7d71b3c0143e8b5247b08cff3b280 Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersAdmin275Test-768474031 Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68c7d71b3c0143e8b5247b08cff3b280"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68c7d71b3c0143e8b5247b08cff3b280"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/68c7d71b3c0143e8b5247b08cff3b280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_68c7d71b3c0143e8b5247b08cff3b280"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersAdmin275Test-768474031 Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 68c7d71b3c0143e8b5247b08cff3b280 Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersAdmin275Test-768474031 Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersAdmin275Test-768474031-project Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: d698bef448a74da2ac299d978c5a6c66 Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersAdmin275Test-768474031-project Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d could not be found. Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '4bc8d72b-7daf-4bb8-84c8-68fef3064a4d'} Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d could not be found. Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d could not be found. Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:31:31.468479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:31:31.475008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:31.475008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:31:31.475008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:31:31.475008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:31:31.475008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:31:31.475008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d could not be found. Oct 05 02:31:31.475008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:31:31.479021 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-05eb2e75-dbe6-48a7-a39b-8d1811ba6292 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] Returning 404 to user: Instance 4bc8d72b-7daf-4bb8-84c8-68fef3064a4d could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:31:31.480149 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-05eb2e75-dbe6-48a7-a39b-8d1811ba6292 tempest-ServersAdmin275Test-768474031 tempest-ServersAdmin275Test-768474031-project] 10.222.0.16 "GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d" status: 404 len: 111 microversion: 2.75 time: 0.049131 Oct 05 02:31:31.481028 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 573/1138] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:31 2022] GET /compute/v2.1/servers/4bc8d72b-7daf-4bb8-84c8-68fef3064a4d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:31:31.496290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-af069c57-8ade-47d6-a5fe-0b07520e4be2 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:31.502938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-af069c57-8ade-47d6-a5fe-0b07520e4be2 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: a9c9522c-a640-49f4-9cb9-0dcf19eea103] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:31.517362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-65d91ac4-3fc1-4387-910f-9ee633193efc tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:31.521420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af069c57-8ade-47d6-a5fe-0b07520e4be2 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:31.524483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af069c57-8ade-47d6-a5fe-0b07520e4be2 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:31.526361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af069c57-8ade-47d6-a5fe-0b07520e4be2 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:31.527955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af069c57-8ade-47d6-a5fe-0b07520e4be2 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:31.532529 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af069c57-8ade-47d6-a5fe-0b07520e4be2 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:31.533329 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af069c57-8ade-47d6-a5fe-0b07520e4be2 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:31.534344 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-65d91ac4-3fc1-4387-910f-9ee633193efc tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1472 microversion: 2.1 time: 0.375046 Oct 05 02:31:31.535157 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 566/1139] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:31 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1472 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:31.935060 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-af069c57-8ade-47d6-a5fe-0b07520e4be2 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.452437 Oct 05 02:31:31.946392 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 574/1140] 10.222.0.16 () {58 vars in 1293 bytes} [Wed Oct 5 02:31:31 2022] GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103/os-security-groups => generated 1157 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:31.956857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2a0c4380-0e7d-4f41-b6af-32d6c685d8e0 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Action: 'create', calling method: .version_select at 0x7fccdff804c0>, body: {"security_group": {"name": " tempest-securitygroup -502705620 ", "description": "tempest-description-1576077416"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:31.978950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=8 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:32.188511 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e7e3b1e0-89b1-4e39-bff8-fec2e0bf4616 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:32.189540 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e7e3b1e0-89b1-4e39-bff8-fec2e0bf4616 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] [instance: e31b9992-fb63-4a85-82e7-a8a04238a6ad] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:32.197097 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7e3b1e0-89b1-4e39-bff8-fec2e0bf4616 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:32.197972 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7e3b1e0-89b1-4e39-bff8-fec2e0bf4616 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:32.198734 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7e3b1e0-89b1-4e39-bff8-fec2e0bf4616 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:32.199670 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7e3b1e0-89b1-4e39-bff8-fec2e0bf4616 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:32.200643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7e3b1e0-89b1-4e39-bff8-fec2e0bf4616 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:32.201412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7e3b1e0-89b1-4e39-bff8-fec2e0bf4616 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:32.212450 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2a0c4380-0e7d-4f41-b6af-32d6c685d8e0 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.261575 Oct 05 02:31:32.213087 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 567/1141] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 5 02:31:31 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:31:32.229078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3e19aeaf-3487-4cde-97fd-57a07d896be9 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '.version_select at 0x7fccdfc81790>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:32.376598 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3e19aeaf-3487-4cde-97fd-57a07d896be9 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/d91df31e-b410-4afd-b7b2-ead004a550a4" status: 200 len: 223 microversion: 2.1 time: 0.152325 Oct 05 02:31:32.377675 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 568/1142] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 5 02:31:32 2022] GET /compute/v2.1/os-security-groups/d91df31e-b410-4afd-b7b2-ead004a550a4 => generated 223 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:31:32.393304 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1d65a0fe-b0af-4920-b679-19fc0202e6f3 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '.version_select at 0x7fccdfcc2940>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:32.457672 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e7e3b1e0-89b1-4e39-bff8-fec2e0bf4616 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6748c4cd29482ca1bcfee6781a0cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c46317b81ae456ebfb65d1d3eb0906e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:32.466143 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e7e3b1e0-89b1-4e39-bff8-fec2e0bf4616 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] 10.222.0.16 "GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad" status: 200 len: 1328 microversion: 2.1 time: 0.285741 Oct 05 02:31:32.466946 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 575/1143] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:32 2022] GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad => generated 1328 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:32.558053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-73ba31b6-afc9-4ebb-b365-1b8d68ce439c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:32.558950 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-73ba31b6-afc9-4ebb-b365-1b8d68ce439c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:32.567040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-73ba31b6-afc9-4ebb-b365-1b8d68ce439c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:32.567751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-73ba31b6-afc9-4ebb-b365-1b8d68ce439c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:32.568385 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-73ba31b6-afc9-4ebb-b365-1b8d68ce439c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:32.569115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-73ba31b6-afc9-4ebb-b365-1b8d68ce439c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:32.569902 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-73ba31b6-afc9-4ebb-b365-1b8d68ce439c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:32.570481 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-73ba31b6-afc9-4ebb-b365-1b8d68ce439c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:32.730566 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1d65a0fe-b0af-4920-b679-19fc0202e6f3 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/d91df31e-b410-4afd-b7b2-ead004a550a4" status: 202 len: 0 microversion: 2.1 time: 0.343024 Oct 05 02:31:32.737416 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 569/1144] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:31:32 2022] DELETE /compute/v2.1/os-security-groups/d91df31e-b410-4afd-b7b2-ead004a550a4 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:31:32.741949 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ff56625e-2362-475e-a829-ec60270737e0 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '.version_select at 0x7fccdfcc2550>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:32.792005 n-d-858272-3 devstack@n-api.service[122320]: DEBUG neutronclient.v2_0.client [None req-ff56625e-2362-475e-a829-ec60270737e0 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d91df31e-b410-4afd-b7b2-ead004a550a4 does not exist", "detail": ""}} {{(pid=122320) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 02:31:32.792654 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.security_group_api [None req-ff56625e-2362-475e-a829-ec60270737e0 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Neutron security group d91df31e-b410-4afd-b7b2-ead004a550a4 not found {{(pid=122320) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 05 02:31:32.793694 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-ff56625e-2362-475e-a829-ec60270737e0 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] HTTP exception thrown: Security group d91df31e-b410-4afd-b7b2-ead004a550a4 does not exist Oct 05 02:31:32.793694 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-31ee4a1c-022f-40cb-92bf-ee4881b4d404'] Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ff56625e-2362-475e-a829-ec60270737e0 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Request method failure captured: Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/os-security-groups/d91df31e-b410-4afd-b7b2-ead004a550a4 HTTP/1.1 Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOxsHfqJu7XBSEzDOBBt7syFIrL9J3OT791dcmShV5lM5pjmkDuONYQmP8-v9KquUBaUHsqFGt8nuaScu9b1kWZKpy9EaLULGZXiZUnDwZJ186OmmTbSMTU6SH3NtgLtLUXyXXhUjMZrhdeVS_vfD8uyVuQTvFy3dykhyOfc3uq0Kds Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c96108fae56640b6aa0cb68523504c43 Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c96108fae56640b6aa0cb68523504c43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c96108fae56640b6aa0cb68523504c43 Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-SecurityGroupsTestJSON-1913947248-project Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 9925b3a9a63c4b1cb98a8adcc28f916d Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-SecurityGroupsTestJSON-1913947248-project Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: exception: Security group d91df31e-b410-4afd-b7b2-ead004a550a4 does not exist Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-31ee4a1c-022f-40cb-92bf-ee4881b4d404'] Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'd91df31e-b410-4afd-b7b2-ead004a550a4'} Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 02:31:32.796738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d91df31e-b410-4afd-b7b2-ead004a550a4 does not exist Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31ee4a1c-022f-40cb-92bf-ee4881b4d404'] Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d91df31e-b410-4afd-b7b2-ead004a550a4 does not exist Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31ee4a1c-022f-40cb-92bf-ee4881b4d404'] Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d91df31e-b410-4afd-b7b2-ead004a550a4 does not exist Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31ee4a1c-022f-40cb-92bf-ee4881b4d404'] Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d91df31e-b410-4afd-b7b2-ead004a550a4 does not exist Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31ee4a1c-022f-40cb-92bf-ee4881b4d404'] Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ff56625e-2362-475e-a829-ec60270737e0 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Returning 404 to user: Security group d91df31e-b410-4afd-b7b2-ead004a550a4 does not exist Oct 05 02:31:32.801808 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-31ee4a1c-022f-40cb-92bf-ee4881b4d404'] {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:31:32.807370 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ff56625e-2362-475e-a829-ec60270737e0 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/d91df31e-b410-4afd-b7b2-ead004a550a4" status: 404 len: 194 microversion: 2.1 time: 0.064653 Oct 05 02:31:32.807491 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-73ba31b6-afc9-4ebb-b365-1b8d68ce439c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:32.807663 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 570/1145] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 5 02:31:32 2022] GET /compute/v2.1/os-security-groups/d91df31e-b410-4afd-b7b2-ead004a550a4 => generated 194 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:31:32.811871 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-e2b7c266-b872-4d84-a358-cccb51bab28e req-167fa78c-37c3-4bb6-a30e-a804e96fcfa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9c9522c-a640-49f4-9cb9-0dcf19eea103", "tag": "39bdaef6-a403-4edc-8790-c97d27f2a7ca"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:32.819531 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-73ba31b6-afc9-4ebb-b365-1b8d68ce439c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1472 microversion: 2.1 time: 0.265178 Oct 05 02:31:32.821689 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 576/1146] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:32 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1472 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:32.822536 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e2b7c266-b872-4d84-a358-cccb51bab28e req-167fa78c-37c3-4bb6-a30e-a804e96fcfa6 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:32.823250 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e2b7c266-b872-4d84-a358-cccb51bab28e req-167fa78c-37c3-4bb6-a30e-a804e96fcfa6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:32.823898 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e2b7c266-b872-4d84-a358-cccb51bab28e req-167fa78c-37c3-4bb6-a30e-a804e96fcfa6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:32.830258 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5598183a-07d7-4cea-a0ef-b85f1c2b9f8f tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Action: 'create', calling method: .version_select at 0x7fccdfd1b940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1874766703", "description": "tempest-description-439434170"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:32.837325 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-e2b7c266-b872-4d84-a358-cccb51bab28e req-167fa78c-37c3-4bb6-a30e-a804e96fcfa6 service nova] Creating event network-changed:39bdaef6-a403-4edc-8790-c97d27f2a7ca for instance a9c9522c-a640-49f4-9cb9-0dcf19eea103 on n-h2-858272-3 Oct 05 02:31:32.844760 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-e2b7c266-b872-4d84-a358-cccb51bab28e req-167fa78c-37c3-4bb6-a30e-a804e96fcfa6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039274 Oct 05 02:31:32.846033 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 571/1147] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:31:33.132810 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5598183a-07d7-4cea-a0ef-b85f1c2b9f8f tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.309083 Oct 05 02:31:33.134461 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 577/1148] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 5 02:31:32 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:31:33.154004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-58b97704-e9c7-4e06-9822-d18d0ba06d73 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Action: 'create', calling method: .version_select at 0x7fccdfc81b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1332460551", "description": "tempest-description-389750198"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:33.490094 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c3d4acb3-c2e6-4bee-bfcd-9c29f016100c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:33.490622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c3d4acb3-c2e6-4bee-bfcd-9c29f016100c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] [instance: e31b9992-fb63-4a85-82e7-a8a04238a6ad] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:33.497964 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3d4acb3-c2e6-4bee-bfcd-9c29f016100c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:33.499289 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3d4acb3-c2e6-4bee-bfcd-9c29f016100c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:33.500038 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3d4acb3-c2e6-4bee-bfcd-9c29f016100c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:33.500995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3d4acb3-c2e6-4bee-bfcd-9c29f016100c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:33.502146 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3d4acb3-c2e6-4bee-bfcd-9c29f016100c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:33.502815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3d4acb3-c2e6-4bee-bfcd-9c29f016100c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:33.614431 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-58b97704-e9c7-4e06-9822-d18d0ba06d73 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.468989 Oct 05 02:31:33.615242 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 572/1149] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 5 02:31:33 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:31:33.628711 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4c722a24-7896-4dc3-a79e-256e0292b1f0 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Action: 'create', calling method: .version_select at 0x7fccdfd24940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-806325925", "description": "tempest-description-924105424"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:33.837921 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c3d4acb3-c2e6-4bee-bfcd-9c29f016100c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6748c4cd29482ca1bcfee6781a0cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c46317b81ae456ebfb65d1d3eb0906e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:33.850228 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c3d4acb3-c2e6-4bee-bfcd-9c29f016100c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] 10.222.0.16 "GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad" status: 200 len: 1328 microversion: 2.1 time: 0.363904 Oct 05 02:31:33.867691 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 578/1150] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:33 2022] GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad => generated 1328 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:33.873440 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a23fe78e-031c-4ab8-8563-9b7f35bf1480 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:33.874957 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a23fe78e-031c-4ab8-8563-9b7f35bf1480 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:33.883184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a23fe78e-031c-4ab8-8563-9b7f35bf1480 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:33.883791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a23fe78e-031c-4ab8-8563-9b7f35bf1480 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:33.884327 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a23fe78e-031c-4ab8-8563-9b7f35bf1480 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:33.885197 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a23fe78e-031c-4ab8-8563-9b7f35bf1480 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:33.885752 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a23fe78e-031c-4ab8-8563-9b7f35bf1480 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:33.886405 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a23fe78e-031c-4ab8-8563-9b7f35bf1480 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:34.010851 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4c722a24-7896-4dc3-a79e-256e0292b1f0 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.386748 Oct 05 02:31:34.012932 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 573/1151] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 5 02:31:33 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:31:34.034379 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1b476e91-4cd7-41b8-b903-abe39cc86a47 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '.version_select at 0x7fccdfca7310>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:34.124140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a23fe78e-031c-4ab8-8563-9b7f35bf1480 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:34.134631 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a23fe78e-031c-4ab8-8563-9b7f35bf1480 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1472 microversion: 2.1 time: 0.273326 Oct 05 02:31:34.135777 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 579/1152] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:33 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1472 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:34.197105 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:34.318007 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1b476e91-4cd7-41b8-b903-abe39cc86a47 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 1831 microversion: 2.1 time: 0.296720 Oct 05 02:31:34.319112 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 574/1153] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 5 02:31:34 2022] GET /compute/v2.1/os-security-groups => generated 1831 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:34.335223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f1876587-af27-4cbd-a0da-0c08fd41a23a tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '.version_select at 0x7fccdfd1d5e0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:34.561353 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f1876587-af27-4cbd-a0da-0c08fd41a23a tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/e73c426f-b9f7-4d44-9250-7c9e836db762" status: 202 len: 0 microversion: 2.1 time: 0.230074 Oct 05 02:31:34.567159 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 580/1154] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:31:34 2022] DELETE /compute/v2.1/os-security-groups/e73c426f-b9f7-4d44-9250-7c9e836db762 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:31:34.572019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-63835ceb-5253-4b7f-859a-f5d1414335ce tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '.version_select at 0x7fccdfc81c10>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:34.603251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG neutronclient.v2_0.client [None req-63835ceb-5253-4b7f-859a-f5d1414335ce tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e73c426f-b9f7-4d44-9250-7c9e836db762 does not exist", "detail": ""}} {{(pid=122320) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 02:31:34.603850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.security_group_api [None req-63835ceb-5253-4b7f-859a-f5d1414335ce tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Neutron security group e73c426f-b9f7-4d44-9250-7c9e836db762 not found {{(pid=122320) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 05 02:31:34.604560 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-63835ceb-5253-4b7f-859a-f5d1414335ce tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] HTTP exception thrown: Security group e73c426f-b9f7-4d44-9250-7c9e836db762 does not exist Oct 05 02:31:34.604560 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-10808a39-43a1-4673-b98f-58ac6ec12aca'] Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-63835ceb-5253-4b7f-859a-f5d1414335ce tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Request method failure captured: Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/os-security-groups/e73c426f-b9f7-4d44-9250-7c9e836db762 HTTP/1.1 Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOxsHfqJu7XBSEzDOBBt7syFIrL9J3OT791dcmShV5lM5pjmkDuONYQmP8-v9KquUBaUHsqFGt8nuaScu9b1kWZKpy9EaLULGZXiZUnDwZJ186OmmTbSMTU6SH3NtgLtLUXyXXhUjMZrhdeVS_vfD8uyVuQTvFy3dykhyOfc3uq0Kds Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c96108fae56640b6aa0cb68523504c43 Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c96108fae56640b6aa0cb68523504c43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c96108fae56640b6aa0cb68523504c43 Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-SecurityGroupsTestJSON-1913947248-project Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 9925b3a9a63c4b1cb98a8adcc28f916d Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-SecurityGroupsTestJSON-1913947248-project Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: exception: Security group e73c426f-b9f7-4d44-9250-7c9e836db762 does not exist Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-10808a39-43a1-4673-b98f-58ac6ec12aca'] Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'e73c426f-b9f7-4d44-9250-7c9e836db762'} Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 02:31:34.606590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e73c426f-b9f7-4d44-9250-7c9e836db762 does not exist Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10808a39-43a1-4673-b98f-58ac6ec12aca'] Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e73c426f-b9f7-4d44-9250-7c9e836db762 does not exist Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10808a39-43a1-4673-b98f-58ac6ec12aca'] Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e73c426f-b9f7-4d44-9250-7c9e836db762 does not exist Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10808a39-43a1-4673-b98f-58ac6ec12aca'] Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e73c426f-b9f7-4d44-9250-7c9e836db762 does not exist Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10808a39-43a1-4673-b98f-58ac6ec12aca'] Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-63835ceb-5253-4b7f-859a-f5d1414335ce tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Returning 404 to user: Security group e73c426f-b9f7-4d44-9250-7c9e836db762 does not exist Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-10808a39-43a1-4673-b98f-58ac6ec12aca'] {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:31:34.611160 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-63835ceb-5253-4b7f-859a-f5d1414335ce tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/e73c426f-b9f7-4d44-9250-7c9e836db762" status: 404 len: 194 microversion: 2.1 time: 0.040601 Oct 05 02:31:34.614329 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 575/1155] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 5 02:31:34 2022] GET /compute/v2.1/os-security-groups/e73c426f-b9f7-4d44-9250-7c9e836db762 => generated 194 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:31:34.620640 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7e4f27a2-4f8b-4560-b9c4-25f026975ff2 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '.version_select at 0x7fccdfd150d0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:34.822734 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7e4f27a2-4f8b-4560-b9c4-25f026975ff2 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/29b22fe0-ff7a-46bb-81cf-77860602871c" status: 202 len: 0 microversion: 2.1 time: 0.206333 Oct 05 02:31:34.826573 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 581/1156] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:31:34 2022] DELETE /compute/v2.1/os-security-groups/29b22fe0-ff7a-46bb-81cf-77860602871c => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:31:34.834645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-15fc837b-ba22-457a-9096-a7ffc4b2b76c tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '.version_select at 0x7fccdfca7ca0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:34.861496 n-d-858272-3 devstack@n-api.service[122320]: DEBUG neutronclient.v2_0.client [None req-15fc837b-ba22-457a-9096-a7ffc4b2b76c tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 29b22fe0-ff7a-46bb-81cf-77860602871c does not exist", "detail": ""}} {{(pid=122320) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 02:31:34.862284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.security_group_api [None req-15fc837b-ba22-457a-9096-a7ffc4b2b76c tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Neutron security group 29b22fe0-ff7a-46bb-81cf-77860602871c not found {{(pid=122320) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 05 02:31:34.862917 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-15fc837b-ba22-457a-9096-a7ffc4b2b76c tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] HTTP exception thrown: Security group 29b22fe0-ff7a-46bb-81cf-77860602871c does not exist Oct 05 02:31:34.862917 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-288de13d-fb5c-46c1-948e-bbbe4d194852'] Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-15fc837b-ba22-457a-9096-a7ffc4b2b76c tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Request method failure captured: Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/os-security-groups/29b22fe0-ff7a-46bb-81cf-77860602871c HTTP/1.1 Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOxsHfqJu7XBSEzDOBBt7syFIrL9J3OT791dcmShV5lM5pjmkDuONYQmP8-v9KquUBaUHsqFGt8nuaScu9b1kWZKpy9EaLULGZXiZUnDwZJ186OmmTbSMTU6SH3NtgLtLUXyXXhUjMZrhdeVS_vfD8uyVuQTvFy3dykhyOfc3uq0Kds Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c96108fae56640b6aa0cb68523504c43 Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c96108fae56640b6aa0cb68523504c43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c96108fae56640b6aa0cb68523504c43 Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-SecurityGroupsTestJSON-1913947248-project Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 9925b3a9a63c4b1cb98a8adcc28f916d Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-SecurityGroupsTestJSON-1913947248-project Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: exception: Security group 29b22fe0-ff7a-46bb-81cf-77860602871c does not exist Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-288de13d-fb5c-46c1-948e-bbbe4d194852'] Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '29b22fe0-ff7a-46bb-81cf-77860602871c'} Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 02:31:34.865111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 29b22fe0-ff7a-46bb-81cf-77860602871c does not exist Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-288de13d-fb5c-46c1-948e-bbbe4d194852'] Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 29b22fe0-ff7a-46bb-81cf-77860602871c does not exist Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-288de13d-fb5c-46c1-948e-bbbe4d194852'] Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 29b22fe0-ff7a-46bb-81cf-77860602871c does not exist Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-288de13d-fb5c-46c1-948e-bbbe4d194852'] Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 29b22fe0-ff7a-46bb-81cf-77860602871c does not exist Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-288de13d-fb5c-46c1-948e-bbbe4d194852'] Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-15fc837b-ba22-457a-9096-a7ffc4b2b76c tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Returning 404 to user: Security group 29b22fe0-ff7a-46bb-81cf-77860602871c does not exist Oct 05 02:31:34.869581 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-288de13d-fb5c-46c1-948e-bbbe4d194852'] {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:31:34.873262 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-15fc837b-ba22-457a-9096-a7ffc4b2b76c tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/29b22fe0-ff7a-46bb-81cf-77860602871c" status: 404 len: 194 microversion: 2.1 time: 0.044217 Oct 05 02:31:34.874215 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 576/1157] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 5 02:31:34 2022] GET /compute/v2.1/os-security-groups/29b22fe0-ff7a-46bb-81cf-77860602871c => generated 194 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:31:34.875308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-79af9b82-d575-4287-a342-5007482dd4d5 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:34.875980 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-79af9b82-d575-4287-a342-5007482dd4d5 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] [instance: e31b9992-fb63-4a85-82e7-a8a04238a6ad] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:34.883386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79af9b82-d575-4287-a342-5007482dd4d5 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:34.883886 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79af9b82-d575-4287-a342-5007482dd4d5 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:34.884319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79af9b82-d575-4287-a342-5007482dd4d5 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:34.884435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-12e50115-dd6c-4585-a4db-b48239513d09 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '.version_select at 0x7fccdfcc2160>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:34.885044 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79af9b82-d575-4287-a342-5007482dd4d5 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:34.885496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79af9b82-d575-4287-a342-5007482dd4d5 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:34.885915 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79af9b82-d575-4287-a342-5007482dd4d5 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:35.094151 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-79af9b82-d575-4287-a342-5007482dd4d5 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6748c4cd29482ca1bcfee6781a0cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c46317b81ae456ebfb65d1d3eb0906e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:35.110644 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-79af9b82-d575-4287-a342-5007482dd4d5 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] 10.222.0.16 "GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad" status: 200 len: 1328 microversion: 2.1 time: 0.239423 Oct 05 02:31:35.126806 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 582/1158] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:34 2022] GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad => generated 1328 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:35.163209 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-21c3d1a9-6018-4736-8ef9-4d719a56de4a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:35.164231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-21c3d1a9-6018-4736-8ef9-4d719a56de4a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:35.182946 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-21c3d1a9-6018-4736-8ef9-4d719a56de4a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:35.183847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-21c3d1a9-6018-4736-8ef9-4d719a56de4a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:35.184451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-21c3d1a9-6018-4736-8ef9-4d719a56de4a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:35.188230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-21c3d1a9-6018-4736-8ef9-4d719a56de4a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:35.189125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-21c3d1a9-6018-4736-8ef9-4d719a56de4a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:35.189794 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-21c3d1a9-6018-4736-8ef9-4d719a56de4a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:35.190883 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-12e50115-dd6c-4585-a4db-b48239513d09 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/7cb132b2-3c93-4634-8b51-54f20c249146" status: 202 len: 0 microversion: 2.1 time: 0.312006 Oct 05 02:31:35.191531 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 577/1159] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:31:34 2022] DELETE /compute/v2.1/os-security-groups/7cb132b2-3c93-4634-8b51-54f20c249146 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 02:31:35.205800 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-38e18c63-50a4-4c66-b1c5-d1362fe80cc8 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '.version_select at 0x7fccdfcc2ee0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:35.242643 n-d-858272-3 devstack@n-api.service[122320]: DEBUG neutronclient.v2_0.client [None req-38e18c63-50a4-4c66-b1c5-d1362fe80cc8 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7cb132b2-3c93-4634-8b51-54f20c249146 does not exist", "detail": ""}} {{(pid=122320) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 02:31:35.244031 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.security_group_api [None req-38e18c63-50a4-4c66-b1c5-d1362fe80cc8 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Neutron security group 7cb132b2-3c93-4634-8b51-54f20c249146 not found {{(pid=122320) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 05 02:31:35.247095 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-38e18c63-50a4-4c66-b1c5-d1362fe80cc8 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] HTTP exception thrown: Security group 7cb132b2-3c93-4634-8b51-54f20c249146 does not exist Oct 05 02:31:35.247095 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-2c233eb6-0477-42c7-b010-5ed22a5a198a'] Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-38e18c63-50a4-4c66-b1c5-d1362fe80cc8 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Request method failure captured: Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/os-security-groups/7cb132b2-3c93-4634-8b51-54f20c249146 HTTP/1.1 Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOxsHfqJu7XBSEzDOBBt7syFIrL9J3OT791dcmShV5lM5pjmkDuONYQmP8-v9KquUBaUHsqFGt8nuaScu9b1kWZKpy9EaLULGZXiZUnDwZJ186OmmTbSMTU6SH3NtgLtLUXyXXhUjMZrhdeVS_vfD8uyVuQTvFy3dykhyOfc3uq0Kds Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c96108fae56640b6aa0cb68523504c43 Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c96108fae56640b6aa0cb68523504c43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c96108fae56640b6aa0cb68523504c43 Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-SecurityGroupsTestJSON-1913947248-project Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 9925b3a9a63c4b1cb98a8adcc28f916d Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-SecurityGroupsTestJSON-1913947248-project Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: exception: Security group 7cb132b2-3c93-4634-8b51-54f20c249146 does not exist Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-2c233eb6-0477-42c7-b010-5ed22a5a198a'] Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '7cb132b2-3c93-4634-8b51-54f20c249146'} Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 02:31:35.253731 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7cb132b2-3c93-4634-8b51-54f20c249146 does not exist Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2c233eb6-0477-42c7-b010-5ed22a5a198a'] Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7cb132b2-3c93-4634-8b51-54f20c249146 does not exist Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2c233eb6-0477-42c7-b010-5ed22a5a198a'] Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7cb132b2-3c93-4634-8b51-54f20c249146 does not exist Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2c233eb6-0477-42c7-b010-5ed22a5a198a'] Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7cb132b2-3c93-4634-8b51-54f20c249146 does not exist Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2c233eb6-0477-42c7-b010-5ed22a5a198a'] Oct 05 02:31:35.258285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:35.262371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-38e18c63-50a4-4c66-b1c5-d1362fe80cc8 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Returning 404 to user: Security group 7cb132b2-3c93-4634-8b51-54f20c249146 does not exist Oct 05 02:31:35.262371 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-2c233eb6-0477-42c7-b010-5ed22a5a198a'] {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:31:35.263563 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-38e18c63-50a4-4c66-b1c5-d1362fe80cc8 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/7cb132b2-3c93-4634-8b51-54f20c249146" status: 404 len: 194 microversion: 2.1 time: 0.065693 Oct 05 02:31:35.266948 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 578/1160] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 5 02:31:35 2022] GET /compute/v2.1/os-security-groups/7cb132b2-3c93-4634-8b51-54f20c249146 => generated 194 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:31:35.277916 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a8ccc8f4-ab05-415f-9bc8-2fd45cba9024 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '.version_select at 0x7fccdfd64a60>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:35.402860 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-21c3d1a9-6018-4736-8ef9-4d719a56de4a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:35.411260 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-21c3d1a9-6018-4736-8ef9-4d719a56de4a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1472 microversion: 2.1 time: 0.254560 Oct 05 02:31:35.425298 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 583/1161] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:35 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1472 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:31:35.550374 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a8ccc8f4-ab05-415f-9bc8-2fd45cba9024 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.279060 Oct 05 02:31:35.564788 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 579/1162] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 5 02:31:35 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:31:35.571465 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-545ed99e-720c-4c17-8f46-453ab1f3484a tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Action: 'create', calling method: .version_select at 0x7fccdfd23040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-311225453", "description": "tempest-description-1868798442"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:35.746511 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-545ed99e-720c-4c17-8f46-453ab1f3484a tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.179855 Oct 05 02:31:35.747889 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 584/1163] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 5 02:31:35 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:31:35.760945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0ef03d3d-44fb-4115-8bc4-a08044fadc2b tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Action: 'create', calling method: .version_select at 0x7fccdfca1c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-183533868", "description": "tempest-description-1477854812"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:35.919964 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0ef03d3d-44fb-4115-8bc4-a08044fadc2b tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.162453 Oct 05 02:31:35.920663 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 580/1164] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 5 02:31:35 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:31:36.036017 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e70799df-6936-4901-90a9-68d9894feab9 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1099554329", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "eb593e91-e5cb-4403-86c7-15b9bfd37416"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:36.095966 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-e70799df-6936-4901-90a9-68d9894feab9 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] validate_networks() for [('eb593e91-e5cb-4403-86c7-15b9bfd37416', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:31:36.136116 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d0aced30-7e8d-4642-a179-28de5a7d2d6e tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:36.136725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d0aced30-7e8d-4642-a179-28de5a7d2d6e tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] [instance: e31b9992-fb63-4a85-82e7-a8a04238a6ad] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:36.144101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d0aced30-7e8d-4642-a179-28de5a7d2d6e tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:36.144983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d0aced30-7e8d-4642-a179-28de5a7d2d6e tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:36.145707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d0aced30-7e8d-4642-a179-28de5a7d2d6e tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:36.146959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d0aced30-7e8d-4642-a179-28de5a7d2d6e tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:36.147624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d0aced30-7e8d-4642-a179-28de5a7d2d6e tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:36.148255 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d0aced30-7e8d-4642-a179-28de5a7d2d6e tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:36.768972 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d0aced30-7e8d-4642-a179-28de5a7d2d6e tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6748c4cd29482ca1bcfee6781a0cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c46317b81ae456ebfb65d1d3eb0906e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:36.776715 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d0aced30-7e8d-4642-a179-28de5a7d2d6e tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] 10.222.0.16 "GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad" status: 200 len: 1328 microversion: 2.1 time: 0.644711 Oct 05 02:31:36.789947 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 581/1165] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:36 2022] GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad => generated 1328 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:36.800337 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-80202a1d-8e62-4053-9141-203b9f634c5f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:36.801578 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-80202a1d-8e62-4053-9141-203b9f634c5f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:36.812639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-80202a1d-8e62-4053-9141-203b9f634c5f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:36.813585 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-80202a1d-8e62-4053-9141-203b9f634c5f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:36.814115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-80202a1d-8e62-4053-9141-203b9f634c5f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:36.814926 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-80202a1d-8e62-4053-9141-203b9f634c5f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:36.815461 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-80202a1d-8e62-4053-9141-203b9f634c5f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:36.815894 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-80202a1d-8e62-4053-9141-203b9f634c5f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:36.994171 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-80202a1d-8e62-4053-9141-203b9f634c5f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:37.003065 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-80202a1d-8e62-4053-9141-203b9f634c5f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1472 microversion: 2.1 time: 0.211746 Oct 05 02:31:37.004237 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 582/1166] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:36 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1472 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:37.010862 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-54a1aa90-4107-46e9-99a0-5079b45d4bea req-6ef62519-041e-4d7a-9e36-16470537ea67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e31b9992-fb63-4a85-82e7-a8a04238a6ad", "name": "network-vif-plugged", "status": "completed", "tag": "35800c36-81bb-4792-a10f-ead304df1713"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:37.024219 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-54a1aa90-4107-46e9-99a0-5079b45d4bea req-6ef62519-041e-4d7a-9e36-16470537ea67 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:37.025018 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-54a1aa90-4107-46e9-99a0-5079b45d4bea req-6ef62519-041e-4d7a-9e36-16470537ea67 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:37.025625 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-54a1aa90-4107-46e9-99a0-5079b45d4bea req-6ef62519-041e-4d7a-9e36-16470537ea67 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:37.039991 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-54a1aa90-4107-46e9-99a0-5079b45d4bea req-6ef62519-041e-4d7a-9e36-16470537ea67 service nova] Creating event network-vif-plugged:35800c36-81bb-4792-a10f-ead304df1713 for instance e31b9992-fb63-4a85-82e7-a8a04238a6ad on n-h1-858272-3 Oct 05 02:31:37.045163 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-54a1aa90-4107-46e9-99a0-5079b45d4bea req-6ef62519-041e-4d7a-9e36-16470537ea67 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039271 Oct 05 02:31:37.046036 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 583/1167] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:31:37.078548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e70799df-6936-4901-90a9-68d9894feab9 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:31:37.079051 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e70799df-6936-4901-90a9-68d9894feab9 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:31:37.079718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e70799df-6936-4901-90a9-68d9894feab9 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:31:37.080212 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e70799df-6936-4901-90a9-68d9894feab9 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:31:37.080859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e70799df-6936-4901-90a9-68d9894feab9 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:31:37.093295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e70799df-6936-4901-90a9-68d9894feab9 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:37.094261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e70799df-6936-4901-90a9-68d9894feab9 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:37.095050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e70799df-6936-4901-90a9-68d9894feab9 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:37.096472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e70799df-6936-4901-90a9-68d9894feab9 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:37.097164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e70799df-6936-4901-90a9-68d9894feab9 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:37.097612 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e70799df-6936-4901-90a9-68d9894feab9 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:37.128709 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-e70799df-6936-4901-90a9-68d9894feab9 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Getting quotas for project c96108fae56640b6aa0cb68523504c43. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:31:37.136550 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-e70799df-6936-4901-90a9-68d9894feab9 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Getting quotas for user 9925b3a9a63c4b1cb98a8adcc28f916d and project c96108fae56640b6aa0cb68523504c43. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:31:37.156074 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e70799df-6936-4901-90a9-68d9894feab9 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:31:37.160399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e70799df-6936-4901-90a9-68d9894feab9 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: eec04f70-af6c-4489-b51e-712165cb8893] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:31:37.231551 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e70799df-6936-4901-90a9-68d9894feab9 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.198982 Oct 05 02:31:37.233315 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 585/1168] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:31:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:31:37.246124 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9ee73d08-c8e3-4498-8753-c564348a5464 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:37.247158 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9ee73d08-c8e3-4498-8753-c564348a5464 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: eec04f70-af6c-4489-b51e-712165cb8893] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:37.337324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9ee73d08-c8e3-4498-8753-c564348a5464 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:37.351442 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9ee73d08-c8e3-4498-8753-c564348a5464 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893" status: 200 len: 1216 microversion: 2.1 time: 0.110734 Oct 05 02:31:37.364939 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 584/1169] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:37 2022] GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893 => generated 1216 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:37.806258 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-28f9973a-2693-41ba-9db5-a3fd98daac39 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:37.807086 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-28f9973a-2693-41ba-9db5-a3fd98daac39 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] [instance: e31b9992-fb63-4a85-82e7-a8a04238a6ad] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:37.822101 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28f9973a-2693-41ba-9db5-a3fd98daac39 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:37.822983 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28f9973a-2693-41ba-9db5-a3fd98daac39 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:37.823621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28f9973a-2693-41ba-9db5-a3fd98daac39 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:37.824535 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28f9973a-2693-41ba-9db5-a3fd98daac39 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:37.825868 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28f9973a-2693-41ba-9db5-a3fd98daac39 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:37.827190 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28f9973a-2693-41ba-9db5-a3fd98daac39 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:38.027471 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5179fe8d-1014-421a-b01c-d86855d6550c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:38.028848 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5179fe8d-1014-421a-b01c-d86855d6550c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:38.037170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5179fe8d-1014-421a-b01c-d86855d6550c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:38.037923 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5179fe8d-1014-421a-b01c-d86855d6550c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:38.038522 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5179fe8d-1014-421a-b01c-d86855d6550c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:38.039488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5179fe8d-1014-421a-b01c-d86855d6550c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:38.040241 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5179fe8d-1014-421a-b01c-d86855d6550c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:38.040820 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5179fe8d-1014-421a-b01c-d86855d6550c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:38.154833 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-28f9973a-2693-41ba-9db5-a3fd98daac39 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6748c4cd29482ca1bcfee6781a0cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c46317b81ae456ebfb65d1d3eb0906e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:38.174991 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-28f9973a-2693-41ba-9db5-a3fd98daac39 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] 10.222.0.16 "GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad" status: 200 len: 1328 microversion: 2.1 time: 0.373525 Oct 05 02:31:38.175707 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 586/1170] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:37 2022] GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad => generated 1328 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:38.294728 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5179fe8d-1014-421a-b01c-d86855d6550c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:38.303955 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5179fe8d-1014-421a-b01c-d86855d6550c tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1472 microversion: 2.1 time: 0.280365 Oct 05 02:31:38.305188 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 585/1171] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:38 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1472 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:31:38.388804 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-951e3d52-2e62-48dd-817c-528908e03ce4 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:38.389455 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-951e3d52-2e62-48dd-817c-528908e03ce4 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: eec04f70-af6c-4489-b51e-712165cb8893] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:38.398922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-951e3d52-2e62-48dd-817c-528908e03ce4 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:38.399488 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-951e3d52-2e62-48dd-817c-528908e03ce4 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:38.400073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-951e3d52-2e62-48dd-817c-528908e03ce4 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:38.400838 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-951e3d52-2e62-48dd-817c-528908e03ce4 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:38.401574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-951e3d52-2e62-48dd-817c-528908e03ce4 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:38.402055 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-951e3d52-2e62-48dd-817c-528908e03ce4 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:38.424774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:38.498927 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-951e3d52-2e62-48dd-817c-528908e03ce4 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:38.513620 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-951e3d52-2e62-48dd-817c-528908e03ce4 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893" status: 200 len: 1220 microversion: 2.1 time: 0.127191 Oct 05 02:31:38.514628 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 587/1172] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:38 2022] GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893 => generated 1220 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:39.199753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8a62408f-d201-4138-9881-6ace19b45c1b tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:39.200373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8a62408f-d201-4138-9881-6ace19b45c1b tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] [instance: e31b9992-fb63-4a85-82e7-a8a04238a6ad] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:39.213708 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a62408f-d201-4138-9881-6ace19b45c1b tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:39.214402 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a62408f-d201-4138-9881-6ace19b45c1b tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:39.215024 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a62408f-d201-4138-9881-6ace19b45c1b tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:39.216081 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a62408f-d201-4138-9881-6ace19b45c1b tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:39.216697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a62408f-d201-4138-9881-6ace19b45c1b tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:39.217307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a62408f-d201-4138-9881-6ace19b45c1b tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:39.328166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9cf97800-2b28-4600-9cd3-66e2dd3131ea tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:39.330645 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9cf97800-2b28-4600-9cd3-66e2dd3131ea tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:39.339158 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cf97800-2b28-4600-9cd3-66e2dd3131ea tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:39.339658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cf97800-2b28-4600-9cd3-66e2dd3131ea tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:39.340093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cf97800-2b28-4600-9cd3-66e2dd3131ea tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:39.340803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cf97800-2b28-4600-9cd3-66e2dd3131ea tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:39.341285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cf97800-2b28-4600-9cd3-66e2dd3131ea tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:39.341699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cf97800-2b28-4600-9cd3-66e2dd3131ea tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:39.607966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8a62408f-d201-4138-9881-6ace19b45c1b tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6748c4cd29482ca1bcfee6781a0cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c46317b81ae456ebfb65d1d3eb0906e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:39.617739 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8a62408f-d201-4138-9881-6ace19b45c1b tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] 10.222.0.16 "GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad" status: 200 len: 1528 microversion: 2.1 time: 0.421772 Oct 05 02:31:39.618889 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 586/1173] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:39 2022] GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad => generated 1528 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:39.646371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8ce17a6b-3b35-4a0b-8a9a-8f715ddeb337 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:39.649685 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8ce17a6b-3b35-4a0b-8a9a-8f715ddeb337 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: eec04f70-af6c-4489-b51e-712165cb8893] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:39.658560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ce17a6b-3b35-4a0b-8a9a-8f715ddeb337 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:39.659063 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ce17a6b-3b35-4a0b-8a9a-8f715ddeb337 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:39.659494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ce17a6b-3b35-4a0b-8a9a-8f715ddeb337 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:39.660196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ce17a6b-3b35-4a0b-8a9a-8f715ddeb337 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:39.660544 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9cf97800-2b28-4600-9cd3-66e2dd3131ea tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:39.660671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ce17a6b-3b35-4a0b-8a9a-8f715ddeb337 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:39.661080 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ce17a6b-3b35-4a0b-8a9a-8f715ddeb337 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:39.668378 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9cf97800-2b28-4600-9cd3-66e2dd3131ea tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1472 microversion: 2.1 time: 0.344442 Oct 05 02:31:39.675014 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 588/1174] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:39 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1472 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:31:39.680259 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-49dc525a-e9fc-4afa-9b0e-ffbee3bd347c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:39.681040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-49dc525a-e9fc-4afa-9b0e-ffbee3bd347c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] [instance: e31b9992-fb63-4a85-82e7-a8a04238a6ad] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:39.694233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-49dc525a-e9fc-4afa-9b0e-ffbee3bd347c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:39.694723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-49dc525a-e9fc-4afa-9b0e-ffbee3bd347c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:39.698091 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-49dc525a-e9fc-4afa-9b0e-ffbee3bd347c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:39.700539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-49dc525a-e9fc-4afa-9b0e-ffbee3bd347c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:39.701778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-49dc525a-e9fc-4afa-9b0e-ffbee3bd347c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:39.702441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-49dc525a-e9fc-4afa-9b0e-ffbee3bd347c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:39.853979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8ce17a6b-3b35-4a0b-8a9a-8f715ddeb337 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:39.861863 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8ce17a6b-3b35-4a0b-8a9a-8f715ddeb337 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893" status: 200 len: 1286 microversion: 2.1 time: 0.241713 Oct 05 02:31:39.862734 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 587/1175] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:39 2022] GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893 => generated 1286 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:40.003561 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-49dc525a-e9fc-4afa-9b0e-ffbee3bd347c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6748c4cd29482ca1bcfee6781a0cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c46317b81ae456ebfb65d1d3eb0906e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:40.014027 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-49dc525a-e9fc-4afa-9b0e-ffbee3bd347c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] 10.222.0.16 "GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad" status: 200 len: 1528 microversion: 2.1 time: 0.337699 Oct 05 02:31:40.014617 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 589/1176] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:39 2022] GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad => generated 1528 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:40.035655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6de0b99e-ed19-4833-b48a-cde551c341c2 tempest-FloatingIPsTestJSON-1281629847 tempest-FloatingIPsTestJSON-1281629847-project] Action: 'create', calling method: .version_select at 0x7fccdfdf3790>, body: {"pool": null} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:40.187226 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bcc47495-687f-4904-912e-6996ae74d1a8 tempest-ServersNegativeTestMultiTenantJSON-1383106213 tempest-ServersNegativeTestMultiTenantJSON-1383106213-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:40.188815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bcc47495-687f-4904-912e-6996ae74d1a8 tempest-ServersNegativeTestMultiTenantJSON-1383106213 tempest-ServersNegativeTestMultiTenantJSON-1383106213-project] [instance: e31b9992-fb63-4a85-82e7-a8a04238a6ad] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:40.197644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bcc47495-687f-4904-912e-6996ae74d1a8 tempest-ServersNegativeTestMultiTenantJSON-1383106213 tempest-ServersNegativeTestMultiTenantJSON-1383106213-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:40.198502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bcc47495-687f-4904-912e-6996ae74d1a8 tempest-ServersNegativeTestMultiTenantJSON-1383106213 tempest-ServersNegativeTestMultiTenantJSON-1383106213-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:40.199329 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bcc47495-687f-4904-912e-6996ae74d1a8 tempest-ServersNegativeTestMultiTenantJSON-1383106213 tempest-ServersNegativeTestMultiTenantJSON-1383106213-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:40.200379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bcc47495-687f-4904-912e-6996ae74d1a8 tempest-ServersNegativeTestMultiTenantJSON-1383106213 tempest-ServersNegativeTestMultiTenantJSON-1383106213-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:40.201465 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bcc47495-687f-4904-912e-6996ae74d1a8 tempest-ServersNegativeTestMultiTenantJSON-1383106213 tempest-ServersNegativeTestMultiTenantJSON-1383106213-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:40.202173 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bcc47495-687f-4904-912e-6996ae74d1a8 tempest-ServersNegativeTestMultiTenantJSON-1383106213 tempest-ServersNegativeTestMultiTenantJSON-1383106213-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:40.218763 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-bcc47495-687f-4904-912e-6996ae74d1a8 tempest-ServersNegativeTestMultiTenantJSON-1383106213 tempest-ServersNegativeTestMultiTenantJSON-1383106213-project] HTTP exception thrown: Instance e31b9992-fb63-4a85-82e7-a8a04238a6ad could not be found. Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bcc47495-687f-4904-912e-6996ae74d1a8 tempest-ServersNegativeTestMultiTenantJSON-1383106213 tempest-ServersNegativeTestMultiTenantJSON-1383106213-project] Request method failure captured: Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad HTTP/1.1 Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOx4AYZw2SQG6gt7Cj1t0VABqeggY8P86mW-gXJZiCTcHWpImk6crwAqwNH4R9phoLsNJ4WJ2pEpTvD_bkq3sO9z7mi8-IFT2DzlHPLvUEzSZ8Y_XgdEY4eeCOoqelcMAaYBSp8VFrJ2JGXHWNwFa-fw6uOWkNmvl_Nu6RpW8iDm5AI Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 4386dc7d86894345bf78700e0cd419ab Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1383106213 Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4386dc7d86894345bf78700e0cd419ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4386dc7d86894345bf78700e0cd419ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4386dc7d86894345bf78700e0cd419ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4386dc7d86894345bf78700e0cd419ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1383106213 Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 4386dc7d86894345bf78700e0cd419ab Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1383106213 Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1383106213-project Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: e364f959cf53436290bc2bb897e1f5c8 Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1383106213-project Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance e31b9992-fb63-4a85-82e7-a8a04238a6ad could not be found. Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'e31b9992-fb63-4a85-82e7-a8a04238a6ad'} Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e31b9992-fb63-4a85-82e7-a8a04238a6ad could not be found. Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:31:40.220664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:31:40.225984 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e31b9992-fb63-4a85-82e7-a8a04238a6ad could not be found. Oct 05 02:31:40.225984 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:31:40.225984 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:31:40.225984 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:31:40.225984 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:40.225984 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:31:40.225984 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:31:40.225984 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:31:40.225984 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:31:40.225984 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e31b9992-fb63-4a85-82e7-a8a04238a6ad could not be found. Oct 05 02:31:40.225984 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:31:40.227484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bcc47495-687f-4904-912e-6996ae74d1a8 tempest-ServersNegativeTestMultiTenantJSON-1383106213 tempest-ServersNegativeTestMultiTenantJSON-1383106213-project] Returning 404 to user: Instance e31b9992-fb63-4a85-82e7-a8a04238a6ad could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:31:40.228327 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bcc47495-687f-4904-912e-6996ae74d1a8 tempest-ServersNegativeTestMultiTenantJSON-1383106213 tempest-ServersNegativeTestMultiTenantJSON-1383106213-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad" status: 404 len: 111 microversion: 2.1 time: 0.188070 Oct 05 02:31:40.228892 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 590/1177] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:31:40 2022] DELETE /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:31:40.239071 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dfcf7fe2-0bbb-492d-a05d-5b10b99e9d94 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:40.239663 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-dfcf7fe2-0bbb-492d-a05d-5b10b99e9d94 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] [instance: e31b9992-fb63-4a85-82e7-a8a04238a6ad] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:40.245707 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dfcf7fe2-0bbb-492d-a05d-5b10b99e9d94 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:40.246195 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dfcf7fe2-0bbb-492d-a05d-5b10b99e9d94 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:40.246624 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dfcf7fe2-0bbb-492d-a05d-5b10b99e9d94 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:40.247715 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dfcf7fe2-0bbb-492d-a05d-5b10b99e9d94 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:40.248168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dfcf7fe2-0bbb-492d-a05d-5b10b99e9d94 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:40.248590 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dfcf7fe2-0bbb-492d-a05d-5b10b99e9d94 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:40.518819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-dfcf7fe2-0bbb-492d-a05d-5b10b99e9d94 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6748c4cd29482ca1bcfee6781a0cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c46317b81ae456ebfb65d1d3eb0906e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:40.527182 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-dfcf7fe2-0bbb-492d-a05d-5b10b99e9d94 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] 10.222.0.16 "GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad" status: 200 len: 1528 microversion: 2.1 time: 0.291738 Oct 05 02:31:40.544772 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 591/1178] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:40 2022] GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad => generated 1528 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:31:40.551817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9c129263-a57c-45dc-86c8-3e1043b23a01 tempest-ServersNegativeTestMultiTenantJSON-1383106213 tempest-ServersNegativeTestMultiTenantJSON-1383106213-project] Action: 'update', calling method: >, body: {"server": {"name": "e31b9992-fb63-4a85-82e7-a8a04238a6ad_new"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:40.554388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9c129263-a57c-45dc-86c8-3e1043b23a01 tempest-ServersNegativeTestMultiTenantJSON-1383106213 tempest-ServersNegativeTestMultiTenantJSON-1383106213-project] [instance: e31b9992-fb63-4a85-82e7-a8a04238a6ad] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:40.561223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c129263-a57c-45dc-86c8-3e1043b23a01 tempest-ServersNegativeTestMultiTenantJSON-1383106213 tempest-ServersNegativeTestMultiTenantJSON-1383106213-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:40.562748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c129263-a57c-45dc-86c8-3e1043b23a01 tempest-ServersNegativeTestMultiTenantJSON-1383106213 tempest-ServersNegativeTestMultiTenantJSON-1383106213-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:40.563190 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c129263-a57c-45dc-86c8-3e1043b23a01 tempest-ServersNegativeTestMultiTenantJSON-1383106213 tempest-ServersNegativeTestMultiTenantJSON-1383106213-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:40.563891 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c129263-a57c-45dc-86c8-3e1043b23a01 tempest-ServersNegativeTestMultiTenantJSON-1383106213 tempest-ServersNegativeTestMultiTenantJSON-1383106213-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:40.564374 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c129263-a57c-45dc-86c8-3e1043b23a01 tempest-ServersNegativeTestMultiTenantJSON-1383106213 tempest-ServersNegativeTestMultiTenantJSON-1383106213-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:40.564793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c129263-a57c-45dc-86c8-3e1043b23a01 tempest-ServersNegativeTestMultiTenantJSON-1383106213 tempest-ServersNegativeTestMultiTenantJSON-1383106213-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:40.580533 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-9c129263-a57c-45dc-86c8-3e1043b23a01 tempest-ServersNegativeTestMultiTenantJSON-1383106213 tempest-ServersNegativeTestMultiTenantJSON-1383106213-project] HTTP exception thrown: Instance e31b9992-fb63-4a85-82e7-a8a04238a6ad could not be found. Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9c129263-a57c-45dc-86c8-3e1043b23a01 tempest-ServersNegativeTestMultiTenantJSON-1383106213 tempest-ServersNegativeTestMultiTenantJSON-1383106213-project] Request method failure captured: Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: request: PUT /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad HTTP/1.1 Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 64 Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOx4AYZw2SQG6gt7Cj1t0VABqeggY8P86mW-gXJZiCTcHWpImk6crwAqwNH4R9phoLsNJ4WJ2pEpTvD_bkq3sO9z7mi8-IFT2DzlHPLvUEzSZ8Y_XgdEY4eeCOoqelcMAaYBSp8VFrJ2JGXHWNwFa-fw6uOWkNmvl_Nu6RpW8iDm5AI Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 4386dc7d86894345bf78700e0cd419ab Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1383106213 Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4386dc7d86894345bf78700e0cd419ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4386dc7d86894345bf78700e0cd419ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4386dc7d86894345bf78700e0cd419ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4386dc7d86894345bf78700e0cd419ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1383106213 Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 4386dc7d86894345bf78700e0cd419ab Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1383106213 Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1383106213-project Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: e364f959cf53436290bc2bb897e1f5c8 Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1383106213-project Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: {"server": {"name": "e31b9992-fb63-4a85-82e7-a8a04238a6ad_new"}} Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance e31b9992-fb63-4a85-82e7-a8a04238a6ad could not be found. Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'e31b9992-fb63-4a85-82e7-a8a04238a6ad', 'body': {'server': {'name': 'e31b9992-fb63-4a85-82e7-a8a04238a6ad_new'}}} Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e31b9992-fb63-4a85-82e7-a8a04238a6ad could not be found. Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:31:40.582449 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 05 02:31:40.587930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 05 02:31:40.587930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 05 02:31:40.587930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:31:40.587930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:31:40.587930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:31:40.587930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:31:40.587930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e31b9992-fb63-4a85-82e7-a8a04238a6ad could not be found. Oct 05 02:31:40.587930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:31:40.587930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:31:40.587930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:31:40.587930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:40.587930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:31:40.587930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:31:40.587930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:31:40.587930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:31:40.587930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e31b9992-fb63-4a85-82e7-a8a04238a6ad could not be found. Oct 05 02:31:40.587930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:31:40.591109 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9c129263-a57c-45dc-86c8-3e1043b23a01 tempest-ServersNegativeTestMultiTenantJSON-1383106213 tempest-ServersNegativeTestMultiTenantJSON-1383106213-project] Returning 404 to user: Instance e31b9992-fb63-4a85-82e7-a8a04238a6ad could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:31:40.592039 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9c129263-a57c-45dc-86c8-3e1043b23a01 tempest-ServersNegativeTestMultiTenantJSON-1383106213 tempest-ServersNegativeTestMultiTenantJSON-1383106213-project] 10.222.0.16 "PUT /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad" status: 404 len: 111 microversion: 2.1 time: 0.044132 Oct 05 02:31:40.592844 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 592/1179] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Oct 5 02:31:40 2022] PUT /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:31:40.601745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-77491f31-f001-42f0-ba16-4ea9e5921577 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:40.602512 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-77491f31-f001-42f0-ba16-4ea9e5921577 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] [instance: e31b9992-fb63-4a85-82e7-a8a04238a6ad] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:40.608338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-77491f31-f001-42f0-ba16-4ea9e5921577 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:40.608853 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-77491f31-f001-42f0-ba16-4ea9e5921577 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:40.609384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-77491f31-f001-42f0-ba16-4ea9e5921577 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:40.610056 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-77491f31-f001-42f0-ba16-4ea9e5921577 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:40.610955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-77491f31-f001-42f0-ba16-4ea9e5921577 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:40.611470 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-77491f31-f001-42f0-ba16-4ea9e5921577 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:40.637794 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-77491f31-f001-42f0-ba16-4ea9e5921577 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] [instance: e31b9992-fb63-4a85-82e7-a8a04238a6ad] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:31:40.745719 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-77491f31-f001-42f0-ba16-4ea9e5921577 tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad" status: 204 len: 0 microversion: 2.1 time: 0.147163 Oct 05 02:31:40.749582 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 593/1180] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:31:40 2022] DELETE /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 02:31:40.755943 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-087d0a8f-562c-4af6-8f89-0e24a868a5a5 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:40.757238 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-087d0a8f-562c-4af6-8f89-0e24a868a5a5 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:40.765506 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-087d0a8f-562c-4af6-8f89-0e24a868a5a5 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:40.766040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-087d0a8f-562c-4af6-8f89-0e24a868a5a5 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:40.766628 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-087d0a8f-562c-4af6-8f89-0e24a868a5a5 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:40.767338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-087d0a8f-562c-4af6-8f89-0e24a868a5a5 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:40.767794 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-087d0a8f-562c-4af6-8f89-0e24a868a5a5 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:40.768423 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-087d0a8f-562c-4af6-8f89-0e24a868a5a5 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:41.023962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-087d0a8f-562c-4af6-8f89-0e24a868a5a5 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:41.038450 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-087d0a8f-562c-4af6-8f89-0e24a868a5a5 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1472 microversion: 2.1 time: 0.286925 Oct 05 02:31:41.039027 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 594/1181] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:40 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1472 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:41.058839 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f38aaec4-5e86-4bd1-ba52-f74dfa30922a tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:41.059810 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f38aaec4-5e86-4bd1-ba52-f74dfa30922a tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] [instance: e31b9992-fb63-4a85-82e7-a8a04238a6ad] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:41.067140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f38aaec4-5e86-4bd1-ba52-f74dfa30922a tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:41.067970 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f38aaec4-5e86-4bd1-ba52-f74dfa30922a tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:41.068722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f38aaec4-5e86-4bd1-ba52-f74dfa30922a tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:41.069739 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f38aaec4-5e86-4bd1-ba52-f74dfa30922a tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:41.070403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f38aaec4-5e86-4bd1-ba52-f74dfa30922a tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:41.071040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f38aaec4-5e86-4bd1-ba52-f74dfa30922a tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:41.349674 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f38aaec4-5e86-4bd1-ba52-f74dfa30922a tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6748c4cd29482ca1bcfee6781a0cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c46317b81ae456ebfb65d1d3eb0906e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:41.360313 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f38aaec4-5e86-4bd1-ba52-f74dfa30922a tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] 10.222.0.16 "GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad" status: 200 len: 1534 microversion: 2.1 time: 0.320027 Oct 05 02:31:41.367605 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 595/1182] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:41 2022] GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad => generated 1534 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:41.377704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0c1356dc-aa2a-492f-b9cf-1ec18fb9b8ec tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:41.378465 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0c1356dc-aa2a-492f-b9cf-1ec18fb9b8ec tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: eec04f70-af6c-4489-b51e-712165cb8893] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:41.385917 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c1356dc-aa2a-492f-b9cf-1ec18fb9b8ec tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:41.386769 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c1356dc-aa2a-492f-b9cf-1ec18fb9b8ec tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:41.387419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c1356dc-aa2a-492f-b9cf-1ec18fb9b8ec tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:41.388364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c1356dc-aa2a-492f-b9cf-1ec18fb9b8ec tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:41.389206 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c1356dc-aa2a-492f-b9cf-1ec18fb9b8ec tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:41.390626 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c1356dc-aa2a-492f-b9cf-1ec18fb9b8ec tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:41.637653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0c1356dc-aa2a-492f-b9cf-1ec18fb9b8ec tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:41.667571 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0c1356dc-aa2a-492f-b9cf-1ec18fb9b8ec tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893" status: 200 len: 1316 microversion: 2.1 time: 0.298567 Oct 05 02:31:41.676671 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 596/1183] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:41 2022] GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893 => generated 1316 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:42.063092 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cee4be9a-fe97-4da3-9c6b-77277ee6429a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:42.063712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cee4be9a-fe97-4da3-9c6b-77277ee6429a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:42.073357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cee4be9a-fe97-4da3-9c6b-77277ee6429a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:42.073864 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cee4be9a-fe97-4da3-9c6b-77277ee6429a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:42.074310 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cee4be9a-fe97-4da3-9c6b-77277ee6429a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:42.079396 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cee4be9a-fe97-4da3-9c6b-77277ee6429a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:42.079904 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cee4be9a-fe97-4da3-9c6b-77277ee6429a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:42.080337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cee4be9a-fe97-4da3-9c6b-77277ee6429a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:42.689968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cee4be9a-fe97-4da3-9c6b-77277ee6429a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:42.698264 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cee4be9a-fe97-4da3-9c6b-77277ee6429a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1472 microversion: 2.1 time: 0.639921 Oct 05 02:31:42.699159 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 597/1184] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:42 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1472 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:42.703872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-58c178f0-c532-456d-b67c-638d9184218c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:42.704509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-58c178f0-c532-456d-b67c-638d9184218c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] [instance: e31b9992-fb63-4a85-82e7-a8a04238a6ad] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:42.710265 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58c178f0-c532-456d-b67c-638d9184218c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:42.710747 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58c178f0-c532-456d-b67c-638d9184218c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:42.711176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58c178f0-c532-456d-b67c-638d9184218c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:42.711856 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58c178f0-c532-456d-b67c-638d9184218c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:42.712304 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58c178f0-c532-456d-b67c-638d9184218c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:42.712721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58c178f0-c532-456d-b67c-638d9184218c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:42.941922 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6de0b99e-ed19-4833-b48a-cde551c341c2 tempest-FloatingIPsTestJSON-1281629847 tempest-FloatingIPsTestJSON-1281629847-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.051750 Oct 05 02:31:42.943343 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 588/1185] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Oct 5 02:31:39 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3054 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:31:42.951072 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fd416d37-c4b4-4e64-a6d3-f50f024c23b6 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:42.951893 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fd416d37-c4b4-4e64-a6d3-f50f024c23b6 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: eec04f70-af6c-4489-b51e-712165cb8893] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:42.963406 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fd416d37-c4b4-4e64-a6d3-f50f024c23b6 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:42.964262 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fd416d37-c4b4-4e64-a6d3-f50f024c23b6 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:42.964783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fd416d37-c4b4-4e64-a6d3-f50f024c23b6 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:42.965542 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fd416d37-c4b4-4e64-a6d3-f50f024c23b6 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:42.966006 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fd416d37-c4b4-4e64-a6d3-f50f024c23b6 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:42.966436 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fd416d37-c4b4-4e64-a6d3-f50f024c23b6 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:43.229378 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-58c178f0-c532-456d-b67c-638d9184218c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6748c4cd29482ca1bcfee6781a0cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c46317b81ae456ebfb65d1d3eb0906e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:43.238274 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-58c178f0-c532-456d-b67c-638d9184218c tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] 10.222.0.16 "GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad" status: 200 len: 1534 microversion: 2.1 time: 0.537916 Oct 05 02:31:43.239046 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 598/1186] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:42 2022] GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad => generated 1534 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:43.249541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d4a1fbe9-5c84-4efe-87d0-a8033b1a0444 tempest-FloatingIPsTestJSON-1281629847 tempest-FloatingIPsTestJSON-1281629847-project] Calling method '.version_select at 0x7fccdfdb8940>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:43.415374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fd416d37-c4b4-4e64-a6d3-f50f024c23b6 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:43.423725 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fd416d37-c4b4-4e64-a6d3-f50f024c23b6 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893" status: 200 len: 1316 microversion: 2.1 time: 0.479087 Oct 05 02:31:43.424476 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 589/1187] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:42 2022] GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893 => generated 1316 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:43.429443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e759ecf7-b99b-4344-acc5-4555cc903ec6 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:43.430440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e759ecf7-b99b-4344-acc5-4555cc903ec6 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:43.437693 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e759ecf7-b99b-4344-acc5-4555cc903ec6 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:43.439136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e759ecf7-b99b-4344-acc5-4555cc903ec6 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:43.440587 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e759ecf7-b99b-4344-acc5-4555cc903ec6 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:43.441540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e759ecf7-b99b-4344-acc5-4555cc903ec6 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:43.442005 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e759ecf7-b99b-4344-acc5-4555cc903ec6 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:43.442820 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e759ecf7-b99b-4344-acc5-4555cc903ec6 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:43.637854 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d4a1fbe9-5c84-4efe-87d0-a8033b1a0444 tempest-FloatingIPsTestJSON-1281629847 tempest-FloatingIPsTestJSON-1281629847-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/94f83fd6-6e88-465e-9f0e-2927fdc4c7d0" status: 200 len: 142 microversion: 2.1 time: 0.397084 Oct 05 02:31:43.638133 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 599/1188] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 5 02:31:43 2022] GET /compute/v2.1/os-floating-ips/94f83fd6-6e88-465e-9f0e-2927fdc4c7d0 => generated 142 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:31:43.652757 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fe7bdc3c-0e7d-4a4f-8bb6-8a4cb39e9ce2 tempest-FloatingIPsTestJSON-1281629847 tempest-FloatingIPsTestJSON-1281629847-project] Calling method '.version_select at 0x7fccdfd1dca0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:43.810989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:43.822004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-e759ecf7-b99b-4344-acc5-4555cc903ec6 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lazy-loading 'services' on Instance uuid d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:31:43.845818 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e759ecf7-b99b-4344-acc5-4555cc903ec6 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 2422 microversion: 2.25 time: 0.419732 Oct 05 02:31:43.865800 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 590/1189] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:43 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 2422 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:31:43.879226 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0287cfdf-d8ac-4377-aed6-b9f0aa30801a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:43.880842 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0287cfdf-d8ac-4377-aed6-b9f0aa30801a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:43.893565 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0287cfdf-d8ac-4377-aed6-b9f0aa30801a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:43.894475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0287cfdf-d8ac-4377-aed6-b9f0aa30801a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:43.895301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0287cfdf-d8ac-4377-aed6-b9f0aa30801a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:43.896691 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0287cfdf-d8ac-4377-aed6-b9f0aa30801a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:43.905990 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0287cfdf-d8ac-4377-aed6-b9f0aa30801a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:43.906849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0287cfdf-d8ac-4377-aed6-b9f0aa30801a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:44.124405 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fe7bdc3c-0e7d-4a4f-8bb6-8a4cb39e9ce2 tempest-FloatingIPsTestJSON-1281629847 tempest-FloatingIPsTestJSON-1281629847-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.476881 Oct 05 02:31:44.125034 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 600/1190] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Oct 5 02:31:43 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:31:44.133517 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9c9559be-ea26-400d-8ed6-09a19c8f0766 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858272-3", "block_migration": "auto"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:44.140193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9c9559be-ea26-400d-8ed6-09a19c8f0766 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:44.142637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:44.162606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c9559be-ea26-400d-8ed6-09a19c8f0766 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:44.163514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c9559be-ea26-400d-8ed6-09a19c8f0766 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:44.165645 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c9559be-ea26-400d-8ed6-09a19c8f0766 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:44.167960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c9559be-ea26-400d-8ed6-09a19c8f0766 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:44.168721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c9559be-ea26-400d-8ed6-09a19c8f0766 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:44.171425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c9559be-ea26-400d-8ed6-09a19c8f0766 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:44.205043 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-9c9559be-ea26-400d-8ed6-09a19c8f0766 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lazy-loading 'flavor' on Instance uuid d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:31:44.221861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9c9559be-ea26-400d-8ed6-09a19c8f0766 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Going to try to live migrate instance to n-h1-858272-3 {{(pid=122319) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 05 02:31:44.278509 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0287cfdf-d8ac-4377-aed6-b9f0aa30801a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:44.297990 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0287cfdf-d8ac-4377-aed6-b9f0aa30801a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1472 microversion: 2.1 time: 0.430578 Oct 05 02:31:44.301357 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 591/1191] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:43 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1472 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:44.307113 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-ee6d23ad-8dc2-49d1-9bd9-f50a4933efc9 req-ff197c8c-3f45-405a-918b-310ca5789ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e31b9992-fb63-4a85-82e7-a8a04238a6ad", "name": "network-vif-deleted", "tag": "35800c36-81bb-4792-a10f-ead304df1713"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:44.324296 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ee6d23ad-8dc2-49d1-9bd9-f50a4933efc9 req-ff197c8c-3f45-405a-918b-310ca5789ce3 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:44.324770 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ee6d23ad-8dc2-49d1-9bd9-f50a4933efc9 req-ff197c8c-3f45-405a-918b-310ca5789ce3 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:44.325231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ee6d23ad-8dc2-49d1-9bd9-f50a4933efc9 req-ff197c8c-3f45-405a-918b-310ca5789ce3 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:44.339095 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-ee6d23ad-8dc2-49d1-9bd9-f50a4933efc9 req-ff197c8c-3f45-405a-918b-310ca5789ce3 service nova] Creating event network-vif-deleted:35800c36-81bb-4792-a10f-ead304df1713 for instance e31b9992-fb63-4a85-82e7-a8a04238a6ad on n-h1-858272-3 Oct 05 02:31:44.345389 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-ee6d23ad-8dc2-49d1-9bd9-f50a4933efc9 req-ff197c8c-3f45-405a-918b-310ca5789ce3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042425 Oct 05 02:31:44.346691 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 592/1192] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:31:44.352078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-afc18500-9579-44b5-9bbd-377ec5e62a31 tempest-FloatingIPsTestJSON-1281629847 tempest-FloatingIPsTestJSON-1281629847-project] Calling method '.version_select at 0x7fccdfca11f0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:45.466692 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9c9559be-ea26-400d-8ed6-09a19c8f0766 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0/action" status: 202 len: 0 microversion: 2.25 time: 1.340321 Oct 05 02:31:45.468355 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 601/1193] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 5 02:31:44 2022] POST /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0/action => generated 0 bytes in 1342 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:31:45.473358 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b5ff054a-1c60-48da-92ff-aca71e96c0ff tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:45.474224 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b5ff054a-1c60-48da-92ff-aca71e96c0ff tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] [instance: e31b9992-fb63-4a85-82e7-a8a04238a6ad] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:45.481734 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5ff054a-1c60-48da-92ff-aca71e96c0ff tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:45.482214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5ff054a-1c60-48da-92ff-aca71e96c0ff tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:45.482849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5ff054a-1c60-48da-92ff-aca71e96c0ff tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:45.484269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5ff054a-1c60-48da-92ff-aca71e96c0ff tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:45.484910 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5ff054a-1c60-48da-92ff-aca71e96c0ff tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:45.485350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5ff054a-1c60-48da-92ff-aca71e96c0ff tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:45.500628 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-b5ff054a-1c60-48da-92ff-aca71e96c0ff tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] HTTP exception thrown: Instance e31b9992-fb63-4a85-82e7-a8a04238a6ad could not be found. Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b5ff054a-1c60-48da-92ff-aca71e96c0ff tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Request method failure captured: Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad HTTP/1.1 Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOxyvNY0SwxgVPx0z5o9JDBaqkcpETFVgsyjgvx02JENEBDEZ8X2jntokbWKpvsEGjcjNY4kpXb6V3a4eXoVrw79e2wdpIi8F-vnRK-_fp0mFbBN2O6wUHEzu_kAoWhmKo7daNdpjCfW-TRmoVDACQGNE-Oi80UJk2clvKdFfwUWsR0 Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 1c46317b81ae456ebfb65d1d3eb0906e Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-583408553 Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1c46317b81ae456ebfb65d1d3eb0906e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1c46317b81ae456ebfb65d1d3eb0906e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1c46317b81ae456ebfb65d1d3eb0906e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1c46317b81ae456ebfb65d1d3eb0906e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-583408553 Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 1c46317b81ae456ebfb65d1d3eb0906e Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-583408553 Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersNegativeTestMultiTenantJSON-583408553-project Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 3f6748c4cd29482ca1bcfee6781a0cf3 Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-583408553-project Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance e31b9992-fb63-4a85-82e7-a8a04238a6ad could not be found. Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'e31b9992-fb63-4a85-82e7-a8a04238a6ad'} Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e31b9992-fb63-4a85-82e7-a8a04238a6ad could not be found. Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e31b9992-fb63-4a85-82e7-a8a04238a6ad could not be found. Oct 05 02:31:45.502519 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:31:45.507454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:31:45.507454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:31:45.507454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:45.507454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:31:45.507454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:31:45.507454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:31:45.507454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:31:45.507454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e31b9992-fb63-4a85-82e7-a8a04238a6ad could not be found. Oct 05 02:31:45.507454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:31:45.509089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b5ff054a-1c60-48da-92ff-aca71e96c0ff tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] Returning 404 to user: Instance e31b9992-fb63-4a85-82e7-a8a04238a6ad could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:31:45.510105 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b5ff054a-1c60-48da-92ff-aca71e96c0ff tempest-ServersNegativeTestMultiTenantJSON-583408553 tempest-ServersNegativeTestMultiTenantJSON-583408553-project] 10.222.0.16 "GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad" status: 404 len: 111 microversion: 2.1 time: 0.040581 Oct 05 02:31:45.510828 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 602/1194] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:45 2022] GET /compute/v2.1/servers/e31b9992-fb63-4a85-82e7-a8a04238a6ad => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:31:45.516236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e4b4bb8a-e048-4402-acdd-a7887bf23ade tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:45.517057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e4b4bb8a-e048-4402-acdd-a7887bf23ade tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: eec04f70-af6c-4489-b51e-712165cb8893] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:45.522041 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 02:31:45.522202 n-d-858272-3 devstack@n-api.service[122319]: Wed Oct 5 02:31:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893 (ip 10.222.0.16) !!! Oct 05 02:31:45.527294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4b4bb8a-e048-4402-acdd-a7887bf23ade tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:45.527881 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4b4bb8a-e048-4402-acdd-a7887bf23ade tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:45.528304 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4b4bb8a-e048-4402-acdd-a7887bf23ade tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:45.529157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4b4bb8a-e048-4402-acdd-a7887bf23ade tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:45.529855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4b4bb8a-e048-4402-acdd-a7887bf23ade tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:45.530044 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-afc18500-9579-44b5-9bbd-377ec5e62a31 tempest-FloatingIPsTestJSON-1281629847 tempest-FloatingIPsTestJSON-1281629847-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/94f83fd6-6e88-465e-9f0e-2927fdc4c7d0" status: 202 len: 0 microversion: 2.1 time: 1.182022 Oct 05 02:31:45.530633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4b4bb8a-e048-4402-acdd-a7887bf23ade tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:45.530891 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 593/1195] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 5 02:31:44 2022] DELETE /compute/v2.1/os-floating-ips/94f83fd6-6e88-465e-9f0e-2927fdc4c7d0 => generated 0 bytes in 1184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:31:45.544564 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c1caa22c-2dde-4c66-b2d6-bf474e5d1c45 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:45.545338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c1caa22c-2dde-4c66-b2d6-bf474e5d1c45 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:45.553567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1caa22c-2dde-4c66-b2d6-bf474e5d1c45 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:45.554330 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1caa22c-2dde-4c66-b2d6-bf474e5d1c45 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:45.554985 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1caa22c-2dde-4c66-b2d6-bf474e5d1c45 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:45.555935 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1caa22c-2dde-4c66-b2d6-bf474e5d1c45 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:45.557313 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1caa22c-2dde-4c66-b2d6-bf474e5d1c45 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:45.558100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1caa22c-2dde-4c66-b2d6-bf474e5d1c45 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:45.873755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e4b4bb8a-e048-4402-acdd-a7887bf23ade tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:45.883112 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e4b4bb8a-e048-4402-acdd-a7887bf23ade tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893" status: 200 len: 1316 microversion: 2.1 time: 0.371049 Oct 05 02:31:45.883708 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 603/1196] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:45 2022] GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893 => generated 1316 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:45.888327 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c1caa22c-2dde-4c66-b2d6-bf474e5d1c45 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:45.890833 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1611ccfb-d674-48d2-9fc9-b85c6da14a42 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:45.891752 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1611ccfb-d674-48d2-9fc9-b85c6da14a42 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:45.897545 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c1caa22c-2dde-4c66-b2d6-bf474e5d1c45 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1472 microversion: 2.1 time: 0.358573 Oct 05 02:31:45.898536 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 594/1197] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:45 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1472 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:45.904969 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cc3278dc-8547-4711-b58f-92a9ff12d4ae tempest-FloatingIPsTestJSON-1281629847 tempest-FloatingIPsTestJSON-1281629847-project] Action: 'create', calling method: .version_select at 0x7fccdfd64040>, body: {"pool": null} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:45.913297 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1611ccfb-d674-48d2-9fc9-b85c6da14a42 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:45.914014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1611ccfb-d674-48d2-9fc9-b85c6da14a42 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:45.914561 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1611ccfb-d674-48d2-9fc9-b85c6da14a42 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:45.915392 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1611ccfb-d674-48d2-9fc9-b85c6da14a42 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:45.915947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1611ccfb-d674-48d2-9fc9-b85c6da14a42 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:45.916458 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1611ccfb-d674-48d2-9fc9-b85c6da14a42 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:45.937736 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:46.510984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1611ccfb-d674-48d2-9fc9-b85c6da14a42 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:46.520374 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1611ccfb-d674-48d2-9fc9-b85c6da14a42 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:46.521871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1611ccfb-d674-48d2-9fc9-b85c6da14a42 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:46.523128 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1611ccfb-d674-48d2-9fc9-b85c6da14a42 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1814 microversion: 2.25 time: 0.638460 Oct 05 02:31:46.523688 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 604/1198] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:45 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1814 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:31:46.527997 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-6475fa35-b0dc-49e0-a61c-cdb5839e0a12 req-23dd31b4-a388-4c63-8816-719ab5583b2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eec04f70-af6c-4489-b51e-712165cb8893", "tag": "1b500420-b259-4125-8c4d-26eee2187a24"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:46.538492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6475fa35-b0dc-49e0-a61c-cdb5839e0a12 req-23dd31b4-a388-4c63-8816-719ab5583b2f service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:46.539095 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6475fa35-b0dc-49e0-a61c-cdb5839e0a12 req-23dd31b4-a388-4c63-8816-719ab5583b2f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:46.539536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6475fa35-b0dc-49e0-a61c-cdb5839e0a12 req-23dd31b4-a388-4c63-8816-719ab5583b2f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:46.551582 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-6475fa35-b0dc-49e0-a61c-cdb5839e0a12 req-23dd31b4-a388-4c63-8816-719ab5583b2f service nova] Creating event network-changed:1b500420-b259-4125-8c4d-26eee2187a24 for instance eec04f70-af6c-4489-b51e-712165cb8893 on n-h1-858272-3 Oct 05 02:31:46.561039 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-6475fa35-b0dc-49e0-a61c-cdb5839e0a12 req-23dd31b4-a388-4c63-8816-719ab5583b2f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035860 Oct 05 02:31:46.562598 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 605/1199] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:31:46.909513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2aa1a870-42e8-4e54-89ef-a17e5b3bb9ed tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:46.910184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2aa1a870-42e8-4e54-89ef-a17e5b3bb9ed tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: eec04f70-af6c-4489-b51e-712165cb8893] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:46.917065 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2aa1a870-42e8-4e54-89ef-a17e5b3bb9ed tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:46.918228 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2aa1a870-42e8-4e54-89ef-a17e5b3bb9ed tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:46.918682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2aa1a870-42e8-4e54-89ef-a17e5b3bb9ed tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:46.919793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2aa1a870-42e8-4e54-89ef-a17e5b3bb9ed tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:46.920537 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2aa1a870-42e8-4e54-89ef-a17e5b3bb9ed tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:46.921703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2aa1a870-42e8-4e54-89ef-a17e5b3bb9ed tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:47.111779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:47.149181 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:47.198632 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2aa1a870-42e8-4e54-89ef-a17e5b3bb9ed tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:47.210305 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2aa1a870-42e8-4e54-89ef-a17e5b3bb9ed tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893" status: 200 len: 1316 microversion: 2.1 time: 0.305458 Oct 05 02:31:47.211570 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 606/1200] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:46 2022] GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893 => generated 1316 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:31:47.219137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-50a1006e-8291-4ac4-b9c2-960cb352290a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:47.220162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-50a1006e-8291-4ac4-b9c2-960cb352290a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:47.228448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50a1006e-8291-4ac4-b9c2-960cb352290a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:47.229170 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50a1006e-8291-4ac4-b9c2-960cb352290a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:47.229943 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50a1006e-8291-4ac4-b9c2-960cb352290a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:47.230718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50a1006e-8291-4ac4-b9c2-960cb352290a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:47.231239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50a1006e-8291-4ac4-b9c2-960cb352290a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:47.231735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50a1006e-8291-4ac4-b9c2-960cb352290a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:47.343746 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:47.542894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-50a1006e-8291-4ac4-b9c2-960cb352290a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:47.556007 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-50a1006e-8291-4ac4-b9c2-960cb352290a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1472 microversion: 2.1 time: 0.343125 Oct 05 02:31:47.569874 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 607/1201] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:47 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1472 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:47.587020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-567cdb19-e32c-4bad-be62-aabc1ccab0e0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:47.588022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-567cdb19-e32c-4bad-be62-aabc1ccab0e0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:47.599397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-567cdb19-e32c-4bad-be62-aabc1ccab0e0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:47.600298 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-567cdb19-e32c-4bad-be62-aabc1ccab0e0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:47.601193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-567cdb19-e32c-4bad-be62-aabc1ccab0e0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:47.602161 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-567cdb19-e32c-4bad-be62-aabc1ccab0e0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:47.602721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-567cdb19-e32c-4bad-be62-aabc1ccab0e0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:47.603620 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-567cdb19-e32c-4bad-be62-aabc1ccab0e0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:48.037899 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-567cdb19-e32c-4bad-be62-aabc1ccab0e0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:48.049652 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-567cdb19-e32c-4bad-be62-aabc1ccab0e0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:48.051523 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-567cdb19-e32c-4bad-be62-aabc1ccab0e0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:48.052738 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-567cdb19-e32c-4bad-be62-aabc1ccab0e0 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1814 microversion: 2.25 time: 0.480681 Oct 05 02:31:48.053389 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 608/1202] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:47 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1814 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:31:48.216653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4e4aba88-d1d5-4d7c-ad22-b3fd4298c633 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d498b999-5afc-4afb-8788-f478e5eec4f2"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:48.220033 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4e4aba88-d1d5-4d7c-ad22-b3fd4298c633 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] [instance: aaa20a8a-8a7b-42dd-9b4e-9165fba82942] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:48.226309 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e4aba88-d1d5-4d7c-ad22-b3fd4298c633 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:48.226789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e4aba88-d1d5-4d7c-ad22-b3fd4298c633 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:48.227221 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e4aba88-d1d5-4d7c-ad22-b3fd4298c633 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:48.227912 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e4aba88-d1d5-4d7c-ad22-b3fd4298c633 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:48.228361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e4aba88-d1d5-4d7c-ad22-b3fd4298c633 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:48.228781 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e4aba88-d1d5-4d7c-ad22-b3fd4298c633 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:48.510476 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4e4aba88-d1d5-4d7c-ad22-b3fd4298c633 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "POST /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297828 Oct 05 02:31:48.511266 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 609/1203] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 02:31:48 2022] POST /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:31:48.529173 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dcccb51d-b150-4287-a9f6-c5e2dfef8720 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:48.529824 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-dcccb51d-b150-4287-a9f6-c5e2dfef8720 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: eec04f70-af6c-4489-b51e-712165cb8893] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:48.540292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dcccb51d-b150-4287-a9f6-c5e2dfef8720 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:48.540697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dcccb51d-b150-4287-a9f6-c5e2dfef8720 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:48.541176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dcccb51d-b150-4287-a9f6-c5e2dfef8720 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:48.541878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dcccb51d-b150-4287-a9f6-c5e2dfef8720 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:48.542350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dcccb51d-b150-4287-a9f6-c5e2dfef8720 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:48.542960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dcccb51d-b150-4287-a9f6-c5e2dfef8720 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:48.912572 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-dcccb51d-b150-4287-a9f6-c5e2dfef8720 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:48.921932 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-dcccb51d-b150-4287-a9f6-c5e2dfef8720 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893" status: 200 len: 1316 microversion: 2.1 time: 0.408334 Oct 05 02:31:48.923050 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 610/1204] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:48 2022] GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893 => generated 1316 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:48.953726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a47220dd-57ba-4b1f-87b8-600953b85104 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:48.958926 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a47220dd-57ba-4b1f-87b8-600953b85104 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:48.968668 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a47220dd-57ba-4b1f-87b8-600953b85104 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:48.969482 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a47220dd-57ba-4b1f-87b8-600953b85104 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:48.969928 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a47220dd-57ba-4b1f-87b8-600953b85104 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:48.970633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a47220dd-57ba-4b1f-87b8-600953b85104 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:48.971082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a47220dd-57ba-4b1f-87b8-600953b85104 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:48.971504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a47220dd-57ba-4b1f-87b8-600953b85104 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:49.761221 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cc3278dc-8547-4711-b58f-92a9ff12d4ae tempest-FloatingIPsTestJSON-1281629847 tempest-FloatingIPsTestJSON-1281629847-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.861039 Oct 05 02:31:49.763189 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 595/1205] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Oct 5 02:31:45 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:31:49.770849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0c53cbe5-b747-464e-a1f1-ca34afa6461c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:49.771566 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0c53cbe5-b747-464e-a1f1-ca34afa6461c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:49.777997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c53cbe5-b747-464e-a1f1-ca34afa6461c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:49.778492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c53cbe5-b747-464e-a1f1-ca34afa6461c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:49.778919 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c53cbe5-b747-464e-a1f1-ca34afa6461c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:49.779850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c53cbe5-b747-464e-a1f1-ca34afa6461c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:49.780335 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c53cbe5-b747-464e-a1f1-ca34afa6461c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:49.781224 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c53cbe5-b747-464e-a1f1-ca34afa6461c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:50.002385 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a47220dd-57ba-4b1f-87b8-600953b85104 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:50.019746 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a47220dd-57ba-4b1f-87b8-600953b85104 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1472 microversion: 2.1 time: 1.095153 Oct 05 02:31:50.020258 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 611/1206] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:48 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1472 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:50.033032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6fd07ac6-2d92-408e-9e00-e87d34322c9e tempest-FloatingIPsTestJSON-1281629847 tempest-FloatingIPsTestJSON-1281629847-project] Calling method '.version_select at 0x7fccdfd1b040>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:50.236316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0c53cbe5-b747-464e-a1f1-ca34afa6461c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:50.259794 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0c53cbe5-b747-464e-a1f1-ca34afa6461c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:50.262368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0c53cbe5-b747-464e-a1f1-ca34afa6461c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:50.263687 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0c53cbe5-b747-464e-a1f1-ca34afa6461c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1814 microversion: 2.25 time: 0.497114 Oct 05 02:31:50.267345 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 596/1207] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:49 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1814 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:31:50.279958 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-773a8a11-b90a-40c3-8b45-ee712b763b42 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:50.282904 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-773a8a11-b90a-40c3-8b45-ee712b763b42 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: eec04f70-af6c-4489-b51e-712165cb8893] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:50.304337 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-773a8a11-b90a-40c3-8b45-ee712b763b42 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:50.307556 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-773a8a11-b90a-40c3-8b45-ee712b763b42 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:50.309590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-773a8a11-b90a-40c3-8b45-ee712b763b42 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:50.312416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-773a8a11-b90a-40c3-8b45-ee712b763b42 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:50.312923 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-773a8a11-b90a-40c3-8b45-ee712b763b42 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:50.313354 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-773a8a11-b90a-40c3-8b45-ee712b763b42 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:50.668435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-773a8a11-b90a-40c3-8b45-ee712b763b42 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:50.687768 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-773a8a11-b90a-40c3-8b45-ee712b763b42 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893" status: 200 len: 1316 microversion: 2.1 time: 0.417984 Oct 05 02:31:50.688290 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 597/1208] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:50 2022] GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893 => generated 1316 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:51.049205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4819875c-cd83-458b-bc74-6810100e7045 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:51.050879 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4819875c-cd83-458b-bc74-6810100e7045 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:51.073270 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4819875c-cd83-458b-bc74-6810100e7045 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:51.076409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4819875c-cd83-458b-bc74-6810100e7045 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:51.078430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4819875c-cd83-458b-bc74-6810100e7045 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:51.082929 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4819875c-cd83-458b-bc74-6810100e7045 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:51.082929 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4819875c-cd83-458b-bc74-6810100e7045 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:51.083205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4819875c-cd83-458b-bc74-6810100e7045 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:51.391726 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4819875c-cd83-458b-bc74-6810100e7045 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:51.416468 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4819875c-cd83-458b-bc74-6810100e7045 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1472 microversion: 2.1 time: 0.373385 Oct 05 02:31:51.419588 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 598/1209] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:51 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1472 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:51.447762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7115ac69-7664-4f1b-9441-c042fb833930 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:51.449154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7115ac69-7664-4f1b-9441-c042fb833930 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:51.462645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7115ac69-7664-4f1b-9441-c042fb833930 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:51.465289 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7115ac69-7664-4f1b-9441-c042fb833930 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:51.469608 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7115ac69-7664-4f1b-9441-c042fb833930 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:51.470673 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7115ac69-7664-4f1b-9441-c042fb833930 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:51.471438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7115ac69-7664-4f1b-9441-c042fb833930 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:51.472084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7115ac69-7664-4f1b-9441-c042fb833930 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:51.786377 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6fd07ac6-2d92-408e-9e00-e87d34322c9e tempest-FloatingIPsTestJSON-1281629847 tempest-FloatingIPsTestJSON-1281629847-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/1d9afa26-6e2b-4ffe-bd79-afb96600eafb" status: 202 len: 0 microversion: 2.1 time: 1.765032 Oct 05 02:31:51.790035 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 612/1210] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 5 02:31:50 2022] DELETE /compute/v2.1/os-floating-ips/1d9afa26-6e2b-4ffe-bd79-afb96600eafb => generated 0 bytes in 1769 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:31:51.806330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1dcf5837-9986-45d4-b51e-1f31be1dd188 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:51.808274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1dcf5837-9986-45d4-b51e-1f31be1dd188 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: eec04f70-af6c-4489-b51e-712165cb8893] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:51.831222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1dcf5837-9986-45d4-b51e-1f31be1dd188 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:51.832691 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7115ac69-7664-4f1b-9441-c042fb833930 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:51.834508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1dcf5837-9986-45d4-b51e-1f31be1dd188 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:51.837357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1dcf5837-9986-45d4-b51e-1f31be1dd188 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:51.843442 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1dcf5837-9986-45d4-b51e-1f31be1dd188 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:51.844804 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1dcf5837-9986-45d4-b51e-1f31be1dd188 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:51.845373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1dcf5837-9986-45d4-b51e-1f31be1dd188 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:51.845975 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7115ac69-7664-4f1b-9441-c042fb833930 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:51.847592 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7115ac69-7664-4f1b-9441-c042fb833930 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:51.848973 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7115ac69-7664-4f1b-9441-c042fb833930 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1814 microversion: 2.25 time: 0.423822 Oct 05 02:31:51.850759 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 599/1211] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:51 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1814 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:31:51.856647 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6e5abf6a-a64d-463b-b27c-c54f36ae3040 tempest-FloatingIPsTestJSON-1281629847 tempest-FloatingIPsTestJSON-1281629847-project] Calling method '.version_select at 0x7fccdfcaee50>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:51.910675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG neutronclient.v2_0.client [None req-6e5abf6a-a64d-463b-b27c-c54f36ae3040 tempest-FloatingIPsTestJSON-1281629847 tempest-FloatingIPsTestJSON-1281629847-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 1d9afa26-6e2b-4ffe-bd79-afb96600eafb could not be found", "detail": ""}} {{(pid=122320) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 02:31:51.911378 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-6e5abf6a-a64d-463b-b27c-c54f36ae3040 tempest-FloatingIPsTestJSON-1281629847 tempest-FloatingIPsTestJSON-1281629847-project] HTTP exception thrown: Floating IP not found for ID 1d9afa26-6e2b-4ffe-bd79-afb96600eafb Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6e5abf6a-a64d-463b-b27c-c54f36ae3040 tempest-FloatingIPsTestJSON-1281629847 tempest-FloatingIPsTestJSON-1281629847-project] Request method failure captured: Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/os-floating-ips/1d9afa26-6e2b-4ffe-bd79-afb96600eafb HTTP/1.1 Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOyLPjLkPbhWSd9jEOhMwi68eywWGApM_XzX6oy-_uUVC_-2TGbm1kKeLa6PWZHniiwBSiXZIKqOSimy4eD8Q1iv-kktdnVdpzJQvdCBj3egLUXYBuviKVS5KhV5mpiSzrsbt4SmNKx3ah3hTPhqZhu8KhuJKI32WfWQSlWMTpsgDxg Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 3526d69fdeff43be95a2760b14b33abc Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-FloatingIPsTestJSON-1281629847 Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3526d69fdeff43be95a2760b14b33abc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3526d69fdeff43be95a2760b14b33abc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3526d69fdeff43be95a2760b14b33abc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3526d69fdeff43be95a2760b14b33abc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-FloatingIPsTestJSON-1281629847 Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 3526d69fdeff43be95a2760b14b33abc Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1281629847 Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-FloatingIPsTestJSON-1281629847-project Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 40ee91bc3e4044c588799f3894df24e7 Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-FloatingIPsTestJSON-1281629847-project Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: exception: Floating IP not found for ID 1d9afa26-6e2b-4ffe-bd79-afb96600eafb Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '1d9afa26-6e2b-4ffe-bd79-afb96600eafb'} Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 1d9afa26-6e2b-4ffe-bd79-afb96600eafb could not be found Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-80bf4679-8689-402a-9b50-8f5cfb5093d1'] Oct 05 02:31:51.913365 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 1d9afa26-6e2b-4ffe-bd79-afb96600eafb. Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 1d9afa26-6e2b-4ffe-bd79-afb96600eafb Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 1d9afa26-6e2b-4ffe-bd79-afb96600eafb Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6e5abf6a-a64d-463b-b27c-c54f36ae3040 tempest-FloatingIPsTestJSON-1281629847 tempest-FloatingIPsTestJSON-1281629847-project] Returning 404 to user: Floating IP not found for ID 1d9afa26-6e2b-4ffe-bd79-afb96600eafb {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6e5abf6a-a64d-463b-b27c-c54f36ae3040 tempest-FloatingIPsTestJSON-1281629847 tempest-FloatingIPsTestJSON-1281629847-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/1d9afa26-6e2b-4ffe-bd79-afb96600eafb" status: 404 len: 111 microversion: 2.1 time: 0.063271 Oct 05 02:31:51.917945 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 600/1212] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 5 02:31:51 2022] GET /compute/v2.1/os-floating-ips/1d9afa26-6e2b-4ffe-bd79-afb96600eafb => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:31:51.924734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-96ad2803-eb61-4990-bd70-1ae82b3d5445 tempest-FloatingIPsTestJSON-1281629847 tempest-FloatingIPsTestJSON-1281629847-project] Calling method '.version_select at 0x7fccdfcc2ee0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:52.023655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG neutronclient.v2_0.client [None req-96ad2803-eb61-4990-bd70-1ae82b3d5445 tempest-FloatingIPsTestJSON-1281629847 tempest-FloatingIPsTestJSON-1281629847-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 1d9afa26-6e2b-4ffe-bd79-afb96600eafb could not be found", "detail": ""}} {{(pid=122320) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 02:31:52.024518 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-96ad2803-eb61-4990-bd70-1ae82b3d5445 tempest-FloatingIPsTestJSON-1281629847 tempest-FloatingIPsTestJSON-1281629847-project] HTTP exception thrown: Floating IP not found for ID 1d9afa26-6e2b-4ffe-bd79-afb96600eafb Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-96ad2803-eb61-4990-bd70-1ae82b3d5445 tempest-FloatingIPsTestJSON-1281629847 tempest-FloatingIPsTestJSON-1281629847-project] Request method failure captured: Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/os-floating-ips/1d9afa26-6e2b-4ffe-bd79-afb96600eafb HTTP/1.1 Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOyLPjLkPbhWSd9jEOhMwi68eywWGApM_XzX6oy-_uUVC_-2TGbm1kKeLa6PWZHniiwBSiXZIKqOSimy4eD8Q1iv-kktdnVdpzJQvdCBj3egLUXYBuviKVS5KhV5mpiSzrsbt4SmNKx3ah3hTPhqZhu8KhuJKI32WfWQSlWMTpsgDxg Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 3526d69fdeff43be95a2760b14b33abc Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-FloatingIPsTestJSON-1281629847 Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3526d69fdeff43be95a2760b14b33abc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3526d69fdeff43be95a2760b14b33abc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3526d69fdeff43be95a2760b14b33abc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3526d69fdeff43be95a2760b14b33abc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-FloatingIPsTestJSON-1281629847 Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 3526d69fdeff43be95a2760b14b33abc Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1281629847 Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-FloatingIPsTestJSON-1281629847-project Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 40ee91bc3e4044c588799f3894df24e7 Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-FloatingIPsTestJSON-1281629847-project Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: exception: Floating IP not found for ID 1d9afa26-6e2b-4ffe-bd79-afb96600eafb Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '1d9afa26-6e2b-4ffe-bd79-afb96600eafb'} Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 1d9afa26-6e2b-4ffe-bd79-afb96600eafb could not be found Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eb8e2853-7f26-4adc-acc3-372a8d48fe45'] Oct 05 02:31:52.027188 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 1d9afa26-6e2b-4ffe-bd79-afb96600eafb. Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 1d9afa26-6e2b-4ffe-bd79-afb96600eafb Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 1d9afa26-6e2b-4ffe-bd79-afb96600eafb Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-96ad2803-eb61-4990-bd70-1ae82b3d5445 tempest-FloatingIPsTestJSON-1281629847 tempest-FloatingIPsTestJSON-1281629847-project] Returning 404 to user: Floating IP not found for ID 1d9afa26-6e2b-4ffe-bd79-afb96600eafb {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-96ad2803-eb61-4990-bd70-1ae82b3d5445 tempest-FloatingIPsTestJSON-1281629847 tempest-FloatingIPsTestJSON-1281629847-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/1d9afa26-6e2b-4ffe-bd79-afb96600eafb" status: 404 len: 111 microversion: 2.1 time: 0.108318 Oct 05 02:31:52.036104 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 601/1213] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 5 02:31:51 2022] DELETE /compute/v2.1/os-floating-ips/1d9afa26-6e2b-4ffe-bd79-afb96600eafb => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:31:52.255060 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1dcf5837-9986-45d4-b51e-1f31be1dd188 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:52.267150 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1dcf5837-9986-45d4-b51e-1f31be1dd188 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893" status: 200 len: 1316 microversion: 2.1 time: 0.470512 Oct 05 02:31:52.270118 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 613/1214] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:51 2022] GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893 => generated 1316 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:52.445705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6b983f0d-c01b-4a2f-8ca9-27ed5e9fb41b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:52.447060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6b983f0d-c01b-4a2f-8ca9-27ed5e9fb41b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:52.455131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b983f0d-c01b-4a2f-8ca9-27ed5e9fb41b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:52.456018 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b983f0d-c01b-4a2f-8ca9-27ed5e9fb41b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:52.456614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b983f0d-c01b-4a2f-8ca9-27ed5e9fb41b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:52.457566 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b983f0d-c01b-4a2f-8ca9-27ed5e9fb41b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:52.458216 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b983f0d-c01b-4a2f-8ca9-27ed5e9fb41b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:52.458781 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b983f0d-c01b-4a2f-8ca9-27ed5e9fb41b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:52.773401 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6b983f0d-c01b-4a2f-8ca9-27ed5e9fb41b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:52.798144 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6b983f0d-c01b-4a2f-8ca9-27ed5e9fb41b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1472 microversion: 2.1 time: 0.344015 Oct 05 02:31:52.815862 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 602/1215] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:52 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1472 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:52.858618 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-b04271ee-d710-40e4-be1b-c818f6c3ce4a req-8fc2f67d-abcb-4100-9b2c-165c6ffae659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eec04f70-af6c-4489-b51e-712165cb8893", "name": "network-vif-plugged", "status": "completed", "tag": "1b500420-b259-4125-8c4d-26eee2187a24"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:52.879769 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b04271ee-d710-40e4-be1b-c818f6c3ce4a req-8fc2f67d-abcb-4100-9b2c-165c6ffae659 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:52.879982 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7c388252-57b9-445b-8145-f8fa7719c320 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:52.880507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7c388252-57b9-445b-8145-f8fa7719c320 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:52.880986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b04271ee-d710-40e4-be1b-c818f6c3ce4a req-8fc2f67d-abcb-4100-9b2c-165c6ffae659 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:52.881583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b04271ee-d710-40e4-be1b-c818f6c3ce4a req-8fc2f67d-abcb-4100-9b2c-165c6ffae659 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:52.893506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c388252-57b9-445b-8145-f8fa7719c320 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:52.894008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c388252-57b9-445b-8145-f8fa7719c320 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:52.894452 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c388252-57b9-445b-8145-f8fa7719c320 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:52.895163 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c388252-57b9-445b-8145-f8fa7719c320 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:52.900065 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c388252-57b9-445b-8145-f8fa7719c320 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:52.900710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c388252-57b9-445b-8145-f8fa7719c320 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:52.905983 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-b04271ee-d710-40e4-be1b-c818f6c3ce4a req-8fc2f67d-abcb-4100-9b2c-165c6ffae659 service nova] Creating event network-vif-plugged:1b500420-b259-4125-8c4d-26eee2187a24 for instance eec04f70-af6c-4489-b51e-712165cb8893 on n-h1-858272-3 Oct 05 02:31:52.921950 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-b04271ee-d710-40e4-be1b-c818f6c3ce4a req-8fc2f67d-abcb-4100-9b2c-165c6ffae659 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066734 Oct 05 02:31:52.923162 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 614/1216] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:31:53.224724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7c388252-57b9-445b-8145-f8fa7719c320 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:53.241043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7c388252-57b9-445b-8145-f8fa7719c320 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:53.243234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7c388252-57b9-445b-8145-f8fa7719c320 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:53.244449 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7c388252-57b9-445b-8145-f8fa7719c320 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1814 microversion: 2.25 time: 0.369329 Oct 05 02:31:53.255800 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 603/1217] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:52 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1814 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:31:53.292327 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-657cb090-ad3d-490b-9908-9f6eb1a73eb8 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:53.293048 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-657cb090-ad3d-490b-9908-9f6eb1a73eb8 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: eec04f70-af6c-4489-b51e-712165cb8893] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:53.304553 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-657cb090-ad3d-490b-9908-9f6eb1a73eb8 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:53.305082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-657cb090-ad3d-490b-9908-9f6eb1a73eb8 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:53.305529 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-657cb090-ad3d-490b-9908-9f6eb1a73eb8 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:53.306230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-657cb090-ad3d-490b-9908-9f6eb1a73eb8 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:53.306731 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-657cb090-ad3d-490b-9908-9f6eb1a73eb8 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:53.307104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-657cb090-ad3d-490b-9908-9f6eb1a73eb8 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:53.807110 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-657cb090-ad3d-490b-9908-9f6eb1a73eb8 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:53.821340 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-657cb090-ad3d-490b-9908-9f6eb1a73eb8 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893" status: 200 len: 1316 microversion: 2.1 time: 0.531418 Oct 05 02:31:53.824725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5b30fa38-8b77-48b4-ab6c-5d24a7c6056e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:53.825978 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5b30fa38-8b77-48b4-ab6c-5d24a7c6056e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:53.829061 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 615/1218] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:53 2022] GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893 => generated 1316 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:53.847009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b30fa38-8b77-48b4-ab6c-5d24a7c6056e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:53.847823 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b30fa38-8b77-48b4-ab6c-5d24a7c6056e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:53.848450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b30fa38-8b77-48b4-ab6c-5d24a7c6056e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:53.849402 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b30fa38-8b77-48b4-ab6c-5d24a7c6056e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:53.850059 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b30fa38-8b77-48b4-ab6c-5d24a7c6056e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:53.850482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b30fa38-8b77-48b4-ab6c-5d24a7c6056e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:54.158449 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5b30fa38-8b77-48b4-ab6c-5d24a7c6056e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:54.172781 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5b30fa38-8b77-48b4-ab6c-5d24a7c6056e tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1472 microversion: 2.1 time: 0.351694 Oct 05 02:31:54.173886 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 604/1219] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:53 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1472 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:31:54.272147 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fdd08cda-1ab3-42b6-8422-8017cecf1573 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:54.273473 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fdd08cda-1ab3-42b6-8422-8017cecf1573 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:54.282522 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fdd08cda-1ab3-42b6-8422-8017cecf1573 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:54.283293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fdd08cda-1ab3-42b6-8422-8017cecf1573 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:54.283903 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fdd08cda-1ab3-42b6-8422-8017cecf1573 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:54.284811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fdd08cda-1ab3-42b6-8422-8017cecf1573 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:54.285455 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fdd08cda-1ab3-42b6-8422-8017cecf1573 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:54.286044 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fdd08cda-1ab3-42b6-8422-8017cecf1573 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:54.546718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fdd08cda-1ab3-42b6-8422-8017cecf1573 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:54.558445 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fdd08cda-1ab3-42b6-8422-8017cecf1573 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:54.559913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fdd08cda-1ab3-42b6-8422-8017cecf1573 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:54.574263 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fdd08cda-1ab3-42b6-8422-8017cecf1573 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1814 microversion: 2.25 time: 0.307209 Oct 05 02:31:54.574869 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 616/1220] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:54 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1814 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:31:54.850838 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b28ef78c-17b5-456e-8df8-9189ad661850 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:54.852331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b28ef78c-17b5-456e-8df8-9189ad661850 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: eec04f70-af6c-4489-b51e-712165cb8893] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:54.855520 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:54.868249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b28ef78c-17b5-456e-8df8-9189ad661850 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:54.869115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b28ef78c-17b5-456e-8df8-9189ad661850 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:54.869726 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b28ef78c-17b5-456e-8df8-9189ad661850 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:54.870617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b28ef78c-17b5-456e-8df8-9189ad661850 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:54.879725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b28ef78c-17b5-456e-8df8-9189ad661850 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:54.880659 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b28ef78c-17b5-456e-8df8-9189ad661850 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:55.172185 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b28ef78c-17b5-456e-8df8-9189ad661850 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:55.182667 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b28ef78c-17b5-456e-8df8-9189ad661850 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893" status: 200 len: 1505 microversion: 2.1 time: 0.335732 Oct 05 02:31:55.193734 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 605/1221] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:54 2022] GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893 => generated 1505 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:55.210576 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3ac6180e-f0c3-4ad9-888a-5229a1fe039d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:55.211207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3ac6180e-f0c3-4ad9-888a-5229a1fe039d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:55.228383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3ac6180e-f0c3-4ad9-888a-5229a1fe039d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:55.231106 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f86aeafa-4b31-418d-8acb-48f65f71b904 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-311225453"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:55.231661 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f86aeafa-4b31-418d-8acb-48f65f71b904 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: eec04f70-af6c-4489-b51e-712165cb8893] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:55.239460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3ac6180e-f0c3-4ad9-888a-5229a1fe039d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:55.240091 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3ac6180e-f0c3-4ad9-888a-5229a1fe039d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:55.240857 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3ac6180e-f0c3-4ad9-888a-5229a1fe039d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:55.241349 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3ac6180e-f0c3-4ad9-888a-5229a1fe039d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:55.241778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3ac6180e-f0c3-4ad9-888a-5229a1fe039d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:55.253642 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f86aeafa-4b31-418d-8acb-48f65f71b904 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:55.265949 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f86aeafa-4b31-418d-8acb-48f65f71b904 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:55.266497 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f86aeafa-4b31-418d-8acb-48f65f71b904 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:55.277698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f86aeafa-4b31-418d-8acb-48f65f71b904 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:55.278436 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f86aeafa-4b31-418d-8acb-48f65f71b904 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:55.279029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f86aeafa-4b31-418d-8acb-48f65f71b904 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:55.568271 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3ac6180e-f0c3-4ad9-888a-5229a1fe039d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:55.581524 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3ac6180e-f0c3-4ad9-888a-5229a1fe039d tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1478 microversion: 2.1 time: 0.378154 Oct 05 02:31:55.602113 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 617/1222] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:55 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1478 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:55.612106 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b3b4cb0c-6fb2-4cec-8fdd-59883f7197c8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:55.613171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b3b4cb0c-6fb2-4cec-8fdd-59883f7197c8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:55.627136 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3b4cb0c-6fb2-4cec-8fdd-59883f7197c8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:55.630798 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3b4cb0c-6fb2-4cec-8fdd-59883f7197c8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:55.631508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3b4cb0c-6fb2-4cec-8fdd-59883f7197c8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:55.632426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3b4cb0c-6fb2-4cec-8fdd-59883f7197c8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:55.633077 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3b4cb0c-6fb2-4cec-8fdd-59883f7197c8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:55.633684 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3b4cb0c-6fb2-4cec-8fdd-59883f7197c8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:55.741506 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.network.security_group_api [None req-f86aeafa-4b31-418d-8acb-48f65f71b904 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Adding security group 39028f60-e6c9-497a-9ed5-786de1288335 to port 1b500420-b259-4125-8c4d-26eee2187a24 Oct 05 02:31:55.975114 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b3b4cb0c-6fb2-4cec-8fdd-59883f7197c8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:55.989763 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b3b4cb0c-6fb2-4cec-8fdd-59883f7197c8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:55.992402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b3b4cb0c-6fb2-4cec-8fdd-59883f7197c8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:55.994822 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b3b4cb0c-6fb2-4cec-8fdd-59883f7197c8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1814 microversion: 2.25 time: 0.391545 Oct 05 02:31:55.996427 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 618/1223] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:55 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1814 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:31:56.611516 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f86aeafa-4b31-418d-8acb-48f65f71b904 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "POST /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893/action" status: 202 len: 0 microversion: 2.1 time: 1.395927 Oct 05 02:31:56.612880 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 606/1224] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:31:55 2022] POST /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893/action => generated 0 bytes in 1398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:31:56.624871 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-129559b0-9871-4e5a-9003-3bb0fe84324a tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '.version_select at 0x7fccdfe8c8b0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:56.633869 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8bd4a0bc-695e-4f01-9d29-20d9d66d9d11 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:56.634490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8bd4a0bc-695e-4f01-9d29-20d9d66d9d11 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:56.649091 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bd4a0bc-695e-4f01-9d29-20d9d66d9d11 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:56.649604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bd4a0bc-695e-4f01-9d29-20d9d66d9d11 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:56.650038 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bd4a0bc-695e-4f01-9d29-20d9d66d9d11 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:56.651245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bd4a0bc-695e-4f01-9d29-20d9d66d9d11 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:56.651888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bd4a0bc-695e-4f01-9d29-20d9d66d9d11 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:56.652591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bd4a0bc-695e-4f01-9d29-20d9d66d9d11 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:57.337534 n-d-858272-3 devstack@n-api.service[122320]: DEBUG neutronclient.v2_0.client [None req-129559b0-9871-4e5a-9003-3bb0fe84324a tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 39028f60-e6c9-497a-9ed5-786de1288335 in use.", "detail": ""}} {{(pid=122320) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 02:31:57.338533 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-129559b0-9871-4e5a-9003-3bb0fe84324a tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] HTTP exception thrown: Security Group 39028f60-e6c9-497a-9ed5-786de1288335 in use. Oct 05 02:31:57.338533 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-d3722309-844f-4e5d-9085-425e5cb12538'] Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-129559b0-9871-4e5a-9003-3bb0fe84324a tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Request method failure captured: Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/os-security-groups/39028f60-e6c9-497a-9ed5-786de1288335 HTTP/1.1 Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOxsHfqJu7XBSEzDOBBt7syFIrL9J3OT791dcmShV5lM5pjmkDuONYQmP8-v9KquUBaUHsqFGt8nuaScu9b1kWZKpy9EaLULGZXiZUnDwZJ186OmmTbSMTU6SH3NtgLtLUXyXXhUjMZrhdeVS_vfD8uyVuQTvFy3dykhyOfc3uq0Kds Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c96108fae56640b6aa0cb68523504c43 Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c96108fae56640b6aa0cb68523504c43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c96108fae56640b6aa0cb68523504c43 Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-SecurityGroupsTestJSON-1913947248-project Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 9925b3a9a63c4b1cb98a8adcc28f916d Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-SecurityGroupsTestJSON-1913947248-project Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: exception: Security Group 39028f60-e6c9-497a-9ed5-786de1288335 in use. Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-d3722309-844f-4e5d-9085-425e5cb12538'] Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '39028f60-e6c9-497a-9ed5-786de1288335'} Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 02:31:57.340854 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 39028f60-e6c9-497a-9ed5-786de1288335 in use. Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d3722309-844f-4e5d-9085-425e5cb12538'] Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 39028f60-e6c9-497a-9ed5-786de1288335 in use. Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d3722309-844f-4e5d-9085-425e5cb12538'] Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 39028f60-e6c9-497a-9ed5-786de1288335 in use. Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d3722309-844f-4e5d-9085-425e5cb12538'] Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 39028f60-e6c9-497a-9ed5-786de1288335 in use. Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d3722309-844f-4e5d-9085-425e5cb12538'] Oct 05 02:31:57.345457 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:31:57.351406 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-129559b0-9871-4e5a-9003-3bb0fe84324a tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Returning 400 to user: Security Group 39028f60-e6c9-497a-9ed5-786de1288335 in use. Oct 05 02:31:57.351406 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-d3722309-844f-4e5d-9085-425e5cb12538'] {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:31:57.352271 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8bd4a0bc-695e-4f01-9d29-20d9d66d9d11 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:57.352936 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-129559b0-9871-4e5a-9003-3bb0fe84324a tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/39028f60-e6c9-497a-9ed5-786de1288335" status: 400 len: 185 microversion: 2.1 time: 0.734896 Oct 05 02:31:57.358013 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 607/1225] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:31:56 2022] DELETE /compute/v2.1/os-security-groups/39028f60-e6c9-497a-9ed5-786de1288335 => generated 185 bytes in 741 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:31:57.371588 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8bd4a0bc-695e-4f01-9d29-20d9d66d9d11 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1478 microversion: 2.1 time: 0.761324 Oct 05 02:31:57.372198 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 619/1226] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:56 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1478 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:31:57.377909 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fa927ac1-20c4-47c1-b6a4-e2616453f8e8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:57.378512 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fa927ac1-20c4-47c1-b6a4-e2616453f8e8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:57.391278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-c459e33f-0ce4-4c69-a0a1-044c7de1c426 req-f7628273-9597-4035-a7cb-bc482f18dd5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eec04f70-af6c-4489-b51e-712165cb8893", "tag": "1b500420-b259-4125-8c4d-26eee2187a24"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:57.401383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa927ac1-20c4-47c1-b6a4-e2616453f8e8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:57.403891 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa927ac1-20c4-47c1-b6a4-e2616453f8e8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:57.404474 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa927ac1-20c4-47c1-b6a4-e2616453f8e8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:57.405685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa927ac1-20c4-47c1-b6a4-e2616453f8e8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:57.406401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa927ac1-20c4-47c1-b6a4-e2616453f8e8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:57.407409 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa927ac1-20c4-47c1-b6a4-e2616453f8e8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:57.428055 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-c459e33f-0ce4-4c69-a0a1-044c7de1c426 req-f7628273-9597-4035-a7cb-bc482f18dd5c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:57.429606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-c459e33f-0ce4-4c69-a0a1-044c7de1c426 req-f7628273-9597-4035-a7cb-bc482f18dd5c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:57.430828 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-c459e33f-0ce4-4c69-a0a1-044c7de1c426 req-f7628273-9597-4035-a7cb-bc482f18dd5c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:57.456628 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-c459e33f-0ce4-4c69-a0a1-044c7de1c426 req-f7628273-9597-4035-a7cb-bc482f18dd5c service nova] Creating event network-changed:1b500420-b259-4125-8c4d-26eee2187a24 for instance eec04f70-af6c-4489-b51e-712165cb8893 on n-h1-858272-3 Oct 05 02:31:57.466624 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-c459e33f-0ce4-4c69-a0a1-044c7de1c426 req-f7628273-9597-4035-a7cb-bc482f18dd5c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106102 Oct 05 02:31:57.470581 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 608/1227] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:31:57.476343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-98579554-06ab-4005-be1b-3b8c5cdb7ce2 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:57.491623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-98579554-06ab-4005-be1b-3b8c5cdb7ce2 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: eec04f70-af6c-4489-b51e-712165cb8893] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:57.498524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98579554-06ab-4005-be1b-3b8c5cdb7ce2 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:57.505817 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98579554-06ab-4005-be1b-3b8c5cdb7ce2 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:57.506629 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98579554-06ab-4005-be1b-3b8c5cdb7ce2 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:57.507568 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98579554-06ab-4005-be1b-3b8c5cdb7ce2 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:57.508289 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98579554-06ab-4005-be1b-3b8c5cdb7ce2 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:57.509008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98579554-06ab-4005-be1b-3b8c5cdb7ce2 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:57.669346 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-98579554-06ab-4005-be1b-3b8c5cdb7ce2 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "POST /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893/action" status: 202 len: 0 microversion: 2.1 time: 0.197115 Oct 05 02:31:57.690160 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 609/1228] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:31:57 2022] POST /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:31:57.708885 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a86dcdbf-d2fe-424a-ab22-6c0fd88b5faa tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:57.710166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a86dcdbf-d2fe-424a-ab22-6c0fd88b5faa tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: eec04f70-af6c-4489-b51e-712165cb8893] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:57.720935 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a86dcdbf-d2fe-424a-ab22-6c0fd88b5faa tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:57.722257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a86dcdbf-d2fe-424a-ab22-6c0fd88b5faa tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:57.723332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a86dcdbf-d2fe-424a-ab22-6c0fd88b5faa tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:57.724566 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a86dcdbf-d2fe-424a-ab22-6c0fd88b5faa tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:57.726409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a86dcdbf-d2fe-424a-ab22-6c0fd88b5faa tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:57.727039 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a86dcdbf-d2fe-424a-ab22-6c0fd88b5faa tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:58.076024 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fa927ac1-20c4-47c1-b6a4-e2616453f8e8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:58.094841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fa927ac1-20c4-47c1-b6a4-e2616453f8e8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:58.096754 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fa927ac1-20c4-47c1-b6a4-e2616453f8e8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:58.098181 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fa927ac1-20c4-47c1-b6a4-e2616453f8e8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1814 microversion: 2.25 time: 0.724989 Oct 05 02:31:58.098922 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 620/1229] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:57 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1814 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:31:58.289446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-95a59356-6bbd-4481-b838-81890730eda8 req-aa22c89f-6544-414a-8a6c-486cb9afc9e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "861e3da3-98a1-4728-b218-322c9db128b3", "name": "network-vif-unplugged", "status": "completed", "tag": "1414377b-0304-4553-b209-c5c3a5855cea"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:31:58.307754 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-95a59356-6bbd-4481-b838-81890730eda8 req-aa22c89f-6544-414a-8a6c-486cb9afc9e5 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:58.308508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-95a59356-6bbd-4481-b838-81890730eda8 req-aa22c89f-6544-414a-8a6c-486cb9afc9e5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:58.309465 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-95a59356-6bbd-4481-b838-81890730eda8 req-aa22c89f-6544-414a-8a6c-486cb9afc9e5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:58.334412 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-95a59356-6bbd-4481-b838-81890730eda8 req-aa22c89f-6544-414a-8a6c-486cb9afc9e5 service nova] Creating event network-vif-unplugged:1414377b-0304-4553-b209-c5c3a5855cea for instance 861e3da3-98a1-4728-b218-322c9db128b3 on n-h2-858272-3 Oct 05 02:31:58.346936 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-95a59356-6bbd-4481-b838-81890730eda8 req-aa22c89f-6544-414a-8a6c-486cb9afc9e5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061004 Oct 05 02:31:58.349159 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 621/1230] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:31:58.372278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a86dcdbf-d2fe-424a-ab22-6c0fd88b5faa tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:58.387316 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a86dcdbf-d2fe-424a-ab22-6c0fd88b5faa tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893" status: 200 len: 1575 microversion: 2.1 time: 0.695333 Oct 05 02:31:58.389369 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 610/1231] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:57 2022] GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893 => generated 1575 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:31:58.405183 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e867099d-998c-443f-9042-0a98b48e3778 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:58.406063 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e867099d-998c-443f-9042-0a98b48e3778 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:58.425448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e867099d-998c-443f-9042-0a98b48e3778 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:58.426049 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e867099d-998c-443f-9042-0a98b48e3778 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:58.426488 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e867099d-998c-443f-9042-0a98b48e3778 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:58.427238 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e867099d-998c-443f-9042-0a98b48e3778 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:58.428317 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e867099d-998c-443f-9042-0a98b48e3778 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:58.428755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e867099d-998c-443f-9042-0a98b48e3778 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:59.125310 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fbcd73c2-701f-47bc-934e-9f0d21c1a74e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:59.126171 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fbcd73c2-701f-47bc-934e-9f0d21c1a74e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:59.134393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fbcd73c2-701f-47bc-934e-9f0d21c1a74e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:59.134969 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fbcd73c2-701f-47bc-934e-9f0d21c1a74e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:59.135476 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fbcd73c2-701f-47bc-934e-9f0d21c1a74e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:59.136611 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fbcd73c2-701f-47bc-934e-9f0d21c1a74e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:59.137042 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fbcd73c2-701f-47bc-934e-9f0d21c1a74e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:59.137672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fbcd73c2-701f-47bc-934e-9f0d21c1a74e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:59.141872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e867099d-998c-443f-9042-0a98b48e3778 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:59.149717 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:59.156605 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e867099d-998c-443f-9042-0a98b48e3778 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1478 microversion: 2.1 time: 0.763853 Oct 05 02:31:59.174185 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 622/1232] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:58 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1478 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:31:59.416151 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e624663e-80da-4f45-a8b0-cb0aefcab246 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:31:59.417394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e624663e-80da-4f45-a8b0-cb0aefcab246 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: eec04f70-af6c-4489-b51e-712165cb8893] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:31:59.431574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e624663e-80da-4f45-a8b0-cb0aefcab246 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:59.432571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e624663e-80da-4f45-a8b0-cb0aefcab246 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:59.433251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e624663e-80da-4f45-a8b0-cb0aefcab246 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:59.438036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e624663e-80da-4f45-a8b0-cb0aefcab246 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:31:59.438861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e624663e-80da-4f45-a8b0-cb0aefcab246 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:31:59.439745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e624663e-80da-4f45-a8b0-cb0aefcab246 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:31:59.512690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fbcd73c2-701f-47bc-934e-9f0d21c1a74e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:59.525481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fbcd73c2-701f-47bc-934e-9f0d21c1a74e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:59.528310 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fbcd73c2-701f-47bc-934e-9f0d21c1a74e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:59.530536 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fbcd73c2-701f-47bc-934e-9f0d21c1a74e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1814 microversion: 2.25 time: 0.409664 Oct 05 02:31:59.531773 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 611/1233] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:31:59 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1814 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:31:59.893193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e624663e-80da-4f45-a8b0-cb0aefcab246 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:31:59.902421 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e624663e-80da-4f45-a8b0-cb0aefcab246 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893" status: 200 len: 1575 microversion: 2.1 time: 0.491344 Oct 05 02:31:59.931718 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 623/1234] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:31:59 2022] GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893 => generated 1575 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:00.185197 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7a03ca68-683a-4c96-84e8-3b1b408d6162 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:00.187282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7a03ca68-683a-4c96-84e8-3b1b408d6162 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:00.202447 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a03ca68-683a-4c96-84e8-3b1b408d6162 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:00.203169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a03ca68-683a-4c96-84e8-3b1b408d6162 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:00.205810 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a03ca68-683a-4c96-84e8-3b1b408d6162 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:00.206918 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a03ca68-683a-4c96-84e8-3b1b408d6162 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:00.208060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a03ca68-683a-4c96-84e8-3b1b408d6162 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:00.208857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a03ca68-683a-4c96-84e8-3b1b408d6162 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:00.463360 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7a03ca68-683a-4c96-84e8-3b1b408d6162 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:00.475288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:00.479346 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7a03ca68-683a-4c96-84e8-3b1b408d6162 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1478 microversion: 2.1 time: 0.299457 Oct 05 02:32:00.481633 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 612/1235] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:00 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1478 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:00.559266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6b85213e-9989-445c-b85f-506ef71c2b06 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:00.560743 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6b85213e-9989-445c-b85f-506ef71c2b06 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:00.581549 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b85213e-9989-445c-b85f-506ef71c2b06 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:00.582424 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b85213e-9989-445c-b85f-506ef71c2b06 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:00.583147 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b85213e-9989-445c-b85f-506ef71c2b06 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:00.584434 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b85213e-9989-445c-b85f-506ef71c2b06 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:00.585413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b85213e-9989-445c-b85f-506ef71c2b06 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:00.586893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b85213e-9989-445c-b85f-506ef71c2b06 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:00.808256 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6b85213e-9989-445c-b85f-506ef71c2b06 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:00.818968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6b85213e-9989-445c-b85f-506ef71c2b06 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:00.820741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6b85213e-9989-445c-b85f-506ef71c2b06 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:00.822221 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6b85213e-9989-445c-b85f-506ef71c2b06 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1814 microversion: 2.25 time: 0.267838 Oct 05 02:32:00.823399 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 624/1236] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:00 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1814 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:32:00.934912 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-944ba09f-9243-4245-9603-bb68c471c2b6 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:00.935564 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-944ba09f-9243-4245-9603-bb68c471c2b6 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: eec04f70-af6c-4489-b51e-712165cb8893] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:00.945684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-944ba09f-9243-4245-9603-bb68c471c2b6 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:00.953150 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-944ba09f-9243-4245-9603-bb68c471c2b6 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:00.953757 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-944ba09f-9243-4245-9603-bb68c471c2b6 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:00.954604 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-944ba09f-9243-4245-9603-bb68c471c2b6 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:00.955076 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-944ba09f-9243-4245-9603-bb68c471c2b6 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:00.955508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-944ba09f-9243-4245-9603-bb68c471c2b6 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:01.215871 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-944ba09f-9243-4245-9603-bb68c471c2b6 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:01.239437 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-944ba09f-9243-4245-9603-bb68c471c2b6 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893" status: 200 len: 1580 microversion: 2.1 time: 0.302948 Oct 05 02:32:01.242081 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 613/1237] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:00 2022] GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893 => generated 1580 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:01.505599 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-59ccf0e1-00f2-4265-a82c-05814bf76911 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:01.506715 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-59ccf0e1-00f2-4265-a82c-05814bf76911 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:01.515226 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-59ccf0e1-00f2-4265-a82c-05814bf76911 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:01.516623 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-59ccf0e1-00f2-4265-a82c-05814bf76911 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:01.517180 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-59ccf0e1-00f2-4265-a82c-05814bf76911 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:01.518138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-59ccf0e1-00f2-4265-a82c-05814bf76911 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:01.518685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-59ccf0e1-00f2-4265-a82c-05814bf76911 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:01.519183 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-59ccf0e1-00f2-4265-a82c-05814bf76911 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:01.804746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-59ccf0e1-00f2-4265-a82c-05814bf76911 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:01.813716 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-59ccf0e1-00f2-4265-a82c-05814bf76911 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1478 microversion: 2.1 time: 0.312809 Oct 05 02:32:01.815021 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 625/1238] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:01 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1478 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:01.859370 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7ebac952-a671-428d-bdee-2fbe8a6110d7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:01.860717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7ebac952-a671-428d-bdee-2fbe8a6110d7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:01.881369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7ebac952-a671-428d-bdee-2fbe8a6110d7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:01.883062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7ebac952-a671-428d-bdee-2fbe8a6110d7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:01.890449 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7ebac952-a671-428d-bdee-2fbe8a6110d7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:01.892603 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7ebac952-a671-428d-bdee-2fbe8a6110d7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:01.893303 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7ebac952-a671-428d-bdee-2fbe8a6110d7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:01.895970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7ebac952-a671-428d-bdee-2fbe8a6110d7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:02.252964 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7ebac952-a671-428d-bdee-2fbe8a6110d7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:02.278322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d729086e-cad3-4e57-a9d6-01883d0837ec tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:02.279299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d729086e-cad3-4e57-a9d6-01883d0837ec tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: eec04f70-af6c-4489-b51e-712165cb8893] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:02.312506 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d729086e-cad3-4e57-a9d6-01883d0837ec tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:02.313059 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d729086e-cad3-4e57-a9d6-01883d0837ec tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:02.314996 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d729086e-cad3-4e57-a9d6-01883d0837ec tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:02.318603 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7ebac952-a671-428d-bdee-2fbe8a6110d7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:02.318945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d729086e-cad3-4e57-a9d6-01883d0837ec tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:02.318945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d729086e-cad3-4e57-a9d6-01883d0837ec tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:02.319786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7ebac952-a671-428d-bdee-2fbe8a6110d7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:02.320376 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d729086e-cad3-4e57-a9d6-01883d0837ec tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:02.323177 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7ebac952-a671-428d-bdee-2fbe8a6110d7 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1814 microversion: 2.25 time: 0.475879 Oct 05 02:32:02.348854 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 614/1239] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:01 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1814 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:32:02.540652 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-8f41ffce-cef2-4dc8-9da1-9508aea98b2b req-5bbaa249-098a-41f4-a53a-95c4d781801a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "861e3da3-98a1-4728-b218-322c9db128b3", "name": "network-vif-plugged", "status": "completed", "tag": "1414377b-0304-4553-b209-c5c3a5855cea"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:32:02.574944 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-8f41ffce-cef2-4dc8-9da1-9508aea98b2b req-5bbaa249-098a-41f4-a53a-95c4d781801a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:02.575843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-8f41ffce-cef2-4dc8-9da1-9508aea98b2b req-5bbaa249-098a-41f4-a53a-95c4d781801a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:02.577977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-8f41ffce-cef2-4dc8-9da1-9508aea98b2b req-5bbaa249-098a-41f4-a53a-95c4d781801a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:02.606897 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-8f41ffce-cef2-4dc8-9da1-9508aea98b2b req-5bbaa249-098a-41f4-a53a-95c4d781801a service nova] Creating event network-vif-plugged:1414377b-0304-4553-b209-c5c3a5855cea for instance 861e3da3-98a1-4728-b218-322c9db128b3 on n-h2-858272-3 Oct 05 02:32:02.619908 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-8f41ffce-cef2-4dc8-9da1-9508aea98b2b req-5bbaa249-098a-41f4-a53a-95c4d781801a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092623 Oct 05 02:32:02.622053 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 615/1240] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:32:02.763233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d729086e-cad3-4e57-a9d6-01883d0837ec tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:02.778046 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d729086e-cad3-4e57-a9d6-01883d0837ec tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893" status: 200 len: 1573 microversion: 2.1 time: 0.513071 Oct 05 02:32:02.779812 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 626/1241] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:02 2022] GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893 => generated 1573 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:02.804415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a2aa65e2-a2ce-4223-9b54-cc1d6de683dc tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-183533868"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:32:02.805402 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a2aa65e2-a2ce-4223-9b54-cc1d6de683dc tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: eec04f70-af6c-4489-b51e-712165cb8893] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:02.822164 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2aa65e2-a2ce-4223-9b54-cc1d6de683dc tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:02.823071 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2aa65e2-a2ce-4223-9b54-cc1d6de683dc tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:02.824080 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2aa65e2-a2ce-4223-9b54-cc1d6de683dc tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:02.825025 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2aa65e2-a2ce-4223-9b54-cc1d6de683dc tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:02.827334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2aa65e2-a2ce-4223-9b54-cc1d6de683dc tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:02.828069 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2aa65e2-a2ce-4223-9b54-cc1d6de683dc tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:02.841192 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fa6026a6-003c-4907-9c2b-91ec0b7e80a6 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:02.843297 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fa6026a6-003c-4907-9c2b-91ec0b7e80a6 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:02.859811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa6026a6-003c-4907-9c2b-91ec0b7e80a6 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:02.860345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa6026a6-003c-4907-9c2b-91ec0b7e80a6 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:02.862701 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa6026a6-003c-4907-9c2b-91ec0b7e80a6 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:02.863744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa6026a6-003c-4907-9c2b-91ec0b7e80a6 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:02.864227 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa6026a6-003c-4907-9c2b-91ec0b7e80a6 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:02.864764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa6026a6-003c-4907-9c2b-91ec0b7e80a6 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:03.312587 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.network.security_group_api [None req-a2aa65e2-a2ce-4223-9b54-cc1d6de683dc tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Adding security group df17ff5e-63f2-456e-a3c1-bd6f1125bd0a to port 1b500420-b259-4125-8c4d-26eee2187a24 Oct 05 02:32:03.333429 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fa6026a6-003c-4907-9c2b-91ec0b7e80a6 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:03.344659 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fa6026a6-003c-4907-9c2b-91ec0b7e80a6 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1478 microversion: 2.1 time: 0.508571 Oct 05 02:32:03.348356 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 627/1242] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:02 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1478 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:03.366232 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6f4ec0c3-2ee8-4979-9e54-d0216e0198e8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:03.366847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6f4ec0c3-2ee8-4979-9e54-d0216e0198e8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:03.389901 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f4ec0c3-2ee8-4979-9e54-d0216e0198e8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:03.390800 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f4ec0c3-2ee8-4979-9e54-d0216e0198e8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:03.391408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f4ec0c3-2ee8-4979-9e54-d0216e0198e8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:03.392814 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f4ec0c3-2ee8-4979-9e54-d0216e0198e8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:03.396481 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f4ec0c3-2ee8-4979-9e54-d0216e0198e8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:03.397300 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f4ec0c3-2ee8-4979-9e54-d0216e0198e8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:03.713260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6f4ec0c3-2ee8-4979-9e54-d0216e0198e8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:03.722686 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6f4ec0c3-2ee8-4979-9e54-d0216e0198e8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:03.724115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6f4ec0c3-2ee8-4979-9e54-d0216e0198e8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:03.735906 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6f4ec0c3-2ee8-4979-9e54-d0216e0198e8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1814 microversion: 2.25 time: 0.372758 Oct 05 02:32:03.738378 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 628/1243] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:03 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1814 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:32:04.383001 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-40e66b6f-9017-4f7f-b773-2a8ff33d586a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:04.384453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-40e66b6f-9017-4f7f-b773-2a8ff33d586a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:04.389519 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a2aa65e2-a2ce-4223-9b54-cc1d6de683dc tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "POST /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893/action" status: 202 len: 0 microversion: 2.1 time: 1.591524 Oct 05 02:32:04.390529 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 616/1244] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:32:02 2022] POST /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893/action => generated 0 bytes in 1594 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:32:04.394650 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40e66b6f-9017-4f7f-b773-2a8ff33d586a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:04.395546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40e66b6f-9017-4f7f-b773-2a8ff33d586a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:04.396215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40e66b6f-9017-4f7f-b773-2a8ff33d586a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:04.397220 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40e66b6f-9017-4f7f-b773-2a8ff33d586a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:04.398237 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40e66b6f-9017-4f7f-b773-2a8ff33d586a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:04.398908 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40e66b6f-9017-4f7f-b773-2a8ff33d586a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:04.400840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d7985272-6760-47a2-a85e-44147846d990 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '.version_select at 0x7fccdfe8c0d0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:05.134744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-40e66b6f-9017-4f7f-b773-2a8ff33d586a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:05.144337 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-40e66b6f-9017-4f7f-b773-2a8ff33d586a tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1478 microversion: 2.1 time: 0.773899 Oct 05 02:32:05.149785 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 629/1245] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:04 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1478 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:05.234094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG neutronclient.v2_0.client [None req-d7985272-6760-47a2-a85e-44147846d990 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group df17ff5e-63f2-456e-a3c1-bd6f1125bd0a in use.", "detail": ""}} {{(pid=122320) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 02:32:05.236195 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-d7985272-6760-47a2-a85e-44147846d990 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] HTTP exception thrown: Security Group df17ff5e-63f2-456e-a3c1-bd6f1125bd0a in use. Oct 05 02:32:05.236195 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-728789f7-7830-4682-b03a-5d352b9d14af'] Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d7985272-6760-47a2-a85e-44147846d990 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Request method failure captured: Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/os-security-groups/df17ff5e-63f2-456e-a3c1-bd6f1125bd0a HTTP/1.1 Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOxsHfqJu7XBSEzDOBBt7syFIrL9J3OT791dcmShV5lM5pjmkDuONYQmP8-v9KquUBaUHsqFGt8nuaScu9b1kWZKpy9EaLULGZXiZUnDwZJ186OmmTbSMTU6SH3NtgLtLUXyXXhUjMZrhdeVS_vfD8uyVuQTvFy3dykhyOfc3uq0Kds Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c96108fae56640b6aa0cb68523504c43 Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c96108fae56640b6aa0cb68523504c43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c96108fae56640b6aa0cb68523504c43 Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-SecurityGroupsTestJSON-1913947248-project Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 9925b3a9a63c4b1cb98a8adcc28f916d Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-SecurityGroupsTestJSON-1913947248-project Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: exception: Security Group df17ff5e-63f2-456e-a3c1-bd6f1125bd0a in use. Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-728789f7-7830-4682-b03a-5d352b9d14af'] Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'df17ff5e-63f2-456e-a3c1-bd6f1125bd0a'} Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 02:32:05.239331 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group df17ff5e-63f2-456e-a3c1-bd6f1125bd0a in use. Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-728789f7-7830-4682-b03a-5d352b9d14af'] Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group df17ff5e-63f2-456e-a3c1-bd6f1125bd0a in use. Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-728789f7-7830-4682-b03a-5d352b9d14af'] Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group df17ff5e-63f2-456e-a3c1-bd6f1125bd0a in use. Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-728789f7-7830-4682-b03a-5d352b9d14af'] Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group df17ff5e-63f2-456e-a3c1-bd6f1125bd0a in use. Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-728789f7-7830-4682-b03a-5d352b9d14af'] Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d7985272-6760-47a2-a85e-44147846d990 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Returning 400 to user: Security Group df17ff5e-63f2-456e-a3c1-bd6f1125bd0a in use. Oct 05 02:32:05.243921 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-728789f7-7830-4682-b03a-5d352b9d14af'] {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:32:05.248448 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d7985272-6760-47a2-a85e-44147846d990 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/df17ff5e-63f2-456e-a3c1-bd6f1125bd0a" status: 400 len: 185 microversion: 2.1 time: 0.852847 Oct 05 02:32:05.253898 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 617/1246] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:32:04 2022] DELETE /compute/v2.1/os-security-groups/df17ff5e-63f2-456e-a3c1-bd6f1125bd0a => generated 185 bytes in 860 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 05 02:32:05.263618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-010ed8d7-6228-4420-87aa-6856110e2eb1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:05.269015 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-010ed8d7-6228-4420-87aa-6856110e2eb1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:05.286994 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-010ed8d7-6228-4420-87aa-6856110e2eb1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:05.287595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-010ed8d7-6228-4420-87aa-6856110e2eb1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:05.289849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-010ed8d7-6228-4420-87aa-6856110e2eb1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:05.290680 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-010ed8d7-6228-4420-87aa-6856110e2eb1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:05.291259 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-010ed8d7-6228-4420-87aa-6856110e2eb1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:05.291789 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-010ed8d7-6228-4420-87aa-6856110e2eb1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:05.415942 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-ab1c0c35-a35b-4a48-b0d8-afa179169c3c req-c0b55814-be96-40a1-988e-e6d745cd038a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eec04f70-af6c-4489-b51e-712165cb8893", "tag": "1b500420-b259-4125-8c4d-26eee2187a24"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:32:05.432057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ab1c0c35-a35b-4a48-b0d8-afa179169c3c req-c0b55814-be96-40a1-988e-e6d745cd038a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:05.432795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ab1c0c35-a35b-4a48-b0d8-afa179169c3c req-c0b55814-be96-40a1-988e-e6d745cd038a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:05.433433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ab1c0c35-a35b-4a48-b0d8-afa179169c3c req-c0b55814-be96-40a1-988e-e6d745cd038a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:05.454917 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-ab1c0c35-a35b-4a48-b0d8-afa179169c3c req-c0b55814-be96-40a1-988e-e6d745cd038a service nova] Creating event network-changed:1b500420-b259-4125-8c4d-26eee2187a24 for instance eec04f70-af6c-4489-b51e-712165cb8893 on n-h1-858272-3 Oct 05 02:32:05.460971 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-ab1c0c35-a35b-4a48-b0d8-afa179169c3c req-c0b55814-be96-40a1-988e-e6d745cd038a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.280877 Oct 05 02:32:05.461743 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 630/1247] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:32:05.471007 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-23b92cdb-77c9-4124-a9f9-36d476cd3658 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:05.472465 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-23b92cdb-77c9-4124-a9f9-36d476cd3658 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: eec04f70-af6c-4489-b51e-712165cb8893] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:05.481213 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23b92cdb-77c9-4124-a9f9-36d476cd3658 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:05.483225 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23b92cdb-77c9-4124-a9f9-36d476cd3658 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:05.483963 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23b92cdb-77c9-4124-a9f9-36d476cd3658 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:05.486108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23b92cdb-77c9-4124-a9f9-36d476cd3658 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:05.486863 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23b92cdb-77c9-4124-a9f9-36d476cd3658 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:05.487645 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23b92cdb-77c9-4124-a9f9-36d476cd3658 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:05.528355 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-23b92cdb-77c9-4124-a9f9-36d476cd3658 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: eec04f70-af6c-4489-b51e-712165cb8893] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:32:05.753096 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-010ed8d7-6228-4420-87aa-6856110e2eb1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:05.763312 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-23b92cdb-77c9-4124-a9f9-36d476cd3658 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893" status: 204 len: 0 microversion: 2.1 time: 0.299874 Oct 05 02:32:05.764282 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 631/1248] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:32:05 2022] DELETE /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:32:05.771308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-010ed8d7-6228-4420-87aa-6856110e2eb1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:05.775395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2ca6f23b-965b-4fba-ae73-93a6fd1f1cb8 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:05.776145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2ca6f23b-965b-4fba-ae73-93a6fd1f1cb8 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: eec04f70-af6c-4489-b51e-712165cb8893] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:05.776659 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-010ed8d7-6228-4420-87aa-6856110e2eb1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:05.784081 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-010ed8d7-6228-4420-87aa-6856110e2eb1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1814 microversion: 2.25 time: 0.522207 Oct 05 02:32:05.784776 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 618/1249] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:05 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1814 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:32:05.798634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ca6f23b-965b-4fba-ae73-93a6fd1f1cb8 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:05.799142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ca6f23b-965b-4fba-ae73-93a6fd1f1cb8 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:05.803388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ca6f23b-965b-4fba-ae73-93a6fd1f1cb8 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:05.807773 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ca6f23b-965b-4fba-ae73-93a6fd1f1cb8 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:05.809119 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ca6f23b-965b-4fba-ae73-93a6fd1f1cb8 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:05.809777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ca6f23b-965b-4fba-ae73-93a6fd1f1cb8 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:06.176327 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-32142b3c-47cc-48b5-91b9-993857f4e011 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:06.176974 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-32142b3c-47cc-48b5-91b9-993857f4e011 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:06.184940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32142b3c-47cc-48b5-91b9-993857f4e011 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:06.185441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32142b3c-47cc-48b5-91b9-993857f4e011 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:06.185883 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32142b3c-47cc-48b5-91b9-993857f4e011 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:06.187027 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32142b3c-47cc-48b5-91b9-993857f4e011 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:06.187162 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32142b3c-47cc-48b5-91b9-993857f4e011 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:06.187551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32142b3c-47cc-48b5-91b9-993857f4e011 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:06.528664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2ca6f23b-965b-4fba-ae73-93a6fd1f1cb8 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:06.543127 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2ca6f23b-965b-4fba-ae73-93a6fd1f1cb8 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893" status: 200 len: 1647 microversion: 2.1 time: 0.772146 Oct 05 02:32:06.551219 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 632/1250] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:05 2022] GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893 => generated 1647 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:32:06.816024 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7d860752-a220-4119-b185-dca0f002b2ee tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:06.816643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7d860752-a220-4119-b185-dca0f002b2ee tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:06.831186 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d860752-a220-4119-b185-dca0f002b2ee tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:06.831932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d860752-a220-4119-b185-dca0f002b2ee tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:06.833538 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d860752-a220-4119-b185-dca0f002b2ee tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:06.834439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d860752-a220-4119-b185-dca0f002b2ee tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:06.838023 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d860752-a220-4119-b185-dca0f002b2ee tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:06.840719 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d860752-a220-4119-b185-dca0f002b2ee tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:06.853021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-32142b3c-47cc-48b5-91b9-993857f4e011 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:06.864826 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-32142b3c-47cc-48b5-91b9-993857f4e011 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1463 microversion: 2.1 time: 0.693148 Oct 05 02:32:06.880926 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 619/1251] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:06 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1463 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:06.907107 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-459ca0b7-7181-45e4-a55f-e953d4ce7f67 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:32:06.910878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-459ca0b7-7181-45e4-a55f-e953d4ce7f67 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:06.924777 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-459ca0b7-7181-45e4-a55f-e953d4ce7f67 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:06.934614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-459ca0b7-7181-45e4-a55f-e953d4ce7f67 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:06.938360 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-459ca0b7-7181-45e4-a55f-e953d4ce7f67 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:06.939827 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-459ca0b7-7181-45e4-a55f-e953d4ce7f67 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:06.941535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-459ca0b7-7181-45e4-a55f-e953d4ce7f67 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:06.946988 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-459ca0b7-7181-45e4-a55f-e953d4ce7f67 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:07.497717 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-459ca0b7-7181-45e4-a55f-e953d4ce7f67 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3/action" status: 202 len: 0 microversion: 2.1 time: 0.595373 Oct 05 02:32:07.498887 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 620/1252] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:32:06 2022] POST /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3/action => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 02:32:07.510664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7d860752-a220-4119-b185-dca0f002b2ee tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:07.511182 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-caf3bc0e-56ec-4921-8525-79e07b177f0f tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:07.513750 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-caf3bc0e-56ec-4921-8525-79e07b177f0f tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] [instance: aaa20a8a-8a7b-42dd-9b4e-9165fba82942] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:07.520007 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7d860752-a220-4119-b185-dca0f002b2ee tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:07.527309 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7d860752-a220-4119-b185-dca0f002b2ee tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:07.527469 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-caf3bc0e-56ec-4921-8525-79e07b177f0f tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:07.527873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-caf3bc0e-56ec-4921-8525-79e07b177f0f tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:07.528863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-caf3bc0e-56ec-4921-8525-79e07b177f0f tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:07.531345 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-caf3bc0e-56ec-4921-8525-79e07b177f0f tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:07.531515 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7d860752-a220-4119-b185-dca0f002b2ee tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1814 microversion: 2.25 time: 0.718133 Oct 05 02:32:07.532504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-caf3bc0e-56ec-4921-8525-79e07b177f0f tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:07.533018 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 633/1253] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:06 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1814 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:32:07.533385 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-caf3bc0e-56ec-4921-8525-79e07b177f0f tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:07.612002 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-caf3bc0e-56ec-4921-8525-79e07b177f0f tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110928 Oct 05 02:32:07.619010 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 621/1254] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 02:32:07 2022] GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:32:07.629607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9f685804-9627-41bb-bb57-d310855fd3b8 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:07.631945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9f685804-9627-41bb-bb57-d310855fd3b8 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:07.638383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cc6def4a-f962-4437-80c7-c167c6f32974 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-172508608", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "48576e87-e85f-42b2-831e-e803ec37a843"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:32:07.654711 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9f685804-9627-41bb-bb57-d310855fd3b8 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:07.673313 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9f685804-9627-41bb-bb57-d310855fd3b8 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:07.675693 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9f685804-9627-41bb-bb57-d310855fd3b8 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:07.677331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9f685804-9627-41bb-bb57-d310855fd3b8 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:07.679229 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9f685804-9627-41bb-bb57-d310855fd3b8 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:07.679859 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9f685804-9627-41bb-bb57-d310855fd3b8 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:07.766025 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-cc6def4a-f962-4437-80c7-c167c6f32974 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] validate_networks() for [('48576e87-e85f-42b2-831e-e803ec37a843', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:32:07.774438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9f685804-9627-41bb-bb57-d310855fd3b8 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:07.774943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9f685804-9627-41bb-bb57-d310855fd3b8 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:07.775572 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9f685804-9627-41bb-bb57-d310855fd3b8 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:07.776049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-9f685804-9627-41bb-bb57-d310855fd3b8 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lazy-loading 'fault' on Instance uuid 861e3da3-98a1-4728-b218-322c9db128b3 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:32:08.089307 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9f685804-9627-41bb-bb57-d310855fd3b8 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1597 microversion: 2.1 time: 0.468817 Oct 05 02:32:08.104997 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 622/1255] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:07 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1597 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:08.104997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cb32376d-0e0e-48eb-8630-8b22eb100101 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:08.104997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cb32376d-0e0e-48eb-8630-8b22eb100101 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: eec04f70-af6c-4489-b51e-712165cb8893] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:08.117499 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cb32376d-0e0e-48eb-8630-8b22eb100101 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:08.118407 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cb32376d-0e0e-48eb-8630-8b22eb100101 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:08.119088 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cb32376d-0e0e-48eb-8630-8b22eb100101 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:08.120075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cb32376d-0e0e-48eb-8630-8b22eb100101 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:08.120784 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cb32376d-0e0e-48eb-8630-8b22eb100101 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:08.121544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cb32376d-0e0e-48eb-8630-8b22eb100101 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:08.725706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cb32376d-0e0e-48eb-8630-8b22eb100101 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:08.744649 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cb32376d-0e0e-48eb-8630-8b22eb100101 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893" status: 200 len: 1647 microversion: 2.1 time: 0.642151 Oct 05 02:32:08.745540 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 623/1256] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:08 2022] GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893 => generated 1647 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:08.761946 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6cbab31d-94c6-4c3b-957d-e5209de74a63 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:08.762851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6cbab31d-94c6-4c3b-957d-e5209de74a63 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] [instance: aaa20a8a-8a7b-42dd-9b4e-9165fba82942] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:08.769924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6cbab31d-94c6-4c3b-957d-e5209de74a63 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:08.770697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6cbab31d-94c6-4c3b-957d-e5209de74a63 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:08.771315 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6cbab31d-94c6-4c3b-957d-e5209de74a63 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:08.772191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6cbab31d-94c6-4c3b-957d-e5209de74a63 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:08.772956 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6cbab31d-94c6-4c3b-957d-e5209de74a63 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:08.773542 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6cbab31d-94c6-4c3b-957d-e5209de74a63 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:08.832433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-cc6def4a-f962-4437-80c7-c167c6f32974 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:32:08.833765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-cc6def4a-f962-4437-80c7-c167c6f32974 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:32:08.834751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-cc6def4a-f962-4437-80c7-c167c6f32974 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:32:08.836045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-cc6def4a-f962-4437-80c7-c167c6f32974 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:32:08.837098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-cc6def4a-f962-4437-80c7-c167c6f32974 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:32:08.858335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cc6def4a-f962-4437-80c7-c167c6f32974 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:08.859182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cc6def4a-f962-4437-80c7-c167c6f32974 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:08.859840 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cc6def4a-f962-4437-80c7-c167c6f32974 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:08.860850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cc6def4a-f962-4437-80c7-c167c6f32974 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:08.861549 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cc6def4a-f962-4437-80c7-c167c6f32974 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:08.862079 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cc6def4a-f962-4437-80c7-c167c6f32974 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:08.891853 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-cc6def4a-f962-4437-80c7-c167c6f32974 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Getting quotas for project 91e0286f34a549ed90c758652f0d20ae. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:32:08.909058 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-cc6def4a-f962-4437-80c7-c167c6f32974 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Getting quotas for user 9f23399a5f1c4af6855a098198ca4ced and project 91e0286f34a549ed90c758652f0d20ae. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:32:08.939409 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cc6def4a-f962-4437-80c7-c167c6f32974 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:32:08.950179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cc6def4a-f962-4437-80c7-c167c6f32974 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: b6f02d3d-f6df-419f-9962-58c68a597dcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:32:08.979853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-6cbab31d-94c6-4c3b-957d-e5209de74a63 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lazy-loading 'services' on Instance uuid aaa20a8a-8a7b-42dd-9b4e-9165fba82942 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:32:09.092188 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cc6def4a-f962-4437-80c7-c167c6f32974 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.552138 Oct 05 02:32:09.095657 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 634/1257] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:32:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:32:09.106558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c79853d4-e4a4-4000-852d-4cd84ac3d866 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:32:09.112123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c79853d4-e4a4-4000-852d-4cd84ac3d866 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:09.120796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c79853d4-e4a4-4000-852d-4cd84ac3d866 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:09.122947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c79853d4-e4a4-4000-852d-4cd84ac3d866 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:09.123408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c79853d4-e4a4-4000-852d-4cd84ac3d866 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:09.127572 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c79853d4-e4a4-4000-852d-4cd84ac3d866 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:09.128822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c79853d4-e4a4-4000-852d-4cd84ac3d866 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:09.132202 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c79853d4-e4a4-4000-852d-4cd84ac3d866 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:09.242581 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c79853d4-e4a4-4000-852d-4cd84ac3d866 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3/action" status: 202 len: 0 microversion: 2.1 time: 0.145635 Oct 05 02:32:09.244315 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 635/1258] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:32:09 2022] POST /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:32:09.252551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d91d9365-5750-4a20-9977-cb772bad0bee tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:09.253471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d91d9365-5750-4a20-9977-cb772bad0bee tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:09.279466 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6cbab31d-94c6-4c3b-957d-e5209de74a63 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942/os-volume_attachments/d498b999-5afc-4afb-8788-f478e5eec4f2" status: 202 len: 0 microversion: 2.1 time: 0.527283 Oct 05 02:32:09.280322 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 624/1259] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 02:32:08 2022] DELETE /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942/os-volume_attachments/d498b999-5afc-4afb-8788-f478e5eec4f2 => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:32:09.290113 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d91d9365-5750-4a20-9977-cb772bad0bee tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:09.290655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d91d9365-5750-4a20-9977-cb772bad0bee tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:09.291049 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d91d9365-5750-4a20-9977-cb772bad0bee tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:09.291758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d91d9365-5750-4a20-9977-cb772bad0bee tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:09.300142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d91d9365-5750-4a20-9977-cb772bad0bee tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:09.300738 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d91d9365-5750-4a20-9977-cb772bad0bee tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:09.301281 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bba50bcf-e2e4-425d-ab9b-84540a8148af tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:09.307819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bba50bcf-e2e4-425d-ab9b-84540a8148af tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: b6f02d3d-f6df-419f-9962-58c68a597dcd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:09.625311 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bba50bcf-e2e4-425d-ab9b-84540a8148af tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:09.634012 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bba50bcf-e2e4-425d-ab9b-84540a8148af tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/b6f02d3d-f6df-419f-9962-58c68a597dcd" status: 200 len: 1207 microversion: 2.1 time: 0.347428 Oct 05 02:32:09.634909 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 625/1260] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:09 2022] GET /compute/v2.1/servers/b6f02d3d-f6df-419f-9962-58c68a597dcd => generated 1207 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:09.656876 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8347b37a-25ac-4213-ae4b-81f3e6fc56f4 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:09.658013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8347b37a-25ac-4213-ae4b-81f3e6fc56f4 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:09.672381 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8347b37a-25ac-4213-ae4b-81f3e6fc56f4 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:09.673304 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8347b37a-25ac-4213-ae4b-81f3e6fc56f4 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:09.676862 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8347b37a-25ac-4213-ae4b-81f3e6fc56f4 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:09.677818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8347b37a-25ac-4213-ae4b-81f3e6fc56f4 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:09.678354 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8347b37a-25ac-4213-ae4b-81f3e6fc56f4 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:09.678726 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8347b37a-25ac-4213-ae4b-81f3e6fc56f4 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:10.949213 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d91d9365-5750-4a20-9977-cb772bad0bee tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:10.961635 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d91d9365-5750-4a20-9977-cb772bad0bee tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:10.964657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d91d9365-5750-4a20-9977-cb772bad0bee tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:10.966159 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d91d9365-5750-4a20-9977-cb772bad0bee tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1814 microversion: 2.25 time: 1.720493 Oct 05 02:32:10.967145 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 636/1261] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:09 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1814 bytes in 1722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:32:10.975629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bd1ad132-4927-4d0c-9c74-fb4155f00ea3 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:10.976786 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bd1ad132-4927-4d0c-9c74-fb4155f00ea3 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: eec04f70-af6c-4489-b51e-712165cb8893] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:10.988379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd1ad132-4927-4d0c-9c74-fb4155f00ea3 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:10.989066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd1ad132-4927-4d0c-9c74-fb4155f00ea3 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:10.989766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd1ad132-4927-4d0c-9c74-fb4155f00ea3 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:10.991044 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd1ad132-4927-4d0c-9c74-fb4155f00ea3 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:10.991934 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd1ad132-4927-4d0c-9c74-fb4155f00ea3 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:10.992810 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd1ad132-4927-4d0c-9c74-fb4155f00ea3 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:11.291055 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8347b37a-25ac-4213-ae4b-81f3e6fc56f4 tempest-ServersAdminTestJSON-743741218 tempest-ServersAdminTestJSON-743741218-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1614 microversion: 2.1 time: 1.639062 Oct 05 02:32:11.307118 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 626/1262] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:09 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1614 bytes in 1656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:11.312950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c9aa37c7-45a4-4846-a73f-cce6753a1c8c tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:11.320430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c9aa37c7-45a4-4846-a73f-cce6753a1c8c tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 6a205b3a-9fb4-4703-9368-0ab2436d60e5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:11.328700 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c9aa37c7-45a4-4846-a73f-cce6753a1c8c tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:11.329898 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c9aa37c7-45a4-4846-a73f-cce6753a1c8c tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:11.330522 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c9aa37c7-45a4-4846-a73f-cce6753a1c8c tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:11.331634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c9aa37c7-45a4-4846-a73f-cce6753a1c8c tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:11.332257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c9aa37c7-45a4-4846-a73f-cce6753a1c8c tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:11.334325 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c9aa37c7-45a4-4846-a73f-cce6753a1c8c tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:11.386770 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c9aa37c7-45a4-4846-a73f-cce6753a1c8c tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 6a205b3a-9fb4-4703-9368-0ab2436d60e5] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:32:11.556299 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c9aa37c7-45a4-4846-a73f-cce6753a1c8c tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5" status: 204 len: 0 microversion: 2.1 time: 0.247683 Oct 05 02:32:11.557131 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 627/1263] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:32:11 2022] DELETE /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:32:11.565433 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1f1b0e83-f5e2-49ce-9ba1-a03797959301 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:11.567376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1f1b0e83-f5e2-49ce-9ba1-a03797959301 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: b6f02d3d-f6df-419f-9962-58c68a597dcd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:11.583512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1f1b0e83-f5e2-49ce-9ba1-a03797959301 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:11.584022 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1f1b0e83-f5e2-49ce-9ba1-a03797959301 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:11.584465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1f1b0e83-f5e2-49ce-9ba1-a03797959301 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:11.585278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1f1b0e83-f5e2-49ce-9ba1-a03797959301 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:11.585725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1f1b0e83-f5e2-49ce-9ba1-a03797959301 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:11.586148 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1f1b0e83-f5e2-49ce-9ba1-a03797959301 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:11.638169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:11.771874 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1f1b0e83-f5e2-49ce-9ba1-a03797959301 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:11.781528 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1f1b0e83-f5e2-49ce-9ba1-a03797959301 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/b6f02d3d-f6df-419f-9962-58c68a597dcd" status: 200 len: 1277 microversion: 2.1 time: 0.222902 Oct 05 02:32:11.782480 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 628/1264] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:11 2022] GET /compute/v2.1/servers/b6f02d3d-f6df-419f-9962-58c68a597dcd => generated 1277 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:11.787376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-eac2fe88-ad84-46b4-9224-f1954f78db66 req-9eed4e94-8e0a-4694-bfe4-94f4de792fff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d497c63f-2a3d-4dbd-95d5-d2b90e743ac0", "name": "network-vif-unplugged", "status": "completed", "tag": "3a205846-298f-466b-b6e3-8f110f0f22de"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:32:11.813273 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-eac2fe88-ad84-46b4-9224-f1954f78db66 req-9eed4e94-8e0a-4694-bfe4-94f4de792fff service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:11.815224 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-eac2fe88-ad84-46b4-9224-f1954f78db66 req-9eed4e94-8e0a-4694-bfe4-94f4de792fff service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:11.815894 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-eac2fe88-ad84-46b4-9224-f1954f78db66 req-9eed4e94-8e0a-4694-bfe4-94f4de792fff service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:11.833896 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-eac2fe88-ad84-46b4-9224-f1954f78db66 req-9eed4e94-8e0a-4694-bfe4-94f4de792fff service nova] Creating event network-vif-unplugged:3a205846-298f-466b-b6e3-8f110f0f22de for instance d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 on n-h2-858272-3 Oct 05 02:32:11.841860 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-eac2fe88-ad84-46b4-9224-f1954f78db66 req-9eed4e94-8e0a-4694-bfe4-94f4de792fff service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056862 Oct 05 02:32:11.845398 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 629/1265] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:32:11.855917 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c7569dc1-7b70-4e7a-b892-a339d55b2a0f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:11.856952 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c7569dc1-7b70-4e7a-b892-a339d55b2a0f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 75dd5d21-42fd-4501-9b43-1716d9e8a63c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:11.863207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bd1ad132-4927-4d0c-9c74-fb4155f00ea3 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:11.866163 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:11.872281 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7569dc1-7b70-4e7a-b892-a339d55b2a0f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:11.873213 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7569dc1-7b70-4e7a-b892-a339d55b2a0f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:11.876201 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bd1ad132-4927-4d0c-9c74-fb4155f00ea3 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893" status: 200 len: 1647 microversion: 2.1 time: 0.907749 Oct 05 02:32:11.877296 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7569dc1-7b70-4e7a-b892-a339d55b2a0f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:11.879282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7569dc1-7b70-4e7a-b892-a339d55b2a0f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:11.879677 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 637/1266] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:10 2022] GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893 => generated 1647 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:11.880674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7569dc1-7b70-4e7a-b892-a339d55b2a0f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:11.882128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7569dc1-7b70-4e7a-b892-a339d55b2a0f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:11.887271 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6ad3db14-c2f5-4eae-99eb-0a2b7db51850 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:11.897676 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6ad3db14-c2f5-4eae-99eb-0a2b7db51850 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 6a205b3a-9fb4-4703-9368-0ab2436d60e5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:11.913569 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ad3db14-c2f5-4eae-99eb-0a2b7db51850 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:11.914498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ad3db14-c2f5-4eae-99eb-0a2b7db51850 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:11.915036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ad3db14-c2f5-4eae-99eb-0a2b7db51850 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:11.915865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ad3db14-c2f5-4eae-99eb-0a2b7db51850 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:11.916531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ad3db14-c2f5-4eae-99eb-0a2b7db51850 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:11.917244 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ad3db14-c2f5-4eae-99eb-0a2b7db51850 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:11.928317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c7569dc1-7b70-4e7a-b892-a339d55b2a0f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 75dd5d21-42fd-4501-9b43-1716d9e8a63c] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:32:12.119883 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c7569dc1-7b70-4e7a-b892-a339d55b2a0f tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "DELETE /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c" status: 204 len: 0 microversion: 2.1 time: 0.271868 Oct 05 02:32:12.120634 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 630/1267] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:32:11 2022] DELETE /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:32:12.133859 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-634f48f7-2032-4c04-ab18-bd4a4427a877 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:12.134594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-634f48f7-2032-4c04-ab18-bd4a4427a877 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:12.161551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-634f48f7-2032-4c04-ab18-bd4a4427a877 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:12.162060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-634f48f7-2032-4c04-ab18-bd4a4427a877 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:12.162502 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-634f48f7-2032-4c04-ab18-bd4a4427a877 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:12.163234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-634f48f7-2032-4c04-ab18-bd4a4427a877 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:12.163684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-634f48f7-2032-4c04-ab18-bd4a4427a877 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:12.164115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-634f48f7-2032-4c04-ab18-bd4a4427a877 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:12.724712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6ad3db14-c2f5-4eae-99eb-0a2b7db51850 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368f6c3db9f24561a13f48ce02e7655e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecbac50c16847799a85c148c6c143de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:12.763340 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6ad3db14-c2f5-4eae-99eb-0a2b7db51850 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5" status: 200 len: 1712 microversion: 2.1 time: 0.877885 Oct 05 02:32:12.764635 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 638/1268] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:11 2022] GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5 => generated 1712 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:12.786680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b4fe014c-c6f2-4de3-88ce-7733c3307c52 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:12.799565 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b4fe014c-c6f2-4de3-88ce-7733c3307c52 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 75dd5d21-42fd-4501-9b43-1716d9e8a63c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:12.809311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4fe014c-c6f2-4de3-88ce-7733c3307c52 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:12.822979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4fe014c-c6f2-4de3-88ce-7733c3307c52 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:12.823718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4fe014c-c6f2-4de3-88ce-7733c3307c52 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:12.824698 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4fe014c-c6f2-4de3-88ce-7733c3307c52 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:12.825411 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4fe014c-c6f2-4de3-88ce-7733c3307c52 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:12.827295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4fe014c-c6f2-4de3-88ce-7733c3307c52 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:13.087464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-634f48f7-2032-4c04-ab18-bd4a4427a877 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:13.107679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-634f48f7-2032-4c04-ab18-bd4a4427a877 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:13.114529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-634f48f7-2032-4c04-ab18-bd4a4427a877 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:13.118768 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-634f48f7-2032-4c04-ab18-bd4a4427a877 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1814 microversion: 2.25 time: 0.994381 Oct 05 02:32:13.121578 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 631/1269] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:12 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1814 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:32:13.137118 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a60865ed-d2fd-4ae4-a274-f38674f01a77 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:13.139064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a60865ed-d2fd-4ae4-a274-f38674f01a77 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: b6f02d3d-f6df-419f-9962-58c68a597dcd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:13.149575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a60865ed-d2fd-4ae4-a274-f38674f01a77 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:13.150822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a60865ed-d2fd-4ae4-a274-f38674f01a77 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:13.151493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a60865ed-d2fd-4ae4-a274-f38674f01a77 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:13.152540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a60865ed-d2fd-4ae4-a274-f38674f01a77 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:13.153231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a60865ed-d2fd-4ae4-a274-f38674f01a77 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:13.153843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a60865ed-d2fd-4ae4-a274-f38674f01a77 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:13.611750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b4fe014c-c6f2-4de3-88ce-7733c3307c52 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:13.625041 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b4fe014c-c6f2-4de3-88ce-7733c3307c52 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c" status: 200 len: 1469 microversion: 2.1 time: 0.853537 Oct 05 02:32:13.625677 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 639/1270] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:12 2022] GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c => generated 1469 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:13.641568 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c1568d0f-4cd9-4215-9041-c14dcd8d1419 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:13.642474 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c1568d0f-4cd9-4215-9041-c14dcd8d1419 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: eec04f70-af6c-4489-b51e-712165cb8893] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:13.655253 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1568d0f-4cd9-4215-9041-c14dcd8d1419 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:13.656307 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1568d0f-4cd9-4215-9041-c14dcd8d1419 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:13.656969 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1568d0f-4cd9-4215-9041-c14dcd8d1419 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:13.657896 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1568d0f-4cd9-4215-9041-c14dcd8d1419 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:13.665278 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1568d0f-4cd9-4215-9041-c14dcd8d1419 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:13.666569 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1568d0f-4cd9-4215-9041-c14dcd8d1419 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:13.695254 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-c1568d0f-4cd9-4215-9041-c14dcd8d1419 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] HTTP exception thrown: Instance eec04f70-af6c-4489-b51e-712165cb8893 could not be found. Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c1568d0f-4cd9-4215-9041-c14dcd8d1419 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Request method failure captured: Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893 HTTP/1.1 Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOxsHfqJu7XBSEzDOBBt7syFIrL9J3OT791dcmShV5lM5pjmkDuONYQmP8-v9KquUBaUHsqFGt8nuaScu9b1kWZKpy9EaLULGZXiZUnDwZJ186OmmTbSMTU6SH3NtgLtLUXyXXhUjMZrhdeVS_vfD8uyVuQTvFy3dykhyOfc3uq0Kds Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: c96108fae56640b6aa0cb68523504c43 Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c96108fae56640b6aa0cb68523504c43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: c96108fae56640b6aa0cb68523504c43 Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-SecurityGroupsTestJSON-1913947248-project Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 9925b3a9a63c4b1cb98a8adcc28f916d Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-SecurityGroupsTestJSON-1913947248-project Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance eec04f70-af6c-4489-b51e-712165cb8893 could not be found. Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'eec04f70-af6c-4489-b51e-712165cb8893'} Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eec04f70-af6c-4489-b51e-712165cb8893 could not be found. Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eec04f70-af6c-4489-b51e-712165cb8893 could not be found. Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:13.697271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:13.702432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:13.702432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:13.702432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:13.702432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:32:13.702432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:32:13.702432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eec04f70-af6c-4489-b51e-712165cb8893 could not be found. Oct 05 02:32:13.702432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:13.704060 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c1568d0f-4cd9-4215-9041-c14dcd8d1419 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Returning 404 to user: Instance eec04f70-af6c-4489-b51e-712165cb8893 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:32:13.707657 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c1568d0f-4cd9-4215-9041-c14dcd8d1419 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893" status: 404 len: 111 microversion: 2.1 time: 0.070658 Oct 05 02:32:13.708489 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 640/1271] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:13 2022] GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:32:13.724406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f1c119a4-74e8-4a2a-ae2d-61d902b051d2 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '.version_select at 0x7fccdfc1c790>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:13.845884 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a60865ed-d2fd-4ae4-a274-f38674f01a77 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:13.860065 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a60865ed-d2fd-4ae4-a274-f38674f01a77 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/b6f02d3d-f6df-419f-9962-58c68a597dcd" status: 200 len: 1307 microversion: 2.1 time: 0.733549 Oct 05 02:32:13.861010 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 632/1272] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:13 2022] GET /compute/v2.1/servers/b6f02d3d-f6df-419f-9962-58c68a597dcd => generated 1307 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:13.865841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-476009fc-46d9-4a52-a43f-f9a40365e285 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:13.868053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-476009fc-46d9-4a52-a43f-f9a40365e285 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 6a205b3a-9fb4-4703-9368-0ab2436d60e5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:13.880173 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-476009fc-46d9-4a52-a43f-f9a40365e285 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:13.881153 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-476009fc-46d9-4a52-a43f-f9a40365e285 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:13.884094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-476009fc-46d9-4a52-a43f-f9a40365e285 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:13.887637 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-476009fc-46d9-4a52-a43f-f9a40365e285 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:13.888740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-476009fc-46d9-4a52-a43f-f9a40365e285 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:13.891084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-476009fc-46d9-4a52-a43f-f9a40365e285 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:14.385307 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f1c119a4-74e8-4a2a-ae2d-61d902b051d2 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/39028f60-e6c9-497a-9ed5-786de1288335" status: 202 len: 0 microversion: 2.1 time: 0.664784 Oct 05 02:32:14.385891 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 641/1273] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:32:13 2022] DELETE /compute/v2.1/os-security-groups/39028f60-e6c9-497a-9ed5-786de1288335 => generated 0 bytes in 666 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:32:14.397162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-6fb31a8c-cd77-48fb-baba-d2a0fc52cf4f req-8f458816-7db3-48ef-83f9-17b0d1999d47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eec04f70-af6c-4489-b51e-712165cb8893", "name": "network-vif-deleted", "tag": "1b500420-b259-4125-8c4d-26eee2187a24"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:32:14.410256 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:14.428026 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6fb31a8c-cd77-48fb-baba-d2a0fc52cf4f req-8f458816-7db3-48ef-83f9-17b0d1999d47 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:14.429487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6fb31a8c-cd77-48fb-baba-d2a0fc52cf4f req-8f458816-7db3-48ef-83f9-17b0d1999d47 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:14.430552 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6fb31a8c-cd77-48fb-baba-d2a0fc52cf4f req-8f458816-7db3-48ef-83f9-17b0d1999d47 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:14.467119 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-6fb31a8c-cd77-48fb-baba-d2a0fc52cf4f req-8f458816-7db3-48ef-83f9-17b0d1999d47 service nova] Creating event network-vif-deleted:1b500420-b259-4125-8c4d-26eee2187a24 for instance eec04f70-af6c-4489-b51e-712165cb8893 on n-h1-858272-3 Oct 05 02:32:14.476669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-476009fc-46d9-4a52-a43f-f9a40365e285 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368f6c3db9f24561a13f48ce02e7655e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecbac50c16847799a85c148c6c143de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:14.478660 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-6fb31a8c-cd77-48fb-baba-d2a0fc52cf4f req-8f458816-7db3-48ef-83f9-17b0d1999d47 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087430 Oct 05 02:32:14.479898 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 642/1274] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:32:14.487734 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-476009fc-46d9-4a52-a43f-f9a40365e285 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5" status: 200 len: 1712 microversion: 2.1 time: 0.625395 Oct 05 02:32:14.488375 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 633/1275] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:13 2022] GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5 => generated 1712 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:14.627991 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8c870044-c2ca-494a-b9a6-d567fa1defa7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Action: 'create', calling method: .version_select at 0x7fccdfc1cca0>, body: {"keypair": {"name": "tempest-keypair-1444920499", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEzKrH4L6Shb+8LJbetQWa2MHO+cuj1grvVHDIdUkRESZCFfGMpARwihkYgTLJFjrMZbpNXMnA21SFCGllW5mtacXG/N+Lh2tWeAPwvkXKzc2V5FweNmelOZi4UFgIpEw=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:32:14.636514 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-0e3db526-4187-414b-b480-e369de124053 req-07c0bed4-62a5-41ef-88cb-f9f0bf9ce8af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6f02d3d-f6df-419f-9962-58c68a597dcd", "tag": "6923daf2-fc58-4cce-8a01-90bf9aab4f50"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:32:14.662978 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-0e3db526-4187-414b-b480-e369de124053 req-07c0bed4-62a5-41ef-88cb-f9f0bf9ce8af service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:14.675890 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-0e3db526-4187-414b-b480-e369de124053 req-07c0bed4-62a5-41ef-88cb-f9f0bf9ce8af service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:14.676981 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-0e3db526-4187-414b-b480-e369de124053 req-07c0bed4-62a5-41ef-88cb-f9f0bf9ce8af service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:14.679350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-8c870044-c2ca-494a-b9a6-d567fa1defa7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Getting quotas for project 3b649132448b44278c6dd55cdb6ff3de. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:32:14.693929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-8c870044-c2ca-494a-b9a6-d567fa1defa7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Getting quotas for user e4b5243d9ffe46c4b32033da558d1e2c and project 3b649132448b44278c6dd55cdb6ff3de. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:32:14.709892 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-0e3db526-4187-414b-b480-e369de124053 req-07c0bed4-62a5-41ef-88cb-f9f0bf9ce8af service nova] Creating event network-changed:6923daf2-fc58-4cce-8a01-90bf9aab4f50 for instance b6f02d3d-f6df-419f-9962-58c68a597dcd on n-h1-858272-3 Oct 05 02:32:14.721870 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-0e3db526-4187-414b-b480-e369de124053 req-07c0bed4-62a5-41ef-88cb-f9f0bf9ce8af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.229822 Oct 05 02:32:14.724890 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 634/1276] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:32:14.738322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2859a529-dd90-4243-8842-8a5d36edb00d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:14.740895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2859a529-dd90-4243-8842-8a5d36edb00d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:14.750378 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8c870044-c2ca-494a-b9a6-d567fa1defa7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.268689 Oct 05 02:32:14.751014 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 643/1277] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Oct 5 02:32:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 270 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 05 02:32:14.756060 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-be180078-cf12-49db-b4a3-5a48d7650d24 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '.version_select at 0x7fccdfc73040>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:14.756813 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2859a529-dd90-4243-8842-8a5d36edb00d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:14.758750 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2859a529-dd90-4243-8842-8a5d36edb00d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:14.761174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2859a529-dd90-4243-8842-8a5d36edb00d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:14.762186 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2859a529-dd90-4243-8842-8a5d36edb00d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:14.764491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2859a529-dd90-4243-8842-8a5d36edb00d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:14.765238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2859a529-dd90-4243-8842-8a5d36edb00d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:16.022598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2859a529-dd90-4243-8842-8a5d36edb00d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:16.052174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2859a529-dd90-4243-8842-8a5d36edb00d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:16.054655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2859a529-dd90-4243-8842-8a5d36edb00d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:16.056069 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2859a529-dd90-4243-8842-8a5d36edb00d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1814 microversion: 2.25 time: 1.327977 Oct 05 02:32:16.087741 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 635/1278] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:14 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1814 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:32:16.109107 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-aa6ef77f-b783-4e3d-b3ce-ebb43b3b78aa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:16.112891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-aa6ef77f-b783-4e3d-b3ce-ebb43b3b78aa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 75dd5d21-42fd-4501-9b43-1716d9e8a63c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:16.134705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa6ef77f-b783-4e3d-b3ce-ebb43b3b78aa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:16.135223 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa6ef77f-b783-4e3d-b3ce-ebb43b3b78aa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:16.150197 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa6ef77f-b783-4e3d-b3ce-ebb43b3b78aa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:16.153720 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa6ef77f-b783-4e3d-b3ce-ebb43b3b78aa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:16.154217 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa6ef77f-b783-4e3d-b3ce-ebb43b3b78aa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:16.156343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa6ef77f-b783-4e3d-b3ce-ebb43b3b78aa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:16.769008 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-be180078-cf12-49db-b4a3-5a48d7650d24 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/df17ff5e-63f2-456e-a3c1-bd6f1125bd0a" status: 202 len: 0 microversion: 2.1 time: 2.016855 Oct 05 02:32:16.770393 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 644/1279] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:32:14 2022] DELETE /compute/v2.1/os-security-groups/df17ff5e-63f2-456e-a3c1-bd6f1125bd0a => generated 0 bytes in 2019 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:32:16.787294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3f116419-2943-4af5-adf8-0a0fa1429e7a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:16.788958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3f116419-2943-4af5-adf8-0a0fa1429e7a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: b6f02d3d-f6df-419f-9962-58c68a597dcd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:16.797987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f116419-2943-4af5-adf8-0a0fa1429e7a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:16.798799 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f116419-2943-4af5-adf8-0a0fa1429e7a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:16.799404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f116419-2943-4af5-adf8-0a0fa1429e7a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:16.800291 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f116419-2943-4af5-adf8-0a0fa1429e7a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:16.800935 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f116419-2943-4af5-adf8-0a0fa1429e7a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:16.801519 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f116419-2943-4af5-adf8-0a0fa1429e7a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:17.114177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-aa6ef77f-b783-4e3d-b3ce-ebb43b3b78aa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:17.128501 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-aa6ef77f-b783-4e3d-b3ce-ebb43b3b78aa tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c" status: 200 len: 1469 microversion: 2.1 time: 1.037062 Oct 05 02:32:17.129523 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 636/1280] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:16 2022] GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c => generated 1469 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:17.137928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9ae32d88-d277-464a-9d27-675ecd8ddd7b tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:17.140881 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9ae32d88-d277-464a-9d27-675ecd8ddd7b tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 6a205b3a-9fb4-4703-9368-0ab2436d60e5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:17.148229 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ae32d88-d277-464a-9d27-675ecd8ddd7b tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:17.150024 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ae32d88-d277-464a-9d27-675ecd8ddd7b tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:17.150714 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ae32d88-d277-464a-9d27-675ecd8ddd7b tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:17.151675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ae32d88-d277-464a-9d27-675ecd8ddd7b tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:17.152360 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ae32d88-d277-464a-9d27-675ecd8ddd7b tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:17.153130 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ae32d88-d277-464a-9d27-675ecd8ddd7b tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:17.598576 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3f116419-2943-4af5-adf8-0a0fa1429e7a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:17.605948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9ae32d88-d277-464a-9d27-675ecd8ddd7b tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368f6c3db9f24561a13f48ce02e7655e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecbac50c16847799a85c148c6c143de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:17.613680 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3f116419-2943-4af5-adf8-0a0fa1429e7a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/b6f02d3d-f6df-419f-9962-58c68a597dcd" status: 200 len: 1307 microversion: 2.1 time: 0.841952 Oct 05 02:32:17.614574 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 645/1281] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:16 2022] GET /compute/v2.1/servers/b6f02d3d-f6df-419f-9962-58c68a597dcd => generated 1307 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:17.619571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-4a5be19b-2f96-49b1-9db1-87dec8b87ce1 req-58c8c0f5-ac3a-4a18-bd97-9e3ea8980bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d497c63f-2a3d-4dbd-95d5-d2b90e743ac0", "tag": "3a205846-298f-466b-b6e3-8f110f0f22de"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:32:17.622921 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9ae32d88-d277-464a-9d27-675ecd8ddd7b tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5" status: 200 len: 1712 microversion: 2.1 time: 0.491505 Oct 05 02:32:17.631799 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4a5be19b-2f96-49b1-9db1-87dec8b87ce1 req-58c8c0f5-ac3a-4a18-bd97-9e3ea8980bf6 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:17.632287 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4a5be19b-2f96-49b1-9db1-87dec8b87ce1 req-58c8c0f5-ac3a-4a18-bd97-9e3ea8980bf6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:17.632973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4a5be19b-2f96-49b1-9db1-87dec8b87ce1 req-58c8c0f5-ac3a-4a18-bd97-9e3ea8980bf6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:17.636861 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 637/1282] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:17 2022] GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5 => generated 1712 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:17.647936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4fa35803-0e28-4d03-86ae-6d7b5824cf0c tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Action: 'create', calling method: .version_select at 0x7fcce444d160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1122343387", "description": "tempest-description-410913133"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:32:17.664119 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-4a5be19b-2f96-49b1-9db1-87dec8b87ce1 req-58c8c0f5-ac3a-4a18-bd97-9e3ea8980bf6 service nova] Creating event network-changed:3a205846-298f-466b-b6e3-8f110f0f22de for instance d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 on n-h2-858272-3 Oct 05 02:32:17.673019 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-4a5be19b-2f96-49b1-9db1-87dec8b87ce1 req-58c8c0f5-ac3a-4a18-bd97-9e3ea8980bf6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056669 Oct 05 02:32:17.673882 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 646/1283] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:32:17.681444 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-35dae4bc-9785-4684-9f2f-e3b34b6513d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:17.682925 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-35dae4bc-9785-4684-9f2f-e3b34b6513d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:17.694249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35dae4bc-9785-4684-9f2f-e3b34b6513d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:17.696136 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35dae4bc-9785-4684-9f2f-e3b34b6513d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:17.698672 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35dae4bc-9785-4684-9f2f-e3b34b6513d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:17.705083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35dae4bc-9785-4684-9f2f-e3b34b6513d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:17.706727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35dae4bc-9785-4684-9f2f-e3b34b6513d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:17.708415 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35dae4bc-9785-4684-9f2f-e3b34b6513d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:18.380523 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-35dae4bc-9785-4684-9f2f-e3b34b6513d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:18.399126 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-35dae4bc-9785-4684-9f2f-e3b34b6513d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:18.401681 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-35dae4bc-9785-4684-9f2f-e3b34b6513d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:18.403804 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-35dae4bc-9785-4684-9f2f-e3b34b6513d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1814 microversion: 2.25 time: 0.728607 Oct 05 02:32:18.407091 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 647/1284] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:17 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1814 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:32:18.413951 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-58f146a0-ed01-478d-962b-3700a3f77d37 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:18.416871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-58f146a0-ed01-478d-962b-3700a3f77d37 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] [instance: aaa20a8a-8a7b-42dd-9b4e-9165fba82942] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:18.428082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58f146a0-ed01-478d-962b-3700a3f77d37 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:18.429901 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58f146a0-ed01-478d-962b-3700a3f77d37 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:18.431637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58f146a0-ed01-478d-962b-3700a3f77d37 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:18.432630 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58f146a0-ed01-478d-962b-3700a3f77d37 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:18.433461 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58f146a0-ed01-478d-962b-3700a3f77d37 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:18.434583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58f146a0-ed01-478d-962b-3700a3f77d37 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:18.460861 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4fa35803-0e28-4d03-86ae-6d7b5824cf0c tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.820796 Oct 05 02:32:18.462077 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 638/1285] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 5 02:32:17 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:32:18.476087 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1d8ace8f-f8fa-45f0-a464-a0a9ccf16902 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1766280561", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c28fde34-e3c2-4465-9f10-5751dc7947b2"}], "security_groups": [{"name": "tempest-securitygroup--744901244"}], "key_name": "tempest-keypair-1444920499", "user_data": "}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:32:18.494548 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-58f146a0-ed01-478d-962b-3700a3f77d37 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079926 Oct 05 02:32:18.497718 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 648/1286] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 02:32:18 2022] GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:32:18.525825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7d92fe4e-e703-4c76-b822-c46a0c9d1a41 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:18.526807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7d92fe4e-e703-4c76-b822-c46a0c9d1a41 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 75dd5d21-42fd-4501-9b43-1716d9e8a63c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:18.535143 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d92fe4e-e703-4c76-b822-c46a0c9d1a41 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:18.535884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d92fe4e-e703-4c76-b822-c46a0c9d1a41 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:18.536518 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d92fe4e-e703-4c76-b822-c46a0c9d1a41 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:18.537427 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d92fe4e-e703-4c76-b822-c46a0c9d1a41 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:18.538044 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d92fe4e-e703-4c76-b822-c46a0c9d1a41 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:18.538632 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d92fe4e-e703-4c76-b822-c46a0c9d1a41 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:18.592818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d92fe4e-e703-4c76-b822-c46a0c9d1a41 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:18.593556 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d92fe4e-e703-4c76-b822-c46a0c9d1a41 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:18.594162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d92fe4e-e703-4c76-b822-c46a0c9d1a41 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:18.594779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-7d92fe4e-e703-4c76-b822-c46a0c9d1a41 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lazy-loading 'fault' on Instance uuid 75dd5d21-42fd-4501-9b43-1716d9e8a63c {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:32:18.757045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7d92fe4e-e703-4c76-b822-c46a0c9d1a41 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:18.767521 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7d92fe4e-e703-4c76-b822-c46a0c9d1a41 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c" status: 200 len: 1304 microversion: 2.1 time: 0.268548 Oct 05 02:32:18.768298 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 649/1287] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:18 2022] GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c => generated 1304 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:18.773171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-560f2e43-3327-4b7d-80e9-27b789fceddd tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Action: 'update', calling method: .version_select at 0x7fccdfc1c790>, body: {"security_group": {"name": "tempest-sg-hth-651558745", "description": "tempest-description-hth-1613687125"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:32:18.872088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:18.924835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-1d8ace8f-f8fa-45f0-a464-a0a9ccf16902 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] validate_networks() for [('c28fde34-e3c2-4465-9f10-5751dc7947b2', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:32:19.304704 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-560f2e43-3327-4b7d-80e9-27b789fceddd tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "PUT /compute/v2.1/os-security-groups/edf0839e-6960-47a2-9d65-16ce6711f567" status: 200 len: 217 microversion: 2.1 time: 0.534792 Oct 05 02:32:19.306515 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 650/1288] 10.222.0.16 () {60 vars in 1290 bytes} [Wed Oct 5 02:32:18 2022] PUT /compute/v2.1/os-security-groups/edf0839e-6960-47a2-9d65-16ce6711f567 => generated 217 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:32:19.312807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fa616c28-ddd8-45c8-8a60-b794c236815b tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:19.317058 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fa616c28-ddd8-45c8-8a60-b794c236815b tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] [instance: aaa20a8a-8a7b-42dd-9b4e-9165fba82942] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:19.326124 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa616c28-ddd8-45c8-8a60-b794c236815b tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:19.326833 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa616c28-ddd8-45c8-8a60-b794c236815b tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:19.327799 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa616c28-ddd8-45c8-8a60-b794c236815b tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:19.328770 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa616c28-ddd8-45c8-8a60-b794c236815b tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:19.329547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa616c28-ddd8-45c8-8a60-b794c236815b tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:19.330040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa616c28-ddd8-45c8-8a60-b794c236815b tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:19.368514 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fa616c28-ddd8-45c8-8a60-b794c236815b tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060042 Oct 05 02:32:19.369736 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 651/1289] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 02:32:19 2022] GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:32:19.377009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-be23ce7c-abfa-4594-b236-6c08d090ce41 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:19.377724 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-be23ce7c-abfa-4594-b236-6c08d090ce41 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: b6f02d3d-f6df-419f-9962-58c68a597dcd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:19.394884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be23ce7c-abfa-4594-b236-6c08d090ce41 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:19.395531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be23ce7c-abfa-4594-b236-6c08d090ce41 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:19.395929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be23ce7c-abfa-4594-b236-6c08d090ce41 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:19.396700 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be23ce7c-abfa-4594-b236-6c08d090ce41 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:19.397282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be23ce7c-abfa-4594-b236-6c08d090ce41 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:19.397761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be23ce7c-abfa-4594-b236-6c08d090ce41 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:19.634197 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:19.725044 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-be23ce7c-abfa-4594-b236-6c08d090ce41 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:19.734606 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-be23ce7c-abfa-4594-b236-6c08d090ce41 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/b6f02d3d-f6df-419f-9962-58c68a597dcd" status: 200 len: 1307 microversion: 2.1 time: 0.363787 Oct 05 02:32:19.749573 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 652/1290] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:19 2022] GET /compute/v2.1/servers/b6f02d3d-f6df-419f-9962-58c68a597dcd => generated 1307 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:19.754697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c1f03c65-080f-48f6-8a5c-399066c5130a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:19.755464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c1f03c65-080f-48f6-8a5c-399066c5130a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 6a205b3a-9fb4-4703-9368-0ab2436d60e5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:19.765098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1f03c65-080f-48f6-8a5c-399066c5130a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:19.765700 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1f03c65-080f-48f6-8a5c-399066c5130a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:19.766191 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1f03c65-080f-48f6-8a5c-399066c5130a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:19.767121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1f03c65-080f-48f6-8a5c-399066c5130a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:19.767773 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1f03c65-080f-48f6-8a5c-399066c5130a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:19.768577 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1f03c65-080f-48f6-8a5c-399066c5130a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:19.776841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-1d8ace8f-f8fa-45f0-a464-a0a9ccf16902 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:32:19.777402 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-1d8ace8f-f8fa-45f0-a464-a0a9ccf16902 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:32:19.777878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-1d8ace8f-f8fa-45f0-a464-a0a9ccf16902 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:32:19.778290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-1d8ace8f-f8fa-45f0-a464-a0a9ccf16902 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:32:19.778693 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-1d8ace8f-f8fa-45f0-a464-a0a9ccf16902 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:32:19.789317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d8ace8f-f8fa-45f0-a464-a0a9ccf16902 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:19.789807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d8ace8f-f8fa-45f0-a464-a0a9ccf16902 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:19.790239 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d8ace8f-f8fa-45f0-a464-a0a9ccf16902 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:19.790962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d8ace8f-f8fa-45f0-a464-a0a9ccf16902 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:19.791420 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d8ace8f-f8fa-45f0-a464-a0a9ccf16902 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:19.791841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d8ace8f-f8fa-45f0-a464-a0a9ccf16902 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:19.806426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1f03c65-080f-48f6-8a5c-399066c5130a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:19.806936 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1f03c65-080f-48f6-8a5c-399066c5130a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:19.807378 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1f03c65-080f-48f6-8a5c-399066c5130a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:19.807813 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-c1f03c65-080f-48f6-8a5c-399066c5130a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lazy-loading 'fault' on Instance uuid 6a205b3a-9fb4-4703-9368-0ab2436d60e5 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:32:19.809324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-1d8ace8f-f8fa-45f0-a464-a0a9ccf16902 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Getting quotas for project 3b649132448b44278c6dd55cdb6ff3de. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:32:19.815571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-1d8ace8f-f8fa-45f0-a464-a0a9ccf16902 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Getting quotas for user e4b5243d9ffe46c4b32033da558d1e2c and project 3b649132448b44278c6dd55cdb6ff3de. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:32:19.829282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1d8ace8f-f8fa-45f0-a464-a0a9ccf16902 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:32:19.831780 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1d8ace8f-f8fa-45f0-a464-a0a9ccf16902 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:32:19.855077 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c1f03c65-080f-48f6-8a5c-399066c5130a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368f6c3db9f24561a13f48ce02e7655e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecbac50c16847799a85c148c6c143de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:19.867762 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c1f03c65-080f-48f6-8a5c-399066c5130a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5" status: 200 len: 1353 microversion: 2.1 time: 0.116888 Oct 05 02:32:19.868960 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 653/1291] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:19 2022] GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5 => generated 1353 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:19.873877 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0287d348-77c0-49c9-8ee8-efa08bf6e0f4 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '.version_select at 0x7fccdfc733a0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:19.890801 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1d8ace8f-f8fa-45f0-a464-a0a9ccf16902 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.418862 Oct 05 02:32:19.891665 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 639/1292] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 5 02:32:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 1420 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 05 02:32:19.896063 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d39756d5-dbae-4445-a985-ccab62ec19ff tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:19.896669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d39756d5-dbae-4445-a985-ccab62ec19ff tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:19.903057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d39756d5-dbae-4445-a985-ccab62ec19ff tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:19.903762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d39756d5-dbae-4445-a985-ccab62ec19ff tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:19.904371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d39756d5-dbae-4445-a985-ccab62ec19ff tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:19.905266 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d39756d5-dbae-4445-a985-ccab62ec19ff tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:19.905805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d39756d5-dbae-4445-a985-ccab62ec19ff tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:19.906396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d39756d5-dbae-4445-a985-ccab62ec19ff tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:19.946520 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0287d348-77c0-49c9-8ee8-efa08bf6e0f4 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/edf0839e-6960-47a2-9d65-16ce6711f567" status: 200 len: 217 microversion: 2.1 time: 0.076342 Oct 05 02:32:19.947103 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 654/1293] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 5 02:32:19 2022] GET /compute/v2.1/os-security-groups/edf0839e-6960-47a2-9d65-16ce6711f567 => generated 217 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:32:19.952411 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-654715a2-47f1-44ad-b2ac-845a98c7cdb1 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:19.953112 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-654715a2-47f1-44ad-b2ac-845a98c7cdb1 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] [instance: aaa20a8a-8a7b-42dd-9b4e-9165fba82942] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:19.972093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-654715a2-47f1-44ad-b2ac-845a98c7cdb1 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:19.972825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-654715a2-47f1-44ad-b2ac-845a98c7cdb1 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:19.973289 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-654715a2-47f1-44ad-b2ac-845a98c7cdb1 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:19.974017 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-654715a2-47f1-44ad-b2ac-845a98c7cdb1 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:19.974473 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-654715a2-47f1-44ad-b2ac-845a98c7cdb1 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:19.974892 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-654715a2-47f1-44ad-b2ac-845a98c7cdb1 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:20.008852 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-654715a2-47f1-44ad-b2ac-845a98c7cdb1 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] [instance: aaa20a8a-8a7b-42dd-9b4e-9165fba82942] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:32:20.091779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d39756d5-dbae-4445-a985-ccab62ec19ff tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:20.111199 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d39756d5-dbae-4445-a985-ccab62ec19ff tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:20.113913 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d39756d5-dbae-4445-a985-ccab62ec19ff tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:20.116354 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d39756d5-dbae-4445-a985-ccab62ec19ff tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1814 microversion: 2.25 time: 0.222725 Oct 05 02:32:20.140160 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 640/1294] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:19 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1814 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:32:20.149499 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-4aa49799-2de1-4492-aff6-47977b9d1cc0 req-7fd015aa-61b9-45b3-bb2f-c9c0f1d85abc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75dd5d21-42fd-4501-9b43-1716d9e8a63c", "name": "network-vif-deleted", "tag": "a93afda1-f2bc-4e2d-b873-c7ed67a96cba"}, {"server_uuid": "6a205b3a-9fb4-4703-9368-0ab2436d60e5", "name": "network-vif-deleted", "tag": "15b4abdf-070c-4e34-93c5-64406f010c79"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:32:20.176185 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4aa49799-2de1-4492-aff6-47977b9d1cc0 req-7fd015aa-61b9-45b3-bb2f-c9c0f1d85abc service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:20.177147 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4aa49799-2de1-4492-aff6-47977b9d1cc0 req-7fd015aa-61b9-45b3-bb2f-c9c0f1d85abc service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:20.177421 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-654715a2-47f1-44ad-b2ac-845a98c7cdb1 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942" status: 204 len: 0 microversion: 2.1 time: 0.228789 Oct 05 02:32:20.177882 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4aa49799-2de1-4492-aff6-47977b9d1cc0 req-7fd015aa-61b9-45b3-bb2f-c9c0f1d85abc service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:20.179148 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 655/1295] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:32:19 2022] DELETE /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:32:20.190708 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-20a5c263-7bd4-40b1-87d7-d857f3bf626b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:20.191427 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-20a5c263-7bd4-40b1-87d7-d857f3bf626b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 75dd5d21-42fd-4501-9b43-1716d9e8a63c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:20.206552 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-4aa49799-2de1-4492-aff6-47977b9d1cc0 req-7fd015aa-61b9-45b3-bb2f-c9c0f1d85abc service nova] Creating event network-vif-deleted:a93afda1-f2bc-4e2d-b873-c7ed67a96cba for instance 75dd5d21-42fd-4501-9b43-1716d9e8a63c on n-h2-858272-3 Oct 05 02:32:20.206864 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20a5c263-7bd4-40b1-87d7-d857f3bf626b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:20.207594 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20a5c263-7bd4-40b1-87d7-d857f3bf626b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:20.208127 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-4aa49799-2de1-4492-aff6-47977b9d1cc0 req-7fd015aa-61b9-45b3-bb2f-c9c0f1d85abc service nova] Creating event network-vif-deleted:15b4abdf-070c-4e34-93c5-64406f010c79 for instance 6a205b3a-9fb4-4703-9368-0ab2436d60e5 on n-h2-858272-3 Oct 05 02:32:20.209435 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20a5c263-7bd4-40b1-87d7-d857f3bf626b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:20.210161 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20a5c263-7bd4-40b1-87d7-d857f3bf626b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:20.214875 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20a5c263-7bd4-40b1-87d7-d857f3bf626b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:20.215326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20a5c263-7bd4-40b1-87d7-d857f3bf626b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:20.219038 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-4aa49799-2de1-4492-aff6-47977b9d1cc0 req-7fd015aa-61b9-45b3-bb2f-c9c0f1d85abc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.076349 Oct 05 02:32:20.227855 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 641/1296] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:32:20.236823 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b71daddd-60d8-4212-a289-bd476f0e2da1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:20.238295 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b71daddd-60d8-4212-a289-bd476f0e2da1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:20.238461 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-20a5c263-7bd4-40b1-87d7-d857f3bf626b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] HTTP exception thrown: Instance 75dd5d21-42fd-4501-9b43-1716d9e8a63c could not be found. Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-20a5c263-7bd4-40b1-87d7-d857f3bf626b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Request method failure captured: Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c HTTP/1.1 Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOwfduJV9tCP52TzWOgOCVFWO3Jj6aty29-CPOgH5G0_Bnucj7xWks_4AKLcWyxnTAFBGDhqPWXPDzPrNGllL9XXqFNhGlbELfZRXdf0_3EI-4W3n4H6Mlwsa8W9-IDF08P19v24Z7VTSsSr7RZy9WGfeIBEqo2tzACp0Hab7tj7V6o Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: c6918daa4f884786b45bc88dd1e4e94a Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersAdminTestJSON-1905021104 Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c6918daa4f884786b45bc88dd1e4e94a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c6918daa4f884786b45bc88dd1e4e94a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c6918daa4f884786b45bc88dd1e4e94a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c6918daa4f884786b45bc88dd1e4e94a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersAdminTestJSON-1905021104 Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: c6918daa4f884786b45bc88dd1e4e94a Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersAdminTestJSON-1905021104 Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersAdminTestJSON-1905021104-project Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: c73227214e404f4db779694b8c11779e Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersAdminTestJSON-1905021104-project Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 75dd5d21-42fd-4501-9b43-1716d9e8a63c could not be found. Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '75dd5d21-42fd-4501-9b43-1716d9e8a63c'} Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75dd5d21-42fd-4501-9b43-1716d9e8a63c could not be found. Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75dd5d21-42fd-4501-9b43-1716d9e8a63c could not be found. Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:20.240396 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:20.244699 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:20.244699 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:20.244699 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:20.244699 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:32:20.244699 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:32:20.244699 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75dd5d21-42fd-4501-9b43-1716d9e8a63c could not be found. Oct 05 02:32:20.244699 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:20.249322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:20.249503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-20a5c263-7bd4-40b1-87d7-d857f3bf626b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Returning 404 to user: Instance 75dd5d21-42fd-4501-9b43-1716d9e8a63c could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:32:20.249503 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-20a5c263-7bd4-40b1-87d7-d857f3bf626b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c" status: 404 len: 111 microversion: 2.1 time: 0.062069 Oct 05 02:32:20.249503 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 656/1297] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:20 2022] GET /compute/v2.1/servers/75dd5d21-42fd-4501-9b43-1716d9e8a63c => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:32:20.252079 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-820d6e31-20b6-4af6-b663-be941765d557 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '.version_select at 0x7fccdfcc6ca0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:20.322415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b71daddd-60d8-4212-a289-bd476f0e2da1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:20.332701 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b71daddd-60d8-4212-a289-bd476f0e2da1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:20.334879 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b71daddd-60d8-4212-a289-bd476f0e2da1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:20.341503 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b71daddd-60d8-4212-a289-bd476f0e2da1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1282 microversion: 2.20 time: 0.106889 Oct 05 02:32:20.343025 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 642/1298] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:20 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1282 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:32:20.347786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-89f6fc25-5b59-4a3e-8eb8-9ceb9b88dbc6 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:20.348531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-89f6fc25-5b59-4a3e-8eb8-9ceb9b88dbc6 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] [instance: aaa20a8a-8a7b-42dd-9b4e-9165fba82942] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:20.355371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89f6fc25-5b59-4a3e-8eb8-9ceb9b88dbc6 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:20.355967 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89f6fc25-5b59-4a3e-8eb8-9ceb9b88dbc6 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:20.356664 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89f6fc25-5b59-4a3e-8eb8-9ceb9b88dbc6 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:20.357498 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89f6fc25-5b59-4a3e-8eb8-9ceb9b88dbc6 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:20.358902 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89f6fc25-5b59-4a3e-8eb8-9ceb9b88dbc6 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:20.359549 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89f6fc25-5b59-4a3e-8eb8-9ceb9b88dbc6 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:20.555578 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-820d6e31-20b6-4af6-b663-be941765d557 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/edf0839e-6960-47a2-9d65-16ce6711f567" status: 202 len: 0 microversion: 2.1 time: 0.311432 Oct 05 02:32:20.563774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-89f6fc25-5b59-4a3e-8eb8-9ceb9b88dbc6 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f914ca523057422f88748746ba18b525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '407895b8d4e94b74a2cb652eb2c30048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:20.564148 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 657/1299] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:32:20 2022] DELETE /compute/v2.1/os-security-groups/edf0839e-6960-47a2-9d65-16ce6711f567 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:32:20.573461 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-89f6fc25-5b59-4a3e-8eb8-9ceb9b88dbc6 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942" status: 200 len: 1681 microversion: 2.1 time: 0.229250 Oct 05 02:32:20.573955 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 643/1300] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:20 2022] GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942 => generated 1681 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:20.579050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b65898d7-9728-4121-ab28-324a0b0efbf3 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:20.579798 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9545b96f-014d-42eb-8a50-42b3e2346872 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:20.579932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b65898d7-9728-4121-ab28-324a0b0efbf3 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 34d20b05-afd7-4c5b-8af2-8176e33c041f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:20.580599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9545b96f-014d-42eb-8a50-42b3e2346872 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: eec04f70-af6c-4489-b51e-712165cb8893] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:20.589372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b65898d7-9728-4121-ab28-324a0b0efbf3 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:20.590296 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9545b96f-014d-42eb-8a50-42b3e2346872 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:20.590510 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b65898d7-9728-4121-ab28-324a0b0efbf3 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:20.590795 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9545b96f-014d-42eb-8a50-42b3e2346872 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:20.591233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9545b96f-014d-42eb-8a50-42b3e2346872 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:20.591943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9545b96f-014d-42eb-8a50-42b3e2346872 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:20.592815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b65898d7-9728-4121-ab28-324a0b0efbf3 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:20.593124 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9545b96f-014d-42eb-8a50-42b3e2346872 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:20.593909 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b65898d7-9728-4121-ab28-324a0b0efbf3 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:20.594534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b65898d7-9728-4121-ab28-324a0b0efbf3 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:20.595122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b65898d7-9728-4121-ab28-324a0b0efbf3 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:20.597655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9545b96f-014d-42eb-8a50-42b3e2346872 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:20.615481 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-9545b96f-014d-42eb-8a50-42b3e2346872 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] HTTP exception thrown: Instance eec04f70-af6c-4489-b51e-712165cb8893 could not be found. Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9545b96f-014d-42eb-8a50-42b3e2346872 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Request method failure captured: Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893 HTTP/1.1 Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOxsHfqJu7XBSEzDOBBt7syFIrL9J3OT791dcmShV5lM5pjmkDuONYQmP8-v9KquUBaUHsqFGt8nuaScu9b1kWZKpy9EaLULGZXiZUnDwZJ186OmmTbSMTU6SH3NtgLtLUXyXXhUjMZrhdeVS_vfD8uyVuQTvFy3dykhyOfc3uq0Kds Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c96108fae56640b6aa0cb68523504c43 Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c96108fae56640b6aa0cb68523504c43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c96108fae56640b6aa0cb68523504c43 Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-SecurityGroupsTestJSON-1913947248-project Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 9925b3a9a63c4b1cb98a8adcc28f916d Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-SecurityGroupsTestJSON-1913947248-project Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance eec04f70-af6c-4489-b51e-712165cb8893 could not be found. Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'eec04f70-af6c-4489-b51e-712165cb8893'} Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eec04f70-af6c-4489-b51e-712165cb8893 could not be found. Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:32:20.626727 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:32:20.635184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eec04f70-af6c-4489-b51e-712165cb8893 could not be found. Oct 05 02:32:20.635184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:20.635184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:20.635184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:20.635184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:20.635184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:20.635184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:20.635184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:32:20.635184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:32:20.635184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eec04f70-af6c-4489-b51e-712165cb8893 could not be found. Oct 05 02:32:20.635184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:20.635184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9545b96f-014d-42eb-8a50-42b3e2346872 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Returning 404 to user: Instance eec04f70-af6c-4489-b51e-712165cb8893 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:32:20.635184 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9545b96f-014d-42eb-8a50-42b3e2346872 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893" status: 404 len: 111 microversion: 2.1 time: 0.053316 Oct 05 02:32:20.635184 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 644/1301] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:32:20 2022] DELETE /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:32:20.636697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b65898d7-9728-4121-ab28-324a0b0efbf3 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 34d20b05-afd7-4c5b-8af2-8176e33c041f] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:32:20.641867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c53b02b8-7f0c-4c1b-876e-6934d3f65af2 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:20.647883 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c53b02b8-7f0c-4c1b-876e-6934d3f65af2 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: eec04f70-af6c-4489-b51e-712165cb8893] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:20.668941 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c53b02b8-7f0c-4c1b-876e-6934d3f65af2 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:20.669631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c53b02b8-7f0c-4c1b-876e-6934d3f65af2 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:20.671316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c53b02b8-7f0c-4c1b-876e-6934d3f65af2 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:20.672242 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c53b02b8-7f0c-4c1b-876e-6934d3f65af2 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:20.672875 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c53b02b8-7f0c-4c1b-876e-6934d3f65af2 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:20.673494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c53b02b8-7f0c-4c1b-876e-6934d3f65af2 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:20.693019 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-c53b02b8-7f0c-4c1b-876e-6934d3f65af2 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] HTTP exception thrown: Instance eec04f70-af6c-4489-b51e-712165cb8893 could not be found. Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c53b02b8-7f0c-4c1b-876e-6934d3f65af2 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Request method failure captured: Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893 HTTP/1.1 Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOxsHfqJu7XBSEzDOBBt7syFIrL9J3OT791dcmShV5lM5pjmkDuONYQmP8-v9KquUBaUHsqFGt8nuaScu9b1kWZKpy9EaLULGZXiZUnDwZJ186OmmTbSMTU6SH3NtgLtLUXyXXhUjMZrhdeVS_vfD8uyVuQTvFy3dykhyOfc3uq0Kds Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c96108fae56640b6aa0cb68523504c43 Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c96108fae56640b6aa0cb68523504c43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c96108fae56640b6aa0cb68523504c43 Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-SecurityGroupsTestJSON-1913947248-project Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 9925b3a9a63c4b1cb98a8adcc28f916d Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-SecurityGroupsTestJSON-1913947248-project Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance eec04f70-af6c-4489-b51e-712165cb8893 could not be found. Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'eec04f70-af6c-4489-b51e-712165cb8893'} Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eec04f70-af6c-4489-b51e-712165cb8893 could not be found. Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eec04f70-af6c-4489-b51e-712165cb8893 could not be found. Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:20.695398 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:20.700671 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:20.700671 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:20.700671 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:20.700671 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:32:20.700671 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:32:20.700671 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eec04f70-af6c-4489-b51e-712165cb8893 could not be found. Oct 05 02:32:20.700671 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:20.701865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c53b02b8-7f0c-4c1b-876e-6934d3f65af2 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Returning 404 to user: Instance eec04f70-af6c-4489-b51e-712165cb8893 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:32:20.702780 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c53b02b8-7f0c-4c1b-876e-6934d3f65af2 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893" status: 404 len: 111 microversion: 2.1 time: 0.067971 Oct 05 02:32:20.703343 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 645/1302] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:20 2022] GET /compute/v2.1/servers/eec04f70-af6c-4489-b51e-712165cb8893 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:32:20.724318 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-760b843c-4714-4444-976d-e4590a0eb604 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '.version_select at 0x7fcce41819d0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:20.735743 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b65898d7-9728-4121-ab28-324a0b0efbf3 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "DELETE /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f" status: 204 len: 0 microversion: 2.1 time: 0.167367 Oct 05 02:32:20.738452 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 658/1303] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:32:20 2022] DELETE /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:32:20.747630 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-aef793d9-2a25-43df-809b-e1281dcb3155 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:20.749004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG neutronclient.v2_0.client [None req-760b843c-4714-4444-976d-e4590a0eb604 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group df17ff5e-63f2-456e-a3c1-bd6f1125bd0a does not exist", "detail": ""}} {{(pid=122320) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 02:32:20.749422 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-aef793d9-2a25-43df-809b-e1281dcb3155 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 34d20b05-afd7-4c5b-8af2-8176e33c041f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:20.749895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.security_group_api [None req-760b843c-4714-4444-976d-e4590a0eb604 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Neutron security group df17ff5e-63f2-456e-a3c1-bd6f1125bd0a not found {{(pid=122320) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 05 02:32:20.750422 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-760b843c-4714-4444-976d-e4590a0eb604 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] HTTP exception thrown: Security group df17ff5e-63f2-456e-a3c1-bd6f1125bd0a does not exist Oct 05 02:32:20.750422 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-1f301fa3-f829-4cda-9400-5e93c40cac25'] Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-760b843c-4714-4444-976d-e4590a0eb604 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Request method failure captured: Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/os-security-groups/df17ff5e-63f2-456e-a3c1-bd6f1125bd0a HTTP/1.1 Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOxsHfqJu7XBSEzDOBBt7syFIrL9J3OT791dcmShV5lM5pjmkDuONYQmP8-v9KquUBaUHsqFGt8nuaScu9b1kWZKpy9EaLULGZXiZUnDwZJ186OmmTbSMTU6SH3NtgLtLUXyXXhUjMZrhdeVS_vfD8uyVuQTvFy3dykhyOfc3uq0Kds Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c96108fae56640b6aa0cb68523504c43 Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c96108fae56640b6aa0cb68523504c43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c96108fae56640b6aa0cb68523504c43 Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-SecurityGroupsTestJSON-1913947248-project Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 9925b3a9a63c4b1cb98a8adcc28f916d Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-SecurityGroupsTestJSON-1913947248-project Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: exception: Security group df17ff5e-63f2-456e-a3c1-bd6f1125bd0a does not exist Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-1f301fa3-f829-4cda-9400-5e93c40cac25'] Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'df17ff5e-63f2-456e-a3c1-bd6f1125bd0a'} Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 02:32:20.752528 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group df17ff5e-63f2-456e-a3c1-bd6f1125bd0a does not exist Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f301fa3-f829-4cda-9400-5e93c40cac25'] Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group df17ff5e-63f2-456e-a3c1-bd6f1125bd0a does not exist Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f301fa3-f829-4cda-9400-5e93c40cac25'] Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group df17ff5e-63f2-456e-a3c1-bd6f1125bd0a does not exist Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f301fa3-f829-4cda-9400-5e93c40cac25'] Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group df17ff5e-63f2-456e-a3c1-bd6f1125bd0a does not exist Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f301fa3-f829-4cda-9400-5e93c40cac25'] Oct 05 02:32:20.757117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:20.760013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aef793d9-2a25-43df-809b-e1281dcb3155 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:20.760013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aef793d9-2a25-43df-809b-e1281dcb3155 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:20.760013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aef793d9-2a25-43df-809b-e1281dcb3155 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:20.760013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aef793d9-2a25-43df-809b-e1281dcb3155 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:20.760013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aef793d9-2a25-43df-809b-e1281dcb3155 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:20.760013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aef793d9-2a25-43df-809b-e1281dcb3155 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:20.764931 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-760b843c-4714-4444-976d-e4590a0eb604 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Returning 404 to user: Security group df17ff5e-63f2-456e-a3c1-bd6f1125bd0a does not exist Oct 05 02:32:20.764931 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-1f301fa3-f829-4cda-9400-5e93c40cac25'] {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:32:20.764931 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-760b843c-4714-4444-976d-e4590a0eb604 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/df17ff5e-63f2-456e-a3c1-bd6f1125bd0a" status: 404 len: 194 microversion: 2.1 time: 0.052553 Oct 05 02:32:20.764931 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 646/1304] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:32:20 2022] DELETE /compute/v2.1/os-security-groups/df17ff5e-63f2-456e-a3c1-bd6f1125bd0a => generated 194 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:32:20.768471 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4180325e-c88a-46d4-b494-a61bb4ffe699 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:20.769440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4180325e-c88a-46d4-b494-a61bb4ffe699 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: b6f02d3d-f6df-419f-9962-58c68a597dcd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:20.769933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:20.778307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4180325e-c88a-46d4-b494-a61bb4ffe699 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:20.779076 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4180325e-c88a-46d4-b494-a61bb4ffe699 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:20.779721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4180325e-c88a-46d4-b494-a61bb4ffe699 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:20.780743 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4180325e-c88a-46d4-b494-a61bb4ffe699 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:20.781464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4180325e-c88a-46d4-b494-a61bb4ffe699 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:20.781826 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4180325e-c88a-46d4-b494-a61bb4ffe699 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:21.006223 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4180325e-c88a-46d4-b494-a61bb4ffe699 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:21.014868 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4180325e-c88a-46d4-b494-a61bb4ffe699 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/b6f02d3d-f6df-419f-9962-58c68a597dcd" status: 200 len: 1307 microversion: 2.1 time: 0.250562 Oct 05 02:32:21.015738 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 647/1305] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:20 2022] GET /compute/v2.1/servers/b6f02d3d-f6df-419f-9962-58c68a597dcd => generated 1307 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:21.020523 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ac54b24a-c65e-49e5-9e05-1031cfeac9bb tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '.version_select at 0x7fcce435bb80>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:21.045637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-aef793d9-2a25-43df-809b-e1281dcb3155 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:21.054742 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-aef793d9-2a25-43df-809b-e1281dcb3155 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f" status: 200 len: 1469 microversion: 2.1 time: 0.311719 Oct 05 02:32:21.065602 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 659/1306] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:20 2022] GET /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f => generated 1469 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:21.066435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG neutronclient.v2_0.client [None req-ac54b24a-c65e-49e5-9e05-1031cfeac9bb tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 39028f60-e6c9-497a-9ed5-786de1288335 does not exist", "detail": ""}} {{(pid=122320) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 02:32:21.067041 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.security_group_api [None req-ac54b24a-c65e-49e5-9e05-1031cfeac9bb tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Neutron security group 39028f60-e6c9-497a-9ed5-786de1288335 not found {{(pid=122320) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 05 02:32:21.067572 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-ac54b24a-c65e-49e5-9e05-1031cfeac9bb tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] HTTP exception thrown: Security group 39028f60-e6c9-497a-9ed5-786de1288335 does not exist Oct 05 02:32:21.067572 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-86727e27-7d1f-401c-bf3c-ab347dad3c9d'] Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ac54b24a-c65e-49e5-9e05-1031cfeac9bb tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Request method failure captured: Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/os-security-groups/39028f60-e6c9-497a-9ed5-786de1288335 HTTP/1.1 Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOxsHfqJu7XBSEzDOBBt7syFIrL9J3OT791dcmShV5lM5pjmkDuONYQmP8-v9KquUBaUHsqFGt8nuaScu9b1kWZKpy9EaLULGZXiZUnDwZJ186OmmTbSMTU6SH3NtgLtLUXyXXhUjMZrhdeVS_vfD8uyVuQTvFy3dykhyOfc3uq0Kds Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c96108fae56640b6aa0cb68523504c43 Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c96108fae56640b6aa0cb68523504c43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c96108fae56640b6aa0cb68523504c43 Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-SecurityGroupsTestJSON-1913947248-project Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 9925b3a9a63c4b1cb98a8adcc28f916d Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-SecurityGroupsTestJSON-1913947248-project Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: exception: Security group 39028f60-e6c9-497a-9ed5-786de1288335 does not exist Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-86727e27-7d1f-401c-bf3c-ab347dad3c9d'] Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '39028f60-e6c9-497a-9ed5-786de1288335'} Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 02:32:21.069675 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 39028f60-e6c9-497a-9ed5-786de1288335 does not exist Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86727e27-7d1f-401c-bf3c-ab347dad3c9d'] Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 39028f60-e6c9-497a-9ed5-786de1288335 does not exist Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86727e27-7d1f-401c-bf3c-ab347dad3c9d'] Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 39028f60-e6c9-497a-9ed5-786de1288335 does not exist Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86727e27-7d1f-401c-bf3c-ab347dad3c9d'] Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 39028f60-e6c9-497a-9ed5-786de1288335 does not exist Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86727e27-7d1f-401c-bf3c-ab347dad3c9d'] Oct 05 02:32:21.074307 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.077804 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-732d2df8-9ced-448f-ae55-9b06a751e4ea tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:21.077804 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-732d2df8-9ced-448f-ae55-9b06a751e4ea tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 6a205b3a-9fb4-4703-9368-0ab2436d60e5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:21.080944 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ac54b24a-c65e-49e5-9e05-1031cfeac9bb tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Returning 404 to user: Security group 39028f60-e6c9-497a-9ed5-786de1288335 does not exist Oct 05 02:32:21.080944 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-86727e27-7d1f-401c-bf3c-ab347dad3c9d'] {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:32:21.082137 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ac54b24a-c65e-49e5-9e05-1031cfeac9bb tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/39028f60-e6c9-497a-9ed5-786de1288335" status: 404 len: 194 microversion: 2.1 time: 0.065328 Oct 05 02:32:21.082984 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 648/1307] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:32:21 2022] DELETE /compute/v2.1/os-security-groups/39028f60-e6c9-497a-9ed5-786de1288335 => generated 194 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:32:21.083880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-732d2df8-9ced-448f-ae55-9b06a751e4ea tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:21.084378 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-732d2df8-9ced-448f-ae55-9b06a751e4ea tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:21.084817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-732d2df8-9ced-448f-ae55-9b06a751e4ea tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:21.085556 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-732d2df8-9ced-448f-ae55-9b06a751e4ea tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:21.086122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-732d2df8-9ced-448f-ae55-9b06a751e4ea tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:21.086507 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-732d2df8-9ced-448f-ae55-9b06a751e4ea tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:21.090767 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f54fccdf-03bd-4e9e-9600-82923e38c8fb tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '.version_select at 0x7fcce41819d0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:21.101033 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-732d2df8-9ced-448f-ae55-9b06a751e4ea tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] HTTP exception thrown: Instance 6a205b3a-9fb4-4703-9368-0ab2436d60e5 could not be found. Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-732d2df8-9ced-448f-ae55-9b06a751e4ea tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Request method failure captured: Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5 HTTP/1.1 Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOu1gG38gJNjmxZnNpWZK6Tz2Td3dHF9b7mPeRCkTHzRqaL6Ag4fVmTJ_ZMi4CYPJrsbGLizIHhQMO5q5yGPYWt4Z22NkV9FS1Bxm5sy2SSxEr7LtK34r1ikudmbjdlXscCrHvo39_f5HTpyI7GvZPLFe_JyDqlWRTA_QZ0Pm5GL3h4 Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: fecbac50c16847799a85c148c6c143de Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1767514494 Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fecbac50c16847799a85c148c6c143de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fecbac50c16847799a85c148c6c143de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fecbac50c16847799a85c148c6c143de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fecbac50c16847799a85c148c6c143de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1767514494 Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: fecbac50c16847799a85c148c6c143de Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1767514494 Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1767514494-project Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 368f6c3db9f24561a13f48ce02e7655e Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1767514494-project Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 6a205b3a-9fb4-4703-9368-0ab2436d60e5 could not be found. Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '6a205b3a-9fb4-4703-9368-0ab2436d60e5'} Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a205b3a-9fb4-4703-9368-0ab2436d60e5 could not be found. Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a205b3a-9fb4-4703-9368-0ab2436d60e5 could not be found. Oct 05 02:32:21.103050 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.108275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:21.108275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.108275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:21.108275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:21.108275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:21.108275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:32:21.108275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:32:21.108275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a205b3a-9fb4-4703-9368-0ab2436d60e5 could not be found. Oct 05 02:32:21.108275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.108275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-732d2df8-9ced-448f-ae55-9b06a751e4ea tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Returning 404 to user: Instance 6a205b3a-9fb4-4703-9368-0ab2436d60e5 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:32:21.108275 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-732d2df8-9ced-448f-ae55-9b06a751e4ea tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5" status: 404 len: 111 microversion: 2.1 time: 0.038672 Oct 05 02:32:21.108275 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 660/1308] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:21 2022] GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:32:21.115011 n-d-858272-3 devstack@n-api.service[122320]: DEBUG neutronclient.v2_0.client [None req-f54fccdf-03bd-4e9e-9600-82923e38c8fb tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7cb132b2-3c93-4634-8b51-54f20c249146 does not exist", "detail": ""}} {{(pid=122320) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 02:32:21.115607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.security_group_api [None req-f54fccdf-03bd-4e9e-9600-82923e38c8fb tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Neutron security group 7cb132b2-3c93-4634-8b51-54f20c249146 not found {{(pid=122320) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 05 02:32:21.115794 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8cc060d4-0365-4899-a8bb-64e235b3b526 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:21.116120 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-f54fccdf-03bd-4e9e-9600-82923e38c8fb tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] HTTP exception thrown: Security group 7cb132b2-3c93-4634-8b51-54f20c249146 does not exist Oct 05 02:32:21.116120 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-7cd7ca64-e74c-4321-a763-4c0065e3d55c'] Oct 05 02:32:21.116346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8cc060d4-0365-4899-a8bb-64e235b3b526 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 3245900a-6147-427e-86e3-b0af919523e6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f54fccdf-03bd-4e9e-9600-82923e38c8fb tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Request method failure captured: Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/os-security-groups/7cb132b2-3c93-4634-8b51-54f20c249146 HTTP/1.1 Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOxsHfqJu7XBSEzDOBBt7syFIrL9J3OT791dcmShV5lM5pjmkDuONYQmP8-v9KquUBaUHsqFGt8nuaScu9b1kWZKpy9EaLULGZXiZUnDwZJ186OmmTbSMTU6SH3NtgLtLUXyXXhUjMZrhdeVS_vfD8uyVuQTvFy3dykhyOfc3uq0Kds Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c96108fae56640b6aa0cb68523504c43 Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c96108fae56640b6aa0cb68523504c43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c96108fae56640b6aa0cb68523504c43 Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-SecurityGroupsTestJSON-1913947248-project Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 9925b3a9a63c4b1cb98a8adcc28f916d Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-SecurityGroupsTestJSON-1913947248-project Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: exception: Security group 7cb132b2-3c93-4634-8b51-54f20c249146 does not exist Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-7cd7ca64-e74c-4321-a763-4c0065e3d55c'] Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '7cb132b2-3c93-4634-8b51-54f20c249146'} Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 02:32:21.118940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7cb132b2-3c93-4634-8b51-54f20c249146 does not exist Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7cd7ca64-e74c-4321-a763-4c0065e3d55c'] Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7cb132b2-3c93-4634-8b51-54f20c249146 does not exist Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7cd7ca64-e74c-4321-a763-4c0065e3d55c'] Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7cb132b2-3c93-4634-8b51-54f20c249146 does not exist Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7cd7ca64-e74c-4321-a763-4c0065e3d55c'] Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7cb132b2-3c93-4634-8b51-54f20c249146 does not exist Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7cd7ca64-e74c-4321-a763-4c0065e3d55c'] Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f54fccdf-03bd-4e9e-9600-82923e38c8fb tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Returning 404 to user: Security group 7cb132b2-3c93-4634-8b51-54f20c249146 does not exist Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-7cd7ca64-e74c-4321-a763-4c0065e3d55c'] {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:32:21.123732 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f54fccdf-03bd-4e9e-9600-82923e38c8fb tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/7cb132b2-3c93-4634-8b51-54f20c249146" status: 404 len: 194 microversion: 2.1 time: 0.033890 Oct 05 02:32:21.126935 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cc060d4-0365-4899-a8bb-64e235b3b526 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:21.126935 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cc060d4-0365-4899-a8bb-64e235b3b526 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:21.126935 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cc060d4-0365-4899-a8bb-64e235b3b526 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:21.126935 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cc060d4-0365-4899-a8bb-64e235b3b526 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:21.127308 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 649/1309] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:32:21 2022] DELETE /compute/v2.1/os-security-groups/7cb132b2-3c93-4634-8b51-54f20c249146 => generated 194 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:32:21.127399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cc060d4-0365-4899-a8bb-64e235b3b526 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:21.129046 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cc060d4-0365-4899-a8bb-64e235b3b526 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:21.130032 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-55a6e2c8-091c-4c13-bcd6-32d3b28bfab7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '.version_select at 0x7fcce444d0d0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:21.147186 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-8cc060d4-0365-4899-a8bb-64e235b3b526 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] HTTP exception thrown: Instance 3245900a-6147-427e-86e3-b0af919523e6 could not be found. Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8cc060d4-0365-4899-a8bb-64e235b3b526 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Request method failure captured: Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6 HTTP/1.1 Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOu1gG38gJNjmxZnNpWZK6Tz2Td3dHF9b7mPeRCkTHzRqaL6Ag4fVmTJ_ZMi4CYPJrsbGLizIHhQMO5q5yGPYWt4Z22NkV9FS1Bxm5sy2SSxEr7LtK34r1ikudmbjdlXscCrHvo39_f5HTpyI7GvZPLFe_JyDqlWRTA_QZ0Pm5GL3h4 Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: fecbac50c16847799a85c148c6c143de Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1767514494 Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fecbac50c16847799a85c148c6c143de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fecbac50c16847799a85c148c6c143de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fecbac50c16847799a85c148c6c143de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fecbac50c16847799a85c148c6c143de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1767514494 Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: fecbac50c16847799a85c148c6c143de Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1767514494 Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1767514494-project Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 368f6c3db9f24561a13f48ce02e7655e Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1767514494-project Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 3245900a-6147-427e-86e3-b0af919523e6 could not be found. Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '3245900a-6147-427e-86e3-b0af919523e6'} Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3245900a-6147-427e-86e3-b0af919523e6 could not be found. Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:32:21.148754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:32:21.156386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3245900a-6147-427e-86e3-b0af919523e6 could not be found. Oct 05 02:32:21.156386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.156386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:21.156386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.156386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:21.156386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:21.156386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:21.156386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:32:21.156386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:32:21.156386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3245900a-6147-427e-86e3-b0af919523e6 could not be found. Oct 05 02:32:21.156386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.156386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8cc060d4-0365-4899-a8bb-64e235b3b526 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Returning 404 to user: Instance 3245900a-6147-427e-86e3-b0af919523e6 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:32:21.156386 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8cc060d4-0365-4899-a8bb-64e235b3b526 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6" status: 404 len: 111 microversion: 2.1 time: 0.038268 Oct 05 02:32:21.156386 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 661/1310] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:32:21 2022] DELETE /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:32:21.157872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ef79e028-e2a9-49da-89a9-df296b7f4d0a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:21.158488 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ef79e028-e2a9-49da-89a9-df296b7f4d0a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:21.164490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef79e028-e2a9-49da-89a9-df296b7f4d0a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:21.165011 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef79e028-e2a9-49da-89a9-df296b7f4d0a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:21.165204 n-d-858272-3 devstack@n-api.service[122320]: DEBUG neutronclient.v2_0.client [None req-55a6e2c8-091c-4c13-bcd6-32d3b28bfab7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 29b22fe0-ff7a-46bb-81cf-77860602871c does not exist", "detail": ""}} {{(pid=122320) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 02:32:21.165451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef79e028-e2a9-49da-89a9-df296b7f4d0a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:21.165754 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.security_group_api [None req-55a6e2c8-091c-4c13-bcd6-32d3b28bfab7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Neutron security group 29b22fe0-ff7a-46bb-81cf-77860602871c not found {{(pid=122320) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 05 02:32:21.166141 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef79e028-e2a9-49da-89a9-df296b7f4d0a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:21.166291 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-55a6e2c8-091c-4c13-bcd6-32d3b28bfab7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] HTTP exception thrown: Security group 29b22fe0-ff7a-46bb-81cf-77860602871c does not exist Oct 05 02:32:21.166291 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-a02ae37c-2e43-4e87-9fef-86d8b228ab46'] Oct 05 02:32:21.166582 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef79e028-e2a9-49da-89a9-df296b7f4d0a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:21.167002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef79e028-e2a9-49da-89a9-df296b7f4d0a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-55a6e2c8-091c-4c13-bcd6-32d3b28bfab7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Request method failure captured: Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/os-security-groups/29b22fe0-ff7a-46bb-81cf-77860602871c HTTP/1.1 Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOxsHfqJu7XBSEzDOBBt7syFIrL9J3OT791dcmShV5lM5pjmkDuONYQmP8-v9KquUBaUHsqFGt8nuaScu9b1kWZKpy9EaLULGZXiZUnDwZJ186OmmTbSMTU6SH3NtgLtLUXyXXhUjMZrhdeVS_vfD8uyVuQTvFy3dykhyOfc3uq0Kds Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c96108fae56640b6aa0cb68523504c43 Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c96108fae56640b6aa0cb68523504c43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c96108fae56640b6aa0cb68523504c43 Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-SecurityGroupsTestJSON-1913947248-project Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 9925b3a9a63c4b1cb98a8adcc28f916d Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-SecurityGroupsTestJSON-1913947248-project Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: exception: Security group 29b22fe0-ff7a-46bb-81cf-77860602871c does not exist Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-a02ae37c-2e43-4e87-9fef-86d8b228ab46'] Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '29b22fe0-ff7a-46bb-81cf-77860602871c'} Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 02:32:21.168185 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 29b22fe0-ff7a-46bb-81cf-77860602871c does not exist Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a02ae37c-2e43-4e87-9fef-86d8b228ab46'] Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 29b22fe0-ff7a-46bb-81cf-77860602871c does not exist Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a02ae37c-2e43-4e87-9fef-86d8b228ab46'] Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 29b22fe0-ff7a-46bb-81cf-77860602871c does not exist Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a02ae37c-2e43-4e87-9fef-86d8b228ab46'] Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 29b22fe0-ff7a-46bb-81cf-77860602871c does not exist Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a02ae37c-2e43-4e87-9fef-86d8b228ab46'] Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-55a6e2c8-091c-4c13-bcd6-32d3b28bfab7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Returning 404 to user: Security group 29b22fe0-ff7a-46bb-81cf-77860602871c does not exist Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-a02ae37c-2e43-4e87-9fef-86d8b228ab46'] {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-55a6e2c8-091c-4c13-bcd6-32d3b28bfab7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/29b22fe0-ff7a-46bb-81cf-77860602871c" status: 404 len: 194 microversion: 2.1 time: 0.043645 Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 650/1311] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:32:21 2022] DELETE /compute/v2.1/os-security-groups/29b22fe0-ff7a-46bb-81cf-77860602871c => generated 194 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-df37eae4-d0ca-4483-8e60-7206b9b6902c tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:21.177320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-df37eae4-d0ca-4483-8e60-7206b9b6902c tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 3245900a-6147-427e-86e3-b0af919523e6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:21.183174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df37eae4-d0ca-4483-8e60-7206b9b6902c tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:21.183659 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df37eae4-d0ca-4483-8e60-7206b9b6902c tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:21.184100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df37eae4-d0ca-4483-8e60-7206b9b6902c tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:21.184786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df37eae4-d0ca-4483-8e60-7206b9b6902c tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:21.185266 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df37eae4-d0ca-4483-8e60-7206b9b6902c tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:21.185690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df37eae4-d0ca-4483-8e60-7206b9b6902c tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:21.199014 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-df37eae4-d0ca-4483-8e60-7206b9b6902c tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] HTTP exception thrown: Instance 3245900a-6147-427e-86e3-b0af919523e6 could not be found. Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-df37eae4-d0ca-4483-8e60-7206b9b6902c tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Request method failure captured: Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6 HTTP/1.1 Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOu1gG38gJNjmxZnNpWZK6Tz2Td3dHF9b7mPeRCkTHzRqaL6Ag4fVmTJ_ZMi4CYPJrsbGLizIHhQMO5q5yGPYWt4Z22NkV9FS1Bxm5sy2SSxEr7LtK34r1ikudmbjdlXscCrHvo39_f5HTpyI7GvZPLFe_JyDqlWRTA_QZ0Pm5GL3h4 Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: fecbac50c16847799a85c148c6c143de Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1767514494 Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fecbac50c16847799a85c148c6c143de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fecbac50c16847799a85c148c6c143de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fecbac50c16847799a85c148c6c143de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fecbac50c16847799a85c148c6c143de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1767514494 Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: fecbac50c16847799a85c148c6c143de Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1767514494 Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1767514494-project Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 368f6c3db9f24561a13f48ce02e7655e Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1767514494-project Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 3245900a-6147-427e-86e3-b0af919523e6 could not be found. Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '3245900a-6147-427e-86e3-b0af919523e6'} Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3245900a-6147-427e-86e3-b0af919523e6 could not be found. Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3245900a-6147-427e-86e3-b0af919523e6 could not be found. Oct 05 02:32:21.200583 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.205764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:21.205764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.205764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:21.205764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:21.205764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:21.205764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:32:21.205764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:32:21.205764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3245900a-6147-427e-86e3-b0af919523e6 could not be found. Oct 05 02:32:21.205764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.205764 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-df37eae4-d0ca-4483-8e60-7206b9b6902c tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Returning 404 to user: Instance 3245900a-6147-427e-86e3-b0af919523e6 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:32:21.205764 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-df37eae4-d0ca-4483-8e60-7206b9b6902c tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6" status: 404 len: 111 microversion: 2.1 time: 0.030426 Oct 05 02:32:21.205764 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 651/1312] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:21 2022] GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:32:21.207709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ee93f770-4414-4395-97fd-e551ac218956 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '.version_select at 0x7fcce4589c10>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:21.248617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG neutronclient.v2_0.client [None req-ee93f770-4414-4395-97fd-e551ac218956 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e73c426f-b9f7-4d44-9250-7c9e836db762 does not exist", "detail": ""}} {{(pid=122320) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 02:32:21.249315 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.security_group_api [None req-ee93f770-4414-4395-97fd-e551ac218956 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Neutron security group e73c426f-b9f7-4d44-9250-7c9e836db762 not found {{(pid=122320) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 05 02:32:21.249835 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-ee93f770-4414-4395-97fd-e551ac218956 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] HTTP exception thrown: Security group e73c426f-b9f7-4d44-9250-7c9e836db762 does not exist Oct 05 02:32:21.249835 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-6730efb0-2255-4e6b-85ac-c942725cb94e'] Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ee93f770-4414-4395-97fd-e551ac218956 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Request method failure captured: Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/os-security-groups/e73c426f-b9f7-4d44-9250-7c9e836db762 HTTP/1.1 Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOxsHfqJu7XBSEzDOBBt7syFIrL9J3OT791dcmShV5lM5pjmkDuONYQmP8-v9KquUBaUHsqFGt8nuaScu9b1kWZKpy9EaLULGZXiZUnDwZJ186OmmTbSMTU6SH3NtgLtLUXyXXhUjMZrhdeVS_vfD8uyVuQTvFy3dykhyOfc3uq0Kds Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c96108fae56640b6aa0cb68523504c43 Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c96108fae56640b6aa0cb68523504c43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c96108fae56640b6aa0cb68523504c43 Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-SecurityGroupsTestJSON-1913947248-project Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 9925b3a9a63c4b1cb98a8adcc28f916d Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-SecurityGroupsTestJSON-1913947248-project Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: exception: Security group e73c426f-b9f7-4d44-9250-7c9e836db762 does not exist Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-6730efb0-2255-4e6b-85ac-c942725cb94e'] Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'e73c426f-b9f7-4d44-9250-7c9e836db762'} Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 02:32:21.251673 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e73c426f-b9f7-4d44-9250-7c9e836db762 does not exist Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6730efb0-2255-4e6b-85ac-c942725cb94e'] Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e73c426f-b9f7-4d44-9250-7c9e836db762 does not exist Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6730efb0-2255-4e6b-85ac-c942725cb94e'] Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e73c426f-b9f7-4d44-9250-7c9e836db762 does not exist Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6730efb0-2255-4e6b-85ac-c942725cb94e'] Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e73c426f-b9f7-4d44-9250-7c9e836db762 does not exist Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6730efb0-2255-4e6b-85ac-c942725cb94e'] Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ee93f770-4414-4395-97fd-e551ac218956 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Returning 404 to user: Security group e73c426f-b9f7-4d44-9250-7c9e836db762 does not exist Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-6730efb0-2255-4e6b-85ac-c942725cb94e'] {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ee93f770-4414-4395-97fd-e551ac218956 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/e73c426f-b9f7-4d44-9250-7c9e836db762" status: 404 len: 194 microversion: 2.1 time: 0.048968 Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 652/1313] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:32:21 2022] DELETE /compute/v2.1/os-security-groups/e73c426f-b9f7-4d44-9250-7c9e836db762 => generated 194 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:32:21.259826 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-29aa2796-d324-4a4e-beff-d4efd410619e tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '.version_select at 0x7fcce4182f70>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:21.280323 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-29aa2796-d324-4a4e-beff-d4efd410619e tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-667138563" status: 202 len: 0 microversion: 2.1 time: 0.024663 Oct 05 02:32:21.281395 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 653/1314] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 5 02:32:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-667138563 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:32:21.285960 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c1be8ac6-8f6a-48fa-bf88-a731531101a4 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '.version_select at 0x7fcce444dc10>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:21.337670 n-d-858272-3 devstack@n-api.service[122320]: DEBUG neutronclient.v2_0.client [None req-c1be8ac6-8f6a-48fa-bf88-a731531101a4 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d91df31e-b410-4afd-b7b2-ead004a550a4 does not exist", "detail": ""}} {{(pid=122320) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 02:32:21.338408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.security_group_api [None req-c1be8ac6-8f6a-48fa-bf88-a731531101a4 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Neutron security group d91df31e-b410-4afd-b7b2-ead004a550a4 not found {{(pid=122320) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 05 02:32:21.339075 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-c1be8ac6-8f6a-48fa-bf88-a731531101a4 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] HTTP exception thrown: Security group d91df31e-b410-4afd-b7b2-ead004a550a4 does not exist Oct 05 02:32:21.339075 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-d419d8f7-8584-4bd1-b7d4-0ce9da608fb6'] Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c1be8ac6-8f6a-48fa-bf88-a731531101a4 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Request method failure captured: Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/os-security-groups/d91df31e-b410-4afd-b7b2-ead004a550a4 HTTP/1.1 Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOxsHfqJu7XBSEzDOBBt7syFIrL9J3OT791dcmShV5lM5pjmkDuONYQmP8-v9KquUBaUHsqFGt8nuaScu9b1kWZKpy9EaLULGZXiZUnDwZJ186OmmTbSMTU6SH3NtgLtLUXyXXhUjMZrhdeVS_vfD8uyVuQTvFy3dykhyOfc3uq0Kds Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c96108fae56640b6aa0cb68523504c43 Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c96108fae56640b6aa0cb68523504c43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c96108fae56640b6aa0cb68523504c43 Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-SecurityGroupsTestJSON-1913947248-project Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 9925b3a9a63c4b1cb98a8adcc28f916d Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-SecurityGroupsTestJSON-1913947248-project Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: exception: Security group d91df31e-b410-4afd-b7b2-ead004a550a4 does not exist Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-d419d8f7-8584-4bd1-b7d4-0ce9da608fb6'] Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'd91df31e-b410-4afd-b7b2-ead004a550a4'} Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 02:32:21.340944 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d91df31e-b410-4afd-b7b2-ead004a550a4 does not exist Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d419d8f7-8584-4bd1-b7d4-0ce9da608fb6'] Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d91df31e-b410-4afd-b7b2-ead004a550a4 does not exist Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d419d8f7-8584-4bd1-b7d4-0ce9da608fb6'] Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d91df31e-b410-4afd-b7b2-ead004a550a4 does not exist Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d419d8f7-8584-4bd1-b7d4-0ce9da608fb6'] Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d91df31e-b410-4afd-b7b2-ead004a550a4 does not exist Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d419d8f7-8584-4bd1-b7d4-0ce9da608fb6'] Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c1be8ac6-8f6a-48fa-bf88-a731531101a4 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Returning 404 to user: Security group d91df31e-b410-4afd-b7b2-ead004a550a4 does not exist Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-d419d8f7-8584-4bd1-b7d4-0ce9da608fb6'] {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c1be8ac6-8f6a-48fa-bf88-a731531101a4 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/d91df31e-b410-4afd-b7b2-ead004a550a4" status: 404 len: 194 microversion: 2.1 time: 0.060013 Oct 05 02:32:21.345764 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 654/1315] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:32:21 2022] DELETE /compute/v2.1/os-security-groups/d91df31e-b410-4afd-b7b2-ead004a550a4 => generated 194 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:32:21.350990 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1b6ceda5-594d-4620-9154-7291743f18f3 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:21.351765 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1b6ceda5-594d-4620-9154-7291743f18f3 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: a9c9522c-a640-49f4-9cb9-0dcf19eea103] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:21.359535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b6ceda5-594d-4620-9154-7291743f18f3 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:21.360029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b6ceda5-594d-4620-9154-7291743f18f3 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:21.360463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b6ceda5-594d-4620-9154-7291743f18f3 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:21.361193 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b6ceda5-594d-4620-9154-7291743f18f3 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:21.361649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b6ceda5-594d-4620-9154-7291743f18f3 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:21.362074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b6ceda5-594d-4620-9154-7291743f18f3 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:21.369263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ef79e028-e2a9-49da-89a9-df296b7f4d0a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:21.379097 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ef79e028-e2a9-49da-89a9-df296b7f4d0a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:21.380665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ef79e028-e2a9-49da-89a9-df296b7f4d0a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:21.382032 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ef79e028-e2a9-49da-89a9-df296b7f4d0a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1814 microversion: 2.25 time: 0.230302 Oct 05 02:32:21.387785 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 662/1316] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:21 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1814 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:32:21.391960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f55c9a9d-e5c6-4326-ba7f-d1f0f4f9cb66 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:21.392573 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f55c9a9d-e5c6-4326-ba7f-d1f0f4f9cb66 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:21.399958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f55c9a9d-e5c6-4326-ba7f-d1f0f4f9cb66 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:21.400788 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f55c9a9d-e5c6-4326-ba7f-d1f0f4f9cb66 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:21.400936 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f55c9a9d-e5c6-4326-ba7f-d1f0f4f9cb66 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:21.401592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f55c9a9d-e5c6-4326-ba7f-d1f0f4f9cb66 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:21.402049 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f55c9a9d-e5c6-4326-ba7f-d1f0f4f9cb66 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:21.402478 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f55c9a9d-e5c6-4326-ba7f-d1f0f4f9cb66 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:21.403930 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1b6ceda5-594d-4620-9154-7291743f18f3 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: a9c9522c-a640-49f4-9cb9-0dcf19eea103] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:32:21.440936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:21.486672 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1b6ceda5-594d-4620-9154-7291743f18f3 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103" status: 204 len: 0 microversion: 2.1 time: 0.139062 Oct 05 02:32:21.488293 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 655/1317] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:32:21 2022] DELETE /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:32:21.490841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f55c9a9d-e5c6-4326-ba7f-d1f0f4f9cb66 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:21.502191 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f55c9a9d-e5c6-4326-ba7f-d1f0f4f9cb66 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:21.503335 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1474e2ee-3eb8-4231-975d-d685e3fe7db5 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:21.503766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f55c9a9d-e5c6-4326-ba7f-d1f0f4f9cb66 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:21.504881 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1474e2ee-3eb8-4231-975d-d685e3fe7db5 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: a9c9522c-a640-49f4-9cb9-0dcf19eea103] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:21.505795 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f55c9a9d-e5c6-4326-ba7f-d1f0f4f9cb66 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1334 microversion: 2.20 time: 0.120830 Oct 05 02:32:21.505795 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 663/1318] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:21 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1334 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:32:21.510918 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1474e2ee-3eb8-4231-975d-d685e3fe7db5 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:21.511403 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1474e2ee-3eb8-4231-975d-d685e3fe7db5 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:21.511829 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1474e2ee-3eb8-4231-975d-d685e3fe7db5 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:21.512517 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1474e2ee-3eb8-4231-975d-d685e3fe7db5 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:21.512994 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1474e2ee-3eb8-4231-975d-d685e3fe7db5 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:21.513413 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1474e2ee-3eb8-4231-975d-d685e3fe7db5 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:21.598058 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d9b95c7f-8080-468f-8ffb-4fe9bebec9fd tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:21.598986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d9b95c7f-8080-468f-8ffb-4fe9bebec9fd tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] [instance: aaa20a8a-8a7b-42dd-9b4e-9165fba82942] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:21.606108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d9b95c7f-8080-468f-8ffb-4fe9bebec9fd tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:21.606609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d9b95c7f-8080-468f-8ffb-4fe9bebec9fd tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:21.607052 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d9b95c7f-8080-468f-8ffb-4fe9bebec9fd tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:21.608402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d9b95c7f-8080-468f-8ffb-4fe9bebec9fd tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:21.609529 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d9b95c7f-8080-468f-8ffb-4fe9bebec9fd tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:21.609965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d9b95c7f-8080-468f-8ffb-4fe9bebec9fd tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:22.197162 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1474e2ee-3eb8-4231-975d-d685e3fe7db5 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:22.206360 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1474e2ee-3eb8-4231-975d-d685e3fe7db5 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103" status: 200 len: 1648 microversion: 2.1 time: 0.712085 Oct 05 02:32:22.207844 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d9b95c7f-8080-468f-8ffb-4fe9bebec9fd tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f914ca523057422f88748746ba18b525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '407895b8d4e94b74a2cb652eb2c30048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:22.214982 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 656/1319] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:21 2022] GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103 => generated 1648 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:22.222414 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8fced7f3-4feb-4655-9605-709eff8af722 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:22.223345 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8fced7f3-4feb-4655-9605-709eff8af722 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: b6f02d3d-f6df-419f-9962-58c68a597dcd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:22.225546 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d9b95c7f-8080-468f-8ffb-4fe9bebec9fd tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942" status: 200 len: 1681 microversion: 2.1 time: 0.631400 Oct 05 02:32:22.226134 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 664/1320] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:21 2022] GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942 => generated 1681 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:32:22.230362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8fced7f3-4feb-4655-9605-709eff8af722 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:22.231268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8fced7f3-4feb-4655-9605-709eff8af722 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:22.231773 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8fced7f3-4feb-4655-9605-709eff8af722 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:22.232535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8fced7f3-4feb-4655-9605-709eff8af722 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:22.233229 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8fced7f3-4feb-4655-9605-709eff8af722 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:22.233849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8fced7f3-4feb-4655-9605-709eff8af722 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:22.237778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-36a73b34-a5bb-4526-a1f0-4ad329e055b8 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:22.238395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-36a73b34-a5bb-4526-a1f0-4ad329e055b8 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 34d20b05-afd7-4c5b-8af2-8176e33c041f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:22.248229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36a73b34-a5bb-4526-a1f0-4ad329e055b8 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:22.248732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36a73b34-a5bb-4526-a1f0-4ad329e055b8 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:22.251581 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36a73b34-a5bb-4526-a1f0-4ad329e055b8 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:22.254617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36a73b34-a5bb-4526-a1f0-4ad329e055b8 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:22.255262 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36a73b34-a5bb-4526-a1f0-4ad329e055b8 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:22.255990 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36a73b34-a5bb-4526-a1f0-4ad329e055b8 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:22.545411 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-36a73b34-a5bb-4526-a1f0-4ad329e055b8 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:22.551804 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8fced7f3-4feb-4655-9605-709eff8af722 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:22.553971 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-36a73b34-a5bb-4526-a1f0-4ad329e055b8 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f" status: 200 len: 1469 microversion: 2.1 time: 0.324113 Oct 05 02:32:22.559896 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8fced7f3-4feb-4655-9605-709eff8af722 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/b6f02d3d-f6df-419f-9962-58c68a597dcd" status: 200 len: 1307 microversion: 2.1 time: 0.343218 Oct 05 02:32:22.561329 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 657/1321] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:22 2022] GET /compute/v2.1/servers/b6f02d3d-f6df-419f-9962-58c68a597dcd => generated 1307 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:22.571241 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 665/1322] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:22 2022] GET /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f => generated 1469 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:22.576230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-eeb51158-8e39-44b6-b16f-7d9c4d0a7b4d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:22.577935 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3f2662d0-e433-46b6-8078-023a465dcecc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:22.578878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3f2662d0-e433-46b6-8078-023a465dcecc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:22.585812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f2662d0-e433-46b6-8078-023a465dcecc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:22.586568 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f2662d0-e433-46b6-8078-023a465dcecc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:22.587227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f2662d0-e433-46b6-8078-023a465dcecc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:22.588418 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f2662d0-e433-46b6-8078-023a465dcecc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:22.589202 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f2662d0-e433-46b6-8078-023a465dcecc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:22.589795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-eeb51158-8e39-44b6-b16f-7d9c4d0a7b4d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:22.590379 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f2662d0-e433-46b6-8078-023a465dcecc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:22.599666 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eeb51158-8e39-44b6-b16f-7d9c4d0a7b4d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:22.603641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eeb51158-8e39-44b6-b16f-7d9c4d0a7b4d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:22.604388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eeb51158-8e39-44b6-b16f-7d9c4d0a7b4d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:22.604598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eeb51158-8e39-44b6-b16f-7d9c4d0a7b4d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:22.605272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eeb51158-8e39-44b6-b16f-7d9c4d0a7b4d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:22.605863 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eeb51158-8e39-44b6-b16f-7d9c4d0a7b4d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:22.713383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-eeb51158-8e39-44b6-b16f-7d9c4d0a7b4d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:22.722907 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-eeb51158-8e39-44b6-b16f-7d9c4d0a7b4d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:22.724517 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-eeb51158-8e39-44b6-b16f-7d9c4d0a7b4d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:22.725889 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-eeb51158-8e39-44b6-b16f-7d9c4d0a7b4d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1334 microversion: 2.20 time: 0.153581 Oct 05 02:32:22.726821 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 666/1323] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:22 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1334 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:32:22.748696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3e8ed879-20b6-433c-ac9e-685a5a4d437d tempest-ServersWithSpecificFlavorTestJSON-871223909 tempest-ServersWithSpecificFlavorTestJSON-871223909-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:22.772314 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3e8ed879-20b6-433c-ac9e-685a5a4d437d tempest-ServersWithSpecificFlavorTestJSON-871223909 tempest-ServersWithSpecificFlavorTestJSON-871223909-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/2092938567" status: 202 len: 0 microversion: 2.1 time: 0.027925 Oct 05 02:32:22.777181 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 667/1324] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 5 02:32:22 2022] DELETE /compute/v2.1/flavors/2092938567 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 02:32:22.782556 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-55fea237-eaa2-430c-94d1-cf86d7e65559 tempest-ServersWithSpecificFlavorTestJSON-871223909 tempest-ServersWithSpecificFlavorTestJSON-871223909-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:22.809692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3f2662d0-e433-46b6-8078-023a465dcecc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:22.817300 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-55fea237-eaa2-430c-94d1-cf86d7e65559 tempest-ServersWithSpecificFlavorTestJSON-871223909 tempest-ServersWithSpecificFlavorTestJSON-871223909-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.038478 Oct 05 02:32:22.819626 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3f2662d0-e433-46b6-8078-023a465dcecc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:22.821331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3f2662d0-e433-46b6-8078-023a465dcecc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:22.822711 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3f2662d0-e433-46b6-8078-023a465dcecc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1814 microversion: 2.25 time: 0.260220 Oct 05 02:32:22.823280 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 658/1325] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:22 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1814 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:32:22.829862 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 668/1326] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:32:22 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:22.837784 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e084e577-e779-495a-a28e-e863afb04122 tempest-ServersWithSpecificFlavorTestJSON-871223909 tempest-ServersWithSpecificFlavorTestJSON-871223909-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:22.859753 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e084e577-e779-495a-a28e-e863afb04122 tempest-ServersWithSpecificFlavorTestJSON-871223909 tempest-ServersWithSpecificFlavorTestJSON-871223909-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1706217788" status: 202 len: 0 microversion: 2.1 time: 0.025329 Oct 05 02:32:22.860585 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 659/1327] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 5 02:32:22 2022] DELETE /compute/v2.1/flavors/1706217788 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:32:22.868844 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c7a5d9b1-e04e-402f-a353-0d5d4c874e51 tempest-ServersWithSpecificFlavorTestJSON-871223909 tempest-ServersWithSpecificFlavorTestJSON-871223909-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:22.894612 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c7a5d9b1-e04e-402f-a353-0d5d4c874e51 tempest-ServersWithSpecificFlavorTestJSON-871223909 tempest-ServersWithSpecificFlavorTestJSON-871223909-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029351 Oct 05 02:32:22.902877 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 669/1328] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:32:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:22.919996 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fb0c29b7-ca9a-4119-9d07-57e338fac52a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:22.921074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fb0c29b7-ca9a-4119-9d07-57e338fac52a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 6a205b3a-9fb4-4703-9368-0ab2436d60e5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:22.928952 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb0c29b7-ca9a-4119-9d07-57e338fac52a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:22.929559 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb0c29b7-ca9a-4119-9d07-57e338fac52a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:22.930697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb0c29b7-ca9a-4119-9d07-57e338fac52a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:22.931499 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb0c29b7-ca9a-4119-9d07-57e338fac52a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:22.932128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb0c29b7-ca9a-4119-9d07-57e338fac52a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:22.932633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb0c29b7-ca9a-4119-9d07-57e338fac52a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:22.947776 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-fb0c29b7-ca9a-4119-9d07-57e338fac52a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] HTTP exception thrown: Instance 6a205b3a-9fb4-4703-9368-0ab2436d60e5 could not be found. Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fb0c29b7-ca9a-4119-9d07-57e338fac52a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Request method failure captured: Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5 HTTP/1.1 Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOu1gG38gJNjmxZnNpWZK6Tz2Td3dHF9b7mPeRCkTHzRqaL6Ag4fVmTJ_ZMi4CYPJrsbGLizIHhQMO5q5yGPYWt4Z22NkV9FS1Bxm5sy2SSxEr7LtK34r1ikudmbjdlXscCrHvo39_f5HTpyI7GvZPLFe_JyDqlWRTA_QZ0Pm5GL3h4 Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: fecbac50c16847799a85c148c6c143de Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1767514494 Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fecbac50c16847799a85c148c6c143de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fecbac50c16847799a85c148c6c143de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fecbac50c16847799a85c148c6c143de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fecbac50c16847799a85c148c6c143de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1767514494 Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: fecbac50c16847799a85c148c6c143de Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1767514494 Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1767514494-project Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 368f6c3db9f24561a13f48ce02e7655e Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1767514494-project Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 6a205b3a-9fb4-4703-9368-0ab2436d60e5 could not be found. Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '6a205b3a-9fb4-4703-9368-0ab2436d60e5'} Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a205b3a-9fb4-4703-9368-0ab2436d60e5 could not be found. Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:32:22.949612 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:32:22.957499 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a205b3a-9fb4-4703-9368-0ab2436d60e5 could not be found. Oct 05 02:32:22.957499 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:22.957499 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:22.957499 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:22.957499 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:22.957499 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:22.957499 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:22.957499 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:32:22.957499 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:32:22.957499 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a205b3a-9fb4-4703-9368-0ab2436d60e5 could not be found. Oct 05 02:32:22.957499 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:22.957499 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fb0c29b7-ca9a-4119-9d07-57e338fac52a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Returning 404 to user: Instance 6a205b3a-9fb4-4703-9368-0ab2436d60e5 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:32:22.957499 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fb0c29b7-ca9a-4119-9d07-57e338fac52a tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5" status: 404 len: 111 microversion: 2.1 time: 0.035646 Oct 05 02:32:22.961531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c34f6a5d-cf39-49c5-a32d-33c26c2e484e tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:22.962041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c34f6a5d-cf39-49c5-a32d-33c26c2e484e tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 6a205b3a-9fb4-4703-9368-0ab2436d60e5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:22.968062 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c34f6a5d-cf39-49c5-a32d-33c26c2e484e tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:22.968270 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 660/1329] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:32:22 2022] DELETE /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:32:22.974649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c34f6a5d-cf39-49c5-a32d-33c26c2e484e tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:22.976441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c34f6a5d-cf39-49c5-a32d-33c26c2e484e tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:22.977738 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c34f6a5d-cf39-49c5-a32d-33c26c2e484e tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:22.980180 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c34f6a5d-cf39-49c5-a32d-33c26c2e484e tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:22.981011 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c34f6a5d-cf39-49c5-a32d-33c26c2e484e tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:23.001444 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-c34f6a5d-cf39-49c5-a32d-33c26c2e484e tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] HTTP exception thrown: Instance 6a205b3a-9fb4-4703-9368-0ab2436d60e5 could not be found. Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c34f6a5d-cf39-49c5-a32d-33c26c2e484e tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Request method failure captured: Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5 HTTP/1.1 Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOu1gG38gJNjmxZnNpWZK6Tz2Td3dHF9b7mPeRCkTHzRqaL6Ag4fVmTJ_ZMi4CYPJrsbGLizIHhQMO5q5yGPYWt4Z22NkV9FS1Bxm5sy2SSxEr7LtK34r1ikudmbjdlXscCrHvo39_f5HTpyI7GvZPLFe_JyDqlWRTA_QZ0Pm5GL3h4 Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: fecbac50c16847799a85c148c6c143de Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1767514494 Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fecbac50c16847799a85c148c6c143de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fecbac50c16847799a85c148c6c143de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fecbac50c16847799a85c148c6c143de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fecbac50c16847799a85c148c6c143de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1767514494 Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: fecbac50c16847799a85c148c6c143de Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1767514494 Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1767514494-project Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 368f6c3db9f24561a13f48ce02e7655e Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1767514494-project Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 6a205b3a-9fb4-4703-9368-0ab2436d60e5 could not be found. Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '6a205b3a-9fb4-4703-9368-0ab2436d60e5'} Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a205b3a-9fb4-4703-9368-0ab2436d60e5 could not be found. Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a205b3a-9fb4-4703-9368-0ab2436d60e5 could not be found. Oct 05 02:32:23.003382 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:23.008294 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:23.008294 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:23.008294 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:23.008294 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:23.008294 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:23.008294 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:32:23.008294 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:32:23.008294 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a205b3a-9fb4-4703-9368-0ab2436d60e5 could not be found. Oct 05 02:32:23.008294 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:23.008294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c34f6a5d-cf39-49c5-a32d-33c26c2e484e tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Returning 404 to user: Instance 6a205b3a-9fb4-4703-9368-0ab2436d60e5 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:32:23.010079 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c34f6a5d-cf39-49c5-a32d-33c26c2e484e tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5" status: 404 len: 111 microversion: 2.1 time: 0.052405 Oct 05 02:32:23.011244 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 670/1330] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:22 2022] GET /compute/v2.1/servers/6a205b3a-9fb4-4703-9368-0ab2436d60e5 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:32:23.021617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-411e6597-9854-443c-92fa-e71a64480913 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:23.022112 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-411e6597-9854-443c-92fa-e71a64480913 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 3245900a-6147-427e-86e3-b0af919523e6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:23.028720 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-411e6597-9854-443c-92fa-e71a64480913 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:23.029249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-411e6597-9854-443c-92fa-e71a64480913 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:23.030315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-411e6597-9854-443c-92fa-e71a64480913 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:23.031133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-411e6597-9854-443c-92fa-e71a64480913 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:23.031598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-411e6597-9854-443c-92fa-e71a64480913 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:23.032229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-411e6597-9854-443c-92fa-e71a64480913 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:23.051249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-907def59-273a-45b3-b9fb-3dcf8e2f833d req-bd931b99-4468-4b86-8a98-8ca5e1599240 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6f02d3d-f6df-419f-9962-58c68a597dcd", "name": "network-vif-plugged", "status": "completed", "tag": "6923daf2-fc58-4cce-8a01-90bf9aab4f50"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:32:23.053059 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-411e6597-9854-443c-92fa-e71a64480913 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] HTTP exception thrown: Instance 3245900a-6147-427e-86e3-b0af919523e6 could not be found. Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-411e6597-9854-443c-92fa-e71a64480913 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Request method failure captured: Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6 HTTP/1.1 Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOu1gG38gJNjmxZnNpWZK6Tz2Td3dHF9b7mPeRCkTHzRqaL6Ag4fVmTJ_ZMi4CYPJrsbGLizIHhQMO5q5yGPYWt4Z22NkV9FS1Bxm5sy2SSxEr7LtK34r1ikudmbjdlXscCrHvo39_f5HTpyI7GvZPLFe_JyDqlWRTA_QZ0Pm5GL3h4 Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: fecbac50c16847799a85c148c6c143de Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1767514494 Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fecbac50c16847799a85c148c6c143de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fecbac50c16847799a85c148c6c143de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fecbac50c16847799a85c148c6c143de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fecbac50c16847799a85c148c6c143de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1767514494 Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: fecbac50c16847799a85c148c6c143de Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1767514494 Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1767514494-project Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 368f6c3db9f24561a13f48ce02e7655e Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1767514494-project Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 3245900a-6147-427e-86e3-b0af919523e6 could not be found. Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '3245900a-6147-427e-86e3-b0af919523e6'} Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3245900a-6147-427e-86e3-b0af919523e6 could not be found. Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:32:23.055108 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:32:23.060166 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3245900a-6147-427e-86e3-b0af919523e6 could not be found. Oct 05 02:32:23.060166 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:23.060166 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:23.060166 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:23.060166 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:23.060166 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:23.060166 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:23.060166 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:32:23.060166 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:32:23.060166 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3245900a-6147-427e-86e3-b0af919523e6 could not be found. Oct 05 02:32:23.060166 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:23.060166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-411e6597-9854-443c-92fa-e71a64480913 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Returning 404 to user: Instance 3245900a-6147-427e-86e3-b0af919523e6 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:32:23.061913 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-411e6597-9854-443c-92fa-e71a64480913 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6" status: 404 len: 111 microversion: 2.1 time: 0.042952 Oct 05 02:32:23.062406 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 671/1331] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:32:23 2022] DELETE /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:32:23.066427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-907def59-273a-45b3-b9fb-3dcf8e2f833d req-bd931b99-4468-4b86-8a98-8ca5e1599240 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:23.066998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-907def59-273a-45b3-b9fb-3dcf8e2f833d req-bd931b99-4468-4b86-8a98-8ca5e1599240 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:23.067523 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-907def59-273a-45b3-b9fb-3dcf8e2f833d req-bd931b99-4468-4b86-8a98-8ca5e1599240 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:23.070349 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-58e43882-de57-49a5-bfbe-7be85ee17381 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:23.071154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-58e43882-de57-49a5-bfbe-7be85ee17381 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] [instance: 3245900a-6147-427e-86e3-b0af919523e6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:23.078118 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58e43882-de57-49a5-bfbe-7be85ee17381 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:23.078600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58e43882-de57-49a5-bfbe-7be85ee17381 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:23.079029 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58e43882-de57-49a5-bfbe-7be85ee17381 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:23.079977 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58e43882-de57-49a5-bfbe-7be85ee17381 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:23.080629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58e43882-de57-49a5-bfbe-7be85ee17381 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:23.081087 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58e43882-de57-49a5-bfbe-7be85ee17381 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:23.081539 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-907def59-273a-45b3-b9fb-3dcf8e2f833d req-bd931b99-4468-4b86-8a98-8ca5e1599240 service nova] Creating event network-vif-plugged:6923daf2-fc58-4cce-8a01-90bf9aab4f50 for instance b6f02d3d-f6df-419f-9962-58c68a597dcd on n-h1-858272-3 Oct 05 02:32:23.086698 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-907def59-273a-45b3-b9fb-3dcf8e2f833d req-bd931b99-4468-4b86-8a98-8ca5e1599240 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117065 Oct 05 02:32:23.087681 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 661/1332] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:32:23.096727 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-58e43882-de57-49a5-bfbe-7be85ee17381 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] HTTP exception thrown: Instance 3245900a-6147-427e-86e3-b0af919523e6 could not be found. Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-58e43882-de57-49a5-bfbe-7be85ee17381 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Request method failure captured: Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6 HTTP/1.1 Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOu1gG38gJNjmxZnNpWZK6Tz2Td3dHF9b7mPeRCkTHzRqaL6Ag4fVmTJ_ZMi4CYPJrsbGLizIHhQMO5q5yGPYWt4Z22NkV9FS1Bxm5sy2SSxEr7LtK34r1ikudmbjdlXscCrHvo39_f5HTpyI7GvZPLFe_JyDqlWRTA_QZ0Pm5GL3h4 Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: fecbac50c16847799a85c148c6c143de Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1767514494 Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fecbac50c16847799a85c148c6c143de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fecbac50c16847799a85c148c6c143de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fecbac50c16847799a85c148c6c143de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fecbac50c16847799a85c148c6c143de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1767514494 Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: fecbac50c16847799a85c148c6c143de Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1767514494 Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1767514494-project Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 368f6c3db9f24561a13f48ce02e7655e Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1767514494-project Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 3245900a-6147-427e-86e3-b0af919523e6 could not be found. Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '3245900a-6147-427e-86e3-b0af919523e6'} Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3245900a-6147-427e-86e3-b0af919523e6 could not be found. Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3245900a-6147-427e-86e3-b0af919523e6 could not be found. Oct 05 02:32:23.098324 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:23.106461 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:23.106461 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:23.106461 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:23.106461 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:23.106461 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:23.106461 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:32:23.106461 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:32:23.106461 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3245900a-6147-427e-86e3-b0af919523e6 could not be found. Oct 05 02:32:23.106461 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:23.106461 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-58e43882-de57-49a5-bfbe-7be85ee17381 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] Returning 404 to user: Instance 3245900a-6147-427e-86e3-b0af919523e6 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:32:23.106461 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-58e43882-de57-49a5-bfbe-7be85ee17381 tempest-ServersWithSpecificFlavorTestJSON-1767514494 tempest-ServersWithSpecificFlavorTestJSON-1767514494-project] 10.222.0.16 "GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6" status: 404 len: 111 microversion: 2.1 time: 0.033670 Oct 05 02:32:23.106461 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 672/1333] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:23 2022] GET /compute/v2.1/servers/3245900a-6147-427e-86e3-b0af919523e6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:32:23.231797 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2c97af69-d5e4-4494-9d8f-e77ed237d272 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:23.232416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2c97af69-d5e4-4494-9d8f-e77ed237d272 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: a9c9522c-a640-49f4-9cb9-0dcf19eea103] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:23.241183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c97af69-d5e4-4494-9d8f-e77ed237d272 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:23.241730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c97af69-d5e4-4494-9d8f-e77ed237d272 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:23.242270 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c97af69-d5e4-4494-9d8f-e77ed237d272 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:23.243011 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c97af69-d5e4-4494-9d8f-e77ed237d272 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:23.243718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c97af69-d5e4-4494-9d8f-e77ed237d272 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:23.244056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c97af69-d5e4-4494-9d8f-e77ed237d272 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:23.255834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-129865a1-1109-4d7e-ba4c-2fb099e0da32 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:23.256854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-129865a1-1109-4d7e-ba4c-2fb099e0da32 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] [instance: aaa20a8a-8a7b-42dd-9b4e-9165fba82942] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:23.264571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-129865a1-1109-4d7e-ba4c-2fb099e0da32 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:23.265245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-129865a1-1109-4d7e-ba4c-2fb099e0da32 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:23.265778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-129865a1-1109-4d7e-ba4c-2fb099e0da32 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:23.266593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-129865a1-1109-4d7e-ba4c-2fb099e0da32 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:23.267168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-129865a1-1109-4d7e-ba4c-2fb099e0da32 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:23.267804 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-129865a1-1109-4d7e-ba4c-2fb099e0da32 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:23.386507 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-129865a1-1109-4d7e-ba4c-2fb099e0da32 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f914ca523057422f88748746ba18b525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '407895b8d4e94b74a2cb652eb2c30048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:23.401250 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-129865a1-1109-4d7e-ba4c-2fb099e0da32 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942" status: 200 len: 1613 microversion: 2.1 time: 0.151931 Oct 05 02:32:23.405015 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 673/1334] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:23 2022] GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942 => generated 1613 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:32:23.464358 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-b55ded7c-602c-48b2-a55b-abce46b4863e req-1196498a-915b-40b2-a047-3dd426443a39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa20a8a-8a7b-42dd-9b4e-9165fba82942", "name": "network-vif-deleted", "tag": "a4ccf2aa-c3c8-483d-b7c6-24391c11f3bc"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:32:23.476315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b55ded7c-602c-48b2-a55b-abce46b4863e req-1196498a-915b-40b2-a047-3dd426443a39 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:23.477595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b55ded7c-602c-48b2-a55b-abce46b4863e req-1196498a-915b-40b2-a047-3dd426443a39 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:23.478107 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b55ded7c-602c-48b2-a55b-abce46b4863e req-1196498a-915b-40b2-a047-3dd426443a39 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:23.492237 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-b55ded7c-602c-48b2-a55b-abce46b4863e req-1196498a-915b-40b2-a047-3dd426443a39 service nova] Creating event network-vif-deleted:a4ccf2aa-c3c8-483d-b7c6-24391c11f3bc for instance aaa20a8a-8a7b-42dd-9b4e-9165fba82942 on n-h1-858272-3 Oct 05 02:32:23.497781 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-b55ded7c-602c-48b2-a55b-abce46b4863e req-1196498a-915b-40b2-a047-3dd426443a39 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038524 Oct 05 02:32:23.499504 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 674/1335] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:32:23.576847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2c97af69-d5e4-4494-9d8f-e77ed237d272 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:23.583331 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f7df753b-103d-4ef6-bc89-4434bea5ea65 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:23.584338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f7df753b-103d-4ef6-bc89-4434bea5ea65 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 34d20b05-afd7-4c5b-8af2-8176e33c041f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:23.594005 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2c97af69-d5e4-4494-9d8f-e77ed237d272 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103" status: 200 len: 1648 microversion: 2.1 time: 0.361862 Oct 05 02:32:23.594739 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7df753b-103d-4ef6-bc89-4434bea5ea65 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:23.597572 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7df753b-103d-4ef6-bc89-4434bea5ea65 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:23.598209 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7df753b-103d-4ef6-bc89-4434bea5ea65 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:23.599954 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7df753b-103d-4ef6-bc89-4434bea5ea65 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:23.601179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7df753b-103d-4ef6-bc89-4434bea5ea65 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:23.602198 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7df753b-103d-4ef6-bc89-4434bea5ea65 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:23.609457 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 662/1336] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:23 2022] GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103 => generated 1648 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:23.619783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-04e4e6eb-680a-49b6-97bf-915bd564e1b2 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:23.625083 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-04e4e6eb-680a-49b6-97bf-915bd564e1b2 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: b6f02d3d-f6df-419f-9962-58c68a597dcd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:23.636220 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04e4e6eb-680a-49b6-97bf-915bd564e1b2 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:23.637008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04e4e6eb-680a-49b6-97bf-915bd564e1b2 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:23.637610 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04e4e6eb-680a-49b6-97bf-915bd564e1b2 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:23.638472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04e4e6eb-680a-49b6-97bf-915bd564e1b2 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:23.639728 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04e4e6eb-680a-49b6-97bf-915bd564e1b2 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:23.641186 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04e4e6eb-680a-49b6-97bf-915bd564e1b2 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:23.928847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f7df753b-103d-4ef6-bc89-4434bea5ea65 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:23.938625 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f7df753b-103d-4ef6-bc89-4434bea5ea65 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f" status: 200 len: 1469 microversion: 2.1 time: 0.363488 Oct 05 02:32:23.940201 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 675/1337] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:23 2022] GET /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f => generated 1469 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:23.948868 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-aaa9a348-4971-440f-993f-ff90264daa8d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:23.949683 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-aaa9a348-4971-440f-993f-ff90264daa8d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:23.959932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aaa9a348-4971-440f-993f-ff90264daa8d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:23.960531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aaa9a348-4971-440f-993f-ff90264daa8d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:23.961041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aaa9a348-4971-440f-993f-ff90264daa8d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:23.961745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aaa9a348-4971-440f-993f-ff90264daa8d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:23.962448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aaa9a348-4971-440f-993f-ff90264daa8d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:23.962868 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aaa9a348-4971-440f-993f-ff90264daa8d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:24.015393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-04e4e6eb-680a-49b6-97bf-915bd564e1b2 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:24.023139 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-04e4e6eb-680a-49b6-97bf-915bd564e1b2 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/b6f02d3d-f6df-419f-9962-58c68a597dcd" status: 200 len: 1307 microversion: 2.1 time: 0.412336 Oct 05 02:32:24.023713 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 663/1338] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:23 2022] GET /compute/v2.1/servers/b6f02d3d-f6df-419f-9962-58c68a597dcd => generated 1307 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:24.038267 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-027f9be9-e63e-491f-9aa9-dec25e134629 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:24.039287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-027f9be9-e63e-491f-9aa9-dec25e134629 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:24.048397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-027f9be9-e63e-491f-9aa9-dec25e134629 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:24.049230 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-027f9be9-e63e-491f-9aa9-dec25e134629 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:24.057939 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-027f9be9-e63e-491f-9aa9-dec25e134629 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:24.058778 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-027f9be9-e63e-491f-9aa9-dec25e134629 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:24.059298 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-027f9be9-e63e-491f-9aa9-dec25e134629 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:24.059737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-027f9be9-e63e-491f-9aa9-dec25e134629 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:24.106377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-aaa9a348-4971-440f-993f-ff90264daa8d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:24.116348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-aaa9a348-4971-440f-993f-ff90264daa8d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:24.117851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-aaa9a348-4971-440f-993f-ff90264daa8d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:24.119014 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-aaa9a348-4971-440f-993f-ff90264daa8d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1334 microversion: 2.20 time: 0.177688 Oct 05 02:32:24.125788 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 676/1339] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:23 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1334 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:32:24.309277 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-027f9be9-e63e-491f-9aa9-dec25e134629 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:24.320096 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-027f9be9-e63e-491f-9aa9-dec25e134629 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:24.321638 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-027f9be9-e63e-491f-9aa9-dec25e134629 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:24.323013 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-027f9be9-e63e-491f-9aa9-dec25e134629 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1814 microversion: 2.25 time: 0.298189 Oct 05 02:32:24.323578 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 664/1340] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:24 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1814 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:32:24.431435 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0f203bb2-2c78-4a4c-a498-b3beab830a2c tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:24.432357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0f203bb2-2c78-4a4c-a498-b3beab830a2c tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] [instance: aaa20a8a-8a7b-42dd-9b4e-9165fba82942] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:24.439714 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0f203bb2-2c78-4a4c-a498-b3beab830a2c tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:24.440517 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0f203bb2-2c78-4a4c-a498-b3beab830a2c tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:24.441245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0f203bb2-2c78-4a4c-a498-b3beab830a2c tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:24.442167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0f203bb2-2c78-4a4c-a498-b3beab830a2c tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:24.442698 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0f203bb2-2c78-4a4c-a498-b3beab830a2c tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:24.443202 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0f203bb2-2c78-4a4c-a498-b3beab830a2c tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:24.550844 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0f203bb2-2c78-4a4c-a498-b3beab830a2c tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f914ca523057422f88748746ba18b525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '407895b8d4e94b74a2cb652eb2c30048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:24.559257 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0f203bb2-2c78-4a4c-a498-b3beab830a2c tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942" status: 200 len: 1325 microversion: 2.1 time: 0.131710 Oct 05 02:32:24.560061 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 677/1341] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:24 2022] GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942 => generated 1325 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:24.621806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b730531d-7ada-44d2-9ede-d100c46da5a7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:24.622769 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b730531d-7ada-44d2-9ede-d100c46da5a7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: a9c9522c-a640-49f4-9cb9-0dcf19eea103] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:24.630690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b730531d-7ada-44d2-9ede-d100c46da5a7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:24.631256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b730531d-7ada-44d2-9ede-d100c46da5a7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:24.631698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b730531d-7ada-44d2-9ede-d100c46da5a7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:24.632468 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b730531d-7ada-44d2-9ede-d100c46da5a7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:24.632942 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b730531d-7ada-44d2-9ede-d100c46da5a7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:24.633410 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b730531d-7ada-44d2-9ede-d100c46da5a7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:24.965419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-16a093ab-7fee-48b7-829b-e3f2aac31a38 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:24.966882 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-16a093ab-7fee-48b7-829b-e3f2aac31a38 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 34d20b05-afd7-4c5b-8af2-8176e33c041f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:24.972451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=10 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:24.977307 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-16a093ab-7fee-48b7-829b-e3f2aac31a38 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:24.977926 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-16a093ab-7fee-48b7-829b-e3f2aac31a38 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:24.979352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-16a093ab-7fee-48b7-829b-e3f2aac31a38 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:24.980343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-16a093ab-7fee-48b7-829b-e3f2aac31a38 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:24.981014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-16a093ab-7fee-48b7-829b-e3f2aac31a38 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:24.981538 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-16a093ab-7fee-48b7-829b-e3f2aac31a38 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:25.389696 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b730531d-7ada-44d2-9ede-d100c46da5a7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:25.410207 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b730531d-7ada-44d2-9ede-d100c46da5a7 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103" status: 200 len: 1648 microversion: 2.1 time: 0.786097 Oct 05 02:32:25.410892 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 665/1342] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:24 2022] GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103 => generated 1648 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:25.415988 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-91084193-307f-4ca9-892e-fea2507b554d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:25.421855 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-91084193-307f-4ca9-892e-fea2507b554d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: b6f02d3d-f6df-419f-9962-58c68a597dcd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:25.429438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91084193-307f-4ca9-892e-fea2507b554d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:25.429934 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91084193-307f-4ca9-892e-fea2507b554d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:25.430370 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91084193-307f-4ca9-892e-fea2507b554d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:25.431068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91084193-307f-4ca9-892e-fea2507b554d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:25.431520 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91084193-307f-4ca9-892e-fea2507b554d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:25.431941 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91084193-307f-4ca9-892e-fea2507b554d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:26.013175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-16a093ab-7fee-48b7-829b-e3f2aac31a38 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:26.025134 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-16a093ab-7fee-48b7-829b-e3f2aac31a38 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f" status: 200 len: 1469 microversion: 2.1 time: 1.063935 Oct 05 02:32:26.043869 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 678/1343] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:24 2022] GET /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f => generated 1469 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:32:26.072638 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6e930af1-30fb-4571-8b2b-ea273664d5c6 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:26.074143 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6e930af1-30fb-4571-8b2b-ea273664d5c6 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:26.082765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e930af1-30fb-4571-8b2b-ea273664d5c6 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:26.083469 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e930af1-30fb-4571-8b2b-ea273664d5c6 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:26.084400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e930af1-30fb-4571-8b2b-ea273664d5c6 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:26.085652 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e930af1-30fb-4571-8b2b-ea273664d5c6 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:26.086271 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e930af1-30fb-4571-8b2b-ea273664d5c6 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:26.086875 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e930af1-30fb-4571-8b2b-ea273664d5c6 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:26.442234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-91084193-307f-4ca9-892e-fea2507b554d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:26.458039 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-91084193-307f-4ca9-892e-fea2507b554d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/b6f02d3d-f6df-419f-9962-58c68a597dcd" status: 200 len: 1487 microversion: 2.1 time: 1.045771 Oct 05 02:32:26.461801 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 666/1344] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:25 2022] GET /compute/v2.1/servers/b6f02d3d-f6df-419f-9962-58c68a597dcd => generated 1487 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:26.494725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bc892a5e-6ded-41d5-9824-9db67b70e935 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:26.495697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bc892a5e-6ded-41d5-9824-9db67b70e935 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:26.506872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bc892a5e-6ded-41d5-9824-9db67b70e935 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:26.507739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bc892a5e-6ded-41d5-9824-9db67b70e935 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:26.508414 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bc892a5e-6ded-41d5-9824-9db67b70e935 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:26.509394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bc892a5e-6ded-41d5-9824-9db67b70e935 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:26.510079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bc892a5e-6ded-41d5-9824-9db67b70e935 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:26.511232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bc892a5e-6ded-41d5-9824-9db67b70e935 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:26.632013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6e930af1-30fb-4571-8b2b-ea273664d5c6 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:26.641482 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6e930af1-30fb-4571-8b2b-ea273664d5c6 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:26.642940 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6e930af1-30fb-4571-8b2b-ea273664d5c6 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:26.644074 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6e930af1-30fb-4571-8b2b-ea273664d5c6 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1407 microversion: 2.20 time: 0.581657 Oct 05 02:32:26.662395 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 679/1345] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:26 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1407 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:32:26.687440 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-358d47c6-23cb-4de9-adf3-10ba95e15e96 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:26.692864 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-358d47c6-23cb-4de9-adf3-10ba95e15e96 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] [instance: aaa20a8a-8a7b-42dd-9b4e-9165fba82942] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:26.716070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:26.719203 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-358d47c6-23cb-4de9-adf3-10ba95e15e96 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:26.722735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-358d47c6-23cb-4de9-adf3-10ba95e15e96 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:26.726104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-358d47c6-23cb-4de9-adf3-10ba95e15e96 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:26.730652 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-358d47c6-23cb-4de9-adf3-10ba95e15e96 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:26.731817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-358d47c6-23cb-4de9-adf3-10ba95e15e96 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:26.732296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-358d47c6-23cb-4de9-adf3-10ba95e15e96 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:26.776354 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-358d47c6-23cb-4de9-adf3-10ba95e15e96 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] HTTP exception thrown: Instance aaa20a8a-8a7b-42dd-9b4e-9165fba82942 could not be found. Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-358d47c6-23cb-4de9-adf3-10ba95e15e96 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Request method failure captured: Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942 HTTP/1.1 Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOv3710Z2fa3LbABRMXb9SZWIoNtJnCn0a_H3hVhzd8pWvfMpRcQQ96ohp-3RTQ154Q397tOcqjaqh_DF0w9K-YntKYkzX9RHIKJiUrEScU7lu2CvUqJ7GWpWS5UgWGW50pAMj1wJ9thdyLVMQVU5I89x4rKL2i051SToyrn9OKjQkQ Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 407895b8d4e94b74a2cb652eb2c30048 Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1640965695 Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/407895b8d4e94b74a2cb652eb2c30048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/407895b8d4e94b74a2cb652eb2c30048"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/407895b8d4e94b74a2cb652eb2c30048"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_407895b8d4e94b74a2cb652eb2c30048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1640965695 Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 407895b8d4e94b74a2cb652eb2c30048 Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1640965695 Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-AttachSCSIVolumeTestJSON-1640965695-project Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: f914ca523057422f88748746ba18b525 Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1640965695-project Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance aaa20a8a-8a7b-42dd-9b4e-9165fba82942 could not be found. Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'aaa20a8a-8a7b-42dd-9b4e-9165fba82942'} Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaa20a8a-8a7b-42dd-9b4e-9165fba82942 could not be found. Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaa20a8a-8a7b-42dd-9b4e-9165fba82942 could not be found. Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:26.780029 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:26.784701 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:26.784701 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:26.784701 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:26.784701 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:32:26.784701 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:32:26.784701 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaa20a8a-8a7b-42dd-9b4e-9165fba82942 could not be found. Oct 05 02:32:26.784701 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:26.787108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-358d47c6-23cb-4de9-adf3-10ba95e15e96 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Returning 404 to user: Instance aaa20a8a-8a7b-42dd-9b4e-9165fba82942 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:32:26.788491 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-358d47c6-23cb-4de9-adf3-10ba95e15e96 tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942" status: 404 len: 111 microversion: 2.1 time: 0.124378 Oct 05 02:32:26.793458 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 680/1346] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:26 2022] GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:32:26.800700 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-be3135c0-f018-412b-a8da-c86f2ab85915 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:26.802956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-be3135c0-f018-412b-a8da-c86f2ab85915 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: a9c9522c-a640-49f4-9cb9-0dcf19eea103] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:26.811334 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be3135c0-f018-412b-a8da-c86f2ab85915 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:26.812680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be3135c0-f018-412b-a8da-c86f2ab85915 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:26.813269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be3135c0-f018-412b-a8da-c86f2ab85915 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:26.814102 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be3135c0-f018-412b-a8da-c86f2ab85915 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:26.814660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be3135c0-f018-412b-a8da-c86f2ab85915 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:26.815181 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be3135c0-f018-412b-a8da-c86f2ab85915 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:26.992256 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-be3135c0-f018-412b-a8da-c86f2ab85915 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:27.011771 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-be3135c0-f018-412b-a8da-c86f2ab85915 tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103" status: 200 len: 1468 microversion: 2.1 time: 0.217003 Oct 05 02:32:27.012529 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 681/1347] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:26 2022] GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103 => generated 1468 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:27.018752 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-18df6767-b497-4b02-864d-85a52e944791 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:32:27.020130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-18df6767-b497-4b02-864d-85a52e944791 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: b6f02d3d-f6df-419f-9962-58c68a597dcd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:27.029077 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-18df6767-b497-4b02-864d-85a52e944791 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:27.030022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-18df6767-b497-4b02-864d-85a52e944791 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:27.030569 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-18df6767-b497-4b02-864d-85a52e944791 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:27.031408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-18df6767-b497-4b02-864d-85a52e944791 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:27.031970 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-18df6767-b497-4b02-864d-85a52e944791 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:27.032502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-18df6767-b497-4b02-864d-85a52e944791 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:27.076283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bc892a5e-6ded-41d5-9824-9db67b70e935 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:27.093143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bc892a5e-6ded-41d5-9824-9db67b70e935 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:27.096946 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bc892a5e-6ded-41d5-9824-9db67b70e935 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:27.098652 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bc892a5e-6ded-41d5-9824-9db67b70e935 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1814 microversion: 2.25 time: 0.607892 Oct 05 02:32:27.104352 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 667/1348] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:26 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1814 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:32:27.115878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dd6aee94-db02-42cb-9373-ddf7309413ea tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Calling method '.version_select at 0x7fcce42a7550>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:27.151784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:27.181954 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dd6aee94-db02-42cb-9373-ddf7309413ea tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-208474523" status: 202 len: 0 microversion: 2.1 time: 0.076240 Oct 05 02:32:27.183725 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 668/1349] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 5 02:32:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-208474523 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:32:27.189363 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-9be70c09-5de7-4971-89d6-cc08364b3cb3 req-d5820341-ce14-4e59-8893-00c9fc4bcae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34d20b05-afd7-4c5b-8af2-8176e33c041f", "name": "network-vif-deleted", "tag": "b656d7a8-ccd2-4692-8b27-890477164d2a"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:32:27.202558 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-18df6767-b497-4b02-864d-85a52e944791 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "POST /compute/v2.1/servers/b6f02d3d-f6df-419f-9962-58c68a597dcd/action" status: 202 len: 0 microversion: 2.1 time: 0.187260 Oct 05 02:32:27.207993 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 682/1350] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:32:27 2022] POST /compute/v2.1/servers/b6f02d3d-f6df-419f-9962-58c68a597dcd/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:32:27.214644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8ef5d361-d2c8-405e-8861-bcc59d3fcb11 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:27.215647 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8ef5d361-d2c8-405e-8861-bcc59d3fcb11 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 34d20b05-afd7-4c5b-8af2-8176e33c041f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:27.220028 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-9be70c09-5de7-4971-89d6-cc08364b3cb3 req-d5820341-ce14-4e59-8893-00c9fc4bcae5 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:27.220661 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-9be70c09-5de7-4971-89d6-cc08364b3cb3 req-d5820341-ce14-4e59-8893-00c9fc4bcae5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:27.221138 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-9be70c09-5de7-4971-89d6-cc08364b3cb3 req-d5820341-ce14-4e59-8893-00c9fc4bcae5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:27.225067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ef5d361-d2c8-405e-8861-bcc59d3fcb11 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:27.225896 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ef5d361-d2c8-405e-8861-bcc59d3fcb11 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:27.226554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ef5d361-d2c8-405e-8861-bcc59d3fcb11 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:27.227801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ef5d361-d2c8-405e-8861-bcc59d3fcb11 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:27.228514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ef5d361-d2c8-405e-8861-bcc59d3fcb11 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:27.229318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ef5d361-d2c8-405e-8861-bcc59d3fcb11 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:27.246120 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-9be70c09-5de7-4971-89d6-cc08364b3cb3 req-d5820341-ce14-4e59-8893-00c9fc4bcae5 service nova] Creating event network-vif-deleted:b656d7a8-ccd2-4692-8b27-890477164d2a for instance 34d20b05-afd7-4c5b-8af2-8176e33c041f on n-h2-858272-3 Oct 05 02:32:27.257691 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-9be70c09-5de7-4971-89d6-cc08364b3cb3 req-d5820341-ce14-4e59-8893-00c9fc4bcae5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072423 Oct 05 02:32:27.262194 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 669/1351] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:32:27.277586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c569ce20-315e-4ae2-88af-caa6de341da1 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:27.281518 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c569ce20-315e-4ae2-88af-caa6de341da1 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: b6f02d3d-f6df-419f-9962-58c68a597dcd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:27.285568 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ef5d361-d2c8-405e-8861-bcc59d3fcb11 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:27.286493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ef5d361-d2c8-405e-8861-bcc59d3fcb11 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:27.288156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ef5d361-d2c8-405e-8861-bcc59d3fcb11 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:27.291723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-8ef5d361-d2c8-405e-8861-bcc59d3fcb11 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lazy-loading 'fault' on Instance uuid 34d20b05-afd7-4c5b-8af2-8176e33c041f {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:32:27.298848 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c569ce20-315e-4ae2-88af-caa6de341da1 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:27.302475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c569ce20-315e-4ae2-88af-caa6de341da1 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:27.303129 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c569ce20-315e-4ae2-88af-caa6de341da1 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:27.306232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c569ce20-315e-4ae2-88af-caa6de341da1 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:27.306898 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c569ce20-315e-4ae2-88af-caa6de341da1 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:27.307526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c569ce20-315e-4ae2-88af-caa6de341da1 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:27.437947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8ef5d361-d2c8-405e-8861-bcc59d3fcb11 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:27.458210 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8ef5d361-d2c8-405e-8861-bcc59d3fcb11 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f" status: 200 len: 1303 microversion: 2.1 time: 0.247074 Oct 05 02:32:27.462313 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 683/1352] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:27 2022] GET /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f => generated 1303 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:27.696861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3e8a1dde-1242-4d78-8849-8fcf0699c15f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:27.698893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3e8a1dde-1242-4d78-8849-8fcf0699c15f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:27.711067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e8a1dde-1242-4d78-8849-8fcf0699c15f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:27.711686 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e8a1dde-1242-4d78-8849-8fcf0699c15f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:27.712505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e8a1dde-1242-4d78-8849-8fcf0699c15f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:27.713607 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e8a1dde-1242-4d78-8849-8fcf0699c15f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:27.714422 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e8a1dde-1242-4d78-8849-8fcf0699c15f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:27.715124 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e8a1dde-1242-4d78-8849-8fcf0699c15f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:27.764073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c569ce20-315e-4ae2-88af-caa6de341da1 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:27.777467 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c569ce20-315e-4ae2-88af-caa6de341da1 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/b6f02d3d-f6df-419f-9962-58c68a597dcd" status: 200 len: 1492 microversion: 2.1 time: 0.510430 Oct 05 02:32:27.778751 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 670/1353] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:27 2022] GET /compute/v2.1/servers/b6f02d3d-f6df-419f-9962-58c68a597dcd => generated 1492 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:28.031989 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3e8a1dde-1242-4d78-8849-8fcf0699c15f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:28.038488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-479f6c43-81fd-4a7f-b48d-471e3369d71e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:28.039126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-479f6c43-81fd-4a7f-b48d-471e3369d71e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: a9c9522c-a640-49f4-9cb9-0dcf19eea103] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:28.052870 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-479f6c43-81fd-4a7f-b48d-471e3369d71e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:28.053557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-479f6c43-81fd-4a7f-b48d-471e3369d71e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:28.055222 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-479f6c43-81fd-4a7f-b48d-471e3369d71e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:28.055999 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-479f6c43-81fd-4a7f-b48d-471e3369d71e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:28.058972 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3e8a1dde-1242-4d78-8849-8fcf0699c15f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:28.061987 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-479f6c43-81fd-4a7f-b48d-471e3369d71e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:28.062551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-479f6c43-81fd-4a7f-b48d-471e3369d71e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:28.065095 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3e8a1dde-1242-4d78-8849-8fcf0699c15f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:28.069781 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3e8a1dde-1242-4d78-8849-8fcf0699c15f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1407 microversion: 2.20 time: 0.384341 Oct 05 02:32:28.071494 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 684/1354] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:27 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1407 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:32:28.103114 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-f58933bd-1a07-444f-9853-ae8b778b6be4 req-b394205d-1eea-4c09-a659-8865b4d6392e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a28c6ea-5b3d-4f74-b490-8effa4fa813d", "tag": "9902bd06-5ff4-4749-a5aa-d4afd71ba732"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:32:28.125448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f58933bd-1a07-444f-9853-ae8b778b6be4 req-b394205d-1eea-4c09-a659-8865b4d6392e service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:28.126027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f58933bd-1a07-444f-9853-ae8b778b6be4 req-b394205d-1eea-4c09-a659-8865b4d6392e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:28.126527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f58933bd-1a07-444f-9853-ae8b778b6be4 req-b394205d-1eea-4c09-a659-8865b4d6392e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:28.139861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-479f6c43-81fd-4a7f-b48d-471e3369d71e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:28.140364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-479f6c43-81fd-4a7f-b48d-471e3369d71e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:28.140812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-479f6c43-81fd-4a7f-b48d-471e3369d71e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:28.141138 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-f58933bd-1a07-444f-9853-ae8b778b6be4 req-b394205d-1eea-4c09-a659-8865b4d6392e service nova] Creating event network-changed:9902bd06-5ff4-4749-a5aa-d4afd71ba732 for instance 7a28c6ea-5b3d-4f74-b490-8effa4fa813d on n-h2-858272-3 Oct 05 02:32:28.141287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-479f6c43-81fd-4a7f-b48d-471e3369d71e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lazy-loading 'fault' on Instance uuid a9c9522c-a640-49f4-9cb9-0dcf19eea103 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:32:28.148888 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-f58933bd-1a07-444f-9853-ae8b778b6be4 req-b394205d-1eea-4c09-a659-8865b4d6392e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049371 Oct 05 02:32:28.150439 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 685/1355] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:32:28.156735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2ee816f9-ce2b-4b98-8be4-2a4481c9b89d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:28.158617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2ee816f9-ce2b-4b98-8be4-2a4481c9b89d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:28.168246 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ee816f9-ce2b-4b98-8be4-2a4481c9b89d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:28.169014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ee816f9-ce2b-4b98-8be4-2a4481c9b89d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:28.169687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ee816f9-ce2b-4b98-8be4-2a4481c9b89d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:28.171343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ee816f9-ce2b-4b98-8be4-2a4481c9b89d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:28.184344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ee816f9-ce2b-4b98-8be4-2a4481c9b89d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:28.184973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ee816f9-ce2b-4b98-8be4-2a4481c9b89d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:28.354910 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-479f6c43-81fd-4a7f-b48d-471e3369d71e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9925b3a9a63c4b1cb98a8adcc28f916d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96108fae56640b6aa0cb68523504c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:28.365276 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-479f6c43-81fd-4a7f-b48d-471e3369d71e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103" status: 200 len: 1306 microversion: 2.1 time: 0.331741 Oct 05 02:32:28.366327 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 671/1356] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:28 2022] GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103 => generated 1306 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:28.490101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-511423f7-a5cf-410d-9fbd-eded30278681 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:28.491383 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-511423f7-a5cf-410d-9fbd-eded30278681 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 34d20b05-afd7-4c5b-8af2-8176e33c041f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:28.497841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-511423f7-a5cf-410d-9fbd-eded30278681 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:28.498730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-511423f7-a5cf-410d-9fbd-eded30278681 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:28.499639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-511423f7-a5cf-410d-9fbd-eded30278681 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:28.500258 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-511423f7-a5cf-410d-9fbd-eded30278681 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:28.500793 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-511423f7-a5cf-410d-9fbd-eded30278681 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:28.510185 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-511423f7-a5cf-410d-9fbd-eded30278681 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:28.528998 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-511423f7-a5cf-410d-9fbd-eded30278681 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] HTTP exception thrown: Instance 34d20b05-afd7-4c5b-8af2-8176e33c041f could not be found. Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-511423f7-a5cf-410d-9fbd-eded30278681 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Request method failure captured: Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f HTTP/1.1 Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOwfduJV9tCP52TzWOgOCVFWO3Jj6aty29-CPOgH5G0_Bnucj7xWks_4AKLcWyxnTAFBGDhqPWXPDzPrNGllL9XXqFNhGlbELfZRXdf0_3EI-4W3n4H6Mlwsa8W9-IDF08P19v24Z7VTSsSr7RZy9WGfeIBEqo2tzACp0Hab7tj7V6o Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c6918daa4f884786b45bc88dd1e4e94a Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersAdminTestJSON-1905021104 Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c6918daa4f884786b45bc88dd1e4e94a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c6918daa4f884786b45bc88dd1e4e94a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c6918daa4f884786b45bc88dd1e4e94a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c6918daa4f884786b45bc88dd1e4e94a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersAdminTestJSON-1905021104 Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c6918daa4f884786b45bc88dd1e4e94a Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersAdminTestJSON-1905021104 Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersAdminTestJSON-1905021104-project Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: c73227214e404f4db779694b8c11779e Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersAdminTestJSON-1905021104-project Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 34d20b05-afd7-4c5b-8af2-8176e33c041f could not be found. Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '34d20b05-afd7-4c5b-8af2-8176e33c041f'} Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34d20b05-afd7-4c5b-8af2-8176e33c041f could not be found. Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34d20b05-afd7-4c5b-8af2-8176e33c041f could not be found. Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:28.536980 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:28.542481 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:28.542481 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:28.542481 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:28.542481 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:32:28.542481 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:32:28.542481 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34d20b05-afd7-4c5b-8af2-8176e33c041f could not be found. Oct 05 02:32:28.542481 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:28.544101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-511423f7-a5cf-410d-9fbd-eded30278681 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Returning 404 to user: Instance 34d20b05-afd7-4c5b-8af2-8176e33c041f could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:32:28.545693 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-511423f7-a5cf-410d-9fbd-eded30278681 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f" status: 404 len: 111 microversion: 2.1 time: 0.059713 Oct 05 02:32:28.550888 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 672/1357] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:28 2022] GET /compute/v2.1/servers/34d20b05-afd7-4c5b-8af2-8176e33c041f => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:32:28.556131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a7c98437-61b5-4252-9048-7ff462164946 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:28.556624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a7c98437-61b5-4252-9048-7ff462164946 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:28.567459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2ee816f9-ce2b-4b98-8be4-2a4481c9b89d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:28.571000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7c98437-61b5-4252-9048-7ff462164946 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:28.571680 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7c98437-61b5-4252-9048-7ff462164946 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:28.572394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7c98437-61b5-4252-9048-7ff462164946 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:28.573161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7c98437-61b5-4252-9048-7ff462164946 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:28.573624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7c98437-61b5-4252-9048-7ff462164946 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:28.574338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7c98437-61b5-4252-9048-7ff462164946 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:28.585744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2ee816f9-ce2b-4b98-8be4-2a4481c9b89d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:28.587582 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2ee816f9-ce2b-4b98-8be4-2a4481c9b89d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:28.590045 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2ee816f9-ce2b-4b98-8be4-2a4481c9b89d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1814 microversion: 2.25 time: 0.437535 Oct 05 02:32:28.591193 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 686/1358] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:28 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1814 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:32:28.629346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a7c98437-61b5-4252-9048-7ff462164946 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:32:28.791499 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a7c98437-61b5-4252-9048-7ff462164946 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "DELETE /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 204 len: 0 microversion: 2.1 time: 0.239125 Oct 05 02:32:28.792405 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 673/1359] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:32:28 2022] DELETE /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:32:28.802542 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f9f4cc7a-d8c6-48eb-8eda-d074485ddf15 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:28.803164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f9f4cc7a-d8c6-48eb-8eda-d074485ddf15 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:28.806692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-186e6541-dc6a-4809-a5c9-d4ade2748927 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:28.807401 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-186e6541-dc6a-4809-a5c9-d4ade2748927 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: b6f02d3d-f6df-419f-9962-58c68a597dcd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:28.811565 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9f4cc7a-d8c6-48eb-8eda-d074485ddf15 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:28.812298 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9f4cc7a-d8c6-48eb-8eda-d074485ddf15 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:28.812742 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9f4cc7a-d8c6-48eb-8eda-d074485ddf15 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:28.813489 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9f4cc7a-d8c6-48eb-8eda-d074485ddf15 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:28.814035 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9f4cc7a-d8c6-48eb-8eda-d074485ddf15 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:28.814471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9f4cc7a-d8c6-48eb-8eda-d074485ddf15 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:28.821714 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-186e6541-dc6a-4809-a5c9-d4ade2748927 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:28.822459 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-186e6541-dc6a-4809-a5c9-d4ade2748927 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:28.823078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-186e6541-dc6a-4809-a5c9-d4ade2748927 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:28.824054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-186e6541-dc6a-4809-a5c9-d4ade2748927 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:28.827404 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-186e6541-dc6a-4809-a5c9-d4ade2748927 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:28.828108 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-186e6541-dc6a-4809-a5c9-d4ade2748927 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:28.861490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:29.241978 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f9f4cc7a-d8c6-48eb-8eda-d074485ddf15 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:29.250515 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f9f4cc7a-d8c6-48eb-8eda-d074485ddf15 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1469 microversion: 2.1 time: 0.452375 Oct 05 02:32:29.251084 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 687/1360] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:28 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1469 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:29.255662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-aa76dcb7-6a89-4224-8356-5bd4baf97f1d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:29.256266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-aa76dcb7-6a89-4224-8356-5bd4baf97f1d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:29.262017 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa76dcb7-6a89-4224-8356-5bd4baf97f1d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:29.263587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa76dcb7-6a89-4224-8356-5bd4baf97f1d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:29.264671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa76dcb7-6a89-4224-8356-5bd4baf97f1d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:29.265507 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa76dcb7-6a89-4224-8356-5bd4baf97f1d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:29.265959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa76dcb7-6a89-4224-8356-5bd4baf97f1d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:29.266370 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa76dcb7-6a89-4224-8356-5bd4baf97f1d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:29.312297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-186e6541-dc6a-4809-a5c9-d4ade2748927 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:29.320394 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-186e6541-dc6a-4809-a5c9-d4ade2748927 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/b6f02d3d-f6df-419f-9962-58c68a597dcd" status: 200 len: 1472 microversion: 2.1 time: 0.519180 Oct 05 02:32:29.320999 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 674/1361] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:28 2022] GET /compute/v2.1/servers/b6f02d3d-f6df-419f-9962-58c68a597dcd => generated 1472 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:32:29.338035 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-cc208f14-3445-4bc6-92ea-87cad75a3889 req-4b9bba82-016d-4337-8983-11281c4a8082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9c9522c-a640-49f4-9cb9-0dcf19eea103", "name": "network-vif-deleted", "tag": "39bdaef6-a403-4edc-8790-c97d27f2a7ca"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:32:29.347982 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-cc208f14-3445-4bc6-92ea-87cad75a3889 req-4b9bba82-016d-4337-8983-11281c4a8082 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:29.348465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-cc208f14-3445-4bc6-92ea-87cad75a3889 req-4b9bba82-016d-4337-8983-11281c4a8082 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:29.349285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-cc208f14-3445-4bc6-92ea-87cad75a3889 req-4b9bba82-016d-4337-8983-11281c4a8082 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:29.361050 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-cc208f14-3445-4bc6-92ea-87cad75a3889 req-4b9bba82-016d-4337-8983-11281c4a8082 service nova] Creating event network-vif-deleted:39bdaef6-a403-4edc-8790-c97d27f2a7ca for instance a9c9522c-a640-49f4-9cb9-0dcf19eea103 on n-h2-858272-3 Oct 05 02:32:29.365826 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-cc208f14-3445-4bc6-92ea-87cad75a3889 req-4b9bba82-016d-4337-8983-11281c4a8082 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031595 Oct 05 02:32:29.366421 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 675/1362] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:32:29.371465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2d012bf4-d029-4ea0-8649-00dbd4de64aa tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1743295808"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:32:29.373849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2d012bf4-d029-4ea0-8649-00dbd4de64aa tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: b6f02d3d-f6df-419f-9962-58c68a597dcd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:29.379973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d012bf4-d029-4ea0-8649-00dbd4de64aa tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:29.381207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d012bf4-d029-4ea0-8649-00dbd4de64aa tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:29.381207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d012bf4-d029-4ea0-8649-00dbd4de64aa tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:29.381646 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d012bf4-d029-4ea0-8649-00dbd4de64aa tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:29.382044 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d012bf4-d029-4ea0-8649-00dbd4de64aa tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:29.382528 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d012bf4-d029-4ea0-8649-00dbd4de64aa tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:29.515441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-aa76dcb7-6a89-4224-8356-5bd4baf97f1d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:29.524794 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-aa76dcb7-6a89-4224-8356-5bd4baf97f1d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:29.527884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-aa76dcb7-6a89-4224-8356-5bd4baf97f1d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:29.532632 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-aa76dcb7-6a89-4224-8356-5bd4baf97f1d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1407 microversion: 2.20 time: 0.279635 Oct 05 02:32:29.534845 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 688/1363] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:29 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1407 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:32:29.542127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ce8cc22a-0ed4-4cfd-b573-360f7ecd3f4e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:29.544022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ce8cc22a-0ed4-4cfd-b573-360f7ecd3f4e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] [instance: a9c9522c-a640-49f4-9cb9-0dcf19eea103] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:29.554001 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce8cc22a-0ed4-4cfd-b573-360f7ecd3f4e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:29.554676 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce8cc22a-0ed4-4cfd-b573-360f7ecd3f4e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:29.555107 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce8cc22a-0ed4-4cfd-b573-360f7ecd3f4e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:29.556000 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce8cc22a-0ed4-4cfd-b573-360f7ecd3f4e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:29.556738 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce8cc22a-0ed4-4cfd-b573-360f7ecd3f4e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:29.557378 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce8cc22a-0ed4-4cfd-b573-360f7ecd3f4e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:29.584151 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-ce8cc22a-0ed4-4cfd-b573-360f7ecd3f4e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] HTTP exception thrown: Instance a9c9522c-a640-49f4-9cb9-0dcf19eea103 could not be found. Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ce8cc22a-0ed4-4cfd-b573-360f7ecd3f4e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Request method failure captured: Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103 HTTP/1.1 Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOxsHfqJu7XBSEzDOBBt7syFIrL9J3OT791dcmShV5lM5pjmkDuONYQmP8-v9KquUBaUHsqFGt8nuaScu9b1kWZKpy9EaLULGZXiZUnDwZJ186OmmTbSMTU6SH3NtgLtLUXyXXhUjMZrhdeVS_vfD8uyVuQTvFy3dykhyOfc3uq0Kds Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: c96108fae56640b6aa0cb68523504c43 Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c96108fae56640b6aa0cb68523504c43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c96108fae56640b6aa0cb68523504c43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: c96108fae56640b6aa0cb68523504c43 Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1913947248 Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-SecurityGroupsTestJSON-1913947248-project Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 9925b3a9a63c4b1cb98a8adcc28f916d Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-SecurityGroupsTestJSON-1913947248-project Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance a9c9522c-a640-49f4-9cb9-0dcf19eea103 could not be found. Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'a9c9522c-a640-49f4-9cb9-0dcf19eea103'} Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9c9522c-a640-49f4-9cb9-0dcf19eea103 could not be found. Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9c9522c-a640-49f4-9cb9-0dcf19eea103 could not be found. Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:29.586760 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:29.592469 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:29.592469 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:29.592469 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:29.592469 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:32:29.592469 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:32:29.592469 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9c9522c-a640-49f4-9cb9-0dcf19eea103 could not be found. Oct 05 02:32:29.592469 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:29.592469 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ce8cc22a-0ed4-4cfd-b573-360f7ecd3f4e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Returning 404 to user: Instance a9c9522c-a640-49f4-9cb9-0dcf19eea103 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:32:29.592469 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ce8cc22a-0ed4-4cfd-b573-360f7ecd3f4e tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103" status: 404 len: 111 microversion: 2.1 time: 0.051937 Oct 05 02:32:29.594995 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 689/1364] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:29 2022] GET /compute/v2.1/servers/a9c9522c-a640-49f4-9cb9-0dcf19eea103 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:32:29.600741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d8d9d939-3056-4fd0-b28d-54b15913a4fe tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '.version_select at 0x7fccdfcda8b0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:29.681052 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2d012bf4-d029-4ea0-8649-00dbd4de64aa tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "POST /compute/v2.1/servers/b6f02d3d-f6df-419f-9962-58c68a597dcd/action" status: 202 len: 0 microversion: 2.1 time: 0.311356 Oct 05 02:32:29.689533 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 676/1365] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:32:29 2022] POST /compute/v2.1/servers/b6f02d3d-f6df-419f-9962-58c68a597dcd/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 05 02:32:29.696662 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cbc6a3a7-f80d-4ad9-b1ae-a5c85d888062 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:29.697641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cbc6a3a7-f80d-4ad9-b1ae-a5c85d888062 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:29.706622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbc6a3a7-f80d-4ad9-b1ae-a5c85d888062 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:29.707529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbc6a3a7-f80d-4ad9-b1ae-a5c85d888062 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:29.708328 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbc6a3a7-f80d-4ad9-b1ae-a5c85d888062 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:29.709439 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbc6a3a7-f80d-4ad9-b1ae-a5c85d888062 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:29.710220 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbc6a3a7-f80d-4ad9-b1ae-a5c85d888062 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:29.710891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbc6a3a7-f80d-4ad9-b1ae-a5c85d888062 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:29.800611 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:29.942217 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d8d9d939-3056-4fd0-b28d-54b15913a4fe tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/19520275-b7cd-4132-8539-42a9f18fde42" status: 202 len: 0 microversion: 2.1 time: 0.346479 Oct 05 02:32:29.943672 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 690/1366] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:32:29 2022] DELETE /compute/v2.1/os-security-groups/19520275-b7cd-4132-8539-42a9f18fde42 => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:32:29.950525 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f8806e28-7ae7-4c0a-93f2-74a92297e8ef tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fccdfc5e430>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:29.971856 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cbc6a3a7-f80d-4ad9-b1ae-a5c85d888062 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:29.986577 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cbc6a3a7-f80d-4ad9-b1ae-a5c85d888062 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:30.001540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cbc6a3a7-f80d-4ad9-b1ae-a5c85d888062 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:30.007006 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cbc6a3a7-f80d-4ad9-b1ae-a5c85d888062 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1814 microversion: 2.25 time: 0.314187 Oct 05 02:32:30.009334 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 677/1367] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:29 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1814 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:32:30.028986 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f8806e28-7ae7-4c0a-93f2-74a92297e8ef tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c" status: 200 len: 1414 microversion: 2.1 time: 0.083816 Oct 05 02:32:30.030451 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 691/1368] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:32:29 2022] GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c => generated 1414 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:30.041578 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2f7f22f5-b676-42a3-b249-415f978bf6fa tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] Calling method '.version_select at 0x7fcce4182700>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:30.276376 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-08f7c800-4bf5-420e-826e-6b870fa546fc tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:30.278049 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-08f7c800-4bf5-420e-826e-6b870fa546fc tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:30.292235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08f7c800-4bf5-420e-826e-6b870fa546fc tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:30.293022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08f7c800-4bf5-420e-826e-6b870fa546fc tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:30.293785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08f7c800-4bf5-420e-826e-6b870fa546fc tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:30.294715 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08f7c800-4bf5-420e-826e-6b870fa546fc tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:30.295614 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08f7c800-4bf5-420e-826e-6b870fa546fc tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:30.296331 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08f7c800-4bf5-420e-826e-6b870fa546fc tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:30.326852 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=8 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:30.480273 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2f7f22f5-b676-42a3-b249-415f978bf6fa tempest-SecurityGroupsTestJSON-1913947248 tempest-SecurityGroupsTestJSON-1913947248-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/819f388a-be3f-4126-a3bc-c10860e11269" status: 202 len: 0 microversion: 2.1 time: 0.467636 Oct 05 02:32:30.481423 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 678/1369] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:32:30 2022] DELETE /compute/v2.1/os-security-groups/819f388a-be3f-4126-a3bc-c10860e11269 => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:32:30.567727 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4b185722-d846-495f-b784-77cb7502e550 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:30.568412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4b185722-d846-495f-b784-77cb7502e550 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:30.578336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b185722-d846-495f-b784-77cb7502e550 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:30.578742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b185722-d846-495f-b784-77cb7502e550 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:30.579180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b185722-d846-495f-b784-77cb7502e550 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:30.579898 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b185722-d846-495f-b784-77cb7502e550 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:30.580355 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b185722-d846-495f-b784-77cb7502e550 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:30.580781 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b185722-d846-495f-b784-77cb7502e550 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:30.618199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-08f7c800-4bf5-420e-826e-6b870fa546fc tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:30.627525 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-08f7c800-4bf5-420e-826e-6b870fa546fc tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1469 microversion: 2.1 time: 0.356580 Oct 05 02:32:30.633363 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 692/1370] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:30 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1469 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:31.015702 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4b185722-d846-495f-b784-77cb7502e550 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:31.036578 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-104cead4-a9e3-4d88-94bb-b77bd3a827fc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:31.037342 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-104cead4-a9e3-4d88-94bb-b77bd3a827fc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:31.042214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4b185722-d846-495f-b784-77cb7502e550 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:31.046069 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4b185722-d846-495f-b784-77cb7502e550 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:31.048561 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4b185722-d846-495f-b784-77cb7502e550 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1407 microversion: 2.20 time: 0.484230 Oct 05 02:32:31.049670 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 679/1371] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:30 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1407 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:32:31.069618 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-104cead4-a9e3-4d88-94bb-b77bd3a827fc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:31.070157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-104cead4-a9e3-4d88-94bb-b77bd3a827fc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:31.072670 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-104cead4-a9e3-4d88-94bb-b77bd3a827fc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:31.073455 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-104cead4-a9e3-4d88-94bb-b77bd3a827fc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:31.073925 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-104cead4-a9e3-4d88-94bb-b77bd3a827fc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:31.074353 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-104cead4-a9e3-4d88-94bb-b77bd3a827fc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:31.089188 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3f053967-98f2-43c4-bb76-fc3177b77793 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce4181ca0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:31.154137 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3f053967-98f2-43c4-bb76-fc3177b77793 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c" status: 200 len: 1414 microversion: 2.1 time: 0.103208 Oct 05 02:32:31.154873 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 680/1372] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:32:31 2022] GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c => generated 1414 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:31.656863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-35b48f76-b47d-4d97-9240-71d08c48f24b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:31.657857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-35b48f76-b47d-4d97-9240-71d08c48f24b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:31.672426 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-35b48f76-b47d-4d97-9240-71d08c48f24b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:31.673469 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-35b48f76-b47d-4d97-9240-71d08c48f24b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:31.681561 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-35b48f76-b47d-4d97-9240-71d08c48f24b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:31.682561 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-35b48f76-b47d-4d97-9240-71d08c48f24b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:31.687661 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-35b48f76-b47d-4d97-9240-71d08c48f24b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:31.688457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-35b48f76-b47d-4d97-9240-71d08c48f24b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:31.750213 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-104cead4-a9e3-4d88-94bb-b77bd3a827fc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:31.762680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-104cead4-a9e3-4d88-94bb-b77bd3a827fc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:31.766904 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-104cead4-a9e3-4d88-94bb-b77bd3a827fc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:31.773632 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-104cead4-a9e3-4d88-94bb-b77bd3a827fc tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1814 microversion: 2.25 time: 0.741746 Oct 05 02:32:31.774733 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 693/1373] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:31 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1814 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:32:32.056056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-35b48f76-b47d-4d97-9240-71d08c48f24b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:32.064763 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-35b48f76-b47d-4d97-9240-71d08c48f24b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1469 microversion: 2.1 time: 0.412999 Oct 05 02:32:32.086346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6732fc8c-16b5-4018-80fa-95251c253035 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:32.094291 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6732fc8c-16b5-4018-80fa-95251c253035 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:32.103010 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 681/1374] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:31 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1469 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:32.109345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6732fc8c-16b5-4018-80fa-95251c253035 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:32.110096 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6732fc8c-16b5-4018-80fa-95251c253035 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:32.110769 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6732fc8c-16b5-4018-80fa-95251c253035 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:32.111693 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6732fc8c-16b5-4018-80fa-95251c253035 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:32.112376 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6732fc8c-16b5-4018-80fa-95251c253035 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:32.113042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6732fc8c-16b5-4018-80fa-95251c253035 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:32.173120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-34e11a52-c433-42b1-8151-b460b9eb6b01 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce4766790>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:32.240243 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-34e11a52-c433-42b1-8151-b460b9eb6b01 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c" status: 200 len: 1414 microversion: 2.1 time: 0.072951 Oct 05 02:32:32.249343 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 682/1375] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:32:32 2022] GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c => generated 1414 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:32.334588 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6732fc8c-16b5-4018-80fa-95251c253035 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:32.346712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6732fc8c-16b5-4018-80fa-95251c253035 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:32.348270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6732fc8c-16b5-4018-80fa-95251c253035 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:32.349514 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6732fc8c-16b5-4018-80fa-95251c253035 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1407 microversion: 2.20 time: 0.267052 Oct 05 02:32:32.350354 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 694/1376] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:32 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1407 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:32:32.464472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-7a184af2-0488-45ed-85a7-3197304794b8 req-317b8a76-a702-4fb2-b639-4b34136cacc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "861e3da3-98a1-4728-b218-322c9db128b3", "name": "network-vif-deleted", "tag": "1414377b-0304-4553-b209-c5c3a5855cea"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:32:32.476533 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-7a184af2-0488-45ed-85a7-3197304794b8 req-317b8a76-a702-4fb2-b639-4b34136cacc8 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:32.477305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-7a184af2-0488-45ed-85a7-3197304794b8 req-317b8a76-a702-4fb2-b639-4b34136cacc8 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:32.477740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-7a184af2-0488-45ed-85a7-3197304794b8 req-317b8a76-a702-4fb2-b639-4b34136cacc8 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:32.504589 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-7a184af2-0488-45ed-85a7-3197304794b8 req-317b8a76-a702-4fb2-b639-4b34136cacc8 service nova] Creating event network-vif-deleted:1414377b-0304-4553-b209-c5c3a5855cea for instance 861e3da3-98a1-4728-b218-322c9db128b3 on n-h2-858272-3 Oct 05 02:32:32.512357 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-7a184af2-0488-45ed-85a7-3197304794b8 req-317b8a76-a702-4fb2-b639-4b34136cacc8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051599 Oct 05 02:32:32.513343 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 683/1377] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:32:32.744998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f00ca586-5731-404b-b518-c03733ccc0ac tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:32.745712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f00ca586-5731-404b-b518-c03733ccc0ac tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:32.761304 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f00ca586-5731-404b-b518-c03733ccc0ac tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:32.761984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f00ca586-5731-404b-b518-c03733ccc0ac tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:32.765342 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f00ca586-5731-404b-b518-c03733ccc0ac tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:32.766751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f00ca586-5731-404b-b518-c03733ccc0ac tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:32.767679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f00ca586-5731-404b-b518-c03733ccc0ac tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:32.776754 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f00ca586-5731-404b-b518-c03733ccc0ac tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:32.938182 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3535c700-b4e6-4249-b6d3-6210c123069b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:32.939146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3535c700-b4e6-4249-b6d3-6210c123069b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:32.963528 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3535c700-b4e6-4249-b6d3-6210c123069b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:32.964033 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3535c700-b4e6-4249-b6d3-6210c123069b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:32.964467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3535c700-b4e6-4249-b6d3-6210c123069b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:32.970099 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3535c700-b4e6-4249-b6d3-6210c123069b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:32.974145 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3535c700-b4e6-4249-b6d3-6210c123069b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:32.974809 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3535c700-b4e6-4249-b6d3-6210c123069b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:33.235285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3535c700-b4e6-4249-b6d3-6210c123069b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:33.267343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3535c700-b4e6-4249-b6d3-6210c123069b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:33.269411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3535c700-b4e6-4249-b6d3-6210c123069b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:33.271884 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3535c700-b4e6-4249-b6d3-6210c123069b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1814 microversion: 2.25 time: 0.475313 Oct 05 02:32:33.272703 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f00ca586-5731-404b-b518-c03733ccc0ac tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1811 microversion: 2.1 time: 0.529727 Oct 05 02:32:33.274049 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 695/1378] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:32 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1811 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:33.275418 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 684/1379] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:32 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1814 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:32:33.281326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4a79a29b-1f00-45a7-adb3-67a941bfc8c7 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:33.281326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4a79a29b-1f00-45a7-adb3-67a941bfc8c7 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:33.285773 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-94eecd30-573f-4cda-b0e5-02170308c95a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce4256d30>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:33.296344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a79a29b-1f00-45a7-adb3-67a941bfc8c7 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:33.296837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a79a29b-1f00-45a7-adb3-67a941bfc8c7 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:33.297294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a79a29b-1f00-45a7-adb3-67a941bfc8c7 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:33.297994 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a79a29b-1f00-45a7-adb3-67a941bfc8c7 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:33.298446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a79a29b-1f00-45a7-adb3-67a941bfc8c7 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:33.298866 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a79a29b-1f00-45a7-adb3-67a941bfc8c7 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:33.371443 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-94eecd30-573f-4cda-b0e5-02170308c95a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c" status: 200 len: 1414 microversion: 2.1 time: 0.094524 Oct 05 02:32:33.379756 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 685/1380] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:32:33 2022] GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c => generated 1414 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:33.379756 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ec7d70eb-1fad-46c1-8167-b0483cacc43c tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:33.382465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec7d70eb-1fad-46c1-8167-b0483cacc43c tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:33.384046 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec7d70eb-1fad-46c1-8167-b0483cacc43c tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:33.384593 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec7d70eb-1fad-46c1-8167-b0483cacc43c tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:33.385555 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec7d70eb-1fad-46c1-8167-b0483cacc43c tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:33.387430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec7d70eb-1fad-46c1-8167-b0483cacc43c tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:33.389657 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec7d70eb-1fad-46c1-8167-b0483cacc43c tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:33.399129 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4a79a29b-1f00-45a7-adb3-67a941bfc8c7 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:33.412764 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4a79a29b-1f00-45a7-adb3-67a941bfc8c7 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1427 microversion: 2.1 time: 0.137099 Oct 05 02:32:33.413987 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 696/1381] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:33 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1427 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:33.420646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b5e2faf3-d6b8-4fa6-96f0-a10de6708631 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:33.421703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b5e2faf3-d6b8-4fa6-96f0-a10de6708631 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:33.429843 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5e2faf3-d6b8-4fa6-96f0-a10de6708631 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:33.430726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5e2faf3-d6b8-4fa6-96f0-a10de6708631 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:33.431390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5e2faf3-d6b8-4fa6-96f0-a10de6708631 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:33.432759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5e2faf3-d6b8-4fa6-96f0-a10de6708631 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:33.433388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5e2faf3-d6b8-4fa6-96f0-a10de6708631 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:33.434002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5e2faf3-d6b8-4fa6-96f0-a10de6708631 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:33.457828 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ec7d70eb-1fad-46c1-8167-b0483cacc43c tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.084233 Oct 05 02:32:33.460029 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 686/1382] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Oct 5 02:32:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:32:33.655438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b5e2faf3-d6b8-4fa6-96f0-a10de6708631 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:33.671303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b5e2faf3-d6b8-4fa6-96f0-a10de6708631 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:33.674952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b5e2faf3-d6b8-4fa6-96f0-a10de6708631 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:33.679572 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b5e2faf3-d6b8-4fa6-96f0-a10de6708631 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1407 microversion: 2.20 time: 0.260874 Oct 05 02:32:33.682104 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 697/1383] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:33 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:32:34.319991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-85ee3213-d47b-4f16-beb0-cb526eccc410 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:34.320709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-85ee3213-d47b-4f16-beb0-cb526eccc410 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:34.340224 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85ee3213-d47b-4f16-beb0-cb526eccc410 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:34.340734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85ee3213-d47b-4f16-beb0-cb526eccc410 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:34.341199 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85ee3213-d47b-4f16-beb0-cb526eccc410 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:34.342085 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85ee3213-d47b-4f16-beb0-cb526eccc410 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:34.342848 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85ee3213-d47b-4f16-beb0-cb526eccc410 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:34.343285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85ee3213-d47b-4f16-beb0-cb526eccc410 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:34.387011 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0e54e522-8ead-404c-8ca6-00fdd85c2792 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fccdfc28550>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:34.458641 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0e54e522-8ead-404c-8ca6-00fdd85c2792 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c" status: 200 len: 1414 microversion: 2.1 time: 0.075777 Oct 05 02:32:34.459536 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 698/1384] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:32:34 2022] GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c => generated 1414 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:34.472252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9d8c7e3a-d668-4aa1-9a28-996e91235460 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:34.473664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9d8c7e3a-d668-4aa1-9a28-996e91235460 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:34.491792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d8c7e3a-d668-4aa1-9a28-996e91235460 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:34.492521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d8c7e3a-d668-4aa1-9a28-996e91235460 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:34.493150 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d8c7e3a-d668-4aa1-9a28-996e91235460 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:34.494038 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d8c7e3a-d668-4aa1-9a28-996e91235460 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:34.494647 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d8c7e3a-d668-4aa1-9a28-996e91235460 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:34.496018 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d8c7e3a-d668-4aa1-9a28-996e91235460 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:34.557081 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d8c7e3a-d668-4aa1-9a28-996e91235460 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:34.557932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d8c7e3a-d668-4aa1-9a28-996e91235460 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:34.558608 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d8c7e3a-d668-4aa1-9a28-996e91235460 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:34.559294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-9d8c7e3a-d668-4aa1-9a28-996e91235460 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lazy-loading 'fault' on Instance uuid 861e3da3-98a1-4728-b218-322c9db128b3 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:32:35.172098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9d8c7e3a-d668-4aa1-9a28-996e91235460 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73227214e404f4db779694b8c11779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6918daa4f884786b45bc88dd1e4e94a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:35.182663 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9d8c7e3a-d668-4aa1-9a28-996e91235460 tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 200 len: 1304 microversion: 2.1 time: 0.716594 Oct 05 02:32:35.203293 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 699/1385] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:34 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 1304 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:35.229865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-668a33af-2284-40e8-a977-fbc7a62779cb tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:35.237506 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-668a33af-2284-40e8-a977-fbc7a62779cb tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:35.271424 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-668a33af-2284-40e8-a977-fbc7a62779cb tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:35.271713 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-668a33af-2284-40e8-a977-fbc7a62779cb tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:35.272148 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-668a33af-2284-40e8-a977-fbc7a62779cb tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:35.272860 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-668a33af-2284-40e8-a977-fbc7a62779cb tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:35.273336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-668a33af-2284-40e8-a977-fbc7a62779cb tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:35.273754 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-668a33af-2284-40e8-a977-fbc7a62779cb tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:35.583906 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-85ee3213-d47b-4f16-beb0-cb526eccc410 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:35.600959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-85ee3213-d47b-4f16-beb0-cb526eccc410 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:35.603909 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-85ee3213-d47b-4f16-beb0-cb526eccc410 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:35.617115 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-85ee3213-d47b-4f16-beb0-cb526eccc410 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1804 microversion: 2.25 time: 1.299478 Oct 05 02:32:35.617749 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 687/1386] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:34 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1804 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:32:35.628270 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6d6b7b2b-5932-4264-aa3d-593110bdcedf tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:35.629421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6d6b7b2b-5932-4264-aa3d-593110bdcedf tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] [instance: aaa20a8a-8a7b-42dd-9b4e-9165fba82942] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:35.635427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=5,nova_api:UPDATE=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:35.636876 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6d6b7b2b-5932-4264-aa3d-593110bdcedf tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:35.637570 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6d6b7b2b-5932-4264-aa3d-593110bdcedf tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:35.638006 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6d6b7b2b-5932-4264-aa3d-593110bdcedf tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:35.638740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6d6b7b2b-5932-4264-aa3d-593110bdcedf tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:35.639490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6d6b7b2b-5932-4264-aa3d-593110bdcedf tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:35.639961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6d6b7b2b-5932-4264-aa3d-593110bdcedf tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:35.699300 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-6d6b7b2b-5932-4264-aa3d-593110bdcedf tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] HTTP exception thrown: Instance aaa20a8a-8a7b-42dd-9b4e-9165fba82942 could not be found. Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6d6b7b2b-5932-4264-aa3d-593110bdcedf tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Request method failure captured: Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942 HTTP/1.1 Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOv3710Z2fa3LbABRMXb9SZWIoNtJnCn0a_H3hVhzd8pWvfMpRcQQ96ohp-3RTQ154Q397tOcqjaqh_DF0w9K-YntKYkzX9RHIKJiUrEScU7lu2CvUqJ7GWpWS5UgWGW50pAMj1wJ9thdyLVMQVU5I89x4rKL2i051SToyrn9OKjQkQ Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 407895b8d4e94b74a2cb652eb2c30048 Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1640965695 Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/407895b8d4e94b74a2cb652eb2c30048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/407895b8d4e94b74a2cb652eb2c30048"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/407895b8d4e94b74a2cb652eb2c30048"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_407895b8d4e94b74a2cb652eb2c30048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1640965695 Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 407895b8d4e94b74a2cb652eb2c30048 Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1640965695 Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-AttachSCSIVolumeTestJSON-1640965695-project Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: f914ca523057422f88748746ba18b525 Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1640965695-project Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance aaa20a8a-8a7b-42dd-9b4e-9165fba82942 could not be found. Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'aaa20a8a-8a7b-42dd-9b4e-9165fba82942'} Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaa20a8a-8a7b-42dd-9b4e-9165fba82942 could not be found. Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:32:35.702327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:32:35.707107 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaa20a8a-8a7b-42dd-9b4e-9165fba82942 could not be found. Oct 05 02:32:35.707107 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:35.707107 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:35.707107 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:35.707107 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:35.707107 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:35.707107 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:35.707107 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:32:35.707107 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:32:35.707107 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaa20a8a-8a7b-42dd-9b4e-9165fba82942 could not be found. Oct 05 02:32:35.707107 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:35.707107 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6d6b7b2b-5932-4264-aa3d-593110bdcedf tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Returning 404 to user: Instance aaa20a8a-8a7b-42dd-9b4e-9165fba82942 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:32:35.707107 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6d6b7b2b-5932-4264-aa3d-593110bdcedf tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942" status: 404 len: 111 microversion: 2.1 time: 0.080641 Oct 05 02:32:35.707107 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 688/1387] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:32:35 2022] DELETE /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:32:35.717669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bcf4bc6d-59b7-40f9-965d-791c7b25f472 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce42d09d0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:35.790256 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bcf4bc6d-59b7-40f9-965d-791c7b25f472 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c" status: 200 len: 1414 microversion: 2.1 time: 0.084732 Oct 05 02:32:35.790984 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 689/1388] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:32:35 2022] GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c => generated 1414 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:35.802106 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c2de6e4e-8b79-4d93-bf82-718997f0639d tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Calling method '.version_select at 0x7fcce434f820>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:35.807983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2de6e4e-8b79-4d93-bf82-718997f0639d tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:35.808923 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2de6e4e-8b79-4d93-bf82-718997f0639d tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:35.809635 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2de6e4e-8b79-4d93-bf82-718997f0639d tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:35.841499 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c2de6e4e-8b79-4d93-bf82-718997f0639d tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 2116 microversion: 2.25 time: 0.039488 Oct 05 02:32:35.843383 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 690/1389] 10.222.0.16 () {60 vars in 1184 bytes} [Wed Oct 5 02:32:35 2022] GET /compute/v2.1/os-migrations => generated 2116 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:32:35.853070 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-98b14fef-4530-4252-a18c-6410125fca1d tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:35.854069 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-98b14fef-4530-4252-a18c-6410125fca1d tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] [instance: aaa20a8a-8a7b-42dd-9b4e-9165fba82942] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:35.861273 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98b14fef-4530-4252-a18c-6410125fca1d tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:35.862281 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98b14fef-4530-4252-a18c-6410125fca1d tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:35.862949 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98b14fef-4530-4252-a18c-6410125fca1d tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:35.863888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98b14fef-4530-4252-a18c-6410125fca1d tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:35.864571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98b14fef-4530-4252-a18c-6410125fca1d tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:35.865301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98b14fef-4530-4252-a18c-6410125fca1d tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:35.887787 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-668a33af-2284-40e8-a977-fbc7a62779cb tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:35.897252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-668a33af-2284-40e8-a977-fbc7a62779cb tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:35.901553 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-98b14fef-4530-4252-a18c-6410125fca1d tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] HTTP exception thrown: Instance aaa20a8a-8a7b-42dd-9b4e-9165fba82942 could not be found. Oct 05 02:32:35.903734 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-668a33af-2284-40e8-a977-fbc7a62779cb tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:35.907105 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-668a33af-2284-40e8-a977-fbc7a62779cb tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1407 microversion: 2.20 time: 0.697971 Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-98b14fef-4530-4252-a18c-6410125fca1d tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Request method failure captured: Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942 HTTP/1.1 Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOv3710Z2fa3LbABRMXb9SZWIoNtJnCn0a_H3hVhzd8pWvfMpRcQQ96ohp-3RTQ154Q397tOcqjaqh_DF0w9K-YntKYkzX9RHIKJiUrEScU7lu2CvUqJ7GWpWS5UgWGW50pAMj1wJ9thdyLVMQVU5I89x4rKL2i051SToyrn9OKjQkQ Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 407895b8d4e94b74a2cb652eb2c30048 Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1640965695 Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/407895b8d4e94b74a2cb652eb2c30048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/407895b8d4e94b74a2cb652eb2c30048"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/407895b8d4e94b74a2cb652eb2c30048"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_407895b8d4e94b74a2cb652eb2c30048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1640965695 Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 407895b8d4e94b74a2cb652eb2c30048 Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1640965695 Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-AttachSCSIVolumeTestJSON-1640965695-project Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: f914ca523057422f88748746ba18b525 Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1640965695-project Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance aaa20a8a-8a7b-42dd-9b4e-9165fba82942 could not be found. Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'aaa20a8a-8a7b-42dd-9b4e-9165fba82942'} Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaa20a8a-8a7b-42dd-9b4e-9165fba82942 could not be found. Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaa20a8a-8a7b-42dd-9b4e-9165fba82942 could not be found. Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:35.907573 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:35.913009 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:35.913009 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:35.913009 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:35.913009 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:32:35.913009 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:32:35.913009 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaa20a8a-8a7b-42dd-9b4e-9165fba82942 could not be found. Oct 05 02:32:35.913009 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:35.913585 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 700/1390] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:35 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1407 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:32:35.924950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-98b14fef-4530-4252-a18c-6410125fca1d tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] Returning 404 to user: Instance aaa20a8a-8a7b-42dd-9b4e-9165fba82942 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:32:35.926185 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-98b14fef-4530-4252-a18c-6410125fca1d tempest-AttachSCSIVolumeTestJSON-1640965695 tempest-AttachSCSIVolumeTestJSON-1640965695-project] 10.222.0.16 "GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942" status: 404 len: 111 microversion: 2.1 time: 0.081481 Oct 05 02:32:35.931575 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 691/1391] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:35 2022] GET /compute/v2.1/servers/aaa20a8a-8a7b-42dd-9b4e-9165fba82942 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:32:35.933969 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-50328707-b7eb-4ba7-80b4-30e83accda91 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:35.935116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-50328707-b7eb-4ba7-80b4-30e83accda91 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:35.943990 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50328707-b7eb-4ba7-80b4-30e83accda91 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:35.944530 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50328707-b7eb-4ba7-80b4-30e83accda91 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:35.944996 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50328707-b7eb-4ba7-80b4-30e83accda91 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:35.945702 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50328707-b7eb-4ba7-80b4-30e83accda91 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:35.946383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50328707-b7eb-4ba7-80b4-30e83accda91 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:35.946972 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50328707-b7eb-4ba7-80b4-30e83accda91 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:36.174961 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-50328707-b7eb-4ba7-80b4-30e83accda91 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lazy-loading 'services' on Instance uuid d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:32:36.199429 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-50328707-b7eb-4ba7-80b4-30e83accda91 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 2422 microversion: 2.25 time: 0.287915 Oct 05 02:32:36.200280 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 701/1392] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:35 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 2422 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:32:36.220226 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3cdabe8f-e254-4095-97ca-b84bd3ebec2b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:36.221041 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3cdabe8f-e254-4095-97ca-b84bd3ebec2b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] [instance: 861e3da3-98a1-4728-b218-322c9db128b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:36.232166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9125c591-9ded-4eb2-a7f0-627cae4b6775 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:36.233485 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9125c591-9ded-4eb2-a7f0-627cae4b6775 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:36.244291 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9125c591-9ded-4eb2-a7f0-627cae4b6775 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:36.244792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9125c591-9ded-4eb2-a7f0-627cae4b6775 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:36.246800 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3cdabe8f-e254-4095-97ca-b84bd3ebec2b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:36.247316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3cdabe8f-e254-4095-97ca-b84bd3ebec2b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:36.248408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3cdabe8f-e254-4095-97ca-b84bd3ebec2b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:36.250098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9125c591-9ded-4eb2-a7f0-627cae4b6775 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:36.250871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9125c591-9ded-4eb2-a7f0-627cae4b6775 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:36.251341 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9125c591-9ded-4eb2-a7f0-627cae4b6775 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:36.251772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9125c591-9ded-4eb2-a7f0-627cae4b6775 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:36.253064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3cdabe8f-e254-4095-97ca-b84bd3ebec2b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:36.253591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3cdabe8f-e254-4095-97ca-b84bd3ebec2b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:36.254028 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3cdabe8f-e254-4095-97ca-b84bd3ebec2b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:36.307585 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:36.313428 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-3cdabe8f-e254-4095-97ca-b84bd3ebec2b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] HTTP exception thrown: Instance 861e3da3-98a1-4728-b218-322c9db128b3 could not be found. Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3cdabe8f-e254-4095-97ca-b84bd3ebec2b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Request method failure captured: Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 HTTP/1.1 Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOwfduJV9tCP52TzWOgOCVFWO3Jj6aty29-CPOgH5G0_Bnucj7xWks_4AKLcWyxnTAFBGDhqPWXPDzPrNGllL9XXqFNhGlbELfZRXdf0_3EI-4W3n4H6Mlwsa8W9-IDF08P19v24Z7VTSsSr7RZy9WGfeIBEqo2tzACp0Hab7tj7V6o Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c6918daa4f884786b45bc88dd1e4e94a Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersAdminTestJSON-1905021104 Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c6918daa4f884786b45bc88dd1e4e94a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c6918daa4f884786b45bc88dd1e4e94a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c6918daa4f884786b45bc88dd1e4e94a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c6918daa4f884786b45bc88dd1e4e94a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersAdminTestJSON-1905021104 Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c6918daa4f884786b45bc88dd1e4e94a Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersAdminTestJSON-1905021104 Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersAdminTestJSON-1905021104-project Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: c73227214e404f4db779694b8c11779e Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersAdminTestJSON-1905021104-project Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 861e3da3-98a1-4728-b218-322c9db128b3 could not be found. Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '861e3da3-98a1-4728-b218-322c9db128b3'} Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 861e3da3-98a1-4728-b218-322c9db128b3 could not be found. Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 861e3da3-98a1-4728-b218-322c9db128b3 could not be found. Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:36.318504 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:36.323435 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:36.323435 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:36.323435 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:36.323435 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:32:36.323435 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:32:36.323435 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 861e3da3-98a1-4728-b218-322c9db128b3 could not be found. Oct 05 02:32:36.323435 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:32:36.323435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3cdabe8f-e254-4095-97ca-b84bd3ebec2b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] Returning 404 to user: Instance 861e3da3-98a1-4728-b218-322c9db128b3 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:32:36.323435 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3cdabe8f-e254-4095-97ca-b84bd3ebec2b tempest-ServersAdminTestJSON-1905021104 tempest-ServersAdminTestJSON-1905021104-project] 10.222.0.16 "GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3" status: 404 len: 111 microversion: 2.1 time: 0.107049 Oct 05 02:32:36.330435 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 692/1393] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:32:36 2022] GET /compute/v2.1/servers/861e3da3-98a1-4728-b218-322c9db128b3 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:32:36.338943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-75d16b90-729d-4900-94b5-e0bb1ac946b7 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0339c51-4ab1-46fd-a7e2-e03bcba7f794", "device": "/dev/xvdb"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:32:36.349379 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-75d16b90-729d-4900-94b5-e0bb1ac946b7 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:36.368482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75d16b90-729d-4900-94b5-e0bb1ac946b7 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:36.369380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75d16b90-729d-4900-94b5-e0bb1ac946b7 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:36.370111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75d16b90-729d-4900-94b5-e0bb1ac946b7 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:36.371205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75d16b90-729d-4900-94b5-e0bb1ac946b7 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:36.372831 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75d16b90-729d-4900-94b5-e0bb1ac946b7 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:36.373955 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75d16b90-729d-4900-94b5-e0bb1ac946b7 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:36.567987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-9125c591-9ded-4eb2-a7f0-627cae4b6775 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lazy-loading 'services' on Instance uuid d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:32:36.599830 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9125c591-9ded-4eb2-a7f0-627cae4b6775 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 2422 microversion: 2.25 time: 0.374324 Oct 05 02:32:36.601424 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 702/1394] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:36 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 2422 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:32:36.742411 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c6dc9a97-5575-470d-a484-4d1b52c16d21 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:36.743065 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c6dc9a97-5575-470d-a484-4d1b52c16d21 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:36.775239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6dc9a97-5575-470d-a484-4d1b52c16d21 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:36.778594 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6dc9a97-5575-470d-a484-4d1b52c16d21 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:36.779840 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6dc9a97-5575-470d-a484-4d1b52c16d21 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:36.782294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6dc9a97-5575-470d-a484-4d1b52c16d21 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:36.783028 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6dc9a97-5575-470d-a484-4d1b52c16d21 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:36.783657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6dc9a97-5575-470d-a484-4d1b52c16d21 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:37.036029 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-c6dc9a97-5575-470d-a484-4d1b52c16d21 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lazy-loading 'services' on Instance uuid d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:32:37.062266 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-75d16b90-729d-4900-94b5-e0bb1ac946b7 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "POST /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.730091 Oct 05 02:32:37.064314 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 693/1395] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 02:32:36 2022] POST /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00/os-volume_attachments => generated 194 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:32:37.088235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-563d8769-cece-402f-bf9f-622cb9300663 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce434fc10>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:37.172106 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-563d8769-cece-402f-bf9f-622cb9300663 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c" status: 200 len: 1414 microversion: 2.1 time: 0.106270 Oct 05 02:32:37.174617 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 694/1396] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:32:37 2022] GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c => generated 1414 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:37.184406 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-12ba1990-3bff-4804-bc67-e4b9e6361352 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:37.189791 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-12ba1990-3bff-4804-bc67-e4b9e6361352 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:37.205434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12ba1990-3bff-4804-bc67-e4b9e6361352 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:37.205961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12ba1990-3bff-4804-bc67-e4b9e6361352 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:37.206476 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12ba1990-3bff-4804-bc67-e4b9e6361352 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:37.207216 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12ba1990-3bff-4804-bc67-e4b9e6361352 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:37.207677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12ba1990-3bff-4804-bc67-e4b9e6361352 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:37.208586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12ba1990-3bff-4804-bc67-e4b9e6361352 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:37.332359 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c6dc9a97-5575-470d-a484-4d1b52c16d21 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0/os-volume_attachments/a7d4c6fe-b19d-4440-9206-b72634329e32" status: 202 len: 0 microversion: 2.25 time: 0.593930 Oct 05 02:32:37.333301 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 703/1397] 10.222.0.16 () {60 vars in 1457 bytes} [Wed Oct 5 02:32:36 2022] DELETE /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0/os-volume_attachments/a7d4c6fe-b19d-4440-9206-b72634329e32 => generated 0 bytes in 596 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:32:37.347296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ef2c736d-e127-4117-9130-7fa528958037 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:37.350888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ef2c736d-e127-4117-9130-7fa528958037 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:37.365253 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef2c736d-e127-4117-9130-7fa528958037 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:37.365974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef2c736d-e127-4117-9130-7fa528958037 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:37.367230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef2c736d-e127-4117-9130-7fa528958037 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:37.368134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef2c736d-e127-4117-9130-7fa528958037 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:37.369301 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef2c736d-e127-4117-9130-7fa528958037 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:37.369908 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef2c736d-e127-4117-9130-7fa528958037 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:37.453474 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ef2c736d-e127-4117-9130-7fa528958037 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.114160 Oct 05 02:32:37.454121 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 704/1398] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 5 02:32:37 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:32:37.515314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-12ba1990-3bff-4804-bc67-e4b9e6361352 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:37.530091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-12ba1990-3bff-4804-bc67-e4b9e6361352 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:37.534586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-12ba1990-3bff-4804-bc67-e4b9e6361352 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:37.536043 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-12ba1990-3bff-4804-bc67-e4b9e6361352 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1407 microversion: 2.20 time: 0.360246 Oct 05 02:32:37.539534 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 695/1399] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:37 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1407 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:32:38.189067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-83de1639-d5c5-4021-8f92-f4e8ba50e320 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce44fb310>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:38.305662 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-83de1639-d5c5-4021-8f92-f4e8ba50e320 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c" status: 200 len: 1414 microversion: 2.1 time: 0.121063 Oct 05 02:32:38.307104 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 705/1400] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:32:38 2022] GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c => generated 1414 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:38.466051 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b628b898-db46-4733-bd25-6b1f1d550b01 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:38.476475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b628b898-db46-4733-bd25-6b1f1d550b01 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:38.488144 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b628b898-db46-4733-bd25-6b1f1d550b01 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:38.492500 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b628b898-db46-4733-bd25-6b1f1d550b01 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:38.493294 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b628b898-db46-4733-bd25-6b1f1d550b01 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:38.494288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b628b898-db46-4733-bd25-6b1f1d550b01 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:38.495826 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b628b898-db46-4733-bd25-6b1f1d550b01 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:38.496545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b628b898-db46-4733-bd25-6b1f1d550b01 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:38.559779 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b628b898-db46-4733-bd25-6b1f1d550b01 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.097705 Oct 05 02:32:38.561894 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 696/1401] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 5 02:32:38 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:32:38.565211 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f17780c2-af89-4cc6-956c-bc2965d36579 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:38.565856 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f17780c2-af89-4cc6-956c-bc2965d36579 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:38.581401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f17780c2-af89-4cc6-956c-bc2965d36579 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:38.584505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f17780c2-af89-4cc6-956c-bc2965d36579 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:38.585009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f17780c2-af89-4cc6-956c-bc2965d36579 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:38.585905 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f17780c2-af89-4cc6-956c-bc2965d36579 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:38.586378 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f17780c2-af89-4cc6-956c-bc2965d36579 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:38.595722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f17780c2-af89-4cc6-956c-bc2965d36579 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:39.183879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f17780c2-af89-4cc6-956c-bc2965d36579 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:39.202751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f17780c2-af89-4cc6-956c-bc2965d36579 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:39.207110 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f17780c2-af89-4cc6-956c-bc2965d36579 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:39.217733 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f17780c2-af89-4cc6-956c-bc2965d36579 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1407 microversion: 2.20 time: 0.653921 Oct 05 02:32:39.218389 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 706/1402] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:38 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1407 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:32:39.325893 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b8439331-a3f7-41ee-8126-3b36ee3c6f67 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce42d0940>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:39.427515 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b8439331-a3f7-41ee-8126-3b36ee3c6f67 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c" status: 200 len: 1414 microversion: 2.1 time: 0.107891 Oct 05 02:32:39.433737 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 697/1403] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:32:39 2022] GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c => generated 1414 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:39.503268 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-ecf487cb-bbd0-4268-a080-a7725c0020c0 req-24bd9c80-3520-4769-a18e-84497dbb9ace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a28c6ea-5b3d-4f74-b490-8effa4fa813d", "name": "network-vif-plugged", "status": "completed", "tag": "9902bd06-5ff4-4749-a5aa-d4afd71ba732"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:32:39.523662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ecf487cb-bbd0-4268-a080-a7725c0020c0 req-24bd9c80-3520-4769-a18e-84497dbb9ace service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:39.524367 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ecf487cb-bbd0-4268-a080-a7725c0020c0 req-24bd9c80-3520-4769-a18e-84497dbb9ace service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:39.524507 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ecf487cb-bbd0-4268-a080-a7725c0020c0 req-24bd9c80-3520-4769-a18e-84497dbb9ace service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:39.575325 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6bf2e032-777f-496f-a275-f18cd807e58f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:39.578234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6bf2e032-777f-496f-a275-f18cd807e58f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:39.597126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6bf2e032-777f-496f-a275-f18cd807e58f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:39.605910 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6bf2e032-777f-496f-a275-f18cd807e58f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:39.606670 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6bf2e032-777f-496f-a275-f18cd807e58f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:39.608196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6bf2e032-777f-496f-a275-f18cd807e58f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:39.616508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6bf2e032-777f-496f-a275-f18cd807e58f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:39.617244 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6bf2e032-777f-496f-a275-f18cd807e58f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:39.710756 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6bf2e032-777f-496f-a275-f18cd807e58f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.140493 Oct 05 02:32:39.715439 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 698/1404] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 5 02:32:39 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 02:32:39.981094 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-ecf487cb-bbd0-4268-a080-a7725c0020c0 req-24bd9c80-3520-4769-a18e-84497dbb9ace service nova] Creating event network-vif-plugged:9902bd06-5ff4-4749-a5aa-d4afd71ba732 for instance 7a28c6ea-5b3d-4f74-b490-8effa4fa813d on n-h2-858272-3 Oct 05 02:32:39.990908 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-ecf487cb-bbd0-4268-a080-a7725c0020c0 req-24bd9c80-3520-4769-a18e-84497dbb9ace service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.493062 Oct 05 02:32:39.997212 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 707/1405] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:32:40.249110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-51566ff4-840f-42a3-b723-6d42129c0ed7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:40.250171 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-51566ff4-840f-42a3-b723-6d42129c0ed7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:40.264731 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51566ff4-840f-42a3-b723-6d42129c0ed7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:40.267724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51566ff4-840f-42a3-b723-6d42129c0ed7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:40.269844 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51566ff4-840f-42a3-b723-6d42129c0ed7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:40.272283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51566ff4-840f-42a3-b723-6d42129c0ed7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:40.273774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51566ff4-840f-42a3-b723-6d42129c0ed7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:40.276151 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51566ff4-840f-42a3-b723-6d42129c0ed7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:40.449006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7adb8648-cbfc-4b56-b511-44eedb2f546b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fccdfc33310>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:40.549731 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7adb8648-cbfc-4b56-b511-44eedb2f546b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c" status: 200 len: 1414 microversion: 2.1 time: 0.106334 Oct 05 02:32:40.558788 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 708/1406] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:32:40 2022] GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c => generated 1414 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:32:40.713204 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-51566ff4-840f-42a3-b723-6d42129c0ed7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:40.724494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1e5e647d-b287-47e7-a3fb-52c82d413a7e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:40.734118 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1e5e647d-b287-47e7-a3fb-52c82d413a7e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:40.743734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-51566ff4-840f-42a3-b723-6d42129c0ed7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:40.752296 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-51566ff4-840f-42a3-b723-6d42129c0ed7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:40.753503 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-51566ff4-840f-42a3-b723-6d42129c0ed7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1407 microversion: 2.20 time: 0.513045 Oct 05 02:32:40.785065 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 699/1407] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:40 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1407 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:32:40.785512 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e5e647d-b287-47e7-a3fb-52c82d413a7e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:40.786281 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e5e647d-b287-47e7-a3fb-52c82d413a7e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:40.786931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e5e647d-b287-47e7-a3fb-52c82d413a7e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:40.788882 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e5e647d-b287-47e7-a3fb-52c82d413a7e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:40.789608 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e5e647d-b287-47e7-a3fb-52c82d413a7e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:40.790360 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e5e647d-b287-47e7-a3fb-52c82d413a7e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:40.865574 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1e5e647d-b287-47e7-a3fb-52c82d413a7e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.143257 Oct 05 02:32:40.875276 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 709/1408] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 5 02:32:40 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:32:41.566702 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-022fb050-1b99-4f0d-ace7-d2a8ffafd1bb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce429eee0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:41.687506 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-022fb050-1b99-4f0d-ace7-d2a8ffafd1bb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c" status: 200 len: 1414 microversion: 2.1 time: 0.124508 Oct 05 02:32:41.689140 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 700/1409] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:32:41 2022] GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c => generated 1414 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:41.792709 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-26793371-afe2-4c67-ad20-d5639da432e5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:41.794080 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-26793371-afe2-4c67-ad20-d5639da432e5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:41.821730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26793371-afe2-4c67-ad20-d5639da432e5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:41.826907 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26793371-afe2-4c67-ad20-d5639da432e5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:41.830018 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26793371-afe2-4c67-ad20-d5639da432e5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:41.832435 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26793371-afe2-4c67-ad20-d5639da432e5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:41.835315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26793371-afe2-4c67-ad20-d5639da432e5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:41.837266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26793371-afe2-4c67-ad20-d5639da432e5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:42.395676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2b176e96-a77b-44b6-a759-e6383b43ced9 tempest-AZV2TestJSON-790379200 tempest-AZV2TestJSON-790379200-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:42.397083 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b176e96-a77b-44b6-a759-e6383b43ced9 tempest-AZV2TestJSON-790379200 tempest-AZV2TestJSON-790379200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:42.397780 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b176e96-a77b-44b6-a759-e6383b43ced9 tempest-AZV2TestJSON-790379200 tempest-AZV2TestJSON-790379200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:42.398389 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b176e96-a77b-44b6-a759-e6383b43ced9 tempest-AZV2TestJSON-790379200 tempest-AZV2TestJSON-790379200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:42.399302 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b176e96-a77b-44b6-a759-e6383b43ced9 tempest-AZV2TestJSON-790379200 tempest-AZV2TestJSON-790379200-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:42.399937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b176e96-a77b-44b6-a759-e6383b43ced9 tempest-AZV2TestJSON-790379200 tempest-AZV2TestJSON-790379200-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:42.403367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b176e96-a77b-44b6-a759-e6383b43ced9 tempest-AZV2TestJSON-790379200 tempest-AZV2TestJSON-790379200-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:42.438841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:42.512797 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2b176e96-a77b-44b6-a759-e6383b43ced9 tempest-AZV2TestJSON-790379200 tempest-AZV2TestJSON-790379200-project] 10.222.0.16 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.705267 Oct 05 02:32:42.523836 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 701/1410] 10.222.0.16 () {58 vars in 1164 bytes} [Wed Oct 5 02:32:41 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:32:42.546198 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b9dfcfd5-802f-4714-bff4-3a156a45cf90 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:42.548500 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b9dfcfd5-802f-4714-bff4-3a156a45cf90 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:42.589872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9dfcfd5-802f-4714-bff4-3a156a45cf90 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:42.590405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9dfcfd5-802f-4714-bff4-3a156a45cf90 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:42.590846 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9dfcfd5-802f-4714-bff4-3a156a45cf90 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:42.591582 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9dfcfd5-802f-4714-bff4-3a156a45cf90 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:42.592044 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9dfcfd5-802f-4714-bff4-3a156a45cf90 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:42.592467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9dfcfd5-802f-4714-bff4-3a156a45cf90 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:42.768890 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-26793371-afe2-4c67-ad20-d5639da432e5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:42.778065 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b9dfcfd5-802f-4714-bff4-3a156a45cf90 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.252628 Oct 05 02:32:42.781498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-26793371-afe2-4c67-ad20-d5639da432e5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:42.783002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-26793371-afe2-4c67-ad20-d5639da432e5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:42.784155 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-26793371-afe2-4c67-ad20-d5639da432e5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1407 microversion: 2.20 time: 0.995960 Oct 05 02:32:42.786363 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 702/1411] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 5 02:32:42 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0/os-volume_attachments => generated 197 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:32:42.805911 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 710/1412] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:41 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1407 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:32:42.821501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-beaab9c2-5862-428a-81ea-d3f636a2ad7e req-0c0f77d9-51ce-4b50-87f4-6055be9e9bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6f02d3d-f6df-419f-9962-58c68a597dcd", "name": "network-vif-plugged", "status": "completed", "tag": "6923daf2-fc58-4cce-8a01-90bf9aab4f50"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:32:42.831551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4cb33248-8007-443b-ad22-7bd0e6380557 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fccdfc1cca0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:42.851284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-beaab9c2-5862-428a-81ea-d3f636a2ad7e req-0c0f77d9-51ce-4b50-87f4-6055be9e9bb0 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:42.853086 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-beaab9c2-5862-428a-81ea-d3f636a2ad7e req-0c0f77d9-51ce-4b50-87f4-6055be9e9bb0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:42.855842 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-beaab9c2-5862-428a-81ea-d3f636a2ad7e req-0c0f77d9-51ce-4b50-87f4-6055be9e9bb0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:42.909727 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-beaab9c2-5862-428a-81ea-d3f636a2ad7e req-0c0f77d9-51ce-4b50-87f4-6055be9e9bb0 service nova] Creating event network-vif-plugged:6923daf2-fc58-4cce-8a01-90bf9aab4f50 for instance b6f02d3d-f6df-419f-9962-58c68a597dcd on n-h1-858272-3 Oct 05 02:32:42.928281 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4cb33248-8007-443b-ad22-7bd0e6380557 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c" status: 200 len: 1414 microversion: 2.1 time: 0.100546 Oct 05 02:32:42.933131 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-beaab9c2-5862-428a-81ea-d3f636a2ad7e req-0c0f77d9-51ce-4b50-87f4-6055be9e9bb0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140467 Oct 05 02:32:42.935615 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 711/1413] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:32:42 2022] GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c => generated 1414 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:42.936350 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 703/1414] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:32:43.799132 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-014993f1-cada-4df3-aa02-5d5cf56d7ac8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:43.804125 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-014993f1-cada-4df3-aa02-5d5cf56d7ac8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:43.834319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-431282ba-160d-447f-b32b-a33096735f4e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:43.835724 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-431282ba-160d-447f-b32b-a33096735f4e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:43.846507 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-431282ba-160d-447f-b32b-a33096735f4e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:43.849062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-014993f1-cada-4df3-aa02-5d5cf56d7ac8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:43.850362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-014993f1-cada-4df3-aa02-5d5cf56d7ac8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:43.851274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-431282ba-160d-447f-b32b-a33096735f4e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:43.853454 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-431282ba-160d-447f-b32b-a33096735f4e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:43.854399 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-014993f1-cada-4df3-aa02-5d5cf56d7ac8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:43.854703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-431282ba-160d-447f-b32b-a33096735f4e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:43.860370 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-014993f1-cada-4df3-aa02-5d5cf56d7ac8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:43.861134 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-014993f1-cada-4df3-aa02-5d5cf56d7ac8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:43.861593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-431282ba-160d-447f-b32b-a33096735f4e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:43.862244 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-431282ba-160d-447f-b32b-a33096735f4e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:43.866075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-014993f1-cada-4df3-aa02-5d5cf56d7ac8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:44.062495 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-014993f1-cada-4df3-aa02-5d5cf56d7ac8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.268656 Oct 05 02:32:44.067194 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 704/1415] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 5 02:32:43 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0/os-volume_attachments => generated 197 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:32:44.083243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ffc8a9fd-d954-443b-9662-1e3744c2ef5a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce433a940>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:44.206101 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ffc8a9fd-d954-443b-9662-1e3744c2ef5a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c" status: 200 len: 1414 microversion: 2.1 time: 0.140044 Oct 05 02:32:44.206731 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 705/1416] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:32:44 2022] GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c => generated 1414 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:44.291718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-431282ba-160d-447f-b32b-a33096735f4e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:44.301860 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-431282ba-160d-447f-b32b-a33096735f4e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:44.314849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-431282ba-160d-447f-b32b-a33096735f4e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:44.315817 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-431282ba-160d-447f-b32b-a33096735f4e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1599 microversion: 2.20 time: 0.485604 Oct 05 02:32:44.316391 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 712/1417] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:32:43 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1599 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:32:44.344959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-baf8c6bc-6f4e-4b43-8185-9ccf782b1d7b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:44.345947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-baf8c6bc-6f4e-4b43-8185-9ccf782b1d7b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:44.356050 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-baf8c6bc-6f4e-4b43-8185-9ccf782b1d7b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:44.356865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-baf8c6bc-6f4e-4b43-8185-9ccf782b1d7b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:44.358252 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-baf8c6bc-6f4e-4b43-8185-9ccf782b1d7b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:44.359220 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-baf8c6bc-6f4e-4b43-8185-9ccf782b1d7b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:44.359899 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-baf8c6bc-6f4e-4b43-8185-9ccf782b1d7b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:44.360645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-baf8c6bc-6f4e-4b43-8185-9ccf782b1d7b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:44.634541 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-baf8c6bc-6f4e-4b43-8185-9ccf782b1d7b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.294949 Oct 05 02:32:44.644111 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 706/1418] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Oct 5 02:32:44 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d/os-interface => generated 285 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:32:45.077007 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-53db4a28-833b-46ee-ad18-2a1cee7aa0b4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:45.079816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-53db4a28-833b-46ee-ad18-2a1cee7aa0b4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:45.090868 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-53db4a28-833b-46ee-ad18-2a1cee7aa0b4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:45.098510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-53db4a28-833b-46ee-ad18-2a1cee7aa0b4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:45.098973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-53db4a28-833b-46ee-ad18-2a1cee7aa0b4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:45.099739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-53db4a28-833b-46ee-ad18-2a1cee7aa0b4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:45.100212 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-53db4a28-833b-46ee-ad18-2a1cee7aa0b4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:45.100636 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-53db4a28-833b-46ee-ad18-2a1cee7aa0b4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:45.227469 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-53db4a28-833b-46ee-ad18-2a1cee7aa0b4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.156016 Oct 05 02:32:45.228078 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 707/1419] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 5 02:32:45 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 02:32:45.240667 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8d13dc84-9dfd-4891-a97a-55627266d865 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce434fc10>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:45.264726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8c349ec6-5dbc-4a28-a4c8-17b194f60e40 tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:45.268712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c349ec6-5dbc-4a28-a4c8-17b194f60e40 tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:45.269236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c349ec6-5dbc-4a28-a4c8-17b194f60e40 tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:45.269682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c349ec6-5dbc-4a28-a4c8-17b194f60e40 tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:45.270424 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c349ec6-5dbc-4a28-a4c8-17b194f60e40 tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:45.270880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c349ec6-5dbc-4a28-a4c8-17b194f60e40 tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:45.282992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c349ec6-5dbc-4a28-a4c8-17b194f60e40 tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:45.320577 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8d13dc84-9dfd-4891-a97a-55627266d865 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c" status: 200 len: 1414 microversion: 2.1 time: 0.091436 Oct 05 02:32:45.324938 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 708/1420] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:32:45 2022] GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c => generated 1414 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:45.360256 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8c349ec6-5dbc-4a28-a4c8-17b194f60e40 tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.922082 Oct 05 02:32:45.364933 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 713/1421] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 5 02:32:44 2022] GET /compute/v2.1/os-services => generated 944 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:32:45.402096 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d66afbf8-ac30-4165-9bcc-3a630e01d736 tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:45.417355 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d66afbf8-ac30-4165-9bcc-3a630e01d736 tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:45.417772 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d66afbf8-ac30-4165-9bcc-3a630e01d736 tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:45.418939 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d66afbf8-ac30-4165-9bcc-3a630e01d736 tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:45.420242 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d66afbf8-ac30-4165-9bcc-3a630e01d736 tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:45.420766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d66afbf8-ac30-4165-9bcc-3a630e01d736 tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:45.421631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d66afbf8-ac30-4165-9bcc-3a630e01d736 tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:45.494024 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d66afbf8-ac30-4165-9bcc-3a630e01d736 tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.099393 Oct 05 02:32:45.496310 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 709/1422] 10.222.0.16 () {58 vars in 1170 bytes} [Wed Oct 5 02:32:45 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:32:45.509563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7687b3af-4501-4051-b213-63f07e57fab4 tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:45.514557 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7687b3af-4501-4051-b213-63f07e57fab4 tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:45.517247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7687b3af-4501-4051-b213-63f07e57fab4 tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:45.517973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7687b3af-4501-4051-b213-63f07e57fab4 tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:45.524720 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7687b3af-4501-4051-b213-63f07e57fab4 tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:45.533696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7687b3af-4501-4051-b213-63f07e57fab4 tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:45.534482 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7687b3af-4501-4051-b213-63f07e57fab4 tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:45.614180 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7687b3af-4501-4051-b213-63f07e57fab4 tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.095289 Oct 05 02:32:45.615372 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 714/1423] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 5 02:32:45 2022] GET /compute/v2.1/os-services => generated 944 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:32:45.630088 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4db5c903-ee6c-47c8-8ada-673d9f05a1fb tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:45.634004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4db5c903-ee6c-47c8-8ada-673d9f05a1fb tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:45.634572 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4db5c903-ee6c-47c8-8ada-673d9f05a1fb tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:45.634938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4db5c903-ee6c-47c8-8ada-673d9f05a1fb tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:45.640786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4db5c903-ee6c-47c8-8ada-673d9f05a1fb tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:45.641331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4db5c903-ee6c-47c8-8ada-673d9f05a1fb tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:45.646294 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4db5c903-ee6c-47c8-8ada-673d9f05a1fb tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:45.755908 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4db5c903-ee6c-47c8-8ada-673d9f05a1fb tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=n-d-858272-3&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.131258 Oct 05 02:32:45.756838 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 710/1424] 10.222.0.16 () {58 vars in 1194 bytes} [Wed Oct 5 02:32:45 2022] GET /compute/v2.1/os-services?host=n-d-858272-3&binary=xxx => generated 16 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:32:45.768653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5786550c-2f4c-4fb3-a908-7aed1f6e5263 tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:45.772835 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5786550c-2f4c-4fb3-a908-7aed1f6e5263 tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:45.773724 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5786550c-2f4c-4fb3-a908-7aed1f6e5263 tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:45.781647 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5786550c-2f4c-4fb3-a908-7aed1f6e5263 tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:45.782710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5786550c-2f4c-4fb3-a908-7aed1f6e5263 tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:45.785332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5786550c-2f4c-4fb3-a908-7aed1f6e5263 tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:45.786033 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5786550c-2f4c-4fb3-a908-7aed1f6e5263 tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:45.910702 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5786550c-2f4c-4fb3-a908-7aed1f6e5263 tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.145670 Oct 05 02:32:45.915424 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 715/1425] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 5 02:32:45 2022] GET /compute/v2.1/os-services => generated 944 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:32:45.924280 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-46bcddd8-5745-4656-98a0-4d66bd69785d tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:45.928679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-46bcddd8-5745-4656-98a0-4d66bd69785d tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:45.929296 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-46bcddd8-5745-4656-98a0-4d66bd69785d tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:45.941054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-46bcddd8-5745-4656-98a0-4d66bd69785d tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:45.942074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-46bcddd8-5745-4656-98a0-4d66bd69785d tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:45.942564 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-46bcddd8-5745-4656-98a0-4d66bd69785d tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:45.943003 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-46bcddd8-5745-4656-98a0-4d66bd69785d tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:45.991084 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-46bcddd8-5745-4656-98a0-4d66bd69785d tempest-ServicesAdminNegativeTestJSON-153119734 tempest-ServicesAdminNegativeTestJSON-153119734-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.070588 Oct 05 02:32:45.998720 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 711/1426] 10.222.0.16 () {58 vars in 1198 bytes} [Wed Oct 5 02:32:45 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:32:46.242284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c5be9e5a-3ee6-4661-bf91-ca2fb12bcd71 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:46.245234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c5be9e5a-3ee6-4661-bf91-ca2fb12bcd71 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:46.273820 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5be9e5a-3ee6-4661-bf91-ca2fb12bcd71 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:46.274367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5be9e5a-3ee6-4661-bf91-ca2fb12bcd71 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:46.274904 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5be9e5a-3ee6-4661-bf91-ca2fb12bcd71 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:46.275485 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5be9e5a-3ee6-4661-bf91-ca2fb12bcd71 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:46.276576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5be9e5a-3ee6-4661-bf91-ca2fb12bcd71 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:46.277210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5be9e5a-3ee6-4661-bf91-ca2fb12bcd71 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:46.353905 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c5be9e5a-3ee6-4661-bf91-ca2fb12bcd71 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.115922 Oct 05 02:32:46.355142 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 712/1427] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 5 02:32:46 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 02:32:46.377589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0d80d579-b8c9-4fb3-a56c-4632c737f1a6 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce42b4a60>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:46.499394 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0d80d579-b8c9-4fb3-a56c-4632c737f1a6 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c" status: 200 len: 1414 microversion: 2.1 time: 0.140176 Oct 05 02:32:46.500234 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 713/1428] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:32:46 2022] GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c => generated 1414 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:46.636440 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5d6bfd7e-1f66-4632-a081-0707d107cfe2 tempest-ServicesAdminNegativeTestJSON-627081959 tempest-ServicesAdminNegativeTestJSON-627081959-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:46.641409 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5d6bfd7e-1f66-4632-a081-0707d107cfe2 tempest-ServicesAdminNegativeTestJSON-627081959 tempest-ServicesAdminNegativeTestJSON-627081959-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'beb5506586a046e0bba6f68725375b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47ec5d2ebf94f92b4458197ead29783', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5d6bfd7e-1f66-4632-a081-0707d107cfe2 tempest-ServicesAdminNegativeTestJSON-627081959 tempest-ServicesAdminNegativeTestJSON-627081959-project] Request method failure captured: Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOzJDlDmVvRDQEJc57JNdHQTweo2rVGcaOUNhnyQSaU0xijV02fGoTPPgRf88Dtxa6wcKfXYxlr_dtXvCbJIycD8s5p_GMtQpP7fQFIztL1yExeNiG-bI5bJs-9C_wmD-0ef43v27j_ylso2FG4gMWr5Gv1kPXe2pVnhkLQhNFV3ZkM Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: a47ec5d2ebf94f92b4458197ead29783 Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-627081959 Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a47ec5d2ebf94f92b4458197ead29783"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a47ec5d2ebf94f92b4458197ead29783"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a47ec5d2ebf94f92b4458197ead29783"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a47ec5d2ebf94f92b4458197ead29783"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-627081959 Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: a47ec5d2ebf94f92b4458197ead29783 Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-627081959 Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServicesAdminNegativeTestJSON-627081959-project Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: beb5506586a046e0bba6f68725375b63 Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-627081959-project Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: action_args: {} Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 05 02:32:46.670605 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:46.676164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:32:46.676164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:46.676164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:32:46.676164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:32:46.676164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:32:46.676164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 02:32:46.676164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 02:32:46.676164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 05 02:32:46.676164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:32:46.689104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5d6bfd7e-1f66-4632-a081-0707d107cfe2 tempest-ServicesAdminNegativeTestJSON-627081959 tempest-ServicesAdminNegativeTestJSON-627081959-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:32:46.690320 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5d6bfd7e-1f66-4632-a081-0707d107cfe2 tempest-ServicesAdminNegativeTestJSON-627081959 tempest-ServicesAdminNegativeTestJSON-627081959-project] 10.222.0.16 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.689789 Oct 05 02:32:46.692184 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 716/1429] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 5 02:32:45 2022] GET /compute/v2.1/os-services => generated 112 bytes in 692 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:32:47.373879 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fb76fd42-ca4e-4396-b81c-8802df917723 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:47.376763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fb76fd42-ca4e-4396-b81c-8802df917723 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:47.396697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb76fd42-ca4e-4396-b81c-8802df917723 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:47.399562 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb76fd42-ca4e-4396-b81c-8802df917723 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:47.400391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb76fd42-ca4e-4396-b81c-8802df917723 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:47.401362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb76fd42-ca4e-4396-b81c-8802df917723 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:47.407496 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb76fd42-ca4e-4396-b81c-8802df917723 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:47.407967 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb76fd42-ca4e-4396-b81c-8802df917723 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:47.513467 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fb76fd42-ca4e-4396-b81c-8802df917723 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.148444 Oct 05 02:32:47.514542 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 714/1430] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 5 02:32:47 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:32:47.526906 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-094674b0-4c5f-45f6-a9f2-c0d1d6908e08 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fccdfcfb670>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:47.629831 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-094674b0-4c5f-45f6-a9f2-c0d1d6908e08 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c" status: 200 len: 1414 microversion: 2.1 time: 0.115842 Oct 05 02:32:47.631463 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 717/1431] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:32:47 2022] GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c => generated 1414 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:47.651316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-b1d46af7-f7f9-4788-ac03-17a4f53e8605 req-a360b3f0-43b0-4cc8-ab55-113f3fe9f5c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a28c6ea-5b3d-4f74-b490-8effa4fa813d", "tag": "9902bd06-5ff4-4749-a5aa-d4afd71ba732"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:32:47.689095 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b1d46af7-f7f9-4788-ac03-17a4f53e8605 req-a360b3f0-43b0-4cc8-ab55-113f3fe9f5c2 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:47.695713 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b1d46af7-f7f9-4788-ac03-17a4f53e8605 req-a360b3f0-43b0-4cc8-ab55-113f3fe9f5c2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:47.698950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b1d46af7-f7f9-4788-ac03-17a4f53e8605 req-a360b3f0-43b0-4cc8-ab55-113f3fe9f5c2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:47.744655 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-b1d46af7-f7f9-4788-ac03-17a4f53e8605 req-a360b3f0-43b0-4cc8-ab55-113f3fe9f5c2 service nova] Creating event network-changed:9902bd06-5ff4-4749-a5aa-d4afd71ba732 for instance 7a28c6ea-5b3d-4f74-b490-8effa4fa813d on n-h2-858272-3 Oct 05 02:32:47.762761 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-b1d46af7-f7f9-4788-ac03-17a4f53e8605 req-a360b3f0-43b0-4cc8-ab55-113f3fe9f5c2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113901 Oct 05 02:32:47.767359 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 715/1432] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:32:48.549651 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-99fab3e7-f5b4-4bf8-824c-c66f39a88116 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:48.558081 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-99fab3e7-f5b4-4bf8-824c-c66f39a88116 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:32:48.575707 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99fab3e7-f5b4-4bf8-824c-c66f39a88116 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:48.577495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99fab3e7-f5b4-4bf8-824c-c66f39a88116 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:48.579496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99fab3e7-f5b4-4bf8-824c-c66f39a88116 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:48.580447 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99fab3e7-f5b4-4bf8-824c-c66f39a88116 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:32:48.582194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99fab3e7-f5b4-4bf8-824c-c66f39a88116 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:32:48.586122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99fab3e7-f5b4-4bf8-824c-c66f39a88116 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:32:48.676434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-afdb9447-6b09-4061-a42e-7ebe7d301784 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce4078280>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:48.827859 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-afdb9447-6b09-4061-a42e-7ebe7d301784 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c" status: 200 len: 1414 microversion: 2.1 time: 0.184650 Oct 05 02:32:48.828469 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 716/1433] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:32:48 2022] GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c => generated 1414 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:32:48.838607 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-99fab3e7-f5b4-4bf8-824c-c66f39a88116 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.301170 Oct 05 02:32:48.849676 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 718/1434] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 5 02:32:48 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0/os-volume_attachments => generated 25 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:49.845144 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b6ffed9d-80bf-4ed8-953f-989fe1960d7f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce434f310>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:49.959299 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b6ffed9d-80bf-4ed8-953f-989fe1960d7f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c" status: 200 len: 1414 microversion: 2.1 time: 0.119152 Oct 05 02:32:49.960709 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 717/1435] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:32:49 2022] GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c => generated 1414 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:32:50.764145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-99fab3e7-f5b4-4bf8-824c-c66f39a88116 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:50.765778 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-99fab3e7-f5b4-4bf8-824c-c66f39a88116 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002298 Oct 05 02:32:50.774381 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 719/1436] 10.222.0.16 () {56 vars in 886 bytes} [Wed Oct 5 02:32:50 2022] GET /compute/ => generated 377 bytes in 12 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 05 02:32:50.977847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bfd90fb4-d2d8-4a23-898e-ab639698e0a3 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce41ab700>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:32:55.951322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=10 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:57.659380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=46 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:57.713502 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=44 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:01.493204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:01.502504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=70 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:01.504565 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=58,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:01.900037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ba19604f-31ed-404d-a26e-7cf0c960852d tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Calling method '.version_select at 0x7fccdfcfbdc0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:02.402068 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ba19604f-31ed-404d-a26e-7cf0c960852d tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/1f5dc5879ace42149508d74038d0fd27" status: 200 len: 371 microversion: 2.1 time: 0.910481 Oct 05 02:33:02.404321 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 720/1437] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 5 02:33:01 2022] GET /compute/v2.1/os-quota-sets/1f5dc5879ace42149508d74038d0fd27 => generated 371 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:33:02.429878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0e60c8e3-c6d9-4bba-9a93-43b146aea789 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Action: 'update', calling method: .version_select at 0x7fccdfcdc1f0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:02.866067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e60c8e3-c6d9-4bba-9a93-43b146aea789 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:02.867689 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e60c8e3-c6d9-4bba-9a93-43b146aea789 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:02.868966 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e60c8e3-c6d9-4bba-9a93-43b146aea789 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:02.870112 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e60c8e3-c6d9-4bba-9a93-43b146aea789 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:02.871002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e60c8e3-c6d9-4bba-9a93-43b146aea789 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:02.871589 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e60c8e3-c6d9-4bba-9a93-43b146aea789 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:02.979451 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0e60c8e3-c6d9-4bba-9a93-43b146aea789 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/1f5dc5879ace42149508d74038d0fd27" status: 200 len: 328 microversion: 2.1 time: 0.562125 Oct 05 02:33:02.981110 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 721/1438] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 5 02:33:02 2022] PUT /compute/v2.1/os-quota-sets/1f5dc5879ace42149508d74038d0fd27 => generated 328 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:33:03.517792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e1202e2f-1fdc-465e-9c98-6de672604b42 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1504445583", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:09.977114 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-e1202e2f-1fdc-465e-9c98-6de672604b42 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] validate_networks() for None {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:33:10.001028 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bfd90fb4-d2d8-4a23-898e-ab639698e0a3 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c" status: 200 len: 1423 microversion: 2.1 time: 19.004833 Oct 05 02:33:10.010368 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 718/1439] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:32:50 2022] GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c => generated 1423 bytes in 19034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:10.503432 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-10f490be-155f-44cd-9a8f-b34dc85d3fc4 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Action: 'create', calling method: .version_select at 0x7fcce4078e50>, body: {"keypair": {"name": "tempest-keypair-884450737", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXPYjMEurbJ3jUTpuKMH7Y6CoD32S/Y2NYKjU8AGdAr3xlBAUaWGN/TvHg9Rk23GdtfIwdvrR3IdJCnzyNmY27mo4mea1ZHN7Okg+Yrp400qYSZcB14B18xdO8FNH2KLg=="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:10.559606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-10f490be-155f-44cd-9a8f-b34dc85d3fc4 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Getting quotas for project 4a08a51781e84e1eb215037744ee3a7b. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:33:10.578326 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-10f490be-155f-44cd-9a8f-b34dc85d3fc4 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Getting quotas for user a262a7ca2be4451a89330098b6134c77 and project 4a08a51781e84e1eb215037744ee3a7b. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:33:10.595687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e1202e2f-1fdc-465e-9c98-6de672604b42 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:33:10.596511 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e1202e2f-1fdc-465e-9c98-6de672604b42 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:33:10.599126 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e1202e2f-1fdc-465e-9c98-6de672604b42 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:33:10.599809 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e1202e2f-1fdc-465e-9c98-6de672604b42 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:33:10.600473 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e1202e2f-1fdc-465e-9c98-6de672604b42 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:33:10.616226 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e1202e2f-1fdc-465e-9c98-6de672604b42 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:10.619756 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e1202e2f-1fdc-465e-9c98-6de672604b42 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:10.622203 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e1202e2f-1fdc-465e-9c98-6de672604b42 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:10.623305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e1202e2f-1fdc-465e-9c98-6de672604b42 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:10.624821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e1202e2f-1fdc-465e-9c98-6de672604b42 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:10.625543 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e1202e2f-1fdc-465e-9c98-6de672604b42 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:10.640228 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-10f490be-155f-44cd-9a8f-b34dc85d3fc4 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.632644 Oct 05 02:33:10.641359 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 719/1440] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 02:33:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:33:10.649592 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5b811731-d96a-4512-9f85-808b2d725b26 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:10.656270 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5b811731-d96a-4512-9f85-808b2d725b26 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:10.671343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b811731-d96a-4512-9f85-808b2d725b26 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:10.672060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b811731-d96a-4512-9f85-808b2d725b26 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:10.672572 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b811731-d96a-4512-9f85-808b2d725b26 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:10.673405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b811731-d96a-4512-9f85-808b2d725b26 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:10.677884 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b811731-d96a-4512-9f85-808b2d725b26 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:10.678595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b811731-d96a-4512-9f85-808b2d725b26 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:10.685454 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-e1202e2f-1fdc-465e-9c98-6de672604b42 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Getting quotas for project 1f5dc5879ace42149508d74038d0fd27. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:33:10.701819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-e1202e2f-1fdc-465e-9c98-6de672604b42 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Getting quotas for user 7051a9f8ca40426e9e73ca02bb1bc9d9 and project 1f5dc5879ace42149508d74038d0fd27. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:33:10.748725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.utils [None req-e1202e2f-1fdc-465e-9c98-6de672604b42 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] cores quota exceeded for 1f5dc5879ace42149508d74038d0fd27, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122319) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 05 02:33:10.753034 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-e1202e2f-1fdc-465e-9c98-6de672604b42 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e1202e2f-1fdc-465e-9c98-6de672604b42 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Request method failure captured: Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 145 Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOzbf3SJT-BdxifN8a0szzU11sNstgKzPnCxFKMdjnyppMgWi5i3uUG93vl6TKEru_Lm32PjljkbbRjt271656GEddcNwpH0X5Onu3LjTf7dX0M8K0_kHLO5tIMyLFiotXPuR6wv6ioEjtBcL7JubWvtQ3a3-AytTkHeiDs9HkZPyiM Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 1f5dc5879ace42149508d74038d0fd27 Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-QuotasAdminNegativeTest-1691905212 Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1f5dc5879ace42149508d74038d0fd27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1f5dc5879ace42149508d74038d0fd27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1f5dc5879ace42149508d74038d0fd27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1f5dc5879ace42149508d74038d0fd27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-QuotasAdminNegativeTest-1691905212 Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 1f5dc5879ace42149508d74038d0fd27 Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1691905212 Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-QuotasAdminNegativeTest-1691905212-project Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 7051a9f8ca40426e9e73ca02bb1bc9d9 Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-QuotasAdminNegativeTest-1691905212-project Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1504445583", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452"}} Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1504445583', 'imageRef': 'adad3215-1ca6-43bb-9981-0d01aff146ab', 'flavorRef': '452'}}} Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 05 02:33:10.800219 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 05 02:33:10.805994 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:33:10.812366 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e1202e2f-1fdc-465e-9c98-6de672604b42 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:33:10.814233 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e1202e2f-1fdc-465e-9c98-6de672604b42 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 7.544998 Oct 05 02:33:10.815942 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 722/1441] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:33:03 2022] POST /compute/v2.1/servers => generated 111 bytes in 7548 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:33:10.821931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-698a7f7c-6d66-4bb4-b797-37bb21819ebc tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fccdfc50ca0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:10.912172 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-698a7f7c-6d66-4bb4-b797-37bb21819ebc tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c" status: 200 len: 1423 microversion: 2.1 time: 0.092202 Oct 05 02:33:10.924475 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 723/1442] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:33:10 2022] GET /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c => generated 1423 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:10.930048 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8ceef028-59f3-484f-918f-9002e5b93ef8 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Action: 'update', calling method: .version_select at 0x7fccdfc50820>, body: {"quota_set": {"cores": 20}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:11.020630 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5b811731-d96a-4512-9f85-808b2d725b26 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1857 microversion: 2.1 time: 0.378050 Oct 05 02:33:11.023185 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 720/1443] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:10 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1857 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:11.032670 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-99b98e04-41ba-46fb-8d8c-c5681418ae65 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce429e040>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:11.258096 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ceef028-59f3-484f-918f-9002e5b93ef8 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:11.261588 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ceef028-59f3-484f-918f-9002e5b93ef8 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:11.266670 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ceef028-59f3-484f-918f-9002e5b93ef8 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:11.267984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ceef028-59f3-484f-918f-9002e5b93ef8 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:11.268750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ceef028-59f3-484f-918f-9002e5b93ef8 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:11.269374 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ceef028-59f3-484f-918f-9002e5b93ef8 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:11.442105 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8ceef028-59f3-484f-918f-9002e5b93ef8 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/1f5dc5879ace42149508d74038d0fd27" status: 200 len: 329 microversion: 2.1 time: 0.515857 Oct 05 02:33:11.445816 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 724/1444] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 5 02:33:10 2022] PUT /compute/v2.1/os-quota-sets/1f5dc5879ace42149508d74038d0fd27 => generated 329 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:33:11.466750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ef02799e-62d1-4cb5-b338-9d4144e1e6c0 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858272-3", "block_migration": true, "disk_over_commit": false}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:11.478293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ef02799e-62d1-4cb5-b338-9d4144e1e6c0 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:11.524490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef02799e-62d1-4cb5-b338-9d4144e1e6c0 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:11.525035 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef02799e-62d1-4cb5-b338-9d4144e1e6c0 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:11.525482 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef02799e-62d1-4cb5-b338-9d4144e1e6c0 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:11.526205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef02799e-62d1-4cb5-b338-9d4144e1e6c0 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:11.533708 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef02799e-62d1-4cb5-b338-9d4144e1e6c0 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:11.535311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef02799e-62d1-4cb5-b338-9d4144e1e6c0 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:11.644437 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-ef02799e-62d1-4cb5-b338-9d4144e1e6c0 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lazy-loading 'flavor' on Instance uuid 9a19871a-12bc-45d8-ad01-489ad68f1e00 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:33:11.681090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ef02799e-62d1-4cb5-b338-9d4144e1e6c0 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Going to try to live migrate instance to n-h2-858272-3 {{(pid=122319) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 05 02:33:12.897256 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-99b98e04-41ba-46fb-8d8c-c5681418ae65 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "DELETE /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c" status: 204 len: 0 microversion: 2.1 time: 1.872722 Oct 05 02:33:12.897882 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 721/1445] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:11 2022] DELETE /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c => generated 0 bytes in 1874 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:33:12.904660 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cd608b53-c0a2-45fb-bbf8-8107e4f95bfd tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Calling method '.version_select at 0x7fccdfcc24c0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:13.467135 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cd608b53-c0a2-45fb-bbf8-8107e4f95bfd tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/1f5dc5879ace42149508d74038d0fd27" status: 200 len: 371 microversion: 2.1 time: 0.566813 Oct 05 02:33:13.485885 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 722/1446] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 5 02:33:12 2022] GET /compute/v2.1/os-quota-sets/1f5dc5879ace42149508d74038d0fd27 => generated 371 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:33:13.511539 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3cc880e5-16cf-4b29-b9b1-6a71187262ea tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:13.512063 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3cc880e5-16cf-4b29-b9b1-6a71187262ea tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: b6f02d3d-f6df-419f-9962-58c68a597dcd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:13.538526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3cc880e5-16cf-4b29-b9b1-6a71187262ea tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:13.539036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3cc880e5-16cf-4b29-b9b1-6a71187262ea tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:13.539482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3cc880e5-16cf-4b29-b9b1-6a71187262ea tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:13.543943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3cc880e5-16cf-4b29-b9b1-6a71187262ea tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:13.544855 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3cc880e5-16cf-4b29-b9b1-6a71187262ea tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:13.545340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3cc880e5-16cf-4b29-b9b1-6a71187262ea tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:13.624997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3cc880e5-16cf-4b29-b9b1-6a71187262ea tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: b6f02d3d-f6df-419f-9962-58c68a597dcd] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:33:13.837815 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3cc880e5-16cf-4b29-b9b1-6a71187262ea tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b6f02d3d-f6df-419f-9962-58c68a597dcd" status: 204 len: 0 microversion: 2.1 time: 0.348902 Oct 05 02:33:13.838762 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 723/1447] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:33:13 2022] DELETE /compute/v2.1/servers/b6f02d3d-f6df-419f-9962-58c68a597dcd => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:33:13.864187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-85d05547-2aa0-4d07-b028-ab4c943e8fa5 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Action: 'update', calling method: .version_select at 0x7fccdfd24820>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:14.019833 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85d05547-2aa0-4d07-b028-ab4c943e8fa5 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:14.023777 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85d05547-2aa0-4d07-b028-ab4c943e8fa5 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:14.025962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85d05547-2aa0-4d07-b028-ab4c943e8fa5 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:14.050738 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85d05547-2aa0-4d07-b028-ab4c943e8fa5 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:14.051424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85d05547-2aa0-4d07-b028-ab4c943e8fa5 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:14.051886 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85d05547-2aa0-4d07-b028-ab4c943e8fa5 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:14.192458 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-85d05547-2aa0-4d07-b028-ab4c943e8fa5 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/1f5dc5879ace42149508d74038d0fd27" status: 200 len: 328 microversion: 2.1 time: 0.346887 Oct 05 02:33:14.193514 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 724/1448] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 5 02:33:13 2022] PUT /compute/v2.1/os-quota-sets/1f5dc5879ace42149508d74038d0fd27 => generated 328 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:33:14.198350 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1a417772-1296-4334-b3b8-2bf8963b0ea9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1520673047", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "48576e87-e85f-42b2-831e-e803ec37a843"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:14.284478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-1a417772-1296-4334-b3b8-2bf8963b0ea9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] validate_networks() for [('48576e87-e85f-42b2-831e-e803ec37a843', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:33:15.349361 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ef02799e-62d1-4cb5-b338-9d4144e1e6c0 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00/action" status: 202 len: 0 microversion: 2.1 time: 3.901875 Oct 05 02:33:15.350270 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 725/1449] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:33:11 2022] POST /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00/action => generated 0 bytes in 3904 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:33:15.355894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f86cccc5-c55a-422a-8733-f58ba5e73f56 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1843784015", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:15.538699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-f86cccc5-c55a-422a-8733-f58ba5e73f56 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] validate_networks() for None {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:33:16.564728 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-1a417772-1296-4334-b3b8-2bf8963b0ea9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:33:16.565321 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-1a417772-1296-4334-b3b8-2bf8963b0ea9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:33:16.566064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-1a417772-1296-4334-b3b8-2bf8963b0ea9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:33:16.566788 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-1a417772-1296-4334-b3b8-2bf8963b0ea9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:33:16.567287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-1a417772-1296-4334-b3b8-2bf8963b0ea9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:33:16.588431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a417772-1296-4334-b3b8-2bf8963b0ea9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:16.589957 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a417772-1296-4334-b3b8-2bf8963b0ea9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:16.590431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a417772-1296-4334-b3b8-2bf8963b0ea9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:16.594896 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a417772-1296-4334-b3b8-2bf8963b0ea9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:16.595506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a417772-1296-4334-b3b8-2bf8963b0ea9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:16.597457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a417772-1296-4334-b3b8-2bf8963b0ea9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:16.633180 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-f86cccc5-c55a-422a-8733-f58ba5e73f56 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:33:16.634678 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-f86cccc5-c55a-422a-8733-f58ba5e73f56 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:33:16.634855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-f86cccc5-c55a-422a-8733-f58ba5e73f56 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:33:16.635231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-f86cccc5-c55a-422a-8733-f58ba5e73f56 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:33:16.635744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-f86cccc5-c55a-422a-8733-f58ba5e73f56 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:33:16.655654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f86cccc5-c55a-422a-8733-f58ba5e73f56 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:16.656241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f86cccc5-c55a-422a-8733-f58ba5e73f56 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:16.656746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f86cccc5-c55a-422a-8733-f58ba5e73f56 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:16.657602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f86cccc5-c55a-422a-8733-f58ba5e73f56 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:16.658267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f86cccc5-c55a-422a-8733-f58ba5e73f56 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:16.658968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f86cccc5-c55a-422a-8733-f58ba5e73f56 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:16.674027 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-1a417772-1296-4334-b3b8-2bf8963b0ea9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Getting quotas for project 91e0286f34a549ed90c758652f0d20ae. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:33:16.681042 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-1a417772-1296-4334-b3b8-2bf8963b0ea9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Getting quotas for user 9f23399a5f1c4af6855a098198ca4ced and project 91e0286f34a549ed90c758652f0d20ae. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:33:16.711343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1a417772-1296-4334-b3b8-2bf8963b0ea9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:33:16.714146 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-f86cccc5-c55a-422a-8733-f58ba5e73f56 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Getting quotas for project 1f5dc5879ace42149508d74038d0fd27. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:33:16.714531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1a417772-1296-4334-b3b8-2bf8963b0ea9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:33:16.729889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-f86cccc5-c55a-422a-8733-f58ba5e73f56 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Getting quotas for user 7051a9f8ca40426e9e73ca02bb1bc9d9 and project 1f5dc5879ace42149508d74038d0fd27. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:33:16.765289 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.utils [None req-f86cccc5-c55a-422a-8733-f58ba5e73f56 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] instances quota exceeded for 1f5dc5879ace42149508d74038d0fd27, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122319) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 05 02:33:16.773590 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-f86cccc5-c55a-422a-8733-f58ba5e73f56 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f86cccc5-c55a-422a-8733-f58ba5e73f56 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Request method failure captured: Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 145 Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOzbf3SJT-BdxifN8a0szzU11sNstgKzPnCxFKMdjnyppMgWi5i3uUG93vl6TKEru_Lm32PjljkbbRjt271656GEddcNwpH0X5Onu3LjTf7dX0M8K0_kHLO5tIMyLFiotXPuR6wv6ioEjtBcL7JubWvtQ3a3-AytTkHeiDs9HkZPyiM Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 1f5dc5879ace42149508d74038d0fd27 Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-QuotasAdminNegativeTest-1691905212 Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1f5dc5879ace42149508d74038d0fd27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1f5dc5879ace42149508d74038d0fd27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1f5dc5879ace42149508d74038d0fd27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1f5dc5879ace42149508d74038d0fd27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-QuotasAdminNegativeTest-1691905212 Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 1f5dc5879ace42149508d74038d0fd27 Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1691905212 Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-QuotasAdminNegativeTest-1691905212-project Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 7051a9f8ca40426e9e73ca02bb1bc9d9 Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-QuotasAdminNegativeTest-1691905212-project Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1843784015", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452"}} Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1843784015', 'imageRef': 'adad3215-1ca6-43bb-9981-0d01aff146ab', 'flavorRef': '452'}}} Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 05 02:33:16.775727 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f86cccc5-c55a-422a-8733-f58ba5e73f56 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:33:16.781718 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f86cccc5-c55a-422a-8733-f58ba5e73f56 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.427042 Oct 05 02:33:16.784794 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 726/1450] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:33:15 2022] POST /compute/v2.1/servers => generated 119 bytes in 1431 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:33:16.789590 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-03ce6751-16d9-47eb-ac39-069f81456b05 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:16.790203 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-03ce6751-16d9-47eb-ac39-069f81456b05 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:16.798043 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1a417772-1296-4334-b3b8-2bf8963b0ea9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.603187 Oct 05 02:33:16.806128 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 725/1451] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:33:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:33:16.807368 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-03ce6751-16d9-47eb-ac39-069f81456b05 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:16.807881 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-03ce6751-16d9-47eb-ac39-069f81456b05 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:16.808305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-03ce6751-16d9-47eb-ac39-069f81456b05 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:16.809045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-03ce6751-16d9-47eb-ac39-069f81456b05 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:16.809505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-03ce6751-16d9-47eb-ac39-069f81456b05 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:16.810168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-03ce6751-16d9-47eb-ac39-069f81456b05 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:16.812714 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-af6c89b1-433f-467a-abf6-044f2f5d2d3c req-07ffcff8-ff7e-4729-8659-c6ad1b7fb171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6f02d3d-f6df-419f-9962-58c68a597dcd", "name": "network-vif-unplugged", "status": "completed", "tag": "6923daf2-fc58-4cce-8a01-90bf9aab4f50"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:16.826818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-af6c89b1-433f-467a-abf6-044f2f5d2d3c req-07ffcff8-ff7e-4729-8659-c6ad1b7fb171 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:16.827785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-af6c89b1-433f-467a-abf6-044f2f5d2d3c req-07ffcff8-ff7e-4729-8659-c6ad1b7fb171 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:16.828444 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-af6c89b1-433f-467a-abf6-044f2f5d2d3c req-07ffcff8-ff7e-4729-8659-c6ad1b7fb171 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:16.843495 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-af6c89b1-433f-467a-abf6-044f2f5d2d3c req-07ffcff8-ff7e-4729-8659-c6ad1b7fb171 service nova] Creating event network-vif-unplugged:6923daf2-fc58-4cce-8a01-90bf9aab4f50 for instance b6f02d3d-f6df-419f-9962-58c68a597dcd on n-h1-858272-3 Oct 05 02:33:16.852248 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-af6c89b1-433f-467a-abf6-044f2f5d2d3c req-07ffcff8-ff7e-4729-8659-c6ad1b7fb171 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044481 Oct 05 02:33:16.854787 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 726/1452] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:33:16.862071 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d1d14bbd-9526-4b03-8d47-1de38c37d9b1 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-2055135405", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "e359576d-08fa-4e38-a07a-3e4c83fe0203"}], "security_groups": [{"name": "tempest-securitygroup--168529898"}], "key_name": "tempest-keypair-884450737", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:17.279513 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-d1d14bbd-9526-4b03-8d47-1de38c37d9b1 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] validate_networks() for [('e359576d-08fa-4e38-a07a-3e4c83fe0203', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:33:17.634055 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-03ce6751-16d9-47eb-ac39-069f81456b05 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:17.664216 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-03ce6751-16d9-47eb-ac39-069f81456b05 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1716 microversion: 2.1 time: 0.876145 Oct 05 02:33:17.671201 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 727/1453] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:16 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1716 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:17.686161 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8714680c-85f5-434f-8499-b4902e3d805d tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Action: 'update', calling method: .version_select at 0x7fccdfd15c10>, body: {"quota_set": {"instances": 10}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:17.823861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8714680c-85f5-434f-8499-b4902e3d805d tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:17.824541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8714680c-85f5-434f-8499-b4902e3d805d tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:17.826029 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8714680c-85f5-434f-8499-b4902e3d805d tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:17.827112 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8714680c-85f5-434f-8499-b4902e3d805d tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:17.829901 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8714680c-85f5-434f-8499-b4902e3d805d tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:17.830591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8714680c-85f5-434f-8499-b4902e3d805d tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:18.055143 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8714680c-85f5-434f-8499-b4902e3d805d tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/1f5dc5879ace42149508d74038d0fd27" status: 200 len: 329 microversion: 2.1 time: 0.382405 Oct 05 02:33:18.078611 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 728/1454] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 5 02:33:17 2022] PUT /compute/v2.1/os-quota-sets/1f5dc5879ace42149508d74038d0fd27 => generated 329 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:33:18.086567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6f0dd023-16cb-47d0-beea-ddf8c1f6f6ac tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:18.088041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6f0dd023-16cb-47d0-beea-ddf8c1f6f6ac tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:18.103104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f0dd023-16cb-47d0-beea-ddf8c1f6f6ac tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:18.103959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f0dd023-16cb-47d0-beea-ddf8c1f6f6ac tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:18.104796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f0dd023-16cb-47d0-beea-ddf8c1f6f6ac tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:18.106619 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f0dd023-16cb-47d0-beea-ddf8c1f6f6ac tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:18.107643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f0dd023-16cb-47d0-beea-ddf8c1f6f6ac tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:18.109539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f0dd023-16cb-47d0-beea-ddf8c1f6f6ac tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:18.488567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6f0dd023-16cb-47d0-beea-ddf8c1f6f6ac tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:18.499068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-d1d14bbd-9526-4b03-8d47-1de38c37d9b1 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Getting quotas for project 4a08a51781e84e1eb215037744ee3a7b. Resources: dict_keys(['metadata_items']) {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:33:18.509464 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6f0dd023-16cb-47d0-beea-ddf8c1f6f6ac tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 200 len: 1204 microversion: 2.1 time: 0.429192 Oct 05 02:33:18.511345 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 729/1455] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:18 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 1204 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:18.520328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6e3a89f9-b66d-43c2-b0d2-b852667f33ac tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Calling method '.version_select at 0x7fccdfc1c3a0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:18.532611 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-d1d14bbd-9526-4b03-8d47-1de38c37d9b1 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Getting quotas for user a262a7ca2be4451a89330098b6134c77 and project 4a08a51781e84e1eb215037744ee3a7b. Resources: dict_keys(['metadata_items']) {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:33:18.589539 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-d1d14bbd-9526-4b03-8d47-1de38c37d9b1 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:33:18.591159 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-d1d14bbd-9526-4b03-8d47-1de38c37d9b1 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:33:18.591693 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-d1d14bbd-9526-4b03-8d47-1de38c37d9b1 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:33:18.592119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-d1d14bbd-9526-4b03-8d47-1de38c37d9b1 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:33:18.592544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-d1d14bbd-9526-4b03-8d47-1de38c37d9b1 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:33:18.663044 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1d14bbd-9526-4b03-8d47-1de38c37d9b1 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:18.664123 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1d14bbd-9526-4b03-8d47-1de38c37d9b1 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:18.665444 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1d14bbd-9526-4b03-8d47-1de38c37d9b1 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:18.668150 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1d14bbd-9526-4b03-8d47-1de38c37d9b1 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:18.671486 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1d14bbd-9526-4b03-8d47-1de38c37d9b1 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:18.674412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1d14bbd-9526-4b03-8d47-1de38c37d9b1 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:18.745248 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-d1d14bbd-9526-4b03-8d47-1de38c37d9b1 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Getting quotas for project 4a08a51781e84e1eb215037744ee3a7b. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:33:18.764478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-d1d14bbd-9526-4b03-8d47-1de38c37d9b1 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Getting quotas for user a262a7ca2be4451a89330098b6134c77 and project 4a08a51781e84e1eb215037744ee3a7b. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:33:18.777954 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6e3a89f9-b66d-43c2-b0d2-b852667f33ac tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/1f5dc5879ace42149508d74038d0fd27" status: 200 len: 371 microversion: 2.1 time: 0.265349 Oct 05 02:33:18.780667 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 730/1456] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 5 02:33:18 2022] GET /compute/v2.1/os-quota-sets/1f5dc5879ace42149508d74038d0fd27 => generated 371 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:33:18.809880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2733cfc3-04d5-41bd-93db-16ae58287063 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:18.810371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d1d14bbd-9526-4b03-8d47-1de38c37d9b1 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:33:18.811025 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2733cfc3-04d5-41bd-93db-16ae58287063 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:18.820732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2733cfc3-04d5-41bd-93db-16ae58287063 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:18.821335 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d1d14bbd-9526-4b03-8d47-1de38c37d9b1 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] [instance: b11969e1-8fcb-4287-8d5b-070809e1e452] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:33:18.821753 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2733cfc3-04d5-41bd-93db-16ae58287063 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:18.822365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2733cfc3-04d5-41bd-93db-16ae58287063 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:18.823576 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2733cfc3-04d5-41bd-93db-16ae58287063 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:18.828985 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2733cfc3-04d5-41bd-93db-16ae58287063 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:18.829811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2733cfc3-04d5-41bd-93db-16ae58287063 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:18.994711 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d1d14bbd-9526-4b03-8d47-1de38c37d9b1 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.138266 Oct 05 02:33:18.996365 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 727/1457] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:33:16 2022] POST /compute/v2.1/servers => generated 408 bytes in 2141 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:33:19.018888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f758488b-67b9-4184-b7d0-ea03bbd466d4 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Action: 'update', calling method: .version_select at 0x7fcce41ab670>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:19.192447 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f758488b-67b9-4184-b7d0-ea03bbd466d4 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:19.193527 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f758488b-67b9-4184-b7d0-ea03bbd466d4 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:19.195673 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f758488b-67b9-4184-b7d0-ea03bbd466d4 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:19.205662 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f758488b-67b9-4184-b7d0-ea03bbd466d4 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:19.207049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f758488b-67b9-4184-b7d0-ea03bbd466d4 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:19.207924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f758488b-67b9-4184-b7d0-ea03bbd466d4 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:19.332557 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2733cfc3-04d5-41bd-93db-16ae58287063 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:19.345331 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2733cfc3-04d5-41bd-93db-16ae58287063 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1716 microversion: 2.1 time: 0.555388 Oct 05 02:33:19.349032 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 731/1458] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:18 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1716 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:19.367360 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-48716fae-5c22-44ca-ba29-ab73c762847f tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:19.371548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-48716fae-5c22-44ca-ba29-ab73c762847f tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] [instance: b11969e1-8fcb-4287-8d5b-070809e1e452] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:19.436316 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f758488b-67b9-4184-b7d0-ea03bbd466d4 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/1f5dc5879ace42149508d74038d0fd27" status: 200 len: 325 microversion: 2.1 time: 0.431855 Oct 05 02:33:19.444940 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 728/1459] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 5 02:33:18 2022] PUT /compute/v2.1/os-quota-sets/1f5dc5879ace42149508d74038d0fd27 => generated 325 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:33:19.534112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a0482e73-b00f-4a36-ab18-7d5493796f7a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:19.534747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a0482e73-b00f-4a36-ab18-7d5493796f7a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:19.562559 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:19.577198 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a0482e73-b00f-4a36-ab18-7d5493796f7a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:19.577807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a0482e73-b00f-4a36-ab18-7d5493796f7a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:19.582229 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a0482e73-b00f-4a36-ab18-7d5493796f7a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:19.582997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a0482e73-b00f-4a36-ab18-7d5493796f7a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:19.588045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-48716fae-5c22-44ca-ba29-ab73c762847f tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a262a7ca2be4451a89330098b6134c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a08a51781e84e1eb215037744ee3a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:19.591783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a0482e73-b00f-4a36-ab18-7d5493796f7a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:19.593521 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a0482e73-b00f-4a36-ab18-7d5493796f7a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:19.604708 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-48716fae-5c22-44ca-ba29-ab73c762847f tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452" status: 200 len: 1277 microversion: 2.1 time: 0.249461 Oct 05 02:33:19.605754 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 732/1460] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:19 2022] GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452 => generated 1277 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:19.621422 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a641c238-f54a-415a-abd1-71bfcb089a79 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-7765668", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:19.759584 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-a641c238-f54a-415a-abd1-71bfcb089a79 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] validate_networks() for None {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:33:19.780603 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a0482e73-b00f-4a36-ab18-7d5493796f7a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:19.794805 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a0482e73-b00f-4a36-ab18-7d5493796f7a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 200 len: 1278 microversion: 2.1 time: 0.263185 Oct 05 02:33:19.811213 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 729/1461] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:19 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 1278 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:33:19.875841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-64bc3f67-3ddb-4ed2-8225-bf8d50831c6c req-b9c9c5ec-7784-4b35-9cbb-7ca6a6f37b9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6f02d3d-f6df-419f-9962-58c68a597dcd", "name": "network-vif-deleted", "tag": "6923daf2-fc58-4cce-8a01-90bf9aab4f50"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:19.900688 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-64bc3f67-3ddb-4ed2-8225-bf8d50831c6c req-b9c9c5ec-7784-4b35-9cbb-7ca6a6f37b9a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:19.901936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-64bc3f67-3ddb-4ed2-8225-bf8d50831c6c req-b9c9c5ec-7784-4b35-9cbb-7ca6a6f37b9a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:19.906203 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-64bc3f67-3ddb-4ed2-8225-bf8d50831c6c req-b9c9c5ec-7784-4b35-9cbb-7ca6a6f37b9a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:19.934261 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-64bc3f67-3ddb-4ed2-8225-bf8d50831c6c req-b9c9c5ec-7784-4b35-9cbb-7ca6a6f37b9a service nova] Creating event network-vif-deleted:6923daf2-fc58-4cce-8a01-90bf9aab4f50 for instance b6f02d3d-f6df-419f-9962-58c68a597dcd on n-h1-858272-3 Oct 05 02:33:19.951285 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-64bc3f67-3ddb-4ed2-8225-bf8d50831c6c req-b9c9c5ec-7784-4b35-9cbb-7ca6a6f37b9a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076773 Oct 05 02:33:19.953262 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 730/1462] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:33:20.252243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-a641c238-f54a-415a-abd1-71bfcb089a79 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:33:20.252738 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-a641c238-f54a-415a-abd1-71bfcb089a79 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:33:20.253174 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-a641c238-f54a-415a-abd1-71bfcb089a79 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:33:20.253641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-a641c238-f54a-415a-abd1-71bfcb089a79 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:33:20.254031 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-a641c238-f54a-415a-abd1-71bfcb089a79 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:33:20.266785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a641c238-f54a-415a-abd1-71bfcb089a79 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:20.267757 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a641c238-f54a-415a-abd1-71bfcb089a79 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:20.268399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a641c238-f54a-415a-abd1-71bfcb089a79 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:20.269396 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a641c238-f54a-415a-abd1-71bfcb089a79 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:20.270027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a641c238-f54a-415a-abd1-71bfcb089a79 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:20.270645 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a641c238-f54a-415a-abd1-71bfcb089a79 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:20.333207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-a641c238-f54a-415a-abd1-71bfcb089a79 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Getting quotas for project 1f5dc5879ace42149508d74038d0fd27. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:33:20.333207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:20.347308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-a641c238-f54a-415a-abd1-71bfcb089a79 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Getting quotas for user 7051a9f8ca40426e9e73ca02bb1bc9d9 and project 1f5dc5879ace42149508d74038d0fd27. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:33:20.380844 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ad717d85-9287-4511-846d-6d88af171cf4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:20.381583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ad717d85-9287-4511-846d-6d88af171cf4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:20.410607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad717d85-9287-4511-846d-6d88af171cf4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:20.411115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad717d85-9287-4511-846d-6d88af171cf4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:20.411623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad717d85-9287-4511-846d-6d88af171cf4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:20.412343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad717d85-9287-4511-846d-6d88af171cf4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:20.412799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad717d85-9287-4511-846d-6d88af171cf4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:20.417500 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad717d85-9287-4511-846d-6d88af171cf4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:20.459971 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.utils [None req-a641c238-f54a-415a-abd1-71bfcb089a79 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] ram quota exceeded for 1f5dc5879ace42149508d74038d0fd27, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122319) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 05 02:33:20.465357 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-a641c238-f54a-415a-abd1-71bfcb089a79 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a641c238-f54a-415a-abd1-71bfcb089a79 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Request method failure captured: Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 142 Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOzbf3SJT-BdxifN8a0szzU11sNstgKzPnCxFKMdjnyppMgWi5i3uUG93vl6TKEru_Lm32PjljkbbRjt271656GEddcNwpH0X5Onu3LjTf7dX0M8K0_kHLO5tIMyLFiotXPuR6wv6ioEjtBcL7JubWvtQ3a3-AytTkHeiDs9HkZPyiM Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 1f5dc5879ace42149508d74038d0fd27 Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-QuotasAdminNegativeTest-1691905212 Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1f5dc5879ace42149508d74038d0fd27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1f5dc5879ace42149508d74038d0fd27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1f5dc5879ace42149508d74038d0fd27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1f5dc5879ace42149508d74038d0fd27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-QuotasAdminNegativeTest-1691905212 Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 1f5dc5879ace42149508d74038d0fd27 Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1691905212 Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-QuotasAdminNegativeTest-1691905212-project Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 7051a9f8ca40426e9e73ca02bb1bc9d9 Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-QuotasAdminNegativeTest-1691905212-project Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-7765668", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452"}} Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-7765668', 'imageRef': 'adad3215-1ca6-43bb-9981-0d01aff146ab', 'flavorRef': '452'}}} Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 05 02:33:20.472242 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 05 02:33:20.478628 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:33:20.490914 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a641c238-f54a-415a-abd1-71bfcb089a79 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:33:20.492079 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a641c238-f54a-415a-abd1-71bfcb089a79 tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.885313 Oct 05 02:33:20.500651 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 733/1463] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:33:19 2022] POST /compute/v2.1/servers => generated 110 bytes in 894 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:33:20.511431 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-48fbb251-6e20-4e14-858b-741e10c9978d tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Action: 'update', calling method: .version_select at 0x7fcce428bd30>, body: {"quota_set": {"ram": 51200}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:20.653928 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48fbb251-6e20-4e14-858b-741e10c9978d tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:20.654084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48fbb251-6e20-4e14-858b-741e10c9978d tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:20.654447 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48fbb251-6e20-4e14-858b-741e10c9978d tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:20.656199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48fbb251-6e20-4e14-858b-741e10c9978d tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:20.658488 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48fbb251-6e20-4e14-858b-741e10c9978d tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:20.659121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48fbb251-6e20-4e14-858b-741e10c9978d tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:20.757073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ad717d85-9287-4511-846d-6d88af171cf4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:20.781894 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ad717d85-9287-4511-846d-6d88af171cf4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1716 microversion: 2.1 time: 0.413629 Oct 05 02:33:20.799125 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 731/1464] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:20 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1716 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:20.814004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cd54d59a-544d-419e-95a8-ff907cda5820 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:20.814971 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cd54d59a-544d-419e-95a8-ff907cda5820 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] [instance: b11969e1-8fcb-4287-8d5b-070809e1e452] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:20.832634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd54d59a-544d-419e-95a8-ff907cda5820 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:20.833697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd54d59a-544d-419e-95a8-ff907cda5820 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:20.834343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd54d59a-544d-419e-95a8-ff907cda5820 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:20.835257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd54d59a-544d-419e-95a8-ff907cda5820 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:20.835939 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd54d59a-544d-419e-95a8-ff907cda5820 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:20.836586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd54d59a-544d-419e-95a8-ff907cda5820 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:20.940200 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-48fbb251-6e20-4e14-858b-741e10c9978d tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/1f5dc5879ace42149508d74038d0fd27" status: 200 len: 329 microversion: 2.1 time: 0.437294 Oct 05 02:33:20.944518 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 734/1465] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 5 02:33:20 2022] PUT /compute/v2.1/os-quota-sets/1f5dc5879ace42149508d74038d0fd27 => generated 329 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:33:20.969735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6b5a1074-7439-4322-8236-6df559b4c1fb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:20.970369 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6b5a1074-7439-4322-8236-6df559b4c1fb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:20.987384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b5a1074-7439-4322-8236-6df559b4c1fb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:20.990062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cd54d59a-544d-419e-95a8-ff907cda5820 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a262a7ca2be4451a89330098b6134c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a08a51781e84e1eb215037744ee3a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:20.990949 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b5a1074-7439-4322-8236-6df559b4c1fb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:20.991580 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b5a1074-7439-4322-8236-6df559b4c1fb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:20.994763 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b5a1074-7439-4322-8236-6df559b4c1fb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:20.995425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b5a1074-7439-4322-8236-6df559b4c1fb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:20.996199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b5a1074-7439-4322-8236-6df559b4c1fb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:20.999049 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cd54d59a-544d-419e-95a8-ff907cda5820 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452" status: 200 len: 1273 microversion: 2.1 time: 0.198534 Oct 05 02:33:21.000207 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 732/1466] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:20 2022] GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452 => generated 1273 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:21.014321 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9f9aefaf-a3a5-47bd-9adc-5c8ebe1206cf tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Action: 'update', calling method: .version_select at 0x7fcce41b3d30>, body: {"quota_set": {"ram": 0}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:21.034376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9f9aefaf-a3a5-47bd-9adc-5c8ebe1206cf tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '7051a9f8ca40426e9e73ca02bb1bc9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f5dc5879ace42149508d74038d0fd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9f9aefaf-a3a5-47bd-9adc-5c8ebe1206cf tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Request method failure captured: Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: request: PUT /compute/v2.1/os-quota-sets/1f5dc5879ace42149508d74038d0fd27 HTTP/1.1 Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 25 Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOzbf3SJT-BdxifN8a0szzU11sNstgKzPnCxFKMdjnyppMgWi5i3uUG93vl6TKEru_Lm32PjljkbbRjt271656GEddcNwpH0X5Onu3LjTf7dX0M8K0_kHLO5tIMyLFiotXPuR6wv6ioEjtBcL7JubWvtQ3a3-AytTkHeiDs9HkZPyiM Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 1f5dc5879ace42149508d74038d0fd27 Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-QuotasAdminNegativeTest-1691905212 Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1f5dc5879ace42149508d74038d0fd27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1f5dc5879ace42149508d74038d0fd27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1f5dc5879ace42149508d74038d0fd27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1f5dc5879ace42149508d74038d0fd27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-QuotasAdminNegativeTest-1691905212 Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 1f5dc5879ace42149508d74038d0fd27 Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1691905212 Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-QuotasAdminNegativeTest-1691905212-project Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 7051a9f8ca40426e9e73ca02bb1bc9d9 Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-QuotasAdminNegativeTest-1691905212-project Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: {"quota_set": {"ram": 0}} Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '1f5dc5879ace42149508d74038d0fd27', 'body': {'quota_set': {'ram': 0}}} Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:33:21.047962 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 02:33:21.053811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 02:33:21.053811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 02:33:21.053811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 02:33:21.053811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:33:21.053811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 02:33:21.053811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 05 02:33:21.053811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:33:21.053811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:33:21.053811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:33:21.053811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:33:21.053811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:33:21.053811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:33:21.053811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 02:33:21.053811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 02:33:21.053811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 05 02:33:21.053811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:33:21.056705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9f9aefaf-a3a5-47bd-9adc-5c8ebe1206cf tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:33:21.057807 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9f9aefaf-a3a5-47bd-9adc-5c8ebe1206cf tempest-QuotasAdminNegativeTest-1691905212 tempest-QuotasAdminNegativeTest-1691905212-project] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/1f5dc5879ace42149508d74038d0fd27" status: 403 len: 116 microversion: 2.1 time: 0.047621 Oct 05 02:33:21.063009 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 733/1467] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 5 02:33:21 2022] PUT /compute/v2.1/os-quota-sets/1f5dc5879ace42149508d74038d0fd27 => generated 116 bytes in 62 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:33:21.278802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6b5a1074-7439-4322-8236-6df559b4c1fb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:21.287273 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6b5a1074-7439-4322-8236-6df559b4c1fb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 200 len: 1266 microversion: 2.1 time: 0.323748 Oct 05 02:33:21.295319 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 735/1468] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:20 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 1266 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:21.442437 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ffd445d6-d1c4-4743-a171-3dd326a0ff79 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1240255648", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "a9b9a246-d688-4317-bc49-b07fde7d021b"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:21.560739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-ffd445d6-d1c4-4743-a171-3dd326a0ff79 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] validate_networks() for [('a9b9a246-d688-4317-bc49-b07fde7d021b', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:33:21.813817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6d7a01b5-790c-4398-8681-1161e001b707 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:21.814838 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6d7a01b5-790c-4398-8681-1161e001b707 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:21.834338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6d7a01b5-790c-4398-8681-1161e001b707 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:21.837253 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6d7a01b5-790c-4398-8681-1161e001b707 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:21.837891 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6d7a01b5-790c-4398-8681-1161e001b707 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:21.838946 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6d7a01b5-790c-4398-8681-1161e001b707 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:21.840030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6d7a01b5-790c-4398-8681-1161e001b707 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:21.840638 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6d7a01b5-790c-4398-8681-1161e001b707 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:22.277580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-ffd445d6-d1c4-4743-a171-3dd326a0ff79 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:33:22.280159 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-ffd445d6-d1c4-4743-a171-3dd326a0ff79 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:33:22.280948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-ffd445d6-d1c4-4743-a171-3dd326a0ff79 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:33:22.281841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-ffd445d6-d1c4-4743-a171-3dd326a0ff79 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:33:22.282614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-ffd445d6-d1c4-4743-a171-3dd326a0ff79 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:33:22.309416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ffd445d6-d1c4-4743-a171-3dd326a0ff79 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:22.312553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ffd445d6-d1c4-4743-a171-3dd326a0ff79 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:22.313866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ffd445d6-d1c4-4743-a171-3dd326a0ff79 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:22.315256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ffd445d6-d1c4-4743-a171-3dd326a0ff79 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:22.317271 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ffd445d6-d1c4-4743-a171-3dd326a0ff79 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:22.319020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ffd445d6-d1c4-4743-a171-3dd326a0ff79 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:22.376481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-ffd445d6-d1c4-4743-a171-3dd326a0ff79 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Getting quotas for project dc5e5d31e8a94667b52be18ed414d846. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:33:22.393721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-ffd445d6-d1c4-4743-a171-3dd326a0ff79 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Getting quotas for user 0b8c2b48f17b470aaa79d4f4a4a7215c and project dc5e5d31e8a94667b52be18ed414d846. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:33:22.415451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6d7a01b5-790c-4398-8681-1161e001b707 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:22.425822 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6d7a01b5-790c-4398-8681-1161e001b707 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1716 microversion: 2.1 time: 0.618782 Oct 05 02:33:22.427525 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 736/1469] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:21 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1716 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:22.437437 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-93e4790e-ee6a-405f-951c-0448b0f49d01 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:22.438322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-93e4790e-ee6a-405f-951c-0448b0f49d01 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] [instance: b11969e1-8fcb-4287-8d5b-070809e1e452] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:22.438696 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ffd445d6-d1c4-4743-a171-3dd326a0ff79 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:33:22.445182 n-d-858272-3 devstack@n-api.service[122320]: WARNING nova.utils [None req-ffd445d6-d1c4-4743-a171-3dd326a0ff79 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1240255648 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-124025564 Oct 05 02:33:22.446856 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93e4790e-ee6a-405f-951c-0448b0f49d01 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:22.447273 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ffd445d6-d1c4-4743-a171-3dd326a0ff79 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] [instance: 8b942fed-d4b6-403d-b121-a53278fe83c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:33:22.447767 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93e4790e-ee6a-405f-951c-0448b0f49d01 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:22.448407 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93e4790e-ee6a-405f-951c-0448b0f49d01 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:22.449669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93e4790e-ee6a-405f-951c-0448b0f49d01 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:22.450735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93e4790e-ee6a-405f-951c-0448b0f49d01 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:22.451348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93e4790e-ee6a-405f-951c-0448b0f49d01 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:22.558657 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ffd445d6-d1c4-4743-a171-3dd326a0ff79 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.235284 Oct 05 02:33:22.566159 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 734/1470] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:33:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:33:22.594501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d8b4c2a9-95be-48bf-9638-17b5258621ea tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:22.595132 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d8b4c2a9-95be-48bf-9638-17b5258621ea tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:22.610850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d8b4c2a9-95be-48bf-9638-17b5258621ea tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:22.611358 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d8b4c2a9-95be-48bf-9638-17b5258621ea tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:22.623234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d8b4c2a9-95be-48bf-9638-17b5258621ea tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:22.624034 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d8b4c2a9-95be-48bf-9638-17b5258621ea tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:22.624517 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d8b4c2a9-95be-48bf-9638-17b5258621ea tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:22.624981 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d8b4c2a9-95be-48bf-9638-17b5258621ea tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:22.740656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-93e4790e-ee6a-405f-951c-0448b0f49d01 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a262a7ca2be4451a89330098b6134c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a08a51781e84e1eb215037744ee3a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:22.762366 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-93e4790e-ee6a-405f-951c-0448b0f49d01 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452" status: 200 len: 1335 microversion: 2.1 time: 0.333501 Oct 05 02:33:22.765593 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 737/1471] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:22 2022] GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452 => generated 1335 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:22.772566 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-abc7ec53-77c6-4b4a-ac10-7b014bede344 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:22.776065 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-abc7ec53-77c6-4b4a-ac10-7b014bede344 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] [instance: 8b942fed-d4b6-403d-b121-a53278fe83c3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:22.790233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d8b4c2a9-95be-48bf-9638-17b5258621ea tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:22.804045 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d8b4c2a9-95be-48bf-9638-17b5258621ea tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 200 len: 1266 microversion: 2.1 time: 0.243038 Oct 05 02:33:22.823084 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 735/1472] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:22 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:22.999489 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-abc7ec53-77c6-4b4a-ac10-7b014bede344 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8c2b48f17b470aaa79d4f4a4a7215c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5e5d31e8a94667b52be18ed414d846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:23.009560 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-abc7ec53-77c6-4b4a-ac10-7b014bede344 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] 10.222.0.16 "GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3" status: 200 len: 1232 microversion: 2.1 time: 0.241213 Oct 05 02:33:23.010262 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 738/1473] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:22 2022] GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3 => generated 1232 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:23.462092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-69c06be5-c3ec-44fa-8798-333b6226e468 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:23.464498 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-69c06be5-c3ec-44fa-8798-333b6226e468 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:23.484782 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69c06be5-c3ec-44fa-8798-333b6226e468 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:23.498191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69c06be5-c3ec-44fa-8798-333b6226e468 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:23.503591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69c06be5-c3ec-44fa-8798-333b6226e468 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:23.504560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69c06be5-c3ec-44fa-8798-333b6226e468 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:23.505101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69c06be5-c3ec-44fa-8798-333b6226e468 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:23.506870 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69c06be5-c3ec-44fa-8798-333b6226e468 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:23.790609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d509206f-d319-4b21-a226-dab46b8b196d tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:23.791772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d509206f-d319-4b21-a226-dab46b8b196d tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] [instance: b11969e1-8fcb-4287-8d5b-070809e1e452] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:23.822524 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d509206f-d319-4b21-a226-dab46b8b196d tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:23.828255 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d509206f-d319-4b21-a226-dab46b8b196d tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:23.830598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d509206f-d319-4b21-a226-dab46b8b196d tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:23.833489 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d509206f-d319-4b21-a226-dab46b8b196d tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:23.834275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d509206f-d319-4b21-a226-dab46b8b196d tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:23.837551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d509206f-d319-4b21-a226-dab46b8b196d tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:24.027045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d509206f-d319-4b21-a226-dab46b8b196d tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a262a7ca2be4451a89330098b6134c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a08a51781e84e1eb215037744ee3a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:24.041018 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d509206f-d319-4b21-a226-dab46b8b196d tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452" status: 200 len: 1335 microversion: 2.1 time: 0.256994 Oct 05 02:33:24.045662 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 739/1474] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:23 2022] GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452 => generated 1335 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:33:24.053653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-deac69d5-47f1-421f-b2ca-7d8095e653a0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:24.056387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-deac69d5-47f1-421f-b2ca-7d8095e653a0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:24.072707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-69c06be5-c3ec-44fa-8798-333b6226e468 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:24.082960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-deac69d5-47f1-421f-b2ca-7d8095e653a0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:24.083797 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-deac69d5-47f1-421f-b2ca-7d8095e653a0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:24.085429 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-deac69d5-47f1-421f-b2ca-7d8095e653a0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:24.086947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-deac69d5-47f1-421f-b2ca-7d8095e653a0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:24.091023 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-deac69d5-47f1-421f-b2ca-7d8095e653a0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:24.091804 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-deac69d5-47f1-421f-b2ca-7d8095e653a0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:24.121571 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-69c06be5-c3ec-44fa-8798-333b6226e468 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1716 microversion: 2.1 time: 0.672935 Oct 05 02:33:24.125527 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 736/1475] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:23 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1716 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:24.148517 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b63fb465-5e80-410b-86df-7afbff75f13c tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:24.149275 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b63fb465-5e80-410b-86df-7afbff75f13c tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] [instance: 8b942fed-d4b6-403d-b121-a53278fe83c3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:24.177833 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b63fb465-5e80-410b-86df-7afbff75f13c tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:24.178314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b63fb465-5e80-410b-86df-7afbff75f13c tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:24.182062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b63fb465-5e80-410b-86df-7afbff75f13c tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:24.184078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b63fb465-5e80-410b-86df-7afbff75f13c tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:24.184998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b63fb465-5e80-410b-86df-7afbff75f13c tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:24.188374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b63fb465-5e80-410b-86df-7afbff75f13c tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:24.411481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b63fb465-5e80-410b-86df-7afbff75f13c tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8c2b48f17b470aaa79d4f4a4a7215c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5e5d31e8a94667b52be18ed414d846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:24.423828 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b63fb465-5e80-410b-86df-7afbff75f13c tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] 10.222.0.16 "GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3" status: 200 len: 1228 microversion: 2.1 time: 0.294795 Oct 05 02:33:24.425059 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 737/1476] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:24 2022] GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3 => generated 1228 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:24.673789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-deac69d5-47f1-421f-b2ca-7d8095e653a0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:24.685792 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-deac69d5-47f1-421f-b2ca-7d8095e653a0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 200 len: 1308 microversion: 2.1 time: 0.637940 Oct 05 02:33:24.687415 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 740/1477] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:24 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 1308 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:25.078831 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-420f8c53-216b-4506-b3ab-7147fcc318f3 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:25.083081 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-420f8c53-216b-4506-b3ab-7147fcc318f3 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] [instance: b11969e1-8fcb-4287-8d5b-070809e1e452] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:25.115110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-420f8c53-216b-4506-b3ab-7147fcc318f3 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:25.118310 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-420f8c53-216b-4506-b3ab-7147fcc318f3 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:25.119839 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-420f8c53-216b-4506-b3ab-7147fcc318f3 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:25.134296 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-420f8c53-216b-4506-b3ab-7147fcc318f3 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:25.140078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-420f8c53-216b-4506-b3ab-7147fcc318f3 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:25.141074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-420f8c53-216b-4506-b3ab-7147fcc318f3 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:25.154596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9b1e52a2-adb9-4e00-a548-b910222d39b4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:25.156861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9b1e52a2-adb9-4e00-a548-b910222d39b4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:25.178610 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b1e52a2-adb9-4e00-a548-b910222d39b4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:25.180506 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b1e52a2-adb9-4e00-a548-b910222d39b4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:25.202719 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b1e52a2-adb9-4e00-a548-b910222d39b4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:25.210200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b1e52a2-adb9-4e00-a548-b910222d39b4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:25.213339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b1e52a2-adb9-4e00-a548-b910222d39b4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:25.220677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b1e52a2-adb9-4e00-a548-b910222d39b4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:25.547968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-420f8c53-216b-4506-b3ab-7147fcc318f3 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a262a7ca2be4451a89330098b6134c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a08a51781e84e1eb215037744ee3a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:25.562627 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-420f8c53-216b-4506-b3ab-7147fcc318f3 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452" status: 200 len: 1335 microversion: 2.1 time: 0.498303 Oct 05 02:33:25.565785 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 738/1478] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:25 2022] GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452 => generated 1335 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:25.576108 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d30e247d-a46e-4415-adaf-67e5e1107c74 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:25.580707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d30e247d-a46e-4415-adaf-67e5e1107c74 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] [instance: 8b942fed-d4b6-403d-b121-a53278fe83c3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:25.595849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d30e247d-a46e-4415-adaf-67e5e1107c74 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:25.599147 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d30e247d-a46e-4415-adaf-67e5e1107c74 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:25.601785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d30e247d-a46e-4415-adaf-67e5e1107c74 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:25.603986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d30e247d-a46e-4415-adaf-67e5e1107c74 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:25.604869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d30e247d-a46e-4415-adaf-67e5e1107c74 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:25.607322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d30e247d-a46e-4415-adaf-67e5e1107c74 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:25.793587 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d30e247d-a46e-4415-adaf-67e5e1107c74 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8c2b48f17b470aaa79d4f4a4a7215c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5e5d31e8a94667b52be18ed414d846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:25.809083 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d30e247d-a46e-4415-adaf-67e5e1107c74 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] 10.222.0.16 "GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3" status: 200 len: 1290 microversion: 2.1 time: 0.235245 Oct 05 02:33:25.809867 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 739/1479] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:25 2022] GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3 => generated 1290 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:25.824022 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-045d9bfe-1f9f-4a0d-991b-cda6c5187b3f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:25.824657 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-045d9bfe-1f9f-4a0d-991b-cda6c5187b3f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:25.853795 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-045d9bfe-1f9f-4a0d-991b-cda6c5187b3f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:25.854296 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-045d9bfe-1f9f-4a0d-991b-cda6c5187b3f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:25.854736 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-045d9bfe-1f9f-4a0d-991b-cda6c5187b3f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:25.859755 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-045d9bfe-1f9f-4a0d-991b-cda6c5187b3f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:25.860329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-045d9bfe-1f9f-4a0d-991b-cda6c5187b3f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:25.860772 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-045d9bfe-1f9f-4a0d-991b-cda6c5187b3f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:25.883312 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9b1e52a2-adb9-4e00-a548-b910222d39b4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:25.892299 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9b1e52a2-adb9-4e00-a548-b910222d39b4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1716 microversion: 2.1 time: 0.743827 Oct 05 02:33:25.914607 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 741/1480] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:25 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1716 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:26.243546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-045d9bfe-1f9f-4a0d-991b-cda6c5187b3f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:26.266576 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-045d9bfe-1f9f-4a0d-991b-cda6c5187b3f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 200 len: 1308 microversion: 2.1 time: 0.454864 Oct 05 02:33:26.269515 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 740/1481] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:25 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 1308 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:26.587925 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-02f5b3f3-206a-4a37-9b6a-6ba623dee5df tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:26.588726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-02f5b3f3-206a-4a37-9b6a-6ba623dee5df tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] [instance: b11969e1-8fcb-4287-8d5b-070809e1e452] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:26.617172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-02f5b3f3-206a-4a37-9b6a-6ba623dee5df tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:26.617708 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-02f5b3f3-206a-4a37-9b6a-6ba623dee5df tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:26.618165 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-02f5b3f3-206a-4a37-9b6a-6ba623dee5df tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:26.623803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-02f5b3f3-206a-4a37-9b6a-6ba623dee5df tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:26.625043 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-02f5b3f3-206a-4a37-9b6a-6ba623dee5df tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:26.625043 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-02f5b3f3-206a-4a37-9b6a-6ba623dee5df tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:26.833213 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-93329452-ceba-4fcd-b376-b2a24d4958b9 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:26.833828 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-93329452-ceba-4fcd-b376-b2a24d4958b9 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] [instance: 8b942fed-d4b6-403d-b121-a53278fe83c3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:26.848817 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93329452-ceba-4fcd-b376-b2a24d4958b9 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:26.849718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93329452-ceba-4fcd-b376-b2a24d4958b9 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:26.854005 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93329452-ceba-4fcd-b376-b2a24d4958b9 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:26.855019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93329452-ceba-4fcd-b376-b2a24d4958b9 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:26.859643 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93329452-ceba-4fcd-b376-b2a24d4958b9 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:26.860097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93329452-ceba-4fcd-b376-b2a24d4958b9 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:27.069646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-02f5b3f3-206a-4a37-9b6a-6ba623dee5df tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a262a7ca2be4451a89330098b6134c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a08a51781e84e1eb215037744ee3a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:27.081524 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-02f5b3f3-206a-4a37-9b6a-6ba623dee5df tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452" status: 200 len: 1402 microversion: 2.1 time: 0.496919 Oct 05 02:33:27.084428 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 742/1482] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:26 2022] GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452 => generated 1402 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:27.101840 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f6783104-7117-4186-9609-15333aca9efd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:27.103120 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f6783104-7117-4186-9609-15333aca9efd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:27.125758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6783104-7117-4186-9609-15333aca9efd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:27.131261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6783104-7117-4186-9609-15333aca9efd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:27.131724 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6783104-7117-4186-9609-15333aca9efd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:27.132474 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6783104-7117-4186-9609-15333aca9efd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:27.132964 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6783104-7117-4186-9609-15333aca9efd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:27.133399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6783104-7117-4186-9609-15333aca9efd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:27.186052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-93329452-ceba-4fcd-b376-b2a24d4958b9 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8c2b48f17b470aaa79d4f4a4a7215c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5e5d31e8a94667b52be18ed414d846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:27.202830 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-93329452-ceba-4fcd-b376-b2a24d4958b9 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] 10.222.0.16 "GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3" status: 200 len: 1290 microversion: 2.1 time: 0.373515 Oct 05 02:33:27.206064 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 741/1483] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:26 2022] GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3 => generated 1290 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:27.292091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cc52308e-b2a3-428b-b0b6-0e99cf54994b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:27.293666 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cc52308e-b2a3-428b-b0b6-0e99cf54994b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:27.306602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cc52308e-b2a3-428b-b0b6-0e99cf54994b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:27.307563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cc52308e-b2a3-428b-b0b6-0e99cf54994b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:27.308268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cc52308e-b2a3-428b-b0b6-0e99cf54994b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:27.313449 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cc52308e-b2a3-428b-b0b6-0e99cf54994b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:27.315720 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cc52308e-b2a3-428b-b0b6-0e99cf54994b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:27.317560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cc52308e-b2a3-428b-b0b6-0e99cf54994b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:27.380077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:27.551800 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f6783104-7117-4186-9609-15333aca9efd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:27.562011 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f6783104-7117-4186-9609-15333aca9efd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1716 microversion: 2.1 time: 0.475528 Oct 05 02:33:27.564886 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 743/1484] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:27 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1716 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:27.610433 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cc52308e-b2a3-428b-b0b6-0e99cf54994b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:27.640145 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cc52308e-b2a3-428b-b0b6-0e99cf54994b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 200 len: 1308 microversion: 2.1 time: 0.335379 Oct 05 02:33:27.640715 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 742/1485] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:27 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 1308 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:33:28.115843 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b8cf5628-3201-4446-b868-a3866a480d9c tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:28.117962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b8cf5628-3201-4446-b868-a3866a480d9c tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] [instance: b11969e1-8fcb-4287-8d5b-070809e1e452] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:28.133220 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8cf5628-3201-4446-b868-a3866a480d9c tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:28.138782 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8cf5628-3201-4446-b868-a3866a480d9c tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:28.139458 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8cf5628-3201-4446-b868-a3866a480d9c tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:28.141441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8cf5628-3201-4446-b868-a3866a480d9c tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:28.145039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8cf5628-3201-4446-b868-a3866a480d9c tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:28.145722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8cf5628-3201-4446-b868-a3866a480d9c tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:28.159757 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:28.196780 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-95ef6891-ba98-4538-aff1-cf6f7821fe55 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-114732822", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "9671ab97-ec52-4c80-a228-74cde59af3af"}], "block_device_mapping_v2": [{"uuid": "2dc88c5f-f184-4cdb-904b-23436b8ecc30", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:28.394720 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-95ef6891-ba98-4538-aff1-cf6f7821fe55 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] validate_networks() for [('9671ab97-ec52-4c80-a228-74cde59af3af', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:33:28.739504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b8cf5628-3201-4446-b868-a3866a480d9c tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a262a7ca2be4451a89330098b6134c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a08a51781e84e1eb215037744ee3a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:28.750936 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b8cf5628-3201-4446-b868-a3866a480d9c tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452" status: 200 len: 1402 microversion: 2.1 time: 0.642818 Oct 05 02:33:28.753996 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 744/1486] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:28 2022] GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452 => generated 1402 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:28.769101 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cca914c5-530b-470a-862e-57d442145ef0 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:28.770022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cca914c5-530b-470a-862e-57d442145ef0 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] [instance: 8b942fed-d4b6-403d-b121-a53278fe83c3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:28.785395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cca914c5-530b-470a-862e-57d442145ef0 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:28.789667 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cca914c5-530b-470a-862e-57d442145ef0 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:28.790348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cca914c5-530b-470a-862e-57d442145ef0 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:28.793556 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cca914c5-530b-470a-862e-57d442145ef0 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:28.797222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cca914c5-530b-470a-862e-57d442145ef0 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:28.797937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cca914c5-530b-470a-862e-57d442145ef0 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:29.437568 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cca914c5-530b-470a-862e-57d442145ef0 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8c2b48f17b470aaa79d4f4a4a7215c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5e5d31e8a94667b52be18ed414d846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:29.457271 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cca914c5-530b-470a-862e-57d442145ef0 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] 10.222.0.16 "GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3" status: 200 len: 1332 microversion: 2.1 time: 0.698957 Oct 05 02:33:29.460084 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 745/1487] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:28 2022] GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3 => generated 1332 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:29.474215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7ac7dc09-c712-438c-a796-4934aff162c5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:29.475636 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7ac7dc09-c712-438c-a796-4934aff162c5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:29.491343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ac7dc09-c712-438c-a796-4934aff162c5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:29.497511 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ac7dc09-c712-438c-a796-4934aff162c5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:29.498529 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ac7dc09-c712-438c-a796-4934aff162c5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:29.499625 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ac7dc09-c712-438c-a796-4934aff162c5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:29.501371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ac7dc09-c712-438c-a796-4934aff162c5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:29.502020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ac7dc09-c712-438c-a796-4934aff162c5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:30.350263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7ac7dc09-c712-438c-a796-4934aff162c5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:30.360496 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7ac7dc09-c712-438c-a796-4934aff162c5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1716 microversion: 2.1 time: 0.898898 Oct 05 02:33:30.361114 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 746/1488] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:29 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1716 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:30.377557 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3f732508-9f0e-4f87-8294-694c28437837 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:30.378103 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3f732508-9f0e-4f87-8294-694c28437837 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:30.396349 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f732508-9f0e-4f87-8294-694c28437837 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:30.397564 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f732508-9f0e-4f87-8294-694c28437837 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:30.398700 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f732508-9f0e-4f87-8294-694c28437837 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:30.400205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f732508-9f0e-4f87-8294-694c28437837 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:30.400859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f732508-9f0e-4f87-8294-694c28437837 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:30.401536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f732508-9f0e-4f87-8294-694c28437837 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:30.617987 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-95ef6891-ba98-4538-aff1-cf6f7821fe55 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:33:30.618695 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-95ef6891-ba98-4538-aff1-cf6f7821fe55 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:33:30.619284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-95ef6891-ba98-4538-aff1-cf6f7821fe55 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:33:30.620135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-95ef6891-ba98-4538-aff1-cf6f7821fe55 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:33:30.620715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-95ef6891-ba98-4538-aff1-cf6f7821fe55 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:33:30.645443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-95ef6891-ba98-4538-aff1-cf6f7821fe55 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:30.654727 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-95ef6891-ba98-4538-aff1-cf6f7821fe55 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:30.654727 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-95ef6891-ba98-4538-aff1-cf6f7821fe55 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:30.654727 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-95ef6891-ba98-4538-aff1-cf6f7821fe55 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:30.660344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-95ef6891-ba98-4538-aff1-cf6f7821fe55 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:30.662886 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-95ef6891-ba98-4538-aff1-cf6f7821fe55 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:30.676884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=14 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:30.701549 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3f732508-9f0e-4f87-8294-694c28437837 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:30.716749 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3f732508-9f0e-4f87-8294-694c28437837 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 200 len: 1308 microversion: 2.1 time: 0.352742 Oct 05 02:33:30.718535 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 747/1489] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:30 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 1308 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:30.724495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-95ef6891-ba98-4538-aff1-cf6f7821fe55 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Getting quotas for project bbd25b0a68f749029eeed701c77462ce. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:33:30.730464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-f8dd14ea-4758-436f-859f-667751dab9e4 req-2438096f-3c2d-48e8-a3ad-ddefdf17c6b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "031f6a33-bf9c-4b51-bf79-3764d67846e4", "tag": "db9891a1-497f-4f63-882e-e84d19c9e5f2"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:30.733171 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-95ef6891-ba98-4538-aff1-cf6f7821fe55 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Getting quotas for user 39671ba0b86847f995c96013947fee65 and project bbd25b0a68f749029eeed701c77462ce. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:33:30.747362 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f8dd14ea-4758-436f-859f-667751dab9e4 req-2438096f-3c2d-48e8-a3ad-ddefdf17c6b9 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:30.748497 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f8dd14ea-4758-436f-859f-667751dab9e4 req-2438096f-3c2d-48e8-a3ad-ddefdf17c6b9 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:30.749336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f8dd14ea-4758-436f-859f-667751dab9e4 req-2438096f-3c2d-48e8-a3ad-ddefdf17c6b9 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:30.769778 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-f8dd14ea-4758-436f-859f-667751dab9e4 req-2438096f-3c2d-48e8-a3ad-ddefdf17c6b9 service nova] Creating event network-changed:db9891a1-497f-4f63-882e-e84d19c9e5f2 for instance 031f6a33-bf9c-4b51-bf79-3764d67846e4 on n-h2-858272-3 Oct 05 02:33:30.781409 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-f8dd14ea-4758-436f-859f-667751dab9e4 req-2438096f-3c2d-48e8-a3ad-ddefdf17c6b9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060777 Oct 05 02:33:30.784578 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 748/1490] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:33:30.791478 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-66dedb75-d6d1-49d4-bd67-368ce9ec5a28 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:30.792517 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-66dedb75-d6d1-49d4-bd67-368ce9ec5a28 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] [instance: b11969e1-8fcb-4287-8d5b-070809e1e452] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:30.813106 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-66dedb75-d6d1-49d4-bd67-368ce9ec5a28 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:30.814391 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-66dedb75-d6d1-49d4-bd67-368ce9ec5a28 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:30.815536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-66dedb75-d6d1-49d4-bd67-368ce9ec5a28 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:30.816759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-66dedb75-d6d1-49d4-bd67-368ce9ec5a28 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:30.817674 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-66dedb75-d6d1-49d4-bd67-368ce9ec5a28 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:30.818299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-66dedb75-d6d1-49d4-bd67-368ce9ec5a28 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:30.898310 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-95ef6891-ba98-4538-aff1-cf6f7821fe55 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:33:30.901163 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-95ef6891-ba98-4538-aff1-cf6f7821fe55 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2dc88c5f-f184-4cdb-904b-23436b8ecc30',volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:33:31.090811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-66dedb75-d6d1-49d4-bd67-368ce9ec5a28 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a262a7ca2be4451a89330098b6134c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a08a51781e84e1eb215037744ee3a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:31.104809 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-66dedb75-d6d1-49d4-bd67-368ce9ec5a28 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452" status: 200 len: 1402 microversion: 2.1 time: 0.314832 Oct 05 02:33:31.107614 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 749/1491] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:30 2022] GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452 => generated 1402 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:31.115111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e806aeb2-e0a5-49f6-8de8-248441372111 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:31.117638 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e806aeb2-e0a5-49f6-8de8-248441372111 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] [instance: 8b942fed-d4b6-403d-b121-a53278fe83c3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:31.136143 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e806aeb2-e0a5-49f6-8de8-248441372111 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:31.138364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e806aeb2-e0a5-49f6-8de8-248441372111 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:31.140216 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e806aeb2-e0a5-49f6-8de8-248441372111 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:31.142513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e806aeb2-e0a5-49f6-8de8-248441372111 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:31.144295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e806aeb2-e0a5-49f6-8de8-248441372111 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:31.145746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e806aeb2-e0a5-49f6-8de8-248441372111 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:31.232631 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-95ef6891-ba98-4538-aff1-cf6f7821fe55 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.039798 Oct 05 02:33:31.236266 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 743/1492] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 5 02:33:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 3044 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 05 02:33:31.254566 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e8f35225-e422-4d99-b031-9941b9b879fa tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:31.255394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e8f35225-e422-4d99-b031-9941b9b879fa tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:31.414669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e8f35225-e422-4d99-b031-9941b9b879fa tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:31.417146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=51 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:31.425809 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e8f35225-e422-4d99-b031-9941b9b879fa tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:31.428049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e8f35225-e422-4d99-b031-9941b9b879fa tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:31.429690 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e8f35225-e422-4d99-b031-9941b9b879fa tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1103 microversion: 2.25 time: 0.180727 Oct 05 02:33:31.431717 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 744/1493] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:33:31 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1103 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:33:31.449300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b22cceb1-37fe-49ea-b7be-aba3fccdd43f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:31.451510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b22cceb1-37fe-49ea-b7be-aba3fccdd43f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:31.463401 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b22cceb1-37fe-49ea-b7be-aba3fccdd43f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:31.464160 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b22cceb1-37fe-49ea-b7be-aba3fccdd43f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:31.464850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b22cceb1-37fe-49ea-b7be-aba3fccdd43f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:31.465926 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b22cceb1-37fe-49ea-b7be-aba3fccdd43f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:31.467027 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b22cceb1-37fe-49ea-b7be-aba3fccdd43f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:31.467690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b22cceb1-37fe-49ea-b7be-aba3fccdd43f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:31.511203 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e806aeb2-e0a5-49f6-8de8-248441372111 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8c2b48f17b470aaa79d4f4a4a7215c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5e5d31e8a94667b52be18ed414d846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:31.523695 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e806aeb2-e0a5-49f6-8de8-248441372111 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] 10.222.0.16 "GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3" status: 200 len: 1332 microversion: 2.1 time: 0.414745 Oct 05 02:33:31.528985 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 750/1494] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:31 2022] GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3 => generated 1332 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:31.744710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ca43ab4e-5365-49ad-97da-41b19bf557b5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:31.745706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ca43ab4e-5365-49ad-97da-41b19bf557b5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:31.757839 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca43ab4e-5365-49ad-97da-41b19bf557b5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:31.759791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca43ab4e-5365-49ad-97da-41b19bf557b5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:31.761154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca43ab4e-5365-49ad-97da-41b19bf557b5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:31.764423 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca43ab4e-5365-49ad-97da-41b19bf557b5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:31.765575 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca43ab4e-5365-49ad-97da-41b19bf557b5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:31.769607 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca43ab4e-5365-49ad-97da-41b19bf557b5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:31.893548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b22cceb1-37fe-49ea-b7be-aba3fccdd43f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:31.903790 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b22cceb1-37fe-49ea-b7be-aba3fccdd43f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1716 microversion: 2.1 time: 0.470738 Oct 05 02:33:31.915822 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 745/1495] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:31 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1716 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:32.091870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ca43ab4e-5365-49ad-97da-41b19bf557b5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:32.099958 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ca43ab4e-5365-49ad-97da-41b19bf557b5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 200 len: 1308 microversion: 2.1 time: 0.359117 Oct 05 02:33:32.100862 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 751/1496] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:31 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 1308 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:33:32.135806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f7fde048-aa39-4529-a078-1f7532447ee8 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:32.138065 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f7fde048-aa39-4529-a078-1f7532447ee8 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] [instance: b11969e1-8fcb-4287-8d5b-070809e1e452] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:32.157579 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7fde048-aa39-4529-a078-1f7532447ee8 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:32.158490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7fde048-aa39-4529-a078-1f7532447ee8 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:32.159635 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7fde048-aa39-4529-a078-1f7532447ee8 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:32.160653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7fde048-aa39-4529-a078-1f7532447ee8 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:32.161380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7fde048-aa39-4529-a078-1f7532447ee8 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:32.162381 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7fde048-aa39-4529-a078-1f7532447ee8 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:32.407038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f7fde048-aa39-4529-a078-1f7532447ee8 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a262a7ca2be4451a89330098b6134c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a08a51781e84e1eb215037744ee3a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:32.422757 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f7fde048-aa39-4529-a078-1f7532447ee8 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452" status: 200 len: 1402 microversion: 2.1 time: 0.292721 Oct 05 02:33:32.423977 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 746/1497] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:32 2022] GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452 => generated 1402 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:32.460296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fce74f3f-ef80-4b49-bbad-1db3dc0d4b3f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:32.461510 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fce74f3f-ef80-4b49-bbad-1db3dc0d4b3f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:32.471047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fce74f3f-ef80-4b49-bbad-1db3dc0d4b3f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:32.471889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fce74f3f-ef80-4b49-bbad-1db3dc0d4b3f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:32.472580 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fce74f3f-ef80-4b49-bbad-1db3dc0d4b3f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:32.473975 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fce74f3f-ef80-4b49-bbad-1db3dc0d4b3f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:32.474563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fce74f3f-ef80-4b49-bbad-1db3dc0d4b3f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:32.475080 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fce74f3f-ef80-4b49-bbad-1db3dc0d4b3f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:32.546523 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-89df8ad6-6554-4c86-9704-6d631a5e6a4d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:32.547139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-89df8ad6-6554-4c86-9704-6d631a5e6a4d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] [instance: 8b942fed-d4b6-403d-b121-a53278fe83c3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:32.553530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89df8ad6-6554-4c86-9704-6d631a5e6a4d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:32.554379 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89df8ad6-6554-4c86-9704-6d631a5e6a4d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:32.555074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89df8ad6-6554-4c86-9704-6d631a5e6a4d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:32.555786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89df8ad6-6554-4c86-9704-6d631a5e6a4d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:32.556253 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89df8ad6-6554-4c86-9704-6d631a5e6a4d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:32.556855 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89df8ad6-6554-4c86-9704-6d631a5e6a4d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:32.576057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fce74f3f-ef80-4b49-bbad-1db3dc0d4b3f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:32.589086 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fce74f3f-ef80-4b49-bbad-1db3dc0d4b3f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:32.591709 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fce74f3f-ef80-4b49-bbad-1db3dc0d4b3f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:32.592844 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fce74f3f-ef80-4b49-bbad-1db3dc0d4b3f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1184 microversion: 2.25 time: 0.136768 Oct 05 02:33:32.593610 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 752/1498] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:33:32 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1184 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:33:32.807461 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-89df8ad6-6554-4c86-9704-6d631a5e6a4d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8c2b48f17b470aaa79d4f4a4a7215c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5e5d31e8a94667b52be18ed414d846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:32.821802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-e56e5a70-ae9b-4a36-a0b9-d819939124f7 req-5dddd7ec-1507-46dd-94ab-197c0cebd79a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b11969e1-8fcb-4287-8d5b-070809e1e452", "tag": "91278f9d-a729-4911-9a6a-5d6cedbc2b96"}, {"name": "network-changed", "server_uuid": "8b942fed-d4b6-403d-b121-a53278fe83c3", "tag": "7e37d2c3-c78d-464d-858e-6d91f57fa6d5"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:32.842948 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-89df8ad6-6554-4c86-9704-6d631a5e6a4d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] 10.222.0.16 "GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3" status: 200 len: 1332 microversion: 2.1 time: 0.296834 Oct 05 02:33:32.843607 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 747/1499] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:32 2022] GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3 => generated 1332 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:33:32.849018 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e56e5a70-ae9b-4a36-a0b9-d819939124f7 req-5dddd7ec-1507-46dd-94ab-197c0cebd79a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:32.849513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e56e5a70-ae9b-4a36-a0b9-d819939124f7 req-5dddd7ec-1507-46dd-94ab-197c0cebd79a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:32.849949 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e56e5a70-ae9b-4a36-a0b9-d819939124f7 req-5dddd7ec-1507-46dd-94ab-197c0cebd79a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:32.868145 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-e56e5a70-ae9b-4a36-a0b9-d819939124f7 req-5dddd7ec-1507-46dd-94ab-197c0cebd79a service nova] Creating event network-changed:91278f9d-a729-4911-9a6a-5d6cedbc2b96 for instance b11969e1-8fcb-4287-8d5b-070809e1e452 on n-h1-858272-3 Oct 05 02:33:32.869052 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-e56e5a70-ae9b-4a36-a0b9-d819939124f7 req-5dddd7ec-1507-46dd-94ab-197c0cebd79a service nova] Creating event network-changed:7e37d2c3-c78d-464d-858e-6d91f57fa6d5 for instance 8b942fed-d4b6-403d-b121-a53278fe83c3 on n-h2-858272-3 Oct 05 02:33:32.883704 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-e56e5a70-ae9b-4a36-a0b9-d819939124f7 req-5dddd7ec-1507-46dd-94ab-197c0cebd79a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.066573 Oct 05 02:33:32.884916 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 753/1500] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:33:32.945053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-69f38e5a-56f4-4014-903d-eca8cb0e3191 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:32.946286 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-69f38e5a-56f4-4014-903d-eca8cb0e3191 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:32.954854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69f38e5a-56f4-4014-903d-eca8cb0e3191 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:32.956304 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69f38e5a-56f4-4014-903d-eca8cb0e3191 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:32.957006 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69f38e5a-56f4-4014-903d-eca8cb0e3191 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:32.960149 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69f38e5a-56f4-4014-903d-eca8cb0e3191 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:32.960973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69f38e5a-56f4-4014-903d-eca8cb0e3191 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:32.961893 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69f38e5a-56f4-4014-903d-eca8cb0e3191 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:33.125002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ad90cc4d-50e7-4e56-b147-ee1a6cdf9e9b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:33.125777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ad90cc4d-50e7-4e56-b147-ee1a6cdf9e9b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:33.131658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=58 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:33.134073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad90cc4d-50e7-4e56-b147-ee1a6cdf9e9b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:33.134794 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad90cc4d-50e7-4e56-b147-ee1a6cdf9e9b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:33.136462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad90cc4d-50e7-4e56-b147-ee1a6cdf9e9b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:33.137005 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad90cc4d-50e7-4e56-b147-ee1a6cdf9e9b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:33.138553 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad90cc4d-50e7-4e56-b147-ee1a6cdf9e9b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:33.139353 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad90cc4d-50e7-4e56-b147-ee1a6cdf9e9b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:33.252624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-69f38e5a-56f4-4014-903d-eca8cb0e3191 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:33.261280 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-69f38e5a-56f4-4014-903d-eca8cb0e3191 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1716 microversion: 2.1 time: 0.320998 Oct 05 02:33:33.265867 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 748/1501] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:32 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1716 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:33.406782 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ad90cc4d-50e7-4e56-b147-ee1a6cdf9e9b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:33.420203 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ad90cc4d-50e7-4e56-b147-ee1a6cdf9e9b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 200 len: 1308 microversion: 2.1 time: 0.300157 Oct 05 02:33:33.435644 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 754/1502] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:33 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 1308 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:33.456138 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cf07de12-9a02-4ceb-9097-87de29c4c49f tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:33.456867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cf07de12-9a02-4ceb-9097-87de29c4c49f tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] [instance: b11969e1-8fcb-4287-8d5b-070809e1e452] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:33.473357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf07de12-9a02-4ceb-9097-87de29c4c49f tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:33.474084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf07de12-9a02-4ceb-9097-87de29c4c49f tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:33.474843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf07de12-9a02-4ceb-9097-87de29c4c49f tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:33.475888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf07de12-9a02-4ceb-9097-87de29c4c49f tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:33.476578 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf07de12-9a02-4ceb-9097-87de29c4c49f tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:33.477131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf07de12-9a02-4ceb-9097-87de29c4c49f tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:33.705438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cf07de12-9a02-4ceb-9097-87de29c4c49f tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a262a7ca2be4451a89330098b6134c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a08a51781e84e1eb215037744ee3a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:33.716562 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cf07de12-9a02-4ceb-9097-87de29c4c49f tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452" status: 200 len: 1402 microversion: 2.1 time: 0.272464 Oct 05 02:33:33.719121 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 749/1503] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:33 2022] GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452 => generated 1402 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:33.731766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1ca86147-edb4-4bc3-9c85-ac1bbb5d9330 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:33.732967 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1ca86147-edb4-4bc3-9c85-ac1bbb5d9330 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:33.750588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1ca86147-edb4-4bc3-9c85-ac1bbb5d9330 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:33.751928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1ca86147-edb4-4bc3-9c85-ac1bbb5d9330 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:33.753844 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1ca86147-edb4-4bc3-9c85-ac1bbb5d9330 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:33.754916 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1ca86147-edb4-4bc3-9c85-ac1bbb5d9330 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:33.757535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1ca86147-edb4-4bc3-9c85-ac1bbb5d9330 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:33.758282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1ca86147-edb4-4bc3-9c85-ac1bbb5d9330 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:33.783319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-eb985e80-5247-41cb-8b77-3d887d0c7244 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Action: 'create', calling method: .version_select at 0x7fccdfcdcee0>, body: {"keypair": {"name": "tempest-keypair-1010722893", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMHgN4+d1f7dL5TTJg16EIyivyjEQRrRaM4M+hQDCp0pFiebNvtb8HDDAPftaoZD4LxdjEAhvsPZKwTF8sAJsH8i/VbcLe92FeRTQBULzIUh4VLKkq3gdyQwHMC4XE3tw=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:33.824774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-eb985e80-5247-41cb-8b77-3d887d0c7244 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Getting quotas for project d4276a8be8c541159a4d1d575995dcc6. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:33:33.835384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-eb985e80-5247-41cb-8b77-3d887d0c7244 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Getting quotas for user 6c889d2c39af44c693a3c15b5ba4bca9 and project d4276a8be8c541159a4d1d575995dcc6. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:33:33.869790 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-eb985e80-5247-41cb-8b77-3d887d0c7244 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.407644 Oct 05 02:33:33.878295 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 755/1504] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 02:33:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:33:33.883927 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b4a2d60d-3053-4123-acd9-712581e97814 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:33.884813 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b4a2d60d-3053-4123-acd9-712581e97814 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] [instance: 8b942fed-d4b6-403d-b121-a53278fe83c3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:33.893632 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4a2d60d-3053-4123-acd9-712581e97814 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:33.894212 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4a2d60d-3053-4123-acd9-712581e97814 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:33.894928 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4a2d60d-3053-4123-acd9-712581e97814 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:33.895906 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4a2d60d-3053-4123-acd9-712581e97814 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:33.897165 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4a2d60d-3053-4123-acd9-712581e97814 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:33.897824 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4a2d60d-3053-4123-acd9-712581e97814 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:33.904320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1ca86147-edb4-4bc3-9c85-ac1bbb5d9330 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:33.916839 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1ca86147-edb4-4bc3-9c85-ac1bbb5d9330 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:33.918323 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1ca86147-edb4-4bc3-9c85-ac1bbb5d9330 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:33.919490 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1ca86147-edb4-4bc3-9c85-ac1bbb5d9330 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1184 microversion: 2.25 time: 0.198217 Oct 05 02:33:33.925886 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 750/1505] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:33:33 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1184 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:33:34.157353 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b4a2d60d-3053-4123-acd9-712581e97814 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8c2b48f17b470aaa79d4f4a4a7215c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5e5d31e8a94667b52be18ed414d846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:34.165817 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b4a2d60d-3053-4123-acd9-712581e97814 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] 10.222.0.16 "GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3" status: 200 len: 1332 microversion: 2.1 time: 0.285954 Oct 05 02:33:34.166690 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 756/1506] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:33 2022] GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3 => generated 1332 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:34.290468 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9893a8db-3f2e-4fe7-83a0-18a1e59481b1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:34.291596 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9893a8db-3f2e-4fe7-83a0-18a1e59481b1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:34.304459 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9893a8db-3f2e-4fe7-83a0-18a1e59481b1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:34.313353 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9893a8db-3f2e-4fe7-83a0-18a1e59481b1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:34.313917 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9893a8db-3f2e-4fe7-83a0-18a1e59481b1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:34.314753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9893a8db-3f2e-4fe7-83a0-18a1e59481b1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:34.315298 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9893a8db-3f2e-4fe7-83a0-18a1e59481b1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:34.315799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9893a8db-3f2e-4fe7-83a0-18a1e59481b1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:34.445833 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c322fdfc-d39b-451a-8b3a-89bc4cbdadc4 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:34.446193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c322fdfc-d39b-451a-8b3a-89bc4cbdadc4 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:34.457384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c322fdfc-d39b-451a-8b3a-89bc4cbdadc4 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:34.457883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c322fdfc-d39b-451a-8b3a-89bc4cbdadc4 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:34.458833 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c322fdfc-d39b-451a-8b3a-89bc4cbdadc4 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:34.459006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c322fdfc-d39b-451a-8b3a-89bc4cbdadc4 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:34.459451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c322fdfc-d39b-451a-8b3a-89bc4cbdadc4 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:34.459876 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c322fdfc-d39b-451a-8b3a-89bc4cbdadc4 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:34.516826 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9893a8db-3f2e-4fe7-83a0-18a1e59481b1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:34.528276 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9893a8db-3f2e-4fe7-83a0-18a1e59481b1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1716 microversion: 2.1 time: 0.241636 Oct 05 02:33:34.533920 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 751/1507] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:34 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1716 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:34.715866 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c322fdfc-d39b-451a-8b3a-89bc4cbdadc4 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:34.726628 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c322fdfc-d39b-451a-8b3a-89bc4cbdadc4 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 200 len: 1308 microversion: 2.1 time: 0.286587 Oct 05 02:33:34.729163 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 757/1508] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:34 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 1308 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:33:34.752543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0e102966-834c-44f5-9c0f-6763ca6c80cb tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:34.760335 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0e102966-834c-44f5-9c0f-6763ca6c80cb tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] [instance: b11969e1-8fcb-4287-8d5b-070809e1e452] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:34.771320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e102966-834c-44f5-9c0f-6763ca6c80cb tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:34.772342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e102966-834c-44f5-9c0f-6763ca6c80cb tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:34.772790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e102966-834c-44f5-9c0f-6763ca6c80cb tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:34.773715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e102966-834c-44f5-9c0f-6763ca6c80cb tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:34.774185 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e102966-834c-44f5-9c0f-6763ca6c80cb tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:34.774626 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e102966-834c-44f5-9c0f-6763ca6c80cb tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:34.955002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a3bd04c5-f789-4259-aded-f2c78fbde481 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:34.955800 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a3bd04c5-f789-4259-aded-f2c78fbde481 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:34.962267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3bd04c5-f789-4259-aded-f2c78fbde481 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:34.962994 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3bd04c5-f789-4259-aded-f2c78fbde481 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:34.963889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3bd04c5-f789-4259-aded-f2c78fbde481 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:34.964799 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3bd04c5-f789-4259-aded-f2c78fbde481 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:34.966370 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3bd04c5-f789-4259-aded-f2c78fbde481 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:34.967563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3bd04c5-f789-4259-aded-f2c78fbde481 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:34.973310 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0e102966-834c-44f5-9c0f-6763ca6c80cb tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a262a7ca2be4451a89330098b6134c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a08a51781e84e1eb215037744ee3a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:34.996305 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0e102966-834c-44f5-9c0f-6763ca6c80cb tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452" status: 200 len: 1402 microversion: 2.1 time: 0.246867 Oct 05 02:33:34.998145 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 752/1509] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:34 2022] GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452 => generated 1402 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:35.077483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a3bd04c5-f789-4259-aded-f2c78fbde481 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:35.089179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a3bd04c5-f789-4259-aded-f2c78fbde481 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:35.091847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a3bd04c5-f789-4259-aded-f2c78fbde481 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:35.093788 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a3bd04c5-f789-4259-aded-f2c78fbde481 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1232 microversion: 2.25 time: 0.143320 Oct 05 02:33:35.094899 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 758/1510] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:33:34 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1232 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:33:35.191703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6de368df-e5d5-4a68-ac21-d098f86ac5ed tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:35.192416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6de368df-e5d5-4a68-ac21-d098f86ac5ed tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] [instance: 8b942fed-d4b6-403d-b121-a53278fe83c3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:35.221187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6de368df-e5d5-4a68-ac21-d098f86ac5ed tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:35.240362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6de368df-e5d5-4a68-ac21-d098f86ac5ed tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:35.240362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6de368df-e5d5-4a68-ac21-d098f86ac5ed tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:35.241745 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6de368df-e5d5-4a68-ac21-d098f86ac5ed tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:35.244108 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6de368df-e5d5-4a68-ac21-d098f86ac5ed tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:35.245523 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6de368df-e5d5-4a68-ac21-d098f86ac5ed tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:35.574855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f9a7afce-14e6-4719-bccf-9234f2bf648e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:35.576794 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f9a7afce-14e6-4719-bccf-9234f2bf648e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:35.607435 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9a7afce-14e6-4719-bccf-9234f2bf648e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:35.607959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9a7afce-14e6-4719-bccf-9234f2bf648e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:35.608399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9a7afce-14e6-4719-bccf-9234f2bf648e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:35.611782 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9a7afce-14e6-4719-bccf-9234f2bf648e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:35.612281 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9a7afce-14e6-4719-bccf-9234f2bf648e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:35.612719 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9a7afce-14e6-4719-bccf-9234f2bf648e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:35.672626 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6de368df-e5d5-4a68-ac21-d098f86ac5ed tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8c2b48f17b470aaa79d4f4a4a7215c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5e5d31e8a94667b52be18ed414d846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:35.689785 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6de368df-e5d5-4a68-ac21-d098f86ac5ed tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] 10.222.0.16 "GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3" status: 200 len: 1332 microversion: 2.1 time: 0.499728 Oct 05 02:33:35.692716 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 753/1511] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:35 2022] GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3 => generated 1332 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:35.755207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-54beeae3-25c2-4573-b527-a9bc3be682b4 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:35.756678 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-54beeae3-25c2-4573-b527-a9bc3be682b4 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:35.771932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54beeae3-25c2-4573-b527-a9bc3be682b4 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:35.773374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54beeae3-25c2-4573-b527-a9bc3be682b4 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:35.775146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54beeae3-25c2-4573-b527-a9bc3be682b4 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:35.776165 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54beeae3-25c2-4573-b527-a9bc3be682b4 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:35.777469 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54beeae3-25c2-4573-b527-a9bc3be682b4 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:35.779892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54beeae3-25c2-4573-b527-a9bc3be682b4 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:36.290459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f9a7afce-14e6-4719-bccf-9234f2bf648e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:36.305183 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f9a7afce-14e6-4719-bccf-9234f2bf648e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1716 microversion: 2.1 time: 0.743804 Oct 05 02:33:36.306324 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 759/1512] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:35 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1716 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:33:36.320108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d3f10117-dd1d-418e-8027-675dce5025bd tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:36.321043 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d3f10117-dd1d-418e-8027-675dce5025bd tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] [instance: b11969e1-8fcb-4287-8d5b-070809e1e452] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:36.343859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d3f10117-dd1d-418e-8027-675dce5025bd tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:36.344364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d3f10117-dd1d-418e-8027-675dce5025bd tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:36.344806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d3f10117-dd1d-418e-8027-675dce5025bd tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:36.348045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d3f10117-dd1d-418e-8027-675dce5025bd tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:36.348532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d3f10117-dd1d-418e-8027-675dce5025bd tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:36.349006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d3f10117-dd1d-418e-8027-675dce5025bd tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:36.379238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-54beeae3-25c2-4573-b527-a9bc3be682b4 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:36.388279 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-54beeae3-25c2-4573-b527-a9bc3be682b4 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 200 len: 1308 microversion: 2.1 time: 0.638217 Oct 05 02:33:36.388870 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 754/1513] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:35 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 1308 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:36.393428 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-37365f4d-e994-489e-b114-a5ecf5b37c59 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:36.403368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-37365f4d-e994-489e-b114-a5ecf5b37c59 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:36.427997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-37365f4d-e994-489e-b114-a5ecf5b37c59 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:36.428934 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-37365f4d-e994-489e-b114-a5ecf5b37c59 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:36.432576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-37365f4d-e994-489e-b114-a5ecf5b37c59 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:36.433228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-37365f4d-e994-489e-b114-a5ecf5b37c59 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:36.434026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-37365f4d-e994-489e-b114-a5ecf5b37c59 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:36.438910 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-37365f4d-e994-489e-b114-a5ecf5b37c59 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:37.042773 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d3f10117-dd1d-418e-8027-675dce5025bd tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a262a7ca2be4451a89330098b6134c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a08a51781e84e1eb215037744ee3a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:37.052441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-37365f4d-e994-489e-b114-a5ecf5b37c59 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:37.070072 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d3f10117-dd1d-418e-8027-675dce5025bd tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452" status: 200 len: 1402 microversion: 2.1 time: 0.761108 Oct 05 02:33:37.074412 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 760/1514] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:36 2022] GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452 => generated 1402 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:37.096302 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8509856e-e43c-4641-a850-537eb2b0c363 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:37.098617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8509856e-e43c-4641-a850-537eb2b0c363 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] [instance: 8b942fed-d4b6-403d-b121-a53278fe83c3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:37.103380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-37365f4d-e994-489e-b114-a5ecf5b37c59 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:37.110211 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-37365f4d-e994-489e-b114-a5ecf5b37c59 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:37.112700 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-37365f4d-e994-489e-b114-a5ecf5b37c59 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1250 microversion: 2.25 time: 0.722802 Oct 05 02:33:37.114182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8509856e-e43c-4641-a850-537eb2b0c363 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:37.114694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8509856e-e43c-4641-a850-537eb2b0c363 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:37.117546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8509856e-e43c-4641-a850-537eb2b0c363 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:37.118217 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 755/1515] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:33:36 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1250 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:33:37.121371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8509856e-e43c-4641-a850-537eb2b0c363 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:37.121990 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8509856e-e43c-4641-a850-537eb2b0c363 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:37.122620 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8509856e-e43c-4641-a850-537eb2b0c363 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:37.331970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-be23a68a-1a46-447a-a3fe-951fed4ad11e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:37.332759 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-be23a68a-1a46-447a-a3fe-951fed4ad11e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:37.343591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be23a68a-1a46-447a-a3fe-951fed4ad11e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:37.359308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be23a68a-1a46-447a-a3fe-951fed4ad11e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:37.359968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be23a68a-1a46-447a-a3fe-951fed4ad11e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:37.361537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be23a68a-1a46-447a-a3fe-951fed4ad11e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:37.368016 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be23a68a-1a46-447a-a3fe-951fed4ad11e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:37.369395 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be23a68a-1a46-447a-a3fe-951fed4ad11e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:37.925550 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8509856e-e43c-4641-a850-537eb2b0c363 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8c2b48f17b470aaa79d4f4a4a7215c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5e5d31e8a94667b52be18ed414d846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:37.940696 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8509856e-e43c-4641-a850-537eb2b0c363 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] 10.222.0.16 "GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3" status: 200 len: 1332 microversion: 2.1 time: 0.864295 Oct 05 02:33:37.942248 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 761/1516] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:37 2022] GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3 => generated 1332 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:37.953981 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-98b50d5c-189f-4cc0-b4db-4756d3b10cbb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:37.954530 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-98b50d5c-189f-4cc0-b4db-4756d3b10cbb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:37.973012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98b50d5c-189f-4cc0-b4db-4756d3b10cbb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:37.973789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98b50d5c-189f-4cc0-b4db-4756d3b10cbb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:37.974405 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98b50d5c-189f-4cc0-b4db-4756d3b10cbb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:37.975322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98b50d5c-189f-4cc0-b4db-4756d3b10cbb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:37.975943 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98b50d5c-189f-4cc0-b4db-4756d3b10cbb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:37.976615 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98b50d5c-189f-4cc0-b4db-4756d3b10cbb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:39.144539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-98b50d5c-189f-4cc0-b4db-4756d3b10cbb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:39.146435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-be23a68a-1a46-447a-a3fe-951fed4ad11e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:39.164470 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-98b50d5c-189f-4cc0-b4db-4756d3b10cbb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 200 len: 1308 microversion: 2.1 time: 1.221033 Oct 05 02:33:39.172423 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-be23a68a-1a46-447a-a3fe-951fed4ad11e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1716 microversion: 2.1 time: 1.844642 Oct 05 02:33:39.174654 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 756/1517] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:37 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1716 bytes in 1848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:33:39.185750 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 762/1518] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:37 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 1308 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:39.195843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7e8eaaf4-8114-4bcf-bdf2-df3aba3353db tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:39.196518 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7e8eaaf4-8114-4bcf-bdf2-df3aba3353db tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] [instance: b11969e1-8fcb-4287-8d5b-070809e1e452] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:39.203871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a8d63c65-1db3-473d-957e-eef57cc63ef4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:39.209933 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e8eaaf4-8114-4bcf-bdf2-df3aba3353db tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:39.210924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a8d63c65-1db3-473d-957e-eef57cc63ef4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:39.213054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e8eaaf4-8114-4bcf-bdf2-df3aba3353db tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:39.213676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e8eaaf4-8114-4bcf-bdf2-df3aba3353db tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:39.216191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e8eaaf4-8114-4bcf-bdf2-df3aba3353db tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:39.219475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e8eaaf4-8114-4bcf-bdf2-df3aba3353db tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:39.221608 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e8eaaf4-8114-4bcf-bdf2-df3aba3353db tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:39.222133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8d63c65-1db3-473d-957e-eef57cc63ef4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:39.222879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8d63c65-1db3-473d-957e-eef57cc63ef4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:39.225668 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8d63c65-1db3-473d-957e-eef57cc63ef4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:39.226540 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8d63c65-1db3-473d-957e-eef57cc63ef4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:39.227132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8d63c65-1db3-473d-957e-eef57cc63ef4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:39.229523 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8d63c65-1db3-473d-957e-eef57cc63ef4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:39.238309 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:39.782515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7e8eaaf4-8114-4bcf-bdf2-df3aba3353db tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a262a7ca2be4451a89330098b6134c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a08a51781e84e1eb215037744ee3a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:39.796309 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7e8eaaf4-8114-4bcf-bdf2-df3aba3353db tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452" status: 200 len: 1402 microversion: 2.1 time: 0.618217 Oct 05 02:33:39.796936 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 757/1519] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:39 2022] GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452 => generated 1402 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:39.815357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-d049a91e-e2ff-4fc0-9793-1d5321a0d68b req-3b256479-af03-4f4d-91cb-a047a5c4ba52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "031f6a33-bf9c-4b51-bf79-3764d67846e4", "name": "network-vif-plugged", "status": "completed", "tag": "db9891a1-497f-4f63-882e-e84d19c9e5f2"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:39.835943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d049a91e-e2ff-4fc0-9793-1d5321a0d68b req-3b256479-af03-4f4d-91cb-a047a5c4ba52 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:39.836601 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d049a91e-e2ff-4fc0-9793-1d5321a0d68b req-3b256479-af03-4f4d-91cb-a047a5c4ba52 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:39.837082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d049a91e-e2ff-4fc0-9793-1d5321a0d68b req-3b256479-af03-4f4d-91cb-a047a5c4ba52 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:39.853738 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-d049a91e-e2ff-4fc0-9793-1d5321a0d68b req-3b256479-af03-4f4d-91cb-a047a5c4ba52 service nova] Creating event network-vif-plugged:db9891a1-497f-4f63-882e-e84d19c9e5f2 for instance 031f6a33-bf9c-4b51-bf79-3764d67846e4 on n-h2-858272-3 Oct 05 02:33:39.870091 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-d049a91e-e2ff-4fc0-9793-1d5321a0d68b req-3b256479-af03-4f4d-91cb-a047a5c4ba52 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071900 Oct 05 02:33:39.870713 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 758/1520] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:33:39.880605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-68528269-87fc-4c37-bb0b-2bcd26019c3d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:39.881577 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-68528269-87fc-4c37-bb0b-2bcd26019c3d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] [instance: 8b942fed-d4b6-403d-b121-a53278fe83c3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:39.892375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68528269-87fc-4c37-bb0b-2bcd26019c3d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:39.893424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68528269-87fc-4c37-bb0b-2bcd26019c3d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:39.894046 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68528269-87fc-4c37-bb0b-2bcd26019c3d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:39.895335 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68528269-87fc-4c37-bb0b-2bcd26019c3d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:39.896278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68528269-87fc-4c37-bb0b-2bcd26019c3d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:39.896876 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68528269-87fc-4c37-bb0b-2bcd26019c3d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:39.958672 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a8d63c65-1db3-473d-957e-eef57cc63ef4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:39.972814 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a8d63c65-1db3-473d-957e-eef57cc63ef4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:39.979521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a8d63c65-1db3-473d-957e-eef57cc63ef4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:39.990849 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a8d63c65-1db3-473d-957e-eef57cc63ef4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1292 microversion: 2.25 time: 0.803030 Oct 05 02:33:39.993817 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 763/1521] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:33:39 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1292 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:33:40.166416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dca0c4e0-c776-4bc6-8d61-bc94af64c5d2 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1445176627", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "56b199ac-5a6b-46c9-8746-597e251514be"}], "security_groups": [{"name": "tempest-securitygroup--1591080487"}], "key_name": "tempest-keypair-1010722893", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:40.226508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-68528269-87fc-4c37-bb0b-2bcd26019c3d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8c2b48f17b470aaa79d4f4a4a7215c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5e5d31e8a94667b52be18ed414d846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:40.244042 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-68528269-87fc-4c37-bb0b-2bcd26019c3d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] 10.222.0.16 "GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3" status: 200 len: 1332 microversion: 2.1 time: 0.370315 Oct 05 02:33:40.259373 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 759/1522] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:39 2022] GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3 => generated 1332 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:40.273805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c9396657-f14f-47f5-912b-912e7a5d2dcf tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:40.275199 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c9396657-f14f-47f5-912b-912e7a5d2dcf tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:40.297356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c9396657-f14f-47f5-912b-912e7a5d2dcf tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:40.299592 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c9396657-f14f-47f5-912b-912e7a5d2dcf tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:40.303322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c9396657-f14f-47f5-912b-912e7a5d2dcf tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:40.304315 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c9396657-f14f-47f5-912b-912e7a5d2dcf tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:40.304986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c9396657-f14f-47f5-912b-912e7a5d2dcf tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:40.306073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c9396657-f14f-47f5-912b-912e7a5d2dcf tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:40.554547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-dca0c4e0-c776-4bc6-8d61-bc94af64c5d2 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] validate_networks() for [('56b199ac-5a6b-46c9-8746-597e251514be', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:33:40.700939 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=12 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:40.814801 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c9396657-f14f-47f5-912b-912e7a5d2dcf tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:40.830625 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c9396657-f14f-47f5-912b-912e7a5d2dcf tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 200 len: 1308 microversion: 2.1 time: 0.570027 Oct 05 02:33:40.832322 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 760/1523] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:40 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 1308 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:40.849024 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-07271122-f39d-430c-bb32-ab04116c691f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:40.854974 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-07271122-f39d-430c-bb32-ab04116c691f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:40.875922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07271122-f39d-430c-bb32-ab04116c691f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:40.878081 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07271122-f39d-430c-bb32-ab04116c691f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:40.880942 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07271122-f39d-430c-bb32-ab04116c691f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:40.883365 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07271122-f39d-430c-bb32-ab04116c691f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:40.886034 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07271122-f39d-430c-bb32-ab04116c691f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:40.889430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07271122-f39d-430c-bb32-ab04116c691f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:40.983766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:41.459629 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:41.799275 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-07271122-f39d-430c-bb32-ab04116c691f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:41.814001 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-07271122-f39d-430c-bb32-ab04116c691f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1716 microversion: 2.1 time: 0.979166 Oct 05 02:33:41.825918 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 761/1524] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:40 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1716 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:41.832295 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3de53f5f-4fff-468c-9fd7-3b7a740132df tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:41.833879 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3de53f5f-4fff-468c-9fd7-3b7a740132df tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] [instance: b11969e1-8fcb-4287-8d5b-070809e1e452] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:41.851634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3de53f5f-4fff-468c-9fd7-3b7a740132df tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:41.853835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3de53f5f-4fff-468c-9fd7-3b7a740132df tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:41.853835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3de53f5f-4fff-468c-9fd7-3b7a740132df tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:41.853835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3de53f5f-4fff-468c-9fd7-3b7a740132df tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:41.857578 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3de53f5f-4fff-468c-9fd7-3b7a740132df tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:41.857762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3de53f5f-4fff-468c-9fd7-3b7a740132df tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:42.540673 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3de53f5f-4fff-468c-9fd7-3b7a740132df tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a262a7ca2be4451a89330098b6134c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a08a51781e84e1eb215037744ee3a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:42.550700 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3de53f5f-4fff-468c-9fd7-3b7a740132df tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452" status: 200 len: 1402 microversion: 2.1 time: 0.731477 Oct 05 02:33:42.551306 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 762/1525] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:41 2022] GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452 => generated 1402 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:42.561262 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-182ac7c0-2706-454e-8e37-fb81a8848075 req-72e10861-a5ed-40d0-b728-bf6f1782c8d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a19871a-12bc-45d8-ad01-489ad68f1e00", "name": "network-vif-unplugged", "status": "completed", "tag": "c4608021-f3cf-466d-92f8-ca22a3a9526d"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:42.580027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-dca0c4e0-c776-4bc6-8d61-bc94af64c5d2 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:33:42.580548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-dca0c4e0-c776-4bc6-8d61-bc94af64c5d2 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:33:42.580992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-dca0c4e0-c776-4bc6-8d61-bc94af64c5d2 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:33:42.581605 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-dca0c4e0-c776-4bc6-8d61-bc94af64c5d2 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:33:42.582374 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-dca0c4e0-c776-4bc6-8d61-bc94af64c5d2 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:33:42.585076 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-182ac7c0-2706-454e-8e37-fb81a8848075 req-72e10861-a5ed-40d0-b728-bf6f1782c8d2 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:42.587254 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-182ac7c0-2706-454e-8e37-fb81a8848075 req-72e10861-a5ed-40d0-b728-bf6f1782c8d2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:42.587822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-182ac7c0-2706-454e-8e37-fb81a8848075 req-72e10861-a5ed-40d0-b728-bf6f1782c8d2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:42.608796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dca0c4e0-c776-4bc6-8d61-bc94af64c5d2 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:42.609497 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dca0c4e0-c776-4bc6-8d61-bc94af64c5d2 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:42.610168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dca0c4e0-c776-4bc6-8d61-bc94af64c5d2 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:42.611089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dca0c4e0-c776-4bc6-8d61-bc94af64c5d2 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:42.611716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dca0c4e0-c776-4bc6-8d61-bc94af64c5d2 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:42.612352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dca0c4e0-c776-4bc6-8d61-bc94af64c5d2 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:42.617907 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-182ac7c0-2706-454e-8e37-fb81a8848075 req-72e10861-a5ed-40d0-b728-bf6f1782c8d2 service nova] Creating event network-vif-unplugged:c4608021-f3cf-466d-92f8-ca22a3a9526d for instance 9a19871a-12bc-45d8-ad01-489ad68f1e00 on n-h1-858272-3 Oct 05 02:33:42.630845 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-182ac7c0-2706-454e-8e37-fb81a8848075 req-72e10861-a5ed-40d0-b728-bf6f1782c8d2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078273 Oct 05 02:33:42.633296 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 763/1526] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:33:42.654933 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-0f0b5c0a-08d1-44fe-a90a-99142c1c429d req-c71ff0e3-bea1-47d5-bcc7-923568bb3225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a786593b-2c6f-4bc5-b338-8715c7d0429f", "tag": "d0b44992-5d97-49da-98a0-6facb5cee1a2"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:42.672694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-dca0c4e0-c776-4bc6-8d61-bc94af64c5d2 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Getting quotas for project d4276a8be8c541159a4d1d575995dcc6. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:33:42.676014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-0f0b5c0a-08d1-44fe-a90a-99142c1c429d req-c71ff0e3-bea1-47d5-bcc7-923568bb3225 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:42.677710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-0f0b5c0a-08d1-44fe-a90a-99142c1c429d req-c71ff0e3-bea1-47d5-bcc7-923568bb3225 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:42.684326 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-0f0b5c0a-08d1-44fe-a90a-99142c1c429d req-c71ff0e3-bea1-47d5-bcc7-923568bb3225 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:42.688042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:42.689544 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-dca0c4e0-c776-4bc6-8d61-bc94af64c5d2 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Getting quotas for user 6c889d2c39af44c693a3c15b5ba4bca9 and project d4276a8be8c541159a4d1d575995dcc6. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:33:42.704115 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-0f0b5c0a-08d1-44fe-a90a-99142c1c429d req-c71ff0e3-bea1-47d5-bcc7-923568bb3225 service nova] Creating event network-changed:d0b44992-5d97-49da-98a0-6facb5cee1a2 for instance a786593b-2c6f-4bc5-b338-8715c7d0429f on n-h1-858272-3 Oct 05 02:33:42.725322 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-0f0b5c0a-08d1-44fe-a90a-99142c1c429d req-c71ff0e3-bea1-47d5-bcc7-923568bb3225 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082394 Oct 05 02:33:42.733452 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 764/1527] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:33:42.734433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-dca0c4e0-c776-4bc6-8d61-bc94af64c5d2 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:33:42.740186 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-dca0c4e0-c776-4bc6-8d61-bc94af64c5d2 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 99fb0801-33dd-4993-a8d9-18a43e372684] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:33:42.743143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b8baeb13-364f-4a68-8df4-94a809c5de84 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:42.753480 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b8baeb13-364f-4a68-8df4-94a809c5de84 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:42.783719 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:42.787738 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8baeb13-364f-4a68-8df4-94a809c5de84 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:42.789524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8baeb13-364f-4a68-8df4-94a809c5de84 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:42.791891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8baeb13-364f-4a68-8df4-94a809c5de84 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:42.795202 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8baeb13-364f-4a68-8df4-94a809c5de84 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:42.797531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8baeb13-364f-4a68-8df4-94a809c5de84 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:42.798739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8baeb13-364f-4a68-8df4-94a809c5de84 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:42.852026 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-dca0c4e0-c776-4bc6-8d61-bc94af64c5d2 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.690408 Oct 05 02:33:42.853283 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 764/1528] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:33:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 2692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 02:33:42.867624 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6777b978-73dd-4071-93bd-def3569b8924 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:42.868515 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6777b978-73dd-4071-93bd-def3569b8924 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] [instance: 8b942fed-d4b6-403d-b121-a53278fe83c3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:42.878245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6777b978-73dd-4071-93bd-def3569b8924 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:42.884680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6777b978-73dd-4071-93bd-def3569b8924 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:42.885391 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6777b978-73dd-4071-93bd-def3569b8924 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:42.902977 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6777b978-73dd-4071-93bd-def3569b8924 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:42.903874 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6777b978-73dd-4071-93bd-def3569b8924 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:42.904536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6777b978-73dd-4071-93bd-def3569b8924 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:43.609906 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6777b978-73dd-4071-93bd-def3569b8924 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8c2b48f17b470aaa79d4f4a4a7215c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5e5d31e8a94667b52be18ed414d846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:43.623859 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6777b978-73dd-4071-93bd-def3569b8924 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] 10.222.0.16 "GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3" status: 200 len: 1332 microversion: 2.1 time: 0.769448 Oct 05 02:33:43.627705 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 765/1529] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:42 2022] GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3 => generated 1332 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:43.642692 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-28cfeab1-f37c-4af5-920c-8c00e0a0625c tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:43.644394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-28cfeab1-f37c-4af5-920c-8c00e0a0625c tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:43.661509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28cfeab1-f37c-4af5-920c-8c00e0a0625c tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:43.664520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28cfeab1-f37c-4af5-920c-8c00e0a0625c tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:43.665243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28cfeab1-f37c-4af5-920c-8c00e0a0625c tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:43.666813 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28cfeab1-f37c-4af5-920c-8c00e0a0625c tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:43.669402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28cfeab1-f37c-4af5-920c-8c00e0a0625c tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:43.670856 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28cfeab1-f37c-4af5-920c-8c00e0a0625c tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:43.705579 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b8baeb13-364f-4a68-8df4-94a809c5de84 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:43.724947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b8baeb13-364f-4a68-8df4-94a809c5de84 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:43.732188 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b8baeb13-364f-4a68-8df4-94a809c5de84 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:43.735390 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b8baeb13-364f-4a68-8df4-94a809c5de84 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1292 microversion: 2.25 time: 1.000030 Oct 05 02:33:43.740920 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 765/1530] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:33:42 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1292 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:33:43.758010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-9a411730-1d16-4b74-ba82-ddd97cdd84f6 req-53f89ff9-3f7e-4c0c-b057-601a30d9274b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b11969e1-8fcb-4287-8d5b-070809e1e452", "name": "network-vif-plugged", "status": "completed", "tag": "91278f9d-a729-4911-9a6a-5d6cedbc2b96"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:43.792101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-9a411730-1d16-4b74-ba82-ddd97cdd84f6 req-53f89ff9-3f7e-4c0c-b057-601a30d9274b service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:43.792603 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-9a411730-1d16-4b74-ba82-ddd97cdd84f6 req-53f89ff9-3f7e-4c0c-b057-601a30d9274b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:43.795306 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-9a411730-1d16-4b74-ba82-ddd97cdd84f6 req-53f89ff9-3f7e-4c0c-b057-601a30d9274b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:43.837084 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-9a411730-1d16-4b74-ba82-ddd97cdd84f6 req-53f89ff9-3f7e-4c0c-b057-601a30d9274b service nova] Creating event network-vif-plugged:91278f9d-a729-4911-9a6a-5d6cedbc2b96 for instance b11969e1-8fcb-4287-8d5b-070809e1e452 on n-h1-858272-3 Oct 05 02:33:43.845325 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-9a411730-1d16-4b74-ba82-ddd97cdd84f6 req-53f89ff9-3f7e-4c0c-b057-601a30d9274b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101957 Oct 05 02:33:43.850261 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 766/1531] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:33:43.864657 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4f042c8b-39ab-4a09-93aa-9462538488cf tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:43.867109 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4f042c8b-39ab-4a09-93aa-9462538488cf tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:43.888207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f042c8b-39ab-4a09-93aa-9462538488cf tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:43.889082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f042c8b-39ab-4a09-93aa-9462538488cf tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:43.890350 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f042c8b-39ab-4a09-93aa-9462538488cf tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:43.892697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f042c8b-39ab-4a09-93aa-9462538488cf tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:43.893304 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f042c8b-39ab-4a09-93aa-9462538488cf tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:43.895535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f042c8b-39ab-4a09-93aa-9462538488cf tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:44.291204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-28cfeab1-f37c-4af5-920c-8c00e0a0625c tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:44.306272 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-28cfeab1-f37c-4af5-920c-8c00e0a0625c tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 200 len: 1488 microversion: 2.1 time: 0.677008 Oct 05 02:33:44.327582 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 766/1532] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:43 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 1488 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:44.347498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bea94311-0cfe-48c0-a0d0-8ac353cfc154 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:44.348141 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bea94311-0cfe-48c0-a0d0-8ac353cfc154 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 99fb0801-33dd-4993-a8d9-18a43e372684] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:44.374381 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bea94311-0cfe-48c0-a0d0-8ac353cfc154 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:44.375505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bea94311-0cfe-48c0-a0d0-8ac353cfc154 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:44.383556 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bea94311-0cfe-48c0-a0d0-8ac353cfc154 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:44.388605 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bea94311-0cfe-48c0-a0d0-8ac353cfc154 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:44.389922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bea94311-0cfe-48c0-a0d0-8ac353cfc154 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:44.393098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bea94311-0cfe-48c0-a0d0-8ac353cfc154 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:44.401472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4f042c8b-39ab-4a09-93aa-9462538488cf tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:44.414311 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4f042c8b-39ab-4a09-93aa-9462538488cf tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1716 microversion: 2.1 time: 0.562473 Oct 05 02:33:44.415376 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 767/1533] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:43 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1716 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:44.420868 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b8519362-04d3-40d2-b34c-983bf3405131 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:44.421554 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b8519362-04d3-40d2-b34c-983bf3405131 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] [instance: b11969e1-8fcb-4287-8d5b-070809e1e452] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:44.427675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8519362-04d3-40d2-b34c-983bf3405131 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:44.428316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8519362-04d3-40d2-b34c-983bf3405131 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:44.428764 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8519362-04d3-40d2-b34c-983bf3405131 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:44.429493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8519362-04d3-40d2-b34c-983bf3405131 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:44.430234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8519362-04d3-40d2-b34c-983bf3405131 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:44.431065 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8519362-04d3-40d2-b34c-983bf3405131 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:44.536893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bea94311-0cfe-48c0-a0d0-8ac353cfc154 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:44.607350 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bea94311-0cfe-48c0-a0d0-8ac353cfc154 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684" status: 200 len: 1294 microversion: 2.1 time: 0.274987 Oct 05 02:33:44.623703 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 767/1534] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:44 2022] GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684 => generated 1294 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:44.630768 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ef6213c2-ffe5-4514-895d-2c29e47a3de2 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:44.651494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef6213c2-ffe5-4514-895d-2c29e47a3de2 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:44.654640 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef6213c2-ffe5-4514-895d-2c29e47a3de2 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:44.655338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef6213c2-ffe5-4514-895d-2c29e47a3de2 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:44.665200 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b8519362-04d3-40d2-b34c-983bf3405131 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a262a7ca2be4451a89330098b6134c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a08a51781e84e1eb215037744ee3a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:44.676704 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b8519362-04d3-40d2-b34c-983bf3405131 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452" status: 200 len: 1402 microversion: 2.1 time: 0.259387 Oct 05 02:33:44.677804 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 768/1535] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:44 2022] GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452 => generated 1402 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:44.796397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-105d1f25-4a5e-4bb0-a32e-031567ee8e0f tempest-FloatingIPDetailsNegativeTestJSON-1992459556 tempest-FloatingIPDetailsNegativeTestJSON-1992459556-project] Calling method '.version_select at 0x7fcce434f040>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:44.818384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ef6213c2-ffe5-4514-895d-2c29e47a3de2 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Going to try to stop instance {{(pid=122319) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 05 02:33:44.862321 n-d-858272-3 devstack@n-api.service[122320]: DEBUG neutronclient.v2_0.client [None req-105d1f25-4a5e-4bb0-a32e-031567ee8e0f tempest-FloatingIPDetailsNegativeTestJSON-1992459556 tempest-FloatingIPDetailsNegativeTestJSON-1992459556-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 762162d3-b943-4fd5-a87b-a55e30f32783 could not be found", "detail": ""}} {{(pid=122320) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 02:33:44.863346 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-105d1f25-4a5e-4bb0-a32e-031567ee8e0f tempest-FloatingIPDetailsNegativeTestJSON-1992459556 tempest-FloatingIPDetailsNegativeTestJSON-1992459556-project] HTTP exception thrown: Floating IP not found for ID 762162d3-b943-4fd5-a87b-a55e30f32783 Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-105d1f25-4a5e-4bb0-a32e-031567ee8e0f tempest-FloatingIPDetailsNegativeTestJSON-1992459556 tempest-FloatingIPDetailsNegativeTestJSON-1992459556-project] Request method failure captured: Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/os-floating-ips/762162d3-b943-4fd5-a87b-a55e30f32783 HTTP/1.1 Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO0I3htQ8rD42g7xhlSv15SD2CKfmIMyb4WVJUoIUfihUaeqrqx5t8qR3Yo8Hq0rc7aYkh608jpIc5qUMZe7xSayNfslF5-jcCFWguYyB2LBU70CdqzCdOGkROABelzjmQ8YsbCaYVS7G97bygI2Heax1BsZOBbkBfARoi8zogOkmsE Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 14134ed022a24bafb4c1a385c72b08a8 Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1992459556 Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/14134ed022a24bafb4c1a385c72b08a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/14134ed022a24bafb4c1a385c72b08a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/14134ed022a24bafb4c1a385c72b08a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_14134ed022a24bafb4c1a385c72b08a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1992459556 Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 14134ed022a24bafb4c1a385c72b08a8 Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1992459556 Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1992459556-project Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 2aacac390d324eab9de3ab40579cdb3e Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1992459556-project Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: exception: Floating IP not found for ID 762162d3-b943-4fd5-a87b-a55e30f32783 Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '762162d3-b943-4fd5-a87b-a55e30f32783'} Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 02:33:44.865622 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 762162d3-b943-4fd5-a87b-a55e30f32783 could not be found Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c3c3a043-bd63-4a92-80dc-50dde4bb7848'] Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 762162d3-b943-4fd5-a87b-a55e30f32783. Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 762162d3-b943-4fd5-a87b-a55e30f32783 Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 762162d3-b943-4fd5-a87b-a55e30f32783 Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-105d1f25-4a5e-4bb0-a32e-031567ee8e0f tempest-FloatingIPDetailsNegativeTestJSON-1992459556 tempest-FloatingIPDetailsNegativeTestJSON-1992459556-project] Returning 404 to user: Floating IP not found for ID 762162d3-b943-4fd5-a87b-a55e30f32783 {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:33:44.871190 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-105d1f25-4a5e-4bb0-a32e-031567ee8e0f tempest-FloatingIPDetailsNegativeTestJSON-1992459556 tempest-FloatingIPDetailsNegativeTestJSON-1992459556-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/762162d3-b943-4fd5-a87b-a55e30f32783" status: 404 len: 111 microversion: 2.1 time: 0.188406 Oct 05 02:33:44.880348 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 769/1536] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 5 02:33:44 2022] GET /compute/v2.1/os-floating-ips/762162d3-b943-4fd5-a87b-a55e30f32783 => generated 111 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:33:44.898100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-30a31a16-f9b8-438c-9ea6-9417ece5e702 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:44.900062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-30a31a16-f9b8-438c-9ea6-9417ece5e702 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] [instance: 8b942fed-d4b6-403d-b121-a53278fe83c3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:44.911929 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ef6213c2-ffe5-4514-895d-2c29e47a3de2 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "POST /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4/action" status: 202 len: 0 microversion: 2.1 time: 0.284504 Oct 05 02:33:44.916181 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 768/1537] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:33:44 2022] POST /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:33:44.920194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30a31a16-f9b8-438c-9ea6-9417ece5e702 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:44.920694 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30a31a16-f9b8-438c-9ea6-9417ece5e702 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:44.921162 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30a31a16-f9b8-438c-9ea6-9417ece5e702 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:44.921870 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30a31a16-f9b8-438c-9ea6-9417ece5e702 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:44.922326 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30a31a16-f9b8-438c-9ea6-9417ece5e702 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:44.922746 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30a31a16-f9b8-438c-9ea6-9417ece5e702 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:44.924298 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-c8fef2e7-cb41-4fad-9a89-6a30b55b3de8 req-4d473996-7e88-4178-86e8-bf0e844932d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a19871a-12bc-45d8-ad01-489ad68f1e00", "tag": "c4608021-f3cf-466d-92f8-ca22a3a9526d"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:44.936222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c8fef2e7-cb41-4fad-9a89-6a30b55b3de8 req-4d473996-7e88-4178-86e8-bf0e844932d8 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:44.937212 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c8fef2e7-cb41-4fad-9a89-6a30b55b3de8 req-4d473996-7e88-4178-86e8-bf0e844932d8 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:44.937916 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c8fef2e7-cb41-4fad-9a89-6a30b55b3de8 req-4d473996-7e88-4178-86e8-bf0e844932d8 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:44.951572 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-c8fef2e7-cb41-4fad-9a89-6a30b55b3de8 req-4d473996-7e88-4178-86e8-bf0e844932d8 service nova] Creating event network-changed:c4608021-f3cf-466d-92f8-ca22a3a9526d for instance 9a19871a-12bc-45d8-ad01-489ad68f1e00 on n-h1-858272-3 Oct 05 02:33:44.957420 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-c8fef2e7-cb41-4fad-9a89-6a30b55b3de8 req-4d473996-7e88-4178-86e8-bf0e844932d8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039147 Oct 05 02:33:44.958778 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 769/1538] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:33:44.964493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-10c99418-f043-4e1a-b1aa-3b4c60adedc8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:44.966261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-10c99418-f043-4e1a-b1aa-3b4c60adedc8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:44.973882 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-10c99418-f043-4e1a-b1aa-3b4c60adedc8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:44.974810 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-10c99418-f043-4e1a-b1aa-3b4c60adedc8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:44.975514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-10c99418-f043-4e1a-b1aa-3b4c60adedc8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:44.976490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-10c99418-f043-4e1a-b1aa-3b4c60adedc8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:44.977236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-10c99418-f043-4e1a-b1aa-3b4c60adedc8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:44.977913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-10c99418-f043-4e1a-b1aa-3b4c60adedc8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:45.226062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-30a31a16-f9b8-438c-9ea6-9417ece5e702 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8c2b48f17b470aaa79d4f4a4a7215c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5e5d31e8a94667b52be18ed414d846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:45.239678 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-30a31a16-f9b8-438c-9ea6-9417ece5e702 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] 10.222.0.16 "GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3" status: 200 len: 1332 microversion: 2.1 time: 0.357862 Oct 05 02:33:45.240764 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 770/1539] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:44 2022] GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3 => generated 1332 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:45.248760 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-20d9617f-5599-4252-808e-64224a8a1b5d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:45.249631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-20d9617f-5599-4252-808e-64224a8a1b5d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:45.266824 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-20d9617f-5599-4252-808e-64224a8a1b5d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:45.272093 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-20d9617f-5599-4252-808e-64224a8a1b5d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:45.272860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-20d9617f-5599-4252-808e-64224a8a1b5d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:45.274101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-20d9617f-5599-4252-808e-64224a8a1b5d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:45.275638 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-20d9617f-5599-4252-808e-64224a8a1b5d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:45.281641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-20d9617f-5599-4252-808e-64224a8a1b5d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:45.322541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-10c99418-f043-4e1a-b1aa-3b4c60adedc8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:45.344114 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-10c99418-f043-4e1a-b1aa-3b4c60adedc8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:45.349001 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-10c99418-f043-4e1a-b1aa-3b4c60adedc8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:45.353005 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-10c99418-f043-4e1a-b1aa-3b4c60adedc8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1292 microversion: 2.25 time: 0.392727 Oct 05 02:33:45.354024 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 770/1540] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:33:44 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1292 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:33:45.443921 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ce18e20b-7ad6-42ad-9422-25951f3a87f1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:45.445731 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ce18e20b-7ad6-42ad-9422-25951f3a87f1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:45.456562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce18e20b-7ad6-42ad-9422-25951f3a87f1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:45.460319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce18e20b-7ad6-42ad-9422-25951f3a87f1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:45.461007 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce18e20b-7ad6-42ad-9422-25951f3a87f1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:45.462563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce18e20b-7ad6-42ad-9422-25951f3a87f1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:45.463578 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce18e20b-7ad6-42ad-9422-25951f3a87f1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:45.464179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce18e20b-7ad6-42ad-9422-25951f3a87f1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:45.615110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-20d9617f-5599-4252-808e-64224a8a1b5d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:45.630940 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-20d9617f-5599-4252-808e-64224a8a1b5d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 200 len: 1498 microversion: 2.1 time: 0.388765 Oct 05 02:33:45.631727 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 771/1541] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:45 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 1498 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:45.652166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5f70c7b9-7fa9-4d43-93a4-b876cbcb1fe5 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:45.653793 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5f70c7b9-7fa9-4d43-93a4-b876cbcb1fe5 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 99fb0801-33dd-4993-a8d9-18a43e372684] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:45.665086 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5f70c7b9-7fa9-4d43-93a4-b876cbcb1fe5 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:45.665864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5f70c7b9-7fa9-4d43-93a4-b876cbcb1fe5 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:45.666566 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5f70c7b9-7fa9-4d43-93a4-b876cbcb1fe5 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:45.668878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5f70c7b9-7fa9-4d43-93a4-b876cbcb1fe5 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:45.676252 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5f70c7b9-7fa9-4d43-93a4-b876cbcb1fe5 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:45.677975 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5f70c7b9-7fa9-4d43-93a4-b876cbcb1fe5 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:45.818516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5f70c7b9-7fa9-4d43-93a4-b876cbcb1fe5 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:45.830616 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5f70c7b9-7fa9-4d43-93a4-b876cbcb1fe5 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684" status: 200 len: 1300 microversion: 2.1 time: 0.182474 Oct 05 02:33:45.832344 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 772/1542] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:45 2022] GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684 => generated 1300 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:33:45.846309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2eca62af-2e0c-40a7-8705-f09f00d20557 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:45.847175 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2eca62af-2e0c-40a7-8705-f09f00d20557 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] [instance: b11969e1-8fcb-4287-8d5b-070809e1e452] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:45.855712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2eca62af-2e0c-40a7-8705-f09f00d20557 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:45.857815 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2eca62af-2e0c-40a7-8705-f09f00d20557 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:45.858766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2eca62af-2e0c-40a7-8705-f09f00d20557 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:45.859684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2eca62af-2e0c-40a7-8705-f09f00d20557 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:45.860449 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2eca62af-2e0c-40a7-8705-f09f00d20557 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:45.861556 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2eca62af-2e0c-40a7-8705-f09f00d20557 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:45.963077 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ce18e20b-7ad6-42ad-9422-25951f3a87f1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:45.975911 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ce18e20b-7ad6-42ad-9422-25951f3a87f1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1716 microversion: 2.1 time: 0.538231 Oct 05 02:33:45.976991 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 771/1543] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:45 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1716 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:33:45.982936 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-c430ed27-e579-43f0-9ae4-72847e7c8ae1 req-95328ea8-3cce-4d69-844e-187462de2340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b942fed-d4b6-403d-b121-a53278fe83c3", "name": "network-vif-plugged", "status": "completed", "tag": "7e37d2c3-c78d-464d-858e-6d91f57fa6d5"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:45.993474 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c430ed27-e579-43f0-9ae4-72847e7c8ae1 req-95328ea8-3cce-4d69-844e-187462de2340 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:45.994055 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c430ed27-e579-43f0-9ae4-72847e7c8ae1 req-95328ea8-3cce-4d69-844e-187462de2340 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:45.994745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c430ed27-e579-43f0-9ae4-72847e7c8ae1 req-95328ea8-3cce-4d69-844e-187462de2340 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:46.015603 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-c430ed27-e579-43f0-9ae4-72847e7c8ae1 req-95328ea8-3cce-4d69-844e-187462de2340 service nova] Creating event network-vif-plugged:7e37d2c3-c78d-464d-858e-6d91f57fa6d5 for instance 8b942fed-d4b6-403d-b121-a53278fe83c3 on n-h2-858272-3 Oct 05 02:33:46.022262 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-c430ed27-e579-43f0-9ae4-72847e7c8ae1 req-95328ea8-3cce-4d69-844e-187462de2340 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043837 Oct 05 02:33:46.024213 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 772/1544] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:33:46.065635 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2eca62af-2e0c-40a7-8705-f09f00d20557 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a262a7ca2be4451a89330098b6134c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a08a51781e84e1eb215037744ee3a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:46.080418 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2eca62af-2e0c-40a7-8705-f09f00d20557 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452" status: 200 len: 1588 microversion: 2.1 time: 0.246752 Oct 05 02:33:46.084616 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 773/1545] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:45 2022] GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452 => generated 1588 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:46.113440 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f315b86e-389d-4cf2-b963-7c0a904de017 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:46.114035 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f315b86e-389d-4cf2-b963-7c0a904de017 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] [instance: b11969e1-8fcb-4287-8d5b-070809e1e452] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:46.121199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f315b86e-389d-4cf2-b963-7c0a904de017 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:46.122044 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f315b86e-389d-4cf2-b963-7c0a904de017 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:46.122898 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f315b86e-389d-4cf2-b963-7c0a904de017 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:46.124169 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f315b86e-389d-4cf2-b963-7c0a904de017 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:46.124811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f315b86e-389d-4cf2-b963-7c0a904de017 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:46.125438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f315b86e-389d-4cf2-b963-7c0a904de017 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:46.240534 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f315b86e-389d-4cf2-b963-7c0a904de017 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131969 Oct 05 02:33:46.241478 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 773/1546] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 02:33:46 2022] GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:33:46.269034 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a6dd71bc-8a86-4075-950b-d691f1ee2c3e tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:46.270525 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a6dd71bc-8a86-4075-950b-d691f1ee2c3e tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] [instance: 8b942fed-d4b6-403d-b121-a53278fe83c3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:46.279560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6dd71bc-8a86-4075-950b-d691f1ee2c3e tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:46.280818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6dd71bc-8a86-4075-950b-d691f1ee2c3e tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:46.282232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6dd71bc-8a86-4075-950b-d691f1ee2c3e tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:46.283542 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6dd71bc-8a86-4075-950b-d691f1ee2c3e tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:46.284269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6dd71bc-8a86-4075-950b-d691f1ee2c3e tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:46.285001 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6dd71bc-8a86-4075-950b-d691f1ee2c3e tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:46.388723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7292d68d-683c-4dbf-b126-55609cf1a8a1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:46.390001 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7292d68d-683c-4dbf-b126-55609cf1a8a1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:46.398330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7292d68d-683c-4dbf-b126-55609cf1a8a1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:46.399129 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7292d68d-683c-4dbf-b126-55609cf1a8a1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:46.399743 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7292d68d-683c-4dbf-b126-55609cf1a8a1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:46.400887 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7292d68d-683c-4dbf-b126-55609cf1a8a1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:46.401684 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7292d68d-683c-4dbf-b126-55609cf1a8a1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:46.402398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7292d68d-683c-4dbf-b126-55609cf1a8a1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:47.036123 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a6dd71bc-8a86-4075-950b-d691f1ee2c3e tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8c2b48f17b470aaa79d4f4a4a7215c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5e5d31e8a94667b52be18ed414d846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:47.046695 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a6dd71bc-8a86-4075-950b-d691f1ee2c3e tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] 10.222.0.16 "GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3" status: 200 len: 1332 microversion: 2.1 time: 0.781457 Oct 05 02:33:47.047976 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 774/1547] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:46 2022] GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3 => generated 1332 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:47.053379 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bf198232-5d39-4216-a7be-f8be541a208a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:47.054324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bf198232-5d39-4216-a7be-f8be541a208a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:47.076643 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf198232-5d39-4216-a7be-f8be541a208a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:47.077613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf198232-5d39-4216-a7be-f8be541a208a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:47.078906 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf198232-5d39-4216-a7be-f8be541a208a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:47.079991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf198232-5d39-4216-a7be-f8be541a208a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:47.080709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf198232-5d39-4216-a7be-f8be541a208a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:47.081578 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf198232-5d39-4216-a7be-f8be541a208a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:47.161243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7292d68d-683c-4dbf-b126-55609cf1a8a1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:47.173320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7292d68d-683c-4dbf-b126-55609cf1a8a1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:47.174761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7292d68d-683c-4dbf-b126-55609cf1a8a1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:47.175898 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7292d68d-683c-4dbf-b126-55609cf1a8a1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1280 microversion: 2.25 time: 0.796982 Oct 05 02:33:47.182188 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 774/1548] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:33:46 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1280 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:33:47.208791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c2a3612d-67b4-4f6e-82cd-0d676f7d3108 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:47.209687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c2a3612d-67b4-4f6e-82cd-0d676f7d3108 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 99fb0801-33dd-4993-a8d9-18a43e372684] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:47.217622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2a3612d-67b4-4f6e-82cd-0d676f7d3108 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:47.218212 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2a3612d-67b4-4f6e-82cd-0d676f7d3108 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:47.218780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2a3612d-67b4-4f6e-82cd-0d676f7d3108 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:47.219733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2a3612d-67b4-4f6e-82cd-0d676f7d3108 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:47.220914 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2a3612d-67b4-4f6e-82cd-0d676f7d3108 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:47.221436 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2a3612d-67b4-4f6e-82cd-0d676f7d3108 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:47.658164 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bf198232-5d39-4216-a7be-f8be541a208a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:47.667161 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bf198232-5d39-4216-a7be-f8be541a208a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 200 len: 1498 microversion: 2.1 time: 0.617870 Oct 05 02:33:47.671124 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 775/1549] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:47 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 1498 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:47.683292 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4dc838fd-7a45-462f-9b21-3260a2e0c0dd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:47.684878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4dc838fd-7a45-462f-9b21-3260a2e0c0dd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:47.701131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4dc838fd-7a45-462f-9b21-3260a2e0c0dd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:47.702047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4dc838fd-7a45-462f-9b21-3260a2e0c0dd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:47.702713 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4dc838fd-7a45-462f-9b21-3260a2e0c0dd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:47.703664 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4dc838fd-7a45-462f-9b21-3260a2e0c0dd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:47.704369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4dc838fd-7a45-462f-9b21-3260a2e0c0dd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:47.705048 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4dc838fd-7a45-462f-9b21-3260a2e0c0dd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:47.771406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c2a3612d-67b4-4f6e-82cd-0d676f7d3108 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:47.780669 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c2a3612d-67b4-4f6e-82cd-0d676f7d3108 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684" status: 200 len: 1368 microversion: 2.1 time: 0.597050 Oct 05 02:33:47.794586 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 775/1550] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:47 2022] GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684 => generated 1368 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:48.071246 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e169b7cc-aad9-4db2-ae95-473e4ece9b31 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:48.072020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e169b7cc-aad9-4db2-ae95-473e4ece9b31 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] [instance: 8b942fed-d4b6-403d-b121-a53278fe83c3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:48.078730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e169b7cc-aad9-4db2-ae95-473e4ece9b31 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:48.079904 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e169b7cc-aad9-4db2-ae95-473e4ece9b31 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:48.080422 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e169b7cc-aad9-4db2-ae95-473e4ece9b31 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:48.081243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e169b7cc-aad9-4db2-ae95-473e4ece9b31 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:48.081923 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e169b7cc-aad9-4db2-ae95-473e4ece9b31 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:48.082351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e169b7cc-aad9-4db2-ae95-473e4ece9b31 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:48.091511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4dc838fd-7a45-462f-9b21-3260a2e0c0dd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:48.100444 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4dc838fd-7a45-462f-9b21-3260a2e0c0dd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1716 microversion: 2.1 time: 0.427850 Oct 05 02:33:48.113651 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 776/1551] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:47 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1716 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:48.213577 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e0e60340-438a-4237-860f-9660df090973 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:48.214303 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e0e60340-438a-4237-860f-9660df090973 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:48.221503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0e60340-438a-4237-860f-9660df090973 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:48.222363 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0e60340-438a-4237-860f-9660df090973 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:48.223073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0e60340-438a-4237-860f-9660df090973 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:48.224191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0e60340-438a-4237-860f-9660df090973 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:48.224939 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0e60340-438a-4237-860f-9660df090973 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:48.225811 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0e60340-438a-4237-860f-9660df090973 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:48.413917 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e169b7cc-aad9-4db2-ae95-473e4ece9b31 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8c2b48f17b470aaa79d4f4a4a7215c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5e5d31e8a94667b52be18ed414d846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:48.423096 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e169b7cc-aad9-4db2-ae95-473e4ece9b31 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] 10.222.0.16 "GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3" status: 200 len: 1535 microversion: 2.1 time: 0.355908 Oct 05 02:33:48.427721 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 776/1552] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:48 2022] GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3 => generated 1535 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:33:48.453869 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8c1c22ea-2036-40b2-9a6f-464f13c71bc0 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Action: 'create', calling method: .version_select at 0x7fccdfca8ee0>, body: {"pool": "8822eb34-3330-4956-843b-08d392361d41"} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:48.686664 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e0e60340-438a-4237-860f-9660df090973 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:48.703844 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e0e60340-438a-4237-860f-9660df090973 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:48.707453 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e0e60340-438a-4237-860f-9660df090973 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:48.710302 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e0e60340-438a-4237-860f-9660df090973 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1280 microversion: 2.25 time: 0.501369 Oct 05 02:33:48.711497 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 777/1553] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:33:48 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1280 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:33:48.721637 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a3b519ba-d82f-400d-b5be-9d8f5ddabe25 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:48.722788 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a3b519ba-d82f-400d-b5be-9d8f5ddabe25 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:48.735111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3b519ba-d82f-400d-b5be-9d8f5ddabe25 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:48.736850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3b519ba-d82f-400d-b5be-9d8f5ddabe25 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:48.738043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3b519ba-d82f-400d-b5be-9d8f5ddabe25 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:48.739427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3b519ba-d82f-400d-b5be-9d8f5ddabe25 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:48.740444 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3b519ba-d82f-400d-b5be-9d8f5ddabe25 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:48.741776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3b519ba-d82f-400d-b5be-9d8f5ddabe25 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:49.055706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a3b519ba-d82f-400d-b5be-9d8f5ddabe25 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:49.064739 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a3b519ba-d82f-400d-b5be-9d8f5ddabe25 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 200 len: 1498 microversion: 2.1 time: 0.351815 Oct 05 02:33:49.065562 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 778/1554] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:48 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 1498 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:49.070406 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a1028daf-e3c6-4f97-bf92-aae283d4dfc1 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:49.071218 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a1028daf-e3c6-4f97-bf92-aae283d4dfc1 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 99fb0801-33dd-4993-a8d9-18a43e372684] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:49.085553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a1028daf-e3c6-4f97-bf92-aae283d4dfc1 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:49.086449 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a1028daf-e3c6-4f97-bf92-aae283d4dfc1 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:49.087134 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a1028daf-e3c6-4f97-bf92-aae283d4dfc1 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:49.090500 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a1028daf-e3c6-4f97-bf92-aae283d4dfc1 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:49.091340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a1028daf-e3c6-4f97-bf92-aae283d4dfc1 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:49.093126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a1028daf-e3c6-4f97-bf92-aae283d4dfc1 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:49.461625 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a1028daf-e3c6-4f97-bf92-aae283d4dfc1 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:49.482544 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a1028daf-e3c6-4f97-bf92-aae283d4dfc1 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684" status: 200 len: 1368 microversion: 2.1 time: 0.415439 Oct 05 02:33:49.499958 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 779/1555] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:49 2022] GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684 => generated 1368 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:49.504893 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-74e6e28c-8e7b-436d-87f6-280400d4d198 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:49.511482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-74e6e28c-8e7b-436d-87f6-280400d4d198 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:49.520132 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-74e6e28c-8e7b-436d-87f6-280400d4d198 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:49.522128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-74e6e28c-8e7b-436d-87f6-280400d4d198 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:49.522798 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-74e6e28c-8e7b-436d-87f6-280400d4d198 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:49.523694 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-74e6e28c-8e7b-436d-87f6-280400d4d198 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:49.524766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-74e6e28c-8e7b-436d-87f6-280400d4d198 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:49.527240 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-74e6e28c-8e7b-436d-87f6-280400d4d198 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:50.244629 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-74e6e28c-8e7b-436d-87f6-280400d4d198 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:50.253973 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-74e6e28c-8e7b-436d-87f6-280400d4d198 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1716 microversion: 2.1 time: 0.752926 Oct 05 02:33:50.254778 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 780/1556] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:49 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1716 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:50.260436 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-b940d39a-6741-411e-bfe1-faac5cdd6879 req-bfc27796-2f14-4e9b-8439-1ebed3d72f5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99fb0801-33dd-4993-a8d9-18a43e372684", "tag": "9347f3a9-118c-40ac-9d21-f7cd82266478"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:50.272317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b940d39a-6741-411e-bfe1-faac5cdd6879 req-bfc27796-2f14-4e9b-8439-1ebed3d72f5c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:50.272734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b940d39a-6741-411e-bfe1-faac5cdd6879 req-bfc27796-2f14-4e9b-8439-1ebed3d72f5c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:50.273186 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b940d39a-6741-411e-bfe1-faac5cdd6879 req-bfc27796-2f14-4e9b-8439-1ebed3d72f5c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:50.277631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:50.287160 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-b940d39a-6741-411e-bfe1-faac5cdd6879 req-bfc27796-2f14-4e9b-8439-1ebed3d72f5c service nova] Creating event network-changed:9347f3a9-118c-40ac-9d21-f7cd82266478 for instance 99fb0801-33dd-4993-a8d9-18a43e372684 on n-h2-858272-3 Oct 05 02:33:50.292368 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-b940d39a-6741-411e-bfe1-faac5cdd6879 req-bfc27796-2f14-4e9b-8439-1ebed3d72f5c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035711 Oct 05 02:33:50.296849 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 781/1557] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:33:50.302468 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-83733d57-0f8a-4fd3-8cb4-a43fdb6f09b9 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:50.303207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-83733d57-0f8a-4fd3-8cb4-a43fdb6f09b9 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] [instance: b11969e1-8fcb-4287-8d5b-070809e1e452] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:50.310829 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83733d57-0f8a-4fd3-8cb4-a43fdb6f09b9 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:50.311943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83733d57-0f8a-4fd3-8cb4-a43fdb6f09b9 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:50.312592 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83733d57-0f8a-4fd3-8cb4-a43fdb6f09b9 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:50.313496 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83733d57-0f8a-4fd3-8cb4-a43fdb6f09b9 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:50.314151 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83733d57-0f8a-4fd3-8cb4-a43fdb6f09b9 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:50.315046 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83733d57-0f8a-4fd3-8cb4-a43fdb6f09b9 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:50.608576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-83733d57-0f8a-4fd3-8cb4-a43fdb6f09b9 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a262a7ca2be4451a89330098b6134c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a08a51781e84e1eb215037744ee3a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:50.632137 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-83733d57-0f8a-4fd3-8cb4-a43fdb6f09b9 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452" status: 200 len: 1588 microversion: 2.1 time: 0.333430 Oct 05 02:33:50.633804 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 782/1558] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:50 2022] GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452 => generated 1588 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:50.639247 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-cf5eed4d-ddad-46b8-80b3-bff2d3bf5ef5 req-5c4e367d-3319-4960-94fa-dcc2e37eab50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b11969e1-8fcb-4287-8d5b-070809e1e452", "tag": "91278f9d-a729-4911-9a6a-5d6cedbc2b96"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:50.672855 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-cf5eed4d-ddad-46b8-80b3-bff2d3bf5ef5 req-5c4e367d-3319-4960-94fa-dcc2e37eab50 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:50.673286 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-cf5eed4d-ddad-46b8-80b3-bff2d3bf5ef5 req-5c4e367d-3319-4960-94fa-dcc2e37eab50 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:50.673717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-cf5eed4d-ddad-46b8-80b3-bff2d3bf5ef5 req-5c4e367d-3319-4960-94fa-dcc2e37eab50 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:50.692342 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-cf5eed4d-ddad-46b8-80b3-bff2d3bf5ef5 req-5c4e367d-3319-4960-94fa-dcc2e37eab50 service nova] Creating event network-changed:91278f9d-a729-4911-9a6a-5d6cedbc2b96 for instance b11969e1-8fcb-4287-8d5b-070809e1e452 on n-h1-858272-3 Oct 05 02:33:50.698989 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-cf5eed4d-ddad-46b8-80b3-bff2d3bf5ef5 req-5c4e367d-3319-4960-94fa-dcc2e37eab50 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063875 Oct 05 02:33:50.700588 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 783/1559] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:33:50.709887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1bb30de3-ca46-4000-b385-a2d2eff23f20 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:50.710900 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1bb30de3-ca46-4000-b385-a2d2eff23f20 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:50.719561 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bb30de3-ca46-4000-b385-a2d2eff23f20 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:50.720985 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bb30de3-ca46-4000-b385-a2d2eff23f20 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:50.722870 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bb30de3-ca46-4000-b385-a2d2eff23f20 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:50.723833 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bb30de3-ca46-4000-b385-a2d2eff23f20 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:50.724472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bb30de3-ca46-4000-b385-a2d2eff23f20 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:50.725289 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bb30de3-ca46-4000-b385-a2d2eff23f20 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:51.078308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1bb30de3-ca46-4000-b385-a2d2eff23f20 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:51.093174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1bb30de3-ca46-4000-b385-a2d2eff23f20 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:51.096264 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1bb30de3-ca46-4000-b385-a2d2eff23f20 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:51.098943 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1bb30de3-ca46-4000-b385-a2d2eff23f20 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1280 microversion: 2.25 time: 0.396274 Oct 05 02:33:51.113475 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 784/1560] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:33:50 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1280 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:33:51.120142 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fbb1670a-3e00-4a13-bbd3-3498e7d05e4d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:51.120142 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fbb1670a-3e00-4a13-bbd3-3498e7d05e4d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:51.130533 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fbb1670a-3e00-4a13-bbd3-3498e7d05e4d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:51.131747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fbb1670a-3e00-4a13-bbd3-3498e7d05e4d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:51.132418 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fbb1670a-3e00-4a13-bbd3-3498e7d05e4d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:51.133624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fbb1670a-3e00-4a13-bbd3-3498e7d05e4d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:51.134768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fbb1670a-3e00-4a13-bbd3-3498e7d05e4d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:51.135966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fbb1670a-3e00-4a13-bbd3-3498e7d05e4d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:51.558753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fbb1670a-3e00-4a13-bbd3-3498e7d05e4d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:51.571523 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8c1c22ea-2036-40b2-9a6f-464f13c71bc0 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.122318 Oct 05 02:33:51.581865 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 777/1561] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Oct 5 02:33:48 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:33:51.582873 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fbb1670a-3e00-4a13-bbd3-3498e7d05e4d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 200 len: 1498 microversion: 2.1 time: 0.464645 Oct 05 02:33:51.582873 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 785/1562] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:51 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 1498 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:51.582873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5144b38f-d7d7-4438-8964-971770dd2150 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:51.585255 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5144b38f-d7d7-4438-8964-971770dd2150 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:51.585987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c2f10e00-b497-4263-bb04-b919aa8e5666 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:51.586863 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c2f10e00-b497-4263-bb04-b919aa8e5666 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 99fb0801-33dd-4993-a8d9-18a43e372684] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:51.592957 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5144b38f-d7d7-4438-8964-971770dd2150 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:51.593631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5144b38f-d7d7-4438-8964-971770dd2150 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:51.594272 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5144b38f-d7d7-4438-8964-971770dd2150 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:51.595177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5144b38f-d7d7-4438-8964-971770dd2150 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:51.595890 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5144b38f-d7d7-4438-8964-971770dd2150 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:51.596291 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2f10e00-b497-4263-bb04-b919aa8e5666 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:51.596785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2f10e00-b497-4263-bb04-b919aa8e5666 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:51.597221 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5144b38f-d7d7-4438-8964-971770dd2150 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:51.597345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2f10e00-b497-4263-bb04-b919aa8e5666 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:51.597947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2f10e00-b497-4263-bb04-b919aa8e5666 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:51.598405 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2f10e00-b497-4263-bb04-b919aa8e5666 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:51.598827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2f10e00-b497-4263-bb04-b919aa8e5666 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:51.917412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c2f10e00-b497-4263-bb04-b919aa8e5666 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:51.922906 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5144b38f-d7d7-4438-8964-971770dd2150 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:51.932594 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c2f10e00-b497-4263-bb04-b919aa8e5666 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684" status: 200 len: 1368 microversion: 2.1 time: 0.359027 Oct 05 02:33:51.933502 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 778/1563] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:51 2022] GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684 => generated 1368 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:51.936099 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5144b38f-d7d7-4438-8964-971770dd2150 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1716 microversion: 2.1 time: 0.358617 Oct 05 02:33:51.951969 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 786/1564] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:51 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1716 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:51.957309 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e2009b76-2ac1-45cc-8722-ee51d3d2116d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Action: 'action', calling method: .version_select at 0x7fcce659f8b0>, body: {"addFloatingIp": {"address": "172.25.5.197"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:51.960403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e2009b76-2ac1-45cc-8722-ee51d3d2116d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] [instance: 8b942fed-d4b6-403d-b121-a53278fe83c3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:51.967659 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e2009b76-2ac1-45cc-8722-ee51d3d2116d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:51.968410 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e2009b76-2ac1-45cc-8722-ee51d3d2116d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:51.969042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e2009b76-2ac1-45cc-8722-ee51d3d2116d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:51.969936 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e2009b76-2ac1-45cc-8722-ee51d3d2116d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:51.970556 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e2009b76-2ac1-45cc-8722-ee51d3d2116d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:51.971351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e2009b76-2ac1-45cc-8722-ee51d3d2116d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:52.048557 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e2009b76-2ac1-45cc-8722-ee51d3d2116d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "refresh_cache-8b942fed-d4b6-403d-b121-a53278fe83c3" {{(pid=122319) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 05 02:33:52.049210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e2009b76-2ac1-45cc-8722-ee51d3d2116d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquired lock "refresh_cache-8b942fed-d4b6-403d-b121-a53278fe83c3" {{(pid=122319) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 05 02:33:52.131300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8eb0a9ac-1362-41d9-a0bf-7388fe433fc5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:52.132029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8eb0a9ac-1362-41d9-a0bf-7388fe433fc5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:52.142047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8eb0a9ac-1362-41d9-a0bf-7388fe433fc5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:52.143413 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8eb0a9ac-1362-41d9-a0bf-7388fe433fc5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:52.144127 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8eb0a9ac-1362-41d9-a0bf-7388fe433fc5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:52.145076 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8eb0a9ac-1362-41d9-a0bf-7388fe433fc5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:52.146002 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8eb0a9ac-1362-41d9-a0bf-7388fe433fc5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:52.147708 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8eb0a9ac-1362-41d9-a0bf-7388fe433fc5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:52.435564 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8eb0a9ac-1362-41d9-a0bf-7388fe433fc5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:52.448384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8eb0a9ac-1362-41d9-a0bf-7388fe433fc5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:52.450879 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8eb0a9ac-1362-41d9-a0bf-7388fe433fc5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:52.452318 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8eb0a9ac-1362-41d9-a0bf-7388fe433fc5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1280 microversion: 2.25 time: 0.328584 Oct 05 02:33:52.453435 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 787/1565] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:33:52 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1280 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:33:52.608020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d64068b6-de5e-4cb2-ae77-89647147446e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:52.609862 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d64068b6-de5e-4cb2-ae77-89647147446e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:52.626391 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:52.633874 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d64068b6-de5e-4cb2-ae77-89647147446e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:52.634641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d64068b6-de5e-4cb2-ae77-89647147446e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:52.639029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d64068b6-de5e-4cb2-ae77-89647147446e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:52.640075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d64068b6-de5e-4cb2-ae77-89647147446e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:52.640730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d64068b6-de5e-4cb2-ae77-89647147446e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:52.641192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d64068b6-de5e-4cb2-ae77-89647147446e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:52.721447 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=10 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:53.163659 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d64068b6-de5e-4cb2-ae77-89647147446e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:53.175900 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d64068b6-de5e-4cb2-ae77-89647147446e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 200 len: 1498 microversion: 2.1 time: 0.576148 Oct 05 02:33:53.177293 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 788/1566] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:52 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 1498 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:53.183537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-38d98de0-be52-4076-9c08-a097ffdac85e tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:53.185030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-38d98de0-be52-4076-9c08-a097ffdac85e tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 99fb0801-33dd-4993-a8d9-18a43e372684] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:53.198610 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38d98de0-be52-4076-9c08-a097ffdac85e tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:53.199111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38d98de0-be52-4076-9c08-a097ffdac85e tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:53.201488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38d98de0-be52-4076-9c08-a097ffdac85e tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:53.202467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38d98de0-be52-4076-9c08-a097ffdac85e tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:53.203596 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38d98de0-be52-4076-9c08-a097ffdac85e tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:53.204251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38d98de0-be52-4076-9c08-a097ffdac85e tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:53.500143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-38d98de0-be52-4076-9c08-a097ffdac85e tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:53.508869 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-38d98de0-be52-4076-9c08-a097ffdac85e tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684" status: 200 len: 1368 microversion: 2.1 time: 0.330228 Oct 05 02:33:53.509580 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 789/1567] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:53 2022] GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684 => generated 1368 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:53.515524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b7e177f5-c525-427d-876c-a774a19fc291 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:53.516482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b7e177f5-c525-427d-876c-a774a19fc291 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:53.527676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b7e177f5-c525-427d-876c-a774a19fc291 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:53.529469 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b7e177f5-c525-427d-876c-a774a19fc291 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:53.532159 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b7e177f5-c525-427d-876c-a774a19fc291 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:53.533008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b7e177f5-c525-427d-876c-a774a19fc291 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:53.533566 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b7e177f5-c525-427d-876c-a774a19fc291 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:53.534057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b7e177f5-c525-427d-876c-a774a19fc291 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:53.823749 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b7e177f5-c525-427d-876c-a774a19fc291 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:53.835687 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b7e177f5-c525-427d-876c-a774a19fc291 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1716 microversion: 2.1 time: 0.324517 Oct 05 02:33:53.837195 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 790/1568] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:53 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1716 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:53.843790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-890ef045-a8c4-49ce-9be2-5eb9dc3011cf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:53.844665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-890ef045-a8c4-49ce-9be2-5eb9dc3011cf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:53.855671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-890ef045-a8c4-49ce-9be2-5eb9dc3011cf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:53.857095 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-890ef045-a8c4-49ce-9be2-5eb9dc3011cf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:53.857767 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-890ef045-a8c4-49ce-9be2-5eb9dc3011cf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:53.859107 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-890ef045-a8c4-49ce-9be2-5eb9dc3011cf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:53.860066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-890ef045-a8c4-49ce-9be2-5eb9dc3011cf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:53.860773 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-890ef045-a8c4-49ce-9be2-5eb9dc3011cf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:54.185832 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-e2009b76-2ac1-45cc-8722-ee51d3d2116d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] [instance: 8b942fed-d4b6-403d-b121-a53278fe83c3] Building network info cache for instance {{(pid=122319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 05 02:33:54.317477 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-890ef045-a8c4-49ce-9be2-5eb9dc3011cf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:54.334786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-890ef045-a8c4-49ce-9be2-5eb9dc3011cf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:54.338183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-890ef045-a8c4-49ce-9be2-5eb9dc3011cf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:54.341095 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-890ef045-a8c4-49ce-9be2-5eb9dc3011cf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1280 microversion: 2.25 time: 0.501746 Oct 05 02:33:54.342716 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 791/1569] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:33:53 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1280 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:33:54.350569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-198322cc-8b0f-4bfa-8d3a-db426b15bf5f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:54.351985 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-198322cc-8b0f-4bfa-8d3a-db426b15bf5f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:54.360959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-198322cc-8b0f-4bfa-8d3a-db426b15bf5f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:54.363266 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-198322cc-8b0f-4bfa-8d3a-db426b15bf5f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:54.364653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-198322cc-8b0f-4bfa-8d3a-db426b15bf5f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:54.366812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-198322cc-8b0f-4bfa-8d3a-db426b15bf5f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:54.368087 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-198322cc-8b0f-4bfa-8d3a-db426b15bf5f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:54.369223 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-198322cc-8b0f-4bfa-8d3a-db426b15bf5f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:54.752849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-198322cc-8b0f-4bfa-8d3a-db426b15bf5f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:54.781305 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-198322cc-8b0f-4bfa-8d3a-db426b15bf5f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 200 len: 1498 microversion: 2.1 time: 0.436929 Oct 05 02:33:54.783434 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 792/1570] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:54 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 1498 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:54.791570 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-1d7ed7fe-c783-4111-9eed-411fc94e7960 req-ec058844-c5f2-4621-8106-dc0c398beb93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b942fed-d4b6-403d-b121-a53278fe83c3", "tag": "7e37d2c3-c78d-464d-858e-6d91f57fa6d5"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:54.812559 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1d7ed7fe-c783-4111-9eed-411fc94e7960 req-ec058844-c5f2-4621-8106-dc0c398beb93 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:54.813315 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1d7ed7fe-c783-4111-9eed-411fc94e7960 req-ec058844-c5f2-4621-8106-dc0c398beb93 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:54.813766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1d7ed7fe-c783-4111-9eed-411fc94e7960 req-ec058844-c5f2-4621-8106-dc0c398beb93 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:54.835420 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-1d7ed7fe-c783-4111-9eed-411fc94e7960 req-ec058844-c5f2-4621-8106-dc0c398beb93 service nova] Creating event network-changed:7e37d2c3-c78d-464d-858e-6d91f57fa6d5 for instance 8b942fed-d4b6-403d-b121-a53278fe83c3 on n-h2-858272-3 Oct 05 02:33:54.849456 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-1d7ed7fe-c783-4111-9eed-411fc94e7960 req-ec058844-c5f2-4621-8106-dc0c398beb93 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061502 Oct 05 02:33:54.850814 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 793/1571] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:33:54.863963 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-42559378-2183-4ad8-98cd-710d17a200dc tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:54.865932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-42559378-2183-4ad8-98cd-710d17a200dc tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 99fb0801-33dd-4993-a8d9-18a43e372684] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:54.881278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42559378-2183-4ad8-98cd-710d17a200dc tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:54.882220 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42559378-2183-4ad8-98cd-710d17a200dc tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:54.882888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42559378-2183-4ad8-98cd-710d17a200dc tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:54.884440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42559378-2183-4ad8-98cd-710d17a200dc tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:54.885121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42559378-2183-4ad8-98cd-710d17a200dc tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:54.885842 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42559378-2183-4ad8-98cd-710d17a200dc tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:55.365654 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-42559378-2183-4ad8-98cd-710d17a200dc tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:55.373351 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-42559378-2183-4ad8-98cd-710d17a200dc tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684" status: 200 len: 1368 microversion: 2.1 time: 0.520849 Oct 05 02:33:55.389606 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 794/1572] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:54 2022] GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684 => generated 1368 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:55.394913 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f8a2da94-6288-417b-8f22-668400662fbb tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:55.396064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f8a2da94-6288-417b-8f22-668400662fbb tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:55.402012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8a2da94-6288-417b-8f22-668400662fbb tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:55.402511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8a2da94-6288-417b-8f22-668400662fbb tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:55.403593 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8a2da94-6288-417b-8f22-668400662fbb tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:55.404455 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8a2da94-6288-417b-8f22-668400662fbb tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:55.404941 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8a2da94-6288-417b-8f22-668400662fbb tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:55.405385 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8a2da94-6288-417b-8f22-668400662fbb tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:55.872016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-e2009b76-2ac1-45cc-8722-ee51d3d2116d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] [instance: 8b942fed-d4b6-403d-b121-a53278fe83c3] Updating instance_info_cache with network_info: [{"id": "7e37d2c3-c78d-464d-858e-6d91f57fa6d5", "address": "fa:16:3e:e7:9c:f1", "network": {"id": "a9b9a246-d688-4317-bc49-b07fde7d021b", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-901301512-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "dc5e5d31e8a94667b52be18ed414d846", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7e37d2c3-c7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 05 02:33:55.891111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e2009b76-2ac1-45cc-8722-ee51d3d2116d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Releasing lock "refresh_cache-8b942fed-d4b6-403d-b121-a53278fe83c3" {{(pid=122319) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 05 02:33:55.892492 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e2009b76-2ac1-45cc-8722-ee51d3d2116d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] 10.222.0.16 "POST /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3/action" status: 202 len: 0 microversion: 2.1 time: 3.957708 Oct 05 02:33:55.897636 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 779/1573] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:33:51 2022] POST /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3/action => generated 0 bytes in 3963 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 05 02:33:55.904591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-129473f6-f409-46a6-8162-5d8fcac3b1d2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:55.905581 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-129473f6-f409-46a6-8162-5d8fcac3b1d2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:55.914866 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-129473f6-f409-46a6-8162-5d8fcac3b1d2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:55.916256 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-129473f6-f409-46a6-8162-5d8fcac3b1d2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:55.916971 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-129473f6-f409-46a6-8162-5d8fcac3b1d2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:55.918377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-129473f6-f409-46a6-8162-5d8fcac3b1d2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:55.919205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-129473f6-f409-46a6-8162-5d8fcac3b1d2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:55.919865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-129473f6-f409-46a6-8162-5d8fcac3b1d2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:55.966669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f8a2da94-6288-417b-8f22-668400662fbb tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:55.977945 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f8a2da94-6288-417b-8f22-668400662fbb tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1716 microversion: 2.1 time: 0.587255 Oct 05 02:33:55.995948 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 795/1574] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:55 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1716 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:55.995948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f97861cf-1c71-4ebd-a70d-86599679326b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:55.995948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f97861cf-1c71-4ebd-a70d-86599679326b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:56.006769 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f97861cf-1c71-4ebd-a70d-86599679326b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:56.007568 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f97861cf-1c71-4ebd-a70d-86599679326b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:56.008504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f97861cf-1c71-4ebd-a70d-86599679326b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:56.009554 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f97861cf-1c71-4ebd-a70d-86599679326b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:56.010170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f97861cf-1c71-4ebd-a70d-86599679326b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:56.010754 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f97861cf-1c71-4ebd-a70d-86599679326b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:56.203495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-129473f6-f409-46a6-8162-5d8fcac3b1d2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:56.226844 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-129473f6-f409-46a6-8162-5d8fcac3b1d2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:56.232195 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-129473f6-f409-46a6-8162-5d8fcac3b1d2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:56.234872 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-129473f6-f409-46a6-8162-5d8fcac3b1d2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1280 microversion: 2.25 time: 0.335822 Oct 05 02:33:56.247946 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 780/1575] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:33:55 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1280 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:33:56.256950 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0f5e5087-6666-4acd-a291-c8f3cab61cec tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Action: 'create', calling method: .version_select at 0x7fcce40dd4c0>, body: {"pool": "8822eb34-3330-4956-843b-08d392361d41"} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:56.406759 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f97861cf-1c71-4ebd-a70d-86599679326b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:56.420035 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f97861cf-1c71-4ebd-a70d-86599679326b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 200 len: 1498 microversion: 2.1 time: 0.434986 Oct 05 02:33:56.447758 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 796/1576] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:55 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 1498 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:56.458186 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-71ff2746-1c90-4c59-bcd6-229caac6b9d9 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:56.459092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-71ff2746-1c90-4c59-bcd6-229caac6b9d9 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 99fb0801-33dd-4993-a8d9-18a43e372684] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:56.487501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71ff2746-1c90-4c59-bcd6-229caac6b9d9 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:56.489514 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71ff2746-1c90-4c59-bcd6-229caac6b9d9 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:56.494889 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71ff2746-1c90-4c59-bcd6-229caac6b9d9 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:56.496277 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71ff2746-1c90-4c59-bcd6-229caac6b9d9 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:56.500494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71ff2746-1c90-4c59-bcd6-229caac6b9d9 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:56.501250 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71ff2746-1c90-4c59-bcd6-229caac6b9d9 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:57.165097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-71ff2746-1c90-4c59-bcd6-229caac6b9d9 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:57.182289 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-71ff2746-1c90-4c59-bcd6-229caac6b9d9 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684" status: 200 len: 1368 microversion: 2.1 time: 0.730155 Oct 05 02:33:57.184380 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 797/1577] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:56 2022] GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684 => generated 1368 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:57.190820 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-15b211b7-174b-475c-8f8c-595bf3c6cc08 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:57.191837 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-15b211b7-174b-475c-8f8c-595bf3c6cc08 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:57.198660 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-15b211b7-174b-475c-8f8c-595bf3c6cc08 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:57.200151 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-15b211b7-174b-475c-8f8c-595bf3c6cc08 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:57.209544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-15b211b7-174b-475c-8f8c-595bf3c6cc08 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:57.211698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-15b211b7-174b-475c-8f8c-595bf3c6cc08 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:57.212393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-15b211b7-174b-475c-8f8c-595bf3c6cc08 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:57.213034 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-15b211b7-174b-475c-8f8c-595bf3c6cc08 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:57.447299 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-15b211b7-174b-475c-8f8c-595bf3c6cc08 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:57.460216 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-15b211b7-174b-475c-8f8c-595bf3c6cc08 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1716 microversion: 2.1 time: 0.273252 Oct 05 02:33:57.477672 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 798/1578] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:57 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1716 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:57.487126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3270a633-7166-4c08-8b76-16d64f38009a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:57.488009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3270a633-7166-4c08-8b76-16d64f38009a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:57.494349 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3270a633-7166-4c08-8b76-16d64f38009a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:57.494838 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3270a633-7166-4c08-8b76-16d64f38009a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:57.495565 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3270a633-7166-4c08-8b76-16d64f38009a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:57.496309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3270a633-7166-4c08-8b76-16d64f38009a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:57.497227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3270a633-7166-4c08-8b76-16d64f38009a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:57.497824 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3270a633-7166-4c08-8b76-16d64f38009a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:57.942674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3270a633-7166-4c08-8b76-16d64f38009a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:57.947716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:57.958386 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3270a633-7166-4c08-8b76-16d64f38009a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:57.962194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3270a633-7166-4c08-8b76-16d64f38009a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:57.968936 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3270a633-7166-4c08-8b76-16d64f38009a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1280 microversion: 2.25 time: 0.487006 Oct 05 02:33:57.970495 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 799/1579] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:33:57 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1280 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:33:57.983845 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2c66e4e9-ea70-4a6a-b064-6b8640976e94 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:57.985293 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2c66e4e9-ea70-4a6a-b064-6b8640976e94 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:58.003160 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c66e4e9-ea70-4a6a-b064-6b8640976e94 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:58.003963 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c66e4e9-ea70-4a6a-b064-6b8640976e94 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:58.007871 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c66e4e9-ea70-4a6a-b064-6b8640976e94 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:58.009085 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c66e4e9-ea70-4a6a-b064-6b8640976e94 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:58.009798 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c66e4e9-ea70-4a6a-b064-6b8640976e94 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:58.010483 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c66e4e9-ea70-4a6a-b064-6b8640976e94 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:58.351126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2c66e4e9-ea70-4a6a-b064-6b8640976e94 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:58.364020 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2c66e4e9-ea70-4a6a-b064-6b8640976e94 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 200 len: 1498 microversion: 2.1 time: 0.390383 Oct 05 02:33:58.367583 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 800/1580] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:57 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 1498 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:58.377381 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-ad2bf9fe-4981-46b7-b646-23292b523be9 req-6a828174-488b-450e-a63c-b73216cfcdad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99fb0801-33dd-4993-a8d9-18a43e372684", "name": "network-vif-plugged", "status": "completed", "tag": "9347f3a9-118c-40ac-9d21-f7cd82266478"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:58.389743 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ad2bf9fe-4981-46b7-b646-23292b523be9 req-6a828174-488b-450e-a63c-b73216cfcdad service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:58.390629 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ad2bf9fe-4981-46b7-b646-23292b523be9 req-6a828174-488b-450e-a63c-b73216cfcdad service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:58.391311 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ad2bf9fe-4981-46b7-b646-23292b523be9 req-6a828174-488b-450e-a63c-b73216cfcdad service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:58.415021 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-ad2bf9fe-4981-46b7-b646-23292b523be9 req-6a828174-488b-450e-a63c-b73216cfcdad service nova] Creating event network-vif-plugged:9347f3a9-118c-40ac-9d21-f7cd82266478 for instance 99fb0801-33dd-4993-a8d9-18a43e372684 on n-h2-858272-3 Oct 05 02:33:58.424022 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-ad2bf9fe-4981-46b7-b646-23292b523be9 req-6a828174-488b-450e-a63c-b73216cfcdad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054494 Oct 05 02:33:58.425337 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 801/1581] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:33:58.433163 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-de64101d-9549-41e4-84e7-cd33601cad68 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:58.435029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-de64101d-9549-41e4-84e7-cd33601cad68 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 99fb0801-33dd-4993-a8d9-18a43e372684] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:58.467001 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-de64101d-9549-41e4-84e7-cd33601cad68 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:58.467308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-de64101d-9549-41e4-84e7-cd33601cad68 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:58.467954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-de64101d-9549-41e4-84e7-cd33601cad68 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:58.469014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-de64101d-9549-41e4-84e7-cd33601cad68 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:58.469782 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-de64101d-9549-41e4-84e7-cd33601cad68 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:58.470371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-de64101d-9549-41e4-84e7-cd33601cad68 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:58.728302 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0f5e5087-6666-4acd-a291-c8f3cab61cec tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.478888 Oct 05 02:33:58.730211 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 781/1582] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Oct 5 02:33:56 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:33:58.738075 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-45bbb343-1afe-443a-b908-121c2c9c0607 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:58.738973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-45bbb343-1afe-443a-b908-121c2c9c0607 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:58.747198 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45bbb343-1afe-443a-b908-121c2c9c0607 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:58.748060 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45bbb343-1afe-443a-b908-121c2c9c0607 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:58.748710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45bbb343-1afe-443a-b908-121c2c9c0607 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:58.749798 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45bbb343-1afe-443a-b908-121c2c9c0607 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:58.750487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45bbb343-1afe-443a-b908-121c2c9c0607 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:58.751124 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45bbb343-1afe-443a-b908-121c2c9c0607 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:58.786771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:58.787775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-de64101d-9549-41e4-84e7-cd33601cad68 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:58.800699 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-de64101d-9549-41e4-84e7-cd33601cad68 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684" status: 200 len: 1368 microversion: 2.1 time: 0.373482 Oct 05 02:33:58.803328 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 802/1583] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:58 2022] GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684 => generated 1368 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:58.814864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-38939dd2-ad43-4c82-8e25-1f54745c6a3d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Action: 'action', calling method: .version_select at 0x7fcce5b18b80>, body: {"addFloatingIp": {"address": "172.25.5.61"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:33:58.820937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-38939dd2-ad43-4c82-8e25-1f54745c6a3d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] [instance: 8b942fed-d4b6-403d-b121-a53278fe83c3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:58.836518 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38939dd2-ad43-4c82-8e25-1f54745c6a3d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:58.838812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38939dd2-ad43-4c82-8e25-1f54745c6a3d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:58.839377 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38939dd2-ad43-4c82-8e25-1f54745c6a3d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:58.841817 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38939dd2-ad43-4c82-8e25-1f54745c6a3d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:58.842541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38939dd2-ad43-4c82-8e25-1f54745c6a3d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:58.843281 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38939dd2-ad43-4c82-8e25-1f54745c6a3d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:58.955807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38939dd2-ad43-4c82-8e25-1f54745c6a3d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "refresh_cache-8b942fed-d4b6-403d-b121-a53278fe83c3" {{(pid=122320) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 05 02:33:58.956211 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38939dd2-ad43-4c82-8e25-1f54745c6a3d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquired lock "refresh_cache-8b942fed-d4b6-403d-b121-a53278fe83c3" {{(pid=122320) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 05 02:33:58.961856 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-45bbb343-1afe-443a-b908-121c2c9c0607 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:58.977543 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-45bbb343-1afe-443a-b908-121c2c9c0607 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1706 microversion: 2.1 time: 0.240443 Oct 05 02:33:58.982337 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 782/1584] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:58 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1706 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:59.004999 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1f357c4b-bfc6-4319-b049-3b915ba1ef8e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:59.005788 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1f357c4b-bfc6-4319-b049-3b915ba1ef8e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:59.013438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f357c4b-bfc6-4319-b049-3b915ba1ef8e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:59.014723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f357c4b-bfc6-4319-b049-3b915ba1ef8e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:59.015325 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f357c4b-bfc6-4319-b049-3b915ba1ef8e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:59.016173 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f357c4b-bfc6-4319-b049-3b915ba1ef8e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:59.016779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f357c4b-bfc6-4319-b049-3b915ba1ef8e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:59.017354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f357c4b-bfc6-4319-b049-3b915ba1ef8e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:59.423526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1f357c4b-bfc6-4319-b049-3b915ba1ef8e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:59.435876 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1f357c4b-bfc6-4319-b049-3b915ba1ef8e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:59.438100 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1f357c4b-bfc6-4319-b049-3b915ba1ef8e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:59.449866 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1f357c4b-bfc6-4319-b049-3b915ba1ef8e tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1280 microversion: 2.25 time: 0.453774 Oct 05 02:33:59.450745 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 783/1585] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:33:58 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1280 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:33:59.458694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c938717c-ef99-4f1d-867c-8e0613ac434d tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Calling method '.version_select at 0x7fcce45ff160>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:59.464206 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c938717c-ef99-4f1d-867c-8e0613ac434d tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:59.467734 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c938717c-ef99-4f1d-867c-8e0613ac434d tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:59.468476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c938717c-ef99-4f1d-867c-8e0613ac434d tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:59.481474 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c938717c-ef99-4f1d-867c-8e0613ac434d tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 2318 microversion: 2.1 time: 0.027858 Oct 05 02:33:59.482768 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 784/1586] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 5 02:33:59 2022] GET /compute/v2.1/os-migrations => generated 2318 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:59.493240 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e54270e0-ce42-4c73-b467-dcc15db9978a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:59.494118 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e54270e0-ce42-4c73-b467-dcc15db9978a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:59.513919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e54270e0-ce42-4c73-b467-dcc15db9978a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:59.516721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e54270e0-ce42-4c73-b467-dcc15db9978a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:59.517419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e54270e0-ce42-4c73-b467-dcc15db9978a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:59.518276 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e54270e0-ce42-4c73-b467-dcc15db9978a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:59.518851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e54270e0-ce42-4c73-b467-dcc15db9978a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:59.521214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e54270e0-ce42-4c73-b467-dcc15db9978a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:59.579821 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e54270e0-ce42-4c73-b467-dcc15db9978a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d/ips" status: 200 len: 151 microversion: 2.20 time: 0.093663 Oct 05 02:33:59.582182 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 785/1587] 10.222.0.16 () {60 vars in 1289 bytes} [Wed Oct 5 02:33:59 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d/ips => generated 151 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:33:59.598832 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4951f6c6-f726-43b8-be13-2cddcded9a1e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:59.599768 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4951f6c6-f726-43b8-be13-2cddcded9a1e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:59.620448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4951f6c6-f726-43b8-be13-2cddcded9a1e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:59.620969 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4951f6c6-f726-43b8-be13-2cddcded9a1e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:59.623531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4951f6c6-f726-43b8-be13-2cddcded9a1e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:59.624287 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4951f6c6-f726-43b8-be13-2cddcded9a1e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:59.624750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4951f6c6-f726-43b8-be13-2cddcded9a1e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:59.625208 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4951f6c6-f726-43b8-be13-2cddcded9a1e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:59.788045 n-d-858272-3 devstack@n-api.service[122320]: DEBUG neutronclient.v2_0.client [None req-38939dd2-ad43-4c82-8e25-1f54745c6a3d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.5.61 (f30e37cb-ac32-42af-ae99-2a09195aa6a2) with port 7e37d2c3-c78d-464d-858e-6d91f57fa6d5 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 8822eb34-3330-4956-843b-08d392361d41.", "detail": ""}} {{(pid=122320) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 02:33:59.788623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38939dd2-ad43-4c82-8e25-1f54745c6a3d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Releasing lock "refresh_cache-8b942fed-d4b6-403d-b121-a53278fe83c3" {{(pid=122320) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 05 02:33:59.791077 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-38939dd2-ad43-4c82-8e25-1f54745c6a3d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] HTTP exception thrown: Cannot associate floating IP 172.25.5.61 (f30e37cb-ac32-42af-ae99-2a09195aa6a2) with port 7e37d2c3-c78d-464d-858e-6d91f57fa6d5 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 8822eb34-3330-4956-843b-08d392361d41. Oct 05 02:33:59.791077 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-0cee33c5-3169-48e8-a71a-e10d922ce26c'] Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-38939dd2-ad43-4c82-8e25-1f54745c6a3d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Request method failure captured: Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3/action HTTP/1.1 Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 45 Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOzwbQ_6-3L7uXAbh921EKnX0fu0osbfa39bbWy20UsTPXkk3BWapQnlmLwRvnXIjd_mswQm06LHM-WgZSphGLcXr5KyfRAgNVEZ_OtwiCfG6Iotl2LZdH1VW7UqyO01pkWARIQAynUSvi8QEvRLRSFiNFJenoQUS0KIUMnI0R8gpPA Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: dc5e5d31e8a94667b52be18ed414d846 Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-910845551 Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dc5e5d31e8a94667b52be18ed414d846"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dc5e5d31e8a94667b52be18ed414d846"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dc5e5d31e8a94667b52be18ed414d846"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dc5e5d31e8a94667b52be18ed414d846"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-910845551 Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: dc5e5d31e8a94667b52be18ed414d846 Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-910845551 Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 0b8c2b48f17b470aaa79d4f4a4a7215c Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: {"addFloatingIp": {"address": "172.25.5.61"}} Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: exception: Cannot associate floating IP 172.25.5.61 (f30e37cb-ac32-42af-ae99-2a09195aa6a2) with port 7e37d2c3-c78d-464d-858e-6d91f57fa6d5 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 8822eb34-3330-4956-843b-08d392361d41. Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-0cee33c5-3169-48e8-a71a-e10d922ce26c'] Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '8b942fed-d4b6-403d-b121-a53278fe83c3', 'body': {'addFloatingIp': {'address': '172.25.5.61'}}} Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 02:33:59.794384 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.5.61 (f30e37cb-ac32-42af-ae99-2a09195aa6a2) with port 7e37d2c3-c78d-464d-858e-6d91f57fa6d5 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 8822eb34-3330-4956-843b-08d392361d41. Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0cee33c5-3169-48e8-a71a-e10d922ce26c'] Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.5.61 (f30e37cb-ac32-42af-ae99-2a09195aa6a2) with port 7e37d2c3-c78d-464d-858e-6d91f57fa6d5 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 8822eb34-3330-4956-843b-08d392361d41. Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0cee33c5-3169-48e8-a71a-e10d922ce26c'] Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.5.61 (f30e37cb-ac32-42af-ae99-2a09195aa6a2) with port 7e37d2c3-c78d-464d-858e-6d91f57fa6d5 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 8822eb34-3330-4956-843b-08d392361d41. Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0cee33c5-3169-48e8-a71a-e10d922ce26c'] Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.5.61 (f30e37cb-ac32-42af-ae99-2a09195aa6a2) with port 7e37d2c3-c78d-464d-858e-6d91f57fa6d5 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 8822eb34-3330-4956-843b-08d392361d41. Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0cee33c5-3169-48e8-a71a-e10d922ce26c'] Oct 05 02:33:59.798875 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:33:59.805651 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-38939dd2-ad43-4c82-8e25-1f54745c6a3d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Returning 400 to user: Cannot associate floating IP 172.25.5.61 (f30e37cb-ac32-42af-ae99-2a09195aa6a2) with port 7e37d2c3-c78d-464d-858e-6d91f57fa6d5 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 8822eb34-3330-4956-843b-08d392361d41. Oct 05 02:33:59.805651 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-0cee33c5-3169-48e8-a71a-e10d922ce26c'] {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:33:59.805651 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-38939dd2-ad43-4c82-8e25-1f54745c6a3d tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] 10.222.0.16 "POST /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3/action" status: 400 len: 380 microversion: 2.1 time: 0.991569 Oct 05 02:33:59.805651 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 803/1588] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:33:58 2022] POST /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3/action => generated 380 bytes in 996 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:33:59.814501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d2d84494-bbdb-4b77-9463-85eab0f14421 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:33:59.815170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d2d84494-bbdb-4b77-9463-85eab0f14421 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:33:59.824854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2d84494-bbdb-4b77-9463-85eab0f14421 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:59.826495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2d84494-bbdb-4b77-9463-85eab0f14421 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:59.827503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2d84494-bbdb-4b77-9463-85eab0f14421 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:59.830102 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2d84494-bbdb-4b77-9463-85eab0f14421 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:33:59.830703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2d84494-bbdb-4b77-9463-85eab0f14421 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:33:59.831132 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2d84494-bbdb-4b77-9463-85eab0f14421 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:33:59.873611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4951f6c6-f726-43b8-be13-2cddcded9a1e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:33:59.884148 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4951f6c6-f726-43b8-be13-2cddcded9a1e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 200 len: 1498 microversion: 2.1 time: 0.299599 Oct 05 02:33:59.885539 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 786/1589] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:59 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 1498 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:33:59.891362 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1e45a480-c7d5-4479-b26e-bba114607935 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Calling method '.version_select at 0x7fcce429ee50>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:00.132332 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d2d84494-bbdb-4b77-9463-85eab0f14421 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1857 microversion: 2.1 time: 0.330088 Oct 05 02:34:00.151942 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 804/1590] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:33:59 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1857 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:00.159983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b1151897-c970-474e-97ea-c323bd0632a6 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:00.161107 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b1151897-c970-474e-97ea-c323bd0632a6 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 99fb0801-33dd-4993-a8d9-18a43e372684] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:00.167469 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b1151897-c970-474e-97ea-c323bd0632a6 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:00.168002 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b1151897-c970-474e-97ea-c323bd0632a6 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:00.169139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b1151897-c970-474e-97ea-c323bd0632a6 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:00.170150 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b1151897-c970-474e-97ea-c323bd0632a6 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:00.170617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b1151897-c970-474e-97ea-c323bd0632a6 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:00.171047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b1151897-c970-474e-97ea-c323bd0632a6 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:00.441725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b1151897-c970-474e-97ea-c323bd0632a6 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:00.453891 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b1151897-c970-474e-97ea-c323bd0632a6 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684" status: 200 len: 1368 microversion: 2.1 time: 0.299679 Oct 05 02:34:00.455464 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 805/1591] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:00 2022] GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684 => generated 1368 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:00.727710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d6857fcd-28c8-4159-8072-63028968dcd9 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-406322141", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "3003c70e-e5f1-4423-9bef-5932f599e8ba"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:00.819395 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-d6857fcd-28c8-4159-8072-63028968dcd9 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] validate_networks() for [('3003c70e-e5f1-4423-9bef-5932f599e8ba', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:34:01.508186 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1e45a480-c7d5-4479-b26e-bba114607935 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/f30e37cb-ac32-42af-ae99-2a09195aa6a2" status: 202 len: 0 microversion: 2.1 time: 1.621425 Oct 05 02:34:01.512968 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 787/1592] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 5 02:33:59 2022] DELETE /compute/v2.1/os-floating-ips/f30e37cb-ac32-42af-ae99-2a09195aa6a2 => generated 0 bytes in 1623 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:34:01.516578 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4814415f-bc20-41a7-8aef-4e15c5f6cf88 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:01.517223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4814415f-bc20-41a7-8aef-4e15c5f6cf88 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:01.524446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4814415f-bc20-41a7-8aef-4e15c5f6cf88 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:01.524642 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4814415f-bc20-41a7-8aef-4e15c5f6cf88 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:01.525099 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4814415f-bc20-41a7-8aef-4e15c5f6cf88 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:01.525803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4814415f-bc20-41a7-8aef-4e15c5f6cf88 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:01.526453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4814415f-bc20-41a7-8aef-4e15c5f6cf88 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:01.526888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4814415f-bc20-41a7-8aef-4e15c5f6cf88 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:01.763870 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4814415f-bc20-41a7-8aef-4e15c5f6cf88 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1857 microversion: 2.1 time: 0.252750 Oct 05 02:34:01.766324 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 788/1593] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:01 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1857 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:01.771260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-dd2120d4-cbd9-4331-8620-769cf67c4911 req-47185170-a025-4f88-8004-1de8da4e105c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a786593b-2c6f-4bc5-b338-8715c7d0429f", "name": "network-vif-plugged", "status": "completed", "tag": "d0b44992-5d97-49da-98a0-6facb5cee1a2"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:01.785326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-dd2120d4-cbd9-4331-8620-769cf67c4911 req-47185170-a025-4f88-8004-1de8da4e105c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:01.787486 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-dd2120d4-cbd9-4331-8620-769cf67c4911 req-47185170-a025-4f88-8004-1de8da4e105c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:01.788202 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-dd2120d4-cbd9-4331-8620-769cf67c4911 req-47185170-a025-4f88-8004-1de8da4e105c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:01.809410 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-dd2120d4-cbd9-4331-8620-769cf67c4911 req-47185170-a025-4f88-8004-1de8da4e105c service nova] Creating event network-vif-plugged:d0b44992-5d97-49da-98a0-6facb5cee1a2 for instance a786593b-2c6f-4bc5-b338-8715c7d0429f on n-h1-858272-3 Oct 05 02:34:01.817068 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-dd2120d4-cbd9-4331-8620-769cf67c4911 req-47185170-a025-4f88-8004-1de8da4e105c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048569 Oct 05 02:34:01.817844 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 789/1594] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:34:01.828801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8132a57d-40a1-40fa-a3ba-f7156ed4a84b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:01.829322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-d6857fcd-28c8-4159-8072-63028968dcd9 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:34:01.829800 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-d6857fcd-28c8-4159-8072-63028968dcd9 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:34:01.830214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-d6857fcd-28c8-4159-8072-63028968dcd9 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:34:01.830396 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8132a57d-40a1-40fa-a3ba-f7156ed4a84b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:01.830633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-d6857fcd-28c8-4159-8072-63028968dcd9 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:34:01.831081 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-d6857fcd-28c8-4159-8072-63028968dcd9 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:34:01.839448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8132a57d-40a1-40fa-a3ba-f7156ed4a84b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:01.840785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d6857fcd-28c8-4159-8072-63028968dcd9 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:01.841531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8132a57d-40a1-40fa-a3ba-f7156ed4a84b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:01.841531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8132a57d-40a1-40fa-a3ba-f7156ed4a84b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:01.842301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d6857fcd-28c8-4159-8072-63028968dcd9 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:01.842893 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d6857fcd-28c8-4159-8072-63028968dcd9 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:01.843053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8132a57d-40a1-40fa-a3ba-f7156ed4a84b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:01.843373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8132a57d-40a1-40fa-a3ba-f7156ed4a84b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:01.843807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8132a57d-40a1-40fa-a3ba-f7156ed4a84b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:01.844452 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d6857fcd-28c8-4159-8072-63028968dcd9 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:01.845128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d6857fcd-28c8-4159-8072-63028968dcd9 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:01.845731 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d6857fcd-28c8-4159-8072-63028968dcd9 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:01.885878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-d6857fcd-28c8-4159-8072-63028968dcd9 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Getting quotas for project 47098be734b14277a4d9a9d6b8464998. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:34:01.885878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-d6857fcd-28c8-4159-8072-63028968dcd9 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Getting quotas for user 4c441be8c87648bf9f1ff5cd4aff2532 and project 47098be734b14277a4d9a9d6b8464998. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:34:01.900036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d6857fcd-28c8-4159-8072-63028968dcd9 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:34:01.903375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d6857fcd-28c8-4159-8072-63028968dcd9 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:34:01.978890 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d6857fcd-28c8-4159-8072-63028968dcd9 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.521852 Oct 05 02:34:01.982513 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 806/1595] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:34:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:34:01.988827 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d3a02e0d-6e46-4fa4-929b-1aa7e782178e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:01.993111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d3a02e0d-6e46-4fa4-929b-1aa7e782178e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:02.003742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3a02e0d-6e46-4fa4-929b-1aa7e782178e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:02.003742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3a02e0d-6e46-4fa4-929b-1aa7e782178e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:02.005405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3a02e0d-6e46-4fa4-929b-1aa7e782178e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:02.006457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3a02e0d-6e46-4fa4-929b-1aa7e782178e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:02.007082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3a02e0d-6e46-4fa4-929b-1aa7e782178e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:02.007685 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3a02e0d-6e46-4fa4-929b-1aa7e782178e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:02.076890 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8132a57d-40a1-40fa-a3ba-f7156ed4a84b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:02.090236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8132a57d-40a1-40fa-a3ba-f7156ed4a84b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:02.092439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8132a57d-40a1-40fa-a3ba-f7156ed4a84b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:02.095659 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8132a57d-40a1-40fa-a3ba-f7156ed4a84b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1280 microversion: 2.25 time: 0.272603 Oct 05 02:34:02.106906 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 790/1596] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:01 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1280 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:02.121224 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9cecaae7-82f4-4d6f-bd87-daae1a8cacfd tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:02.122801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9cecaae7-82f4-4d6f-bd87-daae1a8cacfd tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 99fb0801-33dd-4993-a8d9-18a43e372684] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:02.130116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cecaae7-82f4-4d6f-bd87-daae1a8cacfd tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:02.130610 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cecaae7-82f4-4d6f-bd87-daae1a8cacfd tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:02.131039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cecaae7-82f4-4d6f-bd87-daae1a8cacfd tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:02.131936 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cecaae7-82f4-4d6f-bd87-daae1a8cacfd tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:02.132560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cecaae7-82f4-4d6f-bd87-daae1a8cacfd tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:02.133187 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cecaae7-82f4-4d6f-bd87-daae1a8cacfd tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:02.304393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d3a02e0d-6e46-4fa4-929b-1aa7e782178e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:02.316170 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d3a02e0d-6e46-4fa4-929b-1aa7e782178e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 200 len: 1498 microversion: 2.1 time: 0.332340 Oct 05 02:34:02.317435 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 807/1597] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:01 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 1498 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:02.322530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8e65ed83-ba55-4f67-b3d3-9d3de2356508 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Action: 'action', calling method: .version_select at 0x7fcce659fa60>, body: {"removeFloatingIp": {"address": "172.25.5.197"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:02.337531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9cecaae7-82f4-4d6f-bd87-daae1a8cacfd tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:02.347659 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9cecaae7-82f4-4d6f-bd87-daae1a8cacfd tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684" status: 200 len: 1559 microversion: 2.1 time: 0.238943 Oct 05 02:34:02.348717 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 791/1598] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:02 2022] GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684 => generated 1559 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:02.355759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d8993675-8c21-4c12-8fab-a1b8f97edc62 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:02.357080 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d8993675-8c21-4c12-8fab-a1b8f97edc62 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:02.364228 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8993675-8c21-4c12-8fab-a1b8f97edc62 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:02.365420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8993675-8c21-4c12-8fab-a1b8f97edc62 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:02.366526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8993675-8c21-4c12-8fab-a1b8f97edc62 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:02.368938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8993675-8c21-4c12-8fab-a1b8f97edc62 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:02.369826 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8993675-8c21-4c12-8fab-a1b8f97edc62 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:02.370855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8993675-8c21-4c12-8fab-a1b8f97edc62 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:02.520321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-d8993675-8c21-4c12-8fab-a1b8f97edc62 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lazy-loading 'services' on Instance uuid 9a19871a-12bc-45d8-ad01-489ad68f1e00 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:34:02.548256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8e65ed83-ba55-4f67-b3d3-9d3de2356508 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] [instance: 8b942fed-d4b6-403d-b121-a53278fe83c3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:02.555589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e65ed83-ba55-4f67-b3d3-9d3de2356508 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:02.556345 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e65ed83-ba55-4f67-b3d3-9d3de2356508 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:02.561001 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e65ed83-ba55-4f67-b3d3-9d3de2356508 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:02.561001 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e65ed83-ba55-4f67-b3d3-9d3de2356508 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:02.561001 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e65ed83-ba55-4f67-b3d3-9d3de2356508 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:02.561580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e65ed83-ba55-4f67-b3d3-9d3de2356508 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:02.651071 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d8993675-8c21-4c12-8fab-a1b8f97edc62 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00/os-volume_attachments/a0339c51-4ab1-46fd-a7e2-e03bcba7f794" status: 202 len: 0 microversion: 2.1 time: 0.300623 Oct 05 02:34:02.652116 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 792/1599] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 02:34:02 2022] DELETE /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00/os-volume_attachments/a0339c51-4ab1-46fd-a7e2-e03bcba7f794 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:34:02.658742 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c09e4881-0c4f-484e-8641-6697a7dacb2b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:02.659829 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c09e4881-0c4f-484e-8641-6697a7dacb2b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:02.667392 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c09e4881-0c4f-484e-8641-6697a7dacb2b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:02.668091 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c09e4881-0c4f-484e-8641-6697a7dacb2b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:02.669861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c09e4881-0c4f-484e-8641-6697a7dacb2b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:02.670819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c09e4881-0c4f-484e-8641-6697a7dacb2b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:02.671476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c09e4881-0c4f-484e-8641-6697a7dacb2b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:02.672097 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c09e4881-0c4f-484e-8641-6697a7dacb2b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:02.766982 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c09e4881-0c4f-484e-8641-6697a7dacb2b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:02.778274 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c09e4881-0c4f-484e-8641-6697a7dacb2b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776" status: 200 len: 1228 microversion: 2.1 time: 0.123668 Oct 05 02:34:02.780227 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 793/1600] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:02 2022] GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776 => generated 1228 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:02.785488 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c397ff4f-a709-49c3-a6d6-bdbbdfbe5c06 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:02.786820 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c397ff4f-a709-49c3-a6d6-bdbbdfbe5c06 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 99fb0801-33dd-4993-a8d9-18a43e372684] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:02.796308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c397ff4f-a709-49c3-a6d6-bdbbdfbe5c06 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:02.797517 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c397ff4f-a709-49c3-a6d6-bdbbdfbe5c06 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:02.798218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c397ff4f-a709-49c3-a6d6-bdbbdfbe5c06 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:02.799730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c397ff4f-a709-49c3-a6d6-bdbbdfbe5c06 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:02.800537 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c397ff4f-a709-49c3-a6d6-bdbbdfbe5c06 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:02.801344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c397ff4f-a709-49c3-a6d6-bdbbdfbe5c06 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:02.974576 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c397ff4f-a709-49c3-a6d6-bdbbdfbe5c06 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.192913 Oct 05 02:34:02.975177 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 794/1601] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 02:34:02 2022] GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684/os-interface => generated 285 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:34:02.980308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e2725148-33ad-4b01-9142-5a61dc298769 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:02.982910 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e2725148-33ad-4b01-9142-5a61dc298769 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:02.994865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e2725148-33ad-4b01-9142-5a61dc298769 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:02.995557 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e2725148-33ad-4b01-9142-5a61dc298769 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:02.996187 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e2725148-33ad-4b01-9142-5a61dc298769 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:02.999624 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e2725148-33ad-4b01-9142-5a61dc298769 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:03.000107 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e2725148-33ad-4b01-9142-5a61dc298769 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:03.000539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e2725148-33ad-4b01-9142-5a61dc298769 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:03.036506 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e2725148-33ad-4b01-9142-5a61dc298769 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060089 Oct 05 02:34:03.037442 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 795/1602] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 02:34:02 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:34:03.049414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e8ba77b8-e994-40fc-9a64-622f24185744 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:03.050355 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e8ba77b8-e994-40fc-9a64-622f24185744 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:03.057546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8ba77b8-e994-40fc-9a64-622f24185744 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:03.058367 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8ba77b8-e994-40fc-9a64-622f24185744 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:03.059740 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8ba77b8-e994-40fc-9a64-622f24185744 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:03.060740 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8ba77b8-e994-40fc-9a64-622f24185744 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:03.061451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8ba77b8-e994-40fc-9a64-622f24185744 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:03.063013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8ba77b8-e994-40fc-9a64-622f24185744 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:03.095528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-e8ba77b8-e994-40fc-9a64-622f24185744 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lazy-loading 'flavor' on Instance uuid 7a28c6ea-5b3d-4f74-b490-8effa4fa813d {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:34:03.174905 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e65ed83-ba55-4f67-b3d3-9d3de2356508 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "refresh_cache-8b942fed-d4b6-403d-b121-a53278fe83c3" {{(pid=122320) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 05 02:34:03.175430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e65ed83-ba55-4f67-b3d3-9d3de2356508 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquired lock "refresh_cache-8b942fed-d4b6-403d-b121-a53278fe83c3" {{(pid=122320) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 05 02:34:03.399134 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e8ba77b8-e994-40fc-9a64-622f24185744 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "POST /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d/action" status: 202 len: 0 microversion: 2.20 time: 0.360226 Oct 05 02:34:03.400215 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 796/1603] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 5 02:34:03 2022] POST /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:34:03.407005 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6be1eae6-6e5d-4eb2-939b-431b0d405799 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:03.408050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6be1eae6-6e5d-4eb2-939b-431b0d405799 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:03.416430 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6be1eae6-6e5d-4eb2-939b-431b0d405799 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:03.417248 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6be1eae6-6e5d-4eb2-939b-431b0d405799 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:03.417915 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6be1eae6-6e5d-4eb2-939b-431b0d405799 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:03.420350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6be1eae6-6e5d-4eb2-939b-431b0d405799 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:03.421492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6be1eae6-6e5d-4eb2-939b-431b0d405799 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:03.422889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6be1eae6-6e5d-4eb2-939b-431b0d405799 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:04.019439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6be1eae6-6e5d-4eb2-939b-431b0d405799 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:04.029598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6be1eae6-6e5d-4eb2-939b-431b0d405799 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:04.031057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6be1eae6-6e5d-4eb2-939b-431b0d405799 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:04.041475 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6be1eae6-6e5d-4eb2-939b-431b0d405799 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1280 microversion: 2.25 time: 0.639621 Oct 05 02:34:04.043865 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 797/1604] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:03 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1280 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:04.054836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5f889052-7336-44df-8aaf-5af22b236070 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:04.055471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5f889052-7336-44df-8aaf-5af22b236070 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:04.065563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f889052-7336-44df-8aaf-5af22b236070 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:04.066062 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f889052-7336-44df-8aaf-5af22b236070 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:04.069056 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f889052-7336-44df-8aaf-5af22b236070 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:04.069870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f889052-7336-44df-8aaf-5af22b236070 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:04.070354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f889052-7336-44df-8aaf-5af22b236070 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:04.070796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f889052-7336-44df-8aaf-5af22b236070 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:04.750103 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5f889052-7336-44df-8aaf-5af22b236070 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:04.764947 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5f889052-7336-44df-8aaf-5af22b236070 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 200 len: 1498 microversion: 2.1 time: 0.720350 Oct 05 02:34:04.767159 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 798/1605] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:04 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 1498 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:04.784928 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-17f73931-876b-4717-8073-f2ce13d42a53 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:04.785722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-17f73931-876b-4717-8073-f2ce13d42a53 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:04.793132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17f73931-876b-4717-8073-f2ce13d42a53 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:04.793938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17f73931-876b-4717-8073-f2ce13d42a53 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:04.794610 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17f73931-876b-4717-8073-f2ce13d42a53 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:04.796158 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17f73931-876b-4717-8073-f2ce13d42a53 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:04.796875 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17f73931-876b-4717-8073-f2ce13d42a53 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:04.798197 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17f73931-876b-4717-8073-f2ce13d42a53 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:04.820206 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:34:05.274120 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-17f73931-876b-4717-8073-f2ce13d42a53 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:05.279994 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-8e65ed83-ba55-4f67-b3d3-9d3de2356508 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] [instance: 8b942fed-d4b6-403d-b121-a53278fe83c3] Building network info cache for instance {{(pid=122320) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 05 02:34:05.316544 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-17f73931-876b-4717-8073-f2ce13d42a53 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:05.330921 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-17f73931-876b-4717-8073-f2ce13d42a53 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:05.336544 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-17f73931-876b-4717-8073-f2ce13d42a53 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1723 microversion: 2.20 time: 0.567642 Oct 05 02:34:05.337371 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 799/1606] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:04 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1723 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:05.348726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-271bfbab-8edd-413a-b0c7-575fae32776a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:05.349759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-271bfbab-8edd-413a-b0c7-575fae32776a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:05.359290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-271bfbab-8edd-413a-b0c7-575fae32776a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:05.359887 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-271bfbab-8edd-413a-b0c7-575fae32776a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:05.360413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-271bfbab-8edd-413a-b0c7-575fae32776a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:05.362694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-271bfbab-8edd-413a-b0c7-575fae32776a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:05.363484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-271bfbab-8edd-413a-b0c7-575fae32776a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:05.363937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-271bfbab-8edd-413a-b0c7-575fae32776a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:05.539845 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-271bfbab-8edd-413a-b0c7-575fae32776a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:05.553838 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-271bfbab-8edd-413a-b0c7-575fae32776a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776" status: 200 len: 1282 microversion: 2.1 time: 0.213004 Oct 05 02:34:05.556021 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 800/1607] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:05 2022] GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776 => generated 1282 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:05.563651 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3fbcae84-51d6-41a4-8792-e742d3e772b1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:05.567754 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3fbcae84-51d6-41a4-8792-e742d3e772b1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:05.577785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3fbcae84-51d6-41a4-8792-e742d3e772b1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:05.579478 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3fbcae84-51d6-41a4-8792-e742d3e772b1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:05.580072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3fbcae84-51d6-41a4-8792-e742d3e772b1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:05.583718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3fbcae84-51d6-41a4-8792-e742d3e772b1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:05.584284 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3fbcae84-51d6-41a4-8792-e742d3e772b1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:05.584984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3fbcae84-51d6-41a4-8792-e742d3e772b1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:05.635816 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3fbcae84-51d6-41a4-8792-e742d3e772b1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078292 Oct 05 02:34:05.636552 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 801/1608] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 02:34:05 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:34:05.644071 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b8b3025e-d4e4-4ade-a4d1-c9367b2429d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:05.645042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b8b3025e-d4e4-4ade-a4d1-c9367b2429d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:05.658188 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8b3025e-d4e4-4ade-a4d1-c9367b2429d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:05.658698 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8b3025e-d4e4-4ade-a4d1-c9367b2429d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:05.664267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8b3025e-d4e4-4ade-a4d1-c9367b2429d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:05.664267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8b3025e-d4e4-4ade-a4d1-c9367b2429d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:05.664267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8b3025e-d4e4-4ade-a4d1-c9367b2429d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:05.664267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8b3025e-d4e4-4ade-a4d1-c9367b2429d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:06.013896 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b8b3025e-d4e4-4ade-a4d1-c9367b2429d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:06.030282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b8b3025e-d4e4-4ade-a4d1-c9367b2429d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:06.031975 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b8b3025e-d4e4-4ade-a4d1-c9367b2429d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:06.033383 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b8b3025e-d4e4-4ade-a4d1-c9367b2429d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1477 microversion: 2.25 time: 0.394337 Oct 05 02:34:06.034136 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 802/1609] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:05 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1477 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:06.038769 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-d6d3a0a0-2858-410c-8801-aca709591f12 req-d49e12f4-2e53-4527-89a9-de763e6d69e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b942fed-d4b6-403d-b121-a53278fe83c3", "tag": "7e37d2c3-c78d-464d-858e-6d91f57fa6d5"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:06.070880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d6d3a0a0-2858-410c-8801-aca709591f12 req-d49e12f4-2e53-4527-89a9-de763e6d69e8 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:06.071363 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d6d3a0a0-2858-410c-8801-aca709591f12 req-d49e12f4-2e53-4527-89a9-de763e6d69e8 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:06.071989 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d6d3a0a0-2858-410c-8801-aca709591f12 req-d49e12f4-2e53-4527-89a9-de763e6d69e8 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:06.084927 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-d6d3a0a0-2858-410c-8801-aca709591f12 req-d49e12f4-2e53-4527-89a9-de763e6d69e8 service nova] Creating event network-changed:7e37d2c3-c78d-464d-858e-6d91f57fa6d5 for instance 8b942fed-d4b6-403d-b121-a53278fe83c3 on n-h2-858272-3 Oct 05 02:34:06.102392 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-d6d3a0a0-2858-410c-8801-aca709591f12 req-d49e12f4-2e53-4527-89a9-de763e6d69e8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066903 Oct 05 02:34:06.103299 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 803/1610] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:34:06.109828 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-868d35b7-943f-4865-88cf-90e8a0c17803 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:06.122602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-868d35b7-943f-4865-88cf-90e8a0c17803 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:06.132473 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-868d35b7-943f-4865-88cf-90e8a0c17803 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:06.132992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-868d35b7-943f-4865-88cf-90e8a0c17803 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:06.133428 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-868d35b7-943f-4865-88cf-90e8a0c17803 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:06.134132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-868d35b7-943f-4865-88cf-90e8a0c17803 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:06.134575 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-868d35b7-943f-4865-88cf-90e8a0c17803 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:06.139932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-868d35b7-943f-4865-88cf-90e8a0c17803 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:06.755735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-868d35b7-943f-4865-88cf-90e8a0c17803 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:06.766247 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-868d35b7-943f-4865-88cf-90e8a0c17803 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 200 len: 1498 microversion: 2.1 time: 0.661312 Oct 05 02:34:06.770906 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 804/1611] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:06 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 1498 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:06.899872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-8e65ed83-ba55-4f67-b3d3-9d3de2356508 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] [instance: 8b942fed-d4b6-403d-b121-a53278fe83c3] Updating instance_info_cache with network_info: [{"id": "7e37d2c3-c78d-464d-858e-6d91f57fa6d5", "address": "fa:16:3e:e7:9c:f1", "network": {"id": "a9b9a246-d688-4317-bc49-b07fde7d021b", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-901301512-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "dc5e5d31e8a94667b52be18ed414d846", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7e37d2c3-c7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122320) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 05 02:34:06.929676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e65ed83-ba55-4f67-b3d3-9d3de2356508 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Releasing lock "refresh_cache-8b942fed-d4b6-403d-b121-a53278fe83c3" {{(pid=122320) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 05 02:34:06.930836 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8e65ed83-ba55-4f67-b3d3-9d3de2356508 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] 10.222.0.16 "POST /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3/action" status: 202 len: 0 microversion: 2.1 time: 4.612097 Oct 05 02:34:06.935133 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 808/1612] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:34:02 2022] POST /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3/action => generated 0 bytes in 4617 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 05 02:34:06.940067 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-78a6c60a-775b-4745-a9ed-81e98ef2fa4e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:06.941807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-78a6c60a-775b-4745-a9ed-81e98ef2fa4e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:06.956182 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:34:06.959965 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78a6c60a-775b-4745-a9ed-81e98ef2fa4e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:06.964077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78a6c60a-775b-4745-a9ed-81e98ef2fa4e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:06.966227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78a6c60a-775b-4745-a9ed-81e98ef2fa4e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:06.967256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78a6c60a-775b-4745-a9ed-81e98ef2fa4e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:06.968046 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78a6c60a-775b-4745-a9ed-81e98ef2fa4e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:06.969855 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78a6c60a-775b-4745-a9ed-81e98ef2fa4e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:07.050592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b5c6c733-6f21-496c-b442-d5d5ebcb4043 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:07.051875 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b5c6c733-6f21-496c-b442-d5d5ebcb4043 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:07.065837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5c6c733-6f21-496c-b442-d5d5ebcb4043 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:07.068646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5c6c733-6f21-496c-b442-d5d5ebcb4043 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:07.069471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5c6c733-6f21-496c-b442-d5d5ebcb4043 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:07.070473 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5c6c733-6f21-496c-b442-d5d5ebcb4043 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:07.073554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5c6c733-6f21-496c-b442-d5d5ebcb4043 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:07.074783 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5c6c733-6f21-496c-b442-d5d5ebcb4043 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:07.423697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-78a6c60a-775b-4745-a9ed-81e98ef2fa4e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:07.441222 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-78a6c60a-775b-4745-a9ed-81e98ef2fa4e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:07.442657 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-78a6c60a-775b-4745-a9ed-81e98ef2fa4e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:07.452081 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-78a6c60a-775b-4745-a9ed-81e98ef2fa4e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1723 microversion: 2.20 time: 0.515694 Oct 05 02:34:07.477229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-b5c6c733-6f21-496c-b442-d5d5ebcb4043 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lazy-loading 'services' on Instance uuid a786593b-2c6f-4bc5-b338-8715c7d0429f {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:34:07.484398 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 809/1613] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:06 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1723 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:07.490663 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6ba78531-cbc2-4e50-9ccd-28b71793d27e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:07.491408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6ba78531-cbc2-4e50-9ccd-28b71793d27e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:07.503120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ba78531-cbc2-4e50-9ccd-28b71793d27e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:07.503619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ba78531-cbc2-4e50-9ccd-28b71793d27e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:07.504058 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ba78531-cbc2-4e50-9ccd-28b71793d27e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:07.506059 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b5c6c733-6f21-496c-b442-d5d5ebcb4043 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1969 microversion: 2.25 time: 0.728629 Oct 05 02:34:07.506753 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 805/1614] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:06 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1969 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:07.509216 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ba78531-cbc2-4e50-9ccd-28b71793d27e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:07.509727 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ba78531-cbc2-4e50-9ccd-28b71793d27e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:07.510172 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ba78531-cbc2-4e50-9ccd-28b71793d27e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:07.525207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ad57810e-6813-4fcb-ae31-6bc352ea0f08 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:07.527852 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ad57810e-6813-4fcb-ae31-6bc352ea0f08 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:07.562752 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad57810e-6813-4fcb-ae31-6bc352ea0f08 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:07.563872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad57810e-6813-4fcb-ae31-6bc352ea0f08 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:07.564320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad57810e-6813-4fcb-ae31-6bc352ea0f08 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:07.567273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad57810e-6813-4fcb-ae31-6bc352ea0f08 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:07.567800 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad57810e-6813-4fcb-ae31-6bc352ea0f08 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:07.568237 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad57810e-6813-4fcb-ae31-6bc352ea0f08 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:07.613433 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ad57810e-6813-4fcb-ae31-6bc352ea0f08 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104461 Oct 05 02:34:07.614377 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 806/1615] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 02:34:07 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:34:07.619726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-57fba97e-5a06-4934-8081-0d0fded58091 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Calling method '.version_select at 0x7fcce4245d30>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:08.143917 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6ba78531-cbc2-4e50-9ccd-28b71793d27e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:08.152882 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6ba78531-cbc2-4e50-9ccd-28b71793d27e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776" status: 200 len: 1324 microversion: 2.1 time: 0.666438 Oct 05 02:34:08.171436 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 810/1616] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:07 2022] GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776 => generated 1324 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:08.178129 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-604645e4-3521-4dd9-9703-b04b4f37845a tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:08.178956 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-604645e4-3521-4dd9-9703-b04b4f37845a tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:08.186054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-604645e4-3521-4dd9-9703-b04b4f37845a tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:08.186845 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-604645e4-3521-4dd9-9703-b04b4f37845a tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:08.187447 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-604645e4-3521-4dd9-9703-b04b4f37845a tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:08.188325 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-604645e4-3521-4dd9-9703-b04b4f37845a tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:08.189042 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-604645e4-3521-4dd9-9703-b04b4f37845a tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:08.189652 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-604645e4-3521-4dd9-9703-b04b4f37845a tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:08.593835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-604645e4-3521-4dd9-9703-b04b4f37845a tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lazy-loading 'services' on Instance uuid a786593b-2c6f-4bc5-b338-8715c7d0429f {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:34:08.616845 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-604645e4-3521-4dd9-9703-b04b4f37845a tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1969 microversion: 2.25 time: 0.444271 Oct 05 02:34:08.627046 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 811/1617] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:08 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1969 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:08.632549 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-eb6235b8-c906-4bfb-9be1-b40a7236e015 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:08.633285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-eb6235b8-c906-4bfb-9be1-b40a7236e015 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:08.641169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb6235b8-c906-4bfb-9be1-b40a7236e015 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:08.641982 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb6235b8-c906-4bfb-9be1-b40a7236e015 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:08.643032 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb6235b8-c906-4bfb-9be1-b40a7236e015 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:08.643754 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb6235b8-c906-4bfb-9be1-b40a7236e015 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:08.644312 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb6235b8-c906-4bfb-9be1-b40a7236e015 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:08.644745 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb6235b8-c906-4bfb-9be1-b40a7236e015 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:08.946506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-eb6235b8-c906-4bfb-9be1-b40a7236e015 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:08.955075 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-eb6235b8-c906-4bfb-9be1-b40a7236e015 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 200 len: 1498 microversion: 2.1 time: 0.326457 Oct 05 02:34:08.958295 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 812/1618] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:08 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 1498 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:08.959919 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-8dd54792-2904-490c-908d-44115220c6dd req-86a8c94b-4fe5-48b4-9218-dfaad51cd860 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99fb0801-33dd-4993-a8d9-18a43e372684", "tag": "9347f3a9-118c-40ac-9d21-f7cd82266478"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:08.970902 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-8dd54792-2904-490c-908d-44115220c6dd req-86a8c94b-4fe5-48b4-9218-dfaad51cd860 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:08.971630 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-8dd54792-2904-490c-908d-44115220c6dd req-86a8c94b-4fe5-48b4-9218-dfaad51cd860 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:08.972230 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-8dd54792-2904-490c-908d-44115220c6dd req-86a8c94b-4fe5-48b4-9218-dfaad51cd860 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:08.985660 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-8dd54792-2904-490c-908d-44115220c6dd req-86a8c94b-4fe5-48b4-9218-dfaad51cd860 service nova] Creating event network-changed:9347f3a9-118c-40ac-9d21-f7cd82266478 for instance 99fb0801-33dd-4993-a8d9-18a43e372684 on n-h2-858272-3 Oct 05 02:34:08.991172 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-8dd54792-2904-490c-908d-44115220c6dd req-86a8c94b-4fe5-48b4-9218-dfaad51cd860 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034587 Oct 05 02:34:08.991798 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 813/1619] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:34:08.997081 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cedd3fa1-d55d-4b93-af81-2a3dc70f63f9 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:08.997994 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cedd3fa1-d55d-4b93-af81-2a3dc70f63f9 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:09.004671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cedd3fa1-d55d-4b93-af81-2a3dc70f63f9 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:09.005425 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cedd3fa1-d55d-4b93-af81-2a3dc70f63f9 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:09.006029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cedd3fa1-d55d-4b93-af81-2a3dc70f63f9 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:09.006901 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cedd3fa1-d55d-4b93-af81-2a3dc70f63f9 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:09.007537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cedd3fa1-d55d-4b93-af81-2a3dc70f63f9 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:09.008125 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cedd3fa1-d55d-4b93-af81-2a3dc70f63f9 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:09.358771 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cedd3fa1-d55d-4b93-af81-2a3dc70f63f9 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:09.386572 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cedd3fa1-d55d-4b93-af81-2a3dc70f63f9 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:09.389227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cedd3fa1-d55d-4b93-af81-2a3dc70f63f9 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:09.390446 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cedd3fa1-d55d-4b93-af81-2a3dc70f63f9 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1723 microversion: 2.20 time: 0.397400 Oct 05 02:34:09.403260 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 814/1620] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:08 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1723 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:09.403260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5b8962d4-4211-4bfe-af88-062841dcb0b5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:09.403260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5b8962d4-4211-4bfe-af88-062841dcb0b5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:09.405101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b8962d4-4211-4bfe-af88-062841dcb0b5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:09.405605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b8962d4-4211-4bfe-af88-062841dcb0b5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:09.406043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b8962d4-4211-4bfe-af88-062841dcb0b5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:09.406751 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b8962d4-4211-4bfe-af88-062841dcb0b5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:09.407207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b8962d4-4211-4bfe-af88-062841dcb0b5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:09.407631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b8962d4-4211-4bfe-af88-062841dcb0b5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:09.458036 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5b8962d4-4211-4bfe-af88-062841dcb0b5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060065 Oct 05 02:34:09.458703 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 815/1621] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 02:34:09 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:34:09.469338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bd578c57-8699-4d5e-b955-aa399c824a4a tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:09.473818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd578c57-8699-4d5e-b955-aa399c824a4a tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:09.474309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd578c57-8699-4d5e-b955-aa399c824a4a tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:09.474789 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd578c57-8699-4d5e-b955-aa399c824a4a tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:09.475540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd578c57-8699-4d5e-b955-aa399c824a4a tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:09.475992 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd578c57-8699-4d5e-b955-aa399c824a4a tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:09.476409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd578c57-8699-4d5e-b955-aa399c824a4a tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:09.508734 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bd578c57-8699-4d5e-b955-aa399c824a4a tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.045985 Oct 05 02:34:09.509392 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 816/1622] 10.222.0.16 () {60 vars in 1217 bytes} [Wed Oct 5 02:34:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:34:09.515737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d0d146f9-887b-450b-b7d0-569575c13cb1 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:09.517081 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d0d146f9-887b-450b-b7d0-569575c13cb1 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:09.523203 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d0d146f9-887b-450b-b7d0-569575c13cb1 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:09.523691 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d0d146f9-887b-450b-b7d0-569575c13cb1 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:09.524125 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d0d146f9-887b-450b-b7d0-569575c13cb1 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:09.524821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d0d146f9-887b-450b-b7d0-569575c13cb1 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:09.525314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d0d146f9-887b-450b-b7d0-569575c13cb1 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:09.525733 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d0d146f9-887b-450b-b7d0-569575c13cb1 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:09.592409 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-57fba97e-5a06-4934-8081-0d0fded58091 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/3f93c3b0-1e99-4af9-b44e-eb6abdb0936e" status: 202 len: 0 microversion: 2.1 time: 1.976854 Oct 05 02:34:09.593177 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 807/1623] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 5 02:34:07 2022] DELETE /compute/v2.1/os-floating-ips/3f93c3b0-1e99-4af9-b44e-eb6abdb0936e => generated 0 bytes in 1978 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:34:09.599945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1bb7f453-c69a-4fc2-8d76-cc62724f7ee5 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858272-3", "block_migration": "auto"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:09.602598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1bb7f453-c69a-4fc2-8d76-cc62724f7ee5 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:09.611132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1bb7f453-c69a-4fc2-8d76-cc62724f7ee5 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:09.611657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1bb7f453-c69a-4fc2-8d76-cc62724f7ee5 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:09.612098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1bb7f453-c69a-4fc2-8d76-cc62724f7ee5 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:09.612841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1bb7f453-c69a-4fc2-8d76-cc62724f7ee5 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:09.613537 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1bb7f453-c69a-4fc2-8d76-cc62724f7ee5 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:09.613967 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1bb7f453-c69a-4fc2-8d76-cc62724f7ee5 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:09.639492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-1bb7f453-c69a-4fc2-8d76-cc62724f7ee5 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lazy-loading 'flavor' on Instance uuid a786593b-2c6f-4bc5-b338-8715c7d0429f {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:34:09.652486 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1bb7f453-c69a-4fc2-8d76-cc62724f7ee5 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Going to try to live migrate instance to n-h2-858272-3 {{(pid=122319) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 05 02:34:09.776665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d0d146f9-887b-450b-b7d0-569575c13cb1 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:09.790817 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d0d146f9-887b-450b-b7d0-569575c13cb1 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776" status: 200 len: 1324 microversion: 2.1 time: 0.279664 Oct 05 02:34:09.792712 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 817/1624] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:09 2022] GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776 => generated 1324 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:09.800523 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7896154b-4a99-4ecb-aee6-da1af23f0b54 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7896154b-4a99-4ecb-aee6-da1af23f0b54 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Request method failure captured: Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3/action HTTP/1.1 Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 34 Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOzwbQ_6-3L7uXAbh921EKnX0fu0osbfa39bbWy20UsTPXkk3BWapQnlmLwRvnXIjd_mswQm06LHM-WgZSphGLcXr5KyfRAgNVEZ_OtwiCfG6Iotl2LZdH1VW7UqyO01pkWARIQAynUSvi8QEvRLRSFiNFJenoQUS0KIUMnI0R8gpPA Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: dc5e5d31e8a94667b52be18ed414d846 Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-910845551 Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dc5e5d31e8a94667b52be18ed414d846"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dc5e5d31e8a94667b52be18ed414d846"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dc5e5d31e8a94667b52be18ed414d846"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dc5e5d31e8a94667b52be18ed414d846"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-910845551 Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: dc5e5d31e8a94667b52be18ed414d846 Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-910845551 Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 0b8c2b48f17b470aaa79d4f4a4a7215c Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: {"addFloatingIp": {"address": ""}} Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '8b942fed-d4b6-403d-b121-a53278fe83c3', 'body': {'addFloatingIp': {'address': ''}}} Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi '' Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:34:09.804746 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:34:09.810943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:34:09.810943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 05 02:34:09.810943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:09.810943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:34:09.810943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:09.810943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:34:09.810943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:34:09.810943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:34:09.810943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:34:09.810943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:34:09.810943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 05 02:34:09.810943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:09.813193 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7896154b-4a99-4ecb-aee6-da1af23f0b54 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:34:09.814222 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7896154b-4a99-4ecb-aee6-da1af23f0b54 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] 10.222.0.16 "POST /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3/action" status: 400 len: 142 microversion: 2.1 time: 0.019037 Oct 05 02:34:09.815318 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 818/1625] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:34:09 2022] POST /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3/action => generated 142 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:34:09.825541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b7d73dab-3018-4082-810a-9cf77a3aa8cf tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:09.828207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b7d73dab-3018-4082-810a-9cf77a3aa8cf tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] [instance: 8b942fed-d4b6-403d-b121-a53278fe83c3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:09.836499 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b7d73dab-3018-4082-810a-9cf77a3aa8cf tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:09.837021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b7d73dab-3018-4082-810a-9cf77a3aa8cf tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:09.837531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b7d73dab-3018-4082-810a-9cf77a3aa8cf tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:09.838241 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b7d73dab-3018-4082-810a-9cf77a3aa8cf tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:09.838917 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b7d73dab-3018-4082-810a-9cf77a3aa8cf tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:09.839442 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b7d73dab-3018-4082-810a-9cf77a3aa8cf tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:09.855488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:34:09.868565 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b7d73dab-3018-4082-810a-9cf77a3aa8cf tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "refresh_cache-8b942fed-d4b6-403d-b121-a53278fe83c3" {{(pid=122320) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 05 02:34:09.869024 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b7d73dab-3018-4082-810a-9cf77a3aa8cf tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquired lock "refresh_cache-8b942fed-d4b6-403d-b121-a53278fe83c3" {{(pid=122320) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 05 02:34:10.010363 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b7d73dab-3018-4082-810a-9cf77a3aa8cf tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Releasing lock "refresh_cache-8b942fed-d4b6-403d-b121-a53278fe83c3" {{(pid=122320) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 05 02:34:10.011052 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-b7d73dab-3018-4082-810a-9cf77a3aa8cf tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] HTTP exception thrown: floating IP not found Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b7d73dab-3018-4082-810a-9cf77a3aa8cf tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Request method failure captured: Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3/action HTTP/1.1 Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 41 Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOzwbQ_6-3L7uXAbh921EKnX0fu0osbfa39bbWy20UsTPXkk3BWapQnlmLwRvnXIjd_mswQm06LHM-WgZSphGLcXr5KyfRAgNVEZ_OtwiCfG6Iotl2LZdH1VW7UqyO01pkWARIQAynUSvi8QEvRLRSFiNFJenoQUS0KIUMnI0R8gpPA Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: dc5e5d31e8a94667b52be18ed414d846 Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-910845551 Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dc5e5d31e8a94667b52be18ed414d846"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dc5e5d31e8a94667b52be18ed414d846"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dc5e5d31e8a94667b52be18ed414d846"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dc5e5d31e8a94667b52be18ed414d846"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-910845551 Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: dc5e5d31e8a94667b52be18ed414d846 Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-910845551 Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 0b8c2b48f17b470aaa79d4f4a4a7215c Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: exception: floating IP not found Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '8b942fed-d4b6-403d-b121-a53278fe83c3', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 05 02:34:10.012737 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:10.019193 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:34:10.019193 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:10.019193 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:34:10.019193 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:34:10.019193 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:34:10.019193 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:34:10.019193 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:34:10.019193 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 05 02:34:10.019193 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:10.019193 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b7d73dab-3018-4082-810a-9cf77a3aa8cf tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Returning 404 to user: floating IP not found {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:34:10.019193 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b7d73dab-3018-4082-810a-9cf77a3aa8cf tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] 10.222.0.16 "POST /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3/action" status: 404 len: 67 microversion: 2.1 time: 0.195312 Oct 05 02:34:10.019193 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 819/1626] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:34:09 2022] POST /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3/action => generated 67 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:34:10.022917 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ac81ae25-52c4-4586-a4fb-04f29160f674 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:10.023532 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ac81ae25-52c4-4586-a4fb-04f29160f674 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:10.030472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac81ae25-52c4-4586-a4fb-04f29160f674 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:10.030955 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac81ae25-52c4-4586-a4fb-04f29160f674 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:10.031387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac81ae25-52c4-4586-a4fb-04f29160f674 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:10.032079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac81ae25-52c4-4586-a4fb-04f29160f674 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:10.032930 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac81ae25-52c4-4586-a4fb-04f29160f674 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:10.033534 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac81ae25-52c4-4586-a4fb-04f29160f674 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:10.191203 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ac81ae25-52c4-4586-a4fb-04f29160f674 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:10.199411 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ac81ae25-52c4-4586-a4fb-04f29160f674 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 200 len: 1498 microversion: 2.1 time: 0.181811 Oct 05 02:34:10.200410 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 820/1627] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:10 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 1498 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:10.205293 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c3a0eda9-a80d-4410-8863-38bde91d7b9a tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:10.249785 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-c3a0eda9-a80d-4410-8863-38bde91d7b9a tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c3a0eda9-a80d-4410-8863-38bde91d7b9a tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Request method failure captured: Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3/action HTTP/1.1 Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 44 Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOzwbQ_6-3L7uXAbh921EKnX0fu0osbfa39bbWy20UsTPXkk3BWapQnlmLwRvnXIjd_mswQm06LHM-WgZSphGLcXr5KyfRAgNVEZ_OtwiCfG6Iotl2LZdH1VW7UqyO01pkWARIQAynUSvi8QEvRLRSFiNFJenoQUS0KIUMnI0R8gpPA Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: dc5e5d31e8a94667b52be18ed414d846 Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-910845551 Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dc5e5d31e8a94667b52be18ed414d846"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dc5e5d31e8a94667b52be18ed414d846"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dc5e5d31e8a94667b52be18ed414d846"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dc5e5d31e8a94667b52be18ed414d846"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-910845551 Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: dc5e5d31e8a94667b52be18ed414d846 Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-910845551 Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 0b8c2b48f17b470aaa79d4f4a4a7215c Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: exception: Floating IP not found for address 0.0.0.0. Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '8b942fed-d4b6-403d-b121-a53278fe83c3', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 05 02:34:10.251353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 05 02:34:10.257212 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 05 02:34:10.257212 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:10.257212 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:34:10.257212 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:10.257212 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:34:10.257212 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:34:10.257212 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:34:10.257212 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:34:10.257212 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:34:10.257212 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 05 02:34:10.257212 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:10.257212 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c3a0eda9-a80d-4410-8863-38bde91d7b9a tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:34:10.257212 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c3a0eda9-a80d-4410-8863-38bde91d7b9a tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] 10.222.0.16 "POST /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3/action" status: 404 len: 88 microversion: 2.1 time: 0.051344 Oct 05 02:34:10.257212 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 821/1628] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:34:10 2022] POST /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3/action => generated 88 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:34:10.261856 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9886a180-5059-4343-b77c-e1204df618e1 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:10.262478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9886a180-5059-4343-b77c-e1204df618e1 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] [instance: 8b942fed-d4b6-403d-b121-a53278fe83c3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:10.269206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9886a180-5059-4343-b77c-e1204df618e1 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:10.269691 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9886a180-5059-4343-b77c-e1204df618e1 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:10.270124 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9886a180-5059-4343-b77c-e1204df618e1 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:10.270806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9886a180-5059-4343-b77c-e1204df618e1 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:10.271259 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9886a180-5059-4343-b77c-e1204df618e1 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:10.271683 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9886a180-5059-4343-b77c-e1204df618e1 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:10.296133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9886a180-5059-4343-b77c-e1204df618e1 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] [instance: 8b942fed-d4b6-403d-b121-a53278fe83c3] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:34:10.369157 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9886a180-5059-4343-b77c-e1204df618e1 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3" status: 204 len: 0 microversion: 2.1 time: 0.110446 Oct 05 02:34:10.369837 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 822/1629] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:34:10 2022] DELETE /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 02:34:10.380021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9ad72741-91e4-4bdd-b6da-eb18874f7941 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:10.381002 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9ad72741-91e4-4bdd-b6da-eb18874f7941 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] [instance: 8b942fed-d4b6-403d-b121-a53278fe83c3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:10.388565 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ad72741-91e4-4bdd-b6da-eb18874f7941 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:10.389089 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ad72741-91e4-4bdd-b6da-eb18874f7941 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:10.389534 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ad72741-91e4-4bdd-b6da-eb18874f7941 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:10.390582 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ad72741-91e4-4bdd-b6da-eb18874f7941 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:10.391030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ad72741-91e4-4bdd-b6da-eb18874f7941 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:10.391444 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ad72741-91e4-4bdd-b6da-eb18874f7941 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:10.523794 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9ad72741-91e4-4bdd-b6da-eb18874f7941 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8c2b48f17b470aaa79d4f4a4a7215c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5e5d31e8a94667b52be18ed414d846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:10.532040 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9ad72741-91e4-4bdd-b6da-eb18874f7941 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] 10.222.0.16 "GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3" status: 200 len: 1541 microversion: 2.1 time: 0.157233 Oct 05 02:34:10.532614 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 823/1630] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:10 2022] GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3 => generated 1541 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:34:10.537033 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-622690af-6dc8-4b69-aba5-1b65d6a41361 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:10.537638 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-622690af-6dc8-4b69-aba5-1b65d6a41361 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:10.543748 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-622690af-6dc8-4b69-aba5-1b65d6a41361 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:10.544324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-622690af-6dc8-4b69-aba5-1b65d6a41361 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:10.544763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-622690af-6dc8-4b69-aba5-1b65d6a41361 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:10.545484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-622690af-6dc8-4b69-aba5-1b65d6a41361 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:10.545938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-622690af-6dc8-4b69-aba5-1b65d6a41361 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:10.546364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-622690af-6dc8-4b69-aba5-1b65d6a41361 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:10.676508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-622690af-6dc8-4b69-aba5-1b65d6a41361 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:10.684582 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-622690af-6dc8-4b69-aba5-1b65d6a41361 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:10.686056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-622690af-6dc8-4b69-aba5-1b65d6a41361 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:10.687235 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-622690af-6dc8-4b69-aba5-1b65d6a41361 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1723 microversion: 2.20 time: 0.153685 Oct 05 02:34:10.687824 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 824/1631] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:10 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:10.692266 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5d7cf99d-0ef2-4e75-95b9-509f871b7902 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:10.694490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5d7cf99d-0ef2-4e75-95b9-509f871b7902 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:10.700027 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d7cf99d-0ef2-4e75-95b9-509f871b7902 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:10.700510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d7cf99d-0ef2-4e75-95b9-509f871b7902 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:10.700972 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d7cf99d-0ef2-4e75-95b9-509f871b7902 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:10.701662 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d7cf99d-0ef2-4e75-95b9-509f871b7902 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:10.702116 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d7cf99d-0ef2-4e75-95b9-509f871b7902 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:10.702538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d7cf99d-0ef2-4e75-95b9-509f871b7902 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:10.732459 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5d7cf99d-0ef2-4e75-95b9-509f871b7902 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043628 Oct 05 02:34:10.733039 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 825/1632] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 02:34:10 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:34:10.815078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-96eabcf2-f629-4407-9483-0bae98fedc24 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:10.815714 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-96eabcf2-f629-4407-9483-0bae98fedc24 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:10.822087 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96eabcf2-f629-4407-9483-0bae98fedc24 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:10.822676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96eabcf2-f629-4407-9483-0bae98fedc24 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:10.823121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96eabcf2-f629-4407-9483-0bae98fedc24 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:10.823823 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96eabcf2-f629-4407-9483-0bae98fedc24 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:10.824895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96eabcf2-f629-4407-9483-0bae98fedc24 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:10.825968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96eabcf2-f629-4407-9483-0bae98fedc24 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:10.962127 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-96eabcf2-f629-4407-9483-0bae98fedc24 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:10.970146 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-96eabcf2-f629-4407-9483-0bae98fedc24 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776" status: 200 len: 1324 microversion: 2.1 time: 0.159063 Oct 05 02:34:10.970745 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 826/1633] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:10 2022] GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776 => generated 1324 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:34:11.034057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-01bc9651-eb54-4e39-9ecb-9948089d7769 req-e8bfe522-29c2-4fd5-9a90-5fdf91b3487a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed8c63c7-f728-4202-94b9-1b4a00fac776", "tag": "8ddd7686-11f0-4d1c-98d6-81965c576fd3"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:11.045007 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-01bc9651-eb54-4e39-9ecb-9948089d7769 req-e8bfe522-29c2-4fd5-9a90-5fdf91b3487a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:11.045489 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-01bc9651-eb54-4e39-9ecb-9948089d7769 req-e8bfe522-29c2-4fd5-9a90-5fdf91b3487a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:11.045918 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-01bc9651-eb54-4e39-9ecb-9948089d7769 req-e8bfe522-29c2-4fd5-9a90-5fdf91b3487a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:11.057041 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-01bc9651-eb54-4e39-9ecb-9948089d7769 req-e8bfe522-29c2-4fd5-9a90-5fdf91b3487a service nova] Creating event network-changed:8ddd7686-11f0-4d1c-98d6-81965c576fd3 for instance ed8c63c7-f728-4202-94b9-1b4a00fac776 on n-h1-858272-3 Oct 05 02:34:11.062879 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-01bc9651-eb54-4e39-9ecb-9948089d7769 req-e8bfe522-29c2-4fd5-9a90-5fdf91b3487a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032397 Oct 05 02:34:11.063730 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 827/1634] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:34:11.225602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-49013b8f-ae27-4716-b105-8312dd809f2b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:11.226632 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-49013b8f-ae27-4716-b105-8312dd809f2b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:11.234362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49013b8f-ae27-4716-b105-8312dd809f2b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:11.235051 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49013b8f-ae27-4716-b105-8312dd809f2b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:11.235665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49013b8f-ae27-4716-b105-8312dd809f2b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:11.236726 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49013b8f-ae27-4716-b105-8312dd809f2b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:11.237241 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49013b8f-ae27-4716-b105-8312dd809f2b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:11.237697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49013b8f-ae27-4716-b105-8312dd809f2b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:11.392386 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-49013b8f-ae27-4716-b105-8312dd809f2b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:11.401262 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-49013b8f-ae27-4716-b105-8312dd809f2b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 200 len: 1498 microversion: 2.1 time: 0.181002 Oct 05 02:34:11.401847 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 828/1635] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:11 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 1498 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:34:11.555420 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4bbafd8e-7724-4fee-9954-1858863d862a tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:11.556037 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4bbafd8e-7724-4fee-9954-1858863d862a tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] [instance: 8b942fed-d4b6-403d-b121-a53278fe83c3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:11.562757 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4bbafd8e-7724-4fee-9954-1858863d862a tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:11.563245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4bbafd8e-7724-4fee-9954-1858863d862a tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:11.563683 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4bbafd8e-7724-4fee-9954-1858863d862a tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:11.564371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4bbafd8e-7724-4fee-9954-1858863d862a tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:11.564822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4bbafd8e-7724-4fee-9954-1858863d862a tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:11.565283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4bbafd8e-7724-4fee-9954-1858863d862a tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:11.698844 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4bbafd8e-7724-4fee-9954-1858863d862a tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8c2b48f17b470aaa79d4f4a4a7215c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5e5d31e8a94667b52be18ed414d846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:11.706982 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4bbafd8e-7724-4fee-9954-1858863d862a tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] 10.222.0.16 "GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3" status: 200 len: 1541 microversion: 2.1 time: 0.155374 Oct 05 02:34:11.707840 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 829/1636] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:11 2022] GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3 => generated 1541 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:34:11.712482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c95dd540-c1cf-4855-9423-bb04c23b534f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:11.713109 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c95dd540-c1cf-4855-9423-bb04c23b534f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:11.719322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c95dd540-c1cf-4855-9423-bb04c23b534f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:11.719808 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c95dd540-c1cf-4855-9423-bb04c23b534f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:11.720234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c95dd540-c1cf-4855-9423-bb04c23b534f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:11.720931 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c95dd540-c1cf-4855-9423-bb04c23b534f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:11.721385 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c95dd540-c1cf-4855-9423-bb04c23b534f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:11.721801 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c95dd540-c1cf-4855-9423-bb04c23b534f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:11.858991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c95dd540-c1cf-4855-9423-bb04c23b534f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:11.867211 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c95dd540-c1cf-4855-9423-bb04c23b534f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:11.868632 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c95dd540-c1cf-4855-9423-bb04c23b534f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:11.869850 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c95dd540-c1cf-4855-9423-bb04c23b534f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1723 microversion: 2.20 time: 0.160884 Oct 05 02:34:11.870896 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 830/1637] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:11 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:11.993916 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fc072f85-e5c0-4a2b-bbff-7f62bfcc6ab8 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:11.994535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fc072f85-e5c0-4a2b-bbff-7f62bfcc6ab8 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:11.997292 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:34:12.003348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc072f85-e5c0-4a2b-bbff-7f62bfcc6ab8 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:12.003868 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc072f85-e5c0-4a2b-bbff-7f62bfcc6ab8 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:12.004301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc072f85-e5c0-4a2b-bbff-7f62bfcc6ab8 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:12.005033 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc072f85-e5c0-4a2b-bbff-7f62bfcc6ab8 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:12.005492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc072f85-e5c0-4a2b-bbff-7f62bfcc6ab8 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:12.005910 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc072f85-e5c0-4a2b-bbff-7f62bfcc6ab8 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:12.144245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fc072f85-e5c0-4a2b-bbff-7f62bfcc6ab8 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:12.151996 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fc072f85-e5c0-4a2b-bbff-7f62bfcc6ab8 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776" status: 200 len: 1324 microversion: 2.1 time: 0.162253 Oct 05 02:34:12.152653 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 831/1638] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:11 2022] GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776 => generated 1324 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:34:12.427236 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-77459db3-2705-44ba-a468-8e95695dfc22 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:12.431627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-77459db3-2705-44ba-a468-8e95695dfc22 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:12.440576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-77459db3-2705-44ba-a468-8e95695dfc22 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:12.441130 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-77459db3-2705-44ba-a468-8e95695dfc22 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:12.446789 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-77459db3-2705-44ba-a468-8e95695dfc22 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:12.447638 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-77459db3-2705-44ba-a468-8e95695dfc22 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:12.448137 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-77459db3-2705-44ba-a468-8e95695dfc22 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:12.448580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-77459db3-2705-44ba-a468-8e95695dfc22 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:12.727387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-77459db3-2705-44ba-a468-8e95695dfc22 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:12.745732 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-77459db3-2705-44ba-a468-8e95695dfc22 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 200 len: 1498 microversion: 2.1 time: 0.324399 Oct 05 02:34:12.757817 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 832/1639] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:12 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 1498 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:12.766308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fe6a276c-0767-4f1d-a20d-8f2c3ecfef36 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:12.768661 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fe6a276c-0767-4f1d-a20d-8f2c3ecfef36 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] [instance: 8b942fed-d4b6-403d-b121-a53278fe83c3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:12.775467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe6a276c-0767-4f1d-a20d-8f2c3ecfef36 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:12.775959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe6a276c-0767-4f1d-a20d-8f2c3ecfef36 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:12.776391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe6a276c-0767-4f1d-a20d-8f2c3ecfef36 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:12.777891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe6a276c-0767-4f1d-a20d-8f2c3ecfef36 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:12.778774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe6a276c-0767-4f1d-a20d-8f2c3ecfef36 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:12.779204 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe6a276c-0767-4f1d-a20d-8f2c3ecfef36 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:13.027119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fe6a276c-0767-4f1d-a20d-8f2c3ecfef36 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8c2b48f17b470aaa79d4f4a4a7215c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5e5d31e8a94667b52be18ed414d846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:13.048062 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fe6a276c-0767-4f1d-a20d-8f2c3ecfef36 tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] 10.222.0.16 "GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3" status: 200 len: 1541 microversion: 2.1 time: 0.280093 Oct 05 02:34:13.048062 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 833/1640] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:12 2022] GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3 => generated 1541 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:13.052562 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b1b6fa7b-42cc-4d44-af84-695658aceda4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:13.053595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b1b6fa7b-42cc-4d44-af84-695658aceda4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:13.081811 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b1b6fa7b-42cc-4d44-af84-695658aceda4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:13.082305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b1b6fa7b-42cc-4d44-af84-695658aceda4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:13.082753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b1b6fa7b-42cc-4d44-af84-695658aceda4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:13.083485 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b1b6fa7b-42cc-4d44-af84-695658aceda4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:13.085278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b1b6fa7b-42cc-4d44-af84-695658aceda4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:13.085710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b1b6fa7b-42cc-4d44-af84-695658aceda4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:13.343542 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1bb7f453-c69a-4fc2-8d76-cc62724f7ee5 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f/action" status: 202 len: 0 microversion: 2.25 time: 3.748878 Oct 05 02:34:13.345931 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 808/1641] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 5 02:34:09 2022] POST /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f/action => generated 0 bytes in 3752 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:34:13.353205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-9ae09a14-8c9e-492a-b67c-9d669a96f874 req-549bc3ac-8563-4076-ad9a-b9730be231ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b942fed-d4b6-403d-b121-a53278fe83c3", "name": "network-vif-deleted", "tag": "7e37d2c3-c78d-464d-858e-6d91f57fa6d5"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:13.367931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:34:13.369826 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9ae09a14-8c9e-492a-b67c-9d669a96f874 req-549bc3ac-8563-4076-ad9a-b9730be231ec service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:13.370745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9ae09a14-8c9e-492a-b67c-9d669a96f874 req-549bc3ac-8563-4076-ad9a-b9730be231ec service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:13.371986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9ae09a14-8c9e-492a-b67c-9d669a96f874 req-549bc3ac-8563-4076-ad9a-b9730be231ec service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:13.386947 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-9ae09a14-8c9e-492a-b67c-9d669a96f874 req-549bc3ac-8563-4076-ad9a-b9730be231ec service nova] Creating event network-vif-deleted:7e37d2c3-c78d-464d-858e-6d91f57fa6d5 for instance 8b942fed-d4b6-403d-b121-a53278fe83c3 on n-h2-858272-3 Oct 05 02:34:13.399127 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-9ae09a14-8c9e-492a-b67c-9d669a96f874 req-549bc3ac-8563-4076-ad9a-b9730be231ec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051338 Oct 05 02:34:13.400367 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 809/1642] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:34:13.408210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f9a7bbeb-b3f0-4fa4-955f-e8695e96695c tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:13.409448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f9a7bbeb-b3f0-4fa4-955f-e8695e96695c tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:13.420494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9a7bbeb-b3f0-4fa4-955f-e8695e96695c tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:13.421198 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9a7bbeb-b3f0-4fa4-955f-e8695e96695c tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:13.421834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9a7bbeb-b3f0-4fa4-955f-e8695e96695c tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:13.422715 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9a7bbeb-b3f0-4fa4-955f-e8695e96695c tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:13.423745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9a7bbeb-b3f0-4fa4-955f-e8695e96695c tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:13.424341 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9a7bbeb-b3f0-4fa4-955f-e8695e96695c tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:13.522555 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b1b6fa7b-42cc-4d44-af84-695658aceda4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:13.538485 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b1b6fa7b-42cc-4d44-af84-695658aceda4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:13.540061 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b1b6fa7b-42cc-4d44-af84-695658aceda4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:13.541544 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b1b6fa7b-42cc-4d44-af84-695658aceda4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1723 microversion: 2.20 time: 0.500719 Oct 05 02:34:13.547542 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 834/1643] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:13 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1723 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:13.568747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-77c1fed8-66b1-4eef-995a-e0f1898c2aed tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:13.569631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-77c1fed8-66b1-4eef-995a-e0f1898c2aed tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:13.582094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-77c1fed8-66b1-4eef-995a-e0f1898c2aed tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:13.583176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-77c1fed8-66b1-4eef-995a-e0f1898c2aed tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:13.584433 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-77c1fed8-66b1-4eef-995a-e0f1898c2aed tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:13.585426 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-77c1fed8-66b1-4eef-995a-e0f1898c2aed tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:13.586836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-77c1fed8-66b1-4eef-995a-e0f1898c2aed tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:13.587482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-77c1fed8-66b1-4eef-995a-e0f1898c2aed tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:13.765730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f9a7bbeb-b3f0-4fa4-955f-e8695e96695c tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:13.774471 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f9a7bbeb-b3f0-4fa4-955f-e8695e96695c tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776" status: 200 len: 1324 microversion: 2.1 time: 0.372499 Oct 05 02:34:13.775603 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 810/1644] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:13 2022] GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776 => generated 1324 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:13.782178 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fbcf1778-6f5b-400e-bbc3-a5d531aed705 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:13.783258 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fbcf1778-6f5b-400e-bbc3-a5d531aed705 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:13.790474 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fbcf1778-6f5b-400e-bbc3-a5d531aed705 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:13.791198 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fbcf1778-6f5b-400e-bbc3-a5d531aed705 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:13.791642 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fbcf1778-6f5b-400e-bbc3-a5d531aed705 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:13.792356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fbcf1778-6f5b-400e-bbc3-a5d531aed705 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:13.792823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fbcf1778-6f5b-400e-bbc3-a5d531aed705 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:13.794527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fbcf1778-6f5b-400e-bbc3-a5d531aed705 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:13.796558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-77c1fed8-66b1-4eef-995a-e0f1898c2aed tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:13.807982 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-77c1fed8-66b1-4eef-995a-e0f1898c2aed tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:13.810947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-77c1fed8-66b1-4eef-995a-e0f1898c2aed tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:13.812310 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-77c1fed8-66b1-4eef-995a-e0f1898c2aed tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1487 microversion: 2.25 time: 0.263499 Oct 05 02:34:13.812887 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 835/1645] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:13 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1487 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:13.960745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fbcf1778-6f5b-400e-bbc3-a5d531aed705 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:13.970648 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fbcf1778-6f5b-400e-bbc3-a5d531aed705 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 200 len: 1498 microversion: 2.1 time: 0.193816 Oct 05 02:34:13.984988 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 811/1646] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:13 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 1498 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:14.068305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-abf880bb-6dc3-433b-9ead-3ad7d565ef1b tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:14.068942 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-abf880bb-6dc3-433b-9ead-3ad7d565ef1b tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] [instance: 8b942fed-d4b6-403d-b121-a53278fe83c3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:14.076312 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-abf880bb-6dc3-433b-9ead-3ad7d565ef1b tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:14.077093 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-abf880bb-6dc3-433b-9ead-3ad7d565ef1b tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:14.077543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-abf880bb-6dc3-433b-9ead-3ad7d565ef1b tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:14.078257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-abf880bb-6dc3-433b-9ead-3ad7d565ef1b tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:14.078836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-abf880bb-6dc3-433b-9ead-3ad7d565ef1b tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:14.079224 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-abf880bb-6dc3-433b-9ead-3ad7d565ef1b tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:14.096668 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:34:14.120261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-abf880bb-6dc3-433b-9ead-3ad7d565ef1b tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:14.120758 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-abf880bb-6dc3-433b-9ead-3ad7d565ef1b tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:14.122449 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-abf880bb-6dc3-433b-9ead-3ad7d565ef1b tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:14.125440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-abf880bb-6dc3-433b-9ead-3ad7d565ef1b tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lazy-loading 'fault' on Instance uuid 8b942fed-d4b6-403d-b121-a53278fe83c3 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:34:14.171641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-abf880bb-6dc3-433b-9ead-3ad7d565ef1b tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8c2b48f17b470aaa79d4f4a4a7215c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5e5d31e8a94667b52be18ed414d846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:14.180707 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-abf880bb-6dc3-433b-9ead-3ad7d565ef1b tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] 10.222.0.16 "GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3" status: 200 len: 1322 microversion: 2.1 time: 0.116683 Oct 05 02:34:14.181438 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 836/1647] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:14 2022] GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3 => generated 1322 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:14.579409 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-61c0d4f2-892f-4eab-a9c2-f8ec5acd990e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:14.581148 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-61c0d4f2-892f-4eab-a9c2-f8ec5acd990e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:14.589430 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-61c0d4f2-892f-4eab-a9c2-f8ec5acd990e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:14.589899 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-61c0d4f2-892f-4eab-a9c2-f8ec5acd990e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:14.590602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-61c0d4f2-892f-4eab-a9c2-f8ec5acd990e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:14.591581 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-61c0d4f2-892f-4eab-a9c2-f8ec5acd990e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:14.592166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-61c0d4f2-892f-4eab-a9c2-f8ec5acd990e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:14.593055 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-61c0d4f2-892f-4eab-a9c2-f8ec5acd990e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:14.751111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-61c0d4f2-892f-4eab-a9c2-f8ec5acd990e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:14.760073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-61c0d4f2-892f-4eab-a9c2-f8ec5acd990e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:14.761870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-61c0d4f2-892f-4eab-a9c2-f8ec5acd990e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:14.763047 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-61c0d4f2-892f-4eab-a9c2-f8ec5acd990e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1723 microversion: 2.20 time: 0.189319 Oct 05 02:34:14.763858 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 812/1648] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:14 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:14.802589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a6e0c394-7f95-4560-a1e4-44764256ecc4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:14.804363 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a6e0c394-7f95-4560-a1e4-44764256ecc4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:14.819170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6e0c394-7f95-4560-a1e4-44764256ecc4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:14.820934 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6e0c394-7f95-4560-a1e4-44764256ecc4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:14.822329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6e0c394-7f95-4560-a1e4-44764256ecc4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:14.823136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6e0c394-7f95-4560-a1e4-44764256ecc4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:14.823688 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6e0c394-7f95-4560-a1e4-44764256ecc4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:14.825180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6e0c394-7f95-4560-a1e4-44764256ecc4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:14.839758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-37d91a10-81e3-489a-93b7-526208fd7ce2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:14.841380 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-37d91a10-81e3-489a-93b7-526208fd7ce2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:14.854929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37d91a10-81e3-489a-93b7-526208fd7ce2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:14.855728 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37d91a10-81e3-489a-93b7-526208fd7ce2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:14.856779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37d91a10-81e3-489a-93b7-526208fd7ce2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:14.857675 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37d91a10-81e3-489a-93b7-526208fd7ce2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:14.858294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37d91a10-81e3-489a-93b7-526208fd7ce2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:14.858888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37d91a10-81e3-489a-93b7-526208fd7ce2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:15.050710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a6e0c394-7f95-4560-a1e4-44764256ecc4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:15.067073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-37d91a10-81e3-489a-93b7-526208fd7ce2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:15.073745 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a6e0c394-7f95-4560-a1e4-44764256ecc4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776" status: 200 len: 1324 microversion: 2.1 time: 0.276918 Oct 05 02:34:15.076120 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 837/1649] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:14 2022] GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776 => generated 1324 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:15.081012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e01cccc8-7300-40db-8469-3769689246cb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:15.082289 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e01cccc8-7300-40db-8469-3769689246cb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:15.089198 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e01cccc8-7300-40db-8469-3769689246cb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:15.090263 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e01cccc8-7300-40db-8469-3769689246cb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:15.091063 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e01cccc8-7300-40db-8469-3769689246cb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:15.092134 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e01cccc8-7300-40db-8469-3769689246cb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:15.093036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e01cccc8-7300-40db-8469-3769689246cb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:15.093754 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e01cccc8-7300-40db-8469-3769689246cb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:15.096718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-37d91a10-81e3-489a-93b7-526208fd7ce2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:15.098511 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-37d91a10-81e3-489a-93b7-526208fd7ce2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:15.100138 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-37d91a10-81e3-489a-93b7-526208fd7ce2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1487 microversion: 2.25 time: 0.265952 Oct 05 02:34:15.102166 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 813/1650] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:14 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1487 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:34:15.205390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8d82b231-6868-44e8-8dcc-2d15874a8d6c tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:15.206161 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8d82b231-6868-44e8-8dcc-2d15874a8d6c tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] [instance: 8b942fed-d4b6-403d-b121-a53278fe83c3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:15.215662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d82b231-6868-44e8-8dcc-2d15874a8d6c tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:15.216254 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d82b231-6868-44e8-8dcc-2d15874a8d6c tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:15.216769 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d82b231-6868-44e8-8dcc-2d15874a8d6c tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:15.217611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d82b231-6868-44e8-8dcc-2d15874a8d6c tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:15.218159 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d82b231-6868-44e8-8dcc-2d15874a8d6c tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:15.218660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d82b231-6868-44e8-8dcc-2d15874a8d6c tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:15.235057 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-8d82b231-6868-44e8-8dcc-2d15874a8d6c tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] HTTP exception thrown: Instance 8b942fed-d4b6-403d-b121-a53278fe83c3 could not be found. Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8d82b231-6868-44e8-8dcc-2d15874a8d6c tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Request method failure captured: Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3 HTTP/1.1 Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOzwbQ_6-3L7uXAbh921EKnX0fu0osbfa39bbWy20UsTPXkk3BWapQnlmLwRvnXIjd_mswQm06LHM-WgZSphGLcXr5KyfRAgNVEZ_OtwiCfG6Iotl2LZdH1VW7UqyO01pkWARIQAynUSvi8QEvRLRSFiNFJenoQUS0KIUMnI0R8gpPA Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: dc5e5d31e8a94667b52be18ed414d846 Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-910845551 Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dc5e5d31e8a94667b52be18ed414d846"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dc5e5d31e8a94667b52be18ed414d846"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dc5e5d31e8a94667b52be18ed414d846"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dc5e5d31e8a94667b52be18ed414d846"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-910845551 Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: dc5e5d31e8a94667b52be18ed414d846 Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-910845551 Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 0b8c2b48f17b470aaa79d4f4a4a7215c Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 8b942fed-d4b6-403d-b121-a53278fe83c3 could not be found. Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '8b942fed-d4b6-403d-b121-a53278fe83c3'} Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b942fed-d4b6-403d-b121-a53278fe83c3 could not be found. Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b942fed-d4b6-403d-b121-a53278fe83c3 could not be found. Oct 05 02:34:15.237105 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:34:15.242533 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:34:15.242533 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:34:15.242533 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:34:15.242533 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:34:15.242533 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:34:15.242533 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:34:15.242533 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:34:15.242533 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b942fed-d4b6-403d-b121-a53278fe83c3 could not be found. Oct 05 02:34:15.242533 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:34:15.244923 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8d82b231-6868-44e8-8dcc-2d15874a8d6c tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] Returning 404 to user: Instance 8b942fed-d4b6-403d-b121-a53278fe83c3 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:34:15.246608 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8d82b231-6868-44e8-8dcc-2d15874a8d6c tempest-FloatingIPsAssociationNegativeTestJSON-910845551 tempest-FloatingIPsAssociationNegativeTestJSON-910845551-project] 10.222.0.16 "GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3" status: 404 len: 111 microversion: 2.1 time: 0.044643 Oct 05 02:34:15.248369 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 814/1651] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:15 2022] GET /compute/v2.1/servers/8b942fed-d4b6-403d-b121-a53278fe83c3 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:34:15.348602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e01cccc8-7300-40db-8469-3769689246cb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:15.361884 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e01cccc8-7300-40db-8469-3769689246cb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 200 len: 1498 microversion: 2.1 time: 0.283612 Oct 05 02:34:15.364349 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 838/1652] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:15 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 1498 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:15.473052 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-7fded15d-e498-4d13-958f-561a6586c0a9 req-f4858b62-6567-419a-8533-d084967a6826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed8c63c7-f728-4202-94b9-1b4a00fac776", "name": "network-vif-plugged", "status": "completed", "tag": "8ddd7686-11f0-4d1c-98d6-81965c576fd3"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:15.488730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7fded15d-e498-4d13-958f-561a6586c0a9 req-f4858b62-6567-419a-8533-d084967a6826 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:15.492261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7fded15d-e498-4d13-958f-561a6586c0a9 req-f4858b62-6567-419a-8533-d084967a6826 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:15.492825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7fded15d-e498-4d13-958f-561a6586c0a9 req-f4858b62-6567-419a-8533-d084967a6826 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:15.507422 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-7fded15d-e498-4d13-958f-561a6586c0a9 req-f4858b62-6567-419a-8533-d084967a6826 service nova] Creating event network-vif-plugged:8ddd7686-11f0-4d1c-98d6-81965c576fd3 for instance ed8c63c7-f728-4202-94b9-1b4a00fac776 on n-h1-858272-3 Oct 05 02:34:15.514813 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-7fded15d-e498-4d13-958f-561a6586c0a9 req-f4858b62-6567-419a-8533-d084967a6826 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047049 Oct 05 02:34:15.515983 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 815/1653] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:34:15.793764 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-71ed62d3-4c8b-4447-870a-9d211cfdfc43 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:15.794388 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-71ed62d3-4c8b-4447-870a-9d211cfdfc43 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:15.800745 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71ed62d3-4c8b-4447-870a-9d211cfdfc43 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:15.801462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71ed62d3-4c8b-4447-870a-9d211cfdfc43 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:15.802346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71ed62d3-4c8b-4447-870a-9d211cfdfc43 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:15.803346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71ed62d3-4c8b-4447-870a-9d211cfdfc43 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:15.804690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71ed62d3-4c8b-4447-870a-9d211cfdfc43 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:15.805342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71ed62d3-4c8b-4447-870a-9d211cfdfc43 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:15.982207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-71ed62d3-4c8b-4447-870a-9d211cfdfc43 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:15.991614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-71ed62d3-4c8b-4447-870a-9d211cfdfc43 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:15.993092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-71ed62d3-4c8b-4447-870a-9d211cfdfc43 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:15.995076 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-71ed62d3-4c8b-4447-870a-9d211cfdfc43 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1744 microversion: 2.20 time: 0.206798 Oct 05 02:34:15.997919 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 839/1654] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:15 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1744 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:16.099242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f609ca4b-a771-4bcc-b2f6-268332573ebb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:16.099945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f609ca4b-a771-4bcc-b2f6-268332573ebb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:16.109315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f609ca4b-a771-4bcc-b2f6-268332573ebb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:16.110198 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f609ca4b-a771-4bcc-b2f6-268332573ebb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:16.110893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f609ca4b-a771-4bcc-b2f6-268332573ebb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:16.111845 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f609ca4b-a771-4bcc-b2f6-268332573ebb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:16.112525 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f609ca4b-a771-4bcc-b2f6-268332573ebb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:16.113211 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f609ca4b-a771-4bcc-b2f6-268332573ebb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:16.131210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9362c885-0ca2-4078-aeae-ac1b9eb953a2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:16.131834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9362c885-0ca2-4078-aeae-ac1b9eb953a2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:16.148040 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9362c885-0ca2-4078-aeae-ac1b9eb953a2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:16.148542 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9362c885-0ca2-4078-aeae-ac1b9eb953a2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:16.149006 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9362c885-0ca2-4078-aeae-ac1b9eb953a2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:16.150223 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9362c885-0ca2-4078-aeae-ac1b9eb953a2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:16.151025 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9362c885-0ca2-4078-aeae-ac1b9eb953a2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:16.151674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9362c885-0ca2-4078-aeae-ac1b9eb953a2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:16.347544 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f609ca4b-a771-4bcc-b2f6-268332573ebb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:16.360530 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f609ca4b-a771-4bcc-b2f6-268332573ebb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776" status: 200 len: 1324 microversion: 2.1 time: 0.265197 Oct 05 02:34:16.377135 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 816/1655] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:16 2022] GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776 => generated 1324 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:16.380673 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9362c885-0ca2-4078-aeae-ac1b9eb953a2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:16.394590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9362c885-0ca2-4078-aeae-ac1b9eb953a2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:16.398308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9362c885-0ca2-4078-aeae-ac1b9eb953a2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:16.401700 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fb408bb2-795e-49ec-9be7-15d730f6399e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:16.403544 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9362c885-0ca2-4078-aeae-ac1b9eb953a2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1487 microversion: 2.25 time: 0.275354 Oct 05 02:34:16.404535 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fb408bb2-795e-49ec-9be7-15d730f6399e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:16.406880 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 840/1656] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:16 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1487 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:34:16.412882 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb408bb2-795e-49ec-9be7-15d730f6399e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:16.413653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb408bb2-795e-49ec-9be7-15d730f6399e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:16.414300 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb408bb2-795e-49ec-9be7-15d730f6399e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:16.415472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb408bb2-795e-49ec-9be7-15d730f6399e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:16.416116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb408bb2-795e-49ec-9be7-15d730f6399e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:16.417074 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb408bb2-795e-49ec-9be7-15d730f6399e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:16.435929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:34:16.642378 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fb408bb2-795e-49ec-9be7-15d730f6399e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:16.666441 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fb408bb2-795e-49ec-9be7-15d730f6399e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 200 len: 1475 microversion: 2.1 time: 0.277140 Oct 05 02:34:16.689186 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 817/1657] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:16 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 1475 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:16.694174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0c3054e0-b7b2-4116-b5ea-62a0ad0c26eb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1361263186"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:16.697196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0c3054e0-b7b2-4116-b5ea-62a0ad0c26eb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:16.704972 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c3054e0-b7b2-4116-b5ea-62a0ad0c26eb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:16.705833 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c3054e0-b7b2-4116-b5ea-62a0ad0c26eb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:16.706540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c3054e0-b7b2-4116-b5ea-62a0ad0c26eb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:16.707475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c3054e0-b7b2-4116-b5ea-62a0ad0c26eb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:16.708162 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c3054e0-b7b2-4116-b5ea-62a0ad0c26eb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:16.708804 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c3054e0-b7b2-4116-b5ea-62a0ad0c26eb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:17.006405 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0c3054e0-b7b2-4116-b5ea-62a0ad0c26eb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "POST /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4/action" status: 202 len: 0 microversion: 2.1 time: 0.316537 Oct 05 02:34:17.015375 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 841/1658] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:34:16 2022] POST /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 05 02:34:17.028720 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3f63c57f-90a0-45de-afbe-d5a393c8c11e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce8282ca0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:17.045039 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1a7fc2b3-f541-4d1c-a2f9-130d91b512a7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:17.048311 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1a7fc2b3-f541-4d1c-a2f9-130d91b512a7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:17.066934 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a7fc2b3-f541-4d1c-a2f9-130d91b512a7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:17.067902 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a7fc2b3-f541-4d1c-a2f9-130d91b512a7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:17.070103 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a7fc2b3-f541-4d1c-a2f9-130d91b512a7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:17.071703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a7fc2b3-f541-4d1c-a2f9-130d91b512a7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:17.073042 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a7fc2b3-f541-4d1c-a2f9-130d91b512a7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:17.073662 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a7fc2b3-f541-4d1c-a2f9-130d91b512a7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:17.093840 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3f63c57f-90a0-45de-afbe-d5a393c8c11e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf" status: 200 len: 1414 microversion: 2.1 time: 0.078381 Oct 05 02:34:17.095003 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 818/1659] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:34:17 2022] GET /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf => generated 1414 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:17.305995 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1a7fc2b3-f541-4d1c-a2f9-130d91b512a7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:17.322690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1a7fc2b3-f541-4d1c-a2f9-130d91b512a7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:17.327247 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1a7fc2b3-f541-4d1c-a2f9-130d91b512a7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:17.332111 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1a7fc2b3-f541-4d1c-a2f9-130d91b512a7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1744 microversion: 2.20 time: 0.312234 Oct 05 02:34:17.335527 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 842/1660] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:17 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1744 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:17.387874 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-eb4a4f48-6657-4cf1-ad41-9767c058afe5 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:17.388658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-eb4a4f48-6657-4cf1-ad41-9767c058afe5 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:17.398095 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb4a4f48-6657-4cf1-ad41-9767c058afe5 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:17.407015 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb4a4f48-6657-4cf1-ad41-9767c058afe5 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:17.407805 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb4a4f48-6657-4cf1-ad41-9767c058afe5 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:17.408801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb4a4f48-6657-4cf1-ad41-9767c058afe5 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:17.409538 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb4a4f48-6657-4cf1-ad41-9767c058afe5 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:17.410186 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb4a4f48-6657-4cf1-ad41-9767c058afe5 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:17.438610 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b55a0041-165e-42d5-bf46-e168e8146a4d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:17.448265 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b55a0041-165e-42d5-bf46-e168e8146a4d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:17.461909 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b55a0041-165e-42d5-bf46-e168e8146a4d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:17.471374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b55a0041-165e-42d5-bf46-e168e8146a4d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:17.472157 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b55a0041-165e-42d5-bf46-e168e8146a4d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:17.473146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b55a0041-165e-42d5-bf46-e168e8146a4d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:17.473796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b55a0041-165e-42d5-bf46-e168e8146a4d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:17.474506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b55a0041-165e-42d5-bf46-e168e8146a4d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:17.974891 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-eb4a4f48-6657-4cf1-ad41-9767c058afe5 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:17.989933 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-eb4a4f48-6657-4cf1-ad41-9767c058afe5 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776" status: 200 len: 1522 microversion: 2.1 time: 0.609472 Oct 05 02:34:17.990569 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 819/1661] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:17 2022] GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776 => generated 1522 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:18.020790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-83f75683-f773-4a3f-98eb-7fee8c96965f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:18.021446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-83f75683-f773-4a3f-98eb-7fee8c96965f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:18.033472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-83f75683-f773-4a3f-98eb-7fee8c96965f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:18.033972 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-83f75683-f773-4a3f-98eb-7fee8c96965f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:18.034412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-83f75683-f773-4a3f-98eb-7fee8c96965f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:18.035129 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-83f75683-f773-4a3f-98eb-7fee8c96965f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:18.035586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-83f75683-f773-4a3f-98eb-7fee8c96965f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:18.036013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-83f75683-f773-4a3f-98eb-7fee8c96965f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:18.046421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b55a0041-165e-42d5-bf46-e168e8146a4d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:18.061075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b55a0041-165e-42d5-bf46-e168e8146a4d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:18.062714 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b55a0041-165e-42d5-bf46-e168e8146a4d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:18.063917 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b55a0041-165e-42d5-bf46-e168e8146a4d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1487 microversion: 2.25 time: 0.631926 Oct 05 02:34:18.071501 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 843/1662] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:17 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1487 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:18.112063 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d597a78f-760e-4890-95e3-76335697d030 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce8151b80>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:18.171708 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d597a78f-760e-4890-95e3-76335697d030 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf" status: 200 len: 1414 microversion: 2.1 time: 0.063817 Oct 05 02:34:18.172792 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 844/1663] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:34:18 2022] GET /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf => generated 1414 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:18.313319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-83f75683-f773-4a3f-98eb-7fee8c96965f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:18.326427 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-83f75683-f773-4a3f-98eb-7fee8c96965f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776" status: 200 len: 1522 microversion: 2.1 time: 0.309343 Oct 05 02:34:18.329878 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 820/1664] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:18 2022] GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:18.352373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8c024356-e095-4e2b-9550-f373bc70d672 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1293717160", "metadata": {"": ""}}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:18.364578 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2306fc7d-80e0-47f3-9e16-f7c1ad30de0d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:18.364578 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2306fc7d-80e0-47f3-9e16-f7c1ad30de0d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8c024356-e095-4e2b-9550-f373bc70d672 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Request method failure captured: Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776/action HTTP/1.1 Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 107 Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO0XYeg8tqT8ongEAJOwqXQnTLTHZzTVGNp07qyK2Im6Pk37xE9_000kJ-ghGlg1M4xDfFZdh80YSHVWWaKUqSxFWQ_Csj3K04E3ui1EPC1OYFRpRVpFWUIW6dnDr0Kom0Z5CM2HBG5dMHahqKQPxztoTXPVRWZPXtn1QZY0a3PPLGY Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 47098be734b14277a4d9a9d6b8464998 Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_47098be734b14277a4d9a9d6b8464998"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 47098be734b14277a4d9a9d6b8464998 Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ImagesOneServerNegativeTestJSON-1772902756-project Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 4c441be8c87648bf9f1ff5cd4aff2532 Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756-project Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1293717160", "metadata": {"": ""}}} Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'ed8c63c7-f728-4202-94b9-1b4a00fac776', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1293717160', 'metadata': {'': ''}}}} Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi {'': ''} Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:34:18.377014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 02:34:18.382685 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 02:34:18.382685 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:34:18.382685 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:34:18.382685 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:34:18.382685 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:34:18.382685 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 02:34:18.382685 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:18.382685 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:34:18.382685 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:18.382685 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:34:18.382685 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:34:18.382685 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:34:18.382685 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:34:18.382685 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:34:18.382685 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 02:34:18.382685 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:18.387707 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2306fc7d-80e0-47f3-9e16-f7c1ad30de0d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:18.387707 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2306fc7d-80e0-47f3-9e16-f7c1ad30de0d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:18.387707 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2306fc7d-80e0-47f3-9e16-f7c1ad30de0d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:18.388003 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8c024356-e095-4e2b-9550-f373bc70d672 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:34:18.388003 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8c024356-e095-4e2b-9550-f373bc70d672 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "POST /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776/action" status: 400 len: 170 microversion: 2.1 time: 0.034248 Oct 05 02:34:18.388003 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 845/1665] 10.222.0.16 () {60 vars in 1279 bytes} [Wed Oct 5 02:34:18 2022] POST /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776/action => generated 170 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:34:18.388291 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2306fc7d-80e0-47f3-9e16-f7c1ad30de0d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:18.388291 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2306fc7d-80e0-47f3-9e16-f7c1ad30de0d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:18.388291 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2306fc7d-80e0-47f3-9e16-f7c1ad30de0d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:18.404500 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-18b14a88-f92d-4d6d-ba02-b696801bd1e4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:18.409952 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-18b14a88-f92d-4d6d-ba02-b696801bd1e4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:18.425971 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18b14a88-f92d-4d6d-ba02-b696801bd1e4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:18.426691 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18b14a88-f92d-4d6d-ba02-b696801bd1e4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:18.428866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18b14a88-f92d-4d6d-ba02-b696801bd1e4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:18.430286 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18b14a88-f92d-4d6d-ba02-b696801bd1e4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:18.432607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18b14a88-f92d-4d6d-ba02-b696801bd1e4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:18.433993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18b14a88-f92d-4d6d-ba02-b696801bd1e4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:18.765741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2306fc7d-80e0-47f3-9e16-f7c1ad30de0d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:18.781806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2306fc7d-80e0-47f3-9e16-f7c1ad30de0d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:18.783819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2306fc7d-80e0-47f3-9e16-f7c1ad30de0d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:18.785725 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2306fc7d-80e0-47f3-9e16-f7c1ad30de0d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1744 microversion: 2.20 time: 0.429171 Oct 05 02:34:18.791413 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 821/1666] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:18 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1744 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:18.801590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-18b14a88-f92d-4d6d-ba02-b696801bd1e4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:18.814539 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-18b14a88-f92d-4d6d-ba02-b696801bd1e4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776" status: 200 len: 1522 microversion: 2.1 time: 0.424629 Oct 05 02:34:18.830662 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 846/1667] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:18 2022] GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776 => generated 1522 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:18.842362 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-68d57bb2-4a53-4f4f-aa07-19a1be79ebdd tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:18.843193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-68d57bb2-4a53-4f4f-aa07-19a1be79ebdd tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:18.850306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68d57bb2-4a53-4f4f-aa07-19a1be79ebdd tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:18.851175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68d57bb2-4a53-4f4f-aa07-19a1be79ebdd tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:18.851800 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68d57bb2-4a53-4f4f-aa07-19a1be79ebdd tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:18.852716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68d57bb2-4a53-4f4f-aa07-19a1be79ebdd tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:18.853368 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68d57bb2-4a53-4f4f-aa07-19a1be79ebdd tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:18.854251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68d57bb2-4a53-4f4f-aa07-19a1be79ebdd tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:19.094190 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-201e39df-f17f-441e-bb36-f04055149f22 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:19.094967 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-201e39df-f17f-441e-bb36-f04055149f22 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:19.107008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-201e39df-f17f-441e-bb36-f04055149f22 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:19.108257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-201e39df-f17f-441e-bb36-f04055149f22 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:19.109742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-201e39df-f17f-441e-bb36-f04055149f22 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:19.110744 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-201e39df-f17f-441e-bb36-f04055149f22 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:19.112233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-201e39df-f17f-441e-bb36-f04055149f22 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:19.113646 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-201e39df-f17f-441e-bb36-f04055149f22 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:19.141034 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-68d57bb2-4a53-4f4f-aa07-19a1be79ebdd tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:19.149521 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-68d57bb2-4a53-4f4f-aa07-19a1be79ebdd tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776" status: 200 len: 1522 microversion: 2.1 time: 0.312130 Oct 05 02:34:19.151493 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 822/1668] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:18 2022] GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:19.178858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7d2c1dc9-b29e-4203-80f7-915fb6e54218 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1031316201", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7d2c1dc9-b29e-4203-80f7-915fb6e54218 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Request method failure captured: Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776/action HTTP/1.1 Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 619 Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO0XYeg8tqT8ongEAJOwqXQnTLTHZzTVGNp07qyK2Im6Pk37xE9_000kJ-ghGlg1M4xDfFZdh80YSHVWWaKUqSxFWQ_Csj3K04E3ui1EPC1OYFRpRVpFWUIW6dnDr0Kom0Z5CM2HBG5dMHahqKQPxztoTXPVRWZPXtn1QZY0a3PPLGY Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 47098be734b14277a4d9a9d6b8464998 Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_47098be734b14277a4d9a9d6b8464998"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 47098be734b14277a4d9a9d6b8464998 Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ImagesOneServerNegativeTestJSON-1772902756-project Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 4c441be8c87648bf9f1ff5cd4aff2532 Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756-project Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1031316201", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'ed8c63c7-f728-4202-94b9-1b4a00fac776', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1031316201', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:34:19.196306 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 02:34:19.200631 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:34:19.209527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7d2c1dc9-b29e-4203-80f7-915fb6e54218 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:34:19.210662 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7d2c1dc9-b29e-4203-80f7-915fb6e54218 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "POST /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776/action" status: 400 len: 938 microversion: 2.1 time: 0.036528 Oct 05 02:34:19.218525 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 823/1669] 10.222.0.16 () {60 vars in 1279 bytes} [Wed Oct 5 02:34:19 2022] POST /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776/action => generated 938 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:34:19.234960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-41ed9816-bcff-4729-8562-d5f97c0c42ef tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fccdfdfe670>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:19.317674 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-41ed9816-bcff-4729-8562-d5f97c0c42ef tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf" status: 200 len: 1414 microversion: 2.1 time: 0.097538 Oct 05 02:34:19.318274 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 824/1670] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:34:19 2022] GET /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf => generated 1414 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:19.323335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8083e61f-e178-41fc-a0d4-61838754ed32 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:19.323963 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8083e61f-e178-41fc-a0d4-61838754ed32 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:19.345122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8083e61f-e178-41fc-a0d4-61838754ed32 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:19.345622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8083e61f-e178-41fc-a0d4-61838754ed32 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:19.346263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8083e61f-e178-41fc-a0d4-61838754ed32 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:19.347129 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8083e61f-e178-41fc-a0d4-61838754ed32 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:19.347428 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8083e61f-e178-41fc-a0d4-61838754ed32 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:19.347958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8083e61f-e178-41fc-a0d4-61838754ed32 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:19.370062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-201e39df-f17f-441e-bb36-f04055149f22 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:19.379305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-201e39df-f17f-441e-bb36-f04055149f22 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:19.380747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-201e39df-f17f-441e-bb36-f04055149f22 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:19.381956 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-201e39df-f17f-441e-bb36-f04055149f22 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1487 microversion: 2.25 time: 0.294075 Oct 05 02:34:19.393696 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 847/1671] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:19 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1487 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:34:19.573418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8083e61f-e178-41fc-a0d4-61838754ed32 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:19.592281 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8083e61f-e178-41fc-a0d4-61838754ed32 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776" status: 200 len: 1522 microversion: 2.1 time: 0.272848 Oct 05 02:34:19.610431 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 825/1672] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:19 2022] GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:19.620697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b06ced11-16aa-4aae-b6e9-4c43fc0c061a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:19.621932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b06ced11-16aa-4aae-b6e9-4c43fc0c061a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:19.625576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:34:19.636112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b06ced11-16aa-4aae-b6e9-4c43fc0c061a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:19.637940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b06ced11-16aa-4aae-b6e9-4c43fc0c061a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:19.638384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b06ced11-16aa-4aae-b6e9-4c43fc0c061a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:19.644580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b06ced11-16aa-4aae-b6e9-4c43fc0c061a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:19.645767 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b06ced11-16aa-4aae-b6e9-4c43fc0c061a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:19.649394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b06ced11-16aa-4aae-b6e9-4c43fc0c061a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:19.812386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0bc8300f-134c-4aad-89cd-763745717b08 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:19.813294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0bc8300f-134c-4aad-89cd-763745717b08 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:19.841110 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0bc8300f-134c-4aad-89cd-763745717b08 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:19.842448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0bc8300f-134c-4aad-89cd-763745717b08 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:19.843906 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0bc8300f-134c-4aad-89cd-763745717b08 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:19.844880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0bc8300f-134c-4aad-89cd-763745717b08 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:19.850465 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0bc8300f-134c-4aad-89cd-763745717b08 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:19.851121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0bc8300f-134c-4aad-89cd-763745717b08 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:19.894041 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b06ced11-16aa-4aae-b6e9-4c43fc0c061a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:19.906370 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b06ced11-16aa-4aae-b6e9-4c43fc0c061a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776" status: 200 len: 1522 microversion: 2.1 time: 0.291465 Oct 05 02:34:19.908050 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 848/1673] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:19 2022] GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:19.931165 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a4cb0e5d-44b1-4608-aa60-333cb2f71961 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a4cb0e5d-44b1-4608-aa60-333cb2f71961 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Request method failure captured: Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776/action HTTP/1.1 Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 285 Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO0XYeg8tqT8ongEAJOwqXQnTLTHZzTVGNp07qyK2Im6Pk37xE9_000kJ-ghGlg1M4xDfFZdh80YSHVWWaKUqSxFWQ_Csj3K04E3ui1EPC1OYFRpRVpFWUIW6dnDr0Kom0Z5CM2HBG5dMHahqKQPxztoTXPVRWZPXtn1QZY0a3PPLGY Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 47098be734b14277a4d9a9d6b8464998 Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_47098be734b14277a4d9a9d6b8464998"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 47098be734b14277a4d9a9d6b8464998 Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ImagesOneServerNegativeTestJSON-1772902756-project Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 4c441be8c87648bf9f1ff5cd4aff2532 Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756-project Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'ed8c63c7-f728-4202-94b9-1b4a00fac776', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:34:19.947109 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:19.951789 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:34:19.951789 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:34:19.951789 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:34:19.951789 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:34:19.951789 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:34:19.951789 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:34:19.951789 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:34:19.951789 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:34:19.951789 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:34:19.951789 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 02:34:19.951789 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 02:34:19.951789 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:34:19.951789 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:34:19.951789 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:34:19.951789 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:34:19.951789 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 02:34:19.951789 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:19.951789 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:34:19.951789 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:19.951789 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:34:19.951789 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:34:19.951789 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:34:19.951789 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:34:19.951789 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:34:19.951789 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 02:34:19.951789 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:19.956197 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a4cb0e5d-44b1-4608-aa60-333cb2f71961 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:34:19.957535 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a4cb0e5d-44b1-4608-aa60-333cb2f71961 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "POST /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776/action" status: 400 len: 619 microversion: 2.1 time: 0.030549 Oct 05 02:34:19.959003 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 849/1674] 10.222.0.16 () {60 vars in 1279 bytes} [Wed Oct 5 02:34:19 2022] POST /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776/action => generated 619 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:34:19.967519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7f9f6dfe-dcb6-442f-b058-ea5bea9a2eaa tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:19.968483 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7f9f6dfe-dcb6-442f-b058-ea5bea9a2eaa tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:19.987697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f9f6dfe-dcb6-442f-b058-ea5bea9a2eaa tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:19.988545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f9f6dfe-dcb6-442f-b058-ea5bea9a2eaa tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:19.989255 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f9f6dfe-dcb6-442f-b058-ea5bea9a2eaa tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:19.990184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f9f6dfe-dcb6-442f-b058-ea5bea9a2eaa tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:19.990851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f9f6dfe-dcb6-442f-b058-ea5bea9a2eaa tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:19.992523 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f9f6dfe-dcb6-442f-b058-ea5bea9a2eaa tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:20.154194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0bc8300f-134c-4aad-89cd-763745717b08 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:20.170392 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0bc8300f-134c-4aad-89cd-763745717b08 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:20.172324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0bc8300f-134c-4aad-89cd-763745717b08 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:20.173883 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0bc8300f-134c-4aad-89cd-763745717b08 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1744 microversion: 2.20 time: 0.366742 Oct 05 02:34:20.175011 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 826/1675] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:19 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1744 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:20.257422 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7f9f6dfe-dcb6-442f-b058-ea5bea9a2eaa tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:20.270391 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7f9f6dfe-dcb6-442f-b058-ea5bea9a2eaa tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776" status: 200 len: 1522 microversion: 2.1 time: 0.307320 Oct 05 02:34:20.271498 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 850/1676] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:19 2022] GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776 => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:20.297910 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bd3e2ef2-376a-4368-aca2-ab0401ddf815 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:20.298534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bd3e2ef2-376a-4368-aca2-ab0401ddf815 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:20.318813 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd3e2ef2-376a-4368-aca2-ab0401ddf815 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:20.319325 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd3e2ef2-376a-4368-aca2-ab0401ddf815 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:20.319762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd3e2ef2-376a-4368-aca2-ab0401ddf815 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:20.320482 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd3e2ef2-376a-4368-aca2-ab0401ddf815 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:20.321082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd3e2ef2-376a-4368-aca2-ab0401ddf815 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:20.321730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd3e2ef2-376a-4368-aca2-ab0401ddf815 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:20.332571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5ed29de0-7517-4547-8d9e-c3102ab0bf8a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce80f0280>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:20.552474 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5ed29de0-7517-4547-8d9e-c3102ab0bf8a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf" status: 200 len: 1414 microversion: 2.1 time: 0.223346 Oct 05 02:34:20.556854 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 851/1677] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:34:20 2022] GET /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf => generated 1414 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:20.576302 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-43cdcb02-3be4-491f-8f27-00b250fe25c2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:20.576487 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-43cdcb02-3be4-491f-8f27-00b250fe25c2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:20.594263 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-43cdcb02-3be4-491f-8f27-00b250fe25c2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:20.597671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-43cdcb02-3be4-491f-8f27-00b250fe25c2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:20.598161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-43cdcb02-3be4-491f-8f27-00b250fe25c2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:20.600096 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-43cdcb02-3be4-491f-8f27-00b250fe25c2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:20.603393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-43cdcb02-3be4-491f-8f27-00b250fe25c2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:20.604177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-43cdcb02-3be4-491f-8f27-00b250fe25c2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:20.669950 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bd3e2ef2-376a-4368-aca2-ab0401ddf815 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:20.688150 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bd3e2ef2-376a-4368-aca2-ab0401ddf815 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776" status: 200 len: 1522 microversion: 2.1 time: 0.391688 Oct 05 02:34:20.688790 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 827/1678] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:20 2022] GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776 => generated 1522 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:20.696622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-d2029d77-e2da-4476-ba4e-ca452a12e77c req-b942b4c2-5ce1-46c1-8b4d-b4219242d738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a28c6ea-5b3d-4f74-b490-8effa4fa813d", "name": "network-vif-plugged", "status": "completed", "tag": "9902bd06-5ff4-4749-a5aa-d4afd71ba732"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:20.738998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d2029d77-e2da-4476-ba4e-ca452a12e77c req-b942b4c2-5ce1-46c1-8b4d-b4219242d738 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:20.739668 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d2029d77-e2da-4476-ba4e-ca452a12e77c req-b942b4c2-5ce1-46c1-8b4d-b4219242d738 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:20.740766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d2029d77-e2da-4476-ba4e-ca452a12e77c req-b942b4c2-5ce1-46c1-8b4d-b4219242d738 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:20.787516 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-d2029d77-e2da-4476-ba4e-ca452a12e77c req-b942b4c2-5ce1-46c1-8b4d-b4219242d738 service nova] Creating event network-vif-plugged:9902bd06-5ff4-4749-a5aa-d4afd71ba732 for instance 7a28c6ea-5b3d-4f74-b490-8effa4fa813d on n-h2-858272-3 Oct 05 02:34:20.803746 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-d2029d77-e2da-4476-ba4e-ca452a12e77c req-b942b4c2-5ce1-46c1-8b4d-b4219242d738 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111323 Oct 05 02:34:20.804790 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 828/1679] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:34:20.824817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-50caad8e-f45d-4771-873a-143f74af7bbb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1743381570"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:20.827803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-50caad8e-f45d-4771-873a-143f74af7bbb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:20.846620 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50caad8e-f45d-4771-873a-143f74af7bbb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:20.853216 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50caad8e-f45d-4771-873a-143f74af7bbb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:20.854173 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50caad8e-f45d-4771-873a-143f74af7bbb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:20.855133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50caad8e-f45d-4771-873a-143f74af7bbb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:20.867542 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50caad8e-f45d-4771-873a-143f74af7bbb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:20.881816 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50caad8e-f45d-4771-873a-143f74af7bbb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:20.963346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-43cdcb02-3be4-491f-8f27-00b250fe25c2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:20.976229 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-43cdcb02-3be4-491f-8f27-00b250fe25c2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:20.980700 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-43cdcb02-3be4-491f-8f27-00b250fe25c2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:20.984095 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-43cdcb02-3be4-491f-8f27-00b250fe25c2 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1487 microversion: 2.25 time: 0.425642 Oct 05 02:34:20.984672 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 852/1680] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:20 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1487 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:21.213904 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7783f7d8-5668-431f-abd4-157f2887e46d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:21.215051 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7783f7d8-5668-431f-abd4-157f2887e46d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:21.232981 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7783f7d8-5668-431f-abd4-157f2887e46d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:21.233841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7783f7d8-5668-431f-abd4-157f2887e46d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:21.234528 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7783f7d8-5668-431f-abd4-157f2887e46d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:21.235682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7783f7d8-5668-431f-abd4-157f2887e46d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:21.236486 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7783f7d8-5668-431f-abd4-157f2887e46d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:21.237473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7783f7d8-5668-431f-abd4-157f2887e46d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:21.434629 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7783f7d8-5668-431f-abd4-157f2887e46d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:21.449323 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7783f7d8-5668-431f-abd4-157f2887e46d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:21.450937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7783f7d8-5668-431f-abd4-157f2887e46d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:21.452138 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7783f7d8-5668-431f-abd4-157f2887e46d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1739 microversion: 2.20 time: 0.243624 Oct 05 02:34:21.454704 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 853/1681] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:21 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1739 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:34:21.577905 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dd72cabd-64f7-486b-82d7-417c6a6c40c4 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce80f01f0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:26.388304 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-50caad8e-f45d-4771-873a-143f74af7bbb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "POST /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776/action" status: 202 len: 0 microversion: 2.1 time: 5.576780 Oct 05 02:34:26.390249 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 829/1682] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:34:20 2022] POST /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776/action => generated 0 bytes in 5581 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 05 02:34:26.413334 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4fde3d0e-4d6a-480c-b26b-0f938ba81e6a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:26.414191 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4fde3d0e-4d6a-480c-b26b-0f938ba81e6a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:26.423659 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4fde3d0e-4d6a-480c-b26b-0f938ba81e6a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:26.424149 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4fde3d0e-4d6a-480c-b26b-0f938ba81e6a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:26.424589 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4fde3d0e-4d6a-480c-b26b-0f938ba81e6a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:26.425321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4fde3d0e-4d6a-480c-b26b-0f938ba81e6a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:26.425776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4fde3d0e-4d6a-480c-b26b-0f938ba81e6a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:26.426204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4fde3d0e-4d6a-480c-b26b-0f938ba81e6a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:26.620669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4fde3d0e-4d6a-480c-b26b-0f938ba81e6a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:26.634586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4fde3d0e-4d6a-480c-b26b-0f938ba81e6a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:26.639708 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4fde3d0e-4d6a-480c-b26b-0f938ba81e6a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:26.642689 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4fde3d0e-4d6a-480c-b26b-0f938ba81e6a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1487 microversion: 2.25 time: 0.243760 Oct 05 02:34:26.658009 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 830/1683] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:26 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1487 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:26.658009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-db306f38-e935-4361-a2f6-607d7344c2d7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:26.658009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-db306f38-e935-4361-a2f6-607d7344c2d7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:26.684740 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db306f38-e935-4361-a2f6-607d7344c2d7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:26.686746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db306f38-e935-4361-a2f6-607d7344c2d7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:26.687194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db306f38-e935-4361-a2f6-607d7344c2d7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:26.688604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db306f38-e935-4361-a2f6-607d7344c2d7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:26.689467 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db306f38-e935-4361-a2f6-607d7344c2d7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:26.690140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db306f38-e935-4361-a2f6-607d7344c2d7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:26.737751 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dd72cabd-64f7-486b-82d7-417c6a6c40c4 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf" status: 200 len: 1414 microversion: 2.1 time: 5.167064 Oct 05 02:34:26.739308 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 854/1684] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:34:21 2022] GET /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf => generated 1414 bytes in 5169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:26.747268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-92806513-f66b-4a25-9f7d-5711ff56d8ab req-95ee87d5-6cd5-4e0b-9fc5-3bde93eb1cfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "031f6a33-bf9c-4b51-bf79-3764d67846e4", "name": "network-vif-plugged", "status": "completed", "tag": "db9891a1-497f-4f63-882e-e84d19c9e5f2"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:26.765912 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-92806513-f66b-4a25-9f7d-5711ff56d8ab req-95ee87d5-6cd5-4e0b-9fc5-3bde93eb1cfb service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:26.766588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-92806513-f66b-4a25-9f7d-5711ff56d8ab req-95ee87d5-6cd5-4e0b-9fc5-3bde93eb1cfb service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:26.767187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-92806513-f66b-4a25-9f7d-5711ff56d8ab req-95ee87d5-6cd5-4e0b-9fc5-3bde93eb1cfb service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:26.784545 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-92806513-f66b-4a25-9f7d-5711ff56d8ab req-95ee87d5-6cd5-4e0b-9fc5-3bde93eb1cfb service nova] Creating event network-vif-plugged:db9891a1-497f-4f63-882e-e84d19c9e5f2 for instance 031f6a33-bf9c-4b51-bf79-3764d67846e4 on n-h2-858272-3 Oct 05 02:34:26.792404 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-92806513-f66b-4a25-9f7d-5711ff56d8ab req-95ee87d5-6cd5-4e0b-9fc5-3bde93eb1cfb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051891 Oct 05 02:34:26.794348 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 855/1685] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:34:26.804508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ce16dbe7-e0ef-403d-9a39-c9368e345b4d tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1748154975"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:26.806933 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ce16dbe7-e0ef-403d-9a39-c9368e345b4d tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:26.824893 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce16dbe7-e0ef-403d-9a39-c9368e345b4d tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:26.828140 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce16dbe7-e0ef-403d-9a39-c9368e345b4d tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:26.828140 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce16dbe7-e0ef-403d-9a39-c9368e345b4d tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:26.828742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce16dbe7-e0ef-403d-9a39-c9368e345b4d tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:26.832551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce16dbe7-e0ef-403d-9a39-c9368e345b4d tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:26.833282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce16dbe7-e0ef-403d-9a39-c9368e345b4d tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:26.900724 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-ce16dbe7-e0ef-403d-9a39-c9368e345b4d tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] HTTP exception thrown: Cannot 'createImage' instance ed8c63c7-f728-4202-94b9-1b4a00fac776 while it is in task_state image_snapshot Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ce16dbe7-e0ef-403d-9a39-c9368e345b4d tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Request method failure captured: Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776/action HTTP/1.1 Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 85 Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO0XYeg8tqT8ongEAJOwqXQnTLTHZzTVGNp07qyK2Im6Pk37xE9_000kJ-ghGlg1M4xDfFZdh80YSHVWWaKUqSxFWQ_Csj3K04E3ui1EPC1OYFRpRVpFWUIW6dnDr0Kom0Z5CM2HBG5dMHahqKQPxztoTXPVRWZPXtn1QZY0a3PPLGY Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 47098be734b14277a4d9a9d6b8464998 Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_47098be734b14277a4d9a9d6b8464998"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 47098be734b14277a4d9a9d6b8464998 Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ImagesOneServerNegativeTestJSON-1772902756-project Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 4c441be8c87648bf9f1ff5cd4aff2532 Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756-project Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1748154975"}} Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: exception: Cannot 'createImage' instance ed8c63c7-f728-4202-94b9-1b4a00fac776 while it is in task_state image_snapshot Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'ed8c63c7-f728-4202-94b9-1b4a00fac776', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1748154975'}}} Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ed8c63c7-f728-4202-94b9-1b4a00fac776 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 02:34:26.907118 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance ed8c63c7-f728-4202-94b9-1b4a00fac776 while it is in task_state image_snapshot Oct 05 02:34:26.912014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:26.912014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:34:26.912014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:26.912014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:34:26.912014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:34:26.912014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:34:26.912014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:34:26.912014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:34:26.912014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance ed8c63c7-f728-4202-94b9-1b4a00fac776 while it is in task_state image_snapshot Oct 05 02:34:26.912014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:34:26.912014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ce16dbe7-e0ef-403d-9a39-c9368e345b4d tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Returning 409 to user: Cannot 'createImage' instance ed8c63c7-f728-4202-94b9-1b4a00fac776 while it is in task_state image_snapshot {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:34:26.912014 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ce16dbe7-e0ef-403d-9a39-c9368e345b4d tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "POST /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776/action" status: 409 len: 159 microversion: 2.1 time: 0.112806 Oct 05 02:34:26.914921 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 856/1686] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:34:26 2022] POST /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776/action => generated 159 bytes in 120 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:34:26.923646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-db306f38-e935-4361-a2f6-607d7344c2d7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:26.924735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1aaf18ee-1c56-4532-a706-5e0bf2692e03 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '.version_select at 0x7fcce8202940>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:26.934780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-db306f38-e935-4361-a2f6-607d7344c2d7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:26.937317 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-db306f38-e935-4361-a2f6-607d7344c2d7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:26.938783 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-db306f38-e935-4361-a2f6-607d7344c2d7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1739 microversion: 2.20 time: 0.292379 Oct 05 02:34:26.957697 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 831/1687] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:26 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1739 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:27.187873 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1aaf18ee-1c56-4532-a706-5e0bf2692e03 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "DELETE /compute/v2.1/images/2462b7e2-284c-4860-8c3c-a5330a031305" status: 204 len: 0 microversion: 2.1 time: 0.271370 Oct 05 02:34:27.188326 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 857/1688] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:26 2022] DELETE /compute/v2.1/images/2462b7e2-284c-4860-8c3c-a5330a031305 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:34:27.198685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0e156eb1-5eed-4bbd-9e06-5dff7d363b6f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:27.199933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0e156eb1-5eed-4bbd-9e06-5dff7d363b6f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:27.213250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e156eb1-5eed-4bbd-9e06-5dff7d363b6f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:27.214449 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e156eb1-5eed-4bbd-9e06-5dff7d363b6f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:27.215836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e156eb1-5eed-4bbd-9e06-5dff7d363b6f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:27.217432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e156eb1-5eed-4bbd-9e06-5dff7d363b6f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:27.218768 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e156eb1-5eed-4bbd-9e06-5dff7d363b6f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:27.219198 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e156eb1-5eed-4bbd-9e06-5dff7d363b6f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:27.438599 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0e156eb1-5eed-4bbd-9e06-5dff7d363b6f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:27.447996 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0e156eb1-5eed-4bbd-9e06-5dff7d363b6f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776" status: 200 len: 1534 microversion: 2.1 time: 0.255234 Oct 05 02:34:27.448702 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 832/1689] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:27 2022] GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776 => generated 1534 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:27.682832 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2754220c-6608-480f-a2de-d7186e04741f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:27.685873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2754220c-6608-480f-a2de-d7186e04741f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:27.702450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2754220c-6608-480f-a2de-d7186e04741f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:27.703608 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2754220c-6608-480f-a2de-d7186e04741f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:27.704411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2754220c-6608-480f-a2de-d7186e04741f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:27.705420 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2754220c-6608-480f-a2de-d7186e04741f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:27.706161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2754220c-6608-480f-a2de-d7186e04741f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:27.706816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2754220c-6608-480f-a2de-d7186e04741f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:27.715139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:34:27.758416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3d16b1b6-ff39-49da-b421-81d8c454a55f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce828d4c0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:27.890599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2754220c-6608-480f-a2de-d7186e04741f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:27.899420 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2754220c-6608-480f-a2de-d7186e04741f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:27.901798 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2754220c-6608-480f-a2de-d7186e04741f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:27.903408 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2754220c-6608-480f-a2de-d7186e04741f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1487 microversion: 2.25 time: 0.226957 Oct 05 02:34:27.904450 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 858/1690] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:27 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1487 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:27.971375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c19ff3de-f64e-4393-81f7-13c2117ebe7f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:27.972757 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c19ff3de-f64e-4393-81f7-13c2117ebe7f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:27.986715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c19ff3de-f64e-4393-81f7-13c2117ebe7f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:27.989276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c19ff3de-f64e-4393-81f7-13c2117ebe7f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:27.992767 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c19ff3de-f64e-4393-81f7-13c2117ebe7f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:27.994428 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c19ff3de-f64e-4393-81f7-13c2117ebe7f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:27.995560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c19ff3de-f64e-4393-81f7-13c2117ebe7f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:27.998213 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c19ff3de-f64e-4393-81f7-13c2117ebe7f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:28.237010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c19ff3de-f64e-4393-81f7-13c2117ebe7f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:28.253387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c19ff3de-f64e-4393-81f7-13c2117ebe7f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:28.255266 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c19ff3de-f64e-4393-81f7-13c2117ebe7f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:28.256722 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c19ff3de-f64e-4393-81f7-13c2117ebe7f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1739 microversion: 2.20 time: 0.290754 Oct 05 02:34:28.258554 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 859/1691] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:27 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1739 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:34:28.476798 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-be73e829-e8f6-4d5d-bf90-e4290e659c5b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:28.478026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-be73e829-e8f6-4d5d-bf90-e4290e659c5b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:28.492046 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be73e829-e8f6-4d5d-bf90-e4290e659c5b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:28.494621 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be73e829-e8f6-4d5d-bf90-e4290e659c5b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:28.497473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be73e829-e8f6-4d5d-bf90-e4290e659c5b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:28.499397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be73e829-e8f6-4d5d-bf90-e4290e659c5b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:28.500550 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be73e829-e8f6-4d5d-bf90-e4290e659c5b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:28.501651 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be73e829-e8f6-4d5d-bf90-e4290e659c5b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:28.876851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-be73e829-e8f6-4d5d-bf90-e4290e659c5b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:28.891078 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-be73e829-e8f6-4d5d-bf90-e4290e659c5b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776" status: 200 len: 1534 microversion: 2.1 time: 0.421778 Oct 05 02:34:28.894154 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 860/1692] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:28 2022] GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776 => generated 1534 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:28.932037 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e82e0bda-8c48-4b67-a408-5f5863aaa3ca tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:28.932650 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e82e0bda-8c48-4b67-a408-5f5863aaa3ca tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:28.941402 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e82e0bda-8c48-4b67-a408-5f5863aaa3ca tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:28.942289 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e82e0bda-8c48-4b67-a408-5f5863aaa3ca tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:28.942730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e82e0bda-8c48-4b67-a408-5f5863aaa3ca tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:28.943426 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e82e0bda-8c48-4b67-a408-5f5863aaa3ca tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:28.943877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e82e0bda-8c48-4b67-a408-5f5863aaa3ca tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:28.944409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e82e0bda-8c48-4b67-a408-5f5863aaa3ca tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:29.123589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e82e0bda-8c48-4b67-a408-5f5863aaa3ca tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:29.134630 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e82e0bda-8c48-4b67-a408-5f5863aaa3ca tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:29.136294 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e82e0bda-8c48-4b67-a408-5f5863aaa3ca tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:29.138377 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e82e0bda-8c48-4b67-a408-5f5863aaa3ca tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1487 microversion: 2.25 time: 0.210062 Oct 05 02:34:29.139424 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 861/1693] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:28 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1487 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:34:29.299162 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bc5245d3-a1a9-479a-839c-169daf297817 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:29.299690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bc5245d3-a1a9-479a-839c-169daf297817 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:29.321150 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:34:29.323476 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bc5245d3-a1a9-479a-839c-169daf297817 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:29.324836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bc5245d3-a1a9-479a-839c-169daf297817 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:29.325301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bc5245d3-a1a9-479a-839c-169daf297817 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:29.326282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bc5245d3-a1a9-479a-839c-169daf297817 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:29.338014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bc5245d3-a1a9-479a-839c-169daf297817 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:29.339107 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bc5245d3-a1a9-479a-839c-169daf297817 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:29.613187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bc5245d3-a1a9-479a-839c-169daf297817 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:29.629654 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bc5245d3-a1a9-479a-839c-169daf297817 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:29.631475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bc5245d3-a1a9-479a-839c-169daf297817 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:29.634202 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bc5245d3-a1a9-479a-839c-169daf297817 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1739 microversion: 2.20 time: 0.338943 Oct 05 02:34:29.641966 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 862/1694] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:29 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1739 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:34:29.646868 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-4a41d84e-54e2-47f5-8775-1889b583c194 req-8d555d89-88d3-4a89-a971-730e628728ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a786593b-2c6f-4bc5-b338-8715c7d0429f", "name": "network-vif-unplugged", "status": "completed", "tag": "d0b44992-5d97-49da-98a0-6facb5cee1a2"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:29.678759 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4a41d84e-54e2-47f5-8775-1889b583c194 req-8d555d89-88d3-4a89-a971-730e628728ff service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:29.684495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4a41d84e-54e2-47f5-8775-1889b583c194 req-8d555d89-88d3-4a89-a971-730e628728ff service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:29.694710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4a41d84e-54e2-47f5-8775-1889b583c194 req-8d555d89-88d3-4a89-a971-730e628728ff service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:29.715877 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-4a41d84e-54e2-47f5-8775-1889b583c194 req-8d555d89-88d3-4a89-a971-730e628728ff service nova] Creating event network-vif-unplugged:d0b44992-5d97-49da-98a0-6facb5cee1a2 for instance a786593b-2c6f-4bc5-b338-8715c7d0429f on n-h1-858272-3 Oct 05 02:34:29.723668 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-4a41d84e-54e2-47f5-8775-1889b583c194 req-8d555d89-88d3-4a89-a971-730e628728ff service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079788 Oct 05 02:34:29.725064 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 863/1695] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:34:29.926650 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dfc874a6-f33e-4f4f-a042-4cfc03e4f8b6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:29.928986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dfc874a6-f33e-4f4f-a042-4cfc03e4f8b6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:29.943008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfc874a6-f33e-4f4f-a042-4cfc03e4f8b6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:29.943822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfc874a6-f33e-4f4f-a042-4cfc03e4f8b6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:29.944453 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfc874a6-f33e-4f4f-a042-4cfc03e4f8b6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:29.945375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfc874a6-f33e-4f4f-a042-4cfc03e4f8b6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:29.945993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfc874a6-f33e-4f4f-a042-4cfc03e4f8b6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:29.946586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfc874a6-f33e-4f4f-a042-4cfc03e4f8b6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:30.238072 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dfc874a6-f33e-4f4f-a042-4cfc03e4f8b6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:30.254083 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dfc874a6-f33e-4f4f-a042-4cfc03e4f8b6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776" status: 200 len: 1540 microversion: 2.1 time: 0.332722 Oct 05 02:34:30.257464 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 864/1696] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:29 2022] GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776 => generated 1540 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:30.275236 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a7d154a7-b626-4227-a293-a1a8fbe3bd6b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:30.275853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a7d154a7-b626-4227-a293-a1a8fbe3bd6b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:30.297758 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7d154a7-b626-4227-a293-a1a8fbe3bd6b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:30.298271 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7d154a7-b626-4227-a293-a1a8fbe3bd6b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:30.302987 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7d154a7-b626-4227-a293-a1a8fbe3bd6b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:30.303718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7d154a7-b626-4227-a293-a1a8fbe3bd6b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:30.311942 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7d154a7-b626-4227-a293-a1a8fbe3bd6b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:30.312394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7d154a7-b626-4227-a293-a1a8fbe3bd6b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:30.633594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a7d154a7-b626-4227-a293-a1a8fbe3bd6b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:30.647568 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a7d154a7-b626-4227-a293-a1a8fbe3bd6b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:30.673303 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a7d154a7-b626-4227-a293-a1a8fbe3bd6b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:30.674851 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a7d154a7-b626-4227-a293-a1a8fbe3bd6b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1487 microversion: 2.25 time: 0.416174 Oct 05 02:34:30.675731 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 865/1697] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:30 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1487 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:30.682045 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-33d0e4f2-c922-47e8-a683-7908a43bf1fa tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:30.683035 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-33d0e4f2-c922-47e8-a683-7908a43bf1fa tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:30.691958 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33d0e4f2-c922-47e8-a683-7908a43bf1fa tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:30.693287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33d0e4f2-c922-47e8-a683-7908a43bf1fa tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:30.695466 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33d0e4f2-c922-47e8-a683-7908a43bf1fa tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:30.696443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33d0e4f2-c922-47e8-a683-7908a43bf1fa tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:30.697812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33d0e4f2-c922-47e8-a683-7908a43bf1fa tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:30.698522 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33d0e4f2-c922-47e8-a683-7908a43bf1fa tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:30.937006 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-33d0e4f2-c922-47e8-a683-7908a43bf1fa tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:30.945964 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-33d0e4f2-c922-47e8-a683-7908a43bf1fa tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:30.949731 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-33d0e4f2-c922-47e8-a683-7908a43bf1fa tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:30.951894 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-33d0e4f2-c922-47e8-a683-7908a43bf1fa tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1739 microversion: 2.20 time: 0.274874 Oct 05 02:34:30.953222 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 866/1698] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:30 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1739 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:31.282442 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-54e2298a-b38d-476d-bf9a-380c6deda498 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:31.283038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-54e2298a-b38d-476d-bf9a-380c6deda498 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:31.294152 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54e2298a-b38d-476d-bf9a-380c6deda498 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:31.294661 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54e2298a-b38d-476d-bf9a-380c6deda498 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:31.295103 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54e2298a-b38d-476d-bf9a-380c6deda498 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:31.295839 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54e2298a-b38d-476d-bf9a-380c6deda498 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:31.296293 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54e2298a-b38d-476d-bf9a-380c6deda498 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:31.296708 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54e2298a-b38d-476d-bf9a-380c6deda498 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:31.530828 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-54e2298a-b38d-476d-bf9a-380c6deda498 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:31.543269 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-54e2298a-b38d-476d-bf9a-380c6deda498 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776" status: 200 len: 1540 microversion: 2.1 time: 0.264765 Oct 05 02:34:31.544538 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 867/1699] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:31 2022] GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776 => generated 1540 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:31.705535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f85bf2f3-78ff-4475-9a55-8f5b487be5fe tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:31.706168 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f85bf2f3-78ff-4475-9a55-8f5b487be5fe tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:31.733046 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f85bf2f3-78ff-4475-9a55-8f5b487be5fe tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:31.733857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f85bf2f3-78ff-4475-9a55-8f5b487be5fe tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:31.734478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f85bf2f3-78ff-4475-9a55-8f5b487be5fe tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:31.735390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f85bf2f3-78ff-4475-9a55-8f5b487be5fe tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:31.736605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f85bf2f3-78ff-4475-9a55-8f5b487be5fe tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:31.738461 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f85bf2f3-78ff-4475-9a55-8f5b487be5fe tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:32.017331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f85bf2f3-78ff-4475-9a55-8f5b487be5fe tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:32.030412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f85bf2f3-78ff-4475-9a55-8f5b487be5fe tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:32.031506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f85bf2f3-78ff-4475-9a55-8f5b487be5fe tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:32.040184 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f85bf2f3-78ff-4475-9a55-8f5b487be5fe tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1487 microversion: 2.25 time: 0.339945 Oct 05 02:34:32.054947 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 868/1700] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:31 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1487 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:34:32.067915 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-2761a43c-09a1-4a3c-b1f2-f4b4df40eeb8 req-cdc5b181-02b0-479a-b25e-82205b237d5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a786593b-2c6f-4bc5-b338-8715c7d0429f", "tag": "d0b44992-5d97-49da-98a0-6facb5cee1a2"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:32.091468 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-2761a43c-09a1-4a3c-b1f2-f4b4df40eeb8 req-cdc5b181-02b0-479a-b25e-82205b237d5e service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:32.091947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-2761a43c-09a1-4a3c-b1f2-f4b4df40eeb8 req-cdc5b181-02b0-479a-b25e-82205b237d5e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:32.092373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-2761a43c-09a1-4a3c-b1f2-f4b4df40eeb8 req-cdc5b181-02b0-479a-b25e-82205b237d5e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:32.117601 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-2761a43c-09a1-4a3c-b1f2-f4b4df40eeb8 req-cdc5b181-02b0-479a-b25e-82205b237d5e service nova] Creating event network-changed:d0b44992-5d97-49da-98a0-6facb5cee1a2 for instance a786593b-2c6f-4bc5-b338-8715c7d0429f on n-h1-858272-3 Oct 05 02:34:32.129736 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-2761a43c-09a1-4a3c-b1f2-f4b4df40eeb8 req-cdc5b181-02b0-479a-b25e-82205b237d5e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073289 Oct 05 02:34:32.135880 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 869/1701] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:34:32.141838 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d5209b26-4a56-4daf-85cf-131d1b8c0fea tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:32.142532 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d5209b26-4a56-4daf-85cf-131d1b8c0fea tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:32.163012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5209b26-4a56-4daf-85cf-131d1b8c0fea tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:32.163502 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5209b26-4a56-4daf-85cf-131d1b8c0fea tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:32.163948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5209b26-4a56-4daf-85cf-131d1b8c0fea tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:32.164654 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5209b26-4a56-4daf-85cf-131d1b8c0fea tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:32.165129 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5209b26-4a56-4daf-85cf-131d1b8c0fea tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:32.165701 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5209b26-4a56-4daf-85cf-131d1b8c0fea tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:32.643143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d5209b26-4a56-4daf-85cf-131d1b8c0fea tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:32.655694 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d5209b26-4a56-4daf-85cf-131d1b8c0fea tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:32.662215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d5209b26-4a56-4daf-85cf-131d1b8c0fea tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:32.663875 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d5209b26-4a56-4daf-85cf-131d1b8c0fea tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1739 microversion: 2.20 time: 0.526251 Oct 05 02:34:32.669282 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 870/1702] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:32 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1739 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:32.680936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cdf7c64f-2079-41e0-af2b-bed2a48b0ed2 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:32.681862 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cdf7c64f-2079-41e0-af2b-bed2a48b0ed2 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:32.690425 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdf7c64f-2079-41e0-af2b-bed2a48b0ed2 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:32.691203 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdf7c64f-2079-41e0-af2b-bed2a48b0ed2 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:32.691828 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdf7c64f-2079-41e0-af2b-bed2a48b0ed2 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:32.692724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdf7c64f-2079-41e0-af2b-bed2a48b0ed2 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:32.693373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdf7c64f-2079-41e0-af2b-bed2a48b0ed2 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:32.693968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdf7c64f-2079-41e0-af2b-bed2a48b0ed2 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:32.943232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cdf7c64f-2079-41e0-af2b-bed2a48b0ed2 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:32.954247 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cdf7c64f-2079-41e0-af2b-bed2a48b0ed2 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776" status: 200 len: 1540 microversion: 2.1 time: 0.284323 Oct 05 02:34:32.969657 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 871/1703] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:32 2022] GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776 => generated 1540 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:33.073531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f0e9ee9d-bfcd-45be-9411-bb2e2f985c13 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:33.075418 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f0e9ee9d-bfcd-45be-9411-bb2e2f985c13 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:33.085164 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0e9ee9d-bfcd-45be-9411-bb2e2f985c13 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:33.085987 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0e9ee9d-bfcd-45be-9411-bb2e2f985c13 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:33.086595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0e9ee9d-bfcd-45be-9411-bb2e2f985c13 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:33.087519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0e9ee9d-bfcd-45be-9411-bb2e2f985c13 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:33.088149 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0e9ee9d-bfcd-45be-9411-bb2e2f985c13 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:33.088735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0e9ee9d-bfcd-45be-9411-bb2e2f985c13 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:33.433045 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f0e9ee9d-bfcd-45be-9411-bb2e2f985c13 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:33.455031 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f0e9ee9d-bfcd-45be-9411-bb2e2f985c13 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:33.459590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f0e9ee9d-bfcd-45be-9411-bb2e2f985c13 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:33.459590 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f0e9ee9d-bfcd-45be-9411-bb2e2f985c13 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1487 microversion: 2.25 time: 0.390531 Oct 05 02:34:33.491710 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 872/1704] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:33 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1487 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:33.695042 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7f9906f6-e1f4-45ba-96c3-81364a539b5f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:33.697335 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7f9906f6-e1f4-45ba-96c3-81364a539b5f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:33.717008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f9906f6-e1f4-45ba-96c3-81364a539b5f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:33.719547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f9906f6-e1f4-45ba-96c3-81364a539b5f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:33.721941 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f9906f6-e1f4-45ba-96c3-81364a539b5f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:33.723229 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f9906f6-e1f4-45ba-96c3-81364a539b5f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:33.725334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f9906f6-e1f4-45ba-96c3-81364a539b5f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:33.725992 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f9906f6-e1f4-45ba-96c3-81364a539b5f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:33.998619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7f9906f6-e1f4-45ba-96c3-81364a539b5f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:34.027822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7f9906f6-e1f4-45ba-96c3-81364a539b5f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:34.031817 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7f9906f6-e1f4-45ba-96c3-81364a539b5f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:34.034672 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7f9906f6-e1f4-45ba-96c3-81364a539b5f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1739 microversion: 2.20 time: 0.344531 Oct 05 02:34:34.050519 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 873/1705] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:33 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1739 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:34.060670 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-db1b88c6-e09e-4b4d-9ed9-07d034cfd960 req-6d83ef67-529f-45fd-8f1f-7cbfac5b64c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed8c63c7-f728-4202-94b9-1b4a00fac776", "name": "network-vif-plugged", "status": "completed", "tag": "8ddd7686-11f0-4d1c-98d6-81965c576fd3"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:34.072157 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-db1b88c6-e09e-4b4d-9ed9-07d034cfd960 req-6d83ef67-529f-45fd-8f1f-7cbfac5b64c1 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:34.072658 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-db1b88c6-e09e-4b4d-9ed9-07d034cfd960 req-6d83ef67-529f-45fd-8f1f-7cbfac5b64c1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:34.073105 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-db1b88c6-e09e-4b4d-9ed9-07d034cfd960 req-6d83ef67-529f-45fd-8f1f-7cbfac5b64c1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:34.099495 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-db1b88c6-e09e-4b4d-9ed9-07d034cfd960 req-6d83ef67-529f-45fd-8f1f-7cbfac5b64c1 service nova] Creating event network-vif-plugged:8ddd7686-11f0-4d1c-98d6-81965c576fd3 for instance ed8c63c7-f728-4202-94b9-1b4a00fac776 on n-h1-858272-3 Oct 05 02:34:34.150049 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-db1b88c6-e09e-4b4d-9ed9-07d034cfd960 req-6d83ef67-529f-45fd-8f1f-7cbfac5b64c1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098032 Oct 05 02:34:34.153837 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 874/1706] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:34:34.172343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-02802740-e8d9-4e69-97a4-6771c63c5b9b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:34.175835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-02802740-e8d9-4e69-97a4-6771c63c5b9b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:34.187924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02802740-e8d9-4e69-97a4-6771c63c5b9b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:34.188722 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02802740-e8d9-4e69-97a4-6771c63c5b9b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:34.189417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02802740-e8d9-4e69-97a4-6771c63c5b9b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:34.190538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02802740-e8d9-4e69-97a4-6771c63c5b9b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:34.191861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02802740-e8d9-4e69-97a4-6771c63c5b9b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:34.192500 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02802740-e8d9-4e69-97a4-6771c63c5b9b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:34.409828 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-02802740-e8d9-4e69-97a4-6771c63c5b9b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:34.439203 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-02802740-e8d9-4e69-97a4-6771c63c5b9b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776" status: 200 len: 1535 microversion: 2.1 time: 0.280785 Oct 05 02:34:34.440523 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 875/1707] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:34 2022] GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776 => generated 1535 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:34.498274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-04f496a9-282c-43de-ad60-487ed7101077 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:34.499209 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-04f496a9-282c-43de-ad60-487ed7101077 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:34.505877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04f496a9-282c-43de-ad60-487ed7101077 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:34.506607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04f496a9-282c-43de-ad60-487ed7101077 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:34.507282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04f496a9-282c-43de-ad60-487ed7101077 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:34.508173 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04f496a9-282c-43de-ad60-487ed7101077 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:34.508850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04f496a9-282c-43de-ad60-487ed7101077 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:34.509530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04f496a9-282c-43de-ad60-487ed7101077 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:34.690323 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-04f496a9-282c-43de-ad60-487ed7101077 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:34.693730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:34:34.716472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-04f496a9-282c-43de-ad60-487ed7101077 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:34.717973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-04f496a9-282c-43de-ad60-487ed7101077 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:34.719154 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-04f496a9-282c-43de-ad60-487ed7101077 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1487 microversion: 2.25 time: 0.225727 Oct 05 02:34:34.719723 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 876/1708] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:34 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1487 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:34:34.756331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2d82b85d-7d48-4266-a5e2-8ec8a71c0c97 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce80f03a0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:34.897597 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3d16b1b6-ff39-49da-b421-81d8c454a55f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf" status: 200 len: 1414 microversion: 2.1 time: 7.145606 Oct 05 02:34:34.905804 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 833/1709] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:34:27 2022] GET /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf => generated 1414 bytes in 7155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:34.931796 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2d82b85d-7d48-4266-a5e2-8ec8a71c0c97 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/97437ce4-c141-4f25-b689-7c217fa6716e" status: 200 len: 661 microversion: 2.1 time: 0.179244 Oct 05 02:34:34.932662 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 877/1710] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:34:34 2022] GET /compute/v2.1/images/97437ce4-c141-4f25-b689-7c217fa6716e => generated 661 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:34:34.949280 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c6388b9a-7e3a-40ca-94d4-c79d636fa34a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce41b25e0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:35.003683 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c6388b9a-7e3a-40ca-94d4-c79d636fa34a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/97437ce4-c141-4f25-b689-7c217fa6716e" status: 200 len: 661 microversion: 2.1 time: 0.059005 Oct 05 02:34:35.004435 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 834/1711] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:34:34 2022] GET /compute/v2.1/images/97437ce4-c141-4f25-b689-7c217fa6716e => generated 661 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:34:35.064344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a623d261-b867-46dc-80eb-e94fb4b32e87 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:35.065012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a623d261-b867-46dc-80eb-e94fb4b32e87 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:35.080733 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a623d261-b867-46dc-80eb-e94fb4b32e87 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:35.081443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a623d261-b867-46dc-80eb-e94fb4b32e87 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:35.082360 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a623d261-b867-46dc-80eb-e94fb4b32e87 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:35.083503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a623d261-b867-46dc-80eb-e94fb4b32e87 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:35.088410 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a623d261-b867-46dc-80eb-e94fb4b32e87 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:35.089491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a623d261-b867-46dc-80eb-e94fb4b32e87 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:35.342513 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a623d261-b867-46dc-80eb-e94fb4b32e87 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:35.445133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a623d261-b867-46dc-80eb-e94fb4b32e87 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:35.446684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a623d261-b867-46dc-80eb-e94fb4b32e87 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:35.447923 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a623d261-b867-46dc-80eb-e94fb4b32e87 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1739 microversion: 2.20 time: 0.387620 Oct 05 02:34:35.448508 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 878/1712] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:35 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1739 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:35.475550 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-099efe4c-b60d-4cb8-91c1-9ca6f3d4fe7a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:35.476294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-099efe4c-b60d-4cb8-91c1-9ca6f3d4fe7a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:35.485666 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-099efe4c-b60d-4cb8-91c1-9ca6f3d4fe7a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:35.486132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-099efe4c-b60d-4cb8-91c1-9ca6f3d4fe7a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:35.486667 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-099efe4c-b60d-4cb8-91c1-9ca6f3d4fe7a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:35.487478 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-099efe4c-b60d-4cb8-91c1-9ca6f3d4fe7a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:35.488684 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-099efe4c-b60d-4cb8-91c1-9ca6f3d4fe7a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:35.489621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-099efe4c-b60d-4cb8-91c1-9ca6f3d4fe7a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:35.712295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-099efe4c-b60d-4cb8-91c1-9ca6f3d4fe7a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:35.735364 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-099efe4c-b60d-4cb8-91c1-9ca6f3d4fe7a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776" status: 200 len: 1522 microversion: 2.1 time: 0.262025 Oct 05 02:34:35.752523 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 835/1713] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:35 2022] GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:35.756462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-194fb2ec-f6f4-4aae-a93a-7c6189917d49 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:35.757453 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-194fb2ec-f6f4-4aae-a93a-7c6189917d49 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:35.765414 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-194fb2ec-f6f4-4aae-a93a-7c6189917d49 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:35.766192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-194fb2ec-f6f4-4aae-a93a-7c6189917d49 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:35.766840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-194fb2ec-f6f4-4aae-a93a-7c6189917d49 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:35.767832 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-194fb2ec-f6f4-4aae-a93a-7c6189917d49 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:35.768472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-194fb2ec-f6f4-4aae-a93a-7c6189917d49 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:35.769136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-194fb2ec-f6f4-4aae-a93a-7c6189917d49 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:35.776210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-94e5a5c5-1eff-4fdc-86e7-5d466e81adac tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:35.776744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-94e5a5c5-1eff-4fdc-86e7-5d466e81adac tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:35.792242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94e5a5c5-1eff-4fdc-86e7-5d466e81adac tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:35.794500 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94e5a5c5-1eff-4fdc-86e7-5d466e81adac tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:35.794961 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94e5a5c5-1eff-4fdc-86e7-5d466e81adac tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:35.796712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94e5a5c5-1eff-4fdc-86e7-5d466e81adac tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:35.797221 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94e5a5c5-1eff-4fdc-86e7-5d466e81adac tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:35.797642 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94e5a5c5-1eff-4fdc-86e7-5d466e81adac tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:35.832892 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-94e5a5c5-1eff-4fdc-86e7-5d466e81adac tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:34:35.928160 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:34:35.986699 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-94e5a5c5-1eff-4fdc-86e7-5d466e81adac tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776" status: 204 len: 0 microversion: 2.1 time: 0.221124 Oct 05 02:34:35.988587 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 836/1714] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:34:35 2022] DELETE /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:34:35.996872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a7f347f4-f486-4c22-9610-44ed1255ba8e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce41df040>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:36.063571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-194fb2ec-f6f4-4aae-a93a-7c6189917d49 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:36.080188 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a7f347f4-f486-4c22-9610-44ed1255ba8e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf" status: 200 len: 1414 microversion: 2.1 time: 0.087871 Oct 05 02:34:36.093086 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 837/1715] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:34:35 2022] GET /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf => generated 1414 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:36.094813 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-abdb254b-d514-4207-afae-486144ff25db tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:36.098066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-abdb254b-d514-4207-afae-486144ff25db tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:36.098262 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-194fb2ec-f6f4-4aae-a93a-7c6189917d49 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:36.104535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-194fb2ec-f6f4-4aae-a93a-7c6189917d49 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:36.113180 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abdb254b-d514-4207-afae-486144ff25db tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:36.113990 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abdb254b-d514-4207-afae-486144ff25db tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:36.114578 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abdb254b-d514-4207-afae-486144ff25db tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:36.114700 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-194fb2ec-f6f4-4aae-a93a-7c6189917d49 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1487 microversion: 2.25 time: 0.369844 Oct 05 02:34:36.115647 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abdb254b-d514-4207-afae-486144ff25db tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:36.118057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abdb254b-d514-4207-afae-486144ff25db tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:36.118604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abdb254b-d514-4207-afae-486144ff25db tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:36.118955 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 879/1716] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:35 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1487 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:36.310825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-abdb254b-d514-4207-afae-486144ff25db tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:36.321860 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-abdb254b-d514-4207-afae-486144ff25db tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776" status: 200 len: 1528 microversion: 2.1 time: 0.235341 Oct 05 02:34:36.323059 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 838/1717] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:36 2022] GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776 => generated 1528 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:36.478733 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7b9e0055-1520-4f0d-bb94-47516218fd1e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:36.481175 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7b9e0055-1520-4f0d-bb94-47516218fd1e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:36.498831 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7b9e0055-1520-4f0d-bb94-47516218fd1e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:36.502100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7b9e0055-1520-4f0d-bb94-47516218fd1e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:36.505378 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7b9e0055-1520-4f0d-bb94-47516218fd1e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:36.507989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7b9e0055-1520-4f0d-bb94-47516218fd1e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:36.509857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7b9e0055-1520-4f0d-bb94-47516218fd1e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:36.514017 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7b9e0055-1520-4f0d-bb94-47516218fd1e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:36.845699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3e47e287-dbf8-41fe-8889-bb707aa4cfab tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce828d9d0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:36.910226 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7b9e0055-1520-4f0d-bb94-47516218fd1e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:36.923131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7b9e0055-1520-4f0d-bb94-47516218fd1e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:36.925141 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7b9e0055-1520-4f0d-bb94-47516218fd1e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:36.926878 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3e47e287-dbf8-41fe-8889-bb707aa4cfab tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/69f572a5-9838-4baa-ae75-ade8a46a4f3d" status: 200 len: 662 microversion: 2.1 time: 0.086470 Oct 05 02:34:36.927834 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 839/1718] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:34:36 2022] GET /compute/v2.1/images/69f572a5-9838-4baa-ae75-ade8a46a4f3d => generated 662 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:34:36.928128 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7b9e0055-1520-4f0d-bb94-47516218fd1e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1721 microversion: 2.20 time: 0.452984 Oct 05 02:34:36.941212 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 880/1719] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:36 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1721 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:36.944952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-af468c7e-c85c-4382-8d1e-38bee11ae34f tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce41b2a60>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:37.002147 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-af468c7e-c85c-4382-8d1e-38bee11ae34f tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/69f572a5-9838-4baa-ae75-ade8a46a4f3d" status: 200 len: 662 microversion: 2.1 time: 0.062357 Oct 05 02:34:37.003485 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 840/1720] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:34:36 2022] GET /compute/v2.1/images/69f572a5-9838-4baa-ae75-ade8a46a4f3d => generated 662 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:34:37.102972 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0f904ffc-6f22-4a94-bbc9-864f24e4696e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce80f03a0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:37.152673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5654aa23-e8ff-4673-95c1-901edc5bd02a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:37.153764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5654aa23-e8ff-4673-95c1-901edc5bd02a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:37.160877 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5654aa23-e8ff-4673-95c1-901edc5bd02a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:37.161730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5654aa23-e8ff-4673-95c1-901edc5bd02a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:37.162371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5654aa23-e8ff-4673-95c1-901edc5bd02a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:37.163433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5654aa23-e8ff-4673-95c1-901edc5bd02a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:37.164104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5654aa23-e8ff-4673-95c1-901edc5bd02a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:37.164767 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5654aa23-e8ff-4673-95c1-901edc5bd02a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:37.199475 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0f904ffc-6f22-4a94-bbc9-864f24e4696e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf" status: 200 len: 1414 microversion: 2.1 time: 0.102220 Oct 05 02:34:37.199870 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 881/1721] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:34:37 2022] GET /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf => generated 1414 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:37.351282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-adfcff69-fae0-4bba-845e-cb8a4f8134cd tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:37.352168 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-adfcff69-fae0-4bba-845e-cb8a4f8134cd tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:37.362381 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-adfcff69-fae0-4bba-845e-cb8a4f8134cd tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:37.363202 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-adfcff69-fae0-4bba-845e-cb8a4f8134cd tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:37.363866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-adfcff69-fae0-4bba-845e-cb8a4f8134cd tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:37.364788 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-adfcff69-fae0-4bba-845e-cb8a4f8134cd tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:37.365506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-adfcff69-fae0-4bba-845e-cb8a4f8134cd tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:37.366153 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-adfcff69-fae0-4bba-845e-cb8a4f8134cd tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:37.396064 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5654aa23-e8ff-4673-95c1-901edc5bd02a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:37.410163 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5654aa23-e8ff-4673-95c1-901edc5bd02a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:37.416075 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5654aa23-e8ff-4673-95c1-901edc5bd02a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:37.421041 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5654aa23-e8ff-4673-95c1-901edc5bd02a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1487 microversion: 2.25 time: 0.273216 Oct 05 02:34:37.435369 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 841/1722] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:37 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1487 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:34:37.534077 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-0e582115-0da1-4b17-b091-bf611d951554 req-94dba50d-7a00-4e10-aeca-6bab17896ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed8c63c7-f728-4202-94b9-1b4a00fac776", "name": "network-vif-unplugged", "status": "completed", "tag": "8ddd7686-11f0-4d1c-98d6-81965c576fd3"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:37.561315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-0e582115-0da1-4b17-b091-bf611d951554 req-94dba50d-7a00-4e10-aeca-6bab17896ec1 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:37.561818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-0e582115-0da1-4b17-b091-bf611d951554 req-94dba50d-7a00-4e10-aeca-6bab17896ec1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:37.562251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-0e582115-0da1-4b17-b091-bf611d951554 req-94dba50d-7a00-4e10-aeca-6bab17896ec1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:37.581124 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-0e582115-0da1-4b17-b091-bf611d951554 req-94dba50d-7a00-4e10-aeca-6bab17896ec1 service nova] Creating event network-vif-unplugged:8ddd7686-11f0-4d1c-98d6-81965c576fd3 for instance ed8c63c7-f728-4202-94b9-1b4a00fac776 on n-h1-858272-3 Oct 05 02:34:37.587559 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-0e582115-0da1-4b17-b091-bf611d951554 req-94dba50d-7a00-4e10-aeca-6bab17896ec1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057334 Oct 05 02:34:37.589093 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 842/1723] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:34:37.796425 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-adfcff69-fae0-4bba-845e-cb8a4f8134cd tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:37.808956 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-adfcff69-fae0-4bba-845e-cb8a4f8134cd tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776" status: 200 len: 1528 microversion: 2.1 time: 0.461813 Oct 05 02:34:37.811333 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 882/1724] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:37 2022] GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776 => generated 1528 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:34:37.957370 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ebb66a48-7697-4146-88ac-45ce947e56c6 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:37.958783 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ebb66a48-7697-4146-88ac-45ce947e56c6 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:37.967672 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ebb66a48-7697-4146-88ac-45ce947e56c6 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:37.968591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ebb66a48-7697-4146-88ac-45ce947e56c6 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:37.969315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ebb66a48-7697-4146-88ac-45ce947e56c6 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:37.970395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ebb66a48-7697-4146-88ac-45ce947e56c6 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:37.971059 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ebb66a48-7697-4146-88ac-45ce947e56c6 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:37.971690 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ebb66a48-7697-4146-88ac-45ce947e56c6 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:38.215892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b43f19e8-4226-4d3f-b57b-9f32dc1ae7e8 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce816bb80>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:38.302066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ebb66a48-7697-4146-88ac-45ce947e56c6 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:38.312553 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ebb66a48-7697-4146-88ac-45ce947e56c6 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:38.317658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ebb66a48-7697-4146-88ac-45ce947e56c6 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:38.334531 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ebb66a48-7697-4146-88ac-45ce947e56c6 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1721 microversion: 2.20 time: 0.382173 Oct 05 02:34:38.335436 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 843/1725] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:37 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1721 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:38.460661 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-32831299-5232-4511-a7f0-e6c474ff691b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:38.469807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-32831299-5232-4511-a7f0-e6c474ff691b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:38.491238 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32831299-5232-4511-a7f0-e6c474ff691b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:38.497407 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32831299-5232-4511-a7f0-e6c474ff691b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:38.505704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32831299-5232-4511-a7f0-e6c474ff691b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:38.506803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32831299-5232-4511-a7f0-e6c474ff691b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:38.508338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32831299-5232-4511-a7f0-e6c474ff691b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:38.509357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32831299-5232-4511-a7f0-e6c474ff691b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:38.983000 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b43f19e8-4226-4d3f-b57b-9f32dc1ae7e8 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf" status: 200 len: 1414 microversion: 2.1 time: 0.771422 Oct 05 02:34:38.986161 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 883/1726] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:34:38 2022] GET /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf => generated 1414 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:34:39.002351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-32831299-5232-4511-a7f0-e6c474ff691b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:39.013435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8b0cf624-def6-42a0-9040-d5dc55afe828 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce80b0ca0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:39.017343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-32831299-5232-4511-a7f0-e6c474ff691b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:39.019920 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-32831299-5232-4511-a7f0-e6c474ff691b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:39.021861 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-32831299-5232-4511-a7f0-e6c474ff691b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1487 microversion: 2.25 time: 0.565114 Oct 05 02:34:39.023373 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 844/1727] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:38 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1487 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:39.031627 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a7a94a02-cda9-4f84-bcf4-0b1c6e081e2e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:39.035753 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a7a94a02-cda9-4f84-bcf4-0b1c6e081e2e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:39.044203 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a7a94a02-cda9-4f84-bcf4-0b1c6e081e2e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:39.045041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a7a94a02-cda9-4f84-bcf4-0b1c6e081e2e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:39.046053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a7a94a02-cda9-4f84-bcf4-0b1c6e081e2e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:39.046919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a7a94a02-cda9-4f84-bcf4-0b1c6e081e2e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:39.047755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a7a94a02-cda9-4f84-bcf4-0b1c6e081e2e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:39.048489 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a7a94a02-cda9-4f84-bcf4-0b1c6e081e2e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:39.134294 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8b0cf624-def6-42a0-9040-d5dc55afe828 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/b892f4a9-382e-4bbb-bc48-2a55461a2da9" status: 200 len: 660 microversion: 2.1 time: 0.143102 Oct 05 02:34:39.145309 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 884/1728] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:34:38 2022] GET /compute/v2.1/images/b892f4a9-382e-4bbb-bc48-2a55461a2da9 => generated 660 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:34:39.155563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-a30acd51-a808-41f7-9099-6f08893745d6 req-412239c3-a224-4915-8c25-379e4453ed50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed8c63c7-f728-4202-94b9-1b4a00fac776", "name": "network-vif-deleted", "tag": "8ddd7686-11f0-4d1c-98d6-81965c576fd3"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:39.214557 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a7a94a02-cda9-4f84-bcf4-0b1c6e081e2e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:39.221875 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a30acd51-a808-41f7-9099-6f08893745d6 req-412239c3-a224-4915-8c25-379e4453ed50 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:39.223069 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a30acd51-a808-41f7-9099-6f08893745d6 req-412239c3-a224-4915-8c25-379e4453ed50 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:39.223852 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a30acd51-a808-41f7-9099-6f08893745d6 req-412239c3-a224-4915-8c25-379e4453ed50 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:39.231031 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a7a94a02-cda9-4f84-bcf4-0b1c6e081e2e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776" status: 200 len: 1309 microversion: 2.1 time: 0.203583 Oct 05 02:34:39.233316 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 845/1729] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:39 2022] GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776 => generated 1309 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:39.247037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c3d7633c-a5bd-4894-ac03-6f49c817cbaa tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce41df790>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:39.255037 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-a30acd51-a808-41f7-9099-6f08893745d6 req-412239c3-a224-4915-8c25-379e4453ed50 service nova] Creating event network-vif-deleted:8ddd7686-11f0-4d1c-98d6-81965c576fd3 for instance ed8c63c7-f728-4202-94b9-1b4a00fac776 on n-h1-858272-3 Oct 05 02:34:39.261679 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-a30acd51-a808-41f7-9099-6f08893745d6 req-412239c3-a224-4915-8c25-379e4453ed50 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125366 Oct 05 02:34:39.263642 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 885/1730] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:34:39.313548 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c3d7633c-a5bd-4894-ac03-6f49c817cbaa tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/b892f4a9-382e-4bbb-bc48-2a55461a2da9" status: 200 len: 660 microversion: 2.1 time: 0.077776 Oct 05 02:34:39.315300 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 846/1731] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:34:39 2022] GET /compute/v2.1/images/b892f4a9-382e-4bbb-bc48-2a55461a2da9 => generated 660 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:34:39.365828 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-97c61392-e3fe-471d-baaa-02a5886f5319 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:39.366678 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-97c61392-e3fe-471d-baaa-02a5886f5319 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:39.374340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-97c61392-e3fe-471d-baaa-02a5886f5319 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:39.376977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-97c61392-e3fe-471d-baaa-02a5886f5319 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:39.377831 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-97c61392-e3fe-471d-baaa-02a5886f5319 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:39.378814 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-97c61392-e3fe-471d-baaa-02a5886f5319 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:39.379529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-97c61392-e3fe-471d-baaa-02a5886f5319 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:39.380833 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-97c61392-e3fe-471d-baaa-02a5886f5319 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:39.410012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-894d365b-8b9e-4a2a-bb04-6befd3a1e327 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-2099879517", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:39.500438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-894d365b-8b9e-4a2a-bb04-6befd3a1e327 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] validate_networks() for None {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:34:39.712041 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-97c61392-e3fe-471d-baaa-02a5886f5319 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:39.727823 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-97c61392-e3fe-471d-baaa-02a5886f5319 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:39.758003 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-97c61392-e3fe-471d-baaa-02a5886f5319 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:39.767151 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-97c61392-e3fe-471d-baaa-02a5886f5319 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1724 microversion: 2.20 time: 0.405616 Oct 05 02:34:39.788504 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 886/1732] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:39 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1724 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:39.814135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c3845c56-c6c6-4a20-8fef-57eaba9129b0 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8880aa0a-d2ce-4492-b800-e66f925f235a"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:39.817896 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c3845c56-c6c6-4a20-8fef-57eaba9129b0 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:39.852966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3845c56-c6c6-4a20-8fef-57eaba9129b0 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:39.853099 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3845c56-c6c6-4a20-8fef-57eaba9129b0 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:39.855837 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3845c56-c6c6-4a20-8fef-57eaba9129b0 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:39.856714 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3845c56-c6c6-4a20-8fef-57eaba9129b0 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:39.859944 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3845c56-c6c6-4a20-8fef-57eaba9129b0 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:39.860535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3845c56-c6c6-4a20-8fef-57eaba9129b0 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:39.861602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-894d365b-8b9e-4a2a-bb04-6befd3a1e327 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:34:39.862351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-894d365b-8b9e-4a2a-bb04-6befd3a1e327 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:34:39.863371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-894d365b-8b9e-4a2a-bb04-6befd3a1e327 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:34:39.863953 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-894d365b-8b9e-4a2a-bb04-6befd3a1e327 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:34:39.864533 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-894d365b-8b9e-4a2a-bb04-6befd3a1e327 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:34:39.878423 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-894d365b-8b9e-4a2a-bb04-6befd3a1e327 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:39.879147 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-894d365b-8b9e-4a2a-bb04-6befd3a1e327 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:39.880070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-894d365b-8b9e-4a2a-bb04-6befd3a1e327 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:39.881042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-894d365b-8b9e-4a2a-bb04-6befd3a1e327 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:39.881780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-894d365b-8b9e-4a2a-bb04-6befd3a1e327 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:39.882396 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-894d365b-8b9e-4a2a-bb04-6befd3a1e327 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:39.922999 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-894d365b-8b9e-4a2a-bb04-6befd3a1e327 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Getting quotas for project 7719a3153f66484c8758bb0999719851. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:34:39.929149 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-894d365b-8b9e-4a2a-bb04-6befd3a1e327 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Getting quotas for user f551e15d65a34daaac2b4d4f5963c522 and project 7719a3153f66484c8758bb0999719851. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:34:39.943479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-894d365b-8b9e-4a2a-bb04-6befd3a1e327 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:34:39.946057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-894d365b-8b9e-4a2a-bb04-6befd3a1e327 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: e123bb72-45c5-4371-bf2e-f0747497f16b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:34:40.045961 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-894d365b-8b9e-4a2a-bb04-6befd3a1e327 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.641422 Oct 05 02:34:40.049248 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 847/1733] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:34:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:34:40.091767 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-395719b8-a435-4874-a4d8-3b7174f4d7a0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce41b21f0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:40.187648 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-395719b8-a435-4874-a4d8-3b7174f4d7a0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf" status: 200 len: 1414 microversion: 2.1 time: 0.135790 Oct 05 02:34:40.188518 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 848/1734] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:34:40 2022] GET /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf => generated 1414 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:40.200581 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ab169240-0b7d-4de2-9f17-8202f8e9ddd4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:40.202144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ab169240-0b7d-4de2-9f17-8202f8e9ddd4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:40.225170 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab169240-0b7d-4de2-9f17-8202f8e9ddd4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:40.231712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab169240-0b7d-4de2-9f17-8202f8e9ddd4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:40.232624 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab169240-0b7d-4de2-9f17-8202f8e9ddd4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:40.233455 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab169240-0b7d-4de2-9f17-8202f8e9ddd4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:40.234161 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab169240-0b7d-4de2-9f17-8202f8e9ddd4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:40.234795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab169240-0b7d-4de2-9f17-8202f8e9ddd4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:40.575202 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c3845c56-c6c6-4a20-8fef-57eaba9129b0 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "POST /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.765630 Oct 05 02:34:40.576054 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 887/1735] 10.222.0.16 () {62 vars in 1364 bytes} [Wed Oct 5 02:34:39 2022] POST /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d/os-volume_attachments => generated 188 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:34:40.576874 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ab169240-0b7d-4de2-9f17-8202f8e9ddd4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:40.586978 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2e80f9cf-8b3b-40e9-a571-32ec2ae2cbf0 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-460810428", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:40.589040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ab169240-0b7d-4de2-9f17-8202f8e9ddd4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:40.590512 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ab169240-0b7d-4de2-9f17-8202f8e9ddd4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:40.591970 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ab169240-0b7d-4de2-9f17-8202f8e9ddd4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1487 microversion: 2.25 time: 0.396728 Oct 05 02:34:40.592887 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 849/1736] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:40 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1487 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:40.619308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bdccc31e-e4ef-436c-a2f8-781892063482 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:40.627274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bdccc31e-e4ef-436c-a2f8-781892063482 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:40.644421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bdccc31e-e4ef-436c-a2f8-781892063482 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:40.658316 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bdccc31e-e4ef-436c-a2f8-781892063482 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:40.659045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bdccc31e-e4ef-436c-a2f8-781892063482 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:40.660152 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bdccc31e-e4ef-436c-a2f8-781892063482 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:40.667049 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bdccc31e-e4ef-436c-a2f8-781892063482 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:40.670283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bdccc31e-e4ef-436c-a2f8-781892063482 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:40.692054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-2e80f9cf-8b3b-40e9-a571-32ec2ae2cbf0 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] validate_networks() for None {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:34:40.700197 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-bdccc31e-e4ef-436c-a2f8-781892063482 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] HTTP exception thrown: Instance ed8c63c7-f728-4202-94b9-1b4a00fac776 could not be found. Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bdccc31e-e4ef-436c-a2f8-781892063482 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Request method failure captured: Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776 HTTP/1.1 Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO0XYeg8tqT8ongEAJOwqXQnTLTHZzTVGNp07qyK2Im6Pk37xE9_000kJ-ghGlg1M4xDfFZdh80YSHVWWaKUqSxFWQ_Csj3K04E3ui1EPC1OYFRpRVpFWUIW6dnDr0Kom0Z5CM2HBG5dMHahqKQPxztoTXPVRWZPXtn1QZY0a3PPLGY Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 47098be734b14277a4d9a9d6b8464998 Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_47098be734b14277a4d9a9d6b8464998"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 47098be734b14277a4d9a9d6b8464998 Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ImagesOneServerNegativeTestJSON-1772902756-project Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 4c441be8c87648bf9f1ff5cd4aff2532 Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756-project Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance ed8c63c7-f728-4202-94b9-1b4a00fac776 could not be found. Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'ed8c63c7-f728-4202-94b9-1b4a00fac776'} Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed8c63c7-f728-4202-94b9-1b4a00fac776 could not be found. Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed8c63c7-f728-4202-94b9-1b4a00fac776 could not be found. Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:34:40.706875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:34:40.712945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:34:40.712945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:34:40.712945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:34:40.712945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:34:40.712945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:34:40.712945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:34:40.712945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed8c63c7-f728-4202-94b9-1b4a00fac776 could not be found. Oct 05 02:34:40.712945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:34:40.716113 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bdccc31e-e4ef-436c-a2f8-781892063482 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Returning 404 to user: Instance ed8c63c7-f728-4202-94b9-1b4a00fac776 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:34:40.717255 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bdccc31e-e4ef-436c-a2f8-781892063482 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776" status: 404 len: 111 microversion: 2.1 time: 0.123411 Oct 05 02:34:40.725658 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 850/1737] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:40 2022] GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:34:40.732505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-d02e2164-8e4f-4afc-84a6-86e27829e55a req-1887e074-f044-465f-b4a5-a3daaf419ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a28c6ea-5b3d-4f74-b490-8effa4fa813d", "name": "network-vif-unplugged", "status": "completed", "tag": "9902bd06-5ff4-4749-a5aa-d4afd71ba732"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:40.744059 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d02e2164-8e4f-4afc-84a6-86e27829e55a req-1887e074-f044-465f-b4a5-a3daaf419ed9 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:40.745957 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d02e2164-8e4f-4afc-84a6-86e27829e55a req-1887e074-f044-465f-b4a5-a3daaf419ed9 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:40.747105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d02e2164-8e4f-4afc-84a6-86e27829e55a req-1887e074-f044-465f-b4a5-a3daaf419ed9 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:40.761750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.compute.server_external_events [req-d02e2164-8e4f-4afc-84a6-86e27829e55a req-1887e074-f044-465f-b4a5-a3daaf419ed9 service nova] Unable to find a host for instance 7a28c6ea-5b3d-4f74-b490-8effa4fa813d. Dropping event network-vif-unplugged {{(pid=122319) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 05 02:34:40.763357 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-d02e2164-8e4f-4afc-84a6-86e27829e55a req-1887e074-f044-465f-b4a5-a3daaf419ed9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036153 Oct 05 02:34:40.771206 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 851/1738] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 45 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 05 02:34:40.781843 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a6a4448c-2495-4b81-a3c5-a5b0d1eb601d tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Action: 'create', calling method: .version_select at 0x7fcce828dee0>, body: {"keypair": {"name": "tempest-keypair-1950295311", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4iu8ACBSLq07c/7SEVsATKGFOJFzwLsRNdHyJetSmX7vkzq/Vp2fftiJPbwndpbwK/buZ+WCvjDkkPZtej3ZEqISrXw248bZKBZviF/Qqz/4zFC83DWVJMn5CrKOUCmA=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:40.823576 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-a6a4448c-2495-4b81-a3c5-a5b0d1eb601d tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Getting quotas for project 47098be734b14277a4d9a9d6b8464998. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:34:40.852979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-a6a4448c-2495-4b81-a3c5-a5b0d1eb601d tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Getting quotas for user 4c441be8c87648bf9f1ff5cd4aff2532 and project 47098be734b14277a4d9a9d6b8464998. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:34:40.894709 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a6a4448c-2495-4b81-a3c5-a5b0d1eb601d tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.122292 Oct 05 02:34:40.903112 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 852/1739] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 02:34:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:34:40.910793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4fcc24c9-ab21-456d-8faf-fe6221a2fc81 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:40.911565 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4fcc24c9-ab21-456d-8faf-fe6221a2fc81 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:40.929020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4fcc24c9-ab21-456d-8faf-fe6221a2fc81 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:40.929838 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4fcc24c9-ab21-456d-8faf-fe6221a2fc81 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:40.930363 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4fcc24c9-ab21-456d-8faf-fe6221a2fc81 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:40.931325 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4fcc24c9-ab21-456d-8faf-fe6221a2fc81 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:40.931976 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4fcc24c9-ab21-456d-8faf-fe6221a2fc81 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:40.932668 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4fcc24c9-ab21-456d-8faf-fe6221a2fc81 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:41.076469 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:34:41.081307 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4fcc24c9-ab21-456d-8faf-fe6221a2fc81 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122319) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 05 02:34:41.327600 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4fcc24c9-ab21-456d-8faf-fe6221a2fc81 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "POST /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d/action" status: 202 len: 0 microversion: 2.20 time: 0.427304 Oct 05 02:34:41.329790 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 853/1740] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 5 02:34:40 2022] POST /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d/action => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:34:41.343749 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-2e80f9cf-8b3b-40e9-a571-32ec2ae2cbf0 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:34:41.344694 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-2e80f9cf-8b3b-40e9-a571-32ec2ae2cbf0 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:34:41.345212 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-2e80f9cf-8b3b-40e9-a571-32ec2ae2cbf0 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:34:41.345861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-2e80f9cf-8b3b-40e9-a571-32ec2ae2cbf0 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:34:41.346417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-2e80f9cf-8b3b-40e9-a571-32ec2ae2cbf0 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:34:41.358594 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d960c21b-1e5c-4e8d-934c-29260dbb495f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce428be50>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:41.376559 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2e80f9cf-8b3b-40e9-a571-32ec2ae2cbf0 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:41.378042 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2e80f9cf-8b3b-40e9-a571-32ec2ae2cbf0 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:41.396677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2e80f9cf-8b3b-40e9-a571-32ec2ae2cbf0 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:41.399539 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2e80f9cf-8b3b-40e9-a571-32ec2ae2cbf0 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:41.400268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2e80f9cf-8b3b-40e9-a571-32ec2ae2cbf0 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:41.402832 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2e80f9cf-8b3b-40e9-a571-32ec2ae2cbf0 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:41.489932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-2e80f9cf-8b3b-40e9-a571-32ec2ae2cbf0 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Getting quotas for project 7719a3153f66484c8758bb0999719851. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:34:41.496333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-2e80f9cf-8b3b-40e9-a571-32ec2ae2cbf0 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Getting quotas for user f551e15d65a34daaac2b4d4f5963c522 and project 7719a3153f66484c8758bb0999719851. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:34:41.535975 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d960c21b-1e5c-4e8d-934c-29260dbb495f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf" status: 200 len: 1414 microversion: 2.1 time: 0.206625 Oct 05 02:34:41.539027 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 854/1741] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:34:41 2022] GET /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf => generated 1414 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:41.548127 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2e80f9cf-8b3b-40e9-a571-32ec2ae2cbf0 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:34:41.570227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2e80f9cf-8b3b-40e9-a571-32ec2ae2cbf0 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: 7b30cf01-6bc7-453f-b9f2-98400bcfc063] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:34:41.581377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-003010d2-5ea2-44b4-98fb-e831c88b95f4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:41.601342 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-003010d2-5ea2-44b4-98fb-e831c88b95f4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:41.637511 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-003010d2-5ea2-44b4-98fb-e831c88b95f4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:41.637844 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-003010d2-5ea2-44b4-98fb-e831c88b95f4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:41.638193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-003010d2-5ea2-44b4-98fb-e831c88b95f4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:41.638949 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-003010d2-5ea2-44b4-98fb-e831c88b95f4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:41.639414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-003010d2-5ea2-44b4-98fb-e831c88b95f4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:41.639843 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-003010d2-5ea2-44b4-98fb-e831c88b95f4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:41.798786 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2e80f9cf-8b3b-40e9-a571-32ec2ae2cbf0 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.221505 Oct 05 02:34:41.802007 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 888/1742] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:34:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1225 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:34:41.833535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9c6b621f-7eee-45bf-8aee-338decd248e1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:41.853926 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9c6b621f-7eee-45bf-8aee-338decd248e1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:41.864191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9c6b621f-7eee-45bf-8aee-338decd248e1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:41.864717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9c6b621f-7eee-45bf-8aee-338decd248e1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:41.865429 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9c6b621f-7eee-45bf-8aee-338decd248e1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:41.866419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9c6b621f-7eee-45bf-8aee-338decd248e1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:41.867106 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9c6b621f-7eee-45bf-8aee-338decd248e1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:41.867730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9c6b621f-7eee-45bf-8aee-338decd248e1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:42.514068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9c6b621f-7eee-45bf-8aee-338decd248e1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:42.540302 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-003010d2-5ea2-44b4-98fb-e831c88b95f4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:42.552377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-003010d2-5ea2-44b4-98fb-e831c88b95f4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:42.560447 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9c6b621f-7eee-45bf-8aee-338decd248e1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:42.565119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9c6b621f-7eee-45bf-8aee-338decd248e1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:42.566460 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9c6b621f-7eee-45bf-8aee-338decd248e1 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1477 microversion: 2.25 time: 0.743484 Oct 05 02:34:42.567091 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 889/1743] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:41 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1477 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:42.575022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-003010d2-5ea2-44b4-98fb-e831c88b95f4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:42.581225 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-003010d2-5ea2-44b4-98fb-e831c88b95f4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1750 microversion: 2.20 time: 1.035408 Oct 05 02:34:42.587557 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 855/1744] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:41 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1750 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:42.594100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-19496f9b-ebec-4ff6-a7a0-ffa0f38a5847 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:42.607615 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-091ccfa6-7045-43d3-af83-f3f5295e92c7 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce828ddc0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:42.613294 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-19496f9b-ebec-4ff6-a7a0-ffa0f38a5847 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: 7b30cf01-6bc7-453f-b9f2-98400bcfc063] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:42.814515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-19496f9b-ebec-4ff6-a7a0-ffa0f38a5847 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f551e15d65a34daaac2b4d4f5963c522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7719a3153f66484c8758bb0999719851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:42.828107 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-091ccfa6-7045-43d3-af83-f3f5295e92c7 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf" status: 200 len: 1414 microversion: 2.1 time: 0.237928 Oct 05 02:34:42.829617 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 856/1745] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:34:42 2022] GET /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf => generated 1414 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:42.840974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6eb03dd9-f460-4397-a8ef-8bd70f98c8ff tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Calling method '.version_select at 0x7fcce828d0d0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:42.844214 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-19496f9b-ebec-4ff6-a7a0-ffa0f38a5847 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063" status: 200 len: 1217 microversion: 2.1 time: 0.276010 Oct 05 02:34:42.845479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6eb03dd9-f460-4397-a8ef-8bd70f98c8ff tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:42.846261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6eb03dd9-f460-4397-a8ef-8bd70f98c8ff tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:42.846925 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6eb03dd9-f460-4397-a8ef-8bd70f98c8ff tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:42.849677 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 890/1746] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:42 2022] GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063 => generated 1217 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:42.881233 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6eb03dd9-f460-4397-a8ef-8bd70f98c8ff tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 3200 microversion: 2.25 time: 0.049960 Oct 05 02:34:42.883262 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 857/1747] 10.222.0.16 () {60 vars in 1184 bytes} [Wed Oct 5 02:34:42 2022] GET /compute/v2.1/os-migrations => generated 3200 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:42.907369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2cb3a9b1-dc63-4e5c-b92c-fa6883e5e303 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:42.908037 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2cb3a9b1-dc63-4e5c-b92c-fa6883e5e303 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:42.945184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cb3a9b1-dc63-4e5c-b92c-fa6883e5e303 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:42.945689 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cb3a9b1-dc63-4e5c-b92c-fa6883e5e303 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:42.946135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cb3a9b1-dc63-4e5c-b92c-fa6883e5e303 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:42.946880 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cb3a9b1-dc63-4e5c-b92c-fa6883e5e303 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:42.947339 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cb3a9b1-dc63-4e5c-b92c-fa6883e5e303 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:42.947762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cb3a9b1-dc63-4e5c-b92c-fa6883e5e303 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:43.446931 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-2cb3a9b1-dc63-4e5c-b92c-fa6883e5e303 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] Lazy-loading 'services' on Instance uuid a786593b-2c6f-4bc5-b338-8715c7d0429f {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:34:43.503755 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2cb3a9b1-dc63-4e5c-b92c-fa6883e5e303 tempest-LiveAutoBlockMigrationV225Test-340400538 tempest-LiveAutoBlockMigrationV225Test-340400538-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1969 microversion: 2.25 time: 0.604401 Oct 05 02:34:43.575907 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 891/1748] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:42 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1969 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:43.578211 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2c719040-fa16-4004-92b9-45296595789a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:43.578744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2c719040-fa16-4004-92b9-45296595789a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:43.595950 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c719040-fa16-4004-92b9-45296595789a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:43.600698 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c719040-fa16-4004-92b9-45296595789a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:43.603021 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c719040-fa16-4004-92b9-45296595789a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:43.606147 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c719040-fa16-4004-92b9-45296595789a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:43.608685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c719040-fa16-4004-92b9-45296595789a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:43.613437 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c719040-fa16-4004-92b9-45296595789a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:43.619821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a67881ac-66be-4002-aac8-fbdc5415a65d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:43.621355 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a67881ac-66be-4002-aac8-fbdc5415a65d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:43.634579 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a67881ac-66be-4002-aac8-fbdc5415a65d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:43.637390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a67881ac-66be-4002-aac8-fbdc5415a65d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:43.639309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a67881ac-66be-4002-aac8-fbdc5415a65d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:43.642472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a67881ac-66be-4002-aac8-fbdc5415a65d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:43.645590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a67881ac-66be-4002-aac8-fbdc5415a65d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:43.647659 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a67881ac-66be-4002-aac8-fbdc5415a65d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:43.710893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2c719040-fa16-4004-92b9-45296595789a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:34:43.885305 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2c719040-fa16-4004-92b9-45296595789a tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 204 len: 0 microversion: 2.25 time: 0.312988 Oct 05 02:34:43.886834 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 858/1749] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 5 02:34:43 2022] DELETE /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 05 02:34:43.893322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-657ebc38-bbec-4db4-ab66-980cbb98673b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce41b25e0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:43.976401 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-657ebc38-bbec-4db4-ab66-980cbb98673b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf" status: 200 len: 1414 microversion: 2.1 time: 0.088090 Oct 05 02:34:43.977026 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 859/1750] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:34:43 2022] GET /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf => generated 1414 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:43.992957 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1ae614d5-f3fa-4117-8b26-3fee0087aa64 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:43.997011 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1ae614d5-f3fa-4117-8b26-3fee0087aa64 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: 7b30cf01-6bc7-453f-b9f2-98400bcfc063] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:44.019939 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ae614d5-f3fa-4117-8b26-3fee0087aa64 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:44.020638 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ae614d5-f3fa-4117-8b26-3fee0087aa64 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:44.021648 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ae614d5-f3fa-4117-8b26-3fee0087aa64 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:44.022848 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ae614d5-f3fa-4117-8b26-3fee0087aa64 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:44.023486 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ae614d5-f3fa-4117-8b26-3fee0087aa64 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:44.024077 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ae614d5-f3fa-4117-8b26-3fee0087aa64 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:44.227168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1ae614d5-f3fa-4117-8b26-3fee0087aa64 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f551e15d65a34daaac2b4d4f5963c522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7719a3153f66484c8758bb0999719851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:44.240447 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1ae614d5-f3fa-4117-8b26-3fee0087aa64 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063" status: 200 len: 1213 microversion: 2.1 time: 0.262359 Oct 05 02:34:44.243901 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a67881ac-66be-4002-aac8-fbdc5415a65d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:44.247658 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 860/1751] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:43 2022] GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063 => generated 1213 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:44.257536 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a67881ac-66be-4002-aac8-fbdc5415a65d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:44.262270 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a67881ac-66be-4002-aac8-fbdc5415a65d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:44.264054 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a67881ac-66be-4002-aac8-fbdc5415a65d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1750 microversion: 2.20 time: 0.649351 Oct 05 02:34:44.265730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a8d83522-ee60-49ed-ab3e-b5cdb3f0c1b4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:44.267034 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 892/1752] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:43 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1750 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:44.270799 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a8d83522-ee60-49ed-ab3e-b5cdb3f0c1b4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:44.304766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8d83522-ee60-49ed-ab3e-b5cdb3f0c1b4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:44.309219 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8d83522-ee60-49ed-ab3e-b5cdb3f0c1b4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:44.309858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8d83522-ee60-49ed-ab3e-b5cdb3f0c1b4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:44.312752 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8d83522-ee60-49ed-ab3e-b5cdb3f0c1b4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:44.313254 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8d83522-ee60-49ed-ab3e-b5cdb3f0c1b4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:44.313692 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8d83522-ee60-49ed-ab3e-b5cdb3f0c1b4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:44.584165 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a8d83522-ee60-49ed-ab3e-b5cdb3f0c1b4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:44.596148 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a8d83522-ee60-49ed-ab3e-b5cdb3f0c1b4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:44.600894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a8d83522-ee60-49ed-ab3e-b5cdb3f0c1b4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:44.603137 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a8d83522-ee60-49ed-ab3e-b5cdb3f0c1b4 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1483 microversion: 2.25 time: 0.354162 Oct 05 02:34:44.605633 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 861/1753] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:44 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1483 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:44.995243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-90c9c489-8302-404c-beec-7f217ae4e3c9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce80b8550>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:45.068131 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-90c9c489-8302-404c-beec-7f217ae4e3c9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf" status: 200 len: 1423 microversion: 2.1 time: 0.078102 Oct 05 02:34:45.068982 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 893/1754] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:34:44 2022] GET /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf => generated 1423 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:45.084662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-28005f49-8a1a-4e31-bf83-445c7635243e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce8282820>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:45.162362 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-28005f49-8a1a-4e31-bf83-445c7635243e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf" status: 200 len: 1423 microversion: 2.1 time: 0.083142 Oct 05 02:34:45.162958 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 862/1755] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:34:45 2022] GET /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf => generated 1423 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:45.177542 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7bbc0fc6-1b58-47a3-80cd-43bbc6c7461d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce816b8b0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:45.271401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-896faa96-d78e-4c1c-b4f0-20b6250c10f4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:45.272016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-896faa96-d78e-4c1c-b4f0-20b6250c10f4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: 7b30cf01-6bc7-453f-b9f2-98400bcfc063] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:45.293549 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-896faa96-d78e-4c1c-b4f0-20b6250c10f4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:45.295928 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-896faa96-d78e-4c1c-b4f0-20b6250c10f4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:45.296414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-896faa96-d78e-4c1c-b4f0-20b6250c10f4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:45.297184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-896faa96-d78e-4c1c-b4f0-20b6250c10f4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:45.297648 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-896faa96-d78e-4c1c-b4f0-20b6250c10f4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:45.298077 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-896faa96-d78e-4c1c-b4f0-20b6250c10f4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:45.412098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-896faa96-d78e-4c1c-b4f0-20b6250c10f4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f551e15d65a34daaac2b4d4f5963c522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7719a3153f66484c8758bb0999719851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:45.423056 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-896faa96-d78e-4c1c-b4f0-20b6250c10f4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063" status: 200 len: 1269 microversion: 2.1 time: 0.155360 Oct 05 02:34:45.446765 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 863/1756] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:45 2022] GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063 => generated 1269 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:34:45.457156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c3d2b798-63d1-444f-841c-c232ad0bc3c3 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:45.458268 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c3d2b798-63d1-444f-841c-c232ad0bc3c3 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:45.468834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3d2b798-63d1-444f-841c-c232ad0bc3c3 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:45.469553 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3d2b798-63d1-444f-841c-c232ad0bc3c3 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:45.470475 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3d2b798-63d1-444f-841c-c232ad0bc3c3 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:45.471562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3d2b798-63d1-444f-841c-c232ad0bc3c3 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:45.473553 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3d2b798-63d1-444f-841c-c232ad0bc3c3 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:45.474748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3d2b798-63d1-444f-841c-c232ad0bc3c3 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:45.503311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:34:45.751482 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c3d2b798-63d1-444f-841c-c232ad0bc3c3 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:45.786641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c3d2b798-63d1-444f-841c-c232ad0bc3c3 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:45.796829 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c3d2b798-63d1-444f-841c-c232ad0bc3c3 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:45.800395 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c3d2b798-63d1-444f-841c-c232ad0bc3c3 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1752 microversion: 2.20 time: 0.351981 Oct 05 02:34:45.803272 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 864/1757] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:45 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1752 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:45.850913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-74b8f00d-a007-41a5-937a-4baf65298598 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:45.851539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-74b8f00d-a007-41a5-937a-4baf65298598 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:45.859375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74b8f00d-a007-41a5-937a-4baf65298598 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:45.859872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74b8f00d-a007-41a5-937a-4baf65298598 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:45.860324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74b8f00d-a007-41a5-937a-4baf65298598 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:45.861043 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74b8f00d-a007-41a5-937a-4baf65298598 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:45.861525 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74b8f00d-a007-41a5-937a-4baf65298598 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:45.861919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74b8f00d-a007-41a5-937a-4baf65298598 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:45.925310 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7bbc0fc6-1b58-47a3-80cd-43bbc6c7461d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "DELETE /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf" status: 204 len: 0 microversion: 2.1 time: 0.751492 Oct 05 02:34:45.925997 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 894/1758] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:45 2022] DELETE /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf => generated 0 bytes in 753 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:34:45.931101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-feb99f5c-eed5-441c-a966-9d77ceed9e23 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2077991581", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "eeab81fe-da30-46f9-87be-0b6dd3f4b67b"}], "block_device_mapping_v2": [{"uuid": "bd793995-e6eb-4b51-a261-26397eee3021", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:46.044475 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-74b8f00d-a007-41a5-937a-4baf65298598 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:46.044863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-feb99f5c-eed5-441c-a966-9d77ceed9e23 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] validate_networks() for [('eeab81fe-da30-46f9-87be-0b6dd3f4b67b', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:34:46.056455 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-74b8f00d-a007-41a5-937a-4baf65298598 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:46.060962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-74b8f00d-a007-41a5-937a-4baf65298598 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:46.066340 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-74b8f00d-a007-41a5-937a-4baf65298598 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1483 microversion: 2.25 time: 0.260867 Oct 05 02:34:46.067597 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 865/1759] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:45 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1483 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:46.073248 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-81867e2a-7884-44d4-a882-40b0df4c4bea tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:46.074423 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-81867e2a-7884-44d4-a882-40b0df4c4bea tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:46.082002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81867e2a-7884-44d4-a882-40b0df4c4bea tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:46.082689 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81867e2a-7884-44d4-a882-40b0df4c4bea tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:46.084375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81867e2a-7884-44d4-a882-40b0df4c4bea tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:46.085528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81867e2a-7884-44d4-a882-40b0df4c4bea tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:46.086186 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81867e2a-7884-44d4-a882-40b0df4c4bea tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:46.086762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81867e2a-7884-44d4-a882-40b0df4c4bea tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:46.119693 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-81867e2a-7884-44d4-a882-40b0df4c4bea tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:34:46.247451 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-81867e2a-7884-44d4-a882-40b0df4c4bea tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "DELETE /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 204 len: 0 microversion: 2.1 time: 0.178086 Oct 05 02:34:46.249578 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 866/1760] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:34:46 2022] DELETE /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:34:46.437204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e9f4285b-359e-4393-b236-568885786682 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1326513415", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:46.543232 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-e9f4285b-359e-4393-b236-568885786682 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] validate_networks() for [('3003c70e-e5f1-4423-9bef-5932f599e8ba', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:34:47.107250 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-feb99f5c-eed5-441c-a966-9d77ceed9e23 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:34:47.109850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-feb99f5c-eed5-441c-a966-9d77ceed9e23 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:34:47.110549 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-feb99f5c-eed5-441c-a966-9d77ceed9e23 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:34:47.111128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-feb99f5c-eed5-441c-a966-9d77ceed9e23 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:34:47.111720 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-feb99f5c-eed5-441c-a966-9d77ceed9e23 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:34:47.130663 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-feb99f5c-eed5-441c-a966-9d77ceed9e23 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:47.135664 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-feb99f5c-eed5-441c-a966-9d77ceed9e23 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:47.139094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-feb99f5c-eed5-441c-a966-9d77ceed9e23 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:47.141202 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-feb99f5c-eed5-441c-a966-9d77ceed9e23 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:47.142212 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-feb99f5c-eed5-441c-a966-9d77ceed9e23 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:47.142925 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-feb99f5c-eed5-441c-a966-9d77ceed9e23 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:47.163888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-feb99f5c-eed5-441c-a966-9d77ceed9e23 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Getting quotas for project 6652917123e14c2797cafacc4e31f75a. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:34:47.171061 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-feb99f5c-eed5-441c-a966-9d77ceed9e23 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Getting quotas for user 118c1425677b45b98689befb0eb55cce and project 6652917123e14c2797cafacc4e31f75a. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:34:47.255184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-feb99f5c-eed5-441c-a966-9d77ceed9e23 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:34:47.258661 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-feb99f5c-eed5-441c-a966-9d77ceed9e23 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bd793995-e6eb-4b51-a261-26397eee3021',volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:34:47.410623 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e9f4285b-359e-4393-b236-568885786682 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:34:47.411803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e9f4285b-359e-4393-b236-568885786682 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:34:47.412504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e9f4285b-359e-4393-b236-568885786682 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:34:47.413170 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e9f4285b-359e-4393-b236-568885786682 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:34:47.413840 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e9f4285b-359e-4393-b236-568885786682 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:34:47.425246 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e9f4285b-359e-4393-b236-568885786682 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:47.426000 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e9f4285b-359e-4393-b236-568885786682 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:47.426717 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e9f4285b-359e-4393-b236-568885786682 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:47.427693 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e9f4285b-359e-4393-b236-568885786682 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:47.428396 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e9f4285b-359e-4393-b236-568885786682 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:47.429074 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e9f4285b-359e-4393-b236-568885786682 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:47.448894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-e9f4285b-359e-4393-b236-568885786682 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Getting quotas for project 47098be734b14277a4d9a9d6b8464998. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:34:47.450043 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-feb99f5c-eed5-441c-a966-9d77ceed9e23 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.522321 Oct 05 02:34:47.451160 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 895/1761] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:34:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:34:47.455360 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-e9f4285b-359e-4393-b236-568885786682 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Getting quotas for user 4c441be8c87648bf9f1ff5cd4aff2532 and project 47098be734b14277a4d9a9d6b8464998. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:34:47.457134 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-65d99646-0b5e-4eb9-8c90-4f3e92b239c9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1319094241", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "48576e87-e85f-42b2-831e-e803ec37a843"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:47.470440 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e9f4285b-359e-4393-b236-568885786682 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:34:47.473160 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e9f4285b-359e-4393-b236-568885786682 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:34:47.529932 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e9f4285b-359e-4393-b236-568885786682 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.099552 Oct 05 02:34:47.530402 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-65d99646-0b5e-4eb9-8c90-4f3e92b239c9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] validate_networks() for [('48576e87-e85f-42b2-831e-e803ec37a843', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:34:47.537434 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 867/1762] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:34:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 1109 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 02:34:47.543658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0bbda38c-752f-4c8f-a0a4-5b24bc31ad5a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:47.544435 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0bbda38c-752f-4c8f-a0a4-5b24bc31ad5a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: 7b30cf01-6bc7-453f-b9f2-98400bcfc063] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:47.552778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0bbda38c-752f-4c8f-a0a4-5b24bc31ad5a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:47.553475 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0bbda38c-752f-4c8f-a0a4-5b24bc31ad5a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:47.554025 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0bbda38c-752f-4c8f-a0a4-5b24bc31ad5a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:47.554818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0bbda38c-752f-4c8f-a0a4-5b24bc31ad5a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:47.555364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0bbda38c-752f-4c8f-a0a4-5b24bc31ad5a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:47.555890 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0bbda38c-752f-4c8f-a0a4-5b24bc31ad5a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:47.701847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0bbda38c-752f-4c8f-a0a4-5b24bc31ad5a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f551e15d65a34daaac2b4d4f5963c522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7719a3153f66484c8758bb0999719851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:47.714993 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0bbda38c-752f-4c8f-a0a4-5b24bc31ad5a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063" status: 200 len: 1275 microversion: 2.1 time: 0.175203 Oct 05 02:34:47.730600 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 868/1763] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:47 2022] GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063 => generated 1275 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:47.739637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-881e8a56-bca8-4ffa-84fa-433bca358836 req-47a1c00d-7323-47b4-8704-5cab1d473996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a786593b-2c6f-4bc5-b338-8715c7d0429f", "name": "network-vif-deleted", "tag": "d0b44992-5d97-49da-98a0-6facb5cee1a2"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:47.762027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-881e8a56-bca8-4ffa-84fa-433bca358836 req-47a1c00d-7323-47b4-8704-5cab1d473996 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:47.766779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-881e8a56-bca8-4ffa-84fa-433bca358836 req-47a1c00d-7323-47b4-8704-5cab1d473996 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:47.767291 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-881e8a56-bca8-4ffa-84fa-433bca358836 req-47a1c00d-7323-47b4-8704-5cab1d473996 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:47.789042 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-881e8a56-bca8-4ffa-84fa-433bca358836 req-47a1c00d-7323-47b4-8704-5cab1d473996 service nova] Creating event network-vif-deleted:d0b44992-5d97-49da-98a0-6facb5cee1a2 for instance a786593b-2c6f-4bc5-b338-8715c7d0429f on n-h2-858272-3 Oct 05 02:34:47.803387 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-881e8a56-bca8-4ffa-84fa-433bca358836 req-47a1c00d-7323-47b4-8704-5cab1d473996 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071016 Oct 05 02:34:47.804364 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 869/1764] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:34:47.810413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6493851b-701f-4a45-a8f0-f68fe37456ae tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:47.811714 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6493851b-701f-4a45-a8f0-f68fe37456ae tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:47.819018 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6493851b-701f-4a45-a8f0-f68fe37456ae tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:47.819526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6493851b-701f-4a45-a8f0-f68fe37456ae tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:47.820027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6493851b-701f-4a45-a8f0-f68fe37456ae tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:47.820725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6493851b-701f-4a45-a8f0-f68fe37456ae tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:47.821217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6493851b-701f-4a45-a8f0-f68fe37456ae tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:47.822134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6493851b-701f-4a45-a8f0-f68fe37456ae tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:48.190126 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6493851b-701f-4a45-a8f0-f68fe37456ae tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:48.206787 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6493851b-701f-4a45-a8f0-f68fe37456ae tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:48.216077 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6493851b-701f-4a45-a8f0-f68fe37456ae tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:48.220770 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6493851b-701f-4a45-a8f0-f68fe37456ae tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1752 microversion: 2.20 time: 0.414653 Oct 05 02:34:48.225843 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 870/1765] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:47 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1752 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:48.241586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5c04d554-3279-4211-9949-3fa00743143d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:48.243167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5c04d554-3279-4211-9949-3fa00743143d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:48.255098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c04d554-3279-4211-9949-3fa00743143d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:48.255687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c04d554-3279-4211-9949-3fa00743143d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:48.256563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c04d554-3279-4211-9949-3fa00743143d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:48.257406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c04d554-3279-4211-9949-3fa00743143d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:48.257953 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c04d554-3279-4211-9949-3fa00743143d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:48.258599 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c04d554-3279-4211-9949-3fa00743143d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:48.400547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5c04d554-3279-4211-9949-3fa00743143d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:48.414707 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5c04d554-3279-4211-9949-3fa00743143d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:48.419998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5c04d554-3279-4211-9949-3fa00743143d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:48.426604 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5c04d554-3279-4211-9949-3fa00743143d tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1265 microversion: 2.25 time: 0.199027 Oct 05 02:34:48.442720 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 871/1766] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:48 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:48.453574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3549b310-6d99-444e-94c4-a47c913b772a tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:48.453920 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3549b310-6d99-444e-94c4-a47c913b772a tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:48.460798 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3549b310-6d99-444e-94c4-a47c913b772a tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:48.461753 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3549b310-6d99-444e-94c4-a47c913b772a tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:48.462205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3549b310-6d99-444e-94c4-a47c913b772a tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:48.462917 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3549b310-6d99-444e-94c4-a47c913b772a tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:48.463375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3549b310-6d99-444e-94c4-a47c913b772a tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:48.463805 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3549b310-6d99-444e-94c4-a47c913b772a tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:48.468251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-65d99646-0b5e-4eb9-8c90-4f3e92b239c9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:34:48.469308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-65d99646-0b5e-4eb9-8c90-4f3e92b239c9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:34:48.469982 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-65d99646-0b5e-4eb9-8c90-4f3e92b239c9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:34:48.470826 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-65d99646-0b5e-4eb9-8c90-4f3e92b239c9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:34:48.471596 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-65d99646-0b5e-4eb9-8c90-4f3e92b239c9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:34:48.486057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-65d99646-0b5e-4eb9-8c90-4f3e92b239c9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:48.487237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-65d99646-0b5e-4eb9-8c90-4f3e92b239c9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:48.488086 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-65d99646-0b5e-4eb9-8c90-4f3e92b239c9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:48.489091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-65d99646-0b5e-4eb9-8c90-4f3e92b239c9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:48.490043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-65d99646-0b5e-4eb9-8c90-4f3e92b239c9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:48.490876 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-65d99646-0b5e-4eb9-8c90-4f3e92b239c9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:48.517685 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-65d99646-0b5e-4eb9-8c90-4f3e92b239c9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Getting quotas for project 91e0286f34a549ed90c758652f0d20ae. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:34:48.524943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-65d99646-0b5e-4eb9-8c90-4f3e92b239c9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Getting quotas for user 9f23399a5f1c4af6855a098198ca4ced and project 91e0286f34a549ed90c758652f0d20ae. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:34:48.568866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-65d99646-0b5e-4eb9-8c90-4f3e92b239c9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:34:48.572820 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-65d99646-0b5e-4eb9-8c90-4f3e92b239c9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: f2e6dcdb-9664-46eb-b40d-58d894b62b47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:34:48.622370 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3549b310-6d99-444e-94c4-a47c913b772a tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:48.634365 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3549b310-6d99-444e-94c4-a47c913b772a tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1095 microversion: 2.1 time: 0.190369 Oct 05 02:34:48.637225 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 872/1767] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:48 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1095 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:48.653479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:34:48.658458 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-665e041e-d48e-44a5-b64a-e283c41c5bde tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:48.660251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-665e041e-d48e-44a5-b64a-e283c41c5bde tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:48.674443 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-665e041e-d48e-44a5-b64a-e283c41c5bde tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:48.674946 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-665e041e-d48e-44a5-b64a-e283c41c5bde tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:48.675391 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-665e041e-d48e-44a5-b64a-e283c41c5bde tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:48.676290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-665e041e-d48e-44a5-b64a-e283c41c5bde tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:48.676708 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-665e041e-d48e-44a5-b64a-e283c41c5bde tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:48.685305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-665e041e-d48e-44a5-b64a-e283c41c5bde tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:48.697075 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-65d99646-0b5e-4eb9-8c90-4f3e92b239c9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.244544 Oct 05 02:34:48.700331 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 896/1768] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:34:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:34:48.715068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c92be2e8-6921-44f4-ab12-88f89597306a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:48.716152 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c92be2e8-6921-44f4-ab12-88f89597306a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: f2e6dcdb-9664-46eb-b40d-58d894b62b47] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:48.795751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-665e041e-d48e-44a5-b64a-e283c41c5bde tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:48.814646 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c92be2e8-6921-44f4-ab12-88f89597306a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:48.820711 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-665e041e-d48e-44a5-b64a-e283c41c5bde tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 200 len: 1221 microversion: 2.1 time: 0.181962 Oct 05 02:34:48.825508 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c92be2e8-6921-44f4-ab12-88f89597306a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47" status: 200 len: 1208 microversion: 2.1 time: 0.115350 Oct 05 02:34:48.829183 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 873/1769] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:48 2022] GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 1221 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:48.839764 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 897/1770] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:48 2022] GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47 => generated 1208 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:48.851344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2688ff2f-8d61-4f13-8bea-84f95acd98f5 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:48.852064 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2688ff2f-8d61-4f13-8bea-84f95acd98f5 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: 7b30cf01-6bc7-453f-b9f2-98400bcfc063] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:48.867573 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2688ff2f-8d61-4f13-8bea-84f95acd98f5 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:48.868214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2688ff2f-8d61-4f13-8bea-84f95acd98f5 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:48.869234 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2688ff2f-8d61-4f13-8bea-84f95acd98f5 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:48.870903 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2688ff2f-8d61-4f13-8bea-84f95acd98f5 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:48.871440 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2688ff2f-8d61-4f13-8bea-84f95acd98f5 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:48.872842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2688ff2f-8d61-4f13-8bea-84f95acd98f5 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:49.012816 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2688ff2f-8d61-4f13-8bea-84f95acd98f5 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f551e15d65a34daaac2b4d4f5963c522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7719a3153f66484c8758bb0999719851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:49.023775 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2688ff2f-8d61-4f13-8bea-84f95acd98f5 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063" status: 200 len: 1275 microversion: 2.1 time: 0.190267 Oct 05 02:34:49.028662 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 874/1771] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:48 2022] GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063 => generated 1275 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:49.254619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ad5c8d70-7e8a-4931-8b07-e090baa809bf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:49.255226 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ad5c8d70-7e8a-4931-8b07-e090baa809bf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:49.272789 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad5c8d70-7e8a-4931-8b07-e090baa809bf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:49.273465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad5c8d70-7e8a-4931-8b07-e090baa809bf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:49.273915 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad5c8d70-7e8a-4931-8b07-e090baa809bf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:49.274623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad5c8d70-7e8a-4931-8b07-e090baa809bf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:49.275272 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad5c8d70-7e8a-4931-8b07-e090baa809bf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:49.276470 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad5c8d70-7e8a-4931-8b07-e090baa809bf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:49.456212 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7adff7f9-ba73-4800-a3ea-f7bd83d70974 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:49.456867 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7adff7f9-ba73-4800-a3ea-f7bd83d70974 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:49.481749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7adff7f9-ba73-4800-a3ea-f7bd83d70974 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:49.482476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7adff7f9-ba73-4800-a3ea-f7bd83d70974 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:49.483179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7adff7f9-ba73-4800-a3ea-f7bd83d70974 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:49.484119 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7adff7f9-ba73-4800-a3ea-f7bd83d70974 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:49.484773 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7adff7f9-ba73-4800-a3ea-f7bd83d70974 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:49.485401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7adff7f9-ba73-4800-a3ea-f7bd83d70974 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:49.534216 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ad5c8d70-7e8a-4931-8b07-e090baa809bf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:49.549834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ad5c8d70-7e8a-4931-8b07-e090baa809bf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:49.560319 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ad5c8d70-7e8a-4931-8b07-e090baa809bf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:49.562023 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ad5c8d70-7e8a-4931-8b07-e090baa809bf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1752 microversion: 2.20 time: 0.311345 Oct 05 02:34:49.591957 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 898/1772] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:49 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1752 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:49.611236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7adff7f9-ba73-4800-a3ea-f7bd83d70974 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:49.634354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7adff7f9-ba73-4800-a3ea-f7bd83d70974 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:49.636781 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7adff7f9-ba73-4800-a3ea-f7bd83d70974 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:49.638311 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7adff7f9-ba73-4800-a3ea-f7bd83d70974 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1265 microversion: 2.25 time: 0.186514 Oct 05 02:34:49.640139 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 875/1773] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:49 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:49.669619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-df7a3095-2187-4efc-bbe7-ffd8b69c3dec tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:49.670154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-df7a3095-2187-4efc-bbe7-ffd8b69c3dec tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:49.690360 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df7a3095-2187-4efc-bbe7-ffd8b69c3dec tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:49.690845 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df7a3095-2187-4efc-bbe7-ffd8b69c3dec tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:49.691282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df7a3095-2187-4efc-bbe7-ffd8b69c3dec tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:49.691982 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df7a3095-2187-4efc-bbe7-ffd8b69c3dec tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:49.692507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df7a3095-2187-4efc-bbe7-ffd8b69c3dec tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:49.692842 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df7a3095-2187-4efc-bbe7-ffd8b69c3dec tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:49.782250 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-df7a3095-2187-4efc-bbe7-ffd8b69c3dec tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:49.790793 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-df7a3095-2187-4efc-bbe7-ffd8b69c3dec tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1159 microversion: 2.1 time: 0.126163 Oct 05 02:34:49.793212 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 899/1774] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:49 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1159 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:49.847872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-3f39b40c-befc-4059-a7bd-be5183830905 req-ff153073-0c8b-4b7d-971a-0f2267763127 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e123bb72-45c5-4371-bf2e-f0747497f16b", "tag": "05da60d7-1d7e-4607-a912-92561fc99617"}, {"server_uuid": "031f6a33-bf9c-4b51-bf79-3764d67846e4", "name": "network-vif-deleted", "tag": "db9891a1-497f-4f63-882e-e84d19c9e5f2"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:49.850396 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-434d92fe-816f-4123-99de-4bfb0b598902 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:49.853192 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-434d92fe-816f-4123-99de-4bfb0b598902 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:49.863965 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3f39b40c-befc-4059-a7bd-be5183830905 req-ff153073-0c8b-4b7d-971a-0f2267763127 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:49.864581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3f39b40c-befc-4059-a7bd-be5183830905 req-ff153073-0c8b-4b7d-971a-0f2267763127 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:49.865219 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3f39b40c-befc-4059-a7bd-be5183830905 req-ff153073-0c8b-4b7d-971a-0f2267763127 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:49.866748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-434d92fe-816f-4123-99de-4bfb0b598902 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:49.867338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-434d92fe-816f-4123-99de-4bfb0b598902 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:49.869451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-434d92fe-816f-4123-99de-4bfb0b598902 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:49.870257 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-434d92fe-816f-4123-99de-4bfb0b598902 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:49.873504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-434d92fe-816f-4123-99de-4bfb0b598902 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:49.874019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-434d92fe-816f-4123-99de-4bfb0b598902 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:49.890128 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-3f39b40c-befc-4059-a7bd-be5183830905 req-ff153073-0c8b-4b7d-971a-0f2267763127 service nova] Creating event network-changed:05da60d7-1d7e-4607-a912-92561fc99617 for instance e123bb72-45c5-4371-bf2e-f0747497f16b on n-h1-858272-3 Oct 05 02:34:49.890953 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-3f39b40c-befc-4059-a7bd-be5183830905 req-ff153073-0c8b-4b7d-971a-0f2267763127 service nova] Creating event network-vif-deleted:db9891a1-497f-4f63-882e-e84d19c9e5f2 for instance 031f6a33-bf9c-4b51-bf79-3764d67846e4 on n-h2-858272-3 Oct 05 02:34:49.899928 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-3f39b40c-befc-4059-a7bd-be5183830905 req-ff153073-0c8b-4b7d-971a-0f2267763127 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.055583 Oct 05 02:34:49.901168 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 900/1775] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:34:49.910140 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cb51b94b-f0cb-42f3-b0fe-e4566758ed29 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:49.911382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cb51b94b-f0cb-42f3-b0fe-e4566758ed29 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: f2e6dcdb-9664-46eb-b40d-58d894b62b47] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:49.920251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cb51b94b-f0cb-42f3-b0fe-e4566758ed29 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:49.921226 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cb51b94b-f0cb-42f3-b0fe-e4566758ed29 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:49.922267 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cb51b94b-f0cb-42f3-b0fe-e4566758ed29 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:49.923416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cb51b94b-f0cb-42f3-b0fe-e4566758ed29 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:49.925172 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cb51b94b-f0cb-42f3-b0fe-e4566758ed29 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:49.925978 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cb51b94b-f0cb-42f3-b0fe-e4566758ed29 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:50.007051 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-434d92fe-816f-4123-99de-4bfb0b598902 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:50.023595 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-434d92fe-816f-4123-99de-4bfb0b598902 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 200 len: 1277 microversion: 2.1 time: 0.183138 Oct 05 02:34:50.029537 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 876/1776] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:49 2022] GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 1277 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:50.050912 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0925e38e-e56e-4177-8178-845cd07e959c tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:50.051897 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0925e38e-e56e-4177-8178-845cd07e959c tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: 7b30cf01-6bc7-453f-b9f2-98400bcfc063] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:50.058935 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0925e38e-e56e-4177-8178-845cd07e959c tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:50.059717 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0925e38e-e56e-4177-8178-845cd07e959c tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:50.060320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0925e38e-e56e-4177-8178-845cd07e959c tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:50.061245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0925e38e-e56e-4177-8178-845cd07e959c tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:50.061868 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0925e38e-e56e-4177-8178-845cd07e959c tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:50.062700 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0925e38e-e56e-4177-8178-845cd07e959c tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:50.071191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cb51b94b-f0cb-42f3-b0fe-e4566758ed29 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:50.075235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:34:50.084242 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cb51b94b-f0cb-42f3-b0fe-e4566758ed29 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47" status: 200 len: 1212 microversion: 2.1 time: 0.180999 Oct 05 02:34:50.101893 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 901/1777] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:49 2022] GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47 => generated 1212 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:50.227749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0925e38e-e56e-4177-8178-845cd07e959c tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f551e15d65a34daaac2b4d4f5963c522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7719a3153f66484c8758bb0999719851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:50.242879 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0925e38e-e56e-4177-8178-845cd07e959c tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063" status: 200 len: 1317 microversion: 2.1 time: 0.195859 Oct 05 02:34:50.243467 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 877/1778] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:50 2022] GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063 => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:50.597668 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-947a8d95-a32a-4782-8ee9-cf2cb3ef4577 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:50.598310 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-947a8d95-a32a-4782-8ee9-cf2cb3ef4577 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:50.608784 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-947a8d95-a32a-4782-8ee9-cf2cb3ef4577 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:50.609357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-947a8d95-a32a-4782-8ee9-cf2cb3ef4577 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:50.609922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-947a8d95-a32a-4782-8ee9-cf2cb3ef4577 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:50.610640 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-947a8d95-a32a-4782-8ee9-cf2cb3ef4577 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:50.611097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-947a8d95-a32a-4782-8ee9-cf2cb3ef4577 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:50.611529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-947a8d95-a32a-4782-8ee9-cf2cb3ef4577 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:50.670897 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-004c8991-12f8-465d-ae61-497ca323b884 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:50.671473 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-004c8991-12f8-465d-ae61-497ca323b884 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:50.692128 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-004c8991-12f8-465d-ae61-497ca323b884 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:50.692623 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-004c8991-12f8-465d-ae61-497ca323b884 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:50.693092 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-004c8991-12f8-465d-ae61-497ca323b884 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:50.693803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-004c8991-12f8-465d-ae61-497ca323b884 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:50.694457 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-004c8991-12f8-465d-ae61-497ca323b884 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:50.694886 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-004c8991-12f8-465d-ae61-497ca323b884 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:50.785464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-004c8991-12f8-465d-ae61-497ca323b884 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:50.797551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-004c8991-12f8-465d-ae61-497ca323b884 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:50.799658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-004c8991-12f8-465d-ae61-497ca323b884 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:50.801372 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-004c8991-12f8-465d-ae61-497ca323b884 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1265 microversion: 2.25 time: 0.134995 Oct 05 02:34:50.802685 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 878/1779] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:50 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1265 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:50.827319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-244fa4e9-d16b-4eb9-a49f-fec071b5ed2f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:50.827920 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-244fa4e9-d16b-4eb9-a49f-fec071b5ed2f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:50.834759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-244fa4e9-d16b-4eb9-a49f-fec071b5ed2f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:50.835491 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-244fa4e9-d16b-4eb9-a49f-fec071b5ed2f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:50.836125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-244fa4e9-d16b-4eb9-a49f-fec071b5ed2f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:50.837047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-244fa4e9-d16b-4eb9-a49f-fec071b5ed2f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:50.837737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-244fa4e9-d16b-4eb9-a49f-fec071b5ed2f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:50.838154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-244fa4e9-d16b-4eb9-a49f-fec071b5ed2f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:50.860264 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-947a8d95-a32a-4782-8ee9-cf2cb3ef4577 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:50.875175 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-947a8d95-a32a-4782-8ee9-cf2cb3ef4577 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:50.876980 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-947a8d95-a32a-4782-8ee9-cf2cb3ef4577 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:50.879847 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-947a8d95-a32a-4782-8ee9-cf2cb3ef4577 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1752 microversion: 2.20 time: 0.286615 Oct 05 02:34:50.880400 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 902/1780] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:50 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1752 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:50.934486 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-244fa4e9-d16b-4eb9-a49f-fec071b5ed2f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:50.942401 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-244fa4e9-d16b-4eb9-a49f-fec071b5ed2f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1159 microversion: 2.1 time: 0.119274 Oct 05 02:34:50.952871 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 879/1781] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:50 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1159 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:51.049772 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-90488115-6f0a-43ef-9dba-40390ef8c716 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:51.050386 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-90488115-6f0a-43ef-9dba-40390ef8c716 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:51.057554 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-90488115-6f0a-43ef-9dba-40390ef8c716 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:51.058820 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-90488115-6f0a-43ef-9dba-40390ef8c716 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:51.059268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-90488115-6f0a-43ef-9dba-40390ef8c716 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:51.059983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-90488115-6f0a-43ef-9dba-40390ef8c716 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:51.060445 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-90488115-6f0a-43ef-9dba-40390ef8c716 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:51.060871 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-90488115-6f0a-43ef-9dba-40390ef8c716 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:51.111931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e6c4c033-9658-4235-a81d-41a51510f566 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:51.112864 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e6c4c033-9658-4235-a81d-41a51510f566 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: f2e6dcdb-9664-46eb-b40d-58d894b62b47] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:51.120889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6c4c033-9658-4235-a81d-41a51510f566 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:51.121657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6c4c033-9658-4235-a81d-41a51510f566 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:51.122296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6c4c033-9658-4235-a81d-41a51510f566 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:51.123203 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6c4c033-9658-4235-a81d-41a51510f566 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:51.123868 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6c4c033-9658-4235-a81d-41a51510f566 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:51.124528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6c4c033-9658-4235-a81d-41a51510f566 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:51.128935 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-90488115-6f0a-43ef-9dba-40390ef8c716 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:51.147194 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-90488115-6f0a-43ef-9dba-40390ef8c716 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 200 len: 1277 microversion: 2.1 time: 0.099835 Oct 05 02:34:51.150667 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:34:51.162744 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 903/1782] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:51 2022] GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 1277 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:51.199032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e6c4c033-9658-4235-a81d-41a51510f566 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:51.208280 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e6c4c033-9658-4235-a81d-41a51510f566 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47" status: 200 len: 1212 microversion: 2.1 time: 0.101040 Oct 05 02:34:51.209094 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 880/1783] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:51 2022] GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47 => generated 1212 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:51.268342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5785aecc-fec1-45df-8b28-c257a1eef134 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:51.268986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5785aecc-fec1-45df-8b28-c257a1eef134 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: 7b30cf01-6bc7-453f-b9f2-98400bcfc063] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:51.275457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5785aecc-fec1-45df-8b28-c257a1eef134 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:51.275930 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5785aecc-fec1-45df-8b28-c257a1eef134 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:51.276368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5785aecc-fec1-45df-8b28-c257a1eef134 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:51.277619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5785aecc-fec1-45df-8b28-c257a1eef134 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:51.278252 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5785aecc-fec1-45df-8b28-c257a1eef134 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:51.278854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5785aecc-fec1-45df-8b28-c257a1eef134 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:51.421292 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5785aecc-fec1-45df-8b28-c257a1eef134 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f551e15d65a34daaac2b4d4f5963c522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7719a3153f66484c8758bb0999719851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:51.429328 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5785aecc-fec1-45df-8b28-c257a1eef134 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063" status: 200 len: 1317 microversion: 2.1 time: 0.164756 Oct 05 02:34:51.429920 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 904/1784] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:51 2022] GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:51.830980 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-88ab8d54-2dc6-4da3-a62b-e2e4606d3831 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:51.831614 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-88ab8d54-2dc6-4da3-a62b-e2e4606d3831 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:51.841329 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88ab8d54-2dc6-4da3-a62b-e2e4606d3831 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:51.847086 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88ab8d54-2dc6-4da3-a62b-e2e4606d3831 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:51.847639 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88ab8d54-2dc6-4da3-a62b-e2e4606d3831 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:51.848404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88ab8d54-2dc6-4da3-a62b-e2e4606d3831 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:51.852849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88ab8d54-2dc6-4da3-a62b-e2e4606d3831 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:51.853367 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88ab8d54-2dc6-4da3-a62b-e2e4606d3831 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:51.906140 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3e9a7f7a-6668-4e28-a042-68a0a99c1f77 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:51.906759 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3e9a7f7a-6668-4e28-a042-68a0a99c1f77 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:51.925915 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e9a7f7a-6668-4e28-a042-68a0a99c1f77 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:51.926892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e9a7f7a-6668-4e28-a042-68a0a99c1f77 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:51.927865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e9a7f7a-6668-4e28-a042-68a0a99c1f77 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:51.928753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e9a7f7a-6668-4e28-a042-68a0a99c1f77 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:51.929404 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e9a7f7a-6668-4e28-a042-68a0a99c1f77 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:51.930017 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e9a7f7a-6668-4e28-a042-68a0a99c1f77 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:51.944156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-88ab8d54-2dc6-4da3-a62b-e2e4606d3831 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:51.957029 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-88ab8d54-2dc6-4da3-a62b-e2e4606d3831 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:51.965427 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-88ab8d54-2dc6-4da3-a62b-e2e4606d3831 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:51.967794 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-88ab8d54-2dc6-4da3-a62b-e2e4606d3831 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1265 microversion: 2.25 time: 0.142576 Oct 05 02:34:51.969360 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 881/1785] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:51 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1265 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:51.980179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c5477377-5f6a-4684-b4bf-560a32535ca4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:51.986294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c5477377-5f6a-4684-b4bf-560a32535ca4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:52.004800 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5477377-5f6a-4684-b4bf-560a32535ca4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:52.005350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5477377-5f6a-4684-b4bf-560a32535ca4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:52.005799 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5477377-5f6a-4684-b4bf-560a32535ca4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:52.006530 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5477377-5f6a-4684-b4bf-560a32535ca4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:52.006994 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5477377-5f6a-4684-b4bf-560a32535ca4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:52.007425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5477377-5f6a-4684-b4bf-560a32535ca4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:52.144589 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c5477377-5f6a-4684-b4bf-560a32535ca4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:52.152690 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c5477377-5f6a-4684-b4bf-560a32535ca4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1169 microversion: 2.1 time: 0.177219 Oct 05 02:34:52.154242 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 882/1786] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:51 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1169 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:52.159138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-ce404f92-3eb9-4ace-ab0b-92b4c2003963 req-5577b790-1d64-4324-b01c-3da9bee360f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b30cf01-6bc7-453f-b9f2-98400bcfc063", "tag": "8d0c6b53-f679-4ee4-afb3-4a4e905d5489"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:52.169909 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ce404f92-3eb9-4ace-ab0b-92b4c2003963 req-5577b790-1d64-4324-b01c-3da9bee360f1 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:52.170675 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ce404f92-3eb9-4ace-ab0b-92b4c2003963 req-5577b790-1d64-4324-b01c-3da9bee360f1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:52.171274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ce404f92-3eb9-4ace-ab0b-92b4c2003963 req-5577b790-1d64-4324-b01c-3da9bee360f1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:52.183752 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-ce404f92-3eb9-4ace-ab0b-92b4c2003963 req-5577b790-1d64-4324-b01c-3da9bee360f1 service nova] Creating event network-changed:8d0c6b53-f679-4ee4-afb3-4a4e905d5489 for instance 7b30cf01-6bc7-453f-b9f2-98400bcfc063 on n-h2-858272-3 Oct 05 02:34:52.189263 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-ce404f92-3eb9-4ace-ab0b-92b4c2003963 req-5577b790-1d64-4324-b01c-3da9bee360f1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033518 Oct 05 02:34:52.190403 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 883/1787] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:34:52.195736 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5ecf8895-10e4-4a63-a067-e8150518c7e1 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:52.196690 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5ecf8895-10e4-4a63-a067-e8150518c7e1 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:52.204093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ecf8895-10e4-4a63-a067-e8150518c7e1 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:52.204861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ecf8895-10e4-4a63-a067-e8150518c7e1 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:52.205535 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ecf8895-10e4-4a63-a067-e8150518c7e1 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:52.206452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ecf8895-10e4-4a63-a067-e8150518c7e1 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:52.207101 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ecf8895-10e4-4a63-a067-e8150518c7e1 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:52.207520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ecf8895-10e4-4a63-a067-e8150518c7e1 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:52.217753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3e9a7f7a-6668-4e28-a042-68a0a99c1f77 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:52.228865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3e9a7f7a-6668-4e28-a042-68a0a99c1f77 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:52.232545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3e9a7f7a-6668-4e28-a042-68a0a99c1f77 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:52.234289 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3e9a7f7a-6668-4e28-a042-68a0a99c1f77 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1752 microversion: 2.20 time: 0.332032 Oct 05 02:34:52.248601 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 905/1788] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:51 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1752 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:34:52.248601 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-83617411-28c3-41a3-93ad-9317e38b8f61 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:52.248601 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-83617411-28c3-41a3-93ad-9317e38b8f61 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: f2e6dcdb-9664-46eb-b40d-58d894b62b47] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:52.254953 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83617411-28c3-41a3-93ad-9317e38b8f61 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:52.255461 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83617411-28c3-41a3-93ad-9317e38b8f61 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:52.255908 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83617411-28c3-41a3-93ad-9317e38b8f61 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:52.256610 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83617411-28c3-41a3-93ad-9317e38b8f61 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:52.257114 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83617411-28c3-41a3-93ad-9317e38b8f61 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:52.257594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83617411-28c3-41a3-93ad-9317e38b8f61 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:52.286072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5ecf8895-10e4-4a63-a067-e8150518c7e1 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:52.295311 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5ecf8895-10e4-4a63-a067-e8150518c7e1 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 200 len: 1277 microversion: 2.1 time: 0.103543 Oct 05 02:34:52.296498 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 884/1789] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:52 2022] GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 1277 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:52.329022 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-83617411-28c3-41a3-93ad-9317e38b8f61 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:52.337243 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-83617411-28c3-41a3-93ad-9317e38b8f61 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47" status: 200 len: 1204 microversion: 2.1 time: 0.096424 Oct 05 02:34:52.338466 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 906/1790] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:52 2022] GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47 => generated 1204 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:52.454231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-86efd5b8-4b4d-41b8-a3d7-445fcc929823 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:52.454961 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-86efd5b8-4b4d-41b8-a3d7-445fcc929823 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: 7b30cf01-6bc7-453f-b9f2-98400bcfc063] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:52.462032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86efd5b8-4b4d-41b8-a3d7-445fcc929823 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:52.462523 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86efd5b8-4b4d-41b8-a3d7-445fcc929823 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:52.462953 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86efd5b8-4b4d-41b8-a3d7-445fcc929823 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:52.463669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86efd5b8-4b4d-41b8-a3d7-445fcc929823 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:52.464629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86efd5b8-4b4d-41b8-a3d7-445fcc929823 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:52.465075 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86efd5b8-4b4d-41b8-a3d7-445fcc929823 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:52.927892 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-86efd5b8-4b4d-41b8-a3d7-445fcc929823 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f551e15d65a34daaac2b4d4f5963c522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7719a3153f66484c8758bb0999719851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:52.942340 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-86efd5b8-4b4d-41b8-a3d7-445fcc929823 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063" status: 200 len: 1317 microversion: 2.1 time: 0.494232 Oct 05 02:34:52.958350 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 885/1791] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:52 2022] GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063 => generated 1317 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:52.996202 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5d420b92-90b2-450a-bb99-b05849c6e36c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:52.996862 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5d420b92-90b2-450a-bb99-b05849c6e36c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:53.003532 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d420b92-90b2-450a-bb99-b05849c6e36c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:53.011950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d420b92-90b2-450a-bb99-b05849c6e36c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:53.012867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d420b92-90b2-450a-bb99-b05849c6e36c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:53.013872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d420b92-90b2-450a-bb99-b05849c6e36c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:53.014522 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d420b92-90b2-450a-bb99-b05849c6e36c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:53.015123 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d420b92-90b2-450a-bb99-b05849c6e36c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:53.115697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5d420b92-90b2-450a-bb99-b05849c6e36c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:53.126191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5d420b92-90b2-450a-bb99-b05849c6e36c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:53.127619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5d420b92-90b2-450a-bb99-b05849c6e36c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:53.128870 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5d420b92-90b2-450a-bb99-b05849c6e36c tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1265 microversion: 2.25 time: 0.137069 Oct 05 02:34:53.129349 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 907/1792] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:52 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1265 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:53.177496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e3ba615b-139e-44ce-9550-80c820f46b97 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:53.178013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e3ba615b-139e-44ce-9550-80c820f46b97 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:53.185318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e3ba615b-139e-44ce-9550-80c820f46b97 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:53.186046 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e3ba615b-139e-44ce-9550-80c820f46b97 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:53.187192 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e3ba615b-139e-44ce-9550-80c820f46b97 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:53.188394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e3ba615b-139e-44ce-9550-80c820f46b97 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:53.189139 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e3ba615b-139e-44ce-9550-80c820f46b97 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:53.189725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e3ba615b-139e-44ce-9550-80c820f46b97 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:53.265905 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c42dbb00-6426-494c-ab30-96d99df31b17 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:53.266808 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c42dbb00-6426-494c-ab30-96d99df31b17 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:53.273160 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c42dbb00-6426-494c-ab30-96d99df31b17 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:53.274739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c42dbb00-6426-494c-ab30-96d99df31b17 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:53.275342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c42dbb00-6426-494c-ab30-96d99df31b17 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:53.276249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c42dbb00-6426-494c-ab30-96d99df31b17 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:53.277584 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c42dbb00-6426-494c-ab30-96d99df31b17 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:53.278257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c42dbb00-6426-494c-ab30-96d99df31b17 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:53.690177 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e3ba615b-139e-44ce-9550-80c820f46b97 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:53.702897 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e3ba615b-139e-44ce-9550-80c820f46b97 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1211 microversion: 2.1 time: 0.528553 Oct 05 02:34:53.724483 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 886/1793] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:53 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1211 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:53.732582 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7fd0cdf6-a4fb-4af8-91f1-661351dd5133 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:53.734201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7fd0cdf6-a4fb-4af8-91f1-661351dd5133 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:53.742870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fd0cdf6-a4fb-4af8-91f1-661351dd5133 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:53.744764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fd0cdf6-a4fb-4af8-91f1-661351dd5133 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:53.746261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fd0cdf6-a4fb-4af8-91f1-661351dd5133 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:53.747679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fd0cdf6-a4fb-4af8-91f1-661351dd5133 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:53.748429 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fd0cdf6-a4fb-4af8-91f1-661351dd5133 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:53.749212 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fd0cdf6-a4fb-4af8-91f1-661351dd5133 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:53.774494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c42dbb00-6426-494c-ab30-96d99df31b17 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:53.785405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c42dbb00-6426-494c-ab30-96d99df31b17 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:53.801942 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c42dbb00-6426-494c-ab30-96d99df31b17 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:53.803452 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c42dbb00-6426-494c-ab30-96d99df31b17 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1752 microversion: 2.20 time: 0.544868 Oct 05 02:34:53.809166 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 908/1794] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:53 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1752 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:53.814949 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-71f5f15a-db6b-4233-8002-fd27531b7c8f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:53.816051 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-71f5f15a-db6b-4233-8002-fd27531b7c8f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: f2e6dcdb-9664-46eb-b40d-58d894b62b47] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:53.824356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71f5f15a-db6b-4233-8002-fd27531b7c8f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:53.825782 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71f5f15a-db6b-4233-8002-fd27531b7c8f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:53.827444 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71f5f15a-db6b-4233-8002-fd27531b7c8f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:53.828530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71f5f15a-db6b-4233-8002-fd27531b7c8f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:53.830017 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71f5f15a-db6b-4233-8002-fd27531b7c8f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:53.830761 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71f5f15a-db6b-4233-8002-fd27531b7c8f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:53.890174 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7fd0cdf6-a4fb-4af8-91f1-661351dd5133 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:53.900491 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7fd0cdf6-a4fb-4af8-91f1-661351dd5133 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 200 len: 1283 microversion: 2.1 time: 0.173815 Oct 05 02:34:53.901768 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 887/1795] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:53 2022] GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 1283 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:53.971943 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e5084589-48de-4443-a5b9-86c421f12ce6 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:53.972638 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e5084589-48de-4443-a5b9-86c421f12ce6 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: 7b30cf01-6bc7-453f-b9f2-98400bcfc063] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:53.978727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5084589-48de-4443-a5b9-86c421f12ce6 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:53.979214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5084589-48de-4443-a5b9-86c421f12ce6 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:53.980789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5084589-48de-4443-a5b9-86c421f12ce6 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:53.981876 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5084589-48de-4443-a5b9-86c421f12ce6 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:53.982509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5084589-48de-4443-a5b9-86c421f12ce6 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:53.983108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5084589-48de-4443-a5b9-86c421f12ce6 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:53.995595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-71f5f15a-db6b-4233-8002-fd27531b7c8f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:54.008676 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-71f5f15a-db6b-4233-8002-fd27531b7c8f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47" status: 200 len: 1266 microversion: 2.1 time: 0.194714 Oct 05 02:34:54.030007 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 909/1796] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:53 2022] GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:54.162060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9f0096a0-8a73-4e1b-92ba-1e087297843f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:54.165063 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9f0096a0-8a73-4e1b-92ba-1e087297843f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:54.184274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9f0096a0-8a73-4e1b-92ba-1e087297843f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:54.185439 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9f0096a0-8a73-4e1b-92ba-1e087297843f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:54.186110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9f0096a0-8a73-4e1b-92ba-1e087297843f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:54.189118 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9f0096a0-8a73-4e1b-92ba-1e087297843f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:54.191147 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9f0096a0-8a73-4e1b-92ba-1e087297843f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:54.191830 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9f0096a0-8a73-4e1b-92ba-1e087297843f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:54.409864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9f0096a0-8a73-4e1b-92ba-1e087297843f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:54.422297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9f0096a0-8a73-4e1b-92ba-1e087297843f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:54.424218 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9f0096a0-8a73-4e1b-92ba-1e087297843f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:54.425757 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9f0096a0-8a73-4e1b-92ba-1e087297843f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 200 len: 1265 microversion: 2.25 time: 0.273289 Oct 05 02:34:54.441331 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 910/1797] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:54 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 1265 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:54.449822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-d1c75f73-1620-467f-b6d2-bd7b1ac10164 req-b99103d2-a4c1-4386-861c-80cfaf1ce5de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f4b118a-e665-4c29-a518-811ca1fc9001", "tag": "f83cfb8b-54ff-4810-8dff-d1685b7e58d4"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:54.461370 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d1c75f73-1620-467f-b6d2-bd7b1ac10164 req-b99103d2-a4c1-4386-861c-80cfaf1ce5de service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:54.462050 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d1c75f73-1620-467f-b6d2-bd7b1ac10164 req-b99103d2-a4c1-4386-861c-80cfaf1ce5de service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:54.462595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d1c75f73-1620-467f-b6d2-bd7b1ac10164 req-b99103d2-a4c1-4386-861c-80cfaf1ce5de service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:54.475088 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-d1c75f73-1620-467f-b6d2-bd7b1ac10164 req-b99103d2-a4c1-4386-861c-80cfaf1ce5de service nova] Creating event network-changed:f83cfb8b-54ff-4810-8dff-d1685b7e58d4 for instance 1f4b118a-e665-4c29-a518-811ca1fc9001 on n-h1-858272-3 Oct 05 02:34:54.481467 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-d1c75f73-1620-467f-b6d2-bd7b1ac10164 req-b99103d2-a4c1-4386-861c-80cfaf1ce5de service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038211 Oct 05 02:34:54.482713 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 911/1798] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:34:54.738256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7c96e43d-e2a4-4ee8-b88f-634679969c6f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:54.739560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7c96e43d-e2a4-4ee8-b88f-634679969c6f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:54.742993 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e5084589-48de-4443-a5b9-86c421f12ce6 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f551e15d65a34daaac2b4d4f5963c522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7719a3153f66484c8758bb0999719851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:54.749139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c96e43d-e2a4-4ee8-b88f-634679969c6f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:54.750003 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c96e43d-e2a4-4ee8-b88f-634679969c6f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:54.750708 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c96e43d-e2a4-4ee8-b88f-634679969c6f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:54.751961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c96e43d-e2a4-4ee8-b88f-634679969c6f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:54.752702 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c96e43d-e2a4-4ee8-b88f-634679969c6f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:54.753546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c96e43d-e2a4-4ee8-b88f-634679969c6f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:54.758195 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e5084589-48de-4443-a5b9-86c421f12ce6 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063" status: 200 len: 1317 microversion: 2.1 time: 0.787692 Oct 05 02:34:54.758821 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 888/1799] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:53 2022] GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063 => generated 1317 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:54.834151 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-759082f2-b146-4eb0-a6e1-b733c13dd618 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:54.834774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-759082f2-b146-4eb0-a6e1-b733c13dd618 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:54.859144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-759082f2-b146-4eb0-a6e1-b733c13dd618 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:54.861526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-759082f2-b146-4eb0-a6e1-b733c13dd618 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:54.862163 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-759082f2-b146-4eb0-a6e1-b733c13dd618 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:54.864512 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-759082f2-b146-4eb0-a6e1-b733c13dd618 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:54.867779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-759082f2-b146-4eb0-a6e1-b733c13dd618 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:54.874774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-759082f2-b146-4eb0-a6e1-b733c13dd618 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:55.464727 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7c96e43d-e2a4-4ee8-b88f-634679969c6f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:55.468947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-759082f2-b146-4eb0-a6e1-b733c13dd618 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:55.479883 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7c96e43d-e2a4-4ee8-b88f-634679969c6f tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1211 microversion: 2.1 time: 0.752275 Oct 05 02:34:55.480479 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 912/1800] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:54 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1211 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:55.483257 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-759082f2-b146-4eb0-a6e1-b733c13dd618 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:55.486499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-759082f2-b146-4eb0-a6e1-b733c13dd618 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:55.487736 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-759082f2-b146-4eb0-a6e1-b733c13dd618 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1752 microversion: 2.20 time: 0.658359 Oct 05 02:34:55.491273 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 889/1801] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:54 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1752 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:34:55.498108 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ce76c16f-0f6c-4bfe-8a47-dfee3998d817 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:55.498725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ce76c16f-0f6c-4bfe-8a47-dfee3998d817 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:55.505982 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-123e8e86-d3e0-4917-bdc3-173abe619267 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:55.506994 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-123e8e86-d3e0-4917-bdc3-173abe619267 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: f2e6dcdb-9664-46eb-b40d-58d894b62b47] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:55.517591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-123e8e86-d3e0-4917-bdc3-173abe619267 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:55.521793 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce76c16f-0f6c-4bfe-8a47-dfee3998d817 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:55.522292 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce76c16f-0f6c-4bfe-8a47-dfee3998d817 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:55.522723 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce76c16f-0f6c-4bfe-8a47-dfee3998d817 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:55.523285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-123e8e86-d3e0-4917-bdc3-173abe619267 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:55.523415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce76c16f-0f6c-4bfe-8a47-dfee3998d817 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:55.523866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce76c16f-0f6c-4bfe-8a47-dfee3998d817 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:55.524285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce76c16f-0f6c-4bfe-8a47-dfee3998d817 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:55.524549 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-123e8e86-d3e0-4917-bdc3-173abe619267 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:55.525660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-123e8e86-d3e0-4917-bdc3-173abe619267 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:55.528451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-123e8e86-d3e0-4917-bdc3-173abe619267 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:55.533802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-123e8e86-d3e0-4917-bdc3-173abe619267 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:55.742078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-123e8e86-d3e0-4917-bdc3-173abe619267 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:55.751094 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-123e8e86-d3e0-4917-bdc3-173abe619267 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47" status: 200 len: 1266 microversion: 2.1 time: 0.258420 Oct 05 02:34:55.751692 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 890/1802] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:55 2022] GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47 => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:55.773139 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5c20c323-3414-4875-845f-c279faf58655 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:55.774074 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5c20c323-3414-4875-845f-c279faf58655 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: a786593b-2c6f-4bc5-b338-8715c7d0429f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:55.791016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c20c323-3414-4875-845f-c279faf58655 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:55.797207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c20c323-3414-4875-845f-c279faf58655 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:55.797812 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c20c323-3414-4875-845f-c279faf58655 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:55.798676 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c20c323-3414-4875-845f-c279faf58655 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:55.799244 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c20c323-3414-4875-845f-c279faf58655 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:55.799808 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c20c323-3414-4875-845f-c279faf58655 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:55.816504 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-5c20c323-3414-4875-845f-c279faf58655 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] HTTP exception thrown: Instance a786593b-2c6f-4bc5-b338-8715c7d0429f could not be found. Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5c20c323-3414-4875-845f-c279faf58655 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Request method failure captured: Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f HTTP/1.1 Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOuH8lbWR5T6J4rN8SVnp5khCjpH7yX47ceKkh7ju-ewftZGsMYkWxiQ-NrHtKY9BWHf2UyRIBx7H_Rf_NGmTCCAA2yb8a_C0L3hWQtPE-mbCgBOezy5TWiBIn7_YUsEf0P-DqK0FHwoc6v36DfLV8QftYAjzTVZ97fZJULLAXqmXoI Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: X-Openstack-Nova-Api-Version: 2.25 Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: bbd25b0a68f749029eeed701c77462ce Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-836018511 Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bbd25b0a68f749029eeed701c77462ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bbd25b0a68f749029eeed701c77462ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bbd25b0a68f749029eeed701c77462ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bbd25b0a68f749029eeed701c77462ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-836018511 Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: bbd25b0a68f749029eeed701c77462ce Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-836018511 Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-LiveAutoBlockMigrationV225Test-836018511-project Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 39671ba0b86847f995c96013947fee65 Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-836018511-project Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance a786593b-2c6f-4bc5-b338-8715c7d0429f could not be found. Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'a786593b-2c6f-4bc5-b338-8715c7d0429f'} Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a786593b-2c6f-4bc5-b338-8715c7d0429f could not be found. Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a786593b-2c6f-4bc5-b338-8715c7d0429f could not be found. Oct 05 02:34:55.828933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:34:55.836394 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:34:55.836394 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:34:55.836394 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:34:55.836394 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:34:55.836394 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:34:55.836394 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:34:55.836394 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:34:55.836394 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a786593b-2c6f-4bc5-b338-8715c7d0429f could not be found. Oct 05 02:34:55.836394 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:34:55.838685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5c20c323-3414-4875-845f-c279faf58655 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Returning 404 to user: Instance a786593b-2c6f-4bc5-b338-8715c7d0429f could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:34:55.838869 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5c20c323-3414-4875-845f-c279faf58655 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f" status: 404 len: 111 microversion: 2.25 time: 0.070175 Oct 05 02:34:55.843359 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 891/1803] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:55 2022] GET /compute/v2.1/servers/a786593b-2c6f-4bc5-b338-8715c7d0429f => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:34:55.854250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-510ed11a-5906-4534-8d29-c9c5b7c1ab6a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:55.855866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ce76c16f-0f6c-4bfe-8a47-dfee3998d817 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:55.857139 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-510ed11a-5906-4534-8d29-c9c5b7c1ab6a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: 7b30cf01-6bc7-453f-b9f2-98400bcfc063] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:55.869688 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ce76c16f-0f6c-4bfe-8a47-dfee3998d817 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 200 len: 1325 microversion: 2.1 time: 0.378597 Oct 05 02:34:55.871243 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 913/1804] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:55 2022] GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 1325 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:55.890291 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-510ed11a-5906-4534-8d29-c9c5b7c1ab6a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:55.891179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-510ed11a-5906-4534-8d29-c9c5b7c1ab6a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:55.891842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-510ed11a-5906-4534-8d29-c9c5b7c1ab6a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:55.892786 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-510ed11a-5906-4534-8d29-c9c5b7c1ab6a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:55.893485 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-510ed11a-5906-4534-8d29-c9c5b7c1ab6a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:55.894126 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-510ed11a-5906-4534-8d29-c9c5b7c1ab6a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:55.983065 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-3876cc5a-8925-4092-9847-4d12d972070f req-13d74c71-480e-4fbd-90c0-1ecd4c793f5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e123bb72-45c5-4371-bf2e-f0747497f16b", "name": "network-vif-plugged", "status": "completed", "tag": "05da60d7-1d7e-4607-a912-92561fc99617"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:55.999688 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3876cc5a-8925-4092-9847-4d12d972070f req-13d74c71-480e-4fbd-90c0-1ecd4c793f5d service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:56.002558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3876cc5a-8925-4092-9847-4d12d972070f req-13d74c71-480e-4fbd-90c0-1ecd4c793f5d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:56.003401 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3876cc5a-8925-4092-9847-4d12d972070f req-13d74c71-480e-4fbd-90c0-1ecd4c793f5d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:56.027501 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-3876cc5a-8925-4092-9847-4d12d972070f req-13d74c71-480e-4fbd-90c0-1ecd4c793f5d service nova] Creating event network-vif-plugged:05da60d7-1d7e-4607-a912-92561fc99617 for instance e123bb72-45c5-4371-bf2e-f0747497f16b on n-h1-858272-3 Oct 05 02:34:56.051290 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-3876cc5a-8925-4092-9847-4d12d972070f req-13d74c71-480e-4fbd-90c0-1ecd4c793f5d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073010 Oct 05 02:34:56.056499 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 914/1805] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:34:56.200357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-510ed11a-5906-4534-8d29-c9c5b7c1ab6a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f551e15d65a34daaac2b4d4f5963c522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7719a3153f66484c8758bb0999719851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:56.216401 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-510ed11a-5906-4534-8d29-c9c5b7c1ab6a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063" status: 200 len: 1317 microversion: 2.1 time: 0.371881 Oct 05 02:34:56.217012 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 892/1806] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:55 2022] GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063 => generated 1317 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:56.514123 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-68e2e81d-ebac-4df7-8038-8b2fb3240fb7 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:56.516370 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-68e2e81d-ebac-4df7-8038-8b2fb3240fb7 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:56.518739 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f47f2b95-abb5-447e-8c7e-1dfb10cd60f1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:56.519370 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f47f2b95-abb5-447e-8c7e-1dfb10cd60f1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:56.523372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:34:56.525937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68e2e81d-ebac-4df7-8038-8b2fb3240fb7 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:56.527365 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68e2e81d-ebac-4df7-8038-8b2fb3240fb7 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:56.528243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68e2e81d-ebac-4df7-8038-8b2fb3240fb7 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:56.529315 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68e2e81d-ebac-4df7-8038-8b2fb3240fb7 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:56.530911 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68e2e81d-ebac-4df7-8038-8b2fb3240fb7 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:56.532273 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68e2e81d-ebac-4df7-8038-8b2fb3240fb7 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:56.535321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f47f2b95-abb5-447e-8c7e-1dfb10cd60f1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:56.535830 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f47f2b95-abb5-447e-8c7e-1dfb10cd60f1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:56.536276 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f47f2b95-abb5-447e-8c7e-1dfb10cd60f1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:56.537047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f47f2b95-abb5-447e-8c7e-1dfb10cd60f1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:56.537554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f47f2b95-abb5-447e-8c7e-1dfb10cd60f1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:56.542114 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f47f2b95-abb5-447e-8c7e-1dfb10cd60f1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:56.893758 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-68e2e81d-ebac-4df7-8038-8b2fb3240fb7 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:56.916147 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-68e2e81d-ebac-4df7-8038-8b2fb3240fb7 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1211 microversion: 2.1 time: 0.410095 Oct 05 02:34:56.918071 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 915/1807] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:56 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1211 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:56.940785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4a6d790f-bc6d-401c-a36e-35ad70b027b5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:56.946407 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4a6d790f-bc6d-401c-a36e-35ad70b027b5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: f2e6dcdb-9664-46eb-b40d-58d894b62b47] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:56.969200 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a6d790f-bc6d-401c-a36e-35ad70b027b5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:56.970873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a6d790f-bc6d-401c-a36e-35ad70b027b5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:56.972461 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a6d790f-bc6d-401c-a36e-35ad70b027b5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:56.973773 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a6d790f-bc6d-401c-a36e-35ad70b027b5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:56.974493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a6d790f-bc6d-401c-a36e-35ad70b027b5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:56.975547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a6d790f-bc6d-401c-a36e-35ad70b027b5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:57.093986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f47f2b95-abb5-447e-8c7e-1dfb10cd60f1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:57.106847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f47f2b95-abb5-447e-8c7e-1dfb10cd60f1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:57.108405 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f47f2b95-abb5-447e-8c7e-1dfb10cd60f1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:57.110023 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f47f2b95-abb5-447e-8c7e-1dfb10cd60f1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1752 microversion: 2.20 time: 0.595531 Oct 05 02:34:57.110662 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 893/1808] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:56 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1752 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:34:57.127471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a3a259ff-67de-451c-a379-004f926461d3 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:57.128410 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a3a259ff-67de-451c-a379-004f926461d3 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:57.135560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3a259ff-67de-451c-a379-004f926461d3 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:57.136516 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3a259ff-67de-451c-a379-004f926461d3 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:57.137067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3a259ff-67de-451c-a379-004f926461d3 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:57.137865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3a259ff-67de-451c-a379-004f926461d3 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:57.138386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3a259ff-67de-451c-a379-004f926461d3 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:57.138877 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3a259ff-67de-451c-a379-004f926461d3 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:57.341707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4a6d790f-bc6d-401c-a36e-35ad70b027b5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:57.365391 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4a6d790f-bc6d-401c-a36e-35ad70b027b5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47" status: 200 len: 1308 microversion: 2.1 time: 0.432586 Oct 05 02:34:57.366141 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 916/1809] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:56 2022] GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47 => generated 1308 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:57.371873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-eb3e0d9a-8209-49e5-a8a8-fef9b3106be4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:57.372761 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-eb3e0d9a-8209-49e5-a8a8-fef9b3106be4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: 7b30cf01-6bc7-453f-b9f2-98400bcfc063] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:57.387895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb3e0d9a-8209-49e5-a8a8-fef9b3106be4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:57.388619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb3e0d9a-8209-49e5-a8a8-fef9b3106be4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:57.389306 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb3e0d9a-8209-49e5-a8a8-fef9b3106be4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:57.390190 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb3e0d9a-8209-49e5-a8a8-fef9b3106be4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:57.390874 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb3e0d9a-8209-49e5-a8a8-fef9b3106be4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:57.391472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb3e0d9a-8209-49e5-a8a8-fef9b3106be4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:57.439611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=4 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:34:57.463804 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=16 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:34:57.572137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a3a259ff-67de-451c-a379-004f926461d3 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:57.583526 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a3a259ff-67de-451c-a379-004f926461d3 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 200 len: 1325 microversion: 2.1 time: 0.471564 Oct 05 02:34:57.590304 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 894/1810] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:57 2022] GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 1325 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:57.609378 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-794c1527-dbda-439b-9ca2-201f6aa73d74 req-2b1e432f-aefb-4fc7-8ed5-feff1b5f3c1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39c77ec6-c103-4c7c-b7c0-0753dd0acf83", "tag": "13387ef9-e3f1-49ec-997f-e08850ebba60"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:57.630701 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-794c1527-dbda-439b-9ca2-201f6aa73d74 req-2b1e432f-aefb-4fc7-8ed5-feff1b5f3c1f service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:57.631400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-794c1527-dbda-439b-9ca2-201f6aa73d74 req-2b1e432f-aefb-4fc7-8ed5-feff1b5f3c1f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:57.632000 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-794c1527-dbda-439b-9ca2-201f6aa73d74 req-2b1e432f-aefb-4fc7-8ed5-feff1b5f3c1f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:57.647029 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-794c1527-dbda-439b-9ca2-201f6aa73d74 req-2b1e432f-aefb-4fc7-8ed5-feff1b5f3c1f service nova] Creating event network-changed:13387ef9-e3f1-49ec-997f-e08850ebba60 for instance 39c77ec6-c103-4c7c-b7c0-0753dd0acf83 on n-h1-858272-3 Oct 05 02:34:57.655024 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-794c1527-dbda-439b-9ca2-201f6aa73d74 req-2b1e432f-aefb-4fc7-8ed5-feff1b5f3c1f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066299 Oct 05 02:34:57.660974 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 895/1811] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:34:57.816637 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-eb3e0d9a-8209-49e5-a8a8-fef9b3106be4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f551e15d65a34daaac2b4d4f5963c522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7719a3153f66484c8758bb0999719851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:57.832679 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-eb3e0d9a-8209-49e5-a8a8-fef9b3106be4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063" status: 200 len: 1317 microversion: 2.1 time: 0.465171 Oct 05 02:34:57.850796 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 917/1812] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:57 2022] GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063 => generated 1317 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:57.941357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d4867005-b9c8-420e-9246-73c6cd57c202 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:57.942064 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d4867005-b9c8-420e-9246-73c6cd57c202 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:57.956801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4867005-b9c8-420e-9246-73c6cd57c202 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:57.957324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4867005-b9c8-420e-9246-73c6cd57c202 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:57.957763 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4867005-b9c8-420e-9246-73c6cd57c202 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:57.958470 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4867005-b9c8-420e-9246-73c6cd57c202 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:57.958925 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4867005-b9c8-420e-9246-73c6cd57c202 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:57.959351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4867005-b9c8-420e-9246-73c6cd57c202 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:58.139960 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-192d11b9-82b1-4726-b76c-e5cb7cacb88f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:58.140583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-192d11b9-82b1-4726-b76c-e5cb7cacb88f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:58.156149 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-192d11b9-82b1-4726-b76c-e5cb7cacb88f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:58.156640 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-192d11b9-82b1-4726-b76c-e5cb7cacb88f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:58.157112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-192d11b9-82b1-4726-b76c-e5cb7cacb88f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:58.157820 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-192d11b9-82b1-4726-b76c-e5cb7cacb88f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:58.158272 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-192d11b9-82b1-4726-b76c-e5cb7cacb88f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:58.158698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-192d11b9-82b1-4726-b76c-e5cb7cacb88f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:58.440988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d4867005-b9c8-420e-9246-73c6cd57c202 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:58.461905 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d4867005-b9c8-420e-9246-73c6cd57c202 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1211 microversion: 2.1 time: 0.525220 Oct 05 02:34:58.467210 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 896/1813] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:57 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1211 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:58.478573 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-417b054a-8f3b-4ac4-9fb9-fa4d69c12cd1 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:58.482355 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-417b054a-8f3b-4ac4-9fb9-fa4d69c12cd1 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: f2e6dcdb-9664-46eb-b40d-58d894b62b47] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:58.501097 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-417b054a-8f3b-4ac4-9fb9-fa4d69c12cd1 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:58.502402 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:34:58.503002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-417b054a-8f3b-4ac4-9fb9-fa4d69c12cd1 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:58.503703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-417b054a-8f3b-4ac4-9fb9-fa4d69c12cd1 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:58.508099 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-417b054a-8f3b-4ac4-9fb9-fa4d69c12cd1 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:58.508867 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-417b054a-8f3b-4ac4-9fb9-fa4d69c12cd1 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:58.509640 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-417b054a-8f3b-4ac4-9fb9-fa4d69c12cd1 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:58.821268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=22 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:34:58.943475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-192d11b9-82b1-4726-b76c-e5cb7cacb88f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:58.960467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-192d11b9-82b1-4726-b76c-e5cb7cacb88f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:58.966033 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-192d11b9-82b1-4726-b76c-e5cb7cacb88f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:58.967393 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-192d11b9-82b1-4726-b76c-e5cb7cacb88f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1808 microversion: 2.20 time: 0.832598 Oct 05 02:34:58.971639 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 918/1814] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:58 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1808 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:34:58.976653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-3c8a8a00-ed33-4572-8646-bb3ad40ad823 req-a855f825-eecd-4331-9701-734b053904fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b30cf01-6bc7-453f-b9f2-98400bcfc063", "name": "network-vif-plugged", "status": "completed", "tag": "8d0c6b53-f679-4ee4-afb3-4a4e905d5489"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:34:58.997193 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3c8a8a00-ed33-4572-8646-bb3ad40ad823 req-a855f825-eecd-4331-9701-734b053904fa service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:58.998221 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3c8a8a00-ed33-4572-8646-bb3ad40ad823 req-a855f825-eecd-4331-9701-734b053904fa service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:58.998826 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3c8a8a00-ed33-4572-8646-bb3ad40ad823 req-a855f825-eecd-4331-9701-734b053904fa service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:58.999388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-417b054a-8f3b-4ac4-9fb9-fa4d69c12cd1 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:59.009997 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-417b054a-8f3b-4ac4-9fb9-fa4d69c12cd1 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47" status: 200 len: 1308 microversion: 2.1 time: 0.541377 Oct 05 02:34:59.021829 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 897/1815] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:58 2022] GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47 => generated 1308 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:59.025115 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-3c8a8a00-ed33-4572-8646-bb3ad40ad823 req-a855f825-eecd-4331-9701-734b053904fa service nova] Creating event network-vif-plugged:8d0c6b53-f679-4ee4-afb3-4a4e905d5489 for instance 7b30cf01-6bc7-453f-b9f2-98400bcfc063 on n-h2-858272-3 Oct 05 02:34:59.032672 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f6e02c7b-8f5e-459f-982b-56832215ef5c tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:59.033310 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f6e02c7b-8f5e-459f-982b-56832215ef5c tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:59.038864 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-3c8a8a00-ed33-4572-8646-bb3ad40ad823 req-a855f825-eecd-4331-9701-734b053904fa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064883 Oct 05 02:34:59.040073 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 919/1816] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:34:59.047958 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8478d1cd-0678-4ed0-a914-04bf093ca4d7 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:59.048271 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6e02c7b-8f5e-459f-982b-56832215ef5c tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:59.048777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6e02c7b-8f5e-459f-982b-56832215ef5c tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:59.049256 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6e02c7b-8f5e-459f-982b-56832215ef5c tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:59.049888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8478d1cd-0678-4ed0-a914-04bf093ca4d7 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: 7b30cf01-6bc7-453f-b9f2-98400bcfc063] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:59.053392 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6e02c7b-8f5e-459f-982b-56832215ef5c tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:59.054686 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6e02c7b-8f5e-459f-982b-56832215ef5c tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:59.055561 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6e02c7b-8f5e-459f-982b-56832215ef5c tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:59.060031 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8478d1cd-0678-4ed0-a914-04bf093ca4d7 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:59.060864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8478d1cd-0678-4ed0-a914-04bf093ca4d7 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:59.061486 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8478d1cd-0678-4ed0-a914-04bf093ca4d7 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:59.062364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8478d1cd-0678-4ed0-a914-04bf093ca4d7 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:59.063131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8478d1cd-0678-4ed0-a914-04bf093ca4d7 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:59.063741 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8478d1cd-0678-4ed0-a914-04bf093ca4d7 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:59.112734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:34:59.791957 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8478d1cd-0678-4ed0-a914-04bf093ca4d7 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f551e15d65a34daaac2b4d4f5963c522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7719a3153f66484c8758bb0999719851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:59.804364 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8478d1cd-0678-4ed0-a914-04bf093ca4d7 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063" status: 200 len: 1317 microversion: 2.1 time: 0.762722 Oct 05 02:34:59.816926 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 920/1817] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:59 2022] GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063 => generated 1317 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:34:59.816926 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dd05d3da-6167-4214-9686-e332d7f04852 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:34:59.816926 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dd05d3da-6167-4214-9686-e332d7f04852 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:34:59.852352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f6e02c7b-8f5e-459f-982b-56832215ef5c tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:34:59.855692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd05d3da-6167-4214-9686-e332d7f04852 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:59.857550 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd05d3da-6167-4214-9686-e332d7f04852 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:59.858319 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd05d3da-6167-4214-9686-e332d7f04852 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:59.859764 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd05d3da-6167-4214-9686-e332d7f04852 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:34:59.860690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd05d3da-6167-4214-9686-e332d7f04852 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:34:59.861373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd05d3da-6167-4214-9686-e332d7f04852 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:34:59.861645 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f6e02c7b-8f5e-459f-982b-56832215ef5c tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 200 len: 1325 microversion: 2.1 time: 0.838642 Oct 05 02:34:59.862240 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 898/1818] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:59 2022] GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 1325 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:00.003947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dc69354d-2606-44e9-beb9-dbd628a6478a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:00.005319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-dc69354d-2606-44e9-beb9-dbd628a6478a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:00.026503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc69354d-2606-44e9-beb9-dbd628a6478a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:00.028341 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc69354d-2606-44e9-beb9-dbd628a6478a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:00.030272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc69354d-2606-44e9-beb9-dbd628a6478a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:00.032613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc69354d-2606-44e9-beb9-dbd628a6478a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:00.034718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc69354d-2606-44e9-beb9-dbd628a6478a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:00.036091 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc69354d-2606-44e9-beb9-dbd628a6478a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:00.050350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:35:00.266975 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dd05d3da-6167-4214-9686-e332d7f04852 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:00.278338 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dd05d3da-6167-4214-9686-e332d7f04852 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1211 microversion: 2.1 time: 0.470698 Oct 05 02:35:00.285329 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 921/1819] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:34:59 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1211 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:00.291367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-79e3a4bd-4aec-4d30-8854-2bc24ab4ab42 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:00.292233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-79e3a4bd-4aec-4d30-8854-2bc24ab4ab42 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: f2e6dcdb-9664-46eb-b40d-58d894b62b47] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:00.310279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-79e3a4bd-4aec-4d30-8854-2bc24ab4ab42 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:00.310909 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-79e3a4bd-4aec-4d30-8854-2bc24ab4ab42 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:00.311853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-79e3a4bd-4aec-4d30-8854-2bc24ab4ab42 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:00.314061 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-79e3a4bd-4aec-4d30-8854-2bc24ab4ab42 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:00.314984 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-79e3a4bd-4aec-4d30-8854-2bc24ab4ab42 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:00.315701 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-79e3a4bd-4aec-4d30-8854-2bc24ab4ab42 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:00.483630 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-dc69354d-2606-44e9-beb9-dbd628a6478a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:00.493655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-dc69354d-2606-44e9-beb9-dbd628a6478a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:00.499460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-dc69354d-2606-44e9-beb9-dbd628a6478a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:00.500929 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-dc69354d-2606-44e9-beb9-dbd628a6478a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1808 microversion: 2.20 time: 0.502324 Oct 05 02:35:00.504138 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 899/1820] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:34:59 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1808 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:35:00.518337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-56e2ea57-3c82-46f0-9390-f2026847cea8 req-488d50e7-3d51-4d63-b4da-2da9036dcff3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2e6dcdb-9664-46eb-b40d-58d894b62b47", "tag": "142146ee-f359-42c9-8f33-3302d82a8401"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:35:00.534328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-56e2ea57-3c82-46f0-9390-f2026847cea8 req-488d50e7-3d51-4d63-b4da-2da9036dcff3 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:00.534810 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-56e2ea57-3c82-46f0-9390-f2026847cea8 req-488d50e7-3d51-4d63-b4da-2da9036dcff3 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:00.535431 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-56e2ea57-3c82-46f0-9390-f2026847cea8 req-488d50e7-3d51-4d63-b4da-2da9036dcff3 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:00.556284 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-56e2ea57-3c82-46f0-9390-f2026847cea8 req-488d50e7-3d51-4d63-b4da-2da9036dcff3 service nova] Creating event network-changed:142146ee-f359-42c9-8f33-3302d82a8401 for instance f2e6dcdb-9664-46eb-b40d-58d894b62b47 on n-h1-858272-3 Oct 05 02:35:00.591065 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-56e2ea57-3c82-46f0-9390-f2026847cea8 req-488d50e7-3d51-4d63-b4da-2da9036dcff3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077674 Oct 05 02:35:00.591636 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-79e3a4bd-4aec-4d30-8854-2bc24ab4ab42 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:00.591806 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 900/1821] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:35:00.601849 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-79e3a4bd-4aec-4d30-8854-2bc24ab4ab42 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47" status: 200 len: 1308 microversion: 2.1 time: 0.315070 Oct 05 02:35:00.626499 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 922/1822] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:00 2022] GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47 => generated 1308 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:00.836221 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-de0d7635-837f-4b4d-ac25-1267078ffe3a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:00.837359 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-de0d7635-837f-4b4d-ac25-1267078ffe3a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: 7b30cf01-6bc7-453f-b9f2-98400bcfc063] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:00.855857 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de0d7635-837f-4b4d-ac25-1267078ffe3a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:00.857092 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de0d7635-837f-4b4d-ac25-1267078ffe3a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:00.857756 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de0d7635-837f-4b4d-ac25-1267078ffe3a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:00.858645 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de0d7635-837f-4b4d-ac25-1267078ffe3a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:00.859269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de0d7635-837f-4b4d-ac25-1267078ffe3a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:00.859970 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de0d7635-837f-4b4d-ac25-1267078ffe3a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:00.889275 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d98aa996-af46-4274-86c6-419d0b68078b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:00.890542 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d98aa996-af46-4274-86c6-419d0b68078b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:00.910838 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d98aa996-af46-4274-86c6-419d0b68078b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:00.911605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d98aa996-af46-4274-86c6-419d0b68078b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:00.912215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d98aa996-af46-4274-86c6-419d0b68078b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:00.913141 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d98aa996-af46-4274-86c6-419d0b68078b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:00.913860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d98aa996-af46-4274-86c6-419d0b68078b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:00.921412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d98aa996-af46-4274-86c6-419d0b68078b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:01.281424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d98aa996-af46-4274-86c6-419d0b68078b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:01.290162 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d98aa996-af46-4274-86c6-419d0b68078b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 200 len: 1325 microversion: 2.1 time: 0.404712 Oct 05 02:35:01.290766 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 923/1823] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:00 2022] GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 1325 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:35:01.312159 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6e190a1e-5ba7-49a8-be1f-b766ad46fc24 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:01.313598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6e190a1e-5ba7-49a8-be1f-b766ad46fc24 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:01.348565 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e190a1e-5ba7-49a8-be1f-b766ad46fc24 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:01.349113 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-de0d7635-837f-4b4d-ac25-1267078ffe3a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f551e15d65a34daaac2b4d4f5963c522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7719a3153f66484c8758bb0999719851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:01.349567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e190a1e-5ba7-49a8-be1f-b766ad46fc24 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:01.349847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e190a1e-5ba7-49a8-be1f-b766ad46fc24 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:01.350651 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e190a1e-5ba7-49a8-be1f-b766ad46fc24 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:01.351480 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e190a1e-5ba7-49a8-be1f-b766ad46fc24 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:01.353114 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e190a1e-5ba7-49a8-be1f-b766ad46fc24 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:01.358785 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-de0d7635-837f-4b4d-ac25-1267078ffe3a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063" status: 200 len: 1317 microversion: 2.1 time: 0.531826 Oct 05 02:35:01.362933 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 901/1824] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:00 2022] GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063 => generated 1317 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:01.531680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fb0227b8-f1e5-4691-9b8f-320a63b5ef70 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:01.533722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fb0227b8-f1e5-4691-9b8f-320a63b5ef70 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:01.546521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb0227b8-f1e5-4691-9b8f-320a63b5ef70 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:01.547399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb0227b8-f1e5-4691-9b8f-320a63b5ef70 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:01.548134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb0227b8-f1e5-4691-9b8f-320a63b5ef70 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:01.551390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb0227b8-f1e5-4691-9b8f-320a63b5ef70 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:01.552275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb0227b8-f1e5-4691-9b8f-320a63b5ef70 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:01.553655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb0227b8-f1e5-4691-9b8f-320a63b5ef70 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:01.780465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6e190a1e-5ba7-49a8-be1f-b766ad46fc24 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:01.789704 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6e190a1e-5ba7-49a8-be1f-b766ad46fc24 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1211 microversion: 2.1 time: 0.485850 Oct 05 02:35:01.790287 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 924/1825] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:01 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1211 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:01.800180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-621b5714-b826-4972-acff-12305589f310 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:01.812190 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-621b5714-b826-4972-acff-12305589f310 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: f2e6dcdb-9664-46eb-b40d-58d894b62b47] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:01.833380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-621b5714-b826-4972-acff-12305589f310 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:01.837754 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-621b5714-b826-4972-acff-12305589f310 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:01.842523 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-621b5714-b826-4972-acff-12305589f310 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:01.843591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-621b5714-b826-4972-acff-12305589f310 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:01.846459 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-621b5714-b826-4972-acff-12305589f310 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:01.848651 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-621b5714-b826-4972-acff-12305589f310 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:02.435628 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fb0227b8-f1e5-4691-9b8f-320a63b5ef70 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:02.450151 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fb0227b8-f1e5-4691-9b8f-320a63b5ef70 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:02.454658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fb0227b8-f1e5-4691-9b8f-320a63b5ef70 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:02.457278 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fb0227b8-f1e5-4691-9b8f-320a63b5ef70 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1808 microversion: 2.20 time: 0.929468 Oct 05 02:35:02.461269 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 902/1826] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:35:01 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1808 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:35:02.485251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-621b5714-b826-4972-acff-12305589f310 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:02.498417 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-621b5714-b826-4972-acff-12305589f310 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47" status: 200 len: 1308 microversion: 2.1 time: 0.704614 Oct 05 02:35:02.503428 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-38c6def6-3ff7-4f76-b4c0-9042e3e34042 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:02.505927 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 925/1827] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:01 2022] GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47 => generated 1308 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:02.512825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-38c6def6-3ff7-4f76-b4c0-9042e3e34042 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:02.522055 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-212cf8ab-f767-4f33-ab0a-268bfd245724 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:02.527346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-212cf8ab-f767-4f33-ab0a-268bfd245724 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: 7b30cf01-6bc7-453f-b9f2-98400bcfc063] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:02.539369 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-38c6def6-3ff7-4f76-b4c0-9042e3e34042 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:02.559708 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-212cf8ab-f767-4f33-ab0a-268bfd245724 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:02.560073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-38c6def6-3ff7-4f76-b4c0-9042e3e34042 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:02.561106 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-38c6def6-3ff7-4f76-b4c0-9042e3e34042 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:02.563324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-38c6def6-3ff7-4f76-b4c0-9042e3e34042 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:02.566987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-38c6def6-3ff7-4f76-b4c0-9042e3e34042 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:02.570301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-212cf8ab-f767-4f33-ab0a-268bfd245724 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:02.590305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-212cf8ab-f767-4f33-ab0a-268bfd245724 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:02.591339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-38c6def6-3ff7-4f76-b4c0-9042e3e34042 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:02.598095 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-212cf8ab-f767-4f33-ab0a-268bfd245724 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:02.600565 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-212cf8ab-f767-4f33-ab0a-268bfd245724 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:02.601297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-212cf8ab-f767-4f33-ab0a-268bfd245724 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:03.107699 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-212cf8ab-f767-4f33-ab0a-268bfd245724 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f551e15d65a34daaac2b4d4f5963c522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7719a3153f66484c8758bb0999719851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:03.116092 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-212cf8ab-f767-4f33-ab0a-268bfd245724 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063" status: 200 len: 1317 microversion: 2.1 time: 0.607729 Oct 05 02:35:03.121472 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 926/1828] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:02 2022] GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063 => generated 1317 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:03.145233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b3e84166-af30-4b29-99a0-316f52b7ec5e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:03.146126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b3e84166-af30-4b29-99a0-316f52b7ec5e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:03.163387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3e84166-af30-4b29-99a0-316f52b7ec5e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:03.169692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3e84166-af30-4b29-99a0-316f52b7ec5e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:03.170354 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3e84166-af30-4b29-99a0-316f52b7ec5e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:03.171247 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3e84166-af30-4b29-99a0-316f52b7ec5e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:03.171876 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3e84166-af30-4b29-99a0-316f52b7ec5e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:03.172492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3e84166-af30-4b29-99a0-316f52b7ec5e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:03.376223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-38c6def6-3ff7-4f76-b4c0-9042e3e34042 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:03.384596 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-38c6def6-3ff7-4f76-b4c0-9042e3e34042 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 200 len: 1325 microversion: 2.1 time: 0.887441 Oct 05 02:35:03.397955 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 903/1829] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:02 2022] GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 1325 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:03.492248 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-76edbd1e-f47d-4d9c-973d-0d44961ae2a8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:03.492963 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-76edbd1e-f47d-4d9c-973d-0d44961ae2a8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:03.502984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-76edbd1e-f47d-4d9c-973d-0d44961ae2a8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:03.503641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-76edbd1e-f47d-4d9c-973d-0d44961ae2a8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:03.513263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-76edbd1e-f47d-4d9c-973d-0d44961ae2a8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:03.514210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-76edbd1e-f47d-4d9c-973d-0d44961ae2a8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:03.514802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-76edbd1e-f47d-4d9c-973d-0d44961ae2a8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:03.515350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-76edbd1e-f47d-4d9c-973d-0d44961ae2a8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:03.724216 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b3e84166-af30-4b29-99a0-316f52b7ec5e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:03.739915 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b3e84166-af30-4b29-99a0-316f52b7ec5e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1211 microversion: 2.1 time: 0.616142 Oct 05 02:35:03.742571 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 927/1830] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:03 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1211 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:03.752116 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b1f83c3b-a845-4ee1-b238-f32bef784044 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:03.753184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b1f83c3b-a845-4ee1-b238-f32bef784044 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: f2e6dcdb-9664-46eb-b40d-58d894b62b47] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:03.761335 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b1f83c3b-a845-4ee1-b238-f32bef784044 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:03.763441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b1f83c3b-a845-4ee1-b238-f32bef784044 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:03.764585 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b1f83c3b-a845-4ee1-b238-f32bef784044 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:03.765635 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b1f83c3b-a845-4ee1-b238-f32bef784044 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:03.766275 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b1f83c3b-a845-4ee1-b238-f32bef784044 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:03.766878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b1f83c3b-a845-4ee1-b238-f32bef784044 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:04.340861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b1f83c3b-a845-4ee1-b238-f32bef784044 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:04.361832 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b1f83c3b-a845-4ee1-b238-f32bef784044 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47" status: 200 len: 1308 microversion: 2.1 time: 0.617011 Oct 05 02:35:04.371736 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 928/1831] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:03 2022] GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47 => generated 1308 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:04.384385 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e263b1ea-7624-4b04-aa24-89ba65714f78 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:04.385258 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e263b1ea-7624-4b04-aa24-89ba65714f78 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: 7b30cf01-6bc7-453f-b9f2-98400bcfc063] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:04.390278 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-76edbd1e-f47d-4d9c-973d-0d44961ae2a8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:04.398849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e263b1ea-7624-4b04-aa24-89ba65714f78 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:04.399348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e263b1ea-7624-4b04-aa24-89ba65714f78 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:04.399776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e263b1ea-7624-4b04-aa24-89ba65714f78 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:04.403614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e263b1ea-7624-4b04-aa24-89ba65714f78 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:04.407493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e263b1ea-7624-4b04-aa24-89ba65714f78 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:04.408363 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e263b1ea-7624-4b04-aa24-89ba65714f78 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:04.408810 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-76edbd1e-f47d-4d9c-973d-0d44961ae2a8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:04.410554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-76edbd1e-f47d-4d9c-973d-0d44961ae2a8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:04.413849 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-76edbd1e-f47d-4d9c-973d-0d44961ae2a8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1808 microversion: 2.20 time: 0.926057 Oct 05 02:35:04.420986 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 904/1832] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:35:03 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1808 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:35:04.426833 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6b561486-fff7-4cb4-a6d9-2ad5cbc87162 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:04.445862 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6b561486-fff7-4cb4-a6d9-2ad5cbc87162 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:04.456272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b561486-fff7-4cb4-a6d9-2ad5cbc87162 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:04.470000 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b561486-fff7-4cb4-a6d9-2ad5cbc87162 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:04.473379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b561486-fff7-4cb4-a6d9-2ad5cbc87162 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:04.476596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b561486-fff7-4cb4-a6d9-2ad5cbc87162 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:04.484644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b561486-fff7-4cb4-a6d9-2ad5cbc87162 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:04.493860 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b561486-fff7-4cb4-a6d9-2ad5cbc87162 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:04.905207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e263b1ea-7624-4b04-aa24-89ba65714f78 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f551e15d65a34daaac2b4d4f5963c522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7719a3153f66484c8758bb0999719851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:04.926396 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e263b1ea-7624-4b04-aa24-89ba65714f78 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063" status: 200 len: 1467 microversion: 2.1 time: 0.552714 Oct 05 02:35:04.927311 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 929/1833] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:04 2022] GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063 => generated 1467 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:04.932571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dcbb957c-7175-425b-84ff-2eaf9944a766 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:04.934429 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dcbb957c-7175-425b-84ff-2eaf9944a766 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:04.946237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dcbb957c-7175-425b-84ff-2eaf9944a766 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:04.946740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dcbb957c-7175-425b-84ff-2eaf9944a766 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:04.947180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dcbb957c-7175-425b-84ff-2eaf9944a766 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:04.947891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dcbb957c-7175-425b-84ff-2eaf9944a766 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:04.961640 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dcbb957c-7175-425b-84ff-2eaf9944a766 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:04.962584 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dcbb957c-7175-425b-84ff-2eaf9944a766 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:05.018335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6b561486-fff7-4cb4-a6d9-2ad5cbc87162 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:05.027677 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6b561486-fff7-4cb4-a6d9-2ad5cbc87162 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 200 len: 1325 microversion: 2.1 time: 0.604015 Oct 05 02:35:05.030379 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 905/1834] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:04 2022] GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 1325 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:05.035364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d11de2b6-99bd-4b97-8663-21e05f68bf57 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:05.036237 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d11de2b6-99bd-4b97-8663-21e05f68bf57 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: e123bb72-45c5-4371-bf2e-f0747497f16b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:05.044568 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d11de2b6-99bd-4b97-8663-21e05f68bf57 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:05.045538 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d11de2b6-99bd-4b97-8663-21e05f68bf57 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:05.046139 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d11de2b6-99bd-4b97-8663-21e05f68bf57 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:05.047167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d11de2b6-99bd-4b97-8663-21e05f68bf57 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:05.047903 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d11de2b6-99bd-4b97-8663-21e05f68bf57 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:05.048513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d11de2b6-99bd-4b97-8663-21e05f68bf57 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:05.275468 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d11de2b6-99bd-4b97-8663-21e05f68bf57 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f551e15d65a34daaac2b4d4f5963c522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7719a3153f66484c8758bb0999719851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:05.284450 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d11de2b6-99bd-4b97-8663-21e05f68bf57 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/servers/e123bb72-45c5-4371-bf2e-f0747497f16b" status: 200 len: 1467 microversion: 2.1 time: 0.252535 Oct 05 02:35:05.288339 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 906/1835] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:05 2022] GET /compute/v2.1/servers/e123bb72-45c5-4371-bf2e-f0747497f16b => generated 1467 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:05.304718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5cf90745-0028-4d6c-9f2e-c1c74932e86b tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:05.310662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5cf90745-0028-4d6c-9f2e-c1c74932e86b tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a262a7ca2be4451a89330098b6134c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a08a51781e84e1eb215037744ee3a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:05.313895 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5cf90745-0028-4d6c-9f2e-c1c74932e86b tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Searching by: {'deleted': False, 'project_id': '4a08a51781e84e1eb215037744ee3a7b'} {{(pid=122319) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:35:05.326073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5cf90745-0028-4d6c-9f2e-c1c74932e86b tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:05.326931 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dcbb957c-7175-425b-84ff-2eaf9944a766 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:05.329800 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5cf90745-0028-4d6c-9f2e-c1c74932e86b tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:05.333157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5cf90745-0028-4d6c-9f2e-c1c74932e86b tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:05.334208 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5cf90745-0028-4d6c-9f2e-c1c74932e86b tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:05.334852 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5cf90745-0028-4d6c-9f2e-c1c74932e86b tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:05.335257 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dcbb957c-7175-425b-84ff-2eaf9944a766 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1211 microversion: 2.1 time: 0.406894 Oct 05 02:35:05.335868 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5cf90745-0028-4d6c-9f2e-c1c74932e86b tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:05.340611 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 930/1836] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:04 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1211 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:05.358639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8ced02d6-8313-4131-916e-27b96e444b1d tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1729873936"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:35:05.364387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8ced02d6-8313-4131-916e-27b96e444b1d tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: e123bb72-45c5-4371-bf2e-f0747497f16b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:05.378440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ced02d6-8313-4131-916e-27b96e444b1d tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:05.379225 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ced02d6-8313-4131-916e-27b96e444b1d tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:05.380375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ced02d6-8313-4131-916e-27b96e444b1d tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:05.381327 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ced02d6-8313-4131-916e-27b96e444b1d tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:05.382030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ced02d6-8313-4131-916e-27b96e444b1d tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:05.382886 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ced02d6-8313-4131-916e-27b96e444b1d tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:05.474997 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.multi_cell_list [None req-5cf90745-0028-4d6c-9f2e-c1c74932e86b tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122319) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:35:05.551391 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5cf90745-0028-4d6c-9f2e-c1c74932e86b tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.261089 Oct 05 02:35:05.554181 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 907/1837] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 5 02:35:05 2022] GET /compute/v2.1/servers => generated 340 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:35:05.562042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b5191502-31d5-4fe9-a2d7-0651b805a165 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:05.562939 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b5191502-31d5-4fe9-a2d7-0651b805a165 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: f2e6dcdb-9664-46eb-b40d-58d894b62b47] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:05.570990 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5191502-31d5-4fe9-a2d7-0651b805a165 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:05.571714 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5191502-31d5-4fe9-a2d7-0651b805a165 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:05.572593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5191502-31d5-4fe9-a2d7-0651b805a165 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:05.574025 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5191502-31d5-4fe9-a2d7-0651b805a165 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:05.575865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5191502-31d5-4fe9-a2d7-0651b805a165 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:05.576566 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5191502-31d5-4fe9-a2d7-0651b805a165 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:05.721795 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8ced02d6-8313-4131-916e-27b96e444b1d tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "POST /compute/v2.1/servers/e123bb72-45c5-4371-bf2e-f0747497f16b/action" status: 202 len: 0 microversion: 2.1 time: 0.379531 Oct 05 02:35:05.722457 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 931/1838] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:35:05 2022] POST /compute/v2.1/servers/e123bb72-45c5-4371-bf2e-f0747497f16b/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 05 02:35:05.737664 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1a002f7e-7aff-480a-8d1b-12773097b50c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:05.739466 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1a002f7e-7aff-480a-8d1b-12773097b50c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:05.755866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a002f7e-7aff-480a-8d1b-12773097b50c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:05.758743 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a002f7e-7aff-480a-8d1b-12773097b50c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:05.759463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a002f7e-7aff-480a-8d1b-12773097b50c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:05.762650 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a002f7e-7aff-480a-8d1b-12773097b50c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:05.763337 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a002f7e-7aff-480a-8d1b-12773097b50c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:05.763960 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a002f7e-7aff-480a-8d1b-12773097b50c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:06.003881 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b5191502-31d5-4fe9-a2d7-0651b805a165 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:06.015676 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b5191502-31d5-4fe9-a2d7-0651b805a165 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47" status: 200 len: 1308 microversion: 2.1 time: 0.460036 Oct 05 02:35:06.016276 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 908/1839] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:05 2022] GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47 => generated 1308 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:06.029910 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0a404aa8-5afa-4fa6-8e1b-a38abc60aaec tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:06.055893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0a404aa8-5afa-4fa6-8e1b-a38abc60aaec tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a262a7ca2be4451a89330098b6134c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a08a51781e84e1eb215037744ee3a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:06.069730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0a404aa8-5afa-4fa6-8e1b-a38abc60aaec tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Searching by: {'deleted': False, 'project_id': '4a08a51781e84e1eb215037744ee3a7b'} {{(pid=122319) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:35:06.092221 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a404aa8-5afa-4fa6-8e1b-a38abc60aaec tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:06.093142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a404aa8-5afa-4fa6-8e1b-a38abc60aaec tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:06.093764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a404aa8-5afa-4fa6-8e1b-a38abc60aaec tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:06.095420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a404aa8-5afa-4fa6-8e1b-a38abc60aaec tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:06.102006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a404aa8-5afa-4fa6-8e1b-a38abc60aaec tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:06.102727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a404aa8-5afa-4fa6-8e1b-a38abc60aaec tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:06.169533 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1a002f7e-7aff-480a-8d1b-12773097b50c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:06.180244 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.multi_cell_list [None req-0a404aa8-5afa-4fa6-8e1b-a38abc60aaec tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122319) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:35:06.195514 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1a002f7e-7aff-480a-8d1b-12773097b50c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:06.197494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1a002f7e-7aff-480a-8d1b-12773097b50c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:06.203887 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1a002f7e-7aff-480a-8d1b-12773097b50c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1808 microversion: 2.20 time: 0.479472 Oct 05 02:35:06.219385 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 932/1840] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:35:05 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1808 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:35:06.243755 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-90b88255-f52c-4a77-b36c-b4f55c094f83 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce8263820>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:06.332418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0a404aa8-5afa-4fa6-8e1b-a38abc60aaec tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a262a7ca2be4451a89330098b6134c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a08a51781e84e1eb215037744ee3a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:06.343010 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-90b88255-f52c-4a77-b36c-b4f55c094f83 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad" status: 200 len: 1455 microversion: 2.1 time: 0.112289 Oct 05 02:35:06.345161 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 933/1841] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:06 2022] GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad => generated 1455 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:06.350777 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c56e2e7d-8f96-422c-be6c-4c55e6d589ed tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:06.355207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c56e2e7d-8f96-422c-be6c-4c55e6d589ed tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:06.361159 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a404aa8-5afa-4fa6-8e1b-a38abc60aaec tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:06.366106 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c56e2e7d-8f96-422c-be6c-4c55e6d589ed tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:06.366335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a404aa8-5afa-4fa6-8e1b-a38abc60aaec tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:06.367371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c56e2e7d-8f96-422c-be6c-4c55e6d589ed tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:06.368137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a404aa8-5afa-4fa6-8e1b-a38abc60aaec tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:06.373263 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c56e2e7d-8f96-422c-be6c-4c55e6d589ed tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:06.375177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c56e2e7d-8f96-422c-be6c-4c55e6d589ed tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:06.375177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c56e2e7d-8f96-422c-be6c-4c55e6d589ed tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:06.376371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c56e2e7d-8f96-422c-be6c-4c55e6d589ed tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:06.680554 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0a404aa8-5afa-4fa6-8e1b-a38abc60aaec tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.655476 Oct 05 02:35:06.681902 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 909/1842] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:35:06 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:06.688809 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-40c9b451-4cd0-4a9c-b77b-1383c9a942ce tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:06.690607 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-40c9b451-4cd0-4a9c-b77b-1383c9a942ce tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:06.708054 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40c9b451-4cd0-4a9c-b77b-1383c9a942ce tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:06.717713 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40c9b451-4cd0-4a9c-b77b-1383c9a942ce tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:06.718452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40c9b451-4cd0-4a9c-b77b-1383c9a942ce tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:06.719415 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40c9b451-4cd0-4a9c-b77b-1383c9a942ce tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:06.720224 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40c9b451-4cd0-4a9c-b77b-1383c9a942ce tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:06.722759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40c9b451-4cd0-4a9c-b77b-1383c9a942ce tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:06.763527 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c56e2e7d-8f96-422c-be6c-4c55e6d589ed tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:06.787771 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c56e2e7d-8f96-422c-be6c-4c55e6d589ed tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 200 len: 1325 microversion: 2.1 time: 0.441042 Oct 05 02:35:06.788744 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 934/1843] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:06 2022] GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 1325 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:06.794514 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-68b6a13b-46dd-46e8-8a22-e140e3c2904e req-efb3bfb2-8088-4b8a-909e-a2cde08b343f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39c77ec6-c103-4c7c-b7c0-0753dd0acf83", "name": "network-vif-plugged", "status": "completed", "tag": "13387ef9-e3f1-49ec-997f-e08850ebba60"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:35:06.805049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-68b6a13b-46dd-46e8-8a22-e140e3c2904e req-efb3bfb2-8088-4b8a-909e-a2cde08b343f service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:06.805792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-68b6a13b-46dd-46e8-8a22-e140e3c2904e req-efb3bfb2-8088-4b8a-909e-a2cde08b343f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:06.806384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-68b6a13b-46dd-46e8-8a22-e140e3c2904e req-efb3bfb2-8088-4b8a-909e-a2cde08b343f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:06.836207 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-68b6a13b-46dd-46e8-8a22-e140e3c2904e req-efb3bfb2-8088-4b8a-909e-a2cde08b343f service nova] Creating event network-vif-plugged:13387ef9-e3f1-49ec-997f-e08850ebba60 for instance 39c77ec6-c103-4c7c-b7c0-0753dd0acf83 on n-h1-858272-3 Oct 05 02:35:06.842421 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-68b6a13b-46dd-46e8-8a22-e140e3c2904e req-efb3bfb2-8088-4b8a-909e-a2cde08b343f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052222 Oct 05 02:35:06.843602 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 935/1844] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:35:06.852248 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-47f69bab-241d-465f-9255-a30b35024ff4 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:06.871613 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-47f69bab-241d-465f-9255-a30b35024ff4 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026336 Oct 05 02:35:06.873026 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 936/1845] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 5 02:35:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:35:06.933812 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-40c9b451-4cd0-4a9c-b77b-1383c9a942ce tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:06.950452 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-40c9b451-4cd0-4a9c-b77b-1383c9a942ce tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1211 microversion: 2.1 time: 0.266698 Oct 05 02:35:06.951117 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 910/1846] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:06 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1211 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:07.007962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-560d48dd-c003-4f0f-a9b0-28afca77e3f5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:07.008997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-560d48dd-c003-4f0f-a9b0-28afca77e3f5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:07.017285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-560d48dd-c003-4f0f-a9b0-28afca77e3f5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:07.018162 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-560d48dd-c003-4f0f-a9b0-28afca77e3f5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:07.018980 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-560d48dd-c003-4f0f-a9b0-28afca77e3f5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:07.019903 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-560d48dd-c003-4f0f-a9b0-28afca77e3f5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:07.020620 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-560d48dd-c003-4f0f-a9b0-28afca77e3f5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:07.021270 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-560d48dd-c003-4f0f-a9b0-28afca77e3f5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:07.045165 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-65abd6e3-385f-494d-99ad-ad6194a22ced tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:07.046145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-65abd6e3-385f-494d-99ad-ad6194a22ced tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: f2e6dcdb-9664-46eb-b40d-58d894b62b47] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:07.058763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-560d48dd-c003-4f0f-a9b0-28afca77e3f5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:35:07.062525 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65abd6e3-385f-494d-99ad-ad6194a22ced tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:07.063450 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65abd6e3-385f-494d-99ad-ad6194a22ced tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:07.064233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65abd6e3-385f-494d-99ad-ad6194a22ced tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:07.065312 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65abd6e3-385f-494d-99ad-ad6194a22ced tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:07.066022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65abd6e3-385f-494d-99ad-ad6194a22ced tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:07.066689 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65abd6e3-385f-494d-99ad-ad6194a22ced tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:07.110646 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:35:07.183976 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-560d48dd-c003-4f0f-a9b0-28afca77e3f5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 204 len: 0 microversion: 2.25 time: 0.179731 Oct 05 02:35:07.188723 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 937/1847] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 5 02:35:07 2022] DELETE /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 02:35:07.194948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6a7834dd-9d0f-4ac9-b8bd-a742d38576e4 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:07.195820 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6a7834dd-9d0f-4ac9-b8bd-a742d38576e4 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] [instance: b11969e1-8fcb-4287-8d5b-070809e1e452] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:07.203029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a7834dd-9d0f-4ac9-b8bd-a742d38576e4 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:07.203533 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a7834dd-9d0f-4ac9-b8bd-a742d38576e4 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:07.203973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a7834dd-9d0f-4ac9-b8bd-a742d38576e4 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:07.204682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a7834dd-9d0f-4ac9-b8bd-a742d38576e4 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:07.205245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a7834dd-9d0f-4ac9-b8bd-a742d38576e4 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:07.205738 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a7834dd-9d0f-4ac9-b8bd-a742d38576e4 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:07.249925 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6a7834dd-9d0f-4ac9-b8bd-a742d38576e4 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] [instance: b11969e1-8fcb-4287-8d5b-070809e1e452] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:35:07.292404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-65abd6e3-385f-494d-99ad-ad6194a22ced tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:07.312044 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-65abd6e3-385f-494d-99ad-ad6194a22ced tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47" status: 200 len: 1308 microversion: 2.1 time: 0.271983 Oct 05 02:35:07.330874 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 911/1848] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:07 2022] GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47 => generated 1308 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:07.341370 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6e619c61-9a7e-44d3-9b8b-555e7ba7f9cf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:07.342435 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6e619c61-9a7e-44d3-9b8b-555e7ba7f9cf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:07.348827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e619c61-9a7e-44d3-9b8b-555e7ba7f9cf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:07.349723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e619c61-9a7e-44d3-9b8b-555e7ba7f9cf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:07.350415 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e619c61-9a7e-44d3-9b8b-555e7ba7f9cf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:07.351361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e619c61-9a7e-44d3-9b8b-555e7ba7f9cf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:07.352046 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e619c61-9a7e-44d3-9b8b-555e7ba7f9cf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:07.352804 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e619c61-9a7e-44d3-9b8b-555e7ba7f9cf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:07.491498 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6a7834dd-9d0f-4ac9-b8bd-a742d38576e4 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452" status: 204 len: 0 microversion: 2.1 time: 0.298775 Oct 05 02:35:07.492792 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 938/1849] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:35:07 2022] DELETE /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:35:07.501758 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-34d1ee74-043e-4f67-afe3-fa9ecc551ba9 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:07.502473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-34d1ee74-043e-4f67-afe3-fa9ecc551ba9 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:07.519224 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34d1ee74-043e-4f67-afe3-fa9ecc551ba9 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:07.520418 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34d1ee74-043e-4f67-afe3-fa9ecc551ba9 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:07.523542 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34d1ee74-043e-4f67-afe3-fa9ecc551ba9 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:07.525552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34d1ee74-043e-4f67-afe3-fa9ecc551ba9 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:07.527248 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34d1ee74-043e-4f67-afe3-fa9ecc551ba9 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:07.529280 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34d1ee74-043e-4f67-afe3-fa9ecc551ba9 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:07.638702 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6e619c61-9a7e-44d3-9b8b-555e7ba7f9cf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:07.653549 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6e619c61-9a7e-44d3-9b8b-555e7ba7f9cf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:07.655526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6e619c61-9a7e-44d3-9b8b-555e7ba7f9cf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:07.660543 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6e619c61-9a7e-44d3-9b8b-555e7ba7f9cf tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1732 microversion: 2.25 time: 0.328134 Oct 05 02:35:07.661983 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 912/1850] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:35:07 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1732 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:35:07.666795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2151d709-e44d-4a0d-bf84-238943ba2d44 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce80c4280>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:07.793014 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2151d709-e44d-4a0d-bf84-238943ba2d44 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad" status: 200 len: 1455 microversion: 2.1 time: 0.113312 Oct 05 02:35:07.800183 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 913/1851] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:07 2022] GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad => generated 1455 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:07.820695 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ab6a9595-bbe3-4e11-8e74-6475448259f8 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:07.825029 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ab6a9595-bbe3-4e11-8e74-6475448259f8 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] [instance: b11969e1-8fcb-4287-8d5b-070809e1e452] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:07.844191 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab6a9595-bbe3-4e11-8e74-6475448259f8 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:07.844920 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab6a9595-bbe3-4e11-8e74-6475448259f8 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:07.851130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab6a9595-bbe3-4e11-8e74-6475448259f8 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:07.851895 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab6a9595-bbe3-4e11-8e74-6475448259f8 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:07.852364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab6a9595-bbe3-4e11-8e74-6475448259f8 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:07.853143 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab6a9595-bbe3-4e11-8e74-6475448259f8 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:07.943362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-34d1ee74-043e-4f67-afe3-fa9ecc551ba9 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:07.963021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-34d1ee74-043e-4f67-afe3-fa9ecc551ba9 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:07.966046 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-34d1ee74-043e-4f67-afe3-fa9ecc551ba9 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:07.969883 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-34d1ee74-043e-4f67-afe3-fa9ecc551ba9 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1808 microversion: 2.20 time: 0.475434 Oct 05 02:35:07.972067 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 939/1852] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:35:07 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1808 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:35:07.985147 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c48e5081-2e88-49e9-97cd-b2df16dbf785 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:07.986061 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c48e5081-2e88-49e9-97cd-b2df16dbf785 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:07.998294 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:35:08.000114 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c48e5081-2e88-49e9-97cd-b2df16dbf785 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:08.000811 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c48e5081-2e88-49e9-97cd-b2df16dbf785 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:08.001768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c48e5081-2e88-49e9-97cd-b2df16dbf785 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:08.002903 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c48e5081-2e88-49e9-97cd-b2df16dbf785 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:08.003721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c48e5081-2e88-49e9-97cd-b2df16dbf785 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:08.004336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c48e5081-2e88-49e9-97cd-b2df16dbf785 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:08.143062 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ab6a9595-bbe3-4e11-8e74-6475448259f8 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a262a7ca2be4451a89330098b6134c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a08a51781e84e1eb215037744ee3a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:08.152966 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ab6a9595-bbe3-4e11-8e74-6475448259f8 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452" status: 200 len: 1713 microversion: 2.1 time: 0.350970 Oct 05 02:35:08.170886 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 914/1853] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:07 2022] GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452 => generated 1713 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:08.176210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fd2be2c1-d0d2-4f0e-b274-3217e87c9844 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:08.177755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fd2be2c1-d0d2-4f0e-b274-3217e87c9844 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:08.186287 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fd2be2c1-d0d2-4f0e-b274-3217e87c9844 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:08.187133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fd2be2c1-d0d2-4f0e-b274-3217e87c9844 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:08.187868 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fd2be2c1-d0d2-4f0e-b274-3217e87c9844 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:08.188964 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fd2be2c1-d0d2-4f0e-b274-3217e87c9844 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:08.189660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fd2be2c1-d0d2-4f0e-b274-3217e87c9844 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:08.190387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fd2be2c1-d0d2-4f0e-b274-3217e87c9844 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:08.314546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c48e5081-2e88-49e9-97cd-b2df16dbf785 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:08.323951 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c48e5081-2e88-49e9-97cd-b2df16dbf785 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 200 len: 1325 microversion: 2.1 time: 0.348076 Oct 05 02:35:08.337938 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 940/1854] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:07 2022] GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 1325 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:08.346683 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-27be6bec-84b0-46d6-9f6b-9a61db539c51 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:08.347306 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-27be6bec-84b0-46d6-9f6b-9a61db539c51 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: f2e6dcdb-9664-46eb-b40d-58d894b62b47] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:08.355166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27be6bec-84b0-46d6-9f6b-9a61db539c51 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:08.355664 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27be6bec-84b0-46d6-9f6b-9a61db539c51 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:08.356168 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27be6bec-84b0-46d6-9f6b-9a61db539c51 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:08.356874 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27be6bec-84b0-46d6-9f6b-9a61db539c51 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:08.357357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27be6bec-84b0-46d6-9f6b-9a61db539c51 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:08.358187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27be6bec-84b0-46d6-9f6b-9a61db539c51 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:08.429037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fd2be2c1-d0d2-4f0e-b274-3217e87c9844 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:08.440792 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fd2be2c1-d0d2-4f0e-b274-3217e87c9844 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1199 microversion: 2.1 time: 0.268377 Oct 05 02:35:08.468178 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 915/1855] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:08 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1199 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:08.561902 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-27be6bec-84b0-46d6-9f6b-9a61db539c51 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:08.570594 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-27be6bec-84b0-46d6-9f6b-9a61db539c51 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47" status: 200 len: 1308 microversion: 2.1 time: 0.231348 Oct 05 02:35:08.582517 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 941/1856] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:08 2022] GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47 => generated 1308 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:08.694002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-58739ded-0b7c-4dd7-aa25-db1e16a7efde tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:08.694983 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-58739ded-0b7c-4dd7-aa25-db1e16a7efde tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:08.706862 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58739ded-0b7c-4dd7-aa25-db1e16a7efde tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:08.707649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58739ded-0b7c-4dd7-aa25-db1e16a7efde tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:08.707806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58739ded-0b7c-4dd7-aa25-db1e16a7efde tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:08.708553 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58739ded-0b7c-4dd7-aa25-db1e16a7efde tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:08.709364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58739ded-0b7c-4dd7-aa25-db1e16a7efde tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:08.709364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58739ded-0b7c-4dd7-aa25-db1e16a7efde tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:08.725090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:35:08.818907 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-23953cf9-574f-4749-98fa-8caa943427c9 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce80e23a0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:08.898176 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-23953cf9-574f-4749-98fa-8caa943427c9 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad" status: 200 len: 1455 microversion: 2.1 time: 0.085755 Oct 05 02:35:08.898728 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-58739ded-0b7c-4dd7-aa25-db1e16a7efde tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:08.899505 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 942/1857] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:08 2022] GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:08.907721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-58739ded-0b7c-4dd7-aa25-db1e16a7efde tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:08.909515 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-58739ded-0b7c-4dd7-aa25-db1e16a7efde tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:08.910931 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-58739ded-0b7c-4dd7-aa25-db1e16a7efde tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1732 microversion: 2.25 time: 0.221596 Oct 05 02:35:08.912018 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 916/1858] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:35:08 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1732 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:35:09.002259 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f8a94a5a-fc91-4c25-a1de-444d8e4c9937 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:09.002862 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f8a94a5a-fc91-4c25-a1de-444d8e4c9937 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:09.008925 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8a94a5a-fc91-4c25-a1de-444d8e4c9937 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:09.009412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8a94a5a-fc91-4c25-a1de-444d8e4c9937 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:09.009841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8a94a5a-fc91-4c25-a1de-444d8e4c9937 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:09.010510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8a94a5a-fc91-4c25-a1de-444d8e4c9937 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:09.010956 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8a94a5a-fc91-4c25-a1de-444d8e4c9937 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:09.011372 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8a94a5a-fc91-4c25-a1de-444d8e4c9937 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:09.161663 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f8a94a5a-fc91-4c25-a1de-444d8e4c9937 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:09.171638 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f8a94a5a-fc91-4c25-a1de-444d8e4c9937 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:09.173105 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f8a94a5a-fc91-4c25-a1de-444d8e4c9937 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:09.174269 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f8a94a5a-fc91-4c25-a1de-444d8e4c9937 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1808 microversion: 2.20 time: 0.175945 Oct 05 02:35:09.174829 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 943/1859] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:35:08 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:35:09.183103 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-17bada59-e703-463b-b3ff-d37b9bd9df8a tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:09.183723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-17bada59-e703-463b-b3ff-d37b9bd9df8a tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] [instance: b11969e1-8fcb-4287-8d5b-070809e1e452] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:09.195614 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17bada59-e703-463b-b3ff-d37b9bd9df8a tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:09.196522 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17bada59-e703-463b-b3ff-d37b9bd9df8a tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:09.196988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17bada59-e703-463b-b3ff-d37b9bd9df8a tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:09.197701 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17bada59-e703-463b-b3ff-d37b9bd9df8a tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:09.198479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17bada59-e703-463b-b3ff-d37b9bd9df8a tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:09.199502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17bada59-e703-463b-b3ff-d37b9bd9df8a tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:09.349625 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-17bada59-e703-463b-b3ff-d37b9bd9df8a tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a262a7ca2be4451a89330098b6134c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a08a51781e84e1eb215037744ee3a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:09.351869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-642baaf7-8fbb-4ded-9982-db44c1e9e25b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:09.352565 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-642baaf7-8fbb-4ded-9982-db44c1e9e25b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:09.359772 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-17bada59-e703-463b-b3ff-d37b9bd9df8a tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452" status: 200 len: 1713 microversion: 2.1 time: 0.181355 Oct 05 02:35:09.360621 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 917/1860] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:09 2022] GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452 => generated 1713 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:09.361232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-642baaf7-8fbb-4ded-9982-db44c1e9e25b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:09.361884 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-642baaf7-8fbb-4ded-9982-db44c1e9e25b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:09.362413 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-642baaf7-8fbb-4ded-9982-db44c1e9e25b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:09.363243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-642baaf7-8fbb-4ded-9982-db44c1e9e25b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:09.363801 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-642baaf7-8fbb-4ded-9982-db44c1e9e25b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:09.364346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-642baaf7-8fbb-4ded-9982-db44c1e9e25b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:09.473275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c459bbeb-b510-40ff-8326-d9b71f9b4d7b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:09.473992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c459bbeb-b510-40ff-8326-d9b71f9b4d7b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:09.480973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c459bbeb-b510-40ff-8326-d9b71f9b4d7b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:09.481462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c459bbeb-b510-40ff-8326-d9b71f9b4d7b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:09.482077 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c459bbeb-b510-40ff-8326-d9b71f9b4d7b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:09.482792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c459bbeb-b510-40ff-8326-d9b71f9b4d7b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:09.483241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c459bbeb-b510-40ff-8326-d9b71f9b4d7b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:09.483661 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c459bbeb-b510-40ff-8326-d9b71f9b4d7b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:09.519139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-642baaf7-8fbb-4ded-9982-db44c1e9e25b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:09.528789 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-642baaf7-8fbb-4ded-9982-db44c1e9e25b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 200 len: 1325 microversion: 2.1 time: 0.180816 Oct 05 02:35:09.544204 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 944/1861] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:09 2022] GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 1325 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:09.595408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-450e4e48-3037-4620-8f23-bee4ba06f3e0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:09.596026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-450e4e48-3037-4620-8f23-bee4ba06f3e0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: f2e6dcdb-9664-46eb-b40d-58d894b62b47] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:09.602216 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-450e4e48-3037-4620-8f23-bee4ba06f3e0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:09.602718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-450e4e48-3037-4620-8f23-bee4ba06f3e0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:09.603119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-450e4e48-3037-4620-8f23-bee4ba06f3e0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:09.603819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-450e4e48-3037-4620-8f23-bee4ba06f3e0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:09.605279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-450e4e48-3037-4620-8f23-bee4ba06f3e0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:09.605493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-450e4e48-3037-4620-8f23-bee4ba06f3e0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:09.646869 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c459bbeb-b510-40ff-8326-d9b71f9b4d7b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:09.658525 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c459bbeb-b510-40ff-8326-d9b71f9b4d7b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1199 microversion: 2.1 time: 0.192961 Oct 05 02:35:09.659330 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 918/1862] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:09 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1199 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:09.748835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-450e4e48-3037-4620-8f23-bee4ba06f3e0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:09.756501 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-450e4e48-3037-4620-8f23-bee4ba06f3e0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47" status: 200 len: 1308 microversion: 2.1 time: 0.164943 Oct 05 02:35:09.757100 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 945/1863] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:09 2022] GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47 => generated 1308 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:35:09.914930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6ad2d2ac-93f7-4187-8a87-adf8fdd9b9c2 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce80c4b80>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:09.940622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c62d8075-38ce-49b2-9436-83936236a314 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:09.941361 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c62d8075-38ce-49b2-9436-83936236a314 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:09.948238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c62d8075-38ce-49b2-9436-83936236a314 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:09.949426 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c62d8075-38ce-49b2-9436-83936236a314 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:09.949794 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c62d8075-38ce-49b2-9436-83936236a314 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:09.950845 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c62d8075-38ce-49b2-9436-83936236a314 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:09.951512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c62d8075-38ce-49b2-9436-83936236a314 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:09.951762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c62d8075-38ce-49b2-9436-83936236a314 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:09.961036 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6ad2d2ac-93f7-4187-8a87-adf8fdd9b9c2 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad" status: 200 len: 1455 microversion: 2.1 time: 0.049856 Oct 05 02:35:09.961624 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 919/1864] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:09 2022] GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad => generated 1455 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:35:10.086241 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c62d8075-38ce-49b2-9436-83936236a314 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:10.095012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c62d8075-38ce-49b2-9436-83936236a314 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:10.096470 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c62d8075-38ce-49b2-9436-83936236a314 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:10.097673 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c62d8075-38ce-49b2-9436-83936236a314 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1732 microversion: 2.25 time: 0.161446 Oct 05 02:35:10.098246 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 946/1865] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:35:09 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:35:10.202084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a8e10a0c-7e9a-44ac-8fba-edc893b027e7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:10.202704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a8e10a0c-7e9a-44ac-8fba-edc893b027e7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:10.208878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8e10a0c-7e9a-44ac-8fba-edc893b027e7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:10.209431 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8e10a0c-7e9a-44ac-8fba-edc893b027e7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:10.209876 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8e10a0c-7e9a-44ac-8fba-edc893b027e7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:10.210573 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8e10a0c-7e9a-44ac-8fba-edc893b027e7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:10.211033 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8e10a0c-7e9a-44ac-8fba-edc893b027e7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:10.211463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8e10a0c-7e9a-44ac-8fba-edc893b027e7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:10.343471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a8e10a0c-7e9a-44ac-8fba-edc893b027e7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:10.352099 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a8e10a0c-7e9a-44ac-8fba-edc893b027e7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:10.353554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a8e10a0c-7e9a-44ac-8fba-edc893b027e7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:10.354951 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a8e10a0c-7e9a-44ac-8fba-edc893b027e7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1808 microversion: 2.20 time: 0.158520 Oct 05 02:35:10.355506 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 920/1866] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:35:10 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:35:10.383399 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-86a1c63e-a72f-496c-b8c1-9ec9dab509b0 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:10.384009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-86a1c63e-a72f-496c-b8c1-9ec9dab509b0 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] [instance: b11969e1-8fcb-4287-8d5b-070809e1e452] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:10.390471 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-86a1c63e-a72f-496c-b8c1-9ec9dab509b0 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:10.390949 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-86a1c63e-a72f-496c-b8c1-9ec9dab509b0 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:10.391376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-86a1c63e-a72f-496c-b8c1-9ec9dab509b0 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:10.392054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-86a1c63e-a72f-496c-b8c1-9ec9dab509b0 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:10.392501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-86a1c63e-a72f-496c-b8c1-9ec9dab509b0 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:10.392947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-86a1c63e-a72f-496c-b8c1-9ec9dab509b0 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:10.520927 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-86a1c63e-a72f-496c-b8c1-9ec9dab509b0 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a262a7ca2be4451a89330098b6134c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a08a51781e84e1eb215037744ee3a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:10.528684 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-86a1c63e-a72f-496c-b8c1-9ec9dab509b0 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452" status: 200 len: 1713 microversion: 2.1 time: 0.149107 Oct 05 02:35:10.529287 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 947/1867] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:10 2022] GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452 => generated 1713 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:10.555293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7cb1e912-3641-47b3-87b3-a7a1e0312e80 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:10.555913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7cb1e912-3641-47b3-87b3-a7a1e0312e80 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:10.563464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7cb1e912-3641-47b3-87b3-a7a1e0312e80 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:10.563947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7cb1e912-3641-47b3-87b3-a7a1e0312e80 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:10.564384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7cb1e912-3641-47b3-87b3-a7a1e0312e80 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:10.565111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7cb1e912-3641-47b3-87b3-a7a1e0312e80 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:10.565569 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7cb1e912-3641-47b3-87b3-a7a1e0312e80 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:10.565995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7cb1e912-3641-47b3-87b3-a7a1e0312e80 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:10.681072 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5043be5b-f0e8-4708-9de5-7ee45a1071ac tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:10.681721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5043be5b-f0e8-4708-9de5-7ee45a1071ac tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:10.688102 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5043be5b-f0e8-4708-9de5-7ee45a1071ac tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:10.688583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5043be5b-f0e8-4708-9de5-7ee45a1071ac tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:10.689108 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5043be5b-f0e8-4708-9de5-7ee45a1071ac tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:10.689791 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5043be5b-f0e8-4708-9de5-7ee45a1071ac tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:10.690240 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5043be5b-f0e8-4708-9de5-7ee45a1071ac tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:10.690656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5043be5b-f0e8-4708-9de5-7ee45a1071ac tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:11.002051 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7cb1e912-3641-47b3-87b3-a7a1e0312e80 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:11.012540 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7cb1e912-3641-47b3-87b3-a7a1e0312e80 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 200 len: 1325 microversion: 2.1 time: 0.460978 Oct 05 02:35:11.013355 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 921/1868] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:10 2022] GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 1325 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:11.018175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cd67b208-d1b3-47b3-bb9e-04318bcff5a0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:11.019088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cd67b208-d1b3-47b3-bb9e-04318bcff5a0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: f2e6dcdb-9664-46eb-b40d-58d894b62b47] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:11.025117 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd67b208-d1b3-47b3-bb9e-04318bcff5a0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:11.025736 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd67b208-d1b3-47b3-bb9e-04318bcff5a0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:11.026404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd67b208-d1b3-47b3-bb9e-04318bcff5a0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:11.027801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd67b208-d1b3-47b3-bb9e-04318bcff5a0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:11.028361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd67b208-d1b3-47b3-bb9e-04318bcff5a0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:11.028892 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd67b208-d1b3-47b3-bb9e-04318bcff5a0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:11.155775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5043be5b-f0e8-4708-9de5-7ee45a1071ac tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:11.164042 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5043be5b-f0e8-4708-9de5-7ee45a1071ac tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1199 microversion: 2.1 time: 0.486777 Oct 05 02:35:11.164638 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 948/1869] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:10 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1199 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:35:11.171686 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-23b45f62-5541-4be8-881b-3d34f2ad0587 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce4256280>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:11.225175 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-23b45f62-5541-4be8-881b-3d34f2ad0587 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad" status: 200 len: 1455 microversion: 2.1 time: 0.058395 Oct 05 02:35:11.225739 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 949/1870] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:11 2022] GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad => generated 1455 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:11.231223 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-56c41a19-5eb1-411c-b325-4bb37dc089be tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:11.231847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-56c41a19-5eb1-411c-b325-4bb37dc089be tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:11.239115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56c41a19-5eb1-411c-b325-4bb37dc089be tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:11.239730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56c41a19-5eb1-411c-b325-4bb37dc089be tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:11.240240 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56c41a19-5eb1-411c-b325-4bb37dc089be tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:11.241054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56c41a19-5eb1-411c-b325-4bb37dc089be tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:11.241589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56c41a19-5eb1-411c-b325-4bb37dc089be tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:11.242907 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56c41a19-5eb1-411c-b325-4bb37dc089be tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:11.456107 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cd67b208-d1b3-47b3-bb9e-04318bcff5a0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:11.464726 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cd67b208-d1b3-47b3-bb9e-04318bcff5a0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47" status: 200 len: 1308 microversion: 2.1 time: 0.450043 Oct 05 02:35:11.465343 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 922/1871] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:11 2022] GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47 => generated 1308 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:11.472261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9831f217-d2b1-47f9-82eb-7e9eeaf9f72d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:11.473223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9831f217-d2b1-47f9-82eb-7e9eeaf9f72d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:11.481925 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9831f217-d2b1-47f9-82eb-7e9eeaf9f72d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:11.482518 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9831f217-d2b1-47f9-82eb-7e9eeaf9f72d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:11.483022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9831f217-d2b1-47f9-82eb-7e9eeaf9f72d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:11.483785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9831f217-d2b1-47f9-82eb-7e9eeaf9f72d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:11.484347 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9831f217-d2b1-47f9-82eb-7e9eeaf9f72d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:11.484833 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9831f217-d2b1-47f9-82eb-7e9eeaf9f72d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:11.688092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-56c41a19-5eb1-411c-b325-4bb37dc089be tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:11.707822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-56c41a19-5eb1-411c-b325-4bb37dc089be tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:11.709613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-56c41a19-5eb1-411c-b325-4bb37dc089be tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:11.711119 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-56c41a19-5eb1-411c-b325-4bb37dc089be tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1732 microversion: 2.25 time: 0.484384 Oct 05 02:35:11.711928 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 950/1872] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:35:11 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1732 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:35:11.720229 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4c4b1904-e343-4b6e-a1d8-45cda9df48a5 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:11.721219 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4c4b1904-e343-4b6e-a1d8-45cda9df48a5 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] [instance: b11969e1-8fcb-4287-8d5b-070809e1e452] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:11.733779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c4b1904-e343-4b6e-a1d8-45cda9df48a5 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:11.734717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c4b1904-e343-4b6e-a1d8-45cda9df48a5 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:11.735410 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c4b1904-e343-4b6e-a1d8-45cda9df48a5 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:11.736390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c4b1904-e343-4b6e-a1d8-45cda9df48a5 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:11.737222 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c4b1904-e343-4b6e-a1d8-45cda9df48a5 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:11.737904 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c4b1904-e343-4b6e-a1d8-45cda9df48a5 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:11.805747 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9831f217-d2b1-47f9-82eb-7e9eeaf9f72d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:11.815988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9831f217-d2b1-47f9-82eb-7e9eeaf9f72d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:11.817581 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9831f217-d2b1-47f9-82eb-7e9eeaf9f72d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:11.818837 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9831f217-d2b1-47f9-82eb-7e9eeaf9f72d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1808 microversion: 2.20 time: 0.352293 Oct 05 02:35:11.820214 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 923/1873] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:35:11 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1808 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:35:11.942996 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-fb863f99-5208-4c79-86fb-d2503e89f922 req-ef0616f1-1e86-400b-9659-d23f921d8b09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d497c63f-2a3d-4dbd-95d5-d2b90e743ac0", "name": "network-vif-deleted", "tag": "3a205846-298f-466b-b6e3-8f110f0f22de"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:35:11.951412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4c4b1904-e343-4b6e-a1d8-45cda9df48a5 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a262a7ca2be4451a89330098b6134c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a08a51781e84e1eb215037744ee3a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:11.956734 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-fb863f99-5208-4c79-86fb-d2503e89f922 req-ef0616f1-1e86-400b-9659-d23f921d8b09 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:11.957401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-fb863f99-5208-4c79-86fb-d2503e89f922 req-ef0616f1-1e86-400b-9659-d23f921d8b09 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:11.957735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-fb863f99-5208-4c79-86fb-d2503e89f922 req-ef0616f1-1e86-400b-9659-d23f921d8b09 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:11.961322 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4c4b1904-e343-4b6e-a1d8-45cda9df48a5 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452" status: 200 len: 1713 microversion: 2.1 time: 0.248116 Oct 05 02:35:11.961920 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 951/1874] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:11 2022] GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452 => generated 1713 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:11.989106 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-fb863f99-5208-4c79-86fb-d2503e89f922 req-ef0616f1-1e86-400b-9659-d23f921d8b09 service nova] Creating event network-vif-deleted:3a205846-298f-466b-b6e3-8f110f0f22de for instance d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 on n-h1-858272-3 Oct 05 02:35:11.994518 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-fb863f99-5208-4c79-86fb-d2503e89f922 req-ef0616f1-1e86-400b-9659-d23f921d8b09 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055390 Oct 05 02:35:11.996709 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 924/1875] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:35:12.035937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bf557668-4485-4709-bd14-9733689035e4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:12.036991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bf557668-4485-4709-bd14-9733689035e4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:12.043661 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf557668-4485-4709-bd14-9733689035e4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:12.044301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf557668-4485-4709-bd14-9733689035e4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:12.044866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf557668-4485-4709-bd14-9733689035e4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:12.045810 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf557668-4485-4709-bd14-9733689035e4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:12.046369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf557668-4485-4709-bd14-9733689035e4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:12.046898 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf557668-4485-4709-bd14-9733689035e4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:12.190545 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-983a8667-0810-47e0-9fb1-09ec2e1d9994 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:12.191457 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-983a8667-0810-47e0-9fb1-09ec2e1d9994 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:12.197764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-983a8667-0810-47e0-9fb1-09ec2e1d9994 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:12.199249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-983a8667-0810-47e0-9fb1-09ec2e1d9994 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:12.199910 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-983a8667-0810-47e0-9fb1-09ec2e1d9994 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:12.200854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-983a8667-0810-47e0-9fb1-09ec2e1d9994 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:12.201533 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-983a8667-0810-47e0-9fb1-09ec2e1d9994 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:12.212343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-983a8667-0810-47e0-9fb1-09ec2e1d9994 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:12.624549 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-983a8667-0810-47e0-9fb1-09ec2e1d9994 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:12.638289 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-983a8667-0810-47e0-9fb1-09ec2e1d9994 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1199 microversion: 2.1 time: 0.451793 Oct 05 02:35:12.640254 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bf557668-4485-4709-bd14-9733689035e4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:12.649073 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bf557668-4485-4709-bd14-9733689035e4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 200 len: 1325 microversion: 2.1 time: 0.616447 Oct 05 02:35:12.653556 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 925/1876] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:12 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1199 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:35:12.659500 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f9ea75e7-d769-4beb-8500-de085273b62e tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdfded790>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:12.667730 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 952/1877] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:12 2022] GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 1325 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:12.672479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-66ac608e-4004-4a98-aac1-3b031716d30a req-67f94dc0-c1b9-4d16-a124-5ef6d459806b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2e6dcdb-9664-46eb-b40d-58d894b62b47", "name": "network-vif-plugged", "status": "completed", "tag": "142146ee-f359-42c9-8f33-3302d82a8401"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:35:12.698976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-66ac608e-4004-4a98-aac1-3b031716d30a req-67f94dc0-c1b9-4d16-a124-5ef6d459806b service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:12.700718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-66ac608e-4004-4a98-aac1-3b031716d30a req-67f94dc0-c1b9-4d16-a124-5ef6d459806b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:12.701683 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-66ac608e-4004-4a98-aac1-3b031716d30a req-67f94dc0-c1b9-4d16-a124-5ef6d459806b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:12.716555 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-66ac608e-4004-4a98-aac1-3b031716d30a req-67f94dc0-c1b9-4d16-a124-5ef6d459806b service nova] Creating event network-vif-plugged:142146ee-f359-42c9-8f33-3302d82a8401 for instance f2e6dcdb-9664-46eb-b40d-58d894b62b47 on n-h1-858272-3 Oct 05 02:35:12.720094 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f9ea75e7-d769-4beb-8500-de085273b62e tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad" status: 200 len: 1455 microversion: 2.1 time: 0.064887 Oct 05 02:35:12.721463 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-66ac608e-4004-4a98-aac1-3b031716d30a req-67f94dc0-c1b9-4d16-a124-5ef6d459806b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052526 Oct 05 02:35:12.722352 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 953/1878] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:35:12.728069 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1571107c-7314-4ad5-8f70-710bbf93d99f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:12.728757 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1571107c-7314-4ad5-8f70-710bbf93d99f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: f2e6dcdb-9664-46eb-b40d-58d894b62b47] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:12.729076 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 926/1879] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:12 2022] GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad => generated 1455 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:12.737567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1571107c-7314-4ad5-8f70-710bbf93d99f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:12.738712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1571107c-7314-4ad5-8f70-710bbf93d99f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:12.739677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1571107c-7314-4ad5-8f70-710bbf93d99f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:12.740821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1571107c-7314-4ad5-8f70-710bbf93d99f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:12.741469 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1571107c-7314-4ad5-8f70-710bbf93d99f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:12.742057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1571107c-7314-4ad5-8f70-710bbf93d99f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:12.748068 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fa59b35c-3cd6-4aa9-88f5-f0b7de86e40f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:12.751115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fa59b35c-3cd6-4aa9-88f5-f0b7de86e40f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:12.760346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:35:12.763634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa59b35c-3cd6-4aa9-88f5-f0b7de86e40f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:12.764256 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa59b35c-3cd6-4aa9-88f5-f0b7de86e40f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:12.765000 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa59b35c-3cd6-4aa9-88f5-f0b7de86e40f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:12.765875 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa59b35c-3cd6-4aa9-88f5-f0b7de86e40f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:12.766991 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa59b35c-3cd6-4aa9-88f5-f0b7de86e40f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:12.767581 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa59b35c-3cd6-4aa9-88f5-f0b7de86e40f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:13.012220 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fa59b35c-3cd6-4aa9-88f5-f0b7de86e40f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:13.027813 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fa59b35c-3cd6-4aa9-88f5-f0b7de86e40f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:13.030134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fa59b35c-3cd6-4aa9-88f5-f0b7de86e40f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:13.031639 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fa59b35c-3cd6-4aa9-88f5-f0b7de86e40f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1370 microversion: 2.25 time: 0.296420 Oct 05 02:35:13.033069 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 927/1880] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:35:12 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1370 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:35:13.038393 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ca1af0ea-2291-4126-9d48-132067d6f054 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:13.039616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ca1af0ea-2291-4126-9d48-132067d6f054 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:13.046471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca1af0ea-2291-4126-9d48-132067d6f054 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:13.047693 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca1af0ea-2291-4126-9d48-132067d6f054 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:13.048509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca1af0ea-2291-4126-9d48-132067d6f054 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:13.049707 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca1af0ea-2291-4126-9d48-132067d6f054 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:13.050457 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca1af0ea-2291-4126-9d48-132067d6f054 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:13.051124 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca1af0ea-2291-4126-9d48-132067d6f054 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:13.241226 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1571107c-7314-4ad5-8f70-710bbf93d99f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:13.251050 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1571107c-7314-4ad5-8f70-710bbf93d99f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47" status: 200 len: 1308 microversion: 2.1 time: 0.527263 Oct 05 02:35:13.251636 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 954/1881] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:12 2022] GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47 => generated 1308 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:13.256487 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-39eb61d8-6d11-4078-ac26-d832e833721e tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:13.257379 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-39eb61d8-6d11-4078-ac26-d832e833721e tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] [instance: b11969e1-8fcb-4287-8d5b-070809e1e452] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:13.264622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-39eb61d8-6d11-4078-ac26-d832e833721e tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:13.265690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-39eb61d8-6d11-4078-ac26-d832e833721e tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:13.266509 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-39eb61d8-6d11-4078-ac26-d832e833721e tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:13.267452 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-39eb61d8-6d11-4078-ac26-d832e833721e tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:13.267909 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-39eb61d8-6d11-4078-ac26-d832e833721e tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:13.268339 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-39eb61d8-6d11-4078-ac26-d832e833721e tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:13.362104 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-39eb61d8-6d11-4078-ac26-d832e833721e tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a262a7ca2be4451a89330098b6134c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a08a51781e84e1eb215037744ee3a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:13.371009 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-39eb61d8-6d11-4078-ac26-d832e833721e tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452" status: 200 len: 1646 microversion: 2.1 time: 0.117562 Oct 05 02:35:13.371793 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 955/1882] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:13 2022] GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452 => generated 1646 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:13.389660 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-cb641314-b7c9-49ca-9763-924acedf589a req-b8350cd0-2f8f-444e-bea4-ccd6bf74ed80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b11969e1-8fcb-4287-8d5b-070809e1e452", "name": "network-vif-deleted", "tag": "91278f9d-a729-4911-9a6a-5d6cedbc2b96"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:35:13.393646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ca1af0ea-2291-4126-9d48-132067d6f054 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:13.403279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ca1af0ea-2291-4126-9d48-132067d6f054 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:13.404732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ca1af0ea-2291-4126-9d48-132067d6f054 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:13.405941 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ca1af0ea-2291-4126-9d48-132067d6f054 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1808 microversion: 2.20 time: 0.371620 Oct 05 02:35:13.406509 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 928/1883] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:35:13 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1808 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:35:13.416447 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-cb641314-b7c9-49ca-9763-924acedf589a req-b8350cd0-2f8f-444e-bea4-ccd6bf74ed80 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:13.417209 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-cb641314-b7c9-49ca-9763-924acedf589a req-b8350cd0-2f8f-444e-bea4-ccd6bf74ed80 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:13.417702 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-cb641314-b7c9-49ca-9763-924acedf589a req-b8350cd0-2f8f-444e-bea4-ccd6bf74ed80 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:13.428700 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-cb641314-b7c9-49ca-9763-924acedf589a req-b8350cd0-2f8f-444e-bea4-ccd6bf74ed80 service nova] Creating event network-vif-deleted:91278f9d-a729-4911-9a6a-5d6cedbc2b96 for instance b11969e1-8fcb-4287-8d5b-070809e1e452 on n-h1-858272-3 Oct 05 02:35:13.434191 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-cb641314-b7c9-49ca-9763-924acedf589a req-b8350cd0-2f8f-444e-bea4-ccd6bf74ed80 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051974 Oct 05 02:35:13.434791 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 956/1884] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:35:13.666721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3907abbc-b36e-426e-90fa-f2aafa971cf4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:13.672620 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-82150f6e-8804-4307-861b-fd49b02c82c7 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:13.673785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3907abbc-b36e-426e-90fa-f2aafa971cf4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:13.676325 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-82150f6e-8804-4307-861b-fd49b02c82c7 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:13.686109 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82150f6e-8804-4307-861b-fd49b02c82c7 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:13.686989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82150f6e-8804-4307-861b-fd49b02c82c7 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:13.687538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82150f6e-8804-4307-861b-fd49b02c82c7 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:13.688248 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82150f6e-8804-4307-861b-fd49b02c82c7 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:13.688883 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82150f6e-8804-4307-861b-fd49b02c82c7 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:13.690885 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82150f6e-8804-4307-861b-fd49b02c82c7 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:13.691336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3907abbc-b36e-426e-90fa-f2aafa971cf4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:13.691999 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3907abbc-b36e-426e-90fa-f2aafa971cf4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:13.692445 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3907abbc-b36e-426e-90fa-f2aafa971cf4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:13.693366 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3907abbc-b36e-426e-90fa-f2aafa971cf4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:13.693830 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3907abbc-b36e-426e-90fa-f2aafa971cf4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:13.694387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3907abbc-b36e-426e-90fa-f2aafa971cf4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:13.944374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-82150f6e-8804-4307-861b-fd49b02c82c7 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:13.953240 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-82150f6e-8804-4307-861b-fd49b02c82c7 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 200 len: 1523 microversion: 2.1 time: 0.284566 Oct 05 02:35:13.954279 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 957/1885] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:13 2022] GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 1523 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:13.958404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3907abbc-b36e-426e-90fa-f2aafa971cf4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:13.958972 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fc596383-dcd7-4417-b18a-797f7b22ad05 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce8084af0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:13.973515 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3907abbc-b36e-426e-90fa-f2aafa971cf4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1199 microversion: 2.1 time: 0.311171 Oct 05 02:35:13.974095 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 929/1886] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:13 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1199 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:14.007003 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b043b2a2-ceb0-4dd7-b8e9-efdd811e5beb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:14.007779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b043b2a2-ceb0-4dd7-b8e9-efdd811e5beb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:14.015018 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b043b2a2-ceb0-4dd7-b8e9-efdd811e5beb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:14.015724 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b043b2a2-ceb0-4dd7-b8e9-efdd811e5beb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:14.016351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b043b2a2-ceb0-4dd7-b8e9-efdd811e5beb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:14.017016 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fc596383-dcd7-4417-b18a-797f7b22ad05 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad" status: 200 len: 1455 microversion: 2.1 time: 0.061514 Oct 05 02:35:14.017271 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b043b2a2-ceb0-4dd7-b8e9-efdd811e5beb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:14.017593 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 958/1887] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:13 2022] GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad => generated 1455 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:14.017745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b043b2a2-ceb0-4dd7-b8e9-efdd811e5beb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:14.018139 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b043b2a2-ceb0-4dd7-b8e9-efdd811e5beb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:14.056656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7f975cee-2579-43d2-b543-95775e8f0b14 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:14.057302 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7f975cee-2579-43d2-b543-95775e8f0b14 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:14.063755 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f975cee-2579-43d2-b543-95775e8f0b14 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:14.064257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f975cee-2579-43d2-b543-95775e8f0b14 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:14.064698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f975cee-2579-43d2-b543-95775e8f0b14 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:14.065435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f975cee-2579-43d2-b543-95775e8f0b14 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:14.065894 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f975cee-2579-43d2-b543-95775e8f0b14 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:14.066446 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f975cee-2579-43d2-b543-95775e8f0b14 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:14.103200 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f975cee-2579-43d2-b543-95775e8f0b14 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:14.103693 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f975cee-2579-43d2-b543-95775e8f0b14 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:14.104406 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f975cee-2579-43d2-b543-95775e8f0b14 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:14.105764 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-7f975cee-2579-43d2-b543-95775e8f0b14 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lazy-loading 'fault' on Instance uuid d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:35:14.167928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7f975cee-2579-43d2-b543-95775e8f0b14 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:14.177891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7f975cee-2579-43d2-b543-95775e8f0b14 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:14.179334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7f975cee-2579-43d2-b543-95775e8f0b14 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:14.180509 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7f975cee-2579-43d2-b543-95775e8f0b14 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1375 microversion: 2.25 time: 0.127740 Oct 05 02:35:14.181524 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 959/1888] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:35:14 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1375 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:35:14.186093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b043b2a2-ceb0-4dd7-b8e9-efdd811e5beb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:14.195621 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b043b2a2-ceb0-4dd7-b8e9-efdd811e5beb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 200 len: 1523 microversion: 2.1 time: 0.193740 Oct 05 02:35:14.197238 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 930/1889] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:14 2022] GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:14.220627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6e4e4932-c641-4d8f-9745-9b3ed1a02327 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1684513936"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:35:14.223080 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6e4e4932-c641-4d8f-9745-9b3ed1a02327 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:14.230231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e4e4932-c641-4d8f-9745-9b3ed1a02327 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:14.231424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e4e4932-c641-4d8f-9745-9b3ed1a02327 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:14.231863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e4e4932-c641-4d8f-9745-9b3ed1a02327 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:14.232578 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e4e4932-c641-4d8f-9745-9b3ed1a02327 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:14.233069 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e4e4932-c641-4d8f-9745-9b3ed1a02327 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:14.233500 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e4e4932-c641-4d8f-9745-9b3ed1a02327 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:14.274408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c48cd74f-9eb5-4972-a38b-ff7214e2c7ec tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:14.275037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c48cd74f-9eb5-4972-a38b-ff7214e2c7ec tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: f2e6dcdb-9664-46eb-b40d-58d894b62b47] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:14.283830 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c48cd74f-9eb5-4972-a38b-ff7214e2c7ec tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:14.284475 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c48cd74f-9eb5-4972-a38b-ff7214e2c7ec tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:14.284821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c48cd74f-9eb5-4972-a38b-ff7214e2c7ec tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:14.285583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c48cd74f-9eb5-4972-a38b-ff7214e2c7ec tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:14.286041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c48cd74f-9eb5-4972-a38b-ff7214e2c7ec tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:14.286469 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c48cd74f-9eb5-4972-a38b-ff7214e2c7ec tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:14.478449 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c48cd74f-9eb5-4972-a38b-ff7214e2c7ec tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:14.486487 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6e4e4932-c641-4d8f-9745-9b3ed1a02327 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "POST /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83/action" status: 202 len: 0 microversion: 2.1 time: 0.268796 Oct 05 02:35:14.487571 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 960/1890] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:35:14 2022] POST /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 05 02:35:14.490706 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c48cd74f-9eb5-4972-a38b-ff7214e2c7ec tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47" status: 200 len: 1308 microversion: 2.1 time: 0.220285 Oct 05 02:35:14.491286 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 931/1891] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:14 2022] GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47 => generated 1308 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:35:14.493049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0c6ba63d-e2f2-4a2b-8b47-a3e1c891edeb tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:14.493816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0c6ba63d-e2f2-4a2b-8b47-a3e1c891edeb tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] [instance: b11969e1-8fcb-4287-8d5b-070809e1e452] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:14.501193 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c6ba63d-e2f2-4a2b-8b47-a3e1c891edeb tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:14.501609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e7efd811-0067-4443-bd53-ca2b03bb9dbf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:14.501796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c6ba63d-e2f2-4a2b-8b47-a3e1c891edeb tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:14.502287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c6ba63d-e2f2-4a2b-8b47-a3e1c891edeb tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:14.502578 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e7efd811-0067-4443-bd53-ca2b03bb9dbf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:14.503083 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c6ba63d-e2f2-4a2b-8b47-a3e1c891edeb tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:14.503602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c6ba63d-e2f2-4a2b-8b47-a3e1c891edeb tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:14.504070 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c6ba63d-e2f2-4a2b-8b47-a3e1c891edeb tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:14.509019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7efd811-0067-4443-bd53-ca2b03bb9dbf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:14.509726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7efd811-0067-4443-bd53-ca2b03bb9dbf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:14.510169 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7efd811-0067-4443-bd53-ca2b03bb9dbf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:14.511454 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7efd811-0067-4443-bd53-ca2b03bb9dbf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:14.512131 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7efd811-0067-4443-bd53-ca2b03bb9dbf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:14.512726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7efd811-0067-4443-bd53-ca2b03bb9dbf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:14.545328 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c6ba63d-e2f2-4a2b-8b47-a3e1c891edeb tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:14.545804 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c6ba63d-e2f2-4a2b-8b47-a3e1c891edeb tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:14.546249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c6ba63d-e2f2-4a2b-8b47-a3e1c891edeb tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:14.546690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-0c6ba63d-e2f2-4a2b-8b47-a3e1c891edeb tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lazy-loading 'fault' on Instance uuid b11969e1-8fcb-4287-8d5b-070809e1e452 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:35:14.616376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0c6ba63d-e2f2-4a2b-8b47-a3e1c891edeb tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a262a7ca2be4451a89330098b6134c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a08a51781e84e1eb215037744ee3a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:14.625039 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0c6ba63d-e2f2-4a2b-8b47-a3e1c891edeb tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452" status: 200 len: 1367 microversion: 2.1 time: 0.136069 Oct 05 02:35:14.625695 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 961/1892] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:14 2022] GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452 => generated 1367 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:14.630316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cc6fbb17-eb17-4337-a8fc-d4f702980bd6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '.version_select at 0x7fcce8084f70>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:14.678466 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e7efd811-0067-4443-bd53-ca2b03bb9dbf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:14.689978 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e7efd811-0067-4443-bd53-ca2b03bb9dbf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:14.691428 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e7efd811-0067-4443-bd53-ca2b03bb9dbf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:14.692699 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e7efd811-0067-4443-bd53-ca2b03bb9dbf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1808 microversion: 2.20 time: 0.199755 Oct 05 02:35:14.693281 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 932/1893] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:35:14 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:35:14.747758 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cc6fbb17-eb17-4337-a8fc-d4f702980bd6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "DELETE /compute/v2.1/images/5c0c3b43-b121-459f-9f7c-617d20b7ebbc" status: 204 len: 0 microversion: 2.1 time: 0.121015 Oct 05 02:35:14.748333 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 962/1894] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:14 2022] DELETE /compute/v2.1/images/5c0c3b43-b121-459f-9f7c-617d20b7ebbc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:35:14.756621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e8f39b0d-3cf3-4634-90b7-0bbf6a114c88 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '.version_select at 0x7fccdf6afb80>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:14.776868 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-e8f39b0d-3cf3-4634-90b7-0bbf6a114c88 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] HTTP exception thrown: Image not found. Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e8f39b0d-3cf3-4634-90b7-0bbf6a114c88 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Request method failure captured: Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/images/5c0c3b43-b121-459f-9f7c-617d20b7ebbc HTTP/1.1 Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO0XYeg8tqT8ongEAJOwqXQnTLTHZzTVGNp07qyK2Im6Pk37xE9_000kJ-ghGlg1M4xDfFZdh80YSHVWWaKUqSxFWQ_Csj3K04E3ui1EPC1OYFRpRVpFWUIW6dnDr0Kom0Z5CM2HBG5dMHahqKQPxztoTXPVRWZPXtn1QZY0a3PPLGY Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 47098be734b14277a4d9a9d6b8464998 Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_47098be734b14277a4d9a9d6b8464998"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 47098be734b14277a4d9a9d6b8464998 Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ImagesOneServerNegativeTestJSON-1772902756-project Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 4c441be8c87648bf9f1ff5cd4aff2532 Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756-project Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: exception: Image not found. Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '5c0c3b43-b121-459f-9f7c-617d20b7ebbc'} Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5c0c3b43-b121-459f-9f7c-617d20b7ebbc Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 05 02:35:14.779006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5c0c3b43-b121-459f-9f7c-617d20b7ebbc could not be found. Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e8f39b0d-3cf3-4634-90b7-0bbf6a114c88 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Returning 404 to user: Image not found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e8f39b0d-3cf3-4634-90b7-0bbf6a114c88 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/images/5c0c3b43-b121-459f-9f7c-617d20b7ebbc" status: 404 len: 62 microversion: 2.1 time: 0.027726 Oct 05 02:35:14.784696 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 933/1895] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:14 2022] GET /compute/v2.1/images/5c0c3b43-b121-459f-9f7c-617d20b7ebbc => generated 62 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 05 02:35:14.788976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f6e94d10-20c7-450b-b13a-ad351ba2712f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:14.789595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f6e94d10-20c7-450b-b13a-ad351ba2712f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:14.797089 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6e94d10-20c7-450b-b13a-ad351ba2712f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:14.797578 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6e94d10-20c7-450b-b13a-ad351ba2712f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:14.798015 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6e94d10-20c7-450b-b13a-ad351ba2712f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:14.798709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6e94d10-20c7-450b-b13a-ad351ba2712f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:14.799163 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6e94d10-20c7-450b-b13a-ad351ba2712f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:14.799589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6e94d10-20c7-450b-b13a-ad351ba2712f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:14.936390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f6e94d10-20c7-450b-b13a-ad351ba2712f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:14.944014 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f6e94d10-20c7-450b-b13a-ad351ba2712f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 200 len: 1535 microversion: 2.1 time: 0.158850 Oct 05 02:35:14.944579 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 963/1896] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:14 2022] GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 1535 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:35:15.010317 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4c3cd04a-13bb-4f12-8e16-05ddd82871f8 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:15.011069 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4c3cd04a-13bb-4f12-8e16-05ddd82871f8 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:15.018344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c3cd04a-13bb-4f12-8e16-05ddd82871f8 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:15.018835 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c3cd04a-13bb-4f12-8e16-05ddd82871f8 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:15.019274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c3cd04a-13bb-4f12-8e16-05ddd82871f8 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:15.019973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c3cd04a-13bb-4f12-8e16-05ddd82871f8 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:15.020438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c3cd04a-13bb-4f12-8e16-05ddd82871f8 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:15.020865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c3cd04a-13bb-4f12-8e16-05ddd82871f8 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:15.033406 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1268859e-9642-4fc1-b722-9c6433a7ce0e tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce4256280>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:15.079570 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1268859e-9642-4fc1-b722-9c6433a7ce0e tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad" status: 200 len: 1455 microversion: 2.1 time: 0.049772 Oct 05 02:35:15.081270 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 964/1897] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:15 2022] GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad => generated 1455 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:35:15.156497 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4c3cd04a-13bb-4f12-8e16-05ddd82871f8 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:15.164367 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4c3cd04a-13bb-4f12-8e16-05ddd82871f8 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1199 microversion: 2.1 time: 0.157800 Oct 05 02:35:15.164950 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 934/1898] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:15 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1199 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:15.207666 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-30ade528-bf81-4ec9-80aa-9d32ef0c3e04 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:15.208284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-30ade528-bf81-4ec9-80aa-9d32ef0c3e04 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:15.215666 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30ade528-bf81-4ec9-80aa-9d32ef0c3e04 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:15.216417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30ade528-bf81-4ec9-80aa-9d32ef0c3e04 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:15.216851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30ade528-bf81-4ec9-80aa-9d32ef0c3e04 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:15.217569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30ade528-bf81-4ec9-80aa-9d32ef0c3e04 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:15.218022 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30ade528-bf81-4ec9-80aa-9d32ef0c3e04 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:15.218447 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30ade528-bf81-4ec9-80aa-9d32ef0c3e04 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:15.253637 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30ade528-bf81-4ec9-80aa-9d32ef0c3e04 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:15.254034 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30ade528-bf81-4ec9-80aa-9d32ef0c3e04 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:15.254468 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30ade528-bf81-4ec9-80aa-9d32ef0c3e04 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:15.254916 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-30ade528-bf81-4ec9-80aa-9d32ef0c3e04 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lazy-loading 'fault' on Instance uuid d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:35:15.296226 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-30ade528-bf81-4ec9-80aa-9d32ef0c3e04 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:15.304350 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-30ade528-bf81-4ec9-80aa-9d32ef0c3e04 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:15.305825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-30ade528-bf81-4ec9-80aa-9d32ef0c3e04 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:15.306979 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-30ade528-bf81-4ec9-80aa-9d32ef0c3e04 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 200 len: 1375 microversion: 2.25 time: 0.103853 Oct 05 02:35:15.308429 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 965/1899] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:35:15 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 1375 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:35:15.515943 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b02df326-e050-414f-a54e-85a5784f117f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:15.516520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b02df326-e050-414f-a54e-85a5784f117f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: f2e6dcdb-9664-46eb-b40d-58d894b62b47] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:15.523010 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b02df326-e050-414f-a54e-85a5784f117f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:15.523500 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b02df326-e050-414f-a54e-85a5784f117f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:15.523938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b02df326-e050-414f-a54e-85a5784f117f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:15.524627 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b02df326-e050-414f-a54e-85a5784f117f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:15.525122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b02df326-e050-414f-a54e-85a5784f117f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:15.525552 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b02df326-e050-414f-a54e-85a5784f117f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:15.649011 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-93f666f5-67ab-4132-b207-a5056d6b9f25 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:15.649774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-93f666f5-67ab-4132-b207-a5056d6b9f25 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] [instance: b11969e1-8fcb-4287-8d5b-070809e1e452] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:15.657220 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93f666f5-67ab-4132-b207-a5056d6b9f25 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:15.657729 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93f666f5-67ab-4132-b207-a5056d6b9f25 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:15.658649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93f666f5-67ab-4132-b207-a5056d6b9f25 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:15.659701 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93f666f5-67ab-4132-b207-a5056d6b9f25 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:15.660367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93f666f5-67ab-4132-b207-a5056d6b9f25 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:15.660797 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93f666f5-67ab-4132-b207-a5056d6b9f25 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:15.681223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b02df326-e050-414f-a54e-85a5784f117f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:15.691803 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b02df326-e050-414f-a54e-85a5784f117f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47" status: 200 len: 1488 microversion: 2.1 time: 0.179806 Oct 05 02:35:15.698629 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93f666f5-67ab-4132-b207-a5056d6b9f25 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:15.699227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93f666f5-67ab-4132-b207-a5056d6b9f25 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:15.699732 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93f666f5-67ab-4132-b207-a5056d6b9f25 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:15.700287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-93f666f5-67ab-4132-b207-a5056d6b9f25 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lazy-loading 'fault' on Instance uuid b11969e1-8fcb-4287-8d5b-070809e1e452 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:35:15.700859 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 935/1900] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:15 2022] GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47 => generated 1488 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:15.716133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-74870d13-4f5b-4808-9dba-a4f07d89643d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:35:15.716731 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-74870d13-4f5b-4808-9dba-a4f07d89643d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: f2e6dcdb-9664-46eb-b40d-58d894b62b47] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:15.723123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74870d13-4f5b-4808-9dba-a4f07d89643d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:15.723831 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74870d13-4f5b-4808-9dba-a4f07d89643d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:15.724460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74870d13-4f5b-4808-9dba-a4f07d89643d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:15.725402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74870d13-4f5b-4808-9dba-a4f07d89643d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:15.726033 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74870d13-4f5b-4808-9dba-a4f07d89643d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:15.726655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74870d13-4f5b-4808-9dba-a4f07d89643d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:15.744240 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-93f666f5-67ab-4132-b207-a5056d6b9f25 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a262a7ca2be4451a89330098b6134c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a08a51781e84e1eb215037744ee3a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:15.752334 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-74870d13-4f5b-4808-9dba-a4f07d89643d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lazy-loading 'flavor' on Instance uuid f2e6dcdb-9664-46eb-b40d-58d894b62b47 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:35:15.756130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:35:15.757050 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-93f666f5-67ab-4132-b207-a5056d6b9f25 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452" status: 200 len: 1367 microversion: 2.1 time: 0.112056 Oct 05 02:35:15.758381 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 966/1901] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:15 2022] GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452 => generated 1367 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:35:15.766383 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6f6cb787-d9a4-49c5-9cf8-eb8852e65ec8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:15.767589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6f6cb787-d9a4-49c5-9cf8-eb8852e65ec8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:15.775533 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f6cb787-d9a4-49c5-9cf8-eb8852e65ec8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:15.776723 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f6cb787-d9a4-49c5-9cf8-eb8852e65ec8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:15.777256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f6cb787-d9a4-49c5-9cf8-eb8852e65ec8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:15.778161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f6cb787-d9a4-49c5-9cf8-eb8852e65ec8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:15.778762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f6cb787-d9a4-49c5-9cf8-eb8852e65ec8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:15.779183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f6cb787-d9a4-49c5-9cf8-eb8852e65ec8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:15.846121 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-74870d13-4f5b-4808-9dba-a4f07d89643d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "POST /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47/action" status: 202 len: 0 microversion: 2.1 time: 0.135401 Oct 05 02:35:15.847183 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 936/1902] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:35:15 2022] POST /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 02:35:15.857275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-76759984-6575-43eb-abea-b11151dbc005 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:15.858085 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-76759984-6575-43eb-abea-b11151dbc005 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: f2e6dcdb-9664-46eb-b40d-58d894b62b47] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:15.864594 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-76759984-6575-43eb-abea-b11151dbc005 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:15.865122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-76759984-6575-43eb-abea-b11151dbc005 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:15.865562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-76759984-6575-43eb-abea-b11151dbc005 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:15.866270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-76759984-6575-43eb-abea-b11151dbc005 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:15.866723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-76759984-6575-43eb-abea-b11151dbc005 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:15.867149 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-76759984-6575-43eb-abea-b11151dbc005 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:15.954210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6f6cb787-d9a4-49c5-9cf8-eb8852e65ec8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:15.962919 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6f6cb787-d9a4-49c5-9cf8-eb8852e65ec8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:15.964995 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6f6cb787-d9a4-49c5-9cf8-eb8852e65ec8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:15.966005 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6f6cb787-d9a4-49c5-9cf8-eb8852e65ec8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1808 microversion: 2.20 time: 0.206399 Oct 05 02:35:15.966574 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 967/1903] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:35:15 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:35:15.971116 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1d48239e-e34c-4044-b429-d9f76419d6b2 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:15.971722 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1d48239e-e34c-4044-b429-d9f76419d6b2 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:15.977637 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d48239e-e34c-4044-b429-d9f76419d6b2 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:15.978120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d48239e-e34c-4044-b429-d9f76419d6b2 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:15.978554 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d48239e-e34c-4044-b429-d9f76419d6b2 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:15.979364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d48239e-e34c-4044-b429-d9f76419d6b2 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:15.980246 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d48239e-e34c-4044-b429-d9f76419d6b2 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:15.980704 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d48239e-e34c-4044-b429-d9f76419d6b2 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:16.031507 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-76759984-6575-43eb-abea-b11151dbc005 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:16.040540 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-76759984-6575-43eb-abea-b11151dbc005 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47" status: 200 len: 1496 microversion: 2.1 time: 0.188984 Oct 05 02:35:16.056662 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 937/1904] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:15 2022] GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47 => generated 1496 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:16.095427 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-68fc4d36-2df8-4280-b6e2-ca379b9a45aa tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf6fbee0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:16.127639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1d48239e-e34c-4044-b429-d9f76419d6b2 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:16.137317 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1d48239e-e34c-4044-b429-d9f76419d6b2 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 200 len: 1535 microversion: 2.1 time: 0.169722 Oct 05 02:35:16.141790 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-68fc4d36-2df8-4280-b6e2-ca379b9a45aa tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad" status: 200 len: 1455 microversion: 2.1 time: 0.050121 Oct 05 02:35:16.142444 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 938/1905] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:16 2022] GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad => generated 1455 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:35:16.149322 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 968/1906] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:15 2022] GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 1535 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:16.184531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=4 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:35:16.189089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bd1b20a4-2202-4d1e-a91b-7adde69a8d54 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:16.189703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bd1b20a4-2202-4d1e-a91b-7adde69a8d54 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:16.197001 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd1b20a4-2202-4d1e-a91b-7adde69a8d54 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:16.198503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd1b20a4-2202-4d1e-a91b-7adde69a8d54 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:16.198949 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd1b20a4-2202-4d1e-a91b-7adde69a8d54 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:16.199974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd1b20a4-2202-4d1e-a91b-7adde69a8d54 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:16.200108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd1b20a4-2202-4d1e-a91b-7adde69a8d54 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:16.200482 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd1b20a4-2202-4d1e-a91b-7adde69a8d54 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:16.322673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:35:16.332831 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-54f033a1-c437-4dba-a84a-3864dc7c721f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:16.333562 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-54f033a1-c437-4dba-a84a-3864dc7c721f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: d497c63f-2a3d-4dbd-95d5-d2b90e743ac0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:16.337405 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bd1b20a4-2202-4d1e-a91b-7adde69a8d54 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:16.340626 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54f033a1-c437-4dba-a84a-3864dc7c721f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:16.341232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54f033a1-c437-4dba-a84a-3864dc7c721f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:16.341789 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54f033a1-c437-4dba-a84a-3864dc7c721f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:16.342569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54f033a1-c437-4dba-a84a-3864dc7c721f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:16.343112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54f033a1-c437-4dba-a84a-3864dc7c721f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:16.343603 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54f033a1-c437-4dba-a84a-3864dc7c721f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:16.346958 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bd1b20a4-2202-4d1e-a91b-7adde69a8d54 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1199 microversion: 2.1 time: 0.163192 Oct 05 02:35:16.347542 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 939/1907] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:16 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1199 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:16.358446 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-54f033a1-c437-4dba-a84a-3864dc7c721f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] HTTP exception thrown: Instance d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 could not be found. Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-54f033a1-c437-4dba-a84a-3864dc7c721f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Request method failure captured: Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 HTTP/1.1 Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOuH8lbWR5T6J4rN8SVnp5khCjpH7yX47ceKkh7ju-ewftZGsMYkWxiQ-NrHtKY9BWHf2UyRIBx7H_Rf_NGmTCCAA2yb8a_C0L3hWQtPE-mbCgBOezy5TWiBIn7_YUsEf0P-DqK0FHwoc6v36DfLV8QftYAjzTVZ97fZJULLAXqmXoI Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: X-Openstack-Nova-Api-Version: 2.25 Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: bbd25b0a68f749029eeed701c77462ce Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-836018511 Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bbd25b0a68f749029eeed701c77462ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bbd25b0a68f749029eeed701c77462ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bbd25b0a68f749029eeed701c77462ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bbd25b0a68f749029eeed701c77462ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-836018511 Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: bbd25b0a68f749029eeed701c77462ce Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-836018511 Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-LiveAutoBlockMigrationV225Test-836018511-project Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 39671ba0b86847f995c96013947fee65 Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-836018511-project Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 could not be found. Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'd497c63f-2a3d-4dbd-95d5-d2b90e743ac0'} Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 could not be found. Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 could not be found. Oct 05 02:35:16.360227 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:35:16.365903 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:35:16.365903 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:35:16.365903 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:35:16.365903 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:35:16.365903 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:35:16.365903 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:35:16.365903 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:35:16.365903 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 could not be found. Oct 05 02:35:16.365903 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:35:16.365903 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-54f033a1-c437-4dba-a84a-3864dc7c721f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Returning 404 to user: Instance d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:35:16.365903 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-54f033a1-c437-4dba-a84a-3864dc7c721f tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0" status: 404 len: 111 microversion: 2.25 time: 0.033771 Oct 05 02:35:16.367010 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 969/1908] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:35:16 2022] GET /compute/v2.1/servers/d497c63f-2a3d-4dbd-95d5-d2b90e743ac0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 05 02:35:16.372384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8c38518f-dbb1-478e-a87c-cad0f90ffa50 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '.version_select at 0x7fcce80c4e50>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:16.390886 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8c38518f-dbb1-478e-a87c-cad0f90ffa50 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1679652780" status: 204 len: 0 microversion: 2.25 time: 0.022865 Oct 05 02:35:16.391451 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 940/1909] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 5 02:35:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1679652780 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 05 02:35:16.782969 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f48d2372-25c5-4abf-bbc8-ecaa242f84d7 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:16.783850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f48d2372-25c5-4abf-bbc8-ecaa242f84d7 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] [instance: b11969e1-8fcb-4287-8d5b-070809e1e452] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:16.790676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f48d2372-25c5-4abf-bbc8-ecaa242f84d7 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:16.791212 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f48d2372-25c5-4abf-bbc8-ecaa242f84d7 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:16.792382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f48d2372-25c5-4abf-bbc8-ecaa242f84d7 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:16.794008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f48d2372-25c5-4abf-bbc8-ecaa242f84d7 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:16.795168 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f48d2372-25c5-4abf-bbc8-ecaa242f84d7 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:16.795705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f48d2372-25c5-4abf-bbc8-ecaa242f84d7 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:16.836348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f48d2372-25c5-4abf-bbc8-ecaa242f84d7 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:16.837039 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f48d2372-25c5-4abf-bbc8-ecaa242f84d7 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:16.838100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f48d2372-25c5-4abf-bbc8-ecaa242f84d7 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:16.839357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-f48d2372-25c5-4abf-bbc8-ecaa242f84d7 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lazy-loading 'fault' on Instance uuid b11969e1-8fcb-4287-8d5b-070809e1e452 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:35:16.882362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f48d2372-25c5-4abf-bbc8-ecaa242f84d7 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a262a7ca2be4451a89330098b6134c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a08a51781e84e1eb215037744ee3a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:16.890970 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f48d2372-25c5-4abf-bbc8-ecaa242f84d7 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452" status: 200 len: 1367 microversion: 2.1 time: 0.111866 Oct 05 02:35:16.891537 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 970/1910] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:16 2022] GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452 => generated 1367 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:16.991729 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8271c659-2544-4478-b0bc-802a84c72155 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:16.992449 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8271c659-2544-4478-b0bc-802a84c72155 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:17.000965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8271c659-2544-4478-b0bc-802a84c72155 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:17.001463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8271c659-2544-4478-b0bc-802a84c72155 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:17.001907 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8271c659-2544-4478-b0bc-802a84c72155 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:17.002665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8271c659-2544-4478-b0bc-802a84c72155 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:17.003129 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8271c659-2544-4478-b0bc-802a84c72155 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:17.003558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8271c659-2544-4478-b0bc-802a84c72155 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:17.065057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d08249ab-9a1d-44a2-98ce-d00a194d9380 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:17.065847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d08249ab-9a1d-44a2-98ce-d00a194d9380 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: f2e6dcdb-9664-46eb-b40d-58d894b62b47] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:17.073569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d08249ab-9a1d-44a2-98ce-d00a194d9380 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:17.074077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d08249ab-9a1d-44a2-98ce-d00a194d9380 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:17.074505 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d08249ab-9a1d-44a2-98ce-d00a194d9380 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:17.075207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d08249ab-9a1d-44a2-98ce-d00a194d9380 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:17.076018 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d08249ab-9a1d-44a2-98ce-d00a194d9380 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:17.076633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d08249ab-9a1d-44a2-98ce-d00a194d9380 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:17.173109 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8271c659-2544-4478-b0bc-802a84c72155 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:17.183781 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8271c659-2544-4478-b0bc-802a84c72155 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:17.185535 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8271c659-2544-4478-b0bc-802a84c72155 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:17.186840 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8271c659-2544-4478-b0bc-802a84c72155 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1808 microversion: 2.20 time: 0.199079 Oct 05 02:35:17.192068 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 941/1911] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:35:16 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1808 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:35:17.196896 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5f66b07c-0a19-4ee1-bdce-45e28ab4f775 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf6fbf70>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:17.249996 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d08249ab-9a1d-44a2-98ce-d00a194d9380 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:17.257227 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5f66b07c-0a19-4ee1-bdce-45e28ab4f775 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad" status: 200 len: 1455 microversion: 2.1 time: 0.063863 Oct 05 02:35:17.264954 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 942/1912] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:17 2022] GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad => generated 1455 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:17.265148 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d08249ab-9a1d-44a2-98ce-d00a194d9380 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47" status: 200 len: 1496 microversion: 2.1 time: 0.198955 Oct 05 02:35:17.265148 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 971/1913] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:17 2022] GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47 => generated 1496 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:17.273963 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d0c68bae-0d5d-48c2-8f16-427a15624858 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:17.274871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d0c68bae-0d5d-48c2-8f16-427a15624858 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:17.283397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d0c68bae-0d5d-48c2-8f16-427a15624858 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:17.283919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d0c68bae-0d5d-48c2-8f16-427a15624858 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:17.284414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d0c68bae-0d5d-48c2-8f16-427a15624858 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:17.285153 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d0c68bae-0d5d-48c2-8f16-427a15624858 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:17.285609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d0c68bae-0d5d-48c2-8f16-427a15624858 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:17.286035 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d0c68bae-0d5d-48c2-8f16-427a15624858 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:17.328087 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-998f6424-c782-4df0-8cb9-c5a1c4c7dc79 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:17.328566 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-998f6424-c782-4df0-8cb9-c5a1c4c7dc79 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:17.334746 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-998f6424-c782-4df0-8cb9-c5a1c4c7dc79 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:17.335378 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-998f6424-c782-4df0-8cb9-c5a1c4c7dc79 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:17.335885 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-998f6424-c782-4df0-8cb9-c5a1c4c7dc79 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:17.336654 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-998f6424-c782-4df0-8cb9-c5a1c4c7dc79 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:17.337208 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-998f6424-c782-4df0-8cb9-c5a1c4c7dc79 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:17.337694 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-998f6424-c782-4df0-8cb9-c5a1c4c7dc79 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:17.354436 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:35:17.366147 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-998f6424-c782-4df0-8cb9-c5a1c4c7dc79 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:35:17.426560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d0c68bae-0d5d-48c2-8f16-427a15624858 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:17.435565 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d0c68bae-0d5d-48c2-8f16-427a15624858 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 200 len: 1535 microversion: 2.1 time: 0.176763 Oct 05 02:35:17.451743 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 943/1914] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:17 2022] GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 1535 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:17.451743 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bf633608-5e75-4ba1-8510-2fd151976d13 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:17.451743 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bf633608-5e75-4ba1-8510-2fd151976d13 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:17.452815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf633608-5e75-4ba1-8510-2fd151976d13 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:17.453337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf633608-5e75-4ba1-8510-2fd151976d13 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:17.453810 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf633608-5e75-4ba1-8510-2fd151976d13 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:17.454491 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf633608-5e75-4ba1-8510-2fd151976d13 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:17.455064 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf633608-5e75-4ba1-8510-2fd151976d13 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:17.455511 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf633608-5e75-4ba1-8510-2fd151976d13 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:17.458595 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-998f6424-c782-4df0-8cb9-c5a1c4c7dc79 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "DELETE /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af" status: 204 len: 0 microversion: 2.25 time: 0.134838 Oct 05 02:35:17.459348 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 972/1915] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 5 02:35:17 2022] DELETE /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 05 02:35:17.468618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4e7498db-d744-414f-bbc8-665d236b34cd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:17.469493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4e7498db-d744-414f-bbc8-665d236b34cd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:17.475464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e7498db-d744-414f-bbc8-665d236b34cd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:17.475952 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e7498db-d744-414f-bbc8-665d236b34cd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:17.476386 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e7498db-d744-414f-bbc8-665d236b34cd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:17.477114 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e7498db-d744-414f-bbc8-665d236b34cd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:17.477567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e7498db-d744-414f-bbc8-665d236b34cd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:17.477991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e7498db-d744-414f-bbc8-665d236b34cd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:17.672136 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bf633608-5e75-4ba1-8510-2fd151976d13 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:17.679148 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4e7498db-d744-414f-bbc8-665d236b34cd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:17.680032 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bf633608-5e75-4ba1-8510-2fd151976d13 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1199 microversion: 2.1 time: 0.242907 Oct 05 02:35:17.680609 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 944/1916] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:17 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1199 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:17.688402 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4e7498db-d744-414f-bbc8-665d236b34cd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:17.690201 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4e7498db-d744-414f-bbc8-665d236b34cd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:17.691363 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4e7498db-d744-414f-bbc8-665d236b34cd tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af" status: 200 len: 1549 microversion: 2.25 time: 0.227754 Oct 05 02:35:17.696792 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 973/1917] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:35:17 2022] GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af => generated 1549 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:35:17.915210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-de503a63-6cf1-4e35-9b6a-608456b540ab tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:17.915851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-de503a63-6cf1-4e35-9b6a-608456b540ab tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] [instance: b11969e1-8fcb-4287-8d5b-070809e1e452] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:17.922052 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de503a63-6cf1-4e35-9b6a-608456b540ab tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:17.922528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de503a63-6cf1-4e35-9b6a-608456b540ab tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:17.922958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de503a63-6cf1-4e35-9b6a-608456b540ab tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:17.923640 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de503a63-6cf1-4e35-9b6a-608456b540ab tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:17.924087 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de503a63-6cf1-4e35-9b6a-608456b540ab tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:17.924510 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de503a63-6cf1-4e35-9b6a-608456b540ab tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:17.956322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de503a63-6cf1-4e35-9b6a-608456b540ab tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:17.956794 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de503a63-6cf1-4e35-9b6a-608456b540ab tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:17.957317 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de503a63-6cf1-4e35-9b6a-608456b540ab tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:17.957756 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-de503a63-6cf1-4e35-9b6a-608456b540ab tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lazy-loading 'fault' on Instance uuid b11969e1-8fcb-4287-8d5b-070809e1e452 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:35:17.999500 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-de503a63-6cf1-4e35-9b6a-608456b540ab tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a262a7ca2be4451a89330098b6134c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a08a51781e84e1eb215037744ee3a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:18.008045 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-de503a63-6cf1-4e35-9b6a-608456b540ab tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452" status: 200 len: 1367 microversion: 2.1 time: 0.097875 Oct 05 02:35:18.008610 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 945/1918] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:17 2022] GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452 => generated 1367 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:18.196597 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-b8334016-7d41-4254-9be7-b1f33a564931 req-e6b95388-2fed-4bca-a49a-803aed022c21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e123bb72-45c5-4371-bf2e-f0747497f16b", "name": "network-vif-plugged", "status": "completed", "tag": "05da60d7-1d7e-4607-a912-92561fc99617"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:35:18.210689 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b8334016-7d41-4254-9be7-b1f33a564931 req-e6b95388-2fed-4bca-a49a-803aed022c21 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:18.211174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b8334016-7d41-4254-9be7-b1f33a564931 req-e6b95388-2fed-4bca-a49a-803aed022c21 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:18.211593 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b8334016-7d41-4254-9be7-b1f33a564931 req-e6b95388-2fed-4bca-a49a-803aed022c21 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:18.213923 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c5db80fe-f830-4f5e-8932-e0b33157c7cf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:18.214759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c5db80fe-f830-4f5e-8932-e0b33157c7cf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:18.220347 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:35:18.222388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5db80fe-f830-4f5e-8932-e0b33157c7cf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:18.223002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5db80fe-f830-4f5e-8932-e0b33157c7cf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:18.223542 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5db80fe-f830-4f5e-8932-e0b33157c7cf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:18.224349 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-b8334016-7d41-4254-9be7-b1f33a564931 req-e6b95388-2fed-4bca-a49a-803aed022c21 service nova] Creating event network-vif-plugged:05da60d7-1d7e-4607-a912-92561fc99617 for instance e123bb72-45c5-4371-bf2e-f0747497f16b on n-h1-858272-3 Oct 05 02:35:18.224705 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5db80fe-f830-4f5e-8932-e0b33157c7cf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:18.225294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5db80fe-f830-4f5e-8932-e0b33157c7cf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:18.225812 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5db80fe-f830-4f5e-8932-e0b33157c7cf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:18.229745 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-b8334016-7d41-4254-9be7-b1f33a564931 req-e6b95388-2fed-4bca-a49a-803aed022c21 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036488 Oct 05 02:35:18.231393 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 974/1919] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:35:18.274179 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-360a91cc-5723-4286-92bd-338313394f93 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce8084820>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:18.324387 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-360a91cc-5723-4286-92bd-338313394f93 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad" status: 200 len: 1455 microversion: 2.1 time: 0.054466 Oct 05 02:35:18.329602 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 975/1920] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:18 2022] GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad => generated 1455 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:35:18.332173 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-54a9cd65-d1cb-48ce-ae1b-26cb99e1ca35 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:18.333004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-54a9cd65-d1cb-48ce-ae1b-26cb99e1ca35 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: f2e6dcdb-9664-46eb-b40d-58d894b62b47] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:18.340536 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54a9cd65-d1cb-48ce-ae1b-26cb99e1ca35 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:18.341261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54a9cd65-d1cb-48ce-ae1b-26cb99e1ca35 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:18.341797 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54a9cd65-d1cb-48ce-ae1b-26cb99e1ca35 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:18.342552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54a9cd65-d1cb-48ce-ae1b-26cb99e1ca35 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:18.343070 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54a9cd65-d1cb-48ce-ae1b-26cb99e1ca35 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:18.343681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54a9cd65-d1cb-48ce-ae1b-26cb99e1ca35 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:18.407133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c5db80fe-f830-4f5e-8932-e0b33157c7cf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:18.419199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c5db80fe-f830-4f5e-8932-e0b33157c7cf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:18.420874 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c5db80fe-f830-4f5e-8932-e0b33157c7cf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:18.422385 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c5db80fe-f830-4f5e-8932-e0b33157c7cf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1808 microversion: 2.20 time: 0.212769 Oct 05 02:35:18.423439 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 946/1921] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:35:18 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1808 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:35:18.460045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ff09805e-ae50-4f1f-8d97-e112bab8f093 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:18.461331 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ff09805e-ae50-4f1f-8d97-e112bab8f093 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:18.468327 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff09805e-ae50-4f1f-8d97-e112bab8f093 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:18.468820 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff09805e-ae50-4f1f-8d97-e112bab8f093 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:18.469510 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff09805e-ae50-4f1f-8d97-e112bab8f093 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:18.470413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff09805e-ae50-4f1f-8d97-e112bab8f093 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:18.471045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff09805e-ae50-4f1f-8d97-e112bab8f093 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:18.471646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff09805e-ae50-4f1f-8d97-e112bab8f093 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:18.508327 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-54a9cd65-d1cb-48ce-ae1b-26cb99e1ca35 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:18.518567 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-54a9cd65-d1cb-48ce-ae1b-26cb99e1ca35 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47" status: 200 len: 1496 microversion: 2.1 time: 0.191340 Oct 05 02:35:18.532211 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 976/1922] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:18 2022] GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47 => generated 1496 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:18.629460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ff09805e-ae50-4f1f-8d97-e112bab8f093 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:18.640229 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ff09805e-ae50-4f1f-8d97-e112bab8f093 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 200 len: 1541 microversion: 2.1 time: 0.184271 Oct 05 02:35:18.641040 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 947/1923] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:18 2022] GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 1541 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:35:18.703517 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-89682364-7aed-4471-bb2d-427edc251238 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:18.704129 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-89682364-7aed-4471-bb2d-427edc251238 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:18.710236 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89682364-7aed-4471-bb2d-427edc251238 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:18.710715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89682364-7aed-4471-bb2d-427edc251238 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:18.711317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89682364-7aed-4471-bb2d-427edc251238 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:18.712009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89682364-7aed-4471-bb2d-427edc251238 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:18.712537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89682364-7aed-4471-bb2d-427edc251238 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:18.713019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89682364-7aed-4471-bb2d-427edc251238 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:18.718308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c554225e-afe4-4f84-a911-c9bd7f165be6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:18.719338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c554225e-afe4-4f84-a911-c9bd7f165be6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:18.725363 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c554225e-afe4-4f84-a911-c9bd7f165be6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:18.725935 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c554225e-afe4-4f84-a911-c9bd7f165be6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:18.726439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c554225e-afe4-4f84-a911-c9bd7f165be6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:18.727195 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c554225e-afe4-4f84-a911-c9bd7f165be6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:18.727739 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c554225e-afe4-4f84-a911-c9bd7f165be6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:18.728236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c554225e-afe4-4f84-a911-c9bd7f165be6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:18.919752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-89682364-7aed-4471-bb2d-427edc251238 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:18.928244 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-89682364-7aed-4471-bb2d-427edc251238 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1199 microversion: 2.1 time: 0.228458 Oct 05 02:35:18.928833 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 977/1924] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:18 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1199 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:18.934371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c554225e-afe4-4f84-a911-c9bd7f165be6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:18.943850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c554225e-afe4-4f84-a911-c9bd7f165be6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:18.945566 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c554225e-afe4-4f84-a911-c9bd7f165be6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:18.947028 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c554225e-afe4-4f84-a911-c9bd7f165be6 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af" status: 200 len: 1549 microversion: 2.25 time: 0.233061 Oct 05 02:35:18.948227 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 948/1925] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:35:18 2022] GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af => generated 1549 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:35:19.032386 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-aef2ac0a-2dcb-4a66-a7ba-4a0fb9d33428 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:19.033033 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-aef2ac0a-2dcb-4a66-a7ba-4a0fb9d33428 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] [instance: b11969e1-8fcb-4287-8d5b-070809e1e452] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:19.041602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aef2ac0a-2dcb-4a66-a7ba-4a0fb9d33428 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:19.042676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aef2ac0a-2dcb-4a66-a7ba-4a0fb9d33428 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:19.046405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aef2ac0a-2dcb-4a66-a7ba-4a0fb9d33428 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:19.047137 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aef2ac0a-2dcb-4a66-a7ba-4a0fb9d33428 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:19.047618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aef2ac0a-2dcb-4a66-a7ba-4a0fb9d33428 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:19.048055 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aef2ac0a-2dcb-4a66-a7ba-4a0fb9d33428 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:19.085838 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aef2ac0a-2dcb-4a66-a7ba-4a0fb9d33428 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:19.085997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aef2ac0a-2dcb-4a66-a7ba-4a0fb9d33428 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:19.086661 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aef2ac0a-2dcb-4a66-a7ba-4a0fb9d33428 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:19.087282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-aef2ac0a-2dcb-4a66-a7ba-4a0fb9d33428 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lazy-loading 'fault' on Instance uuid b11969e1-8fcb-4287-8d5b-070809e1e452 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:35:19.163065 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-aef2ac0a-2dcb-4a66-a7ba-4a0fb9d33428 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a262a7ca2be4451a89330098b6134c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a08a51781e84e1eb215037744ee3a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:19.173480 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-aef2ac0a-2dcb-4a66-a7ba-4a0fb9d33428 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452" status: 200 len: 1367 microversion: 2.1 time: 0.144677 Oct 05 02:35:19.173978 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 978/1926] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:19 2022] GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452 => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:19.342189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-98189389-1ec6-41cf-afa1-de951d7d354e tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce80cb700>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:19.395526 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-98189389-1ec6-41cf-afa1-de951d7d354e tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad" status: 200 len: 1455 microversion: 2.1 time: 0.057203 Oct 05 02:35:19.396185 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 949/1927] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:19 2022] GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad => generated 1455 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:35:19.451581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4812e337-e9ce-481f-840f-f90541cdfb7d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:19.452495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4812e337-e9ce-481f-840f-f90541cdfb7d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:19.467586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4812e337-e9ce-481f-840f-f90541cdfb7d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:19.468268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4812e337-e9ce-481f-840f-f90541cdfb7d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:19.468722 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4812e337-e9ce-481f-840f-f90541cdfb7d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:19.469645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4812e337-e9ce-481f-840f-f90541cdfb7d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:19.470582 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4812e337-e9ce-481f-840f-f90541cdfb7d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:19.473905 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4812e337-e9ce-481f-840f-f90541cdfb7d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:19.526284 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-e557e441-c6ae-4634-a244-5915f163be49 req-af79b592-2459-45b0-bf20-2eb88ed92da4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "079782c4-bca1-40e0-aa9f-b8afdb6a79af", "name": "network-vif-deleted", "tag": "0a2b9672-d33e-4824-9498-5a3e1b415686"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:35:19.545249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e557e441-c6ae-4634-a244-5915f163be49 req-af79b592-2459-45b0-bf20-2eb88ed92da4 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:19.545932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e557e441-c6ae-4634-a244-5915f163be49 req-af79b592-2459-45b0-bf20-2eb88ed92da4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:19.546437 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e557e441-c6ae-4634-a244-5915f163be49 req-af79b592-2459-45b0-bf20-2eb88ed92da4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:19.568939 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-e557e441-c6ae-4634-a244-5915f163be49 req-af79b592-2459-45b0-bf20-2eb88ed92da4 service nova] Creating event network-vif-deleted:0a2b9672-d33e-4824-9498-5a3e1b415686 for instance 079782c4-bca1-40e0-aa9f-b8afdb6a79af on n-h1-858272-3 Oct 05 02:35:19.571803 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-e557e441-c6ae-4634-a244-5915f163be49 req-af79b592-2459-45b0-bf20-2eb88ed92da4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052572 Oct 05 02:35:19.572757 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 950/1928] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:35:19.583451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9c506c8c-8b46-4492-9247-b77a2da99ea5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:19.584184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9c506c8c-8b46-4492-9247-b77a2da99ea5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: f2e6dcdb-9664-46eb-b40d-58d894b62b47] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:19.595360 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c506c8c-8b46-4492-9247-b77a2da99ea5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:19.596562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c506c8c-8b46-4492-9247-b77a2da99ea5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:19.597845 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c506c8c-8b46-4492-9247-b77a2da99ea5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:19.598758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c506c8c-8b46-4492-9247-b77a2da99ea5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:19.599385 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c506c8c-8b46-4492-9247-b77a2da99ea5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:19.600052 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c506c8c-8b46-4492-9247-b77a2da99ea5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:19.874083 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4812e337-e9ce-481f-840f-f90541cdfb7d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:19.888923 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4812e337-e9ce-481f-840f-f90541cdfb7d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:19.895899 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4812e337-e9ce-481f-840f-f90541cdfb7d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:19.897537 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4812e337-e9ce-481f-840f-f90541cdfb7d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1808 microversion: 2.20 time: 0.451739 Oct 05 02:35:19.898588 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 979/1929] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:35:19 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1808 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:35:19.906279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-13ac25bd-60e5-4899-a788-897b2dc3d966 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:19.912946 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-13ac25bd-60e5-4899-a788-897b2dc3d966 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:19.937767 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13ac25bd-60e5-4899-a788-897b2dc3d966 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:19.947901 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13ac25bd-60e5-4899-a788-897b2dc3d966 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:19.949386 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13ac25bd-60e5-4899-a788-897b2dc3d966 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:19.951563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13ac25bd-60e5-4899-a788-897b2dc3d966 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:19.952604 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13ac25bd-60e5-4899-a788-897b2dc3d966 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:19.953258 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13ac25bd-60e5-4899-a788-897b2dc3d966 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:19.958204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9c506c8c-8b46-4492-9247-b77a2da99ea5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:19.971532 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9c506c8c-8b46-4492-9247-b77a2da99ea5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47" status: 200 len: 1479 microversion: 2.1 time: 0.396411 Oct 05 02:35:19.972241 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 951/1930] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:19 2022] GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47 => generated 1479 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:19.986935 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-16502b55-04ca-4919-857a-880eea367b8b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:19.988640 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-16502b55-04ca-4919-857a-880eea367b8b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:19.996540 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-16502b55-04ca-4919-857a-880eea367b8b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:19.997420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-16502b55-04ca-4919-857a-880eea367b8b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:19.998447 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-16502b55-04ca-4919-857a-880eea367b8b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:19.999498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-16502b55-04ca-4919-857a-880eea367b8b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:20.000083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-16502b55-04ca-4919-857a-880eea367b8b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:20.000689 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-16502b55-04ca-4919-857a-880eea367b8b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:20.186270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-16502b55-04ca-4919-857a-880eea367b8b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:20.203720 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-16502b55-04ca-4919-857a-880eea367b8b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1199 microversion: 2.1 time: 0.230069 Oct 05 02:35:20.204240 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 952/1931] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:19 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1199 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:20.208827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1279716e-24e5-4461-ab24-cdde5b91e345 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:20.215832 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1279716e-24e5-4461-ab24-cdde5b91e345 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:20.224179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1279716e-24e5-4461-ab24-cdde5b91e345 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:20.226323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1279716e-24e5-4461-ab24-cdde5b91e345 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:20.226997 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1279716e-24e5-4461-ab24-cdde5b91e345 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:20.231140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1279716e-24e5-4461-ab24-cdde5b91e345 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:20.231623 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1279716e-24e5-4461-ab24-cdde5b91e345 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:20.232055 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1279716e-24e5-4461-ab24-cdde5b91e345 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:20.263022 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-13ac25bd-60e5-4899-a788-897b2dc3d966 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:20.270045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1279716e-24e5-4461-ab24-cdde5b91e345 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:20.271073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1279716e-24e5-4461-ab24-cdde5b91e345 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:20.271686 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1279716e-24e5-4461-ab24-cdde5b91e345 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:20.272137 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-13ac25bd-60e5-4899-a788-897b2dc3d966 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 200 len: 1541 microversion: 2.1 time: 0.372202 Oct 05 02:35:20.272537 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-1279716e-24e5-4461-ab24-cdde5b91e345 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lazy-loading 'fault' on Instance uuid 079782c4-bca1-40e0-aa9f-b8afdb6a79af {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:35:20.286289 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 980/1932] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:19 2022] GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 1541 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:20.297854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-654e31c6-79fd-4f99-b43c-e7c090cb7ba5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1309656466"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:35:20.300569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-654e31c6-79fd-4f99-b43c-e7c090cb7ba5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: f2e6dcdb-9664-46eb-b40d-58d894b62b47] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:20.321853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-654e31c6-79fd-4f99-b43c-e7c090cb7ba5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:20.329869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-654e31c6-79fd-4f99-b43c-e7c090cb7ba5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:20.330507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-654e31c6-79fd-4f99-b43c-e7c090cb7ba5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:20.331506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-654e31c6-79fd-4f99-b43c-e7c090cb7ba5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:20.341314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-654e31c6-79fd-4f99-b43c-e7c090cb7ba5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:20.344128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-654e31c6-79fd-4f99-b43c-e7c090cb7ba5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:20.366091 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1279716e-24e5-4461-ab24-cdde5b91e345 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:20.386254 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1279716e-24e5-4461-ab24-cdde5b91e345 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:20.389930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1279716e-24e5-4461-ab24-cdde5b91e345 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:20.393268 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1279716e-24e5-4461-ab24-cdde5b91e345 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af" status: 200 len: 1352 microversion: 2.25 time: 0.188031 Oct 05 02:35:20.397576 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 953/1933] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:35:20 2022] GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af => generated 1352 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:35:20.405478 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-926e9ba8-bbf2-4375-90ae-d97bbffeece9 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:20.406395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-926e9ba8-bbf2-4375-90ae-d97bbffeece9 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] [instance: b11969e1-8fcb-4287-8d5b-070809e1e452] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:20.414896 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-926e9ba8-bbf2-4375-90ae-d97bbffeece9 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:20.415593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-926e9ba8-bbf2-4375-90ae-d97bbffeece9 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:20.420229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-926e9ba8-bbf2-4375-90ae-d97bbffeece9 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:20.422854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-926e9ba8-bbf2-4375-90ae-d97bbffeece9 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:20.423526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-926e9ba8-bbf2-4375-90ae-d97bbffeece9 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:20.424192 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-926e9ba8-bbf2-4375-90ae-d97bbffeece9 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:20.455473 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-926e9ba8-bbf2-4375-90ae-d97bbffeece9 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] HTTP exception thrown: Instance b11969e1-8fcb-4287-8d5b-070809e1e452 could not be found. Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-926e9ba8-bbf2-4375-90ae-d97bbffeece9 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Request method failure captured: Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452 HTTP/1.1 Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOzgWRAL8W3pvtHy7QO1hsKjw1IQGpM8uXQqTP_0y95f6VElPTH3GYM5C9RYjEXbywAQzSy_fmVHKXnu6ppauL3ZHSswXXGWDwawQ96a1Jl_qNm6xfFzARnP7xOfTqqvGhYbFCwwNTKgE-nnvQgWk0FayzhzbWRnNzwljEs9NpEitvk Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 4a08a51781e84e1eb215037744ee3a7b Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersTestManualDisk-1048368124 Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4a08a51781e84e1eb215037744ee3a7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4a08a51781e84e1eb215037744ee3a7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4a08a51781e84e1eb215037744ee3a7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4a08a51781e84e1eb215037744ee3a7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersTestManualDisk-1048368124 Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 4a08a51781e84e1eb215037744ee3a7b Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersTestManualDisk-1048368124 Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersTestManualDisk-1048368124-project Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: a262a7ca2be4451a89330098b6134c77 Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersTestManualDisk-1048368124-project Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance b11969e1-8fcb-4287-8d5b-070809e1e452 could not be found. Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'b11969e1-8fcb-4287-8d5b-070809e1e452'} Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b11969e1-8fcb-4287-8d5b-070809e1e452 could not be found. Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b11969e1-8fcb-4287-8d5b-070809e1e452 could not be found. Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:35:20.457720 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:35:20.462578 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:35:20.462578 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:35:20.462578 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:35:20.462578 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:35:20.462578 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:35:20.462578 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b11969e1-8fcb-4287-8d5b-070809e1e452 could not be found. Oct 05 02:35:20.462578 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:35:20.467735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-926e9ba8-bbf2-4375-90ae-d97bbffeece9 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Returning 404 to user: Instance b11969e1-8fcb-4287-8d5b-070809e1e452 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:35:20.468879 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-926e9ba8-bbf2-4375-90ae-d97bbffeece9 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452" status: 404 len: 111 microversion: 2.1 time: 0.069991 Oct 05 02:35:20.469772 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 954/1934] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:20 2022] GET /compute/v2.1/servers/b11969e1-8fcb-4287-8d5b-070809e1e452 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:35:20.476260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-31fb3381-3edc-4d56-8df9-691364febe42 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf6f2670>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:20.691466 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-31fb3381-3edc-4d56-8df9-691364febe42 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad" status: 200 len: 1455 microversion: 2.1 time: 0.220025 Oct 05 02:35:20.696476 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-654e31c6-79fd-4f99-b43c-e7c090cb7ba5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "POST /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47/action" status: 202 len: 0 microversion: 2.1 time: 0.408658 Oct 05 02:35:20.701257 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 955/1935] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:20 2022] GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad => generated 1455 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:20.708077 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 981/1936] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:35:20 2022] POST /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47/action => generated 0 bytes in 421 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 05 02:35:20.712287 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b6146c86-d964-4963-b72f-602a8080fd01 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] Calling method '.version_select at 0x7fcce80cb700>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:20.713996 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-82d93030-9d94-4617-bb32-f0364373cbd1 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce80dbf70>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:20.750794 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b6146c86-d964-4963-b72f-602a8080fd01 tempest-ServersTestManualDisk-1048368124 tempest-ServersTestManualDisk-1048368124-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-884450737" status: 202 len: 0 microversion: 2.1 time: 0.047701 Oct 05 02:35:20.751627 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 956/1937] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 5 02:35:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-884450737 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:35:20.769182 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-82d93030-9d94-4617-bb32-f0364373cbd1 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471" status: 200 len: 1440 microversion: 2.1 time: 0.059343 Oct 05 02:35:20.777466 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 982/1938] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:20 2022] GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471 => generated 1440 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:20.844936 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-f226d173-2395-48a6-be11-5354c2499b65 req-74ea5f89-90a5-468d-874f-09575c02b3dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a28c6ea-5b3d-4f74-b490-8effa4fa813d", "name": "network-vif-plugged", "status": "completed", "tag": "9902bd06-5ff4-4749-a5aa-d4afd71ba732"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:35:20.863466 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f226d173-2395-48a6-be11-5354c2499b65 req-74ea5f89-90a5-468d-874f-09575c02b3dd service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:20.866625 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f226d173-2395-48a6-be11-5354c2499b65 req-74ea5f89-90a5-468d-874f-09575c02b3dd service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:20.867453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f226d173-2395-48a6-be11-5354c2499b65 req-74ea5f89-90a5-468d-874f-09575c02b3dd service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:20.883986 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-f226d173-2395-48a6-be11-5354c2499b65 req-74ea5f89-90a5-468d-874f-09575c02b3dd service nova] Creating event network-vif-plugged:9902bd06-5ff4-4749-a5aa-d4afd71ba732 for instance 7a28c6ea-5b3d-4f74-b490-8effa4fa813d on n-h2-858272-3 Oct 05 02:35:20.891583 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-f226d173-2395-48a6-be11-5354c2499b65 req-74ea5f89-90a5-468d-874f-09575c02b3dd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050655 Oct 05 02:35:20.892764 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 957/1939] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:35:20.928529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-19bd9dba-c836-4dd3-9e7c-b961a0366356 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:20.931030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-19bd9dba-c836-4dd3-9e7c-b961a0366356 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:20.957069 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19bd9dba-c836-4dd3-9e7c-b961a0366356 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:20.959311 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19bd9dba-c836-4dd3-9e7c-b961a0366356 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:20.966457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19bd9dba-c836-4dd3-9e7c-b961a0366356 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:20.967684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19bd9dba-c836-4dd3-9e7c-b961a0366356 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:20.968373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19bd9dba-c836-4dd3-9e7c-b961a0366356 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:20.969683 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19bd9dba-c836-4dd3-9e7c-b961a0366356 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:21.228008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-19bd9dba-c836-4dd3-9e7c-b961a0366356 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:21.236594 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-85800e13-babc-4a6e-a82b-84ecac7a36c6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:21.237773 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-85800e13-babc-4a6e-a82b-84ecac7a36c6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:21.240404 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-19bd9dba-c836-4dd3-9e7c-b961a0366356 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:21.242143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-19bd9dba-c836-4dd3-9e7c-b961a0366356 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:21.243550 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-19bd9dba-c836-4dd3-9e7c-b961a0366356 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1808 microversion: 2.20 time: 0.321861 Oct 05 02:35:21.244319 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 983/1940] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:35:20 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1808 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:35:21.245079 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-85800e13-babc-4a6e-a82b-84ecac7a36c6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:21.245838 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-85800e13-babc-4a6e-a82b-84ecac7a36c6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:21.246806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-85800e13-babc-4a6e-a82b-84ecac7a36c6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:21.247669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-85800e13-babc-4a6e-a82b-84ecac7a36c6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:21.248230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-85800e13-babc-4a6e-a82b-84ecac7a36c6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:21.248784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-85800e13-babc-4a6e-a82b-84ecac7a36c6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:21.301980 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1d132b08-bee0-48b5-bba0-b432f8f95fd6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:21.304316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1d132b08-bee0-48b5-bba0-b432f8f95fd6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:21.319000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d132b08-bee0-48b5-bba0-b432f8f95fd6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:21.319642 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d132b08-bee0-48b5-bba0-b432f8f95fd6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:21.320226 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d132b08-bee0-48b5-bba0-b432f8f95fd6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:21.321076 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d132b08-bee0-48b5-bba0-b432f8f95fd6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:21.321651 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d132b08-bee0-48b5-bba0-b432f8f95fd6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:21.322190 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d132b08-bee0-48b5-bba0-b432f8f95fd6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:21.493602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-85800e13-babc-4a6e-a82b-84ecac7a36c6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:21.505575 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-85800e13-babc-4a6e-a82b-84ecac7a36c6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1199 microversion: 2.1 time: 0.275845 Oct 05 02:35:21.506758 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 958/1941] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:21 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1199 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:21.512183 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2c0596b3-a85f-4f27-8310-61723be7f46b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:21.518900 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2c0596b3-a85f-4f27-8310-61723be7f46b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: 079782c4-bca1-40e0-aa9f-b8afdb6a79af] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:21.534109 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c0596b3-a85f-4f27-8310-61723be7f46b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:21.537138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c0596b3-a85f-4f27-8310-61723be7f46b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:21.537970 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c0596b3-a85f-4f27-8310-61723be7f46b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:21.538778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c0596b3-a85f-4f27-8310-61723be7f46b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:21.539479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c0596b3-a85f-4f27-8310-61723be7f46b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:21.540117 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c0596b3-a85f-4f27-8310-61723be7f46b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:21.545324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:35:21.556494 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-2c0596b3-a85f-4f27-8310-61723be7f46b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] HTTP exception thrown: Instance 079782c4-bca1-40e0-aa9f-b8afdb6a79af could not be found. Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2c0596b3-a85f-4f27-8310-61723be7f46b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Request method failure captured: Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af HTTP/1.1 Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOuH8lbWR5T6J4rN8SVnp5khCjpH7yX47ceKkh7ju-ewftZGsMYkWxiQ-NrHtKY9BWHf2UyRIBx7H_Rf_NGmTCCAA2yb8a_C0L3hWQtPE-mbCgBOezy5TWiBIn7_YUsEf0P-DqK0FHwoc6v36DfLV8QftYAjzTVZ97fZJULLAXqmXoI Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: X-Openstack-Nova-Api-Version: 2.25 Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: bbd25b0a68f749029eeed701c77462ce Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-836018511 Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bbd25b0a68f749029eeed701c77462ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bbd25b0a68f749029eeed701c77462ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bbd25b0a68f749029eeed701c77462ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bbd25b0a68f749029eeed701c77462ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-836018511 Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: bbd25b0a68f749029eeed701c77462ce Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-836018511 Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-LiveAutoBlockMigrationV225Test-836018511-project Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 39671ba0b86847f995c96013947fee65 Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-836018511-project Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 079782c4-bca1-40e0-aa9f-b8afdb6a79af could not be found. Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '079782c4-bca1-40e0-aa9f-b8afdb6a79af'} Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 079782c4-bca1-40e0-aa9f-b8afdb6a79af could not be found. Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 079782c4-bca1-40e0-aa9f-b8afdb6a79af could not be found. Oct 05 02:35:21.558815 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:35:21.563459 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:35:21.563459 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:35:21.563459 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:35:21.563459 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:35:21.563459 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:35:21.563459 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:35:21.563459 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:35:21.563459 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 079782c4-bca1-40e0-aa9f-b8afdb6a79af could not be found. Oct 05 02:35:21.563459 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:35:21.564247 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1d132b08-bee0-48b5-bba0-b432f8f95fd6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:21.565817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2c0596b3-a85f-4f27-8310-61723be7f46b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Returning 404 to user: Instance 079782c4-bca1-40e0-aa9f-b8afdb6a79af could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:35:21.566942 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2c0596b3-a85f-4f27-8310-61723be7f46b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af" status: 404 len: 111 microversion: 2.25 time: 0.059020 Oct 05 02:35:21.568046 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 959/1942] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:35:21 2022] GET /compute/v2.1/servers/079782c4-bca1-40e0-aa9f-b8afdb6a79af => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:35:21.574744 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1d132b08-bee0-48b5-bba0-b432f8f95fd6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 200 len: 1541 microversion: 2.1 time: 0.276618 Oct 05 02:35:21.579095 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7594b8eb-f150-43e3-9007-2edab2aae31b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:21.579872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7594b8eb-f150-43e3-9007-2edab2aae31b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:21.592177 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 984/1943] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:21 2022] GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 1541 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:35:21.594714 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7594b8eb-f150-43e3-9007-2edab2aae31b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:21.595479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7594b8eb-f150-43e3-9007-2edab2aae31b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:21.596197 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7594b8eb-f150-43e3-9007-2edab2aae31b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:21.597234 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7594b8eb-f150-43e3-9007-2edab2aae31b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:21.597968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7594b8eb-f150-43e3-9007-2edab2aae31b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:21.598653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7594b8eb-f150-43e3-9007-2edab2aae31b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:21.635612 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7594b8eb-f150-43e3-9007-2edab2aae31b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:35:21.707580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d5fa5c6e-23ba-4eab-be59-e30b62293b53 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce8038430>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:21.783138 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7594b8eb-f150-43e3-9007-2edab2aae31b tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 204 len: 0 microversion: 2.25 time: 0.207941 Oct 05 02:35:21.787471 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 960/1944] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 5 02:35:21 2022] DELETE /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 02:35:21.803655 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d5fa5c6e-23ba-4eab-be59-e30b62293b53 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad" status: 200 len: 1455 microversion: 2.1 time: 0.099879 Oct 05 02:35:21.804797 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 985/1945] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:21 2022] GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:35:21.810320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0f30569d-c074-434b-a802-29fc0685753c tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce812cdc0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:21.835122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c83cb82e-9763-4b5f-b060-413e43f0d3d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:21.835867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c83cb82e-9763-4b5f-b060-413e43f0d3d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:21.847561 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c83cb82e-9763-4b5f-b060-413e43f0d3d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:21.848050 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c83cb82e-9763-4b5f-b060-413e43f0d3d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:21.848493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c83cb82e-9763-4b5f-b060-413e43f0d3d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:21.858645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c83cb82e-9763-4b5f-b060-413e43f0d3d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:21.859397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c83cb82e-9763-4b5f-b060-413e43f0d3d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:21.860188 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c83cb82e-9763-4b5f-b060-413e43f0d3d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:21.879625 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0f30569d-c074-434b-a802-29fc0685753c tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471" status: 200 len: 1440 microversion: 2.1 time: 0.090568 Oct 05 02:35:21.893276 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 961/1946] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:21 2022] GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471 => generated 1440 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:22.276330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c265e6c6-4cf7-4834-85be-697813902b68 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:22.278721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c265e6c6-4cf7-4834-85be-697813902b68 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:22.287866 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c265e6c6-4cf7-4834-85be-697813902b68 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:22.288733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c265e6c6-4cf7-4834-85be-697813902b68 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:22.290074 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c265e6c6-4cf7-4834-85be-697813902b68 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:22.291162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c265e6c6-4cf7-4834-85be-697813902b68 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:22.291790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c265e6c6-4cf7-4834-85be-697813902b68 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:22.292544 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c265e6c6-4cf7-4834-85be-697813902b68 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:22.550477 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c83cb82e-9763-4b5f-b060-413e43f0d3d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:22.559774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c83cb82e-9763-4b5f-b060-413e43f0d3d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:22.561622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c83cb82e-9763-4b5f-b060-413e43f0d3d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:22.562825 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c83cb82e-9763-4b5f-b060-413e43f0d3d8 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 200 len: 1563 microversion: 2.25 time: 0.756912 Oct 05 02:35:22.563618 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 986/1947] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:35:21 2022] GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 1563 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:35:22.584069 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-24a52b1f-2df6-46a0-8c35-373fd3f6bd51 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:22.585054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-24a52b1f-2df6-46a0-8c35-373fd3f6bd51 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:22.591744 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24a52b1f-2df6-46a0-8c35-373fd3f6bd51 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:22.592241 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24a52b1f-2df6-46a0-8c35-373fd3f6bd51 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:22.592672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24a52b1f-2df6-46a0-8c35-373fd3f6bd51 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:22.595641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24a52b1f-2df6-46a0-8c35-373fd3f6bd51 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:22.596124 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24a52b1f-2df6-46a0-8c35-373fd3f6bd51 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:22.596563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24a52b1f-2df6-46a0-8c35-373fd3f6bd51 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:22.614305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c265e6c6-4cf7-4834-85be-697813902b68 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:22.627704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c265e6c6-4cf7-4834-85be-697813902b68 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:22.630171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c265e6c6-4cf7-4834-85be-697813902b68 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:22.632516 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c265e6c6-4cf7-4834-85be-697813902b68 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1808 microversion: 2.20 time: 0.360631 Oct 05 02:35:22.633504 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 962/1948] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:35:22 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1808 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:35:22.641273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4c93af13-cdc0-45ad-972a-c2e43293924b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:22.641958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4c93af13-cdc0-45ad-972a-c2e43293924b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:22.654674 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c93af13-cdc0-45ad-972a-c2e43293924b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:22.655418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c93af13-cdc0-45ad-972a-c2e43293924b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:22.656064 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c93af13-cdc0-45ad-972a-c2e43293924b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:22.656799 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c93af13-cdc0-45ad-972a-c2e43293924b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:22.657286 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c93af13-cdc0-45ad-972a-c2e43293924b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:22.657712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c93af13-cdc0-45ad-972a-c2e43293924b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:22.999042 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-24a52b1f-2df6-46a0-8c35-373fd3f6bd51 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:23.034262 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-24a52b1f-2df6-46a0-8c35-373fd3f6bd51 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1199 microversion: 2.1 time: 0.453582 Oct 05 02:35:23.062924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4c93af13-cdc0-45ad-972a-c2e43293924b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:23.073521 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 987/1949] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:22 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1199 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:23.083818 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4c93af13-cdc0-45ad-972a-c2e43293924b tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 200 len: 1541 microversion: 2.1 time: 0.441722 Oct 05 02:35:23.090917 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5f7cbb0c-d7d9-4d3e-9787-ffcb89b46834 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce8094a60>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:23.106015 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 963/1950] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:22 2022] GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 1541 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:23.127864 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d4b3ec9e-0e4f-4de8-b9dd-a67c407b28bb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fccdf6610d0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:24.158316 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5f7cbb0c-d7d9-4d3e-9787-ffcb89b46834 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad" status: 200 len: 1455 microversion: 2.1 time: 1.081630 Oct 05 02:35:24.159461 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 988/1951] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:23 2022] GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad => generated 1455 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:24.187287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7785a165-adbb-4116-bd8e-e894b7e51472 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:24.190233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7785a165-adbb-4116-bd8e-e894b7e51472 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:24.196895 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d4b3ec9e-0e4f-4de8-b9dd-a67c407b28bb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471" status: 200 len: 1440 microversion: 2.1 time: 1.084536 Oct 05 02:35:24.197563 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 964/1952] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:23 2022] GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471 => generated 1440 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:24.210022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8bb4e73c-3548-4bb0-a53c-92d99fe98782 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:24.210956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8bb4e73c-3548-4bb0-a53c-92d99fe98782 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:24.211220 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7785a165-adbb-4116-bd8e-e894b7e51472 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:24.211731 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7785a165-adbb-4116-bd8e-e894b7e51472 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:24.213540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7785a165-adbb-4116-bd8e-e894b7e51472 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:24.219321 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7785a165-adbb-4116-bd8e-e894b7e51472 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:24.219986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7785a165-adbb-4116-bd8e-e894b7e51472 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:24.221806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7785a165-adbb-4116-bd8e-e894b7e51472 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:24.228888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bb4e73c-3548-4bb0-a53c-92d99fe98782 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:24.232559 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bb4e73c-3548-4bb0-a53c-92d99fe98782 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:24.233259 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bb4e73c-3548-4bb0-a53c-92d99fe98782 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:24.234280 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bb4e73c-3548-4bb0-a53c-92d99fe98782 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:24.236119 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bb4e73c-3548-4bb0-a53c-92d99fe98782 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:24.238430 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bb4e73c-3548-4bb0-a53c-92d99fe98782 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:24.579384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7785a165-adbb-4116-bd8e-e894b7e51472 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:24.589587 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7785a165-adbb-4116-bd8e-e894b7e51472 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:24.601552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7785a165-adbb-4116-bd8e-e894b7e51472 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:24.602735 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7785a165-adbb-4116-bd8e-e894b7e51472 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 200 len: 1563 microversion: 2.25 time: 0.438996 Oct 05 02:35:24.603323 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 989/1953] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:35:24 2022] GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 1563 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:35:24.613802 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-5dd5b601-9901-40bd-8341-7a6b793a0ff2 req-5251be70-a0f2-43c8-9bfe-00feb186be3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39c77ec6-c103-4c7c-b7c0-0753dd0acf83", "name": "network-vif-plugged", "status": "completed", "tag": "13387ef9-e3f1-49ec-997f-e08850ebba60"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:35:24.628373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:35:24.643158 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-5dd5b601-9901-40bd-8341-7a6b793a0ff2 req-5251be70-a0f2-43c8-9bfe-00feb186be3c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:24.643963 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-5dd5b601-9901-40bd-8341-7a6b793a0ff2 req-5251be70-a0f2-43c8-9bfe-00feb186be3c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:24.644394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-5dd5b601-9901-40bd-8341-7a6b793a0ff2 req-5251be70-a0f2-43c8-9bfe-00feb186be3c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:24.658602 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-5dd5b601-9901-40bd-8341-7a6b793a0ff2 req-5251be70-a0f2-43c8-9bfe-00feb186be3c service nova] Creating event network-vif-plugged:13387ef9-e3f1-49ec-997f-e08850ebba60 for instance 39c77ec6-c103-4c7c-b7c0-0753dd0acf83 on n-h1-858272-3 Oct 05 02:35:24.675073 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-5dd5b601-9901-40bd-8341-7a6b793a0ff2 req-5251be70-a0f2-43c8-9bfe-00feb186be3c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070495 Oct 05 02:35:24.676003 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 990/1954] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:35:24.690331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f13ffc61-7858-4bde-b7cb-fc6fb3d47eec tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:24.691033 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f13ffc61-7858-4bde-b7cb-fc6fb3d47eec tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:24.705474 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f13ffc61-7858-4bde-b7cb-fc6fb3d47eec tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:24.705992 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f13ffc61-7858-4bde-b7cb-fc6fb3d47eec tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:24.706427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f13ffc61-7858-4bde-b7cb-fc6fb3d47eec tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:24.707219 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f13ffc61-7858-4bde-b7cb-fc6fb3d47eec tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:24.708164 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f13ffc61-7858-4bde-b7cb-fc6fb3d47eec tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:24.708500 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f13ffc61-7858-4bde-b7cb-fc6fb3d47eec tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:24.720467 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8bb4e73c-3548-4bb0-a53c-92d99fe98782 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:24.722612 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:35:24.740983 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8bb4e73c-3548-4bb0-a53c-92d99fe98782 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:24.742584 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8bb4e73c-3548-4bb0-a53c-92d99fe98782 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:24.743792 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8bb4e73c-3548-4bb0-a53c-92d99fe98782 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1808 microversion: 2.20 time: 0.543962 Oct 05 02:35:24.744364 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 965/1955] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:35:24 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1808 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:35:24.749744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-65dbc542-940e-48e0-a25e-5da3f1177d14 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:24.750362 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-65dbc542-940e-48e0-a25e-5da3f1177d14 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:24.765445 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65dbc542-940e-48e0-a25e-5da3f1177d14 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:24.766047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65dbc542-940e-48e0-a25e-5da3f1177d14 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:24.766508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65dbc542-940e-48e0-a25e-5da3f1177d14 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:24.767201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65dbc542-940e-48e0-a25e-5da3f1177d14 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:24.767658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65dbc542-940e-48e0-a25e-5da3f1177d14 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:24.768083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65dbc542-940e-48e0-a25e-5da3f1177d14 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:25.121675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f13ffc61-7858-4bde-b7cb-fc6fb3d47eec tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:25.134212 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f13ffc61-7858-4bde-b7cb-fc6fb3d47eec tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1199 microversion: 2.1 time: 0.456833 Oct 05 02:35:25.135114 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 991/1956] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:24 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1199 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:25.140228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-b7289c54-735e-4198-8a5b-6ed732cafcd0 req-464d182e-5972-4323-bd9c-192c4249287d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eddae3fc-f975-45e3-8592-01b10bcf32ad", "name": "network-vif-deleted", "tag": "76ca6ca5-722f-44bd-ab65-b8f77ef0027e"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:35:25.177355 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b7289c54-735e-4198-8a5b-6ed732cafcd0 req-464d182e-5972-4323-bd9c-192c4249287d service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:25.182274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b7289c54-735e-4198-8a5b-6ed732cafcd0 req-464d182e-5972-4323-bd9c-192c4249287d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:25.183513 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b7289c54-735e-4198-8a5b-6ed732cafcd0 req-464d182e-5972-4323-bd9c-192c4249287d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:25.210459 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-b7289c54-735e-4198-8a5b-6ed732cafcd0 req-464d182e-5972-4323-bd9c-192c4249287d service nova] Creating event network-vif-deleted:76ca6ca5-722f-44bd-ab65-b8f77ef0027e for instance eddae3fc-f975-45e3-8592-01b10bcf32ad on n-h1-858272-3 Oct 05 02:35:25.215803 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-b7289c54-735e-4198-8a5b-6ed732cafcd0 req-464d182e-5972-4323-bd9c-192c4249287d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079265 Oct 05 02:35:25.221026 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 992/1957] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:35:25.226845 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c539e65b-1940-4711-af09-fe24d6bc3e14 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce80599d0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:25.275811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-65dbc542-940e-48e0-a25e-5da3f1177d14 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:25.289897 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-65dbc542-940e-48e0-a25e-5da3f1177d14 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 200 len: 1536 microversion: 2.1 time: 0.541739 Oct 05 02:35:25.290803 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 966/1958] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:24 2022] GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 1536 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:25.296795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9cfa5260-6cc9-42df-9317-352259884d05 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fccdf6f2430>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:25.298098 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c539e65b-1940-4711-af09-fe24d6bc3e14 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad" status: 200 len: 1455 microversion: 2.1 time: 0.075384 Oct 05 02:35:25.298686 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 993/1959] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:25 2022] GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad => generated 1455 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:25.375138 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9cfa5260-6cc9-42df-9317-352259884d05 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471" status: 200 len: 1440 microversion: 2.1 time: 0.083028 Oct 05 02:35:25.375786 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 967/1960] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:25 2022] GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471 => generated 1440 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:25.631739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c591d8f8-3280-4f65-8e3a-936a775555c5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:25.632579 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c591d8f8-3280-4f65-8e3a-936a775555c5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:25.640621 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c591d8f8-3280-4f65-8e3a-936a775555c5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:25.641840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c591d8f8-3280-4f65-8e3a-936a775555c5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:25.642520 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c591d8f8-3280-4f65-8e3a-936a775555c5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:25.643472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c591d8f8-3280-4f65-8e3a-936a775555c5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:25.646129 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c591d8f8-3280-4f65-8e3a-936a775555c5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:25.646977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c591d8f8-3280-4f65-8e3a-936a775555c5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:25.690105 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c591d8f8-3280-4f65-8e3a-936a775555c5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:25.691536 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c591d8f8-3280-4f65-8e3a-936a775555c5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:25.691956 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c591d8f8-3280-4f65-8e3a-936a775555c5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:25.692557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-c591d8f8-3280-4f65-8e3a-936a775555c5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lazy-loading 'fault' on Instance uuid eddae3fc-f975-45e3-8592-01b10bcf32ad {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:35:25.774149 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f3c230f7-cafe-4434-9c26-9c6af2d3212f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:25.775456 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f3c230f7-cafe-4434-9c26-9c6af2d3212f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:25.789287 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3c230f7-cafe-4434-9c26-9c6af2d3212f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:25.790227 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3c230f7-cafe-4434-9c26-9c6af2d3212f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:25.790899 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3c230f7-cafe-4434-9c26-9c6af2d3212f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:25.794298 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3c230f7-cafe-4434-9c26-9c6af2d3212f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:25.795083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3c230f7-cafe-4434-9c26-9c6af2d3212f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:25.795933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3c230f7-cafe-4434-9c26-9c6af2d3212f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:26.030015 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c591d8f8-3280-4f65-8e3a-936a775555c5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:26.038439 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c591d8f8-3280-4f65-8e3a-936a775555c5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:26.042825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c591d8f8-3280-4f65-8e3a-936a775555c5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39671ba0b86847f995c96013947fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd25b0a68f749029eeed701c77462ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:26.047854 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c591d8f8-3280-4f65-8e3a-936a775555c5 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 200 len: 1351 microversion: 2.25 time: 0.422490 Oct 05 02:35:26.050128 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 994/1961] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:35:25 2022] GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 1351 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:35:26.142811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f3c230f7-cafe-4434-9c26-9c6af2d3212f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:26.153537 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f3c230f7-cafe-4434-9c26-9c6af2d3212f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:26.155270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f3c230f7-cafe-4434-9c26-9c6af2d3212f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:26.156472 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f3c230f7-cafe-4434-9c26-9c6af2d3212f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1795 microversion: 2.20 time: 0.388161 Oct 05 02:35:26.179310 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4b0534f7-90bd-44f4-8b05-0576d931dc07 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:26.179925 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4b0534f7-90bd-44f4-8b05-0576d931dc07 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:26.190979 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 968/1962] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:35:25 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1795 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:35:26.199093 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b0534f7-90bd-44f4-8b05-0576d931dc07 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:26.200017 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b0534f7-90bd-44f4-8b05-0576d931dc07 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:26.200588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b0534f7-90bd-44f4-8b05-0576d931dc07 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:26.206050 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b0534f7-90bd-44f4-8b05-0576d931dc07 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:26.206583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b0534f7-90bd-44f4-8b05-0576d931dc07 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:26.207132 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b0534f7-90bd-44f4-8b05-0576d931dc07 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:26.318591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b10080c9-0ebe-49f5-bf14-8bddcec3e04e tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf6af550>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:26.408935 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b10080c9-0ebe-49f5-bf14-8bddcec3e04e tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad" status: 200 len: 1455 microversion: 2.1 time: 0.094200 Oct 05 02:35:26.410182 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 969/1963] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:26 2022] GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:26.422467 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-104d8a8b-8528-4cd8-b2e1-6b6a30a500ab tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:26.423585 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-104d8a8b-8528-4cd8-b2e1-6b6a30a500ab tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:26.438806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-104d8a8b-8528-4cd8-b2e1-6b6a30a500ab tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:26.439775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-104d8a8b-8528-4cd8-b2e1-6b6a30a500ab tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:26.440532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-104d8a8b-8528-4cd8-b2e1-6b6a30a500ab tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:26.442604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-104d8a8b-8528-4cd8-b2e1-6b6a30a500ab tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:26.445292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-104d8a8b-8528-4cd8-b2e1-6b6a30a500ab tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:26.446103 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-104d8a8b-8528-4cd8-b2e1-6b6a30a500ab tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:26.454187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4b0534f7-90bd-44f4-8b05-0576d931dc07 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:26.464866 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4b0534f7-90bd-44f4-8b05-0576d931dc07 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1199 microversion: 2.1 time: 0.294567 Oct 05 02:35:26.472185 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 995/1964] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:26 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1199 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:26.497128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d1dd0d06-f4ea-4fd1-a640-0f454ab791b7 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce8059f70>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:26.588440 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d1dd0d06-f4ea-4fd1-a640-0f454ab791b7 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471" status: 200 len: 1440 microversion: 2.1 time: 0.105575 Oct 05 02:35:26.589522 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 996/1965] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:26 2022] GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471 => generated 1440 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:26.716707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-6787ab4c-1300-497a-9654-d3f90e8f4f1b req-504f51a8-9608-4412-b96f-b949d41c80aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f4b118a-e665-4c29-a518-811ca1fc9001", "name": "network-vif-plugged", "status": "completed", "tag": "f83cfb8b-54ff-4810-8dff-d1685b7e58d4"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:35:26.748421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-6787ab4c-1300-497a-9654-d3f90e8f4f1b req-504f51a8-9608-4412-b96f-b949d41c80aa service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:26.749192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-6787ab4c-1300-497a-9654-d3f90e8f4f1b req-504f51a8-9608-4412-b96f-b949d41c80aa service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:26.749743 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-6787ab4c-1300-497a-9654-d3f90e8f4f1b req-504f51a8-9608-4412-b96f-b949d41c80aa service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:26.788356 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-6787ab4c-1300-497a-9654-d3f90e8f4f1b req-504f51a8-9608-4412-b96f-b949d41c80aa service nova] Creating event network-vif-plugged:f83cfb8b-54ff-4810-8dff-d1685b7e58d4 for instance 1f4b118a-e665-4c29-a518-811ca1fc9001 on n-h1-858272-3 Oct 05 02:35:26.803174 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-6787ab4c-1300-497a-9654-d3f90e8f4f1b req-504f51a8-9608-4412-b96f-b949d41c80aa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090527 Oct 05 02:35:26.814460 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 997/1966] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:35:26.824715 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-104d8a8b-8528-4cd8-b2e1-6b6a30a500ab tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:26.842328 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-104d8a8b-8528-4cd8-b2e1-6b6a30a500ab tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 200 len: 1523 microversion: 2.1 time: 0.426701 Oct 05 02:35:26.843728 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 970/1967] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:26 2022] GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 1523 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:26.874557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a17bd5e4-c0df-4d49-a0c5-52efa46a877f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:26.875835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a17bd5e4-c0df-4d49-a0c5-52efa46a877f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:26.891025 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a17bd5e4-c0df-4d49-a0c5-52efa46a877f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:26.892337 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a17bd5e4-c0df-4d49-a0c5-52efa46a877f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:26.892989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a17bd5e4-c0df-4d49-a0c5-52efa46a877f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:26.896122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a17bd5e4-c0df-4d49-a0c5-52efa46a877f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:26.897202 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a17bd5e4-c0df-4d49-a0c5-52efa46a877f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:26.897764 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a17bd5e4-c0df-4d49-a0c5-52efa46a877f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:26.992314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a17bd5e4-c0df-4d49-a0c5-52efa46a877f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:35:27.078682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-beab5628-4e4e-4d39-b434-4f1622c39d06 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:27.080829 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-beab5628-4e4e-4d39-b434-4f1622c39d06 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] [instance: eddae3fc-f975-45e3-8592-01b10bcf32ad] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:27.098685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-beab5628-4e4e-4d39-b434-4f1622c39d06 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:27.101321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-beab5628-4e4e-4d39-b434-4f1622c39d06 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:27.102038 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-beab5628-4e4e-4d39-b434-4f1622c39d06 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:27.106681 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-beab5628-4e4e-4d39-b434-4f1622c39d06 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:27.109912 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-beab5628-4e4e-4d39-b434-4f1622c39d06 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:27.110657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-beab5628-4e4e-4d39-b434-4f1622c39d06 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:27.157492 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-beab5628-4e4e-4d39-b434-4f1622c39d06 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] HTTP exception thrown: Instance eddae3fc-f975-45e3-8592-01b10bcf32ad could not be found. Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-beab5628-4e4e-4d39-b434-4f1622c39d06 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Request method failure captured: Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad HTTP/1.1 Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOuH8lbWR5T6J4rN8SVnp5khCjpH7yX47ceKkh7ju-ewftZGsMYkWxiQ-NrHtKY9BWHf2UyRIBx7H_Rf_NGmTCCAA2yb8a_C0L3hWQtPE-mbCgBOezy5TWiBIn7_YUsEf0P-DqK0FHwoc6v36DfLV8QftYAjzTVZ97fZJULLAXqmXoI Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: X-Openstack-Nova-Api-Version: 2.25 Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: bbd25b0a68f749029eeed701c77462ce Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-836018511 Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bbd25b0a68f749029eeed701c77462ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bbd25b0a68f749029eeed701c77462ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bbd25b0a68f749029eeed701c77462ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bbd25b0a68f749029eeed701c77462ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-836018511 Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: bbd25b0a68f749029eeed701c77462ce Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-836018511 Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-LiveAutoBlockMigrationV225Test-836018511-project Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 39671ba0b86847f995c96013947fee65 Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-836018511-project Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance eddae3fc-f975-45e3-8592-01b10bcf32ad could not be found. Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'eddae3fc-f975-45e3-8592-01b10bcf32ad'} Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eddae3fc-f975-45e3-8592-01b10bcf32ad could not be found. Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eddae3fc-f975-45e3-8592-01b10bcf32ad could not be found. Oct 05 02:35:27.163083 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:35:27.172748 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:35:27.172748 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:35:27.172748 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:35:27.172748 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:35:27.172748 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:35:27.172748 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:35:27.172748 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:35:27.172748 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eddae3fc-f975-45e3-8592-01b10bcf32ad could not be found. Oct 05 02:35:27.172748 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:35:27.176840 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-beab5628-4e4e-4d39-b434-4f1622c39d06 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] Returning 404 to user: Instance eddae3fc-f975-45e3-8592-01b10bcf32ad could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:35:27.182340 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-beab5628-4e4e-4d39-b434-4f1622c39d06 tempest-LiveAutoBlockMigrationV225Test-836018511 tempest-LiveAutoBlockMigrationV225Test-836018511-project] 10.222.0.16 "GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad" status: 404 len: 111 microversion: 2.25 time: 0.106216 Oct 05 02:35:27.185164 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a17bd5e4-c0df-4d49-a0c5-52efa46a877f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "DELETE /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 204 len: 0 microversion: 2.1 time: 0.318696 Oct 05 02:35:27.185984 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 971/1968] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:35:27 2022] GET /compute/v2.1/servers/eddae3fc-f975-45e3-8592-01b10bcf32ad => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 05 02:35:27.189273 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 998/1969] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:35:26 2022] DELETE /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:35:27.200368 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5f7e2833-9209-4a1a-bc10-9908ed9a854a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:27.201419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5f7e2833-9209-4a1a-bc10-9908ed9a854a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:27.209420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f7e2833-9209-4a1a-bc10-9908ed9a854a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:27.210367 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f7e2833-9209-4a1a-bc10-9908ed9a854a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:27.211270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f7e2833-9209-4a1a-bc10-9908ed9a854a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:27.212220 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f7e2833-9209-4a1a-bc10-9908ed9a854a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:27.212893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f7e2833-9209-4a1a-bc10-9908ed9a854a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:27.213574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f7e2833-9209-4a1a-bc10-9908ed9a854a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:27.429413 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0fee834b-c080-4865-8436-8d2e916d14db tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce804bf70>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:27.532891 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0fee834b-c080-4865-8436-8d2e916d14db tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad" status: 200 len: 1455 microversion: 2.1 time: 0.070934 Oct 05 02:35:27.532891 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 999/1970] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:27 2022] GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad => generated 1455 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:27.532891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a26041b5-df83-4bab-9354-fdd65f45c645 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:27.532891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a26041b5-df83-4bab-9354-fdd65f45c645 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:27.532891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a26041b5-df83-4bab-9354-fdd65f45c645 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:27.532891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a26041b5-df83-4bab-9354-fdd65f45c645 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:27.537288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a26041b5-df83-4bab-9354-fdd65f45c645 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:27.537753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a26041b5-df83-4bab-9354-fdd65f45c645 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:27.538242 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a26041b5-df83-4bab-9354-fdd65f45c645 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:27.538682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a26041b5-df83-4bab-9354-fdd65f45c645 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:27.552112 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5f7e2833-9209-4a1a-bc10-9908ed9a854a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:27.567336 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5f7e2833-9209-4a1a-bc10-9908ed9a854a tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 200 len: 1529 microversion: 2.1 time: 0.373452 Oct 05 02:35:27.568313 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 972/1971] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:27 2022] GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 1529 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:27.603954 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-58d8e124-0afd-4d47-a97a-3147180c67be tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fccdf655b80>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:27.679024 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-58d8e124-0afd-4d47-a97a-3147180c67be tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471" status: 200 len: 1440 microversion: 2.1 time: 0.079166 Oct 05 02:35:27.679713 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 973/1972] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:27 2022] GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471 => generated 1440 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:35:27.906371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a26041b5-df83-4bab-9354-fdd65f45c645 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:27.915239 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a26041b5-df83-4bab-9354-fdd65f45c645 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1199 microversion: 2.1 time: 0.412080 Oct 05 02:35:27.916008 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1000/1973] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:27 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1199 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:28.510347 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0e7861a7-2c02-4cf7-a515-d72cf55d06a4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf65f8b0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:28.575934 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0e7861a7-2c02-4cf7-a515-d72cf55d06a4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad" status: 200 len: 1455 microversion: 2.1 time: 0.070375 Oct 05 02:35:28.577185 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 974/1974] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:28 2022] GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad => generated 1455 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:35:28.596867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fafe3758-adcf-4ede-9e5f-92716e261d16 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:28.597515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fafe3758-adcf-4ede-9e5f-92716e261d16 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:28.606857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fafe3758-adcf-4ede-9e5f-92716e261d16 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:28.608935 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fafe3758-adcf-4ede-9e5f-92716e261d16 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:28.609388 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fafe3758-adcf-4ede-9e5f-92716e261d16 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:28.610115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fafe3758-adcf-4ede-9e5f-92716e261d16 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:28.610573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fafe3758-adcf-4ede-9e5f-92716e261d16 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:28.611914 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fafe3758-adcf-4ede-9e5f-92716e261d16 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:28.695016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d216a6c0-32d1-4156-9a58-1031393209ad tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fccdf655af0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:28.807645 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d216a6c0-32d1-4156-9a58-1031393209ad tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471" status: 200 len: 1440 microversion: 2.1 time: 0.116229 Oct 05 02:35:28.809203 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 975/1975] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:28 2022] GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471 => generated 1440 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:35:28.901869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fafe3758-adcf-4ede-9e5f-92716e261d16 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:28.912140 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fafe3758-adcf-4ede-9e5f-92716e261d16 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 200 len: 1529 microversion: 2.1 time: 0.319924 Oct 05 02:35:28.914277 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1001/1976] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:28 2022] GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 1529 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:28.941745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8bee9d13-11aa-4bfd-8c58-3eafceda986b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:28.942415 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8bee9d13-11aa-4bfd-8c58-3eafceda986b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:28.970703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bee9d13-11aa-4bfd-8c58-3eafceda986b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:28.971371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bee9d13-11aa-4bfd-8c58-3eafceda986b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:28.971869 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bee9d13-11aa-4bfd-8c58-3eafceda986b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:28.972632 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bee9d13-11aa-4bfd-8c58-3eafceda986b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:28.973125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bee9d13-11aa-4bfd-8c58-3eafceda986b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:28.973558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bee9d13-11aa-4bfd-8c58-3eafceda986b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:29.028847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-a1822a37-02d7-4be1-a60b-b36dfe962637 req-0b1a5b7b-8147-4f98-abfc-b7f380fa8f03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2e6dcdb-9664-46eb-b40d-58d894b62b47", "name": "network-vif-plugged", "status": "completed", "tag": "142146ee-f359-42c9-8f33-3302d82a8401"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:35:29.051027 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a1822a37-02d7-4be1-a60b-b36dfe962637 req-0b1a5b7b-8147-4f98-abfc-b7f380fa8f03 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:29.052976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a1822a37-02d7-4be1-a60b-b36dfe962637 req-0b1a5b7b-8147-4f98-abfc-b7f380fa8f03 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:29.053707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a1822a37-02d7-4be1-a60b-b36dfe962637 req-0b1a5b7b-8147-4f98-abfc-b7f380fa8f03 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:29.094286 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-a1822a37-02d7-4be1-a60b-b36dfe962637 req-0b1a5b7b-8147-4f98-abfc-b7f380fa8f03 service nova] Creating event network-vif-plugged:142146ee-f359-42c9-8f33-3302d82a8401 for instance f2e6dcdb-9664-46eb-b40d-58d894b62b47 on n-h1-858272-3 Oct 05 02:35:29.127703 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-a1822a37-02d7-4be1-a60b-b36dfe962637 req-0b1a5b7b-8147-4f98-abfc-b7f380fa8f03 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104000 Oct 05 02:35:29.128991 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1002/1977] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:35:29.589538 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8bee9d13-11aa-4bfd-8c58-3eafceda986b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:29.610303 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fd7c52a6-03db-465d-8d77-09c97535d289 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce8142700>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:29.639193 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8bee9d13-11aa-4bfd-8c58-3eafceda986b tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1199 microversion: 2.1 time: 0.693980 Oct 05 02:35:29.641401 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 976/1978] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:28 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1199 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:29.740951 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fd7c52a6-03db-465d-8d77-09c97535d289 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad" status: 200 len: 1455 microversion: 2.1 time: 0.142309 Oct 05 02:35:29.742300 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1003/1979] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:29 2022] GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad => generated 1455 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:35:29.826162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d6642606-87c1-4be2-99d6-2caa5165ea39 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fccdf6af430>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:29.883095 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d6642606-87c1-4be2-99d6-2caa5165ea39 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471" status: 200 len: 1440 microversion: 2.1 time: 0.061485 Oct 05 02:35:29.884276 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 977/1980] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:29 2022] GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471 => generated 1440 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:29.937246 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2f417c5b-cf43-4d14-acc6-b2981c025c6d tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:29.938161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2f417c5b-cf43-4d14-acc6-b2981c025c6d tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:29.948851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f417c5b-cf43-4d14-acc6-b2981c025c6d tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:29.952879 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f417c5b-cf43-4d14-acc6-b2981c025c6d tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:29.953475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f417c5b-cf43-4d14-acc6-b2981c025c6d tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:29.956210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f417c5b-cf43-4d14-acc6-b2981c025c6d tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:29.957571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f417c5b-cf43-4d14-acc6-b2981c025c6d tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:29.958254 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f417c5b-cf43-4d14-acc6-b2981c025c6d tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:30.214547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2f417c5b-cf43-4d14-acc6-b2981c025c6d tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:30.223191 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2f417c5b-cf43-4d14-acc6-b2981c025c6d tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 200 len: 1529 microversion: 2.1 time: 0.291307 Oct 05 02:35:30.237595 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1004/1981] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:29 2022] GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 1529 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:30.669546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b68eb855-fd96-4c14-bb8b-ab9375b85ce1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:30.670172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b68eb855-fd96-4c14-bb8b-ab9375b85ce1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:30.695248 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b68eb855-fd96-4c14-bb8b-ab9375b85ce1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:30.700275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b68eb855-fd96-4c14-bb8b-ab9375b85ce1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:30.701116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b68eb855-fd96-4c14-bb8b-ab9375b85ce1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:30.704598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b68eb855-fd96-4c14-bb8b-ab9375b85ce1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:30.707267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b68eb855-fd96-4c14-bb8b-ab9375b85ce1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:30.710078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b68eb855-fd96-4c14-bb8b-ab9375b85ce1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:30.758902 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-133525ec-3e29-449d-9617-55b499590bb1 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce8094e50>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:31.127418 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-133525ec-3e29-449d-9617-55b499590bb1 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad" status: 200 len: 1455 microversion: 2.1 time: 0.372887 Oct 05 02:35:31.128334 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1005/1982] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:30 2022] GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad => generated 1455 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:35:31.146000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1c51f8db-bf14-4b5b-9993-967d41d427af tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce804b550>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:31.370475 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b68eb855-fd96-4c14-bb8b-ab9375b85ce1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:31.399175 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b68eb855-fd96-4c14-bb8b-ab9375b85ce1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1383 microversion: 2.1 time: 0.732644 Oct 05 02:35:31.400472 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 978/1983] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:30 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1383 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:31.410396 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-fccee0c5-4d56-41d0-8f36-22572d5c2a9e req-efe7cab0-4e2c-410d-8039-45759078427a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39c77ec6-c103-4c7c-b7c0-0753dd0acf83", "name": "network-vif-unplugged", "status": "completed", "tag": "13387ef9-e3f1-49ec-997f-e08850ebba60"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:35:31.423375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-fccee0c5-4d56-41d0-8f36-22572d5c2a9e req-efe7cab0-4e2c-410d-8039-45759078427a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:31.424246 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-fccee0c5-4d56-41d0-8f36-22572d5c2a9e req-efe7cab0-4e2c-410d-8039-45759078427a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:31.425071 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-fccee0c5-4d56-41d0-8f36-22572d5c2a9e req-efe7cab0-4e2c-410d-8039-45759078427a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:31.443429 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-fccee0c5-4d56-41d0-8f36-22572d5c2a9e req-efe7cab0-4e2c-410d-8039-45759078427a service nova] Creating event network-vif-unplugged:13387ef9-e3f1-49ec-997f-e08850ebba60 for instance 39c77ec6-c103-4c7c-b7c0-0753dd0acf83 on n-h1-858272-3 Oct 05 02:35:31.457991 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-fccee0c5-4d56-41d0-8f36-22572d5c2a9e req-efe7cab0-4e2c-410d-8039-45759078427a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051895 Oct 05 02:35:31.461885 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 979/1984] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:35:31.473541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f81f4af6-f760-4578-94f2-ebe248c80b32 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:31.476505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f81f4af6-f760-4578-94f2-ebe248c80b32 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:31.502465 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f81f4af6-f760-4578-94f2-ebe248c80b32 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:31.505480 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f81f4af6-f760-4578-94f2-ebe248c80b32 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:31.506484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f81f4af6-f760-4578-94f2-ebe248c80b32 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:31.509787 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f81f4af6-f760-4578-94f2-ebe248c80b32 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:31.510515 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f81f4af6-f760-4578-94f2-ebe248c80b32 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:31.511799 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f81f4af6-f760-4578-94f2-ebe248c80b32 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:31.758961 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f81f4af6-f760-4578-94f2-ebe248c80b32 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:31.768816 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f81f4af6-f760-4578-94f2-ebe248c80b32 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 200 len: 1310 microversion: 2.1 time: 0.305441 Oct 05 02:35:31.788816 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 980/1985] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:31 2022] GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 1310 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:31.809572 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-7bf9fe09-e233-47d8-b0da-0d6b801263ea req-e0604cae-4956-4fa2-ac19-e1c15486e5a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39c77ec6-c103-4c7c-b7c0-0753dd0acf83", "name": "network-vif-deleted", "tag": "13387ef9-e3f1-49ec-997f-e08850ebba60"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:35:31.862933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7bf9fe09-e233-47d8-b0da-0d6b801263ea req-e0604cae-4956-4fa2-ac19-e1c15486e5a3 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:31.864215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7bf9fe09-e233-47d8-b0da-0d6b801263ea req-e0604cae-4956-4fa2-ac19-e1c15486e5a3 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:31.869067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7bf9fe09-e233-47d8-b0da-0d6b801263ea req-e0604cae-4956-4fa2-ac19-e1c15486e5a3 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:31.930887 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-7bf9fe09-e233-47d8-b0da-0d6b801263ea req-e0604cae-4956-4fa2-ac19-e1c15486e5a3 service nova] Creating event network-vif-deleted:13387ef9-e3f1-49ec-997f-e08850ebba60 for instance 39c77ec6-c103-4c7c-b7c0-0753dd0acf83 on n-h1-858272-3 Oct 05 02:35:31.962020 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-7bf9fe09-e233-47d8-b0da-0d6b801263ea req-e0604cae-4956-4fa2-ac19-e1c15486e5a3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165762 Oct 05 02:35:31.970338 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 981/1986] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:35:32.480958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1ff451ae-11be-4f75-b19e-80fc6da1c224 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:32.482218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1ff451ae-11be-4f75-b19e-80fc6da1c224 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:32.508221 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ff451ae-11be-4f75-b19e-80fc6da1c224 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:32.509102 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ff451ae-11be-4f75-b19e-80fc6da1c224 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:32.513219 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ff451ae-11be-4f75-b19e-80fc6da1c224 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:32.518958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ff451ae-11be-4f75-b19e-80fc6da1c224 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:32.521443 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ff451ae-11be-4f75-b19e-80fc6da1c224 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:32.522017 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ff451ae-11be-4f75-b19e-80fc6da1c224 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:32.988252 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1ff451ae-11be-4f75-b19e-80fc6da1c224 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1534 microversion: 2.1 time: 1.013680 Oct 05 02:35:32.995844 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 982/1987] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:31 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1534 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:33.023011 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f55135ec-2733-4498-b493-3cc62cb10a0c tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf6af550>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:36.115738 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1c51f8db-bf14-4b5b-9993-967d41d427af tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471" status: 200 len: 1440 microversion: 2.1 time: 4.986104 Oct 05 02:35:36.117099 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f55135ec-2733-4498-b493-3cc62cb10a0c tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad" status: 200 len: 1464 microversion: 2.1 time: 3.117751 Oct 05 02:35:36.126285 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 983/1988] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:32 2022] GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad => generated 1464 bytes in 3124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:36.126285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7f457d47-7fd7-4a69-8b10-db45020c16fd tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:36.126285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7f457d47-7fd7-4a69-8b10-db45020c16fd tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:36.126987 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1006/1989] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:31 2022] GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471 => generated 1440 bytes in 4998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:36.132834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-eb254252-31c4-4830-bc27-dc42a9ee413f tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:36.133743 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-eb254252-31c4-4830-bc27-dc42a9ee413f tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:36.143814 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb254252-31c4-4830-bc27-dc42a9ee413f tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:36.144564 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb254252-31c4-4830-bc27-dc42a9ee413f tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:36.145179 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb254252-31c4-4830-bc27-dc42a9ee413f tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:36.146026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb254252-31c4-4830-bc27-dc42a9ee413f tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:36.146677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb254252-31c4-4830-bc27-dc42a9ee413f tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:36.147391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb254252-31c4-4830-bc27-dc42a9ee413f tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:36.152751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f457d47-7fd7-4a69-8b10-db45020c16fd tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:36.153367 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f457d47-7fd7-4a69-8b10-db45020c16fd tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:36.153814 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f457d47-7fd7-4a69-8b10-db45020c16fd tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:36.154530 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f457d47-7fd7-4a69-8b10-db45020c16fd tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:36.154988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f457d47-7fd7-4a69-8b10-db45020c16fd tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:36.155412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f457d47-7fd7-4a69-8b10-db45020c16fd tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:36.178682 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-7f457d47-7fd7-4a69-8b10-db45020c16fd tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] HTTP exception thrown: Instance 39c77ec6-c103-4c7c-b7c0-0753dd0acf83 could not be found. Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7f457d47-7fd7-4a69-8b10-db45020c16fd tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Request method failure captured: Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 HTTP/1.1 Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO0XYeg8tqT8ongEAJOwqXQnTLTHZzTVGNp07qyK2Im6Pk37xE9_000kJ-ghGlg1M4xDfFZdh80YSHVWWaKUqSxFWQ_Csj3K04E3ui1EPC1OYFRpRVpFWUIW6dnDr0Kom0Z5CM2HBG5dMHahqKQPxztoTXPVRWZPXtn1QZY0a3PPLGY Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 47098be734b14277a4d9a9d6b8464998 Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_47098be734b14277a4d9a9d6b8464998"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 47098be734b14277a4d9a9d6b8464998 Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ImagesOneServerNegativeTestJSON-1772902756-project Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 4c441be8c87648bf9f1ff5cd4aff2532 Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756-project Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 39c77ec6-c103-4c7c-b7c0-0753dd0acf83 could not be found. Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '39c77ec6-c103-4c7c-b7c0-0753dd0acf83'} Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39c77ec6-c103-4c7c-b7c0-0753dd0acf83 could not be found. Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39c77ec6-c103-4c7c-b7c0-0753dd0acf83 could not be found. Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:35:36.181917 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:35:36.186738 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:35:36.186738 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:35:36.186738 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:35:36.186738 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:35:36.186738 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:35:36.186738 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:35:36.186738 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39c77ec6-c103-4c7c-b7c0-0753dd0acf83 could not be found. Oct 05 02:35:36.186738 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:35:36.189460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7f457d47-7fd7-4a69-8b10-db45020c16fd tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Returning 404 to user: Instance 39c77ec6-c103-4c7c-b7c0-0753dd0acf83 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:35:36.190513 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7f457d47-7fd7-4a69-8b10-db45020c16fd tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 404 len: 111 microversion: 2.1 time: 0.068917 Oct 05 02:35:36.191729 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 984/1990] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:36 2022] GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:35:36.219791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-233a1970-18de-4147-a4e1-fafd601f9715 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d651f5ab-295f-4224-95de-8cfcc2bd932c"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:35:36.229893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-233a1970-18de-4147-a4e1-fafd601f9715 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 99fb0801-33dd-4993-a8d9-18a43e372684] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:36.241175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-233a1970-18de-4147-a4e1-fafd601f9715 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:36.242036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-233a1970-18de-4147-a4e1-fafd601f9715 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:36.242612 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-233a1970-18de-4147-a4e1-fafd601f9715 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:36.243489 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-233a1970-18de-4147-a4e1-fafd601f9715 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:36.246496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-233a1970-18de-4147-a4e1-fafd601f9715 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:36.249322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-233a1970-18de-4147-a4e1-fafd601f9715 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:36.454687 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-eb254252-31c4-4830-bc27-dc42a9ee413f tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1534 microversion: 2.1 time: 0.326357 Oct 05 02:35:36.457890 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1007/1991] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:36 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1534 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:36.476467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3710c419-1a92-44a3-bf77-5eddebad1781 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce8142310>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:36.574984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:35:36.584593 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3710c419-1a92-44a3-bf77-5eddebad1781 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad" status: 200 len: 1464 microversion: 2.1 time: 0.117842 Oct 05 02:35:36.585611 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1008/1992] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:36 2022] GET /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad => generated 1464 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:36.603230 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b31ac0ff-7b01-439b-b2cb-4894ff4357fc tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1863421819", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:35:36.669462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-b31ac0ff-7b01-439b-b2cb-4894ff4357fc tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] validate_networks() for [('3003c70e-e5f1-4423-9bef-5932f599e8ba', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:35:36.808390 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-233a1970-18de-4147-a4e1-fafd601f9715 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "POST /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.602162 Oct 05 02:35:36.809346 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 985/1993] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 02:35:36 2022] POST /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684/os-volume_attachments => generated 194 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:35:36.839956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-19e130f6-c19d-42c4-bbcf-da3f83b82cf6 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:36.848879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19e130f6-c19d-42c4-bbcf-da3f83b82cf6 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:36.849748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19e130f6-c19d-42c4-bbcf-da3f83b82cf6 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:36.850908 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19e130f6-c19d-42c4-bbcf-da3f83b82cf6 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:36.851893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19e130f6-c19d-42c4-bbcf-da3f83b82cf6 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:36.853538 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19e130f6-c19d-42c4-bbcf-da3f83b82cf6 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:36.855075 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19e130f6-c19d-42c4-bbcf-da3f83b82cf6 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:36.898637 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-19e130f6-c19d-42c4-bbcf-da3f83b82cf6 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.084365 Oct 05 02:35:36.900477 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 986/1994] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Oct 5 02:35:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:35:36.908049 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-03e303db-3c05-48fc-bd8b-6f46ed2175d7 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:36.909017 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-03e303db-3c05-48fc-bd8b-6f46ed2175d7 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: e123bb72-45c5-4371-bf2e-f0747497f16b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:36.920299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-03e303db-3c05-48fc-bd8b-6f46ed2175d7 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:36.921082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-03e303db-3c05-48fc-bd8b-6f46ed2175d7 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:36.921798 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-03e303db-3c05-48fc-bd8b-6f46ed2175d7 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:36.922803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-03e303db-3c05-48fc-bd8b-6f46ed2175d7 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:36.923522 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-03e303db-3c05-48fc-bd8b-6f46ed2175d7 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:36.924111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-03e303db-3c05-48fc-bd8b-6f46ed2175d7 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:37.306736 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-03e303db-3c05-48fc-bd8b-6f46ed2175d7 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f551e15d65a34daaac2b4d4f5963c522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7719a3153f66484c8758bb0999719851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:37.320027 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-03e303db-3c05-48fc-bd8b-6f46ed2175d7 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/servers/e123bb72-45c5-4371-bf2e-f0747497f16b" status: 200 len: 1467 microversion: 2.1 time: 0.417810 Oct 05 02:35:37.320613 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 987/1995] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:36 2022] GET /compute/v2.1/servers/e123bb72-45c5-4371-bf2e-f0747497f16b => generated 1467 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:37.350220 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ebe41a0b-d19f-4331-99b0-2c033ed4767c tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858272-3", "block_migration": false, "disk_over_commit": false}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:35:37.362111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ebe41a0b-d19f-4331-99b0-2c033ed4767c tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:37.369126 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ebe41a0b-d19f-4331-99b0-2c033ed4767c tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:37.370552 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ebe41a0b-d19f-4331-99b0-2c033ed4767c tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:37.371137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ebe41a0b-d19f-4331-99b0-2c033ed4767c tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:37.381687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ebe41a0b-d19f-4331-99b0-2c033ed4767c tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:37.384200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ebe41a0b-d19f-4331-99b0-2c033ed4767c tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:37.384810 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ebe41a0b-d19f-4331-99b0-2c033ed4767c tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:37.450091 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-ebe41a0b-d19f-4331-99b0-2c033ed4767c tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lazy-loading 'flavor' on Instance uuid 1f4b118a-e665-4c29-a518-811ca1fc9001 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:35:37.465665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ebe41a0b-d19f-4331-99b0-2c033ed4767c tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Going to try to live migrate instance to n-h2-858272-3 {{(pid=122319) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 05 02:35:37.746588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-b31ac0ff-7b01-439b-b2cb-4894ff4357fc tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:35:37.747122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-b31ac0ff-7b01-439b-b2cb-4894ff4357fc tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:35:37.747467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-b31ac0ff-7b01-439b-b2cb-4894ff4357fc tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:35:37.747873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-b31ac0ff-7b01-439b-b2cb-4894ff4357fc tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:35:37.748341 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-b31ac0ff-7b01-439b-b2cb-4894ff4357fc tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:35:37.777872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b31ac0ff-7b01-439b-b2cb-4894ff4357fc tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:37.780171 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b31ac0ff-7b01-439b-b2cb-4894ff4357fc tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:37.781035 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b31ac0ff-7b01-439b-b2cb-4894ff4357fc tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:37.781853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b31ac0ff-7b01-439b-b2cb-4894ff4357fc tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:37.784002 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b31ac0ff-7b01-439b-b2cb-4894ff4357fc tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:37.784624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b31ac0ff-7b01-439b-b2cb-4894ff4357fc tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:37.865997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-b31ac0ff-7b01-439b-b2cb-4894ff4357fc tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Getting quotas for project 47098be734b14277a4d9a9d6b8464998. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:35:37.882490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-b31ac0ff-7b01-439b-b2cb-4894ff4357fc tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Getting quotas for user 4c441be8c87648bf9f1ff5cd4aff2532 and project 47098be734b14277a4d9a9d6b8464998. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:35:37.916155 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b31ac0ff-7b01-439b-b2cb-4894ff4357fc tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:35:37.920837 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b31ac0ff-7b01-439b-b2cb-4894ff4357fc tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 7ce24132-2878-49fd-affe-8e57d06ed5ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:35:38.025838 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b31ac0ff-7b01-439b-b2cb-4894ff4357fc tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.432653 Oct 05 02:35:38.027864 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1009/1996] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:35:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 1442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:35:38.052672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-43e448b6-461c-4a10-b1cd-36cdb8ebaf18 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fccdf748ca0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:38.136880 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-43e448b6-461c-4a10-b1cd-36cdb8ebaf18 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471" status: 200 len: 1440 microversion: 2.1 time: 0.099468 Oct 05 02:35:38.137947 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1010/1997] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:38 2022] GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471 => generated 1440 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:38.151813 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5255d962-98bb-4368-a618-5591dc7e7551 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-430398364"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:35:38.154848 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5255d962-98bb-4368-a618-5591dc7e7551 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: 7b30cf01-6bc7-453f-b9f2-98400bcfc063] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:38.170486 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5255d962-98bb-4368-a618-5591dc7e7551 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:38.173991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5255d962-98bb-4368-a618-5591dc7e7551 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:38.174627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5255d962-98bb-4368-a618-5591dc7e7551 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:38.175845 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5255d962-98bb-4368-a618-5591dc7e7551 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:38.176444 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5255d962-98bb-4368-a618-5591dc7e7551 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:38.182352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5255d962-98bb-4368-a618-5591dc7e7551 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:38.754662 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5255d962-98bb-4368-a618-5591dc7e7551 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "POST /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063/action" status: 202 len: 0 microversion: 2.1 time: 0.611000 Oct 05 02:35:38.756145 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1011/1998] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:35:38 2022] POST /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063/action => generated 0 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 05 02:35:38.764931 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-671b8de8-3797-4e78-89d7-c427c135df64 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:38.765865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-671b8de8-3797-4e78-89d7-c427c135df64 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 7ce24132-2878-49fd-affe-8e57d06ed5ce] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:38.847802 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-671b8de8-3797-4e78-89d7-c427c135df64 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:38.859018 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-671b8de8-3797-4e78-89d7-c427c135df64 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce" status: 200 len: 1225 microversion: 2.1 time: 0.101310 Oct 05 02:35:38.859823 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1012/1999] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:38 2022] GET /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:38.875611 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a408d01e-566d-4abd-82ed-ba8c069118c4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf75df70>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:38.964848 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a408d01e-566d-4abd-82ed-ba8c069118c4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02" status: 200 len: 1454 microversion: 2.1 time: 0.102748 Oct 05 02:35:38.966322 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1013/2000] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:38 2022] GET /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02 => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:39.164498 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b5230cbf-5e1f-4318-b09b-1b6371568dcb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fccdf756f70>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:39.281305 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b5230cbf-5e1f-4318-b09b-1b6371568dcb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471" status: 200 len: 1440 microversion: 2.1 time: 0.132091 Oct 05 02:35:39.292349 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1014/2001] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:39 2022] GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471 => generated 1440 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:35:39.883898 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-841508ca-e783-44ea-b3da-5fae9fd639a6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:39.884940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-841508ca-e783-44ea-b3da-5fae9fd639a6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 7ce24132-2878-49fd-affe-8e57d06ed5ce] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:39.899785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-841508ca-e783-44ea-b3da-5fae9fd639a6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:39.900744 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-841508ca-e783-44ea-b3da-5fae9fd639a6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:39.902027 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-841508ca-e783-44ea-b3da-5fae9fd639a6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:39.904081 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-841508ca-e783-44ea-b3da-5fae9fd639a6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:39.905161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-841508ca-e783-44ea-b3da-5fae9fd639a6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:39.905791 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-841508ca-e783-44ea-b3da-5fae9fd639a6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:40.130637 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-841508ca-e783-44ea-b3da-5fae9fd639a6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:40.156673 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-841508ca-e783-44ea-b3da-5fae9fd639a6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce" status: 200 len: 1277 microversion: 2.1 time: 0.277096 Oct 05 02:35:40.176166 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1015/2002] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:39 2022] GET /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce => generated 1277 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:40.187530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-794ce436-63f0-4728-b364-8b48fa41e2d4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce8041280>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:40.283130 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-794ce436-63f0-4728-b364-8b48fa41e2d4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02" status: 200 len: 1454 microversion: 2.1 time: 0.105457 Oct 05 02:35:40.297191 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1016/2003] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:40 2022] GET /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02 => generated 1454 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:40.307155 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c5e4225e-da11-4a08-9f35-6b904df3af35 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fccdf75d1f0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:40.447431 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c5e4225e-da11-4a08-9f35-6b904df3af35 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471" status: 200 len: 1440 microversion: 2.1 time: 0.143456 Oct 05 02:35:40.459120 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1017/2004] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:40 2022] GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471 => generated 1440 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:35:40.498320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-48cd1a05-8e1f-4b8c-b338-01bbf0cc47a3 req-998a3328-f502-4c70-8aca-3a7b71e04314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e123bb72-45c5-4371-bf2e-f0747497f16b", "name": "network-vif-unplugged", "status": "completed", "tag": "05da60d7-1d7e-4607-a912-92561fc99617"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:35:40.537750 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-48cd1a05-8e1f-4b8c-b338-01bbf0cc47a3 req-998a3328-f502-4c70-8aca-3a7b71e04314 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:40.539094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-48cd1a05-8e1f-4b8c-b338-01bbf0cc47a3 req-998a3328-f502-4c70-8aca-3a7b71e04314 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:40.541319 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-48cd1a05-8e1f-4b8c-b338-01bbf0cc47a3 req-998a3328-f502-4c70-8aca-3a7b71e04314 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:40.598478 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-48cd1a05-8e1f-4b8c-b338-01bbf0cc47a3 req-998a3328-f502-4c70-8aca-3a7b71e04314 service nova] Creating event network-vif-unplugged:05da60d7-1d7e-4607-a912-92561fc99617 for instance e123bb72-45c5-4371-bf2e-f0747497f16b on n-h1-858272-3 Oct 05 02:35:40.613732 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-48cd1a05-8e1f-4b8c-b338-01bbf0cc47a3 req-998a3328-f502-4c70-8aca-3a7b71e04314 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.150085 Oct 05 02:35:40.615073 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1018/2005] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:35:41.206426 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-da090075-4cdb-4f1c-8007-624e82138c44 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:41.208731 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-da090075-4cdb-4f1c-8007-624e82138c44 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 7ce24132-2878-49fd-affe-8e57d06ed5ce] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:41.235741 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-da090075-4cdb-4f1c-8007-624e82138c44 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:41.236773 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-da090075-4cdb-4f1c-8007-624e82138c44 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:41.237464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-da090075-4cdb-4f1c-8007-624e82138c44 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:41.243497 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-da090075-4cdb-4f1c-8007-624e82138c44 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:41.253561 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-da090075-4cdb-4f1c-8007-624e82138c44 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:41.255212 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-da090075-4cdb-4f1c-8007-624e82138c44 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:41.265276 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ebe41a0b-d19f-4331-99b0-2c033ed4767c tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001/action" status: 202 len: 0 microversion: 2.1 time: 3.917888 Oct 05 02:35:41.266557 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 988/2006] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:35:37 2022] POST /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001/action => generated 0 bytes in 3945 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:35:41.277575 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f4ab8b30-70a2-4fb5-b382-59edc2bac22c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:41.278492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f4ab8b30-70a2-4fb5-b382-59edc2bac22c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:41.322505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f4ab8b30-70a2-4fb5-b382-59edc2bac22c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:41.328587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f4ab8b30-70a2-4fb5-b382-59edc2bac22c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:41.331672 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f4ab8b30-70a2-4fb5-b382-59edc2bac22c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:41.334449 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f4ab8b30-70a2-4fb5-b382-59edc2bac22c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:41.345349 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f4ab8b30-70a2-4fb5-b382-59edc2bac22c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:41.351865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f4ab8b30-70a2-4fb5-b382-59edc2bac22c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:41.502919 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-da090075-4cdb-4f1c-8007-624e82138c44 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:41.514685 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-da090075-4cdb-4f1c-8007-624e82138c44 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce" status: 200 len: 1285 microversion: 2.1 time: 0.314075 Oct 05 02:35:41.515340 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1019/2007] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:41 2022] GET /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce => generated 1285 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:41.545358 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b9583ecd-b686-4070-9e9f-2efc1fdd44a4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce80413a0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:41.714859 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b9583ecd-b686-4070-9e9f-2efc1fdd44a4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02" status: 200 len: 1454 microversion: 2.1 time: 0.198462 Oct 05 02:35:41.715812 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1020/2008] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:41 2022] GET /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02 => generated 1454 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:41.738297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-131f3bba-22e7-4c77-b6e7-cfa98ec5c725 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fccdf7483a0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:41.841529 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-131f3bba-22e7-4c77-b6e7-cfa98ec5c725 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471" status: 200 len: 1440 microversion: 2.1 time: 0.124434 Oct 05 02:35:41.848669 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1021/2009] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:41 2022] GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471 => generated 1440 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:42.030569 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f4ab8b30-70a2-4fb5-b382-59edc2bac22c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:42.046404 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f4ab8b30-70a2-4fb5-b382-59edc2bac22c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1393 microversion: 2.1 time: 0.775276 Oct 05 02:35:42.056931 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 989/2010] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:41 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1393 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:42.545607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2bb59eca-2971-4393-aa24-cd3b54889efb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:42.546331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2bb59eca-2971-4393-aa24-cd3b54889efb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 7ce24132-2878-49fd-affe-8e57d06ed5ce] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:42.575258 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bb59eca-2971-4393-aa24-cd3b54889efb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:42.578669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bb59eca-2971-4393-aa24-cd3b54889efb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:42.581904 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bb59eca-2971-4393-aa24-cd3b54889efb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:42.586366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bb59eca-2971-4393-aa24-cd3b54889efb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:42.587202 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bb59eca-2971-4393-aa24-cd3b54889efb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:42.591167 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bb59eca-2971-4393-aa24-cd3b54889efb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:42.732138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-08eb0aaf-e771-461c-bc64-35cffc4cfa4a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf6059d0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:42.890346 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-08eb0aaf-e771-461c-bc64-35cffc4cfa4a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02" status: 200 len: 1454 microversion: 2.1 time: 0.162589 Oct 05 02:35:42.895319 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2bb59eca-2971-4393-aa24-cd3b54889efb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:42.895809 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 990/2011] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:42 2022] GET /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02 => generated 1454 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:42.903203 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:35:42.915638 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2bb59eca-2971-4393-aa24-cd3b54889efb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce" status: 200 len: 1283 microversion: 2.1 time: 0.375550 Oct 05 02:35:42.925780 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1022/2012] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:42 2022] GET /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce => generated 1283 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:42.931968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fcd991bf-8cba-4064-8d14-ddc190c6ee56 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fccdf6f2280>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:43.042828 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fcd991bf-8cba-4064-8d14-ddc190c6ee56 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471" status: 200 len: 1440 microversion: 2.1 time: 0.145801 Oct 05 02:35:43.051226 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 991/2013] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:42 2022] GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471 => generated 1440 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:43.071888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d93495e1-e84d-4e6a-83a0-93736b0e5196 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:43.073737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d93495e1-e84d-4e6a-83a0-93736b0e5196 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:43.090391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d93495e1-e84d-4e6a-83a0-93736b0e5196 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:43.096181 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d93495e1-e84d-4e6a-83a0-93736b0e5196 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:43.096860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d93495e1-e84d-4e6a-83a0-93736b0e5196 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:43.098140 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d93495e1-e84d-4e6a-83a0-93736b0e5196 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:43.098804 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d93495e1-e84d-4e6a-83a0-93736b0e5196 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:43.099418 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d93495e1-e84d-4e6a-83a0-93736b0e5196 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:43.913084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7141d7ea-4be9-4b72-9c03-0c902f3fca53 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce80c2e50>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:44.002268 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7141d7ea-4be9-4b72-9c03-0c902f3fca53 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02" status: 200 len: 1454 microversion: 2.1 time: 0.098866 Oct 05 02:35:44.003113 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 992/2014] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:43 2022] GET /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02 => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:35:44.020329 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e14d33f4-b19e-4a5b-9c75-416ae9db5100 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:44.021426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e14d33f4-b19e-4a5b-9c75-416ae9db5100 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 7ce24132-2878-49fd-affe-8e57d06ed5ce] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:44.045180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d93495e1-e84d-4e6a-83a0-93736b0e5196 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:44.050755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e14d33f4-b19e-4a5b-9c75-416ae9db5100 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:44.051481 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e14d33f4-b19e-4a5b-9c75-416ae9db5100 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:44.053802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e14d33f4-b19e-4a5b-9c75-416ae9db5100 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:44.054796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e14d33f4-b19e-4a5b-9c75-416ae9db5100 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:44.057342 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d93495e1-e84d-4e6a-83a0-93736b0e5196 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1393 microversion: 2.1 time: 0.989120 Oct 05 02:35:44.057848 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e14d33f4-b19e-4a5b-9c75-416ae9db5100 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:44.059998 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1023/2015] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:43 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1393 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:44.060722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e14d33f4-b19e-4a5b-9c75-416ae9db5100 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:44.067652 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-efb09877-11a4-4326-8142-a63d18837729 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce8059790>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:44.241700 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-efb09877-11a4-4326-8142-a63d18837729 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471" status: 200 len: 1440 microversion: 2.1 time: 0.180521 Oct 05 02:35:44.245561 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1024/2016] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:44 2022] GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471 => generated 1440 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:44.426789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e14d33f4-b19e-4a5b-9c75-416ae9db5100 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:44.439193 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e14d33f4-b19e-4a5b-9c75-416ae9db5100 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce" status: 200 len: 1283 microversion: 2.1 time: 0.432757 Oct 05 02:35:44.441767 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 993/2017] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:44 2022] GET /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce => generated 1283 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:45.020851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b6a6ee12-cccb-4a01-9002-ccf32e7616b1 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce804b0d0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:45.090306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d54fd275-295d-454d-a2cb-9f567af590ff tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:45.091403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d54fd275-295d-454d-a2cb-9f567af590ff tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:45.112911 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b6a6ee12-cccb-4a01-9002-ccf32e7616b1 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02" status: 200 len: 1454 microversion: 2.1 time: 0.097709 Oct 05 02:35:45.113520 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1025/2018] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:45 2022] GET /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02 => generated 1454 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:45.116520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d54fd275-295d-454d-a2cb-9f567af590ff tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:45.118544 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d54fd275-295d-454d-a2cb-9f567af590ff tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:45.120867 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d54fd275-295d-454d-a2cb-9f567af590ff tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:45.124947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d54fd275-295d-454d-a2cb-9f567af590ff tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:45.125750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d54fd275-295d-454d-a2cb-9f567af590ff tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:45.126967 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d54fd275-295d-454d-a2cb-9f567af590ff tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:45.258416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a1a8aa93-02b3-4ab5-87e4-1b44662a6510 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce8059d30>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:45.347841 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a1a8aa93-02b3-4ab5-87e4-1b44662a6510 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471" status: 200 len: 1440 microversion: 2.1 time: 0.091085 Oct 05 02:35:45.348758 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1026/2019] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:45 2022] GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471 => generated 1440 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:45.465366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-91062e3a-b428-4cb5-be67-0e9e5d1398c4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:45.466227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-91062e3a-b428-4cb5-be67-0e9e5d1398c4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 7ce24132-2878-49fd-affe-8e57d06ed5ce] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:45.478231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91062e3a-b428-4cb5-be67-0e9e5d1398c4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:45.490314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91062e3a-b428-4cb5-be67-0e9e5d1398c4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:45.490938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91062e3a-b428-4cb5-be67-0e9e5d1398c4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:45.493177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91062e3a-b428-4cb5-be67-0e9e5d1398c4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:45.493816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91062e3a-b428-4cb5-be67-0e9e5d1398c4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:45.499823 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91062e3a-b428-4cb5-be67-0e9e5d1398c4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:46.089949 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d54fd275-295d-454d-a2cb-9f567af590ff tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:46.128837 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d54fd275-295d-454d-a2cb-9f567af590ff tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1393 microversion: 2.1 time: 1.045895 Oct 05 02:35:46.139772 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 994/2020] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:45 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1393 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:46.178504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2c4f69f9-0622-4ed2-bcb7-be030be06853 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf605670>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:46.252362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-91062e3a-b428-4cb5-be67-0e9e5d1398c4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:46.264552 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-91062e3a-b428-4cb5-be67-0e9e5d1398c4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce" status: 200 len: 1325 microversion: 2.1 time: 0.804091 Oct 05 02:35:46.267536 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1027/2021] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:45 2022] GET /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce => generated 1325 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:46.356565 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2c4f69f9-0622-4ed2-bcb7-be030be06853 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02" status: 200 len: 1454 microversion: 2.1 time: 0.213104 Oct 05 02:35:46.365524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-829c9f3e-6cbf-4c24-be4b-16bfc7159499 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fccdf75ddc0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:46.369245 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 995/2022] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:46 2022] GET /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02 => generated 1454 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:46.502495 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-829c9f3e-6cbf-4c24-be4b-16bfc7159499 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471" status: 200 len: 1440 microversion: 2.1 time: 0.140538 Oct 05 02:35:46.508282 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1028/2023] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:46 2022] GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471 => generated 1440 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:35:47.161332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:35:47.171888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-24175820-c6a1-4387-b020-d5f5f986a49d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:47.172871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-24175820-c6a1-4387-b020-d5f5f986a49d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:47.195865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-24175820-c6a1-4387-b020-d5f5f986a49d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:47.196728 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-24175820-c6a1-4387-b020-d5f5f986a49d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:47.201181 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-24175820-c6a1-4387-b020-d5f5f986a49d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:47.215520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-24175820-c6a1-4387-b020-d5f5f986a49d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:47.218438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-24175820-c6a1-4387-b020-d5f5f986a49d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:47.220914 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-24175820-c6a1-4387-b020-d5f5f986a49d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:47.306192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4c4cda91-4c9e-4a21-9d51-050bc4ead9fe tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:47.308063 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4c4cda91-4c9e-4a21-9d51-050bc4ead9fe tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 7ce24132-2878-49fd-affe-8e57d06ed5ce] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:47.335417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c4cda91-4c9e-4a21-9d51-050bc4ead9fe tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:47.336238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c4cda91-4c9e-4a21-9d51-050bc4ead9fe tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:47.343975 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c4cda91-4c9e-4a21-9d51-050bc4ead9fe tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:47.345032 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c4cda91-4c9e-4a21-9d51-050bc4ead9fe tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:47.347114 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c4cda91-4c9e-4a21-9d51-050bc4ead9fe tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:47.347716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c4cda91-4c9e-4a21-9d51-050bc4ead9fe tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:47.823377 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:35:48.072396 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-24175820-c6a1-4387-b020-d5f5f986a49d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:48.086582 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-24175820-c6a1-4387-b020-d5f5f986a49d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1393 microversion: 2.1 time: 0.926562 Oct 05 02:35:48.089909 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 996/2024] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:47 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1393 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:48.101520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-571bc19d-db4e-40e4-bf9c-b485c9ff324e tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf605790>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:48.680890 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4c4cda91-4c9e-4a21-9d51-050bc4ead9fe tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:48.705770 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4c4cda91-4c9e-4a21-9d51-050bc4ead9fe tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce" status: 200 len: 1325 microversion: 2.1 time: 1.403438 Oct 05 02:35:48.727855 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1029/2025] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:47 2022] GET /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce => generated 1325 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:48.740315 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7de8847f-3427-463b-90b4-d86b116c386b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce80ae550>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:48.858285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=8 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:35:57.177587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:35:57.313819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:35:58.079908 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:35:58.367690 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7de8847f-3427-463b-90b4-d86b116c386b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471" status: 200 len: 1449 microversion: 2.1 time: 9.638576 Oct 05 02:35:58.370067 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-571bc19d-db4e-40e4-bf9c-b485c9ff324e tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02" status: 200 len: 1454 microversion: 2.1 time: 10.277922 Oct 05 02:35:58.371181 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1030/2026] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:48 2022] GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471 => generated 1449 bytes in 9643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:58.378668 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 997/2027] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:48 2022] GET /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02 => generated 1454 bytes in 10288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:58.385999 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-91909b0d-118e-4c14-8c30-b7b2f7e01f13 req-3f542833-e781-48f2-b0a6-dbfd341a99a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ce24132-2878-49fd-affe-8e57d06ed5ce", "tag": "4a731a9d-f714-4491-a279-a8665ec4e966"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:35:58.389050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-55f61858-1504-405d-9041-d318b8b98bcf tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:58.391790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-55f61858-1504-405d-9041-d318b8b98bcf tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:58.414156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55f61858-1504-405d-9041-d318b8b98bcf tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:58.414917 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55f61858-1504-405d-9041-d318b8b98bcf tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:58.415606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55f61858-1504-405d-9041-d318b8b98bcf tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:58.418081 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-91909b0d-118e-4c14-8c30-b7b2f7e01f13 req-3f542833-e781-48f2-b0a6-dbfd341a99a7 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:58.418386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55f61858-1504-405d-9041-d318b8b98bcf tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:58.419496 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-91909b0d-118e-4c14-8c30-b7b2f7e01f13 req-3f542833-e781-48f2-b0a6-dbfd341a99a7 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:58.419842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55f61858-1504-405d-9041-d318b8b98bcf tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:58.420552 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55f61858-1504-405d-9041-d318b8b98bcf tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:58.421241 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-91909b0d-118e-4c14-8c30-b7b2f7e01f13 req-3f542833-e781-48f2-b0a6-dbfd341a99a7 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:58.445607 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-91909b0d-118e-4c14-8c30-b7b2f7e01f13 req-3f542833-e781-48f2-b0a6-dbfd341a99a7 service nova] Creating event network-changed:4a731a9d-f714-4491-a279-a8665ec4e966 for instance 7ce24132-2878-49fd-affe-8e57d06ed5ce on n-h2-858272-3 Oct 05 02:35:58.462330 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-91909b0d-118e-4c14-8c30-b7b2f7e01f13 req-3f542833-e781-48f2-b0a6-dbfd341a99a7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084825 Oct 05 02:35:58.464058 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1031/2028] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:35:58.481154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-77632bb1-95c0-4e68-aef5-6e94ac7f49fb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:58.483971 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-77632bb1-95c0-4e68-aef5-6e94ac7f49fb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 7ce24132-2878-49fd-affe-8e57d06ed5ce] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:35:58.499750 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-77632bb1-95c0-4e68-aef5-6e94ac7f49fb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:58.500600 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-77632bb1-95c0-4e68-aef5-6e94ac7f49fb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:58.501255 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-77632bb1-95c0-4e68-aef5-6e94ac7f49fb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:58.503339 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-77632bb1-95c0-4e68-aef5-6e94ac7f49fb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:58.504043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-77632bb1-95c0-4e68-aef5-6e94ac7f49fb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:58.504659 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-77632bb1-95c0-4e68-aef5-6e94ac7f49fb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:59.192934 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-55f61858-1504-405d-9041-d318b8b98bcf tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:59.206186 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-55f61858-1504-405d-9041-d318b8b98bcf tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1393 microversion: 2.1 time: 0.825963 Oct 05 02:35:59.226310 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 998/2029] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:58 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1393 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:59.231564 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-77632bb1-95c0-4e68-aef5-6e94ac7f49fb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:35:59.233364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dac7be56-5aed-49f0-be91-926565e9a279 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1445476501", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "0a9558fc-ee3c-4276-b9e9-435abc472d8e"}, {"uuid": "329fc952-a7f0-4770-96f7-fa5adcbff1ee"}, {"uuid": "0a9558fc-ee3c-4276-b9e9-435abc472d8e"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:35:59.246946 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-77632bb1-95c0-4e68-aef5-6e94ac7f49fb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce" status: 200 len: 1325 microversion: 2.1 time: 0.776558 Oct 05 02:35:59.252574 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1032/2030] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:35:58 2022] GET /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce => generated 1325 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:59.260707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-e8871f11-396e-4bdf-8e8c-c4d656494079 req-caf0b1cf-5c24-4a09-b379-90985af77886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b30cf01-6bc7-453f-b9f2-98400bcfc063", "name": "network-vif-plugged", "status": "completed", "tag": "8d0c6b53-f679-4ee4-afb3-4a4e905d5489"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:35:59.285435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e8871f11-396e-4bdf-8e8c-c4d656494079 req-caf0b1cf-5c24-4a09-b379-90985af77886 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:59.286348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e8871f11-396e-4bdf-8e8c-c4d656494079 req-caf0b1cf-5c24-4a09-b379-90985af77886 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:59.287079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e8871f11-396e-4bdf-8e8c-c4d656494079 req-caf0b1cf-5c24-4a09-b379-90985af77886 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:59.312640 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-e8871f11-396e-4bdf-8e8c-c4d656494079 req-caf0b1cf-5c24-4a09-b379-90985af77886 service nova] Creating event network-vif-plugged:8d0c6b53-f679-4ee4-afb3-4a4e905d5489 for instance 7b30cf01-6bc7-453f-b9f2-98400bcfc063 on n-h2-858272-3 Oct 05 02:35:59.320029 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-dac7be56-5aed-49f0-be91-926565e9a279 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] validate_networks() for [('0a9558fc-ee3c-4276-b9e9-435abc472d8e', None, None, None, None, None), ('329fc952-a7f0-4770-96f7-fa5adcbff1ee', None, None, None, None, None), ('0a9558fc-ee3c-4276-b9e9-435abc472d8e', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:35:59.324008 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-e8871f11-396e-4bdf-8e8c-c4d656494079 req-caf0b1cf-5c24-4a09-b379-90985af77886 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069759 Oct 05 02:35:59.326971 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1033/2031] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:35:59.645466 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-44193bd8-ecda-41b6-8157-af30817e06d1 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Action: 'update', calling method: .version_select at 0x7fcce8059ee0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:35:59.778972 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44193bd8-ecda-41b6-8157-af30817e06d1 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:59.779746 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44193bd8-ecda-41b6-8157-af30817e06d1 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:59.783098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44193bd8-ecda-41b6-8157-af30817e06d1 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:59.785938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44193bd8-ecda-41b6-8157-af30817e06d1 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:35:59.786632 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44193bd8-ecda-41b6-8157-af30817e06d1 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:35:59.789365 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44193bd8-ecda-41b6-8157-af30817e06d1 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:35:59.890132 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-44193bd8-ecda-41b6-8157-af30817e06d1 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/ac0d0bc5b06941d3a6ee0870eb7c72a6" status: 200 len: 240 microversion: 2.36 time: 0.558007 Oct 05 02:35:59.891375 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1034/2032] 10.222.0.16 () {62 vars in 1303 bytes} [Wed Oct 5 02:35:59 2022] PUT /compute/v2.1/os-quota-sets/ac0d0bc5b06941d3a6ee0870eb7c72a6 => generated 240 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:35:59.896499 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c532ae8f-3c3d-4b80-ae19-1b321ae00fd2 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce804bd30>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:35:59.957593 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c532ae8f-3c3d-4b80-ae19-1b321ae00fd2 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471" status: 200 len: 1449 microversion: 2.1 time: 0.065011 Oct 05 02:35:59.958623 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1035/2033] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:59 2022] GET /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471 => generated 1449 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:35:59.964333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ed9f8869-31c6-4518-a655-5294f59bfb08 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce804b700>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:00.013422 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ed9f8869-31c6-4518-a655-5294f59bfb08 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02" status: 200 len: 1454 microversion: 2.1 time: 0.053478 Oct 05 02:36:00.014346 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1036/2034] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:59 2022] GET /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02 => generated 1454 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:00.208857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ff43ae51-13c9-417e-a8e0-2e124077279e tempest-VolumesAdminNegativeTest-1288086852 tempest-VolumesAdminNegativeTest-1288086852-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "d119efec-2904-411c-a9c5-19bb1c42820f"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:00.211797 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ff43ae51-13c9-417e-a8e0-2e124077279e tempest-VolumesAdminNegativeTest-1288086852 tempest-VolumesAdminNegativeTest-1288086852-project-admin] [instance: 99fb0801-33dd-4993-a8d9-18a43e372684] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:00.227248 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff43ae51-13c9-417e-a8e0-2e124077279e tempest-VolumesAdminNegativeTest-1288086852 tempest-VolumesAdminNegativeTest-1288086852-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:00.230264 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff43ae51-13c9-417e-a8e0-2e124077279e tempest-VolumesAdminNegativeTest-1288086852 tempest-VolumesAdminNegativeTest-1288086852-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:00.231614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff43ae51-13c9-417e-a8e0-2e124077279e tempest-VolumesAdminNegativeTest-1288086852 tempest-VolumesAdminNegativeTest-1288086852-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:00.233911 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff43ae51-13c9-417e-a8e0-2e124077279e tempest-VolumesAdminNegativeTest-1288086852 tempest-VolumesAdminNegativeTest-1288086852-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:00.236025 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff43ae51-13c9-417e-a8e0-2e124077279e tempest-VolumesAdminNegativeTest-1288086852 tempest-VolumesAdminNegativeTest-1288086852-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:00.241267 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff43ae51-13c9-417e-a8e0-2e124077279e tempest-VolumesAdminNegativeTest-1288086852 tempest-VolumesAdminNegativeTest-1288086852-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:00.373164 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-ff43ae51-13c9-417e-a8e0-2e124077279e tempest-VolumesAdminNegativeTest-1288086852 tempest-VolumesAdminNegativeTest-1288086852-project-admin] HTTP exception thrown: Volume d119efec-2904-411c-a9c5-19bb1c42820f could not be found. Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ff43ae51-13c9-417e-a8e0-2e124077279e tempest-VolumesAdminNegativeTest-1288086852 tempest-VolumesAdminNegativeTest-1288086852-project-admin] Request method failure captured: Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: request: PUT /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684/os-volume_attachments/d651f5ab-295f-4224-95de-8cfcc2bd932c HTTP/1.1 Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 74 Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOz9m6xT47hnWcr3Hi63UJpST6Io2TNGegGb0JIhky1v6KSnJEnNzfkL1CuTHop9gYLRMZyDpflAm7azHB1b5KUNocbeYob2wVm7V6xlXfFOxIQ21lZkRWIcuU6s63HbpXI35HGQJ3_eo8PJnlRARg-uUVb0zC6n_IBbgCkToGXpn_4 Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 5271c4a34ba547dfa6cb40a569394ef7 Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-VolumesAdminNegativeTest-1288086852 Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: X-Role: admin,member,reader Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: admin,member,reader Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5271c4a34ba547dfa6cb40a569394ef7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5271c4a34ba547dfa6cb40a569394ef7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5271c4a34ba547dfa6cb40a569394ef7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5271c4a34ba547dfa6cb40a569394ef7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-VolumesAdminNegativeTest-1288086852 Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 5271c4a34ba547dfa6cb40a569394ef7 Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1288086852 Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-VolumesAdminNegativeTest-1288086852-project-admin Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 0f6f5c78d11f4ecf9ff99a95df8e1a00 Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-VolumesAdminNegativeTest-1288086852-project-admin Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: {"volumeAttachment": {"volumeId": "d119efec-2904-411c-a9c5-19bb1c42820f"}} Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: exception: Volume d119efec-2904-411c-a9c5-19bb1c42820f could not be found. Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'server_id': '99fb0801-33dd-4993-a8d9-18a43e372684', 'id': 'd651f5ab-295f-4224-95de-8cfcc2bd932c', 'body': {'volumeAttachment': {'volumeId': 'd119efec-2904-411c-a9c5-19bb1c42820f'}}} Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d119efec-2904-411c-a9c5-19bb1c42820f could not be found. (HTTP 404) (Request-ID: req-071b24d3-9b2f-4a16-9de1-14c641c4ef6e) Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 02:36:00.415728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d119efec-2904-411c-a9c5-19bb1c42820f could not be found. Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume d119efec-2904-411c-a9c5-19bb1c42820f could not be found. Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d119efec-2904-411c-a9c5-19bb1c42820f could not be found. Oct 05 02:36:00.420111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:00.424779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ff43ae51-13c9-417e-a8e0-2e124077279e tempest-VolumesAdminNegativeTest-1288086852 tempest-VolumesAdminNegativeTest-1288086852-project-admin] Returning 400 to user: Volume d119efec-2904-411c-a9c5-19bb1c42820f could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:36:00.426029 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ff43ae51-13c9-417e-a8e0-2e124077279e tempest-VolumesAdminNegativeTest-1288086852 tempest-VolumesAdminNegativeTest-1288086852-project-admin] 10.222.0.16 "PUT /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684/os-volume_attachments/d651f5ab-295f-4224-95de-8cfcc2bd932c" status: 400 len: 107 microversion: 2.1 time: 0.410557 Oct 05 02:36:00.426799 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1037/2035] 10.222.0.16 () {60 vars in 1433 bytes} [Wed Oct 5 02:36:00 2022] PUT /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684/os-volume_attachments/d651f5ab-295f-4224-95de-8cfcc2bd932c => generated 107 bytes in 412 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:36:00.443976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1999e8a8-e110-4eb8-9d28-33992071f7a3 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Calling method '.version_select at 0x7fccdf758e50>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:00.571350 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1999e8a8-e110-4eb8-9d28-33992071f7a3 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:00.571871 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1999e8a8-e110-4eb8-9d28-33992071f7a3 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:00.572330 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1999e8a8-e110-4eb8-9d28-33992071f7a3 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:00.580003 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1999e8a8-e110-4eb8-9d28-33992071f7a3 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:00.580501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1999e8a8-e110-4eb8-9d28-33992071f7a3 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:00.580966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1999e8a8-e110-4eb8-9d28-33992071f7a3 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:00.611056 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-dac7be56-5aed-49f0-be91-926565e9a279 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:36:00.611512 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-dac7be56-5aed-49f0-be91-926565e9a279 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:36:00.611939 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-dac7be56-5aed-49f0-be91-926565e9a279 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:36:00.612571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-dac7be56-5aed-49f0-be91-926565e9a279 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:36:00.613237 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-dac7be56-5aed-49f0-be91-926565e9a279 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:36:00.624717 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dac7be56-5aed-49f0-be91-926565e9a279 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:00.625462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dac7be56-5aed-49f0-be91-926565e9a279 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:00.626437 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dac7be56-5aed-49f0-be91-926565e9a279 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:00.627348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dac7be56-5aed-49f0-be91-926565e9a279 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:00.627972 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dac7be56-5aed-49f0-be91-926565e9a279 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:00.628556 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dac7be56-5aed-49f0-be91-926565e9a279 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:00.630448 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1999e8a8-e110-4eb8-9d28-33992071f7a3 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/ac0d0bc5b06941d3a6ee0870eb7c72a6/detail" status: 200 len: 672 microversion: 2.36 time: 0.188988 Oct 05 02:36:00.631272 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1038/2036] 10.222.0.16 () {60 vars in 1304 bytes} [Wed Oct 5 02:36:00 2022] GET /compute/v2.1/os-quota-sets/ac0d0bc5b06941d3a6ee0870eb7c72a6/detail => generated 672 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:36:00.640437 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ad4d0383-7b2b-488f-bddf-a9a74d058e11 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fccdf72ee50>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:00.668479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-dac7be56-5aed-49f0-be91-926565e9a279 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Getting quotas for project fc3fd0eb45ed4080af876031348f367a. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:36:00.675265 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-dac7be56-5aed-49f0-be91-926565e9a279 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Getting quotas for user 9e5ffbccdbec4a4bb21a3e48c1f7beaf and project fc3fd0eb45ed4080af876031348f367a. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:36:00.692219 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-dac7be56-5aed-49f0-be91-926565e9a279 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:36:00.695047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-dac7be56-5aed-49f0-be91-926565e9a279 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:36:00.783097 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-dac7be56-5aed-49f0-be91-926565e9a279 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.555319 Oct 05 02:36:00.786899 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 999/2037] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:35:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:36:00.860089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b3e19067-d6c7-4c13-9196-e0b40db95a2e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:00.862846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b3e19067-d6c7-4c13-9196-e0b40db95a2e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:00.884041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3e19067-d6c7-4c13-9196-e0b40db95a2e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:00.884545 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3e19067-d6c7-4c13-9196-e0b40db95a2e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:00.886292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3e19067-d6c7-4c13-9196-e0b40db95a2e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:00.887130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3e19067-d6c7-4c13-9196-e0b40db95a2e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:00.887591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3e19067-d6c7-4c13-9196-e0b40db95a2e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:00.888013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3e19067-d6c7-4c13-9196-e0b40db95a2e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:01.251608 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b3e19067-d6c7-4c13-9196-e0b40db95a2e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:01.261705 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b3e19067-d6c7-4c13-9196-e0b40db95a2e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1393 microversion: 2.1 time: 0.472418 Oct 05 02:36:01.262613 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1000/2038] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:00 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1393 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:01.290226 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ca26502e-889d-4767-a30b-2996b12a2eaa tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:01.291015 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ca26502e-889d-4767-a30b-2996b12a2eaa tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 7ce24132-2878-49fd-affe-8e57d06ed5ce] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:01.299823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca26502e-889d-4767-a30b-2996b12a2eaa tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:01.300646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca26502e-889d-4767-a30b-2996b12a2eaa tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:01.301320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca26502e-889d-4767-a30b-2996b12a2eaa tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:01.302288 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca26502e-889d-4767-a30b-2996b12a2eaa tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:01.302837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca26502e-889d-4767-a30b-2996b12a2eaa tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:01.303337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca26502e-889d-4767-a30b-2996b12a2eaa tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:01.547956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ca26502e-889d-4767-a30b-2996b12a2eaa tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:01.564335 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ca26502e-889d-4767-a30b-2996b12a2eaa tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce" status: 200 len: 1325 microversion: 2.1 time: 0.300401 Oct 05 02:36:01.577511 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1001/2039] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:01 2022] GET /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce => generated 1325 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:01.585764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-408b0b72-fc75-4ef8-84d7-840de9a87cfa tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:01.586448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-408b0b72-fc75-4ef8-84d7-840de9a87cfa tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 99fb0801-33dd-4993-a8d9-18a43e372684] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:01.593310 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-408b0b72-fc75-4ef8-84d7-840de9a87cfa tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:01.594065 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-408b0b72-fc75-4ef8-84d7-840de9a87cfa tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:01.594494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-408b0b72-fc75-4ef8-84d7-840de9a87cfa tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:01.595326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-408b0b72-fc75-4ef8-84d7-840de9a87cfa tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:01.595883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-408b0b72-fc75-4ef8-84d7-840de9a87cfa tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:01.596431 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-408b0b72-fc75-4ef8-84d7-840de9a87cfa tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:01.730618 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-408b0b72-fc75-4ef8-84d7-840de9a87cfa tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lazy-loading 'services' on Instance uuid 99fb0801-33dd-4993-a8d9-18a43e372684 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:36:01.869762 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-408b0b72-fc75-4ef8-84d7-840de9a87cfa tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "DELETE /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684/os-volume_attachments/d651f5ab-295f-4224-95de-8cfcc2bd932c" status: 202 len: 0 microversion: 2.1 time: 0.286693 Oct 05 02:36:01.871302 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1002/2040] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 02:36:01 2022] DELETE /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684/os-volume_attachments/d651f5ab-295f-4224-95de-8cfcc2bd932c => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:36:01.887017 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3863934b-6ac6-4511-b6da-f6509688ea0b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:01.888030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3863934b-6ac6-4511-b6da-f6509688ea0b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:01.904201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3863934b-6ac6-4511-b6da-f6509688ea0b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:01.905048 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3863934b-6ac6-4511-b6da-f6509688ea0b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:01.905597 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3863934b-6ac6-4511-b6da-f6509688ea0b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:01.906418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3863934b-6ac6-4511-b6da-f6509688ea0b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:01.907022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3863934b-6ac6-4511-b6da-f6509688ea0b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:01.907443 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3863934b-6ac6-4511-b6da-f6509688ea0b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:02.003398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3863934b-6ac6-4511-b6da-f6509688ea0b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:02.016053 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3863934b-6ac6-4511-b6da-f6509688ea0b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 200 len: 1217 microversion: 2.1 time: 0.142659 Oct 05 02:36:02.030378 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1003/2041] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:01 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 1217 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:02.041387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b11a5fc2-f55a-4f2c-a3e5-b51a2d87f7e7 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Action: 'update', calling method: .version_select at 0x7fcce41df040>, body: {"quota_set": {"ram": "2048"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:02.156725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b11a5fc2-f55a-4f2c-a3e5-b51a2d87f7e7 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:02.157817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b11a5fc2-f55a-4f2c-a3e5-b51a2d87f7e7 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:02.158633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b11a5fc2-f55a-4f2c-a3e5-b51a2d87f7e7 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:02.159816 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b11a5fc2-f55a-4f2c-a3e5-b51a2d87f7e7 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:02.160455 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b11a5fc2-f55a-4f2c-a3e5-b51a2d87f7e7 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:02.161134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b11a5fc2-f55a-4f2c-a3e5-b51a2d87f7e7 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:02.232354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b11a5fc2-f55a-4f2c-a3e5-b51a2d87f7e7 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:02.233160 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b11a5fc2-f55a-4f2c-a3e5-b51a2d87f7e7 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:02.233758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b11a5fc2-f55a-4f2c-a3e5-b51a2d87f7e7 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:02.236890 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b11a5fc2-f55a-4f2c-a3e5-b51a2d87f7e7 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:02.237781 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b11a5fc2-f55a-4f2c-a3e5-b51a2d87f7e7 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:02.238230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b11a5fc2-f55a-4f2c-a3e5-b51a2d87f7e7 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:02.313331 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b11a5fc2-f55a-4f2c-a3e5-b51a2d87f7e7 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/ac0d0bc5b06941d3a6ee0870eb7c72a6?user_id=5bb36ffd6097461287d5fab1b405b080" status: 200 len: 240 microversion: 2.36 time: 0.280383 Oct 05 02:36:02.314850 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1004/2042] 10.222.0.16 () {62 vars in 1384 bytes} [Wed Oct 5 02:36:02 2022] PUT /compute/v2.1/os-quota-sets/ac0d0bc5b06941d3a6ee0870eb7c72a6?user_id=5bb36ffd6097461287d5fab1b405b080 => generated 240 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:36:02.329444 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5b53d99d-75d3-43ba-a6ae-5ccd8d3dff3a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce41b2430>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:02.419531 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ad4d0383-7b2b-488f-bddf-a9a74d058e11 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "DELETE /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471" status: 204 len: 0 microversion: 2.1 time: 1.785218 Oct 05 02:36:02.420176 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1039/2043] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:00 2022] DELETE /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471 => generated 0 bytes in 1789 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:36:02.427192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-cb56f473-ed35-4b2b-8d4b-86dcf8ba0108 req-f6156572-d397-4023-a7d3-61b06a2b9a9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ce24132-2878-49fd-affe-8e57d06ed5ce", "name": "network-vif-plugged", "status": "completed", "tag": "4a731a9d-f714-4491-a279-a8665ec4e966"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:02.453702 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-cb56f473-ed35-4b2b-8d4b-86dcf8ba0108 req-f6156572-d397-4023-a7d3-61b06a2b9a9f service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:02.456127 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-cb56f473-ed35-4b2b-8d4b-86dcf8ba0108 req-f6156572-d397-4023-a7d3-61b06a2b9a9f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:02.457607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-cb56f473-ed35-4b2b-8d4b-86dcf8ba0108 req-f6156572-d397-4023-a7d3-61b06a2b9a9f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:02.474659 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-cb56f473-ed35-4b2b-8d4b-86dcf8ba0108 req-f6156572-d397-4023-a7d3-61b06a2b9a9f service nova] Creating event network-vif-plugged:4a731a9d-f714-4491-a279-a8665ec4e966 for instance 7ce24132-2878-49fd-affe-8e57d06ed5ce on n-h2-858272-3 Oct 05 02:36:02.481397 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-cb56f473-ed35-4b2b-8d4b-86dcf8ba0108 req-f6156572-d397-4023-a7d3-61b06a2b9a9f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058840 Oct 05 02:36:02.482805 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1040/2044] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:02.485985 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5b53d99d-75d3-43ba-a6ae-5ccd8d3dff3a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02" status: 200 len: 1454 microversion: 2.1 time: 0.169188 Oct 05 02:36:02.486687 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1005/2045] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:02 2022] GET /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02 => generated 1454 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:02.489765 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c41e7be5-4121-41f8-a1ba-9de877ae6933 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:02.492053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c41e7be5-4121-41f8-a1ba-9de877ae6933 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 99fb0801-33dd-4993-a8d9-18a43e372684] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:02.492399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c28d96a7-dfa9-479d-8aa6-d7b66990c102 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:02.493323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c28d96a7-dfa9-479d-8aa6-d7b66990c102 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:02.500472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c41e7be5-4121-41f8-a1ba-9de877ae6933 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:02.501210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c41e7be5-4121-41f8-a1ba-9de877ae6933 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:02.501666 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c41e7be5-4121-41f8-a1ba-9de877ae6933 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:02.503294 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c41e7be5-4121-41f8-a1ba-9de877ae6933 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:02.504120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c41e7be5-4121-41f8-a1ba-9de877ae6933 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:02.504372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c28d96a7-dfa9-479d-8aa6-d7b66990c102 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:02.505138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c28d96a7-dfa9-479d-8aa6-d7b66990c102 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:02.506263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c28d96a7-dfa9-479d-8aa6-d7b66990c102 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:02.506412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c41e7be5-4121-41f8-a1ba-9de877ae6933 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:02.507289 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c28d96a7-dfa9-479d-8aa6-d7b66990c102 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:02.508151 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c28d96a7-dfa9-479d-8aa6-d7b66990c102 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:02.508796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c28d96a7-dfa9-479d-8aa6-d7b66990c102 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:02.573436 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c41e7be5-4121-41f8-a1ba-9de877ae6933 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088925 Oct 05 02:36:02.574370 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1041/2046] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 02:36:02 2022] GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:02.581227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fc8151f9-a1be-4a87-9896-3b3a56ff221a tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Calling method '.version_select at 0x7fcce825cca0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:02.678659 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c28d96a7-dfa9-479d-8aa6-d7b66990c102 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:02.688417 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c28d96a7-dfa9-479d-8aa6-d7b66990c102 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1393 microversion: 2.1 time: 0.200485 Oct 05 02:36:02.689519 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1006/2047] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:02 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1393 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:02.694810 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-829cd62b-3558-40e9-99a9-79d7df95435f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:02.695618 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-829cd62b-3558-40e9-99a9-79d7df95435f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: f2e6dcdb-9664-46eb-b40d-58d894b62b47] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:02.702721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-829cd62b-3558-40e9-99a9-79d7df95435f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:02.703491 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-829cd62b-3558-40e9-99a9-79d7df95435f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:02.704285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-829cd62b-3558-40e9-99a9-79d7df95435f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:02.705368 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-829cd62b-3558-40e9-99a9-79d7df95435f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:02.706048 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-829cd62b-3558-40e9-99a9-79d7df95435f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:02.706699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-829cd62b-3558-40e9-99a9-79d7df95435f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:02.721261 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fc8151f9-a1be-4a87-9896-3b3a56ff221a tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/ac0d0bc5b06941d3a6ee0870eb7c72a6?user_id=5bb36ffd6097461287d5fab1b405b080" status: 200 len: 282 microversion: 2.36 time: 0.145635 Oct 05 02:36:02.722159 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1042/2048] 10.222.0.16 () {60 vars in 1364 bytes} [Wed Oct 5 02:36:02 2022] GET /compute/v2.1/os-quota-sets/ac0d0bc5b06941d3a6ee0870eb7c72a6?user_id=5bb36ffd6097461287d5fab1b405b080 => generated 282 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:36:02.739085 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ff9a4c9a-a8ac-49ba-866c-cfb0989e8272 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:02.742023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ff9a4c9a-a8ac-49ba-866c-cfb0989e8272 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 7ce24132-2878-49fd-affe-8e57d06ed5ce] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:02.753158 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff9a4c9a-a8ac-49ba-866c-cfb0989e8272 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:02.754106 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff9a4c9a-a8ac-49ba-866c-cfb0989e8272 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:02.754539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-829cd62b-3558-40e9-99a9-79d7df95435f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: f2e6dcdb-9664-46eb-b40d-58d894b62b47] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:36:02.755397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff9a4c9a-a8ac-49ba-866c-cfb0989e8272 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:02.756495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff9a4c9a-a8ac-49ba-866c-cfb0989e8272 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:02.757191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff9a4c9a-a8ac-49ba-866c-cfb0989e8272 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:02.758380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff9a4c9a-a8ac-49ba-866c-cfb0989e8272 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:02.921076 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-829cd62b-3558-40e9-99a9-79d7df95435f tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47" status: 204 len: 0 microversion: 2.1 time: 0.229765 Oct 05 02:36:02.922115 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1007/2049] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:36:02 2022] DELETE /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:36:02.986150 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ff9a4c9a-a8ac-49ba-866c-cfb0989e8272 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:02.997515 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ff9a4c9a-a8ac-49ba-866c-cfb0989e8272 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce" status: 200 len: 1325 microversion: 2.1 time: 0.264467 Oct 05 02:36:02.999173 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1043/2050] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:02 2022] GET /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce => generated 1325 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:03.045267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6bdb85a7-9a89-4143-9867-68d5d645943d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:03.046400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6bdb85a7-9a89-4143-9867-68d5d645943d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:03.060036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6bdb85a7-9a89-4143-9867-68d5d645943d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:03.060560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6bdb85a7-9a89-4143-9867-68d5d645943d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:03.067134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6bdb85a7-9a89-4143-9867-68d5d645943d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:03.067914 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6bdb85a7-9a89-4143-9867-68d5d645943d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:03.074206 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6bdb85a7-9a89-4143-9867-68d5d645943d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:03.074738 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6bdb85a7-9a89-4143-9867-68d5d645943d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:03.120035 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1eb19445-2a1b-4f02-aa48-b959d5d3466e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1150345856", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "48576e87-e85f-42b2-831e-e803ec37a843"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:03.232544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-1eb19445-2a1b-4f02-aa48-b959d5d3466e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] validate_networks() for [('48576e87-e85f-42b2-831e-e803ec37a843', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:36:03.274028 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6bdb85a7-9a89-4143-9867-68d5d645943d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:03.288081 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6bdb85a7-9a89-4143-9867-68d5d645943d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 200 len: 1265 microversion: 2.1 time: 0.247830 Oct 05 02:36:03.289014 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1008/2051] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:03 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:03.502369 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a7b41f10-55d8-45b3-abb6-0a5b461f258b tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf6fbb80>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:03.590734 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a7b41f10-55d8-45b3-abb6-0a5b461f258b tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02" status: 200 len: 1454 microversion: 2.1 time: 0.092082 Oct 05 02:36:03.591630 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1009/2052] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:03 2022] GET /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02 => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:36:03.606324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d04f0be5-3b79-449d-87f8-4cc4e9050293 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:03.608848 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d04f0be5-3b79-449d-87f8-4cc4e9050293 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 99fb0801-33dd-4993-a8d9-18a43e372684] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:03.621547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d04f0be5-3b79-449d-87f8-4cc4e9050293 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:03.629637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d04f0be5-3b79-449d-87f8-4cc4e9050293 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:03.630401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d04f0be5-3b79-449d-87f8-4cc4e9050293 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:03.631398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d04f0be5-3b79-449d-87f8-4cc4e9050293 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:03.632115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d04f0be5-3b79-449d-87f8-4cc4e9050293 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:03.632768 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d04f0be5-3b79-449d-87f8-4cc4e9050293 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:03.711219 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d04f0be5-3b79-449d-87f8-4cc4e9050293 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118023 Oct 05 02:36:03.716988 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1010/2053] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 02:36:03 2022] GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:03.722182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7fb7f8db-1a32-46ef-ace0-1d756333ae34 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:03.723063 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7fb7f8db-1a32-46ef-ace0-1d756333ae34 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:03.729971 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fb7f8db-1a32-46ef-ace0-1d756333ae34 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:03.731061 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fb7f8db-1a32-46ef-ace0-1d756333ae34 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:03.731711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fb7f8db-1a32-46ef-ace0-1d756333ae34 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:03.732651 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fb7f8db-1a32-46ef-ace0-1d756333ae34 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:03.733414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fb7f8db-1a32-46ef-ace0-1d756333ae34 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:03.734047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fb7f8db-1a32-46ef-ace0-1d756333ae34 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:04.061532 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-1eb19445-2a1b-4f02-aa48-b959d5d3466e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:36:04.062032 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-1eb19445-2a1b-4f02-aa48-b959d5d3466e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:36:04.062598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-1eb19445-2a1b-4f02-aa48-b959d5d3466e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:36:04.063618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-1eb19445-2a1b-4f02-aa48-b959d5d3466e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:36:04.064039 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-1eb19445-2a1b-4f02-aa48-b959d5d3466e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:36:04.084652 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1eb19445-2a1b-4f02-aa48-b959d5d3466e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:04.087842 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1eb19445-2a1b-4f02-aa48-b959d5d3466e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:04.090166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1eb19445-2a1b-4f02-aa48-b959d5d3466e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:04.093175 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1eb19445-2a1b-4f02-aa48-b959d5d3466e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:04.093766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1eb19445-2a1b-4f02-aa48-b959d5d3466e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:04.094212 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1eb19445-2a1b-4f02-aa48-b959d5d3466e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:04.115234 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7fb7f8db-1a32-46ef-ace0-1d756333ae34 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:04.125216 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7fb7f8db-1a32-46ef-ace0-1d756333ae34 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1393 microversion: 2.1 time: 0.406755 Oct 05 02:36:04.133181 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-1eb19445-2a1b-4f02-aa48-b959d5d3466e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Getting quotas for project 91e0286f34a549ed90c758652f0d20ae. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:36:04.141751 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-1eb19445-2a1b-4f02-aa48-b959d5d3466e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Getting quotas for user 9f23399a5f1c4af6855a098198ca4ced and project 91e0286f34a549ed90c758652f0d20ae. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:36:04.145685 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1011/2054] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:03 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1393 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:04.151155 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5ee84b47-a4ac-4731-bc4e-f1fd7919bd0f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:04.151834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5ee84b47-a4ac-4731-bc4e-f1fd7919bd0f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 7ce24132-2878-49fd-affe-8e57d06ed5ce] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:04.160684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1eb19445-2a1b-4f02-aa48-b959d5d3466e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:36:04.164133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1eb19445-2a1b-4f02-aa48-b959d5d3466e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: e47438ff-463e-4a43-9767-8c78e8bb6e98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:36:04.177662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ee84b47-a4ac-4731-bc4e-f1fd7919bd0f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:04.178192 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ee84b47-a4ac-4731-bc4e-f1fd7919bd0f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:04.178610 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ee84b47-a4ac-4731-bc4e-f1fd7919bd0f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:04.179337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ee84b47-a4ac-4731-bc4e-f1fd7919bd0f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:04.179798 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ee84b47-a4ac-4731-bc4e-f1fd7919bd0f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:04.180225 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ee84b47-a4ac-4731-bc4e-f1fd7919bd0f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:04.238932 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1eb19445-2a1b-4f02-aa48-b959d5d3466e tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.123464 Oct 05 02:36:04.246455 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1044/2055] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:36:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:36:04.253116 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7c7900af-fe77-4ac5-8d74-fa186a4d850b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:04.256750 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7c7900af-fe77-4ac5-8d74-fa186a4d850b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: e47438ff-463e-4a43-9767-8c78e8bb6e98] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:04.390314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7c7900af-fe77-4ac5-8d74-fa186a4d850b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:04.400835 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7c7900af-fe77-4ac5-8d74-fa186a4d850b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98" status: 200 len: 1208 microversion: 2.1 time: 0.150942 Oct 05 02:36:04.403219 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1045/2056] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:04 2022] GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98 => generated 1208 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:36:04.413727 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-efe4f548-2059-466e-81fa-a49dc1e8fd3a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:04.416785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-efe4f548-2059-466e-81fa-a49dc1e8fd3a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:04.434872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-efe4f548-2059-466e-81fa-a49dc1e8fd3a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:04.439526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-efe4f548-2059-466e-81fa-a49dc1e8fd3a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:04.440425 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-efe4f548-2059-466e-81fa-a49dc1e8fd3a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:04.441427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-efe4f548-2059-466e-81fa-a49dc1e8fd3a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:04.442914 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-efe4f548-2059-466e-81fa-a49dc1e8fd3a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:04.445830 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-efe4f548-2059-466e-81fa-a49dc1e8fd3a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:04.577468 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-efe4f548-2059-466e-81fa-a49dc1e8fd3a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:04.588228 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-efe4f548-2059-466e-81fa-a49dc1e8fd3a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 200 len: 1265 microversion: 2.1 time: 0.183163 Oct 05 02:36:04.601626 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1046/2057] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:04 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:04.609726 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-ba0cba30-9bcd-4017-9129-809cc095c227 req-a2eb489b-a8da-4cdd-bde3-2fb3b1ff3c0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2e6dcdb-9664-46eb-b40d-58d894b62b47", "name": "network-vif-unplugged", "status": "completed", "tag": "142146ee-f359-42c9-8f33-3302d82a8401"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:04.637565 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ba0cba30-9bcd-4017-9129-809cc095c227 req-a2eb489b-a8da-4cdd-bde3-2fb3b1ff3c0b service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:04.638944 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ba0cba30-9bcd-4017-9129-809cc095c227 req-a2eb489b-a8da-4cdd-bde3-2fb3b1ff3c0b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:04.640710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5ee84b47-a4ac-4731-bc4e-f1fd7919bd0f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:04.648472 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5ee84b47-a4ac-4731-bc4e-f1fd7919bd0f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce" status: 200 len: 1325 microversion: 2.1 time: 0.501641 Oct 05 02:36:04.650329 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1012/2058] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:04 2022] GET /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce => generated 1325 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:04.656148 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0e43db36-2a87-483a-b989-09a43202d222 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce80c43a0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:04.669534 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ba0cba30-9bcd-4017-9129-809cc095c227 req-a2eb489b-a8da-4cdd-bde3-2fb3b1ff3c0b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:04.715545 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-ba0cba30-9bcd-4017-9129-809cc095c227 req-a2eb489b-a8da-4cdd-bde3-2fb3b1ff3c0b service nova] Creating event network-vif-unplugged:142146ee-f359-42c9-8f33-3302d82a8401 for instance f2e6dcdb-9664-46eb-b40d-58d894b62b47 on n-h1-858272-3 Oct 05 02:36:04.742942 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-ba0cba30-9bcd-4017-9129-809cc095c227 req-a2eb489b-a8da-4cdd-bde3-2fb3b1ff3c0b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.150702 Oct 05 02:36:04.744093 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1047/2059] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:04.752784 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0e43db36-2a87-483a-b989-09a43202d222 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02" status: 200 len: 1454 microversion: 2.1 time: 0.100840 Oct 05 02:36:04.752980 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-962659df-4871-4ef2-8748-8d5f4f66124a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:04.755134 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1013/2060] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:04 2022] GET /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02 => generated 1454 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:04.755704 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-962659df-4871-4ef2-8748-8d5f4f66124a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 99fb0801-33dd-4993-a8d9-18a43e372684] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:04.769355 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-962659df-4871-4ef2-8748-8d5f4f66124a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:04.769971 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-962659df-4871-4ef2-8748-8d5f4f66124a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:04.770979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-962659df-4871-4ef2-8748-8d5f4f66124a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:04.771803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-962659df-4871-4ef2-8748-8d5f4f66124a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:04.773129 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-962659df-4871-4ef2-8748-8d5f4f66124a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:04.773796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-962659df-4871-4ef2-8748-8d5f4f66124a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:04.825544 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-962659df-4871-4ef2-8748-8d5f4f66124a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079257 Oct 05 02:36:04.831930 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1048/2061] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 02:36:04 2022] GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:05.153845 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-073ca98f-3998-4ab8-981f-acfffb43b686 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:05.155624 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-073ca98f-3998-4ab8-981f-acfffb43b686 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:05.176233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-073ca98f-3998-4ab8-981f-acfffb43b686 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:05.177381 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-073ca98f-3998-4ab8-981f-acfffb43b686 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:05.178083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-073ca98f-3998-4ab8-981f-acfffb43b686 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:05.179570 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-073ca98f-3998-4ab8-981f-acfffb43b686 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:05.180635 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-073ca98f-3998-4ab8-981f-acfffb43b686 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:05.181483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-073ca98f-3998-4ab8-981f-acfffb43b686 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:05.431267 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dd9accec-89be-4b1c-bb45-bff5a5471b9c tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:05.433328 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dd9accec-89be-4b1c-bb45-bff5a5471b9c tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: e47438ff-463e-4a43-9767-8c78e8bb6e98] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:05.467526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd9accec-89be-4b1c-bb45-bff5a5471b9c tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:05.471168 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd9accec-89be-4b1c-bb45-bff5a5471b9c tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:05.471839 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd9accec-89be-4b1c-bb45-bff5a5471b9c tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:05.473851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd9accec-89be-4b1c-bb45-bff5a5471b9c tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:05.474854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd9accec-89be-4b1c-bb45-bff5a5471b9c tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:05.476785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd9accec-89be-4b1c-bb45-bff5a5471b9c tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:06.102593 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dd9accec-89be-4b1c-bb45-bff5a5471b9c tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:06.113419 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dd9accec-89be-4b1c-bb45-bff5a5471b9c tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98" status: 200 len: 1204 microversion: 2.1 time: 0.687365 Oct 05 02:36:06.114037 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1049/2062] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:05 2022] GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98 => generated 1204 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:36:06.130086 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f3b8dce7-e416-4761-9e84-2c4aa1caf769 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:06.130748 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f3b8dce7-e416-4761-9e84-2c4aa1caf769 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:06.144400 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f3b8dce7-e416-4761-9e84-2c4aa1caf769 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:06.144994 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f3b8dce7-e416-4761-9e84-2c4aa1caf769 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:06.145440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f3b8dce7-e416-4761-9e84-2c4aa1caf769 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:06.146166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f3b8dce7-e416-4761-9e84-2c4aa1caf769 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:06.148687 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f3b8dce7-e416-4761-9e84-2c4aa1caf769 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:06.149169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f3b8dce7-e416-4761-9e84-2c4aa1caf769 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:06.184625 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-073ca98f-3998-4ab8-981f-acfffb43b686 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:06.193361 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-073ca98f-3998-4ab8-981f-acfffb43b686 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1393 microversion: 2.1 time: 1.046036 Oct 05 02:36:06.193936 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1014/2063] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:05 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1393 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:06.212729 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-826bd057-8f17-4a9d-b4af-08698021518f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:06.224808 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-826bd057-8f17-4a9d-b4af-08698021518f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 7ce24132-2878-49fd-affe-8e57d06ed5ce] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:06.239605 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-826bd057-8f17-4a9d-b4af-08698021518f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:06.240377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-826bd057-8f17-4a9d-b4af-08698021518f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:06.240971 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-826bd057-8f17-4a9d-b4af-08698021518f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:06.241794 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-826bd057-8f17-4a9d-b4af-08698021518f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:06.243285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-826bd057-8f17-4a9d-b4af-08698021518f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:06.243949 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-826bd057-8f17-4a9d-b4af-08698021518f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:06.394042 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f3b8dce7-e416-4761-9e84-2c4aa1caf769 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:06.420387 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f3b8dce7-e416-4761-9e84-2c4aa1caf769 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 200 len: 1271 microversion: 2.1 time: 0.296468 Oct 05 02:36:06.424112 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1050/2064] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:06 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 1271 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:06.453696 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e3aa46ca-8ca6-490f-a058-1a23dc05db5b tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce804b550>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:06.597475 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e3aa46ca-8ca6-490f-a058-1a23dc05db5b tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02" status: 200 len: 1454 microversion: 2.1 time: 0.168292 Oct 05 02:36:06.598071 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1051/2065] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:06 2022] GET /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02 => generated 1454 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:06.624690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9a43d631-55a5-4e2b-99f2-8d4d30fcb93a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:06.631210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9a43d631-55a5-4e2b-99f2-8d4d30fcb93a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 99fb0801-33dd-4993-a8d9-18a43e372684] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:06.650702 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a43d631-55a5-4e2b-99f2-8d4d30fcb93a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:06.651501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a43d631-55a5-4e2b-99f2-8d4d30fcb93a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:06.652788 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a43d631-55a5-4e2b-99f2-8d4d30fcb93a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:06.653804 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a43d631-55a5-4e2b-99f2-8d4d30fcb93a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:06.655111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a43d631-55a5-4e2b-99f2-8d4d30fcb93a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:06.655851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a43d631-55a5-4e2b-99f2-8d4d30fcb93a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:06.701120 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9a43d631-55a5-4e2b-99f2-8d4d30fcb93a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089868 Oct 05 02:36:06.706537 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1052/2066] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 02:36:06 2022] GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:06.790476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-826bd057-8f17-4a9d-b4af-08698021518f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:06.811526 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-826bd057-8f17-4a9d-b4af-08698021518f tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce" status: 200 len: 1523 microversion: 2.1 time: 0.616484 Oct 05 02:36:06.812461 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1015/2067] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:06 2022] GET /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce => generated 1523 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:06.848840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5da1d765-3f47-424b-9f81-53b0e1599da6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:06.849434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5da1d765-3f47-424b-9f81-53b0e1599da6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 7ce24132-2878-49fd-affe-8e57d06ed5ce] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:06.859083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-4f889313-c0fe-4368-8ceb-576aec613dee req-4a950399-494d-404d-8721-a0195f99f077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2e6dcdb-9664-46eb-b40d-58d894b62b47", "name": "network-vif-deleted", "tag": "142146ee-f359-42c9-8f33-3302d82a8401"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:06.883853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5da1d765-3f47-424b-9f81-53b0e1599da6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:06.886640 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5da1d765-3f47-424b-9f81-53b0e1599da6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:06.891970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5da1d765-3f47-424b-9f81-53b0e1599da6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:06.896243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5da1d765-3f47-424b-9f81-53b0e1599da6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:06.897709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5da1d765-3f47-424b-9f81-53b0e1599da6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:06.900138 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5da1d765-3f47-424b-9f81-53b0e1599da6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:06.901157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4f889313-c0fe-4368-8ceb-576aec613dee req-4a950399-494d-404d-8721-a0195f99f077 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:06.905790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4f889313-c0fe-4368-8ceb-576aec613dee req-4a950399-494d-404d-8721-a0195f99f077 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:06.909028 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4f889313-c0fe-4368-8ceb-576aec613dee req-4a950399-494d-404d-8721-a0195f99f077 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:06.934374 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:06.973585 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-4f889313-c0fe-4368-8ceb-576aec613dee req-4a950399-494d-404d-8721-a0195f99f077 service nova] Creating event network-vif-deleted:142146ee-f359-42c9-8f33-3302d82a8401 for instance f2e6dcdb-9664-46eb-b40d-58d894b62b47 on n-h1-858272-3 Oct 05 02:36:06.995781 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-4f889313-c0fe-4368-8ceb-576aec613dee req-4a950399-494d-404d-8721-a0195f99f077 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141620 Oct 05 02:36:07.008097 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1016/2068] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:36:07.013752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5da1d765-3f47-424b-9f81-53b0e1599da6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 7ce24132-2878-49fd-affe-8e57d06ed5ce] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:36:07.116411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:07.144794 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-28c733ca-5c12-40c6-83ec-a2c4d546a155 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:07.145827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-28c733ca-5c12-40c6-83ec-a2c4d546a155 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: e47438ff-463e-4a43-9767-8c78e8bb6e98] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:07.165383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28c733ca-5c12-40c6-83ec-a2c4d546a155 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:07.171795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28c733ca-5c12-40c6-83ec-a2c4d546a155 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:07.174354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28c733ca-5c12-40c6-83ec-a2c4d546a155 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:07.181287 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28c733ca-5c12-40c6-83ec-a2c4d546a155 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:07.185381 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28c733ca-5c12-40c6-83ec-a2c4d546a155 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:07.191850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28c733ca-5c12-40c6-83ec-a2c4d546a155 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:07.194217 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5da1d765-3f47-424b-9f81-53b0e1599da6 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce" status: 204 len: 0 microversion: 2.1 time: 0.351118 Oct 05 02:36:07.195082 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1053/2069] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:36:06 2022] DELETE /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:36:07.218365 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-12cc4136-b578-4306-a535-4644f86650fc tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:07.219900 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-12cc4136-b578-4306-a535-4644f86650fc tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 7ce24132-2878-49fd-affe-8e57d06ed5ce] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:07.234393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12cc4136-b578-4306-a535-4644f86650fc tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:07.237629 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12cc4136-b578-4306-a535-4644f86650fc tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:07.238602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12cc4136-b578-4306-a535-4644f86650fc tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:07.240285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12cc4136-b578-4306-a535-4644f86650fc tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:07.242312 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12cc4136-b578-4306-a535-4644f86650fc tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:07.244396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12cc4136-b578-4306-a535-4644f86650fc tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:07.378528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-28c733ca-5c12-40c6-83ec-a2c4d546a155 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:07.392755 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-28c733ca-5c12-40c6-83ec-a2c4d546a155 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98" status: 200 len: 1266 microversion: 2.1 time: 0.252907 Oct 05 02:36:07.394333 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1017/2070] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:07 2022] GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98 => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:07.404753 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c4453af6-1343-40fa-b1df-3546c654ef41 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:07.407267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c4453af6-1343-40fa-b1df-3546c654ef41 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:07.425139 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4453af6-1343-40fa-b1df-3546c654ef41 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:07.426287 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4453af6-1343-40fa-b1df-3546c654ef41 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:07.429541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4453af6-1343-40fa-b1df-3546c654ef41 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:07.430654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4453af6-1343-40fa-b1df-3546c654ef41 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:07.431334 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4453af6-1343-40fa-b1df-3546c654ef41 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:07.434443 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4453af6-1343-40fa-b1df-3546c654ef41 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:07.713730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-12cc4136-b578-4306-a535-4644f86650fc tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:07.724948 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-12cc4136-b578-4306-a535-4644f86650fc tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce" status: 200 len: 1529 microversion: 2.1 time: 0.519149 Oct 05 02:36:07.736625 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1054/2071] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:07 2022] GET /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce => generated 1529 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:07.741779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c855b04d-b67c-4b67-ba09-bc278ee25e63 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:07.742700 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c855b04d-b67c-4b67-ba09-bc278ee25e63 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:07.763290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c855b04d-b67c-4b67-ba09-bc278ee25e63 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:07.772499 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c855b04d-b67c-4b67-ba09-bc278ee25e63 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:07.773355 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c855b04d-b67c-4b67-ba09-bc278ee25e63 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:07.774339 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c855b04d-b67c-4b67-ba09-bc278ee25e63 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:07.775020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c855b04d-b67c-4b67-ba09-bc278ee25e63 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:07.775724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c855b04d-b67c-4b67-ba09-bc278ee25e63 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:07.994262 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c855b04d-b67c-4b67-ba09-bc278ee25e63 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:08.028057 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c855b04d-b67c-4b67-ba09-bc278ee25e63 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 200 len: 1271 microversion: 2.1 time: 0.289870 Oct 05 02:36:08.029276 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1055/2072] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:07 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 1271 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:08.042738 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5a66a070-40cc-48d0-b332-61a30d2ac035 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf72e160>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:08.082499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c4453af6-1343-40fa-b1df-3546c654ef41 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:08.096099 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c4453af6-1343-40fa-b1df-3546c654ef41 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1393 microversion: 2.1 time: 0.698477 Oct 05 02:36:08.097511 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1018/2073] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:07 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1393 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:08.104664 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5a66a070-40cc-48d0-b332-61a30d2ac035 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02" status: 200 len: 1454 microversion: 2.1 time: 0.074100 Oct 05 02:36:08.105450 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1056/2074] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:08 2022] GET /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02 => generated 1454 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:08.117571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b9cfab1a-5dee-4946-bda4-81438a284d5a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:08.121253 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b9cfab1a-5dee-4946-bda4-81438a284d5a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 99fb0801-33dd-4993-a8d9-18a43e372684] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:08.130630 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9cfab1a-5dee-4946-bda4-81438a284d5a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:08.131598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9cfab1a-5dee-4946-bda4-81438a284d5a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:08.132056 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9cfab1a-5dee-4946-bda4-81438a284d5a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:08.132794 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9cfab1a-5dee-4946-bda4-81438a284d5a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:08.133502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9cfab1a-5dee-4946-bda4-81438a284d5a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:08.133829 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9cfab1a-5dee-4946-bda4-81438a284d5a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:08.207042 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b9cfab1a-5dee-4946-bda4-81438a284d5a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108227 Oct 05 02:36:08.212972 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1019/2075] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 02:36:08 2022] GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:08.415536 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-925fcc26-f18e-4cb1-9ea2-2df4a92a83c5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:08.416311 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-925fcc26-f18e-4cb1-9ea2-2df4a92a83c5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: e47438ff-463e-4a43-9767-8c78e8bb6e98] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:08.430841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-925fcc26-f18e-4cb1-9ea2-2df4a92a83c5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:08.432326 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-925fcc26-f18e-4cb1-9ea2-2df4a92a83c5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:08.433265 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-925fcc26-f18e-4cb1-9ea2-2df4a92a83c5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:08.434170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-925fcc26-f18e-4cb1-9ea2-2df4a92a83c5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:08.434787 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-925fcc26-f18e-4cb1-9ea2-2df4a92a83c5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:08.435366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-925fcc26-f18e-4cb1-9ea2-2df4a92a83c5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:08.543478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-925fcc26-f18e-4cb1-9ea2-2df4a92a83c5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:08.552518 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-925fcc26-f18e-4cb1-9ea2-2df4a92a83c5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98" status: 200 len: 1266 microversion: 2.1 time: 0.140684 Oct 05 02:36:08.554188 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1057/2076] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:08 2022] GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:08.770286 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9ae226a4-637c-402f-9592-90d6cdfe99a0 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:08.771481 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9ae226a4-637c-402f-9592-90d6cdfe99a0 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 7ce24132-2878-49fd-affe-8e57d06ed5ce] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:08.789987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ae226a4-637c-402f-9592-90d6cdfe99a0 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:08.790813 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ae226a4-637c-402f-9592-90d6cdfe99a0 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:08.792348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ae226a4-637c-402f-9592-90d6cdfe99a0 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:08.793376 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ae226a4-637c-402f-9592-90d6cdfe99a0 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:08.794036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ae226a4-637c-402f-9592-90d6cdfe99a0 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:08.794660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ae226a4-637c-402f-9592-90d6cdfe99a0 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:09.058246 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d5d6d302-a8e4-420a-8c47-c5b003eef7ca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:09.059071 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d5d6d302-a8e4-420a-8c47-c5b003eef7ca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:09.078807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5d6d302-a8e4-420a-8c47-c5b003eef7ca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:09.081221 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5d6d302-a8e4-420a-8c47-c5b003eef7ca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:09.083140 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5d6d302-a8e4-420a-8c47-c5b003eef7ca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:09.085304 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5d6d302-a8e4-420a-8c47-c5b003eef7ca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:09.086039 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5d6d302-a8e4-420a-8c47-c5b003eef7ca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:09.089759 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5d6d302-a8e4-420a-8c47-c5b003eef7ca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:09.133095 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9ae226a4-637c-402f-9592-90d6cdfe99a0 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:09.143886 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9ae226a4-637c-402f-9592-90d6cdfe99a0 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce" status: 200 len: 1529 microversion: 2.1 time: 0.378118 Oct 05 02:36:09.144557 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1020/2077] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:08 2022] GET /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce => generated 1529 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:09.156447 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d366c2d7-7836-472c-bef6-9e25ba589b72 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf674670>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:09.253023 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d366c2d7-7836-472c-bef6-9e25ba589b72 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02" status: 200 len: 1454 microversion: 2.1 time: 0.107596 Oct 05 02:36:09.257322 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1021/2078] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:09 2022] GET /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02 => generated 1454 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:09.274441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f9d2515c-79e4-4320-9838-1ac0b92b83d6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:09.277527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f9d2515c-79e4-4320-9838-1ac0b92b83d6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:09.285745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9d2515c-79e4-4320-9838-1ac0b92b83d6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:09.288418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9d2515c-79e4-4320-9838-1ac0b92b83d6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:09.289394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9d2515c-79e4-4320-9838-1ac0b92b83d6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:09.291877 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9d2515c-79e4-4320-9838-1ac0b92b83d6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:09.292777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9d2515c-79e4-4320-9838-1ac0b92b83d6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:09.293442 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9d2515c-79e4-4320-9838-1ac0b92b83d6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:10.271671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d5d6d302-a8e4-420a-8c47-c5b003eef7ca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:10.287067 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d5d6d302-a8e4-420a-8c47-c5b003eef7ca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 200 len: 1313 microversion: 2.1 time: 1.235170 Oct 05 02:36:10.300937 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1058/2079] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:09 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 1313 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:36:10.305167 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8f3f6af6-9eaf-4118-8409-9f7622b78d25 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:10.309151 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8f3f6af6-9eaf-4118-8409-9f7622b78d25 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 99fb0801-33dd-4993-a8d9-18a43e372684] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:10.316532 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f3f6af6-9eaf-4118-8409-9f7622b78d25 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:10.317497 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f3f6af6-9eaf-4118-8409-9f7622b78d25 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:10.318313 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f3f6af6-9eaf-4118-8409-9f7622b78d25 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:10.319872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f3f6af6-9eaf-4118-8409-9f7622b78d25 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:10.321287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f3f6af6-9eaf-4118-8409-9f7622b78d25 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:10.321979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f3f6af6-9eaf-4118-8409-9f7622b78d25 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:10.333060 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f9d2515c-79e4-4320-9838-1ac0b92b83d6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:10.345533 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f9d2515c-79e4-4320-9838-1ac0b92b83d6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1393 microversion: 2.1 time: 1.080603 Oct 05 02:36:10.362100 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1022/2080] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:09 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1393 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:10.377279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9ad2906d-2eba-4313-8d6e-6beccba7ad69 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:10.378157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9ad2906d-2eba-4313-8d6e-6beccba7ad69 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: e47438ff-463e-4a43-9767-8c78e8bb6e98] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:10.394602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ad2906d-2eba-4313-8d6e-6beccba7ad69 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:10.395335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ad2906d-2eba-4313-8d6e-6beccba7ad69 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:10.395955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ad2906d-2eba-4313-8d6e-6beccba7ad69 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:10.396812 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ad2906d-2eba-4313-8d6e-6beccba7ad69 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:10.397453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ad2906d-2eba-4313-8d6e-6beccba7ad69 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:10.398008 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ad2906d-2eba-4313-8d6e-6beccba7ad69 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:10.984677 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8f3f6af6-9eaf-4118-8409-9f7622b78d25 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.691717 Oct 05 02:36:10.985402 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1059/2081] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 02:36:10 2022] GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684/os-volume_attachments => generated 197 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:10.997864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f7ef9e8f-6709-4a82-8e27-4ed31e9cde4e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:11.001498 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f7ef9e8f-6709-4a82-8e27-4ed31e9cde4e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 7ce24132-2878-49fd-affe-8e57d06ed5ce] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:11.008285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7ef9e8f-6709-4a82-8e27-4ed31e9cde4e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:11.008992 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7ef9e8f-6709-4a82-8e27-4ed31e9cde4e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:11.009665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7ef9e8f-6709-4a82-8e27-4ed31e9cde4e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:11.011352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7ef9e8f-6709-4a82-8e27-4ed31e9cde4e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:11.012049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7ef9e8f-6709-4a82-8e27-4ed31e9cde4e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:11.012635 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7ef9e8f-6709-4a82-8e27-4ed31e9cde4e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:11.048656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9ad2906d-2eba-4313-8d6e-6beccba7ad69 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:11.058551 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9ad2906d-2eba-4313-8d6e-6beccba7ad69 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98" status: 200 len: 1308 microversion: 2.1 time: 0.685177 Oct 05 02:36:11.059845 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1023/2082] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:10 2022] GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98 => generated 1308 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:11.064951 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1a62639f-f658-4ca6-9fd8-3b56f1d55c34 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf6fbb80>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:11.134032 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1a62639f-f658-4ca6-9fd8-3b56f1d55c34 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02" status: 200 len: 1463 microversion: 2.1 time: 0.072622 Oct 05 02:36:11.135521 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1024/2083] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:11 2022] GET /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02 => generated 1463 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:11.143295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-e4cce82f-56e5-44e2-b01b-a02cfae435cf req-eab14c13-2b1f-402a-8389-bb3130dbb2be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f4b118a-e665-4c29-a518-811ca1fc9001", "name": "network-vif-unplugged", "status": "completed", "tag": "f83cfb8b-54ff-4810-8dff-d1685b7e58d4"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:11.160003 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e4cce82f-56e5-44e2-b01b-a02cfae435cf req-eab14c13-2b1f-402a-8389-bb3130dbb2be service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:11.160592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e4cce82f-56e5-44e2-b01b-a02cfae435cf req-eab14c13-2b1f-402a-8389-bb3130dbb2be service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:11.161062 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e4cce82f-56e5-44e2-b01b-a02cfae435cf req-eab14c13-2b1f-402a-8389-bb3130dbb2be service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:11.188282 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-e4cce82f-56e5-44e2-b01b-a02cfae435cf req-eab14c13-2b1f-402a-8389-bb3130dbb2be service nova] Creating event network-vif-unplugged:f83cfb8b-54ff-4810-8dff-d1685b7e58d4 for instance 1f4b118a-e665-4c29-a518-811ca1fc9001 on n-h1-858272-3 Oct 05 02:36:11.194349 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-e4cce82f-56e5-44e2-b01b-a02cfae435cf req-eab14c13-2b1f-402a-8389-bb3130dbb2be service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057575 Oct 05 02:36:11.195294 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1025/2084] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:11.203011 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bcafdc5a-63f7-4722-b795-939bcf6f03a9 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf65f1f0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:11.268473 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bcafdc5a-63f7-4722-b795-939bcf6f03a9 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02" status: 200 len: 1463 microversion: 2.1 time: 0.070907 Oct 05 02:36:11.269559 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1026/2085] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:11 2022] GET /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02 => generated 1463 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:11.285485 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-22748e20-e873-40e1-aa6a-8621f1d4c422 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:11.286953 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-22748e20-e873-40e1-aa6a-8621f1d4c422 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: 7b30cf01-6bc7-453f-b9f2-98400bcfc063] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:11.305314 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22748e20-e873-40e1-aa6a-8621f1d4c422 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:11.307781 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22748e20-e873-40e1-aa6a-8621f1d4c422 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:11.308233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22748e20-e873-40e1-aa6a-8621f1d4c422 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:11.310706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22748e20-e873-40e1-aa6a-8621f1d4c422 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:11.310706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22748e20-e873-40e1-aa6a-8621f1d4c422 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:11.310706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22748e20-e873-40e1-aa6a-8621f1d4c422 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:11.723856 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f7ef9e8f-6709-4a82-8e27-4ed31e9cde4e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c441be8c87648bf9f1ff5cd4aff2532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47098be734b14277a4d9a9d6b8464998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:11.729562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-22748e20-e873-40e1-aa6a-8621f1d4c422 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f551e15d65a34daaac2b4d4f5963c522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7719a3153f66484c8758bb0999719851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:11.734516 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f7ef9e8f-6709-4a82-8e27-4ed31e9cde4e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce" status: 200 len: 1529 microversion: 2.1 time: 0.741473 Oct 05 02:36:11.735914 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1060/2086] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:10 2022] GET /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce => generated 1529 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:11.741141 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2ecf6f06-d851-42f6-b565-e7d13bd4ea53 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:11.741673 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-22748e20-e873-40e1-aa6a-8621f1d4c422 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063" status: 200 len: 1467 microversion: 2.1 time: 0.458855 Oct 05 02:36:11.742210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2ecf6f06-d851-42f6-b565-e7d13bd4ea53 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:11.743065 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1027/2087] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:11 2022] GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063 => generated 1467 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:36:11.750500 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ecf6f06-d851-42f6-b565-e7d13bd4ea53 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:11.751273 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ecf6f06-d851-42f6-b565-e7d13bd4ea53 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:11.751893 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ecf6f06-d851-42f6-b565-e7d13bd4ea53 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:11.752147 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-2df2ed02-a991-4172-b7e5-11e372973ab9 req-161e5887-d757-4658-ad1c-b7f5486576d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e47438ff-463e-4a43-9767-8c78e8bb6e98", "tag": "d17e6d68-21a3-4fc2-9ded-814bf288d29c"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:11.753176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ecf6f06-d851-42f6-b565-e7d13bd4ea53 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:11.753845 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ecf6f06-d851-42f6-b565-e7d13bd4ea53 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:11.754540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ecf6f06-d851-42f6-b565-e7d13bd4ea53 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:11.787435 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-2df2ed02-a991-4172-b7e5-11e372973ab9 req-161e5887-d757-4658-ad1c-b7f5486576d0 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:11.787931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-2df2ed02-a991-4172-b7e5-11e372973ab9 req-161e5887-d757-4658-ad1c-b7f5486576d0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:11.788375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-2df2ed02-a991-4172-b7e5-11e372973ab9 req-161e5887-d757-4658-ad1c-b7f5486576d0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:11.812562 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-2df2ed02-a991-4172-b7e5-11e372973ab9 req-161e5887-d757-4658-ad1c-b7f5486576d0 service nova] Creating event network-changed:d17e6d68-21a3-4fc2-9ded-814bf288d29c for instance e47438ff-463e-4a43-9767-8c78e8bb6e98 on n-h1-858272-3 Oct 05 02:36:11.824401 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-2df2ed02-a991-4172-b7e5-11e372973ab9 req-161e5887-d757-4658-ad1c-b7f5486576d0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078192 Oct 05 02:36:11.827775 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1028/2088] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:11.993300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2ecf6f06-d851-42f6-b565-e7d13bd4ea53 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:12.003807 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2ecf6f06-d851-42f6-b565-e7d13bd4ea53 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 200 len: 1334 microversion: 2.1 time: 0.266610 Oct 05 02:36:12.017176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-625bbc18-ab62-4173-aa19-5c3624333434 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-925263275", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:12.017812 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1061/2089] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:11 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 1334 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:12.026681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-884730c1-be7b-4f61-8b6c-d114c4a4ceb4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:12.027705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-884730c1-be7b-4f61-8b6c-d114c4a4ceb4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:12.034236 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-884730c1-be7b-4f61-8b6c-d114c4a4ceb4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:12.034945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-884730c1-be7b-4f61-8b6c-d114c4a4ceb4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:12.035532 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-884730c1-be7b-4f61-8b6c-d114c4a4ceb4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:12.036498 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-884730c1-be7b-4f61-8b6c-d114c4a4ceb4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:12.037165 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-884730c1-be7b-4f61-8b6c-d114c4a4ceb4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:12.037931 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-884730c1-be7b-4f61-8b6c-d114c4a4ceb4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:12.100749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-625bbc18-ab62-4173-aa19-5c3624333434 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] validate_networks() for None {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:36:12.256748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=7 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:12.308445 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=18 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:12.328951 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-884730c1-be7b-4f61-8b6c-d114c4a4ceb4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:12.338785 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-884730c1-be7b-4f61-8b6c-d114c4a4ceb4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1393 microversion: 2.1 time: 0.318910 Oct 05 02:36:12.339378 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1062/2090] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:12 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1393 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:12.350270 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2cecd220-a0c8-457b-963b-a93375625863 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-947991590"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:12.354316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2cecd220-a0c8-457b-963b-a93375625863 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: e123bb72-45c5-4371-bf2e-f0747497f16b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:12.371700 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cecd220-a0c8-457b-963b-a93375625863 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:12.372500 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cecd220-a0c8-457b-963b-a93375625863 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:12.373136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cecd220-a0c8-457b-963b-a93375625863 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:12.374100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cecd220-a0c8-457b-963b-a93375625863 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:12.375449 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cecd220-a0c8-457b-963b-a93375625863 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:12.376070 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cecd220-a0c8-457b-963b-a93375625863 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:12.500222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-625bbc18-ab62-4173-aa19-5c3624333434 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:36:12.501095 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-625bbc18-ab62-4173-aa19-5c3624333434 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:36:12.502778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-625bbc18-ab62-4173-aa19-5c3624333434 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:36:12.503534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-625bbc18-ab62-4173-aa19-5c3624333434 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:36:12.504141 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-625bbc18-ab62-4173-aa19-5c3624333434 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:36:12.519171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-625bbc18-ab62-4173-aa19-5c3624333434 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:12.519823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-625bbc18-ab62-4173-aa19-5c3624333434 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:12.520357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-625bbc18-ab62-4173-aa19-5c3624333434 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:12.521352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-625bbc18-ab62-4173-aa19-5c3624333434 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:12.522539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-625bbc18-ab62-4173-aa19-5c3624333434 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:12.523239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-625bbc18-ab62-4173-aa19-5c3624333434 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:12.547839 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-625bbc18-ab62-4173-aa19-5c3624333434 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Getting quotas for project eccc732cf08749648be251ca96d18cd1. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:36:12.555064 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-625bbc18-ab62-4173-aa19-5c3624333434 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Getting quotas for user 83a280fd56304b47acca3f0b4061e18a and project eccc732cf08749648be251ca96d18cd1. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:36:12.559501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:12.573354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-625bbc18-ab62-4173-aa19-5c3624333434 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:36:12.576636 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-625bbc18-ab62-4173-aa19-5c3624333434 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: e3d6d4a6-f11c-4b42-9023-4729addcf3da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:36:12.629825 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-625bbc18-ab62-4173-aa19-5c3624333434 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.800577 Oct 05 02:36:12.631100 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1029/2091] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:36:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:36:12.635989 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-28b2d39d-bdab-492d-bae4-28a5dc9c667b tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:12.638636 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-28b2d39d-bdab-492d-bae4-28a5dc9c667b tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 99fb0801-33dd-4993-a8d9-18a43e372684] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:12.645261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28b2d39d-bdab-492d-bae4-28a5dc9c667b tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:12.659105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28b2d39d-bdab-492d-bae4-28a5dc9c667b tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:12.660032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28b2d39d-bdab-492d-bae4-28a5dc9c667b tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:12.664673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28b2d39d-bdab-492d-bae4-28a5dc9c667b tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:12.665302 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28b2d39d-bdab-492d-bae4-28a5dc9c667b tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:12.665843 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28b2d39d-bdab-492d-bae4-28a5dc9c667b tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:12.684257 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2cecd220-a0c8-457b-963b-a93375625863 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "POST /compute/v2.1/servers/e123bb72-45c5-4371-bf2e-f0747497f16b/action" status: 202 len: 0 microversion: 2.1 time: 0.339587 Oct 05 02:36:12.685583 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1063/2092] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:36:12 2022] POST /compute/v2.1/servers/e123bb72-45c5-4371-bf2e-f0747497f16b/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 05 02:36:12.694400 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fdfc67a5-4610-4c28-9f95-faf8b202242d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:12.695346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fdfc67a5-4610-4c28-9f95-faf8b202242d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: e47438ff-463e-4a43-9767-8c78e8bb6e98] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:12.700965 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:12.707114 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-28b2d39d-bdab-492d-bae4-28a5dc9c667b tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074406 Oct 05 02:36:12.708189 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1030/2093] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 02:36:12 2022] GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:36:12.710120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fdfc67a5-4610-4c28-9f95-faf8b202242d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:12.711053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fdfc67a5-4610-4c28-9f95-faf8b202242d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:12.711740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fdfc67a5-4610-4c28-9f95-faf8b202242d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:12.712611 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fdfc67a5-4610-4c28-9f95-faf8b202242d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:12.714149 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fdfc67a5-4610-4c28-9f95-faf8b202242d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:12.714721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fdfc67a5-4610-4c28-9f95-faf8b202242d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:12.726973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ac3db051-5c28-4b9c-ae1d-3721112f82ff tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:12.729990 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ac3db051-5c28-4b9c-ae1d-3721112f82ff tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: e3d6d4a6-f11c-4b42-9023-4729addcf3da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:12.886386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ac3db051-5c28-4b9c-ae1d-3721112f82ff tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:12.896895 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ac3db051-5c28-4b9c-ae1d-3721112f82ff tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da" status: 200 len: 1221 microversion: 2.1 time: 0.187469 Oct 05 02:36:12.898999 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1031/2094] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:12 2022] GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da => generated 1221 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:12.905808 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-57f8de23-7c61-4950-b51a-08f7e21c0a4e tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf605af0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:13.005295 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-57f8de23-7c61-4950-b51a-08f7e21c0a4e tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd" status: 200 len: 1454 microversion: 2.1 time: 0.102482 Oct 05 02:36:13.007011 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1032/2095] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:12 2022] GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd => generated 1454 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:13.032294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9dc4e36e-cc9d-48c1-8b55-74637ca392fb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:13.036223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9dc4e36e-cc9d-48c1-8b55-74637ca392fb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 7ce24132-2878-49fd-affe-8e57d06ed5ce] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:13.056821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9dc4e36e-cc9d-48c1-8b55-74637ca392fb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:13.057681 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9dc4e36e-cc9d-48c1-8b55-74637ca392fb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:13.058291 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9dc4e36e-cc9d-48c1-8b55-74637ca392fb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:13.059017 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9dc4e36e-cc9d-48c1-8b55-74637ca392fb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:13.059469 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9dc4e36e-cc9d-48c1-8b55-74637ca392fb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:13.060784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9dc4e36e-cc9d-48c1-8b55-74637ca392fb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:13.095098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fdfc67a5-4610-4c28-9f95-faf8b202242d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:13.106984 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-9dc4e36e-cc9d-48c1-8b55-74637ca392fb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] HTTP exception thrown: Instance 7ce24132-2878-49fd-affe-8e57d06ed5ce could not be found. Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9dc4e36e-cc9d-48c1-8b55-74637ca392fb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Request method failure captured: Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce HTTP/1.1 Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO0XYeg8tqT8ongEAJOwqXQnTLTHZzTVGNp07qyK2Im6Pk37xE9_000kJ-ghGlg1M4xDfFZdh80YSHVWWaKUqSxFWQ_Csj3K04E3ui1EPC1OYFRpRVpFWUIW6dnDr0Kom0Z5CM2HBG5dMHahqKQPxztoTXPVRWZPXtn1QZY0a3PPLGY Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 47098be734b14277a4d9a9d6b8464998 Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_47098be734b14277a4d9a9d6b8464998"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 47098be734b14277a4d9a9d6b8464998 Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ImagesOneServerNegativeTestJSON-1772902756-project Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 4c441be8c87648bf9f1ff5cd4aff2532 Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756-project Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 7ce24132-2878-49fd-affe-8e57d06ed5ce could not be found. Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '7ce24132-2878-49fd-affe-8e57d06ed5ce'} Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ce24132-2878-49fd-affe-8e57d06ed5ce could not be found. Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ce24132-2878-49fd-affe-8e57d06ed5ce could not be found. Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:13.109659 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:13.113711 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:13.113711 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:13.113711 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:13.113711 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:13.113711 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:36:13.113711 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:36:13.113711 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ce24132-2878-49fd-affe-8e57d06ed5ce could not be found. Oct 05 02:36:13.113711 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:13.114206 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fdfc67a5-4610-4c28-9f95-faf8b202242d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98" status: 200 len: 1308 microversion: 2.1 time: 0.421882 Oct 05 02:36:13.114206 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1064/2096] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:12 2022] GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98 => generated 1308 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:13.115802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9dc4e36e-cc9d-48c1-8b55-74637ca392fb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Returning 404 to user: Instance 7ce24132-2878-49fd-affe-8e57d06ed5ce could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:36:13.117399 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9dc4e36e-cc9d-48c1-8b55-74637ca392fb tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce" status: 404 len: 111 microversion: 2.1 time: 0.108585 Oct 05 02:36:13.122445 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1033/2097] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:13 2022] GET /compute/v2.1/servers/7ce24132-2878-49fd-affe-8e57d06ed5ce => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:36:13.122609 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-abe772e0-61e6-4691-97d8-04e43506ea56 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:13.125253 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-abe772e0-61e6-4691-97d8-04e43506ea56 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:13.130815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a229a053-25aa-4d3d-8c45-f22747cc9b94 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1444268179", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "56b199ac-5a6b-46c9-8746-597e251514be"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:13.132356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-abe772e0-61e6-4691-97d8-04e43506ea56 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:13.132861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-abe772e0-61e6-4691-97d8-04e43506ea56 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:13.133335 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-abe772e0-61e6-4691-97d8-04e43506ea56 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:13.134364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-abe772e0-61e6-4691-97d8-04e43506ea56 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:13.135590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-abe772e0-61e6-4691-97d8-04e43506ea56 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:13.136407 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-abe772e0-61e6-4691-97d8-04e43506ea56 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:13.206181 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-a229a053-25aa-4d3d-8c45-f22747cc9b94 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] validate_networks() for [('56b199ac-5a6b-46c9-8746-597e251514be', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:36:13.435884 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-abe772e0-61e6-4691-97d8-04e43506ea56 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:13.447338 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-abe772e0-61e6-4691-97d8-04e43506ea56 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 200 len: 1355 microversion: 2.1 time: 0.335732 Oct 05 02:36:13.447928 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1065/2098] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:13 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 1355 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:13.452805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c2104015-b6e5-4170-9465-b914405c157e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '.version_select at 0x7fccdf72f1f0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:13.477079 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-c2104015-b6e5-4170-9465-b914405c157e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] HTTP exception thrown: Image not found. Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c2104015-b6e5-4170-9465-b914405c157e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Request method failure captured: Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/images/5c0c3b43-b121-459f-9f7c-617d20b7ebbc HTTP/1.1 Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO0XYeg8tqT8ongEAJOwqXQnTLTHZzTVGNp07qyK2Im6Pk37xE9_000kJ-ghGlg1M4xDfFZdh80YSHVWWaKUqSxFWQ_Csj3K04E3ui1EPC1OYFRpRVpFWUIW6dnDr0Kom0Z5CM2HBG5dMHahqKQPxztoTXPVRWZPXtn1QZY0a3PPLGY Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 47098be734b14277a4d9a9d6b8464998 Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_47098be734b14277a4d9a9d6b8464998"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 47098be734b14277a4d9a9d6b8464998 Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ImagesOneServerNegativeTestJSON-1772902756-project Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 4c441be8c87648bf9f1ff5cd4aff2532 Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756-project Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: exception: Image not found. Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '5c0c3b43-b121-459f-9f7c-617d20b7ebbc'} Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5c0c3b43-b121-459f-9f7c-617d20b7ebbc to delete Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5c0c3b43-b121-459f-9f7c-617d20b7ebbc could not be found. Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:13.479707 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:13.484510 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:13.484510 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:13.484510 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:13.484510 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:36:13.484510 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:36:13.484510 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:36:13.484510 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:36:13.484510 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:36:13.484510 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:36:13.484510 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 05 02:36:13.484510 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 05 02:36:13.484510 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 02:36:13.484510 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:13.484510 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:13.484510 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:13.484510 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:13.484510 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:13.484510 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:13.484510 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:36:13.484510 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:36:13.484510 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 02:36:13.484510 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:13.484510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c2104015-b6e5-4170-9465-b914405c157e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Returning 404 to user: Image not found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:36:13.484510 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c2104015-b6e5-4170-9465-b914405c157e tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "DELETE /compute/v2.1/images/5c0c3b43-b121-459f-9f7c-617d20b7ebbc" status: 404 len: 62 microversion: 2.1 time: 0.032083 Oct 05 02:36:13.484510 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1066/2099] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:13 2022] DELETE /compute/v2.1/images/5c0c3b43-b121-459f-9f7c-617d20b7ebbc => generated 62 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:36:13.489821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-5f6efbd4-3e78-47a9-af28-a34aca1a6391 req-f2488150-54d1-4688-86b1-941c43ec9c58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ce24132-2878-49fd-affe-8e57d06ed5ce", "name": "network-vif-deleted", "tag": "4a731a9d-f714-4491-a279-a8665ec4e966"}, {"name": "network-changed", "server_uuid": "1f4b118a-e665-4c29-a518-811ca1fc9001", "tag": "f83cfb8b-54ff-4810-8dff-d1685b7e58d4"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:13.501645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-5f6efbd4-3e78-47a9-af28-a34aca1a6391 req-f2488150-54d1-4688-86b1-941c43ec9c58 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:13.502131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-5f6efbd4-3e78-47a9-af28-a34aca1a6391 req-f2488150-54d1-4688-86b1-941c43ec9c58 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:13.502561 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-5f6efbd4-3e78-47a9-af28-a34aca1a6391 req-f2488150-54d1-4688-86b1-941c43ec9c58 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:13.515929 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-5f6efbd4-3e78-47a9-af28-a34aca1a6391 req-f2488150-54d1-4688-86b1-941c43ec9c58 service nova] Creating event network-vif-deleted:4a731a9d-f714-4491-a279-a8665ec4e966 for instance 7ce24132-2878-49fd-affe-8e57d06ed5ce on n-h2-858272-3 Oct 05 02:36:13.516437 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-5f6efbd4-3e78-47a9-af28-a34aca1a6391 req-f2488150-54d1-4688-86b1-941c43ec9c58 service nova] Creating event network-changed:f83cfb8b-54ff-4810-8dff-d1685b7e58d4 for instance 1f4b118a-e665-4c29-a518-811ca1fc9001 on n-h1-858272-3 Oct 05 02:36:13.524846 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-5f6efbd4-3e78-47a9-af28-a34aca1a6391 req-f2488150-54d1-4688-86b1-941c43ec9c58 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.041771 Oct 05 02:36:13.526294 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1067/2100] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:13.531348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5101afde-a5c0-45ef-bba5-988b7f4494a6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:13.532096 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5101afde-a5c0-45ef-bba5-988b7f4494a6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:13.538903 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5101afde-a5c0-45ef-bba5-988b7f4494a6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:13.538903 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5101afde-a5c0-45ef-bba5-988b7f4494a6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:13.539352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5101afde-a5c0-45ef-bba5-988b7f4494a6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:13.540202 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5101afde-a5c0-45ef-bba5-988b7f4494a6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:13.540664 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5101afde-a5c0-45ef-bba5-988b7f4494a6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:13.541704 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5101afde-a5c0-45ef-bba5-988b7f4494a6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:13.725652 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5101afde-a5c0-45ef-bba5-988b7f4494a6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:13.737425 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5101afde-a5c0-45ef-bba5-988b7f4494a6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1393 microversion: 2.1 time: 0.210037 Oct 05 02:36:13.738291 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1068/2101] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:13 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1393 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:13.743445 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1e76ca41-b04c-4b5c-b76b-b08540d9a398 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:13.745681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1e76ca41-b04c-4b5c-b76b-b08540d9a398 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:13.756259 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e76ca41-b04c-4b5c-b76b-b08540d9a398 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:13.761051 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e76ca41-b04c-4b5c-b76b-b08540d9a398 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:13.761051 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e76ca41-b04c-4b5c-b76b-b08540d9a398 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:13.761051 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e76ca41-b04c-4b5c-b76b-b08540d9a398 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:13.761051 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e76ca41-b04c-4b5c-b76b-b08540d9a398 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:13.761051 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e76ca41-b04c-4b5c-b76b-b08540d9a398 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:13.779014 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-1e76ca41-b04c-4b5c-b76b-b08540d9a398 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] HTTP exception thrown: Instance 39c77ec6-c103-4c7c-b7c0-0753dd0acf83 could not be found. Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1e76ca41-b04c-4b5c-b76b-b08540d9a398 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Request method failure captured: Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 HTTP/1.1 Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO0XYeg8tqT8ongEAJOwqXQnTLTHZzTVGNp07qyK2Im6Pk37xE9_000kJ-ghGlg1M4xDfFZdh80YSHVWWaKUqSxFWQ_Csj3K04E3ui1EPC1OYFRpRVpFWUIW6dnDr0Kom0Z5CM2HBG5dMHahqKQPxztoTXPVRWZPXtn1QZY0a3PPLGY Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 47098be734b14277a4d9a9d6b8464998 Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_47098be734b14277a4d9a9d6b8464998"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 47098be734b14277a4d9a9d6b8464998 Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ImagesOneServerNegativeTestJSON-1772902756-project Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 4c441be8c87648bf9f1ff5cd4aff2532 Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756-project Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 39c77ec6-c103-4c7c-b7c0-0753dd0acf83 could not be found. Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '39c77ec6-c103-4c7c-b7c0-0753dd0acf83'} Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39c77ec6-c103-4c7c-b7c0-0753dd0acf83 could not be found. Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:36:13.780997 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:36:13.785000 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39c77ec6-c103-4c7c-b7c0-0753dd0acf83 could not be found. Oct 05 02:36:13.785000 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:13.785000 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:13.785000 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:13.785000 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:13.785000 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:13.785000 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:13.785000 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:36:13.785000 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:36:13.785000 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39c77ec6-c103-4c7c-b7c0-0753dd0acf83 could not be found. Oct 05 02:36:13.785000 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:13.785000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1e76ca41-b04c-4b5c-b76b-b08540d9a398 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Returning 404 to user: Instance 39c77ec6-c103-4c7c-b7c0-0753dd0acf83 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:36:13.785000 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1e76ca41-b04c-4b5c-b76b-b08540d9a398 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "DELETE /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 404 len: 111 microversion: 2.1 time: 0.043903 Oct 05 02:36:13.785000 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1069/2102] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:36:13 2022] DELETE /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:36:13.792740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e85688d7-1ae9-45f4-bd51-9d7736d21a6c tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:13.793552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e85688d7-1ae9-45f4-bd51-9d7736d21a6c tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: 39c77ec6-c103-4c7c-b7c0-0753dd0acf83] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:13.800032 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e85688d7-1ae9-45f4-bd51-9d7736d21a6c tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:13.800536 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e85688d7-1ae9-45f4-bd51-9d7736d21a6c tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:13.801413 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e85688d7-1ae9-45f4-bd51-9d7736d21a6c tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:13.801716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e85688d7-1ae9-45f4-bd51-9d7736d21a6c tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:13.802179 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e85688d7-1ae9-45f4-bd51-9d7736d21a6c tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:13.802615 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e85688d7-1ae9-45f4-bd51-9d7736d21a6c tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:13.819179 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-e85688d7-1ae9-45f4-bd51-9d7736d21a6c tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] HTTP exception thrown: Instance 39c77ec6-c103-4c7c-b7c0-0753dd0acf83 could not be found. Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e85688d7-1ae9-45f4-bd51-9d7736d21a6c tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Request method failure captured: Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 HTTP/1.1 Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO0XYeg8tqT8ongEAJOwqXQnTLTHZzTVGNp07qyK2Im6Pk37xE9_000kJ-ghGlg1M4xDfFZdh80YSHVWWaKUqSxFWQ_Csj3K04E3ui1EPC1OYFRpRVpFWUIW6dnDr0Kom0Z5CM2HBG5dMHahqKQPxztoTXPVRWZPXtn1QZY0a3PPLGY Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 47098be734b14277a4d9a9d6b8464998 Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_47098be734b14277a4d9a9d6b8464998"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 47098be734b14277a4d9a9d6b8464998 Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ImagesOneServerNegativeTestJSON-1772902756-project Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 4c441be8c87648bf9f1ff5cd4aff2532 Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756-project Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 39c77ec6-c103-4c7c-b7c0-0753dd0acf83 could not be found. Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '39c77ec6-c103-4c7c-b7c0-0753dd0acf83'} Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39c77ec6-c103-4c7c-b7c0-0753dd0acf83 could not be found. Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39c77ec6-c103-4c7c-b7c0-0753dd0acf83 could not be found. Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:13.820718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:13.825723 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:13.825723 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:13.825723 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:13.825723 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:13.825723 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:36:13.825723 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:36:13.825723 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39c77ec6-c103-4c7c-b7c0-0753dd0acf83 could not be found. Oct 05 02:36:13.825723 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:13.825723 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e85688d7-1ae9-45f4-bd51-9d7736d21a6c tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Returning 404 to user: Instance 39c77ec6-c103-4c7c-b7c0-0753dd0acf83 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:36:13.825723 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e85688d7-1ae9-45f4-bd51-9d7736d21a6c tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83" status: 404 len: 111 microversion: 2.1 time: 0.034134 Oct 05 02:36:13.826879 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1070/2103] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:13 2022] GET /compute/v2.1/servers/39c77ec6-c103-4c7c-b7c0-0753dd0acf83 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:36:13.831864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7764f070-e2b3-4ea1-b4b8-7b4f9d592439 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '.version_select at 0x7fcce8084b80>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:13.833347 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-a229a053-25aa-4d3d-8c45-f22747cc9b94 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:36:13.833817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-a229a053-25aa-4d3d-8c45-f22747cc9b94 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:36:13.834230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-a229a053-25aa-4d3d-8c45-f22747cc9b94 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:36:13.834639 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-a229a053-25aa-4d3d-8c45-f22747cc9b94 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:36:13.835047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-a229a053-25aa-4d3d-8c45-f22747cc9b94 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:36:13.845561 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a229a053-25aa-4d3d-8c45-f22747cc9b94 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:13.846155 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a229a053-25aa-4d3d-8c45-f22747cc9b94 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:13.846815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a229a053-25aa-4d3d-8c45-f22747cc9b94 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:13.848644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a229a053-25aa-4d3d-8c45-f22747cc9b94 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:13.849298 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a229a053-25aa-4d3d-8c45-f22747cc9b94 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:13.849884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a229a053-25aa-4d3d-8c45-f22747cc9b94 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:13.854176 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7764f070-e2b3-4ea1-b4b8-7b4f9d592439 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1950295311" status: 202 len: 0 microversion: 2.1 time: 0.025717 Oct 05 02:36:13.854843 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1071/2104] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 5 02:36:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1950295311 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:36:13.870175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-a229a053-25aa-4d3d-8c45-f22747cc9b94 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Getting quotas for project d4276a8be8c541159a4d1d575995dcc6. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:36:13.875498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-a229a053-25aa-4d3d-8c45-f22747cc9b94 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Getting quotas for user 6c889d2c39af44c693a3c15b5ba4bca9 and project d4276a8be8c541159a4d1d575995dcc6. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:36:13.889112 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a229a053-25aa-4d3d-8c45-f22747cc9b94 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:36:13.891286 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a229a053-25aa-4d3d-8c45-f22747cc9b94 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 6cf0945c-2ca2-4803-ab89-adf554c92c51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:36:13.907968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-e4af4267-ed89-482c-8e28-1cd2eacc73f3 req-8b6b5c53-1a5d-4c36-881f-6b38253ea011 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d0e63ee-ba8d-4203-9cd5-f13d833de668", "tag": "2e61d503-74a8-4e51-878c-815eee17f241"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:13.919071 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e4af4267-ed89-482c-8e28-1cd2eacc73f3 req-8b6b5c53-1a5d-4c36-881f-6b38253ea011 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:13.919776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e4af4267-ed89-482c-8e28-1cd2eacc73f3 req-8b6b5c53-1a5d-4c36-881f-6b38253ea011 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:13.920357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e4af4267-ed89-482c-8e28-1cd2eacc73f3 req-8b6b5c53-1a5d-4c36-881f-6b38253ea011 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:13.940251 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-e4af4267-ed89-482c-8e28-1cd2eacc73f3 req-8b6b5c53-1a5d-4c36-881f-6b38253ea011 service nova] Creating event network-changed:2e61d503-74a8-4e51-878c-815eee17f241 for instance 1d0e63ee-ba8d-4203-9cd5-f13d833de668 on n-h2-858272-3 Oct 05 02:36:13.945796 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-e4af4267-ed89-482c-8e28-1cd2eacc73f3 req-8b6b5c53-1a5d-4c36-881f-6b38253ea011 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041689 Oct 05 02:36:13.946974 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1072/2105] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:36:13.950991 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a229a053-25aa-4d3d-8c45-f22747cc9b94 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.829905 Oct 05 02:36:13.951907 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1034/2106] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:36:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:36:13.959505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-591741a3-9b08-481a-9b8d-f6b2e4afbd67 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:13.960818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-591741a3-9b08-481a-9b8d-f6b2e4afbd67 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: e3d6d4a6-f11c-4b42-9023-4729addcf3da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:13.969644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-591741a3-9b08-481a-9b8d-f6b2e4afbd67 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:13.970798 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-591741a3-9b08-481a-9b8d-f6b2e4afbd67 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:13.972602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-591741a3-9b08-481a-9b8d-f6b2e4afbd67 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:13.972602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-591741a3-9b08-481a-9b8d-f6b2e4afbd67 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:13.973552 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-591741a3-9b08-481a-9b8d-f6b2e4afbd67 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:13.973679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cd2fdff0-3b7b-4a78-92bd-d84d280ea246 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:13.974778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-591741a3-9b08-481a-9b8d-f6b2e4afbd67 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:13.974890 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cd2fdff0-3b7b-4a78-92bd-d84d280ea246 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 6cf0945c-2ca2-4803-ab89-adf554c92c51] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:14.123311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-591741a3-9b08-481a-9b8d-f6b2e4afbd67 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:14.132796 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-591741a3-9b08-481a-9b8d-f6b2e4afbd67 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da" status: 200 len: 1225 microversion: 2.1 time: 0.178267 Oct 05 02:36:14.136858 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1035/2107] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:13 2022] GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da => generated 1225 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:14.140847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:14.148699 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cd2fdff0-3b7b-4a78-92bd-d84d280ea246 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:14.149842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f8ba5b6f-1066-4d7a-a88d-3878fb50fdb5 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce80c24c0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:14.163382 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cd2fdff0-3b7b-4a78-92bd-d84d280ea246 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51" status: 200 len: 1218 microversion: 2.1 time: 0.204204 Oct 05 02:36:14.165269 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1073/2108] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:13 2022] GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51 => generated 1218 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:36:14.173034 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-22f386ec-0567-4e8d-aae8-ce655d73d8e8 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:14.173662 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-22f386ec-0567-4e8d-aae8-ce655d73d8e8 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: e47438ff-463e-4a43-9767-8c78e8bb6e98] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:14.193964 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22f386ec-0567-4e8d-aae8-ce655d73d8e8 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:14.194617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22f386ec-0567-4e8d-aae8-ce655d73d8e8 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:14.195161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22f386ec-0567-4e8d-aae8-ce655d73d8e8 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:14.195994 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22f386ec-0567-4e8d-aae8-ce655d73d8e8 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:14.196554 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22f386ec-0567-4e8d-aae8-ce655d73d8e8 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:14.197248 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22f386ec-0567-4e8d-aae8-ce655d73d8e8 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:14.240684 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f8ba5b6f-1066-4d7a-a88d-3878fb50fdb5 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd" status: 200 len: 1454 microversion: 2.1 time: 0.101677 Oct 05 02:36:14.241600 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1036/2109] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:14 2022] GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd => generated 1454 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:14.475550 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dd91a4d3-4001-4bec-ba4e-0141c2ed06a9 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:14.476514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-dd91a4d3-4001-4bec-ba4e-0141c2ed06a9 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:14.487928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-22f386ec-0567-4e8d-aae8-ce655d73d8e8 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:14.507011 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-22f386ec-0567-4e8d-aae8-ce655d73d8e8 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98" status: 200 len: 1308 microversion: 2.1 time: 0.339338 Oct 05 02:36:14.523588 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1074/2110] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:14 2022] GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98 => generated 1308 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:14.524002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dd91a4d3-4001-4bec-ba4e-0141c2ed06a9 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:14.528044 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dd91a4d3-4001-4bec-ba4e-0141c2ed06a9 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:14.528791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dd91a4d3-4001-4bec-ba4e-0141c2ed06a9 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:14.530089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dd91a4d3-4001-4bec-ba4e-0141c2ed06a9 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:14.531370 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dd91a4d3-4001-4bec-ba4e-0141c2ed06a9 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:14.533531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dd91a4d3-4001-4bec-ba4e-0141c2ed06a9 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:14.758499 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-17c21e13-5969-492d-b6f7-e2a5186f9f7e req-98dc569e-1325-4433-bd86-131c30914fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b30cf01-6bc7-453f-b9f2-98400bcfc063", "name": "network-vif-unplugged", "status": "completed", "tag": "8d0c6b53-f679-4ee4-afb3-4a4e905d5489"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:14.759416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-dd91a4d3-4001-4bec-ba4e-0141c2ed06a9 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:14.771008 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-dd91a4d3-4001-4bec-ba4e-0141c2ed06a9 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 200 len: 1355 microversion: 2.1 time: 0.303047 Oct 05 02:36:14.773118 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1037/2111] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:14 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 1355 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:36:14.776184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-17c21e13-5969-492d-b6f7-e2a5186f9f7e req-98dc569e-1325-4433-bd86-131c30914fa5 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:14.776668 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-17c21e13-5969-492d-b6f7-e2a5186f9f7e req-98dc569e-1325-4433-bd86-131c30914fa5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:14.777328 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-17c21e13-5969-492d-b6f7-e2a5186f9f7e req-98dc569e-1325-4433-bd86-131c30914fa5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:14.790156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3e2e594e-8251-4933-9186-429b56a46792 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:14.793683 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3e2e594e-8251-4933-9186-429b56a46792 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:14.807270 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-17c21e13-5969-492d-b6f7-e2a5186f9f7e req-98dc569e-1325-4433-bd86-131c30914fa5 service nova] Creating event network-vif-unplugged:8d0c6b53-f679-4ee4-afb3-4a4e905d5489 for instance 7b30cf01-6bc7-453f-b9f2-98400bcfc063 on n-h2-858272-3 Oct 05 02:36:14.813354 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-17c21e13-5969-492d-b6f7-e2a5186f9f7e req-98dc569e-1325-4433-bd86-131c30914fa5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059071 Oct 05 02:36:14.814520 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1075/2112] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:36:14.814834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e2e594e-8251-4933-9186-429b56a46792 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:14.815343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e2e594e-8251-4933-9186-429b56a46792 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:14.815788 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e2e594e-8251-4933-9186-429b56a46792 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:14.816504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e2e594e-8251-4933-9186-429b56a46792 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:14.819238 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e2e594e-8251-4933-9186-429b56a46792 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:14.819679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e2e594e-8251-4933-9186-429b56a46792 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:15.015330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3e2e594e-8251-4933-9186-429b56a46792 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:15.023442 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3e2e594e-8251-4933-9186-429b56a46792 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1393 microversion: 2.1 time: 0.248969 Oct 05 02:36:15.024094 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1038/2113] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:14 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1393 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:15.165446 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8d070a80-bebd-414d-ac70-add98ee74ae2 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:15.167126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8d070a80-bebd-414d-ac70-add98ee74ae2 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: e3d6d4a6-f11c-4b42-9023-4729addcf3da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:15.174414 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d070a80-bebd-414d-ac70-add98ee74ae2 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:15.175151 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d070a80-bebd-414d-ac70-add98ee74ae2 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:15.175635 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d070a80-bebd-414d-ac70-add98ee74ae2 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:15.176985 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d070a80-bebd-414d-ac70-add98ee74ae2 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:15.177657 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d070a80-bebd-414d-ac70-add98ee74ae2 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:15.178266 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d070a80-bebd-414d-ac70-add98ee74ae2 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:15.191038 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b4f37b4f-4543-4593-a3ca-39e1eb43b495 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:15.191648 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b4f37b4f-4543-4593-a3ca-39e1eb43b495 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 6cf0945c-2ca2-4803-ab89-adf554c92c51] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:15.199139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:15.215119 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4f37b4f-4543-4593-a3ca-39e1eb43b495 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:15.215887 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4f37b4f-4543-4593-a3ca-39e1eb43b495 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:15.216469 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4f37b4f-4543-4593-a3ca-39e1eb43b495 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:15.221514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4f37b4f-4543-4593-a3ca-39e1eb43b495 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:15.221909 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4f37b4f-4543-4593-a3ca-39e1eb43b495 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:15.222449 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4f37b4f-4543-4593-a3ca-39e1eb43b495 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:15.314072 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8d070a80-bebd-414d-ac70-add98ee74ae2 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:15.323169 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8d070a80-bebd-414d-ac70-add98ee74ae2 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da" status: 200 len: 1217 microversion: 2.1 time: 0.162505 Oct 05 02:36:15.341662 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1076/2114] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:15 2022] GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da => generated 1217 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:15.351835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0a8fd536-97e3-4cb8-a1e7-61f3069c3373 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce80b01f0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:15.358625 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b4f37b4f-4543-4593-a3ca-39e1eb43b495 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:15.390888 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b4f37b4f-4543-4593-a3ca-39e1eb43b495 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51" status: 200 len: 1222 microversion: 2.1 time: 0.203083 Oct 05 02:36:15.394190 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1039/2115] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:15 2022] GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51 => generated 1222 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:15.433195 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0a8fd536-97e3-4cb8-a1e7-61f3069c3373 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd" status: 200 len: 1454 microversion: 2.1 time: 0.090120 Oct 05 02:36:15.433944 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1077/2116] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:15 2022] GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd => generated 1454 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:15.534691 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d7bc5ece-207d-479a-b98e-b05e7b84a700 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:15.535796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d7bc5ece-207d-479a-b98e-b05e7b84a700 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: e47438ff-463e-4a43-9767-8c78e8bb6e98] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:15.544915 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7bc5ece-207d-479a-b98e-b05e7b84a700 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:15.546128 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7bc5ece-207d-479a-b98e-b05e7b84a700 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:15.547041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7bc5ece-207d-479a-b98e-b05e7b84a700 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:15.549264 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7bc5ece-207d-479a-b98e-b05e7b84a700 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:15.549930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7bc5ece-207d-479a-b98e-b05e7b84a700 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:15.551084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7bc5ece-207d-479a-b98e-b05e7b84a700 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:15.700672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-83cb6b76-fc30-4189-96b8-bc3cdbc346df tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '.version_select at 0x7fcce80b0430>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:15.726901 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-83cb6b76-fc30-4189-96b8-bc3cdbc346df tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] HTTP exception thrown: Image not found. Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-83cb6b76-fc30-4189-96b8-bc3cdbc346df tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Request method failure captured: Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/images/2462b7e2-284c-4860-8c3c-a5330a031305 HTTP/1.1 Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO0XYeg8tqT8ongEAJOwqXQnTLTHZzTVGNp07qyK2Im6Pk37xE9_000kJ-ghGlg1M4xDfFZdh80YSHVWWaKUqSxFWQ_Csj3K04E3ui1EPC1OYFRpRVpFWUIW6dnDr0Kom0Z5CM2HBG5dMHahqKQPxztoTXPVRWZPXtn1QZY0a3PPLGY Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 47098be734b14277a4d9a9d6b8464998 Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_47098be734b14277a4d9a9d6b8464998"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 47098be734b14277a4d9a9d6b8464998 Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ImagesOneServerNegativeTestJSON-1772902756-project Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 4c441be8c87648bf9f1ff5cd4aff2532 Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756-project Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: exception: Image not found. Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '2462b7e2-284c-4860-8c3c-a5330a031305'} Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2462b7e2-284c-4860-8c3c-a5330a031305 to delete Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2462b7e2-284c-4860-8c3c-a5330a031305 could not be found. Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:15.730601 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:15.739235 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:15.739235 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:15.739235 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:15.739235 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:36:15.739235 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:36:15.739235 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:36:15.739235 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:36:15.739235 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:36:15.739235 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:36:15.739235 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 05 02:36:15.739235 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 05 02:36:15.739235 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 02:36:15.739235 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:15.739235 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:15.739235 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:15.739235 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:15.739235 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:15.739235 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:15.739235 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:36:15.739235 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:36:15.739235 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 02:36:15.739235 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:15.739235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-83cb6b76-fc30-4189-96b8-bc3cdbc346df tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Returning 404 to user: Image not found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:36:15.739235 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-83cb6b76-fc30-4189-96b8-bc3cdbc346df tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "DELETE /compute/v2.1/images/2462b7e2-284c-4860-8c3c-a5330a031305" status: 404 len: 62 microversion: 2.1 time: 0.036733 Oct 05 02:36:15.739235 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1078/2117] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:15 2022] DELETE /compute/v2.1/images/2462b7e2-284c-4860-8c3c-a5330a031305 => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:36:15.743040 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f604d752-e966-4feb-ac08-68ef0d0e1ce4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:15.743546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f604d752-e966-4feb-ac08-68ef0d0e1ce4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:15.752342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f604d752-e966-4feb-ac08-68ef0d0e1ce4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:15.752975 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f604d752-e966-4feb-ac08-68ef0d0e1ce4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:15.753490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f604d752-e966-4feb-ac08-68ef0d0e1ce4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:15.754445 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f604d752-e966-4feb-ac08-68ef0d0e1ce4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:15.755049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f604d752-e966-4feb-ac08-68ef0d0e1ce4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:15.755707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f604d752-e966-4feb-ac08-68ef0d0e1ce4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:15.762508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d7bc5ece-207d-479a-b98e-b05e7b84a700 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:15.772251 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d7bc5ece-207d-479a-b98e-b05e7b84a700 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98" status: 200 len: 1308 microversion: 2.1 time: 0.241382 Oct 05 02:36:15.773124 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-f604d752-e966-4feb-ac08-68ef0d0e1ce4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] HTTP exception thrown: Instance ed8c63c7-f728-4202-94b9-1b4a00fac776 could not be found. Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f604d752-e966-4feb-ac08-68ef0d0e1ce4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Request method failure captured: Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776 HTTP/1.1 Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO0XYeg8tqT8ongEAJOwqXQnTLTHZzTVGNp07qyK2Im6Pk37xE9_000kJ-ghGlg1M4xDfFZdh80YSHVWWaKUqSxFWQ_Csj3K04E3ui1EPC1OYFRpRVpFWUIW6dnDr0Kom0Z5CM2HBG5dMHahqKQPxztoTXPVRWZPXtn1QZY0a3PPLGY Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 47098be734b14277a4d9a9d6b8464998 Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_47098be734b14277a4d9a9d6b8464998"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 47098be734b14277a4d9a9d6b8464998 Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ImagesOneServerNegativeTestJSON-1772902756-project Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 4c441be8c87648bf9f1ff5cd4aff2532 Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756-project Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance ed8c63c7-f728-4202-94b9-1b4a00fac776 could not be found. Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'ed8c63c7-f728-4202-94b9-1b4a00fac776'} Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed8c63c7-f728-4202-94b9-1b4a00fac776 could not be found. Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:36:15.775036 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:36:15.782952 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed8c63c7-f728-4202-94b9-1b4a00fac776 could not be found. Oct 05 02:36:15.782952 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:15.782952 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:15.782952 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:15.782952 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:15.782952 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:15.782952 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:15.782952 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:36:15.782952 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:36:15.782952 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed8c63c7-f728-4202-94b9-1b4a00fac776 could not be found. Oct 05 02:36:15.782952 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:15.782952 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f604d752-e966-4feb-ac08-68ef0d0e1ce4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Returning 404 to user: Instance ed8c63c7-f728-4202-94b9-1b4a00fac776 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:36:15.782952 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f604d752-e966-4feb-ac08-68ef0d0e1ce4 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776" status: 404 len: 111 microversion: 2.1 time: 0.040254 Oct 05 02:36:15.782952 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1079/2119] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:36:15 2022] DELETE /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:36:15.786021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d71f0d01-5faa-485d-84d3-87467b66e386 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:15.786641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d71f0d01-5faa-485d-84d3-87467b66e386 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] [instance: ed8c63c7-f728-4202-94b9-1b4a00fac776] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:15.788198 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1040/2119] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:15 2022] GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98 => generated 1308 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:15.795267 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d71f0d01-5faa-485d-84d3-87467b66e386 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:15.796156 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d71f0d01-5faa-485d-84d3-87467b66e386 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:15.796675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d71f0d01-5faa-485d-84d3-87467b66e386 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:15.797499 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d71f0d01-5faa-485d-84d3-87467b66e386 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:15.798249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d71f0d01-5faa-485d-84d3-87467b66e386 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:15.798611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b02163f9-dec9-4553-b662-b1d1515fed4d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:15.798804 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d71f0d01-5faa-485d-84d3-87467b66e386 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:15.799247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b02163f9-dec9-4553-b662-b1d1515fed4d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:15.807448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b02163f9-dec9-4553-b662-b1d1515fed4d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:15.808078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b02163f9-dec9-4553-b662-b1d1515fed4d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:15.808559 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b02163f9-dec9-4553-b662-b1d1515fed4d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:15.809302 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b02163f9-dec9-4553-b662-b1d1515fed4d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:15.809767 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b02163f9-dec9-4553-b662-b1d1515fed4d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:15.810201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b02163f9-dec9-4553-b662-b1d1515fed4d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:15.814995 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-d71f0d01-5faa-485d-84d3-87467b66e386 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] HTTP exception thrown: Instance ed8c63c7-f728-4202-94b9-1b4a00fac776 could not be found. Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d71f0d01-5faa-485d-84d3-87467b66e386 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Request method failure captured: Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776 HTTP/1.1 Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO0XYeg8tqT8ongEAJOwqXQnTLTHZzTVGNp07qyK2Im6Pk37xE9_000kJ-ghGlg1M4xDfFZdh80YSHVWWaKUqSxFWQ_Csj3K04E3ui1EPC1OYFRpRVpFWUIW6dnDr0Kom0Z5CM2HBG5dMHahqKQPxztoTXPVRWZPXtn1QZY0a3PPLGY Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 47098be734b14277a4d9a9d6b8464998 Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/47098be734b14277a4d9a9d6b8464998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_47098be734b14277a4d9a9d6b8464998"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 47098be734b14277a4d9a9d6b8464998 Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756 Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ImagesOneServerNegativeTestJSON-1772902756-project Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 4c441be8c87648bf9f1ff5cd4aff2532 Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1772902756-project Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance ed8c63c7-f728-4202-94b9-1b4a00fac776 could not be found. Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'ed8c63c7-f728-4202-94b9-1b4a00fac776'} Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed8c63c7-f728-4202-94b9-1b4a00fac776 could not be found. Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed8c63c7-f728-4202-94b9-1b4a00fac776 could not be found. Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:15.817184 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:15.821491 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:15.821491 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:15.821491 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:15.821491 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:15.821491 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:36:15.821491 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:36:15.821491 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed8c63c7-f728-4202-94b9-1b4a00fac776 could not be found. Oct 05 02:36:15.821491 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:15.821491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d71f0d01-5faa-485d-84d3-87467b66e386 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] Returning 404 to user: Instance ed8c63c7-f728-4202-94b9-1b4a00fac776 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:36:15.821491 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d71f0d01-5faa-485d-84d3-87467b66e386 tempest-ImagesOneServerNegativeTestJSON-1772902756 tempest-ImagesOneServerNegativeTestJSON-1772902756-project] 10.222.0.16 "GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776" status: 404 len: 111 microversion: 2.1 time: 0.038172 Oct 05 02:36:15.823701 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1080/2120] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:15 2022] GET /compute/v2.1/servers/ed8c63c7-f728-4202-94b9-1b4a00fac776 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:36:15.974055 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-e1eaa05c-9de1-48bb-a3f0-e8887635c6fa req-cb1ea9e2-80a8-4345-8a55-7bccf4ae8800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d0e63ee-ba8d-4203-9cd5-f13d833de668", "tag": "bcf2876a-f110-4231-b6e1-99589b34eab3"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:15.994697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e1eaa05c-9de1-48bb-a3f0-e8887635c6fa req-cb1ea9e2-80a8-4345-8a55-7bccf4ae8800 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:15.995592 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e1eaa05c-9de1-48bb-a3f0-e8887635c6fa req-cb1ea9e2-80a8-4345-8a55-7bccf4ae8800 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:15.996028 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e1eaa05c-9de1-48bb-a3f0-e8887635c6fa req-cb1ea9e2-80a8-4345-8a55-7bccf4ae8800 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:16.008696 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-e1eaa05c-9de1-48bb-a3f0-e8887635c6fa req-cb1ea9e2-80a8-4345-8a55-7bccf4ae8800 service nova] Creating event network-changed:bcf2876a-f110-4231-b6e1-99589b34eab3 for instance 1d0e63ee-ba8d-4203-9cd5-f13d833de668 on n-h2-858272-3 Oct 05 02:36:16.015484 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-e1eaa05c-9de1-48bb-a3f0-e8887635c6fa req-cb1ea9e2-80a8-4345-8a55-7bccf4ae8800 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052565 Oct 05 02:36:16.016237 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1081/2121] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:36:16.052374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-10d1ec96-03f1-4932-a435-c20d788e8bf5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:16.054921 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-10d1ec96-03f1-4932-a435-c20d788e8bf5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:16.079632 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10d1ec96-03f1-4932-a435-c20d788e8bf5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:16.080407 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10d1ec96-03f1-4932-a435-c20d788e8bf5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:16.081186 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10d1ec96-03f1-4932-a435-c20d788e8bf5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:16.082179 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10d1ec96-03f1-4932-a435-c20d788e8bf5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:16.082791 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10d1ec96-03f1-4932-a435-c20d788e8bf5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:16.084737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10d1ec96-03f1-4932-a435-c20d788e8bf5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:16.552408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b02163f9-dec9-4553-b662-b1d1515fed4d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:16.562362 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b02163f9-dec9-4553-b662-b1d1515fed4d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 200 len: 1355 microversion: 2.1 time: 0.767933 Oct 05 02:36:16.573872 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1041/2122] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:15 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 1355 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:36:16.586778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f9cfa77c-496c-4884-bb03-862d404115b1 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:16.587623 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f9cfa77c-496c-4884-bb03-862d404115b1 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: e3d6d4a6-f11c-4b42-9023-4729addcf3da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:16.594344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9cfa77c-496c-4884-bb03-862d404115b1 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:16.595043 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9cfa77c-496c-4884-bb03-862d404115b1 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:16.595679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9cfa77c-496c-4884-bb03-862d404115b1 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:16.596532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9cfa77c-496c-4884-bb03-862d404115b1 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:16.597202 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9cfa77c-496c-4884-bb03-862d404115b1 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:16.597818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9cfa77c-496c-4884-bb03-862d404115b1 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:16.815588 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f9cfa77c-496c-4884-bb03-862d404115b1 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:16.817810 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:16.825323 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f9cfa77c-496c-4884-bb03-862d404115b1 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da" status: 200 len: 1279 microversion: 2.1 time: 0.250099 Oct 05 02:36:16.825917 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1042/2123] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:16 2022] GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da => generated 1279 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:16.830419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9da73187-5c8c-409a-bc30-bb8340bbd5e3 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:16.831048 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9da73187-5c8c-409a-bc30-bb8340bbd5e3 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 6cf0945c-2ca2-4803-ab89-adf554c92c51] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:16.837051 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9da73187-5c8c-409a-bc30-bb8340bbd5e3 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:16.837530 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9da73187-5c8c-409a-bc30-bb8340bbd5e3 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:16.838732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9da73187-5c8c-409a-bc30-bb8340bbd5e3 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:16.839420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9da73187-5c8c-409a-bc30-bb8340bbd5e3 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:16.840037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9da73187-5c8c-409a-bc30-bb8340bbd5e3 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:16.840465 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9da73187-5c8c-409a-bc30-bb8340bbd5e3 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:17.026129 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-10d1ec96-03f1-4932-a435-c20d788e8bf5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:17.029928 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9da73187-5c8c-409a-bc30-bb8340bbd5e3 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:17.037316 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-10d1ec96-03f1-4932-a435-c20d788e8bf5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1393 microversion: 2.1 time: 0.991346 Oct 05 02:36:17.039702 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9da73187-5c8c-409a-bc30-bb8340bbd5e3 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51" status: 200 len: 1270 microversion: 2.1 time: 0.212170 Oct 05 02:36:17.056566 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1043/2124] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:16 2022] GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51 => generated 1270 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:17.062336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7d14da0e-b21b-47bb-9a23-a900522ff70f tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf6103a0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:17.063278 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1082/2125] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:16 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1393 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:36:17.071235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cbc2067a-73c6-4c83-9475-2d802783bf98 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:17.071381 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cbc2067a-73c6-4c83-9475-2d802783bf98 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: e47438ff-463e-4a43-9767-8c78e8bb6e98] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:17.086767 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbc2067a-73c6-4c83-9475-2d802783bf98 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:17.087616 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbc2067a-73c6-4c83-9475-2d802783bf98 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:17.088998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbc2067a-73c6-4c83-9475-2d802783bf98 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:17.089911 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbc2067a-73c6-4c83-9475-2d802783bf98 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:17.090577 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbc2067a-73c6-4c83-9475-2d802783bf98 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:17.091194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbc2067a-73c6-4c83-9475-2d802783bf98 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:17.117720 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7d14da0e-b21b-47bb-9a23-a900522ff70f tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd" status: 200 len: 1454 microversion: 2.1 time: 0.059599 Oct 05 02:36:17.118723 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1044/2126] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:17 2022] GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd => generated 1454 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:17.588237 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-84b4aa8d-5b09-42ed-9a9a-0f80b989055d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:17.588995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-84b4aa8d-5b09-42ed-9a9a-0f80b989055d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:17.595017 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84b4aa8d-5b09-42ed-9a9a-0f80b989055d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:17.595501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84b4aa8d-5b09-42ed-9a9a-0f80b989055d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:17.595938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84b4aa8d-5b09-42ed-9a9a-0f80b989055d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:17.596657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84b4aa8d-5b09-42ed-9a9a-0f80b989055d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:17.597132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84b4aa8d-5b09-42ed-9a9a-0f80b989055d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:17.597556 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84b4aa8d-5b09-42ed-9a9a-0f80b989055d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:17.694532 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cbc2067a-73c6-4c83-9475-2d802783bf98 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:17.703926 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cbc2067a-73c6-4c83-9475-2d802783bf98 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98" status: 200 len: 1308 microversion: 2.1 time: 0.639336 Oct 05 02:36:17.704637 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1083/2127] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:17 2022] GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98 => generated 1308 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:17.850572 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7bee04bc-d479-4a0b-91ac-ca6256352693 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:17.851421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7bee04bc-d479-4a0b-91ac-ca6256352693 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: e3d6d4a6-f11c-4b42-9023-4729addcf3da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:17.858749 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7bee04bc-d479-4a0b-91ac-ca6256352693 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:17.859322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7bee04bc-d479-4a0b-91ac-ca6256352693 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:17.859831 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7bee04bc-d479-4a0b-91ac-ca6256352693 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:17.860648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7bee04bc-d479-4a0b-91ac-ca6256352693 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:17.861203 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7bee04bc-d479-4a0b-91ac-ca6256352693 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:17.862012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7bee04bc-d479-4a0b-91ac-ca6256352693 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:18.047518 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7bee04bc-d479-4a0b-91ac-ca6256352693 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:18.055525 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7bee04bc-d479-4a0b-91ac-ca6256352693 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da" status: 200 len: 1279 microversion: 2.1 time: 0.209034 Oct 05 02:36:18.068923 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1084/2128] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:17 2022] GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da => generated 1279 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:36:18.068923 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-87c9c5b3-fe01-4ad7-85fd-8ef65c7e2cba req-a8025ff8-2407-41b8-9eaa-e35c1a68d0a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d0e63ee-ba8d-4203-9cd5-f13d833de668", "tag": "1f6198cb-46e6-468f-99fa-33f57b082af5"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:18.073032 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-87c9c5b3-fe01-4ad7-85fd-8ef65c7e2cba req-a8025ff8-2407-41b8-9eaa-e35c1a68d0a3 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:18.073519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-87c9c5b3-fe01-4ad7-85fd-8ef65c7e2cba req-a8025ff8-2407-41b8-9eaa-e35c1a68d0a3 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:18.073954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-87c9c5b3-fe01-4ad7-85fd-8ef65c7e2cba req-a8025ff8-2407-41b8-9eaa-e35c1a68d0a3 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:18.085100 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-87c9c5b3-fe01-4ad7-85fd-8ef65c7e2cba req-a8025ff8-2407-41b8-9eaa-e35c1a68d0a3 service nova] Creating event network-changed:1f6198cb-46e6-468f-99fa-33f57b082af5 for instance 1d0e63ee-ba8d-4203-9cd5-f13d833de668 on n-h2-858272-3 Oct 05 02:36:18.090995 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-87c9c5b3-fe01-4ad7-85fd-8ef65c7e2cba req-a8025ff8-2407-41b8-9eaa-e35c1a68d0a3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033110 Oct 05 02:36:18.091594 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1085/2129] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:18.096662 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c7a8fadf-bc6b-41e0-9e9b-98c6c7c5b5e4 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:18.097386 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c7a8fadf-bc6b-41e0-9e9b-98c6c7c5b5e4 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 6cf0945c-2ca2-4803-ab89-adf554c92c51] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:18.103484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7a8fadf-bc6b-41e0-9e9b-98c6c7c5b5e4 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:18.104599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7a8fadf-bc6b-41e0-9e9b-98c6c7c5b5e4 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:18.105196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7a8fadf-bc6b-41e0-9e9b-98c6c7c5b5e4 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:18.105916 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7a8fadf-bc6b-41e0-9e9b-98c6c7c5b5e4 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:18.106643 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7a8fadf-bc6b-41e0-9e9b-98c6c7c5b5e4 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:18.107077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7a8fadf-bc6b-41e0-9e9b-98c6c7c5b5e4 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:18.157878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-84b4aa8d-5b09-42ed-9a9a-0f80b989055d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:18.165560 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-84b4aa8d-5b09-42ed-9a9a-0f80b989055d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 200 len: 1355 microversion: 2.1 time: 0.581238 Oct 05 02:36:18.167064 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1045/2130] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:17 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 1355 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:36:18.172131 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-58e7f2e8-b3cb-4231-80ee-b0936fc0bce5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:18.172812 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-58e7f2e8-b3cb-4231-80ee-b0936fc0bce5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:18.178759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58e7f2e8-b3cb-4231-80ee-b0936fc0bce5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:18.179476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58e7f2e8-b3cb-4231-80ee-b0936fc0bce5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:18.179917 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58e7f2e8-b3cb-4231-80ee-b0936fc0bce5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:18.180608 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58e7f2e8-b3cb-4231-80ee-b0936fc0bce5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:18.181295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58e7f2e8-b3cb-4231-80ee-b0936fc0bce5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:18.181912 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58e7f2e8-b3cb-4231-80ee-b0936fc0bce5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:18.248020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c7a8fadf-bc6b-41e0-9e9b-98c6c7c5b5e4 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:18.257470 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c7a8fadf-bc6b-41e0-9e9b-98c6c7c5b5e4 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51" status: 200 len: 1276 microversion: 2.1 time: 0.164638 Oct 05 02:36:18.258209 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1086/2131] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:18 2022] GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51 => generated 1276 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:18.264506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d52a6b74-95f9-4ce5-b02d-b603c084d6d8 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce80b0040>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:18.314166 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d52a6b74-95f9-4ce5-b02d-b603c084d6d8 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd" status: 200 len: 1454 microversion: 2.1 time: 0.054552 Oct 05 02:36:18.315101 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1087/2132] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:18 2022] GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd => generated 1454 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:18.696995 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-d767710a-acc0-455d-99a8-f1f36b4b29f0 req-23549963-cc83-4562-802c-e3df2dd05cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e47438ff-463e-4a43-9767-8c78e8bb6e98", "name": "network-vif-plugged", "status": "completed", "tag": "d17e6d68-21a3-4fc2-9ded-814bf288d29c"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:18.713846 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d767710a-acc0-455d-99a8-f1f36b4b29f0 req-23549963-cc83-4562-802c-e3df2dd05cc6 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:18.714677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d767710a-acc0-455d-99a8-f1f36b4b29f0 req-23549963-cc83-4562-802c-e3df2dd05cc6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:18.715390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d767710a-acc0-455d-99a8-f1f36b4b29f0 req-23549963-cc83-4562-802c-e3df2dd05cc6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:18.729557 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-d767710a-acc0-455d-99a8-f1f36b4b29f0 req-23549963-cc83-4562-802c-e3df2dd05cc6 service nova] Creating event network-vif-plugged:d17e6d68-21a3-4fc2-9ded-814bf288d29c for instance e47438ff-463e-4a43-9767-8c78e8bb6e98 on n-h1-858272-3 Oct 05 02:36:18.736266 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-d767710a-acc0-455d-99a8-f1f36b4b29f0 req-23549963-cc83-4562-802c-e3df2dd05cc6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043365 Oct 05 02:36:18.737920 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1088/2133] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:18.743573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4ecc90de-3980-456e-91c5-f98f94550559 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:18.745090 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4ecc90de-3980-456e-91c5-f98f94550559 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: e47438ff-463e-4a43-9767-8c78e8bb6e98] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:18.753039 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ecc90de-3980-456e-91c5-f98f94550559 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:18.753597 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ecc90de-3980-456e-91c5-f98f94550559 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:18.754174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ecc90de-3980-456e-91c5-f98f94550559 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:18.754980 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ecc90de-3980-456e-91c5-f98f94550559 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:18.755537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ecc90de-3980-456e-91c5-f98f94550559 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:18.756069 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ecc90de-3980-456e-91c5-f98f94550559 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:18.990539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-58e7f2e8-b3cb-4231-80ee-b0936fc0bce5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:18.998667 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-58e7f2e8-b3cb-4231-80ee-b0936fc0bce5 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1393 microversion: 2.1 time: 0.830359 Oct 05 02:36:18.999367 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1046/2134] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:18 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1393 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:19.080798 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4a0ca7b5-c083-4e40-a28b-4952154c7fa4 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:19.082324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4a0ca7b5-c083-4e40-a28b-4952154c7fa4 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: e3d6d4a6-f11c-4b42-9023-4729addcf3da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:19.090139 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a0ca7b5-c083-4e40-a28b-4952154c7fa4 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:19.090847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a0ca7b5-c083-4e40-a28b-4952154c7fa4 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:19.091449 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a0ca7b5-c083-4e40-a28b-4952154c7fa4 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:19.092337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a0ca7b5-c083-4e40-a28b-4952154c7fa4 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:19.094003 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a0ca7b5-c083-4e40-a28b-4952154c7fa4 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:19.094642 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a0ca7b5-c083-4e40-a28b-4952154c7fa4 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:19.258108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4a0ca7b5-c083-4e40-a28b-4952154c7fa4 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:19.267818 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4a0ca7b5-c083-4e40-a28b-4952154c7fa4 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da" status: 200 len: 1279 microversion: 2.1 time: 0.191752 Oct 05 02:36:19.268729 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1047/2135] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:19 2022] GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da => generated 1279 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:36:19.273759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6871e5bc-6c90-4ff9-b422-af13202187b8 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:19.274567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6871e5bc-6c90-4ff9-b422-af13202187b8 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:19.283570 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6871e5bc-6c90-4ff9-b422-af13202187b8 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:19.284236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6871e5bc-6c90-4ff9-b422-af13202187b8 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:19.284841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6871e5bc-6c90-4ff9-b422-af13202187b8 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:19.285730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6871e5bc-6c90-4ff9-b422-af13202187b8 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:19.286321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6871e5bc-6c90-4ff9-b422-af13202187b8 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:19.286883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6871e5bc-6c90-4ff9-b422-af13202187b8 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:19.378944 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4ecc90de-3980-456e-91c5-f98f94550559 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:19.388044 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4ecc90de-3980-456e-91c5-f98f94550559 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98" status: 200 len: 1308 microversion: 2.1 time: 0.648715 Oct 05 02:36:19.388626 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1089/2136] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:18 2022] GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98 => generated 1308 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:19.393355 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0837f9e3-615d-43b7-b1c3-53ae2b7f5643 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:19.393975 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0837f9e3-615d-43b7-b1c3-53ae2b7f5643 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 6cf0945c-2ca2-4803-ab89-adf554c92c51] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:19.399745 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0837f9e3-615d-43b7-b1c3-53ae2b7f5643 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:19.400996 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0837f9e3-615d-43b7-b1c3-53ae2b7f5643 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:19.401616 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0837f9e3-615d-43b7-b1c3-53ae2b7f5643 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:19.402463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0837f9e3-615d-43b7-b1c3-53ae2b7f5643 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:19.403071 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0837f9e3-615d-43b7-b1c3-53ae2b7f5643 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:19.403664 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0837f9e3-615d-43b7-b1c3-53ae2b7f5643 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:19.625528 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0837f9e3-615d-43b7-b1c3-53ae2b7f5643 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:19.633530 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0837f9e3-615d-43b7-b1c3-53ae2b7f5643 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51" status: 200 len: 1276 microversion: 2.1 time: 0.243694 Oct 05 02:36:19.634106 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1090/2137] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:19 2022] GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51 => generated 1276 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:19.640531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3f5ff81b-4c8f-4398-b381-a8ba6cd8c651 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf76a430>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:19.707525 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3f5ff81b-4c8f-4398-b381-a8ba6cd8c651 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd" status: 200 len: 1454 microversion: 2.1 time: 0.070868 Oct 05 02:36:19.708194 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1091/2138] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:19 2022] GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd => generated 1454 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:19.883305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6871e5bc-6c90-4ff9-b422-af13202187b8 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:19.892661 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6871e5bc-6c90-4ff9-b422-af13202187b8 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 200 len: 1355 microversion: 2.1 time: 0.622672 Oct 05 02:36:19.893570 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1048/2139] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:19 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 1355 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:20.022561 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e7c450b9-4f44-403e-a0a3-3c9901147984 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:20.023344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e7c450b9-4f44-403e-a0a3-3c9901147984 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:20.030722 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7c450b9-4f44-403e-a0a3-3c9901147984 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:20.031216 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7c450b9-4f44-403e-a0a3-3c9901147984 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:20.031653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7c450b9-4f44-403e-a0a3-3c9901147984 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:20.032356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7c450b9-4f44-403e-a0a3-3c9901147984 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:20.032818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7c450b9-4f44-403e-a0a3-3c9901147984 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:20.033364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7c450b9-4f44-403e-a0a3-3c9901147984 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:20.298288 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c56bb1ea-6fc4-4dc3-8d54-a44b07a8bef5 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:20.300415 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c56bb1ea-6fc4-4dc3-8d54-a44b07a8bef5 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: e3d6d4a6-f11c-4b42-9023-4729addcf3da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:20.308969 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c56bb1ea-6fc4-4dc3-8d54-a44b07a8bef5 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:20.309745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c56bb1ea-6fc4-4dc3-8d54-a44b07a8bef5 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:20.310392 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c56bb1ea-6fc4-4dc3-8d54-a44b07a8bef5 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:20.311260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c56bb1ea-6fc4-4dc3-8d54-a44b07a8bef5 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:20.312004 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c56bb1ea-6fc4-4dc3-8d54-a44b07a8bef5 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:20.312626 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c56bb1ea-6fc4-4dc3-8d54-a44b07a8bef5 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:20.670716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e7c450b9-4f44-403e-a0a3-3c9901147984 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:20.680187 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e7c450b9-4f44-403e-a0a3-3c9901147984 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1393 microversion: 2.1 time: 0.661693 Oct 05 02:36:20.699903 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1092/2140] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:20 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1393 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:20.705157 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-aceaa5c3-e0ca-4fce-ab65-7d2720780c0a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:20.705786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-aceaa5c3-e0ca-4fce-ab65-7d2720780c0a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: e47438ff-463e-4a43-9767-8c78e8bb6e98] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:20.715578 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aceaa5c3-e0ca-4fce-ab65-7d2720780c0a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:20.716358 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aceaa5c3-e0ca-4fce-ab65-7d2720780c0a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:20.717585 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aceaa5c3-e0ca-4fce-ab65-7d2720780c0a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:20.718878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aceaa5c3-e0ca-4fce-ab65-7d2720780c0a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:20.719571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aceaa5c3-e0ca-4fce-ab65-7d2720780c0a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:20.720231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aceaa5c3-e0ca-4fce-ab65-7d2720780c0a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:21.138965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c56bb1ea-6fc4-4dc3-8d54-a44b07a8bef5 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:21.149562 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c56bb1ea-6fc4-4dc3-8d54-a44b07a8bef5 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da" status: 200 len: 1321 microversion: 2.1 time: 0.857174 Oct 05 02:36:21.151132 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1049/2141] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:20 2022] GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da => generated 1321 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:36:21.161370 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8177d896-3692-42c1-818e-13046d61db22 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:21.162279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8177d896-3692-42c1-818e-13046d61db22 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 6cf0945c-2ca2-4803-ab89-adf554c92c51] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:21.170541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8177d896-3692-42c1-818e-13046d61db22 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:21.171566 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8177d896-3692-42c1-818e-13046d61db22 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:21.172231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8177d896-3692-42c1-818e-13046d61db22 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:21.173201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8177d896-3692-42c1-818e-13046d61db22 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:21.173844 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8177d896-3692-42c1-818e-13046d61db22 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:21.174269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8177d896-3692-42c1-818e-13046d61db22 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:21.641052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-aceaa5c3-e0ca-4fce-ab65-7d2720780c0a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:21.649192 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-aceaa5c3-e0ca-4fce-ab65-7d2720780c0a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98" status: 200 len: 1308 microversion: 2.1 time: 0.947752 Oct 05 02:36:21.649974 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1093/2142] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:20 2022] GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98 => generated 1308 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:21.655049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-12c41ca8-b698-431c-81f4-b32b5ba52143 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce8097b80>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:21.715022 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-12c41ca8-b698-431c-81f4-b32b5ba52143 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd" status: 200 len: 1454 microversion: 2.1 time: 0.063753 Oct 05 02:36:21.715914 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1094/2143] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:21 2022] GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd => generated 1454 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:21.721291 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b028ddb6-93e7-445e-a453-66536008494e tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:21.721912 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b028ddb6-93e7-445e-a453-66536008494e tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:21.729158 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b028ddb6-93e7-445e-a453-66536008494e tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:21.729908 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b028ddb6-93e7-445e-a453-66536008494e tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:21.730487 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b028ddb6-93e7-445e-a453-66536008494e tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:21.731645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b028ddb6-93e7-445e-a453-66536008494e tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:21.732259 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b028ddb6-93e7-445e-a453-66536008494e tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:21.732839 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b028ddb6-93e7-445e-a453-66536008494e tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:22.024007 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8177d896-3692-42c1-818e-13046d61db22 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:22.032828 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8177d896-3692-42c1-818e-13046d61db22 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51" status: 200 len: 1318 microversion: 2.1 time: 0.879929 Oct 05 02:36:22.033654 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1050/2144] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:21 2022] GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51 => generated 1318 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:22.038369 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2e57f8a9-0601-43e9-ba51-fcfbdbb18417 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:22.039206 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2e57f8a9-0601-43e9-ba51-fcfbdbb18417 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:22.054133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e57f8a9-0601-43e9-ba51-fcfbdbb18417 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:22.054801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e57f8a9-0601-43e9-ba51-fcfbdbb18417 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:22.055243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e57f8a9-0601-43e9-ba51-fcfbdbb18417 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:22.055945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e57f8a9-0601-43e9-ba51-fcfbdbb18417 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:22.056431 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e57f8a9-0601-43e9-ba51-fcfbdbb18417 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:22.056854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e57f8a9-0601-43e9-ba51-fcfbdbb18417 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:22.450540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b028ddb6-93e7-445e-a453-66536008494e tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:22.458899 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b028ddb6-93e7-445e-a453-66536008494e tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 200 len: 1355 microversion: 2.1 time: 0.741966 Oct 05 02:36:22.459478 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1095/2145] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:21 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 1355 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:22.476684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-12b639af-e8f3-41bb-b687-d99c7223ea5d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:22.477363 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-12b639af-e8f3-41bb-b687-d99c7223ea5d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: e3d6d4a6-f11c-4b42-9023-4729addcf3da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:22.484261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12b639af-e8f3-41bb-b687-d99c7223ea5d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:22.484786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12b639af-e8f3-41bb-b687-d99c7223ea5d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:22.485268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12b639af-e8f3-41bb-b687-d99c7223ea5d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:22.485972 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12b639af-e8f3-41bb-b687-d99c7223ea5d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:22.486431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12b639af-e8f3-41bb-b687-d99c7223ea5d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:22.486869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12b639af-e8f3-41bb-b687-d99c7223ea5d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:22.754228 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2e57f8a9-0601-43e9-ba51-fcfbdbb18417 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:22.773535 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2e57f8a9-0601-43e9-ba51-fcfbdbb18417 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1393 microversion: 2.1 time: 0.738144 Oct 05 02:36:22.774965 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1051/2146] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:22 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1393 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:22.783818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9c04b7f0-9158-4f43-b113-6af92d5a5ac0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:22.785199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9c04b7f0-9158-4f43-b113-6af92d5a5ac0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: e47438ff-463e-4a43-9767-8c78e8bb6e98] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:22.804435 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c04b7f0-9158-4f43-b113-6af92d5a5ac0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:22.805335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c04b7f0-9158-4f43-b113-6af92d5a5ac0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:22.805855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c04b7f0-9158-4f43-b113-6af92d5a5ac0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:22.808328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c04b7f0-9158-4f43-b113-6af92d5a5ac0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:22.818110 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c04b7f0-9158-4f43-b113-6af92d5a5ac0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:22.818789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c04b7f0-9158-4f43-b113-6af92d5a5ac0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:23.062759 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-12b639af-e8f3-41bb-b687-d99c7223ea5d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:23.070780 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-12b639af-e8f3-41bb-b687-d99c7223ea5d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da" status: 200 len: 1321 microversion: 2.1 time: 0.610275 Oct 05 02:36:23.071623 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1096/2147] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:22 2022] GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da => generated 1321 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:23.071623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-12a7935c-20c7-4a52-ab4e-3c86893196ed req-6b78464c-318c-4af2-806b-b282b785eac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e123bb72-45c5-4371-bf2e-f0747497f16b", "name": "network-vif-plugged", "status": "completed", "tag": "05da60d7-1d7e-4607-a912-92561fc99617"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:23.093339 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-12a7935c-20c7-4a52-ab4e-3c86893196ed req-6b78464c-318c-4af2-806b-b282b785eac1 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:23.093837 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-12a7935c-20c7-4a52-ab4e-3c86893196ed req-6b78464c-318c-4af2-806b-b282b785eac1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:23.094398 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-12a7935c-20c7-4a52-ab4e-3c86893196ed req-6b78464c-318c-4af2-806b-b282b785eac1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:23.108358 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-12a7935c-20c7-4a52-ab4e-3c86893196ed req-6b78464c-318c-4af2-806b-b282b785eac1 service nova] Creating event network-vif-plugged:05da60d7-1d7e-4607-a912-92561fc99617 for instance e123bb72-45c5-4371-bf2e-f0747497f16b on n-h1-858272-3 Oct 05 02:36:23.113251 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-12a7935c-20c7-4a52-ab4e-3c86893196ed req-6b78464c-318c-4af2-806b-b282b785eac1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040049 Oct 05 02:36:23.113862 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1097/2148] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:23.118803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-892bbc51-1923-4b60-911d-418c2d7ffbfe tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce8106ee0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:23.171592 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-892bbc51-1923-4b60-911d-418c2d7ffbfe tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd" status: 200 len: 1454 microversion: 2.1 time: 0.056513 Oct 05 02:36:23.172479 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1098/2149] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:23 2022] GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd => generated 1454 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:23.178402 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a79138df-183f-4d91-86cf-9bbfcf49783f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:23.179231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a79138df-183f-4d91-86cf-9bbfcf49783f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 6cf0945c-2ca2-4803-ab89-adf554c92c51] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:23.187968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a79138df-183f-4d91-86cf-9bbfcf49783f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:23.188551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a79138df-183f-4d91-86cf-9bbfcf49783f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:23.189110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a79138df-183f-4d91-86cf-9bbfcf49783f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:23.189984 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a79138df-183f-4d91-86cf-9bbfcf49783f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:23.190442 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a79138df-183f-4d91-86cf-9bbfcf49783f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:23.190864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a79138df-183f-4d91-86cf-9bbfcf49783f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:23.411067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9c04b7f0-9158-4f43-b113-6af92d5a5ac0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:23.427365 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9c04b7f0-9158-4f43-b113-6af92d5a5ac0 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98" status: 200 len: 1488 microversion: 2.1 time: 0.650376 Oct 05 02:36:23.431598 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1052/2150] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:22 2022] GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98 => generated 1488 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:23.468282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9c45df2c-e844-4ae8-8157-e0504966bed6 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1367364514"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:23.471429 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9c45df2c-e844-4ae8-8157-e0504966bed6 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: e47438ff-463e-4a43-9767-8c78e8bb6e98] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:23.480687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c45df2c-e844-4ae8-8157-e0504966bed6 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:23.481777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c45df2c-e844-4ae8-8157-e0504966bed6 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:23.482480 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c45df2c-e844-4ae8-8157-e0504966bed6 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:23.483409 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c45df2c-e844-4ae8-8157-e0504966bed6 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:23.484067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c45df2c-e844-4ae8-8157-e0504966bed6 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:23.484749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c45df2c-e844-4ae8-8157-e0504966bed6 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:23.827730 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9c45df2c-e844-4ae8-8157-e0504966bed6 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "POST /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98/action" status: 202 len: 0 microversion: 2.1 time: 0.367512 Oct 05 02:36:23.828811 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1053/2151] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:36:23 2022] POST /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 05 02:36:23.836138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b5fea46b-f527-446d-92c1-a92aee4ca96d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:23.837410 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b5fea46b-f527-446d-92c1-a92aee4ca96d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:23.848200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5fea46b-f527-446d-92c1-a92aee4ca96d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:23.849149 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5fea46b-f527-446d-92c1-a92aee4ca96d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:23.849998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5fea46b-f527-446d-92c1-a92aee4ca96d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:23.852811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5fea46b-f527-446d-92c1-a92aee4ca96d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:23.855643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5fea46b-f527-446d-92c1-a92aee4ca96d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:23.858023 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5fea46b-f527-446d-92c1-a92aee4ca96d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:23.862120 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=4 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:23.888821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=14 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:24.159952 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=24 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:24.179387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a79138df-183f-4d91-86cf-9bbfcf49783f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:24.211966 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a79138df-183f-4d91-86cf-9bbfcf49783f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51" status: 200 len: 1318 microversion: 2.1 time: 1.038081 Oct 05 02:36:24.213592 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1099/2152] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:23 2022] GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51 => generated 1318 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:24.229760 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f4c8ac3e-70a6-4376-a264-95a1a604a593 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:24.230591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f4c8ac3e-70a6-4376-a264-95a1a604a593 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:24.238516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4c8ac3e-70a6-4376-a264-95a1a604a593 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:24.239019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4c8ac3e-70a6-4376-a264-95a1a604a593 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:24.239878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4c8ac3e-70a6-4376-a264-95a1a604a593 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:24.241224 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4c8ac3e-70a6-4376-a264-95a1a604a593 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:24.241892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4c8ac3e-70a6-4376-a264-95a1a604a593 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:24.242421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4c8ac3e-70a6-4376-a264-95a1a604a593 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:24.381554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b5fea46b-f527-446d-92c1-a92aee4ca96d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:24.394956 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b5fea46b-f527-446d-92c1-a92aee4ca96d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 200 len: 1355 microversion: 2.1 time: 0.564663 Oct 05 02:36:24.412559 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1054/2153] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:23 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 1355 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:24.412559 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9b0cd7af-eb07-483d-a560-8ee79478c96d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fccdf674ee0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:24.508691 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9b0cd7af-eb07-483d-a560-8ee79478c96d tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/12119e1b-1ded-4ca3-8237-14840e2879e1" status: 200 len: 1414 microversion: 2.1 time: 0.104782 Oct 05 02:36:24.512081 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1055/2154] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:24 2022] GET /compute/v2.1/images/12119e1b-1ded-4ca3-8237-14840e2879e1 => generated 1414 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:24.517296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-62c9b3b0-f65e-4ce9-9334-25da1d604bb0 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:24.518758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-62c9b3b0-f65e-4ce9-9334-25da1d604bb0 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: e3d6d4a6-f11c-4b42-9023-4729addcf3da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:24.527406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62c9b3b0-f65e-4ce9-9334-25da1d604bb0 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:24.528261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62c9b3b0-f65e-4ce9-9334-25da1d604bb0 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:24.528992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62c9b3b0-f65e-4ce9-9334-25da1d604bb0 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:24.529978 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62c9b3b0-f65e-4ce9-9334-25da1d604bb0 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:24.530639 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62c9b3b0-f65e-4ce9-9334-25da1d604bb0 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:24.531321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62c9b3b0-f65e-4ce9-9334-25da1d604bb0 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:24.692189 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f4c8ac3e-70a6-4376-a264-95a1a604a593 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:24.705497 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f4c8ac3e-70a6-4376-a264-95a1a604a593 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1383 microversion: 2.1 time: 0.490213 Oct 05 02:36:24.706567 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1100/2155] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:24 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1383 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:24.713795 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-07d56322-79c6-413b-8607-44a6e31123a9 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf72fc10>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:24.784195 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-07d56322-79c6-413b-8607-44a6e31123a9 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd" status: 200 len: 1454 microversion: 2.1 time: 0.075055 Oct 05 02:36:24.785714 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1101/2156] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:24 2022] GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd => generated 1454 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:24.792861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b1f54ce0-a929-496d-b17c-f5121b10b1b2 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce80f0310>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:24.875152 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b1f54ce0-a929-496d-b17c-f5121b10b1b2 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/12119e1b-1ded-4ca3-8237-14840e2879e1" status: 200 len: 1414 microversion: 2.1 time: 0.087325 Oct 05 02:36:24.876287 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1102/2157] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:24 2022] GET /compute/v2.1/images/12119e1b-1ded-4ca3-8237-14840e2879e1 => generated 1414 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:24.902853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7d1bc1c0-2cac-4e66-959a-0cfa992c48ed tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Calling method '.version_select at 0x7fcce80b0670>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:24.906504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7d1bc1c0-2cac-4e66-959a-0cfa992c48ed tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:24.906787 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7d1bc1c0-2cac-4e66-959a-0cfa992c48ed tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:24.907241 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7d1bc1c0-2cac-4e66-959a-0cfa992c48ed tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:24.926943 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7d1bc1c0-2cac-4e66-959a-0cfa992c48ed tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1552 microversion: 2.1 time: 0.025537 Oct 05 02:36:24.927605 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1103/2158] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 5 02:36:24 2022] GET /compute/v2.1/os-migrations => generated 1552 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:24.944298 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-bd50a9b1-7024-48ff-8c7f-5e3786edab92 req-06075050-9a08-4476-9ca4-94bef14bd8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cf0945c-2ca2-4803-ab89-adf554c92c51", "tag": "f6e6392b-8cd7-4c22-85db-cc379ca54ac8"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:24.968955 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-bd50a9b1-7024-48ff-8c7f-5e3786edab92 req-06075050-9a08-4476-9ca4-94bef14bd8b6 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:24.969419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-bd50a9b1-7024-48ff-8c7f-5e3786edab92 req-06075050-9a08-4476-9ca4-94bef14bd8b6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:24.969856 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-bd50a9b1-7024-48ff-8c7f-5e3786edab92 req-06075050-9a08-4476-9ca4-94bef14bd8b6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:24.992115 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-bd50a9b1-7024-48ff-8c7f-5e3786edab92 req-06075050-9a08-4476-9ca4-94bef14bd8b6 service nova] Creating event network-changed:f6e6392b-8cd7-4c22-85db-cc379ca54ac8 for instance 6cf0945c-2ca2-4803-ab89-adf554c92c51 on n-h1-858272-3 Oct 05 02:36:25.004470 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-bd50a9b1-7024-48ff-8c7f-5e3786edab92 req-06075050-9a08-4476-9ca4-94bef14bd8b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063643 Oct 05 02:36:25.007412 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1104/2159] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:25.018185 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ffd59068-7deb-41ef-98c1-545485fd68cb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fccdf72f8b0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:25.128988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-62c9b3b0-f65e-4ce9-9334-25da1d604bb0 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:25.147585 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-62c9b3b0-f65e-4ce9-9334-25da1d604bb0 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da" status: 200 len: 1321 microversion: 2.1 time: 0.634029 Oct 05 02:36:25.154216 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1056/2160] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:24 2022] GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da => generated 1321 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:25.159241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a178b9e3-8473-43b9-87eb-35b3042dcdd7 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:25.165527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a178b9e3-8473-43b9-87eb-35b3042dcdd7 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:25.184419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a178b9e3-8473-43b9-87eb-35b3042dcdd7 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:25.186154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a178b9e3-8473-43b9-87eb-35b3042dcdd7 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:25.186871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a178b9e3-8473-43b9-87eb-35b3042dcdd7 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:25.188011 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a178b9e3-8473-43b9-87eb-35b3042dcdd7 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:25.188999 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a178b9e3-8473-43b9-87eb-35b3042dcdd7 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:25.197520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a178b9e3-8473-43b9-87eb-35b3042dcdd7 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:25.316924 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ffd59068-7deb-41ef-98c1-545485fd68cb tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "DELETE /compute/v2.1/images/12119e1b-1ded-4ca3-8237-14840e2879e1" status: 204 len: 0 microversion: 2.1 time: 0.307991 Oct 05 02:36:25.320362 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1105/2161] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:25 2022] DELETE /compute/v2.1/images/12119e1b-1ded-4ca3-8237-14840e2879e1 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:36:25.324296 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c04f61d5-a5c0-4e78-a754-b20ff821274e tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:25.325064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c04f61d5-a5c0-4e78-a754-b20ff821274e tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 6cf0945c-2ca2-4803-ab89-adf554c92c51] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:25.357088 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c04f61d5-a5c0-4e78-a754-b20ff821274e tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:25.357609 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c04f61d5-a5c0-4e78-a754-b20ff821274e tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:25.358062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c04f61d5-a5c0-4e78-a754-b20ff821274e tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:25.364244 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c04f61d5-a5c0-4e78-a754-b20ff821274e tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:25.364776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c04f61d5-a5c0-4e78-a754-b20ff821274e tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:25.367701 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c04f61d5-a5c0-4e78-a754-b20ff821274e tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:25.833473 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a178b9e3-8473-43b9-87eb-35b3042dcdd7 tempest-LiveMigrationTest-619880899 tempest-LiveMigrationTest-619880899-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1534 microversion: 2.1 time: 0.673609 Oct 05 02:36:25.834995 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1057/2162] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:25 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1534 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:25.848011 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2000bc76-d1b6-46c4-bce6-1dd95e754bf5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fccdf5ed310>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:25.887612 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-2000bc76-d1b6-46c4-bce6-1dd95e754bf5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] HTTP exception thrown: Image not found. Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2000bc76-d1b6-46c4-bce6-1dd95e754bf5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Request method failure captured: Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/images/12119e1b-1ded-4ca3-8237-14840e2879e1 HTTP/1.1 Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOyncnz_Xr9P8nn_Dn2jWOBPMfB25oKlwUdkb-lAovWLOcnbWbWtB8EupA339z8n4CLPU4Xvp4t38IgdhTeSkNNsbZcCHuTGeDJ3SIdUYD0jAqlhUKoi9rkJcjcETHKnjE1xV6Ecn7VoX8kfZElKx76DeJFkP6MWJtQcCHasZx2Oz20 Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 91e0286f34a549ed90c758652f0d20ae Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 91e0286f34a549ed90c758652f0d20ae Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ImagesTestJSON-1818116565-project Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 9f23399a5f1c4af6855a098198ca4ced Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ImagesTestJSON-1818116565-project Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: exception: Image not found. Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '12119e1b-1ded-4ca3-8237-14840e2879e1'} Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 12119e1b-1ded-4ca3-8237-14840e2879e1 Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 05 02:36:25.890269 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 12119e1b-1ded-4ca3-8237-14840e2879e1 could not be found. Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 02:36:25.894536 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:25.901304 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2000bc76-d1b6-46c4-bce6-1dd95e754bf5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Returning 404 to user: Image not found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:36:25.902449 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2000bc76-d1b6-46c4-bce6-1dd95e754bf5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/images/12119e1b-1ded-4ca3-8237-14840e2879e1" status: 404 len: 62 microversion: 2.1 time: 0.062374 Oct 05 02:36:25.907593 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1058/2163] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:25 2022] GET /compute/v2.1/images/12119e1b-1ded-4ca3-8237-14840e2879e1 => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:36:25.918855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a22932ec-a8bf-460a-a736-6fedd3db4fe5 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:25.920144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a22932ec-a8bf-460a-a736-6fedd3db4fe5 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:25.931826 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a22932ec-a8bf-460a-a736-6fedd3db4fe5 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:25.932743 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a22932ec-a8bf-460a-a736-6fedd3db4fe5 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:25.933635 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a22932ec-a8bf-460a-a736-6fedd3db4fe5 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:25.934648 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a22932ec-a8bf-460a-a736-6fedd3db4fe5 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:25.935435 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a22932ec-a8bf-460a-a736-6fedd3db4fe5 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:25.936028 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a22932ec-a8bf-460a-a736-6fedd3db4fe5 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:26.046138 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c04f61d5-a5c0-4e78-a754-b20ff821274e tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:26.055071 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c04f61d5-a5c0-4e78-a754-b20ff821274e tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51" status: 200 len: 1318 microversion: 2.1 time: 0.736145 Oct 05 02:36:26.058363 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1106/2164] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:25 2022] GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51 => generated 1318 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:26.066386 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7ae9f2f4-6374-4867-90f8-0d38952e8e83 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce804b310>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:26.155430 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7ae9f2f4-6374-4867-90f8-0d38952e8e83 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd" status: 200 len: 1454 microversion: 2.1 time: 0.084415 Oct 05 02:36:26.160461 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1107/2165] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:26 2022] GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd => generated 1454 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:26.171961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-08bc3cf0-f746-4037-95d1-ea5202e20d3d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:26.176036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-08bc3cf0-f746-4037-95d1-ea5202e20d3d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:26.194258 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08bc3cf0-f746-4037-95d1-ea5202e20d3d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:26.194985 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08bc3cf0-f746-4037-95d1-ea5202e20d3d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:26.195664 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08bc3cf0-f746-4037-95d1-ea5202e20d3d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:26.197615 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08bc3cf0-f746-4037-95d1-ea5202e20d3d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:26.198616 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08bc3cf0-f746-4037-95d1-ea5202e20d3d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:26.198786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08bc3cf0-f746-4037-95d1-ea5202e20d3d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:26.247261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:26.253115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-08bc3cf0-f746-4037-95d1-ea5202e20d3d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:36:26.409765 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-08bc3cf0-f746-4037-95d1-ea5202e20d3d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 204 len: 0 microversion: 2.1 time: 0.247670 Oct 05 02:36:26.411616 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1108/2166] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:36:26 2022] DELETE /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:36:26.418712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ebb2b984-04a2-41aa-8746-a9982de16ad5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:26.419629 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ebb2b984-04a2-41aa-8746-a9982de16ad5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: e47438ff-463e-4a43-9767-8c78e8bb6e98] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:26.427301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ebb2b984-04a2-41aa-8746-a9982de16ad5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:26.428108 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ebb2b984-04a2-41aa-8746-a9982de16ad5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:26.429287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ebb2b984-04a2-41aa-8746-a9982de16ad5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:26.437459 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ebb2b984-04a2-41aa-8746-a9982de16ad5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:26.438236 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ebb2b984-04a2-41aa-8746-a9982de16ad5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:26.438881 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ebb2b984-04a2-41aa-8746-a9982de16ad5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:26.451315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a22932ec-a8bf-460a-a736-6fedd3db4fe5 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:26.466397 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a22932ec-a8bf-460a-a736-6fedd3db4fe5 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 200 len: 1355 microversion: 2.1 time: 0.557308 Oct 05 02:36:26.468443 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1059/2167] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:25 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 1355 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:26.484190 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-586fe2a7-c6be-40b7-81d9-4f53fafddfde tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:26.485068 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-586fe2a7-c6be-40b7-81d9-4f53fafddfde tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: e3d6d4a6-f11c-4b42-9023-4729addcf3da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:26.500641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-586fe2a7-c6be-40b7-81d9-4f53fafddfde tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:26.501369 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-586fe2a7-c6be-40b7-81d9-4f53fafddfde tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:26.501993 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-586fe2a7-c6be-40b7-81d9-4f53fafddfde tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:26.502876 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-586fe2a7-c6be-40b7-81d9-4f53fafddfde tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:26.503493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-586fe2a7-c6be-40b7-81d9-4f53fafddfde tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:26.504072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-586fe2a7-c6be-40b7-81d9-4f53fafddfde tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:26.696941 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-586fe2a7-c6be-40b7-81d9-4f53fafddfde tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:26.709940 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-586fe2a7-c6be-40b7-81d9-4f53fafddfde tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da" status: 200 len: 1321 microversion: 2.1 time: 0.240202 Oct 05 02:36:26.711074 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1060/2168] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:26 2022] GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da => generated 1321 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:26.717939 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-abb7524c-0829-4d05-8cfa-80475458b860 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:26.720923 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-abb7524c-0829-4d05-8cfa-80475458b860 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:26.735439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abb7524c-0829-4d05-8cfa-80475458b860 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:26.736020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abb7524c-0829-4d05-8cfa-80475458b860 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:26.736525 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abb7524c-0829-4d05-8cfa-80475458b860 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:26.737411 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abb7524c-0829-4d05-8cfa-80475458b860 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:26.738017 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abb7524c-0829-4d05-8cfa-80475458b860 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:26.738507 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abb7524c-0829-4d05-8cfa-80475458b860 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:26.743803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:26.763618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ebb2b984-04a2-41aa-8746-a9982de16ad5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:26.772094 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ebb2b984-04a2-41aa-8746-a9982de16ad5 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98" status: 200 len: 1500 microversion: 2.1 time: 0.358947 Oct 05 02:36:26.773149 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1109/2169] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:26 2022] GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98 => generated 1500 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:26.956084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-abb7524c-0829-4d05-8cfa-80475458b860 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:26.968743 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-abb7524c-0829-4d05-8cfa-80475458b860 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1389 microversion: 2.1 time: 0.256393 Oct 05 02:36:26.969691 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1061/2170] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:26 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1389 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:27.068634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-3530e8b4-9d10-45b0-ad40-ad0c2027bae6 req-2d8f5a2f-8a40-4b14-b740-50a8b5627d97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3d6d4a6-f11c-4b42-9023-4729addcf3da", "tag": "c891fddd-0e94-442b-939e-a1a5cb5a9fde"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:27.082408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3d99f65c-5293-4e60-897b-57afd2faa276 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:27.083315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3d99f65c-5293-4e60-897b-57afd2faa276 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 6cf0945c-2ca2-4803-ab89-adf554c92c51] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:27.088619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3530e8b4-9d10-45b0-ad40-ad0c2027bae6 req-2d8f5a2f-8a40-4b14-b740-50a8b5627d97 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:27.089120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3530e8b4-9d10-45b0-ad40-ad0c2027bae6 req-2d8f5a2f-8a40-4b14-b740-50a8b5627d97 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:27.089703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3530e8b4-9d10-45b0-ad40-ad0c2027bae6 req-2d8f5a2f-8a40-4b14-b740-50a8b5627d97 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:27.095110 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3d99f65c-5293-4e60-897b-57afd2faa276 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:27.098712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3d99f65c-5293-4e60-897b-57afd2faa276 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:27.099440 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3d99f65c-5293-4e60-897b-57afd2faa276 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:27.104618 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3d99f65c-5293-4e60-897b-57afd2faa276 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:27.105073 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-3530e8b4-9d10-45b0-ad40-ad0c2027bae6 req-2d8f5a2f-8a40-4b14-b740-50a8b5627d97 service nova] Creating event network-changed:c891fddd-0e94-442b-939e-a1a5cb5a9fde for instance e3d6d4a6-f11c-4b42-9023-4729addcf3da on n-h1-858272-3 Oct 05 02:36:27.106813 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3d99f65c-5293-4e60-897b-57afd2faa276 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:27.114348 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-3530e8b4-9d10-45b0-ad40-ad0c2027bae6 req-2d8f5a2f-8a40-4b14-b740-50a8b5627d97 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049579 Oct 05 02:36:27.115096 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3d99f65c-5293-4e60-897b-57afd2faa276 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:27.115683 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1110/2171] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:27.172670 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d1f14d80-fbfc-4179-9741-19954c702f87 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce8038820>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:27.229595 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d1f14d80-fbfc-4179-9741-19954c702f87 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd" status: 200 len: 1454 microversion: 2.1 time: 0.062043 Oct 05 02:36:27.230230 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1111/2172] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:27 2022] GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd => generated 1454 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:27.349688 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3d99f65c-5293-4e60-897b-57afd2faa276 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:27.358218 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3d99f65c-5293-4e60-897b-57afd2faa276 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51" status: 200 len: 1318 microversion: 2.1 time: 0.279855 Oct 05 02:36:27.360892 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1062/2173] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:27 2022] GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51 => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:36:27.489584 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b4e1fa07-335a-410d-b4fa-77f47c678a5e tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:27.490385 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b4e1fa07-335a-410d-b4fa-77f47c678a5e tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:27.498013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4e1fa07-335a-410d-b4fa-77f47c678a5e tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:27.498769 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4e1fa07-335a-410d-b4fa-77f47c678a5e tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:27.499434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4e1fa07-335a-410d-b4fa-77f47c678a5e tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:27.501532 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4e1fa07-335a-410d-b4fa-77f47c678a5e tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:27.502591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4e1fa07-335a-410d-b4fa-77f47c678a5e tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:27.503254 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4e1fa07-335a-410d-b4fa-77f47c678a5e tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:27.739745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9342fde4-cd97-4acb-861a-e1d3588c22e7 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:27.741301 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9342fde4-cd97-4acb-861a-e1d3588c22e7 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: e3d6d4a6-f11c-4b42-9023-4729addcf3da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:27.751873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9342fde4-cd97-4acb-861a-e1d3588c22e7 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:27.752689 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9342fde4-cd97-4acb-861a-e1d3588c22e7 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:27.753947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9342fde4-cd97-4acb-861a-e1d3588c22e7 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:27.754886 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9342fde4-cd97-4acb-861a-e1d3588c22e7 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:27.755844 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9342fde4-cd97-4acb-861a-e1d3588c22e7 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:27.756478 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9342fde4-cd97-4acb-861a-e1d3588c22e7 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:27.765463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b4e1fa07-335a-410d-b4fa-77f47c678a5e tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:27.774409 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b4e1fa07-335a-410d-b4fa-77f47c678a5e tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 200 len: 1355 microversion: 2.1 time: 0.288665 Oct 05 02:36:27.792018 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1112/2174] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:27 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 1355 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:27.799827 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-08544826-395c-462b-bec6-f77d9c37ed39 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:27.800785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-08544826-395c-462b-bec6-f77d9c37ed39 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: e47438ff-463e-4a43-9767-8c78e8bb6e98] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:27.807448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08544826-395c-462b-bec6-f77d9c37ed39 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:27.808153 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08544826-395c-462b-bec6-f77d9c37ed39 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:27.808751 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08544826-395c-462b-bec6-f77d9c37ed39 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:27.810304 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08544826-395c-462b-bec6-f77d9c37ed39 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:27.810966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08544826-395c-462b-bec6-f77d9c37ed39 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:27.811757 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08544826-395c-462b-bec6-f77d9c37ed39 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:28.141391 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9342fde4-cd97-4acb-861a-e1d3588c22e7 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:28.162434 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9342fde4-cd97-4acb-861a-e1d3588c22e7 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da" status: 200 len: 1321 microversion: 2.1 time: 0.431076 Oct 05 02:36:28.163580 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1063/2175] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:27 2022] GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da => generated 1321 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:28.176397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1c79572b-594f-4745-b854-5722e34d6c2d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:28.177053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1c79572b-594f-4745-b854-5722e34d6c2d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:28.184050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c79572b-594f-4745-b854-5722e34d6c2d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:28.192100 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c79572b-594f-4745-b854-5722e34d6c2d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:28.192828 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c79572b-594f-4745-b854-5722e34d6c2d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:28.193610 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c79572b-594f-4745-b854-5722e34d6c2d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:28.194204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c79572b-594f-4745-b854-5722e34d6c2d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:28.194503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c79572b-594f-4745-b854-5722e34d6c2d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:28.218207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-08544826-395c-462b-bec6-f77d9c37ed39 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:28.226867 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-08544826-395c-462b-bec6-f77d9c37ed39 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98" status: 200 len: 1500 microversion: 2.1 time: 0.433573 Oct 05 02:36:28.228725 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1113/2176] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:27 2022] GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98 => generated 1500 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:28.430708 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b56bc814-5fa2-46c5-9877-94440e25317c tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Action: 'create', calling method: .version_select at 0x7fcce80f0700>, body: {"keypair": {"name": "tempest-keypair-93517428", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWkJrbqQznn0utr8HpGPnAhBkAZVyTRL4Pnm02RgKXG+Z5l0vQrqkQN8OknwKoV2dYwjveG0iQFFCEO+Bdwf82wE8HamN/LyUaUqj57LeKVBi4V847zgrGcyQqsNRBndA=="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:28.459913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1c79572b-594f-4745-b854-5722e34d6c2d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:28.473558 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1c79572b-594f-4745-b854-5722e34d6c2d tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1389 microversion: 2.1 time: 0.306293 Oct 05 02:36:28.475919 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1064/2177] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:28 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1389 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:28.476843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-b56bc814-5fa2-46c5-9877-94440e25317c tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Getting quotas for project 24a89b34668a47ecb247ded06342f961. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:36:28.488119 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4eba5219-afd9-44e8-9ebb-cd6b7a92091a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce8282790>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:28.489730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-b56bc814-5fa2-46c5-9877-94440e25317c tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Getting quotas for user 2040ec6ce90c4184af3b0ad3c4ba932a and project 24a89b34668a47ecb247ded06342f961. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:36:28.551868 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b56bc814-5fa2-46c5-9877-94440e25317c tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.2 time: 0.321659 Oct 05 02:36:28.559402 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1114/2178] 10.222.0.16 () {62 vars in 1199 bytes} [Wed Oct 5 02:36:28 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 330 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 05 02:36:28.581444 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4b13c948-eec6-4e5c-83d4-6ab81871a14b tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:28.582546 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4eba5219-afd9-44e8-9ebb-cd6b7a92091a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd" status: 200 len: 1454 microversion: 2.1 time: 0.104663 Oct 05 02:36:28.583141 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1065/2179] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:28 2022] GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:28.593241 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4b13c948-eec6-4e5c-83d4-6ab81871a14b tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 6cf0945c-2ca2-4803-ab89-adf554c92c51] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:28.596527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-319ee8ec-809d-4e5a-b9c4-761f9219208b tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Calling method '.version_select at 0x7fccdf5eda60>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:28.600158 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b13c948-eec6-4e5c-83d4-6ab81871a14b tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:28.600894 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b13c948-eec6-4e5c-83d4-6ab81871a14b tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:28.601810 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b13c948-eec6-4e5c-83d4-6ab81871a14b tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:28.603258 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b13c948-eec6-4e5c-83d4-6ab81871a14b tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:28.603929 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b13c948-eec6-4e5c-83d4-6ab81871a14b tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:28.615539 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-319ee8ec-809d-4e5a-b9c4-761f9219208b tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-93517428" status: 200 len: 511 microversion: 2.2 time: 0.031339 Oct 05 02:36:28.616454 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1066/2180] 10.222.0.16 () {60 vars in 1252 bytes} [Wed Oct 5 02:36:28 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-93517428 => generated 511 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:28.616813 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b13c948-eec6-4e5c-83d4-6ab81871a14b tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:28.630451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-48160f9e-e670-4c11-8d62-85f4e5121af4 req-9dbae576-7704-421d-97c4-75a54f43e967 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f4b118a-e665-4c29-a518-811ca1fc9001", "name": "network-vif-deleted", "tag": "f83cfb8b-54ff-4810-8dff-d1685b7e58d4"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:28.644503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-48160f9e-e670-4c11-8d62-85f4e5121af4 req-9dbae576-7704-421d-97c4-75a54f43e967 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:28.645504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-48160f9e-e670-4c11-8d62-85f4e5121af4 req-9dbae576-7704-421d-97c4-75a54f43e967 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:28.645946 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-48160f9e-e670-4c11-8d62-85f4e5121af4 req-9dbae576-7704-421d-97c4-75a54f43e967 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:28.663648 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-48160f9e-e670-4c11-8d62-85f4e5121af4 req-9dbae576-7704-421d-97c4-75a54f43e967 service nova] Creating event network-vif-deleted:f83cfb8b-54ff-4810-8dff-d1685b7e58d4 for instance 1f4b118a-e665-4c29-a518-811ca1fc9001 on n-h2-858272-3 Oct 05 02:36:28.668141 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-48160f9e-e670-4c11-8d62-85f4e5121af4 req-9dbae576-7704-421d-97c4-75a54f43e967 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047310 Oct 05 02:36:28.672094 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1067/2181] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:28.679660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9b544e76-e251-48e9-9920-1c9b0dcef260 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Calling method '.version_select at 0x7fccdf580c10>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:28.739086 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9b544e76-e251-48e9-9920-1c9b0dcef260 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-93517428" status: 204 len: 0 microversion: 2.2 time: 0.062678 Oct 05 02:36:28.741337 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1068/2182] 10.222.0.16 () {60 vars in 1255 bytes} [Wed Oct 5 02:36:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-93517428 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:36:28.753455 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-29e1755f-d927-45d0-a0e8-3219b44a6a60 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Action: 'create', calling method: .version_select at 0x7fccdf673670>, body: {"keypair": {"name": "tempest-keypair-1529398114", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbhtL8Z6oplIYik8fH01Tg/7NUcmyoudErXclti9dEhKi7l4cQZhwgetMxpDP0A/e/gRNnp0KwSq1ooLIKg6oEb2X1311YwlbhHHxI54TZbrnDwgKHg9lKyscoHCpXj5w=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:28.793580 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-29e1755f-d927-45d0-a0e8-3219b44a6a60 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Getting quotas for project 24a89b34668a47ecb247ded06342f961. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:36:28.800300 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-29e1755f-d927-45d0-a0e8-3219b44a6a60 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Getting quotas for user 2040ec6ce90c4184af3b0ad3c4ba932a and project 24a89b34668a47ecb247ded06342f961. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:36:28.805336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4b13c948-eec6-4e5c-83d4-6ab81871a14b tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:28.814545 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4b13c948-eec6-4e5c-83d4-6ab81871a14b tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51" status: 200 len: 1318 microversion: 2.1 time: 0.253033 Oct 05 02:36:28.815234 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1115/2183] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:28 2022] GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:28.831153 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:28.831290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b505e01d-82dc-4669-a9ae-8561f360beca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:28.831290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b505e01d-82dc-4669-a9ae-8561f360beca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:28.831290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b505e01d-82dc-4669-a9ae-8561f360beca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:28.831290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b505e01d-82dc-4669-a9ae-8561f360beca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:28.831290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b505e01d-82dc-4669-a9ae-8561f360beca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:28.831290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b505e01d-82dc-4669-a9ae-8561f360beca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:28.831290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b505e01d-82dc-4669-a9ae-8561f360beca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:28.832130 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b505e01d-82dc-4669-a9ae-8561f360beca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:28.859904 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-29e1755f-d927-45d0-a0e8-3219b44a6a60 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.110412 Oct 05 02:36:28.865178 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1069/2184] 10.222.0.16 () {62 vars in 1199 bytes} [Wed Oct 5 02:36:28 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 112 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 05 02:36:28.872820 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2308660e-fec5-40a4-a7ae-304a75630db7 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Calling method '.version_select at 0x7fccdf6735e0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:28.925504 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2308660e-fec5-40a4-a7ae-304a75630db7 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1529398114" status: 204 len: 0 microversion: 2.2 time: 0.056741 Oct 05 02:36:28.926480 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1070/2185] 10.222.0.16 () {60 vars in 1261 bytes} [Wed Oct 5 02:36:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1529398114 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 02:36:28.937721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-94fe16b7-48a0-4768-b688-daecdc6a0fd5 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Action: 'create', calling method: .version_select at 0x7fccdf5804c0>, body: {"keypair": {"name": "tempest-keypair-1474178496", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:28.959159 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-94fe16b7-48a0-4768-b688-daecdc6a0fd5 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Getting quotas for project 24a89b34668a47ecb247ded06342f961. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:36:28.965924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-94fe16b7-48a0-4768-b688-daecdc6a0fd5 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Getting quotas for user 2040ec6ce90c4184af3b0ad3c4ba932a and project 24a89b34668a47ecb247ded06342f961. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:36:29.015037 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-94fe16b7-48a0-4768-b688-daecdc6a0fd5 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.079600 Oct 05 02:36:29.021418 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1071/2186] 10.222.0.16 () {62 vars in 1199 bytes} [Wed Oct 5 02:36:28 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 84 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 05 02:36:29.043984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fa2922ef-44c1-4dd8-a7af-ebf976910356 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Calling method '.version_select at 0x7fccdf5d3d30>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:29.130356 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fa2922ef-44c1-4dd8-a7af-ebf976910356 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1474178496" status: 204 len: 0 microversion: 2.2 time: 0.106258 Oct 05 02:36:29.132199 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1072/2187] 10.222.0.16 () {60 vars in 1261 bytes} [Wed Oct 5 02:36:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1474178496 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:36:29.146152 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-18324d54-c093-4726-95d7-74a14af3fb64 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Action: 'create', calling method: .version_select at 0x7fccdf587940>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2129010347", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4pN4EMjrAHFBrO+Y9/DKptdvASLjqTaI3mmtOlJ+ExM7+GlNoLQ3W+PsOQ1ncfdOcDYzISUw/w31siAfRkWFZ+QDtq4O9cNnFQzXLXpDy6AIt8CdHP1CSoyPO6Hej4WA=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:29.163431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b505e01d-82dc-4669-a9ae-8561f360beca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:29.174475 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b505e01d-82dc-4669-a9ae-8561f360beca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 200 len: 1355 microversion: 2.1 time: 0.358068 Oct 05 02:36:29.185647 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1116/2188] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:28 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 1355 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:29.199219 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3698b583-3dde-4ab8-8b2b-e2f1b5c50f77 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:29.199859 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3698b583-3dde-4ab8-8b2b-e2f1b5c50f77 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: e3d6d4a6-f11c-4b42-9023-4729addcf3da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:29.206001 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-18324d54-c093-4726-95d7-74a14af3fb64 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Getting quotas for project 24a89b34668a47ecb247ded06342f961. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:36:29.206244 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:29.209042 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3698b583-3dde-4ab8-8b2b-e2f1b5c50f77 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:29.209741 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3698b583-3dde-4ab8-8b2b-e2f1b5c50f77 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:29.210201 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3698b583-3dde-4ab8-8b2b-e2f1b5c50f77 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:29.210959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3698b583-3dde-4ab8-8b2b-e2f1b5c50f77 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:29.211507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3698b583-3dde-4ab8-8b2b-e2f1b5c50f77 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:29.211947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3698b583-3dde-4ab8-8b2b-e2f1b5c50f77 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:29.220736 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-18324d54-c093-4726-95d7-74a14af3fb64 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Getting quotas for user 2040ec6ce90c4184af3b0ad3c4ba932a and project 24a89b34668a47ecb247ded06342f961. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:36:29.284165 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-18324d54-c093-4726-95d7-74a14af3fb64 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.143794 Oct 05 02:36:29.284784 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1073/2189] 10.222.0.16 () {62 vars in 1199 bytes} [Wed Oct 5 02:36:29 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 145 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 05 02:36:29.297333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ceb355cc-fa91-4f63-925c-8b1e37d7737b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:29.298894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ceb355cc-fa91-4f63-925c-8b1e37d7737b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: e47438ff-463e-4a43-9767-8c78e8bb6e98] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:29.308866 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ceb355cc-fa91-4f63-925c-8b1e37d7737b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:29.309411 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ceb355cc-fa91-4f63-925c-8b1e37d7737b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:29.310986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ceb355cc-fa91-4f63-925c-8b1e37d7737b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:29.311762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ceb355cc-fa91-4f63-925c-8b1e37d7737b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:29.312757 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ceb355cc-fa91-4f63-925c-8b1e37d7737b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:29.313250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ceb355cc-fa91-4f63-925c-8b1e37d7737b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:29.499183 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ceb355cc-fa91-4f63-925c-8b1e37d7737b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:29.510118 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ceb355cc-fa91-4f63-925c-8b1e37d7737b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98" status: 200 len: 1506 microversion: 2.1 time: 0.221382 Oct 05 02:36:29.514215 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1074/2190] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:29 2022] GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98 => generated 1506 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:29.551233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3698b583-3dde-4ab8-8b2b-e2f1b5c50f77 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:29.563691 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7c16c652-9af7-4e3f-a6eb-f1e74bf4e876 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Action: 'create', calling method: .version_select at 0x7fccdf580c10>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-754191627", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9G3oo6R1Ya7sJx7hnh2Kvpi1vx14Tmy4FELYMoP0bz3wFQrdC5gQL9SBuUP38guSu8T+i/Rx5PZsQdEh6Fsq/jcJ1b89pznnM5AAh0uysUTq1435xZQRtGiTsEoa4Qug=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:29.565364 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3698b583-3dde-4ab8-8b2b-e2f1b5c50f77 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da" status: 200 len: 1321 microversion: 2.1 time: 0.378204 Oct 05 02:36:29.568390 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1117/2191] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:29 2022] GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da => generated 1321 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:29.589060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8e16089f-b9d0-43ba-87b6-15c75ceae98c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:29.589060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8e16089f-b9d0-43ba-87b6-15c75ceae98c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:29.629768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e16089f-b9d0-43ba-87b6-15c75ceae98c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:29.632394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e16089f-b9d0-43ba-87b6-15c75ceae98c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:29.632926 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e16089f-b9d0-43ba-87b6-15c75ceae98c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:29.633711 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e16089f-b9d0-43ba-87b6-15c75ceae98c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:29.634185 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e16089f-b9d0-43ba-87b6-15c75ceae98c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:29.634867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e16089f-b9d0-43ba-87b6-15c75ceae98c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:29.749350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-7c16c652-9af7-4e3f-a6eb-f1e74bf4e876 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Getting quotas for project 24a89b34668a47ecb247ded06342f961. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:36:29.762080 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-7c16c652-9af7-4e3f-a6eb-f1e74bf4e876 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Getting quotas for user 2040ec6ce90c4184af3b0ad3c4ba932a and project 24a89b34668a47ecb247ded06342f961. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:36:29.802935 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8e16089f-b9d0-43ba-87b6-15c75ceae98c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:29.811669 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8e16089f-b9d0-43ba-87b6-15c75ceae98c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1184 microversion: 2.1 time: 0.233582 Oct 05 02:36:29.812607 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1118/2192] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:29 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1184 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:29.834554 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-86673e4f-4566-4976-b664-d559ee3f3f21 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce81069d0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:29.842813 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7c16c652-9af7-4e3f-a6eb-f1e74bf4e876 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.327350 Oct 05 02:36:29.852042 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1075/2193] 10.222.0.16 () {62 vars in 1199 bytes} [Wed Oct 5 02:36:29 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 329 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 05 02:36:29.852042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f50a540a-8683-4bec-bb88-e9c53891e384 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:29.852042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f50a540a-8683-4bec-bb88-e9c53891e384 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 6cf0945c-2ca2-4803-ab89-adf554c92c51] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:29.871641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f50a540a-8683-4bec-bb88-e9c53891e384 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:29.874935 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f50a540a-8683-4bec-bb88-e9c53891e384 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:29.875470 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f50a540a-8683-4bec-bb88-e9c53891e384 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:29.876282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f50a540a-8683-4bec-bb88-e9c53891e384 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:29.877275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f50a540a-8683-4bec-bb88-e9c53891e384 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:29.878580 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f50a540a-8683-4bec-bb88-e9c53891e384 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:29.893832 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-86673e4f-4566-4976-b664-d559ee3f3f21 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd" status: 200 len: 1454 microversion: 2.1 time: 0.067091 Oct 05 02:36:29.895080 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1119/2194] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:29 2022] GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd => generated 1454 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:29.900094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d31141c3-0dad-42ab-b3e9-9a080486137c tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Action: 'create', calling method: .version_select at 0x7fcce816baf0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-854530638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCp13iaxY4cFyAPOKa/UqCLVCI/D5NUB78b2nXBjCDeClgsmbetN1t3MBS9PSzvbCm02PjIEXoLWmBdiVY4NcrPG8a+t9nh78q/eqW+r3S5PLpW7ZdGBi6U2MQ5kJ8V46Q=="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:29.930557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-d31141c3-0dad-42ab-b3e9-9a080486137c tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Getting quotas for project 24a89b34668a47ecb247ded06342f961. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:36:29.948680 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-d31141c3-0dad-42ab-b3e9-9a080486137c tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Getting quotas for user 2040ec6ce90c4184af3b0ad3c4ba932a and project 24a89b34668a47ecb247ded06342f961. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:36:29.986527 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d31141c3-0dad-42ab-b3e9-9a080486137c tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.089587 Oct 05 02:36:30.004837 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1120/2195] 10.222.0.16 () {62 vars in 1199 bytes} [Wed Oct 5 02:36:29 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 92 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 05 02:36:30.025557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a29e202f-82eb-44e4-b42a-1790029a74f8 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Calling method '.version_select at 0x7fccdf72f1f0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:30.037234 n-d-858272-3 devstack@n-api.service[122320]: WARNING oslo_db.sqlalchemy.utils [None req-a29e202f-82eb-44e4-b42a-1790029a74f8 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 05 02:36:30.044750 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a29e202f-82eb-44e4-b42a-1790029a74f8 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.038366 Oct 05 02:36:30.052208 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1121/2196] 10.222.0.16 () {60 vars in 1177 bytes} [Wed Oct 5 02:36:30 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:30.065685 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3bd35bbf-a85f-46b5-bf01-0a6b21224e2d tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Calling method '.version_select at 0x7fcce816b4c0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:30.107392 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f50a540a-8683-4bec-bb88-e9c53891e384 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:30.114253 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3bd35bbf-a85f-46b5-bf01-0a6b21224e2d tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-854530638" status: 204 len: 0 microversion: 2.2 time: 0.060565 Oct 05 02:36:30.115382 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1122/2197] 10.222.0.16 () {60 vars in 1318 bytes} [Wed Oct 5 02:36:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-854530638 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:36:30.124109 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3cdd30b2-ddda-4bfa-9d58-96c8a9afe48c tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Calling method '.version_select at 0x7fcce8164940>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:30.125934 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f50a540a-8683-4bec-bb88-e9c53891e384 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51" status: 200 len: 1318 microversion: 2.1 time: 0.280508 Oct 05 02:36:30.126827 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1076/2198] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:29 2022] GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:30.173486 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3cdd30b2-ddda-4bfa-9d58-96c8a9afe48c tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-754191627" status: 204 len: 0 microversion: 2.2 time: 0.053147 Oct 05 02:36:30.174946 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1123/2199] 10.222.0.16 () {60 vars in 1318 bytes} [Wed Oct 5 02:36:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-754191627 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 02:36:30.184865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-07215735-6c63-4931-9276-f3aa18a812d8 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Calling method '.version_select at 0x7fccdf580f70>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:30.209625 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-59bc4a31-df93-4011-985d-edb5aa58f6e6 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:30.210376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-59bc4a31-df93-4011-985d-edb5aa58f6e6 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:30.222605 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-07215735-6c63-4931-9276-f3aa18a812d8 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2129010347" status: 204 len: 0 microversion: 2.2 time: 0.042625 Oct 05 02:36:30.223660 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1077/2200] 10.222.0.16 () {60 vars in 1321 bytes} [Wed Oct 5 02:36:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2129010347 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:36:30.231771 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-59bc4a31-df93-4011-985d-edb5aa58f6e6 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:30.233075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-59bc4a31-df93-4011-985d-edb5aa58f6e6 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:30.233744 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-59bc4a31-df93-4011-985d-edb5aa58f6e6 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:30.234692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-59bc4a31-df93-4011-985d-edb5aa58f6e6 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:30.235411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-59bc4a31-df93-4011-985d-edb5aa58f6e6 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:30.236056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-59bc4a31-df93-4011-985d-edb5aa58f6e6 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:30.236279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-568dbb03-ff79-49ce-9313-4f1e7e468580 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Action: 'create', calling method: .version_select at 0x7fccdf637ca0>, body: {"keypair": {"name": "tempest-keypair-1046541484", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFELZol4kGFSkdvDt3m8eRWOEE2bN2eDSNNBk4RtdQhutX833ArN6V7AQx/rEzqkxVFrK1vx9jOWccvOTM4U4XDB62xza8t6TbKqvE40qZA5acNhDg3b59UZEpIHwZKeQg=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:30.274570 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-568dbb03-ff79-49ce-9313-4f1e7e468580 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Getting quotas for project 24a89b34668a47ecb247ded06342f961. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:36:30.288220 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-568dbb03-ff79-49ce-9313-4f1e7e468580 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Getting quotas for user 2040ec6ce90c4184af3b0ad3c4ba932a and project 24a89b34668a47ecb247ded06342f961. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:36:30.358697 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-568dbb03-ff79-49ce-9313-4f1e7e468580 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.126374 Oct 05 02:36:30.364869 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1078/2201] 10.222.0.16 () {62 vars in 1199 bytes} [Wed Oct 5 02:36:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 05 02:36:30.370289 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-decccd0e-a1c5-44e6-ac4e-184cd96971f7 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Calling method '.version_select at 0x7fccdf655f70>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:30.387844 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-decccd0e-a1c5-44e6-ac4e-184cd96971f7 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-1046541484" status: 200 len: 513 microversion: 2.2 time: 0.021615 Oct 05 02:36:30.402703 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1079/2202] 10.222.0.16 () {60 vars in 1258 bytes} [Wed Oct 5 02:36:30 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1046541484 => generated 513 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:30.409241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f803b895-55a3-4da7-b8ec-1dfc726eee84 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Calling method '.version_select at 0x7fccdf587ee0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:30.418942 n-d-858272-3 devstack@n-api.service[122319]: WARNING oslo_db.sqlalchemy.utils [None req-f803b895-55a3-4da7-b8ec-1dfc726eee84 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 05 02:36:30.433740 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f803b895-55a3-4da7-b8ec-1dfc726eee84 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.029619 Oct 05 02:36:30.441766 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1080/2203] 10.222.0.16 () {60 vars in 1177 bytes} [Wed Oct 5 02:36:30 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:30.448955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c474e236-dc74-4a96-9410-90b45071fdbf tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Calling method '.version_select at 0x7fccdf638700>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:30.509271 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-59bc4a31-df93-4011-985d-edb5aa58f6e6 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:30.522407 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-59bc4a31-df93-4011-985d-edb5aa58f6e6 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 200 len: 1355 microversion: 2.1 time: 0.322903 Oct 05 02:36:30.523447 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1124/2204] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:30 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 1355 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:36:30.544890 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c474e236-dc74-4a96-9410-90b45071fdbf tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1046541484" status: 204 len: 0 microversion: 2.2 time: 0.101573 Oct 05 02:36:30.545896 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1081/2205] 10.222.0.16 () {60 vars in 1261 bytes} [Wed Oct 5 02:36:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1046541484 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:36:30.563220 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c3628474-a953-4423-9500-5b9fcf5ef905 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Action: 'create', calling method: .version_select at 0x7fccdf673040>, body: {"keypair": {"name": "tempest-keypair-1186462929", "type": "x509"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:30.569486 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fe0404dd-9790-4b58-9b52-cb1c5f965f14 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:30.571678 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fe0404dd-9790-4b58-9b52-cb1c5f965f14 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: e47438ff-463e-4a43-9767-8c78e8bb6e98] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:30.581071 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-c3628474-a953-4423-9500-5b9fcf5ef905 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Getting quotas for project 24a89b34668a47ecb247ded06342f961. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:36:30.588349 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-c3628474-a953-4423-9500-5b9fcf5ef905 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Getting quotas for user 2040ec6ce90c4184af3b0ad3c4ba932a and project 24a89b34668a47ecb247ded06342f961. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:36:30.592512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe0404dd-9790-4b58-9b52-cb1c5f965f14 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:30.594855 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe0404dd-9790-4b58-9b52-cb1c5f965f14 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:30.596219 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe0404dd-9790-4b58-9b52-cb1c5f965f14 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:30.598808 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe0404dd-9790-4b58-9b52-cb1c5f965f14 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:30.599999 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe0404dd-9790-4b58-9b52-cb1c5f965f14 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:30.602219 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe0404dd-9790-4b58-9b52-cb1c5f965f14 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:30.606626 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.processutils [None req-c3628474-a953-4423-9500-5b9fcf5ef905 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmptha_a5wy/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmptha_a5wy/temp.key -subj /CN=2040ec6ce90c4184af3b0ad3c4ba932a -extensions v3_req_client {{(pid=122319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 05 02:36:30.781165 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fe0404dd-9790-4b58-9b52-cb1c5f965f14 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:30.810833 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fe0404dd-9790-4b58-9b52-cb1c5f965f14 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98" status: 200 len: 1506 microversion: 2.1 time: 0.247257 Oct 05 02:36:30.812033 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1125/2206] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:30 2022] GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98 => generated 1506 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:30.820464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e64cb900-0b6b-45e7-896a-43751ef6cffa tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:30.822595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e64cb900-0b6b-45e7-896a-43751ef6cffa tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: e3d6d4a6-f11c-4b42-9023-4729addcf3da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:30.842208 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e64cb900-0b6b-45e7-896a-43751ef6cffa tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:30.843096 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e64cb900-0b6b-45e7-896a-43751ef6cffa tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:30.845221 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e64cb900-0b6b-45e7-896a-43751ef6cffa tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:30.846830 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e64cb900-0b6b-45e7-896a-43751ef6cffa tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:30.847933 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e64cb900-0b6b-45e7-896a-43751ef6cffa tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:30.848579 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e64cb900-0b6b-45e7-896a-43751ef6cffa tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:31.034726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.processutils [None req-c3628474-a953-4423-9500-5b9fcf5ef905 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmptha_a5wy/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmptha_a5wy/temp.key -subj /CN=2040ec6ce90c4184af3b0ad3c4ba932a -extensions v3_req_client" returned: 0 in 0.428s {{(pid=122319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 05 02:36:31.036142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.processutils [None req-c3628474-a953-4423-9500-5b9fcf5ef905 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmptha_a5wy/temp.key -password pass: {{(pid=122319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 05 02:36:31.102854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.processutils [None req-c3628474-a953-4423-9500-5b9fcf5ef905 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] CMD "openssl pkcs12 -export -inkey /tmp/tmptha_a5wy/temp.key -password pass:" returned: 0 in 0.066s {{(pid=122319) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 05 02:36:31.163912 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e64cb900-0b6b-45e7-896a-43751ef6cffa tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:31.180558 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e64cb900-0b6b-45e7-896a-43751ef6cffa tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da" status: 200 len: 1321 microversion: 2.1 time: 0.366275 Oct 05 02:36:31.197336 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1126/2207] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:30 2022] GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da => generated 1321 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:31.206417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f086c817-1717-4d0d-a6a9-1d24657263c3 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:31.207293 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f086c817-1717-4d0d-a6a9-1d24657263c3 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:31.210905 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-c3628474-a953-4423-9500-5b9fcf5ef905 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Getting quotas for project 24a89b34668a47ecb247ded06342f961. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:36:31.223054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f086c817-1717-4d0d-a6a9-1d24657263c3 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:31.223824 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f086c817-1717-4d0d-a6a9-1d24657263c3 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:31.224632 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f086c817-1717-4d0d-a6a9-1d24657263c3 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:31.225644 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f086c817-1717-4d0d-a6a9-1d24657263c3 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:31.226690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f086c817-1717-4d0d-a6a9-1d24657263c3 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:31.227312 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f086c817-1717-4d0d-a6a9-1d24657263c3 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:31.238645 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-c3628474-a953-4423-9500-5b9fcf5ef905 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Getting quotas for user 2040ec6ce90c4184af3b0ad3c4ba932a and project 24a89b34668a47ecb247ded06342f961. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:36:31.279895 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c3628474-a953-4423-9500-5b9fcf5ef905 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.720586 Oct 05 02:36:31.282690 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1082/2208] 10.222.0.16 () {62 vars in 1198 bytes} [Wed Oct 5 02:36:30 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 725 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:36:31.291667 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-db458f31-d635-47f2-be78-369f0981eff9 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf638a60>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:31.344660 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f086c817-1717-4d0d-a6a9-1d24657263c3 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:31.357720 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f086c817-1717-4d0d-a6a9-1d24657263c3 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1184 microversion: 2.1 time: 0.159507 Oct 05 02:36:31.365162 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1127/2209] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:31 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1184 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:31.366909 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-db458f31-d635-47f2-be78-369f0981eff9 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd" status: 200 len: 1454 microversion: 2.1 time: 0.081684 Oct 05 02:36:31.371094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-492a0063-87e5-4251-978d-2d5761c10960 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:31.372015 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-492a0063-87e5-4251-978d-2d5761c10960 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 6cf0945c-2ca2-4803-ab89-adf554c92c51] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:31.377408 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1083/2210] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:31 2022] GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd => generated 1454 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:31.386790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-492a0063-87e5-4251-978d-2d5761c10960 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:31.387598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-492a0063-87e5-4251-978d-2d5761c10960 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:31.388297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-492a0063-87e5-4251-978d-2d5761c10960 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:31.392179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6ecb65f0-20fa-44a8-a689-43b915ca3951 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Calling method '.version_select at 0x7fccdf610430>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:31.393195 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-492a0063-87e5-4251-978d-2d5761c10960 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:31.393759 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-492a0063-87e5-4251-978d-2d5761c10960 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:31.394206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-492a0063-87e5-4251-978d-2d5761c10960 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:31.422203 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6ecb65f0-20fa-44a8-a689-43b915ca3951 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-1186462929" status: 200 len: 1534 microversion: 2.2 time: 0.042686 Oct 05 02:36:31.423531 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1084/2211] 10.222.0.16 () {60 vars in 1258 bytes} [Wed Oct 5 02:36:31 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1186462929 => generated 1534 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:31.437060 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-adaae61b-997a-4a33-a3d8-8db7b2a01ce0 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Calling method '.version_select at 0x7fccdf580430>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:31.443506 n-d-858272-3 devstack@n-api.service[122319]: WARNING oslo_db.sqlalchemy.utils [None req-adaae61b-997a-4a33-a3d8-8db7b2a01ce0 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 05 02:36:31.451239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:DELETE=4 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:31.454357 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-adaae61b-997a-4a33-a3d8-8db7b2a01ce0 tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.022948 Oct 05 02:36:31.455296 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1085/2212] 10.222.0.16 () {60 vars in 1177 bytes} [Wed Oct 5 02:36:31 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:36:31.467105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b39368c3-933c-4a99-9bcf-52212d9d113a tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] Calling method '.version_select at 0x7fccdf6744c0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:31.503081 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b39368c3-933c-4a99-9bcf-52212d9d113a tempest-KeyPairsV22TestJSON-203011293 tempest-KeyPairsV22TestJSON-203011293-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1186462929" status: 204 len: 0 microversion: 2.2 time: 0.040691 Oct 05 02:36:31.504931 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1086/2213] 10.222.0.16 () {60 vars in 1261 bytes} [Wed Oct 5 02:36:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1186462929 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:36:31.559708 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9e18c527-64bf-4830-be09-2256b6fd2bf4 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:31.560421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9e18c527-64bf-4830-be09-2256b6fd2bf4 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:31.576321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9e18c527-64bf-4830-be09-2256b6fd2bf4 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:31.576871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9e18c527-64bf-4830-be09-2256b6fd2bf4 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:31.579214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9e18c527-64bf-4830-be09-2256b6fd2bf4 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:31.580037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9e18c527-64bf-4830-be09-2256b6fd2bf4 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:31.580523 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9e18c527-64bf-4830-be09-2256b6fd2bf4 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:31.581002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9e18c527-64bf-4830-be09-2256b6fd2bf4 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:32.195476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9e18c527-64bf-4830-be09-2256b6fd2bf4 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:32.211004 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9e18c527-64bf-4830-be09-2256b6fd2bf4 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 200 len: 1355 microversion: 2.1 time: 0.657797 Oct 05 02:36:32.229034 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1087/2214] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:31 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 1355 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:32.241029 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4643b598-b438-49ef-8eba-4752fb53e496 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:32.242048 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4643b598-b438-49ef-8eba-4752fb53e496 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: e47438ff-463e-4a43-9767-8c78e8bb6e98] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:32.253665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4643b598-b438-49ef-8eba-4752fb53e496 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:32.254918 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4643b598-b438-49ef-8eba-4752fb53e496 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:32.255657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4643b598-b438-49ef-8eba-4752fb53e496 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:32.257804 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4643b598-b438-49ef-8eba-4752fb53e496 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:32.258453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4643b598-b438-49ef-8eba-4752fb53e496 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:32.259032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4643b598-b438-49ef-8eba-4752fb53e496 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:32.994488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-492a0063-87e5-4251-978d-2d5761c10960 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:33.004886 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-492a0063-87e5-4251-978d-2d5761c10960 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51" status: 200 len: 1318 microversion: 2.1 time: 1.638343 Oct 05 02:36:33.006009 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1128/2215] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:31 2022] GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51 => generated 1318 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:33.014172 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8de970b7-1e8b-4dc6-bfb7-6c01429283ee tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:33.021714 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8de970b7-1e8b-4dc6-bfb7-6c01429283ee tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: e3d6d4a6-f11c-4b42-9023-4729addcf3da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:33.032459 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8de970b7-1e8b-4dc6-bfb7-6c01429283ee tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:33.033436 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8de970b7-1e8b-4dc6-bfb7-6c01429283ee tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:33.034062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8de970b7-1e8b-4dc6-bfb7-6c01429283ee tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:33.035477 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8de970b7-1e8b-4dc6-bfb7-6c01429283ee tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:33.036100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8de970b7-1e8b-4dc6-bfb7-6c01429283ee tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:33.036823 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8de970b7-1e8b-4dc6-bfb7-6c01429283ee tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:33.236986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4643b598-b438-49ef-8eba-4752fb53e496 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:33.255409 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4643b598-b438-49ef-8eba-4752fb53e496 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98" status: 200 len: 1506 microversion: 2.1 time: 1.024351 Oct 05 02:36:33.256643 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1088/2216] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:32 2022] GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98 => generated 1506 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:33.261464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-50fa9f83-b537-4eae-b390-02cfd7e8c9c7 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf673ee0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:33.378690 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-50fa9f83-b537-4eae-b390-02cfd7e8c9c7 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd" status: 200 len: 1454 microversion: 2.1 time: 0.120144 Oct 05 02:36:33.381758 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1089/2217] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:33 2022] GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd => generated 1454 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:33.413761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ac9f9e62-b278-491f-9c8b-02e2d16b4380 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:33.415144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ac9f9e62-b278-491f-9c8b-02e2d16b4380 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:33.454538 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac9f9e62-b278-491f-9c8b-02e2d16b4380 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:33.455336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac9f9e62-b278-491f-9c8b-02e2d16b4380 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:33.456619 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac9f9e62-b278-491f-9c8b-02e2d16b4380 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:33.458878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac9f9e62-b278-491f-9c8b-02e2d16b4380 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:33.460673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac9f9e62-b278-491f-9c8b-02e2d16b4380 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:33.464802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac9f9e62-b278-491f-9c8b-02e2d16b4380 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:33.527734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8de970b7-1e8b-4dc6-bfb7-6c01429283ee tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:33.536562 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8de970b7-1e8b-4dc6-bfb7-6c01429283ee tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da" status: 200 len: 1321 microversion: 2.1 time: 0.529375 Oct 05 02:36:33.537728 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1129/2218] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:33 2022] GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da => generated 1321 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:33.547570 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-aacef953-efad-49ac-8034-349b6e07da85 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:33.550026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-aacef953-efad-49ac-8034-349b6e07da85 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:33.560658 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aacef953-efad-49ac-8034-349b6e07da85 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:33.562653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aacef953-efad-49ac-8034-349b6e07da85 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:33.564530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aacef953-efad-49ac-8034-349b6e07da85 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:33.566011 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aacef953-efad-49ac-8034-349b6e07da85 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:33.569795 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aacef953-efad-49ac-8034-349b6e07da85 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:33.574284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aacef953-efad-49ac-8034-349b6e07da85 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:33.697644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ac9f9e62-b278-491f-9c8b-02e2d16b4380 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:33.709000 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ac9f9e62-b278-491f-9c8b-02e2d16b4380 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1184 microversion: 2.1 time: 0.324562 Oct 05 02:36:33.709810 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1090/2219] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:33 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1184 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:33.739782 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3222752c-a0f3-4f15-8412-de1632380d01 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:33.740297 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3222752c-a0f3-4f15-8412-de1632380d01 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:33.754456 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3222752c-a0f3-4f15-8412-de1632380d01 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:33.754958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3222752c-a0f3-4f15-8412-de1632380d01 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:33.755670 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3222752c-a0f3-4f15-8412-de1632380d01 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:33.756431 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3222752c-a0f3-4f15-8412-de1632380d01 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:33.757066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3222752c-a0f3-4f15-8412-de1632380d01 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:33.757498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3222752c-a0f3-4f15-8412-de1632380d01 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:33.839971 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3222752c-a0f3-4f15-8412-de1632380d01 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d/os-volume_attachments/8880aa0a-d2ce-4492-b800-e66f925f235a" status: 200 len: 194 microversion: 2.20 time: 0.112318 Oct 05 02:36:33.841865 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1091/2220] 10.222.0.16 () {60 vars in 1454 bytes} [Wed Oct 5 02:36:33 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d/os-volume_attachments/8880aa0a-d2ce-4492-b800-e66f925f235a => generated 194 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:36:34.006602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0f1f33ac-9250-44c3-ab41-c0e82e3ecaa0 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:34.007669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0f1f33ac-9250-44c3-ab41-c0e82e3ecaa0 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:34.019329 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0f1f33ac-9250-44c3-ab41-c0e82e3ecaa0 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:34.026507 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0f1f33ac-9250-44c3-ab41-c0e82e3ecaa0 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:34.027394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0f1f33ac-9250-44c3-ab41-c0e82e3ecaa0 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:34.028380 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0f1f33ac-9250-44c3-ab41-c0e82e3ecaa0 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:34.033499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0f1f33ac-9250-44c3-ab41-c0e82e3ecaa0 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:34.038512 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0f1f33ac-9250-44c3-ab41-c0e82e3ecaa0 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:34.216356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-aacef953-efad-49ac-8034-349b6e07da85 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:34.226549 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-aacef953-efad-49ac-8034-349b6e07da85 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 200 len: 1355 microversion: 2.1 time: 0.687609 Oct 05 02:36:34.231633 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1130/2221] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:33 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 1355 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:34.239187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2804c3eb-9eb1-454a-8379-4ac1caf7457f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:34.240037 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2804c3eb-9eb1-454a-8379-4ac1caf7457f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 6cf0945c-2ca2-4803-ab89-adf554c92c51] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:34.251846 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2804c3eb-9eb1-454a-8379-4ac1caf7457f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:34.252697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2804c3eb-9eb1-454a-8379-4ac1caf7457f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:34.253963 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2804c3eb-9eb1-454a-8379-4ac1caf7457f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:34.255246 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2804c3eb-9eb1-454a-8379-4ac1caf7457f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:34.256080 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2804c3eb-9eb1-454a-8379-4ac1caf7457f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:34.256728 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2804c3eb-9eb1-454a-8379-4ac1caf7457f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:34.261799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:34.284583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-0f1f33ac-9250-44c3-ab41-c0e82e3ecaa0 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lazy-loading 'services' on Instance uuid 7a28c6ea-5b3d-4f74-b490-8effa4fa813d {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:36:34.433615 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0f1f33ac-9250-44c3-ab41-c0e82e3ecaa0 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d/os-volume_attachments/8880aa0a-d2ce-4492-b800-e66f925f235a" status: 202 len: 0 microversion: 2.20 time: 0.428803 Oct 05 02:36:34.435012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2804c3eb-9eb1-454a-8379-4ac1caf7457f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:34.439286 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1092/2222] 10.222.0.16 () {60 vars in 1457 bytes} [Wed Oct 5 02:36:34 2022] DELETE /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d/os-volume_attachments/8880aa0a-d2ce-4492-b800-e66f925f235a => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 05 02:36:34.444519 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2804c3eb-9eb1-454a-8379-4ac1caf7457f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51" status: 200 len: 1318 microversion: 2.1 time: 0.210670 Oct 05 02:36:34.445304 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1131/2223] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:34 2022] GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:34.450589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bde322d8-2a24-4a62-842a-126a4be49e04 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:34.452101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bde322d8-2a24-4a62-842a-126a4be49e04 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: e47438ff-463e-4a43-9767-8c78e8bb6e98] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:34.458969 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bde322d8-2a24-4a62-842a-126a4be49e04 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:34.459808 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bde322d8-2a24-4a62-842a-126a4be49e04 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:34.460519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bde322d8-2a24-4a62-842a-126a4be49e04 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:34.461523 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bde322d8-2a24-4a62-842a-126a4be49e04 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:34.462270 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bde322d8-2a24-4a62-842a-126a4be49e04 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:34.463500 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bde322d8-2a24-4a62-842a-126a4be49e04 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:34.475769 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-19c8b13c-d8cf-4ecf-93f5-5c0e642a6985 req-fd4786f3-f127-445c-b4ea-095311b7d556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3d6d4a6-f11c-4b42-9023-4729addcf3da", "name": "network-vif-plugged", "status": "completed", "tag": "c891fddd-0e94-442b-939e-a1a5cb5a9fde"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:34.502211 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-19c8b13c-d8cf-4ecf-93f5-5c0e642a6985 req-fd4786f3-f127-445c-b4ea-095311b7d556 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:34.502988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-19c8b13c-d8cf-4ecf-93f5-5c0e642a6985 req-fd4786f3-f127-445c-b4ea-095311b7d556 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:34.503580 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-19c8b13c-d8cf-4ecf-93f5-5c0e642a6985 req-fd4786f3-f127-445c-b4ea-095311b7d556 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:34.543900 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-19c8b13c-d8cf-4ecf-93f5-5c0e642a6985 req-fd4786f3-f127-445c-b4ea-095311b7d556 service nova] Creating event network-vif-plugged:c891fddd-0e94-442b-939e-a1a5cb5a9fde for instance e3d6d4a6-f11c-4b42-9023-4729addcf3da on n-h1-858272-3 Oct 05 02:36:34.559487 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-19c8b13c-d8cf-4ecf-93f5-5c0e642a6985 req-fd4786f3-f127-445c-b4ea-095311b7d556 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104640 Oct 05 02:36:34.560270 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1093/2224] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:34.697554 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bde322d8-2a24-4a62-842a-126a4be49e04 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:34.705439 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bde322d8-2a24-4a62-842a-126a4be49e04 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98" status: 200 len: 1506 microversion: 2.1 time: 0.258796 Oct 05 02:36:34.716925 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1132/2225] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:34 2022] GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98 => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:34.716925 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-abb41517-af56-4c5e-99cd-49f06666b5c1 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf72fe50>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:34.800129 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-abb41517-af56-4c5e-99cd-49f06666b5c1 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd" status: 200 len: 1454 microversion: 2.1 time: 0.093065 Oct 05 02:36:34.808580 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1133/2226] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:34 2022] GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:34.808580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dc4fc944-928e-493c-9cf4-7a6796b027cf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:34.813437 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dc4fc944-928e-493c-9cf4-7a6796b027cf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:34.827726 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dc4fc944-928e-493c-9cf4-7a6796b027cf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:34.828174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dc4fc944-928e-493c-9cf4-7a6796b027cf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:34.828618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dc4fc944-928e-493c-9cf4-7a6796b027cf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:34.829360 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dc4fc944-928e-493c-9cf4-7a6796b027cf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:34.829817 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dc4fc944-928e-493c-9cf4-7a6796b027cf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:34.830245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dc4fc944-928e-493c-9cf4-7a6796b027cf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:34.869951 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dc4fc944-928e-493c-9cf4-7a6796b027cf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068136 Oct 05 02:36:34.870765 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1134/2227] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 5 02:36:34 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:36:34.875886 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-821226fe-3409-417a-9b81-5b2d8cd7cf4e tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:34.876763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-821226fe-3409-417a-9b81-5b2d8cd7cf4e tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: e3d6d4a6-f11c-4b42-9023-4729addcf3da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:34.883320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-821226fe-3409-417a-9b81-5b2d8cd7cf4e tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:34.884816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-821226fe-3409-417a-9b81-5b2d8cd7cf4e tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:34.885601 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-821226fe-3409-417a-9b81-5b2d8cd7cf4e tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:34.886538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-821226fe-3409-417a-9b81-5b2d8cd7cf4e tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:34.887200 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-821226fe-3409-417a-9b81-5b2d8cd7cf4e tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:34.887829 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-821226fe-3409-417a-9b81-5b2d8cd7cf4e tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:34.915833 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4b653dc8-747f-4e7a-8270-62c8606b4864 tempest-AbsoluteLimitsNegativeTestJSON-1460804598 tempest-AbsoluteLimitsNegativeTestJSON-1460804598-project] Calling method '.version_select at 0x7fccdf673700>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:34.940371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4b653dc8-747f-4e7a-8270-62c8606b4864 tempest-AbsoluteLimitsNegativeTestJSON-1460804598 tempest-AbsoluteLimitsNegativeTestJSON-1460804598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:34.942996 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4b653dc8-747f-4e7a-8270-62c8606b4864 tempest-AbsoluteLimitsNegativeTestJSON-1460804598 tempest-AbsoluteLimitsNegativeTestJSON-1460804598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:34.942996 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4b653dc8-747f-4e7a-8270-62c8606b4864 tempest-AbsoluteLimitsNegativeTestJSON-1460804598 tempest-AbsoluteLimitsNegativeTestJSON-1460804598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:34.942996 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4b653dc8-747f-4e7a-8270-62c8606b4864 tempest-AbsoluteLimitsNegativeTestJSON-1460804598 tempest-AbsoluteLimitsNegativeTestJSON-1460804598-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:34.942996 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4b653dc8-747f-4e7a-8270-62c8606b4864 tempest-AbsoluteLimitsNegativeTestJSON-1460804598 tempest-AbsoluteLimitsNegativeTestJSON-1460804598-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:34.943491 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4b653dc8-747f-4e7a-8270-62c8606b4864 tempest-AbsoluteLimitsNegativeTestJSON-1460804598 tempest-AbsoluteLimitsNegativeTestJSON-1460804598-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:34.970563 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4b653dc8-747f-4e7a-8270-62c8606b4864 tempest-AbsoluteLimitsNegativeTestJSON-1460804598 tempest-AbsoluteLimitsNegativeTestJSON-1460804598-project] 10.222.0.16 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.407560 Oct 05 02:36:34.971188 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1094/2228] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:36:34 2022] GET /compute/v2.1/limits => generated 511 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:34.977306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7ed78296-bdb4-4714-b523-b6657740b213 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:34.978183 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7ed78296-bdb4-4714-b523-b6657740b213 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:34.994764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ed78296-bdb4-4714-b523-b6657740b213 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:34.995053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ed78296-bdb4-4714-b523-b6657740b213 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:34.995655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ed78296-bdb4-4714-b523-b6657740b213 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:34.996384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ed78296-bdb4-4714-b523-b6657740b213 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:34.996850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ed78296-bdb4-4714-b523-b6657740b213 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:34.998020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ed78296-bdb4-4714-b523-b6657740b213 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:35.109765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7ed78296-bdb4-4714-b523-b6657740b213 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:35.121596 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7ed78296-bdb4-4714-b523-b6657740b213 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1184 microversion: 2.1 time: 0.147279 Oct 05 02:36:35.124182 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1095/2229] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:34 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1184 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:35.127592 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-821226fe-3409-417a-9b81-5b2d8cd7cf4e tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:35.137130 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-821226fe-3409-417a-9b81-5b2d8cd7cf4e tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da" status: 200 len: 1321 microversion: 2.1 time: 0.265086 Oct 05 02:36:35.138586 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1135/2230] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:34 2022] GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da => generated 1321 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:35.159299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-768c41f9-c7c5-4e3c-ba64-93883a1f8729 tempest-AbsoluteLimitsNegativeTestJSON-1460804598 tempest-AbsoluteLimitsNegativeTestJSON-1460804598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-206874695", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:35.248205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-768c41f9-c7c5-4e3c-ba64-93883a1f8729 tempest-AbsoluteLimitsNegativeTestJSON-1460804598 tempest-AbsoluteLimitsNegativeTestJSON-1460804598-project] validate_networks() for None {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:36:35.253692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-72d6b108-17ea-400b-85f1-61a7022683c5 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:35.254437 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-72d6b108-17ea-400b-85f1-61a7022683c5 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:35.269091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72d6b108-17ea-400b-85f1-61a7022683c5 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:35.269937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72d6b108-17ea-400b-85f1-61a7022683c5 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:35.270435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72d6b108-17ea-400b-85f1-61a7022683c5 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:35.271217 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72d6b108-17ea-400b-85f1-61a7022683c5 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:35.271860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72d6b108-17ea-400b-85f1-61a7022683c5 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:35.272487 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72d6b108-17ea-400b-85f1-61a7022683c5 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:35.523156 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-72d6b108-17ea-400b-85f1-61a7022683c5 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:35.539981 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-72d6b108-17ea-400b-85f1-61a7022683c5 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 200 len: 1355 microversion: 2.1 time: 0.290219 Oct 05 02:36:35.541602 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1136/2231] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:35 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 1355 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:35.549623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d040cb2b-2a38-4c22-922f-45dc8248fd74 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:35.551137 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d040cb2b-2a38-4c22-922f-45dc8248fd74 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 6cf0945c-2ca2-4803-ab89-adf554c92c51] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:35.576346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d040cb2b-2a38-4c22-922f-45dc8248fd74 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:35.585674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d040cb2b-2a38-4c22-922f-45dc8248fd74 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:35.586892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d040cb2b-2a38-4c22-922f-45dc8248fd74 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:35.589099 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d040cb2b-2a38-4c22-922f-45dc8248fd74 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:35.590209 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d040cb2b-2a38-4c22-922f-45dc8248fd74 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:35.590979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d040cb2b-2a38-4c22-922f-45dc8248fd74 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:35.668694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-768c41f9-c7c5-4e3c-ba64-93883a1f8729 tempest-AbsoluteLimitsNegativeTestJSON-1460804598 tempest-AbsoluteLimitsNegativeTestJSON-1460804598-project] Getting quotas for project f3e80db441474690ae517c0c54e69926. Resources: dict_keys(['metadata_items']) {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:36:35.683250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-768c41f9-c7c5-4e3c-ba64-93883a1f8729 tempest-AbsoluteLimitsNegativeTestJSON-1460804598 tempest-AbsoluteLimitsNegativeTestJSON-1460804598-project] Getting quotas for user 0b6f39011b9d4bcba2ac2cd9c44a9de8 and project f3e80db441474690ae517c0c54e69926. Resources: dict_keys(['metadata_items']) {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:36:35.727201 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-768c41f9-c7c5-4e3c-ba64-93883a1f8729 tempest-AbsoluteLimitsNegativeTestJSON-1460804598 tempest-AbsoluteLimitsNegativeTestJSON-1460804598-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 05 02:36:35.733526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-768c41f9-c7c5-4e3c-ba64-93883a1f8729 tempest-AbsoluteLimitsNegativeTestJSON-1460804598 tempest-AbsoluteLimitsNegativeTestJSON-1460804598-project] Request method failure captured: Oct 05 02:36:35.733526 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 02:36:35.733526 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:36:35.733526 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:36:35.733526 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:36:35.733526 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 1751 Oct 05 02:36:35.733526 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:36:35.733526 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:36:35.733526 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:36:35.733526 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:36:35.733526 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO2yiVRH-mIOh_Ln2tCqnrfY8b57fKWkWHUW0rGW67bJ70IDTiYCqj41VQZ0ls2QJ4eDV9c9gwxJp9PRakM60LEy9NT1dUZ-Dy0v36lsOmalCvAcfdpm1XwnJpGYBp3PnuzsHDWwKQNVmkOF7ixY0nWzIuMqFsoX2KSmCxQ41AokxJc Oct 05 02:36:35.733526 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:36:35.733526 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:36:35.733526 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:36:35.733526 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:36:35.733526 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:36:35.733526 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:36:35.733526 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: f3e80db441474690ae517c0c54e69926 Oct 05 02:36:35.733526 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1460804598 Oct 05 02:36:35.733526 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:36:35.733526 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:36:35.733526 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f3e80db441474690ae517c0c54e69926"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f3e80db441474690ae517c0c54e69926"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f3e80db441474690ae517c0c54e69926"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f3e80db441474690ae517c0c54e69926"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:36:35.733526 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1460804598 Oct 05 02:36:35.733526 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: f3e80db441474690ae517c0c54e69926 Oct 05 02:36:35.733526 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1460804598 Oct 05 02:36:35.733526 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1460804598-project Oct 05 02:36:35.733526 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:36:35.733526 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:36:35.733526 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 0b6f39011b9d4bcba2ac2cd9c44a9de8 Oct 05 02:36:35.733526 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1460804598-project Oct 05 02:36:35.733526 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:36:35.733526 n-d-858272-3 devstack@n-api.service[122319]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-206874695", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 05 02:36:35.733526 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:36:35.733526 n-d-858272-3 devstack@n-api.service[122319]: exception: Maximum number of metadata items exceeds 128 Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-206874695', 'imageRef': 'adad3215-1ca6-43bb-9981-0d01aff146ab', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:36:35.735598 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:36:35.740036 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:36:35.740036 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 05 02:36:35.740036 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 05 02:36:35.740036 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 05 02:36:35.740036 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 05 02:36:35.740036 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:35.740036 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:35.740036 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:35.740036 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:35.740036 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:35.740036 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:35.740036 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:36:35.740036 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:36:35.740036 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 05 02:36:35.740036 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:35.740036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-768c41f9-c7c5-4e3c-ba64-93883a1f8729 tempest-AbsoluteLimitsNegativeTestJSON-1460804598 tempest-AbsoluteLimitsNegativeTestJSON-1460804598-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:36:35.740036 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-768c41f9-c7c5-4e3c-ba64-93883a1f8729 tempest-AbsoluteLimitsNegativeTestJSON-1460804598 tempest-AbsoluteLimitsNegativeTestJSON-1460804598-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.610462 Oct 05 02:36:35.740036 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1096/2232] 10.222.0.16 () {60 vars in 1148 bytes} [Wed Oct 5 02:36:35 2022] POST /compute/v2.1/servers => generated 87 bytes in 612 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:36:35.770335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2a35b3a9-b998-40ff-a4cb-5889a51b4979 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:35.771255 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2a35b3a9-b998-40ff-a4cb-5889a51b4979 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: e47438ff-463e-4a43-9767-8c78e8bb6e98] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:35.789463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a35b3a9-b998-40ff-a4cb-5889a51b4979 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:35.790022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a35b3a9-b998-40ff-a4cb-5889a51b4979 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:35.791153 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a35b3a9-b998-40ff-a4cb-5889a51b4979 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:35.791979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a35b3a9-b998-40ff-a4cb-5889a51b4979 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:35.795697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a35b3a9-b998-40ff-a4cb-5889a51b4979 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:35.796282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a35b3a9-b998-40ff-a4cb-5889a51b4979 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:35.858799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d040cb2b-2a38-4c22-922f-45dc8248fd74 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:35.871254 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d040cb2b-2a38-4c22-922f-45dc8248fd74 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51" status: 200 len: 1318 microversion: 2.1 time: 0.328074 Oct 05 02:36:35.871870 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1137/2233] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:35 2022] GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51 => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:35.879939 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-72707d1d-4f5e-4642-ba9a-70010edb044f tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce8137790>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:35.958563 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-72707d1d-4f5e-4642-ba9a-70010edb044f tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd" status: 200 len: 1454 microversion: 2.1 time: 0.085445 Oct 05 02:36:35.970461 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1138/2234] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:35 2022] GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd => generated 1454 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:35.976407 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a6054b32-cf28-4222-8c91-16dfa7d85cb5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:35.979501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a6054b32-cf28-4222-8c91-16dfa7d85cb5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:35.986448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6054b32-cf28-4222-8c91-16dfa7d85cb5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:35.986957 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6054b32-cf28-4222-8c91-16dfa7d85cb5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:35.987405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6054b32-cf28-4222-8c91-16dfa7d85cb5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:35.988201 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6054b32-cf28-4222-8c91-16dfa7d85cb5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:35.988590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6054b32-cf28-4222-8c91-16dfa7d85cb5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:35.989059 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6054b32-cf28-4222-8c91-16dfa7d85cb5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:36.071444 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a6054b32-cf28-4222-8c91-16dfa7d85cb5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.099732 Oct 05 02:36:36.073429 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1139/2235] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 5 02:36:35 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:36:36.100947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2a35b3a9-b998-40ff-a4cb-5889a51b4979 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:36.116197 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2a35b3a9-b998-40ff-a4cb-5889a51b4979 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98" status: 200 len: 1506 microversion: 2.1 time: 0.354754 Oct 05 02:36:36.145221 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1097/2236] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:35 2022] GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98 => generated 1506 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:36.150776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4f892a2a-e864-44dd-93b8-de54816c7aa4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:36.151341 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4f892a2a-e864-44dd-93b8-de54816c7aa4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:36.163716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f892a2a-e864-44dd-93b8-de54816c7aa4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:36.167736 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f892a2a-e864-44dd-93b8-de54816c7aa4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:36.168615 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cfc2c5d7-0d91-4cf4-9582-dda482255529 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:36.170520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cfc2c5d7-0d91-4cf4-9582-dda482255529 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: e3d6d4a6-f11c-4b42-9023-4729addcf3da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:36.172511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f892a2a-e864-44dd-93b8-de54816c7aa4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:36.173571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f892a2a-e864-44dd-93b8-de54816c7aa4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:36.177532 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f892a2a-e864-44dd-93b8-de54816c7aa4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:36.179097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f892a2a-e864-44dd-93b8-de54816c7aa4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:36.185819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cfc2c5d7-0d91-4cf4-9582-dda482255529 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:36.189508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cfc2c5d7-0d91-4cf4-9582-dda482255529 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:36.190139 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cfc2c5d7-0d91-4cf4-9582-dda482255529 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:36.195746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cfc2c5d7-0d91-4cf4-9582-dda482255529 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:36.197459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cfc2c5d7-0d91-4cf4-9582-dda482255529 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:36.198976 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cfc2c5d7-0d91-4cf4-9582-dda482255529 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:36.368300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4f892a2a-e864-44dd-93b8-de54816c7aa4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:36.382644 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4f892a2a-e864-44dd-93b8-de54816c7aa4 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 200 len: 1184 microversion: 2.1 time: 0.237625 Oct 05 02:36:36.388774 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1140/2237] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:36 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 1184 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:36:36.546385 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cfc2c5d7-0d91-4cf4-9582-dda482255529 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:36.561546 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cfc2c5d7-0d91-4cf4-9582-dda482255529 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da" status: 200 len: 1321 microversion: 2.1 time: 0.401285 Oct 05 02:36:36.562696 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1098/2238] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:36 2022] GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da => generated 1321 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:36:36.571595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-11443431-a05f-4b1b-a4ca-fb56774aff65 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:36.573245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-11443431-a05f-4b1b-a4ca-fb56774aff65 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:36.580791 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11443431-a05f-4b1b-a4ca-fb56774aff65 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:36.581590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11443431-a05f-4b1b-a4ca-fb56774aff65 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:36.582232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11443431-a05f-4b1b-a4ca-fb56774aff65 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:36.583098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11443431-a05f-4b1b-a4ca-fb56774aff65 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:36.583773 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11443431-a05f-4b1b-a4ca-fb56774aff65 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:36.584354 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11443431-a05f-4b1b-a4ca-fb56774aff65 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:36.774572 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-b846817a-a9ce-4e42-ab87-2fcac514665f req-4a431b16-9d20-47b8-8e02-ea2fa94e3b73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e47438ff-463e-4a43-9767-8c78e8bb6e98", "name": "network-vif-plugged", "status": "completed", "tag": "d17e6d68-21a3-4fc2-9ded-814bf288d29c"}, {"server_uuid": "1d0e63ee-ba8d-4203-9cd5-f13d833de668", "name": "network-vif-plugged", "status": "completed", "tag": "1f6198cb-46e6-468f-99fa-33f57b082af5"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:36.847794 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b846817a-a9ce-4e42-ab87-2fcac514665f req-4a431b16-9d20-47b8-8e02-ea2fa94e3b73 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:36.854047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b846817a-a9ce-4e42-ab87-2fcac514665f req-4a431b16-9d20-47b8-8e02-ea2fa94e3b73 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:36.857603 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b846817a-a9ce-4e42-ab87-2fcac514665f req-4a431b16-9d20-47b8-8e02-ea2fa94e3b73 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:36.954699 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-b846817a-a9ce-4e42-ab87-2fcac514665f req-4a431b16-9d20-47b8-8e02-ea2fa94e3b73 service nova] Creating event network-vif-plugged:d17e6d68-21a3-4fc2-9ded-814bf288d29c for instance e47438ff-463e-4a43-9767-8c78e8bb6e98 on n-h1-858272-3 Oct 05 02:36:36.955456 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-b846817a-a9ce-4e42-ab87-2fcac514665f req-4a431b16-9d20-47b8-8e02-ea2fa94e3b73 service nova] Creating event network-vif-plugged:1f6198cb-46e6-468f-99fa-33f57b082af5 for instance 1d0e63ee-ba8d-4203-9cd5-f13d833de668 on n-h2-858272-3 Oct 05 02:36:37.011867 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-b846817a-a9ce-4e42-ab87-2fcac514665f req-4a431b16-9d20-47b8-8e02-ea2fa94e3b73 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.265926 Oct 05 02:36:37.015485 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1099/2239] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:36:37.029566 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1d6d4b67-1065-42e4-980a-9093b19c987c tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:37.032418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1d6d4b67-1065-42e4-980a-9093b19c987c tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 6cf0945c-2ca2-4803-ab89-adf554c92c51] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:37.049694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d6d4b67-1065-42e4-980a-9093b19c987c tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:37.052031 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d6d4b67-1065-42e4-980a-9093b19c987c tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:37.052745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d6d4b67-1065-42e4-980a-9093b19c987c tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:37.055194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d6d4b67-1065-42e4-980a-9093b19c987c tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:37.057139 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d6d4b67-1065-42e4-980a-9093b19c987c tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:37.057831 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d6d4b67-1065-42e4-980a-9093b19c987c tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:37.123540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-11443431-a05f-4b1b-a4ca-fb56774aff65 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:37.135346 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-11443431-a05f-4b1b-a4ca-fb56774aff65 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 200 len: 1355 microversion: 2.1 time: 0.566433 Oct 05 02:36:37.136178 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1141/2240] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:36 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 1355 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:36:37.146726 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b257d327-be2f-41a9-96be-e543a40da087 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce8106e50>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:37.256352 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b257d327-be2f-41a9-96be-e543a40da087 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd" status: 200 len: 1454 microversion: 2.1 time: 0.119067 Oct 05 02:36:37.265847 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1142/2241] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:37 2022] GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd => generated 1454 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:37.285119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a8f405c6-1897-4dbd-9ebf-dddc020de3c7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:37.289654 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a8f405c6-1897-4dbd-9ebf-dddc020de3c7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:37.304037 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8f405c6-1897-4dbd-9ebf-dddc020de3c7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:37.304726 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8f405c6-1897-4dbd-9ebf-dddc020de3c7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:37.305343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8f405c6-1897-4dbd-9ebf-dddc020de3c7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:37.306924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8f405c6-1897-4dbd-9ebf-dddc020de3c7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:37.308241 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8f405c6-1897-4dbd-9ebf-dddc020de3c7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:37.308828 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8f405c6-1897-4dbd-9ebf-dddc020de3c7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:37.347141 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a8f405c6-1897-4dbd-9ebf-dddc020de3c7 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079928 Oct 05 02:36:37.347986 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1143/2242] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 5 02:36:37 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:36:37.355847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4a3b82c7-a53d-452b-9359-54fb9a8fadce tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:37.357019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4a3b82c7-a53d-452b-9359-54fb9a8fadce tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: e47438ff-463e-4a43-9767-8c78e8bb6e98] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:37.364157 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a3b82c7-a53d-452b-9359-54fb9a8fadce tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:37.364931 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a3b82c7-a53d-452b-9359-54fb9a8fadce tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:37.365533 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a3b82c7-a53d-452b-9359-54fb9a8fadce tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:37.366410 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a3b82c7-a53d-452b-9359-54fb9a8fadce tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:37.367019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a3b82c7-a53d-452b-9359-54fb9a8fadce tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:37.367592 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a3b82c7-a53d-452b-9359-54fb9a8fadce tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:37.395412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1d6d4b67-1065-42e4-980a-9093b19c987c tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:37.397830 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:37.414671 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1d6d4b67-1065-42e4-980a-9093b19c987c tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51" status: 200 len: 1318 microversion: 2.1 time: 0.391667 Oct 05 02:36:37.434865 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1100/2243] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:37 2022] GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51 => generated 1318 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:37.441780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a1ffa551-377a-483d-91d2-f1c4af6120ed tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:37.442706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a1ffa551-377a-483d-91d2-f1c4af6120ed tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 1f4b118a-e665-4c29-a518-811ca1fc9001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:37.449928 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a1ffa551-377a-483d-91d2-f1c4af6120ed tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:37.450684 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a1ffa551-377a-483d-91d2-f1c4af6120ed tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:37.451496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a1ffa551-377a-483d-91d2-f1c4af6120ed tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:37.452510 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a1ffa551-377a-483d-91d2-f1c4af6120ed tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:37.453179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a1ffa551-377a-483d-91d2-f1c4af6120ed tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:37.453772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a1ffa551-377a-483d-91d2-f1c4af6120ed tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:37.472833 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-a1ffa551-377a-483d-91d2-f1c4af6120ed tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] HTTP exception thrown: Instance 1f4b118a-e665-4c29-a518-811ca1fc9001 could not be found. Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a1ffa551-377a-483d-91d2-f1c4af6120ed tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Request method failure captured: Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 HTTP/1.1 Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOvNe8KhpGZ8DG_1oOvLGb0DCJaF37J8SQNLdwbipKbLuSq3872FLJ_shjUOOozYCqstc1rgVms0er1jsbYXWmNBMApk_YXcsVG10Fg4W_uHLlDzKjEVUZHLAbuWJUnRLXE0v-DNCHykp-Beue_j-q1szQrJD4sNhb_g_7AcfhuUWUI Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 6652917123e14c2797cafacc4e31f75a Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-LiveMigrationTest-256153741 Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6652917123e14c2797cafacc4e31f75a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6652917123e14c2797cafacc4e31f75a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6652917123e14c2797cafacc4e31f75a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6652917123e14c2797cafacc4e31f75a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-LiveMigrationTest-256153741 Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 6652917123e14c2797cafacc4e31f75a Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-LiveMigrationTest-256153741 Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-LiveMigrationTest-256153741-project Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 118c1425677b45b98689befb0eb55cce Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-LiveMigrationTest-256153741-project Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 1f4b118a-e665-4c29-a518-811ca1fc9001 could not be found. Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '1f4b118a-e665-4c29-a518-811ca1fc9001'} Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f4b118a-e665-4c29-a518-811ca1fc9001 could not be found. Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f4b118a-e665-4c29-a518-811ca1fc9001 could not be found. Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:37.474930 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:37.479969 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:37.479969 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:37.479969 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:37.479969 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:36:37.479969 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:36:37.479969 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f4b118a-e665-4c29-a518-811ca1fc9001 could not be found. Oct 05 02:36:37.479969 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:37.479969 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a1ffa551-377a-483d-91d2-f1c4af6120ed tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Returning 404 to user: Instance 1f4b118a-e665-4c29-a518-811ca1fc9001 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:36:37.479969 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a1ffa551-377a-483d-91d2-f1c4af6120ed tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001" status: 404 len: 111 microversion: 2.1 time: 0.040331 Oct 05 02:36:37.479969 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1101/2244] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:37 2022] GET /compute/v2.1/servers/1f4b118a-e665-4c29-a518-811ca1fc9001 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:36:37.588790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0fd44098-b090-4e9c-bbaa-0ad4a25e825d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:37.589500 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0fd44098-b090-4e9c-bbaa-0ad4a25e825d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: e3d6d4a6-f11c-4b42-9023-4729addcf3da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:37.605434 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0fd44098-b090-4e9c-bbaa-0ad4a25e825d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:37.605955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0fd44098-b090-4e9c-bbaa-0ad4a25e825d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:37.606664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0fd44098-b090-4e9c-bbaa-0ad4a25e825d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:37.607425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0fd44098-b090-4e9c-bbaa-0ad4a25e825d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:37.608937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0fd44098-b090-4e9c-bbaa-0ad4a25e825d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:37.616801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0fd44098-b090-4e9c-bbaa-0ad4a25e825d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:37.647133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4a3b82c7-a53d-452b-9359-54fb9a8fadce tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:37.660330 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4a3b82c7-a53d-452b-9359-54fb9a8fadce tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98" status: 200 len: 1501 microversion: 2.1 time: 0.310285 Oct 05 02:36:37.663150 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1144/2245] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:37 2022] GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98 => generated 1501 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:37.924162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0fd44098-b090-4e9c-bbaa-0ad4a25e825d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:37.938150 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0fd44098-b090-4e9c-bbaa-0ad4a25e825d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da" status: 200 len: 1470 microversion: 2.1 time: 0.357654 Oct 05 02:36:37.939331 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1102/2246] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:37 2022] GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da => generated 1470 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:36:38.160637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-24d3d976-2155-4116-882e-0b6be4a3f14b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:38.161872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-24d3d976-2155-4116-882e-0b6be4a3f14b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:38.172379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-24d3d976-2155-4116-882e-0b6be4a3f14b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:38.172945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-24d3d976-2155-4116-882e-0b6be4a3f14b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:38.173393 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-24d3d976-2155-4116-882e-0b6be4a3f14b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:38.174116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-24d3d976-2155-4116-882e-0b6be4a3f14b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:38.177473 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-24d3d976-2155-4116-882e-0b6be4a3f14b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:38.178257 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-24d3d976-2155-4116-882e-0b6be4a3f14b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:38.302410 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bb003ad9-8586-4d96-b9e5-774481075a4f tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:38.303209 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bb003ad9-8586-4d96-b9e5-774481075a4f tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] [instance: b58a0001-284c-4968-8d43-961f5cb1e9aa] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:38.312796 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-bb003ad9-8586-4d96-b9e5-774481075a4f tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] HTTP exception thrown: Instance b58a0001-284c-4968-8d43-961f5cb1e9aa could not be found. Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bb003ad9-8586-4d96-b9e5-774481075a4f tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Request method failure captured: Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers/b58a0001-284c-4968-8d43-961f5cb1e9aa/action HTTP/1.1 Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 15 Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO2aMDuwSSy5VcX_4zm_uoAOsfmKlJbydPjk2ePoYxoFHiWOPANt0AbpMhaL0pNiUWGhl4KUEwQOd2JdfpG11Tkinp6gerJcfwFMQYFaGYEkNAL2yyoGNd3eO-BCo6w4CVvBwEG1ei5qwg3e05_4F9XKk6Z3buS0EWR-OZKw_wQ4fCI Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 071483f03fe14dc58fbd18ee9f167372 Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1972053832 Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: X-Role: admin,member,reader Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: admin,member,reader Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/071483f03fe14dc58fbd18ee9f167372"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/071483f03fe14dc58fbd18ee9f167372"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/071483f03fe14dc58fbd18ee9f167372"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_071483f03fe14dc58fbd18ee9f167372"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1972053832 Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 071483f03fe14dc58fbd18ee9f167372 Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1972053832 Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersAdminNegativeTestJSON-1972053832-project-admin Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 5f174aa8d19d4073a57d9c60fb11c10c Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1972053832-project-admin Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: {"migrate": {}} Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance b58a0001-284c-4968-8d43-961f5cb1e9aa could not be found. Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'b58a0001-284c-4968-8d43-961f5cb1e9aa', 'body': {'migrate': {}}} Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b58a0001-284c-4968-8d43-961f5cb1e9aa could not be found. Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b58a0001-284c-4968-8d43-961f5cb1e9aa could not be found. Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:38.316407 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:38.320782 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:38.320782 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:38.320782 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:36:38.320782 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:36:38.320782 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b58a0001-284c-4968-8d43-961f5cb1e9aa could not be found. Oct 05 02:36:38.320782 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:38.323398 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bb003ad9-8586-4d96-b9e5-774481075a4f tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Returning 404 to user: Instance b58a0001-284c-4968-8d43-961f5cb1e9aa could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:36:38.326176 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bb003ad9-8586-4d96-b9e5-774481075a4f tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/b58a0001-284c-4968-8d43-961f5cb1e9aa/action" status: 404 len: 111 microversion: 2.1 time: 0.366261 Oct 05 02:36:38.326961 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1145/2247] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:36:37 2022] POST /compute/v2.1/servers/b58a0001-284c-4968-8d43-961f5cb1e9aa/action => generated 111 bytes in 368 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:36:38.346244 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cc72b14f-0266-402f-a8ce-7e3258fd5151 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf76aee0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:38.444313 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cc72b14f-0266-402f-a8ce-7e3258fd5151 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd" status: 200 len: 1454 microversion: 2.1 time: 0.114959 Oct 05 02:36:38.455810 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1146/2248] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:38 2022] GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd => generated 1454 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:38.469053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ea9cadd2-ff8b-4020-8d51-2046b3efbc8a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:38.472565 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ea9cadd2-ff8b-4020-8d51-2046b3efbc8a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:38.482271 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea9cadd2-ff8b-4020-8d51-2046b3efbc8a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:38.482971 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea9cadd2-ff8b-4020-8d51-2046b3efbc8a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:38.483675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea9cadd2-ff8b-4020-8d51-2046b3efbc8a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:38.484555 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea9cadd2-ff8b-4020-8d51-2046b3efbc8a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:38.485407 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea9cadd2-ff8b-4020-8d51-2046b3efbc8a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:38.486009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea9cadd2-ff8b-4020-8d51-2046b3efbc8a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:38.541345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-24d3d976-2155-4116-882e-0b6be4a3f14b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:38.562921 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-24d3d976-2155-4116-882e-0b6be4a3f14b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 200 len: 1355 microversion: 2.1 time: 0.407611 Oct 05 02:36:38.563694 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1103/2249] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:38 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 1355 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:38.571392 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ea9cadd2-ff8b-4020-8d51-2046b3efbc8a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.108837 Oct 05 02:36:38.573935 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b439154e-4c22-4456-a136-8d866c5dbbcd tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:38.574921 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b439154e-4c22-4456-a136-8d866c5dbbcd tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 6cf0945c-2ca2-4803-ab89-adf554c92c51] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:38.576968 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1147/2250] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 5 02:36:38 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:36:38.582604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b439154e-4c22-4456-a136-8d866c5dbbcd tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:38.583297 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b439154e-4c22-4456-a136-8d866c5dbbcd tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:38.583938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b439154e-4c22-4456-a136-8d866c5dbbcd tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:38.584797 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b439154e-4c22-4456-a136-8d866c5dbbcd tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:38.585531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b439154e-4c22-4456-a136-8d866c5dbbcd tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:38.586239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b439154e-4c22-4456-a136-8d866c5dbbcd tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:38.588165 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0e2e1452-fb04-437d-9196-2cf420cb40b9 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-532746071", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:38.690261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-0e2e1452-fb04-437d-9196-2cf420cb40b9 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] validate_networks() for None {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:36:39.023673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b439154e-4c22-4456-a136-8d866c5dbbcd tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:39.037059 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b439154e-4c22-4456-a136-8d866c5dbbcd tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51" status: 200 len: 1318 microversion: 2.1 time: 0.468150 Oct 05 02:36:39.038040 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1104/2251] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:38 2022] GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51 => generated 1318 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:39.045984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2f1309ec-eb56-4cd8-9821-3a8e81905145 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:39.046594 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2f1309ec-eb56-4cd8-9821-3a8e81905145 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: e47438ff-463e-4a43-9767-8c78e8bb6e98] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:39.073295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f1309ec-eb56-4cd8-9821-3a8e81905145 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:39.074057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f1309ec-eb56-4cd8-9821-3a8e81905145 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:39.074736 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f1309ec-eb56-4cd8-9821-3a8e81905145 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:39.075817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f1309ec-eb56-4cd8-9821-3a8e81905145 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:39.076390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f1309ec-eb56-4cd8-9821-3a8e81905145 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:39.076940 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f1309ec-eb56-4cd8-9821-3a8e81905145 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:39.083810 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-0e2e1452-fb04-437d-9196-2cf420cb40b9 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:36:39.085636 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-0e2e1452-fb04-437d-9196-2cf420cb40b9 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:36:39.086680 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-0e2e1452-fb04-437d-9196-2cf420cb40b9 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:36:39.086766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-0e2e1452-fb04-437d-9196-2cf420cb40b9 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:36:39.087140 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-0e2e1452-fb04-437d-9196-2cf420cb40b9 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:36:39.109598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e2e1452-fb04-437d-9196-2cf420cb40b9 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:39.110585 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e2e1452-fb04-437d-9196-2cf420cb40b9 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:39.112248 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e2e1452-fb04-437d-9196-2cf420cb40b9 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:39.114906 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e2e1452-fb04-437d-9196-2cf420cb40b9 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:39.116301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e2e1452-fb04-437d-9196-2cf420cb40b9 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:39.117336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e2e1452-fb04-437d-9196-2cf420cb40b9 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:39.164021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-0e2e1452-fb04-437d-9196-2cf420cb40b9 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Getting quotas for project eccc732cf08749648be251ca96d18cd1. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:36:39.182202 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-0e2e1452-fb04-437d-9196-2cf420cb40b9 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Getting quotas for user 83a280fd56304b47acca3f0b4061e18a and project eccc732cf08749648be251ca96d18cd1. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:36:39.213242 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0e2e1452-fb04-437d-9196-2cf420cb40b9 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:36:39.216945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0e2e1452-fb04-437d-9196-2cf420cb40b9 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: 5f395291-91f2-4958-bf8c-6c4d4adb0c9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:36:39.289262 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2f1309ec-eb56-4cd8-9821-3a8e81905145 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:39.301504 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2f1309ec-eb56-4cd8-9821-3a8e81905145 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98" status: 200 len: 1488 microversion: 2.1 time: 0.262621 Oct 05 02:36:39.305614 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1105/2252] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:39 2022] GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98 => generated 1488 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:39.311947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-9ea3d976-168f-437b-bfd1-7bc1a6ca345e req-a913b6e2-2c1a-428b-bfeb-570133f3040a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d0e63ee-ba8d-4203-9cd5-f13d833de668", "name": "network-vif-plugged", "status": "completed", "tag": "2e61d503-74a8-4e51-878c-815eee17f241"}, {"server_uuid": "6cf0945c-2ca2-4803-ab89-adf554c92c51", "name": "network-vif-plugged", "status": "completed", "tag": "f6e6392b-8cd7-4c22-85db-cc379ca54ac8"}, {"server_uuid": "1d0e63ee-ba8d-4203-9cd5-f13d833de668", "name": "network-vif-plugged", "status": "completed", "tag": "bcf2876a-f110-4231-b6e1-99589b34eab3"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:39.327390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9ea3d976-168f-437b-bfd1-7bc1a6ca345e req-a913b6e2-2c1a-428b-bfeb-570133f3040a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:39.328194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9ea3d976-168f-437b-bfd1-7bc1a6ca345e req-a913b6e2-2c1a-428b-bfeb-570133f3040a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:39.341174 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9ea3d976-168f-437b-bfd1-7bc1a6ca345e req-a913b6e2-2c1a-428b-bfeb-570133f3040a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:39.341396 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0e2e1452-fb04-437d-9196-2cf420cb40b9 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.763138 Oct 05 02:36:39.342161 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1148/2253] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:36:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:36:39.355019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-088c49ed-1408-440e-b8a9-2dc9b1b7bb95 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:39.355519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-088c49ed-1408-440e-b8a9-2dc9b1b7bb95 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: e47438ff-463e-4a43-9767-8c78e8bb6e98] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:39.373147 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-9ea3d976-168f-437b-bfd1-7bc1a6ca345e req-a913b6e2-2c1a-428b-bfeb-570133f3040a service nova] Creating event network-vif-plugged:2e61d503-74a8-4e51-878c-815eee17f241 for instance 1d0e63ee-ba8d-4203-9cd5-f13d833de668 on n-h2-858272-3 Oct 05 02:36:39.374035 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-9ea3d976-168f-437b-bfd1-7bc1a6ca345e req-a913b6e2-2c1a-428b-bfeb-570133f3040a service nova] Creating event network-vif-plugged:f6e6392b-8cd7-4c22-85db-cc379ca54ac8 for instance 6cf0945c-2ca2-4803-ab89-adf554c92c51 on n-h1-858272-3 Oct 05 02:36:39.374941 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-9ea3d976-168f-437b-bfd1-7bc1a6ca345e req-a913b6e2-2c1a-428b-bfeb-570133f3040a service nova] Creating event network-vif-plugged:bcf2876a-f110-4231-b6e1-99589b34eab3 for instance 1d0e63ee-ba8d-4203-9cd5-f13d833de668 on n-h2-858272-3 Oct 05 02:36:39.394582 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-088c49ed-1408-440e-b8a9-2dc9b1b7bb95 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:39.395078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-088c49ed-1408-440e-b8a9-2dc9b1b7bb95 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:39.395572 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-088c49ed-1408-440e-b8a9-2dc9b1b7bb95 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:39.396356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-088c49ed-1408-440e-b8a9-2dc9b1b7bb95 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:39.404730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-088c49ed-1408-440e-b8a9-2dc9b1b7bb95 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:39.406396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-088c49ed-1408-440e-b8a9-2dc9b1b7bb95 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:39.407825 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-9ea3d976-168f-437b-bfd1-7bc1a6ca345e req-a913b6e2-2c1a-428b-bfeb-570133f3040a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.100261 Oct 05 02:36:39.409574 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1106/2254] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:39.420735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-73b832fb-db9e-4dcb-860b-7921adb1e49a tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:39.422529 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-73b832fb-db9e-4dcb-860b-7921adb1e49a tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: 5f395291-91f2-4958-bf8c-6c4d4adb0c9f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:39.523232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-088c49ed-1408-440e-b8a9-2dc9b1b7bb95 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: e47438ff-463e-4a43-9767-8c78e8bb6e98] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:36:39.585775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-73b832fb-db9e-4dcb-860b-7921adb1e49a tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:39.600380 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-73b832fb-db9e-4dcb-860b-7921adb1e49a tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f" status: 200 len: 1221 microversion: 2.1 time: 0.188285 Oct 05 02:36:39.616548 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1107/2255] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:39 2022] GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f => generated 1221 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:39.616548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3ffd166e-4c52-42b1-b224-06e6822e478e tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf587790>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:39.710292 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3ffd166e-4c52-42b1-b224-06e6822e478e tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd" status: 200 len: 1454 microversion: 2.1 time: 0.107264 Oct 05 02:36:39.715160 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1108/2256] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:39 2022] GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd => generated 1454 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:39.727090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-af1b0ef0-11c9-400d-9831-437b5460d79c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:39.734107 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-af1b0ef0-11c9-400d-9831-437b5460d79c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:39.741229 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-088c49ed-1408-440e-b8a9-2dc9b1b7bb95 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98" status: 204 len: 0 microversion: 2.1 time: 0.390073 Oct 05 02:36:39.750604 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1149/2257] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:36:39 2022] DELETE /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:36:39.752631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af1b0ef0-11c9-400d-9831-437b5460d79c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:39.753200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af1b0ef0-11c9-400d-9831-437b5460d79c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:39.753593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af1b0ef0-11c9-400d-9831-437b5460d79c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:39.754388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af1b0ef0-11c9-400d-9831-437b5460d79c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:39.754926 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af1b0ef0-11c9-400d-9831-437b5460d79c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:39.756233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af1b0ef0-11c9-400d-9831-437b5460d79c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:39.756371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-94de73c6-41d1-4b70-907d-6d97d73e031f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:39.757311 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-94de73c6-41d1-4b70-907d-6d97d73e031f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:39.766821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94de73c6-41d1-4b70-907d-6d97d73e031f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:39.767320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94de73c6-41d1-4b70-907d-6d97d73e031f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:39.768138 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94de73c6-41d1-4b70-907d-6d97d73e031f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:39.769153 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94de73c6-41d1-4b70-907d-6d97d73e031f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:39.769796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94de73c6-41d1-4b70-907d-6d97d73e031f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:39.770366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94de73c6-41d1-4b70-907d-6d97d73e031f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:39.834300 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-af1b0ef0-11c9-400d-9831-437b5460d79c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.117811 Oct 05 02:36:39.835306 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1109/2258] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 5 02:36:39 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:36:39.850960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a44c1592-f495-4b98-9ae2-806243f5dcf7 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fccdf5ed160>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:39.926612 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-a44c1592-f495-4b98-9ae2-806243f5dcf7 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] HTTP exception thrown: Image not found. Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a44c1592-f495-4b98-9ae2-806243f5dcf7 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Request method failure captured: Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/images/12119e1b-1ded-4ca3-8237-14840e2879e1 HTTP/1.1 Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOyncnz_Xr9P8nn_Dn2jWOBPMfB25oKlwUdkb-lAovWLOcnbWbWtB8EupA339z8n4CLPU4Xvp4t38IgdhTeSkNNsbZcCHuTGeDJ3SIdUYD0jAqlhUKoi9rkJcjcETHKnjE1xV6Ecn7VoX8kfZElKx76DeJFkP6MWJtQcCHasZx2Oz20 Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 91e0286f34a549ed90c758652f0d20ae Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 91e0286f34a549ed90c758652f0d20ae Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ImagesTestJSON-1818116565-project Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 9f23399a5f1c4af6855a098198ca4ced Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ImagesTestJSON-1818116565-project Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: exception: Image not found. Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '12119e1b-1ded-4ca3-8237-14840e2879e1'} Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 12119e1b-1ded-4ca3-8237-14840e2879e1 to delete Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 12119e1b-1ded-4ca3-8237-14840e2879e1 could not be found. Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:39.929963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:39.934829 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:39.934829 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:39.934829 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:36:39.934829 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:36:39.934829 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:36:39.934829 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:36:39.934829 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:36:39.934829 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:36:39.934829 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 05 02:36:39.934829 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 05 02:36:39.934829 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 02:36:39.934829 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:39.934829 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:39.934829 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:39.934829 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:39.934829 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:39.934829 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:39.934829 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:36:39.934829 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:36:39.934829 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 02:36:39.934829 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:39.941381 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a44c1592-f495-4b98-9ae2-806243f5dcf7 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Returning 404 to user: Image not found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:36:39.948702 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a44c1592-f495-4b98-9ae2-806243f5dcf7 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "DELETE /compute/v2.1/images/12119e1b-1ded-4ca3-8237-14840e2879e1" status: 404 len: 62 microversion: 2.1 time: 0.109472 Oct 05 02:36:39.951147 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1110/2259] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:39 2022] DELETE /compute/v2.1/images/12119e1b-1ded-4ca3-8237-14840e2879e1 => generated 62 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:36:39.976216 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-695c5bdf-dc8e-4826-92a6-5a5974e14378 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:39.989722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-695c5bdf-dc8e-4826-92a6-5a5974e14378 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: e47438ff-463e-4a43-9767-8c78e8bb6e98] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:40.015629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-695c5bdf-dc8e-4826-92a6-5a5974e14378 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:40.016135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-695c5bdf-dc8e-4826-92a6-5a5974e14378 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:40.016572 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-695c5bdf-dc8e-4826-92a6-5a5974e14378 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:40.017333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-695c5bdf-dc8e-4826-92a6-5a5974e14378 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:40.017790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-695c5bdf-dc8e-4826-92a6-5a5974e14378 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:40.018217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-695c5bdf-dc8e-4826-92a6-5a5974e14378 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:40.093074 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-695c5bdf-dc8e-4826-92a6-5a5974e14378 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: e47438ff-463e-4a43-9767-8c78e8bb6e98] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:36:40.170631 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.compute.api [None req-695c5bdf-dc8e-4826-92a6-5a5974e14378 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: e47438ff-463e-4a43-9767-8c78e8bb6e98] Instance is already in deleting state, ignoring this request Oct 05 02:36:40.172789 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-695c5bdf-dc8e-4826-92a6-5a5974e14378 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98" status: 204 len: 0 microversion: 2.1 time: 0.217607 Oct 05 02:36:40.174199 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1111/2260] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:36:39 2022] DELETE /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:36:40.186197 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5995e980-53c8-4b7b-9608-02089b636ecc tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:40.187836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5995e980-53c8-4b7b-9608-02089b636ecc tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 6cf0945c-2ca2-4803-ab89-adf554c92c51] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:40.196695 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5995e980-53c8-4b7b-9608-02089b636ecc tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:40.197596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5995e980-53c8-4b7b-9608-02089b636ecc tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:40.198326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5995e980-53c8-4b7b-9608-02089b636ecc tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:40.199237 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5995e980-53c8-4b7b-9608-02089b636ecc tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:40.199784 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-94de73c6-41d1-4b70-907d-6d97d73e031f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:40.200672 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5995e980-53c8-4b7b-9608-02089b636ecc tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:40.201315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5995e980-53c8-4b7b-9608-02089b636ecc tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:40.215303 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-94de73c6-41d1-4b70-907d-6d97d73e031f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 200 len: 1355 microversion: 2.1 time: 0.468246 Oct 05 02:36:40.225764 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1150/2261] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:39 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 1355 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:40.242412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-290eb98d-7863-4ec9-95b8-40ef8cbfd186 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:40.245252 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-290eb98d-7863-4ec9-95b8-40ef8cbfd186 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: e47438ff-463e-4a43-9767-8c78e8bb6e98] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:40.269368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-290eb98d-7863-4ec9-95b8-40ef8cbfd186 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:40.274017 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-290eb98d-7863-4ec9-95b8-40ef8cbfd186 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:40.278851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-290eb98d-7863-4ec9-95b8-40ef8cbfd186 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:40.279849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-290eb98d-7863-4ec9-95b8-40ef8cbfd186 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:40.280532 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-290eb98d-7863-4ec9-95b8-40ef8cbfd186 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:40.282199 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-290eb98d-7863-4ec9-95b8-40ef8cbfd186 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:40.608205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-290eb98d-7863-4ec9-95b8-40ef8cbfd186 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:40.610689 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:40.626150 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-290eb98d-7863-4ec9-95b8-40ef8cbfd186 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98" status: 200 len: 1494 microversion: 2.1 time: 0.395560 Oct 05 02:36:40.631516 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5995e980-53c8-4b7b-9608-02089b636ecc tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:40.642107 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5995e980-53c8-4b7b-9608-02089b636ecc tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51" status: 200 len: 1318 microversion: 2.1 time: 0.465867 Oct 05 02:36:40.654082 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1151/2262] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:40 2022] GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98 => generated 1494 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:40.667708 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1112/2263] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:40 2022] GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51 => generated 1318 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:40.669549 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cbe2b081-86ca-46cb-afc5-a9c5f6b4ddca tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:40.671001 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cbe2b081-86ca-46cb-afc5-a9c5f6b4ddca tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: 5f395291-91f2-4958-bf8c-6c4d4adb0c9f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:40.680851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbe2b081-86ca-46cb-afc5-a9c5f6b4ddca tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:40.681958 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbe2b081-86ca-46cb-afc5-a9c5f6b4ddca tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:40.682575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbe2b081-86ca-46cb-afc5-a9c5f6b4ddca tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:40.683781 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbe2b081-86ca-46cb-afc5-a9c5f6b4ddca tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:40.684390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbe2b081-86ca-46cb-afc5-a9c5f6b4ddca tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:40.685002 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbe2b081-86ca-46cb-afc5-a9c5f6b4ddca tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:40.731934 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2bc3455a-29a1-460e-98f7-0051fda2e72a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf5edd30>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:40.817999 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2bc3455a-29a1-460e-98f7-0051fda2e72a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd" status: 200 len: 1454 microversion: 2.1 time: 0.092602 Oct 05 02:36:40.827470 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1113/2264] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:40 2022] GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd => generated 1454 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:36:40.828447 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cbe2b081-86ca-46cb-afc5-a9c5f6b4ddca tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:40.832026 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cbe2b081-86ca-46cb-afc5-a9c5f6b4ddca tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f" status: 200 len: 1225 microversion: 2.1 time: 0.176491 Oct 05 02:36:40.834032 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1152/2265] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:40 2022] GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f => generated 1225 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:40.854464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e42ba294-92ee-44a6-8aae-4958fbc5c760 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:40.857654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e42ba294-92ee-44a6-8aae-4958fbc5c760 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:40.869053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e42ba294-92ee-44a6-8aae-4958fbc5c760 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:40.869925 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e42ba294-92ee-44a6-8aae-4958fbc5c760 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:40.870687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e42ba294-92ee-44a6-8aae-4958fbc5c760 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:40.871615 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e42ba294-92ee-44a6-8aae-4958fbc5c760 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:40.872559 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e42ba294-92ee-44a6-8aae-4958fbc5c760 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:40.874553 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e42ba294-92ee-44a6-8aae-4958fbc5c760 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:40.910919 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e42ba294-92ee-44a6-8aae-4958fbc5c760 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060447 Oct 05 02:36:40.917250 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1114/2266] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 5 02:36:40 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:36:41.252556 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-84ab2354-ae31-4508-a2ec-c1ae09bde7c1 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:41.253208 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-84ab2354-ae31-4508-a2ec-c1ae09bde7c1 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:41.272012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84ab2354-ae31-4508-a2ec-c1ae09bde7c1 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:41.278122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84ab2354-ae31-4508-a2ec-c1ae09bde7c1 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:41.278790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84ab2354-ae31-4508-a2ec-c1ae09bde7c1 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:41.283483 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84ab2354-ae31-4508-a2ec-c1ae09bde7c1 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:41.287414 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84ab2354-ae31-4508-a2ec-c1ae09bde7c1 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:41.289615 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84ab2354-ae31-4508-a2ec-c1ae09bde7c1 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:41.468069 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-9a50f637-d55d-4748-b991-60f314783b13 req-a580441e-2df2-43ec-90a9-a3c9c9b5b26a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e47438ff-463e-4a43-9767-8c78e8bb6e98", "name": "network-vif-unplugged", "status": "completed", "tag": "d17e6d68-21a3-4fc2-9ded-814bf288d29c"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:41.512966 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9a50f637-d55d-4748-b991-60f314783b13 req-a580441e-2df2-43ec-90a9-a3c9c9b5b26a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:41.516041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9a50f637-d55d-4748-b991-60f314783b13 req-a580441e-2df2-43ec-90a9-a3c9c9b5b26a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:41.519330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9a50f637-d55d-4748-b991-60f314783b13 req-a580441e-2df2-43ec-90a9-a3c9c9b5b26a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:41.582178 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-9a50f637-d55d-4748-b991-60f314783b13 req-a580441e-2df2-43ec-90a9-a3c9c9b5b26a service nova] Creating event network-vif-unplugged:d17e6d68-21a3-4fc2-9ded-814bf288d29c for instance e47438ff-463e-4a43-9767-8c78e8bb6e98 on n-h1-858272-3 Oct 05 02:36:41.611146 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-9a50f637-d55d-4748-b991-60f314783b13 req-a580441e-2df2-43ec-90a9-a3c9c9b5b26a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.146860 Oct 05 02:36:41.617065 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1115/2267] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:41.672558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2df6892d-3a54-4bb3-b527-5798ef5fbe06 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:41.673345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2df6892d-3a54-4bb3-b527-5798ef5fbe06 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: e47438ff-463e-4a43-9767-8c78e8bb6e98] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:41.679998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2df6892d-3a54-4bb3-b527-5798ef5fbe06 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:41.680492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2df6892d-3a54-4bb3-b527-5798ef5fbe06 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:41.681062 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2df6892d-3a54-4bb3-b527-5798ef5fbe06 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:41.681694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2df6892d-3a54-4bb3-b527-5798ef5fbe06 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:41.682145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2df6892d-3a54-4bb3-b527-5798ef5fbe06 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:41.682651 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2df6892d-3a54-4bb3-b527-5798ef5fbe06 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:41.911977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-84ab2354-ae31-4508-a2ec-c1ae09bde7c1 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:41.923155 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-84ab2354-ae31-4508-a2ec-c1ae09bde7c1 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 200 len: 1355 microversion: 2.1 time: 0.675189 Oct 05 02:36:41.929235 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1153/2268] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:41 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 1355 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:41.964495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e6520cc5-41f2-427a-80b9-994ee5555ff7 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:41.969090 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e6520cc5-41f2-427a-80b9-994ee5555ff7 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 6cf0945c-2ca2-4803-ab89-adf554c92c51] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:42.002666 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e6520cc5-41f2-427a-80b9-994ee5555ff7 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:42.003196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e6520cc5-41f2-427a-80b9-994ee5555ff7 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:42.007058 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e6520cc5-41f2-427a-80b9-994ee5555ff7 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:42.007862 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e6520cc5-41f2-427a-80b9-994ee5555ff7 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:42.008350 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e6520cc5-41f2-427a-80b9-994ee5555ff7 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:42.018584 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e6520cc5-41f2-427a-80b9-994ee5555ff7 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:42.164541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2df6892d-3a54-4bb3-b527-5798ef5fbe06 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:42.174756 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2df6892d-3a54-4bb3-b527-5798ef5fbe06 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98" status: 200 len: 1494 microversion: 2.1 time: 0.510144 Oct 05 02:36:42.179288 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1116/2269] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:41 2022] GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98 => generated 1494 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:42.198765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-04f5b60e-6a29-47fd-9b5a-3b20318f6fa5 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf5cdc10>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:42.335821 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-04f5b60e-6a29-47fd-9b5a-3b20318f6fa5 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd" status: 200 len: 1454 microversion: 2.1 time: 0.152478 Oct 05 02:36:42.345777 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1117/2270] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:42 2022] GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:42.345777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2b703740-82b0-40a3-b0f4-152095b4067f tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:42.345777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2b703740-82b0-40a3-b0f4-152095b4067f tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: 5f395291-91f2-4958-bf8c-6c4d4adb0c9f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:42.362431 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b703740-82b0-40a3-b0f4-152095b4067f tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:42.362854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b703740-82b0-40a3-b0f4-152095b4067f tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:42.363313 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b703740-82b0-40a3-b0f4-152095b4067f tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:42.367235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b703740-82b0-40a3-b0f4-152095b4067f tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:42.367912 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b703740-82b0-40a3-b0f4-152095b4067f tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:42.368379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b703740-82b0-40a3-b0f4-152095b4067f tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:42.661471 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e6520cc5-41f2-427a-80b9-994ee5555ff7 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:42.682614 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e6520cc5-41f2-427a-80b9-994ee5555ff7 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51" status: 200 len: 1318 microversion: 2.1 time: 0.749006 Oct 05 02:36:42.686628 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1154/2271] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:41 2022] GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51 => generated 1318 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:42.705234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e0fc00cc-fd96-43d8-8a8f-1545649ff3f8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:42.708312 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e0fc00cc-fd96-43d8-8a8f-1545649ff3f8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:42.715614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:42.734446 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0fc00cc-fd96-43d8-8a8f-1545649ff3f8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:42.734964 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0fc00cc-fd96-43d8-8a8f-1545649ff3f8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:42.735402 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0fc00cc-fd96-43d8-8a8f-1545649ff3f8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:42.736116 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0fc00cc-fd96-43d8-8a8f-1545649ff3f8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:42.736613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0fc00cc-fd96-43d8-8a8f-1545649ff3f8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:42.747033 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0fc00cc-fd96-43d8-8a8f-1545649ff3f8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:42.862687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2b703740-82b0-40a3-b0f4-152095b4067f tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:42.875468 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2b703740-82b0-40a3-b0f4-152095b4067f tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f" status: 200 len: 1273 microversion: 2.1 time: 0.537184 Oct 05 02:36:42.885143 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1118/2272] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:42 2022] GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f => generated 1273 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:42.934889 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e0fc00cc-fd96-43d8-8a8f-1545649ff3f8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.246871 Oct 05 02:36:42.938246 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1155/2273] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 5 02:36:42 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d/os-volume_attachments => generated 197 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:36:42.951288 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d7640c52-e196-4e31-a620-e7597ad073db tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:42.952363 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d7640c52-e196-4e31-a620-e7597ad073db tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:42.969439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7640c52-e196-4e31-a620-e7597ad073db tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:42.970121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7640c52-e196-4e31-a620-e7597ad073db tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:42.979706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7640c52-e196-4e31-a620-e7597ad073db tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:42.981024 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7640c52-e196-4e31-a620-e7597ad073db tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:42.983551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7640c52-e196-4e31-a620-e7597ad073db tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:42.986414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7640c52-e196-4e31-a620-e7597ad073db tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:43.204421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e5d32a66-3ae5-43b7-b8b3-14144711bcce tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:43.206055 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e5d32a66-3ae5-43b7-b8b3-14144711bcce tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: e47438ff-463e-4a43-9767-8c78e8bb6e98] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:43.222945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5d32a66-3ae5-43b7-b8b3-14144711bcce tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:43.230433 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5d32a66-3ae5-43b7-b8b3-14144711bcce tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:43.230919 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5d32a66-3ae5-43b7-b8b3-14144711bcce tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:43.235188 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5d32a66-3ae5-43b7-b8b3-14144711bcce tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:43.236499 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5d32a66-3ae5-43b7-b8b3-14144711bcce tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:43.236981 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5d32a66-3ae5-43b7-b8b3-14144711bcce tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:44.020732 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e5d32a66-3ae5-43b7-b8b3-14144711bcce tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:44.024401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d7640c52-e196-4e31-a620-e7597ad073db tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:44.035771 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d7640c52-e196-4e31-a620-e7597ad073db tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 200 len: 1805 microversion: 2.1 time: 1.089490 Oct 05 02:36:44.052788 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1119/2274] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:42 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 1805 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:44.052885 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-abc7d211-19ce-4f30-80a5-41e90ac78412 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf674af0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:44.062319 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e5d32a66-3ae5-43b7-b8b3-14144711bcce tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98" status: 200 len: 1494 microversion: 2.1 time: 0.836611 Oct 05 02:36:44.063668 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1156/2275] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:43 2022] GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98 => generated 1494 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:36:44.103297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a95cc8e9-0974-4212-8f19-0501b866dd9a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:44.106754 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a95cc8e9-0974-4212-8f19-0501b866dd9a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 6cf0945c-2ca2-4803-ab89-adf554c92c51] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:44.132053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a95cc8e9-0974-4212-8f19-0501b866dd9a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:44.132538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a95cc8e9-0974-4212-8f19-0501b866dd9a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:44.133782 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a95cc8e9-0974-4212-8f19-0501b866dd9a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:44.135840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a95cc8e9-0974-4212-8f19-0501b866dd9a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:44.136549 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a95cc8e9-0974-4212-8f19-0501b866dd9a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:44.137218 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a95cc8e9-0974-4212-8f19-0501b866dd9a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:44.174270 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-abc7d211-19ce-4f30-80a5-41e90ac78412 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd" status: 200 len: 1454 microversion: 2.1 time: 0.128096 Oct 05 02:36:44.186530 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1120/2276] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:44 2022] GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd => generated 1454 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:44.205964 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d3aaf5d3-6092-400b-8bec-4cc0afb696c2 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:44.208571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d3aaf5d3-6092-400b-8bec-4cc0afb696c2 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: 5f395291-91f2-4958-bf8c-6c4d4adb0c9f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:44.245500 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d3aaf5d3-6092-400b-8bec-4cc0afb696c2 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:44.251432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d3aaf5d3-6092-400b-8bec-4cc0afb696c2 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:44.252006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d3aaf5d3-6092-400b-8bec-4cc0afb696c2 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:44.255463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d3aaf5d3-6092-400b-8bec-4cc0afb696c2 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:44.256024 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d3aaf5d3-6092-400b-8bec-4cc0afb696c2 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:44.256554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d3aaf5d3-6092-400b-8bec-4cc0afb696c2 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:44.470526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d3aaf5d3-6092-400b-8bec-4cc0afb696c2 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:44.486347 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d3aaf5d3-6092-400b-8bec-4cc0afb696c2 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f" status: 200 len: 1279 microversion: 2.1 time: 0.298436 Oct 05 02:36:44.491122 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1121/2277] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:44 2022] GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f => generated 1279 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:44.511615 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cf7811b2-8963-48bc-8db6-144ef1eff8cc tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:44.524044 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cf7811b2-8963-48bc-8db6-144ef1eff8cc tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:44.545362 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf7811b2-8963-48bc-8db6-144ef1eff8cc tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:44.545994 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf7811b2-8963-48bc-8db6-144ef1eff8cc tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:44.547564 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf7811b2-8963-48bc-8db6-144ef1eff8cc tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:44.554518 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf7811b2-8963-48bc-8db6-144ef1eff8cc tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:44.558107 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf7811b2-8963-48bc-8db6-144ef1eff8cc tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:44.559013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf7811b2-8963-48bc-8db6-144ef1eff8cc tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:44.599506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a95cc8e9-0974-4212-8f19-0501b866dd9a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:44.611630 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a95cc8e9-0974-4212-8f19-0501b866dd9a tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51" status: 200 len: 1509 microversion: 2.1 time: 0.546443 Oct 05 02:36:44.621556 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1157/2278] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:44 2022] GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51 => generated 1509 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:44.638484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-daf28491-bdad-4bff-9912-6886af9537d4 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:44.639123 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-daf28491-bdad-4bff-9912-6886af9537d4 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:44.659755 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-daf28491-bdad-4bff-9912-6886af9537d4 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:44.669545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-daf28491-bdad-4bff-9912-6886af9537d4 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:44.670883 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-daf28491-bdad-4bff-9912-6886af9537d4 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:44.671726 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-daf28491-bdad-4bff-9912-6886af9537d4 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:44.674905 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-daf28491-bdad-4bff-9912-6886af9537d4 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:44.675437 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-daf28491-bdad-4bff-9912-6886af9537d4 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:44.730324 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cf7811b2-8963-48bc-8db6-144ef1eff8cc tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.232609 Oct 05 02:36:44.731777 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1122/2279] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 5 02:36:44 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d/os-volume_attachments => generated 25 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:44.745423 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-daf28491-bdad-4bff-9912-6886af9537d4 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668/ips" status: 200 len: 218 microversion: 2.1 time: 0.122511 Oct 05 02:36:44.755257 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1158/2280] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 02:36:44 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668/ips => generated 218 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:44.767549 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f124a104-5ccb-4958-a43e-d5002ff70d12 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:44.768206 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f124a104-5ccb-4958-a43e-d5002ff70d12 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:44.773947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-c4b3e9a4-e590-42d7-af99-1ae3877a8bb5 req-b3f7e6d4-4966-40e7-ae90-f2ea627a388f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e47438ff-463e-4a43-9767-8c78e8bb6e98", "name": "network-vif-deleted", "tag": "d17e6d68-21a3-4fc2-9ded-814bf288d29c"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:44.791916 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f124a104-5ccb-4958-a43e-d5002ff70d12 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:44.792607 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f124a104-5ccb-4958-a43e-d5002ff70d12 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:44.794613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-c4b3e9a4-e590-42d7-af99-1ae3877a8bb5 req-b3f7e6d4-4966-40e7-ae90-f2ea627a388f service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:44.795704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f124a104-5ccb-4958-a43e-d5002ff70d12 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:44.796097 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f124a104-5ccb-4958-a43e-d5002ff70d12 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:44.796367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-c4b3e9a4-e590-42d7-af99-1ae3877a8bb5 req-b3f7e6d4-4966-40e7-ae90-f2ea627a388f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:44.797163 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-c4b3e9a4-e590-42d7-af99-1ae3877a8bb5 req-b3f7e6d4-4966-40e7-ae90-f2ea627a388f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:44.797865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f124a104-5ccb-4958-a43e-d5002ff70d12 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:44.802964 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f124a104-5ccb-4958-a43e-d5002ff70d12 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:44.852964 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-c4b3e9a4-e590-42d7-af99-1ae3877a8bb5 req-b3f7e6d4-4966-40e7-ae90-f2ea627a388f service nova] Creating event network-vif-deleted:d17e6d68-21a3-4fc2-9ded-814bf288d29c for instance e47438ff-463e-4a43-9767-8c78e8bb6e98 on n-h1-858272-3 Oct 05 02:36:44.861148 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-c4b3e9a4-e590-42d7-af99-1ae3877a8bb5 req-b3f7e6d4-4966-40e7-ae90-f2ea627a388f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094835 Oct 05 02:36:44.865668 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1159/2281] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:36:44.899454 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-af655303-a7f9-417b-9221-e4f6d7db6f3d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:44.900870 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-af655303-a7f9-417b-9221-e4f6d7db6f3d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:44.901224 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f124a104-5ccb-4958-a43e-d5002ff70d12 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:36:44.917009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af655303-a7f9-417b-9221-e4f6d7db6f3d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:44.917782 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af655303-a7f9-417b-9221-e4f6d7db6f3d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:44.918376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af655303-a7f9-417b-9221-e4f6d7db6f3d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:44.919232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af655303-a7f9-417b-9221-e4f6d7db6f3d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:44.921445 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af655303-a7f9-417b-9221-e4f6d7db6f3d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:44.922033 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af655303-a7f9-417b-9221-e4f6d7db6f3d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:44.951198 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:45.031798 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-af655303-a7f9-417b-9221-e4f6d7db6f3d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:36:45.051088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:45.250960 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f124a104-5ccb-4958-a43e-d5002ff70d12 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 204 len: 0 microversion: 2.1 time: 0.487828 Oct 05 02:36:45.251478 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1123/2282] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:36:44 2022] DELETE /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:36:45.259815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0f8132be-598c-4a4c-a1b7-c671f18c5931 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:45.268473 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0f8132be-598c-4a4c-a1b7-c671f18c5931 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: e47438ff-463e-4a43-9767-8c78e8bb6e98] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:45.291361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0f8132be-598c-4a4c-a1b7-c671f18c5931 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:45.292062 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0f8132be-598c-4a4c-a1b7-c671f18c5931 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:45.317733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0f8132be-598c-4a4c-a1b7-c671f18c5931 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:45.323089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0f8132be-598c-4a4c-a1b7-c671f18c5931 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:45.329150 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0f8132be-598c-4a4c-a1b7-c671f18c5931 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:45.329709 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0f8132be-598c-4a4c-a1b7-c671f18c5931 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:45.389756 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-af655303-a7f9-417b-9221-e4f6d7db6f3d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 204 len: 0 microversion: 2.20 time: 0.494230 Oct 05 02:36:45.390409 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1160/2283] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 5 02:36:44 2022] DELETE /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 02:36:45.419903 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a7fe96cd-2b30-4232-8979-61a2d93428b1 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce8171a60>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:45.491315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0f8132be-598c-4a4c-a1b7-c671f18c5931 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:45.491803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0f8132be-598c-4a4c-a1b7-c671f18c5931 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:45.497948 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0f8132be-598c-4a4c-a1b7-c671f18c5931 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:45.498426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-0f8132be-598c-4a4c-a1b7-c671f18c5931 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lazy-loading 'fault' on Instance uuid e47438ff-463e-4a43-9767-8c78e8bb6e98 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:36:45.566621 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a7fe96cd-2b30-4232-8979-61a2d93428b1 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd" status: 200 len: 1454 microversion: 2.1 time: 0.170482 Oct 05 02:36:45.570522 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1161/2284] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:45 2022] GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd => generated 1454 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:45.583798 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-57d9fe6c-50dc-453a-ae9d-b1e423ef4316 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:45.596860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-57d9fe6c-50dc-453a-ae9d-b1e423ef4316 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:45.623451 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57d9fe6c-50dc-453a-ae9d-b1e423ef4316 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:45.626829 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57d9fe6c-50dc-453a-ae9d-b1e423ef4316 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:45.627462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57d9fe6c-50dc-453a-ae9d-b1e423ef4316 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:45.628354 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57d9fe6c-50dc-453a-ae9d-b1e423ef4316 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:45.629158 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57d9fe6c-50dc-453a-ae9d-b1e423ef4316 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:45.631970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57d9fe6c-50dc-453a-ae9d-b1e423ef4316 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:45.647816 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0f8132be-598c-4a4c-a1b7-c671f18c5931 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f23399a5f1c4af6855a098198ca4ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e0286f34a549ed90c758652f0d20ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:45.683658 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0f8132be-598c-4a4c-a1b7-c671f18c5931 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98" status: 200 len: 1298 microversion: 2.1 time: 0.428460 Oct 05 02:36:45.685684 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1124/2285] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:45 2022] GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98 => generated 1298 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:45.701068 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f0742fa8-c211-4dd6-95ef-123bab93a608 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:45.704837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f0742fa8-c211-4dd6-95ef-123bab93a608 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:45.729140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0742fa8-c211-4dd6-95ef-123bab93a608 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:45.729140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0742fa8-c211-4dd6-95ef-123bab93a608 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:45.729140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0742fa8-c211-4dd6-95ef-123bab93a608 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:45.729140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0742fa8-c211-4dd6-95ef-123bab93a608 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:45.729140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0742fa8-c211-4dd6-95ef-123bab93a608 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:45.729140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0742fa8-c211-4dd6-95ef-123bab93a608 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:46.040338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-57d9fe6c-50dc-453a-ae9d-b1e423ef4316 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:46.078825 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-57d9fe6c-50dc-453a-ae9d-b1e423ef4316 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 200 len: 1811 microversion: 2.1 time: 0.504395 Oct 05 02:36:46.089989 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1162/2286] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:45 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 1811 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:46.110283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9333b11e-c314-4da8-8070-7473faecf17d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:46.113593 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9333b11e-c314-4da8-8070-7473faecf17d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: 5f395291-91f2-4958-bf8c-6c4d4adb0c9f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:46.147939 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9333b11e-c314-4da8-8070-7473faecf17d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:46.151420 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9333b11e-c314-4da8-8070-7473faecf17d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:46.152084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9333b11e-c314-4da8-8070-7473faecf17d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:46.155441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9333b11e-c314-4da8-8070-7473faecf17d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:46.156148 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9333b11e-c314-4da8-8070-7473faecf17d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:46.156775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9333b11e-c314-4da8-8070-7473faecf17d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:46.345737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f0742fa8-c211-4dd6-95ef-123bab93a608 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:46.360069 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f0742fa8-c211-4dd6-95ef-123bab93a608 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:46.363623 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f0742fa8-c211-4dd6-95ef-123bab93a608 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:46.370768 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f0742fa8-c211-4dd6-95ef-123bab93a608 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1723 microversion: 2.20 time: 0.684006 Oct 05 02:36:46.371600 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1125/2287] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:36:45 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1723 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:36:46.525093 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9333b11e-c314-4da8-8070-7473faecf17d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:46.540120 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9333b11e-c314-4da8-8070-7473faecf17d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f" status: 200 len: 1321 microversion: 2.1 time: 0.448533 Oct 05 02:36:46.541940 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1163/2288] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:46 2022] GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f => generated 1321 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:46.601153 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-04435a78-00d1-43b8-b179-fb1455963b2c tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf638280>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:46.702102 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-04435a78-00d1-43b8-b179-fb1455963b2c tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd" status: 200 len: 1454 microversion: 2.1 time: 0.120306 Oct 05 02:36:46.703797 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1126/2289] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:46 2022] GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd => generated 1454 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:46.711558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-290df3ce-edb4-4f09-b260-66d67241e0cd tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:46.712460 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-290df3ce-edb4-4f09-b260-66d67241e0cd tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: e47438ff-463e-4a43-9767-8c78e8bb6e98] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:46.725262 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-290df3ce-edb4-4f09-b260-66d67241e0cd tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:46.725762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-290df3ce-edb4-4f09-b260-66d67241e0cd tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:46.726200 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-290df3ce-edb4-4f09-b260-66d67241e0cd tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:46.726909 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-290df3ce-edb4-4f09-b260-66d67241e0cd tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:46.731340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-290df3ce-edb4-4f09-b260-66d67241e0cd tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:46.732245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-290df3ce-edb4-4f09-b260-66d67241e0cd tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:46.782522 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-290df3ce-edb4-4f09-b260-66d67241e0cd tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] HTTP exception thrown: Instance e47438ff-463e-4a43-9767-8c78e8bb6e98 could not be found. Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-290df3ce-edb4-4f09-b260-66d67241e0cd tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Request method failure captured: Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98 HTTP/1.1 Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOyncnz_Xr9P8nn_Dn2jWOBPMfB25oKlwUdkb-lAovWLOcnbWbWtB8EupA339z8n4CLPU4Xvp4t38IgdhTeSkNNsbZcCHuTGeDJ3SIdUYD0jAqlhUKoi9rkJcjcETHKnjE1xV6Ecn7VoX8kfZElKx76DeJFkP6MWJtQcCHasZx2Oz20 Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 91e0286f34a549ed90c758652f0d20ae Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 91e0286f34a549ed90c758652f0d20ae Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ImagesTestJSON-1818116565-project Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 9f23399a5f1c4af6855a098198ca4ced Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ImagesTestJSON-1818116565-project Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance e47438ff-463e-4a43-9767-8c78e8bb6e98 could not be found. Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'e47438ff-463e-4a43-9767-8c78e8bb6e98'} Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e47438ff-463e-4a43-9767-8c78e8bb6e98 could not be found. Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e47438ff-463e-4a43-9767-8c78e8bb6e98 could not be found. Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:46.784301 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:46.788769 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:46.788769 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:46.788769 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:36:46.788769 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:36:46.788769 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e47438ff-463e-4a43-9767-8c78e8bb6e98 could not be found. Oct 05 02:36:46.788769 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:46.795421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-290df3ce-edb4-4f09-b260-66d67241e0cd tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Returning 404 to user: Instance e47438ff-463e-4a43-9767-8c78e8bb6e98 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:36:46.809339 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-290df3ce-edb4-4f09-b260-66d67241e0cd tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98" status: 404 len: 111 microversion: 2.1 time: 0.090053 Oct 05 02:36:46.809339 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1164/2290] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:46 2022] GET /compute/v2.1/servers/e47438ff-463e-4a43-9767-8c78e8bb6e98 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:36:46.826050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-14c7d473-dfef-42bb-9421-b74dfde6fb42 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fccdf5b2ee0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:46.854143 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-14c7d473-dfef-42bb-9421-b74dfde6fb42 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] HTTP exception thrown: Image not found. Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-14c7d473-dfef-42bb-9421-b74dfde6fb42 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Request method failure captured: Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471 HTTP/1.1 Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOyncnz_Xr9P8nn_Dn2jWOBPMfB25oKlwUdkb-lAovWLOcnbWbWtB8EupA339z8n4CLPU4Xvp4t38IgdhTeSkNNsbZcCHuTGeDJ3SIdUYD0jAqlhUKoi9rkJcjcETHKnjE1xV6Ecn7VoX8kfZElKx76DeJFkP6MWJtQcCHasZx2Oz20 Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 91e0286f34a549ed90c758652f0d20ae Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 91e0286f34a549ed90c758652f0d20ae Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ImagesTestJSON-1818116565-project Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 9f23399a5f1c4af6855a098198ca4ced Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ImagesTestJSON-1818116565-project Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: exception: Image not found. Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'aed41dfe-91be-43b8-91fc-a5f98668a471'} Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image aed41dfe-91be-43b8-91fc-a5f98668a471 to delete Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image aed41dfe-91be-43b8-91fc-a5f98668a471 could not be found. Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:46.870583 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:46.875102 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:46.875102 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:46.875102 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:36:46.875102 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:36:46.875102 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:36:46.875102 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:36:46.875102 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:36:46.875102 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:36:46.875102 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 05 02:36:46.875102 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 05 02:36:46.875102 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 02:36:46.875102 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:46.875102 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:46.875102 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:46.875102 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:46.875102 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:46.875102 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:46.875102 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:36:46.875102 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:36:46.875102 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 02:36:46.875102 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:46.879023 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-14c7d473-dfef-42bb-9421-b74dfde6fb42 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Returning 404 to user: Image not found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:36:46.880297 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-14c7d473-dfef-42bb-9421-b74dfde6fb42 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "DELETE /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471" status: 404 len: 62 microversion: 2.1 time: 0.077905 Oct 05 02:36:46.901156 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1127/2291] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:46 2022] DELETE /compute/v2.1/images/aed41dfe-91be-43b8-91fc-a5f98668a471 => generated 62 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:36:46.905072 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8d9d1794-147c-4f18-8637-939dad6a99ee tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:46.905901 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8d9d1794-147c-4f18-8637-939dad6a99ee tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: f2e6dcdb-9664-46eb-b40d-58d894b62b47] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:46.947637 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d9d1794-147c-4f18-8637-939dad6a99ee tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:46.948594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d9d1794-147c-4f18-8637-939dad6a99ee tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:46.948594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d9d1794-147c-4f18-8637-939dad6a99ee tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:46.949287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d9d1794-147c-4f18-8637-939dad6a99ee tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:46.952249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d9d1794-147c-4f18-8637-939dad6a99ee tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:46.960874 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d9d1794-147c-4f18-8637-939dad6a99ee tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:46.993002 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-8d9d1794-147c-4f18-8637-939dad6a99ee tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] HTTP exception thrown: Instance f2e6dcdb-9664-46eb-b40d-58d894b62b47 could not be found. Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8d9d1794-147c-4f18-8637-939dad6a99ee tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Request method failure captured: Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47 HTTP/1.1 Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOyncnz_Xr9P8nn_Dn2jWOBPMfB25oKlwUdkb-lAovWLOcnbWbWtB8EupA339z8n4CLPU4Xvp4t38IgdhTeSkNNsbZcCHuTGeDJ3SIdUYD0jAqlhUKoi9rkJcjcETHKnjE1xV6Ecn7VoX8kfZElKx76DeJFkP6MWJtQcCHasZx2Oz20 Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 91e0286f34a549ed90c758652f0d20ae Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 91e0286f34a549ed90c758652f0d20ae Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ImagesTestJSON-1818116565-project Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 9f23399a5f1c4af6855a098198ca4ced Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ImagesTestJSON-1818116565-project Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance f2e6dcdb-9664-46eb-b40d-58d894b62b47 could not be found. Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'f2e6dcdb-9664-46eb-b40d-58d894b62b47'} Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2e6dcdb-9664-46eb-b40d-58d894b62b47 could not be found. Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:36:46.994943 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2e6dcdb-9664-46eb-b40d-58d894b62b47 could not be found. Oct 05 02:36:46.999142 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:46.999142 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:46.999142 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:46.999142 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:46.999142 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:46.999142 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:46.999142 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:36:46.999142 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:36:46.999142 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2e6dcdb-9664-46eb-b40d-58d894b62b47 could not be found. Oct 05 02:36:46.999142 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.001587 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8d9d1794-147c-4f18-8637-939dad6a99ee tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Returning 404 to user: Instance f2e6dcdb-9664-46eb-b40d-58d894b62b47 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:36:47.003549 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8d9d1794-147c-4f18-8637-939dad6a99ee tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47" status: 404 len: 111 microversion: 2.1 time: 0.102575 Oct 05 02:36:47.005559 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1165/2292] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:36:46 2022] DELETE /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:36:47.021950 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bda3ade4-0a86-4b6d-a49a-ba36a5ecf8c9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:47.021950 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bda3ade4-0a86-4b6d-a49a-ba36a5ecf8c9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: f2e6dcdb-9664-46eb-b40d-58d894b62b47] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:47.042919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bda3ade4-0a86-4b6d-a49a-ba36a5ecf8c9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:47.043768 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bda3ade4-0a86-4b6d-a49a-ba36a5ecf8c9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:47.044226 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bda3ade4-0a86-4b6d-a49a-ba36a5ecf8c9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:47.048609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bda3ade4-0a86-4b6d-a49a-ba36a5ecf8c9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:47.049734 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bda3ade4-0a86-4b6d-a49a-ba36a5ecf8c9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:47.058642 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bda3ade4-0a86-4b6d-a49a-ba36a5ecf8c9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:47.092960 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-bda3ade4-0a86-4b6d-a49a-ba36a5ecf8c9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] HTTP exception thrown: Instance f2e6dcdb-9664-46eb-b40d-58d894b62b47 could not be found. Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bda3ade4-0a86-4b6d-a49a-ba36a5ecf8c9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Request method failure captured: Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47 HTTP/1.1 Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOyncnz_Xr9P8nn_Dn2jWOBPMfB25oKlwUdkb-lAovWLOcnbWbWtB8EupA339z8n4CLPU4Xvp4t38IgdhTeSkNNsbZcCHuTGeDJ3SIdUYD0jAqlhUKoi9rkJcjcETHKnjE1xV6Ecn7VoX8kfZElKx76DeJFkP6MWJtQcCHasZx2Oz20 Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 91e0286f34a549ed90c758652f0d20ae Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 91e0286f34a549ed90c758652f0d20ae Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ImagesTestJSON-1818116565-project Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 9f23399a5f1c4af6855a098198ca4ced Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ImagesTestJSON-1818116565-project Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance f2e6dcdb-9664-46eb-b40d-58d894b62b47 could not be found. Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'f2e6dcdb-9664-46eb-b40d-58d894b62b47'} Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2e6dcdb-9664-46eb-b40d-58d894b62b47 could not be found. Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2e6dcdb-9664-46eb-b40d-58d894b62b47 could not be found. Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.096554 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:47.100743 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:47.100743 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:47.100743 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:36:47.100743 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:36:47.100743 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2e6dcdb-9664-46eb-b40d-58d894b62b47 could not be found. Oct 05 02:36:47.100743 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.100743 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bda3ade4-0a86-4b6d-a49a-ba36a5ecf8c9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Returning 404 to user: Instance f2e6dcdb-9664-46eb-b40d-58d894b62b47 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:36:47.100743 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bda3ade4-0a86-4b6d-a49a-ba36a5ecf8c9 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47" status: 404 len: 111 microversion: 2.1 time: 0.086264 Oct 05 02:36:47.114027 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6e96ab85-4873-471d-851f-a9d2350c9a8b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fccdf76aaf0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:47.119714 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1128/2293] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:47 2022] GET /compute/v2.1/servers/f2e6dcdb-9664-46eb-b40d-58d894b62b47 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:36:47.139649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e98fa9a9-a2e6-407d-ade4-c91790813bb8 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:47.143991 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-6e96ab85-4873-471d-851f-a9d2350c9a8b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] HTTP exception thrown: Image not found. Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6e96ab85-4873-471d-851f-a9d2350c9a8b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Request method failure captured: Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf HTTP/1.1 Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOyncnz_Xr9P8nn_Dn2jWOBPMfB25oKlwUdkb-lAovWLOcnbWbWtB8EupA339z8n4CLPU4Xvp4t38IgdhTeSkNNsbZcCHuTGeDJ3SIdUYD0jAqlhUKoi9rkJcjcETHKnjE1xV6Ecn7VoX8kfZElKx76DeJFkP6MWJtQcCHasZx2Oz20 Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 91e0286f34a549ed90c758652f0d20ae Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 91e0286f34a549ed90c758652f0d20ae Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ImagesTestJSON-1818116565-project Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 9f23399a5f1c4af6855a098198ca4ced Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ImagesTestJSON-1818116565-project Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: exception: Image not found. Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '73c13e6e-c1a2-4c6f-81f2-4b031317a7cf'} Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 73c13e6e-c1a2-4c6f-81f2-4b031317a7cf to delete Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 73c13e6e-c1a2-4c6f-81f2-4b031317a7cf could not be found. Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.147095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:47.152304 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:47.152304 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:47.152304 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:36:47.152304 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:36:47.152304 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:36:47.152304 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:36:47.152304 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:36:47.152304 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:36:47.152304 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 05 02:36:47.152304 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 05 02:36:47.152304 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 02:36:47.152304 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.152304 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:47.152304 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.152304 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:47.152304 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:47.152304 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:47.152304 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:36:47.152304 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:36:47.152304 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 02:36:47.152304 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.152304 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6e96ab85-4873-471d-851f-a9d2350c9a8b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Returning 404 to user: Image not found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:36:47.152304 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6e96ab85-4873-471d-851f-a9d2350c9a8b tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "DELETE /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf" status: 404 len: 62 microversion: 2.1 time: 0.039549 Oct 05 02:36:47.153853 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e98fa9a9-a2e6-407d-ade4-c91790813bb8 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:47.155491 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1166/2294] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:47 2022] DELETE /compute/v2.1/images/73c13e6e-c1a2-4c6f-81f2-4b031317a7cf => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:36:47.165986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e98fa9a9-a2e6-407d-ade4-c91790813bb8 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:47.166486 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e98fa9a9-a2e6-407d-ade4-c91790813bb8 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:47.167457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9aeef0a3-e0ee-4cd1-8525-f093dd64d5be tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:47.167966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9aeef0a3-e0ee-4cd1-8525-f093dd64d5be tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:47.171117 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e98fa9a9-a2e6-407d-ade4-c91790813bb8 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:47.171941 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e98fa9a9-a2e6-407d-ade4-c91790813bb8 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:47.172411 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e98fa9a9-a2e6-407d-ade4-c91790813bb8 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:47.172837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e98fa9a9-a2e6-407d-ade4-c91790813bb8 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:47.188923 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9aeef0a3-e0ee-4cd1-8525-f093dd64d5be tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:47.189445 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9aeef0a3-e0ee-4cd1-8525-f093dd64d5be tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:47.189891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9aeef0a3-e0ee-4cd1-8525-f093dd64d5be tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:47.190627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9aeef0a3-e0ee-4cd1-8525-f093dd64d5be tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:47.191087 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9aeef0a3-e0ee-4cd1-8525-f093dd64d5be tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:47.191521 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9aeef0a3-e0ee-4cd1-8525-f093dd64d5be tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:47.232243 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-9aeef0a3-e0ee-4cd1-8525-f093dd64d5be tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] HTTP exception thrown: Instance 031f6a33-bf9c-4b51-bf79-3764d67846e4 could not be found. Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9aeef0a3-e0ee-4cd1-8525-f093dd64d5be tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Request method failure captured: Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 HTTP/1.1 Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOyncnz_Xr9P8nn_Dn2jWOBPMfB25oKlwUdkb-lAovWLOcnbWbWtB8EupA339z8n4CLPU4Xvp4t38IgdhTeSkNNsbZcCHuTGeDJ3SIdUYD0jAqlhUKoi9rkJcjcETHKnjE1xV6Ecn7VoX8kfZElKx76DeJFkP6MWJtQcCHasZx2Oz20 Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 91e0286f34a549ed90c758652f0d20ae Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 91e0286f34a549ed90c758652f0d20ae Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ImagesTestJSON-1818116565-project Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 9f23399a5f1c4af6855a098198ca4ced Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ImagesTestJSON-1818116565-project Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 031f6a33-bf9c-4b51-bf79-3764d67846e4 could not be found. Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '031f6a33-bf9c-4b51-bf79-3764d67846e4'} Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 031f6a33-bf9c-4b51-bf79-3764d67846e4 could not be found. Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:36:47.233888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 031f6a33-bf9c-4b51-bf79-3764d67846e4 could not be found. Oct 05 02:36:47.237998 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.237998 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:47.237998 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.237998 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:47.237998 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:47.237998 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:47.237998 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:36:47.237998 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:36:47.237998 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 031f6a33-bf9c-4b51-bf79-3764d67846e4 could not be found. Oct 05 02:36:47.237998 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.237998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9aeef0a3-e0ee-4cd1-8525-f093dd64d5be tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Returning 404 to user: Instance 031f6a33-bf9c-4b51-bf79-3764d67846e4 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:36:47.238706 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9aeef0a3-e0ee-4cd1-8525-f093dd64d5be tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "DELETE /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 404 len: 111 microversion: 2.1 time: 0.082042 Oct 05 02:36:47.242976 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1167/2295] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:36:47 2022] DELETE /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:36:47.250325 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-51e49343-145d-42ba-ab90-f36f961652ed tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:47.250945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-51e49343-145d-42ba-ab90-f36f961652ed tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: 031f6a33-bf9c-4b51-bf79-3764d67846e4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:47.257473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51e49343-145d-42ba-ab90-f36f961652ed tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:47.258131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51e49343-145d-42ba-ab90-f36f961652ed tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:47.258575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51e49343-145d-42ba-ab90-f36f961652ed tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:47.259825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51e49343-145d-42ba-ab90-f36f961652ed tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:47.260453 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51e49343-145d-42ba-ab90-f36f961652ed tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:47.261062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51e49343-145d-42ba-ab90-f36f961652ed tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:47.277985 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-51e49343-145d-42ba-ab90-f36f961652ed tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] HTTP exception thrown: Instance 031f6a33-bf9c-4b51-bf79-3764d67846e4 could not be found. Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-51e49343-145d-42ba-ab90-f36f961652ed tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Request method failure captured: Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 HTTP/1.1 Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOyncnz_Xr9P8nn_Dn2jWOBPMfB25oKlwUdkb-lAovWLOcnbWbWtB8EupA339z8n4CLPU4Xvp4t38IgdhTeSkNNsbZcCHuTGeDJ3SIdUYD0jAqlhUKoi9rkJcjcETHKnjE1xV6Ecn7VoX8kfZElKx76DeJFkP6MWJtQcCHasZx2Oz20 Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 91e0286f34a549ed90c758652f0d20ae Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 91e0286f34a549ed90c758652f0d20ae Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ImagesTestJSON-1818116565-project Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 9f23399a5f1c4af6855a098198ca4ced Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ImagesTestJSON-1818116565-project Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 031f6a33-bf9c-4b51-bf79-3764d67846e4 could not be found. Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '031f6a33-bf9c-4b51-bf79-3764d67846e4'} Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 031f6a33-bf9c-4b51-bf79-3764d67846e4 could not be found. Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 031f6a33-bf9c-4b51-bf79-3764d67846e4 could not be found. Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.279957 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:47.284157 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:47.284157 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:47.284157 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:36:47.284157 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:36:47.284157 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 031f6a33-bf9c-4b51-bf79-3764d67846e4 could not be found. Oct 05 02:36:47.284157 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.285260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-51e49343-145d-42ba-ab90-f36f961652ed tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Returning 404 to user: Instance 031f6a33-bf9c-4b51-bf79-3764d67846e4 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:36:47.286360 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-51e49343-145d-42ba-ab90-f36f961652ed tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4" status: 404 len: 111 microversion: 2.1 time: 0.041066 Oct 05 02:36:47.290799 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1168/2296] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:47 2022] GET /compute/v2.1/servers/031f6a33-bf9c-4b51-bf79-3764d67846e4 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:36:47.296335 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-88c46e3e-0af0-4b14-bad5-d064f0d0a0e8 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '.version_select at 0x7fcce81e14c0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:47.323278 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-88c46e3e-0af0-4b14-bad5-d064f0d0a0e8 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] HTTP exception thrown: Image not found. Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-88c46e3e-0af0-4b14-bad5-d064f0d0a0e8 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Request method failure captured: Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c HTTP/1.1 Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOyncnz_Xr9P8nn_Dn2jWOBPMfB25oKlwUdkb-lAovWLOcnbWbWtB8EupA339z8n4CLPU4Xvp4t38IgdhTeSkNNsbZcCHuTGeDJ3SIdUYD0jAqlhUKoi9rkJcjcETHKnjE1xV6Ecn7VoX8kfZElKx76DeJFkP6MWJtQcCHasZx2Oz20 Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 91e0286f34a549ed90c758652f0d20ae Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 91e0286f34a549ed90c758652f0d20ae Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ImagesTestJSON-1818116565-project Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 9f23399a5f1c4af6855a098198ca4ced Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ImagesTestJSON-1818116565-project Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: exception: Image not found. Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '213e60fe-4312-49e1-af03-aaca79384e9c'} Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 213e60fe-4312-49e1-af03-aaca79384e9c to delete Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 213e60fe-4312-49e1-af03-aaca79384e9c could not be found. Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.325709 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:47.330014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:47.330014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:47.330014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:36:47.330014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:36:47.330014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:36:47.330014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:36:47.330014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:36:47.330014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:36:47.330014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 05 02:36:47.330014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 05 02:36:47.330014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 02:36:47.330014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.330014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:47.330014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.330014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:47.330014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:47.330014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:47.330014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:36:47.330014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:36:47.330014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 02:36:47.330014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.332405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-88c46e3e-0af0-4b14-bad5-d064f0d0a0e8 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Returning 404 to user: Image not found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:36:47.333451 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-88c46e3e-0af0-4b14-bad5-d064f0d0a0e8 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "DELETE /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c" status: 404 len: 62 microversion: 2.1 time: 0.041140 Oct 05 02:36:47.337865 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1169/2297] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:47 2022] DELETE /compute/v2.1/images/213e60fe-4312-49e1-af03-aaca79384e9c => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:36:47.343263 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-10bf12ef-ea04-4871-8a0d-769017a1590a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:47.343946 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-10bf12ef-ea04-4871-8a0d-769017a1590a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: b6f02d3d-f6df-419f-9962-58c68a597dcd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:47.352547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10bf12ef-ea04-4871-8a0d-769017a1590a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:47.353914 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10bf12ef-ea04-4871-8a0d-769017a1590a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:47.354675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10bf12ef-ea04-4871-8a0d-769017a1590a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:47.355571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10bf12ef-ea04-4871-8a0d-769017a1590a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:47.356268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10bf12ef-ea04-4871-8a0d-769017a1590a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:47.357197 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10bf12ef-ea04-4871-8a0d-769017a1590a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:47.373793 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-10bf12ef-ea04-4871-8a0d-769017a1590a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] HTTP exception thrown: Instance b6f02d3d-f6df-419f-9962-58c68a597dcd could not be found. Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-10bf12ef-ea04-4871-8a0d-769017a1590a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Request method failure captured: Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/servers/b6f02d3d-f6df-419f-9962-58c68a597dcd HTTP/1.1 Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOyncnz_Xr9P8nn_Dn2jWOBPMfB25oKlwUdkb-lAovWLOcnbWbWtB8EupA339z8n4CLPU4Xvp4t38IgdhTeSkNNsbZcCHuTGeDJ3SIdUYD0jAqlhUKoi9rkJcjcETHKnjE1xV6Ecn7VoX8kfZElKx76DeJFkP6MWJtQcCHasZx2Oz20 Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 91e0286f34a549ed90c758652f0d20ae Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 91e0286f34a549ed90c758652f0d20ae Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ImagesTestJSON-1818116565-project Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 9f23399a5f1c4af6855a098198ca4ced Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ImagesTestJSON-1818116565-project Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance b6f02d3d-f6df-419f-9962-58c68a597dcd could not be found. Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'b6f02d3d-f6df-419f-9962-58c68a597dcd'} Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6f02d3d-f6df-419f-9962-58c68a597dcd could not be found. Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:36:47.375771 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6f02d3d-f6df-419f-9962-58c68a597dcd could not be found. Oct 05 02:36:47.379966 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.379966 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:47.379966 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.379966 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:47.379966 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:47.379966 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:47.379966 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:36:47.379966 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:36:47.379966 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6f02d3d-f6df-419f-9962-58c68a597dcd could not be found. Oct 05 02:36:47.379966 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.381359 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-10bf12ef-ea04-4871-8a0d-769017a1590a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Returning 404 to user: Instance b6f02d3d-f6df-419f-9962-58c68a597dcd could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:36:47.382443 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-10bf12ef-ea04-4871-8a0d-769017a1590a tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b6f02d3d-f6df-419f-9962-58c68a597dcd" status: 404 len: 111 microversion: 2.1 time: 0.043419 Oct 05 02:36:47.386900 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1170/2298] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:36:47 2022] DELETE /compute/v2.1/servers/b6f02d3d-f6df-419f-9962-58c68a597dcd => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:36:47.391917 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-db371e37-ef56-49da-ac02-9e04f9cdf9f3 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:47.392732 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-db371e37-ef56-49da-ac02-9e04f9cdf9f3 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] [instance: b6f02d3d-f6df-419f-9962-58c68a597dcd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:47.401913 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db371e37-ef56-49da-ac02-9e04f9cdf9f3 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:47.402657 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db371e37-ef56-49da-ac02-9e04f9cdf9f3 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:47.403264 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db371e37-ef56-49da-ac02-9e04f9cdf9f3 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:47.404127 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db371e37-ef56-49da-ac02-9e04f9cdf9f3 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:47.405280 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db371e37-ef56-49da-ac02-9e04f9cdf9f3 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:47.405868 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db371e37-ef56-49da-ac02-9e04f9cdf9f3 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:47.423617 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-db371e37-ef56-49da-ac02-9e04f9cdf9f3 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] HTTP exception thrown: Instance b6f02d3d-f6df-419f-9962-58c68a597dcd could not be found. Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-db371e37-ef56-49da-ac02-9e04f9cdf9f3 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Request method failure captured: Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/b6f02d3d-f6df-419f-9962-58c68a597dcd HTTP/1.1 Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOyncnz_Xr9P8nn_Dn2jWOBPMfB25oKlwUdkb-lAovWLOcnbWbWtB8EupA339z8n4CLPU4Xvp4t38IgdhTeSkNNsbZcCHuTGeDJ3SIdUYD0jAqlhUKoi9rkJcjcETHKnjE1xV6Ecn7VoX8kfZElKx76DeJFkP6MWJtQcCHasZx2Oz20 Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 91e0286f34a549ed90c758652f0d20ae Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_91e0286f34a549ed90c758652f0d20ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 91e0286f34a549ed90c758652f0d20ae Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ImagesTestJSON-1818116565 Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ImagesTestJSON-1818116565-project Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 9f23399a5f1c4af6855a098198ca4ced Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ImagesTestJSON-1818116565-project Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance b6f02d3d-f6df-419f-9962-58c68a597dcd could not be found. Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'b6f02d3d-f6df-419f-9962-58c68a597dcd'} Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6f02d3d-f6df-419f-9962-58c68a597dcd could not be found. Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6f02d3d-f6df-419f-9962-58c68a597dcd could not be found. Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.426430 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:47.430735 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:47.430735 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:47.430735 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:36:47.430735 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:36:47.430735 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6f02d3d-f6df-419f-9962-58c68a597dcd could not be found. Oct 05 02:36:47.430735 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:36:47.432854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-db371e37-ef56-49da-ac02-9e04f9cdf9f3 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] Returning 404 to user: Instance b6f02d3d-f6df-419f-9962-58c68a597dcd could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:36:47.433874 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-db371e37-ef56-49da-ac02-9e04f9cdf9f3 tempest-ImagesTestJSON-1818116565 tempest-ImagesTestJSON-1818116565-project] 10.222.0.16 "GET /compute/v2.1/servers/b6f02d3d-f6df-419f-9962-58c68a597dcd" status: 404 len: 111 microversion: 2.1 time: 0.045771 Oct 05 02:36:47.438493 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1171/2299] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:47 2022] GET /compute/v2.1/servers/b6f02d3d-f6df-419f-9962-58c68a597dcd => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:36:47.443690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0407a233-873e-4c17-b5ca-d54220643925 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:47.445427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0407a233-873e-4c17-b5ca-d54220643925 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:47.453218 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0407a233-873e-4c17-b5ca-d54220643925 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:47.453959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0407a233-873e-4c17-b5ca-d54220643925 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:47.454566 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0407a233-873e-4c17-b5ca-d54220643925 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:47.455430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0407a233-873e-4c17-b5ca-d54220643925 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:47.456032 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0407a233-873e-4c17-b5ca-d54220643925 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:47.456600 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0407a233-873e-4c17-b5ca-d54220643925 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:47.926289 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e98fa9a9-a2e6-407d-ade4-c91790813bb8 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:47.936265 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e98fa9a9-a2e6-407d-ade4-c91790813bb8 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 200 len: 1811 microversion: 2.1 time: 0.803537 Oct 05 02:36:47.957889 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1129/2300] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:47 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 1811 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:47.970158 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a88e27fd-3b6d-495c-a03e-c25fc4bbb244 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:47.973699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a88e27fd-3b6d-495c-a03e-c25fc4bbb244 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: 5f395291-91f2-4958-bf8c-6c4d4adb0c9f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:47.986863 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a88e27fd-3b6d-495c-a03e-c25fc4bbb244 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:47.992354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a88e27fd-3b6d-495c-a03e-c25fc4bbb244 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:47.993021 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a88e27fd-3b6d-495c-a03e-c25fc4bbb244 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:47.994470 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a88e27fd-3b6d-495c-a03e-c25fc4bbb244 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:47.995060 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a88e27fd-3b6d-495c-a03e-c25fc4bbb244 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:47.995605 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a88e27fd-3b6d-495c-a03e-c25fc4bbb244 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:48.340416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a88e27fd-3b6d-495c-a03e-c25fc4bbb244 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:48.349680 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a88e27fd-3b6d-495c-a03e-c25fc4bbb244 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f" status: 200 len: 1321 microversion: 2.1 time: 0.390484 Oct 05 02:36:48.354689 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1130/2301] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:47 2022] GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f => generated 1321 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:48.363964 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-05daefa3-c1c6-45a8-be95-702fd0d8e5ee tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf5d3ca0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:48.461656 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-05daefa3-c1c6-45a8-be95-702fd0d8e5ee tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd" status: 200 len: 1454 microversion: 2.1 time: 0.103960 Oct 05 02:36:48.462394 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1131/2302] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:48 2022] GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:48.831309 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-95e081a2-d6da-4693-80f6-02c43cb3776e tempest-VolumesAdminNegativeTest-1288086852 tempest-VolumesAdminNegativeTest-1288086852-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "d0b98635-4352-430f-99cc-bb242587c6e2"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:48.835114 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-95e081a2-d6da-4693-80f6-02c43cb3776e tempest-VolumesAdminNegativeTest-1288086852 tempest-VolumesAdminNegativeTest-1288086852-project-admin] [instance: 6cf0945c-2ca2-4803-ab89-adf554c92c51] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:48.838988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:48.849969 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-95e081a2-d6da-4693-80f6-02c43cb3776e tempest-VolumesAdminNegativeTest-1288086852 tempest-VolumesAdminNegativeTest-1288086852-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:48.850724 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-95e081a2-d6da-4693-80f6-02c43cb3776e tempest-VolumesAdminNegativeTest-1288086852 tempest-VolumesAdminNegativeTest-1288086852-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:48.851936 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-95e081a2-d6da-4693-80f6-02c43cb3776e tempest-VolumesAdminNegativeTest-1288086852 tempest-VolumesAdminNegativeTest-1288086852-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:48.853878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-95e081a2-d6da-4693-80f6-02c43cb3776e tempest-VolumesAdminNegativeTest-1288086852 tempest-VolumesAdminNegativeTest-1288086852-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:48.854529 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-95e081a2-d6da-4693-80f6-02c43cb3776e tempest-VolumesAdminNegativeTest-1288086852 tempest-VolumesAdminNegativeTest-1288086852-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:48.855121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-95e081a2-d6da-4693-80f6-02c43cb3776e tempest-VolumesAdminNegativeTest-1288086852 tempest-VolumesAdminNegativeTest-1288086852-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:48.973770 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-95e081a2-d6da-4693-80f6-02c43cb3776e tempest-VolumesAdminNegativeTest-1288086852 tempest-VolumesAdminNegativeTest-1288086852-project-admin] HTTP exception thrown: Volume b896263d-b630-4c6d-b467-ae2b9075124c could not be found. Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-95e081a2-d6da-4693-80f6-02c43cb3776e tempest-VolumesAdminNegativeTest-1288086852 tempest-VolumesAdminNegativeTest-1288086852-project-admin] Request method failure captured: Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: request: PUT /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51/os-volume_attachments/b896263d-b630-4c6d-b467-ae2b9075124c HTTP/1.1 Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 74 Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOz9m6xT47hnWcr3Hi63UJpST6Io2TNGegGb0JIhky1v6KSnJEnNzfkL1CuTHop9gYLRMZyDpflAm7azHB1b5KUNocbeYob2wVm7V6xlXfFOxIQ21lZkRWIcuU6s63HbpXI35HGQJ3_eo8PJnlRARg-uUVb0zC6n_IBbgCkToGXpn_4 Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 5271c4a34ba547dfa6cb40a569394ef7 Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-VolumesAdminNegativeTest-1288086852 Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: X-Role: admin,member,reader Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: admin,member,reader Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5271c4a34ba547dfa6cb40a569394ef7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5271c4a34ba547dfa6cb40a569394ef7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5271c4a34ba547dfa6cb40a569394ef7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5271c4a34ba547dfa6cb40a569394ef7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-VolumesAdminNegativeTest-1288086852 Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 5271c4a34ba547dfa6cb40a569394ef7 Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1288086852 Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-VolumesAdminNegativeTest-1288086852-project-admin Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 0f6f5c78d11f4ecf9ff99a95df8e1a00 Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-VolumesAdminNegativeTest-1288086852-project-admin Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: {"volumeAttachment": {"volumeId": "d0b98635-4352-430f-99cc-bb242587c6e2"}} Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: exception: Volume b896263d-b630-4c6d-b467-ae2b9075124c could not be found. Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'server_id': '6cf0945c-2ca2-4803-ab89-adf554c92c51', 'id': 'b896263d-b630-4c6d-b467-ae2b9075124c', 'body': {'volumeAttachment': {'volumeId': 'd0b98635-4352-430f-99cc-bb242587c6e2'}}} Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b896263d-b630-4c6d-b467-ae2b9075124c could not be found. (HTTP 404) (Request-ID: req-cdb45e46-6d0c-4a75-8d52-931e5372b1f8) Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 02:36:48.981160 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b896263d-b630-4c6d-b467-ae2b9075124c could not be found. Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b896263d-b630-4c6d-b467-ae2b9075124c could not be found. Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b896263d-b630-4c6d-b467-ae2b9075124c could not be found. Oct 05 02:36:48.985862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:48.991720 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-95e081a2-d6da-4693-80f6-02c43cb3776e tempest-VolumesAdminNegativeTest-1288086852 tempest-VolumesAdminNegativeTest-1288086852-project-admin] Returning 404 to user: Volume b896263d-b630-4c6d-b467-ae2b9075124c could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:36:48.992847 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-95e081a2-d6da-4693-80f6-02c43cb3776e tempest-VolumesAdminNegativeTest-1288086852 tempest-VolumesAdminNegativeTest-1288086852-project-admin] 10.222.0.16 "PUT /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51/os-volume_attachments/b896263d-b630-4c6d-b467-ae2b9075124c" status: 404 len: 109 microversion: 2.1 time: 0.165445 Oct 05 02:36:48.994987 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1132/2303] 10.222.0.16 () {60 vars in 1433 bytes} [Wed Oct 5 02:36:48 2022] PUT /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51/os-volume_attachments/b896263d-b630-4c6d-b467-ae2b9075124c => generated 109 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:36:49.045022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7bcf7b73-5e55-43b0-92b7-ffb38bbf0a2b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:49.055555 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7bcf7b73-5e55-43b0-92b7-ffb38bbf0a2b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:49.090239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7bcf7b73-5e55-43b0-92b7-ffb38bbf0a2b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:49.090744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7bcf7b73-5e55-43b0-92b7-ffb38bbf0a2b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:49.093737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7bcf7b73-5e55-43b0-92b7-ffb38bbf0a2b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:49.094695 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7bcf7b73-5e55-43b0-92b7-ffb38bbf0a2b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:49.095145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7bcf7b73-5e55-43b0-92b7-ffb38bbf0a2b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:49.102375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7bcf7b73-5e55-43b0-92b7-ffb38bbf0a2b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:49.144762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:49.197849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=14 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:49.385947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0407a233-873e-4c17-b5ca-d54220643925 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:49.409154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0407a233-873e-4c17-b5ca-d54220643925 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:49.409154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0407a233-873e-4c17-b5ca-d54220643925 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:49.409154 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0407a233-873e-4c17-b5ca-d54220643925 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1723 microversion: 2.20 time: 1.967659 Oct 05 02:36:49.439767 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1172/2304] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:36:47 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1723 bytes in 2000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:36:49.456776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3001e578-19b1-4926-9231-0de91363d7c6 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:49.457506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3001e578-19b1-4926-9231-0de91363d7c6 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: 5f395291-91f2-4958-bf8c-6c4d4adb0c9f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:49.479668 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3001e578-19b1-4926-9231-0de91363d7c6 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:49.480438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3001e578-19b1-4926-9231-0de91363d7c6 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:49.480599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3001e578-19b1-4926-9231-0de91363d7c6 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:49.492089 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3001e578-19b1-4926-9231-0de91363d7c6 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:49.497600 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3001e578-19b1-4926-9231-0de91363d7c6 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:49.499797 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3001e578-19b1-4926-9231-0de91363d7c6 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:49.594654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=36 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:51.982490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7bcf7b73-5e55-43b0-92b7-ffb38bbf0a2b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:52.006396 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7bcf7b73-5e55-43b0-92b7-ffb38bbf0a2b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 200 len: 1811 microversion: 2.1 time: 2.993316 Oct 05 02:36:52.007093 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1133/2305] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:48 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 1811 bytes in 3007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:52.019162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b8ed2fcb-5a76-43b5-8fa2-747f8b39a78f tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf501ee0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:52.023518 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3001e578-19b1-4926-9231-0de91363d7c6 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:52.042511 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3001e578-19b1-4926-9231-0de91363d7c6 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f" status: 200 len: 1321 microversion: 2.1 time: 2.598687 Oct 05 02:36:52.043535 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1173/2306] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:49 2022] GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f => generated 1321 bytes in 2603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:52.049217 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-e58a6a5d-247d-4f15-a2f2-7dbb226e913d req-b149cde4-fc9c-4162-89e3-f48983e86283 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f395291-91f2-4958-bf8c-6c4d4adb0c9f", "tag": "4b8f9b1f-1e56-4a62-afee-5b22dad3b1bc"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:52.061202 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e58a6a5d-247d-4f15-a2f2-7dbb226e913d req-b149cde4-fc9c-4162-89e3-f48983e86283 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:52.062046 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e58a6a5d-247d-4f15-a2f2-7dbb226e913d req-b149cde4-fc9c-4162-89e3-f48983e86283 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:52.063478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e58a6a5d-247d-4f15-a2f2-7dbb226e913d req-b149cde4-fc9c-4162-89e3-f48983e86283 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:52.090605 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-e58a6a5d-247d-4f15-a2f2-7dbb226e913d req-b149cde4-fc9c-4162-89e3-f48983e86283 service nova] Creating event network-changed:4b8f9b1f-1e56-4a62-afee-5b22dad3b1bc for instance 5f395291-91f2-4958-bf8c-6c4d4adb0c9f on n-h2-858272-3 Oct 05 02:36:52.107321 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b8ed2fcb-5a76-43b5-8fa2-747f8b39a78f tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd" status: 200 len: 1463 microversion: 2.1 time: 0.098756 Oct 05 02:36:52.115986 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-e58a6a5d-247d-4f15-a2f2-7dbb226e913d req-b149cde4-fc9c-4162-89e3-f48983e86283 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070939 Oct 05 02:36:52.119438 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1134/2307] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:52 2022] GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd => generated 1463 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:52.120680 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1174/2308] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:52.131111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-89d86dd5-0e3e-411d-a008-e364aaa78268 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:52.131816 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-89d86dd5-0e3e-411d-a008-e364aaa78268 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:52.135258 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-58239d37-e4c2-4521-83ec-6a9e121bd318 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:52.136239 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-58239d37-e4c2-4521-83ec-6a9e121bd318 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:52.155921 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-89d86dd5-0e3e-411d-a008-e364aaa78268 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:52.156671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-89d86dd5-0e3e-411d-a008-e364aaa78268 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:52.157310 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-89d86dd5-0e3e-411d-a008-e364aaa78268 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:52.161047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-89d86dd5-0e3e-411d-a008-e364aaa78268 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:52.164239 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58239d37-e4c2-4521-83ec-6a9e121bd318 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:52.168029 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-89d86dd5-0e3e-411d-a008-e364aaa78268 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:52.168493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-89d86dd5-0e3e-411d-a008-e364aaa78268 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:52.174043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58239d37-e4c2-4521-83ec-6a9e121bd318 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:52.174543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58239d37-e4c2-4521-83ec-6a9e121bd318 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:52.175461 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58239d37-e4c2-4521-83ec-6a9e121bd318 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:52.176094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58239d37-e4c2-4521-83ec-6a9e121bd318 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:52.176674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58239d37-e4c2-4521-83ec-6a9e121bd318 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:52.225811 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:52.298233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-58239d37-e4c2-4521-83ec-6a9e121bd318 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:36:52.529161 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-58239d37-e4c2-4521-83ec-6a9e121bd318 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 204 len: 0 microversion: 2.1 time: 0.405717 Oct 05 02:36:52.536499 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1175/2309] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:36:52 2022] DELETE /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:36:52.565553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-73b9e930-aa5b-4099-ae7e-df6b04f462ff tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce8142550>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:52.626723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-89d86dd5-0e3e-411d-a008-e364aaa78268 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:52.642596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-89d86dd5-0e3e-411d-a008-e364aaa78268 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:52.647177 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-89d86dd5-0e3e-411d-a008-e364aaa78268 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:52.651893 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-89d86dd5-0e3e-411d-a008-e364aaa78268 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1656 microversion: 2.20 time: 0.531307 Oct 05 02:36:52.670574 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1135/2310] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:36:52 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1656 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:36:52.679272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fb06c19b-4ae5-4a14-a981-6725db9ec9e6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:52.680170 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fb06c19b-4ae5-4a14-a981-6725db9ec9e6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:52.688382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb06c19b-4ae5-4a14-a981-6725db9ec9e6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:52.689192 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb06c19b-4ae5-4a14-a981-6725db9ec9e6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:52.689789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb06c19b-4ae5-4a14-a981-6725db9ec9e6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:52.690999 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb06c19b-4ae5-4a14-a981-6725db9ec9e6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:52.691611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb06c19b-4ae5-4a14-a981-6725db9ec9e6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:52.692189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb06c19b-4ae5-4a14-a981-6725db9ec9e6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:52.693966 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-73b9e930-aa5b-4099-ae7e-df6b04f462ff tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd" status: 200 len: 1463 microversion: 2.1 time: 0.154538 Oct 05 02:36:52.707888 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1176/2311] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:52 2022] GET /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd => generated 1463 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:52.713095 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-1bc8d2fe-0d4d-4c57-9c19-48709dafb802 req-7b3276e0-1913-4ebb-b515-8f0ced3bbf4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d0e63ee-ba8d-4203-9cd5-f13d833de668", "name": "network-vif-deleted", "tag": "1f6198cb-46e6-468f-99fa-33f57b082af5"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:52.739120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1bc8d2fe-0d4d-4c57-9c19-48709dafb802 req-7b3276e0-1913-4ebb-b515-8f0ced3bbf4e service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:52.739842 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1bc8d2fe-0d4d-4c57-9c19-48709dafb802 req-7b3276e0-1913-4ebb-b515-8f0ced3bbf4e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:52.740208 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1bc8d2fe-0d4d-4c57-9c19-48709dafb802 req-7b3276e0-1913-4ebb-b515-8f0ced3bbf4e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:52.754559 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-1bc8d2fe-0d4d-4c57-9c19-48709dafb802 req-7b3276e0-1913-4ebb-b515-8f0ced3bbf4e service nova] Creating event network-vif-deleted:1f6198cb-46e6-468f-99fa-33f57b082af5 for instance 1d0e63ee-ba8d-4203-9cd5-f13d833de668 on n-h2-858272-3 Oct 05 02:36:52.760130 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-1bc8d2fe-0d4d-4c57-9c19-48709dafb802 req-7b3276e0-1913-4ebb-b515-8f0ced3bbf4e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050160 Oct 05 02:36:52.761265 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1177/2312] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:52.768850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-49703186-f247-4daa-aa5b-16ee936bf4b8 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:52.769630 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-49703186-f247-4daa-aa5b-16ee936bf4b8 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: e123bb72-45c5-4371-bf2e-f0747497f16b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:52.792887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49703186-f247-4daa-aa5b-16ee936bf4b8 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:52.797391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49703186-f247-4daa-aa5b-16ee936bf4b8 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:52.797984 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49703186-f247-4daa-aa5b-16ee936bf4b8 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:52.799649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49703186-f247-4daa-aa5b-16ee936bf4b8 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:52.801397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49703186-f247-4daa-aa5b-16ee936bf4b8 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:52.801999 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49703186-f247-4daa-aa5b-16ee936bf4b8 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:53.448405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-49703186-f247-4daa-aa5b-16ee936bf4b8 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f551e15d65a34daaac2b4d4f5963c522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7719a3153f66484c8758bb0999719851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:53.458724 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-49703186-f247-4daa-aa5b-16ee936bf4b8 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/servers/e123bb72-45c5-4371-bf2e-f0747497f16b" status: 200 len: 1467 microversion: 2.1 time: 0.694439 Oct 05 02:36:53.464764 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1178/2313] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:52 2022] GET /compute/v2.1/servers/e123bb72-45c5-4371-bf2e-f0747497f16b => generated 1467 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:53.505079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-4e8b109b-03c0-47bc-bcb1-4c00eb456b89 req-ae55c6bd-6b1f-4e28-8d86-7e1c82a862bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e123bb72-45c5-4371-bf2e-f0747497f16b", "name": "network-vif-unplugged", "status": "completed", "tag": "05da60d7-1d7e-4607-a912-92561fc99617"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:53.539848 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4e8b109b-03c0-47bc-bcb1-4c00eb456b89 req-ae55c6bd-6b1f-4e28-8d86-7e1c82a862bd service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:53.545035 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4e8b109b-03c0-47bc-bcb1-4c00eb456b89 req-ae55c6bd-6b1f-4e28-8d86-7e1c82a862bd service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:53.545570 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4e8b109b-03c0-47bc-bcb1-4c00eb456b89 req-ae55c6bd-6b1f-4e28-8d86-7e1c82a862bd service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:53.579802 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-4e8b109b-03c0-47bc-bcb1-4c00eb456b89 req-ae55c6bd-6b1f-4e28-8d86-7e1c82a862bd service nova] Creating event network-vif-unplugged:05da60d7-1d7e-4607-a912-92561fc99617 for instance e123bb72-45c5-4371-bf2e-f0747497f16b on n-h1-858272-3 Oct 05 02:36:53.594893 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-4e8b109b-03c0-47bc-bcb1-4c00eb456b89 req-ae55c6bd-6b1f-4e28-8d86-7e1c82a862bd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126861 Oct 05 02:36:53.597104 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1179/2314] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:53.614012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ce08f95b-58dd-4f1a-a574-5ef3faf53beb tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:53.615361 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ce08f95b-58dd-4f1a-a574-5ef3faf53beb tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:53.632689 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce08f95b-58dd-4f1a-a574-5ef3faf53beb tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:53.635783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce08f95b-58dd-4f1a-a574-5ef3faf53beb tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:53.636752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce08f95b-58dd-4f1a-a574-5ef3faf53beb tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:53.639316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce08f95b-58dd-4f1a-a574-5ef3faf53beb tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:53.640085 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce08f95b-58dd-4f1a-a574-5ef3faf53beb tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:53.642561 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce08f95b-58dd-4f1a-a574-5ef3faf53beb tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:53.646354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fb06c19b-4ae5-4a14-a981-6725db9ec9e6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:53.661614 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fb06c19b-4ae5-4a14-a981-6725db9ec9e6 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1666 microversion: 2.1 time: 0.984656 Oct 05 02:36:53.662654 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1136/2315] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:52 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1666 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:53.676181 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fb356ae9-b3b8-48b4-8c29-35e851e48a41 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:53.690978 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fb356ae9-b3b8-48b4-8c29-35e851e48a41 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: 5f395291-91f2-4958-bf8c-6c4d4adb0c9f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:53.706191 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb356ae9-b3b8-48b4-8c29-35e851e48a41 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:53.707495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb356ae9-b3b8-48b4-8c29-35e851e48a41 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:53.709008 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb356ae9-b3b8-48b4-8c29-35e851e48a41 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:53.715393 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb356ae9-b3b8-48b4-8c29-35e851e48a41 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:53.716603 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb356ae9-b3b8-48b4-8c29-35e851e48a41 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:53.719141 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb356ae9-b3b8-48b4-8c29-35e851e48a41 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:54.303071 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fb356ae9-b3b8-48b4-8c29-35e851e48a41 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:54.317701 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fb356ae9-b3b8-48b4-8c29-35e851e48a41 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f" status: 200 len: 1321 microversion: 2.1 time: 0.653710 Oct 05 02:36:54.318540 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1137/2316] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:53 2022] GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f => generated 1321 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:54.325382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a932e03e-ae91-46a5-bff2-8eac5367607d tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf66eb80>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:54.555701 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a932e03e-ae91-46a5-bff2-8eac5367607d tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images?changes-since=2022-10-05T02%3A34%3A37Z" status: 200 len: 2373 microversion: 2.1 time: 0.235782 Oct 05 02:36:54.557103 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1138/2317] 10.222.0.16 () {58 vars in 1199 bytes} [Wed Oct 5 02:36:54 2022] GET /compute/v2.1/images?changes-since=2022-10-05T02%3A34%3A37Z => generated 2373 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:54.579254 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-17a0dc83-3a40-43db-b2e2-f32f07a5704f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:54.585538 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-17a0dc83-3a40-43db-b2e2-f32f07a5704f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:54.611962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17a0dc83-3a40-43db-b2e2-f32f07a5704f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:54.620842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17a0dc83-3a40-43db-b2e2-f32f07a5704f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:54.633608 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17a0dc83-3a40-43db-b2e2-f32f07a5704f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:54.636129 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17a0dc83-3a40-43db-b2e2-f32f07a5704f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:54.639306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17a0dc83-3a40-43db-b2e2-f32f07a5704f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:54.641981 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17a0dc83-3a40-43db-b2e2-f32f07a5704f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:54.751735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ce08f95b-58dd-4f1a-a574-5ef3faf53beb tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:54.769767 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ce08f95b-58dd-4f1a-a574-5ef3faf53beb tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 200 len: 1675 microversion: 2.1 time: 1.169172 Oct 05 02:36:54.770366 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1180/2318] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:53 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 1675 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:54.801097 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17a0dc83-3a40-43db-b2e2-f32f07a5704f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:54.801455 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17a0dc83-3a40-43db-b2e2-f32f07a5704f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:54.804703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17a0dc83-3a40-43db-b2e2-f32f07a5704f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:54.805309 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-17a0dc83-3a40-43db-b2e2-f32f07a5704f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lazy-loading 'fault' on Instance uuid 7a28c6ea-5b3d-4f74-b490-8effa4fa813d {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:36:54.933553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-99f2f104-d57d-4628-afea-b31e694ee831 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-253935993", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "d6fd991d-63d9-47d8-ab37-6e7c262e4ff9"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:55.021066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-99f2f104-d57d-4628-afea-b31e694ee831 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] validate_networks() for [('d6fd991d-63d9-47d8-ab37-6e7c262e4ff9', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:36:55.488315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-17a0dc83-3a40-43db-b2e2-f32f07a5704f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:55.504182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-17a0dc83-3a40-43db-b2e2-f32f07a5704f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:55.510997 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-17a0dc83-3a40-43db-b2e2-f32f07a5704f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:55.536974 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-17a0dc83-3a40-43db-b2e2-f32f07a5704f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 200 len: 1372 microversion: 2.20 time: 0.951151 Oct 05 02:36:55.536974 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1139/2319] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:36:54 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 1372 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:36:55.547052 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2f4d8f7c-bd62-4cf8-acc1-0b1a3110bf6f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:55.547052 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2f4d8f7c-bd62-4cf8-acc1-0b1a3110bf6f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 6cf0945c-2ca2-4803-ab89-adf554c92c51] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:55.568934 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f4d8f7c-bd62-4cf8-acc1-0b1a3110bf6f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:55.574194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f4d8f7c-bd62-4cf8-acc1-0b1a3110bf6f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:55.574685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f4d8f7c-bd62-4cf8-acc1-0b1a3110bf6f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:55.579756 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f4d8f7c-bd62-4cf8-acc1-0b1a3110bf6f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:55.580255 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f4d8f7c-bd62-4cf8-acc1-0b1a3110bf6f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:55.580703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f4d8f7c-bd62-4cf8-acc1-0b1a3110bf6f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:55.694222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2f4d8f7c-bd62-4cf8-acc1-0b1a3110bf6f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 6cf0945c-2ca2-4803-ab89-adf554c92c51] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:36:55.937678 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2f4d8f7c-bd62-4cf8-acc1-0b1a3110bf6f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51" status: 204 len: 0 microversion: 2.1 time: 0.410979 Oct 05 02:36:55.938513 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1140/2320] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:36:55 2022] DELETE /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:36:55.951317 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-16dd638f-1231-40dc-8c62-5b1ab3e5efc5 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf6039d0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:56.073733 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-16dd638f-1231-40dc-8c62-5b1ab3e5efc5 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-260763784" status: 200 len: 484 microversion: 2.1 time: 0.133605 Oct 05 02:36:56.074990 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1141/2321] 10.222.0.16 () {58 vars in 1229 bytes} [Wed Oct 5 02:36:55 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-260763784 => generated 484 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:56.089756 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-53728fd0-c99e-450d-8906-40fbfce37015 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:56.090849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-53728fd0-c99e-450d-8906-40fbfce37015 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:56.107286 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53728fd0-c99e-450d-8906-40fbfce37015 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:56.108090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53728fd0-c99e-450d-8906-40fbfce37015 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:56.110185 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53728fd0-c99e-450d-8906-40fbfce37015 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:56.111265 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53728fd0-c99e-450d-8906-40fbfce37015 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:56.113149 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53728fd0-c99e-450d-8906-40fbfce37015 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:56.120433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53728fd0-c99e-450d-8906-40fbfce37015 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:56.752884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-53728fd0-c99e-450d-8906-40fbfce37015 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:56.765041 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-53728fd0-c99e-450d-8906-40fbfce37015 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 200 len: 1598 microversion: 2.1 time: 0.687056 Oct 05 02:36:56.765649 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1142/2322] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:56 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 1598 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:56.787211 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-438f25be-a3bd-4f41-a4df-5d1fe1ad1473 req-104c40b1-dda6-4f6c-a448-271fe0631838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a28c6ea-5b3d-4f74-b490-8effa4fa813d", "name": "network-vif-deleted", "tag": "9902bd06-5ff4-4749-a5aa-d4afd71ba732"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:56.809013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-438f25be-a3bd-4f41-a4df-5d1fe1ad1473 req-104c40b1-dda6-4f6c-a448-271fe0631838 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:56.809517 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-438f25be-a3bd-4f41-a4df-5d1fe1ad1473 req-104c40b1-dda6-4f6c-a448-271fe0631838 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:56.809954 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-438f25be-a3bd-4f41-a4df-5d1fe1ad1473 req-104c40b1-dda6-4f6c-a448-271fe0631838 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:56.825756 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-438f25be-a3bd-4f41-a4df-5d1fe1ad1473 req-104c40b1-dda6-4f6c-a448-271fe0631838 service nova] Creating event network-vif-deleted:9902bd06-5ff4-4749-a5aa-d4afd71ba732 for instance 7a28c6ea-5b3d-4f74-b490-8effa4fa813d on n-h2-858272-3 Oct 05 02:36:56.853197 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-438f25be-a3bd-4f41-a4df-5d1fe1ad1473 req-104c40b1-dda6-4f6c-a448-271fe0631838 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084345 Oct 05 02:36:56.854123 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1143/2323] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:56.867288 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c9532500-7b6b-4ee8-8c45-7182b8fd0521 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:56.869125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c9532500-7b6b-4ee8-8c45-7182b8fd0521 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: 5f395291-91f2-4958-bf8c-6c4d4adb0c9f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:56.882423 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9532500-7b6b-4ee8-8c45-7182b8fd0521 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:56.882926 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9532500-7b6b-4ee8-8c45-7182b8fd0521 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:56.883364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9532500-7b6b-4ee8-8c45-7182b8fd0521 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:56.884593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9532500-7b6b-4ee8-8c45-7182b8fd0521 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:56.885269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9532500-7b6b-4ee8-8c45-7182b8fd0521 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:56.885700 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9532500-7b6b-4ee8-8c45-7182b8fd0521 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:56.962662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:57.723345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c9532500-7b6b-4ee8-8c45-7182b8fd0521 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:57.731682 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c9532500-7b6b-4ee8-8c45-7182b8fd0521 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f" status: 200 len: 1321 microversion: 2.1 time: 0.875120 Oct 05 02:36:57.732527 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1144/2324] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:56 2022] GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f => generated 1321 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:57.739871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-88d7668e-3cb0-47be-afd0-1cc73950b3f0 req-31eaa102-b5a7-4ce6-921e-91f3afb00c39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d0e63ee-ba8d-4203-9cd5-f13d833de668", "name": "network-vif-unplugged", "status": "completed", "tag": "2e61d503-74a8-4e51-878c-815eee17f241"}, {"server_uuid": "1d0e63ee-ba8d-4203-9cd5-f13d833de668", "name": "network-vif-unplugged", "status": "completed", "tag": "bcf2876a-f110-4231-b6e1-99589b34eab3"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:57.756980 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-88d7668e-3cb0-47be-afd0-1cc73950b3f0 req-31eaa102-b5a7-4ce6-921e-91f3afb00c39 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:57.758070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-88d7668e-3cb0-47be-afd0-1cc73950b3f0 req-31eaa102-b5a7-4ce6-921e-91f3afb00c39 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:57.758705 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-88d7668e-3cb0-47be-afd0-1cc73950b3f0 req-31eaa102-b5a7-4ce6-921e-91f3afb00c39 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:57.771195 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-88d7668e-3cb0-47be-afd0-1cc73950b3f0 req-31eaa102-b5a7-4ce6-921e-91f3afb00c39 service nova] Creating event network-vif-unplugged:2e61d503-74a8-4e51-878c-815eee17f241 for instance 1d0e63ee-ba8d-4203-9cd5-f13d833de668 on n-h2-858272-3 Oct 05 02:36:57.771839 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-88d7668e-3cb0-47be-afd0-1cc73950b3f0 req-31eaa102-b5a7-4ce6-921e-91f3afb00c39 service nova] Creating event network-vif-unplugged:bcf2876a-f110-4231-b6e1-99589b34eab3 for instance 1d0e63ee-ba8d-4203-9cd5-f13d833de668 on n-h2-858272-3 Oct 05 02:36:57.783190 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-88d7668e-3cb0-47be-afd0-1cc73950b3f0 req-31eaa102-b5a7-4ce6-921e-91f3afb00c39 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.049107 Oct 05 02:36:57.784815 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1145/2325] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:57.791195 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8c5f7a87-cbfe-42a4-904a-43a2ec0c05a4 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:57.792921 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8c5f7a87-cbfe-42a4-904a-43a2ec0c05a4 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:57.799838 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c5f7a87-cbfe-42a4-904a-43a2ec0c05a4 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:57.800644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c5f7a87-cbfe-42a4-904a-43a2ec0c05a4 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:57.801328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c5f7a87-cbfe-42a4-904a-43a2ec0c05a4 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:57.802265 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c5f7a87-cbfe-42a4-904a-43a2ec0c05a4 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:57.802938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c5f7a87-cbfe-42a4-904a-43a2ec0c05a4 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:57.803592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c5f7a87-cbfe-42a4-904a-43a2ec0c05a4 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:57.994153 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-99f2f104-d57d-4628-afea-b31e694ee831 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:36:57.994789 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-99f2f104-d57d-4628-afea-b31e694ee831 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:36:57.995269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-99f2f104-d57d-4628-afea-b31e694ee831 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:36:57.995863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-99f2f104-d57d-4628-afea-b31e694ee831 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:36:57.996272 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-99f2f104-d57d-4628-afea-b31e694ee831 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:36:58.005828 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99f2f104-d57d-4628-afea-b31e694ee831 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:58.006640 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99f2f104-d57d-4628-afea-b31e694ee831 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:58.007302 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99f2f104-d57d-4628-afea-b31e694ee831 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:58.008354 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99f2f104-d57d-4628-afea-b31e694ee831 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:58.009290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99f2f104-d57d-4628-afea-b31e694ee831 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:58.009851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99f2f104-d57d-4628-afea-b31e694ee831 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:58.038881 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-99f2f104-d57d-4628-afea-b31e694ee831 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Getting quotas for project 16f8146191044043ab43029742153150. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:36:58.050132 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-99f2f104-d57d-4628-afea-b31e694ee831 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Getting quotas for user 559ade1b882b43d4a4f095c9214e8167 and project 16f8146191044043ab43029742153150. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:36:58.073163 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-99f2f104-d57d-4628-afea-b31e694ee831 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:36:58.075710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-99f2f104-d57d-4628-afea-b31e694ee831 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] [instance: f005bb25-795a-40c0-aca9-32f8183d4b5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:36:58.137468 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-99f2f104-d57d-4628-afea-b31e694ee831 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 3.354783 Oct 05 02:36:58.139030 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1181/2326] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 5 02:36:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 3357 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 05 02:36:58.145744 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5ac8c9cc-92f4-44bf-b0c8-cde54c51c5eb tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:58.146812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5ac8c9cc-92f4-44bf-b0c8-cde54c51c5eb tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 6cf0945c-2ca2-4803-ab89-adf554c92c51] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:58.155123 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5ac8c9cc-92f4-44bf-b0c8-cde54c51c5eb tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:58.155908 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5ac8c9cc-92f4-44bf-b0c8-cde54c51c5eb tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:58.156592 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5ac8c9cc-92f4-44bf-b0c8-cde54c51c5eb tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:58.157693 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5ac8c9cc-92f4-44bf-b0c8-cde54c51c5eb tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:58.158306 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5ac8c9cc-92f4-44bf-b0c8-cde54c51c5eb tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:58.158876 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5ac8c9cc-92f4-44bf-b0c8-cde54c51c5eb tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:58.357760 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8c5f7a87-cbfe-42a4-904a-43a2ec0c05a4 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:58.373875 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8c5f7a87-cbfe-42a4-904a-43a2ec0c05a4 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 200 len: 1654 microversion: 2.1 time: 0.587445 Oct 05 02:36:58.374733 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1146/2327] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:57 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 1654 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:58.379093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bd04d9d3-cff8-4a2e-bd84-79ead4e12391 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf5874c0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:58.559784 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bd04d9d3-cff8-4a2e-bd84-79ead4e12391 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images?server=e123bb72-45c5-4371-bf2e-f0747497f16b" status: 200 len: 957 microversion: 2.1 time: 0.184015 Oct 05 02:36:58.560375 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1147/2328] 10.222.0.16 () {58 vars in 1209 bytes} [Wed Oct 5 02:36:58 2022] GET /compute/v2.1/images?server=e123bb72-45c5-4371-bf2e-f0747497f16b => generated 957 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:58.590711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-5efb1c8d-33ff-4bbf-8e0b-31f9eebbae06 req-2a256d6e-bf23-4ca5-af87-21e37dbf2721 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a19871a-12bc-45d8-ad01-489ad68f1e00", "name": "network-vif-deleted", "tag": "c4608021-f3cf-466d-92f8-ca22a3a9526d"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:58.607451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5efb1c8d-33ff-4bbf-8e0b-31f9eebbae06 req-2a256d6e-bf23-4ca5-af87-21e37dbf2721 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:58.607937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5efb1c8d-33ff-4bbf-8e0b-31f9eebbae06 req-2a256d6e-bf23-4ca5-af87-21e37dbf2721 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:58.608371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5efb1c8d-33ff-4bbf-8e0b-31f9eebbae06 req-2a256d6e-bf23-4ca5-af87-21e37dbf2721 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:58.628358 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-5efb1c8d-33ff-4bbf-8e0b-31f9eebbae06 req-2a256d6e-bf23-4ca5-af87-21e37dbf2721 service nova] Creating event network-vif-deleted:c4608021-f3cf-466d-92f8-ca22a3a9526d for instance 9a19871a-12bc-45d8-ad01-489ad68f1e00 on n-h2-858272-3 Oct 05 02:36:58.635699 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-5efb1c8d-33ff-4bbf-8e0b-31f9eebbae06 req-2a256d6e-bf23-4ca5-af87-21e37dbf2721 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058772 Oct 05 02:36:58.637363 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1148/2329] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:58.648721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0c9c2abe-2cd3-497a-afcf-004bc5c549ca tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:58.649703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0c9c2abe-2cd3-497a-afcf-004bc5c549ca tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:58.682423 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c9c2abe-2cd3-497a-afcf-004bc5c549ca tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:58.682937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c9c2abe-2cd3-497a-afcf-004bc5c549ca tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:58.683392 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c9c2abe-2cd3-497a-afcf-004bc5c549ca tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:58.684113 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c9c2abe-2cd3-497a-afcf-004bc5c549ca tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:58.684831 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c9c2abe-2cd3-497a-afcf-004bc5c549ca tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:58.687614 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c9c2abe-2cd3-497a-afcf-004bc5c549ca tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:58.724797 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-0c9c2abe-2cd3-497a-afcf-004bc5c549ca tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] HTTP exception thrown: Instance 7a28c6ea-5b3d-4f74-b490-8effa4fa813d could not be found. Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0c9c2abe-2cd3-497a-afcf-004bc5c549ca tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Request method failure captured: Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d HTTP/1.1 Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOytiS7b2tK0awcEIotX_usFegY2tGFUeOktlSay5uZeJJlr1mgaMspizter-ThNcnxIA0JGrv8A75MOFzYgHfQXUiIxbzFruC5wIt6llgJ6488NxjhbOhnRVT5nq01W7iSZsvlLO6bsqUodskpKK_NcAurDwc6wAUp_KMwStZczpro Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: X-Openstack-Nova-Api-Version: 2.20 Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 3b649132448b44278c6dd55cdb6ff3de Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1773917274 Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3b649132448b44278c6dd55cdb6ff3de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3b649132448b44278c6dd55cdb6ff3de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3b649132448b44278c6dd55cdb6ff3de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3b649132448b44278c6dd55cdb6ff3de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1773917274 Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 3b649132448b44278c6dd55cdb6ff3de Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1773917274 Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-AttachVolumeShelveTestJSON-1773917274-project Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: e4b5243d9ffe46c4b32033da558d1e2c Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1773917274-project Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 7a28c6ea-5b3d-4f74-b490-8effa4fa813d could not be found. Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '7a28c6ea-5b3d-4f74-b490-8effa4fa813d'} Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a28c6ea-5b3d-4f74-b490-8effa4fa813d could not be found. Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a28c6ea-5b3d-4f74-b490-8effa4fa813d could not be found. Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:58.728370 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:58.733006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:58.733006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:58.733006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:58.733006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:58.733006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:36:58.733006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:36:58.733006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a28c6ea-5b3d-4f74-b490-8effa4fa813d could not be found. Oct 05 02:36:58.733006 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:58.733006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0c9c2abe-2cd3-497a-afcf-004bc5c549ca tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Returning 404 to user: Instance 7a28c6ea-5b3d-4f74-b490-8effa4fa813d could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:36:58.733891 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0c9c2abe-2cd3-497a-afcf-004bc5c549ca tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 404 len: 111 microversion: 2.20 time: 0.090119 Oct 05 02:36:58.733891 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1149/2330] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:36:58 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:36:58.742200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5132ca79-6c0b-447f-87b1-43b426a71617 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:58.742818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5132ca79-6c0b-447f-87b1-43b426a71617 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 9a19871a-12bc-45d8-ad01-489ad68f1e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:58.751921 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5132ca79-6c0b-447f-87b1-43b426a71617 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:58.752640 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5132ca79-6c0b-447f-87b1-43b426a71617 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:58.753274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5132ca79-6c0b-447f-87b1-43b426a71617 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:58.754204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5132ca79-6c0b-447f-87b1-43b426a71617 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:58.754812 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5132ca79-6c0b-447f-87b1-43b426a71617 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:58.755385 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5132ca79-6c0b-447f-87b1-43b426a71617 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:58.777928 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-5132ca79-6c0b-447f-87b1-43b426a71617 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] HTTP exception thrown: Instance 9a19871a-12bc-45d8-ad01-489ad68f1e00 could not be found. Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5132ca79-6c0b-447f-87b1-43b426a71617 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Request method failure captured: Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 HTTP/1.1 Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOvNe8KhpGZ8DG_1oOvLGb0DCJaF37J8SQNLdwbipKbLuSq3872FLJ_shjUOOozYCqstc1rgVms0er1jsbYXWmNBMApk_YXcsVG10Fg4W_uHLlDzKjEVUZHLAbuWJUnRLXE0v-DNCHykp-Beue_j-q1szQrJD4sNhb_g_7AcfhuUWUI Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 6652917123e14c2797cafacc4e31f75a Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-LiveMigrationTest-256153741 Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6652917123e14c2797cafacc4e31f75a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6652917123e14c2797cafacc4e31f75a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6652917123e14c2797cafacc4e31f75a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6652917123e14c2797cafacc4e31f75a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-LiveMigrationTest-256153741 Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 6652917123e14c2797cafacc4e31f75a Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-LiveMigrationTest-256153741 Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-LiveMigrationTest-256153741-project Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 118c1425677b45b98689befb0eb55cce Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-LiveMigrationTest-256153741-project Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 9a19871a-12bc-45d8-ad01-489ad68f1e00 could not be found. Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '9a19871a-12bc-45d8-ad01-489ad68f1e00'} Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a19871a-12bc-45d8-ad01-489ad68f1e00 could not be found. Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a19871a-12bc-45d8-ad01-489ad68f1e00 could not be found. Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:36:58.780172 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:58.785789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:36:58.785789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:36:58.785789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:36:58.785789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:36:58.785789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:36:58.785789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a19871a-12bc-45d8-ad01-489ad68f1e00 could not be found. Oct 05 02:36:58.785789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:36:58.785789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5132ca79-6c0b-447f-87b1-43b426a71617 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Returning 404 to user: Instance 9a19871a-12bc-45d8-ad01-489ad68f1e00 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:36:58.785789 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5132ca79-6c0b-447f-87b1-43b426a71617 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00" status: 404 len: 111 microversion: 2.1 time: 0.043381 Oct 05 02:36:58.785789 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1150/2331] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:58 2022] GET /compute/v2.1/servers/9a19871a-12bc-45d8-ad01-489ad68f1e00 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:36:58.791267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-01fcdcdf-bf51-463d-afbf-4ca9df015dd5 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:58.792149 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-01fcdcdf-bf51-463d-afbf-4ca9df015dd5 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] [instance: f005bb25-795a-40c0-aca9-32f8183d4b5c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:58.976890 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-01fcdcdf-bf51-463d-afbf-4ca9df015dd5 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:58.997569 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-01fcdcdf-bf51-463d-afbf-4ca9df015dd5 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:58.999303 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5ac8c9cc-92f4-44bf-b0c8-cde54c51c5eb tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:58.999768 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-01fcdcdf-bf51-463d-afbf-4ca9df015dd5 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:59.001688 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-01fcdcdf-bf51-463d-afbf-4ca9df015dd5 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] 10.222.0.16 "GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c" status: 200 len: 1258 microversion: 2.21 time: 0.214863 Oct 05 02:36:59.003384 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1151/2332] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:36:58 2022] GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c => generated 1258 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:36:59.011333 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5ac8c9cc-92f4-44bf-b0c8-cde54c51c5eb tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51" status: 200 len: 1515 microversion: 2.1 time: 0.870986 Oct 05 02:36:59.012632 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1182/2333] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:58 2022] GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51 => generated 1515 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:59.018032 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3ecc029d-477f-4fd9-842d-07e0b4390b0b tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce81f4670>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:59.030124 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-598e2b14-77da-4928-b5f5-fd12a5110482 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '.version_select at 0x7fccdf5b2a60>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:59.071949 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-598e2b14-77da-4928-b5f5-fd12a5110482 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1444920499" status: 204 len: 0 microversion: 2.20 time: 0.048053 Oct 05 02:36:59.076652 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1152/2334] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 5 02:36:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1444920499 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 02:36:59.084233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c7c37279-2675-4228-bd6a-13ef9719b566 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:59.084847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c7c37279-2675-4228-bd6a-13ef9719b566 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: 5f395291-91f2-4958-bf8c-6c4d4adb0c9f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:59.089755 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3ecc029d-477f-4fd9-842d-07e0b4390b0b tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F7b30cf01-6bc7-453f-b9f2-98400bcfc063" status: 200 len: 484 microversion: 2.1 time: 0.075816 Oct 05 02:36:59.092519 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c7c37279-2675-4228-bd6a-13ef9719b566 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:59.093321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c7c37279-2675-4228-bd6a-13ef9719b566 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:59.093839 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1183/2335] 10.222.0.16 () {58 vars in 1317 bytes} [Wed Oct 5 02:36:59 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F7b30cf01-6bc7-453f-b9f2-98400bcfc063 => generated 484 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:59.100252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c7c37279-2675-4228-bd6a-13ef9719b566 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:59.100252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c7c37279-2675-4228-bd6a-13ef9719b566 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:59.100252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c7c37279-2675-4228-bd6a-13ef9719b566 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:59.100252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c7c37279-2675-4228-bd6a-13ef9719b566 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:59.125603 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-60a8757b-14ff-42dc-b21b-df4f7db8081c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '.version_select at 0x7fcce81423a0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:59.160118 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-60a8757b-14ff-42dc-b21b-df4f7db8081c tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-727129128" status: 202 len: 0 microversion: 2.1 time: 0.056145 Oct 05 02:36:59.163889 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1184/2336] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 5 02:36:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-727129128 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:36:59.172795 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-ec1d1432-f96f-4118-b9dc-18810319bd94 req-184855a8-6aab-4732-844b-327792823f17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d0e63ee-ba8d-4203-9cd5-f13d833de668", "name": "network-vif-deleted", "tag": "bcf2876a-f110-4231-b6e1-99589b34eab3"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:59.192975 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ec1d1432-f96f-4118-b9dc-18810319bd94 req-184855a8-6aab-4732-844b-327792823f17 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:59.193472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ec1d1432-f96f-4118-b9dc-18810319bd94 req-184855a8-6aab-4732-844b-327792823f17 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:59.198656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ec1d1432-f96f-4118-b9dc-18810319bd94 req-184855a8-6aab-4732-844b-327792823f17 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:59.226765 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-ec1d1432-f96f-4118-b9dc-18810319bd94 req-184855a8-6aab-4732-844b-327792823f17 service nova] Creating event network-vif-deleted:bcf2876a-f110-4231-b6e1-99589b34eab3 for instance 1d0e63ee-ba8d-4203-9cd5-f13d833de668 on n-h2-858272-3 Oct 05 02:36:59.246217 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-ec1d1432-f96f-4118-b9dc-18810319bd94 req-184855a8-6aab-4732-844b-327792823f17 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083709 Oct 05 02:36:59.246915 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1185/2337] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:59.256053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9a839564-b5cb-441f-85d0-6c02d9a2d164 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce8186d30>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:59.388388 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9a839564-b5cb-441f-85d0-6c02d9a2d164 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F7b30cf01-6bc7-453f-b9f2-98400bcfc063" status: 200 len: 484 microversion: 2.1 time: 0.138696 Oct 05 02:36:59.398904 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1186/2338] 10.222.0.16 () {58 vars in 1303 bytes} [Wed Oct 5 02:36:59 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F7b30cf01-6bc7-453f-b9f2-98400bcfc063 => generated 484 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:36:59.407007 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-68f1b392-e666-4518-9ac9-8e67452f9442 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:59.419981 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-68f1b392-e666-4518-9ac9-8e67452f9442 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:36:59.444183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68f1b392-e666-4518-9ac9-8e67452f9442 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:59.444692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68f1b392-e666-4518-9ac9-8e67452f9442 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:59.445333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68f1b392-e666-4518-9ac9-8e67452f9442 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:59.446369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68f1b392-e666-4518-9ac9-8e67452f9442 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:59.447207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68f1b392-e666-4518-9ac9-8e67452f9442 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:59.447801 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68f1b392-e666-4518-9ac9-8e67452f9442 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:59.797161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-68f1b392-e666-4518-9ac9-8e67452f9442 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:59.809337 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-68f1b392-e666-4518-9ac9-8e67452f9442 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 200 len: 1298 microversion: 2.1 time: 0.406577 Oct 05 02:36:59.810369 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1187/2339] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:59 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 1298 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:59.815213 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-efa4285b-c5e9-4f6f-bfb2-5714fa47e8cc tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf76aee0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:36:59.879943 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c7c37279-2675-4228-bd6a-13ef9719b566 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:36:59.902333 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c7c37279-2675-4228-bd6a-13ef9719b566 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f" status: 200 len: 1321 microversion: 2.1 time: 0.820602 Oct 05 02:36:59.905012 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1153/2340] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:36:59 2022] GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f => generated 1321 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:36:59.923901 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-ea01837a-9df3-47da-afc4-20a5ea3958b9 req-f1908574-18ac-44b3-b5d6-167a414a59ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f395291-91f2-4958-bf8c-6c4d4adb0c9f", "name": "network-vif-plugged", "status": "completed", "tag": "4b8f9b1f-1e56-4a62-afee-5b22dad3b1bc"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:36:59.971034 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ea01837a-9df3-47da-afc4-20a5ea3958b9 req-f1908574-18ac-44b3-b5d6-167a414a59ee service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:36:59.972524 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ea01837a-9df3-47da-afc4-20a5ea3958b9 req-f1908574-18ac-44b3-b5d6-167a414a59ee service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:36:59.975156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ea01837a-9df3-47da-afc4-20a5ea3958b9 req-f1908574-18ac-44b3-b5d6-167a414a59ee service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:36:59.999969 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-ea01837a-9df3-47da-afc4-20a5ea3958b9 req-f1908574-18ac-44b3-b5d6-167a414a59ee service nova] Creating event network-vif-plugged:4b8f9b1f-1e56-4a62-afee-5b22dad3b1bc for instance 5f395291-91f2-4958-bf8c-6c4d4adb0c9f on n-h2-858272-3 Oct 05 02:37:00.015497 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-ea01837a-9df3-47da-afc4-20a5ea3958b9 req-f1908574-18ac-44b3-b5d6-167a414a59ee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107325 Oct 05 02:37:00.016684 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1154/2341] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:37:00.028418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2fc58e74-4151-4643-aa15-42d27ecb9083 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:00.029149 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2fc58e74-4151-4643-aa15-42d27ecb9083 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] [instance: f005bb25-795a-40c0-aca9-32f8183d4b5c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:00.047151 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fc58e74-4151-4643-aa15-42d27ecb9083 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:00.047919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fc58e74-4151-4643-aa15-42d27ecb9083 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:00.048546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fc58e74-4151-4643-aa15-42d27ecb9083 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:00.054098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fc58e74-4151-4643-aa15-42d27ecb9083 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:00.054778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fc58e74-4151-4643-aa15-42d27ecb9083 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:00.055375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fc58e74-4151-4643-aa15-42d27ecb9083 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:00.063970 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-efa4285b-c5e9-4f6f-bfb2-5714fa47e8cc tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3278 microversion: 2.1 time: 0.252136 Oct 05 02:37:00.070686 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1188/2342] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Oct 5 02:36:59 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3278 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:00.090853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-105b6a0c-d8a9-4f13-8266-fd0b944fa463 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:00.091512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-105b6a0c-d8a9-4f13-8266-fd0b944fa463 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 6cf0945c-2ca2-4803-ab89-adf554c92c51] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:00.129085 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-105b6a0c-d8a9-4f13-8266-fd0b944fa463 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:00.129785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-105b6a0c-d8a9-4f13-8266-fd0b944fa463 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:00.130414 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-105b6a0c-d8a9-4f13-8266-fd0b944fa463 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:00.131489 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-105b6a0c-d8a9-4f13-8266-fd0b944fa463 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:00.133279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-105b6a0c-d8a9-4f13-8266-fd0b944fa463 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:00.135257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-105b6a0c-d8a9-4f13-8266-fd0b944fa463 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:00.445920 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2fc58e74-4151-4643-aa15-42d27ecb9083 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:00.460637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2fc58e74-4151-4643-aa15-42d27ecb9083 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:00.462808 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2fc58e74-4151-4643-aa15-42d27ecb9083 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:00.464968 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2fc58e74-4151-4643-aa15-42d27ecb9083 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] 10.222.0.16 "GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c" status: 200 len: 1318 microversion: 2.21 time: 0.440853 Oct 05 02:37:00.466228 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1155/2343] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:37:00 2022] GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c => generated 1318 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:37:00.473630 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-105b6a0c-d8a9-4f13-8266-fd0b944fa463 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:00.497741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-58ac0608-ac1d-44ce-91f8-d2faa8920f21 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf587040>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:00.499051 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-105b6a0c-d8a9-4f13-8266-fd0b944fa463 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51" status: 200 len: 1473 microversion: 2.1 time: 0.423330 Oct 05 02:37:00.503545 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1189/2344] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:00 2022] GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51 => generated 1473 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:00.731258 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-58ac0608-ac1d-44ce-91f8-d2faa8920f21 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.263680 Oct 05 02:37:00.739951 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1156/2345] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Oct 5 02:37:00 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:00.748139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6072a9d7-c316-4fc7-aed7-d4a34d6e4ec0 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce8263160>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:00.783866 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9cafc239-640c-4ae6-a10f-5c948c267e8e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Action: 'create', calling method: .version_select at 0x7fccdf5a6310>, body: {"keypair": {"name": "tempest-keypair-1831050844", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJD1dYpEWCZsZTNfdEoQtDnMOH6iKN4tz/LSoayb+a4pz2D3ioSVUzSRNyTDwUINT0/4+0VXPGIsUsVP2y7/F7E1CksqkSebZTcH5sIOXMTZZ28WJcEVgx56hTl5X8fDA=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:00.851306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-9cafc239-640c-4ae6-a10f-5c948c267e8e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Getting quotas for project 3b649132448b44278c6dd55cdb6ff3de. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:37:00.889322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-9cafc239-640c-4ae6-a10f-5c948c267e8e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Getting quotas for user e4b5243d9ffe46c4b32033da558d1e2c and project 3b649132448b44278c6dd55cdb6ff3de. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:37:00.942628 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6072a9d7-c316-4fc7-aed7-d4a34d6e4ec0 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.197882 Oct 05 02:37:00.944128 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1190/2346] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 5 02:37:00 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:37:00.950351 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f8fdbea1-acb4-4845-89d9-d1994ae19ef1 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:00.951026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f8fdbea1-acb4-4845-89d9-d1994ae19ef1 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:00.986158 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9cafc239-640c-4ae6-a10f-5c948c267e8e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.202397 Oct 05 02:37:00.987459 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1157/2347] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Oct 5 02:37:00 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 208 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 05 02:37:00.996326 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8fdbea1-acb4-4845-89d9-d1994ae19ef1 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:01.000132 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8fdbea1-acb4-4845-89d9-d1994ae19ef1 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:01.005043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8fdbea1-acb4-4845-89d9-d1994ae19ef1 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:01.005531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-995a8c60-3ddb-4db8-8592-baaf2d72908b tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:01.006410 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8fdbea1-acb4-4845-89d9-d1994ae19ef1 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:01.007462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-995a8c60-3ddb-4db8-8592-baaf2d72908b tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: 5f395291-91f2-4958-bf8c-6c4d4adb0c9f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:01.008064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8fdbea1-acb4-4845-89d9-d1994ae19ef1 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:01.010362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8fdbea1-acb4-4845-89d9-d1994ae19ef1 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:01.039136 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-995a8c60-3ddb-4db8-8592-baaf2d72908b tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:01.045287 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-995a8c60-3ddb-4db8-8592-baaf2d72908b tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:01.046723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-995a8c60-3ddb-4db8-8592-baaf2d72908b tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:01.048926 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-995a8c60-3ddb-4db8-8592-baaf2d72908b tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:01.051375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-995a8c60-3ddb-4db8-8592-baaf2d72908b tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:01.051706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-995a8c60-3ddb-4db8-8592-baaf2d72908b tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:01.052842 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-f8fdbea1-acb4-4845-89d9-d1994ae19ef1 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] HTTP exception thrown: Instance 1d0e63ee-ba8d-4203-9cd5-f13d833de668 could not be found. Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f8fdbea1-acb4-4845-89d9-d1994ae19ef1 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Request method failure captured: Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 HTTP/1.1 Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO2A94pn1unf7Tec3jJOeL-pCSWjwtu2x-XR2SK5jNwu0xU-WXF4dynC1BdXxsNVnxUewK47XoikuKSvxaXSOdytbuzIEz2yN2g88rujbBE25tHGvxQQKf_mg6cqRei6SIdDyxuPi29B0yiubBblKvoFzf61k7-BMs2AcZU0uU9K3jM Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: fc3fd0eb45ed4080af876031348f367a Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersTestMultiNic-1996318355 Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fc3fd0eb45ed4080af876031348f367a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fc3fd0eb45ed4080af876031348f367a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fc3fd0eb45ed4080af876031348f367a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fc3fd0eb45ed4080af876031348f367a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersTestMultiNic-1996318355 Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: fc3fd0eb45ed4080af876031348f367a Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersTestMultiNic-1996318355 Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersTestMultiNic-1996318355-project Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 9e5ffbccdbec4a4bb21a3e48c1f7beaf Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersTestMultiNic-1996318355-project Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 1d0e63ee-ba8d-4203-9cd5-f13d833de668 could not be found. Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '1d0e63ee-ba8d-4203-9cd5-f13d833de668'} Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d0e63ee-ba8d-4203-9cd5-f13d833de668 could not be found. Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d0e63ee-ba8d-4203-9cd5-f13d833de668 could not be found. Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:01.061327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:01.067459 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:01.067459 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:01.067459 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:01.067459 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:37:01.067459 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:37:01.067459 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d0e63ee-ba8d-4203-9cd5-f13d833de668 could not be found. Oct 05 02:37:01.067459 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:01.067459 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f8fdbea1-acb4-4845-89d9-d1994ae19ef1 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Returning 404 to user: Instance 1d0e63ee-ba8d-4203-9cd5-f13d833de668 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:37:01.067459 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f8fdbea1-acb4-4845-89d9-d1994ae19ef1 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 404 len: 111 microversion: 2.1 time: 0.119619 Oct 05 02:37:01.069528 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1191/2348] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:00 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:37:01.081172 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-acf877c8-364e-4919-81fc-de2c22caf7d4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce8263040>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:01.246294 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-acf877c8-364e-4919-81fc-de2c22caf7d4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/detail?changes-since=2022-10-05T02%3A34%3A27Z" status: 200 len: 6331 microversion: 2.1 time: 0.175079 Oct 05 02:37:01.247504 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1192/2349] 10.222.0.16 () {58 vars in 1220 bytes} [Wed Oct 5 02:37:01 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-05T02%3A34%3A27Z => generated 6331 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:01.252416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4896ac93-6bd1-4945-aaed-02bb25e3ea7e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:01.254131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4896ac93-6bd1-4945-aaed-02bb25e3ea7e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:01.262446 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4896ac93-6bd1-4945-aaed-02bb25e3ea7e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:01.263245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4896ac93-6bd1-4945-aaed-02bb25e3ea7e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:01.263923 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4896ac93-6bd1-4945-aaed-02bb25e3ea7e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:01.264549 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4896ac93-6bd1-4945-aaed-02bb25e3ea7e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:01.265135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4896ac93-6bd1-4945-aaed-02bb25e3ea7e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:01.265768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4896ac93-6bd1-4945-aaed-02bb25e3ea7e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:01.309225 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4896ac93-6bd1-4945-aaed-02bb25e3ea7e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:37:01.424752 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4896ac93-6bd1-4945-aaed-02bb25e3ea7e tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 204 len: 0 microversion: 2.1 time: 0.175690 Oct 05 02:37:01.425602 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1193/2350] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:37:01 2022] DELETE /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:37:01.433239 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d2afceda-a5fb-4f77-afb8-b6fc26c2c84c tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce81f4b80>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:01.500038 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d2afceda-a5fb-4f77-afb8-b6fc26c2c84c tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-260763784" status: 200 len: 664 microversion: 2.1 time: 0.072758 Oct 05 02:37:01.500952 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1194/2351] 10.222.0.16 () {58 vars in 1250 bytes} [Wed Oct 5 02:37:01 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-260763784 => generated 664 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:37:01.505732 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-ebf7220b-585f-4de5-86e2-07e6709715ad req-d4b481d0-a827-43c0-a05c-b4ec1f9c00b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d0e63ee-ba8d-4203-9cd5-f13d833de668", "name": "network-vif-deleted", "tag": "2e61d503-74a8-4e51-878c-815eee17f241"}, {"server_uuid": "6cf0945c-2ca2-4803-ab89-adf554c92c51", "name": "network-vif-deleted", "tag": "f6e6392b-8cd7-4c22-85db-cc379ca54ac8"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:01.518269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ebf7220b-585f-4de5-86e2-07e6709715ad req-d4b481d0-a827-43c0-a05c-b4ec1f9c00b2 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:01.518623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ebf7220b-585f-4de5-86e2-07e6709715ad req-d4b481d0-a827-43c0-a05c-b4ec1f9c00b2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:01.519062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ebf7220b-585f-4de5-86e2-07e6709715ad req-d4b481d0-a827-43c0-a05c-b4ec1f9c00b2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:01.534874 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-ebf7220b-585f-4de5-86e2-07e6709715ad req-d4b481d0-a827-43c0-a05c-b4ec1f9c00b2 service nova] Creating event network-vif-deleted:2e61d503-74a8-4e51-878c-815eee17f241 for instance 1d0e63ee-ba8d-4203-9cd5-f13d833de668 on n-h2-858272-3 Oct 05 02:37:01.535369 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-ebf7220b-585f-4de5-86e2-07e6709715ad req-d4b481d0-a827-43c0-a05c-b4ec1f9c00b2 service nova] Creating event network-vif-deleted:f6e6392b-8cd7-4c22-85db-cc379ca54ac8 for instance 6cf0945c-2ca2-4803-ab89-adf554c92c51 on n-h1-858272-3 Oct 05 02:37:01.547209 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-ebf7220b-585f-4de5-86e2-07e6709715ad req-d4b481d0-a827-43c0-a05c-b4ec1f9c00b2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044859 Oct 05 02:37:01.547823 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1195/2352] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:37:01.553867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e1477638-d88e-4583-8a1d-5c5b3d6b40cd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:01.554775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e1477638-d88e-4583-8a1d-5c5b3d6b40cd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:01.570053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1477638-d88e-4583-8a1d-5c5b3d6b40cd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:01.570804 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1477638-d88e-4583-8a1d-5c5b3d6b40cd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:01.572993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1477638-d88e-4583-8a1d-5c5b3d6b40cd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:01.573922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1477638-d88e-4583-8a1d-5c5b3d6b40cd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:01.574399 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1477638-d88e-4583-8a1d-5c5b3d6b40cd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:01.574836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1477638-d88e-4583-8a1d-5c5b3d6b40cd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:01.677233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-995a8c60-3ddb-4db8-8592-baaf2d72908b tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:01.689802 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-995a8c60-3ddb-4db8-8592-baaf2d72908b tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f" status: 200 len: 1321 microversion: 2.1 time: 0.700875 Oct 05 02:37:01.690839 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1158/2353] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:00 2022] GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f => generated 1321 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:01.697324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2f5aa916-2e32-4719-a570-8808f0d49fe7 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:01.698242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2f5aa916-2e32-4719-a570-8808f0d49fe7 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] [instance: f005bb25-795a-40c0-aca9-32f8183d4b5c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:01.705956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f5aa916-2e32-4719-a570-8808f0d49fe7 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:01.706984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f5aa916-2e32-4719-a570-8808f0d49fe7 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:01.708040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f5aa916-2e32-4719-a570-8808f0d49fe7 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:01.709069 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f5aa916-2e32-4719-a570-8808f0d49fe7 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:01.709750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f5aa916-2e32-4719-a570-8808f0d49fe7 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:01.711327 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f5aa916-2e32-4719-a570-8808f0d49fe7 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:01.889560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2f5aa916-2e32-4719-a570-8808f0d49fe7 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:01.919931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2f5aa916-2e32-4719-a570-8808f0d49fe7 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:01.925053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2f5aa916-2e32-4719-a570-8808f0d49fe7 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:01.928116 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2f5aa916-2e32-4719-a570-8808f0d49fe7 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] 10.222.0.16 "GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c" status: 200 len: 1316 microversion: 2.21 time: 0.235539 Oct 05 02:37:01.947417 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1159/2354] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:37:01 2022] GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c => generated 1316 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:37:01.954478 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-be4ab118-d202-4128-a935-b70859129264 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf5b7790>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:02.036072 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-be4ab118-d202-4128-a935-b70859129264 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F7b30cf01-6bc7-453f-b9f2-98400bcfc063" status: 200 len: 1466 microversion: 2.1 time: 0.087207 Oct 05 02:37:02.037613 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1160/2355] 10.222.0.16 () {58 vars in 1338 bytes} [Wed Oct 5 02:37:01 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F7b30cf01-6bc7-453f-b9f2-98400bcfc063 => generated 1466 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:02.042883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-71d07b80-0527-4589-814d-dfb5215c3484 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:02.043774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-71d07b80-0527-4589-814d-dfb5215c3484 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 6cf0945c-2ca2-4803-ab89-adf554c92c51] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:02.050987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71d07b80-0527-4589-814d-dfb5215c3484 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:02.051732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71d07b80-0527-4589-814d-dfb5215c3484 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:02.052213 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71d07b80-0527-4589-814d-dfb5215c3484 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:02.053135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71d07b80-0527-4589-814d-dfb5215c3484 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:02.053771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71d07b80-0527-4589-814d-dfb5215c3484 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:02.054204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71d07b80-0527-4589-814d-dfb5215c3484 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:02.064975 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e1477638-d88e-4583-8a1d-5c5b3d6b40cd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:02.071203 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-71d07b80-0527-4589-814d-dfb5215c3484 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] HTTP exception thrown: Instance 6cf0945c-2ca2-4803-ab89-adf554c92c51 could not be found. Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-71d07b80-0527-4589-814d-dfb5215c3484 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Request method failure captured: Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51 HTTP/1.1 Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOzmYSUQoTQEHnEFBEthXV58tyuv156c8BrOZCJgkQ7okWPLQbiUqVOHb1lcD8kj6OAV_Z9W_lk4PXFmj71_m0rAhkC1h80lRQYG3-e1RNtAjUuKHEz9QbUL8PlXSrTfQ6-ZVWO4kISO7Wx8nvToRR3gPT4Ks4LbXRnhldh-hHefTvA Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: d4276a8be8c541159a4d1d575995dcc6 Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-VolumesAdminNegativeTest-1228122486 Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d4276a8be8c541159a4d1d575995dcc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d4276a8be8c541159a4d1d575995dcc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d4276a8be8c541159a4d1d575995dcc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d4276a8be8c541159a4d1d575995dcc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-VolumesAdminNegativeTest-1228122486 Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: d4276a8be8c541159a4d1d575995dcc6 Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1228122486 Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-VolumesAdminNegativeTest-1228122486-project Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 6c889d2c39af44c693a3c15b5ba4bca9 Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-VolumesAdminNegativeTest-1228122486-project Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 6cf0945c-2ca2-4803-ab89-adf554c92c51 could not be found. Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '6cf0945c-2ca2-4803-ab89-adf554c92c51'} Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cf0945c-2ca2-4803-ab89-adf554c92c51 could not be found. Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cf0945c-2ca2-4803-ab89-adf554c92c51 could not be found. Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:02.073257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:02.076785 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:02.076785 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:02.076785 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:02.076785 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:37:02.076785 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:37:02.076785 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cf0945c-2ca2-4803-ab89-adf554c92c51 could not be found. Oct 05 02:37:02.076785 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:02.076785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-71d07b80-0527-4589-814d-dfb5215c3484 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Returning 404 to user: Instance 6cf0945c-2ca2-4803-ab89-adf554c92c51 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:37:02.077410 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e1477638-d88e-4583-8a1d-5c5b3d6b40cd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1483 microversion: 2.1 time: 0.525027 Oct 05 02:37:02.077493 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-71d07b80-0527-4589-814d-dfb5215c3484 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51" status: 404 len: 111 microversion: 2.1 time: 0.036009 Oct 05 02:37:02.077493 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1161/2356] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:02 2022] GET /compute/v2.1/servers/6cf0945c-2ca2-4803-ab89-adf554c92c51 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:37:02.081781 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0330cffe-9181-444d-b81f-8f8560b6daaf tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf5a6af0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:02.082967 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1196/2357] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:01 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1483 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:02.191786 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0330cffe-9181-444d-b81f-8f8560b6daaf tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F7b30cf01-6bc7-453f-b9f2-98400bcfc063" status: 200 len: 1466 microversion: 2.1 time: 0.114620 Oct 05 02:37:02.192374 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1162/2358] 10.222.0.16 () {58 vars in 1324 bytes} [Wed Oct 5 02:37:02 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F7b30cf01-6bc7-453f-b9f2-98400bcfc063 => generated 1466 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:02.208186 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1e45902e-b4f3-44ef-8c95-eba8a27847e7 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce8263160>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:02.380701 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1e45902e-b4f3-44ef-8c95-eba8a27847e7 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7106 microversion: 2.1 time: 0.176113 Oct 05 02:37:02.381339 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1197/2359] 10.222.0.16 () {58 vars in 1170 bytes} [Wed Oct 5 02:37:02 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7106 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:02.402181 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e1d1f4a0-e3ed-4b85-9085-822975f2e0c0 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf580dc0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:02.512379 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e1d1f4a0-e3ed-4b85-9085-822975f2e0c0 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4375 microversion: 2.1 time: 0.115021 Oct 05 02:37:02.513728 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1163/2360] 10.222.0.16 () {58 vars in 1170 bytes} [Wed Oct 5 02:37:02 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4375 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:02.532018 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a20b9c26-53a0-44e8-9026-cd18b19a70b1 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce811a040>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:02.627796 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a20b9c26-53a0-44e8-9026-cd18b19a70b1 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/adad3215-1ca6-43bb-9981-0d01aff146ab" status: 200 len: 784 microversion: 2.1 time: 0.100847 Oct 05 02:37:02.628386 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1198/2361] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:37:02 2022] GET /compute/v2.1/images/adad3215-1ca6-43bb-9981-0d01aff146ab => generated 784 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:37:02.644133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-88d210c5-b126-4a44-a72b-9ce22bcfacb4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf5a6670>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:02.718382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7482b926-8c7b-434f-80e6-9eb01f66be76 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:02.719000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7482b926-8c7b-434f-80e6-9eb01f66be76 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: 5f395291-91f2-4958-bf8c-6c4d4adb0c9f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:02.724816 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-88d210c5-b126-4a44-a72b-9ce22bcfacb4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.084447 Oct 05 02:37:02.725457 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1164/2362] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 5 02:37:02 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:02.738250 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7482b926-8c7b-434f-80e6-9eb01f66be76 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:02.738747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7482b926-8c7b-434f-80e6-9eb01f66be76 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:02.739245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7482b926-8c7b-434f-80e6-9eb01f66be76 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:02.739903 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7482b926-8c7b-434f-80e6-9eb01f66be76 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:02.740358 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7482b926-8c7b-434f-80e6-9eb01f66be76 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:02.740781 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7482b926-8c7b-434f-80e6-9eb01f66be76 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:02.745898 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4ab8a24d-807c-47d3-8cff-2821bd1ad107 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf50ae50>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:03.802847 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4ab8a24d-807c-47d3-8cff-2821bd1ad107 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "DELETE /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd" status: 204 len: 0 microversion: 2.1 time: 1.060729 Oct 05 02:37:03.804311 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1165/2363] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:02 2022] DELETE /compute/v2.1/images/68465751-50cb-4879-a38a-f9ab3d73c0dd => generated 0 bytes in 1063 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:37:03.812624 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-db0690f0-eeec-4333-bda5-fa2ec5e24b39 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:03.813376 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-db0690f0-eeec-4333-bda5-fa2ec5e24b39 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] [instance: f005bb25-795a-40c0-aca9-32f8183d4b5c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:03.820693 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db0690f0-eeec-4333-bda5-fa2ec5e24b39 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:03.821889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db0690f0-eeec-4333-bda5-fa2ec5e24b39 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:03.822729 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db0690f0-eeec-4333-bda5-fa2ec5e24b39 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:03.823541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db0690f0-eeec-4333-bda5-fa2ec5e24b39 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:03.824074 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db0690f0-eeec-4333-bda5-fa2ec5e24b39 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:03.824744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db0690f0-eeec-4333-bda5-fa2ec5e24b39 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:04.216778 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7482b926-8c7b-434f-80e6-9eb01f66be76 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:04.226947 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7482b926-8c7b-434f-80e6-9eb01f66be76 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f" status: 200 len: 1471 microversion: 2.1 time: 1.512374 Oct 05 02:37:04.228398 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1199/2364] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:02 2022] GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f => generated 1471 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:04.234101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-93b7a7e6-2023-4d14-a7cb-bce02ba155a0 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:04.235192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-93b7a7e6-2023-4d14-a7cb-bce02ba155a0 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:04.238560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:04.248517 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93b7a7e6-2023-4d14-a7cb-bce02ba155a0 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:04.249161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93b7a7e6-2023-4d14-a7cb-bce02ba155a0 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:04.250788 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93b7a7e6-2023-4d14-a7cb-bce02ba155a0 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:04.251918 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93b7a7e6-2023-4d14-a7cb-bce02ba155a0 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:04.254529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93b7a7e6-2023-4d14-a7cb-bce02ba155a0 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:04.255431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93b7a7e6-2023-4d14-a7cb-bce02ba155a0 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:04.367563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-db0690f0-eeec-4333-bda5-fa2ec5e24b39 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:04.380092 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-db0690f0-eeec-4333-bda5-fa2ec5e24b39 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:04.382009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-db0690f0-eeec-4333-bda5-fa2ec5e24b39 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:04.383426 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-db0690f0-eeec-4333-bda5-fa2ec5e24b39 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] 10.222.0.16 "GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c" status: 200 len: 1358 microversion: 2.21 time: 0.577941 Oct 05 02:37:04.384596 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1166/2365] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:37:03 2022] GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c => generated 1358 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:37:04.390831 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6a93d456-6ab1-416a-8d63-2b82d7a150b8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1014011245", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c28fde34-e3c2-4465-9f10-5751dc7947b2"}], "security_groups": [{"name": "tempest-securitygroup--681420854"}], "key_name": "tempest-keypair-1831050844", "user_data": "}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:04.848099 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-6a93d456-6ab1-416a-8d63-2b82d7a150b8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] validate_networks() for [('c28fde34-e3c2-4465-9f10-5751dc7947b2', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:37:04.888524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-93b7a7e6-2023-4d14-a7cb-bce02ba155a0 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:04.903246 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-93b7a7e6-2023-4d14-a7cb-bce02ba155a0 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 200 len: 1483 microversion: 2.1 time: 0.672620 Oct 05 02:37:04.904251 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1200/2366] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:04 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 1483 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:04.911452 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4c0baa3e-d02c-4df2-b5d1-7c3c01c22cd2 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce8171e50>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:05.804208 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4c0baa3e-d02c-4df2-b5d1-7c3c01c22cd2 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "DELETE /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02" status: 204 len: 0 microversion: 2.1 time: 0.897364 Oct 05 02:37:05.804973 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1201/2367] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:04 2022] DELETE /compute/v2.1/images/4a1be384-9a47-4db9-b77d-c0aa344b0e02 => generated 0 bytes in 899 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:37:05.812488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-635edd90-a7e8-46e2-b747-17b230751ce4 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:05.814424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-635edd90-a7e8-46e2-b747-17b230751ce4 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] [instance: 5f395291-91f2-4958-bf8c-6c4d4adb0c9f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:05.827230 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-635edd90-a7e8-46e2-b747-17b230751ce4 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:05.828060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-635edd90-a7e8-46e2-b747-17b230751ce4 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:05.828766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-635edd90-a7e8-46e2-b747-17b230751ce4 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:05.829798 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-635edd90-a7e8-46e2-b747-17b230751ce4 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:05.830448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-635edd90-a7e8-46e2-b747-17b230751ce4 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:05.831204 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-635edd90-a7e8-46e2-b747-17b230751ce4 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:05.876814 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-635edd90-a7e8-46e2-b747-17b230751ce4 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Lazy-loading 'flavor' on Instance uuid 5f395291-91f2-4958-bf8c-6c4d4adb0c9f {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:37:05.955008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:05.989558 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-635edd90-a7e8-46e2-b747-17b230751ce4 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f/action" status: 202 len: 0 microversion: 2.1 time: 0.182027 Oct 05 02:37:05.990904 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1202/2368] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:37:05 2022] POST /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:37:05.998184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-119a0be7-d435-4de7-af3a-20fdcf777785 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:05.999210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-119a0be7-d435-4de7-af3a-20fdcf777785 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] [instance: f005bb25-795a-40c0-aca9-32f8183d4b5c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:06.008045 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-119a0be7-d435-4de7-af3a-20fdcf777785 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:06.009504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-119a0be7-d435-4de7-af3a-20fdcf777785 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:06.010247 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-119a0be7-d435-4de7-af3a-20fdcf777785 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:06.011158 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-119a0be7-d435-4de7-af3a-20fdcf777785 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:06.011797 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-119a0be7-d435-4de7-af3a-20fdcf777785 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:06.012378 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-119a0be7-d435-4de7-af3a-20fdcf777785 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:07.202775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-119a0be7-d435-4de7-af3a-20fdcf777785 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:07.239531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-119a0be7-d435-4de7-af3a-20fdcf777785 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:07.252035 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-119a0be7-d435-4de7-af3a-20fdcf777785 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:07.269726 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-119a0be7-d435-4de7-af3a-20fdcf777785 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] 10.222.0.16 "GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c" status: 200 len: 1358 microversion: 2.21 time: 1.277167 Oct 05 02:37:07.284066 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1203/2369] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:37:05 2022] GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c => generated 1358 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:37:07.296268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9a604cb2-c3c0-4de4-82fe-b9160df7d088 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce8263940>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:07.471930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-6a93d456-6ab1-416a-8d63-2b82d7a150b8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:37:07.473586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-6a93d456-6ab1-416a-8d63-2b82d7a150b8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:37:07.474338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-6a93d456-6ab1-416a-8d63-2b82d7a150b8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:37:07.475462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-6a93d456-6ab1-416a-8d63-2b82d7a150b8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:37:07.476307 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-6a93d456-6ab1-416a-8d63-2b82d7a150b8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:37:07.495314 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a93d456-6ab1-416a-8d63-2b82d7a150b8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:07.496270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a93d456-6ab1-416a-8d63-2b82d7a150b8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:07.497190 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a93d456-6ab1-416a-8d63-2b82d7a150b8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:07.498722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a93d456-6ab1-416a-8d63-2b82d7a150b8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:07.500088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a93d456-6ab1-416a-8d63-2b82d7a150b8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:07.501027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a93d456-6ab1-416a-8d63-2b82d7a150b8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:07.560227 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-6a93d456-6ab1-416a-8d63-2b82d7a150b8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Getting quotas for project 3b649132448b44278c6dd55cdb6ff3de. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:37:07.568848 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-6a93d456-6ab1-416a-8d63-2b82d7a150b8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Getting quotas for user e4b5243d9ffe46c4b32033da558d1e2c and project 3b649132448b44278c6dd55cdb6ff3de. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:37:07.590421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6a93d456-6ab1-416a-8d63-2b82d7a150b8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:37:07.594032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6a93d456-6ab1-416a-8d63-2b82d7a150b8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:37:07.701516 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6a93d456-6ab1-416a-8d63-2b82d7a150b8 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.313175 Oct 05 02:37:07.703104 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1167/2370] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 5 02:37:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 3318 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 05 02:37:07.719053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8a818b67-f734-4846-a672-bf8b3907b549 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:07.721151 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8a818b67-f734-4846-a672-bf8b3907b549 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: e4445875-4e03-4ee1-8905-a60ec2a9d2c8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:07.741240 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a818b67-f734-4846-a672-bf8b3907b549 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:07.741920 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a818b67-f734-4846-a672-bf8b3907b549 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:07.744469 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a818b67-f734-4846-a672-bf8b3907b549 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:07.746804 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a818b67-f734-4846-a672-bf8b3907b549 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:07.747459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a818b67-f734-4846-a672-bf8b3907b549 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:07.748705 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a818b67-f734-4846-a672-bf8b3907b549 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:07.783702 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-8a818b67-f734-4846-a672-bf8b3907b549 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] HTTP exception thrown: Instance e4445875-4e03-4ee1-8905-a60ec2a9d2c8 could not be found. Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8a818b67-f734-4846-a672-bf8b3907b549 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Request method failure captured: Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 HTTP/1.1 Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOvNe8KhpGZ8DG_1oOvLGb0DCJaF37J8SQNLdwbipKbLuSq3872FLJ_shjUOOozYCqstc1rgVms0er1jsbYXWmNBMApk_YXcsVG10Fg4W_uHLlDzKjEVUZHLAbuWJUnRLXE0v-DNCHykp-Beue_j-q1szQrJD4sNhb_g_7AcfhuUWUI Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 6652917123e14c2797cafacc4e31f75a Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-LiveMigrationTest-256153741 Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6652917123e14c2797cafacc4e31f75a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6652917123e14c2797cafacc4e31f75a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6652917123e14c2797cafacc4e31f75a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6652917123e14c2797cafacc4e31f75a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-LiveMigrationTest-256153741 Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 6652917123e14c2797cafacc4e31f75a Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-LiveMigrationTest-256153741 Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-LiveMigrationTest-256153741-project Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 118c1425677b45b98689befb0eb55cce Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-LiveMigrationTest-256153741-project Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance e4445875-4e03-4ee1-8905-a60ec2a9d2c8 could not be found. Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'e4445875-4e03-4ee1-8905-a60ec2a9d2c8'} Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4445875-4e03-4ee1-8905-a60ec2a9d2c8 could not be found. Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4445875-4e03-4ee1-8905-a60ec2a9d2c8 could not be found. Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:07.792316 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:07.797611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:07.797611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:07.797611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:07.797611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:37:07.797611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:37:07.797611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4445875-4e03-4ee1-8905-a60ec2a9d2c8 could not be found. Oct 05 02:37:07.797611 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:07.800207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8a818b67-f734-4846-a672-bf8b3907b549 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Returning 404 to user: Instance e4445875-4e03-4ee1-8905-a60ec2a9d2c8 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:37:07.802709 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8a818b67-f734-4846-a672-bf8b3907b549 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8" status: 404 len: 111 microversion: 2.1 time: 0.097649 Oct 05 02:37:07.806439 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1168/2371] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:07 2022] GET /compute/v2.1/servers/e4445875-4e03-4ee1-8905-a60ec2a9d2c8 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:37:07.824371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-af8fc585-2993-4e25-9a6f-63a4a23855ab tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:07.829422 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-af8fc585-2993-4e25-9a6f-63a4a23855ab tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] [instance: 5f395291-91f2-4958-bf8c-6c4d4adb0c9f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:07.843605 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af8fc585-2993-4e25-9a6f-63a4a23855ab tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:07.844622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af8fc585-2993-4e25-9a6f-63a4a23855ab tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:07.846637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af8fc585-2993-4e25-9a6f-63a4a23855ab tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:07.848479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af8fc585-2993-4e25-9a6f-63a4a23855ab tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:07.849402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af8fc585-2993-4e25-9a6f-63a4a23855ab tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:07.853397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af8fc585-2993-4e25-9a6f-63a4a23855ab tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:08.020474 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:08.063760 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:08.799399 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9a604cb2-c3c0-4de4-82fe-b9160df7d088 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "DELETE /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad" status: 204 len: 0 microversion: 2.1 time: 1.514051 Oct 05 02:37:08.801284 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1204/2372] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:07 2022] DELETE /compute/v2.1/images/6a6290ff-36fa-4dbb-86c4-216d543c36ad => generated 0 bytes in 1517 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:37:08.969911 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-af8fc585-2993-4e25-9a6f-63a4a23855ab tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f" status: 200 len: 1613 microversion: 2.1 time: 1.156553 Oct 05 02:37:08.974310 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1169/2373] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:07 2022] GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f => generated 1613 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:08.979812 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-20e0d5fe-d3b8-4622-8e53-58c7166b4656 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:08.980323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-20e0d5fe-d3b8-4622-8e53-58c7166b4656 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 99fb0801-33dd-4993-a8d9-18a43e372684] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:09.003914 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20e0d5fe-d3b8-4622-8e53-58c7166b4656 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:09.004164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20e0d5fe-d3b8-4622-8e53-58c7166b4656 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:09.004612 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20e0d5fe-d3b8-4622-8e53-58c7166b4656 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:09.005373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20e0d5fe-d3b8-4622-8e53-58c7166b4656 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:09.005837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20e0d5fe-d3b8-4622-8e53-58c7166b4656 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:09.006280 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20e0d5fe-d3b8-4622-8e53-58c7166b4656 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:09.038871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-20e0d5fe-d3b8-4622-8e53-58c7166b4656 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 99fb0801-33dd-4993-a8d9-18a43e372684] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:37:09.185787 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:09.191239 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-20e0d5fe-d3b8-4622-8e53-58c7166b4656 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "DELETE /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684" status: 204 len: 0 microversion: 2.1 time: 0.215662 Oct 05 02:37:09.196847 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1170/2374] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:37:08 2022] DELETE /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:37:09.205793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e7edfddb-fbb0-47cb-8b9d-d74209f9ee68 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:09.206768 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e7edfddb-fbb0-47cb-8b9d-d74209f9ee68 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:09.217474 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7edfddb-fbb0-47cb-8b9d-d74209f9ee68 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:09.218566 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7edfddb-fbb0-47cb-8b9d-d74209f9ee68 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:09.219364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7edfddb-fbb0-47cb-8b9d-d74209f9ee68 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:09.220327 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7edfddb-fbb0-47cb-8b9d-d74209f9ee68 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:09.221088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7edfddb-fbb0-47cb-8b9d-d74209f9ee68 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:09.222583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7edfddb-fbb0-47cb-8b9d-d74209f9ee68 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:09.276809 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-891b4bb9-ea35-41db-8940-6dc257d9fb57 req-6f83c77c-8db0-404d-8691-addcb0b9a6c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4445875-4e03-4ee1-8905-a60ec2a9d2c8", "name": "network-vif-deleted", "tag": "9fafe495-cce4-462d-af59-d2b8107ff726"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:09.289960 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-891b4bb9-ea35-41db-8940-6dc257d9fb57 req-6f83c77c-8db0-404d-8691-addcb0b9a6c2 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:09.291066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-891b4bb9-ea35-41db-8940-6dc257d9fb57 req-6f83c77c-8db0-404d-8691-addcb0b9a6c2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:09.291767 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-891b4bb9-ea35-41db-8940-6dc257d9fb57 req-6f83c77c-8db0-404d-8691-addcb0b9a6c2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:09.303674 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-891b4bb9-ea35-41db-8940-6dc257d9fb57 req-6f83c77c-8db0-404d-8691-addcb0b9a6c2 service nova] Creating event network-vif-deleted:9fafe495-cce4-462d-af59-d2b8107ff726 for instance e4445875-4e03-4ee1-8905-a60ec2a9d2c8 on n-h2-858272-3 Oct 05 02:37:09.310248 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-891b4bb9-ea35-41db-8940-6dc257d9fb57 req-6f83c77c-8db0-404d-8691-addcb0b9a6c2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.507629 Oct 05 02:37:09.311087 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1205/2375] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:37:09.316744 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-aee6b7da-3387-4ce6-b11c-2e78fc360544 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:09.317552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-aee6b7da-3387-4ce6-b11c-2e78fc360544 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:09.324596 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aee6b7da-3387-4ce6-b11c-2e78fc360544 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:09.325387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aee6b7da-3387-4ce6-b11c-2e78fc360544 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:09.326014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aee6b7da-3387-4ce6-b11c-2e78fc360544 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:09.326934 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aee6b7da-3387-4ce6-b11c-2e78fc360544 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:09.327578 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aee6b7da-3387-4ce6-b11c-2e78fc360544 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:09.328187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aee6b7da-3387-4ce6-b11c-2e78fc360544 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:09.355298 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-aee6b7da-3387-4ce6-b11c-2e78fc360544 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:37:09.405597 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e7edfddb-fbb0-47cb-8b9d-d74209f9ee68 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:09.422799 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e7edfddb-fbb0-47cb-8b9d-d74209f9ee68 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:09.427721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e7edfddb-fbb0-47cb-8b9d-d74209f9ee68 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:09.433995 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e7edfddb-fbb0-47cb-8b9d-d74209f9ee68 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1334 microversion: 2.20 time: 0.234847 Oct 05 02:37:09.436688 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1171/2376] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:37:09 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1334 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:37:09.451322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8d5fedf2-c176-4319-bcfe-8e62f76b4273 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:09.452346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8d5fedf2-c176-4319-bcfe-8e62f76b4273 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] [instance: f005bb25-795a-40c0-aca9-32f8183d4b5c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:09.467467 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d5fedf2-c176-4319-bcfe-8e62f76b4273 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:09.470455 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d5fedf2-c176-4319-bcfe-8e62f76b4273 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:09.472397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d5fedf2-c176-4319-bcfe-8e62f76b4273 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:09.473458 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d5fedf2-c176-4319-bcfe-8e62f76b4273 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:09.474684 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d5fedf2-c176-4319-bcfe-8e62f76b4273 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:09.475381 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d5fedf2-c176-4319-bcfe-8e62f76b4273 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:09.481459 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-aee6b7da-3387-4ce6-b11c-2e78fc360544 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "DELETE /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9" status: 204 len: 0 microversion: 2.1 time: 0.168750 Oct 05 02:37:09.486511 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1206/2377] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:37:09 2022] DELETE /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:37:09.494227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-566b7075-de58-4be8-90fe-5a7524ea78d4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:09.495783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-566b7075-de58-4be8-90fe-5a7524ea78d4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: 7b30cf01-6bc7-453f-b9f2-98400bcfc063] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:09.502920 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-566b7075-de58-4be8-90fe-5a7524ea78d4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:09.503753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-566b7075-de58-4be8-90fe-5a7524ea78d4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:09.505090 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-566b7075-de58-4be8-90fe-5a7524ea78d4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:09.506081 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-566b7075-de58-4be8-90fe-5a7524ea78d4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:09.506775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-566b7075-de58-4be8-90fe-5a7524ea78d4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:09.507610 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-566b7075-de58-4be8-90fe-5a7524ea78d4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:09.540348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-566b7075-de58-4be8-90fe-5a7524ea78d4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: 7b30cf01-6bc7-453f-b9f2-98400bcfc063] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:37:09.682815 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-566b7075-de58-4be8-90fe-5a7524ea78d4 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063" status: 204 len: 0 microversion: 2.1 time: 0.193955 Oct 05 02:37:09.688482 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1207/2378] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:37:09 2022] DELETE /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:37:09.695525 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b9c45998-daa6-42a0-ab7a-26f3810685f3 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:09.697701 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b9c45998-daa6-42a0-ab7a-26f3810685f3 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] [instance: 5f395291-91f2-4958-bf8c-6c4d4adb0c9f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:09.709950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9c45998-daa6-42a0-ab7a-26f3810685f3 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:09.710671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9c45998-daa6-42a0-ab7a-26f3810685f3 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:09.711378 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9c45998-daa6-42a0-ab7a-26f3810685f3 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:09.713139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9c45998-daa6-42a0-ab7a-26f3810685f3 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:09.713713 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9c45998-daa6-42a0-ab7a-26f3810685f3 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:09.714436 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9c45998-daa6-42a0-ab7a-26f3810685f3 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:09.724058 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8d5fedf2-c176-4319-bcfe-8e62f76b4273 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:09.733758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8d5fedf2-c176-4319-bcfe-8e62f76b4273 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:09.735687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8d5fedf2-c176-4319-bcfe-8e62f76b4273 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:09.737045 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8d5fedf2-c176-4319-bcfe-8e62f76b4273 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] 10.222.0.16 "GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c" status: 200 len: 1358 microversion: 2.21 time: 0.296255 Oct 05 02:37:09.738348 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1172/2379] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:37:09 2022] GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c => generated 1358 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:37:09.817223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d5255507-5289-4d60-9868-778b51cc9ac2 tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Action: 'create', calling method: .version_select at 0x7fccdf50d940>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCwTcv9NgbtSfIfIwddlB6ErSSqhuchv86CRMjSciKAYaFAi9Kao8/LwD+B6VNNYDno/fQxY782NhkXIvgUUydCdRiKvd8t6X4kpbkGPb+if8u9SF94cCZjqOtva4YWzw=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d5255507-5289-4d60-9868-778b51cc9ac2 tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Request method failure captured: Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 257 Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO3UY1bKVxCgSyW8jB6uRNMnWvVlNmW_RPDTJmXT2gibZ1wUkuKFyqZoQqJVLgVC1q2S-_k9q20hM_57ainjFwAgAiFucAuCpH16hK96Z_faaIBL-zAA3VutgwwCBf-oM5n8oZSVl7M3CPGH9oKBwWHjYDKwWPu0rGHKeHeJ_-bbq3c Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: e6108c7bf10845c797e086b3db7db6bb Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-616127447 Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6108c7bf10845c797e086b3db7db6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6108c7bf10845c797e086b3db7db6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e6108c7bf10845c797e086b3db7db6bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e6108c7bf10845c797e086b3db7db6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-KeyPairsNegativeTestJSON-616127447 Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: e6108c7bf10845c797e086b3db7db6bb Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-616127447 Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-KeyPairsNegativeTestJSON-616127447-project Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 461700dc15ee4007bf71f4fff983742d Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-KeyPairsNegativeTestJSON-616127447-project Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCwTcv9NgbtSfIfIwddlB6ErSSqhuchv86CRMjSciKAYaFAi9Kao8/LwD+B6VNNYDno/fQxY782NhkXIvgUUydCdRiKvd8t6X4kpbkGPb+if8u9SF94cCZjqOtva4YWzw=="}} Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCwTcv9NgbtSfIfIwddlB6ErSSqhuchv86CRMjSciKAYaFAi9Kao8/LwD+B6VNNYDno/fQxY782NhkXIvgUUydCdRiKvd8t6X4kpbkGPb+if8u9SF94cCZjqOtva4YWzw=='}}} Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 05 02:37:09.823726 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:09.827501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:09.827501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:09.827501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:09.827501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:09.827501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:09.827501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:37:09.827501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:37:09.827501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:37:09.827501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:37:09.827501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:37:09.827501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:37:09.827501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:37:09.827501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:37:09.827501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 02:37:09.827501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 02:37:09.827501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:37:09.827501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:37:09.827501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:37:09.827501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:37:09.827501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 05 02:37:09.827501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:09.827501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:09.827501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:09.827501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:09.827501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:09.827501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:09.827501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:37:09.827501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:37:09.827501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 05 02:37:09.827501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:09.832090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d5255507-5289-4d60-9868-778b51cc9ac2 tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:37:09.833179 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d5255507-5289-4d60-9868-778b51cc9ac2 tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.093584 Oct 05 02:37:09.834287 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1173/2380] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 02:37:09 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:37:09.839824 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bb987eb1-7bf6-42a8-b3e6-ed3e4e888d89 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:09.840726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bb987eb1-7bf6-42a8-b3e6-ed3e4e888d89 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 99fb0801-33dd-4993-a8d9-18a43e372684] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:09.840945 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-b9c45998-daa6-42a0-ab7a-26f3810685f3 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] HTTP exception thrown: Cannot 'migrate' instance 5f395291-91f2-4958-bf8c-6c4d4adb0c9f while it is in vm_state suspended Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b9c45998-daa6-42a0-ab7a-26f3810685f3 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Request method failure captured: Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f/action HTTP/1.1 Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 15 Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO2aMDuwSSy5VcX_4zm_uoAOsfmKlJbydPjk2ePoYxoFHiWOPANt0AbpMhaL0pNiUWGhl4KUEwQOd2JdfpG11Tkinp6gerJcfwFMQYFaGYEkNAL2yyoGNd3eO-BCo6w4CVvBwEG1ei5qwg3e05_4F9XKk6Z3buS0EWR-OZKw_wQ4fCI Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 071483f03fe14dc58fbd18ee9f167372 Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1972053832 Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: X-Role: admin,member,reader Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: admin,member,reader Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/071483f03fe14dc58fbd18ee9f167372"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/071483f03fe14dc58fbd18ee9f167372"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/071483f03fe14dc58fbd18ee9f167372"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_071483f03fe14dc58fbd18ee9f167372"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1972053832 Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 071483f03fe14dc58fbd18ee9f167372 Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1972053832 Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersAdminNegativeTestJSON-1972053832-project-admin Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 5f174aa8d19d4073a57d9c60fb11c10c Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1972053832-project-admin Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: {"migrate": {}} Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: exception: Cannot 'migrate' instance 5f395291-91f2-4958-bf8c-6c4d4adb0c9f while it is in vm_state suspended Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '5f395291-91f2-4958-bf8c-6c4d4adb0c9f', 'body': {'migrate': {}}} Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5f395291-91f2-4958-bf8c-6c4d4adb0c9f in vm_state suspended. Cannot resize while the instance is in this state. Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:37:09.842901 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 05 02:37:09.847357 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 05 02:37:09.847357 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 05 02:37:09.847357 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 02:37:09.847357 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 5f395291-91f2-4958-bf8c-6c4d4adb0c9f while it is in vm_state suspended Oct 05 02:37:09.847357 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:09.847357 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:09.847357 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:09.847357 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:09.847357 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:09.847357 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:09.847357 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:37:09.847357 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:37:09.847357 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 5f395291-91f2-4958-bf8c-6c4d4adb0c9f while it is in vm_state suspended Oct 05 02:37:09.847357 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:09.851804 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b9c45998-daa6-42a0-ab7a-26f3810685f3 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Returning 409 to user: Cannot 'migrate' instance 5f395291-91f2-4958-bf8c-6c4d4adb0c9f while it is in vm_state suspended {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:37:09.853791 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b9c45998-daa6-42a0-ab7a-26f3810685f3 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f/action" status: 409 len: 148 microversion: 2.1 time: 0.163867 Oct 05 02:37:09.861637 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1208/2381] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:37:09 2022] POST /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f/action => generated 148 bytes in 172 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:37:09.867659 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cc352ac8-a360-4f78-a2b5-a96ddb5692f1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:09.869072 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cc352ac8-a360-4f78-a2b5-a96ddb5692f1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:09.877140 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cc352ac8-a360-4f78-a2b5-a96ddb5692f1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:09.878002 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cc352ac8-a360-4f78-a2b5-a96ddb5692f1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:09.878673 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cc352ac8-a360-4f78-a2b5-a96ddb5692f1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:09.881479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cc352ac8-a360-4f78-a2b5-a96ddb5692f1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:09.882237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cc352ac8-a360-4f78-a2b5-a96ddb5692f1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:09.882876 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cc352ac8-a360-4f78-a2b5-a96ddb5692f1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:10.079559 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cc352ac8-a360-4f78-a2b5-a96ddb5692f1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:10.090633 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cc352ac8-a360-4f78-a2b5-a96ddb5692f1 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9" status: 200 len: 1501 microversion: 2.1 time: 0.226702 Oct 05 02:37:10.107332 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1209/2382] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:09 2022] GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 => generated 1501 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:10.112359 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4e0d69fc-be5e-4393-a171-bacf93eb19ba tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:10.113873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4e0d69fc-be5e-4393-a171-bacf93eb19ba tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: 7b30cf01-6bc7-453f-b9f2-98400bcfc063] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:10.119153 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bb987eb1-7bf6-42a8-b3e6-ed3e4e888d89 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:10.119852 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bb987eb1-7bf6-42a8-b3e6-ed3e4e888d89 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:10.120067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bb987eb1-7bf6-42a8-b3e6-ed3e4e888d89 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:10.122207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e0d69fc-be5e-4393-a171-bacf93eb19ba tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:10.122706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e0d69fc-be5e-4393-a171-bacf93eb19ba tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:10.123132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bb987eb1-7bf6-42a8-b3e6-ed3e4e888d89 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:10.123239 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e0d69fc-be5e-4393-a171-bacf93eb19ba tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:10.123596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bb987eb1-7bf6-42a8-b3e6-ed3e4e888d89 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:10.123832 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e0d69fc-be5e-4393-a171-bacf93eb19ba tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:10.124287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e0d69fc-be5e-4393-a171-bacf93eb19ba tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:10.124428 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bb987eb1-7bf6-42a8-b3e6-ed3e4e888d89 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:10.124721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e0d69fc-be5e-4393-a171-bacf93eb19ba tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:10.363983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4e0d69fc-be5e-4393-a171-bacf93eb19ba tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f551e15d65a34daaac2b4d4f5963c522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7719a3153f66484c8758bb0999719851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:10.374886 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4e0d69fc-be5e-4393-a171-bacf93eb19ba tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063" status: 200 len: 1473 microversion: 2.1 time: 0.266317 Oct 05 02:37:10.391573 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1210/2383] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:10 2022] GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063 => generated 1473 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:10.391573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-19e22566-2da2-45ba-b85b-2009c12032d7 tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Action: 'create', calling method: .version_select at 0x7fcce81714c0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1312677064", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:10.398819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bb987eb1-7bf6-42a8-b3e6-ed3e4e888d89 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:10.409982 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bb987eb1-7bf6-42a8-b3e6-ed3e4e888d89 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684" status: 200 len: 1684 microversion: 2.1 time: 0.574171 Oct 05 02:37:10.411305 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1174/2384] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:09 2022] GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684 => generated 1684 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:10.412222 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-19e22566-2da2-45ba-b85b-2009c12032d7 tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Getting quotas for project e6108c7bf10845c797e086b3db7db6bb. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:37:10.419369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-19e22566-2da2-45ba-b85b-2009c12032d7 tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Getting quotas for user 461700dc15ee4007bf71f4fff983742d and project e6108c7bf10845c797e086b3db7db6bb. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:37:10.428077 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-488d6b96-ea8d-46bd-9bd2-f486646ae400 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-488d6b96-ea8d-46bd-9bd2-f486646ae400 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Request method failure captured: Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da/action HTTP/1.1 Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 39 Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO2aMDuwSSy5VcX_4zm_uoAOsfmKlJbydPjk2ePoYxoFHiWOPANt0AbpMhaL0pNiUWGhl4KUEwQOd2JdfpG11Tkinp6gerJcfwFMQYFaGYEkNAL2yyoGNd3eO-BCo6w4CVvBwEG1ei5qwg3e05_4F9XKk6Z3buS0EWR-OZKw_wQ4fCI Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 071483f03fe14dc58fbd18ee9f167372 Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1972053832 Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: X-Role: admin,member,reader Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: admin,member,reader Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/071483f03fe14dc58fbd18ee9f167372"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/071483f03fe14dc58fbd18ee9f167372"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/071483f03fe14dc58fbd18ee9f167372"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_071483f03fe14dc58fbd18ee9f167372"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1972053832 Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 071483f03fe14dc58fbd18ee9f167372 Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1972053832 Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersAdminNegativeTestJSON-1972053832-project-admin Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 5f174aa8d19d4073a57d9c60fb11c10c Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1972053832-project-admin Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: {"os-resetState": {"state": "invalid"}} Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'e3d6d4a6-f11c-4b42-9023-4729addcf3da', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'invalid' Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:37:10.432954 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:37:10.437851 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 05 02:37:10.437851 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.437851 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:10.437851 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.437851 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:10.437851 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:10.437851 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:10.437851 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:37:10.437851 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:37:10.437851 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 05 02:37:10.437851 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.437851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-488d6b96-ea8d-46bd-9bd2-f486646ae400 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:37:10.437851 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-488d6b96-ea8d-46bd-9bd2-f486646ae400 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da/action" status: 400 len: 144 microversion: 2.1 time: 0.021920 Oct 05 02:37:10.448007 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1175/2385] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:37:10 2022] POST /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da/action => generated 144 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:37:10.454144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d27a22a0-7055-4fa5-9c29-0e13f37525da tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1244995646", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "64f2fb14-4b25-43f7-bf17-12437ccef9f2"}, {"uuid": "2a556499-26d8-453f-b359-f731cca7cf03"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:10.471635 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-19e22566-2da2-45ba-b85b-2009c12032d7 tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 05 02:37:10.488575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-19e22566-2da2-45ba-b85b-2009c12032d7 tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Request method failure captured: Oct 05 02:37:10.488575 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 05 02:37:10.488575 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:37:10.488575 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:37:10.488575 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:37:10.488575 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 2167 Oct 05 02:37:10.488575 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:37:10.488575 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:37:10.488575 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:37:10.488575 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:37:10.488575 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO3UY1bKVxCgSyW8jB6uRNMnWvVlNmW_RPDTJmXT2gibZ1wUkuKFyqZoQqJVLgVC1q2S-_k9q20hM_57ainjFwAgAiFucAuCpH16hK96Z_faaIBL-zAA3VutgwwCBf-oM5n8oZSVl7M3CPGH9oKBwWHjYDKwWPu0rGHKeHeJ_-bbq3c Oct 05 02:37:10.488575 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:37:10.488575 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:37:10.488575 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:37:10.488575 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:37:10.488575 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:37:10.488575 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:37:10.488575 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: e6108c7bf10845c797e086b3db7db6bb Oct 05 02:37:10.488575 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-616127447 Oct 05 02:37:10.488575 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:37:10.488575 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:37:10.488575 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6108c7bf10845c797e086b3db7db6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6108c7bf10845c797e086b3db7db6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e6108c7bf10845c797e086b3db7db6bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e6108c7bf10845c797e086b3db7db6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:37:10.488575 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-KeyPairsNegativeTestJSON-616127447 Oct 05 02:37:10.488575 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: e6108c7bf10845c797e086b3db7db6bb Oct 05 02:37:10.488575 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-616127447 Oct 05 02:37:10.488575 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-KeyPairsNegativeTestJSON-616127447-project Oct 05 02:37:10.488575 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:37:10.488575 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:37:10.488575 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 461700dc15ee4007bf71f4fff983742d Oct 05 02:37:10.488575 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-KeyPairsNegativeTestJSON-616127447-project Oct 05 02:37:10.488575 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:37:10.488575 n-d-858272-3 devstack@n-api.service[122320]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1312677064", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 05 02:37:10.488575 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:37:10.488575 n-d-858272-3 devstack@n-api.service[122320]: exception: Keypair data is invalid: failed to generate fingerprint Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1312677064', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:37:10.490641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:37:10.495075 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:37:10.495075 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:37:10.495075 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:37:10.495075 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:37:10.495075 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 05 02:37:10.495075 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 05 02:37:10.495075 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 05 02:37:10.495075 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 05 02:37:10.495075 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 05 02:37:10.495075 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.495075 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:10.495075 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.495075 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:10.495075 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:10.495075 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:10.495075 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:37:10.495075 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:37:10.495075 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 05 02:37:10.495075 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.495075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-19e22566-2da2-45ba-b85b-2009c12032d7 tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:37:10.495075 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-19e22566-2da2-45ba-b85b-2009c12032d7 tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.110765 Oct 05 02:37:10.495075 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1211/2386] 10.222.0.16 () {60 vars in 1160 bytes} [Wed Oct 5 02:37:10 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 05 02:37:10.499681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d7ac7b2f-a107-4bb5-bc54-fb0304ac4d21 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d7ac7b2f-a107-4bb5-bc54-fb0304ac4d21 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Request method failure captured: Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da/action HTTP/1.1 Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 31 Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO2aMDuwSSy5VcX_4zm_uoAOsfmKlJbydPjk2ePoYxoFHiWOPANt0AbpMhaL0pNiUWGhl4KUEwQOd2JdfpG11Tkinp6gerJcfwFMQYFaGYEkNAL2yyoGNd3eO-BCo6w4CVvBwEG1ei5qwg3e05_4F9XKk6Z3buS0EWR-OZKw_wQ4fCI Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 071483f03fe14dc58fbd18ee9f167372 Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1972053832 Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: X-Role: admin,member,reader Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: admin,member,reader Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/071483f03fe14dc58fbd18ee9f167372"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/071483f03fe14dc58fbd18ee9f167372"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/071483f03fe14dc58fbd18ee9f167372"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_071483f03fe14dc58fbd18ee9f167372"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1972053832 Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 071483f03fe14dc58fbd18ee9f167372 Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1972053832 Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersAdminNegativeTestJSON-1972053832-project-admin Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 5f174aa8d19d4073a57d9c60fb11c10c Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1972053832-project-admin Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: {"os-resetState": {"state": 1}} Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'e3d6d4a6-f11c-4b42-9023-4729addcf3da', 'body': {'os-resetState': {'state': 1}}} Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 1 Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 05 02:37:10.505477 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.512136 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:10.512136 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.512136 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:10.512136 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:10.512136 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:10.512136 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:37:10.512136 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:37:10.512136 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 05 02:37:10.512136 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.512136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d7ac7b2f-a107-4bb5-bc54-fb0304ac4d21 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:37:10.512136 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d7ac7b2f-a107-4bb5-bc54-fb0304ac4d21 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da/action" status: 400 len: 120 microversion: 2.1 time: 0.010858 Oct 05 02:37:10.512136 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1212/2387] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:37:10 2022] POST /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da/action => generated 120 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:37:10.513219 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5cf0e1fc-278c-48f3-bda6-6a2e171ee028 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:10.517172 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5cf0e1fc-278c-48f3-bda6-6a2e171ee028 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:10.528641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5cf0e1fc-278c-48f3-bda6-6a2e171ee028 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:10.529953 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5cf0e1fc-278c-48f3-bda6-6a2e171ee028 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:10.531057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5cf0e1fc-278c-48f3-bda6-6a2e171ee028 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:10.531996 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5cf0e1fc-278c-48f3-bda6-6a2e171ee028 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:10.532641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5cf0e1fc-278c-48f3-bda6-6a2e171ee028 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:10.533272 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5cf0e1fc-278c-48f3-bda6-6a2e171ee028 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:10.538536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-d27a22a0-7055-4fa5-9c29-0e13f37525da tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] validate_networks() for [('64f2fb14-4b25-43f7-bf17-12437ccef9f2', None, None, None, None, None), ('2a556499-26d8-453f-b359-f731cca7cf03', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:37:10.634999 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5cf0e1fc-278c-48f3-bda6-6a2e171ee028 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:10.644734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5cf0e1fc-278c-48f3-bda6-6a2e171ee028 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:10.646397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5cf0e1fc-278c-48f3-bda6-6a2e171ee028 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:10.647634 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5cf0e1fc-278c-48f3-bda6-6a2e171ee028 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1334 microversion: 2.20 time: 0.139312 Oct 05 02:37:10.648648 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1213/2388] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:37:10 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1334 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:37:10.653624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0741682f-4f68-4886-baeb-1c1d1c075a5b tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Action: 'create', calling method: .version_select at 0x7fcce816b5e0>, body: {"keypair": {"name": "tempest-keypair-137331484", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzdlY1FyFNwTghfWJJCjQCQ7j2nQ/095i5ta8Z2aqLJbKJapJNefvukcQU4M4N4DyurOcdHX3I3og9wJOhzbdmSY7eKkeEFEdmV2UP+OTbll3h3i5VvdiazfnTrKR1vQA=="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:10.676772 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-0741682f-4f68-4886-baeb-1c1d1c075a5b tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Getting quotas for project e6108c7bf10845c797e086b3db7db6bb. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:37:10.683586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-0741682f-4f68-4886-baeb-1c1d1c075a5b tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Getting quotas for user 461700dc15ee4007bf71f4fff983742d and project e6108c7bf10845c797e086b3db7db6bb. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:37:10.730060 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0741682f-4f68-4886-baeb-1c1d1c075a5b tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.079901 Oct 05 02:37:10.731319 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1214/2389] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 02:37:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:37:10.737024 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ba846a23-ea55-40a4-8a1f-47d67f447bf4 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:10.739637 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ba846a23-ea55-40a4-8a1f-47d67f447bf4 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Failed to fetch instance by id 999 {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 05 02:37:10.744815 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-ba846a23-ea55-40a4-8a1f-47d67f447bf4 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ba846a23-ea55-40a4-8a1f-47d67f447bf4 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Request method failure captured: Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 37 Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO2aMDuwSSy5VcX_4zm_uoAOsfmKlJbydPjk2ePoYxoFHiWOPANt0AbpMhaL0pNiUWGhl4KUEwQOd2JdfpG11Tkinp6gerJcfwFMQYFaGYEkNAL2yyoGNd3eO-BCo6w4CVvBwEG1ei5qwg3e05_4F9XKk6Z3buS0EWR-OZKw_wQ4fCI Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 071483f03fe14dc58fbd18ee9f167372 Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1972053832 Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: X-Role: admin,member,reader Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: admin,member,reader Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/071483f03fe14dc58fbd18ee9f167372"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/071483f03fe14dc58fbd18ee9f167372"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/071483f03fe14dc58fbd18ee9f167372"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_071483f03fe14dc58fbd18ee9f167372"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1972053832 Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 071483f03fe14dc58fbd18ee9f167372 Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1972053832 Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersAdminNegativeTestJSON-1972053832-project-admin Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 5f174aa8d19d4073a57d9c60fb11c10c Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1972053832-project-admin Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: {"os-resetState": {"state": "error"}} Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 999 could not be found. Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:10.753537 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:37:10.757318 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:37:10.757318 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 05 02:37:10.757318 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.757318 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ba846a23-ea55-40a4-8a1f-47d67f447bf4 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:37:10.757318 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ba846a23-ea55-40a4-8a1f-47d67f447bf4 tempest-ServersAdminNegativeTestJSON-1972053832 tempest-ServersAdminNegativeTestJSON-1972053832-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.022747 Oct 05 02:37:10.757318 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1215/2390] 10.222.0.16 () {60 vars in 1179 bytes} [Wed Oct 5 02:37:10 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:37:10.764100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b39bedca-f7c8-48d6-9bad-eaed1b8d3cab tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Action: 'create', calling method: .version_select at 0x7fccdfcaedc0>, body: {"keypair": {"name": "tempest-keypair-137331484", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgaf1QIMwUJZfw1D5uwTlSwaEvXip6NHCvMPwQ9XIxe1ws0JFIlixn6D4B1gJg0mAk0QatJQe7Ke4BX9XBpCVrnJRklaxKzAM4vZDmw1FQCmkFXQyzsLehXx+wrrSKPrA=="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:10.784817 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-b39bedca-f7c8-48d6-9bad-eaed1b8d3cab tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Getting quotas for project e6108c7bf10845c797e086b3db7db6bb. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:37:10.791233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-b39bedca-f7c8-48d6-9bad-eaed1b8d3cab tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Getting quotas for user 461700dc15ee4007bf71f4fff983742d and project e6108c7bf10845c797e086b3db7db6bb. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:37:10.816755 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-b39bedca-f7c8-48d6-9bad-eaed1b8d3cab tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] HTTP exception thrown: Key pair 'tempest-keypair-137331484' already exists. Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b39bedca-f7c8-48d6-9bad-eaed1b8d3cab tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Request method failure captured: Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 272 Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO3UY1bKVxCgSyW8jB6uRNMnWvVlNmW_RPDTJmXT2gibZ1wUkuKFyqZoQqJVLgVC1q2S-_k9q20hM_57ainjFwAgAiFucAuCpH16hK96Z_faaIBL-zAA3VutgwwCBf-oM5n8oZSVl7M3CPGH9oKBwWHjYDKwWPu0rGHKeHeJ_-bbq3c Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: e6108c7bf10845c797e086b3db7db6bb Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-616127447 Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6108c7bf10845c797e086b3db7db6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6108c7bf10845c797e086b3db7db6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e6108c7bf10845c797e086b3db7db6bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e6108c7bf10845c797e086b3db7db6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-KeyPairsNegativeTestJSON-616127447 Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: e6108c7bf10845c797e086b3db7db6bb Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-616127447 Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-KeyPairsNegativeTestJSON-616127447-project Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 461700dc15ee4007bf71f4fff983742d Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-KeyPairsNegativeTestJSON-616127447-project Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: {"keypair": {"name": "tempest-keypair-137331484", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgaf1QIMwUJZfw1D5uwTlSwaEvXip6NHCvMPwQ9XIxe1ws0JFIlixn6D4B1gJg0mAk0QatJQe7Ke4BX9XBpCVrnJRklaxKzAM4vZDmw1FQCmkFXQyzsLehXx+wrrSKPrA=="}} Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: exception: Key pair 'tempest-keypair-137331484' already exists. Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-137331484', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgaf1QIMwUJZfw1D5uwTlSwaEvXip6NHCvMPwQ9XIxe1ws0JFIlixn6D4B1gJg0mAk0QatJQe7Ke4BX9XBpCVrnJRklaxKzAM4vZDmw1FQCmkFXQyzsLehXx+wrrSKPrA=='}}} Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result.read() Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '461700dc15ee4007bf71f4fff983742d-tempest-keypair-137331484' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 05 02:37:10.829393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi session.flush() Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result.read() Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 05 02:37:10.833755 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '461700dc15ee4007bf71f4fff983742d-tempest-keypair-137331484' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 5, 2, 37, 10, 810157), 'updated_at': None, 'name': 'tempest-keypair-137331484', 'user_id': '461700dc15ee4007bf71f4fff983742d', 'fingerprint': '9e:58:3f:ce:17:19:a1:77:b9:b6:ea:c5:7e:7e:32:7d', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgaf1QIMwUJZfw1D5uwTlSwaEvXip6NHCvMPwQ9XIxe1ws0JFIlixn6D4B1gJg0mAk0QatJQe7Ke4BX9XBpCVrnJRklaxKzAM4vZDmw1FQCmkFXQyzsLehXx+wrrSKPrA==', 'type': 'ssh'}] Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi keypair.create() Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._create() Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-137331484' already exists. Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 05 02:37:10.838149 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-137331484' already exists. Oct 05 02:37:10.848884 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.848884 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:10.848884 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.848884 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:10.848884 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:10.848884 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:10.848884 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:37:10.848884 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:37:10.848884 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-137331484' already exists. Oct 05 02:37:10.848884 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:10.848884 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b39bedca-f7c8-48d6-9bad-eaed1b8d3cab tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Returning 409 to user: Key pair 'tempest-keypair-137331484' already exists. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:37:10.848884 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b39bedca-f7c8-48d6-9bad-eaed1b8d3cab tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.077583 Oct 05 02:37:10.848884 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1216/2391] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 02:37:10 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:37:10.848884 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9d31d780-b59e-446f-9bf1-caccaaa9c9a9 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:10.848884 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9d31d780-b59e-446f-9bf1-caccaaa9c9a9 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] [instance: f005bb25-795a-40c0-aca9-32f8183d4b5c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:10.857931 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d31d780-b59e-446f-9bf1-caccaaa9c9a9 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:10.858429 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d31d780-b59e-446f-9bf1-caccaaa9c9a9 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:10.858864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d31d780-b59e-446f-9bf1-caccaaa9c9a9 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:10.859562 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d31d780-b59e-446f-9bf1-caccaaa9c9a9 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:10.860015 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d31d780-b59e-446f-9bf1-caccaaa9c9a9 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:10.860442 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d31d780-b59e-446f-9bf1-caccaaa9c9a9 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:11.179597 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9d31d780-b59e-446f-9bf1-caccaaa9c9a9 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:11.189134 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9d31d780-b59e-446f-9bf1-caccaaa9c9a9 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:11.197703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9d31d780-b59e-446f-9bf1-caccaaa9c9a9 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:11.198981 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9d31d780-b59e-446f-9bf1-caccaaa9c9a9 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] 10.222.0.16 "GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c" status: 200 len: 1358 microversion: 2.21 time: 0.358877 Oct 05 02:37:11.199919 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1217/2392] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:37:10 2022] GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c => generated 1358 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:37:11.204937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b919412c-c8dd-4ea6-9b35-9d93eef3c862 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:11.205629 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b919412c-c8dd-4ea6-9b35-9d93eef3c862 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: 5f395291-91f2-4958-bf8c-6c4d4adb0c9f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:11.240780 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b919412c-c8dd-4ea6-9b35-9d93eef3c862 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:11.241794 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b919412c-c8dd-4ea6-9b35-9d93eef3c862 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:11.242252 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b919412c-c8dd-4ea6-9b35-9d93eef3c862 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:11.248105 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b919412c-c8dd-4ea6-9b35-9d93eef3c862 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:11.248105 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b919412c-c8dd-4ea6-9b35-9d93eef3c862 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:11.248105 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b919412c-c8dd-4ea6-9b35-9d93eef3c862 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:11.293458 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b919412c-c8dd-4ea6-9b35-9d93eef3c862 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: 5f395291-91f2-4958-bf8c-6c4d4adb0c9f] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:37:11.405305 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b919412c-c8dd-4ea6-9b35-9d93eef3c862 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f" status: 204 len: 0 microversion: 2.1 time: 0.203998 Oct 05 02:37:11.405910 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1218/2393] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:37:11 2022] DELETE /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:37:11.414617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-27590b96-26d7-4461-9d1d-3c86c9d4abff tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Calling method '.version_select at 0x7fcce8106b80>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:11.449759 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-27590b96-26d7-4461-9d1d-3c86c9d4abff tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-137331484" status: 202 len: 0 microversion: 2.1 time: 0.039563 Oct 05 02:37:11.458528 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1219/2394] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 5 02:37:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-137331484 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:37:11.460797 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3170611c-04e1-4546-8a3d-a53d8aea31cd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:11.461557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3170611c-04e1-4546-8a3d-a53d8aea31cd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:11.470582 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3170611c-04e1-4546-8a3d-a53d8aea31cd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:11.470753 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-d27a22a0-7055-4fa5-9c29-0e13f37525da tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:37:11.471287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3170611c-04e1-4546-8a3d-a53d8aea31cd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:11.471976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3170611c-04e1-4546-8a3d-a53d8aea31cd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:11.472752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3170611c-04e1-4546-8a3d-a53d8aea31cd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:11.473274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-d27a22a0-7055-4fa5-9c29-0e13f37525da tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:37:11.473426 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3170611c-04e1-4546-8a3d-a53d8aea31cd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:11.473917 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3170611c-04e1-4546-8a3d-a53d8aea31cd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:11.474246 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-d27a22a0-7055-4fa5-9c29-0e13f37525da tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:37:11.474827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-d27a22a0-7055-4fa5-9c29-0e13f37525da tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:37:11.475413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-d27a22a0-7055-4fa5-9c29-0e13f37525da tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:37:11.491614 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d27a22a0-7055-4fa5-9c29-0e13f37525da tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:11.492097 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d27a22a0-7055-4fa5-9c29-0e13f37525da tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:11.494313 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d27a22a0-7055-4fa5-9c29-0e13f37525da tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:11.495442 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d27a22a0-7055-4fa5-9c29-0e13f37525da tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:11.496095 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d27a22a0-7055-4fa5-9c29-0e13f37525da tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:11.496682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d27a22a0-7055-4fa5-9c29-0e13f37525da tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:11.519993 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-d27a22a0-7055-4fa5-9c29-0e13f37525da tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Getting quotas for project fc3fd0eb45ed4080af876031348f367a. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:37:11.526814 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-d27a22a0-7055-4fa5-9c29-0e13f37525da tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Getting quotas for user 9e5ffbccdbec4a4bb21a3e48c1f7beaf and project fc3fd0eb45ed4080af876031348f367a. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:37:11.540873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d27a22a0-7055-4fa5-9c29-0e13f37525da tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:37:11.543829 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d27a22a0-7055-4fa5-9c29-0e13f37525da tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 7dfe1782-6765-4efc-8576-1d138be154ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:37:11.601889 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d27a22a0-7055-4fa5-9c29-0e13f37525da tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.152673 Oct 05 02:37:11.603523 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1176/2395] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:37:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:37:11.616577 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-dae85168-875b-442f-9652-e22859428d59 req-fd60723f-c288-476b-9789-02121d93320b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f005bb25-795a-40c0-aca9-32f8183d4b5c", "tag": "fac7d8d9-388f-41cc-a1f9-55d13c863e97"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:11.629920 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-dae85168-875b-442f-9652-e22859428d59 req-fd60723f-c288-476b-9789-02121d93320b service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:11.630658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-dae85168-875b-442f-9652-e22859428d59 req-fd60723f-c288-476b-9789-02121d93320b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:11.631439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-dae85168-875b-442f-9652-e22859428d59 req-fd60723f-c288-476b-9789-02121d93320b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:11.661617 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-dae85168-875b-442f-9652-e22859428d59 req-fd60723f-c288-476b-9789-02121d93320b service nova] Creating event network-changed:fac7d8d9-388f-41cc-a1f9-55d13c863e97 for instance f005bb25-795a-40c0-aca9-32f8183d4b5c on n-h1-858272-3 Oct 05 02:37:11.668556 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-dae85168-875b-442f-9652-e22859428d59 req-fd60723f-c288-476b-9789-02121d93320b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063600 Oct 05 02:37:11.669768 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1177/2396] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:37:11.676606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2067d970-cb00-4e12-bf49-6914e91396ef tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:11.678296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2067d970-cb00-4e12-bf49-6914e91396ef tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: 7b30cf01-6bc7-453f-b9f2-98400bcfc063] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:11.689748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2067d970-cb00-4e12-bf49-6914e91396ef tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:11.690523 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2067d970-cb00-4e12-bf49-6914e91396ef tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:11.691373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2067d970-cb00-4e12-bf49-6914e91396ef tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:11.692410 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2067d970-cb00-4e12-bf49-6914e91396ef tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:11.693066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2067d970-cb00-4e12-bf49-6914e91396ef tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:11.693642 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2067d970-cb00-4e12-bf49-6914e91396ef tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:11.703884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:11.705397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3170611c-04e1-4546-8a3d-a53d8aea31cd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:11.726393 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3170611c-04e1-4546-8a3d-a53d8aea31cd tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9" status: 200 len: 1501 microversion: 2.1 time: 0.271934 Oct 05 02:37:11.740928 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1220/2397] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:11 2022] GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 => generated 1501 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:11.748346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a9e29624-bdb0-4968-87a5-568b29fbbb4d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:11.749037 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a9e29624-bdb0-4968-87a5-568b29fbbb4d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: 5f395291-91f2-4958-bf8c-6c4d4adb0c9f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:11.757852 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9e29624-bdb0-4968-87a5-568b29fbbb4d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:11.758378 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9e29624-bdb0-4968-87a5-568b29fbbb4d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:11.759095 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9e29624-bdb0-4968-87a5-568b29fbbb4d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:11.759979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9e29624-bdb0-4968-87a5-568b29fbbb4d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:11.761085 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9e29624-bdb0-4968-87a5-568b29fbbb4d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:11.761536 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9e29624-bdb0-4968-87a5-568b29fbbb4d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:12.041047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2067d970-cb00-4e12-bf49-6914e91396ef tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f551e15d65a34daaac2b4d4f5963c522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7719a3153f66484c8758bb0999719851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:12.055040 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2067d970-cb00-4e12-bf49-6914e91396ef tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063" status: 200 len: 1473 microversion: 2.1 time: 0.382833 Oct 05 02:37:12.055818 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1178/2398] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:11 2022] GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063 => generated 1473 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:12.073814 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a9f48ea6-2009-4f89-9a52-e1decfb77697 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:12.074761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a9f48ea6-2009-4f89-9a52-e1decfb77697 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 99fb0801-33dd-4993-a8d9-18a43e372684] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:12.083072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9f48ea6-2009-4f89-9a52-e1decfb77697 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:12.083874 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9f48ea6-2009-4f89-9a52-e1decfb77697 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:12.084384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9f48ea6-2009-4f89-9a52-e1decfb77697 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:12.085299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9f48ea6-2009-4f89-9a52-e1decfb77697 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:12.087543 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9f48ea6-2009-4f89-9a52-e1decfb77697 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:12.088484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9f48ea6-2009-4f89-9a52-e1decfb77697 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:12.189392 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a9e29624-bdb0-4968-87a5-568b29fbbb4d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:12.191685 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:12.200719 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a9e29624-bdb0-4968-87a5-568b29fbbb4d tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f" status: 200 len: 1468 microversion: 2.1 time: 0.465922 Oct 05 02:37:12.201796 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1221/2399] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:11 2022] GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f => generated 1468 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:12.205940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-633ae698-b3b1-49f8-a98e-87b2579146aa tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Action: 'create', calling method: .version_select at 0x7fcce825c280>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5u67NxGTS3ZTnxbBR8MR2sOVXb71/sbiPRrp/N49kH22cEllO69SvMiJQOw1xhd2FSy2ADv1/lz0g+B+BWuWkbH1FbJVNLSd0oXwNi7dXwyjaanUDBCH1gDl4e8rCWYQ=="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-633ae698-b3b1-49f8-a98e-87b2579146aa tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Request method failure captured: Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 247 Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO3UY1bKVxCgSyW8jB6uRNMnWvVlNmW_RPDTJmXT2gibZ1wUkuKFyqZoQqJVLgVC1q2S-_k9q20hM_57ainjFwAgAiFucAuCpH16hK96Z_faaIBL-zAA3VutgwwCBf-oM5n8oZSVl7M3CPGH9oKBwWHjYDKwWPu0rGHKeHeJ_-bbq3c Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: e6108c7bf10845c797e086b3db7db6bb Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-616127447 Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6108c7bf10845c797e086b3db7db6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6108c7bf10845c797e086b3db7db6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e6108c7bf10845c797e086b3db7db6bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e6108c7bf10845c797e086b3db7db6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-KeyPairsNegativeTestJSON-616127447 Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: e6108c7bf10845c797e086b3db7db6bb Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-616127447 Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-KeyPairsNegativeTestJSON-616127447-project Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 461700dc15ee4007bf71f4fff983742d Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-KeyPairsNegativeTestJSON-616127447-project Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5u67NxGTS3ZTnxbBR8MR2sOVXb71/sbiPRrp/N49kH22cEllO69SvMiJQOw1xhd2FSy2ADv1/lz0g+B+BWuWkbH1FbJVNLSd0oXwNi7dXwyjaanUDBCH1gDl4e8rCWYQ=="}} Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5u67NxGTS3ZTnxbBR8MR2sOVXb71/sbiPRrp/N49kH22cEllO69SvMiJQOw1xhd2FSy2ADv1/lz0g+B+BWuWkbH1FbJVNLSd0oXwNi7dXwyjaanUDBCH1gDl4e8rCWYQ=='}}} Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi '' Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 02:37:12.209831 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 02:37:12.218410 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:37:12.218410 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:37:12.218410 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:37:12.218410 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:37:12.218410 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 05 02:37:12.218410 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:12.218410 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:12.218410 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:12.218410 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:12.218410 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:12.218410 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:12.218410 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:37:12.218410 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:37:12.218410 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 05 02:37:12.218410 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:12.218410 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-633ae698-b3b1-49f8-a98e-87b2579146aa tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:37:12.218410 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-633ae698-b3b1-49f8-a98e-87b2579146aa tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.008904 Oct 05 02:37:12.218410 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1222/2400] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 02:37:12 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:37:12.235630 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bc75e97b-aa00-46bb-96d9-40fab9242193 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:12.236543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bc75e97b-aa00-46bb-96d9-40fab9242193 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 7dfe1782-6765-4efc-8576-1d138be154ec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:12.363221 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bc75e97b-aa00-46bb-96d9-40fab9242193 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:12.375260 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bc75e97b-aa00-46bb-96d9-40fab9242193 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec" status: 200 len: 1213 microversion: 2.1 time: 0.162378 Oct 05 02:37:12.375785 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1223/2401] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:12 2022] GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec => generated 1213 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:12.387469 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6a731722-c804-4528-b469-8d38874ad8b1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:12.388421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6a731722-c804-4528-b469-8d38874ad8b1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:12.401227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a731722-c804-4528-b469-8d38874ad8b1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:12.401871 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a731722-c804-4528-b469-8d38874ad8b1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:12.402380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a731722-c804-4528-b469-8d38874ad8b1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:12.403301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a731722-c804-4528-b469-8d38874ad8b1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:12.403999 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a731722-c804-4528-b469-8d38874ad8b1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:12.404575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a731722-c804-4528-b469-8d38874ad8b1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:12.426812 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a9f48ea6-2009-4f89-9a52-e1decfb77697 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:12.435342 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a9f48ea6-2009-4f89-9a52-e1decfb77697 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684" status: 200 len: 1684 microversion: 2.1 time: 0.377919 Oct 05 02:37:12.436548 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1179/2402] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:12 2022] GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684 => generated 1684 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:12.445186 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-297b4163-e9e0-478b-97f5-d5628ab347af tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Action: 'create', calling method: .version_select at 0x7fccdf6379d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-733094246", "public_key": " "}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:12.467602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-297b4163-e9e0-478b-97f5-d5628ab347af tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Getting quotas for project e6108c7bf10845c797e086b3db7db6bb. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:37:12.473813 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-297b4163-e9e0-478b-97f5-d5628ab347af tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Getting quotas for user 461700dc15ee4007bf71f4fff983742d and project e6108c7bf10845c797e086b3db7db6bb. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:37:12.495488 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-297b4163-e9e0-478b-97f5-d5628ab347af tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-297b4163-e9e0-478b-97f5-d5628ab347af tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Request method failure captured: Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 94 Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO3UY1bKVxCgSyW8jB6uRNMnWvVlNmW_RPDTJmXT2gibZ1wUkuKFyqZoQqJVLgVC1q2S-_k9q20hM_57ainjFwAgAiFucAuCpH16hK96Z_faaIBL-zAA3VutgwwCBf-oM5n8oZSVl7M3CPGH9oKBwWHjYDKwWPu0rGHKeHeJ_-bbq3c Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: e6108c7bf10845c797e086b3db7db6bb Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-616127447 Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6108c7bf10845c797e086b3db7db6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6108c7bf10845c797e086b3db7db6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e6108c7bf10845c797e086b3db7db6bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e6108c7bf10845c797e086b3db7db6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-KeyPairsNegativeTestJSON-616127447 Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: e6108c7bf10845c797e086b3db7db6bb Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-616127447 Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-KeyPairsNegativeTestJSON-616127447-project Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 461700dc15ee4007bf71f4fff983742d Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-KeyPairsNegativeTestJSON-616127447-project Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-733094246", "public_key": " "}} Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: exception: Keypair data is invalid: failed to generate fingerprint Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-733094246', 'public_key': ' '}}} Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:12.498588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:12.502243 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:12.502243 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:12.502243 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:12.502243 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:37:12.502243 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:37:12.502243 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:37:12.502243 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:37:12.502243 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:37:12.502243 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:37:12.502243 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:37:12.502243 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:37:12.502243 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:37:12.502243 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:37:12.502243 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 05 02:37:12.502243 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 05 02:37:12.502243 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 05 02:37:12.502243 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 05 02:37:12.502243 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 05 02:37:12.502243 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:12.502243 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:12.502243 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:12.502243 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:12.502243 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:12.502243 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:12.502243 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:37:12.502243 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:37:12.502243 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 05 02:37:12.502243 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:12.502243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-297b4163-e9e0-478b-97f5-d5628ab347af tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:37:12.503778 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-297b4163-e9e0-478b-97f5-d5628ab347af tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.065781 Oct 05 02:37:12.510642 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1180/2403] 10.222.0.16 () {60 vars in 1158 bytes} [Wed Oct 5 02:37:12 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 05 02:37:12.526632 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d07c0d0f-92ab-406d-9f66-2698f7c57311 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:12.527655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d07c0d0f-92ab-406d-9f66-2698f7c57311 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] [instance: f005bb25-795a-40c0-aca9-32f8183d4b5c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:12.535261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d07c0d0f-92ab-406d-9f66-2698f7c57311 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:12.535764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d07c0d0f-92ab-406d-9f66-2698f7c57311 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:12.536216 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d07c0d0f-92ab-406d-9f66-2698f7c57311 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:12.537022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d07c0d0f-92ab-406d-9f66-2698f7c57311 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:12.537490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d07c0d0f-92ab-406d-9f66-2698f7c57311 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:12.537922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d07c0d0f-92ab-406d-9f66-2698f7c57311 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:12.574025 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6a731722-c804-4528-b469-8d38874ad8b1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:12.583875 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6a731722-c804-4528-b469-8d38874ad8b1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:12.585628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6a731722-c804-4528-b469-8d38874ad8b1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:12.587006 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6a731722-c804-4528-b469-8d38874ad8b1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1334 microversion: 2.20 time: 0.209982 Oct 05 02:37:12.588940 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1224/2404] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:37:12 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1334 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:37:12.623547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b13bb96a-e236-4c63-a4ea-e23bb2a5cee3 tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Action: 'create', calling method: .version_select at 0x7fcce816bee0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwdiXsO5HmFegfao0A44H+LLy+gFj+hbiGZgnPC+yjSAirnXq957XL/DdQFnIJDFd7RxHgXE+OJVj0IR01t/devnPwJzggvTdWNL5fGtHlPpj2rQ7tWoqlUYuRuz1vGgQ=="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b13bb96a-e236-4c63-a4ea-e23bb2a5cee3 tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Request method failure captured: Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 507 Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO3UY1bKVxCgSyW8jB6uRNMnWvVlNmW_RPDTJmXT2gibZ1wUkuKFyqZoQqJVLgVC1q2S-_k9q20hM_57ainjFwAgAiFucAuCpH16hK96Z_faaIBL-zAA3VutgwwCBf-oM5n8oZSVl7M3CPGH9oKBwWHjYDKwWPu0rGHKeHeJ_-bbq3c Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: e6108c7bf10845c797e086b3db7db6bb Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-616127447 Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6108c7bf10845c797e086b3db7db6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6108c7bf10845c797e086b3db7db6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e6108c7bf10845c797e086b3db7db6bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e6108c7bf10845c797e086b3db7db6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-KeyPairsNegativeTestJSON-616127447 Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: e6108c7bf10845c797e086b3db7db6bb Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-616127447 Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-KeyPairsNegativeTestJSON-616127447-project Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 461700dc15ee4007bf71f4fff983742d Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-KeyPairsNegativeTestJSON-616127447-project Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwdiXsO5HmFegfao0A44H+LLy+gFj+hbiGZgnPC+yjSAirnXq957XL/DdQFnIJDFd7RxHgXE+OJVj0IR01t/devnPwJzggvTdWNL5fGtHlPpj2rQ7tWoqlUYuRuz1vGgQ=="}} Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwdiXsO5HmFegfao0A44H+LLy+gFj+hbiGZgnPC+yjSAirnXq957XL/DdQFnIJDFd7RxHgXE+OJVj0IR01t/devnPwJzggvTdWNL5fGtHlPpj2rQ7tWoqlUYuRuz1vGgQ=='}}} Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 05 02:37:12.632353 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 05 02:37:12.635809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:12.635809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:12.635809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:12.635809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:12.635809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:12.635809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:12.635809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:37:12.635809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:37:12.635809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:37:12.635809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:37:12.635809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:37:12.635809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:37:12.635809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:37:12.635809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:37:12.635809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 02:37:12.635809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 02:37:12.635809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:37:12.635809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:37:12.635809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:37:12.635809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:37:12.635809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 05 02:37:12.635809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:12.635809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:12.635809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:12.635809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:12.635809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:12.635809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:12.635809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:37:12.635809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:37:12.635809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 05 02:37:12.635809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:12.641307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b13bb96a-e236-4c63-a4ea-e23bb2a5cee3 tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:37:12.642570 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b13bb96a-e236-4c63-a4ea-e23bb2a5cee3 tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.052193 Oct 05 02:37:12.647708 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1225/2405] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 02:37:12 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:37:12.654371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-24883456-3e03-4730-970f-eaa50d4fce7f tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Action: 'create', calling method: .version_select at 0x7fcce825c310>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1575356012", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:12.682131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-24883456-3e03-4730-970f-eaa50d4fce7f tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Getting quotas for project e6108c7bf10845c797e086b3db7db6bb. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:37:12.688598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-24883456-3e03-4730-970f-eaa50d4fce7f tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Getting quotas for user 461700dc15ee4007bf71f4fff983742d and project e6108c7bf10845c797e086b3db7db6bb. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:37:12.710892 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-24883456-3e03-4730-970f-eaa50d4fce7f tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-24883456-3e03-4730-970f-eaa50d4fce7f tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Request method failure captured: Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 118 Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO3UY1bKVxCgSyW8jB6uRNMnWvVlNmW_RPDTJmXT2gibZ1wUkuKFyqZoQqJVLgVC1q2S-_k9q20hM_57ainjFwAgAiFucAuCpH16hK96Z_faaIBL-zAA3VutgwwCBf-oM5n8oZSVl7M3CPGH9oKBwWHjYDKwWPu0rGHKeHeJ_-bbq3c Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: e6108c7bf10845c797e086b3db7db6bb Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-616127447 Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6108c7bf10845c797e086b3db7db6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6108c7bf10845c797e086b3db7db6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e6108c7bf10845c797e086b3db7db6bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e6108c7bf10845c797e086b3db7db6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-KeyPairsNegativeTestJSON-616127447 Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: e6108c7bf10845c797e086b3db7db6bb Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-616127447 Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-KeyPairsNegativeTestJSON-616127447-project Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 461700dc15ee4007bf71f4fff983742d Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-KeyPairsNegativeTestJSON-616127447-project Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1575356012", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: exception: Keypair data is invalid: failed to generate fingerprint Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1575356012', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 05 02:37:12.713869 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 05 02:37:12.717327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 05 02:37:12.717327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 05 02:37:12.717327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 05 02:37:12.717327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:12.717327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:12.717327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:12.717327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:12.717327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:12.717327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:12.717327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:37:12.717327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:37:12.717327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:37:12.717327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:37:12.717327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:37:12.717327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:37:12.717327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:37:12.717327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:37:12.717327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:37:12.717327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:37:12.717327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 05 02:37:12.717327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 05 02:37:12.717327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 05 02:37:12.717327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 05 02:37:12.717327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 05 02:37:12.717327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:12.717327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:12.717327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:12.717327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:12.717327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:12.717327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:12.717327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:37:12.717327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:37:12.717327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 05 02:37:12.717327 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:12.721246 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-24883456-3e03-4730-970f-eaa50d4fce7f tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:37:12.722259 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-24883456-3e03-4730-970f-eaa50d4fce7f tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.072903 Oct 05 02:37:12.723340 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1226/2406] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 02:37:12 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 75 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 05 02:37:12.739889 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f9bc9cfb-ba36-4441-a963-8b6d63bd9401 tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Calling method '.version_select at 0x7fcce8137550>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:12.752209 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:12.757191 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-f9bc9cfb-ba36-4441-a963-8b6d63bd9401 tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1725003192 not found for user 461700dc15ee4007bf71f4fff983742d Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f9bc9cfb-ba36-4441-a963-8b6d63bd9401 tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Request method failure captured: Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1725003192 HTTP/1.1 Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO3UY1bKVxCgSyW8jB6uRNMnWvVlNmW_RPDTJmXT2gibZ1wUkuKFyqZoQqJVLgVC1q2S-_k9q20hM_57ainjFwAgAiFucAuCpH16hK96Z_faaIBL-zAA3VutgwwCBf-oM5n8oZSVl7M3CPGH9oKBwWHjYDKwWPu0rGHKeHeJ_-bbq3c Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: e6108c7bf10845c797e086b3db7db6bb Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-616127447 Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6108c7bf10845c797e086b3db7db6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6108c7bf10845c797e086b3db7db6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e6108c7bf10845c797e086b3db7db6bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e6108c7bf10845c797e086b3db7db6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-KeyPairsNegativeTestJSON-616127447 Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: e6108c7bf10845c797e086b3db7db6bb Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-616127447 Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-KeyPairsNegativeTestJSON-616127447-project Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 461700dc15ee4007bf71f4fff983742d Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-KeyPairsNegativeTestJSON-616127447-project Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: exception: Keypair tempest-keypair-non-existent-1725003192 not found for user 461700dc15ee4007bf71f4fff983742d Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'tempest-keypair-non-existent-1725003192'} Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1725003192 not found for user 461700dc15ee4007bf71f4fff983742d Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:12.760999 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:12.765240 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:12.765240 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:12.765240 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:12.765240 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:12.765240 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:37:12.765240 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:37:12.765240 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:37:12.765240 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:37:12.765240 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 02:37:12.765240 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:37:12.765240 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:37:12.765240 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:37:12.765240 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 05 02:37:12.765240 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 05 02:37:12.765240 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 05 02:37:12.765240 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 05 02:37:12.765240 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1725003192 not found for user 461700dc15ee4007bf71f4fff983742d Oct 05 02:37:12.765240 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:12.765240 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:12.765240 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:12.765240 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:12.765240 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:12.765240 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:12.765240 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:37:12.765240 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:37:12.765240 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1725003192 not found for user 461700dc15ee4007bf71f4fff983742d Oct 05 02:37:12.765240 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:12.768533 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f9bc9cfb-ba36-4441-a963-8b6d63bd9401 tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1725003192 not found for user 461700dc15ee4007bf71f4fff983742d {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:37:12.768997 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f9bc9cfb-ba36-4441-a963-8b6d63bd9401 tempest-KeyPairsNegativeTestJSON-616127447 tempest-KeyPairsNegativeTestJSON-616127447-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1725003192" status: 404 len: 145 microversion: 2.1 time: 0.040766 Oct 05 02:37:12.770305 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1227/2407] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 5 02:37:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1725003192 => generated 145 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:37:12.776627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8d41781c-6ea5-4483-89ec-3263dd2fbb77 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:12.777385 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8d41781c-6ea5-4483-89ec-3263dd2fbb77 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:12.786244 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d41781c-6ea5-4483-89ec-3263dd2fbb77 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:12.786891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d41781c-6ea5-4483-89ec-3263dd2fbb77 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:12.787428 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d41781c-6ea5-4483-89ec-3263dd2fbb77 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:12.788232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d41781c-6ea5-4483-89ec-3263dd2fbb77 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:12.788936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d41781c-6ea5-4483-89ec-3263dd2fbb77 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:12.789572 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d41781c-6ea5-4483-89ec-3263dd2fbb77 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:13.045264 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d07c0d0f-92ab-406d-9f66-2698f7c57311 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:13.055262 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d07c0d0f-92ab-406d-9f66-2698f7c57311 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:13.057682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d07c0d0f-92ab-406d-9f66-2698f7c57311 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:13.059137 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d07c0d0f-92ab-406d-9f66-2698f7c57311 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] 10.222.0.16 "GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c" status: 200 len: 1358 microversion: 2.21 time: 0.538901 Oct 05 02:37:13.059882 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1181/2408] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:37:12 2022] GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c => generated 1358 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:37:13.081647 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8d41781c-6ea5-4483-89ec-3263dd2fbb77 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:13.090509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-047984bc-04ac-4239-a52b-874bfc66e5a9 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:13.091607 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-047984bc-04ac-4239-a52b-874bfc66e5a9 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: 7b30cf01-6bc7-453f-b9f2-98400bcfc063] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:13.093501 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8d41781c-6ea5-4483-89ec-3263dd2fbb77 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9" status: 200 len: 1501 microversion: 2.1 time: 0.321701 Oct 05 02:37:13.112338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-047984bc-04ac-4239-a52b-874bfc66e5a9 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:13.112338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-047984bc-04ac-4239-a52b-874bfc66e5a9 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:13.112338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-047984bc-04ac-4239-a52b-874bfc66e5a9 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:13.112338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-047984bc-04ac-4239-a52b-874bfc66e5a9 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:13.112338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-047984bc-04ac-4239-a52b-874bfc66e5a9 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:13.112338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-047984bc-04ac-4239-a52b-874bfc66e5a9 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:13.113843 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1228/2409] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:12 2022] GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 => generated 1501 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:13.224974 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2202a3f6-1762-4961-959a-09aa15b26e30 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:13.226634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2202a3f6-1762-4961-959a-09aa15b26e30 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: 5f395291-91f2-4958-bf8c-6c4d4adb0c9f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:13.234491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2202a3f6-1762-4961-959a-09aa15b26e30 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:13.235323 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2202a3f6-1762-4961-959a-09aa15b26e30 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:13.235982 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2202a3f6-1762-4961-959a-09aa15b26e30 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:13.236930 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2202a3f6-1762-4961-959a-09aa15b26e30 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:13.237632 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2202a3f6-1762-4961-959a-09aa15b26e30 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:13.238267 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2202a3f6-1762-4961-959a-09aa15b26e30 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:13.278458 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-047984bc-04ac-4239-a52b-874bfc66e5a9 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f551e15d65a34daaac2b4d4f5963c522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7719a3153f66484c8758bb0999719851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:13.290786 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-047984bc-04ac-4239-a52b-874bfc66e5a9 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063" status: 200 len: 1473 microversion: 2.1 time: 0.209792 Oct 05 02:37:13.292085 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1182/2410] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:13 2022] GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063 => generated 1473 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:13.378336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2202a3f6-1762-4961-959a-09aa15b26e30 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:13.390571 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2202a3f6-1762-4961-959a-09aa15b26e30 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f" status: 200 len: 1468 microversion: 2.1 time: 0.168907 Oct 05 02:37:13.391473 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1229/2411] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:13 2022] GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f => generated 1468 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:13.406066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-591df576-5aac-4a20-a372-df3a364b322a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:13.406975 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-591df576-5aac-4a20-a372-df3a364b322a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 7dfe1782-6765-4efc-8576-1d138be154ec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:13.416091 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-591df576-5aac-4a20-a372-df3a364b322a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:13.416770 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-591df576-5aac-4a20-a372-df3a364b322a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:13.417828 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-591df576-5aac-4a20-a372-df3a364b322a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:13.418836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-591df576-5aac-4a20-a372-df3a364b322a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:13.420114 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-591df576-5aac-4a20-a372-df3a364b322a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:13.421078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-591df576-5aac-4a20-a372-df3a364b322a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:13.463654 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-892de508-e2aa-43ac-b4c3-60794507a17f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:13.465180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-892de508-e2aa-43ac-b4c3-60794507a17f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 99fb0801-33dd-4993-a8d9-18a43e372684] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:13.488100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-892de508-e2aa-43ac-b4c3-60794507a17f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:13.489165 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-892de508-e2aa-43ac-b4c3-60794507a17f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:13.489722 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-892de508-e2aa-43ac-b4c3-60794507a17f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:13.490567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-892de508-e2aa-43ac-b4c3-60794507a17f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:13.491438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-892de508-e2aa-43ac-b4c3-60794507a17f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:13.492108 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-892de508-e2aa-43ac-b4c3-60794507a17f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:13.542175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-591df576-5aac-4a20-a372-df3a364b322a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:13.554689 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-591df576-5aac-4a20-a372-df3a364b322a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec" status: 200 len: 1265 microversion: 2.1 time: 0.157463 Oct 05 02:37:13.572515 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1183/2412] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:13 2022] GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:13.619484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ab0f9883-8c60-49f0-96e1-578b55360b25 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:13.620923 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ab0f9883-8c60-49f0-96e1-578b55360b25 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:13.635475 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab0f9883-8c60-49f0-96e1-578b55360b25 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:13.637432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab0f9883-8c60-49f0-96e1-578b55360b25 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:13.640575 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab0f9883-8c60-49f0-96e1-578b55360b25 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:13.641599 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab0f9883-8c60-49f0-96e1-578b55360b25 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:13.642287 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab0f9883-8c60-49f0-96e1-578b55360b25 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:13.643782 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab0f9883-8c60-49f0-96e1-578b55360b25 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:14.085132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ab0f9883-8c60-49f0-96e1-578b55360b25 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:14.100055 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ab0f9883-8c60-49f0-96e1-578b55360b25 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:14.101587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ab0f9883-8c60-49f0-96e1-578b55360b25 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:14.103735 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ab0f9883-8c60-49f0-96e1-578b55360b25 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1334 microversion: 2.20 time: 0.493287 Oct 05 02:37:14.113542 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1184/2413] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:37:13 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1334 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:37:14.135952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1fff8300-f0ee-4f56-a2cd-3ac1b199f3aa tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:14.138236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1fff8300-f0ee-4f56-a2cd-3ac1b199f3aa tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] [instance: f005bb25-795a-40c0-aca9-32f8183d4b5c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:14.144847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1fff8300-f0ee-4f56-a2cd-3ac1b199f3aa tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:14.145496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1fff8300-f0ee-4f56-a2cd-3ac1b199f3aa tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:14.146091 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1fff8300-f0ee-4f56-a2cd-3ac1b199f3aa tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:14.146783 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1fff8300-f0ee-4f56-a2cd-3ac1b199f3aa tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:14.147306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1fff8300-f0ee-4f56-a2cd-3ac1b199f3aa tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:14.147737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1fff8300-f0ee-4f56-a2cd-3ac1b199f3aa tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:14.271792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-892de508-e2aa-43ac-b4c3-60794507a17f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:14.282743 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-892de508-e2aa-43ac-b4c3-60794507a17f tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684" status: 200 len: 1684 microversion: 2.1 time: 0.824300 Oct 05 02:37:14.283872 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1230/2414] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:13 2022] GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684 => generated 1684 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:14.288641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-75de131b-cfc8-4d0f-8a5e-5b6c0bb65121 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:14.289406 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-75de131b-cfc8-4d0f-8a5e-5b6c0bb65121 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:14.296175 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75de131b-cfc8-4d0f-8a5e-5b6c0bb65121 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:14.296799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75de131b-cfc8-4d0f-8a5e-5b6c0bb65121 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:14.297381 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75de131b-cfc8-4d0f-8a5e-5b6c0bb65121 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:14.311235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75de131b-cfc8-4d0f-8a5e-5b6c0bb65121 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:14.312783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75de131b-cfc8-4d0f-8a5e-5b6c0bb65121 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:14.320576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75de131b-cfc8-4d0f-8a5e-5b6c0bb65121 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:14.489386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1fff8300-f0ee-4f56-a2cd-3ac1b199f3aa tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:14.498649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1fff8300-f0ee-4f56-a2cd-3ac1b199f3aa tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:14.500085 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1fff8300-f0ee-4f56-a2cd-3ac1b199f3aa tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:14.501239 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1fff8300-f0ee-4f56-a2cd-3ac1b199f3aa tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] 10.222.0.16 "GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c" status: 200 len: 1358 microversion: 2.21 time: 0.386453 Oct 05 02:37:14.511857 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1185/2415] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:37:14 2022] GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c => generated 1358 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:37:14.517239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-921ae5a1-2b51-48e1-b528-2002b548e8de tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:14.518050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-921ae5a1-2b51-48e1-b528-2002b548e8de tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: 7b30cf01-6bc7-453f-b9f2-98400bcfc063] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:14.531850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-921ae5a1-2b51-48e1-b528-2002b548e8de tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:14.532335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-921ae5a1-2b51-48e1-b528-2002b548e8de tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:14.532855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-921ae5a1-2b51-48e1-b528-2002b548e8de tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:14.533540 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-921ae5a1-2b51-48e1-b528-2002b548e8de tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:14.533953 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-921ae5a1-2b51-48e1-b528-2002b548e8de tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:14.539116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-921ae5a1-2b51-48e1-b528-2002b548e8de tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:15.055276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-75de131b-cfc8-4d0f-8a5e-5b6c0bb65121 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:15.064837 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-75de131b-cfc8-4d0f-8a5e-5b6c0bb65121 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9" status: 200 len: 1501 microversion: 2.1 time: 0.779853 Oct 05 02:37:15.068953 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1231/2416] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:14 2022] GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 => generated 1501 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:15.086281 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2b4ac9e7-db07-4491-b19d-5bd5cdeb7fc1 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:15.087013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2b4ac9e7-db07-4491-b19d-5bd5cdeb7fc1 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: 5f395291-91f2-4958-bf8c-6c4d4adb0c9f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:15.094364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b4ac9e7-db07-4491-b19d-5bd5cdeb7fc1 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:15.095103 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b4ac9e7-db07-4491-b19d-5bd5cdeb7fc1 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:15.095714 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b4ac9e7-db07-4491-b19d-5bd5cdeb7fc1 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:15.096597 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b4ac9e7-db07-4491-b19d-5bd5cdeb7fc1 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:15.097337 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b4ac9e7-db07-4491-b19d-5bd5cdeb7fc1 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:15.097998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b4ac9e7-db07-4491-b19d-5bd5cdeb7fc1 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:15.200275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-921ae5a1-2b51-48e1-b528-2002b548e8de tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f551e15d65a34daaac2b4d4f5963c522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7719a3153f66484c8758bb0999719851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:15.209269 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-921ae5a1-2b51-48e1-b528-2002b548e8de tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063" status: 200 len: 1473 microversion: 2.1 time: 0.696084 Oct 05 02:37:15.210880 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1186/2417] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:14 2022] GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063 => generated 1473 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:15.227967 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-df470c84-997e-4cdb-851d-3dcf427f83f7 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:15.229034 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-df470c84-997e-4cdb-851d-3dcf427f83f7 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 7dfe1782-6765-4efc-8576-1d138be154ec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:15.239822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-df470c84-997e-4cdb-851d-3dcf427f83f7 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:15.240519 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-df470c84-997e-4cdb-851d-3dcf427f83f7 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:15.241260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-df470c84-997e-4cdb-851d-3dcf427f83f7 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:15.242137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-df470c84-997e-4cdb-851d-3dcf427f83f7 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:15.242777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-df470c84-997e-4cdb-851d-3dcf427f83f7 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:15.244118 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-df470c84-997e-4cdb-851d-3dcf427f83f7 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:15.451768 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-df470c84-997e-4cdb-851d-3dcf427f83f7 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:15.481309 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-df470c84-997e-4cdb-851d-3dcf427f83f7 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec" status: 200 len: 1271 microversion: 2.1 time: 0.255430 Oct 05 02:37:15.482475 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1187/2418] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:15 2022] GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec => generated 1271 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:15.491168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-b48fe74f-d5db-4f6e-bbce-cfe0b723da72 req-8f677223-3953-4813-9ab3-24b348903420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f005bb25-795a-40c0-aca9-32f8183d4b5c", "name": "network-vif-plugged", "status": "completed", "tag": "fac7d8d9-388f-41cc-a1f9-55d13c863e97"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:15.505350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b48fe74f-d5db-4f6e-bbce-cfe0b723da72 req-8f677223-3953-4813-9ab3-24b348903420 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:15.505883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b48fe74f-d5db-4f6e-bbce-cfe0b723da72 req-8f677223-3953-4813-9ab3-24b348903420 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:15.506320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b48fe74f-d5db-4f6e-bbce-cfe0b723da72 req-8f677223-3953-4813-9ab3-24b348903420 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:15.523878 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-b48fe74f-d5db-4f6e-bbce-cfe0b723da72 req-8f677223-3953-4813-9ab3-24b348903420 service nova] Creating event network-vif-plugged:fac7d8d9-388f-41cc-a1f9-55d13c863e97 for instance f005bb25-795a-40c0-aca9-32f8183d4b5c on n-h1-858272-3 Oct 05 02:37:15.532473 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-b48fe74f-d5db-4f6e-bbce-cfe0b723da72 req-8f677223-3953-4813-9ab3-24b348903420 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045240 Oct 05 02:37:15.539444 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1188/2419] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:37:15.550554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-089612fe-5ece-40b6-b4b4-3ffa4efcdfcf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:15.551883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-089612fe-5ece-40b6-b4b4-3ffa4efcdfcf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:15.577636 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-089612fe-5ece-40b6-b4b4-3ffa4efcdfcf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:15.578267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-089612fe-5ece-40b6-b4b4-3ffa4efcdfcf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:15.578703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-089612fe-5ece-40b6-b4b4-3ffa4efcdfcf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:15.579680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-089612fe-5ece-40b6-b4b4-3ffa4efcdfcf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:15.581377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-089612fe-5ece-40b6-b4b4-3ffa4efcdfcf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:15.582547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-089612fe-5ece-40b6-b4b4-3ffa4efcdfcf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:15.723718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-089612fe-5ece-40b6-b4b4-3ffa4efcdfcf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:15.751164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-089612fe-5ece-40b6-b4b4-3ffa4efcdfcf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:15.754773 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-089612fe-5ece-40b6-b4b4-3ffa4efcdfcf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:15.756985 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-089612fe-5ece-40b6-b4b4-3ffa4efcdfcf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1340 microversion: 2.20 time: 0.214986 Oct 05 02:37:15.759256 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1189/2420] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:37:15 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1340 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:37:15.769280 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a00a5cb4-0d31-4946-b976-1bc9193f4957 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:15.770265 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a00a5cb4-0d31-4946-b976-1bc9193f4957 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 99fb0801-33dd-4993-a8d9-18a43e372684] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:15.788660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a00a5cb4-0d31-4946-b976-1bc9193f4957 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:15.789200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a00a5cb4-0d31-4946-b976-1bc9193f4957 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:15.789642 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a00a5cb4-0d31-4946-b976-1bc9193f4957 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:15.790463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a00a5cb4-0d31-4946-b976-1bc9193f4957 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:15.792359 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a00a5cb4-0d31-4946-b976-1bc9193f4957 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:15.796363 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a00a5cb4-0d31-4946-b976-1bc9193f4957 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:16.091062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2b4ac9e7-db07-4491-b19d-5bd5cdeb7fc1 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:16.118581 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2b4ac9e7-db07-4491-b19d-5bd5cdeb7fc1 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f" status: 200 len: 1468 microversion: 2.1 time: 1.047281 Oct 05 02:37:16.122120 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1232/2421] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:15 2022] GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f => generated 1468 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:16.137449 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-16aa3814-c79b-4056-8864-f4239f64f357 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:16.139949 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-16aa3814-c79b-4056-8864-f4239f64f357 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] [instance: f005bb25-795a-40c0-aca9-32f8183d4b5c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:16.160681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16aa3814-c79b-4056-8864-f4239f64f357 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:16.161512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16aa3814-c79b-4056-8864-f4239f64f357 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:16.162114 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16aa3814-c79b-4056-8864-f4239f64f357 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:16.173625 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16aa3814-c79b-4056-8864-f4239f64f357 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:16.174502 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16aa3814-c79b-4056-8864-f4239f64f357 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:16.188563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16aa3814-c79b-4056-8864-f4239f64f357 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:17.213423 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a00a5cb4-0d31-4946-b976-1bc9193f4957 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:17.227918 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a00a5cb4-0d31-4946-b976-1bc9193f4957 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684" status: 200 len: 1684 microversion: 2.1 time: 1.466466 Oct 05 02:37:17.230335 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1190/2422] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:15 2022] GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684 => generated 1684 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:17.291598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-16aa3814-c79b-4056-8864-f4239f64f357 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:17.300943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-16aa3814-c79b-4056-8864-f4239f64f357 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:17.302627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-16aa3814-c79b-4056-8864-f4239f64f357 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:17.304084 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-16aa3814-c79b-4056-8864-f4239f64f357 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] 10.222.0.16 "GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c" status: 200 len: 1358 microversion: 2.21 time: 1.180419 Oct 05 02:37:17.305220 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1233/2423] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:37:16 2022] GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c => generated 1358 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:37:17.310808 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a47f2468-de9a-447d-8fba-a201d0a72c02 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:17.311606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a47f2468-de9a-447d-8fba-a201d0a72c02 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:17.317896 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a47f2468-de9a-447d-8fba-a201d0a72c02 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:17.318605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a47f2468-de9a-447d-8fba-a201d0a72c02 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:17.319187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a47f2468-de9a-447d-8fba-a201d0a72c02 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:17.320047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a47f2468-de9a-447d-8fba-a201d0a72c02 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:17.320639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a47f2468-de9a-447d-8fba-a201d0a72c02 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:17.321361 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a47f2468-de9a-447d-8fba-a201d0a72c02 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:17.394305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a47f2468-de9a-447d-8fba-a201d0a72c02 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:17.397074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a47f2468-de9a-447d-8fba-a201d0a72c02 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:17.397788 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a47f2468-de9a-447d-8fba-a201d0a72c02 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:17.400615 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-a47f2468-de9a-447d-8fba-a201d0a72c02 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lazy-loading 'fault' on Instance uuid 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:37:17.510779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-29538a65-76df-4a7d-b1be-9e00a9899760 req-cf778413-d489-42c9-afcd-eb02754f931d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b30cf01-6bc7-453f-b9f2-98400bcfc063", "name": "network-vif-deleted", "tag": "8d0c6b53-f679-4ee4-afb3-4a4e905d5489"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:17.520977 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-29538a65-76df-4a7d-b1be-9e00a9899760 req-cf778413-d489-42c9-afcd-eb02754f931d service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:17.521718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-29538a65-76df-4a7d-b1be-9e00a9899760 req-cf778413-d489-42c9-afcd-eb02754f931d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:17.522155 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-29538a65-76df-4a7d-b1be-9e00a9899760 req-cf778413-d489-42c9-afcd-eb02754f931d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:17.536147 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-29538a65-76df-4a7d-b1be-9e00a9899760 req-cf778413-d489-42c9-afcd-eb02754f931d service nova] Creating event network-vif-deleted:8d0c6b53-f679-4ee4-afb3-4a4e905d5489 for instance 7b30cf01-6bc7-453f-b9f2-98400bcfc063 on n-h2-858272-3 Oct 05 02:37:17.544362 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-29538a65-76df-4a7d-b1be-9e00a9899760 req-cf778413-d489-42c9-afcd-eb02754f931d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.311051 Oct 05 02:37:17.546025 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1191/2424] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:37:17.549271 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a47f2468-de9a-447d-8fba-a201d0a72c02 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '118c1425677b45b98689befb0eb55cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6652917123e14c2797cafacc4e31f75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:17.552041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c10f6a90-c827-4d61-857c-b6e7d2a77462 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:17.553228 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c10f6a90-c827-4d61-857c-b6e7d2a77462 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: 7b30cf01-6bc7-453f-b9f2-98400bcfc063] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:17.558502 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a47f2468-de9a-447d-8fba-a201d0a72c02 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9" status: 200 len: 1301 microversion: 2.1 time: 0.251382 Oct 05 02:37:17.559085 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1234/2425] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:17 2022] GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 => generated 1301 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:17.568548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-999852ee-e179-4eb3-b24a-04218644118d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:17.570451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c10f6a90-c827-4d61-857c-b6e7d2a77462 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:17.571748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c10f6a90-c827-4d61-857c-b6e7d2a77462 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:17.571890 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-999852ee-e179-4eb3-b24a-04218644118d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 7dfe1782-6765-4efc-8576-1d138be154ec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:17.573155 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c10f6a90-c827-4d61-857c-b6e7d2a77462 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:17.574114 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c10f6a90-c827-4d61-857c-b6e7d2a77462 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:17.574782 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c10f6a90-c827-4d61-857c-b6e7d2a77462 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:17.575414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c10f6a90-c827-4d61-857c-b6e7d2a77462 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:17.577947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-999852ee-e179-4eb3-b24a-04218644118d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:17.578436 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-999852ee-e179-4eb3-b24a-04218644118d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:17.578873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-999852ee-e179-4eb3-b24a-04218644118d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:17.579568 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-999852ee-e179-4eb3-b24a-04218644118d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:17.580019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-999852ee-e179-4eb3-b24a-04218644118d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:17.580434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-999852ee-e179-4eb3-b24a-04218644118d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:17.596407 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-c10f6a90-c827-4d61-857c-b6e7d2a77462 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] HTTP exception thrown: Instance 7b30cf01-6bc7-453f-b9f2-98400bcfc063 could not be found. Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c10f6a90-c827-4d61-857c-b6e7d2a77462 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Request method failure captured: Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063 HTTP/1.1 Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO0uxHpm3HuSR31q2m6mktaf80nDlKoEiOZqfEHpyvjaHurMpZCiYsg8b6I45IAm3732x3E7X_xUn2ISZbn_TRs8Vzt-VIoQWb1ZqIoncEEMnMG8Tz9AM_-DbdAaQ4Vi_0Nqn1BjMJw1UGYGYi8TL4bFmyHQ_Sa_Rvk4LAnFi5IxcaA Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 7719a3153f66484c8758bb0999719851 Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ListImageFiltersTestJSON-1755017753 Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7719a3153f66484c8758bb0999719851"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7719a3153f66484c8758bb0999719851"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7719a3153f66484c8758bb0999719851"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7719a3153f66484c8758bb0999719851"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ListImageFiltersTestJSON-1755017753 Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 7719a3153f66484c8758bb0999719851 Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1755017753 Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ListImageFiltersTestJSON-1755017753-project Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: f551e15d65a34daaac2b4d4f5963c522 Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ListImageFiltersTestJSON-1755017753-project Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 7b30cf01-6bc7-453f-b9f2-98400bcfc063 could not be found. Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '7b30cf01-6bc7-453f-b9f2-98400bcfc063'} Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b30cf01-6bc7-453f-b9f2-98400bcfc063 could not be found. Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b30cf01-6bc7-453f-b9f2-98400bcfc063 could not be found. Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:17.613573 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:17.618875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:17.618875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:17.618875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:17.618875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:37:17.618875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:37:17.618875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b30cf01-6bc7-453f-b9f2-98400bcfc063 could not be found. Oct 05 02:37:17.618875 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:17.623102 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c10f6a90-c827-4d61-857c-b6e7d2a77462 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Returning 404 to user: Instance 7b30cf01-6bc7-453f-b9f2-98400bcfc063 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:37:17.624345 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c10f6a90-c827-4d61-857c-b6e7d2a77462 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063" status: 404 len: 111 microversion: 2.1 time: 0.076859 Oct 05 02:37:17.625419 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1192/2426] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:17 2022] GET /compute/v2.1/servers/7b30cf01-6bc7-453f-b9f2-98400bcfc063 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:37:17.630660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-892608e6-f720-4717-af79-4abb2864024d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:17.635221 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-892608e6-f720-4717-af79-4abb2864024d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:17.645064 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-892608e6-f720-4717-af79-4abb2864024d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:17.645790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-892608e6-f720-4717-af79-4abb2864024d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:17.646396 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-892608e6-f720-4717-af79-4abb2864024d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:17.647274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-892608e6-f720-4717-af79-4abb2864024d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:17.647900 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-892608e6-f720-4717-af79-4abb2864024d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:17.648478 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-892608e6-f720-4717-af79-4abb2864024d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:18.081395 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-999852ee-e179-4eb3-b24a-04218644118d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:18.091018 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-999852ee-e179-4eb3-b24a-04218644118d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec" status: 200 len: 1313 microversion: 2.1 time: 0.530866 Oct 05 02:37:18.092774 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1235/2427] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:17 2022] GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec => generated 1313 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:18.098292 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-9c5e1e85-1978-4e9f-b727-bb1bb29c56cf req-572ee93d-bfb1-443e-9293-209c92b85cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94c1a311-92cb-4a6f-9d45-32af2f3ae6e9", "name": "network-vif-deleted", "tag": "235b3397-5893-46bc-98c1-77706502791c"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:18.111826 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-9c5e1e85-1978-4e9f-b727-bb1bb29c56cf req-572ee93d-bfb1-443e-9293-209c92b85cc3 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:18.112837 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-9c5e1e85-1978-4e9f-b727-bb1bb29c56cf req-572ee93d-bfb1-443e-9293-209c92b85cc3 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:18.113421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-9c5e1e85-1978-4e9f-b727-bb1bb29c56cf req-572ee93d-bfb1-443e-9293-209c92b85cc3 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:18.127257 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-9c5e1e85-1978-4e9f-b727-bb1bb29c56cf req-572ee93d-bfb1-443e-9293-209c92b85cc3 service nova] Creating event network-vif-deleted:235b3397-5893-46bc-98c1-77706502791c for instance 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 on n-h2-858272-3 Oct 05 02:37:18.133138 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-9c5e1e85-1978-4e9f-b727-bb1bb29c56cf req-572ee93d-bfb1-443e-9293-209c92b85cc3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038746 Oct 05 02:37:18.135247 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1236/2428] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:37:18.142199 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-98005951-c9a6-4b73-aed2-56ef1a9280c9 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:18.143450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-98005951-c9a6-4b73-aed2-56ef1a9280c9 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: 5f395291-91f2-4958-bf8c-6c4d4adb0c9f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:18.152036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98005951-c9a6-4b73-aed2-56ef1a9280c9 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:18.152734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98005951-c9a6-4b73-aed2-56ef1a9280c9 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:18.153540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98005951-c9a6-4b73-aed2-56ef1a9280c9 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:18.154598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98005951-c9a6-4b73-aed2-56ef1a9280c9 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:18.155369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98005951-c9a6-4b73-aed2-56ef1a9280c9 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:18.156068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98005951-c9a6-4b73-aed2-56ef1a9280c9 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:18.171864 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-98005951-c9a6-4b73-aed2-56ef1a9280c9 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] HTTP exception thrown: Instance 5f395291-91f2-4958-bf8c-6c4d4adb0c9f could not be found. Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-98005951-c9a6-4b73-aed2-56ef1a9280c9 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Request method failure captured: Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f HTTP/1.1 Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO2ZG08VKA_Ymv5W7Om1xf3u4DaERAIUHTRsMxlj9G4CoXdzBR0yaGHhzRpjwpGXxuArbryL-gP5jsHlbrNJo8gggo4K3jN4fiCBwmHfnmQ0cl6lhUD8fQcgya1qqh9nohiFZ6oPMqp9Ith6IcZzk9AasW83mvg51g9iLFx5yJ2H_vQ Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: eccc732cf08749648be251ca96d18cd1 Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2079491689 Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eccc732cf08749648be251ca96d18cd1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eccc732cf08749648be251ca96d18cd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eccc732cf08749648be251ca96d18cd1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eccc732cf08749648be251ca96d18cd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2079491689 Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: eccc732cf08749648be251ca96d18cd1 Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2079491689 Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersAdminNegativeTestJSON-2079491689-project Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 83a280fd56304b47acca3f0b4061e18a Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2079491689-project Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 5f395291-91f2-4958-bf8c-6c4d4adb0c9f could not be found. Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '5f395291-91f2-4958-bf8c-6c4d4adb0c9f'} Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f395291-91f2-4958-bf8c-6c4d4adb0c9f could not be found. Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f395291-91f2-4958-bf8c-6c4d4adb0c9f could not be found. Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:18.174095 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:18.178299 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:18.178299 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:18.178299 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:18.178299 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:18.178299 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:37:18.178299 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:37:18.178299 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f395291-91f2-4958-bf8c-6c4d4adb0c9f could not be found. Oct 05 02:37:18.178299 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:18.179915 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-98005951-c9a6-4b73-aed2-56ef1a9280c9 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Returning 404 to user: Instance 5f395291-91f2-4958-bf8c-6c4d4adb0c9f could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:37:18.182053 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-98005951-c9a6-4b73-aed2-56ef1a9280c9 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f" status: 404 len: 111 microversion: 2.1 time: 0.045114 Oct 05 02:37:18.183138 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1237/2429] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:18 2022] GET /compute/v2.1/servers/5f395291-91f2-4958-bf8c-6c4d4adb0c9f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:37:18.188214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-e7395f66-1ed2-447a-a608-3c2fcea4322f req-60f7cd3d-6b4d-48af-b296-9865f9b88aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99fb0801-33dd-4993-a8d9-18a43e372684", "name": "network-vif-unplugged", "status": "completed", "tag": "9347f3a9-118c-40ac-9d21-f7cd82266478"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:18.200101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e7395f66-1ed2-447a-a608-3c2fcea4322f req-60f7cd3d-6b4d-48af-b296-9865f9b88aa6 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:18.200844 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e7395f66-1ed2-447a-a608-3c2fcea4322f req-60f7cd3d-6b4d-48af-b296-9865f9b88aa6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:18.201508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e7395f66-1ed2-447a-a608-3c2fcea4322f req-60f7cd3d-6b4d-48af-b296-9865f9b88aa6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:18.210263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-892608e6-f720-4717-af79-4abb2864024d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:18.217617 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-e7395f66-1ed2-447a-a608-3c2fcea4322f req-60f7cd3d-6b4d-48af-b296-9865f9b88aa6 service nova] Creating event network-vif-unplugged:9347f3a9-118c-40ac-9d21-f7cd82266478 for instance 99fb0801-33dd-4993-a8d9-18a43e372684 on n-h2-858272-3 Oct 05 02:37:18.223947 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-e7395f66-1ed2-447a-a608-3c2fcea4322f req-60f7cd3d-6b4d-48af-b296-9865f9b88aa6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039220 Oct 05 02:37:18.224146 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-892608e6-f720-4717-af79-4abb2864024d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:18.225126 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1238/2430] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:37:18.228139 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-892608e6-f720-4717-af79-4abb2864024d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:18.231038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-377d00f2-5764-41c1-9f55-a10aaf20d9be tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:18.231637 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-377d00f2-5764-41c1-9f55-a10aaf20d9be tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: e123bb72-45c5-4371-bf2e-f0747497f16b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:18.233633 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-892608e6-f720-4717-af79-4abb2864024d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1407 microversion: 2.20 time: 0.605917 Oct 05 02:37:18.236119 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1193/2431] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:37:17 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1407 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:37:18.239490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-377d00f2-5764-41c1-9f55-a10aaf20d9be tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:18.240061 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-377d00f2-5764-41c1-9f55-a10aaf20d9be tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:18.240534 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-377d00f2-5764-41c1-9f55-a10aaf20d9be tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:18.241257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-377d00f2-5764-41c1-9f55-a10aaf20d9be tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:18.241908 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-377d00f2-5764-41c1-9f55-a10aaf20d9be tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:18.242512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-377d00f2-5764-41c1-9f55-a10aaf20d9be tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:18.246444 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a2b831d8-9cfe-4ca7-a1dc-c81b01a03b8c tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:18.246953 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a2b831d8-9cfe-4ca7-a1dc-c81b01a03b8c tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: e3d6d4a6-f11c-4b42-9023-4729addcf3da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:18.253702 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a2b831d8-9cfe-4ca7-a1dc-c81b01a03b8c tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:18.254195 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a2b831d8-9cfe-4ca7-a1dc-c81b01a03b8c tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:18.254821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a2b831d8-9cfe-4ca7-a1dc-c81b01a03b8c tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:18.255778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a2b831d8-9cfe-4ca7-a1dc-c81b01a03b8c tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:18.256863 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a2b831d8-9cfe-4ca7-a1dc-c81b01a03b8c tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:18.257553 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a2b831d8-9cfe-4ca7-a1dc-c81b01a03b8c tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:18.286775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-377d00f2-5764-41c1-9f55-a10aaf20d9be tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: e123bb72-45c5-4371-bf2e-f0747497f16b] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:37:18.288741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a2b831d8-9cfe-4ca7-a1dc-c81b01a03b8c tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: e3d6d4a6-f11c-4b42-9023-4729addcf3da] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:37:18.399937 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a2b831d8-9cfe-4ca7-a1dc-c81b01a03b8c tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da" status: 204 len: 0 microversion: 2.1 time: 0.160396 Oct 05 02:37:18.403604 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1194/2432] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:37:18 2022] DELETE /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:37:18.417913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bac7192c-9080-469e-9c08-6f9bbf0b8466 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:18.420100 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bac7192c-9080-469e-9c08-6f9bbf0b8466 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 99fb0801-33dd-4993-a8d9-18a43e372684] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:18.428257 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bac7192c-9080-469e-9c08-6f9bbf0b8466 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:18.429229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bac7192c-9080-469e-9c08-6f9bbf0b8466 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:18.434113 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-377d00f2-5764-41c1-9f55-a10aaf20d9be tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e123bb72-45c5-4371-bf2e-f0747497f16b" status: 204 len: 0 microversion: 2.1 time: 0.207332 Oct 05 02:37:18.435180 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1239/2433] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:37:18 2022] DELETE /compute/v2.1/servers/e123bb72-45c5-4371-bf2e-f0747497f16b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:37:18.441458 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bac7192c-9080-469e-9c08-6f9bbf0b8466 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:18.444135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bac7192c-9080-469e-9c08-6f9bbf0b8466 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:18.445838 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bac7192c-9080-469e-9c08-6f9bbf0b8466 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:18.447377 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-72788185-c73e-4f97-bc3e-f46c1910f267 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:18.448374 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bac7192c-9080-469e-9c08-6f9bbf0b8466 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:18.450493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-72788185-c73e-4f97-bc3e-f46c1910f267 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] [instance: f005bb25-795a-40c0-aca9-32f8183d4b5c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:18.468725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72788185-c73e-4f97-bc3e-f46c1910f267 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:18.483165 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72788185-c73e-4f97-bc3e-f46c1910f267 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:18.483623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72788185-c73e-4f97-bc3e-f46c1910f267 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:18.484375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72788185-c73e-4f97-bc3e-f46c1910f267 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:18.488162 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72788185-c73e-4f97-bc3e-f46c1910f267 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:18.488662 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72788185-c73e-4f97-bc3e-f46c1910f267 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:18.725152 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bac7192c-9080-469e-9c08-6f9bbf0b8466 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c889d2c39af44c693a3c15b5ba4bca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4276a8be8c541159a4d1d575995dcc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:18.742559 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bac7192c-9080-469e-9c08-6f9bbf0b8466 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684" status: 200 len: 1616 microversion: 2.1 time: 0.336428 Oct 05 02:37:18.744041 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1195/2434] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:18 2022] GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684 => generated 1616 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:18.753005 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a7b507e1-27e2-4f19-9fcc-e1af60c41501 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:18.754236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a7b507e1-27e2-4f19-9fcc-e1af60c41501 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: e3d6d4a6-f11c-4b42-9023-4729addcf3da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:18.763358 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a7b507e1-27e2-4f19-9fcc-e1af60c41501 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:18.764096 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a7b507e1-27e2-4f19-9fcc-e1af60c41501 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:18.767000 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a7b507e1-27e2-4f19-9fcc-e1af60c41501 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:18.768035 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a7b507e1-27e2-4f19-9fcc-e1af60c41501 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:18.769361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a7b507e1-27e2-4f19-9fcc-e1af60c41501 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:18.769998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a7b507e1-27e2-4f19-9fcc-e1af60c41501 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:18.774058 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:18.836417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-72788185-c73e-4f97-bc3e-f46c1910f267 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:18.851146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-72788185-c73e-4f97-bc3e-f46c1910f267 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:18.856007 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-72788185-c73e-4f97-bc3e-f46c1910f267 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:18.858211 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-72788185-c73e-4f97-bc3e-f46c1910f267 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] 10.222.0.16 "GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c" status: 200 len: 1358 microversion: 2.21 time: 0.421147 Oct 05 02:37:18.881057 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1240/2435] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:37:18 2022] GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c => generated 1358 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:37:18.895118 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7c8418e3-2fa8-4e1f-977e-79ed64de55d9 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:18.895769 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7c8418e3-2fa8-4e1f-977e-79ed64de55d9 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: e123bb72-45c5-4371-bf2e-f0747497f16b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:18.906790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c8418e3-2fa8-4e1f-977e-79ed64de55d9 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:18.907601 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c8418e3-2fa8-4e1f-977e-79ed64de55d9 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:18.908203 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c8418e3-2fa8-4e1f-977e-79ed64de55d9 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:18.909125 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c8418e3-2fa8-4e1f-977e-79ed64de55d9 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:18.909906 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c8418e3-2fa8-4e1f-977e-79ed64de55d9 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:18.910569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c8418e3-2fa8-4e1f-977e-79ed64de55d9 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:19.234077 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a7b507e1-27e2-4f19-9fcc-e1af60c41501 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:19.239172 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7c8418e3-2fa8-4e1f-977e-79ed64de55d9 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f551e15d65a34daaac2b4d4f5963c522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7719a3153f66484c8758bb0999719851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:19.245859 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a7b507e1-27e2-4f19-9fcc-e1af60c41501 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da" status: 200 len: 1476 microversion: 2.1 time: 0.499012 Oct 05 02:37:19.246899 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1196/2436] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:18 2022] GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da => generated 1476 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:19.252408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c3764c50-8b35-48f3-b7f1-8beced036d73 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:19.254308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c3764c50-8b35-48f3-b7f1-8beced036d73 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] [instance: 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:19.261661 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7c8418e3-2fa8-4e1f-977e-79ed64de55d9 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/servers/e123bb72-45c5-4371-bf2e-f0747497f16b" status: 200 len: 1473 microversion: 2.1 time: 0.378278 Oct 05 02:37:19.268200 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1241/2437] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:18 2022] GET /compute/v2.1/servers/e123bb72-45c5-4371-bf2e-f0747497f16b => generated 1473 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:19.276273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3764c50-8b35-48f3-b7f1-8beced036d73 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:19.276815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3764c50-8b35-48f3-b7f1-8beced036d73 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:19.278418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3764c50-8b35-48f3-b7f1-8beced036d73 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:19.280202 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3764c50-8b35-48f3-b7f1-8beced036d73 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:19.281466 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3764c50-8b35-48f3-b7f1-8beced036d73 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:19.282423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9cf1cf87-c12a-4a11-99cc-48e8c900cc7f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:19.283078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3764c50-8b35-48f3-b7f1-8beced036d73 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:19.285160 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9cf1cf87-c12a-4a11-99cc-48e8c900cc7f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 7dfe1782-6765-4efc-8576-1d138be154ec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:19.308704 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9cf1cf87-c12a-4a11-99cc-48e8c900cc7f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:19.309526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9cf1cf87-c12a-4a11-99cc-48e8c900cc7f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:19.310155 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9cf1cf87-c12a-4a11-99cc-48e8c900cc7f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:19.311034 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9cf1cf87-c12a-4a11-99cc-48e8c900cc7f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:19.311658 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9cf1cf87-c12a-4a11-99cc-48e8c900cc7f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:19.312239 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9cf1cf87-c12a-4a11-99cc-48e8c900cc7f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:19.318199 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-c3764c50-8b35-48f3-b7f1-8beced036d73 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] HTTP exception thrown: Instance 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 could not be found. Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c3764c50-8b35-48f3-b7f1-8beced036d73 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Request method failure captured: Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 HTTP/1.1 Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOvNe8KhpGZ8DG_1oOvLGb0DCJaF37J8SQNLdwbipKbLuSq3872FLJ_shjUOOozYCqstc1rgVms0er1jsbYXWmNBMApk_YXcsVG10Fg4W_uHLlDzKjEVUZHLAbuWJUnRLXE0v-DNCHykp-Beue_j-q1szQrJD4sNhb_g_7AcfhuUWUI Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 6652917123e14c2797cafacc4e31f75a Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-LiveMigrationTest-256153741 Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6652917123e14c2797cafacc4e31f75a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6652917123e14c2797cafacc4e31f75a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6652917123e14c2797cafacc4e31f75a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6652917123e14c2797cafacc4e31f75a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-LiveMigrationTest-256153741 Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 6652917123e14c2797cafacc4e31f75a Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-LiveMigrationTest-256153741 Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-LiveMigrationTest-256153741-project Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 118c1425677b45b98689befb0eb55cce Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-LiveMigrationTest-256153741-project Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 could not be found. Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '94c1a311-92cb-4a6f-9d45-32af2f3ae6e9'} Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 could not be found. Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 could not be found. Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:19.320241 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:19.326308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:19.326308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:19.326308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:19.326308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:37:19.326308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:37:19.326308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 could not be found. Oct 05 02:37:19.326308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:19.333575 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c3764c50-8b35-48f3-b7f1-8beced036d73 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] Returning 404 to user: Instance 94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:37:19.335143 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c3764c50-8b35-48f3-b7f1-8beced036d73 tempest-LiveMigrationTest-256153741 tempest-LiveMigrationTest-256153741-project] 10.222.0.16 "GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9" status: 404 len: 111 microversion: 2.1 time: 0.087066 Oct 05 02:37:19.339849 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1197/2438] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:19 2022] GET /compute/v2.1/servers/94c1a311-92cb-4a6f-9d45-32af2f3ae6e9 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:37:19.351886 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-aad8199f-b53a-434b-9a7b-44731b4d4c9a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:19.353258 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-aad8199f-b53a-434b-9a7b-44731b4d4c9a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:19.365800 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aad8199f-b53a-434b-9a7b-44731b4d4c9a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:19.366312 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aad8199f-b53a-434b-9a7b-44731b4d4c9a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:19.366761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aad8199f-b53a-434b-9a7b-44731b4d4c9a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:19.367485 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aad8199f-b53a-434b-9a7b-44731b4d4c9a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:19.368843 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aad8199f-b53a-434b-9a7b-44731b4d4c9a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:19.369710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aad8199f-b53a-434b-9a7b-44731b4d4c9a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:19.887316 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-aad8199f-b53a-434b-9a7b-44731b4d4c9a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:19.894648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9cf1cf87-c12a-4a11-99cc-48e8c900cc7f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:19.898823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-aad8199f-b53a-434b-9a7b-44731b4d4c9a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:19.900945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-aad8199f-b53a-434b-9a7b-44731b4d4c9a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:19.902569 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-aad8199f-b53a-434b-9a7b-44731b4d4c9a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1407 microversion: 2.20 time: 0.561802 Oct 05 02:37:19.904805 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9cf1cf87-c12a-4a11-99cc-48e8c900cc7f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec" status: 200 len: 1334 microversion: 2.1 time: 0.634096 Oct 05 02:37:19.906045 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1242/2439] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:19 2022] GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec => generated 1334 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:19.912415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-f8e8e418-aa43-4762-9ec0-9f2589289ada req-f284b422-6f0c-42ad-9c79-47a8dd218a85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f395291-91f2-4958-bf8c-6c4d4adb0c9f", "name": "network-vif-deleted", "tag": "4b8f9b1f-1e56-4a62-afee-5b22dad3b1bc"}, {"name": "network-changed", "server_uuid": "1c15b977-1608-45e8-8bbd-b2bd5c1eff21", "tag": "af2bec78-4945-43ac-81ca-883ba5ae8ef2"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:19.920390 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1198/2440] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:37:19 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1407 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:37:19.929040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-256117eb-35ca-48ce-9f36-35c1db51980c tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:19.929943 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-256117eb-35ca-48ce-9f36-35c1db51980c tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] [instance: 99fb0801-33dd-4993-a8d9-18a43e372684] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:19.932997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f8e8e418-aa43-4762-9ec0-9f2589289ada req-f284b422-6f0c-42ad-9c79-47a8dd218a85 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:19.933761 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f8e8e418-aa43-4762-9ec0-9f2589289ada req-f284b422-6f0c-42ad-9c79-47a8dd218a85 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:19.934383 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f8e8e418-aa43-4762-9ec0-9f2589289ada req-f284b422-6f0c-42ad-9c79-47a8dd218a85 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:19.940949 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-256117eb-35ca-48ce-9f36-35c1db51980c tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:19.943252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-256117eb-35ca-48ce-9f36-35c1db51980c tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:19.944266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-256117eb-35ca-48ce-9f36-35c1db51980c tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:19.945485 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-256117eb-35ca-48ce-9f36-35c1db51980c tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:19.947434 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-256117eb-35ca-48ce-9f36-35c1db51980c tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:19.948185 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-256117eb-35ca-48ce-9f36-35c1db51980c tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:19.958297 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-f8e8e418-aa43-4762-9ec0-9f2589289ada req-f284b422-6f0c-42ad-9c79-47a8dd218a85 service nova] Creating event network-vif-deleted:4b8f9b1f-1e56-4a62-afee-5b22dad3b1bc for instance 5f395291-91f2-4958-bf8c-6c4d4adb0c9f on n-h2-858272-3 Oct 05 02:37:19.959039 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-f8e8e418-aa43-4762-9ec0-9f2589289ada req-f284b422-6f0c-42ad-9c79-47a8dd218a85 service nova] Creating event network-changed:af2bec78-4945-43ac-81ca-883ba5ae8ef2 for instance 1c15b977-1608-45e8-8bbd-b2bd5c1eff21 on n-h2-858272-3 Oct 05 02:37:19.971278 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-f8e8e418-aa43-4762-9ec0-9f2589289ada req-f284b422-6f0c-42ad-9c79-47a8dd218a85 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.063786 Oct 05 02:37:19.972211 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1243/2441] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:37:19.976493 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-256117eb-35ca-48ce-9f36-35c1db51980c tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] HTTP exception thrown: Instance 99fb0801-33dd-4993-a8d9-18a43e372684 could not be found. Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-256117eb-35ca-48ce-9f36-35c1db51980c tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Request method failure captured: Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684 HTTP/1.1 Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOzmYSUQoTQEHnEFBEthXV58tyuv156c8BrOZCJgkQ7okWPLQbiUqVOHb1lcD8kj6OAV_Z9W_lk4PXFmj71_m0rAhkC1h80lRQYG3-e1RNtAjUuKHEz9QbUL8PlXSrTfQ6-ZVWO4kISO7Wx8nvToRR3gPT4Ks4LbXRnhldh-hHefTvA Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: d4276a8be8c541159a4d1d575995dcc6 Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-VolumesAdminNegativeTest-1228122486 Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d4276a8be8c541159a4d1d575995dcc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d4276a8be8c541159a4d1d575995dcc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d4276a8be8c541159a4d1d575995dcc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d4276a8be8c541159a4d1d575995dcc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-VolumesAdminNegativeTest-1228122486 Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: d4276a8be8c541159a4d1d575995dcc6 Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1228122486 Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-VolumesAdminNegativeTest-1228122486-project Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 6c889d2c39af44c693a3c15b5ba4bca9 Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-VolumesAdminNegativeTest-1228122486-project Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 99fb0801-33dd-4993-a8d9-18a43e372684 could not be found. Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '99fb0801-33dd-4993-a8d9-18a43e372684'} Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99fb0801-33dd-4993-a8d9-18a43e372684 could not be found. Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99fb0801-33dd-4993-a8d9-18a43e372684 could not be found. Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:19.978344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:19.983285 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:19.983285 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:19.983285 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:19.983285 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:37:19.983285 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:37:19.983285 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99fb0801-33dd-4993-a8d9-18a43e372684 could not be found. Oct 05 02:37:19.983285 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:19.987648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a943563f-e757-476e-8b72-fcdda8f43005 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:19.988600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-256117eb-35ca-48ce-9f36-35c1db51980c tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Returning 404 to user: Instance 99fb0801-33dd-4993-a8d9-18a43e372684 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:37:19.989552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a943563f-e757-476e-8b72-fcdda8f43005 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] [instance: f005bb25-795a-40c0-aca9-32f8183d4b5c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:19.992440 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-256117eb-35ca-48ce-9f36-35c1db51980c tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684" status: 404 len: 111 microversion: 2.1 time: 0.070745 Oct 05 02:37:19.995672 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1199/2442] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:19 2022] GET /compute/v2.1/servers/99fb0801-33dd-4993-a8d9-18a43e372684 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:37:20.002939 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a943563f-e757-476e-8b72-fcdda8f43005 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:20.004490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8ef49920-f75e-404b-abd3-4d37d911dd68 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] Calling method '.version_select at 0x7fccdf5a6820>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:20.005222 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a943563f-e757-476e-8b72-fcdda8f43005 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:20.006051 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a943563f-e757-476e-8b72-fcdda8f43005 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:20.007183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a943563f-e757-476e-8b72-fcdda8f43005 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:20.009588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a943563f-e757-476e-8b72-fcdda8f43005 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:20.010281 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a943563f-e757-476e-8b72-fcdda8f43005 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:20.036661 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:20.058206 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8ef49920-f75e-404b-abd3-4d37d911dd68 tempest-VolumesAdminNegativeTest-1228122486 tempest-VolumesAdminNegativeTest-1228122486-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1010722893" status: 202 len: 0 microversion: 2.1 time: 0.059633 Oct 05 02:37:20.058738 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1200/2443] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 5 02:37:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1010722893 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:37:20.168314 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-17d94093-3c1b-4a0e-9275-ee1298af5d68 req-8b279a89-bc12-43f4-a945-078d1e9990bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99fb0801-33dd-4993-a8d9-18a43e372684", "name": "network-vif-deleted", "tag": "9347f3a9-118c-40ac-9d21-f7cd82266478"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:20.190867 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-17d94093-3c1b-4a0e-9275-ee1298af5d68 req-8b279a89-bc12-43f4-a945-078d1e9990bd service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:20.191425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-17d94093-3c1b-4a0e-9275-ee1298af5d68 req-8b279a89-bc12-43f4-a945-078d1e9990bd service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:20.191889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-17d94093-3c1b-4a0e-9275-ee1298af5d68 req-8b279a89-bc12-43f4-a945-078d1e9990bd service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:20.216492 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-17d94093-3c1b-4a0e-9275-ee1298af5d68 req-8b279a89-bc12-43f4-a945-078d1e9990bd service nova] Creating event network-vif-deleted:9347f3a9-118c-40ac-9d21-f7cd82266478 for instance 99fb0801-33dd-4993-a8d9-18a43e372684 on n-h2-858272-3 Oct 05 02:37:20.226626 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-17d94093-3c1b-4a0e-9275-ee1298af5d68 req-8b279a89-bc12-43f4-a945-078d1e9990bd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065537 Oct 05 02:37:20.229116 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1201/2444] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:37:20.281532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a83294f6-1e06-4017-ba49-1d3b920b8f29 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:20.282796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a83294f6-1e06-4017-ba49-1d3b920b8f29 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: e3d6d4a6-f11c-4b42-9023-4729addcf3da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:20.290692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a943563f-e757-476e-8b72-fcdda8f43005 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:20.302190 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a943563f-e757-476e-8b72-fcdda8f43005 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:20.305156 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a943563f-e757-476e-8b72-fcdda8f43005 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:20.306999 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a83294f6-1e06-4017-ba49-1d3b920b8f29 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:20.307462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a83294f6-1e06-4017-ba49-1d3b920b8f29 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:20.307904 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a83294f6-1e06-4017-ba49-1d3b920b8f29 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:20.308619 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a83294f6-1e06-4017-ba49-1d3b920b8f29 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:20.309164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a83294f6-1e06-4017-ba49-1d3b920b8f29 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:20.309785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a83294f6-1e06-4017-ba49-1d3b920b8f29 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:20.312564 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a943563f-e757-476e-8b72-fcdda8f43005 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] 10.222.0.16 "GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c" status: 200 len: 1551 microversion: 2.21 time: 0.335124 Oct 05 02:37:20.314094 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1244/2445] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:37:19 2022] GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c => generated 1551 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:37:20.319787 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-157c8d1e-52e3-4b48-a418-30f2e8ecbde3 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:20.320645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-157c8d1e-52e3-4b48-a418-30f2e8ecbde3 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: e123bb72-45c5-4371-bf2e-f0747497f16b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:20.329243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-157c8d1e-52e3-4b48-a418-30f2e8ecbde3 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:20.330091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-157c8d1e-52e3-4b48-a418-30f2e8ecbde3 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:20.330804 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-157c8d1e-52e3-4b48-a418-30f2e8ecbde3 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:20.331732 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-157c8d1e-52e3-4b48-a418-30f2e8ecbde3 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:20.333024 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-157c8d1e-52e3-4b48-a418-30f2e8ecbde3 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:20.333737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-157c8d1e-52e3-4b48-a418-30f2e8ecbde3 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:20.667500 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a83294f6-1e06-4017-ba49-1d3b920b8f29 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:20.677665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-157c8d1e-52e3-4b48-a418-30f2e8ecbde3 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f551e15d65a34daaac2b4d4f5963c522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7719a3153f66484c8758bb0999719851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:20.698168 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-157c8d1e-52e3-4b48-a418-30f2e8ecbde3 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/servers/e123bb72-45c5-4371-bf2e-f0747497f16b" status: 200 len: 1473 microversion: 2.1 time: 0.382706 Oct 05 02:37:20.699279 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a83294f6-1e06-4017-ba49-1d3b920b8f29 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da" status: 200 len: 1476 microversion: 2.1 time: 0.424819 Oct 05 02:37:20.701032 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1202/2446] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:20 2022] GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da => generated 1476 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:37:20.702250 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1245/2447] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:20 2022] GET /compute/v2.1/servers/e123bb72-45c5-4371-bf2e-f0747497f16b => generated 1473 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:20.713587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-51cf3094-8a6e-4f65-97a3-f580da4aa879 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:20.714454 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-51cf3094-8a6e-4f65-97a3-f580da4aa879 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] [instance: f005bb25-795a-40c0-aca9-32f8183d4b5c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:20.723237 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-51cf3094-8a6e-4f65-97a3-f580da4aa879 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:20.723826 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-51cf3094-8a6e-4f65-97a3-f580da4aa879 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:20.724947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-51cf3094-8a6e-4f65-97a3-f580da4aa879 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:20.726063 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-51cf3094-8a6e-4f65-97a3-f580da4aa879 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:20.726621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-51cf3094-8a6e-4f65-97a3-f580da4aa879 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:20.728339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-51cf3094-8a6e-4f65-97a3-f580da4aa879 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:20.769474 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-51cf3094-8a6e-4f65-97a3-f580da4aa879 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] [instance: f005bb25-795a-40c0-aca9-32f8183d4b5c] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:37:20.878484 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-51cf3094-8a6e-4f65-97a3-f580da4aa879 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c" status: 204 len: 0 microversion: 2.21 time: 0.175936 Oct 05 02:37:20.879479 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1203/2448] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 5 02:37:20 2022] DELETE /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 02:37:20.889583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7501f908-d2e8-4ea5-9bab-abb95133456f tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:20.899504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7501f908-d2e8-4ea5-9bab-abb95133456f tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] [instance: f005bb25-795a-40c0-aca9-32f8183d4b5c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:20.907388 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7501f908-d2e8-4ea5-9bab-abb95133456f tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:20.907886 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7501f908-d2e8-4ea5-9bab-abb95133456f tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:20.908323 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7501f908-d2e8-4ea5-9bab-abb95133456f tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:20.909254 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7501f908-d2e8-4ea5-9bab-abb95133456f tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:20.909713 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7501f908-d2e8-4ea5-9bab-abb95133456f tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:20.910136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7501f908-d2e8-4ea5-9bab-abb95133456f tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:20.933496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8b772bdf-1e48-41a0-8e4f-bd09fe79d919 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:20.934558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8b772bdf-1e48-41a0-8e4f-bd09fe79d919 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 7dfe1782-6765-4efc-8576-1d138be154ec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:20.936955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:20.944559 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b772bdf-1e48-41a0-8e4f-bd09fe79d919 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:20.945386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b772bdf-1e48-41a0-8e4f-bd09fe79d919 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:20.946613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b772bdf-1e48-41a0-8e4f-bd09fe79d919 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:20.947592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b772bdf-1e48-41a0-8e4f-bd09fe79d919 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:20.948360 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b772bdf-1e48-41a0-8e4f-bd09fe79d919 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:20.949243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b772bdf-1e48-41a0-8e4f-bd09fe79d919 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:21.229572 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7501f908-d2e8-4ea5-9bab-abb95133456f tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:21.238904 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7501f908-d2e8-4ea5-9bab-abb95133456f tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:21.241374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7501f908-d2e8-4ea5-9bab-abb95133456f tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:21.242752 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7501f908-d2e8-4ea5-9bab-abb95133456f tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] 10.222.0.16 "GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c" status: 200 len: 1557 microversion: 2.21 time: 0.358428 Oct 05 02:37:21.260935 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1246/2449] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:37:20 2022] GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c => generated 1557 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:37:21.269772 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b0aab399-7b5d-461f-8afd-e2d0079bf2cd tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:21.271771 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b0aab399-7b5d-461f-8afd-e2d0079bf2cd tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:21.278526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0aab399-7b5d-461f-8afd-e2d0079bf2cd tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:21.279240 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0aab399-7b5d-461f-8afd-e2d0079bf2cd tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:21.280256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0aab399-7b5d-461f-8afd-e2d0079bf2cd tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:21.281870 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0aab399-7b5d-461f-8afd-e2d0079bf2cd tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:21.282494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0aab399-7b5d-461f-8afd-e2d0079bf2cd tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:21.282995 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0aab399-7b5d-461f-8afd-e2d0079bf2cd tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:21.302315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8b772bdf-1e48-41a0-8e4f-bd09fe79d919 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:21.312973 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8b772bdf-1e48-41a0-8e4f-bd09fe79d919 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec" status: 200 len: 1334 microversion: 2.1 time: 0.384979 Oct 05 02:37:21.314376 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1204/2450] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:20 2022] GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec => generated 1334 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:21.725271 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c801b480-daea-43b7-85ae-70897e762d0b tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:21.729582 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c801b480-daea-43b7-85ae-70897e762d0b tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: e123bb72-45c5-4371-bf2e-f0747497f16b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:21.738570 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=4 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:21.749610 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c801b480-daea-43b7-85ae-70897e762d0b tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:21.753384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c801b480-daea-43b7-85ae-70897e762d0b tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:21.755015 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c801b480-daea-43b7-85ae-70897e762d0b tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:21.760302 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c801b480-daea-43b7-85ae-70897e762d0b tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:21.762466 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c801b480-daea-43b7-85ae-70897e762d0b tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:21.763166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c801b480-daea-43b7-85ae-70897e762d0b tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:22.056163 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b0aab399-7b5d-461f-8afd-e2d0079bf2cd tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:22.064503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b0aab399-7b5d-461f-8afd-e2d0079bf2cd tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:22.065984 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b0aab399-7b5d-461f-8afd-e2d0079bf2cd tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:22.067338 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b0aab399-7b5d-461f-8afd-e2d0079bf2cd tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1407 microversion: 2.20 time: 0.808757 Oct 05 02:37:22.068094 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1247/2451] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:37:21 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1407 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:37:22.080190 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-225e75dd-4501-4f9b-936e-a83b889103b2 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:22.081087 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-225e75dd-4501-4f9b-936e-a83b889103b2 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: e3d6d4a6-f11c-4b42-9023-4729addcf3da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:22.092761 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-225e75dd-4501-4f9b-936e-a83b889103b2 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:22.093779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-225e75dd-4501-4f9b-936e-a83b889103b2 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:22.094464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-225e75dd-4501-4f9b-936e-a83b889103b2 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:22.095403 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-225e75dd-4501-4f9b-936e-a83b889103b2 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:22.096253 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-225e75dd-4501-4f9b-936e-a83b889103b2 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:22.097336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-225e75dd-4501-4f9b-936e-a83b889103b2 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:22.328080 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c801b480-daea-43b7-85ae-70897e762d0b tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f551e15d65a34daaac2b4d4f5963c522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7719a3153f66484c8758bb0999719851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:22.338834 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c801b480-daea-43b7-85ae-70897e762d0b tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/servers/e123bb72-45c5-4371-bf2e-f0747497f16b" status: 200 len: 1473 microversion: 2.1 time: 0.617458 Oct 05 02:37:22.339419 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1205/2452] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:21 2022] GET /compute/v2.1/servers/e123bb72-45c5-4371-bf2e-f0747497f16b => generated 1473 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:22.349707 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e08e496a-3720-4c2a-9e05-cd8245d6e872 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:22.361847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e08e496a-3720-4c2a-9e05-cd8245d6e872 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] [instance: f005bb25-795a-40c0-aca9-32f8183d4b5c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:22.368778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e08e496a-3720-4c2a-9e05-cd8245d6e872 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:22.369351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e08e496a-3720-4c2a-9e05-cd8245d6e872 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:22.369793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e08e496a-3720-4c2a-9e05-cd8245d6e872 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:22.370700 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e08e496a-3720-4c2a-9e05-cd8245d6e872 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:22.371343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e08e496a-3720-4c2a-9e05-cd8245d6e872 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:22.371921 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e08e496a-3720-4c2a-9e05-cd8245d6e872 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:22.481918 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=22 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:22.566829 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-225e75dd-4501-4f9b-936e-a83b889103b2 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:22.581514 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-225e75dd-4501-4f9b-936e-a83b889103b2 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da" status: 200 len: 1476 microversion: 2.1 time: 0.510163 Oct 05 02:37:22.584089 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1248/2453] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:22 2022] GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da => generated 1476 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:22.601825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e50700f6-be59-49ce-a361-1a08a78a6200 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:22.603869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e50700f6-be59-49ce-a361-1a08a78a6200 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 7dfe1782-6765-4efc-8576-1d138be154ec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:22.619897 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e50700f6-be59-49ce-a361-1a08a78a6200 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:22.621189 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e50700f6-be59-49ce-a361-1a08a78a6200 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:22.623170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e50700f6-be59-49ce-a361-1a08a78a6200 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:22.624702 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e50700f6-be59-49ce-a361-1a08a78a6200 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:22.625509 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e50700f6-be59-49ce-a361-1a08a78a6200 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:22.626521 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e50700f6-be59-49ce-a361-1a08a78a6200 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:22.700651 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=18 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:22.828263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e08e496a-3720-4c2a-9e05-cd8245d6e872 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:22.846252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e08e496a-3720-4c2a-9e05-cd8245d6e872 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:22.852214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e08e496a-3720-4c2a-9e05-cd8245d6e872 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:22.855873 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e08e496a-3720-4c2a-9e05-cd8245d6e872 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] 10.222.0.16 "GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c" status: 200 len: 1557 microversion: 2.21 time: 0.513416 Oct 05 02:37:22.859806 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1206/2454] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:37:22 2022] GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c => generated 1557 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:37:23.094259 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-87b45280-77a2-465c-a2ca-3db3c0081c89 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:23.095147 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-87b45280-77a2-465c-a2ca-3db3c0081c89 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:23.109919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87b45280-77a2-465c-a2ca-3db3c0081c89 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:23.109919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87b45280-77a2-465c-a2ca-3db3c0081c89 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:23.109919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87b45280-77a2-465c-a2ca-3db3c0081c89 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:23.109919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87b45280-77a2-465c-a2ca-3db3c0081c89 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:23.109919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87b45280-77a2-465c-a2ca-3db3c0081c89 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:23.110279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87b45280-77a2-465c-a2ca-3db3c0081c89 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:23.157515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e50700f6-be59-49ce-a361-1a08a78a6200 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:23.167253 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e50700f6-be59-49ce-a361-1a08a78a6200 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec" status: 200 len: 1334 microversion: 2.1 time: 0.580594 Oct 05 02:37:23.175427 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1249/2455] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:22 2022] GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec => generated 1334 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:23.363908 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8c6e43ac-926a-40e8-ac79-86e98cbb9386 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:23.364622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8c6e43ac-926a-40e8-ac79-86e98cbb9386 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: e123bb72-45c5-4371-bf2e-f0747497f16b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:23.372115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c6e43ac-926a-40e8-ac79-86e98cbb9386 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:23.377586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c6e43ac-926a-40e8-ac79-86e98cbb9386 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:23.378028 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c6e43ac-926a-40e8-ac79-86e98cbb9386 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:23.378755 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c6e43ac-926a-40e8-ac79-86e98cbb9386 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:23.379207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c6e43ac-926a-40e8-ac79-86e98cbb9386 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:23.379634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c6e43ac-926a-40e8-ac79-86e98cbb9386 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:23.725782 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-87b45280-77a2-465c-a2ca-3db3c0081c89 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:23.741384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-87b45280-77a2-465c-a2ca-3db3c0081c89 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:23.750062 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-87b45280-77a2-465c-a2ca-3db3c0081c89 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:23.752866 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-87b45280-77a2-465c-a2ca-3db3c0081c89 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1407 microversion: 2.20 time: 0.661988 Oct 05 02:37:23.756863 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1207/2456] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:37:23 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1407 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:37:23.766127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cbaa89f5-007c-454c-923c-31eca391da89 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:23.769130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cbaa89f5-007c-454c-923c-31eca391da89 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: e3d6d4a6-f11c-4b42-9023-4729addcf3da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:23.785475 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cbaa89f5-007c-454c-923c-31eca391da89 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:23.787216 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cbaa89f5-007c-454c-923c-31eca391da89 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:23.790213 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cbaa89f5-007c-454c-923c-31eca391da89 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:23.794308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cbaa89f5-007c-454c-923c-31eca391da89 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:23.796623 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cbaa89f5-007c-454c-923c-31eca391da89 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:23.798398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cbaa89f5-007c-454c-923c-31eca391da89 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:24.332138 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8c6e43ac-926a-40e8-ac79-86e98cbb9386 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f551e15d65a34daaac2b4d4f5963c522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7719a3153f66484c8758bb0999719851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:24.345386 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8c6e43ac-926a-40e8-ac79-86e98cbb9386 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/servers/e123bb72-45c5-4371-bf2e-f0747497f16b" status: 200 len: 1473 microversion: 2.1 time: 0.983274 Oct 05 02:37:24.350657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cbaa89f5-007c-454c-923c-31eca391da89 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a280fd56304b47acca3f0b4061e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccc732cf08749648be251ca96d18cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:24.381667 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1250/2457] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:23 2022] GET /compute/v2.1/servers/e123bb72-45c5-4371-bf2e-f0747497f16b => generated 1473 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:37:24.391838 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cbaa89f5-007c-454c-923c-31eca391da89 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da" status: 200 len: 1434 microversion: 2.1 time: 0.617098 Oct 05 02:37:24.392298 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a6719040-8412-4b03-a9c2-59bdf9bfa7f8 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:24.393350 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a6719040-8412-4b03-a9c2-59bdf9bfa7f8 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] [instance: f005bb25-795a-40c0-aca9-32f8183d4b5c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:24.395312 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1208/2458] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:23 2022] GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da => generated 1434 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:24.402015 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6719040-8412-4b03-a9c2-59bdf9bfa7f8 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:24.402766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6719040-8412-4b03-a9c2-59bdf9bfa7f8 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:24.403822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6719040-8412-4b03-a9c2-59bdf9bfa7f8 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:24.405408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6719040-8412-4b03-a9c2-59bdf9bfa7f8 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:24.406089 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6719040-8412-4b03-a9c2-59bdf9bfa7f8 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:24.406872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6719040-8412-4b03-a9c2-59bdf9bfa7f8 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:24.411871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d7486c4d-7dcf-4bd0-bbd2-1e2964d0bb63 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:24.412510 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d7486c4d-7dcf-4bd0-bbd2-1e2964d0bb63 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 7dfe1782-6765-4efc-8576-1d138be154ec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:24.441312 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7486c4d-7dcf-4bd0-bbd2-1e2964d0bb63 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:24.441847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7486c4d-7dcf-4bd0-bbd2-1e2964d0bb63 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:24.446557 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7486c4d-7dcf-4bd0-bbd2-1e2964d0bb63 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:24.450445 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7486c4d-7dcf-4bd0-bbd2-1e2964d0bb63 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:24.451457 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7486c4d-7dcf-4bd0-bbd2-1e2964d0bb63 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:24.463648 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7486c4d-7dcf-4bd0-bbd2-1e2964d0bb63 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:25.421296 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a6719040-8412-4b03-a9c2-59bdf9bfa7f8 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:25.458451 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a6719040-8412-4b03-a9c2-59bdf9bfa7f8 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:25.464284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a6719040-8412-4b03-a9c2-59bdf9bfa7f8 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:25.466677 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a6719040-8412-4b03-a9c2-59bdf9bfa7f8 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] 10.222.0.16 "GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c" status: 200 len: 1515 microversion: 2.21 time: 1.080893 Oct 05 02:37:25.470231 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1251/2459] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:37:24 2022] GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c => generated 1515 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:37:25.487567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-b2344354-0dc1-4a56-9ff1-133b8de21f97 req-fa39697d-83ce-4d4c-af29-486920f36364 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3d6d4a6-f11c-4b42-9023-4729addcf3da", "name": "network-vif-deleted", "tag": "c891fddd-0e94-442b-939e-a1a5cb5a9fde"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:25.529737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b2344354-0dc1-4a56-9ff1-133b8de21f97 req-fa39697d-83ce-4d4c-af29-486920f36364 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:25.533057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b2344354-0dc1-4a56-9ff1-133b8de21f97 req-fa39697d-83ce-4d4c-af29-486920f36364 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:25.536323 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b2344354-0dc1-4a56-9ff1-133b8de21f97 req-fa39697d-83ce-4d4c-af29-486920f36364 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:25.592658 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-b2344354-0dc1-4a56-9ff1-133b8de21f97 req-fa39697d-83ce-4d4c-af29-486920f36364 service nova] Creating event network-vif-deleted:c891fddd-0e94-442b-939e-a1a5cb5a9fde for instance e3d6d4a6-f11c-4b42-9023-4729addcf3da on n-h1-858272-3 Oct 05 02:37:25.610225 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-b2344354-0dc1-4a56-9ff1-133b8de21f97 req-fa39697d-83ce-4d4c-af29-486920f36364 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137680 Oct 05 02:37:25.610952 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1252/2460] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:37:25.616606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bb4e5c03-a703-4dcb-bed6-29805c78115d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:25.627575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bb4e5c03-a703-4dcb-bed6-29805c78115d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:25.640607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb4e5c03-a703-4dcb-bed6-29805c78115d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:25.641142 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb4e5c03-a703-4dcb-bed6-29805c78115d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:25.641585 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb4e5c03-a703-4dcb-bed6-29805c78115d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:25.642302 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb4e5c03-a703-4dcb-bed6-29805c78115d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:25.642754 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb4e5c03-a703-4dcb-bed6-29805c78115d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:25.650055 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb4e5c03-a703-4dcb-bed6-29805c78115d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:26.252930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d7486c4d-7dcf-4bd0-bbd2-1e2964d0bb63 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:26.272682 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d7486c4d-7dcf-4bd0-bbd2-1e2964d0bb63 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec" status: 200 len: 1334 microversion: 2.1 time: 1.874749 Oct 05 02:37:26.273515 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1209/2461] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:24 2022] GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec => generated 1334 bytes in 1878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:26.291244 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e4c2b95a-e16f-40bf-8a9c-52f469e4b083 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:26.291872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e4c2b95a-e16f-40bf-8a9c-52f469e4b083 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: e123bb72-45c5-4371-bf2e-f0747497f16b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:26.310525 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4c2b95a-e16f-40bf-8a9c-52f469e4b083 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:26.311547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4c2b95a-e16f-40bf-8a9c-52f469e4b083 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:26.319269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4c2b95a-e16f-40bf-8a9c-52f469e4b083 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:26.320223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4c2b95a-e16f-40bf-8a9c-52f469e4b083 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:26.320873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4c2b95a-e16f-40bf-8a9c-52f469e4b083 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:26.321482 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4c2b95a-e16f-40bf-8a9c-52f469e4b083 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:26.363611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4c2b95a-e16f-40bf-8a9c-52f469e4b083 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:26.364191 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4c2b95a-e16f-40bf-8a9c-52f469e4b083 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:26.364631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4c2b95a-e16f-40bf-8a9c-52f469e4b083 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:26.365239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-e4c2b95a-e16f-40bf-8a9c-52f469e4b083 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lazy-loading 'fault' on Instance uuid e123bb72-45c5-4371-bf2e-f0747497f16b {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:37:26.432818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bb4e5c03-a703-4dcb-bed6-29805c78115d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:26.444516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bb4e5c03-a703-4dcb-bed6-29805c78115d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:26.450831 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bb4e5c03-a703-4dcb-bed6-29805c78115d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:26.452176 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bb4e5c03-a703-4dcb-bed6-29805c78115d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1407 microversion: 2.20 time: 0.839844 Oct 05 02:37:26.468178 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1253/2462] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:37:25 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1407 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:37:26.468487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e4c2b95a-e16f-40bf-8a9c-52f469e4b083 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f551e15d65a34daaac2b4d4f5963c522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7719a3153f66484c8758bb0999719851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:26.468621 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e4c2b95a-e16f-40bf-8a9c-52f469e4b083 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/servers/e123bb72-45c5-4371-bf2e-f0747497f16b" status: 200 len: 1308 microversion: 2.1 time: 0.194016 Oct 05 02:37:26.472494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5d60ad79-24c6-45ab-808b-aa0e90cd1295 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:26.473347 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5d60ad79-24c6-45ab-808b-aa0e90cd1295 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] [instance: e3d6d4a6-f11c-4b42-9023-4729addcf3da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:26.482602 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1210/2463] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:26 2022] GET /compute/v2.1/servers/e123bb72-45c5-4371-bf2e-f0747497f16b => generated 1308 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:26.487592 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d60ad79-24c6-45ab-808b-aa0e90cd1295 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:26.488933 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d60ad79-24c6-45ab-808b-aa0e90cd1295 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:26.492854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d60ad79-24c6-45ab-808b-aa0e90cd1295 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:26.493857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d60ad79-24c6-45ab-808b-aa0e90cd1295 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:26.496151 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d60ad79-24c6-45ab-808b-aa0e90cd1295 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:26.497492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d60ad79-24c6-45ab-808b-aa0e90cd1295 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:26.521348 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-5d60ad79-24c6-45ab-808b-aa0e90cd1295 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] HTTP exception thrown: Instance e3d6d4a6-f11c-4b42-9023-4729addcf3da could not be found. Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5d60ad79-24c6-45ab-808b-aa0e90cd1295 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Request method failure captured: Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da HTTP/1.1 Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO2ZG08VKA_Ymv5W7Om1xf3u4DaERAIUHTRsMxlj9G4CoXdzBR0yaGHhzRpjwpGXxuArbryL-gP5jsHlbrNJo8gggo4K3jN4fiCBwmHfnmQ0cl6lhUD8fQcgya1qqh9nohiFZ6oPMqp9Ith6IcZzk9AasW83mvg51g9iLFx5yJ2H_vQ Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: eccc732cf08749648be251ca96d18cd1 Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2079491689 Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eccc732cf08749648be251ca96d18cd1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eccc732cf08749648be251ca96d18cd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eccc732cf08749648be251ca96d18cd1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eccc732cf08749648be251ca96d18cd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2079491689 Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: eccc732cf08749648be251ca96d18cd1 Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2079491689 Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersAdminNegativeTestJSON-2079491689-project Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 83a280fd56304b47acca3f0b4061e18a Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2079491689-project Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance e3d6d4a6-f11c-4b42-9023-4729addcf3da could not be found. Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'e3d6d4a6-f11c-4b42-9023-4729addcf3da'} Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3d6d4a6-f11c-4b42-9023-4729addcf3da could not be found. Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3d6d4a6-f11c-4b42-9023-4729addcf3da could not be found. Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:26.523618 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:26.528264 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:26.528264 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:26.528264 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:26.528264 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:26.528264 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:37:26.528264 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:37:26.528264 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3d6d4a6-f11c-4b42-9023-4729addcf3da could not be found. Oct 05 02:37:26.528264 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:26.531336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5d60ad79-24c6-45ab-808b-aa0e90cd1295 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] Returning 404 to user: Instance e3d6d4a6-f11c-4b42-9023-4729addcf3da could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:37:26.532370 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5d60ad79-24c6-45ab-808b-aa0e90cd1295 tempest-ServersAdminNegativeTestJSON-2079491689 tempest-ServersAdminNegativeTestJSON-2079491689-project] 10.222.0.16 "GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da" status: 404 len: 111 microversion: 2.1 time: 0.076945 Oct 05 02:37:26.534280 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1254/2464] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:26 2022] GET /compute/v2.1/servers/e3d6d4a6-f11c-4b42-9023-4729addcf3da => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:37:26.541216 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-16fc8270-a95d-4044-b7d6-f54b824bf717 req-94b577a9-dfae-475c-8222-53c2134045a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e123bb72-45c5-4371-bf2e-f0747497f16b", "name": "network-vif-deleted", "tag": "05da60d7-1d7e-4607-a912-92561fc99617"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:26.563449 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-16fc8270-a95d-4044-b7d6-f54b824bf717 req-94b577a9-dfae-475c-8222-53c2134045a0 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:26.565530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-16fc8270-a95d-4044-b7d6-f54b824bf717 req-94b577a9-dfae-475c-8222-53c2134045a0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:26.568653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-16fc8270-a95d-4044-b7d6-f54b824bf717 req-94b577a9-dfae-475c-8222-53c2134045a0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:26.598139 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-16fc8270-a95d-4044-b7d6-f54b824bf717 req-94b577a9-dfae-475c-8222-53c2134045a0 service nova] Creating event network-vif-deleted:05da60d7-1d7e-4607-a912-92561fc99617 for instance e123bb72-45c5-4371-bf2e-f0747497f16b on n-h1-858272-3 Oct 05 02:37:26.608389 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-16fc8270-a95d-4044-b7d6-f54b824bf717 req-94b577a9-dfae-475c-8222-53c2134045a0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071906 Oct 05 02:37:26.609407 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1255/2465] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:37:26.622568 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-725480b4-2d04-4488-b400-a769f6e07321 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:26.622568 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-725480b4-2d04-4488-b400-a769f6e07321 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] [instance: f005bb25-795a-40c0-aca9-32f8183d4b5c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:26.640817 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-725480b4-2d04-4488-b400-a769f6e07321 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:26.645408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-725480b4-2d04-4488-b400-a769f6e07321 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:26.645869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-725480b4-2d04-4488-b400-a769f6e07321 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:26.646634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-725480b4-2d04-4488-b400-a769f6e07321 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:26.647078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-725480b4-2d04-4488-b400-a769f6e07321 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:26.647504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-725480b4-2d04-4488-b400-a769f6e07321 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:26.708557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-725480b4-2d04-4488-b400-a769f6e07321 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:26.709287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-725480b4-2d04-4488-b400-a769f6e07321 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:26.709875 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-725480b4-2d04-4488-b400-a769f6e07321 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:26.710488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-725480b4-2d04-4488-b400-a769f6e07321 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lazy-loading 'fault' on Instance uuid f005bb25-795a-40c0-aca9-32f8183d4b5c {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:37:26.815958 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-725480b4-2d04-4488-b400-a769f6e07321 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:26.834539 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-725480b4-2d04-4488-b400-a769f6e07321 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:26.854190 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-725480b4-2d04-4488-b400-a769f6e07321 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '559ade1b882b43d4a4f095c9214e8167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f8146191044043ab43029742153150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:26.855650 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-725480b4-2d04-4488-b400-a769f6e07321 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] 10.222.0.16 "GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c" status: 200 len: 1348 microversion: 2.21 time: 0.244732 Oct 05 02:37:26.858101 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1256/2466] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:37:26 2022] GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c => generated 1348 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:37:26.994219 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-2a4ae04a-88a8-498a-9a5c-141881ad1e10 req-b593f374-856a-4bb4-99a3-70ef635b7be0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c15b977-1608-45e8-8bbd-b2bd5c1eff21", "name": "network-vif-plugged", "status": "completed", "tag": "af2bec78-4945-43ac-81ca-883ba5ae8ef2"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:27.034359 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-2a4ae04a-88a8-498a-9a5c-141881ad1e10 req-b593f374-856a-4bb4-99a3-70ef635b7be0 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:27.035109 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-2a4ae04a-88a8-498a-9a5c-141881ad1e10 req-b593f374-856a-4bb4-99a3-70ef635b7be0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:27.035693 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-2a4ae04a-88a8-498a-9a5c-141881ad1e10 req-b593f374-856a-4bb4-99a3-70ef635b7be0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:27.055103 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-2a4ae04a-88a8-498a-9a5c-141881ad1e10 req-b593f374-856a-4bb4-99a3-70ef635b7be0 service nova] Creating event network-vif-plugged:af2bec78-4945-43ac-81ca-883ba5ae8ef2 for instance 1c15b977-1608-45e8-8bbd-b2bd5c1eff21 on n-h2-858272-3 Oct 05 02:37:27.064435 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-2a4ae04a-88a8-498a-9a5c-141881ad1e10 req-b593f374-856a-4bb4-99a3-70ef635b7be0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.575578 Oct 05 02:37:27.066425 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1211/2467] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:37:27.303917 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3791da06-39e2-4768-841c-617c4cacd3d8 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:27.304799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3791da06-39e2-4768-841c-617c4cacd3d8 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 7dfe1782-6765-4efc-8576-1d138be154ec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:27.316835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3791da06-39e2-4768-841c-617c4cacd3d8 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:27.320750 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3791da06-39e2-4768-841c-617c4cacd3d8 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:27.321541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3791da06-39e2-4768-841c-617c4cacd3d8 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:27.322466 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3791da06-39e2-4768-841c-617c4cacd3d8 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:27.323011 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3791da06-39e2-4768-841c-617c4cacd3d8 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:27.323454 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3791da06-39e2-4768-841c-617c4cacd3d8 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:27.483805 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c365b180-4887-4738-8ae2-68d120dc3a4c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:27.485128 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c365b180-4887-4738-8ae2-68d120dc3a4c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:27.501553 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c365b180-4887-4738-8ae2-68d120dc3a4c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:27.503544 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c365b180-4887-4738-8ae2-68d120dc3a4c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:27.505477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c365b180-4887-4738-8ae2-68d120dc3a4c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:27.506314 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c365b180-4887-4738-8ae2-68d120dc3a4c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:27.508548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c365b180-4887-4738-8ae2-68d120dc3a4c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:27.509221 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c365b180-4887-4738-8ae2-68d120dc3a4c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:28.220039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c365b180-4887-4738-8ae2-68d120dc3a4c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:28.221234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3791da06-39e2-4768-841c-617c4cacd3d8 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:28.235816 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3791da06-39e2-4768-841c-617c4cacd3d8 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec" status: 200 len: 1334 microversion: 2.1 time: 0.935870 Oct 05 02:37:28.236683 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1257/2468] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:27 2022] GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec => generated 1334 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:28.250688 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c365b180-4887-4738-8ae2-68d120dc3a4c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:28.250848 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7749787f-70ed-4184-aa93-f4537e60a896 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:28.251331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7749787f-70ed-4184-aa93-f4537e60a896 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] [instance: e123bb72-45c5-4371-bf2e-f0747497f16b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:28.252838 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c365b180-4887-4738-8ae2-68d120dc3a4c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:28.255363 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c365b180-4887-4738-8ae2-68d120dc3a4c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1407 microversion: 2.20 time: 0.776699 Oct 05 02:37:28.264538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7749787f-70ed-4184-aa93-f4537e60a896 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:28.265014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7749787f-70ed-4184-aa93-f4537e60a896 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:28.265692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7749787f-70ed-4184-aa93-f4537e60a896 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:28.266815 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7749787f-70ed-4184-aa93-f4537e60a896 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:28.267423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7749787f-70ed-4184-aa93-f4537e60a896 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:28.268027 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7749787f-70ed-4184-aa93-f4537e60a896 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:28.270916 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1212/2469] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:37:27 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1407 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:37:28.281477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a41e5c17-d894-4e02-a53e-8cad8cd762fc tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:28.295540 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a41e5c17-d894-4e02-a53e-8cad8cd762fc tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] [instance: f005bb25-795a-40c0-aca9-32f8183d4b5c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:28.298385 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-7749787f-70ed-4184-aa93-f4537e60a896 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] HTTP exception thrown: Instance e123bb72-45c5-4371-bf2e-f0747497f16b could not be found. Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7749787f-70ed-4184-aa93-f4537e60a896 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Request method failure captured: Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/e123bb72-45c5-4371-bf2e-f0747497f16b HTTP/1.1 Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO0uxHpm3HuSR31q2m6mktaf80nDlKoEiOZqfEHpyvjaHurMpZCiYsg8b6I45IAm3732x3E7X_xUn2ISZbn_TRs8Vzt-VIoQWb1ZqIoncEEMnMG8Tz9AM_-DbdAaQ4Vi_0Nqn1BjMJw1UGYGYi8TL4bFmyHQ_Sa_Rvk4LAnFi5IxcaA Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 7719a3153f66484c8758bb0999719851 Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ListImageFiltersTestJSON-1755017753 Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7719a3153f66484c8758bb0999719851"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7719a3153f66484c8758bb0999719851"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7719a3153f66484c8758bb0999719851"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7719a3153f66484c8758bb0999719851"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ListImageFiltersTestJSON-1755017753 Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 7719a3153f66484c8758bb0999719851 Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1755017753 Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ListImageFiltersTestJSON-1755017753-project Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: f551e15d65a34daaac2b4d4f5963c522 Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ListImageFiltersTestJSON-1755017753-project Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance e123bb72-45c5-4371-bf2e-f0747497f16b could not be found. Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'e123bb72-45c5-4371-bf2e-f0747497f16b'} Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e123bb72-45c5-4371-bf2e-f0747497f16b could not be found. Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e123bb72-45c5-4371-bf2e-f0747497f16b could not be found. Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:28.300191 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:28.304328 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:28.304328 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:28.304328 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:28.304328 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:37:28.304328 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:37:28.304328 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e123bb72-45c5-4371-bf2e-f0747497f16b could not be found. Oct 05 02:37:28.304328 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:28.306414 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7749787f-70ed-4184-aa93-f4537e60a896 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Returning 404 to user: Instance e123bb72-45c5-4371-bf2e-f0747497f16b could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:37:28.308081 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7749787f-70ed-4184-aa93-f4537e60a896 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "GET /compute/v2.1/servers/e123bb72-45c5-4371-bf2e-f0747497f16b" status: 404 len: 111 microversion: 2.1 time: 0.070624 Oct 05 02:37:28.316152 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a41e5c17-d894-4e02-a53e-8cad8cd762fc tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:28.316567 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1258/2470] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:28 2022] GET /compute/v2.1/servers/e123bb72-45c5-4371-bf2e-f0747497f16b => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:37:28.317087 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a41e5c17-d894-4e02-a53e-8cad8cd762fc tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:28.322528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a41e5c17-d894-4e02-a53e-8cad8cd762fc tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:28.337346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a41e5c17-d894-4e02-a53e-8cad8cd762fc tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:28.338483 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dc2b295e-180b-4903-808e-af8474c053b5 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce4272ee0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:28.339708 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a41e5c17-d894-4e02-a53e-8cad8cd762fc tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:28.340394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a41e5c17-d894-4e02-a53e-8cad8cd762fc tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:28.388399 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-a41e5c17-d894-4e02-a53e-8cad8cd762fc tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] HTTP exception thrown: Instance f005bb25-795a-40c0-aca9-32f8183d4b5c could not be found. Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a41e5c17-d894-4e02-a53e-8cad8cd762fc tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Request method failure captured: Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c HTTP/1.1 Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO3FHVG3BvoHvvI16to4rkMHqpmU9_TE6JedRGwRmOGFsbuxxykng3CsAp-3KD6sW4G-4_LTJ-FKnM9mTWlB-7ibjim7e0ul_L8xShrDkGLXOqnmFDFDawZKHFS9Y1atkTZ58FcMC6WVYAisY3jhn_enzTY2a6z-FelGxEoFhGU-9ko Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: X-Openstack-Nova-Api-Version: 2.21 Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 16f8146191044043ab43029742153150 Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1528424780 Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/16f8146191044043ab43029742153150"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/16f8146191044043ab43029742153150"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/16f8146191044043ab43029742153150"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_16f8146191044043ab43029742153150"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-InstanceActionsV221TestJSON-1528424780 Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 16f8146191044043ab43029742153150 Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1528424780 Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-InstanceActionsV221TestJSON-1528424780-project Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 559ade1b882b43d4a4f095c9214e8167 Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-InstanceActionsV221TestJSON-1528424780-project Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance f005bb25-795a-40c0-aca9-32f8183d4b5c could not be found. Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'f005bb25-795a-40c0-aca9-32f8183d4b5c'} Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f005bb25-795a-40c0-aca9-32f8183d4b5c could not be found. Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f005bb25-795a-40c0-aca9-32f8183d4b5c could not be found. Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:28.396143 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:28.400358 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:28.400358 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:28.400358 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:28.400358 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:28.400358 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:37:28.400358 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:37:28.400358 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f005bb25-795a-40c0-aca9-32f8183d4b5c could not be found. Oct 05 02:37:28.400358 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:28.402673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a41e5c17-d894-4e02-a53e-8cad8cd762fc tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Returning 404 to user: Instance f005bb25-795a-40c0-aca9-32f8183d4b5c could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:37:28.408052 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a41e5c17-d894-4e02-a53e-8cad8cd762fc tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] 10.222.0.16 "GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c" status: 404 len: 111 microversion: 2.21 time: 0.131003 Oct 05 02:37:28.408686 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1213/2471] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:37:28 2022] GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:37:28.423845 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-66f6205a-3cec-4614-8a50-66bae9dea3bf tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Calling method '.version_select at 0x7fcce80c2670>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:28.429192 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-66f6205a-3cec-4614-8a50-66bae9dea3bf tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] [instance: f005bb25-795a-40c0-aca9-32f8183d4b5c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:28.444407 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-66f6205a-3cec-4614-8a50-66bae9dea3bf tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:28.447531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-66f6205a-3cec-4614-8a50-66bae9dea3bf tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:28.448162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-66f6205a-3cec-4614-8a50-66bae9dea3bf tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:28.449840 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-66f6205a-3cec-4614-8a50-66bae9dea3bf tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:28.452802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-66f6205a-3cec-4614-8a50-66bae9dea3bf tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:28.453495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-66f6205a-3cec-4614-8a50-66bae9dea3bf tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:28.599198 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-66f6205a-3cec-4614-8a50-66bae9dea3bf tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] 10.222.0.16 "GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.184382 Oct 05 02:37:28.610902 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1214/2472] 10.222.0.16 () {60 vars in 1337 bytes} [Wed Oct 5 02:37:28 2022] GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c/os-instance-actions => generated 611 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:37:28.615998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1f5ea959-ff0e-4937-af6d-18ed6f21ef51 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:28.616697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1f5ea959-ff0e-4937-af6d-18ed6f21ef51 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] [instance: f005bb25-795a-40c0-aca9-32f8183d4b5c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:28.626179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f5ea959-ff0e-4937-af6d-18ed6f21ef51 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:28.626880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f5ea959-ff0e-4937-af6d-18ed6f21ef51 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:28.627481 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f5ea959-ff0e-4937-af6d-18ed6f21ef51 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:28.628356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f5ea959-ff0e-4937-af6d-18ed6f21ef51 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:28.629089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f5ea959-ff0e-4937-af6d-18ed6f21ef51 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:28.629693 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f5ea959-ff0e-4937-af6d-18ed6f21ef51 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:28.639841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:28.658342 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-1f5ea959-ff0e-4937-af6d-18ed6f21ef51 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] HTTP exception thrown: Instance f005bb25-795a-40c0-aca9-32f8183d4b5c could not be found. Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1f5ea959-ff0e-4937-af6d-18ed6f21ef51 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Request method failure captured: Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c HTTP/1.1 Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO3FHVG3BvoHvvI16to4rkMHqpmU9_TE6JedRGwRmOGFsbuxxykng3CsAp-3KD6sW4G-4_LTJ-FKnM9mTWlB-7ibjim7e0ul_L8xShrDkGLXOqnmFDFDawZKHFS9Y1atkTZ58FcMC6WVYAisY3jhn_enzTY2a6z-FelGxEoFhGU-9ko Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: X-Openstack-Nova-Api-Version: 2.21 Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 16f8146191044043ab43029742153150 Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1528424780 Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/16f8146191044043ab43029742153150"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/16f8146191044043ab43029742153150"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/16f8146191044043ab43029742153150"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_16f8146191044043ab43029742153150"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-InstanceActionsV221TestJSON-1528424780 Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 16f8146191044043ab43029742153150 Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1528424780 Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-InstanceActionsV221TestJSON-1528424780-project Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 559ade1b882b43d4a4f095c9214e8167 Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-InstanceActionsV221TestJSON-1528424780-project Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance f005bb25-795a-40c0-aca9-32f8183d4b5c could not be found. Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'f005bb25-795a-40c0-aca9-32f8183d4b5c'} Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f005bb25-795a-40c0-aca9-32f8183d4b5c could not be found. Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:37:28.661833 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:37:28.665979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f005bb25-795a-40c0-aca9-32f8183d4b5c could not be found. Oct 05 02:37:28.665979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:28.665979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:28.665979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:28.665979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:28.665979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:28.665979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:28.665979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:37:28.665979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:37:28.665979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f005bb25-795a-40c0-aca9-32f8183d4b5c could not be found. Oct 05 02:37:28.665979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:28.672584 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1f5ea959-ff0e-4937-af6d-18ed6f21ef51 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Returning 404 to user: Instance f005bb25-795a-40c0-aca9-32f8183d4b5c could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:37:28.673992 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1f5ea959-ff0e-4937-af6d-18ed6f21ef51 tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c" status: 404 len: 111 microversion: 2.21 time: 0.062821 Oct 05 02:37:28.680932 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1215/2473] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 5 02:37:28 2022] DELETE /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:37:28.687714 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-766fa058-3155-4497-bbc3-ce52352c6ecb req-31937bcf-4269-4ed2-ae2a-67db5f1ac6af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f005bb25-795a-40c0-aca9-32f8183d4b5c", "name": "network-vif-deleted", "tag": "fac7d8d9-388f-41cc-a1f9-55d13c863e97"}, {"name": "network-changed", "server_uuid": "7dfe1782-6765-4efc-8576-1d138be154ec", "tag": "2f185a5a-975b-4f18-818c-671346a1c21b"}, {"name": "network-changed", "server_uuid": "7dfe1782-6765-4efc-8576-1d138be154ec", "tag": "e3274f93-c8fd-40a4-bb23-9d84e0b02391"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:28.700949 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-766fa058-3155-4497-bbc3-ce52352c6ecb req-31937bcf-4269-4ed2-ae2a-67db5f1ac6af service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:28.701884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-766fa058-3155-4497-bbc3-ce52352c6ecb req-31937bcf-4269-4ed2-ae2a-67db5f1ac6af service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:28.702606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-766fa058-3155-4497-bbc3-ce52352c6ecb req-31937bcf-4269-4ed2-ae2a-67db5f1ac6af service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:28.721918 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-766fa058-3155-4497-bbc3-ce52352c6ecb req-31937bcf-4269-4ed2-ae2a-67db5f1ac6af service nova] Creating event network-vif-deleted:fac7d8d9-388f-41cc-a1f9-55d13c863e97 for instance f005bb25-795a-40c0-aca9-32f8183d4b5c on n-h1-858272-3 Oct 05 02:37:28.722998 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-766fa058-3155-4497-bbc3-ce52352c6ecb req-31937bcf-4269-4ed2-ae2a-67db5f1ac6af service nova] Creating event network-changed:2f185a5a-975b-4f18-818c-671346a1c21b for instance 7dfe1782-6765-4efc-8576-1d138be154ec on n-h1-858272-3 Oct 05 02:37:28.723882 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-766fa058-3155-4497-bbc3-ce52352c6ecb req-31937bcf-4269-4ed2-ae2a-67db5f1ac6af service nova] Creating event network-changed:e3274f93-c8fd-40a4-bb23-9d84e0b02391 for instance 7dfe1782-6765-4efc-8576-1d138be154ec on n-h1-858272-3 Oct 05 02:37:28.733640 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-766fa058-3155-4497-bbc3-ce52352c6ecb req-31937bcf-4269-4ed2-ae2a-67db5f1ac6af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.049200 Oct 05 02:37:28.735238 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1216/2474] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:37:28.744229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cc27ca7e-4f36-477d-b032-048e1e3eee4a tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:28.745285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cc27ca7e-4f36-477d-b032-048e1e3eee4a tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] [instance: f005bb25-795a-40c0-aca9-32f8183d4b5c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:28.754485 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cc27ca7e-4f36-477d-b032-048e1e3eee4a tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:28.755197 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cc27ca7e-4f36-477d-b032-048e1e3eee4a tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:28.755842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cc27ca7e-4f36-477d-b032-048e1e3eee4a tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:28.756752 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cc27ca7e-4f36-477d-b032-048e1e3eee4a tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:28.758099 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cc27ca7e-4f36-477d-b032-048e1e3eee4a tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:28.758794 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cc27ca7e-4f36-477d-b032-048e1e3eee4a tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:28.775279 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-cc27ca7e-4f36-477d-b032-048e1e3eee4a tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] HTTP exception thrown: Instance f005bb25-795a-40c0-aca9-32f8183d4b5c could not be found. Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cc27ca7e-4f36-477d-b032-048e1e3eee4a tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Request method failure captured: Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c HTTP/1.1 Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO3FHVG3BvoHvvI16to4rkMHqpmU9_TE6JedRGwRmOGFsbuxxykng3CsAp-3KD6sW4G-4_LTJ-FKnM9mTWlB-7ibjim7e0ul_L8xShrDkGLXOqnmFDFDawZKHFS9Y1atkTZ58FcMC6WVYAisY3jhn_enzTY2a6z-FelGxEoFhGU-9ko Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: X-Openstack-Nova-Api-Version: 2.21 Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 16f8146191044043ab43029742153150 Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1528424780 Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/16f8146191044043ab43029742153150"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/16f8146191044043ab43029742153150"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/16f8146191044043ab43029742153150"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_16f8146191044043ab43029742153150"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-InstanceActionsV221TestJSON-1528424780 Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 16f8146191044043ab43029742153150 Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1528424780 Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-InstanceActionsV221TestJSON-1528424780-project Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 559ade1b882b43d4a4f095c9214e8167 Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-InstanceActionsV221TestJSON-1528424780-project Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance f005bb25-795a-40c0-aca9-32f8183d4b5c could not be found. Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'f005bb25-795a-40c0-aca9-32f8183d4b5c'} Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f005bb25-795a-40c0-aca9-32f8183d4b5c could not be found. Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f005bb25-795a-40c0-aca9-32f8183d4b5c could not be found. Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:28.778237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:28.784445 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:28.784445 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:28.784445 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:28.784445 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:28.784445 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:37:28.784445 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:37:28.784445 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f005bb25-795a-40c0-aca9-32f8183d4b5c could not be found. Oct 05 02:37:28.784445 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:28.786671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cc27ca7e-4f36-477d-b032-048e1e3eee4a tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] Returning 404 to user: Instance f005bb25-795a-40c0-aca9-32f8183d4b5c could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:37:28.787657 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cc27ca7e-4f36-477d-b032-048e1e3eee4a tempest-InstanceActionsV221TestJSON-1528424780 tempest-InstanceActionsV221TestJSON-1528424780-project] 10.222.0.16 "GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c" status: 404 len: 111 microversion: 2.21 time: 0.051071 Oct 05 02:37:28.788309 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1217/2475] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:37:28 2022] GET /compute/v2.1/servers/f005bb25-795a-40c0-aca9-32f8183d4b5c => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:37:29.054115 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dc2b295e-180b-4903-808e-af8474c053b5 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "DELETE /compute/v2.1/images/b892f4a9-382e-4bbb-bc48-2a55461a2da9" status: 204 len: 0 microversion: 2.1 time: 0.735877 Oct 05 02:37:29.056657 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1259/2476] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:28 2022] DELETE /compute/v2.1/images/b892f4a9-382e-4bbb-bc48-2a55461a2da9 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:37:29.067355 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-25b42736-256f-4166-afd7-3095d055a703 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fccdf655430>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:29.267811 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d669ce4b-d0de-4a59-b714-928be9366736 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:29.268511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d669ce4b-d0de-4a59-b714-928be9366736 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 7dfe1782-6765-4efc-8576-1d138be154ec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:29.307490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d669ce4b-d0de-4a59-b714-928be9366736 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:29.314377 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d669ce4b-d0de-4a59-b714-928be9366736 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:29.320279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d669ce4b-d0de-4a59-b714-928be9366736 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:29.323947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d669ce4b-d0de-4a59-b714-928be9366736 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:29.324877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d669ce4b-d0de-4a59-b714-928be9366736 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:29.325578 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d669ce4b-d0de-4a59-b714-928be9366736 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:29.853608 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d669ce4b-d0de-4a59-b714-928be9366736 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:29.864198 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d669ce4b-d0de-4a59-b714-928be9366736 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec" status: 200 len: 1334 microversion: 2.1 time: 0.603677 Oct 05 02:37:29.868078 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1260/2477] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:29 2022] GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec => generated 1334 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:37:29.878043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-541ff4cd-2e62-409d-bf50-6eea389c33be tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:29.882831 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-541ff4cd-2e62-409d-bf50-6eea389c33be tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:29.909382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-541ff4cd-2e62-409d-bf50-6eea389c33be tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:29.911224 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-541ff4cd-2e62-409d-bf50-6eea389c33be tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:29.911693 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-541ff4cd-2e62-409d-bf50-6eea389c33be tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:29.915661 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-541ff4cd-2e62-409d-bf50-6eea389c33be tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:29.919774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-541ff4cd-2e62-409d-bf50-6eea389c33be tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:29.921917 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-541ff4cd-2e62-409d-bf50-6eea389c33be tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:29.937800 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-25b42736-256f-4166-afd7-3095d055a703 tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "DELETE /compute/v2.1/images/69f572a5-9838-4baa-ae75-ade8a46a4f3d" status: 204 len: 0 microversion: 2.1 time: 0.876872 Oct 05 02:37:29.939400 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1218/2478] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:29 2022] DELETE /compute/v2.1/images/69f572a5-9838-4baa-ae75-ade8a46a4f3d => generated 0 bytes in 879 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:37:29.947924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c7293a53-8d50-4f07-819c-f8a0c7f10c4a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] Calling method '.version_select at 0x7fcce80c44c0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:30.322047 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c7293a53-8d50-4f07-819c-f8a0c7f10c4a tempest-ListImageFiltersTestJSON-1755017753 tempest-ListImageFiltersTestJSON-1755017753-project] 10.222.0.16 "DELETE /compute/v2.1/images/97437ce4-c141-4f25-b689-7c217fa6716e" status: 204 len: 0 microversion: 2.1 time: 0.377429 Oct 05 02:37:30.322729 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1219/2479] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:29 2022] DELETE /compute/v2.1/images/97437ce4-c141-4f25-b689-7c217fa6716e => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 02:37:30.736516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-541ff4cd-2e62-409d-bf50-6eea389c33be tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:30.745976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-541ff4cd-2e62-409d-bf50-6eea389c33be tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:30.753661 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-541ff4cd-2e62-409d-bf50-6eea389c33be tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:30.755068 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-541ff4cd-2e62-409d-bf50-6eea389c33be tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1598 microversion: 2.20 time: 0.885790 Oct 05 02:37:30.763785 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1261/2480] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:37:29 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1598 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:37:30.792633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8c6aefb9-141c-4e36-bfbd-bb0faaf8cf6e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:30.793188 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8c6aefb9-141c-4e36-bfbd-bb0faaf8cf6e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:30.808641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c6aefb9-141c-4e36-bfbd-bb0faaf8cf6e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:30.809197 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c6aefb9-141c-4e36-bfbd-bb0faaf8cf6e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:30.811016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c6aefb9-141c-4e36-bfbd-bb0faaf8cf6e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:30.812615 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c6aefb9-141c-4e36-bfbd-bb0faaf8cf6e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:30.814855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c6aefb9-141c-4e36-bfbd-bb0faaf8cf6e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:30.815389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c6aefb9-141c-4e36-bfbd-bb0faaf8cf6e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:30.895012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c4879fff-193d-4d48-96d5-ada23743b410 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:30.895648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c4879fff-193d-4d48-96d5-ada23743b410 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 7dfe1782-6765-4efc-8576-1d138be154ec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:30.912088 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4879fff-193d-4d48-96d5-ada23743b410 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:30.912586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4879fff-193d-4d48-96d5-ada23743b410 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:30.913128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4879fff-193d-4d48-96d5-ada23743b410 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:30.914087 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4879fff-193d-4d48-96d5-ada23743b410 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:30.914896 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4879fff-193d-4d48-96d5-ada23743b410 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:30.915490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4879fff-193d-4d48-96d5-ada23743b410 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:31.100005 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8c6aefb9-141c-4e36-bfbd-bb0faaf8cf6e tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.312958 Oct 05 02:37:31.108853 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1220/2481] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Oct 5 02:37:30 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21/os-interface => generated 284 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:37:31.410382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c4879fff-193d-4d48-96d5-ada23743b410 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:31.434814 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c4879fff-193d-4d48-96d5-ada23743b410 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec" status: 200 len: 1334 microversion: 2.1 time: 0.543977 Oct 05 02:37:31.443417 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1262/2482] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:30 2022] GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec => generated 1334 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:37:32.469093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7438ba2b-9665-477c-a991-b3d62f98fc9f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:32.469707 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7438ba2b-9665-477c-a991-b3d62f98fc9f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 7dfe1782-6765-4efc-8576-1d138be154ec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:32.488338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7438ba2b-9665-477c-a991-b3d62f98fc9f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:32.488843 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7438ba2b-9665-477c-a991-b3d62f98fc9f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:32.489323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7438ba2b-9665-477c-a991-b3d62f98fc9f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:32.490230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7438ba2b-9665-477c-a991-b3d62f98fc9f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:32.490870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7438ba2b-9665-477c-a991-b3d62f98fc9f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:32.491484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7438ba2b-9665-477c-a991-b3d62f98fc9f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:32.969394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7438ba2b-9665-477c-a991-b3d62f98fc9f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:33.001238 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7438ba2b-9665-477c-a991-b3d62f98fc9f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec" status: 200 len: 1334 microversion: 2.1 time: 0.537129 Oct 05 02:37:33.003884 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1221/2483] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:32 2022] GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec => generated 1334 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:33.156516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ceac584a-d26c-49a3-9db7-21ef626b56fc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-336188800", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:33.273315 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-ceac584a-d26c-49a3-9db7-21ef626b56fc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] validate_networks() for None {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:37:33.723130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-24c3d022-c851-4748-a5df-6ec44b4bab59 tempest-ListImagesTestJSON-529677455 tempest-ListImagesTestJSON-529677455-project] Calling method '.version_select at 0x7fcce80c2940>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:33.878317 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-24c3d022-c851-4748-a5df-6ec44b4bab59 tempest-ListImagesTestJSON-529677455 tempest-ListImagesTestJSON-529677455-project] 10.222.0.16 "GET /compute/v2.1/images/adad3215-1ca6-43bb-9981-0d01aff146ab" status: 200 len: 784 microversion: 2.1 time: 0.564487 Oct 05 02:37:33.889496 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1222/2484] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:37:33 2022] GET /compute/v2.1/images/adad3215-1ca6-43bb-9981-0d01aff146ab => generated 784 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:37:33.894502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-725d281f-d9d7-431f-bcca-815e3bb02a58 tempest-ListImagesTestJSON-529677455 tempest-ListImagesTestJSON-529677455-project] Calling method '.version_select at 0x7fccdf66eca0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:34.072653 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-725d281f-d9d7-431f-bcca-815e3bb02a58 tempest-ListImagesTestJSON-529677455 tempest-ListImagesTestJSON-529677455-project] 10.222.0.16 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.181718 Oct 05 02:37:34.082079 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1223/2485] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:33 2022] GET /compute/v2.1/images => generated 445 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:37:34.087965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6c05bc40-6d48-4fac-8eaf-43157d62a8c9 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:34.088893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6c05bc40-6d48-4fac-8eaf-43157d62a8c9 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 7dfe1782-6765-4efc-8576-1d138be154ec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:34.096726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c05bc40-6d48-4fac-8eaf-43157d62a8c9 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:34.098164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c05bc40-6d48-4fac-8eaf-43157d62a8c9 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:34.098818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c05bc40-6d48-4fac-8eaf-43157d62a8c9 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:34.099763 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c05bc40-6d48-4fac-8eaf-43157d62a8c9 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:34.100434 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c05bc40-6d48-4fac-8eaf-43157d62a8c9 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:34.101104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c05bc40-6d48-4fac-8eaf-43157d62a8c9 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:34.426600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6c05bc40-6d48-4fac-8eaf-43157d62a8c9 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:34.441223 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6c05bc40-6d48-4fac-8eaf-43157d62a8c9 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec" status: 200 len: 1334 microversion: 2.1 time: 0.357121 Oct 05 02:37:34.442339 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1224/2486] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:34 2022] GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec => generated 1334 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:34.449932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e9b3effe-7182-4876-950b-0dedf634ae11 tempest-ListImagesTestJSON-529677455 tempest-ListImagesTestJSON-529677455-project] Calling method '.version_select at 0x7fccdf6fbf70>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:34.533690 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e9b3effe-7182-4876-950b-0dedf634ae11 tempest-ListImagesTestJSON-529677455 tempest-ListImagesTestJSON-529677455-project] 10.222.0.16 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.089535 Oct 05 02:37:34.534580 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1225/2487] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 5 02:37:34 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:37:34.540424 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-da52844b-c539-41f1-af8e-00bdada363cd req-a02c4f65-60a5-4b02-9ff3-c9c7ee14fea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c15b977-1608-45e8-8bbd-b2bd5c1eff21", "tag": "af2bec78-4945-43ac-81ca-883ba5ae8ef2"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:34.565597 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-da52844b-c539-41f1-af8e-00bdada363cd req-a02c4f65-60a5-4b02-9ff3-c9c7ee14fea1 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:34.566348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-da52844b-c539-41f1-af8e-00bdada363cd req-a02c4f65-60a5-4b02-9ff3-c9c7ee14fea1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:34.566984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-da52844b-c539-41f1-af8e-00bdada363cd req-a02c4f65-60a5-4b02-9ff3-c9c7ee14fea1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:34.580516 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-da52844b-c539-41f1-af8e-00bdada363cd req-a02c4f65-60a5-4b02-9ff3-c9c7ee14fea1 service nova] Creating event network-changed:af2bec78-4945-43ac-81ca-883ba5ae8ef2 for instance 1c15b977-1608-45e8-8bbd-b2bd5c1eff21 on n-h2-858272-3 Oct 05 02:37:34.586773 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-da52844b-c539-41f1-af8e-00bdada363cd req-a02c4f65-60a5-4b02-9ff3-c9c7ee14fea1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050503 Oct 05 02:37:34.588004 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1226/2488] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:37:34.781069 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-ceac584a-d26c-49a3-9db7-21ef626b56fc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:37:34.782039 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-ceac584a-d26c-49a3-9db7-21ef626b56fc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:37:34.782791 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-ceac584a-d26c-49a3-9db7-21ef626b56fc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:37:34.783259 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-ceac584a-d26c-49a3-9db7-21ef626b56fc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:37:34.783786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-ceac584a-d26c-49a3-9db7-21ef626b56fc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:37:34.810765 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ceac584a-d26c-49a3-9db7-21ef626b56fc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:34.811257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ceac584a-d26c-49a3-9db7-21ef626b56fc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:34.815263 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ceac584a-d26c-49a3-9db7-21ef626b56fc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:34.817806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ceac584a-d26c-49a3-9db7-21ef626b56fc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:34.818305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ceac584a-d26c-49a3-9db7-21ef626b56fc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:34.818752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ceac584a-d26c-49a3-9db7-21ef626b56fc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:34.858421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-ceac584a-d26c-49a3-9db7-21ef626b56fc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:37:34.865901 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-ceac584a-d26c-49a3-9db7-21ef626b56fc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for user b86e3b7d1c9a4b2c8f2914beefa74cc1 and project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:37:34.887805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ceac584a-d26c-49a3-9db7-21ef626b56fc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:37:34.890834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ceac584a-d26c-49a3-9db7-21ef626b56fc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 6b01f092-c99b-4a47-bdcb-3b6bcdeb0323] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:37:34.996262 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ceac584a-d26c-49a3-9db7-21ef626b56fc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.214045 Oct 05 02:37:35.002321 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1263/2489] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:37:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:37:35.014177 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-58942316-2801-426d-9eae-a7ff11463108 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:35.014902 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-58942316-2801-426d-9eae-a7ff11463108 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 6b01f092-c99b-4a47-bdcb-3b6bcdeb0323] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:35.330772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-58942316-2801-426d-9eae-a7ff11463108 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:35.339210 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-58942316-2801-426d-9eae-a7ff11463108 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323" status: 200 len: 1216 microversion: 2.1 time: 0.329237 Oct 05 02:37:35.349256 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1227/2490] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:35 2022] GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323 => generated 1216 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:35.472031 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-afc1c549-d623-48dc-8de9-a3a0242944fa tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:35.473453 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-afc1c549-d623-48dc-8de9-a3a0242944fa tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 7dfe1782-6765-4efc-8576-1d138be154ec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:35.486531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afc1c549-d623-48dc-8de9-a3a0242944fa tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:35.488508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afc1c549-d623-48dc-8de9-a3a0242944fa tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:35.488996 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afc1c549-d623-48dc-8de9-a3a0242944fa tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:35.492043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afc1c549-d623-48dc-8de9-a3a0242944fa tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:35.495066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afc1c549-d623-48dc-8de9-a3a0242944fa tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:35.495066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afc1c549-d623-48dc-8de9-a3a0242944fa tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:36.124477 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-afc1c549-d623-48dc-8de9-a3a0242944fa tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:36.127860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:36.147669 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-afc1c549-d623-48dc-8de9-a3a0242944fa tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec" status: 200 len: 1334 microversion: 2.1 time: 0.680812 Oct 05 02:37:36.168504 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1264/2491] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:35 2022] GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec => generated 1334 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:36.363357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e5e00049-d499-40e2-ad20-46b1f60105c0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:36.365647 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e5e00049-d499-40e2-ad20-46b1f60105c0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 6b01f092-c99b-4a47-bdcb-3b6bcdeb0323] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:36.381864 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5e00049-d499-40e2-ad20-46b1f60105c0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:36.392535 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5e00049-d499-40e2-ad20-46b1f60105c0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:36.396027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5e00049-d499-40e2-ad20-46b1f60105c0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:36.397646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5e00049-d499-40e2-ad20-46b1f60105c0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:36.402667 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5e00049-d499-40e2-ad20-46b1f60105c0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:36.405361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5e00049-d499-40e2-ad20-46b1f60105c0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:36.573493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e5e00049-d499-40e2-ad20-46b1f60105c0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:36.624878 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e5e00049-d499-40e2-ad20-46b1f60105c0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323" status: 200 len: 1268 microversion: 2.1 time: 0.263036 Oct 05 02:37:36.636259 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1228/2492] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:36 2022] GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323 => generated 1268 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:37.186695 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0fa3b748-2581-4d0d-b415-77316ccd90bc tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:37.189097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0fa3b748-2581-4d0d-b415-77316ccd90bc tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 7dfe1782-6765-4efc-8576-1d138be154ec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:37.200671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0fa3b748-2581-4d0d-b415-77316ccd90bc tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:37.202044 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0fa3b748-2581-4d0d-b415-77316ccd90bc tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:37.203215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0fa3b748-2581-4d0d-b415-77316ccd90bc tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:37.205620 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0fa3b748-2581-4d0d-b415-77316ccd90bc tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:37.206434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0fa3b748-2581-4d0d-b415-77316ccd90bc tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:37.207075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0fa3b748-2581-4d0d-b415-77316ccd90bc tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:37.669011 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-524d7423-7cdc-47b3-a370-361c096352c0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:37.669670 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-524d7423-7cdc-47b3-a370-361c096352c0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 6b01f092-c99b-4a47-bdcb-3b6bcdeb0323] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:37.684940 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-524d7423-7cdc-47b3-a370-361c096352c0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:37.685456 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-524d7423-7cdc-47b3-a370-361c096352c0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:37.686323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-524d7423-7cdc-47b3-a370-361c096352c0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:37.687075 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-524d7423-7cdc-47b3-a370-361c096352c0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:37.687535 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-524d7423-7cdc-47b3-a370-361c096352c0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:37.687964 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-524d7423-7cdc-47b3-a370-361c096352c0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:37.954117 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-524d7423-7cdc-47b3-a370-361c096352c0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:37.970317 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-524d7423-7cdc-47b3-a370-361c096352c0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323" status: 200 len: 1274 microversion: 2.1 time: 0.313851 Oct 05 02:37:37.974435 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1229/2493] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:37 2022] GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323 => generated 1274 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:37:38.404520 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0fa3b748-2581-4d0d-b415-77316ccd90bc tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:38.419271 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0fa3b748-2581-4d0d-b415-77316ccd90bc tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec" status: 200 len: 1334 microversion: 2.1 time: 1.242415 Oct 05 02:37:38.423204 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1265/2494] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:37 2022] GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec => generated 1334 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:39.005594 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9d47c661-c17b-4f74-9004-ae67b843d0c0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:39.006436 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9d47c661-c17b-4f74-9004-ae67b843d0c0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 6b01f092-c99b-4a47-bdcb-3b6bcdeb0323] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:39.021906 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d47c661-c17b-4f74-9004-ae67b843d0c0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:39.022525 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d47c661-c17b-4f74-9004-ae67b843d0c0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:39.024305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d47c661-c17b-4f74-9004-ae67b843d0c0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:39.026617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d47c661-c17b-4f74-9004-ae67b843d0c0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:39.027557 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d47c661-c17b-4f74-9004-ae67b843d0c0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:39.028004 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d47c661-c17b-4f74-9004-ae67b843d0c0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:39.360203 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-aba0e19b-2e30-496c-a911-eae14b8a2e9c req-418e2999-d4a6-4d54-8a18-2b6c8e7a8a8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dfe1782-6765-4efc-8576-1d138be154ec", "name": "network-vif-plugged", "status": "completed", "tag": "2f185a5a-975b-4f18-818c-671346a1c21b"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:39.368041 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:39.389922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-aba0e19b-2e30-496c-a911-eae14b8a2e9c req-418e2999-d4a6-4d54-8a18-2b6c8e7a8a8b service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:39.390353 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-aba0e19b-2e30-496c-a911-eae14b8a2e9c req-418e2999-d4a6-4d54-8a18-2b6c8e7a8a8b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:39.391029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-aba0e19b-2e30-496c-a911-eae14b8a2e9c req-418e2999-d4a6-4d54-8a18-2b6c8e7a8a8b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:39.423337 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-aba0e19b-2e30-496c-a911-eae14b8a2e9c req-418e2999-d4a6-4d54-8a18-2b6c8e7a8a8b service nova] Creating event network-vif-plugged:2f185a5a-975b-4f18-818c-671346a1c21b for instance 7dfe1782-6765-4efc-8576-1d138be154ec on n-h1-858272-3 Oct 05 02:37:39.450389 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-aba0e19b-2e30-496c-a911-eae14b8a2e9c req-418e2999-d4a6-4d54-8a18-2b6c8e7a8a8b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089036 Oct 05 02:37:39.452890 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1266/2495] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:37:39.453925 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9d47c661-c17b-4f74-9004-ae67b843d0c0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:39.468083 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9d47c661-c17b-4f74-9004-ae67b843d0c0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323" status: 200 len: 1274 microversion: 2.1 time: 0.467413 Oct 05 02:37:39.468356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-44e5ac60-6bd6-4c27-9ecf-cf0b93f9099a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:39.468687 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1230/2496] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:38 2022] GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323 => generated 1274 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:39.471115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-44e5ac60-6bd6-4c27-9ecf-cf0b93f9099a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 7dfe1782-6765-4efc-8576-1d138be154ec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:39.490033 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44e5ac60-6bd6-4c27-9ecf-cf0b93f9099a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:39.490542 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44e5ac60-6bd6-4c27-9ecf-cf0b93f9099a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:39.491040 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44e5ac60-6bd6-4c27-9ecf-cf0b93f9099a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:39.491723 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44e5ac60-6bd6-4c27-9ecf-cf0b93f9099a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:39.492184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44e5ac60-6bd6-4c27-9ecf-cf0b93f9099a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:39.493371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44e5ac60-6bd6-4c27-9ecf-cf0b93f9099a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:39.837570 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-44e5ac60-6bd6-4c27-9ecf-cf0b93f9099a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:39.853578 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-44e5ac60-6bd6-4c27-9ecf-cf0b93f9099a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec" status: 200 len: 1334 microversion: 2.1 time: 0.397172 Oct 05 02:37:39.854215 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1267/2497] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:39 2022] GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec => generated 1334 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:40.248088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-05cde759-2164-4dd9-8782-4b95537395fd tempest-AbsoluteLimitsTestJSON-1230641549 tempest-AbsoluteLimitsTestJSON-1230641549-project] Calling method '.version_select at 0x7fccdf50dd30>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:40.272378 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05cde759-2164-4dd9-8782-4b95537395fd tempest-AbsoluteLimitsTestJSON-1230641549 tempest-AbsoluteLimitsTestJSON-1230641549-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:40.272956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05cde759-2164-4dd9-8782-4b95537395fd tempest-AbsoluteLimitsTestJSON-1230641549 tempest-AbsoluteLimitsTestJSON-1230641549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:40.273426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05cde759-2164-4dd9-8782-4b95537395fd tempest-AbsoluteLimitsTestJSON-1230641549 tempest-AbsoluteLimitsTestJSON-1230641549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:40.278463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05cde759-2164-4dd9-8782-4b95537395fd tempest-AbsoluteLimitsTestJSON-1230641549 tempest-AbsoluteLimitsTestJSON-1230641549-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:40.278982 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05cde759-2164-4dd9-8782-4b95537395fd tempest-AbsoluteLimitsTestJSON-1230641549 tempest-AbsoluteLimitsTestJSON-1230641549-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:40.279445 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05cde759-2164-4dd9-8782-4b95537395fd tempest-AbsoluteLimitsTestJSON-1230641549 tempest-AbsoluteLimitsTestJSON-1230641549-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:40.319679 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-05cde759-2164-4dd9-8782-4b95537395fd tempest-AbsoluteLimitsTestJSON-1230641549 tempest-AbsoluteLimitsTestJSON-1230641549-project] 10.222.0.16 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.316329 Oct 05 02:37:40.321448 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1231/2498] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:40 2022] GET /compute/v2.1/limits => generated 511 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:37:40.493069 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8a560da1-0965-4738-84bd-e0684493e453 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:40.494625 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8a560da1-0965-4738-84bd-e0684493e453 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 6b01f092-c99b-4a47-bdcb-3b6bcdeb0323] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:40.512369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a560da1-0965-4738-84bd-e0684493e453 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:40.514405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a560da1-0965-4738-84bd-e0684493e453 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:40.515448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a560da1-0965-4738-84bd-e0684493e453 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:40.516937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a560da1-0965-4738-84bd-e0684493e453 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:40.518800 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a560da1-0965-4738-84bd-e0684493e453 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:40.520563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a560da1-0965-4738-84bd-e0684493e453 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:40.830908 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8a560da1-0965-4738-84bd-e0684493e453 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:40.843489 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8a560da1-0965-4738-84bd-e0684493e453 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323" status: 200 len: 1316 microversion: 2.1 time: 0.355175 Oct 05 02:37:40.845454 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1268/2499] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:40 2022] GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323 => generated 1316 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:40.879715 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1db04aac-3d14-41ae-ace6-fca0b3e58ff9 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:40.880287 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1db04aac-3d14-41ae-ace6-fca0b3e58ff9 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 7dfe1782-6765-4efc-8576-1d138be154ec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:40.891878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1db04aac-3d14-41ae-ace6-fca0b3e58ff9 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:40.892386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1db04aac-3d14-41ae-ace6-fca0b3e58ff9 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:40.892839 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1db04aac-3d14-41ae-ace6-fca0b3e58ff9 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:40.893589 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1db04aac-3d14-41ae-ace6-fca0b3e58ff9 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:40.897635 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1db04aac-3d14-41ae-ace6-fca0b3e58ff9 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:40.898207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1db04aac-3d14-41ae-ace6-fca0b3e58ff9 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:41.404834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1db04aac-3d14-41ae-ace6-fca0b3e58ff9 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:41.434616 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1db04aac-3d14-41ae-ace6-fca0b3e58ff9 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec" status: 200 len: 1334 microversion: 2.1 time: 0.557949 Oct 05 02:37:41.438500 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1232/2500] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:40 2022] GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec => generated 1334 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:41.520155 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-f6e19d86-dc2a-4418-8d71-eb97251a2a5a req-7dd5f2fc-58b1-4939-b336-2ceb64d05317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dfe1782-6765-4efc-8576-1d138be154ec", "name": "network-vif-plugged", "status": "completed", "tag": "e3274f93-c8fd-40a4-bb23-9d84e0b02391"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:41.541804 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f6e19d86-dc2a-4418-8d71-eb97251a2a5a req-7dd5f2fc-58b1-4939-b336-2ceb64d05317 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:41.542294 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f6e19d86-dc2a-4418-8d71-eb97251a2a5a req-7dd5f2fc-58b1-4939-b336-2ceb64d05317 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:41.546561 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f6e19d86-dc2a-4418-8d71-eb97251a2a5a req-7dd5f2fc-58b1-4939-b336-2ceb64d05317 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:41.573426 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-f6e19d86-dc2a-4418-8d71-eb97251a2a5a req-7dd5f2fc-58b1-4939-b336-2ceb64d05317 service nova] Creating event network-vif-plugged:e3274f93-c8fd-40a4-bb23-9d84e0b02391 for instance 7dfe1782-6765-4efc-8576-1d138be154ec on n-h1-858272-3 Oct 05 02:37:41.586598 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-f6e19d86-dc2a-4418-8d71-eb97251a2a5a req-7dd5f2fc-58b1-4939-b336-2ceb64d05317 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070289 Oct 05 02:37:41.587610 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1269/2501] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:37:41.872634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f2c4a1d7-b6b2-490e-bb09-14d643a8c5e1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:41.874615 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f2c4a1d7-b6b2-490e-bb09-14d643a8c5e1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 6b01f092-c99b-4a47-bdcb-3b6bcdeb0323] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:41.887640 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f2c4a1d7-b6b2-490e-bb09-14d643a8c5e1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:41.889361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f2c4a1d7-b6b2-490e-bb09-14d643a8c5e1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:41.890712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f2c4a1d7-b6b2-490e-bb09-14d643a8c5e1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:41.893151 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f2c4a1d7-b6b2-490e-bb09-14d643a8c5e1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:41.893944 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f2c4a1d7-b6b2-490e-bb09-14d643a8c5e1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:41.896026 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f2c4a1d7-b6b2-490e-bb09-14d643a8c5e1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:42.080174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-8d791937-bac3-4890-aae9-49d32a009ca4 req-9afb5be3-2707-44f8-b95c-76ec221f9c07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b01f092-c99b-4a47-bdcb-3b6bcdeb0323", "tag": "6e942f65-fdd7-4e15-8f96-499f27856283"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:42.113873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-8d791937-bac3-4890-aae9-49d32a009ca4 req-9afb5be3-2707-44f8-b95c-76ec221f9c07 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:42.114549 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-8d791937-bac3-4890-aae9-49d32a009ca4 req-9afb5be3-2707-44f8-b95c-76ec221f9c07 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:42.119682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-8d791937-bac3-4890-aae9-49d32a009ca4 req-9afb5be3-2707-44f8-b95c-76ec221f9c07 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:42.181183 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-8d791937-bac3-4890-aae9-49d32a009ca4 req-9afb5be3-2707-44f8-b95c-76ec221f9c07 service nova] Creating event network-changed:6e942f65-fdd7-4e15-8f96-499f27856283 for instance 6b01f092-c99b-4a47-bdcb-3b6bcdeb0323 on n-h1-858272-3 Oct 05 02:37:42.205642 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-8d791937-bac3-4890-aae9-49d32a009ca4 req-9afb5be3-2707-44f8-b95c-76ec221f9c07 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129329 Oct 05 02:37:42.210179 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1270/2502] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:37:42.465423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8fc760e3-47dc-4701-813c-c5a68f7d182f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:42.466233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8fc760e3-47dc-4701-813c-c5a68f7d182f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 7dfe1782-6765-4efc-8576-1d138be154ec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:42.480271 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8fc760e3-47dc-4701-813c-c5a68f7d182f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:42.481115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8fc760e3-47dc-4701-813c-c5a68f7d182f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:42.481877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8fc760e3-47dc-4701-813c-c5a68f7d182f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:42.483346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8fc760e3-47dc-4701-813c-c5a68f7d182f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:42.483965 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8fc760e3-47dc-4701-813c-c5a68f7d182f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:42.484682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8fc760e3-47dc-4701-813c-c5a68f7d182f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:42.594308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f2c4a1d7-b6b2-490e-bb09-14d643a8c5e1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:42.607053 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f2c4a1d7-b6b2-490e-bb09-14d643a8c5e1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323" status: 200 len: 1316 microversion: 2.1 time: 0.739085 Oct 05 02:37:42.611042 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1233/2503] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:41 2022] GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323 => generated 1316 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:42.986077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8fc760e3-47dc-4701-813c-c5a68f7d182f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:42.995434 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8fc760e3-47dc-4701-813c-c5a68f7d182f tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec" status: 200 len: 1334 microversion: 2.1 time: 0.535847 Oct 05 02:37:42.997124 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1271/2504] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:42 2022] GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec => generated 1334 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:43.631310 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-55381632-9b6c-45a7-8c8e-b708bb54df59 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:43.631919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-55381632-9b6c-45a7-8c8e-b708bb54df59 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 6b01f092-c99b-4a47-bdcb-3b6bcdeb0323] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:43.642989 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55381632-9b6c-45a7-8c8e-b708bb54df59 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:43.643510 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55381632-9b6c-45a7-8c8e-b708bb54df59 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:43.643956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55381632-9b6c-45a7-8c8e-b708bb54df59 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:43.644682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55381632-9b6c-45a7-8c8e-b708bb54df59 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:43.646424 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55381632-9b6c-45a7-8c8e-b708bb54df59 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:43.647768 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55381632-9b6c-45a7-8c8e-b708bb54df59 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:43.859637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-55381632-9b6c-45a7-8c8e-b708bb54df59 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:43.871282 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-55381632-9b6c-45a7-8c8e-b708bb54df59 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323" status: 200 len: 1316 microversion: 2.1 time: 0.244076 Oct 05 02:37:43.885824 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1234/2505] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:43 2022] GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323 => generated 1316 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:44.022176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bb54fc47-9557-4ce1-9102-a0fe5eb665ca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:44.022718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bb54fc47-9557-4ce1-9102-a0fe5eb665ca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 7dfe1782-6765-4efc-8576-1d138be154ec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:44.031066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb54fc47-9557-4ce1-9102-a0fe5eb665ca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:44.031818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb54fc47-9557-4ce1-9102-a0fe5eb665ca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:44.032575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb54fc47-9557-4ce1-9102-a0fe5eb665ca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:44.033324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb54fc47-9557-4ce1-9102-a0fe5eb665ca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:44.033788 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb54fc47-9557-4ce1-9102-a0fe5eb665ca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:44.034198 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb54fc47-9557-4ce1-9102-a0fe5eb665ca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:44.207091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bb54fc47-9557-4ce1-9102-a0fe5eb665ca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:44.219694 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bb54fc47-9557-4ce1-9102-a0fe5eb665ca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec" status: 200 len: 1671 microversion: 2.1 time: 0.201375 Oct 05 02:37:44.236940 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1272/2506] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:44 2022] GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec => generated 1671 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:44.252779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c652d19e-4afb-41d8-a250-c85e3ea135ca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:44.253412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c652d19e-4afb-41d8-a250-c85e3ea135ca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 7dfe1782-6765-4efc-8576-1d138be154ec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:44.260170 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c652d19e-4afb-41d8-a250-c85e3ea135ca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:44.261206 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c652d19e-4afb-41d8-a250-c85e3ea135ca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:44.261489 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c652d19e-4afb-41d8-a250-c85e3ea135ca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:44.262352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c652d19e-4afb-41d8-a250-c85e3ea135ca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:44.262923 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c652d19e-4afb-41d8-a250-c85e3ea135ca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:44.263444 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c652d19e-4afb-41d8-a250-c85e3ea135ca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:44.294549 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c652d19e-4afb-41d8-a250-c85e3ea135ca tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec/ips" status: 200 len: 181 microversion: 2.1 time: 0.047621 Oct 05 02:37:44.295622 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1235/2507] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 02:37:44 2022] GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec/ips => generated 181 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:37:44.308483 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b2936411-835b-4c23-8b59-907febca7b44 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:44.309206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b2936411-835b-4c23-8b59-907febca7b44 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 7dfe1782-6765-4efc-8576-1d138be154ec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:44.316265 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2936411-835b-4c23-8b59-907febca7b44 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:44.316265 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2936411-835b-4c23-8b59-907febca7b44 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:44.316888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2936411-835b-4c23-8b59-907febca7b44 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:44.317785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2936411-835b-4c23-8b59-907febca7b44 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:44.318754 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2936411-835b-4c23-8b59-907febca7b44 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:44.319398 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2936411-835b-4c23-8b59-907febca7b44 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:44.353766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b2936411-835b-4c23-8b59-907febca7b44 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 7dfe1782-6765-4efc-8576-1d138be154ec] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:37:44.455885 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b2936411-835b-4c23-8b59-907febca7b44 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec" status: 204 len: 0 microversion: 2.1 time: 0.151717 Oct 05 02:37:44.457081 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1273/2508] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:37:44 2022] DELETE /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 02:37:44.466169 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-57660dd4-be92-410b-86c0-e472f793138d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:44.466957 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-57660dd4-be92-410b-86c0-e472f793138d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 7dfe1782-6765-4efc-8576-1d138be154ec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:44.473140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-57660dd4-be92-410b-86c0-e472f793138d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:44.473943 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-57660dd4-be92-410b-86c0-e472f793138d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:44.476000 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-57660dd4-be92-410b-86c0-e472f793138d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:44.477293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-57660dd4-be92-410b-86c0-e472f793138d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:44.477984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-57660dd4-be92-410b-86c0-e472f793138d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:44.478938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-57660dd4-be92-410b-86c0-e472f793138d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:44.688115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-57660dd4-be92-410b-86c0-e472f793138d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:44.699844 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-57660dd4-be92-410b-86c0-e472f793138d tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec" status: 200 len: 1677 microversion: 2.1 time: 0.238050 Oct 05 02:37:44.722061 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1236/2509] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:44 2022] GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec => generated 1677 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:44.896043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dcda4c62-4c32-4640-b55d-3fa98a57a90a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:44.896826 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dcda4c62-4c32-4640-b55d-3fa98a57a90a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 6b01f092-c99b-4a47-bdcb-3b6bcdeb0323] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:44.898829 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:44.899811 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:44.904950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dcda4c62-4c32-4640-b55d-3fa98a57a90a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:44.905447 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dcda4c62-4c32-4640-b55d-3fa98a57a90a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:44.905886 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dcda4c62-4c32-4640-b55d-3fa98a57a90a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:44.906585 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dcda4c62-4c32-4640-b55d-3fa98a57a90a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:44.907044 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dcda4c62-4c32-4640-b55d-3fa98a57a90a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:44.907465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dcda4c62-4c32-4640-b55d-3fa98a57a90a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:45.097580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dcda4c62-4c32-4640-b55d-3fa98a57a90a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:45.108282 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dcda4c62-4c32-4640-b55d-3fa98a57a90a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323" status: 200 len: 1316 microversion: 2.1 time: 0.216139 Oct 05 02:37:45.110165 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1274/2510] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:44 2022] GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323 => generated 1316 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:45.731787 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9bf635b8-a8b4-4ecc-b91b-7624d3457b43 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:45.732581 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9bf635b8-a8b4-4ecc-b91b-7624d3457b43 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 7dfe1782-6765-4efc-8576-1d138be154ec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:45.751134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9bf635b8-a8b4-4ecc-b91b-7624d3457b43 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:45.753088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9bf635b8-a8b4-4ecc-b91b-7624d3457b43 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:45.753875 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9bf635b8-a8b4-4ecc-b91b-7624d3457b43 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:45.755128 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9bf635b8-a8b4-4ecc-b91b-7624d3457b43 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:45.756066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9bf635b8-a8b4-4ecc-b91b-7624d3457b43 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:45.756715 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9bf635b8-a8b4-4ecc-b91b-7624d3457b43 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:46.131571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-51baf439-97b2-48f7-90dc-4f073456d352 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:46.132828 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-51baf439-97b2-48f7-90dc-4f073456d352 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 6b01f092-c99b-4a47-bdcb-3b6bcdeb0323] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:46.144269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51baf439-97b2-48f7-90dc-4f073456d352 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:46.146462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51baf439-97b2-48f7-90dc-4f073456d352 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:46.146912 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51baf439-97b2-48f7-90dc-4f073456d352 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:46.147792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51baf439-97b2-48f7-90dc-4f073456d352 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:46.148087 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51baf439-97b2-48f7-90dc-4f073456d352 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:46.151732 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51baf439-97b2-48f7-90dc-4f073456d352 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:46.476834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9bf635b8-a8b4-4ecc-b91b-7624d3457b43 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:46.490547 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9bf635b8-a8b4-4ecc-b91b-7624d3457b43 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec" status: 200 len: 1677 microversion: 2.1 time: 0.765350 Oct 05 02:37:46.491142 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1237/2511] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:45 2022] GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec => generated 1677 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:46.533962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-51baf439-97b2-48f7-90dc-4f073456d352 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:46.556422 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-51baf439-97b2-48f7-90dc-4f073456d352 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323" status: 200 len: 1316 microversion: 2.1 time: 0.428225 Oct 05 02:37:46.560439 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1275/2512] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:46 2022] GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323 => generated 1316 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:47.002225 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d9c783f2-9e9a-4e65-b3d1-27a9a664180a tempest-ImagesMetadataNegativeTestJSON-629703310 tempest-ImagesMetadataNegativeTestJSON-629703310-project] Calling method '.version_select at 0x7fcce812c280>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:47.041238 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-d9c783f2-9e9a-4e65-b3d1-27a9a664180a tempest-ImagesMetadataNegativeTestJSON-629703310 tempest-ImagesMetadataNegativeTestJSON-629703310-project] HTTP exception thrown: Image not found. Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d9c783f2-9e9a-4e65-b3d1-27a9a664180a tempest-ImagesMetadataNegativeTestJSON-629703310 tempest-ImagesMetadataNegativeTestJSON-629703310-project] Request method failure captured: Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/images/22e27c2d-2d69-41e4-a873-3c6e988ce9e0/metadata/os_distro HTTP/1.1 Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO36jN0OQqMDGBL3q2b2b2sF6BSskOVfB1u6zA1MhohNMA7daKWJzlUYktaTVSCTkkzQBO2DCZ90r4Unk6gj8vc2XH-phA-tbokZv8JpLLbm4KQ6HP49UI01JjIs_UF3KTu9Xc86fyB8KVHrJmV9rsxQbRXwki4egReQhIpQMXVO52Y Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: d00fdea8d5904c159056f45061e065ee Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-629703310 Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d00fdea8d5904c159056f45061e065ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d00fdea8d5904c159056f45061e065ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d00fdea8d5904c159056f45061e065ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d00fdea8d5904c159056f45061e065ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-629703310 Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: d00fdea8d5904c159056f45061e065ee Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-629703310 Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ImagesMetadataNegativeTestJSON-629703310-project Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 625efde54cb74e3cb4879333d41835d9 Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-629703310-project Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: exception: Image not found. Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'image_id': '22e27c2d-2d69-41e4-a873-3c6e988ce9e0', 'id': 'os_distro'} Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 22e27c2d-2d69-41e4-a873-3c6e988ce9e0 Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 05 02:37:47.052395 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 22e27c2d-2d69-41e4-a873-3c6e988ce9e0 could not be found. Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d9c783f2-9e9a-4e65-b3d1-27a9a664180a tempest-ImagesMetadataNegativeTestJSON-629703310 tempest-ImagesMetadataNegativeTestJSON-629703310-project] Returning 404 to user: Image not found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d9c783f2-9e9a-4e65-b3d1-27a9a664180a tempest-ImagesMetadataNegativeTestJSON-629703310 tempest-ImagesMetadataNegativeTestJSON-629703310-project] 10.222.0.16 "DELETE /compute/v2.1/images/22e27c2d-2d69-41e4-a873-3c6e988ce9e0/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.509516 Oct 05 02:37:47.056862 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1238/2513] 10.222.0.16 () {58 vars in 1293 bytes} [Wed Oct 5 02:37:46 2022] DELETE /compute/v2.1/images/22e27c2d-2d69-41e4-a873-3c6e988ce9e0/metadata/os_distro => generated 62 bytes in 511 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 05 02:37:47.066881 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-45e8db35-b397-4218-b310-628537072ab6 tempest-ImagesMetadataNegativeTestJSON-629703310 tempest-ImagesMetadataNegativeTestJSON-629703310-project] Calling method '.version_select at 0x7fcce8260ee0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:47.107967 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-45e8db35-b397-4218-b310-628537072ab6 tempest-ImagesMetadataNegativeTestJSON-629703310 tempest-ImagesMetadataNegativeTestJSON-629703310-project] HTTP exception thrown: Image not found. Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-45e8db35-b397-4218-b310-628537072ab6 tempest-ImagesMetadataNegativeTestJSON-629703310 tempest-ImagesMetadataNegativeTestJSON-629703310-project] Request method failure captured: Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/images/94036ecb-6dc1-40fb-bff8-fa410083bce0/metadata/os_version HTTP/1.1 Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO36jN0OQqMDGBL3q2b2b2sF6BSskOVfB1u6zA1MhohNMA7daKWJzlUYktaTVSCTkkzQBO2DCZ90r4Unk6gj8vc2XH-phA-tbokZv8JpLLbm4KQ6HP49UI01JjIs_UF3KTu9Xc86fyB8KVHrJmV9rsxQbRXwki4egReQhIpQMXVO52Y Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: d00fdea8d5904c159056f45061e065ee Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-629703310 Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d00fdea8d5904c159056f45061e065ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d00fdea8d5904c159056f45061e065ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d00fdea8d5904c159056f45061e065ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d00fdea8d5904c159056f45061e065ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-629703310 Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: d00fdea8d5904c159056f45061e065ee Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-629703310 Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ImagesMetadataNegativeTestJSON-629703310-project Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 625efde54cb74e3cb4879333d41835d9 Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-629703310-project Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: exception: Image not found. Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'image_id': '94036ecb-6dc1-40fb-bff8-fa410083bce0', 'id': 'os_version'} Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 94036ecb-6dc1-40fb-bff8-fa410083bce0 Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 05 02:37:47.110434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 94036ecb-6dc1-40fb-bff8-fa410083bce0 could not be found. Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-45e8db35-b397-4218-b310-628537072ab6 tempest-ImagesMetadataNegativeTestJSON-629703310 tempest-ImagesMetadataNegativeTestJSON-629703310-project] Returning 404 to user: Image not found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-45e8db35-b397-4218-b310-628537072ab6 tempest-ImagesMetadataNegativeTestJSON-629703310 tempest-ImagesMetadataNegativeTestJSON-629703310-project] 10.222.0.16 "GET /compute/v2.1/images/94036ecb-6dc1-40fb-bff8-fa410083bce0/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.049014 Oct 05 02:37:47.115098 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1276/2514] 10.222.0.16 () {58 vars in 1293 bytes} [Wed Oct 5 02:37:47 2022] GET /compute/v2.1/images/94036ecb-6dc1-40fb-bff8-fa410083bce0/metadata/os_version => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:37:47.126265 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e65d5b41-df69-4030-9654-1fba549674c2 tempest-ImagesMetadataNegativeTestJSON-629703310 tempest-ImagesMetadataNegativeTestJSON-629703310-project] Calling method '.version_select at 0x7fcce80c4430>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-e65d5b41-df69-4030-9654-1fba549674c2 tempest-ImagesMetadataNegativeTestJSON-629703310 tempest-ImagesMetadataNegativeTestJSON-629703310-project] HTTP exception thrown: Image not found. Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e65d5b41-df69-4030-9654-1fba549674c2 tempest-ImagesMetadataNegativeTestJSON-629703310 tempest-ImagesMetadataNegativeTestJSON-629703310-project] Request method failure captured: Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/images/f2f3b6fa-29b2-4df8-9e88-f3a2b90baf4b/metadata HTTP/1.1 Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO36jN0OQqMDGBL3q2b2b2sF6BSskOVfB1u6zA1MhohNMA7daKWJzlUYktaTVSCTkkzQBO2DCZ90r4Unk6gj8vc2XH-phA-tbokZv8JpLLbm4KQ6HP49UI01JjIs_UF3KTu9Xc86fyB8KVHrJmV9rsxQbRXwki4egReQhIpQMXVO52Y Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: d00fdea8d5904c159056f45061e065ee Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-629703310 Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d00fdea8d5904c159056f45061e065ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d00fdea8d5904c159056f45061e065ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d00fdea8d5904c159056f45061e065ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d00fdea8d5904c159056f45061e065ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-629703310 Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: d00fdea8d5904c159056f45061e065ee Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-629703310 Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ImagesMetadataNegativeTestJSON-629703310-project Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 625efde54cb74e3cb4879333d41835d9 Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-629703310-project Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: exception: Image not found. Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'image_id': 'f2f3b6fa-29b2-4df8-9e88-f3a2b90baf4b'} Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f2f3b6fa-29b2-4df8-9e88-f3a2b90baf4b Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 05 02:37:47.169541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f2f3b6fa-29b2-4df8-9e88-f3a2b90baf4b could not be found. Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e65d5b41-df69-4030-9654-1fba549674c2 tempest-ImagesMetadataNegativeTestJSON-629703310 tempest-ImagesMetadataNegativeTestJSON-629703310-project] Returning 404 to user: Image not found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e65d5b41-df69-4030-9654-1fba549674c2 tempest-ImagesMetadataNegativeTestJSON-629703310 tempest-ImagesMetadataNegativeTestJSON-629703310-project] 10.222.0.16 "GET /compute/v2.1/images/f2f3b6fa-29b2-4df8-9e88-f3a2b90baf4b/metadata" status: 404 len: 62 microversion: 2.1 time: 0.048533 Oct 05 02:37:47.173147 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1239/2515] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 5 02:37:47 2022] GET /compute/v2.1/images/f2f3b6fa-29b2-4df8-9e88-f3a2b90baf4b/metadata => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:37:47.179326 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2d95e952-6c63-4bd0-b3a8-ef7216e1d766 tempest-ImagesMetadataNegativeTestJSON-629703310 tempest-ImagesMetadataNegativeTestJSON-629703310-project] Action: 'update_all', calling method: .version_select at 0x7fcce4400820>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:47.223337 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-2d95e952-6c63-4bd0-b3a8-ef7216e1d766 tempest-ImagesMetadataNegativeTestJSON-629703310 tempest-ImagesMetadataNegativeTestJSON-629703310-project] HTTP exception thrown: Image not found. Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2d95e952-6c63-4bd0-b3a8-ef7216e1d766 tempest-ImagesMetadataNegativeTestJSON-629703310 tempest-ImagesMetadataNegativeTestJSON-629703310-project] Request method failure captured: Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: request: PUT /compute/v2.1/images/cb057edf-cad9-4c18-a80d-d6c2f34ec9e7/metadata HTTP/1.1 Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 57 Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO36jN0OQqMDGBL3q2b2b2sF6BSskOVfB1u6zA1MhohNMA7daKWJzlUYktaTVSCTkkzQBO2DCZ90r4Unk6gj8vc2XH-phA-tbokZv8JpLLbm4KQ6HP49UI01JjIs_UF3KTu9Xc86fyB8KVHrJmV9rsxQbRXwki4egReQhIpQMXVO52Y Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: d00fdea8d5904c159056f45061e065ee Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-629703310 Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d00fdea8d5904c159056f45061e065ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d00fdea8d5904c159056f45061e065ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d00fdea8d5904c159056f45061e065ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d00fdea8d5904c159056f45061e065ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-629703310 Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: d00fdea8d5904c159056f45061e065ee Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-629703310 Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ImagesMetadataNegativeTestJSON-629703310-project Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 625efde54cb74e3cb4879333d41835d9 Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-629703310-project Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: exception: Image not found. Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'image_id': 'cb057edf-cad9-4c18-a80d-d6c2f34ec9e7', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID cb057edf-cad9-4c18-a80d-d6c2f34ec9e7 Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 05 02:37:47.225778 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cb057edf-cad9-4c18-a80d-d6c2f34ec9e7 could not be found. Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2d95e952-6c63-4bd0-b3a8-ef7216e1d766 tempest-ImagesMetadataNegativeTestJSON-629703310 tempest-ImagesMetadataNegativeTestJSON-629703310-project] Returning 404 to user: Image not found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:37:47.231393 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2d95e952-6c63-4bd0-b3a8-ef7216e1d766 tempest-ImagesMetadataNegativeTestJSON-629703310 tempest-ImagesMetadataNegativeTestJSON-629703310-project] 10.222.0.16 "PUT /compute/v2.1/images/cb057edf-cad9-4c18-a80d-d6c2f34ec9e7/metadata" status: 404 len: 62 microversion: 2.1 time: 0.053967 Oct 05 02:37:47.234725 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1277/2516] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 5 02:37:47 2022] PUT /compute/v2.1/images/cb057edf-cad9-4c18-a80d-d6c2f34ec9e7/metadata => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:37:47.239372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-83938f90-707e-497a-a751-ffe047986bf5 tempest-ImagesMetadataNegativeTestJSON-629703310 tempest-ImagesMetadataNegativeTestJSON-629703310-project] Action: 'update', calling method: .version_select at 0x7fcce812cd30>, body: {"meta": {"os_distro": "alt"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:47.285931 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-83938f90-707e-497a-a751-ffe047986bf5 tempest-ImagesMetadataNegativeTestJSON-629703310 tempest-ImagesMetadataNegativeTestJSON-629703310-project] HTTP exception thrown: Image not found. Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-83938f90-707e-497a-a751-ffe047986bf5 tempest-ImagesMetadataNegativeTestJSON-629703310 tempest-ImagesMetadataNegativeTestJSON-629703310-project] Request method failure captured: Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: request: PUT /compute/v2.1/images/3a3eded9-bc08-4a7f-ac48-1cace958d527/metadata/os_distro HTTP/1.1 Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 30 Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO36jN0OQqMDGBL3q2b2b2sF6BSskOVfB1u6zA1MhohNMA7daKWJzlUYktaTVSCTkkzQBO2DCZ90r4Unk6gj8vc2XH-phA-tbokZv8JpLLbm4KQ6HP49UI01JjIs_UF3KTu9Xc86fyB8KVHrJmV9rsxQbRXwki4egReQhIpQMXVO52Y Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: d00fdea8d5904c159056f45061e065ee Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-629703310 Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d00fdea8d5904c159056f45061e065ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d00fdea8d5904c159056f45061e065ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d00fdea8d5904c159056f45061e065ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d00fdea8d5904c159056f45061e065ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-629703310 Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: d00fdea8d5904c159056f45061e065ee Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-629703310 Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ImagesMetadataNegativeTestJSON-629703310-project Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 625efde54cb74e3cb4879333d41835d9 Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-629703310-project Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: {"meta": {"os_distro": "alt"}} Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: exception: Image not found. Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'image_id': '3a3eded9-bc08-4a7f-ac48-1cace958d527', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3a3eded9-bc08-4a7f-ac48-1cace958d527 Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 05 02:37:47.288264 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3a3eded9-bc08-4a7f-ac48-1cace958d527 could not be found. Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.295266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-83938f90-707e-497a-a751-ffe047986bf5 tempest-ImagesMetadataNegativeTestJSON-629703310 tempest-ImagesMetadataNegativeTestJSON-629703310-project] Returning 404 to user: Image not found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:37:47.299600 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-83938f90-707e-497a-a751-ffe047986bf5 tempest-ImagesMetadataNegativeTestJSON-629703310 tempest-ImagesMetadataNegativeTestJSON-629703310-project] 10.222.0.16 "PUT /compute/v2.1/images/3a3eded9-bc08-4a7f-ac48-1cace958d527/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.055350 Oct 05 02:37:47.299600 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1240/2517] 10.222.0.16 () {60 vars in 1310 bytes} [Wed Oct 5 02:37:47 2022] PUT /compute/v2.1/images/3a3eded9-bc08-4a7f-ac48-1cace958d527/metadata/os_distro => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 05 02:37:47.310482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ba5c2b06-f3af-4be9-8ca7-f8bc17d0e83d tempest-ImagesMetadataNegativeTestJSON-629703310 tempest-ImagesMetadataNegativeTestJSON-629703310-project] Action: 'create', calling method: .version_select at 0x7fcce8171670>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:47.345210 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-ba5c2b06-f3af-4be9-8ca7-f8bc17d0e83d tempest-ImagesMetadataNegativeTestJSON-629703310 tempest-ImagesMetadataNegativeTestJSON-629703310-project] HTTP exception thrown: Image not found. Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ba5c2b06-f3af-4be9-8ca7-f8bc17d0e83d tempest-ImagesMetadataNegativeTestJSON-629703310 tempest-ImagesMetadataNegativeTestJSON-629703310-project] Request method failure captured: Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/images/da3d5cdf-cbc0-402f-83d0-41649b878872/metadata HTTP/1.1 Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 57 Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO36jN0OQqMDGBL3q2b2b2sF6BSskOVfB1u6zA1MhohNMA7daKWJzlUYktaTVSCTkkzQBO2DCZ90r4Unk6gj8vc2XH-phA-tbokZv8JpLLbm4KQ6HP49UI01JjIs_UF3KTu9Xc86fyB8KVHrJmV9rsxQbRXwki4egReQhIpQMXVO52Y Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: d00fdea8d5904c159056f45061e065ee Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-629703310 Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d00fdea8d5904c159056f45061e065ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d00fdea8d5904c159056f45061e065ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d00fdea8d5904c159056f45061e065ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d00fdea8d5904c159056f45061e065ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-629703310 Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: d00fdea8d5904c159056f45061e065ee Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-629703310 Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ImagesMetadataNegativeTestJSON-629703310-project Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 625efde54cb74e3cb4879333d41835d9 Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-629703310-project Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: exception: Image not found. Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'image_id': 'da3d5cdf-cbc0-402f-83d0-41649b878872', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID da3d5cdf-cbc0-402f-83d0-41649b878872 Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 05 02:37:47.348615 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image da3d5cdf-cbc0-402f-83d0-41649b878872 could not be found. Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 02:37:47.355047 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:37:47.362729 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ba5c2b06-f3af-4be9-8ca7-f8bc17d0e83d tempest-ImagesMetadataNegativeTestJSON-629703310 tempest-ImagesMetadataNegativeTestJSON-629703310-project] Returning 404 to user: Image not found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:37:47.363848 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ba5c2b06-f3af-4be9-8ca7-f8bc17d0e83d tempest-ImagesMetadataNegativeTestJSON-629703310 tempest-ImagesMetadataNegativeTestJSON-629703310-project] 10.222.0.16 "POST /compute/v2.1/images/da3d5cdf-cbc0-402f-83d0-41649b878872/metadata" status: 404 len: 62 microversion: 2.1 time: 0.058914 Oct 05 02:37:47.365066 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1278/2518] 10.222.0.16 () {60 vars in 1281 bytes} [Wed Oct 5 02:37:47 2022] POST /compute/v2.1/images/da3d5cdf-cbc0-402f-83d0-41649b878872/metadata => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:37:47.517774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a7b6e1aa-df84-48a1-8fb8-fe006ad95f92 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:47.518927 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a7b6e1aa-df84-48a1-8fb8-fe006ad95f92 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 7dfe1782-6765-4efc-8576-1d138be154ec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:47.530862 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a7b6e1aa-df84-48a1-8fb8-fe006ad95f92 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:47.533117 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a7b6e1aa-df84-48a1-8fb8-fe006ad95f92 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:47.535518 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a7b6e1aa-df84-48a1-8fb8-fe006ad95f92 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:47.536453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a7b6e1aa-df84-48a1-8fb8-fe006ad95f92 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:47.537322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a7b6e1aa-df84-48a1-8fb8-fe006ad95f92 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:47.540493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a7b6e1aa-df84-48a1-8fb8-fe006ad95f92 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:47.582636 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2ccf4457-07f4-4ea8-8bcc-00cbe9797ba5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:47.583485 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2ccf4457-07f4-4ea8-8bcc-00cbe9797ba5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 6b01f092-c99b-4a47-bdcb-3b6bcdeb0323] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:47.603765 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ccf4457-07f4-4ea8-8bcc-00cbe9797ba5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:47.604581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ccf4457-07f4-4ea8-8bcc-00cbe9797ba5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:47.605320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ccf4457-07f4-4ea8-8bcc-00cbe9797ba5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:47.606240 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ccf4457-07f4-4ea8-8bcc-00cbe9797ba5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:47.610265 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ccf4457-07f4-4ea8-8bcc-00cbe9797ba5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:47.611969 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ccf4457-07f4-4ea8-8bcc-00cbe9797ba5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:48.284505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a7b6e1aa-df84-48a1-8fb8-fe006ad95f92 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:48.293808 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a7b6e1aa-df84-48a1-8fb8-fe006ad95f92 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec" status: 200 len: 1677 microversion: 2.1 time: 0.781970 Oct 05 02:37:48.310341 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1241/2519] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:47 2022] GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec => generated 1677 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:48.387625 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2ccf4457-07f4-4ea8-8bcc-00cbe9797ba5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:48.397195 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2ccf4457-07f4-4ea8-8bcc-00cbe9797ba5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323" status: 200 len: 1316 microversion: 2.1 time: 0.818965 Oct 05 02:37:48.410690 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1279/2520] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:47 2022] GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323 => generated 1316 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:37:49.328046 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-768d36c5-9b62-47c0-b7a1-49d3b5c66833 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:49.328674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-768d36c5-9b62-47c0-b7a1-49d3b5c66833 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 7dfe1782-6765-4efc-8576-1d138be154ec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:49.345325 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-768d36c5-9b62-47c0-b7a1-49d3b5c66833 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:49.352254 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-768d36c5-9b62-47c0-b7a1-49d3b5c66833 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:49.359777 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-768d36c5-9b62-47c0-b7a1-49d3b5c66833 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:49.361933 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-768d36c5-9b62-47c0-b7a1-49d3b5c66833 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:49.366596 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-768d36c5-9b62-47c0-b7a1-49d3b5c66833 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:49.371501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-768d36c5-9b62-47c0-b7a1-49d3b5c66833 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:49.452085 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-758576fa-c1a6-43eb-9329-b2fbbaada8f5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1444429063", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:49.578919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-758576fa-c1a6-43eb-9329-b2fbbaada8f5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] validate_networks() for None {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:37:50.265692 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=4 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:50.298356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:50.553152 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-768d36c5-9b62-47c0-b7a1-49d3b5c66833 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:50.567077 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-768d36c5-9b62-47c0-b7a1-49d3b5c66833 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec" status: 200 len: 1656 microversion: 2.1 time: 1.241738 Oct 05 02:37:50.567692 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1280/2521] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:49 2022] GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec => generated 1656 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:50.591878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6ba308c9-4d8c-492c-a262-98a9596871ab tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:50.592528 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6ba308c9-4d8c-492c-a262-98a9596871ab tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 6b01f092-c99b-4a47-bdcb-3b6bcdeb0323] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:50.599557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ba308c9-4d8c-492c-a262-98a9596871ab tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:50.600056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ba308c9-4d8c-492c-a262-98a9596871ab tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:50.600497 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ba308c9-4d8c-492c-a262-98a9596871ab tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:50.601241 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ba308c9-4d8c-492c-a262-98a9596871ab tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:50.602598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ba308c9-4d8c-492c-a262-98a9596871ab tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:50.603497 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ba308c9-4d8c-492c-a262-98a9596871ab tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:50.997297 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-758576fa-c1a6-43eb-9329-b2fbbaada8f5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:37:50.997862 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-758576fa-c1a6-43eb-9329-b2fbbaada8f5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:37:50.998205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-758576fa-c1a6-43eb-9329-b2fbbaada8f5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:37:50.998619 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-758576fa-c1a6-43eb-9329-b2fbbaada8f5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:37:51.001263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-758576fa-c1a6-43eb-9329-b2fbbaada8f5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:37:51.009938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=70 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:51.034358 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-758576fa-c1a6-43eb-9329-b2fbbaada8f5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:51.035010 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-758576fa-c1a6-43eb-9329-b2fbbaada8f5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:51.035470 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-758576fa-c1a6-43eb-9329-b2fbbaada8f5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:51.036269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-758576fa-c1a6-43eb-9329-b2fbbaada8f5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:51.039847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-758576fa-c1a6-43eb-9329-b2fbbaada8f5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:51.044643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-758576fa-c1a6-43eb-9329-b2fbbaada8f5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:51.099192 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-758576fa-c1a6-43eb-9329-b2fbbaada8f5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Getting quotas for project 446a33968038476fbc98fc0b6b1795c0. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:37:51.124565 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-758576fa-c1a6-43eb-9329-b2fbbaada8f5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Getting quotas for user 1b4b5f0c43074932a8963727adfee38a and project 446a33968038476fbc98fc0b6b1795c0. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:37:51.146870 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6ba308c9-4d8c-492c-a262-98a9596871ab tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:51.158750 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6ba308c9-4d8c-492c-a262-98a9596871ab tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323" status: 200 len: 1316 microversion: 2.1 time: 0.576195 Oct 05 02:37:51.163082 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1281/2522] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:50 2022] GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323 => generated 1316 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:51.180608 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-def7f0d6-37dd-4aed-a47b-0c928c262f49 req-9a885f49-7c42-4878-9b78-3a8f11a904fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dfe1782-6765-4efc-8576-1d138be154ec", "name": "network-vif-deleted", "tag": "e3274f93-c8fd-40a4-bb23-9d84e0b02391"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:51.191841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-758576fa-c1a6-43eb-9329-b2fbbaada8f5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:37:51.197690 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-758576fa-c1a6-43eb-9329-b2fbbaada8f5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:37:51.243699 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-def7f0d6-37dd-4aed-a47b-0c928c262f49 req-9a885f49-7c42-4878-9b78-3a8f11a904fd service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:51.244548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-def7f0d6-37dd-4aed-a47b-0c928c262f49 req-9a885f49-7c42-4878-9b78-3a8f11a904fd service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:51.245190 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-def7f0d6-37dd-4aed-a47b-0c928c262f49 req-9a885f49-7c42-4878-9b78-3a8f11a904fd service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:51.333699 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-def7f0d6-37dd-4aed-a47b-0c928c262f49 req-9a885f49-7c42-4878-9b78-3a8f11a904fd service nova] Creating event network-vif-deleted:e3274f93-c8fd-40a4-bb23-9d84e0b02391 for instance 7dfe1782-6765-4efc-8576-1d138be154ec on n-h1-858272-3 Oct 05 02:37:51.382142 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-def7f0d6-37dd-4aed-a47b-0c928c262f49 req-9a885f49-7c42-4878-9b78-3a8f11a904fd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197626 Oct 05 02:37:51.383896 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1282/2523] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:37:51.394977 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-758576fa-c1a6-43eb-9329-b2fbbaada8f5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.601413 Oct 05 02:37:51.409868 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bfab1d02-8813-478f-842b-eebcb391bae5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:51.410874 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bfab1d02-8813-478f-842b-eebcb391bae5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:51.411360 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1242/2524] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:37:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:37:51.598122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-39354e9f-7c79-481d-8c1d-b94b06e34a25 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:51.598764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-39354e9f-7c79-481d-8c1d-b94b06e34a25 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 7dfe1782-6765-4efc-8576-1d138be154ec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:51.618094 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-39354e9f-7c79-481d-8c1d-b94b06e34a25 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:51.618919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-39354e9f-7c79-481d-8c1d-b94b06e34a25 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:51.619370 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-39354e9f-7c79-481d-8c1d-b94b06e34a25 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:51.621461 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-39354e9f-7c79-481d-8c1d-b94b06e34a25 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:51.621953 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-39354e9f-7c79-481d-8c1d-b94b06e34a25 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:51.622395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-39354e9f-7c79-481d-8c1d-b94b06e34a25 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:51.749170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bfab1d02-8813-478f-842b-eebcb391bae5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:51.759932 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bfab1d02-8813-478f-842b-eebcb391bae5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1213 microversion: 2.1 time: 0.353762 Oct 05 02:37:51.760975 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1283/2525] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:51 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1213 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:52.186157 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7d658a6f-fe46-49eb-99a6-a11001871bc1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:52.186391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7d658a6f-fe46-49eb-99a6-a11001871bc1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 6b01f092-c99b-4a47-bdcb-3b6bcdeb0323] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:52.219568 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7d658a6f-fe46-49eb-99a6-a11001871bc1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:52.220076 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7d658a6f-fe46-49eb-99a6-a11001871bc1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:52.223230 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7d658a6f-fe46-49eb-99a6-a11001871bc1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:52.223950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7d658a6f-fe46-49eb-99a6-a11001871bc1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:52.224418 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7d658a6f-fe46-49eb-99a6-a11001871bc1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:52.224849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7d658a6f-fe46-49eb-99a6-a11001871bc1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:52.292842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-39354e9f-7c79-481d-8c1d-b94b06e34a25 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:52.309285 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-39354e9f-7c79-481d-8c1d-b94b06e34a25 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec" status: 200 len: 1497 microversion: 2.1 time: 0.713763 Oct 05 02:37:52.312001 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1243/2526] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:51 2022] GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec => generated 1497 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:37:52.714955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-ff9a1a6e-1796-4502-8cd7-a7abe89d4a49 req-d03261a2-6fe1-46a5-ae5b-7a9029755a05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b01f092-c99b-4a47-bdcb-3b6bcdeb0323", "name": "network-vif-plugged", "status": "completed", "tag": "6e942f65-fdd7-4e15-8f96-499f27856283"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:52.741179 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7d658a6f-fe46-49eb-99a6-a11001871bc1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:52.760850 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7d658a6f-fe46-49eb-99a6-a11001871bc1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323" status: 200 len: 1316 microversion: 2.1 time: 0.577494 Oct 05 02:37:52.763377 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1284/2527] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:52 2022] GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323 => generated 1316 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:37:52.775503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ff9a1a6e-1796-4502-8cd7-a7abe89d4a49 req-d03261a2-6fe1-46a5-ae5b-7a9029755a05 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:52.779394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ff9a1a6e-1796-4502-8cd7-a7abe89d4a49 req-d03261a2-6fe1-46a5-ae5b-7a9029755a05 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:52.780732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ff9a1a6e-1796-4502-8cd7-a7abe89d4a49 req-d03261a2-6fe1-46a5-ae5b-7a9029755a05 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:52.825918 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-ff9a1a6e-1796-4502-8cd7-a7abe89d4a49 req-d03261a2-6fe1-46a5-ae5b-7a9029755a05 service nova] Creating event network-vif-plugged:6e942f65-fdd7-4e15-8f96-499f27856283 for instance 6b01f092-c99b-4a47-bdcb-3b6bcdeb0323 on n-h1-858272-3 Oct 05 02:37:52.841912 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-ff9a1a6e-1796-4502-8cd7-a7abe89d4a49 req-d03261a2-6fe1-46a5-ae5b-7a9029755a05 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132546 Oct 05 02:37:52.844072 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1244/2528] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:37:52.862000 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6ccd2735-037d-43e0-adda-e22758b9ebb3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:52.863793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6ccd2735-037d-43e0-adda-e22758b9ebb3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:52.890513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ccd2735-037d-43e0-adda-e22758b9ebb3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:52.892310 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ccd2735-037d-43e0-adda-e22758b9ebb3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:52.895493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ccd2735-037d-43e0-adda-e22758b9ebb3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:52.900173 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ccd2735-037d-43e0-adda-e22758b9ebb3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:52.903040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ccd2735-037d-43e0-adda-e22758b9ebb3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:52.904881 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ccd2735-037d-43e0-adda-e22758b9ebb3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:53.183217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6ccd2735-037d-43e0-adda-e22758b9ebb3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:53.192599 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6ccd2735-037d-43e0-adda-e22758b9ebb3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1265 microversion: 2.1 time: 0.347088 Oct 05 02:37:53.214800 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1245/2529] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:52 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1265 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:53.339058 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2fc9e05e-6b64-4e55-95cf-5e20936ab6c6 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:53.340568 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2fc9e05e-6b64-4e55-95cf-5e20936ab6c6 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 7dfe1782-6765-4efc-8576-1d138be154ec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:53.359591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fc9e05e-6b64-4e55-95cf-5e20936ab6c6 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:53.364859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fc9e05e-6b64-4e55-95cf-5e20936ab6c6 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:53.369986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fc9e05e-6b64-4e55-95cf-5e20936ab6c6 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:53.371291 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fc9e05e-6b64-4e55-95cf-5e20936ab6c6 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:53.373425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fc9e05e-6b64-4e55-95cf-5e20936ab6c6 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:53.374290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fc9e05e-6b64-4e55-95cf-5e20936ab6c6 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:53.385575 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:53.474619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8cc9069d-8ace-4751-a55e-b6b3ea358c26 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-366517571", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:53.489712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fc9e05e-6b64-4e55-95cf-5e20936ab6c6 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:53.496175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fc9e05e-6b64-4e55-95cf-5e20936ab6c6 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:53.497230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fc9e05e-6b64-4e55-95cf-5e20936ab6c6 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:53.500245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-2fc9e05e-6b64-4e55-95cf-5e20936ab6c6 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lazy-loading 'fault' on Instance uuid 7dfe1782-6765-4efc-8576-1d138be154ec {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:37:53.630342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-8cc9069d-8ace-4751-a55e-b6b3ea358c26 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] validate_networks() for None {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:37:53.782959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2fc9e05e-6b64-4e55-95cf-5e20936ab6c6 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e5ffbccdbec4a4bb21a3e48c1f7beaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3fd0eb45ed4080af876031348f367a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:53.794411 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2fc9e05e-6b64-4e55-95cf-5e20936ab6c6 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec" status: 200 len: 1303 microversion: 2.1 time: 0.460855 Oct 05 02:37:53.814410 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1246/2530] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:53 2022] GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec => generated 1303 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:53.824594 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-6443285c-bb04-4c9e-8679-1f6e0461ea5e req-26812289-4138-445d-ae04-158c29e9e74d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dfe1782-6765-4efc-8576-1d138be154ec", "name": "network-vif-deleted", "tag": "2f185a5a-975b-4f18-818c-671346a1c21b"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:53.846268 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6443285c-bb04-4c9e-8679-1f6e0461ea5e req-26812289-4138-445d-ae04-158c29e9e74d service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:53.849815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6443285c-bb04-4c9e-8679-1f6e0461ea5e req-26812289-4138-445d-ae04-158c29e9e74d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:53.850408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6443285c-bb04-4c9e-8679-1f6e0461ea5e req-26812289-4138-445d-ae04-158c29e9e74d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:53.882932 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-6443285c-bb04-4c9e-8679-1f6e0461ea5e req-26812289-4138-445d-ae04-158c29e9e74d service nova] Creating event network-vif-deleted:2f185a5a-975b-4f18-818c-671346a1c21b for instance 7dfe1782-6765-4efc-8576-1d138be154ec on n-h1-858272-3 Oct 05 02:37:53.893698 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-6443285c-bb04-4c9e-8679-1f6e0461ea5e req-26812289-4138-445d-ae04-158c29e9e74d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091043 Oct 05 02:37:53.894595 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1247/2531] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:37:53.907708 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d48f110f-a2a6-4bec-be1f-3cf5c8dbb22b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:53.910954 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d48f110f-a2a6-4bec-be1f-3cf5c8dbb22b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 6b01f092-c99b-4a47-bdcb-3b6bcdeb0323] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:53.923541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d48f110f-a2a6-4bec-be1f-3cf5c8dbb22b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:53.933775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d48f110f-a2a6-4bec-be1f-3cf5c8dbb22b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:53.934378 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d48f110f-a2a6-4bec-be1f-3cf5c8dbb22b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:53.935299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d48f110f-a2a6-4bec-be1f-3cf5c8dbb22b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:53.935867 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d48f110f-a2a6-4bec-be1f-3cf5c8dbb22b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:53.936427 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d48f110f-a2a6-4bec-be1f-3cf5c8dbb22b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:54.472018 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-8cc9069d-8ace-4751-a55e-b6b3ea358c26 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:37:54.472525 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-8cc9069d-8ace-4751-a55e-b6b3ea358c26 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:37:54.473147 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-8cc9069d-8ace-4751-a55e-b6b3ea358c26 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:37:54.473561 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-8cc9069d-8ace-4751-a55e-b6b3ea358c26 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:37:54.474398 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-8cc9069d-8ace-4751-a55e-b6b3ea358c26 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:37:54.499232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8cc9069d-8ace-4751-a55e-b6b3ea358c26 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:54.501537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8cc9069d-8ace-4751-a55e-b6b3ea358c26 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:54.502185 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8cc9069d-8ace-4751-a55e-b6b3ea358c26 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:54.504126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8cc9069d-8ace-4751-a55e-b6b3ea358c26 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:54.504912 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8cc9069d-8ace-4751-a55e-b6b3ea358c26 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:54.505668 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8cc9069d-8ace-4751-a55e-b6b3ea358c26 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:54.535276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-8cc9069d-8ace-4751-a55e-b6b3ea358c26 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Getting quotas for project be31ec89b1354d608d7de438f5cf519d. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:37:54.542263 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-8cc9069d-8ace-4751-a55e-b6b3ea358c26 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Getting quotas for user 2d55412129f24e90b1caa99b3aea8c61 and project be31ec89b1354d608d7de438f5cf519d. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:37:54.560042 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8cc9069d-8ace-4751-a55e-b6b3ea358c26 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:37:54.563686 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8cc9069d-8ace-4751-a55e-b6b3ea358c26 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] [instance: 74b1ab94-3bc0-440d-bf57-dcab444e063d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:37:54.586214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d48f110f-a2a6-4bec-be1f-3cf5c8dbb22b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:54.595411 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d48f110f-a2a6-4bec-be1f-3cf5c8dbb22b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323" status: 200 len: 1316 microversion: 2.1 time: 0.694733 Oct 05 02:37:54.596005 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1248/2532] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:53 2022] GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323 => generated 1316 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:54.603354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d808990c-8f6e-45bb-bb55-2382457621f3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:54.608808 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d808990c-8f6e-45bb-bb55-2382457621f3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:54.624064 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d808990c-8f6e-45bb-bb55-2382457621f3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:54.624808 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d808990c-8f6e-45bb-bb55-2382457621f3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:54.625971 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d808990c-8f6e-45bb-bb55-2382457621f3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:54.626863 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d808990c-8f6e-45bb-bb55-2382457621f3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:54.627500 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d808990c-8f6e-45bb-bb55-2382457621f3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:54.628089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d808990c-8f6e-45bb-bb55-2382457621f3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:54.659434 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8cc9069d-8ace-4751-a55e-b6b3ea358c26 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.893298 Oct 05 02:37:54.661366 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1285/2533] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:37:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:37:54.684132 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-346c24f9-ba43-4728-ab24-ff0ed94fd451 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:54.685624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-346c24f9-ba43-4728-ab24-ff0ed94fd451 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] [instance: 74b1ab94-3bc0-440d-bf57-dcab444e063d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:54.923421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d808990c-8f6e-45bb-bb55-2382457621f3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:54.938826 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d808990c-8f6e-45bb-bb55-2382457621f3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1271 microversion: 2.1 time: 0.340987 Oct 05 02:37:54.946417 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1249/2534] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:54 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1271 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:54.948863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-346c24f9-ba43-4728-ab24-ff0ed94fd451 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d55412129f24e90b1caa99b3aea8c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be31ec89b1354d608d7de438f5cf519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:54.962699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-29699e52-a3e0-4f2c-a876-76c8f8bd4b6b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:54.963300 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-29699e52-a3e0-4f2c-a876-76c8f8bd4b6b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 7dfe1782-6765-4efc-8576-1d138be154ec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:54.965841 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-346c24f9-ba43-4728-ab24-ff0ed94fd451 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d" status: 200 len: 1216 microversion: 2.1 time: 0.297091 Oct 05 02:37:54.970459 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1286/2535] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:54 2022] GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d => generated 1216 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:54.979609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-29699e52-a3e0-4f2c-a876-76c8f8bd4b6b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:54.995455 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-29699e52-a3e0-4f2c-a876-76c8f8bd4b6b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:54.996040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-29699e52-a3e0-4f2c-a876-76c8f8bd4b6b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:55.010948 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-29699e52-a3e0-4f2c-a876-76c8f8bd4b6b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:55.014361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-29699e52-a3e0-4f2c-a876-76c8f8bd4b6b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:55.017901 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-29699e52-a3e0-4f2c-a876-76c8f8bd4b6b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:55.074902 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-29699e52-a3e0-4f2c-a876-76c8f8bd4b6b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] HTTP exception thrown: Instance 7dfe1782-6765-4efc-8576-1d138be154ec could not be found. Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-29699e52-a3e0-4f2c-a876-76c8f8bd4b6b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Request method failure captured: Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec HTTP/1.1 Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO2A94pn1unf7Tec3jJOeL-pCSWjwtu2x-XR2SK5jNwu0xU-WXF4dynC1BdXxsNVnxUewK47XoikuKSvxaXSOdytbuzIEz2yN2g88rujbBE25tHGvxQQKf_mg6cqRei6SIdDyxuPi29B0yiubBblKvoFzf61k7-BMs2AcZU0uU9K3jM Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: fc3fd0eb45ed4080af876031348f367a Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersTestMultiNic-1996318355 Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fc3fd0eb45ed4080af876031348f367a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fc3fd0eb45ed4080af876031348f367a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fc3fd0eb45ed4080af876031348f367a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fc3fd0eb45ed4080af876031348f367a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersTestMultiNic-1996318355 Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: fc3fd0eb45ed4080af876031348f367a Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersTestMultiNic-1996318355 Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersTestMultiNic-1996318355-project Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 9e5ffbccdbec4a4bb21a3e48c1f7beaf Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersTestMultiNic-1996318355-project Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 7dfe1782-6765-4efc-8576-1d138be154ec could not be found. Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '7dfe1782-6765-4efc-8576-1d138be154ec'} Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dfe1782-6765-4efc-8576-1d138be154ec could not be found. Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dfe1782-6765-4efc-8576-1d138be154ec could not be found. Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:37:55.080949 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:55.085562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:37:55.085562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:37:55.085562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:37:55.085562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:37:55.085562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:37:55.085562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dfe1782-6765-4efc-8576-1d138be154ec could not be found. Oct 05 02:37:55.085562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:37:55.085562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-29699e52-a3e0-4f2c-a876-76c8f8bd4b6b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Returning 404 to user: Instance 7dfe1782-6765-4efc-8576-1d138be154ec could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:37:55.088605 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-29699e52-a3e0-4f2c-a876-76c8f8bd4b6b tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec" status: 404 len: 111 microversion: 2.1 time: 0.139388 Oct 05 02:37:55.090586 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1250/2536] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:54 2022] GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:37:55.623750 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-66df924b-2e4e-4705-96ce-c1634d89124e tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:55.624402 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-66df924b-2e4e-4705-96ce-c1634d89124e tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 6b01f092-c99b-4a47-bdcb-3b6bcdeb0323] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:55.634690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-66df924b-2e4e-4705-96ce-c1634d89124e tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:55.639279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-66df924b-2e4e-4705-96ce-c1634d89124e tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:55.640967 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-66df924b-2e4e-4705-96ce-c1634d89124e tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:55.640967 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-66df924b-2e4e-4705-96ce-c1634d89124e tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:55.645466 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-66df924b-2e4e-4705-96ce-c1634d89124e tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:55.646054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-66df924b-2e4e-4705-96ce-c1634d89124e tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:55.970156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-197aa557-ddef-47d7-a687-6085c6090f5c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:55.970807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-197aa557-ddef-47d7-a687-6085c6090f5c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:55.995600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-197aa557-ddef-47d7-a687-6085c6090f5c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:55.996123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-197aa557-ddef-47d7-a687-6085c6090f5c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:55.996574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-197aa557-ddef-47d7-a687-6085c6090f5c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:55.997540 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-197aa557-ddef-47d7-a687-6085c6090f5c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:55.998002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-197aa557-ddef-47d7-a687-6085c6090f5c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:55.998429 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-197aa557-ddef-47d7-a687-6085c6090f5c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:56.379054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-66df924b-2e4e-4705-96ce-c1634d89124e tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:56.388994 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-66df924b-2e4e-4705-96ce-c1634d89124e tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323" status: 200 len: 1466 microversion: 2.1 time: 0.769193 Oct 05 02:37:56.393259 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1287/2537] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:55 2022] GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323 => generated 1466 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:56.416057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c2ea5169-ec4a-452c-abaa-812abc32326a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:56.418428 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c2ea5169-ec4a-452c-abaa-812abc32326a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] [instance: 74b1ab94-3bc0-440d-bf57-dcab444e063d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:56.437846 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2ea5169-ec4a-452c-abaa-812abc32326a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:56.438898 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2ea5169-ec4a-452c-abaa-812abc32326a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:56.439492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2ea5169-ec4a-452c-abaa-812abc32326a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:56.440432 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2ea5169-ec4a-452c-abaa-812abc32326a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:56.441437 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2ea5169-ec4a-452c-abaa-812abc32326a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:56.442596 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2ea5169-ec4a-452c-abaa-812abc32326a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:56.451886 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:57.159802 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c2ea5169-ec4a-452c-abaa-812abc32326a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d55412129f24e90b1caa99b3aea8c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be31ec89b1354d608d7de438f5cf519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:57.169172 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c2ea5169-ec4a-452c-abaa-812abc32326a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d" status: 200 len: 1268 microversion: 2.1 time: 0.773049 Oct 05 02:37:57.173597 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1288/2538] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:56 2022] GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d => generated 1268 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:57.577743 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-197aa557-ddef-47d7-a687-6085c6090f5c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:57.585751 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-197aa557-ddef-47d7-a687-6085c6090f5c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1313 microversion: 2.1 time: 1.621497 Oct 05 02:37:57.589230 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1251/2539] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:55 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1313 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:57.910940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-02570eb7-5fbf-4402-91ef-26a32af54dfd tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:57.912770 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-02570eb7-5fbf-4402-91ef-26a32af54dfd tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] [instance: 6b01f092-c99b-4a47-bdcb-3b6bcdeb0323] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:57.940413 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02570eb7-5fbf-4402-91ef-26a32af54dfd tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:57.942470 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02570eb7-5fbf-4402-91ef-26a32af54dfd tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:57.943206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02570eb7-5fbf-4402-91ef-26a32af54dfd tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:57.944157 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02570eb7-5fbf-4402-91ef-26a32af54dfd tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:57.946640 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02570eb7-5fbf-4402-91ef-26a32af54dfd tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:57.947312 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02570eb7-5fbf-4402-91ef-26a32af54dfd tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:58.095312 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-71fca84f-3c8c-4258-9d58-4fe0ecb46bcb tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Action: 'create', calling method: .version_select at 0x7fccdf5a61f0>, body: {"keypair": {"name": "tempest-keypair-654692082", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMh2CYrmLr1E4WaYUKlkIuehNyADV0sHynY+v5JGRQsh/U+3uYeJuGjTGzsvlrh9zquX8rUjOXwMN3vrBjz3Z91gJO1E415jGC0l1aYsbsina0DN+raetxM2ktbUmv18A=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:58.142513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-71fca84f-3c8c-4258-9d58-4fe0ecb46bcb tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Getting quotas for project d69def5e64d945428d420e737fecd987. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:37:58.161892 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-71fca84f-3c8c-4258-9d58-4fe0ecb46bcb tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Getting quotas for user 110ebcc38ef34dfea40fe14ab2ad1b3d and project d69def5e64d945428d420e737fecd987. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:37:58.307343 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-71fca84f-3c8c-4258-9d58-4fe0ecb46bcb tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.710644 Oct 05 02:37:58.312385 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1252/2540] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 02:37:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:37:58.345475 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-257d396f-756d-467b-b54b-ec0566b2d9e5 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:58.347113 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-257d396f-756d-467b-b54b-ec0566b2d9e5 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] [instance: 74b1ab94-3bc0-440d-bf57-dcab444e063d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:58.373012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-257d396f-756d-467b-b54b-ec0566b2d9e5 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:58.373521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-257d396f-756d-467b-b54b-ec0566b2d9e5 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:58.373960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-257d396f-756d-467b-b54b-ec0566b2d9e5 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:58.375699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-257d396f-756d-467b-b54b-ec0566b2d9e5 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:58.376328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-257d396f-756d-467b-b54b-ec0566b2d9e5 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:58.376761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-257d396f-756d-467b-b54b-ec0566b2d9e5 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:58.682313 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-257d396f-756d-467b-b54b-ec0566b2d9e5 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d55412129f24e90b1caa99b3aea8c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be31ec89b1354d608d7de438f5cf519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:58.691622 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-257d396f-756d-467b-b54b-ec0566b2d9e5 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d" status: 200 len: 1274 microversion: 2.1 time: 0.378013 Oct 05 02:37:58.702199 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1253/2541] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:58 2022] GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d => generated 1274 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:58.715340 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-d26b5f92-817a-4241-978e-6821ce9acd06 req-60f36011-086a-4be3-8b9c-dcd9d30a180c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac919870-2512-4424-bea6-b003534ce678", "tag": "210caa7d-298b-408f-a376-b6a2a6f6ce62"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:58.743353 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d26b5f92-817a-4241-978e-6821ce9acd06 req-60f36011-086a-4be3-8b9c-dcd9d30a180c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:58.746897 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d26b5f92-817a-4241-978e-6821ce9acd06 req-60f36011-086a-4be3-8b9c-dcd9d30a180c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:58.748410 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d26b5f92-817a-4241-978e-6821ce9acd06 req-60f36011-086a-4be3-8b9c-dcd9d30a180c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:58.771102 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-d26b5f92-817a-4241-978e-6821ce9acd06 req-60f36011-086a-4be3-8b9c-dcd9d30a180c service nova] Creating event network-changed:210caa7d-298b-408f-a376-b6a2a6f6ce62 for instance ac919870-2512-4424-bea6-b003534ce678 on n-h2-858272-3 Oct 05 02:37:58.775342 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-02570eb7-5fbf-4402-91ef-26a32af54dfd tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323" status: 200 len: 1617 microversion: 2.1 time: 1.600209 Oct 05 02:37:58.775932 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1289/2542] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:57 2022] GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323 => generated 1617 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:58.778855 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-d26b5f92-817a-4241-978e-6821ce9acd06 req-60f36011-086a-4be3-8b9c-dcd9d30a180c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072473 Oct 05 02:37:58.779939 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1254/2543] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:37:58.802339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c0cada87-9a26-4fe1-ba99-640b97f3f580 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Action: 'create', calling method: .version_select at 0x7fcce41df790>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-243644076", "policies": ["affinity"]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:58.809336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e7709a23-20a8-4308-9f25-4d863df27463 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:58.810602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e7709a23-20a8-4308-9f25-4d863df27463 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:58.818401 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7709a23-20a8-4308-9f25-4d863df27463 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:58.821113 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7709a23-20a8-4308-9f25-4d863df27463 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:58.821949 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7709a23-20a8-4308-9f25-4d863df27463 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:58.822999 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7709a23-20a8-4308-9f25-4d863df27463 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:58.823738 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7709a23-20a8-4308-9f25-4d863df27463 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:58.824416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7709a23-20a8-4308-9f25-4d863df27463 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:58.844807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-c0cada87-9a26-4fe1-ba99-640b97f3f580 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'server_groups'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:37:58.858732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-c0cada87-9a26-4fe1-ba99-640b97f3f580 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for user b86e3b7d1c9a4b2c8f2914beefa74cc1 and project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'server_groups'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:37:58.947418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-c0cada87-9a26-4fe1-ba99-640b97f3f580 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'server_groups'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:37:58.961660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-c0cada87-9a26-4fe1-ba99-640b97f3f580 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for user b86e3b7d1c9a4b2c8f2914beefa74cc1 and project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'server_groups'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:37:58.995296 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c0cada87-9a26-4fe1-ba99-640b97f3f580 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.197433 Oct 05 02:37:59.005258 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1255/2544] 10.222.0.16 () {60 vars in 1174 bytes} [Wed Oct 5 02:37:58 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:37:59.199665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-771ddf83-9901-4338-a524-6181581f3976 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1716696310", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "ad010c61-f0d8-4de3-8872-599fd3efd892"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:37:59.302574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-771ddf83-9901-4338-a524-6181581f3976 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] validate_networks() for None {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:37:59.762106 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e7709a23-20a8-4308-9f25-4d863df27463 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:37:59.776731 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e7709a23-20a8-4308-9f25-4d863df27463 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1313 microversion: 2.1 time: 0.984257 Oct 05 02:37:59.779699 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1290/2545] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:58 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1313 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:37:59.796362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-db070a87-8fe9-4f9b-930a-26cf40240664 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:37:59.797282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-db070a87-8fe9-4f9b-930a-26cf40240664 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] [instance: 74b1ab94-3bc0-440d-bf57-dcab444e063d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:37:59.816938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db070a87-8fe9-4f9b-930a-26cf40240664 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:59.817674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db070a87-8fe9-4f9b-930a-26cf40240664 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:59.818301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db070a87-8fe9-4f9b-930a-26cf40240664 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:37:59.819707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db070a87-8fe9-4f9b-930a-26cf40240664 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:37:59.820983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db070a87-8fe9-4f9b-930a-26cf40240664 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:37:59.821607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db070a87-8fe9-4f9b-930a-26cf40240664 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:00.114294 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-db070a87-8fe9-4f9b-930a-26cf40240664 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d55412129f24e90b1caa99b3aea8c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be31ec89b1354d608d7de438f5cf519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:00.123507 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-db070a87-8fe9-4f9b-930a-26cf40240664 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d" status: 200 len: 1274 microversion: 2.1 time: 0.342184 Oct 05 02:38:00.129257 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1291/2546] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:59 2022] GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d => generated 1274 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:00.524443 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-771ddf83-9901-4338-a524-6181581f3976 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:38:00.526798 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-771ddf83-9901-4338-a524-6181581f3976 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:38:00.527536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-771ddf83-9901-4338-a524-6181581f3976 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:38:00.528389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-771ddf83-9901-4338-a524-6181581f3976 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:38:00.529084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-771ddf83-9901-4338-a524-6181581f3976 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:38:00.552487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-771ddf83-9901-4338-a524-6181581f3976 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:00.553130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-771ddf83-9901-4338-a524-6181581f3976 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:00.555444 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-771ddf83-9901-4338-a524-6181581f3976 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:00.560328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-771ddf83-9901-4338-a524-6181581f3976 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:00.565431 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-771ddf83-9901-4338-a524-6181581f3976 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:00.566040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-771ddf83-9901-4338-a524-6181581f3976 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:00.609454 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-771ddf83-9901-4338-a524-6181581f3976 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:38:00.622520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-771ddf83-9901-4338-a524-6181581f3976 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for user b86e3b7d1c9a4b2c8f2914beefa74cc1 and project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:38:00.659366 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-771ddf83-9901-4338-a524-6181581f3976 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Going to run 2 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:38:00.665008 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-771ddf83-9901-4338-a524-6181581f3976 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: d216853e-3fda-40f8-be89-56e8756c83a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:38:00.738431 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-771ddf83-9901-4338-a524-6181581f3976 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122319) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 05 02:38:00.761299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:00.771819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-771ddf83-9901-4338-a524-6181581f3976 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'server_group_members'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:38:00.783590 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-771ddf83-9901-4338-a524-6181581f3976 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for user b86e3b7d1c9a4b2c8f2914beefa74cc1 and project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'server_group_members'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:38:00.816711 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-48b77bb8-6f5e-4977-ab8c-93b9c546b1f8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:00.818367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-48b77bb8-6f5e-4977-ab8c-93b9c546b1f8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:00.841579 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48b77bb8-6f5e-4977-ab8c-93b9c546b1f8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:00.844591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48b77bb8-6f5e-4977-ab8c-93b9c546b1f8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:00.846506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48b77bb8-6f5e-4977-ab8c-93b9c546b1f8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:00.848940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48b77bb8-6f5e-4977-ab8c-93b9c546b1f8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:00.850070 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48b77bb8-6f5e-4977-ab8c-93b9c546b1f8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:00.851232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48b77bb8-6f5e-4977-ab8c-93b9c546b1f8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:00.922492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-771ddf83-9901-4338-a524-6181581f3976 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'server_group_members'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:38:00.943393 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-771ddf83-9901-4338-a524-6181581f3976 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for user b86e3b7d1c9a4b2c8f2914beefa74cc1 and project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'server_group_members'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:38:00.965502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-771ddf83-9901-4338-a524-6181581f3976 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 549e9e9b-0461-402c-a082-4f6a85a6e3c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=d216853e-3fda-40f8-be89-56e8756c83a8,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:38:01.050456 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-771ddf83-9901-4338-a524-6181581f3976 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'server_group_members'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:38:01.063824 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-771ddf83-9901-4338-a524-6181581f3976 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for user b86e3b7d1c9a4b2c8f2914beefa74cc1 and project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'server_group_members'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:38:01.130871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-771ddf83-9901-4338-a524-6181581f3976 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'server_group_members'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:38:01.139035 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-771ddf83-9901-4338-a524-6181581f3976 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for user b86e3b7d1c9a4b2c8f2914beefa74cc1 and project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'server_group_members'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:38:01.201989 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-771ddf83-9901-4338-a524-6181581f3976 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.006988 Oct 05 02:38:01.208329 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1256/2547] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:37:59 2022] POST /compute/v2.1/servers => generated 32 bytes in 2011 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 05 02:38:01.218764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7ff1e104-3537-4510-86c0-1530389f0eaf tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:01.219404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7ff1e104-3537-4510-86c0-1530389f0eaf tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] [instance: 74b1ab94-3bc0-440d-bf57-dcab444e063d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:01.238658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ff1e104-3537-4510-86c0-1530389f0eaf tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:01.239264 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ff1e104-3537-4510-86c0-1530389f0eaf tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:01.239767 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ff1e104-3537-4510-86c0-1530389f0eaf tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:01.240503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ff1e104-3537-4510-86c0-1530389f0eaf tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:01.241499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ff1e104-3537-4510-86c0-1530389f0eaf tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:01.241631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ff1e104-3537-4510-86c0-1530389f0eaf tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:01.853364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7ff1e104-3537-4510-86c0-1530389f0eaf tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d55412129f24e90b1caa99b3aea8c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be31ec89b1354d608d7de438f5cf519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:01.869499 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7ff1e104-3537-4510-86c0-1530389f0eaf tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d" status: 200 len: 1316 microversion: 2.1 time: 0.658216 Oct 05 02:38:01.870136 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1257/2548] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:01 2022] GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d => generated 1316 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:01.886754 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-84c8f2b1-01da-446e-b717-4a340987fe4a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:01.891851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-84c8f2b1-01da-446e-b717-4a340987fe4a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:01.892640 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-84c8f2b1-01da-446e-b717-4a340987fe4a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Searching by: {'deleted': False, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6'} {{(pid=122319) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:38:01.931771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84c8f2b1-01da-446e-b717-4a340987fe4a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:01.932284 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84c8f2b1-01da-446e-b717-4a340987fe4a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:01.932736 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84c8f2b1-01da-446e-b717-4a340987fe4a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:01.933516 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84c8f2b1-01da-446e-b717-4a340987fe4a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:01.942401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84c8f2b1-01da-446e-b717-4a340987fe4a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:01.942680 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-48b77bb8-6f5e-4977-ab8c-93b9c546b1f8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:01.943555 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84c8f2b1-01da-446e-b717-4a340987fe4a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:01.974091 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-48b77bb8-6f5e-4977-ab8c-93b9c546b1f8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1313 microversion: 2.1 time: 1.171442 Oct 05 02:38:01.979987 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1292/2549] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:00 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1313 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:02.013694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.multi_cell_list [None req-84c8f2b1-01da-446e-b717-4a340987fe4a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=122319) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:38:02.129130 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-84c8f2b1-01da-446e-b717-4a340987fe4a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.257776 Oct 05 02:38:02.130323 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1258/2550] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 5 02:38:01 2022] GET /compute/v2.1/servers => generated 1003 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:02.150118 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e5831491-91af-48e3-9df9-bb0b8b6f8432 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:02.153110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e5831491-91af-48e3-9df9-bb0b8b6f8432 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 549e9e9b-0461-402c-a082-4f6a85a6e3c8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:02.557342 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-03ac8ff0-3843-4fa6-8593-12d28fc4409a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:02.557858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-03ac8ff0-3843-4fa6-8593-12d28fc4409a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 7dfe1782-6765-4efc-8576-1d138be154ec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:02.568125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-03ac8ff0-3843-4fa6-8593-12d28fc4409a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:02.568635 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-03ac8ff0-3843-4fa6-8593-12d28fc4409a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:02.570125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-03ac8ff0-3843-4fa6-8593-12d28fc4409a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:02.570401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-03ac8ff0-3843-4fa6-8593-12d28fc4409a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:02.571197 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-03ac8ff0-3843-4fa6-8593-12d28fc4409a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:02.571679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-03ac8ff0-3843-4fa6-8593-12d28fc4409a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:02.636683 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-03ac8ff0-3843-4fa6-8593-12d28fc4409a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] HTTP exception thrown: Instance 7dfe1782-6765-4efc-8576-1d138be154ec could not be found. Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-03ac8ff0-3843-4fa6-8593-12d28fc4409a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Request method failure captured: Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec HTTP/1.1 Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO2A94pn1unf7Tec3jJOeL-pCSWjwtu2x-XR2SK5jNwu0xU-WXF4dynC1BdXxsNVnxUewK47XoikuKSvxaXSOdytbuzIEz2yN2g88rujbBE25tHGvxQQKf_mg6cqRei6SIdDyxuPi29B0yiubBblKvoFzf61k7-BMs2AcZU0uU9K3jM Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: fc3fd0eb45ed4080af876031348f367a Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersTestMultiNic-1996318355 Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fc3fd0eb45ed4080af876031348f367a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fc3fd0eb45ed4080af876031348f367a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fc3fd0eb45ed4080af876031348f367a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fc3fd0eb45ed4080af876031348f367a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersTestMultiNic-1996318355 Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: fc3fd0eb45ed4080af876031348f367a Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersTestMultiNic-1996318355 Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersTestMultiNic-1996318355-project Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 9e5ffbccdbec4a4bb21a3e48c1f7beaf Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersTestMultiNic-1996318355-project Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 7dfe1782-6765-4efc-8576-1d138be154ec could not be found. Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '7dfe1782-6765-4efc-8576-1d138be154ec'} Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dfe1782-6765-4efc-8576-1d138be154ec could not be found. Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:38:02.640427 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:38:02.645047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dfe1782-6765-4efc-8576-1d138be154ec could not be found. Oct 05 02:38:02.645047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:38:02.645047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:38:02.645047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:38:02.645047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:02.645047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:38:02.645047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:38:02.645047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:38:02.645047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:38:02.645047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dfe1782-6765-4efc-8576-1d138be154ec could not be found. Oct 05 02:38:02.645047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:38:02.645047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-03ac8ff0-3843-4fa6-8593-12d28fc4409a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Returning 404 to user: Instance 7dfe1782-6765-4efc-8576-1d138be154ec could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:38:02.645047 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-03ac8ff0-3843-4fa6-8593-12d28fc4409a tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec" status: 404 len: 111 microversion: 2.1 time: 0.090479 Oct 05 02:38:02.657509 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1259/2551] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:38:02 2022] DELETE /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:38:02.677971 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8f5c43c5-5dd0-4c54-9d41-ced9ee373707 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:02.680161 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8f5c43c5-5dd0-4c54-9d41-ced9ee373707 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 7dfe1782-6765-4efc-8576-1d138be154ec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:02.694273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f5c43c5-5dd0-4c54-9d41-ced9ee373707 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:02.695277 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f5c43c5-5dd0-4c54-9d41-ced9ee373707 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:02.696099 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f5c43c5-5dd0-4c54-9d41-ced9ee373707 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:02.703401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f5c43c5-5dd0-4c54-9d41-ced9ee373707 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:02.704762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f5c43c5-5dd0-4c54-9d41-ced9ee373707 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:02.706417 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f5c43c5-5dd0-4c54-9d41-ced9ee373707 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:02.776642 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-8f5c43c5-5dd0-4c54-9d41-ced9ee373707 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] HTTP exception thrown: Instance 7dfe1782-6765-4efc-8576-1d138be154ec could not be found. Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8f5c43c5-5dd0-4c54-9d41-ced9ee373707 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Request method failure captured: Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec HTTP/1.1 Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO2A94pn1unf7Tec3jJOeL-pCSWjwtu2x-XR2SK5jNwu0xU-WXF4dynC1BdXxsNVnxUewK47XoikuKSvxaXSOdytbuzIEz2yN2g88rujbBE25tHGvxQQKf_mg6cqRei6SIdDyxuPi29B0yiubBblKvoFzf61k7-BMs2AcZU0uU9K3jM Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: fc3fd0eb45ed4080af876031348f367a Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersTestMultiNic-1996318355 Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fc3fd0eb45ed4080af876031348f367a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fc3fd0eb45ed4080af876031348f367a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fc3fd0eb45ed4080af876031348f367a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fc3fd0eb45ed4080af876031348f367a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersTestMultiNic-1996318355 Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: fc3fd0eb45ed4080af876031348f367a Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersTestMultiNic-1996318355 Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersTestMultiNic-1996318355-project Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 9e5ffbccdbec4a4bb21a3e48c1f7beaf Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersTestMultiNic-1996318355-project Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 7dfe1782-6765-4efc-8576-1d138be154ec could not be found. Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '7dfe1782-6765-4efc-8576-1d138be154ec'} Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dfe1782-6765-4efc-8576-1d138be154ec could not be found. Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dfe1782-6765-4efc-8576-1d138be154ec could not be found. Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:38:02.783913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:38:02.790806 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:02.790806 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:38:02.790806 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:38:02.790806 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:38:02.790806 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:38:02.790806 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dfe1782-6765-4efc-8576-1d138be154ec could not be found. Oct 05 02:38:02.790806 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:38:02.790806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8f5c43c5-5dd0-4c54-9d41-ced9ee373707 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Returning 404 to user: Instance 7dfe1782-6765-4efc-8576-1d138be154ec could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:38:02.790806 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8f5c43c5-5dd0-4c54-9d41-ced9ee373707 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec" status: 404 len: 111 microversion: 2.1 time: 0.119724 Oct 05 02:38:02.790806 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1260/2552] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:02 2022] GET /compute/v2.1/servers/7dfe1782-6765-4efc-8576-1d138be154ec => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:38:02.808205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e7ed5314-ca8a-49dc-920e-4b7481d3d682 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:02.810252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e7ed5314-ca8a-49dc-920e-4b7481d3d682 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:02.827528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7ed5314-ca8a-49dc-920e-4b7481d3d682 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:02.828055 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7ed5314-ca8a-49dc-920e-4b7481d3d682 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:02.829609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7ed5314-ca8a-49dc-920e-4b7481d3d682 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:02.830353 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7ed5314-ca8a-49dc-920e-4b7481d3d682 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:02.832992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7ed5314-ca8a-49dc-920e-4b7481d3d682 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:02.833502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7ed5314-ca8a-49dc-920e-4b7481d3d682 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:02.884823 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-e7ed5314-ca8a-49dc-920e-4b7481d3d682 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] HTTP exception thrown: Instance 1d0e63ee-ba8d-4203-9cd5-f13d833de668 could not be found. Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e7ed5314-ca8a-49dc-920e-4b7481d3d682 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Request method failure captured: Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 HTTP/1.1 Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO2A94pn1unf7Tec3jJOeL-pCSWjwtu2x-XR2SK5jNwu0xU-WXF4dynC1BdXxsNVnxUewK47XoikuKSvxaXSOdytbuzIEz2yN2g88rujbBE25tHGvxQQKf_mg6cqRei6SIdDyxuPi29B0yiubBblKvoFzf61k7-BMs2AcZU0uU9K3jM Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: fc3fd0eb45ed4080af876031348f367a Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersTestMultiNic-1996318355 Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fc3fd0eb45ed4080af876031348f367a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fc3fd0eb45ed4080af876031348f367a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fc3fd0eb45ed4080af876031348f367a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fc3fd0eb45ed4080af876031348f367a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersTestMultiNic-1996318355 Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: fc3fd0eb45ed4080af876031348f367a Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersTestMultiNic-1996318355 Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersTestMultiNic-1996318355-project Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 9e5ffbccdbec4a4bb21a3e48c1f7beaf Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersTestMultiNic-1996318355-project Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 1d0e63ee-ba8d-4203-9cd5-f13d833de668 could not be found. Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '1d0e63ee-ba8d-4203-9cd5-f13d833de668'} Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d0e63ee-ba8d-4203-9cd5-f13d833de668 could not be found. Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:38:02.890484 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:38:02.894902 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d0e63ee-ba8d-4203-9cd5-f13d833de668 could not be found. Oct 05 02:38:02.894902 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:38:02.894902 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:38:02.894902 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:38:02.894902 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:02.894902 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:38:02.894902 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:38:02.894902 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:38:02.894902 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:38:02.894902 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d0e63ee-ba8d-4203-9cd5-f13d833de668 could not be found. Oct 05 02:38:02.894902 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:38:02.894902 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e7ed5314-ca8a-49dc-920e-4b7481d3d682 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Returning 404 to user: Instance 1d0e63ee-ba8d-4203-9cd5-f13d833de668 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:38:02.895632 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e7ed5314-ca8a-49dc-920e-4b7481d3d682 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 404 len: 111 microversion: 2.1 time: 0.099040 Oct 05 02:38:02.895834 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1261/2553] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:38:02 2022] DELETE /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:38:02.909956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-023c710a-84f4-43f4-9ad5-6571df44f82e tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:02.916396 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-023c710a-84f4-43f4-9ad5-6571df44f82e tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] [instance: 74b1ab94-3bc0-440d-bf57-dcab444e063d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:02.930990 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-023c710a-84f4-43f4-9ad5-6571df44f82e tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:02.934792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-023c710a-84f4-43f4-9ad5-6571df44f82e tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:02.935389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-023c710a-84f4-43f4-9ad5-6571df44f82e tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:02.936718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-023c710a-84f4-43f4-9ad5-6571df44f82e tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:02.937631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-023c710a-84f4-43f4-9ad5-6571df44f82e tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:02.938243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-023c710a-84f4-43f4-9ad5-6571df44f82e tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:03.152053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e5831491-91af-48e3-9df9-bb0b8b6f8432 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:03.169858 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e5831491-91af-48e3-9df9-bb0b8b6f8432 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8" status: 200 len: 1219 microversion: 2.1 time: 1.030223 Oct 05 02:38:03.172081 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1293/2554] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:02 2022] GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8 => generated 1219 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:03.179450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9c429af7-4780-4974-9a26-2ba6f53e14c0 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:03.181881 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9c429af7-4780-4974-9a26-2ba6f53e14c0 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] [instance: 1d0e63ee-ba8d-4203-9cd5-f13d833de668] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:03.210547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9c429af7-4780-4974-9a26-2ba6f53e14c0 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:03.213014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9c429af7-4780-4974-9a26-2ba6f53e14c0 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:03.217179 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9c429af7-4780-4974-9a26-2ba6f53e14c0 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:03.219385 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9c429af7-4780-4974-9a26-2ba6f53e14c0 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:03.221115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9c429af7-4780-4974-9a26-2ba6f53e14c0 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:03.221743 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9c429af7-4780-4974-9a26-2ba6f53e14c0 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:03.261452 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-9c429af7-4780-4974-9a26-2ba6f53e14c0 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] HTTP exception thrown: Instance 1d0e63ee-ba8d-4203-9cd5-f13d833de668 could not be found. Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9c429af7-4780-4974-9a26-2ba6f53e14c0 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Request method failure captured: Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 HTTP/1.1 Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO2A94pn1unf7Tec3jJOeL-pCSWjwtu2x-XR2SK5jNwu0xU-WXF4dynC1BdXxsNVnxUewK47XoikuKSvxaXSOdytbuzIEz2yN2g88rujbBE25tHGvxQQKf_mg6cqRei6SIdDyxuPi29B0yiubBblKvoFzf61k7-BMs2AcZU0uU9K3jM Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: fc3fd0eb45ed4080af876031348f367a Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersTestMultiNic-1996318355 Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fc3fd0eb45ed4080af876031348f367a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fc3fd0eb45ed4080af876031348f367a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fc3fd0eb45ed4080af876031348f367a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fc3fd0eb45ed4080af876031348f367a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersTestMultiNic-1996318355 Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: fc3fd0eb45ed4080af876031348f367a Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersTestMultiNic-1996318355 Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersTestMultiNic-1996318355-project Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 9e5ffbccdbec4a4bb21a3e48c1f7beaf Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersTestMultiNic-1996318355-project Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 1d0e63ee-ba8d-4203-9cd5-f13d833de668 could not be found. Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '1d0e63ee-ba8d-4203-9cd5-f13d833de668'} Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d0e63ee-ba8d-4203-9cd5-f13d833de668 could not be found. Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d0e63ee-ba8d-4203-9cd5-f13d833de668 could not be found. Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:38:03.265097 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:03.272657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:03.272657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:38:03.272657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:38:03.272657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:38:03.272657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:38:03.272657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d0e63ee-ba8d-4203-9cd5-f13d833de668 could not be found. Oct 05 02:38:03.272657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:03.276293 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9c429af7-4780-4974-9a26-2ba6f53e14c0 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] Returning 404 to user: Instance 1d0e63ee-ba8d-4203-9cd5-f13d833de668 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:38:03.278482 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9c429af7-4780-4974-9a26-2ba6f53e14c0 tempest-ServersTestMultiNic-1996318355 tempest-ServersTestMultiNic-1996318355-project] 10.222.0.16 "GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668" status: 404 len: 111 microversion: 2.1 time: 0.105239 Oct 05 02:38:03.279577 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1294/2555] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:03 2022] GET /compute/v2.1/servers/1d0e63ee-ba8d-4203-9cd5-f13d833de668 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:38:03.288599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f04fd437-ec21-4bc0-a8c5-13ab1fcae591 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:03.290940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f04fd437-ec21-4bc0-a8c5-13ab1fcae591 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:03.301372 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f04fd437-ec21-4bc0-a8c5-13ab1fcae591 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:03.302384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f04fd437-ec21-4bc0-a8c5-13ab1fcae591 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:03.303482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f04fd437-ec21-4bc0-a8c5-13ab1fcae591 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:03.305761 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f04fd437-ec21-4bc0-a8c5-13ab1fcae591 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:03.306678 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f04fd437-ec21-4bc0-a8c5-13ab1fcae591 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:03.307282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f04fd437-ec21-4bc0-a8c5-13ab1fcae591 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:03.708305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-023c710a-84f4-43f4-9ad5-6571df44f82e tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d55412129f24e90b1caa99b3aea8c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be31ec89b1354d608d7de438f5cf519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:03.720537 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-023c710a-84f4-43f4-9ad5-6571df44f82e tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d" status: 200 len: 1316 microversion: 2.1 time: 0.817785 Oct 05 02:38:03.721154 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1262/2556] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:02 2022] GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d => generated 1316 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:04.018079 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-757ba60e-26aa-4601-8a12-5c77ebe73437 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-186402928", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "c8f5d013-4f78-4b29-9acf-a7e87beaca1c"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:38:04.111448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f04fd437-ec21-4bc0-a8c5-13ab1fcae591 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:04.121583 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f04fd437-ec21-4bc0-a8c5-13ab1fcae591 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1313 microversion: 2.1 time: 0.840108 Oct 05 02:38:04.122210 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1295/2557] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:03 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1313 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:04.140777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-757ba60e-26aa-4601-8a12-5c77ebe73437 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] validate_networks() for [('c8f5d013-4f78-4b29-9acf-a7e87beaca1c', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:38:04.207031 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5e93f6c9-5ff1-4f62-b67a-651fbc86c753 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:04.207031 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5e93f6c9-5ff1-4f62-b67a-651fbc86c753 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 549e9e9b-0461-402c-a082-4f6a85a6e3c8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:04.212260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e93f6c9-5ff1-4f62-b67a-651fbc86c753 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:04.212765 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e93f6c9-5ff1-4f62-b67a-651fbc86c753 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:04.217438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e93f6c9-5ff1-4f62-b67a-651fbc86c753 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:04.218228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e93f6c9-5ff1-4f62-b67a-651fbc86c753 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:04.219552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e93f6c9-5ff1-4f62-b67a-651fbc86c753 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:04.219999 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e93f6c9-5ff1-4f62-b67a-651fbc86c753 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:04.380783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5e93f6c9-5ff1-4f62-b67a-651fbc86c753 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:04.394053 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5e93f6c9-5ff1-4f62-b67a-651fbc86c753 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8" status: 200 len: 1271 microversion: 2.1 time: 0.199568 Oct 05 02:38:04.395047 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1296/2558] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:04 2022] GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8 => generated 1271 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:04.401127 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b4217cb4-bc34-4e28-840d-7cd27ea082f3 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-23156323", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "19a3ca19-8a4c-492e-93f4-0dd893ef5ddc"}], "security_groups": [{"name": "tempest-securitygroup--825386556"}], "key_name": "tempest-keypair-654692082", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:38:04.520060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:04.799945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-b4217cb4-bc34-4e28-840d-7cd27ea082f3 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] validate_networks() for [('19a3ca19-8a4c-492e-93f4-0dd893ef5ddc', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:38:06.529698 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-757ba60e-26aa-4601-8a12-5c77ebe73437 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:38:06.530237 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-757ba60e-26aa-4601-8a12-5c77ebe73437 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:38:06.531069 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-757ba60e-26aa-4601-8a12-5c77ebe73437 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:38:06.531726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-757ba60e-26aa-4601-8a12-5c77ebe73437 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:38:06.533138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-757ba60e-26aa-4601-8a12-5c77ebe73437 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:38:06.563379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-757ba60e-26aa-4601-8a12-5c77ebe73437 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:06.564873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-757ba60e-26aa-4601-8a12-5c77ebe73437 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:06.565666 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-757ba60e-26aa-4601-8a12-5c77ebe73437 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:06.567755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-757ba60e-26aa-4601-8a12-5c77ebe73437 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:06.568387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-757ba60e-26aa-4601-8a12-5c77ebe73437 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:06.569265 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-757ba60e-26aa-4601-8a12-5c77ebe73437 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:06.631247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-757ba60e-26aa-4601-8a12-5c77ebe73437 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Getting quotas for project 25663d1b71554c84998a009e9e41e7f0. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:38:06.640401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-757ba60e-26aa-4601-8a12-5c77ebe73437 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Getting quotas for user 2b8d63e7d05849e28cc54624771c60e1 and project 25663d1b71554c84998a009e9e41e7f0. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:38:06.663227 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-757ba60e-26aa-4601-8a12-5c77ebe73437 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Going to run 3 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:38:06.668677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-757ba60e-26aa-4601-8a12-5c77ebe73437 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: 40fd6f92-87b8-452f-827f-1bf2b2be98a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:38:06.738041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-757ba60e-26aa-4601-8a12-5c77ebe73437 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: 47c8d34c-c7ca-4b8d-ba7e-72ce986a0985] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=40fd6f92-87b8-452f-827f-1bf2b2be98a9,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:38:06.805601 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-757ba60e-26aa-4601-8a12-5c77ebe73437 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: cdc1d61f-24f7-42ba-bd26-7a24227e5a01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=47c8d34c-c7ca-4b8d-ba7e-72ce986a0985,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:38:06.907134 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-757ba60e-26aa-4601-8a12-5c77ebe73437 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.184783 Oct 05 02:38:06.907974 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1263/2559] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:38:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 3186 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:38:06.919619 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-192582b5-c96a-4fbc-8169-e332adcbb6cc tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:06.920381 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-192582b5-c96a-4fbc-8169-e332adcbb6cc tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] [instance: 74b1ab94-3bc0-440d-bf57-dcab444e063d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:06.928324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-192582b5-c96a-4fbc-8169-e332adcbb6cc tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:06.929105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-192582b5-c96a-4fbc-8169-e332adcbb6cc tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:06.929927 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-192582b5-c96a-4fbc-8169-e332adcbb6cc tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:06.930877 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-192582b5-c96a-4fbc-8169-e332adcbb6cc tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:06.931497 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-192582b5-c96a-4fbc-8169-e332adcbb6cc tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:06.932106 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-192582b5-c96a-4fbc-8169-e332adcbb6cc tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:07.091352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-b4217cb4-bc34-4e28-840d-7cd27ea082f3 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Getting quotas for project d69def5e64d945428d420e737fecd987. Resources: dict_keys(['metadata_items']) {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:38:07.134541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-b4217cb4-bc34-4e28-840d-7cd27ea082f3 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Getting quotas for user 110ebcc38ef34dfea40fe14ab2ad1b3d and project d69def5e64d945428d420e737fecd987. Resources: dict_keys(['metadata_items']) {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:38:07.166309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-b4217cb4-bc34-4e28-840d-7cd27ea082f3 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:38:07.167073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-b4217cb4-bc34-4e28-840d-7cd27ea082f3 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:38:07.167992 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-b4217cb4-bc34-4e28-840d-7cd27ea082f3 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:38:07.168784 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-b4217cb4-bc34-4e28-840d-7cd27ea082f3 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:38:07.171101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-b4217cb4-bc34-4e28-840d-7cd27ea082f3 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:38:07.185701 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4217cb4-bc34-4e28-840d-7cd27ea082f3 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:07.186907 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4217cb4-bc34-4e28-840d-7cd27ea082f3 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:07.187364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4217cb4-bc34-4e28-840d-7cd27ea082f3 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:07.188939 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4217cb4-bc34-4e28-840d-7cd27ea082f3 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:07.189823 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4217cb4-bc34-4e28-840d-7cd27ea082f3 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:07.190963 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4217cb4-bc34-4e28-840d-7cd27ea082f3 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:07.224929 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-b4217cb4-bc34-4e28-840d-7cd27ea082f3 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Getting quotas for project d69def5e64d945428d420e737fecd987. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:38:07.242428 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-b4217cb4-bc34-4e28-840d-7cd27ea082f3 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Getting quotas for user 110ebcc38ef34dfea40fe14ab2ad1b3d and project d69def5e64d945428d420e737fecd987. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:38:07.246205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:07.285097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b4217cb4-bc34-4e28-840d-7cd27ea082f3 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:38:07.287390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b4217cb4-bc34-4e28-840d-7cd27ea082f3 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] [instance: b834e68c-772a-45b6-857b-0cb285b1e320] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:38:07.357482 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b4217cb4-bc34-4e28-840d-7cd27ea082f3 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.961042 Oct 05 02:38:07.368683 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1297/2560] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:38:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 2963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:38:07.373085 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-eb208b2f-01ff-4cfc-879b-8064f01660e2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:07.373857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-eb208b2f-01ff-4cfc-879b-8064f01660e2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:07.385093 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb208b2f-01ff-4cfc-879b-8064f01660e2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:07.387026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb208b2f-01ff-4cfc-879b-8064f01660e2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:07.387477 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb208b2f-01ff-4cfc-879b-8064f01660e2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:07.388228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb208b2f-01ff-4cfc-879b-8064f01660e2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:07.388633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb208b2f-01ff-4cfc-879b-8064f01660e2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:07.389774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb208b2f-01ff-4cfc-879b-8064f01660e2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:07.656686 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-192582b5-c96a-4fbc-8169-e332adcbb6cc tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d55412129f24e90b1caa99b3aea8c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be31ec89b1354d608d7de438f5cf519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:07.677863 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-192582b5-c96a-4fbc-8169-e332adcbb6cc tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d" status: 200 len: 1316 microversion: 2.1 time: 0.762529 Oct 05 02:38:07.678451 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1264/2561] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:06 2022] GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d => generated 1316 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:07.698957 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-380412ac-edcf-4cfe-8c0e-2ce995002458 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:07.699587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-380412ac-edcf-4cfe-8c0e-2ce995002458 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 549e9e9b-0461-402c-a082-4f6a85a6e3c8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:07.714015 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-380412ac-edcf-4cfe-8c0e-2ce995002458 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:07.714525 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-380412ac-edcf-4cfe-8c0e-2ce995002458 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:07.714969 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-380412ac-edcf-4cfe-8c0e-2ce995002458 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:07.715682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-380412ac-edcf-4cfe-8c0e-2ce995002458 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:07.716325 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-380412ac-edcf-4cfe-8c0e-2ce995002458 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:07.716935 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-380412ac-edcf-4cfe-8c0e-2ce995002458 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:07.906969 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-380412ac-edcf-4cfe-8c0e-2ce995002458 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:07.922531 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-380412ac-edcf-4cfe-8c0e-2ce995002458 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8" status: 200 len: 1277 microversion: 2.1 time: 0.227231 Oct 05 02:38:07.924768 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1265/2562] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:07 2022] GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8 => generated 1277 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:07.947154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-bd919b64-5271-4e23-96a2-51021fdf87a7 req-808cebbf-bd54-4f6c-b491-01fd4def01ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac919870-2512-4424-bea6-b003534ce678", "name": "network-vif-plugged", "status": "completed", "tag": "210caa7d-298b-408f-a376-b6a2a6f6ce62"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:38:07.959869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-eb208b2f-01ff-4cfc-879b-8064f01660e2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:07.972957 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-eb208b2f-01ff-4cfc-879b-8064f01660e2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1313 microversion: 2.1 time: 0.613113 Oct 05 02:38:07.974212 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1298/2563] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:07 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1313 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:07.992408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-b4db9772-f05a-42d1-b036-9e6d60a59bcf req-a4557830-030f-477c-9b3d-38f7024cd21b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74b1ab94-3bc0-440d-bf57-dcab444e063d", "tag": "f76faa20-bd22-4858-915c-478dc55b243d"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:38:07.996728 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-bd919b64-5271-4e23-96a2-51021fdf87a7 req-808cebbf-bd54-4f6c-b491-01fd4def01ca service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:07.998721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-bd919b64-5271-4e23-96a2-51021fdf87a7 req-808cebbf-bd54-4f6c-b491-01fd4def01ca service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:08.000162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-bd919b64-5271-4e23-96a2-51021fdf87a7 req-808cebbf-bd54-4f6c-b491-01fd4def01ca service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:08.014715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b4db9772-f05a-42d1-b036-9e6d60a59bcf req-a4557830-030f-477c-9b3d-38f7024cd21b service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:08.015447 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b4db9772-f05a-42d1-b036-9e6d60a59bcf req-a4557830-030f-477c-9b3d-38f7024cd21b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:08.016030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b4db9772-f05a-42d1-b036-9e6d60a59bcf req-a4557830-030f-477c-9b3d-38f7024cd21b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:08.033409 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-bd919b64-5271-4e23-96a2-51021fdf87a7 req-808cebbf-bd54-4f6c-b491-01fd4def01ca service nova] Creating event network-vif-plugged:210caa7d-298b-408f-a376-b6a2a6f6ce62 for instance ac919870-2512-4424-bea6-b003534ce678 on n-h2-858272-3 Oct 05 02:38:08.037283 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-b4db9772-f05a-42d1-b036-9e6d60a59bcf req-a4557830-030f-477c-9b3d-38f7024cd21b service nova] Creating event network-changed:f76faa20-bd22-4858-915c-478dc55b243d for instance 74b1ab94-3bc0-440d-bf57-dcab444e063d on n-h1-858272-3 Oct 05 02:38:08.048473 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-bd919b64-5271-4e23-96a2-51021fdf87a7 req-808cebbf-bd54-4f6c-b491-01fd4def01ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120914 Oct 05 02:38:08.060303 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1266/2564] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:38:08.065994 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-b4db9772-f05a-42d1-b036-9e6d60a59bcf req-a4557830-030f-477c-9b3d-38f7024cd21b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088233 Oct 05 02:38:08.071063 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1299/2565] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:38:08.074276 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-19c3e0f4-1ed8-4d44-b154-c37e459d51d0 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:08.084630 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-19c3e0f4-1ed8-4d44-b154-c37e459d51d0 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:08.087208 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1d2bbfe7-56c3-4a0f-91de-0cbd4fddf060 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:08.087753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1d2bbfe7-56c3-4a0f-91de-0cbd4fddf060 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] [instance: b834e68c-772a-45b6-857b-0cb285b1e320] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:08.088784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-19c3e0f4-1ed8-4d44-b154-c37e459d51d0 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Searching by: {'deleted': False, 'project_id': '25663d1b71554c84998a009e9e41e7f0'} {{(pid=122319) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:38:08.157313 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19c3e0f4-1ed8-4d44-b154-c37e459d51d0 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:08.158626 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19c3e0f4-1ed8-4d44-b154-c37e459d51d0 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:08.161390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19c3e0f4-1ed8-4d44-b154-c37e459d51d0 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:08.165245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19c3e0f4-1ed8-4d44-b154-c37e459d51d0 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:08.166783 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19c3e0f4-1ed8-4d44-b154-c37e459d51d0 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:08.167641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19c3e0f4-1ed8-4d44-b154-c37e459d51d0 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:08.248158 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.multi_cell_list [None req-19c3e0f4-1ed8-4d44-b154-c37e459d51d0 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Listed batch of 3 results from cell out of 997 limit. Returned 3 total so far. {{(pid=122319) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:38:08.341898 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-19c3e0f4-1ed8-4d44-b154-c37e459d51d0 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.278129 Oct 05 02:38:08.343815 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1267/2566] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 5 02:38:08 2022] GET /compute/v2.1/servers => generated 1015 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:08.362305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-14554295-bc81-454b-a9b5-8268b167611a tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:08.365347 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-14554295-bc81-454b-a9b5-8268b167611a tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: cdc1d61f-24f7-42ba-bd26-7a24227e5a01] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:08.499483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-14554295-bc81-454b-a9b5-8268b167611a tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:08.512537 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-14554295-bc81-454b-a9b5-8268b167611a tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01" status: 200 len: 1222 microversion: 2.1 time: 0.157139 Oct 05 02:38:08.515854 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1268/2567] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:08 2022] GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01 => generated 1222 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:08.697560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1d2bbfe7-56c3-4a0f-91de-0cbd4fddf060 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110ebcc38ef34dfea40fe14ab2ad1b3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69def5e64d945428d420e737fecd987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:08.701163 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8c537d10-f0fc-4339-b367-b7298600ed2b tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:08.702038 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8c537d10-f0fc-4339-b367-b7298600ed2b tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] [instance: 74b1ab94-3bc0-440d-bf57-dcab444e063d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:08.706613 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1d2bbfe7-56c3-4a0f-91de-0cbd4fddf060 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] 10.222.0.16 "GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320" status: 200 len: 1267 microversion: 2.1 time: 0.632003 Oct 05 02:38:08.707223 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1300/2568] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:08 2022] GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320 => generated 1267 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:08.722409 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c537d10-f0fc-4339-b367-b7298600ed2b tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:08.723430 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c537d10-f0fc-4339-b367-b7298600ed2b tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:08.729004 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c537d10-f0fc-4339-b367-b7298600ed2b tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:08.731350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c537d10-f0fc-4339-b367-b7298600ed2b tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:08.735393 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c537d10-f0fc-4339-b367-b7298600ed2b tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:08.735886 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c537d10-f0fc-4339-b367-b7298600ed2b tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:08.949254 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b049925e-f7a6-4b12-aefb-74b9fc4b85da tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:08.950043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b049925e-f7a6-4b12-aefb-74b9fc4b85da tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 549e9e9b-0461-402c-a082-4f6a85a6e3c8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:08.959598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b049925e-f7a6-4b12-aefb-74b9fc4b85da tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:08.960436 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b049925e-f7a6-4b12-aefb-74b9fc4b85da tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:08.961591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b049925e-f7a6-4b12-aefb-74b9fc4b85da tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:08.962597 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b049925e-f7a6-4b12-aefb-74b9fc4b85da tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:08.963210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b049925e-f7a6-4b12-aefb-74b9fc4b85da tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:08.963494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b049925e-f7a6-4b12-aefb-74b9fc4b85da tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:09.088524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b049925e-f7a6-4b12-aefb-74b9fc4b85da tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:09.098201 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b049925e-f7a6-4b12-aefb-74b9fc4b85da tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8" status: 200 len: 1277 microversion: 2.1 time: 0.154327 Oct 05 02:38:09.099329 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1301/2569] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:08 2022] GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8 => generated 1277 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:38:09.104850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-98c9c507-eae3-4fc3-8090-190536366479 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:09.106226 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-98c9c507-eae3-4fc3-8090-190536366479 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:09.113169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98c9c507-eae3-4fc3-8090-190536366479 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:09.113837 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98c9c507-eae3-4fc3-8090-190536366479 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:09.114425 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98c9c507-eae3-4fc3-8090-190536366479 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:09.115260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98c9c507-eae3-4fc3-8090-190536366479 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:09.115892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98c9c507-eae3-4fc3-8090-190536366479 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:09.116467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98c9c507-eae3-4fc3-8090-190536366479 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:09.163373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8c537d10-f0fc-4339-b367-b7298600ed2b tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d55412129f24e90b1caa99b3aea8c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be31ec89b1354d608d7de438f5cf519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:09.173513 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8c537d10-f0fc-4339-b367-b7298600ed2b tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d" status: 200 len: 1316 microversion: 2.1 time: 0.476901 Oct 05 02:38:09.174355 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1269/2570] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:08 2022] GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d => generated 1316 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:38:09.541336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f2852858-5494-4cd4-9eaf-380fe518275a tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:09.541959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f2852858-5494-4cd4-9eaf-380fe518275a tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: cdc1d61f-24f7-42ba-bd26-7a24227e5a01] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:09.552127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=14 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:09.562676 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f2852858-5494-4cd4-9eaf-380fe518275a tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:09.563384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f2852858-5494-4cd4-9eaf-380fe518275a tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:09.563979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f2852858-5494-4cd4-9eaf-380fe518275a tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:09.564881 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f2852858-5494-4cd4-9eaf-380fe518275a tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:09.565645 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f2852858-5494-4cd4-9eaf-380fe518275a tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:09.566078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f2852858-5494-4cd4-9eaf-380fe518275a tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:09.696186 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f2852858-5494-4cd4-9eaf-380fe518275a tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:09.699467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-98c9c507-eae3-4fc3-8090-190536366479 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:09.708866 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:09.710149 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-98c9c507-eae3-4fc3-8090-190536366479 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1313 microversion: 2.1 time: 0.609512 Oct 05 02:38:09.711580 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f2852858-5494-4cd4-9eaf-380fe518275a tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01" status: 200 len: 1226 microversion: 2.1 time: 0.175048 Oct 05 02:38:09.715072 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1270/2571] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:09 2022] GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01 => generated 1226 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:38:09.717549 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1302/2572] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:09 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1313 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:09.739490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ab0a23d6-ee16-4844-9f4b-d854f1ecb100 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:09.740633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ab0a23d6-ee16-4844-9f4b-d854f1ecb100 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] [instance: b834e68c-772a-45b6-857b-0cb285b1e320] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:09.751016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab0a23d6-ee16-4844-9f4b-d854f1ecb100 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:09.751860 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab0a23d6-ee16-4844-9f4b-d854f1ecb100 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:09.753247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab0a23d6-ee16-4844-9f4b-d854f1ecb100 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:09.754170 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab0a23d6-ee16-4844-9f4b-d854f1ecb100 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:09.754818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab0a23d6-ee16-4844-9f4b-d854f1ecb100 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:09.755406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab0a23d6-ee16-4844-9f4b-d854f1ecb100 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:09.857838 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ab0a23d6-ee16-4844-9f4b-d854f1ecb100 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110ebcc38ef34dfea40fe14ab2ad1b3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69def5e64d945428d420e737fecd987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:09.867730 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ab0a23d6-ee16-4844-9f4b-d854f1ecb100 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] 10.222.0.16 "GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320" status: 200 len: 1319 microversion: 2.1 time: 0.136065 Oct 05 02:38:09.872151 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1271/2573] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:09 2022] GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320 => generated 1319 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:10.125498 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-126abdbe-caad-4a31-9bfc-94cc6dc3c5ce tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:10.126110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-126abdbe-caad-4a31-9bfc-94cc6dc3c5ce tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 549e9e9b-0461-402c-a082-4f6a85a6e3c8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:10.133156 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-126abdbe-caad-4a31-9bfc-94cc6dc3c5ce tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:10.133648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-126abdbe-caad-4a31-9bfc-94cc6dc3c5ce tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:10.134083 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-126abdbe-caad-4a31-9bfc-94cc6dc3c5ce tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:10.134967 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-126abdbe-caad-4a31-9bfc-94cc6dc3c5ce tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:10.135416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-126abdbe-caad-4a31-9bfc-94cc6dc3c5ce tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:10.136021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-126abdbe-caad-4a31-9bfc-94cc6dc3c5ce tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:10.197877 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-554af9ec-bc37-4ebe-8e90-ff34e2fab808 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:10.198859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-554af9ec-bc37-4ebe-8e90-ff34e2fab808 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] [instance: 74b1ab94-3bc0-440d-bf57-dcab444e063d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:10.211945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-554af9ec-bc37-4ebe-8e90-ff34e2fab808 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:10.212613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-554af9ec-bc37-4ebe-8e90-ff34e2fab808 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:10.213084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-554af9ec-bc37-4ebe-8e90-ff34e2fab808 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:10.214127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-554af9ec-bc37-4ebe-8e90-ff34e2fab808 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:10.228185 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-554af9ec-bc37-4ebe-8e90-ff34e2fab808 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:10.228656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-554af9ec-bc37-4ebe-8e90-ff34e2fab808 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:10.498582 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-126abdbe-caad-4a31-9bfc-94cc6dc3c5ce tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:10.512173 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-126abdbe-caad-4a31-9bfc-94cc6dc3c5ce tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8" status: 200 len: 1319 microversion: 2.1 time: 0.392337 Oct 05 02:38:10.516372 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1303/2574] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:10 2022] GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8 => generated 1319 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:10.736141 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-02f70c40-f8bc-459f-89ed-3f70b10de916 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:10.736840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-02f70c40-f8bc-459f-89ed-3f70b10de916 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: cdc1d61f-24f7-42ba-bd26-7a24227e5a01] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:10.749206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02f70c40-f8bc-459f-89ed-3f70b10de916 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:10.749721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02f70c40-f8bc-459f-89ed-3f70b10de916 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:10.750163 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02f70c40-f8bc-459f-89ed-3f70b10de916 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:10.750879 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02f70c40-f8bc-459f-89ed-3f70b10de916 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:10.751332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02f70c40-f8bc-459f-89ed-3f70b10de916 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:10.751752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02f70c40-f8bc-459f-89ed-3f70b10de916 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:11.093550 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-02f70c40-f8bc-459f-89ed-3f70b10de916 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:11.124542 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-02f70c40-f8bc-459f-89ed-3f70b10de916 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01" status: 200 len: 1218 microversion: 2.1 time: 0.393036 Oct 05 02:38:11.134581 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1304/2575] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:10 2022] GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01 => generated 1218 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:11.162211 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2852fa2b-0c9c-4e75-bccd-1b9a956bd052 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:11.169456 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2852fa2b-0c9c-4e75-bccd-1b9a956bd052 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:11.170908 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-554af9ec-bc37-4ebe-8e90-ff34e2fab808 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d55412129f24e90b1caa99b3aea8c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be31ec89b1354d608d7de438f5cf519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:11.181415 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-554af9ec-bc37-4ebe-8e90-ff34e2fab808 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d" status: 200 len: 1316 microversion: 2.1 time: 0.988787 Oct 05 02:38:11.182827 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1272/2576] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:10 2022] GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d => generated 1316 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:38:11.193682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2852fa2b-0c9c-4e75-bccd-1b9a956bd052 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:11.195536 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2852fa2b-0c9c-4e75-bccd-1b9a956bd052 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:11.200915 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f6283891-52ae-4a9d-9d45-b8a6f358f768 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:11.202531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f6283891-52ae-4a9d-9d45-b8a6f358f768 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] [instance: b834e68c-772a-45b6-857b-0cb285b1e320] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:11.205003 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2852fa2b-0c9c-4e75-bccd-1b9a956bd052 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:11.208305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2852fa2b-0c9c-4e75-bccd-1b9a956bd052 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:11.209264 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2852fa2b-0c9c-4e75-bccd-1b9a956bd052 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:11.210084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2852fa2b-0c9c-4e75-bccd-1b9a956bd052 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:11.231816 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6283891-52ae-4a9d-9d45-b8a6f358f768 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:11.234597 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6283891-52ae-4a9d-9d45-b8a6f358f768 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:11.235836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6283891-52ae-4a9d-9d45-b8a6f358f768 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:11.239791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6283891-52ae-4a9d-9d45-b8a6f358f768 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:11.240555 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6283891-52ae-4a9d-9d45-b8a6f358f768 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:11.241025 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6283891-52ae-4a9d-9d45-b8a6f358f768 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:11.825578 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f6283891-52ae-4a9d-9d45-b8a6f358f768 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110ebcc38ef34dfea40fe14ab2ad1b3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69def5e64d945428d420e737fecd987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:11.841846 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f6283891-52ae-4a9d-9d45-b8a6f358f768 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] 10.222.0.16 "GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320" status: 200 len: 1325 microversion: 2.1 time: 0.657589 Oct 05 02:38:11.843456 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1273/2577] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:11 2022] GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320 => generated 1325 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:11.854125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-362dc9cc-2dda-42fe-964a-30834d8bd9fb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:11.855851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-362dc9cc-2dda-42fe-964a-30834d8bd9fb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 549e9e9b-0461-402c-a082-4f6a85a6e3c8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:11.863146 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-362dc9cc-2dda-42fe-964a-30834d8bd9fb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:11.863755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-362dc9cc-2dda-42fe-964a-30834d8bd9fb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:11.864188 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-362dc9cc-2dda-42fe-964a-30834d8bd9fb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:11.865915 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-362dc9cc-2dda-42fe-964a-30834d8bd9fb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:11.867353 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-362dc9cc-2dda-42fe-964a-30834d8bd9fb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:11.868145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-362dc9cc-2dda-42fe-964a-30834d8bd9fb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:13.401674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2852fa2b-0c9c-4e75-bccd-1b9a956bd052 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:13.424044 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2852fa2b-0c9c-4e75-bccd-1b9a956bd052 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1463 microversion: 2.1 time: 2.284374 Oct 05 02:38:13.427616 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1305/2578] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:11 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1463 bytes in 2291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:13.461563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ef3fafdc-d810-47ee-8571-1bdbcaceff16 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:13.468783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ef3fafdc-d810-47ee-8571-1bdbcaceff16 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: cdc1d61f-24f7-42ba-bd26-7a24227e5a01] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:13.491631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ef3fafdc-d810-47ee-8571-1bdbcaceff16 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:13.493114 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ef3fafdc-d810-47ee-8571-1bdbcaceff16 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:13.494753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ef3fafdc-d810-47ee-8571-1bdbcaceff16 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:13.496062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ef3fafdc-d810-47ee-8571-1bdbcaceff16 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:13.498388 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ef3fafdc-d810-47ee-8571-1bdbcaceff16 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:13.502968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ef3fafdc-d810-47ee-8571-1bdbcaceff16 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:13.812470 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-362dc9cc-2dda-42fe-964a-30834d8bd9fb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:13.822746 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-362dc9cc-2dda-42fe-964a-30834d8bd9fb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8" status: 200 len: 1319 microversion: 2.1 time: 1.977982 Oct 05 02:38:13.823339 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1274/2579] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:11 2022] GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8 => generated 1319 bytes in 1979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:13.844641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ef1aa8a5-7af5-4f3f-b85b-71e0a2d44bb5 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:13.847151 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ef1aa8a5-7af5-4f3f-b85b-71e0a2d44bb5 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] [instance: 74b1ab94-3bc0-440d-bf57-dcab444e063d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:13.857709 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef1aa8a5-7af5-4f3f-b85b-71e0a2d44bb5 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:13.859058 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef1aa8a5-7af5-4f3f-b85b-71e0a2d44bb5 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:13.860193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef1aa8a5-7af5-4f3f-b85b-71e0a2d44bb5 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:13.861088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef1aa8a5-7af5-4f3f-b85b-71e0a2d44bb5 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:13.861577 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef1aa8a5-7af5-4f3f-b85b-71e0a2d44bb5 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:13.862593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef1aa8a5-7af5-4f3f-b85b-71e0a2d44bb5 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:14.392166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ef3fafdc-d810-47ee-8571-1bdbcaceff16 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:14.401570 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ef3fafdc-d810-47ee-8571-1bdbcaceff16 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01" status: 200 len: 1322 microversion: 2.1 time: 0.953523 Oct 05 02:38:14.402672 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1306/2580] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:13 2022] GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01 => generated 1322 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:14.408046 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b9117da0-71cd-40b2-a6f4-0bb4707aafac tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:14.410243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b9117da0-71cd-40b2-a6f4-0bb4707aafac tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] [instance: b834e68c-772a-45b6-857b-0cb285b1e320] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:14.418944 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9117da0-71cd-40b2-a6f4-0bb4707aafac tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:14.420259 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9117da0-71cd-40b2-a6f4-0bb4707aafac tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:14.420928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9117da0-71cd-40b2-a6f4-0bb4707aafac tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:14.421936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9117da0-71cd-40b2-a6f4-0bb4707aafac tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:14.423293 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9117da0-71cd-40b2-a6f4-0bb4707aafac tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:14.424844 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9117da0-71cd-40b2-a6f4-0bb4707aafac tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:14.820318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ef1aa8a5-7af5-4f3f-b85b-71e0a2d44bb5 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d55412129f24e90b1caa99b3aea8c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be31ec89b1354d608d7de438f5cf519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:14.830878 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ef1aa8a5-7af5-4f3f-b85b-71e0a2d44bb5 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d" status: 200 len: 1316 microversion: 2.1 time: 0.994289 Oct 05 02:38:14.832422 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1275/2581] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:13 2022] GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d => generated 1316 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:15.133985 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8d0b0c8a-a2d2-4aa2-ab33-08534ffd1293 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:15.135016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8d0b0c8a-a2d2-4aa2-ab33-08534ffd1293 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:15.142837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d0b0c8a-a2d2-4aa2-ab33-08534ffd1293 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:15.143333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d0b0c8a-a2d2-4aa2-ab33-08534ffd1293 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:15.144389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d0b0c8a-a2d2-4aa2-ab33-08534ffd1293 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:15.145126 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d0b0c8a-a2d2-4aa2-ab33-08534ffd1293 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:15.145586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d0b0c8a-a2d2-4aa2-ab33-08534ffd1293 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:15.146009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d0b0c8a-a2d2-4aa2-ab33-08534ffd1293 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:15.505197 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b9117da0-71cd-40b2-a6f4-0bb4707aafac tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110ebcc38ef34dfea40fe14ab2ad1b3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69def5e64d945428d420e737fecd987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:15.513898 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b9117da0-71cd-40b2-a6f4-0bb4707aafac tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] 10.222.0.16 "GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320" status: 200 len: 1392 microversion: 2.1 time: 1.109300 Oct 05 02:38:15.517512 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1307/2582] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:14 2022] GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320 => generated 1392 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:15.525451 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-00f1afa3-bb85-4649-9b4c-027be2faa741 req-20ab4b87-34bf-4db7-a522-06190f1e40b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74b1ab94-3bc0-440d-bf57-dcab444e063d", "name": "network-vif-plugged", "status": "completed", "tag": "f76faa20-bd22-4858-915c-478dc55b243d"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:38:15.536712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-00f1afa3-bb85-4649-9b4c-027be2faa741 req-20ab4b87-34bf-4db7-a522-06190f1e40b5 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:15.537477 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-00f1afa3-bb85-4649-9b4c-027be2faa741 req-20ab4b87-34bf-4db7-a522-06190f1e40b5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:15.540344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-00f1afa3-bb85-4649-9b4c-027be2faa741 req-20ab4b87-34bf-4db7-a522-06190f1e40b5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:15.555727 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-00f1afa3-bb85-4649-9b4c-027be2faa741 req-20ab4b87-34bf-4db7-a522-06190f1e40b5 service nova] Creating event network-vif-plugged:f76faa20-bd22-4858-915c-478dc55b243d for instance 74b1ab94-3bc0-440d-bf57-dcab444e063d on n-h1-858272-3 Oct 05 02:38:15.562749 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-00f1afa3-bb85-4649-9b4c-027be2faa741 req-20ab4b87-34bf-4db7-a522-06190f1e40b5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043480 Oct 05 02:38:15.563800 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1308/2583] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:38:15.571775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-e11dd240-0eb5-462a-85ad-2c6cae953acb req-1c499527-56ec-4f0e-ab6a-1e529a7f801e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b834e68c-772a-45b6-857b-0cb285b1e320", "tag": "36f2563c-c845-4290-89b1-ae30ad6d77c8"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:38:15.586094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e11dd240-0eb5-462a-85ad-2c6cae953acb req-1c499527-56ec-4f0e-ab6a-1e529a7f801e service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:15.586889 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e11dd240-0eb5-462a-85ad-2c6cae953acb req-1c499527-56ec-4f0e-ab6a-1e529a7f801e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:15.587378 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e11dd240-0eb5-462a-85ad-2c6cae953acb req-1c499527-56ec-4f0e-ab6a-1e529a7f801e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:15.598800 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-e11dd240-0eb5-462a-85ad-2c6cae953acb req-1c499527-56ec-4f0e-ab6a-1e529a7f801e service nova] Creating event network-changed:36f2563c-c845-4290-89b1-ae30ad6d77c8 for instance b834e68c-772a-45b6-857b-0cb285b1e320 on n-h2-858272-3 Oct 05 02:38:15.605897 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-e11dd240-0eb5-462a-85ad-2c6cae953acb req-1c499527-56ec-4f0e-ab6a-1e529a7f801e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040279 Oct 05 02:38:15.607384 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1309/2584] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:38:15.613528 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-12eec379-9634-47fb-8a4e-72b9b3290a54 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:15.615065 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-12eec379-9634-47fb-8a4e-72b9b3290a54 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 549e9e9b-0461-402c-a082-4f6a85a6e3c8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:15.634103 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12eec379-9634-47fb-8a4e-72b9b3290a54 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:15.635826 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12eec379-9634-47fb-8a4e-72b9b3290a54 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:15.636487 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12eec379-9634-47fb-8a4e-72b9b3290a54 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:15.638767 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12eec379-9634-47fb-8a4e-72b9b3290a54 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:15.639573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12eec379-9634-47fb-8a4e-72b9b3290a54 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:15.640206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12eec379-9634-47fb-8a4e-72b9b3290a54 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:15.669754 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:16.341954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-12eec379-9634-47fb-8a4e-72b9b3290a54 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:16.352713 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-12eec379-9634-47fb-8a4e-72b9b3290a54 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8" status: 200 len: 1319 microversion: 2.1 time: 0.743678 Oct 05 02:38:16.353343 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1310/2585] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:15 2022] GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8 => generated 1319 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:16.365390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a9cd4221-c86a-4eb0-a9f4-c47206903c3c tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:16.369324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a9cd4221-c86a-4eb0-a9f4-c47206903c3c tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: cdc1d61f-24f7-42ba-bd26-7a24227e5a01] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:16.385798 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9cd4221-c86a-4eb0-a9f4-c47206903c3c tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:16.386575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9cd4221-c86a-4eb0-a9f4-c47206903c3c tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:16.386915 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9cd4221-c86a-4eb0-a9f4-c47206903c3c tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:16.387666 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9cd4221-c86a-4eb0-a9f4-c47206903c3c tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:16.388132 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9cd4221-c86a-4eb0-a9f4-c47206903c3c tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:16.388581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9cd4221-c86a-4eb0-a9f4-c47206903c3c tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:16.627603 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8d0b0c8a-a2d2-4aa2-ab33-08534ffd1293 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1614 microversion: 2.1 time: 1.793738 Oct 05 02:38:16.638568 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1276/2586] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:14 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1614 bytes in 1805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:16.643479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-b9f1d62c-cfcd-4cb9-8a07-a18cbd2d8297 req-c6ee1023-c243-47d3-ae8b-55a92b00d0ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d216853e-3fda-40f8-be89-56e8756c83a8", "tag": "3cf2d04a-41a2-41a4-999d-f04ae5c6e813"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:38:16.664324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b9f1d62c-cfcd-4cb9-8a07-a18cbd2d8297 req-c6ee1023-c243-47d3-ae8b-55a92b00d0ce service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:16.664827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b9f1d62c-cfcd-4cb9-8a07-a18cbd2d8297 req-c6ee1023-c243-47d3-ae8b-55a92b00d0ce service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:16.665294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b9f1d62c-cfcd-4cb9-8a07-a18cbd2d8297 req-c6ee1023-c243-47d3-ae8b-55a92b00d0ce service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:16.693851 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-b9f1d62c-cfcd-4cb9-8a07-a18cbd2d8297 req-c6ee1023-c243-47d3-ae8b-55a92b00d0ce service nova] Creating event network-changed:3cf2d04a-41a2-41a4-999d-f04ae5c6e813 for instance d216853e-3fda-40f8-be89-56e8756c83a8 on n-h1-858272-3 Oct 05 02:38:16.707277 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-b9f1d62c-cfcd-4cb9-8a07-a18cbd2d8297 req-c6ee1023-c243-47d3-ae8b-55a92b00d0ce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067310 Oct 05 02:38:16.710048 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1277/2587] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:38:16.723561 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d07b2f99-55be-4292-b42e-765ab0ae9c10 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:16.724646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d07b2f99-55be-4292-b42e-765ab0ae9c10 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] [instance: 74b1ab94-3bc0-440d-bf57-dcab444e063d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:16.735217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d07b2f99-55be-4292-b42e-765ab0ae9c10 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:16.736147 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d07b2f99-55be-4292-b42e-765ab0ae9c10 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:16.737231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d07b2f99-55be-4292-b42e-765ab0ae9c10 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:16.738583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d07b2f99-55be-4292-b42e-765ab0ae9c10 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:16.739450 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d07b2f99-55be-4292-b42e-765ab0ae9c10 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:16.740042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d07b2f99-55be-4292-b42e-765ab0ae9c10 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:17.050985 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a9cd4221-c86a-4eb0-a9f4-c47206903c3c tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:17.066491 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a9cd4221-c86a-4eb0-a9f4-c47206903c3c tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01" status: 200 len: 1322 microversion: 2.1 time: 0.705127 Oct 05 02:38:17.067549 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1311/2588] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:16 2022] GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01 => generated 1322 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:17.113276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-02326ddd-6197-47ea-8147-f233cb0a7eef tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:17.118184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-02326ddd-6197-47ea-8147-f233cb0a7eef tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] [instance: b834e68c-772a-45b6-857b-0cb285b1e320] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:17.151415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02326ddd-6197-47ea-8147-f233cb0a7eef tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:17.155128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02326ddd-6197-47ea-8147-f233cb0a7eef tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:17.155865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02326ddd-6197-47ea-8147-f233cb0a7eef tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:17.158436 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02326ddd-6197-47ea-8147-f233cb0a7eef tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:17.159191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02326ddd-6197-47ea-8147-f233cb0a7eef tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:17.160344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02326ddd-6197-47ea-8147-f233cb0a7eef tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:17.207814 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:17.238034 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d07b2f99-55be-4292-b42e-765ab0ae9c10 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d55412129f24e90b1caa99b3aea8c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be31ec89b1354d608d7de438f5cf519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:17.276627 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d07b2f99-55be-4292-b42e-765ab0ae9c10 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d" status: 200 len: 1316 microversion: 2.1 time: 0.556761 Oct 05 02:38:17.279399 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1278/2589] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:16 2022] GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d => generated 1316 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:17.299266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-032bed6d-6ea1-40d1-8155-a9773e33f75f tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:38:17.300253 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-032bed6d-6ea1-40d1-8155-a9773e33f75f tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:17.310305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-032bed6d-6ea1-40d1-8155-a9773e33f75f tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:17.311018 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-032bed6d-6ea1-40d1-8155-a9773e33f75f tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:17.311733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-032bed6d-6ea1-40d1-8155-a9773e33f75f tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:17.312557 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-032bed6d-6ea1-40d1-8155-a9773e33f75f tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:17.313189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-032bed6d-6ea1-40d1-8155-a9773e33f75f tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:17.313735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-032bed6d-6ea1-40d1-8155-a9773e33f75f tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:17.439597 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-032bed6d-6ea1-40d1-8155-a9773e33f75f tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '5bda07d8c2fa4f64b27d6eff9c821472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42e21e5ff8247d2b2fc27a30b7a4fd9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:17.440873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-032bed6d-6ea1-40d1-8155-a9773e33f75f tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] [instance: ac919870-2512-4424-bea6-b003534ce678] flavor_id is None. Assuming migration. {{(pid=122319) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 05 02:38:17.442061 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-032bed6d-6ea1-40d1-8155-a9773e33f75f tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] [instance: ac919870-2512-4424-bea6-b003534ce678] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122319) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 05 02:38:17.821285 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-032bed6d-6ea1-40d1-8155-a9773e33f75f tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678/action" status: 202 len: 0 microversion: 2.1 time: 0.537959 Oct 05 02:38:17.824538 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1279/2590] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:38:17 2022] POST /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678/action => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:38:17.847865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7b824091-fc6b-4f08-a880-97f8e30cf661 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:17.848557 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7b824091-fc6b-4f08-a880-97f8e30cf661 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 549e9e9b-0461-402c-a082-4f6a85a6e3c8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:17.857928 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b824091-fc6b-4f08-a880-97f8e30cf661 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:17.859051 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b824091-fc6b-4f08-a880-97f8e30cf661 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:17.859798 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b824091-fc6b-4f08-a880-97f8e30cf661 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:17.860778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b824091-fc6b-4f08-a880-97f8e30cf661 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:17.861538 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b824091-fc6b-4f08-a880-97f8e30cf661 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:17.862184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b824091-fc6b-4f08-a880-97f8e30cf661 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:18.127446 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-02326ddd-6197-47ea-8147-f233cb0a7eef tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110ebcc38ef34dfea40fe14ab2ad1b3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69def5e64d945428d420e737fecd987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:18.184868 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-02326ddd-6197-47ea-8147-f233cb0a7eef tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] 10.222.0.16 "GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320" status: 200 len: 1392 microversion: 2.1 time: 1.111537 Oct 05 02:38:18.187878 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1312/2591] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:17 2022] GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320 => generated 1392 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:18.202443 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=10 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:18.209728 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a07e4696-87ec-4f37-bba7-2b5379ecb83c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:18.213736 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a07e4696-87ec-4f37-bba7-2b5379ecb83c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:18.241433 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a07e4696-87ec-4f37-bba7-2b5379ecb83c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:18.244587 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a07e4696-87ec-4f37-bba7-2b5379ecb83c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:18.245977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a07e4696-87ec-4f37-bba7-2b5379ecb83c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:18.252265 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a07e4696-87ec-4f37-bba7-2b5379ecb83c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:18.253914 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a07e4696-87ec-4f37-bba7-2b5379ecb83c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:18.255333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a07e4696-87ec-4f37-bba7-2b5379ecb83c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:18.509425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=48 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:18.702118 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=24 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:18.901854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7b824091-fc6b-4f08-a880-97f8e30cf661 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:18.915054 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7b824091-fc6b-4f08-a880-97f8e30cf661 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8" status: 200 len: 1319 microversion: 2.1 time: 1.087324 Oct 05 02:38:18.929200 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1280/2592] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:17 2022] GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8 => generated 1319 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:18.929200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ebeeca73-fc8a-4a09-9c30-cc0ddb5e8707 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:18.929200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ebeeca73-fc8a-4a09-9c30-cc0ddb5e8707 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: cdc1d61f-24f7-42ba-bd26-7a24227e5a01] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:18.929200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ebeeca73-fc8a-4a09-9c30-cc0ddb5e8707 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:18.929200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ebeeca73-fc8a-4a09-9c30-cc0ddb5e8707 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:18.929200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ebeeca73-fc8a-4a09-9c30-cc0ddb5e8707 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:18.932530 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ebeeca73-fc8a-4a09-9c30-cc0ddb5e8707 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:18.934175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ebeeca73-fc8a-4a09-9c30-cc0ddb5e8707 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:18.934872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ebeeca73-fc8a-4a09-9c30-cc0ddb5e8707 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:19.197644 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a07e4696-87ec-4f37-bba7-2b5379ecb83c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:19.214137 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a07e4696-87ec-4f37-bba7-2b5379ecb83c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1472 microversion: 2.1 time: 1.017540 Oct 05 02:38:19.217259 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1313/2593] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:18 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1472 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:19.233973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-88ca5b7e-82cb-40b4-bc95-fa40c59ca9db req-e9a74ba9-7e45-474f-b2f8-b5131a29d0d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdc1d61f-24f7-42ba-bd26-7a24227e5a01", "tag": "272c88c7-585e-43bb-a269-108e1cd243eb"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:38:19.249101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-88ca5b7e-82cb-40b4-bc95-fa40c59ca9db req-e9a74ba9-7e45-474f-b2f8-b5131a29d0d9 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:19.249711 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-88ca5b7e-82cb-40b4-bc95-fa40c59ca9db req-e9a74ba9-7e45-474f-b2f8-b5131a29d0d9 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:19.250266 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-88ca5b7e-82cb-40b4-bc95-fa40c59ca9db req-e9a74ba9-7e45-474f-b2f8-b5131a29d0d9 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:19.266529 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-88ca5b7e-82cb-40b4-bc95-fa40c59ca9db req-e9a74ba9-7e45-474f-b2f8-b5131a29d0d9 service nova] Creating event network-changed:272c88c7-585e-43bb-a269-108e1cd243eb for instance cdc1d61f-24f7-42ba-bd26-7a24227e5a01 on n-h1-858272-3 Oct 05 02:38:19.272986 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-88ca5b7e-82cb-40b4-bc95-fa40c59ca9db req-e9a74ba9-7e45-474f-b2f8-b5131a29d0d9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051072 Oct 05 02:38:19.274606 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1314/2594] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:38:19.282686 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6104185a-0366-4c05-b57d-b569d3a2994a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:19.284586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6104185a-0366-4c05-b57d-b569d3a2994a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] [instance: 74b1ab94-3bc0-440d-bf57-dcab444e063d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:19.293303 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6104185a-0366-4c05-b57d-b569d3a2994a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:19.294034 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6104185a-0366-4c05-b57d-b569d3a2994a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:19.295163 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6104185a-0366-4c05-b57d-b569d3a2994a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:19.296812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6104185a-0366-4c05-b57d-b569d3a2994a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:19.297512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6104185a-0366-4c05-b57d-b569d3a2994a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:19.298608 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6104185a-0366-4c05-b57d-b569d3a2994a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:19.321384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ebeeca73-fc8a-4a09-9c30-cc0ddb5e8707 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:19.333895 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ebeeca73-fc8a-4a09-9c30-cc0ddb5e8707 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01" status: 200 len: 1322 microversion: 2.1 time: 0.416702 Oct 05 02:38:19.353500 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1281/2595] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:18 2022] GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01 => generated 1322 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:19.358612 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-4de27e3e-4185-4814-ba09-846a69b9bdb0 req-bfaebbb5-4753-40e7-992d-6615a56fefd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "549e9e9b-0461-402c-a082-4f6a85a6e3c8", "tag": "7468d644-c04f-44fd-8a69-34556f7a751d"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:38:19.370942 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4de27e3e-4185-4814-ba09-846a69b9bdb0 req-bfaebbb5-4753-40e7-992d-6615a56fefd8 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:19.371833 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4de27e3e-4185-4814-ba09-846a69b9bdb0 req-bfaebbb5-4753-40e7-992d-6615a56fefd8 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:19.373685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4de27e3e-4185-4814-ba09-846a69b9bdb0 req-bfaebbb5-4753-40e7-992d-6615a56fefd8 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:19.387976 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-4de27e3e-4185-4814-ba09-846a69b9bdb0 req-bfaebbb5-4753-40e7-992d-6615a56fefd8 service nova] Creating event network-changed:7468d644-c04f-44fd-8a69-34556f7a751d for instance 549e9e9b-0461-402c-a082-4f6a85a6e3c8 on n-h1-858272-3 Oct 05 02:38:19.393288 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-4de27e3e-4185-4814-ba09-846a69b9bdb0 req-bfaebbb5-4753-40e7-992d-6615a56fefd8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038459 Oct 05 02:38:19.394251 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1282/2596] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:38:19.400592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fe84410f-9d6a-4456-89a7-7d27585a509a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:19.401756 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fe84410f-9d6a-4456-89a7-7d27585a509a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] [instance: b834e68c-772a-45b6-857b-0cb285b1e320] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:19.411790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fe84410f-9d6a-4456-89a7-7d27585a509a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:19.412579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fe84410f-9d6a-4456-89a7-7d27585a509a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:19.413213 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fe84410f-9d6a-4456-89a7-7d27585a509a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:19.414179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fe84410f-9d6a-4456-89a7-7d27585a509a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:19.414802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fe84410f-9d6a-4456-89a7-7d27585a509a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:19.415538 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fe84410f-9d6a-4456-89a7-7d27585a509a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:19.896771 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6104185a-0366-4c05-b57d-b569d3a2994a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d55412129f24e90b1caa99b3aea8c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be31ec89b1354d608d7de438f5cf519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:19.909463 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6104185a-0366-4c05-b57d-b569d3a2994a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d" status: 200 len: 1465 microversion: 2.1 time: 0.632529 Oct 05 02:38:19.917047 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1315/2597] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:19 2022] GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d => generated 1465 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:19.938351 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0afc557a-49d1-4b87-9678-4ad6db05e41f tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1445583940", "metadata": {"image_type": "test"}}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:38:19.941992 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0afc557a-49d1-4b87-9678-4ad6db05e41f tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] [instance: 74b1ab94-3bc0-440d-bf57-dcab444e063d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:19.950038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0afc557a-49d1-4b87-9678-4ad6db05e41f tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:19.950801 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0afc557a-49d1-4b87-9678-4ad6db05e41f tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:19.951451 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0afc557a-49d1-4b87-9678-4ad6db05e41f tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:19.952315 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0afc557a-49d1-4b87-9678-4ad6db05e41f tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:19.953004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0afc557a-49d1-4b87-9678-4ad6db05e41f tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:19.953973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0afc557a-49d1-4b87-9678-4ad6db05e41f tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:19.998440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-0afc557a-49d1-4b87-9678-4ad6db05e41f tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Getting quotas for project be31ec89b1354d608d7de438f5cf519d. Resources: dict_keys(['metadata_items']) {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:38:20.010245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-0afc557a-49d1-4b87-9678-4ad6db05e41f tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Getting quotas for user 2d55412129f24e90b1caa99b3aea8c61 and project be31ec89b1354d608d7de438f5cf519d. Resources: dict_keys(['metadata_items']) {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:38:20.027445 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fe84410f-9d6a-4456-89a7-7d27585a509a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110ebcc38ef34dfea40fe14ab2ad1b3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69def5e64d945428d420e737fecd987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:20.038744 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fe84410f-9d6a-4456-89a7-7d27585a509a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] 10.222.0.16 "GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320" status: 200 len: 1392 microversion: 2.1 time: 0.643047 Oct 05 02:38:20.049808 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1283/2598] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:19 2022] GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320 => generated 1392 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:20.071570 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0ef9fd09-9450-4861-b2a4-3869d653a7f0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:20.072466 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0ef9fd09-9450-4861-b2a4-3869d653a7f0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 549e9e9b-0461-402c-a082-4f6a85a6e3c8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:20.079035 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ef9fd09-9450-4861-b2a4-3869d653a7f0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:20.079746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ef9fd09-9450-4861-b2a4-3869d653a7f0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:20.080332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ef9fd09-9450-4861-b2a4-3869d653a7f0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:20.081392 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ef9fd09-9450-4861-b2a4-3869d653a7f0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:20.081997 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ef9fd09-9450-4861-b2a4-3869d653a7f0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:20.082571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ef9fd09-9450-4861-b2a4-3869d653a7f0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:20.354202 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0afc557a-49d1-4b87-9678-4ad6db05e41f tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "POST /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d/action" status: 202 len: 0 microversion: 2.1 time: 0.421474 Oct 05 02:38:20.355304 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1316/2599] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:38:19 2022] POST /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d/action => generated 0 bytes in 423 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 05 02:38:20.368233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e973d0f5-ca4c-4b5d-821c-c62f3cc56959 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:20.370440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e973d0f5-ca4c-4b5d-821c-c62f3cc56959 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:20.389527 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e973d0f5-ca4c-4b5d-821c-c62f3cc56959 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:20.392265 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e973d0f5-ca4c-4b5d-821c-c62f3cc56959 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:20.394243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e973d0f5-ca4c-4b5d-821c-c62f3cc56959 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:20.396024 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e973d0f5-ca4c-4b5d-821c-c62f3cc56959 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:20.396775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e973d0f5-ca4c-4b5d-821c-c62f3cc56959 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:20.397406 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e973d0f5-ca4c-4b5d-821c-c62f3cc56959 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:20.400880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0ef9fd09-9450-4861-b2a4-3869d653a7f0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:20.413420 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0ef9fd09-9450-4861-b2a4-3869d653a7f0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8" status: 200 len: 1319 microversion: 2.1 time: 0.362572 Oct 05 02:38:20.414425 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1284/2600] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:20 2022] GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8 => generated 1319 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:20.422225 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e78450e1-7124-49f1-be63-fa387027d9b5 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:20.425240 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e78450e1-7124-49f1-be63-fa387027d9b5 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: cdc1d61f-24f7-42ba-bd26-7a24227e5a01] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:20.442733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e78450e1-7124-49f1-be63-fa387027d9b5 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:20.443596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e78450e1-7124-49f1-be63-fa387027d9b5 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:20.444223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e78450e1-7124-49f1-be63-fa387027d9b5 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:20.445717 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e78450e1-7124-49f1-be63-fa387027d9b5 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:20.449976 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e78450e1-7124-49f1-be63-fa387027d9b5 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:20.450600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e78450e1-7124-49f1-be63-fa387027d9b5 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:20.948857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e973d0f5-ca4c-4b5d-821c-c62f3cc56959 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:20.985848 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e973d0f5-ca4c-4b5d-821c-c62f3cc56959 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1472 microversion: 2.1 time: 0.622512 Oct 05 02:38:20.986901 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1317/2601] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:20 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1472 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:21.016024 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e0a1ee36-8099-4d82-a0a1-7b54b8eac364 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fcce4325820>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:21.075532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e78450e1-7124-49f1-be63-fa387027d9b5 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:21.093565 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e78450e1-7124-49f1-be63-fa387027d9b5 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01" status: 200 len: 1322 microversion: 2.1 time: 0.670697 Oct 05 02:38:21.095725 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1285/2602] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:20 2022] GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01 => generated 1322 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:21.105631 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e0a1ee36-8099-4d82-a0a1-7b54b8eac364 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700" status: 200 len: 1424 microversion: 2.1 time: 0.114188 Oct 05 02:38:21.106837 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1318/2603] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:20 2022] GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700 => generated 1424 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:21.111981 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-32ea0320-48bc-4521-ad8b-750ebc09508c tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:21.112862 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-32ea0320-48bc-4521-ad8b-750ebc09508c tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] [instance: b834e68c-772a-45b6-857b-0cb285b1e320] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:21.121904 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32ea0320-48bc-4521-ad8b-750ebc09508c tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:21.122690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32ea0320-48bc-4521-ad8b-750ebc09508c tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:21.123544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32ea0320-48bc-4521-ad8b-750ebc09508c tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:21.124484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32ea0320-48bc-4521-ad8b-750ebc09508c tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:21.125200 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32ea0320-48bc-4521-ad8b-750ebc09508c tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:21.125869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32ea0320-48bc-4521-ad8b-750ebc09508c tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:21.325053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f0a12d43-9efe-48e0-91ee-76e182cb3b55 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-194898305", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": "none"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:38:21.446743 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-f0a12d43-9efe-48e0-91ee-76e182cb3b55 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:38:21.447175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-f0a12d43-9efe-48e0-91ee-76e182cb3b55 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:38:21.454318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-f0a12d43-9efe-48e0-91ee-76e182cb3b55 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:38:21.454763 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-f0a12d43-9efe-48e0-91ee-76e182cb3b55 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:38:21.455180 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-f0a12d43-9efe-48e0-91ee-76e182cb3b55 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:38:21.478095 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0a12d43-9efe-48e0-91ee-76e182cb3b55 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:21.480983 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0a12d43-9efe-48e0-91ee-76e182cb3b55 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:21.481715 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0a12d43-9efe-48e0-91ee-76e182cb3b55 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:21.483101 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0a12d43-9efe-48e0-91ee-76e182cb3b55 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:21.484156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0a12d43-9efe-48e0-91ee-76e182cb3b55 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:21.484758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0a12d43-9efe-48e0-91ee-76e182cb3b55 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:21.521530 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-f0a12d43-9efe-48e0-91ee-76e182cb3b55 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Getting quotas for project 25750c409a734a778294ca66299d4616. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:38:21.535608 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-f0a12d43-9efe-48e0-91ee-76e182cb3b55 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Getting quotas for user 172b2bb2caeb439f858fc7b0eb04f3bf and project 25750c409a734a778294ca66299d4616. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:38:21.569468 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f0a12d43-9efe-48e0-91ee-76e182cb3b55 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:38:21.572760 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f0a12d43-9efe-48e0-91ee-76e182cb3b55 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] [instance: 40d4b47d-383b-4342-a6d7-27725c71fb1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:38:21.701497 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f0a12d43-9efe-48e0-91ee-76e182cb3b55 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.604066 Oct 05 02:38:21.702140 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1286/2604] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 5 02:38:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 05 02:38:21.714638 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e7547f0f-cef8-410c-aaa4-6006a7d9d7b8 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:21.715264 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e7547f0f-cef8-410c-aaa4-6006a7d9d7b8 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 549e9e9b-0461-402c-a082-4f6a85a6e3c8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:21.732230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7547f0f-cef8-410c-aaa4-6006a7d9d7b8 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:21.732662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7547f0f-cef8-410c-aaa4-6006a7d9d7b8 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:21.733137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7547f0f-cef8-410c-aaa4-6006a7d9d7b8 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:21.734108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7547f0f-cef8-410c-aaa4-6006a7d9d7b8 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:21.734973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7547f0f-cef8-410c-aaa4-6006a7d9d7b8 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:21.735403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7547f0f-cef8-410c-aaa4-6006a7d9d7b8 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:22.015049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-32ea0320-48bc-4521-ad8b-750ebc09508c tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110ebcc38ef34dfea40fe14ab2ad1b3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69def5e64d945428d420e737fecd987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:22.044435 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-32ea0320-48bc-4521-ad8b-750ebc09508c tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] 10.222.0.16 "GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320" status: 200 len: 1392 microversion: 2.1 time: 0.936253 Oct 05 02:38:22.049540 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1319/2605] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:21 2022] GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320 => generated 1392 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:22.081341 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-f256497d-62c2-4ee3-8224-a37a267361b8 req-28add6d9-9630-4104-9efe-cc38adf37103 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40fd6f92-87b8-452f-827f-1bf2b2be98a9", "tag": "f61119f0-472d-44b2-b03a-8638b346f14e"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:38:22.099753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f256497d-62c2-4ee3-8224-a37a267361b8 req-28add6d9-9630-4104-9efe-cc38adf37103 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:22.100234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f256497d-62c2-4ee3-8224-a37a267361b8 req-28add6d9-9630-4104-9efe-cc38adf37103 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:22.101616 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f256497d-62c2-4ee3-8224-a37a267361b8 req-28add6d9-9630-4104-9efe-cc38adf37103 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:22.117231 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-f256497d-62c2-4ee3-8224-a37a267361b8 req-28add6d9-9630-4104-9efe-cc38adf37103 service nova] Creating event network-changed:f61119f0-472d-44b2-b03a-8638b346f14e for instance 40fd6f92-87b8-452f-827f-1bf2b2be98a9 on n-h2-858272-3 Oct 05 02:38:22.130367 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-f256497d-62c2-4ee3-8224-a37a267361b8 req-28add6d9-9630-4104-9efe-cc38adf37103 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064192 Oct 05 02:38:22.131207 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1320/2606] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:38:22.143142 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d86fbb67-522b-40e4-a105-6bda0dd7a1f5 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:22.143877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d86fbb67-522b-40e4-a105-6bda0dd7a1f5 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] [instance: 40d4b47d-383b-4342-a6d7-27725c71fb1d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:22.232070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e7547f0f-cef8-410c-aaa4-6006a7d9d7b8 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:22.234909 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:22.251318 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e7547f0f-cef8-410c-aaa4-6006a7d9d7b8 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8" status: 200 len: 1319 microversion: 2.1 time: 0.543636 Oct 05 02:38:22.266170 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1287/2607] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:21 2022] GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8 => generated 1319 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:22.266170 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-1ab9dbfb-2a60-47e9-a1e1-84d5639a9087 req-db9cd5d1-c557-421d-b3d1-89fa3cb9cbeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b834e68c-772a-45b6-857b-0cb285b1e320", "name": "network-vif-plugged", "status": "completed", "tag": "36f2563c-c845-4290-89b1-ae30ad6d77c8"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:38:22.283630 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d86fbb67-522b-40e4-a105-6bda0dd7a1f5 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:22.288805 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1ab9dbfb-2a60-47e9-a1e1-84d5639a9087 req-db9cd5d1-c557-421d-b3d1-89fa3cb9cbeb service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:22.291697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1ab9dbfb-2a60-47e9-a1e1-84d5639a9087 req-db9cd5d1-c557-421d-b3d1-89fa3cb9cbeb service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:22.292591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1ab9dbfb-2a60-47e9-a1e1-84d5639a9087 req-db9cd5d1-c557-421d-b3d1-89fa3cb9cbeb service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:22.302715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d86fbb67-522b-40e4-a105-6bda0dd7a1f5 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:22.304874 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d86fbb67-522b-40e4-a105-6bda0dd7a1f5 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:22.306066 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d86fbb67-522b-40e4-a105-6bda0dd7a1f5 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] 10.222.0.16 "GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d" status: 200 len: 1280 microversion: 2.47 time: 0.169626 Oct 05 02:38:22.306644 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1321/2608] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:38:22 2022] GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d => generated 1280 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:38:22.320618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-56deb1a1-5c9b-423f-98fd-060737682df3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:22.322331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-56deb1a1-5c9b-423f-98fd-060737682df3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:22.334942 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-1ab9dbfb-2a60-47e9-a1e1-84d5639a9087 req-db9cd5d1-c557-421d-b3d1-89fa3cb9cbeb service nova] Creating event network-vif-plugged:36f2563c-c845-4290-89b1-ae30ad6d77c8 for instance b834e68c-772a-45b6-857b-0cb285b1e320 on n-h2-858272-3 Oct 05 02:38:22.337471 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56deb1a1-5c9b-423f-98fd-060737682df3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:22.337952 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56deb1a1-5c9b-423f-98fd-060737682df3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:22.338390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56deb1a1-5c9b-423f-98fd-060737682df3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:22.339102 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56deb1a1-5c9b-423f-98fd-060737682df3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:22.339563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56deb1a1-5c9b-423f-98fd-060737682df3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:22.339988 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56deb1a1-5c9b-423f-98fd-060737682df3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:22.347292 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-1ab9dbfb-2a60-47e9-a1e1-84d5639a9087 req-db9cd5d1-c557-421d-b3d1-89fa3cb9cbeb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093857 Oct 05 02:38:22.350734 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1288/2609] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:38:22.365240 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-70159e78-92a2-4c14-8df0-249e76443d6b tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:22.366114 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-70159e78-92a2-4c14-8df0-249e76443d6b tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: cdc1d61f-24f7-42ba-bd26-7a24227e5a01] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:22.380699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-70159e78-92a2-4c14-8df0-249e76443d6b tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:22.385342 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-70159e78-92a2-4c14-8df0-249e76443d6b tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:22.387513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-70159e78-92a2-4c14-8df0-249e76443d6b tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:22.389012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-70159e78-92a2-4c14-8df0-249e76443d6b tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:22.389867 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-70159e78-92a2-4c14-8df0-249e76443d6b tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:22.390884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-70159e78-92a2-4c14-8df0-249e76443d6b tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:23.192680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-70159e78-92a2-4c14-8df0-249e76443d6b tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:23.211217 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-70159e78-92a2-4c14-8df0-249e76443d6b tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01" status: 200 len: 1322 microversion: 2.1 time: 0.857595 Oct 05 02:38:23.215517 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-56deb1a1-5c9b-423f-98fd-060737682df3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:23.220053 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1289/2610] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:22 2022] GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01 => generated 1322 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:23.230527 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-56deb1a1-5c9b-423f-98fd-060737682df3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1472 microversion: 2.1 time: 0.916218 Oct 05 02:38:23.231098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-68532345-b8b9-4983-a994-5162ac11edc3 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fcce80c2b80>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:23.246299 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1322/2611] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:22 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1472 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:23.255920 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-75723de5-f096-4d32-bb5d-0311d0824eba tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:23.257293 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-75723de5-f096-4d32-bb5d-0311d0824eba tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] [instance: b834e68c-772a-45b6-857b-0cb285b1e320] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:23.265617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75723de5-f096-4d32-bb5d-0311d0824eba tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:23.266701 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75723de5-f096-4d32-bb5d-0311d0824eba tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:23.267375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75723de5-f096-4d32-bb5d-0311d0824eba tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:23.268241 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75723de5-f096-4d32-bb5d-0311d0824eba tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:23.269215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75723de5-f096-4d32-bb5d-0311d0824eba tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:23.269853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75723de5-f096-4d32-bb5d-0311d0824eba tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:23.293333 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-68532345-b8b9-4983-a994-5162ac11edc3 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700" status: 200 len: 1424 microversion: 2.1 time: 0.071777 Oct 05 02:38:23.293911 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1290/2612] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:23 2022] GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700 => generated 1424 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:23.308215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7b2d7728-8c4b-4624-add1-908e7e05df20 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:23.309879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7b2d7728-8c4b-4624-add1-908e7e05df20 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 549e9e9b-0461-402c-a082-4f6a85a6e3c8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:23.317928 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b2d7728-8c4b-4624-add1-908e7e05df20 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:23.318667 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b2d7728-8c4b-4624-add1-908e7e05df20 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:23.319283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b2d7728-8c4b-4624-add1-908e7e05df20 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:23.320933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b2d7728-8c4b-4624-add1-908e7e05df20 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:23.321637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b2d7728-8c4b-4624-add1-908e7e05df20 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:23.322219 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b2d7728-8c4b-4624-add1-908e7e05df20 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:23.559938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-75723de5-f096-4d32-bb5d-0311d0824eba tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110ebcc38ef34dfea40fe14ab2ad1b3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69def5e64d945428d420e737fecd987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:23.567595 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-75723de5-f096-4d32-bb5d-0311d0824eba tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] 10.222.0.16 "GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320" status: 200 len: 1392 microversion: 2.1 time: 0.319837 Oct 05 02:38:23.579453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7b2d7728-8c4b-4624-add1-908e7e05df20 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:23.581429 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1323/2613] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:23 2022] GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320 => generated 1392 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:23.587532 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7b2d7728-8c4b-4624-add1-908e7e05df20 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8" status: 200 len: 1319 microversion: 2.1 time: 0.285395 Oct 05 02:38:23.588713 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1291/2614] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:23 2022] GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8 => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:23.589376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8ef74f99-4e33-467c-9ae0-657e0d3437b8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:23.590006 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8ef74f99-4e33-467c-9ae0-657e0d3437b8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] [instance: 40d4b47d-383b-4342-a6d7-27725c71fb1d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:23.597982 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ef74f99-4e33-467c-9ae0-657e0d3437b8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:23.599323 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ef74f99-4e33-467c-9ae0-657e0d3437b8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:23.599934 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ef74f99-4e33-467c-9ae0-657e0d3437b8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:23.600782 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ef74f99-4e33-467c-9ae0-657e0d3437b8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:23.602206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ef74f99-4e33-467c-9ae0-657e0d3437b8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:23.602796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ef74f99-4e33-467c-9ae0-657e0d3437b8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:23.750450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8ef74f99-4e33-467c-9ae0-657e0d3437b8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:23.761304 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8ef74f99-4e33-467c-9ae0-657e0d3437b8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:23.763136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8ef74f99-4e33-467c-9ae0-657e0d3437b8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:23.764546 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8ef74f99-4e33-467c-9ae0-657e0d3437b8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] 10.222.0.16 "GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d" status: 200 len: 1332 microversion: 2.47 time: 0.181975 Oct 05 02:38:23.765362 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1324/2615] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:38:23 2022] GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d => generated 1332 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:38:24.165203 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-1a27934b-c7af-461a-9b9a-d22928760357 req-ad970c60-5fb4-497e-9226-02f076c71e47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47c8d34c-c7ca-4b8d-ba7e-72ce986a0985", "tag": "2602e55b-b283-44a9-82fe-eba44cd72b1b"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:38:24.175899 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1a27934b-c7af-461a-9b9a-d22928760357 req-ad970c60-5fb4-497e-9226-02f076c71e47 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:24.176698 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1a27934b-c7af-461a-9b9a-d22928760357 req-ad970c60-5fb4-497e-9226-02f076c71e47 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:24.177439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1a27934b-c7af-461a-9b9a-d22928760357 req-ad970c60-5fb4-497e-9226-02f076c71e47 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:24.189669 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-1a27934b-c7af-461a-9b9a-d22928760357 req-ad970c60-5fb4-497e-9226-02f076c71e47 service nova] Creating event network-changed:2602e55b-b283-44a9-82fe-eba44cd72b1b for instance 47c8d34c-c7ca-4b8d-ba7e-72ce986a0985 on n-h2-858272-3 Oct 05 02:38:24.195520 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-1a27934b-c7af-461a-9b9a-d22928760357 req-ad970c60-5fb4-497e-9226-02f076c71e47 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033773 Oct 05 02:38:24.196717 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1292/2616] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:38:24.243114 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-63f797a0-17ad-43be-8ed6-21523bff7a15 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:24.243114 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-63f797a0-17ad-43be-8ed6-21523bff7a15 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: cdc1d61f-24f7-42ba-bd26-7a24227e5a01] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:24.259596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4be47051-b490-4e5f-b464-3829f48f31c1 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:24.260669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4be47051-b490-4e5f-b464-3829f48f31c1 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:24.264147 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63f797a0-17ad-43be-8ed6-21523bff7a15 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:24.264653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63f797a0-17ad-43be-8ed6-21523bff7a15 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:24.265119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63f797a0-17ad-43be-8ed6-21523bff7a15 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:24.265825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63f797a0-17ad-43be-8ed6-21523bff7a15 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:24.266277 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63f797a0-17ad-43be-8ed6-21523bff7a15 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:24.266697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63f797a0-17ad-43be-8ed6-21523bff7a15 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:24.278196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4be47051-b490-4e5f-b464-3829f48f31c1 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:24.279983 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4be47051-b490-4e5f-b464-3829f48f31c1 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:24.280692 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4be47051-b490-4e5f-b464-3829f48f31c1 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:24.281762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4be47051-b490-4e5f-b464-3829f48f31c1 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:24.282497 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4be47051-b490-4e5f-b464-3829f48f31c1 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:24.283148 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4be47051-b490-4e5f-b464-3829f48f31c1 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:24.712737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-63f797a0-17ad-43be-8ed6-21523bff7a15 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:24.721945 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-63f797a0-17ad-43be-8ed6-21523bff7a15 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01" status: 200 len: 1322 microversion: 2.1 time: 0.483393 Oct 05 02:38:24.723203 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1325/2617] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:24 2022] GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01 => generated 1322 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:24.730026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8056f8d7-5352-4764-b327-a5ad10380b53 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fcce43253a0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:24.741749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4be47051-b490-4e5f-b464-3829f48f31c1 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:24.752870 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4be47051-b490-4e5f-b464-3829f48f31c1 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1472 microversion: 2.1 time: 0.498005 Oct 05 02:38:24.754324 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1293/2618] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:24 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1472 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:24.772066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-cc108b46-0af0-46c2-bd19-d82c482ef699 req-b4f62f7c-6051-4957-a207-69a9779f9672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d216853e-3fda-40f8-be89-56e8756c83a8", "name": "network-vif-plugged", "status": "completed", "tag": "3cf2d04a-41a2-41a4-999d-f04ae5c6e813"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:38:24.783951 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-cc108b46-0af0-46c2-bd19-d82c482ef699 req-b4f62f7c-6051-4957-a207-69a9779f9672 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:24.784746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-cc108b46-0af0-46c2-bd19-d82c482ef699 req-b4f62f7c-6051-4957-a207-69a9779f9672 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:24.785416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-cc108b46-0af0-46c2-bd19-d82c482ef699 req-b4f62f7c-6051-4957-a207-69a9779f9672 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:24.785707 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8056f8d7-5352-4764-b327-a5ad10380b53 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700" status: 200 len: 1424 microversion: 2.1 time: 0.061175 Oct 05 02:38:24.790800 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1326/2619] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:24 2022] GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700 => generated 1424 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:24.795721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b08b36b1-df0f-47ef-94df-33e893629095 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:24.796338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b08b36b1-df0f-47ef-94df-33e893629095 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] [instance: b834e68c-772a-45b6-857b-0cb285b1e320] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:24.805402 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b08b36b1-df0f-47ef-94df-33e893629095 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:24.805919 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b08b36b1-df0f-47ef-94df-33e893629095 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:24.806352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b08b36b1-df0f-47ef-94df-33e893629095 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:24.809491 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-cc108b46-0af0-46c2-bd19-d82c482ef699 req-b4f62f7c-6051-4957-a207-69a9779f9672 service nova] Creating event network-vif-plugged:3cf2d04a-41a2-41a4-999d-f04ae5c6e813 for instance d216853e-3fda-40f8-be89-56e8756c83a8 on n-h1-858272-3 Oct 05 02:38:24.815616 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-cc108b46-0af0-46c2-bd19-d82c482ef699 req-b4f62f7c-6051-4957-a207-69a9779f9672 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058027 Oct 05 02:38:24.817951 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1294/2620] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:38:24.818475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b08b36b1-df0f-47ef-94df-33e893629095 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:24.818968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b08b36b1-df0f-47ef-94df-33e893629095 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:24.819407 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b08b36b1-df0f-47ef-94df-33e893629095 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:24.827592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-42dc13b4-23ca-454b-8ee4-633b639caad5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:24.828581 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-42dc13b4-23ca-454b-8ee4-633b639caad5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 549e9e9b-0461-402c-a082-4f6a85a6e3c8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:24.836890 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42dc13b4-23ca-454b-8ee4-633b639caad5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:24.837840 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42dc13b4-23ca-454b-8ee4-633b639caad5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:24.838516 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42dc13b4-23ca-454b-8ee4-633b639caad5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:24.839901 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42dc13b4-23ca-454b-8ee4-633b639caad5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:24.840592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42dc13b4-23ca-454b-8ee4-633b639caad5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:24.841305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42dc13b4-23ca-454b-8ee4-633b639caad5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:25.059222 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b08b36b1-df0f-47ef-94df-33e893629095 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110ebcc38ef34dfea40fe14ab2ad1b3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69def5e64d945428d420e737fecd987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:25.077260 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b08b36b1-df0f-47ef-94df-33e893629095 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] 10.222.0.16 "GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320" status: 200 len: 1392 microversion: 2.1 time: 0.285276 Oct 05 02:38:25.077856 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1327/2621] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:24 2022] GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320 => generated 1392 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:25.092131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ca721d06-ca2b-469d-bf00-d9755a0122e8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:25.092769 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ca721d06-ca2b-469d-bf00-d9755a0122e8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] [instance: 40d4b47d-383b-4342-a6d7-27725c71fb1d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:25.100957 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca721d06-ca2b-469d-bf00-d9755a0122e8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:25.101676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca721d06-ca2b-469d-bf00-d9755a0122e8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:25.102119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca721d06-ca2b-469d-bf00-d9755a0122e8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:25.102833 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca721d06-ca2b-469d-bf00-d9755a0122e8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:25.103297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca721d06-ca2b-469d-bf00-d9755a0122e8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:25.103727 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca721d06-ca2b-469d-bf00-d9755a0122e8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:25.104301 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-42dc13b4-23ca-454b-8ee4-633b639caad5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:25.113222 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-42dc13b4-23ca-454b-8ee4-633b639caad5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8" status: 200 len: 1319 microversion: 2.1 time: 0.293227 Oct 05 02:38:25.114022 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1295/2622] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:24 2022] GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8 => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:25.210262 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ca721d06-ca2b-469d-bf00-d9755a0122e8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:25.219589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ca721d06-ca2b-469d-bf00-d9755a0122e8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:25.221218 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ca721d06-ca2b-469d-bf00-d9755a0122e8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:25.222459 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ca721d06-ca2b-469d-bf00-d9755a0122e8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] 10.222.0.16 "GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d" status: 200 len: 1332 microversion: 2.47 time: 0.143661 Oct 05 02:38:25.223311 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1328/2623] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:38:25 2022] GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d => generated 1332 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:38:25.749018 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2a9f826d-88ec-46b9-a651-2b938c3d8f4b tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:25.749646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2a9f826d-88ec-46b9-a651-2b938c3d8f4b tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: cdc1d61f-24f7-42ba-bd26-7a24227e5a01] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:25.758068 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a9f826d-88ec-46b9-a651-2b938c3d8f4b tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:25.758806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a9f826d-88ec-46b9-a651-2b938c3d8f4b tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:25.759251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a9f826d-88ec-46b9-a651-2b938c3d8f4b tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:25.760484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a9f826d-88ec-46b9-a651-2b938c3d8f4b tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:25.761021 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a9f826d-88ec-46b9-a651-2b938c3d8f4b tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:25.762435 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a9f826d-88ec-46b9-a651-2b938c3d8f4b tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:25.780249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3d6dfc58-f767-43cb-9113-4e2095ca20ef tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:25.781093 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3d6dfc58-f767-43cb-9113-4e2095ca20ef tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:25.791753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d6dfc58-f767-43cb-9113-4e2095ca20ef tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:25.792437 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d6dfc58-f767-43cb-9113-4e2095ca20ef tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:25.793001 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d6dfc58-f767-43cb-9113-4e2095ca20ef tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:25.793950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d6dfc58-f767-43cb-9113-4e2095ca20ef tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:25.794623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d6dfc58-f767-43cb-9113-4e2095ca20ef tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:25.795430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d6dfc58-f767-43cb-9113-4e2095ca20ef tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:25.803369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:25.997395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2a9f826d-88ec-46b9-a651-2b938c3d8f4b tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:26.012102 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2a9f826d-88ec-46b9-a651-2b938c3d8f4b tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01" status: 200 len: 1322 microversion: 2.1 time: 0.266398 Oct 05 02:38:26.014531 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1296/2624] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:25 2022] GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01 => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:26.021130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1797405c-c8bc-4ebc-a962-6abfdc18c18c tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fcce41b24c0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:26.044696 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3d6dfc58-f767-43cb-9113-4e2095ca20ef tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:26.057086 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3d6dfc58-f767-43cb-9113-4e2095ca20ef tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1472 microversion: 2.1 time: 0.281481 Oct 05 02:38:26.069461 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1329/2625] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:25 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1472 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:26.074075 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1797405c-c8bc-4ebc-a962-6abfdc18c18c tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700" status: 200 len: 1424 microversion: 2.1 time: 0.057432 Oct 05 02:38:26.075037 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1297/2626] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:26 2022] GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700 => generated 1424 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:26.102598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6c3ba158-cf97-455f-b005-b83c158015b6 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:26.103223 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6c3ba158-cf97-455f-b005-b83c158015b6 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] [instance: b834e68c-772a-45b6-857b-0cb285b1e320] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:26.109537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c3ba158-cf97-455f-b005-b83c158015b6 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:26.110026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c3ba158-cf97-455f-b005-b83c158015b6 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:26.110455 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c3ba158-cf97-455f-b005-b83c158015b6 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:26.111137 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c3ba158-cf97-455f-b005-b83c158015b6 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:26.111768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c3ba158-cf97-455f-b005-b83c158015b6 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:26.112321 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c3ba158-cf97-455f-b005-b83c158015b6 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:26.146034 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9f8176fd-6b3d-461f-ab2b-a73431aec27f tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:26.147256 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9f8176fd-6b3d-461f-ab2b-a73431aec27f tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 549e9e9b-0461-402c-a082-4f6a85a6e3c8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:26.155863 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9f8176fd-6b3d-461f-ab2b-a73431aec27f tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:26.156664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9f8176fd-6b3d-461f-ab2b-a73431aec27f tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:26.157398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9f8176fd-6b3d-461f-ab2b-a73431aec27f tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:26.158362 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9f8176fd-6b3d-461f-ab2b-a73431aec27f tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:26.159050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9f8176fd-6b3d-461f-ab2b-a73431aec27f tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:26.159738 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9f8176fd-6b3d-461f-ab2b-a73431aec27f tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:26.672001 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9f8176fd-6b3d-461f-ab2b-a73431aec27f tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:26.690579 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6c3ba158-cf97-455f-b005-b83c158015b6 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110ebcc38ef34dfea40fe14ab2ad1b3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69def5e64d945428d420e737fecd987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:26.696444 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9f8176fd-6b3d-461f-ab2b-a73431aec27f tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8" status: 200 len: 1319 microversion: 2.1 time: 0.554880 Oct 05 02:38:26.697176 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1298/2627] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:26 2022] GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8 => generated 1319 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:26.703160 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6c3ba158-cf97-455f-b005-b83c158015b6 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] 10.222.0.16 "GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320" status: 200 len: 1392 microversion: 2.1 time: 0.605456 Oct 05 02:38:26.704867 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cf190719-63a9-4f50-a53a-eee8e5a154c9 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:26.705988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cf190719-63a9-4f50-a53a-eee8e5a154c9 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] [instance: 40d4b47d-383b-4342-a6d7-27725c71fb1d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:26.720597 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1330/2628] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:26 2022] GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320 => generated 1392 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:26.731071 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf190719-63a9-4f50-a53a-eee8e5a154c9 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:26.732028 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf190719-63a9-4f50-a53a-eee8e5a154c9 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:26.732487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf190719-63a9-4f50-a53a-eee8e5a154c9 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:26.733701 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf190719-63a9-4f50-a53a-eee8e5a154c9 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:26.734289 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf190719-63a9-4f50-a53a-eee8e5a154c9 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:26.734720 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf190719-63a9-4f50-a53a-eee8e5a154c9 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:26.938980 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cf190719-63a9-4f50-a53a-eee8e5a154c9 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:26.951397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cf190719-63a9-4f50-a53a-eee8e5a154c9 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:26.954572 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cf190719-63a9-4f50-a53a-eee8e5a154c9 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:26.957124 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cf190719-63a9-4f50-a53a-eee8e5a154c9 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] 10.222.0.16 "GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d" status: 200 len: 1332 microversion: 2.47 time: 0.257774 Oct 05 02:38:26.975735 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1299/2629] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:38:26 2022] GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d => generated 1332 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:38:27.037417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4ea68988-22ed-4b67-a300-32e262b21abc tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:27.038129 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4ea68988-22ed-4b67-a300-32e262b21abc tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: cdc1d61f-24f7-42ba-bd26-7a24227e5a01] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:27.052773 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ea68988-22ed-4b67-a300-32e262b21abc tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:27.064809 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ea68988-22ed-4b67-a300-32e262b21abc tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:27.065622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ea68988-22ed-4b67-a300-32e262b21abc tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:27.066789 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ea68988-22ed-4b67-a300-32e262b21abc tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:27.067807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ea68988-22ed-4b67-a300-32e262b21abc tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:27.068756 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ea68988-22ed-4b67-a300-32e262b21abc tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:27.100475 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9d4c59aa-fe7f-4f32-a081-c9aff811bbb5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:27.104733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9d4c59aa-fe7f-4f32-a081-c9aff811bbb5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:27.118699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d4c59aa-fe7f-4f32-a081-c9aff811bbb5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:27.122645 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d4c59aa-fe7f-4f32-a081-c9aff811bbb5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:27.123451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d4c59aa-fe7f-4f32-a081-c9aff811bbb5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:27.125430 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d4c59aa-fe7f-4f32-a081-c9aff811bbb5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:27.128048 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d4c59aa-fe7f-4f32-a081-c9aff811bbb5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:27.128936 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d4c59aa-fe7f-4f32-a081-c9aff811bbb5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:27.928965 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4ea68988-22ed-4b67-a300-32e262b21abc tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:27.944411 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4ea68988-22ed-4b67-a300-32e262b21abc tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01" status: 200 len: 1322 microversion: 2.1 time: 0.911998 Oct 05 02:38:27.966166 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1331/2630] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:27 2022] GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01 => generated 1322 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:28.000036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a98479c2-d9c7-404e-9630-c8ac111b098e tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fcce45af700>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:28.052701 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9d4c59aa-fe7f-4f32-a081-c9aff811bbb5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:28.070646 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9d4c59aa-fe7f-4f32-a081-c9aff811bbb5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1472 microversion: 2.1 time: 0.992354 Oct 05 02:38:28.073761 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1300/2631] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:27 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1472 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:28.091142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2e30feb4-35fd-4f72-9f40-ae4ab82bf399 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:28.092036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2e30feb4-35fd-4f72-9f40-ae4ab82bf399 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 549e9e9b-0461-402c-a082-4f6a85a6e3c8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:28.098826 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e30feb4-35fd-4f72-9f40-ae4ab82bf399 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:28.099319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e30feb4-35fd-4f72-9f40-ae4ab82bf399 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:28.103614 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e30feb4-35fd-4f72-9f40-ae4ab82bf399 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:28.104602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e30feb4-35fd-4f72-9f40-ae4ab82bf399 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:28.105278 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e30feb4-35fd-4f72-9f40-ae4ab82bf399 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:28.113781 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e30feb4-35fd-4f72-9f40-ae4ab82bf399 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:28.114238 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a98479c2-d9c7-404e-9630-c8ac111b098e tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700" status: 200 len: 1424 microversion: 2.1 time: 0.146152 Oct 05 02:38:28.117008 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1332/2632] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:27 2022] GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700 => generated 1424 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:28.127452 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d48a90ac-7606-4872-b5b7-b3128a08d1ae tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:28.128494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d48a90ac-7606-4872-b5b7-b3128a08d1ae tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] [instance: b834e68c-772a-45b6-857b-0cb285b1e320] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:28.137888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d48a90ac-7606-4872-b5b7-b3128a08d1ae tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:28.138758 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d48a90ac-7606-4872-b5b7-b3128a08d1ae tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:28.139444 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d48a90ac-7606-4872-b5b7-b3128a08d1ae tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:28.140504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d48a90ac-7606-4872-b5b7-b3128a08d1ae tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:28.141209 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d48a90ac-7606-4872-b5b7-b3128a08d1ae tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:28.143879 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d48a90ac-7606-4872-b5b7-b3128a08d1ae tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:28.593255 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d48a90ac-7606-4872-b5b7-b3128a08d1ae tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110ebcc38ef34dfea40fe14ab2ad1b3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69def5e64d945428d420e737fecd987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:28.606424 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d48a90ac-7606-4872-b5b7-b3128a08d1ae tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] 10.222.0.16 "GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320" status: 200 len: 1573 microversion: 2.1 time: 0.483663 Oct 05 02:38:28.608081 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1333/2633] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:28 2022] GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320 => generated 1573 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:28.614668 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b343aab1-9a6a-4c59-8223-788166835e91 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:28.615967 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2e30feb4-35fd-4f72-9f40-ae4ab82bf399 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:28.617122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b343aab1-9a6a-4c59-8223-788166835e91 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] [instance: 40d4b47d-383b-4342-a6d7-27725c71fb1d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:28.624873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b343aab1-9a6a-4c59-8223-788166835e91 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:28.625710 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2e30feb4-35fd-4f72-9f40-ae4ab82bf399 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8" status: 200 len: 1319 microversion: 2.1 time: 0.548751 Oct 05 02:38:28.626727 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b343aab1-9a6a-4c59-8223-788166835e91 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:28.626865 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1301/2634] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:28 2022] GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8 => generated 1319 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:28.627437 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b343aab1-9a6a-4c59-8223-788166835e91 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:28.628341 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b343aab1-9a6a-4c59-8223-788166835e91 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:28.628816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b343aab1-9a6a-4c59-8223-788166835e91 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:28.629304 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b343aab1-9a6a-4c59-8223-788166835e91 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:28.640083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1be4f57a-b4bd-4c9b-a1db-50532331916d tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:28.640878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1be4f57a-b4bd-4c9b-a1db-50532331916d tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] [instance: b834e68c-772a-45b6-857b-0cb285b1e320] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:28.647797 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1be4f57a-b4bd-4c9b-a1db-50532331916d tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:28.649144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1be4f57a-b4bd-4c9b-a1db-50532331916d tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:28.650051 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1be4f57a-b4bd-4c9b-a1db-50532331916d tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:28.651333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1be4f57a-b4bd-4c9b-a1db-50532331916d tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:28.651959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1be4f57a-b4bd-4c9b-a1db-50532331916d tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:28.652579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1be4f57a-b4bd-4c9b-a1db-50532331916d tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:28.749883 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b343aab1-9a6a-4c59-8223-788166835e91 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:28.764418 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b343aab1-9a6a-4c59-8223-788166835e91 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:28.775057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b343aab1-9a6a-4c59-8223-788166835e91 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:28.776647 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b343aab1-9a6a-4c59-8223-788166835e91 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] 10.222.0.16 "GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d" status: 200 len: 1338 microversion: 2.47 time: 0.166873 Oct 05 02:38:28.777799 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1334/2635] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:38:28 2022] GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d => generated 1338 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:38:28.786762 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1be4f57a-b4bd-4c9b-a1db-50532331916d tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] 10.222.0.16 "GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.151638 Oct 05 02:38:28.787865 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1302/2636] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 02:38:28 2022] GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:38:28.980090 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6f71bb27-057a-47ce-b997-70d34bda6351 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:28.981162 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6f71bb27-057a-47ce-b997-70d34bda6351 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: cdc1d61f-24f7-42ba-bd26-7a24227e5a01] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:28.988571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f71bb27-057a-47ce-b997-70d34bda6351 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:28.988695 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f71bb27-057a-47ce-b997-70d34bda6351 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:28.989131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f71bb27-057a-47ce-b997-70d34bda6351 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:28.990014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f71bb27-057a-47ce-b997-70d34bda6351 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:28.990787 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f71bb27-057a-47ce-b997-70d34bda6351 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:28.991413 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f71bb27-057a-47ce-b997-70d34bda6351 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:29.104217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0d041c94-b4d5-4fe8-a9b8-b54988a81f56 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:29.105625 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0d041c94-b4d5-4fe8-a9b8-b54988a81f56 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:29.113701 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0d041c94-b4d5-4fe8-a9b8-b54988a81f56 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:29.114667 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0d041c94-b4d5-4fe8-a9b8-b54988a81f56 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:29.115389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0d041c94-b4d5-4fe8-a9b8-b54988a81f56 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:29.116431 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0d041c94-b4d5-4fe8-a9b8-b54988a81f56 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:29.117195 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0d041c94-b4d5-4fe8-a9b8-b54988a81f56 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:29.117827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0d041c94-b4d5-4fe8-a9b8-b54988a81f56 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:29.786458 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0d041c94-b4d5-4fe8-a9b8-b54988a81f56 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:29.789537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6f71bb27-057a-47ce-b997-70d34bda6351 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:29.800640 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6f71bb27-057a-47ce-b997-70d34bda6351 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01" status: 200 len: 1322 microversion: 2.1 time: 0.825083 Oct 05 02:38:29.801260 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1335/2637] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:28 2022] GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01 => generated 1322 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:29.804953 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0d041c94-b4d5-4fe8-a9b8-b54988a81f56 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1472 microversion: 2.1 time: 0.705375 Oct 05 02:38:29.821880 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3be8c146-53e4-4ed2-b7d2-ccab51ffeef6 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fcce4325b80>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:29.822828 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1303/2638] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:29 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1472 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:29.831596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b04fafce-3d32-44ff-bbb9-a30dd773b5a7 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:29.832558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b04fafce-3d32-44ff-bbb9-a30dd773b5a7 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 549e9e9b-0461-402c-a082-4f6a85a6e3c8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:29.841691 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b04fafce-3d32-44ff-bbb9-a30dd773b5a7 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:29.843093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b04fafce-3d32-44ff-bbb9-a30dd773b5a7 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:29.843695 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b04fafce-3d32-44ff-bbb9-a30dd773b5a7 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:29.844585 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b04fafce-3d32-44ff-bbb9-a30dd773b5a7 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:29.845234 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b04fafce-3d32-44ff-bbb9-a30dd773b5a7 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:29.845833 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b04fafce-3d32-44ff-bbb9-a30dd773b5a7 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:29.885179 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3be8c146-53e4-4ed2-b7d2-ccab51ffeef6 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700" status: 200 len: 1424 microversion: 2.1 time: 0.067550 Oct 05 02:38:29.886433 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1336/2639] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:29 2022] GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700 => generated 1424 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:29.891454 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-38818076-343f-4cd3-877c-ad949fe7a1f8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:29.892295 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-38818076-343f-4cd3-877c-ad949fe7a1f8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] [instance: 40d4b47d-383b-4342-a6d7-27725c71fb1d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:29.903792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38818076-343f-4cd3-877c-ad949fe7a1f8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:29.904560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38818076-343f-4cd3-877c-ad949fe7a1f8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:29.905200 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38818076-343f-4cd3-877c-ad949fe7a1f8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:29.906087 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38818076-343f-4cd3-877c-ad949fe7a1f8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:29.906868 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38818076-343f-4cd3-877c-ad949fe7a1f8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:29.907620 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38818076-343f-4cd3-877c-ad949fe7a1f8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:30.071617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-38818076-343f-4cd3-877c-ad949fe7a1f8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:30.098612 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-38818076-343f-4cd3-877c-ad949fe7a1f8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:30.103550 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-38818076-343f-4cd3-877c-ad949fe7a1f8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:30.105802 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-38818076-343f-4cd3-877c-ad949fe7a1f8 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] 10.222.0.16 "GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d" status: 200 len: 1338 microversion: 2.47 time: 0.218139 Oct 05 02:38:30.117993 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1337/2640] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:38:29 2022] GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d => generated 1338 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:38:30.233788 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b04fafce-3d32-44ff-bbb9-a30dd773b5a7 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:30.252739 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b04fafce-3d32-44ff-bbb9-a30dd773b5a7 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8" status: 200 len: 1319 microversion: 2.1 time: 0.427776 Oct 05 02:38:30.253697 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1304/2641] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:29 2022] GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8 => generated 1319 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:30.495949 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-1d2463ca-6513-447f-b5e4-82db14433a74 req-a8153ace-c837-44d1-afba-568e40fc2ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74b1ab94-3bc0-440d-bf57-dcab444e063d", "name": "network-vif-plugged", "status": "completed", "tag": "f76faa20-bd22-4858-915c-478dc55b243d"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:38:30.515266 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1d2463ca-6513-447f-b5e4-82db14433a74 req-a8153ace-c837-44d1-afba-568e40fc2ec2 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:30.515932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1d2463ca-6513-447f-b5e4-82db14433a74 req-a8153ace-c837-44d1-afba-568e40fc2ec2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:30.516801 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1d2463ca-6513-447f-b5e4-82db14433a74 req-a8153ace-c837-44d1-afba-568e40fc2ec2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:30.533964 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-1d2463ca-6513-447f-b5e4-82db14433a74 req-a8153ace-c837-44d1-afba-568e40fc2ec2 service nova] Creating event network-vif-plugged:f76faa20-bd22-4858-915c-478dc55b243d for instance 74b1ab94-3bc0-440d-bf57-dcab444e063d on n-h1-858272-3 Oct 05 02:38:30.542323 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-1d2463ca-6513-447f-b5e4-82db14433a74 req-a8153ace-c837-44d1-afba-568e40fc2ec2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050415 Oct 05 02:38:30.542933 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1338/2642] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:38:30.824935 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-05188b8c-689e-489d-8c1f-bc602537b2d6 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:30.825771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-05188b8c-689e-489d-8c1f-bc602537b2d6 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: cdc1d61f-24f7-42ba-bd26-7a24227e5a01] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:30.836646 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-57c53c40-9e92-42d4-b673-a0a0251a2e74 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:30.838015 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-57c53c40-9e92-42d4-b673-a0a0251a2e74 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:30.839120 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05188b8c-689e-489d-8c1f-bc602537b2d6 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:30.839625 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05188b8c-689e-489d-8c1f-bc602537b2d6 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:30.844462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57c53c40-9e92-42d4-b673-a0a0251a2e74 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:30.844969 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57c53c40-9e92-42d4-b673-a0a0251a2e74 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:30.845590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57c53c40-9e92-42d4-b673-a0a0251a2e74 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:30.846440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57c53c40-9e92-42d4-b673-a0a0251a2e74 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:30.847039 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57c53c40-9e92-42d4-b673-a0a0251a2e74 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:30.847632 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57c53c40-9e92-42d4-b673-a0a0251a2e74 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:30.849653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05188b8c-689e-489d-8c1f-bc602537b2d6 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:30.856485 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05188b8c-689e-489d-8c1f-bc602537b2d6 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:30.858954 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05188b8c-689e-489d-8c1f-bc602537b2d6 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:30.859843 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05188b8c-689e-489d-8c1f-bc602537b2d6 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:31.393077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-57c53c40-9e92-42d4-b673-a0a0251a2e74 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:31.402685 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-57c53c40-9e92-42d4-b673-a0a0251a2e74 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1472 microversion: 2.1 time: 0.570780 Oct 05 02:38:31.409682 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1339/2643] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:30 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1472 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:31.415420 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0053b650-f309-43c5-acff-58aa948d57ce tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fcce4a9fd30>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:31.449374 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-05188b8c-689e-489d-8c1f-bc602537b2d6 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:31.476280 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-05188b8c-689e-489d-8c1f-bc602537b2d6 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01" status: 200 len: 1322 microversion: 2.1 time: 0.655864 Oct 05 02:38:31.477426 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1305/2644] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:30 2022] GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01 => generated 1322 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:31.494042 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0053b650-f309-43c5-acff-58aa948d57ce tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700" status: 200 len: 1424 microversion: 2.1 time: 0.083050 Oct 05 02:38:31.498782 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1340/2645] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:31 2022] GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700 => generated 1424 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:31.502075 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4bbec930-9b8d-4575-ae17-d9ec9dc6847d tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:31.512572 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4bbec930-9b8d-4575-ae17-d9ec9dc6847d tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] [instance: 40d4b47d-383b-4342-a6d7-27725c71fb1d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:31.516023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9641464b-f85d-4929-b6e8-019b00398e2d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:31.519399 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9641464b-f85d-4929-b6e8-019b00398e2d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 549e9e9b-0461-402c-a082-4f6a85a6e3c8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:31.523387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:31.529471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4bbec930-9b8d-4575-ae17-d9ec9dc6847d tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:31.532283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4bbec930-9b8d-4575-ae17-d9ec9dc6847d tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:31.532989 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4bbec930-9b8d-4575-ae17-d9ec9dc6847d tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:31.533935 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4bbec930-9b8d-4575-ae17-d9ec9dc6847d tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:31.534229 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9641464b-f85d-4929-b6e8-019b00398e2d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:31.534936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9641464b-f85d-4929-b6e8-019b00398e2d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:31.535629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4bbec930-9b8d-4575-ae17-d9ec9dc6847d tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:31.536267 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9641464b-f85d-4929-b6e8-019b00398e2d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:31.536920 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4bbec930-9b8d-4575-ae17-d9ec9dc6847d tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:31.537849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9641464b-f85d-4929-b6e8-019b00398e2d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:31.542474 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9641464b-f85d-4929-b6e8-019b00398e2d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:31.543273 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9641464b-f85d-4929-b6e8-019b00398e2d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:31.551385 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:32.186330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4bbec930-9b8d-4575-ae17-d9ec9dc6847d tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:32.200823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4bbec930-9b8d-4575-ae17-d9ec9dc6847d tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:32.202297 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4bbec930-9b8d-4575-ae17-d9ec9dc6847d tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:32.203422 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4bbec930-9b8d-4575-ae17-d9ec9dc6847d tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] 10.222.0.16 "GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d" status: 200 len: 1338 microversion: 2.47 time: 0.724905 Oct 05 02:38:32.217334 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1306/2646] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:38:31 2022] GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d => generated 1338 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:38:32.289150 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:32.326384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0c95bb1d-8c2a-474b-8abd-a3475a3bf12a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:32.327380 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0c95bb1d-8c2a-474b-8abd-a3475a3bf12a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] [instance: b834e68c-772a-45b6-857b-0cb285b1e320] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:32.340206 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c95bb1d-8c2a-474b-8abd-a3475a3bf12a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:32.340972 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c95bb1d-8c2a-474b-8abd-a3475a3bf12a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:32.341602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c95bb1d-8c2a-474b-8abd-a3475a3bf12a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:32.343854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c95bb1d-8c2a-474b-8abd-a3475a3bf12a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:32.346592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c95bb1d-8c2a-474b-8abd-a3475a3bf12a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:32.347325 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c95bb1d-8c2a-474b-8abd-a3475a3bf12a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:32.364175 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9641464b-f85d-4929-b6e8-019b00398e2d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:32.381364 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9641464b-f85d-4929-b6e8-019b00398e2d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8" status: 200 len: 1319 microversion: 2.1 time: 0.881195 Oct 05 02:38:32.383170 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1341/2647] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:31 2022] GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8 => generated 1319 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:32.390458 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-7814310f-a0de-4454-ace5-342232384b7d req-c43bafe4-144d-4123-8d1b-e1c91fce4a4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b834e68c-772a-45b6-857b-0cb285b1e320", "tag": "36f2563c-c845-4290-89b1-ae30ad6d77c8"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:38:32.410790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-7814310f-a0de-4454-ace5-342232384b7d req-c43bafe4-144d-4123-8d1b-e1c91fce4a4a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:32.411520 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-7814310f-a0de-4454-ace5-342232384b7d req-c43bafe4-144d-4123-8d1b-e1c91fce4a4a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:32.412878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-7814310f-a0de-4454-ace5-342232384b7d req-c43bafe4-144d-4123-8d1b-e1c91fce4a4a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:32.439669 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-7814310f-a0de-4454-ace5-342232384b7d req-c43bafe4-144d-4123-8d1b-e1c91fce4a4a service nova] Creating event network-changed:36f2563c-c845-4290-89b1-ae30ad6d77c8 for instance b834e68c-772a-45b6-857b-0cb285b1e320 on n-h2-858272-3 Oct 05 02:38:32.448682 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-7814310f-a0de-4454-ace5-342232384b7d req-c43bafe4-144d-4123-8d1b-e1c91fce4a4a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063881 Oct 05 02:38:32.450126 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1342/2648] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:38:32.457449 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-45e61f25-45c4-4975-8217-8cfb5f4df7eb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:32.458364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-45e61f25-45c4-4975-8217-8cfb5f4df7eb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:32.464010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:32.468985 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-45e61f25-45c4-4975-8217-8cfb5f4df7eb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:32.469772 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-45e61f25-45c4-4975-8217-8cfb5f4df7eb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:32.470393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-45e61f25-45c4-4975-8217-8cfb5f4df7eb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:32.471486 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-45e61f25-45c4-4975-8217-8cfb5f4df7eb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:32.472108 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-45e61f25-45c4-4975-8217-8cfb5f4df7eb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:32.472868 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-45e61f25-45c4-4975-8217-8cfb5f4df7eb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:32.593138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0c95bb1d-8c2a-474b-8abd-a3475a3bf12a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110ebcc38ef34dfea40fe14ab2ad1b3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69def5e64d945428d420e737fecd987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:32.606571 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0c95bb1d-8c2a-474b-8abd-a3475a3bf12a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] 10.222.0.16 "GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320" status: 200 len: 1573 microversion: 2.1 time: 0.284416 Oct 05 02:38:32.609015 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1307/2649] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:32 2022] GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320 => generated 1573 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:38:32.617836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-360a581a-e6f4-451e-b6c5-26f769578fc8 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:32.618691 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-360a581a-e6f4-451e-b6c5-26f769578fc8 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: cdc1d61f-24f7-42ba-bd26-7a24227e5a01] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:32.633949 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-360a581a-e6f4-451e-b6c5-26f769578fc8 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:32.636709 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-360a581a-e6f4-451e-b6c5-26f769578fc8 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:32.637423 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-360a581a-e6f4-451e-b6c5-26f769578fc8 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:32.638310 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-360a581a-e6f4-451e-b6c5-26f769578fc8 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:32.642371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-360a581a-e6f4-451e-b6c5-26f769578fc8 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:32.643184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-360a581a-e6f4-451e-b6c5-26f769578fc8 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:32.693787 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-45e61f25-45c4-4975-8217-8cfb5f4df7eb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:32.701974 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-45e61f25-45c4-4975-8217-8cfb5f4df7eb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1472 microversion: 2.1 time: 0.250253 Oct 05 02:38:32.702565 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1343/2650] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:32 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1472 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:32.713862 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-79aad464-f1c1-4029-9e68-b10e6253131c tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fcce4049790>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:32.783583 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-79aad464-f1c1-4029-9e68-b10e6253131c tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700" status: 200 len: 1424 microversion: 2.1 time: 0.079955 Oct 05 02:38:32.784172 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1344/2651] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:32 2022] GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700 => generated 1424 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:32.794866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-cd02ab83-ee62-4e7b-a6a6-191715bc74a1 req-b33cd783-6fdc-491b-b6f1-9e41664c1ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdc1d61f-24f7-42ba-bd26-7a24227e5a01", "name": "network-vif-plugged", "status": "completed", "tag": "272c88c7-585e-43bb-a269-108e1cd243eb"}, {"server_uuid": "40fd6f92-87b8-452f-827f-1bf2b2be98a9", "name": "network-vif-plugged", "status": "completed", "tag": "f61119f0-472d-44b2-b03a-8638b346f14e"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:38:32.816742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-cd02ab83-ee62-4e7b-a6a6-191715bc74a1 req-b33cd783-6fdc-491b-b6f1-9e41664c1ba1 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:32.821340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-cd02ab83-ee62-4e7b-a6a6-191715bc74a1 req-b33cd783-6fdc-491b-b6f1-9e41664c1ba1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:32.824096 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-cd02ab83-ee62-4e7b-a6a6-191715bc74a1 req-b33cd783-6fdc-491b-b6f1-9e41664c1ba1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:32.857350 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-cd02ab83-ee62-4e7b-a6a6-191715bc74a1 req-b33cd783-6fdc-491b-b6f1-9e41664c1ba1 service nova] Creating event network-vif-plugged:272c88c7-585e-43bb-a269-108e1cd243eb for instance cdc1d61f-24f7-42ba-bd26-7a24227e5a01 on n-h1-858272-3 Oct 05 02:38:32.860018 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-cd02ab83-ee62-4e7b-a6a6-191715bc74a1 req-b33cd783-6fdc-491b-b6f1-9e41664c1ba1 service nova] Creating event network-vif-plugged:f61119f0-472d-44b2-b03a-8638b346f14e for instance 40fd6f92-87b8-452f-827f-1bf2b2be98a9 on n-h2-858272-3 Oct 05 02:38:32.862649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-360a581a-e6f4-451e-b6c5-26f769578fc8 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:32.867495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:32.875992 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-cd02ab83-ee62-4e7b-a6a6-191715bc74a1 req-b33cd783-6fdc-491b-b6f1-9e41664c1ba1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.090428 Oct 05 02:38:32.878894 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1345/2652] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:38:32.883314 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-360a581a-e6f4-451e-b6c5-26f769578fc8 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01" status: 200 len: 1322 microversion: 2.1 time: 0.272055 Oct 05 02:38:32.884013 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1308/2653] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:32 2022] GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01 => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:33.236926 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-18eba596-af41-47e9-9922-8aa41b6e686b tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:33.237579 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-18eba596-af41-47e9-9922-8aa41b6e686b tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] [instance: 40d4b47d-383b-4342-a6d7-27725c71fb1d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:33.258183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18eba596-af41-47e9-9922-8aa41b6e686b tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:33.258803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18eba596-af41-47e9-9922-8aa41b6e686b tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:33.261973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18eba596-af41-47e9-9922-8aa41b6e686b tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:33.269127 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18eba596-af41-47e9-9922-8aa41b6e686b tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:33.269942 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18eba596-af41-47e9-9922-8aa41b6e686b tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:33.273600 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18eba596-af41-47e9-9922-8aa41b6e686b tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:33.410684 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c39a542e-86f0-4dc7-8d83-d72d82916c0d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:33.411702 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c39a542e-86f0-4dc7-8d83-d72d82916c0d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 549e9e9b-0461-402c-a082-4f6a85a6e3c8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:33.425800 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c39a542e-86f0-4dc7-8d83-d72d82916c0d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:33.433548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c39a542e-86f0-4dc7-8d83-d72d82916c0d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:33.438049 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c39a542e-86f0-4dc7-8d83-d72d82916c0d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:33.439002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c39a542e-86f0-4dc7-8d83-d72d82916c0d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:33.441500 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c39a542e-86f0-4dc7-8d83-d72d82916c0d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:33.443361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c39a542e-86f0-4dc7-8d83-d72d82916c0d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:33.519351 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-18eba596-af41-47e9-9922-8aa41b6e686b tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:33.529989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-18eba596-af41-47e9-9922-8aa41b6e686b tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:33.534470 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-18eba596-af41-47e9-9922-8aa41b6e686b tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:33.538374 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-18eba596-af41-47e9-9922-8aa41b6e686b tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] 10.222.0.16 "GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d" status: 200 len: 1338 microversion: 2.47 time: 0.307113 Oct 05 02:38:33.541442 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1346/2654] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:38:33 2022] GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d => generated 1338 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:38:33.736229 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2c02d917-9b60-46c8-a445-399f94127e9f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:33.736853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2c02d917-9b60-46c8-a445-399f94127e9f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:33.749661 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c02d917-9b60-46c8-a445-399f94127e9f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:33.750157 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c02d917-9b60-46c8-a445-399f94127e9f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:33.750593 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c02d917-9b60-46c8-a445-399f94127e9f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:33.751292 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c02d917-9b60-46c8-a445-399f94127e9f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:33.751742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c02d917-9b60-46c8-a445-399f94127e9f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:33.758943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c02d917-9b60-46c8-a445-399f94127e9f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:33.994224 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c39a542e-86f0-4dc7-8d83-d72d82916c0d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:34.005540 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c39a542e-86f0-4dc7-8d83-d72d82916c0d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8" status: 200 len: 1319 microversion: 2.1 time: 0.598811 Oct 05 02:38:34.015302 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1309/2655] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:33 2022] GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8 => generated 1319 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:34.029752 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b4980593-df54-41f8-85eb-95b08b8dbcfb tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fccdf5408b0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:34.098462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2c02d917-9b60-46c8-a445-399f94127e9f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:34.103013 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b4980593-df54-41f8-85eb-95b08b8dbcfb tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700" status: 200 len: 1424 microversion: 2.1 time: 0.086208 Oct 05 02:38:34.111659 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1310/2656] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:34 2022] GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700 => generated 1424 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:34.114906 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2c02d917-9b60-46c8-a445-399f94127e9f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1472 microversion: 2.1 time: 0.387988 Oct 05 02:38:34.115813 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1347/2657] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:33 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1472 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:34.117252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-12eb96a3-c445-4af6-b9bb-e7cfc2a1a833 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:34.117872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-12eb96a3-c445-4af6-b9bb-e7cfc2a1a833 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: cdc1d61f-24f7-42ba-bd26-7a24227e5a01] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:34.144103 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12eb96a3-c445-4af6-b9bb-e7cfc2a1a833 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:34.144709 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12eb96a3-c445-4af6-b9bb-e7cfc2a1a833 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:34.150824 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12eb96a3-c445-4af6-b9bb-e7cfc2a1a833 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:34.151607 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12eb96a3-c445-4af6-b9bb-e7cfc2a1a833 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:34.152292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12eb96a3-c445-4af6-b9bb-e7cfc2a1a833 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:34.152727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12eb96a3-c445-4af6-b9bb-e7cfc2a1a833 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:34.445776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-12eb96a3-c445-4af6-b9bb-e7cfc2a1a833 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:34.465798 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-12eb96a3-c445-4af6-b9bb-e7cfc2a1a833 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01" status: 200 len: 1322 microversion: 2.1 time: 0.360137 Oct 05 02:38:34.466934 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1311/2658] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:34 2022] GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01 => generated 1322 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:34.569278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0991be55-efd6-4309-a617-0521641b848b tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:34.570422 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0991be55-efd6-4309-a617-0521641b848b tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] [instance: 40d4b47d-383b-4342-a6d7-27725c71fb1d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:34.577022 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0991be55-efd6-4309-a617-0521641b848b tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:34.577517 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0991be55-efd6-4309-a617-0521641b848b tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:34.577945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0991be55-efd6-4309-a617-0521641b848b tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:34.578648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0991be55-efd6-4309-a617-0521641b848b tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:34.579109 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0991be55-efd6-4309-a617-0521641b848b tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:34.579529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0991be55-efd6-4309-a617-0521641b848b tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:34.719224 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0991be55-efd6-4309-a617-0521641b848b tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:34.732327 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0991be55-efd6-4309-a617-0521641b848b tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:34.735141 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0991be55-efd6-4309-a617-0521641b848b tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:34.737326 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0991be55-efd6-4309-a617-0521641b848b tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] 10.222.0.16 "GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d" status: 200 len: 1338 microversion: 2.47 time: 0.171841 Oct 05 02:38:34.738533 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1348/2659] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:38:34 2022] GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d => generated 1338 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:38:34.968361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-029fc582-639c-4b2b-b3f2-e3d5f37348c7 req-1a3f6055-7752-40b5-9405-04e29c62f264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549e9e9b-0461-402c-a082-4f6a85a6e3c8", "name": "network-vif-plugged", "status": "completed", "tag": "7468d644-c04f-44fd-8a69-34556f7a751d"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:38:34.995461 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-029fc582-639c-4b2b-b3f2-e3d5f37348c7 req-1a3f6055-7752-40b5-9405-04e29c62f264 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:34.998795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-029fc582-639c-4b2b-b3f2-e3d5f37348c7 req-1a3f6055-7752-40b5-9405-04e29c62f264 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:34.999437 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-029fc582-639c-4b2b-b3f2-e3d5f37348c7 req-1a3f6055-7752-40b5-9405-04e29c62f264 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:35.020735 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-029fc582-639c-4b2b-b3f2-e3d5f37348c7 req-1a3f6055-7752-40b5-9405-04e29c62f264 service nova] Creating event network-vif-plugged:7468d644-c04f-44fd-8a69-34556f7a751d for instance 549e9e9b-0461-402c-a082-4f6a85a6e3c8 on n-h1-858272-3 Oct 05 02:38:35.029835 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-029fc582-639c-4b2b-b3f2-e3d5f37348c7 req-1a3f6055-7752-40b5-9405-04e29c62f264 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075601 Oct 05 02:38:35.031279 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1312/2660] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:38:35.040243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cda6c2b0-7d4f-46d4-8919-faded63ade32 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:35.041172 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cda6c2b0-7d4f-46d4-8919-faded63ade32 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 549e9e9b-0461-402c-a082-4f6a85a6e3c8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:35.048594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cda6c2b0-7d4f-46d4-8919-faded63ade32 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:35.049400 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cda6c2b0-7d4f-46d4-8919-faded63ade32 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:35.050001 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cda6c2b0-7d4f-46d4-8919-faded63ade32 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:35.050899 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cda6c2b0-7d4f-46d4-8919-faded63ade32 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:35.051516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cda6c2b0-7d4f-46d4-8919-faded63ade32 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:35.052120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cda6c2b0-7d4f-46d4-8919-faded63ade32 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:35.121888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-991583be-2a38-495a-b457-0aa6566f9a45 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fcce80c2820>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:35.178198 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-991583be-2a38-495a-b457-0aa6566f9a45 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700" status: 200 len: 1424 microversion: 2.1 time: 0.062395 Oct 05 02:38:35.181881 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1313/2661] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:35 2022] GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700 => generated 1424 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:35.206413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7be861ee-8452-4921-a566-d53781580169 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:35.211546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7be861ee-8452-4921-a566-d53781580169 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:35.224855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7be861ee-8452-4921-a566-d53781580169 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:35.226238 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7be861ee-8452-4921-a566-d53781580169 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:35.226848 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7be861ee-8452-4921-a566-d53781580169 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:35.227729 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7be861ee-8452-4921-a566-d53781580169 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:35.228365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7be861ee-8452-4921-a566-d53781580169 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:35.229038 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7be861ee-8452-4921-a566-d53781580169 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:35.678509 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cda6c2b0-7d4f-46d4-8919-faded63ade32 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:35.690533 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cda6c2b0-7d4f-46d4-8919-faded63ade32 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8" status: 200 len: 1319 microversion: 2.1 time: 0.655147 Oct 05 02:38:35.691818 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1349/2662] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:35 2022] GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8 => generated 1319 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:35.701941 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8bcf3f1b-3dbd-4177-b75e-00bdfdaacb43 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:35.704214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8bcf3f1b-3dbd-4177-b75e-00bdfdaacb43 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: cdc1d61f-24f7-42ba-bd26-7a24227e5a01] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:35.715981 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8bcf3f1b-3dbd-4177-b75e-00bdfdaacb43 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:35.716811 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8bcf3f1b-3dbd-4177-b75e-00bdfdaacb43 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:35.717481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8bcf3f1b-3dbd-4177-b75e-00bdfdaacb43 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:35.718763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8bcf3f1b-3dbd-4177-b75e-00bdfdaacb43 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:35.719446 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8bcf3f1b-3dbd-4177-b75e-00bdfdaacb43 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:35.720064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8bcf3f1b-3dbd-4177-b75e-00bdfdaacb43 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:35.780163 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7be861ee-8452-4921-a566-d53781580169 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:35.791968 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7be861ee-8452-4921-a566-d53781580169 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1472 microversion: 2.1 time: 0.607959 Oct 05 02:38:35.792568 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1314/2663] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:35 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1472 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:35.812802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2efba0f0-9475-48b4-be71-a98467040fda tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:35.814397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2efba0f0-9475-48b4-be71-a98467040fda tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] [instance: 40d4b47d-383b-4342-a6d7-27725c71fb1d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:35.843821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2efba0f0-9475-48b4-be71-a98467040fda tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:35.848768 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2efba0f0-9475-48b4-be71-a98467040fda tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:35.849598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2efba0f0-9475-48b4-be71-a98467040fda tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:35.852167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2efba0f0-9475-48b4-be71-a98467040fda tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:35.853275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2efba0f0-9475-48b4-be71-a98467040fda tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:35.855699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2efba0f0-9475-48b4-be71-a98467040fda tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:36.162430 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2efba0f0-9475-48b4-be71-a98467040fda tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:36.207143 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2efba0f0-9475-48b4-be71-a98467040fda tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:36.208585 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2efba0f0-9475-48b4-be71-a98467040fda tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:36.221963 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2efba0f0-9475-48b4-be71-a98467040fda tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] 10.222.0.16 "GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d" status: 200 len: 1359 microversion: 2.47 time: 0.416331 Oct 05 02:38:36.236930 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1315/2664] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:38:35 2022] GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d => generated 1359 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:38:36.242789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-05f454b8-ba9d-449e-9aed-b375f0ec7132 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fccdfd81790>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:36.332282 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-05f454b8-ba9d-449e-9aed-b375f0ec7132 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700" status: 200 len: 1424 microversion: 2.1 time: 0.106784 Oct 05 02:38:36.333037 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1316/2665] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:36 2022] GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700 => generated 1424 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:36.344168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-687d2d79-2e5c-40fe-85cc-cc20363c9957 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-883153490"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:38:36.349232 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-687d2d79-2e5c-40fe-85cc-cc20363c9957 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] [instance: 40d4b47d-383b-4342-a6d7-27725c71fb1d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:36.375748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:36.377430 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-687d2d79-2e5c-40fe-85cc-cc20363c9957 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:36.381489 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-687d2d79-2e5c-40fe-85cc-cc20363c9957 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:36.382759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-687d2d79-2e5c-40fe-85cc-cc20363c9957 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:36.393558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-687d2d79-2e5c-40fe-85cc-cc20363c9957 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:36.394325 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-687d2d79-2e5c-40fe-85cc-cc20363c9957 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:36.394960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-687d2d79-2e5c-40fe-85cc-cc20363c9957 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:36.475283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8bcf3f1b-3dbd-4177-b75e-00bdfdaacb43 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:36.487172 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8bcf3f1b-3dbd-4177-b75e-00bdfdaacb43 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01" status: 200 len: 1516 microversion: 2.1 time: 0.793420 Oct 05 02:38:36.493987 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1350/2666] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:35 2022] GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01 => generated 1516 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:36.529457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a2d17192-78b1-42d7-9896-0e8b0442b419 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:36.530091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a2d17192-78b1-42d7-9896-0e8b0442b419 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: 47c8d34c-c7ca-4b8d-ba7e-72ce986a0985] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:36.548577 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2d17192-78b1-42d7-9896-0e8b0442b419 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:36.549110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2d17192-78b1-42d7-9896-0e8b0442b419 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:36.549552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2d17192-78b1-42d7-9896-0e8b0442b419 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:36.550265 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2d17192-78b1-42d7-9896-0e8b0442b419 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:36.550723 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2d17192-78b1-42d7-9896-0e8b0442b419 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:36.551153 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2d17192-78b1-42d7-9896-0e8b0442b419 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:36.797222 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-687d2d79-2e5c-40fe-85cc-cc20363c9957 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] 10.222.0.16 "POST /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d/action" status: 202 len: 52 microversion: 2.47 time: 0.462704 Oct 05 02:38:36.798150 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1317/2667] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 5 02:38:36 2022] POST /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d/action => generated 52 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 05 02:38:36.809223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bf6a7a5f-88df-447a-8b8d-d8fd6d244861 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:36.810214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bf6a7a5f-88df-447a-8b8d-d8fd6d244861 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 549e9e9b-0461-402c-a082-4f6a85a6e3c8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:36.823503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf6a7a5f-88df-447a-8b8d-d8fd6d244861 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:36.827172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf6a7a5f-88df-447a-8b8d-d8fd6d244861 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:36.827886 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf6a7a5f-88df-447a-8b8d-d8fd6d244861 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:36.829931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf6a7a5f-88df-447a-8b8d-d8fd6d244861 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:36.838953 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf6a7a5f-88df-447a-8b8d-d8fd6d244861 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:36.840416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf6a7a5f-88df-447a-8b8d-d8fd6d244861 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:37.237897 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a2d17192-78b1-42d7-9896-0e8b0442b419 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:37.240308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:37.249727 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a2d17192-78b1-42d7-9896-0e8b0442b419 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/47c8d34c-c7ca-4b8d-ba7e-72ce986a0985" status: 200 len: 1322 microversion: 2.1 time: 0.732761 Oct 05 02:38:37.250333 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1351/2668] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:36 2022] GET /compute/v2.1/servers/47c8d34c-c7ca-4b8d-ba7e-72ce986a0985 => generated 1322 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:38:37.263639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ed82506c-e1f6-4bb0-a535-cc750dd6e587 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:37.264140 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ed82506c-e1f6-4bb0-a535-cc750dd6e587 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] [instance: 40d4b47d-383b-4342-a6d7-27725c71fb1d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:37.274717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed82506c-e1f6-4bb0-a535-cc750dd6e587 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:37.277906 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed82506c-e1f6-4bb0-a535-cc750dd6e587 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:37.278365 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed82506c-e1f6-4bb0-a535-cc750dd6e587 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:37.279091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed82506c-e1f6-4bb0-a535-cc750dd6e587 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:37.279553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed82506c-e1f6-4bb0-a535-cc750dd6e587 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:37.279978 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed82506c-e1f6-4bb0-a535-cc750dd6e587 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:37.336641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ed82506c-e1f6-4bb0-a535-cc750dd6e587 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] [instance: 40d4b47d-383b-4342-a6d7-27725c71fb1d] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:38:37.562860 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bf6a7a5f-88df-447a-8b8d-d8fd6d244861 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:37.567725 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ed82506c-e1f6-4bb0-a535-cc750dd6e587 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] 10.222.0.16 "DELETE /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d" status: 204 len: 0 microversion: 2.47 time: 0.316031 Oct 05 02:38:37.568774 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1352/2669] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 5 02:38:37 2022] DELETE /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 02:38:37.575103 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-33db2bf8-4033-4768-bd49-adf249334c2a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:37.576191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-33db2bf8-4033-4768-bd49-adf249334c2a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:37.583730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33db2bf8-4033-4768-bd49-adf249334c2a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:37.585602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33db2bf8-4033-4768-bd49-adf249334c2a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:37.585602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33db2bf8-4033-4768-bd49-adf249334c2a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:37.587059 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33db2bf8-4033-4768-bd49-adf249334c2a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:37.587770 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33db2bf8-4033-4768-bd49-adf249334c2a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:37.588429 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33db2bf8-4033-4768-bd49-adf249334c2a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:37.601547 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bf6a7a5f-88df-447a-8b8d-d8fd6d244861 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8" status: 200 len: 1319 microversion: 2.1 time: 0.801816 Oct 05 02:38:37.602473 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1318/2670] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:36 2022] GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8 => generated 1319 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:37.634754 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-78cb0b11-8f36-4040-a850-b764f30a8d63 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fcce429ef70>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:37.695444 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-78cb0b11-8f36-4040-a850-b764f30a8d63 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700" status: 200 len: 1424 microversion: 2.1 time: 0.090530 Oct 05 02:38:37.696366 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1319/2671] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:37 2022] GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700 => generated 1424 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:37.701561 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2e53c3aa-e8a2-434b-a087-4dc466ae0a39 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:37.702508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2e53c3aa-e8a2-434b-a087-4dc466ae0a39 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] [instance: 40d4b47d-383b-4342-a6d7-27725c71fb1d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:37.724854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e53c3aa-e8a2-434b-a087-4dc466ae0a39 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:37.725390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e53c3aa-e8a2-434b-a087-4dc466ae0a39 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:37.726525 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e53c3aa-e8a2-434b-a087-4dc466ae0a39 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:37.726937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e53c3aa-e8a2-434b-a087-4dc466ae0a39 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:37.727769 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e53c3aa-e8a2-434b-a087-4dc466ae0a39 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:37.727991 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e53c3aa-e8a2-434b-a087-4dc466ae0a39 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:37.815987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2e53c3aa-e8a2-434b-a087-4dc466ae0a39 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:37.827339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2e53c3aa-e8a2-434b-a087-4dc466ae0a39 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:37.827754 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2e53c3aa-e8a2-434b-a087-4dc466ae0a39 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:37.845498 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2e53c3aa-e8a2-434b-a087-4dc466ae0a39 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] 10.222.0.16 "GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d" status: 200 len: 1365 microversion: 2.47 time: 0.130997 Oct 05 02:38:37.847425 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1320/2672] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:38:37 2022] GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:38:37.989867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-33db2bf8-4033-4768-bd49-adf249334c2a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:38.001775 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-33db2bf8-4033-4768-bd49-adf249334c2a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1477 microversion: 2.1 time: 0.430978 Oct 05 02:38:38.002367 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1353/2673] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:37 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1477 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:38.081901 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-722c0670-5b80-4ae4-aea4-0c03170a47d3 req-f3054aea-fb69-4960-b08c-b7bdfe22923b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47c8d34c-c7ca-4b8d-ba7e-72ce986a0985", "name": "network-vif-plugged", "status": "completed", "tag": "2602e55b-b283-44a9-82fe-eba44cd72b1b"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:38:38.105171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-722c0670-5b80-4ae4-aea4-0c03170a47d3 req-f3054aea-fb69-4960-b08c-b7bdfe22923b service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:38.105659 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-722c0670-5b80-4ae4-aea4-0c03170a47d3 req-f3054aea-fb69-4960-b08c-b7bdfe22923b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:38.106088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-722c0670-5b80-4ae4-aea4-0c03170a47d3 req-f3054aea-fb69-4960-b08c-b7bdfe22923b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:38.124489 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-722c0670-5b80-4ae4-aea4-0c03170a47d3 req-f3054aea-fb69-4960-b08c-b7bdfe22923b service nova] Creating event network-vif-plugged:2602e55b-b283-44a9-82fe-eba44cd72b1b for instance 47c8d34c-c7ca-4b8d-ba7e-72ce986a0985 on n-h2-858272-3 Oct 05 02:38:38.129688 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-722c0670-5b80-4ae4-aea4-0c03170a47d3 req-f3054aea-fb69-4960-b08c-b7bdfe22923b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051183 Oct 05 02:38:38.130860 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1321/2674] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:38:38.280813 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4b2ac116-9f70-46bd-b1c9-0c2239ffb3bf tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:38.282656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4b2ac116-9f70-46bd-b1c9-0c2239ffb3bf tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: 47c8d34c-c7ca-4b8d-ba7e-72ce986a0985] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:38.300719 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b2ac116-9f70-46bd-b1c9-0c2239ffb3bf tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:38.301540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b2ac116-9f70-46bd-b1c9-0c2239ffb3bf tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:38.302288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b2ac116-9f70-46bd-b1c9-0c2239ffb3bf tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:38.303002 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b2ac116-9f70-46bd-b1c9-0c2239ffb3bf tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:38.303459 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b2ac116-9f70-46bd-b1c9-0c2239ffb3bf tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:38.304043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b2ac116-9f70-46bd-b1c9-0c2239ffb3bf tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:38.483008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4b2ac116-9f70-46bd-b1c9-0c2239ffb3bf tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:38.492246 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4b2ac116-9f70-46bd-b1c9-0c2239ffb3bf tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/47c8d34c-c7ca-4b8d-ba7e-72ce986a0985" status: 200 len: 1322 microversion: 2.1 time: 0.217372 Oct 05 02:38:38.494605 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1354/2675] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:38 2022] GET /compute/v2.1/servers/47c8d34c-c7ca-4b8d-ba7e-72ce986a0985 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:38.641541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d990809d-8641-4014-9f1f-0d490f269d83 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:38.642955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d990809d-8641-4014-9f1f-0d490f269d83 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 549e9e9b-0461-402c-a082-4f6a85a6e3c8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:38.661634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d990809d-8641-4014-9f1f-0d490f269d83 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:38.664797 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d990809d-8641-4014-9f1f-0d490f269d83 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:38.665538 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d990809d-8641-4014-9f1f-0d490f269d83 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:38.666802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d990809d-8641-4014-9f1f-0d490f269d83 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:38.669727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d990809d-8641-4014-9f1f-0d490f269d83 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:38.674975 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d990809d-8641-4014-9f1f-0d490f269d83 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:38.714557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cb29df63-c29c-4bc8-8a38-8a3d1fa29cd5 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fcce8296940>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:38.812573 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cb29df63-c29c-4bc8-8a38-8a3d1fa29cd5 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700" status: 200 len: 1424 microversion: 2.1 time: 0.104507 Oct 05 02:38:38.813697 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1355/2676] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:38 2022] GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700 => generated 1424 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:38.876257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2cbef45e-792c-4253-93da-2023d0173411 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:38.877154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2cbef45e-792c-4253-93da-2023d0173411 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] [instance: 40d4b47d-383b-4342-a6d7-27725c71fb1d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:38.888362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cbef45e-792c-4253-93da-2023d0173411 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:38.888865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cbef45e-792c-4253-93da-2023d0173411 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:38.894126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cbef45e-792c-4253-93da-2023d0173411 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:38.903279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cbef45e-792c-4253-93da-2023d0173411 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:38.904235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cbef45e-792c-4253-93da-2023d0173411 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:38.904976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cbef45e-792c-4253-93da-2023d0173411 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:39.054456 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2cbef45e-792c-4253-93da-2023d0173411 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:39.058132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d990809d-8641-4014-9f1f-0d490f269d83 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:39.068351 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d990809d-8641-4014-9f1f-0d490f269d83 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8" status: 200 len: 1469 microversion: 2.1 time: 0.432929 Oct 05 02:38:39.090254 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2cbef45e-792c-4253-93da-2023d0173411 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:39.092597 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1322/2677] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:38 2022] GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8 => generated 1469 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:39.092763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2cbef45e-792c-4253-93da-2023d0173411 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:39.094330 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2cbef45e-792c-4253-93da-2023d0173411 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] 10.222.0.16 "GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d" status: 200 len: 1365 microversion: 2.47 time: 0.223029 Oct 05 02:38:39.098769 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1356/2678] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:38:38 2022] GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:38:39.099673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3731b644-baf9-49b9-8306-8fb80f4bfc32 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:39.100476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3731b644-baf9-49b9-8306-8fb80f4bfc32 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:39.112219 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3731b644-baf9-49b9-8306-8fb80f4bfc32 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:39.112945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3731b644-baf9-49b9-8306-8fb80f4bfc32 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:39.113536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3731b644-baf9-49b9-8306-8fb80f4bfc32 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:39.113698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5e5334c8-e355-4a98-8e39-6d6c25d7adcf tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:39.114565 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3731b644-baf9-49b9-8306-8fb80f4bfc32 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:39.115177 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3731b644-baf9-49b9-8306-8fb80f4bfc32 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:39.115974 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5e5334c8-e355-4a98-8e39-6d6c25d7adcf tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: d216853e-3fda-40f8-be89-56e8756c83a8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:39.117261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3731b644-baf9-49b9-8306-8fb80f4bfc32 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:39.135142 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e5334c8-e355-4a98-8e39-6d6c25d7adcf tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:39.135732 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e5334c8-e355-4a98-8e39-6d6c25d7adcf tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:39.141001 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e5334c8-e355-4a98-8e39-6d6c25d7adcf tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:39.141001 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e5334c8-e355-4a98-8e39-6d6c25d7adcf tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:39.141001 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e5334c8-e355-4a98-8e39-6d6c25d7adcf tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:39.141658 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e5334c8-e355-4a98-8e39-6d6c25d7adcf tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:39.433839 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5e5334c8-e355-4a98-8e39-6d6c25d7adcf tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:39.446839 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5e5334c8-e355-4a98-8e39-6d6c25d7adcf tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/d216853e-3fda-40f8-be89-56e8756c83a8" status: 200 len: 1469 microversion: 2.1 time: 0.344743 Oct 05 02:38:39.458643 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1357/2679] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:39 2022] GET /compute/v2.1/servers/d216853e-3fda-40f8-be89-56e8756c83a8 => generated 1469 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:39.473171 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-165e6ab8-c4c4-4014-ba36-39e32d6f1a81 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:39.482573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-165e6ab8-c4c4-4014-ba36-39e32d6f1a81 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:39.485005 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-165e6ab8-c4c4-4014-ba36-39e32d6f1a81 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Searching by: {'reservation_id': 'r-oclxipl1', 'deleted': False, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6'} {{(pid=122320) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:38:39.492558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-165e6ab8-c4c4-4014-ba36-39e32d6f1a81 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:39.493921 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-165e6ab8-c4c4-4014-ba36-39e32d6f1a81 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:39.494517 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-165e6ab8-c4c4-4014-ba36-39e32d6f1a81 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:39.495435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-165e6ab8-c4c4-4014-ba36-39e32d6f1a81 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:39.496219 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3731b644-baf9-49b9-8306-8fb80f4bfc32 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:39.497185 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-165e6ab8-c4c4-4014-ba36-39e32d6f1a81 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:39.497899 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-165e6ab8-c4c4-4014-ba36-39e32d6f1a81 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:39.511401 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3731b644-baf9-49b9-8306-8fb80f4bfc32 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1477 microversion: 2.1 time: 0.415927 Oct 05 02:38:39.512713 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1323/2680] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:39 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1477 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:39.526165 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-70764111-9fe4-48a5-9436-81da69b10208 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:39.527500 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-70764111-9fe4-48a5-9436-81da69b10208 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: 47c8d34c-c7ca-4b8d-ba7e-72ce986a0985] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:39.540470 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-70764111-9fe4-48a5-9436-81da69b10208 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:39.543378 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-70764111-9fe4-48a5-9436-81da69b10208 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:39.545565 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-70764111-9fe4-48a5-9436-81da69b10208 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:39.547283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-70764111-9fe4-48a5-9436-81da69b10208 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:39.549253 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-70764111-9fe4-48a5-9436-81da69b10208 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:39.549877 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-70764111-9fe4-48a5-9436-81da69b10208 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:39.693848 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.multi_cell_list [None req-165e6ab8-c4c4-4014-ba36-39e32d6f1a81 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:38:39.809763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-165e6ab8-c4c4-4014-ba36-39e32d6f1a81 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:39.822157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-70764111-9fe4-48a5-9436-81da69b10208 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:39.822719 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-165e6ab8-c4c4-4014-ba36-39e32d6f1a81 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:39.824277 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-165e6ab8-c4c4-4014-ba36-39e32d6f1a81 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:39.824277 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-165e6ab8-c4c4-4014-ba36-39e32d6f1a81 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:39.831825 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-70764111-9fe4-48a5-9436-81da69b10208 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/47c8d34c-c7ca-4b8d-ba7e-72ce986a0985" status: 200 len: 1322 microversion: 2.1 time: 0.312261 Oct 05 02:38:39.833080 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1324/2681] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:39 2022] GET /compute/v2.1/servers/47c8d34c-c7ca-4b8d-ba7e-72ce986a0985 => generated 1322 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:38:39.840250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-337aab68-2d52-42a2-b811-024930ee2bc1 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fccdfd1d310>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:39.908203 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-337aab68-2d52-42a2-b811-024930ee2bc1 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700" status: 200 len: 1424 microversion: 2.1 time: 0.073770 Oct 05 02:38:39.909426 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1325/2682] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:39 2022] GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700 => generated 1424 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:40.128611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-399f46e6-dfb9-44e0-9889-0160e4e95aed tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:40.131184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-399f46e6-dfb9-44e0-9889-0160e4e95aed tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] [instance: 40d4b47d-383b-4342-a6d7-27725c71fb1d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:40.148917 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-399f46e6-dfb9-44e0-9889-0160e4e95aed tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:40.150803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-399f46e6-dfb9-44e0-9889-0160e4e95aed tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:40.152147 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-399f46e6-dfb9-44e0-9889-0160e4e95aed tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:40.154172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-399f46e6-dfb9-44e0-9889-0160e4e95aed tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:40.156007 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-399f46e6-dfb9-44e0-9889-0160e4e95aed tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:40.156787 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-399f46e6-dfb9-44e0-9889-0160e4e95aed tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:40.222595 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-165e6ab8-c4c4-4014-ba36-39e32d6f1a81 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?reservation_id=r-oclxipl1" status: 200 len: 2931 microversion: 2.1 time: 0.753292 Oct 05 02:38:40.237524 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1358/2683] 10.222.0.16 () {58 vars in 1197 bytes} [Wed Oct 5 02:38:39 2022] GET /compute/v2.1/servers/detail?reservation_id=r-oclxipl1 => generated 2931 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:38:40.248817 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b180d8e2-f5a4-453f-a2af-3352afe01dff tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:40.265549 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.compute.server_groups [None req-b180d8e2-f5a4-453f-a2af-3352afe01dff tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Querying cell d1723b23-1631-4a56-b9ad-72e4c39197cb(cell1) for 2 instances {{(pid=122320) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 05 02:38:40.266366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b180d8e2-f5a4-453f-a2af-3352afe01dff tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:40.266855 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b180d8e2-f5a4-453f-a2af-3352afe01dff tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:40.267296 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b180d8e2-f5a4-453f-a2af-3352afe01dff tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:40.289645 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b180d8e2-f5a4-453f-a2af-3352afe01dff tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/ad010c61-f0d8-4de3-8872-599fd3efd892" status: 200 len: 265 microversion: 2.1 time: 0.044587 Oct 05 02:38:40.296750 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1359/2684] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 5 02:38:40 2022] GET /compute/v2.1/os-server-groups/ad010c61-f0d8-4de3-8872-599fd3efd892 => generated 265 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:38:40.302796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f410a46b-18db-4712-926f-fbc793624b1f tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:40.304445 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f410a46b-18db-4712-926f-fbc793624b1f tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] [instance: 549e9e9b-0461-402c-a082-4f6a85a6e3c8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:40.312435 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-399f46e6-dfb9-44e0-9889-0160e4e95aed tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:40.323196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-399f46e6-dfb9-44e0-9889-0160e4e95aed tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:40.326338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f410a46b-18db-4712-926f-fbc793624b1f tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:40.328742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f410a46b-18db-4712-926f-fbc793624b1f tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:40.329385 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f410a46b-18db-4712-926f-fbc793624b1f tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:40.329576 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-399f46e6-dfb9-44e0-9889-0160e4e95aed tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:40.331105 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f410a46b-18db-4712-926f-fbc793624b1f tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:40.331954 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-399f46e6-dfb9-44e0-9889-0160e4e95aed tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] 10.222.0.16 "GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d" status: 200 len: 1365 microversion: 2.47 time: 0.209789 Oct 05 02:38:40.332786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f410a46b-18db-4712-926f-fbc793624b1f tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:40.333263 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f410a46b-18db-4712-926f-fbc793624b1f tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:40.338509 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1326/2685] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:38:40 2022] GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:38:40.545733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7f105536-795a-41be-891f-ba3c7aa28fc5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:40.547172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7f105536-795a-41be-891f-ba3c7aa28fc5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:40.549739 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f410a46b-18db-4712-926f-fbc793624b1f tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8" status: 200 len: 1620 microversion: 2.1 time: 0.251662 Oct 05 02:38:40.551864 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1360/2686] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:40 2022] GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8 => generated 1620 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:40.577930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f105536-795a-41be-891f-ba3c7aa28fc5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:40.578755 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-40e4be70-32d6-4585-b746-000237abcb48 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:40.579384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-40e4be70-32d6-4585-b746-000237abcb48 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] [instance: d216853e-3fda-40f8-be89-56e8756c83a8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:40.579892 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f105536-795a-41be-891f-ba3c7aa28fc5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:40.580863 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f105536-795a-41be-891f-ba3c7aa28fc5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:40.582284 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f105536-795a-41be-891f-ba3c7aa28fc5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:40.582831 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f105536-795a-41be-891f-ba3c7aa28fc5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:40.583949 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f105536-795a-41be-891f-ba3c7aa28fc5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:40.600178 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-40e4be70-32d6-4585-b746-000237abcb48 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:40.600873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-40e4be70-32d6-4585-b746-000237abcb48 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:40.605613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-40e4be70-32d6-4585-b746-000237abcb48 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:40.606385 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-40e4be70-32d6-4585-b746-000237abcb48 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:40.607113 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-40e4be70-32d6-4585-b746-000237abcb48 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:40.607726 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-40e4be70-32d6-4585-b746-000237abcb48 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:40.867375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7f105536-795a-41be-891f-ba3c7aa28fc5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:40.893362 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7f105536-795a-41be-891f-ba3c7aa28fc5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1477 microversion: 2.1 time: 0.355774 Oct 05 02:38:40.894307 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1327/2687] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:40 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1477 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:40.905699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-535f0b37-ca5c-4203-83e5-6c526fe85d6e tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:40.911786 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-535f0b37-ca5c-4203-83e5-6c526fe85d6e tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: 47c8d34c-c7ca-4b8d-ba7e-72ce986a0985] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:40.932879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-535f0b37-ca5c-4203-83e5-6c526fe85d6e tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:40.947907 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-535f0b37-ca5c-4203-83e5-6c526fe85d6e tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:40.948969 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-535f0b37-ca5c-4203-83e5-6c526fe85d6e tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:40.949934 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-535f0b37-ca5c-4203-83e5-6c526fe85d6e tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:40.950550 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-535f0b37-ca5c-4203-83e5-6c526fe85d6e tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:40.951137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-535f0b37-ca5c-4203-83e5-6c526fe85d6e tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:41.047143 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-40e4be70-32d6-4585-b746-000237abcb48 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d216853e-3fda-40f8-be89-56e8756c83a8" status: 200 len: 1620 microversion: 2.1 time: 0.471975 Oct 05 02:38:41.050192 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1361/2688] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:40 2022] GET /compute/v2.1/servers/d216853e-3fda-40f8-be89-56e8756c83a8 => generated 1620 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:41.057583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a6772152-4ca9-41b0-b60d-da8b60c4e574 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fcce40788b0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:41.146170 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a6772152-4ca9-41b0-b60d-da8b60c4e574 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700" status: 200 len: 1424 microversion: 2.1 time: 0.094803 Oct 05 02:38:41.161427 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1362/2689] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:41 2022] GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700 => generated 1424 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:41.169130 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3138623e-a2ab-4cc5-81ad-90b4c68b0656 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Action: 'create', calling method: .version_select at 0x7fcce433aa60>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1336327351", "policies": ["anti-affinity"]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:38:41.191601 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-3138623e-a2ab-4cc5-81ad-90b4c68b0656 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'server_groups'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:38:41.200969 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-3138623e-a2ab-4cc5-81ad-90b4c68b0656 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for user b86e3b7d1c9a4b2c8f2914beefa74cc1 and project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'server_groups'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:38:41.276154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-3138623e-a2ab-4cc5-81ad-90b4c68b0656 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'server_groups'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:38:41.290042 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-3138623e-a2ab-4cc5-81ad-90b4c68b0656 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for user b86e3b7d1c9a4b2c8f2914beefa74cc1 and project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'server_groups'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:38:41.296323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-535f0b37-ca5c-4203-83e5-6c526fe85d6e tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:41.309662 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-535f0b37-ca5c-4203-83e5-6c526fe85d6e tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/47c8d34c-c7ca-4b8d-ba7e-72ce986a0985" status: 200 len: 1322 microversion: 2.1 time: 0.414201 Oct 05 02:38:41.312070 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1328/2690] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:40 2022] GET /compute/v2.1/servers/47c8d34c-c7ca-4b8d-ba7e-72ce986a0985 => generated 1322 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:41.317395 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3138623e-a2ab-4cc5-81ad-90b4c68b0656 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.154408 Oct 05 02:38:41.331121 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1363/2691] 10.222.0.16 () {60 vars in 1174 bytes} [Wed Oct 5 02:38:41 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:38:41.365992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1aef5421-abe4-4911-8a3c-8d31928bb2d5 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:41.367513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1aef5421-abe4-4911-8a3c-8d31928bb2d5 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] [instance: 40d4b47d-383b-4342-a6d7-27725c71fb1d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:41.384071 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1aef5421-abe4-4911-8a3c-8d31928bb2d5 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:41.384688 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1aef5421-abe4-4911-8a3c-8d31928bb2d5 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:41.385060 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1aef5421-abe4-4911-8a3c-8d31928bb2d5 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:41.385787 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1aef5421-abe4-4911-8a3c-8d31928bb2d5 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:41.386250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1aef5421-abe4-4911-8a3c-8d31928bb2d5 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:41.386673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1aef5421-abe4-4911-8a3c-8d31928bb2d5 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:41.598948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-528573bf-a2ec-4371-b70f-b7fe5ad5bdc0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1346867411", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "8204c863-c4a9-45b5-80b6-8a22caf9efc6"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:38:41.723834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-528573bf-a2ec-4371-b70f-b7fe5ad5bdc0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] validate_networks() for None {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:38:42.009177 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1aef5421-abe4-4911-8a3c-8d31928bb2d5 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:42.027224 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1aef5421-abe4-4911-8a3c-8d31928bb2d5 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:42.028958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1aef5421-abe4-4911-8a3c-8d31928bb2d5 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:42.030142 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1aef5421-abe4-4911-8a3c-8d31928bb2d5 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] 10.222.0.16 "GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d" status: 200 len: 1365 microversion: 2.47 time: 0.668394 Oct 05 02:38:42.030710 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1329/2692] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:38:41 2022] GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d => generated 1365 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:38:42.046534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6dc17857-4303-4c6c-b1f1-e601ddb899be tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:42.047151 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6dc17857-4303-4c6c-b1f1-e601ddb899be tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:42.071555 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6dc17857-4303-4c6c-b1f1-e601ddb899be tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:42.073103 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6dc17857-4303-4c6c-b1f1-e601ddb899be tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:42.073794 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6dc17857-4303-4c6c-b1f1-e601ddb899be tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:42.075451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6dc17857-4303-4c6c-b1f1-e601ddb899be tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:42.076685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6dc17857-4303-4c6c-b1f1-e601ddb899be tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:42.078687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6dc17857-4303-4c6c-b1f1-e601ddb899be tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:42.131446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:42.391186 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-528573bf-a2ec-4371-b70f-b7fe5ad5bdc0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:38:42.391578 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-528573bf-a2ec-4371-b70f-b7fe5ad5bdc0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:38:42.392066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-528573bf-a2ec-4371-b70f-b7fe5ad5bdc0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:38:42.392481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-528573bf-a2ec-4371-b70f-b7fe5ad5bdc0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:38:42.392944 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-528573bf-a2ec-4371-b70f-b7fe5ad5bdc0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:38:42.422298 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-528573bf-a2ec-4371-b70f-b7fe5ad5bdc0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:42.423013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-528573bf-a2ec-4371-b70f-b7fe5ad5bdc0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:42.423465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-528573bf-a2ec-4371-b70f-b7fe5ad5bdc0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:42.424210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-528573bf-a2ec-4371-b70f-b7fe5ad5bdc0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:42.424675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-528573bf-a2ec-4371-b70f-b7fe5ad5bdc0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:42.425123 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-528573bf-a2ec-4371-b70f-b7fe5ad5bdc0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:42.430820 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6dc17857-4303-4c6c-b1f1-e601ddb899be tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:42.439513 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6dc17857-4303-4c6c-b1f1-e601ddb899be tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1477 microversion: 2.1 time: 0.407782 Oct 05 02:38:42.440721 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1330/2693] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:42 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1477 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:42.445648 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4902e270-a07c-48e5-b003-eb23c470f4fa tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fccdfd1baf0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:42.495028 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-528573bf-a2ec-4371-b70f-b7fe5ad5bdc0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:38:42.510395 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-528573bf-a2ec-4371-b70f-b7fe5ad5bdc0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for user b86e3b7d1c9a4b2c8f2914beefa74cc1 and project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:38:42.514680 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4902e270-a07c-48e5-b003-eb23c470f4fa tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700" status: 200 len: 1424 microversion: 2.1 time: 0.072722 Oct 05 02:38:42.515267 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1331/2694] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:42 2022] GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700 => generated 1424 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:42.523877 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d252e434-767c-49e8-8559-634237f584b2 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:42.525539 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-528573bf-a2ec-4371-b70f-b7fe5ad5bdc0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Going to run 2 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:38:42.527730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d252e434-767c-49e8-8559-634237f584b2 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: 47c8d34c-c7ca-4b8d-ba7e-72ce986a0985] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:42.531916 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-528573bf-a2ec-4371-b70f-b7fe5ad5bdc0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: de6a6594-881f-489b-8b94-28b74e935c1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:38:42.539971 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d252e434-767c-49e8-8559-634237f584b2 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:42.540484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d252e434-767c-49e8-8559-634237f584b2 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:42.544973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d252e434-767c-49e8-8559-634237f584b2 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:42.546145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d252e434-767c-49e8-8559-634237f584b2 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:42.546804 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d252e434-767c-49e8-8559-634237f584b2 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:42.547414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d252e434-767c-49e8-8559-634237f584b2 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:42.678461 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-528573bf-a2ec-4371-b70f-b7fe5ad5bdc0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'server_group_members'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:38:42.702856 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-528573bf-a2ec-4371-b70f-b7fe5ad5bdc0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for user b86e3b7d1c9a4b2c8f2914beefa74cc1 and project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'server_group_members'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:38:42.779356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:42.823990 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-528573bf-a2ec-4371-b70f-b7fe5ad5bdc0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'server_group_members'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:38:42.836981 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-528573bf-a2ec-4371-b70f-b7fe5ad5bdc0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for user b86e3b7d1c9a4b2c8f2914beefa74cc1 and project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'server_group_members'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:38:42.875208 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-528573bf-a2ec-4371-b70f-b7fe5ad5bdc0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 37204911-40f0-4356-a6df-7fda8afbf5da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=de6a6594-881f-489b-8b94-28b74e935c1e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:38:42.907552 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d252e434-767c-49e8-8559-634237f584b2 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:42.931744 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d252e434-767c-49e8-8559-634237f584b2 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/47c8d34c-c7ca-4b8d-ba7e-72ce986a0985" status: 200 len: 1322 microversion: 2.1 time: 0.411981 Oct 05 02:38:42.935598 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1332/2695] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:42 2022] GET /compute/v2.1/servers/47c8d34c-c7ca-4b8d-ba7e-72ce986a0985 => generated 1322 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:43.034995 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-528573bf-a2ec-4371-b70f-b7fe5ad5bdc0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'server_group_members'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:38:43.041178 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-528573bf-a2ec-4371-b70f-b7fe5ad5bdc0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for user b86e3b7d1c9a4b2c8f2914beefa74cc1 and project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'server_group_members'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:38:43.056295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-14d54c41-f096-41fb-a441-f4207f395285 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:43.057668 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-14d54c41-f096-41fb-a441-f4207f395285 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] [instance: 40d4b47d-383b-4342-a6d7-27725c71fb1d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:43.072527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-14d54c41-f096-41fb-a441-f4207f395285 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:43.073945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-14d54c41-f096-41fb-a441-f4207f395285 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:43.075448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-14d54c41-f096-41fb-a441-f4207f395285 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:43.076987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-14d54c41-f096-41fb-a441-f4207f395285 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:43.077682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-14d54c41-f096-41fb-a441-f4207f395285 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:43.078311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-14d54c41-f096-41fb-a441-f4207f395285 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:43.101628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-528573bf-a2ec-4371-b70f-b7fe5ad5bdc0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'server_group_members'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:38:43.109535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-528573bf-a2ec-4371-b70f-b7fe5ad5bdc0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for user b86e3b7d1c9a4b2c8f2914beefa74cc1 and project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'server_group_members'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:38:43.162897 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-528573bf-a2ec-4371-b70f-b7fe5ad5bdc0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.567768 Oct 05 02:38:43.167203 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-14d54c41-f096-41fb-a441-f4207f395285 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:43.167453 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1364/2696] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:38:41 2022] POST /compute/v2.1/servers => generated 32 bytes in 1572 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 05 02:38:43.175955 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-10601f02-ed8e-4229-a745-eb3ad2bd5158 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:43.178285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-14d54c41-f096-41fb-a441-f4207f395285 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:43.180683 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-14d54c41-f096-41fb-a441-f4207f395285 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:43.182144 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-14d54c41-f096-41fb-a441-f4207f395285 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] 10.222.0.16 "GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d" status: 200 len: 1365 microversion: 2.47 time: 0.130247 Oct 05 02:38:43.183056 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1333/2697] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:38:43 2022] GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d => generated 1365 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:38:43.200273 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-10601f02-ed8e-4229-a745-eb3ad2bd5158 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:43.203995 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-10601f02-ed8e-4229-a745-eb3ad2bd5158 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Searching by: {'deleted': False, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6'} {{(pid=122320) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:38:43.245597 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10601f02-ed8e-4229-a745-eb3ad2bd5158 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:43.248968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10601f02-ed8e-4229-a745-eb3ad2bd5158 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:43.249806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10601f02-ed8e-4229-a745-eb3ad2bd5158 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:43.252677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10601f02-ed8e-4229-a745-eb3ad2bd5158 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:43.254807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10601f02-ed8e-4229-a745-eb3ad2bd5158 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:43.258314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10601f02-ed8e-4229-a745-eb3ad2bd5158 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:43.431087 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.multi_cell_list [None req-10601f02-ed8e-4229-a745-eb3ad2bd5158 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=122320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:38:43.469368 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-82c04207-46f6-4dbb-9d1f-6fcb681303a1 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:43.470422 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-82c04207-46f6-4dbb-9d1f-6fcb681303a1 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:43.492939 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-82c04207-46f6-4dbb-9d1f-6fcb681303a1 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:43.495013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-82c04207-46f6-4dbb-9d1f-6fcb681303a1 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:43.498128 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-82c04207-46f6-4dbb-9d1f-6fcb681303a1 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:43.501421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-82c04207-46f6-4dbb-9d1f-6fcb681303a1 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:43.503104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-82c04207-46f6-4dbb-9d1f-6fcb681303a1 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:43.503791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-82c04207-46f6-4dbb-9d1f-6fcb681303a1 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:43.548453 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-10601f02-ed8e-4229-a745-eb3ad2bd5158 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1665 microversion: 2.1 time: 0.378170 Oct 05 02:38:43.549814 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1365/2698] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 5 02:38:43 2022] GET /compute/v2.1/servers => generated 1665 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:43.554718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d6d0e964-60d2-499c-97ad-78ecd7ec8bac tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fcce81714c0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:43.615113 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d6d0e964-60d2-499c-97ad-78ecd7ec8bac tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700" status: 200 len: 1424 microversion: 2.1 time: 0.063787 Oct 05 02:38:43.616308 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1366/2699] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:43 2022] GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700 => generated 1424 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:43.622459 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-134b852a-f5b8-4375-8afd-e577d37b25f0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:43.623330 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-134b852a-f5b8-4375-8afd-e577d37b25f0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 37204911-40f0-4356-a6df-7fda8afbf5da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:43.707109 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-134b852a-f5b8-4375-8afd-e577d37b25f0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:43.722077 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-134b852a-f5b8-4375-8afd-e577d37b25f0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da" status: 200 len: 1219 microversion: 2.1 time: 0.099077 Oct 05 02:38:43.728303 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1367/2700] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:43 2022] GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da => generated 1219 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:43.808888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-82c04207-46f6-4dbb-9d1f-6fcb681303a1 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:43.818782 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-82c04207-46f6-4dbb-9d1f-6fcb681303a1 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1477 microversion: 2.1 time: 0.354715 Oct 05 02:38:43.820406 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1334/2701] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:43 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1477 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:38:43.972365 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-266d6f10-5d46-4586-9250-98b34dfec28f tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:43.973117 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-266d6f10-5d46-4586-9250-98b34dfec28f tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: 47c8d34c-c7ca-4b8d-ba7e-72ce986a0985] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:43.984373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-266d6f10-5d46-4586-9250-98b34dfec28f tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:43.989332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-266d6f10-5d46-4586-9250-98b34dfec28f tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:43.992769 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-266d6f10-5d46-4586-9250-98b34dfec28f tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:43.993887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-266d6f10-5d46-4586-9250-98b34dfec28f tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:43.997118 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-266d6f10-5d46-4586-9250-98b34dfec28f tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:43.999387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-266d6f10-5d46-4586-9250-98b34dfec28f tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:44.196457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-266d6f10-5d46-4586-9250-98b34dfec28f tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:44.209726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cbaec78e-9ebd-4a03-9a65-a91c5fec4e85 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:44.210541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cbaec78e-9ebd-4a03-9a65-a91c5fec4e85 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] [instance: 40d4b47d-383b-4342-a6d7-27725c71fb1d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:44.217991 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cbaec78e-9ebd-4a03-9a65-a91c5fec4e85 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:44.218574 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-266d6f10-5d46-4586-9250-98b34dfec28f tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/47c8d34c-c7ca-4b8d-ba7e-72ce986a0985" status: 200 len: 1515 microversion: 2.1 time: 0.237416 Oct 05 02:38:44.219439 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1368/2702] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:43 2022] GET /compute/v2.1/servers/47c8d34c-c7ca-4b8d-ba7e-72ce986a0985 => generated 1515 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:44.219900 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cbaec78e-9ebd-4a03-9a65-a91c5fec4e85 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:44.220508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cbaec78e-9ebd-4a03-9a65-a91c5fec4e85 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:44.221484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cbaec78e-9ebd-4a03-9a65-a91c5fec4e85 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:44.222089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cbaec78e-9ebd-4a03-9a65-a91c5fec4e85 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:44.222577 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cbaec78e-9ebd-4a03-9a65-a91c5fec4e85 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:44.243415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7008df70-5058-495c-a677-6d1b700d639d tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:44.244113 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7008df70-5058-495c-a677-6d1b700d639d tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: 40fd6f92-87b8-452f-827f-1bf2b2be98a9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:44.259719 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7008df70-5058-495c-a677-6d1b700d639d tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:44.260283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7008df70-5058-495c-a677-6d1b700d639d tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:44.260733 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7008df70-5058-495c-a677-6d1b700d639d tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:44.264405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7008df70-5058-495c-a677-6d1b700d639d tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:44.265240 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7008df70-5058-495c-a677-6d1b700d639d tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:44.265705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7008df70-5058-495c-a677-6d1b700d639d tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:44.298846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cbaec78e-9ebd-4a03-9a65-a91c5fec4e85 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:44.299613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cbaec78e-9ebd-4a03-9a65-a91c5fec4e85 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:44.300382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cbaec78e-9ebd-4a03-9a65-a91c5fec4e85 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:44.303148 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-cbaec78e-9ebd-4a03-9a65-a91c5fec4e85 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lazy-loading 'fault' on Instance uuid 40d4b47d-383b-4342-a6d7-27725c71fb1d {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:38:44.410773 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cbaec78e-9ebd-4a03-9a65-a91c5fec4e85 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:44.421010 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cbaec78e-9ebd-4a03-9a65-a91c5fec4e85 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:44.422475 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cbaec78e-9ebd-4a03-9a65-a91c5fec4e85 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:44.423706 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cbaec78e-9ebd-4a03-9a65-a91c5fec4e85 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] 10.222.0.16 "GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d" status: 200 len: 1370 microversion: 2.47 time: 0.217804 Oct 05 02:38:44.424279 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1335/2703] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:38:44 2022] GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d => generated 1370 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:38:44.603943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7008df70-5058-495c-a677-6d1b700d639d tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:44.619063 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7008df70-5058-495c-a677-6d1b700d639d tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/40fd6f92-87b8-452f-827f-1bf2b2be98a9" status: 200 len: 1515 microversion: 2.1 time: 0.379865 Oct 05 02:38:44.642646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0a362909-881e-4ca7-a104-ad61331afab2 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fccdfcaef70>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:44.658976 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1369/2704] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:44 2022] GET /compute/v2.1/servers/40fd6f92-87b8-452f-827f-1bf2b2be98a9 => generated 1515 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:44.670155 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2acfe622-47ba-491b-a329-f78b4571c760 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:44.674092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2acfe622-47ba-491b-a329-f78b4571c760 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: 40fd6f92-87b8-452f-827f-1bf2b2be98a9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:44.690000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2acfe622-47ba-491b-a329-f78b4571c760 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:44.690724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2acfe622-47ba-491b-a329-f78b4571c760 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:44.691499 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2acfe622-47ba-491b-a329-f78b4571c760 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:44.693612 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2acfe622-47ba-491b-a329-f78b4571c760 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:44.699746 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2acfe622-47ba-491b-a329-f78b4571c760 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:44.699746 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2acfe622-47ba-491b-a329-f78b4571c760 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:44.723502 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0a362909-881e-4ca7-a104-ad61331afab2 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700" status: 200 len: 1424 microversion: 2.1 time: 0.083317 Oct 05 02:38:44.735188 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1336/2705] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:44 2022] GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700 => generated 1424 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:38:44.744209 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2acfe622-47ba-491b-a329-f78b4571c760 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: 40fd6f92-87b8-452f-827f-1bf2b2be98a9] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:38:44.754751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-90621644-9eeb-4f48-90cc-35ecdd864d9e tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:44.758234 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-90621644-9eeb-4f48-90cc-35ecdd864d9e tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 37204911-40f0-4356-a6df-7fda8afbf5da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:44.856789 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:44.912394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-90621644-9eeb-4f48-90cc-35ecdd864d9e tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:44.934717 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-90621644-9eeb-4f48-90cc-35ecdd864d9e tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da" status: 200 len: 1219 microversion: 2.1 time: 0.184522 Oct 05 02:38:44.944986 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1337/2706] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:44 2022] GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da => generated 1219 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:38:44.972289 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2c77086f-3eda-4065-97a7-7d6d271ab42c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:44.974728 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2c77086f-3eda-4065-97a7-7d6d271ab42c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:44.982888 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2acfe622-47ba-491b-a329-f78b4571c760 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "DELETE /compute/v2.1/servers/40fd6f92-87b8-452f-827f-1bf2b2be98a9" status: 204 len: 0 microversion: 2.1 time: 0.322238 Oct 05 02:38:44.985359 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1370/2707] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:38:44 2022] DELETE /compute/v2.1/servers/40fd6f92-87b8-452f-827f-1bf2b2be98a9 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:38:44.991351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c77086f-3eda-4065-97a7-7d6d271ab42c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:44.992449 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c77086f-3eda-4065-97a7-7d6d271ab42c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:44.992927 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c77086f-3eda-4065-97a7-7d6d271ab42c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:44.993658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c77086f-3eda-4065-97a7-7d6d271ab42c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:44.998235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e4b40b66-16fd-4dbc-8b6d-08c14b500caf tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:44.999312 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e4b40b66-16fd-4dbc-8b6d-08c14b500caf tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: 40fd6f92-87b8-452f-827f-1bf2b2be98a9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:44.999734 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c77086f-3eda-4065-97a7-7d6d271ab42c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:45.000478 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c77086f-3eda-4065-97a7-7d6d271ab42c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:45.006597 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4b40b66-16fd-4dbc-8b6d-08c14b500caf tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:45.008323 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4b40b66-16fd-4dbc-8b6d-08c14b500caf tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:45.009242 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4b40b66-16fd-4dbc-8b6d-08c14b500caf tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:45.010424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4b40b66-16fd-4dbc-8b6d-08c14b500caf tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:45.012275 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4b40b66-16fd-4dbc-8b6d-08c14b500caf tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:45.012275 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4b40b66-16fd-4dbc-8b6d-08c14b500caf tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:45.427082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2c77086f-3eda-4065-97a7-7d6d271ab42c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:45.442844 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2c77086f-3eda-4065-97a7-7d6d271ab42c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1477 microversion: 2.1 time: 0.496352 Oct 05 02:38:45.445565 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1338/2708] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:44 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1477 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:45.457037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-aa0d798f-d349-4787-ab8b-3fce4ada7221 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:45.459217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-aa0d798f-d349-4787-ab8b-3fce4ada7221 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] [instance: 40d4b47d-383b-4342-a6d7-27725c71fb1d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:45.473422 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa0d798f-d349-4787-ab8b-3fce4ada7221 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:45.476881 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa0d798f-d349-4787-ab8b-3fce4ada7221 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:45.478335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa0d798f-d349-4787-ab8b-3fce4ada7221 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:45.480175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa0d798f-d349-4787-ab8b-3fce4ada7221 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:45.481303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa0d798f-d349-4787-ab8b-3fce4ada7221 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:45.491815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa0d798f-d349-4787-ab8b-3fce4ada7221 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:45.524849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e4b40b66-16fd-4dbc-8b6d-08c14b500caf tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:45.533813 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e4b40b66-16fd-4dbc-8b6d-08c14b500caf tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/40fd6f92-87b8-452f-827f-1bf2b2be98a9" status: 200 len: 1521 microversion: 2.1 time: 0.544305 Oct 05 02:38:45.534410 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1371/2709] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:44 2022] GET /compute/v2.1/servers/40fd6f92-87b8-452f-827f-1bf2b2be98a9 => generated 1521 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:45.575793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa0d798f-d349-4787-ab8b-3fce4ada7221 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:45.576703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa0d798f-d349-4787-ab8b-3fce4ada7221 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:45.577366 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa0d798f-d349-4787-ab8b-3fce4ada7221 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:45.578301 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-aa0d798f-d349-4787-ab8b-3fce4ada7221 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lazy-loading 'fault' on Instance uuid 40d4b47d-383b-4342-a6d7-27725c71fb1d {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:38:45.627397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-aa0d798f-d349-4787-ab8b-3fce4ada7221 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:45.643834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-aa0d798f-d349-4787-ab8b-3fce4ada7221 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:45.647233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-aa0d798f-d349-4787-ab8b-3fce4ada7221 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '172b2bb2caeb439f858fc7b0eb04f3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25750c409a734a778294ca66299d4616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:45.649138 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-aa0d798f-d349-4787-ab8b-3fce4ada7221 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] 10.222.0.16 "GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d" status: 200 len: 1370 microversion: 2.47 time: 0.199022 Oct 05 02:38:45.649722 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1339/2710] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:38:45 2022] GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d => generated 1370 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:38:45.739768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e9924ea1-d60e-4f80-bce6-ad22266f846f tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fccdfd16280>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:45.827688 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e9924ea1-d60e-4f80-bce6-ad22266f846f tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700" status: 200 len: 1424 microversion: 2.1 time: 0.091482 Oct 05 02:38:45.837992 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1372/2711] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:45 2022] GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700 => generated 1424 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:45.964429 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4ab9e5fc-284d-44b8-ba50-12d32f387767 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:45.965341 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4ab9e5fc-284d-44b8-ba50-12d32f387767 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 37204911-40f0-4356-a6df-7fda8afbf5da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:45.977092 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ab9e5fc-284d-44b8-ba50-12d32f387767 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:45.977933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ab9e5fc-284d-44b8-ba50-12d32f387767 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:45.978816 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ab9e5fc-284d-44b8-ba50-12d32f387767 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:45.979585 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ab9e5fc-284d-44b8-ba50-12d32f387767 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:45.980245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ab9e5fc-284d-44b8-ba50-12d32f387767 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:45.981017 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ab9e5fc-284d-44b8-ba50-12d32f387767 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:46.089740 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4ab9e5fc-284d-44b8-ba50-12d32f387767 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:46.100193 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4ab9e5fc-284d-44b8-ba50-12d32f387767 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da" status: 200 len: 1223 microversion: 2.1 time: 0.139864 Oct 05 02:38:46.101929 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1340/2712] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:45 2022] GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da => generated 1223 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:46.473906 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-deb38a44-fe27-4780-b718-a2e5f2990ea6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:46.474863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-deb38a44-fe27-4780-b718-a2e5f2990ea6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:46.487308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-deb38a44-fe27-4780-b718-a2e5f2990ea6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:46.488212 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-deb38a44-fe27-4780-b718-a2e5f2990ea6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:46.488352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-deb38a44-fe27-4780-b718-a2e5f2990ea6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:46.489135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-deb38a44-fe27-4780-b718-a2e5f2990ea6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:46.489603 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-deb38a44-fe27-4780-b718-a2e5f2990ea6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:46.490681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-deb38a44-fe27-4780-b718-a2e5f2990ea6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:46.560866 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f90e975e-4306-434f-9f50-a5b2e6e80382 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:46.562250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f90e975e-4306-434f-9f50-a5b2e6e80382 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: 40fd6f92-87b8-452f-827f-1bf2b2be98a9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:46.577673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f90e975e-4306-434f-9f50-a5b2e6e80382 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:46.581100 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f90e975e-4306-434f-9f50-a5b2e6e80382 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:46.581995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f90e975e-4306-434f-9f50-a5b2e6e80382 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:46.583043 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f90e975e-4306-434f-9f50-a5b2e6e80382 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:46.584602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f90e975e-4306-434f-9f50-a5b2e6e80382 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:46.587463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f90e975e-4306-434f-9f50-a5b2e6e80382 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:47.171204 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-deb38a44-fe27-4780-b718-a2e5f2990ea6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:47.185555 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-deb38a44-fe27-4780-b718-a2e5f2990ea6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1477 microversion: 2.1 time: 0.715944 Oct 05 02:38:47.192358 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f90e975e-4306-434f-9f50-a5b2e6e80382 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:47.209430 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1373/2713] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:46 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1477 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:47.212103 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f90e975e-4306-434f-9f50-a5b2e6e80382 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/40fd6f92-87b8-452f-827f-1bf2b2be98a9" status: 200 len: 1521 microversion: 2.1 time: 0.651914 Oct 05 02:38:47.219854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4e75f1b7-1854-40d0-8a24-031d11104e88 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:47.222453 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4e75f1b7-1854-40d0-8a24-031d11104e88 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] [instance: 40d4b47d-383b-4342-a6d7-27725c71fb1d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:47.231855 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e75f1b7-1854-40d0-8a24-031d11104e88 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:47.233275 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e75f1b7-1854-40d0-8a24-031d11104e88 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:47.234247 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e75f1b7-1854-40d0-8a24-031d11104e88 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:47.235194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e75f1b7-1854-40d0-8a24-031d11104e88 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:47.235650 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1341/2714] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:46 2022] GET /compute/v2.1/servers/40fd6f92-87b8-452f-827f-1bf2b2be98a9 => generated 1521 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:38:47.236144 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e75f1b7-1854-40d0-8a24-031d11104e88 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:47.236822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e75f1b7-1854-40d0-8a24-031d11104e88 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:47.243811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-557bb20a-3e1e-4600-b9ac-ce72f89c1c5a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fcce828d310>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:47.257615 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-4e75f1b7-1854-40d0-8a24-031d11104e88 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] HTTP exception thrown: Instance 40d4b47d-383b-4342-a6d7-27725c71fb1d could not be found. Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4e75f1b7-1854-40d0-8a24-031d11104e88 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Request method failure captured: Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d HTTP/1.1 Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO4c6QQ4h5FpqNoCqjCWl2gqz2Qx_XCkN6hEGoGtQ1oOAsp_hmkQ_8JrL-P63ng3HoMqD70q_dT_CoyrgOp5oNSThL_lHjsm_I-hHdeRv_U5iEl_FbD7zjeJgfoyVmcr8zeQLRjHkjq8XVEPJ80YIDtYWwDgDPCKZ3jxkjJyZPPkYBA Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: X-Openstack-Nova-Api-Version: 2.47 Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 25750c409a734a778294ca66299d4616 Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersAaction247Test-501036043 Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/25750c409a734a778294ca66299d4616"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/25750c409a734a778294ca66299d4616"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/25750c409a734a778294ca66299d4616"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_25750c409a734a778294ca66299d4616"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersAaction247Test-501036043 Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 25750c409a734a778294ca66299d4616 Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersAaction247Test-501036043 Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersAaction247Test-501036043-project Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 172b2bb2caeb439f858fc7b0eb04f3bf Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersAaction247Test-501036043-project Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 40d4b47d-383b-4342-a6d7-27725c71fb1d could not be found. Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '40d4b47d-383b-4342-a6d7-27725c71fb1d'} Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40d4b47d-383b-4342-a6d7-27725c71fb1d could not be found. Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40d4b47d-383b-4342-a6d7-27725c71fb1d could not be found. Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:38:47.260883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:47.265290 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:47.265290 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:38:47.265290 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:38:47.265290 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:38:47.265290 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:38:47.265290 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40d4b47d-383b-4342-a6d7-27725c71fb1d could not be found. Oct 05 02:38:47.265290 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:47.265290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4e75f1b7-1854-40d0-8a24-031d11104e88 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] Returning 404 to user: Instance 40d4b47d-383b-4342-a6d7-27725c71fb1d could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:38:47.265290 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4e75f1b7-1854-40d0-8a24-031d11104e88 tempest-ServersAaction247Test-501036043 tempest-ServersAaction247Test-501036043-project] 10.222.0.16 "GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d" status: 404 len: 111 microversion: 2.47 time: 0.052413 Oct 05 02:38:47.269668 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1374/2715] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:38:47 2022] GET /compute/v2.1/servers/40d4b47d-383b-4342-a6d7-27725c71fb1d => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:38:47.275745 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-55cdf21d-fff3-4290-aa34-c26d1859b0d7 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:47.276427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-55cdf21d-fff3-4290-aa34-c26d1859b0d7 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 37204911-40f0-4356-a6df-7fda8afbf5da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:47.308472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55cdf21d-fff3-4290-aa34-c26d1859b0d7 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:47.312372 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55cdf21d-fff3-4290-aa34-c26d1859b0d7 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:47.313352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55cdf21d-fff3-4290-aa34-c26d1859b0d7 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:47.318430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55cdf21d-fff3-4290-aa34-c26d1859b0d7 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:47.321366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55cdf21d-fff3-4290-aa34-c26d1859b0d7 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:47.325698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55cdf21d-fff3-4290-aa34-c26d1859b0d7 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:47.352692 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-557bb20a-3e1e-4600-b9ac-ce72f89c1c5a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700" status: 200 len: 1424 microversion: 2.1 time: 0.115796 Oct 05 02:38:47.361210 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1342/2716] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:47 2022] GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700 => generated 1424 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:47.590282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-55cdf21d-fff3-4290-aa34-c26d1859b0d7 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:47.598702 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-55cdf21d-fff3-4290-aa34-c26d1859b0d7 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da" status: 200 len: 1271 microversion: 2.1 time: 0.327884 Oct 05 02:38:47.599409 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1375/2717] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:47 2022] GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da => generated 1271 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:48.111465 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bb4c1994-e306-4430-90ad-e9521c53d667 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:48.112674 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bb4c1994-e306-4430-90ad-e9521c53d667 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:48.128310 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bb4c1994-e306-4430-90ad-e9521c53d667 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:48.129209 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bb4c1994-e306-4430-90ad-e9521c53d667 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:48.130588 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bb4c1994-e306-4430-90ad-e9521c53d667 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:48.133225 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bb4c1994-e306-4430-90ad-e9521c53d667 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:48.135138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bb4c1994-e306-4430-90ad-e9521c53d667 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:48.137218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bb4c1994-e306-4430-90ad-e9521c53d667 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:48.216367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8e5b0807-ea1d-4327-8edf-eabfc9dbc0ad tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:48.217096 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8e5b0807-ea1d-4327-8edf-eabfc9dbc0ad tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:48.218951 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bb4c1994-e306-4430-90ad-e9521c53d667 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21/ips" status: 200 len: 151 microversion: 2.20 time: 0.112025 Oct 05 02:38:48.220201 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1343/2718] 10.222.0.16 () {60 vars in 1289 bytes} [Wed Oct 5 02:38:48 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21/ips => generated 151 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:38:48.228795 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e5b0807-ea1d-4327-8edf-eabfc9dbc0ad tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:48.229313 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e5b0807-ea1d-4327-8edf-eabfc9dbc0ad tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:48.238029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e5b0807-ea1d-4327-8edf-eabfc9dbc0ad tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:48.242728 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e5b0807-ea1d-4327-8edf-eabfc9dbc0ad tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:48.243650 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e5b0807-ea1d-4327-8edf-eabfc9dbc0ad tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:48.245422 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e5b0807-ea1d-4327-8edf-eabfc9dbc0ad tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:48.246188 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3d6f6f8b-3075-4163-bcc2-94ab8f5a4cc4 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:48.248761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3d6f6f8b-3075-4163-bcc2-94ab8f5a4cc4 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: 40fd6f92-87b8-452f-827f-1bf2b2be98a9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:48.266040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3d6f6f8b-3075-4163-bcc2-94ab8f5a4cc4 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:48.268309 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3d6f6f8b-3075-4163-bcc2-94ab8f5a4cc4 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:48.268979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3d6f6f8b-3075-4163-bcc2-94ab8f5a4cc4 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:48.274215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3d6f6f8b-3075-4163-bcc2-94ab8f5a4cc4 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:48.275727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3d6f6f8b-3075-4163-bcc2-94ab8f5a4cc4 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:48.277016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3d6f6f8b-3075-4163-bcc2-94ab8f5a4cc4 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:49.062035 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3d6f6f8b-3075-4163-bcc2-94ab8f5a4cc4 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:49.071498 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3d6f6f8b-3075-4163-bcc2-94ab8f5a4cc4 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/40fd6f92-87b8-452f-827f-1bf2b2be98a9" status: 200 len: 1521 microversion: 2.1 time: 0.832112 Oct 05 02:38:49.075595 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1344/2719] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:48 2022] GET /compute/v2.1/servers/40fd6f92-87b8-452f-827f-1bf2b2be98a9 => generated 1521 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:49.092306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-44df3d84-b13a-43a8-8473-e34810bb71c0 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fcce428ba60>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:49.204125 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-44df3d84-b13a-43a8-8473-e34810bb71c0 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700" status: 200 len: 1424 microversion: 2.1 time: 0.125159 Oct 05 02:38:49.205851 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1345/2720] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:49 2022] GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700 => generated 1424 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:49.223914 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-27338fa9-dfb6-4fc7-93f6-edce1a22b3b9 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:49.227260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-27338fa9-dfb6-4fc7-93f6-edce1a22b3b9 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 37204911-40f0-4356-a6df-7fda8afbf5da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:49.251476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27338fa9-dfb6-4fc7-93f6-edce1a22b3b9 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:49.255383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27338fa9-dfb6-4fc7-93f6-edce1a22b3b9 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:49.265105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27338fa9-dfb6-4fc7-93f6-edce1a22b3b9 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:49.266226 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27338fa9-dfb6-4fc7-93f6-edce1a22b3b9 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:49.267663 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27338fa9-dfb6-4fc7-93f6-edce1a22b3b9 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:49.269892 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27338fa9-dfb6-4fc7-93f6-edce1a22b3b9 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:49.572818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8e5b0807-ea1d-4327-8edf-eabfc9dbc0ad tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:49.601223 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8e5b0807-ea1d-4327-8edf-eabfc9dbc0ad tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1477 microversion: 2.1 time: 1.383383 Oct 05 02:38:49.604447 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1376/2721] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:48 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1477 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:38:49.626044 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-27338fa9-dfb6-4fc7-93f6-edce1a22b3b9 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:49.657504 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-27338fa9-dfb6-4fc7-93f6-edce1a22b3b9 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da" status: 200 len: 1271 microversion: 2.1 time: 0.441154 Oct 05 02:38:49.665432 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1346/2722] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:49 2022] GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da => generated 1271 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:50.100448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d8c0bbf5-107c-47bc-8b97-d9b0b4fb3d59 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:50.101418 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d8c0bbf5-107c-47bc-8b97-d9b0b4fb3d59 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: 40fd6f92-87b8-452f-827f-1bf2b2be98a9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:50.111084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d8c0bbf5-107c-47bc-8b97-d9b0b4fb3d59 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:50.111819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d8c0bbf5-107c-47bc-8b97-d9b0b4fb3d59 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:50.114183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d8c0bbf5-107c-47bc-8b97-d9b0b4fb3d59 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:50.115132 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d8c0bbf5-107c-47bc-8b97-d9b0b4fb3d59 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:50.116893 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d8c0bbf5-107c-47bc-8b97-d9b0b4fb3d59 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:50.117818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d8c0bbf5-107c-47bc-8b97-d9b0b4fb3d59 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:50.227698 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-eb6d05ff-b149-4c08-a82b-5c0d01669c3d tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fccdfdb8d30>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:50.296835 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-eb6d05ff-b149-4c08-a82b-5c0d01669c3d tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700" status: 200 len: 1424 microversion: 2.1 time: 0.077664 Oct 05 02:38:50.305569 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1347/2723] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:50 2022] GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700 => generated 1424 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:38:50.658483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-359eddcb-57a5-42ee-b7fc-0b64e90f4ceb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:50.664971 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-359eddcb-57a5-42ee-b7fc-0b64e90f4ceb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:50.704851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-359eddcb-57a5-42ee-b7fc-0b64e90f4ceb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:50.705992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-359eddcb-57a5-42ee-b7fc-0b64e90f4ceb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:50.709345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-359eddcb-57a5-42ee-b7fc-0b64e90f4ceb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:50.717468 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-359eddcb-57a5-42ee-b7fc-0b64e90f4ceb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:50.717997 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-359eddcb-57a5-42ee-b7fc-0b64e90f4ceb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:50.723816 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-359eddcb-57a5-42ee-b7fc-0b64e90f4ceb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:51.620724 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-359eddcb-57a5-42ee-b7fc-0b64e90f4ceb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:51.636211 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-359eddcb-57a5-42ee-b7fc-0b64e90f4ceb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1476 microversion: 2.1 time: 1.010118 Oct 05 02:38:51.656932 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1348/2724] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:50 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1476 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:51.656932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d402d972-1260-4d2e-b67d-a0d49d46972d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:51.656932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d402d972-1260-4d2e-b67d-a0d49d46972d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 37204911-40f0-4356-a6df-7fda8afbf5da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:51.663876 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d402d972-1260-4d2e-b67d-a0d49d46972d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:51.664660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d402d972-1260-4d2e-b67d-a0d49d46972d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:51.665984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d402d972-1260-4d2e-b67d-a0d49d46972d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:51.666872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d402d972-1260-4d2e-b67d-a0d49d46972d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:51.670690 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d402d972-1260-4d2e-b67d-a0d49d46972d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:51.671353 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d402d972-1260-4d2e-b67d-a0d49d46972d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:51.714329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d8c0bbf5-107c-47bc-8b97-d9b0b4fb3d59 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:51.734698 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d8c0bbf5-107c-47bc-8b97-d9b0b4fb3d59 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/40fd6f92-87b8-452f-827f-1bf2b2be98a9" status: 200 len: 1521 microversion: 2.1 time: 1.637883 Oct 05 02:38:51.737348 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1377/2725] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:50 2022] GET /compute/v2.1/servers/40fd6f92-87b8-452f-827f-1bf2b2be98a9 => generated 1521 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:51.764104 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3eb5d451-ad09-4af7-a3a6-1d4dd26892df tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fccdf55e790>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:51.832219 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d402d972-1260-4d2e-b67d-a0d49d46972d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:51.844055 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d402d972-1260-4d2e-b67d-a0d49d46972d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da" status: 200 len: 1277 microversion: 2.1 time: 0.194094 Oct 05 02:38:51.845383 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1349/2726] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:51 2022] GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da => generated 1277 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:51.871919 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3eb5d451-ad09-4af7-a3a6-1d4dd26892df tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700" status: 200 len: 1433 microversion: 2.1 time: 0.129020 Oct 05 02:38:51.878333 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1378/2727] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:51 2022] GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700 => generated 1433 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:51.885274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-b5a2cf8b-75c0-42ae-bd20-e170a85a851e req-62edfa6b-4026-41f0-87c6-b748170cf7b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40fd6f92-87b8-452f-827f-1bf2b2be98a9", "name": "network-vif-deleted", "tag": "f61119f0-472d-44b2-b03a-8638b346f14e"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:38:51.894782 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8fb40e42-eb75-4af9-9aa1-2149e6a0aaf3 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fccdf5684c0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:51.910979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b5a2cf8b-75c0-42ae-bd20-e170a85a851e req-62edfa6b-4026-41f0-87c6-b748170cf7b5 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:51.911493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b5a2cf8b-75c0-42ae-bd20-e170a85a851e req-62edfa6b-4026-41f0-87c6-b748170cf7b5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:51.911933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b5a2cf8b-75c0-42ae-bd20-e170a85a851e req-62edfa6b-4026-41f0-87c6-b748170cf7b5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:51.949517 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-b5a2cf8b-75c0-42ae-bd20-e170a85a851e req-62edfa6b-4026-41f0-87c6-b748170cf7b5 service nova] Creating event network-vif-deleted:f61119f0-472d-44b2-b03a-8638b346f14e for instance 40fd6f92-87b8-452f-827f-1bf2b2be98a9 on n-h2-858272-3 Oct 05 02:38:51.955797 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-b5a2cf8b-75c0-42ae-bd20-e170a85a851e req-62edfa6b-4026-41f0-87c6-b748170cf7b5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109033 Oct 05 02:38:51.956441 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1350/2728] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:38:52.035491 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8fb40e42-eb75-4af9-9aa1-2149e6a0aaf3 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700" status: 200 len: 1433 microversion: 2.1 time: 0.146752 Oct 05 02:38:52.036485 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1379/2729] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:51 2022] GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700 => generated 1433 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:52.051364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-792931c5-bc94-415c-a362-6422791d2799 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:52.052420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-792931c5-bc94-415c-a362-6422791d2799 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] [instance: 74b1ab94-3bc0-440d-bf57-dcab444e063d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:52.066800 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-792931c5-bc94-415c-a362-6422791d2799 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:52.067632 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-792931c5-bc94-415c-a362-6422791d2799 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:52.068349 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-792931c5-bc94-415c-a362-6422791d2799 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:52.069981 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-792931c5-bc94-415c-a362-6422791d2799 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:52.070733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-792931c5-bc94-415c-a362-6422791d2799 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:52.071283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-792931c5-bc94-415c-a362-6422791d2799 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:52.333607 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-792931c5-bc94-415c-a362-6422791d2799 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d55412129f24e90b1caa99b3aea8c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be31ec89b1354d608d7de438f5cf519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:52.341030 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-792931c5-bc94-415c-a362-6422791d2799 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d" status: 200 len: 1465 microversion: 2.1 time: 0.293984 Oct 05 02:38:52.353487 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1351/2730] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:52 2022] GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d => generated 1465 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:52.364418 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2372c365-3311-4607-8aa6-28fb999af803 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fccdf75d310>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:52.426111 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2372c365-3311-4607-8aa6-28fb999af803 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/adad3215-1ca6-43bb-9981-0d01aff146ab" status: 200 len: 784 microversion: 2.1 time: 0.066240 Oct 05 02:38:52.426723 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1380/2731] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:52 2022] GET /compute/v2.1/images/adad3215-1ca6-43bb-9981-0d01aff146ab => generated 784 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:38:52.441752 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-406882eb-35f7-44c7-83f9-3e64d9e0d2f3 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:52.453086 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-406882eb-35f7-44c7-83f9-3e64d9e0d2f3 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015176 Oct 05 02:38:52.454042 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1352/2732] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 5 02:38:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:38:52.468979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3bc4743d-7ccf-4481-b62e-aee10adde241 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fcce81cb9d0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:52.543456 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6526ee4d-2bcc-4234-b69d-4749d553c8ce tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:38:52.546923 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6526ee4d-2bcc-4234-b69d-4749d553c8ce tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:52.568332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6526ee4d-2bcc-4234-b69d-4749d553c8ce tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:52.571037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6526ee4d-2bcc-4234-b69d-4749d553c8ce tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:52.571667 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6526ee4d-2bcc-4234-b69d-4749d553c8ce tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:52.572421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6526ee4d-2bcc-4234-b69d-4749d553c8ce tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:52.574069 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6526ee4d-2bcc-4234-b69d-4749d553c8ce tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:52.574396 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6526ee4d-2bcc-4234-b69d-4749d553c8ce tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:52.640157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-6526ee4d-2bcc-4234-b69d-4749d553c8ce tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lazy-loading 'flavor' on Instance uuid 1c15b977-1608-45e8-8bbd-b2bd5c1eff21 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:38:52.711724 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:53.045795 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6526ee4d-2bcc-4234-b69d-4749d553c8ce tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "POST /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21/action" status: 202 len: 0 microversion: 2.20 time: 0.508376 Oct 05 02:38:53.049760 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1353/2733] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 5 02:38:52 2022] POST /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21/action => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:38:53.072092 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cf3bebd8-ae4b-42f3-8171-aef1f45a808b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:53.072879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cf3bebd8-ae4b-42f3-8171-aef1f45a808b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:53.081223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf3bebd8-ae4b-42f3-8171-aef1f45a808b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:53.081887 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf3bebd8-ae4b-42f3-8171-aef1f45a808b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:53.082507 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf3bebd8-ae4b-42f3-8171-aef1f45a808b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:53.083228 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf3bebd8-ae4b-42f3-8171-aef1f45a808b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:53.083684 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf3bebd8-ae4b-42f3-8171-aef1f45a808b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:53.084109 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf3bebd8-ae4b-42f3-8171-aef1f45a808b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:53.358631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:53.608831 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3bc4743d-7ccf-4481-b62e-aee10adde241 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "DELETE /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700" status: 204 len: 0 microversion: 2.1 time: 1.144815 Oct 05 02:38:53.609694 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1381/2734] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:52 2022] DELETE /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700 => generated 0 bytes in 1146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:38:53.619694 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b0b4591e-11b9-4ecb-9e55-4ea93d9e6054 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:53.620625 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b0b4591e-11b9-4ecb-9e55-4ea93d9e6054 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: 40fd6f92-87b8-452f-827f-1bf2b2be98a9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:53.627546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0b4591e-11b9-4ecb-9e55-4ea93d9e6054 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:53.628455 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0b4591e-11b9-4ecb-9e55-4ea93d9e6054 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:53.629091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0b4591e-11b9-4ecb-9e55-4ea93d9e6054 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:53.630156 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0b4591e-11b9-4ecb-9e55-4ea93d9e6054 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:53.632241 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0b4591e-11b9-4ecb-9e55-4ea93d9e6054 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:53.632892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0b4591e-11b9-4ecb-9e55-4ea93d9e6054 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:53.648882 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-b0b4591e-11b9-4ecb-9e55-4ea93d9e6054 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] HTTP exception thrown: Instance 40fd6f92-87b8-452f-827f-1bf2b2be98a9 could not be found. Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b0b4591e-11b9-4ecb-9e55-4ea93d9e6054 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Request method failure captured: Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/40fd6f92-87b8-452f-827f-1bf2b2be98a9 HTTP/1.1 Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO4LzXWS5PqPGm0R-1pVXbPaQVByd8JFbw07mZ7MFTxL_vfJGRpu7xDxEwAm2moC30ltuIazbGchiwafSf0vZFgxhr-NQ0k4LU7PHHXWWHQcTCteNj_YI3BCzgBL3aOlnRnm35_GIFYvGUGp9I172dC3D6n8SMuwkgQwYIMSE02e59g Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 25663d1b71554c84998a009e9e41e7f0 Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ListServersNegativeTestJSON-1219065022 Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/25663d1b71554c84998a009e9e41e7f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/25663d1b71554c84998a009e9e41e7f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/25663d1b71554c84998a009e9e41e7f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_25663d1b71554c84998a009e9e41e7f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ListServersNegativeTestJSON-1219065022 Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 25663d1b71554c84998a009e9e41e7f0 Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1219065022 Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ListServersNegativeTestJSON-1219065022-project Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 2b8d63e7d05849e28cc54624771c60e1 Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ListServersNegativeTestJSON-1219065022-project Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 40fd6f92-87b8-452f-827f-1bf2b2be98a9 could not be found. Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '40fd6f92-87b8-452f-827f-1bf2b2be98a9'} Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40fd6f92-87b8-452f-827f-1bf2b2be98a9 could not be found. Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40fd6f92-87b8-452f-827f-1bf2b2be98a9 could not be found. Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:53.650705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:38:53.654753 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:53.654753 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:53.654753 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:38:53.654753 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:38:53.654753 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:38:53.654753 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:38:53.654753 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40fd6f92-87b8-452f-827f-1bf2b2be98a9 could not be found. Oct 05 02:38:53.654753 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:53.658119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b0b4591e-11b9-4ecb-9e55-4ea93d9e6054 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Returning 404 to user: Instance 40fd6f92-87b8-452f-827f-1bf2b2be98a9 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:38:53.659719 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b0b4591e-11b9-4ecb-9e55-4ea93d9e6054 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/40fd6f92-87b8-452f-827f-1bf2b2be98a9" status: 404 len: 111 microversion: 2.1 time: 0.045690 Oct 05 02:38:53.660820 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1382/2735] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:53 2022] GET /compute/v2.1/servers/40fd6f92-87b8-452f-827f-1bf2b2be98a9 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:38:53.670598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dff8ce99-6d48-4fbe-9e4f-730bc6c95c5c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:53.671414 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dff8ce99-6d48-4fbe-9e4f-730bc6c95c5c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 37204911-40f0-4356-a6df-7fda8afbf5da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:53.679782 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dff8ce99-6d48-4fbe-9e4f-730bc6c95c5c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:53.680800 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dff8ce99-6d48-4fbe-9e4f-730bc6c95c5c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:53.682760 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dff8ce99-6d48-4fbe-9e4f-730bc6c95c5c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:53.683911 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dff8ce99-6d48-4fbe-9e4f-730bc6c95c5c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:53.684556 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dff8ce99-6d48-4fbe-9e4f-730bc6c95c5c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:53.685256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dff8ce99-6d48-4fbe-9e4f-730bc6c95c5c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:53.693396 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cf3bebd8-ae4b-42f3-8171-aef1f45a808b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:53.701631 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cf3bebd8-ae4b-42f3-8171-aef1f45a808b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1476 microversion: 2.1 time: 0.650559 Oct 05 02:38:53.710686 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1354/2736] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:53 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1476 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:53.714936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=34 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:53.717936 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-16b01cdb-3184-4917-b31f-c4f51eb8012f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:53.718769 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-16b01cdb-3184-4917-b31f-c4f51eb8012f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:53.736721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-16b01cdb-3184-4917-b31f-c4f51eb8012f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:53.737488 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-16b01cdb-3184-4917-b31f-c4f51eb8012f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:53.738099 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-16b01cdb-3184-4917-b31f-c4f51eb8012f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:53.738960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-16b01cdb-3184-4917-b31f-c4f51eb8012f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:53.739574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-16b01cdb-3184-4917-b31f-c4f51eb8012f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:53.740159 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-16b01cdb-3184-4917-b31f-c4f51eb8012f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:54.108384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dff8ce99-6d48-4fbe-9e4f-730bc6c95c5c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:54.127323 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dff8ce99-6d48-4fbe-9e4f-730bc6c95c5c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da" status: 200 len: 1319 microversion: 2.1 time: 0.465072 Oct 05 02:38:54.140928 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1383/2737] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:53 2022] GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da => generated 1319 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:54.140928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0db710fc-2fee-40d8-a34e-1c6706c7d139 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fccdfd24e50>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:54.167935 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-0db710fc-2fee-40d8-a34e-1c6706c7d139 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] HTTP exception thrown: Image not found. Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0db710fc-2fee-40d8-a34e-1c6706c7d139 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Request method failure captured: Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700 HTTP/1.1 Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO4AOxJFWFelW5NIzv1D-2Oz8BlVYw3CEbOJqfQC-WEd3nfoNXQZy_9hWcXNogpU0zWAQr1pT64EgC-FdlsP5SuxtekgsZqh1L5JaZKowSuAPMix2YWcSuuzP5LwhGMSp6UpRWXCu00Ize6TsJ6KktyTp8zfDKWqY91b17Mp2NHIblg Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: be31ec89b1354d608d7de438f5cf519d Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ImagesOneServerTestJSON-1624949803 Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/be31ec89b1354d608d7de438f5cf519d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/be31ec89b1354d608d7de438f5cf519d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/be31ec89b1354d608d7de438f5cf519d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_be31ec89b1354d608d7de438f5cf519d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ImagesOneServerTestJSON-1624949803 Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: be31ec89b1354d608d7de438f5cf519d Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1624949803 Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ImagesOneServerTestJSON-1624949803-project Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 2d55412129f24e90b1caa99b3aea8c61 Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ImagesOneServerTestJSON-1624949803-project Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: exception: Image not found. Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'abd9bd09-3095-4849-9e71-e3bf8e10f700'} Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID abd9bd09-3095-4849-9e71-e3bf8e10f700 Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 05 02:38:54.170783 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image abd9bd09-3095-4849-9e71-e3bf8e10f700 could not be found. Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 02:38:54.175585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:54.179440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0db710fc-2fee-40d8-a34e-1c6706c7d139 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Returning 404 to user: Image not found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:38:54.188653 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0db710fc-2fee-40d8-a34e-1c6706c7d139 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700" status: 404 len: 62 microversion: 2.1 time: 0.058182 Oct 05 02:38:54.189839 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1384/2738] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:54 2022] GET /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:38:54.202697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2e7b63be-ac0a-4c96-b0e9-f3218b59ad93 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:54.211513 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2e7b63be-ac0a-4c96-b0e9-f3218b59ad93 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:54.214462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2e7b63be-ac0a-4c96-b0e9-f3218b59ad93 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '25663d1b71554c84998a009e9e41e7f0'} {{(pid=122320) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:38:54.215181 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-16b01cdb-3184-4917-b31f-c4f51eb8012f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:54.224538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2e7b63be-ac0a-4c96-b0e9-f3218b59ad93 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:54.225872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2e7b63be-ac0a-4c96-b0e9-f3218b59ad93 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:54.226522 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2e7b63be-ac0a-4c96-b0e9-f3218b59ad93 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:54.227623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2e7b63be-ac0a-4c96-b0e9-f3218b59ad93 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:54.228331 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-16b01cdb-3184-4917-b31f-c4f51eb8012f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:54.229060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2e7b63be-ac0a-4c96-b0e9-f3218b59ad93 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:54.229756 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2e7b63be-ac0a-4c96-b0e9-f3218b59ad93 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:54.234942 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-16b01cdb-3184-4917-b31f-c4f51eb8012f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:54.236165 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-16b01cdb-3184-4917-b31f-c4f51eb8012f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1723 microversion: 2.20 time: 0.524083 Oct 05 02:38:54.236737 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1355/2739] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:38:53 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1723 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:38:54.241482 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-eb72d92a-fd04-43ee-a60b-72aca0d06160 req-471ac7ac-77bb-488b-a005-82a495b0fb89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac919870-2512-4424-bea6-b003534ce678", "name": "network-vif-unplugged", "status": "completed", "tag": "210caa7d-298b-408f-a376-b6a2a6f6ce62"}, {"name": "network-changed", "server_uuid": "ac919870-2512-4424-bea6-b003534ce678", "tag": "210caa7d-298b-408f-a376-b6a2a6f6ce62"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:38:54.271991 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-eb72d92a-fd04-43ee-a60b-72aca0d06160 req-471ac7ac-77bb-488b-a005-82a495b0fb89 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:54.273246 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-eb72d92a-fd04-43ee-a60b-72aca0d06160 req-471ac7ac-77bb-488b-a005-82a495b0fb89 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:54.285627 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-eb72d92a-fd04-43ee-a60b-72aca0d06160 req-471ac7ac-77bb-488b-a005-82a495b0fb89 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:54.300841 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-eb72d92a-fd04-43ee-a60b-72aca0d06160 req-471ac7ac-77bb-488b-a005-82a495b0fb89 service nova] Creating event network-vif-unplugged:210caa7d-298b-408f-a376-b6a2a6f6ce62 for instance ac919870-2512-4424-bea6-b003534ce678 on n-h1-858272-3 Oct 05 02:38:54.305958 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-eb72d92a-fd04-43ee-a60b-72aca0d06160 req-471ac7ac-77bb-488b-a005-82a495b0fb89 service nova] Creating event network-changed:210caa7d-298b-408f-a376-b6a2a6f6ce62 for instance ac919870-2512-4424-bea6-b003534ce678 on n-h1-858272-3 Oct 05 02:38:54.328802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [req-eb72d92a-fd04-43ee-a60b-72aca0d06160 req-471ac7ac-77bb-488b-a005-82a495b0fb89 service nova] Instance ac919870-2512-4424-bea6-b003534ce678 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122319) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 02:38:54.353815 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-eb72d92a-fd04-43ee-a60b-72aca0d06160 req-471ac7ac-77bb-488b-a005-82a495b0fb89 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.115581 Oct 05 02:38:54.355046 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1356/2740] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:38:54.361606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fe7e4ac6-ae42-4cc3-8e63-241f8e7ca403 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-621317124"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:38:54.369596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fe7e4ac6-ae42-4cc3-8e63-241f8e7ca403 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] [instance: 74b1ab94-3bc0-440d-bf57-dcab444e063d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:54.389808 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fe7e4ac6-ae42-4cc3-8e63-241f8e7ca403 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:54.390621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fe7e4ac6-ae42-4cc3-8e63-241f8e7ca403 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:54.391254 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fe7e4ac6-ae42-4cc3-8e63-241f8e7ca403 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:54.392156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fe7e4ac6-ae42-4cc3-8e63-241f8e7ca403 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:54.392804 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fe7e4ac6-ae42-4cc3-8e63-241f8e7ca403 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:54.393466 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fe7e4ac6-ae42-4cc3-8e63-241f8e7ca403 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:54.395379 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2e7b63be-ac0a-4c96-b0e9-f3218b59ad93 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.203716 Oct 05 02:38:54.396597 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1385/2741] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:38:54 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:38:54.430402 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-809e07d3-3915-45a2-b08f-ae625552602f tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-809e07d3-3915-45a2-b08f-ae625552602f tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Request method failure captured: Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO4LzXWS5PqPGm0R-1pVXbPaQVByd8JFbw07mZ7MFTxL_vfJGRpu7xDxEwAm2moC30ltuIazbGchiwafSf0vZFgxhr-NQ0k4LU7PHHXWWHQcTCteNj_YI3BCzgBL3aOlnRnm35_GIFYvGUGp9I172dC3D6n8SMuwkgQwYIMSE02e59g Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 25663d1b71554c84998a009e9e41e7f0 Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ListServersNegativeTestJSON-1219065022 Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/25663d1b71554c84998a009e9e41e7f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/25663d1b71554c84998a009e9e41e7f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/25663d1b71554c84998a009e9e41e7f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_25663d1b71554c84998a009e9e41e7f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ListServersNegativeTestJSON-1219065022 Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 25663d1b71554c84998a009e9e41e7f0 Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1219065022 Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ListServersNegativeTestJSON-1219065022-project Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 2b8d63e7d05849e28cc54624771c60e1 Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ListServersNegativeTestJSON-1219065022-project Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: action_args: {} Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 05 02:38:54.443019 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:38:54.449557 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:38:54.449557 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:38:54.449557 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:38:54.449557 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 05 02:38:54.449557 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:54.449557 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:38:54.449557 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:54.449557 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:54.449557 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:38:54.449557 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:38:54.449557 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:38:54.449557 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:38:54.449557 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 05 02:38:54.449557 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:54.449557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-809e07d3-3915-45a2-b08f-ae625552602f tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:38:54.449557 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-809e07d3-3915-45a2-b08f-ae625552602f tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.042251 Oct 05 02:38:54.458416 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1386/2742] 10.222.0.16 () {58 vars in 1182 bytes} [Wed Oct 5 02:38:54 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:38:54.471872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c5427606-0dba-4694-8f13-e7f8e04f49dc tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:54.492220 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c5427606-0dba-4694-8f13-e7f8e04f49dc tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:54.493272 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c5427606-0dba-4694-8f13-e7f8e04f49dc tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Searching by: {'deleted': False, 'project_id': '25663d1b71554c84998a009e9e41e7f0'} {{(pid=122320) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:38:54.501780 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5427606-0dba-4694-8f13-e7f8e04f49dc tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:54.503828 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5427606-0dba-4694-8f13-e7f8e04f49dc tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:54.505054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5427606-0dba-4694-8f13-e7f8e04f49dc tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:54.506456 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5427606-0dba-4694-8f13-e7f8e04f49dc tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:54.507625 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5427606-0dba-4694-8f13-e7f8e04f49dc tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:54.508484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5427606-0dba-4694-8f13-e7f8e04f49dc tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:54.562122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.multi_cell_list [None req-c5427606-0dba-4694-8f13-e7f8e04f49dc tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:38:54.620398 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c5427606-0dba-4694-8f13-e7f8e04f49dc tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.158255 Oct 05 02:38:54.621387 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1387/2743] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 5 02:38:54 2022] GET /compute/v2.1/servers => generated 681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:38:54.626791 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-68320c45-0790-4ffd-a1bf-061e57f48442 req-3a2918e3-a9d8-44ff-b432-f319b7c34b7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74b1ab94-3bc0-440d-bf57-dcab444e063d", "name": "network-vif-unplugged", "status": "completed", "tag": "f76faa20-bd22-4858-915c-478dc55b243d"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:38:54.636536 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-68320c45-0790-4ffd-a1bf-061e57f48442 req-3a2918e3-a9d8-44ff-b432-f319b7c34b7a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:54.637402 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-68320c45-0790-4ffd-a1bf-061e57f48442 req-3a2918e3-a9d8-44ff-b432-f319b7c34b7a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:54.638013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-68320c45-0790-4ffd-a1bf-061e57f48442 req-3a2918e3-a9d8-44ff-b432-f319b7c34b7a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:54.668336 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-68320c45-0790-4ffd-a1bf-061e57f48442 req-3a2918e3-a9d8-44ff-b432-f319b7c34b7a service nova] Creating event network-vif-unplugged:f76faa20-bd22-4858-915c-478dc55b243d for instance 74b1ab94-3bc0-440d-bf57-dcab444e063d on n-h1-858272-3 Oct 05 02:38:54.674812 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-68320c45-0790-4ffd-a1bf-061e57f48442 req-3a2918e3-a9d8-44ff-b432-f319b7c34b7a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051691 Oct 05 02:38:54.676211 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1388/2744] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:38:54.682295 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1b0be266-b8c4-473c-a826-3827175d45b4 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:54.689532 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1b0be266-b8c4-473c-a826-3827175d45b4 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:54.690587 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.compute.servers [None req-1b0be266-b8c4-473c-a826-3827175d45b4 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Removing options 'limit' from query {{(pid=122320) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 05 02:38:54.691567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1b0be266-b8c4-473c-a826-3827175d45b4 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Searching by: {'deleted': False, 'project_id': '25663d1b71554c84998a009e9e41e7f0'} {{(pid=122320) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:38:54.698545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b0be266-b8c4-473c-a826-3827175d45b4 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:54.699275 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b0be266-b8c4-473c-a826-3827175d45b4 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:54.699966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b0be266-b8c4-473c-a826-3827175d45b4 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:54.700935 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b0be266-b8c4-473c-a826-3827175d45b4 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:54.701555 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b0be266-b8c4-473c-a826-3827175d45b4 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:54.702213 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b0be266-b8c4-473c-a826-3827175d45b4 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:54.743427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.multi_cell_list [None req-1b0be266-b8c4-473c-a826-3827175d45b4 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=122320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:38:54.814171 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fe7e4ac6-ae42-4cc3-8e63-241f8e7ca403 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "POST /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d/action" status: 202 len: 0 microversion: 2.1 time: 0.457529 Oct 05 02:38:54.815779 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1b0be266-b8c4-473c-a826-3827175d45b4 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.137835 Oct 05 02:38:54.822644 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1357/2745] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:38:54 2022] POST /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 05 02:38:54.828288 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6463d5c4-7812-4d9c-ac3d-aa5968c51670 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:54.836059 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6463d5c4-7812-4d9c-ac3d-aa5968c51670 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:54.851587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6463d5c4-7812-4d9c-ac3d-aa5968c51670 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:54.853659 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6463d5c4-7812-4d9c-ac3d-aa5968c51670 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:54.853846 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1389/2746] 10.222.0.16 () {58 vars in 1144 bytes} [Wed Oct 5 02:38:54 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:38:54.854327 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6463d5c4-7812-4d9c-ac3d-aa5968c51670 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:54.857426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6463d5c4-7812-4d9c-ac3d-aa5968c51670 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:54.858022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6463d5c4-7812-4d9c-ac3d-aa5968c51670 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:54.858606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6463d5c4-7812-4d9c-ac3d-aa5968c51670 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:54.878134 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b840f5ee-cb4b-4ee4-8b97-4c0b6f2593f1 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fccdf5685e0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:54.931985 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:54.979868 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b840f5ee-cb4b-4ee4-8b97-4c0b6f2593f1 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/6cf12e10-7a03-442e-b35f-02965febd7bd" status: 200 len: 1428 microversion: 2.1 time: 0.123348 Oct 05 02:38:54.980530 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1390/2747] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:54 2022] GET /compute/v2.1/images/6cf12e10-7a03-442e-b35f-02965febd7bd => generated 1428 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:54.996052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ad806f26-1713-44cc-98d8-f7440bd3162f tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ad806f26-1713-44cc-98d8-f7440bd3162f tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Request method failure captured: Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO4LzXWS5PqPGm0R-1pVXbPaQVByd8JFbw07mZ7MFTxL_vfJGRpu7xDxEwAm2moC30ltuIazbGchiwafSf0vZFgxhr-NQ0k4LU7PHHXWWHQcTCteNj_YI3BCzgBL3aOlnRnm35_GIFYvGUGp9I172dC3D6n8SMuwkgQwYIMSE02e59g Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 25663d1b71554c84998a009e9e41e7f0 Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ListServersNegativeTestJSON-1219065022 Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/25663d1b71554c84998a009e9e41e7f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/25663d1b71554c84998a009e9e41e7f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/25663d1b71554c84998a009e9e41e7f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_25663d1b71554c84998a009e9e41e7f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ListServersNegativeTestJSON-1219065022 Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 25663d1b71554c84998a009e9e41e7f0 Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1219065022 Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ListServersNegativeTestJSON-1219065022-project Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 2b8d63e7d05849e28cc54624771c60e1 Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ListServersNegativeTestJSON-1219065022-project Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: action_args: {} Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi '-1' Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 05 02:38:55.005179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 05 02:38:55.014521 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:38:55.014521 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:38:55.014521 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:38:55.014521 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:38:55.014521 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 05 02:38:55.014521 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:55.014521 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:38:55.014521 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:55.014521 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:55.014521 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:38:55.014521 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:38:55.014521 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:38:55.014521 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:38:55.014521 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 05 02:38:55.014521 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:55.014521 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ad806f26-1713-44cc-98d8-f7440bd3162f tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:38:55.014521 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ad806f26-1713-44cc-98d8-f7440bd3162f tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.025267 Oct 05 02:38:55.017040 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1391/2748] 10.222.0.16 () {58 vars in 1142 bytes} [Wed Oct 5 02:38:54 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:38:55.022044 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-277142ce-64df-4138-9e25-cd6f1d4c37db tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-277142ce-64df-4138-9e25-cd6f1d4c37db tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Request method failure captured: Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO4LzXWS5PqPGm0R-1pVXbPaQVByd8JFbw07mZ7MFTxL_vfJGRpu7xDxEwAm2moC30ltuIazbGchiwafSf0vZFgxhr-NQ0k4LU7PHHXWWHQcTCteNj_YI3BCzgBL3aOlnRnm35_GIFYvGUGp9I172dC3D6n8SMuwkgQwYIMSE02e59g Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 25663d1b71554c84998a009e9e41e7f0 Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ListServersNegativeTestJSON-1219065022 Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/25663d1b71554c84998a009e9e41e7f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/25663d1b71554c84998a009e9e41e7f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/25663d1b71554c84998a009e9e41e7f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_25663d1b71554c84998a009e9e41e7f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ListServersNegativeTestJSON-1219065022 Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 25663d1b71554c84998a009e9e41e7f0 Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1219065022 Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ListServersNegativeTestJSON-1219065022-project Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 2b8d63e7d05849e28cc54624771c60e1 Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ListServersNegativeTestJSON-1219065022-project Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: action_args: {} Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 'testing' Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 05 02:38:55.044001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 05 02:38:55.053522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:38:55.053522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:38:55.053522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:38:55.053522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:38:55.053522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 05 02:38:55.053522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:55.053522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:38:55.053522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:55.053522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:55.053522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:38:55.053522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:38:55.053522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:38:55.053522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:38:55.053522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 05 02:38:55.053522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:55.053522 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-277142ce-64df-4138-9e25-cd6f1d4c37db tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:38:55.053522 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-277142ce-64df-4138-9e25-cd6f1d4c37db tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.027901 Oct 05 02:38:55.053522 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1392/2749] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 5 02:38:55 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:38:55.078678 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-54684dec-ac59-434e-8a8e-8d41deb762e4 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:55.100954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-54684dec-ac59-434e-8a8e-8d41deb762e4 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:55.103312 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-54684dec-ac59-434e-8a8e-8d41deb762e4 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '25663d1b71554c84998a009e9e41e7f0'} {{(pid=122320) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:38:55.126682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.compute.servers [None req-54684dec-ac59-434e-8a8e-8d41deb762e4 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Flavor 'non_existing_flavor' could not be found {{(pid=122320) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 05 02:38:55.137578 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-54684dec-ac59-434e-8a8e-8d41deb762e4 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.076239 Oct 05 02:38:55.138729 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1393/2750] 10.222.0.16 () {58 vars in 1178 bytes} [Wed Oct 5 02:38:55 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 05 02:38:55.157995 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7afe6c28-f9bd-4f0e-908b-cc85b3975791 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:55.189670 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7afe6c28-f9bd-4f0e-908b-cc85b3975791 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:55.191012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7afe6c28-f9bd-4f0e-908b-cc85b3975791 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '25663d1b71554c84998a009e9e41e7f0'} {{(pid=122320) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:38:55.203154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7afe6c28-f9bd-4f0e-908b-cc85b3975791 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:55.205423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7afe6c28-f9bd-4f0e-908b-cc85b3975791 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:55.210321 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7afe6c28-f9bd-4f0e-908b-cc85b3975791 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:55.211624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7afe6c28-f9bd-4f0e-908b-cc85b3975791 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:55.212249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7afe6c28-f9bd-4f0e-908b-cc85b3975791 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:55.212891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7afe6c28-f9bd-4f0e-908b-cc85b3975791 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:55.363122 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7afe6c28-f9bd-4f0e-908b-cc85b3975791 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.215886 Oct 05 02:38:55.364048 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1394/2751] 10.222.0.16 () {58 vars in 1174 bytes} [Wed Oct 5 02:38:55 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:38:55.374986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d5712123-dfbf-41e0-a55a-df1b6b69ffc2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:55.375930 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d5712123-dfbf-41e0-a55a-df1b6b69ffc2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 37204911-40f0-4356-a6df-7fda8afbf5da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:55.384189 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5712123-dfbf-41e0-a55a-df1b6b69ffc2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:55.384693 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5712123-dfbf-41e0-a55a-df1b6b69ffc2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:55.387978 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5712123-dfbf-41e0-a55a-df1b6b69ffc2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:55.389155 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5712123-dfbf-41e0-a55a-df1b6b69ffc2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:55.389631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5712123-dfbf-41e0-a55a-df1b6b69ffc2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:55.394777 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5712123-dfbf-41e0-a55a-df1b6b69ffc2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:56.064327 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6463d5c4-7812-4d9c-ac3d-aa5968c51670 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:56.092037 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6463d5c4-7812-4d9c-ac3d-aa5968c51670 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1476 microversion: 2.1 time: 1.267855 Oct 05 02:38:56.118062 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1358/2752] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:54 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1476 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:56.124852 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cb38d6cd-3345-45c3-b1a9-467762250b2c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:56.127288 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cb38d6cd-3345-45c3-b1a9-467762250b2c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:56.136066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb38d6cd-3345-45c3-b1a9-467762250b2c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:56.139636 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb38d6cd-3345-45c3-b1a9-467762250b2c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:56.142019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb38d6cd-3345-45c3-b1a9-467762250b2c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:56.144456 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb38d6cd-3345-45c3-b1a9-467762250b2c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:56.146355 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb38d6cd-3345-45c3-b1a9-467762250b2c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:56.148699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb38d6cd-3345-45c3-b1a9-467762250b2c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:56.292944 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d5712123-dfbf-41e0-a55a-df1b6b69ffc2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:56.305343 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d5712123-dfbf-41e0-a55a-df1b6b69ffc2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da" status: 200 len: 1319 microversion: 2.1 time: 0.940098 Oct 05 02:38:56.305935 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1395/2753] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:55 2022] GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da => generated 1319 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:56.310485 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0f7df6ac-d455-48e7-9161-1723c09f46e5 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:56.325078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0f7df6ac-d455-48e7-9161-1723c09f46e5 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:56.325737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0f7df6ac-d455-48e7-9161-1723c09f46e5 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '25663d1b71554c84998a009e9e41e7f0'} {{(pid=122320) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:38:56.345961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f7df6ac-d455-48e7-9161-1723c09f46e5 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:56.346454 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f7df6ac-d455-48e7-9161-1723c09f46e5 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:56.346949 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f7df6ac-d455-48e7-9161-1723c09f46e5 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:56.347605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f7df6ac-d455-48e7-9161-1723c09f46e5 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:56.348060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f7df6ac-d455-48e7-9161-1723c09f46e5 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:56.348485 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f7df6ac-d455-48e7-9161-1723c09f46e5 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:56.494330 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0f7df6ac-d455-48e7-9161-1723c09f46e5 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.187090 Oct 05 02:38:56.495010 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1396/2754] 10.222.0.16 () {58 vars in 1184 bytes} [Wed Oct 5 02:38:56 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:38:56.508563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-7c52e95c-a326-4fdf-89d2-edcb9c8e406e req-992b1d58-4342-413e-aed4-f374625a1bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37204911-40f0-4356-a6df-7fda8afbf5da", "tag": "293498fd-3dff-4d23-b7bc-8889e0d78f65"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:38:56.523201 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-7c52e95c-a326-4fdf-89d2-edcb9c8e406e req-992b1d58-4342-413e-aed4-f374625a1bd5 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:56.523691 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-7c52e95c-a326-4fdf-89d2-edcb9c8e406e req-992b1d58-4342-413e-aed4-f374625a1bd5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:56.524128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-7c52e95c-a326-4fdf-89d2-edcb9c8e406e req-992b1d58-4342-413e-aed4-f374625a1bd5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:56.537053 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-7c52e95c-a326-4fdf-89d2-edcb9c8e406e req-992b1d58-4342-413e-aed4-f374625a1bd5 service nova] Creating event network-changed:293498fd-3dff-4d23-b7bc-8889e0d78f65 for instance 37204911-40f0-4356-a6df-7fda8afbf5da on n-h2-858272-3 Oct 05 02:38:56.552051 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-7c52e95c-a326-4fdf-89d2-edcb9c8e406e req-992b1d58-4342-413e-aed4-f374625a1bd5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055638 Oct 05 02:38:56.553012 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1397/2755] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:38:56.558778 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-669364f6-1b39-4983-a8a9-c217754a80fe tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fccdfd16820>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:56.631925 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-669364f6-1b39-4983-a8a9-c217754a80fe tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/6cf12e10-7a03-442e-b35f-02965febd7bd" status: 200 len: 1428 microversion: 2.1 time: 0.076060 Oct 05 02:38:56.640294 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1398/2756] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:56 2022] GET /compute/v2.1/images/6cf12e10-7a03-442e-b35f-02965febd7bd => generated 1428 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:56.640294 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c11d2516-30bf-4669-bb50-6189214d2382 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:56.646459 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c11d2516-30bf-4669-bb50-6189214d2382 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:56.657945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c11d2516-30bf-4669-bb50-6189214d2382 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Searching by: {'deleted': False, 'project_id': '25663d1b71554c84998a009e9e41e7f0'} {{(pid=122320) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:38:56.673676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c11d2516-30bf-4669-bb50-6189214d2382 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:56.674174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c11d2516-30bf-4669-bb50-6189214d2382 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:56.674618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c11d2516-30bf-4669-bb50-6189214d2382 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:56.675373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c11d2516-30bf-4669-bb50-6189214d2382 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:56.675957 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c11d2516-30bf-4669-bb50-6189214d2382 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:56.676388 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c11d2516-30bf-4669-bb50-6189214d2382 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:56.720870 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.multi_cell_list [None req-c11d2516-30bf-4669-bb50-6189214d2382 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:38:56.733436 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cb38d6cd-3345-45c3-b1a9-467762250b2c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:56.752746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cb38d6cd-3345-45c3-b1a9-467762250b2c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:56.754463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cb38d6cd-3345-45c3-b1a9-467762250b2c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:56.755839 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cb38d6cd-3345-45c3-b1a9-467762250b2c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1723 microversion: 2.20 time: 0.635804 Oct 05 02:38:56.757506 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1359/2757] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:38:56 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1723 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:38:56.777406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-cd712a0d-7ede-4d69-a370-d2f6ad1dc1bf req-a4de3f2a-90e3-488f-b689-6a12a3105309 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de6a6594-881f-489b-8b94-28b74e935c1e", "tag": "a96fd765-4343-4dce-aab3-f848781564f5"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:38:56.798820 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c11d2516-30bf-4669-bb50-6189214d2382 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:56.809230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-cd712a0d-7ede-4d69-a370-d2f6ad1dc1bf req-a4de3f2a-90e3-488f-b689-6a12a3105309 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:56.809773 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-cd712a0d-7ede-4d69-a370-d2f6ad1dc1bf req-a4de3f2a-90e3-488f-b689-6a12a3105309 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:56.810200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-cd712a0d-7ede-4d69-a370-d2f6ad1dc1bf req-a4de3f2a-90e3-488f-b689-6a12a3105309 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:56.818892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c11d2516-30bf-4669-bb50-6189214d2382 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:56.822176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c11d2516-30bf-4669-bb50-6189214d2382 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:56.825646 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c11d2516-30bf-4669-bb50-6189214d2382 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:56.863697 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-cd712a0d-7ede-4d69-a370-d2f6ad1dc1bf req-a4de3f2a-90e3-488f-b689-6a12a3105309 service nova] Creating event network-changed:a96fd765-4343-4dce-aab3-f848781564f5 for instance de6a6594-881f-489b-8b94-28b74e935c1e on n-h1-858272-3 Oct 05 02:38:56.877367 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-cd712a0d-7ede-4d69-a370-d2f6ad1dc1bf req-a4de3f2a-90e3-488f-b689-6a12a3105309 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117664 Oct 05 02:38:56.878551 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1360/2758] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:38:57.128351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-09f8c457-805e-4a35-aaf9-aaf0b41de48a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:57.129748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-09f8c457-805e-4a35-aaf9-aaf0b41de48a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:57.133918 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c11d2516-30bf-4669-bb50-6189214d2382 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 0.497823 Oct 05 02:38:57.144942 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1399/2759] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:38:56 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:57.158929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-09f8c457-805e-4a35-aaf9-aaf0b41de48a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:57.160624 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-09f8c457-805e-4a35-aaf9-aaf0b41de48a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:57.161333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-09f8c457-805e-4a35-aaf9-aaf0b41de48a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:57.162204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-09f8c457-805e-4a35-aaf9-aaf0b41de48a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:57.163369 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-09f8c457-805e-4a35-aaf9-aaf0b41de48a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:57.163959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-09f8c457-805e-4a35-aaf9-aaf0b41de48a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:57.165886 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3f4ef2b8-9f4b-4eaa-82eb-55ad749c07f4 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:57.175208 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3f4ef2b8-9f4b-4eaa-82eb-55ad749c07f4 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:57.176242 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3f4ef2b8-9f4b-4eaa-82eb-55ad749c07f4 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.014624 Oct 05 02:38:57.176877 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1400/2760] 10.222.0.16 () {58 vars in 1178 bytes} [Wed Oct 5 02:38:57 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:38:57.189978 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9d016ee8-7078-4357-9b2d-0ec5f7633988 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:57.195712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9d016ee8-7078-4357-9b2d-0ec5f7633988 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:57.196393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9d016ee8-7078-4357-9b2d-0ec5f7633988 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Searching by: {'deleted': False, 'project_id': '25663d1b71554c84998a009e9e41e7f0'} {{(pid=122320) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:38:57.214895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d016ee8-7078-4357-9b2d-0ec5f7633988 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:57.215395 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d016ee8-7078-4357-9b2d-0ec5f7633988 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:57.215904 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d016ee8-7078-4357-9b2d-0ec5f7633988 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:57.216802 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d016ee8-7078-4357-9b2d-0ec5f7633988 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:57.217367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d016ee8-7078-4357-9b2d-0ec5f7633988 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:57.217852 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d016ee8-7078-4357-9b2d-0ec5f7633988 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:57.261782 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.multi_cell_list [None req-9d016ee8-7078-4357-9b2d-0ec5f7633988 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:38:57.312427 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9d016ee8-7078-4357-9b2d-0ec5f7633988 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.126845 Oct 05 02:38:57.317428 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1401/2761] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 5 02:38:57 2022] GET /compute/v2.1/servers => generated 681 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:38:57.336311 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a3e42eca-7ae4-40a4-b877-608e62c35eb3 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:57.342170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a3e42eca-7ae4-40a4-b877-608e62c35eb3 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: 40fd6f92-87b8-452f-827f-1bf2b2be98a9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:57.356021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3e42eca-7ae4-40a4-b877-608e62c35eb3 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:57.357989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3e42eca-7ae4-40a4-b877-608e62c35eb3 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:57.361023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3e42eca-7ae4-40a4-b877-608e62c35eb3 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:57.361933 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3e42eca-7ae4-40a4-b877-608e62c35eb3 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:57.363078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3e42eca-7ae4-40a4-b877-608e62c35eb3 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:57.364600 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3e42eca-7ae4-40a4-b877-608e62c35eb3 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:57.400081 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-a3e42eca-7ae4-40a4-b877-608e62c35eb3 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] HTTP exception thrown: Instance 40fd6f92-87b8-452f-827f-1bf2b2be98a9 could not be found. Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a3e42eca-7ae4-40a4-b877-608e62c35eb3 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Request method failure captured: Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/servers/40fd6f92-87b8-452f-827f-1bf2b2be98a9 HTTP/1.1 Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO4LzXWS5PqPGm0R-1pVXbPaQVByd8JFbw07mZ7MFTxL_vfJGRpu7xDxEwAm2moC30ltuIazbGchiwafSf0vZFgxhr-NQ0k4LU7PHHXWWHQcTCteNj_YI3BCzgBL3aOlnRnm35_GIFYvGUGp9I172dC3D6n8SMuwkgQwYIMSE02e59g Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 25663d1b71554c84998a009e9e41e7f0 Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ListServersNegativeTestJSON-1219065022 Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/25663d1b71554c84998a009e9e41e7f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/25663d1b71554c84998a009e9e41e7f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/25663d1b71554c84998a009e9e41e7f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_25663d1b71554c84998a009e9e41e7f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ListServersNegativeTestJSON-1219065022 Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 25663d1b71554c84998a009e9e41e7f0 Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1219065022 Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ListServersNegativeTestJSON-1219065022-project Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 2b8d63e7d05849e28cc54624771c60e1 Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ListServersNegativeTestJSON-1219065022-project Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 40fd6f92-87b8-452f-827f-1bf2b2be98a9 could not be found. Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '40fd6f92-87b8-452f-827f-1bf2b2be98a9'} Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40fd6f92-87b8-452f-827f-1bf2b2be98a9 could not be found. Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:38:57.411045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:38:57.415691 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40fd6f92-87b8-452f-827f-1bf2b2be98a9 could not be found. Oct 05 02:38:57.415691 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:57.415691 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:38:57.415691 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:57.415691 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:57.415691 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:38:57.415691 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:38:57.415691 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:38:57.415691 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:38:57.415691 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40fd6f92-87b8-452f-827f-1bf2b2be98a9 could not be found. Oct 05 02:38:57.415691 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:38:57.418307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a3e42eca-7ae4-40a4-b877-608e62c35eb3 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Returning 404 to user: Instance 40fd6f92-87b8-452f-827f-1bf2b2be98a9 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:38:57.418918 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-09f8c457-805e-4a35-aaf9-aaf0b41de48a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:57.419615 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a3e42eca-7ae4-40a4-b877-608e62c35eb3 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "DELETE /compute/v2.1/servers/40fd6f92-87b8-452f-827f-1bf2b2be98a9" status: 404 len: 111 microversion: 2.1 time: 0.091567 Oct 05 02:38:57.420659 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1402/2762] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:38:57 2022] DELETE /compute/v2.1/servers/40fd6f92-87b8-452f-827f-1bf2b2be98a9 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:38:57.427656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7e6ed6e0-52f3-4184-b169-d2c29aa8bebf tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:57.430080 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7e6ed6e0-52f3-4184-b169-d2c29aa8bebf tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 37204911-40f0-4356-a6df-7fda8afbf5da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:57.435200 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-09f8c457-805e-4a35-aaf9-aaf0b41de48a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1474 microversion: 2.1 time: 0.311018 Oct 05 02:38:57.436757 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1361/2763] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:57 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1474 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:57.446032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cb5b24d9-085e-405d-a01c-299792fd6ced tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:57.449324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:57.456135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e6ed6e0-52f3-4184-b169-d2c29aa8bebf tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:57.457477 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e6ed6e0-52f3-4184-b169-d2c29aa8bebf tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:57.465032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cb5b24d9-085e-405d-a01c-299792fd6ced tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: 47c8d34c-c7ca-4b8d-ba7e-72ce986a0985] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:57.470654 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e6ed6e0-52f3-4184-b169-d2c29aa8bebf tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:57.471840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e6ed6e0-52f3-4184-b169-d2c29aa8bebf tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:57.472331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e6ed6e0-52f3-4184-b169-d2c29aa8bebf tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:57.477219 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e6ed6e0-52f3-4184-b169-d2c29aa8bebf tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:57.480734 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb5b24d9-085e-405d-a01c-299792fd6ced tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:57.481357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb5b24d9-085e-405d-a01c-299792fd6ced tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:57.482618 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb5b24d9-085e-405d-a01c-299792fd6ced tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:57.484934 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb5b24d9-085e-405d-a01c-299792fd6ced tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:57.485756 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb5b24d9-085e-405d-a01c-299792fd6ced tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:57.487766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb5b24d9-085e-405d-a01c-299792fd6ced tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:57.512385 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:57.541972 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cb5b24d9-085e-405d-a01c-299792fd6ced tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: 47c8d34c-c7ca-4b8d-ba7e-72ce986a0985] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:38:57.686564 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cb5b24d9-085e-405d-a01c-299792fd6ced tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "DELETE /compute/v2.1/servers/47c8d34c-c7ca-4b8d-ba7e-72ce986a0985" status: 204 len: 0 microversion: 2.1 time: 0.245825 Oct 05 02:38:57.687407 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1362/2764] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:38:57 2022] DELETE /compute/v2.1/servers/47c8d34c-c7ca-4b8d-ba7e-72ce986a0985 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:38:57.697085 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4969c097-d2f7-4d9a-95f1-cfb560807b13 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fcce80c2430>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:57.798296 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4969c097-d2f7-4d9a-95f1-cfb560807b13 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/6cf12e10-7a03-442e-b35f-02965febd7bd" status: 200 len: 1428 microversion: 2.1 time: 0.109576 Oct 05 02:38:57.808670 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1363/2765] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:57 2022] GET /compute/v2.1/images/6cf12e10-7a03-442e-b35f-02965febd7bd => generated 1428 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:57.813903 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-91a0c8f3-b20b-4902-9f58-efea0f2d0e7d tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:57.814530 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-91a0c8f3-b20b-4902-9f58-efea0f2d0e7d tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: cdc1d61f-24f7-42ba-bd26-7a24227e5a01] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:57.829361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91a0c8f3-b20b-4902-9f58-efea0f2d0e7d tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:57.830118 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91a0c8f3-b20b-4902-9f58-efea0f2d0e7d tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:57.830755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91a0c8f3-b20b-4902-9f58-efea0f2d0e7d tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:57.831634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91a0c8f3-b20b-4902-9f58-efea0f2d0e7d tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:57.832320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91a0c8f3-b20b-4902-9f58-efea0f2d0e7d tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:57.843366 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91a0c8f3-b20b-4902-9f58-efea0f2d0e7d tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:57.888312 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-91a0c8f3-b20b-4902-9f58-efea0f2d0e7d tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: cdc1d61f-24f7-42ba-bd26-7a24227e5a01] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:38:57.892778 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7e6ed6e0-52f3-4184-b169-d2c29aa8bebf tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:57.905942 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7e6ed6e0-52f3-4184-b169-d2c29aa8bebf tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da" status: 200 len: 1319 microversion: 2.1 time: 0.483257 Oct 05 02:38:57.910783 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1403/2766] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:57 2022] GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da => generated 1319 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:57.924529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b0bdb9b2-a210-4f6f-9a1c-d9221b235df2 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:57.928048 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b0bdb9b2-a210-4f6f-9a1c-d9221b235df2 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:57.942431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0bdb9b2-a210-4f6f-9a1c-d9221b235df2 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:57.943391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0bdb9b2-a210-4f6f-9a1c-d9221b235df2 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:57.944656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0bdb9b2-a210-4f6f-9a1c-d9221b235df2 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:57.945569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0bdb9b2-a210-4f6f-9a1c-d9221b235df2 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:57.950756 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0bdb9b2-a210-4f6f-9a1c-d9221b235df2 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:57.951205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0bdb9b2-a210-4f6f-9a1c-d9221b235df2 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:58.052611 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-91a0c8f3-b20b-4902-9f58-efea0f2d0e7d tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01" status: 204 len: 0 microversion: 2.1 time: 0.242358 Oct 05 02:38:58.057103 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1364/2767] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:38:57 2022] DELETE /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:38:58.063677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a1b8c491-6998-4e51-9340-c9fb363fbd44 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:58.064401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a1b8c491-6998-4e51-9340-c9fb363fbd44 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: 40fd6f92-87b8-452f-827f-1bf2b2be98a9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:58.075834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a1b8c491-6998-4e51-9340-c9fb363fbd44 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:58.076579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a1b8c491-6998-4e51-9340-c9fb363fbd44 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:58.077402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a1b8c491-6998-4e51-9340-c9fb363fbd44 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:58.078313 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a1b8c491-6998-4e51-9340-c9fb363fbd44 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:58.078999 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a1b8c491-6998-4e51-9340-c9fb363fbd44 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:58.079651 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a1b8c491-6998-4e51-9340-c9fb363fbd44 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:58.099131 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-a1b8c491-6998-4e51-9340-c9fb363fbd44 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] HTTP exception thrown: Instance 40fd6f92-87b8-452f-827f-1bf2b2be98a9 could not be found. Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a1b8c491-6998-4e51-9340-c9fb363fbd44 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Request method failure captured: Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/40fd6f92-87b8-452f-827f-1bf2b2be98a9 HTTP/1.1 Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO4LzXWS5PqPGm0R-1pVXbPaQVByd8JFbw07mZ7MFTxL_vfJGRpu7xDxEwAm2moC30ltuIazbGchiwafSf0vZFgxhr-NQ0k4LU7PHHXWWHQcTCteNj_YI3BCzgBL3aOlnRnm35_GIFYvGUGp9I172dC3D6n8SMuwkgQwYIMSE02e59g Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 25663d1b71554c84998a009e9e41e7f0 Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ListServersNegativeTestJSON-1219065022 Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/25663d1b71554c84998a009e9e41e7f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/25663d1b71554c84998a009e9e41e7f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/25663d1b71554c84998a009e9e41e7f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_25663d1b71554c84998a009e9e41e7f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ListServersNegativeTestJSON-1219065022 Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 25663d1b71554c84998a009e9e41e7f0 Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1219065022 Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ListServersNegativeTestJSON-1219065022-project Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 2b8d63e7d05849e28cc54624771c60e1 Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ListServersNegativeTestJSON-1219065022-project Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 40fd6f92-87b8-452f-827f-1bf2b2be98a9 could not be found. Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '40fd6f92-87b8-452f-827f-1bf2b2be98a9'} Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40fd6f92-87b8-452f-827f-1bf2b2be98a9 could not be found. Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40fd6f92-87b8-452f-827f-1bf2b2be98a9 could not be found. Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:38:58.103010 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:38:58.108014 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:38:58.108014 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:38:58.108014 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:38:58.108014 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:38:58.108014 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:38:58.108014 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:38:58.108014 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40fd6f92-87b8-452f-827f-1bf2b2be98a9 could not be found. Oct 05 02:38:58.108014 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:38:58.111807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a1b8c491-6998-4e51-9340-c9fb363fbd44 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Returning 404 to user: Instance 40fd6f92-87b8-452f-827f-1bf2b2be98a9 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:38:58.113222 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a1b8c491-6998-4e51-9340-c9fb363fbd44 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/40fd6f92-87b8-452f-827f-1bf2b2be98a9" status: 404 len: 111 microversion: 2.1 time: 0.054499 Oct 05 02:38:58.114841 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1365/2768] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:58 2022] GET /compute/v2.1/servers/40fd6f92-87b8-452f-827f-1bf2b2be98a9 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:38:58.137970 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e5a43b60-c3fc-45b7-89c3-920017c2eeff tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:58.143758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e5a43b60-c3fc-45b7-89c3-920017c2eeff tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: 47c8d34c-c7ca-4b8d-ba7e-72ce986a0985] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:58.148273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:58.159642 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5a43b60-c3fc-45b7-89c3-920017c2eeff tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:58.161905 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5a43b60-c3fc-45b7-89c3-920017c2eeff tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:58.163760 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5a43b60-c3fc-45b7-89c3-920017c2eeff tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:58.164932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5a43b60-c3fc-45b7-89c3-920017c2eeff tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:58.167038 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5a43b60-c3fc-45b7-89c3-920017c2eeff tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:58.169178 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5a43b60-c3fc-45b7-89c3-920017c2eeff tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:58.348819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b0bdb9b2-a210-4f6f-9a1c-d9221b235df2 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:58.358606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b0bdb9b2-a210-4f6f-9a1c-d9221b235df2 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:58.363454 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b0bdb9b2-a210-4f6f-9a1c-d9221b235df2 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:58.367257 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b0bdb9b2-a210-4f6f-9a1c-d9221b235df2 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1723 microversion: 2.20 time: 0.453994 Oct 05 02:38:58.373288 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1404/2769] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:38:57 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1723 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:38:58.463987 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-95bf2289-7d73-4650-becf-8314ab0bd61f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:58.464686 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-95bf2289-7d73-4650-becf-8314ab0bd61f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:58.487133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-95bf2289-7d73-4650-becf-8314ab0bd61f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:58.487921 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-95bf2289-7d73-4650-becf-8314ab0bd61f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:58.488557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-95bf2289-7d73-4650-becf-8314ab0bd61f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:58.489507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-95bf2289-7d73-4650-becf-8314ab0bd61f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:58.490152 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-95bf2289-7d73-4650-becf-8314ab0bd61f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:58.490792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-95bf2289-7d73-4650-becf-8314ab0bd61f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:58.491473 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e5a43b60-c3fc-45b7-89c3-920017c2eeff tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:58.504603 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e5a43b60-c3fc-45b7-89c3-920017c2eeff tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/47c8d34c-c7ca-4b8d-ba7e-72ce986a0985" status: 200 len: 1521 microversion: 2.1 time: 0.383348 Oct 05 02:38:58.505826 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1366/2770] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:58 2022] GET /compute/v2.1/servers/47c8d34c-c7ca-4b8d-ba7e-72ce986a0985 => generated 1521 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:58.816526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1dfac00f-0517-4692-bc8f-bb33504280ac tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fccdfca8310>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:58.828886 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-95bf2289-7d73-4650-becf-8314ab0bd61f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:58.848214 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-95bf2289-7d73-4650-becf-8314ab0bd61f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1474 microversion: 2.1 time: 0.389138 Oct 05 02:38:58.856337 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1405/2771] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:58 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1474 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:38:58.894684 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1dfac00f-0517-4692-bc8f-bb33504280ac tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/6cf12e10-7a03-442e-b35f-02965febd7bd" status: 200 len: 1428 microversion: 2.1 time: 0.083287 Oct 05 02:38:58.895406 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1367/2772] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:58 2022] GET /compute/v2.1/images/6cf12e10-7a03-442e-b35f-02965febd7bd => generated 1428 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:38:58.935851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4606fc39-d467-466b-89cd-881c974e6a99 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:58.936473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4606fc39-d467-466b-89cd-881c974e6a99 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 37204911-40f0-4356-a6df-7fda8afbf5da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:58.949134 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4606fc39-d467-466b-89cd-881c974e6a99 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:58.949641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4606fc39-d467-466b-89cd-881c974e6a99 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:58.951174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4606fc39-d467-466b-89cd-881c974e6a99 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:58.951913 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4606fc39-d467-466b-89cd-881c974e6a99 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:58.952371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4606fc39-d467-466b-89cd-881c974e6a99 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:58.955105 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4606fc39-d467-466b-89cd-881c974e6a99 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:59.169203 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4606fc39-d467-466b-89cd-881c974e6a99 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:38:59.182364 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4606fc39-d467-466b-89cd-881c974e6a99 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da" status: 200 len: 1319 microversion: 2.1 time: 0.249617 Oct 05 02:38:59.198443 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1406/2773] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:58 2022] GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:38:59.398891 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d0b90f0a-7efc-40b8-a466-04e6e08e5bae tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:59.400691 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d0b90f0a-7efc-40b8-a466-04e6e08e5bae tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:59.422900 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d0b90f0a-7efc-40b8-a466-04e6e08e5bae tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:59.426765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d0b90f0a-7efc-40b8-a466-04e6e08e5bae tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:59.427518 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d0b90f0a-7efc-40b8-a466-04e6e08e5bae tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:59.428821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d0b90f0a-7efc-40b8-a466-04e6e08e5bae tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:59.430952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d0b90f0a-7efc-40b8-a466-04e6e08e5bae tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:59.433463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d0b90f0a-7efc-40b8-a466-04e6e08e5bae tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:59.528949 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d223aff3-d280-4e6d-bfaa-7bd17723af8c tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:38:59.530170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d223aff3-d280-4e6d-bfaa-7bd17723af8c tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: 47c8d34c-c7ca-4b8d-ba7e-72ce986a0985] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:38:59.533543 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:59.540309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d223aff3-d280-4e6d-bfaa-7bd17723af8c tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:59.546117 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d223aff3-d280-4e6d-bfaa-7bd17723af8c tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:59.546816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d223aff3-d280-4e6d-bfaa-7bd17723af8c tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:38:59.548010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d223aff3-d280-4e6d-bfaa-7bd17723af8c tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:38:59.551405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d223aff3-d280-4e6d-bfaa-7bd17723af8c tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:38:59.552042 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d223aff3-d280-4e6d-bfaa-7bd17723af8c tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:00.657956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d0b90f0a-7efc-40b8-a466-04e6e08e5bae tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:00.685641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d0b90f0a-7efc-40b8-a466-04e6e08e5bae tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:00.690637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d0b90f0a-7efc-40b8-a466-04e6e08e5bae tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:00.692160 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d0b90f0a-7efc-40b8-a466-04e6e08e5bae tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1723 microversion: 2.20 time: 1.298941 Oct 05 02:39:00.697404 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1368/2774] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:38:59 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1723 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:39:00.702909 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-835d9ee5-f388-4ee5-98eb-cab436d305ad tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:00.710318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-835d9ee5-f388-4ee5-98eb-cab436d305ad tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:00.727632 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-835d9ee5-f388-4ee5-98eb-cab436d305ad tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:00.729651 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-835d9ee5-f388-4ee5-98eb-cab436d305ad tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:00.730172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-835d9ee5-f388-4ee5-98eb-cab436d305ad tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:00.730974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-835d9ee5-f388-4ee5-98eb-cab436d305ad tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:00.731513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-835d9ee5-f388-4ee5-98eb-cab436d305ad tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:00.735050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-835d9ee5-f388-4ee5-98eb-cab436d305ad tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:00.784984 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d223aff3-d280-4e6d-bfaa-7bd17723af8c tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:00.798165 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d223aff3-d280-4e6d-bfaa-7bd17723af8c tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/47c8d34c-c7ca-4b8d-ba7e-72ce986a0985" status: 200 len: 1521 microversion: 2.1 time: 1.273812 Oct 05 02:39:00.799511 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1407/2775] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:38:59 2022] GET /compute/v2.1/servers/47c8d34c-c7ca-4b8d-ba7e-72ce986a0985 => generated 1521 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:39:00.813106 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8031a399-408d-4886-a9d8-a35431131376 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fccdf4291f0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:00.878642 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8031a399-408d-4886-a9d8-a35431131376 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/6cf12e10-7a03-442e-b35f-02965febd7bd" status: 200 len: 1428 microversion: 2.1 time: 0.070986 Oct 05 02:39:00.879228 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1408/2776] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:39:00 2022] GET /compute/v2.1/images/6cf12e10-7a03-442e-b35f-02965febd7bd => generated 1428 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:01.089152 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-405e823a-ca2e-461c-9d29-2fb7f12f226d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-249619873", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "2061a013-0028-4a69-ae54-0af5da48729e"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:39:01.104871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-835d9ee5-f388-4ee5-98eb-cab436d305ad tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:01.123012 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-835d9ee5-f388-4ee5-98eb-cab436d305ad tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1474 microversion: 2.1 time: 0.424021 Oct 05 02:39:01.124211 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1369/2777] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:00 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1474 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:01.129006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-01c66b15-0e0a-4e0a-9f70-5f4d4d8d15ed tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:01.136546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-01c66b15-0e0a-4e0a-9f70-5f4d4d8d15ed tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 37204911-40f0-4356-a6df-7fda8afbf5da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:01.156581 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01c66b15-0e0a-4e0a-9f70-5f4d4d8d15ed tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:01.157137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01c66b15-0e0a-4e0a-9f70-5f4d4d8d15ed tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:01.157585 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01c66b15-0e0a-4e0a-9f70-5f4d4d8d15ed tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:01.158313 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01c66b15-0e0a-4e0a-9f70-5f4d4d8d15ed tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:01.158774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01c66b15-0e0a-4e0a-9f70-5f4d4d8d15ed tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:01.159206 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01c66b15-0e0a-4e0a-9f70-5f4d4d8d15ed tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:01.218443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-405e823a-ca2e-461c-9d29-2fb7f12f226d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] validate_networks() for [('2061a013-0028-4a69-ae54-0af5da48729e', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:39:02.207099 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-01c66b15-0e0a-4e0a-9f70-5f4d4d8d15ed tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:02.218231 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-01c66b15-0e0a-4e0a-9f70-5f4d4d8d15ed tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da" status: 200 len: 1319 microversion: 2.1 time: 1.092644 Oct 05 02:39:02.218837 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1370/2778] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:01 2022] GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da => generated 1319 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:02.240107 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0940bc8b-e7cb-467f-839a-c1bbe0f77475 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:02.240751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0940bc8b-e7cb-467f-839a-c1bbe0f77475 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:02.261024 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0940bc8b-e7cb-467f-839a-c1bbe0f77475 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:02.266346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0940bc8b-e7cb-467f-839a-c1bbe0f77475 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:02.267108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0940bc8b-e7cb-467f-839a-c1bbe0f77475 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:02.268620 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0940bc8b-e7cb-467f-839a-c1bbe0f77475 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:02.269270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0940bc8b-e7cb-467f-839a-c1bbe0f77475 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:02.269888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0940bc8b-e7cb-467f-839a-c1bbe0f77475 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:02.948661 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0940bc8b-e7cb-467f-839a-c1bbe0f77475 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:02.966642 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0940bc8b-e7cb-467f-839a-c1bbe0f77475 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:02.968249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0940bc8b-e7cb-467f-839a-c1bbe0f77475 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:02.969519 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0940bc8b-e7cb-467f-839a-c1bbe0f77475 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1723 microversion: 2.20 time: 0.733411 Oct 05 02:39:02.970087 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1371/2779] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:39:02 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1723 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:39:02.979214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0c8e7f52-5859-4678-9417-c263417ee0ec tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:02.980050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0c8e7f52-5859-4678-9417-c263417ee0ec tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: 47c8d34c-c7ca-4b8d-ba7e-72ce986a0985] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:02.988753 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c8e7f52-5859-4678-9417-c263417ee0ec tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:02.989712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c8e7f52-5859-4678-9417-c263417ee0ec tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:02.990528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c8e7f52-5859-4678-9417-c263417ee0ec tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:02.992174 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c8e7f52-5859-4678-9417-c263417ee0ec tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:02.992591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c8e7f52-5859-4678-9417-c263417ee0ec tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:02.993174 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c8e7f52-5859-4678-9417-c263417ee0ec tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:03.793967 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0c8e7f52-5859-4678-9417-c263417ee0ec tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:03.801807 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0c8e7f52-5859-4678-9417-c263417ee0ec tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/47c8d34c-c7ca-4b8d-ba7e-72ce986a0985" status: 200 len: 1521 microversion: 2.1 time: 0.829743 Oct 05 02:39:03.819039 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1372/2780] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:02 2022] GET /compute/v2.1/servers/47c8d34c-c7ca-4b8d-ba7e-72ce986a0985 => generated 1521 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:03.822805 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1a438663-c09f-41b5-b4ba-5f9b079d9a1a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fccdfc1c310>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:03.889061 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1a438663-c09f-41b5-b4ba-5f9b079d9a1a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/6cf12e10-7a03-442e-b35f-02965febd7bd" status: 200 len: 1428 microversion: 2.1 time: 0.070179 Oct 05 02:39:03.890616 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1373/2781] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:39:03 2022] GET /compute/v2.1/images/6cf12e10-7a03-442e-b35f-02965febd7bd => generated 1428 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:03.898693 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a656ae31-2480-4eda-bf45-3e74dd167c39 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:03.899729 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a656ae31-2480-4eda-bf45-3e74dd167c39 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:03.907900 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a656ae31-2480-4eda-bf45-3e74dd167c39 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:03.908529 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a656ae31-2480-4eda-bf45-3e74dd167c39 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:03.909076 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a656ae31-2480-4eda-bf45-3e74dd167c39 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:03.909982 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a656ae31-2480-4eda-bf45-3e74dd167c39 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:03.910547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a656ae31-2480-4eda-bf45-3e74dd167c39 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:03.911178 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a656ae31-2480-4eda-bf45-3e74dd167c39 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:03.930974 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-405e823a-ca2e-461c-9d29-2fb7f12f226d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:39:03.932335 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-405e823a-ca2e-461c-9d29-2fb7f12f226d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:39:03.933479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-405e823a-ca2e-461c-9d29-2fb7f12f226d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:39:03.934180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-405e823a-ca2e-461c-9d29-2fb7f12f226d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:39:03.937484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-405e823a-ca2e-461c-9d29-2fb7f12f226d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:39:03.958249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-405e823a-ca2e-461c-9d29-2fb7f12f226d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:03.959199 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-405e823a-ca2e-461c-9d29-2fb7f12f226d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:03.960374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-405e823a-ca2e-461c-9d29-2fb7f12f226d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:03.961387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-405e823a-ca2e-461c-9d29-2fb7f12f226d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:03.963460 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-405e823a-ca2e-461c-9d29-2fb7f12f226d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:03.964096 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-405e823a-ca2e-461c-9d29-2fb7f12f226d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:03.987918 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-405e823a-ca2e-461c-9d29-2fb7f12f226d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Getting quotas for project e7cf219232d24bd0adae8ac00e570010. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:39:04.000812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-405e823a-ca2e-461c-9d29-2fb7f12f226d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Getting quotas for user b58f274a86f44352820c63496788f9db and project e7cf219232d24bd0adae8ac00e570010. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:39:04.014271 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-405e823a-ca2e-461c-9d29-2fb7f12f226d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:39:04.016542 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-405e823a-ca2e-461c-9d29-2fb7f12f226d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] [instance: dfc7f734-b4e9-4709-a1f1-c5823297e9ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:39:04.085959 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-405e823a-ca2e-461c-9d29-2fb7f12f226d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.205439 Oct 05 02:39:04.093434 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1409/2782] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:39:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 3213 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:39:04.129073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-948eaf0a-387d-4bc1-b50a-05184ee2020d req-7df23956-5ac2-4ac9-9c98-0c6a6e3a203b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdc1d61f-24f7-42ba-bd26-7a24227e5a01", "name": "network-vif-deleted", "tag": "272c88c7-585e-43bb-a269-108e1cd243eb"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:39:04.150688 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-948eaf0a-387d-4bc1-b50a-05184ee2020d req-7df23956-5ac2-4ac9-9c98-0c6a6e3a203b service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:04.151551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-948eaf0a-387d-4bc1-b50a-05184ee2020d req-7df23956-5ac2-4ac9-9c98-0c6a6e3a203b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:04.152282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-948eaf0a-387d-4bc1-b50a-05184ee2020d req-7df23956-5ac2-4ac9-9c98-0c6a6e3a203b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:04.169569 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-948eaf0a-387d-4bc1-b50a-05184ee2020d req-7df23956-5ac2-4ac9-9c98-0c6a6e3a203b service nova] Creating event network-vif-deleted:272c88c7-585e-43bb-a269-108e1cd243eb for instance cdc1d61f-24f7-42ba-bd26-7a24227e5a01 on n-h1-858272-3 Oct 05 02:39:04.175266 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-948eaf0a-387d-4bc1-b50a-05184ee2020d req-7df23956-5ac2-4ac9-9c98-0c6a6e3a203b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079962 Oct 05 02:39:04.179763 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1410/2783] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:39:04.194340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a5509a2b-630e-455d-b8cf-a4a341ee6537 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:04.195693 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a5509a2b-630e-455d-b8cf-a4a341ee6537 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 37204911-40f0-4356-a6df-7fda8afbf5da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:04.202971 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5509a2b-630e-455d-b8cf-a4a341ee6537 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:04.203747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5509a2b-630e-455d-b8cf-a4a341ee6537 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:04.204338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5509a2b-630e-455d-b8cf-a4a341ee6537 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:04.205841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5509a2b-630e-455d-b8cf-a4a341ee6537 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:04.206523 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5509a2b-630e-455d-b8cf-a4a341ee6537 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:04.207104 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5509a2b-630e-455d-b8cf-a4a341ee6537 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:04.489962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a656ae31-2480-4eda-bf45-3e74dd167c39 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:04.511342 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a656ae31-2480-4eda-bf45-3e74dd167c39 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1471 microversion: 2.1 time: 0.618092 Oct 05 02:39:04.514694 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1374/2784] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:03 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1471 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:04.520175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-41a13c11-2e53-47a1-be2d-52d1ead4991c req-35ae59ed-0891-4a9d-bb28-7ebe3dc15251 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac919870-2512-4424-bea6-b003534ce678", "name": "network-vif-plugged", "status": "completed", "tag": "210caa7d-298b-408f-a376-b6a2a6f6ce62"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:39:04.547529 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-41a13c11-2e53-47a1-be2d-52d1ead4991c req-35ae59ed-0891-4a9d-bb28-7ebe3dc15251 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:04.550149 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-41a13c11-2e53-47a1-be2d-52d1ead4991c req-35ae59ed-0891-4a9d-bb28-7ebe3dc15251 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:04.551637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-41a13c11-2e53-47a1-be2d-52d1ead4991c req-35ae59ed-0891-4a9d-bb28-7ebe3dc15251 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:04.582310 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-41a13c11-2e53-47a1-be2d-52d1ead4991c req-35ae59ed-0891-4a9d-bb28-7ebe3dc15251 service nova] Creating event network-vif-plugged:210caa7d-298b-408f-a376-b6a2a6f6ce62 for instance ac919870-2512-4424-bea6-b003534ce678 on n-h1-858272-3 Oct 05 02:39:04.593644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [req-41a13c11-2e53-47a1-be2d-52d1ead4991c req-35ae59ed-0891-4a9d-bb28-7ebe3dc15251 service nova] Instance ac919870-2512-4424-bea6-b003534ce678 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122319) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 02:39:04.642058 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-41a13c11-2e53-47a1-be2d-52d1ead4991c req-35ae59ed-0891-4a9d-bb28-7ebe3dc15251 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122366 Oct 05 02:39:04.643292 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1375/2785] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:39:04.652243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a5509a2b-630e-455d-b8cf-a4a341ee6537 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:04.660777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-81ac864f-df7c-4fea-8233-c859e9e08801 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:04.661945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-81ac864f-df7c-4fea-8233-c859e9e08801 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:04.663930 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a5509a2b-630e-455d-b8cf-a4a341ee6537 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da" status: 200 len: 1319 microversion: 2.1 time: 0.481942 Oct 05 02:39:04.664523 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1411/2786] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:04 2022] GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da => generated 1319 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:04.670603 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b357ddf3-9441-418e-b681-50dca0dea62c tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:04.671325 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b357ddf3-9441-418e-b681-50dca0dea62c tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] [instance: dfc7f734-b4e9-4709-a1f1-c5823297e9ab] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:04.685912 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81ac864f-df7c-4fea-8233-c859e9e08801 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:04.690639 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81ac864f-df7c-4fea-8233-c859e9e08801 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:04.691373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81ac864f-df7c-4fea-8233-c859e9e08801 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:04.693251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81ac864f-df7c-4fea-8233-c859e9e08801 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:04.695761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81ac864f-df7c-4fea-8233-c859e9e08801 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:04.697368 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81ac864f-df7c-4fea-8233-c859e9e08801 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:04.866237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b357ddf3-9441-418e-b681-50dca0dea62c tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58f274a86f44352820c63496788f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7cf219232d24bd0adae8ac00e570010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:04.882466 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b357ddf3-9441-418e-b681-50dca0dea62c tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] 10.222.0.16 "GET /compute/v2.1/servers/dfc7f734-b4e9-4709-a1f1-c5823297e9ab" status: 200 len: 1224 microversion: 2.1 time: 0.215110 Oct 05 02:39:04.899225 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1412/2787] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:04 2022] GET /compute/v2.1/servers/dfc7f734-b4e9-4709-a1f1-c5823297e9ab => generated 1224 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:04.909080 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-2a36a2b1-a0fb-4cd9-85a8-7ebbb84ce7eb req-aaa3349c-e8da-4d7e-963e-5cb95c142d86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47c8d34c-c7ca-4b8d-ba7e-72ce986a0985", "name": "network-vif-deleted", "tag": "2602e55b-b283-44a9-82fe-eba44cd72b1b"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:39:04.981166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-2a36a2b1-a0fb-4cd9-85a8-7ebbb84ce7eb req-aaa3349c-e8da-4d7e-963e-5cb95c142d86 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:04.981909 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-2a36a2b1-a0fb-4cd9-85a8-7ebbb84ce7eb req-aaa3349c-e8da-4d7e-963e-5cb95c142d86 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:04.987531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-2a36a2b1-a0fb-4cd9-85a8-7ebbb84ce7eb req-aaa3349c-e8da-4d7e-963e-5cb95c142d86 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:05.015920 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-2a36a2b1-a0fb-4cd9-85a8-7ebbb84ce7eb req-aaa3349c-e8da-4d7e-963e-5cb95c142d86 service nova] Creating event network-vif-deleted:2602e55b-b283-44a9-82fe-eba44cd72b1b for instance 47c8d34c-c7ca-4b8d-ba7e-72ce986a0985 on n-h2-858272-3 Oct 05 02:39:05.021272 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-2a36a2b1-a0fb-4cd9-85a8-7ebbb84ce7eb req-aaa3349c-e8da-4d7e-963e-5cb95c142d86 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120492 Oct 05 02:39:05.025057 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1413/2788] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:39:05.036836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-48154e51-ab6c-4faa-8048-f65adfa71b6f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:39:05.040947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-48154e51-ab6c-4faa-8048-f65adfa71b6f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:05.055635 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48154e51-ab6c-4faa-8048-f65adfa71b6f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:05.061297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48154e51-ab6c-4faa-8048-f65adfa71b6f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:05.062020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48154e51-ab6c-4faa-8048-f65adfa71b6f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:05.063029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48154e51-ab6c-4faa-8048-f65adfa71b6f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:05.063726 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48154e51-ab6c-4faa-8048-f65adfa71b6f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:05.064465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48154e51-ab6c-4faa-8048-f65adfa71b6f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:05.119722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-81ac864f-df7c-4fea-8233-c859e9e08801 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:05.134606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-81ac864f-df7c-4fea-8233-c859e9e08801 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:05.139093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-81ac864f-df7c-4fea-8233-c859e9e08801 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:05.153132 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-81ac864f-df7c-4fea-8233-c859e9e08801 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1744 microversion: 2.20 time: 0.499626 Oct 05 02:39:05.154202 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1376/2789] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:39:04 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1744 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:39:05.159283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5c74af88-f448-4fde-892c-ffde34b0ed35 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:05.169656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5c74af88-f448-4fde-892c-ffde34b0ed35 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: 47c8d34c-c7ca-4b8d-ba7e-72ce986a0985] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:05.185192 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c74af88-f448-4fde-892c-ffde34b0ed35 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:05.186577 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c74af88-f448-4fde-892c-ffde34b0ed35 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:05.186679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c74af88-f448-4fde-892c-ffde34b0ed35 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:05.187482 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c74af88-f448-4fde-892c-ffde34b0ed35 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:05.188122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c74af88-f448-4fde-892c-ffde34b0ed35 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:05.188727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c74af88-f448-4fde-892c-ffde34b0ed35 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:05.253348 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-48154e51-ab6c-4faa-8048-f65adfa71b6f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "POST /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678/action" status: 204 len: 0 microversion: 2.1 time: 0.226077 Oct 05 02:39:05.254934 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1414/2790] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:39:05 2022] POST /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678/action => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:39:05.262111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-81e71bcb-01e0-4e66-84fd-87cf640887e0 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fccdf4174c0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:05.299162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c74af88-f448-4fde-892c-ffde34b0ed35 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:05.312795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c74af88-f448-4fde-892c-ffde34b0ed35 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:05.320598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c74af88-f448-4fde-892c-ffde34b0ed35 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:05.321100 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-5c74af88-f448-4fde-892c-ffde34b0ed35 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lazy-loading 'fault' on Instance uuid 47c8d34c-c7ca-4b8d-ba7e-72ce986a0985 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:39:05.344069 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-81e71bcb-01e0-4e66-84fd-87cf640887e0 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/6cf12e10-7a03-442e-b35f-02965febd7bd" status: 200 len: 1428 microversion: 2.1 time: 0.075937 Oct 05 02:39:05.354242 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1415/2791] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:39:05 2022] GET /compute/v2.1/images/6cf12e10-7a03-442e-b35f-02965febd7bd => generated 1428 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:05.373387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2f9829ad-e86d-4681-b153-1f798c7a26ed tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:05.374997 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5c74af88-f448-4fde-892c-ffde34b0ed35 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:05.375483 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2f9829ad-e86d-4681-b153-1f798c7a26ed tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:05.383697 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5c74af88-f448-4fde-892c-ffde34b0ed35 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/47c8d34c-c7ca-4b8d-ba7e-72ce986a0985" status: 200 len: 1312 microversion: 2.1 time: 0.228235 Oct 05 02:39:05.387539 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1377/2792] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:05 2022] GET /compute/v2.1/servers/47c8d34c-c7ca-4b8d-ba7e-72ce986a0985 => generated 1312 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:05.400778 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f9829ad-e86d-4681-b153-1f798c7a26ed tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:05.408438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f9829ad-e86d-4681-b153-1f798c7a26ed tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:05.409372 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f9829ad-e86d-4681-b153-1f798c7a26ed tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:05.410128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f9829ad-e86d-4681-b153-1f798c7a26ed tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:05.410600 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f9829ad-e86d-4681-b153-1f798c7a26ed tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:05.413769 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f9829ad-e86d-4681-b153-1f798c7a26ed tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:05.691796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b3c5cc4d-6bac-49c2-9a01-3dea970a0db3 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:05.692410 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b3c5cc4d-6bac-49c2-9a01-3dea970a0db3 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 37204911-40f0-4356-a6df-7fda8afbf5da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:05.708486 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3c5cc4d-6bac-49c2-9a01-3dea970a0db3 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:05.709007 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3c5cc4d-6bac-49c2-9a01-3dea970a0db3 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:05.710154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3c5cc4d-6bac-49c2-9a01-3dea970a0db3 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:05.711299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3c5cc4d-6bac-49c2-9a01-3dea970a0db3 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:05.711881 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3c5cc4d-6bac-49c2-9a01-3dea970a0db3 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:05.712532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3c5cc4d-6bac-49c2-9a01-3dea970a0db3 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:05.778148 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2f9829ad-e86d-4681-b153-1f798c7a26ed tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:05.787482 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2f9829ad-e86d-4681-b153-1f798c7a26ed tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1471 microversion: 2.1 time: 0.432219 Oct 05 02:39:05.788238 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1416/2793] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:05 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1471 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:05.908190 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d436e297-e293-42a3-956b-43194ab9519d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:05.909416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d436e297-e293-42a3-956b-43194ab9519d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] [instance: dfc7f734-b4e9-4709-a1f1-c5823297e9ab] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:05.931742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d436e297-e293-42a3-956b-43194ab9519d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:05.932152 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d436e297-e293-42a3-956b-43194ab9519d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:05.939899 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d436e297-e293-42a3-956b-43194ab9519d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:05.942326 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d436e297-e293-42a3-956b-43194ab9519d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:05.943689 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d436e297-e293-42a3-956b-43194ab9519d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:05.946504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d436e297-e293-42a3-956b-43194ab9519d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:05.963499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b3c5cc4d-6bac-49c2-9a01-3dea970a0db3 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:05.972832 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b3c5cc4d-6bac-49c2-9a01-3dea970a0db3 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da" status: 200 len: 1319 microversion: 2.1 time: 0.284767 Oct 05 02:39:05.978875 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1378/2794] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:05 2022] GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:39:06.057188 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d436e297-e293-42a3-956b-43194ab9519d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58f274a86f44352820c63496788f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7cf219232d24bd0adae8ac00e570010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:06.066262 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d436e297-e293-42a3-956b-43194ab9519d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] 10.222.0.16 "GET /compute/v2.1/servers/dfc7f734-b4e9-4709-a1f1-c5823297e9ab" status: 200 len: 1220 microversion: 2.1 time: 0.163321 Oct 05 02:39:06.082556 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1417/2795] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:05 2022] GET /compute/v2.1/servers/dfc7f734-b4e9-4709-a1f1-c5823297e9ab => generated 1220 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:06.183256 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c2eb6a52-686c-4447-a66e-767640a7012f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:06.184431 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c2eb6a52-686c-4447-a66e-767640a7012f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:06.191068 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2eb6a52-686c-4447-a66e-767640a7012f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:06.191850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2eb6a52-686c-4447-a66e-767640a7012f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:06.192458 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2eb6a52-686c-4447-a66e-767640a7012f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:06.193193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2eb6a52-686c-4447-a66e-767640a7012f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:06.193648 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2eb6a52-686c-4447-a66e-767640a7012f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:06.194859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2eb6a52-686c-4447-a66e-767640a7012f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:06.366083 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f388b48e-c5c9-4a17-84db-b996c0da0f22 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fccdf75d700>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:06.422677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c2eb6a52-686c-4447-a66e-767640a7012f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:06.435539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c2eb6a52-686c-4447-a66e-767640a7012f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:06.440498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c2eb6a52-686c-4447-a66e-767640a7012f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:06.451186 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c2eb6a52-686c-4447-a66e-767640a7012f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1744 microversion: 2.20 time: 0.271660 Oct 05 02:39:06.454067 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1379/2796] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:39:06 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1744 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:39:06.479263 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f388b48e-c5c9-4a17-84db-b996c0da0f22 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/6cf12e10-7a03-442e-b35f-02965febd7bd" status: 200 len: 1428 microversion: 2.1 time: 0.116355 Oct 05 02:39:06.482075 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1418/2797] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:39:06 2022] GET /compute/v2.1/images/6cf12e10-7a03-442e-b35f-02965febd7bd => generated 1428 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:39:06.492654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-55784f36-d062-4124-8660-1e644d150177 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:06.493672 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-55784f36-d062-4124-8660-1e644d150177 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: 47c8d34c-c7ca-4b8d-ba7e-72ce986a0985] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:06.501365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55784f36-d062-4124-8660-1e644d150177 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:06.502218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55784f36-d062-4124-8660-1e644d150177 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:06.503039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55784f36-d062-4124-8660-1e644d150177 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:06.504080 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55784f36-d062-4124-8660-1e644d150177 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:06.504755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55784f36-d062-4124-8660-1e644d150177 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:06.505903 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55784f36-d062-4124-8660-1e644d150177 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:06.587224 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55784f36-d062-4124-8660-1e644d150177 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:06.588348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55784f36-d062-4124-8660-1e644d150177 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:06.589594 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55784f36-d062-4124-8660-1e644d150177 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:06.591472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-55784f36-d062-4124-8660-1e644d150177 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lazy-loading 'fault' on Instance uuid 47c8d34c-c7ca-4b8d-ba7e-72ce986a0985 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:39:06.715410 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-db005436-3cf7-4744-b7b2-10028d9359bf req-48feeebb-92c0-4eef-b9c3-3e8c45cad781 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37204911-40f0-4356-a6df-7fda8afbf5da", "name": "network-vif-plugged", "status": "completed", "tag": "293498fd-3dff-4d23-b7bc-8889e0d78f65"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:39:06.734816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-db005436-3cf7-4744-b7b2-10028d9359bf req-48feeebb-92c0-4eef-b9c3-3e8c45cad781 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:06.744948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-db005436-3cf7-4744-b7b2-10028d9359bf req-48feeebb-92c0-4eef-b9c3-3e8c45cad781 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:06.745738 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-db005436-3cf7-4744-b7b2-10028d9359bf req-48feeebb-92c0-4eef-b9c3-3e8c45cad781 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:06.747708 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-55784f36-d062-4124-8660-1e644d150177 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d63e7d05849e28cc54624771c60e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25663d1b71554c84998a009e9e41e7f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:06.760277 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-55784f36-d062-4124-8660-1e644d150177 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/47c8d34c-c7ca-4b8d-ba7e-72ce986a0985" status: 200 len: 1312 microversion: 2.1 time: 0.304770 Oct 05 02:39:06.762449 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1380/2798] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:06 2022] GET /compute/v2.1/servers/47c8d34c-c7ca-4b8d-ba7e-72ce986a0985 => generated 1312 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:06.765306 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-db005436-3cf7-4744-b7b2-10028d9359bf req-48feeebb-92c0-4eef-b9c3-3e8c45cad781 service nova] Creating event network-vif-plugged:293498fd-3dff-4d23-b7bc-8889e0d78f65 for instance 37204911-40f0-4356-a6df-7fda8afbf5da on n-h2-858272-3 Oct 05 02:39:06.792164 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-db005436-3cf7-4744-b7b2-10028d9359bf req-48feeebb-92c0-4eef-b9c3-3e8c45cad781 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078580 Oct 05 02:39:06.795406 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1419/2799] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:39:06.812688 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2052a15d-6c24-4d77-b3b4-512f4fd47b8f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:06.813490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2052a15d-6c24-4d77-b3b4-512f4fd47b8f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:06.824311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2052a15d-6c24-4d77-b3b4-512f4fd47b8f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:06.824913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2052a15d-6c24-4d77-b3b4-512f4fd47b8f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:06.825429 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2052a15d-6c24-4d77-b3b4-512f4fd47b8f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:06.826296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2052a15d-6c24-4d77-b3b4-512f4fd47b8f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:06.826682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2052a15d-6c24-4d77-b3b4-512f4fd47b8f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:06.827255 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2052a15d-6c24-4d77-b3b4-512f4fd47b8f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:07.005807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7a0e7015-7e3a-40f1-986e-ec2f47cdc75c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:07.006784 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7a0e7015-7e3a-40f1-986e-ec2f47cdc75c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 37204911-40f0-4356-a6df-7fda8afbf5da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:07.020165 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a0e7015-7e3a-40f1-986e-ec2f47cdc75c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:07.024215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a0e7015-7e3a-40f1-986e-ec2f47cdc75c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:07.025139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a0e7015-7e3a-40f1-986e-ec2f47cdc75c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:07.029655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a0e7015-7e3a-40f1-986e-ec2f47cdc75c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:07.030232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a0e7015-7e3a-40f1-986e-ec2f47cdc75c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:07.030877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a0e7015-7e3a-40f1-986e-ec2f47cdc75c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:07.372537 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2052a15d-6c24-4d77-b3b4-512f4fd47b8f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:07.393186 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2052a15d-6c24-4d77-b3b4-512f4fd47b8f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1471 microversion: 2.1 time: 0.578551 Oct 05 02:39:07.397545 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1381/2800] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:06 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1471 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:07.408950 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d182a016-a289-4e7f-b287-99322d54a352 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:07.417991 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d182a016-a289-4e7f-b287-99322d54a352 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] [instance: dfc7f734-b4e9-4709-a1f1-c5823297e9ab] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:07.447471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d182a016-a289-4e7f-b287-99322d54a352 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:07.448220 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d182a016-a289-4e7f-b287-99322d54a352 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:07.455036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d182a016-a289-4e7f-b287-99322d54a352 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:07.455675 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d182a016-a289-4e7f-b287-99322d54a352 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:07.456170 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d182a016-a289-4e7f-b287-99322d54a352 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:07.456608 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d182a016-a289-4e7f-b287-99322d54a352 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:07.511880 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7a0e7015-7e3a-40f1-986e-ec2f47cdc75c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:07.539501 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7a0e7015-7e3a-40f1-986e-ec2f47cdc75c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da" status: 200 len: 1319 microversion: 2.1 time: 0.535820 Oct 05 02:39:07.553628 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1420/2801] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:06 2022] GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da => generated 1319 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:07.573704 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-376ca098-d882-40c0-b4d3-eab68451d6c4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:07.574742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-376ca098-d882-40c0-b4d3-eab68451d6c4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:07.582466 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-376ca098-d882-40c0-b4d3-eab68451d6c4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:07.583301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-376ca098-d882-40c0-b4d3-eab68451d6c4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:07.583960 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-376ca098-d882-40c0-b4d3-eab68451d6c4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:07.585689 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-376ca098-d882-40c0-b4d3-eab68451d6c4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:07.586345 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-376ca098-d882-40c0-b4d3-eab68451d6c4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:07.587336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-376ca098-d882-40c0-b4d3-eab68451d6c4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:07.640856 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d182a016-a289-4e7f-b287-99322d54a352 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58f274a86f44352820c63496788f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7cf219232d24bd0adae8ac00e570010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:07.659926 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d182a016-a289-4e7f-b287-99322d54a352 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] 10.222.0.16 "GET /compute/v2.1/servers/dfc7f734-b4e9-4709-a1f1-c5823297e9ab" status: 200 len: 1276 microversion: 2.1 time: 0.261055 Oct 05 02:39:07.675031 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1382/2802] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:07 2022] GET /compute/v2.1/servers/dfc7f734-b4e9-4709-a1f1-c5823297e9ab => generated 1276 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:07.691474 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fcc9acc0-c3c9-46bc-ac24-b7302cba39c2 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fccdfceac10>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:07.759441 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fcc9acc0-c3c9-46bc-ac24-b7302cba39c2 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/6cf12e10-7a03-442e-b35f-02965febd7bd" status: 200 len: 1428 microversion: 2.1 time: 0.079250 Oct 05 02:39:07.761280 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1383/2803] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:39:07 2022] GET /compute/v2.1/images/6cf12e10-7a03-442e-b35f-02965febd7bd => generated 1428 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:07.786911 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d7331f13-d208-4fcb-a1eb-abacb27dc772 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:07.789540 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d7331f13-d208-4fcb-a1eb-abacb27dc772 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: 47c8d34c-c7ca-4b8d-ba7e-72ce986a0985] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:07.798193 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-376ca098-d882-40c0-b4d3-eab68451d6c4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:07.800817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7331f13-d208-4fcb-a1eb-abacb27dc772 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:07.801108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7331f13-d208-4fcb-a1eb-abacb27dc772 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:07.801554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7331f13-d208-4fcb-a1eb-abacb27dc772 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:07.802265 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7331f13-d208-4fcb-a1eb-abacb27dc772 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:07.802721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7331f13-d208-4fcb-a1eb-abacb27dc772 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:07.803754 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7331f13-d208-4fcb-a1eb-abacb27dc772 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:07.813769 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-376ca098-d882-40c0-b4d3-eab68451d6c4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:07.815569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-376ca098-d882-40c0-b4d3-eab68451d6c4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:07.817093 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-376ca098-d882-40c0-b4d3-eab68451d6c4 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1744 microversion: 2.20 time: 0.262328 Oct 05 02:39:07.818285 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1421/2804] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:39:07 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1744 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:39:07.824275 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-d7331f13-d208-4fcb-a1eb-abacb27dc772 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] HTTP exception thrown: Instance 47c8d34c-c7ca-4b8d-ba7e-72ce986a0985 could not be found. Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d7331f13-d208-4fcb-a1eb-abacb27dc772 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Request method failure captured: Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/47c8d34c-c7ca-4b8d-ba7e-72ce986a0985 HTTP/1.1 Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO4LzXWS5PqPGm0R-1pVXbPaQVByd8JFbw07mZ7MFTxL_vfJGRpu7xDxEwAm2moC30ltuIazbGchiwafSf0vZFgxhr-NQ0k4LU7PHHXWWHQcTCteNj_YI3BCzgBL3aOlnRnm35_GIFYvGUGp9I172dC3D6n8SMuwkgQwYIMSE02e59g Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 25663d1b71554c84998a009e9e41e7f0 Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ListServersNegativeTestJSON-1219065022 Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/25663d1b71554c84998a009e9e41e7f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/25663d1b71554c84998a009e9e41e7f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/25663d1b71554c84998a009e9e41e7f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_25663d1b71554c84998a009e9e41e7f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ListServersNegativeTestJSON-1219065022 Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 25663d1b71554c84998a009e9e41e7f0 Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1219065022 Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ListServersNegativeTestJSON-1219065022-project Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 2b8d63e7d05849e28cc54624771c60e1 Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ListServersNegativeTestJSON-1219065022-project Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 47c8d34c-c7ca-4b8d-ba7e-72ce986a0985 could not be found. Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '47c8d34c-c7ca-4b8d-ba7e-72ce986a0985'} Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47c8d34c-c7ca-4b8d-ba7e-72ce986a0985 could not be found. Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47c8d34c-c7ca-4b8d-ba7e-72ce986a0985 could not be found. Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:39:07.826259 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:39:07.830100 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:39:07.830100 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:39:07.830100 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:39:07.830100 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:39:07.830100 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:39:07.830100 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:39:07.830100 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47c8d34c-c7ca-4b8d-ba7e-72ce986a0985 could not be found. Oct 05 02:39:07.830100 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:39:07.832171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d7331f13-d208-4fcb-a1eb-abacb27dc772 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Returning 404 to user: Instance 47c8d34c-c7ca-4b8d-ba7e-72ce986a0985 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:39:07.833352 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d7331f13-d208-4fcb-a1eb-abacb27dc772 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/47c8d34c-c7ca-4b8d-ba7e-72ce986a0985" status: 404 len: 111 microversion: 2.1 time: 0.050363 Oct 05 02:39:07.835015 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1384/2805] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:07 2022] GET /compute/v2.1/servers/47c8d34c-c7ca-4b8d-ba7e-72ce986a0985 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:39:07.843146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-899828c7-5c24-4afd-901d-5ed932184ac6 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:07.843877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-899828c7-5c24-4afd-901d-5ed932184ac6 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] [instance: cdc1d61f-24f7-42ba-bd26-7a24227e5a01] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:07.850509 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-899828c7-5c24-4afd-901d-5ed932184ac6 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:07.851238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-899828c7-5c24-4afd-901d-5ed932184ac6 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:07.851819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-899828c7-5c24-4afd-901d-5ed932184ac6 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:07.852542 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-899828c7-5c24-4afd-901d-5ed932184ac6 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:07.853756 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-899828c7-5c24-4afd-901d-5ed932184ac6 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:07.854190 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-899828c7-5c24-4afd-901d-5ed932184ac6 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:07.898668 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-899828c7-5c24-4afd-901d-5ed932184ac6 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] HTTP exception thrown: Instance cdc1d61f-24f7-42ba-bd26-7a24227e5a01 could not be found. Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-899828c7-5c24-4afd-901d-5ed932184ac6 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Request method failure captured: Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01 HTTP/1.1 Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO4LzXWS5PqPGm0R-1pVXbPaQVByd8JFbw07mZ7MFTxL_vfJGRpu7xDxEwAm2moC30ltuIazbGchiwafSf0vZFgxhr-NQ0k4LU7PHHXWWHQcTCteNj_YI3BCzgBL3aOlnRnm35_GIFYvGUGp9I172dC3D6n8SMuwkgQwYIMSE02e59g Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 25663d1b71554c84998a009e9e41e7f0 Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ListServersNegativeTestJSON-1219065022 Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/25663d1b71554c84998a009e9e41e7f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/25663d1b71554c84998a009e9e41e7f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/25663d1b71554c84998a009e9e41e7f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_25663d1b71554c84998a009e9e41e7f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ListServersNegativeTestJSON-1219065022 Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 25663d1b71554c84998a009e9e41e7f0 Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1219065022 Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ListServersNegativeTestJSON-1219065022-project Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 2b8d63e7d05849e28cc54624771c60e1 Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ListServersNegativeTestJSON-1219065022-project Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance cdc1d61f-24f7-42ba-bd26-7a24227e5a01 could not be found. Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'cdc1d61f-24f7-42ba-bd26-7a24227e5a01'} Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdc1d61f-24f7-42ba-bd26-7a24227e5a01 could not be found. Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdc1d61f-24f7-42ba-bd26-7a24227e5a01 could not be found. Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:39:07.903842 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:39:07.907636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:39:07.907636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:39:07.907636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:39:07.907636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:39:07.907636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:39:07.907636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:39:07.907636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdc1d61f-24f7-42ba-bd26-7a24227e5a01 could not be found. Oct 05 02:39:07.907636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:39:07.907636 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-899828c7-5c24-4afd-901d-5ed932184ac6 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] Returning 404 to user: Instance cdc1d61f-24f7-42ba-bd26-7a24227e5a01 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:39:07.907636 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-899828c7-5c24-4afd-901d-5ed932184ac6 tempest-ListServersNegativeTestJSON-1219065022 tempest-ListServersNegativeTestJSON-1219065022-project] 10.222.0.16 "GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01" status: 404 len: 111 microversion: 2.1 time: 0.068345 Oct 05 02:39:07.911235 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1422/2806] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:07 2022] GET /compute/v2.1/servers/cdc1d61f-24f7-42ba-bd26-7a24227e5a01 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:39:08.425640 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-44761f24-cd34-4e41-9162-6a51af0ab1d3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:08.427258 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-44761f24-cd34-4e41-9162-6a51af0ab1d3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:08.441369 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44761f24-cd34-4e41-9162-6a51af0ab1d3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:08.446575 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44761f24-cd34-4e41-9162-6a51af0ab1d3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:08.447289 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44761f24-cd34-4e41-9162-6a51af0ab1d3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:08.448212 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44761f24-cd34-4e41-9162-6a51af0ab1d3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:08.448842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44761f24-cd34-4e41-9162-6a51af0ab1d3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:08.449499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44761f24-cd34-4e41-9162-6a51af0ab1d3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:08.571087 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c6d0fb29-a5fc-404f-ac46-ee2274a10213 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:08.572044 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c6d0fb29-a5fc-404f-ac46-ee2274a10213 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 37204911-40f0-4356-a6df-7fda8afbf5da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:08.590284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c6d0fb29-a5fc-404f-ac46-ee2274a10213 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:08.592572 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c6d0fb29-a5fc-404f-ac46-ee2274a10213 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:08.593213 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c6d0fb29-a5fc-404f-ac46-ee2274a10213 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:08.594999 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c6d0fb29-a5fc-404f-ac46-ee2274a10213 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:08.597985 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c6d0fb29-a5fc-404f-ac46-ee2274a10213 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:08.598636 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c6d0fb29-a5fc-404f-ac46-ee2274a10213 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:09.450814 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-44761f24-cd34-4e41-9162-6a51af0ab1d3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:09.466411 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-44761f24-cd34-4e41-9162-6a51af0ab1d3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1471 microversion: 2.1 time: 1.044687 Oct 05 02:39:09.467000 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1385/2807] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:08 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1471 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:09.471668 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a9c431a0-bfc4-499f-921f-b4e74945da07 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:09.472280 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a9c431a0-bfc4-499f-921f-b4e74945da07 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] [instance: dfc7f734-b4e9-4709-a1f1-c5823297e9ab] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:09.501704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9c431a0-bfc4-499f-921f-b4e74945da07 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:09.502207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9c431a0-bfc4-499f-921f-b4e74945da07 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:09.502647 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9c431a0-bfc4-499f-921f-b4e74945da07 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:09.503357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9c431a0-bfc4-499f-921f-b4e74945da07 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:09.505580 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9c431a0-bfc4-499f-921f-b4e74945da07 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:09.506332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9c431a0-bfc4-499f-921f-b4e74945da07 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:09.526336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c6d0fb29-a5fc-404f-ac46-ee2274a10213 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:09.540039 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c6d0fb29-a5fc-404f-ac46-ee2274a10213 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da" status: 200 len: 1319 microversion: 2.1 time: 0.973819 Oct 05 02:39:09.545696 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1423/2808] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:08 2022] GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da => generated 1319 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:09.551204 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b95a5dfb-9ae7-470c-a208-bc8ac3feedbe tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fccdf3cc3a0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:09.646261 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b95a5dfb-9ae7-470c-a208-bc8ac3feedbe tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/6cf12e10-7a03-442e-b35f-02965febd7bd" status: 200 len: 1428 microversion: 2.1 time: 0.099307 Oct 05 02:39:09.647422 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1424/2809] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:39:09 2022] GET /compute/v2.1/images/6cf12e10-7a03-442e-b35f-02965febd7bd => generated 1428 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:09.663354 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4c5160f8-1a13-444e-8fc4-4ebdcc9c116c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:09.663992 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4c5160f8-1a13-444e-8fc4-4ebdcc9c116c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:09.679847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c5160f8-1a13-444e-8fc4-4ebdcc9c116c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:09.680354 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c5160f8-1a13-444e-8fc4-4ebdcc9c116c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:09.680815 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c5160f8-1a13-444e-8fc4-4ebdcc9c116c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:09.681587 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c5160f8-1a13-444e-8fc4-4ebdcc9c116c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:09.682234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c5160f8-1a13-444e-8fc4-4ebdcc9c116c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:09.682819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c5160f8-1a13-444e-8fc4-4ebdcc9c116c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:09.731145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a9c431a0-bfc4-499f-921f-b4e74945da07 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58f274a86f44352820c63496788f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7cf219232d24bd0adae8ac00e570010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:09.747610 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a9c431a0-bfc4-499f-921f-b4e74945da07 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] 10.222.0.16 "GET /compute/v2.1/servers/dfc7f734-b4e9-4709-a1f1-c5823297e9ab" status: 200 len: 1282 microversion: 2.1 time: 0.271752 Oct 05 02:39:09.748542 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1386/2810] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:09 2022] GET /compute/v2.1/servers/dfc7f734-b4e9-4709-a1f1-c5823297e9ab => generated 1282 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:09.753423 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-0aa763b8-8ae4-41c1-b8eb-938f4b81bc32 req-f0cfd57d-cbde-4a0c-a0ec-70231a61cfbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74b1ab94-3bc0-440d-bf57-dcab444e063d", "name": "network-vif-plugged", "status": "completed", "tag": "f76faa20-bd22-4858-915c-478dc55b243d"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:39:09.764129 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-0aa763b8-8ae4-41c1-b8eb-938f4b81bc32 req-f0cfd57d-cbde-4a0c-a0ec-70231a61cfbf service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:09.765062 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-0aa763b8-8ae4-41c1-b8eb-938f4b81bc32 req-f0cfd57d-cbde-4a0c-a0ec-70231a61cfbf service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:09.765717 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-0aa763b8-8ae4-41c1-b8eb-938f4b81bc32 req-f0cfd57d-cbde-4a0c-a0ec-70231a61cfbf service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:09.770156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:39:09.790908 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-0aa763b8-8ae4-41c1-b8eb-938f4b81bc32 req-f0cfd57d-cbde-4a0c-a0ec-70231a61cfbf service nova] Creating event network-vif-plugged:f76faa20-bd22-4858-915c-478dc55b243d for instance 74b1ab94-3bc0-440d-bf57-dcab444e063d on n-h1-858272-3 Oct 05 02:39:09.806247 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-0aa763b8-8ae4-41c1-b8eb-938f4b81bc32 req-f0cfd57d-cbde-4a0c-a0ec-70231a61cfbf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056169 Oct 05 02:39:09.809418 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1387/2811] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:39:10.183540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4c5160f8-1a13-444e-8fc4-4ebdcc9c116c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:10.196131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4c5160f8-1a13-444e-8fc4-4ebdcc9c116c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:10.216685 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4c5160f8-1a13-444e-8fc4-4ebdcc9c116c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:10.220961 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4c5160f8-1a13-444e-8fc4-4ebdcc9c116c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1744 microversion: 2.20 time: 0.572526 Oct 05 02:39:10.233089 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1425/2812] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:39:09 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1744 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:39:10.496063 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-65b76047-6ac4-4239-8b76-f88e5bad2560 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:10.497523 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-65b76047-6ac4-4239-8b76-f88e5bad2560 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:10.516006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65b76047-6ac4-4239-8b76-f88e5bad2560 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:10.516512 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65b76047-6ac4-4239-8b76-f88e5bad2560 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:10.516986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65b76047-6ac4-4239-8b76-f88e5bad2560 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:10.528384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65b76047-6ac4-4239-8b76-f88e5bad2560 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:10.529725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65b76047-6ac4-4239-8b76-f88e5bad2560 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:10.530192 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65b76047-6ac4-4239-8b76-f88e5bad2560 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:10.574623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cc78d18d-e246-4392-9d94-af885fb1eabe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:10.575238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cc78d18d-e246-4392-9d94-af885fb1eabe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 37204911-40f0-4356-a6df-7fda8afbf5da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:10.587189 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cc78d18d-e246-4392-9d94-af885fb1eabe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:10.587189 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cc78d18d-e246-4392-9d94-af885fb1eabe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:10.587865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cc78d18d-e246-4392-9d94-af885fb1eabe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:10.589835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cc78d18d-e246-4392-9d94-af885fb1eabe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:10.591258 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cc78d18d-e246-4392-9d94-af885fb1eabe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:10.593110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cc78d18d-e246-4392-9d94-af885fb1eabe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:11.325711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-65b76047-6ac4-4239-8b76-f88e5bad2560 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:11.335045 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-65b76047-6ac4-4239-8b76-f88e5bad2560 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1471 microversion: 2.1 time: 0.842498 Oct 05 02:39:11.341813 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1388/2813] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:10 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1471 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:11.363496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e28b074a-6c80-4cb7-9f1a-1ffa5013675a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fcce456ab80>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:11.481433 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cc78d18d-e246-4392-9d94-af885fb1eabe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:11.502234 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cc78d18d-e246-4392-9d94-af885fb1eabe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da" status: 200 len: 1468 microversion: 2.1 time: 0.931398 Oct 05 02:39:11.505375 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1426/2814] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:10 2022] GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da => generated 1468 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:11.510331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-80fe9652-cb14-47f7-b4c3-4484f62d472d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:11.529531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-80fe9652-cb14-47f7-b4c3-4484f62d472d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] [instance: dfc7f734-b4e9-4709-a1f1-c5823297e9ab] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:11.555604 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-80fe9652-cb14-47f7-b4c3-4484f62d472d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:11.556396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-80fe9652-cb14-47f7-b4c3-4484f62d472d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:11.557058 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-80fe9652-cb14-47f7-b4c3-4484f62d472d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:11.557935 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-80fe9652-cb14-47f7-b4c3-4484f62d472d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:11.566856 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-80fe9652-cb14-47f7-b4c3-4484f62d472d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:11.567542 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-80fe9652-cb14-47f7-b4c3-4484f62d472d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:11.638924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:39:11.799064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-80fe9652-cb14-47f7-b4c3-4484f62d472d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58f274a86f44352820c63496788f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7cf219232d24bd0adae8ac00e570010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:11.807595 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-80fe9652-cb14-47f7-b4c3-4484f62d472d tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] 10.222.0.16 "GET /compute/v2.1/servers/dfc7f734-b4e9-4709-a1f1-c5823297e9ab" status: 200 len: 1282 microversion: 2.1 time: 0.300942 Oct 05 02:39:11.814717 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1427/2815] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:11 2022] GET /compute/v2.1/servers/dfc7f734-b4e9-4709-a1f1-c5823297e9ab => generated 1282 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:11.825682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3658f68d-091b-4a46-a6c6-21a9c302823b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:11.826627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3658f68d-091b-4a46-a6c6-21a9c302823b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:11.858543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3658f68d-091b-4a46-a6c6-21a9c302823b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:11.859061 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3658f68d-091b-4a46-a6c6-21a9c302823b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:11.862573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3658f68d-091b-4a46-a6c6-21a9c302823b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:11.867540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3658f68d-091b-4a46-a6c6-21a9c302823b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:11.870990 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3658f68d-091b-4a46-a6c6-21a9c302823b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:11.871716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3658f68d-091b-4a46-a6c6-21a9c302823b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:11.886238 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e28b074a-6c80-4cb7-9f1a-1ffa5013675a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/6cf12e10-7a03-442e-b35f-02965febd7bd" status: 200 len: 1428 microversion: 2.1 time: 0.543129 Oct 05 02:39:11.886893 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1389/2816] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:39:11 2022] GET /compute/v2.1/images/6cf12e10-7a03-442e-b35f-02965febd7bd => generated 1428 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:11.903132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4cf88b98-b0b6-482a-96b4-2fefb319fbe4 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:11.913643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4cf88b98-b0b6-482a-96b4-2fefb319fbe4 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: de6a6594-881f-489b-8b94-28b74e935c1e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:11.954028 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4cf88b98-b0b6-482a-96b4-2fefb319fbe4 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:11.954528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4cf88b98-b0b6-482a-96b4-2fefb319fbe4 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:11.954987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4cf88b98-b0b6-482a-96b4-2fefb319fbe4 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:11.955739 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4cf88b98-b0b6-482a-96b4-2fefb319fbe4 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:11.956196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4cf88b98-b0b6-482a-96b4-2fefb319fbe4 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:11.956636 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4cf88b98-b0b6-482a-96b4-2fefb319fbe4 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:12.782054 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4cf88b98-b0b6-482a-96b4-2fefb319fbe4 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:12.800239 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4cf88b98-b0b6-482a-96b4-2fefb319fbe4 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/de6a6594-881f-489b-8b94-28b74e935c1e" status: 200 len: 1319 microversion: 2.1 time: 0.910148 Oct 05 02:39:12.800858 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1390/2817] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:11 2022] GET /compute/v2.1/servers/de6a6594-881f-489b-8b94-28b74e935c1e => generated 1319 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:12.812445 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-94b65516-b09c-4094-b4a2-2134768004f5 req-8992281c-8802-485d-a2f5-e70e45630cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c15b977-1608-45e8-8bbd-b2bd5c1eff21", "name": "network-vif-plugged", "status": "completed", "tag": "af2bec78-4945-43ac-81ca-883ba5ae8ef2"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:39:12.847222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-94b65516-b09c-4094-b4a2-2134768004f5 req-8992281c-8802-485d-a2f5-e70e45630cf6 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:12.847980 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-94b65516-b09c-4094-b4a2-2134768004f5 req-8992281c-8802-485d-a2f5-e70e45630cf6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:12.848590 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-94b65516-b09c-4094-b4a2-2134768004f5 req-8992281c-8802-485d-a2f5-e70e45630cf6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:12.883774 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-94b65516-b09c-4094-b4a2-2134768004f5 req-8992281c-8802-485d-a2f5-e70e45630cf6 service nova] Creating event network-vif-plugged:af2bec78-4945-43ac-81ca-883ba5ae8ef2 for instance 1c15b977-1608-45e8-8bbd-b2bd5c1eff21 on n-h2-858272-3 Oct 05 02:39:12.898491 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-94b65516-b09c-4094-b4a2-2134768004f5 req-8992281c-8802-485d-a2f5-e70e45630cf6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095963 Oct 05 02:39:12.902929 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1391/2818] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:39:12.919272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1045b01d-8fc1-4584-89b4-cfa8c8eae286 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:12.923670 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1045b01d-8fc1-4584-89b4-cfa8c8eae286 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:12.940016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1045b01d-8fc1-4584-89b4-cfa8c8eae286 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:12.948513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1045b01d-8fc1-4584-89b4-cfa8c8eae286 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:12.949419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1045b01d-8fc1-4584-89b4-cfa8c8eae286 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:12.950521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1045b01d-8fc1-4584-89b4-cfa8c8eae286 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:12.951309 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1045b01d-8fc1-4584-89b4-cfa8c8eae286 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:12.955797 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1045b01d-8fc1-4584-89b4-cfa8c8eae286 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:13.045958 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3658f68d-091b-4a46-a6c6-21a9c302823b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:13.055262 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3658f68d-091b-4a46-a6c6-21a9c302823b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:13.056702 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3658f68d-091b-4a46-a6c6-21a9c302823b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:13.070991 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3658f68d-091b-4a46-a6c6-21a9c302823b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1739 microversion: 2.20 time: 1.254147 Oct 05 02:39:13.087411 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1428/2819] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:39:11 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1739 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:39:13.100156 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c38029ff-9a2c-49cd-a631-ef19219e061b tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:13.103611 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c38029ff-9a2c-49cd-a631-ef19219e061b tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] [instance: dfc7f734-b4e9-4709-a1f1-c5823297e9ab] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:13.125703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c38029ff-9a2c-49cd-a631-ef19219e061b tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:13.132288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c38029ff-9a2c-49cd-a631-ef19219e061b tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:13.133183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c38029ff-9a2c-49cd-a631-ef19219e061b tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:13.134790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c38029ff-9a2c-49cd-a631-ef19219e061b tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:13.138148 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c38029ff-9a2c-49cd-a631-ef19219e061b tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:13.139820 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c38029ff-9a2c-49cd-a631-ef19219e061b tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:13.631084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c38029ff-9a2c-49cd-a631-ef19219e061b tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58f274a86f44352820c63496788f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7cf219232d24bd0adae8ac00e570010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:13.676789 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c38029ff-9a2c-49cd-a631-ef19219e061b tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] 10.222.0.16 "GET /compute/v2.1/servers/dfc7f734-b4e9-4709-a1f1-c5823297e9ab" status: 200 len: 1324 microversion: 2.1 time: 0.582980 Oct 05 02:39:13.680038 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1429/2820] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:13 2022] GET /compute/v2.1/servers/dfc7f734-b4e9-4709-a1f1-c5823297e9ab => generated 1324 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:13.697206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0f55287a-4629-4a4b-873f-fc04e05dae49 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fccdf3d1c10>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:13.803384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1045b01d-8fc1-4584-89b4-cfa8c8eae286 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:13.811896 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1045b01d-8fc1-4584-89b4-cfa8c8eae286 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1463 microversion: 2.1 time: 0.907354 Oct 05 02:39:13.819954 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1392/2821] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:12 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1463 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:13.833960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7c1af171-aa0f-4e6e-b2f9-318b2fc0faf2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:13.835849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7c1af171-aa0f-4e6e-b2f9-318b2fc0faf2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: de6a6594-881f-489b-8b94-28b74e935c1e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:13.856282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7c1af171-aa0f-4e6e-b2f9-318b2fc0faf2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:13.860259 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7c1af171-aa0f-4e6e-b2f9-318b2fc0faf2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:13.860892 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7c1af171-aa0f-4e6e-b2f9-318b2fc0faf2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:13.861817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7c1af171-aa0f-4e6e-b2f9-318b2fc0faf2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:13.868053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7c1af171-aa0f-4e6e-b2f9-318b2fc0faf2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:13.868774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7c1af171-aa0f-4e6e-b2f9-318b2fc0faf2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:13.974756 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=16 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:39:14.561049 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7c1af171-aa0f-4e6e-b2f9-318b2fc0faf2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:14.571130 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7c1af171-aa0f-4e6e-b2f9-318b2fc0faf2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/de6a6594-881f-489b-8b94-28b74e935c1e" status: 200 len: 1319 microversion: 2.1 time: 0.749722 Oct 05 02:39:14.578611 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1393/2822] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:13 2022] GET /compute/v2.1/servers/de6a6594-881f-489b-8b94-28b74e935c1e => generated 1319 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:14.601879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f4e8a371-6e56-45b6-8d2e-929cbadf142a tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:14.602503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f4e8a371-6e56-45b6-8d2e-929cbadf142a tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:14.633088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f4e8a371-6e56-45b6-8d2e-929cbadf142a tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:14.636643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f4e8a371-6e56-45b6-8d2e-929cbadf142a tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:14.637424 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f4e8a371-6e56-45b6-8d2e-929cbadf142a tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:14.638335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f4e8a371-6e56-45b6-8d2e-929cbadf142a tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:14.645581 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f4e8a371-6e56-45b6-8d2e-929cbadf142a tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:14.647947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f4e8a371-6e56-45b6-8d2e-929cbadf142a tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:14.879162 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=10 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:39:15.257930 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f4e8a371-6e56-45b6-8d2e-929cbadf142a tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1614 microversion: 2.1 time: 0.675549 Oct 05 02:39:15.286151 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1394/2823] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:14 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1614 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:15.308255 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-273d9005-b774-4fda-9cb5-c951bb46f914 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:15.309193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-273d9005-b774-4fda-9cb5-c951bb46f914 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:15.323328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-273d9005-b774-4fda-9cb5-c951bb46f914 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:15.323721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-273d9005-b774-4fda-9cb5-c951bb46f914 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:15.324167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-273d9005-b774-4fda-9cb5-c951bb46f914 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:15.324929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-273d9005-b774-4fda-9cb5-c951bb46f914 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:15.327365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-273d9005-b774-4fda-9cb5-c951bb46f914 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:15.327995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-273d9005-b774-4fda-9cb5-c951bb46f914 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:15.832010 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-273d9005-b774-4fda-9cb5-c951bb46f914 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:15.855282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-273d9005-b774-4fda-9cb5-c951bb46f914 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:15.868365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-273d9005-b774-4fda-9cb5-c951bb46f914 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:15.874155 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-273d9005-b774-4fda-9cb5-c951bb46f914 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1739 microversion: 2.20 time: 0.578546 Oct 05 02:39:15.877485 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1395/2824] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:39:15 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1739 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:39:15.887548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9b366faf-320c-4155-b9ec-651dcd1372e2 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:15.893502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9b366faf-320c-4155-b9ec-651dcd1372e2 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] [instance: dfc7f734-b4e9-4709-a1f1-c5823297e9ab] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:15.911176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b366faf-320c-4155-b9ec-651dcd1372e2 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:15.912042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b366faf-320c-4155-b9ec-651dcd1372e2 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:15.912693 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b366faf-320c-4155-b9ec-651dcd1372e2 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:15.913620 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b366faf-320c-4155-b9ec-651dcd1372e2 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:15.914244 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b366faf-320c-4155-b9ec-651dcd1372e2 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:15.917441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b366faf-320c-4155-b9ec-651dcd1372e2 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:16.398184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9b366faf-320c-4155-b9ec-651dcd1372e2 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58f274a86f44352820c63496788f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7cf219232d24bd0adae8ac00e570010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:16.411053 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9b366faf-320c-4155-b9ec-651dcd1372e2 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] 10.222.0.16 "GET /compute/v2.1/servers/dfc7f734-b4e9-4709-a1f1-c5823297e9ab" status: 200 len: 1324 microversion: 2.1 time: 0.529938 Oct 05 02:39:16.420985 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1396/2825] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:15 2022] GET /compute/v2.1/servers/dfc7f734-b4e9-4709-a1f1-c5823297e9ab => generated 1324 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:16.435888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-f4fbeeda-ea67-48a6-998f-262836fcfe68 req-a6728e30-9cc2-45c3-b3be-cc100278fa55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6a6594-881f-489b-8b94-28b74e935c1e", "name": "network-vif-plugged", "status": "completed", "tag": "a96fd765-4343-4dce-aab3-f848781564f5"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:39:16.512416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f4fbeeda-ea67-48a6-998f-262836fcfe68 req-a6728e30-9cc2-45c3-b3be-cc100278fa55 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:16.516348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f4fbeeda-ea67-48a6-998f-262836fcfe68 req-a6728e30-9cc2-45c3-b3be-cc100278fa55 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:16.517185 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f4fbeeda-ea67-48a6-998f-262836fcfe68 req-a6728e30-9cc2-45c3-b3be-cc100278fa55 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:16.575081 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-f4fbeeda-ea67-48a6-998f-262836fcfe68 req-a6728e30-9cc2-45c3-b3be-cc100278fa55 service nova] Creating event network-vif-plugged:a96fd765-4343-4dce-aab3-f848781564f5 for instance de6a6594-881f-489b-8b94-28b74e935c1e on n-h1-858272-3 Oct 05 02:39:16.588553 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-f4fbeeda-ea67-48a6-998f-262836fcfe68 req-a6728e30-9cc2-45c3-b3be-cc100278fa55 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174519 Oct 05 02:39:16.591715 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1397/2826] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:39:16.599528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-55f2861b-1161-474e-a7e2-040e1247a1ca tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Calling method '.version_select at 0x7fccdf638160>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:16.619174 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55f2861b-1161-474e-a7e2-040e1247a1ca tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:16.633718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55f2861b-1161-474e-a7e2-040e1247a1ca tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:16.637658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55f2861b-1161-474e-a7e2-040e1247a1ca tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:16.660836 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-55f2861b-1161-474e-a7e2-040e1247a1ca tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.066581 Oct 05 02:39:16.661830 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1398/2827] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 5 02:39:16 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:39:16.682843 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cff0f1fc-f5cb-4f09-8d0b-2bb1dd655c6a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:16.711464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cff0f1fc-f5cb-4f09-8d0b-2bb1dd655c6a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: de6a6594-881f-489b-8b94-28b74e935c1e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:16.731075 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cff0f1fc-f5cb-4f09-8d0b-2bb1dd655c6a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:16.731562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cff0f1fc-f5cb-4f09-8d0b-2bb1dd655c6a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:16.732069 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cff0f1fc-f5cb-4f09-8d0b-2bb1dd655c6a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:16.732682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cff0f1fc-f5cb-4f09-8d0b-2bb1dd655c6a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:16.733164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cff0f1fc-f5cb-4f09-8d0b-2bb1dd655c6a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:16.733587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cff0f1fc-f5cb-4f09-8d0b-2bb1dd655c6a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:17.997766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cff0f1fc-f5cb-4f09-8d0b-2bb1dd655c6a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:18.005872 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cff0f1fc-f5cb-4f09-8d0b-2bb1dd655c6a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/de6a6594-881f-489b-8b94-28b74e935c1e" status: 200 len: 1319 microversion: 2.1 time: 1.342278 Oct 05 02:39:18.007161 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1399/2828] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:16 2022] GET /compute/v2.1/servers/de6a6594-881f-489b-8b94-28b74e935c1e => generated 1319 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:18.047602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-0c948802-9796-45c4-8ffd-5e9d7479d5cc req-fb8637d6-3adf-488e-b593-9f9e8946c735 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfc7f734-b4e9-4709-a1f1-c5823297e9ab", "tag": "0d0d9bb6-c453-456f-80e7-521b78eeadc7"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:39:18.103263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-0c948802-9796-45c4-8ffd-5e9d7479d5cc req-fb8637d6-3adf-488e-b593-9f9e8946c735 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:18.109940 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-0c948802-9796-45c4-8ffd-5e9d7479d5cc req-fb8637d6-3adf-488e-b593-9f9e8946c735 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:18.114951 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-0c948802-9796-45c4-8ffd-5e9d7479d5cc req-fb8637d6-3adf-488e-b593-9f9e8946c735 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:18.183201 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-0c948802-9796-45c4-8ffd-5e9d7479d5cc req-fb8637d6-3adf-488e-b593-9f9e8946c735 service nova] Creating event network-changed:0d0d9bb6-c453-456f-80e7-521b78eeadc7 for instance dfc7f734-b4e9-4709-a1f1-c5823297e9ab on n-h2-858272-3 Oct 05 02:39:18.203438 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-0c948802-9796-45c4-8ffd-5e9d7479d5cc req-fb8637d6-3adf-488e-b593-9f9e8946c735 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158754 Oct 05 02:39:18.204371 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1400/2829] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:39:18.228321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-717dc4db-8469-4ca4-bf6c-8b42b5f85b29 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:18.229073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-717dc4db-8469-4ca4-bf6c-8b42b5f85b29 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:18.254542 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-717dc4db-8469-4ca4-bf6c-8b42b5f85b29 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:18.255291 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-717dc4db-8469-4ca4-bf6c-8b42b5f85b29 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:18.257622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-717dc4db-8469-4ca4-bf6c-8b42b5f85b29 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:18.260413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-717dc4db-8469-4ca4-bf6c-8b42b5f85b29 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:18.265557 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-717dc4db-8469-4ca4-bf6c-8b42b5f85b29 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:18.265998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-717dc4db-8469-4ca4-bf6c-8b42b5f85b29 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:18.563969 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-717dc4db-8469-4ca4-bf6c-8b42b5f85b29 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:18.573816 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-717dc4db-8469-4ca4-bf6c-8b42b5f85b29 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:18.575361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-717dc4db-8469-4ca4-bf6c-8b42b5f85b29 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:18.576757 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-717dc4db-8469-4ca4-bf6c-8b42b5f85b29 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1739 microversion: 2.20 time: 0.362915 Oct 05 02:39:18.577828 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1401/2830] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:39:18 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1739 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:39:18.582999 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c4d3e319-60b9-4368-b2d0-02c7616c4da7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-107123759", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:39:23.116361 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:39:23.636129 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=16 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:39:28.573986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=63 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:39:28.627230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=66 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:39:30.603657 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0f55287a-4629-4a4b-873f-fc04e05dae49 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/6cf12e10-7a03-442e-b35f-02965febd7bd" status: 200 len: 1437 microversion: 2.1 time: 16.922002 Oct 05 02:39:30.607472 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1430/2831] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:39:13 2022] GET /compute/v2.1/images/6cf12e10-7a03-442e-b35f-02965febd7bd => generated 1437 bytes in 16927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:30.613336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-c4d3e319-60b9-4368-b2d0-02c7616c4da7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] validate_networks() for None {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:39:30.624577 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-13dbb932-ef55-45df-b818-f620bfda43c0 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:30.625675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-13dbb932-ef55-45df-b818-f620bfda43c0 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] [instance: dfc7f734-b4e9-4709-a1f1-c5823297e9ab] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:30.642650 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13dbb932-ef55-45df-b818-f620bfda43c0 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:30.643443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13dbb932-ef55-45df-b818-f620bfda43c0 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:30.644098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13dbb932-ef55-45df-b818-f620bfda43c0 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:30.645053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13dbb932-ef55-45df-b818-f620bfda43c0 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:30.645876 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13dbb932-ef55-45df-b818-f620bfda43c0 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:30.647072 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13dbb932-ef55-45df-b818-f620bfda43c0 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:31.111375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-13dbb932-ef55-45df-b818-f620bfda43c0 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58f274a86f44352820c63496788f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7cf219232d24bd0adae8ac00e570010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:31.128594 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-13dbb932-ef55-45df-b818-f620bfda43c0 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] 10.222.0.16 "GET /compute/v2.1/servers/dfc7f734-b4e9-4709-a1f1-c5823297e9ab" status: 200 len: 1324 microversion: 2.1 time: 0.517326 Oct 05 02:39:31.138712 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1431/2832] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:30 2022] GET /compute/v2.1/servers/dfc7f734-b4e9-4709-a1f1-c5823297e9ab => generated 1324 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:31.151956 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6bf8ec68-0232-4dbb-bb27-d6580f82fad6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:31.152782 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6bf8ec68-0232-4dbb-bb27-d6580f82fad6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: de6a6594-881f-489b-8b94-28b74e935c1e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:31.173997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6bf8ec68-0232-4dbb-bb27-d6580f82fad6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:31.174506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6bf8ec68-0232-4dbb-bb27-d6580f82fad6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:31.174948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6bf8ec68-0232-4dbb-bb27-d6580f82fad6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:31.183644 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6bf8ec68-0232-4dbb-bb27-d6580f82fad6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:31.189023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6bf8ec68-0232-4dbb-bb27-d6580f82fad6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:31.190077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6bf8ec68-0232-4dbb-bb27-d6580f82fad6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:31.243070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-c4d3e319-60b9-4368-b2d0-02c7616c4da7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:39:31.243498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-c4d3e319-60b9-4368-b2d0-02c7616c4da7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:39:31.244122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-c4d3e319-60b9-4368-b2d0-02c7616c4da7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:39:31.244550 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-c4d3e319-60b9-4368-b2d0-02c7616c4da7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:39:31.245140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-c4d3e319-60b9-4368-b2d0-02c7616c4da7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:39:31.267623 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4d3e319-60b9-4368-b2d0-02c7616c4da7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:31.270934 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4d3e319-60b9-4368-b2d0-02c7616c4da7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:31.281397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4d3e319-60b9-4368-b2d0-02c7616c4da7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:31.282650 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4d3e319-60b9-4368-b2d0-02c7616c4da7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:31.283362 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4d3e319-60b9-4368-b2d0-02c7616c4da7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:31.284003 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4d3e319-60b9-4368-b2d0-02c7616c4da7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:31.338651 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-c4d3e319-60b9-4368-b2d0-02c7616c4da7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Getting quotas for project 446a33968038476fbc98fc0b6b1795c0. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:39:31.366685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-c4d3e319-60b9-4368-b2d0-02c7616c4da7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Getting quotas for user 1b4b5f0c43074932a8963727adfee38a and project 446a33968038476fbc98fc0b6b1795c0. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:39:31.405738 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c4d3e319-60b9-4368-b2d0-02c7616c4da7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:39:31.408682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c4d3e319-60b9-4368-b2d0-02c7616c4da7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:39:31.558723 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6bf8ec68-0232-4dbb-bb27-d6580f82fad6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:31.577580 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c4d3e319-60b9-4368-b2d0-02c7616c4da7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 12.997118 Oct 05 02:39:31.577831 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6bf8ec68-0232-4dbb-bb27-d6580f82fad6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/de6a6594-881f-489b-8b94-28b74e935c1e" status: 200 len: 1468 microversion: 2.1 time: 0.435101 Oct 05 02:39:31.578325 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1432/2833] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:31 2022] GET /compute/v2.1/servers/de6a6594-881f-489b-8b94-28b74e935c1e => generated 1468 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:31.579358 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1402/2834] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:39:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 13001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:39:31.585662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-1e154975-9b97-4731-bf79-7f63a838a25b req-abe074fc-6eab-44a3-b3db-13811d6f6a81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfc7f734-b4e9-4709-a1f1-c5823297e9ab", "name": "network-vif-plugged", "status": "completed", "tag": "0d0d9bb6-c453-456f-80e7-521b78eeadc7"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:39:31.602980 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e8eb6597-a52b-4212-9026-2ffe50e7ff82 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:31.622300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e8eb6597-a52b-4212-9026-2ffe50e7ff82 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:31.630382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1e154975-9b97-4731-bf79-7f63a838a25b req-abe074fc-6eab-44a3-b3db-13811d6f6a81 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:31.632519 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1e154975-9b97-4731-bf79-7f63a838a25b req-abe074fc-6eab-44a3-b3db-13811d6f6a81 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:31.634324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1e154975-9b97-4731-bf79-7f63a838a25b req-abe074fc-6eab-44a3-b3db-13811d6f6a81 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:31.648831 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8eb6597-a52b-4212-9026-2ffe50e7ff82 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:31.649673 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8eb6597-a52b-4212-9026-2ffe50e7ff82 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:31.651148 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8eb6597-a52b-4212-9026-2ffe50e7ff82 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:31.655075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8eb6597-a52b-4212-9026-2ffe50e7ff82 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:31.657378 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8eb6597-a52b-4212-9026-2ffe50e7ff82 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:31.661460 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8eb6597-a52b-4212-9026-2ffe50e7ff82 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:31.675186 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-1e154975-9b97-4731-bf79-7f63a838a25b req-abe074fc-6eab-44a3-b3db-13811d6f6a81 service nova] Creating event network-vif-plugged:0d0d9bb6-c453-456f-80e7-521b78eeadc7 for instance dfc7f734-b4e9-4709-a1f1-c5823297e9ab on n-h2-858272-3 Oct 05 02:39:31.682268 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-1e154975-9b97-4731-bf79-7f63a838a25b req-abe074fc-6eab-44a3-b3db-13811d6f6a81 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101296 Oct 05 02:39:31.690900 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1403/2835] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:39:31.698818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bf2aa30d-2abc-4691-823f-a41bc51933dc tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fcce8282d30>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:31.820036 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bf2aa30d-2abc-4691-823f-a41bc51933dc tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/images/6cf12e10-7a03-442e-b35f-02965febd7bd" status: 200 len: 1437 microversion: 2.1 time: 0.127527 Oct 05 02:39:31.831662 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1404/2836] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:39:31 2022] GET /compute/v2.1/images/6cf12e10-7a03-442e-b35f-02965febd7bd => generated 1437 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:31.838628 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1d77a57e-f156-478f-a052-ad12d8f871ce tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:31.839665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1d77a57e-f156-478f-a052-ad12d8f871ce tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:32.030341 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1d77a57e-f156-478f-a052-ad12d8f871ce tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:32.074422 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1d77a57e-f156-478f-a052-ad12d8f871ce tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1212 microversion: 2.1 time: 0.232661 Oct 05 02:39:32.075543 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1405/2837] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:31 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1212 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:32.098024 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-35988c2e-d8eb-4d15-83c1-d3436f2bc0c2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:32.127388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-35988c2e-d8eb-4d15-83c1-d3436f2bc0c2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:32.129505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-35988c2e-d8eb-4d15-83c1-d3436f2bc0c2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Searching by: {'reservation_id': 'r-pr2e88y7', 'deleted': False, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6'} {{(pid=122319) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:39:32.156008 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35988c2e-d8eb-4d15-83c1-d3436f2bc0c2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:32.156514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35988c2e-d8eb-4d15-83c1-d3436f2bc0c2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:32.156989 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35988c2e-d8eb-4d15-83c1-d3436f2bc0c2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:32.157736 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35988c2e-d8eb-4d15-83c1-d3436f2bc0c2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:32.163537 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35988c2e-d8eb-4d15-83c1-d3436f2bc0c2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:32.164757 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35988c2e-d8eb-4d15-83c1-d3436f2bc0c2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:32.500109 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.multi_cell_list [None req-35988c2e-d8eb-4d15-83c1-d3436f2bc0c2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122319) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:39:32.502960 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e8eb6597-a52b-4212-9026-2ffe50e7ff82 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:32.519316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e8eb6597-a52b-4212-9026-2ffe50e7ff82 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:32.527758 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e8eb6597-a52b-4212-9026-2ffe50e7ff82 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:32.534563 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e8eb6597-a52b-4212-9026-2ffe50e7ff82 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1739 microversion: 2.20 time: 0.955183 Oct 05 02:39:32.535210 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1433/2838] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:39:31 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1739 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:39:32.549035 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7177ee60-364e-4de2-9c0b-38fa06b29e92 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:32.562880 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7177ee60-364e-4de2-9c0b-38fa06b29e92 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] [instance: 74b1ab94-3bc0-440d-bf57-dcab444e063d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:32.578572 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7177ee60-364e-4de2-9c0b-38fa06b29e92 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:32.585548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7177ee60-364e-4de2-9c0b-38fa06b29e92 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:32.585994 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7177ee60-364e-4de2-9c0b-38fa06b29e92 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:32.586721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7177ee60-364e-4de2-9c0b-38fa06b29e92 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:32.587179 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7177ee60-364e-4de2-9c0b-38fa06b29e92 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:32.587600 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7177ee60-364e-4de2-9c0b-38fa06b29e92 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:32.735781 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-35988c2e-d8eb-4d15-83c1-d3436f2bc0c2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:32.748410 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35988c2e-d8eb-4d15-83c1-d3436f2bc0c2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:32.758515 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35988c2e-d8eb-4d15-83c1-d3436f2bc0c2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:32.759017 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35988c2e-d8eb-4d15-83c1-d3436f2bc0c2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:33.088528 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7177ee60-364e-4de2-9c0b-38fa06b29e92 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d55412129f24e90b1caa99b3aea8c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be31ec89b1354d608d7de438f5cf519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:33.107348 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7177ee60-364e-4de2-9c0b-38fa06b29e92 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d" status: 200 len: 1465 microversion: 2.1 time: 0.571092 Oct 05 02:39:33.108124 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1434/2839] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:32 2022] GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d => generated 1465 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:33.120408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0b9213fb-9ede-4233-90a0-bdacedc4a4ff tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:33.130104 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0b9213fb-9ede-4233-90a0-bdacedc4a4ff tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] [instance: dfc7f734-b4e9-4709-a1f1-c5823297e9ab] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:33.151542 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b9213fb-9ede-4233-90a0-bdacedc4a4ff tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:33.151736 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-35988c2e-d8eb-4d15-83c1-d3436f2bc0c2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?reservation_id=r-pr2e88y7" status: 200 len: 2929 microversion: 2.1 time: 1.074865 Oct 05 02:39:33.152440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b9213fb-9ede-4233-90a0-bdacedc4a4ff tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:33.152673 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1406/2840] 10.222.0.16 () {58 vars in 1197 bytes} [Wed Oct 5 02:39:32 2022] GET /compute/v2.1/servers/detail?reservation_id=r-pr2e88y7 => generated 2929 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:33.153674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b9213fb-9ede-4233-90a0-bdacedc4a4ff tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:33.154738 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b9213fb-9ede-4233-90a0-bdacedc4a4ff tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:33.155361 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b9213fb-9ede-4233-90a0-bdacedc4a4ff tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:33.155961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b9213fb-9ede-4233-90a0-bdacedc4a4ff tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:33.163237 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1a360876-f0fe-44ae-8df7-0545b807a5bf tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:33.165329 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1a360876-f0fe-44ae-8df7-0545b807a5bf tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:33.207102 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a360876-f0fe-44ae-8df7-0545b807a5bf tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:33.214607 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a360876-f0fe-44ae-8df7-0545b807a5bf tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:33.214607 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a360876-f0fe-44ae-8df7-0545b807a5bf tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:33.219233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a360876-f0fe-44ae-8df7-0545b807a5bf tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:33.222064 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a360876-f0fe-44ae-8df7-0545b807a5bf tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:33.225541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a360876-f0fe-44ae-8df7-0545b807a5bf tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:33.675411 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1a360876-f0fe-44ae-8df7-0545b807a5bf tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:33.685430 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1a360876-f0fe-44ae-8df7-0545b807a5bf tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1208 microversion: 2.1 time: 0.530857 Oct 05 02:39:33.697013 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1407/2841] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:33 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1208 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:33.707048 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ed95aaf0-d9c3-4c82-8c29-601c0953952c tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fcce43a2c10>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:33.732491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0b9213fb-9ede-4233-90a0-bdacedc4a4ff tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58f274a86f44352820c63496788f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7cf219232d24bd0adae8ac00e570010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:33.752957 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0b9213fb-9ede-4233-90a0-bdacedc4a4ff tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] 10.222.0.16 "GET /compute/v2.1/servers/dfc7f734-b4e9-4709-a1f1-c5823297e9ab" status: 200 len: 1324 microversion: 2.1 time: 0.641769 Oct 05 02:39:33.754950 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1435/2842] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:33 2022] GET /compute/v2.1/servers/dfc7f734-b4e9-4709-a1f1-c5823297e9ab => generated 1324 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:33.773255 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e3de41f9-e3bf-4a08-a4d1-52d51acff8fa tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:33.809050 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.compute.server_groups [None req-e3de41f9-e3bf-4a08-a4d1-52d51acff8fa tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Querying cell d1723b23-1631-4a56-b9ad-72e4c39197cb(cell1) for 2 instances {{(pid=122320) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 05 02:39:33.811695 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e3de41f9-e3bf-4a08-a4d1-52d51acff8fa tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:33.812360 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e3de41f9-e3bf-4a08-a4d1-52d51acff8fa tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:33.813011 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e3de41f9-e3bf-4a08-a4d1-52d51acff8fa tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:34.363083 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e3de41f9-e3bf-4a08-a4d1-52d51acff8fa tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/8204c863-c4a9-45b5-80b6-8a22caf9efc6" status: 200 len: 271 microversion: 2.1 time: 0.606093 Oct 05 02:39:34.365642 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1436/2843] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 5 02:39:33 2022] GET /compute/v2.1/os-server-groups/8204c863-c4a9-45b5-80b6-8a22caf9efc6 => generated 271 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:39:34.374490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f62a6046-aeef-4aa4-b978-5781be8d3312 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:34.380018 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f62a6046-aeef-4aa4-b978-5781be8d3312 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:34.416858 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f62a6046-aeef-4aa4-b978-5781be8d3312 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:34.425032 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f62a6046-aeef-4aa4-b978-5781be8d3312 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:34.425685 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f62a6046-aeef-4aa4-b978-5781be8d3312 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:34.430180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f62a6046-aeef-4aa4-b978-5781be8d3312 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:34.430876 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f62a6046-aeef-4aa4-b978-5781be8d3312 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:34.433802 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f62a6046-aeef-4aa4-b978-5781be8d3312 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:34.816414 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ed95aaf0-d9c3-4c82-8c29-601c0953952c tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "DELETE /compute/v2.1/images/6cf12e10-7a03-442e-b35f-02965febd7bd" status: 204 len: 0 microversion: 2.1 time: 1.119785 Oct 05 02:39:34.817314 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1408/2844] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:33 2022] DELETE /compute/v2.1/images/6cf12e10-7a03-442e-b35f-02965febd7bd => generated 0 bytes in 1122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:39:34.822857 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ec6d03b6-af9d-422d-bde6-158e1f3adf84 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:34.823487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ec6d03b6-af9d-422d-bde6-158e1f3adf84 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] [instance: 37204911-40f0-4356-a6df-7fda8afbf5da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:34.836830 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec6d03b6-af9d-422d-bde6-158e1f3adf84 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:34.837380 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec6d03b6-af9d-422d-bde6-158e1f3adf84 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:34.837820 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec6d03b6-af9d-422d-bde6-158e1f3adf84 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:34.838545 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec6d03b6-af9d-422d-bde6-158e1f3adf84 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:34.839011 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec6d03b6-af9d-422d-bde6-158e1f3adf84 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:34.839431 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec6d03b6-af9d-422d-bde6-158e1f3adf84 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:35.643867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f62a6046-aeef-4aa4-b978-5781be8d3312 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:35.664937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f62a6046-aeef-4aa4-b978-5781be8d3312 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:35.666659 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f62a6046-aeef-4aa4-b978-5781be8d3312 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:35.668645 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f62a6046-aeef-4aa4-b978-5781be8d3312 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1721 microversion: 2.20 time: 1.301880 Oct 05 02:39:35.669250 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1437/2845] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:39:34 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1721 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:39:35.681735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-39821b0d-f0c8-4296-b6d4-f4481bee3295 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:35.682572 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-39821b0d-f0c8-4296-b6d4-f4481bee3295 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:35.690547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-39821b0d-f0c8-4296-b6d4-f4481bee3295 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:35.691183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-39821b0d-f0c8-4296-b6d4-f4481bee3295 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:35.691492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-39821b0d-f0c8-4296-b6d4-f4481bee3295 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:35.692197 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-39821b0d-f0c8-4296-b6d4-f4481bee3295 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:35.693962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-39821b0d-f0c8-4296-b6d4-f4481bee3295 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:35.694629 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-39821b0d-f0c8-4296-b6d4-f4481bee3295 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:35.772949 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ec6d03b6-af9d-422d-bde6-158e1f3adf84 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da" status: 200 len: 1619 microversion: 2.1 time: 0.954233 Oct 05 02:39:35.774257 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1409/2846] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:34 2022] GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da => generated 1619 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:35.781434 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7960c0c5-b2c0-4f71-9b8d-dfa5755aaa01 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:35.782557 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7960c0c5-b2c0-4f71-9b8d-dfa5755aaa01 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] [instance: dfc7f734-b4e9-4709-a1f1-c5823297e9ab] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:35.797751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7960c0c5-b2c0-4f71-9b8d-dfa5755aaa01 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:35.798803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7960c0c5-b2c0-4f71-9b8d-dfa5755aaa01 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:35.799405 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7960c0c5-b2c0-4f71-9b8d-dfa5755aaa01 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:35.801613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7960c0c5-b2c0-4f71-9b8d-dfa5755aaa01 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:35.802255 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7960c0c5-b2c0-4f71-9b8d-dfa5755aaa01 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:35.803467 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7960c0c5-b2c0-4f71-9b8d-dfa5755aaa01 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:35.810251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-39821b0d-f0c8-4296-b6d4-f4481bee3295 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:35.822140 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-39821b0d-f0c8-4296-b6d4-f4481bee3295 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1270 microversion: 2.1 time: 0.148858 Oct 05 02:39:35.827177 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1438/2847] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:35 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1270 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:35.836702 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-42b4b2a0-73c6-4e13-8b08-a97d4b0cb09a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '.version_select at 0x7fccdf3e2e50>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:35.876276 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-42b4b2a0-73c6-4e13-8b08-a97d4b0cb09a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] HTTP exception thrown: Image not found. Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-42b4b2a0-73c6-4e13-8b08-a97d4b0cb09a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Request method failure captured: Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700 HTTP/1.1 Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO4AOxJFWFelW5NIzv1D-2Oz8BlVYw3CEbOJqfQC-WEd3nfoNXQZy_9hWcXNogpU0zWAQr1pT64EgC-FdlsP5SuxtekgsZqh1L5JaZKowSuAPMix2YWcSuuzP5LwhGMSp6UpRWXCu00Ize6TsJ6KktyTp8zfDKWqY91b17Mp2NHIblg Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: be31ec89b1354d608d7de438f5cf519d Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ImagesOneServerTestJSON-1624949803 Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/be31ec89b1354d608d7de438f5cf519d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/be31ec89b1354d608d7de438f5cf519d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/be31ec89b1354d608d7de438f5cf519d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_be31ec89b1354d608d7de438f5cf519d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ImagesOneServerTestJSON-1624949803 Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: be31ec89b1354d608d7de438f5cf519d Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1624949803 Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ImagesOneServerTestJSON-1624949803-project Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 2d55412129f24e90b1caa99b3aea8c61 Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ImagesOneServerTestJSON-1624949803-project Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: exception: Image not found. Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'abd9bd09-3095-4849-9e71-e3bf8e10f700'} Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image abd9bd09-3095-4849-9e71-e3bf8e10f700 to delete Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image abd9bd09-3095-4849-9e71-e3bf8e10f700 could not be found. Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:39:35.878111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:39:35.882285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:39:35.882285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:39:35.882285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:39:35.882285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:39:35.882285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:39:35.882285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:39:35.882285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:39:35.882285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:39:35.882285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 05 02:39:35.882285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 05 02:39:35.882285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 02:39:35.882285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:39:35.882285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:39:35.882285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:39:35.882285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:39:35.882285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:39:35.882285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:39:35.882285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:39:35.882285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:39:35.882285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 02:39:35.882285 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:39:35.882285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-42b4b2a0-73c6-4e13-8b08-a97d4b0cb09a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Returning 404 to user: Image not found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:39:35.882285 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-42b4b2a0-73c6-4e13-8b08-a97d4b0cb09a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "DELETE /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700" status: 404 len: 62 microversion: 2.1 time: 0.051039 Oct 05 02:39:35.888521 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1439/2848] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:35 2022] DELETE /compute/v2.1/images/abd9bd09-3095-4849-9e71-e3bf8e10f700 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:39:35.897506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-68e2e1d0-8ead-49aa-a905-23eeca6f0fe6 req-b4145adf-857a-4532-83c6-e954b287c7e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74b1ab94-3bc0-440d-bf57-dcab444e063d", "name": "network-vif-unplugged", "status": "completed", "tag": "f76faa20-bd22-4858-915c-478dc55b243d"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:39:35.909120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-68e2e1d0-8ead-49aa-a905-23eeca6f0fe6 req-b4145adf-857a-4532-83c6-e954b287c7e4 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:35.909564 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-68e2e1d0-8ead-49aa-a905-23eeca6f0fe6 req-b4145adf-857a-4532-83c6-e954b287c7e4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:35.910064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-68e2e1d0-8ead-49aa-a905-23eeca6f0fe6 req-b4145adf-857a-4532-83c6-e954b287c7e4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:35.925682 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-68e2e1d0-8ead-49aa-a905-23eeca6f0fe6 req-b4145adf-857a-4532-83c6-e954b287c7e4 service nova] Creating event network-vif-unplugged:f76faa20-bd22-4858-915c-478dc55b243d for instance 74b1ab94-3bc0-440d-bf57-dcab444e063d on n-h1-858272-3 Oct 05 02:39:35.931572 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-68e2e1d0-8ead-49aa-a905-23eeca6f0fe6 req-b4145adf-857a-4532-83c6-e954b287c7e4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041576 Oct 05 02:39:35.932762 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1440/2849] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:39:36.116690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e8085a40-658f-425a-aac3-58294084dde0 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1820532857", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "eb997f6c-1603-48e6-8298-cfba3d8cb6a1"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:39:36.192775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-e8085a40-658f-425a-aac3-58294084dde0 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] validate_networks() for [('eb997f6c-1603-48e6-8298-cfba3d8cb6a1', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:39:36.228229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7960c0c5-b2c0-4f71-9b8d-dfa5755aaa01 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58f274a86f44352820c63496788f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7cf219232d24bd0adae8ac00e570010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:36.237790 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7960c0c5-b2c0-4f71-9b8d-dfa5755aaa01 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] 10.222.0.16 "GET /compute/v2.1/servers/dfc7f734-b4e9-4709-a1f1-c5823297e9ab" status: 200 len: 1520 microversion: 2.1 time: 0.462063 Oct 05 02:39:36.239094 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1410/2850] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:35 2022] GET /compute/v2.1/servers/dfc7f734-b4e9-4709-a1f1-c5823297e9ab => generated 1520 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:36.257327 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e98efdf8-5990-4912-a530-7e1eccedaf1c tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:36.261542 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e98efdf8-5990-4912-a530-7e1eccedaf1c tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] [instance: de6a6594-881f-489b-8b94-28b74e935c1e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:36.274974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e98efdf8-5990-4912-a530-7e1eccedaf1c tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:36.275488 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e98efdf8-5990-4912-a530-7e1eccedaf1c tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:36.280019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e98efdf8-5990-4912-a530-7e1eccedaf1c tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:36.280940 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e98efdf8-5990-4912-a530-7e1eccedaf1c tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:36.281719 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e98efdf8-5990-4912-a530-7e1eccedaf1c tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:36.282181 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e98efdf8-5990-4912-a530-7e1eccedaf1c tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:36.743171 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e98efdf8-5990-4912-a530-7e1eccedaf1c tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/de6a6594-881f-489b-8b94-28b74e935c1e" status: 200 len: 1619 microversion: 2.1 time: 0.500056 Oct 05 02:39:36.756940 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1411/2851] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:36 2022] GET /compute/v2.1/servers/de6a6594-881f-489b-8b94-28b74e935c1e => generated 1619 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:36.756940 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9fa25b09-fa4a-4c3f-8b6d-2124f4e8764f tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:36.756940 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9fa25b09-fa4a-4c3f-8b6d-2124f4e8764f tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] [instance: 74b1ab94-3bc0-440d-bf57-dcab444e063d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:36.771179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9fa25b09-fa4a-4c3f-8b6d-2124f4e8764f tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:36.771179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9fa25b09-fa4a-4c3f-8b6d-2124f4e8764f tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:36.771179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9fa25b09-fa4a-4c3f-8b6d-2124f4e8764f tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:36.771179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9fa25b09-fa4a-4c3f-8b6d-2124f4e8764f tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:36.771179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9fa25b09-fa4a-4c3f-8b6d-2124f4e8764f tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:36.772192 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9fa25b09-fa4a-4c3f-8b6d-2124f4e8764f tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:36.857659 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9fa25b09-fa4a-4c3f-8b6d-2124f4e8764f tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] [instance: 74b1ab94-3bc0-440d-bf57-dcab444e063d] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:39:37.002124 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9fa25b09-fa4a-4c3f-8b6d-2124f4e8764f tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "DELETE /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d" status: 204 len: 0 microversion: 2.1 time: 0.252601 Oct 05 02:39:37.003421 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1412/2852] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:39:36 2022] DELETE /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:39:37.013528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7ec56a70-0d51-40f7-88b6-a60c644022c2 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:37.014656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7ec56a70-0d51-40f7-88b6-a60c644022c2 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] [instance: dfc7f734-b4e9-4709-a1f1-c5823297e9ab] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:37.027564 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ec56a70-0d51-40f7-88b6-a60c644022c2 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:37.029153 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ec56a70-0d51-40f7-88b6-a60c644022c2 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:37.030198 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ec56a70-0d51-40f7-88b6-a60c644022c2 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:37.031306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ec56a70-0d51-40f7-88b6-a60c644022c2 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:37.033264 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ec56a70-0d51-40f7-88b6-a60c644022c2 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:37.034034 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ec56a70-0d51-40f7-88b6-a60c644022c2 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:37.065757 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-7ec56a70-0d51-40f7-88b6-a60c644022c2 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] HTTP exception thrown: Instance is not a member of specified network Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7ec56a70-0d51-40f7-88b6-a60c644022c2 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Request method failure captured: Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/dfc7f734-b4e9-4709-a1f1-c5823297e9ab/ips/invalid HTTP/1.1 Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO5DDIGBToqaRhl31jTg8oeor9gJQrbPlsu2utPiXocA7YJtK3_RbFMEESi4BH8vvf_MN4PYvesisQkAF1LdMat3S54rd-HUENbfuglPLbWlgn_wklL5aEJa8CA5KcKUmHCjO_fZxweLg46pjiOYDPA7SsSbUcnipv17V6YxL94sBoA Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: e7cf219232d24bd0adae8ac00e570010 Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-301928336 Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e7cf219232d24bd0adae8ac00e570010"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e7cf219232d24bd0adae8ac00e570010"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e7cf219232d24bd0adae8ac00e570010"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e7cf219232d24bd0adae8ac00e570010"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-301928336 Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: e7cf219232d24bd0adae8ac00e570010 Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-301928336 Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerAddressesNegativeTestJSON-301928336-project Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: b58f274a86f44352820c63496788f9db Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-301928336-project Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance is not a member of specified network Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'server_id': 'dfc7f734-b4e9-4709-a1f1-c5823297e9ab', 'id': 'invalid'} Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 05 02:39:37.074275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:39:37.078769 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7ec56a70-0d51-40f7-88b6-a60c644022c2 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Returning 404 to user: Instance is not a member of specified network {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:39:37.078769 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7ec56a70-0d51-40f7-88b6-a60c644022c2 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] 10.222.0.16 "GET /compute/v2.1/servers/dfc7f734-b4e9-4709-a1f1-c5823297e9ab/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.070732 Oct 05 02:39:37.078769 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1413/2853] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:39:37 2022] GET /compute/v2.1/servers/dfc7f734-b4e9-4709-a1f1-c5823297e9ab/ips/invalid => generated 91 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:39:37.089684 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f1d5f53b-c27d-44c5-a7c0-469d7efe9aa2 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:37.092754 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f1d5f53b-c27d-44c5-a7c0-469d7efe9aa2 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:37.110710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f1d5f53b-c27d-44c5-a7c0-469d7efe9aa2 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:37.111667 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f1d5f53b-c27d-44c5-a7c0-469d7efe9aa2 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:37.113729 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f1d5f53b-c27d-44c5-a7c0-469d7efe9aa2 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:37.114765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f1d5f53b-c27d-44c5-a7c0-469d7efe9aa2 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:37.115598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f1d5f53b-c27d-44c5-a7c0-469d7efe9aa2 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:37.116001 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f1d5f53b-c27d-44c5-a7c0-469d7efe9aa2 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:37.317892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-e8085a40-658f-425a-aac3-58294084dde0 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:39:37.318931 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-e8085a40-658f-425a-aac3-58294084dde0 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:39:37.319353 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-e8085a40-658f-425a-aac3-58294084dde0 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:39:37.319769 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-e8085a40-658f-425a-aac3-58294084dde0 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:39:37.320196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-e8085a40-658f-425a-aac3-58294084dde0 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:39:37.333552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8085a40-658f-425a-aac3-58294084dde0 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:37.334825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8085a40-658f-425a-aac3-58294084dde0 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:37.335429 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8085a40-658f-425a-aac3-58294084dde0 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:37.336367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8085a40-658f-425a-aac3-58294084dde0 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:37.337651 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8085a40-658f-425a-aac3-58294084dde0 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:37.338638 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8085a40-658f-425a-aac3-58294084dde0 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:37.363678 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-e8085a40-658f-425a-aac3-58294084dde0 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Getting quotas for project 9160b32c651a43f784bbe95a0e49059c. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:39:37.371358 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-e8085a40-658f-425a-aac3-58294084dde0 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Getting quotas for user dbe30121065f4906b43c3c48888d88a8 and project 9160b32c651a43f784bbe95a0e49059c. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:39:37.387509 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e8085a40-658f-425a-aac3-58294084dde0 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Going to run 2 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:39:37.390763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e8085a40-658f-425a-aac3-58294084dde0 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 15bedd7a-7fb7-40e2-bf87-729192d754aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:39:37.441575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e8085a40-658f-425a-aac3-58294084dde0 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 36a8024b-dab8-454c-bcc3-65dcba09bbc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=15bedd7a-7fb7-40e2-bf87-729192d754aa,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:39:37.542951 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e8085a40-658f-425a-aac3-58294084dde0 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.608666 Oct 05 02:39:37.546619 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1441/2854] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:39:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:39:37.575913 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-23fc685d-bbc5-4555-915d-18bcb4d93868 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:37.577760 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-23fc685d-bbc5-4555-915d-18bcb4d93868 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:37.611951 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f1d5f53b-c27d-44c5-a7c0-469d7efe9aa2 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:37.613538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23fc685d-bbc5-4555-915d-18bcb4d93868 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:37.614053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23fc685d-bbc5-4555-915d-18bcb4d93868 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:37.614499 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23fc685d-bbc5-4555-915d-18bcb4d93868 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:37.615261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23fc685d-bbc5-4555-915d-18bcb4d93868 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:37.615725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23fc685d-bbc5-4555-915d-18bcb4d93868 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:37.618586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23fc685d-bbc5-4555-915d-18bcb4d93868 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:37.645020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f1d5f53b-c27d-44c5-a7c0-469d7efe9aa2 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:37.649100 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f1d5f53b-c27d-44c5-a7c0-469d7efe9aa2 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:37.652120 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f1d5f53b-c27d-44c5-a7c0-469d7efe9aa2 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1721 microversion: 2.20 time: 0.574406 Oct 05 02:39:37.657776 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1414/2855] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:39:37 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1721 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:39:37.676492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-440125ff-add8-4206-ac4f-204cbc049edb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1528971096", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "6b01f092-c99b-4a47-bdcb-3b6bcdeb0323"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:39:37.807310 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-440125ff-add8-4206-ac4f-204cbc049edb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] validate_networks() for None {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:39:38.136364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-23fc685d-bbc5-4555-915d-18bcb4d93868 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:38.148941 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-23fc685d-bbc5-4555-915d-18bcb4d93868 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1312 microversion: 2.1 time: 0.600118 Oct 05 02:39:38.166576 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1442/2856] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:37 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1312 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:38.181802 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-17ddffcc-2866-4827-aa2b-91b772f51d76 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:38.185288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-17ddffcc-2866-4827-aa2b-91b772f51d76 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] [instance: 74b1ab94-3bc0-440d-bf57-dcab444e063d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:38.196240 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17ddffcc-2866-4827-aa2b-91b772f51d76 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:38.196977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17ddffcc-2866-4827-aa2b-91b772f51d76 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:38.197532 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17ddffcc-2866-4827-aa2b-91b772f51d76 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:38.198361 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17ddffcc-2866-4827-aa2b-91b772f51d76 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:38.199264 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17ddffcc-2866-4827-aa2b-91b772f51d76 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:38.200573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17ddffcc-2866-4827-aa2b-91b772f51d76 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:38.261683 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-440125ff-add8-4206-ac4f-204cbc049edb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:39:38.262263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-440125ff-add8-4206-ac4f-204cbc049edb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:39:38.263035 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-440125ff-add8-4206-ac4f-204cbc049edb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:39:38.263553 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-440125ff-add8-4206-ac4f-204cbc049edb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:39:38.264074 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-440125ff-add8-4206-ac4f-204cbc049edb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:39:38.278463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-440125ff-add8-4206-ac4f-204cbc049edb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:38.281705 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-440125ff-add8-4206-ac4f-204cbc049edb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:38.282338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-440125ff-add8-4206-ac4f-204cbc049edb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:38.286073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-440125ff-add8-4206-ac4f-204cbc049edb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:38.287694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-440125ff-add8-4206-ac4f-204cbc049edb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:38.289383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-440125ff-add8-4206-ac4f-204cbc049edb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:38.340454 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-440125ff-add8-4206-ac4f-204cbc049edb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:39:38.359212 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-440125ff-add8-4206-ac4f-204cbc049edb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for user b86e3b7d1c9a4b2c8f2914beefa74cc1 and project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:39:38.397512 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-440125ff-add8-4206-ac4f-204cbc049edb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:39:38.399778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-440125ff-add8-4206-ac4f-204cbc049edb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 057410e8-9ca0-477a-adec-60a7f9d7832d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:39:38.507967 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-17ddffcc-2866-4827-aa2b-91b772f51d76 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d55412129f24e90b1caa99b3aea8c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be31ec89b1354d608d7de438f5cf519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:38.518247 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-17ddffcc-2866-4827-aa2b-91b772f51d76 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d" status: 200 len: 1471 microversion: 2.1 time: 0.350205 Oct 05 02:39:38.524012 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-440125ff-add8-4206-ac4f-204cbc049edb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.863125 Oct 05 02:39:38.530742 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1415/2857] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:39:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:39:38.534130 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1443/2858] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:38 2022] GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d => generated 1471 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:38.543465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e2b695ef-f0c4-4624-aa9f-2d32aa2fc3ee tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:38.550148 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e2b695ef-f0c4-4624-aa9f-2d32aa2fc3ee tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:38.553173 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f9c576d7-c373-4e6d-a82a-c3953481367e tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:38.557509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f9c576d7-c373-4e6d-a82a-c3953481367e tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Failed to fetch instance by id 999 {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 05 02:39:38.558092 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-f9c576d7-c373-4e6d-a82a-c3953481367e tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] HTTP exception thrown: Instance 999 could not be found. Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f9c576d7-c373-4e6d-a82a-c3953481367e tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Request method failure captured: Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO5DDIGBToqaRhl31jTg8oeor9gJQrbPlsu2utPiXocA7YJtK3_RbFMEESi4BH8vvf_MN4PYvesisQkAF1LdMat3S54rd-HUENbfuglPLbWlgn_wklL5aEJa8CA5KcKUmHCjO_fZxweLg46pjiOYDPA7SsSbUcnipv17V6YxL94sBoA Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: e7cf219232d24bd0adae8ac00e570010 Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-301928336 Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e7cf219232d24bd0adae8ac00e570010"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e7cf219232d24bd0adae8ac00e570010"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e7cf219232d24bd0adae8ac00e570010"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e7cf219232d24bd0adae8ac00e570010"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-301928336 Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: e7cf219232d24bd0adae8ac00e570010 Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-301928336 Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerAddressesNegativeTestJSON-301928336-project Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: b58f274a86f44352820c63496788f9db Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-301928336-project Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 999 could not be found. Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'server_id': '999'} Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 05 02:39:38.559593 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:39:38.569467 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f9c576d7-c373-4e6d-a82a-c3953481367e tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Returning 404 to user: Instance 999 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:39:38.569467 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f9c576d7-c373-4e6d-a82a-c3953481367e tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] 10.222.0.16 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.028895 Oct 05 02:39:38.569467 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1416/2859] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Oct 5 02:39:38 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:39:38.572061 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1c9601eb-b27c-4b55-96f5-8b5a902f63d3 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:38.572692 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1c9601eb-b27c-4b55-96f5-8b5a902f63d3 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 057410e8-9ca0-477a-adec-60a7f9d7832d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:38.580256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e2b695ef-f0c4-4624-aa9f-2d32aa2fc3ee tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Searching by: {'deleted': False, 'project_id': '9160b32c651a43f784bbe95a0e49059c'} {{(pid=122320) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:39:38.602196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2b695ef-f0c4-4624-aa9f-2d32aa2fc3ee tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:38.602942 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2b695ef-f0c4-4624-aa9f-2d32aa2fc3ee tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:38.604276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2b695ef-f0c4-4624-aa9f-2d32aa2fc3ee tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:38.605253 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2b695ef-f0c4-4624-aa9f-2d32aa2fc3ee tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:38.606224 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2b695ef-f0c4-4624-aa9f-2d32aa2fc3ee tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:38.607295 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2b695ef-f0c4-4624-aa9f-2d32aa2fc3ee tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:38.635518 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.multi_cell_list [None req-e2b695ef-f0c4-4624-aa9f-2d32aa2fc3ee tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=122320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:39:38.637847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1c9601eb-b27c-4b55-96f5-8b5a902f63d3 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:38.647255 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1c9601eb-b27c-4b55-96f5-8b5a902f63d3 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d" status: 200 len: 1217 microversion: 2.1 time: 0.082909 Oct 05 02:39:38.647861 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1417/2860] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:38 2022] GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:38.669130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d768f346-18ae-4cf7-b30d-50123939b640 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:38.669130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d768f346-18ae-4cf7-b30d-50123939b640 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] [instance: dfc7f734-b4e9-4709-a1f1-c5823297e9ab] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:38.674675 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d768f346-18ae-4cf7-b30d-50123939b640 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:38.675177 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d768f346-18ae-4cf7-b30d-50123939b640 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:38.675823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d768f346-18ae-4cf7-b30d-50123939b640 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:38.676621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d768f346-18ae-4cf7-b30d-50123939b640 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:38.677141 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d768f346-18ae-4cf7-b30d-50123939b640 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:38.678670 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d768f346-18ae-4cf7-b30d-50123939b640 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:38.680330 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e2b695ef-f0c4-4624-aa9f-2d32aa2fc3ee tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.144510 Oct 05 02:39:38.689104 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1444/2861] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 5 02:39:38 2022] GET /compute/v2.1/servers => generated 677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:39:38.694488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-98475a83-e5d1-4141-9314-864ff8ab74a3 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:38.695666 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-98475a83-e5d1-4141-9314-864ff8ab74a3 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:38.708553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98475a83-e5d1-4141-9314-864ff8ab74a3 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:38.710142 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98475a83-e5d1-4141-9314-864ff8ab74a3 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:38.710897 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98475a83-e5d1-4141-9314-864ff8ab74a3 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:38.712564 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98475a83-e5d1-4141-9314-864ff8ab74a3 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:38.713239 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98475a83-e5d1-4141-9314-864ff8ab74a3 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:38.713840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98475a83-e5d1-4141-9314-864ff8ab74a3 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:38.721643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d768f346-18ae-4cf7-b30d-50123939b640 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] [instance: dfc7f734-b4e9-4709-a1f1-c5823297e9ab] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:39:38.891377 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d768f346-18ae-4cf7-b30d-50123939b640 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dfc7f734-b4e9-4709-a1f1-c5823297e9ab" status: 204 len: 0 microversion: 2.1 time: 0.241452 Oct 05 02:39:38.892632 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1418/2862] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:39:38 2022] DELETE /compute/v2.1/servers/dfc7f734-b4e9-4709-a1f1-c5823297e9ab => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:39:38.905412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b6ceab21-db50-45a0-a5ee-7d7c0cb8604e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:38.907247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b6ceab21-db50-45a0-a5ee-7d7c0cb8604e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 36a8024b-dab8-454c-bcc3-65dcba09bbc0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:39.114301 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b6ceab21-db50-45a0-a5ee-7d7c0cb8604e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:39.123999 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b6ceab21-db50-45a0-a5ee-7d7c0cb8604e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/36a8024b-dab8-454c-bcc3-65dcba09bbc0" status: 200 len: 1220 microversion: 2.1 time: 0.229709 Oct 05 02:39:39.137765 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1419/2863] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:38 2022] GET /compute/v2.1/servers/36a8024b-dab8-454c-bcc3-65dcba09bbc0 => generated 1220 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:39.149942 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4dfdd993-5c8c-4ce7-afb2-40514a80c810 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:39.151388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4dfdd993-5c8c-4ce7-afb2-40514a80c810 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] [instance: dfc7f734-b4e9-4709-a1f1-c5823297e9ab] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:39.160182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4dfdd993-5c8c-4ce7-afb2-40514a80c810 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:39.162878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4dfdd993-5c8c-4ce7-afb2-40514a80c810 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:39.163610 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4dfdd993-5c8c-4ce7-afb2-40514a80c810 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:39.165459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4dfdd993-5c8c-4ce7-afb2-40514a80c810 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:39.166357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4dfdd993-5c8c-4ce7-afb2-40514a80c810 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:39.167056 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4dfdd993-5c8c-4ce7-afb2-40514a80c810 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:39.171684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-98475a83-e5d1-4141-9314-864ff8ab74a3 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:39.180328 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-98475a83-e5d1-4141-9314-864ff8ab74a3 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:39.181824 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-98475a83-e5d1-4141-9314-864ff8ab74a3 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:39.183016 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-98475a83-e5d1-4141-9314-864ff8ab74a3 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1664 microversion: 2.20 time: 0.494247 Oct 05 02:39:39.197171 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1445/2864] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:39:38 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1664 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:39:39.197171 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f84a3b82-17ca-4648-8c84-fb80b43b98fd tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:39.197751 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f84a3b82-17ca-4648-8c84-fb80b43b98fd tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:39.224370 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f84a3b82-17ca-4648-8c84-fb80b43b98fd tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:39.225509 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f84a3b82-17ca-4648-8c84-fb80b43b98fd tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:39.226145 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f84a3b82-17ca-4648-8c84-fb80b43b98fd tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:39.227047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f84a3b82-17ca-4648-8c84-fb80b43b98fd tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:39.227807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f84a3b82-17ca-4648-8c84-fb80b43b98fd tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:39.228270 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f84a3b82-17ca-4648-8c84-fb80b43b98fd tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:39.671767 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f84a3b82-17ca-4648-8c84-fb80b43b98fd tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:39.679534 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f84a3b82-17ca-4648-8c84-fb80b43b98fd tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1312 microversion: 2.1 time: 0.486804 Oct 05 02:39:39.691338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4dfdd993-5c8c-4ce7-afb2-40514a80c810 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58f274a86f44352820c63496788f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7cf219232d24bd0adae8ac00e570010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:39.693790 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1446/2865] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:39 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1312 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:39.701007 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-22de4621-6237-4c00-915e-e90cd737ac5b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49e44d62-e40b-46ae-9ee4-50213f99bd12"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:39:39.703636 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-22de4621-6237-4c00-915e-e90cd737ac5b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:39.707354 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4dfdd993-5c8c-4ce7-afb2-40514a80c810 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] 10.222.0.16 "GET /compute/v2.1/servers/dfc7f734-b4e9-4709-a1f1-c5823297e9ab" status: 200 len: 1526 microversion: 2.1 time: 0.567019 Oct 05 02:39:39.710806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22de4621-6237-4c00-915e-e90cd737ac5b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:39.711490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22de4621-6237-4c00-915e-e90cd737ac5b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:39.712106 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22de4621-6237-4c00-915e-e90cd737ac5b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:39.712992 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22de4621-6237-4c00-915e-e90cd737ac5b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:39.713629 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22de4621-6237-4c00-915e-e90cd737ac5b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:39.714206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22de4621-6237-4c00-915e-e90cd737ac5b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:39.725950 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1420/2866] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:39 2022] GET /compute/v2.1/servers/dfc7f734-b4e9-4709-a1f1-c5823297e9ab => generated 1526 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:39.734341 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-de57b9d8-5494-4a12-a8af-39c62eec7d6a req-71c826ff-5efa-4a89-925b-0c9fe69fc264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c15b977-1608-45e8-8bbd-b2bd5c1eff21", "name": "network-vif-unplugged", "status": "completed", "tag": "af2bec78-4945-43ac-81ca-883ba5ae8ef2"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:39:39.749635 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-de57b9d8-5494-4a12-a8af-39c62eec7d6a req-71c826ff-5efa-4a89-925b-0c9fe69fc264 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:39.750438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-de57b9d8-5494-4a12-a8af-39c62eec7d6a req-71c826ff-5efa-4a89-925b-0c9fe69fc264 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:39.751196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-de57b9d8-5494-4a12-a8af-39c62eec7d6a req-71c826ff-5efa-4a89-925b-0c9fe69fc264 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:39.772785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.compute.server_external_events [req-de57b9d8-5494-4a12-a8af-39c62eec7d6a req-71c826ff-5efa-4a89-925b-0c9fe69fc264 service nova] Unable to find a host for instance 1c15b977-1608-45e8-8bbd-b2bd5c1eff21. Dropping event network-vif-unplugged {{(pid=122319) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 05 02:39:39.775372 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-de57b9d8-5494-4a12-a8af-39c62eec7d6a req-71c826ff-5efa-4a89-925b-0c9fe69fc264 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.047438 Oct 05 02:39:39.776499 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1421/2867] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 49 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 05 02:39:39.782217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1829af3f-2124-4849-97f3-974655496a36 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:39.784712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1829af3f-2124-4849-97f3-974655496a36 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] [instance: 74b1ab94-3bc0-440d-bf57-dcab444e063d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:39.796659 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1829af3f-2124-4849-97f3-974655496a36 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:39.797199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1829af3f-2124-4849-97f3-974655496a36 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:39.799939 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1829af3f-2124-4849-97f3-974655496a36 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:39.800704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1829af3f-2124-4849-97f3-974655496a36 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:39.801231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1829af3f-2124-4849-97f3-974655496a36 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:39.801654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1829af3f-2124-4849-97f3-974655496a36 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:40.040710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:39:40.060103 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-22de4621-6237-4c00-915e-e90cd737ac5b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "POST /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.364812 Oct 05 02:39:40.061294 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1447/2868] 10.222.0.16 () {62 vars in 1364 bytes} [Wed Oct 5 02:39:39 2022] POST /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21/os-volume_attachments => generated 188 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:39:40.084262 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7f6460ec-d789-4604-8454-3a8e7ecce260 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:40.090299 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7f6460ec-d789-4604-8454-3a8e7ecce260 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 057410e8-9ca0-477a-adec-60a7f9d7832d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:40.107538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f6460ec-d789-4604-8454-3a8e7ecce260 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:40.108214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f6460ec-d789-4604-8454-3a8e7ecce260 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:40.108754 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f6460ec-d789-4604-8454-3a8e7ecce260 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:40.115037 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f6460ec-d789-4604-8454-3a8e7ecce260 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:40.116176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f6460ec-d789-4604-8454-3a8e7ecce260 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:40.116851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f6460ec-d789-4604-8454-3a8e7ecce260 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:40.843835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7f6460ec-d789-4604-8454-3a8e7ecce260 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:40.857272 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7f6460ec-d789-4604-8454-3a8e7ecce260 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d" status: 200 len: 1221 microversion: 2.1 time: 0.790358 Oct 05 02:39:40.858340 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1448/2869] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:40 2022] GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d => generated 1221 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:40.873076 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ef98812c-74cd-427e-8a7b-eb4414cce782 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:40.873692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ef98812c-74cd-427e-8a7b-eb4414cce782 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 36a8024b-dab8-454c-bcc3-65dcba09bbc0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:40.884700 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ef98812c-74cd-427e-8a7b-eb4414cce782 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:40.887846 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ef98812c-74cd-427e-8a7b-eb4414cce782 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:40.888320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ef98812c-74cd-427e-8a7b-eb4414cce782 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:40.890238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ef98812c-74cd-427e-8a7b-eb4414cce782 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:40.890877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ef98812c-74cd-427e-8a7b-eb4414cce782 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:40.891321 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ef98812c-74cd-427e-8a7b-eb4414cce782 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:41.040037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1829af3f-2124-4849-97f3-974655496a36 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d55412129f24e90b1caa99b3aea8c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be31ec89b1354d608d7de438f5cf519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:41.054042 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1829af3f-2124-4849-97f3-974655496a36 tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d" status: 200 len: 1471 microversion: 2.1 time: 1.276568 Oct 05 02:39:41.069747 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1422/2870] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:39 2022] GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d => generated 1471 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:41.076809 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0a441102-3985-4ec0-b303-ac3c96533411 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:41.077751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0a441102-3985-4ec0-b303-ac3c96533411 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:41.092416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a441102-3985-4ec0-b303-ac3c96533411 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:41.093378 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a441102-3985-4ec0-b303-ac3c96533411 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:41.094051 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a441102-3985-4ec0-b303-ac3c96533411 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:41.095000 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a441102-3985-4ec0-b303-ac3c96533411 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:41.095686 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a441102-3985-4ec0-b303-ac3c96533411 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:41.096359 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a441102-3985-4ec0-b303-ac3c96533411 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:41.128613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:39:41.223774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ef98812c-74cd-427e-8a7b-eb4414cce782 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:41.237757 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ef98812c-74cd-427e-8a7b-eb4414cce782 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/36a8024b-dab8-454c-bcc3-65dcba09bbc0" status: 200 len: 1272 microversion: 2.1 time: 0.378208 Oct 05 02:39:41.243039 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1449/2871] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:40 2022] GET /compute/v2.1/servers/36a8024b-dab8-454c-bcc3-65dcba09bbc0 => generated 1272 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:41.248491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-901ee9f3-a353-46dc-90a3-5f5a5cf9cf7f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:41.255016 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-901ee9f3-a353-46dc-90a3-5f5a5cf9cf7f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:41.275751 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-901ee9f3-a353-46dc-90a3-5f5a5cf9cf7f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:41.276245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-901ee9f3-a353-46dc-90a3-5f5a5cf9cf7f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:41.278231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-901ee9f3-a353-46dc-90a3-5f5a5cf9cf7f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:41.279467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-901ee9f3-a353-46dc-90a3-5f5a5cf9cf7f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:41.280107 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-901ee9f3-a353-46dc-90a3-5f5a5cf9cf7f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:41.280701 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-901ee9f3-a353-46dc-90a3-5f5a5cf9cf7f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:41.854363 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0a441102-3985-4ec0-b303-ac3c96533411 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21/os-volume_attachments/49e44d62-e40b-46ae-9ee4-50213f99bd12" status: 202 len: 0 microversion: 2.20 time: 0.782940 Oct 05 02:39:41.858706 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1423/2872] 10.222.0.16 () {60 vars in 1457 bytes} [Wed Oct 5 02:39:41 2022] DELETE /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21/os-volume_attachments/49e44d62-e40b-46ae-9ee4-50213f99bd12 => generated 0 bytes in 788 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:39:41.874157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6b41d134-1d4d-4aac-8fc7-10482416bb7f tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:41.874787 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6b41d134-1d4d-4aac-8fc7-10482416bb7f tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] [instance: dfc7f734-b4e9-4709-a1f1-c5823297e9ab] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:41.931641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b41d134-1d4d-4aac-8fc7-10482416bb7f tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:41.937412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b41d134-1d4d-4aac-8fc7-10482416bb7f tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:41.938041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b41d134-1d4d-4aac-8fc7-10482416bb7f tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:41.938821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b41d134-1d4d-4aac-8fc7-10482416bb7f tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:41.939401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b41d134-1d4d-4aac-8fc7-10482416bb7f tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:41.939830 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b41d134-1d4d-4aac-8fc7-10482416bb7f tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:42.075249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b41d134-1d4d-4aac-8fc7-10482416bb7f tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:42.076519 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b41d134-1d4d-4aac-8fc7-10482416bb7f tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:42.080393 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b41d134-1d4d-4aac-8fc7-10482416bb7f tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:42.085220 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-6b41d134-1d4d-4aac-8fc7-10482416bb7f tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lazy-loading 'fault' on Instance uuid dfc7f734-b4e9-4709-a1f1-c5823297e9ab {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:39:42.269245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6b41d134-1d4d-4aac-8fc7-10482416bb7f tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58f274a86f44352820c63496788f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7cf219232d24bd0adae8ac00e570010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:42.281282 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6b41d134-1d4d-4aac-8fc7-10482416bb7f tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] 10.222.0.16 "GET /compute/v2.1/servers/dfc7f734-b4e9-4709-a1f1-c5823297e9ab" status: 200 len: 1314 microversion: 2.1 time: 0.418495 Oct 05 02:39:42.282126 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1424/2873] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:41 2022] GET /compute/v2.1/servers/dfc7f734-b4e9-4709-a1f1-c5823297e9ab => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:42.288037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-3531d235-ee62-4a6c-9486-babaea2396b4 req-0a941e5f-d977-4a8e-af07-0c23133e0271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfc7f734-b4e9-4709-a1f1-c5823297e9ab", "name": "network-vif-deleted", "tag": "0d0d9bb6-c453-456f-80e7-521b78eeadc7"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:39:42.310164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-3531d235-ee62-4a6c-9486-babaea2396b4 req-0a941e5f-d977-4a8e-af07-0c23133e0271 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:42.311352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-3531d235-ee62-4a6c-9486-babaea2396b4 req-0a941e5f-d977-4a8e-af07-0c23133e0271 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:42.312194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-3531d235-ee62-4a6c-9486-babaea2396b4 req-0a941e5f-d977-4a8e-af07-0c23133e0271 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:42.326293 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-3531d235-ee62-4a6c-9486-babaea2396b4 req-0a941e5f-d977-4a8e-af07-0c23133e0271 service nova] Creating event network-vif-deleted:0d0d9bb6-c453-456f-80e7-521b78eeadc7 for instance dfc7f734-b4e9-4709-a1f1-c5823297e9ab on n-h2-858272-3 Oct 05 02:39:42.331849 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-3531d235-ee62-4a6c-9486-babaea2396b4 req-0a941e5f-d977-4a8e-af07-0c23133e0271 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048282 Oct 05 02:39:42.335357 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1425/2874] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:39:42.348157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c3afcbcf-e694-4a69-96b4-19d26117cdfe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:42.348888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c3afcbcf-e694-4a69-96b4-19d26117cdfe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 057410e8-9ca0-477a-adec-60a7f9d7832d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:42.366335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3afcbcf-e694-4a69-96b4-19d26117cdfe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:42.366911 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3afcbcf-e694-4a69-96b4-19d26117cdfe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:42.367372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3afcbcf-e694-4a69-96b4-19d26117cdfe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:42.368090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3afcbcf-e694-4a69-96b4-19d26117cdfe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:42.368545 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3afcbcf-e694-4a69-96b4-19d26117cdfe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:42.369038 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3afcbcf-e694-4a69-96b4-19d26117cdfe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:42.525847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-901ee9f3-a353-46dc-90a3-5f5a5cf9cf7f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:42.536191 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-901ee9f3-a353-46dc-90a3-5f5a5cf9cf7f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1312 microversion: 2.1 time: 1.291676 Oct 05 02:39:42.540281 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1450/2875] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:41 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1312 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:42.566764 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-463835ac-fac3-4e27-b26c-ce284270936c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:39:42.567636 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-463835ac-fac3-4e27-b26c-ce284270936c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:42.575409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-463835ac-fac3-4e27-b26c-ce284270936c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:42.576139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-463835ac-fac3-4e27-b26c-ce284270936c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:42.577458 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-463835ac-fac3-4e27-b26c-ce284270936c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:42.593734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-463835ac-fac3-4e27-b26c-ce284270936c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:42.594853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-463835ac-fac3-4e27-b26c-ce284270936c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:42.595454 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-463835ac-fac3-4e27-b26c-ce284270936c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:42.748453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c3afcbcf-e694-4a69-96b4-19d26117cdfe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:42.757097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-463835ac-fac3-4e27-b26c-ce284270936c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122320) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 05 02:39:42.770078 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c3afcbcf-e694-4a69-96b4-19d26117cdfe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d" status: 200 len: 1213 microversion: 2.1 time: 0.430562 Oct 05 02:39:42.791025 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1426/2876] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:42 2022] GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d => generated 1213 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:42.801455 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-61b59425-8ea7-4066-9a4e-ed5913c8180a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:42.807687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-61b59425-8ea7-4066-9a4e-ed5913c8180a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] [instance: 74b1ab94-3bc0-440d-bf57-dcab444e063d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:42.825518 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-61b59425-8ea7-4066-9a4e-ed5913c8180a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:42.826662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-61b59425-8ea7-4066-9a4e-ed5913c8180a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:42.827293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-61b59425-8ea7-4066-9a4e-ed5913c8180a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:42.828198 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-61b59425-8ea7-4066-9a4e-ed5913c8180a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:42.833331 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-61b59425-8ea7-4066-9a4e-ed5913c8180a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:42.835533 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-61b59425-8ea7-4066-9a4e-ed5913c8180a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:42.929945 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-463835ac-fac3-4e27-b26c-ce284270936c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "POST /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21/action" status: 202 len: 0 microversion: 2.20 time: 0.375022 Oct 05 02:39:42.933597 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1451/2877] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 5 02:39:42 2022] POST /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:39:42.952742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-10a6a817-b762-4249-9191-5d711f21ec1e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:42.953628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-10a6a817-b762-4249-9191-5d711f21ec1e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 36a8024b-dab8-454c-bcc3-65dcba09bbc0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:42.965519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10a6a817-b762-4249-9191-5d711f21ec1e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:42.969516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10a6a817-b762-4249-9191-5d711f21ec1e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:42.970326 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10a6a817-b762-4249-9191-5d711f21ec1e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:42.971300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10a6a817-b762-4249-9191-5d711f21ec1e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:42.971989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10a6a817-b762-4249-9191-5d711f21ec1e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:42.972645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10a6a817-b762-4249-9191-5d711f21ec1e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:43.257424 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-61b59425-8ea7-4066-9a4e-ed5913c8180a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d55412129f24e90b1caa99b3aea8c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be31ec89b1354d608d7de438f5cf519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:43.267476 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-61b59425-8ea7-4066-9a4e-ed5913c8180a tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d" status: 200 len: 1429 microversion: 2.1 time: 0.475066 Oct 05 02:39:43.281609 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1427/2878] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:42 2022] GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d => generated 1429 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:43.287653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-5c9338a5-c9d9-46c4-81df-2b289c423b97 req-9236b70c-a7b8-48d2-b3f7-3c9ff5fb7a52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74b1ab94-3bc0-440d-bf57-dcab444e063d", "name": "network-vif-deleted", "tag": "f76faa20-bd22-4858-915c-478dc55b243d"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:39:43.294447 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-10a6a817-b762-4249-9191-5d711f21ec1e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:43.310090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5c9338a5-c9d9-46c4-81df-2b289c423b97 req-9236b70c-a7b8-48d2-b3f7-3c9ff5fb7a52 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:43.311009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5c9338a5-c9d9-46c4-81df-2b289c423b97 req-9236b70c-a7b8-48d2-b3f7-3c9ff5fb7a52 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:43.312196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5c9338a5-c9d9-46c4-81df-2b289c423b97 req-9236b70c-a7b8-48d2-b3f7-3c9ff5fb7a52 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:43.316643 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-10a6a817-b762-4249-9191-5d711f21ec1e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/36a8024b-dab8-454c-bcc3-65dcba09bbc0" status: 200 len: 1278 microversion: 2.1 time: 0.377107 Oct 05 02:39:43.332947 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1452/2879] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:42 2022] GET /compute/v2.1/servers/36a8024b-dab8-454c-bcc3-65dcba09bbc0 => generated 1278 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:43.341917 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-199a5947-ce59-4b63-8d4b-2d41e464c3e0 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:43.343144 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-199a5947-ce59-4b63-8d4b-2d41e464c3e0 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:43.359638 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-199a5947-ce59-4b63-8d4b-2d41e464c3e0 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:43.361843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-199a5947-ce59-4b63-8d4b-2d41e464c3e0 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:43.362582 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-199a5947-ce59-4b63-8d4b-2d41e464c3e0 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:43.364002 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-199a5947-ce59-4b63-8d4b-2d41e464c3e0 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:43.366205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-199a5947-ce59-4b63-8d4b-2d41e464c3e0 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:43.370739 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-5c9338a5-c9d9-46c4-81df-2b289c423b97 req-9236b70c-a7b8-48d2-b3f7-3c9ff5fb7a52 service nova] Creating event network-vif-deleted:f76faa20-bd22-4858-915c-478dc55b243d for instance 74b1ab94-3bc0-440d-bf57-dcab444e063d on n-h1-858272-3 Oct 05 02:39:43.378532 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-5c9338a5-c9d9-46c4-81df-2b289c423b97 req-9236b70c-a7b8-48d2-b3f7-3c9ff5fb7a52 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095177 Oct 05 02:39:43.380694 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-199a5947-ce59-4b63-8d4b-2d41e464c3e0 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:43.381883 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1428/2880] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:39:43.391602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-aa533f0f-ec20-4b9d-a6e8-8a1955f3f600 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:43.392492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-aa533f0f-ec20-4b9d-a6e8-8a1955f3f600 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] [instance: dfc7f734-b4e9-4709-a1f1-c5823297e9ab] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:43.418937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa533f0f-ec20-4b9d-a6e8-8a1955f3f600 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:43.420551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa533f0f-ec20-4b9d-a6e8-8a1955f3f600 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:43.422542 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa533f0f-ec20-4b9d-a6e8-8a1955f3f600 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:43.423660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa533f0f-ec20-4b9d-a6e8-8a1955f3f600 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:43.427081 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa533f0f-ec20-4b9d-a6e8-8a1955f3f600 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:43.429351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa533f0f-ec20-4b9d-a6e8-8a1955f3f600 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:43.502157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:39:43.508988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa533f0f-ec20-4b9d-a6e8-8a1955f3f600 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:43.510454 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa533f0f-ec20-4b9d-a6e8-8a1955f3f600 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:43.511071 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa533f0f-ec20-4b9d-a6e8-8a1955f3f600 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:43.512582 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-aa533f0f-ec20-4b9d-a6e8-8a1955f3f600 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lazy-loading 'fault' on Instance uuid dfc7f734-b4e9-4709-a1f1-c5823297e9ab {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:39:43.899290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-aa533f0f-ec20-4b9d-a6e8-8a1955f3f600 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58f274a86f44352820c63496788f9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7cf219232d24bd0adae8ac00e570010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:43.915402 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-aa533f0f-ec20-4b9d-a6e8-8a1955f3f600 tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] 10.222.0.16 "GET /compute/v2.1/servers/dfc7f734-b4e9-4709-a1f1-c5823297e9ab" status: 200 len: 1314 microversion: 2.1 time: 0.531844 Oct 05 02:39:43.915982 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1429/2881] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:43 2022] GET /compute/v2.1/servers/dfc7f734-b4e9-4709-a1f1-c5823297e9ab => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:43.934001 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5d4d1e1a-e303-492c-a541-3a2bd2272b6a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:43.934855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5d4d1e1a-e303-492c-a541-3a2bd2272b6a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:43.955688 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d4d1e1a-e303-492c-a541-3a2bd2272b6a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:43.956369 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d4d1e1a-e303-492c-a541-3a2bd2272b6a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:43.956957 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d4d1e1a-e303-492c-a541-3a2bd2272b6a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:43.958984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d4d1e1a-e303-492c-a541-3a2bd2272b6a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:43.961519 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d4d1e1a-e303-492c-a541-3a2bd2272b6a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:43.962111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d4d1e1a-e303-492c-a541-3a2bd2272b6a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:44.466097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-199a5947-ce59-4b63-8d4b-2d41e464c3e0 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:44.504519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-199a5947-ce59-4b63-8d4b-2d41e464c3e0 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:44.508607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-199a5947-ce59-4b63-8d4b-2d41e464c3e0 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:44.510403 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-199a5947-ce59-4b63-8d4b-2d41e464c3e0 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1672 microversion: 2.20 time: 1.189233 Oct 05 02:39:44.529337 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1453/2882] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:39:43 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1672 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:39:44.537950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-037c0a5a-7743-456d-99b6-0b8abb144c21 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:44.538761 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-037c0a5a-7743-456d-99b6-0b8abb144c21 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 057410e8-9ca0-477a-adec-60a7f9d7832d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:44.550797 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-037c0a5a-7743-456d-99b6-0b8abb144c21 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:44.554145 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-037c0a5a-7743-456d-99b6-0b8abb144c21 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:44.554633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-037c0a5a-7743-456d-99b6-0b8abb144c21 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:44.573198 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-037c0a5a-7743-456d-99b6-0b8abb144c21 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:44.573752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-037c0a5a-7743-456d-99b6-0b8abb144c21 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:44.574220 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-037c0a5a-7743-456d-99b6-0b8abb144c21 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:44.719078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-037c0a5a-7743-456d-99b6-0b8abb144c21 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:44.729045 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-037c0a5a-7743-456d-99b6-0b8abb144c21 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d" status: 200 len: 1275 microversion: 2.1 time: 0.198451 Oct 05 02:39:44.729654 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1454/2883] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:44 2022] GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d => generated 1275 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:44.749541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-94581295-175e-48fb-b38b-9d6c8af6bbbe tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:44.750161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-94581295-175e-48fb-b38b-9d6c8af6bbbe tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] [instance: 74b1ab94-3bc0-440d-bf57-dcab444e063d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:44.770933 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94581295-175e-48fb-b38b-9d6c8af6bbbe tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:44.771475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94581295-175e-48fb-b38b-9d6c8af6bbbe tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:44.771992 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94581295-175e-48fb-b38b-9d6c8af6bbbe tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:44.772939 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94581295-175e-48fb-b38b-9d6c8af6bbbe tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:44.773440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94581295-175e-48fb-b38b-9d6c8af6bbbe tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:44.773639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94581295-175e-48fb-b38b-9d6c8af6bbbe tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:44.799430 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-94581295-175e-48fb-b38b-9d6c8af6bbbe tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] HTTP exception thrown: Instance 74b1ab94-3bc0-440d-bf57-dcab444e063d could not be found. Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-94581295-175e-48fb-b38b-9d6c8af6bbbe tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Request method failure captured: Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d HTTP/1.1 Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO4AOxJFWFelW5NIzv1D-2Oz8BlVYw3CEbOJqfQC-WEd3nfoNXQZy_9hWcXNogpU0zWAQr1pT64EgC-FdlsP5SuxtekgsZqh1L5JaZKowSuAPMix2YWcSuuzP5LwhGMSp6UpRWXCu00Ize6TsJ6KktyTp8zfDKWqY91b17Mp2NHIblg Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: be31ec89b1354d608d7de438f5cf519d Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ImagesOneServerTestJSON-1624949803 Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/be31ec89b1354d608d7de438f5cf519d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/be31ec89b1354d608d7de438f5cf519d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/be31ec89b1354d608d7de438f5cf519d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_be31ec89b1354d608d7de438f5cf519d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ImagesOneServerTestJSON-1624949803 Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: be31ec89b1354d608d7de438f5cf519d Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1624949803 Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ImagesOneServerTestJSON-1624949803-project Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 2d55412129f24e90b1caa99b3aea8c61 Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ImagesOneServerTestJSON-1624949803-project Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 74b1ab94-3bc0-440d-bf57-dcab444e063d could not be found. Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '74b1ab94-3bc0-440d-bf57-dcab444e063d'} Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74b1ab94-3bc0-440d-bf57-dcab444e063d could not be found. Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74b1ab94-3bc0-440d-bf57-dcab444e063d could not be found. Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:39:44.801045 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:39:44.808633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:39:44.808633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:39:44.808633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:39:44.808633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:39:44.808633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:39:44.808633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74b1ab94-3bc0-440d-bf57-dcab444e063d could not be found. Oct 05 02:39:44.808633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:39:44.808633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-94581295-175e-48fb-b38b-9d6c8af6bbbe tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] Returning 404 to user: Instance 74b1ab94-3bc0-440d-bf57-dcab444e063d could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:39:44.808633 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-94581295-175e-48fb-b38b-9d6c8af6bbbe tempest-ImagesOneServerTestJSON-1624949803 tempest-ImagesOneServerTestJSON-1624949803-project] 10.222.0.16 "GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d" status: 404 len: 111 microversion: 2.1 time: 0.071629 Oct 05 02:39:44.810731 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1455/2884] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:44 2022] GET /compute/v2.1/servers/74b1ab94-3bc0-440d-bf57-dcab444e063d => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:39:44.824496 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b44a53aa-f4a3-4419-9af9-c5cd47eaf0d2 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:44.827750 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b44a53aa-f4a3-4419-9af9-c5cd47eaf0d2 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 36a8024b-dab8-454c-bcc3-65dcba09bbc0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:44.842652 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b44a53aa-f4a3-4419-9af9-c5cd47eaf0d2 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:44.843802 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b44a53aa-f4a3-4419-9af9-c5cd47eaf0d2 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:44.845628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b44a53aa-f4a3-4419-9af9-c5cd47eaf0d2 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:44.847508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b44a53aa-f4a3-4419-9af9-c5cd47eaf0d2 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:44.850182 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b44a53aa-f4a3-4419-9af9-c5cd47eaf0d2 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:44.850793 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b44a53aa-f4a3-4419-9af9-c5cd47eaf0d2 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:44.851965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5d4d1e1a-e303-492c-a541-3a2bd2272b6a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:44.860477 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5d4d1e1a-e303-492c-a541-3a2bd2272b6a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1312 microversion: 2.1 time: 0.940000 Oct 05 02:39:44.861091 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1430/2885] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:43 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1312 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:44.946450 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bf598c84-7d59-4e1a-96ee-978e39519fee tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:44.948737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bf598c84-7d59-4e1a-96ee-978e39519fee tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] [instance: dfc7f734-b4e9-4709-a1f1-c5823297e9ab] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:44.955986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf598c84-7d59-4e1a-96ee-978e39519fee tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:44.956708 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf598c84-7d59-4e1a-96ee-978e39519fee tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:44.957515 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf598c84-7d59-4e1a-96ee-978e39519fee tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:44.959241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf598c84-7d59-4e1a-96ee-978e39519fee tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:44.960002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf598c84-7d59-4e1a-96ee-978e39519fee tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:44.960649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf598c84-7d59-4e1a-96ee-978e39519fee tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:44.997776 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-bf598c84-7d59-4e1a-96ee-978e39519fee tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] HTTP exception thrown: Instance dfc7f734-b4e9-4709-a1f1-c5823297e9ab could not be found. Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bf598c84-7d59-4e1a-96ee-978e39519fee tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Request method failure captured: Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/dfc7f734-b4e9-4709-a1f1-c5823297e9ab HTTP/1.1 Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO5DDIGBToqaRhl31jTg8oeor9gJQrbPlsu2utPiXocA7YJtK3_RbFMEESi4BH8vvf_MN4PYvesisQkAF1LdMat3S54rd-HUENbfuglPLbWlgn_wklL5aEJa8CA5KcKUmHCjO_fZxweLg46pjiOYDPA7SsSbUcnipv17V6YxL94sBoA Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: e7cf219232d24bd0adae8ac00e570010 Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-301928336 Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e7cf219232d24bd0adae8ac00e570010"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e7cf219232d24bd0adae8ac00e570010"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e7cf219232d24bd0adae8ac00e570010"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e7cf219232d24bd0adae8ac00e570010"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-301928336 Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: e7cf219232d24bd0adae8ac00e570010 Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-301928336 Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerAddressesNegativeTestJSON-301928336-project Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: b58f274a86f44352820c63496788f9db Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-301928336-project Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance dfc7f734-b4e9-4709-a1f1-c5823297e9ab could not be found. Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'dfc7f734-b4e9-4709-a1f1-c5823297e9ab'} Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfc7f734-b4e9-4709-a1f1-c5823297e9ab could not be found. Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfc7f734-b4e9-4709-a1f1-c5823297e9ab could not be found. Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:39:45.000454 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:39:45.004351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:39:45.004351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:39:45.004351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:39:45.004351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:39:45.004351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:39:45.004351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:39:45.004351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfc7f734-b4e9-4709-a1f1-c5823297e9ab could not be found. Oct 05 02:39:45.004351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:39:45.007023 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bf598c84-7d59-4e1a-96ee-978e39519fee tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] Returning 404 to user: Instance dfc7f734-b4e9-4709-a1f1-c5823297e9ab could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:39:45.008101 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bf598c84-7d59-4e1a-96ee-978e39519fee tempest-ServerAddressesNegativeTestJSON-301928336 tempest-ServerAddressesNegativeTestJSON-301928336-project] 10.222.0.16 "GET /compute/v2.1/servers/dfc7f734-b4e9-4709-a1f1-c5823297e9ab" status: 404 len: 111 microversion: 2.1 time: 0.067910 Oct 05 02:39:45.009327 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1431/2886] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:44 2022] GET /compute/v2.1/servers/dfc7f734-b4e9-4709-a1f1-c5823297e9ab => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:39:45.386507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b44a53aa-f4a3-4419-9af9-c5cd47eaf0d2 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:45.409785 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b44a53aa-f4a3-4419-9af9-c5cd47eaf0d2 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/36a8024b-dab8-454c-bcc3-65dcba09bbc0" status: 200 len: 1320 microversion: 2.1 time: 0.594484 Oct 05 02:39:45.410379 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1456/2887] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:44 2022] GET /compute/v2.1/servers/36a8024b-dab8-454c-bcc3-65dcba09bbc0 => generated 1320 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:45.502067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-6a7c330b-88c3-4dc4-82f0-4fe7564bb7d9 req-68d9360a-a272-47fc-8d7e-3ea68bcaddcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29215d80-fdc9-408d-b885-e6f3a5f7da84", "tag": "167e3597-f727-40a3-a743-6b1d1d8a0217"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:39:45.533867 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6a7c330b-88c3-4dc4-82f0-4fe7564bb7d9 req-68d9360a-a272-47fc-8d7e-3ea68bcaddcf service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:45.534832 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6a7c330b-88c3-4dc4-82f0-4fe7564bb7d9 req-68d9360a-a272-47fc-8d7e-3ea68bcaddcf service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:45.536063 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6a7c330b-88c3-4dc4-82f0-4fe7564bb7d9 req-68d9360a-a272-47fc-8d7e-3ea68bcaddcf service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:45.543495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8b9e05b0-21b7-4052-a94d-c39da76d5e51 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:45.544124 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8b9e05b0-21b7-4052-a94d-c39da76d5e51 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:45.551875 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-6a7c330b-88c3-4dc4-82f0-4fe7564bb7d9 req-68d9360a-a272-47fc-8d7e-3ea68bcaddcf service nova] Creating event network-changed:167e3597-f727-40a3-a743-6b1d1d8a0217 for instance 29215d80-fdc9-408d-b885-e6f3a5f7da84 on n-h1-858272-3 Oct 05 02:39:45.557259 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b9e05b0-21b7-4052-a94d-c39da76d5e51 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:45.558192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b9e05b0-21b7-4052-a94d-c39da76d5e51 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:45.558797 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b9e05b0-21b7-4052-a94d-c39da76d5e51 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:45.559769 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b9e05b0-21b7-4052-a94d-c39da76d5e51 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:45.560085 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-6a7c330b-88c3-4dc4-82f0-4fe7564bb7d9 req-68d9360a-a272-47fc-8d7e-3ea68bcaddcf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062692 Oct 05 02:39:45.560401 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b9e05b0-21b7-4052-a94d-c39da76d5e51 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:45.561065 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b9e05b0-21b7-4052-a94d-c39da76d5e51 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:45.563254 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1432/2888] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:39:45.761196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0452e50a-96c1-4183-9ca7-13aaa3eaeafc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:45.762264 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0452e50a-96c1-4183-9ca7-13aaa3eaeafc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 057410e8-9ca0-477a-adec-60a7f9d7832d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:45.772053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0452e50a-96c1-4183-9ca7-13aaa3eaeafc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:45.772857 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0452e50a-96c1-4183-9ca7-13aaa3eaeafc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:45.773630 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0452e50a-96c1-4183-9ca7-13aaa3eaeafc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:45.774555 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0452e50a-96c1-4183-9ca7-13aaa3eaeafc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:45.775167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0452e50a-96c1-4183-9ca7-13aaa3eaeafc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:45.775775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0452e50a-96c1-4183-9ca7-13aaa3eaeafc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:46.089857 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0452e50a-96c1-4183-9ca7-13aaa3eaeafc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:46.103708 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0452e50a-96c1-4183-9ca7-13aaa3eaeafc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d" status: 200 len: 1275 microversion: 2.1 time: 0.348653 Oct 05 02:39:46.104345 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1433/2889] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:45 2022] GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d => generated 1275 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:46.121554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8160d4d5-6717-4ce9-b1df-ab178a0bbc4b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:46.122454 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8160d4d5-6717-4ce9-b1df-ab178a0bbc4b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:46.131079 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8160d4d5-6717-4ce9-b1df-ab178a0bbc4b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:46.132177 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8160d4d5-6717-4ce9-b1df-ab178a0bbc4b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:46.132627 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8160d4d5-6717-4ce9-b1df-ab178a0bbc4b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:46.135419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8160d4d5-6717-4ce9-b1df-ab178a0bbc4b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:46.135893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8160d4d5-6717-4ce9-b1df-ab178a0bbc4b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:46.136323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8160d4d5-6717-4ce9-b1df-ab178a0bbc4b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:46.725029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8b9e05b0-21b7-4052-a94d-c39da76d5e51 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:46.735942 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8b9e05b0-21b7-4052-a94d-c39da76d5e51 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:46.737810 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8b9e05b0-21b7-4052-a94d-c39da76d5e51 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:46.739191 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8b9e05b0-21b7-4052-a94d-c39da76d5e51 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1672 microversion: 2.20 time: 1.199934 Oct 05 02:39:46.757136 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1457/2890] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:39:45 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1672 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:39:46.766197 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-eb0690af-61b2-49c2-99fe-a31b54780a5c tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:46.767669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-eb0690af-61b2-49c2-99fe-a31b54780a5c tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 36a8024b-dab8-454c-bcc3-65dcba09bbc0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:46.776469 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb0690af-61b2-49c2-99fe-a31b54780a5c tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:46.777564 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb0690af-61b2-49c2-99fe-a31b54780a5c tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:46.778235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb0690af-61b2-49c2-99fe-a31b54780a5c tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:46.779221 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb0690af-61b2-49c2-99fe-a31b54780a5c tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:46.780013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb0690af-61b2-49c2-99fe-a31b54780a5c tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:46.780721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb0690af-61b2-49c2-99fe-a31b54780a5c tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:47.014655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8160d4d5-6717-4ce9-b1df-ab178a0bbc4b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:47.029760 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8160d4d5-6717-4ce9-b1df-ab178a0bbc4b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1312 microversion: 2.1 time: 0.923581 Oct 05 02:39:47.030909 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1434/2891] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:46 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1312 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:47.138367 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7aa2ac00-8fb9-422b-b86b-f230629e87a0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:47.140995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7aa2ac00-8fb9-422b-b86b-f230629e87a0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 057410e8-9ca0-477a-adec-60a7f9d7832d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:47.174727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7aa2ac00-8fb9-422b-b86b-f230629e87a0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:47.178228 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7aa2ac00-8fb9-422b-b86b-f230629e87a0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:47.178877 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7aa2ac00-8fb9-422b-b86b-f230629e87a0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:47.179818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7aa2ac00-8fb9-422b-b86b-f230629e87a0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:47.180280 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7aa2ac00-8fb9-422b-b86b-f230629e87a0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:47.180718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7aa2ac00-8fb9-422b-b86b-f230629e87a0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:47.383849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:39:47.447932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7aa2ac00-8fb9-422b-b86b-f230629e87a0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:47.456884 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-eb0690af-61b2-49c2-99fe-a31b54780a5c tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:47.477374 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-eb0690af-61b2-49c2-99fe-a31b54780a5c tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/36a8024b-dab8-454c-bcc3-65dcba09bbc0" status: 200 len: 1320 microversion: 2.1 time: 0.717421 Oct 05 02:39:47.477860 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7aa2ac00-8fb9-422b-b86b-f230629e87a0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d" status: 200 len: 1275 microversion: 2.1 time: 0.348404 Oct 05 02:39:47.498323 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1435/2892] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:47 2022] GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d => generated 1275 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:47.498528 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1458/2893] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:46 2022] GET /compute/v2.1/servers/36a8024b-dab8-454c-bcc3-65dcba09bbc0 => generated 1320 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:47.772826 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-45ee46ae-3d52-409c-860c-74fac9e0d394 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:47.774041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-45ee46ae-3d52-409c-860c-74fac9e0d394 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:47.783208 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45ee46ae-3d52-409c-860c-74fac9e0d394 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:47.784101 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45ee46ae-3d52-409c-860c-74fac9e0d394 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:47.785034 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45ee46ae-3d52-409c-860c-74fac9e0d394 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:47.787667 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45ee46ae-3d52-409c-860c-74fac9e0d394 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:47.788433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45ee46ae-3d52-409c-860c-74fac9e0d394 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:47.789142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45ee46ae-3d52-409c-860c-74fac9e0d394 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:47.939405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-1f1fbb98-c778-4a68-9473-7813c7000c20 req-3a609ab3-7a80-4134-9271-0664849a34df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36a8024b-dab8-454c-bcc3-65dcba09bbc0", "tag": "96f234d9-01d0-449d-95b5-8ff6d63d7cd7"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:39:47.962966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1f1fbb98-c778-4a68-9473-7813c7000c20 req-3a609ab3-7a80-4134-9271-0664849a34df service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:47.963460 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1f1fbb98-c778-4a68-9473-7813c7000c20 req-3a609ab3-7a80-4134-9271-0664849a34df service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:47.963895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1f1fbb98-c778-4a68-9473-7813c7000c20 req-3a609ab3-7a80-4134-9271-0664849a34df service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:48.004262 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-1f1fbb98-c778-4a68-9473-7813c7000c20 req-3a609ab3-7a80-4134-9271-0664849a34df service nova] Creating event network-changed:96f234d9-01d0-449d-95b5-8ff6d63d7cd7 for instance 36a8024b-dab8-454c-bcc3-65dcba09bbc0 on n-h2-858272-3 Oct 05 02:39:48.017617 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-1f1fbb98-c778-4a68-9473-7813c7000c20 req-3a609ab3-7a80-4134-9271-0664849a34df service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081418 Oct 05 02:39:48.018832 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1459/2894] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:39:48.064334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-aba5cca8-a55b-423f-ac9b-7fd809f48c90 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:48.065206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-aba5cca8-a55b-423f-ac9b-7fd809f48c90 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:48.072606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aba5cca8-a55b-423f-ac9b-7fd809f48c90 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:48.073383 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aba5cca8-a55b-423f-ac9b-7fd809f48c90 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:48.074058 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aba5cca8-a55b-423f-ac9b-7fd809f48c90 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:48.074999 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aba5cca8-a55b-423f-ac9b-7fd809f48c90 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:48.075676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aba5cca8-a55b-423f-ac9b-7fd809f48c90 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:48.076340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aba5cca8-a55b-423f-ac9b-7fd809f48c90 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:48.316811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:39:48.621940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:39:48.719862 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-aba5cca8-a55b-423f-ac9b-7fd809f48c90 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:48.730127 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-aba5cca8-a55b-423f-ac9b-7fd809f48c90 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1312 microversion: 2.1 time: 0.678512 Oct 05 02:39:48.731326 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1460/2895] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:48 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1312 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:48.737036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9db8c980-9106-4081-bd46-5f6e7f50d8ff tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:48.743669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9db8c980-9106-4081-bd46-5f6e7f50d8ff tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '110ebcc38ef34dfea40fe14ab2ad1b3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69def5e64d945428d420e737fecd987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:48.744568 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9db8c980-9106-4081-bd46-5f6e7f50d8ff tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Searching by: {'deleted': False, 'project_id': 'd69def5e64d945428d420e737fecd987'} {{(pid=122320) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:39:48.754053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9db8c980-9106-4081-bd46-5f6e7f50d8ff tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:48.754719 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9db8c980-9106-4081-bd46-5f6e7f50d8ff tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:48.755481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9db8c980-9106-4081-bd46-5f6e7f50d8ff tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:48.756744 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9db8c980-9106-4081-bd46-5f6e7f50d8ff tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:48.757504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9db8c980-9106-4081-bd46-5f6e7f50d8ff tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:48.758070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-45ee46ae-3d52-409c-860c-74fac9e0d394 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:48.758318 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9db8c980-9106-4081-bd46-5f6e7f50d8ff tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:48.767855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-45ee46ae-3d52-409c-860c-74fac9e0d394 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:48.769848 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-45ee46ae-3d52-409c-860c-74fac9e0d394 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:48.772058 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-45ee46ae-3d52-409c-860c-74fac9e0d394 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1730 microversion: 2.20 time: 1.004581 Oct 05 02:39:48.807099 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1436/2896] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:39:47 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1730 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:39:48.815722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ae8677ae-4dba-45ea-9118-8e5e5c4559bb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:48.817622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ae8677ae-4dba-45ea-9118-8e5e5c4559bb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 057410e8-9ca0-477a-adec-60a7f9d7832d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:48.831890 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae8677ae-4dba-45ea-9118-8e5e5c4559bb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:48.832843 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae8677ae-4dba-45ea-9118-8e5e5c4559bb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:48.835108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae8677ae-4dba-45ea-9118-8e5e5c4559bb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:48.836394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae8677ae-4dba-45ea-9118-8e5e5c4559bb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:48.837176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae8677ae-4dba-45ea-9118-8e5e5c4559bb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:48.837850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae8677ae-4dba-45ea-9118-8e5e5c4559bb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:48.849011 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.multi_cell_list [None req-9db8c980-9106-4081-bd46-5f6e7f50d8ff tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:39:48.896309 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9db8c980-9106-4081-bd46-5f6e7f50d8ff tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 332 microversion: 2.1 time: 0.163566 Oct 05 02:39:48.910093 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1461/2897] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 5 02:39:48 2022] GET /compute/v2.1/servers => generated 332 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:39:48.918367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4efb7f2b-1d03-4a3d-8ee9-cf2d65348b1d tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:48.919227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4efb7f2b-1d03-4a3d-8ee9-cf2d65348b1d tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 36a8024b-dab8-454c-bcc3-65dcba09bbc0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:48.926838 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4efb7f2b-1d03-4a3d-8ee9-cf2d65348b1d tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:48.928339 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4efb7f2b-1d03-4a3d-8ee9-cf2d65348b1d tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:48.929213 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4efb7f2b-1d03-4a3d-8ee9-cf2d65348b1d tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:48.930949 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4efb7f2b-1d03-4a3d-8ee9-cf2d65348b1d tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:48.936765 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4efb7f2b-1d03-4a3d-8ee9-cf2d65348b1d tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:48.937301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4efb7f2b-1d03-4a3d-8ee9-cf2d65348b1d tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:49.121121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=20 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:39:49.474189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ae8677ae-4dba-45ea-9118-8e5e5c4559bb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:49.486702 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ae8677ae-4dba-45ea-9118-8e5e5c4559bb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d" status: 200 len: 1317 microversion: 2.1 time: 0.677957 Oct 05 02:39:49.487541 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1437/2898] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:48 2022] GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d => generated 1317 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:49.511250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b9cd0cbb-772c-4279-ab5f-b701f279460a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:49.516311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b9cd0cbb-772c-4279-ab5f-b701f279460a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '110ebcc38ef34dfea40fe14ab2ad1b3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69def5e64d945428d420e737fecd987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:49.517215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b9cd0cbb-772c-4279-ab5f-b701f279460a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Searching by: {'deleted': False, 'project_id': 'd69def5e64d945428d420e737fecd987'} {{(pid=122319) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:39:49.524791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9cd0cbb-772c-4279-ab5f-b701f279460a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:49.525607 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9cd0cbb-772c-4279-ab5f-b701f279460a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:49.526754 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9cd0cbb-772c-4279-ab5f-b701f279460a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:49.527737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9cd0cbb-772c-4279-ab5f-b701f279460a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:49.528288 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9cd0cbb-772c-4279-ab5f-b701f279460a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:49.529382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9cd0cbb-772c-4279-ab5f-b701f279460a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:49.551707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4efb7f2b-1d03-4a3d-8ee9-cf2d65348b1d tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:49.563672 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4efb7f2b-1d03-4a3d-8ee9-cf2d65348b1d tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/36a8024b-dab8-454c-bcc3-65dcba09bbc0" status: 200 len: 1320 microversion: 2.1 time: 0.652066 Oct 05 02:39:49.565558 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1462/2899] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:48 2022] GET /compute/v2.1/servers/36a8024b-dab8-454c-bcc3-65dcba09bbc0 => generated 1320 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:49.574280 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.multi_cell_list [None req-b9cd0cbb-772c-4279-ab5f-b701f279460a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122319) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:39:49.621178 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b9cd0cbb-772c-4279-ab5f-b701f279460a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110ebcc38ef34dfea40fe14ab2ad1b3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69def5e64d945428d420e737fecd987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:49.639885 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9cd0cbb-772c-4279-ab5f-b701f279460a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:49.640372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9cd0cbb-772c-4279-ab5f-b701f279460a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:49.641032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9cd0cbb-772c-4279-ab5f-b701f279460a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:49.762231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-54eaa7a4-da39-4093-96b0-3aa07bc3511f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:49.763185 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-54eaa7a4-da39-4093-96b0-3aa07bc3511f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:49.774901 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54eaa7a4-da39-4093-96b0-3aa07bc3511f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:49.779241 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54eaa7a4-da39-4093-96b0-3aa07bc3511f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:49.780715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54eaa7a4-da39-4093-96b0-3aa07bc3511f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:49.782376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54eaa7a4-da39-4093-96b0-3aa07bc3511f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:49.784015 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54eaa7a4-da39-4093-96b0-3aa07bc3511f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:49.786195 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54eaa7a4-da39-4093-96b0-3aa07bc3511f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:50.852456 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b9cd0cbb-772c-4279-ab5f-b701f279460a tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 1695 microversion: 2.1 time: 1.349110 Oct 05 02:39:50.853412 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1438/2900] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:39:49 2022] GET /compute/v2.1/servers/detail => generated 1695 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:50.865280 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3bc25820-5f9a-4430-8152-adcffdc9da93 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:50.866119 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3bc25820-5f9a-4430-8152-adcffdc9da93 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:50.873321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bc25820-5f9a-4430-8152-adcffdc9da93 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:50.873851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bc25820-5f9a-4430-8152-adcffdc9da93 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:50.874294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bc25820-5f9a-4430-8152-adcffdc9da93 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:50.874999 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bc25820-5f9a-4430-8152-adcffdc9da93 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:50.875588 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bc25820-5f9a-4430-8152-adcffdc9da93 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:50.876032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bc25820-5f9a-4430-8152-adcffdc9da93 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:50.895289 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-54eaa7a4-da39-4093-96b0-3aa07bc3511f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:50.902107 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:39:50.912682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:39:50.915889 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-54eaa7a4-da39-4093-96b0-3aa07bc3511f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1312 microversion: 2.1 time: 1.157608 Oct 05 02:39:50.916482 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1463/2901] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:49 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1312 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:39:50.923274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-c7ebbfc7-943b-4372-a42d-e6ff26d8e731 req-0e9cdc3a-82d2-4f69-92e0-192a551c7ccc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15bedd7a-7fb7-40e2-bf87-729192d754aa", "tag": "52c5cb9e-fb3c-49d0-b036-314e66927957"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:39:50.937924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-c7ebbfc7-943b-4372-a42d-e6ff26d8e731 req-0e9cdc3a-82d2-4f69-92e0-192a551c7ccc service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:50.938824 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-c7ebbfc7-943b-4372-a42d-e6ff26d8e731 req-0e9cdc3a-82d2-4f69-92e0-192a551c7ccc service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:50.940062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-c7ebbfc7-943b-4372-a42d-e6ff26d8e731 req-0e9cdc3a-82d2-4f69-92e0-192a551c7ccc service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:50.953999 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-c7ebbfc7-943b-4372-a42d-e6ff26d8e731 req-0e9cdc3a-82d2-4f69-92e0-192a551c7ccc service nova] Creating event network-changed:52c5cb9e-fb3c-49d0-b036-314e66927957 for instance 15bedd7a-7fb7-40e2-bf87-729192d754aa on n-h2-858272-3 Oct 05 02:39:50.959977 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-c7ebbfc7-943b-4372-a42d-e6ff26d8e731 req-0e9cdc3a-82d2-4f69-92e0-192a551c7ccc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040862 Oct 05 02:39:50.961005 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1464/2902] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:39:50.966729 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7c18c96e-1365-4228-a82e-2df6dae6b373 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:50.967713 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7c18c96e-1365-4228-a82e-2df6dae6b373 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 057410e8-9ca0-477a-adec-60a7f9d7832d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:50.976356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c18c96e-1365-4228-a82e-2df6dae6b373 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:50.976356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c18c96e-1365-4228-a82e-2df6dae6b373 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:50.976677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c18c96e-1365-4228-a82e-2df6dae6b373 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:50.977723 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c18c96e-1365-4228-a82e-2df6dae6b373 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:50.978188 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c18c96e-1365-4228-a82e-2df6dae6b373 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:50.979433 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c18c96e-1365-4228-a82e-2df6dae6b373 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:51.487610 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3bc25820-5f9a-4430-8152-adcffdc9da93 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:51.505305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3bc25820-5f9a-4430-8152-adcffdc9da93 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:51.507862 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3bc25820-5f9a-4430-8152-adcffdc9da93 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:51.510607 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3bc25820-5f9a-4430-8152-adcffdc9da93 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1730 microversion: 2.20 time: 0.655972 Oct 05 02:39:51.514840 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1439/2903] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:39:50 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1730 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:39:51.529493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a8ff7e54-7839-433a-bb7b-ec33fa7a20d5 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:51.530942 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a8ff7e54-7839-433a-bb7b-ec33fa7a20d5 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 36a8024b-dab8-454c-bcc3-65dcba09bbc0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:51.546965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8ff7e54-7839-433a-bb7b-ec33fa7a20d5 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:51.547818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8ff7e54-7839-433a-bb7b-ec33fa7a20d5 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:51.548502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8ff7e54-7839-433a-bb7b-ec33fa7a20d5 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:51.553936 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8ff7e54-7839-433a-bb7b-ec33fa7a20d5 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:51.554952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8ff7e54-7839-433a-bb7b-ec33fa7a20d5 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:51.556333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8ff7e54-7839-433a-bb7b-ec33fa7a20d5 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:51.631934 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7c18c96e-1365-4228-a82e-2df6dae6b373 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:51.640937 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7c18c96e-1365-4228-a82e-2df6dae6b373 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d" status: 200 len: 1317 microversion: 2.1 time: 0.678538 Oct 05 02:39:51.648335 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1465/2904] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:50 2022] GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d => generated 1317 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:51.656970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-78b1490d-9fce-4775-b788-b75a8dffea93 req-5a9c705d-f3e3-43de-ad06-daa6335769b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c15b977-1608-45e8-8bbd-b2bd5c1eff21", "tag": "af2bec78-4945-43ac-81ca-883ba5ae8ef2"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:39:51.676852 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-78b1490d-9fce-4775-b788-b75a8dffea93 req-5a9c705d-f3e3-43de-ad06-daa6335769b7 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:51.677679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-78b1490d-9fce-4775-b788-b75a8dffea93 req-5a9c705d-f3e3-43de-ad06-daa6335769b7 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:51.678310 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-78b1490d-9fce-4775-b788-b75a8dffea93 req-5a9c705d-f3e3-43de-ad06-daa6335769b7 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:51.692489 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-78b1490d-9fce-4775-b788-b75a8dffea93 req-5a9c705d-f3e3-43de-ad06-daa6335769b7 service nova] Creating event network-changed:af2bec78-4945-43ac-81ca-883ba5ae8ef2 for instance 1c15b977-1608-45e8-8bbd-b2bd5c1eff21 on n-h1-858272-3 Oct 05 02:39:51.706713 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-78b1490d-9fce-4775-b788-b75a8dffea93 req-5a9c705d-f3e3-43de-ad06-daa6335769b7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055867 Oct 05 02:39:51.708377 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1466/2905] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:39:51.715431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-be906bba-4b70-4e79-9998-eb5afabc0eaa tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:51.724889 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-be906bba-4b70-4e79-9998-eb5afabc0eaa tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013950 Oct 05 02:39:51.725913 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1467/2906] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 5 02:39:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:39:51.943290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ae7f3d27-284d-49a0-aa94-f75a2ac38309 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:51.945421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ae7f3d27-284d-49a0-aa94-f75a2ac38309 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:51.952540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae7f3d27-284d-49a0-aa94-f75a2ac38309 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:51.953326 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae7f3d27-284d-49a0-aa94-f75a2ac38309 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:51.953951 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae7f3d27-284d-49a0-aa94-f75a2ac38309 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:51.955165 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae7f3d27-284d-49a0-aa94-f75a2ac38309 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:51.955979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae7f3d27-284d-49a0-aa94-f75a2ac38309 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:51.956570 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae7f3d27-284d-49a0-aa94-f75a2ac38309 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:52.106144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a8ff7e54-7839-433a-bb7b-ec33fa7a20d5 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:52.127672 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a8ff7e54-7839-433a-bb7b-ec33fa7a20d5 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/36a8024b-dab8-454c-bcc3-65dcba09bbc0" status: 200 len: 1320 microversion: 2.1 time: 0.610178 Oct 05 02:39:52.133436 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1440/2907] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:51 2022] GET /compute/v2.1/servers/36a8024b-dab8-454c-bcc3-65dcba09bbc0 => generated 1320 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:52.146874 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b2d8b729-4f3f-4ad3-9925-113970348312 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:52.147592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b2d8b729-4f3f-4ad3-9925-113970348312 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] [instance: b834e68c-772a-45b6-857b-0cb285b1e320] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:52.178957 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2d8b729-4f3f-4ad3-9925-113970348312 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:52.179613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2d8b729-4f3f-4ad3-9925-113970348312 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:52.180060 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2d8b729-4f3f-4ad3-9925-113970348312 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:52.181975 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2d8b729-4f3f-4ad3-9925-113970348312 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:52.183786 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2d8b729-4f3f-4ad3-9925-113970348312 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:52.185379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2d8b729-4f3f-4ad3-9925-113970348312 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:52.246392 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b2d8b729-4f3f-4ad3-9925-113970348312 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] [instance: b834e68c-772a-45b6-857b-0cb285b1e320] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:39:52.332959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ae7f3d27-284d-49a0-aa94-f75a2ac38309 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:52.345912 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ae7f3d27-284d-49a0-aa94-f75a2ac38309 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1312 microversion: 2.1 time: 0.406593 Oct 05 02:39:52.346620 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1468/2908] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:51 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1312 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:52.424647 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b2d8b729-4f3f-4ad3-9925-113970348312 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320" status: 204 len: 0 microversion: 2.1 time: 0.288959 Oct 05 02:39:52.428505 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1441/2909] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:39:52 2022] DELETE /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:39:52.435417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c20c3667-9f97-413e-a3ad-7a8462cb74b7 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:52.436588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c20c3667-9f97-413e-a3ad-7a8462cb74b7 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] [instance: b834e68c-772a-45b6-857b-0cb285b1e320] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:52.440474 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:39:52.445210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c20c3667-9f97-413e-a3ad-7a8462cb74b7 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:52.445722 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c20c3667-9f97-413e-a3ad-7a8462cb74b7 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:52.446970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c20c3667-9f97-413e-a3ad-7a8462cb74b7 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:52.448020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c20c3667-9f97-413e-a3ad-7a8462cb74b7 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:52.448687 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c20c3667-9f97-413e-a3ad-7a8462cb74b7 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:52.449378 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c20c3667-9f97-413e-a3ad-7a8462cb74b7 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:52.547429 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-89d14e05-76c4-4ad0-aa6d-98a8d4df2435 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:52.548502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-89d14e05-76c4-4ad0-aa6d-98a8d4df2435 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:52.564250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-89d14e05-76c4-4ad0-aa6d-98a8d4df2435 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:52.565208 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-89d14e05-76c4-4ad0-aa6d-98a8d4df2435 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:52.565901 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-89d14e05-76c4-4ad0-aa6d-98a8d4df2435 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:52.567110 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-89d14e05-76c4-4ad0-aa6d-98a8d4df2435 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:52.568447 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-89d14e05-76c4-4ad0-aa6d-98a8d4df2435 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:52.569712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-89d14e05-76c4-4ad0-aa6d-98a8d4df2435 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:52.790785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c20c3667-9f97-413e-a3ad-7a8462cb74b7 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110ebcc38ef34dfea40fe14ab2ad1b3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69def5e64d945428d420e737fecd987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:52.808362 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c20c3667-9f97-413e-a3ad-7a8462cb74b7 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] 10.222.0.16 "GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320" status: 200 len: 1698 microversion: 2.1 time: 0.377927 Oct 05 02:39:52.814672 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1469/2910] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:52 2022] GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320 => generated 1698 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:39:52.826576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4f4354d2-3aea-4a53-965b-d06446a62665 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:52.828392 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4f4354d2-3aea-4a53-965b-d06446a62665 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 057410e8-9ca0-477a-adec-60a7f9d7832d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:52.844143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f4354d2-3aea-4a53-965b-d06446a62665 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:52.845427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f4354d2-3aea-4a53-965b-d06446a62665 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:52.846171 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f4354d2-3aea-4a53-965b-d06446a62665 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:52.847724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f4354d2-3aea-4a53-965b-d06446a62665 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:52.848313 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f4354d2-3aea-4a53-965b-d06446a62665 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:52.849285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f4354d2-3aea-4a53-965b-d06446a62665 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:52.864567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-89d14e05-76c4-4ad0-aa6d-98a8d4df2435 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:52.882168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-89d14e05-76c4-4ad0-aa6d-98a8d4df2435 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:52.891232 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-89d14e05-76c4-4ad0-aa6d-98a8d4df2435 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:52.892481 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-89d14e05-76c4-4ad0-aa6d-98a8d4df2435 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1730 microversion: 2.20 time: 0.352108 Oct 05 02:39:52.904926 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1442/2911] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:39:52 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1730 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:39:53.130445 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4f4354d2-3aea-4a53-965b-d06446a62665 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:53.143420 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4f4354d2-3aea-4a53-965b-d06446a62665 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d" status: 200 len: 1317 microversion: 2.1 time: 0.327575 Oct 05 02:39:53.144009 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1470/2912] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:52 2022] GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d => generated 1317 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:53.160696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-53a23370-21e2-4816-8115-97c2b0bce20a tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:53.161372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-53a23370-21e2-4816-8115-97c2b0bce20a tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 36a8024b-dab8-454c-bcc3-65dcba09bbc0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:53.172328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53a23370-21e2-4816-8115-97c2b0bce20a tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:53.174101 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53a23370-21e2-4816-8115-97c2b0bce20a tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:53.176099 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53a23370-21e2-4816-8115-97c2b0bce20a tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:53.178013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53a23370-21e2-4816-8115-97c2b0bce20a tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:53.180409 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53a23370-21e2-4816-8115-97c2b0bce20a tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:53.180870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53a23370-21e2-4816-8115-97c2b0bce20a tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:53.379174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3cc647fd-6362-4866-9358-a550006d1d07 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:53.379867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3cc647fd-6362-4866-9358-a550006d1d07 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:53.400838 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3cc647fd-6362-4866-9358-a550006d1d07 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:53.401374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3cc647fd-6362-4866-9358-a550006d1d07 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:53.404586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3cc647fd-6362-4866-9358-a550006d1d07 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:53.405657 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3cc647fd-6362-4866-9358-a550006d1d07 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:53.407540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3cc647fd-6362-4866-9358-a550006d1d07 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:53.409365 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3cc647fd-6362-4866-9358-a550006d1d07 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:53.755762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-53a23370-21e2-4816-8115-97c2b0bce20a tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:53.767762 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-53a23370-21e2-4816-8115-97c2b0bce20a tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/36a8024b-dab8-454c-bcc3-65dcba09bbc0" status: 200 len: 1320 microversion: 2.1 time: 0.611154 Oct 05 02:39:53.768352 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1443/2913] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:53 2022] GET /compute/v2.1/servers/36a8024b-dab8-454c-bcc3-65dcba09bbc0 => generated 1320 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:53.835326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-aee6af57-c485-47df-8249-345d7a9719a5 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:53.835947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-aee6af57-c485-47df-8249-345d7a9719a5 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] [instance: b834e68c-772a-45b6-857b-0cb285b1e320] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:53.848494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aee6af57-c485-47df-8249-345d7a9719a5 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:53.849088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aee6af57-c485-47df-8249-345d7a9719a5 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:53.861831 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aee6af57-c485-47df-8249-345d7a9719a5 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:53.862613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aee6af57-c485-47df-8249-345d7a9719a5 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:53.867781 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aee6af57-c485-47df-8249-345d7a9719a5 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:53.872498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aee6af57-c485-47df-8249-345d7a9719a5 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:54.235607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3cc647fd-6362-4866-9358-a550006d1d07 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:54.263358 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3cc647fd-6362-4866-9358-a550006d1d07 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1312 microversion: 2.1 time: 0.884589 Oct 05 02:39:54.264368 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1471/2914] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:53 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1312 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:54.280857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-98cd0c3f-d856-4899-aa27-22ee3ffb8a1d req-0f876fd2-4878-4bcc-8d70-fe8c309e205b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "057410e8-9ca0-477a-adec-60a7f9d7832d", "tag": "5cd2eed9-4043-4634-ad60-927cf17f76cd"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:39:54.325056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-98cd0c3f-d856-4899-aa27-22ee3ffb8a1d req-0f876fd2-4878-4bcc-8d70-fe8c309e205b service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:54.325837 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-98cd0c3f-d856-4899-aa27-22ee3ffb8a1d req-0f876fd2-4878-4bcc-8d70-fe8c309e205b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:54.326440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-98cd0c3f-d856-4899-aa27-22ee3ffb8a1d req-0f876fd2-4878-4bcc-8d70-fe8c309e205b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:54.349712 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-98cd0c3f-d856-4899-aa27-22ee3ffb8a1d req-0f876fd2-4878-4bcc-8d70-fe8c309e205b service nova] Creating event network-changed:5cd2eed9-4043-4634-ad60-927cf17f76cd for instance 057410e8-9ca0-477a-adec-60a7f9d7832d on n-h2-858272-3 Oct 05 02:39:54.362759 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-98cd0c3f-d856-4899-aa27-22ee3ffb8a1d req-0f876fd2-4878-4bcc-8d70-fe8c309e205b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096764 Oct 05 02:39:54.363928 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1472/2915] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:39:54.377663 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-10006976-f321-4886-b69a-b57c24e62f94 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:54.379872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-10006976-f321-4886-b69a-b57c24e62f94 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:54.397424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10006976-f321-4886-b69a-b57c24e62f94 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:54.398390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10006976-f321-4886-b69a-b57c24e62f94 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:54.398390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10006976-f321-4886-b69a-b57c24e62f94 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:54.399125 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10006976-f321-4886-b69a-b57c24e62f94 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:54.403136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10006976-f321-4886-b69a-b57c24e62f94 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:54.406811 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10006976-f321-4886-b69a-b57c24e62f94 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:55.274605 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-aee6af57-c485-47df-8249-345d7a9719a5 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110ebcc38ef34dfea40fe14ab2ad1b3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69def5e64d945428d420e737fecd987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:55.293566 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-aee6af57-c485-47df-8249-345d7a9719a5 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] 10.222.0.16 "GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320" status: 200 len: 1698 microversion: 2.1 time: 1.462962 Oct 05 02:39:55.310124 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1444/2916] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:53 2022] GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320 => generated 1698 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:39:55.330479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-15ff3208-4bcc-45df-8d13-4543763f136d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:55.334273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-15ff3208-4bcc-45df-8d13-4543763f136d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 057410e8-9ca0-477a-adec-60a7f9d7832d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:55.355039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15ff3208-4bcc-45df-8d13-4543763f136d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:55.355867 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15ff3208-4bcc-45df-8d13-4543763f136d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:55.361288 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15ff3208-4bcc-45df-8d13-4543763f136d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:55.362320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15ff3208-4bcc-45df-8d13-4543763f136d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:55.363196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15ff3208-4bcc-45df-8d13-4543763f136d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:55.363847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15ff3208-4bcc-45df-8d13-4543763f136d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:55.474633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-10006976-f321-4886-b69a-b57c24e62f94 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:55.494412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-10006976-f321-4886-b69a-b57c24e62f94 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:55.496500 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-10006976-f321-4886-b69a-b57c24e62f94 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:55.498934 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-10006976-f321-4886-b69a-b57c24e62f94 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1730 microversion: 2.20 time: 1.133127 Oct 05 02:39:55.508294 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1473/2917] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:39:54 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1730 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:39:55.514940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3383c74e-91ce-4055-a3d9-e27e75878031 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:55.515851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3383c74e-91ce-4055-a3d9-e27e75878031 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 36a8024b-dab8-454c-bcc3-65dcba09bbc0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:55.533513 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3383c74e-91ce-4055-a3d9-e27e75878031 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:55.534382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3383c74e-91ce-4055-a3d9-e27e75878031 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:55.535073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3383c74e-91ce-4055-a3d9-e27e75878031 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:55.536064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3383c74e-91ce-4055-a3d9-e27e75878031 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:55.536786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3383c74e-91ce-4055-a3d9-e27e75878031 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:55.541009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3383c74e-91ce-4055-a3d9-e27e75878031 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:55.745470 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-15ff3208-4bcc-45df-8d13-4543763f136d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:55.754084 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-15ff3208-4bcc-45df-8d13-4543763f136d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d" status: 200 len: 1317 microversion: 2.1 time: 0.442768 Oct 05 02:39:55.754671 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1445/2918] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:55 2022] GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d => generated 1317 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:55.773066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-19aeb1b9-a40b-43ed-a857-fc6cd7f10188 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:55.773694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-19aeb1b9-a40b-43ed-a857-fc6cd7f10188 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:55.803202 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19aeb1b9-a40b-43ed-a857-fc6cd7f10188 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:55.803715 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19aeb1b9-a40b-43ed-a857-fc6cd7f10188 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:55.804163 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19aeb1b9-a40b-43ed-a857-fc6cd7f10188 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:55.804886 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19aeb1b9-a40b-43ed-a857-fc6cd7f10188 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:55.805377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19aeb1b9-a40b-43ed-a857-fc6cd7f10188 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:55.805809 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19aeb1b9-a40b-43ed-a857-fc6cd7f10188 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:56.153251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3383c74e-91ce-4055-a3d9-e27e75878031 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:56.162787 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3383c74e-91ce-4055-a3d9-e27e75878031 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/36a8024b-dab8-454c-bcc3-65dcba09bbc0" status: 200 len: 1320 microversion: 2.1 time: 0.651912 Oct 05 02:39:56.182528 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1474/2919] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:55 2022] GET /compute/v2.1/servers/36a8024b-dab8-454c-bcc3-65dcba09bbc0 => generated 1320 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:56.322427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0d5e0dd4-cf9f-49c1-9a6e-a13093c5d3ea tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:56.323067 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0d5e0dd4-cf9f-49c1-9a6e-a13093c5d3ea tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] [instance: b834e68c-772a-45b6-857b-0cb285b1e320] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:56.338946 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d5e0dd4-cf9f-49c1-9a6e-a13093c5d3ea tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:56.339452 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d5e0dd4-cf9f-49c1-9a6e-a13093c5d3ea tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:56.339897 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d5e0dd4-cf9f-49c1-9a6e-a13093c5d3ea tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:56.340631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d5e0dd4-cf9f-49c1-9a6e-a13093c5d3ea tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:56.341133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d5e0dd4-cf9f-49c1-9a6e-a13093c5d3ea tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:56.341585 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d5e0dd4-cf9f-49c1-9a6e-a13093c5d3ea tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:56.384379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-19aeb1b9-a40b-43ed-a857-fc6cd7f10188 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:56.393321 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-19aeb1b9-a40b-43ed-a857-fc6cd7f10188 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1312 microversion: 2.1 time: 0.628121 Oct 05 02:39:56.409126 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1446/2920] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:55 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1312 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:56.541394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-443d6979-b45a-4aa9-8bcc-db493a856bc5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:56.549864 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-443d6979-b45a-4aa9-8bcc-db493a856bc5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:56.559802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-443d6979-b45a-4aa9-8bcc-db493a856bc5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:56.560584 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-443d6979-b45a-4aa9-8bcc-db493a856bc5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:56.561365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-443d6979-b45a-4aa9-8bcc-db493a856bc5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:56.562249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-443d6979-b45a-4aa9-8bcc-db493a856bc5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:56.562874 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-443d6979-b45a-4aa9-8bcc-db493a856bc5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:56.570636 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-443d6979-b45a-4aa9-8bcc-db493a856bc5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:56.754137 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0d5e0dd4-cf9f-49c1-9a6e-a13093c5d3ea tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110ebcc38ef34dfea40fe14ab2ad1b3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69def5e64d945428d420e737fecd987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:56.765489 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0d5e0dd4-cf9f-49c1-9a6e-a13093c5d3ea tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] 10.222.0.16 "GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320" status: 200 len: 1698 microversion: 2.1 time: 0.447708 Oct 05 02:39:56.782433 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1475/2921] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:56 2022] GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320 => generated 1698 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:56.800006 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4ef2192b-2d34-4a6f-ad44-2c289c3274e8 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:56.801025 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4ef2192b-2d34-4a6f-ad44-2c289c3274e8 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 057410e8-9ca0-477a-adec-60a7f9d7832d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:56.805531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-443d6979-b45a-4aa9-8bcc-db493a856bc5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:56.818502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-443d6979-b45a-4aa9-8bcc-db493a856bc5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:56.823314 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-443d6979-b45a-4aa9-8bcc-db493a856bc5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:56.827127 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ef2192b-2d34-4a6f-ad44-2c289c3274e8 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:56.832011 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-443d6979-b45a-4aa9-8bcc-db493a856bc5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1730 microversion: 2.20 time: 0.298842 Oct 05 02:39:56.836619 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1447/2922] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:39:56 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1730 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:39:56.837440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ef2192b-2d34-4a6f-ad44-2c289c3274e8 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:56.843636 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ef2192b-2d34-4a6f-ad44-2c289c3274e8 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:56.845835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ef2192b-2d34-4a6f-ad44-2c289c3274e8 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:56.846887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ef2192b-2d34-4a6f-ad44-2c289c3274e8 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:56.849048 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ef2192b-2d34-4a6f-ad44-2c289c3274e8 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:57.157567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4ef2192b-2d34-4a6f-ad44-2c289c3274e8 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:57.175079 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4ef2192b-2d34-4a6f-ad44-2c289c3274e8 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d" status: 200 len: 1317 microversion: 2.1 time: 0.385534 Oct 05 02:39:57.175676 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1476/2923] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:56 2022] GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d => generated 1317 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:57.190775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d8ddf600-f8c3-4b15-8c6b-92f011e0da02 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:57.191849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d8ddf600-f8c3-4b15-8c6b-92f011e0da02 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 36a8024b-dab8-454c-bcc3-65dcba09bbc0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:57.203393 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8ddf600-f8c3-4b15-8c6b-92f011e0da02 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:57.207756 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8ddf600-f8c3-4b15-8c6b-92f011e0da02 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:57.208193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8ddf600-f8c3-4b15-8c6b-92f011e0da02 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:57.209044 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8ddf600-f8c3-4b15-8c6b-92f011e0da02 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:57.209509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8ddf600-f8c3-4b15-8c6b-92f011e0da02 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:57.209944 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8ddf600-f8c3-4b15-8c6b-92f011e0da02 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:57.420052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a46eb3be-ecbd-4236-a9af-7097db7dbc02 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:57.420940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a46eb3be-ecbd-4236-a9af-7097db7dbc02 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:57.437734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a46eb3be-ecbd-4236-a9af-7097db7dbc02 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:57.442871 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a46eb3be-ecbd-4236-a9af-7097db7dbc02 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:57.446994 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a46eb3be-ecbd-4236-a9af-7097db7dbc02 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:57.447993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a46eb3be-ecbd-4236-a9af-7097db7dbc02 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:57.448468 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a46eb3be-ecbd-4236-a9af-7097db7dbc02 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:57.448963 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a46eb3be-ecbd-4236-a9af-7097db7dbc02 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:57.476867 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d8ddf600-f8c3-4b15-8c6b-92f011e0da02 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:57.485060 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d8ddf600-f8c3-4b15-8c6b-92f011e0da02 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/36a8024b-dab8-454c-bcc3-65dcba09bbc0" status: 200 len: 1320 microversion: 2.1 time: 0.299058 Oct 05 02:39:57.485901 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1448/2924] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:57 2022] GET /compute/v2.1/servers/36a8024b-dab8-454c-bcc3-65dcba09bbc0 => generated 1320 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:57.796446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1794d49f-6620-426e-b3e2-9182bfe3db7f tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:57.797111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1794d49f-6620-426e-b3e2-9182bfe3db7f tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] [instance: b834e68c-772a-45b6-857b-0cb285b1e320] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:57.804422 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a46eb3be-ecbd-4236-a9af-7097db7dbc02 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:57.806398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1794d49f-6620-426e-b3e2-9182bfe3db7f tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:57.806896 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1794d49f-6620-426e-b3e2-9182bfe3db7f tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:57.807339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1794d49f-6620-426e-b3e2-9182bfe3db7f tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:57.808041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1794d49f-6620-426e-b3e2-9182bfe3db7f tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:57.811213 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1794d49f-6620-426e-b3e2-9182bfe3db7f tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:57.813402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1794d49f-6620-426e-b3e2-9182bfe3db7f tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:57.819191 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a46eb3be-ecbd-4236-a9af-7097db7dbc02 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1312 microversion: 2.1 time: 0.403331 Oct 05 02:39:57.820711 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1477/2925] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:57 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1312 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:39:57.865986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d156b0d4-a1ff-45ed-9ae1-1fc7f2d002bf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:57.866845 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d156b0d4-a1ff-45ed-9ae1-1fc7f2d002bf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:57.874565 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d156b0d4-a1ff-45ed-9ae1-1fc7f2d002bf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:57.877534 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d156b0d4-a1ff-45ed-9ae1-1fc7f2d002bf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:57.877984 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d156b0d4-a1ff-45ed-9ae1-1fc7f2d002bf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:57.878705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d156b0d4-a1ff-45ed-9ae1-1fc7f2d002bf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:57.879278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d156b0d4-a1ff-45ed-9ae1-1fc7f2d002bf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:57.879575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d156b0d4-a1ff-45ed-9ae1-1fc7f2d002bf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:58.354782 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1794d49f-6620-426e-b3e2-9182bfe3db7f tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110ebcc38ef34dfea40fe14ab2ad1b3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69def5e64d945428d420e737fecd987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:58.363490 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1794d49f-6620-426e-b3e2-9182bfe3db7f tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] 10.222.0.16 "GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320" status: 200 len: 1698 microversion: 2.1 time: 0.571254 Oct 05 02:39:58.367171 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1449/2926] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:57 2022] GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320 => generated 1698 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:39:58.378307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d156b0d4-a1ff-45ed-9ae1-1fc7f2d002bf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:58.393828 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d156b0d4-a1ff-45ed-9ae1-1fc7f2d002bf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:58.401750 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d156b0d4-a1ff-45ed-9ae1-1fc7f2d002bf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:58.403300 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0cfdc34e-e092-4d4c-b28a-8a10761afd2b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:58.406462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0cfdc34e-e092-4d4c-b28a-8a10761afd2b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 057410e8-9ca0-477a-adec-60a7f9d7832d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:58.408969 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d156b0d4-a1ff-45ed-9ae1-1fc7f2d002bf tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1730 microversion: 2.20 time: 0.547278 Oct 05 02:39:58.415560 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1478/2927] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:39:57 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1730 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:39:58.439638 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0cfdc34e-e092-4d4c-b28a-8a10761afd2b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:58.440866 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0cfdc34e-e092-4d4c-b28a-8a10761afd2b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:58.442133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0cfdc34e-e092-4d4c-b28a-8a10761afd2b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:58.444141 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0cfdc34e-e092-4d4c-b28a-8a10761afd2b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:58.445773 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0cfdc34e-e092-4d4c-b28a-8a10761afd2b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:58.447138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0cfdc34e-e092-4d4c-b28a-8a10761afd2b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:58.511034 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-29054317-cc14-4f0d-ae5f-63f67759ac5e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:58.512082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-29054317-cc14-4f0d-ae5f-63f67759ac5e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 36a8024b-dab8-454c-bcc3-65dcba09bbc0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:58.533337 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29054317-cc14-4f0d-ae5f-63f67759ac5e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:58.537948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29054317-cc14-4f0d-ae5f-63f67759ac5e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:58.541968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29054317-cc14-4f0d-ae5f-63f67759ac5e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:58.559569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29054317-cc14-4f0d-ae5f-63f67759ac5e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:58.560710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29054317-cc14-4f0d-ae5f-63f67759ac5e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:58.564752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29054317-cc14-4f0d-ae5f-63f67759ac5e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:58.765016 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:39:58.788207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0cfdc34e-e092-4d4c-b28a-8a10761afd2b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:58.824645 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0cfdc34e-e092-4d4c-b28a-8a10761afd2b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d" status: 200 len: 1317 microversion: 2.1 time: 0.448835 Oct 05 02:39:58.829259 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1450/2928] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:58 2022] GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d => generated 1317 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:58.847140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-73675bed-4ddd-4ca5-b347-7d8abce97dda tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:58.850280 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-73675bed-4ddd-4ca5-b347-7d8abce97dda tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:58.876104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-73675bed-4ddd-4ca5-b347-7d8abce97dda tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:58.882880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-73675bed-4ddd-4ca5-b347-7d8abce97dda tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:58.884756 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-73675bed-4ddd-4ca5-b347-7d8abce97dda tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:58.886979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-73675bed-4ddd-4ca5-b347-7d8abce97dda tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:58.894805 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-73675bed-4ddd-4ca5-b347-7d8abce97dda tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:58.900088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-73675bed-4ddd-4ca5-b347-7d8abce97dda tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:59.299041 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-29054317-cc14-4f0d-ae5f-63f67759ac5e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:59.317678 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-29054317-cc14-4f0d-ae5f-63f67759ac5e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/36a8024b-dab8-454c-bcc3-65dcba09bbc0" status: 200 len: 1320 microversion: 2.1 time: 0.810392 Oct 05 02:39:59.321193 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1479/2929] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:58 2022] GET /compute/v2.1/servers/36a8024b-dab8-454c-bcc3-65dcba09bbc0 => generated 1320 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:59.347374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-f521027f-8fa1-4b91-b67a-31236dd9d7c5 req-6753bb00-5cb7-4710-b442-66e6c95aa986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36a8024b-dab8-454c-bcc3-65dcba09bbc0", "name": "network-vif-plugged", "status": "completed", "tag": "96f234d9-01d0-449d-95b5-8ff6d63d7cd7"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:39:59.378999 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f521027f-8fa1-4b91-b67a-31236dd9d7c5 req-6753bb00-5cb7-4710-b442-66e6c95aa986 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:59.380562 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f521027f-8fa1-4b91-b67a-31236dd9d7c5 req-6753bb00-5cb7-4710-b442-66e6c95aa986 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:59.381657 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f521027f-8fa1-4b91-b67a-31236dd9d7c5 req-6753bb00-5cb7-4710-b442-66e6c95aa986 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:59.405587 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-f521027f-8fa1-4b91-b67a-31236dd9d7c5 req-6753bb00-5cb7-4710-b442-66e6c95aa986 service nova] Creating event network-vif-plugged:96f234d9-01d0-449d-95b5-8ff6d63d7cd7 for instance 36a8024b-dab8-454c-bcc3-65dcba09bbc0 on n-h2-858272-3 Oct 05 02:39:59.414344 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-f521027f-8fa1-4b91-b67a-31236dd9d7c5 req-6753bb00-5cb7-4710-b442-66e6c95aa986 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091542 Oct 05 02:39:59.415617 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1480/2930] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:39:59.423681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f6d39884-64c7-463f-bfa5-ccb0ab9ff4e8 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:59.425099 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f6d39884-64c7-463f-bfa5-ccb0ab9ff4e8 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] [instance: b834e68c-772a-45b6-857b-0cb285b1e320] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:59.435821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6d39884-64c7-463f-bfa5-ccb0ab9ff4e8 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:59.436806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6d39884-64c7-463f-bfa5-ccb0ab9ff4e8 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:59.437859 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6d39884-64c7-463f-bfa5-ccb0ab9ff4e8 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:59.440479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6d39884-64c7-463f-bfa5-ccb0ab9ff4e8 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:59.441340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6d39884-64c7-463f-bfa5-ccb0ab9ff4e8 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:59.441972 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6d39884-64c7-463f-bfa5-ccb0ab9ff4e8 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:59.450883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-73675bed-4ddd-4ca5-b347-7d8abce97dda tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:59.468855 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-73675bed-4ddd-4ca5-b347-7d8abce97dda tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1312 microversion: 2.1 time: 0.617782 Oct 05 02:39:59.470017 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1451/2931] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:58 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1312 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:39:59.485052 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e83e1254-de06-4f37-8086-724e737bb39f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:59.486549 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e83e1254-de06-4f37-8086-724e737bb39f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:59.501609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e83e1254-de06-4f37-8086-724e737bb39f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:59.507132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e83e1254-de06-4f37-8086-724e737bb39f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:59.507891 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e83e1254-de06-4f37-8086-724e737bb39f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:59.523801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e83e1254-de06-4f37-8086-724e737bb39f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:59.527235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e83e1254-de06-4f37-8086-724e737bb39f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:59.527982 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e83e1254-de06-4f37-8086-724e737bb39f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:59.590354 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f6d39884-64c7-463f-bfa5-ccb0ab9ff4e8 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110ebcc38ef34dfea40fe14ab2ad1b3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69def5e64d945428d420e737fecd987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:59.599014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:39:59.606116 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f6d39884-64c7-463f-bfa5-ccb0ab9ff4e8 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] 10.222.0.16 "GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320" status: 200 len: 1631 microversion: 2.1 time: 0.189036 Oct 05 02:39:59.618740 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:39:59.630229 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1481/2932] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:59 2022] GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320 => generated 1631 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:39:59.859613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-41b085c8-f8f0-4d65-a874-293de662c965 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:39:59.860646 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-41b085c8-f8f0-4d65-a874-293de662c965 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 057410e8-9ca0-477a-adec-60a7f9d7832d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:39:59.861486 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e83e1254-de06-4f37-8086-724e737bb39f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:59.871545 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e83e1254-de06-4f37-8086-724e737bb39f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:59.874982 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e83e1254-de06-4f37-8086-724e737bb39f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:39:59.876430 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e83e1254-de06-4f37-8086-724e737bb39f tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1730 microversion: 2.20 time: 0.402304 Oct 05 02:39:59.877621 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-41b085c8-f8f0-4d65-a874-293de662c965 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:59.877980 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1452/2933] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:39:59 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1730 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:39:59.878157 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-41b085c8-f8f0-4d65-a874-293de662c965 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:59.881645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-41b085c8-f8f0-4d65-a874-293de662c965 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:39:59.883404 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-41b085c8-f8f0-4d65-a874-293de662c965 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:39:59.884052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-41b085c8-f8f0-4d65-a874-293de662c965 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:39:59.884776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-41b085c8-f8f0-4d65-a874-293de662c965 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:00.287587 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-41b085c8-f8f0-4d65-a874-293de662c965 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:00.302954 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-41b085c8-f8f0-4d65-a874-293de662c965 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d" status: 200 len: 1317 microversion: 2.1 time: 0.446048 Oct 05 02:40:00.305010 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1482/2934] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:39:59 2022] GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d => generated 1317 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:40:00.353613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-489b407d-573e-4a2a-8c8c-5cf357876c5c tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:00.361201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-489b407d-573e-4a2a-8c8c-5cf357876c5c tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 36a8024b-dab8-454c-bcc3-65dcba09bbc0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:00.374833 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-489b407d-573e-4a2a-8c8c-5cf357876c5c tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:00.376565 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-489b407d-573e-4a2a-8c8c-5cf357876c5c tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:00.379096 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-489b407d-573e-4a2a-8c8c-5cf357876c5c tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:00.380123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-489b407d-573e-4a2a-8c8c-5cf357876c5c tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:00.381880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-489b407d-573e-4a2a-8c8c-5cf357876c5c tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:00.382577 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-489b407d-573e-4a2a-8c8c-5cf357876c5c tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:00.508672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-500bd2fb-f395-45f8-b582-c11e267afbc3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:00.512066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-500bd2fb-f395-45f8-b582-c11e267afbc3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:00.539973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-500bd2fb-f395-45f8-b582-c11e267afbc3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:00.540424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-500bd2fb-f395-45f8-b582-c11e267afbc3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:00.542043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-500bd2fb-f395-45f8-b582-c11e267afbc3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:00.551607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-500bd2fb-f395-45f8-b582-c11e267afbc3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:00.551607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-500bd2fb-f395-45f8-b582-c11e267afbc3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:00.551607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-500bd2fb-f395-45f8-b582-c11e267afbc3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:01.453314 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-489b407d-573e-4a2a-8c8c-5cf357876c5c tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:01.461769 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-489b407d-573e-4a2a-8c8c-5cf357876c5c tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/36a8024b-dab8-454c-bcc3-65dcba09bbc0" status: 200 len: 1320 microversion: 2.1 time: 1.118004 Oct 05 02:40:01.464932 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1453/2935] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:00 2022] GET /compute/v2.1/servers/36a8024b-dab8-454c-bcc3-65dcba09bbc0 => generated 1320 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:01.483050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1407a25c-5baf-4c66-bd47-b7efab393f3e tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:01.487229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1407a25c-5baf-4c66-bd47-b7efab393f3e tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] [instance: b834e68c-772a-45b6-857b-0cb285b1e320] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:01.508350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1407a25c-5baf-4c66-bd47-b7efab393f3e tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:01.520561 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1407a25c-5baf-4c66-bd47-b7efab393f3e tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:01.521321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1407a25c-5baf-4c66-bd47-b7efab393f3e tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:01.522268 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1407a25c-5baf-4c66-bd47-b7efab393f3e tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:01.524241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1407a25c-5baf-4c66-bd47-b7efab393f3e tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:01.524887 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1407a25c-5baf-4c66-bd47-b7efab393f3e tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:01.578600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:40:01.601617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1407a25c-5baf-4c66-bd47-b7efab393f3e tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:01.602357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1407a25c-5baf-4c66-bd47-b7efab393f3e tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:01.602986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1407a25c-5baf-4c66-bd47-b7efab393f3e tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:01.603785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-1407a25c-5baf-4c66-bd47-b7efab393f3e tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lazy-loading 'fault' on Instance uuid b834e68c-772a-45b6-857b-0cb285b1e320 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:40:01.819198 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-500bd2fb-f395-45f8-b582-c11e267afbc3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:01.836746 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-500bd2fb-f395-45f8-b582-c11e267afbc3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1312 microversion: 2.1 time: 1.340322 Oct 05 02:40:01.853020 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1483/2936] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:00 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1312 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:01.853346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1407a25c-5baf-4c66-bd47-b7efab393f3e tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110ebcc38ef34dfea40fe14ab2ad1b3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69def5e64d945428d420e737fecd987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:01.853458 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-03b32cbb-e164-4e5f-87e5-d95349f62573 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:01.853458 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-03b32cbb-e164-4e5f-87e5-d95349f62573 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:01.861590 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1407a25c-5baf-4c66-bd47-b7efab393f3e tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] 10.222.0.16 "GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320" status: 200 len: 1357 microversion: 2.1 time: 0.394208 Oct 05 02:40:01.868590 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1454/2937] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:01 2022] GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320 => generated 1357 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:01.876634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-19b6a8d1-38b9-4725-9bd8-e60dbd2bfee8 req-89d4e6b3-52bd-468f-a99b-23e6abbc054e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b834e68c-772a-45b6-857b-0cb285b1e320", "name": "network-vif-deleted", "tag": "36f2563c-c845-4290-89b1-ae30ad6d77c8"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:01.894470 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03b32cbb-e164-4e5f-87e5-d95349f62573 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:01.894980 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03b32cbb-e164-4e5f-87e5-d95349f62573 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:01.895423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03b32cbb-e164-4e5f-87e5-d95349f62573 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:01.905621 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03b32cbb-e164-4e5f-87e5-d95349f62573 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:01.906545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03b32cbb-e164-4e5f-87e5-d95349f62573 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:01.906999 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03b32cbb-e164-4e5f-87e5-d95349f62573 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:01.918769 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:40:01.927805 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-19b6a8d1-38b9-4725-9bd8-e60dbd2bfee8 req-89d4e6b3-52bd-468f-a99b-23e6abbc054e service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:01.928970 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-19b6a8d1-38b9-4725-9bd8-e60dbd2bfee8 req-89d4e6b3-52bd-468f-a99b-23e6abbc054e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:01.929902 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-19b6a8d1-38b9-4725-9bd8-e60dbd2bfee8 req-89d4e6b3-52bd-468f-a99b-23e6abbc054e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:01.956835 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-19b6a8d1-38b9-4725-9bd8-e60dbd2bfee8 req-89d4e6b3-52bd-468f-a99b-23e6abbc054e service nova] Creating event network-vif-deleted:36f2563c-c845-4290-89b1-ae30ad6d77c8 for instance b834e68c-772a-45b6-857b-0cb285b1e320 on n-h2-858272-3 Oct 05 02:40:01.964576 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-19b6a8d1-38b9-4725-9bd8-e60dbd2bfee8 req-89d4e6b3-52bd-468f-a99b-23e6abbc054e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094176 Oct 05 02:40:01.965872 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1455/2938] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:01.977118 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cb4f6796-22c2-4f63-9258-bd4c6dc1af43 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:01.982154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cb4f6796-22c2-4f63-9258-bd4c6dc1af43 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 057410e8-9ca0-477a-adec-60a7f9d7832d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:02.029574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb4f6796-22c2-4f63-9258-bd4c6dc1af43 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:02.030460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb4f6796-22c2-4f63-9258-bd4c6dc1af43 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:02.031147 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb4f6796-22c2-4f63-9258-bd4c6dc1af43 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:02.032091 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb4f6796-22c2-4f63-9258-bd4c6dc1af43 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:02.032757 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb4f6796-22c2-4f63-9258-bd4c6dc1af43 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:02.034228 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb4f6796-22c2-4f63-9258-bd4c6dc1af43 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:03.191759 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-03b32cbb-e164-4e5f-87e5-d95349f62573 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:03.199232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-03b32cbb-e164-4e5f-87e5-d95349f62573 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:03.206913 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-03b32cbb-e164-4e5f-87e5-d95349f62573 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:03.208162 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-03b32cbb-e164-4e5f-87e5-d95349f62573 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1730 microversion: 2.20 time: 1.365080 Oct 05 02:40:03.220615 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1484/2939] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:40:01 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1730 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:40:03.227207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-aa0cb268-638e-48f4-91ce-1bb433198714 req-57b7c31c-f8f7-4745-9d22-dbdf231d4ace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29215d80-fdc9-408d-b885-e6f3a5f7da84", "name": "network-vif-plugged", "status": "completed", "tag": "167e3597-f727-40a3-a743-6b1d1d8a0217"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:03.255722 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-aa0cb268-638e-48f4-91ce-1bb433198714 req-57b7c31c-f8f7-4745-9d22-dbdf231d4ace service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:03.259622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-aa0cb268-638e-48f4-91ce-1bb433198714 req-57b7c31c-f8f7-4745-9d22-dbdf231d4ace service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:03.260281 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-aa0cb268-638e-48f4-91ce-1bb433198714 req-57b7c31c-f8f7-4745-9d22-dbdf231d4ace service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:03.285585 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-aa0cb268-638e-48f4-91ce-1bb433198714 req-57b7c31c-f8f7-4745-9d22-dbdf231d4ace service nova] Creating event network-vif-plugged:167e3597-f727-40a3-a743-6b1d1d8a0217 for instance 29215d80-fdc9-408d-b885-e6f3a5f7da84 on n-h1-858272-3 Oct 05 02:40:03.298734 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-aa0cb268-638e-48f4-91ce-1bb433198714 req-57b7c31c-f8f7-4745-9d22-dbdf231d4ace service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076184 Oct 05 02:40:03.299635 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1485/2940] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:03.306089 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e68306c6-d685-4816-a7c5-08025253cf66 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:03.315704 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e68306c6-d685-4816-a7c5-08025253cf66 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 36a8024b-dab8-454c-bcc3-65dcba09bbc0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:03.319484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cb4f6796-22c2-4f63-9258-bd4c6dc1af43 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:03.326968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e68306c6-d685-4816-a7c5-08025253cf66 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:03.329558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e68306c6-d685-4816-a7c5-08025253cf66 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:03.330210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e68306c6-d685-4816-a7c5-08025253cf66 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:03.331291 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e68306c6-d685-4816-a7c5-08025253cf66 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:03.335580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e68306c6-d685-4816-a7c5-08025253cf66 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:03.336373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e68306c6-d685-4816-a7c5-08025253cf66 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:03.345259 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cb4f6796-22c2-4f63-9258-bd4c6dc1af43 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d" status: 200 len: 1317 microversion: 2.1 time: 1.374143 Oct 05 02:40:03.349339 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1456/2941] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:01 2022] GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d => generated 1317 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:03.381724 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7dfe9044-b44a-4a6b-a29a-510ada284008 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:03.382768 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7dfe9044-b44a-4a6b-a29a-510ada284008 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:03.420678 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7dfe9044-b44a-4a6b-a29a-510ada284008 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:03.423520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7dfe9044-b44a-4a6b-a29a-510ada284008 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:03.424094 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7dfe9044-b44a-4a6b-a29a-510ada284008 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:03.425750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7dfe9044-b44a-4a6b-a29a-510ada284008 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:03.426608 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7dfe9044-b44a-4a6b-a29a-510ada284008 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:03.429725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7dfe9044-b44a-4a6b-a29a-510ada284008 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:03.798378 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7dfe9044-b44a-4a6b-a29a-510ada284008 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:03.807220 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7dfe9044-b44a-4a6b-a29a-510ada284008 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1312 microversion: 2.1 time: 0.455183 Oct 05 02:40:03.815143 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1457/2942] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:03 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1312 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:03.820678 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-85e12183-722d-4dc1-9905-0bdeca9d7c75 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:03.826227 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-85e12183-722d-4dc1-9905-0bdeca9d7c75 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] [instance: b834e68c-772a-45b6-857b-0cb285b1e320] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:03.832764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-85e12183-722d-4dc1-9905-0bdeca9d7c75 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:03.839539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-85e12183-722d-4dc1-9905-0bdeca9d7c75 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:03.842561 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-85e12183-722d-4dc1-9905-0bdeca9d7c75 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:03.843529 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-85e12183-722d-4dc1-9905-0bdeca9d7c75 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:03.844178 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-85e12183-722d-4dc1-9905-0bdeca9d7c75 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:03.844792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-85e12183-722d-4dc1-9905-0bdeca9d7c75 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:03.871784 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-85e12183-722d-4dc1-9905-0bdeca9d7c75 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] HTTP exception thrown: Instance b834e68c-772a-45b6-857b-0cb285b1e320 could not be found. Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-85e12183-722d-4dc1-9905-0bdeca9d7c75 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Request method failure captured: Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320 HTTP/1.1 Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO4EKVRSB1UU35SPeVvZYaCmvgHJvELF8aXZZHEevhiPSrO_D0Kx-cxwaYwWJ2At_Ga9fVGCTQ4NNFSx28dshGSpbSDGl1QyLrbAY397CTdRYPB4VsfyEsL88tSl5O8OirpXfwUGpQyqnZ4eIM2q9yTnblTGv74-sngTiK94e0cNFlQ Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: d69def5e64d945428d420e737fecd987 Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersTestJSON-66904309 Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d69def5e64d945428d420e737fecd987"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d69def5e64d945428d420e737fecd987"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d69def5e64d945428d420e737fecd987"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d69def5e64d945428d420e737fecd987"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersTestJSON-66904309 Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: d69def5e64d945428d420e737fecd987 Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersTestJSON-66904309 Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersTestJSON-66904309-project Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 110ebcc38ef34dfea40fe14ab2ad1b3d Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersTestJSON-66904309-project Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance b834e68c-772a-45b6-857b-0cb285b1e320 could not be found. Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'b834e68c-772a-45b6-857b-0cb285b1e320'} Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b834e68c-772a-45b6-857b-0cb285b1e320 could not be found. Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b834e68c-772a-45b6-857b-0cb285b1e320 could not be found. Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:40:03.884099 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:40:03.889262 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:40:03.889262 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:40:03.889262 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:40:03.889262 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:40:03.889262 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b834e68c-772a-45b6-857b-0cb285b1e320 could not be found. Oct 05 02:40:03.889262 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:40:03.890424 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-85e12183-722d-4dc1-9905-0bdeca9d7c75 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Returning 404 to user: Instance b834e68c-772a-45b6-857b-0cb285b1e320 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:40:03.891470 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-85e12183-722d-4dc1-9905-0bdeca9d7c75 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] 10.222.0.16 "GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320" status: 404 len: 111 microversion: 2.1 time: 0.075093 Oct 05 02:40:03.892216 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1458/2943] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:03 2022] GET /compute/v2.1/servers/b834e68c-772a-45b6-857b-0cb285b1e320 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:40:03.900861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-84a48442-42f0-47b8-bf9c-a909a0dbcd57 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] Calling method '.version_select at 0x7fccdf2c4820>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:03.925487 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-84a48442-42f0-47b8-bf9c-a909a0dbcd57 tempest-ServersTestJSON-66904309 tempest-ServersTestJSON-66904309-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-654692082" status: 202 len: 0 microversion: 2.1 time: 0.028304 Oct 05 02:40:03.928170 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1459/2944] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 5 02:40:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-654692082 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:40:04.007712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e68306c6-d685-4816-a7c5-08025253cf66 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:04.020429 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e68306c6-d685-4816-a7c5-08025253cf66 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/36a8024b-dab8-454c-bcc3-65dcba09bbc0" status: 200 len: 1509 microversion: 2.1 time: 0.719161 Oct 05 02:40:04.022009 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1486/2945] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:03 2022] GET /compute/v2.1/servers/36a8024b-dab8-454c-bcc3-65dcba09bbc0 => generated 1509 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:04.049217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-952b9f5e-092f-4c16-ab52-ff44132b2782 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:04.050156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-952b9f5e-092f-4c16-ab52-ff44132b2782 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 15bedd7a-7fb7-40e2-bf87-729192d754aa] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:04.064037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-952b9f5e-092f-4c16-ab52-ff44132b2782 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:04.065025 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-952b9f5e-092f-4c16-ab52-ff44132b2782 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:04.065654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-952b9f5e-092f-4c16-ab52-ff44132b2782 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:04.066898 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-952b9f5e-092f-4c16-ab52-ff44132b2782 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:04.069551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-952b9f5e-092f-4c16-ab52-ff44132b2782 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:04.070211 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-952b9f5e-092f-4c16-ab52-ff44132b2782 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:04.243531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3dc1234d-1161-435e-a081-5c25eeb68429 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:04.244731 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3dc1234d-1161-435e-a081-5c25eeb68429 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:04.254133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3dc1234d-1161-435e-a081-5c25eeb68429 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:04.254907 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3dc1234d-1161-435e-a081-5c25eeb68429 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:04.256092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3dc1234d-1161-435e-a081-5c25eeb68429 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:04.257026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3dc1234d-1161-435e-a081-5c25eeb68429 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:04.258660 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3dc1234d-1161-435e-a081-5c25eeb68429 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:04.259653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3dc1234d-1161-435e-a081-5c25eeb68429 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:04.746683 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-952b9f5e-092f-4c16-ab52-ff44132b2782 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:04.765457 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-952b9f5e-092f-4c16-ab52-ff44132b2782 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/15bedd7a-7fb7-40e2-bf87-729192d754aa" status: 200 len: 1320 microversion: 2.1 time: 0.717674 Oct 05 02:40:04.768465 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1460/2946] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:04 2022] GET /compute/v2.1/servers/15bedd7a-7fb7-40e2-bf87-729192d754aa => generated 1320 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:04.781576 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-edb4bece-6367-4d0c-8881-2e69e1fb54b1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:04.783431 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-edb4bece-6367-4d0c-8881-2e69e1fb54b1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 057410e8-9ca0-477a-adec-60a7f9d7832d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:04.801143 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-edb4bece-6367-4d0c-8881-2e69e1fb54b1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:04.801646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-edb4bece-6367-4d0c-8881-2e69e1fb54b1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:04.802123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-edb4bece-6367-4d0c-8881-2e69e1fb54b1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:04.802845 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-edb4bece-6367-4d0c-8881-2e69e1fb54b1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:04.803302 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-edb4bece-6367-4d0c-8881-2e69e1fb54b1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:04.803729 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-edb4bece-6367-4d0c-8881-2e69e1fb54b1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:05.095840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3dc1234d-1161-435e-a081-5c25eeb68429 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:05.132435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3dc1234d-1161-435e-a081-5c25eeb68429 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:05.139456 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3dc1234d-1161-435e-a081-5c25eeb68429 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:05.149617 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3dc1234d-1161-435e-a081-5c25eeb68429 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1730 microversion: 2.20 time: 0.913435 Oct 05 02:40:05.170443 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1487/2947] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:40:04 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1730 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:40:05.194412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bdea2936-8bf2-4802-86cd-75fbb5ed5274 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:05.197540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bdea2936-8bf2-4802-86cd-75fbb5ed5274 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:05.215322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bdea2936-8bf2-4802-86cd-75fbb5ed5274 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:05.219039 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bdea2936-8bf2-4802-86cd-75fbb5ed5274 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:05.221764 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bdea2936-8bf2-4802-86cd-75fbb5ed5274 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:05.222796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bdea2936-8bf2-4802-86cd-75fbb5ed5274 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:05.225505 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bdea2936-8bf2-4802-86cd-75fbb5ed5274 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:05.226571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bdea2936-8bf2-4802-86cd-75fbb5ed5274 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:05.852179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-edb4bece-6367-4d0c-8881-2e69e1fb54b1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:05.873397 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-edb4bece-6367-4d0c-8881-2e69e1fb54b1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d" status: 200 len: 1317 microversion: 2.1 time: 1.102219 Oct 05 02:40:05.876728 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1461/2948] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:04 2022] GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d => generated 1317 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:05.898854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0b6b8511-ecb2-4862-b6ff-7ab3336cfbd4 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:05.904270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0b6b8511-ecb2-4862-b6ff-7ab3336cfbd4 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 15bedd7a-7fb7-40e2-bf87-729192d754aa] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:05.933159 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b6b8511-ecb2-4862-b6ff-7ab3336cfbd4 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:05.935373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b6b8511-ecb2-4862-b6ff-7ab3336cfbd4 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:05.936186 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b6b8511-ecb2-4862-b6ff-7ab3336cfbd4 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:05.937326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b6b8511-ecb2-4862-b6ff-7ab3336cfbd4 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:05.938143 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b6b8511-ecb2-4862-b6ff-7ab3336cfbd4 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:05.939253 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b6b8511-ecb2-4862-b6ff-7ab3336cfbd4 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:06.512233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bdea2936-8bf2-4802-86cd-75fbb5ed5274 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:06.534366 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bdea2936-8bf2-4802-86cd-75fbb5ed5274 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1312 microversion: 2.1 time: 1.362551 Oct 05 02:40:06.544984 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1488/2949] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:05 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1312 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:06.554727 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-60e0e5f1-be59-4251-93c7-31081efb281b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:06.555369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-60e0e5f1-be59-4251-93c7-31081efb281b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:06.566082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60e0e5f1-be59-4251-93c7-31081efb281b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:06.566792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60e0e5f1-be59-4251-93c7-31081efb281b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:06.568531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60e0e5f1-be59-4251-93c7-31081efb281b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:06.569690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60e0e5f1-be59-4251-93c7-31081efb281b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:06.571901 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60e0e5f1-be59-4251-93c7-31081efb281b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:06.572531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60e0e5f1-be59-4251-93c7-31081efb281b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:06.859576 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0b6b8511-ecb2-4862-b6ff-7ab3336cfbd4 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:06.903393 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0b6b8511-ecb2-4862-b6ff-7ab3336cfbd4 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/15bedd7a-7fb7-40e2-bf87-729192d754aa" status: 200 len: 1320 microversion: 2.1 time: 1.019595 Oct 05 02:40:06.905004 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1462/2950] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:05 2022] GET /compute/v2.1/servers/15bedd7a-7fb7-40e2-bf87-729192d754aa => generated 1320 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:06.933369 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-c091791a-4eb2-42a5-a3b1-abb670530217 req-ad148f40-3c2e-4314-b105-5fbe8f2299ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15bedd7a-7fb7-40e2-bf87-729192d754aa", "name": "network-vif-plugged", "status": "completed", "tag": "52c5cb9e-fb3c-49d0-b036-314e66927957"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:06.976576 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c091791a-4eb2-42a5-a3b1-abb670530217 req-ad148f40-3c2e-4314-b105-5fbe8f2299ac service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:06.977455 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c091791a-4eb2-42a5-a3b1-abb670530217 req-ad148f40-3c2e-4314-b105-5fbe8f2299ac service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:06.978880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c091791a-4eb2-42a5-a3b1-abb670530217 req-ad148f40-3c2e-4314-b105-5fbe8f2299ac service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:06.998813 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-c091791a-4eb2-42a5-a3b1-abb670530217 req-ad148f40-3c2e-4314-b105-5fbe8f2299ac service nova] Creating event network-vif-plugged:52c5cb9e-fb3c-49d0-b036-314e66927957 for instance 15bedd7a-7fb7-40e2-bf87-729192d754aa on n-h2-858272-3 Oct 05 02:40:07.049491 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-c091791a-4eb2-42a5-a3b1-abb670530217 req-ad148f40-3c2e-4314-b105-5fbe8f2299ac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141882 Oct 05 02:40:07.050694 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1463/2951] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:07.063946 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4173af08-926f-4b3c-bc79-33f681972ef6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:07.065192 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4173af08-926f-4b3c-bc79-33f681972ef6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 057410e8-9ca0-477a-adec-60a7f9d7832d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:07.074113 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4173af08-926f-4b3c-bc79-33f681972ef6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:07.074909 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4173af08-926f-4b3c-bc79-33f681972ef6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:07.075508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4173af08-926f-4b3c-bc79-33f681972ef6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:07.076598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4173af08-926f-4b3c-bc79-33f681972ef6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:07.077243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4173af08-926f-4b3c-bc79-33f681972ef6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:07.077821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4173af08-926f-4b3c-bc79-33f681972ef6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:07.336839 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-60e0e5f1-be59-4251-93c7-31081efb281b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:07.364064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-60e0e5f1-be59-4251-93c7-31081efb281b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:07.365667 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-60e0e5f1-be59-4251-93c7-31081efb281b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:07.373715 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-60e0e5f1-be59-4251-93c7-31081efb281b tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1730 microversion: 2.20 time: 0.820434 Oct 05 02:40:07.374428 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1489/2952] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:40:06 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1730 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:40:07.562768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-50b27ca2-7836-4650-8d29-1087a431e67b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:07.563445 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-50b27ca2-7836-4650-8d29-1087a431e67b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:07.581341 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-50b27ca2-7836-4650-8d29-1087a431e67b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:07.582073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-50b27ca2-7836-4650-8d29-1087a431e67b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:07.582737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-50b27ca2-7836-4650-8d29-1087a431e67b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:07.583745 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-50b27ca2-7836-4650-8d29-1087a431e67b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:07.584625 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-50b27ca2-7836-4650-8d29-1087a431e67b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:07.585591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-50b27ca2-7836-4650-8d29-1087a431e67b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:07.588448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4173af08-926f-4b3c-bc79-33f681972ef6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:07.601805 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4173af08-926f-4b3c-bc79-33f681972ef6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d" status: 200 len: 1317 microversion: 2.1 time: 0.547106 Oct 05 02:40:07.603038 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1464/2953] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:07 2022] GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d => generated 1317 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:07.931066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5bc999b2-3b2a-4e6d-8491-2d75afd51c27 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:07.932705 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5bc999b2-3b2a-4e6d-8491-2d75afd51c27 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 15bedd7a-7fb7-40e2-bf87-729192d754aa] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:07.946294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5bc999b2-3b2a-4e6d-8491-2d75afd51c27 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:07.947561 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5bc999b2-3b2a-4e6d-8491-2d75afd51c27 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:07.949193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5bc999b2-3b2a-4e6d-8491-2d75afd51c27 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:07.951534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5bc999b2-3b2a-4e6d-8491-2d75afd51c27 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:07.953205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5bc999b2-3b2a-4e6d-8491-2d75afd51c27 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:07.954418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5bc999b2-3b2a-4e6d-8491-2d75afd51c27 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:08.169986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-50b27ca2-7836-4650-8d29-1087a431e67b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:08.178362 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-50b27ca2-7836-4650-8d29-1087a431e67b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1312 microversion: 2.1 time: 0.619892 Oct 05 02:40:08.182885 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1490/2954] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:07 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1312 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:40:08.405479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-61e9cfb7-2146-4d32-9932-9f770a624a84 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:08.406095 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-61e9cfb7-2146-4d32-9932-9f770a624a84 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:08.414589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-61e9cfb7-2146-4d32-9932-9f770a624a84 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:08.415091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-61e9cfb7-2146-4d32-9932-9f770a624a84 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:08.415530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-61e9cfb7-2146-4d32-9932-9f770a624a84 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:08.416244 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-61e9cfb7-2146-4d32-9932-9f770a624a84 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:08.416696 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-61e9cfb7-2146-4d32-9932-9f770a624a84 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:08.417196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-61e9cfb7-2146-4d32-9932-9f770a624a84 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:08.424941 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5bc999b2-3b2a-4e6d-8491-2d75afd51c27 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:08.441482 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5bc999b2-3b2a-4e6d-8491-2d75afd51c27 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/15bedd7a-7fb7-40e2-bf87-729192d754aa" status: 200 len: 1320 microversion: 2.1 time: 0.515190 Oct 05 02:40:08.464805 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1465/2955] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:07 2022] GET /compute/v2.1/servers/15bedd7a-7fb7-40e2-bf87-729192d754aa => generated 1320 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:08.627883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-07fa2d99-7bab-4d42-93bd-e7379b0518f8 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:08.628519 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-07fa2d99-7bab-4d42-93bd-e7379b0518f8 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 057410e8-9ca0-477a-adec-60a7f9d7832d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:08.641979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-07fa2d99-7bab-4d42-93bd-e7379b0518f8 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:08.642698 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-07fa2d99-7bab-4d42-93bd-e7379b0518f8 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:08.643280 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-07fa2d99-7bab-4d42-93bd-e7379b0518f8 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:08.644198 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-07fa2d99-7bab-4d42-93bd-e7379b0518f8 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:08.645062 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-07fa2d99-7bab-4d42-93bd-e7379b0518f8 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:08.646558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-07fa2d99-7bab-4d42-93bd-e7379b0518f8 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:08.894174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-61e9cfb7-2146-4d32-9932-9f770a624a84 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:08.913260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-61e9cfb7-2146-4d32-9932-9f770a624a84 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:08.914906 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-61e9cfb7-2146-4d32-9932-9f770a624a84 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:08.915963 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-61e9cfb7-2146-4d32-9932-9f770a624a84 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1730 microversion: 2.20 time: 0.516147 Oct 05 02:40:08.928954 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1491/2956] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:40:08 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1730 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:40:09.153558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-07fa2d99-7bab-4d42-93bd-e7379b0518f8 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:09.164800 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-07fa2d99-7bab-4d42-93bd-e7379b0518f8 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d" status: 200 len: 1317 microversion: 2.1 time: 0.540783 Oct 05 02:40:09.182918 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1466/2957] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:08 2022] GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d => generated 1317 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:40:09.208061 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c00693f3-f7bb-4250-aa5f-57855f775b0e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:09.211569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c00693f3-f7bb-4250-aa5f-57855f775b0e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:09.228372 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c00693f3-f7bb-4250-aa5f-57855f775b0e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:09.229899 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c00693f3-f7bb-4250-aa5f-57855f775b0e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:09.232210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c00693f3-f7bb-4250-aa5f-57855f775b0e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:09.234385 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c00693f3-f7bb-4250-aa5f-57855f775b0e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:09.236235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c00693f3-f7bb-4250-aa5f-57855f775b0e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:09.236984 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c00693f3-f7bb-4250-aa5f-57855f775b0e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:09.572333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-29d189a4-e5ec-4068-b907-b2ed3b4144b7 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] Action: 'create', calling method: .version_select at 0x7fccdf35b280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-789983218", "description": "tempest-description-491509709"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:09.874375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c00693f3-f7bb-4250-aa5f-57855f775b0e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:09.886153 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c00693f3-f7bb-4250-aa5f-57855f775b0e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1312 microversion: 2.1 time: 0.685658 Oct 05 02:40:09.890116 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1492/2958] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:09 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1312 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:40:09.897911 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-bfde1a2f-8bba-4bf4-98e2-908c2149cb26 req-6c10cc83-f4d5-4278-a1bb-074df7609a49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "057410e8-9ca0-477a-adec-60a7f9d7832d", "name": "network-vif-plugged", "status": "completed", "tag": "5cd2eed9-4043-4634-ad60-927cf17f76cd"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:09.931513 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-bfde1a2f-8bba-4bf4-98e2-908c2149cb26 req-6c10cc83-f4d5-4278-a1bb-074df7609a49 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:09.932281 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-bfde1a2f-8bba-4bf4-98e2-908c2149cb26 req-6c10cc83-f4d5-4278-a1bb-074df7609a49 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:09.933279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-bfde1a2f-8bba-4bf4-98e2-908c2149cb26 req-6c10cc83-f4d5-4278-a1bb-074df7609a49 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:09.961895 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-bfde1a2f-8bba-4bf4-98e2-908c2149cb26 req-6c10cc83-f4d5-4278-a1bb-074df7609a49 service nova] Creating event network-vif-plugged:5cd2eed9-4043-4634-ad60-927cf17f76cd for instance 057410e8-9ca0-477a-adec-60a7f9d7832d on n-h2-858272-3 Oct 05 02:40:09.977981 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-bfde1a2f-8bba-4bf4-98e2-908c2149cb26 req-6c10cc83-f4d5-4278-a1bb-074df7609a49 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086185 Oct 05 02:40:09.980829 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1493/2959] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:09.990949 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0a765759-91b2-4551-ba87-ec9ec4c82dc6 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:10.002611 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0a765759-91b2-4551-ba87-ec9ec4c82dc6 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 15bedd7a-7fb7-40e2-bf87-729192d754aa] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:10.018966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0a765759-91b2-4551-ba87-ec9ec4c82dc6 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:10.019468 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0a765759-91b2-4551-ba87-ec9ec4c82dc6 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:10.019915 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0a765759-91b2-4551-ba87-ec9ec4c82dc6 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:10.020789 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0a765759-91b2-4551-ba87-ec9ec4c82dc6 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:10.022478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0a765759-91b2-4551-ba87-ec9ec4c82dc6 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:10.022923 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0a765759-91b2-4551-ba87-ec9ec4c82dc6 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:10.388424 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-29d189a4-e5ec-4068-b907-b2ed3b4144b7 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.138290 Oct 05 02:40:10.390490 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1467/2960] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 5 02:40:09 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:40:10.397410 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ddd16400-dc3c-4b84-bac4-568e82632b22 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:10.400983 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ddd16400-dc3c-4b84-bac4-568e82632b22 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:10.409572 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0a765759-91b2-4551-ba87-ec9ec4c82dc6 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:10.422428 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0a765759-91b2-4551-ba87-ec9ec4c82dc6 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/15bedd7a-7fb7-40e2-bf87-729192d754aa" status: 200 len: 1508 microversion: 2.1 time: 0.440113 Oct 05 02:40:10.423563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ddd16400-dc3c-4b84-bac4-568e82632b22 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:10.430181 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1494/2961] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:09 2022] GET /compute/v2.1/servers/15bedd7a-7fb7-40e2-bf87-729192d754aa => generated 1508 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:10.434412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ddd16400-dc3c-4b84-bac4-568e82632b22 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:10.436164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ddd16400-dc3c-4b84-bac4-568e82632b22 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:10.437687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ddd16400-dc3c-4b84-bac4-568e82632b22 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:10.438383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ddd16400-dc3c-4b84-bac4-568e82632b22 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:10.438901 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ddd16400-dc3c-4b84-bac4-568e82632b22 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:10.452107 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0a256c49-ff45-40d9-96e2-110a34164a1f tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:10.453194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0a256c49-ff45-40d9-96e2-110a34164a1f tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 057410e8-9ca0-477a-adec-60a7f9d7832d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:10.479867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0a256c49-ff45-40d9-96e2-110a34164a1f tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:10.480403 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0a256c49-ff45-40d9-96e2-110a34164a1f tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:10.480966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0a256c49-ff45-40d9-96e2-110a34164a1f tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:10.481686 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0a256c49-ff45-40d9-96e2-110a34164a1f tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:10.482150 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0a256c49-ff45-40d9-96e2-110a34164a1f tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:10.482581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0a256c49-ff45-40d9-96e2-110a34164a1f tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:11.002669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0a256c49-ff45-40d9-96e2-110a34164a1f tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:11.018862 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0a256c49-ff45-40d9-96e2-110a34164a1f tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d" status: 200 len: 1317 microversion: 2.1 time: 0.594154 Oct 05 02:40:11.020558 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1495/2962] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:10 2022] GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d => generated 1317 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:11.027094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2a0a83dc-50bb-45f7-9464-30bfa2bee7d7 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] Action: 'create', calling method: .version_select at 0x7fccdf429940>, body: {"security_group_rule": {"parent_group_id": "94c57a9f-436b-4b1c-9023-2d4f0934f35e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:11.228965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ddd16400-dc3c-4b84-bac4-568e82632b22 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:11.252680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ddd16400-dc3c-4b84-bac4-568e82632b22 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:11.256736 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ddd16400-dc3c-4b84-bac4-568e82632b22 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:11.258532 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ddd16400-dc3c-4b84-bac4-568e82632b22 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1730 microversion: 2.20 time: 0.866731 Oct 05 02:40:11.259996 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1468/2963] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:40:10 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1730 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:40:11.265310 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-de69aa22-d4f6-434c-b7d3-30ec66ac8f71 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:11.266269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-de69aa22-d4f6-434c-b7d3-30ec66ac8f71 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 15bedd7a-7fb7-40e2-bf87-729192d754aa] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:11.275569 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de69aa22-d4f6-434c-b7d3-30ec66ac8f71 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:11.277078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de69aa22-d4f6-434c-b7d3-30ec66ac8f71 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:11.277833 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de69aa22-d4f6-434c-b7d3-30ec66ac8f71 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:11.278903 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de69aa22-d4f6-434c-b7d3-30ec66ac8f71 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:11.280570 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de69aa22-d4f6-434c-b7d3-30ec66ac8f71 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:11.281280 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de69aa22-d4f6-434c-b7d3-30ec66ac8f71 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:11.352446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-de69aa22-d4f6-434c-b7d3-30ec66ac8f71 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 15bedd7a-7fb7-40e2-bf87-729192d754aa] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:40:11.496023 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-de69aa22-d4f6-434c-b7d3-30ec66ac8f71 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "DELETE /compute/v2.1/servers/15bedd7a-7fb7-40e2-bf87-729192d754aa" status: 204 len: 0 microversion: 2.1 time: 0.234264 Oct 05 02:40:11.500164 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1469/2964] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:40:11 2022] DELETE /compute/v2.1/servers/15bedd7a-7fb7-40e2-bf87-729192d754aa => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:40:11.513656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c4d5566a-bb3f-4374-a1b3-5b25506fa260 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:11.514497 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c4d5566a-bb3f-4374-a1b3-5b25506fa260 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:11.526897 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4d5566a-bb3f-4374-a1b3-5b25506fa260 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:11.528132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4d5566a-bb3f-4374-a1b3-5b25506fa260 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:11.528945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4d5566a-bb3f-4374-a1b3-5b25506fa260 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:11.530189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4d5566a-bb3f-4374-a1b3-5b25506fa260 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:11.532530 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4d5566a-bb3f-4374-a1b3-5b25506fa260 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:11.533268 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4d5566a-bb3f-4374-a1b3-5b25506fa260 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:11.793335 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2a0a83dc-50bb-45f7-9464-30bfa2bee7d7 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.769195 Oct 05 02:40:11.794166 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1496/2965] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 5 02:40:11 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:11.801173 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-15e44ac8-c8ab-4741-9563-82417288aa82 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:11.802386 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-15e44ac8-c8ab-4741-9563-82417288aa82 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 36a8024b-dab8-454c-bcc3-65dcba09bbc0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:11.821672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-15e44ac8-c8ab-4741-9563-82417288aa82 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:11.822994 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-15e44ac8-c8ab-4741-9563-82417288aa82 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:11.823604 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-15e44ac8-c8ab-4741-9563-82417288aa82 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:11.827062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-15e44ac8-c8ab-4741-9563-82417288aa82 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:11.827586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-15e44ac8-c8ab-4741-9563-82417288aa82 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:11.828087 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-15e44ac8-c8ab-4741-9563-82417288aa82 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:11.897808 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-15e44ac8-c8ab-4741-9563-82417288aa82 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 36a8024b-dab8-454c-bcc3-65dcba09bbc0] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:40:11.909019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c4d5566a-bb3f-4374-a1b3-5b25506fa260 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:11.927018 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c4d5566a-bb3f-4374-a1b3-5b25506fa260 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1461 microversion: 2.1 time: 0.424219 Oct 05 02:40:11.946923 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1470/2966] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:11 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1461 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:11.954210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c56e7dd5-b9a1-40e8-80ca-7d1fea6c05b3 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] Action: 'create', calling method: .version_select at 0x7fccdf2cb310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1427251303", "description": "tempest-description-1609041381"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:12.035660 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-15e44ac8-c8ab-4741-9563-82417288aa82 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "DELETE /compute/v2.1/servers/36a8024b-dab8-454c-bcc3-65dcba09bbc0" status: 204 len: 0 microversion: 2.1 time: 0.239966 Oct 05 02:40:12.047553 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1497/2967] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:40:11 2022] DELETE /compute/v2.1/servers/36a8024b-dab8-454c-bcc3-65dcba09bbc0 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:40:12.053493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-57ec5333-1a56-4a9c-a8be-4f859d144149 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:12.056525 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-57ec5333-1a56-4a9c-a8be-4f859d144149 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:12.065192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57ec5333-1a56-4a9c-a8be-4f859d144149 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:12.065697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57ec5333-1a56-4a9c-a8be-4f859d144149 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:12.066141 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57ec5333-1a56-4a9c-a8be-4f859d144149 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:12.067131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57ec5333-1a56-4a9c-a8be-4f859d144149 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:12.068248 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57ec5333-1a56-4a9c-a8be-4f859d144149 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:12.069060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57ec5333-1a56-4a9c-a8be-4f859d144149 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:12.278332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-57ec5333-1a56-4a9c-a8be-4f859d144149 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:12.288529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-57ec5333-1a56-4a9c-a8be-4f859d144149 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Old instance type m1.heat2, new instance type m1.heat {{(pid=122320) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 05 02:40:12.298950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-57ec5333-1a56-4a9c-a8be-4f859d144149 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:40:12.299780 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-57ec5333-1a56-4a9c-a8be-4f859d144149 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:40:12.300536 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-57ec5333-1a56-4a9c-a8be-4f859d144149 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:40:12.306026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-57ec5333-1a56-4a9c-a8be-4f859d144149 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:40:12.307073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-57ec5333-1a56-4a9c-a8be-4f859d144149 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:40:12.490202 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-57ec5333-1a56-4a9c-a8be-4f859d144149 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "POST /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84/action" status: 202 len: 0 microversion: 2.1 time: 0.441557 Oct 05 02:40:12.498881 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1498/2968] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:40:12 2022] POST /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84/action => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:40:12.520152 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9267e963-3852-491d-8cb0-70985e080357 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:12.528206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9267e963-3852-491d-8cb0-70985e080357 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 057410e8-9ca0-477a-adec-60a7f9d7832d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:12.530548 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c56e7dd5-b9a1-40e8-80ca-7d1fea6c05b3 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.582097 Oct 05 02:40:12.531631 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1471/2969] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 5 02:40:11 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:12.537439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-96584df1-0da1-4c5a-9389-9f838675522e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-73960012", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "eb997f6c-1603-48e6-8298-cfba3d8cb6a1"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:12.543734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9267e963-3852-491d-8cb0-70985e080357 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:12.544249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9267e963-3852-491d-8cb0-70985e080357 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:12.544691 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9267e963-3852-491d-8cb0-70985e080357 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:12.550672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9267e963-3852-491d-8cb0-70985e080357 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:12.553228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9267e963-3852-491d-8cb0-70985e080357 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:12.553951 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9267e963-3852-491d-8cb0-70985e080357 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:12.587772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:40:12.639868 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-96584df1-0da1-4c5a-9389-9f838675522e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] validate_networks() for [('eb997f6c-1603-48e6-8298-cfba3d8cb6a1', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:40:13.148214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9267e963-3852-491d-8cb0-70985e080357 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:13.165052 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9267e963-3852-491d-8cb0-70985e080357 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d" status: 200 len: 1317 microversion: 2.1 time: 0.664914 Oct 05 02:40:13.171677 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1499/2970] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:12 2022] GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d => generated 1317 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:13.181989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-911528a9-2668-4e74-8b20-da9d0a9d4c06 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:13.187309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-911528a9-2668-4e74-8b20-da9d0a9d4c06 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:13.210042 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-911528a9-2668-4e74-8b20-da9d0a9d4c06 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:13.210960 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-911528a9-2668-4e74-8b20-da9d0a9d4c06 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:13.213874 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-911528a9-2668-4e74-8b20-da9d0a9d4c06 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:13.214894 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-911528a9-2668-4e74-8b20-da9d0a9d4c06 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:13.215581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-911528a9-2668-4e74-8b20-da9d0a9d4c06 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:13.217123 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-911528a9-2668-4e74-8b20-da9d0a9d4c06 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:13.234565 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:40:13.857323 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-911528a9-2668-4e74-8b20-da9d0a9d4c06 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:13.870900 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-911528a9-2668-4e74-8b20-da9d0a9d4c06 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:13.872736 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-911528a9-2668-4e74-8b20-da9d0a9d4c06 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:13.875612 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-911528a9-2668-4e74-8b20-da9d0a9d4c06 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1730 microversion: 2.20 time: 0.702368 Oct 05 02:40:13.878746 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1500/2971] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:40:13 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1730 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:40:13.899309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4feb3528-6660-4135-9631-611868a3ef29 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:13.901208 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4feb3528-6660-4135-9631-611868a3ef29 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:13.911009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4feb3528-6660-4135-9631-611868a3ef29 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:13.912690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4feb3528-6660-4135-9631-611868a3ef29 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:13.914410 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4feb3528-6660-4135-9631-611868a3ef29 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:13.917038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4feb3528-6660-4135-9631-611868a3ef29 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:13.919047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4feb3528-6660-4135-9631-611868a3ef29 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:13.919650 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4feb3528-6660-4135-9631-611868a3ef29 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:14.439415 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-96584df1-0da1-4c5a-9389-9f838675522e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:40:14.440513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-96584df1-0da1-4c5a-9389-9f838675522e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:40:14.441292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-96584df1-0da1-4c5a-9389-9f838675522e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:40:14.441978 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-96584df1-0da1-4c5a-9389-9f838675522e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:40:14.443842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-96584df1-0da1-4c5a-9389-9f838675522e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:40:14.472821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96584df1-0da1-4c5a-9389-9f838675522e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:14.472821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96584df1-0da1-4c5a-9389-9f838675522e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:14.473446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96584df1-0da1-4c5a-9389-9f838675522e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:14.475489 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96584df1-0da1-4c5a-9389-9f838675522e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:14.476273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96584df1-0da1-4c5a-9389-9f838675522e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:14.477491 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96584df1-0da1-4c5a-9389-9f838675522e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:14.559175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-96584df1-0da1-4c5a-9389-9f838675522e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Getting quotas for project 9160b32c651a43f784bbe95a0e49059c. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:40:14.569660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-96584df1-0da1-4c5a-9389-9f838675522e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Getting quotas for user dbe30121065f4906b43c3c48888d88a8 and project 9160b32c651a43f784bbe95a0e49059c. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:40:14.585804 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-96584df1-0da1-4c5a-9389-9f838675522e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Going to run 2 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:40:14.588569 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-96584df1-0da1-4c5a-9389-9f838675522e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: ac3c82a2-0553-4902-ba33-568525392af2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:40:14.644479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-96584df1-0da1-4c5a-9389-9f838675522e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 94bc6034-3861-4067-8f58-ff4151d8c37f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=ac3c82a2-0553-4902-ba33-568525392af2,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:40:14.684096 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4feb3528-6660-4135-9631-611868a3ef29 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:14.694898 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4feb3528-6660-4135-9631-611868a3ef29 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1470 microversion: 2.1 time: 0.814913 Oct 05 02:40:14.713461 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1501/2972] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:13 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1470 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:14.728661 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e9acc995-7c30-420b-999d-01f7be1a838f tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] Action: 'create', calling method: .version_select at 0x7fccdfcc2d30>, body: {"security_group_rule": {"parent_group_id": "f89bded8-bd42-4611-bbb5-c7146765b225", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:14.736751 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-96584df1-0da1-4c5a-9389-9f838675522e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.203599 Oct 05 02:40:14.738406 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1472/2973] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:40:12 2022] POST /compute/v2.1/servers => generated 32 bytes in 2206 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 05 02:40:14.746125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1e6bfbb5-bf58-441b-8f74-0e4c6684940c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:14.747209 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1e6bfbb5-bf58-441b-8f74-0e4c6684940c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 057410e8-9ca0-477a-adec-60a7f9d7832d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:14.758907 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e6bfbb5-bf58-441b-8f74-0e4c6684940c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:14.759723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e6bfbb5-bf58-441b-8f74-0e4c6684940c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:14.760566 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e6bfbb5-bf58-441b-8f74-0e4c6684940c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:14.762444 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e6bfbb5-bf58-441b-8f74-0e4c6684940c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:14.763201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e6bfbb5-bf58-441b-8f74-0e4c6684940c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:14.763860 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e6bfbb5-bf58-441b-8f74-0e4c6684940c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:16.183229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1e6bfbb5-bf58-441b-8f74-0e4c6684940c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:16.198093 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1e6bfbb5-bf58-441b-8f74-0e4c6684940c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d" status: 200 len: 1467 microversion: 2.1 time: 1.456869 Oct 05 02:40:16.199962 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1473/2974] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:14 2022] GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d => generated 1467 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:16.207323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9fb2058d-b261-4b06-8020-1ebb5edc78c0 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:16.223783 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9fb2058d-b261-4b06-8020-1ebb5edc78c0 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:16.230470 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9fb2058d-b261-4b06-8020-1ebb5edc78c0 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Searching by: {'deleted': False, 'project_id': '9160b32c651a43f784bbe95a0e49059c'} {{(pid=122319) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:40:16.263578 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9fb2058d-b261-4b06-8020-1ebb5edc78c0 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:16.265643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9fb2058d-b261-4b06-8020-1ebb5edc78c0 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:16.267587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9fb2058d-b261-4b06-8020-1ebb5edc78c0 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:16.270269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9fb2058d-b261-4b06-8020-1ebb5edc78c0 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:16.271884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9fb2058d-b261-4b06-8020-1ebb5edc78c0 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:16.272976 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9fb2058d-b261-4b06-8020-1ebb5edc78c0 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:16.340017 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:40:16.360783 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.multi_cell_list [None req-9fb2058d-b261-4b06-8020-1ebb5edc78c0 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Listed batch of 4 results from cell out of 999 limit. Returned 4 total so far. {{(pid=122319) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:40:16.433394 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9fb2058d-b261-4b06-8020-1ebb5edc78c0 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1333 microversion: 2.1 time: 0.229333 Oct 05 02:40:16.446025 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1474/2975] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 5 02:40:16 2022] GET /compute/v2.1/servers => generated 1333 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:16.465375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-499ee372-c452-4a89-bac9-d663a09c589d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:16.467487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-499ee372-c452-4a89-bac9-d663a09c589d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:16.502775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-499ee372-c452-4a89-bac9-d663a09c589d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:16.503679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-499ee372-c452-4a89-bac9-d663a09c589d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:16.504519 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-499ee372-c452-4a89-bac9-d663a09c589d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:16.508182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-499ee372-c452-4a89-bac9-d663a09c589d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:16.509835 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-499ee372-c452-4a89-bac9-d663a09c589d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:16.510562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-499ee372-c452-4a89-bac9-d663a09c589d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:17.708742 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-499ee372-c452-4a89-bac9-d663a09c589d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:17.721201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-499ee372-c452-4a89-bac9-d663a09c589d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:17.742413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-499ee372-c452-4a89-bac9-d663a09c589d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:17.750789 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-499ee372-c452-4a89-bac9-d663a09c589d tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1730 microversion: 2.20 time: 1.300210 Oct 05 02:40:17.752314 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1475/2976] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:40:16 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1730 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:40:17.801665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d710e987-538a-4b7e-aea6-1c3debd8fb9f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:17.805983 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d710e987-538a-4b7e-aea6-1c3debd8fb9f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:17.816204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d710e987-538a-4b7e-aea6-1c3debd8fb9f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:17.816926 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d710e987-538a-4b7e-aea6-1c3debd8fb9f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:17.818484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d710e987-538a-4b7e-aea6-1c3debd8fb9f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:17.819914 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d710e987-538a-4b7e-aea6-1c3debd8fb9f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:17.820541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d710e987-538a-4b7e-aea6-1c3debd8fb9f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:17.821193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d710e987-538a-4b7e-aea6-1c3debd8fb9f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:18.797126 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e9acc995-7c30-420b-999d-01f7be1a838f tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 4.081028 Oct 05 02:40:18.806282 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1502/2977] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 5 02:40:14 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 4084 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:18.806282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f5efbe94-270b-4716-8d93-c98add011da6 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:18.806282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f5efbe94-270b-4716-8d93-c98add011da6 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] [instance: 057410e8-9ca0-477a-adec-60a7f9d7832d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:18.821447 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5efbe94-270b-4716-8d93-c98add011da6 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:18.823632 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5efbe94-270b-4716-8d93-c98add011da6 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:18.824618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5efbe94-270b-4716-8d93-c98add011da6 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:18.829451 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5efbe94-270b-4716-8d93-c98add011da6 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:18.830440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5efbe94-270b-4716-8d93-c98add011da6 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:18.830440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5efbe94-270b-4716-8d93-c98add011da6 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:19.320504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d710e987-538a-4b7e-aea6-1c3debd8fb9f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:19.330879 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d710e987-538a-4b7e-aea6-1c3debd8fb9f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1470 microversion: 2.1 time: 1.539976 Oct 05 02:40:19.331477 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1476/2978] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:17 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1470 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:19.336662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bd83cc18-a276-4188-b2cf-6ff1ccf4e1a9 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:19.353528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bd83cc18-a276-4188-b2cf-6ff1ccf4e1a9 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 94bc6034-3861-4067-8f58-ff4151d8c37f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:19.360175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd83cc18-a276-4188-b2cf-6ff1ccf4e1a9 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:19.361192 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd83cc18-a276-4188-b2cf-6ff1ccf4e1a9 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:19.361628 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd83cc18-a276-4188-b2cf-6ff1ccf4e1a9 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:19.362328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd83cc18-a276-4188-b2cf-6ff1ccf4e1a9 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:19.365915 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd83cc18-a276-4188-b2cf-6ff1ccf4e1a9 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:19.366362 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd83cc18-a276-4188-b2cf-6ff1ccf4e1a9 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:19.549195 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bd83cc18-a276-4188-b2cf-6ff1ccf4e1a9 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:19.563782 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bd83cc18-a276-4188-b2cf-6ff1ccf4e1a9 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/94bc6034-3861-4067-8f58-ff4151d8c37f" status: 200 len: 1274 microversion: 2.1 time: 0.231213 Oct 05 02:40:19.564683 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1477/2979] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:19 2022] GET /compute/v2.1/servers/94bc6034-3861-4067-8f58-ff4151d8c37f => generated 1274 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:19.569560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-087d9088-4a96-410a-a7a8-a728abf32f4f req-9e36f718-a6e3-457a-9750-8aa7538a6893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15bedd7a-7fb7-40e2-bf87-729192d754aa", "name": "network-vif-deleted", "tag": "52c5cb9e-fb3c-49d0-b036-314e66927957"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:19.603290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-087d9088-4a96-410a-a7a8-a728abf32f4f req-9e36f718-a6e3-457a-9750-8aa7538a6893 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:19.603794 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-087d9088-4a96-410a-a7a8-a728abf32f4f req-9e36f718-a6e3-457a-9750-8aa7538a6893 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:19.604198 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-087d9088-4a96-410a-a7a8-a728abf32f4f req-9e36f718-a6e3-457a-9750-8aa7538a6893 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:19.618689 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-087d9088-4a96-410a-a7a8-a728abf32f4f req-9e36f718-a6e3-457a-9750-8aa7538a6893 service nova] Creating event network-vif-deleted:52c5cb9e-fb3c-49d0-b036-314e66927957 for instance 15bedd7a-7fb7-40e2-bf87-729192d754aa on n-h2-858272-3 Oct 05 02:40:19.634784 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-087d9088-4a96-410a-a7a8-a728abf32f4f req-9e36f718-a6e3-457a-9750-8aa7538a6893 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068626 Oct 05 02:40:19.635395 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1478/2980] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:19.640632 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-b643bd1a-bf4d-422f-ab5b-48129a06f2c8 req-cfcf7308-3263-4c93-b7a5-1e2d81ad082c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36a8024b-dab8-454c-bcc3-65dcba09bbc0", "name": "network-vif-deleted", "tag": "96f234d9-01d0-449d-95b5-8ff6d63d7cd7"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:19.664225 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b643bd1a-bf4d-422f-ab5b-48129a06f2c8 req-cfcf7308-3263-4c93-b7a5-1e2d81ad082c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:19.664435 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b643bd1a-bf4d-422f-ab5b-48129a06f2c8 req-cfcf7308-3263-4c93-b7a5-1e2d81ad082c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:19.664810 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b643bd1a-bf4d-422f-ab5b-48129a06f2c8 req-cfcf7308-3263-4c93-b7a5-1e2d81ad082c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:19.693332 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-b643bd1a-bf4d-422f-ab5b-48129a06f2c8 req-cfcf7308-3263-4c93-b7a5-1e2d81ad082c service nova] Creating event network-vif-deleted:96f234d9-01d0-449d-95b5-8ff6d63d7cd7 for instance 36a8024b-dab8-454c-bcc3-65dcba09bbc0 on n-h2-858272-3 Oct 05 02:40:19.703253 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-b643bd1a-bf4d-422f-ab5b-48129a06f2c8 req-cfcf7308-3263-4c93-b7a5-1e2d81ad082c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066264 Oct 05 02:40:19.704514 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1479/2981] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:19.711105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-758c10d6-8623-4f16-aa59-b3001faa5f36 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:19.712611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-758c10d6-8623-4f16-aa59-b3001faa5f36 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:19.720567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-758c10d6-8623-4f16-aa59-b3001faa5f36 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:19.721312 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-758c10d6-8623-4f16-aa59-b3001faa5f36 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:19.722441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-758c10d6-8623-4f16-aa59-b3001faa5f36 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:19.723328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-758c10d6-8623-4f16-aa59-b3001faa5f36 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:19.724442 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-758c10d6-8623-4f16-aa59-b3001faa5f36 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:19.725380 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-758c10d6-8623-4f16-aa59-b3001faa5f36 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:20.020763 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f5efbe94-270b-4716-8d93-c98add011da6 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d" status: 200 len: 1618 microversion: 2.1 time: 1.220634 Oct 05 02:40:20.024234 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1503/2982] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:18 2022] GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d => generated 1618 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:20.034956 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ef9c49a8-86e2-42fa-aadc-980fe5a52ec3 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] Action: 'create', calling method: .version_select at 0x7fcce43eab80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-64265188", "description": "tempest-description-2038639266"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:20.479487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-758c10d6-8623-4f16-aa59-b3001faa5f36 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:20.494393 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-758c10d6-8623-4f16-aa59-b3001faa5f36 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:20.495879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-758c10d6-8623-4f16-aa59-b3001faa5f36 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:20.497106 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-758c10d6-8623-4f16-aa59-b3001faa5f36 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1730 microversion: 2.20 time: 0.791256 Oct 05 02:40:20.502575 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1480/2983] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:40:19 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1730 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:40:20.511962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-81ec5692-418a-4a8a-bbe1-6658c702fbe3 req-483b871e-e2ff-4715-af6f-9a5389fb5eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c15b977-1608-45e8-8bbd-b2bd5c1eff21", "name": "network-vif-plugged", "status": "completed", "tag": "af2bec78-4945-43ac-81ca-883ba5ae8ef2"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:20.540333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-81ec5692-418a-4a8a-bbe1-6658c702fbe3 req-483b871e-e2ff-4715-af6f-9a5389fb5eb5 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:20.541295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-81ec5692-418a-4a8a-bbe1-6658c702fbe3 req-483b871e-e2ff-4715-af6f-9a5389fb5eb5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:20.541746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-81ec5692-418a-4a8a-bbe1-6658c702fbe3 req-483b871e-e2ff-4715-af6f-9a5389fb5eb5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:20.593180 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-81ec5692-418a-4a8a-bbe1-6658c702fbe3 req-483b871e-e2ff-4715-af6f-9a5389fb5eb5 service nova] Creating event network-vif-plugged:af2bec78-4945-43ac-81ca-883ba5ae8ef2 for instance 1c15b977-1608-45e8-8bbd-b2bd5c1eff21 on n-h1-858272-3 Oct 05 02:40:20.601435 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-81ec5692-418a-4a8a-bbe1-6658c702fbe3 req-483b871e-e2ff-4715-af6f-9a5389fb5eb5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097370 Oct 05 02:40:20.602668 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1481/2984] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:20.604168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-81ec5692-418a-4a8a-bbe1-6658c702fbe3 req-483b871e-e2ff-4715-af6f-9a5389fb5eb5 service nova] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:20.605355 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-81ec5692-418a-4a8a-bbe1-6658c702fbe3 req-483b871e-e2ff-4715-af6f-9a5389fb5eb5 service nova] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001665 Oct 05 02:40:20.606327 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1482/2985] 10.222.0.16 () {56 vars in 886 bytes} [Wed Oct 5 02:40:20 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 05 02:40:20.612891 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-00d54aa7-f26f-4b6c-a5e9-d80405d1ed83 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-668428111", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["6b01f092-c99b-4a47-bdcb-3b6bcdeb0323"]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:20.695383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-00d54aa7-f26f-4b6c-a5e9-d80405d1ed83 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] validate_networks() for None {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:40:21.031488 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ef9c49a8-86e2-42fa-aadc-980fe5a52ec3 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.002428 Oct 05 02:40:21.032443 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1504/2986] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 5 02:40:20 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:21.037605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0586c8c7-0631-4c16-8af0-736208cccdab tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:21.038422 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0586c8c7-0631-4c16-8af0-736208cccdab tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:21.062366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0586c8c7-0631-4c16-8af0-736208cccdab tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:21.065218 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0586c8c7-0631-4c16-8af0-736208cccdab tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:21.067106 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0586c8c7-0631-4c16-8af0-736208cccdab tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:21.068735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0586c8c7-0631-4c16-8af0-736208cccdab tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:21.072311 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0586c8c7-0631-4c16-8af0-736208cccdab tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:21.075729 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0586c8c7-0631-4c16-8af0-736208cccdab tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:21.870904 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-00d54aa7-f26f-4b6c-a5e9-d80405d1ed83 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:40:21.871499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-00d54aa7-f26f-4b6c-a5e9-d80405d1ed83 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:40:21.871780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-00d54aa7-f26f-4b6c-a5e9-d80405d1ed83 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:40:21.872186 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-00d54aa7-f26f-4b6c-a5e9-d80405d1ed83 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:40:21.872592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-00d54aa7-f26f-4b6c-a5e9-d80405d1ed83 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:40:21.894025 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-00d54aa7-f26f-4b6c-a5e9-d80405d1ed83 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:21.894524 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-00d54aa7-f26f-4b6c-a5e9-d80405d1ed83 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:21.894945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-00d54aa7-f26f-4b6c-a5e9-d80405d1ed83 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:21.896079 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-00d54aa7-f26f-4b6c-a5e9-d80405d1ed83 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:21.900489 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-00d54aa7-f26f-4b6c-a5e9-d80405d1ed83 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:21.900836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-00d54aa7-f26f-4b6c-a5e9-d80405d1ed83 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:21.952537 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-00d54aa7-f26f-4b6c-a5e9-d80405d1ed83 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:40:21.965927 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-00d54aa7-f26f-4b6c-a5e9-d80405d1ed83 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for user b86e3b7d1c9a4b2c8f2914beefa74cc1 and project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:40:21.996626 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-00d54aa7-f26f-4b6c-a5e9-d80405d1ed83 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:40:22.001722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-00d54aa7-f26f-4b6c-a5e9-d80405d1ed83 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:40:22.076945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0586c8c7-0631-4c16-8af0-736208cccdab tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:22.086480 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0586c8c7-0631-4c16-8af0-736208cccdab tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1470 microversion: 2.1 time: 1.052737 Oct 05 02:40:22.092339 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1505/2987] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:21 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1470 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:22.093627 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-00d54aa7-f26f-4b6c-a5e9-d80405d1ed83 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.486102 Oct 05 02:40:22.094271 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1483/2988] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:40:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:40:22.104819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3f03448c-80e4-4391-b6b3-db8308f8d113 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:22.112300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3f03448c-80e4-4391-b6b3-db8308f8d113 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 94bc6034-3861-4067-8f58-ff4151d8c37f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:22.114841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-242153ef-d633-46d5-8e6d-e1cec969d15b tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] Action: 'create', calling method: .version_select at 0x7fccdf294820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1387623487", "description": "tempest-description-127830160"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:22.128253 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f03448c-80e4-4391-b6b3-db8308f8d113 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:22.129111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f03448c-80e4-4391-b6b3-db8308f8d113 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:22.129779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f03448c-80e4-4391-b6b3-db8308f8d113 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:22.131584 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f03448c-80e4-4391-b6b3-db8308f8d113 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:22.132238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f03448c-80e4-4391-b6b3-db8308f8d113 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:22.132838 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f03448c-80e4-4391-b6b3-db8308f8d113 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:22.778075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3f03448c-80e4-4391-b6b3-db8308f8d113 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:22.788371 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3f03448c-80e4-4391-b6b3-db8308f8d113 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/94bc6034-3861-4067-8f58-ff4151d8c37f" status: 200 len: 1316 microversion: 2.1 time: 0.694532 Oct 05 02:40:22.793367 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1506/2989] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:22 2022] GET /compute/v2.1/servers/94bc6034-3861-4067-8f58-ff4151d8c37f => generated 1316 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:22.806368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c15479dd-6f81-4af7-aca7-68d8cf30522c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:22.807279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c15479dd-6f81-4af7-aca7-68d8cf30522c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:22.822114 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:40:22.823849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c15479dd-6f81-4af7-aca7-68d8cf30522c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:22.828005 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c15479dd-6f81-4af7-aca7-68d8cf30522c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:22.828815 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c15479dd-6f81-4af7-aca7-68d8cf30522c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:22.830466 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c15479dd-6f81-4af7-aca7-68d8cf30522c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:22.831106 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c15479dd-6f81-4af7-aca7-68d8cf30522c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:22.832244 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c15479dd-6f81-4af7-aca7-68d8cf30522c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:23.026690 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-242153ef-d633-46d5-8e6d-e1cec969d15b tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.930915 Oct 05 02:40:23.028723 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1484/2990] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 5 02:40:22 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:23.033511 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-56a57736-6494-450e-9f09-e0d5ccfe3d58 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:23.034255 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-56a57736-6494-450e-9f09-e0d5ccfe3d58 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:23.058069 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-56a57736-6494-450e-9f09-e0d5ccfe3d58 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:23.058951 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-56a57736-6494-450e-9f09-e0d5ccfe3d58 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:23.059617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-56a57736-6494-450e-9f09-e0d5ccfe3d58 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:23.060586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-56a57736-6494-450e-9f09-e0d5ccfe3d58 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:23.062042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-56a57736-6494-450e-9f09-e0d5ccfe3d58 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:23.062852 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-56a57736-6494-450e-9f09-e0d5ccfe3d58 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:23.194960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-56a57736-6494-450e-9f09-e0d5ccfe3d58 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:23.205232 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-56a57736-6494-450e-9f09-e0d5ccfe3d58 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b" status: 200 len: 1220 microversion: 2.1 time: 0.175255 Oct 05 02:40:23.207186 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1485/2991] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:23 2022] GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b => generated 1220 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:23.213573 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b7170480-de2b-4fbd-83d4-89074fa6c19f tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] Action: 'create', calling method: .version_select at 0x7fccdf2d8040>, body: {"security_group_rule": {"parent_group_id": "e5c7e6ac-148b-45b5-90fb-b94ef70b326f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "c9299c7f-ee8a-4ca3-a6e5-1660d371e22b"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:23.301463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c15479dd-6f81-4af7-aca7-68d8cf30522c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:23.331278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c15479dd-6f81-4af7-aca7-68d8cf30522c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:23.334108 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c15479dd-6f81-4af7-aca7-68d8cf30522c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:23.336329 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c15479dd-6f81-4af7-aca7-68d8cf30522c tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1730 microversion: 2.20 time: 0.541505 Oct 05 02:40:23.337251 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1507/2992] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:40:22 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1730 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:40:23.344431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f7eabf89-869c-47be-a945-ee06d15964e5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:23.345903 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f7eabf89-869c-47be-a945-ee06d15964e5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:23.361512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7eabf89-869c-47be-a945-ee06d15964e5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:23.362878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7eabf89-869c-47be-a945-ee06d15964e5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:23.363803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7eabf89-869c-47be-a945-ee06d15964e5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:23.367048 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7eabf89-869c-47be-a945-ee06d15964e5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:23.367808 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7eabf89-869c-47be-a945-ee06d15964e5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:23.368799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7eabf89-869c-47be-a945-ee06d15964e5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:23.883082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f7eabf89-869c-47be-a945-ee06d15964e5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:23.905940 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f7eabf89-869c-47be-a945-ee06d15964e5 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1475 microversion: 2.1 time: 0.566556 Oct 05 02:40:23.906471 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1508/2993] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:23 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1475 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:23.939560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c464edc6-03c0-4135-ba48-92c02c8a7a70 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:23.940198 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c464edc6-03c0-4135-ba48-92c02c8a7a70 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 94bc6034-3861-4067-8f58-ff4151d8c37f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:23.994710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c464edc6-03c0-4135-ba48-92c02c8a7a70 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:23.997337 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c464edc6-03c0-4135-ba48-92c02c8a7a70 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:23.997771 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c464edc6-03c0-4135-ba48-92c02c8a7a70 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:23.998513 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c464edc6-03c0-4135-ba48-92c02c8a7a70 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:24.009450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c464edc6-03c0-4135-ba48-92c02c8a7a70 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:24.009998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c464edc6-03c0-4135-ba48-92c02c8a7a70 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:24.936957 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b7170480-de2b-4fbd-83d4-89074fa6c19f tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.727446 Oct 05 02:40:24.938515 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1486/2994] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 5 02:40:23 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:24.954514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d7c82a5d-35a0-448f-bef5-0d733d58323e tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:24.958700 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d7c82a5d-35a0-448f-bef5-0d733d58323e tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:24.963399 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c464edc6-03c0-4135-ba48-92c02c8a7a70 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:24.973315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7c82a5d-35a0-448f-bef5-0d733d58323e tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:24.974600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7c82a5d-35a0-448f-bef5-0d733d58323e tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:24.975371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7c82a5d-35a0-448f-bef5-0d733d58323e tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:24.976292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7c82a5d-35a0-448f-bef5-0d733d58323e tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:24.976953 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c464edc6-03c0-4135-ba48-92c02c8a7a70 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/94bc6034-3861-4067-8f58-ff4151d8c37f" status: 200 len: 1316 microversion: 2.1 time: 1.066850 Oct 05 02:40:24.977250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7c82a5d-35a0-448f-bef5-0d733d58323e tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:24.977848 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7c82a5d-35a0-448f-bef5-0d733d58323e tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:24.978997 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1509/2995] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:23 2022] GET /compute/v2.1/servers/94bc6034-3861-4067-8f58-ff4151d8c37f => generated 1316 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:25.009365 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ac17847c-f696-4696-a1be-336efa105704 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:25.011371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ac17847c-f696-4696-a1be-336efa105704 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:25.024628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac17847c-f696-4696-a1be-336efa105704 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:25.025737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac17847c-f696-4696-a1be-336efa105704 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:25.026371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac17847c-f696-4696-a1be-336efa105704 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:25.027298 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac17847c-f696-4696-a1be-336efa105704 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:25.027945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac17847c-f696-4696-a1be-336efa105704 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:25.028936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac17847c-f696-4696-a1be-336efa105704 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:25.212707 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d7c82a5d-35a0-448f-bef5-0d733d58323e tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:25.229187 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d7c82a5d-35a0-448f-bef5-0d733d58323e tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b" status: 200 len: 1274 microversion: 2.1 time: 0.279352 Oct 05 02:40:25.230427 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1487/2996] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:24 2022] GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b => generated 1274 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:25.250269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-7878c938-264b-49d1-8dc8-6a2f87b64ee0 req-8879bcec-9ab5-4c60-a435-04c5efe24aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac3c82a2-0553-4902-ba33-568525392af2", "tag": "8a6f06f5-5996-445c-a262-e2d180ad3ca7"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:25.286905 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7878c938-264b-49d1-8dc8-6a2f87b64ee0 req-8879bcec-9ab5-4c60-a435-04c5efe24aa5 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:25.288082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7878c938-264b-49d1-8dc8-6a2f87b64ee0 req-8879bcec-9ab5-4c60-a435-04c5efe24aa5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:25.289527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7878c938-264b-49d1-8dc8-6a2f87b64ee0 req-8879bcec-9ab5-4c60-a435-04c5efe24aa5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:25.336228 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-7878c938-264b-49d1-8dc8-6a2f87b64ee0 req-8879bcec-9ab5-4c60-a435-04c5efe24aa5 service nova] Creating event network-changed:8a6f06f5-5996-445c-a262-e2d180ad3ca7 for instance ac3c82a2-0553-4902-ba33-568525392af2 on n-h2-858272-3 Oct 05 02:40:25.344230 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-7878c938-264b-49d1-8dc8-6a2f87b64ee0 req-8879bcec-9ab5-4c60-a435-04c5efe24aa5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112144 Oct 05 02:40:25.345381 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1488/2997] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:25.352452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7d711e49-26c1-41ba-9d3e-87878548131e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:25.354032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7d711e49-26c1-41ba-9d3e-87878548131e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:25.361191 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d711e49-26c1-41ba-9d3e-87878548131e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:25.361848 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d711e49-26c1-41ba-9d3e-87878548131e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:25.371238 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d711e49-26c1-41ba-9d3e-87878548131e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:25.373310 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d711e49-26c1-41ba-9d3e-87878548131e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:25.373792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d711e49-26c1-41ba-9d3e-87878548131e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:25.374224 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d711e49-26c1-41ba-9d3e-87878548131e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:25.381712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ac17847c-f696-4696-a1be-336efa105704 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:25.396925 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ac17847c-f696-4696-a1be-336efa105704 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:25.398361 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ac17847c-f696-4696-a1be-336efa105704 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:25.399551 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ac17847c-f696-4696-a1be-336efa105704 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1730 microversion: 2.20 time: 0.419603 Oct 05 02:40:25.400121 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1510/2998] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:40:24 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1730 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:40:25.404581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6481d6ef-e90c-41f4-b638-a6b1a49a8386 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] Action: 'create', calling method: .version_select at 0x7fccdf3d1940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1203352042", "description": "tempest-description-167315675"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:25.879825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7d711e49-26c1-41ba-9d3e-87878548131e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:25.898404 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7d711e49-26c1-41ba-9d3e-87878548131e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1475 microversion: 2.1 time: 0.545273 Oct 05 02:40:25.899578 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1489/2999] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:25 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1475 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:26.007660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3bd1caae-cdc0-44ca-98b9-ac99ab7d9ce9 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:26.009172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3bd1caae-cdc0-44ca-98b9-ac99ab7d9ce9 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 94bc6034-3861-4067-8f58-ff4151d8c37f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:26.022889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bd1caae-cdc0-44ca-98b9-ac99ab7d9ce9 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:26.024854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bd1caae-cdc0-44ca-98b9-ac99ab7d9ce9 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:26.026563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bd1caae-cdc0-44ca-98b9-ac99ab7d9ce9 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:26.027639 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bd1caae-cdc0-44ca-98b9-ac99ab7d9ce9 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:26.029374 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bd1caae-cdc0-44ca-98b9-ac99ab7d9ce9 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:26.030980 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bd1caae-cdc0-44ca-98b9-ac99ab7d9ce9 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:26.051240 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6481d6ef-e90c-41f4-b638-a6b1a49a8386 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.648702 Oct 05 02:40:26.055109 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1511/3000] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 5 02:40:25 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:26.071639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3d010d44-a979-497d-9dd9-870797111863 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] Action: 'create', calling method: .version_select at 0x7fcce4142e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1769085787", "description": "tempest-description-763010632"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:26.490599 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3bd1caae-cdc0-44ca-98b9-ac99ab7d9ce9 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:26.500034 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3bd1caae-cdc0-44ca-98b9-ac99ab7d9ce9 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/94bc6034-3861-4067-8f58-ff4151d8c37f" status: 200 len: 1316 microversion: 2.1 time: 0.499758 Oct 05 02:40:26.529461 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1490/3001] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:25 2022] GET /compute/v2.1/servers/94bc6034-3861-4067-8f58-ff4151d8c37f => generated 1316 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:26.538258 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4fa75f1e-fb7f-4d02-8906-676802cdeceb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:26.539075 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4fa75f1e-fb7f-4d02-8906-676802cdeceb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:26.550629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4fa75f1e-fb7f-4d02-8906-676802cdeceb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:26.551135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4fa75f1e-fb7f-4d02-8906-676802cdeceb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:26.551635 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4fa75f1e-fb7f-4d02-8906-676802cdeceb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:26.552879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4fa75f1e-fb7f-4d02-8906-676802cdeceb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:26.553376 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4fa75f1e-fb7f-4d02-8906-676802cdeceb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:26.553807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4fa75f1e-fb7f-4d02-8906-676802cdeceb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:26.837796 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3d010d44-a979-497d-9dd9-870797111863 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.773123 Oct 05 02:40:26.839325 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1512/3002] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 5 02:40:26 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:26.856264 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-80f52059-fe9c-4ed0-a3d8-e2bfb06e9781 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:26.857027 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-80f52059-fe9c-4ed0-a3d8-e2bfb06e9781 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:26.869252 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-80f52059-fe9c-4ed0-a3d8-e2bfb06e9781 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:26.869745 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-80f52059-fe9c-4ed0-a3d8-e2bfb06e9781 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:26.871739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-80f52059-fe9c-4ed0-a3d8-e2bfb06e9781 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:26.874273 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-80f52059-fe9c-4ed0-a3d8-e2bfb06e9781 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:26.875062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-80f52059-fe9c-4ed0-a3d8-e2bfb06e9781 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:26.876979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-80f52059-fe9c-4ed0-a3d8-e2bfb06e9781 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:27.330906 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4fa75f1e-fb7f-4d02-8906-676802cdeceb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:27.345238 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4fa75f1e-fb7f-4d02-8906-676802cdeceb tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b" status: 200 len: 1316 microversion: 2.1 time: 0.813755 Oct 05 02:40:27.345944 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1491/3003] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:26 2022] GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b => generated 1316 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:27.363246 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4b807c8d-37b9-48f0-b3ac-73a867a961db tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] Action: 'create', calling method: .version_select at 0x7fccdf438670>, body: {"security_group_rule": {"parent_group_id": "a32735c5-9b42-4692-8982-525c2344b855", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "5e985283-7314-4a7b-b3dd-e7e9d3f1fa8b"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:27.621727 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-80f52059-fe9c-4ed0-a3d8-e2bfb06e9781 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:27.631292 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-80f52059-fe9c-4ed0-a3d8-e2bfb06e9781 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:27.637480 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-80f52059-fe9c-4ed0-a3d8-e2bfb06e9781 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:27.638839 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-80f52059-fe9c-4ed0-a3d8-e2bfb06e9781 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1717 microversion: 2.20 time: 0.798077 Oct 05 02:40:27.641955 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1513/3004] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:40:26 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1717 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:40:27.654882 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1c303721-c269-4259-8a8a-fed3c3a428e4 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:27.656862 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1c303721-c269-4259-8a8a-fed3c3a428e4 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:27.670018 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c303721-c269-4259-8a8a-fed3c3a428e4 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:27.672659 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c303721-c269-4259-8a8a-fed3c3a428e4 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:27.673333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c303721-c269-4259-8a8a-fed3c3a428e4 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:27.678878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c303721-c269-4259-8a8a-fed3c3a428e4 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:27.679522 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c303721-c269-4259-8a8a-fed3c3a428e4 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:27.680114 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c303721-c269-4259-8a8a-fed3c3a428e4 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:28.064546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1c303721-c269-4259-8a8a-fed3c3a428e4 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:28.078330 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1c303721-c269-4259-8a8a-fed3c3a428e4 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1475 microversion: 2.1 time: 0.433970 Oct 05 02:40:28.079018 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1514/3005] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:27 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1475 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:28.093364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-92e4092e-9614-43b8-b29b-eb5379038f11 req-d836b11b-6fae-4a79-b087-868b81ade800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94bc6034-3861-4067-8f58-ff4151d8c37f", "tag": "b393c68b-ce91-4c9f-adf2-b41a81283718"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:28.116928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-92e4092e-9614-43b8-b29b-eb5379038f11 req-d836b11b-6fae-4a79-b087-868b81ade800 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:28.129875 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-92e4092e-9614-43b8-b29b-eb5379038f11 req-d836b11b-6fae-4a79-b087-868b81ade800 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:28.131343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-92e4092e-9614-43b8-b29b-eb5379038f11 req-d836b11b-6fae-4a79-b087-868b81ade800 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:28.144242 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-92e4092e-9614-43b8-b29b-eb5379038f11 req-d836b11b-6fae-4a79-b087-868b81ade800 service nova] Creating event network-changed:b393c68b-ce91-4c9f-adf2-b41a81283718 for instance 94bc6034-3861-4067-8f58-ff4151d8c37f on n-h1-858272-3 Oct 05 02:40:28.163606 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-92e4092e-9614-43b8-b29b-eb5379038f11 req-d836b11b-6fae-4a79-b087-868b81ade800 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083053 Oct 05 02:40:28.165198 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1515/3006] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:28.171179 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-61ace333-f362-4c8d-ace5-060b1a1758d7 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:28.174769 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-61ace333-f362-4c8d-ace5-060b1a1758d7 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 94bc6034-3861-4067-8f58-ff4151d8c37f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:28.189855 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-61ace333-f362-4c8d-ace5-060b1a1758d7 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:28.190653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-61ace333-f362-4c8d-ace5-060b1a1758d7 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:28.191461 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-61ace333-f362-4c8d-ace5-060b1a1758d7 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:28.196074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-61ace333-f362-4c8d-ace5-060b1a1758d7 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:28.200378 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-61ace333-f362-4c8d-ace5-060b1a1758d7 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:28.201003 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-61ace333-f362-4c8d-ace5-060b1a1758d7 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:28.586608 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-61ace333-f362-4c8d-ace5-060b1a1758d7 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:28.602157 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-61ace333-f362-4c8d-ace5-060b1a1758d7 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/94bc6034-3861-4067-8f58-ff4151d8c37f" status: 200 len: 1316 microversion: 2.1 time: 0.435443 Oct 05 02:40:28.613558 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1516/3007] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:28 2022] GET /compute/v2.1/servers/94bc6034-3861-4067-8f58-ff4151d8c37f => generated 1316 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:28.633274 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4b807c8d-37b9-48f0-b3ac-73a867a961db tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.283064 Oct 05 02:40:28.634137 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1492/3008] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 5 02:40:27 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:28.640148 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7afb5d03-f327-4415-9f23-443b72c1a3a6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:28.641891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7afb5d03-f327-4415-9f23-443b72c1a3a6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:28.659234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7afb5d03-f327-4415-9f23-443b72c1a3a6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:28.660079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7afb5d03-f327-4415-9f23-443b72c1a3a6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:28.660699 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7afb5d03-f327-4415-9f23-443b72c1a3a6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:28.661854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7afb5d03-f327-4415-9f23-443b72c1a3a6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:28.662614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7afb5d03-f327-4415-9f23-443b72c1a3a6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:28.663223 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7afb5d03-f327-4415-9f23-443b72c1a3a6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:28.675060 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-aa96cf01-adaa-41e4-975a-90a3d0e2e9d2 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] Calling method '.version_select at 0x7fccdf318dc0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:29.171715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7afb5d03-f327-4415-9f23-443b72c1a3a6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:29.180403 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7afb5d03-f327-4415-9f23-443b72c1a3a6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b" status: 200 len: 1316 microversion: 2.1 time: 0.553158 Oct 05 02:40:29.181035 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1517/3009] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:28 2022] GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b => generated 1316 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:29.185922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d2c297bf-3271-49b4-b4fe-014a8e09e388 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:29.186745 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d2c297bf-3271-49b4-b4fe-014a8e09e388 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:29.196133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2c297bf-3271-49b4-b4fe-014a8e09e388 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:29.196860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2c297bf-3271-49b4-b4fe-014a8e09e388 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:29.197490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2c297bf-3271-49b4-b4fe-014a8e09e388 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:29.198370 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2c297bf-3271-49b4-b4fe-014a8e09e388 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:29.199100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2c297bf-3271-49b4-b4fe-014a8e09e388 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:29.200663 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2c297bf-3271-49b4-b4fe-014a8e09e388 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:29.947968 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-aa96cf01-adaa-41e4-975a-90a3d0e2e9d2 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/5e985283-7314-4a7b-b3dd-e7e9d3f1fa8b" status: 202 len: 0 microversion: 2.1 time: 1.302111 Oct 05 02:40:29.955114 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1493/3010] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:40:28 2022] DELETE /compute/v2.1/os-security-groups/5e985283-7314-4a7b-b3dd-e7e9d3f1fa8b => generated 0 bytes in 1313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:40:29.976930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8b30aeff-7650-4f0c-a0d5-4a9081e481cf tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:29.978039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8b30aeff-7650-4f0c-a0d5-4a9081e481cf tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 94bc6034-3861-4067-8f58-ff4151d8c37f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:29.992472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b30aeff-7650-4f0c-a0d5-4a9081e481cf tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:29.996265 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b30aeff-7650-4f0c-a0d5-4a9081e481cf tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:29.997822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b30aeff-7650-4f0c-a0d5-4a9081e481cf tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:29.999270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b30aeff-7650-4f0c-a0d5-4a9081e481cf tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:30.000577 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b30aeff-7650-4f0c-a0d5-4a9081e481cf tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:30.001279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b30aeff-7650-4f0c-a0d5-4a9081e481cf tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:30.121512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d2c297bf-3271-49b4-b4fe-014a8e09e388 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:30.138765 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d2c297bf-3271-49b4-b4fe-014a8e09e388 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1475 microversion: 2.1 time: 0.956455 Oct 05 02:40:30.139976 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1518/3011] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:29 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1475 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:30.144863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-814fea97-ece5-4ca9-9125-873da8f18119 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] Calling method '.version_select at 0x7fcce433adc0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:30.371682 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-814fea97-ece5-4ca9-9125-873da8f18119 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/a32735c5-9b42-4692-8982-525c2344b855" status: 200 len: 247 microversion: 2.1 time: 0.230429 Oct 05 02:40:30.372562 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1519/3012] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 5 02:40:30 2022] GET /compute/v2.1/os-security-groups/a32735c5-9b42-4692-8982-525c2344b855 => generated 247 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:30.382477 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-91a81123-6bf8-4baf-a207-a3fcaa2988fd tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:30.382477 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-91a81123-6bf8-4baf-a207-a3fcaa2988fd tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:30.408062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91a81123-6bf8-4baf-a207-a3fcaa2988fd tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:30.409968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91a81123-6bf8-4baf-a207-a3fcaa2988fd tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:30.423140 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91a81123-6bf8-4baf-a207-a3fcaa2988fd tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:30.424508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91a81123-6bf8-4baf-a207-a3fcaa2988fd tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:30.428767 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91a81123-6bf8-4baf-a207-a3fcaa2988fd tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:30.429508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91a81123-6bf8-4baf-a207-a3fcaa2988fd tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:30.528189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8b30aeff-7650-4f0c-a0d5-4a9081e481cf tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:30.548395 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8b30aeff-7650-4f0c-a0d5-4a9081e481cf tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/94bc6034-3861-4067-8f58-ff4151d8c37f" status: 200 len: 1316 microversion: 2.1 time: 0.590320 Oct 05 02:40:30.557187 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1494/3013] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:29 2022] GET /compute/v2.1/servers/94bc6034-3861-4067-8f58-ff4151d8c37f => generated 1316 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:30.562596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2d6fc34e-40f1-4d3d-9b3f-3850371a81ad tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] Action: 'create', calling method: .version_select at 0x7fccdf318820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1579402888", "description": "tempest-description-1646074875"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:30.866574 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-91a81123-6bf8-4baf-a207-a3fcaa2988fd tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:30.886031 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-91a81123-6bf8-4baf-a207-a3fcaa2988fd tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b" status: 200 len: 1316 microversion: 2.1 time: 0.511825 Oct 05 02:40:30.887190 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1520/3014] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:30 2022] GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b => generated 1316 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:31.109394 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2d6fc34e-40f1-4d3d-9b3f-3850371a81ad tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.550645 Oct 05 02:40:31.110622 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1495/3015] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 5 02:40:30 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:31.125110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-38ef3656-093b-4635-b104-4e64c8ee8311 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] Action: 'create', calling method: .version_select at 0x7fcce82319d0>, body: {"security_group_rule": {"parent_group_id": "64322369-fb42-428f-a569-b5544c17275d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:31.167837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-19f20c12-4623-43e3-9186-92c42ac61d57 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:31.168866 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-19f20c12-4623-43e3-9186-92c42ac61d57 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:31.183120 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19f20c12-4623-43e3-9186-92c42ac61d57 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:31.183830 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19f20c12-4623-43e3-9186-92c42ac61d57 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:31.184633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19f20c12-4623-43e3-9186-92c42ac61d57 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:31.185538 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19f20c12-4623-43e3-9186-92c42ac61d57 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:31.186137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19f20c12-4623-43e3-9186-92c42ac61d57 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:31.186700 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19f20c12-4623-43e3-9186-92c42ac61d57 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:31.540179 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-38ef3656-093b-4635-b104-4e64c8ee8311 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.416696 Oct 05 02:40:31.542974 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1521/3016] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 5 02:40:31 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:31.557578 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5f805b1b-7415-45fc-8ce1-c856a9a6d9b3 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] Action: 'create', calling method: .version_select at 0x7fcce45afc10>, body: {"security_group_rule": {"parent_group_id": "64322369-fb42-428f-a569-b5544c17275d", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:31.562246 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-19f20c12-4623-43e3-9186-92c42ac61d57 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:31.575859 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-19f20c12-4623-43e3-9186-92c42ac61d57 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1475 microversion: 2.1 time: 0.411772 Oct 05 02:40:31.595993 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1496/3017] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:31 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1475 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:40:31.601469 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-ff53c12c-732a-482c-a953-9e69a3645b46 req-b16b4aaa-43bc-4a16-8d99-597ff5479a82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b", "tag": "d2e34487-c5e1-4d23-bdc7-9bbdaa045c58"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:31.628230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ff53c12c-732a-482c-a953-9e69a3645b46 req-b16b4aaa-43bc-4a16-8d99-597ff5479a82 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:31.631773 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ff53c12c-732a-482c-a953-9e69a3645b46 req-b16b4aaa-43bc-4a16-8d99-597ff5479a82 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:31.632438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ff53c12c-732a-482c-a953-9e69a3645b46 req-b16b4aaa-43bc-4a16-8d99-597ff5479a82 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:31.669259 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-ff53c12c-732a-482c-a953-9e69a3645b46 req-b16b4aaa-43bc-4a16-8d99-597ff5479a82 service nova] Creating event network-changed:d2e34487-c5e1-4d23-bdc7-9bbdaa045c58 for instance 35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b on n-h2-858272-3 Oct 05 02:40:31.685301 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-ff53c12c-732a-482c-a953-9e69a3645b46 req-b16b4aaa-43bc-4a16-8d99-597ff5479a82 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086726 Oct 05 02:40:31.688100 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1497/3018] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:31.708151 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-361724f4-9f81-4a89-951c-9b2a6bc68693 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:31.709484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-361724f4-9f81-4a89-951c-9b2a6bc68693 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 94bc6034-3861-4067-8f58-ff4151d8c37f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:31.720581 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-361724f4-9f81-4a89-951c-9b2a6bc68693 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:31.721620 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-361724f4-9f81-4a89-951c-9b2a6bc68693 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:31.722821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-361724f4-9f81-4a89-951c-9b2a6bc68693 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:31.725381 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-361724f4-9f81-4a89-951c-9b2a6bc68693 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:31.726126 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-361724f4-9f81-4a89-951c-9b2a6bc68693 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:31.726889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-361724f4-9f81-4a89-951c-9b2a6bc68693 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:31.933912 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:40:31.991132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=12 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:40:32.037946 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-361724f4-9f81-4a89-951c-9b2a6bc68693 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:32.060517 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-361724f4-9f81-4a89-951c-9b2a6bc68693 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/94bc6034-3861-4067-8f58-ff4151d8c37f" status: 200 len: 1316 microversion: 2.1 time: 0.368946 Oct 05 02:40:32.062247 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1498/3019] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:31 2022] GET /compute/v2.1/servers/94bc6034-3861-4067-8f58-ff4151d8c37f => generated 1316 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:32.081662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-13f98cfd-4b9e-4f24-9a7d-3986076ae15c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:32.082293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-13f98cfd-4b9e-4f24-9a7d-3986076ae15c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:32.089089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13f98cfd-4b9e-4f24-9a7d-3986076ae15c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:32.089518 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13f98cfd-4b9e-4f24-9a7d-3986076ae15c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:32.090020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13f98cfd-4b9e-4f24-9a7d-3986076ae15c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:32.090919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13f98cfd-4b9e-4f24-9a7d-3986076ae15c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:32.091527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13f98cfd-4b9e-4f24-9a7d-3986076ae15c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:32.092154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13f98cfd-4b9e-4f24-9a7d-3986076ae15c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:32.410039 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5f805b1b-7415-45fc-8ce1-c856a9a6d9b3 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.859165 Oct 05 02:40:32.410668 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1522/3020] 10.222.0.16 () {60 vars in 1195 bytes} [Wed Oct 5 02:40:31 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:32.422627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-68482f0a-6ddd-4176-b006-cd3a8cec28f7 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] Calling method '.version_select at 0x7fcce42d0dc0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:32.425297 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-13f98cfd-4b9e-4f24-9a7d-3986076ae15c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:32.440464 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-13f98cfd-4b9e-4f24-9a7d-3986076ae15c tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b" status: 200 len: 1316 microversion: 2.1 time: 0.374126 Oct 05 02:40:32.441487 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1499/3021] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:32 2022] GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b => generated 1316 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:32.574054 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-68482f0a-6ddd-4176-b006-cd3a8cec28f7 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/64322369-fb42-428f-a569-b5544c17275d" status: 200 len: 665 microversion: 2.1 time: 0.146988 Oct 05 02:40:32.583783 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1523/3022] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 5 02:40:32 2022] GET /compute/v2.1/os-security-groups/64322369-fb42-428f-a569-b5544c17275d => generated 665 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:32.589348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b33e7fab-ec23-446e-93d9-f4c639bc77b2 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] Calling method '.version_select at 0x7fccdf324d30>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:32.603228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-82a4a305-f4ef-48d3-9393-71970d1807e7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:32.603859 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-82a4a305-f4ef-48d3-9393-71970d1807e7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:32.629969 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82a4a305-f4ef-48d3-9393-71970d1807e7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:32.631573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82a4a305-f4ef-48d3-9393-71970d1807e7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:32.632024 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82a4a305-f4ef-48d3-9393-71970d1807e7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:32.633099 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82a4a305-f4ef-48d3-9393-71970d1807e7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:32.633803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82a4a305-f4ef-48d3-9393-71970d1807e7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:32.635454 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82a4a305-f4ef-48d3-9393-71970d1807e7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:32.923324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-82a4a305-f4ef-48d3-9393-71970d1807e7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:32.943243 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b33e7fab-ec23-446e-93d9-f4c639bc77b2 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/a60b488d-764f-47bf-a1a9-50217393c6e2" status: 202 len: 0 microversion: 2.1 time: 0.357091 Oct 05 02:40:32.944656 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1500/3023] 10.222.0.16 () {58 vars in 1287 bytes} [Wed Oct 5 02:40:32 2022] DELETE /compute/v2.1/os-security-group-rules/a60b488d-764f-47bf-a1a9-50217393c6e2 => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:40:32.955198 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-82a4a305-f4ef-48d3-9393-71970d1807e7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1475 microversion: 2.1 time: 0.356322 Oct 05 02:40:32.958905 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c8bcdd8a-cf98-46d4-8bd6-6e2e113b9e0c tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] Calling method '.version_select at 0x7fccdf2b1790>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:32.969920 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1524/3024] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:32 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1475 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:33.101518 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3d4b2771-7bb2-4111-ae62-c9984388b82e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:33.104769 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3d4b2771-7bb2-4111-ae62-c9984388b82e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 94bc6034-3861-4067-8f58-ff4151d8c37f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:33.121061 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d4b2771-7bb2-4111-ae62-c9984388b82e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:33.123193 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d4b2771-7bb2-4111-ae62-c9984388b82e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:33.125384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d4b2771-7bb2-4111-ae62-c9984388b82e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:33.141585 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d4b2771-7bb2-4111-ae62-c9984388b82e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:33.145150 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d4b2771-7bb2-4111-ae62-c9984388b82e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:33.149488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d4b2771-7bb2-4111-ae62-c9984388b82e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:33.220367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:40:33.441660 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c8bcdd8a-cf98-46d4-8bd6-6e2e113b9e0c tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/64322369-fb42-428f-a569-b5544c17275d" status: 202 len: 0 microversion: 2.1 time: 0.489840 Oct 05 02:40:33.444134 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1501/3025] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:40:32 2022] DELETE /compute/v2.1/os-security-groups/64322369-fb42-428f-a569-b5544c17275d => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:40:33.449767 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-64812c84-cde8-40ba-9289-52889f14a5a3 req-9591def0-5612-4a42-92d1-521f4be37a8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac3c82a2-0553-4902-ba33-568525392af2", "name": "network-vif-plugged", "status": "completed", "tag": "8a6f06f5-5996-445c-a262-e2d180ad3ca7"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:33.463771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-64812c84-cde8-40ba-9289-52889f14a5a3 req-9591def0-5612-4a42-92d1-521f4be37a8e service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:33.464674 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-64812c84-cde8-40ba-9289-52889f14a5a3 req-9591def0-5612-4a42-92d1-521f4be37a8e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:33.465563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-64812c84-cde8-40ba-9289-52889f14a5a3 req-9591def0-5612-4a42-92d1-521f4be37a8e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:33.487566 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-64812c84-cde8-40ba-9289-52889f14a5a3 req-9591def0-5612-4a42-92d1-521f4be37a8e service nova] Creating event network-vif-plugged:8a6f06f5-5996-445c-a262-e2d180ad3ca7 for instance ac3c82a2-0553-4902-ba33-568525392af2 on n-h2-858272-3 Oct 05 02:40:33.496100 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-64812c84-cde8-40ba-9289-52889f14a5a3 req-9591def0-5612-4a42-92d1-521f4be37a8e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050088 Oct 05 02:40:33.497915 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1502/3026] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:33.507111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c6c6c5b1-c11b-4afc-9657-a610305a34d9 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] Calling method '.version_select at 0x7fccdf2b1700>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:33.661648 n-d-858272-3 devstack@n-api.service[122319]: DEBUG neutronclient.v2_0.client [None req-c6c6c5b1-c11b-4afc-9657-a610305a34d9 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5e985283-7314-4a7b-b3dd-e7e9d3f1fa8b does not exist", "detail": ""}} {{(pid=122319) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 02:40:33.661648 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.security_group_api [None req-c6c6c5b1-c11b-4afc-9657-a610305a34d9 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] Neutron security group 5e985283-7314-4a7b-b3dd-e7e9d3f1fa8b not found {{(pid=122319) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 05 02:40:33.661648 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-c6c6c5b1-c11b-4afc-9657-a610305a34d9 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] HTTP exception thrown: Security group 5e985283-7314-4a7b-b3dd-e7e9d3f1fa8b does not exist Oct 05 02:40:33.661648 n-d-858272-3 devstack@n-api.service[122319]: Neutron server returns request_ids: ['req-8bd43a02-f452-40bb-b88a-594958a401c8'] Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c6c6c5b1-c11b-4afc-9657-a610305a34d9 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] Request method failure captured: Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/os-security-groups/5e985283-7314-4a7b-b3dd-e7e9d3f1fa8b HTTP/1.1 Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO6JO6OrTI0YzB6vRnE-RhawBO-SWdtBffPghycdxtfNID8MdL-JPn9iOjSBNHd9n76YXf8n_qvJJkbVBCHErPnJXrDe77hjnnuiDbMVqDv9Ac8w6tbeEyZFwwIsXE31XHm6Tek8Uz5VykUw3vdmrEBkwsqzvHSTi47D7vLMA2XIdYo Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 6fb5662ea05340d28c0cb6a096579815 Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-294743579 Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6fb5662ea05340d28c0cb6a096579815"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6fb5662ea05340d28c0cb6a096579815"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6fb5662ea05340d28c0cb6a096579815"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6fb5662ea05340d28c0cb6a096579815"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-SecurityGroupRulesTestJSON-294743579 Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 6fb5662ea05340d28c0cb6a096579815 Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-294743579 Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-SecurityGroupRulesTestJSON-294743579-project Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: bec99928d4b54fe6a6275a01b1267c83 Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-SecurityGroupRulesTestJSON-294743579-project Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: exception: Security group 5e985283-7314-4a7b-b3dd-e7e9d3f1fa8b does not exist Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: Neutron server returns request_ids: ['req-8bd43a02-f452-40bb-b88a-594958a401c8'] Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '5e985283-7314-4a7b-b3dd-e7e9d3f1fa8b'} Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 02:40:33.663200 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5e985283-7314-4a7b-b3dd-e7e9d3f1fa8b does not exist Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8bd43a02-f452-40bb-b88a-594958a401c8'] Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5e985283-7314-4a7b-b3dd-e7e9d3f1fa8b does not exist Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8bd43a02-f452-40bb-b88a-594958a401c8'] Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5e985283-7314-4a7b-b3dd-e7e9d3f1fa8b does not exist Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8bd43a02-f452-40bb-b88a-594958a401c8'] Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5e985283-7314-4a7b-b3dd-e7e9d3f1fa8b does not exist Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8bd43a02-f452-40bb-b88a-594958a401c8'] Oct 05 02:40:33.667670 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:40:33.673717 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c6c6c5b1-c11b-4afc-9657-a610305a34d9 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] Returning 404 to user: Security group 5e985283-7314-4a7b-b3dd-e7e9d3f1fa8b does not exist Oct 05 02:40:33.673717 n-d-858272-3 devstack@n-api.service[122319]: Neutron server returns request_ids: ['req-8bd43a02-f452-40bb-b88a-594958a401c8'] {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:40:33.673717 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c6c6c5b1-c11b-4afc-9657-a610305a34d9 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/5e985283-7314-4a7b-b3dd-e7e9d3f1fa8b" status: 404 len: 194 microversion: 2.1 time: 0.173055 Oct 05 02:40:33.674250 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1503/3027] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:40:33 2022] DELETE /compute/v2.1/os-security-groups/5e985283-7314-4a7b-b3dd-e7e9d3f1fa8b => generated 194 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:40:33.685597 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fb8b58d0-47bc-48c5-8e2e-51389522d9af tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:33.688407 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fb8b58d0-47bc-48c5-8e2e-51389522d9af tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:33.707759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb8b58d0-47bc-48c5-8e2e-51389522d9af tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:33.708937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb8b58d0-47bc-48c5-8e2e-51389522d9af tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:33.710335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb8b58d0-47bc-48c5-8e2e-51389522d9af tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:33.713213 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb8b58d0-47bc-48c5-8e2e-51389522d9af tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:33.715340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3d4b2771-7bb2-4111-ae62-c9984388b82e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:33.717332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb8b58d0-47bc-48c5-8e2e-51389522d9af tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:33.717989 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb8b58d0-47bc-48c5-8e2e-51389522d9af tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:33.723271 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3d4b2771-7bb2-4111-ae62-c9984388b82e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/94bc6034-3861-4067-8f58-ff4151d8c37f" status: 200 len: 1316 microversion: 2.1 time: 0.637044 Oct 05 02:40:33.739904 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1525/3028] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:33 2022] GET /compute/v2.1/servers/94bc6034-3861-4067-8f58-ff4151d8c37f => generated 1316 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:33.739904 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6f886250-91c1-4d9d-be2a-2ccbf5e30f3c tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] Calling method '.version_select at 0x7fcce42d0c10>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:33.760634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:40:34.070815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fb8b58d0-47bc-48c5-8e2e-51389522d9af tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:34.096575 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fb8b58d0-47bc-48c5-8e2e-51389522d9af tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b" status: 200 len: 1316 microversion: 2.1 time: 0.420967 Oct 05 02:40:34.115999 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1504/3029] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:33 2022] GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b => generated 1316 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:34.124737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6695d8c9-e091-4fcb-ac94-c7f2f7d78d91 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:34.128235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6695d8c9-e091-4fcb-ac94-c7f2f7d78d91 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:34.138150 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6695d8c9-e091-4fcb-ac94-c7f2f7d78d91 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:34.147172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6695d8c9-e091-4fcb-ac94-c7f2f7d78d91 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:34.147980 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6695d8c9-e091-4fcb-ac94-c7f2f7d78d91 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:34.149194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6695d8c9-e091-4fcb-ac94-c7f2f7d78d91 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:34.149934 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6695d8c9-e091-4fcb-ac94-c7f2f7d78d91 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:34.150775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6695d8c9-e091-4fcb-ac94-c7f2f7d78d91 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:34.305420 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6f886250-91c1-4d9d-be2a-2ccbf5e30f3c tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/a32735c5-9b42-4692-8982-525c2344b855" status: 202 len: 0 microversion: 2.1 time: 0.574887 Oct 05 02:40:34.306350 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1526/3030] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:40:33 2022] DELETE /compute/v2.1/os-security-groups/a32735c5-9b42-4692-8982-525c2344b855 => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:40:34.315863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-842e2bbe-1e31-4814-8d14-a9e3404918b2 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] Calling method '.version_select at 0x7fcce42d0160>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:34.542098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6695d8c9-e091-4fcb-ac94-c7f2f7d78d91 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:34.556163 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6695d8c9-e091-4fcb-ac94-c7f2f7d78d91 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1475 microversion: 2.1 time: 0.438392 Oct 05 02:40:34.557033 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1505/3031] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:34 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1475 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:34.748271 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6c11e0aa-3e71-40b0-b825-11daf25955b3 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:34.749130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6c11e0aa-3e71-40b0-b825-11daf25955b3 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 94bc6034-3861-4067-8f58-ff4151d8c37f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:34.759696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c11e0aa-3e71-40b0-b825-11daf25955b3 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:34.760868 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-842e2bbe-1e31-4814-8d14-a9e3404918b2 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/c9299c7f-ee8a-4ca3-a6e5-1660d371e22b" status: 202 len: 0 microversion: 2.1 time: 0.449948 Oct 05 02:40:34.761514 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1527/3032] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:40:34 2022] DELETE /compute/v2.1/os-security-groups/c9299c7f-ee8a-4ca3-a6e5-1660d371e22b => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 02:40:34.763497 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c11e0aa-3e71-40b0-b825-11daf25955b3 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:34.765828 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c11e0aa-3e71-40b0-b825-11daf25955b3 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:34.768158 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c11e0aa-3e71-40b0-b825-11daf25955b3 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:34.768815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c11e0aa-3e71-40b0-b825-11daf25955b3 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:34.769607 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c11e0aa-3e71-40b0-b825-11daf25955b3 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:34.770442 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ab2202a6-cd51-4abb-9698-8595d9c543e9 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] Calling method '.version_select at 0x7fccdfccdb80>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:35.071782 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6c11e0aa-3e71-40b0-b825-11daf25955b3 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:35.087003 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6c11e0aa-3e71-40b0-b825-11daf25955b3 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/94bc6034-3861-4067-8f58-ff4151d8c37f" status: 200 len: 1316 microversion: 2.1 time: 0.342556 Oct 05 02:40:35.087920 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1506/3033] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:34 2022] GET /compute/v2.1/servers/94bc6034-3861-4067-8f58-ff4151d8c37f => generated 1316 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:40:35.123948 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ab2202a6-cd51-4abb-9698-8595d9c543e9 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/e5c7e6ac-148b-45b5-90fb-b94ef70b326f" status: 202 len: 0 microversion: 2.1 time: 0.358306 Oct 05 02:40:35.124984 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1528/3034] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:40:34 2022] DELETE /compute/v2.1/os-security-groups/e5c7e6ac-148b-45b5-90fb-b94ef70b326f => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:40:35.136157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a3724ded-3d35-48b3-9462-1278b28e65fe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:35.136785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a3724ded-3d35-48b3-9462-1278b28e65fe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:35.150724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e05e6d7b-c0b5-4bdc-9c58-65903ea5f9e3 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] Calling method '.version_select at 0x7fcce4400af0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:35.197187 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3724ded-3d35-48b3-9462-1278b28e65fe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:35.198365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3724ded-3d35-48b3-9462-1278b28e65fe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:35.203835 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3724ded-3d35-48b3-9462-1278b28e65fe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:35.206165 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3724ded-3d35-48b3-9462-1278b28e65fe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:35.209437 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3724ded-3d35-48b3-9462-1278b28e65fe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:35.215118 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3724ded-3d35-48b3-9462-1278b28e65fe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:35.654595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a3724ded-3d35-48b3-9462-1278b28e65fe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:35.664265 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a3724ded-3d35-48b3-9462-1278b28e65fe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b" status: 200 len: 1316 microversion: 2.1 time: 0.537245 Oct 05 02:40:35.669262 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1507/3035] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:35 2022] GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b => generated 1316 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:35.686723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-41a0d4fe-3cbf-4e24-ac89-6cba4ed255d6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:35.687968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-41a0d4fe-3cbf-4e24-ac89-6cba4ed255d6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:35.701822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41a0d4fe-3cbf-4e24-ac89-6cba4ed255d6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:35.702382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41a0d4fe-3cbf-4e24-ac89-6cba4ed255d6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:35.702897 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41a0d4fe-3cbf-4e24-ac89-6cba4ed255d6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:35.703822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41a0d4fe-3cbf-4e24-ac89-6cba4ed255d6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:35.704552 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41a0d4fe-3cbf-4e24-ac89-6cba4ed255d6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:35.705178 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41a0d4fe-3cbf-4e24-ac89-6cba4ed255d6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:36.136571 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e05e6d7b-c0b5-4bdc-9c58-65903ea5f9e3 tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/f89bded8-bd42-4611-bbb5-c7146765b225" status: 202 len: 0 microversion: 2.1 time: 1.002656 Oct 05 02:40:36.137720 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1529/3036] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:40:35 2022] DELETE /compute/v2.1/os-security-groups/f89bded8-bd42-4611-bbb5-c7146765b225 => generated 0 bytes in 1004 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:40:36.143780 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-4c43a2da-0117-452e-925f-c34aeee6b7de req-81c422b6-2cf4-4f52-8614-9dc1869a13c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94bc6034-3861-4067-8f58-ff4151d8c37f", "name": "network-vif-plugged", "status": "completed", "tag": "b393c68b-ce91-4c9f-adf2-b41a81283718"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:36.160106 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4c43a2da-0117-452e-925f-c34aeee6b7de req-81c422b6-2cf4-4f52-8614-9dc1869a13c1 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:36.161820 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4c43a2da-0117-452e-925f-c34aeee6b7de req-81c422b6-2cf4-4f52-8614-9dc1869a13c1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:36.162612 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4c43a2da-0117-452e-925f-c34aeee6b7de req-81c422b6-2cf4-4f52-8614-9dc1869a13c1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:36.171142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-41a0d4fe-3cbf-4e24-ac89-6cba4ed255d6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:36.194095 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-41a0d4fe-3cbf-4e24-ac89-6cba4ed255d6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1475 microversion: 2.1 time: 0.523104 Oct 05 02:40:36.195706 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-4c43a2da-0117-452e-925f-c34aeee6b7de req-81c422b6-2cf4-4f52-8614-9dc1869a13c1 service nova] Creating event network-vif-plugged:b393c68b-ce91-4c9f-adf2-b41a81283718 for instance 94bc6034-3861-4067-8f58-ff4151d8c37f on n-h1-858272-3 Oct 05 02:40:36.196594 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1508/3037] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:35 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1475 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:36.222808 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-953fcaf2-1d5e-4805-ab36-dad9f386a3bc tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:36.224424 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-953fcaf2-1d5e-4805-ab36-dad9f386a3bc tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 94bc6034-3861-4067-8f58-ff4151d8c37f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:36.238560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-953fcaf2-1d5e-4805-ab36-dad9f386a3bc tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:36.240450 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-953fcaf2-1d5e-4805-ab36-dad9f386a3bc tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:36.240770 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-4c43a2da-0117-452e-925f-c34aeee6b7de req-81c422b6-2cf4-4f52-8614-9dc1869a13c1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096342 Oct 05 02:40:36.242700 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1530/3038] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:36.243924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-953fcaf2-1d5e-4805-ab36-dad9f386a3bc tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:36.246096 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-953fcaf2-1d5e-4805-ab36-dad9f386a3bc tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:36.246945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-953fcaf2-1d5e-4805-ab36-dad9f386a3bc tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:36.248784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-953fcaf2-1d5e-4805-ab36-dad9f386a3bc tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:36.251406 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0ce9b1ee-f109-44c1-9933-859d9f6ea6df tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] Calling method '.version_select at 0x7fcce434fee0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:36.721698 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-953fcaf2-1d5e-4805-ab36-dad9f386a3bc tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:36.734013 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-953fcaf2-1d5e-4805-ab36-dad9f386a3bc tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/94bc6034-3861-4067-8f58-ff4151d8c37f" status: 200 len: 1316 microversion: 2.1 time: 0.535905 Oct 05 02:40:36.734611 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1509/3039] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:36 2022] GET /compute/v2.1/servers/94bc6034-3861-4067-8f58-ff4151d8c37f => generated 1316 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:36.848763 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0ce9b1ee-f109-44c1-9933-859d9f6ea6df tempest-SecurityGroupRulesTestJSON-294743579 tempest-SecurityGroupRulesTestJSON-294743579-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/94c57a9f-436b-4b1c-9023-2d4f0934f35e" status: 202 len: 0 microversion: 2.1 time: 0.603087 Oct 05 02:40:36.854314 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1531/3040] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:40:36 2022] DELETE /compute/v2.1/os-security-groups/94c57a9f-436b-4b1c-9023-2d4f0934f35e => generated 0 bytes in 611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:40:36.889496 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-81c85820-04be-481b-975b-cf2cdad558ed tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:36.893805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-81c85820-04be-481b-975b-cf2cdad558ed tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:36.917889 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81c85820-04be-481b-975b-cf2cdad558ed tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:36.921913 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81c85820-04be-481b-975b-cf2cdad558ed tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:36.922945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81c85820-04be-481b-975b-cf2cdad558ed tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:36.925738 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81c85820-04be-481b-975b-cf2cdad558ed tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:36.927542 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81c85820-04be-481b-975b-cf2cdad558ed tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:36.931483 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81c85820-04be-481b-975b-cf2cdad558ed tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:37.024054 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4211c4d8-9229-4f3a-b51e-a5deca4dd63b tempest-ComputeTenantNetworksTest-1814846216 tempest-ComputeTenantNetworksTest-1814846216-project] Calling method '.version_select at 0x7fccdf3185e0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:38.123453 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4211c4d8-9229-4f3a-b51e-a5deca4dd63b tempest-ComputeTenantNetworksTest-1814846216 tempest-ComputeTenantNetworksTest-1814846216-project] 10.222.0.16 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 1.387484 Oct 05 02:40:38.124426 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1510/3041] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 5 02:40:36 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:38.129484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-12b862fa-0ca3-43e8-9c96-8b31bda8a1e0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:38.131023 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-12b862fa-0ca3-43e8-9c96-8b31bda8a1e0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:38.146768 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12b862fa-0ca3-43e8-9c96-8b31bda8a1e0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:38.147280 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12b862fa-0ca3-43e8-9c96-8b31bda8a1e0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:38.147729 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12b862fa-0ca3-43e8-9c96-8b31bda8a1e0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:38.148455 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12b862fa-0ca3-43e8-9c96-8b31bda8a1e0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:38.148946 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12b862fa-0ca3-43e8-9c96-8b31bda8a1e0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:38.149389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12b862fa-0ca3-43e8-9c96-8b31bda8a1e0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:38.359595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-81c85820-04be-481b-975b-cf2cdad558ed tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:38.379930 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-81c85820-04be-481b-975b-cf2cdad558ed tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b" status: 200 len: 1316 microversion: 2.1 time: 1.514411 Oct 05 02:40:38.384615 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1532/3042] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:36 2022] GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b => generated 1316 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:38.406321 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-256cc5c8-a042-438c-9cb1-ae664d88f80d tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:38.406965 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-256cc5c8-a042-438c-9cb1-ae664d88f80d tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 94bc6034-3861-4067-8f58-ff4151d8c37f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:38.433837 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-256cc5c8-a042-438c-9cb1-ae664d88f80d tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:38.437099 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-256cc5c8-a042-438c-9cb1-ae664d88f80d tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:38.437681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-256cc5c8-a042-438c-9cb1-ae664d88f80d tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:38.438909 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-256cc5c8-a042-438c-9cb1-ae664d88f80d tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:38.441881 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-256cc5c8-a042-438c-9cb1-ae664d88f80d tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:38.447657 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-256cc5c8-a042-438c-9cb1-ae664d88f80d tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:38.890505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-12b862fa-0ca3-43e8-9c96-8b31bda8a1e0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:38.899308 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-12b862fa-0ca3-43e8-9c96-8b31bda8a1e0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1475 microversion: 2.1 time: 0.773468 Oct 05 02:40:38.899904 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1511/3043] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:38 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1475 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:38.920488 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a33f96b2-9b4b-4e77-9ad0-f6aa71439d49 tempest-ComputeTenantNetworksTest-1814846216 tempest-ComputeTenantNetworksTest-1814846216-project] Calling method '.version_select at 0x7fccdfc33f70>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:39.063133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-256cc5c8-a042-438c-9cb1-ae664d88f80d tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:39.074254 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-256cc5c8-a042-438c-9cb1-ae664d88f80d tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/94bc6034-3861-4067-8f58-ff4151d8c37f" status: 200 len: 1316 microversion: 2.1 time: 0.688419 Oct 05 02:40:39.075142 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1533/3044] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:38 2022] GET /compute/v2.1/servers/94bc6034-3861-4067-8f58-ff4151d8c37f => generated 1316 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:39.198326 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dd9e8a04-76eb-4e7d-8066-78a56d947da9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1792253361", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "8d324f6f-cca2-40de-b54e-b428e9535a8f"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:39.217943 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a33f96b2-9b4b-4e77-9ad0-f6aa71439d49 tempest-ComputeTenantNetworksTest-1814846216 tempest-ComputeTenantNetworksTest-1814846216-project] 10.222.0.16 "GET /compute/v2.1/os-tenant-networks/ab985550-97d6-420b-9657-778ebf68220d" status: 200 len: 140 microversion: 2.1 time: 0.316746 Oct 05 02:40:39.225838 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1512/3045] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 5 02:40:38 2022] GET /compute/v2.1/os-tenant-networks/ab985550-97d6-420b-9657-778ebf68220d => generated 140 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:39.276746 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-dd9e8a04-76eb-4e7d-8066-78a56d947da9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] validate_networks() for [('8d324f6f-cca2-40de-b54e-b428e9535a8f', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:40:39.412226 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2e64aecd-4950-4182-8415-f45fc7d44efa tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:39.412475 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2e64aecd-4950-4182-8415-f45fc7d44efa tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:39.424760 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e64aecd-4950-4182-8415-f45fc7d44efa tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:39.425767 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e64aecd-4950-4182-8415-f45fc7d44efa tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:39.426905 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e64aecd-4950-4182-8415-f45fc7d44efa tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:39.427998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e64aecd-4950-4182-8415-f45fc7d44efa tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:39.432159 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e64aecd-4950-4182-8415-f45fc7d44efa tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:39.433428 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e64aecd-4950-4182-8415-f45fc7d44efa tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:40.215175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2e64aecd-4950-4182-8415-f45fc7d44efa tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:40.224689 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2e64aecd-4950-4182-8415-f45fc7d44efa tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b" status: 200 len: 1316 microversion: 2.1 time: 0.817779 Oct 05 02:40:40.240785 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1513/3046] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:39 2022] GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b => generated 1316 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:40:40.240785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7572aee9-0af2-4a41-9e0f-50d8791853e8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:40.240785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7572aee9-0af2-4a41-9e0f-50d8791853e8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:40.250871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7572aee9-0af2-4a41-9e0f-50d8791853e8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:40.251690 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7572aee9-0af2-4a41-9e0f-50d8791853e8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:40.252056 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7572aee9-0af2-4a41-9e0f-50d8791853e8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:40.252862 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7572aee9-0af2-4a41-9e0f-50d8791853e8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:40.254492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7572aee9-0af2-4a41-9e0f-50d8791853e8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:40.254492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7572aee9-0af2-4a41-9e0f-50d8791853e8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:41.077747 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7572aee9-0af2-4a41-9e0f-50d8791853e8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:41.089476 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7572aee9-0af2-4a41-9e0f-50d8791853e8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1474 microversion: 2.1 time: 0.857019 Oct 05 02:40:41.111185 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1514/3047] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:40 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1474 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:41.118390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-dd9e8a04-76eb-4e7d-8066-78a56d947da9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:40:41.118884 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-dd9e8a04-76eb-4e7d-8066-78a56d947da9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:40:41.119269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-dd9e8a04-76eb-4e7d-8066-78a56d947da9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:40:41.119676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-dd9e8a04-76eb-4e7d-8066-78a56d947da9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:40:41.120099 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-dd9e8a04-76eb-4e7d-8066-78a56d947da9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:40:41.135666 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-7573e877-5bc2-4864-997b-6bbfb33bc351 req-56d90caa-efa5-47d8-b4eb-98f5bef9101f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b", "name": "network-vif-plugged", "status": "completed", "tag": "d2e34487-c5e1-4d23-bdc7-9bbdaa045c58"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:41.139507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd9e8a04-76eb-4e7d-8066-78a56d947da9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:41.140004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd9e8a04-76eb-4e7d-8066-78a56d947da9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:41.140438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd9e8a04-76eb-4e7d-8066-78a56d947da9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:41.141877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd9e8a04-76eb-4e7d-8066-78a56d947da9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:41.142340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd9e8a04-76eb-4e7d-8066-78a56d947da9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:41.142768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd9e8a04-76eb-4e7d-8066-78a56d947da9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:41.165086 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7573e877-5bc2-4864-997b-6bbfb33bc351 req-56d90caa-efa5-47d8-b4eb-98f5bef9101f service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:41.165679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7573e877-5bc2-4864-997b-6bbfb33bc351 req-56d90caa-efa5-47d8-b4eb-98f5bef9101f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:41.166211 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7573e877-5bc2-4864-997b-6bbfb33bc351 req-56d90caa-efa5-47d8-b4eb-98f5bef9101f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:41.166614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-dd9e8a04-76eb-4e7d-8066-78a56d947da9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Getting quotas for project 58c3c2b9910b4ba48a52cb1e3f1ef254. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:40:41.189196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-dd9e8a04-76eb-4e7d-8066-78a56d947da9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Getting quotas for user 9211cfded73b4747b3cb63bcfb3c3ff8 and project 58c3c2b9910b4ba48a52cb1e3f1ef254. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:40:41.202479 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-7573e877-5bc2-4864-997b-6bbfb33bc351 req-56d90caa-efa5-47d8-b4eb-98f5bef9101f service nova] Creating event network-vif-plugged:d2e34487-c5e1-4d23-bdc7-9bbdaa045c58 for instance 35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b on n-h2-858272-3 Oct 05 02:40:41.210703 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-7573e877-5bc2-4864-997b-6bbfb33bc351 req-56d90caa-efa5-47d8-b4eb-98f5bef9101f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097078 Oct 05 02:40:41.210940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dd9e8a04-76eb-4e7d-8066-78a56d947da9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:40:41.211808 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1515/3048] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:41.213416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dd9e8a04-76eb-4e7d-8066-78a56d947da9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:40:41.226265 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6af6078d-302a-4318-b190-3cd79d938400 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:41.227057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6af6078d-302a-4318-b190-3cd79d938400 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 94bc6034-3861-4067-8f58-ff4151d8c37f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:41.242326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6af6078d-302a-4318-b190-3cd79d938400 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:41.242975 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6af6078d-302a-4318-b190-3cd79d938400 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:41.245477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6af6078d-302a-4318-b190-3cd79d938400 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:41.247275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6af6078d-302a-4318-b190-3cd79d938400 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:41.248406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6af6078d-302a-4318-b190-3cd79d938400 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:41.251212 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6af6078d-302a-4318-b190-3cd79d938400 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:41.343105 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dd9e8a04-76eb-4e7d-8066-78a56d947da9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.256001 Oct 05 02:40:41.352162 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1534/3049] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:40:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:40:41.358344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-724cb165-5011-446e-8ebb-b7a3c5711519 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:41.359396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-724cb165-5011-446e-8ebb-b7a3c5711519 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:41.368154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-724cb165-5011-446e-8ebb-b7a3c5711519 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:41.368957 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-724cb165-5011-446e-8ebb-b7a3c5711519 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:41.369553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-724cb165-5011-446e-8ebb-b7a3c5711519 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:41.370440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-724cb165-5011-446e-8ebb-b7a3c5711519 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:41.371106 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-724cb165-5011-446e-8ebb-b7a3c5711519 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:41.371852 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-724cb165-5011-446e-8ebb-b7a3c5711519 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:42.368629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6af6078d-302a-4318-b190-3cd79d938400 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:42.382530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-724cb165-5011-446e-8ebb-b7a3c5711519 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:42.391191 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-724cb165-5011-446e-8ebb-b7a3c5711519 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b" status: 200 len: 1316 microversion: 2.1 time: 1.037452 Oct 05 02:40:42.393704 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6af6078d-302a-4318-b190-3cd79d938400 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/94bc6034-3861-4067-8f58-ff4151d8c37f" status: 200 len: 1504 microversion: 2.1 time: 1.180202 Oct 05 02:40:42.394693 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1516/3050] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:41 2022] GET /compute/v2.1/servers/94bc6034-3861-4067-8f58-ff4151d8c37f => generated 1504 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:42.405812 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-eab31f4b-28b4-40d2-a2c1-9d0ce99dfa42 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:42.406437 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-eab31f4b-28b4-40d2-a2c1-9d0ce99dfa42 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:42.421520 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1535/3051] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:41 2022] GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b => generated 1316 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:42.424120 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:40:42.430063 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eab31f4b-28b4-40d2-a2c1-9d0ce99dfa42 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:42.432323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eab31f4b-28b4-40d2-a2c1-9d0ce99dfa42 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:42.433068 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eab31f4b-28b4-40d2-a2c1-9d0ce99dfa42 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:42.434012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eab31f4b-28b4-40d2-a2c1-9d0ce99dfa42 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:42.437220 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eab31f4b-28b4-40d2-a2c1-9d0ce99dfa42 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:42.439196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eab31f4b-28b4-40d2-a2c1-9d0ce99dfa42 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:42.440355 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-df13a574-441b-41bc-8890-05378851af98 req-9ab50261-8a5f-47ec-ae8a-7d825f90043b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29215d80-fdc9-408d-b885-e6f3a5f7da84", "name": "network-vif-unplugged", "status": "completed", "tag": "167e3597-f727-40a3-a743-6b1d1d8a0217"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:42.472536 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-df13a574-441b-41bc-8890-05378851af98 req-9ab50261-8a5f-47ec-ae8a-7d825f90043b service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:42.472536 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-df13a574-441b-41bc-8890-05378851af98 req-9ab50261-8a5f-47ec-ae8a-7d825f90043b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:42.472758 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-df13a574-441b-41bc-8890-05378851af98 req-9ab50261-8a5f-47ec-ae8a-7d825f90043b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:42.496093 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-df13a574-441b-41bc-8890-05378851af98 req-9ab50261-8a5f-47ec-ae8a-7d825f90043b service nova] Creating event network-vif-unplugged:167e3597-f727-40a3-a743-6b1d1d8a0217 for instance 29215d80-fdc9-408d-b885-e6f3a5f7da84 on n-h2-858272-3 Oct 05 02:40:42.505261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [req-df13a574-441b-41bc-8890-05378851af98 req-9ab50261-8a5f-47ec-ae8a-7d825f90043b service nova] Instance 29215d80-fdc9-408d-b885-e6f3a5f7da84 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 02:40:42.532924 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-df13a574-441b-41bc-8890-05378851af98 req-9ab50261-8a5f-47ec-ae8a-7d825f90043b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109739 Oct 05 02:40:42.533560 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1536/3052] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:42.539160 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6dad52cb-b332-42db-adbd-bae4a3e9f3b3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:42.539887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6dad52cb-b332-42db-adbd-bae4a3e9f3b3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:42.566575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6dad52cb-b332-42db-adbd-bae4a3e9f3b3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:42.568342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6dad52cb-b332-42db-adbd-bae4a3e9f3b3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:42.569419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6dad52cb-b332-42db-adbd-bae4a3e9f3b3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:42.570857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6dad52cb-b332-42db-adbd-bae4a3e9f3b3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:42.577686 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6dad52cb-b332-42db-adbd-bae4a3e9f3b3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:42.578429 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6dad52cb-b332-42db-adbd-bae4a3e9f3b3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:42.691433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-eab31f4b-28b4-40d2-a2c1-9d0ce99dfa42 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:42.706286 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-eab31f4b-28b4-40d2-a2c1-9d0ce99dfa42 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1222 microversion: 2.1 time: 0.309087 Oct 05 02:40:42.725301 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1517/3053] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:42 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1222 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:42.742584 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4781b7e3-cd1d-4e04-9e29-c08206c11fde tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:42.743957 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4781b7e3-cd1d-4e04-9e29-c08206c11fde tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: ac3c82a2-0553-4902-ba33-568525392af2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:42.763748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4781b7e3-cd1d-4e04-9e29-c08206c11fde tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:42.764260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4781b7e3-cd1d-4e04-9e29-c08206c11fde tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:42.764699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4781b7e3-cd1d-4e04-9e29-c08206c11fde tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:42.766868 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4781b7e3-cd1d-4e04-9e29-c08206c11fde tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:42.767386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4781b7e3-cd1d-4e04-9e29-c08206c11fde tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:42.767822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4781b7e3-cd1d-4e04-9e29-c08206c11fde tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:43.344523 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6dad52cb-b332-42db-adbd-bae4a3e9f3b3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:43.360694 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6dad52cb-b332-42db-adbd-bae4a3e9f3b3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1474 microversion: 2.1 time: 0.825748 Oct 05 02:40:43.364580 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1537/3054] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:42 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1474 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:43.452192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-833f99ce-e6e4-403b-bee1-8067dbf40827 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:43.457342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-833f99ce-e6e4-403b-bee1-8067dbf40827 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:43.477778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4781b7e3-cd1d-4e04-9e29-c08206c11fde tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:43.492400 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4781b7e3-cd1d-4e04-9e29-c08206c11fde tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/ac3c82a2-0553-4902-ba33-568525392af2" status: 200 len: 1504 microversion: 2.1 time: 0.764952 Oct 05 02:40:43.492965 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-833f99ce-e6e4-403b-bee1-8067dbf40827 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:43.504995 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1518/3055] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:42 2022] GET /compute/v2.1/servers/ac3c82a2-0553-4902-ba33-568525392af2 => generated 1504 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:43.505338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-833f99ce-e6e4-403b-bee1-8067dbf40827 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:43.505338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-833f99ce-e6e4-403b-bee1-8067dbf40827 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:43.505956 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-833f99ce-e6e4-403b-bee1-8067dbf40827 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:43.506978 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-833f99ce-e6e4-403b-bee1-8067dbf40827 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:43.518330 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-833f99ce-e6e4-403b-bee1-8067dbf40827 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:43.531423 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dfe06709-b908-4285-893a-37352202982c tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:43.532778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-dfe06709-b908-4285-893a-37352202982c tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: ac3c82a2-0553-4902-ba33-568525392af2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:43.545643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dfe06709-b908-4285-893a-37352202982c tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:43.548622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dfe06709-b908-4285-893a-37352202982c tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:43.549315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dfe06709-b908-4285-893a-37352202982c tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:43.550946 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dfe06709-b908-4285-893a-37352202982c tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:43.553144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dfe06709-b908-4285-893a-37352202982c tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:43.553975 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dfe06709-b908-4285-893a-37352202982c tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:43.603609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-dfe06709-b908-4285-893a-37352202982c tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: ac3c82a2-0553-4902-ba33-568525392af2] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:40:43.759632 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-dfe06709-b908-4285-893a-37352202982c tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ac3c82a2-0553-4902-ba33-568525392af2" status: 204 len: 0 microversion: 2.1 time: 0.232725 Oct 05 02:40:43.760232 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1519/3056] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:40:43 2022] DELETE /compute/v2.1/servers/ac3c82a2-0553-4902-ba33-568525392af2 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 02:40:43.785371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e2934f1a-8045-4617-82ca-56afc846b419 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:43.787874 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e2934f1a-8045-4617-82ca-56afc846b419 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:43.804651 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e2934f1a-8045-4617-82ca-56afc846b419 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:43.805844 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e2934f1a-8045-4617-82ca-56afc846b419 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:43.806932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e2934f1a-8045-4617-82ca-56afc846b419 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:43.808180 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e2934f1a-8045-4617-82ca-56afc846b419 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:43.811102 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e2934f1a-8045-4617-82ca-56afc846b419 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:43.811748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e2934f1a-8045-4617-82ca-56afc846b419 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:44.234206 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e2934f1a-8045-4617-82ca-56afc846b419 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:44.246387 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e2934f1a-8045-4617-82ca-56afc846b419 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1270 microversion: 2.1 time: 0.479893 Oct 05 02:40:44.246991 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1520/3057] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:43 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1270 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:44.252401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5d8dd3bd-0a22-4c41-a126-e027003b6a97 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:44.261847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5d8dd3bd-0a22-4c41-a126-e027003b6a97 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 94bc6034-3861-4067-8f58-ff4151d8c37f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:44.286746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d8dd3bd-0a22-4c41-a126-e027003b6a97 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:44.288043 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d8dd3bd-0a22-4c41-a126-e027003b6a97 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:44.288043 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d8dd3bd-0a22-4c41-a126-e027003b6a97 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:44.291756 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d8dd3bd-0a22-4c41-a126-e027003b6a97 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:44.292504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d8dd3bd-0a22-4c41-a126-e027003b6a97 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:44.293153 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d8dd3bd-0a22-4c41-a126-e027003b6a97 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:44.337326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5d8dd3bd-0a22-4c41-a126-e027003b6a97 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 94bc6034-3861-4067-8f58-ff4151d8c37f] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:40:44.392736 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:40:44.471588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-833f99ce-e6e4-403b-bee1-8067dbf40827 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:44.488818 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-833f99ce-e6e4-403b-bee1-8067dbf40827 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b" status: 200 len: 1316 microversion: 2.1 time: 1.049592 Oct 05 02:40:44.506139 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1538/3058] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:43 2022] GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b => generated 1316 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:40:44.512480 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5d8dd3bd-0a22-4c41-a126-e027003b6a97 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "DELETE /compute/v2.1/servers/94bc6034-3861-4067-8f58-ff4151d8c37f" status: 204 len: 0 microversion: 2.1 time: 0.263314 Oct 05 02:40:44.513500 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1521/3059] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:40:44 2022] DELETE /compute/v2.1/servers/94bc6034-3861-4067-8f58-ff4151d8c37f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:40:44.519265 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4f5b1671-de11-46a2-949f-fd136265c08c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:44.519895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4f5b1671-de11-46a2-949f-fd136265c08c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:44.528069 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5190d14d-1d43-487c-a502-1ece60e5789a tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:44.528771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5190d14d-1d43-487c-a502-1ece60e5789a tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: ac3c82a2-0553-4902-ba33-568525392af2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:44.537467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f5b1671-de11-46a2-949f-fd136265c08c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:44.537958 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f5b1671-de11-46a2-949f-fd136265c08c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:44.541055 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5190d14d-1d43-487c-a502-1ece60e5789a tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:44.541775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5190d14d-1d43-487c-a502-1ece60e5789a tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:44.542426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5190d14d-1d43-487c-a502-1ece60e5789a tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:44.543342 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5190d14d-1d43-487c-a502-1ece60e5789a tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:44.544728 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5190d14d-1d43-487c-a502-1ece60e5789a tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:44.544728 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5190d14d-1d43-487c-a502-1ece60e5789a tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:44.545736 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f5b1671-de11-46a2-949f-fd136265c08c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:44.546893 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f5b1671-de11-46a2-949f-fd136265c08c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:44.547747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f5b1671-de11-46a2-949f-fd136265c08c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:44.549411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f5b1671-de11-46a2-949f-fd136265c08c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:45.217308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5190d14d-1d43-487c-a502-1ece60e5789a tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:45.233760 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5190d14d-1d43-487c-a502-1ece60e5789a tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/ac3c82a2-0553-4902-ba33-568525392af2" status: 200 len: 1510 microversion: 2.1 time: 0.708121 Oct 05 02:40:45.236673 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1522/3060] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:44 2022] GET /compute/v2.1/servers/ac3c82a2-0553-4902-ba33-568525392af2 => generated 1510 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:45.245399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-aaa02844-707b-433e-be31-3ac167c0f4a3 req-90ee6fe5-6b1d-43df-918d-991b5474491a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29215d80-fdc9-408d-b885-e6f3a5f7da84", "tag": "167e3597-f727-40a3-a743-6b1d1d8a0217"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:45.252972 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4f5b1671-de11-46a2-949f-fd136265c08c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:45.265881 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4f5b1671-de11-46a2-949f-fd136265c08c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1474 microversion: 2.1 time: 0.757728 Oct 05 02:40:45.267378 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1539/3061] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:44 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1474 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:45.278938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-aaa02844-707b-433e-be31-3ac167c0f4a3 req-90ee6fe5-6b1d-43df-918d-991b5474491a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:45.280600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-aaa02844-707b-433e-be31-3ac167c0f4a3 req-90ee6fe5-6b1d-43df-918d-991b5474491a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:45.282762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-aaa02844-707b-433e-be31-3ac167c0f4a3 req-90ee6fe5-6b1d-43df-918d-991b5474491a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:45.285329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-95c9c0f0-c06f-4759-a251-889dcd585adf tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:45.287090 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-95c9c0f0-c06f-4759-a251-889dcd585adf tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:45.299375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-95c9c0f0-c06f-4759-a251-889dcd585adf tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:45.300230 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-aaa02844-707b-433e-be31-3ac167c0f4a3 req-90ee6fe5-6b1d-43df-918d-991b5474491a service nova] Creating event network-changed:167e3597-f727-40a3-a743-6b1d1d8a0217 for instance 29215d80-fdc9-408d-b885-e6f3a5f7da84 on n-h2-858272-3 Oct 05 02:40:45.300802 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-95c9c0f0-c06f-4759-a251-889dcd585adf tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:45.302004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-95c9c0f0-c06f-4759-a251-889dcd585adf tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:45.308079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-95c9c0f0-c06f-4759-a251-889dcd585adf tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:45.308711 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-95c9c0f0-c06f-4759-a251-889dcd585adf tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:45.309166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [req-aaa02844-707b-433e-be31-3ac167c0f4a3 req-90ee6fe5-6b1d-43df-918d-991b5474491a service nova] Instance 29215d80-fdc9-408d-b885-e6f3a5f7da84 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122319) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 02:40:45.309375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-95c9c0f0-c06f-4759-a251-889dcd585adf tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:45.324588 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-aaa02844-707b-433e-be31-3ac167c0f4a3 req-90ee6fe5-6b1d-43df-918d-991b5474491a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086034 Oct 05 02:40:45.325367 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1523/3062] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:45.418867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-95c9c0f0-c06f-4759-a251-889dcd585adf tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:45.436437 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-95c9c0f0-c06f-4759-a251-889dcd585adf tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1276 microversion: 2.1 time: 0.166197 Oct 05 02:40:45.437654 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1540/3063] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:45 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1276 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:40:45.517630 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ce74aedc-7bcb-4f16-8046-10ea006c6187 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:45.518985 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ce74aedc-7bcb-4f16-8046-10ea006c6187 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:45.540082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce74aedc-7bcb-4f16-8046-10ea006c6187 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:45.540588 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce74aedc-7bcb-4f16-8046-10ea006c6187 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:45.545006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce74aedc-7bcb-4f16-8046-10ea006c6187 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:45.547709 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce74aedc-7bcb-4f16-8046-10ea006c6187 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:45.548227 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce74aedc-7bcb-4f16-8046-10ea006c6187 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:45.554635 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce74aedc-7bcb-4f16-8046-10ea006c6187 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:46.262701 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-44040214-75a9-4ed5-ae12-3bc22c67971e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:46.264140 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-44040214-75a9-4ed5-ae12-3bc22c67971e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: ac3c82a2-0553-4902-ba33-568525392af2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:46.276049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44040214-75a9-4ed5-ae12-3bc22c67971e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:46.277167 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44040214-75a9-4ed5-ae12-3bc22c67971e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:46.283911 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44040214-75a9-4ed5-ae12-3bc22c67971e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:46.285505 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44040214-75a9-4ed5-ae12-3bc22c67971e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:46.287243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44040214-75a9-4ed5-ae12-3bc22c67971e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:46.289985 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44040214-75a9-4ed5-ae12-3bc22c67971e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:46.328269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ce74aedc-7bcb-4f16-8046-10ea006c6187 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:46.348334 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ce74aedc-7bcb-4f16-8046-10ea006c6187 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b" status: 200 len: 1466 microversion: 2.1 time: 0.836320 Oct 05 02:40:46.356256 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1524/3064] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:45 2022] GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b => generated 1466 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:46.374963 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-75b9a5a1-cd2c-4492-a33c-7d65ce51d847 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:46.388776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-75b9a5a1-cd2c-4492-a33c-7d65ce51d847 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:46.407681 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75b9a5a1-cd2c-4492-a33c-7d65ce51d847 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:46.408582 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75b9a5a1-cd2c-4492-a33c-7d65ce51d847 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:46.409365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75b9a5a1-cd2c-4492-a33c-7d65ce51d847 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:46.410273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75b9a5a1-cd2c-4492-a33c-7d65ce51d847 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:46.412003 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75b9a5a1-cd2c-4492-a33c-7d65ce51d847 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:46.412626 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75b9a5a1-cd2c-4492-a33c-7d65ce51d847 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:47.392895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-44040214-75a9-4ed5-ae12-3bc22c67971e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:47.445038 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-44040214-75a9-4ed5-ae12-3bc22c67971e tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/ac3c82a2-0553-4902-ba33-568525392af2" status: 200 len: 1510 microversion: 2.1 time: 1.186778 Oct 05 02:40:47.446251 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1541/3065] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:46 2022] GET /compute/v2.1/servers/ac3c82a2-0553-4902-ba33-568525392af2 => generated 1510 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:40:47.456427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6c18cee8-5a6f-49fd-a410-cf0dc14f43b8 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:47.461373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-75b9a5a1-cd2c-4492-a33c-7d65ce51d847 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:47.469742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6c18cee8-5a6f-49fd-a410-cf0dc14f43b8 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] [instance: 35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:47.483299 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-75b9a5a1-cd2c-4492-a33c-7d65ce51d847 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1474 microversion: 2.1 time: 1.122322 Oct 05 02:40:47.495310 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1525/3066] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:46 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1474 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:47.502193 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c18cee8-5a6f-49fd-a410-cf0dc14f43b8 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:47.506146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c18cee8-5a6f-49fd-a410-cf0dc14f43b8 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:47.507987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-70733b38-5c8b-44b4-a88e-00f04df8d6f4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:47.508648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c18cee8-5a6f-49fd-a410-cf0dc14f43b8 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:47.509792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-70733b38-5c8b-44b4-a88e-00f04df8d6f4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:47.511293 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c18cee8-5a6f-49fd-a410-cf0dc14f43b8 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:47.513088 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c18cee8-5a6f-49fd-a410-cf0dc14f43b8 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:47.516306 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c18cee8-5a6f-49fd-a410-cf0dc14f43b8 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:47.534016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-70733b38-5c8b-44b4-a88e-00f04df8d6f4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:47.537257 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-70733b38-5c8b-44b4-a88e-00f04df8d6f4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:47.538719 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-70733b38-5c8b-44b4-a88e-00f04df8d6f4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:47.543985 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-70733b38-5c8b-44b4-a88e-00f04df8d6f4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:47.544770 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-70733b38-5c8b-44b4-a88e-00f04df8d6f4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:47.552278 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-70733b38-5c8b-44b4-a88e-00f04df8d6f4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:47.867127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-70733b38-5c8b-44b4-a88e-00f04df8d6f4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:47.880353 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-70733b38-5c8b-44b4-a88e-00f04df8d6f4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1276 microversion: 2.1 time: 0.383179 Oct 05 02:40:47.880978 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1526/3067] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:47 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1276 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:48.316342 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-d18ea8c1-446d-40f9-97df-c2c9057b1905 req-bd3afbdb-4e51-46bf-bdac-2520c3ce816e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac3c82a2-0553-4902-ba33-568525392af2", "name": "network-vif-deleted", "tag": "8a6f06f5-5996-445c-a262-e2d180ad3ca7"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:48.350943 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d18ea8c1-446d-40f9-97df-c2c9057b1905 req-bd3afbdb-4e51-46bf-bdac-2520c3ce816e service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:48.351847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d18ea8c1-446d-40f9-97df-c2c9057b1905 req-bd3afbdb-4e51-46bf-bdac-2520c3ce816e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:48.352488 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d18ea8c1-446d-40f9-97df-c2c9057b1905 req-bd3afbdb-4e51-46bf-bdac-2520c3ce816e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:48.379182 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-d18ea8c1-446d-40f9-97df-c2c9057b1905 req-bd3afbdb-4e51-46bf-bdac-2520c3ce816e service nova] Creating event network-vif-deleted:8a6f06f5-5996-445c-a262-e2d180ad3ca7 for instance ac3c82a2-0553-4902-ba33-568525392af2 on n-h2-858272-3 Oct 05 02:40:48.390215 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-d18ea8c1-446d-40f9-97df-c2c9057b1905 req-bd3afbdb-4e51-46bf-bdac-2520c3ce816e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076206 Oct 05 02:40:48.392612 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1527/3068] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:40:48.471446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-35358a22-60c7-46ad-8414-b13d59e9f803 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:48.472189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-35358a22-60c7-46ad-8414-b13d59e9f803 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: ac3c82a2-0553-4902-ba33-568525392af2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:48.488092 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35358a22-60c7-46ad-8414-b13d59e9f803 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:48.491569 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35358a22-60c7-46ad-8414-b13d59e9f803 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:48.492279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35358a22-60c7-46ad-8414-b13d59e9f803 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:48.493850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35358a22-60c7-46ad-8414-b13d59e9f803 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:48.495501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35358a22-60c7-46ad-8414-b13d59e9f803 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:48.497637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35358a22-60c7-46ad-8414-b13d59e9f803 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:48.553361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35358a22-60c7-46ad-8414-b13d59e9f803 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:48.554162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35358a22-60c7-46ad-8414-b13d59e9f803 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:48.554986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35358a22-60c7-46ad-8414-b13d59e9f803 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:48.555827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-35358a22-60c7-46ad-8414-b13d59e9f803 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lazy-loading 'fault' on Instance uuid ac3c82a2-0553-4902-ba33-568525392af2 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:40:48.602019 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6c18cee8-5a6f-49fd-a410-cf0dc14f43b8 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b" status: 200 len: 1617 microversion: 2.1 time: 1.154273 Oct 05 02:40:48.602620 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1542/3069] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:47 2022] GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b => generated 1617 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:48.614622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3767b1bb-8b27-438d-bf1c-de64789caae8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:48.619652 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3767b1bb-8b27-438d-bf1c-de64789caae8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:48.633729 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3767b1bb-8b27-438d-bf1c-de64789caae8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:48.634283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3767b1bb-8b27-438d-bf1c-de64789caae8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:48.636152 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3767b1bb-8b27-438d-bf1c-de64789caae8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:48.636753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3767b1bb-8b27-438d-bf1c-de64789caae8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:48.640584 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3767b1bb-8b27-438d-bf1c-de64789caae8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:48.641200 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3767b1bb-8b27-438d-bf1c-de64789caae8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:48.755224 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-35358a22-60c7-46ad-8414-b13d59e9f803 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:48.767536 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-35358a22-60c7-46ad-8414-b13d59e9f803 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/ac3c82a2-0553-4902-ba33-568525392af2" status: 200 len: 1306 microversion: 2.1 time: 0.300935 Oct 05 02:40:48.768141 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1528/3070] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:48 2022] GET /compute/v2.1/servers/ac3c82a2-0553-4902-ba33-568525392af2 => generated 1306 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:40:48.821442 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-aa502cfb-5e53-4adb-aa37-e0aca43e2087 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1420662127", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "6b01f092-c99b-4a47-bdcb-3b6bcdeb0323"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:48.914062 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-aa502cfb-5e53-4adb-aa37-e0aca43e2087 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] validate_networks() for None {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:40:49.819658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-aa502cfb-5e53-4adb-aa37-e0aca43e2087 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:40:49.820788 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-aa502cfb-5e53-4adb-aa37-e0aca43e2087 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:40:49.828433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-aa502cfb-5e53-4adb-aa37-e0aca43e2087 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:40:49.829215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-aa502cfb-5e53-4adb-aa37-e0aca43e2087 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:40:49.829802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-aa502cfb-5e53-4adb-aa37-e0aca43e2087 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:40:49.853420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa502cfb-5e53-4adb-aa37-e0aca43e2087 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:49.855073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa502cfb-5e53-4adb-aa37-e0aca43e2087 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:49.856810 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa502cfb-5e53-4adb-aa37-e0aca43e2087 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:49.860395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa502cfb-5e53-4adb-aa37-e0aca43e2087 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:49.862716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa502cfb-5e53-4adb-aa37-e0aca43e2087 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:49.864797 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa502cfb-5e53-4adb-aa37-e0aca43e2087 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:49.869895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3767b1bb-8b27-438d-bf1c-de64789caae8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:49.883145 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3767b1bb-8b27-438d-bf1c-de64789caae8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1472 microversion: 2.1 time: 1.273234 Oct 05 02:40:49.883921 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1543/3071] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:48 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1472 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:49.897247 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-02c3617b-4d35-4ed4-8dc9-69864e7d901a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:49.898927 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-02c3617b-4d35-4ed4-8dc9-69864e7d901a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:49.924435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02c3617b-4d35-4ed4-8dc9-69864e7d901a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:49.924972 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02c3617b-4d35-4ed4-8dc9-69864e7d901a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:49.925420 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02c3617b-4d35-4ed4-8dc9-69864e7d901a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:49.926960 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02c3617b-4d35-4ed4-8dc9-69864e7d901a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:49.927329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02c3617b-4d35-4ed4-8dc9-69864e7d901a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:49.927902 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02c3617b-4d35-4ed4-8dc9-69864e7d901a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:49.932344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-aa502cfb-5e53-4adb-aa37-e0aca43e2087 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:40:49.942382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-aa502cfb-5e53-4adb-aa37-e0aca43e2087 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Getting quotas for user b86e3b7d1c9a4b2c8f2914beefa74cc1 and project f5a44c2cd99949c2a30ab83bdede01e6. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:40:49.981578 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-aa502cfb-5e53-4adb-aa37-e0aca43e2087 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:40:49.985037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-aa502cfb-5e53-4adb-aa37-e0aca43e2087 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 95b81895-54ff-41fe-a3db-1343ad91dec9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:40:50.106284 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-aa502cfb-5e53-4adb-aa37-e0aca43e2087 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.289831 Oct 05 02:40:50.108585 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1529/3072] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:40:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1293 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:40:50.143106 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c84a2c63-f1c3-4aac-a1af-91af3380d8e4 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:50.149686 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c84a2c63-f1c3-4aac-a1af-91af3380d8e4 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: ac3c82a2-0553-4902-ba33-568525392af2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:50.175789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c84a2c63-f1c3-4aac-a1af-91af3380d8e4 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:50.177102 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c84a2c63-f1c3-4aac-a1af-91af3380d8e4 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:50.177570 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c84a2c63-f1c3-4aac-a1af-91af3380d8e4 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:50.178330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c84a2c63-f1c3-4aac-a1af-91af3380d8e4 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:50.178792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c84a2c63-f1c3-4aac-a1af-91af3380d8e4 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:50.179222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c84a2c63-f1c3-4aac-a1af-91af3380d8e4 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:50.238239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c84a2c63-f1c3-4aac-a1af-91af3380d8e4 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:50.239286 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c84a2c63-f1c3-4aac-a1af-91af3380d8e4 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:50.239742 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c84a2c63-f1c3-4aac-a1af-91af3380d8e4 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:50.240217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-c84a2c63-f1c3-4aac-a1af-91af3380d8e4 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lazy-loading 'fault' on Instance uuid ac3c82a2-0553-4902-ba33-568525392af2 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:40:50.336584 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-02c3617b-4d35-4ed4-8dc9-69864e7d901a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:50.346292 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-02c3617b-4d35-4ed4-8dc9-69864e7d901a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1318 microversion: 2.1 time: 0.460435 Oct 05 02:40:50.347099 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1544/3073] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:49 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1318 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:50.353333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-9a019d38-9ce9-45ba-94fc-79adb3c076aa req-5a3bf071-27f9-4701-bc03-e3dbc5dbff9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94bc6034-3861-4067-8f58-ff4151d8c37f", "name": "network-vif-deleted", "tag": "b393c68b-ce91-4c9f-adf2-b41a81283718"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:50.366582 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-9a019d38-9ce9-45ba-94fc-79adb3c076aa req-5a3bf071-27f9-4701-bc03-e3dbc5dbff9c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:50.367264 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-9a019d38-9ce9-45ba-94fc-79adb3c076aa req-5a3bf071-27f9-4701-bc03-e3dbc5dbff9c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:50.367888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-9a019d38-9ce9-45ba-94fc-79adb3c076aa req-5a3bf071-27f9-4701-bc03-e3dbc5dbff9c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:50.385970 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-9a019d38-9ce9-45ba-94fc-79adb3c076aa req-5a3bf071-27f9-4701-bc03-e3dbc5dbff9c service nova] Creating event network-vif-deleted:b393c68b-ce91-4c9f-adf2-b41a81283718 for instance 94bc6034-3861-4067-8f58-ff4151d8c37f on n-h1-858272-3 Oct 05 02:40:50.389966 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c84a2c63-f1c3-4aac-a1af-91af3380d8e4 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:50.392413 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-9a019d38-9ce9-45ba-94fc-79adb3c076aa req-5a3bf071-27f9-4701-bc03-e3dbc5dbff9c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043797 Oct 05 02:40:50.393243 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1545/3074] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:50.409556 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c84a2c63-f1c3-4aac-a1af-91af3380d8e4 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/ac3c82a2-0553-4902-ba33-568525392af2" status: 200 len: 1306 microversion: 2.1 time: 0.296017 Oct 05 02:40:50.411406 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1530/3075] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:50 2022] GET /compute/v2.1/servers/ac3c82a2-0553-4902-ba33-568525392af2 => generated 1306 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:50.434258 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fbe8b2eb-b3ff-4bc6-9f71-36fab4b2fe43 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:50.440449 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fbe8b2eb-b3ff-4bc6-9f71-36fab4b2fe43 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 95b81895-54ff-41fe-a3db-1343ad91dec9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:50.586507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fbe8b2eb-b3ff-4bc6-9f71-36fab4b2fe43 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:50.603914 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fbe8b2eb-b3ff-4bc6-9f71-36fab4b2fe43 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9" status: 200 len: 1217 microversion: 2.1 time: 0.206697 Oct 05 02:40:50.608744 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1546/3076] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:50 2022] GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9 => generated 1217 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:50.907459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fcb5083d-9540-442b-a273-1f74261b7506 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:50.908057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fcb5083d-9540-442b-a273-1f74261b7506 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:50.921277 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fcb5083d-9540-442b-a273-1f74261b7506 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:50.922044 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fcb5083d-9540-442b-a273-1f74261b7506 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:50.922681 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fcb5083d-9540-442b-a273-1f74261b7506 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:50.923616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fcb5083d-9540-442b-a273-1f74261b7506 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:50.924297 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fcb5083d-9540-442b-a273-1f74261b7506 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:50.924934 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fcb5083d-9540-442b-a273-1f74261b7506 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:51.374068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-06211ab1-b074-41f4-9e10-4ab3d3dd7136 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:51.375684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-06211ab1-b074-41f4-9e10-4ab3d3dd7136 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:51.389204 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:40:51.392076 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-06211ab1-b074-41f4-9e10-4ab3d3dd7136 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:51.392573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-06211ab1-b074-41f4-9e10-4ab3d3dd7136 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:51.393375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-06211ab1-b074-41f4-9e10-4ab3d3dd7136 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:51.394087 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-06211ab1-b074-41f4-9e10-4ab3d3dd7136 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:51.398393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-06211ab1-b074-41f4-9e10-4ab3d3dd7136 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:51.398976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-06211ab1-b074-41f4-9e10-4ab3d3dd7136 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:51.534894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fcb5083d-9540-442b-a273-1f74261b7506 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:51.551403 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fcb5083d-9540-442b-a273-1f74261b7506 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1472 microversion: 2.1 time: 0.647609 Oct 05 02:40:51.552828 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1531/3077] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:50 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1472 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:51.563653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-34355cb1-fab7-4061-8182-94317be9c00a tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:51.566271 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-34355cb1-fab7-4061-8182-94317be9c00a tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: ac3c82a2-0553-4902-ba33-568525392af2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:51.592987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-34355cb1-fab7-4061-8182-94317be9c00a tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:51.594386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-34355cb1-fab7-4061-8182-94317be9c00a tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:51.595062 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-34355cb1-fab7-4061-8182-94317be9c00a tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:51.596269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-34355cb1-fab7-4061-8182-94317be9c00a tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:51.597015 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-34355cb1-fab7-4061-8182-94317be9c00a tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:51.597894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-34355cb1-fab7-4061-8182-94317be9c00a tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:51.664301 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-34355cb1-fab7-4061-8182-94317be9c00a tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:51.665209 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-34355cb1-fab7-4061-8182-94317be9c00a tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:51.666065 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-34355cb1-fab7-4061-8182-94317be9c00a tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:51.666878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-34355cb1-fab7-4061-8182-94317be9c00a tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lazy-loading 'fault' on Instance uuid ac3c82a2-0553-4902-ba33-568525392af2 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:40:51.857067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-34355cb1-fab7-4061-8182-94317be9c00a tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe30121065f4906b43c3c48888d88a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9160b32c651a43f784bbe95a0e49059c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:51.869947 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-34355cb1-fab7-4061-8182-94317be9c00a tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/ac3c82a2-0553-4902-ba33-568525392af2" status: 200 len: 1306 microversion: 2.1 time: 0.315782 Oct 05 02:40:51.870538 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1532/3078] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:51 2022] GET /compute/v2.1/servers/ac3c82a2-0553-4902-ba33-568525392af2 => generated 1306 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:51.875232 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-940518d7-3279-4a3d-a18f-b0303ddb1937 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:51.881470 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-940518d7-3279-4a3d-a18f-b0303ddb1937 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 95b81895-54ff-41fe-a3db-1343ad91dec9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:51.889491 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-940518d7-3279-4a3d-a18f-b0303ddb1937 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:51.890019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-940518d7-3279-4a3d-a18f-b0303ddb1937 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:51.890462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-940518d7-3279-4a3d-a18f-b0303ddb1937 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:51.891360 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-940518d7-3279-4a3d-a18f-b0303ddb1937 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:51.891995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-940518d7-3279-4a3d-a18f-b0303ddb1937 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:51.892590 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-940518d7-3279-4a3d-a18f-b0303ddb1937 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:52.398251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-940518d7-3279-4a3d-a18f-b0303ddb1937 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:52.414306 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-940518d7-3279-4a3d-a18f-b0303ddb1937 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9" status: 200 len: 1269 microversion: 2.1 time: 0.542446 Oct 05 02:40:52.415572 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1533/3079] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:51 2022] GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9 => generated 1269 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:52.421832 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-380bd805-462e-4c33-99c5-d92149a3ffea req-6039216c-b9b0-468b-bad4-ea99ad0c957e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d6e3897-5115-4283-804d-abaa483786fc", "tag": "4aff4e1f-3112-4ceb-b24d-2327b404029f"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:52.436344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-380bd805-462e-4c33-99c5-d92149a3ffea req-6039216c-b9b0-468b-bad4-ea99ad0c957e service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:52.437001 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-380bd805-462e-4c33-99c5-d92149a3ffea req-6039216c-b9b0-468b-bad4-ea99ad0c957e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:52.437607 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-380bd805-462e-4c33-99c5-d92149a3ffea req-6039216c-b9b0-468b-bad4-ea99ad0c957e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:52.467987 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-380bd805-462e-4c33-99c5-d92149a3ffea req-6039216c-b9b0-468b-bad4-ea99ad0c957e service nova] Creating event network-changed:4aff4e1f-3112-4ceb-b24d-2327b404029f for instance 0d6e3897-5115-4283-804d-abaa483786fc on n-h1-858272-3 Oct 05 02:40:52.478996 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-380bd805-462e-4c33-99c5-d92149a3ffea req-6039216c-b9b0-468b-bad4-ea99ad0c957e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061669 Oct 05 02:40:52.485671 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1534/3080] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:52.554460 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-06211ab1-b074-41f4-9e10-4ab3d3dd7136 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:52.565762 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-06211ab1-b074-41f4-9e10-4ab3d3dd7136 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1318 microversion: 2.1 time: 1.195382 Oct 05 02:40:52.567984 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1547/3081] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:51 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1318 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:40:52.577331 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-039f7f4e-65d6-4660-8134-bfd73ba2637b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:52.578040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-039f7f4e-65d6-4660-8134-bfd73ba2637b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:52.590859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-039f7f4e-65d6-4660-8134-bfd73ba2637b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:52.593805 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-039f7f4e-65d6-4660-8134-bfd73ba2637b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:52.594316 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-039f7f4e-65d6-4660-8134-bfd73ba2637b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:52.595239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-039f7f4e-65d6-4660-8134-bfd73ba2637b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:52.595755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-039f7f4e-65d6-4660-8134-bfd73ba2637b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:52.596266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-039f7f4e-65d6-4660-8134-bfd73ba2637b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:52.896291 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-20426f95-91c5-4150-b88a-47117e0cb438 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:52.896991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-20426f95-91c5-4150-b88a-47117e0cb438 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: ac3c82a2-0553-4902-ba33-568525392af2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:52.899739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:40:52.910098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-20426f95-91c5-4150-b88a-47117e0cb438 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:52.911826 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-20426f95-91c5-4150-b88a-47117e0cb438 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:52.912269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-20426f95-91c5-4150-b88a-47117e0cb438 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:52.913015 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-20426f95-91c5-4150-b88a-47117e0cb438 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:52.913472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-20426f95-91c5-4150-b88a-47117e0cb438 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:52.913900 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-20426f95-91c5-4150-b88a-47117e0cb438 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:52.945452 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-20426f95-91c5-4150-b88a-47117e0cb438 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] HTTP exception thrown: Instance ac3c82a2-0553-4902-ba33-568525392af2 could not be found. Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-20426f95-91c5-4150-b88a-47117e0cb438 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Request method failure captured: Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/ac3c82a2-0553-4902-ba33-568525392af2 HTTP/1.1 Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO5n5F4gONqL78UoC1ZQEdk1K0WAV1VZobXXtxTi52e3zvsPefR255AJg4IOy8zMSE_ayxesKR4TMrJ3FvNDq8sHlHYEUUZBunYMGo5WajwapxEmGpeORsFgRvxrOb_zVc00ZPk-FCrVna3m4170390bmn27rK2SYT7y-X6Z_S5EPjk Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 9160b32c651a43f784bbe95a0e49059c Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-MultipleCreateTestJSON-690706459 Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9160b32c651a43f784bbe95a0e49059c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9160b32c651a43f784bbe95a0e49059c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9160b32c651a43f784bbe95a0e49059c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9160b32c651a43f784bbe95a0e49059c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-MultipleCreateTestJSON-690706459 Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 9160b32c651a43f784bbe95a0e49059c Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-MultipleCreateTestJSON-690706459 Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-MultipleCreateTestJSON-690706459-project Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: dbe30121065f4906b43c3c48888d88a8 Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-MultipleCreateTestJSON-690706459-project Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance ac3c82a2-0553-4902-ba33-568525392af2 could not be found. Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'ac3c82a2-0553-4902-ba33-568525392af2'} Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac3c82a2-0553-4902-ba33-568525392af2 could not be found. Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac3c82a2-0553-4902-ba33-568525392af2 could not be found. Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:40:52.957102 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:40:52.962775 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:40:52.962775 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:40:52.962775 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:40:52.962775 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:40:52.962775 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:40:52.962775 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac3c82a2-0553-4902-ba33-568525392af2 could not be found. Oct 05 02:40:52.962775 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:40:52.962775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-20426f95-91c5-4150-b88a-47117e0cb438 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Returning 404 to user: Instance ac3c82a2-0553-4902-ba33-568525392af2 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:40:52.963335 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-20426f95-91c5-4150-b88a-47117e0cb438 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/ac3c82a2-0553-4902-ba33-568525392af2" status: 404 len: 111 microversion: 2.1 time: 0.071139 Oct 05 02:40:52.963456 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1548/3082] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:52 2022] GET /compute/v2.1/servers/ac3c82a2-0553-4902-ba33-568525392af2 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:40:52.973333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b4040ef0-2db1-49bc-aa2d-f5cd18458eb2 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:52.977748 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b4040ef0-2db1-49bc-aa2d-f5cd18458eb2 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] [instance: 94bc6034-3861-4067-8f58-ff4151d8c37f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:52.992892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4040ef0-2db1-49bc-aa2d-f5cd18458eb2 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:52.993412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4040ef0-2db1-49bc-aa2d-f5cd18458eb2 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:52.993847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4040ef0-2db1-49bc-aa2d-f5cd18458eb2 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:52.994567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4040ef0-2db1-49bc-aa2d-f5cd18458eb2 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:52.995017 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4040ef0-2db1-49bc-aa2d-f5cd18458eb2 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:52.995445 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4040ef0-2db1-49bc-aa2d-f5cd18458eb2 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:53.027119 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-b4040ef0-2db1-49bc-aa2d-f5cd18458eb2 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] HTTP exception thrown: Instance 94bc6034-3861-4067-8f58-ff4151d8c37f could not be found. Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b4040ef0-2db1-49bc-aa2d-f5cd18458eb2 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Request method failure captured: Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/94bc6034-3861-4067-8f58-ff4151d8c37f HTTP/1.1 Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO5n5F4gONqL78UoC1ZQEdk1K0WAV1VZobXXtxTi52e3zvsPefR255AJg4IOy8zMSE_ayxesKR4TMrJ3FvNDq8sHlHYEUUZBunYMGo5WajwapxEmGpeORsFgRvxrOb_zVc00ZPk-FCrVna3m4170390bmn27rK2SYT7y-X6Z_S5EPjk Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 9160b32c651a43f784bbe95a0e49059c Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-MultipleCreateTestJSON-690706459 Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9160b32c651a43f784bbe95a0e49059c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9160b32c651a43f784bbe95a0e49059c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9160b32c651a43f784bbe95a0e49059c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9160b32c651a43f784bbe95a0e49059c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-MultipleCreateTestJSON-690706459 Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 9160b32c651a43f784bbe95a0e49059c Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-MultipleCreateTestJSON-690706459 Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-MultipleCreateTestJSON-690706459-project Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: dbe30121065f4906b43c3c48888d88a8 Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-MultipleCreateTestJSON-690706459-project Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 94bc6034-3861-4067-8f58-ff4151d8c37f could not be found. Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '94bc6034-3861-4067-8f58-ff4151d8c37f'} Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94bc6034-3861-4067-8f58-ff4151d8c37f could not be found. Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94bc6034-3861-4067-8f58-ff4151d8c37f could not be found. Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:40:53.029669 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:40:53.035955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:40:53.035955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:40:53.035955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:40:53.035955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:40:53.035955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:40:53.035955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94bc6034-3861-4067-8f58-ff4151d8c37f could not be found. Oct 05 02:40:53.035955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:40:53.035955 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b4040ef0-2db1-49bc-aa2d-f5cd18458eb2 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] Returning 404 to user: Instance 94bc6034-3861-4067-8f58-ff4151d8c37f could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:40:53.035955 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b4040ef0-2db1-49bc-aa2d-f5cd18458eb2 tempest-MultipleCreateTestJSON-690706459 tempest-MultipleCreateTestJSON-690706459-project] 10.222.0.16 "GET /compute/v2.1/servers/94bc6034-3861-4067-8f58-ff4151d8c37f" status: 404 len: 111 microversion: 2.1 time: 0.063900 Oct 05 02:40:53.035955 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1549/3083] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:52 2022] GET /compute/v2.1/servers/94bc6034-3861-4067-8f58-ff4151d8c37f => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:40:53.124294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-039f7f4e-65d6-4660-8134-bfd73ba2637b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:53.138987 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-039f7f4e-65d6-4660-8134-bfd73ba2637b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1469 microversion: 2.1 time: 0.566478 Oct 05 02:40:53.139815 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1535/3084] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:52 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1469 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:53.187044 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0169d026-1250-4140-ad1f-dbc5e6d2fe70 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:53.190189 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0169d026-1250-4140-ad1f-dbc5e6d2fe70 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:53.208254 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0169d026-1250-4140-ad1f-dbc5e6d2fe70 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:53.208758 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0169d026-1250-4140-ad1f-dbc5e6d2fe70 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:53.214781 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0169d026-1250-4140-ad1f-dbc5e6d2fe70 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:53.215628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0169d026-1250-4140-ad1f-dbc5e6d2fe70 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:53.218815 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0169d026-1250-4140-ad1f-dbc5e6d2fe70 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:53.219330 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0169d026-1250-4140-ad1f-dbc5e6d2fe70 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:53.283430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:40:53.305395 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0169d026-1250-4140-ad1f-dbc5e6d2fe70 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "POST /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84/action" status: 204 len: 0 microversion: 2.1 time: 0.140884 Oct 05 02:40:53.317429 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-86b4e7b9-8b5c-4c3e-af9f-36a9c0fe7f60 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:53.318256 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-86b4e7b9-8b5c-4c3e-af9f-36a9c0fe7f60 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:53.322082 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1550/3085] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:40:53 2022] POST /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84/action => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:40:53.329774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86b4e7b9-8b5c-4c3e-af9f-36a9c0fe7f60 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:53.330207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86b4e7b9-8b5c-4c3e-af9f-36a9c0fe7f60 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:53.330650 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86b4e7b9-8b5c-4c3e-af9f-36a9c0fe7f60 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:53.331358 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86b4e7b9-8b5c-4c3e-af9f-36a9c0fe7f60 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:53.331814 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86b4e7b9-8b5c-4c3e-af9f-36a9c0fe7f60 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:53.332237 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86b4e7b9-8b5c-4c3e-af9f-36a9c0fe7f60 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:53.440535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f98e8dfb-9773-47f4-89ee-f9015e736bd0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:53.441274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f98e8dfb-9773-47f4-89ee-f9015e736bd0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 95b81895-54ff-41fe-a3db-1343ad91dec9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:53.454639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f98e8dfb-9773-47f4-89ee-f9015e736bd0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:53.455124 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f98e8dfb-9773-47f4-89ee-f9015e736bd0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:53.459301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f98e8dfb-9773-47f4-89ee-f9015e736bd0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:53.460288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f98e8dfb-9773-47f4-89ee-f9015e736bd0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:53.461495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f98e8dfb-9773-47f4-89ee-f9015e736bd0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:53.462698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f98e8dfb-9773-47f4-89ee-f9015e736bd0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:53.765245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f98e8dfb-9773-47f4-89ee-f9015e736bd0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:53.778322 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f98e8dfb-9773-47f4-89ee-f9015e736bd0 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9" status: 200 len: 1275 microversion: 2.1 time: 0.342040 Oct 05 02:40:53.796863 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1551/3086] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:53 2022] GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9 => generated 1275 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:53.804521 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-135e2996-a43b-4ace-bf10-11392016f56b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:53.805178 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-135e2996-a43b-4ace-bf10-11392016f56b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:53.818965 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-135e2996-a43b-4ace-bf10-11392016f56b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:53.820594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-135e2996-a43b-4ace-bf10-11392016f56b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:53.821462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-135e2996-a43b-4ace-bf10-11392016f56b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:53.826103 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-135e2996-a43b-4ace-bf10-11392016f56b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:53.830281 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-135e2996-a43b-4ace-bf10-11392016f56b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:53.831082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-135e2996-a43b-4ace-bf10-11392016f56b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:54.338311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-86b4e7b9-8b5c-4c3e-af9f-36a9c0fe7f60 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:54.373838 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-86b4e7b9-8b5c-4c3e-af9f-36a9c0fe7f60 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1469 microversion: 2.1 time: 1.060990 Oct 05 02:40:54.375645 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1536/3087] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:53 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1469 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:54.536763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-135e2996-a43b-4ace-bf10-11392016f56b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:54.544931 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-135e2996-a43b-4ace-bf10-11392016f56b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1318 microversion: 2.1 time: 0.746827 Oct 05 02:40:54.553293 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1552/3088] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:53 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1318 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:54.804578 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b6ab43c8-66f5-48c4-91b5-17b56767e997 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:54.805233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b6ab43c8-66f5-48c4-91b5-17b56767e997 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 95b81895-54ff-41fe-a3db-1343ad91dec9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:54.815906 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b6ab43c8-66f5-48c4-91b5-17b56767e997 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:54.817298 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b6ab43c8-66f5-48c4-91b5-17b56767e997 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:54.820874 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b6ab43c8-66f5-48c4-91b5-17b56767e997 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:54.822535 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b6ab43c8-66f5-48c4-91b5-17b56767e997 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:54.823957 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b6ab43c8-66f5-48c4-91b5-17b56767e997 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:54.825680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b6ab43c8-66f5-48c4-91b5-17b56767e997 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:55.049170 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b6ab43c8-66f5-48c4-91b5-17b56767e997 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:55.070767 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b6ab43c8-66f5-48c4-91b5-17b56767e997 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9" status: 200 len: 1275 microversion: 2.1 time: 0.270931 Oct 05 02:40:55.073624 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1537/3089] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:54 2022] GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9 => generated 1275 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:55.402509 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ad8058cf-6a90-4776-87ab-9a49a55ba7d3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:55.404265 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ad8058cf-6a90-4776-87ab-9a49a55ba7d3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:55.414881 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad8058cf-6a90-4776-87ab-9a49a55ba7d3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:55.415923 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad8058cf-6a90-4776-87ab-9a49a55ba7d3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:55.416582 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad8058cf-6a90-4776-87ab-9a49a55ba7d3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:55.417801 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad8058cf-6a90-4776-87ab-9a49a55ba7d3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:55.418579 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad8058cf-6a90-4776-87ab-9a49a55ba7d3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:55.419241 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad8058cf-6a90-4776-87ab-9a49a55ba7d3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:55.579506 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5f85d332-ce53-4574-9382-b3268e58bd16 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:55.584425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5f85d332-ce53-4574-9382-b3268e58bd16 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:55.599641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f85d332-ce53-4574-9382-b3268e58bd16 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:55.601290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f85d332-ce53-4574-9382-b3268e58bd16 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:55.606715 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f85d332-ce53-4574-9382-b3268e58bd16 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:55.610025 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f85d332-ce53-4574-9382-b3268e58bd16 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:55.612047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f85d332-ce53-4574-9382-b3268e58bd16 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:55.613288 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f85d332-ce53-4574-9382-b3268e58bd16 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:55.687461 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:40:56.547847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5f85d332-ce53-4574-9382-b3268e58bd16 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:56.556253 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5f85d332-ce53-4574-9382-b3268e58bd16 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1318 microversion: 2.1 time: 0.984345 Oct 05 02:40:56.569669 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1538/3090] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:55 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1318 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:56.579906 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b282f2b2-e01c-4b3e-a31c-1a22f43c7aab tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:56.583719 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b282f2b2-e01c-4b3e-a31c-1a22f43c7aab tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 95b81895-54ff-41fe-a3db-1343ad91dec9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:56.590770 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b282f2b2-e01c-4b3e-a31c-1a22f43c7aab tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:56.591607 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b282f2b2-e01c-4b3e-a31c-1a22f43c7aab tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:56.592272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b282f2b2-e01c-4b3e-a31c-1a22f43c7aab tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:56.593272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b282f2b2-e01c-4b3e-a31c-1a22f43c7aab tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:56.593974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b282f2b2-e01c-4b3e-a31c-1a22f43c7aab tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:56.594623 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b282f2b2-e01c-4b3e-a31c-1a22f43c7aab tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:56.991321 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ad8058cf-6a90-4776-87ab-9a49a55ba7d3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:57.012196 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ad8058cf-6a90-4776-87ab-9a49a55ba7d3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1469 microversion: 2.1 time: 1.614752 Oct 05 02:40:57.037856 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1553/3091] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:55 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1469 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:57.046656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-feab4c14-60f0-4758-a288-575856a95a1c req-0682bb6a-5837-4847-b36a-3e87cd493718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29215d80-fdc9-408d-b885-e6f3a5f7da84", "name": "network-vif-plugged", "status": "completed", "tag": "167e3597-f727-40a3-a743-6b1d1d8a0217"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:57.063738 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-feab4c14-60f0-4758-a288-575856a95a1c req-0682bb6a-5837-4847-b36a-3e87cd493718 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:57.064579 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-feab4c14-60f0-4758-a288-575856a95a1c req-0682bb6a-5837-4847-b36a-3e87cd493718 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:57.065226 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-feab4c14-60f0-4758-a288-575856a95a1c req-0682bb6a-5837-4847-b36a-3e87cd493718 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:57.085246 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-feab4c14-60f0-4758-a288-575856a95a1c req-0682bb6a-5837-4847-b36a-3e87cd493718 service nova] Creating event network-vif-plugged:167e3597-f727-40a3-a743-6b1d1d8a0217 for instance 29215d80-fdc9-408d-b885-e6f3a5f7da84 on n-h2-858272-3 Oct 05 02:40:57.094728 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [req-feab4c14-60f0-4758-a288-575856a95a1c req-0682bb6a-5837-4847-b36a-3e87cd493718 service nova] Instance 29215d80-fdc9-408d-b885-e6f3a5f7da84 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 02:40:57.111152 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-feab4c14-60f0-4758-a288-575856a95a1c req-0682bb6a-5837-4847-b36a-3e87cd493718 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069421 Oct 05 02:40:57.113264 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1554/3092] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:57.544096 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b282f2b2-e01c-4b3e-a31c-1a22f43c7aab tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:57.556386 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b282f2b2-e01c-4b3e-a31c-1a22f43c7aab tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9" status: 200 len: 1317 microversion: 2.1 time: 0.985239 Oct 05 02:40:57.557304 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1539/3093] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:56 2022] GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9 => generated 1317 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:57.595892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2d8a56e6-d658-46ea-9078-8b98005506ef tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:57.596689 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2d8a56e6-d658-46ea-9078-8b98005506ef tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:57.641296 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d8a56e6-d658-46ea-9078-8b98005506ef tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:57.643427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d8a56e6-d658-46ea-9078-8b98005506ef tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:57.644052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d8a56e6-d658-46ea-9078-8b98005506ef tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:57.648050 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d8a56e6-d658-46ea-9078-8b98005506ef tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:57.650148 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d8a56e6-d658-46ea-9078-8b98005506ef tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:57.652681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d8a56e6-d658-46ea-9078-8b98005506ef tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:58.131890 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6dbe2560-ea0d-4275-acf8-238b152cb2bb tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Action: 'create', calling method: .version_select at 0x7fccdf223820>, body: {"keypair": {"name": "tempest-keypair-874834135", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzWtqSkyjPco0mixCuU0V7WP/2EZ7H5f3U7RHoIq6Mc3rMyLx8ppScojmXCBZPXb10k15HnTfw/hxdW7n8ExBwxtOmUS8/DG8M7Xr4wbTx58IMX90+vKm6EC6ctWbOu0Q=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:40:58.157108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-6dbe2560-ea0d-4275-acf8-238b152cb2bb tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Getting quotas for project 20891ecf732b4c4597e3bfa0d96585a7. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:40:58.170327 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-6dbe2560-ea0d-4275-acf8-238b152cb2bb tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Getting quotas for user 4c2aedcc40d84bb6a287c2bac019ed4e and project 20891ecf732b4c4597e3bfa0d96585a7. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:40:58.211978 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6dbe2560-ea0d-4275-acf8-238b152cb2bb tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.220435 Oct 05 02:40:58.213792 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1540/3094] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 02:40:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:40:58.220847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-54534645-4ec6-4e08-805f-c97a0ef8a8c7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:58.222124 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-54534645-4ec6-4e08-805f-c97a0ef8a8c7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:58.231447 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-54534645-4ec6-4e08-805f-c97a0ef8a8c7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:58.232297 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-54534645-4ec6-4e08-805f-c97a0ef8a8c7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:58.233205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-54534645-4ec6-4e08-805f-c97a0ef8a8c7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:58.234307 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-54534645-4ec6-4e08-805f-c97a0ef8a8c7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:58.235462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-54534645-4ec6-4e08-805f-c97a0ef8a8c7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:58.236552 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-54534645-4ec6-4e08-805f-c97a0ef8a8c7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:58.869267 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2d8a56e6-d658-46ea-9078-8b98005506ef tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:58.896556 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2d8a56e6-d658-46ea-9078-8b98005506ef tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1318 microversion: 2.1 time: 1.308740 Oct 05 02:40:58.897778 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1555/3095] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:57 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1318 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:58.910795 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b76f4bfe-a2e1-4fd4-93af-292e22d757dc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:58.916264 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b76f4bfe-a2e1-4fd4-93af-292e22d757dc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 95b81895-54ff-41fe-a3db-1343ad91dec9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:58.928030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b76f4bfe-a2e1-4fd4-93af-292e22d757dc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:58.929327 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b76f4bfe-a2e1-4fd4-93af-292e22d757dc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:58.932888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b76f4bfe-a2e1-4fd4-93af-292e22d757dc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:58.939077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b76f4bfe-a2e1-4fd4-93af-292e22d757dc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:58.941082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b76f4bfe-a2e1-4fd4-93af-292e22d757dc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:58.943676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b76f4bfe-a2e1-4fd4-93af-292e22d757dc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:59.086875 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-54534645-4ec6-4e08-805f-c97a0ef8a8c7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:59.107525 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-54534645-4ec6-4e08-805f-c97a0ef8a8c7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1469 microversion: 2.1 time: 0.891291 Oct 05 02:40:59.114714 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1541/3096] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:58 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1469 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:59.575152 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b76f4bfe-a2e1-4fd4-93af-292e22d757dc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:40:59.593152 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b76f4bfe-a2e1-4fd4-93af-292e22d757dc tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9" status: 200 len: 1317 microversion: 2.1 time: 0.691877 Oct 05 02:40:59.594643 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1556/3097] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:58 2022] GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9 => generated 1317 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:40:59.927331 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dbe35508-3f8e-4a53-801c-0e35915ec6d8 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:40:59.931694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-dbe35508-3f8e-4a53-801c-0e35915ec6d8 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:40:59.949560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:40:59.952156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dbe35508-3f8e-4a53-801c-0e35915ec6d8 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:59.954429 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dbe35508-3f8e-4a53-801c-0e35915ec6d8 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:59.955161 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dbe35508-3f8e-4a53-801c-0e35915ec6d8 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:40:59.958105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dbe35508-3f8e-4a53-801c-0e35915ec6d8 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:40:59.959022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dbe35508-3f8e-4a53-801c-0e35915ec6d8 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:40:59.961321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dbe35508-3f8e-4a53-801c-0e35915ec6d8 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:00.141965 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-afd17bf2-348c-4883-a1fb-aef8224e1398 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:00.142605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-afd17bf2-348c-4883-a1fb-aef8224e1398 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:00.163600 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afd17bf2-348c-4883-a1fb-aef8224e1398 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:00.166279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afd17bf2-348c-4883-a1fb-aef8224e1398 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:00.169489 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afd17bf2-348c-4883-a1fb-aef8224e1398 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:00.170484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afd17bf2-348c-4883-a1fb-aef8224e1398 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:00.175031 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afd17bf2-348c-4883-a1fb-aef8224e1398 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:00.178519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afd17bf2-348c-4883-a1fb-aef8224e1398 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:00.599099 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=8 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:01.140570 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-dbe35508-3f8e-4a53-801c-0e35915ec6d8 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:01.151900 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-dbe35508-3f8e-4a53-801c-0e35915ec6d8 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1318 microversion: 2.1 time: 1.233722 Oct 05 02:41:01.157241 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1542/3098] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:40:59 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1318 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:01.163415 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-47427534-b9e6-4c08-b5b1-6150a6281fde tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:01.168521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-47427534-b9e6-4c08-b5b1-6150a6281fde tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 95b81895-54ff-41fe-a3db-1343ad91dec9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:01.185323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-47427534-b9e6-4c08-b5b1-6150a6281fde tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:01.186185 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-47427534-b9e6-4c08-b5b1-6150a6281fde tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:01.186836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-47427534-b9e6-4c08-b5b1-6150a6281fde tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:01.187818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-47427534-b9e6-4c08-b5b1-6150a6281fde tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:01.188559 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-47427534-b9e6-4c08-b5b1-6150a6281fde tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:01.189177 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-47427534-b9e6-4c08-b5b1-6150a6281fde tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:01.300652 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-afd17bf2-348c-4883-a1fb-aef8224e1398 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:01.322745 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-afd17bf2-348c-4883-a1fb-aef8224e1398 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1469 microversion: 2.1 time: 1.186944 Oct 05 02:41:01.338967 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1557/3099] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:00 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1469 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:01.357863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-cc9d064a-bcf9-4ce7-85a4-5c1ef22a2f26 req-52678303-8daa-4c47-a834-9cb4b0176186 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95b81895-54ff-41fe-a3db-1343ad91dec9", "tag": "a923990c-25c7-4fef-8fc1-ab024718a92a"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:41:01.382667 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-cc9d064a-bcf9-4ce7-85a4-5c1ef22a2f26 req-52678303-8daa-4c47-a834-9cb4b0176186 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:01.385105 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-cc9d064a-bcf9-4ce7-85a4-5c1ef22a2f26 req-52678303-8daa-4c47-a834-9cb4b0176186 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:01.385637 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-cc9d064a-bcf9-4ce7-85a4-5c1ef22a2f26 req-52678303-8daa-4c47-a834-9cb4b0176186 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:01.438236 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-cc9d064a-bcf9-4ce7-85a4-5c1ef22a2f26 req-52678303-8daa-4c47-a834-9cb4b0176186 service nova] Creating event network-changed:a923990c-25c7-4fef-8fc1-ab024718a92a for instance 95b81895-54ff-41fe-a3db-1343ad91dec9 on n-h1-858272-3 Oct 05 02:41:01.451957 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-cc9d064a-bcf9-4ce7-85a4-5c1ef22a2f26 req-52678303-8daa-4c47-a834-9cb4b0176186 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107726 Oct 05 02:41:01.455563 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1558/3100] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:41:01.775398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-47427534-b9e6-4c08-b5b1-6150a6281fde tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:01.797413 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-47427534-b9e6-4c08-b5b1-6150a6281fde tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9" status: 200 len: 1317 microversion: 2.1 time: 0.638335 Oct 05 02:41:01.799468 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1543/3101] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:01 2022] GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9 => generated 1317 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:02.179121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c315b5da-f21d-4452-834a-9877ce9752c4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:02.179911 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c315b5da-f21d-4452-834a-9877ce9752c4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:02.243789 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c315b5da-f21d-4452-834a-9877ce9752c4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:02.247684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c315b5da-f21d-4452-834a-9877ce9752c4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:02.248356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c315b5da-f21d-4452-834a-9877ce9752c4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:02.254980 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c315b5da-f21d-4452-834a-9877ce9752c4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:02.262357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c315b5da-f21d-4452-834a-9877ce9752c4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:02.266536 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c315b5da-f21d-4452-834a-9877ce9752c4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:02.363749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bd639fa0-0909-40cd-852f-324fdccb7c05 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:02.365143 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bd639fa0-0909-40cd-852f-324fdccb7c05 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:02.391860 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd639fa0-0909-40cd-852f-324fdccb7c05 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:02.393369 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd639fa0-0909-40cd-852f-324fdccb7c05 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:02.394352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd639fa0-0909-40cd-852f-324fdccb7c05 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:02.396703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd639fa0-0909-40cd-852f-324fdccb7c05 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:02.397460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd639fa0-0909-40cd-852f-324fdccb7c05 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:02.398585 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd639fa0-0909-40cd-852f-324fdccb7c05 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:03.031606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bd639fa0-0909-40cd-852f-324fdccb7c05 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:03.051757 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bd639fa0-0909-40cd-852f-324fdccb7c05 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1461 microversion: 2.1 time: 0.696285 Oct 05 02:41:03.069529 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1544/3102] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:02 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1461 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:03.083327 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-61e1c4d8-582a-4ce6-bd1f-394d1e8393e6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1051445144", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "74605e79-96c6-45a8-ae1a-732547f9e79d"}], "security_groups": [{"name": "tempest-securitygroup--847783189"}], "key_name": "tempest-keypair-874834135", "user_data": "}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:41:03.111094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c315b5da-f21d-4452-834a-9877ce9752c4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:03.122470 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c315b5da-f21d-4452-834a-9877ce9752c4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1318 microversion: 2.1 time: 0.949604 Oct 05 02:41:03.123895 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1559/3103] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:02 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1318 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:03.128805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fe339baf-920f-458d-ba79-83f18da3e092 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:03.129740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fe339baf-920f-458d-ba79-83f18da3e092 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 95b81895-54ff-41fe-a3db-1343ad91dec9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:03.136514 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe339baf-920f-458d-ba79-83f18da3e092 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:03.137235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe339baf-920f-458d-ba79-83f18da3e092 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:03.137857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe339baf-920f-458d-ba79-83f18da3e092 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:03.138730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe339baf-920f-458d-ba79-83f18da3e092 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:03.139346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe339baf-920f-458d-ba79-83f18da3e092 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:03.139930 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe339baf-920f-458d-ba79-83f18da3e092 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:04.134679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-61e1c4d8-582a-4ce6-bd1f-394d1e8393e6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] validate_networks() for [('74605e79-96c6-45a8-ae1a-732547f9e79d', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:41:04.500690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fe339baf-920f-458d-ba79-83f18da3e092 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:04.511060 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fe339baf-920f-458d-ba79-83f18da3e092 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9" status: 200 len: 1317 microversion: 2.1 time: 1.385903 Oct 05 02:41:04.511664 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1560/3104] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:03 2022] GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9 => generated 1317 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:04.526973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1f68aed0-d1df-41e5-a96c-bf20c5010da0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:04.529146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1f68aed0-d1df-41e5-a96c-bf20c5010da0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:04.544938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1f68aed0-d1df-41e5-a96c-bf20c5010da0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:04.547890 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1f68aed0-d1df-41e5-a96c-bf20c5010da0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:04.549484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1f68aed0-d1df-41e5-a96c-bf20c5010da0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:04.551009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1f68aed0-d1df-41e5-a96c-bf20c5010da0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:04.553148 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1f68aed0-d1df-41e5-a96c-bf20c5010da0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:04.554724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1f68aed0-d1df-41e5-a96c-bf20c5010da0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:04.877479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:04.944469 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1f68aed0-d1df-41e5-a96c-bf20c5010da0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:04.956120 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1f68aed0-d1df-41e5-a96c-bf20c5010da0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1461 microversion: 2.1 time: 0.443375 Oct 05 02:41:04.973109 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1561/3105] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:04 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1461 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:04.986190 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-41cefe0d-abf0-4bac-8ffa-3cb05f1e0d33 req-643adbcb-afe2-4cf0-8f64-4d0c59b13b8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6e3897-5115-4283-804d-abaa483786fc", "name": "network-vif-plugged", "status": "completed", "tag": "4aff4e1f-3112-4ceb-b24d-2327b404029f"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:41:04.997969 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-41cefe0d-abf0-4bac-8ffa-3cb05f1e0d33 req-643adbcb-afe2-4cf0-8f64-4d0c59b13b8e service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:04.998801 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-41cefe0d-abf0-4bac-8ffa-3cb05f1e0d33 req-643adbcb-afe2-4cf0-8f64-4d0c59b13b8e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:04.999861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-41cefe0d-abf0-4bac-8ffa-3cb05f1e0d33 req-643adbcb-afe2-4cf0-8f64-4d0c59b13b8e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:05.017902 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-41cefe0d-abf0-4bac-8ffa-3cb05f1e0d33 req-643adbcb-afe2-4cf0-8f64-4d0c59b13b8e service nova] Creating event network-vif-plugged:4aff4e1f-3112-4ceb-b24d-2327b404029f for instance 0d6e3897-5115-4283-804d-abaa483786fc on n-h1-858272-3 Oct 05 02:41:05.032800 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-41cefe0d-abf0-4bac-8ffa-3cb05f1e0d33 req-643adbcb-afe2-4cf0-8f64-4d0c59b13b8e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057829 Oct 05 02:41:05.040141 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1562/3106] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:41:05.057848 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f14e243a-b6db-49ba-8d55-da649cff9417 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:05.058580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f14e243a-b6db-49ba-8d55-da649cff9417 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:05.073961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f14e243a-b6db-49ba-8d55-da649cff9417 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:05.074471 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f14e243a-b6db-49ba-8d55-da649cff9417 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:05.074920 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f14e243a-b6db-49ba-8d55-da649cff9417 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:05.075639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f14e243a-b6db-49ba-8d55-da649cff9417 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:05.076105 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f14e243a-b6db-49ba-8d55-da649cff9417 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:05.076533 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f14e243a-b6db-49ba-8d55-da649cff9417 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:05.559617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-61e1c4d8-582a-4ce6-bd1f-394d1e8393e6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:41:05.560115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-61e1c4d8-582a-4ce6-bd1f-394d1e8393e6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:41:05.560482 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-61e1c4d8-582a-4ce6-bd1f-394d1e8393e6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:41:05.561092 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-61e1c4d8-582a-4ce6-bd1f-394d1e8393e6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:41:05.561686 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-61e1c4d8-582a-4ce6-bd1f-394d1e8393e6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:41:05.584205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-61e1c4d8-582a-4ce6-bd1f-394d1e8393e6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:05.585400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-61e1c4d8-582a-4ce6-bd1f-394d1e8393e6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:05.589705 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-61e1c4d8-582a-4ce6-bd1f-394d1e8393e6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:05.590922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-61e1c4d8-582a-4ce6-bd1f-394d1e8393e6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:05.591849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-61e1c4d8-582a-4ce6-bd1f-394d1e8393e6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:05.592490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-61e1c4d8-582a-4ce6-bd1f-394d1e8393e6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:05.622653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-61e1c4d8-582a-4ce6-bd1f-394d1e8393e6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Getting quotas for project 20891ecf732b4c4597e3bfa0d96585a7. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:41:05.632104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-61e1c4d8-582a-4ce6-bd1f-394d1e8393e6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Getting quotas for user 4c2aedcc40d84bb6a287c2bac019ed4e and project 20891ecf732b4c4597e3bfa0d96585a7. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:41:05.674638 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f14e243a-b6db-49ba-8d55-da649cff9417 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:05.685543 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f14e243a-b6db-49ba-8d55-da649cff9417 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1318 microversion: 2.1 time: 0.645751 Oct 05 02:41:05.694001 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1563/3107] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:05 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1318 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:05.696674 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-61e1c4d8-582a-4ce6-bd1f-394d1e8393e6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:41:05.700646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-61e1c4d8-582a-4ce6-bd1f-394d1e8393e6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:41:05.835353 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-61e1c4d8-582a-4ce6-bd1f-394d1e8393e6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.760343 Oct 05 02:41:05.836555 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1545/3108] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:41:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 2766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:41:05.847218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7ceb8ef7-8071-4993-97dc-b8c0de3f0b35 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Action: 'create', calling method: .version_select at 0x7fccdf2411f0>, body: {"keypair": {"name": "tempest-keypair-256781211", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyPSTvvYz4OkYkmoA+BNLcHHLcxaTI8+PK90pRV1DAa/WAtOKnwWSbLY32GINGuF7opDea7QRK+Qxnn0YG/NBiStwRNPKXbwJfUcqyl9xcno7sqpD8NvPfKcnNj39FlKQ=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:41:05.850110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-64dae815-55ae-45cc-bd41-c35fad3b57c0 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Action: 'create', calling method: .version_select at 0x7fcce81f4430>, body: {"keypair": {"name": "tempest-keypair-7082707", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzqlWM7wDB5GfwXQfu/o8x40i9LKGv71afmzfEMOBVANYHD+zn7+WrURsJqC32vENNgAbe4eXRU3rV0IGiKPvZci/VO2mlWZDmPjimkUU+GM0nNsK0MZhjCnH+qN5gHXA=="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:41:05.868437 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-7ceb8ef7-8071-4993-97dc-b8c0de3f0b35 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Getting quotas for project 446a33968038476fbc98fc0b6b1795c0. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:41:05.875678 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-7ceb8ef7-8071-4993-97dc-b8c0de3f0b35 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Getting quotas for user 1b4b5f0c43074932a8963727adfee38a and project 446a33968038476fbc98fc0b6b1795c0. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:41:05.898400 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-64dae815-55ae-45cc-bd41-c35fad3b57c0 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Getting quotas for project 2ced783ca2614e7996ccac3bc9ad97c7. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:41:05.912359 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-64dae815-55ae-45cc-bd41-c35fad3b57c0 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Getting quotas for user 6746153a53d94c4a9b8d1167a7fa7c4a and project 2ced783ca2614e7996ccac3bc9ad97c7. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:41:05.921366 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7ceb8ef7-8071-4993-97dc-b8c0de3f0b35 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.081692 Oct 05 02:41:05.921930 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1546/3109] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 02:41:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:41:05.931776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5017e957-e966-4c80-9fb1-4ec5e88d5e05 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:05.933484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5017e957-e966-4c80-9fb1-4ec5e88d5e05 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 95b81895-54ff-41fe-a3db-1343ad91dec9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:05.949905 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5017e957-e966-4c80-9fb1-4ec5e88d5e05 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:05.950822 n-d-858272-3 devstack@n-api.service[122320]: ERROR oslo.messaging._drivers.impl_rabbit [None req-64dae815-55ae-45cc-bd41-c35fad3b57c0 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [8a8df7a1-9fb5-4319-8aad-cf438823f16a] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 02:41:05.951342 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5017e957-e966-4c80-9fb1-4ec5e88d5e05 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:05.951809 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5017e957-e966-4c80-9fb1-4ec5e88d5e05 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:05.952569 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5017e957-e966-4c80-9fb1-4ec5e88d5e05 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:05.954962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5017e957-e966-4c80-9fb1-4ec5e88d5e05 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:05.956223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5017e957-e966-4c80-9fb1-4ec5e88d5e05 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:06.283499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5017e957-e966-4c80-9fb1-4ec5e88d5e05 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:06.304674 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5017e957-e966-4c80-9fb1-4ec5e88d5e05 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9" status: 200 len: 1317 microversion: 2.1 time: 0.381208 Oct 05 02:41:06.306718 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1547/3110] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:05 2022] GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9 => generated 1317 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:06.314443 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dcf98abd-140d-4968-89ad-57277272a208 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:06.315404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-dcf98abd-140d-4968-89ad-57277272a208 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:06.493141 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-dcf98abd-140d-4968-89ad-57277272a208 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:06.522482 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-dcf98abd-140d-4968-89ad-57277272a208 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1237 microversion: 2.1 time: 0.213791 Oct 05 02:41:06.523082 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1548/3111] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:06 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1237 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:06.718020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ab1b0130-3105-4f0e-8b58-6ffb02735c9a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:06.722404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ab1b0130-3105-4f0e-8b58-6ffb02735c9a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:06.749437 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab1b0130-3105-4f0e-8b58-6ffb02735c9a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:06.750430 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab1b0130-3105-4f0e-8b58-6ffb02735c9a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:06.751301 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab1b0130-3105-4f0e-8b58-6ffb02735c9a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:06.752543 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab1b0130-3105-4f0e-8b58-6ffb02735c9a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:06.753355 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab1b0130-3105-4f0e-8b58-6ffb02735c9a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:06.754865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab1b0130-3105-4f0e-8b58-6ffb02735c9a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:06.969959 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [None req-64dae815-55ae-45cc-bd41-c35fad3b57c0 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [8a8df7a1-9fb5-4319-8aad-cf438823f16a] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54030. Oct 05 02:41:07.018774 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-64dae815-55ae-45cc-bd41-c35fad3b57c0 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 1.322746 Oct 05 02:41:07.034583 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1564/3112] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 02:41:05 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:41:07.342323 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a3728fdd-667c-40ed-9344-9a67cd76aeab tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:07.347519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a3728fdd-667c-40ed-9344-9a67cd76aeab tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 95b81895-54ff-41fe-a3db-1343ad91dec9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:07.360627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3728fdd-667c-40ed-9344-9a67cd76aeab tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:07.369571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3728fdd-667c-40ed-9344-9a67cd76aeab tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:07.373433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ab1b0130-3105-4f0e-8b58-6ffb02735c9a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:07.374273 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3728fdd-667c-40ed-9344-9a67cd76aeab tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:07.375060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3728fdd-667c-40ed-9344-9a67cd76aeab tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:07.375546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3728fdd-667c-40ed-9344-9a67cd76aeab tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:07.376191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3728fdd-667c-40ed-9344-9a67cd76aeab tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:07.401385 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ab1b0130-3105-4f0e-8b58-6ffb02735c9a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1318 microversion: 2.1 time: 0.686817 Oct 05 02:41:07.404048 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1549/3113] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:06 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1318 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:41:07.558121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-62fe6202-5b87-4a42-90d8-6828eecb4d7e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:07.559304 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-62fe6202-5b87-4a42-90d8-6828eecb4d7e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:07.568351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62fe6202-5b87-4a42-90d8-6828eecb4d7e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:07.573249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62fe6202-5b87-4a42-90d8-6828eecb4d7e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:07.574111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62fe6202-5b87-4a42-90d8-6828eecb4d7e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:07.575108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62fe6202-5b87-4a42-90d8-6828eecb4d7e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:07.575808 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62fe6202-5b87-4a42-90d8-6828eecb4d7e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:07.576458 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62fe6202-5b87-4a42-90d8-6828eecb4d7e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:08.178774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-62fe6202-5b87-4a42-90d8-6828eecb4d7e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:08.189312 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-62fe6202-5b87-4a42-90d8-6828eecb4d7e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1233 microversion: 2.1 time: 0.635199 Oct 05 02:41:08.206497 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1550/3114] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:07 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1233 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:41:08.429595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-26ae34c5-d16f-4473-822c-3320ee39a6a0 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:08.433712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-26ae34c5-d16f-4473-822c-3320ee39a6a0 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:08.463922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26ae34c5-d16f-4473-822c-3320ee39a6a0 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:08.465281 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26ae34c5-d16f-4473-822c-3320ee39a6a0 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:08.470132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26ae34c5-d16f-4473-822c-3320ee39a6a0 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:08.490483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26ae34c5-d16f-4473-822c-3320ee39a6a0 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:08.491677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26ae34c5-d16f-4473-822c-3320ee39a6a0 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:08.497127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26ae34c5-d16f-4473-822c-3320ee39a6a0 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:08.906445 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a3728fdd-667c-40ed-9344-9a67cd76aeab tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:08.921673 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a3728fdd-667c-40ed-9344-9a67cd76aeab tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9" status: 200 len: 1317 microversion: 2.1 time: 1.590435 Oct 05 02:41:08.923440 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1565/3115] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:07 2022] GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9 => generated 1317 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:09.218244 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-900bcb39-3fda-4ef3-8f46-68bb71e1f77f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:09.218941 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-900bcb39-3fda-4ef3-8f46-68bb71e1f77f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:09.234844 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-900bcb39-3fda-4ef3-8f46-68bb71e1f77f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:09.236935 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-900bcb39-3fda-4ef3-8f46-68bb71e1f77f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:09.237415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-900bcb39-3fda-4ef3-8f46-68bb71e1f77f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:09.241434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-900bcb39-3fda-4ef3-8f46-68bb71e1f77f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:09.241948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-900bcb39-3fda-4ef3-8f46-68bb71e1f77f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:09.242664 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-900bcb39-3fda-4ef3-8f46-68bb71e1f77f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:09.937506 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-26ae34c5-d16f-4473-822c-3320ee39a6a0 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:09.966935 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-26ae34c5-d16f-4473-822c-3320ee39a6a0 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1507 microversion: 2.1 time: 1.544795 Oct 05 02:41:09.968954 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1551/3116] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:08 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1507 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:41:09.980504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-900bcb39-3fda-4ef3-8f46-68bb71e1f77f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:10.005225 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-936cce8e-c129-4abf-9f4b-255cb2b6c9f6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:10.005762 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-900bcb39-3fda-4ef3-8f46-68bb71e1f77f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1295 microversion: 2.1 time: 0.792227 Oct 05 02:41:10.006374 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1566/3117] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:09 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1295 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:41:10.019199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-936cce8e-c129-4abf-9f4b-255cb2b6c9f6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 95b81895-54ff-41fe-a3db-1343ad91dec9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:10.046836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9dc65455-439c-40d2-abe7-a5a65fee87c4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:10.048980 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9dc65455-439c-40d2-abe7-a5a65fee87c4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:10.050812 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-936cce8e-c129-4abf-9f4b-255cb2b6c9f6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:10.051545 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-936cce8e-c129-4abf-9f4b-255cb2b6c9f6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:10.054513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-936cce8e-c129-4abf-9f4b-255cb2b6c9f6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:10.056485 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-936cce8e-c129-4abf-9f4b-255cb2b6c9f6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:10.058897 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-936cce8e-c129-4abf-9f4b-255cb2b6c9f6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:10.061592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-936cce8e-c129-4abf-9f4b-255cb2b6c9f6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:10.068451 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9dc65455-439c-40d2-abe7-a5a65fee87c4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:10.069238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9dc65455-439c-40d2-abe7-a5a65fee87c4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:10.070173 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9dc65455-439c-40d2-abe7-a5a65fee87c4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:10.071973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9dc65455-439c-40d2-abe7-a5a65fee87c4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:10.072602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9dc65455-439c-40d2-abe7-a5a65fee87c4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:10.073741 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9dc65455-439c-40d2-abe7-a5a65fee87c4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:10.581617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-936cce8e-c129-4abf-9f4b-255cb2b6c9f6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:10.593837 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-936cce8e-c129-4abf-9f4b-255cb2b6c9f6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9" status: 200 len: 1317 microversion: 2.1 time: 0.623474 Oct 05 02:41:10.594425 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1552/3118] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:09 2022] GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9 => generated 1317 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:10.727444 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9dc65455-439c-40d2-abe7-a5a65fee87c4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:10.741806 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9dc65455-439c-40d2-abe7-a5a65fee87c4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1507 microversion: 2.1 time: 0.710162 Oct 05 02:41:10.744364 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1567/3119] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:10 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1507 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:10.773569 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-00e7a11f-bf48-4cc2-b347-8636a7b0af4c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:41:10.777111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-00e7a11f-bf48-4cc2-b347-8636a7b0af4c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:10.789148 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-00e7a11f-bf48-4cc2-b347-8636a7b0af4c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:10.789645 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-00e7a11f-bf48-4cc2-b347-8636a7b0af4c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:10.790081 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-00e7a11f-bf48-4cc2-b347-8636a7b0af4c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:10.790781 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-00e7a11f-bf48-4cc2-b347-8636a7b0af4c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:10.791235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-00e7a11f-bf48-4cc2-b347-8636a7b0af4c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:10.802335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-00e7a11f-bf48-4cc2-b347-8636a7b0af4c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:11.035399 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c1416196-f0ef-4da7-8c1c-e88cd56bda6c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:11.036792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c1416196-f0ef-4da7-8c1c-e88cd56bda6c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:11.053200 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1416196-f0ef-4da7-8c1c-e88cd56bda6c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:11.054075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1416196-f0ef-4da7-8c1c-e88cd56bda6c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:11.055369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1416196-f0ef-4da7-8c1c-e88cd56bda6c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:11.056352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1416196-f0ef-4da7-8c1c-e88cd56bda6c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:11.057072 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1416196-f0ef-4da7-8c1c-e88cd56bda6c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:11.057726 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1416196-f0ef-4da7-8c1c-e88cd56bda6c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:11.208586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c1416196-f0ef-4da7-8c1c-e88cd56bda6c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:11.217346 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c1416196-f0ef-4da7-8c1c-e88cd56bda6c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1295 microversion: 2.1 time: 0.185765 Oct 05 02:41:11.221834 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1568/3120] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:11 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1295 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:11.259518 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-ef765701-a169-4e95-9238-a242b6013a84 req-79aab24b-8142-438f-b8f8-e98c933cfd12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b81895-54ff-41fe-a3db-1343ad91dec9", "name": "network-vif-plugged", "status": "completed", "tag": "a923990c-25c7-4fef-8fc1-ab024718a92a"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:41:11.278869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ef765701-a169-4e95-9238-a242b6013a84 req-79aab24b-8142-438f-b8f8-e98c933cfd12 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:11.289123 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ef765701-a169-4e95-9238-a242b6013a84 req-79aab24b-8142-438f-b8f8-e98c933cfd12 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:11.289704 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ef765701-a169-4e95-9238-a242b6013a84 req-79aab24b-8142-438f-b8f8-e98c933cfd12 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:11.309332 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-ef765701-a169-4e95-9238-a242b6013a84 req-79aab24b-8142-438f-b8f8-e98c933cfd12 service nova] Creating event network-vif-plugged:a923990c-25c7-4fef-8fc1-ab024718a92a for instance 95b81895-54ff-41fe-a3db-1343ad91dec9 on n-h1-858272-3 Oct 05 02:41:11.358167 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-ef765701-a169-4e95-9238-a242b6013a84 req-79aab24b-8142-438f-b8f8-e98c933cfd12 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102588 Oct 05 02:41:11.359267 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1569/3121] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:41:11.397016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-00e7a11f-bf48-4cc2-b347-8636a7b0af4c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:41:11.397656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-00e7a11f-bf48-4cc2-b347-8636a7b0af4c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:41:11.397881 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-00e7a11f-bf48-4cc2-b347-8636a7b0af4c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:41:11.403600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-00e7a11f-bf48-4cc2-b347-8636a7b0af4c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:41:11.404352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-00e7a11f-bf48-4cc2-b347-8636a7b0af4c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:41:11.512994 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-00e7a11f-bf48-4cc2-b347-8636a7b0af4c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:11.538724 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-00e7a11f-bf48-4cc2-b347-8636a7b0af4c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:11.540182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-00e7a11f-bf48-4cc2-b347-8636a7b0af4c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:11.541230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-00e7a11f-bf48-4cc2-b347-8636a7b0af4c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:11.544028 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-00e7a11f-bf48-4cc2-b347-8636a7b0af4c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:11.546233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-00e7a11f-bf48-4cc2-b347-8636a7b0af4c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:11.546970 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-00e7a11f-bf48-4cc2-b347-8636a7b0af4c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:11.622837 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1b9594b2-81d6-42ce-aa85-198a336de607 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:11.623581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1b9594b2-81d6-42ce-aa85-198a336de607 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 95b81895-54ff-41fe-a3db-1343ad91dec9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:11.645547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b9594b2-81d6-42ce-aa85-198a336de607 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:11.646054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b9594b2-81d6-42ce-aa85-198a336de607 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:11.646498 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b9594b2-81d6-42ce-aa85-198a336de607 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:11.647216 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b9594b2-81d6-42ce-aa85-198a336de607 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:11.647674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b9594b2-81d6-42ce-aa85-198a336de607 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:11.648102 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b9594b2-81d6-42ce-aa85-198a336de607 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:11.654168 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-00e7a11f-bf48-4cc2-b347-8636a7b0af4c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "POST /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc/action" status: 202 len: 1109 microversion: 2.1 time: 0.885669 Oct 05 02:41:11.661559 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1553/3122] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:41:10 2022] POST /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc/action => generated 1109 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 05 02:41:11.708589 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b0e31203-99f9-4e38-bd2b-96564bfab385 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:11.709620 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b0e31203-99f9-4e38-bd2b-96564bfab385 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:11.744925 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0e31203-99f9-4e38-bd2b-96564bfab385 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:11.749548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0e31203-99f9-4e38-bd2b-96564bfab385 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:11.751428 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0e31203-99f9-4e38-bd2b-96564bfab385 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:11.757183 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0e31203-99f9-4e38-bd2b-96564bfab385 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:11.759929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0e31203-99f9-4e38-bd2b-96564bfab385 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:11.762727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0e31203-99f9-4e38-bd2b-96564bfab385 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:12.793553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1b9594b2-81d6-42ce-aa85-198a336de607 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:12.795888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:12.811305 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1b9594b2-81d6-42ce-aa85-198a336de607 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9" status: 200 len: 1317 microversion: 2.1 time: 1.199299 Oct 05 02:41:12.812438 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1570/3123] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:11 2022] GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9 => generated 1317 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:41:12.818208 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-85dd0240-ff3f-4142-a665-d66607fe95f2 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:12.829859 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-85dd0240-ff3f-4142-a665-d66607fe95f2 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:12.845471 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85dd0240-ff3f-4142-a665-d66607fe95f2 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:12.846470 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85dd0240-ff3f-4142-a665-d66607fe95f2 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:12.850060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85dd0240-ff3f-4142-a665-d66607fe95f2 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:12.851001 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85dd0240-ff3f-4142-a665-d66607fe95f2 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:12.851648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85dd0240-ff3f-4142-a665-d66607fe95f2 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:12.852089 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85dd0240-ff3f-4142-a665-d66607fe95f2 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:13.046879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b0e31203-99f9-4e38-bd2b-96564bfab385 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:13.057299 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b0e31203-99f9-4e38-bd2b-96564bfab385 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1514 microversion: 2.1 time: 1.367970 Oct 05 02:41:13.059425 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1554/3124] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:11 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1514 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:13.534243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-85dd0240-ff3f-4142-a665-d66607fe95f2 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:13.548306 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-85dd0240-ff3f-4142-a665-d66607fe95f2 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1362 microversion: 2.1 time: 0.734479 Oct 05 02:41:13.561127 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1571/3125] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:12 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1362 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:13.835361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fdac4a87-ca4d-4a84-9c70-629993d817e5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:13.835976 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fdac4a87-ca4d-4a84-9c70-629993d817e5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 95b81895-54ff-41fe-a3db-1343ad91dec9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:13.843502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fdac4a87-ca4d-4a84-9c70-629993d817e5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:13.844286 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fdac4a87-ca4d-4a84-9c70-629993d817e5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:13.845682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fdac4a87-ca4d-4a84-9c70-629993d817e5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:13.846984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fdac4a87-ca4d-4a84-9c70-629993d817e5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:13.847782 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fdac4a87-ca4d-4a84-9c70-629993d817e5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:13.848450 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fdac4a87-ca4d-4a84-9c70-629993d817e5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:14.086148 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3965084c-0da1-46ca-9516-fb98e5257f86 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:14.086794 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3965084c-0da1-46ca-9516-fb98e5257f86 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:14.107555 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3965084c-0da1-46ca-9516-fb98e5257f86 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:14.108061 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3965084c-0da1-46ca-9516-fb98e5257f86 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:14.108503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3965084c-0da1-46ca-9516-fb98e5257f86 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:14.109255 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3965084c-0da1-46ca-9516-fb98e5257f86 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:14.109718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3965084c-0da1-46ca-9516-fb98e5257f86 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:14.110150 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3965084c-0da1-46ca-9516-fb98e5257f86 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:14.717932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fdac4a87-ca4d-4a84-9c70-629993d817e5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:14.734351 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fdac4a87-ca4d-4a84-9c70-629993d817e5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9" status: 200 len: 1317 microversion: 2.1 time: 0.903359 Oct 05 02:41:14.739949 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1555/3126] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:13 2022] GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9 => generated 1317 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:14.750157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-46f810b1-acb7-4b74-858a-7c0ead997561 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Calling method '.version_select at 0x7fccdf265160>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:14.757136 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46f810b1-acb7-4b74-858a-7c0ead997561 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:14.758405 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46f810b1-acb7-4b74-858a-7c0ead997561 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:14.759108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46f810b1-acb7-4b74-858a-7c0ead997561 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:14.779780 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-46f810b1-acb7-4b74-858a-7c0ead997561 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 803 microversion: 2.1 time: 0.032978 Oct 05 02:41:14.781088 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1556/3127] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 5 02:41:14 2022] GET /compute/v2.1/os-migrations => generated 803 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:41:14.791229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c8e68df5-efc1-4744-ad65-c828b0b54cad tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:14.793137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c8e68df5-efc1-4744-ad65-c828b0b54cad tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:14.806556 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c8e68df5-efc1-4744-ad65-c828b0b54cad tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:14.808061 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c8e68df5-efc1-4744-ad65-c828b0b54cad tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:14.810831 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c8e68df5-efc1-4744-ad65-c828b0b54cad tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:14.812811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c8e68df5-efc1-4744-ad65-c828b0b54cad tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:14.818384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c8e68df5-efc1-4744-ad65-c828b0b54cad tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:14.820456 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c8e68df5-efc1-4744-ad65-c828b0b54cad tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:14.868120 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:15.247194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3965084c-0da1-46ca-9516-fb98e5257f86 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:15.264258 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3965084c-0da1-46ca-9516-fb98e5257f86 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1514 microversion: 2.1 time: 1.182664 Oct 05 02:41:15.265652 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1572/3128] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:14 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1514 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:41:15.275648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a06cb00f-c85a-44ca-a3f5-482eee0e5973 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:15.286717 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a06cb00f-c85a-44ca-a3f5-482eee0e5973 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019466 Oct 05 02:41:15.288625 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1573/3129] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 5 02:41:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:41:15.310829 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-58247b3f-5a62-4aa9-a900-e47fdacd28f4 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-336469695", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:41:15.377571 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-58247b3f-5a62-4aa9-a900-e47fdacd28f4 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.079403 Oct 05 02:41:15.380597 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1574/3130] 10.222.0.16 () {60 vars in 1146 bytes} [Wed Oct 5 02:41:15 2022] POST /compute/v2.1/flavors => generated 498 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:41:15.391928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-158d02bf-be22-4743-ace8-0903b905e54b tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:15.400316 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-158d02bf-be22-4743-ace8-0903b905e54b tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012606 Oct 05 02:41:15.401502 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1575/3131] 10.222.0.16 () {58 vars in 1182 bytes} [Wed Oct 5 02:41:15 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:41:15.530478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-969919de-e755-4917-954f-776a9db9d8a3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1902368238", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "420c4dd2-e5ee-47a6-859a-f68516099f07"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:41:15.557099 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c8e68df5-efc1-4744-ad65-c828b0b54cad tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:15.571594 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c8e68df5-efc1-4744-ad65-c828b0b54cad tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1362 microversion: 2.1 time: 0.788762 Oct 05 02:41:15.573704 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1557/3132] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:14 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1362 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:15.639299 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-969919de-e755-4917-954f-776a9db9d8a3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] validate_networks() for None {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:41:15.765450 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-69d23337-4a19-4c6d-bad0-19aa3d2907ba tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:15.766702 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-69d23337-4a19-4c6d-bad0-19aa3d2907ba tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 95b81895-54ff-41fe-a3db-1343ad91dec9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:15.769050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:15.776883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69d23337-4a19-4c6d-bad0-19aa3d2907ba tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:15.777796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69d23337-4a19-4c6d-bad0-19aa3d2907ba tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:15.778486 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69d23337-4a19-4c6d-bad0-19aa3d2907ba tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:15.779522 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69d23337-4a19-4c6d-bad0-19aa3d2907ba tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:15.780201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69d23337-4a19-4c6d-bad0-19aa3d2907ba tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:15.780846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69d23337-4a19-4c6d-bad0-19aa3d2907ba tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:15.942552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:16.499947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=22 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:16.561851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-69d23337-4a19-4c6d-bad0-19aa3d2907ba tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:16.578245 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-69d23337-4a19-4c6d-bad0-19aa3d2907ba tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9" status: 200 len: 1467 microversion: 2.1 time: 0.813554 Oct 05 02:41:16.579535 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1558/3133] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:15 2022] GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9 => generated 1467 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:41:16.604289 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-13e1f767-379c-4804-bfde-b3f83272a980 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:16.605482 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-13e1f767-379c-4804-bfde-b3f83272a980 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:16.628394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13e1f767-379c-4804-bfde-b3f83272a980 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:16.631254 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13e1f767-379c-4804-bfde-b3f83272a980 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:16.632230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13e1f767-379c-4804-bfde-b3f83272a980 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:16.633462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13e1f767-379c-4804-bfde-b3f83272a980 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:16.634382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13e1f767-379c-4804-bfde-b3f83272a980 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:16.635368 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13e1f767-379c-4804-bfde-b3f83272a980 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:16.825122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-969919de-e755-4917-954f-776a9db9d8a3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:41:16.826230 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-969919de-e755-4917-954f-776a9db9d8a3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:41:16.826869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-969919de-e755-4917-954f-776a9db9d8a3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:41:16.827739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-969919de-e755-4917-954f-776a9db9d8a3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:41:16.828333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-969919de-e755-4917-954f-776a9db9d8a3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:41:16.852160 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-969919de-e755-4917-954f-776a9db9d8a3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:16.864207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-969919de-e755-4917-954f-776a9db9d8a3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:16.867071 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-969919de-e755-4917-954f-776a9db9d8a3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:16.868100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-969919de-e755-4917-954f-776a9db9d8a3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:16.873566 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-969919de-e755-4917-954f-776a9db9d8a3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:16.874264 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-969919de-e755-4917-954f-776a9db9d8a3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:16.918010 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-13e1f767-379c-4804-bfde-b3f83272a980 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:16.928838 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-13e1f767-379c-4804-bfde-b3f83272a980 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1514 microversion: 2.1 time: 0.343405 Oct 05 02:41:16.930383 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1559/3134] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:16 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1514 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:16.943134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-96360da0-4c29-444a-a0d5-dc292af5d0e1 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:16.944347 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-96360da0-4c29-444a-a0d5-dc292af5d0e1 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:16.952235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-969919de-e755-4917-954f-776a9db9d8a3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Getting quotas for project 446a33968038476fbc98fc0b6b1795c0. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:41:16.953242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96360da0-4c29-444a-a0d5-dc292af5d0e1 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:16.953741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96360da0-4c29-444a-a0d5-dc292af5d0e1 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:16.954178 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96360da0-4c29-444a-a0d5-dc292af5d0e1 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:16.954875 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96360da0-4c29-444a-a0d5-dc292af5d0e1 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:16.955766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96360da0-4c29-444a-a0d5-dc292af5d0e1 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:16.956475 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96360da0-4c29-444a-a0d5-dc292af5d0e1 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:16.961054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-969919de-e755-4917-954f-776a9db9d8a3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Getting quotas for user 1b4b5f0c43074932a8963727adfee38a and project 446a33968038476fbc98fc0b6b1795c0. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:41:16.980417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-969919de-e755-4917-954f-776a9db9d8a3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:41:16.983268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-969919de-e755-4917-954f-776a9db9d8a3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:41:17.102124 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-969919de-e755-4917-954f-776a9db9d8a3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.575044 Oct 05 02:41:17.103576 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1576/3135] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:41:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:41:17.109161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-14fcb488-3419-46c1-b61e-bf36db558851 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:17.110204 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-14fcb488-3419-46c1-b61e-bf36db558851 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] [instance: 95b81895-54ff-41fe-a3db-1343ad91dec9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:17.121780 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14fcb488-3419-46c1-b61e-bf36db558851 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:17.122508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14fcb488-3419-46c1-b61e-bf36db558851 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:17.135392 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14fcb488-3419-46c1-b61e-bf36db558851 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:17.139916 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14fcb488-3419-46c1-b61e-bf36db558851 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:17.141114 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14fcb488-3419-46c1-b61e-bf36db558851 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:17.142658 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14fcb488-3419-46c1-b61e-bf36db558851 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:17.215719 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-96360da0-4c29-444a-a0d5-dc292af5d0e1 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:17.224937 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-96360da0-4c29-444a-a0d5-dc292af5d0e1 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1362 microversion: 2.1 time: 0.293206 Oct 05 02:41:17.228569 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1560/3136] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:16 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1362 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:17.236555 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ffa4d84e-5477-423f-b72f-adaa627248a1 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:17.250707 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ffa4d84e-5477-423f-b72f-adaa627248a1 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:17.565277 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ffa4d84e-5477-423f-b72f-adaa627248a1 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:17.586780 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ffa4d84e-5477-423f-b72f-adaa627248a1 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1279 microversion: 2.1 time: 0.356792 Oct 05 02:41:17.588513 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1561/3137] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:17 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1279 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:17.745737 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-14fcb488-3419-46c1-b61e-bf36db558851 tempest-ServersOnMultiNodesTest-1580774238 tempest-ServersOnMultiNodesTest-1580774238-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9" status: 200 len: 1618 microversion: 2.1 time: 0.640424 Oct 05 02:41:17.749493 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1577/3138] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:17 2022] GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9 => generated 1618 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:17.779181 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-41c9fb3c-8dc5-4b4a-b8b8-b78878097801 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:17.779721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-41c9fb3c-8dc5-4b4a-b8b8-b78878097801 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 95b81895-54ff-41fe-a3db-1343ad91dec9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:17.807736 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41c9fb3c-8dc5-4b4a-b8b8-b78878097801 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:17.808233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41c9fb3c-8dc5-4b4a-b8b8-b78878097801 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:17.810400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41c9fb3c-8dc5-4b4a-b8b8-b78878097801 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:17.811167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41c9fb3c-8dc5-4b4a-b8b8-b78878097801 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:17.814892 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41c9fb3c-8dc5-4b4a-b8b8-b78878097801 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:17.815352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41c9fb3c-8dc5-4b4a-b8b8-b78878097801 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:17.889351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-41c9fb3c-8dc5-4b4a-b8b8-b78878097801 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 95b81895-54ff-41fe-a3db-1343ad91dec9] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:41:17.964109 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-afa2bd58-27f7-498f-ba2f-bb4b6f7af165 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:17.965341 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-afa2bd58-27f7-498f-ba2f-bb4b6f7af165 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:17.995205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afa2bd58-27f7-498f-ba2f-bb4b6f7af165 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:17.995737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afa2bd58-27f7-498f-ba2f-bb4b6f7af165 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:17.996184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afa2bd58-27f7-498f-ba2f-bb4b6f7af165 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:17.996969 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afa2bd58-27f7-498f-ba2f-bb4b6f7af165 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:17.997398 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afa2bd58-27f7-498f-ba2f-bb4b6f7af165 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:17.997827 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afa2bd58-27f7-498f-ba2f-bb4b6f7af165 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:18.148857 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-41c9fb3c-8dc5-4b4a-b8b8-b78878097801 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "DELETE /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9" status: 204 len: 0 microversion: 2.1 time: 0.374020 Oct 05 02:41:18.152535 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1562/3139] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:41:17 2022] DELETE /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:41:18.170885 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c5ecb9dc-c568-4522-92c0-60c98b07b3ed tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:18.171786 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c5ecb9dc-c568-4522-92c0-60c98b07b3ed tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 95b81895-54ff-41fe-a3db-1343ad91dec9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:18.186101 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5ecb9dc-c568-4522-92c0-60c98b07b3ed tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:18.186693 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5ecb9dc-c568-4522-92c0-60c98b07b3ed tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:18.192358 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5ecb9dc-c568-4522-92c0-60c98b07b3ed tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:18.193272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5ecb9dc-c568-4522-92c0-60c98b07b3ed tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:18.198396 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5ecb9dc-c568-4522-92c0-60c98b07b3ed tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:18.198894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5ecb9dc-c568-4522-92c0-60c98b07b3ed tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:18.229257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-afa2bd58-27f7-498f-ba2f-bb4b6f7af165 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:18.237586 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-afa2bd58-27f7-498f-ba2f-bb4b6f7af165 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1514 microversion: 2.1 time: 0.287578 Oct 05 02:41:18.253445 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1578/3140] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:17 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1514 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:18.295122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4a92d380-4c14-47fb-b656-8ee0abaf182d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:18.318780 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4a92d380-4c14-47fb-b656-8ee0abaf182d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:18.360091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a92d380-4c14-47fb-b656-8ee0abaf182d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:18.361320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a92d380-4c14-47fb-b656-8ee0abaf182d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:18.362517 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a92d380-4c14-47fb-b656-8ee0abaf182d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:18.364248 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a92d380-4c14-47fb-b656-8ee0abaf182d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:18.365105 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a92d380-4c14-47fb-b656-8ee0abaf182d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:18.365945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a92d380-4c14-47fb-b656-8ee0abaf182d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:19.019179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c5ecb9dc-c568-4522-92c0-60c98b07b3ed tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:19.035655 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c5ecb9dc-c568-4522-92c0-60c98b07b3ed tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9" status: 200 len: 1473 microversion: 2.1 time: 0.876936 Oct 05 02:41:19.036250 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1563/3141] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:18 2022] GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9 => generated 1473 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:19.041187 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-bb5f77ff-319f-47b1-956c-613f5836deeb req-61cb9afe-6881-489e-97fc-f3eeead5526d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d47438b-a5f5-4dfb-a134-c5cd6dc5a397", "tag": "700b091a-5ee8-4bb5-86f1-61a41c2ee276"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:41:19.065935 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-bb5f77ff-319f-47b1-956c-613f5836deeb req-61cb9afe-6881-489e-97fc-f3eeead5526d service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:19.067028 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-bb5f77ff-319f-47b1-956c-613f5836deeb req-61cb9afe-6881-489e-97fc-f3eeead5526d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:19.067865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-bb5f77ff-319f-47b1-956c-613f5836deeb req-61cb9afe-6881-489e-97fc-f3eeead5526d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:19.092859 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-bb5f77ff-319f-47b1-956c-613f5836deeb req-61cb9afe-6881-489e-97fc-f3eeead5526d service nova] Creating event network-changed:700b091a-5ee8-4bb5-86f1-61a41c2ee276 for instance 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 on n-h2-858272-3 Oct 05 02:41:19.098482 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-bb5f77ff-319f-47b1-956c-613f5836deeb req-61cb9afe-6881-489e-97fc-f3eeead5526d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060720 Oct 05 02:41:19.105762 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1564/3142] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:41:19.111242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-57b231b5-0cca-4cdf-a378-b692253b322e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:19.114461 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-57b231b5-0cca-4cdf-a378-b692253b322e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:19.123471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-57b231b5-0cca-4cdf-a378-b692253b322e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:19.124411 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-57b231b5-0cca-4cdf-a378-b692253b322e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:19.125579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-57b231b5-0cca-4cdf-a378-b692253b322e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:19.126510 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-57b231b5-0cca-4cdf-a378-b692253b322e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:19.127162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-57b231b5-0cca-4cdf-a378-b692253b322e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:19.127776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-57b231b5-0cca-4cdf-a378-b692253b322e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:19.153258 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4a92d380-4c14-47fb-b656-8ee0abaf182d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:19.165899 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4a92d380-4c14-47fb-b656-8ee0abaf182d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1362 microversion: 2.1 time: 0.908623 Oct 05 02:41:19.168037 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1579/3143] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:18 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1362 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:19.257160 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-57b231b5-0cca-4cdf-a378-b692253b322e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:19.271266 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-57b231b5-0cca-4cdf-a378-b692253b322e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1331 microversion: 2.1 time: 0.163969 Oct 05 02:41:19.271972 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1565/3144] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:19 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1331 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:19.276853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-23f359bf-70dc-4839-824f-02e03eacaa8e tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:19.279454 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-23f359bf-70dc-4839-824f-02e03eacaa8e tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:19.290145 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23f359bf-70dc-4839-824f-02e03eacaa8e tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:19.291526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23f359bf-70dc-4839-824f-02e03eacaa8e tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:19.292201 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23f359bf-70dc-4839-824f-02e03eacaa8e tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:19.295068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23f359bf-70dc-4839-824f-02e03eacaa8e tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:19.296175 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23f359bf-70dc-4839-824f-02e03eacaa8e tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:19.297113 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23f359bf-70dc-4839-824f-02e03eacaa8e tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:19.749967 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-23f359bf-70dc-4839-824f-02e03eacaa8e tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:19.762577 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-23f359bf-70dc-4839-824f-02e03eacaa8e tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1514 microversion: 2.1 time: 0.493454 Oct 05 02:41:19.781860 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1580/3145] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:19 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1514 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:41:20.065174 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7ca7c707-e7cf-41ab-9ef4-f26b76253bb5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:20.065728 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7ca7c707-e7cf-41ab-9ef4-f26b76253bb5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 95b81895-54ff-41fe-a3db-1343ad91dec9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:20.080932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ca7c707-e7cf-41ab-9ef4-f26b76253bb5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:20.081450 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ca7c707-e7cf-41ab-9ef4-f26b76253bb5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:20.083061 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ca7c707-e7cf-41ab-9ef4-f26b76253bb5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:20.085543 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ca7c707-e7cf-41ab-9ef4-f26b76253bb5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:20.087224 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ca7c707-e7cf-41ab-9ef4-f26b76253bb5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:20.087858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ca7c707-e7cf-41ab-9ef4-f26b76253bb5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:20.194751 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-81419575-969a-4abd-8636-7db412fb1d6c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:20.195375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-81419575-969a-4abd-8636-7db412fb1d6c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:20.202668 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81419575-969a-4abd-8636-7db412fb1d6c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:20.209084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81419575-969a-4abd-8636-7db412fb1d6c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:20.209719 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81419575-969a-4abd-8636-7db412fb1d6c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:20.212292 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81419575-969a-4abd-8636-7db412fb1d6c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:20.212961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81419575-969a-4abd-8636-7db412fb1d6c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:20.214544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81419575-969a-4abd-8636-7db412fb1d6c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:20.970071 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-81419575-969a-4abd-8636-7db412fb1d6c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:20.990282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7ca7c707-e7cf-41ab-9ef4-f26b76253bb5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:20.993847 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-81419575-969a-4abd-8636-7db412fb1d6c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1362 microversion: 2.1 time: 0.788817 Oct 05 02:41:20.994747 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1581/3146] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:20 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1362 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:41:20.999491 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7ca7c707-e7cf-41ab-9ef4-f26b76253bb5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9" status: 200 len: 1473 microversion: 2.1 time: 0.939553 Oct 05 02:41:21.000076 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1566/3147] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:20 2022] GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9 => generated 1473 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:21.007003 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-460ccc23-da52-49a1-8d82-23e633769ee4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:21.007622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-460ccc23-da52-49a1-8d82-23e633769ee4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:21.019474 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c4434d0b-ae01-44e9-904f-9a6d9e49a207 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:21.020475 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c4434d0b-ae01-44e9-904f-9a6d9e49a207 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:21.025559 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-460ccc23-da52-49a1-8d82-23e633769ee4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:21.026084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-460ccc23-da52-49a1-8d82-23e633769ee4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:21.026515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-460ccc23-da52-49a1-8d82-23e633769ee4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:21.027214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-460ccc23-da52-49a1-8d82-23e633769ee4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:21.029483 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-460ccc23-da52-49a1-8d82-23e633769ee4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:21.031236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4434d0b-ae01-44e9-904f-9a6d9e49a207 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:21.031959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-460ccc23-da52-49a1-8d82-23e633769ee4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:21.032646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4434d0b-ae01-44e9-904f-9a6d9e49a207 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:21.039401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4434d0b-ae01-44e9-904f-9a6d9e49a207 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:21.040604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4434d0b-ae01-44e9-904f-9a6d9e49a207 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:21.041281 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4434d0b-ae01-44e9-904f-9a6d9e49a207 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:21.041903 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4434d0b-ae01-44e9-904f-9a6d9e49a207 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:21.231514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c4434d0b-ae01-44e9-904f-9a6d9e49a207 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:21.240726 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c4434d0b-ae01-44e9-904f-9a6d9e49a207 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1337 microversion: 2.1 time: 0.239582 Oct 05 02:41:21.241345 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1567/3148] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:21 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1337 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:21.456806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-460ccc23-da52-49a1-8d82-23e633769ee4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:21.478268 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-460ccc23-da52-49a1-8d82-23e633769ee4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1514 microversion: 2.1 time: 0.474980 Oct 05 02:41:21.479693 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1582/3149] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:21 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1514 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:21.837556 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-5bcc430e-8ace-44d2-a746-e322110c346c req-ef0efc6d-7ef5-4542-b22d-b77537fd1d8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b81895-54ff-41fe-a3db-1343ad91dec9", "name": "network-vif-deleted", "tag": "a923990c-25c7-4fef-8fc1-ab024718a92a"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:41:21.887525 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5bcc430e-8ace-44d2-a746-e322110c346c req-ef0efc6d-7ef5-4542-b22d-b77537fd1d8d service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:21.888598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5bcc430e-8ace-44d2-a746-e322110c346c req-ef0efc6d-7ef5-4542-b22d-b77537fd1d8d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:21.889206 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5bcc430e-8ace-44d2-a746-e322110c346c req-ef0efc6d-7ef5-4542-b22d-b77537fd1d8d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:21.904161 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-5bcc430e-8ace-44d2-a746-e322110c346c req-ef0efc6d-7ef5-4542-b22d-b77537fd1d8d service nova] Creating event network-vif-deleted:a923990c-25c7-4fef-8fc1-ab024718a92a for instance 95b81895-54ff-41fe-a3db-1343ad91dec9 on n-h1-858272-3 Oct 05 02:41:21.911218 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-5bcc430e-8ace-44d2-a746-e322110c346c req-ef0efc6d-7ef5-4542-b22d-b77537fd1d8d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082908 Oct 05 02:41:21.917072 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1568/3150] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:41:22.028438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d1236e81-e308-4d68-ad01-b4f583d0a56f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:22.030516 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ce97c318-b363-4b96-b456-bafcfb97b524 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:22.031452 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d1236e81-e308-4d68-ad01-b4f583d0a56f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:22.045153 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ce97c318-b363-4b96-b456-bafcfb97b524 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 95b81895-54ff-41fe-a3db-1343ad91dec9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:22.060553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1236e81-e308-4d68-ad01-b4f583d0a56f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:22.064186 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce97c318-b363-4b96-b456-bafcfb97b524 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:22.065137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce97c318-b363-4b96-b456-bafcfb97b524 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:22.065759 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1236e81-e308-4d68-ad01-b4f583d0a56f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:22.066071 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce97c318-b363-4b96-b456-bafcfb97b524 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:22.066725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1236e81-e308-4d68-ad01-b4f583d0a56f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:22.067368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1236e81-e308-4d68-ad01-b4f583d0a56f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:22.067789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce97c318-b363-4b96-b456-bafcfb97b524 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:22.068018 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1236e81-e308-4d68-ad01-b4f583d0a56f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:22.068452 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1236e81-e308-4d68-ad01-b4f583d0a56f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:22.068763 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce97c318-b363-4b96-b456-bafcfb97b524 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:22.069378 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce97c318-b363-4b96-b456-bafcfb97b524 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:22.148608 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce97c318-b363-4b96-b456-bafcfb97b524 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:22.150416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce97c318-b363-4b96-b456-bafcfb97b524 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:22.151043 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce97c318-b363-4b96-b456-bafcfb97b524 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:22.151688 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-ce97c318-b363-4b96-b456-bafcfb97b524 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lazy-loading 'fault' on Instance uuid 95b81895-54ff-41fe-a3db-1343ad91dec9 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:41:22.332581 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ce97c318-b363-4b96-b456-bafcfb97b524 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:22.354146 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ce97c318-b363-4b96-b456-bafcfb97b524 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9" status: 200 len: 1307 microversion: 2.1 time: 0.325331 Oct 05 02:41:22.356160 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1569/3151] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:22 2022] GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9 => generated 1307 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:22.366819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a5ad018d-7125-4634-b461-b1effcfbc9d3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:22.367463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a5ad018d-7125-4634-b461-b1effcfbc9d3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:22.385672 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5ad018d-7125-4634-b461-b1effcfbc9d3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:22.389426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5ad018d-7125-4634-b461-b1effcfbc9d3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:22.390154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5ad018d-7125-4634-b461-b1effcfbc9d3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:22.400067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5ad018d-7125-4634-b461-b1effcfbc9d3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:22.400067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5ad018d-7125-4634-b461-b1effcfbc9d3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:22.409463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5ad018d-7125-4634-b461-b1effcfbc9d3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:22.711601 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d1236e81-e308-4d68-ad01-b4f583d0a56f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:22.726924 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d1236e81-e308-4d68-ad01-b4f583d0a56f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1362 microversion: 2.1 time: 0.710003 Oct 05 02:41:22.728998 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1583/3152] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:22 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1362 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:22.739639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d4bb011b-c858-4c43-b4ca-f64983f57e7e tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:22.740264 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d4bb011b-c858-4c43-b4ca-f64983f57e7e tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:22.766893 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4bb011b-c858-4c43-b4ca-f64983f57e7e tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:22.767391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4bb011b-c858-4c43-b4ca-f64983f57e7e tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:22.767825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4bb011b-c858-4c43-b4ca-f64983f57e7e tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:22.768528 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4bb011b-c858-4c43-b4ca-f64983f57e7e tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:22.769065 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4bb011b-c858-4c43-b4ca-f64983f57e7e tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:22.770102 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4bb011b-c858-4c43-b4ca-f64983f57e7e tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:22.796555 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a5ad018d-7125-4634-b461-b1effcfbc9d3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:22.806732 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a5ad018d-7125-4634-b461-b1effcfbc9d3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1379 microversion: 2.1 time: 0.447534 Oct 05 02:41:22.808354 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1570/3153] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:22 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1379 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:23.142753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d4bb011b-c858-4c43-b4ca-f64983f57e7e tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:23.151051 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d4bb011b-c858-4c43-b4ca-f64983f57e7e tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1514 microversion: 2.1 time: 0.420911 Oct 05 02:41:23.166778 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1584/3154] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:22 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1514 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:23.379098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b22a0d0a-4676-4d77-ba7f-b94d53d0aaba tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:23.380022 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b22a0d0a-4676-4d77-ba7f-b94d53d0aaba tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 95b81895-54ff-41fe-a3db-1343ad91dec9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:23.384888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:23.405857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b22a0d0a-4676-4d77-ba7f-b94d53d0aaba tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:23.406385 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b22a0d0a-4676-4d77-ba7f-b94d53d0aaba tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:23.407081 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b22a0d0a-4676-4d77-ba7f-b94d53d0aaba tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:23.407832 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b22a0d0a-4676-4d77-ba7f-b94d53d0aaba tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:23.408299 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b22a0d0a-4676-4d77-ba7f-b94d53d0aaba tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:23.408750 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b22a0d0a-4676-4d77-ba7f-b94d53d0aaba tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:23.433707 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4e88356b-35c2-45be-acb9-64ea9c0e807e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'create', calling method: .version_select at 0x7fccdf302940>, body: {"keypair": {"name": "tempest-keypair-1513811679", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCeE7WxCsGBHIiirFgvM8CdFLLTR0NAmZq4oWl0WOvF/3wlu0BHyYsdliAX+E8zYsXpSZgCWrTd+XRCVrA0lztiAOBt3lC3s8RqIj6PfphZ3rzCuFtxNhc+3w1W93GDi2g=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:41:23.461303 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-b22a0d0a-4676-4d77-ba7f-b94d53d0aaba tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] HTTP exception thrown: Instance 95b81895-54ff-41fe-a3db-1343ad91dec9 could not be found. Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b22a0d0a-4676-4d77-ba7f-b94d53d0aaba tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Request method failure captured: Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9 HTTP/1.1 Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO3rxm78ro_lNid6Y0mfn-jyk6yAO5lWqW8Lr16wE4MCHagKAeauvptfZCvHaJ-6doq4nQv84xoFEpGRxvpNSA8Zrv8qJa_I5PWdE0F_gyAXlJijeV0AOJD3fyv6ynFZOJHx-riqsCQLfbqmpKoB-zpHICxlYmWXXCF5clocFvQOwXs Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: f5a44c2cd99949c2a30ab83bdede01e6 Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersOnMultiNodesTest-1239008232 Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5a44c2cd99949c2a30ab83bdede01e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5a44c2cd99949c2a30ab83bdede01e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f5a44c2cd99949c2a30ab83bdede01e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f5a44c2cd99949c2a30ab83bdede01e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersOnMultiNodesTest-1239008232 Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: f5a44c2cd99949c2a30ab83bdede01e6 Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1239008232 Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersOnMultiNodesTest-1239008232-project Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: b86e3b7d1c9a4b2c8f2914beefa74cc1 Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersOnMultiNodesTest-1239008232-project Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 95b81895-54ff-41fe-a3db-1343ad91dec9 could not be found. Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '95b81895-54ff-41fe-a3db-1343ad91dec9'} Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95b81895-54ff-41fe-a3db-1343ad91dec9 could not be found. Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95b81895-54ff-41fe-a3db-1343ad91dec9 could not be found. Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:41:23.465873 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:23.471180 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:41:23.471180 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:41:23.471180 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:41:23.471180 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:41:23.471180 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:41:23.471180 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95b81895-54ff-41fe-a3db-1343ad91dec9 could not be found. Oct 05 02:41:23.471180 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:23.471180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b22a0d0a-4676-4d77-ba7f-b94d53d0aaba tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Returning 404 to user: Instance 95b81895-54ff-41fe-a3db-1343ad91dec9 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:41:23.471180 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b22a0d0a-4676-4d77-ba7f-b94d53d0aaba tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9" status: 404 len: 111 microversion: 2.1 time: 0.093594 Oct 05 02:41:23.476188 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-4e88356b-35c2-45be-acb9-64ea9c0e807e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Getting quotas for project 1ff63adf9571439d8f8bf9b0fa6c63f9. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:41:23.478188 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1585/3155] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:23 2022] GET /compute/v2.1/servers/95b81895-54ff-41fe-a3db-1343ad91dec9 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:41:23.490583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d5ff9ef9-6e75-4408-ad09-366a68ebffbe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:23.492137 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d5ff9ef9-6e75-4408-ad09-366a68ebffbe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:23.495588 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-4e88356b-35c2-45be-acb9-64ea9c0e807e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Getting quotas for user 728544ca5e164540b3c5395534542955 and project 1ff63adf9571439d8f8bf9b0fa6c63f9. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:41:23.510126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5ff9ef9-6e75-4408-ad09-366a68ebffbe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:23.510630 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5ff9ef9-6e75-4408-ad09-366a68ebffbe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:23.511275 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5ff9ef9-6e75-4408-ad09-366a68ebffbe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:23.512683 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5ff9ef9-6e75-4408-ad09-366a68ebffbe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:23.515273 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5ff9ef9-6e75-4408-ad09-366a68ebffbe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:23.516138 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5ff9ef9-6e75-4408-ad09-366a68ebffbe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:23.571651 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:23.586361 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4e88356b-35c2-45be-acb9-64ea9c0e807e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.438911 Oct 05 02:41:23.593394 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1571/3156] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 02:41:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:41:23.622534 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d5ff9ef9-6e75-4408-ad09-366a68ebffbe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:41:23.763027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bf1c83c9-0d20-4b28-af3d-b37572246ed8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:23.769083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bf1c83c9-0d20-4b28-af3d-b37572246ed8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:23.804499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf1c83c9-0d20-4b28-af3d-b37572246ed8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:23.807408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf1c83c9-0d20-4b28-af3d-b37572246ed8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:23.808157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf1c83c9-0d20-4b28-af3d-b37572246ed8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:23.810432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf1c83c9-0d20-4b28-af3d-b37572246ed8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:23.811448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf1c83c9-0d20-4b28-af3d-b37572246ed8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:23.812673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf1c83c9-0d20-4b28-af3d-b37572246ed8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:23.833750 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d5ff9ef9-6e75-4408-ad09-366a68ebffbe tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "DELETE /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b" status: 204 len: 0 microversion: 2.1 time: 0.351608 Oct 05 02:41:23.835185 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1586/3157] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:41:23 2022] DELETE /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:41:23.850847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1702776f-01a2-4fd0-86fb-bd058d8eaaff tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:23.851635 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1702776f-01a2-4fd0-86fb-bd058d8eaaff tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:23.870138 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1702776f-01a2-4fd0-86fb-bd058d8eaaff tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:23.870822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1702776f-01a2-4fd0-86fb-bd058d8eaaff tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:23.871373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1702776f-01a2-4fd0-86fb-bd058d8eaaff tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:23.874461 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1702776f-01a2-4fd0-86fb-bd058d8eaaff tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:23.876028 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1702776f-01a2-4fd0-86fb-bd058d8eaaff tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:23.876684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1702776f-01a2-4fd0-86fb-bd058d8eaaff tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:24.306046 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1702776f-01a2-4fd0-86fb-bd058d8eaaff tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:24.324320 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1702776f-01a2-4fd0-86fb-bd058d8eaaff tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1379 microversion: 2.1 time: 0.485760 Oct 05 02:41:24.325199 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1587/3158] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:23 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1379 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:24.330267 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9c48c94d-abcf-44d0-9ba6-98b6420ef255 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:24.331156 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9c48c94d-abcf-44d0-9ba6-98b6420ef255 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:24.348494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9c48c94d-abcf-44d0-9ba6-98b6420ef255 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:24.349211 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9c48c94d-abcf-44d0-9ba6-98b6420ef255 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:24.349817 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9c48c94d-abcf-44d0-9ba6-98b6420ef255 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:24.350701 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9c48c94d-abcf-44d0-9ba6-98b6420ef255 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:24.351317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9c48c94d-abcf-44d0-9ba6-98b6420ef255 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:24.352004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9c48c94d-abcf-44d0-9ba6-98b6420ef255 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:24.381349 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bf1c83c9-0d20-4b28-af3d-b37572246ed8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:24.390399 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bf1c83c9-0d20-4b28-af3d-b37572246ed8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1362 microversion: 2.1 time: 0.643447 Oct 05 02:41:24.409447 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1572/3159] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:23 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1362 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:24.431322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3ca5d478-325c-4b3e-88d2-f2f40aa388d2 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:24.439566 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3ca5d478-325c-4b3e-88d2-f2f40aa388d2 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:24.489810 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3ca5d478-325c-4b3e-88d2-f2f40aa388d2 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:24.491055 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3ca5d478-325c-4b3e-88d2-f2f40aa388d2 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:24.494741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3ca5d478-325c-4b3e-88d2-f2f40aa388d2 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:24.498232 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3ca5d478-325c-4b3e-88d2-f2f40aa388d2 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:24.510505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3ca5d478-325c-4b3e-88d2-f2f40aa388d2 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:24.513194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3ca5d478-325c-4b3e-88d2-f2f40aa388d2 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:24.906898 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9c48c94d-abcf-44d0-9ba6-98b6420ef255 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:24.916213 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9c48c94d-abcf-44d0-9ba6-98b6420ef255 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b" status: 200 len: 1472 microversion: 2.1 time: 0.589803 Oct 05 02:41:24.919767 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1588/3160] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:24 2022] GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b => generated 1472 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:24.954590 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3ca5d478-325c-4b3e-88d2-f2f40aa388d2 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:24.964652 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3ca5d478-325c-4b3e-88d2-f2f40aa388d2 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1514 microversion: 2.1 time: 0.548141 Oct 05 02:41:24.965286 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1573/3161] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:24 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1514 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:25.351275 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d6688f30-c9b5-4be4-a684-c420203d154b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:25.351906 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d6688f30-c9b5-4be4-a684-c420203d154b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:25.382025 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d6688f30-c9b5-4be4-a684-c420203d154b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:25.382652 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d6688f30-c9b5-4be4-a684-c420203d154b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:25.383108 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d6688f30-c9b5-4be4-a684-c420203d154b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:25.384578 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d6688f30-c9b5-4be4-a684-c420203d154b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:25.385096 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d6688f30-c9b5-4be4-a684-c420203d154b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:25.385533 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d6688f30-c9b5-4be4-a684-c420203d154b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:25.418506 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8acc556d-d894-4372-8cef-e27e5e5a19b0 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:25.419293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8acc556d-d894-4372-8cef-e27e5e5a19b0 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:25.435101 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8acc556d-d894-4372-8cef-e27e5e5a19b0 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:25.436606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8acc556d-d894-4372-8cef-e27e5e5a19b0 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:25.437888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8acc556d-d894-4372-8cef-e27e5e5a19b0 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:25.439984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8acc556d-d894-4372-8cef-e27e5e5a19b0 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:25.443884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8acc556d-d894-4372-8cef-e27e5e5a19b0 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:25.444656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8acc556d-d894-4372-8cef-e27e5e5a19b0 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:26.368973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d6688f30-c9b5-4be4-a684-c420203d154b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:26.380472 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d6688f30-c9b5-4be4-a684-c420203d154b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1379 microversion: 2.1 time: 1.033929 Oct 05 02:41:26.400323 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1589/3162] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:25 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1379 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:26.405380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-bbe657d3-88ea-490e-9330-937c74f9c403 req-cc4eeec5-c0d3-444b-a49a-5704f1f3a32a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1b41d44-1201-460a-b938-7a70567656cd", "tag": "99ce69bd-430b-41c6-a998-33a5e643493b"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:41:26.442276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-bbe657d3-88ea-490e-9330-937c74f9c403 req-cc4eeec5-c0d3-444b-a49a-5704f1f3a32a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:26.442766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-bbe657d3-88ea-490e-9330-937c74f9c403 req-cc4eeec5-c0d3-444b-a49a-5704f1f3a32a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:26.443192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-bbe657d3-88ea-490e-9330-937c74f9c403 req-cc4eeec5-c0d3-444b-a49a-5704f1f3a32a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:26.460756 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:26.485569 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-bbe657d3-88ea-490e-9330-937c74f9c403 req-cc4eeec5-c0d3-444b-a49a-5704f1f3a32a service nova] Creating event network-changed:99ce69bd-430b-41c6-a998-33a5e643493b for instance d1b41d44-1201-460a-b938-7a70567656cd on n-h2-858272-3 Oct 05 02:41:26.509996 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-bbe657d3-88ea-490e-9330-937c74f9c403 req-cc4eeec5-c0d3-444b-a49a-5704f1f3a32a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107795 Oct 05 02:41:26.513273 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1590/3163] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:41:26.523571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8acc556d-d894-4372-8cef-e27e5e5a19b0 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:26.532682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ac5443f9-64bf-4ff7-b933-f233e432fce1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:26.533710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ac5443f9-64bf-4ff7-b933-f233e432fce1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:26.544454 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8acc556d-d894-4372-8cef-e27e5e5a19b0 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1362 microversion: 2.1 time: 1.130834 Oct 05 02:41:26.547412 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1574/3164] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:25 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1362 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:26.557943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac5443f9-64bf-4ff7-b933-f233e432fce1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:26.558688 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac5443f9-64bf-4ff7-b933-f233e432fce1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:26.561579 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac5443f9-64bf-4ff7-b933-f233e432fce1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:26.564273 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac5443f9-64bf-4ff7-b933-f233e432fce1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:26.566299 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac5443f9-64bf-4ff7-b933-f233e432fce1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:26.566944 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dcfd3cdb-cf6a-448f-8630-6add6343900c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:26.567273 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac5443f9-64bf-4ff7-b933-f233e432fce1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:26.570051 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-dcfd3cdb-cf6a-448f-8630-6add6343900c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:26.604784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dcfd3cdb-cf6a-448f-8630-6add6343900c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:26.606472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dcfd3cdb-cf6a-448f-8630-6add6343900c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:26.607143 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dcfd3cdb-cf6a-448f-8630-6add6343900c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:26.610495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dcfd3cdb-cf6a-448f-8630-6add6343900c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:26.611319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dcfd3cdb-cf6a-448f-8630-6add6343900c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:26.613425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dcfd3cdb-cf6a-448f-8630-6add6343900c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:26.669971 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:26.926763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:26.974698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:27.086102 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ac5443f9-64bf-4ff7-b933-f233e432fce1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:27.092480 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-dcfd3cdb-cf6a-448f-8630-6add6343900c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:27.104565 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-dcfd3cdb-cf6a-448f-8630-6add6343900c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1514 microversion: 2.1 time: 0.555224 Oct 05 02:41:27.105567 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ac5443f9-64bf-4ff7-b933-f233e432fce1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b" status: 200 len: 1472 microversion: 2.1 time: 0.589541 Oct 05 02:41:27.122011 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1575/3165] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:26 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1514 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:27.122857 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1591/3166] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:26 2022] GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b => generated 1472 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:27.404513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c833405d-05f2-4b97-8fa6-d002393f8a56 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:27.406730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c833405d-05f2-4b97-8fa6-d002393f8a56 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:27.424053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c833405d-05f2-4b97-8fa6-d002393f8a56 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:27.426225 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c833405d-05f2-4b97-8fa6-d002393f8a56 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:27.429319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c833405d-05f2-4b97-8fa6-d002393f8a56 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:27.434298 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c833405d-05f2-4b97-8fa6-d002393f8a56 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:27.438208 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c833405d-05f2-4b97-8fa6-d002393f8a56 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:27.438866 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c833405d-05f2-4b97-8fa6-d002393f8a56 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:27.575681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9fe1d191-bf9b-48c9-902f-c98d1c3bec20 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:27.576749 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9fe1d191-bf9b-48c9-902f-c98d1c3bec20 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:27.594539 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9fe1d191-bf9b-48c9-902f-c98d1c3bec20 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:27.595038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9fe1d191-bf9b-48c9-902f-c98d1c3bec20 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:27.595482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9fe1d191-bf9b-48c9-902f-c98d1c3bec20 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:27.603115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9fe1d191-bf9b-48c9-902f-c98d1c3bec20 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:27.618588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9fe1d191-bf9b-48c9-902f-c98d1c3bec20 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:27.619036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9fe1d191-bf9b-48c9-902f-c98d1c3bec20 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:28.197735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c833405d-05f2-4b97-8fa6-d002393f8a56 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:28.216513 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c833405d-05f2-4b97-8fa6-d002393f8a56 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1379 microversion: 2.1 time: 0.813354 Oct 05 02:41:28.217512 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1576/3167] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:27 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1379 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:28.229946 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3c274f81-482e-4dd4-8253-70a0cd35ac34 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:28.230617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3c274f81-482e-4dd4-8253-70a0cd35ac34 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:28.251369 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c274f81-482e-4dd4-8253-70a0cd35ac34 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:28.251895 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c274f81-482e-4dd4-8253-70a0cd35ac34 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:28.252351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c274f81-482e-4dd4-8253-70a0cd35ac34 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:28.253124 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c274f81-482e-4dd4-8253-70a0cd35ac34 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:28.253756 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c274f81-482e-4dd4-8253-70a0cd35ac34 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:28.254058 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c274f81-482e-4dd4-8253-70a0cd35ac34 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:28.439526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9fe1d191-bf9b-48c9-902f-c98d1c3bec20 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:28.452412 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9fe1d191-bf9b-48c9-902f-c98d1c3bec20 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1362 microversion: 2.1 time: 0.877513 Oct 05 02:41:28.475363 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1592/3168] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:27 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1362 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:28.489696 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d98fbbd7-64e1-42c4-b71b-b45eaa3ff365 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:28.491513 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d98fbbd7-64e1-42c4-b71b-b45eaa3ff365 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:28.514550 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d98fbbd7-64e1-42c4-b71b-b45eaa3ff365 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:28.524650 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d98fbbd7-64e1-42c4-b71b-b45eaa3ff365 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:28.525664 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d98fbbd7-64e1-42c4-b71b-b45eaa3ff365 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:28.526587 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d98fbbd7-64e1-42c4-b71b-b45eaa3ff365 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:28.527058 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d98fbbd7-64e1-42c4-b71b-b45eaa3ff365 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:28.528802 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d98fbbd7-64e1-42c4-b71b-b45eaa3ff365 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:28.614154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d98fbbd7-64e1-42c4-b71b-b45eaa3ff365 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:28.615616 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d98fbbd7-64e1-42c4-b71b-b45eaa3ff365 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:28.616374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d98fbbd7-64e1-42c4-b71b-b45eaa3ff365 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:28.617078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-d98fbbd7-64e1-42c4-b71b-b45eaa3ff365 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lazy-loading 'fault' on Instance uuid 35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:41:28.730701 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d98fbbd7-64e1-42c4-b71b-b45eaa3ff365 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:28.757461 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d98fbbd7-64e1-42c4-b71b-b45eaa3ff365 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b" status: 200 len: 1306 microversion: 2.1 time: 0.280232 Oct 05 02:41:28.758476 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1593/3169] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:28 2022] GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b => generated 1306 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:28.817788 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-a60044a5-32fd-475b-b92e-bb1592dea124 req-c7356c82-3c94-4a65-83dd-fb0e6d5f82c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b", "name": "network-vif-deleted", "tag": "d2e34487-c5e1-4d23-bdc7-9bbdaa045c58"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:41:28.841865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3c274f81-482e-4dd4-8253-70a0cd35ac34 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:28.861319 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3c274f81-482e-4dd4-8253-70a0cd35ac34 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1514 microversion: 2.1 time: 0.640706 Oct 05 02:41:28.862577 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1577/3170] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:28 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1514 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:28.869047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a60044a5-32fd-475b-b92e-bb1592dea124 req-c7356c82-3c94-4a65-83dd-fb0e6d5f82c2 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:28.871214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a60044a5-32fd-475b-b92e-bb1592dea124 req-c7356c82-3c94-4a65-83dd-fb0e6d5f82c2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:28.871732 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a60044a5-32fd-475b-b92e-bb1592dea124 req-c7356c82-3c94-4a65-83dd-fb0e6d5f82c2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:28.935224 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-a60044a5-32fd-475b-b92e-bb1592dea124 req-c7356c82-3c94-4a65-83dd-fb0e6d5f82c2 service nova] Creating event network-vif-deleted:d2e34487-c5e1-4d23-bdc7-9bbdaa045c58 for instance 35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b on n-h2-858272-3 Oct 05 02:41:28.959536 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-a60044a5-32fd-475b-b92e-bb1592dea124 req-c7356c82-3c94-4a65-83dd-fb0e6d5f82c2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176978 Oct 05 02:41:28.960719 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1594/3171] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:41:29.246404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2939d3a4-9607-434a-b9e9-f20edd1ce300 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:29.247050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2939d3a4-9607-434a-b9e9-f20edd1ce300 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:29.258756 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2939d3a4-9607-434a-b9e9-f20edd1ce300 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:29.259272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2939d3a4-9607-434a-b9e9-f20edd1ce300 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:29.259722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2939d3a4-9607-434a-b9e9-f20edd1ce300 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:29.260480 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2939d3a4-9607-434a-b9e9-f20edd1ce300 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:29.262964 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2939d3a4-9607-434a-b9e9-f20edd1ce300 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:29.263672 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2939d3a4-9607-434a-b9e9-f20edd1ce300 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:29.282213 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-93c89447-0e11-476c-9d5c-a58894090d8f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1058171873", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c7ecbb9-3319-48a3-8bf2-f42adcddf7f9"}], "security_groups": [{"name": "tempest-securitygroup--1819721030"}], "key_name": "tempest-keypair-1513811679", "user_data": "}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:41:29.597153 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-93c89447-0e11-476c-9d5c-a58894090d8f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] validate_networks() for [('3c7ecbb9-3319-48a3-8bf2-f42adcddf7f9', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:41:29.790555 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2939d3a4-9607-434a-b9e9-f20edd1ce300 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:29.807860 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2939d3a4-9607-434a-b9e9-f20edd1ce300 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1379 microversion: 2.1 time: 0.569374 Oct 05 02:41:29.812080 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1578/3172] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:29 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1379 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:29.820446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-89e67973-90ab-4b0b-b9c3-4e924d349077 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:29.837243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-89e67973-90ab-4b0b-b9c3-4e924d349077 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:29.855365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-89e67973-90ab-4b0b-b9c3-4e924d349077 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:29.858037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-89e67973-90ab-4b0b-b9c3-4e924d349077 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:29.859401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-89e67973-90ab-4b0b-b9c3-4e924d349077 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:29.861177 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-89e67973-90ab-4b0b-b9c3-4e924d349077 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:29.864515 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-89e67973-90ab-4b0b-b9c3-4e924d349077 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:29.869548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-89e67973-90ab-4b0b-b9c3-4e924d349077 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:30.277344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-93c89447-0e11-476c-9d5c-a58894090d8f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:41:30.277731 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-93c89447-0e11-476c-9d5c-a58894090d8f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:41:30.278143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-93c89447-0e11-476c-9d5c-a58894090d8f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:41:30.278548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-93c89447-0e11-476c-9d5c-a58894090d8f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:41:30.279013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-93c89447-0e11-476c-9d5c-a58894090d8f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:41:30.296421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93c89447-0e11-476c-9d5c-a58894090d8f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:30.297625 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93c89447-0e11-476c-9d5c-a58894090d8f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:30.298295 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93c89447-0e11-476c-9d5c-a58894090d8f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:30.299804 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93c89447-0e11-476c-9d5c-a58894090d8f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:30.300684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93c89447-0e11-476c-9d5c-a58894090d8f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:30.301419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93c89447-0e11-476c-9d5c-a58894090d8f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:30.329020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-93c89447-0e11-476c-9d5c-a58894090d8f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Getting quotas for project 1ff63adf9571439d8f8bf9b0fa6c63f9. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:41:30.341191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-93c89447-0e11-476c-9d5c-a58894090d8f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Getting quotas for user 728544ca5e164540b3c5395534542955 and project 1ff63adf9571439d8f8bf9b0fa6c63f9. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:41:30.366049 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-89e67973-90ab-4b0b-b9c3-4e924d349077 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:30.373926 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-93c89447-0e11-476c-9d5c-a58894090d8f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:41:30.376078 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-89e67973-90ab-4b0b-b9c3-4e924d349077 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1362 microversion: 2.1 time: 0.562603 Oct 05 02:41:30.377006 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-93c89447-0e11-476c-9d5c-a58894090d8f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:41:30.393380 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1579/3173] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:29 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1362 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:30.398946 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-08c3b830-2cc0-472f-89a3-e4f9c5d13025 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:30.399954 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-08c3b830-2cc0-472f-89a3-e4f9c5d13025 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:30.407243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08c3b830-2cc0-472f-89a3-e4f9c5d13025 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:30.408173 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08c3b830-2cc0-472f-89a3-e4f9c5d13025 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:30.408850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08c3b830-2cc0-472f-89a3-e4f9c5d13025 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:30.409891 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08c3b830-2cc0-472f-89a3-e4f9c5d13025 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:30.410595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08c3b830-2cc0-472f-89a3-e4f9c5d13025 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:30.411250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08c3b830-2cc0-472f-89a3-e4f9c5d13025 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:30.449620 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08c3b830-2cc0-472f-89a3-e4f9c5d13025 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:30.450497 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08c3b830-2cc0-472f-89a3-e4f9c5d13025 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:30.451195 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08c3b830-2cc0-472f-89a3-e4f9c5d13025 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:30.451682 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-93c89447-0e11-476c-9d5c-a58894090d8f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.177579 Oct 05 02:41:30.452130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-08c3b830-2cc0-472f-89a3-e4f9c5d13025 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lazy-loading 'fault' on Instance uuid 35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:41:30.454598 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1595/3174] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:41:29 2022] POST /compute/v2.1/servers => generated 409 bytes in 1181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 02:41:30.476240 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e8993a75-ae46-4c2f-bb0c-b6b06ea002d5 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:30.477597 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e8993a75-ae46-4c2f-bb0c-b6b06ea002d5 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:30.506330 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8993a75-ae46-4c2f-bb0c-b6b06ea002d5 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:30.507622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8993a75-ae46-4c2f-bb0c-b6b06ea002d5 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:30.508717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8993a75-ae46-4c2f-bb0c-b6b06ea002d5 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:30.509704 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8993a75-ae46-4c2f-bb0c-b6b06ea002d5 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:30.510537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8993a75-ae46-4c2f-bb0c-b6b06ea002d5 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:30.511137 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8993a75-ae46-4c2f-bb0c-b6b06ea002d5 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:30.523760 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-08c3b830-2cc0-472f-89a3-e4f9c5d13025 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:30.537229 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-08c3b830-2cc0-472f-89a3-e4f9c5d13025 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b" status: 200 len: 1306 microversion: 2.1 time: 0.142137 Oct 05 02:41:30.549453 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1580/3175] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:30 2022] GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b => generated 1306 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:30.560254 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-82565c41-ccb2-43a2-a0cc-8d122a3a3d99 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:30.561579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-82565c41-ccb2-43a2-a0cc-8d122a3a3d99 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:30.675984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-82565c41-ccb2-43a2-a0cc-8d122a3a3d99 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:30.687888 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-82565c41-ccb2-43a2-a0cc-8d122a3a3d99 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1239 microversion: 2.1 time: 0.136207 Oct 05 02:41:30.688846 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1581/3176] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:30 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1239 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:30.834728 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-763c1ca2-e823-494c-ae55-89c0ae3d6968 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:30.835424 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-763c1ca2-e823-494c-ae55-89c0ae3d6968 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:30.862118 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-763c1ca2-e823-494c-ae55-89c0ae3d6968 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:30.862682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-763c1ca2-e823-494c-ae55-89c0ae3d6968 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:30.863896 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-763c1ca2-e823-494c-ae55-89c0ae3d6968 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:30.865234 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-763c1ca2-e823-494c-ae55-89c0ae3d6968 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:30.865891 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-763c1ca2-e823-494c-ae55-89c0ae3d6968 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:30.866332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-763c1ca2-e823-494c-ae55-89c0ae3d6968 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:30.969052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e8993a75-ae46-4c2f-bb0c-b6b06ea002d5 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:31.001384 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e8993a75-ae46-4c2f-bb0c-b6b06ea002d5 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1514 microversion: 2.1 time: 0.532116 Oct 05 02:41:31.002252 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1596/3177] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:30 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1514 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:31.272436 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-763c1ca2-e823-494c-ae55-89c0ae3d6968 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:31.284117 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-763c1ca2-e823-494c-ae55-89c0ae3d6968 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1379 microversion: 2.1 time: 0.455394 Oct 05 02:41:31.289458 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1582/3178] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:30 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1379 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:31.392711 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-867dc22b-7332-4f5a-ac30-59f50fb49d2f req-03dba99b-83ca-449d-bb33-fd9ec680e1ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d47438b-a5f5-4dfb-a134-c5cd6dc5a397", "name": "network-vif-plugged", "status": "completed", "tag": "700b091a-5ee8-4bb5-86f1-61a41c2ee276"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:41:31.401497 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fa1d7a92-e13c-4ae3-8917-659522632163 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:31.402122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fa1d7a92-e13c-4ae3-8917-659522632163 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:31.418567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa1d7a92-e13c-4ae3-8917-659522632163 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:31.423137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa1d7a92-e13c-4ae3-8917-659522632163 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:31.423894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa1d7a92-e13c-4ae3-8917-659522632163 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:31.425566 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa1d7a92-e13c-4ae3-8917-659522632163 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:31.426892 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa1d7a92-e13c-4ae3-8917-659522632163 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:31.430654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa1d7a92-e13c-4ae3-8917-659522632163 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:31.434415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-867dc22b-7332-4f5a-ac30-59f50fb49d2f req-03dba99b-83ca-449d-bb33-fd9ec680e1ca service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:31.438065 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-867dc22b-7332-4f5a-ac30-59f50fb49d2f req-03dba99b-83ca-449d-bb33-fd9ec680e1ca service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:31.440029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-867dc22b-7332-4f5a-ac30-59f50fb49d2f req-03dba99b-83ca-449d-bb33-fd9ec680e1ca service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:31.481659 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-867dc22b-7332-4f5a-ac30-59f50fb49d2f req-03dba99b-83ca-449d-bb33-fd9ec680e1ca service nova] Creating event network-vif-plugged:700b091a-5ee8-4bb5-86f1-61a41c2ee276 for instance 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 on n-h2-858272-3 Oct 05 02:41:31.495292 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-867dc22b-7332-4f5a-ac30-59f50fb49d2f req-03dba99b-83ca-449d-bb33-fd9ec680e1ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106476 Oct 05 02:41:31.501365 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1597/3179] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:41:31.570423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0a1de1ee-fe97-493f-a766-439c2cba2c1d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:31.572778 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0a1de1ee-fe97-493f-a766-439c2cba2c1d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:31.592704 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0a1de1ee-fe97-493f-a766-439c2cba2c1d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:31.598022 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0a1de1ee-fe97-493f-a766-439c2cba2c1d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:31.599945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0a1de1ee-fe97-493f-a766-439c2cba2c1d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:31.607672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0a1de1ee-fe97-493f-a766-439c2cba2c1d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:31.608963 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0a1de1ee-fe97-493f-a766-439c2cba2c1d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:31.611294 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0a1de1ee-fe97-493f-a766-439c2cba2c1d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:31.682269 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-0a1de1ee-fe97-493f-a766-439c2cba2c1d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] HTTP exception thrown: Instance 35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b could not be found. Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0a1de1ee-fe97-493f-a766-439c2cba2c1d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Request method failure captured: Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b HTTP/1.1 Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO3rxm78ro_lNid6Y0mfn-jyk6yAO5lWqW8Lr16wE4MCHagKAeauvptfZCvHaJ-6doq4nQv84xoFEpGRxvpNSA8Zrv8qJa_I5PWdE0F_gyAXlJijeV0AOJD3fyv6ynFZOJHx-riqsCQLfbqmpKoB-zpHICxlYmWXXCF5clocFvQOwXs Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: f5a44c2cd99949c2a30ab83bdede01e6 Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersOnMultiNodesTest-1239008232 Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5a44c2cd99949c2a30ab83bdede01e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5a44c2cd99949c2a30ab83bdede01e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f5a44c2cd99949c2a30ab83bdede01e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f5a44c2cd99949c2a30ab83bdede01e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersOnMultiNodesTest-1239008232 Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: f5a44c2cd99949c2a30ab83bdede01e6 Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1239008232 Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersOnMultiNodesTest-1239008232-project Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: b86e3b7d1c9a4b2c8f2914beefa74cc1 Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersOnMultiNodesTest-1239008232-project Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b could not be found. Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b'} Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b could not be found. Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b could not be found. Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:41:31.684175 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:31.688983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:41:31.688983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:41:31.688983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:41:31.688983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:41:31.688983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:41:31.688983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b could not be found. Oct 05 02:41:31.688983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:31.688983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0a1de1ee-fe97-493f-a766-439c2cba2c1d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Returning 404 to user: Instance 35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:41:31.688983 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0a1de1ee-fe97-493f-a766-439c2cba2c1d tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b" status: 404 len: 111 microversion: 2.1 time: 0.121901 Oct 05 02:41:31.689799 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1598/3180] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:31 2022] GET /compute/v2.1/servers/35b897d1-f37b-4ec9-9873-c3dcb8f0aa7b => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:41:31.703969 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-af935966-1396-4eea-b983-2bc7fe55c238 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:31.704475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-af935966-1396-4eea-b983-2bc7fe55c238 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 057410e8-9ca0-477a-adec-60a7f9d7832d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:31.720986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af935966-1396-4eea-b983-2bc7fe55c238 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:31.721505 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af935966-1396-4eea-b983-2bc7fe55c238 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:31.721961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af935966-1396-4eea-b983-2bc7fe55c238 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:31.723288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af935966-1396-4eea-b983-2bc7fe55c238 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:31.723977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af935966-1396-4eea-b983-2bc7fe55c238 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:31.724597 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af935966-1396-4eea-b983-2bc7fe55c238 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:31.766707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-af935966-1396-4eea-b983-2bc7fe55c238 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 057410e8-9ca0-477a-adec-60a7f9d7832d] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:41:31.773406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fa1d7a92-e13c-4ae3-8917-659522632163 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:31.785526 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fa1d7a92-e13c-4ae3-8917-659522632163 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1362 microversion: 2.1 time: 0.386881 Oct 05 02:41:31.787780 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1583/3181] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:31 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1362 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:41:31.793680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1aa59445-6e95-4496-a14a-280683887a6a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:31.794737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1aa59445-6e95-4496-a14a-280683887a6a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:31.805140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1aa59445-6e95-4496-a14a-280683887a6a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:31.806154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1aa59445-6e95-4496-a14a-280683887a6a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:31.806617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1aa59445-6e95-4496-a14a-280683887a6a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:31.807644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1aa59445-6e95-4496-a14a-280683887a6a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:31.808118 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1aa59445-6e95-4496-a14a-280683887a6a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:31.809817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1aa59445-6e95-4496-a14a-280683887a6a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:31.897443 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-af935966-1396-4eea-b983-2bc7fe55c238 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "DELETE /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d" status: 204 len: 0 microversion: 2.1 time: 0.206583 Oct 05 02:41:31.901912 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1599/3182] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:41:31 2022] DELETE /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 02:41:31.909717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0e63efd5-c8e0-4d38-80f5-029cd5cbba3a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:31.911067 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0e63efd5-c8e0-4d38-80f5-029cd5cbba3a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 057410e8-9ca0-477a-adec-60a7f9d7832d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:31.917815 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e63efd5-c8e0-4d38-80f5-029cd5cbba3a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:31.918368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e63efd5-c8e0-4d38-80f5-029cd5cbba3a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:31.918816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e63efd5-c8e0-4d38-80f5-029cd5cbba3a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:31.919526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e63efd5-c8e0-4d38-80f5-029cd5cbba3a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:31.920037 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e63efd5-c8e0-4d38-80f5-029cd5cbba3a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:31.920473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e63efd5-c8e0-4d38-80f5-029cd5cbba3a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:32.051986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1aa59445-6e95-4496-a14a-280683887a6a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:32.062757 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1aa59445-6e95-4496-a14a-280683887a6a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1243 microversion: 2.1 time: 0.273788 Oct 05 02:41:32.063750 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1584/3183] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:31 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1243 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:32.072793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5817c7f6-cf2e-4883-9827-8263d08f845f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:32.073710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5817c7f6-cf2e-4883-9827-8263d08f845f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:32.084170 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5817c7f6-cf2e-4883-9827-8263d08f845f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:32.084765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5817c7f6-cf2e-4883-9827-8263d08f845f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:32.085318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5817c7f6-cf2e-4883-9827-8263d08f845f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:32.086105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5817c7f6-cf2e-4883-9827-8263d08f845f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:32.086645 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5817c7f6-cf2e-4883-9827-8263d08f845f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:32.087147 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5817c7f6-cf2e-4883-9827-8263d08f845f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:32.295887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0e63efd5-c8e0-4d38-80f5-029cd5cbba3a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:32.312367 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0e63efd5-c8e0-4d38-80f5-029cd5cbba3a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d" status: 200 len: 1473 microversion: 2.1 time: 0.407957 Oct 05 02:41:32.315404 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1600/3184] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:31 2022] GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d => generated 1473 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:32.337328 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e033c2b0-8ef9-4c7b-9d4b-6b570d010e8d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:32.338551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e033c2b0-8ef9-4c7b-9d4b-6b570d010e8d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:32.353930 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e033c2b0-8ef9-4c7b-9d4b-6b570d010e8d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:32.356123 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e033c2b0-8ef9-4c7b-9d4b-6b570d010e8d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:32.356570 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e033c2b0-8ef9-4c7b-9d4b-6b570d010e8d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:32.357325 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e033c2b0-8ef9-4c7b-9d4b-6b570d010e8d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:32.357784 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e033c2b0-8ef9-4c7b-9d4b-6b570d010e8d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:32.361227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e033c2b0-8ef9-4c7b-9d4b-6b570d010e8d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:32.719182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5817c7f6-cf2e-4883-9827-8263d08f845f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:32.748436 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5817c7f6-cf2e-4883-9827-8263d08f845f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1514 microversion: 2.1 time: 0.683336 Oct 05 02:41:32.749734 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1585/3185] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:32 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1514 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:32.780159 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e033c2b0-8ef9-4c7b-9d4b-6b570d010e8d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:32.792075 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e033c2b0-8ef9-4c7b-9d4b-6b570d010e8d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1379 microversion: 2.1 time: 0.473268 Oct 05 02:41:32.793705 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1601/3186] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:32 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1379 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:32.818009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6046f011-f723-4390-a5c9-2d6dcabef215 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:32.819084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6046f011-f723-4390-a5c9-2d6dcabef215 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:32.826865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6046f011-f723-4390-a5c9-2d6dcabef215 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:32.827624 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6046f011-f723-4390-a5c9-2d6dcabef215 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:32.828618 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6046f011-f723-4390-a5c9-2d6dcabef215 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:32.829694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6046f011-f723-4390-a5c9-2d6dcabef215 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:32.830631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6046f011-f723-4390-a5c9-2d6dcabef215 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:32.831225 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6046f011-f723-4390-a5c9-2d6dcabef215 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:33.008712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6046f011-f723-4390-a5c9-2d6dcabef215 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:33.022378 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6046f011-f723-4390-a5c9-2d6dcabef215 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1362 microversion: 2.1 time: 0.207431 Oct 05 02:41:33.023328 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1586/3187] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:32 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:33.088529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-560f4eaf-6993-4e5e-b307-c3871b633dce tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:33.089332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-560f4eaf-6993-4e5e-b307-c3871b633dce tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:33.101474 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-560f4eaf-6993-4e5e-b307-c3871b633dce tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:33.101976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-560f4eaf-6993-4e5e-b307-c3871b633dce tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:33.102418 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-560f4eaf-6993-4e5e-b307-c3871b633dce tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:33.103128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-560f4eaf-6993-4e5e-b307-c3871b633dce tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:33.103590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-560f4eaf-6993-4e5e-b307-c3871b633dce tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:33.104013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-560f4eaf-6993-4e5e-b307-c3871b633dce tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:33.233683 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-560f4eaf-6993-4e5e-b307-c3871b633dce tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:33.247072 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-560f4eaf-6993-4e5e-b307-c3871b633dce tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1299 microversion: 2.1 time: 0.162732 Oct 05 02:41:33.247676 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1602/3188] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:33 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1299 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:33.341024 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2ffc354b-279b-4ddc-8bf4-af71b80cbaae tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:33.342089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2ffc354b-279b-4ddc-8bf4-af71b80cbaae tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 057410e8-9ca0-477a-adec-60a7f9d7832d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:33.352359 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ffc354b-279b-4ddc-8bf4-af71b80cbaae tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:33.356249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ffc354b-279b-4ddc-8bf4-af71b80cbaae tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:33.360076 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ffc354b-279b-4ddc-8bf4-af71b80cbaae tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:33.361108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ffc354b-279b-4ddc-8bf4-af71b80cbaae tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:33.363286 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ffc354b-279b-4ddc-8bf4-af71b80cbaae tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:33.363957 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ffc354b-279b-4ddc-8bf4-af71b80cbaae tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:33.703413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2ffc354b-279b-4ddc-8bf4-af71b80cbaae tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:33.717148 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2ffc354b-279b-4ddc-8bf4-af71b80cbaae tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d" status: 200 len: 1473 microversion: 2.1 time: 0.378992 Oct 05 02:41:33.718608 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1587/3189] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:33 2022] GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d => generated 1473 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:33.774973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a8d29742-7140-410b-ade6-0482381a1a97 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:33.775600 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a8d29742-7140-410b-ade6-0482381a1a97 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:33.783104 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8d29742-7140-410b-ade6-0482381a1a97 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:33.784361 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8d29742-7140-410b-ade6-0482381a1a97 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:33.784918 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8d29742-7140-410b-ade6-0482381a1a97 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:33.785897 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8d29742-7140-410b-ade6-0482381a1a97 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:33.786442 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8d29742-7140-410b-ade6-0482381a1a97 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:33.786874 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8d29742-7140-410b-ade6-0482381a1a97 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:33.815784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-31a6cdd6-3db4-4509-bd49-08a2d94cfb30 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:33.817225 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-31a6cdd6-3db4-4509-bd49-08a2d94cfb30 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:33.824890 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-31a6cdd6-3db4-4509-bd49-08a2d94cfb30 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:33.825408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-31a6cdd6-3db4-4509-bd49-08a2d94cfb30 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:33.826062 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-31a6cdd6-3db4-4509-bd49-08a2d94cfb30 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:33.826954 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-31a6cdd6-3db4-4509-bd49-08a2d94cfb30 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:33.827404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-31a6cdd6-3db4-4509-bd49-08a2d94cfb30 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:33.828003 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-31a6cdd6-3db4-4509-bd49-08a2d94cfb30 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:34.139716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a8d29742-7140-410b-ade6-0482381a1a97 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:34.153530 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a8d29742-7140-410b-ade6-0482381a1a97 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1514 microversion: 2.1 time: 0.384453 Oct 05 02:41:34.154118 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1603/3190] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:33 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1514 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:34.160067 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dd477dab-3436-49ee-a235-c572cb1dcd44 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:34.160939 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dd477dab-3436-49ee-a235-c572cb1dcd44 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:34.168631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd477dab-3436-49ee-a235-c572cb1dcd44 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:34.169713 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd477dab-3436-49ee-a235-c572cb1dcd44 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:34.170263 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd477dab-3436-49ee-a235-c572cb1dcd44 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:34.171147 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd477dab-3436-49ee-a235-c572cb1dcd44 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:34.171725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd477dab-3436-49ee-a235-c572cb1dcd44 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:34.172170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd477dab-3436-49ee-a235-c572cb1dcd44 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:34.181917 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-31a6cdd6-3db4-4509-bd49-08a2d94cfb30 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:34.190836 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-31a6cdd6-3db4-4509-bd49-08a2d94cfb30 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1379 microversion: 2.1 time: 0.378675 Oct 05 02:41:34.192629 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1588/3191] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:33 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1379 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:41:34.272813 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ad42f5a2-764c-4b83-bffa-c1345975ff59 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:34.275121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ad42f5a2-764c-4b83-bffa-c1345975ff59 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:34.287263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad42f5a2-764c-4b83-bffa-c1345975ff59 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:34.288505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad42f5a2-764c-4b83-bffa-c1345975ff59 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:34.291610 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad42f5a2-764c-4b83-bffa-c1345975ff59 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:34.293183 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad42f5a2-764c-4b83-bffa-c1345975ff59 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:34.293664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad42f5a2-764c-4b83-bffa-c1345975ff59 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:34.294123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad42f5a2-764c-4b83-bffa-c1345975ff59 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:34.453026 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ad42f5a2-764c-4b83-bffa-c1345975ff59 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:34.464272 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ad42f5a2-764c-4b83-bffa-c1345975ff59 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1297 microversion: 2.1 time: 0.195539 Oct 05 02:41:34.467935 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1589/3192] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:34 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1297 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:41:34.542926 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-e41d714f-ed1d-44ca-b631-12412c85ea1b req-a0c20f2e-9375-4e7d-93f3-48b6a18b3efa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1b41d44-1201-460a-b938-7a70567656cd", "name": "network-vif-plugged", "status": "completed", "tag": "99ce69bd-430b-41c6-a998-33a5e643493b"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:41:34.584106 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e41d714f-ed1d-44ca-b631-12412c85ea1b req-a0c20f2e-9375-4e7d-93f3-48b6a18b3efa service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:34.585406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e41d714f-ed1d-44ca-b631-12412c85ea1b req-a0c20f2e-9375-4e7d-93f3-48b6a18b3efa service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:34.586814 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e41d714f-ed1d-44ca-b631-12412c85ea1b req-a0c20f2e-9375-4e7d-93f3-48b6a18b3efa service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:34.626532 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-e41d714f-ed1d-44ca-b631-12412c85ea1b req-a0c20f2e-9375-4e7d-93f3-48b6a18b3efa service nova] Creating event network-vif-plugged:99ce69bd-430b-41c6-a998-33a5e643493b for instance d1b41d44-1201-460a-b938-7a70567656cd on n-h2-858272-3 Oct 05 02:41:34.635722 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-e41d714f-ed1d-44ca-b631-12412c85ea1b req-a0c20f2e-9375-4e7d-93f3-48b6a18b3efa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097502 Oct 05 02:41:34.641357 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1590/3193] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:41:34.679694 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dd477dab-3436-49ee-a235-c572cb1dcd44 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:34.682842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-865c705e-bf36-484a-9c42-c7f68939a2bb tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:34.687271 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-865c705e-bf36-484a-9c42-c7f68939a2bb tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:34.691937 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dd477dab-3436-49ee-a235-c572cb1dcd44 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1362 microversion: 2.1 time: 0.533972 Oct 05 02:41:34.692560 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1604/3194] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:34 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1362 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:34.722038 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-865c705e-bf36-484a-9c42-c7f68939a2bb tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:34.722511 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-865c705e-bf36-484a-9c42-c7f68939a2bb tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:34.725722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-865c705e-bf36-484a-9c42-c7f68939a2bb tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:34.729217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-865c705e-bf36-484a-9c42-c7f68939a2bb tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:34.729943 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-865c705e-bf36-484a-9c42-c7f68939a2bb tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:34.732125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-865c705e-bf36-484a-9c42-c7f68939a2bb tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:34.742693 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f3d44cbb-18cd-4e49-98d3-cfa59a5bab54 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:34.745398 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f3d44cbb-18cd-4e49-98d3-cfa59a5bab54 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 057410e8-9ca0-477a-adec-60a7f9d7832d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:34.760522 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f3d44cbb-18cd-4e49-98d3-cfa59a5bab54 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:34.762975 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f3d44cbb-18cd-4e49-98d3-cfa59a5bab54 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:34.764034 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f3d44cbb-18cd-4e49-98d3-cfa59a5bab54 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:34.765074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f3d44cbb-18cd-4e49-98d3-cfa59a5bab54 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:34.766028 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f3d44cbb-18cd-4e49-98d3-cfa59a5bab54 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:34.766702 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f3d44cbb-18cd-4e49-98d3-cfa59a5bab54 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:34.821646 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-865c705e-bf36-484a-9c42-c7f68939a2bb tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.146807 Oct 05 02:41:34.835151 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1591/3195] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Oct 5 02:41:34 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21/os-volume_attachments => generated 25 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:41:34.922548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f3d44cbb-18cd-4e49-98d3-cfa59a5bab54 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:34.928047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c21d8301-f702-4c24-b3b0-b715004547c6 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:34.931629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c21d8301-f702-4c24-b3b0-b715004547c6 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:34.936352 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f3d44cbb-18cd-4e49-98d3-cfa59a5bab54 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d" status: 200 len: 1431 microversion: 2.1 time: 0.198071 Oct 05 02:41:34.937438 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1605/3196] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:34 2022] GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d => generated 1431 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:41:34.946001 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c21d8301-f702-4c24-b3b0-b715004547c6 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:34.946590 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c21d8301-f702-4c24-b3b0-b715004547c6 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:34.949875 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c21d8301-f702-4c24-b3b0-b715004547c6 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:34.951030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c21d8301-f702-4c24-b3b0-b715004547c6 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:34.952649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c21d8301-f702-4c24-b3b0-b715004547c6 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:34.955802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c21d8301-f702-4c24-b3b0-b715004547c6 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:35.014737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c21d8301-f702-4c24-b3b0-b715004547c6 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:41:35.046322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-11fb59bf-b08c-4746-bd0e-e730da7cdc1c req-811089f1-f71d-4e7d-91cf-8c906f306632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "057410e8-9ca0-477a-adec-60a7f9d7832d", "name": "network-vif-deleted", "tag": "5cd2eed9-4043-4634-ad60-927cf17f76cd"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:41:35.062187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-11fb59bf-b08c-4746-bd0e-e730da7cdc1c req-811089f1-f71d-4e7d-91cf-8c906f306632 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:35.062676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-11fb59bf-b08c-4746-bd0e-e730da7cdc1c req-811089f1-f71d-4e7d-91cf-8c906f306632 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:35.063110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-11fb59bf-b08c-4746-bd0e-e730da7cdc1c req-811089f1-f71d-4e7d-91cf-8c906f306632 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:35.074739 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:35.102228 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-11fb59bf-b08c-4746-bd0e-e730da7cdc1c req-811089f1-f71d-4e7d-91cf-8c906f306632 service nova] Creating event network-vif-deleted:5cd2eed9-4043-4634-ad60-927cf17f76cd for instance 057410e8-9ca0-477a-adec-60a7f9d7832d on n-h2-858272-3 Oct 05 02:41:35.107536 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-11fb59bf-b08c-4746-bd0e-e730da7cdc1c req-811089f1-f71d-4e7d-91cf-8c906f306632 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064896 Oct 05 02:41:35.130393 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1606/3197] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:41:35.204619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-aaf62e1f-ab0b-46dc-a92f-60172fd14ac5 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:35.206374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-aaf62e1f-ab0b-46dc-a92f-60172fd14ac5 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:35.214658 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c21d8301-f702-4c24-b3b0-b715004547c6 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 204 len: 0 microversion: 2.20 time: 0.292990 Oct 05 02:41:35.218058 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1592/3198] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 5 02:41:34 2022] DELETE /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 02:41:35.220788 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aaf62e1f-ab0b-46dc-a92f-60172fd14ac5 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:35.221692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aaf62e1f-ab0b-46dc-a92f-60172fd14ac5 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:35.223236 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aaf62e1f-ab0b-46dc-a92f-60172fd14ac5 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:35.224243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aaf62e1f-ab0b-46dc-a92f-60172fd14ac5 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:35.224976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aaf62e1f-ab0b-46dc-a92f-60172fd14ac5 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:35.225634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aaf62e1f-ab0b-46dc-a92f-60172fd14ac5 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:35.242422 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-17a23a98-91a9-4505-b620-8dab74a10a21 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:35.244463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-17a23a98-91a9-4505-b620-8dab74a10a21 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:35.268705 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17a23a98-91a9-4505-b620-8dab74a10a21 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:35.270397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17a23a98-91a9-4505-b620-8dab74a10a21 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:35.273726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17a23a98-91a9-4505-b620-8dab74a10a21 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:35.275994 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17a23a98-91a9-4505-b620-8dab74a10a21 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:35.278560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17a23a98-91a9-4505-b620-8dab74a10a21 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:35.281270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17a23a98-91a9-4505-b620-8dab74a10a21 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:35.756666 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-17a23a98-91a9-4505-b620-8dab74a10a21 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:35.773028 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-17a23a98-91a9-4505-b620-8dab74a10a21 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1379 microversion: 2.1 time: 0.549488 Oct 05 02:41:35.774173 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1593/3199] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:35 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1379 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:35.780518 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-01be92a2-477e-4aa3-94f7-33d6e35c1b7a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:35.783145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-01be92a2-477e-4aa3-94f7-33d6e35c1b7a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:35.791679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01be92a2-477e-4aa3-94f7-33d6e35c1b7a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:35.792409 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01be92a2-477e-4aa3-94f7-33d6e35c1b7a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:35.793089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01be92a2-477e-4aa3-94f7-33d6e35c1b7a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:35.794023 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01be92a2-477e-4aa3-94f7-33d6e35c1b7a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:35.794701 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01be92a2-477e-4aa3-94f7-33d6e35c1b7a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:35.795615 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01be92a2-477e-4aa3-94f7-33d6e35c1b7a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:35.822138 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-aaf62e1f-ab0b-46dc-a92f-60172fd14ac5 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:35.835552 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-aaf62e1f-ab0b-46dc-a92f-60172fd14ac5 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1514 microversion: 2.1 time: 0.649055 Oct 05 02:41:35.836153 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1607/3200] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:35 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1514 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:35.840928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9662d176-d914-415c-accc-3cd0c45ecb53 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:35.853237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9662d176-d914-415c-accc-3cd0c45ecb53 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:35.865383 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9662d176-d914-415c-accc-3cd0c45ecb53 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:35.865977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9662d176-d914-415c-accc-3cd0c45ecb53 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:35.866490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9662d176-d914-415c-accc-3cd0c45ecb53 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:35.867320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9662d176-d914-415c-accc-3cd0c45ecb53 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:35.867847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9662d176-d914-415c-accc-3cd0c45ecb53 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:35.868375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9662d176-d914-415c-accc-3cd0c45ecb53 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:36.232492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-01be92a2-477e-4aa3-94f7-33d6e35c1b7a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:36.246574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-01be92a2-477e-4aa3-94f7-33d6e35c1b7a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:36.252057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-01be92a2-477e-4aa3-94f7-33d6e35c1b7a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:36.254296 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-01be92a2-477e-4aa3-94f7-33d6e35c1b7a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1723 microversion: 2.20 time: 0.478651 Oct 05 02:41:36.256032 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1594/3201] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:41:35 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1723 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:41:36.279595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f5bf5711-b4b5-483c-bb5c-7d66496e2303 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:36.282412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f5bf5711-b4b5-483c-bb5c-7d66496e2303 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:36.306532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5bf5711-b4b5-483c-bb5c-7d66496e2303 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:36.307534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5bf5711-b4b5-483c-bb5c-7d66496e2303 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:36.308229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5bf5711-b4b5-483c-bb5c-7d66496e2303 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:36.309285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5bf5711-b4b5-483c-bb5c-7d66496e2303 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:36.310535 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5bf5711-b4b5-483c-bb5c-7d66496e2303 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:36.311387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5bf5711-b4b5-483c-bb5c-7d66496e2303 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:36.380307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9662d176-d914-415c-accc-3cd0c45ecb53 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:36.387091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:36.423457 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9662d176-d914-415c-accc-3cd0c45ecb53 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1365 microversion: 2.1 time: 0.586187 Oct 05 02:41:36.449199 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1608/3202] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:35 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1365 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:36.483242 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d6d4c5c6-f20f-4630-bb46-c46e67e4e043 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:36.485066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d6d4c5c6-f20f-4630-bb46-c46e67e4e043 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 057410e8-9ca0-477a-adec-60a7f9d7832d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:36.531681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d6d4c5c6-f20f-4630-bb46-c46e67e4e043 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:36.536997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d6d4c5c6-f20f-4630-bb46-c46e67e4e043 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:36.540859 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d6d4c5c6-f20f-4630-bb46-c46e67e4e043 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:36.541769 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d6d4c5c6-f20f-4630-bb46-c46e67e4e043 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:36.548485 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d6d4c5c6-f20f-4630-bb46-c46e67e4e043 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:36.552433 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d6d4c5c6-f20f-4630-bb46-c46e67e4e043 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:36.613932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f5bf5711-b4b5-483c-bb5c-7d66496e2303 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:36.624974 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d6d4c5c6-f20f-4630-bb46-c46e67e4e043 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:36.625772 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d6d4c5c6-f20f-4630-bb46-c46e67e4e043 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:36.626433 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d6d4c5c6-f20f-4630-bb46-c46e67e4e043 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:36.627092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-d6d4c5c6-f20f-4630-bb46-c46e67e4e043 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lazy-loading 'fault' on Instance uuid 057410e8-9ca0-477a-adec-60a7f9d7832d {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:41:36.627696 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f5bf5711-b4b5-483c-bb5c-7d66496e2303 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1548 microversion: 2.1 time: 0.369565 Oct 05 02:41:36.630982 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1595/3203] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:36 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1548 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:36.661234 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6f706666-2f59-48db-a836-80f76ff7de69 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:36.662105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6f706666-2f59-48db-a836-80f76ff7de69 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:36.679698 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f706666-2f59-48db-a836-80f76ff7de69 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:36.681223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f706666-2f59-48db-a836-80f76ff7de69 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:36.683662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f706666-2f59-48db-a836-80f76ff7de69 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:36.685327 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f706666-2f59-48db-a836-80f76ff7de69 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:36.689689 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f706666-2f59-48db-a836-80f76ff7de69 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:36.691772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f706666-2f59-48db-a836-80f76ff7de69 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:37.017782 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6f706666-2f59-48db-a836-80f76ff7de69 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.368115 Oct 05 02:41:37.018844 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1596/3204] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 02:41:36 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397/os-interface => generated 284 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:41:37.025102 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d2880f86-eab6-4ed9-a8af-3c7ca78b2f56 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:37.025857 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d2880f86-eab6-4ed9-a8af-3c7ca78b2f56 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:37.049809 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2880f86-eab6-4ed9-a8af-3c7ca78b2f56 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:37.050997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d6d4c5c6-f20f-4630-bb46-c46e67e4e043 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:37.054404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2880f86-eab6-4ed9-a8af-3c7ca78b2f56 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:37.058011 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2880f86-eab6-4ed9-a8af-3c7ca78b2f56 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:37.060324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2880f86-eab6-4ed9-a8af-3c7ca78b2f56 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:37.061664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2880f86-eab6-4ed9-a8af-3c7ca78b2f56 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:37.063476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2880f86-eab6-4ed9-a8af-3c7ca78b2f56 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:37.067180 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d6d4c5c6-f20f-4630-bb46-c46e67e4e043 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d" status: 200 len: 1307 microversion: 2.1 time: 0.614132 Oct 05 02:41:37.083859 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1609/3205] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:36 2022] GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d => generated 1307 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:37.102745 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6271e0e5-2726-416c-9bdd-f09e85806794 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:37.103821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6271e0e5-2726-416c-9bdd-f09e85806794 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:37.120013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6271e0e5-2726-416c-9bdd-f09e85806794 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:37.124749 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6271e0e5-2726-416c-9bdd-f09e85806794 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:37.125555 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6271e0e5-2726-416c-9bdd-f09e85806794 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:37.129902 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6271e0e5-2726-416c-9bdd-f09e85806794 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:37.133888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6271e0e5-2726-416c-9bdd-f09e85806794 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:37.137182 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6271e0e5-2726-416c-9bdd-f09e85806794 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:37.581682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d2880f86-eab6-4ed9-a8af-3c7ca78b2f56 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:37.582571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6271e0e5-2726-416c-9bdd-f09e85806794 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:37.592488 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d2880f86-eab6-4ed9-a8af-3c7ca78b2f56 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1529 microversion: 2.1 time: 0.572354 Oct 05 02:41:37.594135 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1597/3206] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:37 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1529 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:37.604795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7ff1f356-5561-409b-bb0c-7d44a0fe4030 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:37.606491 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7ff1f356-5561-409b-bb0c-7d44a0fe4030 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:37.609589 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6271e0e5-2726-416c-9bdd-f09e85806794 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1514 microversion: 2.1 time: 0.523517 Oct 05 02:41:37.617552 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ff1f356-5561-409b-bb0c-7d44a0fe4030 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:37.618643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ff1f356-5561-409b-bb0c-7d44a0fe4030 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:37.619305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ff1f356-5561-409b-bb0c-7d44a0fe4030 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:37.620404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ff1f356-5561-409b-bb0c-7d44a0fe4030 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:37.622022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ff1f356-5561-409b-bb0c-7d44a0fe4030 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:37.623423 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1610/3207] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:37 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1514 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:37.625044 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ff1f356-5561-409b-bb0c-7d44a0fe4030 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:37.689412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d8733561-f7e9-4fc9-a5bf-bc88291424c8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:37.690672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d8733561-f7e9-4fc9-a5bf-bc88291424c8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:37.701333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d8733561-f7e9-4fc9-a5bf-bc88291424c8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:37.703059 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d8733561-f7e9-4fc9-a5bf-bc88291424c8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:37.703059 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d8733561-f7e9-4fc9-a5bf-bc88291424c8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:37.704819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d8733561-f7e9-4fc9-a5bf-bc88291424c8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:37.705559 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d8733561-f7e9-4fc9-a5bf-bc88291424c8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:37.706911 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d8733561-f7e9-4fc9-a5bf-bc88291424c8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:38.233806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7ff1f356-5561-409b-bb0c-7d44a0fe4030 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:38.250197 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7ff1f356-5561-409b-bb0c-7d44a0fe4030 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:38.252630 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7ff1f356-5561-409b-bb0c-7d44a0fe4030 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:38.259426 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7ff1f356-5561-409b-bb0c-7d44a0fe4030 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1723 microversion: 2.20 time: 0.662656 Oct 05 02:41:38.267477 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1598/3208] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:41:37 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1723 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:41:38.278829 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d321c1e4-919c-4c65-8d79-dd5163d795ee tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:38.279470 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d321c1e4-919c-4c65-8d79-dd5163d795ee tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:38.303172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d321c1e4-919c-4c65-8d79-dd5163d795ee tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:38.303854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d321c1e4-919c-4c65-8d79-dd5163d795ee tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:38.304319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d321c1e4-919c-4c65-8d79-dd5163d795ee tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:38.309519 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d321c1e4-919c-4c65-8d79-dd5163d795ee tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:38.310933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d321c1e4-919c-4c65-8d79-dd5163d795ee tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:38.312260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d321c1e4-919c-4c65-8d79-dd5163d795ee tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:38.418687 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d8733561-f7e9-4fc9-a5bf-bc88291424c8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:38.435150 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d8733561-f7e9-4fc9-a5bf-bc88291424c8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1365 microversion: 2.1 time: 0.801213 Oct 05 02:41:38.437363 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1611/3209] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:37 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1365 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:38.447516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c168630e-e8d2-4e7b-8082-d71ee5ebc5b1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:38.448408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c168630e-e8d2-4e7b-8082-d71ee5ebc5b1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 057410e8-9ca0-477a-adec-60a7f9d7832d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:38.457779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c168630e-e8d2-4e7b-8082-d71ee5ebc5b1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:38.458734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c168630e-e8d2-4e7b-8082-d71ee5ebc5b1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:38.459954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c168630e-e8d2-4e7b-8082-d71ee5ebc5b1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:38.463074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c168630e-e8d2-4e7b-8082-d71ee5ebc5b1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:38.463976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c168630e-e8d2-4e7b-8082-d71ee5ebc5b1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:38.464783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c168630e-e8d2-4e7b-8082-d71ee5ebc5b1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:38.482308 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-c168630e-e8d2-4e7b-8082-d71ee5ebc5b1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] HTTP exception thrown: Instance 057410e8-9ca0-477a-adec-60a7f9d7832d could not be found. Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c168630e-e8d2-4e7b-8082-d71ee5ebc5b1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Request method failure captured: Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d HTTP/1.1 Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO3rxm78ro_lNid6Y0mfn-jyk6yAO5lWqW8Lr16wE4MCHagKAeauvptfZCvHaJ-6doq4nQv84xoFEpGRxvpNSA8Zrv8qJa_I5PWdE0F_gyAXlJijeV0AOJD3fyv6ynFZOJHx-riqsCQLfbqmpKoB-zpHICxlYmWXXCF5clocFvQOwXs Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: f5a44c2cd99949c2a30ab83bdede01e6 Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersOnMultiNodesTest-1239008232 Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5a44c2cd99949c2a30ab83bdede01e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5a44c2cd99949c2a30ab83bdede01e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f5a44c2cd99949c2a30ab83bdede01e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f5a44c2cd99949c2a30ab83bdede01e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersOnMultiNodesTest-1239008232 Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: f5a44c2cd99949c2a30ab83bdede01e6 Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1239008232 Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersOnMultiNodesTest-1239008232-project Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: b86e3b7d1c9a4b2c8f2914beefa74cc1 Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersOnMultiNodesTest-1239008232-project Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 057410e8-9ca0-477a-adec-60a7f9d7832d could not be found. Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '057410e8-9ca0-477a-adec-60a7f9d7832d'} Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 057410e8-9ca0-477a-adec-60a7f9d7832d could not be found. Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 057410e8-9ca0-477a-adec-60a7f9d7832d could not be found. Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:41:38.485634 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:38.495056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:41:38.495056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:41:38.495056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:41:38.495056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:41:38.495056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:41:38.495056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 057410e8-9ca0-477a-adec-60a7f9d7832d could not be found. Oct 05 02:41:38.495056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:38.497550 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c168630e-e8d2-4e7b-8082-d71ee5ebc5b1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Returning 404 to user: Instance 057410e8-9ca0-477a-adec-60a7f9d7832d could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:41:38.498719 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c168630e-e8d2-4e7b-8082-d71ee5ebc5b1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d" status: 404 len: 111 microversion: 2.1 time: 0.059001 Oct 05 02:41:38.502777 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1612/3210] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:38 2022] GET /compute/v2.1/servers/057410e8-9ca0-477a-adec-60a7f9d7832d => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:41:38.508988 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-287046bf-5916-4210-b0cd-a1bb2e682a82 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:38.509866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-287046bf-5916-4210-b0cd-a1bb2e682a82 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: de6a6594-881f-489b-8b94-28b74e935c1e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:38.516324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-287046bf-5916-4210-b0cd-a1bb2e682a82 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:38.517611 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-287046bf-5916-4210-b0cd-a1bb2e682a82 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:38.518329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-287046bf-5916-4210-b0cd-a1bb2e682a82 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:38.520005 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-287046bf-5916-4210-b0cd-a1bb2e682a82 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:38.520709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-287046bf-5916-4210-b0cd-a1bb2e682a82 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:38.521405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-287046bf-5916-4210-b0cd-a1bb2e682a82 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:38.573116 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-287046bf-5916-4210-b0cd-a1bb2e682a82 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: de6a6594-881f-489b-8b94-28b74e935c1e] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:41:38.688943 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d321c1e4-919c-4c65-8d79-dd5163d795ee tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:38.700572 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d321c1e4-919c-4c65-8d79-dd5163d795ee tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1529 microversion: 2.1 time: 0.431626 Oct 05 02:41:38.701356 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1599/3211] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:38 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1529 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:38.714148 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-63b4950e-39c3-4919-86e0-391e8857cc93 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:38.715055 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-63b4950e-39c3-4919-86e0-391e8857cc93 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:38.731056 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-63b4950e-39c3-4919-86e0-391e8857cc93 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:38.732358 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-63b4950e-39c3-4919-86e0-391e8857cc93 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:38.733956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-63b4950e-39c3-4919-86e0-391e8857cc93 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:38.736579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-63b4950e-39c3-4919-86e0-391e8857cc93 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:38.737820 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-63b4950e-39c3-4919-86e0-391e8857cc93 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:38.740044 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-63b4950e-39c3-4919-86e0-391e8857cc93 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:38.786506 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-287046bf-5916-4210-b0cd-a1bb2e682a82 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "DELETE /compute/v2.1/servers/de6a6594-881f-489b-8b94-28b74e935c1e" status: 204 len: 0 microversion: 2.1 time: 0.280455 Oct 05 02:41:38.787284 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1613/3212] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:41:38 2022] DELETE /compute/v2.1/servers/de6a6594-881f-489b-8b94-28b74e935c1e => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:41:38.795112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bded0b4d-6057-4fd7-8b5a-f06e2a475c35 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:38.833997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:38.844175 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bded0b4d-6057-4fd7-8b5a-f06e2a475c35 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/420c4dd2-e5ee-47a6-859a-f68516099f07" status: 202 len: 0 microversion: 2.1 time: 0.055351 Oct 05 02:41:38.845242 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1614/3213] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:41:38 2022] DELETE /compute/v2.1/flavors/420c4dd2-e5ee-47a6-859a-f68516099f07 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:41:38.851520 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-24f1c531-1876-4e50-8cfd-c2cfaeb13136 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:38.852498 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-24f1c531-1876-4e50-8cfd-c2cfaeb13136 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 37204911-40f0-4356-a6df-7fda8afbf5da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:38.861081 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24f1c531-1876-4e50-8cfd-c2cfaeb13136 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:38.861954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24f1c531-1876-4e50-8cfd-c2cfaeb13136 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:38.863851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24f1c531-1876-4e50-8cfd-c2cfaeb13136 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:38.864777 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24f1c531-1876-4e50-8cfd-c2cfaeb13136 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:38.865445 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24f1c531-1876-4e50-8cfd-c2cfaeb13136 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:38.866073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24f1c531-1876-4e50-8cfd-c2cfaeb13136 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:38.923104 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-24f1c531-1876-4e50-8cfd-c2cfaeb13136 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 37204911-40f0-4356-a6df-7fda8afbf5da] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:41:39.104867 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-24f1c531-1876-4e50-8cfd-c2cfaeb13136 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "DELETE /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da" status: 204 len: 0 microversion: 2.1 time: 0.257763 Oct 05 02:41:39.105939 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1615/3214] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:41:38 2022] DELETE /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:41:39.115661 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2039c025-e5c0-4626-9684-b537fef7c9d3 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:39.169016 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2039c025-e5c0-4626-9684-b537fef7c9d3 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058219 Oct 05 02:41:39.170340 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1616/3215] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:41:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:39.178448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6910afbe-31c7-4dfd-86f2-8a5f034cec13 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:39.179660 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6910afbe-31c7-4dfd-86f2-8a5f034cec13 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: de6a6594-881f-489b-8b94-28b74e935c1e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:39.188844 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6910afbe-31c7-4dfd-86f2-8a5f034cec13 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:39.189674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6910afbe-31c7-4dfd-86f2-8a5f034cec13 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:39.190223 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6910afbe-31c7-4dfd-86f2-8a5f034cec13 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:39.191120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6910afbe-31c7-4dfd-86f2-8a5f034cec13 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:39.191932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6910afbe-31c7-4dfd-86f2-8a5f034cec13 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:39.193148 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6910afbe-31c7-4dfd-86f2-8a5f034cec13 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:39.312493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-63b4950e-39c3-4919-86e0-391e8857cc93 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:39.328250 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-63b4950e-39c3-4919-86e0-391e8857cc93 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1514 microversion: 2.1 time: 0.622135 Oct 05 02:41:39.333468 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1600/3216] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:38 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1514 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:39.344072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-0e38cb41-60c8-4606-b29f-bc15ba854d20 req-f8dd6e20-0f5a-4a41-bafb-022962f4b0ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d47438b-a5f5-4dfb-a134-c5cd6dc5a397", "tag": "700b091a-5ee8-4bb5-86f1-61a41c2ee276"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:41:39.382168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-0e38cb41-60c8-4606-b29f-bc15ba854d20 req-f8dd6e20-0f5a-4a41-bafb-022962f4b0ca service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:39.384013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-0e38cb41-60c8-4606-b29f-bc15ba854d20 req-f8dd6e20-0f5a-4a41-bafb-022962f4b0ca service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:39.384824 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-0e38cb41-60c8-4606-b29f-bc15ba854d20 req-f8dd6e20-0f5a-4a41-bafb-022962f4b0ca service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:39.420721 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-0e38cb41-60c8-4606-b29f-bc15ba854d20 req-f8dd6e20-0f5a-4a41-bafb-022962f4b0ca service nova] Creating event network-changed:700b091a-5ee8-4bb5-86f1-61a41c2ee276 for instance 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 on n-h2-858272-3 Oct 05 02:41:39.430254 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-0e38cb41-60c8-4606-b29f-bc15ba854d20 req-f8dd6e20-0f5a-4a41-bafb-022962f4b0ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094195 Oct 05 02:41:39.432393 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1601/3217] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:41:39.443758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6bbf19ca-89f2-4f5a-9b16-52fade91943f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:41:39.448729 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6bbf19ca-89f2-4f5a-9b16-52fade91943f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:39.460697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6bbf19ca-89f2-4f5a-9b16-52fade91943f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:39.464186 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6bbf19ca-89f2-4f5a-9b16-52fade91943f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:39.465498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6bbf19ca-89f2-4f5a-9b16-52fade91943f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:39.466585 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6bbf19ca-89f2-4f5a-9b16-52fade91943f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:39.467311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6bbf19ca-89f2-4f5a-9b16-52fade91943f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:39.468384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6bbf19ca-89f2-4f5a-9b16-52fade91943f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:39.800341 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6bbf19ca-89f2-4f5a-9b16-52fade91943f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:39.814963 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6bbf19ca-89f2-4f5a-9b16-52fade91943f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Old instance type tempest-test_resize_flavor_-336469695, new instance type m1.heat {{(pid=122319) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 05 02:41:39.833538 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-6bbf19ca-89f2-4f5a-9b16-52fade91943f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:41:39.834476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-6bbf19ca-89f2-4f5a-9b16-52fade91943f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:41:39.835410 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-6bbf19ca-89f2-4f5a-9b16-52fade91943f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:41:39.837847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-6bbf19ca-89f2-4f5a-9b16-52fade91943f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:41:39.838465 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-6bbf19ca-89f2-4f5a-9b16-52fade91943f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:41:39.970013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6910afbe-31c7-4dfd-86f2-8a5f034cec13 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:39.983587 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6910afbe-31c7-4dfd-86f2-8a5f034cec13 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/de6a6594-881f-489b-8b94-28b74e935c1e" status: 200 len: 1474 microversion: 2.1 time: 0.811814 Oct 05 02:41:39.985114 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1617/3218] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:39 2022] GET /compute/v2.1/servers/de6a6594-881f-489b-8b94-28b74e935c1e => generated 1474 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:40.000166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-c79be317-4e85-469a-bef6-b2169ad8f5f1 req-f52cfd57-83dc-4d10-9111-84d4a499be21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4388e9ec-13a9-4d5b-9310-7a10953c57d0", "tag": "17b098e0-7358-489c-bec3-6b98c1db0796"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:41:40.020279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-c79be317-4e85-469a-bef6-b2169ad8f5f1 req-f52cfd57-83dc-4d10-9111-84d4a499be21 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:40.022594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-c79be317-4e85-469a-bef6-b2169ad8f5f1 req-f52cfd57-83dc-4d10-9111-84d4a499be21 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:40.022924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-c79be317-4e85-469a-bef6-b2169ad8f5f1 req-f52cfd57-83dc-4d10-9111-84d4a499be21 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:40.049402 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-c79be317-4e85-469a-bef6-b2169ad8f5f1 req-f52cfd57-83dc-4d10-9111-84d4a499be21 service nova] Creating event network-changed:17b098e0-7358-489c-bec3-6b98c1db0796 for instance 4388e9ec-13a9-4d5b-9310-7a10953c57d0 on n-h1-858272-3 Oct 05 02:41:40.067947 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-c79be317-4e85-469a-bef6-b2169ad8f5f1 req-f52cfd57-83dc-4d10-9111-84d4a499be21 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081530 Oct 05 02:41:40.069033 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1618/3219] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:41:40.075340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-303dfebd-3f3d-4c87-95d5-9d2c01f4f215 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:40.076285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-303dfebd-3f3d-4c87-95d5-9d2c01f4f215 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:40.085482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-303dfebd-3f3d-4c87-95d5-9d2c01f4f215 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:40.085821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-303dfebd-3f3d-4c87-95d5-9d2c01f4f215 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:40.086097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-303dfebd-3f3d-4c87-95d5-9d2c01f4f215 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:40.086846 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-303dfebd-3f3d-4c87-95d5-9d2c01f4f215 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:40.088090 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-303dfebd-3f3d-4c87-95d5-9d2c01f4f215 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:40.088680 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-303dfebd-3f3d-4c87-95d5-9d2c01f4f215 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:40.137497 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6bbf19ca-89f2-4f5a-9b16-52fade91943f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "POST /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd/action" status: 202 len: 0 microversion: 2.1 time: 0.702567 Oct 05 02:41:40.146084 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1602/3220] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:41:39 2022] POST /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd/action => generated 0 bytes in 710 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:41:40.152083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b4ca022f-f94d-4aa1-b782-1aea65a83a4c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:40.153358 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b4ca022f-f94d-4aa1-b782-1aea65a83a4c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:40.168409 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4ca022f-f94d-4aa1-b782-1aea65a83a4c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:40.168938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4ca022f-f94d-4aa1-b782-1aea65a83a4c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:40.173918 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4ca022f-f94d-4aa1-b782-1aea65a83a4c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:40.175033 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4ca022f-f94d-4aa1-b782-1aea65a83a4c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:40.177132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4ca022f-f94d-4aa1-b782-1aea65a83a4c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:40.177655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4ca022f-f94d-4aa1-b782-1aea65a83a4c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:40.289252 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-303dfebd-3f3d-4c87-95d5-9d2c01f4f215 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:40.301657 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-303dfebd-3f3d-4c87-95d5-9d2c01f4f215 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:40.304622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-303dfebd-3f3d-4c87-95d5-9d2c01f4f215 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:40.308559 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-303dfebd-3f3d-4c87-95d5-9d2c01f4f215 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1656 microversion: 2.20 time: 0.236639 Oct 05 02:41:40.313489 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1619/3221] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:41:40 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1656 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:41:40.319462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:40.334812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0ffefad6-f15d-465d-be2e-80fa4608cc49 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:40.335839 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0ffefad6-f15d-465d-be2e-80fa4608cc49 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:40.348757 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ffefad6-f15d-465d-be2e-80fa4608cc49 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:40.351718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ffefad6-f15d-465d-be2e-80fa4608cc49 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:40.353191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ffefad6-f15d-465d-be2e-80fa4608cc49 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:40.354287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ffefad6-f15d-465d-be2e-80fa4608cc49 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:40.357444 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ffefad6-f15d-465d-be2e-80fa4608cc49 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:40.358316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ffefad6-f15d-465d-be2e-80fa4608cc49 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:40.359135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:40.681303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=8 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:40.880931 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0ffefad6-f15d-465d-be2e-80fa4608cc49 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:40.905441 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0ffefad6-f15d-465d-be2e-80fa4608cc49 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1538 microversion: 2.1 time: 0.574472 Oct 05 02:41:40.906562 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1620/3222] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:40 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1538 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:40.937588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cdbc2d9b-47de-4640-8c5a-cc7187ac780d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:40.938698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cdbc2d9b-47de-4640-8c5a-cc7187ac780d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:40.950819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdbc2d9b-47de-4640-8c5a-cc7187ac780d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:40.952166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdbc2d9b-47de-4640-8c5a-cc7187ac780d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:40.953464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdbc2d9b-47de-4640-8c5a-cc7187ac780d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:40.955599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdbc2d9b-47de-4640-8c5a-cc7187ac780d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:40.956387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdbc2d9b-47de-4640-8c5a-cc7187ac780d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:40.958360 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdbc2d9b-47de-4640-8c5a-cc7187ac780d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:41.026423 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b4ca022f-f94d-4aa1-b782-1aea65a83a4c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:41.035971 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b4ca022f-f94d-4aa1-b782-1aea65a83a4c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1365 microversion: 2.1 time: 0.891316 Oct 05 02:41:41.036573 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1603/3223] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:40 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1365 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:41.073256 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-961eb1b2-ea59-4ddc-a778-c58cbfd28754 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:41.074076 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-961eb1b2-ea59-4ddc-a778-c58cbfd28754 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: de6a6594-881f-489b-8b94-28b74e935c1e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:41.121228 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-961eb1b2-ea59-4ddc-a778-c58cbfd28754 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:41.129277 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-961eb1b2-ea59-4ddc-a778-c58cbfd28754 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:41.129968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-961eb1b2-ea59-4ddc-a778-c58cbfd28754 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:41.146168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-961eb1b2-ea59-4ddc-a778-c58cbfd28754 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:41.148851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-961eb1b2-ea59-4ddc-a778-c58cbfd28754 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:41.151851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-961eb1b2-ea59-4ddc-a778-c58cbfd28754 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:41.882010 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-961eb1b2-ea59-4ddc-a778-c58cbfd28754 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:41.890028 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-961eb1b2-ea59-4ddc-a778-c58cbfd28754 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/de6a6594-881f-489b-8b94-28b74e935c1e" status: 200 len: 1474 microversion: 2.1 time: 0.846697 Oct 05 02:41:41.908475 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1604/3224] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:41 2022] GET /compute/v2.1/servers/de6a6594-881f-489b-8b94-28b74e935c1e => generated 1474 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:41.921087 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-96da23f5-4b62-4a9d-b7b0-b8665e35abba tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:41.934060 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-96da23f5-4b62-4a9d-b7b0-b8665e35abba tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:41.962217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96da23f5-4b62-4a9d-b7b0-b8665e35abba tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:41.963727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96da23f5-4b62-4a9d-b7b0-b8665e35abba tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:41.964185 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96da23f5-4b62-4a9d-b7b0-b8665e35abba tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:41.964930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96da23f5-4b62-4a9d-b7b0-b8665e35abba tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:41.965387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96da23f5-4b62-4a9d-b7b0-b8665e35abba tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:41.965821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96da23f5-4b62-4a9d-b7b0-b8665e35abba tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:42.056225 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96da23f5-4b62-4a9d-b7b0-b8665e35abba tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:42.056864 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96da23f5-4b62-4a9d-b7b0-b8665e35abba tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:42.057167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96da23f5-4b62-4a9d-b7b0-b8665e35abba tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:42.063967 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-96da23f5-4b62-4a9d-b7b0-b8665e35abba tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lazy-loading 'fault' on Instance uuid 1c15b977-1608-45e8-8bbd-b2bd5c1eff21 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:41:42.108055 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cdbc2d9b-47de-4640-8c5a-cc7187ac780d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:42.122062 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cdbc2d9b-47de-4640-8c5a-cc7187ac780d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1514 microversion: 2.1 time: 1.194283 Oct 05 02:41:42.127011 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1621/3225] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:40 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1514 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:42.135475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5e6cffcc-2dd6-4d9e-8032-3ee942d89976 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:42.136086 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5e6cffcc-2dd6-4d9e-8032-3ee942d89976 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:42.147132 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e6cffcc-2dd6-4d9e-8032-3ee942d89976 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:42.148227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e6cffcc-2dd6-4d9e-8032-3ee942d89976 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:42.149235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e6cffcc-2dd6-4d9e-8032-3ee942d89976 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:42.150244 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e6cffcc-2dd6-4d9e-8032-3ee942d89976 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:42.150998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e6cffcc-2dd6-4d9e-8032-3ee942d89976 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:42.151662 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e6cffcc-2dd6-4d9e-8032-3ee942d89976 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:42.266872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-96da23f5-4b62-4a9d-b7b0-b8665e35abba tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:42.282319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-96da23f5-4b62-4a9d-b7b0-b8665e35abba tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:42.287704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-96da23f5-4b62-4a9d-b7b0-b8665e35abba tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4b5243d9ffe46c4b32033da558d1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b649132448b44278c6dd55cdb6ff3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:42.290477 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-96da23f5-4b62-4a9d-b7b0-b8665e35abba tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 200 len: 1372 microversion: 2.20 time: 0.380624 Oct 05 02:41:42.292962 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1605/3226] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:41:41 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 1372 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:41:42.306840 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-28c79cfa-9ecf-4db3-890c-526839ffffad tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:42.307982 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-28c79cfa-9ecf-4db3-890c-526839ffffad tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:42.324534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28c79cfa-9ecf-4db3-890c-526839ffffad tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:42.325686 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28c79cfa-9ecf-4db3-890c-526839ffffad tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:42.326596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28c79cfa-9ecf-4db3-890c-526839ffffad tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:42.328000 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28c79cfa-9ecf-4db3-890c-526839ffffad tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:42.328727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28c79cfa-9ecf-4db3-890c-526839ffffad tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:42.330364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28c79cfa-9ecf-4db3-890c-526839ffffad tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:42.606673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-28c79cfa-9ecf-4db3-890c-526839ffffad tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:42.616676 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-28c79cfa-9ecf-4db3-890c-526839ffffad tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1365 microversion: 2.1 time: 0.321283 Oct 05 02:41:42.625188 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5e6cffcc-2dd6-4d9e-8032-3ee942d89976 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:42.627742 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1606/3227] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:42 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1365 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:42.640689 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5e6cffcc-2dd6-4d9e-8032-3ee942d89976 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1538 microversion: 2.1 time: 0.510370 Oct 05 02:41:42.641781 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1622/3228] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:42 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1538 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:42.642362 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-227f1f00-bb96-4662-929d-cf50424342a9 req-cd24f579-7f6a-4e87-beb5-27e62862c4b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c15b977-1608-45e8-8bbd-b2bd5c1eff21", "name": "network-vif-deleted", "tag": "af2bec78-4945-43ac-81ca-883ba5ae8ef2"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:41:42.667278 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-227f1f00-bb96-4662-929d-cf50424342a9 req-cd24f579-7f6a-4e87-beb5-27e62862c4b8 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:42.668130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-227f1f00-bb96-4662-929d-cf50424342a9 req-cd24f579-7f6a-4e87-beb5-27e62862c4b8 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:42.668733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-227f1f00-bb96-4662-929d-cf50424342a9 req-cd24f579-7f6a-4e87-beb5-27e62862c4b8 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:42.682426 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-227f1f00-bb96-4662-929d-cf50424342a9 req-cd24f579-7f6a-4e87-beb5-27e62862c4b8 service nova] Creating event network-vif-deleted:af2bec78-4945-43ac-81ca-883ba5ae8ef2 for instance 1c15b977-1608-45e8-8bbd-b2bd5c1eff21 on n-h1-858272-3 Oct 05 02:41:42.687940 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-227f1f00-bb96-4662-929d-cf50424342a9 req-cd24f579-7f6a-4e87-beb5-27e62862c4b8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057981 Oct 05 02:41:42.694124 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1607/3229] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:41:42.932373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5379e95c-d1e2-4584-9ed6-036422ba9ba9 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:42.933014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5379e95c-d1e2-4584-9ed6-036422ba9ba9 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: de6a6594-881f-489b-8b94-28b74e935c1e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:42.945009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5379e95c-d1e2-4584-9ed6-036422ba9ba9 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:42.946370 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5379e95c-d1e2-4584-9ed6-036422ba9ba9 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:42.948656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5379e95c-d1e2-4584-9ed6-036422ba9ba9 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:42.949428 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5379e95c-d1e2-4584-9ed6-036422ba9ba9 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:42.950748 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5379e95c-d1e2-4584-9ed6-036422ba9ba9 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:42.954441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5379e95c-d1e2-4584-9ed6-036422ba9ba9 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:43.002024 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-ff7beec4-4e24-4da4-8be1-dd17c3cec1a5 req-a50c6b39-5b08-4cbe-8198-e93290b87e4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37204911-40f0-4356-a6df-7fda8afbf5da", "name": "network-vif-deleted", "tag": "293498fd-3dff-4d23-b7bc-8889e0d78f65"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:41:43.030948 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ff7beec4-4e24-4da4-8be1-dd17c3cec1a5 req-a50c6b39-5b08-4cbe-8198-e93290b87e4f service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:43.031441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ff7beec4-4e24-4da4-8be1-dd17c3cec1a5 req-a50c6b39-5b08-4cbe-8198-e93290b87e4f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:43.037676 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ff7beec4-4e24-4da4-8be1-dd17c3cec1a5 req-a50c6b39-5b08-4cbe-8198-e93290b87e4f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:43.129559 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-ff7beec4-4e24-4da4-8be1-dd17c3cec1a5 req-a50c6b39-5b08-4cbe-8198-e93290b87e4f service nova] Creating event network-vif-deleted:293498fd-3dff-4d23-b7bc-8889e0d78f65 for instance 37204911-40f0-4356-a6df-7fda8afbf5da on n-h2-858272-3 Oct 05 02:41:43.164783 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-ff7beec4-4e24-4da4-8be1-dd17c3cec1a5 req-a50c6b39-5b08-4cbe-8198-e93290b87e4f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167320 Oct 05 02:41:43.172311 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1608/3230] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:41:43.178929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6b366ccb-ed14-414a-9a66-9c8fe1466a14 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:43.183903 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6b366ccb-ed14-414a-9a66-9c8fe1466a14 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:43.206215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b366ccb-ed14-414a-9a66-9c8fe1466a14 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:43.207885 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b366ccb-ed14-414a-9a66-9c8fe1466a14 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:43.208558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b366ccb-ed14-414a-9a66-9c8fe1466a14 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:43.210289 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b366ccb-ed14-414a-9a66-9c8fe1466a14 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:43.210979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b366ccb-ed14-414a-9a66-9c8fe1466a14 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:43.214396 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b366ccb-ed14-414a-9a66-9c8fe1466a14 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:43.226827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:43.330044 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5379e95c-d1e2-4584-9ed6-036422ba9ba9 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:43.346862 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5379e95c-d1e2-4584-9ed6-036422ba9ba9 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/de6a6594-881f-489b-8b94-28b74e935c1e" status: 200 len: 1432 microversion: 2.1 time: 0.417258 Oct 05 02:41:43.350442 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1623/3231] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:42 2022] GET /compute/v2.1/servers/de6a6594-881f-489b-8b94-28b74e935c1e => generated 1432 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:43.359404 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-796bb562-28a2-4ad7-842e-e7c7aaa34f10 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:43.364002 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-796bb562-28a2-4ad7-842e-e7c7aaa34f10 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:43.376388 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-796bb562-28a2-4ad7-842e-e7c7aaa34f10 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:43.376740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-796bb562-28a2-4ad7-842e-e7c7aaa34f10 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:43.378023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-796bb562-28a2-4ad7-842e-e7c7aaa34f10 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:43.379330 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-796bb562-28a2-4ad7-842e-e7c7aaa34f10 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:43.380015 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-796bb562-28a2-4ad7-842e-e7c7aaa34f10 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:43.383757 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-796bb562-28a2-4ad7-842e-e7c7aaa34f10 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:43.414972 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-796bb562-28a2-4ad7-842e-e7c7aaa34f10 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] HTTP exception thrown: Instance 1c15b977-1608-45e8-8bbd-b2bd5c1eff21 could not be found. Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-796bb562-28a2-4ad7-842e-e7c7aaa34f10 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Request method failure captured: Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 HTTP/1.1 Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOytiS7b2tK0awcEIotX_usFegY2tGFUeOktlSay5uZeJJlr1mgaMspizter-ThNcnxIA0JGrv8A75MOFzYgHfQXUiIxbzFruC5wIt6llgJ6488NxjhbOhnRVT5nq01W7iSZsvlLO6bsqUodskpKK_NcAurDwc6wAUp_KMwStZczpro Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: X-Openstack-Nova-Api-Version: 2.20 Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 3b649132448b44278c6dd55cdb6ff3de Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1773917274 Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3b649132448b44278c6dd55cdb6ff3de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3b649132448b44278c6dd55cdb6ff3de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3b649132448b44278c6dd55cdb6ff3de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3b649132448b44278c6dd55cdb6ff3de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1773917274 Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 3b649132448b44278c6dd55cdb6ff3de Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1773917274 Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-AttachVolumeShelveTestJSON-1773917274-project Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: e4b5243d9ffe46c4b32033da558d1e2c Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1773917274-project Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 1c15b977-1608-45e8-8bbd-b2bd5c1eff21 could not be found. Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '1c15b977-1608-45e8-8bbd-b2bd5c1eff21'} Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c15b977-1608-45e8-8bbd-b2bd5c1eff21 could not be found. Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c15b977-1608-45e8-8bbd-b2bd5c1eff21 could not be found. Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:43.426964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:41:43.431153 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:43.431153 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:41:43.431153 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:41:43.431153 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:41:43.431153 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:41:43.431153 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:41:43.431153 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c15b977-1608-45e8-8bbd-b2bd5c1eff21 could not be found. Oct 05 02:41:43.431153 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:43.431153 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-796bb562-28a2-4ad7-842e-e7c7aaa34f10 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Returning 404 to user: Instance 1c15b977-1608-45e8-8bbd-b2bd5c1eff21 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:41:43.431153 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-796bb562-28a2-4ad7-842e-e7c7aaa34f10 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 404 len: 111 microversion: 2.20 time: 0.076757 Oct 05 02:41:43.431153 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1624/3232] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:41:43 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:41:43.438305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-559c8e0d-746a-48ae-a2aa-50d4d8712341 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '.version_select at 0x7fcce81cba60>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:43.532521 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-559c8e0d-746a-48ae-a2aa-50d4d8712341 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1831050844" status: 204 len: 0 microversion: 2.20 time: 0.097358 Oct 05 02:41:43.537646 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1625/3233] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 5 02:41:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1831050844 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 05 02:41:43.641575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-183b85ca-17ae-420b-9470-45b38d4de1ba tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:43.642502 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-183b85ca-17ae-420b-9470-45b38d4de1ba tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:43.675597 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-183b85ca-17ae-420b-9470-45b38d4de1ba tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:43.676254 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-183b85ca-17ae-420b-9470-45b38d4de1ba tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:43.676722 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-183b85ca-17ae-420b-9470-45b38d4de1ba tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:43.682000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-183b85ca-17ae-420b-9470-45b38d4de1ba tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:43.683115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-183b85ca-17ae-420b-9470-45b38d4de1ba tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:43.683581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-183b85ca-17ae-420b-9470-45b38d4de1ba tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:44.184515 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6b366ccb-ed14-414a-9a66-9c8fe1466a14 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:44.213102 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6b366ccb-ed14-414a-9a66-9c8fe1466a14 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1514 microversion: 2.1 time: 1.037937 Oct 05 02:41:44.214460 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1609/3234] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:43 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1514 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:44.217321 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-183b85ca-17ae-420b-9470-45b38d4de1ba tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:44.220805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:44.223392 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2da1321d-7029-4372-81f5-61873d9143de tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:44.224321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2da1321d-7029-4372-81f5-61873d9143de tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:44.239230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2da1321d-7029-4372-81f5-61873d9143de tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:44.241043 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2da1321d-7029-4372-81f5-61873d9143de tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:44.241934 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2da1321d-7029-4372-81f5-61873d9143de tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:44.243919 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-183b85ca-17ae-420b-9470-45b38d4de1ba tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1365 microversion: 2.1 time: 0.603585 Oct 05 02:41:44.245316 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1626/3235] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:43 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1365 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:44.247652 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2da1321d-7029-4372-81f5-61873d9143de tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:44.253831 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2da1321d-7029-4372-81f5-61873d9143de tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:44.254820 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2da1321d-7029-4372-81f5-61873d9143de tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:44.377214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1448e16e-ca26-480f-bf47-201d1c46618a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:44.377836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1448e16e-ca26-480f-bf47-201d1c46618a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: de6a6594-881f-489b-8b94-28b74e935c1e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:44.386366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1448e16e-ca26-480f-bf47-201d1c46618a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:44.386864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1448e16e-ca26-480f-bf47-201d1c46618a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:44.387299 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1448e16e-ca26-480f-bf47-201d1c46618a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:44.388005 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1448e16e-ca26-480f-bf47-201d1c46618a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:44.388453 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1448e16e-ca26-480f-bf47-201d1c46618a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:44.388875 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1448e16e-ca26-480f-bf47-201d1c46618a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:44.457821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1448e16e-ca26-480f-bf47-201d1c46618a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:44.458674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1448e16e-ca26-480f-bf47-201d1c46618a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:44.459309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1448e16e-ca26-480f-bf47-201d1c46618a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:44.460005 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-1448e16e-ca26-480f-bf47-201d1c46618a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lazy-loading 'fault' on Instance uuid de6a6594-881f-489b-8b94-28b74e935c1e {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:41:44.573132 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1448e16e-ca26-480f-bf47-201d1c46618a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:44.584985 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1448e16e-ca26-480f-bf47-201d1c46618a tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/de6a6594-881f-489b-8b94-28b74e935c1e" status: 200 len: 1309 microversion: 2.1 time: 0.210719 Oct 05 02:41:44.586777 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1627/3236] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:44 2022] GET /compute/v2.1/servers/de6a6594-881f-489b-8b94-28b74e935c1e => generated 1309 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:44.592156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2da1321d-7029-4372-81f5-61873d9143de tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:44.604954 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2da1321d-7029-4372-81f5-61873d9143de tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1538 microversion: 2.1 time: 0.389067 Oct 05 02:41:44.605565 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1610/3237] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:44 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1538 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:45.192250 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-d0102a84-c48a-4a1d-ba39-779509338c03 req-ce98718e-725c-4e1c-a514-9a899a5080c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6a6594-881f-489b-8b94-28b74e935c1e", "name": "network-vif-deleted", "tag": "a96fd765-4343-4dce-aab3-f848781564f5"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:41:45.209822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d0102a84-c48a-4a1d-ba39-779509338c03 req-ce98718e-725c-4e1c-a514-9a899a5080c0 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:45.212758 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d0102a84-c48a-4a1d-ba39-779509338c03 req-ce98718e-725c-4e1c-a514-9a899a5080c0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:45.213445 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d0102a84-c48a-4a1d-ba39-779509338c03 req-ce98718e-725c-4e1c-a514-9a899a5080c0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:45.231296 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-d0102a84-c48a-4a1d-ba39-779509338c03 req-ce98718e-725c-4e1c-a514-9a899a5080c0 service nova] Creating event network-vif-deleted:a96fd765-4343-4dce-aab3-f848781564f5 for instance de6a6594-881f-489b-8b94-28b74e935c1e on n-h1-858272-3 Oct 05 02:41:45.243564 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-d0102a84-c48a-4a1d-ba39-779509338c03 req-ce98718e-725c-4e1c-a514-9a899a5080c0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051088 Oct 05 02:41:45.246302 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1628/3238] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:41:45.250029 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6261554a-a688-4aed-8318-0bb7f403fa80 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:45.251459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6261554a-a688-4aed-8318-0bb7f403fa80 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:45.259448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6261554a-a688-4aed-8318-0bb7f403fa80 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:45.260398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6261554a-a688-4aed-8318-0bb7f403fa80 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:45.261418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6261554a-a688-4aed-8318-0bb7f403fa80 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:45.263232 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6261554a-a688-4aed-8318-0bb7f403fa80 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:45.264031 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6261554a-a688-4aed-8318-0bb7f403fa80 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:45.264990 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6261554a-a688-4aed-8318-0bb7f403fa80 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:45.283877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3dad705e-6fe5-4e26-adf0-3787fdd36601 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:45.287164 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3dad705e-6fe5-4e26-adf0-3787fdd36601 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:45.317569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3dad705e-6fe5-4e26-adf0-3787fdd36601 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:45.318480 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3dad705e-6fe5-4e26-adf0-3787fdd36601 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:45.319161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3dad705e-6fe5-4e26-adf0-3787fdd36601 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:45.320138 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3dad705e-6fe5-4e26-adf0-3787fdd36601 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:45.321664 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3dad705e-6fe5-4e26-adf0-3787fdd36601 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:45.322372 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3dad705e-6fe5-4e26-adf0-3787fdd36601 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:45.628302 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6261554a-a688-4aed-8318-0bb7f403fa80 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:45.642127 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6261554a-a688-4aed-8318-0bb7f403fa80 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1532 microversion: 2.1 time: 0.402060 Oct 05 02:41:45.643355 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1611/3239] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:45 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1532 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:45.650610 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f7e2987e-159d-484b-a764-709ce7b2db96 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:45.651602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f7e2987e-159d-484b-a764-709ce7b2db96 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: de6a6594-881f-489b-8b94-28b74e935c1e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:45.658277 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7e2987e-159d-484b-a764-709ce7b2db96 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:45.670286 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7e2987e-159d-484b-a764-709ce7b2db96 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:45.673322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7e2987e-159d-484b-a764-709ce7b2db96 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:45.674357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7e2987e-159d-484b-a764-709ce7b2db96 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:45.676929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7e2987e-159d-484b-a764-709ce7b2db96 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:45.677643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7e2987e-159d-484b-a764-709ce7b2db96 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:45.706100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3dad705e-6fe5-4e26-adf0-3787fdd36601 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:45.720256 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3dad705e-6fe5-4e26-adf0-3787fdd36601 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1365 microversion: 2.1 time: 0.451883 Oct 05 02:41:45.725263 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1629/3240] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:45 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1365 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:45.735580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-804fde25-1d07-476a-a921-1e85657e882d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:45.736293 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-804fde25-1d07-476a-a921-1e85657e882d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:45.746198 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-804fde25-1d07-476a-a921-1e85657e882d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:45.746785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-804fde25-1d07-476a-a921-1e85657e882d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:45.747298 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-804fde25-1d07-476a-a921-1e85657e882d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:45.748778 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-804fde25-1d07-476a-a921-1e85657e882d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:45.750394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-804fde25-1d07-476a-a921-1e85657e882d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:45.750394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-804fde25-1d07-476a-a921-1e85657e882d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:45.787680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:45.789587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7e2987e-159d-484b-a764-709ce7b2db96 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:45.790148 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7e2987e-159d-484b-a764-709ce7b2db96 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:45.795350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7e2987e-159d-484b-a764-709ce7b2db96 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:45.796036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-f7e2987e-159d-484b-a764-709ce7b2db96 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lazy-loading 'fault' on Instance uuid de6a6594-881f-489b-8b94-28b74e935c1e {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:41:45.903663 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f7e2987e-159d-484b-a764-709ce7b2db96 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:45.917724 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f7e2987e-159d-484b-a764-709ce7b2db96 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/de6a6594-881f-489b-8b94-28b74e935c1e" status: 200 len: 1309 microversion: 2.1 time: 0.268577 Oct 05 02:41:45.933775 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1612/3241] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:45 2022] GET /compute/v2.1/servers/de6a6594-881f-489b-8b94-28b74e935c1e => generated 1309 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:46.004029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-804fde25-1d07-476a-a921-1e85657e882d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:46.014673 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-804fde25-1d07-476a-a921-1e85657e882d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1538 microversion: 2.1 time: 0.288026 Oct 05 02:41:46.026548 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1630/3242] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:45 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1538 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:46.667883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f398e1bf-fb4c-41b9-8e10-e79e0c418949 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:46.668840 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f398e1bf-fb4c-41b9-8e10-e79e0c418949 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:46.680540 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f398e1bf-fb4c-41b9-8e10-e79e0c418949 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:46.685217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f398e1bf-fb4c-41b9-8e10-e79e0c418949 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:46.686271 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f398e1bf-fb4c-41b9-8e10-e79e0c418949 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:46.688750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f398e1bf-fb4c-41b9-8e10-e79e0c418949 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:46.689487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f398e1bf-fb4c-41b9-8e10-e79e0c418949 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:46.691096 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f398e1bf-fb4c-41b9-8e10-e79e0c418949 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:46.751295 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e5eb4917-5744-4229-8b3f-33af6eb781b2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:46.751859 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e5eb4917-5744-4229-8b3f-33af6eb781b2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:46.787405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5eb4917-5744-4229-8b3f-33af6eb781b2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:46.788814 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5eb4917-5744-4229-8b3f-33af6eb781b2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:46.796359 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5eb4917-5744-4229-8b3f-33af6eb781b2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:46.797701 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5eb4917-5744-4229-8b3f-33af6eb781b2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:46.798969 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5eb4917-5744-4229-8b3f-33af6eb781b2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:46.802718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5eb4917-5744-4229-8b3f-33af6eb781b2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:47.116572 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f398e1bf-fb4c-41b9-8e10-e79e0c418949 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:47.129462 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f398e1bf-fb4c-41b9-8e10-e79e0c418949 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1520 microversion: 2.1 time: 0.466015 Oct 05 02:41:47.131399 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1613/3243] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:46 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1520 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:47.137546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8333779f-9ea2-4e19-8779-60688f06f0ec tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:47.138480 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8333779f-9ea2-4e19-8779-60688f06f0ec tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: de6a6594-881f-489b-8b94-28b74e935c1e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:47.149069 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8333779f-9ea2-4e19-8779-60688f06f0ec tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:47.149992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8333779f-9ea2-4e19-8779-60688f06f0ec tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:47.150912 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8333779f-9ea2-4e19-8779-60688f06f0ec tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:47.152442 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8333779f-9ea2-4e19-8779-60688f06f0ec tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:47.153563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8333779f-9ea2-4e19-8779-60688f06f0ec tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:47.154492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8333779f-9ea2-4e19-8779-60688f06f0ec tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:47.208423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e5eb4917-5744-4229-8b3f-33af6eb781b2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:47.226581 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e5eb4917-5744-4229-8b3f-33af6eb781b2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1365 microversion: 2.1 time: 0.483045 Oct 05 02:41:47.227183 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1631/3244] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:46 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1365 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:47.232041 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3a176f58-471f-49f2-adb7-cef62d66e731 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:47.239936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3a176f58-471f-49f2-adb7-cef62d66e731 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:47.247113 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8333779f-9ea2-4e19-8779-60688f06f0ec tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:47.247614 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8333779f-9ea2-4e19-8779-60688f06f0ec tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:47.249534 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3a176f58-471f-49f2-adb7-cef62d66e731 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:47.250267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8333779f-9ea2-4e19-8779-60688f06f0ec tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:47.250929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-8333779f-9ea2-4e19-8779-60688f06f0ec tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lazy-loading 'fault' on Instance uuid de6a6594-881f-489b-8b94-28b74e935c1e {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:41:47.253677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3a176f58-471f-49f2-adb7-cef62d66e731 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:47.254730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3a176f58-471f-49f2-adb7-cef62d66e731 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:47.255704 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3a176f58-471f-49f2-adb7-cef62d66e731 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:47.256177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3a176f58-471f-49f2-adb7-cef62d66e731 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:47.256629 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3a176f58-471f-49f2-adb7-cef62d66e731 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:47.335879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8333779f-9ea2-4e19-8779-60688f06f0ec tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:47.354301 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8333779f-9ea2-4e19-8779-60688f06f0ec tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/de6a6594-881f-489b-8b94-28b74e935c1e" status: 200 len: 1309 microversion: 2.1 time: 0.221180 Oct 05 02:41:47.364770 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1614/3245] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:47 2022] GET /compute/v2.1/servers/de6a6594-881f-489b-8b94-28b74e935c1e => generated 1309 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:47.524364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3a176f58-471f-49f2-adb7-cef62d66e731 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:47.554111 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3a176f58-471f-49f2-adb7-cef62d66e731 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1538 microversion: 2.1 time: 0.325691 Oct 05 02:41:47.555664 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1632/3246] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:47 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1538 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:47.812802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-bfe14cb1-a3b8-4156-9eec-d6cd563d8003 req-4f9d58cc-b597-4fdd-9007-05d5a1326e82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6e3897-5115-4283-804d-abaa483786fc", "name": "network-vif-unplugged", "status": "completed", "tag": "4aff4e1f-3112-4ceb-b24d-2327b404029f"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:41:47.826673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-bfe14cb1-a3b8-4156-9eec-d6cd563d8003 req-4f9d58cc-b597-4fdd-9007-05d5a1326e82 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:47.827651 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-bfe14cb1-a3b8-4156-9eec-d6cd563d8003 req-4f9d58cc-b597-4fdd-9007-05d5a1326e82 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:47.828579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-bfe14cb1-a3b8-4156-9eec-d6cd563d8003 req-4f9d58cc-b597-4fdd-9007-05d5a1326e82 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:47.849447 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-bfe14cb1-a3b8-4156-9eec-d6cd563d8003 req-4f9d58cc-b597-4fdd-9007-05d5a1326e82 service nova] Creating event network-vif-unplugged:4aff4e1f-3112-4ceb-b24d-2327b404029f for instance 0d6e3897-5115-4283-804d-abaa483786fc on n-h1-858272-3 Oct 05 02:41:47.857822 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-bfe14cb1-a3b8-4156-9eec-d6cd563d8003 req-4f9d58cc-b597-4fdd-9007-05d5a1326e82 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048450 Oct 05 02:41:47.859469 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1615/3247] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:41:48.161020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9eb2d8e5-06d5-48ba-a0ea-dc322f55d70b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:48.162832 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9eb2d8e5-06d5-48ba-a0ea-dc322f55d70b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:48.169918 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9eb2d8e5-06d5-48ba-a0ea-dc322f55d70b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:48.171132 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9eb2d8e5-06d5-48ba-a0ea-dc322f55d70b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:48.171816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9eb2d8e5-06d5-48ba-a0ea-dc322f55d70b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:48.172963 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9eb2d8e5-06d5-48ba-a0ea-dc322f55d70b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:48.173636 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9eb2d8e5-06d5-48ba-a0ea-dc322f55d70b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:48.174290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9eb2d8e5-06d5-48ba-a0ea-dc322f55d70b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:48.257487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-86ab8c7d-75fa-4e22-8b43-d4713baf0cf2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:48.258218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-86ab8c7d-75fa-4e22-8b43-d4713baf0cf2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:48.268323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86ab8c7d-75fa-4e22-8b43-d4713baf0cf2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:48.274241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86ab8c7d-75fa-4e22-8b43-d4713baf0cf2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:48.275554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86ab8c7d-75fa-4e22-8b43-d4713baf0cf2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:48.276697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86ab8c7d-75fa-4e22-8b43-d4713baf0cf2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:48.277410 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86ab8c7d-75fa-4e22-8b43-d4713baf0cf2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:48.278215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86ab8c7d-75fa-4e22-8b43-d4713baf0cf2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:48.481149 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9eb2d8e5-06d5-48ba-a0ea-dc322f55d70b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:48.493703 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9eb2d8e5-06d5-48ba-a0ea-dc322f55d70b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1520 microversion: 2.1 time: 0.337504 Oct 05 02:41:48.495007 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1633/3248] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:48 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1520 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:48.500893 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6ea8fed3-b3ba-476c-bf5c-ee30c5d14b4a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:48.501884 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6ea8fed3-b3ba-476c-bf5c-ee30c5d14b4a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:48.509583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ea8fed3-b3ba-476c-bf5c-ee30c5d14b4a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:48.510442 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ea8fed3-b3ba-476c-bf5c-ee30c5d14b4a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:48.511097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ea8fed3-b3ba-476c-bf5c-ee30c5d14b4a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:48.512161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ea8fed3-b3ba-476c-bf5c-ee30c5d14b4a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:48.512782 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ea8fed3-b3ba-476c-bf5c-ee30c5d14b4a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:48.513407 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ea8fed3-b3ba-476c-bf5c-ee30c5d14b4a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:48.533523 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-6ea8fed3-b3ba-476c-bf5c-ee30c5d14b4a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] HTTP exception thrown: Instance 1c15b977-1608-45e8-8bbd-b2bd5c1eff21 could not be found. Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6ea8fed3-b3ba-476c-bf5c-ee30c5d14b4a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Request method failure captured: Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 HTTP/1.1 Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOytiS7b2tK0awcEIotX_usFegY2tGFUeOktlSay5uZeJJlr1mgaMspizter-ThNcnxIA0JGrv8A75MOFzYgHfQXUiIxbzFruC5wIt6llgJ6488NxjhbOhnRVT5nq01W7iSZsvlLO6bsqUodskpKK_NcAurDwc6wAUp_KMwStZczpro Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: X-Openstack-Nova-Api-Version: 2.20 Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 3b649132448b44278c6dd55cdb6ff3de Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1773917274 Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3b649132448b44278c6dd55cdb6ff3de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3b649132448b44278c6dd55cdb6ff3de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3b649132448b44278c6dd55cdb6ff3de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3b649132448b44278c6dd55cdb6ff3de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1773917274 Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 3b649132448b44278c6dd55cdb6ff3de Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1773917274 Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-AttachVolumeShelveTestJSON-1773917274-project Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: e4b5243d9ffe46c4b32033da558d1e2c Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1773917274-project Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 1c15b977-1608-45e8-8bbd-b2bd5c1eff21 could not be found. Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '1c15b977-1608-45e8-8bbd-b2bd5c1eff21'} Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c15b977-1608-45e8-8bbd-b2bd5c1eff21 could not be found. Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:41:48.536001 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:41:48.541460 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c15b977-1608-45e8-8bbd-b2bd5c1eff21 could not be found. Oct 05 02:41:48.541460 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:48.541460 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:41:48.541460 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:48.541460 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:41:48.541460 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:41:48.541460 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:41:48.541460 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:41:48.541460 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:41:48.541460 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c15b977-1608-45e8-8bbd-b2bd5c1eff21 could not be found. Oct 05 02:41:48.541460 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:48.541460 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6ea8fed3-b3ba-476c-bf5c-ee30c5d14b4a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Returning 404 to user: Instance 1c15b977-1608-45e8-8bbd-b2bd5c1eff21 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:41:48.541460 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6ea8fed3-b3ba-476c-bf5c-ee30c5d14b4a tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 404 len: 111 microversion: 2.20 time: 0.041082 Oct 05 02:41:48.541460 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1634/3249] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 5 02:41:48 2022] DELETE /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:41:48.543458 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-db3e85bb-0d02-49ab-8e94-ab74d94fc4d6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:48.543458 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-db3e85bb-0d02-49ab-8e94-ab74d94fc4d6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: de6a6594-881f-489b-8b94-28b74e935c1e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:48.550701 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db3e85bb-0d02-49ab-8e94-ab74d94fc4d6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:48.550982 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db3e85bb-0d02-49ab-8e94-ab74d94fc4d6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:48.551414 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db3e85bb-0d02-49ab-8e94-ab74d94fc4d6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:48.552320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db3e85bb-0d02-49ab-8e94-ab74d94fc4d6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:48.553515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db3e85bb-0d02-49ab-8e94-ab74d94fc4d6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:48.554421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-86ab8c7d-75fa-4e22-8b43-d4713baf0cf2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:48.555246 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db3e85bb-0d02-49ab-8e94-ab74d94fc4d6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:48.565282 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-86ab8c7d-75fa-4e22-8b43-d4713baf0cf2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1365 microversion: 2.1 time: 0.313122 Oct 05 02:41:48.566322 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1616/3250] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:48 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1365 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:41:48.574394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d828c66a-e14f-4d1a-aecc-b57739aa08c1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:48.574394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d828c66a-e14f-4d1a-aecc-b57739aa08c1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 1c15b977-1608-45e8-8bbd-b2bd5c1eff21] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:48.584259 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d828c66a-e14f-4d1a-aecc-b57739aa08c1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:48.585212 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d828c66a-e14f-4d1a-aecc-b57739aa08c1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:48.586199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d828c66a-e14f-4d1a-aecc-b57739aa08c1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:48.587959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d828c66a-e14f-4d1a-aecc-b57739aa08c1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:48.588721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d828c66a-e14f-4d1a-aecc-b57739aa08c1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:48.589502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d828c66a-e14f-4d1a-aecc-b57739aa08c1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:48.608004 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-d828c66a-e14f-4d1a-aecc-b57739aa08c1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] HTTP exception thrown: Instance 1c15b977-1608-45e8-8bbd-b2bd5c1eff21 could not be found. Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d828c66a-e14f-4d1a-aecc-b57739aa08c1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Request method failure captured: Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 HTTP/1.1 Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOytiS7b2tK0awcEIotX_usFegY2tGFUeOktlSay5uZeJJlr1mgaMspizter-ThNcnxIA0JGrv8A75MOFzYgHfQXUiIxbzFruC5wIt6llgJ6488NxjhbOhnRVT5nq01W7iSZsvlLO6bsqUodskpKK_NcAurDwc6wAUp_KMwStZczpro Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: X-Openstack-Nova-Api-Version: 2.20 Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 3b649132448b44278c6dd55cdb6ff3de Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1773917274 Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3b649132448b44278c6dd55cdb6ff3de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3b649132448b44278c6dd55cdb6ff3de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3b649132448b44278c6dd55cdb6ff3de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3b649132448b44278c6dd55cdb6ff3de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1773917274 Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 3b649132448b44278c6dd55cdb6ff3de Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1773917274 Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-AttachVolumeShelveTestJSON-1773917274-project Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: e4b5243d9ffe46c4b32033da558d1e2c Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1773917274-project Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 1c15b977-1608-45e8-8bbd-b2bd5c1eff21 could not be found. Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '1c15b977-1608-45e8-8bbd-b2bd5c1eff21'} Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c15b977-1608-45e8-8bbd-b2bd5c1eff21 could not be found. Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c15b977-1608-45e8-8bbd-b2bd5c1eff21 could not be found. Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:41:48.610257 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:41:48.615898 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:41:48.615898 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:41:48.615898 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:41:48.615898 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:41:48.615898 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:41:48.615898 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:41:48.615898 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c15b977-1608-45e8-8bbd-b2bd5c1eff21 could not be found. Oct 05 02:41:48.615898 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:41:48.618072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d828c66a-e14f-4d1a-aecc-b57739aa08c1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Returning 404 to user: Instance 1c15b977-1608-45e8-8bbd-b2bd5c1eff21 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:41:48.619315 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d828c66a-e14f-4d1a-aecc-b57739aa08c1 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21" status: 404 len: 111 microversion: 2.20 time: 0.051840 Oct 05 02:41:48.620471 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1617/3251] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:41:48 2022] GET /compute/v2.1/servers/1c15b977-1608-45e8-8bbd-b2bd5c1eff21 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:41:48.626141 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db3e85bb-0d02-49ab-8e94-ab74d94fc4d6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:48.633238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db3e85bb-0d02-49ab-8e94-ab74d94fc4d6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:48.635897 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db3e85bb-0d02-49ab-8e94-ab74d94fc4d6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:48.636380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-db3e85bb-0d02-49ab-8e94-ab74d94fc4d6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lazy-loading 'fault' on Instance uuid de6a6594-881f-489b-8b94-28b74e935c1e {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:41:48.637242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-38cac7be-0b97-4afb-9f2d-cefbe977965b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:48.638031 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-38cac7be-0b97-4afb-9f2d-cefbe977965b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:48.686003 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-38cac7be-0b97-4afb-9f2d-cefbe977965b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:48.686389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-38cac7be-0b97-4afb-9f2d-cefbe977965b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:48.686838 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-38cac7be-0b97-4afb-9f2d-cefbe977965b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:48.687583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-38cac7be-0b97-4afb-9f2d-cefbe977965b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:48.688041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-38cac7be-0b97-4afb-9f2d-cefbe977965b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:48.688467 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-38cac7be-0b97-4afb-9f2d-cefbe977965b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:48.707098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-db3e85bb-0d02-49ab-8e94-ab74d94fc4d6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:48.715551 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-db3e85bb-0d02-49ab-8e94-ab74d94fc4d6 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/de6a6594-881f-489b-8b94-28b74e935c1e" status: 200 len: 1309 microversion: 2.1 time: 0.176537 Oct 05 02:41:48.716983 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1635/3252] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:48 2022] GET /compute/v2.1/servers/de6a6594-881f-489b-8b94-28b74e935c1e => generated 1309 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:48.916949 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-38cac7be-0b97-4afb-9f2d-cefbe977965b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:48.925519 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-38cac7be-0b97-4afb-9f2d-cefbe977965b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1538 microversion: 2.1 time: 0.303605 Oct 05 02:41:48.927015 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1618/3253] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:48 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1538 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:49.520360 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9be3cbff-0deb-4ca5-9fb6-4eb7c2f0af72 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:49.521180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9be3cbff-0deb-4ca5-9fb6-4eb7c2f0af72 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:49.541135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9be3cbff-0deb-4ca5-9fb6-4eb7c2f0af72 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:49.550745 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9be3cbff-0deb-4ca5-9fb6-4eb7c2f0af72 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:49.551331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9be3cbff-0deb-4ca5-9fb6-4eb7c2f0af72 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:49.552154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9be3cbff-0deb-4ca5-9fb6-4eb7c2f0af72 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:49.552715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9be3cbff-0deb-4ca5-9fb6-4eb7c2f0af72 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:49.553602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9be3cbff-0deb-4ca5-9fb6-4eb7c2f0af72 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:49.590749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f332250b-335c-4a9e-8e0e-619a3c32ecff tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:49.591793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f332250b-335c-4a9e-8e0e-619a3c32ecff tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:49.613680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f332250b-335c-4a9e-8e0e-619a3c32ecff tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:49.614402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f332250b-335c-4a9e-8e0e-619a3c32ecff tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:49.616232 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f332250b-335c-4a9e-8e0e-619a3c32ecff tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:49.618420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f332250b-335c-4a9e-8e0e-619a3c32ecff tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:49.620397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f332250b-335c-4a9e-8e0e-619a3c32ecff tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:49.621339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f332250b-335c-4a9e-8e0e-619a3c32ecff tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:49.899956 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9be3cbff-0deb-4ca5-9fb6-4eb7c2f0af72 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:49.914475 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9be3cbff-0deb-4ca5-9fb6-4eb7c2f0af72 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1520 microversion: 2.1 time: 0.399590 Oct 05 02:41:49.918950 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1636/3254] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:49 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1520 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:49.933990 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0cf061ac-b49a-41be-b9e5-b7896cc9cb4b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:49.936304 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0cf061ac-b49a-41be-b9e5-b7896cc9cb4b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: de6a6594-881f-489b-8b94-28b74e935c1e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:49.957330 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0cf061ac-b49a-41be-b9e5-b7896cc9cb4b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:49.959196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0cf061ac-b49a-41be-b9e5-b7896cc9cb4b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:49.960280 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0cf061ac-b49a-41be-b9e5-b7896cc9cb4b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:49.963312 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0cf061ac-b49a-41be-b9e5-b7896cc9cb4b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:49.965719 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0cf061ac-b49a-41be-b9e5-b7896cc9cb4b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:49.967247 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0cf061ac-b49a-41be-b9e5-b7896cc9cb4b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:50.055033 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0cf061ac-b49a-41be-b9e5-b7896cc9cb4b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:50.055626 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0cf061ac-b49a-41be-b9e5-b7896cc9cb4b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:50.055989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0cf061ac-b49a-41be-b9e5-b7896cc9cb4b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:50.056454 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-0cf061ac-b49a-41be-b9e5-b7896cc9cb4b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lazy-loading 'fault' on Instance uuid de6a6594-881f-489b-8b94-28b74e935c1e {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:41:50.214803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0cf061ac-b49a-41be-b9e5-b7896cc9cb4b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:50.230748 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0cf061ac-b49a-41be-b9e5-b7896cc9cb4b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/de6a6594-881f-489b-8b94-28b74e935c1e" status: 200 len: 1309 microversion: 2.1 time: 0.307422 Oct 05 02:41:50.233222 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1637/3255] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:49 2022] GET /compute/v2.1/servers/de6a6594-881f-489b-8b94-28b74e935c1e => generated 1309 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:50.242115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-92d26d04-0330-4ed6-873a-9fd6138f0545 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:50.243072 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-92d26d04-0330-4ed6-873a-9fd6138f0545 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:50.274205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92d26d04-0330-4ed6-873a-9fd6138f0545 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:50.275286 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92d26d04-0330-4ed6-873a-9fd6138f0545 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:50.276683 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92d26d04-0330-4ed6-873a-9fd6138f0545 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:50.279362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92d26d04-0330-4ed6-873a-9fd6138f0545 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:50.280273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f332250b-335c-4a9e-8e0e-619a3c32ecff tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:50.280778 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92d26d04-0330-4ed6-873a-9fd6138f0545 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:50.282785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92d26d04-0330-4ed6-873a-9fd6138f0545 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:50.292737 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f332250b-335c-4a9e-8e0e-619a3c32ecff tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1365 microversion: 2.1 time: 0.707211 Oct 05 02:41:50.294467 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1619/3256] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:49 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1365 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:50.300677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-7aacb220-4e97-4443-810b-7e1056d13aad req-57442e90-33b2-4592-9926-9ccafb0a71bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4388e9ec-13a9-4d5b-9310-7a10953c57d0", "name": "network-vif-plugged", "status": "completed", "tag": "17b098e0-7358-489c-bec3-6b98c1db0796"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:41:50.314643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7aacb220-4e97-4443-810b-7e1056d13aad req-57442e90-33b2-4592-9926-9ccafb0a71bf service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:50.315449 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7aacb220-4e97-4443-810b-7e1056d13aad req-57442e90-33b2-4592-9926-9ccafb0a71bf service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:50.316362 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7aacb220-4e97-4443-810b-7e1056d13aad req-57442e90-33b2-4592-9926-9ccafb0a71bf service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:50.335876 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-7aacb220-4e97-4443-810b-7e1056d13aad req-57442e90-33b2-4592-9926-9ccafb0a71bf service nova] Creating event network-vif-plugged:17b098e0-7358-489c-bec3-6b98c1db0796 for instance 4388e9ec-13a9-4d5b-9310-7a10953c57d0 on n-h1-858272-3 Oct 05 02:41:50.341756 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-7aacb220-4e97-4443-810b-7e1056d13aad req-57442e90-33b2-4592-9926-9ccafb0a71bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045724 Oct 05 02:41:50.343372 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1620/3257] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:41:50.353807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-34018c1d-95b5-4d42-9955-9187b731c93d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-721259272", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "7eb36c67-cef1-4873-b3dd-8e6ff90077c0"}], "security_groups": [{"name": "tempest-securitygroup--569521925"}], "key_name": "tempest-keypair-7082707", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "4857b2a2-f6a5-48d9-9381-8b0d46054da4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:41:50.615083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-34018c1d-95b5-4d42-9955-9187b731c93d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] validate_networks() for [('7eb36c67-cef1-4873-b3dd-8e6ff90077c0', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:41:51.134514 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-92d26d04-0330-4ed6-873a-9fd6138f0545 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:51.148912 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-92d26d04-0330-4ed6-873a-9fd6138f0545 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1538 microversion: 2.1 time: 0.913450 Oct 05 02:41:51.149894 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1638/3258] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:50 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1538 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:51.169747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-16251db9-12a3-4772-a2ca-480830e1fd15 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:51.170530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-16251db9-12a3-4772-a2ca-480830e1fd15 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:51.179072 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16251db9-12a3-4772-a2ca-480830e1fd15 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:51.179072 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16251db9-12a3-4772-a2ca-480830e1fd15 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:51.179535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16251db9-12a3-4772-a2ca-480830e1fd15 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:51.180247 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16251db9-12a3-4772-a2ca-480830e1fd15 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:51.180775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16251db9-12a3-4772-a2ca-480830e1fd15 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:51.181457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16251db9-12a3-4772-a2ca-480830e1fd15 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:51.428109 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-16251db9-12a3-4772-a2ca-480830e1fd15 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:51.439788 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-16251db9-12a3-4772-a2ca-480830e1fd15 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1520 microversion: 2.1 time: 0.286079 Oct 05 02:41:51.439788 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1639/3259] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:51 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1520 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:51.448915 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-84847efc-8636-414b-8ce3-f0d2abfd2c69 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:51.449939 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-84847efc-8636-414b-8ce3-f0d2abfd2c69 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: de6a6594-881f-489b-8b94-28b74e935c1e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:51.456924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84847efc-8636-414b-8ce3-f0d2abfd2c69 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:51.457620 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84847efc-8636-414b-8ce3-f0d2abfd2c69 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:51.458230 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84847efc-8636-414b-8ce3-f0d2abfd2c69 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:51.459116 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84847efc-8636-414b-8ce3-f0d2abfd2c69 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:51.459581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84847efc-8636-414b-8ce3-f0d2abfd2c69 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:51.460019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84847efc-8636-414b-8ce3-f0d2abfd2c69 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:51.479395 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-84847efc-8636-414b-8ce3-f0d2abfd2c69 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] HTTP exception thrown: Instance de6a6594-881f-489b-8b94-28b74e935c1e could not be found. Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-84847efc-8636-414b-8ce3-f0d2abfd2c69 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Request method failure captured: Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/de6a6594-881f-489b-8b94-28b74e935c1e HTTP/1.1 Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO3rxm78ro_lNid6Y0mfn-jyk6yAO5lWqW8Lr16wE4MCHagKAeauvptfZCvHaJ-6doq4nQv84xoFEpGRxvpNSA8Zrv8qJa_I5PWdE0F_gyAXlJijeV0AOJD3fyv6ynFZOJHx-riqsCQLfbqmpKoB-zpHICxlYmWXXCF5clocFvQOwXs Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: f5a44c2cd99949c2a30ab83bdede01e6 Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersOnMultiNodesTest-1239008232 Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5a44c2cd99949c2a30ab83bdede01e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5a44c2cd99949c2a30ab83bdede01e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f5a44c2cd99949c2a30ab83bdede01e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f5a44c2cd99949c2a30ab83bdede01e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersOnMultiNodesTest-1239008232 Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: f5a44c2cd99949c2a30ab83bdede01e6 Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1239008232 Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersOnMultiNodesTest-1239008232-project Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: b86e3b7d1c9a4b2c8f2914beefa74cc1 Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersOnMultiNodesTest-1239008232-project Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance de6a6594-881f-489b-8b94-28b74e935c1e could not be found. Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'de6a6594-881f-489b-8b94-28b74e935c1e'} Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de6a6594-881f-489b-8b94-28b74e935c1e could not be found. Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de6a6594-881f-489b-8b94-28b74e935c1e could not be found. Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:41:51.481371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:51.486438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:41:51.486438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:41:51.486438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:41:51.486438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:41:51.486438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:41:51.486438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de6a6594-881f-489b-8b94-28b74e935c1e could not be found. Oct 05 02:41:51.486438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:51.489154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-84847efc-8636-414b-8ce3-f0d2abfd2c69 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Returning 404 to user: Instance de6a6594-881f-489b-8b94-28b74e935c1e could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:41:51.490024 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-84847efc-8636-414b-8ce3-f0d2abfd2c69 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/de6a6594-881f-489b-8b94-28b74e935c1e" status: 404 len: 111 microversion: 2.1 time: 0.049298 Oct 05 02:41:51.490794 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1640/3260] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:51 2022] GET /compute/v2.1/servers/de6a6594-881f-489b-8b94-28b74e935c1e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:41:51.495621 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b62ca968-29e1-4348-b6d0-77715067e715 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:51.496238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b62ca968-29e1-4348-b6d0-77715067e715 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:51.503092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b62ca968-29e1-4348-b6d0-77715067e715 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:51.504111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b62ca968-29e1-4348-b6d0-77715067e715 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:51.504556 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b62ca968-29e1-4348-b6d0-77715067e715 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:51.505285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b62ca968-29e1-4348-b6d0-77715067e715 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:51.505745 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b62ca968-29e1-4348-b6d0-77715067e715 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:51.506172 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b62ca968-29e1-4348-b6d0-77715067e715 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:51.662668 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-34018c1d-95b5-4d42-9955-9187b731c93d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Getting quotas for project 2ced783ca2614e7996ccac3bc9ad97c7. Resources: dict_keys(['metadata_items']) {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:41:51.671395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-34018c1d-95b5-4d42-9955-9187b731c93d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Getting quotas for user 6746153a53d94c4a9b8d1167a7fa7c4a and project 2ced783ca2614e7996ccac3bc9ad97c7. Resources: dict_keys(['metadata_items']) {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:41:51.685130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-34018c1d-95b5-4d42-9955-9187b731c93d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:41:51.685875 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-34018c1d-95b5-4d42-9955-9187b731c93d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:41:51.686508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-34018c1d-95b5-4d42-9955-9187b731c93d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:41:51.687071 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-34018c1d-95b5-4d42-9955-9187b731c93d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:41:51.687649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-34018c1d-95b5-4d42-9955-9187b731c93d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:41:51.698119 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-34018c1d-95b5-4d42-9955-9187b731c93d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:51.698775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-34018c1d-95b5-4d42-9955-9187b731c93d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:51.699228 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-34018c1d-95b5-4d42-9955-9187b731c93d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:51.699982 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-34018c1d-95b5-4d42-9955-9187b731c93d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:51.700420 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b62ca968-29e1-4348-b6d0-77715067e715 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:51.700576 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-34018c1d-95b5-4d42-9955-9187b731c93d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:51.700855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-34018c1d-95b5-4d42-9955-9187b731c93d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:51.715892 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b62ca968-29e1-4348-b6d0-77715067e715 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1365 microversion: 2.1 time: 0.224241 Oct 05 02:41:51.720391 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1641/3261] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:51 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:51.721381 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-75ed47ac-c7f6-48ea-a022-4d5c825af600 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:51.722914 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-75ed47ac-c7f6-48ea-a022-4d5c825af600 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 37204911-40f0-4356-a6df-7fda8afbf5da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:51.729389 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75ed47ac-c7f6-48ea-a022-4d5c825af600 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:51.730094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75ed47ac-c7f6-48ea-a022-4d5c825af600 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:51.730696 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75ed47ac-c7f6-48ea-a022-4d5c825af600 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:51.731582 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75ed47ac-c7f6-48ea-a022-4d5c825af600 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:51.732202 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75ed47ac-c7f6-48ea-a022-4d5c825af600 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:51.732790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75ed47ac-c7f6-48ea-a022-4d5c825af600 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:51.749575 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-34018c1d-95b5-4d42-9955-9187b731c93d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Getting quotas for project 2ced783ca2614e7996ccac3bc9ad97c7. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:41:51.752360 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-75ed47ac-c7f6-48ea-a022-4d5c825af600 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] HTTP exception thrown: Instance 37204911-40f0-4356-a6df-7fda8afbf5da could not be found. Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-75ed47ac-c7f6-48ea-a022-4d5c825af600 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Request method failure captured: Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da HTTP/1.1 Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO3rxm78ro_lNid6Y0mfn-jyk6yAO5lWqW8Lr16wE4MCHagKAeauvptfZCvHaJ-6doq4nQv84xoFEpGRxvpNSA8Zrv8qJa_I5PWdE0F_gyAXlJijeV0AOJD3fyv6ynFZOJHx-riqsCQLfbqmpKoB-zpHICxlYmWXXCF5clocFvQOwXs Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: f5a44c2cd99949c2a30ab83bdede01e6 Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersOnMultiNodesTest-1239008232 Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5a44c2cd99949c2a30ab83bdede01e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5a44c2cd99949c2a30ab83bdede01e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f5a44c2cd99949c2a30ab83bdede01e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f5a44c2cd99949c2a30ab83bdede01e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersOnMultiNodesTest-1239008232 Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: f5a44c2cd99949c2a30ab83bdede01e6 Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1239008232 Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersOnMultiNodesTest-1239008232-project Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: b86e3b7d1c9a4b2c8f2914beefa74cc1 Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersOnMultiNodesTest-1239008232-project Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 37204911-40f0-4356-a6df-7fda8afbf5da could not be found. Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '37204911-40f0-4356-a6df-7fda8afbf5da'} Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37204911-40f0-4356-a6df-7fda8afbf5da could not be found. Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37204911-40f0-4356-a6df-7fda8afbf5da could not be found. Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:41:51.754209 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:51.759274 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:41:51.759274 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:41:51.759274 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:41:51.759274 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:41:51.759274 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:41:51.759274 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37204911-40f0-4356-a6df-7fda8afbf5da could not be found. Oct 05 02:41:51.759274 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:51.760818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-75ed47ac-c7f6-48ea-a022-4d5c825af600 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Returning 404 to user: Instance 37204911-40f0-4356-a6df-7fda8afbf5da could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:41:51.761741 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-75ed47ac-c7f6-48ea-a022-4d5c825af600 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da" status: 404 len: 111 microversion: 2.1 time: 0.043888 Oct 05 02:41:51.762643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-34018c1d-95b5-4d42-9955-9187b731c93d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Getting quotas for user 6746153a53d94c4a9b8d1167a7fa7c4a and project 2ced783ca2614e7996ccac3bc9ad97c7. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:41:51.762790 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1642/3262] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:51 2022] GET /compute/v2.1/servers/37204911-40f0-4356-a6df-7fda8afbf5da => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:41:51.773198 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-171bb744-a9c0-49e7-8b6d-4bda9d434a51 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:51.813559 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-171bb744-a9c0-49e7-8b6d-4bda9d434a51 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/8204c863-c4a9-45b5-80b6-8a22caf9efc6" status: 204 len: 0 microversion: 2.1 time: 0.046404 Oct 05 02:41:51.814641 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1643/3263] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 5 02:41:51 2022] DELETE /compute/v2.1/os-server-groups/8204c863-c4a9-45b5-80b6-8a22caf9efc6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 02:41:51.826133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d31d7532-5f0d-4465-b924-ebfd7aafd0dd tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:51.826652 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d31d7532-5f0d-4465-b924-ebfd7aafd0dd tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: d216853e-3fda-40f8-be89-56e8756c83a8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:51.840750 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d31d7532-5f0d-4465-b924-ebfd7aafd0dd tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:51.841288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d31d7532-5f0d-4465-b924-ebfd7aafd0dd tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:51.841732 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d31d7532-5f0d-4465-b924-ebfd7aafd0dd tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:51.842441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d31d7532-5f0d-4465-b924-ebfd7aafd0dd tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:51.842911 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d31d7532-5f0d-4465-b924-ebfd7aafd0dd tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:51.843344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d31d7532-5f0d-4465-b924-ebfd7aafd0dd tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:51.855357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-34018c1d-95b5-4d42-9955-9187b731c93d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:41:51.858132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-34018c1d-95b5-4d42-9955-9187b731c93d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4857b2a2-f6a5-48d9-9381-8b0d46054da4',volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:41:51.895634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d31d7532-5f0d-4465-b924-ebfd7aafd0dd tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: d216853e-3fda-40f8-be89-56e8756c83a8] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:41:51.976558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:52.033101 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d31d7532-5f0d-4465-b924-ebfd7aafd0dd tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d216853e-3fda-40f8-be89-56e8756c83a8" status: 204 len: 0 microversion: 2.1 time: 0.204351 Oct 05 02:41:52.037950 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1644/3264] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:41:51 2022] DELETE /compute/v2.1/servers/d216853e-3fda-40f8-be89-56e8756c83a8 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:41:52.054777 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5ce54531-3506-4ea3-a6f3-ae51d8ffddff tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:52.056409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5ce54531-3506-4ea3-a6f3-ae51d8ffddff tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 549e9e9b-0461-402c-a082-4f6a85a6e3c8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:52.067611 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5ce54531-3506-4ea3-a6f3-ae51d8ffddff tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:52.068716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5ce54531-3506-4ea3-a6f3-ae51d8ffddff tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:52.069732 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5ce54531-3506-4ea3-a6f3-ae51d8ffddff tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:52.071438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5ce54531-3506-4ea3-a6f3-ae51d8ffddff tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:52.073382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5ce54531-3506-4ea3-a6f3-ae51d8ffddff tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:52.074422 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5ce54531-3506-4ea3-a6f3-ae51d8ffddff tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:52.108558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5ce54531-3506-4ea3-a6f3-ae51d8ffddff tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 549e9e9b-0461-402c-a082-4f6a85a6e3c8] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:41:52.129029 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-34018c1d-95b5-4d42-9955-9187b731c93d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.783924 Oct 05 02:41:52.130000 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1621/3265] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:41:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 1786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:41:52.157871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8b5b901e-b0d2-4985-9abe-bbe7a06994dd tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:52.159122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8b5b901e-b0d2-4985-9abe-bbe7a06994dd tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:52.253270 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5ce54531-3506-4ea3-a6f3-ae51d8ffddff tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "DELETE /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8" status: 204 len: 0 microversion: 2.1 time: 0.209281 Oct 05 02:41:52.254050 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1645/3266] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:41:52 2022] DELETE /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 02:41:52.260471 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5017721d-6cae-4938-a416-9023bf6b5795 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:52.260751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8b5b901e-b0d2-4985-9abe-bbe7a06994dd tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:52.261297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5017721d-6cae-4938-a416-9023bf6b5795 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:52.268215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5017721d-6cae-4938-a416-9023bf6b5795 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:52.269229 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5017721d-6cae-4938-a416-9023bf6b5795 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:52.269822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5017721d-6cae-4938-a416-9023bf6b5795 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:52.270699 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5017721d-6cae-4938-a416-9023bf6b5795 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:52.271268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5017721d-6cae-4938-a416-9023bf6b5795 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:52.271586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5017721d-6cae-4938-a416-9023bf6b5795 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:52.275068 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8b5b901e-b0d2-4985-9abe-bbe7a06994dd tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 200 len: 1118 microversion: 2.1 time: 0.127524 Oct 05 02:41:52.287845 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1622/3267] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:52 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 1118 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:52.299826 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-992b9662-b19b-483f-a33d-c7b02768cb57 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:52.305644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-992b9662-b19b-483f-a33d-c7b02768cb57 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: d216853e-3fda-40f8-be89-56e8756c83a8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:52.320389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-992b9662-b19b-483f-a33d-c7b02768cb57 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:52.321622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-992b9662-b19b-483f-a33d-c7b02768cb57 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:52.322274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-992b9662-b19b-483f-a33d-c7b02768cb57 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:52.323884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-992b9662-b19b-483f-a33d-c7b02768cb57 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:52.324572 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-992b9662-b19b-483f-a33d-c7b02768cb57 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:52.325295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-992b9662-b19b-483f-a33d-c7b02768cb57 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:52.565759 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5017721d-6cae-4938-a416-9023bf6b5795 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:52.574915 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-992b9662-b19b-483f-a33d-c7b02768cb57 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:52.579570 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5017721d-6cae-4938-a416-9023bf6b5795 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1543 microversion: 2.1 time: 0.319960 Oct 05 02:41:52.580272 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1646/3268] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:52 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1543 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:52.585493 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-992b9662-b19b-483f-a33d-c7b02768cb57 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/d216853e-3fda-40f8-be89-56e8756c83a8" status: 200 len: 1475 microversion: 2.1 time: 0.294368 Oct 05 02:41:52.586392 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1623/3269] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:52 2022] GET /compute/v2.1/servers/d216853e-3fda-40f8-be89-56e8756c83a8 => generated 1475 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:52.586524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4088a954-cd1b-4715-ae66-5218daabe00d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:52.587142 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4088a954-cd1b-4715-ae66-5218daabe00d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:52.595870 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=5,nova_api:UPDATE=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:52.604214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4088a954-cd1b-4715-ae66-5218daabe00d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:52.608079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4088a954-cd1b-4715-ae66-5218daabe00d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:52.608841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4088a954-cd1b-4715-ae66-5218daabe00d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:52.610017 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4088a954-cd1b-4715-ae66-5218daabe00d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:52.610703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4088a954-cd1b-4715-ae66-5218daabe00d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:52.611386 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4088a954-cd1b-4715-ae66-5218daabe00d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:52.741504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6c3f4a22-e106-4737-b369-bc3f313b9ede tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:52.743089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6c3f4a22-e106-4737-b369-bc3f313b9ede tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:52.758711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c3f4a22-e106-4737-b369-bc3f313b9ede tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:52.759584 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c3f4a22-e106-4737-b369-bc3f313b9ede tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:52.760260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c3f4a22-e106-4737-b369-bc3f313b9ede tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:52.763145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c3f4a22-e106-4737-b369-bc3f313b9ede tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:52.763934 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c3f4a22-e106-4737-b369-bc3f313b9ede tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:52.764665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c3f4a22-e106-4737-b369-bc3f313b9ede tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:52.929478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4088a954-cd1b-4715-ae66-5218daabe00d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:52.945476 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4088a954-cd1b-4715-ae66-5218daabe00d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1520 microversion: 2.1 time: 0.363888 Oct 05 02:41:52.946394 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1647/3270] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:52 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1520 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:53.006506 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6c3f4a22-e106-4737-b369-bc3f313b9ede tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:53.017532 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6c3f4a22-e106-4737-b369-bc3f313b9ede tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1365 microversion: 2.1 time: 0.279968 Oct 05 02:41:53.034617 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1624/3271] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:52 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1365 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:53.173170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c95af58c-2122-4bbc-822c-929bcc042796 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:53.173671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c95af58c-2122-4bbc-822c-929bcc042796 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:53.182063 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c95af58c-2122-4bbc-822c-929bcc042796 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:53.182560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c95af58c-2122-4bbc-822c-929bcc042796 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:53.182989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c95af58c-2122-4bbc-822c-929bcc042796 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:53.183696 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c95af58c-2122-4bbc-822c-929bcc042796 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:53.184148 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c95af58c-2122-4bbc-822c-929bcc042796 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:53.184567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c95af58c-2122-4bbc-822c-929bcc042796 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:53.203345 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-c95af58c-2122-4bbc-822c-929bcc042796 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] HTTP exception thrown: Instance 7a28c6ea-5b3d-4f74-b490-8effa4fa813d could not be found. Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c95af58c-2122-4bbc-822c-929bcc042796 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Request method failure captured: Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d HTTP/1.1 Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPOytiS7b2tK0awcEIotX_usFegY2tGFUeOktlSay5uZeJJlr1mgaMspizter-ThNcnxIA0JGrv8A75MOFzYgHfQXUiIxbzFruC5wIt6llgJ6488NxjhbOhnRVT5nq01W7iSZsvlLO6bsqUodskpKK_NcAurDwc6wAUp_KMwStZczpro Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: X-Openstack-Nova-Api-Version: 2.20 Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 3b649132448b44278c6dd55cdb6ff3de Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1773917274 Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3b649132448b44278c6dd55cdb6ff3de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3b649132448b44278c6dd55cdb6ff3de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3b649132448b44278c6dd55cdb6ff3de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3b649132448b44278c6dd55cdb6ff3de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1773917274 Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 3b649132448b44278c6dd55cdb6ff3de Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1773917274 Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-AttachVolumeShelveTestJSON-1773917274-project Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: e4b5243d9ffe46c4b32033da558d1e2c Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1773917274-project Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 7a28c6ea-5b3d-4f74-b490-8effa4fa813d could not be found. Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '7a28c6ea-5b3d-4f74-b490-8effa4fa813d'} Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a28c6ea-5b3d-4f74-b490-8effa4fa813d could not be found. Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:41:53.205048 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:41:53.210382 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a28c6ea-5b3d-4f74-b490-8effa4fa813d could not be found. Oct 05 02:41:53.210382 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:53.210382 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:41:53.210382 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:53.210382 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:41:53.210382 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:41:53.210382 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:41:53.210382 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:41:53.210382 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:41:53.210382 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a28c6ea-5b3d-4f74-b490-8effa4fa813d could not be found. Oct 05 02:41:53.210382 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:41:53.210382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c95af58c-2122-4bbc-822c-929bcc042796 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Returning 404 to user: Instance 7a28c6ea-5b3d-4f74-b490-8effa4fa813d could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:41:53.210382 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c95af58c-2122-4bbc-822c-929bcc042796 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 404 len: 111 microversion: 2.20 time: 0.038524 Oct 05 02:41:53.211625 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1648/3272] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 5 02:41:53 2022] DELETE /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:41:53.216196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1bf210de-ae31-41f9-b58e-a42a62f31df5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:53.219625 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1bf210de-ae31-41f9-b58e-a42a62f31df5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] [instance: 7a28c6ea-5b3d-4f74-b490-8effa4fa813d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:53.226612 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1bf210de-ae31-41f9-b58e-a42a62f31df5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:53.227115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1bf210de-ae31-41f9-b58e-a42a62f31df5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:53.227554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1bf210de-ae31-41f9-b58e-a42a62f31df5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:53.228269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1bf210de-ae31-41f9-b58e-a42a62f31df5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:53.228727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1bf210de-ae31-41f9-b58e-a42a62f31df5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:53.229177 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1bf210de-ae31-41f9-b58e-a42a62f31df5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:53.244139 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-1bf210de-ae31-41f9-b58e-a42a62f31df5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] HTTP exception thrown: Instance 7a28c6ea-5b3d-4f74-b490-8effa4fa813d could not be found. Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1bf210de-ae31-41f9-b58e-a42a62f31df5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Request method failure captured: Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d HTTP/1.1 Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPOytiS7b2tK0awcEIotX_usFegY2tGFUeOktlSay5uZeJJlr1mgaMspizter-ThNcnxIA0JGrv8A75MOFzYgHfQXUiIxbzFruC5wIt6llgJ6488NxjhbOhnRVT5nq01W7iSZsvlLO6bsqUodskpKK_NcAurDwc6wAUp_KMwStZczpro Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: X-Openstack-Nova-Api-Version: 2.20 Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 3b649132448b44278c6dd55cdb6ff3de Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1773917274 Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3b649132448b44278c6dd55cdb6ff3de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3b649132448b44278c6dd55cdb6ff3de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3b649132448b44278c6dd55cdb6ff3de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3b649132448b44278c6dd55cdb6ff3de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1773917274 Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 3b649132448b44278c6dd55cdb6ff3de Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1773917274 Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-AttachVolumeShelveTestJSON-1773917274-project Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: e4b5243d9ffe46c4b32033da558d1e2c Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1773917274-project Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 7a28c6ea-5b3d-4f74-b490-8effa4fa813d could not be found. Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '7a28c6ea-5b3d-4f74-b490-8effa4fa813d'} Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a28c6ea-5b3d-4f74-b490-8effa4fa813d could not be found. Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a28c6ea-5b3d-4f74-b490-8effa4fa813d could not be found. Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:41:53.245867 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:41:53.250660 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:41:53.250660 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:41:53.250660 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:41:53.250660 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:41:53.250660 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:41:53.250660 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:41:53.250660 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a28c6ea-5b3d-4f74-b490-8effa4fa813d could not be found. Oct 05 02:41:53.250660 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:41:53.250660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1bf210de-ae31-41f9-b58e-a42a62f31df5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] Returning 404 to user: Instance 7a28c6ea-5b3d-4f74-b490-8effa4fa813d could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:41:53.250660 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1bf210de-ae31-41f9-b58e-a42a62f31df5 tempest-AttachVolumeShelveTestJSON-1773917274 tempest-AttachVolumeShelveTestJSON-1773917274-project] 10.222.0.16 "GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d" status: 404 len: 111 microversion: 2.20 time: 0.034981 Oct 05 02:41:53.250660 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1625/3273] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:41:53 2022] GET /compute/v2.1/servers/7a28c6ea-5b3d-4f74-b490-8effa4fa813d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:41:53.300844 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3121f1e3-766a-452a-8af4-c4389815e42d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:53.301613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3121f1e3-766a-452a-8af4-c4389815e42d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:53.308790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3121f1e3-766a-452a-8af4-c4389815e42d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:53.309547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3121f1e3-766a-452a-8af4-c4389815e42d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:53.310084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3121f1e3-766a-452a-8af4-c4389815e42d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:53.310922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3121f1e3-766a-452a-8af4-c4389815e42d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:53.311491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3121f1e3-766a-452a-8af4-c4389815e42d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:53.312135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3121f1e3-766a-452a-8af4-c4389815e42d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:53.419796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3121f1e3-766a-452a-8af4-c4389815e42d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:53.435128 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3121f1e3-766a-452a-8af4-c4389815e42d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 200 len: 1168 microversion: 2.1 time: 0.139477 Oct 05 02:41:53.449960 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1649/3274] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:53 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 1168 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:53.620251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3c048bb1-17d4-481d-b486-94830a145e0f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:53.621083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3c048bb1-17d4-481d-b486-94830a145e0f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:53.630967 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ce6504ec-9a26-444c-a3f7-274881ab50e1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:53.631875 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ce6504ec-9a26-444c-a3f7-274881ab50e1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: d216853e-3fda-40f8-be89-56e8756c83a8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:53.633378 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c048bb1-17d4-481d-b486-94830a145e0f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:53.635033 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c048bb1-17d4-481d-b486-94830a145e0f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:53.635555 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c048bb1-17d4-481d-b486-94830a145e0f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:53.637916 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c048bb1-17d4-481d-b486-94830a145e0f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:53.638461 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c048bb1-17d4-481d-b486-94830a145e0f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:53.638964 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c048bb1-17d4-481d-b486-94830a145e0f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:53.642676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce6504ec-9a26-444c-a3f7-274881ab50e1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:53.644447 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce6504ec-9a26-444c-a3f7-274881ab50e1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:53.645302 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce6504ec-9a26-444c-a3f7-274881ab50e1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:53.652497 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce6504ec-9a26-444c-a3f7-274881ab50e1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:53.653396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce6504ec-9a26-444c-a3f7-274881ab50e1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:53.654053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce6504ec-9a26-444c-a3f7-274881ab50e1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:53.994787 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ce6504ec-9a26-444c-a3f7-274881ab50e1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:54.002527 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ce6504ec-9a26-444c-a3f7-274881ab50e1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/d216853e-3fda-40f8-be89-56e8756c83a8" status: 200 len: 1475 microversion: 2.1 time: 0.378164 Oct 05 02:41:54.019505 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1650/3275] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:53 2022] GET /compute/v2.1/servers/d216853e-3fda-40f8-be89-56e8756c83a8 => generated 1475 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:41:54.024624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f42e2c0b-0988-4152-91da-fe3c9d303b2f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:54.025492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f42e2c0b-0988-4152-91da-fe3c9d303b2f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:54.031670 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f42e2c0b-0988-4152-91da-fe3c9d303b2f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:54.032169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f42e2c0b-0988-4152-91da-fe3c9d303b2f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:54.032653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f42e2c0b-0988-4152-91da-fe3c9d303b2f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:54.033655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f42e2c0b-0988-4152-91da-fe3c9d303b2f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:54.034459 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f42e2c0b-0988-4152-91da-fe3c9d303b2f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:54.035103 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f42e2c0b-0988-4152-91da-fe3c9d303b2f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:54.099571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3c048bb1-17d4-481d-b486-94830a145e0f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:54.108125 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3c048bb1-17d4-481d-b486-94830a145e0f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1543 microversion: 2.1 time: 0.491634 Oct 05 02:41:54.124948 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1626/3276] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:53 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1543 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:54.130961 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-471f997a-d175-49f9-8d0a-d482afbe162d req-e54a28f0-4a7e-4907-bf7e-e6b9dc2a6205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6e3897-5115-4283-804d-abaa483786fc", "name": "network-vif-plugged", "status": "completed", "tag": "4aff4e1f-3112-4ceb-b24d-2327b404029f"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:41:54.141047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-471f997a-d175-49f9-8d0a-d482afbe162d req-e54a28f0-4a7e-4907-bf7e-e6b9dc2a6205 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:54.141529 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-471f997a-d175-49f9-8d0a-d482afbe162d req-e54a28f0-4a7e-4907-bf7e-e6b9dc2a6205 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:54.141962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-471f997a-d175-49f9-8d0a-d482afbe162d req-e54a28f0-4a7e-4907-bf7e-e6b9dc2a6205 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:54.154811 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-471f997a-d175-49f9-8d0a-d482afbe162d req-e54a28f0-4a7e-4907-bf7e-e6b9dc2a6205 service nova] Creating event network-vif-plugged:4aff4e1f-3112-4ceb-b24d-2327b404029f for instance 0d6e3897-5115-4283-804d-abaa483786fc on n-h1-858272-3 Oct 05 02:41:54.160474 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-471f997a-d175-49f9-8d0a-d482afbe162d req-e54a28f0-4a7e-4907-bf7e-e6b9dc2a6205 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033154 Oct 05 02:41:54.161289 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1627/3277] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:41:54.167137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-01f2f64c-b35a-4977-97cd-f4e7002c4224 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:54.168068 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-01f2f64c-b35a-4977-97cd-f4e7002c4224 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:54.175519 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01f2f64c-b35a-4977-97cd-f4e7002c4224 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:54.176247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01f2f64c-b35a-4977-97cd-f4e7002c4224 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:54.176779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01f2f64c-b35a-4977-97cd-f4e7002c4224 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:54.177529 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01f2f64c-b35a-4977-97cd-f4e7002c4224 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:54.178001 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01f2f64c-b35a-4977-97cd-f4e7002c4224 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:54.178420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01f2f64c-b35a-4977-97cd-f4e7002c4224 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:54.319163 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f42e2c0b-0988-4152-91da-fe3c9d303b2f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:54.328101 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f42e2c0b-0988-4152-91da-fe3c9d303b2f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1520 microversion: 2.1 time: 0.307262 Oct 05 02:41:54.328677 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1651/3278] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:54 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1520 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:54.459984 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a212e778-fbec-493c-897c-ac22d0f513d7 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:54.460633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a212e778-fbec-493c-897c-ac22d0f513d7 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:54.466934 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a212e778-fbec-493c-897c-ac22d0f513d7 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:54.467420 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a212e778-fbec-493c-897c-ac22d0f513d7 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:54.467855 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a212e778-fbec-493c-897c-ac22d0f513d7 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:54.468581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a212e778-fbec-493c-897c-ac22d0f513d7 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:54.469084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a212e778-fbec-493c-897c-ac22d0f513d7 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:54.469508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a212e778-fbec-493c-897c-ac22d0f513d7 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:54.481348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-01f2f64c-b35a-4977-97cd-f4e7002c4224 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:54.493730 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-01f2f64c-b35a-4977-97cd-f4e7002c4224 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1551 microversion: 2.1 time: 0.329518 Oct 05 02:41:54.497540 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1628/3279] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:54 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1551 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:54.517295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-da332d73-4867-4944-8f71-93402cbebb57 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:54.517822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-da332d73-4867-4944-8f71-93402cbebb57 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:54.523885 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da332d73-4867-4944-8f71-93402cbebb57 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:54.524369 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da332d73-4867-4944-8f71-93402cbebb57 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:54.524802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da332d73-4867-4944-8f71-93402cbebb57 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:54.525513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da332d73-4867-4944-8f71-93402cbebb57 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:54.525965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da332d73-4867-4944-8f71-93402cbebb57 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:54.526392 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da332d73-4867-4944-8f71-93402cbebb57 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:54.593437 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a212e778-fbec-493c-897c-ac22d0f513d7 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:54.602345 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a212e778-fbec-493c-897c-ac22d0f513d7 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 200 len: 1168 microversion: 2.1 time: 0.146415 Oct 05 02:41:54.612987 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1652/3280] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:54 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 1168 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:54.679076 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-da332d73-4867-4944-8f71-93402cbebb57 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.165741 Oct 05 02:41:54.679997 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1629/3281] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 02:41:54 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/os-interface => generated 284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:41:55.026872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8a0862b4-5a0b-4697-9f41-950feaafb576 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:55.027889 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8a0862b4-5a0b-4697-9f41-950feaafb576 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: d216853e-3fda-40f8-be89-56e8756c83a8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:55.037771 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a0862b4-5a0b-4697-9f41-950feaafb576 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:55.038558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a0862b4-5a0b-4697-9f41-950feaafb576 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:55.039861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a0862b4-5a0b-4697-9f41-950feaafb576 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:55.040825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a0862b4-5a0b-4697-9f41-950feaafb576 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:55.041416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a0862b4-5a0b-4697-9f41-950feaafb576 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:55.041902 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a0862b4-5a0b-4697-9f41-950feaafb576 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:55.145818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5c90c56a-7832-466f-b3b4-86b7e4e1885a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:55.146992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5c90c56a-7832-466f-b3b4-86b7e4e1885a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:55.158604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c90c56a-7832-466f-b3b4-86b7e4e1885a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:55.159234 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c90c56a-7832-466f-b3b4-86b7e4e1885a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:55.160483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c90c56a-7832-466f-b3b4-86b7e4e1885a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:55.161773 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c90c56a-7832-466f-b3b4-86b7e4e1885a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:55.162615 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c90c56a-7832-466f-b3b4-86b7e4e1885a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:55.163563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c90c56a-7832-466f-b3b4-86b7e4e1885a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:55.189527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:55.514710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8a0862b4-5a0b-4697-9f41-950feaafb576 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:55.527314 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8a0862b4-5a0b-4697-9f41-950feaafb576 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/d216853e-3fda-40f8-be89-56e8756c83a8" status: 200 len: 1475 microversion: 2.1 time: 0.504394 Oct 05 02:41:55.527907 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1653/3282] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:55 2022] GET /compute/v2.1/servers/d216853e-3fda-40f8-be89-56e8756c83a8 => generated 1475 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:55.539047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-af3e2462-b0b4-4520-ac1e-26ace5508db1 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:55.541955 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-af3e2462-b0b4-4520-ac1e-26ace5508db1 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:55.562381 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af3e2462-b0b4-4520-ac1e-26ace5508db1 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:55.564667 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af3e2462-b0b4-4520-ac1e-26ace5508db1 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:55.565159 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af3e2462-b0b4-4520-ac1e-26ace5508db1 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:55.568066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af3e2462-b0b4-4520-ac1e-26ace5508db1 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:55.569232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af3e2462-b0b4-4520-ac1e-26ace5508db1 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:55.571111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af3e2462-b0b4-4520-ac1e-26ace5508db1 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:56.086178 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5c90c56a-7832-466f-b3b4-86b7e4e1885a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:56.094008 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5c90c56a-7832-466f-b3b4-86b7e4e1885a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1543 microversion: 2.1 time: 0.966153 Oct 05 02:41:56.094589 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1630/3283] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:55 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1543 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:56.102238 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7f189350-11bc-4a9f-a3bd-b40ac9c6e2ca tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:56.102848 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7f189350-11bc-4a9f-a3bd-b40ac9c6e2ca tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:56.122076 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f189350-11bc-4a9f-a3bd-b40ac9c6e2ca tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:56.122845 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f189350-11bc-4a9f-a3bd-b40ac9c6e2ca tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:56.123479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f189350-11bc-4a9f-a3bd-b40ac9c6e2ca tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:56.124367 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f189350-11bc-4a9f-a3bd-b40ac9c6e2ca tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:56.125005 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f189350-11bc-4a9f-a3bd-b40ac9c6e2ca tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:56.133974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f189350-11bc-4a9f-a3bd-b40ac9c6e2ca tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:56.463146 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7f189350-11bc-4a9f-a3bd-b40ac9c6e2ca tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:56.472797 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7f189350-11bc-4a9f-a3bd-b40ac9c6e2ca tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 200 len: 1224 microversion: 2.1 time: 0.374202 Oct 05 02:41:56.474701 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1631/3284] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:56 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 1224 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:56.554429 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-627cb931-8804-49a7-9dc5-d3aff786bbe5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:56.554818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-627cb931-8804-49a7-9dc5-d3aff786bbe5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: d216853e-3fda-40f8-be89-56e8756c83a8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:56.569045 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-af3e2462-b0b4-4520-ac1e-26ace5508db1 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:56.578766 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-af3e2462-b0b4-4520-ac1e-26ace5508db1 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1520 microversion: 2.1 time: 1.044085 Oct 05 02:41:56.581757 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-627cb931-8804-49a7-9dc5-d3aff786bbe5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:56.598414 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1654/3285] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:55 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1520 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:56.599366 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-627cb931-8804-49a7-9dc5-d3aff786bbe5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:56.599991 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-627cb931-8804-49a7-9dc5-d3aff786bbe5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:56.601672 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-627cb931-8804-49a7-9dc5-d3aff786bbe5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:56.602569 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-627cb931-8804-49a7-9dc5-d3aff786bbe5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:56.603355 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-627cb931-8804-49a7-9dc5-d3aff786bbe5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:56.779038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-064c0f7d-1ae4-41ea-b6c7-3f228865cfb2 req-337268dc-0492-4746-a150-f1af66369dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549e9e9b-0461-402c-a082-4f6a85a6e3c8", "name": "network-vif-deleted", "tag": "7468d644-c04f-44fd-8a69-34556f7a751d"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:41:56.796558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-064c0f7d-1ae4-41ea-b6c7-3f228865cfb2 req-337268dc-0492-4746-a150-f1af66369dc2 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:56.797075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-064c0f7d-1ae4-41ea-b6c7-3f228865cfb2 req-337268dc-0492-4746-a150-f1af66369dc2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:56.797507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-064c0f7d-1ae4-41ea-b6c7-3f228865cfb2 req-337268dc-0492-4746-a150-f1af66369dc2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:56.833912 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-064c0f7d-1ae4-41ea-b6c7-3f228865cfb2 req-337268dc-0492-4746-a150-f1af66369dc2 service nova] Creating event network-vif-deleted:7468d644-c04f-44fd-8a69-34556f7a751d for instance 549e9e9b-0461-402c-a082-4f6a85a6e3c8 on n-h1-858272-3 Oct 05 02:41:56.863022 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-064c0f7d-1ae4-41ea-b6c7-3f228865cfb2 req-337268dc-0492-4746-a150-f1af66369dc2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087911 Oct 05 02:41:56.863953 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1655/3286] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:41:57.126763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0f467223-2659-4bca-a6fa-941fbce23caf tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:57.127862 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0f467223-2659-4bca-a6fa-941fbce23caf tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:57.140442 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f467223-2659-4bca-a6fa-941fbce23caf tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:57.141381 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f467223-2659-4bca-a6fa-941fbce23caf tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:57.142072 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f467223-2659-4bca-a6fa-941fbce23caf tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:57.143050 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f467223-2659-4bca-a6fa-941fbce23caf tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:57.144351 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f467223-2659-4bca-a6fa-941fbce23caf tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:57.148335 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f467223-2659-4bca-a6fa-941fbce23caf tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:57.518185 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-627cb931-8804-49a7-9dc5-d3aff786bbe5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:57.529279 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-627cb931-8804-49a7-9dc5-d3aff786bbe5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/d216853e-3fda-40f8-be89-56e8756c83a8" status: 200 len: 1475 microversion: 2.1 time: 0.979069 Oct 05 02:41:57.529887 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1632/3287] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:56 2022] GET /compute/v2.1/servers/d216853e-3fda-40f8-be89-56e8756c83a8 => generated 1475 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:57.579981 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0537a482-e8db-4f94-8e87-bd4adc2ca9fd tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:57.583060 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0537a482-e8db-4f94-8e87-bd4adc2ca9fd tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:57.611207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0537a482-e8db-4f94-8e87-bd4adc2ca9fd tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:57.614475 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0537a482-e8db-4f94-8e87-bd4adc2ca9fd tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:57.617639 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0537a482-e8db-4f94-8e87-bd4adc2ca9fd tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:57.621184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0537a482-e8db-4f94-8e87-bd4adc2ca9fd tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:57.621690 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0537a482-e8db-4f94-8e87-bd4adc2ca9fd tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:57.624397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0537a482-e8db-4f94-8e87-bd4adc2ca9fd tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:58.004841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0537a482-e8db-4f94-8e87-bd4adc2ca9fd tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:58.034597 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0537a482-e8db-4f94-8e87-bd4adc2ca9fd tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 200 len: 1234 microversion: 2.1 time: 0.476106 Oct 05 02:41:58.040975 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1633/3288] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:57 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 1234 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:58.071532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4f483dc9-a5e5-4a63-820c-3d7055e08a4b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:58.073122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4f483dc9-a5e5-4a63-820c-3d7055e08a4b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:58.095015 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f483dc9-a5e5-4a63-820c-3d7055e08a4b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:58.102549 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f483dc9-a5e5-4a63-820c-3d7055e08a4b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:58.103590 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f483dc9-a5e5-4a63-820c-3d7055e08a4b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:58.107249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f483dc9-a5e5-4a63-820c-3d7055e08a4b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:58.107827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f483dc9-a5e5-4a63-820c-3d7055e08a4b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:58.108274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f483dc9-a5e5-4a63-820c-3d7055e08a4b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:58.120492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0f467223-2659-4bca-a6fa-941fbce23caf tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:58.130989 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0f467223-2659-4bca-a6fa-941fbce23caf tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1543 microversion: 2.1 time: 1.013263 Oct 05 02:41:58.138328 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1656/3289] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:57 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1543 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:41:58.159373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-630cfd37-a574-4b2d-8172-370a7ebce088 req-75f02329-85de-4864-bac4-388aac0080c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d216853e-3fda-40f8-be89-56e8756c83a8", "name": "network-vif-deleted", "tag": "3cf2d04a-41a2-41a4-999d-f04ae5c6e813"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:41:58.186981 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-630cfd37-a574-4b2d-8172-370a7ebce088 req-75f02329-85de-4864-bac4-388aac0080c1 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:58.203675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-630cfd37-a574-4b2d-8172-370a7ebce088 req-75f02329-85de-4864-bac4-388aac0080c1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:58.206078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-630cfd37-a574-4b2d-8172-370a7ebce088 req-75f02329-85de-4864-bac4-388aac0080c1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:58.279741 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-630cfd37-a574-4b2d-8172-370a7ebce088 req-75f02329-85de-4864-bac4-388aac0080c1 service nova] Creating event network-vif-deleted:3cf2d04a-41a2-41a4-999d-f04ae5c6e813 for instance d216853e-3fda-40f8-be89-56e8756c83a8 on n-h1-858272-3 Oct 05 02:41:58.293892 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-630cfd37-a574-4b2d-8172-370a7ebce088 req-75f02329-85de-4864-bac4-388aac0080c1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153899 Oct 05 02:41:58.296993 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1657/3290] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:41:58.560313 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-062cb053-61d7-4f6e-b865-942be1bc42d5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:58.561335 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-062cb053-61d7-4f6e-b865-942be1bc42d5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: d216853e-3fda-40f8-be89-56e8756c83a8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:58.572922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-062cb053-61d7-4f6e-b865-942be1bc42d5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:58.574195 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-062cb053-61d7-4f6e-b865-942be1bc42d5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:58.575687 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-062cb053-61d7-4f6e-b865-942be1bc42d5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:58.578154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-062cb053-61d7-4f6e-b865-942be1bc42d5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:58.578928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-062cb053-61d7-4f6e-b865-942be1bc42d5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:58.579987 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-062cb053-61d7-4f6e-b865-942be1bc42d5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:58.681478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-062cb053-61d7-4f6e-b865-942be1bc42d5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:58.686278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-062cb053-61d7-4f6e-b865-942be1bc42d5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:58.687787 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-062cb053-61d7-4f6e-b865-942be1bc42d5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:58.689456 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-062cb053-61d7-4f6e-b865-942be1bc42d5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lazy-loading 'fault' on Instance uuid d216853e-3fda-40f8-be89-56e8756c83a8 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:41:59.045007 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-062cb053-61d7-4f6e-b865-942be1bc42d5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:59.056924 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-062cb053-61d7-4f6e-b865-942be1bc42d5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/d216853e-3fda-40f8-be89-56e8756c83a8" status: 200 len: 1309 microversion: 2.1 time: 0.500850 Oct 05 02:41:59.057525 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1658/3291] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:58 2022] GET /compute/v2.1/servers/d216853e-3fda-40f8-be89-56e8756c83a8 => generated 1309 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:59.089841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-548faec3-d6d0-456c-b717-f395aec6ecec req-0cabf00a-b66f-4753-b6d8-e633246b7fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4388e9ec-13a9-4d5b-9310-7a10953c57d0", "tag": "17b098e0-7358-489c-bec3-6b98c1db0796"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:41:59.102370 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-548faec3-d6d0-456c-b717-f395aec6ecec req-0cabf00a-b66f-4753-b6d8-e633246b7fa3 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:59.103144 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-548faec3-d6d0-456c-b717-f395aec6ecec req-0cabf00a-b66f-4753-b6d8-e633246b7fa3 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:59.103754 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-548faec3-d6d0-456c-b717-f395aec6ecec req-0cabf00a-b66f-4753-b6d8-e633246b7fa3 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:59.118724 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-548faec3-d6d0-456c-b717-f395aec6ecec req-0cabf00a-b66f-4753-b6d8-e633246b7fa3 service nova] Creating event network-changed:17b098e0-7358-489c-bec3-6b98c1db0796 for instance 4388e9ec-13a9-4d5b-9310-7a10953c57d0 on n-h1-858272-3 Oct 05 02:41:59.125018 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-548faec3-d6d0-456c-b717-f395aec6ecec req-0cabf00a-b66f-4753-b6d8-e633246b7fa3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047003 Oct 05 02:41:59.127339 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1659/3292] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:41:59.135434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4642e4af-633c-48e8-bb3d-9681f4469a99 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:59.136855 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4642e4af-633c-48e8-bb3d-9681f4469a99 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:59.147819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4642e4af-633c-48e8-bb3d-9681f4469a99 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:59.148878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4642e4af-633c-48e8-bb3d-9681f4469a99 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:59.149606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4642e4af-633c-48e8-bb3d-9681f4469a99 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:59.150539 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4642e4af-633c-48e8-bb3d-9681f4469a99 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:59.151375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4642e4af-633c-48e8-bb3d-9681f4469a99 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:59.152053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4642e4af-633c-48e8-bb3d-9681f4469a99 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:59.802430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4642e4af-633c-48e8-bb3d-9681f4469a99 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:41:59.822661 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4642e4af-633c-48e8-bb3d-9681f4469a99 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 200 len: 1234 microversion: 2.1 time: 0.685276 Oct 05 02:41:59.824374 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1660/3293] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:59 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 1234 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:41:59.858368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f5d8b7e5-10a9-498d-9652-8adeceb6859e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:41:59.864995 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f5d8b7e5-10a9-498d-9652-8adeceb6859e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:41:59.890199 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5d8b7e5-10a9-498d-9652-8adeceb6859e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:59.901563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5d8b7e5-10a9-498d-9652-8adeceb6859e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:59.905840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5d8b7e5-10a9-498d-9652-8adeceb6859e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:41:59.907020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5d8b7e5-10a9-498d-9652-8adeceb6859e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:41:59.908205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5d8b7e5-10a9-498d-9652-8adeceb6859e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:41:59.910553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5d8b7e5-10a9-498d-9652-8adeceb6859e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:00.658001 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4f483dc9-a5e5-4a63-820c-3d7055e08a4b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:00.682807 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4f483dc9-a5e5-4a63-820c-3d7055e08a4b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1505 microversion: 2.1 time: 2.637695 Oct 05 02:42:00.683978 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1634/3294] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:58 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1505 bytes in 2642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:00.695827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d3eac1ee-17f6-417b-994c-5566a94ffea1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:00.696464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d3eac1ee-17f6-417b-994c-5566a94ffea1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: d216853e-3fda-40f8-be89-56e8756c83a8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:00.712199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d3eac1ee-17f6-417b-994c-5566a94ffea1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:00.712709 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d3eac1ee-17f6-417b-994c-5566a94ffea1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:00.713175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d3eac1ee-17f6-417b-994c-5566a94ffea1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:00.713902 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d3eac1ee-17f6-417b-994c-5566a94ffea1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:00.714347 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d3eac1ee-17f6-417b-994c-5566a94ffea1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:00.719883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d3eac1ee-17f6-417b-994c-5566a94ffea1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:00.737254 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-d3eac1ee-17f6-417b-994c-5566a94ffea1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] HTTP exception thrown: Instance d216853e-3fda-40f8-be89-56e8756c83a8 could not be found. Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d3eac1ee-17f6-417b-994c-5566a94ffea1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Request method failure captured: Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/d216853e-3fda-40f8-be89-56e8756c83a8 HTTP/1.1 Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO3rxm78ro_lNid6Y0mfn-jyk6yAO5lWqW8Lr16wE4MCHagKAeauvptfZCvHaJ-6doq4nQv84xoFEpGRxvpNSA8Zrv8qJa_I5PWdE0F_gyAXlJijeV0AOJD3fyv6ynFZOJHx-riqsCQLfbqmpKoB-zpHICxlYmWXXCF5clocFvQOwXs Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: f5a44c2cd99949c2a30ab83bdede01e6 Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersOnMultiNodesTest-1239008232 Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5a44c2cd99949c2a30ab83bdede01e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5a44c2cd99949c2a30ab83bdede01e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f5a44c2cd99949c2a30ab83bdede01e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f5a44c2cd99949c2a30ab83bdede01e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersOnMultiNodesTest-1239008232 Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: f5a44c2cd99949c2a30ab83bdede01e6 Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1239008232 Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersOnMultiNodesTest-1239008232-project Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: b86e3b7d1c9a4b2c8f2914beefa74cc1 Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersOnMultiNodesTest-1239008232-project Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance d216853e-3fda-40f8-be89-56e8756c83a8 could not be found. Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'd216853e-3fda-40f8-be89-56e8756c83a8'} Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d216853e-3fda-40f8-be89-56e8756c83a8 could not be found. Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d216853e-3fda-40f8-be89-56e8756c83a8 could not be found. Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:42:00.739766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:00.745061 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:42:00.745061 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:42:00.745061 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:42:00.745061 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:42:00.745061 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:42:00.745061 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d216853e-3fda-40f8-be89-56e8756c83a8 could not be found. Oct 05 02:42:00.745061 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:00.746342 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d3eac1ee-17f6-417b-994c-5566a94ffea1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Returning 404 to user: Instance d216853e-3fda-40f8-be89-56e8756c83a8 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:42:00.747370 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d3eac1ee-17f6-417b-994c-5566a94ffea1 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/d216853e-3fda-40f8-be89-56e8756c83a8" status: 404 len: 111 microversion: 2.1 time: 0.062229 Oct 05 02:42:00.748616 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1635/3295] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:00 2022] GET /compute/v2.1/servers/d216853e-3fda-40f8-be89-56e8756c83a8 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:42:00.754923 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-68cb62e3-5e5c-4bb2-b1d1-e1a3555d07df tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:00.755768 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-68cb62e3-5e5c-4bb2-b1d1-e1a3555d07df tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:00.763930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68cb62e3-5e5c-4bb2-b1d1-e1a3555d07df tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:00.764643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68cb62e3-5e5c-4bb2-b1d1-e1a3555d07df tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:00.765284 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68cb62e3-5e5c-4bb2-b1d1-e1a3555d07df tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:00.766173 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68cb62e3-5e5c-4bb2-b1d1-e1a3555d07df tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:00.766790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68cb62e3-5e5c-4bb2-b1d1-e1a3555d07df tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:00.767375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68cb62e3-5e5c-4bb2-b1d1-e1a3555d07df tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:01.440661 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f5d8b7e5-10a9-498d-9652-8adeceb6859e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:01.451145 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:01.469498 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f5d8b7e5-10a9-498d-9652-8adeceb6859e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1543 microversion: 2.1 time: 1.625054 Oct 05 02:42:01.471472 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1661/3296] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:41:59 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1543 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:01.477052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0e5e297c-e9d8-4d65-849e-cf3eb5df2ea5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:01.478094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0e5e297c-e9d8-4d65-849e-cf3eb5df2ea5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 549e9e9b-0461-402c-a082-4f6a85a6e3c8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:01.488010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e5e297c-e9d8-4d65-849e-cf3eb5df2ea5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:01.500056 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-68cb62e3-5e5c-4bb2-b1d1-e1a3555d07df tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:01.502794 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e5e297c-e9d8-4d65-849e-cf3eb5df2ea5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:01.505318 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e5e297c-e9d8-4d65-849e-cf3eb5df2ea5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:01.506261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e5e297c-e9d8-4d65-849e-cf3eb5df2ea5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:01.507950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e5e297c-e9d8-4d65-849e-cf3eb5df2ea5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:01.509149 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e5e297c-e9d8-4d65-849e-cf3eb5df2ea5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:01.520264 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-68cb62e3-5e5c-4bb2-b1d1-e1a3555d07df tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 200 len: 1505 microversion: 2.1 time: 0.767645 Oct 05 02:42:01.521305 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1636/3297] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:00 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 1505 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:01.531985 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-29a0ec44-4be4-467e-84b6-fc95fd4aa007 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:01.532883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-29a0ec44-4be4-467e-84b6-fc95fd4aa007 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:01.552132 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-0e5e297c-e9d8-4d65-849e-cf3eb5df2ea5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] HTTP exception thrown: Instance 549e9e9b-0461-402c-a082-4f6a85a6e3c8 could not be found. Oct 05 02:42:01.555439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-29a0ec44-4be4-467e-84b6-fc95fd4aa007 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:01.555962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-29a0ec44-4be4-467e-84b6-fc95fd4aa007 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:01.559074 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-29a0ec44-4be4-467e-84b6-fc95fd4aa007 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:01.559867 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-29a0ec44-4be4-467e-84b6-fc95fd4aa007 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:01.560354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-29a0ec44-4be4-467e-84b6-fc95fd4aa007 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0e5e297c-e9d8-4d65-849e-cf3eb5df2ea5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Request method failure captured: Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8 HTTP/1.1 Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO3rxm78ro_lNid6Y0mfn-jyk6yAO5lWqW8Lr16wE4MCHagKAeauvptfZCvHaJ-6doq4nQv84xoFEpGRxvpNSA8Zrv8qJa_I5PWdE0F_gyAXlJijeV0AOJD3fyv6ynFZOJHx-riqsCQLfbqmpKoB-zpHICxlYmWXXCF5clocFvQOwXs Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: f5a44c2cd99949c2a30ab83bdede01e6 Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersOnMultiNodesTest-1239008232 Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5a44c2cd99949c2a30ab83bdede01e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5a44c2cd99949c2a30ab83bdede01e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f5a44c2cd99949c2a30ab83bdede01e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f5a44c2cd99949c2a30ab83bdede01e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersOnMultiNodesTest-1239008232 Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: f5a44c2cd99949c2a30ab83bdede01e6 Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1239008232 Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersOnMultiNodesTest-1239008232-project Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: b86e3b7d1c9a4b2c8f2914beefa74cc1 Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersOnMultiNodesTest-1239008232-project Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 549e9e9b-0461-402c-a082-4f6a85a6e3c8 could not be found. Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '549e9e9b-0461-402c-a082-4f6a85a6e3c8'} Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 549e9e9b-0461-402c-a082-4f6a85a6e3c8 could not be found. Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 549e9e9b-0461-402c-a082-4f6a85a6e3c8 could not be found. Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:42:01.560641 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:42:01.566304 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:42:01.566304 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:42:01.566304 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:42:01.566304 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:42:01.566304 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:42:01.566304 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 549e9e9b-0461-402c-a082-4f6a85a6e3c8 could not be found. Oct 05 02:42:01.566304 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:42:01.566304 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0e5e297c-e9d8-4d65-849e-cf3eb5df2ea5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Returning 404 to user: Instance 549e9e9b-0461-402c-a082-4f6a85a6e3c8 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:42:01.569929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-29a0ec44-4be4-467e-84b6-fc95fd4aa007 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:01.570032 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0e5e297c-e9d8-4d65-849e-cf3eb5df2ea5 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8" status: 404 len: 111 microversion: 2.1 time: 0.089170 Oct 05 02:42:01.570907 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1662/3298] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:01 2022] GET /compute/v2.1/servers/549e9e9b-0461-402c-a082-4f6a85a6e3c8 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:42:01.580068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2b1bbae3-1465-4293-a755-c55a5e511691 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:01.582971 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2b1bbae3-1465-4293-a755-c55a5e511691 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:01.606194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b1bbae3-1465-4293-a755-c55a5e511691 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:01.607880 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b1bbae3-1465-4293-a755-c55a5e511691 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:01.609267 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b1bbae3-1465-4293-a755-c55a5e511691 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:01.610275 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b1bbae3-1465-4293-a755-c55a5e511691 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:01.613646 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b1bbae3-1465-4293-a755-c55a5e511691 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:01.614816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b1bbae3-1465-4293-a755-c55a5e511691 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:01.681394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2b1bbae3-1465-4293-a755-c55a5e511691 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:42:01.711130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:01.826305 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2b1bbae3-1465-4293-a755-c55a5e511691 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 204 len: 0 microversion: 2.1 time: 0.253583 Oct 05 02:42:01.832680 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1663/3299] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:42:01 2022] DELETE /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:42:01.832680 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-165a18a2-b63f-4c72-b44b-0f118c3871ca tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:01.888760 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-165a18a2-b63f-4c72-b44b-0f118c3871ca tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/ad010c61-f0d8-4de3-8872-599fd3efd892" status: 204 len: 0 microversion: 2.1 time: 0.060464 Oct 05 02:42:01.890921 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1664/3300] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 5 02:42:01 2022] DELETE /compute/v2.1/os-server-groups/ad010c61-f0d8-4de3-8872-599fd3efd892 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:42:01.901111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-72d1763d-9440-4e32-ab2a-16d9aed4cd2f tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:01.901743 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-72d1763d-9440-4e32-ab2a-16d9aed4cd2f tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 6b01f092-c99b-4a47-bdcb-3b6bcdeb0323] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:01.912570 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72d1763d-9440-4e32-ab2a-16d9aed4cd2f tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:01.913418 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72d1763d-9440-4e32-ab2a-16d9aed4cd2f tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:01.914019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72d1763d-9440-4e32-ab2a-16d9aed4cd2f tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:01.915071 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72d1763d-9440-4e32-ab2a-16d9aed4cd2f tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:01.915694 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72d1763d-9440-4e32-ab2a-16d9aed4cd2f tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:01.916333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72d1763d-9440-4e32-ab2a-16d9aed4cd2f tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:01.949056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-72d1763d-9440-4e32-ab2a-16d9aed4cd2f tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 6b01f092-c99b-4a47-bdcb-3b6bcdeb0323] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:42:02.052970 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-72d1763d-9440-4e32-ab2a-16d9aed4cd2f tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323" status: 204 len: 0 microversion: 2.1 time: 0.156891 Oct 05 02:42:02.053973 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1665/3301] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:42:01 2022] DELETE /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:42:02.062248 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8c59adda-e369-4e37-a136-dab8da3c6eb4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-140693072", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "8d324f6f-cca2-40de-b54e-b428e9535a8f"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:42:02.123789 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-8c59adda-e369-4e37-a136-dab8da3c6eb4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] validate_networks() for [('8d324f6f-cca2-40de-b54e-b428e9535a8f', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:42:02.210438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-29a0ec44-4be4-467e-84b6-fc95fd4aa007 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:02.219139 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-29a0ec44-4be4-467e-84b6-fc95fd4aa007 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 200 len: 1301 microversion: 2.1 time: 0.696474 Oct 05 02:42:02.219900 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1637/3302] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:01 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 1301 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:02.233272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a59b5be6-835e-4425-8008-601aecbfda01 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:02.234262 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a59b5be6-835e-4425-8008-601aecbfda01 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 6b01f092-c99b-4a47-bdcb-3b6bcdeb0323] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:02.244245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a59b5be6-835e-4425-8008-601aecbfda01 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:02.244831 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a59b5be6-835e-4425-8008-601aecbfda01 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:02.245426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a59b5be6-835e-4425-8008-601aecbfda01 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:02.246382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a59b5be6-835e-4425-8008-601aecbfda01 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:02.246911 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a59b5be6-835e-4425-8008-601aecbfda01 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:02.247411 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a59b5be6-835e-4425-8008-601aecbfda01 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:02.268126 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=12 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:03.213816 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a59b5be6-835e-4425-8008-601aecbfda01 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:03.229711 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a59b5be6-835e-4425-8008-601aecbfda01 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323" status: 200 len: 1472 microversion: 2.1 time: 1.003050 Oct 05 02:42:03.240984 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1638/3303] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:02 2022] GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323 => generated 1472 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:03.240984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-97086865-d69c-447b-98da-0a79daacd3f6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:03.240984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-97086865-d69c-447b-98da-0a79daacd3f6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:03.261695 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-97086865-d69c-447b-98da-0a79daacd3f6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:03.262211 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-97086865-d69c-447b-98da-0a79daacd3f6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:03.262833 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-97086865-d69c-447b-98da-0a79daacd3f6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:03.267964 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-97086865-d69c-447b-98da-0a79daacd3f6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:03.268475 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-97086865-d69c-447b-98da-0a79daacd3f6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:03.268926 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-97086865-d69c-447b-98da-0a79daacd3f6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:04.139793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-97086865-d69c-447b-98da-0a79daacd3f6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:04.163277 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-97086865-d69c-447b-98da-0a79daacd3f6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1543 microversion: 2.1 time: 0.931443 Oct 05 02:42:04.165497 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1639/3304] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:03 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1543 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:04.170003 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b3de4f9a-8f73-4fea-8fef-16f1ff35a3ec tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:04.170864 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b3de4f9a-8f73-4fea-8fef-16f1ff35a3ec tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:04.178567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3de4f9a-8f73-4fea-8fef-16f1ff35a3ec tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:04.179293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3de4f9a-8f73-4fea-8fef-16f1ff35a3ec tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:04.179833 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3de4f9a-8f73-4fea-8fef-16f1ff35a3ec tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:04.180600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3de4f9a-8f73-4fea-8fef-16f1ff35a3ec tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:04.181266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3de4f9a-8f73-4fea-8fef-16f1ff35a3ec tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:04.181785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3de4f9a-8f73-4fea-8fef-16f1ff35a3ec tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:04.417080 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-8c59adda-e369-4e37-a136-dab8da3c6eb4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:42:04.417555 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-8c59adda-e369-4e37-a136-dab8da3c6eb4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:42:04.418366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-8c59adda-e369-4e37-a136-dab8da3c6eb4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:42:04.418809 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-8c59adda-e369-4e37-a136-dab8da3c6eb4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:42:04.419249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-8c59adda-e369-4e37-a136-dab8da3c6eb4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:42:04.432489 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c59adda-e369-4e37-a136-dab8da3c6eb4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:04.433013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c59adda-e369-4e37-a136-dab8da3c6eb4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:04.433559 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c59adda-e369-4e37-a136-dab8da3c6eb4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:04.434359 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c59adda-e369-4e37-a136-dab8da3c6eb4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:04.434828 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c59adda-e369-4e37-a136-dab8da3c6eb4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:04.435344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c59adda-e369-4e37-a136-dab8da3c6eb4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:04.471284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-8c59adda-e369-4e37-a136-dab8da3c6eb4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Getting quotas for project 58c3c2b9910b4ba48a52cb1e3f1ef254. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:42:04.477280 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-8c59adda-e369-4e37-a136-dab8da3c6eb4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Getting quotas for user 9211cfded73b4747b3cb63bcfb3c3ff8 and project 58c3c2b9910b4ba48a52cb1e3f1ef254. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:42:04.493388 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8c59adda-e369-4e37-a136-dab8da3c6eb4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:42:04.496308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8c59adda-e369-4e37-a136-dab8da3c6eb4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:42:04.554691 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b3de4f9a-8f73-4fea-8fef-16f1ff35a3ec tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:04.563993 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b3de4f9a-8f73-4fea-8fef-16f1ff35a3ec tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 200 len: 1301 microversion: 2.1 time: 0.398341 Oct 05 02:42:04.571423 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8c59adda-e369-4e37-a136-dab8da3c6eb4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.513258 Oct 05 02:42:04.572870 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1666/3305] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:42:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:42:04.577499 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1640/3306] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:04 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 1301 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:04.579988 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-50f8fc6a-df76-4aba-947c-23cfbee2ef14 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:04.581810 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-50f8fc6a-df76-4aba-947c-23cfbee2ef14 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 6b01f092-c99b-4a47-bdcb-3b6bcdeb0323] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:04.588333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-53e563ce-0cbd-40dd-81c3-a3cff703f931 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:04.589009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-53e563ce-0cbd-40dd-81c3-a3cff703f931 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:04.616125 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-50f8fc6a-df76-4aba-947c-23cfbee2ef14 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:04.618781 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-50f8fc6a-df76-4aba-947c-23cfbee2ef14 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:04.620451 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-50f8fc6a-df76-4aba-947c-23cfbee2ef14 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:04.622473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-50f8fc6a-df76-4aba-947c-23cfbee2ef14 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:04.623714 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-50f8fc6a-df76-4aba-947c-23cfbee2ef14 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:04.625298 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-50f8fc6a-df76-4aba-947c-23cfbee2ef14 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:04.875762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-53e563ce-0cbd-40dd-81c3-a3cff703f931 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:04.905997 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-53e563ce-0cbd-40dd-81c3-a3cff703f931 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1217 microversion: 2.1 time: 0.322199 Oct 05 02:42:04.906602 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1641/3307] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:04 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1217 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:04.989176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-fbbc99c6-c4fb-48af-9bbb-8a658cd98a74 req-62e21812-5142-4073-ac45-0df4aee0b7a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d57f876f-018d-4500-8b46-a0ad8983fff5", "tag": "bed4013f-097d-4219-99f5-4d1b78fcda5c"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:42:05.027704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-fbbc99c6-c4fb-48af-9bbb-8a658cd98a74 req-62e21812-5142-4073-ac45-0df4aee0b7a4 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:05.028508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-fbbc99c6-c4fb-48af-9bbb-8a658cd98a74 req-62e21812-5142-4073-ac45-0df4aee0b7a4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:05.029197 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-fbbc99c6-c4fb-48af-9bbb-8a658cd98a74 req-62e21812-5142-4073-ac45-0df4aee0b7a4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:05.072102 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-fbbc99c6-c4fb-48af-9bbb-8a658cd98a74 req-62e21812-5142-4073-ac45-0df4aee0b7a4 service nova] Creating event network-changed:bed4013f-097d-4219-99f5-4d1b78fcda5c for instance d57f876f-018d-4500-8b46-a0ad8983fff5 on n-h1-858272-3 Oct 05 02:42:05.085585 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-fbbc99c6-c4fb-48af-9bbb-8a658cd98a74 req-62e21812-5142-4073-ac45-0df4aee0b7a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101096 Oct 05 02:42:05.089233 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1642/3308] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:42:05.200310 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2cb05c0b-1ab8-4d78-8d13-6cba987b0078 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:05.201621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2cb05c0b-1ab8-4d78-8d13-6cba987b0078 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:05.211557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-50f8fc6a-df76-4aba-947c-23cfbee2ef14 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:05.219229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2cb05c0b-1ab8-4d78-8d13-6cba987b0078 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:05.220658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2cb05c0b-1ab8-4d78-8d13-6cba987b0078 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:05.223117 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2cb05c0b-1ab8-4d78-8d13-6cba987b0078 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:05.224601 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-50f8fc6a-df76-4aba-947c-23cfbee2ef14 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323" status: 200 len: 1472 microversion: 2.1 time: 0.649294 Oct 05 02:42:05.225216 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2cb05c0b-1ab8-4d78-8d13-6cba987b0078 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:05.238248 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1667/3309] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:04 2022] GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323 => generated 1472 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:05.244252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2cb05c0b-1ab8-4d78-8d13-6cba987b0078 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:05.247295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2cb05c0b-1ab8-4d78-8d13-6cba987b0078 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:05.588084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bbc4595d-5438-4ddf-9069-32be135d1eec tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:05.589341 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bbc4595d-5438-4ddf-9069-32be135d1eec tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:05.601380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bbc4595d-5438-4ddf-9069-32be135d1eec tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:05.602113 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bbc4595d-5438-4ddf-9069-32be135d1eec tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:05.602551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bbc4595d-5438-4ddf-9069-32be135d1eec tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:05.603244 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bbc4595d-5438-4ddf-9069-32be135d1eec tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:05.603865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bbc4595d-5438-4ddf-9069-32be135d1eec tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:05.604288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bbc4595d-5438-4ddf-9069-32be135d1eec tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:06.003738 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2cb05c0b-1ab8-4d78-8d13-6cba987b0078 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:06.014611 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2cb05c0b-1ab8-4d78-8d13-6cba987b0078 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1543 microversion: 2.1 time: 0.825841 Oct 05 02:42:06.015891 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1643/3310] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:05 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1543 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:06.096148 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bbc4595d-5438-4ddf-9069-32be135d1eec tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:06.105565 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bbc4595d-5438-4ddf-9069-32be135d1eec tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 200 len: 1289 microversion: 2.1 time: 0.521350 Oct 05 02:42:06.106485 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1668/3311] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:05 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 1289 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:42:06.111357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-329226f8-9b93-443f-bb0c-80517da1e44c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:06.113425 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-329226f8-9b93-443f-bb0c-80517da1e44c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:06.126270 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-329226f8-9b93-443f-bb0c-80517da1e44c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:06.126961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-329226f8-9b93-443f-bb0c-80517da1e44c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:06.129528 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-329226f8-9b93-443f-bb0c-80517da1e44c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:06.130503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-329226f8-9b93-443f-bb0c-80517da1e44c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:06.131491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-329226f8-9b93-443f-bb0c-80517da1e44c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:06.132187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-329226f8-9b93-443f-bb0c-80517da1e44c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:06.276684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-329226f8-9b93-443f-bb0c-80517da1e44c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:06.285193 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-329226f8-9b93-443f-bb0c-80517da1e44c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1269 microversion: 2.1 time: 0.177596 Oct 05 02:42:06.286407 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1669/3312] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:06 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1269 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:06.303865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c61f595b-b72c-4e65-b528-7478e5550e2b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:06.306386 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c61f595b-b72c-4e65-b528-7478e5550e2b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 6b01f092-c99b-4a47-bdcb-3b6bcdeb0323] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:06.317712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c61f595b-b72c-4e65-b528-7478e5550e2b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:06.318354 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c61f595b-b72c-4e65-b528-7478e5550e2b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:06.319707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c61f595b-b72c-4e65-b528-7478e5550e2b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:06.320560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c61f595b-b72c-4e65-b528-7478e5550e2b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:06.321304 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c61f595b-b72c-4e65-b528-7478e5550e2b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:06.322354 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c61f595b-b72c-4e65-b528-7478e5550e2b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:06.371497 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-40d80915-ca52-4327-95d0-962ba2fd6228 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] Action: 'create', calling method: .version_select at 0x7fcce420d040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-932203091"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:42:06.822208 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-40d80915-ca52-4327-95d0-962ba2fd6228 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.804776 Oct 05 02:42:06.822845 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1644/3313] 10.222.0.16 () {60 vars in 1155 bytes} [Wed Oct 5 02:42:06 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 806 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 05 02:42:06.838967 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-20cc8a24-d166-4a14-9e52-f475c7d523fe tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] Calling method '.version_select at 0x7fcce456a8b0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:06.924285 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-20cc8a24-d166-4a14-9e52-f475c7d523fe tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/28310851-175f-4dda-b6a6-5f06155c4d62" status: 200 len: 344 microversion: 2.1 time: 0.089845 Oct 05 02:42:06.926274 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1645/3314] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 02:42:06 2022] GET /compute/v2.1/os-volumes/28310851-175f-4dda-b6a6-5f06155c4d62 => generated 344 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:42:07.043892 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2b260b88-960a-4743-9b18-a93fae77ef74 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:07.044682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2b260b88-960a-4743-9b18-a93fae77ef74 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:07.056111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b260b88-960a-4743-9b18-a93fae77ef74 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:07.057231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b260b88-960a-4743-9b18-a93fae77ef74 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:07.057866 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b260b88-960a-4743-9b18-a93fae77ef74 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:07.059004 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b260b88-960a-4743-9b18-a93fae77ef74 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:07.060169 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b260b88-960a-4743-9b18-a93fae77ef74 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:07.060842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b260b88-960a-4743-9b18-a93fae77ef74 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:07.171942 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c61f595b-b72c-4e65-b528-7478e5550e2b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:07.180682 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c61f595b-b72c-4e65-b528-7478e5550e2b tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323" status: 200 len: 1472 microversion: 2.1 time: 0.893044 Oct 05 02:42:07.181298 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1670/3315] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:06 2022] GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323 => generated 1472 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:07.213957 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5c456d65-44c8-4560-a1d8-960b864d0069 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:07.215532 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5c456d65-44c8-4560-a1d8-960b864d0069 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:07.223463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c456d65-44c8-4560-a1d8-960b864d0069 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:07.223966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c456d65-44c8-4560-a1d8-960b864d0069 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:07.224463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c456d65-44c8-4560-a1d8-960b864d0069 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:07.225191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c456d65-44c8-4560-a1d8-960b864d0069 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:07.225655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c456d65-44c8-4560-a1d8-960b864d0069 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:07.226086 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c456d65-44c8-4560-a1d8-960b864d0069 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:07.463828 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2b260b88-960a-4743-9b18-a93fae77ef74 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:07.477384 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2b260b88-960a-4743-9b18-a93fae77ef74 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1543 microversion: 2.1 time: 0.441204 Oct 05 02:42:07.495459 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1646/3316] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:07 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1543 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:07.507176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-803a8ade-8392-4af6-849a-2a350985d62a req-f94fcf42-477c-4ab6-ab5c-c1de84cbabc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6e3897-5115-4283-804d-abaa483786fc", "name": "network-vif-deleted", "tag": "4aff4e1f-3112-4ceb-b24d-2327b404029f"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:42:07.532552 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-803a8ade-8392-4af6-849a-2a350985d62a req-f94fcf42-477c-4ab6-ab5c-c1de84cbabc9 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:07.533077 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-803a8ade-8392-4af6-849a-2a350985d62a req-f94fcf42-477c-4ab6-ab5c-c1de84cbabc9 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:07.533517 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-803a8ade-8392-4af6-849a-2a350985d62a req-f94fcf42-477c-4ab6-ab5c-c1de84cbabc9 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:07.551315 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5c456d65-44c8-4560-a1d8-960b864d0069 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:07.561694 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5c456d65-44c8-4560-a1d8-960b864d0069 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 200 len: 1289 microversion: 2.1 time: 0.375079 Oct 05 02:42:07.576931 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1671/3317] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:07 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 1289 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:07.577204 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-803a8ade-8392-4af6-849a-2a350985d62a req-f94fcf42-477c-4ab6-ab5c-c1de84cbabc9 service nova] Creating event network-vif-deleted:4aff4e1f-3112-4ceb-b24d-2327b404029f for instance 0d6e3897-5115-4283-804d-abaa483786fc on n-h1-858272-3 Oct 05 02:42:07.577334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3d3df8f1-6a75-4451-93b6-885870120f4a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:07.577334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3d3df8f1-6a75-4451-93b6-885870120f4a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:07.580209 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-803a8ade-8392-4af6-849a-2a350985d62a req-f94fcf42-477c-4ab6-ab5c-c1de84cbabc9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083357 Oct 05 02:42:07.581130 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1647/3318] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:42:07.590257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d3df8f1-6a75-4451-93b6-885870120f4a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:07.590796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d3df8f1-6a75-4451-93b6-885870120f4a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:07.591322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d3df8f1-6a75-4451-93b6-885870120f4a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:07.592119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d3df8f1-6a75-4451-93b6-885870120f4a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:07.592746 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d3df8f1-6a75-4451-93b6-885870120f4a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:07.593463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d3df8f1-6a75-4451-93b6-885870120f4a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:07.665083 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3d3df8f1-6a75-4451-93b6-885870120f4a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:07.674693 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3d3df8f1-6a75-4451-93b6-885870120f4a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1277 microversion: 2.1 time: 0.108091 Oct 05 02:42:07.689772 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1672/3319] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:07 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1277 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:07.941980 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b685b956-6a90-4d1c-a7fd-bc8905a9d171 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] Calling method '.version_select at 0x7fcce41dfaf0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:08.027611 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b685b956-6a90-4d1c-a7fd-bc8905a9d171 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/28310851-175f-4dda-b6a6-5f06155c4d62" status: 200 len: 344 microversion: 2.1 time: 0.091449 Oct 05 02:42:08.028208 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1648/3320] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 02:42:07 2022] GET /compute/v2.1/os-volumes/28310851-175f-4dda-b6a6-5f06155c4d62 => generated 344 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:42:08.207681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-70985b7e-a5f3-43df-b406-4cb0d08fa8c2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:08.208328 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-70985b7e-a5f3-43df-b406-4cb0d08fa8c2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 6b01f092-c99b-4a47-bdcb-3b6bcdeb0323] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:08.215297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-70985b7e-a5f3-43df-b406-4cb0d08fa8c2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:08.215787 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-70985b7e-a5f3-43df-b406-4cb0d08fa8c2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:08.216219 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-70985b7e-a5f3-43df-b406-4cb0d08fa8c2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:08.216981 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-70985b7e-a5f3-43df-b406-4cb0d08fa8c2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:08.217452 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-70985b7e-a5f3-43df-b406-4cb0d08fa8c2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:08.217874 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-70985b7e-a5f3-43df-b406-4cb0d08fa8c2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:08.256584 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-70985b7e-a5f3-43df-b406-4cb0d08fa8c2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:08.257139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-70985b7e-a5f3-43df-b406-4cb0d08fa8c2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:08.257725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-70985b7e-a5f3-43df-b406-4cb0d08fa8c2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:08.258566 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-70985b7e-a5f3-43df-b406-4cb0d08fa8c2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lazy-loading 'fault' on Instance uuid 6b01f092-c99b-4a47-bdcb-3b6bcdeb0323 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:42:08.313295 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-70985b7e-a5f3-43df-b406-4cb0d08fa8c2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86e3b7d1c9a4b2c8f2914beefa74cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a44c2cd99949c2a30ab83bdede01e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:08.322095 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-70985b7e-a5f3-43df-b406-4cb0d08fa8c2 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323" status: 200 len: 1306 microversion: 2.1 time: 0.118400 Oct 05 02:42:08.322697 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1673/3321] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:08 2022] GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323 => generated 1306 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:08.513568 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-35f2df49-bb09-40d3-811e-622fadd6c330 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:08.516588 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-35f2df49-bb09-40d3-811e-622fadd6c330 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:08.559045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35f2df49-bb09-40d3-811e-622fadd6c330 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:08.560270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35f2df49-bb09-40d3-811e-622fadd6c330 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:08.561805 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35f2df49-bb09-40d3-811e-622fadd6c330 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:08.562722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35f2df49-bb09-40d3-811e-622fadd6c330 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:08.563886 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35f2df49-bb09-40d3-811e-622fadd6c330 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:08.564506 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35f2df49-bb09-40d3-811e-622fadd6c330 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:08.589641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a268e3f6-1140-426c-8ae7-c08e044c2656 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:08.590737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a268e3f6-1140-426c-8ae7-c08e044c2656 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:08.620929 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a268e3f6-1140-426c-8ae7-c08e044c2656 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:08.624972 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a268e3f6-1140-426c-8ae7-c08e044c2656 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:08.624972 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a268e3f6-1140-426c-8ae7-c08e044c2656 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:08.637291 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a268e3f6-1140-426c-8ae7-c08e044c2656 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:08.639186 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a268e3f6-1140-426c-8ae7-c08e044c2656 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:08.642681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a268e3f6-1140-426c-8ae7-c08e044c2656 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:09.058515 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-35f2df49-bb09-40d3-811e-622fadd6c330 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:09.066880 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a268e3f6-1140-426c-8ae7-c08e044c2656 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:09.072654 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-35f2df49-bb09-40d3-811e-622fadd6c330 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1542 microversion: 2.1 time: 0.570364 Oct 05 02:42:09.074259 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1649/3322] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:08 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1542 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:42:09.080727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-504f1d6f-126a-42f4-999b-8b0ef8603bea tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:09.082979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-504f1d6f-126a-42f4-999b-8b0ef8603bea tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:09.088732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:09.091110 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-504f1d6f-126a-42f4-999b-8b0ef8603bea tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:09.091998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-504f1d6f-126a-42f4-999b-8b0ef8603bea tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:09.093534 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a268e3f6-1140-426c-8ae7-c08e044c2656 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 200 len: 1289 microversion: 2.1 time: 0.509198 Oct 05 02:42:09.094533 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-504f1d6f-126a-42f4-999b-8b0ef8603bea tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:09.095507 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-504f1d6f-126a-42f4-999b-8b0ef8603bea tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:09.096138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-504f1d6f-126a-42f4-999b-8b0ef8603bea tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:09.096622 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1674/3323] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:08 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 1289 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:42:09.097198 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-504f1d6f-126a-42f4-999b-8b0ef8603bea tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:09.108679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9eeba71e-71c3-4805-9905-e62cd29577d1 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] Calling method '.version_select at 0x7fccdf72dc10>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:09.194019 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9eeba71e-71c3-4805-9905-e62cd29577d1 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/28310851-175f-4dda-b6a6-5f06155c4d62" status: 200 len: 345 microversion: 2.1 time: 0.092120 Oct 05 02:42:09.208065 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1675/3324] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 02:42:09 2022] GET /compute/v2.1/os-volumes/28310851-175f-4dda-b6a6-5f06155c4d62 => generated 345 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:42:09.215954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-de8be4bc-b61c-4c06-b39a-9cbcfbd37ebf tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] Action: 'create', calling method: .version_select at 0x7fcce8084160>, body: {"snapshot": {"volume_id": "28310851-175f-4dda-b6a6-5f06155c4d62", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1273373254"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:42:09.256887 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-504f1d6f-126a-42f4-999b-8b0ef8603bea tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:09.268133 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-504f1d6f-126a-42f4-999b-8b0ef8603bea tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1275 microversion: 2.1 time: 0.192430 Oct 05 02:42:09.270244 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1650/3325] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:09 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1275 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:09.346045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9f7230a5-8b1f-4391-8b87-e41823ae6129 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:09.347278 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9f7230a5-8b1f-4391-8b87-e41823ae6129 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] [instance: 6b01f092-c99b-4a47-bdcb-3b6bcdeb0323] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:09.357042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9f7230a5-8b1f-4391-8b87-e41823ae6129 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:09.357915 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9f7230a5-8b1f-4391-8b87-e41823ae6129 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:09.358720 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9f7230a5-8b1f-4391-8b87-e41823ae6129 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:09.359708 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9f7230a5-8b1f-4391-8b87-e41823ae6129 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:09.360417 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9f7230a5-8b1f-4391-8b87-e41823ae6129 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:09.361099 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9f7230a5-8b1f-4391-8b87-e41823ae6129 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:09.386176 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-9f7230a5-8b1f-4391-8b87-e41823ae6129 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] HTTP exception thrown: Instance 6b01f092-c99b-4a47-bdcb-3b6bcdeb0323 could not be found. Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9f7230a5-8b1f-4391-8b87-e41823ae6129 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Request method failure captured: Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323 HTTP/1.1 Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO3rxm78ro_lNid6Y0mfn-jyk6yAO5lWqW8Lr16wE4MCHagKAeauvptfZCvHaJ-6doq4nQv84xoFEpGRxvpNSA8Zrv8qJa_I5PWdE0F_gyAXlJijeV0AOJD3fyv6ynFZOJHx-riqsCQLfbqmpKoB-zpHICxlYmWXXCF5clocFvQOwXs Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: f5a44c2cd99949c2a30ab83bdede01e6 Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersOnMultiNodesTest-1239008232 Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5a44c2cd99949c2a30ab83bdede01e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5a44c2cd99949c2a30ab83bdede01e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f5a44c2cd99949c2a30ab83bdede01e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f5a44c2cd99949c2a30ab83bdede01e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersOnMultiNodesTest-1239008232 Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: f5a44c2cd99949c2a30ab83bdede01e6 Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1239008232 Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersOnMultiNodesTest-1239008232-project Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: b86e3b7d1c9a4b2c8f2914beefa74cc1 Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersOnMultiNodesTest-1239008232-project Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 6b01f092-c99b-4a47-bdcb-3b6bcdeb0323 could not be found. Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '6b01f092-c99b-4a47-bdcb-3b6bcdeb0323'} Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b01f092-c99b-4a47-bdcb-3b6bcdeb0323 could not be found. Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b01f092-c99b-4a47-bdcb-3b6bcdeb0323 could not be found. Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:42:09.388315 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:09.393696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:42:09.393696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:42:09.393696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:42:09.393696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:42:09.393696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:42:09.393696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b01f092-c99b-4a47-bdcb-3b6bcdeb0323 could not be found. Oct 05 02:42:09.393696 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:09.396141 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9f7230a5-8b1f-4391-8b87-e41823ae6129 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] Returning 404 to user: Instance 6b01f092-c99b-4a47-bdcb-3b6bcdeb0323 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:42:09.397409 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9f7230a5-8b1f-4391-8b87-e41823ae6129 tempest-ServersOnMultiNodesTest-1239008232 tempest-ServersOnMultiNodesTest-1239008232-project] 10.222.0.16 "GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323" status: 404 len: 111 microversion: 2.1 time: 0.055251 Oct 05 02:42:09.398620 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1651/3326] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:09 2022] GET /compute/v2.1/servers/6b01f092-c99b-4a47-bdcb-3b6bcdeb0323 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:42:09.560672 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-de8be4bc-b61c-4c06-b39a-9cbcfbd37ebf tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.350230 Oct 05 02:42:09.561419 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1676/3327] 10.222.0.16 () {60 vars in 1162 bytes} [Wed Oct 5 02:42:09 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:42:09.574074 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-09a8645c-21df-4cc7-a309-46c50b31ba85 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] Calling method '.version_select at 0x7fcce420d700>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:09.735484 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-09a8645c-21df-4cc7-a309-46c50b31ba85 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/a294ea90-9ea9-4eff-893b-3b7241c877c9" status: 200 len: 287 microversion: 2.1 time: 0.165272 Oct 05 02:42:09.736359 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1652/3328] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 5 02:42:09 2022] GET /compute/v2.1/os-snapshots/a294ea90-9ea9-4eff-893b-3b7241c877c9 => generated 287 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:42:09.741925 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-dbd0dbb3-7bb0-4100-871c-77b3278c9fa9 req-8af87cbf-f48f-42d2-849c-5b294bd06b20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1b41d44-1201-460a-b938-7a70567656cd", "name": "network-vif-unplugged", "status": "completed", "tag": "99ce69bd-430b-41c6-a998-33a5e643493b"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:42:09.773864 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-dbd0dbb3-7bb0-4100-871c-77b3278c9fa9 req-8af87cbf-f48f-42d2-849c-5b294bd06b20 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:09.778121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-dbd0dbb3-7bb0-4100-871c-77b3278c9fa9 req-8af87cbf-f48f-42d2-849c-5b294bd06b20 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:09.791823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-dbd0dbb3-7bb0-4100-871c-77b3278c9fa9 req-8af87cbf-f48f-42d2-849c-5b294bd06b20 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:09.847584 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-dbd0dbb3-7bb0-4100-871c-77b3278c9fa9 req-8af87cbf-f48f-42d2-849c-5b294bd06b20 service nova] Creating event network-vif-unplugged:99ce69bd-430b-41c6-a998-33a5e643493b for instance d1b41d44-1201-460a-b938-7a70567656cd on n-h1-858272-3 Oct 05 02:42:09.875649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [req-dbd0dbb3-7bb0-4100-871c-77b3278c9fa9 req-8af87cbf-f48f-42d2-849c-5b294bd06b20 service nova] Instance d1b41d44-1201-460a-b938-7a70567656cd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122319) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 02:42:09.919110 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-dbd0dbb3-7bb0-4100-871c-77b3278c9fa9 req-8af87cbf-f48f-42d2-849c-5b294bd06b20 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.174216 Oct 05 02:42:09.923333 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1653/3329] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:42:09.935161 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-79636ad7-0c7d-48b6-9fe8-182ae9cf3988 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] Calling method '.version_select at 0x7fccdfc22940>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:09.983531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-3c28f5bf-7aeb-4905-be7c-b90f109d8418 req-f58218be-9f94-430f-8fc4-da6b1d0ebe34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b01f092-c99b-4a47-bdcb-3b6bcdeb0323", "name": "network-vif-deleted", "tag": "6e942f65-fdd7-4e15-8f96-499f27856283"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:42:10.005857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3c28f5bf-7aeb-4905-be7c-b90f109d8418 req-f58218be-9f94-430f-8fc4-da6b1d0ebe34 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:10.007329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3c28f5bf-7aeb-4905-be7c-b90f109d8418 req-f58218be-9f94-430f-8fc4-da6b1d0ebe34 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:10.008720 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3c28f5bf-7aeb-4905-be7c-b90f109d8418 req-f58218be-9f94-430f-8fc4-da6b1d0ebe34 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:10.034569 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-3c28f5bf-7aeb-4905-be7c-b90f109d8418 req-f58218be-9f94-430f-8fc4-da6b1d0ebe34 service nova] Creating event network-vif-deleted:6e942f65-fdd7-4e15-8f96-499f27856283 for instance 6b01f092-c99b-4a47-bdcb-3b6bcdeb0323 on n-h1-858272-3 Oct 05 02:42:10.051153 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-3c28f5bf-7aeb-4905-be7c-b90f109d8418 req-f58218be-9f94-430f-8fc4-da6b1d0ebe34 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.377874 Oct 05 02:42:10.051856 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1677/3330] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:42:10.053575 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-79636ad7-0c7d-48b6-9fe8-182ae9cf3988 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.128186 Oct 05 02:42:10.054743 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1654/3331] 10.222.0.16 () {58 vars in 1140 bytes} [Wed Oct 5 02:42:09 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:42:10.066756 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-44bbc687-4d10-46fd-b02c-b45740a6a784 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] Calling method '.version_select at 0x7fccdf72d310>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:10.099657 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-44bbc687-4d10-46fd-b02c-b45740a6a784 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/a294ea90-9ea9-4eff-893b-3b7241c877c9" status: 200 len: 287 microversion: 2.1 time: 0.037626 Oct 05 02:42:10.100787 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1678/3332] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 5 02:42:10 2022] GET /compute/v2.1/os-snapshots/a294ea90-9ea9-4eff-893b-3b7241c877c9 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:42:10.101014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c4627e0d-528d-4713-8566-faadec477566 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:10.101656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c4627e0d-528d-4713-8566-faadec477566 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:10.118760 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4627e0d-528d-4713-8566-faadec477566 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:10.119634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4627e0d-528d-4713-8566-faadec477566 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:10.120149 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-86dd6d18-6373-4e4c-89af-b1ea818468b1 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:10.120484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4627e0d-528d-4713-8566-faadec477566 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:10.121110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-86dd6d18-6373-4e4c-89af-b1ea818468b1 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:10.121650 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4627e0d-528d-4713-8566-faadec477566 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:10.122298 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4627e0d-528d-4713-8566-faadec477566 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:10.123025 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4627e0d-528d-4713-8566-faadec477566 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:10.131230 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-86dd6d18-6373-4e4c-89af-b1ea818468b1 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:10.133698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-86dd6d18-6373-4e4c-89af-b1ea818468b1 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:10.135047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-86dd6d18-6373-4e4c-89af-b1ea818468b1 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:10.137117 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-86dd6d18-6373-4e4c-89af-b1ea818468b1 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:10.140423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-86dd6d18-6373-4e4c-89af-b1ea818468b1 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:10.141206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-86dd6d18-6373-4e4c-89af-b1ea818468b1 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:10.468531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c4627e0d-528d-4713-8566-faadec477566 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:10.472532 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-86dd6d18-6373-4e4c-89af-b1ea818468b1 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:10.480479 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-86dd6d18-6373-4e4c-89af-b1ea818468b1 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 200 len: 1289 microversion: 2.1 time: 0.364943 Oct 05 02:42:10.481284 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1679/3333] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:10 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 1289 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:10.484072 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c4627e0d-528d-4713-8566-faadec477566 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1542 microversion: 2.1 time: 0.387216 Oct 05 02:42:10.489527 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1655/3334] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:10 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1542 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:10.506263 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a2386ad8-5a04-4a42-b7f0-ff0765dcf23d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:10.507267 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a2386ad8-5a04-4a42-b7f0-ff0765dcf23d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:10.526937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2386ad8-5a04-4a42-b7f0-ff0765dcf23d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:10.527430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2386ad8-5a04-4a42-b7f0-ff0765dcf23d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:10.527867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2386ad8-5a04-4a42-b7f0-ff0765dcf23d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:10.528575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2386ad8-5a04-4a42-b7f0-ff0765dcf23d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:10.529151 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2386ad8-5a04-4a42-b7f0-ff0765dcf23d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:10.529487 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2386ad8-5a04-4a42-b7f0-ff0765dcf23d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:10.755305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a2386ad8-5a04-4a42-b7f0-ff0765dcf23d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:10.757921 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:10.767339 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a2386ad8-5a04-4a42-b7f0-ff0765dcf23d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1317 microversion: 2.1 time: 0.264806 Oct 05 02:42:10.768115 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1680/3335] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:10 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1317 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:11.129102 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4caffa2d-bc7a-48af-81f1-ae51d17dd4dc tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] Calling method '.version_select at 0x7fccdfc22940>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:11.185654 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4caffa2d-bc7a-48af-81f1-ae51d17dd4dc tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/a294ea90-9ea9-4eff-893b-3b7241c877c9" status: 200 len: 287 microversion: 2.1 time: 0.075503 Oct 05 02:42:11.187372 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1656/3336] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 5 02:42:11 2022] GET /compute/v2.1/os-snapshots/a294ea90-9ea9-4eff-893b-3b7241c877c9 => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:42:11.507112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d7021279-638f-4d3d-a36e-cdcff6642754 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:11.507722 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d7021279-638f-4d3d-a36e-cdcff6642754 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:11.515684 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ade71440-0ea5-4c5c-bf24-420bafebe2a7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:11.516597 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ade71440-0ea5-4c5c-bf24-420bafebe2a7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:11.530905 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ade71440-0ea5-4c5c-bf24-420bafebe2a7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:11.531601 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ade71440-0ea5-4c5c-bf24-420bafebe2a7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:11.532055 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ade71440-0ea5-4c5c-bf24-420bafebe2a7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:11.532774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ade71440-0ea5-4c5c-bf24-420bafebe2a7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:11.536334 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ade71440-0ea5-4c5c-bf24-420bafebe2a7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:11.537453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ade71440-0ea5-4c5c-bf24-420bafebe2a7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:11.538168 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7021279-638f-4d3d-a36e-cdcff6642754 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:11.539908 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7021279-638f-4d3d-a36e-cdcff6642754 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:11.541413 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7021279-638f-4d3d-a36e-cdcff6642754 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:11.542334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7021279-638f-4d3d-a36e-cdcff6642754 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:11.544224 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7021279-638f-4d3d-a36e-cdcff6642754 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:11.547858 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7021279-638f-4d3d-a36e-cdcff6642754 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:11.610807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:11.818634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ade71440-0ea5-4c5c-bf24-420bafebe2a7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:11.822065 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d7021279-638f-4d3d-a36e-cdcff6642754 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:11.830708 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d7021279-638f-4d3d-a36e-cdcff6642754 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 200 len: 1289 microversion: 2.1 time: 0.327972 Oct 05 02:42:11.845094 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1681/3337] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:11 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 1289 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:11.845094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-89bf3220-ee66-405a-b044-5af5f6094da9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:11.845408 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ade71440-0ea5-4c5c-bf24-420bafebe2a7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1542 microversion: 2.1 time: 0.327504 Oct 05 02:42:11.853163 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1657/3338] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:11 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1542 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:11.853661 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-89bf3220-ee66-405a-b044-5af5f6094da9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:11.856734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:11.863520 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89bf3220-ee66-405a-b044-5af5f6094da9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:11.864016 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89bf3220-ee66-405a-b044-5af5f6094da9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:11.864673 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89bf3220-ee66-405a-b044-5af5f6094da9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:11.865419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89bf3220-ee66-405a-b044-5af5f6094da9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:11.865879 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89bf3220-ee66-405a-b044-5af5f6094da9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:11.866353 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89bf3220-ee66-405a-b044-5af5f6094da9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:12.009365 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-89bf3220-ee66-405a-b044-5af5f6094da9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:12.017180 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-89bf3220-ee66-405a-b044-5af5f6094da9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1317 microversion: 2.1 time: 0.184021 Oct 05 02:42:12.017979 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1682/3339] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:11 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:12.066333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-755692cb-4524-42b2-ad21-4018b044386c req-7ffbdaa1-28ac-441b-a886-fdb54cc866ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1b41d44-1201-460a-b938-7a70567656cd", "tag": "99ce69bd-430b-41c6-a998-33a5e643493b"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:42:12.076164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-755692cb-4524-42b2-ad21-4018b044386c req-7ffbdaa1-28ac-441b-a886-fdb54cc866ce service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:12.076730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-755692cb-4524-42b2-ad21-4018b044386c req-7ffbdaa1-28ac-441b-a886-fdb54cc866ce service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:12.077274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-755692cb-4524-42b2-ad21-4018b044386c req-7ffbdaa1-28ac-441b-a886-fdb54cc866ce service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:12.090334 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-755692cb-4524-42b2-ad21-4018b044386c req-7ffbdaa1-28ac-441b-a886-fdb54cc866ce service nova] Creating event network-changed:99ce69bd-430b-41c6-a998-33a5e643493b for instance d1b41d44-1201-460a-b938-7a70567656cd on n-h1-858272-3 Oct 05 02:42:12.096082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [req-755692cb-4524-42b2-ad21-4018b044386c req-7ffbdaa1-28ac-441b-a886-fdb54cc866ce service nova] Instance d1b41d44-1201-460a-b938-7a70567656cd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122319) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 02:42:12.108482 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-755692cb-4524-42b2-ad21-4018b044386c req-7ffbdaa1-28ac-441b-a886-fdb54cc866ce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045770 Oct 05 02:42:12.109320 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1658/3340] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:42:12.201501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1e5d0be3-8182-4b74-b69d-3e07440bcb64 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] Calling method '.version_select at 0x7fcce8137b80>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:12.240664 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1e5d0be3-8182-4b74-b69d-3e07440bcb64 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/a294ea90-9ea9-4eff-893b-3b7241c877c9" status: 200 len: 288 microversion: 2.1 time: 0.043511 Oct 05 02:42:12.246787 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1683/3341] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 5 02:42:12 2022] GET /compute/v2.1/os-snapshots/a294ea90-9ea9-4eff-893b-3b7241c877c9 => generated 288 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:42:12.259920 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-65935328-39ef-493f-a8f4-2883c34647f3 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] Calling method '.version_select at 0x7fccdfca8670>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:12.375262 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-65935328-39ef-493f-a8f4-2883c34647f3 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/a294ea90-9ea9-4eff-893b-3b7241c877c9" status: 202 len: 0 microversion: 2.1 time: 0.120422 Oct 05 02:42:12.379065 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1659/3342] 10.222.0.16 () {58 vars in 1254 bytes} [Wed Oct 5 02:42:12 2022] DELETE /compute/v2.1/os-snapshots/a294ea90-9ea9-4eff-893b-3b7241c877c9 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:42:12.384307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-358a5e6c-49ed-410d-8e7e-3e2488ebb0e5 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] Calling method '.version_select at 0x7fccdf72f5e0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:12.453073 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-358a5e6c-49ed-410d-8e7e-3e2488ebb0e5 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/a294ea90-9ea9-4eff-893b-3b7241c877c9" status: 200 len: 287 microversion: 2.1 time: 0.071793 Oct 05 02:42:12.461487 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1684/3343] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 5 02:42:12 2022] GET /compute/v2.1/os-snapshots/a294ea90-9ea9-4eff-893b-3b7241c877c9 => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:42:12.855752 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8d9fe2c1-6ee4-42cf-a920-8e8abb0da948 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:12.856498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8d9fe2c1-6ee4-42cf-a920-8e8abb0da948 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:12.867542 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d9fe2c1-6ee4-42cf-a920-8e8abb0da948 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:12.868458 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d9fe2c1-6ee4-42cf-a920-8e8abb0da948 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:12.869255 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d9fe2c1-6ee4-42cf-a920-8e8abb0da948 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:12.870171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d9fe2c1-6ee4-42cf-a920-8e8abb0da948 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:12.870448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1aa74365-179f-462d-8a1f-fd4fd500d875 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:12.871078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1aa74365-179f-462d-8a1f-fd4fd500d875 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:12.871631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d9fe2c1-6ee4-42cf-a920-8e8abb0da948 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:12.872711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d9fe2c1-6ee4-42cf-a920-8e8abb0da948 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:12.884272 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1aa74365-179f-462d-8a1f-fd4fd500d875 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:12.884942 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1aa74365-179f-462d-8a1f-fd4fd500d875 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:12.885419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1aa74365-179f-462d-8a1f-fd4fd500d875 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:12.886126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1aa74365-179f-462d-8a1f-fd4fd500d875 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:12.886589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1aa74365-179f-462d-8a1f-fd4fd500d875 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:12.887020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1aa74365-179f-462d-8a1f-fd4fd500d875 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:13.185973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1aa74365-179f-462d-8a1f-fd4fd500d875 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:13.187672 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8d9fe2c1-6ee4-42cf-a920-8e8abb0da948 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:13.195981 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1aa74365-179f-462d-8a1f-fd4fd500d875 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1542 microversion: 2.1 time: 0.329957 Oct 05 02:42:13.196719 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1685/3344] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:12 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1542 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:42:13.202500 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-09021807-dfcd-4eac-8c16-c214be61a52f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:13.203875 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-09021807-dfcd-4eac-8c16-c214be61a52f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:13.211611 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8d9fe2c1-6ee4-42cf-a920-8e8abb0da948 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 200 len: 1289 microversion: 2.1 time: 0.359634 Oct 05 02:42:13.212549 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1660/3345] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:12 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 1289 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:13.213527 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09021807-dfcd-4eac-8c16-c214be61a52f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:13.214193 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09021807-dfcd-4eac-8c16-c214be61a52f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:13.214934 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09021807-dfcd-4eac-8c16-c214be61a52f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:13.216180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09021807-dfcd-4eac-8c16-c214be61a52f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:13.216851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09021807-dfcd-4eac-8c16-c214be61a52f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:13.217397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09021807-dfcd-4eac-8c16-c214be61a52f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:13.393909 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-09021807-dfcd-4eac-8c16-c214be61a52f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:13.405819 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-09021807-dfcd-4eac-8c16-c214be61a52f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1317 microversion: 2.1 time: 0.207123 Oct 05 02:42:13.407773 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1686/3346] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:13 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:13.467684 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f753a972-b762-426c-8660-a02fe453d5ad tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] Calling method '.version_select at 0x7fccdfca8670>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:13.502405 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f753a972-b762-426c-8660-a02fe453d5ad tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/a294ea90-9ea9-4eff-893b-3b7241c877c9" status: 200 len: 287 microversion: 2.1 time: 0.038474 Oct 05 02:42:13.503864 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1661/3347] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 5 02:42:13 2022] GET /compute/v2.1/os-snapshots/a294ea90-9ea9-4eff-893b-3b7241c877c9 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:42:14.134405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-bdb559ad-34cf-4072-9994-61ed45b1fb24 req-33f8956b-3f2f-4b40-9d7e-d44abfe01838 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91e1df96-3094-46e9-a96a-adb0aa39d976", "tag": "1de9a92c-6fa6-47d3-96ae-a2dd7481ec08"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:42:14.146112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-bdb559ad-34cf-4072-9994-61ed45b1fb24 req-33f8956b-3f2f-4b40-9d7e-d44abfe01838 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:14.146902 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-bdb559ad-34cf-4072-9994-61ed45b1fb24 req-33f8956b-3f2f-4b40-9d7e-d44abfe01838 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:14.147524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-bdb559ad-34cf-4072-9994-61ed45b1fb24 req-33f8956b-3f2f-4b40-9d7e-d44abfe01838 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:14.183003 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-bdb559ad-34cf-4072-9994-61ed45b1fb24 req-33f8956b-3f2f-4b40-9d7e-d44abfe01838 service nova] Creating event network-changed:1de9a92c-6fa6-47d3-96ae-a2dd7481ec08 for instance 91e1df96-3094-46e9-a96a-adb0aa39d976 on n-h2-858272-3 Oct 05 02:42:14.194982 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-bdb559ad-34cf-4072-9994-61ed45b1fb24 req-33f8956b-3f2f-4b40-9d7e-d44abfe01838 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064003 Oct 05 02:42:14.196439 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1687/3348] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:42:14.234654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-421b6770-6983-47c5-a5af-71aa0ff68bf2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:14.235273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-421b6770-6983-47c5-a5af-71aa0ff68bf2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:14.242512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f23c68cf-e9da-484c-aea8-2c52a3b80f42 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:14.243357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f23c68cf-e9da-484c-aea8-2c52a3b80f42 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:14.246435 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-421b6770-6983-47c5-a5af-71aa0ff68bf2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:14.247171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-421b6770-6983-47c5-a5af-71aa0ff68bf2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:14.247789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-421b6770-6983-47c5-a5af-71aa0ff68bf2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:14.253313 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f23c68cf-e9da-484c-aea8-2c52a3b80f42 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:14.253506 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-421b6770-6983-47c5-a5af-71aa0ff68bf2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:14.253927 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-421b6770-6983-47c5-a5af-71aa0ff68bf2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:14.254363 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-421b6770-6983-47c5-a5af-71aa0ff68bf2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:14.254512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f23c68cf-e9da-484c-aea8-2c52a3b80f42 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:14.255225 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f23c68cf-e9da-484c-aea8-2c52a3b80f42 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:14.256880 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f23c68cf-e9da-484c-aea8-2c52a3b80f42 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:14.257582 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f23c68cf-e9da-484c-aea8-2c52a3b80f42 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:14.258348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f23c68cf-e9da-484c-aea8-2c52a3b80f42 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:14.462732 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:14.484821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:14.538805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f23c68cf-e9da-484c-aea8-2c52a3b80f42 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:14.539992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-421b6770-6983-47c5-a5af-71aa0ff68bf2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:14.548120 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f23c68cf-e9da-484c-aea8-2c52a3b80f42 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 200 len: 1289 microversion: 2.1 time: 0.311888 Oct 05 02:42:14.548781 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-421b6770-6983-47c5-a5af-71aa0ff68bf2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1474 microversion: 2.1 time: 0.317813 Oct 05 02:42:14.557592 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1688/3349] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:14 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 1289 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:14.561466 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1662/3350] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:14 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1474 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:14.577480 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ee922469-1ec0-4ba3-bf15-da1992e21d05 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:14.578346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ee922469-1ec0-4ba3-bf15-da1992e21d05 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:14.585236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee922469-1ec0-4ba3-bf15-da1992e21d05 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:14.585979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee922469-1ec0-4ba3-bf15-da1992e21d05 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:14.586427 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee922469-1ec0-4ba3-bf15-da1992e21d05 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:14.587133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee922469-1ec0-4ba3-bf15-da1992e21d05 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:14.587757 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee922469-1ec0-4ba3-bf15-da1992e21d05 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:14.588190 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee922469-1ec0-4ba3-bf15-da1992e21d05 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:14.703814 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ae32eff6-b1f2-45a0-a78b-19aa6250a17d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-2069315105", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": "none"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:42:14.743517 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ee922469-1ec0-4ba3-bf15-da1992e21d05 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:14.751861 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ee922469-1ec0-4ba3-bf15-da1992e21d05 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1317 microversion: 2.1 time: 0.189218 Oct 05 02:42:14.752442 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1663/3351] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:14 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:14.758115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6a3e551a-dd91-4663-8434-53a8a3f26367 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] Calling method '.version_select at 0x7fcce4285820>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:14.764285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-ae32eff6-b1f2-45a0-a78b-19aa6250a17d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:42:14.764952 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-ae32eff6-b1f2-45a0-a78b-19aa6250a17d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:42:14.765931 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-ae32eff6-b1f2-45a0-a78b-19aa6250a17d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:42:14.766388 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-ae32eff6-b1f2-45a0-a78b-19aa6250a17d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:42:14.767275 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-ae32eff6-b1f2-45a0-a78b-19aa6250a17d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:42:14.776325 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae32eff6-b1f2-45a0-a78b-19aa6250a17d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:14.776896 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae32eff6-b1f2-45a0-a78b-19aa6250a17d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:14.777673 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae32eff6-b1f2-45a0-a78b-19aa6250a17d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:14.779152 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae32eff6-b1f2-45a0-a78b-19aa6250a17d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:14.779730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae32eff6-b1f2-45a0-a78b-19aa6250a17d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:14.780273 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae32eff6-b1f2-45a0-a78b-19aa6250a17d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:14.788462 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-6a3e551a-dd91-4663-8434-53a8a3f26367 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] HTTP exception thrown: Snapshot a294ea90-9ea9-4eff-893b-3b7241c877c9 could not be found. Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6a3e551a-dd91-4663-8434-53a8a3f26367 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] Request method failure captured: Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/os-snapshots/a294ea90-9ea9-4eff-893b-3b7241c877c9 HTTP/1.1 Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO79YfvGxJMpe3U156YQcmMhjEWGTnL34DNwPGs6h3hYkaCSrM-oTK5gsGT8Jd5Tlw8nWu7D4NngggDJYAYNrZzoD0W11w_jke4PUpnj9wsJTbBjc2Jnr90svUAfcc3MMmWSN4yevxYIz0dSBOd5zblLCZtgSGFWMonUbnOTSw_gB-I Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: fd7c8d5cae8b44c4b3f1b79787b0dad9 Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-246106381 Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd7c8d5cae8b44c4b3f1b79787b0dad9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd7c8d5cae8b44c4b3f1b79787b0dad9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fd7c8d5cae8b44c4b3f1b79787b0dad9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fd7c8d5cae8b44c4b3f1b79787b0dad9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-VolumesSnapshotsTestJSON-246106381 Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: fd7c8d5cae8b44c4b3f1b79787b0dad9 Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-246106381 Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-VolumesSnapshotsTestJSON-246106381-project Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: dde6d228151a43be8b5ac3a6bbe4e038 Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-VolumesSnapshotsTestJSON-246106381-project Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: exception: Snapshot a294ea90-9ea9-4eff-893b-3b7241c877c9 could not be found. Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'a294ea90-9ea9-4eff-893b-3b7241c877c9'} Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a294ea90-9ea9-4eff-893b-3b7241c877c9 could not be found. (HTTP 404) (Request-ID: req-35aba3fd-1703-4966-917d-8a16c8041802) Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 02:42:14.795094 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a294ea90-9ea9-4eff-893b-3b7241c877c9 could not be found. Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a294ea90-9ea9-4eff-893b-3b7241c877c9 could not be found. Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a294ea90-9ea9-4eff-893b-3b7241c877c9 could not be found. Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6a3e551a-dd91-4663-8434-53a8a3f26367 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] Returning 404 to user: Snapshot a294ea90-9ea9-4eff-893b-3b7241c877c9 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:42:14.800849 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6a3e551a-dd91-4663-8434-53a8a3f26367 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/a294ea90-9ea9-4eff-893b-3b7241c877c9" status: 404 len: 111 microversion: 2.1 time: 0.042634 Oct 05 02:42:14.804078 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1664/3352] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 5 02:42:14 2022] GET /compute/v2.1/os-snapshots/a294ea90-9ea9-4eff-893b-3b7241c877c9 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:42:14.808112 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3a592bdd-f2d0-428e-9e93-ba4c15656b0c tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] Calling method '.version_select at 0x7fcce4070c10>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:14.808997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-ae32eff6-b1f2-45a0-a78b-19aa6250a17d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Getting quotas for project 53c0d3a590cd4154999aa75e3009cfd1. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:42:14.815975 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-ae32eff6-b1f2-45a0-a78b-19aa6250a17d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Getting quotas for user cc626f587b9541ce82f7d52f426b129d and project 53c0d3a590cd4154999aa75e3009cfd1. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:42:14.831384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ae32eff6-b1f2-45a0-a78b-19aa6250a17d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:42:14.834320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ae32eff6-b1f2-45a0-a78b-19aa6250a17d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:42:14.882505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:14.885615 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3a592bdd-f2d0-428e-9e93-ba4c15656b0c tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/28310851-175f-4dda-b6a6-5f06155c4d62" status: 202 len: 0 microversion: 2.1 time: 0.082960 Oct 05 02:42:14.887719 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1665/3353] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 02:42:14 2022] DELETE /compute/v2.1/os-volumes/28310851-175f-4dda-b6a6-5f06155c4d62 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:42:14.897960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-19aa4fe2-cd4d-4987-9ecf-4fef8a90c62f tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] Calling method '.version_select at 0x7fcce4285820>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:14.901827 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ae32eff6-b1f2-45a0-a78b-19aa6250a17d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.342172 Oct 05 02:42:14.910966 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1689/3354] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 5 02:42:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 353 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 05 02:42:14.916832 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-140bb028-a5e1-43ca-a8b3-3b8bf801ece7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:14.917441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-140bb028-a5e1-43ca-a8b3-3b8bf801ece7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:14.985077 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-19aa4fe2-cd4d-4987-9ecf-4fef8a90c62f tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/28310851-175f-4dda-b6a6-5f06155c4d62" status: 200 len: 344 microversion: 2.1 time: 0.092962 Oct 05 02:42:14.986124 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1666/3355] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 02:42:14 2022] GET /compute/v2.1/os-volumes/28310851-175f-4dda-b6a6-5f06155c4d62 => generated 344 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:42:15.010877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-140bb028-a5e1-43ca-a8b3-3b8bf801ece7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:15.022112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-140bb028-a5e1-43ca-a8b3-3b8bf801ece7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:15.023891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-140bb028-a5e1-43ca-a8b3-3b8bf801ece7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:15.031189 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-140bb028-a5e1-43ca-a8b3-3b8bf801ece7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1454 microversion: 2.91 time: 0.118873 Oct 05 02:42:15.032433 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1690/3356] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:14 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1454 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:42:15.576657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b1e79750-7570-4d5e-a678-32c6f65bb0f7 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:15.578402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b1e79750-7570-4d5e-a678-32c6f65bb0f7 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:15.581428 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8948549e-8911-40c8-89b8-d2572e98d399 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:15.582948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8948549e-8911-40c8-89b8-d2572e98d399 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:15.588974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b1e79750-7570-4d5e-a678-32c6f65bb0f7 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:15.590015 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b1e79750-7570-4d5e-a678-32c6f65bb0f7 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:15.590780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b1e79750-7570-4d5e-a678-32c6f65bb0f7 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:15.592183 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b1e79750-7570-4d5e-a678-32c6f65bb0f7 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:15.593432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b1e79750-7570-4d5e-a678-32c6f65bb0f7 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:15.594122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b1e79750-7570-4d5e-a678-32c6f65bb0f7 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:15.597864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8948549e-8911-40c8-89b8-d2572e98d399 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:15.598450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8948549e-8911-40c8-89b8-d2572e98d399 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:15.598954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8948549e-8911-40c8-89b8-d2572e98d399 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:15.604063 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8948549e-8911-40c8-89b8-d2572e98d399 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:15.604063 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8948549e-8911-40c8-89b8-d2572e98d399 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:15.604525 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8948549e-8911-40c8-89b8-d2572e98d399 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:15.821861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b1e79750-7570-4d5e-a678-32c6f65bb0f7 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:15.833775 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b1e79750-7570-4d5e-a678-32c6f65bb0f7 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 200 len: 1289 microversion: 2.1 time: 0.264458 Oct 05 02:42:15.840540 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1667/3357] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:15 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 1289 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:15.856223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f5b9eb4e-f781-41b4-8f96-cbcd1103fe25 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:15.856968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8948549e-8911-40c8-89b8-d2572e98d399 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:15.859434 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f5b9eb4e-f781-41b4-8f96-cbcd1103fe25 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:15.866757 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8948549e-8911-40c8-89b8-d2572e98d399 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1474 microversion: 2.1 time: 0.291863 Oct 05 02:42:15.868626 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1691/3358] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:15 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1474 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:15.895514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5b9eb4e-f781-41b4-8f96-cbcd1103fe25 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:15.898397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5b9eb4e-f781-41b4-8f96-cbcd1103fe25 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:15.899135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5b9eb4e-f781-41b4-8f96-cbcd1103fe25 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:15.900531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5b9eb4e-f781-41b4-8f96-cbcd1103fe25 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:15.901292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5b9eb4e-f781-41b4-8f96-cbcd1103fe25 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:15.901963 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5b9eb4e-f781-41b4-8f96-cbcd1103fe25 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:16.000698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-26331416-dcf0-4bb2-a8ee-c689dc48c0a1 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] Calling method '.version_select at 0x7fccdf76a550>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:16.102032 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-26331416-dcf0-4bb2-a8ee-c689dc48c0a1 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/28310851-175f-4dda-b6a6-5f06155c4d62" status: 200 len: 344 microversion: 2.1 time: 0.105761 Oct 05 02:42:16.102606 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1692/3359] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 02:42:15 2022] GET /compute/v2.1/os-volumes/28310851-175f-4dda-b6a6-5f06155c4d62 => generated 344 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:42:16.108525 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-37919a49-dc70-4da4-8da3-134995331234 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:16.109166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-37919a49-dc70-4da4-8da3-134995331234 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:16.131253 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-37919a49-dc70-4da4-8da3-134995331234 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:16.132214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-37919a49-dc70-4da4-8da3-134995331234 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:16.135022 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-37919a49-dc70-4da4-8da3-134995331234 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:16.137897 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-37919a49-dc70-4da4-8da3-134995331234 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:16.140623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-37919a49-dc70-4da4-8da3-134995331234 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:16.145753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-37919a49-dc70-4da4-8da3-134995331234 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:16.168917 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f5b9eb4e-f781-41b4-8f96-cbcd1103fe25 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:16.180127 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f5b9eb4e-f781-41b4-8f96-cbcd1103fe25 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1317 microversion: 2.1 time: 0.336166 Oct 05 02:42:16.180946 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1668/3360] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:15 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1317 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:16.298871 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-37919a49-dc70-4da4-8da3-134995331234 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:16.312285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-37919a49-dc70-4da4-8da3-134995331234 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:16.314377 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-37919a49-dc70-4da4-8da3-134995331234 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:16.322563 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-37919a49-dc70-4da4-8da3-134995331234 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1458 microversion: 2.91 time: 0.218931 Oct 05 02:42:16.323559 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1693/3361] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:16 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1458 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:42:16.858821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e6790e22-0a4a-4034-823c-4db59053c1b1 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:16.861072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e6790e22-0a4a-4034-823c-4db59053c1b1 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:16.880192 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6790e22-0a4a-4034-823c-4db59053c1b1 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:16.881770 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6790e22-0a4a-4034-823c-4db59053c1b1 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:16.883427 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6790e22-0a4a-4034-823c-4db59053c1b1 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:16.884414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6790e22-0a4a-4034-823c-4db59053c1b1 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:16.887007 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6790e22-0a4a-4034-823c-4db59053c1b1 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:16.887981 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6790e22-0a4a-4034-823c-4db59053c1b1 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:16.896362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2385c1f1-5fca-4944-8785-67e50fbc41a8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:16.897781 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2385c1f1-5fca-4944-8785-67e50fbc41a8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:16.909583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2385c1f1-5fca-4944-8785-67e50fbc41a8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:16.914052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2385c1f1-5fca-4944-8785-67e50fbc41a8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:16.914535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2385c1f1-5fca-4944-8785-67e50fbc41a8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:16.915279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2385c1f1-5fca-4944-8785-67e50fbc41a8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:16.915983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2385c1f1-5fca-4944-8785-67e50fbc41a8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:16.916731 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2385c1f1-5fca-4944-8785-67e50fbc41a8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:17.218015 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e6790e22-0a4a-4034-823c-4db59053c1b1 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:17.222961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2385c1f1-5fca-4944-8785-67e50fbc41a8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:17.234651 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e6790e22-0a4a-4034-823c-4db59053c1b1 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 200 len: 1289 microversion: 2.1 time: 0.378600 Oct 05 02:42:17.236032 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1669/3362] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:16 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 1289 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:17.240479 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2385c1f1-5fca-4944-8785-67e50fbc41a8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1474 microversion: 2.1 time: 0.345274 Oct 05 02:42:17.244173 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1694/3363] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:16 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1474 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:17.260315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e46ffd1c-f944-4729-a6d8-050efb00c83c tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] Calling method '.version_select at 0x7fcce4214670>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:17.261035 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b4652f3a-6632-4c1e-a576-2619268adccc tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:17.261663 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b4652f3a-6632-4c1e-a576-2619268adccc tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:17.268098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4652f3a-6632-4c1e-a576-2619268adccc tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:17.268619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4652f3a-6632-4c1e-a576-2619268adccc tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:17.274686 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4652f3a-6632-4c1e-a576-2619268adccc tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:17.275655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4652f3a-6632-4c1e-a576-2619268adccc tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:17.276290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4652f3a-6632-4c1e-a576-2619268adccc tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:17.276925 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4652f3a-6632-4c1e-a576-2619268adccc tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:17.324804 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-e46ffd1c-f944-4729-a6d8-050efb00c83c tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] HTTP exception thrown: Volume 28310851-175f-4dda-b6a6-5f06155c4d62 could not be found. Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e46ffd1c-f944-4729-a6d8-050efb00c83c tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] Request method failure captured: Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/os-volumes/28310851-175f-4dda-b6a6-5f06155c4d62 HTTP/1.1 Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO79YfvGxJMpe3U156YQcmMhjEWGTnL34DNwPGs6h3hYkaCSrM-oTK5gsGT8Jd5Tlw8nWu7D4NngggDJYAYNrZzoD0W11w_jke4PUpnj9wsJTbBjc2Jnr90svUAfcc3MMmWSN4yevxYIz0dSBOd5zblLCZtgSGFWMonUbnOTSw_gB-I Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: fd7c8d5cae8b44c4b3f1b79787b0dad9 Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-246106381 Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd7c8d5cae8b44c4b3f1b79787b0dad9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd7c8d5cae8b44c4b3f1b79787b0dad9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fd7c8d5cae8b44c4b3f1b79787b0dad9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fd7c8d5cae8b44c4b3f1b79787b0dad9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-VolumesSnapshotsTestJSON-246106381 Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: fd7c8d5cae8b44c4b3f1b79787b0dad9 Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-246106381 Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-VolumesSnapshotsTestJSON-246106381-project Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: dde6d228151a43be8b5ac3a6bbe4e038 Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-VolumesSnapshotsTestJSON-246106381-project Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: exception: Volume 28310851-175f-4dda-b6a6-5f06155c4d62 could not be found. Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '28310851-175f-4dda-b6a6-5f06155c4d62'} Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 28310851-175f-4dda-b6a6-5f06155c4d62 could not be found. (HTTP 404) (Request-ID: req-2963f69f-568e-4c01-b0df-047b48fd35b1) Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 02:42:17.327692 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 28310851-175f-4dda-b6a6-5f06155c4d62 could not be found. Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 28310851-175f-4dda-b6a6-5f06155c4d62 could not be found. Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 28310851-175f-4dda-b6a6-5f06155c4d62 could not be found. Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e46ffd1c-f944-4729-a6d8-050efb00c83c tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] Returning 404 to user: Volume 28310851-175f-4dda-b6a6-5f06155c4d62 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:42:17.332321 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e46ffd1c-f944-4729-a6d8-050efb00c83c tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/28310851-175f-4dda-b6a6-5f06155c4d62" status: 404 len: 109 microversion: 2.1 time: 0.092208 Oct 05 02:42:17.337085 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1670/3364] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 02:42:17 2022] GET /compute/v2.1/os-volumes/28310851-175f-4dda-b6a6-5f06155c4d62 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:42:17.356538 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4f69fe55-dd01-4a77-adbd-c5ef138ad2d8 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] Calling method '.version_select at 0x7fccdf302ca0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:17.445125 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-4f69fe55-dd01-4a77-adbd-c5ef138ad2d8 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] HTTP exception thrown: Volume 28310851-175f-4dda-b6a6-5f06155c4d62 could not be found. Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4f69fe55-dd01-4a77-adbd-c5ef138ad2d8 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] Request method failure captured: Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/os-volumes/28310851-175f-4dda-b6a6-5f06155c4d62 HTTP/1.1 Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO79YfvGxJMpe3U156YQcmMhjEWGTnL34DNwPGs6h3hYkaCSrM-oTK5gsGT8Jd5Tlw8nWu7D4NngggDJYAYNrZzoD0W11w_jke4PUpnj9wsJTbBjc2Jnr90svUAfcc3MMmWSN4yevxYIz0dSBOd5zblLCZtgSGFWMonUbnOTSw_gB-I Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: fd7c8d5cae8b44c4b3f1b79787b0dad9 Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-246106381 Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd7c8d5cae8b44c4b3f1b79787b0dad9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd7c8d5cae8b44c4b3f1b79787b0dad9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fd7c8d5cae8b44c4b3f1b79787b0dad9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fd7c8d5cae8b44c4b3f1b79787b0dad9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-VolumesSnapshotsTestJSON-246106381 Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: fd7c8d5cae8b44c4b3f1b79787b0dad9 Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-246106381 Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-VolumesSnapshotsTestJSON-246106381-project Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: dde6d228151a43be8b5ac3a6bbe4e038 Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-VolumesSnapshotsTestJSON-246106381-project Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: exception: Volume 28310851-175f-4dda-b6a6-5f06155c4d62 could not be found. Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '28310851-175f-4dda-b6a6-5f06155c4d62'} Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 28310851-175f-4dda-b6a6-5f06155c4d62 could not be found. (HTTP 404) (Request-ID: req-6b3cbb53-3c77-44d9-922d-9a9a755e350a) Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 02:42:17.450093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 28310851-175f-4dda-b6a6-5f06155c4d62 could not be found. Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 28310851-175f-4dda-b6a6-5f06155c4d62 could not be found. Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 28310851-175f-4dda-b6a6-5f06155c4d62 could not be found. Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:17.454617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4f69fe55-dd01-4a77-adbd-c5ef138ad2d8 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] Returning 404 to user: Volume 28310851-175f-4dda-b6a6-5f06155c4d62 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:42:17.462875 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4f69fe55-dd01-4a77-adbd-c5ef138ad2d8 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/28310851-175f-4dda-b6a6-5f06155c4d62" status: 404 len: 109 microversion: 2.1 time: 0.117501 Oct 05 02:42:17.462875 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1671/3365] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 02:42:17 2022] DELETE /compute/v2.1/os-volumes/28310851-175f-4dda-b6a6-5f06155c4d62 => generated 109 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:42:17.475856 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-41200816-fde6-4305-b6a9-a62b8e1e8c1c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:17.476589 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-41200816-fde6-4305-b6a9-a62b8e1e8c1c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:17.512374 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41200816-fde6-4305-b6a9-a62b8e1e8c1c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:17.512936 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41200816-fde6-4305-b6a9-a62b8e1e8c1c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:17.513365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41200816-fde6-4305-b6a9-a62b8e1e8c1c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:17.515175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41200816-fde6-4305-b6a9-a62b8e1e8c1c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:17.515707 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41200816-fde6-4305-b6a9-a62b8e1e8c1c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:17.516148 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41200816-fde6-4305-b6a9-a62b8e1e8c1c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:17.710344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-41200816-fde6-4305-b6a9-a62b8e1e8c1c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:17.731553 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-41200816-fde6-4305-b6a9-a62b8e1e8c1c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:17.734093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-41200816-fde6-4305-b6a9-a62b8e1e8c1c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:17.743940 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-41200816-fde6-4305-b6a9-a62b8e1e8c1c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1506 microversion: 2.91 time: 0.277894 Oct 05 02:42:17.745255 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1672/3366] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:17 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1506 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:42:17.753157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-400bea42-c69b-4cbd-a223-b8974644c789 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] Calling method '.version_select at 0x7fccdfdfec10>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:17.766286 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b4652f3a-6632-4c1e-a576-2619268adccc tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:17.787965 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b4652f3a-6632-4c1e-a576-2619268adccc tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1317 microversion: 2.1 time: 0.532401 Oct 05 02:42:17.789140 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1695/3367] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:17 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1317 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:17.822073 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-400bea42-c69b-4cbd-a223-b8974644c789 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] HTTP exception thrown: Volume 28310851-175f-4dda-b6a6-5f06155c4d62 could not be found. Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-400bea42-c69b-4cbd-a223-b8974644c789 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] Request method failure captured: Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/os-volumes/28310851-175f-4dda-b6a6-5f06155c4d62 HTTP/1.1 Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO79YfvGxJMpe3U156YQcmMhjEWGTnL34DNwPGs6h3hYkaCSrM-oTK5gsGT8Jd5Tlw8nWu7D4NngggDJYAYNrZzoD0W11w_jke4PUpnj9wsJTbBjc2Jnr90svUAfcc3MMmWSN4yevxYIz0dSBOd5zblLCZtgSGFWMonUbnOTSw_gB-I Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: fd7c8d5cae8b44c4b3f1b79787b0dad9 Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-246106381 Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd7c8d5cae8b44c4b3f1b79787b0dad9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd7c8d5cae8b44c4b3f1b79787b0dad9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fd7c8d5cae8b44c4b3f1b79787b0dad9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fd7c8d5cae8b44c4b3f1b79787b0dad9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-VolumesSnapshotsTestJSON-246106381 Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: fd7c8d5cae8b44c4b3f1b79787b0dad9 Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-246106381 Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-VolumesSnapshotsTestJSON-246106381-project Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: dde6d228151a43be8b5ac3a6bbe4e038 Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-VolumesSnapshotsTestJSON-246106381-project Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: exception: Volume 28310851-175f-4dda-b6a6-5f06155c4d62 could not be found. Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '28310851-175f-4dda-b6a6-5f06155c4d62'} Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 28310851-175f-4dda-b6a6-5f06155c4d62 could not be found. (HTTP 404) (Request-ID: req-7437f371-366a-48ee-91e1-a64c2146d903) Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 02:42:17.824275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 28310851-175f-4dda-b6a6-5f06155c4d62 could not be found. Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 28310851-175f-4dda-b6a6-5f06155c4d62 could not be found. Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 28310851-175f-4dda-b6a6-5f06155c4d62 could not be found. Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-400bea42-c69b-4cbd-a223-b8974644c789 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] Returning 404 to user: Volume 28310851-175f-4dda-b6a6-5f06155c4d62 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-400bea42-c69b-4cbd-a223-b8974644c789 tempest-VolumesSnapshotsTestJSON-246106381 tempest-VolumesSnapshotsTestJSON-246106381-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/28310851-175f-4dda-b6a6-5f06155c4d62" status: 404 len: 109 microversion: 2.1 time: 0.079456 Oct 05 02:42:17.833133 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1673/3368] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 02:42:17 2022] GET /compute/v2.1/os-volumes/28310851-175f-4dda-b6a6-5f06155c4d62 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:42:18.266451 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-58f44908-3b17-498d-8bc3-f6e8c9a33907 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:18.267867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-58f44908-3b17-498d-8bc3-f6e8c9a33907 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:18.270217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-acc5b119-8f9e-4513-91ab-90eeb3ee00db tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:18.271450 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-acc5b119-8f9e-4513-91ab-90eeb3ee00db tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:18.280035 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58f44908-3b17-498d-8bc3-f6e8c9a33907 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:18.286605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58f44908-3b17-498d-8bc3-f6e8c9a33907 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:18.287247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-acc5b119-8f9e-4513-91ab-90eeb3ee00db tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:18.287480 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58f44908-3b17-498d-8bc3-f6e8c9a33907 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:18.289974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-acc5b119-8f9e-4513-91ab-90eeb3ee00db tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:18.290855 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58f44908-3b17-498d-8bc3-f6e8c9a33907 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:18.291445 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58f44908-3b17-498d-8bc3-f6e8c9a33907 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:18.291808 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-acc5b119-8f9e-4513-91ab-90eeb3ee00db tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:18.292758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-acc5b119-8f9e-4513-91ab-90eeb3ee00db tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:18.293823 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58f44908-3b17-498d-8bc3-f6e8c9a33907 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:18.295242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-acc5b119-8f9e-4513-91ab-90eeb3ee00db tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:18.296735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-acc5b119-8f9e-4513-91ab-90eeb3ee00db tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:18.603988 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-58f44908-3b17-498d-8bc3-f6e8c9a33907 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:18.613393 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-58f44908-3b17-498d-8bc3-f6e8c9a33907 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 200 len: 1289 microversion: 2.1 time: 0.353013 Oct 05 02:42:18.613986 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1696/3369] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:18 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 1289 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:18.655705 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-acc5b119-8f9e-4513-91ab-90eeb3ee00db tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:18.671061 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-acc5b119-8f9e-4513-91ab-90eeb3ee00db tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1471 microversion: 2.1 time: 0.405235 Oct 05 02:42:18.671778 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1674/3370] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:18 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1471 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:18.698907 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-361b2b15-21a7-4772-8aec-70e7ea7ba72e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:42:18.699824 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-361b2b15-21a7-4772-8aec-70e7ea7ba72e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:18.709037 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-361b2b15-21a7-4772-8aec-70e7ea7ba72e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:18.709782 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-361b2b15-21a7-4772-8aec-70e7ea7ba72e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:18.710757 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-361b2b15-21a7-4772-8aec-70e7ea7ba72e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:18.711713 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-361b2b15-21a7-4772-8aec-70e7ea7ba72e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:18.712347 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-361b2b15-21a7-4772-8aec-70e7ea7ba72e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:18.713381 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-361b2b15-21a7-4772-8aec-70e7ea7ba72e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:18.776167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-98f18848-c358-4e14-bf70-85abbf7ffc5c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:18.776931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-98f18848-c358-4e14-bf70-85abbf7ffc5c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:18.780049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-361b2b15-21a7-4772-8aec-70e7ea7ba72e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:18.783622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98f18848-c358-4e14-bf70-85abbf7ffc5c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:18.784648 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98f18848-c358-4e14-bf70-85abbf7ffc5c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:18.785116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98f18848-c358-4e14-bf70-85abbf7ffc5c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:18.785829 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98f18848-c358-4e14-bf70-85abbf7ffc5c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:18.786315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98f18848-c358-4e14-bf70-85abbf7ffc5c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:18.786747 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98f18848-c358-4e14-bf70-85abbf7ffc5c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:18.789395 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-361b2b15-21a7-4772-8aec-70e7ea7ba72e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:18.790273 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-361b2b15-21a7-4772-8aec-70e7ea7ba72e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:18.791297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-361b2b15-21a7-4772-8aec-70e7ea7ba72e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:18.791769 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-361b2b15-21a7-4772-8aec-70e7ea7ba72e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:18.792204 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-361b2b15-21a7-4772-8aec-70e7ea7ba72e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:18.836487 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-361b2b15-21a7-4772-8aec-70e7ea7ba72e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Getting quotas for project 446a33968038476fbc98fc0b6b1795c0. Resources: {'cores', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:42:18.843539 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-361b2b15-21a7-4772-8aec-70e7ea7ba72e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Getting quotas for user 1b4b5f0c43074932a8963727adfee38a and project 446a33968038476fbc98fc0b6b1795c0. Resources: {'cores', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:42:18.883884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-98f18848-c358-4e14-bf70-85abbf7ffc5c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:18.894532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-98f18848-c358-4e14-bf70-85abbf7ffc5c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:18.896371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-98f18848-c358-4e14-bf70-85abbf7ffc5c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:18.903317 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-98f18848-c358-4e14-bf70-85abbf7ffc5c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1512 microversion: 2.91 time: 0.130913 Oct 05 02:42:18.917647 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1675/3371] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:18 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1512 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:42:18.932380 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-12415c86-0eb8-428d-b8b8-63b5f6c71aff tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:18.933073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-12415c86-0eb8-428d-b8b8-63b5f6c71aff tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:18.941751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12415c86-0eb8-428d-b8b8-63b5f6c71aff tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:18.942529 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12415c86-0eb8-428d-b8b8-63b5f6c71aff tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:18.943129 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12415c86-0eb8-428d-b8b8-63b5f6c71aff tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:18.945043 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12415c86-0eb8-428d-b8b8-63b5f6c71aff tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:18.945731 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12415c86-0eb8-428d-b8b8-63b5f6c71aff tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:18.946328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12415c86-0eb8-428d-b8b8-63b5f6c71aff tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:18.985701 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-361b2b15-21a7-4772-8aec-70e7ea7ba72e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "POST /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd/action" status: 202 len: 0 microversion: 2.1 time: 0.291617 Oct 05 02:42:18.986322 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1697/3372] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:42:18 2022] POST /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:42:19.001640 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c86943a2-2f32-48a2-b88c-8272715cf477 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:19.004530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c86943a2-2f32-48a2-b88c-8272715cf477 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:19.015042 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c86943a2-2f32-48a2-b88c-8272715cf477 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:19.015992 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c86943a2-2f32-48a2-b88c-8272715cf477 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:19.016681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c86943a2-2f32-48a2-b88c-8272715cf477 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:19.017650 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c86943a2-2f32-48a2-b88c-8272715cf477 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:19.019251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c86943a2-2f32-48a2-b88c-8272715cf477 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:19.019913 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c86943a2-2f32-48a2-b88c-8272715cf477 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:19.173036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-12415c86-0eb8-428d-b8b8-63b5f6c71aff tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:19.184658 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-12415c86-0eb8-428d-b8b8-63b5f6c71aff tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1317 microversion: 2.1 time: 0.265574 Oct 05 02:42:19.188624 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1676/3373] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:18 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:19.218127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-2ae715ad-8d64-4ea2-a4df-c150a7a80a72 req-5482877a-9c0e-49ef-a6b0-6b6c9b5f7aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d57f876f-018d-4500-8b46-a0ad8983fff5", "name": "network-vif-plugged", "status": "completed", "tag": "bed4013f-097d-4219-99f5-4d1b78fcda5c"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:42:19.230675 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-2ae715ad-8d64-4ea2-a4df-c150a7a80a72 req-5482877a-9c0e-49ef-a6b0-6b6c9b5f7aa9 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:19.231763 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-2ae715ad-8d64-4ea2-a4df-c150a7a80a72 req-5482877a-9c0e-49ef-a6b0-6b6c9b5f7aa9 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:19.232214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-2ae715ad-8d64-4ea2-a4df-c150a7a80a72 req-5482877a-9c0e-49ef-a6b0-6b6c9b5f7aa9 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:19.240532 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c86943a2-2f32-48a2-b88c-8272715cf477 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:19.248637 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c86943a2-2f32-48a2-b88c-8272715cf477 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1470 microversion: 2.1 time: 0.257078 Oct 05 02:42:19.249567 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1698/3374] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:18 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1470 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:42:19.251344 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-2ae715ad-8d64-4ea2-a4df-c150a7a80a72 req-5482877a-9c0e-49ef-a6b0-6b6c9b5f7aa9 service nova] Creating event network-vif-plugged:bed4013f-097d-4219-99f5-4d1b78fcda5c for instance d57f876f-018d-4500-8b46-a0ad8983fff5 on n-h1-858272-3 Oct 05 02:42:19.265286 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-2ae715ad-8d64-4ea2-a4df-c150a7a80a72 req-5482877a-9c0e-49ef-a6b0-6b6c9b5f7aa9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058115 Oct 05 02:42:19.266239 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1677/3375] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:42:19.644596 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-19d62f61-5393-4eba-b1ce-511a3111e37a tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:19.645230 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-19d62f61-5393-4eba-b1ce-511a3111e37a tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:19.658659 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19d62f61-5393-4eba-b1ce-511a3111e37a tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:19.659394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19d62f61-5393-4eba-b1ce-511a3111e37a tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:19.659843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19d62f61-5393-4eba-b1ce-511a3111e37a tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:19.661201 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19d62f61-5393-4eba-b1ce-511a3111e37a tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:19.661668 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19d62f61-5393-4eba-b1ce-511a3111e37a tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:19.662097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19d62f61-5393-4eba-b1ce-511a3111e37a tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:19.858277 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-19d62f61-5393-4eba-b1ce-511a3111e37a tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:19.861455 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:19.885742 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-19d62f61-5393-4eba-b1ce-511a3111e37a tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 200 len: 1289 microversion: 2.1 time: 0.237231 Oct 05 02:42:19.887102 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1699/3376] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:19 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 1289 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:19.937880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-60ae0648-99ae-44f3-8572-f9c0b2ef2aae tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:19.939159 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-60ae0648-99ae-44f3-8572-f9c0b2ef2aae tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:19.945732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60ae0648-99ae-44f3-8572-f9c0b2ef2aae tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:19.946642 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60ae0648-99ae-44f3-8572-f9c0b2ef2aae tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:19.947563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60ae0648-99ae-44f3-8572-f9c0b2ef2aae tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:19.948464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60ae0648-99ae-44f3-8572-f9c0b2ef2aae tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:19.949139 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60ae0648-99ae-44f3-8572-f9c0b2ef2aae tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:19.950043 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60ae0648-99ae-44f3-8572-f9c0b2ef2aae tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:20.040827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-60ae0648-99ae-44f3-8572-f9c0b2ef2aae tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:20.056629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-60ae0648-99ae-44f3-8572-f9c0b2ef2aae tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:20.059037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-60ae0648-99ae-44f3-8572-f9c0b2ef2aae tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:20.080202 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-60ae0648-99ae-44f3-8572-f9c0b2ef2aae tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1512 microversion: 2.91 time: 0.147295 Oct 05 02:42:20.082043 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1678/3377] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:19 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:42:20.210727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0b4083c3-bb18-43ad-ada1-b919ece47ca2 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:20.211348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0b4083c3-bb18-43ad-ada1-b919ece47ca2 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:20.229565 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b4083c3-bb18-43ad-ada1-b919ece47ca2 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:20.230392 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b4083c3-bb18-43ad-ada1-b919ece47ca2 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:20.231315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b4083c3-bb18-43ad-ada1-b919ece47ca2 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:20.232720 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b4083c3-bb18-43ad-ada1-b919ece47ca2 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:20.233724 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b4083c3-bb18-43ad-ada1-b919ece47ca2 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:20.234377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b4083c3-bb18-43ad-ada1-b919ece47ca2 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:20.331158 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4ab45174-7942-450e-914e-ad428f68f525 tempest-VolumesGetTestJSON-481404777 tempest-VolumesGetTestJSON-481404777-project] Action: 'create', calling method: .version_select at 0x7fcce816b160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-338412811", "metadata": {"Type": "work"}}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:42:20.505450 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0b4083c3-bb18-43ad-ada1-b919ece47ca2 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:20.517401 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0b4083c3-bb18-43ad-ada1-b919ece47ca2 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1317 microversion: 2.1 time: 0.307687 Oct 05 02:42:20.520294 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1679/3378] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:20 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:42:20.537735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ae7e6823-d907-4dd2-821c-0e48081680e6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:20.538677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ae7e6823-d907-4dd2-821c-0e48081680e6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:20.554844 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae7e6823-d907-4dd2-821c-0e48081680e6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:20.555292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae7e6823-d907-4dd2-821c-0e48081680e6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:20.556165 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae7e6823-d907-4dd2-821c-0e48081680e6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:20.557519 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae7e6823-d907-4dd2-821c-0e48081680e6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:20.558281 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae7e6823-d907-4dd2-821c-0e48081680e6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:20.559049 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae7e6823-d907-4dd2-821c-0e48081680e6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:20.780514 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4ab45174-7942-450e-914e-ad428f68f525 tempest-VolumesGetTestJSON-481404777 tempest-VolumesGetTestJSON-481404777-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.632555 Oct 05 02:42:20.781565 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1700/3379] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Oct 5 02:42:20 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 634 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 05 02:42:20.816667 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8fa97d89-3ddf-44ae-b37f-64550b0c8d01 tempest-VolumesGetTestJSON-481404777 tempest-VolumesGetTestJSON-481404777-project] Calling method '.version_select at 0x7fcce8084700>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:20.883620 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8fa97d89-3ddf-44ae-b37f-64550b0c8d01 tempest-VolumesGetTestJSON-481404777 tempest-VolumesGetTestJSON-481404777-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/d8a477c1-86f0-4d8f-8b5b-7219a17871cb" status: 200 len: 352 microversion: 2.1 time: 0.079956 Oct 05 02:42:20.884203 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1701/3380] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 02:42:20 2022] GET /compute/v2.1/os-volumes/d8a477c1-86f0-4d8f-8b5b-7219a17871cb => generated 352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:42:20.910302 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-88a513a6-e024-4b24-8348-aa2e3dbea092 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:20.910909 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-88a513a6-e024-4b24-8348-aa2e3dbea092 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:20.930812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-88a513a6-e024-4b24-8348-aa2e3dbea092 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:20.930812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-88a513a6-e024-4b24-8348-aa2e3dbea092 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:20.930812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-88a513a6-e024-4b24-8348-aa2e3dbea092 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:20.930812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-88a513a6-e024-4b24-8348-aa2e3dbea092 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:20.930812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-88a513a6-e024-4b24-8348-aa2e3dbea092 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:20.931235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-88a513a6-e024-4b24-8348-aa2e3dbea092 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:21.209841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ae7e6823-d907-4dd2-821c-0e48081680e6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:21.222449 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ae7e6823-d907-4dd2-821c-0e48081680e6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1470 microversion: 2.1 time: 0.699976 Oct 05 02:42:21.226671 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1680/3381] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:20 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1470 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:21.235081 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-23bc28fc-a75b-4199-945d-ef35a314c19e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:21.235704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-23bc28fc-a75b-4199-945d-ef35a314c19e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:21.253500 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23bc28fc-a75b-4199-945d-ef35a314c19e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:21.256048 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23bc28fc-a75b-4199-945d-ef35a314c19e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:21.257088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23bc28fc-a75b-4199-945d-ef35a314c19e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:21.258014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23bc28fc-a75b-4199-945d-ef35a314c19e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:21.261425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23bc28fc-a75b-4199-945d-ef35a314c19e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:21.262111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23bc28fc-a75b-4199-945d-ef35a314c19e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:21.298327 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-88a513a6-e024-4b24-8348-aa2e3dbea092 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:21.308853 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-88a513a6-e024-4b24-8348-aa2e3dbea092 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 200 len: 1289 microversion: 2.1 time: 0.402764 Oct 05 02:42:21.317560 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1702/3382] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:20 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 1289 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:42:21.412419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-23bc28fc-a75b-4199-945d-ef35a314c19e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:21.420680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-23bc28fc-a75b-4199-945d-ef35a314c19e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:21.422840 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-23bc28fc-a75b-4199-945d-ef35a314c19e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:21.434755 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-23bc28fc-a75b-4199-945d-ef35a314c19e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1512 microversion: 2.91 time: 0.206946 Oct 05 02:42:21.435750 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1681/3383] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:21 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1512 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:42:21.540611 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-14e77c16-5ab3-4530-8e6b-83f24b008ea7 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:21.541228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-14e77c16-5ab3-4530-8e6b-83f24b008ea7 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:21.550991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14e77c16-5ab3-4530-8e6b-83f24b008ea7 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:21.552146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14e77c16-5ab3-4530-8e6b-83f24b008ea7 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:21.552583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14e77c16-5ab3-4530-8e6b-83f24b008ea7 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:21.553327 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14e77c16-5ab3-4530-8e6b-83f24b008ea7 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:21.553771 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14e77c16-5ab3-4530-8e6b-83f24b008ea7 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:21.554188 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14e77c16-5ab3-4530-8e6b-83f24b008ea7 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:21.900729 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6511bb46-163a-430e-a288-0674fdc1f6f1 tempest-VolumesGetTestJSON-481404777 tempest-VolumesGetTestJSON-481404777-project] Calling method '.version_select at 0x7fccdfd1d040>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:21.925340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-14e77c16-5ab3-4530-8e6b-83f24b008ea7 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:21.939036 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-14e77c16-5ab3-4530-8e6b-83f24b008ea7 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1317 microversion: 2.1 time: 0.402225 Oct 05 02:42:21.940430 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1703/3384] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:21 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1317 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:21.988208 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6511bb46-163a-430e-a288-0674fdc1f6f1 tempest-VolumesGetTestJSON-481404777 tempest-VolumesGetTestJSON-481404777-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/d8a477c1-86f0-4d8f-8b5b-7219a17871cb" status: 200 len: 353 microversion: 2.1 time: 0.091750 Oct 05 02:42:21.993408 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1682/3385] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 02:42:21 2022] GET /compute/v2.1/os-volumes/d8a477c1-86f0-4d8f-8b5b-7219a17871cb => generated 353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:42:22.003226 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a5d42e53-50a5-42ba-be4a-ac00d368e38e tempest-VolumesGetTestJSON-481404777 tempest-VolumesGetTestJSON-481404777-project] Calling method '.version_select at 0x7fccdf72d820>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:22.083795 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a5d42e53-50a5-42ba-be4a-ac00d368e38e tempest-VolumesGetTestJSON-481404777 tempest-VolumesGetTestJSON-481404777-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/d8a477c1-86f0-4d8f-8b5b-7219a17871cb" status: 200 len: 353 microversion: 2.1 time: 0.085400 Oct 05 02:42:22.085297 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1704/3386] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 02:42:21 2022] GET /compute/v2.1/os-volumes/d8a477c1-86f0-4d8f-8b5b-7219a17871cb => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:42:22.098281 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-581f7967-0be9-4563-a44e-9a1fc0a3df11 tempest-VolumesGetTestJSON-481404777 tempest-VolumesGetTestJSON-481404777-project] Calling method '.version_select at 0x7fccdfdd9f70>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:22.164045 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-40fbfa6a-53f4-4cca-b32b-3a5c7a9c1004 req-588606d4-ea05-41fd-81ba-c7aec825d9b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1b41d44-1201-460a-b938-7a70567656cd", "name": "network-vif-plugged", "status": "completed", "tag": "99ce69bd-430b-41c6-a998-33a5e643493b"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:42:22.177020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-40fbfa6a-53f4-4cca-b32b-3a5c7a9c1004 req-588606d4-ea05-41fd-81ba-c7aec825d9b6 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:22.177728 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-40fbfa6a-53f4-4cca-b32b-3a5c7a9c1004 req-588606d4-ea05-41fd-81ba-c7aec825d9b6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:22.178505 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-40fbfa6a-53f4-4cca-b32b-3a5c7a9c1004 req-588606d4-ea05-41fd-81ba-c7aec825d9b6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:22.183373 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-581f7967-0be9-4563-a44e-9a1fc0a3df11 tempest-VolumesGetTestJSON-481404777 tempest-VolumesGetTestJSON-481404777-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/d8a477c1-86f0-4d8f-8b5b-7219a17871cb" status: 202 len: 0 microversion: 2.1 time: 0.089318 Oct 05 02:42:22.183955 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1683/3387] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 02:42:22 2022] DELETE /compute/v2.1/os-volumes/d8a477c1-86f0-4d8f-8b5b-7219a17871cb => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:42:22.195207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0885e34b-c91b-4891-82ae-8e65cfbab019 tempest-VolumesGetTestJSON-481404777 tempest-VolumesGetTestJSON-481404777-project] Calling method '.version_select at 0x7fcce40dddc0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:22.234184 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-40fbfa6a-53f4-4cca-b32b-3a5c7a9c1004 req-588606d4-ea05-41fd-81ba-c7aec825d9b6 service nova] Creating event network-vif-plugged:99ce69bd-430b-41c6-a998-33a5e643493b for instance d1b41d44-1201-460a-b938-7a70567656cd on n-h1-858272-3 Oct 05 02:42:22.248522 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [req-40fbfa6a-53f4-4cca-b32b-3a5c7a9c1004 req-588606d4-ea05-41fd-81ba-c7aec825d9b6 service nova] Instance d1b41d44-1201-460a-b938-7a70567656cd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 02:42:22.274213 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-40fbfa6a-53f4-4cca-b32b-3a5c7a9c1004 req-588606d4-ea05-41fd-81ba-c7aec825d9b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113736 Oct 05 02:42:22.277340 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1705/3388] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:42:22.291115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c8c4271c-0def-4e4a-b7c8-c718dc0ed724 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:22.294803 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0885e34b-c91b-4891-82ae-8e65cfbab019 tempest-VolumesGetTestJSON-481404777 tempest-VolumesGetTestJSON-481404777-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/d8a477c1-86f0-4d8f-8b5b-7219a17871cb" status: 200 len: 352 microversion: 2.1 time: 0.106676 Oct 05 02:42:22.295346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c8c4271c-0def-4e4a-b7c8-c718dc0ed724 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:22.295487 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1684/3389] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 02:42:22 2022] GET /compute/v2.1/os-volumes/d8a477c1-86f0-4d8f-8b5b-7219a17871cb => generated 352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:42:22.309927 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8c4271c-0def-4e4a-b7c8-c718dc0ed724 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:22.310429 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8c4271c-0def-4e4a-b7c8-c718dc0ed724 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:22.310860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8c4271c-0def-4e4a-b7c8-c718dc0ed724 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:22.311559 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8c4271c-0def-4e4a-b7c8-c718dc0ed724 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:22.312376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8c4271c-0def-4e4a-b7c8-c718dc0ed724 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:22.312817 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8c4271c-0def-4e4a-b7c8-c718dc0ed724 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:22.337570 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d61f81d1-3224-45fe-8b27-2e3f4ec0160e tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:22.338427 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d61f81d1-3224-45fe-8b27-2e3f4ec0160e tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:22.349843 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d61f81d1-3224-45fe-8b27-2e3f4ec0160e tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:22.352770 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d61f81d1-3224-45fe-8b27-2e3f4ec0160e tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:22.353267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d61f81d1-3224-45fe-8b27-2e3f4ec0160e tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:22.355030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d61f81d1-3224-45fe-8b27-2e3f4ec0160e tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:22.356787 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d61f81d1-3224-45fe-8b27-2e3f4ec0160e tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:22.357260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d61f81d1-3224-45fe-8b27-2e3f4ec0160e tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:22.579533 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c8c4271c-0def-4e4a-b7c8-c718dc0ed724 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:22.595863 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c8c4271c-0def-4e4a-b7c8-c718dc0ed724 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1470 microversion: 2.1 time: 0.316908 Oct 05 02:42:22.610725 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1706/3390] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:22 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1470 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:22.621036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1fadccfe-62ba-4520-8e6a-be124cb954c5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:22.621682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1fadccfe-62ba-4520-8e6a-be124cb954c5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:22.628571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1fadccfe-62ba-4520-8e6a-be124cb954c5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:22.629484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1fadccfe-62ba-4520-8e6a-be124cb954c5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:22.630153 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1fadccfe-62ba-4520-8e6a-be124cb954c5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:22.631253 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1fadccfe-62ba-4520-8e6a-be124cb954c5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:22.631933 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1fadccfe-62ba-4520-8e6a-be124cb954c5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:22.632577 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1fadccfe-62ba-4520-8e6a-be124cb954c5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:22.701012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d61f81d1-3224-45fe-8b27-2e3f4ec0160e tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:22.703837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:22.722300 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d61f81d1-3224-45fe-8b27-2e3f4ec0160e tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 200 len: 1289 microversion: 2.1 time: 0.389756 Oct 05 02:42:22.738678 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1685/3391] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:22 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 1289 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:42:22.745160 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1fadccfe-62ba-4520-8e6a-be124cb954c5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:22.760032 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1fadccfe-62ba-4520-8e6a-be124cb954c5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:22.761991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1fadccfe-62ba-4520-8e6a-be124cb954c5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:22.768777 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1fadccfe-62ba-4520-8e6a-be124cb954c5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1512 microversion: 2.91 time: 0.156508 Oct 05 02:42:22.786245 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1707/3392] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:22 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:42:22.970907 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4f41ecb4-29ef-4473-b954-2746f020f575 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:22.972504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4f41ecb4-29ef-4473-b954-2746f020f575 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:22.987272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f41ecb4-29ef-4473-b954-2746f020f575 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:22.991905 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f41ecb4-29ef-4473-b954-2746f020f575 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:22.992683 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f41ecb4-29ef-4473-b954-2746f020f575 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:22.993654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f41ecb4-29ef-4473-b954-2746f020f575 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:22.994319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f41ecb4-29ef-4473-b954-2746f020f575 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:22.995002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f41ecb4-29ef-4473-b954-2746f020f575 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:23.173378 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4f41ecb4-29ef-4473-b954-2746f020f575 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:23.187230 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4f41ecb4-29ef-4473-b954-2746f020f575 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1317 microversion: 2.1 time: 0.223964 Oct 05 02:42:23.187759 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1686/3393] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:22 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:23.314945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6a001609-8ccd-4248-96d0-83f2829b9dfe tempest-VolumesGetTestJSON-481404777 tempest-VolumesGetTestJSON-481404777-project] Calling method '.version_select at 0x7fccdfd16ee0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:23.404574 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6a001609-8ccd-4248-96d0-83f2829b9dfe tempest-VolumesGetTestJSON-481404777 tempest-VolumesGetTestJSON-481404777-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/d8a477c1-86f0-4d8f-8b5b-7219a17871cb" status: 200 len: 352 microversion: 2.1 time: 0.097653 Oct 05 02:42:23.405189 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1708/3394] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 02:42:23 2022] GET /compute/v2.1/os-volumes/d8a477c1-86f0-4d8f-8b5b-7219a17871cb => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:42:23.623412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-26f12b69-4e96-484e-bd09-ab861b61730d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:23.624294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-26f12b69-4e96-484e-bd09-ab861b61730d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:23.636271 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26f12b69-4e96-484e-bd09-ab861b61730d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:23.637155 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26f12b69-4e96-484e-bd09-ab861b61730d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:23.637707 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26f12b69-4e96-484e-bd09-ab861b61730d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:23.638640 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26f12b69-4e96-484e-bd09-ab861b61730d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:23.639202 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26f12b69-4e96-484e-bd09-ab861b61730d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:23.639696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26f12b69-4e96-484e-bd09-ab861b61730d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:23.750812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-65aa706b-3cc2-41d8-989e-bb54a3162d76 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:23.751583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-65aa706b-3cc2-41d8-989e-bb54a3162d76 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:23.773122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-65aa706b-3cc2-41d8-989e-bb54a3162d76 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:23.773681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-65aa706b-3cc2-41d8-989e-bb54a3162d76 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:23.774136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-65aa706b-3cc2-41d8-989e-bb54a3162d76 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:23.774888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-65aa706b-3cc2-41d8-989e-bb54a3162d76 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:23.775379 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-65aa706b-3cc2-41d8-989e-bb54a3162d76 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:23.775822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-65aa706b-3cc2-41d8-989e-bb54a3162d76 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:23.901784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-26f12b69-4e96-484e-bd09-ab861b61730d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:23.914986 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-26f12b69-4e96-484e-bd09-ab861b61730d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1470 microversion: 2.1 time: 0.294207 Oct 05 02:42:23.917307 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1687/3395] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:23 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1470 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:23.934151 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-48bb2283-3638-4579-9b16-acaf30782258 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:23.935135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-48bb2283-3638-4579-9b16-acaf30782258 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:23.948025 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48bb2283-3638-4579-9b16-acaf30782258 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:23.948891 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48bb2283-3638-4579-9b16-acaf30782258 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:23.949671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48bb2283-3638-4579-9b16-acaf30782258 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:23.951855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48bb2283-3638-4579-9b16-acaf30782258 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:23.952573 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48bb2283-3638-4579-9b16-acaf30782258 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:23.954521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48bb2283-3638-4579-9b16-acaf30782258 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:24.076886 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-48bb2283-3638-4579-9b16-acaf30782258 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:24.094354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-48bb2283-3638-4579-9b16-acaf30782258 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:24.096153 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-48bb2283-3638-4579-9b16-acaf30782258 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:24.102007 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-48bb2283-3638-4579-9b16-acaf30782258 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1533 microversion: 2.91 time: 0.182038 Oct 05 02:42:24.102847 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1688/3396] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:23 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1533 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:42:24.118619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-65aa706b-3cc2-41d8-989e-bb54a3162d76 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:24.131007 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-65aa706b-3cc2-41d8-989e-bb54a3162d76 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 200 len: 1289 microversion: 2.1 time: 0.387999 Oct 05 02:42:24.159775 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1709/3397] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:23 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 1289 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:24.216195 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-26b75d45-a73d-4769-942d-55ba10cb8829 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:24.216823 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-26b75d45-a73d-4769-942d-55ba10cb8829 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:24.232011 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-26b75d45-a73d-4769-942d-55ba10cb8829 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:24.232792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-26b75d45-a73d-4769-942d-55ba10cb8829 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:24.233260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-26b75d45-a73d-4769-942d-55ba10cb8829 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:24.234302 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-26b75d45-a73d-4769-942d-55ba10cb8829 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:24.235012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-26b75d45-a73d-4769-942d-55ba10cb8829 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:24.235703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-26b75d45-a73d-4769-942d-55ba10cb8829 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:24.430677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-26b75d45-a73d-4769-942d-55ba10cb8829 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:24.442436 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-26b75d45-a73d-4769-942d-55ba10cb8829 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1317 microversion: 2.1 time: 0.231891 Oct 05 02:42:24.444003 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1710/3398] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:24 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:24.449326 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-eab23ffe-d8aa-4d61-b65c-fc1d476e4468 req-80be5c2b-1ee2-4e02-acce-4dc903c02c25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e1df96-3094-46e9-a96a-adb0aa39d976", "name": "network-vif-plugged", "status": "completed", "tag": "1de9a92c-6fa6-47d3-96ae-a2dd7481ec08"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:42:24.461215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-eab23ffe-d8aa-4d61-b65c-fc1d476e4468 req-80be5c2b-1ee2-4e02-acce-4dc903c02c25 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:24.461985 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-eab23ffe-d8aa-4d61-b65c-fc1d476e4468 req-80be5c2b-1ee2-4e02-acce-4dc903c02c25 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:24.463404 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-eab23ffe-d8aa-4d61-b65c-fc1d476e4468 req-80be5c2b-1ee2-4e02-acce-4dc903c02c25 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:24.476175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b13fcafa-6cc8-4b0f-9a92-444f0e925180 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:24.478151 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b13fcafa-6cc8-4b0f-9a92-444f0e925180 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:24.479445 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-eab23ffe-d8aa-4d61-b65c-fc1d476e4468 req-80be5c2b-1ee2-4e02-acce-4dc903c02c25 service nova] Creating event network-vif-plugged:1de9a92c-6fa6-47d3-96ae-a2dd7481ec08 for instance 91e1df96-3094-46e9-a96a-adb0aa39d976 on n-h2-858272-3 Oct 05 02:42:24.491027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b13fcafa-6cc8-4b0f-9a92-444f0e925180 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:24.491353 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b13fcafa-6cc8-4b0f-9a92-444f0e925180 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:24.492039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b13fcafa-6cc8-4b0f-9a92-444f0e925180 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:24.492956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b13fcafa-6cc8-4b0f-9a92-444f0e925180 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:24.493277 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b13fcafa-6cc8-4b0f-9a92-444f0e925180 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:24.493971 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b13fcafa-6cc8-4b0f-9a92-444f0e925180 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:24.497092 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-eab23ffe-d8aa-4d61-b65c-fc1d476e4468 req-80be5c2b-1ee2-4e02-acce-4dc903c02c25 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048721 Oct 05 02:42:24.501201 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1711/3399] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:42:24.512872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-33e140fb-13dd-4a0f-a158-fcc9773139c3 tempest-VolumesGetTestJSON-481404777 tempest-VolumesGetTestJSON-481404777-project] Calling method '.version_select at 0x7fccdfd16430>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:24.586478 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-b13fcafa-6cc8-4b0f-9a92-444f0e925180 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Lazy-loading 'services' on Instance uuid 6787dcfc-b357-49d7-9192-24607b81f2b6 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:42:24.605051 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b13fcafa-6cc8-4b0f-9a92-444f0e925180 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1938 microversion: 2.91 time: 0.478564 Oct 05 02:42:24.605976 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1689/3400] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:24 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1938 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:42:24.629907 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-33e140fb-13dd-4a0f-a158-fcc9773139c3 tempest-VolumesGetTestJSON-481404777 tempest-VolumesGetTestJSON-481404777-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/d8a477c1-86f0-4d8f-8b5b-7219a17871cb" status: 200 len: 352 microversion: 2.1 time: 0.126302 Oct 05 02:42:24.642702 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6aed17bb-fc82-44b1-904b-71486293b5e7 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:24.644020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6aed17bb-fc82-44b1-904b-71486293b5e7 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:24.644657 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1712/3401] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 02:42:24 2022] GET /compute/v2.1/os-volumes/d8a477c1-86f0-4d8f-8b5b-7219a17871cb => generated 352 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:42:24.664617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6aed17bb-fc82-44b1-904b-71486293b5e7 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:24.667811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6aed17bb-fc82-44b1-904b-71486293b5e7 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:24.668804 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6aed17bb-fc82-44b1-904b-71486293b5e7 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:24.670772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6aed17bb-fc82-44b1-904b-71486293b5e7 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:24.671452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6aed17bb-fc82-44b1-904b-71486293b5e7 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:24.672233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6aed17bb-fc82-44b1-904b-71486293b5e7 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:24.793345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-6aed17bb-fc82-44b1-904b-71486293b5e7 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Lazy-loading 'services' on Instance uuid 6787dcfc-b357-49d7-9192-24607b81f2b6 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:42:24.820646 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6aed17bb-fc82-44b1-904b-71486293b5e7 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1938 microversion: 2.91 time: 0.186336 Oct 05 02:42:24.821395 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1690/3402] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:24 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1938 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:42:24.849374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c85c6f1d-ae32-466b-80d1-fe2c322d0f17 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:24.852940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c85c6f1d-ae32-466b-80d1-fe2c322d0f17 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:24.854758 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c85c6f1d-ae32-466b-80d1-fe2c322d0f17 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:24.855082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c85c6f1d-ae32-466b-80d1-fe2c322d0f17 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:24.855826 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c85c6f1d-ae32-466b-80d1-fe2c322d0f17 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:24.856288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c85c6f1d-ae32-466b-80d1-fe2c322d0f17 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:24.856714 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c85c6f1d-ae32-466b-80d1-fe2c322d0f17 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:24.897180 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c85c6f1d-ae32-466b-80d1-fe2c322d0f17 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.052413 Oct 05 02:42:24.904951 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1713/3403] 10.222.0.16 () {60 vars in 1217 bytes} [Wed Oct 5 02:42:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:42:24.910159 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8b0cd088-62ee-456f-acf2-495f577a3515 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:42:24.910766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8b0cd088-62ee-456f-acf2-495f577a3515 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:24.917118 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b0cd088-62ee-456f-acf2-495f577a3515 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:24.917622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b0cd088-62ee-456f-acf2-495f577a3515 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:24.918063 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b0cd088-62ee-456f-acf2-495f577a3515 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:24.918774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b0cd088-62ee-456f-acf2-495f577a3515 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:24.919237 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b0cd088-62ee-456f-acf2-495f577a3515 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:24.919667 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b0cd088-62ee-456f-acf2-495f577a3515 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:24.944524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a5f80efe-f4bb-4443-8cc4-3ce2b7540924 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:24.945405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a5f80efe-f4bb-4443-8cc4-3ce2b7540924 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:24.954236 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5f80efe-f4bb-4443-8cc4-3ce2b7540924 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:24.961530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5f80efe-f4bb-4443-8cc4-3ce2b7540924 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:24.962143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5f80efe-f4bb-4443-8cc4-3ce2b7540924 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:24.965318 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5f80efe-f4bb-4443-8cc4-3ce2b7540924 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:24.966739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5f80efe-f4bb-4443-8cc4-3ce2b7540924 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:24.967235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-8b0cd088-62ee-456f-acf2-495f577a3515 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lazy-loading 'flavor' on Instance uuid 6787dcfc-b357-49d7-9192-24607b81f2b6 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:42:24.969012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5f80efe-f4bb-4443-8cc4-3ce2b7540924 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:25.019872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=8 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:25.185191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a5f80efe-f4bb-4443-8cc4-3ce2b7540924 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:25.198243 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a5f80efe-f4bb-4443-8cc4-3ce2b7540924 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1470 microversion: 2.1 time: 0.256250 Oct 05 02:42:25.202283 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1714/3404] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:24 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1470 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:25.216963 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-768c04ac-b449-4cc3-b28f-dab37d2e8b78 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:25.217592 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-768c04ac-b449-4cc3-b28f-dab37d2e8b78 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:25.226962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-768c04ac-b449-4cc3-b28f-dab37d2e8b78 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:25.227687 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-768c04ac-b449-4cc3-b28f-dab37d2e8b78 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:25.228293 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-768c04ac-b449-4cc3-b28f-dab37d2e8b78 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:25.229189 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-768c04ac-b449-4cc3-b28f-dab37d2e8b78 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:25.229850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-768c04ac-b449-4cc3-b28f-dab37d2e8b78 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:25.230271 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-768c04ac-b449-4cc3-b28f-dab37d2e8b78 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:25.245262 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8b0cd088-62ee-456f-acf2-495f577a3515 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "POST /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6/action" status: 202 len: 0 microversion: 2.91 time: 0.338715 Oct 05 02:42:25.250102 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1691/3405] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 5 02:42:24 2022] POST /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:42:25.261019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f9c9fb0b-a49d-4c2a-9771-a2bac5555860 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:25.262347 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f9c9fb0b-a49d-4c2a-9771-a2bac5555860 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:25.271037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9c9fb0b-a49d-4c2a-9771-a2bac5555860 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:25.271438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9c9fb0b-a49d-4c2a-9771-a2bac5555860 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:25.272172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9c9fb0b-a49d-4c2a-9771-a2bac5555860 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:25.272883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9c9fb0b-a49d-4c2a-9771-a2bac5555860 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:25.273365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9c9fb0b-a49d-4c2a-9771-a2bac5555860 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:25.273863 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9c9fb0b-a49d-4c2a-9771-a2bac5555860 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:25.385986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f9c9fb0b-a49d-4c2a-9771-a2bac5555860 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:25.400251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f9c9fb0b-a49d-4c2a-9771-a2bac5555860 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:25.402673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f9c9fb0b-a49d-4c2a-9771-a2bac5555860 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:25.410999 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f9c9fb0b-a49d-4c2a-9771-a2bac5555860 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.158381 Oct 05 02:42:25.412343 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1692/3406] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:25 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:42:25.448372 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-768c04ac-b449-4cc3-b28f-dab37d2e8b78 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:25.456741 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-768c04ac-b449-4cc3-b28f-dab37d2e8b78 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 200 len: 1480 microversion: 2.1 time: 0.252567 Oct 05 02:42:25.463258 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1715/3407] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:25 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 1480 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:25.467573 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6b661a6b-3c31-48d2-b6df-110c56ee8d87 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:25.468414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6b661a6b-3c31-48d2-b6df-110c56ee8d87 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:25.477311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b661a6b-3c31-48d2-b6df-110c56ee8d87 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:25.478050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b661a6b-3c31-48d2-b6df-110c56ee8d87 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:25.478964 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b661a6b-3c31-48d2-b6df-110c56ee8d87 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:25.479377 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e2d58e2b-6114-4468-a469-eb1f445a1be7 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:25.480094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e2d58e2b-6114-4468-a469-eb1f445a1be7 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:25.480484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b661a6b-3c31-48d2-b6df-110c56ee8d87 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:25.481139 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b661a6b-3c31-48d2-b6df-110c56ee8d87 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:25.482503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b661a6b-3c31-48d2-b6df-110c56ee8d87 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:25.486755 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2d58e2b-6114-4468-a469-eb1f445a1be7 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:25.487342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2d58e2b-6114-4468-a469-eb1f445a1be7 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:25.488207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2d58e2b-6114-4468-a469-eb1f445a1be7 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:25.489217 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2d58e2b-6114-4468-a469-eb1f445a1be7 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:25.490163 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2d58e2b-6114-4468-a469-eb1f445a1be7 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:25.490817 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2d58e2b-6114-4468-a469-eb1f445a1be7 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:25.621156 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e2d58e2b-6114-4468-a469-eb1f445a1be7 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.145339 Oct 05 02:42:25.622282 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1716/3408] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 02:42:25 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5/os-interface => generated 284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:42:25.657557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5f5e1d36-79a3-476e-ad7c-148846dc033f tempest-VolumesGetTestJSON-481404777 tempest-VolumesGetTestJSON-481404777-project] Calling method '.version_select at 0x7fccdfd164c0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:25.683694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6b661a6b-3c31-48d2-b6df-110c56ee8d87 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:25.695843 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6b661a6b-3c31-48d2-b6df-110c56ee8d87 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1317 microversion: 2.1 time: 0.232318 Oct 05 02:42:25.697033 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1693/3409] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:25 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:25.725308 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-5f5e1d36-79a3-476e-ad7c-148846dc033f tempest-VolumesGetTestJSON-481404777 tempest-VolumesGetTestJSON-481404777-project] HTTP exception thrown: Volume d8a477c1-86f0-4d8f-8b5b-7219a17871cb could not be found. Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5f5e1d36-79a3-476e-ad7c-148846dc033f tempest-VolumesGetTestJSON-481404777 tempest-VolumesGetTestJSON-481404777-project] Request method failure captured: Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/os-volumes/d8a477c1-86f0-4d8f-8b5b-7219a17871cb HTTP/1.1 Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO8M11udx_pCH7hfwDjbnh5lpwBqEbpvc5_0RUp8hsB-wvBrRm6dttOczIk7MEVRJrCC0S7eLv2piz5r3CFizdSq_2TXNerz_TTiaOalgUQxHP03ACTQtwkpsD0S44xQwFcM7etEO48afdmRTQNXRZOUzvWxKuU-xgmj-VDqxfyJk98 Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: df4947898613404696306d225928646a Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-VolumesGetTestJSON-481404777 Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/df4947898613404696306d225928646a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/df4947898613404696306d225928646a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/df4947898613404696306d225928646a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_df4947898613404696306d225928646a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-VolumesGetTestJSON-481404777 Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: df4947898613404696306d225928646a Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-VolumesGetTestJSON-481404777 Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-VolumesGetTestJSON-481404777-project Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: f21e8a5fbfa84bd9a1986b9072ffb7cb Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-VolumesGetTestJSON-481404777-project Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: exception: Volume d8a477c1-86f0-4d8f-8b5b-7219a17871cb could not be found. Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'd8a477c1-86f0-4d8f-8b5b-7219a17871cb'} Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d8a477c1-86f0-4d8f-8b5b-7219a17871cb could not be found. (HTTP 404) (Request-ID: req-7e76122a-1184-493a-88bb-c3f10e62df50) Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 02:42:25.729056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d8a477c1-86f0-4d8f-8b5b-7219a17871cb could not be found. Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d8a477c1-86f0-4d8f-8b5b-7219a17871cb could not be found. Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d8a477c1-86f0-4d8f-8b5b-7219a17871cb could not be found. Oct 05 02:42:25.736031 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:42:25.744842 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5f5e1d36-79a3-476e-ad7c-148846dc033f tempest-VolumesGetTestJSON-481404777 tempest-VolumesGetTestJSON-481404777-project] Returning 404 to user: Volume d8a477c1-86f0-4d8f-8b5b-7219a17871cb could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:42:25.745999 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5f5e1d36-79a3-476e-ad7c-148846dc033f tempest-VolumesGetTestJSON-481404777 tempest-VolumesGetTestJSON-481404777-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/d8a477c1-86f0-4d8f-8b5b-7219a17871cb" status: 404 len: 109 microversion: 2.1 time: 0.104410 Oct 05 02:42:25.760520 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1717/3410] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 02:42:25 2022] GET /compute/v2.1/os-volumes/d8a477c1-86f0-4d8f-8b5b-7219a17871cb => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:42:26.224744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8964215f-4b05-43fe-92b8-c0fe500899cb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:26.225769 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8964215f-4b05-43fe-92b8-c0fe500899cb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:26.233952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8964215f-4b05-43fe-92b8-c0fe500899cb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:26.234929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8964215f-4b05-43fe-92b8-c0fe500899cb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:26.235567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8964215f-4b05-43fe-92b8-c0fe500899cb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:26.236499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8964215f-4b05-43fe-92b8-c0fe500899cb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:26.237726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8964215f-4b05-43fe-92b8-c0fe500899cb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:26.238924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8964215f-4b05-43fe-92b8-c0fe500899cb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:26.440664 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ab6cc716-a780-4523-b910-b5fc26ceb6c4 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:26.442540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ab6cc716-a780-4523-b910-b5fc26ceb6c4 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:26.457832 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ab6cc716-a780-4523-b910-b5fc26ceb6c4 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:26.458589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ab6cc716-a780-4523-b910-b5fc26ceb6c4 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:26.463545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ab6cc716-a780-4523-b910-b5fc26ceb6c4 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:26.464627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ab6cc716-a780-4523-b910-b5fc26ceb6c4 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:26.465412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ab6cc716-a780-4523-b910-b5fc26ceb6c4 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:26.466190 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ab6cc716-a780-4523-b910-b5fc26ceb6c4 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:26.483972 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8964215f-4b05-43fe-92b8-c0fe500899cb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:26.503112 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8964215f-4b05-43fe-92b8-c0fe500899cb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1470 microversion: 2.1 time: 0.283330 Oct 05 02:42:26.522457 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1694/3411] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:26 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1470 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:26.600002 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ab6cc716-a780-4523-b910-b5fc26ceb6c4 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:26.619729 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ab6cc716-a780-4523-b910-b5fc26ceb6c4 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:26.621633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ab6cc716-a780-4523-b910-b5fc26ceb6c4 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:26.629416 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ab6cc716-a780-4523-b910-b5fc26ceb6c4 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.193507 Oct 05 02:42:26.630547 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1718/3412] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:26 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:42:26.723968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5391e118-a01b-440e-b913-ae18ea26af63 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:26.728477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5391e118-a01b-440e-b913-ae18ea26af63 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:26.744437 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5391e118-a01b-440e-b913-ae18ea26af63 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:26.745415 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5391e118-a01b-440e-b913-ae18ea26af63 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:26.746376 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5391e118-a01b-440e-b913-ae18ea26af63 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:26.747849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5391e118-a01b-440e-b913-ae18ea26af63 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:26.748477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5391e118-a01b-440e-b913-ae18ea26af63 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:26.749646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5391e118-a01b-440e-b913-ae18ea26af63 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:27.072079 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5391e118-a01b-440e-b913-ae18ea26af63 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:27.081890 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5391e118-a01b-440e-b913-ae18ea26af63 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1506 microversion: 2.1 time: 0.365071 Oct 05 02:42:27.083006 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1695/3413] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:26 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1506 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:27.104078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5215ae85-262e-4542-b952-a4bc67d60a45 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:27.105209 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5215ae85-262e-4542-b952-a4bc67d60a45 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:27.112497 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5215ae85-262e-4542-b952-a4bc67d60a45 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:27.113523 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5215ae85-262e-4542-b952-a4bc67d60a45 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:27.114123 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5215ae85-262e-4542-b952-a4bc67d60a45 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:27.114981 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5215ae85-262e-4542-b952-a4bc67d60a45 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:27.115597 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5215ae85-262e-4542-b952-a4bc67d60a45 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:27.116181 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5215ae85-262e-4542-b952-a4bc67d60a45 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:27.346202 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5215ae85-262e-4542-b952-a4bc67d60a45 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:27.355689 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5215ae85-262e-4542-b952-a4bc67d60a45 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1506 microversion: 2.1 time: 0.254530 Oct 05 02:42:27.356654 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1719/3414] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:27 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1506 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:27.382685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-697487d6-ab14-44c1-a8af-83006db3f995 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:42:27.386299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-697487d6-ab14-44c1-a8af-83006db3f995 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:27.395807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-697487d6-ab14-44c1-a8af-83006db3f995 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:27.396571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-697487d6-ab14-44c1-a8af-83006db3f995 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:27.397616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-697487d6-ab14-44c1-a8af-83006db3f995 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:27.398577 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-697487d6-ab14-44c1-a8af-83006db3f995 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:27.399522 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-697487d6-ab14-44c1-a8af-83006db3f995 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:27.400163 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-697487d6-ab14-44c1-a8af-83006db3f995 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:27.499370 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-697487d6-ab14-44c1-a8af-83006db3f995 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "PUT /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1078 microversion: 2.1 time: 0.122838 Oct 05 02:42:27.500033 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1696/3415] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Oct 5 02:42:27 2022] PUT /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1078 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:27.519891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b0a5a33c-da1c-441f-8927-7a9c8f39d22d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:27.520514 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b0a5a33c-da1c-441f-8927-7a9c8f39d22d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:27.532379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-15872265-d46b-45e6-9a16-57d87847f8a7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:27.533064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0a5a33c-da1c-441f-8927-7a9c8f39d22d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:27.533679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0a5a33c-da1c-441f-8927-7a9c8f39d22d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:27.534129 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0a5a33c-da1c-441f-8927-7a9c8f39d22d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:27.534933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-15872265-d46b-45e6-9a16-57d87847f8a7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:27.537317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0a5a33c-da1c-441f-8927-7a9c8f39d22d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:27.537784 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0a5a33c-da1c-441f-8927-7a9c8f39d22d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:27.538208 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0a5a33c-da1c-441f-8927-7a9c8f39d22d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:27.546662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15872265-d46b-45e6-9a16-57d87847f8a7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:27.547120 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15872265-d46b-45e6-9a16-57d87847f8a7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:27.548694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15872265-d46b-45e6-9a16-57d87847f8a7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:27.550913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15872265-d46b-45e6-9a16-57d87847f8a7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:27.551379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15872265-d46b-45e6-9a16-57d87847f8a7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:27.553723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15872265-d46b-45e6-9a16-57d87847f8a7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:28.129504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b0a5a33c-da1c-441f-8927-7a9c8f39d22d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:28.145799 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b0a5a33c-da1c-441f-8927-7a9c8f39d22d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1504 microversion: 2.1 time: 0.630348 Oct 05 02:42:28.146984 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1720/3416] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:27 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1504 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:28.159000 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-15872265-d46b-45e6-9a16-57d87847f8a7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:28.172393 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-15872265-d46b-45e6-9a16-57d87847f8a7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1536 microversion: 2.1 time: 0.643655 Oct 05 02:42:28.173279 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1697/3417] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:27 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1536 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:42:28.195313 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6e5d3c8a-a82a-4528-a80b-79904c5b5862 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:28.196244 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6e5d3c8a-a82a-4528-a80b-79904c5b5862 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:28.202481 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e5d3c8a-a82a-4528-a80b-79904c5b5862 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:28.203187 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e5d3c8a-a82a-4528-a80b-79904c5b5862 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:28.203800 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e5d3c8a-a82a-4528-a80b-79904c5b5862 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:28.204699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e5d3c8a-a82a-4528-a80b-79904c5b5862 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:28.205352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e5d3c8a-a82a-4528-a80b-79904c5b5862 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:28.206184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e5d3c8a-a82a-4528-a80b-79904c5b5862 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:28.386934 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-12d22806-2c52-4d3a-b332-29386bb1ee02 req-b72b1d99-ee81-443a-a626-3621756e4664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1b41d44-1201-460a-b938-7a70567656cd", "name": "network-vif-unplugged", "status": "completed", "tag": "99ce69bd-430b-41c6-a998-33a5e643493b"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:42:28.395055 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6e5d3c8a-a82a-4528-a80b-79904c5b5862 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:28.418949 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:28.420754 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6e5d3c8a-a82a-4528-a80b-79904c5b5862 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:28.423663 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6e5d3c8a-a82a-4528-a80b-79904c5b5862 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:28.432937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-12d22806-2c52-4d3a-b332-29386bb1ee02 req-b72b1d99-ee81-443a-a626-3621756e4664 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:28.435015 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-12d22806-2c52-4d3a-b332-29386bb1ee02 req-b72b1d99-ee81-443a-a626-3621756e4664 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:28.438209 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-12d22806-2c52-4d3a-b332-29386bb1ee02 req-b72b1d99-ee81-443a-a626-3621756e4664 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:28.443717 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6e5d3c8a-a82a-4528-a80b-79904c5b5862 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.252164 Oct 05 02:42:28.444437 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1698/3418] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:28 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:42:28.454233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ff2f06f3-3cfb-4c13-b1e9-d22e689732e6 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:28.456440 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ff2f06f3-3cfb-4c13-b1e9-d22e689732e6 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:28.474344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff2f06f3-3cfb-4c13-b1e9-d22e689732e6 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:28.474567 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-12d22806-2c52-4d3a-b332-29386bb1ee02 req-b72b1d99-ee81-443a-a626-3621756e4664 service nova] Creating event network-vif-unplugged:99ce69bd-430b-41c6-a998-33a5e643493b for instance d1b41d44-1201-460a-b938-7a70567656cd on n-h2-858272-3 Oct 05 02:42:28.475678 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff2f06f3-3cfb-4c13-b1e9-d22e689732e6 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:28.477788 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff2f06f3-3cfb-4c13-b1e9-d22e689732e6 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:28.478839 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff2f06f3-3cfb-4c13-b1e9-d22e689732e6 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:28.481095 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff2f06f3-3cfb-4c13-b1e9-d22e689732e6 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:28.481840 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff2f06f3-3cfb-4c13-b1e9-d22e689732e6 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:28.484040 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [req-12d22806-2c52-4d3a-b332-29386bb1ee02 req-b72b1d99-ee81-443a-a626-3621756e4664 service nova] Instance d1b41d44-1201-460a-b938-7a70567656cd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 02:42:28.487426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:28.501960 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-12d22806-2c52-4d3a-b332-29386bb1ee02 req-b72b1d99-ee81-443a-a626-3621756e4664 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.353299 Oct 05 02:42:28.504346 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1721/3419] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:42:28.516541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-42df8cf7-dce9-42a6-84ae-5fa61ffab78b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:28.518755 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-42df8cf7-dce9-42a6-84ae-5fa61ffab78b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:28.529037 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42df8cf7-dce9-42a6-84ae-5fa61ffab78b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:28.530378 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42df8cf7-dce9-42a6-84ae-5fa61ffab78b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:28.531057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42df8cf7-dce9-42a6-84ae-5fa61ffab78b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:28.531945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42df8cf7-dce9-42a6-84ae-5fa61ffab78b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:28.532571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42df8cf7-dce9-42a6-84ae-5fa61ffab78b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:28.533078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42df8cf7-dce9-42a6-84ae-5fa61ffab78b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:28.977371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ff2f06f3-3cfb-4c13-b1e9-d22e689732e6 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:28.985382 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ff2f06f3-3cfb-4c13-b1e9-d22e689732e6 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 200 len: 1480 microversion: 2.1 time: 0.539632 Oct 05 02:42:28.994763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-42df8cf7-dce9-42a6-84ae-5fa61ffab78b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:29.002226 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1699/3420] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:28 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 1480 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:29.007587 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-42df8cf7-dce9-42a6-84ae-5fa61ffab78b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1504 microversion: 2.1 time: 0.500714 Oct 05 02:42:29.022504 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1722/3421] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:28 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1504 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:29.050391 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a920f5d4-e15b-471c-9746-3a1f0c784a50 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:42:29.054780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a920f5d4-e15b-471c-9746-3a1f0c784a50 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:29.063077 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a920f5d4-e15b-471c-9746-3a1f0c784a50 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:29.064690 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a920f5d4-e15b-471c-9746-3a1f0c784a50 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:29.066011 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a920f5d4-e15b-471c-9746-3a1f0c784a50 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:29.067943 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a920f5d4-e15b-471c-9746-3a1f0c784a50 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:29.068859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a920f5d4-e15b-471c-9746-3a1f0c784a50 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:29.070387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a920f5d4-e15b-471c-9746-3a1f0c784a50 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:29.176995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-a920f5d4-e15b-471c-9746-3a1f0c784a50 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:42:29.177677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-a920f5d4-e15b-471c-9746-3a1f0c784a50 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:42:29.178077 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-a920f5d4-e15b-471c-9746-3a1f0c784a50 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:42:29.178694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-a920f5d4-e15b-471c-9746-3a1f0c784a50 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:42:29.179142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-a920f5d4-e15b-471c-9746-3a1f0c784a50 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:42:29.201433 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-96b75ee7-3a52-4bdb-ad79-7cabd2540521 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:29.202273 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-96b75ee7-3a52-4bdb-ad79-7cabd2540521 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:29.210477 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96b75ee7-3a52-4bdb-ad79-7cabd2540521 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:29.210974 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96b75ee7-3a52-4bdb-ad79-7cabd2540521 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:29.211413 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96b75ee7-3a52-4bdb-ad79-7cabd2540521 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:29.212111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96b75ee7-3a52-4bdb-ad79-7cabd2540521 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:29.212563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96b75ee7-3a52-4bdb-ad79-7cabd2540521 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:29.213021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96b75ee7-3a52-4bdb-ad79-7cabd2540521 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:29.294983 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a920f5d4-e15b-471c-9746-3a1f0c784a50 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:29.307991 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a920f5d4-e15b-471c-9746-3a1f0c784a50 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:29.308499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a920f5d4-e15b-471c-9746-3a1f0c784a50 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:29.308966 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a920f5d4-e15b-471c-9746-3a1f0c784a50 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:29.309690 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a920f5d4-e15b-471c-9746-3a1f0c784a50 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:29.310153 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a920f5d4-e15b-471c-9746-3a1f0c784a50 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:29.310585 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a920f5d4-e15b-471c-9746-3a1f0c784a50 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:29.345392 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a920f5d4-e15b-471c-9746-3a1f0c784a50 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "POST /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976/action" status: 202 len: 1110 microversion: 2.1 time: 0.302140 Oct 05 02:42:29.347163 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1700/3422] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:42:29 2022] POST /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976/action => generated 1110 bytes in 307 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 05 02:42:29.368892 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-229931b2-1e27-4bf9-a32a-81bf3a0fe1b2 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:29.369960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-229931b2-1e27-4bf9-a32a-81bf3a0fe1b2 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:29.380222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-229931b2-1e27-4bf9-a32a-81bf3a0fe1b2 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:29.380724 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-229931b2-1e27-4bf9-a32a-81bf3a0fe1b2 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:29.381345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-229931b2-1e27-4bf9-a32a-81bf3a0fe1b2 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:29.382249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-229931b2-1e27-4bf9-a32a-81bf3a0fe1b2 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:29.382710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-229931b2-1e27-4bf9-a32a-81bf3a0fe1b2 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:29.383198 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-229931b2-1e27-4bf9-a32a-81bf3a0fe1b2 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:29.523817 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-96b75ee7-3a52-4bdb-ad79-7cabd2540521 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:29.532123 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-96b75ee7-3a52-4bdb-ad79-7cabd2540521 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1536 microversion: 2.1 time: 0.334494 Oct 05 02:42:29.532781 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1723/3423] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:29 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1536 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:42:29.538775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4e742a4b-8a5d-4b55-8848-8d0a55efb7cf tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:29.539460 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4e742a4b-8a5d-4b55-8848-8d0a55efb7cf tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:29.545414 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e742a4b-8a5d-4b55-8848-8d0a55efb7cf tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:29.545974 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e742a4b-8a5d-4b55-8848-8d0a55efb7cf tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:29.546490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e742a4b-8a5d-4b55-8848-8d0a55efb7cf tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:29.547234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e742a4b-8a5d-4b55-8848-8d0a55efb7cf tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:29.547763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e742a4b-8a5d-4b55-8848-8d0a55efb7cf tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:29.548344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e742a4b-8a5d-4b55-8848-8d0a55efb7cf tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:29.665382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4e742a4b-8a5d-4b55-8848-8d0a55efb7cf tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:29.672167 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:29.678597 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4e742a4b-8a5d-4b55-8848-8d0a55efb7cf tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:29.680204 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4e742a4b-8a5d-4b55-8848-8d0a55efb7cf tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:29.686390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-229931b2-1e27-4bf9-a32a-81bf3a0fe1b2 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:29.687219 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4e742a4b-8a5d-4b55-8848-8d0a55efb7cf tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.152074 Oct 05 02:42:29.688066 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1724/3424] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:29 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:42:29.696759 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-229931b2-1e27-4bf9-a32a-81bf3a0fe1b2 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1515 microversion: 2.1 time: 0.334783 Oct 05 02:42:29.698033 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1701/3425] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:29 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1515 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:30.526303 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-faa96e0d-77eb-4fb1-8fc2-6a5d1e64a0c2 req-eb489272-357e-4fa8-b6aa-aa11f4ae8bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d57f876f-018d-4500-8b46-a0ad8983fff5", "tag": "bed4013f-097d-4219-99f5-4d1b78fcda5c"}, {"name": "network-changed", "server_uuid": "d1b41d44-1201-460a-b938-7a70567656cd", "tag": "99ce69bd-430b-41c6-a998-33a5e643493b"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:42:30.538669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-faa96e0d-77eb-4fb1-8fc2-6a5d1e64a0c2 req-eb489272-357e-4fa8-b6aa-aa11f4ae8bc7 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:30.539339 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-faa96e0d-77eb-4fb1-8fc2-6a5d1e64a0c2 req-eb489272-357e-4fa8-b6aa-aa11f4ae8bc7 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:30.539700 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-faa96e0d-77eb-4fb1-8fc2-6a5d1e64a0c2 req-eb489272-357e-4fa8-b6aa-aa11f4ae8bc7 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:30.555923 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-faa96e0d-77eb-4fb1-8fc2-6a5d1e64a0c2 req-eb489272-357e-4fa8-b6aa-aa11f4ae8bc7 service nova] Creating event network-changed:bed4013f-097d-4219-99f5-4d1b78fcda5c for instance d57f876f-018d-4500-8b46-a0ad8983fff5 on n-h1-858272-3 Oct 05 02:42:30.556593 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-faa96e0d-77eb-4fb1-8fc2-6a5d1e64a0c2 req-eb489272-357e-4fa8-b6aa-aa11f4ae8bc7 service nova] Creating event network-changed:99ce69bd-430b-41c6-a998-33a5e643493b for instance d1b41d44-1201-460a-b938-7a70567656cd on n-h2-858272-3 Oct 05 02:42:30.559992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cd54d773-7f26-4005-aef8-2ccec8b50a1d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:30.561978 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cd54d773-7f26-4005-aef8-2ccec8b50a1d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:30.562667 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [req-faa96e0d-77eb-4fb1-8fc2-6a5d1e64a0c2 req-eb489272-357e-4fa8-b6aa-aa11f4ae8bc7 service nova] Instance d1b41d44-1201-460a-b938-7a70567656cd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 02:42:30.570416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd54d773-7f26-4005-aef8-2ccec8b50a1d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:30.571671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd54d773-7f26-4005-aef8-2ccec8b50a1d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:30.572495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd54d773-7f26-4005-aef8-2ccec8b50a1d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:30.573539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd54d773-7f26-4005-aef8-2ccec8b50a1d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:30.574226 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd54d773-7f26-4005-aef8-2ccec8b50a1d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:30.574881 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd54d773-7f26-4005-aef8-2ccec8b50a1d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:30.578584 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-faa96e0d-77eb-4fb1-8fc2-6a5d1e64a0c2 req-eb489272-357e-4fa8-b6aa-aa11f4ae8bc7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.055101 Oct 05 02:42:30.582480 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1725/3426] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:42:30.726318 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c2f43a5e-12fd-4bfe-974a-a0c6eac4fb4c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:30.727295 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c2f43a5e-12fd-4bfe-974a-a0c6eac4fb4c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:30.734259 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2f43a5e-12fd-4bfe-974a-a0c6eac4fb4c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:30.734958 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2f43a5e-12fd-4bfe-974a-a0c6eac4fb4c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:30.735575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2f43a5e-12fd-4bfe-974a-a0c6eac4fb4c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:30.736451 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2f43a5e-12fd-4bfe-974a-a0c6eac4fb4c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:30.737780 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2f43a5e-12fd-4bfe-974a-a0c6eac4fb4c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:30.738658 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2f43a5e-12fd-4bfe-974a-a0c6eac4fb4c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:30.860531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c2f43a5e-12fd-4bfe-974a-a0c6eac4fb4c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:30.871253 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c2f43a5e-12fd-4bfe-974a-a0c6eac4fb4c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:30.873019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c2f43a5e-12fd-4bfe-974a-a0c6eac4fb4c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:30.876834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cd54d773-7f26-4005-aef8-2ccec8b50a1d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:30.879854 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c2f43a5e-12fd-4bfe-974a-a0c6eac4fb4c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.160120 Oct 05 02:42:30.881027 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1726/3427] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:30 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:42:30.897628 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cd54d773-7f26-4005-aef8-2ccec8b50a1d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1536 microversion: 2.1 time: 0.342472 Oct 05 02:42:30.897897 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8d9c20b2-017f-421e-b23c-45a8a1161680 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:30.898710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8d9c20b2-017f-421e-b23c-45a8a1161680 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:30.905152 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d9c20b2-017f-421e-b23c-45a8a1161680 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:30.905647 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d9c20b2-017f-421e-b23c-45a8a1161680 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:30.906082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d9c20b2-017f-421e-b23c-45a8a1161680 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:30.906232 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1702/3428] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:30 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1536 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:42:30.908803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d9c20b2-017f-421e-b23c-45a8a1161680 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:30.910218 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d9c20b2-017f-421e-b23c-45a8a1161680 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:30.910839 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d9c20b2-017f-421e-b23c-45a8a1161680 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:31.204112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8d9c20b2-017f-421e-b23c-45a8a1161680 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:31.212824 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8d9c20b2-017f-421e-b23c-45a8a1161680 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1515 microversion: 2.1 time: 0.330365 Oct 05 02:42:31.213739 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1727/3429] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:30 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1515 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:31.913111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a06ca918-09ac-4031-ba5e-6b35f989f53f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:31.913974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a06ca918-09ac-4031-ba5e-6b35f989f53f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:31.917922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:31.926929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a06ca918-09ac-4031-ba5e-6b35f989f53f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:31.933931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a06ca918-09ac-4031-ba5e-6b35f989f53f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:31.934387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a06ca918-09ac-4031-ba5e-6b35f989f53f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:31.935135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a06ca918-09ac-4031-ba5e-6b35f989f53f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:31.935602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a06ca918-09ac-4031-ba5e-6b35f989f53f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:31.936100 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a06ca918-09ac-4031-ba5e-6b35f989f53f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:31.939394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-87cc8020-8b53-4c4e-b3b8-3f62e710b4eb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:31.941222 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-87cc8020-8b53-4c4e-b3b8-3f62e710b4eb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:31.962312 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-87cc8020-8b53-4c4e-b3b8-3f62e710b4eb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:31.965686 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-87cc8020-8b53-4c4e-b3b8-3f62e710b4eb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:31.969022 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-87cc8020-8b53-4c4e-b3b8-3f62e710b4eb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:31.972705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-87cc8020-8b53-4c4e-b3b8-3f62e710b4eb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:31.973891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-87cc8020-8b53-4c4e-b3b8-3f62e710b4eb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:31.976725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-87cc8020-8b53-4c4e-b3b8-3f62e710b4eb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:32.086057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a06ca918-09ac-4031-ba5e-6b35f989f53f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:32.096250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a06ca918-09ac-4031-ba5e-6b35f989f53f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:32.114327 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a06ca918-09ac-4031-ba5e-6b35f989f53f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:32.137263 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a06ca918-09ac-4031-ba5e-6b35f989f53f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.226064 Oct 05 02:42:32.139478 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1703/3430] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:31 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:42:32.238372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-02340b3d-c99a-4f96-8708-fa09c93d0546 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:32.239435 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-02340b3d-c99a-4f96-8708-fa09c93d0546 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:32.246259 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-02340b3d-c99a-4f96-8708-fa09c93d0546 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:32.247092 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-02340b3d-c99a-4f96-8708-fa09c93d0546 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:32.247870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-02340b3d-c99a-4f96-8708-fa09c93d0546 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:32.248827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-02340b3d-c99a-4f96-8708-fa09c93d0546 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:32.264112 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-02340b3d-c99a-4f96-8708-fa09c93d0546 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:32.265025 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-02340b3d-c99a-4f96-8708-fa09c93d0546 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:32.640602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-87cc8020-8b53-4c4e-b3b8-3f62e710b4eb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:32.652867 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-87cc8020-8b53-4c4e-b3b8-3f62e710b4eb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1536 microversion: 2.1 time: 0.722744 Oct 05 02:42:32.662189 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1728/3431] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:31 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1536 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:42:32.876368 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-02340b3d-c99a-4f96-8708-fa09c93d0546 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:32.895450 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-02340b3d-c99a-4f96-8708-fa09c93d0546 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1515 microversion: 2.1 time: 0.662844 Oct 05 02:42:32.896365 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1704/3432] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:32 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1515 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:33.188423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5c089f68-d596-4555-81ea-09636e39ac2e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:33.191121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5c089f68-d596-4555-81ea-09636e39ac2e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:33.200424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c089f68-d596-4555-81ea-09636e39ac2e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:33.201033 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c089f68-d596-4555-81ea-09636e39ac2e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:33.201688 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c089f68-d596-4555-81ea-09636e39ac2e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:33.202713 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c089f68-d596-4555-81ea-09636e39ac2e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:33.203403 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c089f68-d596-4555-81ea-09636e39ac2e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:33.204146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c089f68-d596-4555-81ea-09636e39ac2e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:33.310829 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5c089f68-d596-4555-81ea-09636e39ac2e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:33.321105 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5c089f68-d596-4555-81ea-09636e39ac2e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:33.323573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5c089f68-d596-4555-81ea-09636e39ac2e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:33.329562 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5c089f68-d596-4555-81ea-09636e39ac2e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.145054 Oct 05 02:42:33.330477 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1729/3433] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:33 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:42:33.680968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5e03985f-90fc-474c-a654-31bf282fbd6f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:33.682713 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5e03985f-90fc-474c-a654-31bf282fbd6f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:33.693575 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e03985f-90fc-474c-a654-31bf282fbd6f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:33.694532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e03985f-90fc-474c-a654-31bf282fbd6f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:33.695041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e03985f-90fc-474c-a654-31bf282fbd6f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:33.695984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e03985f-90fc-474c-a654-31bf282fbd6f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:33.696643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e03985f-90fc-474c-a654-31bf282fbd6f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:33.697373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e03985f-90fc-474c-a654-31bf282fbd6f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:33.925989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a46d6536-3228-448f-8503-bdd8560aa1d6 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:33.926617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a46d6536-3228-448f-8503-bdd8560aa1d6 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:33.931260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5e03985f-90fc-474c-a654-31bf282fbd6f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:33.936780 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a46d6536-3228-448f-8503-bdd8560aa1d6 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:33.938540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a46d6536-3228-448f-8503-bdd8560aa1d6 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:33.938983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a46d6536-3228-448f-8503-bdd8560aa1d6 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:33.941443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a46d6536-3228-448f-8503-bdd8560aa1d6 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:33.942702 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5e03985f-90fc-474c-a654-31bf282fbd6f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1529 microversion: 2.1 time: 0.267548 Oct 05 02:42:33.943023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a46d6536-3228-448f-8503-bdd8560aa1d6 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:33.943537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a46d6536-3228-448f-8503-bdd8560aa1d6 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:33.944652 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1705/3434] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:33 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1529 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:33.967797 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b2f7f3e3-efad-4cc4-bfab-109313517eab tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:33.968407 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b2f7f3e3-efad-4cc4-bfab-109313517eab tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:33.977505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2f7f3e3-efad-4cc4-bfab-109313517eab tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:33.978870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2f7f3e3-efad-4cc4-bfab-109313517eab tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:33.979489 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2f7f3e3-efad-4cc4-bfab-109313517eab tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:33.980394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2f7f3e3-efad-4cc4-bfab-109313517eab tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:33.981066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2f7f3e3-efad-4cc4-bfab-109313517eab tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:33.982600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2f7f3e3-efad-4cc4-bfab-109313517eab tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:34.226001 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a46d6536-3228-448f-8503-bdd8560aa1d6 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:34.234339 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a46d6536-3228-448f-8503-bdd8560aa1d6 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1515 microversion: 2.1 time: 0.317959 Oct 05 02:42:34.237624 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1730/3435] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:33 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1515 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:42:34.292215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b2f7f3e3-efad-4cc4-bfab-109313517eab tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:34.301903 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b2f7f3e3-efad-4cc4-bfab-109313517eab tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1529 microversion: 2.1 time: 0.337950 Oct 05 02:42:34.302550 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1706/3436] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:33 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1529 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:42:34.324654 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a02b5a63-f3fa-4962-b4dd-62a3f3fdccaf tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:34.333699 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-a02b5a63-f3fa-4962-b4dd-62a3f3fdccaf tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] HTTP exception thrown: Flavor 420c4dd2-e5ee-47a6-859a-f68516099f07 could not be found. Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a02b5a63-f3fa-4962-b4dd-62a3f3fdccaf tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Request method failure captured: Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/flavors/420c4dd2-e5ee-47a6-859a-f68516099f07 HTTP/1.1 Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO38KyloHi4tqXlgufs8-VUSEGj0KAZU_O6HszBau71ob8-d1_8Hcyc79CkBk7-5hD5dVnk_SuZ57JK9Etm9EfGcUfTE1fuhY4H13rn2TizXSxZvgTr5NBSwilDEhrkJ5sxOqrYK-5yvzvUUq-L2Afgp68YLkOuuCnD5hc4VKGgt-S0 Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: f42e21e5ff8247d2b2fc27a30b7a4fd9 Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-MigrationsAdminTest-1390301331 Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: X-Role: admin,member,reader Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: admin,member,reader Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f42e21e5ff8247d2b2fc27a30b7a4fd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f42e21e5ff8247d2b2fc27a30b7a4fd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f42e21e5ff8247d2b2fc27a30b7a4fd9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f42e21e5ff8247d2b2fc27a30b7a4fd9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-MigrationsAdminTest-1390301331 Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: f42e21e5ff8247d2b2fc27a30b7a4fd9 Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-MigrationsAdminTest-1390301331 Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-MigrationsAdminTest-1390301331-project-admin Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 5bda07d8c2fa4f64b27d6eff9c821472 Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-MigrationsAdminTest-1390301331-project-admin Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: exception: Flavor 420c4dd2-e5ee-47a6-859a-f68516099f07 could not be found. Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '420c4dd2-e5ee-47a6-859a-f68516099f07'} Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 420c4dd2-e5ee-47a6-859a-f68516099f07 could not be found. Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 420c4dd2-e5ee-47a6-859a-f68516099f07 could not be found. Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:42:34.347705 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:42:34.353699 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:42:34.353699 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:42:34.353699 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:42:34.353699 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:42:34.353699 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:42:34.353699 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:42:34.353699 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 420c4dd2-e5ee-47a6-859a-f68516099f07 could not be found. Oct 05 02:42:34.353699 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:42:34.355644 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a02b5a63-f3fa-4962-b4dd-62a3f3fdccaf tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Returning 404 to user: Flavor 420c4dd2-e5ee-47a6-859a-f68516099f07 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:42:34.357051 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a02b5a63-f3fa-4962-b4dd-62a3f3fdccaf tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/420c4dd2-e5ee-47a6-859a-f68516099f07" status: 404 len: 109 microversion: 2.1 time: 0.036048 Oct 05 02:42:34.359775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-94c88a59-1e46-42e1-b4ad-012f87b283b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:34.360634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-94c88a59-1e46-42e1-b4ad-012f87b283b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:34.362400 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1731/3437] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:42:34 2022] DELETE /compute/v2.1/flavors/420c4dd2-e5ee-47a6-859a-f68516099f07 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:42:34.383953 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94c88a59-1e46-42e1-b4ad-012f87b283b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:34.384467 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94c88a59-1e46-42e1-b4ad-012f87b283b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:34.384939 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94c88a59-1e46-42e1-b4ad-012f87b283b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:34.385672 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94c88a59-1e46-42e1-b4ad-012f87b283b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:34.386139 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94c88a59-1e46-42e1-b4ad-012f87b283b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:34.386573 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94c88a59-1e46-42e1-b4ad-012f87b283b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:34.513946 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-94c88a59-1e46-42e1-b4ad-012f87b283b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:34.530150 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-94c88a59-1e46-42e1-b4ad-012f87b283b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:34.531694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-94c88a59-1e46-42e1-b4ad-012f87b283b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:34.548173 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-94c88a59-1e46-42e1-b4ad-012f87b283b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.192650 Oct 05 02:42:34.548660 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b412262a-88f6-4be7-b52c-1231e0639567 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-515602697", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:42:34.549794 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1707/3438] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:34 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:42:34.633722 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-b412262a-88f6-4be7-b52c-1231e0639567 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] validate_networks() for None {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:42:34.881794 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=7 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:35.031974 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-b412262a-88f6-4be7-b52c-1231e0639567 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:42:35.032704 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-b412262a-88f6-4be7-b52c-1231e0639567 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:42:35.033487 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-b412262a-88f6-4be7-b52c-1231e0639567 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:42:35.034176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-b412262a-88f6-4be7-b52c-1231e0639567 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:42:35.035106 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-b412262a-88f6-4be7-b52c-1231e0639567 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:42:35.042857 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-511d2b44-1f53-4c60-a4a0-8545992f90c1 req-204d0890-0010-4906-878d-f4dcd6a29f60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1b41d44-1201-460a-b938-7a70567656cd", "name": "network-vif-plugged", "status": "completed", "tag": "99ce69bd-430b-41c6-a998-33a5e643493b"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:42:35.049693 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b412262a-88f6-4be7-b52c-1231e0639567 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:35.050413 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b412262a-88f6-4be7-b52c-1231e0639567 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:35.051013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b412262a-88f6-4be7-b52c-1231e0639567 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:35.051935 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b412262a-88f6-4be7-b52c-1231e0639567 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:35.052701 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b412262a-88f6-4be7-b52c-1231e0639567 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:35.053312 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b412262a-88f6-4be7-b52c-1231e0639567 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:35.062226 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-511d2b44-1f53-4c60-a4a0-8545992f90c1 req-204d0890-0010-4906-878d-f4dcd6a29f60 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:35.067241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-511d2b44-1f53-4c60-a4a0-8545992f90c1 req-204d0890-0010-4906-878d-f4dcd6a29f60 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:35.067909 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-511d2b44-1f53-4c60-a4a0-8545992f90c1 req-204d0890-0010-4906-878d-f4dcd6a29f60 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:35.080139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-b412262a-88f6-4be7-b52c-1231e0639567 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Getting quotas for project 446a33968038476fbc98fc0b6b1795c0. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:42:35.088186 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-b412262a-88f6-4be7-b52c-1231e0639567 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Getting quotas for user 1b4b5f0c43074932a8963727adfee38a and project 446a33968038476fbc98fc0b6b1795c0. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:42:35.104370 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b412262a-88f6-4be7-b52c-1231e0639567 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:42:35.104809 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-511d2b44-1f53-4c60-a4a0-8545992f90c1 req-204d0890-0010-4906-878d-f4dcd6a29f60 service nova] Creating event network-vif-plugged:99ce69bd-430b-41c6-a998-33a5e643493b for instance d1b41d44-1201-460a-b938-7a70567656cd on n-h2-858272-3 Oct 05 02:42:35.106899 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b412262a-88f6-4be7-b52c-1231e0639567 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:42:35.124002 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-511d2b44-1f53-4c60-a4a0-8545992f90c1 req-204d0890-0010-4906-878d-f4dcd6a29f60 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.351024 Oct 05 02:42:35.130174 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1708/3439] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:42:35.167787 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b412262a-88f6-4be7-b52c-1231e0639567 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.626761 Oct 05 02:42:35.169162 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1732/3440] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:42:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:42:35.182262 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d4ecf031-1c0b-4fb9-b1fd-fe9441bb03b7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:35.183217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d4ecf031-1c0b-4fb9-b1fd-fe9441bb03b7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:35.265967 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-90a3342f-fd02-47db-b664-84625f9e0f6d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:35.268349 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-90a3342f-fd02-47db-b664-84625f9e0f6d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:35.303741 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-90a3342f-fd02-47db-b664-84625f9e0f6d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:35.304843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-90a3342f-fd02-47db-b664-84625f9e0f6d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:35.307630 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-90a3342f-fd02-47db-b664-84625f9e0f6d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:35.310157 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-90a3342f-fd02-47db-b664-84625f9e0f6d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:35.319147 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-90a3342f-fd02-47db-b664-84625f9e0f6d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:35.322330 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-90a3342f-fd02-47db-b664-84625f9e0f6d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:35.405446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d4ecf031-1c0b-4fb9-b1fd-fe9441bb03b7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:35.416495 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d4ecf031-1c0b-4fb9-b1fd-fe9441bb03b7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1212 microversion: 2.1 time: 0.239330 Oct 05 02:42:35.420927 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1709/3441] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:35 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1212 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:35.578196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5ea0d864-3d3b-43ff-9336-d400352e7450 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:35.578891 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5ea0d864-3d3b-43ff-9336-d400352e7450 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:35.600600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ea0d864-3d3b-43ff-9336-d400352e7450 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:35.601134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ea0d864-3d3b-43ff-9336-d400352e7450 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:35.601863 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ea0d864-3d3b-43ff-9336-d400352e7450 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:35.602734 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ea0d864-3d3b-43ff-9336-d400352e7450 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:35.603338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ea0d864-3d3b-43ff-9336-d400352e7450 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:35.604045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ea0d864-3d3b-43ff-9336-d400352e7450 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:35.716758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5ea0d864-3d3b-43ff-9336-d400352e7450 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:35.731520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5ea0d864-3d3b-43ff-9336-d400352e7450 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:35.733329 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5ea0d864-3d3b-43ff-9336-d400352e7450 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:35.741383 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5ea0d864-3d3b-43ff-9336-d400352e7450 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.166893 Oct 05 02:42:35.742421 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1710/3442] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:35 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:42:35.776211 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-90a3342f-fd02-47db-b664-84625f9e0f6d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:35.810179 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-90a3342f-fd02-47db-b664-84625f9e0f6d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1515 microversion: 2.1 time: 0.552577 Oct 05 02:42:35.812247 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1733/3443] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:35 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1515 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:36.444099 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9f1ceddd-bf36-4d73-a2fa-6114124097fd tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:36.444720 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9f1ceddd-bf36-4d73-a2fa-6114124097fd tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:36.451534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9f1ceddd-bf36-4d73-a2fa-6114124097fd tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:36.452020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9f1ceddd-bf36-4d73-a2fa-6114124097fd tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:36.452452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9f1ceddd-bf36-4d73-a2fa-6114124097fd tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:36.453172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9f1ceddd-bf36-4d73-a2fa-6114124097fd tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:36.453824 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9f1ceddd-bf36-4d73-a2fa-6114124097fd tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:36.454412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9f1ceddd-bf36-4d73-a2fa-6114124097fd tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:36.531683 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9f1ceddd-bf36-4d73-a2fa-6114124097fd tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:36.541570 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9f1ceddd-bf36-4d73-a2fa-6114124097fd tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1264 microversion: 2.1 time: 0.101430 Oct 05 02:42:36.542730 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1711/3444] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:36 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1264 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:36.784034 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-df2b55f0-58f4-4c49-9c29-37b0fac3e9cf tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:36.784795 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-df2b55f0-58f4-4c49-9c29-37b0fac3e9cf tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:36.791861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df2b55f0-58f4-4c49-9c29-37b0fac3e9cf tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:36.792553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df2b55f0-58f4-4c49-9c29-37b0fac3e9cf tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:36.793085 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df2b55f0-58f4-4c49-9c29-37b0fac3e9cf tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:36.794054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df2b55f0-58f4-4c49-9c29-37b0fac3e9cf tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:36.794595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df2b55f0-58f4-4c49-9c29-37b0fac3e9cf tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:36.795085 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df2b55f0-58f4-4c49-9c29-37b0fac3e9cf tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:36.836851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1f083ff5-ebd3-4aca-a552-5ecb230b6846 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:36.837754 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1f083ff5-ebd3-4aca-a552-5ecb230b6846 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:36.848573 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f083ff5-ebd3-4aca-a552-5ecb230b6846 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:36.849540 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f083ff5-ebd3-4aca-a552-5ecb230b6846 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:36.850649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f083ff5-ebd3-4aca-a552-5ecb230b6846 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:36.851764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f083ff5-ebd3-4aca-a552-5ecb230b6846 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:36.852606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f083ff5-ebd3-4aca-a552-5ecb230b6846 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:36.853336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f083ff5-ebd3-4aca-a552-5ecb230b6846 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:36.961872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-df2b55f0-58f4-4c49-9c29-37b0fac3e9cf tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:36.979790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-df2b55f0-58f4-4c49-9c29-37b0fac3e9cf tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:36.983655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-df2b55f0-58f4-4c49-9c29-37b0fac3e9cf tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:37.011803 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-df2b55f0-58f4-4c49-9c29-37b0fac3e9cf tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.234820 Oct 05 02:42:37.012402 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1734/3445] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:36 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:42:37.118295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1f083ff5-ebd3-4aca-a552-5ecb230b6846 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:37.131806 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1f083ff5-ebd3-4aca-a552-5ecb230b6846 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1515 microversion: 2.1 time: 0.300040 Oct 05 02:42:37.133274 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1712/3446] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:36 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1515 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:42:37.568153 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2e5a110f-4d52-4153-88e7-f288a19e1b1f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:37.568779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2e5a110f-4d52-4153-88e7-f288a19e1b1f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:37.581739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2e5a110f-4d52-4153-88e7-f288a19e1b1f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:37.591947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2e5a110f-4d52-4153-88e7-f288a19e1b1f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:37.592441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2e5a110f-4d52-4153-88e7-f288a19e1b1f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:37.593217 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2e5a110f-4d52-4153-88e7-f288a19e1b1f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:37.596960 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2e5a110f-4d52-4153-88e7-f288a19e1b1f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:37.596960 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2e5a110f-4d52-4153-88e7-f288a19e1b1f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:37.736852 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2e5a110f-4d52-4153-88e7-f288a19e1b1f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:37.746792 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2e5a110f-4d52-4153-88e7-f288a19e1b1f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1270 microversion: 2.1 time: 0.183836 Oct 05 02:42:37.753797 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1735/3447] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:37 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1270 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:38.049186 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c1914b83-eeca-4385-bf3f-562e33d0b5ec tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:38.050398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c1914b83-eeca-4385-bf3f-562e33d0b5ec tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:38.060238 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1914b83-eeca-4385-bf3f-562e33d0b5ec tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:38.064285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1914b83-eeca-4385-bf3f-562e33d0b5ec tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:38.069579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1914b83-eeca-4385-bf3f-562e33d0b5ec tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:38.070634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1914b83-eeca-4385-bf3f-562e33d0b5ec tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:38.071455 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1914b83-eeca-4385-bf3f-562e33d0b5ec tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:38.072078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1914b83-eeca-4385-bf3f-562e33d0b5ec tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:38.160271 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fa4d22a0-aa85-4431-9b1f-3e0424a40ffd tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:38.161494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fa4d22a0-aa85-4431-9b1f-3e0424a40ffd tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:38.186200 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fa4d22a0-aa85-4431-9b1f-3e0424a40ffd tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:38.187143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fa4d22a0-aa85-4431-9b1f-3e0424a40ffd tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:38.189083 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fa4d22a0-aa85-4431-9b1f-3e0424a40ffd tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:38.191583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fa4d22a0-aa85-4431-9b1f-3e0424a40ffd tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:38.194419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fa4d22a0-aa85-4431-9b1f-3e0424a40ffd tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:38.195827 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fa4d22a0-aa85-4431-9b1f-3e0424a40ffd tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:38.213329 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c1914b83-eeca-4385-bf3f-562e33d0b5ec tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:38.253940 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c1914b83-eeca-4385-bf3f-562e33d0b5ec tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:38.256293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c1914b83-eeca-4385-bf3f-562e33d0b5ec tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:38.270124 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c1914b83-eeca-4385-bf3f-562e33d0b5ec tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.226283 Oct 05 02:42:38.276466 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1713/3448] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:38 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:42:38.497714 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fa4d22a0-aa85-4431-9b1f-3e0424a40ffd tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:38.508757 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fa4d22a0-aa85-4431-9b1f-3e0424a40ffd tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1515 microversion: 2.1 time: 0.353213 Oct 05 02:42:38.525866 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1736/3449] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:38 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1515 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:42:38.779585 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b139c1f6-53e6-4c46-9309-e0008df63abb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:38.780215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b139c1f6-53e6-4c46-9309-e0008df63abb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:38.787300 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b139c1f6-53e6-4c46-9309-e0008df63abb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:38.787802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b139c1f6-53e6-4c46-9309-e0008df63abb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:38.788443 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b139c1f6-53e6-4c46-9309-e0008df63abb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:38.789497 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b139c1f6-53e6-4c46-9309-e0008df63abb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:38.789864 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b139c1f6-53e6-4c46-9309-e0008df63abb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:38.790280 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b139c1f6-53e6-4c46-9309-e0008df63abb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:38.967591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b139c1f6-53e6-4c46-9309-e0008df63abb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:38.978854 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b139c1f6-53e6-4c46-9309-e0008df63abb tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1312 microversion: 2.1 time: 0.202421 Oct 05 02:42:38.979921 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1714/3450] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:38 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1312 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:39.306658 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-25d90774-c411-4282-8f2b-803760be578e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:39.307363 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-25d90774-c411-4282-8f2b-803760be578e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:39.337132 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25d90774-c411-4282-8f2b-803760be578e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:39.360115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25d90774-c411-4282-8f2b-803760be578e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:39.360115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25d90774-c411-4282-8f2b-803760be578e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:39.360115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25d90774-c411-4282-8f2b-803760be578e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:39.360115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25d90774-c411-4282-8f2b-803760be578e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:39.372505 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25d90774-c411-4282-8f2b-803760be578e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:39.499674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-25d90774-c411-4282-8f2b-803760be578e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:39.514440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-25d90774-c411-4282-8f2b-803760be578e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:39.517332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-25d90774-c411-4282-8f2b-803760be578e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:39.533895 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-25d90774-c411-4282-8f2b-803760be578e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.231224 Oct 05 02:42:39.535855 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1737/3451] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:39 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:42:39.550757 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-516f7562-b1bf-4fa2-beac-112a6a773163 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:39.552231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-516f7562-b1bf-4fa2-beac-112a6a773163 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:39.565312 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-516f7562-b1bf-4fa2-beac-112a6a773163 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:39.566780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-516f7562-b1bf-4fa2-beac-112a6a773163 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:39.567336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-516f7562-b1bf-4fa2-beac-112a6a773163 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:39.568799 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-516f7562-b1bf-4fa2-beac-112a6a773163 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:39.569390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-516f7562-b1bf-4fa2-beac-112a6a773163 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:39.570631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-516f7562-b1bf-4fa2-beac-112a6a773163 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:39.597472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:39.768403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-516f7562-b1bf-4fa2-beac-112a6a773163 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:39.780677 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-516f7562-b1bf-4fa2-beac-112a6a773163 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1515 microversion: 2.1 time: 0.250625 Oct 05 02:42:39.782197 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1715/3452] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:39 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1515 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:40.009128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6038d9e8-9c7f-449e-82cf-4822b4d9df1a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:40.009825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6038d9e8-9c7f-449e-82cf-4822b4d9df1a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:40.024784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-6ff85871-19e7-4a99-9dc2-663d4068e3b4 req-65558c07-530c-4a61-a142-fd9cf8159b0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03081f70-6b52-497a-ab3f-27f86089c602", "tag": "7edc14f6-3b4b-460e-96c8-a6f177b5e033"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:42:40.039809 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6038d9e8-9c7f-449e-82cf-4822b4d9df1a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:40.043100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6038d9e8-9c7f-449e-82cf-4822b4d9df1a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:40.044388 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6038d9e8-9c7f-449e-82cf-4822b4d9df1a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:40.046180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6038d9e8-9c7f-449e-82cf-4822b4d9df1a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:40.047957 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6038d9e8-9c7f-449e-82cf-4822b4d9df1a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:40.048417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6038d9e8-9c7f-449e-82cf-4822b4d9df1a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:40.053869 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6ff85871-19e7-4a99-9dc2-663d4068e3b4 req-65558c07-530c-4a61-a142-fd9cf8159b0a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:40.055570 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6ff85871-19e7-4a99-9dc2-663d4068e3b4 req-65558c07-530c-4a61-a142-fd9cf8159b0a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:40.056034 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6ff85871-19e7-4a99-9dc2-663d4068e3b4 req-65558c07-530c-4a61-a142-fd9cf8159b0a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:40.099054 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-6ff85871-19e7-4a99-9dc2-663d4068e3b4 req-65558c07-530c-4a61-a142-fd9cf8159b0a service nova] Creating event network-changed:7edc14f6-3b4b-460e-96c8-a6f177b5e033 for instance 03081f70-6b52-497a-ab3f-27f86089c602 on n-h2-858272-3 Oct 05 02:42:40.109399 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-6ff85871-19e7-4a99-9dc2-663d4068e3b4 req-65558c07-530c-4a61-a142-fd9cf8159b0a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089206 Oct 05 02:42:40.112163 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1716/3453] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:42:40.250040 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6038d9e8-9c7f-449e-82cf-4822b4d9df1a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:40.261343 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6038d9e8-9c7f-449e-82cf-4822b4d9df1a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1312 microversion: 2.1 time: 0.257304 Oct 05 02:42:40.264942 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1738/3454] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:40 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1312 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:40.566387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-eddb46b9-ef3f-4261-b660-6ba5ac4941b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:40.567277 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-eddb46b9-ef3f-4261-b660-6ba5ac4941b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:40.575102 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eddb46b9-ef3f-4261-b660-6ba5ac4941b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:40.575873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eddb46b9-ef3f-4261-b660-6ba5ac4941b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:40.576408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eddb46b9-ef3f-4261-b660-6ba5ac4941b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:40.577777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eddb46b9-ef3f-4261-b660-6ba5ac4941b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:40.578459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eddb46b9-ef3f-4261-b660-6ba5ac4941b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:40.579008 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eddb46b9-ef3f-4261-b660-6ba5ac4941b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:40.663240 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-eddb46b9-ef3f-4261-b660-6ba5ac4941b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:40.672811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-eddb46b9-ef3f-4261-b660-6ba5ac4941b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:40.674870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-eddb46b9-ef3f-4261-b660-6ba5ac4941b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:40.681014 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-eddb46b9-ef3f-4261-b660-6ba5ac4941b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.120374 Oct 05 02:42:40.681584 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1717/3455] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:40 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:42:40.816291 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ac25b865-1062-4bf6-8396-90d1081ce750 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:40.816951 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ac25b865-1062-4bf6-8396-90d1081ce750 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:40.825125 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac25b865-1062-4bf6-8396-90d1081ce750 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:40.825746 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac25b865-1062-4bf6-8396-90d1081ce750 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:40.826207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac25b865-1062-4bf6-8396-90d1081ce750 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:40.827578 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac25b865-1062-4bf6-8396-90d1081ce750 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:40.827578 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac25b865-1062-4bf6-8396-90d1081ce750 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:40.828116 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac25b865-1062-4bf6-8396-90d1081ce750 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:40.996283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ac25b865-1062-4bf6-8396-90d1081ce750 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:41.006685 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ac25b865-1062-4bf6-8396-90d1081ce750 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1515 microversion: 2.1 time: 0.199626 Oct 05 02:42:41.007882 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1739/3456] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:40 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1515 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:41.294879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-228a1578-64f9-4052-8435-ebacc43c8cef tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:41.295901 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-228a1578-64f9-4052-8435-ebacc43c8cef tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:41.303141 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-228a1578-64f9-4052-8435-ebacc43c8cef tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:41.305829 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-228a1578-64f9-4052-8435-ebacc43c8cef tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:41.307412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-228a1578-64f9-4052-8435-ebacc43c8cef tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:41.311494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-228a1578-64f9-4052-8435-ebacc43c8cef tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:41.312210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-228a1578-64f9-4052-8435-ebacc43c8cef tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:41.312843 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-228a1578-64f9-4052-8435-ebacc43c8cef tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:41.644565 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-228a1578-64f9-4052-8435-ebacc43c8cef tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:41.658092 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-228a1578-64f9-4052-8435-ebacc43c8cef tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1312 microversion: 2.1 time: 0.370697 Oct 05 02:42:41.663788 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1718/3457] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:41 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1312 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:41.709450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1b33e512-56d7-440d-86a8-7455879ce1eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:41.710131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1b33e512-56d7-440d-86a8-7455879ce1eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:41.716832 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b33e512-56d7-440d-86a8-7455879ce1eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:41.717454 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b33e512-56d7-440d-86a8-7455879ce1eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:41.718177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b33e512-56d7-440d-86a8-7455879ce1eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:41.719117 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b33e512-56d7-440d-86a8-7455879ce1eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:41.719799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b33e512-56d7-440d-86a8-7455879ce1eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:41.720459 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b33e512-56d7-440d-86a8-7455879ce1eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:41.810219 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1b33e512-56d7-440d-86a8-7455879ce1eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:41.821032 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1b33e512-56d7-440d-86a8-7455879ce1eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:41.822873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1b33e512-56d7-440d-86a8-7455879ce1eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:41.831590 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1b33e512-56d7-440d-86a8-7455879ce1eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.126580 Oct 05 02:42:41.832790 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1740/3458] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:41 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:42:42.031076 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7ff18d87-0e0a-41a4-b291-619ed075b37f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:42.032739 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7ff18d87-0e0a-41a4-b291-619ed075b37f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:42.043649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ff18d87-0e0a-41a4-b291-619ed075b37f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:42.044602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ff18d87-0e0a-41a4-b291-619ed075b37f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:42.045736 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ff18d87-0e0a-41a4-b291-619ed075b37f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:42.047767 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ff18d87-0e0a-41a4-b291-619ed075b37f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:42.049343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ff18d87-0e0a-41a4-b291-619ed075b37f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:42.050326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ff18d87-0e0a-41a4-b291-619ed075b37f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:42.219416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7ff18d87-0e0a-41a4-b291-619ed075b37f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:42.231113 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7ff18d87-0e0a-41a4-b291-619ed075b37f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1515 microversion: 2.1 time: 0.204693 Oct 05 02:42:42.232316 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1719/3459] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:42 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1515 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:42.684096 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-101d066f-36db-4c92-9e6c-5d7c8a3b1b30 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:42.685173 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-101d066f-36db-4c92-9e6c-5d7c8a3b1b30 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:42.691906 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-101d066f-36db-4c92-9e6c-5d7c8a3b1b30 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:42.692846 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-101d066f-36db-4c92-9e6c-5d7c8a3b1b30 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:42.693862 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-101d066f-36db-4c92-9e6c-5d7c8a3b1b30 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:42.694663 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-101d066f-36db-4c92-9e6c-5d7c8a3b1b30 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:42.695582 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-101d066f-36db-4c92-9e6c-5d7c8a3b1b30 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:42.695582 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-101d066f-36db-4c92-9e6c-5d7c8a3b1b30 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:42.864682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c34204f9-0da1-481f-ac0c-c0ffdecee24c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:42.866094 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c34204f9-0da1-481f-ac0c-c0ffdecee24c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:42.873042 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-101d066f-36db-4c92-9e6c-5d7c8a3b1b30 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:42.873901 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c34204f9-0da1-481f-ac0c-c0ffdecee24c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:42.874562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c34204f9-0da1-481f-ac0c-c0ffdecee24c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:42.875216 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c34204f9-0da1-481f-ac0c-c0ffdecee24c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:42.876137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c34204f9-0da1-481f-ac0c-c0ffdecee24c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:42.876654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c34204f9-0da1-481f-ac0c-c0ffdecee24c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:42.877373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c34204f9-0da1-481f-ac0c-c0ffdecee24c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:42.881760 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-101d066f-36db-4c92-9e6c-5d7c8a3b1b30 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1312 microversion: 2.1 time: 0.202119 Oct 05 02:42:42.882663 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1741/3460] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:42 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1312 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:42.951809 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c34204f9-0da1-481f-ac0c-c0ffdecee24c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:42.962246 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c34204f9-0da1-481f-ac0c-c0ffdecee24c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:42.963977 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c34204f9-0da1-481f-ac0c-c0ffdecee24c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:42.969913 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c34204f9-0da1-481f-ac0c-c0ffdecee24c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.112436 Oct 05 02:42:42.971839 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1720/3461] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:42 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:42:43.262925 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-934ab418-214b-4d4c-b25a-3224345266da tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:43.263458 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-934ab418-214b-4d4c-b25a-3224345266da tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:43.270308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-934ab418-214b-4d4c-b25a-3224345266da tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:43.270803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-934ab418-214b-4d4c-b25a-3224345266da tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:43.271232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-934ab418-214b-4d4c-b25a-3224345266da tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:43.271997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-934ab418-214b-4d4c-b25a-3224345266da tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:43.272376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-934ab418-214b-4d4c-b25a-3224345266da tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:43.272799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-934ab418-214b-4d4c-b25a-3224345266da tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:43.426836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-934ab418-214b-4d4c-b25a-3224345266da tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:43.436101 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-934ab418-214b-4d4c-b25a-3224345266da tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1515 microversion: 2.1 time: 0.177026 Oct 05 02:42:43.437003 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1742/3462] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:43 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:43.905391 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-93c33b21-34e5-41da-9a0a-9dd9116a8a99 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:43.906133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-93c33b21-34e5-41da-9a0a-9dd9116a8a99 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:43.913765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93c33b21-34e5-41da-9a0a-9dd9116a8a99 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:43.914258 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93c33b21-34e5-41da-9a0a-9dd9116a8a99 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:43.914711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93c33b21-34e5-41da-9a0a-9dd9116a8a99 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:43.915479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93c33b21-34e5-41da-9a0a-9dd9116a8a99 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:43.915950 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93c33b21-34e5-41da-9a0a-9dd9116a8a99 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:43.916383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93c33b21-34e5-41da-9a0a-9dd9116a8a99 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:44.000769 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9ad31161-91eb-4051-be05-a3ac056e50eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:44.002107 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9ad31161-91eb-4051-be05-a3ac056e50eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:44.010794 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ad31161-91eb-4051-be05-a3ac056e50eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:44.011473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ad31161-91eb-4051-be05-a3ac056e50eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:44.012094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ad31161-91eb-4051-be05-a3ac056e50eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:44.013035 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ad31161-91eb-4051-be05-a3ac056e50eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:44.014120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ad31161-91eb-4051-be05-a3ac056e50eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:44.014834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ad31161-91eb-4051-be05-a3ac056e50eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:44.045235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:44.114291 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9ad31161-91eb-4051-be05-a3ac056e50eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:44.120209 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-93c33b21-34e5-41da-9a0a-9dd9116a8a99 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:44.123901 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9ad31161-91eb-4051-be05-a3ac056e50eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:44.125652 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9ad31161-91eb-4051-be05-a3ac056e50eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:44.131498 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-93c33b21-34e5-41da-9a0a-9dd9116a8a99 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1312 microversion: 2.1 time: 0.229849 Oct 05 02:42:44.132186 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9ad31161-91eb-4051-be05-a3ac056e50eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.136086 Oct 05 02:42:44.133003 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1721/3463] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:43 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1312 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:44.145759 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1743/3464] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:43 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:42:44.463444 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-87249267-070f-4a10-abd0-9ab49da0b9b6 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:44.464493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-87249267-070f-4a10-abd0-9ab49da0b9b6 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:44.470551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87249267-070f-4a10-abd0-9ab49da0b9b6 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:44.471320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87249267-070f-4a10-abd0-9ab49da0b9b6 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:44.471968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87249267-070f-4a10-abd0-9ab49da0b9b6 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:44.472742 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87249267-070f-4a10-abd0-9ab49da0b9b6 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:44.473296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87249267-070f-4a10-abd0-9ab49da0b9b6 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:44.473849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87249267-070f-4a10-abd0-9ab49da0b9b6 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:44.630617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-87249267-070f-4a10-abd0-9ab49da0b9b6 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:44.640406 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-87249267-070f-4a10-abd0-9ab49da0b9b6 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1515 microversion: 2.1 time: 0.180327 Oct 05 02:42:44.640710 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1722/3465] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:44 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:45.164211 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-da19839e-4099-4ee2-8f1b-7ca9c266c63c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:45.170165 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6bc07e6f-85cc-4d32-8c2d-c5c5c1cf7421 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:45.170923 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-da19839e-4099-4ee2-8f1b-7ca9c266c63c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:45.173761 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:45.174854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:45.182744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6bc07e6f-85cc-4d32-8c2d-c5c5c1cf7421 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:45.192429 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-da19839e-4099-4ee2-8f1b-7ca9c266c63c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:45.198446 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-da19839e-4099-4ee2-8f1b-7ca9c266c63c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:45.200302 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-da19839e-4099-4ee2-8f1b-7ca9c266c63c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:45.201899 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6bc07e6f-85cc-4d32-8c2d-c5c5c1cf7421 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:45.203206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-da19839e-4099-4ee2-8f1b-7ca9c266c63c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:45.203684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-da19839e-4099-4ee2-8f1b-7ca9c266c63c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:45.204174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-da19839e-4099-4ee2-8f1b-7ca9c266c63c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:45.206451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6bc07e6f-85cc-4d32-8c2d-c5c5c1cf7421 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:45.207271 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6bc07e6f-85cc-4d32-8c2d-c5c5c1cf7421 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:45.208457 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6bc07e6f-85cc-4d32-8c2d-c5c5c1cf7421 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:45.209130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6bc07e6f-85cc-4d32-8c2d-c5c5c1cf7421 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:45.209739 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6bc07e6f-85cc-4d32-8c2d-c5c5c1cf7421 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:45.324364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-da19839e-4099-4ee2-8f1b-7ca9c266c63c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:45.338656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-da19839e-4099-4ee2-8f1b-7ca9c266c63c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:45.341458 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-da19839e-4099-4ee2-8f1b-7ca9c266c63c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:45.349587 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-da19839e-4099-4ee2-8f1b-7ca9c266c63c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.193478 Oct 05 02:42:45.350679 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1744/3466] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:45 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:42:45.399680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6bc07e6f-85cc-4d32-8c2d-c5c5c1cf7421 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:45.407941 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6bc07e6f-85cc-4d32-8c2d-c5c5c1cf7421 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1312 microversion: 2.1 time: 0.249646 Oct 05 02:42:45.408884 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1723/3467] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:45 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1312 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:45.664409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f2b032ac-3753-4b5a-858e-e29daeec1ace tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:45.665119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f2b032ac-3753-4b5a-858e-e29daeec1ace tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:45.677439 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2b032ac-3753-4b5a-858e-e29daeec1ace tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:45.679307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2b032ac-3753-4b5a-858e-e29daeec1ace tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:45.680203 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2b032ac-3753-4b5a-858e-e29daeec1ace tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:45.681432 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2b032ac-3753-4b5a-858e-e29daeec1ace tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:45.682315 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2b032ac-3753-4b5a-858e-e29daeec1ace tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:45.683122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2b032ac-3753-4b5a-858e-e29daeec1ace tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:45.930764 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f2b032ac-3753-4b5a-858e-e29daeec1ace tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:45.942269 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f2b032ac-3753-4b5a-858e-e29daeec1ace tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1515 microversion: 2.1 time: 0.282617 Oct 05 02:42:45.943090 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1745/3468] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:45 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1515 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:42:46.376535 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:46.385635 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-787a575f-11ff-43a9-b5ce-9dc9df1705cb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:46.386197 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-787a575f-11ff-43a9-b5ce-9dc9df1705cb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:46.394333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-787a575f-11ff-43a9-b5ce-9dc9df1705cb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:46.394850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-787a575f-11ff-43a9-b5ce-9dc9df1705cb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:46.395273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-787a575f-11ff-43a9-b5ce-9dc9df1705cb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:46.396108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-787a575f-11ff-43a9-b5ce-9dc9df1705cb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:46.396496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-787a575f-11ff-43a9-b5ce-9dc9df1705cb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:46.396972 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-787a575f-11ff-43a9-b5ce-9dc9df1705cb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:46.431908 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-54083748-8fb8-4962-87cf-36ead78f640a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:46.432537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-54083748-8fb8-4962-87cf-36ead78f640a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:46.446067 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54083748-8fb8-4962-87cf-36ead78f640a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:46.446647 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54083748-8fb8-4962-87cf-36ead78f640a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:46.447097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54083748-8fb8-4962-87cf-36ead78f640a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:46.447844 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54083748-8fb8-4962-87cf-36ead78f640a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:46.448325 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54083748-8fb8-4962-87cf-36ead78f640a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:46.448952 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54083748-8fb8-4962-87cf-36ead78f640a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:46.646600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-787a575f-11ff-43a9-b5ce-9dc9df1705cb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:46.662459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-787a575f-11ff-43a9-b5ce-9dc9df1705cb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:46.668996 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-787a575f-11ff-43a9-b5ce-9dc9df1705cb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:46.692035 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-787a575f-11ff-43a9-b5ce-9dc9df1705cb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.315545 Oct 05 02:42:46.707019 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1724/3469] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:46 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:42:46.813818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-54083748-8fb8-4962-87cf-36ead78f640a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:46.822521 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-54083748-8fb8-4962-87cf-36ead78f640a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1312 microversion: 2.1 time: 0.394734 Oct 05 02:42:46.823824 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1746/3470] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:46 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1312 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:46.967900 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3fe71ace-f85e-40dd-adf1-62ceda0d696d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:46.968690 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3fe71ace-f85e-40dd-adf1-62ceda0d696d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:46.977564 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3fe71ace-f85e-40dd-adf1-62ceda0d696d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:46.978202 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3fe71ace-f85e-40dd-adf1-62ceda0d696d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:46.978737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3fe71ace-f85e-40dd-adf1-62ceda0d696d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:46.979545 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3fe71ace-f85e-40dd-adf1-62ceda0d696d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:46.980106 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3fe71ace-f85e-40dd-adf1-62ceda0d696d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:46.980633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3fe71ace-f85e-40dd-adf1-62ceda0d696d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:47.352321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3fe71ace-f85e-40dd-adf1-62ceda0d696d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:47.360105 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3fe71ace-f85e-40dd-adf1-62ceda0d696d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1515 microversion: 2.1 time: 0.396234 Oct 05 02:42:47.360960 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1725/3471] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:46 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1515 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:47.743554 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e206c43f-a2eb-4aa4-a23d-f22c7bf10649 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:47.746504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e206c43f-a2eb-4aa4-a23d-f22c7bf10649 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:47.769960 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e206c43f-a2eb-4aa4-a23d-f22c7bf10649 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:47.771595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e206c43f-a2eb-4aa4-a23d-f22c7bf10649 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:47.772606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e206c43f-a2eb-4aa4-a23d-f22c7bf10649 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:47.773721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e206c43f-a2eb-4aa4-a23d-f22c7bf10649 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:47.774424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e206c43f-a2eb-4aa4-a23d-f22c7bf10649 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:47.775272 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e206c43f-a2eb-4aa4-a23d-f22c7bf10649 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:47.849205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b3873fe0-9784-4bc4-9bee-25059f999b28 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:47.849980 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b3873fe0-9784-4bc4-9bee-25059f999b28 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:47.867029 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3873fe0-9784-4bc4-9bee-25059f999b28 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:47.867645 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3873fe0-9784-4bc4-9bee-25059f999b28 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:47.868250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3873fe0-9784-4bc4-9bee-25059f999b28 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:47.869095 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3873fe0-9784-4bc4-9bee-25059f999b28 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:47.869984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3873fe0-9784-4bc4-9bee-25059f999b28 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:47.870698 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3873fe0-9784-4bc4-9bee-25059f999b28 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:47.892122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e206c43f-a2eb-4aa4-a23d-f22c7bf10649 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:47.907842 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e206c43f-a2eb-4aa4-a23d-f22c7bf10649 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:47.910166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e206c43f-a2eb-4aa4-a23d-f22c7bf10649 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:47.916326 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e206c43f-a2eb-4aa4-a23d-f22c7bf10649 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.196895 Oct 05 02:42:47.916929 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1747/3472] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:47 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:42:48.051819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b3873fe0-9784-4bc4-9bee-25059f999b28 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:48.060555 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b3873fe0-9784-4bc4-9bee-25059f999b28 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1312 microversion: 2.1 time: 0.217675 Oct 05 02:42:48.061796 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1726/3473] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:47 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1312 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:42:48.384857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b82c32b1-3999-4c4a-bac8-3f1e4ed4679f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:48.386036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b82c32b1-3999-4c4a-bac8-3f1e4ed4679f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:48.392690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b82c32b1-3999-4c4a-bac8-3f1e4ed4679f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:48.393451 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b82c32b1-3999-4c4a-bac8-3f1e4ed4679f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:48.394047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b82c32b1-3999-4c4a-bac8-3f1e4ed4679f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:48.395169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b82c32b1-3999-4c4a-bac8-3f1e4ed4679f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:48.396238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b82c32b1-3999-4c4a-bac8-3f1e4ed4679f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:48.396946 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b82c32b1-3999-4c4a-bac8-3f1e4ed4679f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:48.568662 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b82c32b1-3999-4c4a-bac8-3f1e4ed4679f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:48.580942 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b82c32b1-3999-4c4a-bac8-3f1e4ed4679f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1515 microversion: 2.1 time: 0.200465 Oct 05 02:42:48.582022 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1748/3474] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:48 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1515 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:48.790258 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-d9bb5081-ab6f-4bf8-be40-ba65a79898c8 req-5ff0d43f-5301-4e8f-bc2a-3a9e4ef7c918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03081f70-6b52-497a-ab3f-27f86089c602", "name": "network-vif-plugged", "status": "completed", "tag": "7edc14f6-3b4b-460e-96c8-a6f177b5e033"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:42:48.805174 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d9bb5081-ab6f-4bf8-be40-ba65a79898c8 req-5ff0d43f-5301-4e8f-bc2a-3a9e4ef7c918 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:48.805980 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d9bb5081-ab6f-4bf8-be40-ba65a79898c8 req-5ff0d43f-5301-4e8f-bc2a-3a9e4ef7c918 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:48.806587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d9bb5081-ab6f-4bf8-be40-ba65a79898c8 req-5ff0d43f-5301-4e8f-bc2a-3a9e4ef7c918 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:48.827150 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-d9bb5081-ab6f-4bf8-be40-ba65a79898c8 req-5ff0d43f-5301-4e8f-bc2a-3a9e4ef7c918 service nova] Creating event network-vif-plugged:7edc14f6-3b4b-460e-96c8-a6f177b5e033 for instance 03081f70-6b52-497a-ab3f-27f86089c602 on n-h2-858272-3 Oct 05 02:42:48.832293 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-d9bb5081-ab6f-4bf8-be40-ba65a79898c8 req-5ff0d43f-5301-4e8f-bc2a-3a9e4ef7c918 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047401 Oct 05 02:42:48.833364 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1727/3475] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:42:48.946149 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2254e82e-370f-4526-8baa-381c1a7fa638 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:48.946912 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2254e82e-370f-4526-8baa-381c1a7fa638 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:48.954965 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2254e82e-370f-4526-8baa-381c1a7fa638 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:48.956074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2254e82e-370f-4526-8baa-381c1a7fa638 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:48.956928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2254e82e-370f-4526-8baa-381c1a7fa638 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:48.958000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2254e82e-370f-4526-8baa-381c1a7fa638 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:48.958691 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2254e82e-370f-4526-8baa-381c1a7fa638 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:48.959293 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2254e82e-370f-4526-8baa-381c1a7fa638 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:49.048027 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2254e82e-370f-4526-8baa-381c1a7fa638 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:49.062518 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2254e82e-370f-4526-8baa-381c1a7fa638 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:49.065650 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2254e82e-370f-4526-8baa-381c1a7fa638 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:49.078007 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2254e82e-370f-4526-8baa-381c1a7fa638 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.134704 Oct 05 02:42:49.090968 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1749/3476] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:48 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:42:49.478358 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8b19df0e-ea01-4e52-a6e2-651600275a00 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:49.479165 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8b19df0e-ea01-4e52-a6e2-651600275a00 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:49.491631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b19df0e-ea01-4e52-a6e2-651600275a00 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:49.492373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b19df0e-ea01-4e52-a6e2-651600275a00 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:49.493052 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b19df0e-ea01-4e52-a6e2-651600275a00 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:49.494749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b19df0e-ea01-4e52-a6e2-651600275a00 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:49.495296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b19df0e-ea01-4e52-a6e2-651600275a00 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:49.496423 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b19df0e-ea01-4e52-a6e2-651600275a00 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:49.607075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-baabbb34-237d-4fc2-9655-da25ec54e482 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:49.608004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-baabbb34-237d-4fc2-9655-da25ec54e482 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:49.616276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-baabbb34-237d-4fc2-9655-da25ec54e482 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:49.617184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-baabbb34-237d-4fc2-9655-da25ec54e482 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:49.617875 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-baabbb34-237d-4fc2-9655-da25ec54e482 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:49.619029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-baabbb34-237d-4fc2-9655-da25ec54e482 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:49.619922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-baabbb34-237d-4fc2-9655-da25ec54e482 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:49.620581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-baabbb34-237d-4fc2-9655-da25ec54e482 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:50.000558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8b19df0e-ea01-4e52-a6e2-651600275a00 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:50.010830 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-baabbb34-237d-4fc2-9655-da25ec54e482 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:50.013942 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8b19df0e-ea01-4e52-a6e2-651600275a00 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1312 microversion: 2.1 time: 0.929826 Oct 05 02:42:50.016266 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1728/3477] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:49 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1312 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:50.034310 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-baabbb34-237d-4fc2-9655-da25ec54e482 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1515 microversion: 2.1 time: 0.429931 Oct 05 02:42:50.035485 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1750/3478] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:49 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1515 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:42:50.111734 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-066fe9d4-5744-4730-a588-379c7e157ad5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:50.113056 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-066fe9d4-5744-4730-a588-379c7e157ad5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:50.124506 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-066fe9d4-5744-4730-a588-379c7e157ad5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:50.125039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-066fe9d4-5744-4730-a588-379c7e157ad5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:50.129501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-066fe9d4-5744-4730-a588-379c7e157ad5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:50.130498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-066fe9d4-5744-4730-a588-379c7e157ad5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:50.131038 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-066fe9d4-5744-4730-a588-379c7e157ad5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:50.131435 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-066fe9d4-5744-4730-a588-379c7e157ad5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:50.217269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-066fe9d4-5744-4730-a588-379c7e157ad5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:50.234095 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-066fe9d4-5744-4730-a588-379c7e157ad5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:50.234095 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-066fe9d4-5744-4730-a588-379c7e157ad5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:50.257057 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-066fe9d4-5744-4730-a588-379c7e157ad5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.149864 Oct 05 02:42:50.258903 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1729/3479] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:50 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:42:51.042378 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a229bf37-da02-44c6-9576-8d545c6342b2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:51.043681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a229bf37-da02-44c6-9576-8d545c6342b2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:51.051559 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a229bf37-da02-44c6-9576-8d545c6342b2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:51.052243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a229bf37-da02-44c6-9576-8d545c6342b2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:51.052873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a229bf37-da02-44c6-9576-8d545c6342b2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:51.054238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a229bf37-da02-44c6-9576-8d545c6342b2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:51.054936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a229bf37-da02-44c6-9576-8d545c6342b2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:51.056196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a229bf37-da02-44c6-9576-8d545c6342b2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:51.059827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c04b07d2-e727-442a-a292-c2758a6cd3cb tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:51.060450 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c04b07d2-e727-442a-a292-c2758a6cd3cb tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:51.072551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c04b07d2-e727-442a-a292-c2758a6cd3cb tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:51.084179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c04b07d2-e727-442a-a292-c2758a6cd3cb tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:51.084854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c04b07d2-e727-442a-a292-c2758a6cd3cb tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:51.087244 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c04b07d2-e727-442a-a292-c2758a6cd3cb tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:51.087734 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c04b07d2-e727-442a-a292-c2758a6cd3cb tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:51.088169 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c04b07d2-e727-442a-a292-c2758a6cd3cb tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:51.331831 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c04b07d2-e727-442a-a292-c2758a6cd3cb tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:51.337722 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a229bf37-da02-44c6-9576-8d545c6342b2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:51.345529 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a229bf37-da02-44c6-9576-8d545c6342b2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1461 microversion: 2.1 time: 0.307325 Oct 05 02:42:51.349097 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1751/3480] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:51 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1461 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:51.355057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-889f30ed-a9a9-45c1-88fb-2dcb94ec7363 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:51.355702 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-889f30ed-a9a9-45c1-88fb-2dcb94ec7363 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:51.364054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-889f30ed-a9a9-45c1-88fb-2dcb94ec7363 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:51.364559 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-889f30ed-a9a9-45c1-88fb-2dcb94ec7363 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:51.365040 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-889f30ed-a9a9-45c1-88fb-2dcb94ec7363 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:51.365840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-889f30ed-a9a9-45c1-88fb-2dcb94ec7363 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:51.366310 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-889f30ed-a9a9-45c1-88fb-2dcb94ec7363 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:51.366912 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-889f30ed-a9a9-45c1-88fb-2dcb94ec7363 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:51.369241 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c04b07d2-e727-442a-a292-c2758a6cd3cb tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1515 microversion: 2.1 time: 0.313922 Oct 05 02:42:51.385757 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1730/3481] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:51 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1515 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:42:51.391162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f7e57e58-280d-45ad-89d8-f043c40426b7 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:51.392117 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f7e57e58-280d-45ad-89d8-f043c40426b7 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:51.399367 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7e57e58-280d-45ad-89d8-f043c40426b7 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:51.400104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7e57e58-280d-45ad-89d8-f043c40426b7 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:51.400705 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7e57e58-280d-45ad-89d8-f043c40426b7 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:51.401594 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7e57e58-280d-45ad-89d8-f043c40426b7 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:51.402235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7e57e58-280d-45ad-89d8-f043c40426b7 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:51.402825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7e57e58-280d-45ad-89d8-f043c40426b7 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:51.455661 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-889f30ed-a9a9-45c1-88fb-2dcb94ec7363 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:51.477414 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-889f30ed-a9a9-45c1-88fb-2dcb94ec7363 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:51.478907 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-889f30ed-a9a9-45c1-88fb-2dcb94ec7363 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:51.484714 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-889f30ed-a9a9-45c1-88fb-2dcb94ec7363 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.134379 Oct 05 02:42:51.485411 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1752/3482] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:51 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:42:51.677911 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f7e57e58-280d-45ad-89d8-f043c40426b7 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1612 microversion: 2.1 time: 0.290553 Oct 05 02:42:51.678543 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1731/3483] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:51 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1612 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:51.700481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-db14af10-c480-4849-9e54-c280e13a1fa9 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:42:51.701398 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-db14af10-c480-4849-9e54-c280e13a1fa9 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:51.708110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:51.709746 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db14af10-c480-4849-9e54-c280e13a1fa9 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:51.710466 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db14af10-c480-4849-9e54-c280e13a1fa9 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:51.711231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db14af10-c480-4849-9e54-c280e13a1fa9 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:51.712157 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db14af10-c480-4849-9e54-c280e13a1fa9 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:51.712639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db14af10-c480-4849-9e54-c280e13a1fa9 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:51.713275 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db14af10-c480-4849-9e54-c280e13a1fa9 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:51.785818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-db14af10-c480-4849-9e54-c280e13a1fa9 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '5bda07d8c2fa4f64b27d6eff9c821472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42e21e5ff8247d2b2fc27a30b7a4fd9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:51.786451 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-db14af10-c480-4849-9e54-c280e13a1fa9 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] flavor_id is None. Assuming migration. {{(pid=122320) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 05 02:42:51.786889 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-db14af10-c480-4849-9e54-c280e13a1fa9 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122320) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 05 02:42:52.191373 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-db14af10-c480-4849-9e54-c280e13a1fa9 tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602/action" status: 202 len: 0 microversion: 2.1 time: 0.494208 Oct 05 02:42:52.193060 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1753/3484] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:42:51 2022] POST /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602/action => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 02:42:52.202465 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-76f21b02-a692-45a4-82da-97ab683b3e59 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:52.204012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-76f21b02-a692-45a4-82da-97ab683b3e59 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:52.214095 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-76f21b02-a692-45a4-82da-97ab683b3e59 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:52.214885 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-76f21b02-a692-45a4-82da-97ab683b3e59 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:52.215548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-76f21b02-a692-45a4-82da-97ab683b3e59 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:52.216738 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-76f21b02-a692-45a4-82da-97ab683b3e59 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:52.217441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-76f21b02-a692-45a4-82da-97ab683b3e59 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:52.217973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-76f21b02-a692-45a4-82da-97ab683b3e59 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:52.395114 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9cffafab-c1ff-43f5-a1ea-19b4bed857a1 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:52.395867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9cffafab-c1ff-43f5-a1ea-19b4bed857a1 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:52.406098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9cffafab-c1ff-43f5-a1ea-19b4bed857a1 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:52.406720 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9cffafab-c1ff-43f5-a1ea-19b4bed857a1 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:52.407629 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9cffafab-c1ff-43f5-a1ea-19b4bed857a1 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:52.409284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9cffafab-c1ff-43f5-a1ea-19b4bed857a1 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:52.409983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9cffafab-c1ff-43f5-a1ea-19b4bed857a1 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:52.410602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9cffafab-c1ff-43f5-a1ea-19b4bed857a1 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:52.433772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-76f21b02-a692-45a4-82da-97ab683b3e59 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:52.443929 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-76f21b02-a692-45a4-82da-97ab683b3e59 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1470 microversion: 2.1 time: 0.246172 Oct 05 02:42:52.456181 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1732/3485] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:52 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1470 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:52.523370 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-12d702a8-e6f1-45a8-898b-ab284dfb7e6f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:52.525399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-12d702a8-e6f1-45a8-898b-ab284dfb7e6f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:52.554566 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12d702a8-e6f1-45a8-898b-ab284dfb7e6f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:52.555104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12d702a8-e6f1-45a8-898b-ab284dfb7e6f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:52.555540 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12d702a8-e6f1-45a8-898b-ab284dfb7e6f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:52.556257 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12d702a8-e6f1-45a8-898b-ab284dfb7e6f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:52.556822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12d702a8-e6f1-45a8-898b-ab284dfb7e6f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:52.557912 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12d702a8-e6f1-45a8-898b-ab284dfb7e6f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:52.602846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:52.714794 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-12d702a8-e6f1-45a8-898b-ab284dfb7e6f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:52.742414 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9cffafab-c1ff-43f5-a1ea-19b4bed857a1 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:52.749875 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-12d702a8-e6f1-45a8-898b-ab284dfb7e6f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:52.752516 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9cffafab-c1ff-43f5-a1ea-19b4bed857a1 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1515 microversion: 2.1 time: 0.362340 Oct 05 02:42:52.754838 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-12d702a8-e6f1-45a8-898b-ab284dfb7e6f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:52.762273 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-12d702a8-e6f1-45a8-898b-ab284dfb7e6f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1560 microversion: 2.91 time: 0.247799 Oct 05 02:42:52.768275 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1754/3486] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:52 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1515 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:52.787427 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1733/3487] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:52 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1560 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:42:53.472492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6d7243e8-4744-49a0-8fb6-5859b6582767 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:53.473807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6d7243e8-4744-49a0-8fb6-5859b6582767 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:53.493684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6d7243e8-4744-49a0-8fb6-5859b6582767 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:53.494603 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6d7243e8-4744-49a0-8fb6-5859b6582767 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:53.496716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6d7243e8-4744-49a0-8fb6-5859b6582767 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:53.497520 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6d7243e8-4744-49a0-8fb6-5859b6582767 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:53.500353 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6d7243e8-4744-49a0-8fb6-5859b6582767 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:53.501122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6d7243e8-4744-49a0-8fb6-5859b6582767 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:53.745845 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6d7243e8-4744-49a0-8fb6-5859b6582767 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:53.758094 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6d7243e8-4744-49a0-8fb6-5859b6582767 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1470 microversion: 2.1 time: 0.291817 Oct 05 02:42:53.758819 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1755/3488] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:53 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1470 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:53.778438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8d3c0af6-5db5-497c-9c01-e0443825087f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:53.779807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8d3c0af6-5db5-497c-9c01-e0443825087f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:53.787827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d3c0af6-5db5-497c-9c01-e0443825087f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:53.788601 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d3c0af6-5db5-497c-9c01-e0443825087f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:53.789273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d3c0af6-5db5-497c-9c01-e0443825087f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:53.790299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d3c0af6-5db5-497c-9c01-e0443825087f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:53.790942 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d3c0af6-5db5-497c-9c01-e0443825087f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:53.791372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d3c0af6-5db5-497c-9c01-e0443825087f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:53.798246 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a9ac62fd-db67-4f49-aa32-96158b20d6b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:53.799631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a9ac62fd-db67-4f49-aa32-96158b20d6b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:53.806298 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9ac62fd-db67-4f49-aa32-96158b20d6b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:53.807012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9ac62fd-db67-4f49-aa32-96158b20d6b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:53.807880 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9ac62fd-db67-4f49-aa32-96158b20d6b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:53.808506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9ac62fd-db67-4f49-aa32-96158b20d6b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:53.808991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9ac62fd-db67-4f49-aa32-96158b20d6b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:53.809616 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9ac62fd-db67-4f49-aa32-96158b20d6b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:53.949325 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a9ac62fd-db67-4f49-aa32-96158b20d6b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:53.960353 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a9ac62fd-db67-4f49-aa32-96158b20d6b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:53.961979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a9ac62fd-db67-4f49-aa32-96158b20d6b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:53.967675 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a9ac62fd-db67-4f49-aa32-96158b20d6b7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1560 microversion: 2.91 time: 0.174473 Oct 05 02:42:53.969392 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1756/3489] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:53 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:42:54.071149 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8d3c0af6-5db5-497c-9c01-e0443825087f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:54.085156 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8d3c0af6-5db5-497c-9c01-e0443825087f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1515 microversion: 2.1 time: 0.310459 Oct 05 02:42:54.085951 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1734/3490] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:53 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1515 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:54.784988 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-41ad9f95-34e7-44bb-bc4c-adee98859070 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:54.786202 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-41ad9f95-34e7-44bb-bc4c-adee98859070 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:54.795251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-41ad9f95-34e7-44bb-bc4c-adee98859070 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:54.795973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-41ad9f95-34e7-44bb-bc4c-adee98859070 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:54.796655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-41ad9f95-34e7-44bb-bc4c-adee98859070 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:54.797409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-41ad9f95-34e7-44bb-bc4c-adee98859070 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:54.798039 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-41ad9f95-34e7-44bb-bc4c-adee98859070 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:54.798740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-41ad9f95-34e7-44bb-bc4c-adee98859070 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:54.956343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-41ad9f95-34e7-44bb-bc4c-adee98859070 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:54.966703 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-41ad9f95-34e7-44bb-bc4c-adee98859070 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1470 microversion: 2.1 time: 0.187212 Oct 05 02:42:54.967790 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1757/3491] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:54 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1470 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:55.003488 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b9b5016e-20f2-459f-9ee4-38588297eee5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:55.004302 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b9b5016e-20f2-459f-9ee4-38588297eee5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:55.012941 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9b5016e-20f2-459f-9ee4-38588297eee5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:55.013717 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9b5016e-20f2-459f-9ee4-38588297eee5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:55.014275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9b5016e-20f2-459f-9ee4-38588297eee5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:55.015250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9b5016e-20f2-459f-9ee4-38588297eee5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:55.016198 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9b5016e-20f2-459f-9ee4-38588297eee5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:55.016510 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9b5016e-20f2-459f-9ee4-38588297eee5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:55.098765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b9b5016e-20f2-459f-9ee4-38588297eee5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:55.111160 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b9b5016e-20f2-459f-9ee4-38588297eee5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:55.113913 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5283b8ef-6361-40c3-9fac-8ba6621ae152 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:55.114473 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b9b5016e-20f2-459f-9ee4-38588297eee5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:55.114643 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5283b8ef-6361-40c3-9fac-8ba6621ae152 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:55.121358 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b9b5016e-20f2-459f-9ee4-38588297eee5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1560 microversion: 2.91 time: 0.124995 Oct 05 02:42:55.122797 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1735/3492] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:54 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1560 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:42:55.125981 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5283b8ef-6361-40c3-9fac-8ba6621ae152 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:55.127312 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5283b8ef-6361-40c3-9fac-8ba6621ae152 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:55.128614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5283b8ef-6361-40c3-9fac-8ba6621ae152 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:55.129679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5283b8ef-6361-40c3-9fac-8ba6621ae152 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:55.130372 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5283b8ef-6361-40c3-9fac-8ba6621ae152 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:55.131025 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5283b8ef-6361-40c3-9fac-8ba6621ae152 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:55.149692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:55.358058 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-93c8ed2b-7c0c-4c67-8c2c-ec74e96e980f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:55.360599 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-93c8ed2b-7c0c-4c67-8c2c-ec74e96e980f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:55.376450 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93c8ed2b-7c0c-4c67-8c2c-ec74e96e980f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:55.377933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93c8ed2b-7c0c-4c67-8c2c-ec74e96e980f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:55.379739 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93c8ed2b-7c0c-4c67-8c2c-ec74e96e980f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:55.385844 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93c8ed2b-7c0c-4c67-8c2c-ec74e96e980f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:55.385993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5283b8ef-6361-40c3-9fac-8ba6621ae152 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:55.387354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93c8ed2b-7c0c-4c67-8c2c-ec74e96e980f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:55.387920 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93c8ed2b-7c0c-4c67-8c2c-ec74e96e980f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:55.401802 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5283b8ef-6361-40c3-9fac-8ba6621ae152 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1515 microversion: 2.1 time: 0.291659 Oct 05 02:42:55.402661 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1758/3493] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:55 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1515 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:55.445019 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-93c8ed2b-7c0c-4c67-8c2c-ec74e96e980f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397/ips" status: 200 len: 146 microversion: 2.1 time: 0.094175 Oct 05 02:42:55.445920 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1736/3494] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 02:42:55 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397/ips => generated 146 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:42:56.000108 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2189011f-1c43-42a0-8b41-42aaef6f2317 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:56.001061 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2189011f-1c43-42a0-8b41-42aaef6f2317 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:56.027376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2189011f-1c43-42a0-8b41-42aaef6f2317 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:56.027878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2189011f-1c43-42a0-8b41-42aaef6f2317 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:56.030723 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2189011f-1c43-42a0-8b41-42aaef6f2317 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:56.032065 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2189011f-1c43-42a0-8b41-42aaef6f2317 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:56.032836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2189011f-1c43-42a0-8b41-42aaef6f2317 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:56.033399 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2189011f-1c43-42a0-8b41-42aaef6f2317 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:56.160278 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-79829588-9f3c-46fa-bcad-7fc8505f446c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:56.161803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-79829588-9f3c-46fa-bcad-7fc8505f446c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:56.176122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79829588-9f3c-46fa-bcad-7fc8505f446c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:56.176800 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79829588-9f3c-46fa-bcad-7fc8505f446c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:56.177388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79829588-9f3c-46fa-bcad-7fc8505f446c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:56.178197 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79829588-9f3c-46fa-bcad-7fc8505f446c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:56.178763 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79829588-9f3c-46fa-bcad-7fc8505f446c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:56.179518 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79829588-9f3c-46fa-bcad-7fc8505f446c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:56.342515 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-79829588-9f3c-46fa-bcad-7fc8505f446c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:56.355681 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-79829588-9f3c-46fa-bcad-7fc8505f446c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:56.357179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-79829588-9f3c-46fa-bcad-7fc8505f446c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:56.363973 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-79829588-9f3c-46fa-bcad-7fc8505f446c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1560 microversion: 2.91 time: 0.211965 Oct 05 02:42:56.365433 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1737/3495] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:56 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:42:56.381347 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2189011f-1c43-42a0-8b41-42aaef6f2317 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:56.386209 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2189011f-1c43-42a0-8b41-42aaef6f2317 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1475 microversion: 2.1 time: 0.396574 Oct 05 02:42:56.398043 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1759/3496] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:55 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1475 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:56.427784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b693169e-68a9-474e-b6c4-0d9b0bb6eb58 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:56.428515 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b693169e-68a9-474e-b6c4-0d9b0bb6eb58 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:56.435808 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b693169e-68a9-474e-b6c4-0d9b0bb6eb58 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:56.436309 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b693169e-68a9-474e-b6c4-0d9b0bb6eb58 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:56.436753 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b693169e-68a9-474e-b6c4-0d9b0bb6eb58 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:56.437491 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b693169e-68a9-474e-b6c4-0d9b0bb6eb58 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:56.437951 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b693169e-68a9-474e-b6c4-0d9b0bb6eb58 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:56.438381 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b693169e-68a9-474e-b6c4-0d9b0bb6eb58 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:56.715472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b693169e-68a9-474e-b6c4-0d9b0bb6eb58 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:56.730469 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b693169e-68a9-474e-b6c4-0d9b0bb6eb58 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1515 microversion: 2.1 time: 0.306221 Oct 05 02:42:56.731327 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1738/3497] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:56 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1515 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:57.400209 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0c243eb9-c924-49f4-921f-22155444ba11 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:57.401937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0c243eb9-c924-49f4-921f-22155444ba11 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:57.412676 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d660a535-6539-4ed0-8e0c-ac0d307baf2a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:57.413438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d660a535-6539-4ed0-8e0c-ac0d307baf2a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:57.420394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d660a535-6539-4ed0-8e0c-ac0d307baf2a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:57.427282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c243eb9-c924-49f4-921f-22155444ba11 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:57.431666 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d660a535-6539-4ed0-8e0c-ac0d307baf2a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:57.432235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d660a535-6539-4ed0-8e0c-ac0d307baf2a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:57.432968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c243eb9-c924-49f4-921f-22155444ba11 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:57.434011 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c243eb9-c924-49f4-921f-22155444ba11 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:57.436708 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d660a535-6539-4ed0-8e0c-ac0d307baf2a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:57.437700 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c243eb9-c924-49f4-921f-22155444ba11 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:57.438352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d660a535-6539-4ed0-8e0c-ac0d307baf2a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:57.445182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d660a535-6539-4ed0-8e0c-ac0d307baf2a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:57.445970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c243eb9-c924-49f4-921f-22155444ba11 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:57.450838 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c243eb9-c924-49f4-921f-22155444ba11 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:57.753143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0c243eb9-c924-49f4-921f-22155444ba11 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:57.769881 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0c243eb9-c924-49f4-921f-22155444ba11 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:57.771920 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0c243eb9-c924-49f4-921f-22155444ba11 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:57.785636 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0c243eb9-c924-49f4-921f-22155444ba11 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1555 microversion: 2.91 time: 0.390760 Oct 05 02:42:57.786941 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1760/3498] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:57 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1555 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:42:57.812560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-896e42bc-2db7-4a9a-b60c-25260dda8bfc tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:57.815060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-896e42bc-2db7-4a9a-b60c-25260dda8bfc tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:57.829377 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-896e42bc-2db7-4a9a-b60c-25260dda8bfc tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:57.830948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-896e42bc-2db7-4a9a-b60c-25260dda8bfc tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:57.830948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-896e42bc-2db7-4a9a-b60c-25260dda8bfc tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:57.831614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-896e42bc-2db7-4a9a-b60c-25260dda8bfc tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:57.832279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-896e42bc-2db7-4a9a-b60c-25260dda8bfc tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:57.832922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-896e42bc-2db7-4a9a-b60c-25260dda8bfc tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:58.027329 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d660a535-6539-4ed0-8e0c-ac0d307baf2a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:58.041554 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d660a535-6539-4ed0-8e0c-ac0d307baf2a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1475 microversion: 2.1 time: 0.633593 Oct 05 02:42:58.042836 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1739/3499] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:57 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1475 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:42:58.195619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-896e42bc-2db7-4a9a-b60c-25260dda8bfc tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:58.207047 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-896e42bc-2db7-4a9a-b60c-25260dda8bfc tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1515 microversion: 2.1 time: 0.418782 Oct 05 02:42:58.221754 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1761/3500] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:57 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1515 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:42:58.819697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c4ded8eb-0c1e-4d6f-8529-013d101940c2 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:58.820315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c4ded8eb-0c1e-4d6f-8529-013d101940c2 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:58.829023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a6e5c8cd-15d4-4073-805e-7428f2a93b7b tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1c1230b-06ef-4e84-898e-eecaef1b7652"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:42:58.843923 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a6e5c8cd-15d4-4073-805e-7428f2a93b7b tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:58.854072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4ded8eb-0c1e-4d6f-8529-013d101940c2 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:58.854568 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4ded8eb-0c1e-4d6f-8529-013d101940c2 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:58.855011 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4ded8eb-0c1e-4d6f-8529-013d101940c2 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:58.855719 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4ded8eb-0c1e-4d6f-8529-013d101940c2 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:58.856215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4ded8eb-0c1e-4d6f-8529-013d101940c2 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:58.856772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4ded8eb-0c1e-4d6f-8529-013d101940c2 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:58.868253 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6e5c8cd-15d4-4073-805e-7428f2a93b7b tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:58.868763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6e5c8cd-15d4-4073-805e-7428f2a93b7b tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:58.870894 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6e5c8cd-15d4-4073-805e-7428f2a93b7b tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:58.871623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6e5c8cd-15d4-4073-805e-7428f2a93b7b tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:58.872084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6e5c8cd-15d4-4073-805e-7428f2a93b7b tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:58.872508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6e5c8cd-15d4-4073-805e-7428f2a93b7b tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:59.021301 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c4ded8eb-0c1e-4d6f-8529-013d101940c2 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:59.040298 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c4ded8eb-0c1e-4d6f-8529-013d101940c2 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:59.041937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c4ded8eb-0c1e-4d6f-8529-013d101940c2 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:59.049153 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:59.051127 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c4ded8eb-0c1e-4d6f-8529-013d101940c2 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1555 microversion: 2.91 time: 0.235309 Oct 05 02:42:59.055982 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1740/3501] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:42:58 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1555 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:42:59.083931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a9889127-01db-441d-8f6d-329ee838a411 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:59.086301 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a9889127-01db-441d-8f6d-329ee838a411 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:59.101927 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9889127-01db-441d-8f6d-329ee838a411 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:59.104044 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9889127-01db-441d-8f6d-329ee838a411 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:59.105670 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9889127-01db-441d-8f6d-329ee838a411 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:59.109366 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9889127-01db-441d-8f6d-329ee838a411 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:59.110839 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9889127-01db-441d-8f6d-329ee838a411 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:59.116138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9889127-01db-441d-8f6d-329ee838a411 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:59.427341 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a9889127-01db-441d-8f6d-329ee838a411 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:59.435965 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a9889127-01db-441d-8f6d-329ee838a411 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1475 microversion: 2.1 time: 0.371308 Oct 05 02:42:59.440456 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1741/3502] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:59 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1475 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:42:59.458574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-86d6fc23-be4f-4237-971b-575b99dcdc50 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:42:59.461848 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-86d6fc23-be4f-4237-971b-575b99dcdc50 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:42:59.478235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86d6fc23-be4f-4237-971b-575b99dcdc50 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:59.478732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86d6fc23-be4f-4237-971b-575b99dcdc50 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:59.479168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86d6fc23-be4f-4237-971b-575b99dcdc50 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:59.479870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86d6fc23-be4f-4237-971b-575b99dcdc50 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:42:59.480319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86d6fc23-be4f-4237-971b-575b99dcdc50 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:42:59.480742 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86d6fc23-be4f-4237-971b-575b99dcdc50 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:42:59.775303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-86d6fc23-be4f-4237-971b-575b99dcdc50 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:42:59.786193 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-86d6fc23-be4f-4237-971b-575b99dcdc50 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1515 microversion: 2.1 time: 0.344003 Oct 05 02:42:59.791811 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1742/3503] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:42:59 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1515 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:00.086551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-deb5e5d9-2fa8-474f-bf38-483fb9168e07 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:00.087249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-deb5e5d9-2fa8-474f-bf38-483fb9168e07 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:00.104034 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-deb5e5d9-2fa8-474f-bf38-483fb9168e07 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:00.104513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-deb5e5d9-2fa8-474f-bf38-483fb9168e07 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:00.115161 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-deb5e5d9-2fa8-474f-bf38-483fb9168e07 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:00.116333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-deb5e5d9-2fa8-474f-bf38-483fb9168e07 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:00.117259 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-deb5e5d9-2fa8-474f-bf38-483fb9168e07 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:00.117874 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-deb5e5d9-2fa8-474f-bf38-483fb9168e07 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:00.259630 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-deb5e5d9-2fa8-474f-bf38-483fb9168e07 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:00.279764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-deb5e5d9-2fa8-474f-bf38-483fb9168e07 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:00.287019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-deb5e5d9-2fa8-474f-bf38-483fb9168e07 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:00.301277 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-deb5e5d9-2fa8-474f-bf38-483fb9168e07 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1555 microversion: 2.91 time: 0.218883 Oct 05 02:43:00.303021 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1743/3504] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:00 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1555 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:43:00.466468 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4ab0a76b-6ad8-478a-a5d3-451f214f7e9e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:00.467222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4ab0a76b-6ad8-478a-a5d3-451f214f7e9e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:00.478902 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ab0a76b-6ad8-478a-a5d3-451f214f7e9e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:00.480103 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ab0a76b-6ad8-478a-a5d3-451f214f7e9e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:00.480710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ab0a76b-6ad8-478a-a5d3-451f214f7e9e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:00.481786 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ab0a76b-6ad8-478a-a5d3-451f214f7e9e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:00.483014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ab0a76b-6ad8-478a-a5d3-451f214f7e9e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:00.483621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ab0a76b-6ad8-478a-a5d3-451f214f7e9e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:00.654994 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a6e5c8cd-15d4-4073-805e-7428f2a93b7b tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "POST /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.812175 Oct 05 02:43:00.662034 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1762/3505] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 02:42:58 2022] POST /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397/os-volume_attachments => generated 194 bytes in 1838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:43:00.783065 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4ab0a76b-6ad8-478a-a5d3-451f214f7e9e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:00.809719 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4ab0a76b-6ad8-478a-a5d3-451f214f7e9e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1475 microversion: 2.1 time: 0.347602 Oct 05 02:43:00.819035 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-22c5fd94-2220-4208-ac04-faef07db6292 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:00.819660 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-22c5fd94-2220-4208-ac04-faef07db6292 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:00.851400 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1744/3506] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:00 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1475 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:00.851568 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22c5fd94-2220-4208-ac04-faef07db6292 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:00.851568 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22c5fd94-2220-4208-ac04-faef07db6292 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:00.851568 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22c5fd94-2220-4208-ac04-faef07db6292 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:00.851568 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22c5fd94-2220-4208-ac04-faef07db6292 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:00.851568 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22c5fd94-2220-4208-ac04-faef07db6292 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:00.851568 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22c5fd94-2220-4208-ac04-faef07db6292 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:01.100028 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-22c5fd94-2220-4208-ac04-faef07db6292 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:01.111261 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-22c5fd94-2220-4208-ac04-faef07db6292 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1521 microversion: 2.1 time: 0.299395 Oct 05 02:43:01.112050 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1763/3507] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:00 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:43:01.337085 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-aaf9cec4-8baa-41e7-9a78-61aa684fbf10 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:01.337696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-aaf9cec4-8baa-41e7-9a78-61aa684fbf10 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:01.349338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aaf9cec4-8baa-41e7-9a78-61aa684fbf10 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:01.349999 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aaf9cec4-8baa-41e7-9a78-61aa684fbf10 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:01.350318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aaf9cec4-8baa-41e7-9a78-61aa684fbf10 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:01.351178 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aaf9cec4-8baa-41e7-9a78-61aa684fbf10 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:01.351646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aaf9cec4-8baa-41e7-9a78-61aa684fbf10 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:01.355241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aaf9cec4-8baa-41e7-9a78-61aa684fbf10 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:01.525801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-aaf9cec4-8baa-41e7-9a78-61aa684fbf10 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:01.549800 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-aaf9cec4-8baa-41e7-9a78-61aa684fbf10 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:01.551672 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-aaf9cec4-8baa-41e7-9a78-61aa684fbf10 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:01.561625 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-aaf9cec4-8baa-41e7-9a78-61aa684fbf10 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1555 microversion: 2.91 time: 0.228275 Oct 05 02:43:01.562767 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1745/3508] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:01 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1555 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:43:01.867243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c8dca844-cbbe-41f8-b1f9-25c845a2d21a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:01.867851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c8dca844-cbbe-41f8-b1f9-25c845a2d21a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:01.903243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8dca844-cbbe-41f8-b1f9-25c845a2d21a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:01.905700 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8dca844-cbbe-41f8-b1f9-25c845a2d21a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:01.906161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8dca844-cbbe-41f8-b1f9-25c845a2d21a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:01.908545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8dca844-cbbe-41f8-b1f9-25c845a2d21a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:01.911821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8dca844-cbbe-41f8-b1f9-25c845a2d21a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:01.912298 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8dca844-cbbe-41f8-b1f9-25c845a2d21a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:02.141498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-74f6f8b2-4f12-4778-b9e3-5d2db69b10e9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:02.143163 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-74f6f8b2-4f12-4778-b9e3-5d2db69b10e9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:02.150979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74f6f8b2-4f12-4778-b9e3-5d2db69b10e9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:02.153986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74f6f8b2-4f12-4778-b9e3-5d2db69b10e9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:02.159155 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74f6f8b2-4f12-4778-b9e3-5d2db69b10e9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:02.160466 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74f6f8b2-4f12-4778-b9e3-5d2db69b10e9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:02.163359 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74f6f8b2-4f12-4778-b9e3-5d2db69b10e9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:02.165448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74f6f8b2-4f12-4778-b9e3-5d2db69b10e9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:02.197674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c8dca844-cbbe-41f8-b1f9-25c845a2d21a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:02.218483 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c8dca844-cbbe-41f8-b1f9-25c845a2d21a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1475 microversion: 2.1 time: 0.355722 Oct 05 02:43:02.223812 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1764/3509] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:01 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1475 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:02.533831 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-74f6f8b2-4f12-4778-b9e3-5d2db69b10e9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:02.541477 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-74f6f8b2-4f12-4778-b9e3-5d2db69b10e9 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1521 microversion: 2.1 time: 0.407197 Oct 05 02:43:02.542069 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1746/3510] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:02 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1521 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:43:02.596495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b98aae38-87b2-40c1-adc7-6e4181a6316d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:02.597416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b98aae38-87b2-40c1-adc7-6e4181a6316d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:02.615083 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b98aae38-87b2-40c1-adc7-6e4181a6316d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:02.623628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b98aae38-87b2-40c1-adc7-6e4181a6316d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:02.629419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b98aae38-87b2-40c1-adc7-6e4181a6316d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:02.630210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b98aae38-87b2-40c1-adc7-6e4181a6316d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:02.630693 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b98aae38-87b2-40c1-adc7-6e4181a6316d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:02.631125 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b98aae38-87b2-40c1-adc7-6e4181a6316d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:02.823277 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b98aae38-87b2-40c1-adc7-6e4181a6316d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:02.836817 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b98aae38-87b2-40c1-adc7-6e4181a6316d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:02.839507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b98aae38-87b2-40c1-adc7-6e4181a6316d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:02.854570 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b98aae38-87b2-40c1-adc7-6e4181a6316d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1555 microversion: 2.91 time: 0.260535 Oct 05 02:43:02.855654 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1765/3511] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:02 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1555 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:43:03.249958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3a2dd096-4ffb-4750-82b2-45e29c1e7157 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:03.251170 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3a2dd096-4ffb-4750-82b2-45e29c1e7157 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:03.262986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a2dd096-4ffb-4750-82b2-45e29c1e7157 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:03.266127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a2dd096-4ffb-4750-82b2-45e29c1e7157 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:03.268562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a2dd096-4ffb-4750-82b2-45e29c1e7157 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:03.269685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a2dd096-4ffb-4750-82b2-45e29c1e7157 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:03.277149 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a2dd096-4ffb-4750-82b2-45e29c1e7157 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:03.277969 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a2dd096-4ffb-4750-82b2-45e29c1e7157 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:03.569550 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bb3bf97d-5f04-4af4-9edd-fea048cc5b71 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:03.569550 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bb3bf97d-5f04-4af4-9edd-fea048cc5b71 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:03.577098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb3bf97d-5f04-4af4-9edd-fea048cc5b71 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:03.577591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb3bf97d-5f04-4af4-9edd-fea048cc5b71 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:03.578024 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb3bf97d-5f04-4af4-9edd-fea048cc5b71 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:03.578716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb3bf97d-5f04-4af4-9edd-fea048cc5b71 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:03.579162 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb3bf97d-5f04-4af4-9edd-fea048cc5b71 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:03.579572 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb3bf97d-5f04-4af4-9edd-fea048cc5b71 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:04.242882 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bb3bf97d-5f04-4af4-9edd-fea048cc5b71 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:04.254905 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bb3bf97d-5f04-4af4-9edd-fea048cc5b71 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1521 microversion: 2.1 time: 0.692247 Oct 05 02:43:04.257388 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1766/3512] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:03 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1521 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:43:04.274117 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cdf0dc47-e045-44b1-a8e8-381ee4fe0740 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:04.280208 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cdf0dc47-e045-44b1-a8e8-381ee4fe0740 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:04.299933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3a2dd096-4ffb-4750-82b2-45e29c1e7157 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:04.308020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdf0dc47-e045-44b1-a8e8-381ee4fe0740 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:04.309115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdf0dc47-e045-44b1-a8e8-381ee4fe0740 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:04.310183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdf0dc47-e045-44b1-a8e8-381ee4fe0740 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:04.311463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdf0dc47-e045-44b1-a8e8-381ee4fe0740 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:04.312148 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdf0dc47-e045-44b1-a8e8-381ee4fe0740 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:04.313157 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdf0dc47-e045-44b1-a8e8-381ee4fe0740 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:04.314635 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3a2dd096-4ffb-4750-82b2-45e29c1e7157 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1475 microversion: 2.1 time: 1.070610 Oct 05 02:43:04.321276 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1747/3513] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:03 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1475 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:04.497959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cdf0dc47-e045-44b1-a8e8-381ee4fe0740 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:04.515784 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cdf0dc47-e045-44b1-a8e8-381ee4fe0740 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:04.519979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cdf0dc47-e045-44b1-a8e8-381ee4fe0740 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:04.529058 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cdf0dc47-e045-44b1-a8e8-381ee4fe0740 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1555 microversion: 2.91 time: 0.268435 Oct 05 02:43:04.530360 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1767/3514] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:04 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1555 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:43:04.816963 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a8e94bfc-1313-430b-adb7-1f4fd1d03435 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:04.822212 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a8e94bfc-1313-430b-adb7-1f4fd1d03435 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:04.824511 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a8e94bfc-1313-430b-adb7-1f4fd1d03435 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Searching by: {'deleted': False, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7'} {{(pid=122319) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:43:04.832348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8e94bfc-1313-430b-adb7-1f4fd1d03435 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:04.833155 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8e94bfc-1313-430b-adb7-1f4fd1d03435 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:04.834374 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8e94bfc-1313-430b-adb7-1f4fd1d03435 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:04.835504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8e94bfc-1313-430b-adb7-1f4fd1d03435 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:04.836150 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8e94bfc-1313-430b-adb7-1f4fd1d03435 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:04.836760 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8e94bfc-1313-430b-adb7-1f4fd1d03435 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:04.877977 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.multi_cell_list [None req-a8e94bfc-1313-430b-adb7-1f4fd1d03435 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122319) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:43:04.958839 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a8e94bfc-1313-430b-adb7-1f4fd1d03435 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.146992 Oct 05 02:43:04.960495 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1748/3515] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 5 02:43:04 2022] GET /compute/v2.1/servers => generated 343 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:43:04.976157 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-af72d87b-21b0-4e54-aee8-ea97546906d0 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:04.984573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-af72d87b-21b0-4e54-aee8-ea97546906d0 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:04.986727 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-af72d87b-21b0-4e54-aee8-ea97546906d0 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Searching by: {'deleted': False, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7'} {{(pid=122320) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:43:04.997774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af72d87b-21b0-4e54-aee8-ea97546906d0 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:04.998994 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af72d87b-21b0-4e54-aee8-ea97546906d0 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:04.999690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af72d87b-21b0-4e54-aee8-ea97546906d0 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:05.000747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af72d87b-21b0-4e54-aee8-ea97546906d0 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:05.003102 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af72d87b-21b0-4e54-aee8-ea97546906d0 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:05.004119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af72d87b-21b0-4e54-aee8-ea97546906d0 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:05.039570 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.multi_cell_list [None req-af72d87b-21b0-4e54-aee8-ea97546906d0 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:43:05.162828 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-af72d87b-21b0-4e54-aee8-ea97546906d0 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:05.190011 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af72d87b-21b0-4e54-aee8-ea97546906d0 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:05.191461 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af72d87b-21b0-4e54-aee8-ea97546906d0 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:05.192207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af72d87b-21b0-4e54-aee8-ea97546906d0 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:05.282954 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c2000e44-8b0d-4d0b-b837-b7f0fbc61c5a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:05.283776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c2000e44-8b0d-4d0b-b837-b7f0fbc61c5a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:05.296147 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2000e44-8b0d-4d0b-b837-b7f0fbc61c5a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:05.297046 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2000e44-8b0d-4d0b-b837-b7f0fbc61c5a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:05.298392 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2000e44-8b0d-4d0b-b837-b7f0fbc61c5a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:05.305737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2000e44-8b0d-4d0b-b837-b7f0fbc61c5a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:05.306316 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2000e44-8b0d-4d0b-b837-b7f0fbc61c5a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:05.307612 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2000e44-8b0d-4d0b-b837-b7f0fbc61c5a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:06.014293 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-af72d87b-21b0-4e54-aee8-ea97546906d0 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 1601 microversion: 2.1 time: 1.044079 Oct 05 02:43:06.015308 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1768/3516] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:43:04 2022] GET /compute/v2.1/servers/detail => generated 1601 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:06.021104 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3bee083a-7506-4551-91d3-db8c81f81926 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:06.021733 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3bee083a-7506-4551-91d3-db8c81f81926 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:06.039825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3bee083a-7506-4551-91d3-db8c81f81926 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:06.044846 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3bee083a-7506-4551-91d3-db8c81f81926 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:06.048581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3bee083a-7506-4551-91d3-db8c81f81926 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:06.051466 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3bee083a-7506-4551-91d3-db8c81f81926 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:06.054356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3bee083a-7506-4551-91d3-db8c81f81926 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:06.055078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3bee083a-7506-4551-91d3-db8c81f81926 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:06.070574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c2000e44-8b0d-4d0b-b837-b7f0fbc61c5a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:06.084226 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c2000e44-8b0d-4d0b-b837-b7f0fbc61c5a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1521 microversion: 2.1 time: 0.805920 Oct 05 02:43:06.087081 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1749/3517] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:05 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1521 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:06.105345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2cddd966-da81-476d-a39d-f9f9449a8c23 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:06.106298 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2cddd966-da81-476d-a39d-f9f9449a8c23 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:06.113170 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2cddd966-da81-476d-a39d-f9f9449a8c23 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:06.114218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2cddd966-da81-476d-a39d-f9f9449a8c23 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:06.115635 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2cddd966-da81-476d-a39d-f9f9449a8c23 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:06.117988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2cddd966-da81-476d-a39d-f9f9449a8c23 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:06.118889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2cddd966-da81-476d-a39d-f9f9449a8c23 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:06.119840 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2cddd966-da81-476d-a39d-f9f9449a8c23 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:06.123516 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:06.422905 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2cddd966-da81-476d-a39d-f9f9449a8c23 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:06.433285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2cddd966-da81-476d-a39d-f9f9449a8c23 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:06.446231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2cddd966-da81-476d-a39d-f9f9449a8c23 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:06.461031 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2cddd966-da81-476d-a39d-f9f9449a8c23 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1555 microversion: 2.91 time: 0.369869 Oct 05 02:43:06.462877 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1750/3518] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:06 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1555 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:43:06.478029 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-514d04b5-ae0f-495c-af72-bedcfebf7799 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:06.503676 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-514d04b5-ae0f-495c-af72-bedcfebf7799 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034547 Oct 05 02:43:06.506300 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1751/3519] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 5 02:43:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:43:06.703082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3bee083a-7506-4551-91d3-db8c81f81926 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:06.723615 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3bee083a-7506-4551-91d3-db8c81f81926 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1475 microversion: 2.1 time: 0.707090 Oct 05 02:43:06.729264 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1769/3520] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:06 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1475 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:06.811325 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-067163ab-5a02-4303-8255-e8b9c97d0850 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:06.811847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-067163ab-5a02-4303-8255-e8b9c97d0850 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:06.825524 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-067163ab-5a02-4303-8255-e8b9c97d0850 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:06.826745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-067163ab-5a02-4303-8255-e8b9c97d0850 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:06.828333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-067163ab-5a02-4303-8255-e8b9c97d0850 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:06.829630 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-067163ab-5a02-4303-8255-e8b9c97d0850 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:06.831602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-067163ab-5a02-4303-8255-e8b9c97d0850 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:06.832433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-067163ab-5a02-4303-8255-e8b9c97d0850 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:06.948683 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-067163ab-5a02-4303-8255-e8b9c97d0850 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:43:07.121174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2649229e-78d4-4aeb-ba33-1a3b72678cc1 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:07.124523 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2649229e-78d4-4aeb-ba33-1a3b72678cc1 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:07.163632 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2649229e-78d4-4aeb-ba33-1a3b72678cc1 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:07.166048 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2649229e-78d4-4aeb-ba33-1a3b72678cc1 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:07.169285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2649229e-78d4-4aeb-ba33-1a3b72678cc1 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:07.170397 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-067163ab-5a02-4303-8255-e8b9c97d0850 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 204 len: 0 microversion: 2.1 time: 0.372355 Oct 05 02:43:07.171826 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1752/3521] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:43:06 2022] DELETE /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:43:07.173357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2649229e-78d4-4aeb-ba33-1a3b72678cc1 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:07.175507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2649229e-78d4-4aeb-ba33-1a3b72678cc1 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:07.176329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2649229e-78d4-4aeb-ba33-1a3b72678cc1 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:07.180140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3beef9df-1114-4810-bb51-a917e1f25a9c tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:07.181472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3beef9df-1114-4810-bb51-a917e1f25a9c tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:07.200554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3beef9df-1114-4810-bb51-a917e1f25a9c tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:07.204496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3beef9df-1114-4810-bb51-a917e1f25a9c tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:07.208149 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3beef9df-1114-4810-bb51-a917e1f25a9c tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:07.208981 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3beef9df-1114-4810-bb51-a917e1f25a9c tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:07.209478 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3beef9df-1114-4810-bb51-a917e1f25a9c tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:07.219313 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3beef9df-1114-4810-bb51-a917e1f25a9c tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:07.702352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3beef9df-1114-4810-bb51-a917e1f25a9c tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:07.719070 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3beef9df-1114-4810-bb51-a917e1f25a9c tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 200 len: 1604 microversion: 2.1 time: 0.541938 Oct 05 02:43:07.721474 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1753/3522] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:07 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 1604 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:43:07.733350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3a34f7ab-6bb6-4c7f-9194-1da43ac1df93 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:07.734042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3a34f7ab-6bb6-4c7f-9194-1da43ac1df93 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:07.769003 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a34f7ab-6bb6-4c7f-9194-1da43ac1df93 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:07.771127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a34f7ab-6bb6-4c7f-9194-1da43ac1df93 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:07.771748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a34f7ab-6bb6-4c7f-9194-1da43ac1df93 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:07.773640 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a34f7ab-6bb6-4c7f-9194-1da43ac1df93 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:07.776448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a34f7ab-6bb6-4c7f-9194-1da43ac1df93 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:07.776938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a34f7ab-6bb6-4c7f-9194-1da43ac1df93 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:07.816618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2649229e-78d4-4aeb-ba33-1a3b72678cc1 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:07.833174 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2649229e-78d4-4aeb-ba33-1a3b72678cc1 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1521 microversion: 2.1 time: 0.727378 Oct 05 02:43:07.851635 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1770/3523] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:07 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1521 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:07.867429 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7a120a01-9d3a-4f1b-99a5-9a1b0c42a75b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:07.868842 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7a120a01-9d3a-4f1b-99a5-9a1b0c42a75b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:07.901988 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a120a01-9d3a-4f1b-99a5-9a1b0c42a75b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:07.902495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a120a01-9d3a-4f1b-99a5-9a1b0c42a75b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:07.902919 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a120a01-9d3a-4f1b-99a5-9a1b0c42a75b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:07.903626 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a120a01-9d3a-4f1b-99a5-9a1b0c42a75b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:07.904077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a120a01-9d3a-4f1b-99a5-9a1b0c42a75b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:07.904495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a120a01-9d3a-4f1b-99a5-9a1b0c42a75b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:07.999457 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3a34f7ab-6bb6-4c7f-9194-1da43ac1df93 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:08.016111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3a34f7ab-6bb6-4c7f-9194-1da43ac1df93 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:08.019748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3a34f7ab-6bb6-4c7f-9194-1da43ac1df93 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:08.030456 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3a34f7ab-6bb6-4c7f-9194-1da43ac1df93 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1555 microversion: 2.91 time: 0.305129 Oct 05 02:43:08.031628 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1754/3524] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:07 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1555 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:43:08.037575 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-4c1219af-52c0-4a6d-8226-fe0e9c40cc2c req-8a82b2bf-a987-4960-a95b-6131e434d76a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e1df96-3094-46e9-a96a-adb0aa39d976", "name": "network-vif-plugged", "status": "completed", "tag": "1de9a92c-6fa6-47d3-96ae-a2dd7481ec08"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:43:08.051417 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4c1219af-52c0-4a6d-8226-fe0e9c40cc2c req-8a82b2bf-a987-4960-a95b-6131e434d76a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:08.052037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4c1219af-52c0-4a6d-8226-fe0e9c40cc2c req-8a82b2bf-a987-4960-a95b-6131e434d76a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:08.053011 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4c1219af-52c0-4a6d-8226-fe0e9c40cc2c req-8a82b2bf-a987-4960-a95b-6131e434d76a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:08.072702 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-4c1219af-52c0-4a6d-8226-fe0e9c40cc2c req-8a82b2bf-a987-4960-a95b-6131e434d76a service nova] Creating event network-vif-plugged:1de9a92c-6fa6-47d3-96ae-a2dd7481ec08 for instance 91e1df96-3094-46e9-a96a-adb0aa39d976 on n-h2-858272-3 Oct 05 02:43:08.081850 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-4c1219af-52c0-4a6d-8226-fe0e9c40cc2c req-8a82b2bf-a987-4960-a95b-6131e434d76a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048475 Oct 05 02:43:08.083116 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1755/3525] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:43:08.290224 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7a120a01-9d3a-4f1b-99a5-9a1b0c42a75b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:08.298076 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7a120a01-9d3a-4f1b-99a5-9a1b0c42a75b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1475 microversion: 2.1 time: 0.443967 Oct 05 02:43:08.302455 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1771/3526] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:07 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1475 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:08.753989 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9cdf854d-8b36-4ec4-b2d4-9a001a3ec8a3 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:08.754658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9cdf854d-8b36-4ec4-b2d4-9a001a3ec8a3 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:08.780723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cdf854d-8b36-4ec4-b2d4-9a001a3ec8a3 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:08.784632 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cdf854d-8b36-4ec4-b2d4-9a001a3ec8a3 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:08.785383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cdf854d-8b36-4ec4-b2d4-9a001a3ec8a3 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:08.788111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cdf854d-8b36-4ec4-b2d4-9a001a3ec8a3 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:08.788588 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cdf854d-8b36-4ec4-b2d4-9a001a3ec8a3 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:08.797636 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cdf854d-8b36-4ec4-b2d4-9a001a3ec8a3 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:08.859155 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a2aeb6de-9c7c-4b16-bc45-a64b4f34d8ef tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:08.859779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a2aeb6de-9c7c-4b16-bc45-a64b4f34d8ef tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:08.873849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2aeb6de-9c7c-4b16-bc45-a64b4f34d8ef tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:08.874297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2aeb6de-9c7c-4b16-bc45-a64b4f34d8ef tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:08.877247 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2aeb6de-9c7c-4b16-bc45-a64b4f34d8ef tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:08.882789 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2aeb6de-9c7c-4b16-bc45-a64b4f34d8ef tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:08.883755 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2aeb6de-9c7c-4b16-bc45-a64b4f34d8ef tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:08.884419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2aeb6de-9c7c-4b16-bc45-a64b4f34d8ef tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:09.255562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9cdf854d-8b36-4ec4-b2d4-9a001a3ec8a3 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:09.270475 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9cdf854d-8b36-4ec4-b2d4-9a001a3ec8a3 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 200 len: 1604 microversion: 2.1 time: 0.524035 Oct 05 02:43:09.273438 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1756/3527] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:08 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 1604 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:09.285097 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2762a18f-c2bb-4506-b8d6-a1927875409a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:09.289323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2762a18f-c2bb-4506-b8d6-a1927875409a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:09.309587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2762a18f-c2bb-4506-b8d6-a1927875409a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:09.313032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2762a18f-c2bb-4506-b8d6-a1927875409a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:09.313725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2762a18f-c2bb-4506-b8d6-a1927875409a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:09.316508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2762a18f-c2bb-4506-b8d6-a1927875409a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:09.317439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2762a18f-c2bb-4506-b8d6-a1927875409a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:09.319681 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2762a18f-c2bb-4506-b8d6-a1927875409a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:09.327568 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a2aeb6de-9c7c-4b16-bc45-a64b4f34d8ef tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:09.340508 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a2aeb6de-9c7c-4b16-bc45-a64b4f34d8ef tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1521 microversion: 2.1 time: 0.480947 Oct 05 02:43:09.341118 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1772/3528] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:08 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1521 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:09.363518 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5ff84203-a955-44d1-8c8b-2d508ba6e3a5 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:09.371765 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5ff84203-a955-44d1-8c8b-2d508ba6e3a5 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:09.393827 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5ff84203-a955-44d1-8c8b-2d508ba6e3a5 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:09.393991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5ff84203-a955-44d1-8c8b-2d508ba6e3a5 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:09.394438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5ff84203-a955-44d1-8c8b-2d508ba6e3a5 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:09.404993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5ff84203-a955-44d1-8c8b-2d508ba6e3a5 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:09.404993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5ff84203-a955-44d1-8c8b-2d508ba6e3a5 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:09.406599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5ff84203-a955-44d1-8c8b-2d508ba6e3a5 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:09.495452 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:09.575612 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2762a18f-c2bb-4506-b8d6-a1927875409a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:09.584599 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2762a18f-c2bb-4506-b8d6-a1927875409a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:09.589303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2762a18f-c2bb-4506-b8d6-a1927875409a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:09.602743 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2762a18f-c2bb-4506-b8d6-a1927875409a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1555 microversion: 2.91 time: 0.327034 Oct 05 02:43:09.608612 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1757/3529] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:09 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1555 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:43:09.619344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0689b6b3-561d-42c1-b373-cefb6f47042f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:09.620289 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0689b6b3-561d-42c1-b373-cefb6f47042f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:09.633759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0689b6b3-561d-42c1-b373-cefb6f47042f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:09.635759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0689b6b3-561d-42c1-b373-cefb6f47042f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:09.638521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0689b6b3-561d-42c1-b373-cefb6f47042f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:09.640366 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0689b6b3-561d-42c1-b373-cefb6f47042f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:09.642585 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0689b6b3-561d-42c1-b373-cefb6f47042f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:09.643315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0689b6b3-561d-42c1-b373-cefb6f47042f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:10.312364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5ff84203-a955-44d1-8c8b-2d508ba6e3a5 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:10.330208 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5ff84203-a955-44d1-8c8b-2d508ba6e3a5 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.984853 Oct 05 02:43:10.332256 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1773/3530] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:09 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:10.359045 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7feae573-e733-483f-b87c-d7e5b9e16f3d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:10.360279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7feae573-e733-483f-b87c-d7e5b9e16f3d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:10.387815 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7feae573-e733-483f-b87c-d7e5b9e16f3d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:10.388636 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7feae573-e733-483f-b87c-d7e5b9e16f3d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:10.389167 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7feae573-e733-483f-b87c-d7e5b9e16f3d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:10.395047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7feae573-e733-483f-b87c-d7e5b9e16f3d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:10.397411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7feae573-e733-483f-b87c-d7e5b9e16f3d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:10.399066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7feae573-e733-483f-b87c-d7e5b9e16f3d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:10.477546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0689b6b3-561d-42c1-b373-cefb6f47042f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:10.487491 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0689b6b3-561d-42c1-b373-cefb6f47042f tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1475 microversion: 2.1 time: 0.876883 Oct 05 02:43:10.506173 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1758/3531] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:09 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1475 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:10.524465 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7f645319-8764-4a60-817c-5cf30e0fd9e9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:10.527836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7f645319-8764-4a60-817c-5cf30e0fd9e9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:10.550838 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f645319-8764-4a60-817c-5cf30e0fd9e9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:10.551313 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f645319-8764-4a60-817c-5cf30e0fd9e9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:10.551755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f645319-8764-4a60-817c-5cf30e0fd9e9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:10.552465 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f645319-8764-4a60-817c-5cf30e0fd9e9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:10.569458 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f645319-8764-4a60-817c-5cf30e0fd9e9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:10.572344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f645319-8764-4a60-817c-5cf30e0fd9e9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:10.585830 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7feae573-e733-483f-b87c-d7e5b9e16f3d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:10.595136 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7feae573-e733-483f-b87c-d7e5b9e16f3d tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 200 len: 1537 microversion: 2.1 time: 0.260815 Oct 05 02:43:10.605724 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1774/3532] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:10 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 1537 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:10.622801 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3612a3ef-14f6-4784-84fd-76ef8490dcdc tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:10.626119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3612a3ef-14f6-4784-84fd-76ef8490dcdc tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:10.638483 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3612a3ef-14f6-4784-84fd-76ef8490dcdc tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:10.640703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3612a3ef-14f6-4784-84fd-76ef8490dcdc tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:10.641382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3612a3ef-14f6-4784-84fd-76ef8490dcdc tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:10.644561 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3612a3ef-14f6-4784-84fd-76ef8490dcdc tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:10.645299 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3612a3ef-14f6-4784-84fd-76ef8490dcdc tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:10.649092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3612a3ef-14f6-4784-84fd-76ef8490dcdc tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:11.134967 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3612a3ef-14f6-4784-84fd-76ef8490dcdc tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:11.151633 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3612a3ef-14f6-4784-84fd-76ef8490dcdc tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1506 microversion: 2.1 time: 0.537567 Oct 05 02:43:11.160959 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1775/3533] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:10 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1506 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:11.176395 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e3868825-1e52-4e49-8182-1eced3224ec0 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:11.177054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e3868825-1e52-4e49-8182-1eced3224ec0 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:11.199492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e3868825-1e52-4e49-8182-1eced3224ec0 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:11.207450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e3868825-1e52-4e49-8182-1eced3224ec0 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:11.217657 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e3868825-1e52-4e49-8182-1eced3224ec0 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:11.219614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e3868825-1e52-4e49-8182-1eced3224ec0 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:11.224101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e3868825-1e52-4e49-8182-1eced3224ec0 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:11.225548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e3868825-1e52-4e49-8182-1eced3224ec0 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:11.350601 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7f645319-8764-4a60-817c-5cf30e0fd9e9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:11.366940 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7f645319-8764-4a60-817c-5cf30e0fd9e9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.858902 Oct 05 02:43:11.367508 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1759/3534] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:10 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:11.382583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2d502d1f-4cd4-48c8-92e9-dc813fbf3013 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:11.382583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2d502d1f-4cd4-48c8-92e9-dc813fbf3013 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:11.416924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2d502d1f-4cd4-48c8-92e9-dc813fbf3013 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:11.417448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2d502d1f-4cd4-48c8-92e9-dc813fbf3013 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:11.417893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2d502d1f-4cd4-48c8-92e9-dc813fbf3013 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:11.418624 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2d502d1f-4cd4-48c8-92e9-dc813fbf3013 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:11.419086 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2d502d1f-4cd4-48c8-92e9-dc813fbf3013 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:11.419520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2d502d1f-4cd4-48c8-92e9-dc813fbf3013 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:11.547320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e3868825-1e52-4e49-8182-1eced3224ec0 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:11.558110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e3868825-1e52-4e49-8182-1eced3224ec0 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:11.559580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e3868825-1e52-4e49-8182-1eced3224ec0 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:11.565755 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e3868825-1e52-4e49-8182-1eced3224ec0 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1555 microversion: 2.91 time: 0.403388 Oct 05 02:43:11.590985 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1776/3535] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:11 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1555 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:43:11.596448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-f944d2e6-849c-4635-9d3e-4c0a326b8537 req-f8fa2473-88dd-4433-a2d8-7b4e0581d7ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d57f876f-018d-4500-8b46-a0ad8983fff5", "name": "network-vif-deleted", "tag": "bed4013f-097d-4219-99f5-4d1b78fcda5c"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:43:11.626386 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f944d2e6-849c-4635-9d3e-4c0a326b8537 req-f8fa2473-88dd-4433-a2d8-7b4e0581d7ed service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:11.627176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f944d2e6-849c-4635-9d3e-4c0a326b8537 req-f8fa2473-88dd-4433-a2d8-7b4e0581d7ed service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:11.627806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f944d2e6-849c-4635-9d3e-4c0a326b8537 req-f8fa2473-88dd-4433-a2d8-7b4e0581d7ed service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:11.639922 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-f944d2e6-849c-4635-9d3e-4c0a326b8537 req-f8fa2473-88dd-4433-a2d8-7b4e0581d7ed service nova] Creating event network-vif-deleted:bed4013f-097d-4219-99f5-4d1b78fcda5c for instance d57f876f-018d-4500-8b46-a0ad8983fff5 on n-h1-858272-3 Oct 05 02:43:11.659936 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-f944d2e6-849c-4635-9d3e-4c0a326b8537 req-f8fa2473-88dd-4433-a2d8-7b4e0581d7ed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067555 Oct 05 02:43:11.661156 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1777/3536] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:43:11.676946 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0815c9c3-2663-4e3a-99ab-dfa9f998fb3f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:11.678127 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0815c9c3-2663-4e3a-99ab-dfa9f998fb3f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:11.697022 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0815c9c3-2663-4e3a-99ab-dfa9f998fb3f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:11.697822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0815c9c3-2663-4e3a-99ab-dfa9f998fb3f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:11.698454 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0815c9c3-2663-4e3a-99ab-dfa9f998fb3f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:11.699346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0815c9c3-2663-4e3a-99ab-dfa9f998fb3f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:11.699999 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0815c9c3-2663-4e3a-99ab-dfa9f998fb3f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:11.700605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0815c9c3-2663-4e3a-99ab-dfa9f998fb3f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:12.044844 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0815c9c3-2663-4e3a-99ab-dfa9f998fb3f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:12.059044 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0815c9c3-2663-4e3a-99ab-dfa9f998fb3f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.396150 Oct 05 02:43:12.060091 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1778/3537] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:11 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:12.077601 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2d502d1f-4cd4-48c8-92e9-dc813fbf3013 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:12.089826 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2d502d1f-4cd4-48c8-92e9-dc813fbf3013 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 200 len: 1506 microversion: 2.1 time: 0.721273 Oct 05 02:43:12.090492 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1760/3538] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:11 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 1506 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:12.107664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7cd93f02-937f-44ff-b4b0-72607ddaee66 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:12.107664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7cd93f02-937f-44ff-b4b0-72607ddaee66 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:12.112976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7e91e348-98aa-43bf-9972-b5b2631ccad6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:12.114141 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7e91e348-98aa-43bf-9972-b5b2631ccad6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:12.115132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7cd93f02-937f-44ff-b4b0-72607ddaee66 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:12.116040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7cd93f02-937f-44ff-b4b0-72607ddaee66 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:12.117425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7cd93f02-937f-44ff-b4b0-72607ddaee66 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:12.118758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7cd93f02-937f-44ff-b4b0-72607ddaee66 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:12.123613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7cd93f02-937f-44ff-b4b0-72607ddaee66 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:12.124263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7cd93f02-937f-44ff-b4b0-72607ddaee66 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:12.125345 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e91e348-98aa-43bf-9972-b5b2631ccad6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:12.125868 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e91e348-98aa-43bf-9972-b5b2631ccad6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:12.126308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e91e348-98aa-43bf-9972-b5b2631ccad6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:12.128111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e91e348-98aa-43bf-9972-b5b2631ccad6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:12.130803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e91e348-98aa-43bf-9972-b5b2631ccad6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:12.131258 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e91e348-98aa-43bf-9972-b5b2631ccad6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:12.320356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7cd93f02-937f-44ff-b4b0-72607ddaee66 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:12.340434 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7cd93f02-937f-44ff-b4b0-72607ddaee66 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 200 len: 1249 microversion: 2.1 time: 0.248885 Oct 05 02:43:12.343448 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1761/3539] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:12 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 1249 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:12.371499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-268318e2-d09b-4803-abc3-22f349c3651c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-953227412"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:43:12.382738 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-268318e2-d09b-4803-abc3-22f349c3651c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:12.416727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-268318e2-d09b-4803-abc3-22f349c3651c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:12.420582 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-268318e2-d09b-4803-abc3-22f349c3651c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:12.423063 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-268318e2-d09b-4803-abc3-22f349c3651c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:12.431790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-268318e2-d09b-4803-abc3-22f349c3651c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:12.432731 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-268318e2-d09b-4803-abc3-22f349c3651c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:12.433458 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-268318e2-d09b-4803-abc3-22f349c3651c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:12.475779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7e91e348-98aa-43bf-9972-b5b2631ccad6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:12.495181 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7e91e348-98aa-43bf-9972-b5b2631ccad6 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1475 microversion: 2.1 time: 0.404170 Oct 05 02:43:12.496046 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1779/3540] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:12 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1475 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:12.530052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-98f1862a-b667-49c8-8636-597516431622 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:12.537537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-98f1862a-b667-49c8-8636-597516431622 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:12.570463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98f1862a-b667-49c8-8636-597516431622 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:12.571167 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98f1862a-b667-49c8-8636-597516431622 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:12.571431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98f1862a-b667-49c8-8636-597516431622 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:12.572134 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98f1862a-b667-49c8-8636-597516431622 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:12.572583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98f1862a-b667-49c8-8636-597516431622 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:12.582768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98f1862a-b667-49c8-8636-597516431622 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:12.666881 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-98f1862a-b667-49c8-8636-597516431622 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:43:12.923453 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-98f1862a-b667-49c8-8636-597516431622 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "DELETE /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 204 len: 0 microversion: 2.1 time: 0.423931 Oct 05 02:43:12.924001 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1780/3541] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:43:12 2022] DELETE /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:43:12.929561 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-22736016-a26e-4016-81e1-fe6c7393cb71 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:12.934029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-22736016-a26e-4016-81e1-fe6c7393cb71 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:12.959307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22736016-a26e-4016-81e1-fe6c7393cb71 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:12.962582 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22736016-a26e-4016-81e1-fe6c7393cb71 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:12.963082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22736016-a26e-4016-81e1-fe6c7393cb71 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:12.972400 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22736016-a26e-4016-81e1-fe6c7393cb71 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:12.972880 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22736016-a26e-4016-81e1-fe6c7393cb71 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:12.973714 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22736016-a26e-4016-81e1-fe6c7393cb71 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:13.010813 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-268318e2-d09b-4803-abc3-22f349c3651c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action" status: 202 len: 0 microversion: 2.1 time: 0.663749 Oct 05 02:43:13.011572 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1762/3542] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:43:12 2022] POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action => generated 0 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 05 02:43:13.278439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-27814d30-802f-4ec4-872e-fa33a7dd4267 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-316100831", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "8d324f6f-cca2-40de-b54e-b428e9535a8f"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:43:13.381564 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-22736016-a26e-4016-81e1-fe6c7393cb71 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:13.390257 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-27814d30-802f-4ec4-872e-fa33a7dd4267 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] validate_networks() for [('8d324f6f-cca2-40de-b54e-b428e9535a8f', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:43:13.395193 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-22736016-a26e-4016-81e1-fe6c7393cb71 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:13.401555 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-22736016-a26e-4016-81e1-fe6c7393cb71 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:13.418938 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-22736016-a26e-4016-81e1-fe6c7393cb71 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1555 microversion: 2.91 time: 0.493267 Oct 05 02:43:13.433607 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1781/3543] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:12 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1555 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:43:13.445842 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7a3ea9cd-2754-4b66-92ed-e1e321786b50 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:13.454169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7a3ea9cd-2754-4b66-92ed-e1e321786b50 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:13.471361 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a3ea9cd-2754-4b66-92ed-e1e321786b50 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:13.472028 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a3ea9cd-2754-4b66-92ed-e1e321786b50 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:13.472479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a3ea9cd-2754-4b66-92ed-e1e321786b50 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:13.473229 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a3ea9cd-2754-4b66-92ed-e1e321786b50 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:13.473697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a3ea9cd-2754-4b66-92ed-e1e321786b50 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:13.474128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a3ea9cd-2754-4b66-92ed-e1e321786b50 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:13.630944 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7a3ea9cd-2754-4b66-92ed-e1e321786b50 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:13.641777 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7a3ea9cd-2754-4b66-92ed-e1e321786b50 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 200 len: 1249 microversion: 2.1 time: 0.206827 Oct 05 02:43:13.661598 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1782/3544] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:13 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 1249 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:13.682732 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b25cc84b-76e6-4194-81bc-de4b201ef2c8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:13.683661 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b25cc84b-76e6-4194-81bc-de4b201ef2c8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:13.690143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b25cc84b-76e6-4194-81bc-de4b201ef2c8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:13.690902 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b25cc84b-76e6-4194-81bc-de4b201ef2c8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:13.695319 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b25cc84b-76e6-4194-81bc-de4b201ef2c8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:13.696278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b25cc84b-76e6-4194-81bc-de4b201ef2c8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:13.703167 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b25cc84b-76e6-4194-81bc-de4b201ef2c8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:13.703800 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b25cc84b-76e6-4194-81bc-de4b201ef2c8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:14.706466 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b25cc84b-76e6-4194-81bc-de4b201ef2c8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:14.716946 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b25cc84b-76e6-4194-81bc-de4b201ef2c8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1475 microversion: 2.1 time: 1.054212 Oct 05 02:43:14.717820 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1783/3545] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:13 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1475 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:14.724448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a02aadf3-d68c-40b2-a1cf-8e59d5540d0f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:14.725425 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a02aadf3-d68c-40b2-a1cf-8e59d5540d0f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:14.733034 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a02aadf3-d68c-40b2-a1cf-8e59d5540d0f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:14.734007 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a02aadf3-d68c-40b2-a1cf-8e59d5540d0f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:14.734879 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a02aadf3-d68c-40b2-a1cf-8e59d5540d0f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:14.735915 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a02aadf3-d68c-40b2-a1cf-8e59d5540d0f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:14.737303 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a02aadf3-d68c-40b2-a1cf-8e59d5540d0f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:14.737967 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a02aadf3-d68c-40b2-a1cf-8e59d5540d0f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:14.851979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:14.905161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a02aadf3-d68c-40b2-a1cf-8e59d5540d0f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:14.923832 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a02aadf3-d68c-40b2-a1cf-8e59d5540d0f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:14.928031 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a02aadf3-d68c-40b2-a1cf-8e59d5540d0f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:14.946522 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a02aadf3-d68c-40b2-a1cf-8e59d5540d0f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1555 microversion: 2.91 time: 0.227342 Oct 05 02:43:14.952881 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1784/3546] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:14 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1555 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:43:14.973177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e84e2df1-1c9d-4c55-aadf-0740d64da194 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:14.973804 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e84e2df1-1c9d-4c55-aadf-0740d64da194 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:15.001082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e84e2df1-1c9d-4c55-aadf-0740d64da194 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:15.002304 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e84e2df1-1c9d-4c55-aadf-0740d64da194 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:15.002878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e84e2df1-1c9d-4c55-aadf-0740d64da194 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:15.005322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e84e2df1-1c9d-4c55-aadf-0740d64da194 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:15.005906 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e84e2df1-1c9d-4c55-aadf-0740d64da194 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:15.006418 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e84e2df1-1c9d-4c55-aadf-0740d64da194 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:15.106255 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:15.166333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:15.282598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e84e2df1-1c9d-4c55-aadf-0740d64da194 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:15.293678 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e84e2df1-1c9d-4c55-aadf-0740d64da194 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 200 len: 1249 microversion: 2.1 time: 0.336884 Oct 05 02:43:15.302872 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1785/3547] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:14 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 1249 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:15.380963 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-27814d30-802f-4ec4-872e-fa33a7dd4267 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:43:15.381780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-27814d30-802f-4ec4-872e-fa33a7dd4267 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:43:15.382330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-27814d30-802f-4ec4-872e-fa33a7dd4267 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:43:15.382983 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-27814d30-802f-4ec4-872e-fa33a7dd4267 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:43:15.383736 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-27814d30-802f-4ec4-872e-fa33a7dd4267 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:43:15.407240 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27814d30-802f-4ec4-872e-fa33a7dd4267 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:15.411571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27814d30-802f-4ec4-872e-fa33a7dd4267 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:15.413158 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27814d30-802f-4ec4-872e-fa33a7dd4267 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:15.415283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27814d30-802f-4ec4-872e-fa33a7dd4267 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:15.416444 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27814d30-802f-4ec4-872e-fa33a7dd4267 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:15.418600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27814d30-802f-4ec4-872e-fa33a7dd4267 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:15.476034 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-27814d30-802f-4ec4-872e-fa33a7dd4267 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Getting quotas for project 58c3c2b9910b4ba48a52cb1e3f1ef254. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:43:15.513955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-27814d30-802f-4ec4-872e-fa33a7dd4267 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Getting quotas for user 9211cfded73b4747b3cb63bcfb3c3ff8 and project 58c3c2b9910b4ba48a52cb1e3f1ef254. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:43:15.576201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-27814d30-802f-4ec4-872e-fa33a7dd4267 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:43:15.588658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-27814d30-802f-4ec4-872e-fa33a7dd4267 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 8b408fc3-0c45-490f-8c42-df0ce8e9f591] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:43:15.750498 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-27814d30-802f-4ec4-872e-fa33a7dd4267 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.474903 Oct 05 02:43:15.752960 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ec9d2083-d65e-4577-bbb4-1ae537669f19 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:15.754412 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1763/3548] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:43:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 02:43:15.763009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ec9d2083-d65e-4577-bbb4-1ae537669f19 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:15.768327 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e7359548-322e-444a-8fc0-42955da295a6 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:15.771400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e7359548-322e-444a-8fc0-42955da295a6 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 8b408fc3-0c45-490f-8c42-df0ce8e9f591] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:15.782022 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec9d2083-d65e-4577-bbb4-1ae537669f19 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:15.788867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec9d2083-d65e-4577-bbb4-1ae537669f19 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:15.790056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec9d2083-d65e-4577-bbb4-1ae537669f19 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:15.793980 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec9d2083-d65e-4577-bbb4-1ae537669f19 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:15.794580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec9d2083-d65e-4577-bbb4-1ae537669f19 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:15.800962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec9d2083-d65e-4577-bbb4-1ae537669f19 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:15.930136 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e7359548-322e-444a-8fc0-42955da295a6 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:15.943424 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e7359548-322e-444a-8fc0-42955da295a6 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591" status: 200 len: 1217 microversion: 2.1 time: 0.179516 Oct 05 02:43:15.946425 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1764/3549] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:15 2022] GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591 => generated 1217 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:43:15.984394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c4d743bd-237f-4dbb-9aaa-c88dc7e02f73 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:15.985141 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c4d743bd-237f-4dbb-9aaa-c88dc7e02f73 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:16.003821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4d743bd-237f-4dbb-9aaa-c88dc7e02f73 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:16.004440 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4d743bd-237f-4dbb-9aaa-c88dc7e02f73 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:16.004892 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4d743bd-237f-4dbb-9aaa-c88dc7e02f73 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:16.008602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4d743bd-237f-4dbb-9aaa-c88dc7e02f73 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:16.009542 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4d743bd-237f-4dbb-9aaa-c88dc7e02f73 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:16.012211 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4d743bd-237f-4dbb-9aaa-c88dc7e02f73 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:16.580514 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ec9d2083-d65e-4577-bbb4-1ae537669f19 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:16.594403 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ec9d2083-d65e-4577-bbb4-1ae537669f19 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1475 microversion: 2.1 time: 0.847689 Oct 05 02:43:16.602949 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1786/3550] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:15 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1475 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:16.611596 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b18a3c4a-9999-459b-8ec5-50d46ea4d812 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:16.624269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b18a3c4a-9999-459b-8ec5-50d46ea4d812 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:16.628861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c4d743bd-237f-4dbb-9aaa-c88dc7e02f73 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:16.637673 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b18a3c4a-9999-459b-8ec5-50d46ea4d812 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:16.638784 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b18a3c4a-9999-459b-8ec5-50d46ea4d812 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:16.639467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b18a3c4a-9999-459b-8ec5-50d46ea4d812 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:16.641366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b18a3c4a-9999-459b-8ec5-50d46ea4d812 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:16.642634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b18a3c4a-9999-459b-8ec5-50d46ea4d812 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:16.643305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b18a3c4a-9999-459b-8ec5-50d46ea4d812 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:16.653183 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c4d743bd-237f-4dbb-9aaa-c88dc7e02f73 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:16.668840 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c4d743bd-237f-4dbb-9aaa-c88dc7e02f73 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:16.700801 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c4d743bd-237f-4dbb-9aaa-c88dc7e02f73 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1555 microversion: 2.91 time: 0.718263 Oct 05 02:43:16.701460 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1765/3551] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:15 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1555 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:43:16.751420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-4848a146-392c-45af-9a11-37857d46e5da req-5486d84e-1ffe-4e2f-a7f0-eefc155c7d6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e1df96-3094-46e9-a96a-adb0aa39d976", "name": "network-vif-deleted", "tag": "1de9a92c-6fa6-47d3-96ae-a2dd7481ec08"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:43:16.804715 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4848a146-392c-45af-9a11-37857d46e5da req-5486d84e-1ffe-4e2f-a7f0-eefc155c7d6f service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:16.805239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4848a146-392c-45af-9a11-37857d46e5da req-5486d84e-1ffe-4e2f-a7f0-eefc155c7d6f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:16.805665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4848a146-392c-45af-9a11-37857d46e5da req-5486d84e-1ffe-4e2f-a7f0-eefc155c7d6f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:16.856789 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-4848a146-392c-45af-9a11-37857d46e5da req-5486d84e-1ffe-4e2f-a7f0-eefc155c7d6f service nova] Creating event network-vif-deleted:1de9a92c-6fa6-47d3-96ae-a2dd7481ec08 for instance 91e1df96-3094-46e9-a96a-adb0aa39d976 on n-h2-858272-3 Oct 05 02:43:16.898923 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-4848a146-392c-45af-9a11-37857d46e5da req-5486d84e-1ffe-4e2f-a7f0-eefc155c7d6f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164991 Oct 05 02:43:16.908058 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1766/3552] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:43:16.960093 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b18a3c4a-9999-459b-8ec5-50d46ea4d812 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:16.979006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d1f6d2cf-2322-4ae6-b5bd-481a2b4d0d42 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:16.979718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d1f6d2cf-2322-4ae6-b5bd-481a2b4d0d42 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 8b408fc3-0c45-490f-8c42-df0ce8e9f591] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:16.986690 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b18a3c4a-9999-459b-8ec5-50d46ea4d812 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 200 len: 1249 microversion: 2.1 time: 0.380037 Oct 05 02:43:17.004027 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1787/3553] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:16 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 1249 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:17.268137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d1f6d2cf-2322-4ae6-b5bd-481a2b4d0d42 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:17.286962 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d1f6d2cf-2322-4ae6-b5bd-481a2b4d0d42 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591" status: 200 len: 1217 microversion: 2.1 time: 0.303071 Oct 05 02:43:17.287656 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1767/3554] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:16 2022] GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591 => generated 1217 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:17.627535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7f1ec983-d017-4ff9-af61-546eb0820ec3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:17.628167 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7f1ec983-d017-4ff9-af61-546eb0820ec3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:17.641753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f1ec983-d017-4ff9-af61-546eb0820ec3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:17.642271 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f1ec983-d017-4ff9-af61-546eb0820ec3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:17.644379 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f1ec983-d017-4ff9-af61-546eb0820ec3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:17.645418 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f1ec983-d017-4ff9-af61-546eb0820ec3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:17.646487 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f1ec983-d017-4ff9-af61-546eb0820ec3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:17.670332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f1ec983-d017-4ff9-af61-546eb0820ec3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:17.736949 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3f6212c9-a3e1-4455-8af8-caac40668f2f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:17.738682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3f6212c9-a3e1-4455-8af8-caac40668f2f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:17.757052 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f6212c9-a3e1-4455-8af8-caac40668f2f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:17.757566 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f6212c9-a3e1-4455-8af8-caac40668f2f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:17.765401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f6212c9-a3e1-4455-8af8-caac40668f2f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:17.766547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f6212c9-a3e1-4455-8af8-caac40668f2f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:17.769441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f6212c9-a3e1-4455-8af8-caac40668f2f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:17.771136 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f6212c9-a3e1-4455-8af8-caac40668f2f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:18.015337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3f6212c9-a3e1-4455-8af8-caac40668f2f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:18.018974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:18.052380 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3f6212c9-a3e1-4455-8af8-caac40668f2f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:18.058628 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3f6212c9-a3e1-4455-8af8-caac40668f2f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:18.104106 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3f6212c9-a3e1-4455-8af8-caac40668f2f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1555 microversion: 2.91 time: 0.374450 Oct 05 02:43:18.105524 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1768/3555] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:17 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1555 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:43:18.121657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-703e5a6f-4ab3-4971-b8ef-b916e2e208f4 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:18.130434 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-703e5a6f-4ab3-4971-b8ef-b916e2e208f4 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:18.162346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-703e5a6f-4ab3-4971-b8ef-b916e2e208f4 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:18.170371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-703e5a6f-4ab3-4971-b8ef-b916e2e208f4 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:18.170970 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-703e5a6f-4ab3-4971-b8ef-b916e2e208f4 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:18.172948 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-703e5a6f-4ab3-4971-b8ef-b916e2e208f4 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:18.174171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-703e5a6f-4ab3-4971-b8ef-b916e2e208f4 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:18.177523 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-703e5a6f-4ab3-4971-b8ef-b916e2e208f4 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:18.463003 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7f1ec983-d017-4ff9-af61-546eb0820ec3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:18.470779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:18.473797 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-703e5a6f-4ab3-4971-b8ef-b916e2e208f4 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:18.483710 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7f1ec983-d017-4ff9-af61-546eb0820ec3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1475 microversion: 2.1 time: 0.860075 Oct 05 02:43:18.484990 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-703e5a6f-4ab3-4971-b8ef-b916e2e208f4 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 200 len: 1249 microversion: 2.1 time: 0.372357 Oct 05 02:43:18.485338 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1788/3556] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:17 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1475 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:18.485573 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1769/3557] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:18 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 1249 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:18.506197 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f966bdbd-fd46-40f5-a427-8e60bcb8097c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:18.510813 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f966bdbd-fd46-40f5-a427-8e60bcb8097c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 8b408fc3-0c45-490f-8c42-df0ce8e9f591] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:18.513027 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-76ea4a53-43a0-4052-92ab-65296192726e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:43:18.521955 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-76ea4a53-43a0-4052-92ab-65296192726e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:18.523077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-76ea4a53-43a0-4052-92ab-65296192726e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:18.523748 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-76ea4a53-43a0-4052-92ab-65296192726e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:18.535070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f966bdbd-fd46-40f5-a427-8e60bcb8097c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:18.537958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f966bdbd-fd46-40f5-a427-8e60bcb8097c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:18.538472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f966bdbd-fd46-40f5-a427-8e60bcb8097c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:18.539222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f966bdbd-fd46-40f5-a427-8e60bcb8097c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:18.539693 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f966bdbd-fd46-40f5-a427-8e60bcb8097c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:18.540134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f966bdbd-fd46-40f5-a427-8e60bcb8097c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:18.609654 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-76ea4a53-43a0-4052-92ab-65296192726e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Going to try to stop instance {{(pid=122320) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 05 02:43:18.689891 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f966bdbd-fd46-40f5-a427-8e60bcb8097c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:18.706725 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f966bdbd-fd46-40f5-a427-8e60bcb8097c tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591" status: 200 len: 1269 microversion: 2.1 time: 0.209801 Oct 05 02:43:18.708572 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1770/3558] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:18 2022] GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591 => generated 1269 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:18.736295 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-76ea4a53-43a0-4052-92ab-65296192726e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "POST /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397/action" status: 202 len: 0 microversion: 2.1 time: 0.225307 Oct 05 02:43:18.738581 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1789/3559] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:43:18 2022] POST /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:43:18.750703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3e02fb36-73b8-4488-ae3d-0bd01f458110 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:18.753677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3e02fb36-73b8-4488-ae3d-0bd01f458110 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:18.772176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:18.774235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e02fb36-73b8-4488-ae3d-0bd01f458110 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:18.775008 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e02fb36-73b8-4488-ae3d-0bd01f458110 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:18.775707 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e02fb36-73b8-4488-ae3d-0bd01f458110 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:18.777760 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e02fb36-73b8-4488-ae3d-0bd01f458110 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:18.778578 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e02fb36-73b8-4488-ae3d-0bd01f458110 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:18.779890 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e02fb36-73b8-4488-ae3d-0bd01f458110 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:19.143512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-344b6b8a-39fe-45b9-9576-df4d1d2c442d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:19.144747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-344b6b8a-39fe-45b9-9576-df4d1d2c442d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:19.158980 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-344b6b8a-39fe-45b9-9576-df4d1d2c442d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:19.161945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-344b6b8a-39fe-45b9-9576-df4d1d2c442d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:19.162683 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-344b6b8a-39fe-45b9-9576-df4d1d2c442d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:19.163705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-344b6b8a-39fe-45b9-9576-df4d1d2c442d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:19.165527 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-344b6b8a-39fe-45b9-9576-df4d1d2c442d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:19.167741 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-344b6b8a-39fe-45b9-9576-df4d1d2c442d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:19.339844 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3e02fb36-73b8-4488-ae3d-0bd01f458110 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:19.356156 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3e02fb36-73b8-4488-ae3d-0bd01f458110 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1723 microversion: 2.1 time: 0.614011 Oct 05 02:43:19.371929 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1771/3560] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:18 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1723 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:19.513544 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-74db7d47-4725-4ad3-b5f6-ab2b506feff0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:19.514326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-74db7d47-4725-4ad3-b5f6-ab2b506feff0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:19.538853 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74db7d47-4725-4ad3-b5f6-ab2b506feff0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:19.539396 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74db7d47-4725-4ad3-b5f6-ab2b506feff0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:19.539853 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74db7d47-4725-4ad3-b5f6-ab2b506feff0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:19.553258 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74db7d47-4725-4ad3-b5f6-ab2b506feff0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:19.553951 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74db7d47-4725-4ad3-b5f6-ab2b506feff0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:19.556810 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74db7d47-4725-4ad3-b5f6-ab2b506feff0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:19.772220 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-344b6b8a-39fe-45b9-9576-df4d1d2c442d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:19.792473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-344b6b8a-39fe-45b9-9576-df4d1d2c442d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:19.795285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-344b6b8a-39fe-45b9-9576-df4d1d2c442d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:19.818331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:19.821876 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-344b6b8a-39fe-45b9-9576-df4d1d2c442d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1555 microversion: 2.91 time: 0.683851 Oct 05 02:43:19.825924 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1790/3561] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:19 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1555 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:43:19.840860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-48cfcda1-bf40-4ef1-836e-56a095ad0ffa tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:19.846606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-48cfcda1-bf40-4ef1-836e-56a095ad0ffa tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:19.877789 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48cfcda1-bf40-4ef1-836e-56a095ad0ffa tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:19.878278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48cfcda1-bf40-4ef1-836e-56a095ad0ffa tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:19.878718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48cfcda1-bf40-4ef1-836e-56a095ad0ffa tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:19.885655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48cfcda1-bf40-4ef1-836e-56a095ad0ffa tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:19.886214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48cfcda1-bf40-4ef1-836e-56a095ad0ffa tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:19.889463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48cfcda1-bf40-4ef1-836e-56a095ad0ffa tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:20.350699 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-48cfcda1-bf40-4ef1-836e-56a095ad0ffa tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:20.367776 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-48cfcda1-bf40-4ef1-836e-56a095ad0ffa tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 200 len: 1249 microversion: 2.1 time: 0.539885 Oct 05 02:43:20.369041 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1791/3562] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:19 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 1249 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:20.374091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-72244a11-3223-456c-86e9-025dba81c83b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:20.383390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-72244a11-3223-456c-86e9-025dba81c83b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 8b408fc3-0c45-490f-8c42-df0ce8e9f591] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:20.392146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72244a11-3223-456c-86e9-025dba81c83b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:20.392987 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72244a11-3223-456c-86e9-025dba81c83b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:20.393601 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72244a11-3223-456c-86e9-025dba81c83b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:20.399968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72244a11-3223-456c-86e9-025dba81c83b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:20.400740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72244a11-3223-456c-86e9-025dba81c83b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:20.401396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72244a11-3223-456c-86e9-025dba81c83b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:20.749732 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-72244a11-3223-456c-86e9-025dba81c83b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:20.761026 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-72244a11-3223-456c-86e9-025dba81c83b tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591" status: 200 len: 1275 microversion: 2.1 time: 0.388853 Oct 05 02:43:20.763788 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1792/3563] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:20 2022] GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591 => generated 1275 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:20.772137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-74db7d47-4725-4ad3-b5f6-ab2b506feff0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:20.787131 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-74db7d47-4725-4ad3-b5f6-ab2b506feff0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1475 microversion: 2.1 time: 1.278318 Oct 05 02:43:20.812868 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9360fc50-184b-4d00-b365-ab592cac415a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:20.825342 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1772/3564] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:19 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1475 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:20.827805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9360fc50-184b-4d00-b365-ab592cac415a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:20.857005 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9360fc50-184b-4d00-b365-ab592cac415a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:20.857632 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4c6efeb7-b2d9-4bdb-a0e6-429a01602ff1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:20.858692 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4c6efeb7-b2d9-4bdb-a0e6-429a01602ff1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:20.859239 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9360fc50-184b-4d00-b365-ab592cac415a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:20.859698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9360fc50-184b-4d00-b365-ab592cac415a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:20.860424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9360fc50-184b-4d00-b365-ab592cac415a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:20.863486 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9360fc50-184b-4d00-b365-ab592cac415a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:20.863936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9360fc50-184b-4d00-b365-ab592cac415a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:20.879619 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c6efeb7-b2d9-4bdb-a0e6-429a01602ff1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:20.880647 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c6efeb7-b2d9-4bdb-a0e6-429a01602ff1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:20.882299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c6efeb7-b2d9-4bdb-a0e6-429a01602ff1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:20.884442 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c6efeb7-b2d9-4bdb-a0e6-429a01602ff1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:20.885160 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c6efeb7-b2d9-4bdb-a0e6-429a01602ff1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:20.887113 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c6efeb7-b2d9-4bdb-a0e6-429a01602ff1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:21.158754 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4c6efeb7-b2d9-4bdb-a0e6-429a01602ff1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:21.187939 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4c6efeb7-b2d9-4bdb-a0e6-429a01602ff1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:21.199800 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4c6efeb7-b2d9-4bdb-a0e6-429a01602ff1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:21.220972 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4c6efeb7-b2d9-4bdb-a0e6-429a01602ff1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1555 microversion: 2.91 time: 0.367951 Oct 05 02:43:21.230530 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1773/3565] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:20 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1555 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:43:21.397231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0965f970-47dc-43bb-a21a-786acf9aee8c tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:21.400422 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0965f970-47dc-43bb-a21a-786acf9aee8c tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:21.421200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0965f970-47dc-43bb-a21a-786acf9aee8c tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:21.425854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0965f970-47dc-43bb-a21a-786acf9aee8c tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:21.429312 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0965f970-47dc-43bb-a21a-786acf9aee8c tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:21.434069 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0965f970-47dc-43bb-a21a-786acf9aee8c tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:21.437853 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0965f970-47dc-43bb-a21a-786acf9aee8c tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:21.440067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0965f970-47dc-43bb-a21a-786acf9aee8c tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:21.559468 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0965f970-47dc-43bb-a21a-786acf9aee8c tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:21.559991 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0965f970-47dc-43bb-a21a-786acf9aee8c tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:21.560416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0965f970-47dc-43bb-a21a-786acf9aee8c tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:21.560884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-0965f970-47dc-43bb-a21a-786acf9aee8c tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lazy-loading 'fault' on Instance uuid d57f876f-018d-4500-8b46-a0ad8983fff5 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:43:21.682527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0965f970-47dc-43bb-a21a-786acf9aee8c tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6746153a53d94c4a9b8d1167a7fa7c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ced783ca2614e7996ccac3bc9ad97c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:21.697353 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0965f970-47dc-43bb-a21a-786acf9aee8c tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 200 len: 1254 microversion: 2.1 time: 0.300370 Oct 05 02:43:21.698474 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1774/3566] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:21 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 1254 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:43:21.790554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-eb999cac-e498-4e6d-a97f-f78413c1b390 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:21.791616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-eb999cac-e498-4e6d-a97f-f78413c1b390 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 8b408fc3-0c45-490f-8c42-df0ce8e9f591] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:21.803575 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb999cac-e498-4e6d-a97f-f78413c1b390 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:21.804377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb999cac-e498-4e6d-a97f-f78413c1b390 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:21.805042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb999cac-e498-4e6d-a97f-f78413c1b390 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:21.806090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb999cac-e498-4e6d-a97f-f78413c1b390 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:21.806725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb999cac-e498-4e6d-a97f-f78413c1b390 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:21.809299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb999cac-e498-4e6d-a97f-f78413c1b390 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:21.874427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9360fc50-184b-4d00-b365-ab592cac415a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:21.891919 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9360fc50-184b-4d00-b365-ab592cac415a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1723 microversion: 2.1 time: 1.125702 Oct 05 02:43:21.892851 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1793/3567] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:20 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1723 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:21.897959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-aba13aaf-81ad-4d1b-9ae0-3b1cb296541c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:21.901629 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-aba13aaf-81ad-4d1b-9ae0-3b1cb296541c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:21.913296 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aba13aaf-81ad-4d1b-9ae0-3b1cb296541c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:21.924914 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aba13aaf-81ad-4d1b-9ae0-3b1cb296541c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:21.927244 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aba13aaf-81ad-4d1b-9ae0-3b1cb296541c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:21.932312 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aba13aaf-81ad-4d1b-9ae0-3b1cb296541c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:21.935679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aba13aaf-81ad-4d1b-9ae0-3b1cb296541c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:21.936148 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aba13aaf-81ad-4d1b-9ae0-3b1cb296541c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:22.494359 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-eb999cac-e498-4e6d-a97f-f78413c1b390 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:22.512279 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-eb999cac-e498-4e6d-a97f-f78413c1b390 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591" status: 200 len: 1317 microversion: 2.1 time: 0.723509 Oct 05 02:43:22.530590 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1775/3568] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:21 2022] GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591 => generated 1317 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:43:22.536772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ed00649b-dabe-4c09-9ebd-ec10861112c3 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:22.541305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ed00649b-dabe-4c09-9ebd-ec10861112c3 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:22.556765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed00649b-dabe-4c09-9ebd-ec10861112c3 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:22.561317 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed00649b-dabe-4c09-9ebd-ec10861112c3 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:22.562194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed00649b-dabe-4c09-9ebd-ec10861112c3 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:22.563167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed00649b-dabe-4c09-9ebd-ec10861112c3 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:22.565639 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed00649b-dabe-4c09-9ebd-ec10861112c3 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:22.566381 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed00649b-dabe-4c09-9ebd-ec10861112c3 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:22.618069 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-aba13aaf-81ad-4d1b-9ae0-3b1cb296541c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:22.635360 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-aba13aaf-81ad-4d1b-9ae0-3b1cb296541c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1475 microversion: 2.1 time: 0.741178 Oct 05 02:43:22.647368 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1794/3569] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:21 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1475 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:22.681550 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-af4c21f1-6318-46dd-8ab4-958f4071ef03 req-0073505e-9f1b-4fcd-912b-28860f0de922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4388e9ec-13a9-4d5b-9310-7a10953c57d0", "name": "network-vif-plugged", "status": "completed", "tag": "17b098e0-7358-489c-bec3-6b98c1db0796"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:43:22.727332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-af4c21f1-6318-46dd-8ab4-958f4071ef03 req-0073505e-9f1b-4fcd-912b-28860f0de922 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:22.731756 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-af4c21f1-6318-46dd-8ab4-958f4071ef03 req-0073505e-9f1b-4fcd-912b-28860f0de922 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:22.745392 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-af4c21f1-6318-46dd-8ab4-958f4071ef03 req-0073505e-9f1b-4fcd-912b-28860f0de922 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:22.813452 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-af4c21f1-6318-46dd-8ab4-958f4071ef03 req-0073505e-9f1b-4fcd-912b-28860f0de922 service nova] Creating event network-vif-plugged:17b098e0-7358-489c-bec3-6b98c1db0796 for instance 4388e9ec-13a9-4d5b-9310-7a10953c57d0 on n-h1-858272-3 Oct 05 02:43:22.828932 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-af4c21f1-6318-46dd-8ab4-958f4071ef03 req-0073505e-9f1b-4fcd-912b-28860f0de922 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179564 Oct 05 02:43:22.841543 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1795/3570] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:43:22.858753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fda52863-636a-4057-9a9d-bbae8d19b2c1 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:22.862050 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fda52863-636a-4057-9a9d-bbae8d19b2c1 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] [instance: d57f876f-018d-4500-8b46-a0ad8983fff5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:22.880752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fda52863-636a-4057-9a9d-bbae8d19b2c1 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:22.882612 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fda52863-636a-4057-9a9d-bbae8d19b2c1 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:22.885047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fda52863-636a-4057-9a9d-bbae8d19b2c1 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:22.886674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fda52863-636a-4057-9a9d-bbae8d19b2c1 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:22.888513 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fda52863-636a-4057-9a9d-bbae8d19b2c1 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:22.890868 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fda52863-636a-4057-9a9d-bbae8d19b2c1 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:22.966288 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-fda52863-636a-4057-9a9d-bbae8d19b2c1 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] HTTP exception thrown: Instance d57f876f-018d-4500-8b46-a0ad8983fff5 could not be found. Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fda52863-636a-4057-9a9d-bbae8d19b2c1 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Request method failure captured: Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 HTTP/1.1 Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO7APnt5oQn-rheE3F1hLO5T0ng8iUvV31RYqLWyvdBn7b9b9gMLU1MNv4Up1RndOi507gDDNoEQwIRSqf5eK9CRHsDwEbrTi2TmFdYMy5vGph-fRkDMVJqElbJXojwI7jMms43xgSSEX1u2FAIGoLUgOwOBMtsQNgq2nIv3UyEGcik Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 2ced783ca2614e7996ccac3bc9ad97c7 Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersTestBootFromVolume-1236193401 Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2ced783ca2614e7996ccac3bc9ad97c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2ced783ca2614e7996ccac3bc9ad97c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2ced783ca2614e7996ccac3bc9ad97c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2ced783ca2614e7996ccac3bc9ad97c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersTestBootFromVolume-1236193401 Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 2ced783ca2614e7996ccac3bc9ad97c7 Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1236193401 Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersTestBootFromVolume-1236193401-project Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 6746153a53d94c4a9b8d1167a7fa7c4a Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersTestBootFromVolume-1236193401-project Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance d57f876f-018d-4500-8b46-a0ad8983fff5 could not be found. Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'd57f876f-018d-4500-8b46-a0ad8983fff5'} Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d57f876f-018d-4500-8b46-a0ad8983fff5 could not be found. Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d57f876f-018d-4500-8b46-a0ad8983fff5 could not be found. Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:43:22.972524 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:43:22.978691 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:43:22.978691 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:43:22.978691 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:43:22.978691 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:43:22.978691 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:43:22.978691 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d57f876f-018d-4500-8b46-a0ad8983fff5 could not be found. Oct 05 02:43:22.978691 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:43:22.982387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fda52863-636a-4057-9a9d-bbae8d19b2c1 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Returning 404 to user: Instance d57f876f-018d-4500-8b46-a0ad8983fff5 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:43:22.988709 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fda52863-636a-4057-9a9d-bbae8d19b2c1 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5" status: 404 len: 111 microversion: 2.1 time: 0.139956 Oct 05 02:43:22.993017 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1796/3571] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:22 2022] GET /compute/v2.1/servers/d57f876f-018d-4500-8b46-a0ad8983fff5 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:43:22.998111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ed00649b-dabe-4c09-9ebd-ec10861112c3 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:23.010209 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ed00649b-dabe-4c09-9ebd-ec10861112c3 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:23.013541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-13a0537e-7ff5-4221-a92b-4a61c16b8004 req-e662346d-fdb7-492f-947f-9796167c3d57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b408fc3-0c45-490f-8c42-df0ce8e9f591", "tag": "711a059e-96a5-4a9b-b279-8338cdce3565"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:43:23.014977 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ed00649b-dabe-4c09-9ebd-ec10861112c3 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:23.027952 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ed00649b-dabe-4c09-9ebd-ec10861112c3 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1555 microversion: 2.91 time: 0.495673 Oct 05 02:43:23.033307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-13a0537e-7ff5-4221-a92b-4a61c16b8004 req-e662346d-fdb7-492f-947f-9796167c3d57 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:23.037157 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-13a0537e-7ff5-4221-a92b-4a61c16b8004 req-e662346d-fdb7-492f-947f-9796167c3d57 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:23.037860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-13a0537e-7ff5-4221-a92b-4a61c16b8004 req-e662346d-fdb7-492f-947f-9796167c3d57 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:23.045839 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1776/3572] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:22 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1555 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:43:23.063243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3083cc97-5602-48ab-a18a-444a4899b9da tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:23.064429 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3083cc97-5602-48ab-a18a-444a4899b9da tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:23.075301 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-13a0537e-7ff5-4221-a92b-4a61c16b8004 req-e662346d-fdb7-492f-947f-9796167c3d57 service nova] Creating event network-changed:711a059e-96a5-4a9b-b279-8338cdce3565 for instance 8b408fc3-0c45-490f-8c42-df0ce8e9f591 on n-h1-858272-3 Oct 05 02:43:23.087014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3083cc97-5602-48ab-a18a-444a4899b9da tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:23.087837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3083cc97-5602-48ab-a18a-444a4899b9da tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:23.088452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3083cc97-5602-48ab-a18a-444a4899b9da tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:23.089392 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3083cc97-5602-48ab-a18a-444a4899b9da tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:23.090027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3083cc97-5602-48ab-a18a-444a4899b9da tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:23.090612 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3083cc97-5602-48ab-a18a-444a4899b9da tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:23.099887 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-13a0537e-7ff5-4221-a92b-4a61c16b8004 req-e662346d-fdb7-492f-947f-9796167c3d57 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105047 Oct 05 02:43:23.100551 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1797/3573] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:43:23.122230 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-962ece7e-4cb4-451a-b8d1-a276bc095415 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] Calling method '.version_select at 0x7fccdf123af0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:23.249596 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-962ece7e-4cb4-451a-b8d1-a276bc095415 tempest-ServersTestBootFromVolume-1236193401 tempest-ServersTestBootFromVolume-1236193401-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-7082707" status: 202 len: 0 microversion: 2.1 time: 0.128039 Oct 05 02:43:23.251089 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1798/3574] 10.222.0.16 () {58 vars in 1212 bytes} [Wed Oct 5 02:43:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-7082707 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:43:23.538515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d10b63d9-20f9-42e1-9a95-7718b0742153 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:23.539262 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d10b63d9-20f9-42e1-9a95-7718b0742153 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 8b408fc3-0c45-490f-8c42-df0ce8e9f591] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:23.546667 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d10b63d9-20f9-42e1-9a95-7718b0742153 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:23.547169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d10b63d9-20f9-42e1-9a95-7718b0742153 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:23.547609 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d10b63d9-20f9-42e1-9a95-7718b0742153 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:23.548875 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d10b63d9-20f9-42e1-9a95-7718b0742153 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:23.562606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d10b63d9-20f9-42e1-9a95-7718b0742153 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:23.563065 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d10b63d9-20f9-42e1-9a95-7718b0742153 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:24.301302 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3083cc97-5602-48ab-a18a-444a4899b9da tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:24.310959 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3083cc97-5602-48ab-a18a-444a4899b9da tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1723 microversion: 2.1 time: 1.264077 Oct 05 02:43:24.319081 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1777/3575] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:23 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1723 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:24.333045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-40fd0c3c-9abd-4466-ad49-435ae32d1677 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:24.333979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-40fd0c3c-9abd-4466-ad49-435ae32d1677 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:24.344761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40fd0c3c-9abd-4466-ad49-435ae32d1677 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:24.345879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40fd0c3c-9abd-4466-ad49-435ae32d1677 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:24.349944 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40fd0c3c-9abd-4466-ad49-435ae32d1677 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:24.352241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40fd0c3c-9abd-4466-ad49-435ae32d1677 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:24.352931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40fd0c3c-9abd-4466-ad49-435ae32d1677 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:24.353649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40fd0c3c-9abd-4466-ad49-435ae32d1677 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:24.837424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d10b63d9-20f9-42e1-9a95-7718b0742153 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:24.860668 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d10b63d9-20f9-42e1-9a95-7718b0742153 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591" status: 200 len: 1317 microversion: 2.1 time: 1.326614 Oct 05 02:43:24.866011 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1799/3576] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:23 2022] GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591 => generated 1317 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:43:24.880414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-40fd0c3c-9abd-4466-ad49-435ae32d1677 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:24.882306 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1941676e-6cff-40ff-beb4-be80ea538fb1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:24.885588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1941676e-6cff-40ff-beb4-be80ea538fb1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:24.893216 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-40fd0c3c-9abd-4466-ad49-435ae32d1677 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1474 microversion: 2.1 time: 0.568792 Oct 05 02:43:24.895801 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1778/3577] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:24 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1474 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:24.909275 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1941676e-6cff-40ff-beb4-be80ea538fb1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:24.922796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1941676e-6cff-40ff-beb4-be80ea538fb1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:24.923194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1941676e-6cff-40ff-beb4-be80ea538fb1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:24.924441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1941676e-6cff-40ff-beb4-be80ea538fb1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:24.925386 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1941676e-6cff-40ff-beb4-be80ea538fb1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:24.926021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1941676e-6cff-40ff-beb4-be80ea538fb1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:25.058628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1941676e-6cff-40ff-beb4-be80ea538fb1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:25.077164 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1941676e-6cff-40ff-beb4-be80ea538fb1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:25.088979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1941676e-6cff-40ff-beb4-be80ea538fb1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:25.101785 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1941676e-6cff-40ff-beb4-be80ea538fb1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1555 microversion: 2.91 time: 0.234431 Oct 05 02:43:25.105522 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1800/3578] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:24 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1555 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:43:25.351126 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bea06140-bdc5-461d-b12d-c40d69ad7291 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:25.352619 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bea06140-bdc5-461d-b12d-c40d69ad7291 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:25.374998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bea06140-bdc5-461d-b12d-c40d69ad7291 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:25.377704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bea06140-bdc5-461d-b12d-c40d69ad7291 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:25.380156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bea06140-bdc5-461d-b12d-c40d69ad7291 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:25.388792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-487003f0-7788-45a5-862f-627391cedfa0 req-7693cec1-7cd3-4226-b4fb-bc95202c5ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03081f70-6b52-497a-ab3f-27f86089c602", "name": "network-vif-unplugged", "status": "completed", "tag": "7edc14f6-3b4b-460e-96c8-a6f177b5e033"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:43:25.400785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bea06140-bdc5-461d-b12d-c40d69ad7291 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:25.405995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bea06140-bdc5-461d-b12d-c40d69ad7291 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:25.407290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bea06140-bdc5-461d-b12d-c40d69ad7291 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:25.438093 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-487003f0-7788-45a5-862f-627391cedfa0 req-7693cec1-7cd3-4226-b4fb-bc95202c5ea5 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:25.442718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-487003f0-7788-45a5-862f-627391cedfa0 req-7693cec1-7cd3-4226-b4fb-bc95202c5ea5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:25.443428 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-487003f0-7788-45a5-862f-627391cedfa0 req-7693cec1-7cd3-4226-b4fb-bc95202c5ea5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:25.510761 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-487003f0-7788-45a5-862f-627391cedfa0 req-7693cec1-7cd3-4226-b4fb-bc95202c5ea5 service nova] Creating event network-vif-unplugged:7edc14f6-3b4b-460e-96c8-a6f177b5e033 for instance 03081f70-6b52-497a-ab3f-27f86089c602 on n-h1-858272-3 Oct 05 02:43:25.518791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:25.542571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [req-487003f0-7788-45a5-862f-627391cedfa0 req-7693cec1-7cd3-4226-b4fb-bc95202c5ea5 service nova] Instance 03081f70-6b52-497a-ab3f-27f86089c602 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 02:43:25.580766 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-487003f0-7788-45a5-862f-627391cedfa0 req-7693cec1-7cd3-4226-b4fb-bc95202c5ea5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.193226 Oct 05 02:43:25.581483 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1801/3579] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:43:25.883169 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bea06140-bdc5-461d-b12d-c40d69ad7291 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:25.895513 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b6bd99de-47a0-4a31-8aa9-b97bc1c5c9eb tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:25.896154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b6bd99de-47a0-4a31-8aa9-b97bc1c5c9eb tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 8b408fc3-0c45-490f-8c42-df0ce8e9f591] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:25.902428 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bea06140-bdc5-461d-b12d-c40d69ad7291 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1723 microversion: 2.1 time: 0.557074 Oct 05 02:43:25.906558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6bd99de-47a0-4a31-8aa9-b97bc1c5c9eb tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:25.909232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6bd99de-47a0-4a31-8aa9-b97bc1c5c9eb tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:25.911753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6bd99de-47a0-4a31-8aa9-b97bc1c5c9eb tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:25.913163 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6bd99de-47a0-4a31-8aa9-b97bc1c5c9eb tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:25.914406 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6bd99de-47a0-4a31-8aa9-b97bc1c5c9eb tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:25.919097 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1779/3580] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:25 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1723 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:25.919910 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6bd99de-47a0-4a31-8aa9-b97bc1c5c9eb tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:25.937984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6b3e9b12-21ed-425f-961a-8aa425e86d62 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:25.938621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6b3e9b12-21ed-425f-961a-8aa425e86d62 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:25.958755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b3e9b12-21ed-425f-961a-8aa425e86d62 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:25.959263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b3e9b12-21ed-425f-961a-8aa425e86d62 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:25.959709 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b3e9b12-21ed-425f-961a-8aa425e86d62 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:25.961474 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b3e9b12-21ed-425f-961a-8aa425e86d62 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:25.961958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b3e9b12-21ed-425f-961a-8aa425e86d62 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:25.962398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b3e9b12-21ed-425f-961a-8aa425e86d62 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:26.524982 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b6bd99de-47a0-4a31-8aa9-b97bc1c5c9eb tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:26.535501 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b6bd99de-47a0-4a31-8aa9-b97bc1c5c9eb tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591" status: 200 len: 1317 microversion: 2.1 time: 0.646852 Oct 05 02:43:26.542754 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1802/3581] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:25 2022] GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591 => generated 1317 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:26.562123 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-180fdb61-1041-4bd6-8ed8-bce60da9ff3f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:26.562854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-180fdb61-1041-4bd6-8ed8-bce60da9ff3f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:26.582446 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-180fdb61-1041-4bd6-8ed8-bce60da9ff3f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:26.584539 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-180fdb61-1041-4bd6-8ed8-bce60da9ff3f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:26.587105 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-180fdb61-1041-4bd6-8ed8-bce60da9ff3f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:26.587983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-180fdb61-1041-4bd6-8ed8-bce60da9ff3f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:26.589271 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-180fdb61-1041-4bd6-8ed8-bce60da9ff3f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:26.589938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-180fdb61-1041-4bd6-8ed8-bce60da9ff3f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:26.647779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6b3e9b12-21ed-425f-961a-8aa425e86d62 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:26.662785 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6b3e9b12-21ed-425f-961a-8aa425e86d62 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1474 microversion: 2.1 time: 0.741253 Oct 05 02:43:26.670625 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1780/3582] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:25 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1474 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:26.734081 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-180fdb61-1041-4bd6-8ed8-bce60da9ff3f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:26.745036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-180fdb61-1041-4bd6-8ed8-bce60da9ff3f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:26.746648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-180fdb61-1041-4bd6-8ed8-bce60da9ff3f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:26.753139 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-180fdb61-1041-4bd6-8ed8-bce60da9ff3f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1555 microversion: 2.91 time: 0.209062 Oct 05 02:43:26.769447 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1803/3583] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:26 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1555 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:43:26.949133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3532dd80-d27d-49b1-9166-48cbabf9db68 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:26.949696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3532dd80-d27d-49b1-9166-48cbabf9db68 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:26.971028 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3532dd80-d27d-49b1-9166-48cbabf9db68 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:26.971539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3532dd80-d27d-49b1-9166-48cbabf9db68 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:26.977904 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3532dd80-d27d-49b1-9166-48cbabf9db68 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:26.981109 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3532dd80-d27d-49b1-9166-48cbabf9db68 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:26.985226 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3532dd80-d27d-49b1-9166-48cbabf9db68 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:26.986481 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3532dd80-d27d-49b1-9166-48cbabf9db68 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:27.273458 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=10 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:27.562662 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0b039da7-1fa5-4e63-a169-94720b9dee83 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:27.564744 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0b039da7-1fa5-4e63-a169-94720b9dee83 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 8b408fc3-0c45-490f-8c42-df0ce8e9f591] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:27.617218 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b039da7-1fa5-4e63-a169-94720b9dee83 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:27.617757 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b039da7-1fa5-4e63-a169-94720b9dee83 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:27.620714 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b039da7-1fa5-4e63-a169-94720b9dee83 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:27.625875 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b039da7-1fa5-4e63-a169-94720b9dee83 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:27.628626 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b039da7-1fa5-4e63-a169-94720b9dee83 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:27.631357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b039da7-1fa5-4e63-a169-94720b9dee83 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:28.795934 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3532dd80-d27d-49b1-9166-48cbabf9db68 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:28.822644 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3532dd80-d27d-49b1-9166-48cbabf9db68 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1723 microversion: 2.1 time: 1.877673 Oct 05 02:43:28.823979 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1781/3584] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:26 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1723 bytes in 1881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:28.830482 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-430b518a-3313-49dd-a693-7ba926b03d91 req-4005f61d-39da-44e4-b0bb-7e51baf9b5a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03081f70-6b52-497a-ab3f-27f86089c602", "tag": "7edc14f6-3b4b-460e-96c8-a6f177b5e033"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:43:28.844277 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-430b518a-3313-49dd-a693-7ba926b03d91 req-4005f61d-39da-44e4-b0bb-7e51baf9b5a1 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:28.845696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-430b518a-3313-49dd-a693-7ba926b03d91 req-4005f61d-39da-44e4-b0bb-7e51baf9b5a1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:28.847441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-430b518a-3313-49dd-a693-7ba926b03d91 req-4005f61d-39da-44e4-b0bb-7e51baf9b5a1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:28.873849 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-430b518a-3313-49dd-a693-7ba926b03d91 req-4005f61d-39da-44e4-b0bb-7e51baf9b5a1 service nova] Creating event network-changed:7edc14f6-3b4b-460e-96c8-a6f177b5e033 for instance 03081f70-6b52-497a-ab3f-27f86089c602 on n-h1-858272-3 Oct 05 02:43:28.883293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [req-430b518a-3313-49dd-a693-7ba926b03d91 req-4005f61d-39da-44e4-b0bb-7e51baf9b5a1 service nova] Instance 03081f70-6b52-497a-ab3f-27f86089c602 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122319) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 02:43:28.903246 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-430b518a-3313-49dd-a693-7ba926b03d91 req-4005f61d-39da-44e4-b0bb-7e51baf9b5a1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077774 Oct 05 02:43:28.904751 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1782/3585] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:43:28.917471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bf0d16f1-cffb-48c7-b298-3f83fcd8b7e1 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:28.918565 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bf0d16f1-cffb-48c7-b298-3f83fcd8b7e1 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:28.927666 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf0d16f1-cffb-48c7-b298-3f83fcd8b7e1 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:28.928446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf0d16f1-cffb-48c7-b298-3f83fcd8b7e1 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:28.929261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf0d16f1-cffb-48c7-b298-3f83fcd8b7e1 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:28.930145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf0d16f1-cffb-48c7-b298-3f83fcd8b7e1 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:28.930773 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf0d16f1-cffb-48c7-b298-3f83fcd8b7e1 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:28.932064 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf0d16f1-cffb-48c7-b298-3f83fcd8b7e1 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:29.053951 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0b039da7-1fa5-4e63-a169-94720b9dee83 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:29.062439 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0b039da7-1fa5-4e63-a169-94720b9dee83 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591" status: 200 len: 1317 microversion: 2.1 time: 1.503476 Oct 05 02:43:29.067543 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1804/3586] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:27 2022] GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591 => generated 1317 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:43:29.072492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2392ac56-ba3b-4db9-9622-b7cff4ff39eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:29.078656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2392ac56-ba3b-4db9-9622-b7cff4ff39eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:29.094079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2392ac56-ba3b-4db9-9622-b7cff4ff39eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:29.094874 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2392ac56-ba3b-4db9-9622-b7cff4ff39eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:29.095502 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2392ac56-ba3b-4db9-9622-b7cff4ff39eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:29.096739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2392ac56-ba3b-4db9-9622-b7cff4ff39eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:29.097427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2392ac56-ba3b-4db9-9622-b7cff4ff39eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:29.098036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2392ac56-ba3b-4db9-9622-b7cff4ff39eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:29.265350 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2392ac56-ba3b-4db9-9622-b7cff4ff39eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:29.277165 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2392ac56-ba3b-4db9-9622-b7cff4ff39eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:29.283425 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2392ac56-ba3b-4db9-9622-b7cff4ff39eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:29.299161 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2392ac56-ba3b-4db9-9622-b7cff4ff39eb tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1537 microversion: 2.91 time: 0.230319 Oct 05 02:43:29.300351 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1805/3587] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:29 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1537 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:43:29.390816 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bf0d16f1-cffb-48c7-b298-3f83fcd8b7e1 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:29.400274 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bf0d16f1-cffb-48c7-b298-3f83fcd8b7e1 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1474 microversion: 2.1 time: 0.493988 Oct 05 02:43:29.405228 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1783/3588] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:28 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1474 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:29.850242 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0b679644-bafb-4eca-aaa3-28c02cb2ebb4 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:29.850878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0b679644-bafb-4eca-aaa3-28c02cb2ebb4 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:29.869793 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b679644-bafb-4eca-aaa3-28c02cb2ebb4 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:29.869793 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b679644-bafb-4eca-aaa3-28c02cb2ebb4 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:29.880231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b679644-bafb-4eca-aaa3-28c02cb2ebb4 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:29.881382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b679644-bafb-4eca-aaa3-28c02cb2ebb4 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:29.881873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b679644-bafb-4eca-aaa3-28c02cb2ebb4 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:29.883503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b679644-bafb-4eca-aaa3-28c02cb2ebb4 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:30.090658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-975bacf4-6a2d-42e4-9495-346ee9ad4e90 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:30.093040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-975bacf4-6a2d-42e4-9495-346ee9ad4e90 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 8b408fc3-0c45-490f-8c42-df0ce8e9f591] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:30.104876 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-975bacf4-6a2d-42e4-9495-346ee9ad4e90 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:30.107471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-975bacf4-6a2d-42e4-9495-346ee9ad4e90 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:30.108120 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-975bacf4-6a2d-42e4-9495-346ee9ad4e90 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:30.109723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-975bacf4-6a2d-42e4-9495-346ee9ad4e90 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:30.111444 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-975bacf4-6a2d-42e4-9495-346ee9ad4e90 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:30.112080 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-975bacf4-6a2d-42e4-9495-346ee9ad4e90 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:31.020875 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0b679644-bafb-4eca-aaa3-28c02cb2ebb4 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:31.029965 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0b679644-bafb-4eca-aaa3-28c02cb2ebb4 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1700 microversion: 2.1 time: 1.183644 Oct 05 02:43:31.035804 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1806/3589] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:29 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1700 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:31.049668 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7660c7c9-d938-451b-9240-52c267cac77b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:31.050534 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7660c7c9-d938-451b-9240-52c267cac77b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:31.060596 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7660c7c9-d938-451b-9240-52c267cac77b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:31.065605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7660c7c9-d938-451b-9240-52c267cac77b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:31.066327 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7660c7c9-d938-451b-9240-52c267cac77b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:31.067258 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7660c7c9-d938-451b-9240-52c267cac77b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:31.067970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7660c7c9-d938-451b-9240-52c267cac77b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:31.068572 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7660c7c9-d938-451b-9240-52c267cac77b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:31.071606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-975bacf4-6a2d-42e4-9495-346ee9ad4e90 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:31.080876 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-975bacf4-6a2d-42e4-9495-346ee9ad4e90 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591" status: 200 len: 1317 microversion: 2.1 time: 0.993998 Oct 05 02:43:31.084971 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1784/3590] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:30 2022] GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591 => generated 1317 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:31.098841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-324d33f6-1743-4dfa-9c01-1ca93d0ef573 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:31.105075 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-324d33f6-1743-4dfa-9c01-1ca93d0ef573 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:31.126910 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-324d33f6-1743-4dfa-9c01-1ca93d0ef573 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:31.127904 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-324d33f6-1743-4dfa-9c01-1ca93d0ef573 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:31.131062 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-324d33f6-1743-4dfa-9c01-1ca93d0ef573 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:31.133766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-324d33f6-1743-4dfa-9c01-1ca93d0ef573 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:31.134437 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-324d33f6-1743-4dfa-9c01-1ca93d0ef573 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:31.136838 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-324d33f6-1743-4dfa-9c01-1ca93d0ef573 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:31.206630 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:31.436854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7660c7c9-d938-451b-9240-52c267cac77b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:31.446059 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:31.454041 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7660c7c9-d938-451b-9240-52c267cac77b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:31.458675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7660c7c9-d938-451b-9240-52c267cac77b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:31.472314 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7660c7c9-d938-451b-9240-52c267cac77b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1480 microversion: 2.91 time: 0.435112 Oct 05 02:43:31.477665 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1807/3591] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:31 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1480 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:43:31.498542 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5e942741-a104-4cd4-9bf3-dd10bc3a6f9c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:43:31.526797 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e942741-a104-4cd4-9bf3-dd10bc3a6f9c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:31.528792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e942741-a104-4cd4-9bf3-dd10bc3a6f9c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:31.532702 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e942741-a104-4cd4-9bf3-dd10bc3a6f9c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:31.662431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5e942741-a104-4cd4-9bf3-dd10bc3a6f9c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Going to try to start instance {{(pid=122320) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 05 02:43:31.747352 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5e942741-a104-4cd4-9bf3-dd10bc3a6f9c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "POST /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397/action" status: 202 len: 0 microversion: 2.1 time: 0.267855 Oct 05 02:43:31.748555 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1808/3592] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:43:31 2022] POST /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:43:31.760019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-609e2238-8f72-4769-8a78-9f72c8b0099f req-0cb6745b-f80e-4397-862b-aebc16866e3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b408fc3-0c45-490f-8c42-df0ce8e9f591", "name": "network-vif-plugged", "status": "completed", "tag": "711a059e-96a5-4a9b-b279-8338cdce3565"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:43:31.792827 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-609e2238-8f72-4769-8a78-9f72c8b0099f req-0cb6745b-f80e-4397-862b-aebc16866e3c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:31.795013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-609e2238-8f72-4769-8a78-9f72c8b0099f req-0cb6745b-f80e-4397-862b-aebc16866e3c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:31.796983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-609e2238-8f72-4769-8a78-9f72c8b0099f req-0cb6745b-f80e-4397-862b-aebc16866e3c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:31.823311 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-609e2238-8f72-4769-8a78-9f72c8b0099f req-0cb6745b-f80e-4397-862b-aebc16866e3c service nova] Creating event network-vif-plugged:711a059e-96a5-4a9b-b279-8338cdce3565 for instance 8b408fc3-0c45-490f-8c42-df0ce8e9f591 on n-h1-858272-3 Oct 05 02:43:31.835573 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-609e2238-8f72-4769-8a78-9f72c8b0099f req-0cb6745b-f80e-4397-862b-aebc16866e3c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083365 Oct 05 02:43:31.850064 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1809/3593] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:43:31.870492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5f7bf047-7331-4326-849a-676cb9c37291 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-858272-3"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:43:31.877237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5f7bf047-7331-4326-849a-676cb9c37291 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:31.900074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5f7bf047-7331-4326-849a-676cb9c37291 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:31.903503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5f7bf047-7331-4326-849a-676cb9c37291 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:31.904891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5f7bf047-7331-4326-849a-676cb9c37291 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:31.905977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5f7bf047-7331-4326-849a-676cb9c37291 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:31.906953 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5f7bf047-7331-4326-849a-676cb9c37291 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:31.908628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5f7bf047-7331-4326-849a-676cb9c37291 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:31.972167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-324d33f6-1743-4dfa-9c01-1ca93d0ef573 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:31.981787 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-324d33f6-1743-4dfa-9c01-1ca93d0ef573 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1474 microversion: 2.1 time: 0.895355 Oct 05 02:43:31.990893 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5f7bf047-7331-4326-849a-676cb9c37291 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-858272-3". {{(pid=122320) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 05 02:43:31.993910 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1785/3594] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:31 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1474 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:32.011881 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-52a90415-22c5-4c1f-9af8-1f4d69a4f8aa tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:32.013361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-52a90415-22c5-4c1f-9af8-1f4d69a4f8aa tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:32.028424 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52a90415-22c5-4c1f-9af8-1f4d69a4f8aa tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:32.029272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52a90415-22c5-4c1f-9af8-1f4d69a4f8aa tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:32.029713 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52a90415-22c5-4c1f-9af8-1f4d69a4f8aa tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:32.030611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52a90415-22c5-4c1f-9af8-1f4d69a4f8aa tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:32.031070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52a90415-22c5-4c1f-9af8-1f4d69a4f8aa tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:32.031505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52a90415-22c5-4c1f-9af8-1f4d69a4f8aa tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:32.203155 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5f7bf047-7331-4326-849a-676cb9c37291 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6/action" status: 202 len: 0 microversion: 2.91 time: 0.343332 Oct 05 02:43:32.210809 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1810/3595] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 5 02:43:31 2022] POST /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:43:32.219064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c1911eac-c85a-4923-9294-8cd65e006c47 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:32.220339 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c1911eac-c85a-4923-9294-8cd65e006c47 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 8b408fc3-0c45-490f-8c42-df0ce8e9f591] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:32.231525 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1911eac-c85a-4923-9294-8cd65e006c47 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:32.233278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1911eac-c85a-4923-9294-8cd65e006c47 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:32.233960 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1911eac-c85a-4923-9294-8cd65e006c47 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:32.237775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1911eac-c85a-4923-9294-8cd65e006c47 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:32.238591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1911eac-c85a-4923-9294-8cd65e006c47 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:32.240010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1911eac-c85a-4923-9294-8cd65e006c47 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:32.483803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-52a90415-22c5-4c1f-9af8-1f4d69a4f8aa tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:32.526471 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-52a90415-22c5-4c1f-9af8-1f4d69a4f8aa tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1709 microversion: 2.1 time: 0.531074 Oct 05 02:43:32.541493 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1786/3596] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:31 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1709 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:32.554596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d887919f-befa-4639-8378-849ee80787b4 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:32.555480 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d887919f-befa-4639-8378-849ee80787b4 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:32.562335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d887919f-befa-4639-8378-849ee80787b4 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:32.563451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d887919f-befa-4639-8378-849ee80787b4 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:32.564796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d887919f-befa-4639-8378-849ee80787b4 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:32.565745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d887919f-befa-4639-8378-849ee80787b4 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:32.566378 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d887919f-befa-4639-8378-849ee80787b4 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:32.566975 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d887919f-befa-4639-8378-849ee80787b4 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:32.968693 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d887919f-befa-4639-8378-849ee80787b4 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:32.984002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d887919f-befa-4639-8378-849ee80787b4 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:32.992988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d887919f-befa-4639-8378-849ee80787b4 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:33.018677 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d887919f-befa-4639-8378-849ee80787b4 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1488 microversion: 2.91 time: 0.472639 Oct 05 02:43:33.035948 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1787/3597] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:32 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1488 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:43:33.050253 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-422042c7-1a64-4e11-8977-362a19b21494 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:33.051709 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-422042c7-1a64-4e11-8977-362a19b21494 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:33.092004 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-422042c7-1a64-4e11-8977-362a19b21494 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:33.092855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-422042c7-1a64-4e11-8977-362a19b21494 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:33.093585 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-422042c7-1a64-4e11-8977-362a19b21494 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:33.094522 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-422042c7-1a64-4e11-8977-362a19b21494 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:33.113221 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-422042c7-1a64-4e11-8977-362a19b21494 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:33.113830 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-422042c7-1a64-4e11-8977-362a19b21494 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:33.153721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c1911eac-c85a-4923-9294-8cd65e006c47 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:33.169488 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c1911eac-c85a-4923-9294-8cd65e006c47 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591" status: 200 len: 1317 microversion: 2.1 time: 0.956188 Oct 05 02:43:33.179633 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1811/3598] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:32 2022] GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591 => generated 1317 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:33.556444 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6ff2e6ac-b19e-48ea-b01e-fa3bb07381b8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:33.557865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6ff2e6ac-b19e-48ea-b01e-fa3bb07381b8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:33.566027 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ff2e6ac-b19e-48ea-b01e-fa3bb07381b8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:33.567504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ff2e6ac-b19e-48ea-b01e-fa3bb07381b8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:33.568134 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ff2e6ac-b19e-48ea-b01e-fa3bb07381b8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:33.569092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ff2e6ac-b19e-48ea-b01e-fa3bb07381b8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:33.569716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ff2e6ac-b19e-48ea-b01e-fa3bb07381b8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:33.570320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ff2e6ac-b19e-48ea-b01e-fa3bb07381b8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:34.130888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-422042c7-1a64-4e11-8977-362a19b21494 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:34.131695 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6ff2e6ac-b19e-48ea-b01e-fa3bb07381b8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:34.147039 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6ff2e6ac-b19e-48ea-b01e-fa3bb07381b8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1709 microversion: 2.1 time: 0.594942 Oct 05 02:43:34.148007 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1812/3599] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:33 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1709 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:43:34.153052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-47e3d018-8bd7-4620-a937-0eff0dac1a88 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:34.156799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-47e3d018-8bd7-4620-a937-0eff0dac1a88 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:34.174230 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-422042c7-1a64-4e11-8977-362a19b21494 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1472 microversion: 2.1 time: 1.133258 Oct 05 02:43:34.176057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47e3d018-8bd7-4620-a937-0eff0dac1a88 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:34.176728 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47e3d018-8bd7-4620-a937-0eff0dac1a88 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:34.177372 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47e3d018-8bd7-4620-a937-0eff0dac1a88 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:34.178263 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47e3d018-8bd7-4620-a937-0eff0dac1a88 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:34.178869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47e3d018-8bd7-4620-a937-0eff0dac1a88 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:34.179657 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47e3d018-8bd7-4620-a937-0eff0dac1a88 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:34.192208 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1788/3600] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:33 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1472 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:34.210570 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bc00a1a7-c6c5-486d-b6cd-bee375c7c4df tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:34.211387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bc00a1a7-c6c5-486d-b6cd-bee375c7c4df tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 8b408fc3-0c45-490f-8c42-df0ce8e9f591] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:34.220789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bc00a1a7-c6c5-486d-b6cd-bee375c7c4df tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:34.221445 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bc00a1a7-c6c5-486d-b6cd-bee375c7c4df tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:34.221968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bc00a1a7-c6c5-486d-b6cd-bee375c7c4df tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:34.222950 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bc00a1a7-c6c5-486d-b6cd-bee375c7c4df tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:34.223397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bc00a1a7-c6c5-486d-b6cd-bee375c7c4df tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:34.224081 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bc00a1a7-c6c5-486d-b6cd-bee375c7c4df tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:34.965027 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-47e3d018-8bd7-4620-a937-0eff0dac1a88 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:34.979925 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-47e3d018-8bd7-4620-a937-0eff0dac1a88 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:35.011602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-47e3d018-8bd7-4620-a937-0eff0dac1a88 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:35.033868 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-47e3d018-8bd7-4620-a937-0eff0dac1a88 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1488 microversion: 2.91 time: 0.884345 Oct 05 02:43:35.036210 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1813/3601] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:34 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1488 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:43:35.171864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ae47b8f2-57d9-4f68-90bd-2906222e5262 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:35.172672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ae47b8f2-57d9-4f68-90bd-2906222e5262 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:35.203910 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae47b8f2-57d9-4f68-90bd-2906222e5262 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:35.205802 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae47b8f2-57d9-4f68-90bd-2906222e5262 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:35.206486 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae47b8f2-57d9-4f68-90bd-2906222e5262 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:35.207482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae47b8f2-57d9-4f68-90bd-2906222e5262 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:35.208545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae47b8f2-57d9-4f68-90bd-2906222e5262 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:35.209276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae47b8f2-57d9-4f68-90bd-2906222e5262 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:35.646714 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bc00a1a7-c6c5-486d-b6cd-bee375c7c4df tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:35.661954 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bc00a1a7-c6c5-486d-b6cd-bee375c7c4df tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591" status: 200 len: 1317 microversion: 2.1 time: 1.455303 Oct 05 02:43:35.666246 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1789/3602] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:34 2022] GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591 => generated 1317 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:35.681768 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d4ed2343-755a-4695-8595-b2f5383f92dc tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:35.682567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d4ed2343-755a-4695-8595-b2f5383f92dc tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:35.703744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4ed2343-755a-4695-8595-b2f5383f92dc tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:35.706173 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4ed2343-755a-4695-8595-b2f5383f92dc tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:35.706951 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4ed2343-755a-4695-8595-b2f5383f92dc tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:35.717811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4ed2343-755a-4695-8595-b2f5383f92dc tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:35.718973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4ed2343-755a-4695-8595-b2f5383f92dc tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:35.723817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4ed2343-755a-4695-8595-b2f5383f92dc tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:36.453238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ae47b8f2-57d9-4f68-90bd-2906222e5262 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:36.463969 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ae47b8f2-57d9-4f68-90bd-2906222e5262 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1713 microversion: 2.1 time: 1.297541 Oct 05 02:43:36.482134 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1814/3603] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:35 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1713 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:43:36.497997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ac366601-ff32-476f-b4dd-f9b64f44b5ac tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:36.502436 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ac366601-ff32-476f-b4dd-f9b64f44b5ac tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:36.532410 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac366601-ff32-476f-b4dd-f9b64f44b5ac tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:36.541634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac366601-ff32-476f-b4dd-f9b64f44b5ac tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:36.542649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac366601-ff32-476f-b4dd-f9b64f44b5ac tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:36.543728 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac366601-ff32-476f-b4dd-f9b64f44b5ac tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:36.544358 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac366601-ff32-476f-b4dd-f9b64f44b5ac tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:36.544981 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac366601-ff32-476f-b4dd-f9b64f44b5ac tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:36.781938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ac366601-ff32-476f-b4dd-f9b64f44b5ac tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:36.795544 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d4ed2343-755a-4695-8595-b2f5383f92dc tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:36.800890 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ac366601-ff32-476f-b4dd-f9b64f44b5ac tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:36.811243 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d4ed2343-755a-4695-8595-b2f5383f92dc tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1469 microversion: 2.1 time: 1.143666 Oct 05 02:43:36.812047 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1790/3604] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:35 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1469 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:36.816877 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-73bb8078-daff-4341-ab94-44c4f4fc481e tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:36.830084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ac366601-ff32-476f-b4dd-f9b64f44b5ac tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:36.833899 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-73bb8078-daff-4341-ab94-44c4f4fc481e tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 8b408fc3-0c45-490f-8c42-df0ce8e9f591] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:36.847612 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-73bb8078-daff-4341-ab94-44c4f4fc481e tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:36.848390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-73bb8078-daff-4341-ab94-44c4f4fc481e tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:36.848543 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-73bb8078-daff-4341-ab94-44c4f4fc481e tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:36.854678 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-73bb8078-daff-4341-ab94-44c4f4fc481e tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:36.855162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-73bb8078-daff-4341-ab94-44c4f4fc481e tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:36.855591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-73bb8078-daff-4341-ab94-44c4f4fc481e tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:36.862297 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ac366601-ff32-476f-b4dd-f9b64f44b5ac tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1546 microversion: 2.91 time: 0.378844 Oct 05 02:43:36.866766 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1815/3605] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:36 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1546 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:43:36.879517 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-119c225f-6e17-4d9b-9aae-f8d99cdd731b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:43:36.886338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-119c225f-6e17-4d9b-9aae-f8d99cdd731b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:36.908655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-119c225f-6e17-4d9b-9aae-f8d99cdd731b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:36.911307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-119c225f-6e17-4d9b-9aae-f8d99cdd731b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:36.912793 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-119c225f-6e17-4d9b-9aae-f8d99cdd731b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:36.914682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-119c225f-6e17-4d9b-9aae-f8d99cdd731b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:36.922059 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-119c225f-6e17-4d9b-9aae-f8d99cdd731b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:36.922933 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-119c225f-6e17-4d9b-9aae-f8d99cdd731b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:37.294980 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-119c225f-6e17-4d9b-9aae-f8d99cdd731b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "POST /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602/action" status: 202 len: 0 microversion: 2.1 time: 0.401772 Oct 05 02:43:37.300896 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1816/3606] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:43:36 2022] POST /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602/action => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:43:37.331726 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-aaa9e246-21a7-40be-b96d-a2661deb4cde tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:37.336684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-aaa9e246-21a7-40be-b96d-a2661deb4cde tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:37.361412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aaa9e246-21a7-40be-b96d-a2661deb4cde tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:37.363348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aaa9e246-21a7-40be-b96d-a2661deb4cde tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:37.365969 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aaa9e246-21a7-40be-b96d-a2661deb4cde tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:37.367941 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aaa9e246-21a7-40be-b96d-a2661deb4cde tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:37.371750 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aaa9e246-21a7-40be-b96d-a2661deb4cde tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:37.374287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aaa9e246-21a7-40be-b96d-a2661deb4cde tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:37.908486 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-aaa9e246-21a7-40be-b96d-a2661deb4cde tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:37.923684 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-73bb8078-daff-4341-ab94-44c4f4fc481e tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:37.928025 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-aaa9e246-21a7-40be-b96d-a2661deb4cde tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1468 microversion: 2.1 time: 0.621500 Oct 05 02:43:37.940928 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1817/3607] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:37 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1468 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:37.940928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7aab6641-21d3-4773-a66f-00bf91d36fc2 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:37.940928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7aab6641-21d3-4773-a66f-00bf91d36fc2 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:37.952661 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-73bb8078-daff-4341-ab94-44c4f4fc481e tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591" status: 200 len: 1507 microversion: 2.1 time: 1.139530 Oct 05 02:43:37.955861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7aab6641-21d3-4773-a66f-00bf91d36fc2 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:37.956808 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7aab6641-21d3-4773-a66f-00bf91d36fc2 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:37.957549 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7aab6641-21d3-4773-a66f-00bf91d36fc2 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:37.958510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7aab6641-21d3-4773-a66f-00bf91d36fc2 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:37.959213 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7aab6641-21d3-4773-a66f-00bf91d36fc2 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:37.960499 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7aab6641-21d3-4773-a66f-00bf91d36fc2 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:37.972593 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1791/3608] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:36 2022] GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591 => generated 1507 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:37.978281 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-812d50db-c8be-4619-aa62-f09f95351a24 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:37.979096 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-812d50db-c8be-4619-aa62-f09f95351a24 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 8b408fc3-0c45-490f-8c42-df0ce8e9f591] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:37.985792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-812d50db-c8be-4619-aa62-f09f95351a24 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:37.986548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-812d50db-c8be-4619-aa62-f09f95351a24 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:37.987139 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-812d50db-c8be-4619-aa62-f09f95351a24 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:37.988018 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-812d50db-c8be-4619-aa62-f09f95351a24 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:37.989020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-812d50db-c8be-4619-aa62-f09f95351a24 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:37.989877 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-812d50db-c8be-4619-aa62-f09f95351a24 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:38.344270 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7aab6641-21d3-4773-a66f-00bf91d36fc2 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:38.357137 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7aab6641-21d3-4773-a66f-00bf91d36fc2 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:38.364011 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7aab6641-21d3-4773-a66f-00bf91d36fc2 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:38.401020 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7aab6641-21d3-4773-a66f-00bf91d36fc2 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1546 microversion: 2.91 time: 0.452980 Oct 05 02:43:38.404028 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1818/3609] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:37 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1546 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:43:38.850408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-812d50db-c8be-4619-aa62-f09f95351a24 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:38.869406 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-812d50db-c8be-4619-aa62-f09f95351a24 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591" status: 200 len: 1507 microversion: 2.1 time: 0.886351 Oct 05 02:43:38.870069 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1792/3610] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:37 2022] GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591 => generated 1507 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:38.898234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2a9dd1e2-3e30-45f7-b946-76b1614f589a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:43:38.901897 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2a9dd1e2-3e30-45f7-b946-76b1614f589a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 8b408fc3-0c45-490f-8c42-df0ce8e9f591] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:38.947783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2a9dd1e2-3e30-45f7-b946-76b1614f589a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:38.949631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2a9dd1e2-3e30-45f7-b946-76b1614f589a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:38.950292 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2a9dd1e2-3e30-45f7-b946-76b1614f589a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:38.951939 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2a9dd1e2-3e30-45f7-b946-76b1614f589a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:38.954260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7c521f86-15db-40fb-8b90-48e9cfafe3d9 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:38.955387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2a9dd1e2-3e30-45f7-b946-76b1614f589a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:38.955892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2a9dd1e2-3e30-45f7-b946-76b1614f589a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:38.956537 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7c521f86-15db-40fb-8b90-48e9cfafe3d9 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:38.970983 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7c521f86-15db-40fb-8b90-48e9cfafe3d9 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:38.973243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7c521f86-15db-40fb-8b90-48e9cfafe3d9 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:38.975171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7c521f86-15db-40fb-8b90-48e9cfafe3d9 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:38.977614 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7c521f86-15db-40fb-8b90-48e9cfafe3d9 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:38.982660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7c521f86-15db-40fb-8b90-48e9cfafe3d9 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:38.983334 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7c521f86-15db-40fb-8b90-48e9cfafe3d9 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:39.064214 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2a9dd1e2-3e30-45f7-b946-76b1614f589a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "PUT /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591" status: 200 len: 1079 microversion: 2.1 time: 0.169926 Oct 05 02:43:39.065475 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1819/3611] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Oct 5 02:43:38 2022] PUT /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591 => generated 1079 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:39.087496 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-582b3699-12a4-4d79-9d91-1d19ae1be63f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:39.088601 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-582b3699-12a4-4d79-9d91-1d19ae1be63f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 8b408fc3-0c45-490f-8c42-df0ce8e9f591] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:39.104052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-582b3699-12a4-4d79-9d91-1d19ae1be63f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:39.107072 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-582b3699-12a4-4d79-9d91-1d19ae1be63f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:39.107704 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-582b3699-12a4-4d79-9d91-1d19ae1be63f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:39.113393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-582b3699-12a4-4d79-9d91-1d19ae1be63f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:39.113903 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-582b3699-12a4-4d79-9d91-1d19ae1be63f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:39.114596 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-582b3699-12a4-4d79-9d91-1d19ae1be63f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:39.210396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:39.990051 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-582b3699-12a4-4d79-9d91-1d19ae1be63f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:40.004387 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-582b3699-12a4-4d79-9d91-1d19ae1be63f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591" status: 200 len: 1505 microversion: 2.1 time: 0.924223 Oct 05 02:43:40.023997 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1820/3612] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:39 2022] GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591 => generated 1505 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:40.042992 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-45234d7b-e62e-49ac-ba34-7fe802accf96 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:40.044231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-45234d7b-e62e-49ac-ba34-7fe802accf96 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:40.068273 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-45234d7b-e62e-49ac-ba34-7fe802accf96 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:40.068792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-45234d7b-e62e-49ac-ba34-7fe802accf96 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:40.069270 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-45234d7b-e62e-49ac-ba34-7fe802accf96 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:40.070000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-45234d7b-e62e-49ac-ba34-7fe802accf96 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:40.080226 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-45234d7b-e62e-49ac-ba34-7fe802accf96 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:40.080734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-45234d7b-e62e-49ac-ba34-7fe802accf96 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:40.102876 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7c521f86-15db-40fb-8b90-48e9cfafe3d9 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:40.112402 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7c521f86-15db-40fb-8b90-48e9cfafe3d9 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1468 microversion: 2.1 time: 1.161837 Oct 05 02:43:40.113022 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1793/3613] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:38 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1468 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:43:40.167121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bdb02529-07e2-4563-bf26-1ba8e0ed0c10 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:40.168021 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bdb02529-07e2-4563-bf26-1ba8e0ed0c10 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 8b408fc3-0c45-490f-8c42-df0ce8e9f591] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:40.195832 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bdb02529-07e2-4563-bf26-1ba8e0ed0c10 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:40.196615 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bdb02529-07e2-4563-bf26-1ba8e0ed0c10 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:40.200502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bdb02529-07e2-4563-bf26-1ba8e0ed0c10 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:40.201472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bdb02529-07e2-4563-bf26-1ba8e0ed0c10 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:40.202105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bdb02529-07e2-4563-bf26-1ba8e0ed0c10 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:40.202722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bdb02529-07e2-4563-bf26-1ba8e0ed0c10 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:40.357989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-45234d7b-e62e-49ac-ba34-7fe802accf96 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:40.380966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-45234d7b-e62e-49ac-ba34-7fe802accf96 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:40.389687 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-45234d7b-e62e-49ac-ba34-7fe802accf96 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:40.422535 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-45234d7b-e62e-49ac-ba34-7fe802accf96 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1546 microversion: 2.91 time: 0.397263 Oct 05 02:43:40.430026 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1821/3614] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:40 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1546 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:43:40.727702 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bdb02529-07e2-4563-bf26-1ba8e0ed0c10 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:40.738546 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bdb02529-07e2-4563-bf26-1ba8e0ed0c10 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591" status: 200 len: 1505 microversion: 2.1 time: 0.582122 Oct 05 02:43:40.748516 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1794/3615] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:40 2022] GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591 => generated 1505 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:40.764252 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0ca5da28-dc26-4835-8c34-409ad8863852 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:43:40.767525 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0ca5da28-dc26-4835-8c34-409ad8863852 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 8b408fc3-0c45-490f-8c42-df0ce8e9f591] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:40.813166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ca5da28-dc26-4835-8c34-409ad8863852 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:40.818632 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ca5da28-dc26-4835-8c34-409ad8863852 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:40.819665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ca5da28-dc26-4835-8c34-409ad8863852 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:40.820617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ca5da28-dc26-4835-8c34-409ad8863852 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:40.825245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ca5da28-dc26-4835-8c34-409ad8863852 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:40.825990 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ca5da28-dc26-4835-8c34-409ad8863852 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:41.013678 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0ca5da28-dc26-4835-8c34-409ad8863852 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "PUT /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591" status: 200 len: 1081 microversion: 2.1 time: 0.252276 Oct 05 02:43:41.029705 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1822/3616] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Oct 5 02:43:40 2022] PUT /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591 => generated 1081 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:41.055423 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-37551686-b04c-424b-b24b-02298e8e8a53 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:41.056561 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-37551686-b04c-424b-b24b-02298e8e8a53 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 8b408fc3-0c45-490f-8c42-df0ce8e9f591] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:41.068463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37551686-b04c-424b-b24b-02298e8e8a53 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:41.071124 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37551686-b04c-424b-b24b-02298e8e8a53 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:41.074047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37551686-b04c-424b-b24b-02298e8e8a53 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:41.075920 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37551686-b04c-424b-b24b-02298e8e8a53 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:41.077281 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37551686-b04c-424b-b24b-02298e8e8a53 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:41.082181 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37551686-b04c-424b-b24b-02298e8e8a53 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:41.129376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-b502cd16-a0c4-4c64-ae63-89a529340042 req-3c602a13-e6fc-476f-a355-f8a118878b48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03081f70-6b52-497a-ab3f-27f86089c602", "name": "network-vif-plugged", "status": "completed", "tag": "7edc14f6-3b4b-460e-96c8-a6f177b5e033"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:43:41.150937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b502cd16-a0c4-4c64-ae63-89a529340042 req-3c602a13-e6fc-476f-a355-f8a118878b48 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:41.152719 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b502cd16-a0c4-4c64-ae63-89a529340042 req-3c602a13-e6fc-476f-a355-f8a118878b48 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:41.154804 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b502cd16-a0c4-4c64-ae63-89a529340042 req-3c602a13-e6fc-476f-a355-f8a118878b48 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:41.211827 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-b502cd16-a0c4-4c64-ae63-89a529340042 req-3c602a13-e6fc-476f-a355-f8a118878b48 service nova] Creating event network-vif-plugged:7edc14f6-3b4b-460e-96c8-a6f177b5e033 for instance 03081f70-6b52-497a-ab3f-27f86089c602 on n-h1-858272-3 Oct 05 02:43:41.241023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [req-b502cd16-a0c4-4c64-ae63-89a529340042 req-3c602a13-e6fc-476f-a355-f8a118878b48 service nova] Instance 03081f70-6b52-497a-ab3f-27f86089c602 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 02:43:41.304341 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-b502cd16-a0c4-4c64-ae63-89a529340042 req-3c602a13-e6fc-476f-a355-f8a118878b48 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179183 Oct 05 02:43:41.309217 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1823/3617] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:43:41.326341 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-13f3cec1-40e1-4497-a85d-5e2203a77d81 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:41.336628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-13f3cec1-40e1-4497-a85d-5e2203a77d81 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:41.379993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13f3cec1-40e1-4497-a85d-5e2203a77d81 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:41.380504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13f3cec1-40e1-4497-a85d-5e2203a77d81 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:41.380972 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13f3cec1-40e1-4497-a85d-5e2203a77d81 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:41.381696 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13f3cec1-40e1-4497-a85d-5e2203a77d81 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:41.382169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13f3cec1-40e1-4497-a85d-5e2203a77d81 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:41.382578 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13f3cec1-40e1-4497-a85d-5e2203a77d81 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:42.196534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-37551686-b04c-424b-b24b-02298e8e8a53 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:42.212309 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-37551686-b04c-424b-b24b-02298e8e8a53 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591" status: 200 len: 1507 microversion: 2.1 time: 1.162106 Oct 05 02:43:42.217688 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1795/3618] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:41 2022] GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591 => generated 1507 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:42.246089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d16a87ce-7a4d-437c-ac2b-18f49b25f175 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:42.249788 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d16a87ce-7a4d-437c-ac2b-18f49b25f175 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:42.269714 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d16a87ce-7a4d-437c-ac2b-18f49b25f175 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:42.271030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d16a87ce-7a4d-437c-ac2b-18f49b25f175 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:42.273218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d16a87ce-7a4d-437c-ac2b-18f49b25f175 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:42.275557 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d16a87ce-7a4d-437c-ac2b-18f49b25f175 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:42.276954 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d16a87ce-7a4d-437c-ac2b-18f49b25f175 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:42.278945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d16a87ce-7a4d-437c-ac2b-18f49b25f175 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:42.526616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d16a87ce-7a4d-437c-ac2b-18f49b25f175 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:42.555744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d16a87ce-7a4d-437c-ac2b-18f49b25f175 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:42.567372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d16a87ce-7a4d-437c-ac2b-18f49b25f175 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:42.578899 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-13f3cec1-40e1-4497-a85d-5e2203a77d81 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:42.594988 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d16a87ce-7a4d-437c-ac2b-18f49b25f175 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1546 microversion: 2.91 time: 0.359026 Oct 05 02:43:42.595546 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-13f3cec1-40e1-4497-a85d-5e2203a77d81 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1468 microversion: 2.1 time: 1.279525 Oct 05 02:43:42.595706 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1796/3619] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:42 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1546 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:43:42.602334 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1824/3620] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:41 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1468 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:42.674921 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1a7d652d-680b-4cea-a7d5-24ab142e2a38 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:42.675537 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1a7d652d-680b-4cea-a7d5-24ab142e2a38 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 8b408fc3-0c45-490f-8c42-df0ce8e9f591] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:42.703004 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a7d652d-680b-4cea-a7d5-24ab142e2a38 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:42.707261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a7d652d-680b-4cea-a7d5-24ab142e2a38 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:42.709237 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a7d652d-680b-4cea-a7d5-24ab142e2a38 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:42.710531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a7d652d-680b-4cea-a7d5-24ab142e2a38 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:42.711550 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a7d652d-680b-4cea-a7d5-24ab142e2a38 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:42.712237 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a7d652d-680b-4cea-a7d5-24ab142e2a38 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:43.118509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1a7d652d-680b-4cea-a7d5-24ab142e2a38 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:43.127623 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1a7d652d-680b-4cea-a7d5-24ab142e2a38 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591" status: 200 len: 1507 microversion: 2.1 time: 0.489334 Oct 05 02:43:43.129891 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1797/3621] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:42 2022] GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591 => generated 1507 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:43.157435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-864372b0-d56d-4167-9f5b-4f99f3fe97bf tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:43.158054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-864372b0-d56d-4167-9f5b-4f99f3fe97bf tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 8b408fc3-0c45-490f-8c42-df0ce8e9f591] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:43.175547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-864372b0-d56d-4167-9f5b-4f99f3fe97bf tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:43.179712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-864372b0-d56d-4167-9f5b-4f99f3fe97bf tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:43.180669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-864372b0-d56d-4167-9f5b-4f99f3fe97bf tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:43.183507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-864372b0-d56d-4167-9f5b-4f99f3fe97bf tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:43.184287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-864372b0-d56d-4167-9f5b-4f99f3fe97bf tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:43.185063 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-864372b0-d56d-4167-9f5b-4f99f3fe97bf tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:43.318899 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-864372b0-d56d-4167-9f5b-4f99f3fe97bf tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 8b408fc3-0c45-490f-8c42-df0ce8e9f591] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:43:43.640066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-703a7913-25be-4dd3-a256-071986e9d6dc tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:43.642249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-703a7913-25be-4dd3-a256-071986e9d6dc tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:43.656454 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-703a7913-25be-4dd3-a256-071986e9d6dc tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:43.660604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-703a7913-25be-4dd3-a256-071986e9d6dc tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:43.661450 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-703a7913-25be-4dd3-a256-071986e9d6dc tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:43.662503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-703a7913-25be-4dd3-a256-071986e9d6dc tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:43.665224 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-703a7913-25be-4dd3-a256-071986e9d6dc tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:43.665889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-703a7913-25be-4dd3-a256-071986e9d6dc tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:43.703786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:43.769831 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-864372b0-d56d-4167-9f5b-4f99f3fe97bf tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591" status: 204 len: 0 microversion: 2.1 time: 0.615670 Oct 05 02:43:43.772267 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1825/3622] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:43:43 2022] DELETE /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:43:43.781122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-48b3016a-b3f9-4ba0-bd6c-823112bc0733 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:43.795357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-48b3016a-b3f9-4ba0-bd6c-823112bc0733 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:43.806820 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48b3016a-b3f9-4ba0-bd6c-823112bc0733 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:43.808275 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48b3016a-b3f9-4ba0-bd6c-823112bc0733 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:43.808934 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48b3016a-b3f9-4ba0-bd6c-823112bc0733 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:43.810046 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48b3016a-b3f9-4ba0-bd6c-823112bc0733 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:43.810702 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48b3016a-b3f9-4ba0-bd6c-823112bc0733 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:43.811408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48b3016a-b3f9-4ba0-bd6c-823112bc0733 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:44.122812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-48b3016a-b3f9-4ba0-bd6c-823112bc0733 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:44.140374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-48b3016a-b3f9-4ba0-bd6c-823112bc0733 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:44.142466 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-48b3016a-b3f9-4ba0-bd6c-823112bc0733 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:44.152715 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-48b3016a-b3f9-4ba0-bd6c-823112bc0733 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1546 microversion: 2.91 time: 0.378730 Oct 05 02:43:44.156059 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1826/3623] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:43 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1546 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:43:44.193520 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d24a6103-edba-464e-bd02-5a74a9036922 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:44.201936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d24a6103-edba-464e-bd02-5a74a9036922 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 8b408fc3-0c45-490f-8c42-df0ce8e9f591] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:44.221015 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d24a6103-edba-464e-bd02-5a74a9036922 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:44.222417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d24a6103-edba-464e-bd02-5a74a9036922 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:44.223639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d24a6103-edba-464e-bd02-5a74a9036922 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:44.225795 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d24a6103-edba-464e-bd02-5a74a9036922 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:44.226473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d24a6103-edba-464e-bd02-5a74a9036922 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:44.230850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d24a6103-edba-464e-bd02-5a74a9036922 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:44.292551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d24a6103-edba-464e-bd02-5a74a9036922 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 8b408fc3-0c45-490f-8c42-df0ce8e9f591] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:43:44.409500 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.compute.api [None req-d24a6103-edba-464e-bd02-5a74a9036922 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 8b408fc3-0c45-490f-8c42-df0ce8e9f591] Instance is already in deleting state, ignoring this request Oct 05 02:43:44.414118 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d24a6103-edba-464e-bd02-5a74a9036922 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591" status: 204 len: 0 microversion: 2.1 time: 0.256262 Oct 05 02:43:44.415952 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1827/3624] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:43:44 2022] DELETE /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:43:44.430699 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-224daa6d-f79c-4dd8-99cf-45138a53d8f4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:44.431649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-224daa6d-f79c-4dd8-99cf-45138a53d8f4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 8b408fc3-0c45-490f-8c42-df0ce8e9f591] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:44.449960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-703a7913-25be-4dd3-a256-071986e9d6dc tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:44.463064 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-703a7913-25be-4dd3-a256-071986e9d6dc tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1468 microversion: 2.1 time: 0.827837 Oct 05 02:43:44.464825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-224daa6d-f79c-4dd8-99cf-45138a53d8f4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:44.465376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-224daa6d-f79c-4dd8-99cf-45138a53d8f4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:44.465819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-224daa6d-f79c-4dd8-99cf-45138a53d8f4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:44.466539 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-224daa6d-f79c-4dd8-99cf-45138a53d8f4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:44.466987 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-224daa6d-f79c-4dd8-99cf-45138a53d8f4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:44.467407 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-224daa6d-f79c-4dd8-99cf-45138a53d8f4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:44.468456 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1798/3625] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:43 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1468 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:45.185742 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-982ad854-9afc-46b4-9586-3ecc1ab7735d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:45.186439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-982ad854-9afc-46b4-9586-3ecc1ab7735d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:45.203600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-982ad854-9afc-46b4-9586-3ecc1ab7735d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:45.204631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-982ad854-9afc-46b4-9586-3ecc1ab7735d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:45.205798 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-982ad854-9afc-46b4-9586-3ecc1ab7735d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:45.206744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-982ad854-9afc-46b4-9586-3ecc1ab7735d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:45.207386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-982ad854-9afc-46b4-9586-3ecc1ab7735d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:45.207998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-982ad854-9afc-46b4-9586-3ecc1ab7735d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:45.768167 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-224daa6d-f79c-4dd8-99cf-45138a53d8f4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:45.776621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-982ad854-9afc-46b4-9586-3ecc1ab7735d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:45.787995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-982ad854-9afc-46b4-9586-3ecc1ab7735d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:45.791350 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-224daa6d-f79c-4dd8-99cf-45138a53d8f4 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591" status: 200 len: 1513 microversion: 2.1 time: 1.371013 Oct 05 02:43:45.793300 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-982ad854-9afc-46b4-9586-3ecc1ab7735d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:45.805843 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1828/3626] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:44 2022] GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591 => generated 1513 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:45.824274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9bec996f-3e4b-4840-ae7b-25f02967826d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:45.825544 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-982ad854-9afc-46b4-9586-3ecc1ab7735d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1546 microversion: 2.91 time: 0.641022 Oct 05 02:43:45.827260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9bec996f-3e4b-4840-ae7b-25f02967826d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:45.827716 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1799/3627] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:45 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1546 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:43:45.840129 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-404c5112-a53c-433e-af3f-9e91b0dc94a2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:45.842528 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9bec996f-3e4b-4840-ae7b-25f02967826d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:45.843486 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-404c5112-a53c-433e-af3f-9e91b0dc94a2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:45.846012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9bec996f-3e4b-4840-ae7b-25f02967826d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:45.846738 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9bec996f-3e4b-4840-ae7b-25f02967826d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:45.849121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9bec996f-3e4b-4840-ae7b-25f02967826d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:45.851484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9bec996f-3e4b-4840-ae7b-25f02967826d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:45.852184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9bec996f-3e4b-4840-ae7b-25f02967826d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:45.856816 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-404c5112-a53c-433e-af3f-9e91b0dc94a2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:45.857625 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-404c5112-a53c-433e-af3f-9e91b0dc94a2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:45.860489 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-404c5112-a53c-433e-af3f-9e91b0dc94a2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:45.861685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-404c5112-a53c-433e-af3f-9e91b0dc94a2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:45.862401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-404c5112-a53c-433e-af3f-9e91b0dc94a2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:45.864217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-404c5112-a53c-433e-af3f-9e91b0dc94a2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:47.246771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-404c5112-a53c-433e-af3f-9e91b0dc94a2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:47.265582 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-404c5112-a53c-433e-af3f-9e91b0dc94a2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1682 microversion: 2.1 time: 1.436547 Oct 05 02:43:47.284552 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1800/3628] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:45 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1682 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:47.287817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-ea37ad95-330d-44b8-88a4-603e17eccf50 req-7492a829-d5bf-4f6e-b2bd-534276b601cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03081f70-6b52-497a-ab3f-27f86089c602", "name": "network-vif-unplugged", "status": "completed", "tag": "7edc14f6-3b4b-460e-96c8-a6f177b5e033"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:43:47.288392 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9bec996f-3e4b-4840-ae7b-25f02967826d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:47.312366 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ea37ad95-330d-44b8-88a4-603e17eccf50 req-7492a829-d5bf-4f6e-b2bd-534276b601cc service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:47.312851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ea37ad95-330d-44b8-88a4-603e17eccf50 req-7492a829-d5bf-4f6e-b2bd-534276b601cc service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:47.313883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ea37ad95-330d-44b8-88a4-603e17eccf50 req-7492a829-d5bf-4f6e-b2bd-534276b601cc service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:47.320935 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9bec996f-3e4b-4840-ae7b-25f02967826d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1468 microversion: 2.1 time: 1.507171 Oct 05 02:43:47.328085 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1829/3629] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:45 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1468 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:47.369130 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-ea37ad95-330d-44b8-88a4-603e17eccf50 req-7492a829-d5bf-4f6e-b2bd-534276b601cc service nova] Creating event network-vif-unplugged:7edc14f6-3b4b-460e-96c8-a6f177b5e033 for instance 03081f70-6b52-497a-ab3f-27f86089c602 on n-h2-858272-3 Oct 05 02:43:47.387214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-26514a41-fb35-491f-b3a2-f635f29647d8 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:47.392297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-26514a41-fb35-491f-b3a2-f635f29647d8 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 8b408fc3-0c45-490f-8c42-df0ce8e9f591] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:47.393332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [req-ea37ad95-330d-44b8-88a4-603e17eccf50 req-7492a829-d5bf-4f6e-b2bd-534276b601cc service nova] Instance 03081f70-6b52-497a-ab3f-27f86089c602 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122319) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 02:43:47.431099 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-26514a41-fb35-491f-b3a2-f635f29647d8 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:47.433343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-26514a41-fb35-491f-b3a2-f635f29647d8 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:47.434269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-26514a41-fb35-491f-b3a2-f635f29647d8 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:47.435222 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-26514a41-fb35-491f-b3a2-f635f29647d8 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:47.435397 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-ea37ad95-330d-44b8-88a4-603e17eccf50 req-7492a829-d5bf-4f6e-b2bd-534276b601cc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.154090 Oct 05 02:43:47.436440 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1801/3630] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:43:47.437060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-26514a41-fb35-491f-b3a2-f635f29647d8 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:47.437735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-26514a41-fb35-491f-b3a2-f635f29647d8 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:47.460176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-de832d04-2c4a-4ff0-969c-a9ad27e048df tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:47.463294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-de832d04-2c4a-4ff0-969c-a9ad27e048df tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:47.481356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de832d04-2c4a-4ff0-969c-a9ad27e048df tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:47.485322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de832d04-2c4a-4ff0-969c-a9ad27e048df tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:47.485998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de832d04-2c4a-4ff0-969c-a9ad27e048df tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:47.487566 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de832d04-2c4a-4ff0-969c-a9ad27e048df tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:47.488227 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de832d04-2c4a-4ff0-969c-a9ad27e048df tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:47.489383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de832d04-2c4a-4ff0-969c-a9ad27e048df tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:47.521867 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:47.843189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-de832d04-2c4a-4ff0-969c-a9ad27e048df tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:47.865064 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-de832d04-2c4a-4ff0-969c-a9ad27e048df tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:47.871459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-de832d04-2c4a-4ff0-969c-a9ad27e048df tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:47.889611 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-de832d04-2c4a-4ff0-969c-a9ad27e048df tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1546 microversion: 2.91 time: 0.449112 Oct 05 02:43:47.890159 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1802/3631] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:47 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1546 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:43:47.915525 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-b06534c2-01b0-4abb-b2c6-d23a07a300f9 req-82e7cc83-77d4-47b5-aae3-f7aad6578ef4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b408fc3-0c45-490f-8c42-df0ce8e9f591", "name": "network-vif-unplugged", "status": "completed", "tag": "711a059e-96a5-4a9b-b279-8338cdce3565"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:43:47.939600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b06534c2-01b0-4abb-b2c6-d23a07a300f9 req-82e7cc83-77d4-47b5-aae3-f7aad6578ef4 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:47.940150 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b06534c2-01b0-4abb-b2c6-d23a07a300f9 req-82e7cc83-77d4-47b5-aae3-f7aad6578ef4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:47.940587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b06534c2-01b0-4abb-b2c6-d23a07a300f9 req-82e7cc83-77d4-47b5-aae3-f7aad6578ef4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:47.970767 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-26514a41-fb35-491f-b3a2-f635f29647d8 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:47.979712 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-26514a41-fb35-491f-b3a2-f635f29647d8 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591" status: 200 len: 1513 microversion: 2.1 time: 0.626542 Oct 05 02:43:47.982293 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-b06534c2-01b0-4abb-b2c6-d23a07a300f9 req-82e7cc83-77d4-47b5-aae3-f7aad6578ef4 service nova] Creating event network-vif-unplugged:711a059e-96a5-4a9b-b279-8338cdce3565 for instance 8b408fc3-0c45-490f-8c42-df0ce8e9f591 on n-h1-858272-3 Oct 05 02:43:47.986086 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1830/3632] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:47 2022] GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591 => generated 1513 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:47.990448 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-b06534c2-01b0-4abb-b2c6-d23a07a300f9 req-82e7cc83-77d4-47b5-aae3-f7aad6578ef4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094288 Oct 05 02:43:47.991495 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1803/3633] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:43:48.297106 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0ea2cfd1-c745-490e-af59-c9053a285415 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:48.299740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0ea2cfd1-c745-490e-af59-c9053a285415 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:48.334867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ea2cfd1-c745-490e-af59-c9053a285415 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:48.337449 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ea2cfd1-c745-490e-af59-c9053a285415 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:48.342213 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ea2cfd1-c745-490e-af59-c9053a285415 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:48.346153 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ea2cfd1-c745-490e-af59-c9053a285415 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:48.348489 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ea2cfd1-c745-490e-af59-c9053a285415 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:48.350460 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ea2cfd1-c745-490e-af59-c9053a285415 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:48.360608 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-98ffabee-5f3c-41af-bb76-12d2a3fa91c3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:48.361498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-98ffabee-5f3c-41af-bb76-12d2a3fa91c3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:48.378567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98ffabee-5f3c-41af-bb76-12d2a3fa91c3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:48.382560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98ffabee-5f3c-41af-bb76-12d2a3fa91c3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:48.383046 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98ffabee-5f3c-41af-bb76-12d2a3fa91c3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:48.383816 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98ffabee-5f3c-41af-bb76-12d2a3fa91c3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:48.384326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98ffabee-5f3c-41af-bb76-12d2a3fa91c3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:48.384760 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98ffabee-5f3c-41af-bb76-12d2a3fa91c3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:49.425452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-98ffabee-5f3c-41af-bb76-12d2a3fa91c3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:49.474033 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-98ffabee-5f3c-41af-bb76-12d2a3fa91c3 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1468 microversion: 2.1 time: 1.118995 Oct 05 02:43:49.474551 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1804/3634] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:48 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1468 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:49.513003 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e8888ef8-9316-4390-a8c3-1d8dbc385f72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:49.524521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e8888ef8-9316-4390-a8c3-1d8dbc385f72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:49.527024 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=81 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:49.538784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8888ef8-9316-4390-a8c3-1d8dbc385f72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:49.543362 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8888ef8-9316-4390-a8c3-1d8dbc385f72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:49.544037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8888ef8-9316-4390-a8c3-1d8dbc385f72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:49.545030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8888ef8-9316-4390-a8c3-1d8dbc385f72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:49.546541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8888ef8-9316-4390-a8c3-1d8dbc385f72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:49.549231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8888ef8-9316-4390-a8c3-1d8dbc385f72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:49.769194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e8888ef8-9316-4390-a8c3-1d8dbc385f72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:49.778804 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e8888ef8-9316-4390-a8c3-1d8dbc385f72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:49.792592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e8888ef8-9316-4390-a8c3-1d8dbc385f72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:49.825566 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e8888ef8-9316-4390-a8c3-1d8dbc385f72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1546 microversion: 2.91 time: 0.311912 Oct 05 02:43:49.826909 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1805/3635] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:49 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1546 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:43:49.841522 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1e3c37c5-a238-4139-b564-71c17ce5e55f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:49.842544 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1e3c37c5-a238-4139-b564-71c17ce5e55f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 8b408fc3-0c45-490f-8c42-df0ce8e9f591] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:49.849599 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e3c37c5-a238-4139-b564-71c17ce5e55f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:49.850430 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e3c37c5-a238-4139-b564-71c17ce5e55f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:49.851119 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e3c37c5-a238-4139-b564-71c17ce5e55f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:49.857890 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e3c37c5-a238-4139-b564-71c17ce5e55f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:49.858773 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e3c37c5-a238-4139-b564-71c17ce5e55f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:49.859502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e3c37c5-a238-4139-b564-71c17ce5e55f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:49.869160 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0ea2cfd1-c745-490e-af59-c9053a285415 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:49.888424 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0ea2cfd1-c745-490e-af59-c9053a285415 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 1.600071 Oct 05 02:43:49.900932 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1831/3636] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:48 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:49.919815 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-17923bb3-e797-4194-9a02-942dfbd0822c req-e5f2e95c-2fa7-492a-89e3-72c8d9b7d007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b408fc3-0c45-490f-8c42-df0ce8e9f591", "name": "network-vif-deleted", "tag": "711a059e-96a5-4a9b-b279-8338cdce3565"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:43:49.958222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e3c37c5-a238-4139-b564-71c17ce5e55f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:49.958721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e3c37c5-a238-4139-b564-71c17ce5e55f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:49.959166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e3c37c5-a238-4139-b564-71c17ce5e55f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:49.959629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-1e3c37c5-a238-4139-b564-71c17ce5e55f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lazy-loading 'fault' on Instance uuid 8b408fc3-0c45-490f-8c42-df0ce8e9f591 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:43:49.973920 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-17923bb3-e797-4194-9a02-942dfbd0822c req-e5f2e95c-2fa7-492a-89e3-72c8d9b7d007 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:49.974456 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-17923bb3-e797-4194-9a02-942dfbd0822c req-e5f2e95c-2fa7-492a-89e3-72c8d9b7d007 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:49.974901 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-17923bb3-e797-4194-9a02-942dfbd0822c req-e5f2e95c-2fa7-492a-89e3-72c8d9b7d007 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:50.032701 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-17923bb3-e797-4194-9a02-942dfbd0822c req-e5f2e95c-2fa7-492a-89e3-72c8d9b7d007 service nova] Creating event network-vif-deleted:711a059e-96a5-4a9b-b279-8338cdce3565 for instance 8b408fc3-0c45-490f-8c42-df0ce8e9f591 on n-h1-858272-3 Oct 05 02:43:50.046446 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-17923bb3-e797-4194-9a02-942dfbd0822c req-e5f2e95c-2fa7-492a-89e3-72c8d9b7d007 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150329 Oct 05 02:43:50.049836 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1832/3637] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:43:50.066992 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-db6174a3-b50a-46e4-8e07-87cada3a4c3a req-c5d228d8-3658-426c-b051-fc048df02a85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03081f70-6b52-497a-ab3f-27f86089c602", "tag": "7edc14f6-3b4b-460e-96c8-a6f177b5e033"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:43:50.083276 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1e3c37c5-a238-4139-b564-71c17ce5e55f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9211cfded73b4747b3cb63bcfb3c3ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:50.087623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-db6174a3-b50a-46e4-8e07-87cada3a4c3a req-c5d228d8-3658-426c-b051-fc048df02a85 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:50.088526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-db6174a3-b50a-46e4-8e07-87cada3a4c3a req-c5d228d8-3658-426c-b051-fc048df02a85 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:50.089343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-db6174a3-b50a-46e4-8e07-87cada3a4c3a req-c5d228d8-3658-426c-b051-fc048df02a85 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:50.092555 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1e3c37c5-a238-4139-b564-71c17ce5e55f tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591" status: 200 len: 1307 microversion: 2.1 time: 0.264288 Oct 05 02:43:50.101902 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1806/3638] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:49 2022] GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591 => generated 1307 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:50.114250 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-db6174a3-b50a-46e4-8e07-87cada3a4c3a req-c5d228d8-3658-426c-b051-fc048df02a85 service nova] Creating event network-changed:7edc14f6-3b4b-460e-96c8-a6f177b5e033 for instance 03081f70-6b52-497a-ab3f-27f86089c602 on n-h2-858272-3 Oct 05 02:43:50.115176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0e4d50ae-4bf4-4577-b009-623d3b944b30 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-129893011"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:43:50.123388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0e4d50ae-4bf4-4577-b009-623d3b944b30 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:50.124260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [req-db6174a3-b50a-46e4-8e07-87cada3a4c3a req-c5d228d8-3658-426c-b051-fc048df02a85 service nova] Instance 03081f70-6b52-497a-ab3f-27f86089c602 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 02:43:50.142268 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e4d50ae-4bf4-4577-b009-623d3b944b30 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:50.142834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e4d50ae-4bf4-4577-b009-623d3b944b30 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:50.146712 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-db6174a3-b50a-46e4-8e07-87cada3a4c3a req-c5d228d8-3658-426c-b051-fc048df02a85 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093738 Oct 05 02:43:50.147862 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1833/3639] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:43:50.158026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-e5a83993-4f39-4f34-b352-2c6750f2e416 req-a05cf6a4-b6ce-4272-8645-70e88f4bf5d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4388e9ec-13a9-4d5b-9310-7a10953c57d0", "name": "network-vif-unplugged", "status": "completed", "tag": "17b098e0-7358-489c-bec3-6b98c1db0796"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:43:50.162444 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e4d50ae-4bf4-4577-b009-623d3b944b30 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:50.163406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e4d50ae-4bf4-4577-b009-623d3b944b30 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:50.163989 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e4d50ae-4bf4-4577-b009-623d3b944b30 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:50.166552 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e4d50ae-4bf4-4577-b009-623d3b944b30 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:50.187844 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e5a83993-4f39-4f34-b352-2c6750f2e416 req-a05cf6a4-b6ce-4272-8645-70e88f4bf5d0 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:50.193319 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e5a83993-4f39-4f34-b352-2c6750f2e416 req-a05cf6a4-b6ce-4272-8645-70e88f4bf5d0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:50.193319 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e5a83993-4f39-4f34-b352-2c6750f2e416 req-a05cf6a4-b6ce-4272-8645-70e88f4bf5d0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:50.215304 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-e5a83993-4f39-4f34-b352-2c6750f2e416 req-a05cf6a4-b6ce-4272-8645-70e88f4bf5d0 service nova] Creating event network-vif-unplugged:17b098e0-7358-489c-bec3-6b98c1db0796 for instance 4388e9ec-13a9-4d5b-9310-7a10953c57d0 on n-h1-858272-3 Oct 05 02:43:50.226036 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-e5a83993-4f39-4f34-b352-2c6750f2e416 req-a05cf6a4-b6ce-4272-8645-70e88f4bf5d0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075701 Oct 05 02:43:50.232041 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1834/3640] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:43:50.510383 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b958a92d-9a1d-44e7-8a73-3209ae4afc4d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:50.511117 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b958a92d-9a1d-44e7-8a73-3209ae4afc4d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:50.560587 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b958a92d-9a1d-44e7-8a73-3209ae4afc4d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:50.561977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b958a92d-9a1d-44e7-8a73-3209ae4afc4d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:50.564187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b958a92d-9a1d-44e7-8a73-3209ae4afc4d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:50.567414 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b958a92d-9a1d-44e7-8a73-3209ae4afc4d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:50.569630 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b958a92d-9a1d-44e7-8a73-3209ae4afc4d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:50.571724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b958a92d-9a1d-44e7-8a73-3209ae4afc4d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:50.587209 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:50.777815 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0e4d50ae-4bf4-4577-b009-623d3b944b30 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action" status: 202 len: 0 microversion: 2.1 time: 0.672263 Oct 05 02:43:50.780795 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1807/3641] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:43:50 2022] POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action => generated 0 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 05 02:43:50.874735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6f2152ab-f28e-4662-b60f-04932bf696ca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:50.875958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6f2152ab-f28e-4662-b60f-04932bf696ca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:50.897439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f2152ab-f28e-4662-b60f-04932bf696ca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:50.902748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f2152ab-f28e-4662-b60f-04932bf696ca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:50.903771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f2152ab-f28e-4662-b60f-04932bf696ca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:50.904998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f2152ab-f28e-4662-b60f-04932bf696ca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:50.906347 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f2152ab-f28e-4662-b60f-04932bf696ca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:50.907679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f2152ab-f28e-4662-b60f-04932bf696ca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:51.103172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6f2152ab-f28e-4662-b60f-04932bf696ca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:51.124279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6f2152ab-f28e-4662-b60f-04932bf696ca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:51.146876 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6f2152ab-f28e-4662-b60f-04932bf696ca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:51.165380 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6f2152ab-f28e-4662-b60f-04932bf696ca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1546 microversion: 2.91 time: 0.303561 Oct 05 02:43:51.177786 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1808/3642] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:50 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1546 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:43:51.194517 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-62e1a1c2-b8c0-41bc-ba15-098b85c2f785 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:51.205866 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-62e1a1c2-b8c0-41bc-ba15-098b85c2f785 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 8b408fc3-0c45-490f-8c42-df0ce8e9f591] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:51.215388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62e1a1c2-b8c0-41bc-ba15-098b85c2f785 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:51.219934 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62e1a1c2-b8c0-41bc-ba15-098b85c2f785 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:51.220837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62e1a1c2-b8c0-41bc-ba15-098b85c2f785 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:51.227878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62e1a1c2-b8c0-41bc-ba15-098b85c2f785 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:51.243976 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62e1a1c2-b8c0-41bc-ba15-098b85c2f785 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:51.245004 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62e1a1c2-b8c0-41bc-ba15-098b85c2f785 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:51.272069 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-62e1a1c2-b8c0-41bc-ba15-098b85c2f785 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] HTTP exception thrown: Instance 8b408fc3-0c45-490f-8c42-df0ce8e9f591 could not be found. Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-62e1a1c2-b8c0-41bc-ba15-098b85c2f785 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Request method failure captured: Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591 HTTP/1.1 Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO6mohoxNe2F_Neq0fKaid9U7yaEEVXZbrSOimZx0MIF1DumnY7YoElyIeXyuC0-SsSfKuT5sj95y0S0NeKzH0fWl5H0ecgXhQ5OxgORdOGtVtIPQWDKQKNRJPZJKg9pc5wrND3AjR4tGhx_-QctKX_KDBVcr0GL7firM9UUpWd-xMc Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 58c3c2b9910b4ba48a52cb1e3f1ef254 Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1315804487 Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58c3c2b9910b4ba48a52cb1e3f1ef254"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58c3c2b9910b4ba48a52cb1e3f1ef254"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/58c3c2b9910b4ba48a52cb1e3f1ef254"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_58c3c2b9910b4ba48a52cb1e3f1ef254"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerDiskConfigTestJSON-1315804487 Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 58c3c2b9910b4ba48a52cb1e3f1ef254 Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1315804487 Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerDiskConfigTestJSON-1315804487-project Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 9211cfded73b4747b3cb63bcfb3c3ff8 Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerDiskConfigTestJSON-1315804487-project Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 8b408fc3-0c45-490f-8c42-df0ce8e9f591 could not be found. Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '8b408fc3-0c45-490f-8c42-df0ce8e9f591'} Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b408fc3-0c45-490f-8c42-df0ce8e9f591 could not be found. Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b408fc3-0c45-490f-8c42-df0ce8e9f591 could not be found. Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:43:51.282908 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:43:51.289735 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:43:51.289735 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:43:51.289735 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:43:51.289735 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:43:51.289735 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:43:51.289735 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b408fc3-0c45-490f-8c42-df0ce8e9f591 could not be found. Oct 05 02:43:51.289735 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:43:51.293225 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-62e1a1c2-b8c0-41bc-ba15-098b85c2f785 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Returning 404 to user: Instance 8b408fc3-0c45-490f-8c42-df0ce8e9f591 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:43:51.294583 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-62e1a1c2-b8c0-41bc-ba15-098b85c2f785 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591" status: 404 len: 111 microversion: 2.1 time: 0.115277 Oct 05 02:43:51.299949 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1809/3643] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:51 2022] GET /compute/v2.1/servers/8b408fc3-0c45-490f-8c42-df0ce8e9f591 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:43:51.309692 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1ef9c03b-6c81-4975-93d5-cefb22b5a01a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:51.310599 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1ef9c03b-6c81-4975-93d5-cefb22b5a01a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:51.319459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ef9c03b-6c81-4975-93d5-cefb22b5a01a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:51.320363 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ef9c03b-6c81-4975-93d5-cefb22b5a01a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:51.321115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ef9c03b-6c81-4975-93d5-cefb22b5a01a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:51.322637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ef9c03b-6c81-4975-93d5-cefb22b5a01a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:51.323366 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ef9c03b-6c81-4975-93d5-cefb22b5a01a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:51.324060 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ef9c03b-6c81-4975-93d5-cefb22b5a01a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:51.364966 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-1ef9c03b-6c81-4975-93d5-cefb22b5a01a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] HTTP exception thrown: Instance 91e1df96-3094-46e9-a96a-adb0aa39d976 could not be found. Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1ef9c03b-6c81-4975-93d5-cefb22b5a01a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Request method failure captured: Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 HTTP/1.1 Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO6mohoxNe2F_Neq0fKaid9U7yaEEVXZbrSOimZx0MIF1DumnY7YoElyIeXyuC0-SsSfKuT5sj95y0S0NeKzH0fWl5H0ecgXhQ5OxgORdOGtVtIPQWDKQKNRJPZJKg9pc5wrND3AjR4tGhx_-QctKX_KDBVcr0GL7firM9UUpWd-xMc Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 58c3c2b9910b4ba48a52cb1e3f1ef254 Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1315804487 Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58c3c2b9910b4ba48a52cb1e3f1ef254"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58c3c2b9910b4ba48a52cb1e3f1ef254"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/58c3c2b9910b4ba48a52cb1e3f1ef254"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_58c3c2b9910b4ba48a52cb1e3f1ef254"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerDiskConfigTestJSON-1315804487 Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 58c3c2b9910b4ba48a52cb1e3f1ef254 Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1315804487 Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerDiskConfigTestJSON-1315804487-project Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 9211cfded73b4747b3cb63bcfb3c3ff8 Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerDiskConfigTestJSON-1315804487-project Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 91e1df96-3094-46e9-a96a-adb0aa39d976 could not be found. Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '91e1df96-3094-46e9-a96a-adb0aa39d976'} Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91e1df96-3094-46e9-a96a-adb0aa39d976 could not be found. Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:43:51.369037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:43:51.373669 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91e1df96-3094-46e9-a96a-adb0aa39d976 could not be found. Oct 05 02:43:51.373669 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:43:51.373669 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:43:51.373669 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:43:51.373669 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:43:51.373669 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:43:51.373669 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:43:51.373669 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:43:51.373669 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:43:51.373669 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91e1df96-3094-46e9-a96a-adb0aa39d976 could not be found. Oct 05 02:43:51.373669 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:43:51.380735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1ef9c03b-6c81-4975-93d5-cefb22b5a01a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Returning 404 to user: Instance 91e1df96-3094-46e9-a96a-adb0aa39d976 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:43:51.383653 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1ef9c03b-6c81-4975-93d5-cefb22b5a01a tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "DELETE /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 404 len: 111 microversion: 2.1 time: 0.078780 Oct 05 02:43:51.386196 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1810/3644] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:43:51 2022] DELETE /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:43:51.397985 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-08a02ce8-221b-4ae7-94b8-8e0d3e1748b5 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:51.409846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-08a02ce8-221b-4ae7-94b8-8e0d3e1748b5 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 91e1df96-3094-46e9-a96a-adb0aa39d976] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:51.416974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08a02ce8-221b-4ae7-94b8-8e0d3e1748b5 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:51.417841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08a02ce8-221b-4ae7-94b8-8e0d3e1748b5 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:51.418558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08a02ce8-221b-4ae7-94b8-8e0d3e1748b5 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:51.425960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08a02ce8-221b-4ae7-94b8-8e0d3e1748b5 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:51.426796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08a02ce8-221b-4ae7-94b8-8e0d3e1748b5 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:51.427479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08a02ce8-221b-4ae7-94b8-8e0d3e1748b5 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:51.456417 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-08a02ce8-221b-4ae7-94b8-8e0d3e1748b5 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] HTTP exception thrown: Instance 91e1df96-3094-46e9-a96a-adb0aa39d976 could not be found. Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-08a02ce8-221b-4ae7-94b8-8e0d3e1748b5 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Request method failure captured: Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 HTTP/1.1 Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO6mohoxNe2F_Neq0fKaid9U7yaEEVXZbrSOimZx0MIF1DumnY7YoElyIeXyuC0-SsSfKuT5sj95y0S0NeKzH0fWl5H0ecgXhQ5OxgORdOGtVtIPQWDKQKNRJPZJKg9pc5wrND3AjR4tGhx_-QctKX_KDBVcr0GL7firM9UUpWd-xMc Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 58c3c2b9910b4ba48a52cb1e3f1ef254 Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1315804487 Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58c3c2b9910b4ba48a52cb1e3f1ef254"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58c3c2b9910b4ba48a52cb1e3f1ef254"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/58c3c2b9910b4ba48a52cb1e3f1ef254"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_58c3c2b9910b4ba48a52cb1e3f1ef254"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerDiskConfigTestJSON-1315804487 Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 58c3c2b9910b4ba48a52cb1e3f1ef254 Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1315804487 Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerDiskConfigTestJSON-1315804487-project Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 9211cfded73b4747b3cb63bcfb3c3ff8 Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerDiskConfigTestJSON-1315804487-project Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 91e1df96-3094-46e9-a96a-adb0aa39d976 could not be found. Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '91e1df96-3094-46e9-a96a-adb0aa39d976'} Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91e1df96-3094-46e9-a96a-adb0aa39d976 could not be found. Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91e1df96-3094-46e9-a96a-adb0aa39d976 could not be found. Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:43:51.458430 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:43:51.463205 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:43:51.463205 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:43:51.463205 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:43:51.463205 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:43:51.463205 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:43:51.463205 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91e1df96-3094-46e9-a96a-adb0aa39d976 could not be found. Oct 05 02:43:51.463205 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:43:51.466995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-08a02ce8-221b-4ae7-94b8-8e0d3e1748b5 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Returning 404 to user: Instance 91e1df96-3094-46e9-a96a-adb0aa39d976 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:43:51.471280 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-08a02ce8-221b-4ae7-94b8-8e0d3e1748b5 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976" status: 404 len: 111 microversion: 2.1 time: 0.076573 Oct 05 02:43:51.473596 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1811/3645] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:51 2022] GET /compute/v2.1/servers/91e1df96-3094-46e9-a96a-adb0aa39d976 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:43:51.483031 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7d0b466d-dbdf-44da-b179-6aa2722acd5d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:51.489951 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7d0b466d-dbdf-44da-b179-6aa2722acd5d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:51.502067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d0b466d-dbdf-44da-b179-6aa2722acd5d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:51.505758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d0b466d-dbdf-44da-b179-6aa2722acd5d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:51.506643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d0b466d-dbdf-44da-b179-6aa2722acd5d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:51.509856 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d0b466d-dbdf-44da-b179-6aa2722acd5d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:51.510781 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d0b466d-dbdf-44da-b179-6aa2722acd5d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:51.511547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d0b466d-dbdf-44da-b179-6aa2722acd5d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:51.549147 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-7d0b466d-dbdf-44da-b179-6aa2722acd5d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] HTTP exception thrown: Instance 0d6e3897-5115-4283-804d-abaa483786fc could not be found. Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7d0b466d-dbdf-44da-b179-6aa2722acd5d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Request method failure captured: Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc HTTP/1.1 Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO6mohoxNe2F_Neq0fKaid9U7yaEEVXZbrSOimZx0MIF1DumnY7YoElyIeXyuC0-SsSfKuT5sj95y0S0NeKzH0fWl5H0ecgXhQ5OxgORdOGtVtIPQWDKQKNRJPZJKg9pc5wrND3AjR4tGhx_-QctKX_KDBVcr0GL7firM9UUpWd-xMc Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 58c3c2b9910b4ba48a52cb1e3f1ef254 Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1315804487 Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58c3c2b9910b4ba48a52cb1e3f1ef254"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58c3c2b9910b4ba48a52cb1e3f1ef254"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/58c3c2b9910b4ba48a52cb1e3f1ef254"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_58c3c2b9910b4ba48a52cb1e3f1ef254"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerDiskConfigTestJSON-1315804487 Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 58c3c2b9910b4ba48a52cb1e3f1ef254 Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1315804487 Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerDiskConfigTestJSON-1315804487-project Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 9211cfded73b4747b3cb63bcfb3c3ff8 Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerDiskConfigTestJSON-1315804487-project Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 0d6e3897-5115-4283-804d-abaa483786fc could not be found. Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '0d6e3897-5115-4283-804d-abaa483786fc'} Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d6e3897-5115-4283-804d-abaa483786fc could not be found. Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:43:51.551266 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:43:51.556650 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d6e3897-5115-4283-804d-abaa483786fc could not be found. Oct 05 02:43:51.556650 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:43:51.556650 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:43:51.556650 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:43:51.556650 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:43:51.556650 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:43:51.556650 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:43:51.556650 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:43:51.556650 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:43:51.556650 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d6e3897-5115-4283-804d-abaa483786fc could not be found. Oct 05 02:43:51.556650 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:43:51.560492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7d0b466d-dbdf-44da-b179-6aa2722acd5d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Returning 404 to user: Instance 0d6e3897-5115-4283-804d-abaa483786fc could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:43:51.561738 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7d0b466d-dbdf-44da-b179-6aa2722acd5d tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 404 len: 111 microversion: 2.1 time: 0.082814 Oct 05 02:43:51.563001 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1812/3646] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:43:51 2022] DELETE /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:43:51.571808 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-de76255d-0a37-4afb-be3f-dd10a1bb1c94 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:51.585947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-de76255d-0a37-4afb-be3f-dd10a1bb1c94 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] [instance: 0d6e3897-5115-4283-804d-abaa483786fc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:51.593253 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de76255d-0a37-4afb-be3f-dd10a1bb1c94 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:51.594236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de76255d-0a37-4afb-be3f-dd10a1bb1c94 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:51.596403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de76255d-0a37-4afb-be3f-dd10a1bb1c94 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:51.597547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de76255d-0a37-4afb-be3f-dd10a1bb1c94 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:51.598263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de76255d-0a37-4afb-be3f-dd10a1bb1c94 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:51.598938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de76255d-0a37-4afb-be3f-dd10a1bb1c94 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:51.608336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b958a92d-9a1d-44e7-8a73-3209ae4afc4d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:51.629550 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b958a92d-9a1d-44e7-8a73-3209ae4afc4d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1468 microversion: 2.1 time: 1.128447 Oct 05 02:43:51.630153 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1835/3647] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:50 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1468 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:43:51.641102 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-de76255d-0a37-4afb-be3f-dd10a1bb1c94 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] HTTP exception thrown: Instance 0d6e3897-5115-4283-804d-abaa483786fc could not be found. Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-de76255d-0a37-4afb-be3f-dd10a1bb1c94 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Request method failure captured: Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc HTTP/1.1 Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO6mohoxNe2F_Neq0fKaid9U7yaEEVXZbrSOimZx0MIF1DumnY7YoElyIeXyuC0-SsSfKuT5sj95y0S0NeKzH0fWl5H0ecgXhQ5OxgORdOGtVtIPQWDKQKNRJPZJKg9pc5wrND3AjR4tGhx_-QctKX_KDBVcr0GL7firM9UUpWd-xMc Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 58c3c2b9910b4ba48a52cb1e3f1ef254 Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1315804487 Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58c3c2b9910b4ba48a52cb1e3f1ef254"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58c3c2b9910b4ba48a52cb1e3f1ef254"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/58c3c2b9910b4ba48a52cb1e3f1ef254"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_58c3c2b9910b4ba48a52cb1e3f1ef254"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerDiskConfigTestJSON-1315804487 Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 58c3c2b9910b4ba48a52cb1e3f1ef254 Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1315804487 Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerDiskConfigTestJSON-1315804487-project Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 9211cfded73b4747b3cb63bcfb3c3ff8 Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerDiskConfigTestJSON-1315804487-project Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 0d6e3897-5115-4283-804d-abaa483786fc could not be found. Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '0d6e3897-5115-4283-804d-abaa483786fc'} Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d6e3897-5115-4283-804d-abaa483786fc could not be found. Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d6e3897-5115-4283-804d-abaa483786fc could not be found. Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:43:51.644500 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:43:51.649185 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:43:51.649185 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:43:51.649185 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:43:51.649185 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:43:51.649185 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:43:51.649185 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d6e3897-5115-4283-804d-abaa483786fc could not be found. Oct 05 02:43:51.649185 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:43:51.652880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-de76255d-0a37-4afb-be3f-dd10a1bb1c94 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] Returning 404 to user: Instance 0d6e3897-5115-4283-804d-abaa483786fc could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:43:51.654055 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-de76255d-0a37-4afb-be3f-dd10a1bb1c94 tempest-ServerDiskConfigTestJSON-1315804487 tempest-ServerDiskConfigTestJSON-1315804487-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc" status: 404 len: 111 microversion: 2.1 time: 0.086426 Oct 05 02:43:51.655237 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1813/3648] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:51 2022] GET /compute/v2.1/servers/0d6e3897-5115-4283-804d-abaa483786fc => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:43:52.196576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7d22b41d-f399-438b-977c-864157f604ca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:52.197310 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7d22b41d-f399-438b-977c-864157f604ca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:52.208161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7d22b41d-f399-438b-977c-864157f604ca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:52.208659 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7d22b41d-f399-438b-977c-864157f604ca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:52.213596 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7d22b41d-f399-438b-977c-864157f604ca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:52.214362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7d22b41d-f399-438b-977c-864157f604ca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:52.214834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7d22b41d-f399-438b-977c-864157f604ca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:52.220591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7d22b41d-f399-438b-977c-864157f604ca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:52.655074 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5b71c81e-034d-4810-b247-75675f7dbfca tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:52.656598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5b71c81e-034d-4810-b247-75675f7dbfca tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:52.670849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5b71c81e-034d-4810-b247-75675f7dbfca tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:52.676973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5b71c81e-034d-4810-b247-75675f7dbfca tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:52.679403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5b71c81e-034d-4810-b247-75675f7dbfca tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:52.680440 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5b71c81e-034d-4810-b247-75675f7dbfca tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:52.682819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5b71c81e-034d-4810-b247-75675f7dbfca tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:52.684135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5b71c81e-034d-4810-b247-75675f7dbfca tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:52.833394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7d22b41d-f399-438b-977c-864157f604ca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:52.858059 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7d22b41d-f399-438b-977c-864157f604ca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:52.869476 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7d22b41d-f399-438b-977c-864157f604ca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:52.890210 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7d22b41d-f399-438b-977c-864157f604ca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1546 microversion: 2.91 time: 0.696893 Oct 05 02:43:52.913537 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1836/3649] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:52 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1546 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:43:53.890753 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5b71c81e-034d-4810-b247-75675f7dbfca tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:53.904512 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5b71c81e-034d-4810-b247-75675f7dbfca tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1468 microversion: 2.1 time: 1.250637 Oct 05 02:43:53.921802 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1814/3650] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:52 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1468 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:43:53.931516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e81737db-84de-4dc7-8429-20854957fc55 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:53.932190 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e81737db-84de-4dc7-8429-20854957fc55 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:53.946185 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e81737db-84de-4dc7-8429-20854957fc55 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:53.946699 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e81737db-84de-4dc7-8429-20854957fc55 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:53.947191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e81737db-84de-4dc7-8429-20854957fc55 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:53.947954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e81737db-84de-4dc7-8429-20854957fc55 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:53.948440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e81737db-84de-4dc7-8429-20854957fc55 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:53.948848 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e81737db-84de-4dc7-8429-20854957fc55 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:54.175234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e81737db-84de-4dc7-8429-20854957fc55 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:54.191641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e81737db-84de-4dc7-8429-20854957fc55 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:54.193135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e81737db-84de-4dc7-8429-20854957fc55 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:54.228387 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e81737db-84de-4dc7-8429-20854957fc55 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1546 microversion: 2.91 time: 0.301074 Oct 05 02:43:54.232415 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1837/3651] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:53 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1546 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:43:54.937964 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-38dd8caa-1a33-467f-b83f-736ad5895bc8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:54.940058 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-38dd8caa-1a33-467f-b83f-736ad5895bc8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:54.955044 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-38dd8caa-1a33-467f-b83f-736ad5895bc8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:54.958505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-38dd8caa-1a33-467f-b83f-736ad5895bc8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:54.959248 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-38dd8caa-1a33-467f-b83f-736ad5895bc8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:54.960288 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-38dd8caa-1a33-467f-b83f-736ad5895bc8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:54.963021 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-38dd8caa-1a33-467f-b83f-736ad5895bc8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:54.964943 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-38dd8caa-1a33-467f-b83f-736ad5895bc8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:55.260883 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3d893aaa-91ac-4fad-9702-8a9279c6796f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:55.261521 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3d893aaa-91ac-4fad-9702-8a9279c6796f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:55.280870 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d893aaa-91ac-4fad-9702-8a9279c6796f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:55.281283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d893aaa-91ac-4fad-9702-8a9279c6796f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:55.281997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d893aaa-91ac-4fad-9702-8a9279c6796f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:55.282847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d893aaa-91ac-4fad-9702-8a9279c6796f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:55.283174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d893aaa-91ac-4fad-9702-8a9279c6796f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:55.283610 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d893aaa-91ac-4fad-9702-8a9279c6796f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:55.291770 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-38dd8caa-1a33-467f-b83f-736ad5895bc8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:55.313938 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-38dd8caa-1a33-467f-b83f-736ad5895bc8 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1461 microversion: 2.1 time: 0.380619 Oct 05 02:43:55.316094 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1815/3652] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:54 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1461 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:55.406538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3d893aaa-91ac-4fad-9702-8a9279c6796f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:55.427440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3d893aaa-91ac-4fad-9702-8a9279c6796f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:55.429238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3d893aaa-91ac-4fad-9702-8a9279c6796f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:55.435179 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3d893aaa-91ac-4fad-9702-8a9279c6796f tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1546 microversion: 2.91 time: 0.178170 Oct 05 02:43:55.436109 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1838/3653] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:55 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1546 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:43:55.645057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2adfc671-5733-4625-a5b2-71363205e89c tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:55.645972 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2adfc671-5733-4625-a5b2-71363205e89c tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:55.656479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2adfc671-5733-4625-a5b2-71363205e89c tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:55.658142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2adfc671-5733-4625-a5b2-71363205e89c tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:55.658588 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2adfc671-5733-4625-a5b2-71363205e89c tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:55.659322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2adfc671-5733-4625-a5b2-71363205e89c tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:55.659776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2adfc671-5733-4625-a5b2-71363205e89c tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:55.660209 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2adfc671-5733-4625-a5b2-71363205e89c tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:56.013388 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2adfc671-5733-4625-a5b2-71363205e89c tempest-MigrationsAdminTest-1390301331 tempest-MigrationsAdminTest-1390301331-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1612 microversion: 2.1 time: 0.677731 Oct 05 02:43:56.014757 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1816/3654] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:55 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1612 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:43:56.050049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-895cd90f-a5b8-482a-9a20-eaf456dcd67a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:56.050563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-895cd90f-a5b8-482a-9a20-eaf456dcd67a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:56.062479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-895cd90f-a5b8-482a-9a20-eaf456dcd67a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:56.091269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-895cd90f-a5b8-482a-9a20-eaf456dcd67a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:56.091729 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-895cd90f-a5b8-482a-9a20-eaf456dcd67a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:56.092500 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-895cd90f-a5b8-482a-9a20-eaf456dcd67a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:56.096806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-895cd90f-a5b8-482a-9a20-eaf456dcd67a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:56.098196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-895cd90f-a5b8-482a-9a20-eaf456dcd67a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:56.157642 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-895cd90f-a5b8-482a-9a20-eaf456dcd67a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:43:56.293815 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-895cd90f-a5b8-482a-9a20-eaf456dcd67a tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "DELETE /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 204 len: 0 microversion: 2.1 time: 0.250962 Oct 05 02:43:56.295653 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1839/3655] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:43:56 2022] DELETE /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:43:56.304751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7397f32b-9e54-4c9b-b725-8273358cb29b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:56.306464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7397f32b-9e54-4c9b-b725-8273358cb29b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:56.313584 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7397f32b-9e54-4c9b-b725-8273358cb29b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:56.314344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7397f32b-9e54-4c9b-b725-8273358cb29b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:56.314993 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7397f32b-9e54-4c9b-b725-8273358cb29b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:56.315891 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7397f32b-9e54-4c9b-b725-8273358cb29b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:56.316519 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7397f32b-9e54-4c9b-b725-8273358cb29b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:56.317156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7397f32b-9e54-4c9b-b725-8273358cb29b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:56.470465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-996ae970-54aa-4737-a30d-573dc8d868b3 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:56.471496 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-996ae970-54aa-4737-a30d-573dc8d868b3 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:56.478336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-996ae970-54aa-4737-a30d-573dc8d868b3 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:56.479068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-996ae970-54aa-4737-a30d-573dc8d868b3 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:56.479759 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-996ae970-54aa-4737-a30d-573dc8d868b3 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:56.480730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-996ae970-54aa-4737-a30d-573dc8d868b3 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:56.481398 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-996ae970-54aa-4737-a30d-573dc8d868b3 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:56.482004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-996ae970-54aa-4737-a30d-573dc8d868b3 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:56.733550 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7397f32b-9e54-4c9b-b725-8273358cb29b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:56.749464 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7397f32b-9e54-4c9b-b725-8273358cb29b tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1467 microversion: 2.1 time: 0.448791 Oct 05 02:43:56.758153 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1817/3656] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:56 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1467 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:56.832648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-996ae970-54aa-4737-a30d-573dc8d868b3 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:56.842084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-996ae970-54aa-4737-a30d-573dc8d868b3 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:56.843850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-996ae970-54aa-4737-a30d-573dc8d868b3 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:56.849874 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-996ae970-54aa-4737-a30d-573dc8d868b3 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1546 microversion: 2.91 time: 0.384183 Oct 05 02:43:56.850995 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1840/3657] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:56 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1546 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:43:57.225387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-badc828c-172e-4fe5-be66-6e8a46741e3a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1539106685", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "e4f9d49c-25ab-4e4f-a7c4-00e803798e90"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:43:57.333765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-badc828c-172e-4fe5-be66-6e8a46741e3a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] validate_networks() for [('e4f9d49c-25ab-4e4f-a7c4-00e803798e90', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:43:57.788297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cf7c947d-bdc9-4ed4-b62d-42429ed70377 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:57.789000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cf7c947d-bdc9-4ed4-b62d-42429ed70377 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:57.819782 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf7c947d-bdc9-4ed4-b62d-42429ed70377 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:57.820278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf7c947d-bdc9-4ed4-b62d-42429ed70377 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:57.827146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf7c947d-bdc9-4ed4-b62d-42429ed70377 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:57.830282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf7c947d-bdc9-4ed4-b62d-42429ed70377 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:57.839371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf7c947d-bdc9-4ed4-b62d-42429ed70377 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:57.840120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf7c947d-bdc9-4ed4-b62d-42429ed70377 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:58.262879 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cf7c947d-bdc9-4ed4-b62d-42429ed70377 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:58.278934 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cf7c947d-bdc9-4ed4-b62d-42429ed70377 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1467 microversion: 2.1 time: 0.497170 Oct 05 02:43:58.296927 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1841/3658] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:57 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1467 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:58.296927 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-94e0e411-c1a5-4df8-8aee-c66d8aa5276c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:58.298442 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-94e0e411-c1a5-4df8-8aee-c66d8aa5276c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:58.312873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94e0e411-c1a5-4df8-8aee-c66d8aa5276c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:58.316262 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94e0e411-c1a5-4df8-8aee-c66d8aa5276c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:58.316938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94e0e411-c1a5-4df8-8aee-c66d8aa5276c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:58.319165 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94e0e411-c1a5-4df8-8aee-c66d8aa5276c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:58.321498 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94e0e411-c1a5-4df8-8aee-c66d8aa5276c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:58.322265 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94e0e411-c1a5-4df8-8aee-c66d8aa5276c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:58.567681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-94e0e411-c1a5-4df8-8aee-c66d8aa5276c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:58.586914 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-94e0e411-c1a5-4df8-8aee-c66d8aa5276c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:58.588718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-94e0e411-c1a5-4df8-8aee-c66d8aa5276c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:58.605324 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-94e0e411-c1a5-4df8-8aee-c66d8aa5276c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1546 microversion: 2.91 time: 0.316820 Oct 05 02:43:58.627732 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1842/3659] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:58 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1546 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:43:58.732384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-badc828c-172e-4fe5-be66-6e8a46741e3a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:43:58.733518 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-badc828c-172e-4fe5-be66-6e8a46741e3a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:43:58.734229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-badc828c-172e-4fe5-be66-6e8a46741e3a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:43:58.735076 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-badc828c-172e-4fe5-be66-6e8a46741e3a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:43:58.736423 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-badc828c-172e-4fe5-be66-6e8a46741e3a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:43:58.755554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-badc828c-172e-4fe5-be66-6e8a46741e3a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:58.756870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-badc828c-172e-4fe5-be66-6e8a46741e3a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:58.758006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-badc828c-172e-4fe5-be66-6e8a46741e3a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:58.759178 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-badc828c-172e-4fe5-be66-6e8a46741e3a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:58.760468 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-badc828c-172e-4fe5-be66-6e8a46741e3a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:58.761235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-badc828c-172e-4fe5-be66-6e8a46741e3a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:58.786362 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-badc828c-172e-4fe5-be66-6e8a46741e3a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Getting quotas for project d797c0058e8c456290081d056df79292. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:43:58.802503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-badc828c-172e-4fe5-be66-6e8a46741e3a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Getting quotas for user ff170a5be8a04902b66e5f0e79fd47df and project d797c0058e8c456290081d056df79292. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:43:58.832769 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-badc828c-172e-4fe5-be66-6e8a46741e3a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:43:58.836996 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-badc828c-172e-4fe5-be66-6e8a46741e3a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 982726d5-6806-4714-a8c0-551ce0243b54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:43:58.951332 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-badc828c-172e-4fe5-be66-6e8a46741e3a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.823673 Oct 05 02:43:58.963180 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1818/3660] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:43:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:43:58.970413 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0f1336d4-3f30-4ad1-9f23-92a5920ebd42 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:58.971641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0f1336d4-3f30-4ad1-9f23-92a5920ebd42 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 982726d5-6806-4714-a8c0-551ce0243b54] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:59.127861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0f1336d4-3f30-4ad1-9f23-92a5920ebd42 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:59.139891 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0f1336d4-3f30-4ad1-9f23-92a5920ebd42 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54" status: 200 len: 1215 microversion: 2.1 time: 0.172862 Oct 05 02:43:59.140486 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1843/3661] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:58 2022] GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54 => generated 1215 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:59.307642 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4bea9c32-b5a9-4c01-ae27-e4a775045789 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:59.308624 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4bea9c32-b5a9-4c01-ae27-e4a775045789 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:59.319548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4bea9c32-b5a9-4c01-ae27-e4a775045789 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:59.320606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4bea9c32-b5a9-4c01-ae27-e4a775045789 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:59.321298 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4bea9c32-b5a9-4c01-ae27-e4a775045789 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:59.322265 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4bea9c32-b5a9-4c01-ae27-e4a775045789 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:59.323813 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4bea9c32-b5a9-4c01-ae27-e4a775045789 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:59.324567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4bea9c32-b5a9-4c01-ae27-e4a775045789 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:59.636656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9cbac610-730d-4810-bc83-3c97d2c73647 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:43:59.637308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9cbac610-730d-4810-bc83-3c97d2c73647 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:43:59.650354 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9cbac610-730d-4810-bc83-3c97d2c73647 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:59.650861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9cbac610-730d-4810-bc83-3c97d2c73647 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:59.651305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9cbac610-730d-4810-bc83-3c97d2c73647 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:59.652041 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9cbac610-730d-4810-bc83-3c97d2c73647 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:59.652503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9cbac610-730d-4810-bc83-3c97d2c73647 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:59.652954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9cbac610-730d-4810-bc83-3c97d2c73647 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:59.687909 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4bea9c32-b5a9-4c01-ae27-e4a775045789 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:59.696743 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4bea9c32-b5a9-4c01-ae27-e4a775045789 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1467 microversion: 2.1 time: 0.393625 Oct 05 02:43:59.697351 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1819/3662] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:43:59 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1467 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:43:59.865697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-f21b8e0f-0fa8-4283-98a4-541243fef3e1 req-6683fdb6-9f0b-4e35-b987-a3429c10fd9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03081f70-6b52-497a-ab3f-27f86089c602", "name": "network-vif-deleted", "tag": "7edc14f6-3b4b-460e-96c8-a6f177b5e033"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:43:59.880864 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f21b8e0f-0fa8-4283-98a4-541243fef3e1 req-6683fdb6-9f0b-4e35-b987-a3429c10fd9f service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:43:59.881369 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f21b8e0f-0fa8-4283-98a4-541243fef3e1 req-6683fdb6-9f0b-4e35-b987-a3429c10fd9f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:43:59.881803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f21b8e0f-0fa8-4283-98a4-541243fef3e1 req-6683fdb6-9f0b-4e35-b987-a3429c10fd9f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:43:59.916062 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-f21b8e0f-0fa8-4283-98a4-541243fef3e1 req-6683fdb6-9f0b-4e35-b987-a3429c10fd9f service nova] Creating event network-vif-deleted:7edc14f6-3b4b-460e-96c8-a6f177b5e033 for instance 03081f70-6b52-497a-ab3f-27f86089c602 on n-h2-858272-3 Oct 05 02:43:59.928398 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-f21b8e0f-0fa8-4283-98a4-541243fef3e1 req-6683fdb6-9f0b-4e35-b987-a3429c10fd9f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094057 Oct 05 02:43:59.929462 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1820/3663] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 05 02:43:59.950565 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9cbac610-730d-4810-bc83-3c97d2c73647 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:59.962740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9cbac610-730d-4810-bc83-3c97d2c73647 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:59.967030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9cbac610-730d-4810-bc83-3c97d2c73647 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:43:59.981900 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9cbac610-730d-4810-bc83-3c97d2c73647 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1546 microversion: 2.91 time: 0.349889 Oct 05 02:43:59.998837 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1844/3664] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:43:59 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1546 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:44:00.167350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c8b18d55-54d1-4176-a771-9d6cf291a47f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:00.168211 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c8b18d55-54d1-4176-a771-9d6cf291a47f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 982726d5-6806-4714-a8c0-551ce0243b54] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:00.200166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c8b18d55-54d1-4176-a771-9d6cf291a47f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:00.200706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c8b18d55-54d1-4176-a771-9d6cf291a47f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:00.201195 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c8b18d55-54d1-4176-a771-9d6cf291a47f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:00.202011 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c8b18d55-54d1-4176-a771-9d6cf291a47f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:00.202485 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c8b18d55-54d1-4176-a771-9d6cf291a47f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:00.202916 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c8b18d55-54d1-4176-a771-9d6cf291a47f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:00.327805 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c8b18d55-54d1-4176-a771-9d6cf291a47f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:00.343325 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c8b18d55-54d1-4176-a771-9d6cf291a47f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54" status: 200 len: 1219 microversion: 2.1 time: 0.180488 Oct 05 02:44:00.377674 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1821/3665] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:00 2022] GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54 => generated 1219 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:00.577666 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-bb82bf0d-ad2c-4e84-a5d5-e488cb6ac654 req-a8b35f84-19f0-4d25-ac51-9013c10a220d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4388e9ec-13a9-4d5b-9310-7a10953c57d0", "name": "network-vif-plugged", "status": "completed", "tag": "17b098e0-7358-489c-bec3-6b98c1db0796"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:44:00.596029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-bb82bf0d-ad2c-4e84-a5d5-e488cb6ac654 req-a8b35f84-19f0-4d25-ac51-9013c10a220d service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:00.596670 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-bb82bf0d-ad2c-4e84-a5d5-e488cb6ac654 req-a8b35f84-19f0-4d25-ac51-9013c10a220d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:00.597203 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-bb82bf0d-ad2c-4e84-a5d5-e488cb6ac654 req-a8b35f84-19f0-4d25-ac51-9013c10a220d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:00.610625 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-bb82bf0d-ad2c-4e84-a5d5-e488cb6ac654 req-a8b35f84-19f0-4d25-ac51-9013c10a220d service nova] Creating event network-vif-plugged:17b098e0-7358-489c-bec3-6b98c1db0796 for instance 4388e9ec-13a9-4d5b-9310-7a10953c57d0 on n-h1-858272-3 Oct 05 02:44:00.616475 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-bb82bf0d-ad2c-4e84-a5d5-e488cb6ac654 req-a8b35f84-19f0-4d25-ac51-9013c10a220d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045904 Oct 05 02:44:00.617577 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1845/3666] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:44:00.725202 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a5530c06-a2a9-43ab-87ec-8b1ee1f81a0c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:00.726142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a5530c06-a2a9-43ab-87ec-8b1ee1f81a0c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:00.733388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5530c06-a2a9-43ab-87ec-8b1ee1f81a0c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:00.734354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5530c06-a2a9-43ab-87ec-8b1ee1f81a0c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:00.735879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5530c06-a2a9-43ab-87ec-8b1ee1f81a0c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:00.737040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5530c06-a2a9-43ab-87ec-8b1ee1f81a0c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:00.738128 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5530c06-a2a9-43ab-87ec-8b1ee1f81a0c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:00.739066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5530c06-a2a9-43ab-87ec-8b1ee1f81a0c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:00.810780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5530c06-a2a9-43ab-87ec-8b1ee1f81a0c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:00.811499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5530c06-a2a9-43ab-87ec-8b1ee1f81a0c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:00.812129 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5530c06-a2a9-43ab-87ec-8b1ee1f81a0c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:00.812765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-a5530c06-a2a9-43ab-87ec-8b1ee1f81a0c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lazy-loading 'fault' on Instance uuid 03081f70-6b52-497a-ab3f-27f86089c602 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:44:00.821631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:01.018669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f5fdd0ee-8f72-462b-8e96-558e869112da tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:01.021041 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f5fdd0ee-8f72-462b-8e96-558e869112da tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:01.037166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5fdd0ee-8f72-462b-8e96-558e869112da tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:01.038016 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5fdd0ee-8f72-462b-8e96-558e869112da tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:01.038157 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5fdd0ee-8f72-462b-8e96-558e869112da tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:01.038800 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5fdd0ee-8f72-462b-8e96-558e869112da tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:01.039259 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5fdd0ee-8f72-462b-8e96-558e869112da tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:01.044200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a5530c06-a2a9-43ab-87ec-8b1ee1f81a0c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:01.049598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5fdd0ee-8f72-462b-8e96-558e869112da tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:01.055912 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a5530c06-a2a9-43ab-87ec-8b1ee1f81a0c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 200 len: 1302 microversion: 2.1 time: 0.334574 Oct 05 02:44:01.069726 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1822/3667] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:00 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 1302 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:01.139274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f5fdd0ee-8f72-462b-8e96-558e869112da tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:01.149156 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f5fdd0ee-8f72-462b-8e96-558e869112da tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:01.150851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f5fdd0ee-8f72-462b-8e96-558e869112da tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:01.157992 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f5fdd0ee-8f72-462b-8e96-558e869112da tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1546 microversion: 2.91 time: 0.146369 Oct 05 02:44:01.158871 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1846/3668] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:01 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1546 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:44:01.367182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-62e8e8e7-ceac-49d4-90f9-48e9f0802808 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:01.367783 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-62e8e8e7-ceac-49d4-90f9-48e9f0802808 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 982726d5-6806-4714-a8c0-551ce0243b54] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:01.383461 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62e8e8e7-ceac-49d4-90f9-48e9f0802808 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:01.383971 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62e8e8e7-ceac-49d4-90f9-48e9f0802808 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:01.384411 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62e8e8e7-ceac-49d4-90f9-48e9f0802808 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:01.385348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62e8e8e7-ceac-49d4-90f9-48e9f0802808 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:01.385980 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62e8e8e7-ceac-49d4-90f9-48e9f0802808 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:01.386574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62e8e8e7-ceac-49d4-90f9-48e9f0802808 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:01.685676 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-62e8e8e7-ceac-49d4-90f9-48e9f0802808 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:01.705865 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-62e8e8e7-ceac-49d4-90f9-48e9f0802808 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54" status: 200 len: 1219 microversion: 2.1 time: 0.342478 Oct 05 02:44:01.717093 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1823/3669] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:01 2022] GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54 => generated 1219 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:02.083857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1a621a28-c2a2-4652-9e5c-98a3a20bbb19 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:02.084691 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1a621a28-c2a2-4652-9e5c-98a3a20bbb19 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 03081f70-6b52-497a-ab3f-27f86089c602] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:02.096667 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a621a28-c2a2-4652-9e5c-98a3a20bbb19 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:02.097543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a621a28-c2a2-4652-9e5c-98a3a20bbb19 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:02.111824 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a621a28-c2a2-4652-9e5c-98a3a20bbb19 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:02.113738 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a621a28-c2a2-4652-9e5c-98a3a20bbb19 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:02.115181 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a621a28-c2a2-4652-9e5c-98a3a20bbb19 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:02.116265 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a621a28-c2a2-4652-9e5c-98a3a20bbb19 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:02.185208 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-1a621a28-c2a2-4652-9e5c-98a3a20bbb19 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] HTTP exception thrown: Instance 03081f70-6b52-497a-ab3f-27f86089c602 could not be found. Oct 05 02:44:02.196637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cda135e3-aeb3-4a8d-82f6-c900071953db tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1a621a28-c2a2-4652-9e5c-98a3a20bbb19 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Request method failure captured: Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 HTTP/1.1 Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO36ltbqSTUUbvu0hdqW0wQBoUm-r6GxIAEEd18CBM22KLVOl8K-EDOJPIET_U45dlDowv34n9XRsWWKfPvsyy2vrAIp4utgmXQPYalSsXar1M4lI-8u75H4HGbvKo_36r6Qb_FAus1jmvh8wdpC8UH0bLnDilwqzOjDx1XYkrBZ0cw Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 446a33968038476fbc98fc0b6b1795c0 Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-MigrationsAdminTest-976515262 Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/446a33968038476fbc98fc0b6b1795c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/446a33968038476fbc98fc0b6b1795c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/446a33968038476fbc98fc0b6b1795c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_446a33968038476fbc98fc0b6b1795c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-MigrationsAdminTest-976515262 Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 446a33968038476fbc98fc0b6b1795c0 Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-MigrationsAdminTest-976515262 Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-MigrationsAdminTest-976515262-project Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 1b4b5f0c43074932a8963727adfee38a Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-MigrationsAdminTest-976515262-project Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 03081f70-6b52-497a-ab3f-27f86089c602 could not be found. Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '03081f70-6b52-497a-ab3f-27f86089c602'} Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03081f70-6b52-497a-ab3f-27f86089c602 could not be found. Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03081f70-6b52-497a-ab3f-27f86089c602 could not be found. Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:44:02.206069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:02.219912 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:02.219912 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:44:02.219912 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:44:02.219912 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:44:02.219912 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:44:02.219912 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03081f70-6b52-497a-ab3f-27f86089c602 could not be found. Oct 05 02:44:02.219912 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:02.219912 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1a621a28-c2a2-4652-9e5c-98a3a20bbb19 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Returning 404 to user: Instance 03081f70-6b52-497a-ab3f-27f86089c602 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:44:02.219912 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1a621a28-c2a2-4652-9e5c-98a3a20bbb19 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602" status: 404 len: 111 microversion: 2.1 time: 0.130993 Oct 05 02:44:02.219912 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1847/3670] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:02 2022] GET /compute/v2.1/servers/03081f70-6b52-497a-ab3f-27f86089c602 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:44:02.234265 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cda135e3-aeb3-4a8d-82f6-c900071953db tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:02.240463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8b6d8118-c0ff-4a98-98eb-745ffd854d1d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:02.241486 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8b6d8118-c0ff-4a98-98eb-745ffd854d1d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:02.255717 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cda135e3-aeb3-4a8d-82f6-c900071953db tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:02.257127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cda135e3-aeb3-4a8d-82f6-c900071953db tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:02.258312 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cda135e3-aeb3-4a8d-82f6-c900071953db tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:02.259928 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cda135e3-aeb3-4a8d-82f6-c900071953db tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:02.261615 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cda135e3-aeb3-4a8d-82f6-c900071953db tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:02.262656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cda135e3-aeb3-4a8d-82f6-c900071953db tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:02.265867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b6d8118-c0ff-4a98-98eb-745ffd854d1d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:02.272167 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b6d8118-c0ff-4a98-98eb-745ffd854d1d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:02.272571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b6d8118-c0ff-4a98-98eb-745ffd854d1d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:02.274749 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b6d8118-c0ff-4a98-98eb-745ffd854d1d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:02.275170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b6d8118-c0ff-4a98-98eb-745ffd854d1d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:02.276691 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b6d8118-c0ff-4a98-98eb-745ffd854d1d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:02.354348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8b6d8118-c0ff-4a98-98eb-745ffd854d1d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:44:02.549484 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8b6d8118-c0ff-4a98-98eb-745ffd854d1d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 204 len: 0 microversion: 2.1 time: 0.329693 Oct 05 02:44:02.554051 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1848/3671] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:44:02 2022] DELETE /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:44:02.559595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-587c7831-aa47-4081-90e5-670aa1a74051 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:02.560295 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-587c7831-aa47-4081-90e5-670aa1a74051 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:02.576481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-587c7831-aa47-4081-90e5-670aa1a74051 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:02.577292 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-587c7831-aa47-4081-90e5-670aa1a74051 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:02.577925 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-587c7831-aa47-4081-90e5-670aa1a74051 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:02.585098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-587c7831-aa47-4081-90e5-670aa1a74051 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:02.585875 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-587c7831-aa47-4081-90e5-670aa1a74051 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:02.586494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-587c7831-aa47-4081-90e5-670aa1a74051 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:02.759758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cda135e3-aeb3-4a8d-82f6-c900071953db tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:02.776279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cda135e3-aeb3-4a8d-82f6-c900071953db tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:02.787185 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cda135e3-aeb3-4a8d-82f6-c900071953db tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:02.811541 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cda135e3-aeb3-4a8d-82f6-c900071953db tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1546 microversion: 2.91 time: 0.624303 Oct 05 02:44:02.833071 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1824/3672] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:02 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1546 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:44:02.850333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-71bc18de-5841-4ad2-97fb-ee787e0ff2e8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:02.862835 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-71bc18de-5841-4ad2-97fb-ee787e0ff2e8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 982726d5-6806-4714-a8c0-551ce0243b54] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:02.874958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71bc18de-5841-4ad2-97fb-ee787e0ff2e8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:02.883897 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71bc18de-5841-4ad2-97fb-ee787e0ff2e8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:02.885366 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71bc18de-5841-4ad2-97fb-ee787e0ff2e8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:02.889832 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71bc18de-5841-4ad2-97fb-ee787e0ff2e8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:02.890527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71bc18de-5841-4ad2-97fb-ee787e0ff2e8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:02.891745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71bc18de-5841-4ad2-97fb-ee787e0ff2e8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:03.091802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-71bc18de-5841-4ad2-97fb-ee787e0ff2e8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:03.105539 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-71bc18de-5841-4ad2-97fb-ee787e0ff2e8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54" status: 200 len: 1267 microversion: 2.1 time: 0.271094 Oct 05 02:44:03.106869 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1825/3673] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:02 2022] GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54 => generated 1267 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:03.371243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-587c7831-aa47-4081-90e5-670aa1a74051 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:03.386676 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-587c7831-aa47-4081-90e5-670aa1a74051 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1535 microversion: 2.1 time: 0.830625 Oct 05 02:44:03.388515 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1849/3674] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:02 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1535 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:03.851045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-94763053-c6a0-426e-8db5-7ebcc6f98cf6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:03.852537 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-94763053-c6a0-426e-8db5-7ebcc6f98cf6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:03.867560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94763053-c6a0-426e-8db5-7ebcc6f98cf6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:03.868057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94763053-c6a0-426e-8db5-7ebcc6f98cf6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:03.868496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94763053-c6a0-426e-8db5-7ebcc6f98cf6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:03.869229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94763053-c6a0-426e-8db5-7ebcc6f98cf6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:03.869682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94763053-c6a0-426e-8db5-7ebcc6f98cf6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:03.870150 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94763053-c6a0-426e-8db5-7ebcc6f98cf6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:04.135056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3db101db-fee3-4d68-b1ce-bffd8e2e5981 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:04.136556 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3db101db-fee3-4d68-b1ce-bffd8e2e5981 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 982726d5-6806-4714-a8c0-551ce0243b54] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:04.158857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3db101db-fee3-4d68-b1ce-bffd8e2e5981 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:04.159811 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3db101db-fee3-4d68-b1ce-bffd8e2e5981 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:04.163325 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3db101db-fee3-4d68-b1ce-bffd8e2e5981 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:04.166053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3db101db-fee3-4d68-b1ce-bffd8e2e5981 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:04.171554 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3db101db-fee3-4d68-b1ce-bffd8e2e5981 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:04.179398 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3db101db-fee3-4d68-b1ce-bffd8e2e5981 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:04.741249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3db101db-fee3-4d68-b1ce-bffd8e2e5981 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:04.749406 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:04.755471 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3db101db-fee3-4d68-b1ce-bffd8e2e5981 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54" status: 200 len: 1273 microversion: 2.1 time: 0.623609 Oct 05 02:44:04.758837 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1850/3675] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:04 2022] GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54 => generated 1273 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:04.794384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-94763053-c6a0-426e-8db5-7ebcc6f98cf6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:04.812109 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-94763053-c6a0-426e-8db5-7ebcc6f98cf6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:04.814542 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-94763053-c6a0-426e-8db5-7ebcc6f98cf6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:04.836499 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-94763053-c6a0-426e-8db5-7ebcc6f98cf6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1546 microversion: 2.91 time: 0.993542 Oct 05 02:44:04.862403 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1826/3676] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:03 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1546 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:44:04.869473 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8acfd1c9-cba4-4361-bb5c-139250c464c0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:04.873244 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8acfd1c9-cba4-4361-bb5c-139250c464c0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:04.892971 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8acfd1c9-cba4-4361-bb5c-139250c464c0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:04.893575 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8acfd1c9-cba4-4361-bb5c-139250c464c0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:04.894118 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8acfd1c9-cba4-4361-bb5c-139250c464c0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:04.894927 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8acfd1c9-cba4-4361-bb5c-139250c464c0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:04.895461 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8acfd1c9-cba4-4361-bb5c-139250c464c0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:04.895968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8acfd1c9-cba4-4361-bb5c-139250c464c0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:04.970243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4b34e445-4795-48eb-99df-d40bf02c392c tempest-MultipleCreateNegativeTestJSON-53055962 tempest-MultipleCreateNegativeTestJSON-53055962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-878264387", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:44:04.975077 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-4b34e445-4795-48eb-99df-d40bf02c392c tempest-MultipleCreateNegativeTestJSON-53055962 tempest-MultipleCreateNegativeTestJSON-53055962-project] HTTP exception thrown: min_count must be <= max_count Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4b34e445-4795-48eb-99df-d40bf02c392c tempest-MultipleCreateNegativeTestJSON-53055962 tempest-MultipleCreateNegativeTestJSON-53055962-project] Request method failure captured: Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 183 Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO9zTICnw9DuS9sQCIubLvlVZXi43q1qR4eDJ5VY8jY3t0ffn3mRRX1iVhR_9Nn3ujMJFro_Tak32M8USsxBU2JnnVI0gch_WnDbtCMdYTLVtykRe3uWzXJltj9tebizeWEukD4nsAQS4QzeNNnKKEI4f9if9wJvb1unhpn0YZz4y38 Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: e4e4790602ed424f8fed3f9a58f11f8d Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-53055962 Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4e4790602ed424f8fed3f9a58f11f8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4e4790602ed424f8fed3f9a58f11f8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e4e4790602ed424f8fed3f9a58f11f8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e4e4790602ed424f8fed3f9a58f11f8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-53055962 Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: e4e4790602ed424f8fed3f9a58f11f8d Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-53055962 Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-MultipleCreateNegativeTestJSON-53055962-project Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 50721b88e9bb40c285e981a01c34dab7 Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-53055962-project Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-878264387", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: exception: min_count must be <= max_count Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-878264387', 'imageRef': 'adad3215-1ca6-43bb-9981-0d01aff146ab', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 05 02:44:04.979177 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:04.987329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4b34e445-4795-48eb-99df-d40bf02c392c tempest-MultipleCreateNegativeTestJSON-53055962 tempest-MultipleCreateNegativeTestJSON-53055962-project] Returning 400 to user: min_count must be <= max_count {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:44:04.992337 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4b34e445-4795-48eb-99df-d40bf02c392c tempest-MultipleCreateNegativeTestJSON-53055962 tempest-MultipleCreateNegativeTestJSON-53055962-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.229808 Oct 05 02:44:04.993284 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1851/3677] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:44:04 2022] POST /compute/v2.1/servers => generated 74 bytes in 234 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 05 02:44:05.087403 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-29f8f0b1-3308-4ea8-9cfb-1f9f7beb19be tempest-MultipleCreateNegativeTestJSON-53055962 tempest-MultipleCreateNegativeTestJSON-53055962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-388605293", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "max_count": 0}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-29f8f0b1-3308-4ea8-9cfb-1f9f7beb19be tempest-MultipleCreateNegativeTestJSON-53055962 tempest-MultipleCreateNegativeTestJSON-53055962-project] Request method failure captured: Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 167 Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO9zTICnw9DuS9sQCIubLvlVZXi43q1qR4eDJ5VY8jY3t0ffn3mRRX1iVhR_9Nn3ujMJFro_Tak32M8USsxBU2JnnVI0gch_WnDbtCMdYTLVtykRe3uWzXJltj9tebizeWEukD4nsAQS4QzeNNnKKEI4f9if9wJvb1unhpn0YZz4y38 Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: e4e4790602ed424f8fed3f9a58f11f8d Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-53055962 Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4e4790602ed424f8fed3f9a58f11f8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4e4790602ed424f8fed3f9a58f11f8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e4e4790602ed424f8fed3f9a58f11f8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e4e4790602ed424f8fed3f9a58f11f8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-53055962 Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: e4e4790602ed424f8fed3f9a58f11f8d Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-53055962 Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-MultipleCreateNegativeTestJSON-53055962-project Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 50721b88e9bb40c285e981a01c34dab7 Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-53055962-project Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-388605293", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "max_count": 0}} Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-388605293', 'imageRef': 'adad3215-1ca6-43bb-9981-0d01aff146ab', 'flavorRef': '452', 'max_count': 0}}} Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 0 Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 02:44:05.092619 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 02:44:05.101832 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:44:05.101832 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:44:05.101832 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:44:05.101832 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:44:05.101832 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 05 02:44:05.101832 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:05.101832 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:44:05.101832 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:05.101832 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:05.101832 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:44:05.101832 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:44:05.101832 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:44:05.101832 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:44:05.101832 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 05 02:44:05.101832 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:05.108680 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-29f8f0b1-3308-4ea8-9cfb-1f9f7beb19be tempest-MultipleCreateNegativeTestJSON-53055962 tempest-MultipleCreateNegativeTestJSON-53055962-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:44:05.110552 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-29f8f0b1-3308-4ea8-9cfb-1f9f7beb19be tempest-MultipleCreateNegativeTestJSON-53055962 tempest-MultipleCreateNegativeTestJSON-53055962-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.027399 Oct 05 02:44:05.111775 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1852/3678] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:44:05 2022] POST /compute/v2.1/servers => generated 130 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 05 02:44:05.215475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a2cd72d1-dd16-4fbb-99b1-7674336768ef tempest-MultipleCreateNegativeTestJSON-53055962 tempest-MultipleCreateNegativeTestJSON-53055962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2050689099", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "max_count": 2.5}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a2cd72d1-dd16-4fbb-99b1-7674336768ef tempest-MultipleCreateNegativeTestJSON-53055962 tempest-MultipleCreateNegativeTestJSON-53055962-project] Request method failure captured: Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 170 Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO9zTICnw9DuS9sQCIubLvlVZXi43q1qR4eDJ5VY8jY3t0ffn3mRRX1iVhR_9Nn3ujMJFro_Tak32M8USsxBU2JnnVI0gch_WnDbtCMdYTLVtykRe3uWzXJltj9tebizeWEukD4nsAQS4QzeNNnKKEI4f9if9wJvb1unhpn0YZz4y38 Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: e4e4790602ed424f8fed3f9a58f11f8d Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-53055962 Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4e4790602ed424f8fed3f9a58f11f8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4e4790602ed424f8fed3f9a58f11f8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e4e4790602ed424f8fed3f9a58f11f8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e4e4790602ed424f8fed3f9a58f11f8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-53055962 Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: e4e4790602ed424f8fed3f9a58f11f8d Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-53055962 Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-MultipleCreateNegativeTestJSON-53055962-project Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 50721b88e9bb40c285e981a01c34dab7 Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-53055962-project Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2050689099", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "max_count": 2.5}} Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2050689099', 'imageRef': 'adad3215-1ca6-43bb-9981-0d01aff146ab', 'flavorRef': '452', 'max_count': 2.5}}} Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 2.5 Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 02:44:05.240855 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 02:44:05.246968 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:44:05.246968 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:44:05.246968 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:44:05.246968 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:44:05.246968 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 05 02:44:05.246968 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:05.246968 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:44:05.246968 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:05.246968 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:05.246968 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:44:05.246968 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:44:05.246968 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:44:05.246968 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:44:05.246968 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 05 02:44:05.246968 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:05.246968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a2cd72d1-dd16-4fbb-99b1-7674336768ef tempest-MultipleCreateNegativeTestJSON-53055962 tempest-MultipleCreateNegativeTestJSON-53055962-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:44:05.248342 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a2cd72d1-dd16-4fbb-99b1-7674336768ef tempest-MultipleCreateNegativeTestJSON-53055962 tempest-MultipleCreateNegativeTestJSON-53055962-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.052228 Oct 05 02:44:05.253621 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1853/3679] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:44:05 2022] POST /compute/v2.1/servers => generated 139 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:44:05.358981 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-465d7582-fe01-4c07-bbbc-b272ed6328ac tempest-MultipleCreateNegativeTestJSON-53055962 tempest-MultipleCreateNegativeTestJSON-53055962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-616114534", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "min_count": 0}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-465d7582-fe01-4c07-bbbc-b272ed6328ac tempest-MultipleCreateNegativeTestJSON-53055962 tempest-MultipleCreateNegativeTestJSON-53055962-project] Request method failure captured: Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 167 Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO9zTICnw9DuS9sQCIubLvlVZXi43q1qR4eDJ5VY8jY3t0ffn3mRRX1iVhR_9Nn3ujMJFro_Tak32M8USsxBU2JnnVI0gch_WnDbtCMdYTLVtykRe3uWzXJltj9tebizeWEukD4nsAQS4QzeNNnKKEI4f9if9wJvb1unhpn0YZz4y38 Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: e4e4790602ed424f8fed3f9a58f11f8d Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-53055962 Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4e4790602ed424f8fed3f9a58f11f8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4e4790602ed424f8fed3f9a58f11f8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e4e4790602ed424f8fed3f9a58f11f8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e4e4790602ed424f8fed3f9a58f11f8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-53055962 Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: e4e4790602ed424f8fed3f9a58f11f8d Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-53055962 Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-MultipleCreateNegativeTestJSON-53055962-project Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 50721b88e9bb40c285e981a01c34dab7 Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-53055962-project Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-616114534", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "min_count": 0}} Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-616114534', 'imageRef': 'adad3215-1ca6-43bb-9981-0d01aff146ab', 'flavorRef': '452', 'min_count': 0}}} Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 0 Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 02:44:05.389558 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 02:44:05.397972 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:44:05.397972 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:44:05.397972 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:44:05.397972 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:44:05.397972 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 05 02:44:05.397972 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:05.397972 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:44:05.397972 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:05.397972 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:05.397972 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:44:05.397972 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:44:05.397972 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:44:05.397972 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:44:05.397972 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 05 02:44:05.397972 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:05.397972 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-465d7582-fe01-4c07-bbbc-b272ed6328ac tempest-MultipleCreateNegativeTestJSON-53055962 tempest-MultipleCreateNegativeTestJSON-53055962-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:44:05.397972 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-465d7582-fe01-4c07-bbbc-b272ed6328ac tempest-MultipleCreateNegativeTestJSON-53055962 tempest-MultipleCreateNegativeTestJSON-53055962-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.047783 Oct 05 02:44:05.412345 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1854/3680] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:44:05 2022] POST /compute/v2.1/servers => generated 130 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 05 02:44:05.506340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c1c8ef69-bde8-47c3-b4f1-ce34c5299784 tempest-MultipleCreateNegativeTestJSON-53055962 tempest-MultipleCreateNegativeTestJSON-53055962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-858308760", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "min_count": 2.5}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c1c8ef69-bde8-47c3-b4f1-ce34c5299784 tempest-MultipleCreateNegativeTestJSON-53055962 tempest-MultipleCreateNegativeTestJSON-53055962-project] Request method failure captured: Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 169 Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO9zTICnw9DuS9sQCIubLvlVZXi43q1qR4eDJ5VY8jY3t0ffn3mRRX1iVhR_9Nn3ujMJFro_Tak32M8USsxBU2JnnVI0gch_WnDbtCMdYTLVtykRe3uWzXJltj9tebizeWEukD4nsAQS4QzeNNnKKEI4f9if9wJvb1unhpn0YZz4y38 Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: e4e4790602ed424f8fed3f9a58f11f8d Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-53055962 Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4e4790602ed424f8fed3f9a58f11f8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4e4790602ed424f8fed3f9a58f11f8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e4e4790602ed424f8fed3f9a58f11f8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e4e4790602ed424f8fed3f9a58f11f8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-53055962 Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: e4e4790602ed424f8fed3f9a58f11f8d Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-53055962 Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-MultipleCreateNegativeTestJSON-53055962-project Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 50721b88e9bb40c285e981a01c34dab7 Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-53055962-project Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-858308760", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "min_count": 2.5}} Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-858308760', 'imageRef': 'adad3215-1ca6-43bb-9981-0d01aff146ab', 'flavorRef': '452', 'min_count': 2.5}}} Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 2.5 Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 02:44:05.511404 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 02:44:05.519020 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:44:05.519020 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:44:05.519020 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:44:05.519020 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:44:05.519020 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 05 02:44:05.519020 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:05.519020 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:44:05.519020 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:05.519020 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:05.519020 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:44:05.519020 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:44:05.519020 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:44:05.519020 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:44:05.519020 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 05 02:44:05.519020 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:05.522529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c1c8ef69-bde8-47c3-b4f1-ce34c5299784 tempest-MultipleCreateNegativeTestJSON-53055962 tempest-MultipleCreateNegativeTestJSON-53055962-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:44:05.523171 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c1c8ef69-bde8-47c3-b4f1-ce34c5299784 tempest-MultipleCreateNegativeTestJSON-53055962 tempest-MultipleCreateNegativeTestJSON-53055962-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.022155 Oct 05 02:44:05.528484 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1855/3681] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:44:05 2022] POST /compute/v2.1/servers => generated 139 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:44:05.696695 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-1e69cd16-e350-4303-b68e-8bf44aae14bf req-8328a61b-4c35-4d72-9ca1-f371021c33e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1b41d44-1201-460a-b938-7a70567656cd", "name": "network-vif-deleted", "tag": "99ce69bd-430b-41c6-a998-33a5e643493b"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:44:05.727248 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1e69cd16-e350-4303-b68e-8bf44aae14bf req-8328a61b-4c35-4d72-9ca1-f371021c33e3 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:05.728479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1e69cd16-e350-4303-b68e-8bf44aae14bf req-8328a61b-4c35-4d72-9ca1-f371021c33e3 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:05.731383 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1e69cd16-e350-4303-b68e-8bf44aae14bf req-8328a61b-4c35-4d72-9ca1-f371021c33e3 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:05.766879 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-1e69cd16-e350-4303-b68e-8bf44aae14bf req-8328a61b-4c35-4d72-9ca1-f371021c33e3 service nova] Creating event network-vif-deleted:99ce69bd-430b-41c6-a998-33a5e643493b for instance d1b41d44-1201-460a-b938-7a70567656cd on n-h2-858272-3 Oct 05 02:44:05.779545 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-1e69cd16-e350-4303-b68e-8bf44aae14bf req-8328a61b-4c35-4d72-9ca1-f371021c33e3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087364 Oct 05 02:44:05.782282 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1856/3682] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:44:05.795881 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d41f2b4c-0b04-4ae8-8540-e35be7831ad5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:05.802970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d41f2b4c-0b04-4ae8-8540-e35be7831ad5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 982726d5-6806-4714-a8c0-551ce0243b54] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:05.820354 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d41f2b4c-0b04-4ae8-8540-e35be7831ad5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:05.827121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d41f2b4c-0b04-4ae8-8540-e35be7831ad5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:05.829557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d41f2b4c-0b04-4ae8-8540-e35be7831ad5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:05.830547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d41f2b4c-0b04-4ae8-8540-e35be7831ad5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:05.833094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d41f2b4c-0b04-4ae8-8540-e35be7831ad5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:05.833834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d41f2b4c-0b04-4ae8-8540-e35be7831ad5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:06.131180 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8acfd1c9-cba4-4361-bb5c-139250c464c0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:06.135730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d41f2b4c-0b04-4ae8-8540-e35be7831ad5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:06.143906 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8acfd1c9-cba4-4361-bb5c-139250c464c0 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 200 len: 1535 microversion: 2.1 time: 1.278217 Oct 05 02:44:06.147695 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1827/3683] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:04 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 1535 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:06.155774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9c81a5c2-34e0-447b-9343-afff1db2c6ed tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:06.157411 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9c81a5c2-34e0-447b-9343-afff1db2c6ed tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:06.159183 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d41f2b4c-0b04-4ae8-8540-e35be7831ad5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54" status: 200 len: 1273 microversion: 2.1 time: 0.375415 Oct 05 02:44:06.185802 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1857/3684] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:05 2022] GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54 => generated 1273 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:06.190136 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c81a5c2-34e0-447b-9343-afff1db2c6ed tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:06.191106 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c81a5c2-34e0-447b-9343-afff1db2c6ed tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:06.192120 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c81a5c2-34e0-447b-9343-afff1db2c6ed tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:06.193109 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c81a5c2-34e0-447b-9343-afff1db2c6ed tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:06.195265 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c81a5c2-34e0-447b-9343-afff1db2c6ed tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:06.195876 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c81a5c2-34e0-447b-9343-afff1db2c6ed tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:06.428084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9c81a5c2-34e0-447b-9343-afff1db2c6ed tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:06.455967 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9c81a5c2-34e0-447b-9343-afff1db2c6ed tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:06.466689 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9c81a5c2-34e0-447b-9343-afff1db2c6ed tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:06.474455 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9c81a5c2-34e0-447b-9343-afff1db2c6ed tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1533 microversion: 2.91 time: 0.324956 Oct 05 02:44:06.475428 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1828/3685] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:06 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1533 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:44:06.514548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a6e339d6-8758-4206-85cc-1a1d8222a03e tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:06.515512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a6e339d6-8758-4206-85cc-1a1d8222a03e tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:06.542175 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6e339d6-8758-4206-85cc-1a1d8222a03e tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:06.545623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6e339d6-8758-4206-85cc-1a1d8222a03e tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:06.550357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6e339d6-8758-4206-85cc-1a1d8222a03e tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:06.555094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6e339d6-8758-4206-85cc-1a1d8222a03e tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:06.561182 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6e339d6-8758-4206-85cc-1a1d8222a03e tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:06.561647 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6e339d6-8758-4206-85cc-1a1d8222a03e tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:07.151374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-a6e339d6-8758-4206-85cc-1a1d8222a03e tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Lazy-loading 'services' on Instance uuid 6787dcfc-b357-49d7-9192-24607b81f2b6 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:44:07.177439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8a0ba8e3-e39d-4a9d-a698-16809202c2cc tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:07.178455 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8a0ba8e3-e39d-4a9d-a698-16809202c2cc tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: d1b41d44-1201-460a-b938-7a70567656cd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:07.192535 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a0ba8e3-e39d-4a9d-a698-16809202c2cc tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:07.195355 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a0ba8e3-e39d-4a9d-a698-16809202c2cc tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:07.196644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a0ba8e3-e39d-4a9d-a698-16809202c2cc tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:07.198348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a0ba8e3-e39d-4a9d-a698-16809202c2cc tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:07.201571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a0ba8e3-e39d-4a9d-a698-16809202c2cc tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:07.202839 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a0ba8e3-e39d-4a9d-a698-16809202c2cc tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:07.209549 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a6e339d6-8758-4206-85cc-1a1d8222a03e tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1938 microversion: 2.91 time: 0.706408 Oct 05 02:44:07.210489 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1858/3686] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:06 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1938 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:44:07.215660 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d561df4f-6dfe-4600-ac6c-11200cfc64ee tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:07.217673 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d561df4f-6dfe-4600-ac6c-11200cfc64ee tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 982726d5-6806-4714-a8c0-551ce0243b54] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:07.224198 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d561df4f-6dfe-4600-ac6c-11200cfc64ee tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:07.225142 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d561df4f-6dfe-4600-ac6c-11200cfc64ee tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:07.225918 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d561df4f-6dfe-4600-ac6c-11200cfc64ee tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:07.226880 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d561df4f-6dfe-4600-ac6c-11200cfc64ee tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:07.249214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d561df4f-6dfe-4600-ac6c-11200cfc64ee tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:07.249960 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d561df4f-6dfe-4600-ac6c-11200cfc64ee tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:07.271934 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-8a0ba8e3-e39d-4a9d-a698-16809202c2cc tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] HTTP exception thrown: Instance d1b41d44-1201-460a-b938-7a70567656cd could not be found. Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8a0ba8e3-e39d-4a9d-a698-16809202c2cc tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Request method failure captured: Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd HTTP/1.1 Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO36ltbqSTUUbvu0hdqW0wQBoUm-r6GxIAEEd18CBM22KLVOl8K-EDOJPIET_U45dlDowv34n9XRsWWKfPvsyy2vrAIp4utgmXQPYalSsXar1M4lI-8u75H4HGbvKo_36r6Qb_FAus1jmvh8wdpC8UH0bLnDilwqzOjDx1XYkrBZ0cw Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 446a33968038476fbc98fc0b6b1795c0 Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-MigrationsAdminTest-976515262 Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/446a33968038476fbc98fc0b6b1795c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/446a33968038476fbc98fc0b6b1795c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/446a33968038476fbc98fc0b6b1795c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_446a33968038476fbc98fc0b6b1795c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-MigrationsAdminTest-976515262 Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 446a33968038476fbc98fc0b6b1795c0 Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-MigrationsAdminTest-976515262 Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-MigrationsAdminTest-976515262-project Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 1b4b5f0c43074932a8963727adfee38a Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-MigrationsAdminTest-976515262-project Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance d1b41d44-1201-460a-b938-7a70567656cd could not be found. Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'd1b41d44-1201-460a-b938-7a70567656cd'} Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1b41d44-1201-460a-b938-7a70567656cd could not be found. Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1b41d44-1201-460a-b938-7a70567656cd could not be found. Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:44:07.274329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:44:07.279133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:07.279133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:44:07.279133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:44:07.279133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:44:07.279133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:44:07.279133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1b41d44-1201-460a-b938-7a70567656cd could not be found. Oct 05 02:44:07.279133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:44:07.279133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8a0ba8e3-e39d-4a9d-a698-16809202c2cc tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Returning 404 to user: Instance d1b41d44-1201-460a-b938-7a70567656cd could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:44:07.279133 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8a0ba8e3-e39d-4a9d-a698-16809202c2cc tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd" status: 404 len: 111 microversion: 2.1 time: 0.105111 Oct 05 02:44:07.279997 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1829/3687] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:07 2022] GET /compute/v2.1/servers/d1b41d44-1201-460a-b938-7a70567656cd => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:44:07.292943 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d9f2013e-4d8d-4cf9-b529-61e6c1143cca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:44:07.297937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d9f2013e-4d8d-4cf9-b529-61e6c1143cca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:07.312637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d9f2013e-4d8d-4cf9-b529-61e6c1143cca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:07.314224 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d9f2013e-4d8d-4cf9-b529-61e6c1143cca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:07.315204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d9f2013e-4d8d-4cf9-b529-61e6c1143cca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:07.316198 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d9f2013e-4d8d-4cf9-b529-61e6c1143cca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:07.317984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d9f2013e-4d8d-4cf9-b529-61e6c1143cca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:07.319125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d9f2013e-4d8d-4cf9-b529-61e6c1143cca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:07.421121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-d9f2013e-4d8d-4cf9-b529-61e6c1143cca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lazy-loading 'flavor' on Instance uuid 6787dcfc-b357-49d7-9192-24607b81f2b6 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:44:07.422809 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d561df4f-6dfe-4600-ac6c-11200cfc64ee tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:07.433433 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d561df4f-6dfe-4600-ac6c-11200cfc64ee tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54" status: 200 len: 1273 microversion: 2.1 time: 0.221608 Oct 05 02:44:07.438771 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1859/3688] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:07 2022] GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54 => generated 1273 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:07.447119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e097e5cf-9494-40f6-bc33-7a30c2296126 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '.version_select at 0x7fccdf1510d0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:07.499048 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e097e5cf-9494-40f6-bc33-7a30c2296126 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-256781211" status: 202 len: 0 microversion: 2.1 time: 0.055616 Oct 05 02:44:07.500007 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1860/3689] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 5 02:44:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-256781211 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:44:07.948341 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d9f2013e-4d8d-4cf9-b529-61e6c1143cca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "POST /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6/action" status: 202 len: 0 microversion: 2.91 time: 0.666792 Oct 05 02:44:07.949380 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1830/3690] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 5 02:44:07 2022] POST /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6/action => generated 0 bytes in 669 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:44:07.959669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-08c41994-cd82-483c-a52d-521b018ceeca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:07.960293 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-08c41994-cd82-483c-a52d-521b018ceeca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:07.982737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:07.985897 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08c41994-cd82-483c-a52d-521b018ceeca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:07.986542 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08c41994-cd82-483c-a52d-521b018ceeca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:07.988319 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08c41994-cd82-483c-a52d-521b018ceeca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:07.989103 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08c41994-cd82-483c-a52d-521b018ceeca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:07.993362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08c41994-cd82-483c-a52d-521b018ceeca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:07.993823 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08c41994-cd82-483c-a52d-521b018ceeca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:08.410636 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-08c41994-cd82-483c-a52d-521b018ceeca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:08.419318 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-08c41994-cd82-483c-a52d-521b018ceeca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:08.425137 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-08c41994-cd82-483c-a52d-521b018ceeca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:08.446149 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-08c41994-cd82-483c-a52d-521b018ceeca tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.491550 Oct 05 02:44:08.448704 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1861/3691] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:07 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:44:08.466784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9bf6e16b-d846-4192-b61b-5d4f75b939e6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:08.469067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9bf6e16b-d846-4192-b61b-5d4f75b939e6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 982726d5-6806-4714-a8c0-551ce0243b54] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:08.490435 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9bf6e16b-d846-4192-b61b-5d4f75b939e6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:08.491347 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9bf6e16b-d846-4192-b61b-5d4f75b939e6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:08.492145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9bf6e16b-d846-4192-b61b-5d4f75b939e6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:08.493127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9bf6e16b-d846-4192-b61b-5d4f75b939e6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:08.493818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9bf6e16b-d846-4192-b61b-5d4f75b939e6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:08.494342 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9bf6e16b-d846-4192-b61b-5d4f75b939e6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:08.773578 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:08.819245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:08.893320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9bf6e16b-d846-4192-b61b-5d4f75b939e6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:08.915174 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9bf6e16b-d846-4192-b61b-5d4f75b939e6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54" status: 200 len: 1315 microversion: 2.1 time: 0.453243 Oct 05 02:44:08.929305 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1831/3692] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:08 2022] GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54 => generated 1315 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:09.429358 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a5f80d18-afd0-4ed1-a17a-01607e9ee880 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:09.429918 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a5f80d18-afd0-4ed1-a17a-01607e9ee880 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:09.432348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:09.440820 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5f80d18-afd0-4ed1-a17a-01607e9ee880 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:09.445842 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5f80d18-afd0-4ed1-a17a-01607e9ee880 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:09.446916 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5f80d18-afd0-4ed1-a17a-01607e9ee880 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:09.448069 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5f80d18-afd0-4ed1-a17a-01607e9ee880 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:09.448710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5f80d18-afd0-4ed1-a17a-01607e9ee880 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:09.449417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5f80d18-afd0-4ed1-a17a-01607e9ee880 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:09.491648 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-eb34623e-fa84-45b2-8324-17ff4aeba627 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:09.492978 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a5f80d18-afd0-4ed1-a17a-01607e9ee880 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:44:09.494741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-eb34623e-fa84-45b2-8324-17ff4aeba627 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:09.508891 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb34623e-fa84-45b2-8324-17ff4aeba627 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:09.509644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb34623e-fa84-45b2-8324-17ff4aeba627 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:09.513664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb34623e-fa84-45b2-8324-17ff4aeba627 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:09.514742 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb34623e-fa84-45b2-8324-17ff4aeba627 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:09.517245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb34623e-fa84-45b2-8324-17ff4aeba627 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:09.520306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb34623e-fa84-45b2-8324-17ff4aeba627 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:09.628474 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a5f80d18-afd0-4ed1-a17a-01607e9ee880 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "DELETE /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 204 len: 0 microversion: 2.1 time: 0.201010 Oct 05 02:44:09.633141 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1862/3693] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:44:09 2022] DELETE /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:44:09.640078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-aca4dbdc-7372-43b9-96b0-ec644bf1c5c2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:09.641964 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-aca4dbdc-7372-43b9-96b0-ec644bf1c5c2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:09.664920 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aca4dbdc-7372-43b9-96b0-ec644bf1c5c2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:09.664920 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aca4dbdc-7372-43b9-96b0-ec644bf1c5c2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:09.664920 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aca4dbdc-7372-43b9-96b0-ec644bf1c5c2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:09.664920 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aca4dbdc-7372-43b9-96b0-ec644bf1c5c2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:09.664920 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aca4dbdc-7372-43b9-96b0-ec644bf1c5c2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:09.664920 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aca4dbdc-7372-43b9-96b0-ec644bf1c5c2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:09.690349 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-eb34623e-fa84-45b2-8324-17ff4aeba627 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:09.701326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-eb34623e-fa84-45b2-8324-17ff4aeba627 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:09.704311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-eb34623e-fa84-45b2-8324-17ff4aeba627 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:09.711473 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-eb34623e-fa84-45b2-8324-17ff4aeba627 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.238937 Oct 05 02:44:09.730378 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1832/3694] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:09 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:44:09.945755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0af797ae-b587-494f-a886-4e9b55c8ee98 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:09.950018 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0af797ae-b587-494f-a886-4e9b55c8ee98 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 982726d5-6806-4714-a8c0-551ce0243b54] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:09.964417 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0af797ae-b587-494f-a886-4e9b55c8ee98 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:09.965230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0af797ae-b587-494f-a886-4e9b55c8ee98 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:09.965879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0af797ae-b587-494f-a886-4e9b55c8ee98 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:09.966847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0af797ae-b587-494f-a886-4e9b55c8ee98 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:09.967502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0af797ae-b587-494f-a886-4e9b55c8ee98 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:09.968097 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0af797ae-b587-494f-a886-4e9b55c8ee98 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:10.207950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-aca4dbdc-7372-43b9-96b0-ec644bf1c5c2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:10.220555 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-aca4dbdc-7372-43b9-96b0-ec644bf1c5c2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1467 microversion: 2.1 time: 0.584642 Oct 05 02:44:10.221061 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1863/3695] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:09 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1467 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:10.743221 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-652d999c-b61e-4151-b889-d1922765a651 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:10.744612 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-652d999c-b61e-4151-b889-d1922765a651 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:10.763871 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-652d999c-b61e-4151-b889-d1922765a651 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:10.764816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-652d999c-b61e-4151-b889-d1922765a651 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:10.765490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-652d999c-b61e-4151-b889-d1922765a651 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:10.766982 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-652d999c-b61e-4151-b889-d1922765a651 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:10.767998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-652d999c-b61e-4151-b889-d1922765a651 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:10.768797 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-652d999c-b61e-4151-b889-d1922765a651 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:11.045862 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0af797ae-b587-494f-a886-4e9b55c8ee98 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:11.058160 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-652d999c-b61e-4151-b889-d1922765a651 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:11.067458 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0af797ae-b587-494f-a886-4e9b55c8ee98 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54" status: 200 len: 1315 microversion: 2.1 time: 1.126853 Oct 05 02:44:11.068710 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1833/3696] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:09 2022] GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54 => generated 1315 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:11.109034 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-652d999c-b61e-4151-b889-d1922765a651 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:11.111395 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-652d999c-b61e-4151-b889-d1922765a651 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:11.140522 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-652d999c-b61e-4151-b889-d1922765a651 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.401123 Oct 05 02:44:11.140646 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1864/3697] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:10 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:44:11.246353 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dc53521c-ac1d-4ead-aedf-dc07b2cfb991 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:11.248628 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-dc53521c-ac1d-4ead-aedf-dc07b2cfb991 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:11.261631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc53521c-ac1d-4ead-aedf-dc07b2cfb991 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:11.271822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc53521c-ac1d-4ead-aedf-dc07b2cfb991 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:11.272756 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc53521c-ac1d-4ead-aedf-dc07b2cfb991 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:11.273780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc53521c-ac1d-4ead-aedf-dc07b2cfb991 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:11.274366 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc53521c-ac1d-4ead-aedf-dc07b2cfb991 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:11.274807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc53521c-ac1d-4ead-aedf-dc07b2cfb991 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:11.799694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-dc53521c-ac1d-4ead-aedf-dc07b2cfb991 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:11.813533 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-dc53521c-ac1d-4ead-aedf-dc07b2cfb991 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1467 microversion: 2.1 time: 0.570605 Oct 05 02:44:11.821104 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1834/3698] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:11 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1467 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:12.097810 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-194b69da-bf59-4eed-9acd-64e4484b3916 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:12.098589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-194b69da-bf59-4eed-9acd-64e4484b3916 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 982726d5-6806-4714-a8c0-551ce0243b54] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:12.110865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-194b69da-bf59-4eed-9acd-64e4484b3916 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:12.113905 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-194b69da-bf59-4eed-9acd-64e4484b3916 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:12.114632 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-194b69da-bf59-4eed-9acd-64e4484b3916 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:12.117529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-194b69da-bf59-4eed-9acd-64e4484b3916 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:12.118260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-194b69da-bf59-4eed-9acd-64e4484b3916 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:12.118924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-194b69da-bf59-4eed-9acd-64e4484b3916 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:12.170426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d9f55eac-d134-404f-b708-582f1fff3a72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:12.171046 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d9f55eac-d134-404f-b708-582f1fff3a72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:12.182908 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d9f55eac-d134-404f-b708-582f1fff3a72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:12.183608 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d9f55eac-d134-404f-b708-582f1fff3a72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:12.184235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d9f55eac-d134-404f-b708-582f1fff3a72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:12.189119 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d9f55eac-d134-404f-b708-582f1fff3a72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:12.189836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d9f55eac-d134-404f-b708-582f1fff3a72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:12.190460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d9f55eac-d134-404f-b708-582f1fff3a72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:12.370538 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d9f55eac-d134-404f-b708-582f1fff3a72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:12.381634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d9f55eac-d134-404f-b708-582f1fff3a72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:12.389146 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d9f55eac-d134-404f-b708-582f1fff3a72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:12.403428 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d9f55eac-d134-404f-b708-582f1fff3a72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.236399 Oct 05 02:44:12.405516 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1835/3699] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:12 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:44:12.504123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-09764219-0e32-4d0f-92dc-fa91d59c41bc req-73c8aeac-8d36-4d69-b9a4-10387477afad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "982726d5-6806-4714-a8c0-551ce0243b54", "tag": "9ed69517-151f-4fb3-be05-5de4ef13374d"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:44:12.540094 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-09764219-0e32-4d0f-92dc-fa91d59c41bc req-73c8aeac-8d36-4d69-b9a4-10387477afad service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:12.540585 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-09764219-0e32-4d0f-92dc-fa91d59c41bc req-73c8aeac-8d36-4d69-b9a4-10387477afad service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:12.541125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-09764219-0e32-4d0f-92dc-fa91d59c41bc req-73c8aeac-8d36-4d69-b9a4-10387477afad service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:12.605551 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-09764219-0e32-4d0f-92dc-fa91d59c41bc req-73c8aeac-8d36-4d69-b9a4-10387477afad service nova] Creating event network-changed:9ed69517-151f-4fb3-be05-5de4ef13374d for instance 982726d5-6806-4714-a8c0-551ce0243b54 on n-h1-858272-3 Oct 05 02:44:12.616195 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-09764219-0e32-4d0f-92dc-fa91d59c41bc req-73c8aeac-8d36-4d69-b9a4-10387477afad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117488 Oct 05 02:44:12.619068 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1836/3700] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:44:12.767988 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-194b69da-bf59-4eed-9acd-64e4484b3916 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:12.777790 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-194b69da-bf59-4eed-9acd-64e4484b3916 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54" status: 200 len: 1315 microversion: 2.1 time: 0.684151 Oct 05 02:44:12.799461 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1865/3701] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:12 2022] GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54 => generated 1315 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:12.848555 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-30b871c1-8cbb-4ff0-98db-67b0ad5290f7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:12.851554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-30b871c1-8cbb-4ff0-98db-67b0ad5290f7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:12.861865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-30b871c1-8cbb-4ff0-98db-67b0ad5290f7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:12.862772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-30b871c1-8cbb-4ff0-98db-67b0ad5290f7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:12.864220 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-30b871c1-8cbb-4ff0-98db-67b0ad5290f7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:12.865501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-30b871c1-8cbb-4ff0-98db-67b0ad5290f7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:12.866584 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-30b871c1-8cbb-4ff0-98db-67b0ad5290f7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:12.867220 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-30b871c1-8cbb-4ff0-98db-67b0ad5290f7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:13.101818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-30b871c1-8cbb-4ff0-98db-67b0ad5290f7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:13.114095 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-30b871c1-8cbb-4ff0-98db-67b0ad5290f7 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1425 microversion: 2.1 time: 0.275563 Oct 05 02:44:13.117947 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1837/3702] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:12 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1425 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:13.351326 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-be6807bc-9669-47ea-afcb-04fcc8d1f809 req-66b0ba0f-faca-4329-89c1-07c790cd2b5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29215d80-fdc9-408d-b885-e6f3a5f7da84", "name": "network-vif-deleted", "tag": "167e3597-f727-40a3-a743-6b1d1d8a0217"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:44:13.381553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-be6807bc-9669-47ea-afcb-04fcc8d1f809 req-66b0ba0f-faca-4329-89c1-07c790cd2b5f service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:13.382077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-be6807bc-9669-47ea-afcb-04fcc8d1f809 req-66b0ba0f-faca-4329-89c1-07c790cd2b5f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:13.382517 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-be6807bc-9669-47ea-afcb-04fcc8d1f809 req-66b0ba0f-faca-4329-89c1-07c790cd2b5f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:13.435366 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-556f6ce9-4930-46cd-9d5f-97af7f5d3f15 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:13.435964 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-556f6ce9-4930-46cd-9d5f-97af7f5d3f15 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:13.448079 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-556f6ce9-4930-46cd-9d5f-97af7f5d3f15 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:13.453897 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-be6807bc-9669-47ea-afcb-04fcc8d1f809 req-66b0ba0f-faca-4329-89c1-07c790cd2b5f service nova] Creating event network-vif-deleted:167e3597-f727-40a3-a743-6b1d1d8a0217 for instance 29215d80-fdc9-408d-b885-e6f3a5f7da84 on n-h2-858272-3 Oct 05 02:44:13.457922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-556f6ce9-4930-46cd-9d5f-97af7f5d3f15 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:13.458371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-556f6ce9-4930-46cd-9d5f-97af7f5d3f15 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:13.459110 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-556f6ce9-4930-46cd-9d5f-97af7f5d3f15 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:13.459561 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-556f6ce9-4930-46cd-9d5f-97af7f5d3f15 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:13.459987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-556f6ce9-4930-46cd-9d5f-97af7f5d3f15 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:13.476573 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-be6807bc-9669-47ea-afcb-04fcc8d1f809 req-66b0ba0f-faca-4329-89c1-07c790cd2b5f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129358 Oct 05 02:44:13.494241 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1866/3703] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:44:13.528012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:13.826274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fadb5533-5ee6-41d9-a847-0e4cf876cc2e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:13.827002 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fadb5533-5ee6-41d9-a847-0e4cf876cc2e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 982726d5-6806-4714-a8c0-551ce0243b54] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:13.845300 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-556f6ce9-4930-46cd-9d5f-97af7f5d3f15 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:13.862988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-556f6ce9-4930-46cd-9d5f-97af7f5d3f15 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:13.874854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fadb5533-5ee6-41d9-a847-0e4cf876cc2e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:13.877848 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-556f6ce9-4930-46cd-9d5f-97af7f5d3f15 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:13.882403 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fadb5533-5ee6-41d9-a847-0e4cf876cc2e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:13.888864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fadb5533-5ee6-41d9-a847-0e4cf876cc2e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:13.891495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fadb5533-5ee6-41d9-a847-0e4cf876cc2e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:13.892653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fadb5533-5ee6-41d9-a847-0e4cf876cc2e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:13.893742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fadb5533-5ee6-41d9-a847-0e4cf876cc2e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:13.907884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:13.910637 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-556f6ce9-4930-46cd-9d5f-97af7f5d3f15 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.479645 Oct 05 02:44:13.917011 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1838/3704] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:13 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:44:14.145030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6f0b7fe4-4ad8-47a3-b7ac-1ae7f8006a86 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:14.145731 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6f0b7fe4-4ad8-47a3-b7ac-1ae7f8006a86 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:14.154260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f0b7fe4-4ad8-47a3-b7ac-1ae7f8006a86 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:14.156488 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f0b7fe4-4ad8-47a3-b7ac-1ae7f8006a86 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:14.160788 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f0b7fe4-4ad8-47a3-b7ac-1ae7f8006a86 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:14.162025 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f0b7fe4-4ad8-47a3-b7ac-1ae7f8006a86 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:14.162800 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f0b7fe4-4ad8-47a3-b7ac-1ae7f8006a86 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:14.163411 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f0b7fe4-4ad8-47a3-b7ac-1ae7f8006a86 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:14.257172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f0b7fe4-4ad8-47a3-b7ac-1ae7f8006a86 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:14.257786 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f0b7fe4-4ad8-47a3-b7ac-1ae7f8006a86 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:14.258251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f0b7fe4-4ad8-47a3-b7ac-1ae7f8006a86 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:14.258728 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-6f0b7fe4-4ad8-47a3-b7ac-1ae7f8006a86 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lazy-loading 'fault' on Instance uuid 29215d80-fdc9-408d-b885-e6f3a5f7da84 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:44:14.337569 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6f0b7fe4-4ad8-47a3-b7ac-1ae7f8006a86 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:14.350197 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6f0b7fe4-4ad8-47a3-b7ac-1ae7f8006a86 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 200 len: 1302 microversion: 2.1 time: 0.210161 Oct 05 02:44:14.368928 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1839/3705] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:14 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 1302 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:44:14.404997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fadb5533-5ee6-41d9-a847-0e4cf876cc2e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:14.418192 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fadb5533-5ee6-41d9-a847-0e4cf876cc2e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54" status: 200 len: 1315 microversion: 2.1 time: 0.614020 Oct 05 02:44:14.440713 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1867/3706] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:13 2022] GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54 => generated 1315 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:14.948511 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f738b3a2-2750-4275-8a1a-eea5cff35e36 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:14.949158 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f738b3a2-2750-4275-8a1a-eea5cff35e36 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:14.981582 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f738b3a2-2750-4275-8a1a-eea5cff35e36 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:14.982778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f738b3a2-2750-4275-8a1a-eea5cff35e36 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:14.984199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f738b3a2-2750-4275-8a1a-eea5cff35e36 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:14.986308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f738b3a2-2750-4275-8a1a-eea5cff35e36 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:14.987151 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f738b3a2-2750-4275-8a1a-eea5cff35e36 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:14.987795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f738b3a2-2750-4275-8a1a-eea5cff35e36 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:15.119601 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f738b3a2-2750-4275-8a1a-eea5cff35e36 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:15.132570 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f738b3a2-2750-4275-8a1a-eea5cff35e36 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:15.135591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f738b3a2-2750-4275-8a1a-eea5cff35e36 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:15.143444 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f738b3a2-2750-4275-8a1a-eea5cff35e36 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.199343 Oct 05 02:44:15.145985 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1840/3707] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:14 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:44:15.379722 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5e98e25a-79c9-4a08-aa74-0072676aa50c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:15.381056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5e98e25a-79c9-4a08-aa74-0072676aa50c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: 29215d80-fdc9-408d-b885-e6f3a5f7da84] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:15.401647 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e98e25a-79c9-4a08-aa74-0072676aa50c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:15.402417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e98e25a-79c9-4a08-aa74-0072676aa50c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:15.403694 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e98e25a-79c9-4a08-aa74-0072676aa50c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:15.406308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e98e25a-79c9-4a08-aa74-0072676aa50c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:15.407040 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e98e25a-79c9-4a08-aa74-0072676aa50c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:15.413406 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e98e25a-79c9-4a08-aa74-0072676aa50c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:15.448934 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-341ee9f5-6b20-4a7b-a41b-394fb5a1310a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:15.450010 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-341ee9f5-6b20-4a7b-a41b-394fb5a1310a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 982726d5-6806-4714-a8c0-551ce0243b54] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:15.452697 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-5e98e25a-79c9-4a08-aa74-0072676aa50c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] HTTP exception thrown: Instance 29215d80-fdc9-408d-b885-e6f3a5f7da84 could not be found. Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5e98e25a-79c9-4a08-aa74-0072676aa50c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Request method failure captured: Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 HTTP/1.1 Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO36ltbqSTUUbvu0hdqW0wQBoUm-r6GxIAEEd18CBM22KLVOl8K-EDOJPIET_U45dlDowv34n9XRsWWKfPvsyy2vrAIp4utgmXQPYalSsXar1M4lI-8u75H4HGbvKo_36r6Qb_FAus1jmvh8wdpC8UH0bLnDilwqzOjDx1XYkrBZ0cw Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 446a33968038476fbc98fc0b6b1795c0 Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-MigrationsAdminTest-976515262 Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/446a33968038476fbc98fc0b6b1795c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/446a33968038476fbc98fc0b6b1795c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/446a33968038476fbc98fc0b6b1795c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_446a33968038476fbc98fc0b6b1795c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-MigrationsAdminTest-976515262 Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 446a33968038476fbc98fc0b6b1795c0 Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-MigrationsAdminTest-976515262 Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-MigrationsAdminTest-976515262-project Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 1b4b5f0c43074932a8963727adfee38a Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-MigrationsAdminTest-976515262-project Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 29215d80-fdc9-408d-b885-e6f3a5f7da84 could not be found. Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '29215d80-fdc9-408d-b885-e6f3a5f7da84'} Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29215d80-fdc9-408d-b885-e6f3a5f7da84 could not be found. Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29215d80-fdc9-408d-b885-e6f3a5f7da84 could not be found. Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:44:15.456370 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:15.461071 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:15.461071 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:44:15.461071 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:44:15.461071 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:44:15.461071 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:44:15.461071 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29215d80-fdc9-408d-b885-e6f3a5f7da84 could not be found. Oct 05 02:44:15.461071 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:15.462836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-341ee9f5-6b20-4a7b-a41b-394fb5a1310a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:15.463352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-341ee9f5-6b20-4a7b-a41b-394fb5a1310a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:15.463797 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-341ee9f5-6b20-4a7b-a41b-394fb5a1310a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:15.464322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5e98e25a-79c9-4a08-aa74-0072676aa50c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Returning 404 to user: Instance 29215d80-fdc9-408d-b885-e6f3a5f7da84 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:44:15.464509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-341ee9f5-6b20-4a7b-a41b-394fb5a1310a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:15.465530 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5e98e25a-79c9-4a08-aa74-0072676aa50c tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84" status: 404 len: 111 microversion: 2.1 time: 0.091151 Oct 05 02:44:15.470277 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1868/3708] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:15 2022] GET /compute/v2.1/servers/29215d80-fdc9-408d-b885-e6f3a5f7da84 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:44:15.478282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-341ee9f5-6b20-4a7b-a41b-394fb5a1310a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:15.480351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-341ee9f5-6b20-4a7b-a41b-394fb5a1310a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:15.485377 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-27ad8b6f-698f-45c6-a7d6-dd613291a7fe tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:15.486496 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-27ad8b6f-698f-45c6-a7d6-dd613291a7fe tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:15.497467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27ad8b6f-698f-45c6-a7d6-dd613291a7fe tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:15.498369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27ad8b6f-698f-45c6-a7d6-dd613291a7fe tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:15.499039 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27ad8b6f-698f-45c6-a7d6-dd613291a7fe tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:15.499986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27ad8b6f-698f-45c6-a7d6-dd613291a7fe tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:15.506798 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27ad8b6f-698f-45c6-a7d6-dd613291a7fe tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:15.507731 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27ad8b6f-698f-45c6-a7d6-dd613291a7fe tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:15.543366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-27ad8b6f-698f-45c6-a7d6-dd613291a7fe tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:44:15.684553 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-27ad8b6f-698f-45c6-a7d6-dd613291a7fe tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 204 len: 0 microversion: 2.1 time: 0.212820 Oct 05 02:44:15.689227 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1869/3709] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:44:15 2022] DELETE /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:44:15.701240 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c6edc6b8-5d92-4135-9eda-62680277461d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:15.703026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c6edc6b8-5d92-4135-9eda-62680277461d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:15.721467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c6edc6b8-5d92-4135-9eda-62680277461d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:15.722213 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c6edc6b8-5d92-4135-9eda-62680277461d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:15.725160 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c6edc6b8-5d92-4135-9eda-62680277461d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:15.726131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c6edc6b8-5d92-4135-9eda-62680277461d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:15.730803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c6edc6b8-5d92-4135-9eda-62680277461d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:15.731492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c6edc6b8-5d92-4135-9eda-62680277461d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:16.059157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-341ee9f5-6b20-4a7b-a41b-394fb5a1310a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:16.084579 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-341ee9f5-6b20-4a7b-a41b-394fb5a1310a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54" status: 200 len: 1315 microversion: 2.1 time: 0.640704 Oct 05 02:44:16.086705 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1841/3710] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:15 2022] GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54 => generated 1315 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:44:16.178409 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6413f4af-c516-4c88-a09b-1d9a8a86a131 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:16.179579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6413f4af-c516-4c88-a09b-1d9a8a86a131 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:16.188260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c6edc6b8-5d92-4135-9eda-62680277461d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:16.196394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6413f4af-c516-4c88-a09b-1d9a8a86a131 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:16.197054 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6413f4af-c516-4c88-a09b-1d9a8a86a131 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:16.197491 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c6edc6b8-5d92-4135-9eda-62680277461d tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1469 microversion: 2.1 time: 0.504077 Oct 05 02:44:16.202644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6413f4af-c516-4c88-a09b-1d9a8a86a131 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:16.205464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6413f4af-c516-4c88-a09b-1d9a8a86a131 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:16.212378 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6413f4af-c516-4c88-a09b-1d9a8a86a131 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:16.213099 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6413f4af-c516-4c88-a09b-1d9a8a86a131 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:16.239808 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1870/3711] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:15 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1469 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:16.393418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6413f4af-c516-4c88-a09b-1d9a8a86a131 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:16.405449 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6413f4af-c516-4c88-a09b-1d9a8a86a131 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:16.408140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6413f4af-c516-4c88-a09b-1d9a8a86a131 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:16.415631 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6413f4af-c516-4c88-a09b-1d9a8a86a131 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.241096 Oct 05 02:44:16.416763 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1842/3712] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:16 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:44:17.111232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a541f155-bcf6-48f8-8d09-680fbd820aa5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:17.112499 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a541f155-bcf6-48f8-8d09-680fbd820aa5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 982726d5-6806-4714-a8c0-551ce0243b54] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:17.122333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a541f155-bcf6-48f8-8d09-680fbd820aa5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:17.130782 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a541f155-bcf6-48f8-8d09-680fbd820aa5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:17.133078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a541f155-bcf6-48f8-8d09-680fbd820aa5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:17.135367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a541f155-bcf6-48f8-8d09-680fbd820aa5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:17.146374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a541f155-bcf6-48f8-8d09-680fbd820aa5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:17.147103 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a541f155-bcf6-48f8-8d09-680fbd820aa5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:17.224072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-afbf9bb1-2306-4d68-a464-718d467dbee4 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:17.225360 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-afbf9bb1-2306-4d68-a464-718d467dbee4 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:17.245232 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-afbf9bb1-2306-4d68-a464-718d467dbee4 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:17.247371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-afbf9bb1-2306-4d68-a464-718d467dbee4 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:17.247841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-afbf9bb1-2306-4d68-a464-718d467dbee4 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:17.248594 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-afbf9bb1-2306-4d68-a464-718d467dbee4 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:17.249102 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-afbf9bb1-2306-4d68-a464-718d467dbee4 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:17.249536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-afbf9bb1-2306-4d68-a464-718d467dbee4 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:17.943651 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-afbf9bb1-2306-4d68-a464-718d467dbee4 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:17.966251 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-afbf9bb1-2306-4d68-a464-718d467dbee4 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1469 microversion: 2.1 time: 0.737572 Oct 05 02:44:17.991278 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1843/3713] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:17 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1469 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:18.002839 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-752a9768-691a-40f8-995f-8ecfec832645 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:18.014413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-752a9768-691a-40f8-995f-8ecfec832645 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:18.028746 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a541f155-bcf6-48f8-8d09-680fbd820aa5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:18.033350 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:18.047825 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a541f155-bcf6-48f8-8d09-680fbd820aa5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54" status: 200 len: 1315 microversion: 2.1 time: 0.936682 Oct 05 02:44:18.051350 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1871/3714] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:17 2022] GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54 => generated 1315 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:18.062040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-752a9768-691a-40f8-995f-8ecfec832645 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:18.062569 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-752a9768-691a-40f8-995f-8ecfec832645 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:18.069589 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-752a9768-691a-40f8-995f-8ecfec832645 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:18.070884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-752a9768-691a-40f8-995f-8ecfec832645 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:18.073820 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-752a9768-691a-40f8-995f-8ecfec832645 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:18.075087 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-752a9768-691a-40f8-995f-8ecfec832645 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:18.157624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-e55793e6-2329-4a06-b312-1ebfb7506980 req-4b233bf0-7e92-48c6-9f32-b522b9688d61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac919870-2512-4424-bea6-b003534ce678", "name": "network-vif-deleted", "tag": "210caa7d-298b-408f-a376-b6a2a6f6ce62"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:44:18.182742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e55793e6-2329-4a06-b312-1ebfb7506980 req-4b233bf0-7e92-48c6-9f32-b522b9688d61 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:18.183485 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e55793e6-2329-4a06-b312-1ebfb7506980 req-4b233bf0-7e92-48c6-9f32-b522b9688d61 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:18.184133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e55793e6-2329-4a06-b312-1ebfb7506980 req-4b233bf0-7e92-48c6-9f32-b522b9688d61 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:18.216812 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-e55793e6-2329-4a06-b312-1ebfb7506980 req-4b233bf0-7e92-48c6-9f32-b522b9688d61 service nova] Creating event network-vif-deleted:210caa7d-298b-408f-a376-b6a2a6f6ce62 for instance ac919870-2512-4424-bea6-b003534ce678 on n-h1-858272-3 Oct 05 02:44:18.227722 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-e55793e6-2329-4a06-b312-1ebfb7506980 req-4b233bf0-7e92-48c6-9f32-b522b9688d61 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075958 Oct 05 02:44:18.231953 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1872/3715] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:44:18.257610 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-752a9768-691a-40f8-995f-8ecfec832645 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:18.286361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-752a9768-691a-40f8-995f-8ecfec832645 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:18.295044 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-752a9768-691a-40f8-995f-8ecfec832645 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:18.314092 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-752a9768-691a-40f8-995f-8ecfec832645 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.317726 Oct 05 02:44:18.316270 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1844/3716] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:17 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:44:18.997099 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c564cf97-d44b-4a7f-af54-ea66ba7ef7a2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:18.997802 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c564cf97-d44b-4a7f-af54-ea66ba7ef7a2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:19.008661 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c564cf97-d44b-4a7f-af54-ea66ba7ef7a2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:19.014573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c564cf97-d44b-4a7f-af54-ea66ba7ef7a2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:19.015009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c564cf97-d44b-4a7f-af54-ea66ba7ef7a2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:19.017580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c564cf97-d44b-4a7f-af54-ea66ba7ef7a2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:19.018322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c564cf97-d44b-4a7f-af54-ea66ba7ef7a2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:19.020233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c564cf97-d44b-4a7f-af54-ea66ba7ef7a2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:19.077917 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-656730da-8a3c-4b49-bbc5-0178e05ffc59 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:19.079522 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-656730da-8a3c-4b49-bbc5-0178e05ffc59 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 982726d5-6806-4714-a8c0-551ce0243b54] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:19.096003 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c564cf97-d44b-4a7f-af54-ea66ba7ef7a2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:19.098146 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-656730da-8a3c-4b49-bbc5-0178e05ffc59 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:19.098846 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c564cf97-d44b-4a7f-af54-ea66ba7ef7a2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:19.099374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c564cf97-d44b-4a7f-af54-ea66ba7ef7a2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:19.100049 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-656730da-8a3c-4b49-bbc5-0178e05ffc59 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:19.100543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-c564cf97-d44b-4a7f-af54-ea66ba7ef7a2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lazy-loading 'fault' on Instance uuid ac919870-2512-4424-bea6-b003534ce678 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:44:19.101406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-656730da-8a3c-4b49-bbc5-0178e05ffc59 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:19.103241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-656730da-8a3c-4b49-bbc5-0178e05ffc59 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:19.105575 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-656730da-8a3c-4b49-bbc5-0178e05ffc59 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:19.108193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-656730da-8a3c-4b49-bbc5-0178e05ffc59 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:19.296183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c564cf97-d44b-4a7f-af54-ea66ba7ef7a2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4b5f0c43074932a8963727adfee38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446a33968038476fbc98fc0b6b1795c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:19.310695 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c564cf97-d44b-4a7f-af54-ea66ba7ef7a2 tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 200 len: 1303 microversion: 2.1 time: 0.317999 Oct 05 02:44:19.332403 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1873/3717] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:18 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 1303 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:19.353519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5290b762-529c-4c2d-bf6c-ce99c253fa16 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:19.354137 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5290b762-529c-4c2d-bf6c-ce99c253fa16 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:19.369812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5290b762-529c-4c2d-bf6c-ce99c253fa16 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:19.378588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5290b762-529c-4c2d-bf6c-ce99c253fa16 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:19.379125 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5290b762-529c-4c2d-bf6c-ce99c253fa16 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:19.379912 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5290b762-529c-4c2d-bf6c-ce99c253fa16 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:19.380381 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5290b762-529c-4c2d-bf6c-ce99c253fa16 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:19.380813 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5290b762-529c-4c2d-bf6c-ce99c253fa16 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:19.385395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-656730da-8a3c-4b49-bbc5-0178e05ffc59 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:19.396171 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-656730da-8a3c-4b49-bbc5-0178e05ffc59 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54" status: 200 len: 1315 microversion: 2.1 time: 0.323607 Oct 05 02:44:19.399451 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1845/3718] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:19 2022] GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54 => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:44:19.655877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5290b762-529c-4c2d-bf6c-ce99c253fa16 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:19.665657 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5290b762-529c-4c2d-bf6c-ce99c253fa16 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:19.669564 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5290b762-529c-4c2d-bf6c-ce99c253fa16 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:19.695720 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5290b762-529c-4c2d-bf6c-ce99c253fa16 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.338156 Oct 05 02:44:19.696397 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1874/3719] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:19 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:44:20.428687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-35a2319c-3c9f-447a-959f-0eaa1d5b839e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:20.428687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-35a2319c-3c9f-447a-959f-0eaa1d5b839e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] [instance: ac919870-2512-4424-bea6-b003534ce678] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:20.428687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35a2319c-3c9f-447a-959f-0eaa1d5b839e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:20.428687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35a2319c-3c9f-447a-959f-0eaa1d5b839e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:20.428687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35a2319c-3c9f-447a-959f-0eaa1d5b839e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:20.428687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35a2319c-3c9f-447a-959f-0eaa1d5b839e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:20.428687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35a2319c-3c9f-447a-959f-0eaa1d5b839e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:20.428687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35a2319c-3c9f-447a-959f-0eaa1d5b839e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:20.428687 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-35a2319c-3c9f-447a-959f-0eaa1d5b839e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] HTTP exception thrown: Instance ac919870-2512-4424-bea6-b003534ce678 could not be found. Oct 05 02:44:20.428687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-35a2319c-3c9f-447a-959f-0eaa1d5b839e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Request method failure captured: Oct 05 02:44:20.428687 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 HTTP/1.1 Oct 05 02:44:20.428687 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:44:20.428687 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:44:20.428687 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:44:20.428687 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:44:20.428687 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:44:20.428687 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:44:20.428687 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:44:20.428687 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:44:20.428687 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO36ltbqSTUUbvu0hdqW0wQBoUm-r6GxIAEEd18CBM22KLVOl8K-EDOJPIET_U45dlDowv34n9XRsWWKfPvsyy2vrAIp4utgmXQPYalSsXar1M4lI-8u75H4HGbvKo_36r6Qb_FAus1jmvh8wdpC8UH0bLnDilwqzOjDx1XYkrBZ0cw Oct 05 02:44:20.428687 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:44:20.428687 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:44:20.428687 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:44:20.428687 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:44:20.428687 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:44:20.428687 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:44:20.428687 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 446a33968038476fbc98fc0b6b1795c0 Oct 05 02:44:20.428687 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-MigrationsAdminTest-976515262 Oct 05 02:44:20.428687 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:44:20.428687 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/446a33968038476fbc98fc0b6b1795c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/446a33968038476fbc98fc0b6b1795c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/446a33968038476fbc98fc0b6b1795c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_446a33968038476fbc98fc0b6b1795c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-MigrationsAdminTest-976515262 Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 446a33968038476fbc98fc0b6b1795c0 Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-MigrationsAdminTest-976515262 Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-MigrationsAdminTest-976515262-project Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 1b4b5f0c43074932a8963727adfee38a Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-MigrationsAdminTest-976515262-project Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance ac919870-2512-4424-bea6-b003534ce678 could not be found. Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'ac919870-2512-4424-bea6-b003534ce678'} Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac919870-2512-4424-bea6-b003534ce678 could not be found. Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac919870-2512-4424-bea6-b003534ce678 could not be found. Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac919870-2512-4424-bea6-b003534ce678 could not be found. Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:44:20.434433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-35a2319c-3c9f-447a-959f-0eaa1d5b839e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] Returning 404 to user: Instance ac919870-2512-4424-bea6-b003534ce678 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:44:20.442838 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-35a2319c-3c9f-447a-959f-0eaa1d5b839e tempest-MigrationsAdminTest-976515262 tempest-MigrationsAdminTest-976515262-project] 10.222.0.16 "GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678" status: 404 len: 111 microversion: 2.1 time: 0.093540 Oct 05 02:44:20.443582 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-33435af5-23e9-4a27-a787-4c5264d214c3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:20.443582 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-33435af5-23e9-4a27-a787-4c5264d214c3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 982726d5-6806-4714-a8c0-551ce0243b54] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:20.444120 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1846/3720] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:20 2022] GET /compute/v2.1/servers/ac919870-2512-4424-bea6-b003534ce678 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:44:20.449201 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33435af5-23e9-4a27-a787-4c5264d214c3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:20.449201 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33435af5-23e9-4a27-a787-4c5264d214c3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:20.452539 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33435af5-23e9-4a27-a787-4c5264d214c3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:20.455256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33435af5-23e9-4a27-a787-4c5264d214c3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:20.458789 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33435af5-23e9-4a27-a787-4c5264d214c3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:20.459811 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33435af5-23e9-4a27-a787-4c5264d214c3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:20.730083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7ff59586-3847-437b-879f-9fbf9ef7fc0d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:20.730533 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7ff59586-3847-437b-879f-9fbf9ef7fc0d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:20.753002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ff59586-3847-437b-879f-9fbf9ef7fc0d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:20.756287 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ff59586-3847-437b-879f-9fbf9ef7fc0d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:20.771973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ff59586-3847-437b-879f-9fbf9ef7fc0d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:20.774207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ff59586-3847-437b-879f-9fbf9ef7fc0d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:20.778394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ff59586-3847-437b-879f-9fbf9ef7fc0d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:20.779730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ff59586-3847-437b-879f-9fbf9ef7fc0d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:21.474167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7ff59586-3847-437b-879f-9fbf9ef7fc0d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:21.494283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7ff59586-3847-437b-879f-9fbf9ef7fc0d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:21.504109 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7ff59586-3847-437b-879f-9fbf9ef7fc0d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:21.524745 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7ff59586-3847-437b-879f-9fbf9ef7fc0d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.799067 Oct 05 02:44:21.527731 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1847/3721] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:20 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:44:21.667490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-33435af5-23e9-4a27-a787-4c5264d214c3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:21.680821 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-33435af5-23e9-4a27-a787-4c5264d214c3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54" status: 200 len: 1315 microversion: 2.1 time: 1.253469 Oct 05 02:44:21.682365 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1875/3722] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:20 2022] GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54 => generated 1315 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:21.990786 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-0f4f6b2f-2449-479c-868e-5959e637789f req-0db5069c-f36e-493a-9157-b1261713ca5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "982726d5-6806-4714-a8c0-551ce0243b54", "name": "network-vif-plugged", "status": "completed", "tag": "9ed69517-151f-4fb3-be05-5de4ef13374d"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:44:22.016694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-0f4f6b2f-2449-479c-868e-5959e637789f req-0db5069c-f36e-493a-9157-b1261713ca5a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:22.017311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-0f4f6b2f-2449-479c-868e-5959e637789f req-0db5069c-f36e-493a-9157-b1261713ca5a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:22.017553 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-0f4f6b2f-2449-479c-868e-5959e637789f req-0db5069c-f36e-493a-9157-b1261713ca5a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:22.057931 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-0f4f6b2f-2449-479c-868e-5959e637789f req-0db5069c-f36e-493a-9157-b1261713ca5a service nova] Creating event network-vif-plugged:9ed69517-151f-4fb3-be05-5de4ef13374d for instance 982726d5-6806-4714-a8c0-551ce0243b54 on n-h1-858272-3 Oct 05 02:44:22.076464 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-0f4f6b2f-2449-479c-868e-5959e637789f req-0db5069c-f36e-493a-9157-b1261713ca5a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089108 Oct 05 02:44:22.079261 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1848/3723] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:44:22.560895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-47b718e7-e457-44aa-942d-82fd99942e2b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:22.563796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-47b718e7-e457-44aa-942d-82fd99942e2b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:22.590608 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47b718e7-e457-44aa-942d-82fd99942e2b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:22.593324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47b718e7-e457-44aa-942d-82fd99942e2b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:22.594414 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47b718e7-e457-44aa-942d-82fd99942e2b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:22.597946 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47b718e7-e457-44aa-942d-82fd99942e2b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:22.598464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47b718e7-e457-44aa-942d-82fd99942e2b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:22.598914 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47b718e7-e457-44aa-942d-82fd99942e2b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:22.714647 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2a3991bc-9baf-495d-9f4d-438ca70905ce tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:22.717859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2a3991bc-9baf-495d-9f4d-438ca70905ce tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 982726d5-6806-4714-a8c0-551ce0243b54] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:22.737948 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a3991bc-9baf-495d-9f4d-438ca70905ce tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:22.745080 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a3991bc-9baf-495d-9f4d-438ca70905ce tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:22.748275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a3991bc-9baf-495d-9f4d-438ca70905ce tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:22.751339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a3991bc-9baf-495d-9f4d-438ca70905ce tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:22.752696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a3991bc-9baf-495d-9f4d-438ca70905ce tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:22.759715 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a3991bc-9baf-495d-9f4d-438ca70905ce tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:22.908097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-47b718e7-e457-44aa-942d-82fd99942e2b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:22.937234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-47b718e7-e457-44aa-942d-82fd99942e2b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:22.940423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-47b718e7-e457-44aa-942d-82fd99942e2b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:22.955503 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-47b718e7-e457-44aa-942d-82fd99942e2b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.400105 Oct 05 02:44:22.958321 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1876/3724] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:22 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:44:23.377439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2a3991bc-9baf-495d-9f4d-438ca70905ce tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:23.386859 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2a3991bc-9baf-495d-9f4d-438ca70905ce tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54" status: 200 len: 1315 microversion: 2.1 time: 0.678897 Oct 05 02:44:23.393349 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1849/3725] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:22 2022] GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54 => generated 1315 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:23.985585 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5ca3912c-e9d8-4ccf-bce0-54e7abe47c85 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:23.986847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5ca3912c-e9d8-4ccf-bce0-54e7abe47c85 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:24.003801 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5ca3912c-e9d8-4ccf-bce0-54e7abe47c85 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:24.004604 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5ca3912c-e9d8-4ccf-bce0-54e7abe47c85 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:24.005149 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5ca3912c-e9d8-4ccf-bce0-54e7abe47c85 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:24.005957 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5ca3912c-e9d8-4ccf-bce0-54e7abe47c85 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:24.006473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5ca3912c-e9d8-4ccf-bce0-54e7abe47c85 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:24.007073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5ca3912c-e9d8-4ccf-bce0-54e7abe47c85 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:24.230448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5ca3912c-e9d8-4ccf-bce0-54e7abe47c85 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:24.243436 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5ca3912c-e9d8-4ccf-bce0-54e7abe47c85 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:24.244878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5ca3912c-e9d8-4ccf-bce0-54e7abe47c85 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:24.256612 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5ca3912c-e9d8-4ccf-bce0-54e7abe47c85 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.276736 Oct 05 02:44:24.261703 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1877/3726] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:23 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:44:24.416076 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5c8f6103-dc57-4dff-91fc-589e041bfc54 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:24.417247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5c8f6103-dc57-4dff-91fc-589e041bfc54 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 982726d5-6806-4714-a8c0-551ce0243b54] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:24.425765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c8f6103-dc57-4dff-91fc-589e041bfc54 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:24.435101 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c8f6103-dc57-4dff-91fc-589e041bfc54 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:24.435522 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c8f6103-dc57-4dff-91fc-589e041bfc54 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:24.436320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c8f6103-dc57-4dff-91fc-589e041bfc54 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:24.445137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c8f6103-dc57-4dff-91fc-589e041bfc54 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:24.445715 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c8f6103-dc57-4dff-91fc-589e041bfc54 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:25.310144 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8c963734-19f9-448f-9e43-4e007146ae05 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:25.310567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8c963734-19f9-448f-9e43-4e007146ae05 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:25.323061 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c963734-19f9-448f-9e43-4e007146ae05 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:25.323887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c963734-19f9-448f-9e43-4e007146ae05 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:25.324543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c963734-19f9-448f-9e43-4e007146ae05 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:25.325781 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c963734-19f9-448f-9e43-4e007146ae05 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:25.326593 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c963734-19f9-448f-9e43-4e007146ae05 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:25.327161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c963734-19f9-448f-9e43-4e007146ae05 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:25.339256 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5c8f6103-dc57-4dff-91fc-589e041bfc54 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:25.355593 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5c8f6103-dc57-4dff-91fc-589e041bfc54 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54" status: 200 len: 1315 microversion: 2.1 time: 0.941496 Oct 05 02:44:25.356479 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1850/3727] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:24 2022] GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54 => generated 1315 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:25.495873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8c963734-19f9-448f-9e43-4e007146ae05 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:25.521395 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8c963734-19f9-448f-9e43-4e007146ae05 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:25.530815 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8c963734-19f9-448f-9e43-4e007146ae05 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:25.558575 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8c963734-19f9-448f-9e43-4e007146ae05 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1560 microversion: 2.91 time: 0.268340 Oct 05 02:44:25.561307 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1878/3728] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:25 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1560 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:44:26.283910 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2ead9cd9-0b30-4227-98eb-77177c461599 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1189266246", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "96e642ce-fd4a-4176-9f26-2851b1136035"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:44:26.377733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-2ead9cd9-0b30-4227-98eb-77177c461599 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] validate_networks() for [('96e642ce-fd4a-4176-9f26-2851b1136035', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:44:26.383909 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-82bd505f-a949-4572-8c2f-a9a2ddc4e119 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:26.385114 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-82bd505f-a949-4572-8c2f-a9a2ddc4e119 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 982726d5-6806-4714-a8c0-551ce0243b54] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:26.414027 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82bd505f-a949-4572-8c2f-a9a2ddc4e119 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:26.416407 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82bd505f-a949-4572-8c2f-a9a2ddc4e119 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:26.419179 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82bd505f-a949-4572-8c2f-a9a2ddc4e119 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:26.420091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82bd505f-a949-4572-8c2f-a9a2ddc4e119 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:26.422196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82bd505f-a949-4572-8c2f-a9a2ddc4e119 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:26.423721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82bd505f-a949-4572-8c2f-a9a2ddc4e119 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:27.092331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-82bd505f-a949-4572-8c2f-a9a2ddc4e119 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:27.102674 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-82bd505f-a949-4572-8c2f-a9a2ddc4e119 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54" status: 200 len: 1503 microversion: 2.1 time: 0.721725 Oct 05 02:44:27.118919 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1879/3729] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:26 2022] GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54 => generated 1503 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:44:27.130984 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7d9be973-8ac6-41aa-a92d-8aebebaa9388 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:27.134472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7d9be973-8ac6-41aa-a92d-8aebebaa9388 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:27.148695 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7d9be973-8ac6-41aa-a92d-8aebebaa9388 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:27.149455 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7d9be973-8ac6-41aa-a92d-8aebebaa9388 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:27.151422 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7d9be973-8ac6-41aa-a92d-8aebebaa9388 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:27.152523 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7d9be973-8ac6-41aa-a92d-8aebebaa9388 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:27.154491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7d9be973-8ac6-41aa-a92d-8aebebaa9388 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:27.155072 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7d9be973-8ac6-41aa-a92d-8aebebaa9388 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:27.294762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7d9be973-8ac6-41aa-a92d-8aebebaa9388 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:27.317721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7d9be973-8ac6-41aa-a92d-8aebebaa9388 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:27.321462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7d9be973-8ac6-41aa-a92d-8aebebaa9388 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:27.340926 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-2ead9cd9-0b30-4227-98eb-77177c461599 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:44:27.341426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-2ead9cd9-0b30-4227-98eb-77177c461599 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:44:27.341958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-2ead9cd9-0b30-4227-98eb-77177c461599 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:44:27.342569 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-2ead9cd9-0b30-4227-98eb-77177c461599 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:44:27.343173 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-2ead9cd9-0b30-4227-98eb-77177c461599 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:44:27.352318 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7d9be973-8ac6-41aa-a92d-8aebebaa9388 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1560 microversion: 2.91 time: 0.232138 Oct 05 02:44:27.353027 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1880/3730] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:27 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1560 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:44:27.373714 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ead9cd9-0b30-4227-98eb-77177c461599 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:27.373714 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ead9cd9-0b30-4227-98eb-77177c461599 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:27.373714 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ead9cd9-0b30-4227-98eb-77177c461599 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:27.374665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ead9cd9-0b30-4227-98eb-77177c461599 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:27.375493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ead9cd9-0b30-4227-98eb-77177c461599 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:27.376301 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ead9cd9-0b30-4227-98eb-77177c461599 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:27.382413 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ae894ae0-75a2-4b40-82ad-1cd224a1f56a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:27.382931 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ae894ae0-75a2-4b40-82ad-1cd224a1f56a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 982726d5-6806-4714-a8c0-551ce0243b54] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:27.392157 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae894ae0-75a2-4b40-82ad-1cd224a1f56a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:27.392157 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae894ae0-75a2-4b40-82ad-1cd224a1f56a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:27.392157 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae894ae0-75a2-4b40-82ad-1cd224a1f56a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:27.393010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae894ae0-75a2-4b40-82ad-1cd224a1f56a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:27.393010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae894ae0-75a2-4b40-82ad-1cd224a1f56a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:27.393309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae894ae0-75a2-4b40-82ad-1cd224a1f56a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:27.436500 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-2ead9cd9-0b30-4227-98eb-77177c461599 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Getting quotas for project b8325066949145cf92e3ec5dd67f44a2. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:44:27.444346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ae894ae0-75a2-4b40-82ad-1cd224a1f56a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 982726d5-6806-4714-a8c0-551ce0243b54] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:44:27.444935 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-2ead9cd9-0b30-4227-98eb-77177c461599 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Getting quotas for user ed6bf791f0d34cbe822b35402973cc49 and project b8325066949145cf92e3ec5dd67f44a2. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:44:27.466067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2ead9cd9-0b30-4227-98eb-77177c461599 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:44:27.482323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2ead9cd9-0b30-4227-98eb-77177c461599 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] [instance: 7025724f-62fd-40b5-b6c2-d696e2298236] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:44:27.613245 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2ead9cd9-0b30-4227-98eb-77177c461599 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.803943 Oct 05 02:44:27.614883 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1851/3731] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:44:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:44:27.644469 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-373d9eab-6c50-4abc-9cc6-024285ce83b3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:27.646605 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-373d9eab-6c50-4abc-9cc6-024285ce83b3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:27.668730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-373d9eab-6c50-4abc-9cc6-024285ce83b3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:27.669635 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-373d9eab-6c50-4abc-9cc6-024285ce83b3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:27.670157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-373d9eab-6c50-4abc-9cc6-024285ce83b3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:27.671193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-373d9eab-6c50-4abc-9cc6-024285ce83b3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:27.683902 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-373d9eab-6c50-4abc-9cc6-024285ce83b3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:27.687246 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-373d9eab-6c50-4abc-9cc6-024285ce83b3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:27.709659 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ae894ae0-75a2-4b40-82ad-1cd224a1f56a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "DELETE /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54" status: 204 len: 0 microversion: 2.1 time: 0.331610 Oct 05 02:44:27.711175 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1881/3732] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:44:27 2022] DELETE /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:44:27.720327 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-da431a77-7c02-436a-afb4-89583531b98b tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:27.721642 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-da431a77-7c02-436a-afb4-89583531b98b tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] [instance: 7025724f-62fd-40b5-b6c2-d696e2298236] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:27.929763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-da431a77-7c02-436a-afb4-89583531b98b tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6bf791f0d34cbe822b35402973cc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8325066949145cf92e3ec5dd67f44a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:27.943242 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-da431a77-7c02-436a-afb4-89583531b98b tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] 10.222.0.16 "GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236" status: 200 len: 1217 microversion: 2.1 time: 0.229378 Oct 05 02:44:27.943868 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1882/3733] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:27 2022] GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236 => generated 1217 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:28.046876 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-373d9eab-6c50-4abc-9cc6-024285ce83b3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:28.058078 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-373d9eab-6c50-4abc-9cc6-024285ce83b3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1682 microversion: 2.1 time: 0.440039 Oct 05 02:44:28.058785 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1852/3734] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:27 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1682 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:28.066453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7417418d-1827-4142-8bda-a4e2b5d9f116 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:28.067289 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7417418d-1827-4142-8bda-a4e2b5d9f116 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 982726d5-6806-4714-a8c0-551ce0243b54] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:28.080030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7417418d-1827-4142-8bda-a4e2b5d9f116 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:28.081201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7417418d-1827-4142-8bda-a4e2b5d9f116 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:28.081922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7417418d-1827-4142-8bda-a4e2b5d9f116 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:28.083009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7417418d-1827-4142-8bda-a4e2b5d9f116 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:28.083479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7417418d-1827-4142-8bda-a4e2b5d9f116 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:28.083910 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7417418d-1827-4142-8bda-a4e2b5d9f116 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:28.272789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7417418d-1827-4142-8bda-a4e2b5d9f116 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:28.282518 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7417418d-1827-4142-8bda-a4e2b5d9f116 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54" status: 200 len: 1509 microversion: 2.1 time: 0.222414 Oct 05 02:44:28.300487 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1853/3735] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:28 2022] GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54 => generated 1509 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:28.389326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5b0fa2b0-8c70-4dd7-869f-28bbd642d047 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:28.389995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5b0fa2b0-8c70-4dd7-869f-28bbd642d047 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:28.403521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5b0fa2b0-8c70-4dd7-869f-28bbd642d047 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:28.404044 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5b0fa2b0-8c70-4dd7-869f-28bbd642d047 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:28.404492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5b0fa2b0-8c70-4dd7-869f-28bbd642d047 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:28.405249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5b0fa2b0-8c70-4dd7-869f-28bbd642d047 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:28.409443 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5b0fa2b0-8c70-4dd7-869f-28bbd642d047 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:28.410208 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5b0fa2b0-8c70-4dd7-869f-28bbd642d047 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:28.484007 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-606fab1d-fcdb-4ae6-959e-8ae7238084ee tempest-QuotaClassesAdmin257Test-1393469824 tempest-QuotaClassesAdmin257Test-1393469824-project-admin] Calling method '.version_select at 0x7fcce80ae4c0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:28.505042 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-606fab1d-fcdb-4ae6-959e-8ae7238084ee tempest-QuotaClassesAdmin257Test-1393469824 tempest-QuotaClassesAdmin257Test-1393469824-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.546352 Oct 05 02:44:28.506216 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1883/3736] 10.222.0.16 () {60 vars in 1226 bytes} [Wed Oct 5 02:44:27 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:44:28.521357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d38349b4-38e2-41d1-8aca-1e2e2d146cd0 tempest-QuotaClassesAdmin257Test-1393469824 tempest-QuotaClassesAdmin257Test-1393469824-project-admin] Action: 'update', calling method: .version_select at 0x7fcce80ae670>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:44:28.565384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5b0fa2b0-8c70-4dd7-869f-28bbd642d047 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:28.593222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5b0fa2b0-8c70-4dd7-869f-28bbd642d047 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:28.596619 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5b0fa2b0-8c70-4dd7-869f-28bbd642d047 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:28.603515 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5b0fa2b0-8c70-4dd7-869f-28bbd642d047 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1560 microversion: 2.91 time: 0.218674 Oct 05 02:44:28.604670 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1854/3737] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:28 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:44:28.673197 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=10,nova_api:INSERT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:28.704211 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d38349b4-38e2-41d1-8aca-1e2e2d146cd0 tempest-QuotaClassesAdmin257Test-1393469824 tempest-QuotaClassesAdmin257Test-1393469824-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.190254 Oct 05 02:44:28.711473 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1884/3738] 10.222.0.16 () {62 vars in 1247 bytes} [Wed Oct 5 02:44:28 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:44:28.715733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1aa14c4c-8802-498c-acc5-34c395c26b82 tempest-QuotaClassesAdmin257Test-1393469824 tempest-QuotaClassesAdmin257Test-1393469824-project-admin] Calling method '.version_select at 0x7fccdf180dc0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:28.741775 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1aa14c4c-8802-498c-acc5-34c395c26b82 tempest-QuotaClassesAdmin257Test-1393469824 tempest-QuotaClassesAdmin257Test-1393469824-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.029686 Oct 05 02:44:28.742337 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1855/3739] 10.222.0.16 () {60 vars in 1226 bytes} [Wed Oct 5 02:44:28 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 02:44:28.756402 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f6d35442-64c0-4f01-b8b7-1f4026f15d10 tempest-QuotaClassesAdmin257Test-1393469824 tempest-QuotaClassesAdmin257Test-1393469824-project-admin] Action: 'update', calling method: .version_select at 0x7fccdf3cc430>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:44:28.879834 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f6d35442-64c0-4f01-b8b7-1f4026f15d10 tempest-QuotaClassesAdmin257Test-1393469824 tempest-QuotaClassesAdmin257Test-1393469824-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.129812 Oct 05 02:44:28.887312 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1885/3740] 10.222.0.16 () {62 vars in 1247 bytes} [Wed Oct 5 02:44:28 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 02:44:28.973290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f10dcf68-d946-42bd-b0bc-b54cf324c34f tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:28.973923 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f10dcf68-d946-42bd-b0bc-b54cf324c34f tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] [instance: 7025724f-62fd-40b5-b6c2-d696e2298236] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:28.995120 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f10dcf68-d946-42bd-b0bc-b54cf324c34f tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:28.995662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f10dcf68-d946-42bd-b0bc-b54cf324c34f tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:28.996363 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f10dcf68-d946-42bd-b0bc-b54cf324c34f tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:28.998299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f10dcf68-d946-42bd-b0bc-b54cf324c34f tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:28.998782 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f10dcf68-d946-42bd-b0bc-b54cf324c34f tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:29.000593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f10dcf68-d946-42bd-b0bc-b54cf324c34f tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:29.083262 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-19c98c28-1616-4d12-8013-da77b844c45b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:29.084226 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-19c98c28-1616-4d12-8013-da77b844c45b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:29.098132 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19c98c28-1616-4d12-8013-da77b844c45b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:29.098677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f10dcf68-d946-42bd-b0bc-b54cf324c34f tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6bf791f0d34cbe822b35402973cc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8325066949145cf92e3ec5dd67f44a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:29.100429 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19c98c28-1616-4d12-8013-da77b844c45b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:29.102694 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19c98c28-1616-4d12-8013-da77b844c45b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:29.107376 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f10dcf68-d946-42bd-b0bc-b54cf324c34f tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] 10.222.0.16 "GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236" status: 200 len: 1269 microversion: 2.1 time: 0.142859 Oct 05 02:44:29.107547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19c98c28-1616-4d12-8013-da77b844c45b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:29.108572 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1856/3741] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:28 2022] GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236 => generated 1269 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:29.108676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19c98c28-1616-4d12-8013-da77b844c45b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:29.109515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19c98c28-1616-4d12-8013-da77b844c45b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:29.266907 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-19c98c28-1616-4d12-8013-da77b844c45b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:29.277271 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-19c98c28-1616-4d12-8013-da77b844c45b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.199106 Oct 05 02:44:29.285441 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1886/3742] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:29 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:29.307196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0e516542-4011-4d88-afb9-6d2df8ab0630 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:29.308013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0e516542-4011-4d88-afb9-6d2df8ab0630 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 982726d5-6806-4714-a8c0-551ce0243b54] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:29.320421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e516542-4011-4d88-afb9-6d2df8ab0630 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:29.320421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e516542-4011-4d88-afb9-6d2df8ab0630 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:29.322122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bcfab574-afbb-426c-b2cd-3992ef63140c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1152494263"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:44:29.323807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e516542-4011-4d88-afb9-6d2df8ab0630 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:29.324647 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e516542-4011-4d88-afb9-6d2df8ab0630 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:29.326448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bcfab574-afbb-426c-b2cd-3992ef63140c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:29.327007 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e516542-4011-4d88-afb9-6d2df8ab0630 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:29.327559 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e516542-4011-4d88-afb9-6d2df8ab0630 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:29.337973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bcfab574-afbb-426c-b2cd-3992ef63140c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:29.338478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bcfab574-afbb-426c-b2cd-3992ef63140c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:29.338926 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bcfab574-afbb-426c-b2cd-3992ef63140c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:29.339642 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bcfab574-afbb-426c-b2cd-3992ef63140c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:29.340111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bcfab574-afbb-426c-b2cd-3992ef63140c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:29.340546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bcfab574-afbb-426c-b2cd-3992ef63140c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:29.789500 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0e516542-4011-4d88-afb9-6d2df8ab0630 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:29.792508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:29.804996 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0e516542-4011-4d88-afb9-6d2df8ab0630 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54" status: 200 len: 1509 microversion: 2.1 time: 0.502903 Oct 05 02:44:29.806049 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1857/3743] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:29 2022] GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54 => generated 1509 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:29.820919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f65e03c8-9caa-4c0c-8ccd-74d74147f482 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:29.821748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f65e03c8-9caa-4c0c-8ccd-74d74147f482 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:29.824887 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bcfab574-afbb-426c-b2cd-3992ef63140c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action" status: 202 len: 0 microversion: 2.1 time: 0.512808 Oct 05 02:44:29.832460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f65e03c8-9caa-4c0c-8ccd-74d74147f482 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:29.835815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f65e03c8-9caa-4c0c-8ccd-74d74147f482 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:29.836935 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f65e03c8-9caa-4c0c-8ccd-74d74147f482 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:29.838366 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f65e03c8-9caa-4c0c-8ccd-74d74147f482 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:29.840462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f65e03c8-9caa-4c0c-8ccd-74d74147f482 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:29.841908 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f65e03c8-9caa-4c0c-8ccd-74d74147f482 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:29.845280 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1887/3744] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:44:29 2022] POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action => generated 0 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 05 02:44:29.857129 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b9c2f24f-a5ec-431a-9614-42211a7b5b39 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:29.858211 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b9c2f24f-a5ec-431a-9614-42211a7b5b39 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:29.874733 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9c2f24f-a5ec-431a-9614-42211a7b5b39 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:29.876224 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9c2f24f-a5ec-431a-9614-42211a7b5b39 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:29.876855 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9c2f24f-a5ec-431a-9614-42211a7b5b39 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:29.877911 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9c2f24f-a5ec-431a-9614-42211a7b5b39 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:29.878615 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9c2f24f-a5ec-431a-9614-42211a7b5b39 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:29.879388 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b9c2f24f-a5ec-431a-9614-42211a7b5b39 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:30.131741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f65e03c8-9caa-4c0c-8ccd-74d74147f482 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:30.145686 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f65e03c8-9caa-4c0c-8ccd-74d74147f482 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:30.149907 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f65e03c8-9caa-4c0c-8ccd-74d74147f482 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:30.155345 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f65e03c8-9caa-4c0c-8ccd-74d74147f482 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1560 microversion: 2.91 time: 0.347581 Oct 05 02:44:30.169386 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1858/3745] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:29 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1560 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:44:30.183261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-33333ee5-66b8-430d-8cdf-23ec5c8bcf24 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:30.184117 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-33333ee5-66b8-430d-8cdf-23ec5c8bcf24 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] [instance: 7025724f-62fd-40b5-b6c2-d696e2298236] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:30.191626 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-33333ee5-66b8-430d-8cdf-23ec5c8bcf24 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:30.192132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-33333ee5-66b8-430d-8cdf-23ec5c8bcf24 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:30.192573 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-33333ee5-66b8-430d-8cdf-23ec5c8bcf24 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:30.193305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-33333ee5-66b8-430d-8cdf-23ec5c8bcf24 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:30.193761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-33333ee5-66b8-430d-8cdf-23ec5c8bcf24 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:30.194187 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-33333ee5-66b8-430d-8cdf-23ec5c8bcf24 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:30.352353 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-33333ee5-66b8-430d-8cdf-23ec5c8bcf24 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6bf791f0d34cbe822b35402973cc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8325066949145cf92e3ec5dd67f44a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:30.368094 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-33333ee5-66b8-430d-8cdf-23ec5c8bcf24 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] 10.222.0.16 "GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236" status: 200 len: 1275 microversion: 2.1 time: 0.195916 Oct 05 02:44:30.369949 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1859/3746] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:30 2022] GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236 => generated 1275 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:30.580813 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b9c2f24f-a5ec-431a-9614-42211a7b5b39 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:30.590988 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b9c2f24f-a5ec-431a-9614-42211a7b5b39 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1679 microversion: 2.1 time: 0.743196 Oct 05 02:44:30.595630 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1888/3747] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:29 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1679 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:30.832853 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-205f9e2a-d046-4b2f-8195-458b2297acc5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:30.833524 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-205f9e2a-d046-4b2f-8195-458b2297acc5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 982726d5-6806-4714-a8c0-551ce0243b54] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:30.842590 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-205f9e2a-d046-4b2f-8195-458b2297acc5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:30.843082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-205f9e2a-d046-4b2f-8195-458b2297acc5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:30.843939 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-205f9e2a-d046-4b2f-8195-458b2297acc5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:30.845244 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-205f9e2a-d046-4b2f-8195-458b2297acc5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:30.845821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-205f9e2a-d046-4b2f-8195-458b2297acc5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:30.846134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-205f9e2a-d046-4b2f-8195-458b2297acc5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:31.035869 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-205f9e2a-d046-4b2f-8195-458b2297acc5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:31.048599 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-205f9e2a-d046-4b2f-8195-458b2297acc5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54" status: 200 len: 1467 microversion: 2.1 time: 0.222780 Oct 05 02:44:31.049541 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1860/3748] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:30 2022] GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54 => generated 1467 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:31.085584 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-2c387c14-40f0-4154-b0e1-cabce8f23a64 req-2c7dc3a2-61c5-4a14-965c-37c3973fe6f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "982726d5-6806-4714-a8c0-551ce0243b54", "name": "network-vif-deleted", "tag": "9ed69517-151f-4fb3-be05-5de4ef13374d"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:44:31.118783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-2c387c14-40f0-4154-b0e1-cabce8f23a64 req-2c7dc3a2-61c5-4a14-965c-37c3973fe6f3 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:31.120980 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-2c387c14-40f0-4154-b0e1-cabce8f23a64 req-2c7dc3a2-61c5-4a14-965c-37c3973fe6f3 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:31.124621 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-2c387c14-40f0-4154-b0e1-cabce8f23a64 req-2c7dc3a2-61c5-4a14-965c-37c3973fe6f3 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:31.167561 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-2c387c14-40f0-4154-b0e1-cabce8f23a64 req-2c7dc3a2-61c5-4a14-965c-37c3973fe6f3 service nova] Creating event network-vif-deleted:9ed69517-151f-4fb3-be05-5de4ef13374d for instance 982726d5-6806-4714-a8c0-551ce0243b54 on n-h1-858272-3 Oct 05 02:44:31.174346 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-2c387c14-40f0-4154-b0e1-cabce8f23a64 req-2c7dc3a2-61c5-4a14-965c-37c3973fe6f3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096300 Oct 05 02:44:31.176201 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1889/3749] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:44:31.191904 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c5411435-349d-4459-a021-b4ae8ece2e5a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:31.200161 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c5411435-349d-4459-a021-b4ae8ece2e5a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:31.230369 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5411435-349d-4459-a021-b4ae8ece2e5a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:31.232176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5411435-349d-4459-a021-b4ae8ece2e5a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:31.232952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5411435-349d-4459-a021-b4ae8ece2e5a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:31.233959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5411435-349d-4459-a021-b4ae8ece2e5a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:31.235480 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5411435-349d-4459-a021-b4ae8ece2e5a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:31.236992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5411435-349d-4459-a021-b4ae8ece2e5a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:31.393968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6c30b4ac-c693-4226-8ea8-0ea2f25330ac tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:31.395899 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6c30b4ac-c693-4226-8ea8-0ea2f25330ac tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] [instance: 7025724f-62fd-40b5-b6c2-d696e2298236] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:31.412025 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c5411435-349d-4459-a021-b4ae8ece2e5a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:31.420123 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c30b4ac-c693-4226-8ea8-0ea2f25330ac tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:31.420988 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c30b4ac-c693-4226-8ea8-0ea2f25330ac tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:31.421093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c5411435-349d-4459-a021-b4ae8ece2e5a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:31.422012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c30b4ac-c693-4226-8ea8-0ea2f25330ac tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:31.422631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c5411435-349d-4459-a021-b4ae8ece2e5a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:31.426969 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c30b4ac-c693-4226-8ea8-0ea2f25330ac tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:31.426969 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c30b4ac-c693-4226-8ea8-0ea2f25330ac tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:31.426969 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c30b4ac-c693-4226-8ea8-0ea2f25330ac tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:31.447493 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c5411435-349d-4459-a021-b4ae8ece2e5a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1555 microversion: 2.91 time: 0.259119 Oct 05 02:44:31.473481 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1861/3750] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:31 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1555 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:44:31.494443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:31.622089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-023c1a15-0c53-44a1-a106-4d68b7b8fe0b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:31.622706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-023c1a15-0c53-44a1-a106-4d68b7b8fe0b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:31.639535 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-023c1a15-0c53-44a1-a106-4d68b7b8fe0b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:31.640031 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-023c1a15-0c53-44a1-a106-4d68b7b8fe0b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:31.641466 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-023c1a15-0c53-44a1-a106-4d68b7b8fe0b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:31.642343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-023c1a15-0c53-44a1-a106-4d68b7b8fe0b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:31.642948 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-023c1a15-0c53-44a1-a106-4d68b7b8fe0b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:31.643545 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-023c1a15-0c53-44a1-a106-4d68b7b8fe0b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:31.656145 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6c30b4ac-c693-4226-8ea8-0ea2f25330ac tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6bf791f0d34cbe822b35402973cc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8325066949145cf92e3ec5dd67f44a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:31.665554 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6c30b4ac-c693-4226-8ea8-0ea2f25330ac tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] 10.222.0.16 "GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236" status: 200 len: 1275 microversion: 2.1 time: 0.277349 Oct 05 02:44:31.667784 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1890/3751] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:31 2022] GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236 => generated 1275 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:32.096993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4ef2b25a-31b0-45c6-9e2e-f18eb528b26a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:32.097965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-023c1a15-0c53-44a1-a106-4d68b7b8fe0b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:32.098918 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4ef2b25a-31b0-45c6-9e2e-f18eb528b26a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 982726d5-6806-4714-a8c0-551ce0243b54] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:32.112578 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-023c1a15-0c53-44a1-a106-4d68b7b8fe0b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1679 microversion: 2.1 time: 0.493532 Oct 05 02:44:32.117539 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1862/3752] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:31 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1679 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:32.118543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ef2b25a-31b0-45c6-9e2e-f18eb528b26a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:32.119284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ef2b25a-31b0-45c6-9e2e-f18eb528b26a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:32.119931 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ef2b25a-31b0-45c6-9e2e-f18eb528b26a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:32.122082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ef2b25a-31b0-45c6-9e2e-f18eb528b26a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:32.122771 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ef2b25a-31b0-45c6-9e2e-f18eb528b26a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:32.124192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ef2b25a-31b0-45c6-9e2e-f18eb528b26a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:32.232874 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ef2b25a-31b0-45c6-9e2e-f18eb528b26a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:32.235870 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ef2b25a-31b0-45c6-9e2e-f18eb528b26a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:32.237320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ef2b25a-31b0-45c6-9e2e-f18eb528b26a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:32.238210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-4ef2b25a-31b0-45c6-9e2e-f18eb528b26a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lazy-loading 'fault' on Instance uuid 982726d5-6806-4714-a8c0-551ce0243b54 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:44:32.248595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6f674d56-31ba-42e4-8316-850700cd9a98 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:32.249155 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6f674d56-31ba-42e4-8316-850700cd9a98 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:32.279178 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f674d56-31ba-42e4-8316-850700cd9a98 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:32.279914 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f674d56-31ba-42e4-8316-850700cd9a98 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:32.280421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f674d56-31ba-42e4-8316-850700cd9a98 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:32.282392 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f674d56-31ba-42e4-8316-850700cd9a98 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:32.284819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f674d56-31ba-42e4-8316-850700cd9a98 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:32.289784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f674d56-31ba-42e4-8316-850700cd9a98 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:32.446244 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-6f674d56-31ba-42e4-8316-850700cd9a98 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lazy-loading 'services' on Instance uuid 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:44:32.447447 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4ef2b25a-31b0-45c6-9e2e-f18eb528b26a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:32.455712 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4ef2b25a-31b0-45c6-9e2e-f18eb528b26a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54" status: 200 len: 1305 microversion: 2.1 time: 0.362701 Oct 05 02:44:32.458785 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1891/3753] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:32 2022] GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54 => generated 1305 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:32.483117 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f6d878e7-d306-4ef3-b3db-fc41662f092e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:32.483744 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f6d878e7-d306-4ef3-b3db-fc41662f092e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:32.515692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6d878e7-d306-4ef3-b3db-fc41662f092e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:32.521667 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6d878e7-d306-4ef3-b3db-fc41662f092e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:32.525328 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6d878e7-d306-4ef3-b3db-fc41662f092e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:32.526476 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6d878e7-d306-4ef3-b3db-fc41662f092e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:32.535843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6d878e7-d306-4ef3-b3db-fc41662f092e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:32.537054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6d878e7-d306-4ef3-b3db-fc41662f092e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:32.647261 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6f674d56-31ba-42e4-8316-850700cd9a98 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397/os-volume_attachments/a1c1230b-06ef-4e84-898e-eecaef1b7652" status: 202 len: 0 microversion: 2.1 time: 0.415716 Oct 05 02:44:32.671206 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1863/3754] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 02:44:32 2022] DELETE /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397/os-volume_attachments/a1c1230b-06ef-4e84-898e-eecaef1b7652 => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:44:32.726851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3bf97a55-b187-4e02-be84-d46b24a051aa tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:32.728078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3bf97a55-b187-4e02-be84-d46b24a051aa tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] [instance: 7025724f-62fd-40b5-b6c2-d696e2298236] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:32.768977 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bf97a55-b187-4e02-be84-d46b24a051aa tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:32.770077 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bf97a55-b187-4e02-be84-d46b24a051aa tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:32.770525 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bf97a55-b187-4e02-be84-d46b24a051aa tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:32.782583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bf97a55-b187-4e02-be84-d46b24a051aa tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:32.783090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bf97a55-b187-4e02-be84-d46b24a051aa tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:32.797813 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bf97a55-b187-4e02-be84-d46b24a051aa tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:33.359905 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f6d878e7-d306-4ef3-b3db-fc41662f092e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:33.375979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f6d878e7-d306-4ef3-b3db-fc41662f092e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:33.389892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f6d878e7-d306-4ef3-b3db-fc41662f092e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:33.402776 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f6d878e7-d306-4ef3-b3db-fc41662f092e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1555 microversion: 2.91 time: 0.925728 Oct 05 02:44:33.403486 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1892/3755] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:32 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1555 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:44:33.413588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-aaf044e6-5f1e-4819-b778-04574db5cd44 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:33.414481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-aaf044e6-5f1e-4819-b778-04574db5cd44 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:33.435922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aaf044e6-5f1e-4819-b778-04574db5cd44 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:33.441550 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aaf044e6-5f1e-4819-b778-04574db5cd44 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:33.442214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aaf044e6-5f1e-4819-b778-04574db5cd44 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:33.449928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aaf044e6-5f1e-4819-b778-04574db5cd44 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:33.450688 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aaf044e6-5f1e-4819-b778-04574db5cd44 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:33.451300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aaf044e6-5f1e-4819-b778-04574db5cd44 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:33.558838 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3bf97a55-b187-4e02-be84-d46b24a051aa tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6bf791f0d34cbe822b35402973cc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8325066949145cf92e3ec5dd67f44a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:33.570679 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3bf97a55-b187-4e02-be84-d46b24a051aa tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] 10.222.0.16 "GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236" status: 200 len: 1317 microversion: 2.1 time: 0.880054 Oct 05 02:44:33.573220 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1864/3756] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:32 2022] GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236 => generated 1317 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:44:33.585017 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-b9cd6264-5037-469e-acb4-bc56681bc659 req-87be8815-d118-458b-b245-514c31ceeb0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4388e9ec-13a9-4d5b-9310-7a10953c57d0", "name": "network-vif-unplugged", "status": "completed", "tag": "17b098e0-7358-489c-bec3-6b98c1db0796"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:44:33.607977 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b9cd6264-5037-469e-acb4-bc56681bc659 req-87be8815-d118-458b-b245-514c31ceeb0a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:33.610496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b9cd6264-5037-469e-acb4-bc56681bc659 req-87be8815-d118-458b-b245-514c31ceeb0a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:33.621407 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b9cd6264-5037-469e-acb4-bc56681bc659 req-87be8815-d118-458b-b245-514c31ceeb0a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:33.639783 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-b9cd6264-5037-469e-acb4-bc56681bc659 req-87be8815-d118-458b-b245-514c31ceeb0a service nova] Creating event network-vif-unplugged:17b098e0-7358-489c-bec3-6b98c1db0796 for instance 4388e9ec-13a9-4d5b-9310-7a10953c57d0 on n-h1-858272-3 Oct 05 02:44:33.667344 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-b9cd6264-5037-469e-acb4-bc56681bc659 req-87be8815-d118-458b-b245-514c31ceeb0a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086075 Oct 05 02:44:33.671361 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1865/3757] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:44:33.684889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b8dae28c-9800-4b1a-aa2d-49a060be588f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:33.685910 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b8dae28c-9800-4b1a-aa2d-49a060be588f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 982726d5-6806-4714-a8c0-551ce0243b54] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:33.693493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8dae28c-9800-4b1a-aa2d-49a060be588f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:33.694313 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8dae28c-9800-4b1a-aa2d-49a060be588f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:33.695365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8dae28c-9800-4b1a-aa2d-49a060be588f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:33.696279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8dae28c-9800-4b1a-aa2d-49a060be588f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:33.698064 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8dae28c-9800-4b1a-aa2d-49a060be588f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:33.698708 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8dae28c-9800-4b1a-aa2d-49a060be588f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:33.723076 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-b8dae28c-9800-4b1a-aa2d-49a060be588f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] HTTP exception thrown: Instance 982726d5-6806-4714-a8c0-551ce0243b54 could not be found. Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b8dae28c-9800-4b1a-aa2d-49a060be588f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Request method failure captured: Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54 HTTP/1.1 Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO9sJgtvOLeTr4nOCD-vOqCqD1zJrAITPFW_zz4yiLyvIoTdHjuR4LJfH4xTHqVQhBEUV87uN4J6FQiHHhnatngFlbfTbJmS6cPceNKMN6UWu-_pNs3jdF8Cb5CgC-hxlx6u-5aGNVi9h5jLYyViTpDjMXgNyRvr5dJZFZQW2uKikA8 Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: d797c0058e8c456290081d056df79292 Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d797c0058e8c456290081d056df79292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d797c0058e8c456290081d056df79292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: d797c0058e8c456290081d056df79292 Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: ff170a5be8a04902b66e5f0e79fd47df Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 982726d5-6806-4714-a8c0-551ce0243b54 could not be found. Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '982726d5-6806-4714-a8c0-551ce0243b54'} Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 982726d5-6806-4714-a8c0-551ce0243b54 could not be found. Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 982726d5-6806-4714-a8c0-551ce0243b54 could not be found. Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:44:33.725398 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:44:33.728595 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:33.728595 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:44:33.728595 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:44:33.728595 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:44:33.728595 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:44:33.728595 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 982726d5-6806-4714-a8c0-551ce0243b54 could not be found. Oct 05 02:44:33.728595 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:44:33.730617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b8dae28c-9800-4b1a-aa2d-49a060be588f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Returning 404 to user: Instance 982726d5-6806-4714-a8c0-551ce0243b54 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:44:33.731799 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b8dae28c-9800-4b1a-aa2d-49a060be588f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54" status: 404 len: 111 microversion: 2.1 time: 0.058946 Oct 05 02:44:33.733035 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1866/3758] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:33 2022] GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:44:33.909782 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bdb75666-1413-4a4f-b62c-ed3981de380a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1058114838", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "e4f9d49c-25ab-4e4f-a7c4-00e803798e90"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:44:34.024128 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-bdb75666-1413-4a4f-b62c-ed3981de380a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] validate_networks() for [('e4f9d49c-25ab-4e4f-a7c4-00e803798e90', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:44:34.335975 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-aaf044e6-5f1e-4819-b778-04574db5cd44 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:34.344795 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-aaf044e6-5f1e-4819-b778-04574db5cd44 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1687 microversion: 2.1 time: 0.939572 Oct 05 02:44:34.353695 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1893/3759] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:33 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1687 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:34.439009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-28ffdf00-1c5b-46bb-b286-26002b425c3e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:34.440368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-28ffdf00-1c5b-46bb-b286-26002b425c3e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:34.450745 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28ffdf00-1c5b-46bb-b286-26002b425c3e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:34.461689 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28ffdf00-1c5b-46bb-b286-26002b425c3e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:34.462157 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28ffdf00-1c5b-46bb-b286-26002b425c3e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:34.462916 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28ffdf00-1c5b-46bb-b286-26002b425c3e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:34.463384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28ffdf00-1c5b-46bb-b286-26002b425c3e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:34.463826 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28ffdf00-1c5b-46bb-b286-26002b425c3e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:34.586551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-28ffdf00-1c5b-46bb-b286-26002b425c3e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:34.609401 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-28ffdf00-1c5b-46bb-b286-26002b425c3e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:34.613962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-28ffdf00-1c5b-46bb-b286-26002b425c3e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:34.623952 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-28ffdf00-1c5b-46bb-b286-26002b425c3e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1555 microversion: 2.91 time: 0.188803 Oct 05 02:44:34.625547 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1894/3760] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:34 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1555 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:44:34.646995 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4d56f429-5d7d-487b-9d42-6d083b073d3c tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:34.647844 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4d56f429-5d7d-487b-9d42-6d083b073d3c tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] [instance: 7025724f-62fd-40b5-b6c2-d696e2298236] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:34.675570 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d56f429-5d7d-487b-9d42-6d083b073d3c tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:34.682847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d56f429-5d7d-487b-9d42-6d083b073d3c tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:34.684696 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d56f429-5d7d-487b-9d42-6d083b073d3c tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:34.686248 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d56f429-5d7d-487b-9d42-6d083b073d3c tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:34.690597 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d56f429-5d7d-487b-9d42-6d083b073d3c tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:34.692661 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d56f429-5d7d-487b-9d42-6d083b073d3c tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:35.622320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-bdb75666-1413-4a4f-b62c-ed3981de380a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:44:35.623639 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-bdb75666-1413-4a4f-b62c-ed3981de380a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:44:35.624433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-bdb75666-1413-4a4f-b62c-ed3981de380a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:44:35.625539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-bdb75666-1413-4a4f-b62c-ed3981de380a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:44:35.626161 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-bdb75666-1413-4a4f-b62c-ed3981de380a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:44:35.652534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bdb75666-1413-4a4f-b62c-ed3981de380a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:35.653410 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bdb75666-1413-4a4f-b62c-ed3981de380a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:35.654225 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bdb75666-1413-4a4f-b62c-ed3981de380a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:35.656323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bdb75666-1413-4a4f-b62c-ed3981de380a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:35.658009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bdb75666-1413-4a4f-b62c-ed3981de380a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:35.659196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bdb75666-1413-4a4f-b62c-ed3981de380a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:35.737771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-bdb75666-1413-4a4f-b62c-ed3981de380a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Getting quotas for project d797c0058e8c456290081d056df79292. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:44:35.760115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-bdb75666-1413-4a4f-b62c-ed3981de380a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Getting quotas for user ff170a5be8a04902b66e5f0e79fd47df and project d797c0058e8c456290081d056df79292. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:44:35.780651 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4d56f429-5d7d-487b-9d42-6d083b073d3c tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6bf791f0d34cbe822b35402973cc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8325066949145cf92e3ec5dd67f44a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:35.797322 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4d56f429-5d7d-487b-9d42-6d083b073d3c tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] 10.222.0.16 "GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236" status: 200 len: 1317 microversion: 2.1 time: 1.167113 Oct 05 02:44:35.800887 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1895/3761] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:34 2022] GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236 => generated 1317 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:35.808777 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-44f3931e-119d-4a32-991e-14ac6239adef tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:35.815862 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-44f3931e-119d-4a32-991e-14ac6239adef tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:35.826052 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bdb75666-1413-4a4f-b62c-ed3981de380a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:44:35.828682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bdb75666-1413-4a4f-b62c-ed3981de380a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7517582f-12a1-4f22-bfb9-0690938cafd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:44:35.840459 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44f3931e-119d-4a32-991e-14ac6239adef tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:35.844477 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44f3931e-119d-4a32-991e-14ac6239adef tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:35.846202 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44f3931e-119d-4a32-991e-14ac6239adef tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:35.849622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44f3931e-119d-4a32-991e-14ac6239adef tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:35.850801 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44f3931e-119d-4a32-991e-14ac6239adef tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:35.853149 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44f3931e-119d-4a32-991e-14ac6239adef tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:35.867771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:35.946750 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bdb75666-1413-4a4f-b62c-ed3981de380a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.043105 Oct 05 02:44:35.947851 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1867/3762] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:44:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:44:35.987498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-abd2c084-9e7f-489b-8d08-4d17b951f637 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:35.988402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-abd2c084-9e7f-489b-8d08-4d17b951f637 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:36.007795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abd2c084-9e7f-489b-8d08-4d17b951f637 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:36.008308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abd2c084-9e7f-489b-8d08-4d17b951f637 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:36.009348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abd2c084-9e7f-489b-8d08-4d17b951f637 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:36.010080 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abd2c084-9e7f-489b-8d08-4d17b951f637 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:36.010595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abd2c084-9e7f-489b-8d08-4d17b951f637 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:36.011201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abd2c084-9e7f-489b-8d08-4d17b951f637 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:36.197110 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-abd2c084-9e7f-489b-8d08-4d17b951f637 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:36.216965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-abd2c084-9e7f-489b-8d08-4d17b951f637 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:36.222546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-abd2c084-9e7f-489b-8d08-4d17b951f637 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:36.248040 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-abd2c084-9e7f-489b-8d08-4d17b951f637 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1555 microversion: 2.91 time: 0.293721 Oct 05 02:44:36.250465 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1868/3763] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:35 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1555 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:44:36.295484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-915c8a99-3f5a-4849-90b9-ee2fc2ee2d33 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:36.299104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-915c8a99-3f5a-4849-90b9-ee2fc2ee2d33 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7517582f-12a1-4f22-bfb9-0690938cafd0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:36.464708 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-915c8a99-3f5a-4849-90b9-ee2fc2ee2d33 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:36.483832 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-915c8a99-3f5a-4849-90b9-ee2fc2ee2d33 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0" status: 200 len: 1215 microversion: 2.1 time: 0.209356 Oct 05 02:44:36.502982 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1869/3764] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:36 2022] GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0 => generated 1215 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:36.541460 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-44f3931e-119d-4a32-991e-14ac6239adef tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:36.557602 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-44f3931e-119d-4a32-991e-14ac6239adef tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1687 microversion: 2.1 time: 0.754669 Oct 05 02:44:36.562950 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1896/3765] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:35 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1687 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:36.821366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-605958ff-bd3a-41af-b719-022f60adac02 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:36.822118 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-605958ff-bd3a-41af-b719-022f60adac02 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] [instance: 7025724f-62fd-40b5-b6c2-d696e2298236] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:36.835740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-605958ff-bd3a-41af-b719-022f60adac02 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:36.836191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-605958ff-bd3a-41af-b719-022f60adac02 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:36.842752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-605958ff-bd3a-41af-b719-022f60adac02 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:36.847490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-605958ff-bd3a-41af-b719-022f60adac02 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:36.851253 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-605958ff-bd3a-41af-b719-022f60adac02 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:36.853876 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-605958ff-bd3a-41af-b719-022f60adac02 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:36.862006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c50a8383-a6e7-4f4e-a265-24de0b7026ad tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Action: 'update', calling method: .version_select at 0x7fccdf13f820>, body: {"quota_set": {"ram": "5120"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:44:37.035754 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c50a8383-a6e7-4f4e-a265-24de0b7026ad tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:37.038513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c50a8383-a6e7-4f4e-a265-24de0b7026ad tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:37.038991 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c50a8383-a6e7-4f4e-a265-24de0b7026ad tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:37.039841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c50a8383-a6e7-4f4e-a265-24de0b7026ad tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:37.040317 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c50a8383-a6e7-4f4e-a265-24de0b7026ad tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:37.042218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c50a8383-a6e7-4f4e-a265-24de0b7026ad tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:37.155379 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c50a8383-a6e7-4f4e-a265-24de0b7026ad tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/9e304a79cc6e41aaa255690c1a4cd667" status: 200 len: 148 microversion: 2.57 time: 0.651027 Oct 05 02:44:37.156377 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1870/3766] 10.222.0.16 () {62 vars in 1303 bytes} [Wed Oct 5 02:44:36 2022] PUT /compute/v2.1/os-quota-sets/9e304a79cc6e41aaa255690c1a4cd667 => generated 148 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:44:37.163448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-a08a5758-86bc-4e27-ae04-ef470a95bdbf req-815c88fd-c853-4025-bedd-b6d448985af8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7025724f-62fd-40b5-b6c2-d696e2298236", "tag": "f0d80d97-8b9a-40fd-a863-46fb655b1f8f"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:44:37.176403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a08a5758-86bc-4e27-ae04-ef470a95bdbf req-815c88fd-c853-4025-bedd-b6d448985af8 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:37.177189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a08a5758-86bc-4e27-ae04-ef470a95bdbf req-815c88fd-c853-4025-bedd-b6d448985af8 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:37.177832 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a08a5758-86bc-4e27-ae04-ef470a95bdbf req-815c88fd-c853-4025-bedd-b6d448985af8 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:37.199083 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-a08a5758-86bc-4e27-ae04-ef470a95bdbf req-815c88fd-c853-4025-bedd-b6d448985af8 service nova] Creating event network-changed:f0d80d97-8b9a-40fd-a863-46fb655b1f8f for instance 7025724f-62fd-40b5-b6c2-d696e2298236 on n-h2-858272-3 Oct 05 02:44:37.206055 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-a08a5758-86bc-4e27-ae04-ef470a95bdbf req-815c88fd-c853-4025-bedd-b6d448985af8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047537 Oct 05 02:44:37.207639 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1871/3767] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:44:37.213025 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3181b428-d7ab-4218-b3c3-ccaedcb7fe31 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Calling method '.version_select at 0x7fccdf6f2160>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:37.433358 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3181b428-d7ab-4218-b3c3-ccaedcb7fe31 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:37.435673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3181b428-d7ab-4218-b3c3-ccaedcb7fe31 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:37.436410 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3181b428-d7ab-4218-b3c3-ccaedcb7fe31 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:37.442118 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3181b428-d7ab-4218-b3c3-ccaedcb7fe31 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:37.442611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3181b428-d7ab-4218-b3c3-ccaedcb7fe31 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:37.443058 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3181b428-d7ab-4218-b3c3-ccaedcb7fe31 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:37.557806 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3181b428-d7ab-4218-b3c3-ccaedcb7fe31 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/9e304a79cc6e41aaa255690c1a4cd667/detail" status: 200 len: 463 microversion: 2.57 time: 0.348655 Oct 05 02:44:37.560232 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1872/3768] 10.222.0.16 () {60 vars in 1304 bytes} [Wed Oct 5 02:44:37 2022] GET /compute/v2.1/os-quota-sets/9e304a79cc6e41aaa255690c1a4cd667/detail => generated 463 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:44:37.580744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-aa139d1d-5c29-47fc-ab4a-53aa39e4174b req-88fdb109-410f-4bc3-ad22-ce679aba017b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4388e9ec-13a9-4d5b-9310-7a10953c57d0", "name": "network-vif-plugged", "status": "completed", "tag": "17b098e0-7358-489c-bec3-6b98c1db0796"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:44:37.606336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-aa139d1d-5c29-47fc-ab4a-53aa39e4174b req-88fdb109-410f-4bc3-ad22-ce679aba017b service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:37.612609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-aa139d1d-5c29-47fc-ab4a-53aa39e4174b req-88fdb109-410f-4bc3-ad22-ce679aba017b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:37.614732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-aa139d1d-5c29-47fc-ab4a-53aa39e4174b req-88fdb109-410f-4bc3-ad22-ce679aba017b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:37.698698 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-aa139d1d-5c29-47fc-ab4a-53aa39e4174b req-88fdb109-410f-4bc3-ad22-ce679aba017b service nova] Creating event network-vif-plugged:17b098e0-7358-489c-bec3-6b98c1db0796 for instance 4388e9ec-13a9-4d5b-9310-7a10953c57d0 on n-h1-858272-3 Oct 05 02:44:37.720351 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-aa139d1d-5c29-47fc-ab4a-53aa39e4174b req-88fdb109-410f-4bc3-ad22-ce679aba017b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156339 Oct 05 02:44:37.725939 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1873/3769] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:44:37.750380 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f66132f5-0b6c-479b-b6c6-c2d433025a60 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:37.752387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f66132f5-0b6c-479b-b6c6-c2d433025a60 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:37.782765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f66132f5-0b6c-479b-b6c6-c2d433025a60 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:37.783300 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f66132f5-0b6c-479b-b6c6-c2d433025a60 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:37.788506 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f66132f5-0b6c-479b-b6c6-c2d433025a60 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:37.789802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f66132f5-0b6c-479b-b6c6-c2d433025a60 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:37.794624 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f66132f5-0b6c-479b-b6c6-c2d433025a60 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:37.796392 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f66132f5-0b6c-479b-b6c6-c2d433025a60 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:38.097962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f66132f5-0b6c-479b-b6c6-c2d433025a60 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:38.116534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f66132f5-0b6c-479b-b6c6-c2d433025a60 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:38.120346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f66132f5-0b6c-479b-b6c6-c2d433025a60 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:38.139043 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f66132f5-0b6c-479b-b6c6-c2d433025a60 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1555 microversion: 2.91 time: 0.408306 Oct 05 02:44:38.140649 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1874/3770] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:37 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1555 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:44:38.154592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a131668a-75c6-48f2-a800-099e6dd4da8f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:38.155566 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a131668a-75c6-48f2-a800-099e6dd4da8f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7517582f-12a1-4f22-bfb9-0690938cafd0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:38.168424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-605958ff-bd3a-41af-b719-022f60adac02 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6bf791f0d34cbe822b35402973cc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8325066949145cf92e3ec5dd67f44a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:38.174159 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a131668a-75c6-48f2-a800-099e6dd4da8f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:38.174977 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a131668a-75c6-48f2-a800-099e6dd4da8f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:38.175703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a131668a-75c6-48f2-a800-099e6dd4da8f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:38.177218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a131668a-75c6-48f2-a800-099e6dd4da8f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:38.179821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a131668a-75c6-48f2-a800-099e6dd4da8f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:38.181577 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a131668a-75c6-48f2-a800-099e6dd4da8f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:38.185869 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-605958ff-bd3a-41af-b719-022f60adac02 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] 10.222.0.16 "GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236" status: 200 len: 1317 microversion: 2.1 time: 1.367928 Oct 05 02:44:38.192363 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1897/3771] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:36 2022] GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236 => generated 1317 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:44:38.208506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-395548eb-085c-4566-91f4-194c552d0baf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:38.215251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-395548eb-085c-4566-91f4-194c552d0baf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:38.243118 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-395548eb-085c-4566-91f4-194c552d0baf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:38.243627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-395548eb-085c-4566-91f4-194c552d0baf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:38.244265 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-395548eb-085c-4566-91f4-194c552d0baf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:38.245156 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-395548eb-085c-4566-91f4-194c552d0baf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:38.245759 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-395548eb-085c-4566-91f4-194c552d0baf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:38.246329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-395548eb-085c-4566-91f4-194c552d0baf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:38.499855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a131668a-75c6-48f2-a800-099e6dd4da8f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:38.517740 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a131668a-75c6-48f2-a800-099e6dd4da8f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0" status: 200 len: 1267 microversion: 2.1 time: 0.373111 Oct 05 02:44:38.518903 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1875/3772] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:38 2022] GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0 => generated 1267 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:38.528786 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-13dc0ed9-a1c0-4f67-bf6c-8566137f5451 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Action: 'update', calling method: .version_select at 0x7fccdf66e1f0>, body: {"quota_set": {"ram": "2048"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:44:38.880099 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:38.972577 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-395548eb-085c-4566-91f4-194c552d0baf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:39.063582 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-395548eb-085c-4566-91f4-194c552d0baf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1687 microversion: 2.1 time: 0.863887 Oct 05 02:44:39.082810 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1898/3773] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:38 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1687 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:39.188749 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5a15bf26-7699-4800-980e-41c06bb0e3c6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:39.193770 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5a15bf26-7699-4800-980e-41c06bb0e3c6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:39.216186 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5a15bf26-7699-4800-980e-41c06bb0e3c6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:39.217635 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5a15bf26-7699-4800-980e-41c06bb0e3c6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:39.220479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5a15bf26-7699-4800-980e-41c06bb0e3c6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:39.222846 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5a15bf26-7699-4800-980e-41c06bb0e3c6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:39.229470 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5a15bf26-7699-4800-980e-41c06bb0e3c6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:39.233625 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5a15bf26-7699-4800-980e-41c06bb0e3c6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:39.246773 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13dc0ed9-a1c0-4f67-bf6c-8566137f5451 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:39.247256 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13dc0ed9-a1c0-4f67-bf6c-8566137f5451 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:39.247695 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13dc0ed9-a1c0-4f67-bf6c-8566137f5451 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:39.266239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13dc0ed9-a1c0-4f67-bf6c-8566137f5451 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:39.266559 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13dc0ed9-a1c0-4f67-bf6c-8566137f5451 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:39.267016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13dc0ed9-a1c0-4f67-bf6c-8566137f5451 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:39.386978 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13dc0ed9-a1c0-4f67-bf6c-8566137f5451 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:39.388977 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13dc0ed9-a1c0-4f67-bf6c-8566137f5451 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:39.391927 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5a15bf26-7699-4800-980e-41c06bb0e3c6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:39.411814 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13dc0ed9-a1c0-4f67-bf6c-8566137f5451 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:39.412657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13dc0ed9-a1c0-4f67-bf6c-8566137f5451 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:39.419187 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13dc0ed9-a1c0-4f67-bf6c-8566137f5451 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:39.419921 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5a15bf26-7699-4800-980e-41c06bb0e3c6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:39.420834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13dc0ed9-a1c0-4f67-bf6c-8566137f5451 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:39.421395 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5a15bf26-7699-4800-980e-41c06bb0e3c6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:39.445640 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5a15bf26-7699-4800-980e-41c06bb0e3c6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1555 microversion: 2.91 time: 0.277244 Oct 05 02:44:39.446958 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1899/3774] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:39 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1555 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:44:39.467822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a7939a01-1368-4185-b2d2-6763e85cd822 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:39.470281 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a7939a01-1368-4185-b2d2-6763e85cd822 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] [instance: 7025724f-62fd-40b5-b6c2-d696e2298236] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:39.488195 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7939a01-1368-4185-b2d2-6763e85cd822 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:39.489459 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7939a01-1368-4185-b2d2-6763e85cd822 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:39.491454 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7939a01-1368-4185-b2d2-6763e85cd822 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:39.492649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7939a01-1368-4185-b2d2-6763e85cd822 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:39.494374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7939a01-1368-4185-b2d2-6763e85cd822 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:39.495912 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7939a01-1368-4185-b2d2-6763e85cd822 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:39.623395 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-13dc0ed9-a1c0-4f67-bf6c-8566137f5451 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/9e304a79cc6e41aaa255690c1a4cd667?user_id=3fc907b3ac954ae58f60d54de765a4c9" status: 200 len: 148 microversion: 2.57 time: 1.103116 Oct 05 02:44:39.643171 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1876/3775] 10.222.0.16 () {62 vars in 1384 bytes} [Wed Oct 5 02:44:38 2022] PUT /compute/v2.1/os-quota-sets/9e304a79cc6e41aaa255690c1a4cd667?user_id=3fc907b3ac954ae58f60d54de765a4c9 => generated 148 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:44:39.649187 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-118d12e7-de5b-4f3d-b468-cf5e81c40a36 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:39.649799 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-118d12e7-de5b-4f3d-b468-cf5e81c40a36 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7517582f-12a1-4f22-bfb9-0690938cafd0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:39.692390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-118d12e7-de5b-4f3d-b468-cf5e81c40a36 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:39.695871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-118d12e7-de5b-4f3d-b468-cf5e81c40a36 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:39.698324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-118d12e7-de5b-4f3d-b468-cf5e81c40a36 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:39.699442 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-118d12e7-de5b-4f3d-b468-cf5e81c40a36 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:39.701223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-118d12e7-de5b-4f3d-b468-cf5e81c40a36 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:39.709154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-118d12e7-de5b-4f3d-b468-cf5e81c40a36 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:40.184721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-118d12e7-de5b-4f3d-b468-cf5e81c40a36 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:40.204862 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-118d12e7-de5b-4f3d-b468-cf5e81c40a36 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0" status: 200 len: 1273 microversion: 2.1 time: 0.560467 Oct 05 02:44:40.206038 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1877/3776] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:39 2022] GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0 => generated 1273 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:40.211391 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6114ad89-bb9c-447b-86bd-90a4c5162423 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Calling method '.version_select at 0x7fccdf1b40d0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:40.299027 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a7939a01-1368-4185-b2d2-6763e85cd822 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6bf791f0d34cbe822b35402973cc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8325066949145cf92e3ec5dd67f44a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:40.312054 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a7939a01-1368-4185-b2d2-6763e85cd822 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] 10.222.0.16 "GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236" status: 200 len: 1317 microversion: 2.1 time: 0.862493 Oct 05 02:44:40.317477 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1900/3777] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:39 2022] GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236 => generated 1317 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:40.337018 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0eb2aa64-0cec-4812-8adc-bbfb50d0e5b3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:40.337919 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0eb2aa64-0cec-4812-8adc-bbfb50d0e5b3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:40.357507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0eb2aa64-0cec-4812-8adc-bbfb50d0e5b3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:40.361849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0eb2aa64-0cec-4812-8adc-bbfb50d0e5b3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:40.362795 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0eb2aa64-0cec-4812-8adc-bbfb50d0e5b3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:40.364407 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0eb2aa64-0cec-4812-8adc-bbfb50d0e5b3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:40.367667 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0eb2aa64-0cec-4812-8adc-bbfb50d0e5b3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:40.368929 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0eb2aa64-0cec-4812-8adc-bbfb50d0e5b3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:40.727431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0eb2aa64-0cec-4812-8adc-bbfb50d0e5b3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:40.735914 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0eb2aa64-0cec-4812-8adc-bbfb50d0e5b3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1682 microversion: 2.1 time: 0.415851 Oct 05 02:44:40.742149 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1901/3778] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:40 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1682 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:40.755239 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a45cbd5e-72c2-4cd6-8ada-8a5f51af924d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:40.756866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a45cbd5e-72c2-4cd6-8ada-8a5f51af924d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:40.767285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a45cbd5e-72c2-4cd6-8ada-8a5f51af924d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:40.768127 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a45cbd5e-72c2-4cd6-8ada-8a5f51af924d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:40.768788 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a45cbd5e-72c2-4cd6-8ada-8a5f51af924d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:40.769780 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a45cbd5e-72c2-4cd6-8ada-8a5f51af924d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:40.770427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a45cbd5e-72c2-4cd6-8ada-8a5f51af924d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:40.771036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a45cbd5e-72c2-4cd6-8ada-8a5f51af924d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:40.948644 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a45cbd5e-72c2-4cd6-8ada-8a5f51af924d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:40.959902 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a45cbd5e-72c2-4cd6-8ada-8a5f51af924d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:40.965482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a45cbd5e-72c2-4cd6-8ada-8a5f51af924d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:40.978268 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a45cbd5e-72c2-4cd6-8ada-8a5f51af924d tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1555 microversion: 2.91 time: 0.233397 Oct 05 02:44:40.979505 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1902/3779] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:40 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1555 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:44:41.101522 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6114ad89-bb9c-447b-86bd-90a4c5162423 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/9e304a79cc6e41aaa255690c1a4cd667?user_id=3fc907b3ac954ae58f60d54de765a4c9" status: 200 len: 190 microversion: 2.57 time: 0.894098 Oct 05 02:44:41.107988 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1878/3780] 10.222.0.16 () {60 vars in 1364 bytes} [Wed Oct 5 02:44:40 2022] GET /compute/v2.1/os-quota-sets/9e304a79cc6e41aaa255690c1a4cd667?user_id=3fc907b3ac954ae58f60d54de765a4c9 => generated 190 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:44:41.231844 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dd69db11-21cd-4377-b4ca-77095436f96d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:41.232484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dd69db11-21cd-4377-b4ca-77095436f96d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7517582f-12a1-4f22-bfb9-0690938cafd0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:41.246617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd69db11-21cd-4377-b4ca-77095436f96d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:41.247129 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd69db11-21cd-4377-b4ca-77095436f96d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:41.247572 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd69db11-21cd-4377-b4ca-77095436f96d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:41.248289 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd69db11-21cd-4377-b4ca-77095436f96d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:41.248755 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd69db11-21cd-4377-b4ca-77095436f96d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:41.254777 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd69db11-21cd-4377-b4ca-77095436f96d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:41.342217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-886ab286-90b5-4760-af3d-3dd8b7868680 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:41.342846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-886ab286-90b5-4760-af3d-3dd8b7868680 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] [instance: 7025724f-62fd-40b5-b6c2-d696e2298236] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:41.370771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-886ab286-90b5-4760-af3d-3dd8b7868680 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:41.371275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-886ab286-90b5-4760-af3d-3dd8b7868680 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:41.382137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-886ab286-90b5-4760-af3d-3dd8b7868680 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:41.383000 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-886ab286-90b5-4760-af3d-3dd8b7868680 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:41.383591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-886ab286-90b5-4760-af3d-3dd8b7868680 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:41.383988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-886ab286-90b5-4760-af3d-3dd8b7868680 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:42.635641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dd69db11-21cd-4377-b4ca-77095436f96d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:42.666266 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dd69db11-21cd-4377-b4ca-77095436f96d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0" status: 200 len: 1315 microversion: 2.1 time: 1.438344 Oct 05 02:44:42.670056 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1903/3781] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:41 2022] GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0 => generated 1315 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:42.680047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d093877f-622a-46a0-af8f-3ec07eba51f3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:42.683700 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d093877f-622a-46a0-af8f-3ec07eba51f3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:42.709165 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d093877f-622a-46a0-af8f-3ec07eba51f3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:42.710158 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d093877f-622a-46a0-af8f-3ec07eba51f3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:42.710813 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d093877f-622a-46a0-af8f-3ec07eba51f3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:42.711777 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d093877f-622a-46a0-af8f-3ec07eba51f3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:42.712450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d093877f-622a-46a0-af8f-3ec07eba51f3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:42.713199 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d093877f-622a-46a0-af8f-3ec07eba51f3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:44.121666 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-886ab286-90b5-4760-af3d-3dd8b7868680 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6bf791f0d34cbe822b35402973cc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8325066949145cf92e3ec5dd67f44a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:44.146105 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-886ab286-90b5-4760-af3d-3dd8b7868680 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] 10.222.0.16 "GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236" status: 200 len: 1317 microversion: 2.1 time: 2.807991 Oct 05 02:44:44.149196 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1879/3782] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:41 2022] GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236 => generated 1317 bytes in 2812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:44.165490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dfa991a6-ad09-4dff-866e-142f3637bc79 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:44.166102 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-dfa991a6-ad09-4dff-866e-142f3637bc79 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:44.180010 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dfa991a6-ad09-4dff-866e-142f3637bc79 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:44.180514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dfa991a6-ad09-4dff-866e-142f3637bc79 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:44.199299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dfa991a6-ad09-4dff-866e-142f3637bc79 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:44.200274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dfa991a6-ad09-4dff-866e-142f3637bc79 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:44.213712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dfa991a6-ad09-4dff-866e-142f3637bc79 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:44.214470 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dfa991a6-ad09-4dff-866e-142f3637bc79 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:44.289138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:44.420940 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-dfa991a6-ad09-4dff-866e-142f3637bc79 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:44.434048 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-dfa991a6-ad09-4dff-866e-142f3637bc79 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:44.438553 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-dfa991a6-ad09-4dff-866e-142f3637bc79 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:44.456519 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-dfa991a6-ad09-4dff-866e-142f3637bc79 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1555 microversion: 2.91 time: 0.304940 Oct 05 02:44:44.469215 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1880/3783] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:44 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1555 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:44:44.475735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-baa20243-c458-4a9d-92c5-0f1b3eca0fbd tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:44.476695 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-baa20243-c458-4a9d-92c5-0f1b3eca0fbd tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7517582f-12a1-4f22-bfb9-0690938cafd0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:44.493888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-baa20243-c458-4a9d-92c5-0f1b3eca0fbd tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:44.494790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-baa20243-c458-4a9d-92c5-0f1b3eca0fbd tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:44.495542 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-baa20243-c458-4a9d-92c5-0f1b3eca0fbd tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:44.496477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-baa20243-c458-4a9d-92c5-0f1b3eca0fbd tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:44.497167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-baa20243-c458-4a9d-92c5-0f1b3eca0fbd tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:44.497817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-baa20243-c458-4a9d-92c5-0f1b3eca0fbd tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:44.501823 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d093877f-622a-46a0-af8f-3ec07eba51f3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:44.520559 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d093877f-622a-46a0-af8f-3ec07eba51f3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1682 microversion: 2.1 time: 1.849084 Oct 05 02:44:44.530495 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1904/3784] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:42 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1682 bytes in 1859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:44.535654 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-de58748c-99a9-4d64-981e-193f1acbb963 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:44:44.580122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-de58748c-99a9-4d64-981e-193f1acbb963 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:44.580645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-de58748c-99a9-4d64-981e-193f1acbb963 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:44.581125 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-de58748c-99a9-4d64-981e-193f1acbb963 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:44.635651 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-de58748c-99a9-4d64-981e-193f1acbb963 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Going to try to stop instance {{(pid=122320) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 05 02:44:44.725739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:44.756962 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-de58748c-99a9-4d64-981e-193f1acbb963 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "POST /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397/action" status: 202 len: 0 microversion: 2.1 time: 0.224973 Oct 05 02:44:44.757594 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1905/3785] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:44:44 2022] POST /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:44:44.769408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fd0c6158-8357-41fe-8497-5daffcafa688 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:44.770124 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fd0c6158-8357-41fe-8497-5daffcafa688 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:44.807556 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fd0c6158-8357-41fe-8497-5daffcafa688 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:44.810477 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fd0c6158-8357-41fe-8497-5daffcafa688 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:44.814010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fd0c6158-8357-41fe-8497-5daffcafa688 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:44.817306 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fd0c6158-8357-41fe-8497-5daffcafa688 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:44.819000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fd0c6158-8357-41fe-8497-5daffcafa688 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:44.820090 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fd0c6158-8357-41fe-8497-5daffcafa688 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:45.029733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-baa20243-c458-4a9d-92c5-0f1b3eca0fbd tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:45.038715 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-baa20243-c458-4a9d-92c5-0f1b3eca0fbd tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0" status: 200 len: 1315 microversion: 2.1 time: 0.567948 Oct 05 02:44:45.049970 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1881/3786] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:44 2022] GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0 => generated 1315 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:45.177940 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-41f20125-12e4-437d-9184-8c6db0fe00aa tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:45.178570 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-41f20125-12e4-437d-9184-8c6db0fe00aa tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] [instance: 7025724f-62fd-40b5-b6c2-d696e2298236] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:45.201233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41f20125-12e4-437d-9184-8c6db0fe00aa tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:45.202520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41f20125-12e4-437d-9184-8c6db0fe00aa tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:45.205293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41f20125-12e4-437d-9184-8c6db0fe00aa tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:45.207611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41f20125-12e4-437d-9184-8c6db0fe00aa tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:45.209874 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41f20125-12e4-437d-9184-8c6db0fe00aa tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:45.210849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41f20125-12e4-437d-9184-8c6db0fe00aa tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:45.511585 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fd0c6158-8357-41fe-8497-5daffcafa688 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:45.525565 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fd0c6158-8357-41fe-8497-5daffcafa688 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1677 microversion: 2.1 time: 0.762554 Oct 05 02:44:45.530044 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1906/3787] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:44 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1677 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:45.565618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-e51bc6f3-6d63-4b78-a894-d8d90f420013 req-466f859c-2ca8-4963-ac7d-1a97c9349ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7025724f-62fd-40b5-b6c2-d696e2298236", "name": "network-vif-plugged", "status": "completed", "tag": "f0d80d97-8b9a-40fd-a863-46fb655b1f8f"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:44:45.617016 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e51bc6f3-6d63-4b78-a894-d8d90f420013 req-466f859c-2ca8-4963-ac7d-1a97c9349ade service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:45.619044 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e51bc6f3-6d63-4b78-a894-d8d90f420013 req-466f859c-2ca8-4963-ac7d-1a97c9349ade service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:45.622075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e51bc6f3-6d63-4b78-a894-d8d90f420013 req-466f859c-2ca8-4963-ac7d-1a97c9349ade service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:45.693765 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-e51bc6f3-6d63-4b78-a894-d8d90f420013 req-466f859c-2ca8-4963-ac7d-1a97c9349ade service nova] Creating event network-vif-plugged:f0d80d97-8b9a-40fd-a863-46fb655b1f8f for instance 7025724f-62fd-40b5-b6c2-d696e2298236 on n-h2-858272-3 Oct 05 02:44:45.700698 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-e51bc6f3-6d63-4b78-a894-d8d90f420013 req-466f859c-2ca8-4963-ac7d-1a97c9349ade service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169169 Oct 05 02:44:45.703611 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1907/3788] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:44:45.712630 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e6fad1ba-1a1d-4716-b37e-398d65fe2f65 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:45.713631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e6fad1ba-1a1d-4716-b37e-398d65fe2f65 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:45.723596 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e6fad1ba-1a1d-4716-b37e-398d65fe2f65 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:45.724430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e6fad1ba-1a1d-4716-b37e-398d65fe2f65 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:45.725119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e6fad1ba-1a1d-4716-b37e-398d65fe2f65 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:45.726047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e6fad1ba-1a1d-4716-b37e-398d65fe2f65 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:45.726922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e6fad1ba-1a1d-4716-b37e-398d65fe2f65 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:45.727584 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e6fad1ba-1a1d-4716-b37e-398d65fe2f65 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:46.253176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e6fad1ba-1a1d-4716-b37e-398d65fe2f65 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:46.276492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e6fad1ba-1a1d-4716-b37e-398d65fe2f65 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:46.278215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e6fad1ba-1a1d-4716-b37e-398d65fe2f65 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:46.285780 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e6fad1ba-1a1d-4716-b37e-398d65fe2f65 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1555 microversion: 2.91 time: 0.580436 Oct 05 02:44:46.286980 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1908/3789] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:45 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1555 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:44:46.292561 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e5f1e903-3303-4076-b74f-69c659ee1903 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:46.293456 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e5f1e903-3303-4076-b74f-69c659ee1903 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:46.301799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5f1e903-3303-4076-b74f-69c659ee1903 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:46.302605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5f1e903-3303-4076-b74f-69c659ee1903 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:46.303187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5f1e903-3303-4076-b74f-69c659ee1903 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:46.304109 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5f1e903-3303-4076-b74f-69c659ee1903 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:46.304707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5f1e903-3303-4076-b74f-69c659ee1903 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:46.305309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5f1e903-3303-4076-b74f-69c659ee1903 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:46.808817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-41f20125-12e4-437d-9184-8c6db0fe00aa tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6bf791f0d34cbe822b35402973cc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8325066949145cf92e3ec5dd67f44a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:46.827542 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-41f20125-12e4-437d-9184-8c6db0fe00aa tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] 10.222.0.16 "GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236" status: 200 len: 1317 microversion: 2.1 time: 1.654727 Oct 05 02:44:46.830322 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1882/3790] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:45 2022] GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236 => generated 1317 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:46.841378 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6c2c0353-d3fa-4f13-ba3a-80f3db090384 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:46.851989 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6c2c0353-d3fa-4f13-ba3a-80f3db090384 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7517582f-12a1-4f22-bfb9-0690938cafd0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:46.872221 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c2c0353-d3fa-4f13-ba3a-80f3db090384 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:46.879099 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c2c0353-d3fa-4f13-ba3a-80f3db090384 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:46.885140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c2c0353-d3fa-4f13-ba3a-80f3db090384 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:46.886112 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c2c0353-d3fa-4f13-ba3a-80f3db090384 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:46.889644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c2c0353-d3fa-4f13-ba3a-80f3db090384 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:46.890352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c2c0353-d3fa-4f13-ba3a-80f3db090384 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:47.069852 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e5f1e903-3303-4076-b74f-69c659ee1903 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:47.080845 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e5f1e903-3303-4076-b74f-69c659ee1903 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1682 microversion: 2.1 time: 0.792590 Oct 05 02:44:47.093088 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1909/3791] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:46 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1682 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:47.109659 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1109bf14-6ccd-44f5-ac9f-cbd3c77740a0 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:47.113798 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1109bf14-6ccd-44f5-ac9f-cbd3c77740a0 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:47.136135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1109bf14-6ccd-44f5-ac9f-cbd3c77740a0 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:47.136960 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1109bf14-6ccd-44f5-ac9f-cbd3c77740a0 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:47.137580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1109bf14-6ccd-44f5-ac9f-cbd3c77740a0 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:47.138479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1109bf14-6ccd-44f5-ac9f-cbd3c77740a0 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:47.139150 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1109bf14-6ccd-44f5-ac9f-cbd3c77740a0 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:47.139762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1109bf14-6ccd-44f5-ac9f-cbd3c77740a0 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:48.169313 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6c2c0353-d3fa-4f13-ba3a-80f3db090384 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:48.184337 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6c2c0353-d3fa-4f13-ba3a-80f3db090384 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0" status: 200 len: 1315 microversion: 2.1 time: 1.348946 Oct 05 02:44:48.191758 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1883/3792] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:46 2022] GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0 => generated 1315 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:48.207683 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-75599453-0149-44ba-96fd-82a4cdcf99e5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:48.214118 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-75599453-0149-44ba-96fd-82a4cdcf99e5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:48.235800 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75599453-0149-44ba-96fd-82a4cdcf99e5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:48.236308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75599453-0149-44ba-96fd-82a4cdcf99e5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:48.237313 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75599453-0149-44ba-96fd-82a4cdcf99e5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:48.238263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75599453-0149-44ba-96fd-82a4cdcf99e5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:48.240453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75599453-0149-44ba-96fd-82a4cdcf99e5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:48.241427 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75599453-0149-44ba-96fd-82a4cdcf99e5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:48.355403 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1109bf14-6ccd-44f5-ac9f-cbd3c77740a0 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:48.368722 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1109bf14-6ccd-44f5-ac9f-cbd3c77740a0 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1677 microversion: 2.1 time: 1.273613 Oct 05 02:44:48.370126 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1910/3793] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:47 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1677 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:48.375967 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-4fca82ee-1f50-457d-ac53-1415d18ffb2d req-92a85a57-9f90-4a1a-9b68-2b0c920516ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7517582f-12a1-4f22-bfb9-0690938cafd0", "tag": "8a9340ae-7d83-456a-83fd-039db65d4ab2"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:44:48.405251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4fca82ee-1f50-457d-ac53-1415d18ffb2d req-92a85a57-9f90-4a1a-9b68-2b0c920516ba service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:48.406115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4fca82ee-1f50-457d-ac53-1415d18ffb2d req-92a85a57-9f90-4a1a-9b68-2b0c920516ba service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:48.408597 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4fca82ee-1f50-457d-ac53-1415d18ffb2d req-92a85a57-9f90-4a1a-9b68-2b0c920516ba service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:48.440481 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-75599453-0149-44ba-96fd-82a4cdcf99e5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:48.445781 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-4fca82ee-1f50-457d-ac53-1415d18ffb2d req-92a85a57-9f90-4a1a-9b68-2b0c920516ba service nova] Creating event network-changed:8a9340ae-7d83-456a-83fd-039db65d4ab2 for instance 7517582f-12a1-4f22-bfb9-0690938cafd0 on n-h1-858272-3 Oct 05 02:44:48.454933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-75599453-0149-44ba-96fd-82a4cdcf99e5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:48.456390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-75599453-0149-44ba-96fd-82a4cdcf99e5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:48.461031 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-4fca82ee-1f50-457d-ac53-1415d18ffb2d req-92a85a57-9f90-4a1a-9b68-2b0c920516ba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087752 Oct 05 02:44:48.464442 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1911/3794] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:44:48.473600 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-69400e5e-5317-404b-8967-397d4c97439c tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:48.475016 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-75599453-0149-44ba-96fd-82a4cdcf99e5 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1555 microversion: 2.91 time: 0.280227 Oct 05 02:44:48.479297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-69400e5e-5317-404b-8967-397d4c97439c tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] [instance: 7025724f-62fd-40b5-b6c2-d696e2298236] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:48.482417 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1884/3795] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:48 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1555 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:44:48.496352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1f5be83f-3cc1-4147-abb6-28fd65f55fdf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:48.497211 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1f5be83f-3cc1-4147-abb6-28fd65f55fdf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:48.513757 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f5be83f-3cc1-4147-abb6-28fd65f55fdf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:48.519053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f5be83f-3cc1-4147-abb6-28fd65f55fdf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:48.519934 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f5be83f-3cc1-4147-abb6-28fd65f55fdf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:48.520869 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f5be83f-3cc1-4147-abb6-28fd65f55fdf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:48.532825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f5be83f-3cc1-4147-abb6-28fd65f55fdf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:48.535821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f5be83f-3cc1-4147-abb6-28fd65f55fdf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:48.540136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69400e5e-5317-404b-8967-397d4c97439c tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:48.540792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69400e5e-5317-404b-8967-397d4c97439c tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:48.541622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69400e5e-5317-404b-8967-397d4c97439c tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:48.544837 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69400e5e-5317-404b-8967-397d4c97439c tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:48.547792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69400e5e-5317-404b-8967-397d4c97439c tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:48.548530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69400e5e-5317-404b-8967-397d4c97439c tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:49.050682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-69400e5e-5317-404b-8967-397d4c97439c tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6bf791f0d34cbe822b35402973cc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8325066949145cf92e3ec5dd67f44a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:49.063393 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-69400e5e-5317-404b-8967-397d4c97439c tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] 10.222.0.16 "GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236" status: 200 len: 1506 microversion: 2.1 time: 0.597071 Oct 05 02:44:49.069369 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1912/3796] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:48 2022] GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236 => generated 1506 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:49.097878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-decc75dd-a4a9-43ba-83a8-d7261e3da483 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:49.098843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-decc75dd-a4a9-43ba-83a8-d7261e3da483 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] [instance: 7025724f-62fd-40b5-b6c2-d696e2298236] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:49.112064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-decc75dd-a4a9-43ba-83a8-d7261e3da483 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:49.118304 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-decc75dd-a4a9-43ba-83a8-d7261e3da483 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:49.133678 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-decc75dd-a4a9-43ba-83a8-d7261e3da483 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:49.134843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-decc75dd-a4a9-43ba-83a8-d7261e3da483 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:49.135548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-decc75dd-a4a9-43ba-83a8-d7261e3da483 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:49.136205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-decc75dd-a4a9-43ba-83a8-d7261e3da483 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:49.209858 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-decc75dd-a4a9-43ba-83a8-d7261e3da483 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] 10.222.0.16 "GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236/ips" status: 200 len: 109 microversion: 2.1 time: 0.117001 Oct 05 02:44:49.213736 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1913/3797] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 02:44:49 2022] GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236/ips => generated 109 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:44:49.221151 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fcb30543-ec04-4490-9a30-7e0f1bc29f4e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:49.236530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fcb30543-ec04-4490-9a30-7e0f1bc29f4e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7517582f-12a1-4f22-bfb9-0690938cafd0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:49.263920 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fcb30543-ec04-4490-9a30-7e0f1bc29f4e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:49.264803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fcb30543-ec04-4490-9a30-7e0f1bc29f4e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:49.265651 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fcb30543-ec04-4490-9a30-7e0f1bc29f4e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:49.266713 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fcb30543-ec04-4490-9a30-7e0f1bc29f4e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:49.267449 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fcb30543-ec04-4490-9a30-7e0f1bc29f4e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:49.268108 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fcb30543-ec04-4490-9a30-7e0f1bc29f4e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:49.367036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1f5be83f-3cc1-4147-abb6-28fd65f55fdf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:49.379698 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1f5be83f-3cc1-4147-abb6-28fd65f55fdf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1682 microversion: 2.1 time: 0.893526 Oct 05 02:44:49.383283 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1885/3798] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:48 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1682 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:49.402219 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1a1cfc97-4994-4708-85bf-779d59172dfe tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:49.403616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1a1cfc97-4994-4708-85bf-779d59172dfe tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] [instance: 7025724f-62fd-40b5-b6c2-d696e2298236] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:49.420135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a1cfc97-4994-4708-85bf-779d59172dfe tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:49.420637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a1cfc97-4994-4708-85bf-779d59172dfe tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:49.433316 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a1cfc97-4994-4708-85bf-779d59172dfe tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:49.434434 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a1cfc97-4994-4708-85bf-779d59172dfe tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:49.437781 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a1cfc97-4994-4708-85bf-779d59172dfe tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:49.438261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a1cfc97-4994-4708-85bf-779d59172dfe tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:49.503908 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=13 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:49.512106 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1a1cfc97-4994-4708-85bf-779d59172dfe tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] 10.222.0.16 "GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236/ips" status: 200 len: 109 microversion: 2.1 time: 0.126993 Oct 05 02:44:49.524886 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1886/3799] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 02:44:49 2022] GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236/ips => generated 109 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:44:49.543695 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8fcd53f0-ad9e-44ab-bbcd-286364d0236e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:49.544597 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8fcd53f0-ad9e-44ab-bbcd-286364d0236e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:49.562837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8fcd53f0-ad9e-44ab-bbcd-286364d0236e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:49.563732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8fcd53f0-ad9e-44ab-bbcd-286364d0236e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:49.564670 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8fcd53f0-ad9e-44ab-bbcd-286364d0236e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:49.567295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8fcd53f0-ad9e-44ab-bbcd-286364d0236e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:49.568234 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8fcd53f0-ad9e-44ab-bbcd-286364d0236e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:49.569207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8fcd53f0-ad9e-44ab-bbcd-286364d0236e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:50.286894 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fcb30543-ec04-4490-9a30-7e0f1bc29f4e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:50.310768 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fcb30543-ec04-4490-9a30-7e0f1bc29f4e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0" status: 200 len: 1315 microversion: 2.1 time: 1.091494 Oct 05 02:44:50.313635 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1914/3800] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:49 2022] GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0 => generated 1315 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:50.334454 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e8fa0503-ce26-4d90-bc5c-7bcc6cac5098 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:50.335734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e8fa0503-ce26-4d90-bc5c-7bcc6cac5098 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:50.349699 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8fa0503-ce26-4d90-bc5c-7bcc6cac5098 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:50.351415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8fa0503-ce26-4d90-bc5c-7bcc6cac5098 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:50.353137 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8fa0503-ce26-4d90-bc5c-7bcc6cac5098 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:50.354334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8fa0503-ce26-4d90-bc5c-7bcc6cac5098 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:50.355910 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8fa0503-ce26-4d90-bc5c-7bcc6cac5098 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:50.356554 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8fa0503-ce26-4d90-bc5c-7bcc6cac5098 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:50.560230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8fcd53f0-ad9e-44ab-bbcd-286364d0236e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:50.580868 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8fcd53f0-ad9e-44ab-bbcd-286364d0236e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1677 microversion: 2.1 time: 1.051186 Oct 05 02:44:50.597610 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1887/3801] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:49 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1677 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:50.606479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8664819d-6e8e-4322-b81d-6c5e8fcea4a6 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:50.607449 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8664819d-6e8e-4322-b81d-6c5e8fcea4a6 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] [instance: 7025724f-62fd-40b5-b6c2-d696e2298236] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:50.615094 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8664819d-6e8e-4322-b81d-6c5e8fcea4a6 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:50.616073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8664819d-6e8e-4322-b81d-6c5e8fcea4a6 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:50.616731 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8664819d-6e8e-4322-b81d-6c5e8fcea4a6 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:50.618363 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8664819d-6e8e-4322-b81d-6c5e8fcea4a6 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:50.619083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8664819d-6e8e-4322-b81d-6c5e8fcea4a6 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:50.620272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8664819d-6e8e-4322-b81d-6c5e8fcea4a6 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:50.654666 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8664819d-6e8e-4322-b81d-6c5e8fcea4a6 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] 10.222.0.16 "GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236/ips/tempest-ServerAddressesTestJSON-1810785717-network" status: 200 len: 94 microversion: 2.1 time: 0.055483 Oct 05 02:44:50.665669 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1888/3802] 10.222.0.16 () {58 vars in 1401 bytes} [Wed Oct 5 02:44:50 2022] GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236/ips/tempest-ServerAddressesTestJSON-1810785717-network => generated 94 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:44:50.672612 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e53986a6-194c-439f-9367-bf36d6eaaeff tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:50.673566 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e53986a6-194c-439f-9367-bf36d6eaaeff tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:50.683494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e8fa0503-ce26-4d90-bc5c-7bcc6cac5098 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:50.694856 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e8fa0503-ce26-4d90-bc5c-7bcc6cac5098 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:50.699888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e53986a6-194c-439f-9367-bf36d6eaaeff tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:50.702086 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e8fa0503-ce26-4d90-bc5c-7bcc6cac5098 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:50.703532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e53986a6-194c-439f-9367-bf36d6eaaeff tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:50.704228 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e53986a6-194c-439f-9367-bf36d6eaaeff tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:50.705225 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e53986a6-194c-439f-9367-bf36d6eaaeff tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:50.706857 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e53986a6-194c-439f-9367-bf36d6eaaeff tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:50.708580 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e53986a6-194c-439f-9367-bf36d6eaaeff tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:50.723083 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e8fa0503-ce26-4d90-bc5c-7bcc6cac5098 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1555 microversion: 2.91 time: 0.401025 Oct 05 02:44:50.726924 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1915/3803] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:50 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1555 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:44:50.733300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cf14d9dd-be56-401b-a747-84bbb2b0b345 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:50.741170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cf14d9dd-be56-401b-a747-84bbb2b0b345 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] [instance: 7025724f-62fd-40b5-b6c2-d696e2298236] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:50.758776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf14d9dd-be56-401b-a747-84bbb2b0b345 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:50.760630 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf14d9dd-be56-401b-a747-84bbb2b0b345 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:50.762848 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf14d9dd-be56-401b-a747-84bbb2b0b345 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:50.763883 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf14d9dd-be56-401b-a747-84bbb2b0b345 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:50.767746 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf14d9dd-be56-401b-a747-84bbb2b0b345 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:50.768475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf14d9dd-be56-401b-a747-84bbb2b0b345 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:50.837194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cf14d9dd-be56-401b-a747-84bbb2b0b345 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] [instance: 7025724f-62fd-40b5-b6c2-d696e2298236] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:44:51.051389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=42 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:51.087308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e53986a6-194c-439f-9367-bf36d6eaaeff tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:51.099362 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e53986a6-194c-439f-9367-bf36d6eaaeff tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1682 microversion: 2.1 time: 0.432293 Oct 05 02:44:51.102554 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=8 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:51.111556 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cf14d9dd-be56-401b-a747-84bbb2b0b345 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236" status: 204 len: 0 microversion: 2.1 time: 0.382154 Oct 05 02:44:51.118378 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1916/3804] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:44:50 2022] DELETE /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:44:51.126120 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1889/3805] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:50 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1682 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:51.136296 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b2a8f579-61b5-4b32-b37b-4f416c1b7b0d tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:51.138020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b2a8f579-61b5-4b32-b37b-4f416c1b7b0d tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] [instance: 7025724f-62fd-40b5-b6c2-d696e2298236] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:51.157028 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2a8f579-61b5-4b32-b37b-4f416c1b7b0d tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:51.160126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2a8f579-61b5-4b32-b37b-4f416c1b7b0d tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:51.161989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2a8f579-61b5-4b32-b37b-4f416c1b7b0d tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:51.162904 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2a8f579-61b5-4b32-b37b-4f416c1b7b0d tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:51.164825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2a8f579-61b5-4b32-b37b-4f416c1b7b0d tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:51.166710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2a8f579-61b5-4b32-b37b-4f416c1b7b0d tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:51.339828 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b7083a0e-c4ff-4042-a4d9-6a9adae4bda4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:51.340395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b7083a0e-c4ff-4042-a4d9-6a9adae4bda4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7517582f-12a1-4f22-bfb9-0690938cafd0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:51.344078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=95 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:51.362462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7083a0e-c4ff-4042-a4d9-6a9adae4bda4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:51.367778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7083a0e-c4ff-4042-a4d9-6a9adae4bda4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:51.368441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7083a0e-c4ff-4042-a4d9-6a9adae4bda4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:51.389114 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7083a0e-c4ff-4042-a4d9-6a9adae4bda4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:51.390006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7083a0e-c4ff-4042-a4d9-6a9adae4bda4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:51.393811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7083a0e-c4ff-4042-a4d9-6a9adae4bda4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:51.854935 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b2a8f579-61b5-4b32-b37b-4f416c1b7b0d tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6bf791f0d34cbe822b35402973cc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8325066949145cf92e3ec5dd67f44a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:51.863162 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b2a8f579-61b5-4b32-b37b-4f416c1b7b0d tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] 10.222.0.16 "GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236" status: 200 len: 1512 microversion: 2.1 time: 0.739994 Oct 05 02:44:51.863669 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1917/3806] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:51 2022] GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236 => generated 1512 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:51.877840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-907ad9bc-2390-4bc1-baad-ba89aee520c8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:51.890936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-907ad9bc-2390-4bc1-baad-ba89aee520c8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:51.908029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-907ad9bc-2390-4bc1-baad-ba89aee520c8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:51.913536 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-907ad9bc-2390-4bc1-baad-ba89aee520c8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:51.914126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-907ad9bc-2390-4bc1-baad-ba89aee520c8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:51.917363 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-907ad9bc-2390-4bc1-baad-ba89aee520c8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:51.917951 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-907ad9bc-2390-4bc1-baad-ba89aee520c8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:51.918467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-907ad9bc-2390-4bc1-baad-ba89aee520c8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:51.979926 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b7083a0e-c4ff-4042-a4d9-6a9adae4bda4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:52.002829 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b7083a0e-c4ff-4042-a4d9-6a9adae4bda4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0" status: 200 len: 1315 microversion: 2.1 time: 0.667026 Oct 05 02:44:52.008113 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1890/3807] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:51 2022] GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0 => generated 1315 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:44:52.031464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-44f2f540-f756-4abb-b310-655a0277f458 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:52.040699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-44f2f540-f756-4abb-b310-655a0277f458 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:52.082833 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44f2f540-f756-4abb-b310-655a0277f458 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:52.083350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44f2f540-f756-4abb-b310-655a0277f458 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:52.083864 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44f2f540-f756-4abb-b310-655a0277f458 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:52.085376 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44f2f540-f756-4abb-b310-655a0277f458 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:52.085848 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44f2f540-f756-4abb-b310-655a0277f458 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:52.093598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44f2f540-f756-4abb-b310-655a0277f458 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:52.301558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-44f2f540-f756-4abb-b310-655a0277f458 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:52.331736 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-907ad9bc-2390-4bc1-baad-ba89aee520c8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:52.333283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-44f2f540-f756-4abb-b310-655a0277f458 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:52.346003 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-907ad9bc-2390-4bc1-baad-ba89aee520c8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1677 microversion: 2.1 time: 0.480447 Oct 05 02:44:52.346499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-44f2f540-f756-4abb-b310-655a0277f458 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:52.361201 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1918/3808] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:51 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1677 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:52.370324 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-44f2f540-f756-4abb-b310-655a0277f458 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1555 microversion: 2.91 time: 0.357363 Oct 05 02:44:52.379735 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1891/3809] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:52 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1555 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:44:52.393110 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ae824875-bc86-4b88-b44d-5a9e750685b8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:52.403681 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ae824875-bc86-4b88-b44d-5a9e750685b8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:52.421369 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae824875-bc86-4b88-b44d-5a9e750685b8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:52.421879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae824875-bc86-4b88-b44d-5a9e750685b8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:52.422319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae824875-bc86-4b88-b44d-5a9e750685b8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:52.423050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae824875-bc86-4b88-b44d-5a9e750685b8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:52.423511 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae824875-bc86-4b88-b44d-5a9e750685b8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:52.423944 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae824875-bc86-4b88-b44d-5a9e750685b8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:52.859178 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6a1245f8-cab3-4929-97b4-84a87692a2c3 tempest-FlavorsV2NegativeTest-1011014657 tempest-FlavorsV2NegativeTest-1011014657-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:52.893725 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6a1245f8-cab3-4929-97b4-84a87692a2c3 tempest-FlavorsV2NegativeTest-1011014657 tempest-FlavorsV2NegativeTest-1011014657-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.542615 Oct 05 02:44:52.894304 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1919/3810] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 5 02:44:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:44:52.918324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a509ed71-af55-4998-be48-046ff22028fb tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:52.918955 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a509ed71-af55-4998-be48-046ff22028fb tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] [instance: 7025724f-62fd-40b5-b6c2-d696e2298236] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:52.950038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a509ed71-af55-4998-be48-046ff22028fb tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:52.950510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a509ed71-af55-4998-be48-046ff22028fb tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:52.950954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a509ed71-af55-4998-be48-046ff22028fb tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:52.955937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a509ed71-af55-4998-be48-046ff22028fb tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:52.956430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a509ed71-af55-4998-be48-046ff22028fb tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:52.956870 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a509ed71-af55-4998-be48-046ff22028fb tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:53.086307 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ae824875-bc86-4b88-b44d-5a9e750685b8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:53.109628 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ae824875-bc86-4b88-b44d-5a9e750685b8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1682 microversion: 2.1 time: 0.724618 Oct 05 02:44:53.110834 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1892/3811] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:52 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1682 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:53.131196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-78859e10-46c1-45a4-b600-f21089b4b8ba tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:53.133617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-78859e10-46c1-45a4-b600-f21089b4b8ba tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7517582f-12a1-4f22-bfb9-0690938cafd0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:53.152179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-78859e10-46c1-45a4-b600-f21089b4b8ba tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:53.158447 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-78859e10-46c1-45a4-b600-f21089b4b8ba tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:53.165482 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-78859e10-46c1-45a4-b600-f21089b4b8ba tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:53.166418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-78859e10-46c1-45a4-b600-f21089b4b8ba tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:53.167959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-78859e10-46c1-45a4-b600-f21089b4b8ba tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:53.170482 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-78859e10-46c1-45a4-b600-f21089b4b8ba tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:54.565603 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-78859e10-46c1-45a4-b600-f21089b4b8ba tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:54.573843 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-78859e10-46c1-45a4-b600-f21089b4b8ba tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0" status: 200 len: 1315 microversion: 2.1 time: 1.461589 Oct 05 02:44:54.594047 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1893/3812] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:53 2022] GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0 => generated 1315 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:54.607794 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8f493436-36c3-40fc-a3ad-05494987631d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:54.610046 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8f493436-36c3-40fc-a3ad-05494987631d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:54.624457 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f493436-36c3-40fc-a3ad-05494987631d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:54.626225 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f493436-36c3-40fc-a3ad-05494987631d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:54.628167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f493436-36c3-40fc-a3ad-05494987631d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:54.631380 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f493436-36c3-40fc-a3ad-05494987631d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:54.632103 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f493436-36c3-40fc-a3ad-05494987631d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:54.632766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f493436-36c3-40fc-a3ad-05494987631d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:54.889626 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a509ed71-af55-4998-be48-046ff22028fb tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6bf791f0d34cbe822b35402973cc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8325066949145cf92e3ec5dd67f44a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:54.914574 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a509ed71-af55-4998-be48-046ff22028fb tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] 10.222.0.16 "GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236" status: 200 len: 1512 microversion: 2.1 time: 1.999916 Oct 05 02:44:54.932868 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1920/3813] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:52 2022] GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236 => generated 1512 bytes in 2032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:54.943064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f356b3fb-4bcd-4540-811a-b3cfff1eca10 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:54.945283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f356b3fb-4bcd-4540-811a-b3cfff1eca10 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:54.957669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f356b3fb-4bcd-4540-811a-b3cfff1eca10 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:54.958624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f356b3fb-4bcd-4540-811a-b3cfff1eca10 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:54.960370 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f356b3fb-4bcd-4540-811a-b3cfff1eca10 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:54.961877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f356b3fb-4bcd-4540-811a-b3cfff1eca10 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:54.963674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f356b3fb-4bcd-4540-811a-b3cfff1eca10 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:54.964828 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f356b3fb-4bcd-4540-811a-b3cfff1eca10 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:55.194876 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8f493436-36c3-40fc-a3ad-05494987631d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:55.206438 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8f493436-36c3-40fc-a3ad-05494987631d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1677 microversion: 2.1 time: 0.610562 Oct 05 02:44:55.209871 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1894/3814] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:54 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1677 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:55.239965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b160f8e3-a860-4ad5-be72-392bceee464c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:55.242111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b160f8e3-a860-4ad5-be72-392bceee464c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:55.257753 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b160f8e3-a860-4ad5-be72-392bceee464c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:55.260721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b160f8e3-a860-4ad5-be72-392bceee464c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:55.261351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b160f8e3-a860-4ad5-be72-392bceee464c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:55.263569 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b160f8e3-a860-4ad5-be72-392bceee464c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:55.264116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b160f8e3-a860-4ad5-be72-392bceee464c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:55.264692 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b160f8e3-a860-4ad5-be72-392bceee464c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:55.345955 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f356b3fb-4bcd-4540-811a-b3cfff1eca10 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:55.355604 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f356b3fb-4bcd-4540-811a-b3cfff1eca10 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:55.363324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f356b3fb-4bcd-4540-811a-b3cfff1eca10 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:55.394080 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f356b3fb-4bcd-4540-811a-b3cfff1eca10 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1555 microversion: 2.91 time: 0.459500 Oct 05 02:44:55.395089 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1921/3815] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:54 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1555 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:44:55.602882 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-55ebe090-6f4a-4e5b-807e-89df21b25448 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:55.603781 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-55ebe090-6f4a-4e5b-807e-89df21b25448 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7517582f-12a1-4f22-bfb9-0690938cafd0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:55.617704 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55ebe090-6f4a-4e5b-807e-89df21b25448 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:55.623768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55ebe090-6f4a-4e5b-807e-89df21b25448 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:55.624931 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55ebe090-6f4a-4e5b-807e-89df21b25448 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:55.630072 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55ebe090-6f4a-4e5b-807e-89df21b25448 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:55.631322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55ebe090-6f4a-4e5b-807e-89df21b25448 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:55.631998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55ebe090-6f4a-4e5b-807e-89df21b25448 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:55.732794 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b160f8e3-a860-4ad5-be72-392bceee464c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:55.746321 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b160f8e3-a860-4ad5-be72-392bceee464c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1682 microversion: 2.1 time: 0.522849 Oct 05 02:44:55.747239 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1895/3816] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:55 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1682 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:55.939810 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-431edf03-1ef2-4e2c-ae39-6ab5961ba453 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:55.940446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-431edf03-1ef2-4e2c-ae39-6ab5961ba453 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] [instance: 7025724f-62fd-40b5-b6c2-d696e2298236] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:55.947762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-431edf03-1ef2-4e2c-ae39-6ab5961ba453 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:55.948084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-431edf03-1ef2-4e2c-ae39-6ab5961ba453 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:55.948530 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-431edf03-1ef2-4e2c-ae39-6ab5961ba453 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:55.949697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-431edf03-1ef2-4e2c-ae39-6ab5961ba453 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:55.949697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-431edf03-1ef2-4e2c-ae39-6ab5961ba453 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:55.950142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-431edf03-1ef2-4e2c-ae39-6ab5961ba453 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:56.392886 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-431edf03-1ef2-4e2c-ae39-6ab5961ba453 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6bf791f0d34cbe822b35402973cc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8325066949145cf92e3ec5dd67f44a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:56.423436 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-431edf03-1ef2-4e2c-ae39-6ab5961ba453 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] 10.222.0.16 "GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236" status: 200 len: 1470 microversion: 2.1 time: 0.481220 Oct 05 02:44:56.424117 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1896/3817] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:55 2022] GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236 => generated 1470 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:44:56.436802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4d4cc3a4-54e0-49ed-a847-bb69282dae6f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:56.439859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4d4cc3a4-54e0-49ed-a847-bb69282dae6f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:56.455158 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d4cc3a4-54e0-49ed-a847-bb69282dae6f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:56.460322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d4cc3a4-54e0-49ed-a847-bb69282dae6f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:56.461101 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d4cc3a4-54e0-49ed-a847-bb69282dae6f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:56.462038 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d4cc3a4-54e0-49ed-a847-bb69282dae6f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:56.465049 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d4cc3a4-54e0-49ed-a847-bb69282dae6f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:56.466502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d4cc3a4-54e0-49ed-a847-bb69282dae6f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:56.686832 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-55ebe090-6f4a-4e5b-807e-89df21b25448 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:56.706740 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-55ebe090-6f4a-4e5b-807e-89df21b25448 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0" status: 200 len: 1315 microversion: 2.1 time: 1.105707 Oct 05 02:44:56.710007 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1922/3818] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:55 2022] GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0 => generated 1315 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:44:56.738284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fe8319cd-e6c3-427d-82a3-746692e56650 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:56.741428 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fe8319cd-e6c3-427d-82a3-746692e56650 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:56.764780 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe8319cd-e6c3-427d-82a3-746692e56650 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:56.766218 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe8319cd-e6c3-427d-82a3-746692e56650 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:56.769971 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe8319cd-e6c3-427d-82a3-746692e56650 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:56.770939 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe8319cd-e6c3-427d-82a3-746692e56650 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:56.774913 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe8319cd-e6c3-427d-82a3-746692e56650 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:56.775640 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe8319cd-e6c3-427d-82a3-746692e56650 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:56.819658 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:56.922960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4d4cc3a4-54e0-49ed-a847-bb69282dae6f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:56.927904 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:56.940023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fe8319cd-e6c3-427d-82a3-746692e56650 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:56.959877 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4d4cc3a4-54e0-49ed-a847-bb69282dae6f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1654 microversion: 2.1 time: 0.518188 Oct 05 02:44:56.960735 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1897/3819] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:56 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1654 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:56.963842 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fe8319cd-e6c3-427d-82a3-746692e56650 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:56.969106 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fe8319cd-e6c3-427d-82a3-746692e56650 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:56.977551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-8fe23803-d31a-4db6-a601-2b3543c0d884 req-38ca58ee-ee01-4b48-b3fc-a30a412cca45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7025724f-62fd-40b5-b6c2-d696e2298236", "name": "network-vif-deleted", "tag": "f0d80d97-8b9a-40fd-a863-46fb655b1f8f"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:44:56.996010 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fe8319cd-e6c3-427d-82a3-746692e56650 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1555 microversion: 2.91 time: 0.275105 Oct 05 02:44:56.998359 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1923/3820] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:56 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1555 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:44:57.012763 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-8fe23803-d31a-4db6-a601-2b3543c0d884 req-38ca58ee-ee01-4b48-b3fc-a30a412cca45 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:57.013442 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8a6ae5e7-8f8f-43ac-9348-e4d151e3e777 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:57.014328 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8a6ae5e7-8f8f-43ac-9348-e4d151e3e777 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:57.015510 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-8fe23803-d31a-4db6-a601-2b3543c0d884 req-38ca58ee-ee01-4b48-b3fc-a30a412cca45 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:57.019762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-8fe23803-d31a-4db6-a601-2b3543c0d884 req-38ca58ee-ee01-4b48-b3fc-a30a412cca45 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:57.034484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a6ae5e7-8f8f-43ac-9348-e4d151e3e777 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:57.036309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a6ae5e7-8f8f-43ac-9348-e4d151e3e777 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:57.037479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a6ae5e7-8f8f-43ac-9348-e4d151e3e777 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:57.046730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a6ae5e7-8f8f-43ac-9348-e4d151e3e777 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:57.049956 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a6ae5e7-8f8f-43ac-9348-e4d151e3e777 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:57.050642 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a6ae5e7-8f8f-43ac-9348-e4d151e3e777 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:57.070667 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-8fe23803-d31a-4db6-a601-2b3543c0d884 req-38ca58ee-ee01-4b48-b3fc-a30a412cca45 service nova] Creating event network-vif-deleted:f0d80d97-8b9a-40fd-a863-46fb655b1f8f for instance 7025724f-62fd-40b5-b6c2-d696e2298236 on n-h2-858272-3 Oct 05 02:44:57.084738 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-8fe23803-d31a-4db6-a601-2b3543c0d884 req-38ca58ee-ee01-4b48-b3fc-a30a412cca45 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119455 Oct 05 02:44:57.087786 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1898/3821] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:44:57.107328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-343b0b06-9a24-4b87-af12-edf4732104eb tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:44:57.145888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-343b0b06-9a24-4b87-af12-edf4732104eb tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:57.146388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-343b0b06-9a24-4b87-af12-edf4732104eb tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:57.147283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-343b0b06-9a24-4b87-af12-edf4732104eb tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:57.264810 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-343b0b06-9a24-4b87-af12-edf4732104eb tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Going to try to start instance {{(pid=122319) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 05 02:44:57.441399 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-343b0b06-9a24-4b87-af12-edf4732104eb tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "POST /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397/action" status: 202 len: 0 microversion: 2.1 time: 0.348900 Oct 05 02:44:57.446898 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1899/3822] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:44:57 2022] POST /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:44:57.467147 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2816b1cb-b5ed-4a97-be3e-015a87e7440c tempest-FlavorsV2NegativeTest-1011014657 tempest-FlavorsV2NegativeTest-1011014657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1006341362", "imageRef": "7e6c76de-240a-43a6-8cc3-572a2bbc82a5", "flavorRef": "452"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:44:57.574120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8a6ae5e7-8f8f-43ac-9348-e4d151e3e777 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:57.587633 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8a6ae5e7-8f8f-43ac-9348-e4d151e3e777 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1682 microversion: 2.1 time: 0.587936 Oct 05 02:44:57.591648 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1924/3823] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:56 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1682 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:57.611046 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-00633e6e-4983-4310-b1c0-25b33bbc6881 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:57.613663 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-00633e6e-4983-4310-b1c0-25b33bbc6881 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] [instance: 7025724f-62fd-40b5-b6c2-d696e2298236] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:57.644486 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-00633e6e-4983-4310-b1c0-25b33bbc6881 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:57.644976 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-2816b1cb-b5ed-4a97-be3e-015a87e7440c tempest-FlavorsV2NegativeTest-1011014657 tempest-FlavorsV2NegativeTest-1011014657-project] validate_networks() for None {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:44:57.645907 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-00633e6e-4983-4310-b1c0-25b33bbc6881 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:57.646466 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-00633e6e-4983-4310-b1c0-25b33bbc6881 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:57.647314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-00633e6e-4983-4310-b1c0-25b33bbc6881 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:57.649810 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-00633e6e-4983-4310-b1c0-25b33bbc6881 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:57.653446 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-00633e6e-4983-4310-b1c0-25b33bbc6881 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:57.711511 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-00633e6e-4983-4310-b1c0-25b33bbc6881 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] HTTP exception thrown: Instance 7025724f-62fd-40b5-b6c2-d696e2298236 could not be found. Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-00633e6e-4983-4310-b1c0-25b33bbc6881 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Request method failure captured: Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236 HTTP/1.1 Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO-JnnhzZhy9ZNlrfS6aZPJehuse534ikxyhsGZldzKIsjACgI5rcjybDfvGzR3kR5wtJH5SjROzyIR-tQT21mGII7K8TGUZCKm_EiyGoBxuA-mgLyPF3WersR7RlwQORmiWgNgDyW4dPGhbz8Yes7qIlk4xP8zkOF0lwG56VZ33BiQ Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: b8325066949145cf92e3ec5dd67f44a2 Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServerAddressesTestJSON-2093510178 Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b8325066949145cf92e3ec5dd67f44a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b8325066949145cf92e3ec5dd67f44a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b8325066949145cf92e3ec5dd67f44a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b8325066949145cf92e3ec5dd67f44a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServerAddressesTestJSON-2093510178 Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: b8325066949145cf92e3ec5dd67f44a2 Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServerAddressesTestJSON-2093510178 Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServerAddressesTestJSON-2093510178-project Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: ed6bf791f0d34cbe822b35402973cc49 Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServerAddressesTestJSON-2093510178-project Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 7025724f-62fd-40b5-b6c2-d696e2298236 could not be found. Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '7025724f-62fd-40b5-b6c2-d696e2298236'} Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7025724f-62fd-40b5-b6c2-d696e2298236 could not be found. Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7025724f-62fd-40b5-b6c2-d696e2298236 could not be found. Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:44:57.725399 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:57.729108 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:57.729108 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:44:57.729108 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:44:57.729108 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:44:57.729108 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:44:57.729108 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7025724f-62fd-40b5-b6c2-d696e2298236 could not be found. Oct 05 02:44:57.729108 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:44:57.734084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-00633e6e-4983-4310-b1c0-25b33bbc6881 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] Returning 404 to user: Instance 7025724f-62fd-40b5-b6c2-d696e2298236 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:44:57.735452 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-00633e6e-4983-4310-b1c0-25b33bbc6881 tempest-ServerAddressesTestJSON-2093510178 tempest-ServerAddressesTestJSON-2093510178-project] 10.222.0.16 "GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236" status: 404 len: 111 microversion: 2.1 time: 0.140693 Oct 05 02:44:57.741345 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1925/3824] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:57 2022] GET /compute/v2.1/servers/7025724f-62fd-40b5-b6c2-d696e2298236 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:44:57.751607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4b4abaef-4eef-42d3-a168-e53b9c24c7b6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:57.766864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4b4abaef-4eef-42d3-a168-e53b9c24c7b6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:57.802215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b4abaef-4eef-42d3-a168-e53b9c24c7b6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:57.802744 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b4abaef-4eef-42d3-a168-e53b9c24c7b6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:57.803189 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b4abaef-4eef-42d3-a168-e53b9c24c7b6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:57.803930 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b4abaef-4eef-42d3-a168-e53b9c24c7b6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:57.810672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b4abaef-4eef-42d3-a168-e53b9c24c7b6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:57.814293 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b4abaef-4eef-42d3-a168-e53b9c24c7b6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:58.722390 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-2816b1cb-b5ed-4a97-be3e-015a87e7440c tempest-FlavorsV2NegativeTest-1011014657 tempest-FlavorsV2NegativeTest-1011014657-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2816b1cb-b5ed-4a97-be3e-015a87e7440c tempest-FlavorsV2NegativeTest-1011014657 tempest-FlavorsV2NegativeTest-1011014657-project] Request method failure captured: Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 143 Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO-j1MEhIzKDrjZiaz-u1sel9fLkEOe8wF1MOUhYPLmfWnAm9OiLXtM-gAwADN9cDqyC5ZyMOWZHYO8dIuYOv2kODNf0SZGRsqfxZri9fiEyTdU3V0nqIT2sGZaRVrEvx1VqNuMaTwZdJbnMXsT6NHyMVe894t7AZu_KeEPcX15wZkc Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 866f7da063ae4a9c9303deff8d91c6ae Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-FlavorsV2NegativeTest-1011014657 Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/866f7da063ae4a9c9303deff8d91c6ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/866f7da063ae4a9c9303deff8d91c6ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/866f7da063ae4a9c9303deff8d91c6ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_866f7da063ae4a9c9303deff8d91c6ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-FlavorsV2NegativeTest-1011014657 Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 866f7da063ae4a9c9303deff8d91c6ae Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1011014657 Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-FlavorsV2NegativeTest-1011014657-project Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 5339c00a88e6415b981ab6c1d68b14bb Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-FlavorsV2NegativeTest-1011014657-project Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1006341362", "imageRef": "7e6c76de-240a-43a6-8cc3-572a2bbc82a5", "flavorRef": "452"}} Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: exception: Flavor's memory is too small for requested image. Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1006341362', 'imageRef': '7e6c76de-240a-43a6-8cc3-572a2bbc82a5', 'flavorRef': '452'}}} Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:44:58.724958 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:44:58.728236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:44:58.728236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:44:58.728236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 05 02:44:58.728236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 05 02:44:58.728236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 05 02:44:58.728236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 05 02:44:58.728236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:44:58.728236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:44:58.728236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:44:58.728236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:44:58.728236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:44:58.728236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:44:58.728236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:44:58.728236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:44:58.728236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 05 02:44:58.728236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:44:58.732313 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2816b1cb-b5ed-4a97-be3e-015a87e7440c tempest-FlavorsV2NegativeTest-1011014657 tempest-FlavorsV2NegativeTest-1011014657-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:44:58.733480 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2816b1cb-b5ed-4a97-be3e-015a87e7440c tempest-FlavorsV2NegativeTest-1011014657 tempest-FlavorsV2NegativeTest-1011014657-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.283983 Oct 05 02:44:58.734877 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1900/3825] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:44:57 2022] POST /compute/v2.1/servers => generated 93 bytes in 1286 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 05 02:44:58.749851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-77a3a9b0-8726-4de3-8433-e26b44db231e req-c1f22217-10d0-48b6-80d9-7ccba1ee1bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7517582f-12a1-4f22-bfb9-0690938cafd0", "name": "network-vif-plugged", "status": "completed", "tag": "8a9340ae-7d83-456a-83fd-039db65d4ab2"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:44:58.765222 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4b4abaef-4eef-42d3-a168-e53b9c24c7b6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:58.777987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-77a3a9b0-8726-4de3-8433-e26b44db231e req-c1f22217-10d0-48b6-80d9-7ccba1ee1bf4 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:58.783151 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4b4abaef-4eef-42d3-a168-e53b9c24c7b6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1663 microversion: 2.1 time: 1.040307 Oct 05 02:44:58.783779 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1926/3826] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:57 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1663 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:58.784253 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-77a3a9b0-8726-4de3-8433-e26b44db231e req-c1f22217-10d0-48b6-80d9-7ccba1ee1bf4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:58.784934 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-77a3a9b0-8726-4de3-8433-e26b44db231e req-c1f22217-10d0-48b6-80d9-7ccba1ee1bf4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:58.810510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1bb84d1f-1b73-40bd-bee5-ed69dd832aae tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:58.816335 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1bb84d1f-1b73-40bd-bee5-ed69dd832aae tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7517582f-12a1-4f22-bfb9-0690938cafd0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:58.824870 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-77a3a9b0-8726-4de3-8433-e26b44db231e req-c1f22217-10d0-48b6-80d9-7ccba1ee1bf4 service nova] Creating event network-vif-plugged:8a9340ae-7d83-456a-83fd-039db65d4ab2 for instance 7517582f-12a1-4f22-bfb9-0690938cafd0 on n-h1-858272-3 Oct 05 02:44:58.834000 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-77a3a9b0-8726-4de3-8433-e26b44db231e req-c1f22217-10d0-48b6-80d9-7ccba1ee1bf4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097574 Oct 05 02:44:58.839956 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1901/3827] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:44:58.845798 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bb84d1f-1b73-40bd-bee5-ed69dd832aae tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:58.846285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bb84d1f-1b73-40bd-bee5-ed69dd832aae tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:58.848645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bb84d1f-1b73-40bd-bee5-ed69dd832aae tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:58.850268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bb84d1f-1b73-40bd-bee5-ed69dd832aae tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:58.852622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7491bcb8-7676-4963-9cd6-4bee2e520672 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:58.857200 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bb84d1f-1b73-40bd-bee5-ed69dd832aae tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:58.857712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bb84d1f-1b73-40bd-bee5-ed69dd832aae tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:58.862784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7491bcb8-7676-4963-9cd6-4bee2e520672 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:58.871823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7491bcb8-7676-4963-9cd6-4bee2e520672 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:58.872574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7491bcb8-7676-4963-9cd6-4bee2e520672 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:58.873287 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7491bcb8-7676-4963-9cd6-4bee2e520672 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:58.874238 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7491bcb8-7676-4963-9cd6-4bee2e520672 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:58.875108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7491bcb8-7676-4963-9cd6-4bee2e520672 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:58.875756 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7491bcb8-7676-4963-9cd6-4bee2e520672 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:59.180074 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7491bcb8-7676-4963-9cd6-4bee2e520672 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:59.204445 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7491bcb8-7676-4963-9cd6-4bee2e520672 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:59.215274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7491bcb8-7676-4963-9cd6-4bee2e520672 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:59.224005 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7491bcb8-7676-4963-9cd6-4bee2e520672 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1537 microversion: 2.91 time: 0.382481 Oct 05 02:44:59.241779 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1902/3828] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:44:58 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1537 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:44:59.262880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-36ce36de-8a24-4bfb-aeec-a7e8f849869f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:59.263583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-36ce36de-8a24-4bfb-aeec-a7e8f849869f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:59.299771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36ce36de-8a24-4bfb-aeec-a7e8f849869f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:59.300279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36ce36de-8a24-4bfb-aeec-a7e8f849869f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:59.300724 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36ce36de-8a24-4bfb-aeec-a7e8f849869f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:59.306632 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36ce36de-8a24-4bfb-aeec-a7e8f849869f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:59.307210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36ce36de-8a24-4bfb-aeec-a7e8f849869f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:59.307662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36ce36de-8a24-4bfb-aeec-a7e8f849869f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:59.885460 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1bb84d1f-1b73-40bd-bee5-ed69dd832aae tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:44:59.916873 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1bb84d1f-1b73-40bd-bee5-ed69dd832aae tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0" status: 200 len: 1315 microversion: 2.1 time: 1.131974 Oct 05 02:44:59.932863 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1927/3829] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:58 2022] GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0 => generated 1315 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:44:59.932863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-974af109-131e-4bd6-b2c2-0974d4bb75df tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:44:59.932863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-974af109-131e-4bd6-b2c2-0974d4bb75df tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:44:59.962083 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-974af109-131e-4bd6-b2c2-0974d4bb75df tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:59.966793 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-974af109-131e-4bd6-b2c2-0974d4bb75df tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:59.967558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-974af109-131e-4bd6-b2c2-0974d4bb75df tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:44:59.969049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-974af109-131e-4bd6-b2c2-0974d4bb75df tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:44:59.969682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-974af109-131e-4bd6-b2c2-0974d4bb75df tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:44:59.973811 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-974af109-131e-4bd6-b2c2-0974d4bb75df tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:00.512673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-36ce36de-8a24-4bfb-aeec-a7e8f849869f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:00.533971 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-36ce36de-8a24-4bfb-aeec-a7e8f849869f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1682 microversion: 2.1 time: 1.290748 Oct 05 02:45:00.534609 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1903/3830] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:59 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1682 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:00.551344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cb625308-1433-4ae0-a7aa-31119dc5ba5a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:00.553047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cb625308-1433-4ae0-a7aa-31119dc5ba5a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:00.574226 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb625308-1433-4ae0-a7aa-31119dc5ba5a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:00.574596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb625308-1433-4ae0-a7aa-31119dc5ba5a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:00.575053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb625308-1433-4ae0-a7aa-31119dc5ba5a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:00.577293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb625308-1433-4ae0-a7aa-31119dc5ba5a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:00.577293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb625308-1433-4ae0-a7aa-31119dc5ba5a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:00.577293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb625308-1433-4ae0-a7aa-31119dc5ba5a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:00.963525 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-974af109-131e-4bd6-b2c2-0974d4bb75df tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:00.986672 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-974af109-131e-4bd6-b2c2-0974d4bb75df tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1663 microversion: 2.1 time: 1.066978 Oct 05 02:45:00.999242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cb625308-1433-4ae0-a7aa-31119dc5ba5a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:01.005567 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1928/3831] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:44:59 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1663 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:01.013852 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cb625308-1433-4ae0-a7aa-31119dc5ba5a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:01.015098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cd21ccb9-5ae3-4b65-8d8c-a594d08be836 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:01.015915 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cd21ccb9-5ae3-4b65-8d8c-a594d08be836 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7517582f-12a1-4f22-bfb9-0690938cafd0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:01.021973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cb625308-1433-4ae0-a7aa-31119dc5ba5a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:01.023376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd21ccb9-5ae3-4b65-8d8c-a594d08be836 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:01.024025 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd21ccb9-5ae3-4b65-8d8c-a594d08be836 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:01.024610 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd21ccb9-5ae3-4b65-8d8c-a594d08be836 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:01.025565 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd21ccb9-5ae3-4b65-8d8c-a594d08be836 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:01.026220 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd21ccb9-5ae3-4b65-8d8c-a594d08be836 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:01.026832 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd21ccb9-5ae3-4b65-8d8c-a594d08be836 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:01.035625 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cb625308-1433-4ae0-a7aa-31119dc5ba5a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1537 microversion: 2.91 time: 0.494759 Oct 05 02:45:01.041766 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1904/3832] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:45:00 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1537 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:45:01.262412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cd21ccb9-5ae3-4b65-8d8c-a594d08be836 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:01.271346 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cd21ccb9-5ae3-4b65-8d8c-a594d08be836 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0" status: 200 len: 1315 microversion: 2.1 time: 0.264534 Oct 05 02:45:01.271912 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1929/3833] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:01 2022] GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0 => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:01.560036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e83f113d-f115-4be4-b1d3-d3264796fecf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:01.562146 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e83f113d-f115-4be4-b1d3-d3264796fecf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:01.578973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e83f113d-f115-4be4-b1d3-d3264796fecf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:01.579800 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e83f113d-f115-4be4-b1d3-d3264796fecf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:01.581361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e83f113d-f115-4be4-b1d3-d3264796fecf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:01.582880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e83f113d-f115-4be4-b1d3-d3264796fecf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:01.584693 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e83f113d-f115-4be4-b1d3-d3264796fecf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:01.585726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e83f113d-f115-4be4-b1d3-d3264796fecf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:02.018571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-da8262ac-dde8-4076-96de-4c800f8cc0e4 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:02.019191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-da8262ac-dde8-4076-96de-4c800f8cc0e4 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:02.034536 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-da8262ac-dde8-4076-96de-4c800f8cc0e4 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:02.039411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-da8262ac-dde8-4076-96de-4c800f8cc0e4 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:02.039864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-da8262ac-dde8-4076-96de-4c800f8cc0e4 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:02.040596 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-da8262ac-dde8-4076-96de-4c800f8cc0e4 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:02.041134 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-da8262ac-dde8-4076-96de-4c800f8cc0e4 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:02.041496 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-da8262ac-dde8-4076-96de-4c800f8cc0e4 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:02.855299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e83f113d-f115-4be4-b1d3-d3264796fecf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:02.867900 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e83f113d-f115-4be4-b1d3-d3264796fecf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1682 microversion: 2.1 time: 1.312613 Oct 05 02:45:02.880011 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1905/3834] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:01 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1682 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:02.893869 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-aa41b1df-9e85-4a08-8715-948009a5d998 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:02.894829 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-aa41b1df-9e85-4a08-8715-948009a5d998 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:02.901237 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa41b1df-9e85-4a08-8715-948009a5d998 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:02.902025 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa41b1df-9e85-4a08-8715-948009a5d998 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:02.902789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa41b1df-9e85-4a08-8715-948009a5d998 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:02.903711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa41b1df-9e85-4a08-8715-948009a5d998 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:02.904375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa41b1df-9e85-4a08-8715-948009a5d998 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:02.905076 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa41b1df-9e85-4a08-8715-948009a5d998 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:03.258191 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-aa41b1df-9e85-4a08-8715-948009a5d998 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:03.320023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-da8262ac-dde8-4076-96de-4c800f8cc0e4 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:03.320551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-aa41b1df-9e85-4a08-8715-948009a5d998 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:03.321509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-aa41b1df-9e85-4a08-8715-948009a5d998 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:03.347106 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-aa41b1df-9e85-4a08-8715-948009a5d998 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1480 microversion: 2.91 time: 0.461001 Oct 05 02:45:03.348121 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1906/3835] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:45:02 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1480 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:45:03.363504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-786b80c2-da51-4029-bd50-43e16c035f65 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:03.364355 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-786b80c2-da51-4029-bd50-43e16c035f65 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7517582f-12a1-4f22-bfb9-0690938cafd0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:03.371014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-786b80c2-da51-4029-bd50-43e16c035f65 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:03.371775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-786b80c2-da51-4029-bd50-43e16c035f65 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:03.372413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-786b80c2-da51-4029-bd50-43e16c035f65 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:03.373349 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-786b80c2-da51-4029-bd50-43e16c035f65 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:03.374008 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-786b80c2-da51-4029-bd50-43e16c035f65 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:03.374840 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-786b80c2-da51-4029-bd50-43e16c035f65 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:03.489049 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-da8262ac-dde8-4076-96de-4c800f8cc0e4 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1667 microversion: 2.1 time: 1.475235 Oct 05 02:45:03.489771 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1930/3836] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:02 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1667 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:03.505208 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bd2f2fee-d619-4864-a6b8-bd311af0ab13 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-858272-3"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:45:03.508494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bd2f2fee-d619-4864-a6b8-bd311af0ab13 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:03.519298 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd2f2fee-d619-4864-a6b8-bd311af0ab13 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:03.529884 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd2f2fee-d619-4864-a6b8-bd311af0ab13 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:03.530698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd2f2fee-d619-4864-a6b8-bd311af0ab13 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:03.537270 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd2f2fee-d619-4864-a6b8-bd311af0ab13 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:03.539733 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd2f2fee-d619-4864-a6b8-bd311af0ab13 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:03.540357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd2f2fee-d619-4864-a6b8-bd311af0ab13 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:03.710469 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bd2f2fee-d619-4864-a6b8-bd311af0ab13 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-858272-3". {{(pid=122320) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 05 02:45:03.867971 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bd2f2fee-d619-4864-a6b8-bd311af0ab13 tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6/action" status: 202 len: 0 microversion: 2.91 time: 0.374753 Oct 05 02:45:03.875069 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1931/3837] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 5 02:45:03 2022] POST /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:45:03.896888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1b094e4d-bdf7-4cd2-88c1-b1e493423807 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:03.898944 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1b094e4d-bdf7-4cd2-88c1-b1e493423807 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:03.919301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b094e4d-bdf7-4cd2-88c1-b1e493423807 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:03.920153 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b094e4d-bdf7-4cd2-88c1-b1e493423807 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:03.920807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b094e4d-bdf7-4cd2-88c1-b1e493423807 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:03.927165 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b094e4d-bdf7-4cd2-88c1-b1e493423807 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:03.928792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b094e4d-bdf7-4cd2-88c1-b1e493423807 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:03.929529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b094e4d-bdf7-4cd2-88c1-b1e493423807 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:04.038906 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1b094e4d-bdf7-4cd2-88c1-b1e493423807 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:04.058242 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1b094e4d-bdf7-4cd2-88c1-b1e493423807 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:04.062961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1b094e4d-bdf7-4cd2-88c1-b1e493423807 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:04.081877 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1b094e4d-bdf7-4cd2-88c1-b1e493423807 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1488 microversion: 2.91 time: 0.203294 Oct 05 02:45:04.108493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-786b80c2-da51-4029-bd50-43e16c035f65 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:04.117864 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1932/3838] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:45:03 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1488 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:45:04.126662 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-786b80c2-da51-4029-bd50-43e16c035f65 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0" status: 200 len: 1502 microversion: 2.1 time: 0.771377 Oct 05 02:45:04.128257 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1907/3839] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:03 2022] GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0 => generated 1502 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:04.132293 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-514de397-eb17-4a50-aa5c-b31c86c274a7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:04.132960 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-514de397-eb17-4a50-aa5c-b31c86c274a7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:04.148191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-514de397-eb17-4a50-aa5c-b31c86c274a7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:04.148191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-514de397-eb17-4a50-aa5c-b31c86c274a7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:04.148617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-514de397-eb17-4a50-aa5c-b31c86c274a7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:04.149348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-514de397-eb17-4a50-aa5c-b31c86c274a7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:04.149803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-514de397-eb17-4a50-aa5c-b31c86c274a7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:04.158388 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-514de397-eb17-4a50-aa5c-b31c86c274a7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:04.673422 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-514de397-eb17-4a50-aa5c-b31c86c274a7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:04.698884 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-514de397-eb17-4a50-aa5c-b31c86c274a7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1682 microversion: 2.1 time: 0.572947 Oct 05 02:45:04.700990 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1933/3840] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:04 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1682 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:05.119079 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b0424313-a6c4-43cf-8d0e-45ec600b3d1e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:05.119604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b0424313-a6c4-43cf-8d0e-45ec600b3d1e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:05.137306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0424313-a6c4-43cf-8d0e-45ec600b3d1e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:05.138236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0424313-a6c4-43cf-8d0e-45ec600b3d1e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:05.138928 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0424313-a6c4-43cf-8d0e-45ec600b3d1e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:05.140207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0424313-a6c4-43cf-8d0e-45ec600b3d1e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:05.141150 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0424313-a6c4-43cf-8d0e-45ec600b3d1e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:05.141926 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0424313-a6c4-43cf-8d0e-45ec600b3d1e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:05.320229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b0424313-a6c4-43cf-8d0e-45ec600b3d1e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:05.334219 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b0424313-a6c4-43cf-8d0e-45ec600b3d1e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:05.360700 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b0424313-a6c4-43cf-8d0e-45ec600b3d1e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:05.384133 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b0424313-a6c4-43cf-8d0e-45ec600b3d1e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1488 microversion: 2.91 time: 0.270698 Oct 05 02:45:05.424012 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1908/3841] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:45:05 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1488 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:45:05.736347 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fef6917c-a723-47f6-80eb-3a9af44434c7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:05.737746 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fef6917c-a723-47f6-80eb-3a9af44434c7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:05.756996 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fef6917c-a723-47f6-80eb-3a9af44434c7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:05.760386 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fef6917c-a723-47f6-80eb-3a9af44434c7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:05.760877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fef6917c-a723-47f6-80eb-3a9af44434c7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:05.770090 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fef6917c-a723-47f6-80eb-3a9af44434c7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:05.770939 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fef6917c-a723-47f6-80eb-3a9af44434c7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:05.771556 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fef6917c-a723-47f6-80eb-3a9af44434c7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:06.229632 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fef6917c-a723-47f6-80eb-3a9af44434c7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:06.242648 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fef6917c-a723-47f6-80eb-3a9af44434c7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1682 microversion: 2.1 time: 0.514839 Oct 05 02:45:06.245774 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1934/3842] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:05 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1682 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:06.424077 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7b4005bf-5cab-436c-b1bb-c4e09229ad72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:06.425470 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7b4005bf-5cab-436c-b1bb-c4e09229ad72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:06.456823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b4005bf-5cab-436c-b1bb-c4e09229ad72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:06.460282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b4005bf-5cab-436c-b1bb-c4e09229ad72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:06.462466 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b4005bf-5cab-436c-b1bb-c4e09229ad72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:06.466397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b4005bf-5cab-436c-b1bb-c4e09229ad72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:06.470534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b4005bf-5cab-436c-b1bb-c4e09229ad72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:06.472352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b4005bf-5cab-436c-b1bb-c4e09229ad72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:06.692215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7b4005bf-5cab-436c-b1bb-c4e09229ad72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:06.707429 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7b4005bf-5cab-436c-b1bb-c4e09229ad72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:06.716360 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7b4005bf-5cab-436c-b1bb-c4e09229ad72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:06.728423 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7b4005bf-5cab-436c-b1bb-c4e09229ad72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1490 microversion: 2.91 time: 0.308495 Oct 05 02:45:06.743034 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1909/3843] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:45:06 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1490 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:45:07.270762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b2ac6510-911b-40ee-bc38-8ab7c6029466 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:07.271389 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b2ac6510-911b-40ee-bc38-8ab7c6029466 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:07.285392 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2ac6510-911b-40ee-bc38-8ab7c6029466 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:07.285901 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2ac6510-911b-40ee-bc38-8ab7c6029466 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:07.286352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2ac6510-911b-40ee-bc38-8ab7c6029466 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:07.287079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2ac6510-911b-40ee-bc38-8ab7c6029466 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:07.287547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2ac6510-911b-40ee-bc38-8ab7c6029466 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:07.287985 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2ac6510-911b-40ee-bc38-8ab7c6029466 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:07.774575 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a62298f3-22ab-4b6a-ad5f-ca49f6cf007e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:07.775514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a62298f3-22ab-4b6a-ad5f-ca49f6cf007e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:07.788707 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a62298f3-22ab-4b6a-ad5f-ca49f6cf007e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:07.793256 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a62298f3-22ab-4b6a-ad5f-ca49f6cf007e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:07.793861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a62298f3-22ab-4b6a-ad5f-ca49f6cf007e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:07.794749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a62298f3-22ab-4b6a-ad5f-ca49f6cf007e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:07.795420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a62298f3-22ab-4b6a-ad5f-ca49f6cf007e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:07.795929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a62298f3-22ab-4b6a-ad5f-ca49f6cf007e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:07.889707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b2ac6510-911b-40ee-bc38-8ab7c6029466 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:07.902663 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b2ac6510-911b-40ee-bc38-8ab7c6029466 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.632721 Oct 05 02:45:07.906081 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1935/3844] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:07 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:07.978929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a62298f3-22ab-4b6a-ad5f-ca49f6cf007e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:07.993471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a62298f3-22ab-4b6a-ad5f-ca49f6cf007e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:07.997610 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a62298f3-22ab-4b6a-ad5f-ca49f6cf007e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:08.011269 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a62298f3-22ab-4b6a-ad5f-ca49f6cf007e tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1546 microversion: 2.91 time: 0.240824 Oct 05 02:45:08.014163 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1910/3845] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:45:07 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1546 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:45:08.335623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-91bc7700-4ea9-4f73-9a7f-00d273dee28e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff08cc3c-a7ac-48ed-8511-4bb1052fa63e"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:45:08.340018 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-91bc7700-4ea9-4f73-9a7f-00d273dee28e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7517582f-12a1-4f22-bfb9-0690938cafd0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:08.374053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91bc7700-4ea9-4f73-9a7f-00d273dee28e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:08.380163 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91bc7700-4ea9-4f73-9a7f-00d273dee28e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:08.386141 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91bc7700-4ea9-4f73-9a7f-00d273dee28e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:08.387150 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91bc7700-4ea9-4f73-9a7f-00d273dee28e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:08.387591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91bc7700-4ea9-4f73-9a7f-00d273dee28e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:08.400322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91bc7700-4ea9-4f73-9a7f-00d273dee28e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:09.049436 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1b901f31-0b72-4831-90e1-e4db04efacb9 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:09.050843 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1b901f31-0b72-4831-90e1-e4db04efacb9 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:09.066066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b901f31-0b72-4831-90e1-e4db04efacb9 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:09.070556 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b901f31-0b72-4831-90e1-e4db04efacb9 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:09.073052 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b901f31-0b72-4831-90e1-e4db04efacb9 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:09.075528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b901f31-0b72-4831-90e1-e4db04efacb9 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:09.077063 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b901f31-0b72-4831-90e1-e4db04efacb9 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:09.082776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b901f31-0b72-4831-90e1-e4db04efacb9 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:09.137543 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-91bc7700-4ea9-4f73-9a7f-00d273dee28e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "POST /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.795482 Oct 05 02:45:09.137927 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1936/3846] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 02:45:08 2022] POST /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0/os-volume_attachments => generated 194 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:45:09.254340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0aedb37f-8865-4f09-b841-9af0c2fa38f2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:09.255333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0aedb37f-8865-4f09-b841-9af0c2fa38f2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:09.291423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0aedb37f-8865-4f09-b841-9af0c2fa38f2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:09.292476 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0aedb37f-8865-4f09-b841-9af0c2fa38f2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:09.298250 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0aedb37f-8865-4f09-b841-9af0c2fa38f2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:09.300694 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0aedb37f-8865-4f09-b841-9af0c2fa38f2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:09.306796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0aedb37f-8865-4f09-b841-9af0c2fa38f2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:09.316391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0aedb37f-8865-4f09-b841-9af0c2fa38f2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:09.410230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1b901f31-0b72-4831-90e1-e4db04efacb9 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:09.426805 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1b901f31-0b72-4831-90e1-e4db04efacb9 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:09.433117 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1b901f31-0b72-4831-90e1-e4db04efacb9 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:09.447479 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1b901f31-0b72-4831-90e1-e4db04efacb9 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1546 microversion: 2.91 time: 0.401886 Oct 05 02:45:09.453346 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1911/3847] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:45:09 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1546 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:45:09.966027 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0aedb37f-8865-4f09-b841-9af0c2fa38f2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:09.995491 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0aedb37f-8865-4f09-b841-9af0c2fa38f2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.746803 Oct 05 02:45:09.999436 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1937/3848] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:09 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:45:10.489659 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-34877e12-f990-4f6c-b47f-7e26c30daf72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:10.491426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-34877e12-f990-4f6c-b47f-7e26c30daf72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:10.507495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-34877e12-f990-4f6c-b47f-7e26c30daf72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:10.518403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-34877e12-f990-4f6c-b47f-7e26c30daf72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:10.519437 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-34877e12-f990-4f6c-b47f-7e26c30daf72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:10.524300 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-34877e12-f990-4f6c-b47f-7e26c30daf72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:10.525385 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-34877e12-f990-4f6c-b47f-7e26c30daf72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:10.528782 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-34877e12-f990-4f6c-b47f-7e26c30daf72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:10.590228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-5bbfd2e4-b680-4c36-aebb-ceb57a0fc263 req-548853e6-b464-4aec-938e-db8af8335abc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4388e9ec-13a9-4d5b-9310-7a10953c57d0", "name": "network-vif-unplugged", "status": "completed", "tag": "17b098e0-7358-489c-bec3-6b98c1db0796"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:45:10.625685 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-5bbfd2e4-b680-4c36-aebb-ceb57a0fc263 req-548853e6-b464-4aec-938e-db8af8335abc service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:10.628320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-5bbfd2e4-b680-4c36-aebb-ceb57a0fc263 req-548853e6-b464-4aec-938e-db8af8335abc service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:10.629305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-5bbfd2e4-b680-4c36-aebb-ceb57a0fc263 req-548853e6-b464-4aec-938e-db8af8335abc service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:10.653675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:10.715609 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-5bbfd2e4-b680-4c36-aebb-ceb57a0fc263 req-548853e6-b464-4aec-938e-db8af8335abc service nova] Creating event network-vif-unplugged:17b098e0-7358-489c-bec3-6b98c1db0796 for instance 4388e9ec-13a9-4d5b-9310-7a10953c57d0 on n-h1-858272-3 Oct 05 02:45:10.734578 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-5bbfd2e4-b680-4c36-aebb-ceb57a0fc263 req-548853e6-b464-4aec-938e-db8af8335abc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.142478 Oct 05 02:45:10.736006 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1938/3849] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:45:12.075559 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-34877e12-f990-4f6c-b47f-7e26c30daf72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:12.089176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-34877e12-f990-4f6c-b47f-7e26c30daf72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:12.102815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-34877e12-f990-4f6c-b47f-7e26c30daf72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:12.118566 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-34877e12-f990-4f6c-b47f-7e26c30daf72 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1546 microversion: 2.91 time: 1.631695 Oct 05 02:45:12.120132 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1912/3850] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:45:10 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1546 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:45:13.071028 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7239429a-3f18-4e8e-9ad2-2d1e5c245756 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:13.080391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7239429a-3f18-4e8e-9ad2-2d1e5c245756 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:13.103035 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7239429a-3f18-4e8e-9ad2-2d1e5c245756 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:13.103544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7239429a-3f18-4e8e-9ad2-2d1e5c245756 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:13.103979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7239429a-3f18-4e8e-9ad2-2d1e5c245756 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:13.108022 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7239429a-3f18-4e8e-9ad2-2d1e5c245756 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:13.110439 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7239429a-3f18-4e8e-9ad2-2d1e5c245756 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:13.111105 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7239429a-3f18-4e8e-9ad2-2d1e5c245756 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:13.158593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-52ee60fa-bdf8-457b-a0a5-c6f0065713c0 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:13.159896 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-52ee60fa-bdf8-457b-a0a5-c6f0065713c0 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:13.177220 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52ee60fa-bdf8-457b-a0a5-c6f0065713c0 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:13.181279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52ee60fa-bdf8-457b-a0a5-c6f0065713c0 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:13.182759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52ee60fa-bdf8-457b-a0a5-c6f0065713c0 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:13.184789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52ee60fa-bdf8-457b-a0a5-c6f0065713c0 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:13.188296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52ee60fa-bdf8-457b-a0a5-c6f0065713c0 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:13.189762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52ee60fa-bdf8-457b-a0a5-c6f0065713c0 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:13.517391 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-52ee60fa-bdf8-457b-a0a5-c6f0065713c0 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:13.533427 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-52ee60fa-bdf8-457b-a0a5-c6f0065713c0 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:13.540228 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-52ee60fa-bdf8-457b-a0a5-c6f0065713c0 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:13.556712 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-52ee60fa-bdf8-457b-a0a5-c6f0065713c0 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1546 microversion: 2.91 time: 0.404256 Oct 05 02:45:13.561112 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1913/3851] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:45:13 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1546 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:45:13.871058 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7239429a-3f18-4e8e-9ad2-2d1e5c245756 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:13.887366 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7239429a-3f18-4e8e-9ad2-2d1e5c245756 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.861492 Oct 05 02:45:13.890664 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1939/3852] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:13 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:13.918605 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-828b5602-ff7e-4b82-b2b6-4d6a1520ec30 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:13.922217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-828b5602-ff7e-4b82-b2b6-4d6a1520ec30 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:13.935609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-828b5602-ff7e-4b82-b2b6-4d6a1520ec30 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:13.939421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-828b5602-ff7e-4b82-b2b6-4d6a1520ec30 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:13.940222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-828b5602-ff7e-4b82-b2b6-4d6a1520ec30 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:13.945409 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-828b5602-ff7e-4b82-b2b6-4d6a1520ec30 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:13.955880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-828b5602-ff7e-4b82-b2b6-4d6a1520ec30 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:13.956488 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-828b5602-ff7e-4b82-b2b6-4d6a1520ec30 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:14.440486 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-828b5602-ff7e-4b82-b2b6-4d6a1520ec30 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:14.452102 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-828b5602-ff7e-4b82-b2b6-4d6a1520ec30 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.539028 Oct 05 02:45:14.461045 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1914/3853] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:13 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:14.480121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-32c70392-f23c-4919-88e4-fc4ad9c8c5c4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:14.480747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-32c70392-f23c-4919-88e4-fc4ad9c8c5c4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:14.495658 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32c70392-f23c-4919-88e4-fc4ad9c8c5c4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:14.498632 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32c70392-f23c-4919-88e4-fc4ad9c8c5c4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:14.501669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32c70392-f23c-4919-88e4-fc4ad9c8c5c4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:14.502528 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32c70392-f23c-4919-88e4-fc4ad9c8c5c4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:14.503047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32c70392-f23c-4919-88e4-fc4ad9c8c5c4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:14.511183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32c70392-f23c-4919-88e4-fc4ad9c8c5c4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:14.592483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-56862a8a-b48e-42ae-adfe-f9f12e36a685 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:14.593581 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-56862a8a-b48e-42ae-adfe-f9f12e36a685 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:14.605333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-56862a8a-b48e-42ae-adfe-f9f12e36a685 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:14.613411 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-56862a8a-b48e-42ae-adfe-f9f12e36a685 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:14.618803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-56862a8a-b48e-42ae-adfe-f9f12e36a685 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:14.622207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-56862a8a-b48e-42ae-adfe-f9f12e36a685 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:14.626525 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-56862a8a-b48e-42ae-adfe-f9f12e36a685 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:14.628149 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-56862a8a-b48e-42ae-adfe-f9f12e36a685 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:14.970457 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-56862a8a-b48e-42ae-adfe-f9f12e36a685 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:14.974545 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:14.983162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-56862a8a-b48e-42ae-adfe-f9f12e36a685 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:14.998394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-56862a8a-b48e-42ae-adfe-f9f12e36a685 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:15.021159 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-56862a8a-b48e-42ae-adfe-f9f12e36a685 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1546 microversion: 2.91 time: 0.433713 Oct 05 02:45:15.024516 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1915/3854] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:45:14 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1546 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:45:15.197956 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-32c70392-f23c-4919-88e4-fc4ad9c8c5c4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:15.211250 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-32c70392-f23c-4919-88e4-fc4ad9c8c5c4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.735325 Oct 05 02:45:15.213029 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1940/3855] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:14 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:15.239220 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6a5949bd-9ea3-4fa0-93db-48e765d202f6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:45:15.243303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6a5949bd-9ea3-4fa0-93db-48e765d202f6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:15.276499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a5949bd-9ea3-4fa0-93db-48e765d202f6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:15.277307 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a5949bd-9ea3-4fa0-93db-48e765d202f6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:15.278878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a5949bd-9ea3-4fa0-93db-48e765d202f6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:15.281086 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a5949bd-9ea3-4fa0-93db-48e765d202f6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:15.282192 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a5949bd-9ea3-4fa0-93db-48e765d202f6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:15.282814 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a5949bd-9ea3-4fa0-93db-48e765d202f6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:15.611236 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6a5949bd-9ea3-4fa0-93db-48e765d202f6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action" status: 202 len: 0 microversion: 2.1 time: 0.374381 Oct 05 02:45:15.632894 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1916/3856] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:45:15 2022] POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:45:15.636822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5c122698-d772-4df3-87cd-0950f34fd15f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:15.637970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5c122698-d772-4df3-87cd-0950f34fd15f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:15.660632 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c122698-d772-4df3-87cd-0950f34fd15f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:15.664815 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c122698-d772-4df3-87cd-0950f34fd15f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:15.668212 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c122698-d772-4df3-87cd-0950f34fd15f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:15.669885 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c122698-d772-4df3-87cd-0950f34fd15f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:15.670526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c122698-d772-4df3-87cd-0950f34fd15f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:15.673237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c122698-d772-4df3-87cd-0950f34fd15f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:16.057430 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4a1034a5-af41-4e15-8cf6-7fbfc34abffd tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:16.058586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4a1034a5-af41-4e15-8cf6-7fbfc34abffd tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:16.074411 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a1034a5-af41-4e15-8cf6-7fbfc34abffd tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:16.080122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a1034a5-af41-4e15-8cf6-7fbfc34abffd tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:16.082134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a1034a5-af41-4e15-8cf6-7fbfc34abffd tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:16.085371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a1034a5-af41-4e15-8cf6-7fbfc34abffd tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:16.087868 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a1034a5-af41-4e15-8cf6-7fbfc34abffd tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:16.090723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a1034a5-af41-4e15-8cf6-7fbfc34abffd tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:16.718992 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5c122698-d772-4df3-87cd-0950f34fd15f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:16.739554 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5c122698-d772-4df3-87cd-0950f34fd15f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1671 microversion: 2.1 time: 1.106594 Oct 05 02:45:16.750036 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1941/3857] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:15 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1671 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:45:16.867877 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4a1034a5-af41-4e15-8cf6-7fbfc34abffd tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:16.910314 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4a1034a5-af41-4e15-8cf6-7fbfc34abffd tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:16.914988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4a1034a5-af41-4e15-8cf6-7fbfc34abffd tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:16.940243 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4a1034a5-af41-4e15-8cf6-7fbfc34abffd tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1546 microversion: 2.91 time: 0.884253 Oct 05 02:45:16.965092 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1917/3858] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:45:16 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1546 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:45:17.775870 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c3ac9595-d878-4976-aca5-4600c4998bb6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:17.777212 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c3ac9595-d878-4976-aca5-4600c4998bb6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:17.787526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3ac9595-d878-4976-aca5-4600c4998bb6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:17.797800 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3ac9595-d878-4976-aca5-4600c4998bb6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:17.798555 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3ac9595-d878-4976-aca5-4600c4998bb6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:17.805080 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3ac9595-d878-4976-aca5-4600c4998bb6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:17.805813 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3ac9595-d878-4976-aca5-4600c4998bb6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:17.806614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3ac9595-d878-4976-aca5-4600c4998bb6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:18.000821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e9abdee2-ac1c-4b31-9989-a6025d37893b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:18.002857 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e9abdee2-ac1c-4b31-9989-a6025d37893b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:18.050610 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e9abdee2-ac1c-4b31-9989-a6025d37893b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:18.056108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e9abdee2-ac1c-4b31-9989-a6025d37893b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:18.058716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e9abdee2-ac1c-4b31-9989-a6025d37893b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:18.061341 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e9abdee2-ac1c-4b31-9989-a6025d37893b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:18.065973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e9abdee2-ac1c-4b31-9989-a6025d37893b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:18.067587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e9abdee2-ac1c-4b31-9989-a6025d37893b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:18.616563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e9abdee2-ac1c-4b31-9989-a6025d37893b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:18.630179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e9abdee2-ac1c-4b31-9989-a6025d37893b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:18.631631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e9abdee2-ac1c-4b31-9989-a6025d37893b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:18.655067 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e9abdee2-ac1c-4b31-9989-a6025d37893b tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1546 microversion: 2.91 time: 0.678156 Oct 05 02:45:18.668612 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1918/3859] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:45:17 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1546 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:45:18.881332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c3ac9595-d878-4976-aca5-4600c4998bb6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:18.903938 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c3ac9595-d878-4976-aca5-4600c4998bb6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1671 microversion: 2.1 time: 1.117863 Oct 05 02:45:18.905247 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1942/3860] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:17 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1671 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:45:19.711323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f43a575f-a207-40c4-a16a-df3c98bd6323 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:19.712070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f43a575f-a207-40c4-a16a-df3c98bd6323 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:19.725207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f43a575f-a207-40c4-a16a-df3c98bd6323 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:19.725207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f43a575f-a207-40c4-a16a-df3c98bd6323 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:19.725207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f43a575f-a207-40c4-a16a-df3c98bd6323 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:19.731462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f43a575f-a207-40c4-a16a-df3c98bd6323 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:19.732189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f43a575f-a207-40c4-a16a-df3c98bd6323 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:19.732927 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f43a575f-a207-40c4-a16a-df3c98bd6323 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:19.929589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7b609412-5750-465c-aa9c-dfe7b0748e28 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:19.930997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7b609412-5750-465c-aa9c-dfe7b0748e28 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:19.947387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7b609412-5750-465c-aa9c-dfe7b0748e28 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:19.959147 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7b609412-5750-465c-aa9c-dfe7b0748e28 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:19.959863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7b609412-5750-465c-aa9c-dfe7b0748e28 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:19.961559 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7b609412-5750-465c-aa9c-dfe7b0748e28 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:19.969746 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7b609412-5750-465c-aa9c-dfe7b0748e28 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:19.971806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7b609412-5750-465c-aa9c-dfe7b0748e28 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:20.237779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f43a575f-a207-40c4-a16a-df3c98bd6323 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:20.251800 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f43a575f-a207-40c4-a16a-df3c98bd6323 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:20.259558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f43a575f-a207-40c4-a16a-df3c98bd6323 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:20.272215 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f43a575f-a207-40c4-a16a-df3c98bd6323 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1546 microversion: 2.91 time: 0.564944 Oct 05 02:45:20.275592 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1919/3861] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:45:19 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1546 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:45:20.767355 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7b609412-5750-465c-aa9c-dfe7b0748e28 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:20.782141 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7b609412-5750-465c-aa9c-dfe7b0748e28 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.856670 Oct 05 02:45:20.786925 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1943/3862] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:19 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:20.814632 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-55fac550-7351-41f8-b419-0495ec493660 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:45:20.820003 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-55fac550-7351-41f8-b419-0495ec493660 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:20.848618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55fac550-7351-41f8-b419-0495ec493660 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:20.856041 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55fac550-7351-41f8-b419-0495ec493660 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:20.861115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55fac550-7351-41f8-b419-0495ec493660 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:20.862284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55fac550-7351-41f8-b419-0495ec493660 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:20.870054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55fac550-7351-41f8-b419-0495ec493660 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:20.877774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55fac550-7351-41f8-b419-0495ec493660 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:20.966247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-455afa7d-02e9-4659-b202-642238a4d21c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1312701549", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "fe740311-a76a-438e-a2c2-3036d93972fd"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:45:21.053209 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-55fac550-7351-41f8-b419-0495ec493660 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action" status: 200 len: 323 microversion: 2.1 time: 0.242738 Oct 05 02:45:21.054678 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1944/3863] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:45:20 2022] POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action => generated 323 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:45:21.068694 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-58e1f9ae-260e-437e-9c87-89abfa67941c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:21.071053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-58e1f9ae-260e-437e-9c87-89abfa67941c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:21.095773 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58e1f9ae-260e-437e-9c87-89abfa67941c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:21.098013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58e1f9ae-260e-437e-9c87-89abfa67941c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:21.099295 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58e1f9ae-260e-437e-9c87-89abfa67941c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:21.103221 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58e1f9ae-260e-437e-9c87-89abfa67941c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:21.110813 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58e1f9ae-260e-437e-9c87-89abfa67941c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:21.113419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58e1f9ae-260e-437e-9c87-89abfa67941c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:21.136477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-455afa7d-02e9-4659-b202-642238a4d21c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] validate_networks() for [('fe740311-a76a-438e-a2c2-3036d93972fd', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:45:22.475605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-58e1f9ae-260e-437e-9c87-89abfa67941c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:22.498084 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-58e1f9ae-260e-437e-9c87-89abfa67941c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 1.436572 Oct 05 02:45:22.503320 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1945/3864] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:21 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:45:22.525423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d6a2c395-0ca4-4d07-bc59-66880d20db43 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:22.529706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d6a2c395-0ca4-4d07-bc59-66880d20db43 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:22.536080 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=69 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:22.559680 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d6a2c395-0ca4-4d07-bc59-66880d20db43 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:22.560514 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d6a2c395-0ca4-4d07-bc59-66880d20db43 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:22.562520 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d6a2c395-0ca4-4d07-bc59-66880d20db43 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:22.571944 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d6a2c395-0ca4-4d07-bc59-66880d20db43 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:22.574096 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d6a2c395-0ca4-4d07-bc59-66880d20db43 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:22.575295 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d6a2c395-0ca4-4d07-bc59-66880d20db43 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:23.141543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d6a2c395-0ca4-4d07-bc59-66880d20db43 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:23.161471 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d6a2c395-0ca4-4d07-bc59-66880d20db43 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:23.175079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d6a2c395-0ca4-4d07-bc59-66880d20db43 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:23.198590 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d6a2c395-0ca4-4d07-bc59-66880d20db43 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1546 microversion: 2.91 time: 0.693983 Oct 05 02:45:23.199318 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1946/3865] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:45:22 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1546 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:45:23.223892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-08d7b105-ffda-4322-b695-da37fff71424 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:23.229838 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-08d7b105-ffda-4322-b695-da37fff71424 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:23.263863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08d7b105-ffda-4322-b695-da37fff71424 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:23.264776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08d7b105-ffda-4322-b695-da37fff71424 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:23.274375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08d7b105-ffda-4322-b695-da37fff71424 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:23.275269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08d7b105-ffda-4322-b695-da37fff71424 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:23.275965 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08d7b105-ffda-4322-b695-da37fff71424 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:23.276523 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08d7b105-ffda-4322-b695-da37fff71424 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:24.429314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-08d7b105-ffda-4322-b695-da37fff71424 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:24.449270 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-08d7b105-ffda-4322-b695-da37fff71424 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 1.247120 Oct 05 02:45:24.454143 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1947/3866] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:23 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:24.477375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-501e4eea-a2eb-4684-a5f6-f195ecb9ac44 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:24.478362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-501e4eea-a2eb-4684-a5f6-f195ecb9ac44 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:24.522186 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-501e4eea-a2eb-4684-a5f6-f195ecb9ac44 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:24.528514 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-501e4eea-a2eb-4684-a5f6-f195ecb9ac44 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:24.531723 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-501e4eea-a2eb-4684-a5f6-f195ecb9ac44 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:24.532730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-501e4eea-a2eb-4684-a5f6-f195ecb9ac44 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:24.533338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-501e4eea-a2eb-4684-a5f6-f195ecb9ac44 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:24.533823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-455afa7d-02e9-4659-b202-642238a4d21c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:45:24.535189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-455afa7d-02e9-4659-b202-642238a4d21c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:45:24.535608 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-501e4eea-a2eb-4684-a5f6-f195ecb9ac44 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:24.536389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-455afa7d-02e9-4659-b202-642238a4d21c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:45:24.538499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-455afa7d-02e9-4659-b202-642238a4d21c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:45:24.540563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-455afa7d-02e9-4659-b202-642238a4d21c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:45:24.557809 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=89 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:24.592072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-455afa7d-02e9-4659-b202-642238a4d21c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:24.595615 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-455afa7d-02e9-4659-b202-642238a4d21c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:24.599640 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-455afa7d-02e9-4659-b202-642238a4d21c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:24.601847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-455afa7d-02e9-4659-b202-642238a4d21c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:24.604053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-455afa7d-02e9-4659-b202-642238a4d21c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:24.609036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-455afa7d-02e9-4659-b202-642238a4d21c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:24.671620 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-455afa7d-02e9-4659-b202-642238a4d21c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Getting quotas for project 1ae15e13c1ae4b2db5de94fbd428867d. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:45:24.678725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-455afa7d-02e9-4659-b202-642238a4d21c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Getting quotas for user c14d2fac851e4bbaaa760b5c3406a335 and project 1ae15e13c1ae4b2db5de94fbd428867d. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:45:24.706025 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-455afa7d-02e9-4659-b202-642238a4d21c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:45:24.717284 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-455afa7d-02e9-4659-b202-642238a4d21c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: c2d68022-2fa3-4464-8004-262c23e41ea2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:45:24.884450 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-455afa7d-02e9-4659-b202-642238a4d21c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.605980 Oct 05 02:45:24.885133 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1920/3867] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:45:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 4607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:45:24.903412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dd471588-1c67-49c3-9abc-0ab217a1aad7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:24.908955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-dd471588-1c67-49c3-9abc-0ab217a1aad7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:24.927273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dd471588-1c67-49c3-9abc-0ab217a1aad7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:24.930489 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dd471588-1c67-49c3-9abc-0ab217a1aad7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:24.932006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dd471588-1c67-49c3-9abc-0ab217a1aad7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:24.934533 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dd471588-1c67-49c3-9abc-0ab217a1aad7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:24.939331 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dd471588-1c67-49c3-9abc-0ab217a1aad7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:24.940121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dd471588-1c67-49c3-9abc-0ab217a1aad7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:26.033001 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-501e4eea-a2eb-4684-a5f6-f195ecb9ac44 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:26.057521 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-501e4eea-a2eb-4684-a5f6-f195ecb9ac44 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:26.059346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-501e4eea-a2eb-4684-a5f6-f195ecb9ac44 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:26.090290 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-501e4eea-a2eb-4684-a5f6-f195ecb9ac44 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1546 microversion: 2.91 time: 1.630118 Oct 05 02:45:26.093803 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1948/3868] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:45:24 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1546 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:45:26.105447 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b7d48815-6e14-429f-abef-3cd2e03181dc tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:26.107633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b7d48815-6e14-429f-abef-3cd2e03181dc tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: c2d68022-2fa3-4464-8004-262c23e41ea2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:26.286085 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b7d48815-6e14-429f-abef-3cd2e03181dc tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14d2fac851e4bbaaa760b5c3406a335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae15e13c1ae4b2db5de94fbd428867d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:26.293733 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b7d48815-6e14-429f-abef-3cd2e03181dc tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2" status: 200 len: 1224 microversion: 2.1 time: 0.198564 Oct 05 02:45:26.299797 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1949/3869] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:26 2022] GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2 => generated 1224 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:26.362558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-dd471588-1c67-49c3-9abc-0ab217a1aad7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:26.375576 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-dd471588-1c67-49c3-9abc-0ab217a1aad7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 1.483972 Oct 05 02:45:26.376175 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1921/3870] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:24 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:26.411606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a636fd3e-5ec4-4f78-ba77-d60934a95e0c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:26.413606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a636fd3e-5ec4-4f78-ba77-d60934a95e0c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:26.425194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a636fd3e-5ec4-4f78-ba77-d60934a95e0c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:26.425907 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a636fd3e-5ec4-4f78-ba77-d60934a95e0c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:26.426541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a636fd3e-5ec4-4f78-ba77-d60934a95e0c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:26.427454 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a636fd3e-5ec4-4f78-ba77-d60934a95e0c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:26.428278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a636fd3e-5ec4-4f78-ba77-d60934a95e0c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:26.428892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a636fd3e-5ec4-4f78-ba77-d60934a95e0c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:26.824290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a636fd3e-5ec4-4f78-ba77-d60934a95e0c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:26.836757 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a636fd3e-5ec4-4f78-ba77-d60934a95e0c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.432832 Oct 05 02:45:26.838623 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1950/3871] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:26 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:26.982901 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b0c1b112-9668-4af4-8f1a-477cfebd6361 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-763737706", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "3c7ecbb9-3319-48a3-8bf2-f42adcddf7f9"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:45:27.054003 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-b0c1b112-9668-4af4-8f1a-477cfebd6361 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] validate_networks() for [('3c7ecbb9-3319-48a3-8bf2-f42adcddf7f9', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:45:27.129911 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-693a8e52-13a4-4c32-96ba-2c339fef2b93 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:27.130704 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-693a8e52-13a4-4c32-96ba-2c339fef2b93 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:27.138554 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-693a8e52-13a4-4c32-96ba-2c339fef2b93 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:27.140708 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-693a8e52-13a4-4c32-96ba-2c339fef2b93 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:27.141691 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-693a8e52-13a4-4c32-96ba-2c339fef2b93 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:27.142703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-693a8e52-13a4-4c32-96ba-2c339fef2b93 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:27.143334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-693a8e52-13a4-4c32-96ba-2c339fef2b93 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:27.143945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-693a8e52-13a4-4c32-96ba-2c339fef2b93 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:27.337675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-693a8e52-13a4-4c32-96ba-2c339fef2b93 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:27.350368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-693a8e52-13a4-4c32-96ba-2c339fef2b93 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:27.351231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-693a8e52-13a4-4c32-96ba-2c339fef2b93 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:27.357181 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-693a8e52-13a4-4c32-96ba-2c339fef2b93 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1546 microversion: 2.91 time: 0.233404 Oct 05 02:45:27.372675 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1951/3872] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:45:27 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1546 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:45:27.372675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-42e05315-b798-4910-9e2e-780611ad37f0 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:27.372675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-42e05315-b798-4910-9e2e-780611ad37f0 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: c2d68022-2fa3-4464-8004-262c23e41ea2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:27.379808 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42e05315-b798-4910-9e2e-780611ad37f0 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:27.380607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42e05315-b798-4910-9e2e-780611ad37f0 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:27.381409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42e05315-b798-4910-9e2e-780611ad37f0 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:27.382686 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42e05315-b798-4910-9e2e-780611ad37f0 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:27.383066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42e05315-b798-4910-9e2e-780611ad37f0 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:27.383496 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42e05315-b798-4910-9e2e-780611ad37f0 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:27.626840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-42e05315-b798-4910-9e2e-780611ad37f0 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14d2fac851e4bbaaa760b5c3406a335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae15e13c1ae4b2db5de94fbd428867d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:27.640680 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-42e05315-b798-4910-9e2e-780611ad37f0 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2" status: 200 len: 1228 microversion: 2.1 time: 0.275406 Oct 05 02:45:27.641170 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1952/3873] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:27 2022] GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2 => generated 1228 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:28.365053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-b0c1b112-9668-4af4-8f1a-477cfebd6361 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:45:28.366228 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-b0c1b112-9668-4af4-8f1a-477cfebd6361 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:45:28.368841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-b0c1b112-9668-4af4-8f1a-477cfebd6361 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:45:28.370129 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-b0c1b112-9668-4af4-8f1a-477cfebd6361 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:45:28.370847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-b0c1b112-9668-4af4-8f1a-477cfebd6361 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:45:28.387764 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cbc717b5-b3df-45f3-9e39-21f3c8c08c2a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:28.389344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cbc717b5-b3df-45f3-9e39-21f3c8c08c2a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:28.397237 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0c1b112-9668-4af4-8f1a-477cfebd6361 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:28.400338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbc717b5-b3df-45f3-9e39-21f3c8c08c2a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:28.401034 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbc717b5-b3df-45f3-9e39-21f3c8c08c2a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:28.401642 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbc717b5-b3df-45f3-9e39-21f3c8c08c2a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:28.404122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0c1b112-9668-4af4-8f1a-477cfebd6361 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:28.404585 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0c1b112-9668-4af4-8f1a-477cfebd6361 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:28.405329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbc717b5-b3df-45f3-9e39-21f3c8c08c2a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:28.405973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbc717b5-b3df-45f3-9e39-21f3c8c08c2a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:28.406600 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbc717b5-b3df-45f3-9e39-21f3c8c08c2a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:28.409834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0c1b112-9668-4af4-8f1a-477cfebd6361 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:28.410341 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0c1b112-9668-4af4-8f1a-477cfebd6361 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:28.410792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0c1b112-9668-4af4-8f1a-477cfebd6361 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:28.477104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-b0c1b112-9668-4af4-8f1a-477cfebd6361 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Getting quotas for project 1ff63adf9571439d8f8bf9b0fa6c63f9. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:45:28.491139 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-b0c1b112-9668-4af4-8f1a-477cfebd6361 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Getting quotas for user 728544ca5e164540b3c5395534542955 and project 1ff63adf9571439d8f8bf9b0fa6c63f9. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:45:28.528269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b0c1b112-9668-4af4-8f1a-477cfebd6361 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:45:28.529555 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cbc717b5-b3df-45f3-9e39-21f3c8c08c2a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:28.534602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b0c1b112-9668-4af4-8f1a-477cfebd6361 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:45:28.548352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cbc717b5-b3df-45f3-9e39-21f3c8c08c2a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:28.552594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cbc717b5-b3df-45f3-9e39-21f3c8c08c2a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:28.565298 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cbc717b5-b3df-45f3-9e39-21f3c8c08c2a tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1546 microversion: 2.91 time: 0.181326 Oct 05 02:45:28.594906 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1953/3874] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:45:28 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1546 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:45:28.661178 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b0c1b112-9668-4af4-8f1a-477cfebd6361 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.682115 Oct 05 02:45:28.672686 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5727d24e-65ce-425a-ad37-7f51947d95b7 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:28.673302 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5727d24e-65ce-425a-ad37-7f51947d95b7 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: c2d68022-2fa3-4464-8004-262c23e41ea2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:28.673741 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1922/3875] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:45:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:45:28.680285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5727d24e-65ce-425a-ad37-7f51947d95b7 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:28.680779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5727d24e-65ce-425a-ad37-7f51947d95b7 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:28.681253 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5727d24e-65ce-425a-ad37-7f51947d95b7 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:28.681953 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5727d24e-65ce-425a-ad37-7f51947d95b7 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:28.682416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5727d24e-65ce-425a-ad37-7f51947d95b7 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:28.682842 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5727d24e-65ce-425a-ad37-7f51947d95b7 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:28.707111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5cc43fce-433f-45ed-9a71-05fa029f4aa4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:28.709050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5cc43fce-433f-45ed-9a71-05fa029f4aa4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:28.931699 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5727d24e-65ce-425a-ad37-7f51947d95b7 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14d2fac851e4bbaaa760b5c3406a335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae15e13c1ae4b2db5de94fbd428867d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:28.943874 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5727d24e-65ce-425a-ad37-7f51947d95b7 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2" status: 200 len: 1276 microversion: 2.1 time: 0.284022 Oct 05 02:45:28.949641 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1954/3876] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:28 2022] GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2 => generated 1276 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:45:28.987546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5cc43fce-433f-45ed-9a71-05fa029f4aa4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:28.997745 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5cc43fce-433f-45ed-9a71-05fa029f4aa4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc" status: 200 len: 1214 microversion: 2.1 time: 0.296741 Oct 05 02:45:28.998349 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1923/3877] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:28 2022] GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc => generated 1214 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:29.600626 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-08bdbef8-f788-4802-9210-1ac1928b41ab tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:29.601938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-08bdbef8-f788-4802-9210-1ac1928b41ab tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:29.615511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08bdbef8-f788-4802-9210-1ac1928b41ab tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:29.616961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08bdbef8-f788-4802-9210-1ac1928b41ab tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:29.617643 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08bdbef8-f788-4802-9210-1ac1928b41ab tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:29.618592 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08bdbef8-f788-4802-9210-1ac1928b41ab tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:29.619264 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08bdbef8-f788-4802-9210-1ac1928b41ab tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:29.620175 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08bdbef8-f788-4802-9210-1ac1928b41ab tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:29.979328 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-08bdbef8-f788-4802-9210-1ac1928b41ab tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:29.981897 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-186ed9cd-0b9e-44fd-aaff-ca7c252a5bbd tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:29.982502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-186ed9cd-0b9e-44fd-aaff-ca7c252a5bbd tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: c2d68022-2fa3-4464-8004-262c23e41ea2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:29.997376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-08bdbef8-f788-4802-9210-1ac1928b41ab tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:29.999811 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-08bdbef8-f788-4802-9210-1ac1928b41ab tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:30.008541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-186ed9cd-0b9e-44fd-aaff-ca7c252a5bbd tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:30.011252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-186ed9cd-0b9e-44fd-aaff-ca7c252a5bbd tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:30.016540 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-186ed9cd-0b9e-44fd-aaff-ca7c252a5bbd tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:30.017473 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-186ed9cd-0b9e-44fd-aaff-ca7c252a5bbd tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:30.017971 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-186ed9cd-0b9e-44fd-aaff-ca7c252a5bbd tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:30.018416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-186ed9cd-0b9e-44fd-aaff-ca7c252a5bbd tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:30.028493 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-08bdbef8-f788-4802-9210-1ac1928b41ab tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1546 microversion: 2.91 time: 0.434471 Oct 05 02:45:30.036797 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1955/3878] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:45:29 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1546 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:45:30.060756 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-19ce33f9-42e0-4981-a64a-311aa14e9ddb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:30.062492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-19ce33f9-42e0-4981-a64a-311aa14e9ddb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:30.095536 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19ce33f9-42e0-4981-a64a-311aa14e9ddb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:30.096272 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19ce33f9-42e0-4981-a64a-311aa14e9ddb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:30.096950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19ce33f9-42e0-4981-a64a-311aa14e9ddb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:30.097912 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19ce33f9-42e0-4981-a64a-311aa14e9ddb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:30.101748 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19ce33f9-42e0-4981-a64a-311aa14e9ddb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:30.102502 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19ce33f9-42e0-4981-a64a-311aa14e9ddb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:30.297475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-19ce33f9-42e0-4981-a64a-311aa14e9ddb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:30.298873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-186ed9cd-0b9e-44fd-aaff-ca7c252a5bbd tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14d2fac851e4bbaaa760b5c3406a335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae15e13c1ae4b2db5de94fbd428867d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:30.312313 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:30.312572 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-186ed9cd-0b9e-44fd-aaff-ca7c252a5bbd tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2" status: 200 len: 1276 microversion: 2.1 time: 0.333643 Oct 05 02:45:30.313800 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1924/3879] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:29 2022] GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2 => generated 1276 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:30.330641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-59773478-5a78-45d1-a780-aed0deb798fc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:30.331478 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-59773478-5a78-45d1-a780-aed0deb798fc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7517582f-12a1-4f22-bfb9-0690938cafd0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:30.345512 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-59773478-5a78-45d1-a780-aed0deb798fc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:30.346036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-59773478-5a78-45d1-a780-aed0deb798fc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:30.346497 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-59773478-5a78-45d1-a780-aed0deb798fc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:30.347485 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-19ce33f9-42e0-4981-a64a-311aa14e9ddb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc" status: 200 len: 1218 microversion: 2.1 time: 0.305910 Oct 05 02:45:30.348158 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1956/3880] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:30 2022] GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc => generated 1218 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:30.357830 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-59773478-5a78-45d1-a780-aed0deb798fc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:30.358391 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-59773478-5a78-45d1-a780-aed0deb798fc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:30.358840 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-59773478-5a78-45d1-a780-aed0deb798fc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:30.432623 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-59773478-5a78-45d1-a780-aed0deb798fc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7517582f-12a1-4f22-bfb9-0690938cafd0] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:45:30.818446 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-59773478-5a78-45d1-a780-aed0deb798fc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0" status: 204 len: 0 microversion: 2.1 time: 0.501672 Oct 05 02:45:30.822544 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1925/3881] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:45:30 2022] DELETE /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:45:30.829446 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4f9ec02e-73e5-4946-a84f-7b859b09e5c2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:30.830736 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4f9ec02e-73e5-4946-a84f-7b859b09e5c2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7517582f-12a1-4f22-bfb9-0690938cafd0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:30.839804 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f9ec02e-73e5-4946-a84f-7b859b09e5c2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:30.852791 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f9ec02e-73e5-4946-a84f-7b859b09e5c2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:30.857206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f9ec02e-73e5-4946-a84f-7b859b09e5c2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:30.858316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f9ec02e-73e5-4946-a84f-7b859b09e5c2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:30.861291 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f9ec02e-73e5-4946-a84f-7b859b09e5c2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:30.861904 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f9ec02e-73e5-4946-a84f-7b859b09e5c2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:31.063952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-49416263-20b7-4ba2-88c8-5cbcf5590904 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:31.064864 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-49416263-20b7-4ba2-88c8-5cbcf5590904 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:31.079771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-49416263-20b7-4ba2-88c8-5cbcf5590904 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:31.085139 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-49416263-20b7-4ba2-88c8-5cbcf5590904 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:31.085671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-49416263-20b7-4ba2-88c8-5cbcf5590904 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:31.086630 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-49416263-20b7-4ba2-88c8-5cbcf5590904 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:31.088621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-49416263-20b7-4ba2-88c8-5cbcf5590904 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:31.094123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-49416263-20b7-4ba2-88c8-5cbcf5590904 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:31.196243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-49416263-20b7-4ba2-88c8-5cbcf5590904 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:31.211380 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-49416263-20b7-4ba2-88c8-5cbcf5590904 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:31.217062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4f9ec02e-73e5-4946-a84f-7b859b09e5c2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:31.217413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-49416263-20b7-4ba2-88c8-5cbcf5590904 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:31.232834 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4f9ec02e-73e5-4946-a84f-7b859b09e5c2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0" status: 200 len: 1554 microversion: 2.1 time: 0.407435 Oct 05 02:45:31.236474 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1957/3882] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:30 2022] GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0 => generated 1554 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:31.238366 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-49416263-20b7-4ba2-88c8-5cbcf5590904 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1546 microversion: 2.91 time: 0.178261 Oct 05 02:45:31.239013 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1926/3883] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:45:31 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1546 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:45:31.340222 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-43629238-9d08-45ea-b15a-572fe19e304c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:31.340891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-43629238-9d08-45ea-b15a-572fe19e304c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: c2d68022-2fa3-4464-8004-262c23e41ea2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:31.371445 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-43629238-9d08-45ea-b15a-572fe19e304c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:31.371971 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-43629238-9d08-45ea-b15a-572fe19e304c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:31.373637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-620e995d-4c82-4c63-93fc-337138186ebd tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:31.374656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-620e995d-4c82-4c63-93fc-337138186ebd tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:31.375742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-43629238-9d08-45ea-b15a-572fe19e304c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:31.379833 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-43629238-9d08-45ea-b15a-572fe19e304c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:31.381043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-43629238-9d08-45ea-b15a-572fe19e304c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:31.384428 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-43629238-9d08-45ea-b15a-572fe19e304c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:31.385689 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-620e995d-4c82-4c63-93fc-337138186ebd tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:31.386186 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-620e995d-4c82-4c63-93fc-337138186ebd tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:31.388058 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-620e995d-4c82-4c63-93fc-337138186ebd tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:31.390798 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-620e995d-4c82-4c63-93fc-337138186ebd tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:31.392941 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-620e995d-4c82-4c63-93fc-337138186ebd tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:31.393545 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-620e995d-4c82-4c63-93fc-337138186ebd tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:31.517874 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-43629238-9d08-45ea-b15a-572fe19e304c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14d2fac851e4bbaaa760b5c3406a335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae15e13c1ae4b2db5de94fbd428867d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:31.528616 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-43629238-9d08-45ea-b15a-572fe19e304c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2" status: 200 len: 1276 microversion: 2.1 time: 0.193606 Oct 05 02:45:31.550497 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1958/3884] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:31 2022] GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2 => generated 1276 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:31.604402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-620e995d-4c82-4c63-93fc-337138186ebd tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:31.616877 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-620e995d-4c82-4c63-93fc-337138186ebd tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc" status: 200 len: 1210 microversion: 2.1 time: 0.244072 Oct 05 02:45:31.635406 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1927/3885] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:31 2022] GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc => generated 1210 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:45:32.265313 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-16eb43a0-d660-421f-9d74-619ac4b2c849 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:32.275808 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ca9e54af-4fbb-4b7c-94a1-6f55ca6e352c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:32.277505 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-16eb43a0-d660-421f-9d74-619ac4b2c849 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7517582f-12a1-4f22-bfb9-0690938cafd0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:32.277950 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ca9e54af-4fbb-4b7c-94a1-6f55ca6e352c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:32.306975 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca9e54af-4fbb-4b7c-94a1-6f55ca6e352c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:32.307483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca9e54af-4fbb-4b7c-94a1-6f55ca6e352c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:32.308036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca9e54af-4fbb-4b7c-94a1-6f55ca6e352c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:32.308641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca9e54af-4fbb-4b7c-94a1-6f55ca6e352c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:32.309133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca9e54af-4fbb-4b7c-94a1-6f55ca6e352c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:32.309570 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca9e54af-4fbb-4b7c-94a1-6f55ca6e352c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:32.310552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16eb43a0-d660-421f-9d74-619ac4b2c849 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:32.311094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16eb43a0-d660-421f-9d74-619ac4b2c849 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:32.314867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16eb43a0-d660-421f-9d74-619ac4b2c849 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:32.315978 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16eb43a0-d660-421f-9d74-619ac4b2c849 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:32.318889 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16eb43a0-d660-421f-9d74-619ac4b2c849 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:32.319342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16eb43a0-d660-421f-9d74-619ac4b2c849 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:32.826523 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ca9e54af-4fbb-4b7c-94a1-6f55ca6e352c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:32.862039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ca9e54af-4fbb-4b7c-94a1-6f55ca6e352c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:32.863530 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ca9e54af-4fbb-4b7c-94a1-6f55ca6e352c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:32.886575 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ca9e54af-4fbb-4b7c-94a1-6f55ca6e352c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1546 microversion: 2.91 time: 0.615925 Oct 05 02:45:32.887097 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1928/3886] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:45:32 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1546 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:45:32.913278 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bf11486a-abce-4c81-873c-f50ce0f6b77e tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:32.916345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bf11486a-abce-4c81-873c-f50ce0f6b77e tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: c2d68022-2fa3-4464-8004-262c23e41ea2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:32.933234 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf11486a-abce-4c81-873c-f50ce0f6b77e tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:32.933736 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf11486a-abce-4c81-873c-f50ce0f6b77e tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:32.934184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf11486a-abce-4c81-873c-f50ce0f6b77e tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:32.934899 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf11486a-abce-4c81-873c-f50ce0f6b77e tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:32.946070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf11486a-abce-4c81-873c-f50ce0f6b77e tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:32.946526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf11486a-abce-4c81-873c-f50ce0f6b77e tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:33.451121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bf11486a-abce-4c81-873c-f50ce0f6b77e tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14d2fac851e4bbaaa760b5c3406a335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae15e13c1ae4b2db5de94fbd428867d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:33.464073 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bf11486a-abce-4c81-873c-f50ce0f6b77e tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2" status: 200 len: 1282 microversion: 2.1 time: 0.564095 Oct 05 02:45:33.464991 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1929/3887] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:32 2022] GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2 => generated 1282 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:33.478392 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e866e6a4-6e2c-4069-a7e3-06c293f7b37c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:33.481982 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e866e6a4-6e2c-4069-a7e3-06c293f7b37c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:33.495387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e866e6a4-6e2c-4069-a7e3-06c293f7b37c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:33.498307 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e866e6a4-6e2c-4069-a7e3-06c293f7b37c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:33.499670 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e866e6a4-6e2c-4069-a7e3-06c293f7b37c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:33.502802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e866e6a4-6e2c-4069-a7e3-06c293f7b37c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:33.503359 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e866e6a4-6e2c-4069-a7e3-06c293f7b37c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:33.504345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e866e6a4-6e2c-4069-a7e3-06c293f7b37c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:33.708188 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e866e6a4-6e2c-4069-a7e3-06c293f7b37c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:33.721101 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e866e6a4-6e2c-4069-a7e3-06c293f7b37c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc" status: 200 len: 1272 microversion: 2.1 time: 0.252196 Oct 05 02:45:33.722290 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1930/3888] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:33 2022] GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc => generated 1272 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:33.734203 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-16eb43a0-d660-421f-9d74-619ac4b2c849 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:33.744147 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-16eb43a0-d660-421f-9d74-619ac4b2c849 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0" status: 200 len: 1554 microversion: 2.1 time: 1.483526 Oct 05 02:45:33.745071 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1959/3889] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:32 2022] GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0 => generated 1554 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:33.924749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f619d153-5a96-4ab6-b6bb-3136a3834dd7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:33.925475 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f619d153-5a96-4ab6-b6bb-3136a3834dd7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:33.932421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f619d153-5a96-4ab6-b6bb-3136a3834dd7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:33.933038 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f619d153-5a96-4ab6-b6bb-3136a3834dd7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:33.933603 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f619d153-5a96-4ab6-b6bb-3136a3834dd7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:33.934663 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f619d153-5a96-4ab6-b6bb-3136a3834dd7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:33.935310 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f619d153-5a96-4ab6-b6bb-3136a3834dd7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:33.935921 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f619d153-5a96-4ab6-b6bb-3136a3834dd7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:34.073940 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f619d153-5a96-4ab6-b6bb-3136a3834dd7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:34.099443 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f619d153-5a96-4ab6-b6bb-3136a3834dd7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:34.106610 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f619d153-5a96-4ab6-b6bb-3136a3834dd7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:34.142362 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f619d153-5a96-4ab6-b6bb-3136a3834dd7 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1546 microversion: 2.91 time: 0.222117 Oct 05 02:45:34.199415 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1931/3890] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:45:33 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1546 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:45:34.491012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-68c3a44a-5f4f-44a3-b2ba-1f0c67e009a7 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:34.492602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-68c3a44a-5f4f-44a3-b2ba-1f0c67e009a7 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: c2d68022-2fa3-4464-8004-262c23e41ea2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:34.507645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68c3a44a-5f4f-44a3-b2ba-1f0c67e009a7 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:34.508534 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68c3a44a-5f4f-44a3-b2ba-1f0c67e009a7 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:34.510696 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68c3a44a-5f4f-44a3-b2ba-1f0c67e009a7 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:34.513118 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68c3a44a-5f4f-44a3-b2ba-1f0c67e009a7 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:34.515942 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68c3a44a-5f4f-44a3-b2ba-1f0c67e009a7 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:34.521175 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68c3a44a-5f4f-44a3-b2ba-1f0c67e009a7 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:34.932622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-86f1bf18-6cef-4386-b13d-0f3975be4319 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-2143439216", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:45:35.037452 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-68c3a44a-5f4f-44a3-b2ba-1f0c67e009a7 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14d2fac851e4bbaaa760b5c3406a335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae15e13c1ae4b2db5de94fbd428867d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:35.055071 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-68c3a44a-5f4f-44a3-b2ba-1f0c67e009a7 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2" status: 200 len: 1324 microversion: 2.1 time: 0.569960 Oct 05 02:45:35.060677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-86f1bf18-6cef-4386-b13d-0f3975be4319 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] validate_networks() for [('17434e34-cbc4-4307-a1a5-1c9d980ad9e1', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:45:35.065553 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1960/3891] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:34 2022] GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2 => generated 1324 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:35.090868 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8bcfaac0-00e8-4241-b41b-616ad1ba158b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:35.091498 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8bcfaac0-00e8-4241-b41b-616ad1ba158b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:35.109798 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8bcfaac0-00e8-4241-b41b-616ad1ba158b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:35.110563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8bcfaac0-00e8-4241-b41b-616ad1ba158b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:35.111169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8bcfaac0-00e8-4241-b41b-616ad1ba158b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:35.112393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8bcfaac0-00e8-4241-b41b-616ad1ba158b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:35.113064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8bcfaac0-00e8-4241-b41b-616ad1ba158b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:35.113806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8bcfaac0-00e8-4241-b41b-616ad1ba158b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:35.321459 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8bcfaac0-00e8-4241-b41b-616ad1ba158b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:35.342212 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8bcfaac0-00e8-4241-b41b-616ad1ba158b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc" status: 200 len: 1272 microversion: 2.1 time: 0.275325 Oct 05 02:45:35.343277 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1961/3892] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:35 2022] GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc => generated 1272 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:35.348853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7eb99c7a-e69e-432f-bb2d-f61e18230d29 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:35.349902 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7eb99c7a-e69e-432f-bb2d-f61e18230d29 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7517582f-12a1-4f22-bfb9-0690938cafd0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:35.366016 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7eb99c7a-e69e-432f-bb2d-f61e18230d29 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:35.371338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7eb99c7a-e69e-432f-bb2d-f61e18230d29 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:35.372228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7eb99c7a-e69e-432f-bb2d-f61e18230d29 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:35.373281 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7eb99c7a-e69e-432f-bb2d-f61e18230d29 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:35.374849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7eb99c7a-e69e-432f-bb2d-f61e18230d29 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:35.375537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7eb99c7a-e69e-432f-bb2d-f61e18230d29 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:35.522678 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7eb99c7a-e69e-432f-bb2d-f61e18230d29 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:35.538626 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7eb99c7a-e69e-432f-bb2d-f61e18230d29 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0" status: 200 len: 1512 microversion: 2.1 time: 0.193986 Oct 05 02:45:35.552928 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1962/3893] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:35 2022] GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0 => generated 1512 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:35.552928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4dad61dc-22f7-4a85-b6a4-acc3154592e6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:35.552928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4dad61dc-22f7-4a85-b6a4-acc3154592e6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:35.583766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4dad61dc-22f7-4a85-b6a4-acc3154592e6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:35.586695 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4dad61dc-22f7-4a85-b6a4-acc3154592e6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:35.587765 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4dad61dc-22f7-4a85-b6a4-acc3154592e6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:35.590284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4dad61dc-22f7-4a85-b6a4-acc3154592e6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:35.591703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4dad61dc-22f7-4a85-b6a4-acc3154592e6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:35.592405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4dad61dc-22f7-4a85-b6a4-acc3154592e6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:35.808707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4dad61dc-22f7-4a85-b6a4-acc3154592e6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:35.823426 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4dad61dc-22f7-4a85-b6a4-acc3154592e6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:35.825230 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4dad61dc-22f7-4a85-b6a4-acc3154592e6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:35.842558 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4dad61dc-22f7-4a85-b6a4-acc3154592e6 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1533 microversion: 2.91 time: 0.301702 Oct 05 02:45:35.843937 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1963/3894] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:45:35 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1533 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:45:35.848825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-6a98ba76-d11f-4225-a9db-fef233c29a70 req-0900ff1e-ea6d-4b75-97ee-2685a650018c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7517582f-12a1-4f22-bfb9-0690938cafd0", "name": "network-vif-deleted", "tag": "8a9340ae-7d83-456a-83fd-039db65d4ab2"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:45:35.868547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-6a98ba76-d11f-4225-a9db-fef233c29a70 req-0900ff1e-ea6d-4b75-97ee-2685a650018c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:35.872215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-6a98ba76-d11f-4225-a9db-fef233c29a70 req-0900ff1e-ea6d-4b75-97ee-2685a650018c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:35.872774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-6a98ba76-d11f-4225-a9db-fef233c29a70 req-0900ff1e-ea6d-4b75-97ee-2685a650018c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:35.892511 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-6a98ba76-d11f-4225-a9db-fef233c29a70 req-0900ff1e-ea6d-4b75-97ee-2685a650018c service nova] Creating event network-vif-deleted:8a9340ae-7d83-456a-83fd-039db65d4ab2 for instance 7517582f-12a1-4f22-bfb9-0690938cafd0 on n-h1-858272-3 Oct 05 02:45:35.914306 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-6a98ba76-d11f-4225-a9db-fef233c29a70 req-0900ff1e-ea6d-4b75-97ee-2685a650018c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068733 Oct 05 02:45:35.916123 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1964/3895] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:45:35.930843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-02902283-51be-4ba7-908f-92b51644c0cf tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:35.931556 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-02902283-51be-4ba7-908f-92b51644c0cf tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:35.950827 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02902283-51be-4ba7-908f-92b51644c0cf tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:35.952098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02902283-51be-4ba7-908f-92b51644c0cf tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:35.952716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02902283-51be-4ba7-908f-92b51644c0cf tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:35.953628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02902283-51be-4ba7-908f-92b51644c0cf tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:35.966366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02902283-51be-4ba7-908f-92b51644c0cf tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:35.966973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02902283-51be-4ba7-908f-92b51644c0cf tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:36.127301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-02902283-51be-4ba7-908f-92b51644c0cf tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] Lazy-loading 'services' on Instance uuid 6787dcfc-b357-49d7-9192-24607b81f2b6 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:45:36.181057 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-02902283-51be-4ba7-908f-92b51644c0cf tempest-UnshelveToHostMultiNodesTest-1589509074 tempest-UnshelveToHostMultiNodesTest-1589509074-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1938 microversion: 2.91 time: 0.262798 Oct 05 02:45:36.182697 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1965/3896] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:45:35 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1938 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:45:36.191385 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0520b6f9-1fae-4625-9140-c1b5f476fa19 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:36.192560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0520b6f9-1fae-4625-9140-c1b5f476fa19 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: c2d68022-2fa3-4464-8004-262c23e41ea2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:36.207347 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0520b6f9-1fae-4625-9140-c1b5f476fa19 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:36.208337 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0520b6f9-1fae-4625-9140-c1b5f476fa19 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:36.209056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0520b6f9-1fae-4625-9140-c1b5f476fa19 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:36.219495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0520b6f9-1fae-4625-9140-c1b5f476fa19 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:36.220763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0520b6f9-1fae-4625-9140-c1b5f476fa19 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:36.221860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0520b6f9-1fae-4625-9140-c1b5f476fa19 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:36.330993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:36.496738 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-86f1bf18-6cef-4386-b13d-0f3975be4319 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:45:36.497750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-86f1bf18-6cef-4386-b13d-0f3975be4319 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:45:36.498378 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-86f1bf18-6cef-4386-b13d-0f3975be4319 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:45:36.499550 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-86f1bf18-6cef-4386-b13d-0f3975be4319 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:45:36.500818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-86f1bf18-6cef-4386-b13d-0f3975be4319 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:45:36.523645 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86f1bf18-6cef-4386-b13d-0f3975be4319 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:36.524407 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86f1bf18-6cef-4386-b13d-0f3975be4319 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:36.525032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86f1bf18-6cef-4386-b13d-0f3975be4319 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:36.525910 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86f1bf18-6cef-4386-b13d-0f3975be4319 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:36.526535 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86f1bf18-6cef-4386-b13d-0f3975be4319 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:36.527126 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86f1bf18-6cef-4386-b13d-0f3975be4319 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:36.549770 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:36.572590 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-86f1bf18-6cef-4386-b13d-0f3975be4319 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Getting quotas for project 14c9c845b4e04fb09dc03de04a799cf3. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:45:36.589280 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-86f1bf18-6cef-4386-b13d-0f3975be4319 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Getting quotas for user 27a14e4e71454d18946512dedba312a0 and project 14c9c845b4e04fb09dc03de04a799cf3. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:45:36.659045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-86f1bf18-6cef-4386-b13d-0f3975be4319 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:45:36.674722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-86f1bf18-6cef-4386-b13d-0f3975be4319 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:45:36.678873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0520b6f9-1fae-4625-9140-c1b5f476fa19 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14d2fac851e4bbaaa760b5c3406a335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae15e13c1ae4b2db5de94fbd428867d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:36.691473 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0520b6f9-1fae-4625-9140-c1b5f476fa19 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2" status: 200 len: 1324 microversion: 2.1 time: 0.507309 Oct 05 02:45:36.692627 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1966/3897] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:36 2022] GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2 => generated 1324 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:36.703686 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-54759143-a439-4de6-b482-b2731920fce3 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:36.710392 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-54759143-a439-4de6-b482-b2731920fce3 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:36.725658 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54759143-a439-4de6-b482-b2731920fce3 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:36.730730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54759143-a439-4de6-b482-b2731920fce3 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:36.731428 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54759143-a439-4de6-b482-b2731920fce3 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:36.733811 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54759143-a439-4de6-b482-b2731920fce3 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:36.737379 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54759143-a439-4de6-b482-b2731920fce3 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:36.739494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54759143-a439-4de6-b482-b2731920fce3 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:36.831284 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-86f1bf18-6cef-4386-b13d-0f3975be4319 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.222641 Oct 05 02:45:36.832391 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1932/3898] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:45:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 2224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 02:45:36.834181 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-54759143-a439-4de6-b482-b2731920fce3 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:45:36.842648 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6e5910bf-f824-47c2-9422-7092803e13cf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:36.850099 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6e5910bf-f824-47c2-9422-7092803e13cf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:36.894446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e5910bf-f824-47c2-9422-7092803e13cf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:36.897256 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e5910bf-f824-47c2-9422-7092803e13cf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:36.897975 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e5910bf-f824-47c2-9422-7092803e13cf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:36.898938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e5910bf-f824-47c2-9422-7092803e13cf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:36.901519 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e5910bf-f824-47c2-9422-7092803e13cf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:36.902947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e5910bf-f824-47c2-9422-7092803e13cf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:37.139346 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-54759143-a439-4de6-b482-b2731920fce3 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 204 len: 0 microversion: 2.91 time: 0.443978 Oct 05 02:45:37.142119 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1967/3899] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 5 02:45:36 2022] DELETE /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 02:45:37.170943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1cbaba70-b13f-4967-b098-a6e850a0ff2d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:37.172213 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1cbaba70-b13f-4967-b098-a6e850a0ff2d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7517582f-12a1-4f22-bfb9-0690938cafd0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:37.190507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1cbaba70-b13f-4967-b098-a6e850a0ff2d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:37.195193 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1cbaba70-b13f-4967-b098-a6e850a0ff2d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:37.200487 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1cbaba70-b13f-4967-b098-a6e850a0ff2d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:37.201739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1cbaba70-b13f-4967-b098-a6e850a0ff2d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:37.203950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1cbaba70-b13f-4967-b098-a6e850a0ff2d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:37.204610 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1cbaba70-b13f-4967-b098-a6e850a0ff2d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:37.730574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6e5910bf-f824-47c2-9422-7092803e13cf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:37.755796 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6e5910bf-f824-47c2-9422-7092803e13cf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc" status: 200 len: 1314 microversion: 2.1 time: 0.922078 Oct 05 02:45:37.756603 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1933/3900] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:36 2022] GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc => generated 1314 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:37.771044 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7ef09e0a-de38-4591-8ca8-b7758f6b2710 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:37.794391 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7ef09e0a-de38-4591-8ca8-b7758f6b2710 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:37.881036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1cbaba70-b13f-4967-b098-a6e850a0ff2d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:37.900392 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1cbaba70-b13f-4967-b098-a6e850a0ff2d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0" status: 200 len: 1346 microversion: 2.1 time: 0.752910 Oct 05 02:45:37.910981 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1968/3901] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:37 2022] GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0 => generated 1346 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:37.926174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-49eaf477-6fa5-47b6-8bf3-962c95c5c821 req-cc213cdd-f679-41ab-aea7-217524b0e651 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2d68022-2fa3-4464-8004-262c23e41ea2", "tag": "baf1bb4d-f79e-4dc4-903a-f0407e6bf5d8"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:45:37.955629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7ef09e0a-de38-4591-8ca8-b7758f6b2710 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:37.965452 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7ef09e0a-de38-4591-8ca8-b7758f6b2710 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59" status: 200 len: 1214 microversion: 2.1 time: 0.206259 Oct 05 02:45:37.966391 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1934/3902] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:37 2022] GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59 => generated 1214 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:37.976388 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-49eaf477-6fa5-47b6-8bf3-962c95c5c821 req-cc213cdd-f679-41ab-aea7-217524b0e651 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:37.977120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-49eaf477-6fa5-47b6-8bf3-962c95c5c821 req-cc213cdd-f679-41ab-aea7-217524b0e651 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:37.979383 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-49eaf477-6fa5-47b6-8bf3-962c95c5c821 req-cc213cdd-f679-41ab-aea7-217524b0e651 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:37.984892 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6305795e-5af5-40eb-a97d-bb75775b2424 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:37.985535 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6305795e-5af5-40eb-a97d-bb75775b2424 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:38.012444 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6305795e-5af5-40eb-a97d-bb75775b2424 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:38.015323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6305795e-5af5-40eb-a97d-bb75775b2424 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:38.016603 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6305795e-5af5-40eb-a97d-bb75775b2424 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:38.019330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6305795e-5af5-40eb-a97d-bb75775b2424 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:38.019986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6305795e-5af5-40eb-a97d-bb75775b2424 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:38.021234 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6305795e-5af5-40eb-a97d-bb75775b2424 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:38.039536 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-49eaf477-6fa5-47b6-8bf3-962c95c5c821 req-cc213cdd-f679-41ab-aea7-217524b0e651 service nova] Creating event network-changed:baf1bb4d-f79e-4dc4-903a-f0407e6bf5d8 for instance c2d68022-2fa3-4464-8004-262c23e41ea2 on n-h2-858272-3 Oct 05 02:45:38.048921 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-49eaf477-6fa5-47b6-8bf3-962c95c5c821 req-cc213cdd-f679-41ab-aea7-217524b0e651 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136221 Oct 05 02:45:38.054504 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1969/3903] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:45:38.064174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e9eb3046-d6c8-4e2f-855a-664a0a7c9987 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:38.065406 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e9eb3046-d6c8-4e2f-855a-664a0a7c9987 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: c2d68022-2fa3-4464-8004-262c23e41ea2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:38.108515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e9eb3046-d6c8-4e2f-855a-664a0a7c9987 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:38.112113 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e9eb3046-d6c8-4e2f-855a-664a0a7c9987 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:38.112773 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e9eb3046-d6c8-4e2f-855a-664a0a7c9987 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:38.114028 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e9eb3046-d6c8-4e2f-855a-664a0a7c9987 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:38.114650 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e9eb3046-d6c8-4e2f-855a-664a0a7c9987 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:38.117623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e9eb3046-d6c8-4e2f-855a-664a0a7c9987 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:38.508322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6305795e-5af5-40eb-a97d-bb75775b2424 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:38.525151 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6305795e-5af5-40eb-a97d-bb75775b2424 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:38.537740 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6305795e-5af5-40eb-a97d-bb75775b2424 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:38.568840 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6305795e-5af5-40eb-a97d-bb75775b2424 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1539 microversion: 2.91 time: 0.598540 Oct 05 02:45:38.575124 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1935/3904] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:45:37 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1539 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:45:38.787017 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6645a350-d23e-4b9d-a789-c79c32e19f52 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:38.788429 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6645a350-d23e-4b9d-a789-c79c32e19f52 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:38.808609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6645a350-d23e-4b9d-a789-c79c32e19f52 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:38.817059 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6645a350-d23e-4b9d-a789-c79c32e19f52 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:38.819749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6645a350-d23e-4b9d-a789-c79c32e19f52 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:38.820628 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6645a350-d23e-4b9d-a789-c79c32e19f52 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:38.824270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6645a350-d23e-4b9d-a789-c79c32e19f52 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:38.825412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6645a350-d23e-4b9d-a789-c79c32e19f52 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:39.784600 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e9eb3046-d6c8-4e2f-855a-664a0a7c9987 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14d2fac851e4bbaaa760b5c3406a335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae15e13c1ae4b2db5de94fbd428867d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:39.796721 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e9eb3046-d6c8-4e2f-855a-664a0a7c9987 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2" status: 200 len: 1324 microversion: 2.1 time: 1.735893 Oct 05 02:45:39.797410 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1970/3905] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:38 2022] GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2 => generated 1324 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:39.804192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ab28d60a-822f-41f0-9088-20915f4679d7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:39.805383 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ab28d60a-822f-41f0-9088-20915f4679d7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7517582f-12a1-4f22-bfb9-0690938cafd0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:39.814611 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ab28d60a-822f-41f0-9088-20915f4679d7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:39.825903 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6645a350-d23e-4b9d-a789-c79c32e19f52 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:39.829571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ab28d60a-822f-41f0-9088-20915f4679d7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:39.832396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ab28d60a-822f-41f0-9088-20915f4679d7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:39.833225 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ab28d60a-822f-41f0-9088-20915f4679d7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:39.833709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ab28d60a-822f-41f0-9088-20915f4679d7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:39.834141 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ab28d60a-822f-41f0-9088-20915f4679d7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:39.835725 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6645a350-d23e-4b9d-a789-c79c32e19f52 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc" status: 200 len: 1314 microversion: 2.1 time: 1.054258 Oct 05 02:45:39.836336 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1936/3906] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:38 2022] GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc => generated 1314 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:45:39.849862 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2c854739-624e-4f7a-b8a9-58fef0ebc5ae tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:39.850594 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2c854739-624e-4f7a-b8a9-58fef0ebc5ae tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:39.868533 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c854739-624e-4f7a-b8a9-58fef0ebc5ae tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:39.869085 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c854739-624e-4f7a-b8a9-58fef0ebc5ae tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:39.869530 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c854739-624e-4f7a-b8a9-58fef0ebc5ae tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:39.870394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c854739-624e-4f7a-b8a9-58fef0ebc5ae tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:39.870856 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c854739-624e-4f7a-b8a9-58fef0ebc5ae tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:39.871284 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c854739-624e-4f7a-b8a9-58fef0ebc5ae tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:40.108487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2c854739-624e-4f7a-b8a9-58fef0ebc5ae tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:40.124159 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2c854739-624e-4f7a-b8a9-58fef0ebc5ae tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59" status: 200 len: 1266 microversion: 2.1 time: 0.282722 Oct 05 02:45:40.126810 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1937/3907] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:39 2022] GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59 => generated 1266 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:40.139075 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-e86b74ed-fa19-4b8b-9e2b-ebba1c25b0bd req-369326ad-5b37-4442-b8b7-2c25783b938e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba5279cc-8f1f-436e-8341-21488398f1dc", "tag": "8ace94b1-dfa5-4957-9902-856931c12b4c"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:45:40.162248 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e86b74ed-fa19-4b8b-9e2b-ebba1c25b0bd req-369326ad-5b37-4442-b8b7-2c25783b938e service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:40.162735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e86b74ed-fa19-4b8b-9e2b-ebba1c25b0bd req-369326ad-5b37-4442-b8b7-2c25783b938e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:40.163165 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e86b74ed-fa19-4b8b-9e2b-ebba1c25b0bd req-369326ad-5b37-4442-b8b7-2c25783b938e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:40.198001 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-e86b74ed-fa19-4b8b-9e2b-ebba1c25b0bd req-369326ad-5b37-4442-b8b7-2c25783b938e service nova] Creating event network-changed:8ace94b1-dfa5-4957-9902-856931c12b4c for instance ba5279cc-8f1f-436e-8341-21488398f1dc on n-h2-858272-3 Oct 05 02:45:40.210166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ab28d60a-822f-41f0-9088-20915f4679d7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:40.236477 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ab28d60a-822f-41f0-9088-20915f4679d7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0" status: 200 len: 1346 microversion: 2.1 time: 0.437566 Oct 05 02:45:40.238718 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1971/3908] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:39 2022] GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0 => generated 1346 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:40.255883 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-e86b74ed-fa19-4b8b-9e2b-ebba1c25b0bd req-369326ad-5b37-4442-b8b7-2c25783b938e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126651 Oct 05 02:45:40.256856 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1938/3909] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:45:40.262382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2a906c2b-d7f9-43ab-a0ea-9ba12966bd45 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:40.266485 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2a906c2b-d7f9-43ab-a0ea-9ba12966bd45 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:40.275539 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2a906c2b-d7f9-43ab-a0ea-9ba12966bd45 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:40.277156 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2a906c2b-d7f9-43ab-a0ea-9ba12966bd45 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:40.278589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2a906c2b-d7f9-43ab-a0ea-9ba12966bd45 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:40.279488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2a906c2b-d7f9-43ab-a0ea-9ba12966bd45 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:40.280661 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2a906c2b-d7f9-43ab-a0ea-9ba12966bd45 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:40.281421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2a906c2b-d7f9-43ab-a0ea-9ba12966bd45 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:40.333341 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2a906c2b-d7f9-43ab-a0ea-9ba12966bd45 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:40.334185 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2a906c2b-d7f9-43ab-a0ea-9ba12966bd45 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:40.334630 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2a906c2b-d7f9-43ab-a0ea-9ba12966bd45 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:40.335253 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-2a906c2b-d7f9-43ab-a0ea-9ba12966bd45 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lazy-loading 'fault' on Instance uuid 6787dcfc-b357-49d7-9192-24607b81f2b6 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:45:40.338650 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:40.422551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2a906c2b-d7f9-43ab-a0ea-9ba12966bd45 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:40.444676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2a906c2b-d7f9-43ab-a0ea-9ba12966bd45 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:40.447408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2a906c2b-d7f9-43ab-a0ea-9ba12966bd45 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:40.464935 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2a906c2b-d7f9-43ab-a0ea-9ba12966bd45 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1544 microversion: 2.91 time: 0.219776 Oct 05 02:45:40.470046 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1972/3910] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:45:40 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1544 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:45:40.832229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d1095af6-4e53-492b-954f-42291f03c168 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:40.833301 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d1095af6-4e53-492b-954f-42291f03c168 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: c2d68022-2fa3-4464-8004-262c23e41ea2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:40.846071 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d1095af6-4e53-492b-954f-42291f03c168 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:40.846722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d1095af6-4e53-492b-954f-42291f03c168 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:40.847688 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d1095af6-4e53-492b-954f-42291f03c168 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:40.848497 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d1095af6-4e53-492b-954f-42291f03c168 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:40.849347 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d1095af6-4e53-492b-954f-42291f03c168 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:40.849876 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d1095af6-4e53-492b-954f-42291f03c168 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:40.865491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-33e325d7-8e25-49b3-99d1-9f4e26f44b45 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:40.866943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-33e325d7-8e25-49b3-99d1-9f4e26f44b45 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:40.883525 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33e325d7-8e25-49b3-99d1-9f4e26f44b45 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:40.884315 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33e325d7-8e25-49b3-99d1-9f4e26f44b45 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:40.886410 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33e325d7-8e25-49b3-99d1-9f4e26f44b45 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:40.892100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33e325d7-8e25-49b3-99d1-9f4e26f44b45 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:40.892939 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33e325d7-8e25-49b3-99d1-9f4e26f44b45 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:40.893611 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33e325d7-8e25-49b3-99d1-9f4e26f44b45 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:41.298393 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d1095af6-4e53-492b-954f-42291f03c168 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14d2fac851e4bbaaa760b5c3406a335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae15e13c1ae4b2db5de94fbd428867d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:41.310122 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d1095af6-4e53-492b-954f-42291f03c168 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2" status: 200 len: 1324 microversion: 2.1 time: 0.489842 Oct 05 02:45:41.314529 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1939/3911] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:40 2022] GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2 => generated 1324 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:41.321998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f6593e15-7afa-48e5-98a6-0f07b013cc1e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:41.328748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f6593e15-7afa-48e5-98a6-0f07b013cc1e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:41.346859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6593e15-7afa-48e5-98a6-0f07b013cc1e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:41.355552 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6593e15-7afa-48e5-98a6-0f07b013cc1e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:41.356710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6593e15-7afa-48e5-98a6-0f07b013cc1e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:41.359715 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6593e15-7afa-48e5-98a6-0f07b013cc1e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:41.361861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6593e15-7afa-48e5-98a6-0f07b013cc1e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:41.363783 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6593e15-7afa-48e5-98a6-0f07b013cc1e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:41.373289 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-33e325d7-8e25-49b3-99d1-9f4e26f44b45 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:41.387139 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-33e325d7-8e25-49b3-99d1-9f4e26f44b45 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc" status: 200 len: 1314 microversion: 2.1 time: 0.527997 Oct 05 02:45:41.403272 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1973/3912] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:40 2022] GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc => generated 1314 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:41.412224 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-66fca728-5332-4895-a37e-d733a7fec066 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:41.413648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-66fca728-5332-4895-a37e-d733a7fec066 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7517582f-12a1-4f22-bfb9-0690938cafd0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:41.426146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-66fca728-5332-4895-a37e-d733a7fec066 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:41.426762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-66fca728-5332-4895-a37e-d733a7fec066 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:41.439717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-66fca728-5332-4895-a37e-d733a7fec066 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:41.441117 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-66fca728-5332-4895-a37e-d733a7fec066 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:41.441889 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-66fca728-5332-4895-a37e-d733a7fec066 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:41.442534 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-66fca728-5332-4895-a37e-d733a7fec066 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:41.562688 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-66fca728-5332-4895-a37e-d733a7fec066 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:41.575212 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-66fca728-5332-4895-a37e-d733a7fec066 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0" status: 200 len: 1346 microversion: 2.1 time: 0.168233 Oct 05 02:45:41.581748 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1974/3913] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:41 2022] GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0 => generated 1346 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:41.600133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8b37057b-6a9d-4af6-9694-a57672432e7c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:41.601353 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8b37057b-6a9d-4af6-9694-a57672432e7c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:41.615931 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b37057b-6a9d-4af6-9694-a57672432e7c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:41.619176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b37057b-6a9d-4af6-9694-a57672432e7c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:41.619875 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b37057b-6a9d-4af6-9694-a57672432e7c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:41.621395 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b37057b-6a9d-4af6-9694-a57672432e7c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:41.622616 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b37057b-6a9d-4af6-9694-a57672432e7c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:41.624522 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b37057b-6a9d-4af6-9694-a57672432e7c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:41.719404 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b37057b-6a9d-4af6-9694-a57672432e7c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:41.720363 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b37057b-6a9d-4af6-9694-a57672432e7c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:41.720764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f6593e15-7afa-48e5-98a6-0f07b013cc1e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:41.721428 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b37057b-6a9d-4af6-9694-a57672432e7c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:41.722104 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-8b37057b-6a9d-4af6-9694-a57672432e7c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lazy-loading 'fault' on Instance uuid 6787dcfc-b357-49d7-9192-24607b81f2b6 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:45:41.732210 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f6593e15-7afa-48e5-98a6-0f07b013cc1e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59" status: 200 len: 1314 microversion: 2.1 time: 0.416172 Oct 05 02:45:41.732814 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1940/3914] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:41 2022] GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59 => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:41.802299 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8b37057b-6a9d-4af6-9694-a57672432e7c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:41.816119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8b37057b-6a9d-4af6-9694-a57672432e7c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:41.817655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8b37057b-6a9d-4af6-9694-a57672432e7c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc626f587b9541ce82f7d52f426b129d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53c0d3a590cd4154999aa75e3009cfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:41.831207 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8b37057b-6a9d-4af6-9694-a57672432e7c tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 200 len: 1544 microversion: 2.91 time: 0.246984 Oct 05 02:45:41.841240 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1975/3915] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:45:41 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 1544 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:45:42.340655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8510a405-ac23-4ddb-a83b-f474a2e2e830 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:42.341213 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8510a405-ac23-4ddb-a83b-f474a2e2e830 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: c2d68022-2fa3-4464-8004-262c23e41ea2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:42.369201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:42.374934 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8510a405-ac23-4ddb-a83b-f474a2e2e830 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:42.376010 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8510a405-ac23-4ddb-a83b-f474a2e2e830 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:42.377582 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8510a405-ac23-4ddb-a83b-f474a2e2e830 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:42.378784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8510a405-ac23-4ddb-a83b-f474a2e2e830 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:42.381243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8510a405-ac23-4ddb-a83b-f474a2e2e830 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:42.382656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8510a405-ac23-4ddb-a83b-f474a2e2e830 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:42.412866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4f2ec538-bf8e-45af-b16a-373cc4fd7fb0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:42.413698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4f2ec538-bf8e-45af-b16a-373cc4fd7fb0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:42.449212 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f2ec538-bf8e-45af-b16a-373cc4fd7fb0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:42.449952 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f2ec538-bf8e-45af-b16a-373cc4fd7fb0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:42.450620 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f2ec538-bf8e-45af-b16a-373cc4fd7fb0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:42.451534 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f2ec538-bf8e-45af-b16a-373cc4fd7fb0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:42.454264 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f2ec538-bf8e-45af-b16a-373cc4fd7fb0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:42.454933 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f2ec538-bf8e-45af-b16a-373cc4fd7fb0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:43.030076 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4f2ec538-bf8e-45af-b16a-373cc4fd7fb0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:43.042138 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4f2ec538-bf8e-45af-b16a-373cc4fd7fb0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc" status: 200 len: 1314 microversion: 2.1 time: 0.632866 Oct 05 02:45:43.063443 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1976/3916] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:42 2022] GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc => generated 1314 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:43.076683 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ed9810cd-704e-4ff4-8971-691360436836 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:43.078416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ed9810cd-704e-4ff4-8971-691360436836 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7517582f-12a1-4f22-bfb9-0690938cafd0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:43.085629 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed9810cd-704e-4ff4-8971-691360436836 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:43.086125 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed9810cd-704e-4ff4-8971-691360436836 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:43.086569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed9810cd-704e-4ff4-8971-691360436836 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:43.087269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed9810cd-704e-4ff4-8971-691360436836 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:43.088188 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed9810cd-704e-4ff4-8971-691360436836 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:43.088711 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed9810cd-704e-4ff4-8971-691360436836 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:43.124210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8510a405-ac23-4ddb-a83b-f474a2e2e830 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14d2fac851e4bbaaa760b5c3406a335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae15e13c1ae4b2db5de94fbd428867d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:43.134929 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8510a405-ac23-4ddb-a83b-f474a2e2e830 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2" status: 200 len: 1324 microversion: 2.1 time: 0.798715 Oct 05 02:45:43.140953 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1941/3917] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:42 2022] GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2 => generated 1324 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:43.159063 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1cb7c9c1-038e-423a-9cb9-a6974cb8439b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:43.163022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1cb7c9c1-038e-423a-9cb9-a6974cb8439b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:43.179413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1cb7c9c1-038e-423a-9cb9-a6974cb8439b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:43.180135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1cb7c9c1-038e-423a-9cb9-a6974cb8439b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:43.182121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1cb7c9c1-038e-423a-9cb9-a6974cb8439b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:43.183157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1cb7c9c1-038e-423a-9cb9-a6974cb8439b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:43.185675 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1cb7c9c1-038e-423a-9cb9-a6974cb8439b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:43.188570 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1cb7c9c1-038e-423a-9cb9-a6974cb8439b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:43.193599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ed9810cd-704e-4ff4-8971-691360436836 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:43.208629 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ed9810cd-704e-4ff4-8971-691360436836 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0" status: 200 len: 1346 microversion: 2.1 time: 0.143106 Oct 05 02:45:43.209794 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1977/3918] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:43 2022] GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0 => generated 1346 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:43.236569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-06908ba3-fca9-4567-adf9-9a2f940ca8e1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:43.237460 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-06908ba3-fca9-4567-adf9-9a2f940ca8e1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] [instance: 6787dcfc-b357-49d7-9192-24607b81f2b6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:43.249790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-06908ba3-fca9-4567-adf9-9a2f940ca8e1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:43.251379 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-06908ba3-fca9-4567-adf9-9a2f940ca8e1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:43.251910 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-06908ba3-fca9-4567-adf9-9a2f940ca8e1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:43.253869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-06908ba3-fca9-4567-adf9-9a2f940ca8e1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:43.254437 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-06908ba3-fca9-4567-adf9-9a2f940ca8e1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:43.255219 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-06908ba3-fca9-4567-adf9-9a2f940ca8e1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:43.280306 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-06908ba3-fca9-4567-adf9-9a2f940ca8e1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] HTTP exception thrown: Instance 6787dcfc-b357-49d7-9192-24607b81f2b6 could not be found. Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-06908ba3-fca9-4567-adf9-9a2f940ca8e1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Request method failure captured: Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 HTTP/1.1 Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO8FIRMt2zgq5PSXtAEd-rgaCuWAe-of2hZJBviW60XVi9u4iBHu1nph9JsOGJzGBsa371IsTCZQ-9MHVlV55Pjw9vjhkC15TAfHqwAnAv6Yz1fZs-H_j1z-kt2632_apipEX6YxHcw9ezPN-5FbD-F0sQ1GtLRuDIP4-FUFEFkZM78 Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: X-Openstack-Nova-Api-Version: 2.91 Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 53c0d3a590cd4154999aa75e3009cfd1 Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1039838793 Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/53c0d3a590cd4154999aa75e3009cfd1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/53c0d3a590cd4154999aa75e3009cfd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/53c0d3a590cd4154999aa75e3009cfd1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_53c0d3a590cd4154999aa75e3009cfd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1039838793 Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 53c0d3a590cd4154999aa75e3009cfd1 Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1039838793 Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-UnshelveToHostMultiNodesTest-1039838793-project Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: cc626f587b9541ce82f7d52f426b129d Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1039838793-project Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 6787dcfc-b357-49d7-9192-24607b81f2b6 could not be found. Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '6787dcfc-b357-49d7-9192-24607b81f2b6'} Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6787dcfc-b357-49d7-9192-24607b81f2b6 could not be found. Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6787dcfc-b357-49d7-9192-24607b81f2b6 could not be found. Oct 05 02:45:43.282386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:45:43.286547 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:45:43.286547 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:45:43.286547 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:45:43.286547 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:45:43.286547 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:45:43.286547 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:45:43.286547 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:45:43.286547 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6787dcfc-b357-49d7-9192-24607b81f2b6 could not be found. Oct 05 02:45:43.286547 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:45:43.286547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-06908ba3-fca9-4567-adf9-9a2f940ca8e1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] Returning 404 to user: Instance 6787dcfc-b357-49d7-9192-24607b81f2b6 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:45:43.286547 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-06908ba3-fca9-4567-adf9-9a2f940ca8e1 tempest-UnshelveToHostMultiNodesTest-1039838793 tempest-UnshelveToHostMultiNodesTest-1039838793-project] 10.222.0.16 "GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6" status: 404 len: 111 microversion: 2.91 time: 0.059509 Oct 05 02:45:43.288862 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1978/3919] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:45:43 2022] GET /compute/v2.1/servers/6787dcfc-b357-49d7-9192-24607b81f2b6 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:45:43.312856 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-f0a175eb-b5ae-4f83-823f-5e793e373a1f req-a751aaac-6265-4942-b7bd-f3e2f183cb10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a75e896f-b5a7-47a8-8376-c447c6645f59", "tag": "d7fbef64-88d7-41be-9f9f-7e6cc11ea6de"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:45:43.341401 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f0a175eb-b5ae-4f83-823f-5e793e373a1f req-a751aaac-6265-4942-b7bd-f3e2f183cb10 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:43.343759 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f0a175eb-b5ae-4f83-823f-5e793e373a1f req-a751aaac-6265-4942-b7bd-f3e2f183cb10 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:43.344200 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f0a175eb-b5ae-4f83-823f-5e793e373a1f req-a751aaac-6265-4942-b7bd-f3e2f183cb10 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:43.380923 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-f0a175eb-b5ae-4f83-823f-5e793e373a1f req-a751aaac-6265-4942-b7bd-f3e2f183cb10 service nova] Creating event network-changed:d7fbef64-88d7-41be-9f9f-7e6cc11ea6de for instance a75e896f-b5a7-47a8-8376-c447c6645f59 on n-h1-858272-3 Oct 05 02:45:43.395686 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-f0a175eb-b5ae-4f83-823f-5e793e373a1f req-a751aaac-6265-4942-b7bd-f3e2f183cb10 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103117 Oct 05 02:45:43.396340 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1979/3920] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:45:43.660978 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1cb7c9c1-038e-423a-9cb9-a6974cb8439b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:43.669050 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1cb7c9c1-038e-423a-9cb9-a6974cb8439b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59" status: 200 len: 1314 microversion: 2.1 time: 0.526722 Oct 05 02:45:43.669631 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1942/3921] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:43 2022] GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59 => generated 1314 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:44.072052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-eee31a73-6a1d-40e5-ad28-781b6e09c08b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:44.073133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-eee31a73-6a1d-40e5-ad28-781b6e09c08b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:44.087235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eee31a73-6a1d-40e5-ad28-781b6e09c08b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:44.088930 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eee31a73-6a1d-40e5-ad28-781b6e09c08b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:44.089874 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eee31a73-6a1d-40e5-ad28-781b6e09c08b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:44.092535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eee31a73-6a1d-40e5-ad28-781b6e09c08b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:44.093359 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eee31a73-6a1d-40e5-ad28-781b6e09c08b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:44.094561 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eee31a73-6a1d-40e5-ad28-781b6e09c08b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:44.161584 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4a483c65-6092-4ee0-aeac-1b19fd3994ab tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:44.162201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4a483c65-6092-4ee0-aeac-1b19fd3994ab tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: c2d68022-2fa3-4464-8004-262c23e41ea2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:44.172036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a483c65-6092-4ee0-aeac-1b19fd3994ab tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:44.172789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a483c65-6092-4ee0-aeac-1b19fd3994ab tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:44.179706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a483c65-6092-4ee0-aeac-1b19fd3994ab tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:44.180780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a483c65-6092-4ee0-aeac-1b19fd3994ab tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:44.181188 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a483c65-6092-4ee0-aeac-1b19fd3994ab tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:44.181610 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a483c65-6092-4ee0-aeac-1b19fd3994ab tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:44.544334 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4a483c65-6092-4ee0-aeac-1b19fd3994ab tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14d2fac851e4bbaaa760b5c3406a335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae15e13c1ae4b2db5de94fbd428867d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:44.554202 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4a483c65-6092-4ee0-aeac-1b19fd3994ab tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2" status: 200 len: 1324 microversion: 2.1 time: 0.396583 Oct 05 02:45:44.554581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-eee31a73-6a1d-40e5-ad28-781b6e09c08b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:44.555435 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1943/3922] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:44 2022] GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2 => generated 1324 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:44.580382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1da66b0b-ea6d-451b-b82b-21b4a7b46e6b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:44.581526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1da66b0b-ea6d-451b-b82b-21b4a7b46e6b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7517582f-12a1-4f22-bfb9-0690938cafd0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:44.582733 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-eee31a73-6a1d-40e5-ad28-781b6e09c08b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc" status: 200 len: 1314 microversion: 2.1 time: 0.516655 Oct 05 02:45:44.583355 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1980/3923] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:44 2022] GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:44.589802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1da66b0b-ea6d-451b-b82b-21b4a7b46e6b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:44.590860 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1da66b0b-ea6d-451b-b82b-21b4a7b46e6b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:44.591373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1da66b0b-ea6d-451b-b82b-21b4a7b46e6b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:44.592156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1da66b0b-ea6d-451b-b82b-21b4a7b46e6b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:44.592751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1da66b0b-ea6d-451b-b82b-21b4a7b46e6b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:44.593283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1da66b0b-ea6d-451b-b82b-21b4a7b46e6b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:44.657571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1da66b0b-ea6d-451b-b82b-21b4a7b46e6b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:44.658352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1da66b0b-ea6d-451b-b82b-21b4a7b46e6b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:44.658856 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1da66b0b-ea6d-451b-b82b-21b4a7b46e6b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:44.659280 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-1da66b0b-ea6d-451b-b82b-21b4a7b46e6b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lazy-loading 'fault' on Instance uuid 7517582f-12a1-4f22-bfb9-0690938cafd0 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:45:44.692527 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-78ec3919-19c5-4cb1-b741-334f28efcba8 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:44.693743 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-78ec3919-19c5-4cb1-b741-334f28efcba8 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:44.697484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:44.716874 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78ec3919-19c5-4cb1-b741-334f28efcba8 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:44.720423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78ec3919-19c5-4cb1-b741-334f28efcba8 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:44.723081 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78ec3919-19c5-4cb1-b741-334f28efcba8 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:44.724146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78ec3919-19c5-4cb1-b741-334f28efcba8 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:44.725393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78ec3919-19c5-4cb1-b741-334f28efcba8 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:44.731283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78ec3919-19c5-4cb1-b741-334f28efcba8 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:44.756093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1da66b0b-ea6d-451b-b82b-21b4a7b46e6b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:44.771569 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1da66b0b-ea6d-451b-b82b-21b4a7b46e6b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0" status: 200 len: 1351 microversion: 2.1 time: 0.198653 Oct 05 02:45:44.772374 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1944/3924] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:44 2022] GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0 => generated 1351 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:45.173571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-78ec3919-19c5-4cb1-b741-334f28efcba8 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:45.185170 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-78ec3919-19c5-4cb1-b741-334f28efcba8 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59" status: 200 len: 1314 microversion: 2.1 time: 0.496643 Oct 05 02:45:45.187997 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1981/3925] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:44 2022] GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59 => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:45.584943 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-49a526b1-e722-4bc0-ac16-0cae10263a24 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:45.585816 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-49a526b1-e722-4bc0-ac16-0cae10263a24 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: c2d68022-2fa3-4464-8004-262c23e41ea2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:45.594479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-49a526b1-e722-4bc0-ac16-0cae10263a24 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:45.595191 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-49a526b1-e722-4bc0-ac16-0cae10263a24 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:45.595784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-49a526b1-e722-4bc0-ac16-0cae10263a24 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:45.596649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-49a526b1-e722-4bc0-ac16-0cae10263a24 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:45.597267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-49a526b1-e722-4bc0-ac16-0cae10263a24 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:45.597837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-49a526b1-e722-4bc0-ac16-0cae10263a24 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:45.611005 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fe20fd95-42c5-4f77-8c13-253a02e4a7b3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:45.611631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fe20fd95-42c5-4f77-8c13-253a02e4a7b3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:45.625317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe20fd95-42c5-4f77-8c13-253a02e4a7b3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:45.625818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe20fd95-42c5-4f77-8c13-253a02e4a7b3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:45.626258 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe20fd95-42c5-4f77-8c13-253a02e4a7b3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:45.626971 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe20fd95-42c5-4f77-8c13-253a02e4a7b3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:45.627429 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe20fd95-42c5-4f77-8c13-253a02e4a7b3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:45.627853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe20fd95-42c5-4f77-8c13-253a02e4a7b3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:46.063917 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fe20fd95-42c5-4f77-8c13-253a02e4a7b3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:46.072190 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-49a526b1-e722-4bc0-ac16-0cae10263a24 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14d2fac851e4bbaaa760b5c3406a335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae15e13c1ae4b2db5de94fbd428867d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:46.086342 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-49a526b1-e722-4bc0-ac16-0cae10263a24 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2" status: 200 len: 1324 microversion: 2.1 time: 0.503535 Oct 05 02:45:46.087260 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1945/3926] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:45 2022] GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2 => generated 1324 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:46.096279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c3f53902-4541-48aa-8b25-6d721daae94c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:46.097275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c3f53902-4541-48aa-8b25-6d721daae94c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7517582f-12a1-4f22-bfb9-0690938cafd0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:46.131768 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3f53902-4541-48aa-8b25-6d721daae94c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:46.132181 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3f53902-4541-48aa-8b25-6d721daae94c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:46.132627 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3f53902-4541-48aa-8b25-6d721daae94c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:46.133379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3f53902-4541-48aa-8b25-6d721daae94c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:46.134922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3f53902-4541-48aa-8b25-6d721daae94c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:46.135355 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3f53902-4541-48aa-8b25-6d721daae94c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:46.140146 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fe20fd95-42c5-4f77-8c13-253a02e4a7b3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc" status: 200 len: 1314 microversion: 2.1 time: 0.532475 Oct 05 02:45:46.140758 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1982/3927] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:45 2022] GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc => generated 1314 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:45:46.161468 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-d333236e-4cbc-4f0e-ad43-fe30fcb508b5 req-23b76f8b-3a63-4d02-863c-53d700cfcb6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2d68022-2fa3-4464-8004-262c23e41ea2", "name": "network-vif-plugged", "status": "completed", "tag": "baf1bb4d-f79e-4dc4-903a-f0407e6bf5d8"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:45:46.189502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3f53902-4541-48aa-8b25-6d721daae94c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:46.190243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3f53902-4541-48aa-8b25-6d721daae94c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:46.190932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3f53902-4541-48aa-8b25-6d721daae94c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:46.191695 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-c3f53902-4541-48aa-8b25-6d721daae94c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lazy-loading 'fault' on Instance uuid 7517582f-12a1-4f22-bfb9-0690938cafd0 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:45:46.207073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d333236e-4cbc-4f0e-ad43-fe30fcb508b5 req-23b76f8b-3a63-4d02-863c-53d700cfcb6c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:46.208357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d333236e-4cbc-4f0e-ad43-fe30fcb508b5 req-23b76f8b-3a63-4d02-863c-53d700cfcb6c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:46.209689 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d333236e-4cbc-4f0e-ad43-fe30fcb508b5 req-23b76f8b-3a63-4d02-863c-53d700cfcb6c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:46.247134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c3f53902-4541-48aa-8b25-6d721daae94c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:46.249646 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-d333236e-4cbc-4f0e-ad43-fe30fcb508b5 req-23b76f8b-3a63-4d02-863c-53d700cfcb6c service nova] Creating event network-vif-plugged:baf1bb4d-f79e-4dc4-903a-f0407e6bf5d8 for instance c2d68022-2fa3-4464-8004-262c23e41ea2 on n-h2-858272-3 Oct 05 02:45:46.257728 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c3f53902-4541-48aa-8b25-6d721daae94c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0" status: 200 len: 1351 microversion: 2.1 time: 0.168154 Oct 05 02:45:46.259275 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1946/3928] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:46 2022] GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0 => generated 1351 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:46.271271 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-d333236e-4cbc-4f0e-ad43-fe30fcb508b5 req-23b76f8b-3a63-4d02-863c-53d700cfcb6c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129254 Oct 05 02:45:46.274740 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1983/3929] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:45:46.282493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8d3f81cb-8c37-47cf-ac78-296c493571b9 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:46.283368 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8d3f81cb-8c37-47cf-ac78-296c493571b9 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:46.291299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d3f81cb-8c37-47cf-ac78-296c493571b9 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:46.291989 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d3f81cb-8c37-47cf-ac78-296c493571b9 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:46.292588 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d3f81cb-8c37-47cf-ac78-296c493571b9 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:46.293487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d3f81cb-8c37-47cf-ac78-296c493571b9 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:46.294085 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d3f81cb-8c37-47cf-ac78-296c493571b9 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:46.294653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d3f81cb-8c37-47cf-ac78-296c493571b9 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:46.550766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:46.716677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8d3f81cb-8c37-47cf-ac78-296c493571b9 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:46.730858 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8d3f81cb-8c37-47cf-ac78-296c493571b9 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59" status: 200 len: 1314 microversion: 2.1 time: 0.470204 Oct 05 02:45:46.732197 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1947/3930] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:46 2022] GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59 => generated 1314 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:47.114659 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7f886356-a60b-4efa-ac9d-3848c69b8432 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:47.115348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7f886356-a60b-4efa-ac9d-3848c69b8432 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: c2d68022-2fa3-4464-8004-262c23e41ea2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:47.131718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f886356-a60b-4efa-ac9d-3848c69b8432 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:47.132246 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f886356-a60b-4efa-ac9d-3848c69b8432 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:47.132675 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f886356-a60b-4efa-ac9d-3848c69b8432 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:47.133566 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f886356-a60b-4efa-ac9d-3848c69b8432 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:47.135349 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f886356-a60b-4efa-ac9d-3848c69b8432 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:47.135797 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f886356-a60b-4efa-ac9d-3848c69b8432 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:47.240258 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7a58113c-3302-4300-8f48-828d621296d4 tempest-ListImageFiltersNegativeTestJSON-1717358732 tempest-ListImageFiltersNegativeTestJSON-1717358732-project] Calling method '.version_select at 0x7fcce8290d30>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:47.267421 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-7a58113c-3302-4300-8f48-828d621296d4 tempest-ListImageFiltersNegativeTestJSON-1717358732 tempest-ListImageFiltersNegativeTestJSON-1717358732-project] HTTP exception thrown: Image not found. Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7a58113c-3302-4300-8f48-828d621296d4 tempest-ListImageFiltersNegativeTestJSON-1717358732 tempest-ListImageFiltersNegativeTestJSON-1717358732-project] Request method failure captured: Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/images/447a5153-9529-4c3e-b820-687d39eac9d6 HTTP/1.1 Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO_aksOk-zuFUSoruT9wXQMWwH66ELgsR3nwCoLGzlpzVnshXMYz8HOmiEQiQ87BDTWNOeW5ZZVZ8YbvVTjHmahxcBZw5yqp84zOyuZWBekM73YW7Vin8IRiI4b9CDgwd37u3-7HGY0fztzTp-MjnwfhbSu4gkWayMZcmY0rvK5Rps4 Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 08bcef080b0f40eb91af065a0cd71060 Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1717358732 Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/08bcef080b0f40eb91af065a0cd71060"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/08bcef080b0f40eb91af065a0cd71060"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/08bcef080b0f40eb91af065a0cd71060"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_08bcef080b0f40eb91af065a0cd71060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1717358732 Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 08bcef080b0f40eb91af065a0cd71060 Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1717358732 Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ListImageFiltersNegativeTestJSON-1717358732-project Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 4f6d0954d11b4fbeafdcf5504801f6b2 Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1717358732-project Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: exception: Image not found. Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '447a5153-9529-4c3e-b820-687d39eac9d6'} Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 447a5153-9529-4c3e-b820-687d39eac9d6 Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 05 02:45:47.269581 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 447a5153-9529-4c3e-b820-687d39eac9d6 could not be found. Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 02:45:47.273850 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:45:47.280999 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7a58113c-3302-4300-8f48-828d621296d4 tempest-ListImageFiltersNegativeTestJSON-1717358732 tempest-ListImageFiltersNegativeTestJSON-1717358732-project] Returning 404 to user: Image not found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:45:47.282266 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7a58113c-3302-4300-8f48-828d621296d4 tempest-ListImageFiltersNegativeTestJSON-1717358732 tempest-ListImageFiltersNegativeTestJSON-1717358732-project] 10.222.0.16 "GET /compute/v2.1/images/447a5153-9529-4c3e-b820-687d39eac9d6" status: 404 len: 62 microversion: 2.1 time: 0.224116 Oct 05 02:45:47.283381 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1984/3931] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:45:47 2022] GET /compute/v2.1/images/447a5153-9529-4c3e-b820-687d39eac9d6 => generated 62 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:45:47.295954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-be921d11-8f02-4c44-9ebd-bf03a508205c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:47.296703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-be921d11-8f02-4c44-9ebd-bf03a508205c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:47.304150 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be921d11-8f02-4c44-9ebd-bf03a508205c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:47.304646 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be921d11-8f02-4c44-9ebd-bf03a508205c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:47.307405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be921d11-8f02-4c44-9ebd-bf03a508205c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:47.309738 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be921d11-8f02-4c44-9ebd-bf03a508205c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:47.310374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be921d11-8f02-4c44-9ebd-bf03a508205c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:47.314497 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be921d11-8f02-4c44-9ebd-bf03a508205c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:47.378365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7f886356-a60b-4efa-ac9d-3848c69b8432 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14d2fac851e4bbaaa760b5c3406a335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae15e13c1ae4b2db5de94fbd428867d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:47.387516 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7f886356-a60b-4efa-ac9d-3848c69b8432 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2" status: 200 len: 1324 microversion: 2.1 time: 0.281986 Oct 05 02:45:47.409811 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1948/3932] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:47 2022] GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2 => generated 1324 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:45:47.418019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-08da334d-2f9d-448a-80ce-fed7ec8c7812 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:47.418671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-08da334d-2f9d-448a-80ce-fed7ec8c7812 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7517582f-12a1-4f22-bfb9-0690938cafd0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:47.432933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08da334d-2f9d-448a-80ce-fed7ec8c7812 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:47.434171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08da334d-2f9d-448a-80ce-fed7ec8c7812 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:47.434622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08da334d-2f9d-448a-80ce-fed7ec8c7812 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:47.435395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08da334d-2f9d-448a-80ce-fed7ec8c7812 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:47.445004 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08da334d-2f9d-448a-80ce-fed7ec8c7812 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:47.445654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08da334d-2f9d-448a-80ce-fed7ec8c7812 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:47.473923 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-08da334d-2f9d-448a-80ce-fed7ec8c7812 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] HTTP exception thrown: Instance 7517582f-12a1-4f22-bfb9-0690938cafd0 could not be found. Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-08da334d-2f9d-448a-80ce-fed7ec8c7812 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Request method failure captured: Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0 HTTP/1.1 Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO9sJgtvOLeTr4nOCD-vOqCqD1zJrAITPFW_zz4yiLyvIoTdHjuR4LJfH4xTHqVQhBEUV87uN4J6FQiHHhnatngFlbfTbJmS6cPceNKMN6UWu-_pNs3jdF8Cb5CgC-hxlx6u-5aGNVi9h5jLYyViTpDjMXgNyRvr5dJZFZQW2uKikA8 Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: d797c0058e8c456290081d056df79292 Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d797c0058e8c456290081d056df79292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d797c0058e8c456290081d056df79292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: d797c0058e8c456290081d056df79292 Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: ff170a5be8a04902b66e5f0e79fd47df Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 7517582f-12a1-4f22-bfb9-0690938cafd0 could not be found. Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '7517582f-12a1-4f22-bfb9-0690938cafd0'} Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7517582f-12a1-4f22-bfb9-0690938cafd0 could not be found. Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7517582f-12a1-4f22-bfb9-0690938cafd0 could not be found. Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:45:47.475893 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:45:47.480283 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:45:47.480283 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:45:47.480283 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:45:47.480283 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:45:47.480283 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:45:47.480283 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7517582f-12a1-4f22-bfb9-0690938cafd0 could not be found. Oct 05 02:45:47.480283 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:45:47.485079 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-08da334d-2f9d-448a-80ce-fed7ec8c7812 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Returning 404 to user: Instance 7517582f-12a1-4f22-bfb9-0690938cafd0 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:45:47.486160 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-08da334d-2f9d-448a-80ce-fed7ec8c7812 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0" status: 404 len: 111 microversion: 2.1 time: 0.075259 Oct 05 02:45:47.488139 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1949/3933] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:47 2022] GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:45:47.626607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-be921d11-8f02-4c44-9ebd-bf03a508205c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:47.639149 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-be921d11-8f02-4c44-9ebd-bf03a508205c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc" status: 200 len: 1314 microversion: 2.1 time: 0.354294 Oct 05 02:45:47.654942 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1985/3934] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:47 2022] GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:47.718958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f3fcecbe-65ed-401c-a45e-2bfc63223750 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:47.722100 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f3fcecbe-65ed-401c-a45e-2bfc63223750 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7517582f-12a1-4f22-bfb9-0690938cafd0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:47.747512 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3fcecbe-65ed-401c-a45e-2bfc63223750 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:47.748251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3fcecbe-65ed-401c-a45e-2bfc63223750 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:47.751655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3fcecbe-65ed-401c-a45e-2bfc63223750 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:47.752615 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3fcecbe-65ed-401c-a45e-2bfc63223750 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:47.753289 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3fcecbe-65ed-401c-a45e-2bfc63223750 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:47.753890 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3fcecbe-65ed-401c-a45e-2bfc63223750 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:47.757276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ea591a1c-4eec-4ef3-97e9-e3ca35706e9f tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:47.759555 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ea591a1c-4eec-4ef3-97e9-e3ca35706e9f tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:47.770176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea591a1c-4eec-4ef3-97e9-e3ca35706e9f tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:47.773178 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea591a1c-4eec-4ef3-97e9-e3ca35706e9f tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:47.776048 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea591a1c-4eec-4ef3-97e9-e3ca35706e9f tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:47.777127 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea591a1c-4eec-4ef3-97e9-e3ca35706e9f tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:47.778409 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-f3fcecbe-65ed-401c-a45e-2bfc63223750 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] HTTP exception thrown: Instance 7517582f-12a1-4f22-bfb9-0690938cafd0 could not be found. Oct 05 02:45:47.780451 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea591a1c-4eec-4ef3-97e9-e3ca35706e9f tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:47.780948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea591a1c-4eec-4ef3-97e9-e3ca35706e9f tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f3fcecbe-65ed-401c-a45e-2bfc63223750 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Request method failure captured: Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0/os-volume_attachments HTTP/1.1 Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO9sJgtvOLeTr4nOCD-vOqCqD1zJrAITPFW_zz4yiLyvIoTdHjuR4LJfH4xTHqVQhBEUV87uN4J6FQiHHhnatngFlbfTbJmS6cPceNKMN6UWu-_pNs3jdF8Cb5CgC-hxlx6u-5aGNVi9h5jLYyViTpDjMXgNyRvr5dJZFZQW2uKikA8 Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: d797c0058e8c456290081d056df79292 Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d797c0058e8c456290081d056df79292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d797c0058e8c456290081d056df79292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: d797c0058e8c456290081d056df79292 Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: ff170a5be8a04902b66e5f0e79fd47df Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 7517582f-12a1-4f22-bfb9-0690938cafd0 could not be found. Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'server_id': '7517582f-12a1-4f22-bfb9-0690938cafd0'} Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7517582f-12a1-4f22-bfb9-0690938cafd0 could not be found. Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:45:47.781682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:45:47.785664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7517582f-12a1-4f22-bfb9-0690938cafd0 could not be found. Oct 05 02:45:47.785664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:45:47.785664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:45:47.785664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:45:47.785664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:45:47.785664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:45:47.785664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:45:47.785664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:45:47.785664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:45:47.785664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7517582f-12a1-4f22-bfb9-0690938cafd0 could not be found. Oct 05 02:45:47.785664 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:45:47.787222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f3fcecbe-65ed-401c-a45e-2bfc63223750 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Returning 404 to user: Instance 7517582f-12a1-4f22-bfb9-0690938cafd0 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:45:47.788293 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f3fcecbe-65ed-401c-a45e-2bfc63223750 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.074079 Oct 05 02:45:47.790885 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1950/3935] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 02:45:47 2022] GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0/os-volume_attachments => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:45:48.113267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-440e382c-1cd8-476b-90ae-dae4ac016d24 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-213297356", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "e4f9d49c-25ab-4e4f-a7c4-00e803798e90"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:45:48.142745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=22 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:48.205170 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-440e382c-1cd8-476b-90ae-dae4ac016d24 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] validate_networks() for [('e4f9d49c-25ab-4e4f-a7c4-00e803798e90', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:45:48.608278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ea591a1c-4eec-4ef3-97e9-e3ca35706e9f tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:48.629312 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ea591a1c-4eec-4ef3-97e9-e3ca35706e9f tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59" status: 200 len: 1314 microversion: 2.1 time: 0.866510 Oct 05 02:45:48.630252 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1986/3936] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:47 2022] GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59 => generated 1314 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:45:48.635543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-a06898b1-1de1-4204-81e5-1d0024b26e74 req-e62dc17f-b1d0-4726-99f2-76ef60b9033a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba5279cc-8f1f-436e-8341-21488398f1dc", "name": "network-vif-plugged", "status": "completed", "tag": "8ace94b1-dfa5-4957-9902-856931c12b4c"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:45:48.650912 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a06898b1-1de1-4204-81e5-1d0024b26e74 req-e62dc17f-b1d0-4726-99f2-76ef60b9033a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:48.661728 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a06898b1-1de1-4204-81e5-1d0024b26e74 req-e62dc17f-b1d0-4726-99f2-76ef60b9033a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:48.662440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a06898b1-1de1-4204-81e5-1d0024b26e74 req-e62dc17f-b1d0-4726-99f2-76ef60b9033a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:48.690068 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-a06898b1-1de1-4204-81e5-1d0024b26e74 req-e62dc17f-b1d0-4726-99f2-76ef60b9033a service nova] Creating event network-vif-plugged:8ace94b1-dfa5-4957-9902-856931c12b4c for instance ba5279cc-8f1f-436e-8341-21488398f1dc on n-h2-858272-3 Oct 05 02:45:48.700587 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-a06898b1-1de1-4204-81e5-1d0024b26e74 req-e62dc17f-b1d0-4726-99f2-76ef60b9033a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066308 Oct 05 02:45:48.701822 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1987/3937] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:45:48.736952 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-618b683b-9143-40f8-b30d-cd49dab85076 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:48.737757 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-618b683b-9143-40f8-b30d-cd49dab85076 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: c2d68022-2fa3-4464-8004-262c23e41ea2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:48.751840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-618b683b-9143-40f8-b30d-cd49dab85076 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:48.755583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-618b683b-9143-40f8-b30d-cd49dab85076 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:48.756189 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-618b683b-9143-40f8-b30d-cd49dab85076 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:48.757691 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-618b683b-9143-40f8-b30d-cd49dab85076 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:48.758465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-618b683b-9143-40f8-b30d-cd49dab85076 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:48.761343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-618b683b-9143-40f8-b30d-cd49dab85076 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:49.330603 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-618b683b-9143-40f8-b30d-cd49dab85076 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14d2fac851e4bbaaa760b5c3406a335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae15e13c1ae4b2db5de94fbd428867d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:49.344280 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-618b683b-9143-40f8-b30d-cd49dab85076 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2" status: 200 len: 1520 microversion: 2.1 time: 0.640404 Oct 05 02:45:49.349493 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1988/3938] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:48 2022] GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2 => generated 1520 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:49.354756 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-71d9fefb-a345-46fe-8f74-cab539dd00fe tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:49.355384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-71d9fefb-a345-46fe-8f74-cab539dd00fe tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:49.388310 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71d9fefb-a345-46fe-8f74-cab539dd00fe tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:49.388823 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71d9fefb-a345-46fe-8f74-cab539dd00fe tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:49.389821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71d9fefb-a345-46fe-8f74-cab539dd00fe tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:49.390595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71d9fefb-a345-46fe-8f74-cab539dd00fe tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:49.391054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71d9fefb-a345-46fe-8f74-cab539dd00fe tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:49.392475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71d9fefb-a345-46fe-8f74-cab539dd00fe tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:49.793637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-440e382c-1cd8-476b-90ae-dae4ac016d24 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:45:49.797948 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-440e382c-1cd8-476b-90ae-dae4ac016d24 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:45:49.803583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-440e382c-1cd8-476b-90ae-dae4ac016d24 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:45:49.805432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-440e382c-1cd8-476b-90ae-dae4ac016d24 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:45:49.809726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-440e382c-1cd8-476b-90ae-dae4ac016d24 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:45:49.856781 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-71d9fefb-a345-46fe-8f74-cab539dd00fe tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:49.871650 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-71d9fefb-a345-46fe-8f74-cab539dd00fe tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc" status: 200 len: 1314 microversion: 2.1 time: 0.520708 Oct 05 02:45:49.874968 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1989/3939] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:49 2022] GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc => generated 1314 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:49.897027 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d2ae16dd-1fa1-45db-bd3c-83aba908cafd tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Action: 'create', calling method: .version_select at 0x7fcce8186a60>, body: {"pool": null} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:45:49.900495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-440e382c-1cd8-476b-90ae-dae4ac016d24 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:49.902000 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-440e382c-1cd8-476b-90ae-dae4ac016d24 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:49.903072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-440e382c-1cd8-476b-90ae-dae4ac016d24 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:49.910884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-440e382c-1cd8-476b-90ae-dae4ac016d24 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:49.913479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-440e382c-1cd8-476b-90ae-dae4ac016d24 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:49.915477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-440e382c-1cd8-476b-90ae-dae4ac016d24 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:49.987293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-440e382c-1cd8-476b-90ae-dae4ac016d24 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Getting quotas for project d797c0058e8c456290081d056df79292. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:45:49.993701 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-440e382c-1cd8-476b-90ae-dae4ac016d24 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Getting quotas for user ff170a5be8a04902b66e5f0e79fd47df and project d797c0058e8c456290081d056df79292. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:45:50.010750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-440e382c-1cd8-476b-90ae-dae4ac016d24 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:45:50.017216 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-440e382c-1cd8-476b-90ae-dae4ac016d24 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: dc04e91e-b5d5-4583-9de3-b8a4271d4842] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:45:50.102632 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-440e382c-1cd8-476b-90ae-dae4ac016d24 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.000677 Oct 05 02:45:50.105455 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1951/3940] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:45:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 02:45:50.118239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d57296b4-0864-4ad9-bb86-0037b878ff77 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:50.120493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d57296b4-0864-4ad9-bb86-0037b878ff77 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:50.130960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d57296b4-0864-4ad9-bb86-0037b878ff77 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:50.131766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d57296b4-0864-4ad9-bb86-0037b878ff77 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:50.132877 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d57296b4-0864-4ad9-bb86-0037b878ff77 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:50.134627 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d57296b4-0864-4ad9-bb86-0037b878ff77 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:50.135243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d57296b4-0864-4ad9-bb86-0037b878ff77 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:50.135820 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d57296b4-0864-4ad9-bb86-0037b878ff77 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:50.182070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:50.558955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d57296b4-0864-4ad9-bb86-0037b878ff77 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:50.578252 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d57296b4-0864-4ad9-bb86-0037b878ff77 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59" status: 200 len: 1314 microversion: 2.1 time: 0.466901 Oct 05 02:45:50.585110 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1952/3941] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:50 2022] GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59 => generated 1314 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:50.596582 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b618b5dc-914a-4282-8262-b2a0a5c277f2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:50.600327 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b618b5dc-914a-4282-8262-b2a0a5c277f2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: dc04e91e-b5d5-4583-9de3-b8a4271d4842] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:51.138563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b618b5dc-914a-4282-8262-b2a0a5c277f2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:51.147142 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b618b5dc-914a-4282-8262-b2a0a5c277f2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/dc04e91e-b5d5-4583-9de3-b8a4271d4842" status: 200 len: 1214 microversion: 2.1 time: 0.564422 Oct 05 02:45:51.148007 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1953/3942] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:50 2022] GET /compute/v2.1/servers/dc04e91e-b5d5-4583-9de3-b8a4271d4842 => generated 1214 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:51.152440 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-eb3a16b3-ae7c-4d86-a8cc-51001adf9071 req-608cdfb7-bb24-41c2-bd8c-52c2f3afa62f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a75e896f-b5a7-47a8-8376-c447c6645f59", "name": "network-vif-plugged", "status": "completed", "tag": "d7fbef64-88d7-41be-9f9f-7e6cc11ea6de"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:45:51.194613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-eb3a16b3-ae7c-4d86-a8cc-51001adf9071 req-608cdfb7-bb24-41c2-bd8c-52c2f3afa62f service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:51.195090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-eb3a16b3-ae7c-4d86-a8cc-51001adf9071 req-608cdfb7-bb24-41c2-bd8c-52c2f3afa62f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:51.204015 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-eb3a16b3-ae7c-4d86-a8cc-51001adf9071 req-608cdfb7-bb24-41c2-bd8c-52c2f3afa62f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:51.221465 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-eb3a16b3-ae7c-4d86-a8cc-51001adf9071 req-608cdfb7-bb24-41c2-bd8c-52c2f3afa62f service nova] Creating event network-vif-plugged:d7fbef64-88d7-41be-9f9f-7e6cc11ea6de for instance a75e896f-b5a7-47a8-8376-c447c6645f59 on n-h1-858272-3 Oct 05 02:45:51.231548 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-eb3a16b3-ae7c-4d86-a8cc-51001adf9071 req-608cdfb7-bb24-41c2-bd8c-52c2f3afa62f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082243 Oct 05 02:45:51.240794 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1954/3943] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:45:51.246527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9a2e62a0-edfa-4745-a0c7-1f79a4e1b12a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:51.248256 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9a2e62a0-edfa-4745-a0c7-1f79a4e1b12a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:51.267787 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a2e62a0-edfa-4745-a0c7-1f79a4e1b12a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:51.268529 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a2e62a0-edfa-4745-a0c7-1f79a4e1b12a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:51.269392 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a2e62a0-edfa-4745-a0c7-1f79a4e1b12a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:51.270242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a2e62a0-edfa-4745-a0c7-1f79a4e1b12a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:51.270844 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a2e62a0-edfa-4745-a0c7-1f79a4e1b12a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:51.278370 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a2e62a0-edfa-4745-a0c7-1f79a4e1b12a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:51.585631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9a2e62a0-edfa-4745-a0c7-1f79a4e1b12a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:51.599341 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9a2e62a0-edfa-4745-a0c7-1f79a4e1b12a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc" status: 200 len: 1500 microversion: 2.1 time: 0.357045 Oct 05 02:45:51.600320 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1955/3944] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:51 2022] GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc => generated 1500 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:51.619325 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-09d06a7c-327e-4891-a0bb-8d54feec8f65 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:51.620261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-09d06a7c-327e-4891-a0bb-8d54feec8f65 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: dc04e91e-b5d5-4583-9de3-b8a4271d4842] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:51.631253 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-09d06a7c-327e-4891-a0bb-8d54feec8f65 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:51.636280 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-09d06a7c-327e-4891-a0bb-8d54feec8f65 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:51.636784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-09d06a7c-327e-4891-a0bb-8d54feec8f65 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:51.639929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-09d06a7c-327e-4891-a0bb-8d54feec8f65 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:51.642684 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-09d06a7c-327e-4891-a0bb-8d54feec8f65 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:51.646162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-09d06a7c-327e-4891-a0bb-8d54feec8f65 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:51.698345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-09d06a7c-327e-4891-a0bb-8d54feec8f65 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: dc04e91e-b5d5-4583-9de3-b8a4271d4842] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:45:51.877117 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-09d06a7c-327e-4891-a0bb-8d54feec8f65 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dc04e91e-b5d5-4583-9de3-b8a4271d4842" status: 204 len: 0 microversion: 2.1 time: 0.274985 Oct 05 02:45:51.878236 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1956/3945] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:45:51 2022] DELETE /compute/v2.1/servers/dc04e91e-b5d5-4583-9de3-b8a4271d4842 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:45:51.885609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f919027f-4ae3-482a-a9b3-aae9ef976f12 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:51.886403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f919027f-4ae3-482a-a9b3-aae9ef976f12 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:51.916308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f919027f-4ae3-482a-a9b3-aae9ef976f12 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:51.921534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f919027f-4ae3-482a-a9b3-aae9ef976f12 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:51.921986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f919027f-4ae3-482a-a9b3-aae9ef976f12 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:51.922723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f919027f-4ae3-482a-a9b3-aae9ef976f12 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:51.923186 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f919027f-4ae3-482a-a9b3-aae9ef976f12 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:51.923611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f919027f-4ae3-482a-a9b3-aae9ef976f12 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:52.490091 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f919027f-4ae3-482a-a9b3-aae9ef976f12 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:52.500558 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f919027f-4ae3-482a-a9b3-aae9ef976f12 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59" status: 200 len: 1314 microversion: 2.1 time: 0.620829 Oct 05 02:45:52.505795 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1957/3946] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:51 2022] GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59 => generated 1314 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:52.512134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-842b0d65-95fd-48f0-88bf-5d10373a7462 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:45:52.532044 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-842b0d65-95fd-48f0-88bf-5d10373a7462 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:52.532754 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-842b0d65-95fd-48f0-88bf-5d10373a7462 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:52.533360 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-842b0d65-95fd-48f0-88bf-5d10373a7462 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:52.582929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-842b0d65-95fd-48f0-88bf-5d10373a7462 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Going to try to stop instance {{(pid=122319) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 05 02:45:52.696452 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-842b0d65-95fd-48f0-88bf-5d10373a7462 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc/action" status: 202 len: 0 microversion: 2.1 time: 0.187868 Oct 05 02:45:52.698157 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1958/3947] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:45:52 2022] POST /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:45:52.723973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-26fa743e-bea5-4b39-a0d8-0ee4a2462639 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:52.724718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-26fa743e-bea5-4b39-a0d8-0ee4a2462639 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: dc04e91e-b5d5-4583-9de3-b8a4271d4842] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:52.737120 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26fa743e-bea5-4b39-a0d8-0ee4a2462639 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:52.737873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26fa743e-bea5-4b39-a0d8-0ee4a2462639 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:52.738583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26fa743e-bea5-4b39-a0d8-0ee4a2462639 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:52.739732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26fa743e-bea5-4b39-a0d8-0ee4a2462639 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:52.740346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26fa743e-bea5-4b39-a0d8-0ee4a2462639 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:52.741280 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26fa743e-bea5-4b39-a0d8-0ee4a2462639 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:52.869303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-26fa743e-bea5-4b39-a0d8-0ee4a2462639 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:52.885603 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-26fa743e-bea5-4b39-a0d8-0ee4a2462639 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/dc04e91e-b5d5-4583-9de3-b8a4271d4842" status: 200 len: 1272 microversion: 2.1 time: 0.185622 Oct 05 02:45:52.888166 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1959/3948] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:52 2022] GET /compute/v2.1/servers/dc04e91e-b5d5-4583-9de3-b8a4271d4842 => generated 1272 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:52.894514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2aae7363-4751-4782-986b-b9538c4011ed tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:52.895390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2aae7363-4751-4782-986b-b9538c4011ed tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:52.906088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2aae7363-4751-4782-986b-b9538c4011ed tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:52.906832 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2aae7363-4751-4782-986b-b9538c4011ed tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:52.907487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2aae7363-4751-4782-986b-b9538c4011ed tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:52.908433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2aae7363-4751-4782-986b-b9538c4011ed tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:52.909146 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2aae7363-4751-4782-986b-b9538c4011ed tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:52.909809 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2aae7363-4751-4782-986b-b9538c4011ed tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:53.765021 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d2ae16dd-1fa1-45db-bd3c-83aba908cafd tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 3.887250 Oct 05 02:45:53.765555 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1990/3949] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Oct 5 02:45:49 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 3890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:45:53.774247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2aae7363-4751-4782-986b-b9538c4011ed tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:53.774721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7589e73c-a02e-468f-8213-03aa8a484c0e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:53.775187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7589e73c-a02e-468f-8213-03aa8a484c0e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:53.787126 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2aae7363-4751-4782-986b-b9538c4011ed tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc" status: 200 len: 1510 microversion: 2.1 time: 0.896287 Oct 05 02:45:53.789325 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1960/3950] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:52 2022] GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc => generated 1510 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:53.807840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7589e73c-a02e-468f-8213-03aa8a484c0e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:53.808366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7589e73c-a02e-468f-8213-03aa8a484c0e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:53.808810 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7589e73c-a02e-468f-8213-03aa8a484c0e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:53.809563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7589e73c-a02e-468f-8213-03aa8a484c0e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:53.810021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7589e73c-a02e-468f-8213-03aa8a484c0e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:53.810445 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7589e73c-a02e-468f-8213-03aa8a484c0e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:53.915594 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-92af3276-8eec-46f6-bbf6-5131c583a0d4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:53.916589 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-92af3276-8eec-46f6-bbf6-5131c583a0d4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: dc04e91e-b5d5-4583-9de3-b8a4271d4842] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:53.937095 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92af3276-8eec-46f6-bbf6-5131c583a0d4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:53.938446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92af3276-8eec-46f6-bbf6-5131c583a0d4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:53.939433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92af3276-8eec-46f6-bbf6-5131c583a0d4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:53.940148 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92af3276-8eec-46f6-bbf6-5131c583a0d4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:53.942459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92af3276-8eec-46f6-bbf6-5131c583a0d4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:53.943526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92af3276-8eec-46f6-bbf6-5131c583a0d4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:54.088755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-92af3276-8eec-46f6-bbf6-5131c583a0d4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:54.097989 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-92af3276-8eec-46f6-bbf6-5131c583a0d4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/dc04e91e-b5d5-4583-9de3-b8a4271d4842" status: 200 len: 1216 microversion: 2.1 time: 0.186593 Oct 05 02:45:54.109789 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1961/3951] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:53 2022] GET /compute/v2.1/servers/dc04e91e-b5d5-4583-9de3-b8a4271d4842 => generated 1216 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:54.120938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7e8c479a-13cb-4417-94fa-29a88472678d tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1056923460", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "fe740311-a76a-438e-a2c2-3036d93972fd"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:45:54.197324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-7e8c479a-13cb-4417-94fa-29a88472678d tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] validate_networks() for [('fe740311-a76a-438e-a2c2-3036d93972fd', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:45:54.418792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7589e73c-a02e-468f-8213-03aa8a484c0e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:54.453687 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7589e73c-a02e-468f-8213-03aa8a484c0e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59" status: 200 len: 1501 microversion: 2.1 time: 0.685187 Oct 05 02:45:54.464935 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1991/3952] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:53 2022] GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59 => generated 1501 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:54.487677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-12df60d0-b813-4707-a489-130177882ab1 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:45:54.491723 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-12df60d0-b813-4707-a489-130177882ab1 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:54.509173 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12df60d0-b813-4707-a489-130177882ab1 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:54.510155 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12df60d0-b813-4707-a489-130177882ab1 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:54.511066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12df60d0-b813-4707-a489-130177882ab1 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:54.511992 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12df60d0-b813-4707-a489-130177882ab1 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:54.512893 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12df60d0-b813-4707-a489-130177882ab1 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:54.513549 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12df60d0-b813-4707-a489-130177882ab1 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:54.556926 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-12df60d0-b813-4707-a489-130177882ab1 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lazy-loading 'flavor' on Instance uuid a75e896f-b5a7-47a8-8376-c447c6645f59 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:45:54.656681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:54.767342 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-12df60d0-b813-4707-a489-130177882ab1 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "POST /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59/action" status: 200 len: 32 microversion: 2.1 time: 0.286776 Oct 05 02:45:54.781147 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1992/3953] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:45:54 2022] POST /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59/action => generated 32 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 05 02:45:54.793920 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-204654a7-88e6-4b94-a588-6a02bfea36af tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:54.798724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-204654a7-88e6-4b94-a588-6a02bfea36af tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:54.815314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-204654a7-88e6-4b94-a588-6a02bfea36af tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:54.815864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-204654a7-88e6-4b94-a588-6a02bfea36af tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:54.816334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-204654a7-88e6-4b94-a588-6a02bfea36af tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:54.817116 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-204654a7-88e6-4b94-a588-6a02bfea36af tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:54.817587 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-204654a7-88e6-4b94-a588-6a02bfea36af tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:54.818019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-204654a7-88e6-4b94-a588-6a02bfea36af tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:55.148938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-7e8c479a-13cb-4417-94fa-29a88472678d tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:45:55.150069 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-7e8c479a-13cb-4417-94fa-29a88472678d tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:45:55.152099 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-7e8c479a-13cb-4417-94fa-29a88472678d tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:45:55.153613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-7e8c479a-13cb-4417-94fa-29a88472678d tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:45:55.156188 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-7e8c479a-13cb-4417-94fa-29a88472678d tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:45:55.184025 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e8c479a-13cb-4417-94fa-29a88472678d tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:55.187387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e8c479a-13cb-4417-94fa-29a88472678d tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:55.188274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e8c479a-13cb-4417-94fa-29a88472678d tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:55.189312 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e8c479a-13cb-4417-94fa-29a88472678d tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:55.189988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e8c479a-13cb-4417-94fa-29a88472678d tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:55.190675 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e8c479a-13cb-4417-94fa-29a88472678d tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:55.212177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-204654a7-88e6-4b94-a588-6a02bfea36af tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:55.231962 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-204654a7-88e6-4b94-a588-6a02bfea36af tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59" status: 200 len: 1507 microversion: 2.1 time: 0.445695 Oct 05 02:45:55.240600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-7e8c479a-13cb-4417-94fa-29a88472678d tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Getting quotas for project 1ae15e13c1ae4b2db5de94fbd428867d. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:45:55.249060 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-7e8c479a-13cb-4417-94fa-29a88472678d tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Getting quotas for user c14d2fac851e4bbaaa760b5c3406a335 and project 1ae15e13c1ae4b2db5de94fbd428867d. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:45:55.249281 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1993/3954] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:54 2022] GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59 => generated 1507 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:55.266729 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-17cf6555-7cfb-4a74-99c6-08ffd7fff7eb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:55.267390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-17cf6555-7cfb-4a74-99c6-08ffd7fff7eb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:55.273887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17cf6555-7cfb-4a74-99c6-08ffd7fff7eb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:55.274394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17cf6555-7cfb-4a74-99c6-08ffd7fff7eb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:55.274841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17cf6555-7cfb-4a74-99c6-08ffd7fff7eb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:55.275560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17cf6555-7cfb-4a74-99c6-08ffd7fff7eb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:55.276022 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17cf6555-7cfb-4a74-99c6-08ffd7fff7eb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:55.276456 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17cf6555-7cfb-4a74-99c6-08ffd7fff7eb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:55.301475 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7e8c479a-13cb-4417-94fa-29a88472678d tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:45:55.305766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7e8c479a-13cb-4417-94fa-29a88472678d tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: ac770ead-5d43-4762-9cea-cb163c073d5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:45:55.453809 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7e8c479a-13cb-4417-94fa-29a88472678d tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.342797 Oct 05 02:45:55.464464 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1962/3955] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:45:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:45:55.471897 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fe76ddde-2380-438c-afe2-a19d94d2e0aa tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:55.476004 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fe76ddde-2380-438c-afe2-a19d94d2e0aa tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: dc04e91e-b5d5-4583-9de3-b8a4271d4842] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:55.506217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fe76ddde-2380-438c-afe2-a19d94d2e0aa tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:55.506820 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fe76ddde-2380-438c-afe2-a19d94d2e0aa tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:55.508270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fe76ddde-2380-438c-afe2-a19d94d2e0aa tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:55.524328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fe76ddde-2380-438c-afe2-a19d94d2e0aa tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:55.526733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fe76ddde-2380-438c-afe2-a19d94d2e0aa tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:55.527659 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fe76ddde-2380-438c-afe2-a19d94d2e0aa tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:55.680182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fe76ddde-2380-438c-afe2-a19d94d2e0aa tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:55.692228 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fe76ddde-2380-438c-afe2-a19d94d2e0aa tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/dc04e91e-b5d5-4583-9de3-b8a4271d4842" status: 200 len: 1218 microversion: 2.1 time: 0.226193 Oct 05 02:45:55.695346 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1963/3956] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:55 2022] GET /compute/v2.1/servers/dc04e91e-b5d5-4583-9de3-b8a4271d4842 => generated 1218 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:55.705279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c937ee78-2b36-4aca-b9ae-ffa96172c2e5 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:55.710822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c937ee78-2b36-4aca-b9ae-ffa96172c2e5 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: ac770ead-5d43-4762-9cea-cb163c073d5c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:55.836516 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c937ee78-2b36-4aca-b9ae-ffa96172c2e5 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14d2fac851e4bbaaa760b5c3406a335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae15e13c1ae4b2db5de94fbd428867d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:55.844828 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c937ee78-2b36-4aca-b9ae-ffa96172c2e5 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c" status: 200 len: 1224 microversion: 2.1 time: 0.145917 Oct 05 02:45:55.845530 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1964/3957] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:55 2022] GET /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c => generated 1224 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:55.880830 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-17cf6555-7cfb-4a74-99c6-08ffd7fff7eb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:55.889043 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-17cf6555-7cfb-4a74-99c6-08ffd7fff7eb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc" status: 200 len: 1510 microversion: 2.1 time: 0.638235 Oct 05 02:45:55.890708 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1994/3958] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:55 2022] GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc => generated 1510 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:56.262444 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c8639d4e-82b9-44c5-87d0-c7887792c5b0 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:56.263316 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c8639d4e-82b9-44c5-87d0-c7887792c5b0 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:56.285657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c8639d4e-82b9-44c5-87d0-c7887792c5b0 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:56.286866 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c8639d4e-82b9-44c5-87d0-c7887792c5b0 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:56.287481 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c8639d4e-82b9-44c5-87d0-c7887792c5b0 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:56.288383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c8639d4e-82b9-44c5-87d0-c7887792c5b0 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:56.291201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c8639d4e-82b9-44c5-87d0-c7887792c5b0 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:56.305589 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c8639d4e-82b9-44c5-87d0-c7887792c5b0 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:56.723281 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c65a03dd-c381-40da-9d14-6d46b7ac6ab0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:56.724233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c65a03dd-c381-40da-9d14-6d46b7ac6ab0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: dc04e91e-b5d5-4583-9de3-b8a4271d4842] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:56.739834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c65a03dd-c381-40da-9d14-6d46b7ac6ab0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:56.740620 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c65a03dd-c381-40da-9d14-6d46b7ac6ab0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:56.744022 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c65a03dd-c381-40da-9d14-6d46b7ac6ab0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:56.748998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c65a03dd-c381-40da-9d14-6d46b7ac6ab0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:56.752047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c65a03dd-c381-40da-9d14-6d46b7ac6ab0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:56.752720 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c65a03dd-c381-40da-9d14-6d46b7ac6ab0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:56.767922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c8639d4e-82b9-44c5-87d0-c7887792c5b0 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:56.780521 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c8639d4e-82b9-44c5-87d0-c7887792c5b0 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59" status: 200 len: 1507 microversion: 2.1 time: 0.520083 Oct 05 02:45:56.783165 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1965/3959] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:56 2022] GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59 => generated 1507 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:56.874909 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c60e0daa-384c-4eb1-a02d-e0e542ca4242 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:56.875650 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c60e0daa-384c-4eb1-a02d-e0e542ca4242 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: ac770ead-5d43-4762-9cea-cb163c073d5c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:56.894950 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c60e0daa-384c-4eb1-a02d-e0e542ca4242 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:56.895786 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c60e0daa-384c-4eb1-a02d-e0e542ca4242 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:56.896372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c60e0daa-384c-4eb1-a02d-e0e542ca4242 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:56.897285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c60e0daa-384c-4eb1-a02d-e0e542ca4242 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:56.898857 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c60e0daa-384c-4eb1-a02d-e0e542ca4242 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:56.899356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c60e0daa-384c-4eb1-a02d-e0e542ca4242 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:56.953648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c65a03dd-c381-40da-9d14-6d46b7ac6ab0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:56.971287 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c65a03dd-c381-40da-9d14-6d46b7ac6ab0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/dc04e91e-b5d5-4583-9de3-b8a4271d4842" status: 200 len: 1218 microversion: 2.1 time: 0.252258 Oct 05 02:45:56.978112 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1995/3960] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:56 2022] GET /compute/v2.1/servers/dc04e91e-b5d5-4583-9de3-b8a4271d4842 => generated 1218 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:45:56.990604 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ee6424e5-e538-47a6-ad7a-9730225b2e6c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:56.991816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ee6424e5-e538-47a6-ad7a-9730225b2e6c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:56.997253 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c60e0daa-384c-4eb1-a02d-e0e542ca4242 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14d2fac851e4bbaaa760b5c3406a335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae15e13c1ae4b2db5de94fbd428867d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:57.007469 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ee6424e5-e538-47a6-ad7a-9730225b2e6c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:57.009139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ee6424e5-e538-47a6-ad7a-9730225b2e6c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:57.009861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ee6424e5-e538-47a6-ad7a-9730225b2e6c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:57.010798 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ee6424e5-e538-47a6-ad7a-9730225b2e6c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:57.011458 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ee6424e5-e538-47a6-ad7a-9730225b2e6c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:57.012237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ee6424e5-e538-47a6-ad7a-9730225b2e6c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:57.014072 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c60e0daa-384c-4eb1-a02d-e0e542ca4242 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c" status: 200 len: 1276 microversion: 2.1 time: 0.144083 Oct 05 02:45:57.017529 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1966/3961] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:56 2022] GET /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c => generated 1276 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:45:57.290937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ee6424e5-e538-47a6-ad7a-9730225b2e6c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:57.306098 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ee6424e5-e538-47a6-ad7a-9730225b2e6c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc" status: 200 len: 1510 microversion: 2.1 time: 0.326580 Oct 05 02:45:57.306885 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1996/3962] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:56 2022] GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc => generated 1510 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:57.815502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-37069943-bc22-4e4a-8595-5ac37ed63bcd tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:57.817457 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-37069943-bc22-4e4a-8595-5ac37ed63bcd tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:57.826182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37069943-bc22-4e4a-8595-5ac37ed63bcd tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:57.828683 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37069943-bc22-4e4a-8595-5ac37ed63bcd tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:57.829539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37069943-bc22-4e4a-8595-5ac37ed63bcd tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:57.831293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37069943-bc22-4e4a-8595-5ac37ed63bcd tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:57.832250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37069943-bc22-4e4a-8595-5ac37ed63bcd tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:57.833920 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37069943-bc22-4e4a-8595-5ac37ed63bcd tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:57.998972 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8eaa0b00-945b-46ec-b3d3-c44096a1b5db tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:58.000270 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8eaa0b00-945b-46ec-b3d3-c44096a1b5db tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: dc04e91e-b5d5-4583-9de3-b8a4271d4842] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:58.007714 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8eaa0b00-945b-46ec-b3d3-c44096a1b5db tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:58.008573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8eaa0b00-945b-46ec-b3d3-c44096a1b5db tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:58.009266 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8eaa0b00-945b-46ec-b3d3-c44096a1b5db tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:58.010204 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8eaa0b00-945b-46ec-b3d3-c44096a1b5db tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:58.010892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8eaa0b00-945b-46ec-b3d3-c44096a1b5db tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:58.011733 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8eaa0b00-945b-46ec-b3d3-c44096a1b5db tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:58.047068 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-8eaa0b00-945b-46ec-b3d3-c44096a1b5db tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] HTTP exception thrown: Instance dc04e91e-b5d5-4583-9de3-b8a4271d4842 could not be found. Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8eaa0b00-945b-46ec-b3d3-c44096a1b5db tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Request method failure captured: Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/dc04e91e-b5d5-4583-9de3-b8a4271d4842 HTTP/1.1 Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO9sJgtvOLeTr4nOCD-vOqCqD1zJrAITPFW_zz4yiLyvIoTdHjuR4LJfH4xTHqVQhBEUV87uN4J6FQiHHhnatngFlbfTbJmS6cPceNKMN6UWu-_pNs3jdF8Cb5CgC-hxlx6u-5aGNVi9h5jLYyViTpDjMXgNyRvr5dJZFZQW2uKikA8 Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: d797c0058e8c456290081d056df79292 Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d797c0058e8c456290081d056df79292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d797c0058e8c456290081d056df79292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: d797c0058e8c456290081d056df79292 Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: ff170a5be8a04902b66e5f0e79fd47df Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance dc04e91e-b5d5-4583-9de3-b8a4271d4842 could not be found. Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'dc04e91e-b5d5-4583-9de3-b8a4271d4842'} Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc04e91e-b5d5-4583-9de3-b8a4271d4842 could not be found. Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc04e91e-b5d5-4583-9de3-b8a4271d4842 could not be found. Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:45:58.056385 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:45:58.062977 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:45:58.062977 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:45:58.062977 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:45:58.062977 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:45:58.062977 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:45:58.062977 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc04e91e-b5d5-4583-9de3-b8a4271d4842 could not be found. Oct 05 02:45:58.062977 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:45:58.066422 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8eaa0b00-945b-46ec-b3d3-c44096a1b5db tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Returning 404 to user: Instance dc04e91e-b5d5-4583-9de3-b8a4271d4842 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:45:58.067925 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8eaa0b00-945b-46ec-b3d3-c44096a1b5db tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/dc04e91e-b5d5-4583-9de3-b8a4271d4842" status: 404 len: 111 microversion: 2.1 time: 0.072969 Oct 05 02:45:58.070002 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1997/3963] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:57 2022] GET /compute/v2.1/servers/dc04e91e-b5d5-4583-9de3-b8a4271d4842 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:45:58.087416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a8b39174-3a6c-4f47-816e-62eee32b2ca4 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:58.089001 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a8b39174-3a6c-4f47-816e-62eee32b2ca4 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: ac770ead-5d43-4762-9cea-cb163c073d5c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:58.098908 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8b39174-3a6c-4f47-816e-62eee32b2ca4 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:58.099866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8b39174-3a6c-4f47-816e-62eee32b2ca4 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:58.102403 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8b39174-3a6c-4f47-816e-62eee32b2ca4 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:58.103662 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8b39174-3a6c-4f47-816e-62eee32b2ca4 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:58.104417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8b39174-3a6c-4f47-816e-62eee32b2ca4 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:58.105218 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8b39174-3a6c-4f47-816e-62eee32b2ca4 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:58.303978 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-37069943-bc22-4e4a-8595-5ac37ed63bcd tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:58.314541 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-37069943-bc22-4e4a-8595-5ac37ed63bcd tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59" status: 200 len: 1507 microversion: 2.1 time: 0.508305 Oct 05 02:45:58.317215 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1967/3964] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:57 2022] GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59 => generated 1507 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:58.337613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0421d37f-3599-4aaa-883c-a1f6bd33201c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1244756378", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "e4f9d49c-25ab-4e4f-a7c4-00e803798e90"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:45:58.400113 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a8b39174-3a6c-4f47-816e-62eee32b2ca4 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14d2fac851e4bbaaa760b5c3406a335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae15e13c1ae4b2db5de94fbd428867d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:58.424404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-0421d37f-3599-4aaa-883c-a1f6bd33201c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] validate_networks() for [('e4f9d49c-25ab-4e4f-a7c4-00e803798e90', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:45:58.424987 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a8b39174-3a6c-4f47-816e-62eee32b2ca4 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c" status: 200 len: 1282 microversion: 2.1 time: 0.353055 Oct 05 02:45:58.426087 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1998/3965] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:58 2022] GET /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c => generated 1282 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:58.445247 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-84817646-9825-49d2-8e87-9d17dd4c60ec tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:58.446257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-84817646-9825-49d2-8e87-9d17dd4c60ec tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:58.459008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84817646-9825-49d2-8e87-9d17dd4c60ec tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:58.460354 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84817646-9825-49d2-8e87-9d17dd4c60ec tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:58.462177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84817646-9825-49d2-8e87-9d17dd4c60ec tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:58.463163 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84817646-9825-49d2-8e87-9d17dd4c60ec tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:58.463858 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84817646-9825-49d2-8e87-9d17dd4c60ec tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:58.470427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84817646-9825-49d2-8e87-9d17dd4c60ec tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:58.890016 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-84817646-9825-49d2-8e87-9d17dd4c60ec tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:45:58.906556 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-84817646-9825-49d2-8e87-9d17dd4c60ec tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc" status: 200 len: 1510 microversion: 2.1 time: 0.476961 Oct 05 02:45:58.921468 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 1999/3966] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:58 2022] GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc => generated 1510 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:45:59.172995 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-723327ac-7cdd-4d20-9ee7-31e64af32581 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:59.176022 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-723327ac-7cdd-4d20-9ee7-31e64af32581 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:59.183292 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-723327ac-7cdd-4d20-9ee7-31e64af32581 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:59.184175 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-723327ac-7cdd-4d20-9ee7-31e64af32581 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:59.185024 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-723327ac-7cdd-4d20-9ee7-31e64af32581 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:59.186549 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-723327ac-7cdd-4d20-9ee7-31e64af32581 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:59.187206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-723327ac-7cdd-4d20-9ee7-31e64af32581 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:59.187840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-723327ac-7cdd-4d20-9ee7-31e64af32581 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:59.250128 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-723327ac-7cdd-4d20-9ee7-31e64af32581 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.081880 Oct 05 02:45:59.250792 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2000/3967] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 02:45:59 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 05 02:45:59.290315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0421d37f-3599-4aaa-883c-a1f6bd33201c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:45:59.290785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0421d37f-3599-4aaa-883c-a1f6bd33201c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:45:59.291196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0421d37f-3599-4aaa-883c-a1f6bd33201c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:45:59.291604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0421d37f-3599-4aaa-883c-a1f6bd33201c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:45:59.292040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0421d37f-3599-4aaa-883c-a1f6bd33201c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:45:59.310314 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0421d37f-3599-4aaa-883c-a1f6bd33201c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:59.311539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0421d37f-3599-4aaa-883c-a1f6bd33201c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:59.312149 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0421d37f-3599-4aaa-883c-a1f6bd33201c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:59.313086 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0421d37f-3599-4aaa-883c-a1f6bd33201c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:59.314954 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0421d37f-3599-4aaa-883c-a1f6bd33201c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:59.315568 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0421d37f-3599-4aaa-883c-a1f6bd33201c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:59.347399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:59.358849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-271a362d-2313-4adf-acaf-4a1ef30170dd tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:59.359582 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-271a362d-2313-4adf-acaf-4a1ef30170dd tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:59.361017 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-0421d37f-3599-4aaa-883c-a1f6bd33201c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Getting quotas for project d797c0058e8c456290081d056df79292. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:45:59.370245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-271a362d-2313-4adf-acaf-4a1ef30170dd tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:59.370741 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-271a362d-2313-4adf-acaf-4a1ef30170dd tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:59.371356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-271a362d-2313-4adf-acaf-4a1ef30170dd tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:59.372831 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-271a362d-2313-4adf-acaf-4a1ef30170dd tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:59.377093 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-271a362d-2313-4adf-acaf-4a1ef30170dd tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:59.377911 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-0421d37f-3599-4aaa-883c-a1f6bd33201c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Getting quotas for user ff170a5be8a04902b66e5f0e79fd47df and project d797c0058e8c456290081d056df79292. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:45:59.378434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-271a362d-2313-4adf-acaf-4a1ef30170dd tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:59.413301 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0421d37f-3599-4aaa-883c-a1f6bd33201c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:45:59.415779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0421d37f-3599-4aaa-883c-a1f6bd33201c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 11e71f42-f1ec-46ca-a349-265766e0483e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:45:59.538263 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0421d37f-3599-4aaa-883c-a1f6bd33201c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.219553 Oct 05 02:45:59.563477 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1968/3968] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:45:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:45:59.577514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-691a1dd2-f555-4f0b-ab74-a84224dfe4fa tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:59.578989 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-691a1dd2-f555-4f0b-ab74-a84224dfe4fa tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:59.597785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-691a1dd2-f555-4f0b-ab74-a84224dfe4fa tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:59.598301 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-691a1dd2-f555-4f0b-ab74-a84224dfe4fa tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:59.598846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-691a1dd2-f555-4f0b-ab74-a84224dfe4fa tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:59.599580 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-691a1dd2-f555-4f0b-ab74-a84224dfe4fa tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:59.600040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-691a1dd2-f555-4f0b-ab74-a84224dfe4fa tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:59.600469 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-691a1dd2-f555-4f0b-ab74-a84224dfe4fa tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:59.675433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-691a1dd2-f555-4f0b-ab74-a84224dfe4fa tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:45:59.737589 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:59.872244 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-691a1dd2-f555-4f0b-ab74-a84224dfe4fa tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 204 len: 0 microversion: 2.1 time: 0.305639 Oct 05 02:45:59.876355 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1969/3969] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:45:59 2022] DELETE /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:45:59.893641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-282b7f44-5a7b-4b67-a4e8-c2c7d70ba242 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:45:59.895880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-282b7f44-5a7b-4b67-a4e8-c2c7d70ba242 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: ac770ead-5d43-4762-9cea-cb163c073d5c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:45:59.913092 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-282b7f44-5a7b-4b67-a4e8-c2c7d70ba242 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:59.914399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-282b7f44-5a7b-4b67-a4e8-c2c7d70ba242 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:59.915679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-282b7f44-5a7b-4b67-a4e8-c2c7d70ba242 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:45:59.917164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-282b7f44-5a7b-4b67-a4e8-c2c7d70ba242 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:45:59.918977 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-282b7f44-5a7b-4b67-a4e8-c2c7d70ba242 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:45:59.920969 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-282b7f44-5a7b-4b67-a4e8-c2c7d70ba242 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:00.112786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-271a362d-2313-4adf-acaf-4a1ef30170dd tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:00.122566 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-271a362d-2313-4adf-acaf-4a1ef30170dd tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59" status: 200 len: 1507 microversion: 2.1 time: 0.774893 Oct 05 02:46:00.126279 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2001/3970] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:59 2022] GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59 => generated 1507 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:00.136627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1ea7ce0b-c37a-4c1a-9f9b-e7b4452e30ac tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:00.137878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1ea7ce0b-c37a-4c1a-9f9b-e7b4452e30ac tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 11e71f42-f1ec-46ca-a349-265766e0483e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:00.310006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-282b7f44-5a7b-4b67-a4e8-c2c7d70ba242 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14d2fac851e4bbaaa760b5c3406a335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae15e13c1ae4b2db5de94fbd428867d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:00.320340 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-282b7f44-5a7b-4b67-a4e8-c2c7d70ba242 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c" status: 200 len: 1324 microversion: 2.1 time: 0.442299 Oct 05 02:46:00.321435 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1970/3971] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:45:59 2022] GET /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c => generated 1324 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:00.329601 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ab8269e3-d9ee-4f50-b4de-cbf5d5eb62a4 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:00.330365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ab8269e3-d9ee-4f50-b4de-cbf5d5eb62a4 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:00.340734 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab8269e3-d9ee-4f50-b4de-cbf5d5eb62a4 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:00.341628 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab8269e3-d9ee-4f50-b4de-cbf5d5eb62a4 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:00.343317 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab8269e3-d9ee-4f50-b4de-cbf5d5eb62a4 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:00.344786 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab8269e3-d9ee-4f50-b4de-cbf5d5eb62a4 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:00.345432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab8269e3-d9ee-4f50-b4de-cbf5d5eb62a4 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:00.346155 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab8269e3-d9ee-4f50-b4de-cbf5d5eb62a4 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:00.622559 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1ea7ce0b-c37a-4c1a-9f9b-e7b4452e30ac tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:00.634494 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1ea7ce0b-c37a-4c1a-9f9b-e7b4452e30ac tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e" status: 200 len: 1215 microversion: 2.1 time: 0.505520 Oct 05 02:46:00.635847 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2002/3972] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:00 2022] GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e => generated 1215 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:00.649901 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-12dbeefc-485d-4e39-b738-c2823d245ce0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:00.651700 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-12dbeefc-485d-4e39-b738-c2823d245ce0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:00.671494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12dbeefc-485d-4e39-b738-c2823d245ce0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:00.672208 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12dbeefc-485d-4e39-b738-c2823d245ce0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:00.672801 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12dbeefc-485d-4e39-b738-c2823d245ce0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:00.674177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12dbeefc-485d-4e39-b738-c2823d245ce0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:00.674788 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12dbeefc-485d-4e39-b738-c2823d245ce0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:00.675868 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12dbeefc-485d-4e39-b738-c2823d245ce0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:00.712290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ab8269e3-d9ee-4f50-b4de-cbf5d5eb62a4 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:00.725443 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ab8269e3-d9ee-4f50-b4de-cbf5d5eb62a4 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1673 microversion: 2.1 time: 0.402739 Oct 05 02:46:00.727238 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1971/3973] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:00 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1673 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:00.951032 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-12dbeefc-485d-4e39-b738-c2823d245ce0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:00.968467 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-12dbeefc-485d-4e39-b738-c2823d245ce0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc" status: 200 len: 1510 microversion: 2.1 time: 0.330036 Oct 05 02:46:00.969339 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2003/3974] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:00 2022] GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc => generated 1510 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:01.151560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4c458bcc-ac41-42dc-a781-fd6d763d8d1b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:01.152176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4c458bcc-ac41-42dc-a781-fd6d763d8d1b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:01.159356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c458bcc-ac41-42dc-a781-fd6d763d8d1b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:01.159836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c458bcc-ac41-42dc-a781-fd6d763d8d1b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:01.160274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c458bcc-ac41-42dc-a781-fd6d763d8d1b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:01.174311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c458bcc-ac41-42dc-a781-fd6d763d8d1b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:01.175215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c458bcc-ac41-42dc-a781-fd6d763d8d1b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:01.175632 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c458bcc-ac41-42dc-a781-fd6d763d8d1b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:01.348933 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-55ead43b-9423-4879-9de0-eecb1e9ec73f tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:01.349558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-55ead43b-9423-4879-9de0-eecb1e9ec73f tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: ac770ead-5d43-4762-9cea-cb163c073d5c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:01.365122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55ead43b-9423-4879-9de0-eecb1e9ec73f tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:01.365625 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55ead43b-9423-4879-9de0-eecb1e9ec73f tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:01.366064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55ead43b-9423-4879-9de0-eecb1e9ec73f tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:01.366769 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55ead43b-9423-4879-9de0-eecb1e9ec73f tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:01.367526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55ead43b-9423-4879-9de0-eecb1e9ec73f tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:01.367901 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55ead43b-9423-4879-9de0-eecb1e9ec73f tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:01.594378 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4c458bcc-ac41-42dc-a781-fd6d763d8d1b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:01.610917 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4c458bcc-ac41-42dc-a781-fd6d763d8d1b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59" status: 200 len: 1507 microversion: 2.1 time: 0.461755 Oct 05 02:46:01.614651 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1972/3975] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:01 2022] GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59 => generated 1507 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:01.660756 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-233e268f-2472-4667-9b05-29df9b87a279 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:01.661412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-233e268f-2472-4667-9b05-29df9b87a279 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 11e71f42-f1ec-46ca-a349-265766e0483e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:01.674973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-233e268f-2472-4667-9b05-29df9b87a279 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:01.675380 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-233e268f-2472-4667-9b05-29df9b87a279 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:01.675824 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-233e268f-2472-4667-9b05-29df9b87a279 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:01.676533 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-233e268f-2472-4667-9b05-29df9b87a279 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:01.677012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-233e268f-2472-4667-9b05-29df9b87a279 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:01.677433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-233e268f-2472-4667-9b05-29df9b87a279 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:02.574998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-55ead43b-9423-4879-9de0-eecb1e9ec73f tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14d2fac851e4bbaaa760b5c3406a335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae15e13c1ae4b2db5de94fbd428867d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:02.590247 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-55ead43b-9423-4879-9de0-eecb1e9ec73f tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c" status: 200 len: 1324 microversion: 2.1 time: 1.244473 Oct 05 02:46:02.593181 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2004/3976] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:01 2022] GET /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c => generated 1324 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:02.611186 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-0b162840-c2c5-40a9-b942-a93b0c815584 req-62ec02e1-7b90-4afd-87d6-1abf41169583 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac770ead-5d43-4762-9cea-cb163c073d5c", "tag": "376ff818-7bff-4848-847c-b6e88a6b8588"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:02.623952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-233e268f-2472-4667-9b05-29df9b87a279 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:02.635799 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-233e268f-2472-4667-9b05-29df9b87a279 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e" status: 200 len: 1219 microversion: 2.1 time: 0.978750 Oct 05 02:46:02.637666 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1973/3977] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:01 2022] GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e => generated 1219 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:02.651307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-0b162840-c2c5-40a9-b942-a93b0c815584 req-62ec02e1-7b90-4afd-87d6-1abf41169583 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:02.655179 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-0b162840-c2c5-40a9-b942-a93b0c815584 req-62ec02e1-7b90-4afd-87d6-1abf41169583 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:02.661004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-0b162840-c2c5-40a9-b942-a93b0c815584 req-62ec02e1-7b90-4afd-87d6-1abf41169583 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:02.668621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-27e1fe9a-f0e4-4626-b1e3-54ce7d49e65d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:02.671064 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-27e1fe9a-f0e4-4626-b1e3-54ce7d49e65d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:02.690900 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27e1fe9a-f0e4-4626-b1e3-54ce7d49e65d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:02.692811 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-0b162840-c2c5-40a9-b942-a93b0c815584 req-62ec02e1-7b90-4afd-87d6-1abf41169583 service nova] Creating event network-changed:376ff818-7bff-4848-847c-b6e88a6b8588 for instance ac770ead-5d43-4762-9cea-cb163c073d5c on n-h1-858272-3 Oct 05 02:46:02.697187 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27e1fe9a-f0e4-4626-b1e3-54ce7d49e65d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:02.697766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27e1fe9a-f0e4-4626-b1e3-54ce7d49e65d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:02.698586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27e1fe9a-f0e4-4626-b1e3-54ce7d49e65d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:02.699062 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27e1fe9a-f0e4-4626-b1e3-54ce7d49e65d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:02.699579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27e1fe9a-f0e4-4626-b1e3-54ce7d49e65d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:02.706899 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-0b162840-c2c5-40a9-b942-a93b0c815584 req-62ec02e1-7b90-4afd-87d6-1abf41169583 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112404 Oct 05 02:46:02.709348 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2005/3978] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:46:02.715594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4f83f71a-7148-4dac-a73b-1a6c9b409cad tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:02.716554 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4f83f71a-7148-4dac-a73b-1a6c9b409cad tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:02.736395 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f83f71a-7148-4dac-a73b-1a6c9b409cad tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:02.737703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f83f71a-7148-4dac-a73b-1a6c9b409cad tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:02.741487 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f83f71a-7148-4dac-a73b-1a6c9b409cad tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:02.742815 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f83f71a-7148-4dac-a73b-1a6c9b409cad tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:02.743500 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f83f71a-7148-4dac-a73b-1a6c9b409cad tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:02.744848 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f83f71a-7148-4dac-a73b-1a6c9b409cad tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:03.478471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-27e1fe9a-f0e4-4626-b1e3-54ce7d49e65d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:03.488284 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-27e1fe9a-f0e4-4626-b1e3-54ce7d49e65d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1673 microversion: 2.1 time: 0.849320 Oct 05 02:46:03.497813 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1974/3979] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:02 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1673 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:03.510622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a502ea9a-329d-4fe5-b945-dd23fcc84886 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:03.511328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a502ea9a-329d-4fe5-b945-dd23fcc84886 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:03.541999 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a502ea9a-329d-4fe5-b945-dd23fcc84886 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:03.547964 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a502ea9a-329d-4fe5-b945-dd23fcc84886 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:03.548680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a502ea9a-329d-4fe5-b945-dd23fcc84886 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:03.551790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a502ea9a-329d-4fe5-b945-dd23fcc84886 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:03.552452 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4f83f71a-7148-4dac-a73b-1a6c9b409cad tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:03.552629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a502ea9a-329d-4fe5-b945-dd23fcc84886 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:03.557064 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a502ea9a-329d-4fe5-b945-dd23fcc84886 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:03.569401 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4f83f71a-7148-4dac-a73b-1a6c9b409cad tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc" status: 200 len: 1510 microversion: 2.1 time: 0.857682 Oct 05 02:46:03.594166 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2006/3980] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:02 2022] GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc => generated 1510 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:03.620089 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5847c3d3-68e8-4235-8ab2-cce4a05f8f25 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:03.621013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5847c3d3-68e8-4235-8ab2-cce4a05f8f25 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: ac770ead-5d43-4762-9cea-cb163c073d5c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:03.635045 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5847c3d3-68e8-4235-8ab2-cce4a05f8f25 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:03.635977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5847c3d3-68e8-4235-8ab2-cce4a05f8f25 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:03.636674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5847c3d3-68e8-4235-8ab2-cce4a05f8f25 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:03.637834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5847c3d3-68e8-4235-8ab2-cce4a05f8f25 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:03.648583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5847c3d3-68e8-4235-8ab2-cce4a05f8f25 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:03.649361 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5847c3d3-68e8-4235-8ab2-cce4a05f8f25 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:04.308056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5847c3d3-68e8-4235-8ab2-cce4a05f8f25 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14d2fac851e4bbaaa760b5c3406a335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae15e13c1ae4b2db5de94fbd428867d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:04.320438 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5847c3d3-68e8-4235-8ab2-cce4a05f8f25 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c" status: 200 len: 1324 microversion: 2.1 time: 0.705402 Oct 05 02:46:04.349092 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2007/3981] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:03 2022] GET /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c => generated 1324 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:04.354263 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-11749e41-d441-4f7f-aa48-17c6d6381047 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:04.369903 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-11749e41-d441-4f7f-aa48-17c6d6381047 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 11e71f42-f1ec-46ca-a349-265766e0483e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:04.381907 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a502ea9a-329d-4fe5-b945-dd23fcc84886 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:04.382443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11749e41-d441-4f7f-aa48-17c6d6381047 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:04.382952 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11749e41-d441-4f7f-aa48-17c6d6381047 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:04.383400 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11749e41-d441-4f7f-aa48-17c6d6381047 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:04.384101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11749e41-d441-4f7f-aa48-17c6d6381047 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:04.393620 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a502ea9a-329d-4fe5-b945-dd23fcc84886 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59" status: 200 len: 1507 microversion: 2.1 time: 0.893915 Oct 05 02:46:04.398732 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11749e41-d441-4f7f-aa48-17c6d6381047 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:04.399416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11749e41-d441-4f7f-aa48-17c6d6381047 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:04.400203 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1975/3982] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:03 2022] GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59 => generated 1507 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:04.523673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ff5a6ce9-fee7-4133-ad96-54949728126f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:04.524786 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ff5a6ce9-fee7-4133-ad96-54949728126f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:04.546382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff5a6ce9-fee7-4133-ad96-54949728126f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:04.549272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff5a6ce9-fee7-4133-ad96-54949728126f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:04.550650 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff5a6ce9-fee7-4133-ad96-54949728126f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:04.552195 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff5a6ce9-fee7-4133-ad96-54949728126f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:04.553238 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff5a6ce9-fee7-4133-ad96-54949728126f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:04.553930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff5a6ce9-fee7-4133-ad96-54949728126f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:04.601163 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-11749e41-d441-4f7f-aa48-17c6d6381047 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:04.617368 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-11749e41-d441-4f7f-aa48-17c6d6381047 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e" status: 200 len: 1273 microversion: 2.1 time: 0.266604 Oct 05 02:46:04.619910 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2008/3983] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:04 2022] GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e => generated 1273 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:04.645242 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-58bca22b-a364-413f-9391-4a324591347e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:04.646119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-58bca22b-a364-413f-9391-4a324591347e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:04.652800 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58bca22b-a364-413f-9391-4a324591347e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:04.653530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58bca22b-a364-413f-9391-4a324591347e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:04.655103 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58bca22b-a364-413f-9391-4a324591347e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:04.656092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58bca22b-a364-413f-9391-4a324591347e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:04.658215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58bca22b-a364-413f-9391-4a324591347e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:04.658828 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58bca22b-a364-413f-9391-4a324591347e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:04.766332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ff5a6ce9-fee7-4133-ad96-54949728126f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:04.776138 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ff5a6ce9-fee7-4133-ad96-54949728126f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1606 microversion: 2.1 time: 0.257449 Oct 05 02:46:04.781903 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1976/3984] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:04 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1606 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:05.096590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-58bca22b-a364-413f-9391-4a324591347e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:05.109300 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-58bca22b-a364-413f-9391-4a324591347e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc" status: 200 len: 1510 microversion: 2.1 time: 0.473887 Oct 05 02:46:05.111801 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2009/3985] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:04 2022] GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc => generated 1510 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:05.348193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3bcff92a-7007-4a3f-8839-e98a9930f1ac tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:05.349214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3bcff92a-7007-4a3f-8839-e98a9930f1ac tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: ac770ead-5d43-4762-9cea-cb163c073d5c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:05.362578 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bcff92a-7007-4a3f-8839-e98a9930f1ac tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:05.368756 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bcff92a-7007-4a3f-8839-e98a9930f1ac tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:05.369487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bcff92a-7007-4a3f-8839-e98a9930f1ac tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:05.370358 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bcff92a-7007-4a3f-8839-e98a9930f1ac tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:05.371067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bcff92a-7007-4a3f-8839-e98a9930f1ac tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:05.375083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bcff92a-7007-4a3f-8839-e98a9930f1ac tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:05.427449 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-444df41b-1465-4114-a2d1-0b8e0c05b7bc tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:05.429613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-444df41b-1465-4114-a2d1-0b8e0c05b7bc tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:05.444983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-444df41b-1465-4114-a2d1-0b8e0c05b7bc tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:05.446889 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-444df41b-1465-4114-a2d1-0b8e0c05b7bc tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:05.450526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-444df41b-1465-4114-a2d1-0b8e0c05b7bc tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:05.451454 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-444df41b-1465-4114-a2d1-0b8e0c05b7bc tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:05.458686 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-444df41b-1465-4114-a2d1-0b8e0c05b7bc tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:05.460186 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-444df41b-1465-4114-a2d1-0b8e0c05b7bc tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:05.521345 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:05.862258 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-444df41b-1465-4114-a2d1-0b8e0c05b7bc tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:05.871661 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3bcff92a-7007-4a3f-8839-e98a9930f1ac tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14d2fac851e4bbaaa760b5c3406a335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae15e13c1ae4b2db5de94fbd428867d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:05.891385 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-444df41b-1465-4114-a2d1-0b8e0c05b7bc tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59" status: 200 len: 1507 microversion: 2.1 time: 0.466559 Oct 05 02:46:05.892994 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3bcff92a-7007-4a3f-8839-e98a9930f1ac tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c" status: 200 len: 1324 microversion: 2.1 time: 0.548532 Oct 05 02:46:05.893824 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1977/3986] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:05 2022] GET /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c => generated 1324 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:05.915006 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2010/3987] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:05 2022] GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59 => generated 1507 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:46:05.927254 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5749171c-9e39-4f53-bdb8-8ca2008c1c36 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:05.931002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-9bf49a71-bb62-41c9-b04b-5122e0cbd76c req-41c6e250-0fb4-4807-bd17-254f23b2a610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d47438b-a5f5-4dfb-a134-c5cd6dc5a397", "name": "network-vif-deleted", "tag": "700b091a-5ee8-4bb5-86f1-61a41c2ee276"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:05.934559 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5749171c-9e39-4f53-bdb8-8ca2008c1c36 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 11e71f42-f1ec-46ca-a349-265766e0483e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:05.955536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9bf49a71-bb62-41c9-b04b-5122e0cbd76c req-41c6e250-0fb4-4807-bd17-254f23b2a610 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:05.958188 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5749171c-9e39-4f53-bdb8-8ca2008c1c36 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:05.958797 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5749171c-9e39-4f53-bdb8-8ca2008c1c36 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:05.959308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5749171c-9e39-4f53-bdb8-8ca2008c1c36 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:05.962046 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5749171c-9e39-4f53-bdb8-8ca2008c1c36 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:05.962591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5749171c-9e39-4f53-bdb8-8ca2008c1c36 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:05.963096 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5749171c-9e39-4f53-bdb8-8ca2008c1c36 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:05.966796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9bf49a71-bb62-41c9-b04b-5122e0cbd76c req-41c6e250-0fb4-4807-bd17-254f23b2a610 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:05.967931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9bf49a71-bb62-41c9-b04b-5122e0cbd76c req-41c6e250-0fb4-4807-bd17-254f23b2a610 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:06.003183 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-9bf49a71-bb62-41c9-b04b-5122e0cbd76c req-41c6e250-0fb4-4807-bd17-254f23b2a610 service nova] Creating event network-vif-deleted:700b091a-5ee8-4bb5-86f1-61a41c2ee276 for instance 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 on n-h2-858272-3 Oct 05 02:46:06.015687 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-9bf49a71-bb62-41c9-b04b-5122e0cbd76c req-41c6e250-0fb4-4807-bd17-254f23b2a610 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102795 Oct 05 02:46:06.020509 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1978/3988] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:46:06.035181 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a4e1b4fd-3614-4daa-97e5-22b570837c70 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:06.036200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a4e1b4fd-3614-4daa-97e5-22b570837c70 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:06.043540 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a4e1b4fd-3614-4daa-97e5-22b570837c70 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:06.044384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a4e1b4fd-3614-4daa-97e5-22b570837c70 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:06.045757 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a4e1b4fd-3614-4daa-97e5-22b570837c70 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:06.046716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a4e1b4fd-3614-4daa-97e5-22b570837c70 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:06.047683 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a4e1b4fd-3614-4daa-97e5-22b570837c70 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:06.049514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a4e1b4fd-3614-4daa-97e5-22b570837c70 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:06.079281 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5749171c-9e39-4f53-bdb8-8ca2008c1c36 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:06.089097 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5749171c-9e39-4f53-bdb8-8ca2008c1c36 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e" status: 200 len: 1273 microversion: 2.1 time: 0.172490 Oct 05 02:46:06.089958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a4e1b4fd-3614-4daa-97e5-22b570837c70 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:06.090077 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2011/3989] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:05 2022] GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e => generated 1273 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:06.090848 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a4e1b4fd-3614-4daa-97e5-22b570837c70 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:06.091501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a4e1b4fd-3614-4daa-97e5-22b570837c70 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:06.092759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-a4e1b4fd-3614-4daa-97e5-22b570837c70 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lazy-loading 'fault' on Instance uuid 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:46:06.134821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e48bfb63-8631-49bc-a48f-e54721fbb89e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:06.136090 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e48bfb63-8631-49bc-a48f-e54721fbb89e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:06.143214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e48bfb63-8631-49bc-a48f-e54721fbb89e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:06.144295 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e48bfb63-8631-49bc-a48f-e54721fbb89e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:06.145585 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e48bfb63-8631-49bc-a48f-e54721fbb89e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:06.146510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e48bfb63-8631-49bc-a48f-e54721fbb89e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:06.147319 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e48bfb63-8631-49bc-a48f-e54721fbb89e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:06.148343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e48bfb63-8631-49bc-a48f-e54721fbb89e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:06.162746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a4e1b4fd-3614-4daa-97e5-22b570837c70 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:06.172572 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a4e1b4fd-3614-4daa-97e5-22b570837c70 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 200 len: 1327 microversion: 2.1 time: 0.149876 Oct 05 02:46:06.173206 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1979/3990] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:06 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 1327 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:06.489692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e48bfb63-8631-49bc-a48f-e54721fbb89e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:06.502246 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e48bfb63-8631-49bc-a48f-e54721fbb89e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc" status: 200 len: 1510 microversion: 2.1 time: 0.371938 Oct 05 02:46:06.521504 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2012/3991] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:06 2022] GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc => generated 1510 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:46:06.918615 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c5d2eca9-7bb3-4d8f-826d-a0074a72cace tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:06.919499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c5d2eca9-7bb3-4d8f-826d-a0074a72cace tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: ac770ead-5d43-4762-9cea-cb163c073d5c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:06.922913 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4a8c7db5-d46b-42f5-815b-4de75634a305 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:06.925408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4a8c7db5-d46b-42f5-815b-4de75634a305 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:06.932947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5d2eca9-7bb3-4d8f-826d-a0074a72cace tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:06.933139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a8c7db5-d46b-42f5-815b-4de75634a305 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:06.933420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5d2eca9-7bb3-4d8f-826d-a0074a72cace tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:06.933884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5d2eca9-7bb3-4d8f-826d-a0074a72cace tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:06.934152 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a8c7db5-d46b-42f5-815b-4de75634a305 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:06.934593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5d2eca9-7bb3-4d8f-826d-a0074a72cace tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:06.934706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a8c7db5-d46b-42f5-815b-4de75634a305 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:06.935045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5d2eca9-7bb3-4d8f-826d-a0074a72cace tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:06.935290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a8c7db5-d46b-42f5-815b-4de75634a305 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:06.935466 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5d2eca9-7bb3-4d8f-826d-a0074a72cace tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:06.936279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a8c7db5-d46b-42f5-815b-4de75634a305 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:06.936838 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a8c7db5-d46b-42f5-815b-4de75634a305 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:07.278701 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4a8c7db5-d46b-42f5-815b-4de75634a305 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:07.317300 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4a8c7db5-d46b-42f5-815b-4de75634a305 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59" status: 200 len: 1507 microversion: 2.1 time: 0.398260 Oct 05 02:46:07.317826 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2013/3992] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:06 2022] GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59 => generated 1507 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:07.349860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a860a30d-779b-4a25-a6b4-71d13c9bcae4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:07.350650 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a860a30d-779b-4a25-a6b4-71d13c9bcae4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 11e71f42-f1ec-46ca-a349-265766e0483e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:07.357133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a860a30d-779b-4a25-a6b4-71d13c9bcae4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:07.358027 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a860a30d-779b-4a25-a6b4-71d13c9bcae4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:07.358659 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a860a30d-779b-4a25-a6b4-71d13c9bcae4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:07.360300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a860a30d-779b-4a25-a6b4-71d13c9bcae4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:07.365557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a860a30d-779b-4a25-a6b4-71d13c9bcae4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:07.366242 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a860a30d-779b-4a25-a6b4-71d13c9bcae4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:07.454314 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c5d2eca9-7bb3-4d8f-826d-a0074a72cace tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14d2fac851e4bbaaa760b5c3406a335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae15e13c1ae4b2db5de94fbd428867d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:07.468640 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c5d2eca9-7bb3-4d8f-826d-a0074a72cace tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c" status: 200 len: 1324 microversion: 2.1 time: 0.556326 Oct 05 02:46:07.470450 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1980/3993] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:06 2022] GET /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c => generated 1324 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:07.484012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-87b531a3-b1d2-45b3-ba69-bef72e57db3a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:07.484663 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-87b531a3-b1d2-45b3-ba69-bef72e57db3a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:07.501297 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87b531a3-b1d2-45b3-ba69-bef72e57db3a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:07.501880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87b531a3-b1d2-45b3-ba69-bef72e57db3a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:07.502333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87b531a3-b1d2-45b3-ba69-bef72e57db3a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:07.503063 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87b531a3-b1d2-45b3-ba69-bef72e57db3a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:07.503520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87b531a3-b1d2-45b3-ba69-bef72e57db3a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:07.503956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87b531a3-b1d2-45b3-ba69-bef72e57db3a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:07.543382 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-87b531a3-b1d2-45b3-ba69-bef72e57db3a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] HTTP exception thrown: Instance 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 could not be found. Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-87b531a3-b1d2-45b3-ba69-bef72e57db3a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Request method failure captured: Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 HTTP/1.1 Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO65ExXFSMcv-UYGFiGC6ownV_rHFtaePi5NC2Vdud2LC6WavS6h4ro52z50RYYtQxAu5Mc3FpnY7BXVdbMqPcgepNZwBqAaHERrgmPzkHi5wlJ9X7Ay3ec5_pcoUMvhRWKtNoSxi-hf2OJVrgwb-n0TSs9Oo3HDatyGWBlHEpMqa4M Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 20891ecf732b4c4597e3bfa0d96585a7 Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-AttachVolumeTestJSON-191918943 Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/20891ecf732b4c4597e3bfa0d96585a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/20891ecf732b4c4597e3bfa0d96585a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/20891ecf732b4c4597e3bfa0d96585a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_20891ecf732b4c4597e3bfa0d96585a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-AttachVolumeTestJSON-191918943 Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 20891ecf732b4c4597e3bfa0d96585a7 Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-AttachVolumeTestJSON-191918943 Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-AttachVolumeTestJSON-191918943-project Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 4c2aedcc40d84bb6a287c2bac019ed4e Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-AttachVolumeTestJSON-191918943-project Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 could not be found. Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '6d47438b-a5f5-4dfb-a134-c5cd6dc5a397'} Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 could not be found. Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 could not be found. Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:46:07.549027 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:46:07.553348 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:46:07.553348 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:46:07.553348 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:46:07.553348 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:46:07.553348 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:46:07.553348 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 could not be found. Oct 05 02:46:07.553348 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:46:07.553348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-87b531a3-b1d2-45b3-ba69-bef72e57db3a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Returning 404 to user: Instance 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:46:07.553348 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-87b531a3-b1d2-45b3-ba69-bef72e57db3a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 404 len: 111 microversion: 2.1 time: 0.079502 Oct 05 02:46:07.558685 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1981/3994] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:07 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:46:07.570805 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d4057172-95d8-40f9-aaea-ea8e3c1f0bd3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:07.573038 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d4057172-95d8-40f9-aaea-ea8e3c1f0bd3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:07.591919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4057172-95d8-40f9-aaea-ea8e3c1f0bd3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:07.592746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4057172-95d8-40f9-aaea-ea8e3c1f0bd3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:07.594466 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4057172-95d8-40f9-aaea-ea8e3c1f0bd3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:07.596375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4057172-95d8-40f9-aaea-ea8e3c1f0bd3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:07.597145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4057172-95d8-40f9-aaea-ea8e3c1f0bd3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:07.597790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4057172-95d8-40f9-aaea-ea8e3c1f0bd3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:07.762660 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a860a30d-779b-4a25-a6b4-71d13c9bcae4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:07.778203 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a860a30d-779b-4a25-a6b4-71d13c9bcae4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e" status: 200 len: 1315 microversion: 2.1 time: 0.456330 Oct 05 02:46:07.785564 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2014/3995] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:07 2022] GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e => generated 1315 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:07.804825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-955f41d8-08f4-4fd5-b0df-19828d808a35 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '.version_select at 0x7fcce811a790>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:07.866089 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-955f41d8-08f4-4fd5-b0df-19828d808a35 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-874834135" status: 202 len: 0 microversion: 2.1 time: 0.079355 Oct 05 02:46:07.870539 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2015/3996] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 5 02:46:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-874834135 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:46:08.050603 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d4057172-95d8-40f9-aaea-ea8e3c1f0bd3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:08.064647 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d4057172-95d8-40f9-aaea-ea8e3c1f0bd3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc" status: 200 len: 1510 microversion: 2.1 time: 0.504606 Oct 05 02:46:08.067605 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1982/3997] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:07 2022] GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc => generated 1510 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:08.342769 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2f262485-6d5c-4b2f-a2b2-ec5ceb0c923d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:08.345042 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2f262485-6d5c-4b2f-a2b2-ec5ceb0c923d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:08.362912 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f262485-6d5c-4b2f-a2b2-ec5ceb0c923d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:08.365730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f262485-6d5c-4b2f-a2b2-ec5ceb0c923d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:08.366344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f262485-6d5c-4b2f-a2b2-ec5ceb0c923d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:08.369193 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f262485-6d5c-4b2f-a2b2-ec5ceb0c923d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:08.369940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f262485-6d5c-4b2f-a2b2-ec5ceb0c923d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:08.370661 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f262485-6d5c-4b2f-a2b2-ec5ceb0c923d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:08.497379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ffbc7f47-2f9e-49db-b289-1ec172d304ab tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:08.499191 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ffbc7f47-2f9e-49db-b289-1ec172d304ab tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: ac770ead-5d43-4762-9cea-cb163c073d5c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:08.516119 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ffbc7f47-2f9e-49db-b289-1ec172d304ab tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:08.517131 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ffbc7f47-2f9e-49db-b289-1ec172d304ab tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:08.519580 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ffbc7f47-2f9e-49db-b289-1ec172d304ab tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:08.521964 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ffbc7f47-2f9e-49db-b289-1ec172d304ab tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:08.522571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ffbc7f47-2f9e-49db-b289-1ec172d304ab tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:08.523505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ffbc7f47-2f9e-49db-b289-1ec172d304ab tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:08.981889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ffbc7f47-2f9e-49db-b289-1ec172d304ab tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14d2fac851e4bbaaa760b5c3406a335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae15e13c1ae4b2db5de94fbd428867d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:08.991115 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ffbc7f47-2f9e-49db-b289-1ec172d304ab tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c" status: 200 len: 1324 microversion: 2.1 time: 0.498466 Oct 05 02:46:08.991713 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1983/3998] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:08 2022] GET /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c => generated 1324 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:46:09.006852 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0b3720a1-9635-4b6a-96c4-4dcd2cf5868d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:09.008198 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0b3720a1-9635-4b6a-96c4-4dcd2cf5868d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 11e71f42-f1ec-46ca-a349-265766e0483e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:09.022271 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b3720a1-9635-4b6a-96c4-4dcd2cf5868d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:09.022961 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b3720a1-9635-4b6a-96c4-4dcd2cf5868d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:09.023584 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b3720a1-9635-4b6a-96c4-4dcd2cf5868d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:09.024457 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b3720a1-9635-4b6a-96c4-4dcd2cf5868d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:09.028456 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b3720a1-9635-4b6a-96c4-4dcd2cf5868d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:09.029159 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b3720a1-9635-4b6a-96c4-4dcd2cf5868d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:09.067565 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2f262485-6d5c-4b2f-a2b2-ec5ceb0c923d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:09.081589 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2f262485-6d5c-4b2f-a2b2-ec5ceb0c923d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59" status: 200 len: 1507 microversion: 2.1 time: 0.744074 Oct 05 02:46:09.085415 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2016/3999] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:08 2022] GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59 => generated 1507 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:09.098285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3618ccb4-b5b3-4e90-bb8c-3c6c42b0f955 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:09.100160 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3618ccb4-b5b3-4e90-bb8c-3c6c42b0f955 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:09.118742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3618ccb4-b5b3-4e90-bb8c-3c6c42b0f955 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:09.120770 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3618ccb4-b5b3-4e90-bb8c-3c6c42b0f955 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:09.121413 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3618ccb4-b5b3-4e90-bb8c-3c6c42b0f955 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:09.123524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3618ccb4-b5b3-4e90-bb8c-3c6c42b0f955 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:09.126161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3618ccb4-b5b3-4e90-bb8c-3c6c42b0f955 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:09.127069 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3618ccb4-b5b3-4e90-bb8c-3c6c42b0f955 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:09.339927 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:09.395735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=22 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:09.574576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3618ccb4-b5b3-4e90-bb8c-3c6c42b0f955 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:09.591340 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3618ccb4-b5b3-4e90-bb8c-3c6c42b0f955 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc" status: 200 len: 1510 microversion: 2.1 time: 0.503067 Oct 05 02:46:09.592725 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2017/4000] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:09 2022] GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc => generated 1510 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:09.667995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0b3720a1-9635-4b6a-96c4-4dcd2cf5868d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:09.693406 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0b3720a1-9635-4b6a-96c4-4dcd2cf5868d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e" status: 200 len: 1315 microversion: 2.1 time: 0.700303 Oct 05 02:46:09.694179 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1984/4001] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:08 2022] GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e => generated 1315 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:09.925048 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-330c840a-ada1-448f-8732-c915ac919d17 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Action: 'create', calling method: .version_select at 0x7fccdf265c10>, body: {"keypair": {"name": "tempest-keypair-1334904593", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcHBj4Jii6rS5geYvCCeFje7lSyPBmiXJ2qSx2MAqXItkPHd1n3PB2PbU1wncdKGXS3+fCpIhfiR2cjeOsw0INktYGKDLQdNIkYlJGV4mcdT8Tct4ZDzjj469dW4wOwCw=="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:09.942008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-330c840a-ada1-448f-8732-c915ac919d17 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Getting quotas for project 20891ecf732b4c4597e3bfa0d96585a7. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:46:09.952431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-330c840a-ada1-448f-8732-c915ac919d17 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Getting quotas for user 4c2aedcc40d84bb6a287c2bac019ed4e and project 20891ecf732b4c4597e3bfa0d96585a7. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:46:09.989004 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-330c840a-ada1-448f-8732-c915ac919d17 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.072389 Oct 05 02:46:09.989624 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2018/4002] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 02:46:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:46:10.017070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1a944473-c140-4036-8c91-b7e6d44229d3 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:10.018166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1a944473-c140-4036-8c91-b7e6d44229d3 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: ac770ead-5d43-4762-9cea-cb163c073d5c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:10.025630 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a944473-c140-4036-8c91-b7e6d44229d3 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:10.026413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a944473-c140-4036-8c91-b7e6d44229d3 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:10.027236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a944473-c140-4036-8c91-b7e6d44229d3 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:10.028291 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a944473-c140-4036-8c91-b7e6d44229d3 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:10.028788 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a944473-c140-4036-8c91-b7e6d44229d3 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:10.030064 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a944473-c140-4036-8c91-b7e6d44229d3 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:10.113634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-688aba43-8f9a-46ba-a1b0-771242d4a737 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:10.114377 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-688aba43-8f9a-46ba-a1b0-771242d4a737 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:10.125475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-688aba43-8f9a-46ba-a1b0-771242d4a737 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:10.126227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-688aba43-8f9a-46ba-a1b0-771242d4a737 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:10.128925 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-688aba43-8f9a-46ba-a1b0-771242d4a737 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:10.129906 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-688aba43-8f9a-46ba-a1b0-771242d4a737 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:10.130614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-688aba43-8f9a-46ba-a1b0-771242d4a737 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:10.132270 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-688aba43-8f9a-46ba-a1b0-771242d4a737 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:10.411552 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1a944473-c140-4036-8c91-b7e6d44229d3 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14d2fac851e4bbaaa760b5c3406a335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae15e13c1ae4b2db5de94fbd428867d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:10.420980 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1a944473-c140-4036-8c91-b7e6d44229d3 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c" status: 200 len: 1324 microversion: 2.1 time: 0.407700 Oct 05 02:46:10.421901 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1985/4003] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:10 2022] GET /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c => generated 1324 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:10.449709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-688aba43-8f9a-46ba-a1b0-771242d4a737 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:10.465344 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-688aba43-8f9a-46ba-a1b0-771242d4a737 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59" status: 200 len: 1507 microversion: 2.1 time: 0.355401 Oct 05 02:46:10.466324 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2019/4004] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:10 2022] GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59 => generated 1507 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:10.618559 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-280421d4-57bd-4b56-9a75-3d2cd36e36d7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:10.620040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-280421d4-57bd-4b56-9a75-3d2cd36e36d7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:10.633746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-280421d4-57bd-4b56-9a75-3d2cd36e36d7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:10.634484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-280421d4-57bd-4b56-9a75-3d2cd36e36d7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:10.635269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-280421d4-57bd-4b56-9a75-3d2cd36e36d7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:10.636681 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-280421d4-57bd-4b56-9a75-3d2cd36e36d7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:10.637570 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-280421d4-57bd-4b56-9a75-3d2cd36e36d7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:10.638154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-280421d4-57bd-4b56-9a75-3d2cd36e36d7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:10.676338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:10.725705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-48f2705c-4ef8-4a8f-b8de-be622f3ff45b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:10.730228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-48f2705c-4ef8-4a8f-b8de-be622f3ff45b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 11e71f42-f1ec-46ca-a349-265766e0483e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:10.745988 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48f2705c-4ef8-4a8f-b8de-be622f3ff45b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:10.746494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48f2705c-4ef8-4a8f-b8de-be622f3ff45b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:10.747256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48f2705c-4ef8-4a8f-b8de-be622f3ff45b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:10.748380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48f2705c-4ef8-4a8f-b8de-be622f3ff45b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:10.748936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48f2705c-4ef8-4a8f-b8de-be622f3ff45b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:10.749539 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48f2705c-4ef8-4a8f-b8de-be622f3ff45b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:11.118538 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-280421d4-57bd-4b56-9a75-3d2cd36e36d7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:11.129128 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-280421d4-57bd-4b56-9a75-3d2cd36e36d7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc" status: 200 len: 1510 microversion: 2.1 time: 0.515683 Oct 05 02:46:11.139375 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1986/4005] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:10 2022] GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc => generated 1510 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:11.204727 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-48f2705c-4ef8-4a8f-b8de-be622f3ff45b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:11.223272 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-48f2705c-4ef8-4a8f-b8de-be622f3ff45b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e" status: 200 len: 1315 microversion: 2.1 time: 0.506835 Oct 05 02:46:11.238351 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2020/4006] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:10 2022] GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e => generated 1315 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:11.450995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9c90e36d-66a1-4c2b-9807-b618c514364c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:11.451654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9c90e36d-66a1-4c2b-9807-b618c514364c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: ac770ead-5d43-4762-9cea-cb163c073d5c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:11.465583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c90e36d-66a1-4c2b-9807-b618c514364c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:11.466088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c90e36d-66a1-4c2b-9807-b618c514364c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:11.466531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c90e36d-66a1-4c2b-9807-b618c514364c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:11.467779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c90e36d-66a1-4c2b-9807-b618c514364c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:11.468230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c90e36d-66a1-4c2b-9807-b618c514364c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:11.468761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c90e36d-66a1-4c2b-9807-b618c514364c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:11.494657 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d2cfe02e-c52d-437c-b95f-33020b6c366a tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:11.495480 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d2cfe02e-c52d-437c-b95f-33020b6c366a tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:11.513386 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2cfe02e-c52d-437c-b95f-33020b6c366a tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:11.514038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2cfe02e-c52d-437c-b95f-33020b6c366a tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:11.514607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2cfe02e-c52d-437c-b95f-33020b6c366a tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:11.525434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2cfe02e-c52d-437c-b95f-33020b6c366a tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:11.526087 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2cfe02e-c52d-437c-b95f-33020b6c366a tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:11.526537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2cfe02e-c52d-437c-b95f-33020b6c366a tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:12.061144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9c90e36d-66a1-4c2b-9807-b618c514364c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14d2fac851e4bbaaa760b5c3406a335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae15e13c1ae4b2db5de94fbd428867d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:12.078168 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9c90e36d-66a1-4c2b-9807-b618c514364c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c" status: 200 len: 1324 microversion: 2.1 time: 0.630728 Oct 05 02:46:12.079159 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1987/4007] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:11 2022] GET /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c => generated 1324 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:12.104721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d2cfe02e-c52d-437c-b95f-33020b6c366a tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:12.118855 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d2cfe02e-c52d-437c-b95f-33020b6c366a tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59" status: 200 len: 1507 microversion: 2.1 time: 0.628215 Oct 05 02:46:12.123023 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2021/4008] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:11 2022] GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59 => generated 1507 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:46:12.156591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a3feb87d-d3e9-4c39-894b-889c22a0c3a2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:12.157640 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a3feb87d-d3e9-4c39-894b-889c22a0c3a2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:12.170846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3feb87d-d3e9-4c39-894b-889c22a0c3a2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:12.171634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3feb87d-d3e9-4c39-894b-889c22a0c3a2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:12.172461 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3feb87d-d3e9-4c39-894b-889c22a0c3a2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:12.174403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3feb87d-d3e9-4c39-894b-889c22a0c3a2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:12.176948 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3feb87d-d3e9-4c39-894b-889c22a0c3a2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:12.177647 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3feb87d-d3e9-4c39-894b-889c22a0c3a2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:12.261238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b48207cb-1398-4d34-86e9-d0483dd7b6d4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:12.262148 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b48207cb-1398-4d34-86e9-d0483dd7b6d4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 11e71f42-f1ec-46ca-a349-265766e0483e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:12.270963 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b48207cb-1398-4d34-86e9-d0483dd7b6d4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:12.273247 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b48207cb-1398-4d34-86e9-d0483dd7b6d4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:12.273796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b48207cb-1398-4d34-86e9-d0483dd7b6d4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:12.274594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b48207cb-1398-4d34-86e9-d0483dd7b6d4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:12.277369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b48207cb-1398-4d34-86e9-d0483dd7b6d4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:12.277928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b48207cb-1398-4d34-86e9-d0483dd7b6d4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:12.612750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a3feb87d-d3e9-4c39-894b-889c22a0c3a2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:12.621171 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a3feb87d-d3e9-4c39-894b-889c22a0c3a2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc" status: 200 len: 1510 microversion: 2.1 time: 0.469857 Oct 05 02:46:12.621970 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1988/4009] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:12 2022] GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc => generated 1510 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:12.627021 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-9d4dd1bb-4738-40ce-aea8-ffa4f75a80f2 req-28a3cf37-be8b-47fb-bfb0-f3433020843a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac770ead-5d43-4762-9cea-cb163c073d5c", "name": "network-vif-plugged", "status": "completed", "tag": "376ff818-7bff-4848-847c-b6e88a6b8588"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:12.648023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b48207cb-1398-4d34-86e9-d0483dd7b6d4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:12.701528 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b48207cb-1398-4d34-86e9-d0483dd7b6d4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e" status: 200 len: 1315 microversion: 2.1 time: 0.444066 Oct 05 02:46:12.702441 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2022/4010] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:12 2022] GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:12.706214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9d4dd1bb-4738-40ce-aea8-ffa4f75a80f2 req-28a3cf37-be8b-47fb-bfb0-f3433020843a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:12.707007 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9d4dd1bb-4738-40ce-aea8-ffa4f75a80f2 req-28a3cf37-be8b-47fb-bfb0-f3433020843a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:12.707733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9d4dd1bb-4738-40ce-aea8-ffa4f75a80f2 req-28a3cf37-be8b-47fb-bfb0-f3433020843a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:12.724568 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-9d4dd1bb-4738-40ce-aea8-ffa4f75a80f2 req-28a3cf37-be8b-47fb-bfb0-f3433020843a service nova] Creating event network-vif-plugged:376ff818-7bff-4848-847c-b6e88a6b8588 for instance ac770ead-5d43-4762-9cea-cb163c073d5c on n-h1-858272-3 Oct 05 02:46:12.734545 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-9d4dd1bb-4738-40ce-aea8-ffa4f75a80f2 req-28a3cf37-be8b-47fb-bfb0-f3433020843a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111355 Oct 05 02:46:12.740718 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1989/4011] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:46:13.091294 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-2a45f17a-7ec2-4a1a-99a5-877599eb6af4 req-2d6795b3-b078-4fc4-9af1-ae1b13d23ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11e71f42-f1ec-46ca-a349-265766e0483e", "tag": "acd2b4f7-d1b4-4033-a1e1-e9724ea51b97"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:13.103622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-2a45f17a-7ec2-4a1a-99a5-877599eb6af4 req-2d6795b3-b078-4fc4-9af1-ae1b13d23ab4 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:13.105121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-2a45f17a-7ec2-4a1a-99a5-877599eb6af4 req-2d6795b3-b078-4fc4-9af1-ae1b13d23ab4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:13.106289 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-2a45f17a-7ec2-4a1a-99a5-877599eb6af4 req-2d6795b3-b078-4fc4-9af1-ae1b13d23ab4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:13.108125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-11cf0b0e-fc15-45c8-9271-8b2171e24271 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:13.108834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-11cf0b0e-fc15-45c8-9271-8b2171e24271 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: ac770ead-5d43-4762-9cea-cb163c073d5c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:13.125504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11cf0b0e-fc15-45c8-9271-8b2171e24271 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:13.126833 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11cf0b0e-fc15-45c8-9271-8b2171e24271 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:13.127723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11cf0b0e-fc15-45c8-9271-8b2171e24271 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:13.128653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11cf0b0e-fc15-45c8-9271-8b2171e24271 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:13.129320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11cf0b0e-fc15-45c8-9271-8b2171e24271 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:13.129956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11cf0b0e-fc15-45c8-9271-8b2171e24271 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:13.147913 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-2a45f17a-7ec2-4a1a-99a5-877599eb6af4 req-2d6795b3-b078-4fc4-9af1-ae1b13d23ab4 service nova] Creating event network-changed:acd2b4f7-d1b4-4033-a1e1-e9724ea51b97 for instance 11e71f42-f1ec-46ca-a349-265766e0483e on n-h2-858272-3 Oct 05 02:46:13.181361 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-2a45f17a-7ec2-4a1a-99a5-877599eb6af4 req-2d6795b3-b078-4fc4-9af1-ae1b13d23ab4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090161 Oct 05 02:46:13.181361 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2023/4012] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:46:13.195726 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8120d6f0-1c2e-4e5e-aca3-5175a38df5f0 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:13.196455 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8120d6f0-1c2e-4e5e-aca3-5175a38df5f0 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:13.210028 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8120d6f0-1c2e-4e5e-aca3-5175a38df5f0 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:13.210522 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8120d6f0-1c2e-4e5e-aca3-5175a38df5f0 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:13.210955 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8120d6f0-1c2e-4e5e-aca3-5175a38df5f0 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:13.212176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8120d6f0-1c2e-4e5e-aca3-5175a38df5f0 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:13.212641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8120d6f0-1c2e-4e5e-aca3-5175a38df5f0 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:13.213240 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8120d6f0-1c2e-4e5e-aca3-5175a38df5f0 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:14.053930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-11cf0b0e-fc15-45c8-9271-8b2171e24271 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14d2fac851e4bbaaa760b5c3406a335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae15e13c1ae4b2db5de94fbd428867d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:14.067369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8120d6f0-1c2e-4e5e-aca3-5175a38df5f0 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:14.093040 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-11cf0b0e-fc15-45c8-9271-8b2171e24271 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c" status: 200 len: 1324 microversion: 2.1 time: 0.988295 Oct 05 02:46:14.094622 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8120d6f0-1c2e-4e5e-aca3-5175a38df5f0 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59" status: 200 len: 1507 microversion: 2.1 time: 0.912233 Oct 05 02:46:14.095278 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1990/4013] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:13 2022] GET /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c => generated 1324 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:46:14.115069 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2024/4014] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:13 2022] GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59 => generated 1507 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:14.125062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6a104cb1-68ed-4712-b098-75bf8e372dca tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:14.126064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6a104cb1-68ed-4712-b098-75bf8e372dca tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 11e71f42-f1ec-46ca-a349-265766e0483e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:14.132250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ef22b144-2c31-49fd-869a-46f951b757c3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:14.133462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a104cb1-68ed-4712-b098-75bf8e372dca tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:14.134210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a104cb1-68ed-4712-b098-75bf8e372dca tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:14.134960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ef22b144-2c31-49fd-869a-46f951b757c3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:14.135523 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a104cb1-68ed-4712-b098-75bf8e372dca tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:14.136457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a104cb1-68ed-4712-b098-75bf8e372dca tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:14.137280 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a104cb1-68ed-4712-b098-75bf8e372dca tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:14.137920 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a104cb1-68ed-4712-b098-75bf8e372dca tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:14.154244 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef22b144-2c31-49fd-869a-46f951b757c3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:14.155189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef22b144-2c31-49fd-869a-46f951b757c3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:14.155828 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef22b144-2c31-49fd-869a-46f951b757c3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:14.156556 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef22b144-2c31-49fd-869a-46f951b757c3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:14.159565 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef22b144-2c31-49fd-869a-46f951b757c3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:14.162349 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef22b144-2c31-49fd-869a-46f951b757c3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:14.663343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ef22b144-2c31-49fd-869a-46f951b757c3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:14.671667 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ef22b144-2c31-49fd-869a-46f951b757c3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc" status: 200 len: 1510 microversion: 2.1 time: 0.564151 Oct 05 02:46:14.676820 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1991/4015] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:14 2022] GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc => generated 1510 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:14.702268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6a104cb1-68ed-4712-b098-75bf8e372dca tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:14.712061 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6a104cb1-68ed-4712-b098-75bf8e372dca tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e" status: 200 len: 1315 microversion: 2.1 time: 0.595983 Oct 05 02:46:14.713027 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2025/4016] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:14 2022] GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e => generated 1315 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:14.989447 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fff59e3d-1e41-4809-8237-89b214457226 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1088741871", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "74605e79-96c6-45a8-ae1a-732547f9e79d"}], "security_groups": [{"name": "tempest-securitygroup--1426579380"}], "key_name": "tempest-keypair-1334904593", "user_data": "}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:15.119791 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d3349395-8f57-4b48-a097-41964102a8df tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:15.120705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d3349395-8f57-4b48-a097-41964102a8df tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: ac770ead-5d43-4762-9cea-cb163c073d5c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:15.124336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:15.132858 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3349395-8f57-4b48-a097-41964102a8df tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:15.133662 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3349395-8f57-4b48-a097-41964102a8df tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:15.134258 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3349395-8f57-4b48-a097-41964102a8df tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:15.135150 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3349395-8f57-4b48-a097-41964102a8df tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:15.135755 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3349395-8f57-4b48-a097-41964102a8df tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:15.136337 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3349395-8f57-4b48-a097-41964102a8df tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:15.365836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-fff59e3d-1e41-4809-8237-89b214457226 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] validate_networks() for [('74605e79-96c6-45a8-ae1a-732547f9e79d', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:46:15.474967 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d3349395-8f57-4b48-a097-41964102a8df tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14d2fac851e4bbaaa760b5c3406a335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae15e13c1ae4b2db5de94fbd428867d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:15.489707 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d3349395-8f57-4b48-a097-41964102a8df tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c" status: 200 len: 1521 microversion: 2.1 time: 0.377465 Oct 05 02:46:15.514310 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2026/4017] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:15 2022] GET /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c => generated 1521 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:46:15.519512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2964c878-f28e-4337-a951-3eb69a42610c tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:15.520342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2964c878-f28e-4337-a951-3eb69a42610c tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:15.527496 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2964c878-f28e-4337-a951-3eb69a42610c tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:15.528228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2964c878-f28e-4337-a951-3eb69a42610c tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:15.528814 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2964c878-f28e-4337-a951-3eb69a42610c tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:15.529722 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2964c878-f28e-4337-a951-3eb69a42610c tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:15.530325 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2964c878-f28e-4337-a951-3eb69a42610c tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:15.530889 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2964c878-f28e-4337-a951-3eb69a42610c tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:15.993978 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2964c878-f28e-4337-a951-3eb69a42610c tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:16.006179 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2964c878-f28e-4337-a951-3eb69a42610c tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59" status: 200 len: 1507 microversion: 2.1 time: 0.490425 Oct 05 02:46:16.006824 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2027/4018] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:15 2022] GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59 => generated 1507 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:16.025309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4583c3e6-48ed-42a2-a5c6-dc508d9fc188 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.3"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:16.037724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4583c3e6-48ed-42a2-a5c6-dc508d9fc188 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: c2d68022-2fa3-4464-8004-262c23e41ea2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:16.062816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4583c3e6-48ed-42a2-a5c6-dc508d9fc188 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:16.063755 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4583c3e6-48ed-42a2-a5c6-dc508d9fc188 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:16.068408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4583c3e6-48ed-42a2-a5c6-dc508d9fc188 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:16.070424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4583c3e6-48ed-42a2-a5c6-dc508d9fc188 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:16.070930 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4583c3e6-48ed-42a2-a5c6-dc508d9fc188 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:16.071373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4583c3e6-48ed-42a2-a5c6-dc508d9fc188 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:16.132653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4583c3e6-48ed-42a2-a5c6-dc508d9fc188 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "refresh_cache-c2d68022-2fa3-4464-8004-262c23e41ea2" {{(pid=122320) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 05 02:46:16.135580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4583c3e6-48ed-42a2-a5c6-dc508d9fc188 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquired lock "refresh_cache-c2d68022-2fa3-4464-8004-262c23e41ea2" {{(pid=122320) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 05 02:46:16.864377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-fff59e3d-1e41-4809-8237-89b214457226 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:46:16.865726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-fff59e3d-1e41-4809-8237-89b214457226 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:46:16.865726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-fff59e3d-1e41-4809-8237-89b214457226 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:46:16.865726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-fff59e3d-1e41-4809-8237-89b214457226 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:46:16.866110 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-fff59e3d-1e41-4809-8237-89b214457226 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:46:16.883921 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fff59e3d-1e41-4809-8237-89b214457226 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:16.884411 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fff59e3d-1e41-4809-8237-89b214457226 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:16.885065 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fff59e3d-1e41-4809-8237-89b214457226 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:16.889365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fff59e3d-1e41-4809-8237-89b214457226 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:16.890060 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fff59e3d-1e41-4809-8237-89b214457226 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:16.890661 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fff59e3d-1e41-4809-8237-89b214457226 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:16.929082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-fff59e3d-1e41-4809-8237-89b214457226 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Getting quotas for project 20891ecf732b4c4597e3bfa0d96585a7. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:46:16.944728 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-fff59e3d-1e41-4809-8237-89b214457226 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Getting quotas for user 4c2aedcc40d84bb6a287c2bac019ed4e and project 20891ecf732b4c4597e3bfa0d96585a7. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:46:16.959725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fff59e3d-1e41-4809-8237-89b214457226 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:46:16.962481 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fff59e3d-1e41-4809-8237-89b214457226 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: ae8e1003-15ab-4801-a026-e9d80e200d3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:46:17.031515 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fff59e3d-1e41-4809-8237-89b214457226 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.046233 Oct 05 02:46:17.032746 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1992/4019] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:46:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 2048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:46:17.037847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7232d35a-9e37-436c-8684-6b7f732d2181 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:17.039011 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7232d35a-9e37-436c-8684-6b7f732d2181 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:17.046408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7232d35a-9e37-436c-8684-6b7f732d2181 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:17.047136 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7232d35a-9e37-436c-8684-6b7f732d2181 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:17.047757 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7232d35a-9e37-436c-8684-6b7f732d2181 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:17.048760 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7232d35a-9e37-436c-8684-6b7f732d2181 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:17.049392 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7232d35a-9e37-436c-8684-6b7f732d2181 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:17.049974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7232d35a-9e37-436c-8684-6b7f732d2181 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:18.165744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7232d35a-9e37-436c-8684-6b7f732d2181 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:18.175504 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7232d35a-9e37-436c-8684-6b7f732d2181 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc" status: 200 len: 1510 microversion: 2.1 time: 1.141520 Oct 05 02:46:18.189283 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1993/4020] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:17 2022] GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc => generated 1510 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:18.196969 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a89d886b-c2e1-41e2-b1c9-45533e8e667b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:18.197536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a89d886b-c2e1-41e2-b1c9-45533e8e667b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 11e71f42-f1ec-46ca-a349-265766e0483e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:18.211514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a89d886b-c2e1-41e2-b1c9-45533e8e667b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:18.212404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a89d886b-c2e1-41e2-b1c9-45533e8e667b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:18.213232 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a89d886b-c2e1-41e2-b1c9-45533e8e667b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:18.214649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a89d886b-c2e1-41e2-b1c9-45533e8e667b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:18.215608 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a89d886b-c2e1-41e2-b1c9-45533e8e667b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:18.216406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a89d886b-c2e1-41e2-b1c9-45533e8e667b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:18.970725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a89d886b-c2e1-41e2-b1c9-45533e8e667b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:18.981441 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a89d886b-c2e1-41e2-b1c9-45533e8e667b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e" status: 200 len: 1315 microversion: 2.1 time: 0.790529 Oct 05 02:46:18.982384 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1994/4021] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:18 2022] GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e => generated 1315 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:18.992815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5ed82499-beda-4c11-9b23-01e044ee1afc tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:18.994140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5ed82499-beda-4c11-9b23-01e044ee1afc tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:19.017665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ed82499-beda-4c11-9b23-01e044ee1afc tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:19.023806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ed82499-beda-4c11-9b23-01e044ee1afc tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:19.025749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ed82499-beda-4c11-9b23-01e044ee1afc tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:19.030007 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ed82499-beda-4c11-9b23-01e044ee1afc tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:19.031699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ed82499-beda-4c11-9b23-01e044ee1afc tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:19.032154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ed82499-beda-4c11-9b23-01e044ee1afc tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:19.438407 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5ed82499-beda-4c11-9b23-01e044ee1afc tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:19.469909 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5ed82499-beda-4c11-9b23-01e044ee1afc tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59" status: 200 len: 1507 microversion: 2.1 time: 0.481503 Oct 05 02:46:19.471449 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1995/4022] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:18 2022] GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59 => generated 1507 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:19.497073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f5eb82aa-97cc-41e4-b566-e058c5716db5 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:19.499179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f5eb82aa-97cc-41e4-b566-e058c5716db5 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: ae8e1003-15ab-4801-a026-e9d80e200d3c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:19.507747 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5eb82aa-97cc-41e4-b566-e058c5716db5 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:19.508863 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5eb82aa-97cc-41e4-b566-e058c5716db5 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:19.509552 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5eb82aa-97cc-41e4-b566-e058c5716db5 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:19.510490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5eb82aa-97cc-41e4-b566-e058c5716db5 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:19.511111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5eb82aa-97cc-41e4-b566-e058c5716db5 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:19.511709 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5eb82aa-97cc-41e4-b566-e058c5716db5 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:19.648324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f5eb82aa-97cc-41e4-b566-e058c5716db5 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:19.658992 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f5eb82aa-97cc-41e4-b566-e058c5716db5 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c" status: 200 len: 1296 microversion: 2.1 time: 0.185343 Oct 05 02:46:19.662559 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1996/4023] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:19 2022] GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c => generated 1296 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:19.676516 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-eeb5976f-910a-4b3e-ae65-44ca7582417b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:19.677379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-eeb5976f-910a-4b3e-ae65-44ca7582417b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:19.693219 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eeb5976f-910a-4b3e-ae65-44ca7582417b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:19.693728 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eeb5976f-910a-4b3e-ae65-44ca7582417b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:19.694174 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eeb5976f-910a-4b3e-ae65-44ca7582417b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:19.695891 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eeb5976f-910a-4b3e-ae65-44ca7582417b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:19.697408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eeb5976f-910a-4b3e-ae65-44ca7582417b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:19.697854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eeb5976f-910a-4b3e-ae65-44ca7582417b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:19.966963 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:19.977881 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-eeb5976f-910a-4b3e-ae65-44ca7582417b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:20.019238 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-eeb5976f-910a-4b3e-ae65-44ca7582417b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc" status: 200 len: 1487 microversion: 2.1 time: 0.355190 Oct 05 02:46:20.048421 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1997/4024] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:19 2022] GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc => generated 1487 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:20.061084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9947b107-d659-44ac-898e-67bd0e8fcf02 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:20.063704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9947b107-d659-44ac-898e-67bd0e8fcf02 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 11e71f42-f1ec-46ca-a349-265766e0483e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:20.108003 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9947b107-d659-44ac-898e-67bd0e8fcf02 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:20.112857 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9947b107-d659-44ac-898e-67bd0e8fcf02 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:20.115387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9947b107-d659-44ac-898e-67bd0e8fcf02 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:20.118616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9947b107-d659-44ac-898e-67bd0e8fcf02 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:20.121686 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9947b107-d659-44ac-898e-67bd0e8fcf02 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:20.123356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9947b107-d659-44ac-898e-67bd0e8fcf02 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:20.460017 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-4583c3e6-48ed-42a2-a5c6-dc508d9fc188 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: c2d68022-2fa3-4464-8004-262c23e41ea2] Building network info cache for instance {{(pid=122320) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 05 02:46:20.519026 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9947b107-d659-44ac-898e-67bd0e8fcf02 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:20.536333 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9947b107-d659-44ac-898e-67bd0e8fcf02 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e" status: 200 len: 1315 microversion: 2.1 time: 0.485000 Oct 05 02:46:20.538106 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1998/4025] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:20 2022] GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e => generated 1315 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:20.567938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-385f103c-acb4-4e06-b549-6bc28eaed771 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:20.579492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-385f103c-acb4-4e06-b549-6bc28eaed771 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:20.595420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-385f103c-acb4-4e06-b549-6bc28eaed771 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:20.596125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-385f103c-acb4-4e06-b549-6bc28eaed771 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:20.596667 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-385f103c-acb4-4e06-b549-6bc28eaed771 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:20.597463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-385f103c-acb4-4e06-b549-6bc28eaed771 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:20.599841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-385f103c-acb4-4e06-b549-6bc28eaed771 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:20.602038 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-385f103c-acb4-4e06-b549-6bc28eaed771 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:20.723348 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-385f103c-acb4-4e06-b549-6bc28eaed771 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action" status: 200 len: 122 microversion: 2.1 time: 0.183417 Oct 05 02:46:20.724183 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 1999/4026] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:46:20 2022] POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action => generated 122 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:46:20.735749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-028f8cd9-f1ac-4e51-b287-c6bfd9977be7 req-c68a91c0-771b-4698-bc85-d79ab70d8aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e71f42-f1ec-46ca-a349-265766e0483e", "name": "network-vif-plugged", "status": "completed", "tag": "acd2b4f7-d1b4-4033-a1e1-e9724ea51b97"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:20.772679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-028f8cd9-f1ac-4e51-b287-c6bfd9977be7 req-c68a91c0-771b-4698-bc85-d79ab70d8aa0 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:20.774694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-028f8cd9-f1ac-4e51-b287-c6bfd9977be7 req-c68a91c0-771b-4698-bc85-d79ab70d8aa0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:20.777357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-028f8cd9-f1ac-4e51-b287-c6bfd9977be7 req-c68a91c0-771b-4698-bc85-d79ab70d8aa0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:20.795057 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-028f8cd9-f1ac-4e51-b287-c6bfd9977be7 req-c68a91c0-771b-4698-bc85-d79ab70d8aa0 service nova] Creating event network-vif-plugged:acd2b4f7-d1b4-4033-a1e1-e9724ea51b97 for instance 11e71f42-f1ec-46ca-a349-265766e0483e on n-h2-858272-3 Oct 05 02:46:20.802198 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-028f8cd9-f1ac-4e51-b287-c6bfd9977be7 req-c68a91c0-771b-4698-bc85-d79ab70d8aa0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076009 Oct 05 02:46:20.803144 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2000/4027] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:46:20.817355 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-d4cf64a0-305f-44a2-989d-f98566873ea1 req-cf41a3ad-8abb-46b6-b5f5-67c406475e28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2d68022-2fa3-4464-8004-262c23e41ea2", "tag": "baf1bb4d-f79e-4dc4-903a-f0407e6bf5d8"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:20.839939 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:20.845992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d4cf64a0-305f-44a2-989d-f98566873ea1 req-cf41a3ad-8abb-46b6-b5f5-67c406475e28 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:20.849631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d4cf64a0-305f-44a2-989d-f98566873ea1 req-cf41a3ad-8abb-46b6-b5f5-67c406475e28 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:20.850351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d4cf64a0-305f-44a2-989d-f98566873ea1 req-cf41a3ad-8abb-46b6-b5f5-67c406475e28 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:20.874924 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-d4cf64a0-305f-44a2-989d-f98566873ea1 req-cf41a3ad-8abb-46b6-b5f5-67c406475e28 service nova] Creating event network-changed:baf1bb4d-f79e-4dc4-903a-f0407e6bf5d8 for instance c2d68022-2fa3-4464-8004-262c23e41ea2 on n-h2-858272-3 Oct 05 02:46:20.899262 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-d4cf64a0-305f-44a2-989d-f98566873ea1 req-cf41a3ad-8abb-46b6-b5f5-67c406475e28 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094365 Oct 05 02:46:20.903041 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2001/4028] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:46:20.917337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-97b06dac-15c9-458b-974e-f47f76fc10b2 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:20.918568 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-97b06dac-15c9-458b-974e-f47f76fc10b2 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:20.935871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-97b06dac-15c9-458b-974e-f47f76fc10b2 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:20.937252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-97b06dac-15c9-458b-974e-f47f76fc10b2 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:20.941232 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-97b06dac-15c9-458b-974e-f47f76fc10b2 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:20.943669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-97b06dac-15c9-458b-974e-f47f76fc10b2 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:20.945950 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-97b06dac-15c9-458b-974e-f47f76fc10b2 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:20.946642 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-97b06dac-15c9-458b-974e-f47f76fc10b2 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:21.606562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-97b06dac-15c9-458b-974e-f47f76fc10b2 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:21.621568 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-97b06dac-15c9-458b-974e-f47f76fc10b2 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59" status: 200 len: 1507 microversion: 2.1 time: 0.716933 Oct 05 02:46:21.637898 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2002/4029] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:20 2022] GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59 => generated 1507 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:21.638171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b5f09c02-6f7d-4eb2-a004-bf6d240fb38a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:21.640494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b5f09c02-6f7d-4eb2-a004-bf6d240fb38a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: ae8e1003-15ab-4801-a026-e9d80e200d3c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:21.656633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5f09c02-6f7d-4eb2-a004-bf6d240fb38a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:21.657411 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5f09c02-6f7d-4eb2-a004-bf6d240fb38a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:21.658028 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5f09c02-6f7d-4eb2-a004-bf6d240fb38a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:21.658907 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5f09c02-6f7d-4eb2-a004-bf6d240fb38a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:21.659723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5f09c02-6f7d-4eb2-a004-bf6d240fb38a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:21.660302 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5f09c02-6f7d-4eb2-a004-bf6d240fb38a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:22.181972 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b5f09c02-6f7d-4eb2-a004-bf6d240fb38a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:22.191781 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b5f09c02-6f7d-4eb2-a004-bf6d240fb38a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c" status: 200 len: 1364 microversion: 2.1 time: 0.561411 Oct 05 02:46:22.192601 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2003/4030] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:21 2022] GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c => generated 1364 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:22.626162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-48b7849a-77a8-4a8f-953b-37557bd5e991 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:22.626703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-48b7849a-77a8-4a8f-953b-37557bd5e991 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:22.644059 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48b7849a-77a8-4a8f-953b-37557bd5e991 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:22.644579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48b7849a-77a8-4a8f-953b-37557bd5e991 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:22.645063 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48b7849a-77a8-4a8f-953b-37557bd5e991 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:22.645797 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48b7849a-77a8-4a8f-953b-37557bd5e991 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:22.646262 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48b7849a-77a8-4a8f-953b-37557bd5e991 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:22.646696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48b7849a-77a8-4a8f-953b-37557bd5e991 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:22.685078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-4583c3e6-48ed-42a2-a5c6-dc508d9fc188 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: c2d68022-2fa3-4464-8004-262c23e41ea2] Updating instance_info_cache with network_info: [{"id": "baf1bb4d-f79e-4dc4-903a-f0407e6bf5d8", "address": "fa:16:3e:29:05:2e", "network": {"id": "fe740311-a76a-438e-a2c2-3036d93972fd", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2071185980-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1ae15e13c1ae4b2db5de94fbd428867d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbaf1bb4d-f7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122320) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 05 02:46:22.708345 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4583c3e6-48ed-42a2-a5c6-dc508d9fc188 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Releasing lock "refresh_cache-c2d68022-2fa3-4464-8004-262c23e41ea2" {{(pid=122320) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 05 02:46:22.709271 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4583c3e6-48ed-42a2-a5c6-dc508d9fc188 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "POST /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2/action" status: 202 len: 0 microversion: 2.1 time: 6.688730 Oct 05 02:46:22.709901 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2028/4031] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:46:16 2022] POST /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2/action => generated 0 bytes in 6703 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 05 02:46:22.721845 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cad739b4-d20d-4077-9ddf-b6b408ea626a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:22.721845 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cad739b4-d20d-4077-9ddf-b6b408ea626a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 11e71f42-f1ec-46ca-a349-265766e0483e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:22.779598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cad739b4-d20d-4077-9ddf-b6b408ea626a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:22.781594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cad739b4-d20d-4077-9ddf-b6b408ea626a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:22.782047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cad739b4-d20d-4077-9ddf-b6b408ea626a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:22.782779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cad739b4-d20d-4077-9ddf-b6b408ea626a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:22.783246 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cad739b4-d20d-4077-9ddf-b6b408ea626a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:22.783673 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cad739b4-d20d-4077-9ddf-b6b408ea626a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:22.883754 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:23.801304 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-48b7849a-77a8-4a8f-953b-37557bd5e991 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:23.812529 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-48b7849a-77a8-4a8f-953b-37557bd5e991 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 1.619070 Oct 05 02:46:23.813613 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2004/4032] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:22 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:23.818797 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-539f9288-000b-4728-8e49-144282e63f79 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:23.819602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-539f9288-000b-4728-8e49-144282e63f79 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:23.831974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-539f9288-000b-4728-8e49-144282e63f79 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:23.832802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-539f9288-000b-4728-8e49-144282e63f79 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:23.833442 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-539f9288-000b-4728-8e49-144282e63f79 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:23.834354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-539f9288-000b-4728-8e49-144282e63f79 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:23.834980 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-539f9288-000b-4728-8e49-144282e63f79 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:23.835567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-539f9288-000b-4728-8e49-144282e63f79 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:23.973287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cad739b4-d20d-4077-9ddf-b6b408ea626a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:23.993294 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cad739b4-d20d-4077-9ddf-b6b408ea626a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e" status: 200 len: 1315 microversion: 2.1 time: 1.278607 Oct 05 02:46:23.994668 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2029/4033] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:22 2022] GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e => generated 1315 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:24.003646 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-376c1058-725e-4c08-baeb-cea5570c6c53 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.3"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:24.008980 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-376c1058-725e-4c08-baeb-cea5570c6c53 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: ac770ead-5d43-4762-9cea-cb163c073d5c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:24.020501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-376c1058-725e-4c08-baeb-cea5570c6c53 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:24.034391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-376c1058-725e-4c08-baeb-cea5570c6c53 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:24.036071 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-376c1058-725e-4c08-baeb-cea5570c6c53 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:24.038153 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-376c1058-725e-4c08-baeb-cea5570c6c53 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:24.039882 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-376c1058-725e-4c08-baeb-cea5570c6c53 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:24.040529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-376c1058-725e-4c08-baeb-cea5570c6c53 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:24.087164 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-376c1058-725e-4c08-baeb-cea5570c6c53 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "refresh_cache-ac770ead-5d43-4762-9cea-cb163c073d5c" {{(pid=122320) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 05 02:46:24.087665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-376c1058-725e-4c08-baeb-cea5570c6c53 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquired lock "refresh_cache-ac770ead-5d43-4762-9cea-cb163c073d5c" {{(pid=122320) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 05 02:46:24.147664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-539f9288-000b-4728-8e49-144282e63f79 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:24.164505 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-539f9288-000b-4728-8e49-144282e63f79 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59" status: 200 len: 1507 microversion: 2.1 time: 0.349026 Oct 05 02:46:24.165782 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2005/4034] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:23 2022] GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59 => generated 1507 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:24.180547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-469952d7-3768-429e-b2f3-1bc913f7811e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:24.182195 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-469952d7-3768-429e-b2f3-1bc913f7811e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: ae8e1003-15ab-4801-a026-e9d80e200d3c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:24.211440 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-469952d7-3768-429e-b2f3-1bc913f7811e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:24.212106 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-469952d7-3768-429e-b2f3-1bc913f7811e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:24.212859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-469952d7-3768-429e-b2f3-1bc913f7811e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:24.214019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-469952d7-3768-429e-b2f3-1bc913f7811e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:24.214709 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-469952d7-3768-429e-b2f3-1bc913f7811e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:24.215915 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-469952d7-3768-429e-b2f3-1bc913f7811e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:24.223479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:24.495829 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-469952d7-3768-429e-b2f3-1bc913f7811e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:24.518581 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-469952d7-3768-429e-b2f3-1bc913f7811e tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c" status: 200 len: 1364 microversion: 2.1 time: 0.349769 Oct 05 02:46:24.521094 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2006/4035] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:24 2022] GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c => generated 1364 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:24.539400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-04f831f3-278c-45d0-96d5-023fb1716973 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:24.540292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-04f831f3-278c-45d0-96d5-023fb1716973 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:24.553462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-04f831f3-278c-45d0-96d5-023fb1716973 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:24.554065 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-04f831f3-278c-45d0-96d5-023fb1716973 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:24.554509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-04f831f3-278c-45d0-96d5-023fb1716973 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:24.555557 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-04f831f3-278c-45d0-96d5-023fb1716973 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:24.555669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-04f831f3-278c-45d0-96d5-023fb1716973 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:24.562495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-04f831f3-278c-45d0-96d5-023fb1716973 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:24.894270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-04f831f3-278c-45d0-96d5-023fb1716973 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:24.903970 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-04f831f3-278c-45d0-96d5-023fb1716973 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.380918 Oct 05 02:46:24.904716 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2007/4036] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:24 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:24.928841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-288d869d-71f6-48d7-928c-f9bc591d3cb5 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:24.929733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-288d869d-71f6-48d7-928c-f9bc591d3cb5 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:24.941428 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-288d869d-71f6-48d7-928c-f9bc591d3cb5 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:24.942159 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-288d869d-71f6-48d7-928c-f9bc591d3cb5 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:24.942778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-288d869d-71f6-48d7-928c-f9bc591d3cb5 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:24.943639 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-288d869d-71f6-48d7-928c-f9bc591d3cb5 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:24.944250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-288d869d-71f6-48d7-928c-f9bc591d3cb5 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:24.944828 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-288d869d-71f6-48d7-928c-f9bc591d3cb5 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:25.209391 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-288d869d-71f6-48d7-928c-f9bc591d3cb5 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:25.227631 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-288d869d-71f6-48d7-928c-f9bc591d3cb5 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.303068 Oct 05 02:46:25.228424 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2008/4037] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:24 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:25.241183 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-408f9556-4915-446c-a09f-02a3faf5e78f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:25.242941 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-408f9556-4915-446c-a09f-02a3faf5e78f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 11e71f42-f1ec-46ca-a349-265766e0483e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:25.265417 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-408f9556-4915-446c-a09f-02a3faf5e78f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:25.269700 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-408f9556-4915-446c-a09f-02a3faf5e78f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:25.270621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-408f9556-4915-446c-a09f-02a3faf5e78f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:25.273332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-408f9556-4915-446c-a09f-02a3faf5e78f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:25.274065 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-408f9556-4915-446c-a09f-02a3faf5e78f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:25.274725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-408f9556-4915-446c-a09f-02a3faf5e78f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:25.693263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-408f9556-4915-446c-a09f-02a3faf5e78f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:25.709709 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-408f9556-4915-446c-a09f-02a3faf5e78f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e" status: 200 len: 1503 microversion: 2.1 time: 0.478094 Oct 05 02:46:25.710325 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2009/4038] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:25 2022] GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e => generated 1503 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:25.716641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-aa3b468e-0d25-434c-a9ed-98048d237c3e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:25.717325 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-aa3b468e-0d25-434c-a9ed-98048d237c3e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:25.745119 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa3b468e-0d25-434c-a9ed-98048d237c3e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:25.745624 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa3b468e-0d25-434c-a9ed-98048d237c3e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:25.746064 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa3b468e-0d25-434c-a9ed-98048d237c3e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:25.746778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa3b468e-0d25-434c-a9ed-98048d237c3e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:25.747230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa3b468e-0d25-434c-a9ed-98048d237c3e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:25.752597 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa3b468e-0d25-434c-a9ed-98048d237c3e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:26.115001 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-aa3b468e-0d25-434c-a9ed-98048d237c3e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:26.130727 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-aa3b468e-0d25-434c-a9ed-98048d237c3e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59" status: 200 len: 1487 microversion: 2.1 time: 0.419342 Oct 05 02:46:26.146799 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2010/4039] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:25 2022] GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59 => generated 1487 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:26.184195 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-51085e21-892a-4689-8ef1-ec5ffb656a1d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:26.188668 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-51085e21-892a-4689-8ef1-ec5ffb656a1d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:26.195617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-51085e21-892a-4689-8ef1-ec5ffb656a1d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:26.196510 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-51085e21-892a-4689-8ef1-ec5ffb656a1d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:26.197432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-51085e21-892a-4689-8ef1-ec5ffb656a1d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:26.198503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-51085e21-892a-4689-8ef1-ec5ffb656a1d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:26.199201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-51085e21-892a-4689-8ef1-ec5ffb656a1d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:26.200041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-51085e21-892a-4689-8ef1-ec5ffb656a1d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:26.532780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-51085e21-892a-4689-8ef1-ec5ffb656a1d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:26.541444 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-51085e21-892a-4689-8ef1-ec5ffb656a1d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.393106 Oct 05 02:46:26.542037 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2011/4040] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:26 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:26.547949 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-a1532cc9-11f4-460e-a78d-ab8aed63f7f8 req-0d7c2977-357e-49cb-8d51-38c768a18000 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae8e1003-15ab-4801-a026-e9d80e200d3c", "tag": "e39d2c77-d9f4-430b-9b4f-2778c13414de"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:26.584201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a1532cc9-11f4-460e-a78d-ab8aed63f7f8 req-0d7c2977-357e-49cb-8d51-38c768a18000 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:26.586451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a1532cc9-11f4-460e-a78d-ab8aed63f7f8 req-0d7c2977-357e-49cb-8d51-38c768a18000 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:26.588737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a1532cc9-11f4-460e-a78d-ab8aed63f7f8 req-0d7c2977-357e-49cb-8d51-38c768a18000 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:26.606658 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-a1532cc9-11f4-460e-a78d-ab8aed63f7f8 req-0d7c2977-357e-49cb-8d51-38c768a18000 service nova] Creating event network-changed:e39d2c77-d9f4-430b-9b4f-2778c13414de for instance ae8e1003-15ab-4801-a026-e9d80e200d3c on n-h2-858272-3 Oct 05 02:46:26.633435 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-a1532cc9-11f4-460e-a78d-ab8aed63f7f8 req-0d7c2977-357e-49cb-8d51-38c768a18000 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090113 Oct 05 02:46:26.637970 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2012/4041] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:46:26.658855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9ac6efd8-27b5-4c7c-8379-5df05c4459b8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:26.658855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9ac6efd8-27b5-4c7c-8379-5df05c4459b8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: ae8e1003-15ab-4801-a026-e9d80e200d3c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:26.684250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ac6efd8-27b5-4c7c-8379-5df05c4459b8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:26.690829 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ac6efd8-27b5-4c7c-8379-5df05c4459b8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:26.694927 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ac6efd8-27b5-4c7c-8379-5df05c4459b8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:26.697694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ac6efd8-27b5-4c7c-8379-5df05c4459b8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:26.700656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ac6efd8-27b5-4c7c-8379-5df05c4459b8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:26.702525 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ac6efd8-27b5-4c7c-8379-5df05c4459b8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:26.914718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:26.955005 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:27.149346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9ac6efd8-27b5-4c7c-8379-5df05c4459b8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:27.163013 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9ac6efd8-27b5-4c7c-8379-5df05c4459b8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c" status: 200 len: 1364 microversion: 2.1 time: 0.522427 Oct 05 02:46:27.163616 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2013/4042] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:26 2022] GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c => generated 1364 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:27.194586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1afb75a1-9bc3-4989-b84d-6183ce5aab7e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:27.202479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1afb75a1-9bc3-4989-b84d-6183ce5aab7e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 11e71f42-f1ec-46ca-a349-265766e0483e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:27.218201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1afb75a1-9bc3-4989-b84d-6183ce5aab7e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:27.220574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1afb75a1-9bc3-4989-b84d-6183ce5aab7e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:27.221281 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1afb75a1-9bc3-4989-b84d-6183ce5aab7e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:27.223438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1afb75a1-9bc3-4989-b84d-6183ce5aab7e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:27.225472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1afb75a1-9bc3-4989-b84d-6183ce5aab7e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:27.226653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1afb75a1-9bc3-4989-b84d-6183ce5aab7e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:27.396859 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1afb75a1-9bc3-4989-b84d-6183ce5aab7e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "POST /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e/action" status: 202 len: 0 microversion: 2.1 time: 0.206274 Oct 05 02:46:27.398878 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2014/4043] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:46:27 2022] POST /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:46:27.418026 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cceb9738-4ba0-4d05-9b1d-f648f2164872 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-460264312", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:27.504846 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.network.neutron [None req-376c1058-725e-4c08-baeb-cea5570c6c53 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: ac770ead-5d43-4762-9cea-cb163c073d5c] re-assign floating IP 172.25.5.3 from instance c2d68022-2fa3-4464-8004-262c23e41ea2 Oct 05 02:46:27.568448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-cceb9738-4ba0-4d05-9b1d-f648f2164872 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] validate_networks() for [('17434e34-cbc4-4307-a1a5-1c9d980ad9e1', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:46:27.611080 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-376c1058-725e-4c08-baeb-cea5570c6c53 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: c2d68022-2fa3-4464-8004-262c23e41ea2] Building network info cache for instance {{(pid=122320) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 05 02:46:28.974996 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-cceb9738-4ba0-4d05-9b1d-f648f2164872 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:46:28.975501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-cceb9738-4ba0-4d05-9b1d-f648f2164872 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:46:28.975927 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-cceb9738-4ba0-4d05-9b1d-f648f2164872 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:46:28.976343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-cceb9738-4ba0-4d05-9b1d-f648f2164872 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:46:28.977437 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-cceb9738-4ba0-4d05-9b1d-f648f2164872 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:46:29.001782 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cceb9738-4ba0-4d05-9b1d-f648f2164872 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:29.002495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cceb9738-4ba0-4d05-9b1d-f648f2164872 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:29.002966 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cceb9738-4ba0-4d05-9b1d-f648f2164872 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:29.003707 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cceb9738-4ba0-4d05-9b1d-f648f2164872 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:29.004168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cceb9738-4ba0-4d05-9b1d-f648f2164872 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:29.004596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cceb9738-4ba0-4d05-9b1d-f648f2164872 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:29.052630 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-cceb9738-4ba0-4d05-9b1d-f648f2164872 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Getting quotas for project 14c9c845b4e04fb09dc03de04a799cf3. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:46:29.073545 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-cceb9738-4ba0-4d05-9b1d-f648f2164872 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Getting quotas for user 27a14e4e71454d18946512dedba312a0 and project 14c9c845b4e04fb09dc03de04a799cf3. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:46:29.098762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cceb9738-4ba0-4d05-9b1d-f648f2164872 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:46:29.102230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cceb9738-4ba0-4d05-9b1d-f648f2164872 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:46:29.197790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-376c1058-725e-4c08-baeb-cea5570c6c53 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: c2d68022-2fa3-4464-8004-262c23e41ea2] Updating instance_info_cache with network_info: [{"id": "baf1bb4d-f79e-4dc4-903a-f0407e6bf5d8", "address": "fa:16:3e:29:05:2e", "network": {"id": "fe740311-a76a-438e-a2c2-3036d93972fd", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2071185980-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1ae15e13c1ae4b2db5de94fbd428867d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbaf1bb4d-f7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122320) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 05 02:46:29.211494 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cceb9738-4ba0-4d05-9b1d-f648f2164872 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.793912 Oct 05 02:46:29.215706 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2015/4044] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:46:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 1816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:46:29.223692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-376c1058-725e-4c08-baeb-cea5570c6c53 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: ac770ead-5d43-4762-9cea-cb163c073d5c] Building network info cache for instance {{(pid=122320) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 05 02:46:29.230902 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-959f5984-794d-4b58-a126-a8816cdbb9b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-179641430", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "3c7ecbb9-3319-48a3-8bf2-f42adcddf7f9"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:29.819274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-959f5984-794d-4b58-a126-a8816cdbb9b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] validate_networks() for [('3c7ecbb9-3319-48a3-8bf2-f42adcddf7f9', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:46:30.509238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-376c1058-725e-4c08-baeb-cea5570c6c53 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: ac770ead-5d43-4762-9cea-cb163c073d5c] Updating instance_info_cache with network_info: [{"id": "376ff818-7bff-4848-847c-b6e88a6b8588", "address": "fa:16:3e:7e:40:d6", "network": {"id": "fe740311-a76a-438e-a2c2-3036d93972fd", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2071185980-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1ae15e13c1ae4b2db5de94fbd428867d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap376ff818-7b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122320) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 05 02:46:30.530860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-376c1058-725e-4c08-baeb-cea5570c6c53 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Releasing lock "refresh_cache-ac770ead-5d43-4762-9cea-cb163c073d5c" {{(pid=122320) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 05 02:46:30.531834 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-376c1058-725e-4c08-baeb-cea5570c6c53 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "POST /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c/action" status: 202 len: 0 microversion: 2.1 time: 6.535631 Oct 05 02:46:30.534122 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2030/4045] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:46:23 2022] POST /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c/action => generated 0 bytes in 6538 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 05 02:46:30.541399 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-b429ee18-c175-4285-9207-e5ce900d9a39 req-da78d9be-b79f-4814-a861-c41de447fc2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2d68022-2fa3-4464-8004-262c23e41ea2", "tag": "baf1bb4d-f79e-4dc4-903a-f0407e6bf5d8"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:30.546890 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-959f5984-794d-4b58-a126-a8816cdbb9b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:46:30.547428 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-959f5984-794d-4b58-a126-a8816cdbb9b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:46:30.547772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-959f5984-794d-4b58-a126-a8816cdbb9b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:46:30.548180 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-959f5984-794d-4b58-a126-a8816cdbb9b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:46:30.548596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-959f5984-794d-4b58-a126-a8816cdbb9b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:46:30.559156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-959f5984-794d-4b58-a126-a8816cdbb9b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:30.559659 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b429ee18-c175-4285-9207-e5ce900d9a39 req-da78d9be-b79f-4814-a861-c41de447fc2c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:30.561008 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-959f5984-794d-4b58-a126-a8816cdbb9b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:30.561345 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b429ee18-c175-4285-9207-e5ce900d9a39 req-da78d9be-b79f-4814-a861-c41de447fc2c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:30.561876 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-959f5984-794d-4b58-a126-a8816cdbb9b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:30.561987 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b429ee18-c175-4285-9207-e5ce900d9a39 req-da78d9be-b79f-4814-a861-c41de447fc2c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:30.562914 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-959f5984-794d-4b58-a126-a8816cdbb9b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:30.563560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-959f5984-794d-4b58-a126-a8816cdbb9b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:30.564174 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-959f5984-794d-4b58-a126-a8816cdbb9b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:30.581116 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-b429ee18-c175-4285-9207-e5ce900d9a39 req-da78d9be-b79f-4814-a861-c41de447fc2c service nova] Creating event network-changed:baf1bb4d-f79e-4dc4-903a-f0407e6bf5d8 for instance c2d68022-2fa3-4464-8004-262c23e41ea2 on n-h2-858272-3 Oct 05 02:46:30.588233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-959f5984-794d-4b58-a126-a8816cdbb9b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Getting quotas for project 1ff63adf9571439d8f8bf9b0fa6c63f9. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:46:30.594210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-959f5984-794d-4b58-a126-a8816cdbb9b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Getting quotas for user 728544ca5e164540b3c5395534542955 and project 1ff63adf9571439d8f8bf9b0fa6c63f9. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:46:30.606722 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-b429ee18-c175-4285-9207-e5ce900d9a39 req-da78d9be-b79f-4814-a861-c41de447fc2c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067997 Oct 05 02:46:30.609425 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2031/4046] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:46:30.610683 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-959f5984-794d-4b58-a126-a8816cdbb9b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:46:30.614087 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-959f5984-794d-4b58-a126-a8816cdbb9b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: eceb1b06-e5fa-442b-ae37-cce2f99d58ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:46:30.630527 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c5b559b5-52a6-49ef-af3e-14a1dcb726e4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:30.636324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c5b559b5-52a6-49ef-af3e-14a1dcb726e4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 11e71f42-f1ec-46ca-a349-265766e0483e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:30.653547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5b559b5-52a6-49ef-af3e-14a1dcb726e4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:30.655898 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5b559b5-52a6-49ef-af3e-14a1dcb726e4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:30.656867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5b559b5-52a6-49ef-af3e-14a1dcb726e4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:30.658387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5b559b5-52a6-49ef-af3e-14a1dcb726e4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:30.659340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5b559b5-52a6-49ef-af3e-14a1dcb726e4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:30.660402 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5b559b5-52a6-49ef-af3e-14a1dcb726e4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:30.670633 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-959f5984-794d-4b58-a126-a8816cdbb9b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.453359 Oct 05 02:46:30.672886 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2016/4047] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:46:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1456 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:46:30.680036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2281e40d-4140-489a-87e0-2420fd285a0b tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:30.680932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2281e40d-4140-489a-87e0-2420fd285a0b tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: ae8e1003-15ab-4801-a026-e9d80e200d3c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:30.689228 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2281e40d-4140-489a-87e0-2420fd285a0b tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:30.689956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2281e40d-4140-489a-87e0-2420fd285a0b tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:30.691334 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2281e40d-4140-489a-87e0-2420fd285a0b tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:30.692341 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2281e40d-4140-489a-87e0-2420fd285a0b tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:30.693035 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2281e40d-4140-489a-87e0-2420fd285a0b tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:30.693615 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2281e40d-4140-489a-87e0-2420fd285a0b tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:31.048346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2281e40d-4140-489a-87e0-2420fd285a0b tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:31.057210 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2281e40d-4140-489a-87e0-2420fd285a0b tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c" status: 200 len: 1364 microversion: 2.1 time: 0.382823 Oct 05 02:46:31.063465 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2017/4048] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:30 2022] GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c => generated 1364 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:31.095043 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4d49589c-2d9f-4864-b7b8-05d821978dc3 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:31.095671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4d49589c-2d9f-4864-b7b8-05d821978dc3 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:31.106365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d49589c-2d9f-4864-b7b8-05d821978dc3 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:31.112702 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d49589c-2d9f-4864-b7b8-05d821978dc3 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:31.113176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d49589c-2d9f-4864-b7b8-05d821978dc3 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:31.113938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d49589c-2d9f-4864-b7b8-05d821978dc3 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:31.114434 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d49589c-2d9f-4864-b7b8-05d821978dc3 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:31.115240 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d49589c-2d9f-4864-b7b8-05d821978dc3 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:31.448799 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4d49589c-2d9f-4864-b7b8-05d821978dc3 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:31.474975 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c5b559b5-52a6-49ef-af3e-14a1dcb726e4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:31.479281 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4d49589c-2d9f-4864-b7b8-05d821978dc3 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1273 microversion: 2.1 time: 0.414283 Oct 05 02:46:31.483559 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2018/4049] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:31 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1273 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:31.485364 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c5b559b5-52a6-49ef-af3e-14a1dcb726e4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e" status: 200 len: 1488 microversion: 2.1 time: 0.872368 Oct 05 02:46:31.487932 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2032/4050] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:30 2022] GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e => generated 1488 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:31.509710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8fc84730-9f8b-4518-9b97-1cd28c796130 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:31.510364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a619fef7-d3f3-4043-b561-ba34a2d54a7a tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Action: 'action', calling method: .version_select at 0x7fcce659f9d0>, body: {"removeFloatingIp": {"address": "172.25.5.3"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:31.511152 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8fc84730-9f8b-4518-9b97-1cd28c796130 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: eceb1b06-e5fa-442b-ae37-cce2f99d58ae] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:31.703314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8fc84730-9f8b-4518-9b97-1cd28c796130 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:31.724740 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8fc84730-9f8b-4518-9b97-1cd28c796130 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae" status: 200 len: 1214 microversion: 2.1 time: 0.216488 Oct 05 02:46:31.743429 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2033/4051] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:31 2022] GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae => generated 1214 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:31.757435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4369c8cf-6eb8-4873-8fc8-d1b90639129c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:31.758187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4369c8cf-6eb8-4873-8fc8-d1b90639129c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 11e71f42-f1ec-46ca-a349-265766e0483e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:31.775178 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4369c8cf-6eb8-4873-8fc8-d1b90639129c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:31.777030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4369c8cf-6eb8-4873-8fc8-d1b90639129c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:31.777898 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4369c8cf-6eb8-4873-8fc8-d1b90639129c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:31.780424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4369c8cf-6eb8-4873-8fc8-d1b90639129c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:31.782169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4369c8cf-6eb8-4873-8fc8-d1b90639129c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:31.783323 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4369c8cf-6eb8-4873-8fc8-d1b90639129c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:31.856843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4369c8cf-6eb8-4873-8fc8-d1b90639129c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 11e71f42-f1ec-46ca-a349-265766e0483e] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:46:31.945758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a619fef7-d3f3-4043-b561-ba34a2d54a7a tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: ac770ead-5d43-4762-9cea-cb163c073d5c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:31.954357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a619fef7-d3f3-4043-b561-ba34a2d54a7a tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:31.958403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a619fef7-d3f3-4043-b561-ba34a2d54a7a tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:31.959536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a619fef7-d3f3-4043-b561-ba34a2d54a7a tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:31.960300 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a619fef7-d3f3-4043-b561-ba34a2d54a7a tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:31.960779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a619fef7-d3f3-4043-b561-ba34a2d54a7a tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:31.961243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a619fef7-d3f3-4043-b561-ba34a2d54a7a tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:32.037324 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4369c8cf-6eb8-4873-8fc8-d1b90639129c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "DELETE /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e" status: 204 len: 0 microversion: 2.1 time: 0.291195 Oct 05 02:46:32.039787 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2034/4052] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:46:31 2022] DELETE /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:46:32.049691 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e850113f-9fde-4995-9453-bbb55b7bca06 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:32.051170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e850113f-9fde-4995-9453-bbb55b7bca06 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 11e71f42-f1ec-46ca-a349-265766e0483e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:32.063586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e850113f-9fde-4995-9453-bbb55b7bca06 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:32.064493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e850113f-9fde-4995-9453-bbb55b7bca06 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:32.065481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e850113f-9fde-4995-9453-bbb55b7bca06 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:32.066531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e850113f-9fde-4995-9453-bbb55b7bca06 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:32.067252 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e850113f-9fde-4995-9453-bbb55b7bca06 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:32.068118 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e850113f-9fde-4995-9453-bbb55b7bca06 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:32.309518 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e850113f-9fde-4995-9453-bbb55b7bca06 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:32.321471 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e850113f-9fde-4995-9453-bbb55b7bca06 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e" status: 200 len: 1494 microversion: 2.1 time: 0.277036 Oct 05 02:46:32.323234 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2035/4053] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:32 2022] GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e => generated 1494 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:46:32.332382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b6ae4015-64be-460a-a158-0333ce37b486 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:32.333343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b6ae4015-64be-460a-a158-0333ce37b486 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: ae8e1003-15ab-4801-a026-e9d80e200d3c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:32.352465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6ae4015-64be-460a-a158-0333ce37b486 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:32.358164 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6ae4015-64be-460a-a158-0333ce37b486 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:32.358999 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6ae4015-64be-460a-a158-0333ce37b486 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:32.360935 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6ae4015-64be-460a-a158-0333ce37b486 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:32.362491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6ae4015-64be-460a-a158-0333ce37b486 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:32.363949 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6ae4015-64be-460a-a158-0333ce37b486 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:32.768501 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-a619fef7-d3f3-4043-b561-ba34a2d54a7a tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] HTTP exception thrown: Floating IP 172.25.5.3 is not associated with instance c2d68022-2fa3-4464-8004-262c23e41ea2. Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a619fef7-d3f3-4043-b561-ba34a2d54a7a tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Request method failure captured: Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2/action HTTP/1.1 Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 47 Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO-_YAk49lT-VoDNWG4JMCGuN03AJh3L--gWDPtlaR70f-QCyuwo15V7YSXMUFTpujP0kONQy-VFYnzkuo04rEgEFeaiCF58fUhu6bz2nLaOBEqejAsQKuaKVeQn7PVXe-X-DUEp-cNpSkQsh7AVkaHQ_3Uhb0Qjf0_T_gtllz3KpoM Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 1ae15e13c1ae4b2db5de94fbd428867d Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2113355299 Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ae15e13c1ae4b2db5de94fbd428867d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ae15e13c1ae4b2db5de94fbd428867d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1ae15e13c1ae4b2db5de94fbd428867d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1ae15e13c1ae4b2db5de94fbd428867d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2113355299 Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 1ae15e13c1ae4b2db5de94fbd428867d Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2113355299 Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-FloatingIPsAssociationTestJSON-2113355299-project Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: c14d2fac851e4bbaaa760b5c3406a335 Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2113355299-project Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: {"removeFloatingIp": {"address": "172.25.5.3"}} Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: exception: Floating IP 172.25.5.3 is not associated with instance c2d68022-2fa3-4464-8004-262c23e41ea2. Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'c2d68022-2fa3-4464-8004-262c23e41ea2', 'body': {'removeFloatingIp': {'address': '172.25.5.3'}}} Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.5.3 is not associated with instance c2d68022-2fa3-4464-8004-262c23e41ea2. Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.5.3 is not associated with instance c2d68022-2fa3-4464-8004-262c23e41ea2. Oct 05 02:46:32.770084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:46:32.775837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a619fef7-d3f3-4043-b561-ba34a2d54a7a tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Returning 409 to user: Floating IP 172.25.5.3 is not associated with instance c2d68022-2fa3-4464-8004-262c23e41ea2. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:46:32.776719 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a619fef7-d3f3-4043-b561-ba34a2d54a7a tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "POST /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2/action" status: 409 len: 144 microversion: 2.1 time: 1.291988 Oct 05 02:46:32.777486 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2019/4054] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:46:31 2022] POST /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2/action => generated 144 bytes in 1293 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:46:32.782990 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bf1a46ef-5836-43b1-a5ae-dcd0705c8962 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:32.783530 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bf1a46ef-5836-43b1-a5ae-dcd0705c8962 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:32.804145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf1a46ef-5836-43b1-a5ae-dcd0705c8962 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:32.804645 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf1a46ef-5836-43b1-a5ae-dcd0705c8962 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:32.805296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf1a46ef-5836-43b1-a5ae-dcd0705c8962 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:32.806420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf1a46ef-5836-43b1-a5ae-dcd0705c8962 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:32.806888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf1a46ef-5836-43b1-a5ae-dcd0705c8962 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:32.807320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf1a46ef-5836-43b1-a5ae-dcd0705c8962 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:32.831716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b6ae4015-64be-460a-a158-0333ce37b486 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:32.843786 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b6ae4015-64be-460a-a158-0333ce37b486 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c" status: 200 len: 1364 microversion: 2.1 time: 0.518503 Oct 05 02:46:32.844571 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2036/4055] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:32 2022] GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c => generated 1364 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:32.849314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-d4a2bc69-001d-4046-902b-9f1d593487aa req-a29fa574-725a-45cb-908c-225ac559ec97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac770ead-5d43-4762-9cea-cb163c073d5c", "tag": "376ff818-7bff-4848-847c-b6e88a6b8588"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:32.865243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d4a2bc69-001d-4046-902b-9f1d593487aa req-a29fa574-725a-45cb-908c-225ac559ec97 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:32.866059 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d4a2bc69-001d-4046-902b-9f1d593487aa req-a29fa574-725a-45cb-908c-225ac559ec97 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:32.867303 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d4a2bc69-001d-4046-902b-9f1d593487aa req-a29fa574-725a-45cb-908c-225ac559ec97 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:32.888471 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-d4a2bc69-001d-4046-902b-9f1d593487aa req-a29fa574-725a-45cb-908c-225ac559ec97 service nova] Creating event network-changed:376ff818-7bff-4848-847c-b6e88a6b8588 for instance ac770ead-5d43-4762-9cea-cb163c073d5c on n-h1-858272-3 Oct 05 02:46:32.907868 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bf1a46ef-5836-43b1-a5ae-dcd0705c8962 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:32.910049 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-d4a2bc69-001d-4046-902b-9f1d593487aa req-a29fa574-725a-45cb-908c-225ac559ec97 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062781 Oct 05 02:46:32.911934 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2037/4056] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:46:32.920203 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bf1a46ef-5836-43b1-a5ae-dcd0705c8962 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1271 microversion: 2.1 time: 0.140007 Oct 05 02:46:32.933223 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2020/4057] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:32 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1271 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:32.933223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1dbe20e9-c7fb-4932-8788-40715984dba4 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.3"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:32.933495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b2cb6670-061b-4087-915d-b8fafd27bbb6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:32.933495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b2cb6670-061b-4087-915d-b8fafd27bbb6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: eceb1b06-e5fa-442b-ae37-cce2f99d58ae] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:32.956005 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2cb6670-061b-4087-915d-b8fafd27bbb6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:32.956510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2cb6670-061b-4087-915d-b8fafd27bbb6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:32.956976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2cb6670-061b-4087-915d-b8fafd27bbb6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:32.957691 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2cb6670-061b-4087-915d-b8fafd27bbb6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:32.958145 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2cb6670-061b-4087-915d-b8fafd27bbb6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:32.958644 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2cb6670-061b-4087-915d-b8fafd27bbb6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:33.083251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b2cb6670-061b-4087-915d-b8fafd27bbb6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:33.100171 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b2cb6670-061b-4087-915d-b8fafd27bbb6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae" status: 200 len: 1210 microversion: 2.1 time: 0.184371 Oct 05 02:46:33.108237 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2038/4058] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:32 2022] GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae => generated 1210 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:33.176805 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1dbe20e9-c7fb-4932-8788-40715984dba4 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: ac770ead-5d43-4762-9cea-cb163c073d5c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:33.189336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1dbe20e9-c7fb-4932-8788-40715984dba4 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:33.190098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1dbe20e9-c7fb-4932-8788-40715984dba4 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:33.190716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1dbe20e9-c7fb-4932-8788-40715984dba4 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:33.194230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1dbe20e9-c7fb-4932-8788-40715984dba4 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:33.196417 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1dbe20e9-c7fb-4932-8788-40715984dba4 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:33.197320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1dbe20e9-c7fb-4932-8788-40715984dba4 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:33.351348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7fe22a0b-ca55-45e4-b032-320456e35e4d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:33.351982 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7fe22a0b-ca55-45e4-b032-320456e35e4d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 11e71f42-f1ec-46ca-a349-265766e0483e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:33.363471 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7fe22a0b-ca55-45e4-b032-320456e35e4d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:33.364837 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7fe22a0b-ca55-45e4-b032-320456e35e4d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:33.365331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7fe22a0b-ca55-45e4-b032-320456e35e4d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:33.366286 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7fe22a0b-ca55-45e4-b032-320456e35e4d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:33.366963 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7fe22a0b-ca55-45e4-b032-320456e35e4d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:33.367550 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7fe22a0b-ca55-45e4-b032-320456e35e4d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:34.148891 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1dbe20e9-c7fb-4932-8788-40715984dba4 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "refresh_cache-ac770ead-5d43-4762-9cea-cb163c073d5c" {{(pid=122319) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 05 02:46:34.154352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1dbe20e9-c7fb-4932-8788-40715984dba4 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquired lock "refresh_cache-ac770ead-5d43-4762-9cea-cb163c073d5c" {{(pid=122319) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 05 02:46:34.157418 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7fe22a0b-ca55-45e4-b032-320456e35e4d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:34.166185 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7fe22a0b-ca55-45e4-b032-320456e35e4d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e" status: 200 len: 1494 microversion: 2.1 time: 0.821201 Oct 05 02:46:34.166780 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2039/4059] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:33 2022] GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e => generated 1494 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:46:34.206356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-63fa542b-73ea-47cb-af63-a21f66135ab2 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:34.211047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-63fa542b-73ea-47cb-af63-a21f66135ab2 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: ae8e1003-15ab-4801-a026-e9d80e200d3c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:34.219917 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63fa542b-73ea-47cb-af63-a21f66135ab2 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:34.233735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63fa542b-73ea-47cb-af63-a21f66135ab2 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:34.234468 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63fa542b-73ea-47cb-af63-a21f66135ab2 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:34.235433 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63fa542b-73ea-47cb-af63-a21f66135ab2 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:34.236074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63fa542b-73ea-47cb-af63-a21f66135ab2 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:34.236682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63fa542b-73ea-47cb-af63-a21f66135ab2 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:34.853332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-63fa542b-73ea-47cb-af63-a21f66135ab2 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:34.862974 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-63fa542b-73ea-47cb-af63-a21f66135ab2 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c" status: 200 len: 1364 microversion: 2.1 time: 0.676419 Oct 05 02:46:34.880591 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2040/4060] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:34 2022] GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c => generated 1364 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:34.885798 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-79de19ba-2fa5-4e56-b0a4-8ec189560324 req-2176a823-fb2d-45c3-be20-e21033e9405e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae8e1003-15ab-4801-a026-e9d80e200d3c", "name": "network-vif-plugged", "status": "completed", "tag": "e39d2c77-d9f4-430b-9b4f-2778c13414de"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:34.898445 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-79de19ba-2fa5-4e56-b0a4-8ec189560324 req-2176a823-fb2d-45c3-be20-e21033e9405e service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:34.899265 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-79de19ba-2fa5-4e56-b0a4-8ec189560324 req-2176a823-fb2d-45c3-be20-e21033e9405e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:34.899897 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-79de19ba-2fa5-4e56-b0a4-8ec189560324 req-2176a823-fb2d-45c3-be20-e21033e9405e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:34.918727 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-79de19ba-2fa5-4e56-b0a4-8ec189560324 req-2176a823-fb2d-45c3-be20-e21033e9405e service nova] Creating event network-vif-plugged:e39d2c77-d9f4-430b-9b4f-2778c13414de for instance ae8e1003-15ab-4801-a026-e9d80e200d3c on n-h2-858272-3 Oct 05 02:46:34.926679 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-79de19ba-2fa5-4e56-b0a4-8ec189560324 req-2176a823-fb2d-45c3-be20-e21033e9405e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044211 Oct 05 02:46:34.928151 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2041/4061] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:46:34.941419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-29554ec3-575b-4e20-bf59-1dac57f58e10 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:34.942223 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-29554ec3-575b-4e20-bf59-1dac57f58e10 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:34.955441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29554ec3-575b-4e20-bf59-1dac57f58e10 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:34.956017 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29554ec3-575b-4e20-bf59-1dac57f58e10 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:34.956530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29554ec3-575b-4e20-bf59-1dac57f58e10 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:34.958230 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29554ec3-575b-4e20-bf59-1dac57f58e10 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:34.958772 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29554ec3-575b-4e20-bf59-1dac57f58e10 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:34.959278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29554ec3-575b-4e20-bf59-1dac57f58e10 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:35.348776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-29554ec3-575b-4e20-bf59-1dac57f58e10 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:35.365911 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-29554ec3-575b-4e20-bf59-1dac57f58e10 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1313 microversion: 2.1 time: 0.436139 Oct 05 02:46:35.367451 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2042/4062] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:34 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1313 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:35.385763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bdea805f-26f2-49e2-a829-71e581e45f12 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:35.393962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bdea805f-26f2-49e2-a829-71e581e45f12 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: eceb1b06-e5fa-442b-ae37-cce2f99d58ae] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:35.421297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bdea805f-26f2-49e2-a829-71e581e45f12 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:35.422196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bdea805f-26f2-49e2-a829-71e581e45f12 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:35.422813 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bdea805f-26f2-49e2-a829-71e581e45f12 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:35.423725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bdea805f-26f2-49e2-a829-71e581e45f12 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:35.424344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bdea805f-26f2-49e2-a829-71e581e45f12 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:35.425096 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bdea805f-26f2-49e2-a829-71e581e45f12 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:35.586099 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bdea805f-26f2-49e2-a829-71e581e45f12 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:35.600020 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bdea805f-26f2-49e2-a829-71e581e45f12 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae" status: 200 len: 1272 microversion: 2.1 time: 0.228397 Oct 05 02:46:35.601713 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2043/4063] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:35 2022] GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae => generated 1272 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:35.622526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7670a84d-3da1-4b54-b4e5-606a37c68bea tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:35.623355 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7670a84d-3da1-4b54-b4e5-606a37c68bea tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 11e71f42-f1ec-46ca-a349-265766e0483e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:35.629885 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7670a84d-3da1-4b54-b4e5-606a37c68bea tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:35.630397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7670a84d-3da1-4b54-b4e5-606a37c68bea tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:35.630818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7670a84d-3da1-4b54-b4e5-606a37c68bea tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:35.631527 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7670a84d-3da1-4b54-b4e5-606a37c68bea tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:35.632043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7670a84d-3da1-4b54-b4e5-606a37c68bea tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:35.632475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7670a84d-3da1-4b54-b4e5-606a37c68bea tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:35.810527 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7670a84d-3da1-4b54-b4e5-606a37c68bea tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:35.815329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:35.832657 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7670a84d-3da1-4b54-b4e5-606a37c68bea tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e" status: 200 len: 1452 microversion: 2.1 time: 0.214083 Oct 05 02:46:35.854507 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2044/4064] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:35 2022] GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e => generated 1452 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:35.865852 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-338954fc-483a-42e5-bf6b-c81dc7f78fb0 req-f8671504-6cc0-4fae-b9fe-3b55cf43dbf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e71f42-f1ec-46ca-a349-265766e0483e", "name": "network-vif-deleted", "tag": "acd2b4f7-d1b4-4033-a1e1-e9724ea51b97"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:35.883421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-338954fc-483a-42e5-bf6b-c81dc7f78fb0 req-f8671504-6cc0-4fae-b9fe-3b55cf43dbf2 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:35.884171 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-338954fc-483a-42e5-bf6b-c81dc7f78fb0 req-f8671504-6cc0-4fae-b9fe-3b55cf43dbf2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:35.884871 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-338954fc-483a-42e5-bf6b-c81dc7f78fb0 req-f8671504-6cc0-4fae-b9fe-3b55cf43dbf2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:35.900091 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-338954fc-483a-42e5-bf6b-c81dc7f78fb0 req-f8671504-6cc0-4fae-b9fe-3b55cf43dbf2 service nova] Creating event network-vif-deleted:acd2b4f7-d1b4-4033-a1e1-e9724ea51b97 for instance 11e71f42-f1ec-46ca-a349-265766e0483e on n-h2-858272-3 Oct 05 02:46:35.906297 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-338954fc-483a-42e5-bf6b-c81dc7f78fb0 req-f8671504-6cc0-4fae-b9fe-3b55cf43dbf2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049894 Oct 05 02:46:35.907548 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2045/4065] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:46:35.916984 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8f1283d5-39b4-4f7f-857f-10870413a127 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:35.918131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8f1283d5-39b4-4f7f-857f-10870413a127 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: ae8e1003-15ab-4801-a026-e9d80e200d3c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:35.929807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f1283d5-39b4-4f7f-857f-10870413a127 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:35.930736 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f1283d5-39b4-4f7f-857f-10870413a127 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:35.931379 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f1283d5-39b4-4f7f-857f-10870413a127 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:35.932848 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f1283d5-39b4-4f7f-857f-10870413a127 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:35.933887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f1283d5-39b4-4f7f-857f-10870413a127 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:35.934682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f1283d5-39b4-4f7f-857f-10870413a127 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:36.413703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-1dbe20e9-c7fb-4932-8788-40715984dba4 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: ac770ead-5d43-4762-9cea-cb163c073d5c] Building network info cache for instance {{(pid=122319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 05 02:46:36.547550 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8f1283d5-39b4-4f7f-857f-10870413a127 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:36.562478 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8f1283d5-39b4-4f7f-857f-10870413a127 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c" status: 200 len: 1364 microversion: 2.1 time: 0.653312 Oct 05 02:46:36.564430 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2046/4066] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:35 2022] GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c => generated 1364 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:36.577074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0d9398db-0f81-4e36-9df1-377088445106 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:36.577718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0d9398db-0f81-4e36-9df1-377088445106 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:36.599566 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d9398db-0f81-4e36-9df1-377088445106 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:36.602207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d9398db-0f81-4e36-9df1-377088445106 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:36.605644 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d9398db-0f81-4e36-9df1-377088445106 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:36.607569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d9398db-0f81-4e36-9df1-377088445106 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:36.609636 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d9398db-0f81-4e36-9df1-377088445106 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:36.623927 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d9398db-0f81-4e36-9df1-377088445106 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:37.370136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0d9398db-0f81-4e36-9df1-377088445106 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:37.385778 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0d9398db-0f81-4e36-9df1-377088445106 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1313 microversion: 2.1 time: 0.815754 Oct 05 02:46:37.386654 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2047/4067] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:36 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1313 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:37.399354 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-d1ce3813-c6f5-4d05-8cee-f65f655b9c9b req-b586de9c-1725-45f5-8551-24aaef315510 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac770ead-5d43-4762-9cea-cb163c073d5c", "tag": "376ff818-7bff-4848-847c-b6e88a6b8588"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:37.426785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d1ce3813-c6f5-4d05-8cee-f65f655b9c9b req-b586de9c-1725-45f5-8551-24aaef315510 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:37.427316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d1ce3813-c6f5-4d05-8cee-f65f655b9c9b req-b586de9c-1725-45f5-8551-24aaef315510 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:37.428135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d1ce3813-c6f5-4d05-8cee-f65f655b9c9b req-b586de9c-1725-45f5-8551-24aaef315510 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:37.480757 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-d1ce3813-c6f5-4d05-8cee-f65f655b9c9b req-b586de9c-1725-45f5-8551-24aaef315510 service nova] Creating event network-changed:376ff818-7bff-4848-847c-b6e88a6b8588 for instance ac770ead-5d43-4762-9cea-cb163c073d5c on n-h1-858272-3 Oct 05 02:46:37.497375 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-d1ce3813-c6f5-4d05-8cee-f65f655b9c9b req-b586de9c-1725-45f5-8551-24aaef315510 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109103 Oct 05 02:46:37.501393 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2048/4068] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:46:37.558323 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-85259899-7be3-452c-8738-497bc037f5b7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:37.574993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-85259899-7be3-452c-8738-497bc037f5b7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: eceb1b06-e5fa-442b-ae37-cce2f99d58ae] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:37.605542 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85259899-7be3-452c-8738-497bc037f5b7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:37.610142 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85259899-7be3-452c-8738-497bc037f5b7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:37.611077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85259899-7be3-452c-8738-497bc037f5b7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:37.616738 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85259899-7be3-452c-8738-497bc037f5b7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:37.617508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85259899-7be3-452c-8738-497bc037f5b7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:37.622546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85259899-7be3-452c-8738-497bc037f5b7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:38.288390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-85259899-7be3-452c-8738-497bc037f5b7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:38.299448 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-85259899-7be3-452c-8738-497bc037f5b7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae" status: 200 len: 1314 microversion: 2.1 time: 0.796741 Oct 05 02:46:38.305580 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2049/4069] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:37 2022] GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae => generated 1314 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:38.310980 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c93e89ab-f90f-46af-8c8d-39b5a4bf8269 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:38.311752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c93e89ab-f90f-46af-8c8d-39b5a4bf8269 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 11e71f42-f1ec-46ca-a349-265766e0483e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:38.343811 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c93e89ab-f90f-46af-8c8d-39b5a4bf8269 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:38.346233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c93e89ab-f90f-46af-8c8d-39b5a4bf8269 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:38.346866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c93e89ab-f90f-46af-8c8d-39b5a4bf8269 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:38.348896 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c93e89ab-f90f-46af-8c8d-39b5a4bf8269 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:38.349708 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c93e89ab-f90f-46af-8c8d-39b5a4bf8269 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:38.352510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c93e89ab-f90f-46af-8c8d-39b5a4bf8269 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:38.384038 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-c93e89ab-f90f-46af-8c8d-39b5a4bf8269 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] HTTP exception thrown: Instance 11e71f42-f1ec-46ca-a349-265766e0483e could not be found. Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c93e89ab-f90f-46af-8c8d-39b5a4bf8269 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Request method failure captured: Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e HTTP/1.1 Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO9sJgtvOLeTr4nOCD-vOqCqD1zJrAITPFW_zz4yiLyvIoTdHjuR4LJfH4xTHqVQhBEUV87uN4J6FQiHHhnatngFlbfTbJmS6cPceNKMN6UWu-_pNs3jdF8Cb5CgC-hxlx6u-5aGNVi9h5jLYyViTpDjMXgNyRvr5dJZFZQW2uKikA8 Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: d797c0058e8c456290081d056df79292 Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d797c0058e8c456290081d056df79292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d797c0058e8c456290081d056df79292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: d797c0058e8c456290081d056df79292 Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: ff170a5be8a04902b66e5f0e79fd47df Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 11e71f42-f1ec-46ca-a349-265766e0483e could not be found. Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '11e71f42-f1ec-46ca-a349-265766e0483e'} Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11e71f42-f1ec-46ca-a349-265766e0483e could not be found. Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11e71f42-f1ec-46ca-a349-265766e0483e could not be found. Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:46:38.386129 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:46:38.391364 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:46:38.391364 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:46:38.391364 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:46:38.391364 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:46:38.391364 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:46:38.391364 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11e71f42-f1ec-46ca-a349-265766e0483e could not be found. Oct 05 02:46:38.391364 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:46:38.394140 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c93e89ab-f90f-46af-8c8d-39b5a4bf8269 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Returning 404 to user: Instance 11e71f42-f1ec-46ca-a349-265766e0483e could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:46:38.395263 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c93e89ab-f90f-46af-8c8d-39b5a4bf8269 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e" status: 404 len: 111 microversion: 2.1 time: 0.088564 Oct 05 02:46:38.396469 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2050/4070] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:38 2022] GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:46:38.414023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a8094ce9-027a-4fb4-b3b7-60685fc5219c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:38.447427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a8094ce9-027a-4fb4-b3b7-60685fc5219c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: ae8e1003-15ab-4801-a026-e9d80e200d3c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:38.462446 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8094ce9-027a-4fb4-b3b7-60685fc5219c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:38.462960 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8094ce9-027a-4fb4-b3b7-60685fc5219c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:38.463408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8094ce9-027a-4fb4-b3b7-60685fc5219c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:38.464153 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8094ce9-027a-4fb4-b3b7-60685fc5219c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:38.465118 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8094ce9-027a-4fb4-b3b7-60685fc5219c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:38.470687 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8094ce9-027a-4fb4-b3b7-60685fc5219c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:38.561494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-1dbe20e9-c7fb-4932-8788-40715984dba4 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: ac770ead-5d43-4762-9cea-cb163c073d5c] Updating instance_info_cache with network_info: [{"id": "376ff818-7bff-4848-847c-b6e88a6b8588", "address": "fa:16:3e:7e:40:d6", "network": {"id": "fe740311-a76a-438e-a2c2-3036d93972fd", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2071185980-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1ae15e13c1ae4b2db5de94fbd428867d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap376ff818-7b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 05 02:46:38.596493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1dbe20e9-c7fb-4932-8788-40715984dba4 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Releasing lock "refresh_cache-ac770ead-5d43-4762-9cea-cb163c073d5c" {{(pid=122319) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 05 02:46:38.597500 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1dbe20e9-c7fb-4932-8788-40715984dba4 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "POST /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c/action" status: 202 len: 0 microversion: 2.1 time: 5.674098 Oct 05 02:46:38.598547 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2021/4071] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:46:32 2022] POST /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c/action => generated 0 bytes in 5676 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 05 02:46:38.603631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e1c345e1-b8e6-442d-ac54-169e4ee3ad3c tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:38.604855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e1c345e1-b8e6-442d-ac54-169e4ee3ad3c tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:38.616800 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e1c345e1-b8e6-442d-ac54-169e4ee3ad3c tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:38.617993 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e1c345e1-b8e6-442d-ac54-169e4ee3ad3c tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:38.618667 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e1c345e1-b8e6-442d-ac54-169e4ee3ad3c tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:38.619795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e1c345e1-b8e6-442d-ac54-169e4ee3ad3c tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:38.620477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e1c345e1-b8e6-442d-ac54-169e4ee3ad3c tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:38.621148 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e1c345e1-b8e6-442d-ac54-169e4ee3ad3c tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:39.203241 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a8094ce9-027a-4fb4-b3b7-60685fc5219c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:39.218648 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a8094ce9-027a-4fb4-b3b7-60685fc5219c tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c" status: 200 len: 1550 microversion: 2.1 time: 0.816139 Oct 05 02:46:39.219988 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2051/4072] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:38 2022] GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c => generated 1550 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:39.230764 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-361edaec-eede-4990-9c72-8b9e9e42f712 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:39.231598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-361edaec-eede-4990-9c72-8b9e9e42f712 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: ac770ead-5d43-4762-9cea-cb163c073d5c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:39.245162 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-361edaec-eede-4990-9c72-8b9e9e42f712 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:39.247430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-361edaec-eede-4990-9c72-8b9e9e42f712 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:39.248873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-361edaec-eede-4990-9c72-8b9e9e42f712 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:39.249907 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-361edaec-eede-4990-9c72-8b9e9e42f712 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:39.253865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-361edaec-eede-4990-9c72-8b9e9e42f712 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:39.254581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-361edaec-eede-4990-9c72-8b9e9e42f712 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:39.262590 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e1c345e1-b8e6-442d-ac54-169e4ee3ad3c tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:39.275336 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e1c345e1-b8e6-442d-ac54-169e4ee3ad3c tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1313 microversion: 2.1 time: 0.675393 Oct 05 02:46:39.280800 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2022/4073] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:38 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1313 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:39.293595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8f253184-5ee5-4790-8753-d484c3dea591 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-195440197", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "e4f9d49c-25ab-4e4f-a7c4-00e803798e90"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:39.310793 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-361edaec-eede-4990-9c72-8b9e9e42f712 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: ac770ead-5d43-4762-9cea-cb163c073d5c] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:46:39.431020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-8f253184-5ee5-4790-8753-d484c3dea591 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] validate_networks() for [('e4f9d49c-25ab-4e4f-a7c4-00e803798e90', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:46:39.487166 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-361edaec-eede-4990-9c72-8b9e9e42f712 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c" status: 204 len: 0 microversion: 2.1 time: 0.265553 Oct 05 02:46:39.488459 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2052/4074] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:46:39 2022] DELETE /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:46:39.499262 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a4c66f38-d7b9-403e-8d16-d12d9a5e3df8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:39.500456 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a4c66f38-d7b9-403e-8d16-d12d9a5e3df8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: ae8e1003-15ab-4801-a026-e9d80e200d3c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:39.513682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a4c66f38-d7b9-403e-8d16-d12d9a5e3df8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:39.514524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a4c66f38-d7b9-403e-8d16-d12d9a5e3df8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:39.515426 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a4c66f38-d7b9-403e-8d16-d12d9a5e3df8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:39.523032 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a4c66f38-d7b9-403e-8d16-d12d9a5e3df8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:39.523748 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a4c66f38-d7b9-403e-8d16-d12d9a5e3df8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:39.524411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a4c66f38-d7b9-403e-8d16-d12d9a5e3df8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:39.671458 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a4c66f38-d7b9-403e-8d16-d12d9a5e3df8 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.181482 Oct 05 02:46:39.672061 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2053/4075] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 02:46:39 2022] GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c/os-interface => generated 284 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:46:39.677268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b379a34f-7737-43a1-9c43-fab55f34b8c1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:39.678259 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b379a34f-7737-43a1-9c43-fab55f34b8c1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: eceb1b06-e5fa-442b-ae37-cce2f99d58ae] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:39.691433 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b379a34f-7737-43a1-9c43-fab55f34b8c1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:39.692298 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b379a34f-7737-43a1-9c43-fab55f34b8c1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:39.692879 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b379a34f-7737-43a1-9c43-fab55f34b8c1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:39.693826 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b379a34f-7737-43a1-9c43-fab55f34b8c1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:39.694278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b379a34f-7737-43a1-9c43-fab55f34b8c1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:39.694701 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b379a34f-7737-43a1-9c43-fab55f34b8c1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:40.072665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b379a34f-7737-43a1-9c43-fab55f34b8c1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:40.086203 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b379a34f-7737-43a1-9c43-fab55f34b8c1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae" status: 200 len: 1314 microversion: 2.1 time: 0.412441 Oct 05 02:46:40.088519 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2054/4076] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:39 2022] GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:40.094404 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0c9f4a14-b269-442d-8410-5e92fe4f863c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.3"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:40.098560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0c9f4a14-b269-442d-8410-5e92fe4f863c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: c2d68022-2fa3-4464-8004-262c23e41ea2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:40.108685 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c9f4a14-b269-442d-8410-5e92fe4f863c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:40.109935 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c9f4a14-b269-442d-8410-5e92fe4f863c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:40.110607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c9f4a14-b269-442d-8410-5e92fe4f863c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:40.111785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c9f4a14-b269-442d-8410-5e92fe4f863c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:40.112393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c9f4a14-b269-442d-8410-5e92fe4f863c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:40.113049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c9f4a14-b269-442d-8410-5e92fe4f863c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:40.152205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c9f4a14-b269-442d-8410-5e92fe4f863c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "refresh_cache-c2d68022-2fa3-4464-8004-262c23e41ea2" {{(pid=122320) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 05 02:46:40.152957 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c9f4a14-b269-442d-8410-5e92fe4f863c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquired lock "refresh_cache-c2d68022-2fa3-4464-8004-262c23e41ea2" {{(pid=122320) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 05 02:46:40.579094 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=4 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:40.604266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=12 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:40.927758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-8f253184-5ee5-4790-8753-d484c3dea591 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:46:40.928716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-8f253184-5ee5-4790-8753-d484c3dea591 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:46:40.929514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-8f253184-5ee5-4790-8753-d484c3dea591 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:46:40.930766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-8f253184-5ee5-4790-8753-d484c3dea591 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:46:40.931374 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-8f253184-5ee5-4790-8753-d484c3dea591 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:46:40.945990 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f253184-5ee5-4790-8753-d484c3dea591 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:40.946952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f253184-5ee5-4790-8753-d484c3dea591 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:40.947866 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f253184-5ee5-4790-8753-d484c3dea591 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:40.949775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f253184-5ee5-4790-8753-d484c3dea591 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:40.950413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f253184-5ee5-4790-8753-d484c3dea591 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:40.951028 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f253184-5ee5-4790-8753-d484c3dea591 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:40.997348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-8f253184-5ee5-4790-8753-d484c3dea591 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Getting quotas for project d797c0058e8c456290081d056df79292. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:46:41.011236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-8f253184-5ee5-4790-8753-d484c3dea591 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Getting quotas for user ff170a5be8a04902b66e5f0e79fd47df and project d797c0058e8c456290081d056df79292. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:46:41.033231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8f253184-5ee5-4790-8753-d484c3dea591 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:46:41.036098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8f253184-5ee5-4790-8753-d484c3dea591 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:46:41.150832 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8f253184-5ee5-4790-8753-d484c3dea591 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.860898 Oct 05 02:46:41.157922 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2023/4077] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:46:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:46:41.162916 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-6334d5c3-0f08-4976-a8cd-98e0eb360240 req-3051c2d9-4191-41da-a39b-e439f42fa878 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eceb1b06-e5fa-442b-ae37-cce2f99d58ae", "tag": "7a2af2b2-9d69-41ec-970a-8afdc30e948d"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:41.181205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6334d5c3-0f08-4976-a8cd-98e0eb360240 req-3051c2d9-4191-41da-a39b-e439f42fa878 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:41.181566 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6334d5c3-0f08-4976-a8cd-98e0eb360240 req-3051c2d9-4191-41da-a39b-e439f42fa878 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:41.182196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6334d5c3-0f08-4976-a8cd-98e0eb360240 req-3051c2d9-4191-41da-a39b-e439f42fa878 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:41.191905 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:41.210460 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-6334d5c3-0f08-4976-a8cd-98e0eb360240 req-3051c2d9-4191-41da-a39b-e439f42fa878 service nova] Creating event network-changed:7a2af2b2-9d69-41ec-970a-8afdc30e948d for instance eceb1b06-e5fa-442b-ae37-cce2f99d58ae on n-h2-858272-3 Oct 05 02:46:41.227011 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-6334d5c3-0f08-4976-a8cd-98e0eb360240 req-3051c2d9-4191-41da-a39b-e439f42fa878 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067564 Oct 05 02:46:41.229424 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2024/4078] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:46:41.235338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-38f986d9-3d56-412e-aa3c-1454e792a1f8 req-b7a7ae00-ebfc-4f72-8882-feefcd78d295 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a9c787b-50d1-4c8b-bb14-6eccdfcad827", "tag": "db6b304e-8f4d-4073-9fd4-9f4927ee4358"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:41.250575 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-38f986d9-3d56-412e-aa3c-1454e792a1f8 req-b7a7ae00-ebfc-4f72-8882-feefcd78d295 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:41.258686 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-38f986d9-3d56-412e-aa3c-1454e792a1f8 req-b7a7ae00-ebfc-4f72-8882-feefcd78d295 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:41.260325 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-38f986d9-3d56-412e-aa3c-1454e792a1f8 req-b7a7ae00-ebfc-4f72-8882-feefcd78d295 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:41.275083 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-38f986d9-3d56-412e-aa3c-1454e792a1f8 req-b7a7ae00-ebfc-4f72-8882-feefcd78d295 service nova] Creating event network-changed:db6b304e-8f4d-4073-9fd4-9f4927ee4358 for instance 4a9c787b-50d1-4c8b-bb14-6eccdfcad827 on n-h2-858272-3 Oct 05 02:46:41.282498 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-38f986d9-3d56-412e-aa3c-1454e792a1f8 req-b7a7ae00-ebfc-4f72-8882-feefcd78d295 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051512 Oct 05 02:46:41.283579 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2025/4079] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:46:41.289246 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4819238d-5c43-4f6b-bbd5-dbb3bc340017 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:41.290331 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4819238d-5c43-4f6b-bbd5-dbb3bc340017 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:41.304720 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4819238d-5c43-4f6b-bbd5-dbb3bc340017 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:41.305512 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4819238d-5c43-4f6b-bbd5-dbb3bc340017 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:41.306119 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4819238d-5c43-4f6b-bbd5-dbb3bc340017 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:41.307205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4819238d-5c43-4f6b-bbd5-dbb3bc340017 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:41.307823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4819238d-5c43-4f6b-bbd5-dbb3bc340017 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:41.308507 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4819238d-5c43-4f6b-bbd5-dbb3bc340017 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:41.710670 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:42.870965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4819238d-5c43-4f6b-bbd5-dbb3bc340017 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:42.881780 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4819238d-5c43-4f6b-bbd5-dbb3bc340017 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1313 microversion: 2.1 time: 1.596849 Oct 05 02:46:42.882695 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2026/4080] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:41 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1313 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:42.890698 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-466bb5da-cd3e-4d8e-871f-6f3c13594bb9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:42.891527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-466bb5da-cd3e-4d8e-871f-6f3c13594bb9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: eceb1b06-e5fa-442b-ae37-cce2f99d58ae] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:42.902461 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-466bb5da-cd3e-4d8e-871f-6f3c13594bb9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:42.903209 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-466bb5da-cd3e-4d8e-871f-6f3c13594bb9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:42.905093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-466bb5da-cd3e-4d8e-871f-6f3c13594bb9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:42.905987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-466bb5da-cd3e-4d8e-871f-6f3c13594bb9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:42.906596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-466bb5da-cd3e-4d8e-871f-6f3c13594bb9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:42.907181 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-466bb5da-cd3e-4d8e-871f-6f3c13594bb9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:43.784824 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-466bb5da-cd3e-4d8e-871f-6f3c13594bb9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:43.793023 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-466bb5da-cd3e-4d8e-871f-6f3c13594bb9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae" status: 200 len: 1314 microversion: 2.1 time: 0.909068 Oct 05 02:46:43.809556 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2027/4081] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:42 2022] GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae => generated 1314 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:43.822420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-432c1b44-3761-4ce4-902b-5bed11745690 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:43.823420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-432c1b44-3761-4ce4-902b-5bed11745690 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:43.832503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-432c1b44-3761-4ce4-902b-5bed11745690 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:43.833490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-432c1b44-3761-4ce4-902b-5bed11745690 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:43.834174 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-432c1b44-3761-4ce4-902b-5bed11745690 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:43.835108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-432c1b44-3761-4ce4-902b-5bed11745690 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:43.835795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-432c1b44-3761-4ce4-902b-5bed11745690 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:43.836433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-432c1b44-3761-4ce4-902b-5bed11745690 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:44.014194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-432c1b44-3761-4ce4-902b-5bed11745690 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:44.026534 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-432c1b44-3761-4ce4-902b-5bed11745690 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1266 microversion: 2.1 time: 0.214878 Oct 05 02:46:44.031973 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2028/4082] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:43 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:44.041705 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-b5dc66b1-141b-4867-b6ed-bf4c559e5a94 req-827f24a2-5229-4671-a288-eb6b0e802382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac770ead-5d43-4762-9cea-cb163c073d5c", "name": "network-vif-deleted", "tag": "376ff818-7bff-4848-847c-b6e88a6b8588"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:44.067273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b5dc66b1-141b-4867-b6ed-bf4c559e5a94 req-827f24a2-5229-4671-a288-eb6b0e802382 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:44.071294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b5dc66b1-141b-4867-b6ed-bf4c559e5a94 req-827f24a2-5229-4671-a288-eb6b0e802382 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:44.072030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b5dc66b1-141b-4867-b6ed-bf4c559e5a94 req-827f24a2-5229-4671-a288-eb6b0e802382 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:44.099275 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-b5dc66b1-141b-4867-b6ed-bf4c559e5a94 req-827f24a2-5229-4671-a288-eb6b0e802382 service nova] Creating event network-vif-deleted:376ff818-7bff-4848-847c-b6e88a6b8588 for instance ac770ead-5d43-4762-9cea-cb163c073d5c on n-h1-858272-3 Oct 05 02:46:44.105745 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-b5dc66b1-141b-4867-b6ed-bf4c559e5a94 req-827f24a2-5229-4671-a288-eb6b0e802382 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071586 Oct 05 02:46:44.107344 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2029/4083] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:46:44.119628 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-abfe6a0d-62e9-4fc0-a35f-c94d48049b49 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:44.121420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-abfe6a0d-62e9-4fc0-a35f-c94d48049b49 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:44.133021 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:44.142102 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abfe6a0d-62e9-4fc0-a35f-c94d48049b49 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:44.143024 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abfe6a0d-62e9-4fc0-a35f-c94d48049b49 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:44.144932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abfe6a0d-62e9-4fc0-a35f-c94d48049b49 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:44.148118 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abfe6a0d-62e9-4fc0-a35f-c94d48049b49 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:44.160076 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abfe6a0d-62e9-4fc0-a35f-c94d48049b49 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:44.162092 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abfe6a0d-62e9-4fc0-a35f-c94d48049b49 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:44.610151 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-abfe6a0d-62e9-4fc0-a35f-c94d48049b49 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:44.625332 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-abfe6a0d-62e9-4fc0-a35f-c94d48049b49 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1313 microversion: 2.1 time: 0.516496 Oct 05 02:46:44.627346 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2030/4084] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:44 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1313 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:44.639367 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-fb1bcf08-154d-472b-ad08-e56b4c287c1e req-85d60029-c4ab-461c-bfd7-55a92c4e034c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae8e1003-15ab-4801-a026-e9d80e200d3c", "tag": "e39d2c77-d9f4-430b-9b4f-2778c13414de"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:44.665300 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-fb1bcf08-154d-472b-ad08-e56b4c287c1e req-85d60029-c4ab-461c-bfd7-55a92c4e034c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:44.677295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-fb1bcf08-154d-472b-ad08-e56b4c287c1e req-85d60029-c4ab-461c-bfd7-55a92c4e034c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:44.680521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-fb1bcf08-154d-472b-ad08-e56b4c287c1e req-85d60029-c4ab-461c-bfd7-55a92c4e034c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:44.720026 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-fb1bcf08-154d-472b-ad08-e56b4c287c1e req-85d60029-c4ab-461c-bfd7-55a92c4e034c service nova] Creating event network-changed:e39d2c77-d9f4-430b-9b4f-2778c13414de for instance ae8e1003-15ab-4801-a026-e9d80e200d3c on n-h2-858272-3 Oct 05 02:46:44.727852 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-fb1bcf08-154d-472b-ad08-e56b4c287c1e req-85d60029-c4ab-461c-bfd7-55a92c4e034c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099038 Oct 05 02:46:44.731877 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2031/4085] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:46:44.738499 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-0c9f4a14-b269-442d-8410-5e92fe4f863c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: c2d68022-2fa3-4464-8004-262c23e41ea2] Building network info cache for instance {{(pid=122320) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 05 02:46:44.822894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1f55c5dc-924a-4d47-bc43-8a040ca67dff tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:44.823620 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1f55c5dc-924a-4d47-bc43-8a040ca67dff tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: eceb1b06-e5fa-442b-ae37-cce2f99d58ae] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:44.831014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f55c5dc-924a-4d47-bc43-8a040ca67dff tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:44.831526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f55c5dc-924a-4d47-bc43-8a040ca67dff tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:44.831855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f55c5dc-924a-4d47-bc43-8a040ca67dff tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:44.832563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f55c5dc-924a-4d47-bc43-8a040ca67dff tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:44.833117 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f55c5dc-924a-4d47-bc43-8a040ca67dff tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:44.833735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f55c5dc-924a-4d47-bc43-8a040ca67dff tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:45.274931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1f55c5dc-924a-4d47-bc43-8a040ca67dff tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:45.287754 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1f55c5dc-924a-4d47-bc43-8a040ca67dff tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae" status: 200 len: 1314 microversion: 2.1 time: 0.468987 Oct 05 02:46:45.288363 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2032/4086] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:44 2022] GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:45.293374 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-efea07ab-2397-4b6f-9602-edc4b5271e8b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:45.294009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-efea07ab-2397-4b6f-9602-edc4b5271e8b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:45.313883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-efea07ab-2397-4b6f-9602-edc4b5271e8b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:45.314393 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-efea07ab-2397-4b6f-9602-edc4b5271e8b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:45.314840 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-efea07ab-2397-4b6f-9602-edc4b5271e8b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:45.315611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-efea07ab-2397-4b6f-9602-edc4b5271e8b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:45.316079 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-efea07ab-2397-4b6f-9602-edc4b5271e8b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:45.316509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-efea07ab-2397-4b6f-9602-edc4b5271e8b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:45.630137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-efea07ab-2397-4b6f-9602-edc4b5271e8b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:45.639899 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-efea07ab-2397-4b6f-9602-edc4b5271e8b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1266 microversion: 2.1 time: 0.350438 Oct 05 02:46:45.665555 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2033/4087] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:45 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1266 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:45.702112 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-69ed5d1b-cb48-48ed-a009-26f51ddb9a53 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:45.703055 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-69ed5d1b-cb48-48ed-a009-26f51ddb9a53 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:45.730797 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69ed5d1b-cb48-48ed-a009-26f51ddb9a53 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:45.731548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69ed5d1b-cb48-48ed-a009-26f51ddb9a53 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:45.732708 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69ed5d1b-cb48-48ed-a009-26f51ddb9a53 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:45.733736 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69ed5d1b-cb48-48ed-a009-26f51ddb9a53 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:45.734441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69ed5d1b-cb48-48ed-a009-26f51ddb9a53 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:45.735072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69ed5d1b-cb48-48ed-a009-26f51ddb9a53 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:46.431661 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 02:46:46.432722 n-d-858272-3 devstack@n-api.service[122319]: Wed Oct 5 02:46:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 (ip 10.222.0.16) !!! Oct 05 02:46:46.611560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-69ed5d1b-cb48-48ed-a009-26f51ddb9a53 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:46.636720 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-69ed5d1b-cb48-48ed-a009-26f51ddb9a53 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1313 microversion: 2.1 time: 0.954988 Oct 05 02:46:46.639409 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2034/4088] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:45 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1313 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:46.653589 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2eedc3ab-2e73-44f4-b7df-1e2ba626a298 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:46.661288 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2eedc3ab-2e73-44f4-b7df-1e2ba626a298 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: eceb1b06-e5fa-442b-ae37-cce2f99d58ae] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:46.688602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2eedc3ab-2e73-44f4-b7df-1e2ba626a298 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:46.697768 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2eedc3ab-2e73-44f4-b7df-1e2ba626a298 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:46.698306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2eedc3ab-2e73-44f4-b7df-1e2ba626a298 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:46.699561 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2eedc3ab-2e73-44f4-b7df-1e2ba626a298 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:46.700063 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2eedc3ab-2e73-44f4-b7df-1e2ba626a298 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:46.701320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2eedc3ab-2e73-44f4-b7df-1e2ba626a298 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:47.257467 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2eedc3ab-2e73-44f4-b7df-1e2ba626a298 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:47.268659 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2eedc3ab-2e73-44f4-b7df-1e2ba626a298 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae" status: 200 len: 1314 microversion: 2.1 time: 0.627514 Oct 05 02:46:47.281764 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2035/4089] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:46 2022] GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae => generated 1314 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:47.303009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-43737aec-aff0-492f-855f-eed99d84e7ec tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:47.303893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-43737aec-aff0-492f-855f-eed99d84e7ec tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:47.320779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43737aec-aff0-492f-855f-eed99d84e7ec tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:47.321308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43737aec-aff0-492f-855f-eed99d84e7ec tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:47.321750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43737aec-aff0-492f-855f-eed99d84e7ec tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:47.322466 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43737aec-aff0-492f-855f-eed99d84e7ec tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:47.322932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43737aec-aff0-492f-855f-eed99d84e7ec tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:47.323360 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43737aec-aff0-492f-855f-eed99d84e7ec tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:47.424492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-0c9f4a14-b269-442d-8410-5e92fe4f863c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: c2d68022-2fa3-4464-8004-262c23e41ea2] Updating instance_info_cache with network_info: [{"id": "baf1bb4d-f79e-4dc4-903a-f0407e6bf5d8", "address": "fa:16:3e:29:05:2e", "network": {"id": "fe740311-a76a-438e-a2c2-3036d93972fd", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2071185980-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1ae15e13c1ae4b2db5de94fbd428867d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbaf1bb4d-f7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122320) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 05 02:46:47.451780 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c9f4a14-b269-442d-8410-5e92fe4f863c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Releasing lock "refresh_cache-c2d68022-2fa3-4464-8004-262c23e41ea2" {{(pid=122320) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 05 02:46:47.453104 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0c9f4a14-b269-442d-8410-5e92fe4f863c tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "POST /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2/action" status: 202 len: 0 microversion: 2.1 time: 7.363364 Oct 05 02:46:47.454263 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2055/4090] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:46:40 2022] POST /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2/action => generated 0 bytes in 7365 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 05 02:46:47.467520 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-20630d61-acc6-418b-a3e9-af2ce4ab7137 req-4e3bff89-559a-4a3c-a8dd-0e352164c299 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2d68022-2fa3-4464-8004-262c23e41ea2", "tag": "baf1bb4d-f79e-4dc4-903a-f0407e6bf5d8"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:47.479897 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:47.487703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-20630d61-acc6-418b-a3e9-af2ce4ab7137 req-4e3bff89-559a-4a3c-a8dd-0e352164c299 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:47.488698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-20630d61-acc6-418b-a3e9-af2ce4ab7137 req-4e3bff89-559a-4a3c-a8dd-0e352164c299 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:47.489370 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-20630d61-acc6-418b-a3e9-af2ce4ab7137 req-4e3bff89-559a-4a3c-a8dd-0e352164c299 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:47.491614 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-43737aec-aff0-492f-855f-eed99d84e7ec tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:47.504396 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-43737aec-aff0-492f-855f-eed99d84e7ec tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1272 microversion: 2.1 time: 0.206013 Oct 05 02:46:47.505014 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2036/4091] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:47 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1272 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:47.512486 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-a29eb571-e658-479a-9519-dba14505285a req-0db01e9d-364a-410e-9b5b-e64c5b6b0207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a9c787b-50d1-4c8b-bb14-6eccdfcad827", "name": "network-vif-plugged", "status": "completed", "tag": "db6b304e-8f4d-4073-9fd4-9f4927ee4358"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:47.518885 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-20630d61-acc6-418b-a3e9-af2ce4ab7137 req-4e3bff89-559a-4a3c-a8dd-0e352164c299 service nova] Creating event network-changed:baf1bb4d-f79e-4dc4-903a-f0407e6bf5d8 for instance c2d68022-2fa3-4464-8004-262c23e41ea2 on n-h2-858272-3 Oct 05 02:46:47.529082 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-20630d61-acc6-418b-a3e9-af2ce4ab7137 req-4e3bff89-559a-4a3c-a8dd-0e352164c299 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073256 Oct 05 02:46:47.530103 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2056/4092] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:46:47.535232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-51434048-256b-4a52-b1dc-005e00175490 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '.version_select at 0x7fcce4256d30>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:47.553713 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a29eb571-e658-479a-9519-dba14505285a req-0db01e9d-364a-410e-9b5b-e64c5b6b0207 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:47.554358 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a29eb571-e658-479a-9519-dba14505285a req-0db01e9d-364a-410e-9b5b-e64c5b6b0207 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:47.558600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a29eb571-e658-479a-9519-dba14505285a req-0db01e9d-364a-410e-9b5b-e64c5b6b0207 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:47.584674 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-a29eb571-e658-479a-9519-dba14505285a req-0db01e9d-364a-410e-9b5b-e64c5b6b0207 service nova] Creating event network-vif-plugged:db6b304e-8f4d-4073-9fd4-9f4927ee4358 for instance 4a9c787b-50d1-4c8b-bb14-6eccdfcad827 on n-h2-858272-3 Oct 05 02:46:47.591062 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-a29eb571-e658-479a-9519-dba14505285a req-0db01e9d-364a-410e-9b5b-e64c5b6b0207 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084200 Oct 05 02:46:47.593087 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2037/4093] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:46:47.668974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5a0a5fc5-4d9f-4eab-b9dd-bbc7d5e11daa tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:47.671249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5a0a5fc5-4d9f-4eab-b9dd-bbc7d5e11daa tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:47.689332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a0a5fc5-4d9f-4eab-b9dd-bbc7d5e11daa tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:47.724927 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a0a5fc5-4d9f-4eab-b9dd-bbc7d5e11daa tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:47.725644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a0a5fc5-4d9f-4eab-b9dd-bbc7d5e11daa tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:47.726694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a0a5fc5-4d9f-4eab-b9dd-bbc7d5e11daa tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:47.727490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a0a5fc5-4d9f-4eab-b9dd-bbc7d5e11daa tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:47.728125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a0a5fc5-4d9f-4eab-b9dd-bbc7d5e11daa tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:48.313012 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-51434048-256b-4a52-b1dc-005e00175490 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/3c04228d-71fc-41a6-befc-905c94e2a9fa" status: 200 len: 182 microversion: 2.1 time: 0.781665 Oct 05 02:46:48.320892 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2057/4094] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 5 02:46:47 2022] GET /compute/v2.1/os-floating-ips/3c04228d-71fc-41a6-befc-905c94e2a9fa => generated 182 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:46:48.321953 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-68169e75-eafb-458b-9958-912773aabc44 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:48.322707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-68169e75-eafb-458b-9958-912773aabc44 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: eceb1b06-e5fa-442b-ae37-cce2f99d58ae] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:48.333756 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5a0a5fc5-4d9f-4eab-b9dd-bbc7d5e11daa tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:48.338278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68169e75-eafb-458b-9958-912773aabc44 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:48.339580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68169e75-eafb-458b-9958-912773aabc44 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:48.340473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68169e75-eafb-458b-9958-912773aabc44 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:48.345966 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5a0a5fc5-4d9f-4eab-b9dd-bbc7d5e11daa tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1313 microversion: 2.1 time: 0.684706 Oct 05 02:46:48.352857 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2038/4095] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:47 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1313 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:48.355113 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68169e75-eafb-458b-9958-912773aabc44 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:48.356154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68169e75-eafb-458b-9958-912773aabc44 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:48.359743 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-187ad7a7-f8fb-4fa1-9d35-cf469d3a18a0 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.3"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:48.360089 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68169e75-eafb-458b-9958-912773aabc44 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:48.720413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-187ad7a7-f8fb-4fa1-9d35-cf469d3a18a0 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: c2d68022-2fa3-4464-8004-262c23e41ea2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:48.729628 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-187ad7a7-f8fb-4fa1-9d35-cf469d3a18a0 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:48.729954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-68169e75-eafb-458b-9958-912773aabc44 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:48.730950 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-187ad7a7-f8fb-4fa1-9d35-cf469d3a18a0 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:48.732093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-187ad7a7-f8fb-4fa1-9d35-cf469d3a18a0 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:48.734533 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-187ad7a7-f8fb-4fa1-9d35-cf469d3a18a0 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:48.735586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-187ad7a7-f8fb-4fa1-9d35-cf469d3a18a0 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:48.736200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-187ad7a7-f8fb-4fa1-9d35-cf469d3a18a0 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:48.740408 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-68169e75-eafb-458b-9958-912773aabc44 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae" status: 200 len: 1314 microversion: 2.1 time: 0.424837 Oct 05 02:46:48.758143 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2058/4096] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:48 2022] GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:48.764889 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ddfe28d2-cabc-44d5-8f48-3636387674f3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:48.766077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ddfe28d2-cabc-44d5-8f48-3636387674f3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:48.773530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ddfe28d2-cabc-44d5-8f48-3636387674f3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:48.774249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ddfe28d2-cabc-44d5-8f48-3636387674f3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:48.774898 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ddfe28d2-cabc-44d5-8f48-3636387674f3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:48.775940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ddfe28d2-cabc-44d5-8f48-3636387674f3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:48.776554 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ddfe28d2-cabc-44d5-8f48-3636387674f3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:48.777172 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ddfe28d2-cabc-44d5-8f48-3636387674f3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:48.992474 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ddfe28d2-cabc-44d5-8f48-3636387674f3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:49.009533 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ddfe28d2-cabc-44d5-8f48-3636387674f3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1314 microversion: 2.1 time: 0.249968 Oct 05 02:46:49.010660 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2059/4097] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:48 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:49.226288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-1b110b9b-7c4f-4e24-b039-e31ec7e25480 req-67c3e96b-d333-4f45-bd84-356d28218858 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "161a6f96-e469-47fd-a72f-df5a05e9a62b", "tag": "7d9bdf6d-adf0-4eb9-ab11-e0dc32dd5fa8"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:49.290392 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1b110b9b-7c4f-4e24-b039-e31ec7e25480 req-67c3e96b-d333-4f45-bd84-356d28218858 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:49.291103 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1b110b9b-7c4f-4e24-b039-e31ec7e25480 req-67c3e96b-d333-4f45-bd84-356d28218858 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:49.291716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1b110b9b-7c4f-4e24-b039-e31ec7e25480 req-67c3e96b-d333-4f45-bd84-356d28218858 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:49.329980 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-1b110b9b-7c4f-4e24-b039-e31ec7e25480 req-67c3e96b-d333-4f45-bd84-356d28218858 service nova] Creating event network-changed:7d9bdf6d-adf0-4eb9-ab11-e0dc32dd5fa8 for instance 161a6f96-e469-47fd-a72f-df5a05e9a62b on n-h2-858272-3 Oct 05 02:46:49.335529 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-1b110b9b-7c4f-4e24-b039-e31ec7e25480 req-67c3e96b-d333-4f45-bd84-356d28218858 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116080 Oct 05 02:46:49.336490 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2060/4098] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:46:49.376515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-830c96b3-9300-416a-9393-d07c38fa201e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:49.377257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-830c96b3-9300-416a-9393-d07c38fa201e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:49.382543 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-187ad7a7-f8fb-4fa1-9d35-cf469d3a18a0 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "refresh_cache-c2d68022-2fa3-4464-8004-262c23e41ea2" {{(pid=122319) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 05 02:46:49.384291 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-187ad7a7-f8fb-4fa1-9d35-cf469d3a18a0 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquired lock "refresh_cache-c2d68022-2fa3-4464-8004-262c23e41ea2" {{(pid=122319) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 05 02:46:49.395944 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-830c96b3-9300-416a-9393-d07c38fa201e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:49.396706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-830c96b3-9300-416a-9393-d07c38fa201e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:49.397667 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-830c96b3-9300-416a-9393-d07c38fa201e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:49.398586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-830c96b3-9300-416a-9393-d07c38fa201e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:49.399223 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-830c96b3-9300-416a-9393-d07c38fa201e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:49.399823 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-830c96b3-9300-416a-9393-d07c38fa201e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:49.698929 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-830c96b3-9300-416a-9393-d07c38fa201e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:49.707724 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-830c96b3-9300-416a-9393-d07c38fa201e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1313 microversion: 2.1 time: 0.337311 Oct 05 02:46:49.709115 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2061/4099] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:49 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:49.714105 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-0d0afff7-f67d-4194-92a2-e10122a5b4a7 req-6c64d57b-be7f-402b-9661-8e42c4f2d008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eceb1b06-e5fa-442b-ae37-cce2f99d58ae", "name": "network-vif-plugged", "status": "completed", "tag": "7a2af2b2-9d69-41ec-970a-8afdc30e948d"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:49.727489 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-0d0afff7-f67d-4194-92a2-e10122a5b4a7 req-6c64d57b-be7f-402b-9661-8e42c4f2d008 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:49.728391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-0d0afff7-f67d-4194-92a2-e10122a5b4a7 req-6c64d57b-be7f-402b-9661-8e42c4f2d008 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:49.728809 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-0d0afff7-f67d-4194-92a2-e10122a5b4a7 req-6c64d57b-be7f-402b-9661-8e42c4f2d008 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:49.744137 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-0d0afff7-f67d-4194-92a2-e10122a5b4a7 req-6c64d57b-be7f-402b-9661-8e42c4f2d008 service nova] Creating event network-vif-plugged:7a2af2b2-9d69-41ec-970a-8afdc30e948d for instance eceb1b06-e5fa-442b-ae37-cce2f99d58ae on n-h2-858272-3 Oct 05 02:46:49.751107 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-0d0afff7-f67d-4194-92a2-e10122a5b4a7 req-6c64d57b-be7f-402b-9661-8e42c4f2d008 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040489 Oct 05 02:46:49.752088 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2062/4100] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:46:49.766710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ee88bf86-4e2a-45fe-91c6-095af0bce4ed tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:49.767522 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ee88bf86-4e2a-45fe-91c6-095af0bce4ed tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: eceb1b06-e5fa-442b-ae37-cce2f99d58ae] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:49.774825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ee88bf86-4e2a-45fe-91c6-095af0bce4ed tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:49.775760 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ee88bf86-4e2a-45fe-91c6-095af0bce4ed tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:49.776429 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ee88bf86-4e2a-45fe-91c6-095af0bce4ed tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:49.777233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ee88bf86-4e2a-45fe-91c6-095af0bce4ed tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:49.777888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ee88bf86-4e2a-45fe-91c6-095af0bce4ed tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:49.779066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ee88bf86-4e2a-45fe-91c6-095af0bce4ed tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:50.527345 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ee88bf86-4e2a-45fe-91c6-095af0bce4ed tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:50.536771 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ee88bf86-4e2a-45fe-91c6-095af0bce4ed tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae" status: 200 len: 1314 microversion: 2.1 time: 0.774988 Oct 05 02:46:50.553106 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2063/4101] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:49 2022] GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae => generated 1314 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:50.559532 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8763b6b0-964c-4a58-b5e3-064d0a0fa5f6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:50.561361 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8763b6b0-964c-4a58-b5e3-064d0a0fa5f6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:50.568891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8763b6b0-964c-4a58-b5e3-064d0a0fa5f6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:50.569872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8763b6b0-964c-4a58-b5e3-064d0a0fa5f6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:50.570529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8763b6b0-964c-4a58-b5e3-064d0a0fa5f6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:50.571465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8763b6b0-964c-4a58-b5e3-064d0a0fa5f6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:50.572322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8763b6b0-964c-4a58-b5e3-064d0a0fa5f6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:50.573017 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8763b6b0-964c-4a58-b5e3-064d0a0fa5f6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:50.579415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:50.820128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8763b6b0-964c-4a58-b5e3-064d0a0fa5f6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:50.833742 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8763b6b0-964c-4a58-b5e3-064d0a0fa5f6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1314 microversion: 2.1 time: 0.277843 Oct 05 02:46:50.849767 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2064/4102] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:50 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:50.892216 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8b49559f-d726-4686-901e-fdc2832b91f5 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:50.893269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8b49559f-d726-4686-901e-fdc2832b91f5 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:50.908948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b49559f-d726-4686-901e-fdc2832b91f5 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:50.909462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b49559f-d726-4686-901e-fdc2832b91f5 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:50.909896 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b49559f-d726-4686-901e-fdc2832b91f5 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:50.912102 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b49559f-d726-4686-901e-fdc2832b91f5 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:50.914584 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b49559f-d726-4686-901e-fdc2832b91f5 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:50.915211 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b49559f-d726-4686-901e-fdc2832b91f5 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:50.965640 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:51.026838 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:51.054119 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-187ad7a7-f8fb-4fa1-9d35-cf469d3a18a0 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: c2d68022-2fa3-4464-8004-262c23e41ea2] Building network info cache for instance {{(pid=122319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 05 02:46:51.695796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8b49559f-d726-4686-901e-fdc2832b91f5 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:51.713281 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8b49559f-d726-4686-901e-fdc2832b91f5 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1499 microversion: 2.1 time: 0.861946 Oct 05 02:46:51.726830 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2065/4103] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:50 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1499 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:51.745834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-c57c81fd-4308-404e-ab8b-b282987d5a47 req-0210a054-119c-4eb2-9127-9bbbf9bc7943 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2d68022-2fa3-4464-8004-262c23e41ea2", "tag": "baf1bb4d-f79e-4dc4-903a-f0407e6bf5d8"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:51.770650 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-c57c81fd-4308-404e-ab8b-b282987d5a47 req-0210a054-119c-4eb2-9127-9bbbf9bc7943 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:51.777187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-c57c81fd-4308-404e-ab8b-b282987d5a47 req-0210a054-119c-4eb2-9127-9bbbf9bc7943 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:51.777738 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-c57c81fd-4308-404e-ab8b-b282987d5a47 req-0210a054-119c-4eb2-9127-9bbbf9bc7943 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:51.797246 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-c57c81fd-4308-404e-ab8b-b282987d5a47 req-0210a054-119c-4eb2-9127-9bbbf9bc7943 service nova] Creating event network-changed:baf1bb4d-f79e-4dc4-903a-f0407e6bf5d8 for instance c2d68022-2fa3-4464-8004-262c23e41ea2 on n-h2-858272-3 Oct 05 02:46:51.803474 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-c57c81fd-4308-404e-ab8b-b282987d5a47 req-0210a054-119c-4eb2-9127-9bbbf9bc7943 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075157 Oct 05 02:46:51.805518 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2066/4104] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:46:51.812659 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6d59949c-bee0-4463-8ca9-9ab3639c59b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:51.813756 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6d59949c-bee0-4463-8ca9-9ab3639c59b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: eceb1b06-e5fa-442b-ae37-cce2f99d58ae] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:51.822928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6d59949c-bee0-4463-8ca9-9ab3639c59b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:51.824208 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6d59949c-bee0-4463-8ca9-9ab3639c59b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:51.825019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6d59949c-bee0-4463-8ca9-9ab3639c59b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:51.826686 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6d59949c-bee0-4463-8ca9-9ab3639c59b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:51.827458 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6d59949c-bee0-4463-8ca9-9ab3639c59b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:51.828448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6d59949c-bee0-4463-8ca9-9ab3639c59b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:51.868850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-187ad7a7-f8fb-4fa1-9d35-cf469d3a18a0 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: c2d68022-2fa3-4464-8004-262c23e41ea2] Updating instance_info_cache with network_info: [{"id": "baf1bb4d-f79e-4dc4-903a-f0407e6bf5d8", "address": "fa:16:3e:29:05:2e", "network": {"id": "fe740311-a76a-438e-a2c2-3036d93972fd", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2071185980-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1ae15e13c1ae4b2db5de94fbd428867d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbaf1bb4d-f7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 05 02:46:51.894084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-187ad7a7-f8fb-4fa1-9d35-cf469d3a18a0 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Releasing lock "refresh_cache-c2d68022-2fa3-4464-8004-262c23e41ea2" {{(pid=122319) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 05 02:46:51.895166 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-187ad7a7-f8fb-4fa1-9d35-cf469d3a18a0 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "POST /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2/action" status: 202 len: 0 microversion: 2.1 time: 3.540988 Oct 05 02:46:51.899762 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2039/4105] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:46:48 2022] POST /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2/action => generated 0 bytes in 3542 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 05 02:46:51.901846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8c24f7c2-efb5-450f-a5e1-4881a871459d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:51.905177 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8c24f7c2-efb5-450f-a5e1-4881a871459d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:51.916188 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c24f7c2-efb5-450f-a5e1-4881a871459d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:51.917667 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c24f7c2-efb5-450f-a5e1-4881a871459d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:51.918780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c24f7c2-efb5-450f-a5e1-4881a871459d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:51.920480 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c24f7c2-efb5-450f-a5e1-4881a871459d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:51.921335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c24f7c2-efb5-450f-a5e1-4881a871459d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:51.921945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c24f7c2-efb5-450f-a5e1-4881a871459d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:51.997307 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-8c24f7c2-efb5-450f-a5e1-4881a871459d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lazy-loading 'flavor' on Instance uuid 4a9c787b-50d1-4c8b-bb14-6eccdfcad827 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:46:52.052772 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6d59949c-bee0-4463-8ca9-9ab3639c59b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:52.078976 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6d59949c-bee0-4463-8ca9-9ab3639c59b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae" status: 200 len: 1314 microversion: 2.1 time: 0.271285 Oct 05 02:46:52.085244 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2067/4106] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:51 2022] GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:52.120163 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9eca8e65-feb4-4f07-9092-e8e38579ff77 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:52.136386 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9eca8e65-feb4-4f07-9092-e8e38579ff77 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:52.177288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9eca8e65-feb4-4f07-9092-e8e38579ff77 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:52.178653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9eca8e65-feb4-4f07-9092-e8e38579ff77 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:52.179254 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9eca8e65-feb4-4f07-9092-e8e38579ff77 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:52.180172 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9eca8e65-feb4-4f07-9092-e8e38579ff77 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:52.180806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9eca8e65-feb4-4f07-9092-e8e38579ff77 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:52.181509 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9eca8e65-feb4-4f07-9092-e8e38579ff77 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:52.192310 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8c24f7c2-efb5-450f-a5e1-4881a871459d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "POST /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827/action" status: 200 len: 32 microversion: 2.1 time: 0.294179 Oct 05 02:46:52.193358 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2040/4107] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:46:51 2022] POST /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827/action => generated 32 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:46:52.213065 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ad6f158d-a846-41ab-9f76-0da8a847a79d tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:52.214049 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ad6f158d-a846-41ab-9f76-0da8a847a79d tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: ac770ead-5d43-4762-9cea-cb163c073d5c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:52.226930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad6f158d-a846-41ab-9f76-0da8a847a79d tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:52.229400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad6f158d-a846-41ab-9f76-0da8a847a79d tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:52.233738 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad6f158d-a846-41ab-9f76-0da8a847a79d tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:52.234761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad6f158d-a846-41ab-9f76-0da8a847a79d tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:52.235314 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad6f158d-a846-41ab-9f76-0da8a847a79d tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:52.235822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad6f158d-a846-41ab-9f76-0da8a847a79d tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:52.246846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:52.275069 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-ad6f158d-a846-41ab-9f76-0da8a847a79d tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] HTTP exception thrown: Instance ac770ead-5d43-4762-9cea-cb163c073d5c could not be found. Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ad6f158d-a846-41ab-9f76-0da8a847a79d tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Request method failure captured: Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c HTTP/1.1 Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO-_YAk49lT-VoDNWG4JMCGuN03AJh3L--gWDPtlaR70f-QCyuwo15V7YSXMUFTpujP0kONQy-VFYnzkuo04rEgEFeaiCF58fUhu6bz2nLaOBEqejAsQKuaKVeQn7PVXe-X-DUEp-cNpSkQsh7AVkaHQ_3Uhb0Qjf0_T_gtllz3KpoM Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 1ae15e13c1ae4b2db5de94fbd428867d Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2113355299 Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ae15e13c1ae4b2db5de94fbd428867d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ae15e13c1ae4b2db5de94fbd428867d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1ae15e13c1ae4b2db5de94fbd428867d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1ae15e13c1ae4b2db5de94fbd428867d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2113355299 Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 1ae15e13c1ae4b2db5de94fbd428867d Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2113355299 Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-FloatingIPsAssociationTestJSON-2113355299-project Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: c14d2fac851e4bbaaa760b5c3406a335 Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2113355299-project Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance ac770ead-5d43-4762-9cea-cb163c073d5c could not be found. Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'ac770ead-5d43-4762-9cea-cb163c073d5c'} Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac770ead-5d43-4762-9cea-cb163c073d5c could not be found. Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:46:52.279679 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:46:52.284277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac770ead-5d43-4762-9cea-cb163c073d5c could not be found. Oct 05 02:46:52.284277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:46:52.284277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:46:52.284277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:46:52.284277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:46:52.284277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:46:52.284277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:46:52.284277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:46:52.284277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:46:52.284277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac770ead-5d43-4762-9cea-cb163c073d5c could not be found. Oct 05 02:46:52.284277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:46:52.285089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ad6f158d-a846-41ab-9f76-0da8a847a79d tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Returning 404 to user: Instance ac770ead-5d43-4762-9cea-cb163c073d5c could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:46:52.286062 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ad6f158d-a846-41ab-9f76-0da8a847a79d tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c" status: 404 len: 111 microversion: 2.1 time: 0.086751 Oct 05 02:46:52.301677 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2041/4108] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:46:52 2022] DELETE /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:46:52.307142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-20a27241-5b2c-427a-a3dc-c3cdad426848 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:52.307846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-20a27241-5b2c-427a-a3dc-c3cdad426848 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:52.322018 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20a27241-5b2c-427a-a3dc-c3cdad426848 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:52.328133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20a27241-5b2c-427a-a3dc-c3cdad426848 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:52.328471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20a27241-5b2c-427a-a3dc-c3cdad426848 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:52.329799 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20a27241-5b2c-427a-a3dc-c3cdad426848 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:52.330530 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20a27241-5b2c-427a-a3dc-c3cdad426848 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:52.331185 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20a27241-5b2c-427a-a3dc-c3cdad426848 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:52.568020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9eca8e65-feb4-4f07-9092-e8e38579ff77 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:52.576417 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9eca8e65-feb4-4f07-9092-e8e38579ff77 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1314 microversion: 2.1 time: 0.460062 Oct 05 02:46:52.577249 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2068/4109] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:52 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:52.582300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4e71159f-50da-4198-bf34-7477f183be58 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:52.582812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4e71159f-50da-4198-bf34-7477f183be58 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: ac770ead-5d43-4762-9cea-cb163c073d5c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:52.589288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e71159f-50da-4198-bf34-7477f183be58 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:52.589985 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e71159f-50da-4198-bf34-7477f183be58 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:52.590605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e71159f-50da-4198-bf34-7477f183be58 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:52.591697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e71159f-50da-4198-bf34-7477f183be58 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:52.592482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e71159f-50da-4198-bf34-7477f183be58 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:52.596516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e71159f-50da-4198-bf34-7477f183be58 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:52.614878 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-4e71159f-50da-4198-bf34-7477f183be58 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] HTTP exception thrown: Instance ac770ead-5d43-4762-9cea-cb163c073d5c could not be found. Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4e71159f-50da-4198-bf34-7477f183be58 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Request method failure captured: Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c HTTP/1.1 Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO-_YAk49lT-VoDNWG4JMCGuN03AJh3L--gWDPtlaR70f-QCyuwo15V7YSXMUFTpujP0kONQy-VFYnzkuo04rEgEFeaiCF58fUhu6bz2nLaOBEqejAsQKuaKVeQn7PVXe-X-DUEp-cNpSkQsh7AVkaHQ_3Uhb0Qjf0_T_gtllz3KpoM Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 1ae15e13c1ae4b2db5de94fbd428867d Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2113355299 Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ae15e13c1ae4b2db5de94fbd428867d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ae15e13c1ae4b2db5de94fbd428867d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1ae15e13c1ae4b2db5de94fbd428867d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1ae15e13c1ae4b2db5de94fbd428867d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2113355299 Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 1ae15e13c1ae4b2db5de94fbd428867d Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2113355299 Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-FloatingIPsAssociationTestJSON-2113355299-project Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: c14d2fac851e4bbaaa760b5c3406a335 Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2113355299-project Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance ac770ead-5d43-4762-9cea-cb163c073d5c could not be found. Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'ac770ead-5d43-4762-9cea-cb163c073d5c'} Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac770ead-5d43-4762-9cea-cb163c073d5c could not be found. Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac770ead-5d43-4762-9cea-cb163c073d5c could not be found. Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:46:52.616568 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:46:52.620562 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:46:52.620562 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:46:52.620562 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:46:52.620562 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:46:52.620562 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:46:52.620562 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:46:52.620562 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac770ead-5d43-4762-9cea-cb163c073d5c could not be found. Oct 05 02:46:52.620562 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:46:52.620562 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4e71159f-50da-4198-bf34-7477f183be58 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Returning 404 to user: Instance ac770ead-5d43-4762-9cea-cb163c073d5c could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:46:52.620562 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4e71159f-50da-4198-bf34-7477f183be58 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c" status: 404 len: 111 microversion: 2.1 time: 0.039652 Oct 05 02:46:52.620562 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2069/4110] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:52 2022] GET /compute/v2.1/servers/ac770ead-5d43-4762-9cea-cb163c073d5c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:46:52.628353 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-20a27241-5b2c-427a-a3dc-c3cdad426848 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:52.632675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-200a2010-2f7c-4961-8997-7c120e64bd8b tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '.version_select at 0x7fcce40498b0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:52.637174 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-20a27241-5b2c-427a-a3dc-c3cdad426848 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1505 microversion: 2.1 time: 0.333703 Oct 05 02:46:52.638651 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2042/4111] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:52 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1505 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:53.112673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-134376da-09fd-48b4-a168-865eb92da9bb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:53.114094 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-134376da-09fd-48b4-a168-865eb92da9bb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: eceb1b06-e5fa-442b-ae37-cce2f99d58ae] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:53.123214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-134376da-09fd-48b4-a168-865eb92da9bb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:53.123986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-134376da-09fd-48b4-a168-865eb92da9bb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:53.124993 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-134376da-09fd-48b4-a168-865eb92da9bb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:53.126041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-134376da-09fd-48b4-a168-865eb92da9bb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:53.126951 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-134376da-09fd-48b4-a168-865eb92da9bb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:53.129066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-134376da-09fd-48b4-a168-865eb92da9bb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:53.542035 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-134376da-09fd-48b4-a168-865eb92da9bb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:53.559811 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-134376da-09fd-48b4-a168-865eb92da9bb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae" status: 200 len: 1314 microversion: 2.1 time: 0.454918 Oct 05 02:46:53.560724 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2043/4112] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:53 2022] GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:53.601177 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-08612073-a918-4fcd-92bf-8dc22aded939 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:53.602067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-08612073-a918-4fcd-92bf-8dc22aded939 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:53.609728 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08612073-a918-4fcd-92bf-8dc22aded939 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:53.610559 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08612073-a918-4fcd-92bf-8dc22aded939 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:53.611157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08612073-a918-4fcd-92bf-8dc22aded939 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:53.612021 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08612073-a918-4fcd-92bf-8dc22aded939 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:53.612724 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08612073-a918-4fcd-92bf-8dc22aded939 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:53.613384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08612073-a918-4fcd-92bf-8dc22aded939 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:54.360010 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-08612073-a918-4fcd-92bf-8dc22aded939 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:54.373571 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-08612073-a918-4fcd-92bf-8dc22aded939 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1314 microversion: 2.1 time: 0.775319 Oct 05 02:46:54.374393 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2044/4113] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:53 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1314 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:46:54.383637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c01050f3-cc5c-4c85-9143-e42a3359c5ee tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:54.383637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c01050f3-cc5c-4c85-9143-e42a3359c5ee tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:54.387526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c01050f3-cc5c-4c85-9143-e42a3359c5ee tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:54.389002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c01050f3-cc5c-4c85-9143-e42a3359c5ee tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:54.414611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c01050f3-cc5c-4c85-9143-e42a3359c5ee tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:54.414611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c01050f3-cc5c-4c85-9143-e42a3359c5ee tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:54.414611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c01050f3-cc5c-4c85-9143-e42a3359c5ee tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:54.414611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c01050f3-cc5c-4c85-9143-e42a3359c5ee tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:54.949730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c01050f3-cc5c-4c85-9143-e42a3359c5ee tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:54.961320 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c01050f3-cc5c-4c85-9143-e42a3359c5ee tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1505 microversion: 2.1 time: 0.585629 Oct 05 02:46:54.963316 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2045/4114] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:54 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1505 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:54.973328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0263e03e-21fc-43f5-961d-ec6e35753f6d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:54.975659 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0263e03e-21fc-43f5-961d-ec6e35753f6d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: eceb1b06-e5fa-442b-ae37-cce2f99d58ae] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:54.985760 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0263e03e-21fc-43f5-961d-ec6e35753f6d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:54.986357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0263e03e-21fc-43f5-961d-ec6e35753f6d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:54.986997 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0263e03e-21fc-43f5-961d-ec6e35753f6d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:54.987788 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0263e03e-21fc-43f5-961d-ec6e35753f6d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:54.989970 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0263e03e-21fc-43f5-961d-ec6e35753f6d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:54.990490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0263e03e-21fc-43f5-961d-ec6e35753f6d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:55.088665 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-200a2010-2f7c-4961-8997-7c120e64bd8b tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/3c04228d-71fc-41a6-befc-905c94e2a9fa" status: 202 len: 0 microversion: 2.1 time: 2.464844 Oct 05 02:46:55.092174 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2070/4115] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 5 02:46:52 2022] DELETE /compute/v2.1/os-floating-ips/3c04228d-71fc-41a6-befc-905c94e2a9fa => generated 0 bytes in 2469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:46:55.098519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fdea1079-7153-4127-9e7b-4576b9a237ba tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:55.099019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fdea1079-7153-4127-9e7b-4576b9a237ba tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: c2d68022-2fa3-4464-8004-262c23e41ea2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:55.105215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fdea1079-7153-4127-9e7b-4576b9a237ba tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:55.105713 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fdea1079-7153-4127-9e7b-4576b9a237ba tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:55.106149 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fdea1079-7153-4127-9e7b-4576b9a237ba tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:55.106877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fdea1079-7153-4127-9e7b-4576b9a237ba tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:55.107515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fdea1079-7153-4127-9e7b-4576b9a237ba tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:55.107934 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fdea1079-7153-4127-9e7b-4576b9a237ba tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:55.139849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fdea1079-7153-4127-9e7b-4576b9a237ba tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: c2d68022-2fa3-4464-8004-262c23e41ea2] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:46:55.251887 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fdea1079-7153-4127-9e7b-4576b9a237ba tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2" status: 204 len: 0 microversion: 2.1 time: 0.156812 Oct 05 02:46:55.252486 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2071/4116] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:46:55 2022] DELETE /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 02:46:55.265295 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a80589ce-6efb-4c31-9962-5fe8f33f6cd5 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:55.266478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a80589ce-6efb-4c31-9962-5fe8f33f6cd5 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: c2d68022-2fa3-4464-8004-262c23e41ea2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:55.274284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a80589ce-6efb-4c31-9962-5fe8f33f6cd5 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:55.275509 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a80589ce-6efb-4c31-9962-5fe8f33f6cd5 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:55.276040 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a80589ce-6efb-4c31-9962-5fe8f33f6cd5 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:55.276979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a80589ce-6efb-4c31-9962-5fe8f33f6cd5 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:55.277671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a80589ce-6efb-4c31-9962-5fe8f33f6cd5 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:55.279770 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a80589ce-6efb-4c31-9962-5fe8f33f6cd5 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:55.357840 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0263e03e-21fc-43f5-961d-ec6e35753f6d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:55.367655 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0263e03e-21fc-43f5-961d-ec6e35753f6d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae" status: 200 len: 1501 microversion: 2.1 time: 0.402379 Oct 05 02:46:55.370060 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2046/4117] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:54 2022] GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae => generated 1501 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:55.397263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c606bd07-15b3-4765-88ba-004627505931 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:55.402976 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c606bd07-15b3-4765-88ba-004627505931 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: eceb1b06-e5fa-442b-ae37-cce2f99d58ae] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:55.412138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c606bd07-15b3-4765-88ba-004627505931 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:55.412790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c606bd07-15b3-4765-88ba-004627505931 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:55.413411 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c606bd07-15b3-4765-88ba-004627505931 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:55.414217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c606bd07-15b3-4765-88ba-004627505931 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:55.415176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c606bd07-15b3-4765-88ba-004627505931 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:55.415710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c606bd07-15b3-4765-88ba-004627505931 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:55.544107 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a80589ce-6efb-4c31-9962-5fe8f33f6cd5 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14d2fac851e4bbaaa760b5c3406a335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae15e13c1ae4b2db5de94fbd428867d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:55.562618 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a80589ce-6efb-4c31-9962-5fe8f33f6cd5 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2" status: 200 len: 1526 microversion: 2.1 time: 0.304538 Oct 05 02:46:55.563856 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2072/4118] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:55 2022] GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2 => generated 1526 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:46:55.571138 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-71aafadf-25d2-49b7-ae61-c71bc284a07a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:55.573448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-71aafadf-25d2-49b7-ae61-c71bc284a07a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:55.583150 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71aafadf-25d2-49b7-ae61-c71bc284a07a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:55.583982 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71aafadf-25d2-49b7-ae61-c71bc284a07a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:55.584593 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71aafadf-25d2-49b7-ae61-c71bc284a07a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:55.586129 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71aafadf-25d2-49b7-ae61-c71bc284a07a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:55.587451 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71aafadf-25d2-49b7-ae61-c71bc284a07a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:55.589077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71aafadf-25d2-49b7-ae61-c71bc284a07a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:55.866807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-71aafadf-25d2-49b7-ae61-c71bc284a07a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:55.891283 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-71aafadf-25d2-49b7-ae61-c71bc284a07a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1314 microversion: 2.1 time: 0.325495 Oct 05 02:46:55.892629 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2073/4119] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:55 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:55.898908 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-e4b237bc-fd9a-4ad2-912a-cb2942272e14 req-eafd4b40-1dca-46b0-9745-39f8259bacb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "161a6f96-e469-47fd-a72f-df5a05e9a62b", "name": "network-vif-plugged", "status": "completed", "tag": "7d9bdf6d-adf0-4eb9-ab11-e0dc32dd5fa8"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:55.920587 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e4b237bc-fd9a-4ad2-912a-cb2942272e14 req-eafd4b40-1dca-46b0-9745-39f8259bacb5 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:55.921866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e4b237bc-fd9a-4ad2-912a-cb2942272e14 req-eafd4b40-1dca-46b0-9745-39f8259bacb5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:55.923706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e4b237bc-fd9a-4ad2-912a-cb2942272e14 req-eafd4b40-1dca-46b0-9745-39f8259bacb5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:55.948548 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-e4b237bc-fd9a-4ad2-912a-cb2942272e14 req-eafd4b40-1dca-46b0-9745-39f8259bacb5 service nova] Creating event network-vif-plugged:7d9bdf6d-adf0-4eb9-ab11-e0dc32dd5fa8 for instance 161a6f96-e469-47fd-a72f-df5a05e9a62b on n-h2-858272-3 Oct 05 02:46:55.961082 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-e4b237bc-fd9a-4ad2-912a-cb2942272e14 req-eafd4b40-1dca-46b0-9745-39f8259bacb5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065216 Oct 05 02:46:55.962158 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2074/4120] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:46:55.995542 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ec3a9c17-39df-4d31-8ca9-378fe0b78bdf tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:56.016463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ec3a9c17-39df-4d31-8ca9-378fe0b78bdf tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:56.028212 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec3a9c17-39df-4d31-8ca9-378fe0b78bdf tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:56.029494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec3a9c17-39df-4d31-8ca9-378fe0b78bdf tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:56.030580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec3a9c17-39df-4d31-8ca9-378fe0b78bdf tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:56.034553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec3a9c17-39df-4d31-8ca9-378fe0b78bdf tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:56.035684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec3a9c17-39df-4d31-8ca9-378fe0b78bdf tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:56.036416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec3a9c17-39df-4d31-8ca9-378fe0b78bdf tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:56.359035 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ec3a9c17-39df-4d31-8ca9-378fe0b78bdf tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:56.380410 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ec3a9c17-39df-4d31-8ca9-378fe0b78bdf tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1505 microversion: 2.1 time: 0.393212 Oct 05 02:46:56.383637 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2075/4121] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:55 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1505 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:46:56.541458 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c606bd07-15b3-4765-88ba-004627505931 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae/action" status: 200 len: 14 microversion: 2.1 time: 1.147160 Oct 05 02:46:56.543561 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2047/4122] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:46:55 2022] POST /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae/action => generated 14 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 05 02:46:56.590752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a7c54914-94bc-43e9-a15c-7d72fbaefe97 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:56.593563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a7c54914-94bc-43e9-a15c-7d72fbaefe97 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: c2d68022-2fa3-4464-8004-262c23e41ea2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:56.604490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7c54914-94bc-43e9-a15c-7d72fbaefe97 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:56.607204 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7c54914-94bc-43e9-a15c-7d72fbaefe97 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:56.609458 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7c54914-94bc-43e9-a15c-7d72fbaefe97 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:56.610415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7c54914-94bc-43e9-a15c-7d72fbaefe97 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:56.611067 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7c54914-94bc-43e9-a15c-7d72fbaefe97 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:56.613161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7c54914-94bc-43e9-a15c-7d72fbaefe97 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:56.916335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1d3d82c9-83be-4609-96ef-898106412687 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:56.917071 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1d3d82c9-83be-4609-96ef-898106412687 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:56.933182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d3d82c9-83be-4609-96ef-898106412687 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:56.933893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d3d82c9-83be-4609-96ef-898106412687 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:56.934354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d3d82c9-83be-4609-96ef-898106412687 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:56.937664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d3d82c9-83be-4609-96ef-898106412687 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:56.938491 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d3d82c9-83be-4609-96ef-898106412687 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:56.939095 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d3d82c9-83be-4609-96ef-898106412687 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:57.132649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a7c54914-94bc-43e9-a15c-7d72fbaefe97 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14d2fac851e4bbaaa760b5c3406a335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae15e13c1ae4b2db5de94fbd428867d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:57.157187 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a7c54914-94bc-43e9-a15c-7d72fbaefe97 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2" status: 200 len: 1526 microversion: 2.1 time: 0.568514 Oct 05 02:46:57.159873 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2076/4123] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:56 2022] GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2 => generated 1526 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:57.234079 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1d3d82c9-83be-4609-96ef-898106412687 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:57.248260 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1d3d82c9-83be-4609-96ef-898106412687 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1314 microversion: 2.1 time: 0.334777 Oct 05 02:46:57.249418 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2048/4124] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:56 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:46:57.408775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a19fc214-9cf8-458a-82ec-be3671e0fc92 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:57.413189 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a19fc214-9cf8-458a-82ec-be3671e0fc92 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:57.425831 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a19fc214-9cf8-458a-82ec-be3671e0fc92 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:57.426557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a19fc214-9cf8-458a-82ec-be3671e0fc92 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:57.428623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a19fc214-9cf8-458a-82ec-be3671e0fc92 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:57.429432 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a19fc214-9cf8-458a-82ec-be3671e0fc92 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:57.430752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a19fc214-9cf8-458a-82ec-be3671e0fc92 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:57.433986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a19fc214-9cf8-458a-82ec-be3671e0fc92 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:57.555372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-263e8492-e1d0-4b48-a89a-a6b3d3d4c9c7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:57.557595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-263e8492-e1d0-4b48-a89a-a6b3d3d4c9c7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: eceb1b06-e5fa-442b-ae37-cce2f99d58ae] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:57.574973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-263e8492-e1d0-4b48-a89a-a6b3d3d4c9c7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:57.579319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-263e8492-e1d0-4b48-a89a-a6b3d3d4c9c7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:57.579969 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-263e8492-e1d0-4b48-a89a-a6b3d3d4c9c7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:57.580881 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-263e8492-e1d0-4b48-a89a-a6b3d3d4c9c7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:57.581527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-263e8492-e1d0-4b48-a89a-a6b3d3d4c9c7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:57.582119 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-263e8492-e1d0-4b48-a89a-a6b3d3d4c9c7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:58.123158 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-263e8492-e1d0-4b48-a89a-a6b3d3d4c9c7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae/action" status: 200 len: 14 microversion: 2.1 time: 0.571519 Oct 05 02:46:58.126719 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2049/4125] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:46:57 2022] POST /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae/action => generated 14 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:46:58.187914 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4fd3c713-6f70-4509-8168-871cd649c24b tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:58.189197 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4fd3c713-6f70-4509-8168-871cd649c24b tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: c2d68022-2fa3-4464-8004-262c23e41ea2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:58.208701 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4fd3c713-6f70-4509-8168-871cd649c24b tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:58.209867 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4fd3c713-6f70-4509-8168-871cd649c24b tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:58.210602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4fd3c713-6f70-4509-8168-871cd649c24b tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:58.212135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4fd3c713-6f70-4509-8168-871cd649c24b tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:58.213911 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4fd3c713-6f70-4509-8168-871cd649c24b tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:58.215453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4fd3c713-6f70-4509-8168-871cd649c24b tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:58.254558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a19fc214-9cf8-458a-82ec-be3671e0fc92 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:58.270180 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a19fc214-9cf8-458a-82ec-be3671e0fc92 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1505 microversion: 2.1 time: 0.865604 Oct 05 02:46:58.274391 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2077/4126] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:57 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1505 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:58.280225 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-277b8a7c-f94c-4c85-b3c5-b5d35468e31c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:58.280860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-277b8a7c-f94c-4c85-b3c5-b5d35468e31c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:58.300685 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-277b8a7c-f94c-4c85-b3c5-b5d35468e31c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:58.302277 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-277b8a7c-f94c-4c85-b3c5-b5d35468e31c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:58.303125 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-277b8a7c-f94c-4c85-b3c5-b5d35468e31c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:58.305576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-277b8a7c-f94c-4c85-b3c5-b5d35468e31c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:58.306647 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-277b8a7c-f94c-4c85-b3c5-b5d35468e31c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:58.307491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-277b8a7c-f94c-4c85-b3c5-b5d35468e31c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:58.866334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-277b8a7c-f94c-4c85-b3c5-b5d35468e31c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:58.876361 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-277b8a7c-f94c-4c85-b3c5-b5d35468e31c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1314 microversion: 2.1 time: 0.601137 Oct 05 02:46:58.878209 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2078/4127] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:58 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1314 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:58.967326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4fd3c713-6f70-4509-8168-871cd649c24b tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14d2fac851e4bbaaa760b5c3406a335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae15e13c1ae4b2db5de94fbd428867d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:58.984758 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4fd3c713-6f70-4509-8168-871cd649c24b tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2" status: 200 len: 1526 microversion: 2.1 time: 0.801529 Oct 05 02:46:58.988207 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2050/4128] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:58 2022] GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2 => generated 1526 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:59.140545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8b52860e-081a-41cb-9379-036972e92d8d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:59.144112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8b52860e-081a-41cb-9379-036972e92d8d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: eceb1b06-e5fa-442b-ae37-cce2f99d58ae] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:59.159918 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b52860e-081a-41cb-9379-036972e92d8d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:59.160594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b52860e-081a-41cb-9379-036972e92d8d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:59.161551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b52860e-081a-41cb-9379-036972e92d8d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:59.162426 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b52860e-081a-41cb-9379-036972e92d8d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:59.163038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b52860e-081a-41cb-9379-036972e92d8d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:59.163750 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b52860e-081a-41cb-9379-036972e92d8d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:59.275723 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8b52860e-081a-41cb-9379-036972e92d8d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae/action" status: 200 len: 14 microversion: 2.1 time: 0.139097 Oct 05 02:46:59.277255 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2079/4129] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:46:59 2022] POST /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:46:59.294560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-27aab8af-4e69-4f84-accd-839513beb584 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:59.295250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-27aab8af-4e69-4f84-accd-839513beb584 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:59.306691 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27aab8af-4e69-4f84-accd-839513beb584 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:59.307190 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27aab8af-4e69-4f84-accd-839513beb584 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:59.307626 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27aab8af-4e69-4f84-accd-839513beb584 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:59.308521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27aab8af-4e69-4f84-accd-839513beb584 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:59.308982 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27aab8af-4e69-4f84-accd-839513beb584 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:59.316723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27aab8af-4e69-4f84-accd-839513beb584 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:59.654344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-699fadc7-9841-4e76-91c4-82320f7ec5f4 req-d6205543-fc42-4f5b-84f9-81524b216694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2d68022-2fa3-4464-8004-262c23e41ea2", "name": "network-vif-deleted", "tag": "baf1bb4d-f79e-4dc4-903a-f0407e6bf5d8"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:46:59.690605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-699fadc7-9841-4e76-91c4-82320f7ec5f4 req-d6205543-fc42-4f5b-84f9-81524b216694 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:59.691084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-699fadc7-9841-4e76-91c4-82320f7ec5f4 req-d6205543-fc42-4f5b-84f9-81524b216694 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:59.691517 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-699fadc7-9841-4e76-91c4-82320f7ec5f4 req-d6205543-fc42-4f5b-84f9-81524b216694 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:59.710772 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-699fadc7-9841-4e76-91c4-82320f7ec5f4 req-d6205543-fc42-4f5b-84f9-81524b216694 service nova] Creating event network-vif-deleted:baf1bb4d-f79e-4dc4-903a-f0407e6bf5d8 for instance c2d68022-2fa3-4464-8004-262c23e41ea2 on n-h2-858272-3 Oct 05 02:46:59.717052 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-699fadc7-9841-4e76-91c4-82320f7ec5f4 req-d6205543-fc42-4f5b-84f9-81524b216694 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067667 Oct 05 02:46:59.718534 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2080/4130] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:46:59.792247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-27aab8af-4e69-4f84-accd-839513beb584 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:46:59.804205 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-27aab8af-4e69-4f84-accd-839513beb584 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1505 microversion: 2.1 time: 0.513454 Oct 05 02:46:59.805424 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2051/4131] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:59 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1505 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:46:59.907095 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-93fd8ff9-6a14-44bc-90a0-197891800eae tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:46:59.908076 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-93fd8ff9-6a14-44bc-90a0-197891800eae tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:46:59.934362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93fd8ff9-6a14-44bc-90a0-197891800eae tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:59.937738 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93fd8ff9-6a14-44bc-90a0-197891800eae tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:59.939694 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93fd8ff9-6a14-44bc-90a0-197891800eae tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:46:59.945403 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93fd8ff9-6a14-44bc-90a0-197891800eae tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:46:59.945890 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93fd8ff9-6a14-44bc-90a0-197891800eae tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:46:59.946337 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93fd8ff9-6a14-44bc-90a0-197891800eae tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:00.014970 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1da74516-946b-48de-8026-ed272f9b03f1 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:00.016302 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1da74516-946b-48de-8026-ed272f9b03f1 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: c2d68022-2fa3-4464-8004-262c23e41ea2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:00.027924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1da74516-946b-48de-8026-ed272f9b03f1 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:00.031713 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1da74516-946b-48de-8026-ed272f9b03f1 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:00.032194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1da74516-946b-48de-8026-ed272f9b03f1 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:00.032978 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1da74516-946b-48de-8026-ed272f9b03f1 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:00.033462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1da74516-946b-48de-8026-ed272f9b03f1 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:00.033887 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1da74516-946b-48de-8026-ed272f9b03f1 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:00.132732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1da74516-946b-48de-8026-ed272f9b03f1 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:00.133494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1da74516-946b-48de-8026-ed272f9b03f1 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:00.134749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1da74516-946b-48de-8026-ed272f9b03f1 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:00.135478 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-1da74516-946b-48de-8026-ed272f9b03f1 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lazy-loading 'fault' on Instance uuid c2d68022-2fa3-4464-8004-262c23e41ea2 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:47:00.303977 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1da74516-946b-48de-8026-ed272f9b03f1 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14d2fac851e4bbaaa760b5c3406a335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae15e13c1ae4b2db5de94fbd428867d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:00.323467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-93fd8ff9-6a14-44bc-90a0-197891800eae tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:00.332895 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1da74516-946b-48de-8026-ed272f9b03f1 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2" status: 200 len: 1314 microversion: 2.1 time: 0.322269 Oct 05 02:47:00.336438 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2052/4132] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:00 2022] GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:00.352425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-26ef9c23-66d7-4889-95b8-86d2f7164e10 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:00.354909 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-26ef9c23-66d7-4889-95b8-86d2f7164e10 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: eceb1b06-e5fa-442b-ae37-cce2f99d58ae] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:00.358999 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-93fd8ff9-6a14-44bc-90a0-197891800eae tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1501 microversion: 2.1 time: 0.458018 Oct 05 02:47:00.362867 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2081/4133] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:46:59 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1501 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:00.371120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-468c3e43-92b1-4edb-a70c-9fca7091f892 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Action: 'create', calling method: .version_select at 0x7fcce43259d0>, body: {"keypair": {"name": "tempest-keypair-550557407", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEW2YKeW/rm95xN+HcoEm9p5bPycdHnUcyFP4KIhNEnUrUNOdK997LeqIqPFpabgMxrLyFJSI1zMl6GrVbeCERMWUwDlT6nTkqLWVdPsanbgLc5OUA4pybA9vU0VYTNYhQ=="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:00.374835 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26ef9c23-66d7-4889-95b8-86d2f7164e10 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:00.375577 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26ef9c23-66d7-4889-95b8-86d2f7164e10 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:00.376220 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26ef9c23-66d7-4889-95b8-86d2f7164e10 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:00.377402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26ef9c23-66d7-4889-95b8-86d2f7164e10 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:00.378068 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26ef9c23-66d7-4889-95b8-86d2f7164e10 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:00.378692 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26ef9c23-66d7-4889-95b8-86d2f7164e10 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:00.391734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-468c3e43-92b1-4edb-a70c-9fca7091f892 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Getting quotas for project 534df890fde640cc913ecd53e83540bc. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:47:00.400111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-468c3e43-92b1-4edb-a70c-9fca7091f892 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Getting quotas for user 9e8f069e9e2a48549d02a1505b648a88 and project 534df890fde640cc913ecd53e83540bc. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:47:00.439948 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-468c3e43-92b1-4edb-a70c-9fca7091f892 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.075855 Oct 05 02:47:00.440650 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2082/4134] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Oct 5 02:47:00 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 77 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 05 02:47:00.460739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0bb50760-d841-4d89-bb82-7e9185b8bd91 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:00.461315 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0bb50760-d841-4d89-bb82-7e9185b8bd91 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:00.477299 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0bb50760-d841-4d89-bb82-7e9185b8bd91 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:00.477799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0bb50760-d841-4d89-bb82-7e9185b8bd91 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:00.478235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0bb50760-d841-4d89-bb82-7e9185b8bd91 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:00.478980 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0bb50760-d841-4d89-bb82-7e9185b8bd91 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:00.479442 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0bb50760-d841-4d89-bb82-7e9185b8bd91 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:00.479871 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0bb50760-d841-4d89-bb82-7e9185b8bd91 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:00.549235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-0bb50760-d841-4d89-bb82-7e9185b8bd91 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lazy-loading 'flavor' on Instance uuid 161a6f96-e469-47fd-a72f-df5a05e9a62b {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:47:00.579959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:47:00.675584 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-26ef9c23-66d7-4889-95b8-86d2f7164e10 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae/action" status: 200 len: 14 microversion: 2.1 time: 0.337221 Oct 05 02:47:00.680683 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2053/4135] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:47:00 2022] POST /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae/action => generated 14 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:47:00.831626 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6a444311-50c5-4a5b-a11b-435dc016df2e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:00.832415 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6a444311-50c5-4a5b-a11b-435dc016df2e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:00.849398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a444311-50c5-4a5b-a11b-435dc016df2e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:00.852404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a444311-50c5-4a5b-a11b-435dc016df2e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:00.853098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a444311-50c5-4a5b-a11b-435dc016df2e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:00.854031 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a444311-50c5-4a5b-a11b-435dc016df2e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:00.856576 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a444311-50c5-4a5b-a11b-435dc016df2e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:00.860162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a444311-50c5-4a5b-a11b-435dc016df2e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:00.913482 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0bb50760-d841-4d89-bb82-7e9185b8bd91 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "POST /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b/action" status: 202 len: 0 microversion: 2.1 time: 0.467274 Oct 05 02:47:00.918092 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2083/4136] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:47:00 2022] POST /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:47:00.941925 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-00264db2-6fd5-400a-a9aa-d3f97339c77f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:00.943379 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-00264db2-6fd5-400a-a9aa-d3f97339c77f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:00.954458 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-00264db2-6fd5-400a-a9aa-d3f97339c77f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:00.955415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-00264db2-6fd5-400a-a9aa-d3f97339c77f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:00.956214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-00264db2-6fd5-400a-a9aa-d3f97339c77f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:00.957303 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-00264db2-6fd5-400a-a9aa-d3f97339c77f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:00.957985 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-00264db2-6fd5-400a-a9aa-d3f97339c77f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:00.958830 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-00264db2-6fd5-400a-a9aa-d3f97339c77f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:01.327393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-00264db2-6fd5-400a-a9aa-d3f97339c77f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:01.336040 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-00264db2-6fd5-400a-a9aa-d3f97339c77f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1507 microversion: 2.1 time: 0.413481 Oct 05 02:47:01.336880 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2084/4137] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:00 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1507 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:01.362892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-359af077-f974-4d12-9d62-74cf8086a168 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:01.363875 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-359af077-f974-4d12-9d62-74cf8086a168 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] [instance: c2d68022-2fa3-4464-8004-262c23e41ea2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:01.375224 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-359af077-f974-4d12-9d62-74cf8086a168 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:01.378583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-359af077-f974-4d12-9d62-74cf8086a168 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:01.381899 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-359af077-f974-4d12-9d62-74cf8086a168 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:01.382861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-359af077-f974-4d12-9d62-74cf8086a168 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:01.384962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-359af077-f974-4d12-9d62-74cf8086a168 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:01.385596 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-359af077-f974-4d12-9d62-74cf8086a168 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:01.429489 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-359af077-f974-4d12-9d62-74cf8086a168 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] HTTP exception thrown: Instance c2d68022-2fa3-4464-8004-262c23e41ea2 could not be found. Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-359af077-f974-4d12-9d62-74cf8086a168 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Request method failure captured: Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2 HTTP/1.1 Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO-_YAk49lT-VoDNWG4JMCGuN03AJh3L--gWDPtlaR70f-QCyuwo15V7YSXMUFTpujP0kONQy-VFYnzkuo04rEgEFeaiCF58fUhu6bz2nLaOBEqejAsQKuaKVeQn7PVXe-X-DUEp-cNpSkQsh7AVkaHQ_3Uhb0Qjf0_T_gtllz3KpoM Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 1ae15e13c1ae4b2db5de94fbd428867d Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2113355299 Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ae15e13c1ae4b2db5de94fbd428867d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ae15e13c1ae4b2db5de94fbd428867d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1ae15e13c1ae4b2db5de94fbd428867d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1ae15e13c1ae4b2db5de94fbd428867d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2113355299 Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 1ae15e13c1ae4b2db5de94fbd428867d Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2113355299 Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-FloatingIPsAssociationTestJSON-2113355299-project Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: c14d2fac851e4bbaaa760b5c3406a335 Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2113355299-project Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance c2d68022-2fa3-4464-8004-262c23e41ea2 could not be found. Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'c2d68022-2fa3-4464-8004-262c23e41ea2'} Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2d68022-2fa3-4464-8004-262c23e41ea2 could not be found. Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2d68022-2fa3-4464-8004-262c23e41ea2 could not be found. Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:01.431468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:47:01.435646 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:01.435646 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:47:01.435646 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:47:01.435646 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:47:01.435646 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:47:01.435646 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:47:01.435646 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2d68022-2fa3-4464-8004-262c23e41ea2 could not be found. Oct 05 02:47:01.435646 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:01.438221 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-359af077-f974-4d12-9d62-74cf8086a168 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] Returning 404 to user: Instance c2d68022-2fa3-4464-8004-262c23e41ea2 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:47:01.439754 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-359af077-f974-4d12-9d62-74cf8086a168 tempest-FloatingIPsAssociationTestJSON-2113355299 tempest-FloatingIPsAssociationTestJSON-2113355299-project] 10.222.0.16 "GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2" status: 404 len: 111 microversion: 2.1 time: 0.080772 Oct 05 02:47:01.440854 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2085/4138] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:01 2022] GET /compute/v2.1/servers/c2d68022-2fa3-4464-8004-262c23e41ea2 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:47:01.445967 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6a444311-50c5-4a5b-a11b-435dc016df2e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:01.459048 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6a444311-50c5-4a5b-a11b-435dc016df2e tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1505 microversion: 2.1 time: 0.634856 Oct 05 02:47:01.464748 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2054/4139] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:00 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1505 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:01.688015 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f9eb9342-ab15-43b5-9099-9e609f045176 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:01.690853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f9eb9342-ab15-43b5-9099-9e609f045176 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: eceb1b06-e5fa-442b-ae37-cce2f99d58ae] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:01.698022 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9eb9342-ab15-43b5-9099-9e609f045176 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:01.698541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9eb9342-ab15-43b5-9099-9e609f045176 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:01.699044 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9eb9342-ab15-43b5-9099-9e609f045176 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:01.700589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9eb9342-ab15-43b5-9099-9e609f045176 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:01.702262 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9eb9342-ab15-43b5-9099-9e609f045176 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:01.703177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9eb9342-ab15-43b5-9099-9e609f045176 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:01.818909 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f9eb9342-ab15-43b5-9099-9e609f045176 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae/action" status: 200 len: 14 microversion: 2.1 time: 0.135207 Oct 05 02:47:01.819565 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2086/4140] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:47:01 2022] POST /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 05 02:47:02.363940 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a25cdef8-06fe-4bfd-8b3e-4741cbacfbc3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:02.364859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a25cdef8-06fe-4bfd-8b3e-4741cbacfbc3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:02.374638 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a25cdef8-06fe-4bfd-8b3e-4741cbacfbc3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:02.375529 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a25cdef8-06fe-4bfd-8b3e-4741cbacfbc3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:02.376311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a25cdef8-06fe-4bfd-8b3e-4741cbacfbc3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:02.377382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a25cdef8-06fe-4bfd-8b3e-4741cbacfbc3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:02.378086 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a25cdef8-06fe-4bfd-8b3e-4741cbacfbc3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:02.378801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a25cdef8-06fe-4bfd-8b3e-4741cbacfbc3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:02.487665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0008c858-e5d5-4125-80d2-22433353a2e7 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:02.488990 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0008c858-e5d5-4125-80d2-22433353a2e7 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:02.504878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0008c858-e5d5-4125-80d2-22433353a2e7 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:02.511451 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0008c858-e5d5-4125-80d2-22433353a2e7 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:02.512274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0008c858-e5d5-4125-80d2-22433353a2e7 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:02.513886 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0008c858-e5d5-4125-80d2-22433353a2e7 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:02.514591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0008c858-e5d5-4125-80d2-22433353a2e7 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:02.515886 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0008c858-e5d5-4125-80d2-22433353a2e7 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:02.729484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a25cdef8-06fe-4bfd-8b3e-4741cbacfbc3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:02.741262 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a25cdef8-06fe-4bfd-8b3e-4741cbacfbc3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1507 microversion: 2.1 time: 0.381326 Oct 05 02:47:02.744998 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2055/4141] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:02 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1507 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:02.830726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b88f518f-2b11-40d9-8c04-3f3fea50b452 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:02.833132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b88f518f-2b11-40d9-8c04-3f3fea50b452 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: eceb1b06-e5fa-442b-ae37-cce2f99d58ae] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:02.842696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b88f518f-2b11-40d9-8c04-3f3fea50b452 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:02.843490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b88f518f-2b11-40d9-8c04-3f3fea50b452 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:02.844130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b88f518f-2b11-40d9-8c04-3f3fea50b452 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:02.845084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b88f518f-2b11-40d9-8c04-3f3fea50b452 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:02.845629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b88f518f-2b11-40d9-8c04-3f3fea50b452 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:02.849677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b88f518f-2b11-40d9-8c04-3f3fea50b452 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:02.937255 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b88f518f-2b11-40d9-8c04-3f3fea50b452 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae/action" status: 200 len: 14 microversion: 2.1 time: 0.109989 Oct 05 02:47:02.938785 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2056/4142] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:47:02 2022] POST /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 05 02:47:03.304000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0008c858-e5d5-4125-80d2-22433353a2e7 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:03.312980 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0008c858-e5d5-4125-80d2-22433353a2e7 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1505 microversion: 2.1 time: 0.829416 Oct 05 02:47:03.313575 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2087/4143] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:02 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1505 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:03.775375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2c30d52c-3065-4baf-a22f-6ed45a8919eb tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:03.791061 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2c30d52c-3065-4baf-a22f-6ed45a8919eb tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:03.808213 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c30d52c-3065-4baf-a22f-6ed45a8919eb tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:03.808718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c30d52c-3065-4baf-a22f-6ed45a8919eb tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:03.813007 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c30d52c-3065-4baf-a22f-6ed45a8919eb tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:03.813834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c30d52c-3065-4baf-a22f-6ed45a8919eb tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:03.814316 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c30d52c-3065-4baf-a22f-6ed45a8919eb tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:03.814761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c30d52c-3065-4baf-a22f-6ed45a8919eb tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:03.950410 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3793bc80-1766-4fc1-938d-8525b13f5930 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:03.952729 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3793bc80-1766-4fc1-938d-8525b13f5930 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: eceb1b06-e5fa-442b-ae37-cce2f99d58ae] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:03.978546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3793bc80-1766-4fc1-938d-8525b13f5930 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:03.980355 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3793bc80-1766-4fc1-938d-8525b13f5930 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:03.981017 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3793bc80-1766-4fc1-938d-8525b13f5930 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:03.982920 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3793bc80-1766-4fc1-938d-8525b13f5930 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:03.983593 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3793bc80-1766-4fc1-938d-8525b13f5930 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:03.984215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3793bc80-1766-4fc1-938d-8525b13f5930 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:04.110043 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3793bc80-1766-4fc1-938d-8525b13f5930 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae/action" status: 200 len: 14 microversion: 2.1 time: 0.164270 Oct 05 02:47:04.113322 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2088/4144] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:47:03 2022] POST /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae/action => generated 14 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:47:04.209760 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2c30d52c-3065-4baf-a22f-6ed45a8919eb tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:04.227149 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2c30d52c-3065-4baf-a22f-6ed45a8919eb tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1507 microversion: 2.1 time: 0.465804 Oct 05 02:47:04.227981 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2057/4145] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:03 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1507 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:47:04.337448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2abf2571-510a-41d1-a9cf-98825c49263b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:04.338166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2abf2571-510a-41d1-a9cf-98825c49263b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:04.345813 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2abf2571-510a-41d1-a9cf-98825c49263b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:04.346586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2abf2571-510a-41d1-a9cf-98825c49263b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:04.347322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2abf2571-510a-41d1-a9cf-98825c49263b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:04.348217 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2abf2571-510a-41d1-a9cf-98825c49263b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:04.348834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2abf2571-510a-41d1-a9cf-98825c49263b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:04.349443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2abf2571-510a-41d1-a9cf-98825c49263b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:04.678063 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2abf2571-510a-41d1-a9cf-98825c49263b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:04.688164 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2abf2571-510a-41d1-a9cf-98825c49263b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1505 microversion: 2.1 time: 0.354908 Oct 05 02:47:04.688737 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2089/4146] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:04 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1505 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:04.826404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e0a64c9d-6fe1-412d-a48d-096ab99b0dd3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1893178047", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "2e14b78d-f236-4859-9bf5-a515e763757e"}, {"port": "88922211-2f92-4989-937c-6c447b45f0b1", "tag": "port-1"}, {"port": "07524a96-4932-40f9-b62e-ec594f3e7266", "tag": "port-2"}, {"uuid": "25fece4f-b27c-4a60-9456-6f1a5d1b75a2", "tag": "net-1"}, {"uuid": "25fece4f-b27c-4a60-9456-6f1a5d1b75a2"}, {"uuid": "bb6f43a0-fa2d-491d-aa9b-f576f0e76215", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "bb6f43a0-fa2d-491d-aa9b-f576f0e76215", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "3a874aa4-0ac0-4e7c-8fcd-53161cd31dfb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "293684fc-0da7-47c7-b45d-c829caf8c67c", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "70b164fc-a47a-4b81-9f01-3e38aaf62bf3", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1793389551"}], "key_name": "tempest-keypair-550557407", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:05.001642 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-e0a64c9d-6fe1-412d-a48d-096ab99b0dd3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] validate_networks() for [('2e14b78d-f236-4859-9bf5-a515e763757e', None, None, None, None, None), (None, None, '88922211-2f92-4989-937c-6c447b45f0b1', None, None, None), (None, None, '07524a96-4932-40f9-b62e-ec594f3e7266', None, None, None), ('25fece4f-b27c-4a60-9456-6f1a5d1b75a2', None, None, None, None, None), ('25fece4f-b27c-4a60-9456-6f1a5d1b75a2', None, None, None, None, None), ('bb6f43a0-fa2d-491d-aa9b-f576f0e76215', '10.2.2.100', None, None, None, None), ('bb6f43a0-fa2d-491d-aa9b-f576f0e76215', '10.2.2.200', None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:47:05.121249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7463cc08-c61a-442c-a6be-9e8f4a602c02 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:05.123551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7463cc08-c61a-442c-a6be-9e8f4a602c02 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: eceb1b06-e5fa-442b-ae37-cce2f99d58ae] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:05.142715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7463cc08-c61a-442c-a6be-9e8f4a602c02 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:05.143074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7463cc08-c61a-442c-a6be-9e8f4a602c02 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:05.143746 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7463cc08-c61a-442c-a6be-9e8f4a602c02 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:05.144501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7463cc08-c61a-442c-a6be-9e8f4a602c02 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:05.144987 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7463cc08-c61a-442c-a6be-9e8f4a602c02 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:05.145580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7463cc08-c61a-442c-a6be-9e8f4a602c02 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:05.230144 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7463cc08-c61a-442c-a6be-9e8f4a602c02 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae/action" status: 200 len: 14 microversion: 2.1 time: 0.112582 Oct 05 02:47:05.231046 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2090/4147] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:47:05 2022] POST /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 05 02:47:05.254784 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ad394d96-8ac9-47e7-b68e-58599884d6d0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:05.255721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ad394d96-8ac9-47e7-b68e-58599884d6d0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:05.263351 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad394d96-8ac9-47e7-b68e-58599884d6d0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:05.270503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad394d96-8ac9-47e7-b68e-58599884d6d0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:05.273223 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad394d96-8ac9-47e7-b68e-58599884d6d0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:05.274183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad394d96-8ac9-47e7-b68e-58599884d6d0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:05.277284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad394d96-8ac9-47e7-b68e-58599884d6d0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:05.277937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad394d96-8ac9-47e7-b68e-58599884d6d0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:05.690975 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ad394d96-8ac9-47e7-b68e-58599884d6d0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:05.705320 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ad394d96-8ac9-47e7-b68e-58599884d6d0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1507 microversion: 2.1 time: 0.452590 Oct 05 02:47:05.708846 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2091/4148] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:05 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1507 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:05.720026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e0cd57f8-4892-4211-a3bd-e210614fbf3a tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:05.720660 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e0cd57f8-4892-4211-a3bd-e210614fbf3a tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:05.733973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0cd57f8-4892-4211-a3bd-e210614fbf3a tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:05.734510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0cd57f8-4892-4211-a3bd-e210614fbf3a tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:05.734958 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0cd57f8-4892-4211-a3bd-e210614fbf3a tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:05.739457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0cd57f8-4892-4211-a3bd-e210614fbf3a tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:05.739986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0cd57f8-4892-4211-a3bd-e210614fbf3a tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:05.740430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0cd57f8-4892-4211-a3bd-e210614fbf3a tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:06.376926 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e0cd57f8-4892-4211-a3bd-e210614fbf3a tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:06.386598 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e0cd57f8-4892-4211-a3bd-e210614fbf3a tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1505 microversion: 2.1 time: 0.676346 Oct 05 02:47:06.388306 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2092/4149] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:05 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1505 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:06.397633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f04bd8af-67e8-4a35-b963-f0c68e170015 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:06.401970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f04bd8af-67e8-4a35-b963-f0c68e170015 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: eceb1b06-e5fa-442b-ae37-cce2f99d58ae] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:06.409458 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f04bd8af-67e8-4a35-b963-f0c68e170015 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:06.410210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f04bd8af-67e8-4a35-b963-f0c68e170015 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:06.410633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f04bd8af-67e8-4a35-b963-f0c68e170015 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:06.411426 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f04bd8af-67e8-4a35-b963-f0c68e170015 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:06.411911 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f04bd8af-67e8-4a35-b963-f0c68e170015 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:06.412551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f04bd8af-67e8-4a35-b963-f0c68e170015 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:06.489257 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f04bd8af-67e8-4a35-b963-f0c68e170015 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae/action" status: 200 len: 14 microversion: 2.1 time: 0.099106 Oct 05 02:47:06.490065 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2093/4150] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:47:06 2022] POST /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:47:06.734745 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0eb3f992-43b6-4432-a377-bb78ab1743c5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:06.735780 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0eb3f992-43b6-4432-a377-bb78ab1743c5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:06.743778 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0eb3f992-43b6-4432-a377-bb78ab1743c5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:06.744434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0eb3f992-43b6-4432-a377-bb78ab1743c5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:06.745005 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0eb3f992-43b6-4432-a377-bb78ab1743c5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:06.745951 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0eb3f992-43b6-4432-a377-bb78ab1743c5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:06.746508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0eb3f992-43b6-4432-a377-bb78ab1743c5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:06.747739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0eb3f992-43b6-4432-a377-bb78ab1743c5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:07.136671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0eb3f992-43b6-4432-a377-bb78ab1743c5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:07.145860 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0eb3f992-43b6-4432-a377-bb78ab1743c5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1507 microversion: 2.1 time: 0.415799 Oct 05 02:47:07.146455 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2094/4151] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:06 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1507 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:47:07.412014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-67287ef9-5d60-477e-bfa3-994997b0517d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:07.412684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-67287ef9-5d60-477e-bfa3-994997b0517d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:07.431653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-67287ef9-5d60-477e-bfa3-994997b0517d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:07.432405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-67287ef9-5d60-477e-bfa3-994997b0517d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:07.433039 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-67287ef9-5d60-477e-bfa3-994997b0517d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:07.434011 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-67287ef9-5d60-477e-bfa3-994997b0517d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:07.435438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-67287ef9-5d60-477e-bfa3-994997b0517d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:07.436176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-67287ef9-5d60-477e-bfa3-994997b0517d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:07.837317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-67287ef9-5d60-477e-bfa3-994997b0517d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:07.848617 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-67287ef9-5d60-477e-bfa3-994997b0517d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1505 microversion: 2.1 time: 0.440832 Oct 05 02:47:07.850449 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2095/4152] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:07 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1505 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:47:07.857989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d215a927-5fef-4c8a-bc2b-bcdb50b6ed70 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:07.860544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d215a927-5fef-4c8a-bc2b-bcdb50b6ed70 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: eceb1b06-e5fa-442b-ae37-cce2f99d58ae] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:07.867968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d215a927-5fef-4c8a-bc2b-bcdb50b6ed70 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:07.868996 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d215a927-5fef-4c8a-bc2b-bcdb50b6ed70 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:07.869596 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d215a927-5fef-4c8a-bc2b-bcdb50b6ed70 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:07.872863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d215a927-5fef-4c8a-bc2b-bcdb50b6ed70 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:07.874907 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d215a927-5fef-4c8a-bc2b-bcdb50b6ed70 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:07.875557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d215a927-5fef-4c8a-bc2b-bcdb50b6ed70 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:07.949577 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d215a927-5fef-4c8a-bc2b-bcdb50b6ed70 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae/action" status: 200 len: 14 microversion: 2.1 time: 0.097417 Oct 05 02:47:07.951408 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2096/4153] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:47:07 2022] POST /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:47:08.177469 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4be1cdf7-44a9-4afb-be18-9f76431fe086 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:08.180976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4be1cdf7-44a9-4afb-be18-9f76431fe086 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:08.205996 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4be1cdf7-44a9-4afb-be18-9f76431fe086 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:08.206524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4be1cdf7-44a9-4afb-be18-9f76431fe086 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:08.206986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4be1cdf7-44a9-4afb-be18-9f76431fe086 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:08.207918 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4be1cdf7-44a9-4afb-be18-9f76431fe086 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:08.208192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4be1cdf7-44a9-4afb-be18-9f76431fe086 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:08.208652 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4be1cdf7-44a9-4afb-be18-9f76431fe086 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:08.515556 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4be1cdf7-44a9-4afb-be18-9f76431fe086 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:08.537308 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4be1cdf7-44a9-4afb-be18-9f76431fe086 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1507 microversion: 2.1 time: 0.370998 Oct 05 02:47:08.538504 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2097/4154] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:08 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1507 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:47:08.876665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4063ec3e-acdc-417a-ae16-84157d8612de tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:08.877456 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4063ec3e-acdc-417a-ae16-84157d8612de tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:08.885147 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4063ec3e-acdc-417a-ae16-84157d8612de tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:08.885637 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4063ec3e-acdc-417a-ae16-84157d8612de tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:08.886076 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4063ec3e-acdc-417a-ae16-84157d8612de tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:08.886755 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4063ec3e-acdc-417a-ae16-84157d8612de tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:08.887204 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4063ec3e-acdc-417a-ae16-84157d8612de tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:08.908757 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4063ec3e-acdc-417a-ae16-84157d8612de tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:09.483835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4063ec3e-acdc-417a-ae16-84157d8612de tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:09.492880 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4063ec3e-acdc-417a-ae16-84157d8612de tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1505 microversion: 2.1 time: 0.621049 Oct 05 02:47:09.509404 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2098/4155] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:08 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1505 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:47:09.515060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ce39282d-8a04-421d-b8ef-332dcbdd0814 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:09.517472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ce39282d-8a04-421d-b8ef-332dcbdd0814 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: eceb1b06-e5fa-442b-ae37-cce2f99d58ae] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:09.525371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce39282d-8a04-421d-b8ef-332dcbdd0814 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:09.526104 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce39282d-8a04-421d-b8ef-332dcbdd0814 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:09.527089 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce39282d-8a04-421d-b8ef-332dcbdd0814 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:09.528856 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce39282d-8a04-421d-b8ef-332dcbdd0814 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:09.529786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce39282d-8a04-421d-b8ef-332dcbdd0814 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:09.530366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce39282d-8a04-421d-b8ef-332dcbdd0814 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:09.631391 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ce39282d-8a04-421d-b8ef-332dcbdd0814 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae/action" status: 200 len: 8206 microversion: 2.1 time: 0.120582 Oct 05 02:47:09.632497 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2099/4156] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:47:09 2022] POST /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae/action => generated 8206 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:09.646818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e0a64c9d-6fe1-412d-a48d-096ab99b0dd3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:47:09.655878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e0a64c9d-6fe1-412d-a48d-096ab99b0dd3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:47:09.656416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e0a64c9d-6fe1-412d-a48d-096ab99b0dd3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:47:09.656832 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e0a64c9d-6fe1-412d-a48d-096ab99b0dd3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:47:09.657324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e0a64c9d-6fe1-412d-a48d-096ab99b0dd3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:47:09.664732 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e67d4852-2fc2-4e01-8372-c2e4206ad568 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:09.666569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e67d4852-2fc2-4e01-8372-c2e4206ad568 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:09.672970 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e0a64c9d-6fe1-412d-a48d-096ab99b0dd3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:09.673669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e0a64c9d-6fe1-412d-a48d-096ab99b0dd3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:09.674335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e0a64c9d-6fe1-412d-a48d-096ab99b0dd3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:09.675290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e0a64c9d-6fe1-412d-a48d-096ab99b0dd3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:09.675917 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e0a64c9d-6fe1-412d-a48d-096ab99b0dd3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:09.676592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e0a64c9d-6fe1-412d-a48d-096ab99b0dd3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:09.678553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:47:09.680193 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e67d4852-2fc2-4e01-8372-c2e4206ad568 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:09.680741 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e67d4852-2fc2-4e01-8372-c2e4206ad568 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:09.683994 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e67d4852-2fc2-4e01-8372-c2e4206ad568 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:09.684975 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e67d4852-2fc2-4e01-8372-c2e4206ad568 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:09.685458 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e67d4852-2fc2-4e01-8372-c2e4206ad568 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:09.685898 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e67d4852-2fc2-4e01-8372-c2e4206ad568 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:09.707854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-e0a64c9d-6fe1-412d-a48d-096ab99b0dd3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Getting quotas for project 534df890fde640cc913ecd53e83540bc. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:47:09.726843 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-e0a64c9d-6fe1-412d-a48d-096ab99b0dd3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Getting quotas for user 9e8f069e9e2a48549d02a1505b648a88 and project 534df890fde640cc913ecd53e83540bc. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:47:09.945824 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e0a64c9d-6fe1-412d-a48d-096ab99b0dd3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:47:09.948577 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e0a64c9d-6fe1-412d-a48d-096ab99b0dd3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='3a874aa4-0ac0-4e7c-8fcd-53161cd31dfb',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='293684fc-0da7-47c7-b45d-c829caf8c67c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='70b164fc-a47a-4b81-9f01-3e38aaf62bf3',volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:47:09.979970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e67d4852-2fc2-4e01-8372-c2e4206ad568 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:09.990216 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e67d4852-2fc2-4e01-8372-c2e4206ad568 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1507 microversion: 2.1 time: 0.350502 Oct 05 02:47:10.006029 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2100/4157] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:09 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1507 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:10.015870 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f0d71ccf-194c-4c37-98c0-6931ab86390a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:10.016579 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f0d71ccf-194c-4c37-98c0-6931ab86390a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:10.023569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0d71ccf-194c-4c37-98c0-6931ab86390a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:10.024069 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0d71ccf-194c-4c37-98c0-6931ab86390a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:10.024529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0d71ccf-194c-4c37-98c0-6931ab86390a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:10.025339 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0d71ccf-194c-4c37-98c0-6931ab86390a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:10.026136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0d71ccf-194c-4c37-98c0-6931ab86390a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:10.026757 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0d71ccf-194c-4c37-98c0-6931ab86390a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:10.047244 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:47:10.244792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f0d71ccf-194c-4c37-98c0-6931ab86390a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:10.258186 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f0d71ccf-194c-4c37-98c0-6931ab86390a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.250869 Oct 05 02:47:10.259575 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2101/4158] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:10 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:10.400788 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e0a64c9d-6fe1-412d-a48d-096ab99b0dd3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 5.579484 Oct 05 02:47:10.408249 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2058/4159] 10.222.0.16 () {62 vars in 1189 bytes} [Wed Oct 5 02:47:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 5587 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 05 02:47:10.409726 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:47:10.413665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4d6f77ae-7230-4580-ad9b-19acb811049d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:10.414493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4d6f77ae-7230-4580-ad9b-19acb811049d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:10.421433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d6f77ae-7230-4580-ad9b-19acb811049d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:10.422064 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d6f77ae-7230-4580-ad9b-19acb811049d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:10.422690 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d6f77ae-7230-4580-ad9b-19acb811049d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:10.423579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d6f77ae-7230-4580-ad9b-19acb811049d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:10.424128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f14b0b1c-8a7b-46c1-8415-ac78f0bcb4eb tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] Action: 'create', calling method: .version_select at 0x7fccdf429d30>, body: {"keypair": {"name": "tempest-keypair-1264598481", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZOVNIHwlwqHdg3+DAzPrVMXJjRbFV/xJV2MQgpw5QCIeU6CvrSer0F5H2AeJeUPqX3gLSHdr1mbOs9yrAextzPpWOVPx7SEEDkkEJYPuUDtsaIqADwZrCViqPf2Z4I3A=="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:10.424397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d6f77ae-7230-4580-ad9b-19acb811049d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:10.425005 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d6f77ae-7230-4580-ad9b-19acb811049d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:10.464432 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-f14b0b1c-8a7b-46c1-8415-ac78f0bcb4eb tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] Getting quotas for project 630c364945fd482aabf658b63a514f84. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:47:10.470210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-f14b0b1c-8a7b-46c1-8415-ac78f0bcb4eb tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] Getting quotas for user 45e78ecac3ef4fc1b40178d58817ee7f and project 630c364945fd482aabf658b63a514f84. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:47:10.505697 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f14b0b1c-8a7b-46c1-8415-ac78f0bcb4eb tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.244396 Oct 05 02:47:10.506952 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2102/4160] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 02:47:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:47:10.514795 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b2690542-8316-418c-9299-d2ec68f49054 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:10.519189 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b2690542-8316-418c-9299-d2ec68f49054 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:10.597739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b2690542-8316-418c-9299-d2ec68f49054 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:10.609129 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b2690542-8316-418c-9299-d2ec68f49054 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:10.612984 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b2690542-8316-418c-9299-d2ec68f49054 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:10.615340 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b2690542-8316-418c-9299-d2ec68f49054 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1285 microversion: 2.42 time: 0.106784 Oct 05 02:47:10.628930 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2103/4161] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:47:10 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:47:10.629428 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4d6f77ae-7230-4580-ad9b-19acb811049d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:10.629540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-378b60da-02c8-4892-88f6-74bdc2f50667 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:10.629540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-378b60da-02c8-4892-88f6-74bdc2f50667 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:10.631774 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4d6f77ae-7230-4580-ad9b-19acb811049d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.222144 Oct 05 02:47:10.635744 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2059/4162] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:10 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:10.642033 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-378b60da-02c8-4892-88f6-74bdc2f50667 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:10.642479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-378b60da-02c8-4892-88f6-74bdc2f50667 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:10.643530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-378b60da-02c8-4892-88f6-74bdc2f50667 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:10.644352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-378b60da-02c8-4892-88f6-74bdc2f50667 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:10.644976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-378b60da-02c8-4892-88f6-74bdc2f50667 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:10.645693 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-378b60da-02c8-4892-88f6-74bdc2f50667 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:10.656309 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8dee40c9-1a03-442f-909a-f3e0cb222649 tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] Calling method '.version_select at 0x7fccdf150d30>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:10.669800 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8dee40c9-1a03-442f-909a-f3e0cb222649 tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-1264598481" status: 200 len: 498 microversion: 2.1 time: 0.032292 Oct 05 02:47:10.670386 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2060/4163] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 5 02:47:10 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1264598481 => generated 498 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:47:10.675245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f591b9ad-79d4-4efe-be45-014cadd2bf27 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:10.676034 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f591b9ad-79d4-4efe-be45-014cadd2bf27 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:10.682303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f591b9ad-79d4-4efe-be45-014cadd2bf27 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:10.682796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f591b9ad-79d4-4efe-be45-014cadd2bf27 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:10.683227 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f591b9ad-79d4-4efe-be45-014cadd2bf27 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:10.683926 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f591b9ad-79d4-4efe-be45-014cadd2bf27 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:10.685503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f591b9ad-79d4-4efe-be45-014cadd2bf27 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:10.685942 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f591b9ad-79d4-4efe-be45-014cadd2bf27 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:10.690347 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:47:10.863474 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-378b60da-02c8-4892-88f6-74bdc2f50667 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:10.875248 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-378b60da-02c8-4892-88f6-74bdc2f50667 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1505 microversion: 2.1 time: 0.257418 Oct 05 02:47:10.875870 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2104/4164] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:10 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1505 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:10.896042 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-623e19a4-246f-4409-9afe-03b480f00f9b tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] Calling method '.version_select at 0x7fcce4182700>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:10.927232 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f591b9ad-79d4-4efe-be45-014cadd2bf27 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:10.937456 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f591b9ad-79d4-4efe-be45-014cadd2bf27 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.265674 Oct 05 02:47:10.953110 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-623e19a4-246f-4409-9afe-03b480f00f9b tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1264598481" status: 202 len: 0 microversion: 2.1 time: 0.062536 Oct 05 02:47:10.953110 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2105/4165] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 5 02:47:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1264598481 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:47:10.958797 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2061/4166] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:10 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:10.960430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f9609e7f-3ebe-414e-8a21-be6f812ae245 tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] Action: 'create', calling method: .version_select at 0x7fcce40784c0>, body: {"keypair": {"name": "tempest-keypair-1484013156", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9wqcC18W4rOMdau+IE4ZDPv+A3XyhFWQYXv5AHqQa0n7pVuAemf0qPMPgAsT0Y2skkkiBvUBeFoPpPxgyETTWyDAsRXW3euTGRryibv7ftczhY+U76szbDZ5hVqeYkiw=="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:10.968328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f6bb1cd6-ab2a-4f48-b785-b5f247e0d8f1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:10.968816 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f6bb1cd6-ab2a-4f48-b785-b5f247e0d8f1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:10.975790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6bb1cd6-ab2a-4f48-b785-b5f247e0d8f1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:10.976656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6bb1cd6-ab2a-4f48-b785-b5f247e0d8f1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:10.977674 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6bb1cd6-ab2a-4f48-b785-b5f247e0d8f1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:10.978884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6bb1cd6-ab2a-4f48-b785-b5f247e0d8f1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:10.979810 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6bb1cd6-ab2a-4f48-b785-b5f247e0d8f1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:10.980547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6bb1cd6-ab2a-4f48-b785-b5f247e0d8f1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:10.998989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-f9609e7f-3ebe-414e-8a21-be6f812ae245 tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] Getting quotas for project 630c364945fd482aabf658b63a514f84. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:47:11.004885 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-f9609e7f-3ebe-414e-8a21-be6f812ae245 tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] Getting quotas for user 45e78ecac3ef4fc1b40178d58817ee7f and project 630c364945fd482aabf658b63a514f84. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:47:11.036941 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f9609e7f-3ebe-414e-8a21-be6f812ae245 tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.088805 Oct 05 02:47:11.043059 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2106/4167] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 02:47:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:47:11.044119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-27fa5e74-a717-4a52-9450-68472a05f729 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:11.044119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-27fa5e74-a717-4a52-9450-68472a05f729 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:11.051050 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27fa5e74-a717-4a52-9450-68472a05f729 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:11.051550 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27fa5e74-a717-4a52-9450-68472a05f729 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:11.051983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27fa5e74-a717-4a52-9450-68472a05f729 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:11.052676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27fa5e74-a717-4a52-9450-68472a05f729 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:11.053160 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27fa5e74-a717-4a52-9450-68472a05f729 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:11.053584 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27fa5e74-a717-4a52-9450-68472a05f729 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:11.273878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f6bb1cd6-ab2a-4f48-b785-b5f247e0d8f1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:11.280038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-27fa5e74-a717-4a52-9450-68472a05f729 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:11.288295 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f6bb1cd6-ab2a-4f48-b785-b5f247e0d8f1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.324456 Oct 05 02:47:11.289900 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2062/4168] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:10 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:47:11.290140 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-27fa5e74-a717-4a52-9450-68472a05f729 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1507 microversion: 2.1 time: 0.250901 Oct 05 02:47:11.295633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ffd998b5-a74e-47c6-8a8d-054bcc8d70ed tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] Calling method '.version_select at 0x7fccdf09f700>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:11.301470 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2107/4169] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:11 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1507 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:11.318228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-262c9783-4eef-4d0c-bdee-8e2a7c525aa4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:11.319538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-262c9783-4eef-4d0c-bdee-8e2a7c525aa4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:11.321552 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ffd998b5-a74e-47c6-8a8d-054bcc8d70ed tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1484013156" status: 202 len: 0 microversion: 2.1 time: 0.030139 Oct 05 02:47:11.322205 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2063/4170] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 5 02:47:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1484013156 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:47:11.328837 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-262c9783-4eef-4d0c-bdee-8e2a7c525aa4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:11.329962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-262c9783-4eef-4d0c-bdee-8e2a7c525aa4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:11.330552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-262c9783-4eef-4d0c-bdee-8e2a7c525aa4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:11.331126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-262c9783-4eef-4d0c-bdee-8e2a7c525aa4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:11.331584 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-262c9783-4eef-4d0c-bdee-8e2a7c525aa4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:11.332491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-262c9783-4eef-4d0c-bdee-8e2a7c525aa4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:11.334863 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f1b6f0ae-c78c-48f1-8679-75f41e525904 tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] Action: 'create', calling method: .version_select at 0x7fccdfded940>, body: {"keypair": {"name": "tempest-keypair-908411304", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:11.354262 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-f1b6f0ae-c78c-48f1-8679-75f41e525904 tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] Getting quotas for project 630c364945fd482aabf658b63a514f84. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:47:11.363009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-f1b6f0ae-c78c-48f1-8679-75f41e525904 tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] Getting quotas for user 45e78ecac3ef4fc1b40178d58817ee7f and project 630c364945fd482aabf658b63a514f84. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:47:11.384619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-262c9783-4eef-4d0c-bdee-8e2a7c525aa4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Locking {{(pid=122320) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 05 02:47:11.394429 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f1b6f0ae-c78c-48f1-8679-75f41e525904 tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.065444 Oct 05 02:47:11.395829 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2064/4171] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 02:47:11 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:47:11.407344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-741d3982-8dd2-43df-b3de-5e45b2d571d0 tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] Calling method '.version_select at 0x7fccdf6558b0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:11.417937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:47:11.444191 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-741d3982-8dd2-43df-b3de-5e45b2d571d0 tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-908411304" status: 202 len: 0 microversion: 2.1 time: 0.042048 Oct 05 02:47:11.445720 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2065/4172] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 5 02:47:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-908411304 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 02:47:11.465268 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-864f3c9a-ee2f-463d-92a9-a1c463cc7030 tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] Action: 'create', calling method: .version_select at 0x7fcce80c4d30>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1766166310", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECDOq/gt5kIlJRceVbw2nVhjn6qDQWt7BMMuygzZ7oA5QHjYfGE+pRakEbEdrOua/WLzHJqk5fSOR1dR82ok0xdWf9pX3c9Kf38EeiU0tw14zApDMObhBufs5jWLvFWlg=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:11.467889 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-262c9783-4eef-4d0c-bdee-8e2a7c525aa4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action" status: 202 len: 0 microversion: 2.1 time: 0.155094 Oct 05 02:47:11.468553 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2108/4173] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:47:11 2022] POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 02:47:11.482761 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-402332c6-bc91-4318-a632-c62cd7f9b1bb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:11.483395 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-402332c6-bc91-4318-a632-c62cd7f9b1bb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:11.491998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-864f3c9a-ee2f-463d-92a9-a1c463cc7030 tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] Getting quotas for project 630c364945fd482aabf658b63a514f84. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:47:11.501421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-402332c6-bc91-4318-a632-c62cd7f9b1bb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:11.501972 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-402332c6-bc91-4318-a632-c62cd7f9b1bb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:11.502424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-402332c6-bc91-4318-a632-c62cd7f9b1bb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:11.503149 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-402332c6-bc91-4318-a632-c62cd7f9b1bb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:11.503614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-402332c6-bc91-4318-a632-c62cd7f9b1bb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:11.504537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-402332c6-bc91-4318-a632-c62cd7f9b1bb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:11.504746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-864f3c9a-ee2f-463d-92a9-a1c463cc7030 tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] Getting quotas for user 45e78ecac3ef4fc1b40178d58817ee7f and project 630c364945fd482aabf658b63a514f84. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:47:11.543101 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-864f3c9a-ee2f-463d-92a9-a1c463cc7030 tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.088181 Oct 05 02:47:11.545738 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2066/4174] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 02:47:11 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:47:11.570497 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d104071a-49d4-4a88-a480-65029c58eccd tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] Action: 'create', calling method: .version_select at 0x7fccdf50ac10>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2017175107", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlGtK75y21rBhIMSPBrSGo6+cjiHKk6an6Jcg4PcCnVAK6mOenPHsg6wHIWFZc7D83na+HavhCSnqgJyeWnBE8LCF5Hmk70oh58wuj7RqOKaVfSeYVnbYYTSe6vHoImxA=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:11.592309 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-d104071a-49d4-4a88-a480-65029c58eccd tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] Getting quotas for project 630c364945fd482aabf658b63a514f84. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:47:11.602854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-d104071a-49d4-4a88-a480-65029c58eccd tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] Getting quotas for user 45e78ecac3ef4fc1b40178d58817ee7f and project 630c364945fd482aabf658b63a514f84. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:47:11.646207 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d104071a-49d4-4a88-a480-65029c58eccd tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.083601 Oct 05 02:47:11.648551 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2067/4175] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 02:47:11 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:47:11.662709 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-60fc3d65-2a99-4d0c-8bc4-48b7dccffd3f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:11.663486 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-60fc3d65-2a99-4d0c-8bc4-48b7dccffd3f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:11.670884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60fc3d65-2a99-4d0c-8bc4-48b7dccffd3f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:11.671901 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60fc3d65-2a99-4d0c-8bc4-48b7dccffd3f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:11.672447 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60fc3d65-2a99-4d0c-8bc4-48b7dccffd3f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:11.673439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60fc3d65-2a99-4d0c-8bc4-48b7dccffd3f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:11.674003 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60fc3d65-2a99-4d0c-8bc4-48b7dccffd3f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:11.674772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60fc3d65-2a99-4d0c-8bc4-48b7dccffd3f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:11.718380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-402332c6-bc91-4318-a632-c62cd7f9b1bb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:11.727003 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-402332c6-bc91-4318-a632-c62cd7f9b1bb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.252422 Oct 05 02:47:11.728099 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2109/4176] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:11 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:11.741511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cc42dbd3-42b8-48d2-a041-bd098b6825f4 tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] Action: 'create', calling method: .version_select at 0x7fcce4256c10>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1157943797", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9QYjfBtkjngxVzEezvdD29dlTRKPXq2G2C/iLmFb0t1473IVZn5FCjotxGPMVCCM4PeiRBsXx/udyc+LhyCHVFOaVIExSRIQuzKtAKHMbkaPKGdzpaJs3LlHEv+sijZw=="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:11.761393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-cc42dbd3-42b8-48d2-a041-bd098b6825f4 tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] Getting quotas for project 630c364945fd482aabf658b63a514f84. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:47:11.769558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-cc42dbd3-42b8-48d2-a041-bd098b6825f4 tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] Getting quotas for user 45e78ecac3ef4fc1b40178d58817ee7f and project 630c364945fd482aabf658b63a514f84. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:47:11.790704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-60fc3d65-2a99-4d0c-8bc4-48b7dccffd3f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:11.806290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-60fc3d65-2a99-4d0c-8bc4-48b7dccffd3f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:11.808600 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cc42dbd3-42b8-48d2-a041-bd098b6825f4 tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.078393 Oct 05 02:47:11.809487 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2110/4177] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 02:47:11 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:47:11.811445 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-60fc3d65-2a99-4d0c-8bc4-48b7dccffd3f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:11.812670 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-60fc3d65-2a99-4d0c-8bc4-48b7dccffd3f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1519 microversion: 2.42 time: 0.162711 Oct 05 02:47:11.825838 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2068/4178] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:47:11 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:47:11.829777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-feed73b2-5050-4804-9803-98ca7d0e3b8f tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] Calling method '.version_select at 0x7fccdf09fdc0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:11.835635 n-d-858272-3 devstack@n-api.service[122319]: WARNING oslo_db.sqlalchemy.utils [None req-feed73b2-5050-4804-9803-98ca7d0e3b8f tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 05 02:47:11.843149 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d7a75e9a-6584-4777-bac2-ea2f63b9a29c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:11.845437 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-feed73b2-5050-4804-9803-98ca7d0e3b8f tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1094 microversion: 2.1 time: 0.029126 Oct 05 02:47:11.846398 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2069/4179] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 5 02:47:11 2022] GET /compute/v2.1/os-keypairs => generated 1094 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:11.860580 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6045eaaf-58a5-4443-9c02-3eb9504f65ca tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] Calling method '.version_select at 0x7fcce80c4550>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:11.863071 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7a75e9a-6584-4777-bac2-ea2f63b9a29c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:11.863689 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7a75e9a-6584-4777-bac2-ea2f63b9a29c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:11.864364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7a75e9a-6584-4777-bac2-ea2f63b9a29c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:11.917235 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-d7a75e9a-6584-4777-bac2-ea2f63b9a29c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] HTTP exception thrown: Instance 4388e9ec-13a9-4d5b-9310-7a10953c57d0 is locked Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d7a75e9a-6584-4777-bac2-ea2f63b9a29c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Request method failure captured: Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action HTTP/1.1 Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 15 Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO7Sif7k2Rw6uRp1-U79PqbkOIEiV2C9maqWOg5HMbTQohV_wI3ZnNHqYwQk7awYRSS07q-kKtBu6GhULl5i3c9ATZsA7i0MdjMTEZGOwFDjxeZA_z2PV0fcLV1ncQTeNhB317y14StT_9d9kGPegGkBw0puNI5HL7TMGXTWx0tieJI Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 1ff63adf9571439d8f8bf9b0fa6c63f9 Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServerActionsTestJSON-1915862737 Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ff63adf9571439d8f8bf9b0fa6c63f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ff63adf9571439d8f8bf9b0fa6c63f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1ff63adf9571439d8f8bf9b0fa6c63f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1ff63adf9571439d8f8bf9b0fa6c63f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServerActionsTestJSON-1915862737 Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 1ff63adf9571439d8f8bf9b0fa6c63f9 Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServerActionsTestJSON-1915862737 Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServerActionsTestJSON-1915862737-project Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 728544ca5e164540b3c5395534542955 Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServerActionsTestJSON-1915862737-project Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: {"os-stop": {}} Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 4388e9ec-13a9-4d5b-9310-7a10953c57d0 is locked Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '4388e9ec-13a9-4d5b-9310-7a10953c57d0', 'body': {'os-stop': {}}} Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 4388e9ec-13a9-4d5b-9310-7a10953c57d0 is locked Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 4388e9ec-13a9-4d5b-9310-7a10953c57d0 is locked Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4388e9ec-13a9-4d5b-9310-7a10953c57d0 is locked Oct 05 02:47:11.920522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:11.924504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d7a75e9a-6584-4777-bac2-ea2f63b9a29c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Returning 409 to user: Instance 4388e9ec-13a9-4d5b-9310-7a10953c57d0 is locked {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:47:11.924504 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d7a75e9a-6584-4777-bac2-ea2f63b9a29c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action" status: 409 len: 107 microversion: 2.1 time: 0.096043 Oct 05 02:47:11.924504 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2111/4180] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:47:11 2022] POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action => generated 107 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:47:11.927486 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a5cf6511-cb66-4377-bd0f-1f3d916a18f0 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:11.928115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a5cf6511-cb66-4377-bd0f-1f3d916a18f0 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:11.932014 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6045eaaf-58a5-4443-9c02-3eb9504f65ca tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1157943797" status: 202 len: 0 microversion: 2.1 time: 0.078706 Oct 05 02:47:11.933109 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2070/4181] 10.222.0.16 () {58 vars in 1278 bytes} [Wed Oct 5 02:47:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1157943797 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:47:11.938628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5cf6511-cb66-4377-bd0f-1f3d916a18f0 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:11.939130 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5cf6511-cb66-4377-bd0f-1f3d916a18f0 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:11.939374 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8f61322b-25c7-4b32-aaeb-35c15b8dfc29 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:11.939569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5cf6511-cb66-4377-bd0f-1f3d916a18f0 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:11.940277 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5cf6511-cb66-4377-bd0f-1f3d916a18f0 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:11.940402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8f61322b-25c7-4b32-aaeb-35c15b8dfc29 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:11.940735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5cf6511-cb66-4377-bd0f-1f3d916a18f0 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:11.941191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5cf6511-cb66-4377-bd0f-1f3d916a18f0 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:11.951414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f61322b-25c7-4b32-aaeb-35c15b8dfc29 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:11.952163 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f61322b-25c7-4b32-aaeb-35c15b8dfc29 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:11.952679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f61322b-25c7-4b32-aaeb-35c15b8dfc29 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:11.954673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f61322b-25c7-4b32-aaeb-35c15b8dfc29 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:11.955403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f61322b-25c7-4b32-aaeb-35c15b8dfc29 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:11.956337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f61322b-25c7-4b32-aaeb-35c15b8dfc29 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:12.033180 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8f61322b-25c7-4b32-aaeb-35c15b8dfc29 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Unlocking {{(pid=122319) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 05 02:47:12.110139 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8f61322b-25c7-4b32-aaeb-35c15b8dfc29 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action" status: 202 len: 0 microversion: 2.1 time: 0.175586 Oct 05 02:47:12.114422 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2071/4182] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:47:11 2022] POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:47:12.119600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1dd99e36-e4aa-4a96-8bc7-f497791d122a tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] Calling method '.version_select at 0x7fccdf50d670>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:12.145862 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1dd99e36-e4aa-4a96-8bc7-f497791d122a tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2017175107" status: 202 len: 0 microversion: 2.1 time: 0.030265 Oct 05 02:47:12.146478 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2072/4183] 10.222.0.16 () {58 vars in 1278 bytes} [Wed Oct 5 02:47:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2017175107 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:47:12.151732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d7750c84-be9a-490e-8b4a-e26567b80153 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:12.158601 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7750c84-be9a-490e-8b4a-e26567b80153 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:12.159104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7750c84-be9a-490e-8b4a-e26567b80153 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:12.159726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7750c84-be9a-490e-8b4a-e26567b80153 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:12.191558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d7750c84-be9a-490e-8b4a-e26567b80153 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Going to try to stop instance {{(pid=122319) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 05 02:47:12.246588 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d7750c84-be9a-490e-8b4a-e26567b80153 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action" status: 202 len: 0 microversion: 2.1 time: 0.098681 Oct 05 02:47:12.247336 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2073/4184] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:47:12 2022] POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:47:12.272228 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3f4ec512-a5c6-4dd4-8746-40f3c69485bc tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] Calling method '.version_select at 0x7fccdf1790d0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:12.273025 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a5cf6511-cb66-4377-bd0f-1f3d916a18f0 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:12.285430 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a5cf6511-cb66-4377-bd0f-1f3d916a18f0 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1505 microversion: 2.1 time: 0.361562 Oct 05 02:47:12.297039 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2112/4185] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:11 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1505 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:12.300350 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-27498774-c99c-45bf-a819-ae35418eb7c2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:12.301040 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-27498774-c99c-45bf-a819-ae35418eb7c2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:12.316725 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3f4ec512-a5c6-4dd4-8746-40f3c69485bc tempest-KeyPairsV2TestJSON-960481781 tempest-KeyPairsV2TestJSON-960481781-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1766166310" status: 202 len: 0 microversion: 2.1 time: 0.050169 Oct 05 02:47:12.318046 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2074/4186] 10.222.0.16 () {58 vars in 1278 bytes} [Wed Oct 5 02:47:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1766166310 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:47:12.323671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27498774-c99c-45bf-a819-ae35418eb7c2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:12.324151 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27498774-c99c-45bf-a819-ae35418eb7c2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:12.324597 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27498774-c99c-45bf-a819-ae35418eb7c2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:12.325618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27498774-c99c-45bf-a819-ae35418eb7c2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:12.326079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27498774-c99c-45bf-a819-ae35418eb7c2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:12.326511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27498774-c99c-45bf-a819-ae35418eb7c2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:12.328327 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6d13c26b-e9f4-425e-abb7-05b20eed8902 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:12.329217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6d13c26b-e9f4-425e-abb7-05b20eed8902 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:12.336242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6d13c26b-e9f4-425e-abb7-05b20eed8902 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:12.336890 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6d13c26b-e9f4-425e-abb7-05b20eed8902 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:12.337612 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6d13c26b-e9f4-425e-abb7-05b20eed8902 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:12.338502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6d13c26b-e9f4-425e-abb7-05b20eed8902 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:12.339316 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6d13c26b-e9f4-425e-abb7-05b20eed8902 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:12.339875 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6d13c26b-e9f4-425e-abb7-05b20eed8902 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:12.727791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6d13c26b-e9f4-425e-abb7-05b20eed8902 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:12.736093 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6d13c26b-e9f4-425e-abb7-05b20eed8902 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1507 microversion: 2.1 time: 0.412578 Oct 05 02:47:12.749189 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-27498774-c99c-45bf-a819-ae35418eb7c2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:12.757079 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2075/4187] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:12 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1507 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:12.758724 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-27498774-c99c-45bf-a819-ae35418eb7c2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1679 microversion: 2.1 time: 0.462758 Oct 05 02:47:12.759304 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2113/4188] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:12 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1679 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:12.843855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-84128eec-98c1-4b10-b232-3533dd093f90 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:12.846890 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-84128eec-98c1-4b10-b232-3533dd093f90 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:12.864200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84128eec-98c1-4b10-b232-3533dd093f90 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:12.866975 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84128eec-98c1-4b10-b232-3533dd093f90 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:12.867649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84128eec-98c1-4b10-b232-3533dd093f90 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:12.869540 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84128eec-98c1-4b10-b232-3533dd093f90 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:12.870022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84128eec-98c1-4b10-b232-3533dd093f90 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:12.870483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84128eec-98c1-4b10-b232-3533dd093f90 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:13.053320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-84128eec-98c1-4b10-b232-3533dd093f90 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:13.063480 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-84128eec-98c1-4b10-b232-3533dd093f90 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:13.079936 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-84128eec-98c1-4b10-b232-3533dd093f90 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:13.081122 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-84128eec-98c1-4b10-b232-3533dd093f90 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1593 microversion: 2.42 time: 0.243582 Oct 05 02:47:13.082181 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2076/4189] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:47:12 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1593 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:47:13.311241 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f9de1590-4db1-4645-b42f-917370a31a2a tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:13.312249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f9de1590-4db1-4645-b42f-917370a31a2a tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:13.324296 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9de1590-4db1-4645-b42f-917370a31a2a tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:13.327613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9de1590-4db1-4645-b42f-917370a31a2a tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:13.328791 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9de1590-4db1-4645-b42f-917370a31a2a tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:13.329768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9de1590-4db1-4645-b42f-917370a31a2a tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:13.330826 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9de1590-4db1-4645-b42f-917370a31a2a tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:13.331589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9de1590-4db1-4645-b42f-917370a31a2a tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:13.760270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-493a4234-67e2-4df7-bf12-c799a31c6d37 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:13.762019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-493a4234-67e2-4df7-bf12-c799a31c6d37 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:13.771241 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f9de1590-4db1-4645-b42f-917370a31a2a tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:13.780072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-493a4234-67e2-4df7-bf12-c799a31c6d37 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:13.780937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-493a4234-67e2-4df7-bf12-c799a31c6d37 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:13.781468 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-493a4234-67e2-4df7-bf12-c799a31c6d37 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:13.782727 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f9de1590-4db1-4645-b42f-917370a31a2a tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1505 microversion: 2.1 time: 0.476306 Oct 05 02:47:13.783573 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-493a4234-67e2-4df7-bf12-c799a31c6d37 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:13.788304 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2114/4190] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:13 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1505 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:13.789854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-493a4234-67e2-4df7-bf12-c799a31c6d37 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:13.790399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-493a4234-67e2-4df7-bf12-c799a31c6d37 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:13.804466 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-183eee4f-b427-4547-9489-057053c846fb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:13.809997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-183eee4f-b427-4547-9489-057053c846fb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:13.824395 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-183eee4f-b427-4547-9489-057053c846fb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:13.830346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-183eee4f-b427-4547-9489-057053c846fb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:13.844068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-183eee4f-b427-4547-9489-057053c846fb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:13.851002 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-183eee4f-b427-4547-9489-057053c846fb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:13.851841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-183eee4f-b427-4547-9489-057053c846fb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:13.851966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-183eee4f-b427-4547-9489-057053c846fb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:14.358316 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-493a4234-67e2-4df7-bf12-c799a31c6d37 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:14.373766 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-493a4234-67e2-4df7-bf12-c799a31c6d37 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1507 microversion: 2.1 time: 0.617836 Oct 05 02:47:14.374322 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2077/4191] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:13 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1507 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:47:14.379667 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9af50ab0-d8e4-489b-8861-ef2c2972ce21 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:14.386894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9af50ab0-d8e4-489b-8861-ef2c2972ce21 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:14.394846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9af50ab0-d8e4-489b-8861-ef2c2972ce21 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:14.395335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9af50ab0-d8e4-489b-8861-ef2c2972ce21 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:14.404025 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9af50ab0-d8e4-489b-8861-ef2c2972ce21 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:14.405030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9af50ab0-d8e4-489b-8861-ef2c2972ce21 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:14.405664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9af50ab0-d8e4-489b-8861-ef2c2972ce21 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:14.406261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9af50ab0-d8e4-489b-8861-ef2c2972ce21 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:14.414314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-183eee4f-b427-4547-9489-057053c846fb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:14.424232 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-183eee4f-b427-4547-9489-057053c846fb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1679 microversion: 2.1 time: 0.634616 Oct 05 02:47:14.436070 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2115/4192] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:13 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1679 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:14.619771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9af50ab0-d8e4-489b-8861-ef2c2972ce21 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:14.634350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9af50ab0-d8e4-489b-8861-ef2c2972ce21 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:14.635791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9af50ab0-d8e4-489b-8861-ef2c2972ce21 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:14.636952 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9af50ab0-d8e4-489b-8861-ef2c2972ce21 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1593 microversion: 2.42 time: 0.261399 Oct 05 02:47:14.638355 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2078/4193] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:47:14 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1593 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:47:14.812360 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f2f0b1fe-3db4-406a-ad77-574c2c423400 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:14.813528 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f2f0b1fe-3db4-406a-ad77-574c2c423400 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:14.821217 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2f0b1fe-3db4-406a-ad77-574c2c423400 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:14.821920 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2f0b1fe-3db4-406a-ad77-574c2c423400 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:14.822512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2f0b1fe-3db4-406a-ad77-574c2c423400 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:14.823890 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2f0b1fe-3db4-406a-ad77-574c2c423400 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:14.824510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2f0b1fe-3db4-406a-ad77-574c2c423400 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:14.825179 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2f0b1fe-3db4-406a-ad77-574c2c423400 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:15.189661 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f2f0b1fe-3db4-406a-ad77-574c2c423400 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:15.199799 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f2f0b1fe-3db4-406a-ad77-574c2c423400 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1505 microversion: 2.1 time: 0.392133 Oct 05 02:47:15.203688 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2116/4194] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:14 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1505 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:15.397796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-afe54fc1-affb-4d5b-9b91-22415d47fe58 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:15.399269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-afe54fc1-affb-4d5b-9b91-22415d47fe58 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:15.408237 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-afe54fc1-affb-4d5b-9b91-22415d47fe58 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:15.409582 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-afe54fc1-affb-4d5b-9b91-22415d47fe58 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:15.410241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-afe54fc1-affb-4d5b-9b91-22415d47fe58 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:15.411228 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-afe54fc1-affb-4d5b-9b91-22415d47fe58 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:15.412055 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-afe54fc1-affb-4d5b-9b91-22415d47fe58 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:15.412642 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-afe54fc1-affb-4d5b-9b91-22415d47fe58 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:15.455876 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b65bc726-0204-4ea0-b086-a755774c4fda tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:15.457075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b65bc726-0204-4ea0-b086-a755774c4fda tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:15.471748 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b65bc726-0204-4ea0-b086-a755774c4fda tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:15.472634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b65bc726-0204-4ea0-b086-a755774c4fda tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:15.479808 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b65bc726-0204-4ea0-b086-a755774c4fda tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:15.480662 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b65bc726-0204-4ea0-b086-a755774c4fda tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:15.483665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b65bc726-0204-4ea0-b086-a755774c4fda tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:15.484335 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b65bc726-0204-4ea0-b086-a755774c4fda tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:16.218631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-afe54fc1-affb-4d5b-9b91-22415d47fe58 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:16.229515 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-afe54fc1-affb-4d5b-9b91-22415d47fe58 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1507 microversion: 2.1 time: 0.835598 Oct 05 02:47:16.230101 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2079/4195] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:15 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1507 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:16.242108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-59c5ed37-a832-48a1-a29b-6e97a08c73c1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:16.245529 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-59c5ed37-a832-48a1-a29b-6e97a08c73c1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:16.260215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b65bc726-0204-4ea0-b086-a755774c4fda tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:16.261219 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-59c5ed37-a832-48a1-a29b-6e97a08c73c1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:16.261728 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-59c5ed37-a832-48a1-a29b-6e97a08c73c1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:16.263153 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-59c5ed37-a832-48a1-a29b-6e97a08c73c1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:16.264240 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-59c5ed37-a832-48a1-a29b-6e97a08c73c1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:16.264718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-59c5ed37-a832-48a1-a29b-6e97a08c73c1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:16.267340 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-59c5ed37-a832-48a1-a29b-6e97a08c73c1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:16.275664 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b65bc726-0204-4ea0-b086-a755774c4fda tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1679 microversion: 2.1 time: 0.818614 Oct 05 02:47:16.277606 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2117/4196] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:15 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1679 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:16.284203 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-66e836f8-a1b5-4253-9c82-803d0364ae74 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:16.284828 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-66e836f8-a1b5-4253-9c82-803d0364ae74 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:16.305169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-66e836f8-a1b5-4253-9c82-803d0364ae74 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:16.305169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-66e836f8-a1b5-4253-9c82-803d0364ae74 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:16.305169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-66e836f8-a1b5-4253-9c82-803d0364ae74 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:16.305169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-66e836f8-a1b5-4253-9c82-803d0364ae74 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:16.305169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-66e836f8-a1b5-4253-9c82-803d0364ae74 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:16.310054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-66e836f8-a1b5-4253-9c82-803d0364ae74 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:16.725674 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-59c5ed37-a832-48a1-a29b-6e97a08c73c1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:16.743881 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-59c5ed37-a832-48a1-a29b-6e97a08c73c1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:16.748180 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-59c5ed37-a832-48a1-a29b-6e97a08c73c1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:16.753418 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-59c5ed37-a832-48a1-a29b-6e97a08c73c1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1708 microversion: 2.42 time: 0.514305 Oct 05 02:47:16.754362 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2080/4197] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:47:16 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1708 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:47:16.786163 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-66e836f8-a1b5-4253-9c82-803d0364ae74 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:16.804075 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-66e836f8-a1b5-4253-9c82-803d0364ae74 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1505 microversion: 2.1 time: 0.524969 Oct 05 02:47:16.810847 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2118/4198] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:16 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1505 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:17.256020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3151b7f2-43eb-4b11-9e19-baaed36cea0f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:17.256637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3151b7f2-43eb-4b11-9e19-baaed36cea0f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:17.269104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3151b7f2-43eb-4b11-9e19-baaed36cea0f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:17.270982 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3151b7f2-43eb-4b11-9e19-baaed36cea0f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:17.271412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3151b7f2-43eb-4b11-9e19-baaed36cea0f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:17.276553 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3151b7f2-43eb-4b11-9e19-baaed36cea0f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:17.277144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3151b7f2-43eb-4b11-9e19-baaed36cea0f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:17.277806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3151b7f2-43eb-4b11-9e19-baaed36cea0f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:17.301710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2d61150c-9f3e-4cf8-8157-f306efef3f5a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:17.303690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2d61150c-9f3e-4cf8-8157-f306efef3f5a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:17.318786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d61150c-9f3e-4cf8-8157-f306efef3f5a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:17.326434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d61150c-9f3e-4cf8-8157-f306efef3f5a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:17.327989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d61150c-9f3e-4cf8-8157-f306efef3f5a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:17.334378 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d61150c-9f3e-4cf8-8157-f306efef3f5a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:17.335044 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d61150c-9f3e-4cf8-8157-f306efef3f5a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:17.335654 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d61150c-9f3e-4cf8-8157-f306efef3f5a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:17.913822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3151b7f2-43eb-4b11-9e19-baaed36cea0f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:17.936523 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3151b7f2-43eb-4b11-9e19-baaed36cea0f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1507 microversion: 2.1 time: 0.674065 Oct 05 02:47:17.937459 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2081/4199] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:17 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1507 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:17.943037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a485ce13-0c30-48b1-a3eb-1bc6c026a535 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:17.943885 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a485ce13-0c30-48b1-a3eb-1bc6c026a535 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:17.958611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a485ce13-0c30-48b1-a3eb-1bc6c026a535 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:17.959482 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a485ce13-0c30-48b1-a3eb-1bc6c026a535 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:17.960560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a485ce13-0c30-48b1-a3eb-1bc6c026a535 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:17.961133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a485ce13-0c30-48b1-a3eb-1bc6c026a535 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:17.961766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a485ce13-0c30-48b1-a3eb-1bc6c026a535 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:17.962354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a485ce13-0c30-48b1-a3eb-1bc6c026a535 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:18.261214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2d61150c-9f3e-4cf8-8157-f306efef3f5a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:18.275591 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2d61150c-9f3e-4cf8-8157-f306efef3f5a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1679 microversion: 2.1 time: 0.976527 Oct 05 02:47:18.275835 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2119/4200] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:17 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1679 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:47:18.289098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ec99170f-5aff-43e7-9548-1d819ecac89b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:18.289951 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ec99170f-5aff-43e7-9548-1d819ecac89b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:18.310924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec99170f-5aff-43e7-9548-1d819ecac89b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:18.312192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec99170f-5aff-43e7-9548-1d819ecac89b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:18.314841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec99170f-5aff-43e7-9548-1d819ecac89b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:18.317786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec99170f-5aff-43e7-9548-1d819ecac89b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:18.318432 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec99170f-5aff-43e7-9548-1d819ecac89b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:18.320026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec99170f-5aff-43e7-9548-1d819ecac89b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:18.374146 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a485ce13-0c30-48b1-a3eb-1bc6c026a535 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:18.386160 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a485ce13-0c30-48b1-a3eb-1bc6c026a535 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:18.396309 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a485ce13-0c30-48b1-a3eb-1bc6c026a535 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:18.402999 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a485ce13-0c30-48b1-a3eb-1bc6c026a535 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1755 microversion: 2.42 time: 0.462559 Oct 05 02:47:18.407021 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2082/4201] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:47:17 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1755 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:47:18.883042 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ec99170f-5aff-43e7-9548-1d819ecac89b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:18.893548 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ec99170f-5aff-43e7-9548-1d819ecac89b tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1505 microversion: 2.1 time: 0.615920 Oct 05 02:47:18.909292 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2120/4202] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:18 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1505 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:18.968193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4457d836-2d68-4731-bf4a-62d094f1d639 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:18.969002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4457d836-2d68-4731-bf4a-62d094f1d639 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:18.983694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4457d836-2d68-4731-bf4a-62d094f1d639 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:18.984308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4457d836-2d68-4731-bf4a-62d094f1d639 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:18.985333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4457d836-2d68-4731-bf4a-62d094f1d639 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:18.986446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4457d836-2d68-4731-bf4a-62d094f1d639 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:18.987016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4457d836-2d68-4731-bf4a-62d094f1d639 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:18.988132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4457d836-2d68-4731-bf4a-62d094f1d639 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:19.015569 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:47:19.304082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5500250c-4c07-43fd-b124-c3294f9ce9c1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:19.305898 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5500250c-4c07-43fd-b124-c3294f9ce9c1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:19.335309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5500250c-4c07-43fd-b124-c3294f9ce9c1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:19.336405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5500250c-4c07-43fd-b124-c3294f9ce9c1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:19.337032 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5500250c-4c07-43fd-b124-c3294f9ce9c1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:19.338292 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5500250c-4c07-43fd-b124-c3294f9ce9c1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:19.340300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5500250c-4c07-43fd-b124-c3294f9ce9c1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:19.341447 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5500250c-4c07-43fd-b124-c3294f9ce9c1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:19.381198 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:47:19.691021 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:47:19.779494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5500250c-4c07-43fd-b124-c3294f9ce9c1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:19.793571 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5500250c-4c07-43fd-b124-c3294f9ce9c1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1679 microversion: 2.1 time: 0.497262 Oct 05 02:47:19.795236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4457d836-2d68-4731-bf4a-62d094f1d639 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:19.796442 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2121/4203] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:19 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1679 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:19.802617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-78efa293-145f-404e-9001-265cc2fbcb15 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:19.806601 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4457d836-2d68-4731-bf4a-62d094f1d639 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1507 microversion: 2.1 time: 0.845667 Oct 05 02:47:19.809886 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-78efa293-145f-404e-9001-265cc2fbcb15 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:19.811097 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2083/4204] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:18 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1507 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:19.839472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78efa293-145f-404e-9001-265cc2fbcb15 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:19.839982 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78efa293-145f-404e-9001-265cc2fbcb15 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:19.841030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78efa293-145f-404e-9001-265cc2fbcb15 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:19.841884 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78efa293-145f-404e-9001-265cc2fbcb15 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:19.842346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78efa293-145f-404e-9001-265cc2fbcb15 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:19.842774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78efa293-145f-404e-9001-265cc2fbcb15 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:19.916271 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-58452c58-b89b-4a82-a450-945d54323f40 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:19.917130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-58452c58-b89b-4a82-a450-945d54323f40 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:19.936398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58452c58-b89b-4a82-a450-945d54323f40 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:19.938138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58452c58-b89b-4a82-a450-945d54323f40 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:19.938853 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58452c58-b89b-4a82-a450-945d54323f40 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:19.941868 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58452c58-b89b-4a82-a450-945d54323f40 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:19.943452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58452c58-b89b-4a82-a450-945d54323f40 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:19.948079 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58452c58-b89b-4a82-a450-945d54323f40 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:20.401285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-58452c58-b89b-4a82-a450-945d54323f40 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:20.409406 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-78efa293-145f-404e-9001-265cc2fbcb15 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:20.435771 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-58452c58-b89b-4a82-a450-945d54323f40 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1505 microversion: 2.1 time: 0.521848 Oct 05 02:47:20.447983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-78efa293-145f-404e-9001-265cc2fbcb15 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:20.452042 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2084/4205] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:19 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1505 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:47:20.457808 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-78efa293-145f-404e-9001-265cc2fbcb15 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:20.459112 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-78efa293-145f-404e-9001-265cc2fbcb15 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1802 microversion: 2.42 time: 0.661625 Oct 05 02:47:20.460674 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2122/4206] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:47:19 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1802 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:47:20.823674 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7e72a9e9-bc35-4d6b-8819-4ad07d7f03d7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:20.824305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7e72a9e9-bc35-4d6b-8819-4ad07d7f03d7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:20.838951 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2bfbc074-25a7-441e-ae7d-1342131d6415 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:20.839576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2bfbc074-25a7-441e-ae7d-1342131d6415 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:20.855288 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e72a9e9-bc35-4d6b-8819-4ad07d7f03d7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:20.855786 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e72a9e9-bc35-4d6b-8819-4ad07d7f03d7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:20.856284 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e72a9e9-bc35-4d6b-8819-4ad07d7f03d7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:20.857242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e72a9e9-bc35-4d6b-8819-4ad07d7f03d7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:20.857705 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e72a9e9-bc35-4d6b-8819-4ad07d7f03d7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:20.861028 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bfbc074-25a7-441e-ae7d-1342131d6415 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:20.861726 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bfbc074-25a7-441e-ae7d-1342131d6415 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:20.861940 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e72a9e9-bc35-4d6b-8819-4ad07d7f03d7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:20.864192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bfbc074-25a7-441e-ae7d-1342131d6415 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:20.865133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bfbc074-25a7-441e-ae7d-1342131d6415 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:20.867374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bfbc074-25a7-441e-ae7d-1342131d6415 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:20.867969 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bfbc074-25a7-441e-ae7d-1342131d6415 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:21.355437 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2bfbc074-25a7-441e-ae7d-1342131d6415 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:21.369302 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2bfbc074-25a7-441e-ae7d-1342131d6415 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1507 microversion: 2.1 time: 0.534770 Oct 05 02:47:21.393276 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2123/4207] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:20 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1507 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:47:21.489730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7e72a9e9-bc35-4d6b-8819-4ad07d7f03d7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:21.494933 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0d9e308b-242f-45bf-8dc7-ee46dcdbffca tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:21.496195 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0d9e308b-242f-45bf-8dc7-ee46dcdbffca tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:21.510239 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7e72a9e9-bc35-4d6b-8819-4ad07d7f03d7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1679 microversion: 2.1 time: 0.690118 Oct 05 02:47:21.524142 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d9e308b-242f-45bf-8dc7-ee46dcdbffca tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:21.524874 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d9e308b-242f-45bf-8dc7-ee46dcdbffca tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:21.525539 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d9e308b-242f-45bf-8dc7-ee46dcdbffca tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:21.526447 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d9e308b-242f-45bf-8dc7-ee46dcdbffca tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:21.527077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d9e308b-242f-45bf-8dc7-ee46dcdbffca tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:21.527726 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d9e308b-242f-45bf-8dc7-ee46dcdbffca tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:21.542767 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2085/4208] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:20 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1679 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:21.562354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ee0f9085-1378-41d5-9ec2-e8d94a631b06 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:21.563298 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ee0f9085-1378-41d5-9ec2-e8d94a631b06 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:21.594279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee0f9085-1378-41d5-9ec2-e8d94a631b06 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:21.594480 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee0f9085-1378-41d5-9ec2-e8d94a631b06 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:21.594919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee0f9085-1378-41d5-9ec2-e8d94a631b06 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:21.603349 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee0f9085-1378-41d5-9ec2-e8d94a631b06 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:21.606471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee0f9085-1378-41d5-9ec2-e8d94a631b06 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:21.620408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee0f9085-1378-41d5-9ec2-e8d94a631b06 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:21.647061 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=18 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:47:21.779051 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=14 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:47:22.043421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ee0f9085-1378-41d5-9ec2-e8d94a631b06 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:22.058734 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ee0f9085-1378-41d5-9ec2-e8d94a631b06 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:22.066346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ee0f9085-1378-41d5-9ec2-e8d94a631b06 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:22.076932 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ee0f9085-1378-41d5-9ec2-e8d94a631b06 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1849 microversion: 2.42 time: 0.523707 Oct 05 02:47:22.078788 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2086/4209] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:47:21 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1849 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:47:22.270471 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0d9e308b-242f-45bf-8dc7-ee46dcdbffca tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:22.284679 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0d9e308b-242f-45bf-8dc7-ee46dcdbffca tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1505 microversion: 2.1 time: 0.800772 Oct 05 02:47:22.288048 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2124/4210] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:21 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1505 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:22.399788 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b3862b38-70c0-4728-8a3d-97f50818d6e3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:22.400777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b3862b38-70c0-4728-8a3d-97f50818d6e3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:22.410432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3862b38-70c0-4728-8a3d-97f50818d6e3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:22.419998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3862b38-70c0-4728-8a3d-97f50818d6e3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:22.420819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3862b38-70c0-4728-8a3d-97f50818d6e3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:22.421858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3862b38-70c0-4728-8a3d-97f50818d6e3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:22.422568 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3862b38-70c0-4728-8a3d-97f50818d6e3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:22.423237 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3862b38-70c0-4728-8a3d-97f50818d6e3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:22.544538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6cf5dad9-8cf5-4a10-bacd-d9440f64a1a8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:22.546025 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6cf5dad9-8cf5-4a10-bacd-d9440f64a1a8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:22.556283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6cf5dad9-8cf5-4a10-bacd-d9440f64a1a8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:22.557169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6cf5dad9-8cf5-4a10-bacd-d9440f64a1a8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:22.557840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6cf5dad9-8cf5-4a10-bacd-d9440f64a1a8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:22.558781 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6cf5dad9-8cf5-4a10-bacd-d9440f64a1a8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:22.561567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6cf5dad9-8cf5-4a10-bacd-d9440f64a1a8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:22.562308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6cf5dad9-8cf5-4a10-bacd-d9440f64a1a8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:22.844430 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b3862b38-70c0-4728-8a3d-97f50818d6e3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:22.853374 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b3862b38-70c0-4728-8a3d-97f50818d6e3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1507 microversion: 2.1 time: 0.457504 Oct 05 02:47:22.861527 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2087/4211] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:22 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1507 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:22.982807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6cf5dad9-8cf5-4a10-bacd-d9440f64a1a8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:23.004453 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6cf5dad9-8cf5-4a10-bacd-d9440f64a1a8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1679 microversion: 2.1 time: 0.464562 Oct 05 02:47:23.008260 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2125/4212] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:22 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1679 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:23.086737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-c9d4a05d-0fe2-4192-b9fd-5c54c7b77311 req-f387ea2b-202a-439e-b202-0666fc715bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a710dba5-18ef-4840-835b-06b1fc2bde87", "tag": "432071a7-edac-416f-aec1-3041b15ece3c"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:23.103228 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c9d4a05d-0fe2-4192-b9fd-5c54c7b77311 req-f387ea2b-202a-439e-b202-0666fc715bd2 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:23.109417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fb17ab55-2eb1-4c44-90ae-1d9890fd9b20 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:23.110641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fb17ab55-2eb1-4c44-90ae-1d9890fd9b20 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:23.121178 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c9d4a05d-0fe2-4192-b9fd-5c54c7b77311 req-f387ea2b-202a-439e-b202-0666fc715bd2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:23.122915 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c9d4a05d-0fe2-4192-b9fd-5c54c7b77311 req-f387ea2b-202a-439e-b202-0666fc715bd2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:23.126607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb17ab55-2eb1-4c44-90ae-1d9890fd9b20 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:23.130369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb17ab55-2eb1-4c44-90ae-1d9890fd9b20 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:23.131071 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb17ab55-2eb1-4c44-90ae-1d9890fd9b20 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:23.132030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb17ab55-2eb1-4c44-90ae-1d9890fd9b20 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:23.132706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb17ab55-2eb1-4c44-90ae-1d9890fd9b20 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:23.133380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb17ab55-2eb1-4c44-90ae-1d9890fd9b20 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:23.141167 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-c9d4a05d-0fe2-4192-b9fd-5c54c7b77311 req-f387ea2b-202a-439e-b202-0666fc715bd2 service nova] Creating event network-changed:432071a7-edac-416f-aec1-3041b15ece3c for instance a710dba5-18ef-4840-835b-06b1fc2bde87 on n-h1-858272-3 Oct 05 02:47:23.163083 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-c9d4a05d-0fe2-4192-b9fd-5c54c7b77311 req-f387ea2b-202a-439e-b202-0666fc715bd2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080438 Oct 05 02:47:23.164237 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2088/4213] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:47:23.315320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ce6bfc51-9f30-4d79-9a29-b05bfe464d51 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:23.316323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ce6bfc51-9f30-4d79-9a29-b05bfe464d51 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:23.341562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce6bfc51-9f30-4d79-9a29-b05bfe464d51 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:23.342337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce6bfc51-9f30-4d79-9a29-b05bfe464d51 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:23.343536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce6bfc51-9f30-4d79-9a29-b05bfe464d51 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:23.346847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce6bfc51-9f30-4d79-9a29-b05bfe464d51 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:23.347501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce6bfc51-9f30-4d79-9a29-b05bfe464d51 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:23.350685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce6bfc51-9f30-4d79-9a29-b05bfe464d51 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:24.147920 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fb17ab55-2eb1-4c44-90ae-1d9890fd9b20 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:24.163401 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fb17ab55-2eb1-4c44-90ae-1d9890fd9b20 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:24.165310 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fb17ab55-2eb1-4c44-90ae-1d9890fd9b20 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:24.170588 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fb17ab55-2eb1-4c44-90ae-1d9890fd9b20 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1849 microversion: 2.42 time: 1.065506 Oct 05 02:47:24.171836 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2126/4214] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:47:23 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1849 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:47:24.185900 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8a4f59a3-b58a-4ed4-bb79-48a20fc24412 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:24.186921 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8a4f59a3-b58a-4ed4-bb79-48a20fc24412 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:24.210428 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a4f59a3-b58a-4ed4-bb79-48a20fc24412 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:24.213361 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a4f59a3-b58a-4ed4-bb79-48a20fc24412 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:24.214905 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a4f59a3-b58a-4ed4-bb79-48a20fc24412 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:24.217380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a4f59a3-b58a-4ed4-bb79-48a20fc24412 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:24.219185 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a4f59a3-b58a-4ed4-bb79-48a20fc24412 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:24.221233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a4f59a3-b58a-4ed4-bb79-48a20fc24412 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:24.227039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ce6bfc51-9f30-4d79-9a29-b05bfe464d51 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:24.237999 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ce6bfc51-9f30-4d79-9a29-b05bfe464d51 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1505 microversion: 2.1 time: 0.928586 Oct 05 02:47:24.238971 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2089/4215] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:23 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1505 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:47:24.250030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f631b375-1558-457b-90ab-83c0c9bf53ea tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:24.250650 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f631b375-1558-457b-90ab-83c0c9bf53ea tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:24.266109 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f631b375-1558-457b-90ab-83c0c9bf53ea tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:24.266612 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f631b375-1558-457b-90ab-83c0c9bf53ea tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:24.267048 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f631b375-1558-457b-90ab-83c0c9bf53ea tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:24.274899 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f631b375-1558-457b-90ab-83c0c9bf53ea tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:24.275544 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f631b375-1558-457b-90ab-83c0c9bf53ea tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:24.276033 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f631b375-1558-457b-90ab-83c0c9bf53ea tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:24.838387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f631b375-1558-457b-90ab-83c0c9bf53ea tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:24.851845 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f631b375-1558-457b-90ab-83c0c9bf53ea tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1656 microversion: 2.1 time: 0.611712 Oct 05 02:47:24.852657 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2090/4216] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:24 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1656 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:24.882408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8a4f59a3-b58a-4ed4-bb79-48a20fc24412 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:24.891629 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8a4f59a3-b58a-4ed4-bb79-48a20fc24412 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1507 microversion: 2.1 time: 0.718512 Oct 05 02:47:24.892226 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2127/4217] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:24 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1507 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:24.903454 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d3f5b470-8784-4a86-8883-e37d6b9d6450 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:24.914145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d3f5b470-8784-4a86-8883-e37d6b9d6450 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:24.914665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d3f5b470-8784-4a86-8883-e37d6b9d6450 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:24.917870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d3f5b470-8784-4a86-8883-e37d6b9d6450 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:24.969049 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d3f5b470-8784-4a86-8883-e37d6b9d6450 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Going to try to start instance {{(pid=122319) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 05 02:47:25.062911 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d3f5b470-8784-4a86-8883-e37d6b9d6450 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action" status: 202 len: 0 microversion: 2.1 time: 0.178008 Oct 05 02:47:25.063889 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2091/4218] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:47:24 2022] POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:47:25.072020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-71dbafa9-36eb-4348-a3c6-7000d0fd21b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:25.072648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-71dbafa9-36eb-4348-a3c6-7000d0fd21b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:25.092104 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71dbafa9-36eb-4348-a3c6-7000d0fd21b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:25.092808 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71dbafa9-36eb-4348-a3c6-7000d0fd21b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:25.093287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71dbafa9-36eb-4348-a3c6-7000d0fd21b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:25.094189 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71dbafa9-36eb-4348-a3c6-7000d0fd21b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:25.094817 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71dbafa9-36eb-4348-a3c6-7000d0fd21b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:25.095433 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71dbafa9-36eb-4348-a3c6-7000d0fd21b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:25.205358 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dc98faa1-2372-4d08-a9e8-1300e4ce3ce3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:25.213696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-dc98faa1-2372-4d08-a9e8-1300e4ce3ce3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:25.227217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc98faa1-2372-4d08-a9e8-1300e4ce3ce3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:25.228676 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc98faa1-2372-4d08-a9e8-1300e4ce3ce3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:25.229332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc98faa1-2372-4d08-a9e8-1300e4ce3ce3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:25.230793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc98faa1-2372-4d08-a9e8-1300e4ce3ce3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:25.232281 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc98faa1-2372-4d08-a9e8-1300e4ce3ce3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:25.232970 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc98faa1-2372-4d08-a9e8-1300e4ce3ce3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:25.550767 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-71dbafa9-36eb-4348-a3c6-7000d0fd21b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:25.564206 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-71dbafa9-36eb-4348-a3c6-7000d0fd21b6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1665 microversion: 2.1 time: 0.494097 Oct 05 02:47:25.564878 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2128/4219] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:25 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1665 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:47:25.602501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-89888400-ff96-4bcf-8ab2-03b9ad2512e7 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:25.603126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-89888400-ff96-4bcf-8ab2-03b9ad2512e7 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:25.634283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89888400-ff96-4bcf-8ab2-03b9ad2512e7 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:25.635332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89888400-ff96-4bcf-8ab2-03b9ad2512e7 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:25.635997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89888400-ff96-4bcf-8ab2-03b9ad2512e7 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:25.637911 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89888400-ff96-4bcf-8ab2-03b9ad2512e7 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:25.643642 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89888400-ff96-4bcf-8ab2-03b9ad2512e7 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:25.644342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89888400-ff96-4bcf-8ab2-03b9ad2512e7 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:26.041081 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-89888400-ff96-4bcf-8ab2-03b9ad2512e7 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:26.055486 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-89888400-ff96-4bcf-8ab2-03b9ad2512e7 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1505 microversion: 2.1 time: 0.469606 Oct 05 02:47:26.074329 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2129/4220] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:25 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1505 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:26.088675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c3746cab-14af-410b-a95f-b0fd2316e2d8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:26.089338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c3746cab-14af-410b-a95f-b0fd2316e2d8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:26.106599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3746cab-14af-410b-a95f-b0fd2316e2d8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:26.107105 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3746cab-14af-410b-a95f-b0fd2316e2d8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:26.107546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3746cab-14af-410b-a95f-b0fd2316e2d8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:26.108256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3746cab-14af-410b-a95f-b0fd2316e2d8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:26.108712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3746cab-14af-410b-a95f-b0fd2316e2d8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:26.109164 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3746cab-14af-410b-a95f-b0fd2316e2d8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:26.172814 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-dc98faa1-2372-4d08-a9e8-1300e4ce3ce3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:26.184621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-dc98faa1-2372-4d08-a9e8-1300e4ce3ce3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:26.186332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-dc98faa1-2372-4d08-a9e8-1300e4ce3ce3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:26.196597 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-dc98faa1-2372-4d08-a9e8-1300e4ce3ce3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1870 microversion: 2.42 time: 0.987547 Oct 05 02:47:26.197944 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2092/4221] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:47:25 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1870 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:47:26.204839 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-a0808df0-62be-42dc-89d2-15ab8b7893d3 req-04343085-2c6d-4f5e-bb19-ab793d82ce8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a710dba5-18ef-4840-835b-06b1fc2bde87", "tag": "88922211-2f92-4989-937c-6c447b45f0b1"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:26.251680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a0808df0-62be-42dc-89d2-15ab8b7893d3 req-04343085-2c6d-4f5e-bb19-ab793d82ce8c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:26.255750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a0808df0-62be-42dc-89d2-15ab8b7893d3 req-04343085-2c6d-4f5e-bb19-ab793d82ce8c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:26.256419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a0808df0-62be-42dc-89d2-15ab8b7893d3 req-04343085-2c6d-4f5e-bb19-ab793d82ce8c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:26.287936 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-a0808df0-62be-42dc-89d2-15ab8b7893d3 req-04343085-2c6d-4f5e-bb19-ab793d82ce8c service nova] Creating event network-changed:88922211-2f92-4989-937c-6c447b45f0b1 for instance a710dba5-18ef-4840-835b-06b1fc2bde87 on n-h1-858272-3 Oct 05 02:47:26.303712 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-a0808df0-62be-42dc-89d2-15ab8b7893d3 req-04343085-2c6d-4f5e-bb19-ab793d82ce8c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104367 Oct 05 02:47:26.304359 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2093/4222] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:47:26.572841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c3746cab-14af-410b-a95f-b0fd2316e2d8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:26.595836 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c3746cab-14af-410b-a95f-b0fd2316e2d8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1507 microversion: 2.1 time: 0.519770 Oct 05 02:47:26.612930 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2130/4223] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:26 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1507 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:26.612930 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fa88b8c3-d99d-4b81-b0e3-ea6fff1779db tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:26.612930 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fa88b8c3-d99d-4b81-b0e3-ea6fff1779db tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:26.631435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fa88b8c3-d99d-4b81-b0e3-ea6fff1779db tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:26.632016 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fa88b8c3-d99d-4b81-b0e3-ea6fff1779db tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:26.635329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fa88b8c3-d99d-4b81-b0e3-ea6fff1779db tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:26.636193 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fa88b8c3-d99d-4b81-b0e3-ea6fff1779db tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:26.637021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fa88b8c3-d99d-4b81-b0e3-ea6fff1779db tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:26.639526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fa88b8c3-d99d-4b81-b0e3-ea6fff1779db tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:26.755489 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c736d020-400a-4988-a2b2-fea80dc7e08a tempest-SecurityGroupsNegativeTestJSON-1623494284 tempest-SecurityGroupsNegativeTestJSON-1623494284-project] Calling method '.version_select at 0x7fccdf637af0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:26.886601 n-d-858272-3 devstack@n-api.service[122319]: DEBUG neutronclient.v2_0.client [None req-c736d020-400a-4988-a2b2-fea80dc7e08a tempest-SecurityGroupsNegativeTestJSON-1623494284 tempest-SecurityGroupsNegativeTestJSON-1623494284-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b99069d3-5990-49aa-931a-bc02de583117 does not exist", "detail": ""}} {{(pid=122319) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 02:47:26.888032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.security_group_api [None req-c736d020-400a-4988-a2b2-fea80dc7e08a tempest-SecurityGroupsNegativeTestJSON-1623494284 tempest-SecurityGroupsNegativeTestJSON-1623494284-project] Neutron security group b99069d3-5990-49aa-931a-bc02de583117 not found {{(pid=122319) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 05 02:47:26.888894 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-c736d020-400a-4988-a2b2-fea80dc7e08a tempest-SecurityGroupsNegativeTestJSON-1623494284 tempest-SecurityGroupsNegativeTestJSON-1623494284-project] HTTP exception thrown: Security group b99069d3-5990-49aa-931a-bc02de583117 does not exist Oct 05 02:47:26.888894 n-d-858272-3 devstack@n-api.service[122319]: Neutron server returns request_ids: ['req-239b9bdf-3cd7-4c5a-b8b0-8bd158c4fb19'] Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c736d020-400a-4988-a2b2-fea80dc7e08a tempest-SecurityGroupsNegativeTestJSON-1623494284 tempest-SecurityGroupsNegativeTestJSON-1623494284-project] Request method failure captured: Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/os-security-groups/b99069d3-5990-49aa-931a-bc02de583117 HTTP/1.1 Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPA-LkHE-ysjKBN8vwAa7gEnjaBF4DdM_uiyIW2LHK-YmIUolQ-paU1895EUduSwmC7IRmGKFVBS-M_82T9L1skwuLmcGwt7rWVUEmMAH_B88IHlqGxTxMGogxg1Si0DyLncbMhT2AMAq4hn7mMWIiTnsKKZTdWlfP60dgfIfaLBiB0 Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: afcc750c588548109028bc2cafbad90a Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1623494284 Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/afcc750c588548109028bc2cafbad90a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/afcc750c588548109028bc2cafbad90a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/afcc750c588548109028bc2cafbad90a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_afcc750c588548109028bc2cafbad90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1623494284 Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: afcc750c588548109028bc2cafbad90a Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1623494284 Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-SecurityGroupsNegativeTestJSON-1623494284-project Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 6dfade6ab7784ee8bd06cabbd1eb8c0a Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1623494284-project Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: exception: Security group b99069d3-5990-49aa-931a-bc02de583117 does not exist Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: Neutron server returns request_ids: ['req-239b9bdf-3cd7-4c5a-b8b0-8bd158c4fb19'] Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'b99069d3-5990-49aa-931a-bc02de583117'} Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 02:47:26.892183 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b99069d3-5990-49aa-931a-bc02de583117 does not exist Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-239b9bdf-3cd7-4c5a-b8b0-8bd158c4fb19'] Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b99069d3-5990-49aa-931a-bc02de583117 does not exist Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-239b9bdf-3cd7-4c5a-b8b0-8bd158c4fb19'] Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b99069d3-5990-49aa-931a-bc02de583117 does not exist Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-239b9bdf-3cd7-4c5a-b8b0-8bd158c4fb19'] Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b99069d3-5990-49aa-931a-bc02de583117 does not exist Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-239b9bdf-3cd7-4c5a-b8b0-8bd158c4fb19'] Oct 05 02:47:26.895874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:47:26.900393 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c736d020-400a-4988-a2b2-fea80dc7e08a tempest-SecurityGroupsNegativeTestJSON-1623494284 tempest-SecurityGroupsNegativeTestJSON-1623494284-project] Returning 404 to user: Security group b99069d3-5990-49aa-931a-bc02de583117 does not exist Oct 05 02:47:26.900393 n-d-858272-3 devstack@n-api.service[122319]: Neutron server returns request_ids: ['req-239b9bdf-3cd7-4c5a-b8b0-8bd158c4fb19'] {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:47:26.901885 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c736d020-400a-4988-a2b2-fea80dc7e08a tempest-SecurityGroupsNegativeTestJSON-1623494284 tempest-SecurityGroupsNegativeTestJSON-1623494284-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/b99069d3-5990-49aa-931a-bc02de583117" status: 404 len: 194 microversion: 2.1 time: 0.443425 Oct 05 02:47:26.907274 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2094/4224] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:47:26 2022] DELETE /compute/v2.1/os-security-groups/b99069d3-5990-49aa-931a-bc02de583117 => generated 194 bytes in 449 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:47:26.921027 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a7ca5a54-f35b-414f-ae48-fd3e8865e9b9 tempest-SecurityGroupsNegativeTestJSON-1623494284 tempest-SecurityGroupsNegativeTestJSON-1623494284-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.011621 Oct 05 02:47:26.922959 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2095/4225] 10.222.0.16 () {58 vars in 1164 bytes} [Wed Oct 5 02:47:26 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 05 02:47:26.936880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f21a102c-6dba-4996-bef4-09db9678bfc4 tempest-SecurityGroupsNegativeTestJSON-1623494284 tempest-SecurityGroupsNegativeTestJSON-1623494284-project] Calling method '.version_select at 0x7fccdf4ff0d0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:27.093720 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fa88b8c3-d99d-4b81-b0e3-ea6fff1779db tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:27.102705 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fa88b8c3-d99d-4b81-b0e3-ea6fff1779db tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1665 microversion: 2.1 time: 0.502052 Oct 05 02:47:27.117003 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2131/4226] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:26 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1665 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:27.123040 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5bde0e09-2221-43d3-b04b-a160d6a0e4f5 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:27.128498 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5bde0e09-2221-43d3-b04b-a160d6a0e4f5 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:27.146231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5bde0e09-2221-43d3-b04b-a160d6a0e4f5 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:27.147257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5bde0e09-2221-43d3-b04b-a160d6a0e4f5 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:27.149143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5bde0e09-2221-43d3-b04b-a160d6a0e4f5 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:27.150202 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5bde0e09-2221-43d3-b04b-a160d6a0e4f5 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:27.150892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5bde0e09-2221-43d3-b04b-a160d6a0e4f5 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:27.153737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5bde0e09-2221-43d3-b04b-a160d6a0e4f5 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:27.713598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5bde0e09-2221-43d3-b04b-a160d6a0e4f5 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:27.730206 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5bde0e09-2221-43d3-b04b-a160d6a0e4f5 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1505 microversion: 2.1 time: 0.605949 Oct 05 02:47:27.734074 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2132/4227] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:27 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1505 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:27.754037 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9fdc9d25-8749-4b9b-8614-c42c59f11f9f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:27.754651 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9fdc9d25-8749-4b9b-8614-c42c59f11f9f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:27.756571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:47:27.774576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9fdc9d25-8749-4b9b-8614-c42c59f11f9f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:27.775072 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9fdc9d25-8749-4b9b-8614-c42c59f11f9f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:27.775510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9fdc9d25-8749-4b9b-8614-c42c59f11f9f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:27.779495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9fdc9d25-8749-4b9b-8614-c42c59f11f9f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:27.780344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9fdc9d25-8749-4b9b-8614-c42c59f11f9f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:27.792412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9fdc9d25-8749-4b9b-8614-c42c59f11f9f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:27.886515 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f21a102c-6dba-4996-bef4-09db9678bfc4 tempest-SecurityGroupsNegativeTestJSON-1623494284 tempest-SecurityGroupsNegativeTestJSON-1623494284-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.954658 Oct 05 02:47:27.888075 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2096/4228] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 5 02:47:26 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:47:27.893643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dd48acee-4e8a-4f49-80aa-42928334fa91 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:27.894650 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-dd48acee-4e8a-4f49-80aa-42928334fa91 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:27.932647 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dd48acee-4e8a-4f49-80aa-42928334fa91 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:27.933704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dd48acee-4e8a-4f49-80aa-42928334fa91 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:27.934886 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dd48acee-4e8a-4f49-80aa-42928334fa91 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:27.940131 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dd48acee-4e8a-4f49-80aa-42928334fa91 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:27.940960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dd48acee-4e8a-4f49-80aa-42928334fa91 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:27.941585 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dd48acee-4e8a-4f49-80aa-42928334fa91 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:28.267822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9fdc9d25-8749-4b9b-8614-c42c59f11f9f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:28.279063 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9fdc9d25-8749-4b9b-8614-c42c59f11f9f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:28.280805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9fdc9d25-8749-4b9b-8614-c42c59f11f9f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:28.290481 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9fdc9d25-8749-4b9b-8614-c42c59f11f9f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1891 microversion: 2.42 time: 0.555245 Oct 05 02:47:28.291845 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2133/4229] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:47:27 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1891 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:47:28.298116 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7a573d4e-950e-4fa6-a459-0ce4f3acee29 tempest-SecurityGroupsNegativeTestJSON-1623494284 tempest-SecurityGroupsNegativeTestJSON-1623494284-project] Calling method '.version_select at 0x7fcce4256dc0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:28.382943 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-dd48acee-4e8a-4f49-80aa-42928334fa91 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:28.397192 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-dd48acee-4e8a-4f49-80aa-42928334fa91 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1507 microversion: 2.1 time: 0.507514 Oct 05 02:47:28.398394 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2097/4230] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:27 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1507 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:28.403580 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6045aa18-c51c-4012-af10-2327b71f71da tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:28.404203 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6045aa18-c51c-4012-af10-2327b71f71da tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:28.423460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6045aa18-c51c-4012-af10-2327b71f71da tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:28.423965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6045aa18-c51c-4012-af10-2327b71f71da tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:28.428546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6045aa18-c51c-4012-af10-2327b71f71da tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:28.429402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6045aa18-c51c-4012-af10-2327b71f71da tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:28.430793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6045aa18-c51c-4012-af10-2327b71f71da tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:28.431294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6045aa18-c51c-4012-af10-2327b71f71da tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:28.572947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG neutronclient.v2_0.client [None req-7a573d4e-950e-4fa6-a459-0ce4f3acee29 tempest-SecurityGroupsNegativeTestJSON-1623494284 tempest-SecurityGroupsNegativeTestJSON-1623494284-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=122320) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 02:47:28.573653 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-7a573d4e-950e-4fa6-a459-0ce4f3acee29 tempest-SecurityGroupsNegativeTestJSON-1623494284 tempest-SecurityGroupsNegativeTestJSON-1623494284-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 05 02:47:28.573653 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-7d8eaa06-29a6-426c-8254-1bd56d9333f2'] Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7a573d4e-950e-4fa6-a459-0ce4f3acee29 tempest-SecurityGroupsNegativeTestJSON-1623494284 tempest-SecurityGroupsNegativeTestJSON-1623494284-project] Request method failure captured: Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/os-security-groups/0f6c0f46-34a3-47f3-a1e0-a4b2e735aa61 HTTP/1.1 Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPA-LkHE-ysjKBN8vwAa7gEnjaBF4DdM_uiyIW2LHK-YmIUolQ-paU1895EUduSwmC7IRmGKFVBS-M_82T9L1skwuLmcGwt7rWVUEmMAH_B88IHlqGxTxMGogxg1Si0DyLncbMhT2AMAq4hn7mMWIiTnsKKZTdWlfP60dgfIfaLBiB0 Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: afcc750c588548109028bc2cafbad90a Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1623494284 Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/afcc750c588548109028bc2cafbad90a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/afcc750c588548109028bc2cafbad90a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/afcc750c588548109028bc2cafbad90a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_afcc750c588548109028bc2cafbad90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1623494284 Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: afcc750c588548109028bc2cafbad90a Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1623494284 Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-SecurityGroupsNegativeTestJSON-1623494284-project Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 6dfade6ab7784ee8bd06cabbd1eb8c0a Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1623494284-project Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: exception: Insufficient rights for removing default security group. Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-7d8eaa06-29a6-426c-8254-1bd56d9333f2'] Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '0f6c0f46-34a3-47f3-a1e0-a4b2e735aa61'} Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 02:47:28.575797 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d8eaa06-29a6-426c-8254-1bd56d9333f2'] Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d8eaa06-29a6-426c-8254-1bd56d9333f2'] Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d8eaa06-29a6-426c-8254-1bd56d9333f2'] Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d8eaa06-29a6-426c-8254-1bd56d9333f2'] Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7a573d4e-950e-4fa6-a459-0ce4f3acee29 tempest-SecurityGroupsNegativeTestJSON-1623494284 tempest-SecurityGroupsNegativeTestJSON-1623494284-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-7d8eaa06-29a6-426c-8254-1bd56d9333f2'] {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7a573d4e-950e-4fa6-a459-0ce4f3acee29 tempest-SecurityGroupsNegativeTestJSON-1623494284 tempest-SecurityGroupsNegativeTestJSON-1623494284-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/0f6c0f46-34a3-47f3-a1e0-a4b2e735aa61" status: 400 len: 182 microversion: 2.1 time: 0.284106 Oct 05 02:47:28.580773 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2134/4231] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:47:28 2022] DELETE /compute/v2.1/os-security-groups/0f6c0f46-34a3-47f3-a1e0-a4b2e735aa61 => generated 182 bytes in 287 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:47:28.591939 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f982ab2b-4b9c-4823-b4fb-5f9b15ec81c4 tempest-SecurityGroupsNegativeTestJSON-1623494284 tempest-SecurityGroupsNegativeTestJSON-1623494284-project] Calling method '.version_select at 0x7fcce4182550>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:28.626233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG neutronclient.v2_0.client [None req-f982ab2b-4b9c-4823-b4fb-5f9b15ec81c4 tempest-SecurityGroupsNegativeTestJSON-1623494284 tempest-SecurityGroupsNegativeTestJSON-1623494284-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 30d26c12-1d23-4606-afbe-570693bf81d3 does not exist", "detail": ""}} {{(pid=122320) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 02:47:28.626843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.security_group_api [None req-f982ab2b-4b9c-4823-b4fb-5f9b15ec81c4 tempest-SecurityGroupsNegativeTestJSON-1623494284 tempest-SecurityGroupsNegativeTestJSON-1623494284-project] Neutron security group 30d26c12-1d23-4606-afbe-570693bf81d3 not found {{(pid=122320) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 05 02:47:28.627369 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-f982ab2b-4b9c-4823-b4fb-5f9b15ec81c4 tempest-SecurityGroupsNegativeTestJSON-1623494284 tempest-SecurityGroupsNegativeTestJSON-1623494284-project] HTTP exception thrown: Security group 30d26c12-1d23-4606-afbe-570693bf81d3 does not exist Oct 05 02:47:28.627369 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-1de6b652-ee7f-4e28-9c99-55b420e5cef3'] Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f982ab2b-4b9c-4823-b4fb-5f9b15ec81c4 tempest-SecurityGroupsNegativeTestJSON-1623494284 tempest-SecurityGroupsNegativeTestJSON-1623494284-project] Request method failure captured: Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/os-security-groups/30d26c12-1d23-4606-afbe-570693bf81d3 HTTP/1.1 Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPA-LkHE-ysjKBN8vwAa7gEnjaBF4DdM_uiyIW2LHK-YmIUolQ-paU1895EUduSwmC7IRmGKFVBS-M_82T9L1skwuLmcGwt7rWVUEmMAH_B88IHlqGxTxMGogxg1Si0DyLncbMhT2AMAq4hn7mMWIiTnsKKZTdWlfP60dgfIfaLBiB0 Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: afcc750c588548109028bc2cafbad90a Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1623494284 Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/afcc750c588548109028bc2cafbad90a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/afcc750c588548109028bc2cafbad90a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/afcc750c588548109028bc2cafbad90a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_afcc750c588548109028bc2cafbad90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1623494284 Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: afcc750c588548109028bc2cafbad90a Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1623494284 Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-SecurityGroupsNegativeTestJSON-1623494284-project Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 6dfade6ab7784ee8bd06cabbd1eb8c0a Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1623494284-project Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: exception: Security group 30d26c12-1d23-4606-afbe-570693bf81d3 does not exist Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-1de6b652-ee7f-4e28-9c99-55b420e5cef3'] Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '30d26c12-1d23-4606-afbe-570693bf81d3'} Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 02:47:28.629605 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 30d26c12-1d23-4606-afbe-570693bf81d3 does not exist Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1de6b652-ee7f-4e28-9c99-55b420e5cef3'] Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 30d26c12-1d23-4606-afbe-570693bf81d3 does not exist Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1de6b652-ee7f-4e28-9c99-55b420e5cef3'] Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 30d26c12-1d23-4606-afbe-570693bf81d3 does not exist Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1de6b652-ee7f-4e28-9c99-55b420e5cef3'] Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 30d26c12-1d23-4606-afbe-570693bf81d3 does not exist Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1de6b652-ee7f-4e28-9c99-55b420e5cef3'] Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f982ab2b-4b9c-4823-b4fb-5f9b15ec81c4 tempest-SecurityGroupsNegativeTestJSON-1623494284 tempest-SecurityGroupsNegativeTestJSON-1623494284-project] Returning 404 to user: Security group 30d26c12-1d23-4606-afbe-570693bf81d3 does not exist Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-1de6b652-ee7f-4e28-9c99-55b420e5cef3'] {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f982ab2b-4b9c-4823-b4fb-5f9b15ec81c4 tempest-SecurityGroupsNegativeTestJSON-1623494284 tempest-SecurityGroupsNegativeTestJSON-1623494284-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/30d26c12-1d23-4606-afbe-570693bf81d3" status: 404 len: 194 microversion: 2.1 time: 0.043698 Oct 05 02:47:28.635255 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2135/4232] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 5 02:47:28 2022] GET /compute/v2.1/os-security-groups/30d26c12-1d23-4606-afbe-570693bf81d3 => generated 194 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:47:28.641378 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-648d4cc3-db10-4610-95c0-42d4466afcb5 tempest-SecurityGroupsNegativeTestJSON-1623494284 tempest-SecurityGroupsNegativeTestJSON-1623494284-project] Action: 'update', calling method: .version_select at 0x7fcce418ae50>, body: {"security_group": {"name": "tempest-sg-1038512074", "description": "tempest-description-1913381445"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:28.722706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6045aa18-c51c-4012-af10-2327b71f71da tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:28.739357 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6045aa18-c51c-4012-af10-2327b71f71da tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.337112 Oct 05 02:47:28.745352 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2098/4233] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:28 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:28.768835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG neutronclient.v2_0.client [None req-648d4cc3-db10-4610-95c0-42d4466afcb5 tempest-SecurityGroupsNegativeTestJSON-1623494284 tempest-SecurityGroupsNegativeTestJSON-1623494284-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4f86d6a2-cc81-4f38-90c8-efcd3bb8e46c does not exist", "detail": ""}} {{(pid=122320) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 02:47:28.769478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.security_group_api [None req-648d4cc3-db10-4610-95c0-42d4466afcb5 tempest-SecurityGroupsNegativeTestJSON-1623494284 tempest-SecurityGroupsNegativeTestJSON-1623494284-project] Neutron security group 4f86d6a2-cc81-4f38-90c8-efcd3bb8e46c not found {{(pid=122320) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 05 02:47:28.770311 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-648d4cc3-db10-4610-95c0-42d4466afcb5 tempest-SecurityGroupsNegativeTestJSON-1623494284 tempest-SecurityGroupsNegativeTestJSON-1623494284-project] HTTP exception thrown: Security group 4f86d6a2-cc81-4f38-90c8-efcd3bb8e46c does not exist Oct 05 02:47:28.770311 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-8ea89884-16bc-48fe-abf9-3f5f1513c8dc'] Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-648d4cc3-db10-4610-95c0-42d4466afcb5 tempest-SecurityGroupsNegativeTestJSON-1623494284 tempest-SecurityGroupsNegativeTestJSON-1623494284-project] Request method failure captured: Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: request: PUT /compute/v2.1/os-security-groups/4f86d6a2-cc81-4f38-90c8-efcd3bb8e46c HTTP/1.1 Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 102 Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPA-LkHE-ysjKBN8vwAa7gEnjaBF4DdM_uiyIW2LHK-YmIUolQ-paU1895EUduSwmC7IRmGKFVBS-M_82T9L1skwuLmcGwt7rWVUEmMAH_B88IHlqGxTxMGogxg1Si0DyLncbMhT2AMAq4hn7mMWIiTnsKKZTdWlfP60dgfIfaLBiB0 Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: afcc750c588548109028bc2cafbad90a Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1623494284 Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/afcc750c588548109028bc2cafbad90a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/afcc750c588548109028bc2cafbad90a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/afcc750c588548109028bc2cafbad90a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_afcc750c588548109028bc2cafbad90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1623494284 Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: afcc750c588548109028bc2cafbad90a Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1623494284 Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-SecurityGroupsNegativeTestJSON-1623494284-project Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 6dfade6ab7784ee8bd06cabbd1eb8c0a Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1623494284-project Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: {"security_group": {"name": "tempest-sg-1038512074", "description": "tempest-description-1913381445"}} Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: exception: Security group 4f86d6a2-cc81-4f38-90c8-efcd3bb8e46c does not exist Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-8ea89884-16bc-48fe-abf9-3f5f1513c8dc'] Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '4f86d6a2-cc81-4f38-90c8-efcd3bb8e46c', 'body': {'security_group': {'name': 'tempest-sg-1038512074', 'description': 'tempest-description-1913381445'}}} Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 02:47:28.772630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4f86d6a2-cc81-4f38-90c8-efcd3bb8e46c does not exist Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ea89884-16bc-48fe-abf9-3f5f1513c8dc'] Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4f86d6a2-cc81-4f38-90c8-efcd3bb8e46c does not exist Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ea89884-16bc-48fe-abf9-3f5f1513c8dc'] Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4f86d6a2-cc81-4f38-90c8-efcd3bb8e46c does not exist Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ea89884-16bc-48fe-abf9-3f5f1513c8dc'] Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4f86d6a2-cc81-4f38-90c8-efcd3bb8e46c does not exist Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ea89884-16bc-48fe-abf9-3f5f1513c8dc'] Oct 05 02:47:28.776608 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:28.780186 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-648d4cc3-db10-4610-95c0-42d4466afcb5 tempest-SecurityGroupsNegativeTestJSON-1623494284 tempest-SecurityGroupsNegativeTestJSON-1623494284-project] Returning 404 to user: Security group 4f86d6a2-cc81-4f38-90c8-efcd3bb8e46c does not exist Oct 05 02:47:28.780186 n-d-858272-3 devstack@n-api.service[122320]: Neutron server returns request_ids: ['req-8ea89884-16bc-48fe-abf9-3f5f1513c8dc'] {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:47:28.780186 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-648d4cc3-db10-4610-95c0-42d4466afcb5 tempest-SecurityGroupsNegativeTestJSON-1623494284 tempest-SecurityGroupsNegativeTestJSON-1623494284-project] 10.222.0.16 "PUT /compute/v2.1/os-security-groups/4f86d6a2-cc81-4f38-90c8-efcd3bb8e46c" status: 404 len: 194 microversion: 2.1 time: 0.142153 Oct 05 02:47:28.780186 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2136/4234] 10.222.0.16 () {60 vars in 1290 bytes} [Wed Oct 5 02:47:28 2022] PUT /compute/v2.1/os-security-groups/4f86d6a2-cc81-4f38-90c8-efcd3bb8e46c => generated 194 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:47:28.791404 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c25b0e68-cb68-4a5b-ae0c-f328e33f71c1 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:28.792026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c25b0e68-cb68-4a5b-ae0c-f328e33f71c1 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:28.814992 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c25b0e68-cb68-4a5b-ae0c-f328e33f71c1 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:28.815485 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c25b0e68-cb68-4a5b-ae0c-f328e33f71c1 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:28.815932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c25b0e68-cb68-4a5b-ae0c-f328e33f71c1 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:28.816920 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c25b0e68-cb68-4a5b-ae0c-f328e33f71c1 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:28.817316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c25b0e68-cb68-4a5b-ae0c-f328e33f71c1 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:28.817752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c25b0e68-cb68-4a5b-ae0c-f328e33f71c1 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:28.895254 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-3c8c4494-5a4b-484c-b6e9-82e7bc3c9e5f req-8e2b0bb0-7d17-4a3d-ad94-a7ffe76fc3b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a710dba5-18ef-4840-835b-06b1fc2bde87", "tag": "07524a96-4932-40f9-b62e-ec594f3e7266"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:28.918187 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-3c8c4494-5a4b-484c-b6e9-82e7bc3c9e5f req-8e2b0bb0-7d17-4a3d-ad94-a7ffe76fc3b5 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:28.919203 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-3c8c4494-5a4b-484c-b6e9-82e7bc3c9e5f req-8e2b0bb0-7d17-4a3d-ad94-a7ffe76fc3b5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:28.919694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-3c8c4494-5a4b-484c-b6e9-82e7bc3c9e5f req-8e2b0bb0-7d17-4a3d-ad94-a7ffe76fc3b5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:28.946876 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-3c8c4494-5a4b-484c-b6e9-82e7bc3c9e5f req-8e2b0bb0-7d17-4a3d-ad94-a7ffe76fc3b5 service nova] Creating event network-changed:07524a96-4932-40f9-b62e-ec594f3e7266 for instance a710dba5-18ef-4840-835b-06b1fc2bde87 on n-h1-858272-3 Oct 05 02:47:28.960999 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-3c8c4494-5a4b-484c-b6e9-82e7bc3c9e5f req-8e2b0bb0-7d17-4a3d-ad94-a7ffe76fc3b5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214002 Oct 05 02:47:28.961924 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2099/4235] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:47:28.973024 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-227e4319-ab90-4697-8a4b-bf2ec61eac95 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:28.978698 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-227e4319-ab90-4697-8a4b-bf2ec61eac95 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:28.995262 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-227e4319-ab90-4697-8a4b-bf2ec61eac95 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:28.996080 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-227e4319-ab90-4697-8a4b-bf2ec61eac95 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:28.997352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-227e4319-ab90-4697-8a4b-bf2ec61eac95 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:29.000527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-227e4319-ab90-4697-8a4b-bf2ec61eac95 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:29.003879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-227e4319-ab90-4697-8a4b-bf2ec61eac95 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:29.004529 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-227e4319-ab90-4697-8a4b-bf2ec61eac95 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:30.115010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c25b0e68-cb68-4a5b-ae0c-f328e33f71c1 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:30.129250 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c25b0e68-cb68-4a5b-ae0c-f328e33f71c1 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1485 microversion: 2.1 time: 1.347706 Oct 05 02:47:30.147344 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2137/4236] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:28 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1485 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:30.154291 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dfa33769-f8cb-496b-abf4-b5d4eb1df6ec tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:30.154906 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dfa33769-f8cb-496b-abf4-b5d4eb1df6ec tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:30.185309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfa33769-f8cb-496b-abf4-b5d4eb1df6ec tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:30.186530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfa33769-f8cb-496b-abf4-b5d4eb1df6ec tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:30.187094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfa33769-f8cb-496b-abf4-b5d4eb1df6ec tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:30.190395 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfa33769-f8cb-496b-abf4-b5d4eb1df6ec tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:30.193309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfa33769-f8cb-496b-abf4-b5d4eb1df6ec tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:30.194031 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfa33769-f8cb-496b-abf4-b5d4eb1df6ec tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:30.400888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-227e4319-ab90-4697-8a4b-bf2ec61eac95 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:30.414811 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-227e4319-ab90-4697-8a4b-bf2ec61eac95 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 1.445850 Oct 05 02:47:30.419992 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2100/4237] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:28 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:30.426230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b5fd9756-b76b-40ba-8d4d-f58ab267f80b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:30.430525 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b5fd9756-b76b-40ba-8d4d-f58ab267f80b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:30.446433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5fd9756-b76b-40ba-8d4d-f58ab267f80b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:30.447569 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5fd9756-b76b-40ba-8d4d-f58ab267f80b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:30.450032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5fd9756-b76b-40ba-8d4d-f58ab267f80b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:30.451153 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5fd9756-b76b-40ba-8d4d-f58ab267f80b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:30.453421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5fd9756-b76b-40ba-8d4d-f58ab267f80b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:30.455927 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5fd9756-b76b-40ba-8d4d-f58ab267f80b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:31.021305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b5fd9756-b76b-40ba-8d4d-f58ab267f80b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:31.037219 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b5fd9756-b76b-40ba-8d4d-f58ab267f80b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1507 microversion: 2.1 time: 0.615813 Oct 05 02:47:31.038933 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2101/4238] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:30 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1507 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:31.047710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3c6f7393-bb15-453a-9f84-a25e2f5a85fb tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:31.047904 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dfa33769-f8cb-496b-abf4-b5d4eb1df6ec tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:31.048721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3c6f7393-bb15-453a-9f84-a25e2f5a85fb tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:31.060677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dfa33769-f8cb-496b-abf4-b5d4eb1df6ec tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:31.062489 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dfa33769-f8cb-496b-abf4-b5d4eb1df6ec tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:31.063143 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c6f7393-bb15-453a-9f84-a25e2f5a85fb tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:31.063919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c6f7393-bb15-453a-9f84-a25e2f5a85fb tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:31.066236 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dfa33769-f8cb-496b-abf4-b5d4eb1df6ec tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1891 microversion: 2.42 time: 0.917315 Oct 05 02:47:31.068296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c6f7393-bb15-453a-9f84-a25e2f5a85fb tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:31.069415 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c6f7393-bb15-453a-9f84-a25e2f5a85fb tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:31.069827 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2138/4239] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:47:30 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1891 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:47:31.070297 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c6f7393-bb15-453a-9f84-a25e2f5a85fb tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:31.070905 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c6f7393-bb15-453a-9f84-a25e2f5a85fb tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:31.081092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-43eaaf50-22f8-4f77-b23b-b363f9f878be tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:31.081899 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-43eaaf50-22f8-4f77-b23b-b363f9f878be tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:31.096879 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-43eaaf50-22f8-4f77-b23b-b363f9f878be tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:31.100570 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-43eaaf50-22f8-4f77-b23b-b363f9f878be tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:31.101192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-43eaaf50-22f8-4f77-b23b-b363f9f878be tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:31.103515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-43eaaf50-22f8-4f77-b23b-b363f9f878be tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:31.104117 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-43eaaf50-22f8-4f77-b23b-b363f9f878be tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:31.114861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-43eaaf50-22f8-4f77-b23b-b363f9f878be tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:31.232052 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3c6f7393-bb15-453a-9f84-a25e2f5a85fb tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "POST /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827/action" status: 202 len: 0 microversion: 2.1 time: 0.191136 Oct 05 02:47:31.233436 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2102/4240] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:47:31 2022] POST /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:47:31.238000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-43eaaf50-22f8-4f77-b23b-b363f9f878be tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Unlocking {{(pid=122320) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 05 02:47:31.243692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:47:31.245286 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d97f97ee-011c-4105-a1c7-b5f0249331ab tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:31.246013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d97f97ee-011c-4105-a1c7-b5f0249331ab tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:31.268356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d97f97ee-011c-4105-a1c7-b5f0249331ab tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:31.271108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d97f97ee-011c-4105-a1c7-b5f0249331ab tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:31.273815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d97f97ee-011c-4105-a1c7-b5f0249331ab tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:31.274788 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d97f97ee-011c-4105-a1c7-b5f0249331ab tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:31.276329 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d97f97ee-011c-4105-a1c7-b5f0249331ab tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:31.280674 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d97f97ee-011c-4105-a1c7-b5f0249331ab tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:31.295552 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:47:31.359223 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-43eaaf50-22f8-4f77-b23b-b363f9f878be tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action" status: 202 len: 0 microversion: 2.1 time: 0.287506 Oct 05 02:47:31.365634 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2139/4241] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:47:31 2022] POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:47:31.371979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-19252c3f-1438-4d33-af38-42ea76e14e5f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:31.372617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-19252c3f-1438-4d33-af38-42ea76e14e5f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:31.404196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19252c3f-1438-4d33-af38-42ea76e14e5f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:31.412749 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19252c3f-1438-4d33-af38-42ea76e14e5f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:31.413566 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19252c3f-1438-4d33-af38-42ea76e14e5f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:31.414340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19252c3f-1438-4d33-af38-42ea76e14e5f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:31.414830 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19252c3f-1438-4d33-af38-42ea76e14e5f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:31.415282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19252c3f-1438-4d33-af38-42ea76e14e5f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:31.938935 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d97f97ee-011c-4105-a1c7-b5f0249331ab tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:31.954395 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d97f97ee-011c-4105-a1c7-b5f0249331ab tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1493 microversion: 2.1 time: 0.716139 Oct 05 02:47:31.955240 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2103/4242] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:31 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1493 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:31.959969 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-d6c6b8ff-024f-4963-a6ae-2e3d950d4911 req-b90c30c5-9718-44b4-8f4c-868893e01f4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a710dba5-18ef-4840-835b-06b1fc2bde87", "tag": "71f0f4da-1745-4447-9f63-d186fb5b9770"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:31.964847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=4,nova_api:INSERT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:47:31.983810 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d6c6b8ff-024f-4963-a6ae-2e3d950d4911 req-b90c30c5-9718-44b4-8f4c-868893e01f4e service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:31.984300 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d6c6b8ff-024f-4963-a6ae-2e3d950d4911 req-b90c30c5-9718-44b4-8f4c-868893e01f4e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:31.984739 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d6c6b8ff-024f-4963-a6ae-2e3d950d4911 req-b90c30c5-9718-44b4-8f4c-868893e01f4e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:32.019269 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-d6c6b8ff-024f-4963-a6ae-2e3d950d4911 req-b90c30c5-9718-44b4-8f4c-868893e01f4e service nova] Creating event network-changed:71f0f4da-1745-4447-9f63-d186fb5b9770 for instance a710dba5-18ef-4840-835b-06b1fc2bde87 on n-h1-858272-3 Oct 05 02:47:32.024508 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-d6c6b8ff-024f-4963-a6ae-2e3d950d4911 req-b90c30c5-9718-44b4-8f4c-868893e01f4e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067805 Oct 05 02:47:32.025539 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2104/4243] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:47:32.062812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-19252c3f-1438-4d33-af38-42ea76e14e5f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:32.070395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-51c92079-4622-4d86-b12a-747f5a6e7c74 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:32.071109 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-51c92079-4622-4d86-b12a-747f5a6e7c74 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:32.084278 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-19252c3f-1438-4d33-af38-42ea76e14e5f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.717227 Oct 05 02:47:32.088287 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-51c92079-4622-4d86-b12a-747f5a6e7c74 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:32.089501 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2140/4244] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:31 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:32.090828 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-51c92079-4622-4d86-b12a-747f5a6e7c74 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:32.092029 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-51c92079-4622-4d86-b12a-747f5a6e7c74 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:32.092946 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-51c92079-4622-4d86-b12a-747f5a6e7c74 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:32.093559 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-51c92079-4622-4d86-b12a-747f5a6e7c74 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:32.094137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-51c92079-4622-4d86-b12a-747f5a6e7c74 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:32.110811 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8c82b97e-d8b0-4e7c-a7a8-8e2c67749461 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:32.111444 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8c82b97e-d8b0-4e7c-a7a8-8e2c67749461 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:32.122663 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c82b97e-d8b0-4e7c-a7a8-8e2c67749461 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:32.129680 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c82b97e-d8b0-4e7c-a7a8-8e2c67749461 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:32.130141 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c82b97e-d8b0-4e7c-a7a8-8e2c67749461 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:32.130896 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c82b97e-d8b0-4e7c-a7a8-8e2c67749461 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:32.131362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c82b97e-d8b0-4e7c-a7a8-8e2c67749461 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:32.131796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c82b97e-d8b0-4e7c-a7a8-8e2c67749461 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:32.821216 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-51c92079-4622-4d86-b12a-747f5a6e7c74 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:32.847626 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-51c92079-4622-4d86-b12a-747f5a6e7c74 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1507 microversion: 2.1 time: 0.781323 Oct 05 02:47:32.853231 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2105/4245] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:32 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1507 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:32.862579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-af9dd120-3233-4cc1-8ca1-3230395a4721 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:32.863422 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-af9dd120-3233-4cc1-8ca1-3230395a4721 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:32.891093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af9dd120-3233-4cc1-8ca1-3230395a4721 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:32.896723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af9dd120-3233-4cc1-8ca1-3230395a4721 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:32.897466 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af9dd120-3233-4cc1-8ca1-3230395a4721 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:32.899140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af9dd120-3233-4cc1-8ca1-3230395a4721 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:32.900276 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af9dd120-3233-4cc1-8ca1-3230395a4721 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:32.900917 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af9dd120-3233-4cc1-8ca1-3230395a4721 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:32.970625 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8c82b97e-d8b0-4e7c-a7a8-8e2c67749461 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:33.023501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8c82b97e-d8b0-4e7c-a7a8-8e2c67749461 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:33.033721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8c82b97e-d8b0-4e7c-a7a8-8e2c67749461 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:33.037860 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8c82b97e-d8b0-4e7c-a7a8-8e2c67749461 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1891 microversion: 2.42 time: 0.935583 Oct 05 02:47:33.041090 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2141/4246] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:47:32 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1891 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:47:33.050896 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d288492f-2201-4df4-ac6b-68fed4666003 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:33.052250 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d288492f-2201-4df4-ac6b-68fed4666003 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:33.061597 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d288492f-2201-4df4-ac6b-68fed4666003 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:33.062332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d288492f-2201-4df4-ac6b-68fed4666003 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:33.063079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d288492f-2201-4df4-ac6b-68fed4666003 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:33.063979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d288492f-2201-4df4-ac6b-68fed4666003 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:33.064604 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d288492f-2201-4df4-ac6b-68fed4666003 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:33.065232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d288492f-2201-4df4-ac6b-68fed4666003 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:33.850291 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d288492f-2201-4df4-ac6b-68fed4666003 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:33.860077 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d288492f-2201-4df4-ac6b-68fed4666003 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1493 microversion: 2.1 time: 0.816590 Oct 05 02:47:33.864806 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2142/4247] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:33 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1493 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:33.870722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-af9dd120-3233-4cc1-8ca1-3230395a4721 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:33.881047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ed8ca9e8-957a-4bcd-b7a7-90e632a1df9d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:33.881731 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ed8ca9e8-957a-4bcd-b7a7-90e632a1df9d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:33.891321 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-af9dd120-3233-4cc1-8ca1-3230395a4721 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 1.035817 Oct 05 02:47:33.891926 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2106/4248] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:32 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:33.920239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-94419c2c-f516-4ab8-b511-5603e7c7152d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:33.923970 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-94419c2c-f516-4ab8-b511-5603e7c7152d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:33.930678 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed8ca9e8-957a-4bcd-b7a7-90e632a1df9d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:33.933697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed8ca9e8-957a-4bcd-b7a7-90e632a1df9d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:33.935834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed8ca9e8-957a-4bcd-b7a7-90e632a1df9d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:33.939977 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94419c2c-f516-4ab8-b511-5603e7c7152d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:33.941075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed8ca9e8-957a-4bcd-b7a7-90e632a1df9d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:33.941764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94419c2c-f516-4ab8-b511-5603e7c7152d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:33.945180 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94419c2c-f516-4ab8-b511-5603e7c7152d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:33.946123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94419c2c-f516-4ab8-b511-5603e7c7152d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:33.946787 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94419c2c-f516-4ab8-b511-5603e7c7152d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:33.947384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94419c2c-f516-4ab8-b511-5603e7c7152d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:33.951475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed8ca9e8-957a-4bcd-b7a7-90e632a1df9d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:33.952109 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed8ca9e8-957a-4bcd-b7a7-90e632a1df9d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:34.307045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-94419c2c-f516-4ab8-b511-5603e7c7152d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:34.321114 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-94419c2c-f516-4ab8-b511-5603e7c7152d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.406514 Oct 05 02:47:34.340874 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2107/4249] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:33 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:34.351477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-e6d5bc28-2819-41e0-a38d-fe53de540e17 req-3cafe6de-1b53-4dc5-95f0-c7f42c85627b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a710dba5-18ef-4840-835b-06b1fc2bde87", "tag": "8a8ea6c2-c534-4a07-92e6-de17c7a31bf2"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:34.362632 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e6d5bc28-2819-41e0-a38d-fe53de540e17 req-3cafe6de-1b53-4dc5-95f0-c7f42c85627b service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:34.363417 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e6d5bc28-2819-41e0-a38d-fe53de540e17 req-3cafe6de-1b53-4dc5-95f0-c7f42c85627b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:34.364026 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e6d5bc28-2819-41e0-a38d-fe53de540e17 req-3cafe6de-1b53-4dc5-95f0-c7f42c85627b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:34.380197 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-e6d5bc28-2819-41e0-a38d-fe53de540e17 req-3cafe6de-1b53-4dc5-95f0-c7f42c85627b service nova] Creating event network-changed:8a8ea6c2-c534-4a07-92e6-de17c7a31bf2 for instance a710dba5-18ef-4840-835b-06b1fc2bde87 on n-h1-858272-3 Oct 05 02:47:34.393113 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ed8ca9e8-957a-4bcd-b7a7-90e632a1df9d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:34.398881 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-e6d5bc28-2819-41e0-a38d-fe53de540e17 req-3cafe6de-1b53-4dc5-95f0-c7f42c85627b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052755 Oct 05 02:47:34.407982 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ed8ca9e8-957a-4bcd-b7a7-90e632a1df9d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1528 microversion: 2.1 time: 0.530994 Oct 05 02:47:34.411264 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2108/4250] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:47:34.414807 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2143/4251] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:33 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1528 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:34.429338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d10f7180-f2bb-4280-9548-77f170290c79 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:34.430892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2c677388-3e2f-48ae-a462-1d3c2902071f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:34.431584 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d10f7180-f2bb-4280-9548-77f170290c79 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:34.432867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2c677388-3e2f-48ae-a462-1d3c2902071f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:34.451727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d10f7180-f2bb-4280-9548-77f170290c79 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:34.453408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d10f7180-f2bb-4280-9548-77f170290c79 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:34.454052 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d10f7180-f2bb-4280-9548-77f170290c79 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:34.454872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c677388-3e2f-48ae-a462-1d3c2902071f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:34.456058 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c677388-3e2f-48ae-a462-1d3c2902071f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:34.456455 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d10f7180-f2bb-4280-9548-77f170290c79 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:34.457121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d10f7180-f2bb-4280-9548-77f170290c79 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:34.457744 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c677388-3e2f-48ae-a462-1d3c2902071f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:34.459328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d10f7180-f2bb-4280-9548-77f170290c79 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:34.461501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c677388-3e2f-48ae-a462-1d3c2902071f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:34.462300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c677388-3e2f-48ae-a462-1d3c2902071f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:34.462959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c677388-3e2f-48ae-a462-1d3c2902071f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:34.600780 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2c677388-3e2f-48ae-a462-1d3c2902071f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action" status: 202 len: 0 microversion: 2.1 time: 0.182494 Oct 05 02:47:34.607802 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2144/4252] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:47:34 2022] POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:47:34.614254 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7a508786-67ce-44a9-a353-62c5d32d4278 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:34.615276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7a508786-67ce-44a9-a353-62c5d32d4278 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:34.624544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a508786-67ce-44a9-a353-62c5d32d4278 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:34.625544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a508786-67ce-44a9-a353-62c5d32d4278 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:34.626280 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a508786-67ce-44a9-a353-62c5d32d4278 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:34.629068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a508786-67ce-44a9-a353-62c5d32d4278 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:34.630006 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a508786-67ce-44a9-a353-62c5d32d4278 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:34.630872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a508786-67ce-44a9-a353-62c5d32d4278 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:35.077154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d10f7180-f2bb-4280-9548-77f170290c79 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:35.096406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d10f7180-f2bb-4280-9548-77f170290c79 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:35.097226 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7a508786-67ce-44a9-a353-62c5d32d4278 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:35.097881 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d10f7180-f2bb-4280-9548-77f170290c79 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:35.099052 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d10f7180-f2bb-4280-9548-77f170290c79 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1891 microversion: 2.42 time: 0.686428 Oct 05 02:47:35.099617 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2109/4253] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:47:34 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1891 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:47:35.112036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4de2b435-6dcf-4705-9648-5f4603353357 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:35.117278 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4de2b435-6dcf-4705-9648-5f4603353357 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:35.126059 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7a508786-67ce-44a9-a353-62c5d32d4278 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1674 microversion: 2.1 time: 0.516340 Oct 05 02:47:35.134220 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4de2b435-6dcf-4705-9648-5f4603353357 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:35.134992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4de2b435-6dcf-4705-9648-5f4603353357 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:35.135616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4de2b435-6dcf-4705-9648-5f4603353357 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:35.136642 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4de2b435-6dcf-4705-9648-5f4603353357 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:35.137784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4de2b435-6dcf-4705-9648-5f4603353357 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:35.138366 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4de2b435-6dcf-4705-9648-5f4603353357 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:35.142888 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2145/4254] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:34 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1674 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:35.442865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9d4127f7-6f17-47ca-a704-c68ea4c0be68 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:35.443552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9d4127f7-6f17-47ca-a704-c68ea4c0be68 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:35.452881 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d4127f7-6f17-47ca-a704-c68ea4c0be68 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:35.454259 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d4127f7-6f17-47ca-a704-c68ea4c0be68 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:35.455046 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d4127f7-6f17-47ca-a704-c68ea4c0be68 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:35.456057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d4127f7-6f17-47ca-a704-c68ea4c0be68 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:35.456678 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d4127f7-6f17-47ca-a704-c68ea4c0be68 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:35.457349 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d4127f7-6f17-47ca-a704-c68ea4c0be68 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:35.741406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4de2b435-6dcf-4705-9648-5f4603353357 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:35.760115 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4de2b435-6dcf-4705-9648-5f4603353357 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1493 microversion: 2.1 time: 0.659412 Oct 05 02:47:35.761970 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2110/4255] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:35 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1493 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:35.965250 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9d4127f7-6f17-47ca-a704-c68ea4c0be68 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:35.977373 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9d4127f7-6f17-47ca-a704-c68ea4c0be68 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1528 microversion: 2.1 time: 0.534595 Oct 05 02:47:35.977994 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2146/4256] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:35 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1528 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:47:36.035149 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-11eef82c-f739-4e90-8858-66b058eb0f1e req-b6375356-4395-4d2a-b734-a1ea73455a3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "161a6f96-e469-47fd-a72f-df5a05e9a62b", "name": "network-vif-plugged", "status": "completed", "tag": "7d9bdf6d-adf0-4eb9-ab11-e0dc32dd5fa8"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:36.053871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-11eef82c-f739-4e90-8858-66b058eb0f1e req-b6375356-4395-4d2a-b734-a1ea73455a3b service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:36.055345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-11eef82c-f739-4e90-8858-66b058eb0f1e req-b6375356-4395-4d2a-b734-a1ea73455a3b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:36.055800 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-11eef82c-f739-4e90-8858-66b058eb0f1e req-b6375356-4395-4d2a-b734-a1ea73455a3b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:36.083168 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-11eef82c-f739-4e90-8858-66b058eb0f1e req-b6375356-4395-4d2a-b734-a1ea73455a3b service nova] Creating event network-vif-plugged:7d9bdf6d-adf0-4eb9-ab11-e0dc32dd5fa8 for instance 161a6f96-e469-47fd-a72f-df5a05e9a62b on n-h2-858272-3 Oct 05 02:47:36.096078 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-11eef82c-f739-4e90-8858-66b058eb0f1e req-b6375356-4395-4d2a-b734-a1ea73455a3b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203971 Oct 05 02:47:36.099546 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2111/4257] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:47:36.129320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cef3856b-fd56-4266-8206-a0f5dbae58b6 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:36.129991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cef3856b-fd56-4266-8206-a0f5dbae58b6 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:36.138073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cef3856b-fd56-4266-8206-a0f5dbae58b6 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:36.138838 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cef3856b-fd56-4266-8206-a0f5dbae58b6 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:36.139471 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cef3856b-fd56-4266-8206-a0f5dbae58b6 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:36.140349 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cef3856b-fd56-4266-8206-a0f5dbae58b6 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:36.140986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cef3856b-fd56-4266-8206-a0f5dbae58b6 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:36.141592 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cef3856b-fd56-4266-8206-a0f5dbae58b6 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:36.150831 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-56380702-bded-4234-9c0b-ff756f5e427c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:36.151865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-56380702-bded-4234-9c0b-ff756f5e427c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:36.164517 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-56380702-bded-4234-9c0b-ff756f5e427c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:36.169203 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-56380702-bded-4234-9c0b-ff756f5e427c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:36.169818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-56380702-bded-4234-9c0b-ff756f5e427c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:36.170715 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-56380702-bded-4234-9c0b-ff756f5e427c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:36.171330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-56380702-bded-4234-9c0b-ff756f5e427c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:36.173438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-56380702-bded-4234-9c0b-ff756f5e427c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:36.906555 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-56380702-bded-4234-9c0b-ff756f5e427c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:36.916101 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-56380702-bded-4234-9c0b-ff756f5e427c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1654 microversion: 2.1 time: 0.769591 Oct 05 02:47:36.917197 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2112/4258] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:36 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1654 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:47:36.922391 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-064c797b-85da-4c3e-a607-e4db6728f28e req-761bf319-986e-4225-9e37-bb24a49a2da1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a710dba5-18ef-4840-835b-06b1fc2bde87", "tag": "a4b7823b-7c50-4314-99cb-dea5af5cfe33"}, {"name": "network-changed", "server_uuid": "a710dba5-18ef-4840-835b-06b1fc2bde87", "tag": "c6b3e9fb-230c-4ce3-abab-896b74e674ca"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:36.934855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-064c797b-85da-4c3e-a607-e4db6728f28e req-761bf319-986e-4225-9e37-bb24a49a2da1 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:36.935913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-064c797b-85da-4c3e-a607-e4db6728f28e req-761bf319-986e-4225-9e37-bb24a49a2da1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:36.936976 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-064c797b-85da-4c3e-a607-e4db6728f28e req-761bf319-986e-4225-9e37-bb24a49a2da1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:36.949426 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-064c797b-85da-4c3e-a607-e4db6728f28e req-761bf319-986e-4225-9e37-bb24a49a2da1 service nova] Creating event network-changed:a4b7823b-7c50-4314-99cb-dea5af5cfe33 for instance a710dba5-18ef-4840-835b-06b1fc2bde87 on n-h1-858272-3 Oct 05 02:47:36.950725 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-064c797b-85da-4c3e-a607-e4db6728f28e req-761bf319-986e-4225-9e37-bb24a49a2da1 service nova] Creating event network-changed:c6b3e9fb-230c-4ce3-abab-896b74e674ca for instance a710dba5-18ef-4840-835b-06b1fc2bde87 on n-h1-858272-3 Oct 05 02:47:36.956719 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-064c797b-85da-4c3e-a607-e4db6728f28e req-761bf319-986e-4225-9e37-bb24a49a2da1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038200 Oct 05 02:47:36.958042 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2113/4259] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:47:36.964590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cef3856b-fd56-4266-8206-a0f5dbae58b6 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:36.976698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cef3856b-fd56-4266-8206-a0f5dbae58b6 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:36.977698 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e88db07a-8c7e-40c5-bb68-8c67c69271fa tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:36.978429 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cef3856b-fd56-4266-8206-a0f5dbae58b6 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:36.979856 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cef3856b-fd56-4266-8206-a0f5dbae58b6 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1879 microversion: 2.42 time: 0.855226 Oct 05 02:47:36.981411 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2147/4260] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:47:36 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1879 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:47:36.983369 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e88db07a-8c7e-40c5-bb68-8c67c69271fa tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:36.987010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6950c344-3a9e-4e0a-9bea-65fc407bd214 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:36.987849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6950c344-3a9e-4e0a-9bea-65fc407bd214 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:36.990321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e88db07a-8c7e-40c5-bb68-8c67c69271fa tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:36.991010 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e88db07a-8c7e-40c5-bb68-8c67c69271fa tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:36.991626 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e88db07a-8c7e-40c5-bb68-8c67c69271fa tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:36.992501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e88db07a-8c7e-40c5-bb68-8c67c69271fa tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:36.993355 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e88db07a-8c7e-40c5-bb68-8c67c69271fa tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:36.994349 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e88db07a-8c7e-40c5-bb68-8c67c69271fa tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:36.999333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6950c344-3a9e-4e0a-9bea-65fc407bd214 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:37.002601 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6950c344-3a9e-4e0a-9bea-65fc407bd214 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:37.005333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6950c344-3a9e-4e0a-9bea-65fc407bd214 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:37.006346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6950c344-3a9e-4e0a-9bea-65fc407bd214 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:37.007329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6950c344-3a9e-4e0a-9bea-65fc407bd214 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:37.011342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6950c344-3a9e-4e0a-9bea-65fc407bd214 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:37.113333 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6950c344-3a9e-4e0a-9bea-65fc407bd214 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action" status: 202 len: 0 microversion: 2.1 time: 0.129303 Oct 05 02:47:37.114623 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2148/4261] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:47:36 2022] POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:47:37.121771 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9086b102-a48a-4236-884b-e91014fa74ff tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:37.123396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9086b102-a48a-4236-884b-e91014fa74ff tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:37.130842 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9086b102-a48a-4236-884b-e91014fa74ff tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:37.131341 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9086b102-a48a-4236-884b-e91014fa74ff tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:37.131777 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9086b102-a48a-4236-884b-e91014fa74ff tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:37.132622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9086b102-a48a-4236-884b-e91014fa74ff tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:37.133100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9086b102-a48a-4236-884b-e91014fa74ff tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:37.133520 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9086b102-a48a-4236-884b-e91014fa74ff tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:37.336159 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e88db07a-8c7e-40c5-bb68-8c67c69271fa tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:37.383117 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e88db07a-8c7e-40c5-bb68-8c67c69271fa tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1499 microversion: 2.1 time: 0.423504 Oct 05 02:47:37.385872 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2114/4262] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:36 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1499 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:37.388870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5ca47f62-a2e1-4cf1-81ed-f36b4394ff77 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:37.389527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5ca47f62-a2e1-4cf1-81ed-f36b4394ff77 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:37.398764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ca47f62-a2e1-4cf1-81ed-f36b4394ff77 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:37.399187 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ca47f62-a2e1-4cf1-81ed-f36b4394ff77 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:37.399637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ca47f62-a2e1-4cf1-81ed-f36b4394ff77 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:37.400360 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ca47f62-a2e1-4cf1-81ed-f36b4394ff77 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:37.400823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ca47f62-a2e1-4cf1-81ed-f36b4394ff77 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:37.409142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ca47f62-a2e1-4cf1-81ed-f36b4394ff77 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:37.465842 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9086b102-a48a-4236-884b-e91014fa74ff tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:37.477876 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9086b102-a48a-4236-884b-e91014fa74ff tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1528 microversion: 2.1 time: 0.361858 Oct 05 02:47:37.479275 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2149/4263] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:37 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1528 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:37.485444 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-02d80c7b-31ac-4126-9a04-89b51f3a61c3 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:37.486278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-02d80c7b-31ac-4126-9a04-89b51f3a61c3 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:37.503929 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02d80c7b-31ac-4126-9a04-89b51f3a61c3 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:37.511209 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02d80c7b-31ac-4126-9a04-89b51f3a61c3 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:37.511827 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02d80c7b-31ac-4126-9a04-89b51f3a61c3 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:37.512880 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02d80c7b-31ac-4126-9a04-89b51f3a61c3 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:37.514155 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02d80c7b-31ac-4126-9a04-89b51f3a61c3 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:37.514893 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02d80c7b-31ac-4126-9a04-89b51f3a61c3 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:37.561203 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-02d80c7b-31ac-4126-9a04-89b51f3a61c3 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:47:37.670146 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5ca47f62-a2e1-4cf1-81ed-f36b4394ff77 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:37.678439 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5ca47f62-a2e1-4cf1-81ed-f36b4394ff77 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.293380 Oct 05 02:47:37.682693 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2115/4264] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:37 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:37.704285 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-02d80c7b-31ac-4126-9a04-89b51f3a61c3 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 204 len: 0 microversion: 2.1 time: 0.222668 Oct 05 02:47:37.706202 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2150/4265] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:47:37 2022] DELETE /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:47:37.706936 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6f702f57-0913-4b19-bd31-19d134ec7177 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:37.707626 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6f702f57-0913-4b19-bd31-19d134ec7177 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:37.714593 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-abbf779e-3275-47b1-a42c-0ba7497af933 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:37.715837 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-abbf779e-3275-47b1-a42c-0ba7497af933 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:37.717377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f702f57-0913-4b19-bd31-19d134ec7177 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:37.717991 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f702f57-0913-4b19-bd31-19d134ec7177 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:37.718326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f702f57-0913-4b19-bd31-19d134ec7177 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:37.719055 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f702f57-0913-4b19-bd31-19d134ec7177 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:37.719521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f702f57-0913-4b19-bd31-19d134ec7177 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:37.721081 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f702f57-0913-4b19-bd31-19d134ec7177 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:37.724707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-abbf779e-3275-47b1-a42c-0ba7497af933 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:37.725470 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-abbf779e-3275-47b1-a42c-0ba7497af933 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:37.726199 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-abbf779e-3275-47b1-a42c-0ba7497af933 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:37.727221 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-abbf779e-3275-47b1-a42c-0ba7497af933 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:37.728094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-abbf779e-3275-47b1-a42c-0ba7497af933 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:37.728820 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-abbf779e-3275-47b1-a42c-0ba7497af933 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:37.759810 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:47:38.140142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6f702f57-0913-4b19-bd31-19d134ec7177 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:38.145520 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-abbf779e-3275-47b1-a42c-0ba7497af933 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:38.151046 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6f702f57-0913-4b19-bd31-19d134ec7177 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.448695 Oct 05 02:47:38.152481 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2116/4266] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:37 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:38.153650 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-abbf779e-3275-47b1-a42c-0ba7497af933 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1505 microversion: 2.1 time: 0.443454 Oct 05 02:47:38.158149 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-37906528-f4f7-4f12-b396-71a99a7861fd tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:38.158836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-37906528-f4f7-4f12-b396-71a99a7861fd tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:38.165335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37906528-f4f7-4f12-b396-71a99a7861fd tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:38.166639 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37906528-f4f7-4f12-b396-71a99a7861fd tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:38.167299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37906528-f4f7-4f12-b396-71a99a7861fd tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:38.168762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37906528-f4f7-4f12-b396-71a99a7861fd tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:38.169320 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2151/4267] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:37 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1505 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:38.170052 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37906528-f4f7-4f12-b396-71a99a7861fd tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:38.170710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37906528-f4f7-4f12-b396-71a99a7861fd tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:38.183455 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d23726ea-448a-4887-9cf2-5bdd06d001cf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:38.185387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d23726ea-448a-4887-9cf2-5bdd06d001cf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:38.192645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d23726ea-448a-4887-9cf2-5bdd06d001cf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:38.193511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d23726ea-448a-4887-9cf2-5bdd06d001cf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:38.194128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d23726ea-448a-4887-9cf2-5bdd06d001cf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:38.195012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d23726ea-448a-4887-9cf2-5bdd06d001cf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:38.195630 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d23726ea-448a-4887-9cf2-5bdd06d001cf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:38.196215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d23726ea-448a-4887-9cf2-5bdd06d001cf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:38.507333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d23726ea-448a-4887-9cf2-5bdd06d001cf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:38.515813 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d23726ea-448a-4887-9cf2-5bdd06d001cf tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.336571 Oct 05 02:47:38.516889 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2152/4268] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:38 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:47:38.521881 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-84bda774-7452-4d80-b9b7-df26450f6c9d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:38.522698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-84bda774-7452-4d80-b9b7-df26450f6c9d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:38.529159 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-37906528-f4f7-4f12-b396-71a99a7861fd tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:38.533740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84bda774-7452-4d80-b9b7-df26450f6c9d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:38.534264 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84bda774-7452-4d80-b9b7-df26450f6c9d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:38.534697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84bda774-7452-4d80-b9b7-df26450f6c9d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:38.536487 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84bda774-7452-4d80-b9b7-df26450f6c9d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:38.537287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84bda774-7452-4d80-b9b7-df26450f6c9d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:38.537884 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84bda774-7452-4d80-b9b7-df26450f6c9d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:38.541633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-37906528-f4f7-4f12-b396-71a99a7861fd tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:38.544285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-37906528-f4f7-4f12-b396-71a99a7861fd tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:38.545843 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-37906528-f4f7-4f12-b396-71a99a7861fd tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1879 microversion: 2.42 time: 0.391891 Oct 05 02:47:38.546424 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2117/4269] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:47:38 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1879 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:47:38.551974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cfea1973-2989-4efc-9531-7ce8b9ea8e54 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:38.552825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cfea1973-2989-4efc-9531-7ce8b9ea8e54 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:38.559852 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cfea1973-2989-4efc-9531-7ce8b9ea8e54 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:38.560611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cfea1973-2989-4efc-9531-7ce8b9ea8e54 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:38.561266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cfea1973-2989-4efc-9531-7ce8b9ea8e54 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:38.562155 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cfea1973-2989-4efc-9531-7ce8b9ea8e54 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:38.562772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cfea1973-2989-4efc-9531-7ce8b9ea8e54 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:38.563509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cfea1973-2989-4efc-9531-7ce8b9ea8e54 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:38.788304 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-84bda774-7452-4d80-b9b7-df26450f6c9d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:38.796988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cfea1973-2989-4efc-9531-7ce8b9ea8e54 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:38.799744 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-84bda774-7452-4d80-b9b7-df26450f6c9d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1528 microversion: 2.1 time: 0.281501 Oct 05 02:47:38.806236 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cfea1973-2989-4efc-9531-7ce8b9ea8e54 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.258344 Oct 05 02:47:38.807198 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2118/4270] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:38 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:38.811604 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2153/4271] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:38 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1528 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:38.842512 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a90a4d0f-7b20-4e21-aff2-6598a73afd68 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:38.843862 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a90a4d0f-7b20-4e21-aff2-6598a73afd68 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:38.856983 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a90a4d0f-7b20-4e21-aff2-6598a73afd68 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:38.857491 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a90a4d0f-7b20-4e21-aff2-6598a73afd68 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:38.857941 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a90a4d0f-7b20-4e21-aff2-6598a73afd68 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:38.858679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a90a4d0f-7b20-4e21-aff2-6598a73afd68 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:38.859127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a90a4d0f-7b20-4e21-aff2-6598a73afd68 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:38.859550 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a90a4d0f-7b20-4e21-aff2-6598a73afd68 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:39.056930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a90a4d0f-7b20-4e21-aff2-6598a73afd68 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:39.068405 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a90a4d0f-7b20-4e21-aff2-6598a73afd68 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.234052 Oct 05 02:47:39.073895 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2119/4272] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:38 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:39.097988 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3c920300-a7b4-4662-a70c-4e7010e82e1a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:39.098666 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3c920300-a7b4-4662-a70c-4e7010e82e1a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:39.115774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3c920300-a7b4-4662-a70c-4e7010e82e1a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:39.117026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3c920300-a7b4-4662-a70c-4e7010e82e1a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:39.117650 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3c920300-a7b4-4662-a70c-4e7010e82e1a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:39.118561 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3c920300-a7b4-4662-a70c-4e7010e82e1a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:39.123494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3c920300-a7b4-4662-a70c-4e7010e82e1a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:39.124277 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3c920300-a7b4-4662-a70c-4e7010e82e1a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:39.180328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-422fbe9b-a19a-48c6-9f60-ec0d94a0427d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:39.180979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-422fbe9b-a19a-48c6-9f60-ec0d94a0427d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:39.189355 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-422fbe9b-a19a-48c6-9f60-ec0d94a0427d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:39.190388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-422fbe9b-a19a-48c6-9f60-ec0d94a0427d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:39.191399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-422fbe9b-a19a-48c6-9f60-ec0d94a0427d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:39.193534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-422fbe9b-a19a-48c6-9f60-ec0d94a0427d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:39.194708 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-422fbe9b-a19a-48c6-9f60-ec0d94a0427d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:39.195308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-422fbe9b-a19a-48c6-9f60-ec0d94a0427d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:39.602405 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-422fbe9b-a19a-48c6-9f60-ec0d94a0427d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:39.612120 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-422fbe9b-a19a-48c6-9f60-ec0d94a0427d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1505 microversion: 2.1 time: 0.436444 Oct 05 02:47:39.618590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3c920300-a7b4-4662-a70c-4e7010e82e1a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:39.625579 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2120/4273] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:39 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1505 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:39.631211 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3f9b68bb-2c39-4a5b-b96d-6dc3564d5b9f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:39.636495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3f9b68bb-2c39-4a5b-b96d-6dc3564d5b9f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:39.648744 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3c920300-a7b4-4662-a70c-4e7010e82e1a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.554431 Oct 05 02:47:39.649903 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2154/4274] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:39 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:39.676931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f9b68bb-2c39-4a5b-b96d-6dc3564d5b9f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:39.683894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f9b68bb-2c39-4a5b-b96d-6dc3564d5b9f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:39.686515 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f9b68bb-2c39-4a5b-b96d-6dc3564d5b9f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:39.690053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f9b68bb-2c39-4a5b-b96d-6dc3564d5b9f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:39.690557 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f9b68bb-2c39-4a5b-b96d-6dc3564d5b9f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:39.691039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f9b68bb-2c39-4a5b-b96d-6dc3564d5b9f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:39.823074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6be0cd98-25ba-4f7d-8c26-a05a76620214 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:39.825200 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6be0cd98-25ba-4f7d-8c26-a05a76620214 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:39.842323 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6be0cd98-25ba-4f7d-8c26-a05a76620214 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:39.849671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6be0cd98-25ba-4f7d-8c26-a05a76620214 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:39.851938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6be0cd98-25ba-4f7d-8c26-a05a76620214 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:39.853770 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6be0cd98-25ba-4f7d-8c26-a05a76620214 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:39.855000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6be0cd98-25ba-4f7d-8c26-a05a76620214 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:39.855526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6be0cd98-25ba-4f7d-8c26-a05a76620214 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:40.128396 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3f9b68bb-2c39-4a5b-b96d-6dc3564d5b9f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:40.140822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3f9b68bb-2c39-4a5b-b96d-6dc3564d5b9f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:40.144139 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3f9b68bb-2c39-4a5b-b96d-6dc3564d5b9f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:40.145734 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3f9b68bb-2c39-4a5b-b96d-6dc3564d5b9f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1879 microversion: 2.42 time: 0.518937 Oct 05 02:47:40.146326 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2121/4275] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:47:39 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1879 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:47:40.167580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6be0cd98-25ba-4f7d-8c26-a05a76620214 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:40.176885 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6be0cd98-25ba-4f7d-8c26-a05a76620214 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1528 microversion: 2.1 time: 0.358301 Oct 05 02:47:40.177488 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2155/4276] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:39 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1528 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:47:40.653419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-066a1135-23bf-410f-8bdf-2ee98dac3090 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:40.653419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-066a1135-23bf-410f-8bdf-2ee98dac3090 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:40.666442 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-066a1135-23bf-410f-8bdf-2ee98dac3090 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:40.667758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-066a1135-23bf-410f-8bdf-2ee98dac3090 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:40.668724 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-066a1135-23bf-410f-8bdf-2ee98dac3090 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:40.669598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-066a1135-23bf-410f-8bdf-2ee98dac3090 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:40.674695 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-066a1135-23bf-410f-8bdf-2ee98dac3090 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:40.675214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-066a1135-23bf-410f-8bdf-2ee98dac3090 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:40.692404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:47:41.097549 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-066a1135-23bf-410f-8bdf-2ee98dac3090 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:41.119438 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-066a1135-23bf-410f-8bdf-2ee98dac3090 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1505 microversion: 2.1 time: 0.472992 Oct 05 02:47:41.120972 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2122/4277] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:40 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1505 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:41.178136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ca07171d-8cd0-4509-bd05-50661e0c0ee0 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:41.180129 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ca07171d-8cd0-4509-bd05-50661e0c0ee0 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:41.192729 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca07171d-8cd0-4509-bd05-50661e0c0ee0 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:41.193630 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca07171d-8cd0-4509-bd05-50661e0c0ee0 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:41.194315 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca07171d-8cd0-4509-bd05-50661e0c0ee0 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:41.195217 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca07171d-8cd0-4509-bd05-50661e0c0ee0 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:41.207374 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-92a4f1db-6429-4788-b889-c831912d83f8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:41.209389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-92a4f1db-6429-4788-b889-c831912d83f8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:41.216375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca07171d-8cd0-4509-bd05-50661e0c0ee0 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:41.217283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92a4f1db-6429-4788-b889-c831912d83f8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:41.217608 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca07171d-8cd0-4509-bd05-50661e0c0ee0 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:41.218471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92a4f1db-6429-4788-b889-c831912d83f8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:41.219120 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92a4f1db-6429-4788-b889-c831912d83f8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:41.220297 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92a4f1db-6429-4788-b889-c831912d83f8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:41.221006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92a4f1db-6429-4788-b889-c831912d83f8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:41.221641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92a4f1db-6429-4788-b889-c831912d83f8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:41.805321 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ca07171d-8cd0-4509-bd05-50661e0c0ee0 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:41.814678 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ca07171d-8cd0-4509-bd05-50661e0c0ee0 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:41.826875 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ca07171d-8cd0-4509-bd05-50661e0c0ee0 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:41.828078 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ca07171d-8cd0-4509-bd05-50661e0c0ee0 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1879 microversion: 2.42 time: 0.658503 Oct 05 02:47:41.841004 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2156/4278] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:47:41 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1879 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:47:41.841452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-92a4f1db-6429-4788-b889-c831912d83f8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:41.848935 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-92a4f1db-6429-4788-b889-c831912d83f8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1528 microversion: 2.1 time: 0.650090 Oct 05 02:47:41.851444 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2123/4279] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:41 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1528 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:42.144393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6e61aef9-1bd1-459b-ae8b-b4bd0a0710a4 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:42.145048 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6e61aef9-1bd1-459b-ae8b-b4bd0a0710a4 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:42.161985 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e61aef9-1bd1-459b-ae8b-b4bd0a0710a4 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:42.162327 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e61aef9-1bd1-459b-ae8b-b4bd0a0710a4 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:42.162816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e61aef9-1bd1-459b-ae8b-b4bd0a0710a4 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:42.163536 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e61aef9-1bd1-459b-ae8b-b4bd0a0710a4 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:42.163992 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e61aef9-1bd1-459b-ae8b-b4bd0a0710a4 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:42.164416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e61aef9-1bd1-459b-ae8b-b4bd0a0710a4 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:42.295134 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6e61aef9-1bd1-459b-ae8b-b4bd0a0710a4 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:42.303860 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6e61aef9-1bd1-459b-ae8b-b4bd0a0710a4 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 200 len: 1463 microversion: 2.1 time: 0.163386 Oct 05 02:47:42.304313 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2157/4280] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:42 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 1463 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:42.802407 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-f6b34d41-f591-4076-b007-816f7b4031db req-350a3bb3-d3ee-491e-a4d8-f8e35c776255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a9c787b-50d1-4c8b-bb14-6eccdfcad827", "name": "network-vif-deleted", "tag": "db6b304e-8f4d-4073-9fd4-9f4927ee4358"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:42.831398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f6b34d41-f591-4076-b007-816f7b4031db req-350a3bb3-d3ee-491e-a4d8-f8e35c776255 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:42.831889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f6b34d41-f591-4076-b007-816f7b4031db req-350a3bb3-d3ee-491e-a4d8-f8e35c776255 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:42.832321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f6b34d41-f591-4076-b007-816f7b4031db req-350a3bb3-d3ee-491e-a4d8-f8e35c776255 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:42.858996 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-05f0c39c-3465-45c8-bbd7-106ae53b5c6e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:42.859614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-05f0c39c-3465-45c8-bbd7-106ae53b5c6e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:42.868101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-05f0c39c-3465-45c8-bbd7-106ae53b5c6e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:42.868573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-05f0c39c-3465-45c8-bbd7-106ae53b5c6e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:42.875678 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-05f0c39c-3465-45c8-bbd7-106ae53b5c6e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:42.876508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-05f0c39c-3465-45c8-bbd7-106ae53b5c6e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:42.879964 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-f6b34d41-f591-4076-b007-816f7b4031db req-350a3bb3-d3ee-491e-a4d8-f8e35c776255 service nova] Creating event network-vif-deleted:db6b304e-8f4d-4073-9fd4-9f4927ee4358 for instance 4a9c787b-50d1-4c8b-bb14-6eccdfcad827 on n-h2-858272-3 Oct 05 02:47:42.885089 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-05f0c39c-3465-45c8-bbd7-106ae53b5c6e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:42.885853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-05f0c39c-3465-45c8-bbd7-106ae53b5c6e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:42.894965 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-f6b34d41-f591-4076-b007-816f7b4031db req-350a3bb3-d3ee-491e-a4d8-f8e35c776255 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.433465 Oct 05 02:47:42.902510 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2124/4281] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:47:42.908226 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-25116e7c-6687-4f0f-a4b4-958013562725 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:42.908798 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-25116e7c-6687-4f0f-a4b4-958013562725 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:42.925826 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-25116e7c-6687-4f0f-a4b4-958013562725 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:42.926310 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-25116e7c-6687-4f0f-a4b4-958013562725 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:42.926746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-25116e7c-6687-4f0f-a4b4-958013562725 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:42.930681 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-25116e7c-6687-4f0f-a4b4-958013562725 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:42.931220 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-25116e7c-6687-4f0f-a4b4-958013562725 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:42.931664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-25116e7c-6687-4f0f-a4b4-958013562725 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:43.749346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-25116e7c-6687-4f0f-a4b4-958013562725 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:43.773326 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-05f0c39c-3465-45c8-bbd7-106ae53b5c6e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:43.784862 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-05f0c39c-3465-45c8-bbd7-106ae53b5c6e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:43.786883 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-25116e7c-6687-4f0f-a4b4-958013562725 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1523 microversion: 2.1 time: 0.882843 Oct 05 02:47:43.792147 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-05f0c39c-3465-45c8-bbd7-106ae53b5c6e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:43.795023 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-05f0c39c-3465-45c8-bbd7-106ae53b5c6e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1879 microversion: 2.42 time: 0.940152 Oct 05 02:47:43.796572 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2158/4282] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:47:42 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1879 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:47:43.802963 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8ffb7ee9-8eec-4485-8bed-e3f12b568c1d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:43.803787 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8ffb7ee9-8eec-4485-8bed-e3f12b568c1d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: 4a9c787b-50d1-4c8b-bb14-6eccdfcad827] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:43.805327 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2125/4283] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:42 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1523 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:43.811190 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ffb7ee9-8eec-4485-8bed-e3f12b568c1d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:43.811998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ffb7ee9-8eec-4485-8bed-e3f12b568c1d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:43.812748 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ffb7ee9-8eec-4485-8bed-e3f12b568c1d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:43.813678 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ffb7ee9-8eec-4485-8bed-e3f12b568c1d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:43.814339 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ffb7ee9-8eec-4485-8bed-e3f12b568c1d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:43.814972 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ffb7ee9-8eec-4485-8bed-e3f12b568c1d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:43.831587 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-8ffb7ee9-8eec-4485-8bed-e3f12b568c1d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] HTTP exception thrown: Instance 4a9c787b-50d1-4c8b-bb14-6eccdfcad827 could not be found. Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8ffb7ee9-8eec-4485-8bed-e3f12b568c1d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Request method failure captured: Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 HTTP/1.1 Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO_OS4goKDUA3ttBj4g9cHZ0hVexZZiIB6H5oYxxI_7P5dzw9Xv0gd3gkon9qKwmLuajBIqFLy3893M-4w0WhJ_VHiWrmZ_0S3ALiN9ge-Lu0hTXM57NABG47isZyr3J24_spJnjxdEvIjzlArxsww6-MMaLCzmUZVEjNSAn4Rbky80 Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 14c9c845b4e04fb09dc03de04a799cf3 Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServerRescueTestJSON-1620494790 Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/14c9c845b4e04fb09dc03de04a799cf3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/14c9c845b4e04fb09dc03de04a799cf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/14c9c845b4e04fb09dc03de04a799cf3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_14c9c845b4e04fb09dc03de04a799cf3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServerRescueTestJSON-1620494790 Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 14c9c845b4e04fb09dc03de04a799cf3 Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServerRescueTestJSON-1620494790 Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServerRescueTestJSON-1620494790-project Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 27a14e4e71454d18946512dedba312a0 Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServerRescueTestJSON-1620494790-project Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 4a9c787b-50d1-4c8b-bb14-6eccdfcad827 could not be found. Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '4a9c787b-50d1-4c8b-bb14-6eccdfcad827'} Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a9c787b-50d1-4c8b-bb14-6eccdfcad827 could not be found. Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a9c787b-50d1-4c8b-bb14-6eccdfcad827 could not be found. Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:47:43.833660 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:43.838394 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:47:43.838394 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:47:43.838394 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:47:43.838394 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:47:43.838394 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:47:43.838394 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a9c787b-50d1-4c8b-bb14-6eccdfcad827 could not be found. Oct 05 02:47:43.838394 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:47:43.839332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8ffb7ee9-8eec-4485-8bed-e3f12b568c1d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Returning 404 to user: Instance 4a9c787b-50d1-4c8b-bb14-6eccdfcad827 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:47:43.839667 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8ffb7ee9-8eec-4485-8bed-e3f12b568c1d tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827" status: 404 len: 111 microversion: 2.1 time: 0.041936 Oct 05 02:47:43.842282 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2159/4284] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:43 2022] GET /compute/v2.1/servers/4a9c787b-50d1-4c8b-bb14-6eccdfcad827 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:47:43.850370 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d1458f43-c790-4ae5-9027-f4f0772a40ba tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:43.850881 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d1458f43-c790-4ae5-9027-f4f0772a40ba tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:43.858691 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d1458f43-c790-4ae5-9027-f4f0772a40ba tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:43.859424 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d1458f43-c790-4ae5-9027-f4f0772a40ba tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:43.859874 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d1458f43-c790-4ae5-9027-f4f0772a40ba tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:43.860726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d1458f43-c790-4ae5-9027-f4f0772a40ba tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:43.861242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d1458f43-c790-4ae5-9027-f4f0772a40ba tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:43.861672 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d1458f43-c790-4ae5-9027-f4f0772a40ba tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:43.893518 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d1458f43-c790-4ae5-9027-f4f0772a40ba tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:47:44.027487 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d1458f43-c790-4ae5-9027-f4f0772a40ba tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59" status: 204 len: 0 microversion: 2.1 time: 0.180433 Oct 05 02:47:44.028950 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2126/4285] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:47:43 2022] DELETE /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:47:44.047438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-54f7181d-a2b3-4e11-9012-21bea92d2113 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:44.047838 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-54f7181d-a2b3-4e11-9012-21bea92d2113 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:44.059464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54f7181d-a2b3-4e11-9012-21bea92d2113 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:44.060014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54f7181d-a2b3-4e11-9012-21bea92d2113 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:44.060658 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54f7181d-a2b3-4e11-9012-21bea92d2113 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:44.061409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54f7181d-a2b3-4e11-9012-21bea92d2113 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:44.061869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54f7181d-a2b3-4e11-9012-21bea92d2113 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:44.062381 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54f7181d-a2b3-4e11-9012-21bea92d2113 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:44.246853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-54f7181d-a2b3-4e11-9012-21bea92d2113 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:44.259367 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-54f7181d-a2b3-4e11-9012-21bea92d2113 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59" status: 200 len: 1493 microversion: 2.1 time: 0.220060 Oct 05 02:47:44.262448 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2160/4286] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:44 2022] GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59 => generated 1493 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:44.820103 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c0f153a3-e546-48c6-8fd0-2e8024c09e9a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:44.822664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c0f153a3-e546-48c6-8fd0-2e8024c09e9a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:44.829284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4d98ba67-29ad-45d2-96a0-d725bc268d7c tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:44.830027 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4d98ba67-29ad-45d2-96a0-d725bc268d7c tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:44.837062 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c0f153a3-e546-48c6-8fd0-2e8024c09e9a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:44.837661 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c0f153a3-e546-48c6-8fd0-2e8024c09e9a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:44.838184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c0f153a3-e546-48c6-8fd0-2e8024c09e9a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:44.841898 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c0f153a3-e546-48c6-8fd0-2e8024c09e9a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:44.842088 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d98ba67-29ad-45d2-96a0-d725bc268d7c tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:44.842653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c0f153a3-e546-48c6-8fd0-2e8024c09e9a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:44.843161 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c0f153a3-e546-48c6-8fd0-2e8024c09e9a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:44.843972 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d98ba67-29ad-45d2-96a0-d725bc268d7c tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:44.844725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d98ba67-29ad-45d2-96a0-d725bc268d7c tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:44.848495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d98ba67-29ad-45d2-96a0-d725bc268d7c tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:44.849213 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d98ba67-29ad-45d2-96a0-d725bc268d7c tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:44.852405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d98ba67-29ad-45d2-96a0-d725bc268d7c tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:45.514285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4d98ba67-29ad-45d2-96a0-d725bc268d7c tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:45.532362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4d98ba67-29ad-45d2-96a0-d725bc268d7c tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:45.536673 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4d98ba67-29ad-45d2-96a0-d725bc268d7c tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:45.540919 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4d98ba67-29ad-45d2-96a0-d725bc268d7c tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1879 microversion: 2.42 time: 0.717804 Oct 05 02:47:45.542479 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2161/4287] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:47:44 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1879 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:47:45.554173 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b7159c37-8eec-4ba2-a19c-833502781ab6 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:45.557460 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b7159c37-8eec-4ba2-a19c-833502781ab6 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:45.573209 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b7159c37-8eec-4ba2-a19c-833502781ab6 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:45.573728 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b7159c37-8eec-4ba2-a19c-833502781ab6 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:45.574180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b7159c37-8eec-4ba2-a19c-833502781ab6 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:45.576974 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b7159c37-8eec-4ba2-a19c-833502781ab6 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:45.578432 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b7159c37-8eec-4ba2-a19c-833502781ab6 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:45.580134 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b7159c37-8eec-4ba2-a19c-833502781ab6 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:45.630409 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c0f153a3-e546-48c6-8fd0-2e8024c09e9a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:45.673338 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c0f153a3-e546-48c6-8fd0-2e8024c09e9a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1523 microversion: 2.1 time: 0.828506 Oct 05 02:47:45.691137 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2127/4288] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:44 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1523 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:45.986643 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b7159c37-8eec-4ba2-a19c-833502781ab6 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:45.999041 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b7159c37-8eec-4ba2-a19c-833502781ab6 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59" status: 200 len: 1493 microversion: 2.1 time: 0.454650 Oct 05 02:47:46.019429 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2162/4289] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:45 2022] GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59 => generated 1493 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:46.574385 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-27d1cda8-e906-4f1b-849c-3b4ee392332e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:46.575551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-27d1cda8-e906-4f1b-849c-3b4ee392332e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:46.597231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27d1cda8-e906-4f1b-849c-3b4ee392332e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:46.598136 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27d1cda8-e906-4f1b-849c-3b4ee392332e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:46.600272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27d1cda8-e906-4f1b-849c-3b4ee392332e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:46.601629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27d1cda8-e906-4f1b-849c-3b4ee392332e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:46.602546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27d1cda8-e906-4f1b-849c-3b4ee392332e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:46.603725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27d1cda8-e906-4f1b-849c-3b4ee392332e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:46.705010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a49ab097-2074-47c4-8e77-9c426f4ac2c4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:46.706395 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a49ab097-2074-47c4-8e77-9c426f4ac2c4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:46.725203 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a49ab097-2074-47c4-8e77-9c426f4ac2c4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:46.725998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a49ab097-2074-47c4-8e77-9c426f4ac2c4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:46.726617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a49ab097-2074-47c4-8e77-9c426f4ac2c4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:46.727559 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a49ab097-2074-47c4-8e77-9c426f4ac2c4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:46.728173 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a49ab097-2074-47c4-8e77-9c426f4ac2c4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:46.728755 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a49ab097-2074-47c4-8e77-9c426f4ac2c4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:47.466086 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-27d1cda8-e906-4f1b-849c-3b4ee392332e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:47.482675 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-27d1cda8-e906-4f1b-849c-3b4ee392332e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:47.486778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-27d1cda8-e906-4f1b-849c-3b4ee392332e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:47.488725 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-27d1cda8-e906-4f1b-849c-3b4ee392332e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1879 microversion: 2.42 time: 0.921267 Oct 05 02:47:47.489848 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2128/4290] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:47:46 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1879 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:47:47.496015 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0da0d899-03f5-4d56-bd77-e5f7cbbfbde2 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:47.497762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0da0d899-03f5-4d56-bd77-e5f7cbbfbde2 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:47.505877 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0da0d899-03f5-4d56-bd77-e5f7cbbfbde2 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:47.506619 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0da0d899-03f5-4d56-bd77-e5f7cbbfbde2 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:47.507250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0da0d899-03f5-4d56-bd77-e5f7cbbfbde2 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:47.508657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0da0d899-03f5-4d56-bd77-e5f7cbbfbde2 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:47.509306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0da0d899-03f5-4d56-bd77-e5f7cbbfbde2 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:47.510409 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0da0d899-03f5-4d56-bd77-e5f7cbbfbde2 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:47.521910 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a49ab097-2074-47c4-8e77-9c426f4ac2c4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:47.556443 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a49ab097-2074-47c4-8e77-9c426f4ac2c4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1523 microversion: 2.1 time: 0.855967 Oct 05 02:47:47.559329 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2163/4291] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:46 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1523 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:48.006824 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0da0d899-03f5-4d56-bd77-e5f7cbbfbde2 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:48.021406 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0da0d899-03f5-4d56-bd77-e5f7cbbfbde2 tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59" status: 200 len: 1493 microversion: 2.1 time: 0.526543 Oct 05 02:47:48.023009 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2129/4292] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:47 2022] GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59 => generated 1493 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:48.515977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f5e5d80f-8f22-4bc4-a78a-e77a84b0cdf4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:48.516913 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f5e5d80f-8f22-4bc4-a78a-e77a84b0cdf4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:48.527540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5e5d80f-8f22-4bc4-a78a-e77a84b0cdf4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:48.528733 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5e5d80f-8f22-4bc4-a78a-e77a84b0cdf4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:48.529369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5e5d80f-8f22-4bc4-a78a-e77a84b0cdf4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:48.530277 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5e5d80f-8f22-4bc4-a78a-e77a84b0cdf4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:48.530894 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5e5d80f-8f22-4bc4-a78a-e77a84b0cdf4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:48.531493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5e5d80f-8f22-4bc4-a78a-e77a84b0cdf4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:48.585929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-06070ab0-f4e2-4733-a176-d83f4f974ea6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:48.586630 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-06070ab0-f4e2-4733-a176-d83f4f974ea6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:48.593571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06070ab0-f4e2-4733-a176-d83f4f974ea6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:48.601784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06070ab0-f4e2-4733-a176-d83f4f974ea6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:48.602335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06070ab0-f4e2-4733-a176-d83f4f974ea6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:48.603193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06070ab0-f4e2-4733-a176-d83f4f974ea6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:48.603908 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06070ab0-f4e2-4733-a176-d83f4f974ea6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:48.605095 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06070ab0-f4e2-4733-a176-d83f4f974ea6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:49.118097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f5e5d80f-8f22-4bc4-a78a-e77a84b0cdf4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:49.133339 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f5e5d80f-8f22-4bc4-a78a-e77a84b0cdf4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:49.145293 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f5e5d80f-8f22-4bc4-a78a-e77a84b0cdf4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:49.146781 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f5e5d80f-8f22-4bc4-a78a-e77a84b0cdf4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1879 microversion: 2.42 time: 0.634969 Oct 05 02:47:49.164253 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2164/4293] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:47:48 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1879 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:47:49.182580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-2ef27ce9-d9e5-40f2-a24e-acc92c944122 req-f85728c5-ffb3-4562-b95a-cdeafe365f63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a75e896f-b5a7-47a8-8376-c447c6645f59", "name": "network-vif-deleted", "tag": "d7fbef64-88d7-41be-9f9f-7e6cc11ea6de"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:49.184662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-06070ab0-f4e2-4733-a176-d83f4f974ea6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:49.195056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-2ef27ce9-d9e5-40f2-a24e-acc92c944122 req-f85728c5-ffb3-4562-b95a-cdeafe365f63 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:49.195552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-2ef27ce9-d9e5-40f2-a24e-acc92c944122 req-f85728c5-ffb3-4562-b95a-cdeafe365f63 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:49.196030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-2ef27ce9-d9e5-40f2-a24e-acc92c944122 req-f85728c5-ffb3-4562-b95a-cdeafe365f63 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:49.202961 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-06070ab0-f4e2-4733-a176-d83f4f974ea6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1523 microversion: 2.1 time: 0.621251 Oct 05 02:47:49.210047 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2130/4294] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:48 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1523 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:47:49.222273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e8e4827a-9671-4457-b717-fb439ef6b81c tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:49.227630 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e8e4827a-9671-4457-b717-fb439ef6b81c tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:49.263493 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-2ef27ce9-d9e5-40f2-a24e-acc92c944122 req-f85728c5-ffb3-4562-b95a-cdeafe365f63 service nova] Creating event network-vif-deleted:d7fbef64-88d7-41be-9f9f-7e6cc11ea6de for instance a75e896f-b5a7-47a8-8376-c447c6645f59 on n-h1-858272-3 Oct 05 02:47:49.271449 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-2ef27ce9-d9e5-40f2-a24e-acc92c944122 req-f85728c5-ffb3-4562-b95a-cdeafe365f63 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100918 Oct 05 02:47:49.275936 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2165/4295] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:47:49.280659 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8e4827a-9671-4457-b717-fb439ef6b81c tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:49.282238 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8e4827a-9671-4457-b717-fb439ef6b81c tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:49.287026 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8e4827a-9671-4457-b717-fb439ef6b81c tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:49.287842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8e4827a-9671-4457-b717-fb439ef6b81c tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:49.288496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8e4827a-9671-4457-b717-fb439ef6b81c tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:49.291236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8e4827a-9671-4457-b717-fb439ef6b81c tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:49.373782 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8e4827a-9671-4457-b717-fb439ef6b81c tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:49.374328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8e4827a-9671-4457-b717-fb439ef6b81c tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:49.375327 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8e4827a-9671-4457-b717-fb439ef6b81c tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:49.375800 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-e8e4827a-9671-4457-b717-fb439ef6b81c tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lazy-loading 'fault' on Instance uuid a75e896f-b5a7-47a8-8376-c447c6645f59 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:47:49.497272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e8e4827a-9671-4457-b717-fb439ef6b81c tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a14e4e71454d18946512dedba312a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c845b4e04fb09dc03de04a799cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:49.510907 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e8e4827a-9671-4457-b717-fb439ef6b81c tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59" status: 200 len: 1304 microversion: 2.1 time: 0.294437 Oct 05 02:47:49.512095 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2131/4296] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:49 2022] GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59 => generated 1304 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:50.185525 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ecd7e7c1-feef-4209-bbc6-90e1f45f3367 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:50.187182 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ecd7e7c1-feef-4209-bbc6-90e1f45f3367 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:50.204763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ecd7e7c1-feef-4209-bbc6-90e1f45f3367 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:50.205379 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ecd7e7c1-feef-4209-bbc6-90e1f45f3367 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:50.206133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ecd7e7c1-feef-4209-bbc6-90e1f45f3367 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:50.207009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ecd7e7c1-feef-4209-bbc6-90e1f45f3367 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:50.208621 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ecd7e7c1-feef-4209-bbc6-90e1f45f3367 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:50.208621 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ecd7e7c1-feef-4209-bbc6-90e1f45f3367 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:50.235351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f10fa6e0-23d9-48c2-aea9-9191ff33474d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:50.242862 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f10fa6e0-23d9-48c2-aea9-9191ff33474d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:50.274172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f10fa6e0-23d9-48c2-aea9-9191ff33474d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:50.279380 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f10fa6e0-23d9-48c2-aea9-9191ff33474d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:50.283599 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f10fa6e0-23d9-48c2-aea9-9191ff33474d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:50.291745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f10fa6e0-23d9-48c2-aea9-9191ff33474d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:50.296302 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f10fa6e0-23d9-48c2-aea9-9191ff33474d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:50.297015 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f10fa6e0-23d9-48c2-aea9-9191ff33474d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:51.627499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f10fa6e0-23d9-48c2-aea9-9191ff33474d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:51.672364 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f10fa6e0-23d9-48c2-aea9-9191ff33474d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1523 microversion: 2.1 time: 1.443226 Oct 05 02:47:51.673242 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2132/4297] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:50 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1523 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:51.675427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ecd7e7c1-feef-4209-bbc6-90e1f45f3367 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:51.693839 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ecd7e7c1-feef-4209-bbc6-90e1f45f3367 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:51.695694 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ecd7e7c1-feef-4209-bbc6-90e1f45f3367 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:51.696746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9af9df34-0007-4594-9f1e-72c43ae1cfcc tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:51.697893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9af9df34-0007-4594-9f1e-72c43ae1cfcc tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] [instance: a75e896f-b5a7-47a8-8376-c447c6645f59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:51.700272 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ecd7e7c1-feef-4209-bbc6-90e1f45f3367 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1879 microversion: 2.42 time: 1.520051 Oct 05 02:47:51.733294 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2166/4298] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:47:50 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1879 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:47:51.734734 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9af9df34-0007-4594-9f1e-72c43ae1cfcc tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:51.735790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9af9df34-0007-4594-9f1e-72c43ae1cfcc tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:51.740058 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9af9df34-0007-4594-9f1e-72c43ae1cfcc tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:51.748998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9af9df34-0007-4594-9f1e-72c43ae1cfcc tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:51.750716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9af9df34-0007-4594-9f1e-72c43ae1cfcc tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:51.751649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9af9df34-0007-4594-9f1e-72c43ae1cfcc tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:51.846959 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-9af9df34-0007-4594-9f1e-72c43ae1cfcc tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] HTTP exception thrown: Instance a75e896f-b5a7-47a8-8376-c447c6645f59 could not be found. Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9af9df34-0007-4594-9f1e-72c43ae1cfcc tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Request method failure captured: Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59 HTTP/1.1 Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO_OS4goKDUA3ttBj4g9cHZ0hVexZZiIB6H5oYxxI_7P5dzw9Xv0gd3gkon9qKwmLuajBIqFLy3893M-4w0WhJ_VHiWrmZ_0S3ALiN9ge-Lu0hTXM57NABG47isZyr3J24_spJnjxdEvIjzlArxsww6-MMaLCzmUZVEjNSAn4Rbky80 Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 14c9c845b4e04fb09dc03de04a799cf3 Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerRescueTestJSON-1620494790 Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/14c9c845b4e04fb09dc03de04a799cf3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/14c9c845b4e04fb09dc03de04a799cf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/14c9c845b4e04fb09dc03de04a799cf3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_14c9c845b4e04fb09dc03de04a799cf3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerRescueTestJSON-1620494790 Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 14c9c845b4e04fb09dc03de04a799cf3 Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerRescueTestJSON-1620494790 Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerRescueTestJSON-1620494790-project Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 27a14e4e71454d18946512dedba312a0 Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerRescueTestJSON-1620494790-project Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance a75e896f-b5a7-47a8-8376-c447c6645f59 could not be found. Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'a75e896f-b5a7-47a8-8376-c447c6645f59'} Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a75e896f-b5a7-47a8-8376-c447c6645f59 could not be found. Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a75e896f-b5a7-47a8-8376-c447c6645f59 could not be found. Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:47:51.848776 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:47:51.855254 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:47:51.855254 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:47:51.855254 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:47:51.855254 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:47:51.855254 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:47:51.855254 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a75e896f-b5a7-47a8-8376-c447c6645f59 could not be found. Oct 05 02:47:51.855254 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:47:51.855254 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9af9df34-0007-4594-9f1e-72c43ae1cfcc tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] Returning 404 to user: Instance a75e896f-b5a7-47a8-8376-c447c6645f59 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:47:51.870403 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9af9df34-0007-4594-9f1e-72c43ae1cfcc tempest-ServerRescueTestJSON-1620494790 tempest-ServerRescueTestJSON-1620494790-project] 10.222.0.16 "GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59" status: 404 len: 111 microversion: 2.1 time: 0.176424 Oct 05 02:47:51.872306 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2133/4299] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:51 2022] GET /compute/v2.1/servers/a75e896f-b5a7-47a8-8376-c447c6645f59 => generated 111 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:47:52.706529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-14eaf2d5-c29d-4212-9d65-68b7773937c1 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:52.707448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-14eaf2d5-c29d-4212-9d65-68b7773937c1 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:52.726091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14eaf2d5-c29d-4212-9d65-68b7773937c1 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:52.726588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14eaf2d5-c29d-4212-9d65-68b7773937c1 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:52.727028 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14eaf2d5-c29d-4212-9d65-68b7773937c1 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:52.727724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14eaf2d5-c29d-4212-9d65-68b7773937c1 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:52.728176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14eaf2d5-c29d-4212-9d65-68b7773937c1 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:52.728592 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14eaf2d5-c29d-4212-9d65-68b7773937c1 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:52.748221 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-75a5cf3d-ec08-4386-9cbd-df77eea58a41 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:52.749467 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-75a5cf3d-ec08-4386-9cbd-df77eea58a41 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:52.781305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75a5cf3d-ec08-4386-9cbd-df77eea58a41 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:52.785117 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75a5cf3d-ec08-4386-9cbd-df77eea58a41 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:52.785783 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75a5cf3d-ec08-4386-9cbd-df77eea58a41 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:52.793665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75a5cf3d-ec08-4386-9cbd-df77eea58a41 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:52.798190 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75a5cf3d-ec08-4386-9cbd-df77eea58a41 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:52.805624 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75a5cf3d-ec08-4386-9cbd-df77eea58a41 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:53.219061 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-14eaf2d5-c29d-4212-9d65-68b7773937c1 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:53.236995 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-14eaf2d5-c29d-4212-9d65-68b7773937c1 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1523 microversion: 2.1 time: 0.534338 Oct 05 02:47:53.238291 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2167/4300] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:52 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1523 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:53.380352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d2b97820-2652-458a-a802-c42231f1b42b tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Action: 'create', calling method: .version_select at 0x7fcce4a9fb80>, body: {"keypair": {"name": "tempest-keypair-961275917", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYAIvLLZMNXbM3ufdp/p/6vpWkiCwcOga0WaHal3K9YNn0vqMXBQYB9b4iSuF/XtZDmzYdZ5cwdIAmjQPx/jOE4bTYCxFY2hcW8onGVFv3fIA1V4f6hok2YAZT70sVCZA=="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:53.427247 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-d2b97820-2652-458a-a802-c42231f1b42b tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Getting quotas for project a2a0fa4883254728921c0c49aa4e60b1. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:47:53.436382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-d2b97820-2652-458a-a802-c42231f1b42b tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Getting quotas for user 569a3db98b7a44aeb902f7956af5a710 and project a2a0fa4883254728921c0c49aa4e60b1. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:47:53.530833 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d2b97820-2652-458a-a802-c42231f1b42b tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.290530 Oct 05 02:47:53.531583 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2168/4301] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 02:47:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:47:53.542036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-75a5cf3d-ec08-4386-9cbd-df77eea58a41 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:53.560242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-75a5cf3d-ec08-4386-9cbd-df77eea58a41 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:53.562040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-75a5cf3d-ec08-4386-9cbd-df77eea58a41 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:53.568471 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-75a5cf3d-ec08-4386-9cbd-df77eea58a41 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1879 microversion: 2.42 time: 0.827102 Oct 05 02:47:53.572380 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2134/4302] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:47:52 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1879 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:47:54.266487 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-07a888a8-3979-4127-824b-489ba9d80f94 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:54.267906 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-07a888a8-3979-4127-824b-489ba9d80f94 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:54.300125 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07a888a8-3979-4127-824b-489ba9d80f94 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:54.300884 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07a888a8-3979-4127-824b-489ba9d80f94 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:54.301544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07a888a8-3979-4127-824b-489ba9d80f94 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:54.302467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07a888a8-3979-4127-824b-489ba9d80f94 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:54.303090 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07a888a8-3979-4127-824b-489ba9d80f94 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:54.305272 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07a888a8-3979-4127-824b-489ba9d80f94 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:54.600076 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fde39ed3-b89b-4ad6-aa7e-62a2cdc45e8d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:54.601641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fde39ed3-b89b-4ad6-aa7e-62a2cdc45e8d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:54.625775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fde39ed3-b89b-4ad6-aa7e-62a2cdc45e8d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:54.627578 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fde39ed3-b89b-4ad6-aa7e-62a2cdc45e8d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:54.628309 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fde39ed3-b89b-4ad6-aa7e-62a2cdc45e8d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:54.634245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fde39ed3-b89b-4ad6-aa7e-62a2cdc45e8d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:54.637513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fde39ed3-b89b-4ad6-aa7e-62a2cdc45e8d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:54.639446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fde39ed3-b89b-4ad6-aa7e-62a2cdc45e8d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:55.006451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fde39ed3-b89b-4ad6-aa7e-62a2cdc45e8d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:55.027528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fde39ed3-b89b-4ad6-aa7e-62a2cdc45e8d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:55.029723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fde39ed3-b89b-4ad6-aa7e-62a2cdc45e8d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:55.031277 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fde39ed3-b89b-4ad6-aa7e-62a2cdc45e8d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1879 microversion: 2.42 time: 0.436160 Oct 05 02:47:55.033159 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2135/4303] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:47:54 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1879 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:47:55.251225 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-07a888a8-3979-4127-824b-489ba9d80f94 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:55.260365 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-07a888a8-3979-4127-824b-489ba9d80f94 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1523 microversion: 2.1 time: 1.000423 Oct 05 02:47:55.282493 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2169/4304] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:54 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1523 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:56.067588 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c532be57-9dda-4e7a-9dfb-11783e12058e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:56.068131 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c532be57-9dda-4e7a-9dfb-11783e12058e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:56.078429 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c532be57-9dda-4e7a-9dfb-11783e12058e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:56.086515 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c532be57-9dda-4e7a-9dfb-11783e12058e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:56.089146 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c532be57-9dda-4e7a-9dfb-11783e12058e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:56.090389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c532be57-9dda-4e7a-9dfb-11783e12058e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:56.097023 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c532be57-9dda-4e7a-9dfb-11783e12058e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:56.097861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c532be57-9dda-4e7a-9dfb-11783e12058e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:56.288160 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-99819526-fd83-4fa2-bf49-f2421ff50d4c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:56.302540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-99819526-fd83-4fa2-bf49-f2421ff50d4c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:56.329780 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99819526-fd83-4fa2-bf49-f2421ff50d4c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:56.331574 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99819526-fd83-4fa2-bf49-f2421ff50d4c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:56.332198 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99819526-fd83-4fa2-bf49-f2421ff50d4c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:56.334034 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99819526-fd83-4fa2-bf49-f2421ff50d4c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:56.337878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99819526-fd83-4fa2-bf49-f2421ff50d4c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:56.341809 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99819526-fd83-4fa2-bf49-f2421ff50d4c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:56.351155 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:47:57.583667 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c532be57-9dda-4e7a-9dfb-11783e12058e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:57.599328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c532be57-9dda-4e7a-9dfb-11783e12058e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:57.602748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c532be57-9dda-4e7a-9dfb-11783e12058e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:57.609197 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c532be57-9dda-4e7a-9dfb-11783e12058e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1879 microversion: 2.42 time: 1.546786 Oct 05 02:47:57.610489 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2136/4305] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:47:56 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1879 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:47:57.673525 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-99819526-fd83-4fa2-bf49-f2421ff50d4c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:57.688119 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-99819526-fd83-4fa2-bf49-f2421ff50d4c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1523 microversion: 2.1 time: 1.404248 Oct 05 02:47:57.694648 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2170/4306] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:56 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1523 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:47:58.115773 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b016d2ab-a60e-4e45-a6cc-b264c4cede17 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:58.116431 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b016d2ab-a60e-4e45-a6cc-b264c4cede17 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: ae8e1003-15ab-4801-a026-e9d80e200d3c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:58.127696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b016d2ab-a60e-4e45-a6cc-b264c4cede17 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:58.130665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b016d2ab-a60e-4e45-a6cc-b264c4cede17 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:58.131418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b016d2ab-a60e-4e45-a6cc-b264c4cede17 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:58.133791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b016d2ab-a60e-4e45-a6cc-b264c4cede17 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:58.134661 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b016d2ab-a60e-4e45-a6cc-b264c4cede17 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:58.136206 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b016d2ab-a60e-4e45-a6cc-b264c4cede17 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:58.198310 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b016d2ab-a60e-4e45-a6cc-b264c4cede17 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c/ips" status: 200 len: 145 microversion: 2.1 time: 0.087897 Oct 05 02:47:58.199215 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2137/4307] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 02:47:58 2022] GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c/ips => generated 145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:47:58.648981 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ec6c8727-4af9-453f-93bf-2b436b2de0ae tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:58.650512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ec6c8727-4af9-453f-93bf-2b436b2de0ae tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:58.654180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:47:58.675370 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec6c8727-4af9-453f-93bf-2b436b2de0ae tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:58.676636 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec6c8727-4af9-453f-93bf-2b436b2de0ae tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:58.677147 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec6c8727-4af9-453f-93bf-2b436b2de0ae tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:58.681474 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec6c8727-4af9-453f-93bf-2b436b2de0ae tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:58.682025 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec6c8727-4af9-453f-93bf-2b436b2de0ae tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:58.686388 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec6c8727-4af9-453f-93bf-2b436b2de0ae tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:58.721161 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-58abd821-7dce-4b18-9e1c-27cf70ab9af9 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:47:58.723241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-58abd821-7dce-4b18-9e1c-27cf70ab9af9 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:47:58.736860 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58abd821-7dce-4b18-9e1c-27cf70ab9af9 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:58.742511 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58abd821-7dce-4b18-9e1c-27cf70ab9af9 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:58.751791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58abd821-7dce-4b18-9e1c-27cf70ab9af9 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:58.753730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58abd821-7dce-4b18-9e1c-27cf70ab9af9 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:47:58.754221 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58abd821-7dce-4b18-9e1c-27cf70ab9af9 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:47:58.759080 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58abd821-7dce-4b18-9e1c-27cf70ab9af9 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:47:59.407655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-58abd821-7dce-4b18-9e1c-27cf70ab9af9 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:59.409963 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:47:59.420117 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-58abd821-7dce-4b18-9e1c-27cf70ab9af9 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1523 microversion: 2.1 time: 0.702671 Oct 05 02:47:59.421204 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2138/4308] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:47:58 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1523 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:47:59.428849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-980e65ae-dac1-41cf-975b-b0266e38aac7 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "9465ae42-2eca-46c1-b5ed-5939b99335d5"}], "security_groups": [{"name": "tempest-securitygroup--2072437277"}], "key_name": "tempest-keypair-961275917", "user_data": "}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:47:59.565144 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ec6c8727-4af9-453f-93bf-2b436b2de0ae tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:59.582250 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ec6c8727-4af9-453f-93bf-2b436b2de0ae tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:59.586099 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ec6c8727-4af9-453f-93bf-2b436b2de0ae tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:47:59.589358 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ec6c8727-4af9-453f-93bf-2b436b2de0ae tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1879 microversion: 2.42 time: 0.950631 Oct 05 02:47:59.591977 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2171/4309] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:47:58 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1879 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:47:59.668667 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-980e65ae-dac1-41cf-975b-b0266e38aac7 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] validate_networks() for [('9465ae42-2eca-46c1-b5ed-5939b99335d5', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:48:00.443886 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bf0a0d76-f3ad-4ffa-9b8e-7bdddce218f5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:00.444555 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bf0a0d76-f3ad-4ffa-9b8e-7bdddce218f5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:00.460746 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf0a0d76-f3ad-4ffa-9b8e-7bdddce218f5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:00.461716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf0a0d76-f3ad-4ffa-9b8e-7bdddce218f5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:00.462763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf0a0d76-f3ad-4ffa-9b8e-7bdddce218f5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:00.463731 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf0a0d76-f3ad-4ffa-9b8e-7bdddce218f5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:00.467127 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf0a0d76-f3ad-4ffa-9b8e-7bdddce218f5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:00.467838 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf0a0d76-f3ad-4ffa-9b8e-7bdddce218f5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:00.801215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-980e65ae-dac1-41cf-975b-b0266e38aac7 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:48:00.802305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-980e65ae-dac1-41cf-975b-b0266e38aac7 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:48:00.802962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-980e65ae-dac1-41cf-975b-b0266e38aac7 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:48:00.803561 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-980e65ae-dac1-41cf-975b-b0266e38aac7 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:48:00.804168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-980e65ae-dac1-41cf-975b-b0266e38aac7 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:48:00.818618 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-980e65ae-dac1-41cf-975b-b0266e38aac7 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:00.819777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-980e65ae-dac1-41cf-975b-b0266e38aac7 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:00.820695 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-980e65ae-dac1-41cf-975b-b0266e38aac7 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:00.822019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-980e65ae-dac1-41cf-975b-b0266e38aac7 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:00.822920 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-980e65ae-dac1-41cf-975b-b0266e38aac7 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:00.825921 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-980e65ae-dac1-41cf-975b-b0266e38aac7 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:00.901924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bf0a0d76-f3ad-4ffa-9b8e-7bdddce218f5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:00.911649 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bf0a0d76-f3ad-4ffa-9b8e-7bdddce218f5 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1523 microversion: 2.1 time: 0.472097 Oct 05 02:48:00.923463 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2172/4310] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:00 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1523 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:48:00.925123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-980e65ae-dac1-41cf-975b-b0266e38aac7 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Getting quotas for project a2a0fa4883254728921c0c49aa4e60b1. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:48:00.940503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5f688725-3b0d-4cd9-b493-942e4f9d0ef3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:00.944232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5f688725-3b0d-4cd9-b493-942e4f9d0ef3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:00.947130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-980e65ae-dac1-41cf-975b-b0266e38aac7 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Getting quotas for user 569a3db98b7a44aeb902f7956af5a710 and project a2a0fa4883254728921c0c49aa4e60b1. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:48:00.968367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5f688725-3b0d-4cd9-b493-942e4f9d0ef3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:00.970819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5f688725-3b0d-4cd9-b493-942e4f9d0ef3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:00.973152 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5f688725-3b0d-4cd9-b493-942e4f9d0ef3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:00.975092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5f688725-3b0d-4cd9-b493-942e4f9d0ef3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:00.977165 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5f688725-3b0d-4cd9-b493-942e4f9d0ef3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:00.978931 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5f688725-3b0d-4cd9-b493-942e4f9d0ef3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:01.008657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-980e65ae-dac1-41cf-975b-b0266e38aac7 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:48:01.011260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-980e65ae-dac1-41cf-975b-b0266e38aac7 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] [instance: 1f810197-91e4-4965-b93b-bdd3bf2950bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:48:01.151394 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-980e65ae-dac1-41cf-975b-b0266e38aac7 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.728217 Oct 05 02:48:01.164733 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2139/4311] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:47:59 2022] POST /compute/v2.1/servers => generated 409 bytes in 1743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:48:01.217359 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b5d246ef-a231-4df0-8d19-d6d07f00aaa5 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:01.217917 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b5d246ef-a231-4df0-8d19-d6d07f00aaa5 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] [instance: 1f810197-91e4-4965-b93b-bdd3bf2950bf] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:01.484629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b5d246ef-a231-4df0-8d19-d6d07f00aaa5 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569a3db98b7a44aeb902f7956af5a710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0fa4883254728921c0c49aa4e60b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:01.503581 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b5d246ef-a231-4df0-8d19-d6d07f00aaa5 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] 10.222.0.16 "GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf" status: 200 len: 1225 microversion: 2.1 time: 0.336074 Oct 05 02:48:01.521527 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2140/4312] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:01 2022] GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf => generated 1225 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:01.531451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d43c13b8-d078-4eb0-982b-861900302cc1 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4153e1c4-82d0-4d4b-b19d-14a20b70c4d2"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:48:01.540184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d43c13b8-d078-4eb0-982b-861900302cc1 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: ae8e1003-15ab-4801-a026-e9d80e200d3c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:01.550234 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:48:01.557792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d43c13b8-d078-4eb0-982b-861900302cc1 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:01.561643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d43c13b8-d078-4eb0-982b-861900302cc1 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:01.562677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d43c13b8-d078-4eb0-982b-861900302cc1 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:01.564096 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d43c13b8-d078-4eb0-982b-861900302cc1 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:01.565257 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d43c13b8-d078-4eb0-982b-861900302cc1 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:01.565906 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d43c13b8-d078-4eb0-982b-861900302cc1 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:01.572791 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5f688725-3b0d-4cd9-b493-942e4f9d0ef3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:01.592410 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5f688725-3b0d-4cd9-b493-942e4f9d0ef3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:01.598702 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5f688725-3b0d-4cd9-b493-942e4f9d0ef3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:01.601901 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5f688725-3b0d-4cd9-b493-942e4f9d0ef3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1879 microversion: 2.42 time: 0.675658 Oct 05 02:48:01.607682 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2173/4313] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:48:00 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1879 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:48:01.952602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9cd987a1-279c-43e3-8bb0-08bec7c69072 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:01.953389 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9cd987a1-279c-43e3-8bb0-08bec7c69072 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:01.965726 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9cd987a1-279c-43e3-8bb0-08bec7c69072 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:01.966838 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9cd987a1-279c-43e3-8bb0-08bec7c69072 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:01.984621 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9cd987a1-279c-43e3-8bb0-08bec7c69072 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:01.985686 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9cd987a1-279c-43e3-8bb0-08bec7c69072 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:01.986629 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9cd987a1-279c-43e3-8bb0-08bec7c69072 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:01.990017 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9cd987a1-279c-43e3-8bb0-08bec7c69072 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:02.330120 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d43c13b8-d078-4eb0-982b-861900302cc1 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "POST /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.788593 Oct 05 02:48:02.332746 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2141/4314] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 02:48:01 2022] POST /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c/os-volume_attachments => generated 194 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:48:02.549026 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7fa1d6bd-7245-486a-a233-44e8321866e3 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:02.549747 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7fa1d6bd-7245-486a-a233-44e8321866e3 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] [instance: 1f810197-91e4-4965-b93b-bdd3bf2950bf] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:02.737157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7fa1d6bd-7245-486a-a233-44e8321866e3 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569a3db98b7a44aeb902f7956af5a710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0fa4883254728921c0c49aa4e60b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:02.763175 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7fa1d6bd-7245-486a-a233-44e8321866e3 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] 10.222.0.16 "GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf" status: 200 len: 1225 microversion: 2.1 time: 0.221204 Oct 05 02:48:02.763874 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2142/4315] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:02 2022] GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf => generated 1225 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:02.783662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1d53f95e-24bb-4257-a47e-ba5986d8cdb5 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:02.784299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1d53f95e-24bb-4257-a47e-ba5986d8cdb5 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:02.814733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d53f95e-24bb-4257-a47e-ba5986d8cdb5 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:02.817920 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d53f95e-24bb-4257-a47e-ba5986d8cdb5 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:02.819801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d53f95e-24bb-4257-a47e-ba5986d8cdb5 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:02.820655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d53f95e-24bb-4257-a47e-ba5986d8cdb5 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:02.821406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d53f95e-24bb-4257-a47e-ba5986d8cdb5 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:02.825320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d53f95e-24bb-4257-a47e-ba5986d8cdb5 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:02.979671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9cd987a1-279c-43e3-8bb0-08bec7c69072 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:02.994891 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9cd987a1-279c-43e3-8bb0-08bec7c69072 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1523 microversion: 2.1 time: 1.046780 Oct 05 02:48:02.995494 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2174/4316] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:01 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1523 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:03.748983 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1d53f95e-24bb-4257-a47e-ba5986d8cdb5 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:03.763867 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1d53f95e-24bb-4257-a47e-ba5986d8cdb5 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:03.765878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1d53f95e-24bb-4257-a47e-ba5986d8cdb5 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:03.767426 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1d53f95e-24bb-4257-a47e-ba5986d8cdb5 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1879 microversion: 2.42 time: 1.002587 Oct 05 02:48:03.768788 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2143/4317] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:48:02 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1879 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:48:03.788168 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bd06bb97-b270-45d1-8388-0a075823f961 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:03.788168 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bd06bb97-b270-45d1-8388-0a075823f961 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] [instance: 1f810197-91e4-4965-b93b-bdd3bf2950bf] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:03.790452 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:48:03.802626 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd06bb97-b270-45d1-8388-0a075823f961 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:03.803397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd06bb97-b270-45d1-8388-0a075823f961 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:03.804266 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd06bb97-b270-45d1-8388-0a075823f961 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:03.806602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd06bb97-b270-45d1-8388-0a075823f961 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:03.807390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd06bb97-b270-45d1-8388-0a075823f961 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:03.807980 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd06bb97-b270-45d1-8388-0a075823f961 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:03.919092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bd06bb97-b270-45d1-8388-0a075823f961 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569a3db98b7a44aeb902f7956af5a710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0fa4883254728921c0c49aa4e60b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:03.934677 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bd06bb97-b270-45d1-8388-0a075823f961 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] 10.222.0.16 "GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf" status: 200 len: 1277 microversion: 2.1 time: 0.148729 Oct 05 02:48:03.936414 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2175/4318] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:03 2022] GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf => generated 1277 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:04.019114 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a134369a-0725-4669-b314-8b4968cbe7ab tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:04.019840 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a134369a-0725-4669-b314-8b4968cbe7ab tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:04.026363 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a134369a-0725-4669-b314-8b4968cbe7ab tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:04.027321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a134369a-0725-4669-b314-8b4968cbe7ab tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:04.028661 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a134369a-0725-4669-b314-8b4968cbe7ab tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:04.029643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a134369a-0725-4669-b314-8b4968cbe7ab tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:04.030354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a134369a-0725-4669-b314-8b4968cbe7ab tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:04.031006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a134369a-0725-4669-b314-8b4968cbe7ab tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:04.208489 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a134369a-0725-4669-b314-8b4968cbe7ab tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:04.221953 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a134369a-0725-4669-b314-8b4968cbe7ab tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1505 microversion: 2.1 time: 0.206470 Oct 05 02:48:04.223342 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2144/4319] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:04 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1505 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:48:04.797176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b441039c-947d-404d-a1da-37fc52970746 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:04.798521 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b441039c-947d-404d-a1da-37fc52970746 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:04.812371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b441039c-947d-404d-a1da-37fc52970746 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:04.813615 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b441039c-947d-404d-a1da-37fc52970746 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:04.815312 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b441039c-947d-404d-a1da-37fc52970746 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:04.816285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b441039c-947d-404d-a1da-37fc52970746 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:04.821536 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b441039c-947d-404d-a1da-37fc52970746 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:04.822348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b441039c-947d-404d-a1da-37fc52970746 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:04.961707 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e98f39c2-cdc6-4de3-b842-1cc119419e46 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:04.962230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e98f39c2-cdc6-4de3-b842-1cc119419e46 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] [instance: 1f810197-91e4-4965-b93b-bdd3bf2950bf] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:04.974115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e98f39c2-cdc6-4de3-b842-1cc119419e46 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:04.974574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e98f39c2-cdc6-4de3-b842-1cc119419e46 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:04.975103 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e98f39c2-cdc6-4de3-b842-1cc119419e46 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:04.976023 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e98f39c2-cdc6-4de3-b842-1cc119419e46 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:04.978652 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e98f39c2-cdc6-4de3-b842-1cc119419e46 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:04.979259 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e98f39c2-cdc6-4de3-b842-1cc119419e46 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:05.187672 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e98f39c2-cdc6-4de3-b842-1cc119419e46 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569a3db98b7a44aeb902f7956af5a710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0fa4883254728921c0c49aa4e60b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:05.200181 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e98f39c2-cdc6-4de3-b842-1cc119419e46 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] 10.222.0.16 "GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf" status: 200 len: 1283 microversion: 2.1 time: 0.244127 Oct 05 02:48:05.200791 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2145/4320] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:04 2022] GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf => generated 1283 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:05.249149 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d70feee5-192d-4e6f-9916-5b27f9547127 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:05.249778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d70feee5-192d-4e6f-9916-5b27f9547127 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:05.260611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d70feee5-192d-4e6f-9916-5b27f9547127 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:05.261135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d70feee5-192d-4e6f-9916-5b27f9547127 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:05.261613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d70feee5-192d-4e6f-9916-5b27f9547127 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:05.262318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d70feee5-192d-4e6f-9916-5b27f9547127 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:05.266229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d70feee5-192d-4e6f-9916-5b27f9547127 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:05.269255 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d70feee5-192d-4e6f-9916-5b27f9547127 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:05.362750 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b441039c-947d-404d-a1da-37fc52970746 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:05.372856 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b441039c-947d-404d-a1da-37fc52970746 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:05.374329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b441039c-947d-404d-a1da-37fc52970746 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:05.375505 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b441039c-947d-404d-a1da-37fc52970746 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1879 microversion: 2.42 time: 0.583665 Oct 05 02:48:05.376073 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2176/4321] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:48:04 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1879 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:48:05.807683 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d70feee5-192d-4e6f-9916-5b27f9547127 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:05.822870 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d70feee5-192d-4e6f-9916-5b27f9547127 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1505 microversion: 2.1 time: 0.576583 Oct 05 02:48:05.826389 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2146/4322] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:05 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1505 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:06.186222 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-3356e3e0-16fd-463c-88c6-315a7259856e req-3735611a-b79c-4679-8901-5cd4168ba4e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a710dba5-18ef-4840-835b-06b1fc2bde87", "name": "network-vif-plugged", "status": "completed", "tag": "432071a7-edac-416f-aec1-3041b15ece3c"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:48:06.210993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3356e3e0-16fd-463c-88c6-315a7259856e req-3735611a-b79c-4679-8901-5cd4168ba4e0 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:06.211622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3356e3e0-16fd-463c-88c6-315a7259856e req-3735611a-b79c-4679-8901-5cd4168ba4e0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:06.212133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3356e3e0-16fd-463c-88c6-315a7259856e req-3735611a-b79c-4679-8901-5cd4168ba4e0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:06.224000 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7f456718-b547-4c30-9a56-89d5e4396ccc tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:06.224985 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7f456718-b547-4c30-9a56-89d5e4396ccc tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] [instance: 1f810197-91e4-4965-b93b-bdd3bf2950bf] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:06.238085 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f456718-b547-4c30-9a56-89d5e4396ccc tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:06.239817 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-3356e3e0-16fd-463c-88c6-315a7259856e req-3735611a-b79c-4679-8901-5cd4168ba4e0 service nova] Creating event network-vif-plugged:432071a7-edac-416f-aec1-3041b15ece3c for instance a710dba5-18ef-4840-835b-06b1fc2bde87 on n-h1-858272-3 Oct 05 02:48:06.240439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f456718-b547-4c30-9a56-89d5e4396ccc tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:06.242597 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f456718-b547-4c30-9a56-89d5e4396ccc tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:06.245807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f456718-b547-4c30-9a56-89d5e4396ccc tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:06.246412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f456718-b547-4c30-9a56-89d5e4396ccc tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:06.247009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f456718-b547-4c30-9a56-89d5e4396ccc tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:06.250599 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-3356e3e0-16fd-463c-88c6-315a7259856e req-3735611a-b79c-4679-8901-5cd4168ba4e0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069063 Oct 05 02:48:06.253454 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2177/4323] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:48:06.403949 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c8f86482-dc89-4ca4-b997-bcce79f07ad3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:06.404937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c8f86482-dc89-4ca4-b997-bcce79f07ad3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:06.423237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8f86482-dc89-4ca4-b997-bcce79f07ad3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:06.423932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8f86482-dc89-4ca4-b997-bcce79f07ad3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:06.425632 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8f86482-dc89-4ca4-b997-bcce79f07ad3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:06.430147 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8f86482-dc89-4ca4-b997-bcce79f07ad3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:06.430804 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8f86482-dc89-4ca4-b997-bcce79f07ad3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:06.431493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8f86482-dc89-4ca4-b997-bcce79f07ad3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:06.831850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7f456718-b547-4c30-9a56-89d5e4396ccc tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569a3db98b7a44aeb902f7956af5a710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0fa4883254728921c0c49aa4e60b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:06.837092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c8f86482-dc89-4ca4-b997-bcce79f07ad3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:06.846634 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7f456718-b547-4c30-9a56-89d5e4396ccc tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] 10.222.0.16 "GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf" status: 200 len: 1351 microversion: 2.1 time: 0.627306 Oct 05 02:48:06.852859 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c8f86482-dc89-4ca4-b997-bcce79f07ad3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:06.853313 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2147/4324] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:06 2022] GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf => generated 1351 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:06.854870 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c8f86482-dc89-4ca4-b997-bcce79f07ad3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:06.857037 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c8f86482-dc89-4ca4-b997-bcce79f07ad3 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1879 microversion: 2.42 time: 0.458040 Oct 05 02:48:06.861455 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2e7a0266-a1f4-40ce-9839-d9e17a1dc0cc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:06.867946 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2e7a0266-a1f4-40ce-9839-d9e17a1dc0cc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:06.869289 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2178/4325] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:48:06 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1879 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:48:06.880850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e7a0266-a1f4-40ce-9839-d9e17a1dc0cc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:06.884583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e7a0266-a1f4-40ce-9839-d9e17a1dc0cc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:06.885704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e7a0266-a1f4-40ce-9839-d9e17a1dc0cc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:06.886535 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e7a0266-a1f4-40ce-9839-d9e17a1dc0cc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:06.892726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e7a0266-a1f4-40ce-9839-d9e17a1dc0cc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:06.893265 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e7a0266-a1f4-40ce-9839-d9e17a1dc0cc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:07.103621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2e7a0266-a1f4-40ce-9839-d9e17a1dc0cc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:07.116043 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2e7a0266-a1f4-40ce-9839-d9e17a1dc0cc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1505 microversion: 2.1 time: 0.261562 Oct 05 02:48:07.116754 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2148/4326] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:06 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1505 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:07.870469 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b4754536-641d-4366-8714-02ae26e71f42 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:07.872244 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b4754536-641d-4366-8714-02ae26e71f42 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] [instance: 1f810197-91e4-4965-b93b-bdd3bf2950bf] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:07.885505 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4754536-641d-4366-8714-02ae26e71f42 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:07.886010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4754536-641d-4366-8714-02ae26e71f42 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:07.887018 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4754536-641d-4366-8714-02ae26e71f42 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:07.887738 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4754536-641d-4366-8714-02ae26e71f42 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:07.891293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d99e9860-c214-43ba-8e6c-6d414ba7ae5a tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:07.892507 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d99e9860-c214-43ba-8e6c-6d414ba7ae5a tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:07.893233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4754536-641d-4366-8714-02ae26e71f42 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:07.893738 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b4754536-641d-4366-8714-02ae26e71f42 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:07.900051 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d99e9860-c214-43ba-8e6c-6d414ba7ae5a tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:07.909563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d99e9860-c214-43ba-8e6c-6d414ba7ae5a tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:07.910284 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d99e9860-c214-43ba-8e6c-6d414ba7ae5a tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:07.911280 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d99e9860-c214-43ba-8e6c-6d414ba7ae5a tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:07.912003 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d99e9860-c214-43ba-8e6c-6d414ba7ae5a tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:07.912464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d99e9860-c214-43ba-8e6c-6d414ba7ae5a tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:08.461455 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d99e9860-c214-43ba-8e6c-6d414ba7ae5a tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:08.478607 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d99e9860-c214-43ba-8e6c-6d414ba7ae5a tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:08.481039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d99e9860-c214-43ba-8e6c-6d414ba7ae5a tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:08.493095 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d99e9860-c214-43ba-8e6c-6d414ba7ae5a tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1879 microversion: 2.42 time: 0.598472 Oct 05 02:48:08.494077 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2149/4327] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:48:07 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1879 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:48:08.500125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6f0f6536-3949-43c1-8b9e-64d9f0be39ac tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:08.500974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6f0f6536-3949-43c1-8b9e-64d9f0be39ac tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:08.514646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f0f6536-3949-43c1-8b9e-64d9f0be39ac tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:08.515387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f0f6536-3949-43c1-8b9e-64d9f0be39ac tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:08.516036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f0f6536-3949-43c1-8b9e-64d9f0be39ac tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:08.519985 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f0f6536-3949-43c1-8b9e-64d9f0be39ac tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:08.521072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f0f6536-3949-43c1-8b9e-64d9f0be39ac tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:08.521803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f0f6536-3949-43c1-8b9e-64d9f0be39ac tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:08.537851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b4754536-641d-4366-8714-02ae26e71f42 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569a3db98b7a44aeb902f7956af5a710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0fa4883254728921c0c49aa4e60b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:08.551956 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b4754536-641d-4366-8714-02ae26e71f42 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] 10.222.0.16 "GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf" status: 200 len: 1351 microversion: 2.1 time: 0.685301 Oct 05 02:48:08.552647 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2179/4328] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:07 2022] GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf => generated 1351 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:08.868946 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6f0f6536-3949-43c1-8b9e-64d9f0be39ac tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:08.882842 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6f0f6536-3949-43c1-8b9e-64d9f0be39ac tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 200 len: 1448 microversion: 2.1 time: 0.387185 Oct 05 02:48:08.887145 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2150/4329] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:08 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 1448 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:08.916027 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-693c35c7-b770-4b5b-8743-6242c93389ed tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:08.917443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-693c35c7-b770-4b5b-8743-6242c93389ed tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:08.930858 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-693c35c7-b770-4b5b-8743-6242c93389ed tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:08.932428 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-693c35c7-b770-4b5b-8743-6242c93389ed tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:08.933853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-693c35c7-b770-4b5b-8743-6242c93389ed tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:08.935277 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-693c35c7-b770-4b5b-8743-6242c93389ed tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:08.938655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-693c35c7-b770-4b5b-8743-6242c93389ed tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:08.940520 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-693c35c7-b770-4b5b-8743-6242c93389ed tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:08.977376 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-89817647-a310-4f31-bfcf-f7724b48e2e2 req-3bb67c17-4e96-4f7b-a6fd-3beb8e0761ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f810197-91e4-4965-b93b-bdd3bf2950bf", "tag": "7927478e-de48-49be-ab91-0b118325717e"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:48:09.007741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-89817647-a310-4f31-bfcf-f7724b48e2e2 req-3bb67c17-4e96-4f7b-a6fd-3beb8e0761ab service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:09.017250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-89817647-a310-4f31-bfcf-f7724b48e2e2 req-3bb67c17-4e96-4f7b-a6fd-3beb8e0761ab service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:09.017860 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-89817647-a310-4f31-bfcf-f7724b48e2e2 req-3bb67c17-4e96-4f7b-a6fd-3beb8e0761ab service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:09.033351 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-89817647-a310-4f31-bfcf-f7724b48e2e2 req-3bb67c17-4e96-4f7b-a6fd-3beb8e0761ab service nova] Creating event network-changed:7927478e-de48-49be-ab91-0b118325717e for instance 1f810197-91e4-4965-b93b-bdd3bf2950bf on n-h2-858272-3 Oct 05 02:48:09.043676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-693c35c7-b770-4b5b-8743-6242c93389ed tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:48:09.052823 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-89817647-a310-4f31-bfcf-f7724b48e2e2 req-3bb67c17-4e96-4f7b-a6fd-3beb8e0761ab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081814 Oct 05 02:48:09.053506 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2151/4330] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:48:09.062706 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.compute.api [None req-693c35c7-b770-4b5b-8743-6242c93389ed tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Working on deleting snapshot 76d1c022-390f-472d-91b2-61870f68b6c3 from shelved instance... Oct 05 02:48:09.068564 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-df92ac9f-8840-4ea6-9b26-d688531dbe6a req-df0eb66d-dbdb-43e6-94fd-5c120870646f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "161a6f96-e469-47fd-a72f-df5a05e9a62b", "name": "network-vif-unplugged", "status": "completed", "tag": "7d9bdf6d-adf0-4eb9-ab11-e0dc32dd5fa8"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:48:09.096110 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-df92ac9f-8840-4ea6-9b26-d688531dbe6a req-df0eb66d-dbdb-43e6-94fd-5c120870646f service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:09.096845 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-df92ac9f-8840-4ea6-9b26-d688531dbe6a req-df0eb66d-dbdb-43e6-94fd-5c120870646f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:09.097382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-df92ac9f-8840-4ea6-9b26-d688531dbe6a req-df0eb66d-dbdb-43e6-94fd-5c120870646f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:09.124135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.compute.server_external_events [req-df92ac9f-8840-4ea6-9b26-d688531dbe6a req-df0eb66d-dbdb-43e6-94fd-5c120870646f service nova] Unable to find a host for instance 161a6f96-e469-47fd-a72f-df5a05e9a62b. Dropping event network-vif-unplugged {{(pid=122319) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 05 02:48:09.129713 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-df92ac9f-8840-4ea6-9b26-d688531dbe6a req-df0eb66d-dbdb-43e6-94fd-5c120870646f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.071358 Oct 05 02:48:09.132548 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2152/4331] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 76 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 05 02:48:09.525252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-eba0e0ec-b8e6-4890-83c2-50357a9c923f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:09.526375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-eba0e0ec-b8e6-4890-83c2-50357a9c923f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:09.541034 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eba0e0ec-b8e6-4890-83c2-50357a9c923f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:09.541616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eba0e0ec-b8e6-4890-83c2-50357a9c923f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:09.542070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eba0e0ec-b8e6-4890-83c2-50357a9c923f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:09.547808 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eba0e0ec-b8e6-4890-83c2-50357a9c923f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:09.548540 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eba0e0ec-b8e6-4890-83c2-50357a9c923f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:09.549706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eba0e0ec-b8e6-4890-83c2-50357a9c923f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:10.378146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-693c35c7-b770-4b5b-8743-6242c93389ed tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Doing local delete in cell d1723b23-1631-4a56-b9ad-72e4c39197cb(cell1) {{(pid=122320) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 05 02:48:10.380861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-693c35c7-b770-4b5b-8743-6242c93389ed tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:10.381401 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-693c35c7-b770-4b5b-8743-6242c93389ed tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:10.384860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-693c35c7-b770-4b5b-8743-6242c93389ed tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:10.385584 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.compute.api [None req-693c35c7-b770-4b5b-8743-6242c93389ed tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 05 02:48:10.396208 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-693c35c7-b770-4b5b-8743-6242c93389ed tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] deallocate_for_instance() {{(pid=122320) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 05 02:48:10.625808 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-eba0e0ec-b8e6-4890-83c2-50357a9c923f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:10.640517 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-eba0e0ec-b8e6-4890-83c2-50357a9c923f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:10.641984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-eba0e0ec-b8e6-4890-83c2-50357a9c923f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:10.643157 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-eba0e0ec-b8e6-4890-83c2-50357a9c923f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1879 microversion: 2.42 time: 1.122355 Oct 05 02:48:10.668929 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2153/4332] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:48:09 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1879 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:48:10.668929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1afe4b46-eaf2-4468-9e89-21e869eb1855 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:10.668929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1afe4b46-eaf2-4468-9e89-21e869eb1855 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] [instance: 1f810197-91e4-4965-b93b-bdd3bf2950bf] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:10.676867 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1afe4b46-eaf2-4468-9e89-21e869eb1855 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:10.677685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1afe4b46-eaf2-4468-9e89-21e869eb1855 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:10.679720 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1afe4b46-eaf2-4468-9e89-21e869eb1855 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:10.683432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1afe4b46-eaf2-4468-9e89-21e869eb1855 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:10.685308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1afe4b46-eaf2-4468-9e89-21e869eb1855 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:10.687070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1afe4b46-eaf2-4468-9e89-21e869eb1855 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:10.861741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:48:11.662973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1afe4b46-eaf2-4468-9e89-21e869eb1855 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569a3db98b7a44aeb902f7956af5a710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0fa4883254728921c0c49aa4e60b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:11.682096 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1afe4b46-eaf2-4468-9e89-21e869eb1855 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] 10.222.0.16 "GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf" status: 200 len: 1351 microversion: 2.1 time: 1.021117 Oct 05 02:48:11.685363 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2154/4333] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:10 2022] GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf => generated 1351 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:11.694346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-a77d076e-7662-4d4d-bc35-6b5cc2672e88 req-232aa718-124d-4172-a11e-7f0cef7d1a24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a710dba5-18ef-4840-835b-06b1fc2bde87", "name": "network-vif-plugged", "status": "completed", "tag": "8a8ea6c2-c534-4a07-92e6-de17c7a31bf2"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:48:11.721441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a77d076e-7662-4d4d-bc35-6b5cc2672e88 req-232aa718-124d-4172-a11e-7f0cef7d1a24 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:11.721932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a77d076e-7662-4d4d-bc35-6b5cc2672e88 req-232aa718-124d-4172-a11e-7f0cef7d1a24 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:11.722360 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a77d076e-7662-4d4d-bc35-6b5cc2672e88 req-232aa718-124d-4172-a11e-7f0cef7d1a24 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:11.753998 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-a77d076e-7662-4d4d-bc35-6b5cc2672e88 req-232aa718-124d-4172-a11e-7f0cef7d1a24 service nova] Creating event network-vif-plugged:8a8ea6c2-c534-4a07-92e6-de17c7a31bf2 for instance a710dba5-18ef-4840-835b-06b1fc2bde87 on n-h1-858272-3 Oct 05 02:48:11.762842 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-a77d076e-7662-4d4d-bc35-6b5cc2672e88 req-232aa718-124d-4172-a11e-7f0cef7d1a24 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076055 Oct 05 02:48:11.773666 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2155/4334] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:48:11.779662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b80c8cee-59a5-499a-858a-02b262de4bd1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:11.780322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b80c8cee-59a5-499a-858a-02b262de4bd1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:11.794198 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b80c8cee-59a5-499a-858a-02b262de4bd1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:11.797536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b80c8cee-59a5-499a-858a-02b262de4bd1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:11.798012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b80c8cee-59a5-499a-858a-02b262de4bd1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:11.798815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b80c8cee-59a5-499a-858a-02b262de4bd1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:11.799269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b80c8cee-59a5-499a-858a-02b262de4bd1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:11.799746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b80c8cee-59a5-499a-858a-02b262de4bd1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:12.435051 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b80c8cee-59a5-499a-858a-02b262de4bd1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:12.452106 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b80c8cee-59a5-499a-858a-02b262de4bd1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:12.454091 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b80c8cee-59a5-499a-858a-02b262de4bd1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:12.458483 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b80c8cee-59a5-499a-858a-02b262de4bd1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1879 microversion: 2.42 time: 0.683232 Oct 05 02:48:12.462635 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2156/4335] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:48:11 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1879 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:48:12.533862 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-5b090c32-aa9b-41b7-8ae7-0bd3228f3889 req-4e8ac26f-f588-4bdc-aa7c-78bc4e3f1af6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "161a6f96-e469-47fd-a72f-df5a05e9a62b", "name": "network-vif-deleted", "tag": "7d9bdf6d-adf0-4eb9-ab11-e0dc32dd5fa8"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:48:12.545577 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-693c35c7-b770-4b5b-8743-6242c93389ed tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Updating instance_info_cache with network_info: [] {{(pid=122320) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 05 02:48:12.601105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5b090c32-aa9b-41b7-8ae7-0bd3228f3889 req-4e8ac26f-f588-4bdc-aa7c-78bc4e3f1af6 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:12.602608 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5b090c32-aa9b-41b7-8ae7-0bd3228f3889 req-4e8ac26f-f588-4bdc-aa7c-78bc4e3f1af6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:12.603046 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5b090c32-aa9b-41b7-8ae7-0bd3228f3889 req-4e8ac26f-f588-4bdc-aa7c-78bc4e3f1af6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:12.656629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.compute.server_external_events [req-5b090c32-aa9b-41b7-8ae7-0bd3228f3889 req-4e8ac26f-f588-4bdc-aa7c-78bc4e3f1af6 service nova] Unable to find a host for instance 161a6f96-e469-47fd-a72f-df5a05e9a62b. Dropping event network-vif-deleted {{(pid=122319) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 05 02:48:12.658966 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-5b090c32-aa9b-41b7-8ae7-0bd3228f3889 req-4e8ac26f-f588-4bdc-aa7c-78bc4e3f1af6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.132528 Oct 05 02:48:12.663130 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2157/4336] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 137 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 05 02:48:12.722215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2167d4ab-199d-41c1-bf85-00eb5948c5d0 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:12.723475 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2167d4ab-199d-41c1-bf85-00eb5948c5d0 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] [instance: 1f810197-91e4-4965-b93b-bdd3bf2950bf] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:12.734774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2167d4ab-199d-41c1-bf85-00eb5948c5d0 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:12.737360 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2167d4ab-199d-41c1-bf85-00eb5948c5d0 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:12.737889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2167d4ab-199d-41c1-bf85-00eb5948c5d0 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:12.745404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2167d4ab-199d-41c1-bf85-00eb5948c5d0 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:12.747383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2167d4ab-199d-41c1-bf85-00eb5948c5d0 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:12.748668 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2167d4ab-199d-41c1-bf85-00eb5948c5d0 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:12.749548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=10 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:48:13.164055 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2167d4ab-199d-41c1-bf85-00eb5948c5d0 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569a3db98b7a44aeb902f7956af5a710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0fa4883254728921c0c49aa4e60b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:13.173093 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2167d4ab-199d-41c1-bf85-00eb5948c5d0 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] 10.222.0.16 "GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf" status: 200 len: 1351 microversion: 2.1 time: 0.464107 Oct 05 02:48:13.179440 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2158/4337] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:12 2022] GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf => generated 1351 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:13.194993 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-693c35c7-b770-4b5b-8743-6242c93389ed tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "DELETE /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 204 len: 0 microversion: 2.1 time: 4.284211 Oct 05 02:48:13.195819 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2180/4338] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:48:08 2022] DELETE /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 0 bytes in 4286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:48:13.204159 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f7e3bb8a-0f83-49ce-8625-78ba8834325c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:13.205545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f7e3bb8a-0f83-49ce-8625-78ba8834325c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:13.219416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7e3bb8a-0f83-49ce-8625-78ba8834325c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:13.219922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7e3bb8a-0f83-49ce-8625-78ba8834325c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:13.220363 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7e3bb8a-0f83-49ce-8625-78ba8834325c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:13.226195 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7e3bb8a-0f83-49ce-8625-78ba8834325c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:13.226896 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7e3bb8a-0f83-49ce-8625-78ba8834325c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:13.228972 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7e3bb8a-0f83-49ce-8625-78ba8834325c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:13.235271 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:48:13.271136 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-f7e3bb8a-0f83-49ce-8625-78ba8834325c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] HTTP exception thrown: Instance 161a6f96-e469-47fd-a72f-df5a05e9a62b could not be found. Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f7e3bb8a-0f83-49ce-8625-78ba8834325c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Request method failure captured: Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b HTTP/1.1 Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO9sJgtvOLeTr4nOCD-vOqCqD1zJrAITPFW_zz4yiLyvIoTdHjuR4LJfH4xTHqVQhBEUV87uN4J6FQiHHhnatngFlbfTbJmS6cPceNKMN6UWu-_pNs3jdF8Cb5CgC-hxlx6u-5aGNVi9h5jLYyViTpDjMXgNyRvr5dJZFZQW2uKikA8 Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: d797c0058e8c456290081d056df79292 Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d797c0058e8c456290081d056df79292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d797c0058e8c456290081d056df79292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: d797c0058e8c456290081d056df79292 Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: ff170a5be8a04902b66e5f0e79fd47df Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 161a6f96-e469-47fd-a72f-df5a05e9a62b could not be found. Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '161a6f96-e469-47fd-a72f-df5a05e9a62b'} Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 161a6f96-e469-47fd-a72f-df5a05e9a62b could not be found. Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 161a6f96-e469-47fd-a72f-df5a05e9a62b could not be found. Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:48:13.274267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:48:13.279476 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:48:13.279476 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:48:13.279476 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:48:13.279476 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:48:13.279476 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:48:13.279476 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 161a6f96-e469-47fd-a72f-df5a05e9a62b could not be found. Oct 05 02:48:13.279476 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:48:13.283515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f7e3bb8a-0f83-49ce-8625-78ba8834325c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Returning 404 to user: Instance 161a6f96-e469-47fd-a72f-df5a05e9a62b could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:48:13.291706 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f7e3bb8a-0f83-49ce-8625-78ba8834325c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 404 len: 111 microversion: 2.1 time: 0.089093 Oct 05 02:48:13.295665 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2181/4339] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:13 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:48:13.473855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1b7dd00b-c8e2-44cf-a671-b70aa71516fd tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1464935581", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:48:13.494446 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-81a58b52-810e-4f61-b2b0-fd3b3909771f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:13.495470 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-81a58b52-810e-4f61-b2b0-fd3b3909771f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:13.506404 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81a58b52-810e-4f61-b2b0-fd3b3909771f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:13.516752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81a58b52-810e-4f61-b2b0-fd3b3909771f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:13.517759 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81a58b52-810e-4f61-b2b0-fd3b3909771f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:13.521384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81a58b52-810e-4f61-b2b0-fd3b3909771f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:13.522235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81a58b52-810e-4f61-b2b0-fd3b3909771f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:13.522931 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81a58b52-810e-4f61-b2b0-fd3b3909771f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:13.569125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-1b7dd00b-c8e2-44cf-a671-b70aa71516fd tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] validate_networks() for [('e491bb1a-0157-4d09-a562-11c88a7d4e65', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:48:14.225274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-81a58b52-810e-4f61-b2b0-fd3b3909771f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:14.249998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-81a58b52-810e-4f61-b2b0-fd3b3909771f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:14.251803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-81a58b52-810e-4f61-b2b0-fd3b3909771f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:14.253244 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-81a58b52-810e-4f61-b2b0-fd3b3909771f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1879 microversion: 2.42 time: 0.764981 Oct 05 02:48:14.254797 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2182/4340] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:48:13 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1879 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:48:14.261990 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2c3792dc-e83e-4b4e-9a63-f3d0752c2f7b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-186904652", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "e4f9d49c-25ab-4e4f-a7c4-00e803798e90"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:48:14.333395 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-2c3792dc-e83e-4b4e-9a63-f3d0752c2f7b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] validate_networks() for [('e4f9d49c-25ab-4e4f-a7c4-00e803798e90', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:48:15.751972 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-1b7dd00b-c8e2-44cf-a671-b70aa71516fd tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:48:15.752467 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-1b7dd00b-c8e2-44cf-a671-b70aa71516fd tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:48:15.752858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-1b7dd00b-c8e2-44cf-a671-b70aa71516fd tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:48:15.753304 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-1b7dd00b-c8e2-44cf-a671-b70aa71516fd tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:48:15.753718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-1b7dd00b-c8e2-44cf-a671-b70aa71516fd tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:48:15.776613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b7dd00b-c8e2-44cf-a671-b70aa71516fd tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:15.777935 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b7dd00b-c8e2-44cf-a671-b70aa71516fd tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:15.781285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b7dd00b-c8e2-44cf-a671-b70aa71516fd tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:15.782425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b7dd00b-c8e2-44cf-a671-b70aa71516fd tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:15.782917 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b7dd00b-c8e2-44cf-a671-b70aa71516fd tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:15.783365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b7dd00b-c8e2-44cf-a671-b70aa71516fd tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:15.817677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-1b7dd00b-c8e2-44cf-a671-b70aa71516fd tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Getting quotas for project 1eab97ab9390449da800dab7d39217da. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:48:15.842723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-1b7dd00b-c8e2-44cf-a671-b70aa71516fd tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Getting quotas for user 4660830930074af2905b664500feefe6 and project 1eab97ab9390449da800dab7d39217da. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:48:15.861833 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1b7dd00b-c8e2-44cf-a671-b70aa71516fd tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:48:15.880624 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1b7dd00b-c8e2-44cf-a671-b70aa71516fd tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:48:15.991999 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1b7dd00b-c8e2-44cf-a671-b70aa71516fd tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.811049 Oct 05 02:48:15.993579 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2159/4341] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:48:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 2813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:48:16.007128 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-c0f1034f-d0a9-444c-a556-08239156cb65 req-381b03a1-41f6-4352-810e-77a01a707723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a710dba5-18ef-4840-835b-06b1fc2bde87", "name": "network-vif-plugged", "status": "completed", "tag": "88922211-2f92-4989-937c-6c447b45f0b1"}, {"server_uuid": "a710dba5-18ef-4840-835b-06b1fc2bde87", "name": "network-vif-plugged", "status": "completed", "tag": "a4b7823b-7c50-4314-99cb-dea5af5cfe33"}, {"server_uuid": "a710dba5-18ef-4840-835b-06b1fc2bde87", "name": "network-vif-plugged", "status": "completed", "tag": "c6b3e9fb-230c-4ce3-abab-896b74e674ca"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:48:16.015532 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-2c3792dc-e83e-4b4e-9a63-f3d0752c2f7b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:48:16.016567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-2c3792dc-e83e-4b4e-9a63-f3d0752c2f7b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:48:16.017419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-2c3792dc-e83e-4b4e-9a63-f3d0752c2f7b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:48:16.024205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-2c3792dc-e83e-4b4e-9a63-f3d0752c2f7b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:48:16.025570 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-2c3792dc-e83e-4b4e-9a63-f3d0752c2f7b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:48:16.047602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c3792dc-e83e-4b4e-9a63-f3d0752c2f7b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:16.048124 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c3792dc-e83e-4b4e-9a63-f3d0752c2f7b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:16.048933 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c3792dc-e83e-4b4e-9a63-f3d0752c2f7b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:16.050613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c0f1034f-d0a9-444c-a556-08239156cb65 req-381b03a1-41f6-4352-810e-77a01a707723 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:16.052504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c3792dc-e83e-4b4e-9a63-f3d0752c2f7b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:16.053204 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c3792dc-e83e-4b4e-9a63-f3d0752c2f7b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:16.054330 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c3792dc-e83e-4b4e-9a63-f3d0752c2f7b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:16.054867 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c0f1034f-d0a9-444c-a556-08239156cb65 req-381b03a1-41f6-4352-810e-77a01a707723 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:16.055517 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c0f1034f-d0a9-444c-a556-08239156cb65 req-381b03a1-41f6-4352-810e-77a01a707723 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:16.070222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:48:16.092212 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-c0f1034f-d0a9-444c-a556-08239156cb65 req-381b03a1-41f6-4352-810e-77a01a707723 service nova] Creating event network-vif-plugged:88922211-2f92-4989-937c-6c447b45f0b1 for instance a710dba5-18ef-4840-835b-06b1fc2bde87 on n-h1-858272-3 Oct 05 02:48:16.094209 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-c0f1034f-d0a9-444c-a556-08239156cb65 req-381b03a1-41f6-4352-810e-77a01a707723 service nova] Creating event network-vif-plugged:a4b7823b-7c50-4314-99cb-dea5af5cfe33 for instance a710dba5-18ef-4840-835b-06b1fc2bde87 on n-h1-858272-3 Oct 05 02:48:16.097492 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-c0f1034f-d0a9-444c-a556-08239156cb65 req-381b03a1-41f6-4352-810e-77a01a707723 service nova] Creating event network-vif-plugged:c6b3e9fb-230c-4ce3-abab-896b74e674ca for instance a710dba5-18ef-4840-835b-06b1fc2bde87 on n-h1-858272-3 Oct 05 02:48:16.111905 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-2c3792dc-e83e-4b4e-9a63-f3d0752c2f7b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Getting quotas for project d797c0058e8c456290081d056df79292. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:48:16.117886 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-c0f1034f-d0a9-444c-a556-08239156cb65 req-381b03a1-41f6-4352-810e-77a01a707723 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.122829 Oct 05 02:48:16.121666 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2160/4342] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:48:16.131912 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-2c3792dc-e83e-4b4e-9a63-f3d0752c2f7b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Getting quotas for user ff170a5be8a04902b66e5f0e79fd47df and project d797c0058e8c456290081d056df79292. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:48:16.144721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c6b97ea8-4837-4093-8282-ea221e21eb8f tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:16.147001 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c6b97ea8-4837-4093-8282-ea221e21eb8f tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] [instance: 1f810197-91e4-4965-b93b-bdd3bf2950bf] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:16.175431 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6b97ea8-4837-4093-8282-ea221e21eb8f tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:16.186886 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6b97ea8-4837-4093-8282-ea221e21eb8f tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:16.187575 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6b97ea8-4837-4093-8282-ea221e21eb8f tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:16.188357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6b97ea8-4837-4093-8282-ea221e21eb8f tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:16.188840 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6b97ea8-4837-4093-8282-ea221e21eb8f tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:16.189311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6b97ea8-4837-4093-8282-ea221e21eb8f tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:16.193639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2c3792dc-e83e-4b4e-9a63-f3d0752c2f7b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:48:16.196232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2c3792dc-e83e-4b4e-9a63-f3d0752c2f7b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:48:16.348644 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2c3792dc-e83e-4b4e-9a63-f3d0752c2f7b tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.091783 Oct 05 02:48:16.349370 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2183/4343] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:48:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:48:16.364244 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e7a16cf7-3415-4da0-8b17-e7a89ccf8fbf tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:16.366338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e7a16cf7-3415-4da0-8b17-e7a89ccf8fbf tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:16.380271 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7a16cf7-3415-4da0-8b17-e7a89ccf8fbf tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:16.382457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7a16cf7-3415-4da0-8b17-e7a89ccf8fbf tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:16.382772 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7a16cf7-3415-4da0-8b17-e7a89ccf8fbf tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:16.385567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7a16cf7-3415-4da0-8b17-e7a89ccf8fbf tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:16.387299 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7a16cf7-3415-4da0-8b17-e7a89ccf8fbf tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:16.389475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7a16cf7-3415-4da0-8b17-e7a89ccf8fbf tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:16.517607 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c6b97ea8-4837-4093-8282-ea221e21eb8f tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569a3db98b7a44aeb902f7956af5a710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0fa4883254728921c0c49aa4e60b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:16.536825 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c6b97ea8-4837-4093-8282-ea221e21eb8f tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] 10.222.0.16 "GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf" status: 200 len: 1351 microversion: 2.1 time: 0.411681 Oct 05 02:48:16.557742 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2161/4344] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:16 2022] GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf => generated 1351 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:16.576655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-66781ba8-5536-4059-8c73-57336feeed51 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:16.577343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-66781ba8-5536-4059-8c73-57336feeed51 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:16.903154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-66781ba8-5536-4059-8c73-57336feeed51 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:16.916071 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-66781ba8-5536-4059-8c73-57336feeed51 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1223 microversion: 2.1 time: 0.351654 Oct 05 02:48:16.935045 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2162/4345] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:16 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1223 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:16.947528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e407bf15-b4fe-43f1-b3c4-a9c576a0f554 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:16.972538 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e407bf15-b4fe-43f1-b3c4-a9c576a0f554 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: ae8e1003-15ab-4801-a026-e9d80e200d3c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:16.989782 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e407bf15-b4fe-43f1-b3c4-a9c576a0f554 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:16.990399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e407bf15-b4fe-43f1-b3c4-a9c576a0f554 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:16.991822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e407bf15-b4fe-43f1-b3c4-a9c576a0f554 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:16.994042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e407bf15-b4fe-43f1-b3c4-a9c576a0f554 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:16.995400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e407bf15-b4fe-43f1-b3c4-a9c576a0f554 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:16.996769 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e407bf15-b4fe-43f1-b3c4-a9c576a0f554 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:17.037640 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e7a16cf7-3415-4da0-8b17-e7a89ccf8fbf tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:17.051046 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e7a16cf7-3415-4da0-8b17-e7a89ccf8fbf tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:17.053161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e7a16cf7-3415-4da0-8b17-e7a89ccf8fbf tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:17.054896 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e7a16cf7-3415-4da0-8b17-e7a89ccf8fbf tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1879 microversion: 2.42 time: 0.704175 Oct 05 02:48:17.071103 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2184/4346] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:48:16 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1879 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:48:17.086353 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-463b5413-e681-4b05-ba6e-318da7a2092e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:17.089173 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-463b5413-e681-4b05-ba6e-318da7a2092e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:17.106881 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e407bf15-b4fe-43f1-b3c4-a9c576a0f554 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.168623 Oct 05 02:48:17.108864 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2163/4347] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 02:48:16 2022] GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:48:17.120423 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9aea9224-2aeb-4cdb-a448-2b8811d97e73 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:17.121296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9aea9224-2aeb-4cdb-a448-2b8811d97e73 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: ae8e1003-15ab-4801-a026-e9d80e200d3c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:17.138350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9aea9224-2aeb-4cdb-a448-2b8811d97e73 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:17.140115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9aea9224-2aeb-4cdb-a448-2b8811d97e73 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:17.140856 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9aea9224-2aeb-4cdb-a448-2b8811d97e73 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:17.141938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9aea9224-2aeb-4cdb-a448-2b8811d97e73 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:17.142708 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9aea9224-2aeb-4cdb-a448-2b8811d97e73 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:17.143825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9aea9224-2aeb-4cdb-a448-2b8811d97e73 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:17.198105 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-463b5413-e681-4b05-ba6e-318da7a2092e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:17.209581 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-463b5413-e681-4b05-ba6e-318da7a2092e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1214 microversion: 2.1 time: 0.137726 Oct 05 02:48:17.212395 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2185/4348] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:17 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1214 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:17.217724 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9aea9224-2aeb-4cdb-a448-2b8811d97e73 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c/os-volume_attachments/4153e1c4-82d0-4d4b-b19d-14a20b70c4d2" status: 200 len: 194 microversion: 2.1 time: 0.100249 Oct 05 02:48:17.226273 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2164/4349] 10.222.0.16 () {58 vars in 1413 bytes} [Wed Oct 5 02:48:17 2022] GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c/os-volume_attachments/4153e1c4-82d0-4d4b-b19d-14a20b70c4d2 => generated 194 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:48:17.577624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-84349aed-3b35-47e5-89b3-e90e818634e9 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:17.582051 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-84349aed-3b35-47e5-89b3-e90e818634e9 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] [instance: 1f810197-91e4-4965-b93b-bdd3bf2950bf] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:17.610106 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84349aed-3b35-47e5-89b3-e90e818634e9 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:17.612030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84349aed-3b35-47e5-89b3-e90e818634e9 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:17.613431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84349aed-3b35-47e5-89b3-e90e818634e9 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:17.614662 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84349aed-3b35-47e5-89b3-e90e818634e9 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:17.615425 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84349aed-3b35-47e5-89b3-e90e818634e9 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:17.617767 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84349aed-3b35-47e5-89b3-e90e818634e9 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:17.861603 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-84349aed-3b35-47e5-89b3-e90e818634e9 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569a3db98b7a44aeb902f7956af5a710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0fa4883254728921c0c49aa4e60b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:17.874023 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-84349aed-3b35-47e5-89b3-e90e818634e9 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] 10.222.0.16 "GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf" status: 200 len: 1351 microversion: 2.1 time: 0.303757 Oct 05 02:48:17.893633 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2186/4350] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:17 2022] GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf => generated 1351 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:17.946693 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-37d24f2c-7a80-44b4-b441-6a78278d8401 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:17.947324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-37d24f2c-7a80-44b4-b441-6a78278d8401 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:17.959984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37d24f2c-7a80-44b4-b441-6a78278d8401 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:17.960507 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37d24f2c-7a80-44b4-b441-6a78278d8401 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:17.962530 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37d24f2c-7a80-44b4-b441-6a78278d8401 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:17.965010 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37d24f2c-7a80-44b4-b441-6a78278d8401 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:17.965758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37d24f2c-7a80-44b4-b441-6a78278d8401 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:17.966789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37d24f2c-7a80-44b4-b441-6a78278d8401 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:18.084847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b6169f6e-0934-402f-8cd6-6e6e9b6d7d08 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:18.085627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b6169f6e-0934-402f-8cd6-6e6e9b6d7d08 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:18.098159 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6169f6e-0934-402f-8cd6-6e6e9b6d7d08 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:18.098666 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6169f6e-0934-402f-8cd6-6e6e9b6d7d08 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:18.101562 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6169f6e-0934-402f-8cd6-6e6e9b6d7d08 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:18.116130 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6169f6e-0934-402f-8cd6-6e6e9b6d7d08 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:18.116716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6169f6e-0934-402f-8cd6-6e6e9b6d7d08 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:18.121167 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6169f6e-0934-402f-8cd6-6e6e9b6d7d08 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:18.167295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-37d24f2c-7a80-44b4-b441-6a78278d8401 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:18.184749 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-37d24f2c-7a80-44b4-b441-6a78278d8401 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1275 microversion: 2.1 time: 0.240996 Oct 05 02:48:18.186827 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2165/4351] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:17 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1275 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:18.234329 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-fd0c630d-8f97-425e-840f-ba8b57718e44 req-297d95ae-79da-4d7e-97ba-fc7e5ac8e66c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a710dba5-18ef-4840-835b-06b1fc2bde87", "name": "network-vif-plugged", "status": "completed", "tag": "07524a96-4932-40f9-b62e-ec594f3e7266"}, {"server_uuid": "a710dba5-18ef-4840-835b-06b1fc2bde87", "name": "network-vif-plugged", "status": "completed", "tag": "71f0f4da-1745-4447-9f63-d186fb5b9770"}, {"server_uuid": "1f810197-91e4-4965-b93b-bdd3bf2950bf", "name": "network-vif-plugged", "status": "completed", "tag": "7927478e-de48-49be-ab91-0b118325717e"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:48:18.275996 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-fd0c630d-8f97-425e-840f-ba8b57718e44 req-297d95ae-79da-4d7e-97ba-fc7e5ac8e66c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:18.276526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-fd0c630d-8f97-425e-840f-ba8b57718e44 req-297d95ae-79da-4d7e-97ba-fc7e5ac8e66c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:18.279486 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-fd0c630d-8f97-425e-840f-ba8b57718e44 req-297d95ae-79da-4d7e-97ba-fc7e5ac8e66c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:18.328874 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-fd0c630d-8f97-425e-840f-ba8b57718e44 req-297d95ae-79da-4d7e-97ba-fc7e5ac8e66c service nova] Creating event network-vif-plugged:07524a96-4932-40f9-b62e-ec594f3e7266 for instance a710dba5-18ef-4840-835b-06b1fc2bde87 on n-h1-858272-3 Oct 05 02:48:18.330848 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-fd0c630d-8f97-425e-840f-ba8b57718e44 req-297d95ae-79da-4d7e-97ba-fc7e5ac8e66c service nova] Creating event network-vif-plugged:71f0f4da-1745-4447-9f63-d186fb5b9770 for instance a710dba5-18ef-4840-835b-06b1fc2bde87 on n-h1-858272-3 Oct 05 02:48:18.331548 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-fd0c630d-8f97-425e-840f-ba8b57718e44 req-297d95ae-79da-4d7e-97ba-fc7e5ac8e66c service nova] Creating event network-vif-plugged:7927478e-de48-49be-ab91-0b118325717e for instance 1f810197-91e4-4965-b93b-bdd3bf2950bf on n-h2-858272-3 Oct 05 02:48:18.356170 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-fd0c630d-8f97-425e-840f-ba8b57718e44 req-297d95ae-79da-4d7e-97ba-fc7e5ac8e66c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.127195 Oct 05 02:48:18.361286 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2166/4352] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:48:18.366529 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-01ff9bb7-c462-4ca2-a8c4-d83ae9746eed tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:18.367233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-01ff9bb7-c462-4ca2-a8c4-d83ae9746eed tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:18.388341 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01ff9bb7-c462-4ca2-a8c4-d83ae9746eed tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:18.388840 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01ff9bb7-c462-4ca2-a8c4-d83ae9746eed tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:18.389303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01ff9bb7-c462-4ca2-a8c4-d83ae9746eed tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:18.403530 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01ff9bb7-c462-4ca2-a8c4-d83ae9746eed tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:18.416735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01ff9bb7-c462-4ca2-a8c4-d83ae9746eed tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:18.419776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01ff9bb7-c462-4ca2-a8c4-d83ae9746eed tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:19.193758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-01ff9bb7-c462-4ca2-a8c4-d83ae9746eed tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:19.206302 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-01ff9bb7-c462-4ca2-a8c4-d83ae9746eed tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1266 microversion: 2.1 time: 0.843690 Oct 05 02:48:19.229263 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2167/4353] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:18 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1266 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:19.236764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-25bccf06-dc4f-42fb-92e5-81e1cdd24120 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:19.237552 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-25bccf06-dc4f-42fb-92e5-81e1cdd24120 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] [instance: 1f810197-91e4-4965-b93b-bdd3bf2950bf] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:19.244513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-25bccf06-dc4f-42fb-92e5-81e1cdd24120 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:19.245622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-25bccf06-dc4f-42fb-92e5-81e1cdd24120 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:19.248744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-25bccf06-dc4f-42fb-92e5-81e1cdd24120 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:19.249591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-25bccf06-dc4f-42fb-92e5-81e1cdd24120 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:19.250073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-25bccf06-dc4f-42fb-92e5-81e1cdd24120 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:19.250736 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-25bccf06-dc4f-42fb-92e5-81e1cdd24120 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:19.646966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b6169f6e-0934-402f-8cd6-6e6e9b6d7d08 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:19.667682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b6169f6e-0934-402f-8cd6-6e6e9b6d7d08 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:19.674198 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b6169f6e-0934-402f-8cd6-6e6e9b6d7d08 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:19.676165 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b6169f6e-0934-402f-8cd6-6e6e9b6d7d08 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1879 microversion: 2.42 time: 1.595313 Oct 05 02:48:19.677124 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2187/4354] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:48:18 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1879 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:48:19.684677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8a1bd490-50c5-4973-88d1-fc43a0e724db tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:19.685574 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8a1bd490-50c5-4973-88d1-fc43a0e724db tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:19.692435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a1bd490-50c5-4973-88d1-fc43a0e724db tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:19.693094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a1bd490-50c5-4973-88d1-fc43a0e724db tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:19.693712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a1bd490-50c5-4973-88d1-fc43a0e724db tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:19.694612 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a1bd490-50c5-4973-88d1-fc43a0e724db tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:19.695220 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a1bd490-50c5-4973-88d1-fc43a0e724db tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:19.695815 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a1bd490-50c5-4973-88d1-fc43a0e724db tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:19.830874 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8a1bd490-50c5-4973-88d1-fc43a0e724db tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:19.843299 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8a1bd490-50c5-4973-88d1-fc43a0e724db tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1281 microversion: 2.1 time: 0.165067 Oct 05 02:48:19.846945 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2188/4355] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:19 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1281 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:19.892887 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-25bccf06-dc4f-42fb-92e5-81e1cdd24120 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569a3db98b7a44aeb902f7956af5a710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0fa4883254728921c0c49aa4e60b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:19.902633 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-25bccf06-dc4f-42fb-92e5-81e1cdd24120 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] 10.222.0.16 "GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf" status: 200 len: 1351 microversion: 2.1 time: 0.671462 Oct 05 02:48:19.906392 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2168/4356] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:19 2022] GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf => generated 1351 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:19.959386 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-44ff7582-329e-4a25-a3dd-fcd96ac5531d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "25d4a551-686a-45bb-815b-84cb7bd751d1"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:48:19.963790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-44ff7582-329e-4a25-a3dd-fcd96ac5531d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: ae8e1003-15ab-4801-a026-e9d80e200d3c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:19.970572 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44ff7582-329e-4a25-a3dd-fcd96ac5531d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:19.971124 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44ff7582-329e-4a25-a3dd-fcd96ac5531d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:19.971622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44ff7582-329e-4a25-a3dd-fcd96ac5531d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:19.972332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44ff7582-329e-4a25-a3dd-fcd96ac5531d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:19.972788 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44ff7582-329e-4a25-a3dd-fcd96ac5531d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:19.973246 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44ff7582-329e-4a25-a3dd-fcd96ac5531d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:20.238685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-76f8c349-4d5c-4e16-9cd4-82fddc7fd0b0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:20.240094 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-76f8c349-4d5c-4e16-9cd4-82fddc7fd0b0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:20.258328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-76f8c349-4d5c-4e16-9cd4-82fddc7fd0b0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:20.263628 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-76f8c349-4d5c-4e16-9cd4-82fddc7fd0b0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:20.264081 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-76f8c349-4d5c-4e16-9cd4-82fddc7fd0b0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:20.264834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-76f8c349-4d5c-4e16-9cd4-82fddc7fd0b0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:20.265321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-76f8c349-4d5c-4e16-9cd4-82fddc7fd0b0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:20.265744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-76f8c349-4d5c-4e16-9cd4-82fddc7fd0b0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:20.417985 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-76f8c349-4d5c-4e16-9cd4-82fddc7fd0b0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:20.436409 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-76f8c349-4d5c-4e16-9cd4-82fddc7fd0b0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1272 microversion: 2.1 time: 0.203293 Oct 05 02:48:20.444140 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2169/4357] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:20 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1272 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:48:20.702461 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6ce11121-0ee3-44c3-bc5b-f0578b190520 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:20.703382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6ce11121-0ee3-44c3-bc5b-f0578b190520 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:20.717275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ce11121-0ee3-44c3-bc5b-f0578b190520 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:20.717857 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ce11121-0ee3-44c3-bc5b-f0578b190520 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:20.718533 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ce11121-0ee3-44c3-bc5b-f0578b190520 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:20.722179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ce11121-0ee3-44c3-bc5b-f0578b190520 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:20.722760 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ce11121-0ee3-44c3-bc5b-f0578b190520 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:20.723342 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ce11121-0ee3-44c3-bc5b-f0578b190520 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:20.936190 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-44ff7582-329e-4a25-a3dd-fcd96ac5531d tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "POST /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.982992 Oct 05 02:48:20.949781 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2189/4358] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 02:48:19 2022] POST /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c/os-volume_attachments => generated 194 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:48:20.956307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-358e5e22-baea-4a90-8709-09cf9a7dd366 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:20.957439 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-358e5e22-baea-4a90-8709-09cf9a7dd366 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:20.998335 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-358e5e22-baea-4a90-8709-09cf9a7dd366 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:21.002717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-358e5e22-baea-4a90-8709-09cf9a7dd366 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:21.003352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-358e5e22-baea-4a90-8709-09cf9a7dd366 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:21.004857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-358e5e22-baea-4a90-8709-09cf9a7dd366 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:21.007008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-358e5e22-baea-4a90-8709-09cf9a7dd366 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:21.021336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-358e5e22-baea-4a90-8709-09cf9a7dd366 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:22.150022 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-358e5e22-baea-4a90-8709-09cf9a7dd366 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:22.165620 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-358e5e22-baea-4a90-8709-09cf9a7dd366 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1323 microversion: 2.1 time: 1.212837 Oct 05 02:48:22.169112 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2190/4359] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:20 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1323 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:22.176057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4a1e0688-3249-4eed-9173-7569d16d9a17 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:22.177038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4a1e0688-3249-4eed-9173-7569d16d9a17 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] [instance: 1f810197-91e4-4965-b93b-bdd3bf2950bf] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:22.202146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a1e0688-3249-4eed-9173-7569d16d9a17 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:22.206427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a1e0688-3249-4eed-9173-7569d16d9a17 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:22.216044 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a1e0688-3249-4eed-9173-7569d16d9a17 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:22.217109 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a1e0688-3249-4eed-9173-7569d16d9a17 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:22.224557 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6ce11121-0ee3-44c3-bc5b-f0578b190520 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:22.225364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a1e0688-3249-4eed-9173-7569d16d9a17 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:22.226657 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a1e0688-3249-4eed-9173-7569d16d9a17 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:22.250490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6ce11121-0ee3-44c3-bc5b-f0578b190520 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:22.253274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6ce11121-0ee3-44c3-bc5b-f0578b190520 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:22.268525 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6ce11121-0ee3-44c3-bc5b-f0578b190520 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1879 microversion: 2.42 time: 1.570498 Oct 05 02:48:22.281993 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2170/4360] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:48:20 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1879 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:48:22.311895 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-64964793-f7e8-4322-bd83-b17d3f1a8cb7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:22.313003 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-64964793-f7e8-4322-bd83-b17d3f1a8cb7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:22.323051 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64964793-f7e8-4322-bd83-b17d3f1a8cb7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:22.326176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64964793-f7e8-4322-bd83-b17d3f1a8cb7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:22.327193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64964793-f7e8-4322-bd83-b17d3f1a8cb7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:22.328413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64964793-f7e8-4322-bd83-b17d3f1a8cb7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:22.329151 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64964793-f7e8-4322-bd83-b17d3f1a8cb7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:22.346713 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64964793-f7e8-4322-bd83-b17d3f1a8cb7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:22.578203 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-64964793-f7e8-4322-bd83-b17d3f1a8cb7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:22.590538 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-64964793-f7e8-4322-bd83-b17d3f1a8cb7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1272 microversion: 2.1 time: 0.307046 Oct 05 02:48:22.591143 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2171/4361] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:22 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1272 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:22.836219 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4a1e0688-3249-4eed-9173-7569d16d9a17 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569a3db98b7a44aeb902f7956af5a710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0fa4883254728921c0c49aa4e60b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:22.850541 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4a1e0688-3249-4eed-9173-7569d16d9a17 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] 10.222.0.16 "GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf" status: 200 len: 1540 microversion: 2.1 time: 0.679919 Oct 05 02:48:22.851802 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2191/4362] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:22 2022] GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf => generated 1540 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:22.874457 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d9db6302-43a4-4843-92c6-95e8f20c0043 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:22.874955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d9db6302-43a4-4843-92c6-95e8f20c0043 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] [instance: 1f810197-91e4-4965-b93b-bdd3bf2950bf] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:22.881696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d9db6302-43a4-4843-92c6-95e8f20c0043 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:22.882179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d9db6302-43a4-4843-92c6-95e8f20c0043 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:22.882612 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d9db6302-43a4-4843-92c6-95e8f20c0043 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:22.883312 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d9db6302-43a4-4843-92c6-95e8f20c0043 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:22.883948 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d9db6302-43a4-4843-92c6-95e8f20c0043 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:22.884548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d9db6302-43a4-4843-92c6-95e8f20c0043 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:23.190778 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-23328797-7656-47b4-bea4-0811efeaf97a tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:23.192116 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-23328797-7656-47b4-bea4-0811efeaf97a tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:23.201775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23328797-7656-47b4-bea4-0811efeaf97a tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:23.210909 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23328797-7656-47b4-bea4-0811efeaf97a tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:23.221686 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23328797-7656-47b4-bea4-0811efeaf97a tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:23.222631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23328797-7656-47b4-bea4-0811efeaf97a tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:23.223208 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23328797-7656-47b4-bea4-0811efeaf97a tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:23.223868 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23328797-7656-47b4-bea4-0811efeaf97a tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:23.398908 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d9db6302-43a4-4843-92c6-95e8f20c0043 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] 10.222.0.16 "GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.528915 Oct 05 02:48:23.400261 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2172/4363] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 02:48:22 2022] GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf/os-interface => generated 284 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:48:23.407192 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2fa92c6a-dbee-4139-b152-106a81a4fd16 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:23.408098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2fa92c6a-dbee-4139-b152-106a81a4fd16 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:23.431311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fa92c6a-dbee-4139-b152-106a81a4fd16 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:23.433739 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fa92c6a-dbee-4139-b152-106a81a4fd16 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:23.440955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fa92c6a-dbee-4139-b152-106a81a4fd16 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:23.443724 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fa92c6a-dbee-4139-b152-106a81a4fd16 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:23.444487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fa92c6a-dbee-4139-b152-106a81a4fd16 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:23.447226 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fa92c6a-dbee-4139-b152-106a81a4fd16 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:24.420066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-23328797-7656-47b4-bea4-0811efeaf97a tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:24.433306 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-23328797-7656-47b4-bea4-0811efeaf97a tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1323 microversion: 2.1 time: 1.245048 Oct 05 02:48:24.437347 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2192/4364] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:23 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1323 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:48:24.454871 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c0771219-af26-415a-ad3e-df7854e9b640 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:24.456124 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c0771219-af26-415a-ad3e-df7854e9b640 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:24.466362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c0771219-af26-415a-ad3e-df7854e9b640 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:24.467289 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c0771219-af26-415a-ad3e-df7854e9b640 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:24.469682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c0771219-af26-415a-ad3e-df7854e9b640 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:24.470712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c0771219-af26-415a-ad3e-df7854e9b640 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:24.471519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c0771219-af26-415a-ad3e-df7854e9b640 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:24.472156 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c0771219-af26-415a-ad3e-df7854e9b640 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:24.587216 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2fa92c6a-dbee-4139-b152-106a81a4fd16 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:24.599822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2fa92c6a-dbee-4139-b152-106a81a4fd16 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:24.601892 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2fa92c6a-dbee-4139-b152-106a81a4fd16 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:24.603588 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2fa92c6a-dbee-4139-b152-106a81a4fd16 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 2838 microversion: 2.42 time: 1.202131 Oct 05 02:48:24.605264 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2173/4365] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:48:23 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 2838 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:48:24.636499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dd22d5fd-7759-4167-9c2d-0792bf38f267 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:24.637551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-dd22d5fd-7759-4167-9c2d-0792bf38f267 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:24.645710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dd22d5fd-7759-4167-9c2d-0792bf38f267 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:24.646594 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dd22d5fd-7759-4167-9c2d-0792bf38f267 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:24.647260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dd22d5fd-7759-4167-9c2d-0792bf38f267 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:24.648368 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dd22d5fd-7759-4167-9c2d-0792bf38f267 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:24.655204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dd22d5fd-7759-4167-9c2d-0792bf38f267 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:24.656135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dd22d5fd-7759-4167-9c2d-0792bf38f267 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:25.210980 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-dd22d5fd-7759-4167-9c2d-0792bf38f267 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.579771 Oct 05 02:48:25.211791 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2174/4366] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Oct 5 02:48:24 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87/os-interface => generated 1832 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:48:25.221283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-642c3a43-c1cc-47e7-b1d8-9ac2c8958db1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:48:25.225083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-642c3a43-c1cc-47e7-b1d8-9ac2c8958db1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:25.246365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-642c3a43-c1cc-47e7-b1d8-9ac2c8958db1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:25.248359 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-642c3a43-c1cc-47e7-b1d8-9ac2c8958db1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:25.249049 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-642c3a43-c1cc-47e7-b1d8-9ac2c8958db1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:25.252640 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-642c3a43-c1cc-47e7-b1d8-9ac2c8958db1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:25.253577 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-642c3a43-c1cc-47e7-b1d8-9ac2c8958db1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:25.254306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-642c3a43-c1cc-47e7-b1d8-9ac2c8958db1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:25.376989 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-642c3a43-c1cc-47e7-b1d8-9ac2c8958db1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action" status: 202 len: 0 microversion: 2.1 time: 0.163696 Oct 05 02:48:25.378438 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2175/4367] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:48:25 2022] POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:48:25.399919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3e5d84a9-1692-4b53-a53d-4be03132fd67 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:25.401184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3e5d84a9-1692-4b53-a53d-4be03132fd67 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:25.415521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e5d84a9-1692-4b53-a53d-4be03132fd67 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:25.416314 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e5d84a9-1692-4b53-a53d-4be03132fd67 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:25.417431 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e5d84a9-1692-4b53-a53d-4be03132fd67 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:25.418408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e5d84a9-1692-4b53-a53d-4be03132fd67 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:25.419116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e5d84a9-1692-4b53-a53d-4be03132fd67 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:25.419765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e5d84a9-1692-4b53-a53d-4be03132fd67 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:25.801503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:48:26.083658 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:48:26.681176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3e5d84a9-1692-4b53-a53d-4be03132fd67 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:26.693909 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c0771219-af26-415a-ad3e-df7854e9b640 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:26.694762 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3e5d84a9-1692-4b53-a53d-4be03132fd67 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1671 microversion: 2.1 time: 1.301059 Oct 05 02:48:26.711220 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2176/4368] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:25 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1671 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:26.719976 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c0771219-af26-415a-ad3e-df7854e9b640 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1314 microversion: 2.1 time: 2.279599 Oct 05 02:48:26.720166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8fad2c6c-8e01-4a6a-b975-aa42e00c3a15 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:26.720489 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2193/4369] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:24 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1314 bytes in 2283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:26.725124 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-47f75788-b658-4c43-892b-43b42e525da6 req-6caa4f7f-8750-4a3a-8024-d24dfd0d47f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a711b7d-3d62-4118-aa2f-985160e79ffb", "tag": "93af56e9-cedc-4b3b-80a7-2c94ef741a18"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:48:26.741656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8fad2c6c-8e01-4a6a-b975-aa42e00c3a15 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:26.751982 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-47f75788-b658-4c43-892b-43b42e525da6 req-6caa4f7f-8750-4a3a-8024-d24dfd0d47f7 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:26.753731 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8fad2c6c-8e01-4a6a-b975-aa42e00c3a15 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:26.755035 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8fad2c6c-8e01-4a6a-b975-aa42e00c3a15 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:26.755720 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8fad2c6c-8e01-4a6a-b975-aa42e00c3a15 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:26.756646 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-47f75788-b658-4c43-892b-43b42e525da6 req-6caa4f7f-8750-4a3a-8024-d24dfd0d47f7 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:26.757126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-47f75788-b658-4c43-892b-43b42e525da6 req-6caa4f7f-8750-4a3a-8024-d24dfd0d47f7 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:26.758179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8fad2c6c-8e01-4a6a-b975-aa42e00c3a15 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:26.759050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8fad2c6c-8e01-4a6a-b975-aa42e00c3a15 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:26.759906 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8fad2c6c-8e01-4a6a-b975-aa42e00c3a15 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:26.790884 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-47f75788-b658-4c43-892b-43b42e525da6 req-6caa4f7f-8750-4a3a-8024-d24dfd0d47f7 service nova] Creating event network-changed:93af56e9-cedc-4b3b-80a7-2c94ef741a18 for instance 3a711b7d-3d62-4118-aa2f-985160e79ffb on n-h1-858272-3 Oct 05 02:48:26.800448 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-47f75788-b658-4c43-892b-43b42e525da6 req-6caa4f7f-8750-4a3a-8024-d24dfd0d47f7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078646 Oct 05 02:48:26.804389 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2194/4370] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:48:26.915802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=8 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:48:27.724005 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2f16d5b3-e2ac-46c5-9739-7816517f8c31 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:27.725359 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2f16d5b3-e2ac-46c5-9739-7816517f8c31 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:27.734462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=8 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:48:27.739185 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f16d5b3-e2ac-46c5-9739-7816517f8c31 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:27.745942 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f16d5b3-e2ac-46c5-9739-7816517f8c31 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:27.746891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f16d5b3-e2ac-46c5-9739-7816517f8c31 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:27.747801 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f16d5b3-e2ac-46c5-9739-7816517f8c31 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:27.748417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f16d5b3-e2ac-46c5-9739-7816517f8c31 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:27.749089 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f16d5b3-e2ac-46c5-9739-7816517f8c31 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:27.755137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8fad2c6c-8e01-4a6a-b975-aa42e00c3a15 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:27.771403 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8fad2c6c-8e01-4a6a-b975-aa42e00c3a15 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1323 microversion: 2.1 time: 1.058253 Oct 05 02:48:27.772508 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2177/4371] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:26 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1323 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:27.787153 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a4a9c263-d364-49cd-b176-ea64bcddc9c8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:27.788624 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a4a9c263-d364-49cd-b176-ea64bcddc9c8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:27.800554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a4a9c263-d364-49cd-b176-ea64bcddc9c8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:27.803491 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a4a9c263-d364-49cd-b176-ea64bcddc9c8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:27.804964 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a4a9c263-d364-49cd-b176-ea64bcddc9c8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:27.804964 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a4a9c263-d364-49cd-b176-ea64bcddc9c8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:27.809750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a4a9c263-d364-49cd-b176-ea64bcddc9c8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:27.810253 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a4a9c263-d364-49cd-b176-ea64bcddc9c8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:28.419110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2f16d5b3-e2ac-46c5-9739-7816517f8c31 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:28.431385 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2f16d5b3-e2ac-46c5-9739-7816517f8c31 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1676 microversion: 2.1 time: 0.711571 Oct 05 02:48:28.445184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a4a9c263-d364-49cd-b176-ea64bcddc9c8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:28.445184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:48:28.446676 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2195/4372] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:27 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1676 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:28.470730 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a4a9c263-d364-49cd-b176-ea64bcddc9c8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1314 microversion: 2.1 time: 0.696263 Oct 05 02:48:28.485930 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2178/4373] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:27 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1314 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:28.800757 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f053702c-03a3-4670-9802-bf3349181126 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:28.802075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f053702c-03a3-4670-9802-bf3349181126 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:28.805648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:48:28.825570 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f053702c-03a3-4670-9802-bf3349181126 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:28.826296 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f053702c-03a3-4670-9802-bf3349181126 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:28.826915 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f053702c-03a3-4670-9802-bf3349181126 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:28.827831 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f053702c-03a3-4670-9802-bf3349181126 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:28.828460 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f053702c-03a3-4670-9802-bf3349181126 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:28.829201 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f053702c-03a3-4670-9802-bf3349181126 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:29.458949 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2b7eb54b-a9df-40a5-8867-59e9499cf074 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:29.460633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2b7eb54b-a9df-40a5-8867-59e9499cf074 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:29.478741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b7eb54b-a9df-40a5-8867-59e9499cf074 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:29.481956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b7eb54b-a9df-40a5-8867-59e9499cf074 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:29.483833 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b7eb54b-a9df-40a5-8867-59e9499cf074 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:29.484839 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b7eb54b-a9df-40a5-8867-59e9499cf074 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:29.488175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b7eb54b-a9df-40a5-8867-59e9499cf074 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:29.488981 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b7eb54b-a9df-40a5-8867-59e9499cf074 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:30.106971 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f053702c-03a3-4670-9802-bf3349181126 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:30.118986 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f053702c-03a3-4670-9802-bf3349181126 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1323 microversion: 2.1 time: 1.320493 Oct 05 02:48:30.119592 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2196/4374] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:28 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1323 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:30.134589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4828c9fc-f396-4709-96a1-88e986eda566 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:30.145754 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4828c9fc-f396-4709-96a1-88e986eda566 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:30.158662 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4828c9fc-f396-4709-96a1-88e986eda566 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:30.159015 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4828c9fc-f396-4709-96a1-88e986eda566 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:30.159447 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4828c9fc-f396-4709-96a1-88e986eda566 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:30.177537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4828c9fc-f396-4709-96a1-88e986eda566 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:30.178065 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4828c9fc-f396-4709-96a1-88e986eda566 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:30.178516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4828c9fc-f396-4709-96a1-88e986eda566 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:30.452605 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2b7eb54b-a9df-40a5-8867-59e9499cf074 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:30.467267 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2b7eb54b-a9df-40a5-8867-59e9499cf074 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1676 microversion: 2.1 time: 1.011322 Oct 05 02:48:30.469935 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2179/4375] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:29 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1676 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:48:30.481098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-818fe9b1-80f9-4207-b57d-858e0b288448 req-07cfaedf-7767-4ce2-913a-f2bcb44a17b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ec0ae24-68e3-4673-a177-50594e62bff2", "tag": "5a6793ab-1647-4586-abc2-bc083a2d1fdf"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:48:30.510620 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-818fe9b1-80f9-4207-b57d-858e0b288448 req-07cfaedf-7767-4ce2-913a-f2bcb44a17b0 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:30.511440 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-818fe9b1-80f9-4207-b57d-858e0b288448 req-07cfaedf-7767-4ce2-913a-f2bcb44a17b0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:30.512490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-818fe9b1-80f9-4207-b57d-858e0b288448 req-07cfaedf-7767-4ce2-913a-f2bcb44a17b0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:30.537743 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-818fe9b1-80f9-4207-b57d-858e0b288448 req-07cfaedf-7767-4ce2-913a-f2bcb44a17b0 service nova] Creating event network-changed:5a6793ab-1647-4586-abc2-bc083a2d1fdf for instance 8ec0ae24-68e3-4673-a177-50594e62bff2 on n-h1-858272-3 Oct 05 02:48:30.548192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4828c9fc-f396-4709-96a1-88e986eda566 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:30.556449 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-818fe9b1-80f9-4207-b57d-858e0b288448 req-07cfaedf-7767-4ce2-913a-f2bcb44a17b0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083071 Oct 05 02:48:30.557391 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2180/4376] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:48:30.559558 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4828c9fc-f396-4709-96a1-88e986eda566 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1314 microversion: 2.1 time: 0.435537 Oct 05 02:48:30.563359 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2197/4377] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:30 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:31.154973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c45f3596-2acd-4a07-9df7-924da3696312 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:31.156920 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c45f3596-2acd-4a07-9df7-924da3696312 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:31.174883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c45f3596-2acd-4a07-9df7-924da3696312 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:31.175674 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c45f3596-2acd-4a07-9df7-924da3696312 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:31.176332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c45f3596-2acd-4a07-9df7-924da3696312 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:31.177442 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c45f3596-2acd-4a07-9df7-924da3696312 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:31.179851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c45f3596-2acd-4a07-9df7-924da3696312 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:31.180537 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c45f3596-2acd-4a07-9df7-924da3696312 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:31.384095 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c45f3596-2acd-4a07-9df7-924da3696312 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:31.394311 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c45f3596-2acd-4a07-9df7-924da3696312 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1323 microversion: 2.1 time: 0.251296 Oct 05 02:48:31.395857 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2181/4378] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:31 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1323 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:31.504411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c622a6af-82a0-416d-87ad-b6449d401035 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:31.505843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c622a6af-82a0-416d-87ad-b6449d401035 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:31.517440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c622a6af-82a0-416d-87ad-b6449d401035 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:31.518429 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c622a6af-82a0-416d-87ad-b6449d401035 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:31.519059 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c622a6af-82a0-416d-87ad-b6449d401035 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:31.520115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c622a6af-82a0-416d-87ad-b6449d401035 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:31.520764 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c622a6af-82a0-416d-87ad-b6449d401035 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:31.521720 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c622a6af-82a0-416d-87ad-b6449d401035 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:31.587166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-aaecb270-fb7a-4426-9a62-95062be55416 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:31.588637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-aaecb270-fb7a-4426-9a62-95062be55416 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:31.599572 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:48:31.601936 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aaecb270-fb7a-4426-9a62-95062be55416 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:31.602763 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aaecb270-fb7a-4426-9a62-95062be55416 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:31.610699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aaecb270-fb7a-4426-9a62-95062be55416 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:31.611985 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aaecb270-fb7a-4426-9a62-95062be55416 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:31.613027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aaecb270-fb7a-4426-9a62-95062be55416 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:31.613786 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aaecb270-fb7a-4426-9a62-95062be55416 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:31.772581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c622a6af-82a0-416d-87ad-b6449d401035 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:31.781756 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c622a6af-82a0-416d-87ad-b6449d401035 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1676 microversion: 2.1 time: 0.287343 Oct 05 02:48:31.795676 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2198/4379] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:31 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1676 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:31.882834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-aaecb270-fb7a-4426-9a62-95062be55416 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:31.892606 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-aaecb270-fb7a-4426-9a62-95062be55416 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1314 microversion: 2.1 time: 0.310016 Oct 05 02:48:31.893550 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2182/4380] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:31 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:32.419013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7267e98a-c307-4ee3-ba74-1ff57bde1bee tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:32.419645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7267e98a-c307-4ee3-ba74-1ff57bde1bee tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:32.425946 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7267e98a-c307-4ee3-ba74-1ff57bde1bee tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:32.426699 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7267e98a-c307-4ee3-ba74-1ff57bde1bee tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:32.427134 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7267e98a-c307-4ee3-ba74-1ff57bde1bee tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:32.428222 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7267e98a-c307-4ee3-ba74-1ff57bde1bee tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:32.428924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7267e98a-c307-4ee3-ba74-1ff57bde1bee tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:32.429588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7267e98a-c307-4ee3-ba74-1ff57bde1bee tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:32.458675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:48:32.579715 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-93d6b9d1-dd6f-4674-8153-08fb262584bb req-dab98e6c-5c6c-4529-81ed-12d8a211e707 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f810197-91e4-4965-b93b-bdd3bf2950bf", "tag": "7927478e-de48-49be-ab91-0b118325717e"}, {"name": "network-changed", "server_uuid": "a710dba5-18ef-4840-835b-06b1fc2bde87", "tag": "432071a7-edac-416f-aec1-3041b15ece3c"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:48:32.583611 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7267e98a-c307-4ee3-ba74-1ff57bde1bee tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:32.592668 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-93d6b9d1-dd6f-4674-8153-08fb262584bb req-dab98e6c-5c6c-4529-81ed-12d8a211e707 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:32.593183 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-93d6b9d1-dd6f-4674-8153-08fb262584bb req-dab98e6c-5c6c-4529-81ed-12d8a211e707 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:32.593301 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7267e98a-c307-4ee3-ba74-1ff57bde1bee tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1323 microversion: 2.1 time: 0.178069 Oct 05 02:48:32.593653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-93d6b9d1-dd6f-4674-8153-08fb262584bb req-dab98e6c-5c6c-4529-81ed-12d8a211e707 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:32.594215 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2199/4381] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:32 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1323 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:32.609533 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-93d6b9d1-dd6f-4674-8153-08fb262584bb req-dab98e6c-5c6c-4529-81ed-12d8a211e707 service nova] Creating event network-changed:7927478e-de48-49be-ab91-0b118325717e for instance 1f810197-91e4-4965-b93b-bdd3bf2950bf on n-h2-858272-3 Oct 05 02:48:32.610053 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-93d6b9d1-dd6f-4674-8153-08fb262584bb req-dab98e6c-5c6c-4529-81ed-12d8a211e707 service nova] Creating event network-changed:432071a7-edac-416f-aec1-3041b15ece3c for instance a710dba5-18ef-4840-835b-06b1fc2bde87 on n-h1-858272-3 Oct 05 02:48:32.619712 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-93d6b9d1-dd6f-4674-8153-08fb262584bb req-dab98e6c-5c6c-4529-81ed-12d8a211e707 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.046144 Oct 05 02:48:32.621287 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2183/4382] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:48:32.810726 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5b2ba8a6-703e-40f5-b933-2a15d504abbc tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:32.812110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5b2ba8a6-703e-40f5-b933-2a15d504abbc tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:32.821347 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b2ba8a6-703e-40f5-b933-2a15d504abbc tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:32.822234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b2ba8a6-703e-40f5-b933-2a15d504abbc tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:32.822696 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b2ba8a6-703e-40f5-b933-2a15d504abbc tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:32.849571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b2ba8a6-703e-40f5-b933-2a15d504abbc tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:32.853084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b2ba8a6-703e-40f5-b933-2a15d504abbc tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:32.857190 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b2ba8a6-703e-40f5-b933-2a15d504abbc tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:32.920973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9008e2d9-8cb0-4309-b36e-7f7c63794664 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:32.922137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9008e2d9-8cb0-4309-b36e-7f7c63794664 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:32.929496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9008e2d9-8cb0-4309-b36e-7f7c63794664 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:32.930522 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9008e2d9-8cb0-4309-b36e-7f7c63794664 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:32.931180 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9008e2d9-8cb0-4309-b36e-7f7c63794664 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:32.932299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9008e2d9-8cb0-4309-b36e-7f7c63794664 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:32.933701 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9008e2d9-8cb0-4309-b36e-7f7c63794664 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:32.934564 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9008e2d9-8cb0-4309-b36e-7f7c63794664 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:33.368674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5b2ba8a6-703e-40f5-b933-2a15d504abbc tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:33.396155 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5b2ba8a6-703e-40f5-b933-2a15d504abbc tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1676 microversion: 2.1 time: 0.591742 Oct 05 02:48:33.397591 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2200/4383] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:32 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1676 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:33.589651 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9008e2d9-8cb0-4309-b36e-7f7c63794664 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:33.597651 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9008e2d9-8cb0-4309-b36e-7f7c63794664 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1314 microversion: 2.1 time: 0.681618 Oct 05 02:48:33.609297 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2184/4384] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:32 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1314 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:33.623632 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2b10a77a-b85a-449c-9393-202abe687a97 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:33.625424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2b10a77a-b85a-449c-9393-202abe687a97 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:33.634554 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b10a77a-b85a-449c-9393-202abe687a97 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:33.635283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b10a77a-b85a-449c-9393-202abe687a97 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:33.635921 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b10a77a-b85a-449c-9393-202abe687a97 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:33.636925 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b10a77a-b85a-449c-9393-202abe687a97 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:33.637528 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b10a77a-b85a-449c-9393-202abe687a97 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:33.638136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b10a77a-b85a-449c-9393-202abe687a97 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:33.968796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2b10a77a-b85a-449c-9393-202abe687a97 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:33.977551 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2b10a77a-b85a-449c-9393-202abe687a97 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1323 microversion: 2.1 time: 0.363038 Oct 05 02:48:33.979067 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2201/4385] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:33 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1323 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:34.420666 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e263faf4-59fe-469c-9d64-7ca3ddaf3223 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:34.421252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e263faf4-59fe-469c-9d64-7ca3ddaf3223 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:34.428382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e263faf4-59fe-469c-9d64-7ca3ddaf3223 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:34.428867 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e263faf4-59fe-469c-9d64-7ca3ddaf3223 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:34.429336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e263faf4-59fe-469c-9d64-7ca3ddaf3223 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:34.430026 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e263faf4-59fe-469c-9d64-7ca3ddaf3223 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:34.430506 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e263faf4-59fe-469c-9d64-7ca3ddaf3223 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:34.430975 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e263faf4-59fe-469c-9d64-7ca3ddaf3223 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:34.625498 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-52fd0869-815c-4cf4-bbab-ec3b3e13d618 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:34.626415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-52fd0869-815c-4cf4-bbab-ec3b3e13d618 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:34.632438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52fd0869-815c-4cf4-bbab-ec3b3e13d618 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:34.633036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52fd0869-815c-4cf4-bbab-ec3b3e13d618 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:34.633472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52fd0869-815c-4cf4-bbab-ec3b3e13d618 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:34.634296 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52fd0869-815c-4cf4-bbab-ec3b3e13d618 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:34.634601 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52fd0869-815c-4cf4-bbab-ec3b3e13d618 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:34.635023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52fd0869-815c-4cf4-bbab-ec3b3e13d618 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:34.725233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e263faf4-59fe-469c-9d64-7ca3ddaf3223 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:34.734220 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e263faf4-59fe-469c-9d64-7ca3ddaf3223 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.318108 Oct 05 02:48:34.735111 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2185/4386] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:34 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:35.005925 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-888613b8-36a6-4caa-83b6-a16a8553c6c1 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:35.006498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-888613b8-36a6-4caa-83b6-a16a8553c6c1 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:35.013403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-888613b8-36a6-4caa-83b6-a16a8553c6c1 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:35.013909 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-888613b8-36a6-4caa-83b6-a16a8553c6c1 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:35.014356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-888613b8-36a6-4caa-83b6-a16a8553c6c1 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:35.015066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-888613b8-36a6-4caa-83b6-a16a8553c6c1 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:35.015530 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-888613b8-36a6-4caa-83b6-a16a8553c6c1 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:35.015962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-888613b8-36a6-4caa-83b6-a16a8553c6c1 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:35.294779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-52fd0869-815c-4cf4-bbab-ec3b3e13d618 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:35.302594 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-52fd0869-815c-4cf4-bbab-ec3b3e13d618 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1314 microversion: 2.1 time: 0.681276 Oct 05 02:48:35.303179 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2202/4387] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:34 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1314 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:48:35.328032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-888613b8-36a6-4caa-83b6-a16a8553c6c1 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:35.335666 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-888613b8-36a6-4caa-83b6-a16a8553c6c1 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1323 microversion: 2.1 time: 0.333842 Oct 05 02:48:35.336363 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2186/4388] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:35 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1323 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:48:36.326413 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b962bd23-fba3-4d0f-9b42-1c01e5110f8a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:36.327730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b962bd23-fba3-4d0f-9b42-1c01e5110f8a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:36.335374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b962bd23-fba3-4d0f-9b42-1c01e5110f8a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:36.335939 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b962bd23-fba3-4d0f-9b42-1c01e5110f8a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:36.336439 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b962bd23-fba3-4d0f-9b42-1c01e5110f8a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:36.337251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b962bd23-fba3-4d0f-9b42-1c01e5110f8a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:36.337778 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b962bd23-fba3-4d0f-9b42-1c01e5110f8a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:36.338272 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b962bd23-fba3-4d0f-9b42-1c01e5110f8a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:36.359774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a53ead98-8eec-4226-9fa1-cf3e3f83e739 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:36.361098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a53ead98-8eec-4226-9fa1-cf3e3f83e739 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:36.373432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a53ead98-8eec-4226-9fa1-cf3e3f83e739 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:36.374552 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a53ead98-8eec-4226-9fa1-cf3e3f83e739 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:36.375157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a53ead98-8eec-4226-9fa1-cf3e3f83e739 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:36.376077 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a53ead98-8eec-4226-9fa1-cf3e3f83e739 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:36.376687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a53ead98-8eec-4226-9fa1-cf3e3f83e739 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:36.377294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a53ead98-8eec-4226-9fa1-cf3e3f83e739 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:36.593319 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b962bd23-fba3-4d0f-9b42-1c01e5110f8a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:36.603436 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a53ead98-8eec-4226-9fa1-cf3e3f83e739 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:36.603636 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b962bd23-fba3-4d0f-9b42-1c01e5110f8a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1314 microversion: 2.1 time: 0.281228 Oct 05 02:48:36.604414 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2203/4389] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:36 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:36.616053 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a53ead98-8eec-4226-9fa1-cf3e3f83e739 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1323 microversion: 2.1 time: 0.261060 Oct 05 02:48:36.617471 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2187/4390] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:36 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1323 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:48:36.803282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-464908ff-3cfc-47a8-8088-412ab932aa20 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:36.805854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-464908ff-3cfc-47a8-8088-412ab932aa20 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: ae8e1003-15ab-4801-a026-e9d80e200d3c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:36.812672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-464908ff-3cfc-47a8-8088-412ab932aa20 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:36.813193 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-464908ff-3cfc-47a8-8088-412ab932aa20 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:36.813627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-464908ff-3cfc-47a8-8088-412ab932aa20 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:36.814324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-464908ff-3cfc-47a8-8088-412ab932aa20 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:36.814774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-464908ff-3cfc-47a8-8088-412ab932aa20 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:36.815192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-464908ff-3cfc-47a8-8088-412ab932aa20 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:36.848431 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-464908ff-3cfc-47a8-8088-412ab932aa20 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049061 Oct 05 02:48:36.849333 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2204/4391] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 02:48:36 2022] GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:48:36.990680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8a79be26-b738-4221-a2c1-8e00844274ae tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:36.991431 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8a79be26-b738-4221-a2c1-8e00844274ae tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: ae8e1003-15ab-4801-a026-e9d80e200d3c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:36.998889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a79be26-b738-4221-a2c1-8e00844274ae tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:36.999789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a79be26-b738-4221-a2c1-8e00844274ae tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:37.000595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a79be26-b738-4221-a2c1-8e00844274ae tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:37.002216 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a79be26-b738-4221-a2c1-8e00844274ae tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:37.003703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a79be26-b738-4221-a2c1-8e00844274ae tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:37.005264 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a79be26-b738-4221-a2c1-8e00844274ae tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:37.041237 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8a79be26-b738-4221-a2c1-8e00844274ae tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c/os-volume_attachments/4153e1c4-82d0-4d4b-b19d-14a20b70c4d2" status: 200 len: 194 microversion: 2.1 time: 0.055070 Oct 05 02:48:37.049098 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2188/4392] 10.222.0.16 () {58 vars in 1413 bytes} [Wed Oct 5 02:48:36 2022] GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c/os-volume_attachments/4153e1c4-82d0-4d4b-b19d-14a20b70c4d2 => generated 194 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:48:37.053996 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-83342767-01fd-4861-9a2b-03c50e35410f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:37.054540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-83342767-01fd-4861-9a2b-03c50e35410f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: ae8e1003-15ab-4801-a026-e9d80e200d3c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:37.061739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83342767-01fd-4861-9a2b-03c50e35410f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:37.062234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83342767-01fd-4861-9a2b-03c50e35410f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:37.062675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83342767-01fd-4861-9a2b-03c50e35410f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:37.063382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83342767-01fd-4861-9a2b-03c50e35410f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:37.063880 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83342767-01fd-4861-9a2b-03c50e35410f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:37.064305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83342767-01fd-4861-9a2b-03c50e35410f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:37.155618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-83342767-01fd-4861-9a2b-03c50e35410f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lazy-loading 'services' on Instance uuid ae8e1003-15ab-4801-a026-e9d80e200d3c {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:48:37.240601 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-83342767-01fd-4861-9a2b-03c50e35410f tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c/os-volume_attachments/4153e1c4-82d0-4d4b-b19d-14a20b70c4d2" status: 202 len: 0 microversion: 2.1 time: 0.190794 Oct 05 02:48:37.242065 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2205/4393] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 02:48:37 2022] DELETE /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c/os-volume_attachments/4153e1c4-82d0-4d4b-b19d-14a20b70c4d2 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 02:48:37.630287 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-524845cf-30e4-40be-a9ff-6b934e3f6b23 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:37.630932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-524845cf-30e4-40be-a9ff-6b934e3f6b23 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:37.638740 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-524845cf-30e4-40be-a9ff-6b934e3f6b23 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:37.639162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-524845cf-30e4-40be-a9ff-6b934e3f6b23 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:37.639598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-524845cf-30e4-40be-a9ff-6b934e3f6b23 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:37.640294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-524845cf-30e4-40be-a9ff-6b934e3f6b23 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:37.640746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-524845cf-30e4-40be-a9ff-6b934e3f6b23 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:37.641205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-524845cf-30e4-40be-a9ff-6b934e3f6b23 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:37.642162 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1a93e67a-3811-467d-826a-ffcc69f4baff tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:37.642945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1a93e67a-3811-467d-826a-ffcc69f4baff tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:37.650353 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a93e67a-3811-467d-826a-ffcc69f4baff tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:37.651041 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a93e67a-3811-467d-826a-ffcc69f4baff tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:37.651814 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a93e67a-3811-467d-826a-ffcc69f4baff tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:37.652733 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a93e67a-3811-467d-826a-ffcc69f4baff tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:37.653356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a93e67a-3811-467d-826a-ffcc69f4baff tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:37.653960 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a93e67a-3811-467d-826a-ffcc69f4baff tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:37.863469 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-524845cf-30e4-40be-a9ff-6b934e3f6b23 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:37.864658 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1a93e67a-3811-467d-826a-ffcc69f4baff tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:37.877844 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-524845cf-30e4-40be-a9ff-6b934e3f6b23 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1314 microversion: 2.1 time: 0.251546 Oct 05 02:48:37.878054 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1a93e67a-3811-467d-826a-ffcc69f4baff tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1323 microversion: 2.1 time: 0.240790 Oct 05 02:48:37.879067 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2206/4394] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:37 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1323 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:48:37.904222 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2189/4395] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:37 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:38.905279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c3a8c702-ef4c-43b8-903d-b729821a6da6 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:38.906515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c3a8c702-ef4c-43b8-903d-b729821a6da6 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:38.921207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3a8c702-ef4c-43b8-903d-b729821a6da6 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:38.921716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3a8c702-ef4c-43b8-903d-b729821a6da6 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:38.923629 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3a8c702-ef4c-43b8-903d-b729821a6da6 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:38.923629 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3a8c702-ef4c-43b8-903d-b729821a6da6 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:38.923629 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3a8c702-ef4c-43b8-903d-b729821a6da6 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:38.925220 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3a8c702-ef4c-43b8-903d-b729821a6da6 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:38.930367 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-468cc475-3ca6-48bc-a3a5-3626f811f443 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:38.935189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-468cc475-3ca6-48bc-a3a5-3626f811f443 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:38.947172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-468cc475-3ca6-48bc-a3a5-3626f811f443 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:38.947927 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-468cc475-3ca6-48bc-a3a5-3626f811f443 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:38.949343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-468cc475-3ca6-48bc-a3a5-3626f811f443 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:38.950236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-468cc475-3ca6-48bc-a3a5-3626f811f443 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:38.950860 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-468cc475-3ca6-48bc-a3a5-3626f811f443 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:38.951445 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-468cc475-3ca6-48bc-a3a5-3626f811f443 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:39.249103 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c3a8c702-ef4c-43b8-903d-b729821a6da6 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:39.262655 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c3a8c702-ef4c-43b8-903d-b729821a6da6 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1323 microversion: 2.1 time: 0.361487 Oct 05 02:48:39.263243 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2207/4396] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:38 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1323 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:39.267877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-a426e150-e179-45e3-99ae-8abdc289d854 req-023c48ca-4841-4006-907a-dbe2a13659c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a711b7d-3d62-4118-aa2f-985160e79ffb", "name": "network-vif-plugged", "status": "completed", "tag": "93af56e9-cedc-4b3b-80a7-2c94ef741a18"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:48:39.277900 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-468cc475-3ca6-48bc-a3a5-3626f811f443 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:39.287944 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a426e150-e179-45e3-99ae-8abdc289d854 req-023c48ca-4841-4006-907a-dbe2a13659c7 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:39.291697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a426e150-e179-45e3-99ae-8abdc289d854 req-023c48ca-4841-4006-907a-dbe2a13659c7 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:39.292042 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-468cc475-3ca6-48bc-a3a5-3626f811f443 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1314 microversion: 2.1 time: 0.365674 Oct 05 02:48:39.292364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a426e150-e179-45e3-99ae-8abdc289d854 req-023c48ca-4841-4006-907a-dbe2a13659c7 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:39.310248 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2190/4397] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:38 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:39.319435 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-a426e150-e179-45e3-99ae-8abdc289d854 req-023c48ca-4841-4006-907a-dbe2a13659c7 service nova] Creating event network-vif-plugged:93af56e9-cedc-4b3b-80a7-2c94ef741a18 for instance 3a711b7d-3d62-4118-aa2f-985160e79ffb on n-h1-858272-3 Oct 05 02:48:39.339311 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-a426e150-e179-45e3-99ae-8abdc289d854 req-023c48ca-4841-4006-907a-dbe2a13659c7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074112 Oct 05 02:48:39.340041 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2208/4398] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:48:40.289027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ffddf98c-2786-430d-9d73-e310110267ca tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:40.289650 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ffddf98c-2786-430d-9d73-e310110267ca tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:40.306244 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ffddf98c-2786-430d-9d73-e310110267ca tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:40.307276 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ffddf98c-2786-430d-9d73-e310110267ca tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:40.308229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ffddf98c-2786-430d-9d73-e310110267ca tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:40.309344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ffddf98c-2786-430d-9d73-e310110267ca tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:40.310230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ffddf98c-2786-430d-9d73-e310110267ca tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:40.310857 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ffddf98c-2786-430d-9d73-e310110267ca tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:40.326919 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-da3fae82-b441-4e49-8ebe-311c136bd739 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:40.328881 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-da3fae82-b441-4e49-8ebe-311c136bd739 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:40.363666 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-da3fae82-b441-4e49-8ebe-311c136bd739 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:40.365866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-da3fae82-b441-4e49-8ebe-311c136bd739 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:40.367180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-da3fae82-b441-4e49-8ebe-311c136bd739 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:40.368469 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-da3fae82-b441-4e49-8ebe-311c136bd739 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:40.369434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-da3fae82-b441-4e49-8ebe-311c136bd739 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:40.370357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-da3fae82-b441-4e49-8ebe-311c136bd739 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:41.128184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ffddf98c-2786-430d-9d73-e310110267ca tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:41.136397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-da3fae82-b441-4e49-8ebe-311c136bd739 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:41.145417 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-da3fae82-b441-4e49-8ebe-311c136bd739 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1314 microversion: 2.1 time: 0.825280 Oct 05 02:48:41.149202 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ffddf98c-2786-430d-9d73-e310110267ca tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1323 microversion: 2.1 time: 0.863692 Oct 05 02:48:41.152879 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2191/4399] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:40 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1323 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:41.161838 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2209/4400] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:40 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1314 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:42.170279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9ac747eb-4057-4dfa-8f86-98ec58a536d3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:42.170908 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9ac747eb-4057-4dfa-8f86-98ec58a536d3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:42.181308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ac747eb-4057-4dfa-8f86-98ec58a536d3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:42.182037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ac747eb-4057-4dfa-8f86-98ec58a536d3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:42.182817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ac747eb-4057-4dfa-8f86-98ec58a536d3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:42.183666 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ede17bdd-ff27-40fa-bbea-39ff5bf2beeb tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:42.184174 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ac747eb-4057-4dfa-8f86-98ec58a536d3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:42.184318 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ede17bdd-ff27-40fa-bbea-39ff5bf2beeb tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:42.184956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ac747eb-4057-4dfa-8f86-98ec58a536d3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:42.185536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ac747eb-4057-4dfa-8f86-98ec58a536d3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:42.196424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ede17bdd-ff27-40fa-bbea-39ff5bf2beeb tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:42.196938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ede17bdd-ff27-40fa-bbea-39ff5bf2beeb tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:42.197387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ede17bdd-ff27-40fa-bbea-39ff5bf2beeb tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:42.198128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ede17bdd-ff27-40fa-bbea-39ff5bf2beeb tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:42.198854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ede17bdd-ff27-40fa-bbea-39ff5bf2beeb tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:42.209340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ede17bdd-ff27-40fa-bbea-39ff5bf2beeb tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:42.503816 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9ac747eb-4057-4dfa-8f86-98ec58a536d3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:42.511961 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9ac747eb-4057-4dfa-8f86-98ec58a536d3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1314 microversion: 2.1 time: 0.346253 Oct 05 02:48:42.514022 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2192/4401] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:42 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:42.531348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ede17bdd-ff27-40fa-bbea-39ff5bf2beeb tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:42.539849 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ede17bdd-ff27-40fa-bbea-39ff5bf2beeb tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1519 microversion: 2.1 time: 0.360106 Oct 05 02:48:42.554948 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2210/4402] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:42 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1519 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:42.567815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b0c38f6f-6a38-4d85-ae33-b5d2514bda9b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:48:42.570614 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b0c38f6f-6a38-4d85-ae33-b5d2514bda9b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:42.577855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0c38f6f-6a38-4d85-ae33-b5d2514bda9b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:42.578675 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0c38f6f-6a38-4d85-ae33-b5d2514bda9b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:42.579353 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0c38f6f-6a38-4d85-ae33-b5d2514bda9b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:42.580653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0c38f6f-6a38-4d85-ae33-b5d2514bda9b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:42.581481 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0c38f6f-6a38-4d85-ae33-b5d2514bda9b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:42.581939 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0c38f6f-6a38-4d85-ae33-b5d2514bda9b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:42.611409 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-b0c38f6f-6a38-4d85-ae33-b5d2514bda9b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lazy-loading 'flavor' on Instance uuid 3a711b7d-3d62-4118-aa2f-985160e79ffb {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:48:42.756545 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b0c38f6f-6a38-4d85-ae33-b5d2514bda9b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "POST /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb/action" status: 200 len: 32 microversion: 2.1 time: 0.193734 Oct 05 02:48:42.759706 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2193/4403] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:48:42 2022] POST /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb/action => generated 32 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:48:42.768413 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ab962ca8-e937-458a-a440-67606e9fe188 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:42.769068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ab962ca8-e937-458a-a440-67606e9fe188 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:42.795052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ab962ca8-e937-458a-a440-67606e9fe188 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:42.795559 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ab962ca8-e937-458a-a440-67606e9fe188 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:42.795999 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ab962ca8-e937-458a-a440-67606e9fe188 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:42.796716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ab962ca8-e937-458a-a440-67606e9fe188 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:42.797923 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ab962ca8-e937-458a-a440-67606e9fe188 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:42.798567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ab962ca8-e937-458a-a440-67606e9fe188 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:43.103246 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-65e19060-a253-45ac-95aa-0a9b4c9551d9 req-12db64c9-a3c7-47b1-bc55-a89846e400d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ec0ae24-68e3-4673-a177-50594e62bff2", "name": "network-vif-plugged", "status": "completed", "tag": "5a6793ab-1647-4586-abc2-bc083a2d1fdf"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:48:43.122771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-65e19060-a253-45ac-95aa-0a9b4c9551d9 req-12db64c9-a3c7-47b1-bc55-a89846e400d6 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:43.126655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-65e19060-a253-45ac-95aa-0a9b4c9551d9 req-12db64c9-a3c7-47b1-bc55-a89846e400d6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:43.127212 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-65e19060-a253-45ac-95aa-0a9b4c9551d9 req-12db64c9-a3c7-47b1-bc55-a89846e400d6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:43.157566 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-65e19060-a253-45ac-95aa-0a9b4c9551d9 req-12db64c9-a3c7-47b1-bc55-a89846e400d6 service nova] Creating event network-vif-plugged:5a6793ab-1647-4586-abc2-bc083a2d1fdf for instance 8ec0ae24-68e3-4673-a177-50594e62bff2 on n-h1-858272-3 Oct 05 02:48:43.177303 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ab962ca8-e937-458a-a440-67606e9fe188 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:43.210867 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-65e19060-a253-45ac-95aa-0a9b4c9551d9 req-12db64c9-a3c7-47b1-bc55-a89846e400d6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109583 Oct 05 02:48:43.212839 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2194/4404] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:48:43.213366 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ab962ca8-e937-458a-a440-67606e9fe188 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1525 microversion: 2.1 time: 0.446602 Oct 05 02:48:43.215042 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2211/4405] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:42 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1525 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:43.536279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1a2d54c2-8bda-47a8-9379-44fd1831c2eb tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:43.537088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1a2d54c2-8bda-47a8-9379-44fd1831c2eb tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:43.543259 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a2d54c2-8bda-47a8-9379-44fd1831c2eb tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:43.543839 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a2d54c2-8bda-47a8-9379-44fd1831c2eb tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:43.544208 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a2d54c2-8bda-47a8-9379-44fd1831c2eb tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:43.544894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a2d54c2-8bda-47a8-9379-44fd1831c2eb tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:43.545379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a2d54c2-8bda-47a8-9379-44fd1831c2eb tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:43.545840 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a2d54c2-8bda-47a8-9379-44fd1831c2eb tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:43.562686 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:48:43.846228 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1a2d54c2-8bda-47a8-9379-44fd1831c2eb tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:43.861644 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fe516d19-8786-4fe1-bda9-491e53770405 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:43.870969 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fe516d19-8786-4fe1-bda9-491e53770405 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: ae8e1003-15ab-4801-a026-e9d80e200d3c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:43.880773 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe516d19-8786-4fe1-bda9-491e53770405 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:43.881551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe516d19-8786-4fe1-bda9-491e53770405 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:43.882151 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1a2d54c2-8bda-47a8-9379-44fd1831c2eb tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1314 microversion: 2.1 time: 0.349876 Oct 05 02:48:43.882303 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe516d19-8786-4fe1-bda9-491e53770405 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:43.882853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe516d19-8786-4fe1-bda9-491e53770405 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:43.882982 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2195/4406] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:43 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:43.883826 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe516d19-8786-4fe1-bda9-491e53770405 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:43.884470 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe516d19-8786-4fe1-bda9-491e53770405 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:43.920640 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fe516d19-8786-4fe1-bda9-491e53770405 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c/os-volume_attachments/25d4a551-686a-45bb-815b-84cb7bd751d1" status: 200 len: 194 microversion: 2.1 time: 0.063172 Oct 05 02:48:43.921299 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2212/4407] 10.222.0.16 () {58 vars in 1413 bytes} [Wed Oct 5 02:48:43 2022] GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c/os-volume_attachments/25d4a551-686a-45bb-815b-84cb7bd751d1 => generated 194 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:48:43.932338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-848f5584-9a1c-46f0-8077-09267a1ce790 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:43.932986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-848f5584-9a1c-46f0-8077-09267a1ce790 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: ae8e1003-15ab-4801-a026-e9d80e200d3c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:43.939465 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-848f5584-9a1c-46f0-8077-09267a1ce790 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:43.940072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-848f5584-9a1c-46f0-8077-09267a1ce790 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:43.940593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-848f5584-9a1c-46f0-8077-09267a1ce790 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:43.941407 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-848f5584-9a1c-46f0-8077-09267a1ce790 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:43.941944 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-848f5584-9a1c-46f0-8077-09267a1ce790 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:43.942448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-848f5584-9a1c-46f0-8077-09267a1ce790 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:44.036046 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-848f5584-9a1c-46f0-8077-09267a1ce790 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lazy-loading 'services' on Instance uuid ae8e1003-15ab-4801-a026-e9d80e200d3c {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:48:44.132592 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-848f5584-9a1c-46f0-8077-09267a1ce790 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c/os-volume_attachments/25d4a551-686a-45bb-815b-84cb7bd751d1" status: 202 len: 0 microversion: 2.1 time: 0.204137 Oct 05 02:48:44.147543 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2196/4408] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 02:48:43 2022] DELETE /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c/os-volume_attachments/25d4a551-686a-45bb-815b-84cb7bd751d1 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:48:44.238508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b76f8a28-9fbe-459b-a709-8b43566a9faa tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:44.239121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b76f8a28-9fbe-459b-a709-8b43566a9faa tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:44.246795 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b76f8a28-9fbe-459b-a709-8b43566a9faa tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:44.247292 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b76f8a28-9fbe-459b-a709-8b43566a9faa tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:44.247727 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b76f8a28-9fbe-459b-a709-8b43566a9faa tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:44.248483 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b76f8a28-9fbe-459b-a709-8b43566a9faa tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:44.248961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b76f8a28-9fbe-459b-a709-8b43566a9faa tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:44.249391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b76f8a28-9fbe-459b-a709-8b43566a9faa tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:44.390981 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b76f8a28-9fbe-459b-a709-8b43566a9faa tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:44.398797 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b76f8a28-9fbe-459b-a709-8b43566a9faa tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1525 microversion: 2.1 time: 0.164205 Oct 05 02:48:44.399396 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2213/4409] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:44 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1525 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:48:44.907485 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b4926d57-0092-49be-939b-15a26648c81c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:44.908944 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b4926d57-0092-49be-939b-15a26648c81c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:44.915686 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4926d57-0092-49be-939b-15a26648c81c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:44.916538 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4926d57-0092-49be-939b-15a26648c81c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:44.917924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4926d57-0092-49be-939b-15a26648c81c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:44.919147 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4926d57-0092-49be-939b-15a26648c81c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:44.919825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4926d57-0092-49be-939b-15a26648c81c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:44.920506 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4926d57-0092-49be-939b-15a26648c81c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:45.085900 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b4926d57-0092-49be-939b-15a26648c81c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:45.116852 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b4926d57-0092-49be-939b-15a26648c81c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1314 microversion: 2.1 time: 0.214031 Oct 05 02:48:45.132967 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2197/4410] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:44 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:45.423104 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-eefe8b47-900f-4a43-82f5-fd7e32db2aaa tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:45.424869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-eefe8b47-900f-4a43-82f5-fd7e32db2aaa tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:45.433602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eefe8b47-900f-4a43-82f5-fd7e32db2aaa tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:45.434426 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eefe8b47-900f-4a43-82f5-fd7e32db2aaa tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:45.435117 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eefe8b47-900f-4a43-82f5-fd7e32db2aaa tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:45.436036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eefe8b47-900f-4a43-82f5-fd7e32db2aaa tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:45.437540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eefe8b47-900f-4a43-82f5-fd7e32db2aaa tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:45.438180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eefe8b47-900f-4a43-82f5-fd7e32db2aaa tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:45.600156 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-eefe8b47-900f-4a43-82f5-fd7e32db2aaa tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:45.611581 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-eefe8b47-900f-4a43-82f5-fd7e32db2aaa tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1525 microversion: 2.1 time: 0.192367 Oct 05 02:48:45.612548 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2214/4411] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:45 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1525 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:46.145164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b2b4efaa-21e5-43b8-9604-6f355cde7f21 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:46.146772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b2b4efaa-21e5-43b8-9604-6f355cde7f21 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:46.156814 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2b4efaa-21e5-43b8-9604-6f355cde7f21 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:46.157546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2b4efaa-21e5-43b8-9604-6f355cde7f21 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:46.159385 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2b4efaa-21e5-43b8-9604-6f355cde7f21 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:46.159982 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2b4efaa-21e5-43b8-9604-6f355cde7f21 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:46.160463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2b4efaa-21e5-43b8-9604-6f355cde7f21 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:46.160920 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2b4efaa-21e5-43b8-9604-6f355cde7f21 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:46.437756 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b2b4efaa-21e5-43b8-9604-6f355cde7f21 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:46.446732 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b2b4efaa-21e5-43b8-9604-6f355cde7f21 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1501 microversion: 2.1 time: 0.306513 Oct 05 02:48:46.458668 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2198/4412] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:46 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1501 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:46.473473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-17e1db41-b140-4ede-9985-4d2cca87a282 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:48:46.482551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17e1db41-b140-4ede-9985-4d2cca87a282 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:46.485506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17e1db41-b140-4ede-9985-4d2cca87a282 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:46.485959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17e1db41-b140-4ede-9985-4d2cca87a282 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:46.513066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-17e1db41-b140-4ede-9985-4d2cca87a282 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Going to try to stop instance {{(pid=122320) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 05 02:48:46.549838 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:48:46.570892 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-17e1db41-b140-4ede-9985-4d2cca87a282 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "POST /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2/action" status: 202 len: 0 microversion: 2.1 time: 0.101310 Oct 05 02:48:46.572023 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2215/4413] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:48:46 2022] POST /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:48:46.580608 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-74f48797-41eb-4d58-9a81-263c0f9b3296 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:46.581573 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-74f48797-41eb-4d58-9a81-263c0f9b3296 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:46.592979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74f48797-41eb-4d58-9a81-263c0f9b3296 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:46.594142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74f48797-41eb-4d58-9a81-263c0f9b3296 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:46.594906 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74f48797-41eb-4d58-9a81-263c0f9b3296 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:46.595865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74f48797-41eb-4d58-9a81-263c0f9b3296 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:46.596491 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74f48797-41eb-4d58-9a81-263c0f9b3296 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:46.597108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74f48797-41eb-4d58-9a81-263c0f9b3296 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:46.636628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a9242e60-9051-4fd8-be7b-45fc41845544 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:46.637266 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a9242e60-9051-4fd8-be7b-45fc41845544 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:46.645442 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9242e60-9051-4fd8-be7b-45fc41845544 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:46.646480 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9242e60-9051-4fd8-be7b-45fc41845544 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:46.646981 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9242e60-9051-4fd8-be7b-45fc41845544 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:46.647872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9242e60-9051-4fd8-be7b-45fc41845544 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:46.648404 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9242e60-9051-4fd8-be7b-45fc41845544 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:46.649112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9242e60-9051-4fd8-be7b-45fc41845544 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:46.848113 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-74f48797-41eb-4d58-9a81-263c0f9b3296 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:46.861621 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-74f48797-41eb-4d58-9a81-263c0f9b3296 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1511 microversion: 2.1 time: 0.284935 Oct 05 02:48:46.862360 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2199/4414] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:46 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1511 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:46.912847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a9242e60-9051-4fd8-be7b-45fc41845544 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:46.922505 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a9242e60-9051-4fd8-be7b-45fc41845544 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1525 microversion: 2.1 time: 0.290340 Oct 05 02:48:46.924945 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2216/4415] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:46 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1525 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:47.886208 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c0b81b57-d4e8-4896-b883-a9bd55d337d4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:47.886870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c0b81b57-d4e8-4896-b883-a9bd55d337d4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:47.894273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c0b81b57-d4e8-4896-b883-a9bd55d337d4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:47.894852 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c0b81b57-d4e8-4896-b883-a9bd55d337d4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:47.895505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c0b81b57-d4e8-4896-b883-a9bd55d337d4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:47.896251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c0b81b57-d4e8-4896-b883-a9bd55d337d4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:47.896716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c0b81b57-d4e8-4896-b883-a9bd55d337d4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:47.897188 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c0b81b57-d4e8-4896-b883-a9bd55d337d4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:47.950018 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a20fa6f4-9ed7-4a9d-a1bc-b932970e078b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:47.951718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a20fa6f4-9ed7-4a9d-a1bc-b932970e078b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:47.965804 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a20fa6f4-9ed7-4a9d-a1bc-b932970e078b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:47.968394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a20fa6f4-9ed7-4a9d-a1bc-b932970e078b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:47.970548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a20fa6f4-9ed7-4a9d-a1bc-b932970e078b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:47.973103 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a20fa6f4-9ed7-4a9d-a1bc-b932970e078b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:47.973948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a20fa6f4-9ed7-4a9d-a1bc-b932970e078b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:47.975920 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a20fa6f4-9ed7-4a9d-a1bc-b932970e078b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:48.071915 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c0b81b57-d4e8-4896-b883-a9bd55d337d4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:48.080185 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c0b81b57-d4e8-4896-b883-a9bd55d337d4 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1511 microversion: 2.1 time: 0.197865 Oct 05 02:48:48.081483 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2200/4416] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:47 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1511 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:48.212432 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a20fa6f4-9ed7-4a9d-a1bc-b932970e078b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:48.223655 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a20fa6f4-9ed7-4a9d-a1bc-b932970e078b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1525 microversion: 2.1 time: 0.279006 Oct 05 02:48:48.225279 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2217/4417] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:47 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1525 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:48:49.105991 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6966ad0e-b583-412f-b780-0df932ff0e57 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:49.107432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6966ad0e-b583-412f-b780-0df932ff0e57 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:49.115536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6966ad0e-b583-412f-b780-0df932ff0e57 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:49.116207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6966ad0e-b583-412f-b780-0df932ff0e57 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:49.116794 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6966ad0e-b583-412f-b780-0df932ff0e57 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:49.129702 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6966ad0e-b583-412f-b780-0df932ff0e57 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:49.132542 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6966ad0e-b583-412f-b780-0df932ff0e57 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:49.133328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6966ad0e-b583-412f-b780-0df932ff0e57 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:49.249797 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-631def60-ee32-4253-933d-592595628fb3 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:49.250387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-631def60-ee32-4253-933d-592595628fb3 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:49.258054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-631def60-ee32-4253-933d-592595628fb3 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:49.258540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-631def60-ee32-4253-933d-592595628fb3 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:49.259024 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-631def60-ee32-4253-933d-592595628fb3 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:49.259775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-631def60-ee32-4253-933d-592595628fb3 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:49.260549 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-631def60-ee32-4253-933d-592595628fb3 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:49.261037 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-631def60-ee32-4253-933d-592595628fb3 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:49.509633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6966ad0e-b583-412f-b780-0df932ff0e57 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:49.521695 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6966ad0e-b583-412f-b780-0df932ff0e57 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1511 microversion: 2.1 time: 0.421109 Oct 05 02:48:49.522383 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2201/4418] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:49 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1511 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:49.538775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-631def60-ee32-4253-933d-592595628fb3 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:49.550503 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-631def60-ee32-4253-933d-592595628fb3 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1525 microversion: 2.1 time: 0.305236 Oct 05 02:48:49.551209 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2218/4419] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:49 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1525 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:48:49.705639 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-58f9f73a-ad39-4a62-88c1-cf0faf1f25bf tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:49.708352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-58f9f73a-ad39-4a62-88c1-cf0faf1f25bf tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: ae8e1003-15ab-4801-a026-e9d80e200d3c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:49.717485 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58f9f73a-ad39-4a62-88c1-cf0faf1f25bf tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:49.718126 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58f9f73a-ad39-4a62-88c1-cf0faf1f25bf tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:49.718632 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58f9f73a-ad39-4a62-88c1-cf0faf1f25bf tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:49.719544 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58f9f73a-ad39-4a62-88c1-cf0faf1f25bf tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:49.720025 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58f9f73a-ad39-4a62-88c1-cf0faf1f25bf tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:49.720461 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58f9f73a-ad39-4a62-88c1-cf0faf1f25bf tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:49.760051 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-58f9f73a-ad39-4a62-88c1-cf0faf1f25bf tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059392 Oct 05 02:48:49.761802 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2202/4420] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 02:48:49 2022] GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:48:49.889067 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9538ec62-4ccd-416c-a939-1ce556587052 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:49.891286 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9538ec62-4ccd-416c-a939-1ce556587052 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: ae8e1003-15ab-4801-a026-e9d80e200d3c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:49.897504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9538ec62-4ccd-416c-a939-1ce556587052 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:49.897996 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9538ec62-4ccd-416c-a939-1ce556587052 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:49.898428 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9538ec62-4ccd-416c-a939-1ce556587052 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:49.899121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9538ec62-4ccd-416c-a939-1ce556587052 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:49.899628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9538ec62-4ccd-416c-a939-1ce556587052 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:49.900049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9538ec62-4ccd-416c-a939-1ce556587052 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:49.930495 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9538ec62-4ccd-416c-a939-1ce556587052 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046071 Oct 05 02:48:49.931064 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2219/4421] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 02:48:49 2022] GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:48:49.999247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-da11de61-43c1-4077-a880-7ac6b3973770 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:49.999749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-da11de61-43c1-4077-a880-7ac6b3973770 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: ae8e1003-15ab-4801-a026-e9d80e200d3c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:50.005933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da11de61-43c1-4077-a880-7ac6b3973770 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:50.006420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da11de61-43c1-4077-a880-7ac6b3973770 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:50.006854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da11de61-43c1-4077-a880-7ac6b3973770 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:50.007554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da11de61-43c1-4077-a880-7ac6b3973770 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:50.008008 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da11de61-43c1-4077-a880-7ac6b3973770 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:50.008441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da11de61-43c1-4077-a880-7ac6b3973770 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:50.036670 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-da11de61-43c1-4077-a880-7ac6b3973770 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: ae8e1003-15ab-4801-a026-e9d80e200d3c] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:48:50.134701 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-da11de61-43c1-4077-a880-7ac6b3973770 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c" status: 204 len: 0 microversion: 2.1 time: 0.139621 Oct 05 02:48:50.135595 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2203/4422] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:48:49 2022] DELETE /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:48:50.146658 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fcdbc41e-69cf-4864-9c20-d96b11e395ad tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:50.147595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fcdbc41e-69cf-4864-9c20-d96b11e395ad tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: ae8e1003-15ab-4801-a026-e9d80e200d3c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:50.155315 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fcdbc41e-69cf-4864-9c20-d96b11e395ad tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:50.155909 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fcdbc41e-69cf-4864-9c20-d96b11e395ad tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:50.156599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fcdbc41e-69cf-4864-9c20-d96b11e395ad tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:50.157621 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fcdbc41e-69cf-4864-9c20-d96b11e395ad tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:50.158350 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fcdbc41e-69cf-4864-9c20-d96b11e395ad tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:50.158860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fcdbc41e-69cf-4864-9c20-d96b11e395ad tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:50.324531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fcdbc41e-69cf-4864-9c20-d96b11e395ad tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:50.333749 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fcdbc41e-69cf-4864-9c20-d96b11e395ad tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c" status: 200 len: 1674 microversion: 2.1 time: 0.192844 Oct 05 02:48:50.335964 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2220/4423] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:50 2022] GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c => generated 1674 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:50.548912 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-42823779-400e-43c8-978e-f4660872e49d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:50.549725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-42823779-400e-43c8-978e-f4660872e49d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:50.557519 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42823779-400e-43c8-978e-f4660872e49d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:50.559027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42823779-400e-43c8-978e-f4660872e49d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:50.560267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42823779-400e-43c8-978e-f4660872e49d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:50.561498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42823779-400e-43c8-978e-f4660872e49d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:50.562133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42823779-400e-43c8-978e-f4660872e49d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:50.563103 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42823779-400e-43c8-978e-f4660872e49d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:50.575875 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7f228ff1-2654-4d7c-9a51-637032fa0f65 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:50.576418 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7f228ff1-2654-4d7c-9a51-637032fa0f65 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:50.582488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f228ff1-2654-4d7c-9a51-637032fa0f65 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:50.583347 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f228ff1-2654-4d7c-9a51-637032fa0f65 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:50.584015 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f228ff1-2654-4d7c-9a51-637032fa0f65 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:50.585015 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f228ff1-2654-4d7c-9a51-637032fa0f65 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:50.585580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f228ff1-2654-4d7c-9a51-637032fa0f65 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:50.586232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f228ff1-2654-4d7c-9a51-637032fa0f65 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:50.820609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-42823779-400e-43c8-978e-f4660872e49d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:50.825340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7f228ff1-2654-4d7c-9a51-637032fa0f65 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:50.830771 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-42823779-400e-43c8-978e-f4660872e49d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1511 microversion: 2.1 time: 0.287594 Oct 05 02:48:50.831323 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2204/4424] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:50 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1511 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:50.847673 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7f228ff1-2654-4d7c-9a51-637032fa0f65 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1525 microversion: 2.1 time: 0.266252 Oct 05 02:48:50.847673 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2221/4425] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:50 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1525 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:51.360230 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c2b6a8a5-1ec3-49c3-a8fa-62ab96dc82f6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:51.361477 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c2b6a8a5-1ec3-49c3-a8fa-62ab96dc82f6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: ae8e1003-15ab-4801-a026-e9d80e200d3c] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:51.369360 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2b6a8a5-1ec3-49c3-a8fa-62ab96dc82f6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:51.370766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2b6a8a5-1ec3-49c3-a8fa-62ab96dc82f6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:51.371696 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2b6a8a5-1ec3-49c3-a8fa-62ab96dc82f6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:51.373170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2b6a8a5-1ec3-49c3-a8fa-62ab96dc82f6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:51.373764 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2b6a8a5-1ec3-49c3-a8fa-62ab96dc82f6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:51.374261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2b6a8a5-1ec3-49c3-a8fa-62ab96dc82f6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:51.534863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c2b6a8a5-1ec3-49c3-a8fa-62ab96dc82f6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:51.550327 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c2b6a8a5-1ec3-49c3-a8fa-62ab96dc82f6 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c" status: 200 len: 1674 microversion: 2.1 time: 0.194248 Oct 05 02:48:51.551249 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2222/4426] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:51 2022] GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c => generated 1674 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:48:51.855168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4cbd670d-2427-46d8-94ce-24f2aa9f4fc0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:51.855803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4cbd670d-2427-46d8-94ce-24f2aa9f4fc0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:51.864319 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-03fbd7bf-1bdb-409d-a36f-e295ec6d15fd tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:51.867226 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-03fbd7bf-1bdb-409d-a36f-e295ec6d15fd tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:51.876447 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03fbd7bf-1bdb-409d-a36f-e295ec6d15fd tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:51.877256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03fbd7bf-1bdb-409d-a36f-e295ec6d15fd tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:51.877852 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03fbd7bf-1bdb-409d-a36f-e295ec6d15fd tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:51.879466 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4cbd670d-2427-46d8-94ce-24f2aa9f4fc0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:51.880162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4cbd670d-2427-46d8-94ce-24f2aa9f4fc0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:51.880863 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4cbd670d-2427-46d8-94ce-24f2aa9f4fc0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:51.882291 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03fbd7bf-1bdb-409d-a36f-e295ec6d15fd tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:51.883110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03fbd7bf-1bdb-409d-a36f-e295ec6d15fd tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:51.883705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03fbd7bf-1bdb-409d-a36f-e295ec6d15fd tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:51.887535 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4cbd670d-2427-46d8-94ce-24f2aa9f4fc0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:51.888286 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4cbd670d-2427-46d8-94ce-24f2aa9f4fc0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:51.888995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4cbd670d-2427-46d8-94ce-24f2aa9f4fc0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:52.466871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4cbd670d-2427-46d8-94ce-24f2aa9f4fc0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:52.475729 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4cbd670d-2427-46d8-94ce-24f2aa9f4fc0 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1511 microversion: 2.1 time: 0.624510 Oct 05 02:48:52.492109 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-03fbd7bf-1bdb-409d-a36f-e295ec6d15fd tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:52.493933 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2205/4427] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:51 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1511 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:52.504289 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-03fbd7bf-1bdb-409d-a36f-e295ec6d15fd tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1525 microversion: 2.1 time: 0.645169 Oct 05 02:48:52.505723 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2223/4428] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:51 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1525 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:52.576397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-24c713d4-3ad7-4108-8d2c-c54bae0c4a9a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:52.583856 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-24c713d4-3ad7-4108-8d2c-c54bae0c4a9a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: ae8e1003-15ab-4801-a026-e9d80e200d3c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:52.591775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-24c713d4-3ad7-4108-8d2c-c54bae0c4a9a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:52.592682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-24c713d4-3ad7-4108-8d2c-c54bae0c4a9a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:52.595377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-24c713d4-3ad7-4108-8d2c-c54bae0c4a9a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:52.596471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-24c713d4-3ad7-4108-8d2c-c54bae0c4a9a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:52.599672 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-24c713d4-3ad7-4108-8d2c-c54bae0c4a9a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:52.600240 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-24c713d4-3ad7-4108-8d2c-c54bae0c4a9a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:52.902652 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-24c713d4-3ad7-4108-8d2c-c54bae0c4a9a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:52.923425 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-24c713d4-3ad7-4108-8d2c-c54bae0c4a9a tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c" status: 200 len: 1674 microversion: 2.1 time: 0.346920 Oct 05 02:48:52.927836 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2206/4429] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:52 2022] GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c => generated 1674 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:53.503322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0f870e15-28b7-48fd-b8e6-0efb5f664e08 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:53.504540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0f870e15-28b7-48fd-b8e6-0efb5f664e08 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:53.513977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f870e15-28b7-48fd-b8e6-0efb5f664e08 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:53.518255 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f870e15-28b7-48fd-b8e6-0efb5f664e08 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:53.518701 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f870e15-28b7-48fd-b8e6-0efb5f664e08 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:53.519628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f870e15-28b7-48fd-b8e6-0efb5f664e08 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:53.520243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f870e15-28b7-48fd-b8e6-0efb5f664e08 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:53.520838 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f870e15-28b7-48fd-b8e6-0efb5f664e08 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:53.529854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d5c6fe03-a912-4fdf-a73e-b031c2ba2bc8 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:53.530870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d5c6fe03-a912-4fdf-a73e-b031c2ba2bc8 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:53.538144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5c6fe03-a912-4fdf-a73e-b031c2ba2bc8 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:53.538932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5c6fe03-a912-4fdf-a73e-b031c2ba2bc8 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:53.539668 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5c6fe03-a912-4fdf-a73e-b031c2ba2bc8 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:53.540622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5c6fe03-a912-4fdf-a73e-b031c2ba2bc8 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:53.541327 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5c6fe03-a912-4fdf-a73e-b031c2ba2bc8 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:53.542730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5c6fe03-a912-4fdf-a73e-b031c2ba2bc8 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:53.880066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0f870e15-28b7-48fd-b8e6-0efb5f664e08 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:53.897688 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0f870e15-28b7-48fd-b8e6-0efb5f664e08 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1511 microversion: 2.1 time: 0.399338 Oct 05 02:48:53.901589 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d5c6fe03-a912-4fdf-a73e-b031c2ba2bc8 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:53.917317 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2224/4430] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:53 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1511 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:53.924553 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d5c6fe03-a912-4fdf-a73e-b031c2ba2bc8 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1525 microversion: 2.1 time: 0.399272 Oct 05 02:48:53.925171 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-e45c4757-5d2e-4d1c-89c3-a70d337cb2fd req-c0b9ea8f-bf40-4572-b07d-5e70458d6864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae8e1003-15ab-4801-a026-e9d80e200d3c", "name": "network-vif-deleted", "tag": "e39d2c77-d9f4-430b-9b4f-2778c13414de"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:48:53.926135 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2207/4431] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:53 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1525 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:48:53.951364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-674a2596-c13e-419d-b618-2e7b9dcc11a5 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:53.952243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-674a2596-c13e-419d-b618-2e7b9dcc11a5 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: ae8e1003-15ab-4801-a026-e9d80e200d3c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:53.959079 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-674a2596-c13e-419d-b618-2e7b9dcc11a5 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:53.960136 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-674a2596-c13e-419d-b618-2e7b9dcc11a5 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:53.960733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-674a2596-c13e-419d-b618-2e7b9dcc11a5 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:53.962241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-674a2596-c13e-419d-b618-2e7b9dcc11a5 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:53.962861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-674a2596-c13e-419d-b618-2e7b9dcc11a5 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:53.963006 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e45c4757-5d2e-4d1c-89c3-a70d337cb2fd req-c0b9ea8f-bf40-4572-b07d-5e70458d6864 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:53.963572 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e45c4757-5d2e-4d1c-89c3-a70d337cb2fd req-c0b9ea8f-bf40-4572-b07d-5e70458d6864 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:53.963913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-674a2596-c13e-419d-b618-2e7b9dcc11a5 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:53.964106 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e45c4757-5d2e-4d1c-89c3-a70d337cb2fd req-c0b9ea8f-bf40-4572-b07d-5e70458d6864 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:53.999255 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-e45c4757-5d2e-4d1c-89c3-a70d337cb2fd req-c0b9ea8f-bf40-4572-b07d-5e70458d6864 service nova] Creating event network-vif-deleted:e39d2c77-d9f4-430b-9b4f-2778c13414de for instance ae8e1003-15ab-4801-a026-e9d80e200d3c on n-h2-858272-3 Oct 05 02:48:54.019268 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-e45c4757-5d2e-4d1c-89c3-a70d337cb2fd req-c0b9ea8f-bf40-4572-b07d-5e70458d6864 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097632 Oct 05 02:48:54.020448 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2225/4432] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:48:54.076164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-674a2596-c13e-419d-b618-2e7b9dcc11a5 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2aedcc40d84bb6a287c2bac019ed4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20891ecf732b4c4597e3bfa0d96585a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:54.091139 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-674a2596-c13e-419d-b618-2e7b9dcc11a5 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c" status: 200 len: 1323 microversion: 2.1 time: 0.144040 Oct 05 02:48:54.092310 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2208/4433] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:53 2022] GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c => generated 1323 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:48:54.929883 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-19c34a00-7337-4a25-9ceb-0079d986d3bc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:54.931656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-19c34a00-7337-4a25-9ceb-0079d986d3bc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:54.947001 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19c34a00-7337-4a25-9ceb-0079d986d3bc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:54.949455 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19c34a00-7337-4a25-9ceb-0079d986d3bc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:54.950124 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19c34a00-7337-4a25-9ceb-0079d986d3bc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:54.951780 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19c34a00-7337-4a25-9ceb-0079d986d3bc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:54.951984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1255ebd2-8b37-4909-93f3-8bcd76465cfa tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:54.953450 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1255ebd2-8b37-4909-93f3-8bcd76465cfa tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:54.954270 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19c34a00-7337-4a25-9ceb-0079d986d3bc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:54.954790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19c34a00-7337-4a25-9ceb-0079d986d3bc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:54.967937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1255ebd2-8b37-4909-93f3-8bcd76465cfa tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:54.972542 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1255ebd2-8b37-4909-93f3-8bcd76465cfa tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:54.973264 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1255ebd2-8b37-4909-93f3-8bcd76465cfa tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:54.974384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1255ebd2-8b37-4909-93f3-8bcd76465cfa tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:54.975026 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1255ebd2-8b37-4909-93f3-8bcd76465cfa tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:54.975861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1255ebd2-8b37-4909-93f3-8bcd76465cfa tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:55.362203 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1255ebd2-8b37-4909-93f3-8bcd76465cfa tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:55.365850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:48:55.374442 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1255ebd2-8b37-4909-93f3-8bcd76465cfa tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1525 microversion: 2.1 time: 0.427500 Oct 05 02:48:55.375695 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2209/4434] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:54 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1525 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:55.380952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9b8c3b47-4051-44d7-9764-ffb92aaa4768 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:55.381986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9b8c3b47-4051-44d7-9764-ffb92aaa4768 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: ae8e1003-15ab-4801-a026-e9d80e200d3c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:55.393185 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b8c3b47-4051-44d7-9764-ffb92aaa4768 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:55.394471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b8c3b47-4051-44d7-9764-ffb92aaa4768 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:55.396503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b8c3b47-4051-44d7-9764-ffb92aaa4768 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:55.397830 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b8c3b47-4051-44d7-9764-ffb92aaa4768 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:55.398552 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b8c3b47-4051-44d7-9764-ffb92aaa4768 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:55.399677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b8c3b47-4051-44d7-9764-ffb92aaa4768 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:55.421401 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-19c34a00-7337-4a25-9ceb-0079d986d3bc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:55.425430 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-9b8c3b47-4051-44d7-9764-ffb92aaa4768 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] HTTP exception thrown: Instance ae8e1003-15ab-4801-a026-e9d80e200d3c could not be found. Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9b8c3b47-4051-44d7-9764-ffb92aaa4768 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Request method failure captured: Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c HTTP/1.1 Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO65ExXFSMcv-UYGFiGC6ownV_rHFtaePi5NC2Vdud2LC6WavS6h4ro52z50RYYtQxAu5Mc3FpnY7BXVdbMqPcgepNZwBqAaHERrgmPzkHi5wlJ9X7Ay3ec5_pcoUMvhRWKtNoSxi-hf2OJVrgwb-n0TSs9Oo3HDatyGWBlHEpMqa4M Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 20891ecf732b4c4597e3bfa0d96585a7 Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-AttachVolumeTestJSON-191918943 Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/20891ecf732b4c4597e3bfa0d96585a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/20891ecf732b4c4597e3bfa0d96585a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/20891ecf732b4c4597e3bfa0d96585a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_20891ecf732b4c4597e3bfa0d96585a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-AttachVolumeTestJSON-191918943 Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 20891ecf732b4c4597e3bfa0d96585a7 Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-AttachVolumeTestJSON-191918943 Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-AttachVolumeTestJSON-191918943-project Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 4c2aedcc40d84bb6a287c2bac019ed4e Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-AttachVolumeTestJSON-191918943-project Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance ae8e1003-15ab-4801-a026-e9d80e200d3c could not be found. Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'ae8e1003-15ab-4801-a026-e9d80e200d3c'} Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae8e1003-15ab-4801-a026-e9d80e200d3c could not be found. Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae8e1003-15ab-4801-a026-e9d80e200d3c could not be found. Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:48:55.427553 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:48:55.431823 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:48:55.431823 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:48:55.431823 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:48:55.431823 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:48:55.431823 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:48:55.431823 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae8e1003-15ab-4801-a026-e9d80e200d3c could not be found. Oct 05 02:48:55.431823 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:48:55.434446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9b8c3b47-4051-44d7-9764-ffb92aaa4768 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Returning 404 to user: Instance ae8e1003-15ab-4801-a026-e9d80e200d3c could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:48:55.435537 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9b8c3b47-4051-44d7-9764-ffb92aaa4768 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c" status: 404 len: 111 microversion: 2.1 time: 0.058636 Oct 05 02:48:55.436757 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2210/4435] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:55 2022] GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:48:55.438569 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-19c34a00-7337-4a25-9ceb-0079d986d3bc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1511 microversion: 2.1 time: 0.509569 Oct 05 02:48:55.439256 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2226/4436] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:54 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1511 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:55.462186 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-50681ae8-941e-43b4-8d1d-a2ced975592b tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '.version_select at 0x7fccdfc5eaf0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:55.488248 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-50681ae8-941e-43b4-8d1d-a2ced975592b tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1334904593" status: 202 len: 0 microversion: 2.1 time: 0.030033 Oct 05 02:48:55.489646 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2211/4437] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 5 02:48:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1334904593 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:48:56.400187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cbd1e3b1-075d-4276-b45a-cb3fa653c4a9 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:56.401595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cbd1e3b1-075d-4276-b45a-cb3fa653c4a9 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:56.432970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbd1e3b1-075d-4276-b45a-cb3fa653c4a9 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:56.433803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbd1e3b1-075d-4276-b45a-cb3fa653c4a9 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:56.434679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbd1e3b1-075d-4276-b45a-cb3fa653c4a9 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:56.436013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbd1e3b1-075d-4276-b45a-cb3fa653c4a9 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:56.436725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbd1e3b1-075d-4276-b45a-cb3fa653c4a9 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:56.437407 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbd1e3b1-075d-4276-b45a-cb3fa653c4a9 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:56.471008 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ee5961bc-c3f3-44dd-867b-3e3b0e5f0b1e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:56.471633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ee5961bc-c3f3-44dd-867b-3e3b0e5f0b1e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:56.486531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee5961bc-c3f3-44dd-867b-3e3b0e5f0b1e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:56.487039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee5961bc-c3f3-44dd-867b-3e3b0e5f0b1e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:56.487486 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee5961bc-c3f3-44dd-867b-3e3b0e5f0b1e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:56.488266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee5961bc-c3f3-44dd-867b-3e3b0e5f0b1e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:56.488663 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee5961bc-c3f3-44dd-867b-3e3b0e5f0b1e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:56.489121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee5961bc-c3f3-44dd-867b-3e3b0e5f0b1e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:56.850954 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ee5961bc-c3f3-44dd-867b-3e3b0e5f0b1e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:56.862121 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ee5961bc-c3f3-44dd-867b-3e3b0e5f0b1e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1511 microversion: 2.1 time: 0.394966 Oct 05 02:48:56.876505 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2212/4438] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:56 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1511 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:56.883464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cbd1e3b1-075d-4276-b45a-cb3fa653c4a9 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:56.893500 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cbd1e3b1-075d-4276-b45a-cb3fa653c4a9 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1525 microversion: 2.1 time: 0.498556 Oct 05 02:48:56.905701 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2227/4439] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:56 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1525 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:57.917614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-519db468-0178-4098-a840-bb5b1e65a176 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:57.918426 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-519db468-0178-4098-a840-bb5b1e65a176 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:57.925950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-519db468-0178-4098-a840-bb5b1e65a176 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:57.926602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-519db468-0178-4098-a840-bb5b1e65a176 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:57.927289 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-519db468-0178-4098-a840-bb5b1e65a176 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:57.928205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-519db468-0178-4098-a840-bb5b1e65a176 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:57.928891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-519db468-0178-4098-a840-bb5b1e65a176 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:57.929638 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-519db468-0178-4098-a840-bb5b1e65a176 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:58.130539 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-519db468-0178-4098-a840-bb5b1e65a176 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:58.146147 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-519db468-0178-4098-a840-bb5b1e65a176 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1525 microversion: 2.1 time: 0.232220 Oct 05 02:48:58.147718 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2228/4440] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:57 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1525 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:58.165084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2978498f-555a-4313-9608-1ab7db38a652 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:58.166069 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2978498f-555a-4313-9608-1ab7db38a652 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:58.174074 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2978498f-555a-4313-9608-1ab7db38a652 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:58.174590 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2978498f-555a-4313-9608-1ab7db38a652 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:58.174999 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2978498f-555a-4313-9608-1ab7db38a652 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:58.175770 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2978498f-555a-4313-9608-1ab7db38a652 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:58.176298 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2978498f-555a-4313-9608-1ab7db38a652 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:58.176817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2978498f-555a-4313-9608-1ab7db38a652 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:58.328440 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2978498f-555a-4313-9608-1ab7db38a652 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:58.337112 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2978498f-555a-4313-9608-1ab7db38a652 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1511 microversion: 2.1 time: 0.454257 Oct 05 02:48:58.337829 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2213/4441] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:57 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1511 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:59.172658 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3d2b5512-ee78-42f8-acff-2833694781d4 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:59.173474 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3d2b5512-ee78-42f8-acff-2833694781d4 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:59.176966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=66 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:48:59.183559 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d2b5512-ee78-42f8-acff-2833694781d4 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:59.184053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d2b5512-ee78-42f8-acff-2833694781d4 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:59.184497 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d2b5512-ee78-42f8-acff-2833694781d4 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:59.185247 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d2b5512-ee78-42f8-acff-2833694781d4 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:59.185679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d2b5512-ee78-42f8-acff-2833694781d4 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:59.186100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d2b5512-ee78-42f8-acff-2833694781d4 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:59.343144 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3d2b5512-ee78-42f8-acff-2833694781d4 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:59.351171 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3d2b5512-ee78-42f8-acff-2833694781d4 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1525 microversion: 2.1 time: 0.182934 Oct 05 02:48:59.352004 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2229/4442] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:59 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1525 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:48:59.363288 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7cb2578e-f852-4639-b4bd-8a8184ff7b8a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:48:59.363854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7cb2578e-f852-4639-b4bd-8a8184ff7b8a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:48:59.371809 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7cb2578e-f852-4639-b4bd-8a8184ff7b8a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:59.372415 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7cb2578e-f852-4639-b4bd-8a8184ff7b8a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:59.372936 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7cb2578e-f852-4639-b4bd-8a8184ff7b8a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:59.373928 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7cb2578e-f852-4639-b4bd-8a8184ff7b8a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:48:59.374464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7cb2578e-f852-4639-b4bd-8a8184ff7b8a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:48:59.375037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7cb2578e-f852-4639-b4bd-8a8184ff7b8a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:48:59.551419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7cb2578e-f852-4639-b4bd-8a8184ff7b8a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:48:59.568974 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7cb2578e-f852-4639-b4bd-8a8184ff7b8a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1511 microversion: 2.1 time: 0.209853 Oct 05 02:48:59.570199 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2214/4443] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:48:59 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1511 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:00.377938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8b0e6bf3-3fdd-459c-bebe-52f5f359098f tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:00.379259 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8b0e6bf3-3fdd-459c-bebe-52f5f359098f tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:00.390246 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b0e6bf3-3fdd-459c-bebe-52f5f359098f tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:00.391212 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b0e6bf3-3fdd-459c-bebe-52f5f359098f tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:00.391825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b0e6bf3-3fdd-459c-bebe-52f5f359098f tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:00.392984 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b0e6bf3-3fdd-459c-bebe-52f5f359098f tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:00.393871 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b0e6bf3-3fdd-459c-bebe-52f5f359098f tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:00.394595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b0e6bf3-3fdd-459c-bebe-52f5f359098f tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:00.578653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8b0e6bf3-3fdd-459c-bebe-52f5f359098f tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:00.589869 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8b0e6bf3-3fdd-459c-bebe-52f5f359098f tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1525 microversion: 2.1 time: 0.214009 Oct 05 02:49:00.591516 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2230/4444] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:00 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1525 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:00.595052 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b2dfd300-a476-4c78-8dee-ef9bec7745c7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:00.596480 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b2dfd300-a476-4c78-8dee-ef9bec7745c7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:00.605733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2dfd300-a476-4c78-8dee-ef9bec7745c7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:00.606783 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2dfd300-a476-4c78-8dee-ef9bec7745c7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:00.607477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2dfd300-a476-4c78-8dee-ef9bec7745c7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:00.608448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2dfd300-a476-4c78-8dee-ef9bec7745c7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:00.609222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2dfd300-a476-4c78-8dee-ef9bec7745c7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:00.610231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2dfd300-a476-4c78-8dee-ef9bec7745c7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:00.788115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b2dfd300-a476-4c78-8dee-ef9bec7745c7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:00.802368 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b2dfd300-a476-4c78-8dee-ef9bec7745c7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1511 microversion: 2.1 time: 0.211323 Oct 05 02:49:00.804763 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2215/4445] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:00 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1511 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:01.618973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9eadee46-dd10-4048-85a7-f4c275e50fb6 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:01.620281 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9eadee46-dd10-4048-85a7-f4c275e50fb6 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:01.631288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9eadee46-dd10-4048-85a7-f4c275e50fb6 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:01.632056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9eadee46-dd10-4048-85a7-f4c275e50fb6 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:01.632680 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9eadee46-dd10-4048-85a7-f4c275e50fb6 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:01.633566 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9eadee46-dd10-4048-85a7-f4c275e50fb6 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:01.634088 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9eadee46-dd10-4048-85a7-f4c275e50fb6 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:01.634535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9eadee46-dd10-4048-85a7-f4c275e50fb6 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:01.809081 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9eadee46-dd10-4048-85a7-f4c275e50fb6 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:01.818685 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9eadee46-dd10-4048-85a7-f4c275e50fb6 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1525 microversion: 2.1 time: 0.204229 Oct 05 02:49:01.819918 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2231/4446] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:01 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1525 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:01.829563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b267501d-80d1-4d18-91c5-d56a558285f8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:01.830847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b267501d-80d1-4d18-91c5-d56a558285f8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:01.838950 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:01.851999 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b267501d-80d1-4d18-91c5-d56a558285f8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:01.852574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b267501d-80d1-4d18-91c5-d56a558285f8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:01.853491 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b267501d-80d1-4d18-91c5-d56a558285f8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:01.854487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b267501d-80d1-4d18-91c5-d56a558285f8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:01.855206 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b267501d-80d1-4d18-91c5-d56a558285f8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:01.856067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b267501d-80d1-4d18-91c5-d56a558285f8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:02.086399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b267501d-80d1-4d18-91c5-d56a558285f8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:02.099156 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b267501d-80d1-4d18-91c5-d56a558285f8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1511 microversion: 2.1 time: 0.273492 Oct 05 02:49:02.100314 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2216/4447] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:01 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1511 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:02.845872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-db8e252e-e329-4241-afe0-6f07d00d6c66 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:02.846501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-db8e252e-e329-4241-afe0-6f07d00d6c66 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:02.855401 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db8e252e-e329-4241-afe0-6f07d00d6c66 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:02.855900 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db8e252e-e329-4241-afe0-6f07d00d6c66 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:02.856344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db8e252e-e329-4241-afe0-6f07d00d6c66 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:02.857090 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db8e252e-e329-4241-afe0-6f07d00d6c66 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:02.857554 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db8e252e-e329-4241-afe0-6f07d00d6c66 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:02.857983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db8e252e-e329-4241-afe0-6f07d00d6c66 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:02.878055 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:02.992128 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-93f1277f-9c70-4461-b820-99a0c039cc15 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:02.993535 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-93f1277f-9c70-4461-b820-99a0c039cc15 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: ae8e1003-15ab-4801-a026-e9d80e200d3c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:03.004531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93f1277f-9c70-4461-b820-99a0c039cc15 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:03.005585 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93f1277f-9c70-4461-b820-99a0c039cc15 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:03.007976 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93f1277f-9c70-4461-b820-99a0c039cc15 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:03.009132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93f1277f-9c70-4461-b820-99a0c039cc15 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:03.009819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93f1277f-9c70-4461-b820-99a0c039cc15 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:03.010396 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93f1277f-9c70-4461-b820-99a0c039cc15 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:03.049083 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-93f1277f-9c70-4461-b820-99a0c039cc15 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] HTTP exception thrown: Instance ae8e1003-15ab-4801-a026-e9d80e200d3c could not be found. Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-93f1277f-9c70-4461-b820-99a0c039cc15 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Request method failure captured: Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c HTTP/1.1 Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO65ExXFSMcv-UYGFiGC6ownV_rHFtaePi5NC2Vdud2LC6WavS6h4ro52z50RYYtQxAu5Mc3FpnY7BXVdbMqPcgepNZwBqAaHERrgmPzkHi5wlJ9X7Ay3ec5_pcoUMvhRWKtNoSxi-hf2OJVrgwb-n0TSs9Oo3HDatyGWBlHEpMqa4M Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 20891ecf732b4c4597e3bfa0d96585a7 Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-AttachVolumeTestJSON-191918943 Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/20891ecf732b4c4597e3bfa0d96585a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/20891ecf732b4c4597e3bfa0d96585a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/20891ecf732b4c4597e3bfa0d96585a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_20891ecf732b4c4597e3bfa0d96585a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-AttachVolumeTestJSON-191918943 Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 20891ecf732b4c4597e3bfa0d96585a7 Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-AttachVolumeTestJSON-191918943 Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-AttachVolumeTestJSON-191918943-project Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 4c2aedcc40d84bb6a287c2bac019ed4e Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-AttachVolumeTestJSON-191918943-project Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance ae8e1003-15ab-4801-a026-e9d80e200d3c could not be found. Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'ae8e1003-15ab-4801-a026-e9d80e200d3c'} Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae8e1003-15ab-4801-a026-e9d80e200d3c could not be found. Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:49:03.051009 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:49:03.055239 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae8e1003-15ab-4801-a026-e9d80e200d3c could not be found. Oct 05 02:49:03.055239 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:03.055239 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:03.055239 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:03.055239 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:03.055239 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:03.055239 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:03.055239 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:49:03.055239 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:49:03.055239 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae8e1003-15ab-4801-a026-e9d80e200d3c could not be found. Oct 05 02:49:03.055239 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:03.056852 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-93f1277f-9c70-4461-b820-99a0c039cc15 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Returning 404 to user: Instance ae8e1003-15ab-4801-a026-e9d80e200d3c could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:49:03.058283 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-93f1277f-9c70-4461-b820-99a0c039cc15 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c" status: 404 len: 111 microversion: 2.1 time: 0.070323 Oct 05 02:49:03.059187 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2217/4448] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:49:02 2022] DELETE /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:49:03.067050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-da0e050d-46a6-4243-ab93-01a69a31d568 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:03.067860 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-da0e050d-46a6-4243-ab93-01a69a31d568 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: ae8e1003-15ab-4801-a026-e9d80e200d3c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:03.074265 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da0e050d-46a6-4243-ab93-01a69a31d568 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:03.074830 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da0e050d-46a6-4243-ab93-01a69a31d568 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:03.075489 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da0e050d-46a6-4243-ab93-01a69a31d568 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:03.076267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da0e050d-46a6-4243-ab93-01a69a31d568 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:03.076790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da0e050d-46a6-4243-ab93-01a69a31d568 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:03.077344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da0e050d-46a6-4243-ab93-01a69a31d568 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:03.095010 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-da0e050d-46a6-4243-ab93-01a69a31d568 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] HTTP exception thrown: Instance ae8e1003-15ab-4801-a026-e9d80e200d3c could not be found. Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-da0e050d-46a6-4243-ab93-01a69a31d568 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Request method failure captured: Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c HTTP/1.1 Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO65ExXFSMcv-UYGFiGC6ownV_rHFtaePi5NC2Vdud2LC6WavS6h4ro52z50RYYtQxAu5Mc3FpnY7BXVdbMqPcgepNZwBqAaHERrgmPzkHi5wlJ9X7Ay3ec5_pcoUMvhRWKtNoSxi-hf2OJVrgwb-n0TSs9Oo3HDatyGWBlHEpMqa4M Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 20891ecf732b4c4597e3bfa0d96585a7 Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-AttachVolumeTestJSON-191918943 Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/20891ecf732b4c4597e3bfa0d96585a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/20891ecf732b4c4597e3bfa0d96585a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/20891ecf732b4c4597e3bfa0d96585a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_20891ecf732b4c4597e3bfa0d96585a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-AttachVolumeTestJSON-191918943 Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 20891ecf732b4c4597e3bfa0d96585a7 Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-AttachVolumeTestJSON-191918943 Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-AttachVolumeTestJSON-191918943-project Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 4c2aedcc40d84bb6a287c2bac019ed4e Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-AttachVolumeTestJSON-191918943-project Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance ae8e1003-15ab-4801-a026-e9d80e200d3c could not be found. Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'ae8e1003-15ab-4801-a026-e9d80e200d3c'} Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae8e1003-15ab-4801-a026-e9d80e200d3c could not be found. Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae8e1003-15ab-4801-a026-e9d80e200d3c could not be found. Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:03.096541 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:03.100802 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:03.100802 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:03.100802 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:03.100802 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:49:03.100802 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:49:03.100802 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae8e1003-15ab-4801-a026-e9d80e200d3c could not be found. Oct 05 02:49:03.100802 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:03.100802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-da0e050d-46a6-4243-ab93-01a69a31d568 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Returning 404 to user: Instance ae8e1003-15ab-4801-a026-e9d80e200d3c could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:49:03.100802 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-da0e050d-46a6-4243-ab93-01a69a31d568 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c" status: 404 len: 111 microversion: 2.1 time: 0.035017 Oct 05 02:49:03.100802 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2218/4449] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:03 2022] GET /compute/v2.1/servers/ae8e1003-15ab-4801-a026-e9d80e200d3c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:49:03.128775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f186fc0d-65f5-450e-9256-b2078aa3241a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:03.129023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-db8e252e-e329-4241-afe0-6f07d00d6c66 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:03.129133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f186fc0d-65f5-450e-9256-b2078aa3241a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:03.137082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f186fc0d-65f5-450e-9256-b2078aa3241a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:03.137550 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-db8e252e-e329-4241-afe0-6f07d00d6c66 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1525 microversion: 2.1 time: 0.295806 Oct 05 02:49:03.137967 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f186fc0d-65f5-450e-9256-b2078aa3241a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:03.138501 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2232/4450] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:02 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1525 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:03.139435 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f186fc0d-65f5-450e-9256-b2078aa3241a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:03.140341 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f186fc0d-65f5-450e-9256-b2078aa3241a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:03.141934 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f186fc0d-65f5-450e-9256-b2078aa3241a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:03.143206 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f186fc0d-65f5-450e-9256-b2078aa3241a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:03.389523 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f186fc0d-65f5-450e-9256-b2078aa3241a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:03.397561 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f186fc0d-65f5-450e-9256-b2078aa3241a tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1511 microversion: 2.1 time: 0.277710 Oct 05 02:49:03.398715 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2219/4451] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:03 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1511 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:04.165729 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a3888ea3-8ff5-426a-afc8-523b6ef7502a tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:04.166342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a3888ea3-8ff5-426a-afc8-523b6ef7502a tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:04.179983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3888ea3-8ff5-426a-afc8-523b6ef7502a tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:04.180645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3888ea3-8ff5-426a-afc8-523b6ef7502a tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:04.181208 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3888ea3-8ff5-426a-afc8-523b6ef7502a tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:04.182049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3888ea3-8ff5-426a-afc8-523b6ef7502a tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:04.182809 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3888ea3-8ff5-426a-afc8-523b6ef7502a tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:04.183534 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3888ea3-8ff5-426a-afc8-523b6ef7502a tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:04.364668 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a3888ea3-8ff5-426a-afc8-523b6ef7502a tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:04.372788 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a3888ea3-8ff5-426a-afc8-523b6ef7502a tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1525 microversion: 2.1 time: 0.211181 Oct 05 02:49:04.373419 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2233/4452] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:04 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1525 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:04.423784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-98f069da-c03a-47aa-85d7-e8d42737dea3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:04.424981 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-98f069da-c03a-47aa-85d7-e8d42737dea3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:04.433775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98f069da-c03a-47aa-85d7-e8d42737dea3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:04.434452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98f069da-c03a-47aa-85d7-e8d42737dea3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:04.435042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98f069da-c03a-47aa-85d7-e8d42737dea3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:04.435925 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98f069da-c03a-47aa-85d7-e8d42737dea3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:04.437615 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98f069da-c03a-47aa-85d7-e8d42737dea3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:04.439005 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98f069da-c03a-47aa-85d7-e8d42737dea3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:04.640734 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-98f069da-c03a-47aa-85d7-e8d42737dea3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:04.653189 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-98f069da-c03a-47aa-85d7-e8d42737dea3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1511 microversion: 2.1 time: 0.234124 Oct 05 02:49:04.654675 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2220/4453] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:04 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1511 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:05.399192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-71e6821c-0e13-4587-9a9c-678bb98361b4 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:05.400045 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-71e6821c-0e13-4587-9a9c-678bb98361b4 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:05.409047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71e6821c-0e13-4587-9a9c-678bb98361b4 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:05.409534 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71e6821c-0e13-4587-9a9c-678bb98361b4 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:05.410039 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71e6821c-0e13-4587-9a9c-678bb98361b4 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:05.410818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71e6821c-0e13-4587-9a9c-678bb98361b4 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:05.411408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71e6821c-0e13-4587-9a9c-678bb98361b4 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:05.411911 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71e6821c-0e13-4587-9a9c-678bb98361b4 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:05.576356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-71e6821c-0e13-4587-9a9c-678bb98361b4 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:05.584265 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-71e6821c-0e13-4587-9a9c-678bb98361b4 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1525 microversion: 2.1 time: 0.189174 Oct 05 02:49:05.585559 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2234/4454] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:05 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1525 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:05.675451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2fd27361-8297-4c43-8dae-e5e0007e1796 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:05.676069 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2fd27361-8297-4c43-8dae-e5e0007e1796 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:05.683301 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fd27361-8297-4c43-8dae-e5e0007e1796 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:05.683883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fd27361-8297-4c43-8dae-e5e0007e1796 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:05.684537 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fd27361-8297-4c43-8dae-e5e0007e1796 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:05.685357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fd27361-8297-4c43-8dae-e5e0007e1796 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:05.685888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fd27361-8297-4c43-8dae-e5e0007e1796 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:05.686550 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fd27361-8297-4c43-8dae-e5e0007e1796 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:05.836333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2fd27361-8297-4c43-8dae-e5e0007e1796 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:05.845469 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2fd27361-8297-4c43-8dae-e5e0007e1796 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1511 microversion: 2.1 time: 0.173808 Oct 05 02:49:05.858029 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2221/4455] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:05 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1511 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:06.406252 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-11d6620b-498f-490a-b659-d57364a46fc0 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:06.406765 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-11d6620b-498f-490a-b659-d57364a46fc0 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:06.413566 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11d6620b-498f-490a-b659-d57364a46fc0 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:06.414061 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11d6620b-498f-490a-b659-d57364a46fc0 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:06.414678 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11d6620b-498f-490a-b659-d57364a46fc0 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:06.415558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11d6620b-498f-490a-b659-d57364a46fc0 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:06.416176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11d6620b-498f-490a-b659-d57364a46fc0 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:06.416804 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11d6620b-498f-490a-b659-d57364a46fc0 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:06.431270 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-11d6620b-498f-490a-b659-d57364a46fc0 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] HTTP exception thrown: Instance 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 could not be found. Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-11d6620b-498f-490a-b659-d57364a46fc0 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Request method failure captured: Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 HTTP/1.1 Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO65ExXFSMcv-UYGFiGC6ownV_rHFtaePi5NC2Vdud2LC6WavS6h4ro52z50RYYtQxAu5Mc3FpnY7BXVdbMqPcgepNZwBqAaHERrgmPzkHi5wlJ9X7Ay3ec5_pcoUMvhRWKtNoSxi-hf2OJVrgwb-n0TSs9Oo3HDatyGWBlHEpMqa4M Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 20891ecf732b4c4597e3bfa0d96585a7 Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-AttachVolumeTestJSON-191918943 Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/20891ecf732b4c4597e3bfa0d96585a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/20891ecf732b4c4597e3bfa0d96585a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/20891ecf732b4c4597e3bfa0d96585a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_20891ecf732b4c4597e3bfa0d96585a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-AttachVolumeTestJSON-191918943 Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 20891ecf732b4c4597e3bfa0d96585a7 Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-AttachVolumeTestJSON-191918943 Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-AttachVolumeTestJSON-191918943-project Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 4c2aedcc40d84bb6a287c2bac019ed4e Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-AttachVolumeTestJSON-191918943-project Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 could not be found. Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '6d47438b-a5f5-4dfb-a134-c5cd6dc5a397'} Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 could not be found. Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:49:06.433332 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:49:06.437711 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 could not be found. Oct 05 02:49:06.437711 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:06.437711 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:06.437711 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:06.437711 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:06.437711 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:06.437711 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:06.437711 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:49:06.437711 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:49:06.437711 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 could not be found. Oct 05 02:49:06.437711 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:06.439794 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-11d6620b-498f-490a-b659-d57364a46fc0 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Returning 404 to user: Instance 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:49:06.440814 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-11d6620b-498f-490a-b659-d57364a46fc0 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 404 len: 111 microversion: 2.1 time: 0.039608 Oct 05 02:49:06.441881 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2235/4456] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:49:06 2022] DELETE /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:49:06.451005 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cb9410fe-bdea-415f-ac89-d0fb4cb17012 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:06.451942 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cb9410fe-bdea-415f-ac89-d0fb4cb17012 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] [instance: 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:06.458506 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb9410fe-bdea-415f-ac89-d0fb4cb17012 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:06.459066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb9410fe-bdea-415f-ac89-d0fb4cb17012 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:06.459514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb9410fe-bdea-415f-ac89-d0fb4cb17012 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:06.460727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb9410fe-bdea-415f-ac89-d0fb4cb17012 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:06.461269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb9410fe-bdea-415f-ac89-d0fb4cb17012 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:06.461834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb9410fe-bdea-415f-ac89-d0fb4cb17012 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:06.479380 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-cb9410fe-bdea-415f-ac89-d0fb4cb17012 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] HTTP exception thrown: Instance 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 could not be found. Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cb9410fe-bdea-415f-ac89-d0fb4cb17012 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Request method failure captured: Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 HTTP/1.1 Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO65ExXFSMcv-UYGFiGC6ownV_rHFtaePi5NC2Vdud2LC6WavS6h4ro52z50RYYtQxAu5Mc3FpnY7BXVdbMqPcgepNZwBqAaHERrgmPzkHi5wlJ9X7Ay3ec5_pcoUMvhRWKtNoSxi-hf2OJVrgwb-n0TSs9Oo3HDatyGWBlHEpMqa4M Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 20891ecf732b4c4597e3bfa0d96585a7 Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-AttachVolumeTestJSON-191918943 Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/20891ecf732b4c4597e3bfa0d96585a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/20891ecf732b4c4597e3bfa0d96585a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/20891ecf732b4c4597e3bfa0d96585a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_20891ecf732b4c4597e3bfa0d96585a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-AttachVolumeTestJSON-191918943 Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 20891ecf732b4c4597e3bfa0d96585a7 Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-AttachVolumeTestJSON-191918943 Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-AttachVolumeTestJSON-191918943-project Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 4c2aedcc40d84bb6a287c2bac019ed4e Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-AttachVolumeTestJSON-191918943-project Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 could not be found. Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '6d47438b-a5f5-4dfb-a134-c5cd6dc5a397'} Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 could not be found. Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 could not be found. Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:06.481031 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:06.484983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:06.484983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:06.484983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:06.484983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:49:06.484983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:49:06.484983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 could not be found. Oct 05 02:49:06.484983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:06.484983 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cb9410fe-bdea-415f-ac89-d0fb4cb17012 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] Returning 404 to user: Instance 6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:49:06.484983 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cb9410fe-bdea-415f-ac89-d0fb4cb17012 tempest-AttachVolumeTestJSON-191918943 tempest-AttachVolumeTestJSON-191918943-project] 10.222.0.16 "GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397" status: 404 len: 111 microversion: 2.1 time: 0.036777 Oct 05 02:49:06.484983 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2222/4457] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:06 2022] GET /compute/v2.1/servers/6d47438b-a5f5-4dfb-a134-c5cd6dc5a397 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:49:06.609569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-471063fc-f495-474d-adae-83d14061b2d2 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:06.610252 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-471063fc-f495-474d-adae-83d14061b2d2 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:06.622310 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-471063fc-f495-474d-adae-83d14061b2d2 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:06.623047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-471063fc-f495-474d-adae-83d14061b2d2 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:06.623714 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-471063fc-f495-474d-adae-83d14061b2d2 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:06.624677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-471063fc-f495-474d-adae-83d14061b2d2 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:06.625522 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-471063fc-f495-474d-adae-83d14061b2d2 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:06.626165 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-471063fc-f495-474d-adae-83d14061b2d2 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:06.871998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-195089fb-a38a-42ed-b678-109cfc2798cb tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:06.873386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-195089fb-a38a-42ed-b678-109cfc2798cb tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:06.881775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-195089fb-a38a-42ed-b678-109cfc2798cb tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:06.882651 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-195089fb-a38a-42ed-b678-109cfc2798cb tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:06.883387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-195089fb-a38a-42ed-b678-109cfc2798cb tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:06.884365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-195089fb-a38a-42ed-b678-109cfc2798cb tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:06.885131 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-195089fb-a38a-42ed-b678-109cfc2798cb tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:06.886513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-195089fb-a38a-42ed-b678-109cfc2798cb tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:06.892008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-471063fc-f495-474d-adae-83d14061b2d2 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:06.904155 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-471063fc-f495-474d-adae-83d14061b2d2 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1525 microversion: 2.1 time: 0.298973 Oct 05 02:49:06.905171 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2236/4458] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:06 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1525 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:07.160664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-195089fb-a38a-42ed-b678-109cfc2798cb tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:07.169538 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-195089fb-a38a-42ed-b678-109cfc2798cb tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1511 microversion: 2.1 time: 0.302275 Oct 05 02:49:07.170443 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2223/4459] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:06 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1511 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:49:07.931638 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6d14f8a5-302e-41e9-9857-41cab0819169 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:07.933141 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6d14f8a5-302e-41e9-9857-41cab0819169 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:07.945694 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6d14f8a5-302e-41e9-9857-41cab0819169 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:07.946595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6d14f8a5-302e-41e9-9857-41cab0819169 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:07.947286 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6d14f8a5-302e-41e9-9857-41cab0819169 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:07.949470 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6d14f8a5-302e-41e9-9857-41cab0819169 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:07.950228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6d14f8a5-302e-41e9-9857-41cab0819169 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:07.950893 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6d14f8a5-302e-41e9-9857-41cab0819169 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:08.195166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-01da8e05-7c54-4ade-b9a3-7f3b7bb3752f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:08.196330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-01da8e05-7c54-4ade-b9a3-7f3b7bb3752f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:08.203682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6d14f8a5-302e-41e9-9857-41cab0819169 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:08.208942 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01da8e05-7c54-4ade-b9a3-7f3b7bb3752f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:08.209316 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01da8e05-7c54-4ade-b9a3-7f3b7bb3752f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:08.212013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01da8e05-7c54-4ade-b9a3-7f3b7bb3752f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:08.217642 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01da8e05-7c54-4ade-b9a3-7f3b7bb3752f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:08.217893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01da8e05-7c54-4ade-b9a3-7f3b7bb3752f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:08.219060 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01da8e05-7c54-4ade-b9a3-7f3b7bb3752f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:08.221553 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6d14f8a5-302e-41e9-9857-41cab0819169 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1525 microversion: 2.1 time: 0.294208 Oct 05 02:49:08.222445 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2237/4460] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:07 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1525 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:08.486097 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-01da8e05-7c54-4ade-b9a3-7f3b7bb3752f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:08.496096 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-01da8e05-7c54-4ade-b9a3-7f3b7bb3752f tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1511 microversion: 2.1 time: 0.303861 Oct 05 02:49:08.497126 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2224/4461] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:08 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1511 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:49:09.247829 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-36cceac0-4b01-4e8e-9247-ce59936ff1b1 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:09.248815 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-36cceac0-4b01-4e8e-9247-ce59936ff1b1 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:09.256077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36cceac0-4b01-4e8e-9247-ce59936ff1b1 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:09.256917 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36cceac0-4b01-4e8e-9247-ce59936ff1b1 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:09.257482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36cceac0-4b01-4e8e-9247-ce59936ff1b1 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:09.258273 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36cceac0-4b01-4e8e-9247-ce59936ff1b1 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:09.258991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36cceac0-4b01-4e8e-9247-ce59936ff1b1 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:09.259487 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36cceac0-4b01-4e8e-9247-ce59936ff1b1 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:09.519789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7117e7df-5dc5-4f27-b88b-21af6d275e58 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:09.522997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-36cceac0-4b01-4e8e-9247-ce59936ff1b1 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:09.525115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7117e7df-5dc5-4f27-b88b-21af6d275e58 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:09.540439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7117e7df-5dc5-4f27-b88b-21af6d275e58 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:09.544263 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-36cceac0-4b01-4e8e-9247-ce59936ff1b1 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1525 microversion: 2.1 time: 0.302369 Oct 05 02:49:09.545285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7117e7df-5dc5-4f27-b88b-21af6d275e58 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:09.546357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7117e7df-5dc5-4f27-b88b-21af6d275e58 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:09.547106 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7117e7df-5dc5-4f27-b88b-21af6d275e58 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:09.547639 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7117e7df-5dc5-4f27-b88b-21af6d275e58 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:09.548029 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7117e7df-5dc5-4f27-b88b-21af6d275e58 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:09.549817 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2238/4462] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:09 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1525 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:09.796474 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7117e7df-5dc5-4f27-b88b-21af6d275e58 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:09.812862 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7117e7df-5dc5-4f27-b88b-21af6d275e58 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1511 microversion: 2.1 time: 0.296839 Oct 05 02:49:09.814560 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2225/4463] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:09 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1511 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:10.601225 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-579b5960-43aa-4739-a672-28f625796367 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:10.601843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-579b5960-43aa-4739-a672-28f625796367 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:10.629677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-579b5960-43aa-4739-a672-28f625796367 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:10.629933 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-579b5960-43aa-4739-a672-28f625796367 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:10.631640 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-579b5960-43aa-4739-a672-28f625796367 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:10.636165 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-579b5960-43aa-4739-a672-28f625796367 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:10.638120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-579b5960-43aa-4739-a672-28f625796367 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:10.638942 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-579b5960-43aa-4739-a672-28f625796367 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:10.838973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2ec7d51f-e4e5-4615-bda0-95d2cf797353 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:10.840242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2ec7d51f-e4e5-4615-bda0-95d2cf797353 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:10.855319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ec7d51f-e4e5-4615-bda0-95d2cf797353 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:10.855978 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ec7d51f-e4e5-4615-bda0-95d2cf797353 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:10.873274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ec7d51f-e4e5-4615-bda0-95d2cf797353 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:10.875613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ec7d51f-e4e5-4615-bda0-95d2cf797353 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:10.876490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ec7d51f-e4e5-4615-bda0-95d2cf797353 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:10.878965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ec7d51f-e4e5-4615-bda0-95d2cf797353 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:10.879108 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-579b5960-43aa-4739-a672-28f625796367 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:10.903844 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-579b5960-43aa-4739-a672-28f625796367 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1525 microversion: 2.1 time: 0.316484 Oct 05 02:49:10.906284 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2239/4464] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:10 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1525 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:11.144999 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2ec7d51f-e4e5-4615-bda0-95d2cf797353 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:11.156503 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2ec7d51f-e4e5-4615-bda0-95d2cf797353 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1511 microversion: 2.1 time: 0.321751 Oct 05 02:49:11.169177 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2226/4465] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:10 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1511 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:11.560369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dd1b43db-3435-41e8-afaa-88f62b5c6746 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:11.561020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dd1b43db-3435-41e8-afaa-88f62b5c6746 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:11.571565 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd1b43db-3435-41e8-afaa-88f62b5c6746 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:11.572254 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd1b43db-3435-41e8-afaa-88f62b5c6746 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:11.572754 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd1b43db-3435-41e8-afaa-88f62b5c6746 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:11.573655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd1b43db-3435-41e8-afaa-88f62b5c6746 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:11.574208 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd1b43db-3435-41e8-afaa-88f62b5c6746 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:11.574639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd1b43db-3435-41e8-afaa-88f62b5c6746 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:11.796836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dd1b43db-3435-41e8-afaa-88f62b5c6746 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:11.806257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dd1b43db-3435-41e8-afaa-88f62b5c6746 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:11.808396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dd1b43db-3435-41e8-afaa-88f62b5c6746 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:11.809689 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dd1b43db-3435-41e8-afaa-88f62b5c6746 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 2957 microversion: 2.42 time: 0.254474 Oct 05 02:49:11.810459 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2240/4466] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:49:11 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 2957 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:49:11.847689 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b5ce794a-6310-4ebd-bc2d-197dec261af4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:11.848221 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b5ce794a-6310-4ebd-bc2d-197dec261af4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:11.857338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5ce794a-6310-4ebd-bc2d-197dec261af4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:11.858621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5ce794a-6310-4ebd-bc2d-197dec261af4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:11.859286 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5ce794a-6310-4ebd-bc2d-197dec261af4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:11.860385 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5ce794a-6310-4ebd-bc2d-197dec261af4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:11.860979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5ce794a-6310-4ebd-bc2d-197dec261af4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:11.861837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5ce794a-6310-4ebd-bc2d-197dec261af4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:11.929879 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-481e0cb5-9106-4770-b92e-2682cf9a4d93 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:11.931009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-481e0cb5-9106-4770-b92e-2682cf9a4d93 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:11.937909 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-481e0cb5-9106-4770-b92e-2682cf9a4d93 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:11.938253 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-481e0cb5-9106-4770-b92e-2682cf9a4d93 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:11.939021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-481e0cb5-9106-4770-b92e-2682cf9a4d93 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:11.939768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-481e0cb5-9106-4770-b92e-2682cf9a4d93 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:11.940261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-481e0cb5-9106-4770-b92e-2682cf9a4d93 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:11.940819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-481e0cb5-9106-4770-b92e-2682cf9a4d93 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:12.039573 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b5ce794a-6310-4ebd-bc2d-197dec261af4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.202017 Oct 05 02:49:12.041078 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2227/4467] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Oct 5 02:49:11 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87/os-interface => generated 1832 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:49:12.186029 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ade146d0-5063-4a6c-8212-81edbff9a020 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:12.187027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ade146d0-5063-4a6c-8212-81edbff9a020 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:12.193718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ade146d0-5063-4a6c-8212-81edbff9a020 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:12.195465 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ade146d0-5063-4a6c-8212-81edbff9a020 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:12.196137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ade146d0-5063-4a6c-8212-81edbff9a020 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:12.198314 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ade146d0-5063-4a6c-8212-81edbff9a020 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:12.198822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ade146d0-5063-4a6c-8212-81edbff9a020 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:12.199577 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ade146d0-5063-4a6c-8212-81edbff9a020 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:12.208759 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-481e0cb5-9106-4770-b92e-2682cf9a4d93 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:12.223857 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-481e0cb5-9106-4770-b92e-2682cf9a4d93 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1525 microversion: 2.1 time: 0.297706 Oct 05 02:49:12.224702 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2241/4468] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:11 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1525 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:12.411445 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ade146d0-5063-4a6c-8212-81edbff9a020 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:12.421982 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ade146d0-5063-4a6c-8212-81edbff9a020 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1511 microversion: 2.1 time: 0.240398 Oct 05 02:49:12.423011 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2228/4469] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:12 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1511 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:13.250065 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3303607d-514c-4805-bcae-d5ea39eecd7f tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:13.251914 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3303607d-514c-4805-bcae-d5ea39eecd7f tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:13.259009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3303607d-514c-4805-bcae-d5ea39eecd7f tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:13.259503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3303607d-514c-4805-bcae-d5ea39eecd7f tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:13.259950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3303607d-514c-4805-bcae-d5ea39eecd7f tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:13.260801 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3303607d-514c-4805-bcae-d5ea39eecd7f tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:13.261457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3303607d-514c-4805-bcae-d5ea39eecd7f tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:13.262051 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3303607d-514c-4805-bcae-d5ea39eecd7f tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:13.448580 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-febccaec-0658-4024-a805-b2ecd076754e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:13.449399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-febccaec-0658-4024-a805-b2ecd076754e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:13.466745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-febccaec-0658-4024-a805-b2ecd076754e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:13.467426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-febccaec-0658-4024-a805-b2ecd076754e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:13.468046 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-febccaec-0658-4024-a805-b2ecd076754e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:13.468206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3303607d-514c-4805-bcae-d5ea39eecd7f tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:13.468762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-febccaec-0658-4024-a805-b2ecd076754e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:13.469255 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-febccaec-0658-4024-a805-b2ecd076754e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:13.469683 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-febccaec-0658-4024-a805-b2ecd076754e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:13.484494 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3303607d-514c-4805-bcae-d5ea39eecd7f tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1525 microversion: 2.1 time: 0.239744 Oct 05 02:49:13.485446 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2242/4470] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:13 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1525 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:13.678857 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-febccaec-0658-4024-a805-b2ecd076754e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:13.689844 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-febccaec-0658-4024-a805-b2ecd076754e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1511 microversion: 2.1 time: 0.245836 Oct 05 02:49:13.690533 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2229/4471] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:13 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1511 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:49:14.507784 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-91076d08-45f7-472a-8ae5-7a8fde555977 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:14.508424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-91076d08-45f7-472a-8ae5-7a8fde555977 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:14.521105 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91076d08-45f7-472a-8ae5-7a8fde555977 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:14.525481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91076d08-45f7-472a-8ae5-7a8fde555977 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:14.527299 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91076d08-45f7-472a-8ae5-7a8fde555977 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:14.529502 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91076d08-45f7-472a-8ae5-7a8fde555977 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:14.540857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91076d08-45f7-472a-8ae5-7a8fde555977 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:14.542236 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91076d08-45f7-472a-8ae5-7a8fde555977 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:14.726183 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-41c87156-354b-40bd-9a96-cc61d89e5b18 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:14.726816 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-41c87156-354b-40bd-9a96-cc61d89e5b18 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:14.748842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41c87156-354b-40bd-9a96-cc61d89e5b18 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:14.751124 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41c87156-354b-40bd-9a96-cc61d89e5b18 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:14.752638 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41c87156-354b-40bd-9a96-cc61d89e5b18 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:14.754676 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41c87156-354b-40bd-9a96-cc61d89e5b18 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:14.755787 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41c87156-354b-40bd-9a96-cc61d89e5b18 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:14.756520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41c87156-354b-40bd-9a96-cc61d89e5b18 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:14.794307 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:15.047027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-41c87156-354b-40bd-9a96-cc61d89e5b18 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:15.064552 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-41c87156-354b-40bd-9a96-cc61d89e5b18 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1511 microversion: 2.1 time: 0.343478 Oct 05 02:49:15.073643 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2230/4472] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:14 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1511 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:15.161247 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-91076d08-45f7-472a-8ae5-7a8fde555977 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:15.172771 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-91076d08-45f7-472a-8ae5-7a8fde555977 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1525 microversion: 2.1 time: 0.668912 Oct 05 02:49:15.183736 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2243/4473] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:14 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1525 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:16.091848 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-444f95ca-a6a4-456e-aece-4ff056dae859 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:16.093200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-444f95ca-a6a4-456e-aece-4ff056dae859 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:16.100857 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-444f95ca-a6a4-456e-aece-4ff056dae859 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:16.101403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-444f95ca-a6a4-456e-aece-4ff056dae859 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:16.101843 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-444f95ca-a6a4-456e-aece-4ff056dae859 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:16.102546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-444f95ca-a6a4-456e-aece-4ff056dae859 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:16.102997 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-444f95ca-a6a4-456e-aece-4ff056dae859 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:16.103420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-444f95ca-a6a4-456e-aece-4ff056dae859 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:16.203493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-058dc0c1-1d0d-4c93-ab03-b257571c4176 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:16.204769 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-058dc0c1-1d0d-4c93-ab03-b257571c4176 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:16.213379 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-058dc0c1-1d0d-4c93-ab03-b257571c4176 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:16.214116 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-058dc0c1-1d0d-4c93-ab03-b257571c4176 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:16.214768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-058dc0c1-1d0d-4c93-ab03-b257571c4176 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:16.215841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-058dc0c1-1d0d-4c93-ab03-b257571c4176 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:16.216367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-058dc0c1-1d0d-4c93-ab03-b257571c4176 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:16.217136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-058dc0c1-1d0d-4c93-ab03-b257571c4176 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:16.270806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-444f95ca-a6a4-456e-aece-4ff056dae859 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:16.281223 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-444f95ca-a6a4-456e-aece-4ff056dae859 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1511 microversion: 2.1 time: 0.194715 Oct 05 02:49:16.282482 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2231/4474] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:16 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1511 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:16.371576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-058dc0c1-1d0d-4c93-ab03-b257571c4176 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:16.383131 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-058dc0c1-1d0d-4c93-ab03-b257571c4176 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1525 microversion: 2.1 time: 0.187218 Oct 05 02:49:16.383895 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2244/4475] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:16 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1525 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:17.309853 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e428b9a0-4ddf-4bc6-a834-1aa1920db4e9 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:17.310694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e428b9a0-4ddf-4bc6-a834-1aa1920db4e9 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:17.323783 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e428b9a0-4ddf-4bc6-a834-1aa1920db4e9 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:17.324407 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e428b9a0-4ddf-4bc6-a834-1aa1920db4e9 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:17.325194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e428b9a0-4ddf-4bc6-a834-1aa1920db4e9 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:17.326836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e428b9a0-4ddf-4bc6-a834-1aa1920db4e9 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:17.327505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e428b9a0-4ddf-4bc6-a834-1aa1920db4e9 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:17.328241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e428b9a0-4ddf-4bc6-a834-1aa1920db4e9 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:17.407980 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-965fffb5-f30a-412d-a098-56b121bafac5 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:17.408601 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-965fffb5-f30a-412d-a098-56b121bafac5 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:17.417957 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-965fffb5-f30a-412d-a098-56b121bafac5 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:17.418459 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-965fffb5-f30a-412d-a098-56b121bafac5 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:17.418901 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-965fffb5-f30a-412d-a098-56b121bafac5 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:17.419650 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-965fffb5-f30a-412d-a098-56b121bafac5 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:17.420111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-965fffb5-f30a-412d-a098-56b121bafac5 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:17.420541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-965fffb5-f30a-412d-a098-56b121bafac5 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:17.569388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e428b9a0-4ddf-4bc6-a834-1aa1920db4e9 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:17.587052 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e428b9a0-4ddf-4bc6-a834-1aa1920db4e9 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1511 microversion: 2.1 time: 0.285137 Oct 05 02:49:17.588934 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2232/4476] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:17 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1511 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:17.626152 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-965fffb5-f30a-412d-a098-56b121bafac5 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:17.636514 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-965fffb5-f30a-412d-a098-56b121bafac5 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1525 microversion: 2.1 time: 0.232693 Oct 05 02:49:17.637672 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2245/4477] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:17 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1525 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:18.621318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-359ff3ae-a191-49f1-ab05-031e787c250e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:18.623841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-359ff3ae-a191-49f1-ab05-031e787c250e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:18.632485 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-359ff3ae-a191-49f1-ab05-031e787c250e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:18.633206 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-359ff3ae-a191-49f1-ab05-031e787c250e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:18.634158 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-359ff3ae-a191-49f1-ab05-031e787c250e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:18.635361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-359ff3ae-a191-49f1-ab05-031e787c250e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:18.636277 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-359ff3ae-a191-49f1-ab05-031e787c250e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:18.636938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-359ff3ae-a191-49f1-ab05-031e787c250e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:18.660148 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8ee15a6b-2111-4fe8-b0cc-3cedd0767183 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:18.661398 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8ee15a6b-2111-4fe8-b0cc-3cedd0767183 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:18.673444 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ee15a6b-2111-4fe8-b0cc-3cedd0767183 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:18.673949 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ee15a6b-2111-4fe8-b0cc-3cedd0767183 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:18.674384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ee15a6b-2111-4fe8-b0cc-3cedd0767183 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:18.678197 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ee15a6b-2111-4fe8-b0cc-3cedd0767183 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:18.678672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ee15a6b-2111-4fe8-b0cc-3cedd0767183 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:18.679107 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ee15a6b-2111-4fe8-b0cc-3cedd0767183 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:19.018473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8ee15a6b-2111-4fe8-b0cc-3cedd0767183 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:19.027621 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8ee15a6b-2111-4fe8-b0cc-3cedd0767183 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1505 microversion: 2.1 time: 0.371856 Oct 05 02:49:19.045656 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2246/4478] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:18 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1505 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:19.051480 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-359ff3ae-a191-49f1-ab05-031e787c250e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:19.057952 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-14ff4f9f-19c2-4407-8608-11af46dbc45e tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Action: 'create', calling method: .version_select at 0x7fccdefc7d30>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1852105424", "description": "tempest-description-1963950429"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:49:19.061205 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-359ff3ae-a191-49f1-ab05-031e787c250e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1488 microversion: 2.1 time: 0.452468 Oct 05 02:49:19.062035 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2233/4479] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:18 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1488 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:19.088296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d7627e4f-bc16-4022-a3ef-1bf3b418668c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:19.088953 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d7627e4f-bc16-4022-a3ef-1bf3b418668c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:19.096834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7627e4f-bc16-4022-a3ef-1bf3b418668c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:19.109875 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7627e4f-bc16-4022-a3ef-1bf3b418668c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:19.110583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7627e4f-bc16-4022-a3ef-1bf3b418668c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:19.111349 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7627e4f-bc16-4022-a3ef-1bf3b418668c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:19.111827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7627e4f-bc16-4022-a3ef-1bf3b418668c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:19.112268 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7627e4f-bc16-4022-a3ef-1bf3b418668c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:19.141029 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d7627e4f-bc16-4022-a3ef-1bf3b418668c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:49:19.230718 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d7627e4f-bc16-4022-a3ef-1bf3b418668c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 204 len: 0 microversion: 2.1 time: 0.146533 Oct 05 02:49:19.237754 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2234/4480] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:49:19 2022] DELETE /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:49:19.244114 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-447318b2-c893-4d97-9980-5330a8063613 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:19.244979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-447318b2-c893-4d97-9980-5330a8063613 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:19.251821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-447318b2-c893-4d97-9980-5330a8063613 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:19.252406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-447318b2-c893-4d97-9980-5330a8063613 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:19.253085 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-447318b2-c893-4d97-9980-5330a8063613 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:19.253960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-447318b2-c893-4d97-9980-5330a8063613 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:19.254573 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-447318b2-c893-4d97-9980-5330a8063613 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:19.255167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-447318b2-c893-4d97-9980-5330a8063613 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:19.458666 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-14ff4f9f-19c2-4407-8608-11af46dbc45e tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.409878 Oct 05 02:49:19.459448 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2247/4481] 10.222.0.16 () {60 vars in 1180 bytes} [Wed Oct 5 02:49:19 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:49:19.473470 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8e388230-27ea-4797-80c5-7bcca8d45f2e tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1852105424"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:49:19.474029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8e388230-27ea-4797-80c5-7bcca8d45f2e tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:19.483631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e388230-27ea-4797-80c5-7bcca8d45f2e tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:19.484144 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e388230-27ea-4797-80c5-7bcca8d45f2e tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:19.484587 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e388230-27ea-4797-80c5-7bcca8d45f2e tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:19.485567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e388230-27ea-4797-80c5-7bcca8d45f2e tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:19.486200 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e388230-27ea-4797-80c5-7bcca8d45f2e tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:19.486793 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e388230-27ea-4797-80c5-7bcca8d45f2e tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:19.506865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-447318b2-c893-4d97-9980-5330a8063613 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:19.516089 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-447318b2-c893-4d97-9980-5330a8063613 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1494 microversion: 2.1 time: 0.276387 Oct 05 02:49:19.516768 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2235/4482] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:19 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1494 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:19.679114 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.network.security_group_api [None req-8e388230-27ea-4797-80c5-7bcca8d45f2e tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Adding security group 1ce32527-2f68-494a-9b8f-e1a50d3d401f to port 93af56e9-cedc-4b3b-80a7-2c94ef741a18 Oct 05 02:49:20.048149 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8e388230-27ea-4797-80c5-7bcca8d45f2e tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "POST /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb/action" status: 202 len: 0 microversion: 2.1 time: 0.579242 Oct 05 02:49:20.048773 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2248/4483] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:49:19 2022] POST /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb/action => generated 0 bytes in 581 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 02:49:20.065397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5c0f3bb1-ad46-4993-ae24-fb0f83629888 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1852105424"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:49:20.065962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5c0f3bb1-ad46-4993-ae24-fb0f83629888 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:20.081159 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-ec316faa-7a5b-4916-b605-b22ac807964d req-0e88f1a4-4fda-461e-94f7-087554f2268f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a711b7d-3d62-4118-aa2f-985160e79ffb", "tag": "93af56e9-cedc-4b3b-80a7-2c94ef741a18"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:49:20.082808 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c0f3bb1-ad46-4993-ae24-fb0f83629888 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:20.083993 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c0f3bb1-ad46-4993-ae24-fb0f83629888 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:20.084987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c0f3bb1-ad46-4993-ae24-fb0f83629888 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:20.086404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c0f3bb1-ad46-4993-ae24-fb0f83629888 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:20.087539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c0f3bb1-ad46-4993-ae24-fb0f83629888 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:20.089784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c0f3bb1-ad46-4993-ae24-fb0f83629888 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:20.107977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ec316faa-7a5b-4916-b605-b22ac807964d req-0e88f1a4-4fda-461e-94f7-087554f2268f service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:20.109224 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ec316faa-7a5b-4916-b605-b22ac807964d req-0e88f1a4-4fda-461e-94f7-087554f2268f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:20.109904 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ec316faa-7a5b-4916-b605-b22ac807964d req-0e88f1a4-4fda-461e-94f7-087554f2268f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:20.125693 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-ec316faa-7a5b-4916-b605-b22ac807964d req-0e88f1a4-4fda-461e-94f7-087554f2268f service nova] Creating event network-changed:93af56e9-cedc-4b3b-80a7-2c94ef741a18 for instance 3a711b7d-3d62-4118-aa2f-985160e79ffb on n-h1-858272-3 Oct 05 02:49:20.132028 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-ec316faa-7a5b-4916-b605-b22ac807964d req-0e88f1a4-4fda-461e-94f7-087554f2268f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057911 Oct 05 02:49:20.132698 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2249/4484] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:49:20.274253 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.network.security_group_api [None req-5c0f3bb1-ad46-4993-ae24-fb0f83629888 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Removing security group 1ce32527-2f68-494a-9b8f-e1a50d3d401f from port 93af56e9-cedc-4b3b-80a7-2c94ef741a18 Oct 05 02:49:20.545563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3fe7a9f7-58dd-41e1-a731-5ec33e185941 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:20.546305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3fe7a9f7-58dd-41e1-a731-5ec33e185941 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:20.555849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3fe7a9f7-58dd-41e1-a731-5ec33e185941 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:20.556748 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3fe7a9f7-58dd-41e1-a731-5ec33e185941 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:20.557400 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3fe7a9f7-58dd-41e1-a731-5ec33e185941 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:20.558481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3fe7a9f7-58dd-41e1-a731-5ec33e185941 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:20.559419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3fe7a9f7-58dd-41e1-a731-5ec33e185941 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:20.560060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3fe7a9f7-58dd-41e1-a731-5ec33e185941 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:21.297274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3fe7a9f7-58dd-41e1-a731-5ec33e185941 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:21.306277 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3fe7a9f7-58dd-41e1-a731-5ec33e185941 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1494 microversion: 2.1 time: 0.769778 Oct 05 02:49:21.308330 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2250/4485] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:20 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1494 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:21.320037 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5c0f3bb1-ad46-4993-ae24-fb0f83629888 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "POST /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb/action" status: 202 len: 0 microversion: 2.1 time: 1.266198 Oct 05 02:49:21.321500 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2236/4486] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:49:20 2022] POST /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb/action => generated 0 bytes in 1268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:49:21.334159 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a7a977c1-c16f-4323-8cb4-1514021a5e6b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Action: 'create', calling method: .version_select at 0x7fccdf179a60>, body: {"pool": null} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:49:22.172112 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-ac4b421a-ff3c-4577-9933-970782167063 req-5da1155a-ed2b-4c7d-aad1-46aa15f9d508 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a711b7d-3d62-4118-aa2f-985160e79ffb", "tag": "93af56e9-cedc-4b3b-80a7-2c94ef741a18"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:49:22.184329 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ac4b421a-ff3c-4577-9933-970782167063 req-5da1155a-ed2b-4c7d-aad1-46aa15f9d508 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:22.185221 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ac4b421a-ff3c-4577-9933-970782167063 req-5da1155a-ed2b-4c7d-aad1-46aa15f9d508 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:22.185890 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ac4b421a-ff3c-4577-9933-970782167063 req-5da1155a-ed2b-4c7d-aad1-46aa15f9d508 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:22.199703 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-ac4b421a-ff3c-4577-9933-970782167063 req-5da1155a-ed2b-4c7d-aad1-46aa15f9d508 service nova] Creating event network-changed:93af56e9-cedc-4b3b-80a7-2c94ef741a18 for instance 3a711b7d-3d62-4118-aa2f-985160e79ffb on n-h1-858272-3 Oct 05 02:49:22.207926 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-ac4b421a-ff3c-4577-9933-970782167063 req-5da1155a-ed2b-4c7d-aad1-46aa15f9d508 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041711 Oct 05 02:49:22.209141 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2237/4487] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:49:22.336601 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0ef6b05b-cb81-44c5-abaa-7f9f274d8129 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:22.340497 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0ef6b05b-cb81-44c5-abaa-7f9f274d8129 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:22.366712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ef6b05b-cb81-44c5-abaa-7f9f274d8129 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:22.367981 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ef6b05b-cb81-44c5-abaa-7f9f274d8129 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:22.368777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ef6b05b-cb81-44c5-abaa-7f9f274d8129 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:22.370663 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ef6b05b-cb81-44c5-abaa-7f9f274d8129 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:22.371530 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ef6b05b-cb81-44c5-abaa-7f9f274d8129 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:22.372307 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ef6b05b-cb81-44c5-abaa-7f9f274d8129 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:22.646311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0ef6b05b-cb81-44c5-abaa-7f9f274d8129 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:22.662064 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0ef6b05b-cb81-44c5-abaa-7f9f274d8129 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 200 len: 1452 microversion: 2.1 time: 0.333921 Oct 05 02:49:22.663320 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2238/4488] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:22 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 1452 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:49:22.913196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-964c61f4-b26f-44f3-8ac8-458bc4a20e76 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:22.913196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-964c61f4-b26f-44f3-8ac8-458bc4a20e76 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:22.920362 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-964c61f4-b26f-44f3-8ac8-458bc4a20e76 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:22.921005 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-964c61f4-b26f-44f3-8ac8-458bc4a20e76 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:22.921337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-964c61f4-b26f-44f3-8ac8-458bc4a20e76 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:22.925951 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-964c61f4-b26f-44f3-8ac8-458bc4a20e76 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:22.926471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-964c61f4-b26f-44f3-8ac8-458bc4a20e76 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:22.926910 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-964c61f4-b26f-44f3-8ac8-458bc4a20e76 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:23.245321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-964c61f4-b26f-44f3-8ac8-458bc4a20e76 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:23.254266 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-964c61f4-b26f-44f3-8ac8-458bc4a20e76 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.348130 Oct 05 02:49:23.255341 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2239/4489] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:22 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:49:23.284641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a5439762-d415-43f6-92f3-876fa68bddb4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:23.285565 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a5439762-d415-43f6-92f3-876fa68bddb4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:23.292129 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5439762-d415-43f6-92f3-876fa68bddb4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:23.292664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5439762-d415-43f6-92f3-876fa68bddb4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:23.299328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5439762-d415-43f6-92f3-876fa68bddb4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:23.300159 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5439762-d415-43f6-92f3-876fa68bddb4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:23.300617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5439762-d415-43f6-92f3-876fa68bddb4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:23.301304 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5439762-d415-43f6-92f3-876fa68bddb4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:24.062958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a5439762-d415-43f6-92f3-876fa68bddb4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:24.071669 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a5439762-d415-43f6-92f3-876fa68bddb4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.791480 Oct 05 02:49:24.085079 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2240/4490] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:23 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:24.095922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5846584b-02a0-4f5b-bd95-31435bf5bd35 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:24.096644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5846584b-02a0-4f5b-bd95-31435bf5bd35 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:24.103910 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5846584b-02a0-4f5b-bd95-31435bf5bd35 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:24.104763 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5846584b-02a0-4f5b-bd95-31435bf5bd35 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:24.105243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5846584b-02a0-4f5b-bd95-31435bf5bd35 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:24.105957 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5846584b-02a0-4f5b-bd95-31435bf5bd35 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:24.106425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5846584b-02a0-4f5b-bd95-31435bf5bd35 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:24.106857 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5846584b-02a0-4f5b-bd95-31435bf5bd35 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:24.123287 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-5846584b-02a0-4f5b-bd95-31435bf5bd35 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] HTTP exception thrown: Instance 8ec0ae24-68e3-4673-a177-50594e62bff2 could not be found. Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5846584b-02a0-4f5b-bd95-31435bf5bd35 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Request method failure captured: Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 HTTP/1.1 Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO9sJgtvOLeTr4nOCD-vOqCqD1zJrAITPFW_zz4yiLyvIoTdHjuR4LJfH4xTHqVQhBEUV87uN4J6FQiHHhnatngFlbfTbJmS6cPceNKMN6UWu-_pNs3jdF8Cb5CgC-hxlx6u-5aGNVi9h5jLYyViTpDjMXgNyRvr5dJZFZQW2uKikA8 Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: d797c0058e8c456290081d056df79292 Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d797c0058e8c456290081d056df79292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d797c0058e8c456290081d056df79292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: d797c0058e8c456290081d056df79292 Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: ff170a5be8a04902b66e5f0e79fd47df Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 8ec0ae24-68e3-4673-a177-50594e62bff2 could not be found. Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '8ec0ae24-68e3-4673-a177-50594e62bff2'} Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ec0ae24-68e3-4673-a177-50594e62bff2 could not be found. Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ec0ae24-68e3-4673-a177-50594e62bff2 could not be found. Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:24.125104 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:24.131047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:24.131047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:24.131047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:24.131047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:49:24.131047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:49:24.131047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ec0ae24-68e3-4673-a177-50594e62bff2 could not be found. Oct 05 02:49:24.131047 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:24.131047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5846584b-02a0-4f5b-bd95-31435bf5bd35 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Returning 404 to user: Instance 8ec0ae24-68e3-4673-a177-50594e62bff2 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:49:24.131047 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5846584b-02a0-4f5b-bd95-31435bf5bd35 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 404 len: 111 microversion: 2.1 time: 0.052411 Oct 05 02:49:24.131047 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2241/4491] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:24 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:49:24.135712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b34bea6a-3bb1-4f9f-a229-3b5174222d80 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:24.136576 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b34bea6a-3bb1-4f9f-a229-3b5174222d80 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:24.142976 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b34bea6a-3bb1-4f9f-a229-3b5174222d80 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:24.143730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b34bea6a-3bb1-4f9f-a229-3b5174222d80 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:24.144261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b34bea6a-3bb1-4f9f-a229-3b5174222d80 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:24.145091 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b34bea6a-3bb1-4f9f-a229-3b5174222d80 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:24.145731 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b34bea6a-3bb1-4f9f-a229-3b5174222d80 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:24.146380 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b34bea6a-3bb1-4f9f-a229-3b5174222d80 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:24.440304 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a7a977c1-c16f-4323-8cb4-1514021a5e6b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.112065 Oct 05 02:49:24.445496 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2251/4492] 10.222.0.16 () {60 vars in 1170 bytes} [Wed Oct 5 02:49:21 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:49:24.445496 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-92618aad-b5c7-4ad2-bf20-e80f9313d21b req-e95371fe-fe79-4c33-920e-3fbca190f45a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ec0ae24-68e3-4673-a177-50594e62bff2", "name": "network-vif-deleted", "tag": "5a6793ab-1647-4586-abc2-bc083a2d1fdf"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:49:24.456381 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-92618aad-b5c7-4ad2-bf20-e80f9313d21b req-e95371fe-fe79-4c33-920e-3fbca190f45a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:24.456861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-92618aad-b5c7-4ad2-bf20-e80f9313d21b req-e95371fe-fe79-4c33-920e-3fbca190f45a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:24.457420 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-92618aad-b5c7-4ad2-bf20-e80f9313d21b req-e95371fe-fe79-4c33-920e-3fbca190f45a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:24.469124 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-92618aad-b5c7-4ad2-bf20-e80f9313d21b req-e95371fe-fe79-4c33-920e-3fbca190f45a service nova] Creating event network-vif-deleted:5a6793ab-1647-4586-abc2-bc083a2d1fdf for instance 8ec0ae24-68e3-4673-a177-50594e62bff2 on n-h1-858272-3 Oct 05 02:49:24.474151 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-92618aad-b5c7-4ad2-bf20-e80f9313d21b req-e95371fe-fe79-4c33-920e-3fbca190f45a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032021 Oct 05 02:49:24.474753 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2252/4493] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:49:24.480663 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-184557d8-1d5c-4454-af20-210d96e03452 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-225727898", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "e4f9d49c-25ab-4e4f-a7c4-00e803798e90"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:49:24.497263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b34bea6a-3bb1-4f9f-a229-3b5174222d80 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:24.511601 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b34bea6a-3bb1-4f9f-a229-3b5174222d80 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.382353 Oct 05 02:49:24.512339 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2242/4494] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:24 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:24.517567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7e9c5e64-0b60-4a2d-bb81-eac597a77e0b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.62"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:49:24.520693 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7e9c5e64-0b60-4a2d-bb81-eac597a77e0b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:24.527975 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e9c5e64-0b60-4a2d-bb81-eac597a77e0b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:24.528647 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e9c5e64-0b60-4a2d-bb81-eac597a77e0b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:24.529178 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e9c5e64-0b60-4a2d-bb81-eac597a77e0b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:24.529801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e9c5e64-0b60-4a2d-bb81-eac597a77e0b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:24.530405 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e9c5e64-0b60-4a2d-bb81-eac597a77e0b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:24.530972 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e9c5e64-0b60-4a2d-bb81-eac597a77e0b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:24.542387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-184557d8-1d5c-4454-af20-210d96e03452 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] validate_networks() for [('e4f9d49c-25ab-4e4f-a7c4-00e803798e90', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:49:24.564640 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e9c5e64-0b60-4a2d-bb81-eac597a77e0b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "refresh_cache-3a711b7d-3d62-4118-aa2f-985160e79ffb" {{(pid=122319) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 05 02:49:24.565441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e9c5e64-0b60-4a2d-bb81-eac597a77e0b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquired lock "refresh_cache-3a711b7d-3d62-4118-aa2f-985160e79ffb" {{(pid=122319) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 05 02:49:25.518817 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-184557d8-1d5c-4454-af20-210d96e03452 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:49:25.520357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-184557d8-1d5c-4454-af20-210d96e03452 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:49:25.521066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-184557d8-1d5c-4454-af20-210d96e03452 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:49:25.521702 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-184557d8-1d5c-4454-af20-210d96e03452 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:49:25.522595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-184557d8-1d5c-4454-af20-210d96e03452 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:49:25.537256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-184557d8-1d5c-4454-af20-210d96e03452 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:25.537993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-184557d8-1d5c-4454-af20-210d96e03452 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:25.538651 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-184557d8-1d5c-4454-af20-210d96e03452 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:25.540108 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-184557d8-1d5c-4454-af20-210d96e03452 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:25.542056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-184557d8-1d5c-4454-af20-210d96e03452 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:25.542950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-184557d8-1d5c-4454-af20-210d96e03452 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:25.570494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-184557d8-1d5c-4454-af20-210d96e03452 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Getting quotas for project d797c0058e8c456290081d056df79292. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:49:25.578850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-184557d8-1d5c-4454-af20-210d96e03452 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Getting quotas for user ff170a5be8a04902b66e5f0e79fd47df and project d797c0058e8c456290081d056df79292. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:49:25.597696 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-184557d8-1d5c-4454-af20-210d96e03452 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:49:25.600490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-184557d8-1d5c-4454-af20-210d96e03452 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7b7df17d-34fa-459d-880c-356dcd4a847f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:49:25.693718 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-184557d8-1d5c-4454-af20-210d96e03452 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.217116 Oct 05 02:49:25.702525 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2253/4495] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:49:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:49:25.708187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0ebab895-350e-46c2-b3c1-0d6ddadf0eac tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:25.709026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0ebab895-350e-46c2-b3c1-0d6ddadf0eac tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:25.720788 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ebab895-350e-46c2-b3c1-0d6ddadf0eac tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:25.722039 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ebab895-350e-46c2-b3c1-0d6ddadf0eac tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:25.723068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ebab895-350e-46c2-b3c1-0d6ddadf0eac tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:25.723946 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ebab895-350e-46c2-b3c1-0d6ddadf0eac tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:25.724567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ebab895-350e-46c2-b3c1-0d6ddadf0eac tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:25.725202 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ebab895-350e-46c2-b3c1-0d6ddadf0eac tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:25.753634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:26.003021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0ebab895-350e-46c2-b3c1-0d6ddadf0eac tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:26.020525 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0ebab895-350e-46c2-b3c1-0d6ddadf0eac tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.316585 Oct 05 02:49:26.024572 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2254/4496] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:25 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:26.036734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-79adf96c-8814-4485-a4eb-5b0c8e99cfa8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:26.037692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-79adf96c-8814-4485-a4eb-5b0c8e99cfa8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7b7df17d-34fa-459d-880c-356dcd4a847f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:26.153149 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-79adf96c-8814-4485-a4eb-5b0c8e99cfa8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:26.164367 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-79adf96c-8814-4485-a4eb-5b0c8e99cfa8 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f" status: 200 len: 1214 microversion: 2.1 time: 0.136987 Oct 05 02:49:26.166729 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2255/4497] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:26 2022] GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f => generated 1214 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:26.237140 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6b6040c1-3f31-46fd-a286-23476bdb2ea8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-183019238", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "3c7ecbb9-3319-48a3-8bf2-f42adcddf7f9"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:49:26.321384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-6b6040c1-3f31-46fd-a286-23476bdb2ea8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] validate_networks() for [('3c7ecbb9-3319-48a3-8bf2-f42adcddf7f9', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:49:27.016277 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-7e9c5e64-0b60-4a2d-bb81-eac597a77e0b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Building network info cache for instance {{(pid=122319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 05 02:49:27.791715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-6b6040c1-3f31-46fd-a286-23476bdb2ea8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:49:27.792195 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-6b6040c1-3f31-46fd-a286-23476bdb2ea8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:49:27.793087 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-6b6040c1-3f31-46fd-a286-23476bdb2ea8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:49:27.793510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-6b6040c1-3f31-46fd-a286-23476bdb2ea8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:49:27.793928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-6b6040c1-3f31-46fd-a286-23476bdb2ea8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:49:27.807779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b6040c1-3f31-46fd-a286-23476bdb2ea8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:27.812801 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b6040c1-3f31-46fd-a286-23476bdb2ea8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:27.813504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b6040c1-3f31-46fd-a286-23476bdb2ea8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:27.816986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b6040c1-3f31-46fd-a286-23476bdb2ea8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:27.817759 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b6040c1-3f31-46fd-a286-23476bdb2ea8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:27.818421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b6040c1-3f31-46fd-a286-23476bdb2ea8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:27.856846 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-6b6040c1-3f31-46fd-a286-23476bdb2ea8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Getting quotas for project 1ff63adf9571439d8f8bf9b0fa6c63f9. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:49:27.863104 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-6b6040c1-3f31-46fd-a286-23476bdb2ea8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Getting quotas for user 728544ca5e164540b3c5395534542955 and project 1ff63adf9571439d8f8bf9b0fa6c63f9. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:49:27.895061 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6b6040c1-3f31-46fd-a286-23476bdb2ea8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:49:27.897994 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6b6040c1-3f31-46fd-a286-23476bdb2ea8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: c32101ff-4278-4a35-b328-895629612614] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:49:27.983920 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6b6040c1-3f31-46fd-a286-23476bdb2ea8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.751053 Oct 05 02:49:27.985171 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2256/4498] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:49:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 02:49:27.990747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-518ba3ef-bf62-4dc7-afbb-6c043c58bc46 req-9cffad1e-b8a4-498e-bfc0-667376ca6ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a711b7d-3d62-4118-aa2f-985160e79ffb", "tag": "93af56e9-cedc-4b3b-80a7-2c94ef741a18"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:49:28.002510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-518ba3ef-bf62-4dc7-afbb-6c043c58bc46 req-9cffad1e-b8a4-498e-bfc0-667376ca6ab4 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:28.003429 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-518ba3ef-bf62-4dc7-afbb-6c043c58bc46 req-9cffad1e-b8a4-498e-bfc0-667376ca6ab4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:28.004095 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-518ba3ef-bf62-4dc7-afbb-6c043c58bc46 req-9cffad1e-b8a4-498e-bfc0-667376ca6ab4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:28.021822 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-518ba3ef-bf62-4dc7-afbb-6c043c58bc46 req-9cffad1e-b8a4-498e-bfc0-667376ca6ab4 service nova] Creating event network-changed:93af56e9-cedc-4b3b-80a7-2c94ef741a18 for instance 3a711b7d-3d62-4118-aa2f-985160e79ffb on n-h1-858272-3 Oct 05 02:49:28.031356 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-518ba3ef-bf62-4dc7-afbb-6c043c58bc46 req-9cffad1e-b8a4-498e-bfc0-667376ca6ab4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044777 Oct 05 02:49:28.032099 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2257/4499] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:49:28.038321 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fc7b3c55-5f43-401c-84a0-2bd26366be65 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:28.038904 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fc7b3c55-5f43-401c-84a0-2bd26366be65 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7b7df17d-34fa-459d-880c-356dcd4a847f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:28.048889 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc7b3c55-5f43-401c-84a0-2bd26366be65 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:28.049621 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc7b3c55-5f43-401c-84a0-2bd26366be65 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:28.050405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc7b3c55-5f43-401c-84a0-2bd26366be65 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:28.051536 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc7b3c55-5f43-401c-84a0-2bd26366be65 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:28.052151 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc7b3c55-5f43-401c-84a0-2bd26366be65 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:28.052942 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc7b3c55-5f43-401c-84a0-2bd26366be65 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:28.242364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fc7b3c55-5f43-401c-84a0-2bd26366be65 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:28.251101 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fc7b3c55-5f43-401c-84a0-2bd26366be65 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f" status: 200 len: 1272 microversion: 2.1 time: 0.217943 Oct 05 02:49:28.251689 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2258/4500] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:28 2022] GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f => generated 1272 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:28.286383 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-573e13a2-17b3-453c-99db-7f3c8237fc98 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:28.306764 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-573e13a2-17b3-453c-99db-7f3c8237fc98 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: c32101ff-4278-4a35-b328-895629612614] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:28.534702 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-573e13a2-17b3-453c-99db-7f3c8237fc98 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:28.557601 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-573e13a2-17b3-453c-99db-7f3c8237fc98 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614" status: 200 len: 1214 microversion: 2.1 time: 0.280691 Oct 05 02:49:28.559134 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2259/4501] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:28 2022] GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614 => generated 1214 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:28.685956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-7e9c5e64-0b60-4a2d-bb81-eac597a77e0b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Updating instance_info_cache with network_info: [{"id": "93af56e9-cedc-4b3b-80a7-2c94ef741a18", "address": "fa:16:3e:e0:89:1b", "network": {"id": "e491bb1a-0157-4d09-a562-11c88a7d4e65", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1922227469-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1eab97ab9390449da800dab7d39217da", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap93af56e9-ce", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 05 02:49:28.707572 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e9c5e64-0b60-4a2d-bb81-eac597a77e0b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Releasing lock "refresh_cache-3a711b7d-3d62-4118-aa2f-985160e79ffb" {{(pid=122319) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 05 02:49:28.709455 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7e9c5e64-0b60-4a2d-bb81-eac597a77e0b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "POST /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb/action" status: 202 len: 0 microversion: 2.1 time: 4.195450 Oct 05 02:49:28.710693 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2243/4502] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:49:24 2022] POST /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb/action => generated 0 bytes in 4198 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 05 02:49:28.720336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-72277e84-a485-4cf4-aaf0-6f0c07aec8d8 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.62"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:49:29.153934 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-72277e84-a485-4cf4-aaf0-6f0c07aec8d8 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:29.167420 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72277e84-a485-4cf4-aaf0-6f0c07aec8d8 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:29.168149 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72277e84-a485-4cf4-aaf0-6f0c07aec8d8 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:29.169279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72277e84-a485-4cf4-aaf0-6f0c07aec8d8 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:29.170355 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72277e84-a485-4cf4-aaf0-6f0c07aec8d8 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:29.171133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72277e84-a485-4cf4-aaf0-6f0c07aec8d8 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:29.171894 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72277e84-a485-4cf4-aaf0-6f0c07aec8d8 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:29.283348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e4fd6a79-d2a0-409b-97a6-5f5f61a0c281 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:29.287916 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e4fd6a79-d2a0-409b-97a6-5f5f61a0c281 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7b7df17d-34fa-459d-880c-356dcd4a847f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:29.301642 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4fd6a79-d2a0-409b-97a6-5f5f61a0c281 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:29.302197 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4fd6a79-d2a0-409b-97a6-5f5f61a0c281 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:29.302564 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4fd6a79-d2a0-409b-97a6-5f5f61a0c281 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:29.303267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4fd6a79-d2a0-409b-97a6-5f5f61a0c281 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:29.303702 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4fd6a79-d2a0-409b-97a6-5f5f61a0c281 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:29.304121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4fd6a79-d2a0-409b-97a6-5f5f61a0c281 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:29.488265 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e4fd6a79-d2a0-409b-97a6-5f5f61a0c281 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:29.503250 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e4fd6a79-d2a0-409b-97a6-5f5f61a0c281 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f" status: 200 len: 1272 microversion: 2.1 time: 0.226883 Oct 05 02:49:29.510643 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2244/4503] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:29 2022] GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f => generated 1272 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:29.585564 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-145e910c-e78e-4600-b1b7-8e5ed2fe3e23 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:29.586891 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-145e910c-e78e-4600-b1b7-8e5ed2fe3e23 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: c32101ff-4278-4a35-b328-895629612614] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:29.597051 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-145e910c-e78e-4600-b1b7-8e5ed2fe3e23 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:29.598278 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-145e910c-e78e-4600-b1b7-8e5ed2fe3e23 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:29.601354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-145e910c-e78e-4600-b1b7-8e5ed2fe3e23 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:29.602610 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-145e910c-e78e-4600-b1b7-8e5ed2fe3e23 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:29.603419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-145e910c-e78e-4600-b1b7-8e5ed2fe3e23 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:29.604993 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-145e910c-e78e-4600-b1b7-8e5ed2fe3e23 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:29.760660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-145e910c-e78e-4600-b1b7-8e5ed2fe3e23 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:29.775991 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-145e910c-e78e-4600-b1b7-8e5ed2fe3e23 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614" status: 200 len: 1266 microversion: 2.1 time: 0.198356 Oct 05 02:49:29.779093 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2245/4504] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:29 2022] GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:29.849278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72277e84-a485-4cf4-aaf0-6f0c07aec8d8 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "refresh_cache-3a711b7d-3d62-4118-aa2f-985160e79ffb" {{(pid=122320) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 05 02:49:29.849684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72277e84-a485-4cf4-aaf0-6f0c07aec8d8 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquired lock "refresh_cache-3a711b7d-3d62-4118-aa2f-985160e79ffb" {{(pid=122320) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 05 02:49:30.528945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-50c3c431-04b3-45ac-a6e7-bb2052199988 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:30.529616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-50c3c431-04b3-45ac-a6e7-bb2052199988 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7b7df17d-34fa-459d-880c-356dcd4a847f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:30.538304 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50c3c431-04b3-45ac-a6e7-bb2052199988 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:30.538811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50c3c431-04b3-45ac-a6e7-bb2052199988 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:30.539531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50c3c431-04b3-45ac-a6e7-bb2052199988 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:30.540538 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50c3c431-04b3-45ac-a6e7-bb2052199988 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:30.542961 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50c3c431-04b3-45ac-a6e7-bb2052199988 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:30.543966 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50c3c431-04b3-45ac-a6e7-bb2052199988 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:30.551084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:31.210774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-50c3c431-04b3-45ac-a6e7-bb2052199988 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:31.228253 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-50c3c431-04b3-45ac-a6e7-bb2052199988 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f" status: 200 len: 1314 microversion: 2.1 time: 0.703419 Oct 05 02:49:31.230723 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2246/4505] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:30 2022] GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f => generated 1314 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:31.236801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-054d507f-2caf-4d6c-a952-ccd83d2bcb4b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:31.238143 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-054d507f-2caf-4d6c-a952-ccd83d2bcb4b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: c32101ff-4278-4a35-b328-895629612614] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:31.247994 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-054d507f-2caf-4d6c-a952-ccd83d2bcb4b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:31.248586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-054d507f-2caf-4d6c-a952-ccd83d2bcb4b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:31.249538 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-054d507f-2caf-4d6c-a952-ccd83d2bcb4b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:31.250377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-054d507f-2caf-4d6c-a952-ccd83d2bcb4b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:31.252562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-054d507f-2caf-4d6c-a952-ccd83d2bcb4b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:31.252991 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-054d507f-2caf-4d6c-a952-ccd83d2bcb4b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:31.433993 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-054d507f-2caf-4d6c-a952-ccd83d2bcb4b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:31.447872 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-054d507f-2caf-4d6c-a952-ccd83d2bcb4b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614" status: 200 len: 1272 microversion: 2.1 time: 0.214518 Oct 05 02:49:31.449222 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2247/4506] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:31 2022] GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614 => generated 1272 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:32.254912 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-28437d90-640e-405b-9f5f-61539b92db9e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:32.255543 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-28437d90-640e-405b-9f5f-61539b92db9e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7b7df17d-34fa-459d-880c-356dcd4a847f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:32.268070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:32.273145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28437d90-640e-405b-9f5f-61539b92db9e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:32.273648 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28437d90-640e-405b-9f5f-61539b92db9e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:32.274094 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28437d90-640e-405b-9f5f-61539b92db9e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:32.276114 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28437d90-640e-405b-9f5f-61539b92db9e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:32.278500 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28437d90-640e-405b-9f5f-61539b92db9e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:32.282392 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28437d90-640e-405b-9f5f-61539b92db9e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:32.313751 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-72277e84-a485-4cf4-aaf0-6f0c07aec8d8 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Building network info cache for instance {{(pid=122320) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 05 02:49:32.750633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-28437d90-640e-405b-9f5f-61539b92db9e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:32.759391 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-28437d90-640e-405b-9f5f-61539b92db9e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f" status: 200 len: 1314 microversion: 2.1 time: 0.508176 Oct 05 02:49:32.774517 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2248/4507] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:32 2022] GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f => generated 1314 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:49:32.787027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-78760881-352a-40a9-9930-89f4791b04e5 req-2fa8f374-0e27-4b3e-bfad-3887d81e50b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a711b7d-3d62-4118-aa2f-985160e79ffb", "tag": "93af56e9-cedc-4b3b-80a7-2c94ef741a18"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:49:32.811291 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-78760881-352a-40a9-9930-89f4791b04e5 req-2fa8f374-0e27-4b3e-bfad-3887d81e50b8 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:32.811792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-78760881-352a-40a9-9930-89f4791b04e5 req-2fa8f374-0e27-4b3e-bfad-3887d81e50b8 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:32.812239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-78760881-352a-40a9-9930-89f4791b04e5 req-2fa8f374-0e27-4b3e-bfad-3887d81e50b8 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:32.845229 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-78760881-352a-40a9-9930-89f4791b04e5 req-2fa8f374-0e27-4b3e-bfad-3887d81e50b8 service nova] Creating event network-changed:93af56e9-cedc-4b3b-80a7-2c94ef741a18 for instance 3a711b7d-3d62-4118-aa2f-985160e79ffb on n-h1-858272-3 Oct 05 02:49:32.857322 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-78760881-352a-40a9-9930-89f4791b04e5 req-2fa8f374-0e27-4b3e-bfad-3887d81e50b8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079984 Oct 05 02:49:32.859215 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2249/4508] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:49:32.873648 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-30139bc8-373e-4e25-ba87-9aa12ea5e01d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:32.874381 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-30139bc8-373e-4e25-ba87-9aa12ea5e01d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: c32101ff-4278-4a35-b328-895629612614] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:32.891765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-30139bc8-373e-4e25-ba87-9aa12ea5e01d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:32.892271 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-30139bc8-373e-4e25-ba87-9aa12ea5e01d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:32.892712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-30139bc8-373e-4e25-ba87-9aa12ea5e01d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:32.895716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-30139bc8-373e-4e25-ba87-9aa12ea5e01d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:32.896207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-30139bc8-373e-4e25-ba87-9aa12ea5e01d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:32.896647 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-30139bc8-373e-4e25-ba87-9aa12ea5e01d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:33.566132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-30139bc8-373e-4e25-ba87-9aa12ea5e01d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:33.575013 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-30139bc8-373e-4e25-ba87-9aa12ea5e01d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614" status: 200 len: 1314 microversion: 2.1 time: 0.713775 Oct 05 02:49:33.580003 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2250/4509] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:32 2022] GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614 => generated 1314 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:33.587005 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f039e23a-90db-4f30-a0c7-ef1b471ddf49 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:33.591773 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f039e23a-90db-4f30-a0c7-ef1b471ddf49 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] [instance: 1f810197-91e4-4965-b93b-bdd3bf2950bf] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:33.605374 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f039e23a-90db-4f30-a0c7-ef1b471ddf49 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:33.606123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f039e23a-90db-4f30-a0c7-ef1b471ddf49 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:33.606572 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f039e23a-90db-4f30-a0c7-ef1b471ddf49 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:33.607303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f039e23a-90db-4f30-a0c7-ef1b471ddf49 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:33.607764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f039e23a-90db-4f30-a0c7-ef1b471ddf49 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:33.608199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f039e23a-90db-4f30-a0c7-ef1b471ddf49 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:33.670814 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f039e23a-90db-4f30-a0c7-ef1b471ddf49 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] [instance: 1f810197-91e4-4965-b93b-bdd3bf2950bf] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:49:33.819225 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f039e23a-90db-4f30-a0c7-ef1b471ddf49 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf" status: 204 len: 0 microversion: 2.1 time: 0.237448 Oct 05 02:49:33.822561 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2251/4510] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:49:33 2022] DELETE /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:49:33.840344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9330ddb2-1c86-48c7-ac3a-2b3f6776c64c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:33.841292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9330ddb2-1c86-48c7-ac3a-2b3f6776c64c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7b7df17d-34fa-459d-880c-356dcd4a847f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:33.848288 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9330ddb2-1c86-48c7-ac3a-2b3f6776c64c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:33.849120 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9330ddb2-1c86-48c7-ac3a-2b3f6776c64c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:33.849827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9330ddb2-1c86-48c7-ac3a-2b3f6776c64c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:33.850863 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9330ddb2-1c86-48c7-ac3a-2b3f6776c64c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:33.851483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9330ddb2-1c86-48c7-ac3a-2b3f6776c64c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:33.852072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9330ddb2-1c86-48c7-ac3a-2b3f6776c64c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:34.622293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9330ddb2-1c86-48c7-ac3a-2b3f6776c64c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:34.640014 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9330ddb2-1c86-48c7-ac3a-2b3f6776c64c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f" status: 200 len: 1314 microversion: 2.1 time: 0.814047 Oct 05 02:49:34.641585 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2252/4511] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:33 2022] GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f => generated 1314 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:34.673564 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d4f84062-c4ff-4994-84c1-dcbfb048c97a tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:34.674423 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d4f84062-c4ff-4994-84c1-dcbfb048c97a tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] [instance: 1f810197-91e4-4965-b93b-bdd3bf2950bf] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:34.681955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4f84062-c4ff-4994-84c1-dcbfb048c97a tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:34.682447 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4f84062-c4ff-4994-84c1-dcbfb048c97a tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:34.682884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4f84062-c4ff-4994-84c1-dcbfb048c97a tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:34.683588 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4f84062-c4ff-4994-84c1-dcbfb048c97a tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:34.684034 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4f84062-c4ff-4994-84c1-dcbfb048c97a tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:34.684653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4f84062-c4ff-4994-84c1-dcbfb048c97a tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:34.744641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-72277e84-a485-4cf4-aaf0-6f0c07aec8d8 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Updating instance_info_cache with network_info: [{"id": "93af56e9-cedc-4b3b-80a7-2c94ef741a18", "address": "fa:16:3e:e0:89:1b", "network": {"id": "e491bb1a-0157-4d09-a562-11c88a7d4e65", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1922227469-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1eab97ab9390449da800dab7d39217da", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap93af56e9-ce", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122320) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 05 02:49:34.763973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72277e84-a485-4cf4-aaf0-6f0c07aec8d8 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Releasing lock "refresh_cache-3a711b7d-3d62-4118-aa2f-985160e79ffb" {{(pid=122320) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 05 02:49:34.766495 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-72277e84-a485-4cf4-aaf0-6f0c07aec8d8 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "POST /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb/action" status: 202 len: 0 microversion: 2.1 time: 6.050975 Oct 05 02:49:34.770882 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2260/4512] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:49:28 2022] POST /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb/action => generated 0 bytes in 6056 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 05 02:49:34.777625 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c7b36bb9-28bd-427a-bb9e-7eddda19b97a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:34.778472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c7b36bb9-28bd-427a-bb9e-7eddda19b97a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: c32101ff-4278-4a35-b328-895629612614] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:34.780785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:34.787246 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7b36bb9-28bd-427a-bb9e-7eddda19b97a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:34.788028 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7b36bb9-28bd-427a-bb9e-7eddda19b97a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:34.788775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7b36bb9-28bd-427a-bb9e-7eddda19b97a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:34.789775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7b36bb9-28bd-427a-bb9e-7eddda19b97a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:34.790492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7b36bb9-28bd-427a-bb9e-7eddda19b97a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:34.792005 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7b36bb9-28bd-427a-bb9e-7eddda19b97a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:35.231446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d4f84062-c4ff-4994-84c1-dcbfb048c97a tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569a3db98b7a44aeb902f7956af5a710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0fa4883254728921c0c49aa4e60b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:35.242164 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d4f84062-c4ff-4994-84c1-dcbfb048c97a tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] 10.222.0.16 "GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf" status: 200 len: 1664 microversion: 2.1 time: 0.598383 Oct 05 02:49:35.242826 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2253/4513] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:34 2022] GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf => generated 1664 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:35.248748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-176f4104-2ba2-4a75-81c5-7c805f6ee88b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '.version_select at 0x7fccdf302550>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:35.420895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c7b36bb9-28bd-427a-bb9e-7eddda19b97a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:35.429191 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c7b36bb9-28bd-427a-bb9e-7eddda19b97a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614" status: 200 len: 1314 microversion: 2.1 time: 0.657042 Oct 05 02:49:35.445585 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2261/4514] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:34 2022] GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614 => generated 1314 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:35.451368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-fe46f923-422d-429c-b4f2-11d527f9e0ea req-b8ef1151-4cf7-465b-a56f-29d1d8f90e44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b7df17d-34fa-459d-880c-356dcd4a847f", "tag": "a7ebbbac-cdb2-4339-b5ea-cace0aa0dd4c"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:49:35.463600 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-fe46f923-422d-429c-b4f2-11d527f9e0ea req-b8ef1151-4cf7-465b-a56f-29d1d8f90e44 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:35.464334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-fe46f923-422d-429c-b4f2-11d527f9e0ea req-b8ef1151-4cf7-465b-a56f-29d1d8f90e44 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:35.465002 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-fe46f923-422d-429c-b4f2-11d527f9e0ea req-b8ef1151-4cf7-465b-a56f-29d1d8f90e44 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:35.484840 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-fe46f923-422d-429c-b4f2-11d527f9e0ea req-b8ef1151-4cf7-465b-a56f-29d1d8f90e44 service nova] Creating event network-changed:a7ebbbac-cdb2-4339-b5ea-cace0aa0dd4c for instance 7b7df17d-34fa-459d-880c-356dcd4a847f on n-h2-858272-3 Oct 05 02:49:35.491623 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-fe46f923-422d-429c-b4f2-11d527f9e0ea req-b8ef1151-4cf7-465b-a56f-29d1d8f90e44 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044579 Oct 05 02:49:35.492891 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2262/4515] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:49:35.676556 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a0ca9210-5628-4930-a6b9-9e887f084265 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:35.677284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a0ca9210-5628-4930-a6b9-9e887f084265 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7b7df17d-34fa-459d-880c-356dcd4a847f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:35.685482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a0ca9210-5628-4930-a6b9-9e887f084265 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:35.685975 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a0ca9210-5628-4930-a6b9-9e887f084265 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:35.686613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a0ca9210-5628-4930-a6b9-9e887f084265 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:35.688111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a0ca9210-5628-4930-a6b9-9e887f084265 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:35.688732 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a0ca9210-5628-4930-a6b9-9e887f084265 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:35.689362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a0ca9210-5628-4930-a6b9-9e887f084265 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:36.392617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a0ca9210-5628-4930-a6b9-9e887f084265 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:36.418721 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a0ca9210-5628-4930-a6b9-9e887f084265 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f" status: 200 len: 1314 microversion: 2.1 time: 0.746499 Oct 05 02:49:36.422426 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2263/4516] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:35 2022] GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f => generated 1314 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:36.432044 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bd82e7e9-397f-4cfb-88c0-f5a3cd86a4f8 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:36.433236 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bd82e7e9-397f-4cfb-88c0-f5a3cd86a4f8 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] [instance: 1f810197-91e4-4965-b93b-bdd3bf2950bf] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:36.444454 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd82e7e9-397f-4cfb-88c0-f5a3cd86a4f8 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:36.445560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd82e7e9-397f-4cfb-88c0-f5a3cd86a4f8 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:36.446188 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd82e7e9-397f-4cfb-88c0-f5a3cd86a4f8 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:36.447777 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd82e7e9-397f-4cfb-88c0-f5a3cd86a4f8 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:36.448874 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd82e7e9-397f-4cfb-88c0-f5a3cd86a4f8 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:36.449574 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd82e7e9-397f-4cfb-88c0-f5a3cd86a4f8 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:37.462515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bd82e7e9-397f-4cfb-88c0-f5a3cd86a4f8 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569a3db98b7a44aeb902f7956af5a710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0fa4883254728921c0c49aa4e60b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:37.471268 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bd82e7e9-397f-4cfb-88c0-f5a3cd86a4f8 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] 10.222.0.16 "GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf" status: 200 len: 1664 microversion: 2.1 time: 1.046805 Oct 05 02:49:37.477197 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2264/4517] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:36 2022] GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf => generated 1664 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:37.482917 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b3fcbba0-bb74-4060-b10c-e3dbe12b4458 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:37.483602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b3fcbba0-bb74-4060-b10c-e3dbe12b4458 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: c32101ff-4278-4a35-b328-895629612614] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:37.495384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3fcbba0-bb74-4060-b10c-e3dbe12b4458 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:37.496007 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3fcbba0-bb74-4060-b10c-e3dbe12b4458 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:37.496819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3fcbba0-bb74-4060-b10c-e3dbe12b4458 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:37.497633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3fcbba0-bb74-4060-b10c-e3dbe12b4458 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:37.498182 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3fcbba0-bb74-4060-b10c-e3dbe12b4458 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:37.498707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3fcbba0-bb74-4060-b10c-e3dbe12b4458 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:37.847135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:37.879209 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b3fcbba0-bb74-4060-b10c-e3dbe12b4458 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:37.890430 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b3fcbba0-bb74-4060-b10c-e3dbe12b4458 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614" status: 200 len: 1314 microversion: 2.1 time: 0.417367 Oct 05 02:49:37.891774 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2265/4518] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:37 2022] GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614 => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:37.911155 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5cff0410-f107-4011-b6b5-1ba3cca5e5f2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:37.912481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5cff0410-f107-4011-b6b5-1ba3cca5e5f2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7b7df17d-34fa-459d-880c-356dcd4a847f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:37.926357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5cff0410-f107-4011-b6b5-1ba3cca5e5f2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:37.927761 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5cff0410-f107-4011-b6b5-1ba3cca5e5f2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:37.928486 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5cff0410-f107-4011-b6b5-1ba3cca5e5f2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:37.929610 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5cff0410-f107-4011-b6b5-1ba3cca5e5f2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:37.930352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5cff0410-f107-4011-b6b5-1ba3cca5e5f2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:37.931115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5cff0410-f107-4011-b6b5-1ba3cca5e5f2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:38.237054 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-176f4104-2ba2-4a75-81c5-7c805f6ee88b tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/705b8313-2335-433e-bd8e-4624032f7451" status: 202 len: 0 microversion: 2.1 time: 2.992605 Oct 05 02:49:38.239171 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2254/4519] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 5 02:49:35 2022] DELETE /compute/v2.1/os-floating-ips/705b8313-2335-433e-bd8e-4624032f7451 => generated 0 bytes in 2996 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:49:38.246535 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-39ac52cc-9e9b-4fc9-baf7-a70873bad6dc req-321d5d51-4b81-4307-ab2c-99f043a9ee2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c32101ff-4278-4a35-b328-895629612614", "tag": "59567f38-bc61-44be-80c4-4986eccffb6a"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:49:38.264495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-39ac52cc-9e9b-4fc9-baf7-a70873bad6dc req-321d5d51-4b81-4307-ab2c-99f043a9ee2c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:38.272062 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-39ac52cc-9e9b-4fc9-baf7-a70873bad6dc req-321d5d51-4b81-4307-ab2c-99f043a9ee2c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:38.272705 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-39ac52cc-9e9b-4fc9-baf7-a70873bad6dc req-321d5d51-4b81-4307-ab2c-99f043a9ee2c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:38.294878 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-39ac52cc-9e9b-4fc9-baf7-a70873bad6dc req-321d5d51-4b81-4307-ab2c-99f043a9ee2c service nova] Creating event network-changed:59567f38-bc61-44be-80c4-4986eccffb6a for instance c32101ff-4278-4a35-b328-895629612614 on n-h1-858272-3 Oct 05 02:49:38.301042 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-39ac52cc-9e9b-4fc9-baf7-a70873bad6dc req-321d5d51-4b81-4307-ab2c-99f043a9ee2c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060470 Oct 05 02:49:38.302267 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2255/4520] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:49:38.309404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-08498a2e-a7f6-49cc-bffe-24f6b44f26af tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '.version_select at 0x7fccdf3248b0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:38.450246 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5cff0410-f107-4011-b6b5-1ba3cca5e5f2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:38.464073 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5cff0410-f107-4011-b6b5-1ba3cca5e5f2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f" status: 200 len: 1314 microversion: 2.1 time: 0.570804 Oct 05 02:49:38.469103 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2266/4521] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:37 2022] GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f => generated 1314 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:38.495840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5f675594-95b2-43a8-81c2-d0535a95082c tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:38.496863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5f675594-95b2-43a8-81c2-d0535a95082c tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] [instance: 1f810197-91e4-4965-b93b-bdd3bf2950bf] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:38.510121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5f675594-95b2-43a8-81c2-d0535a95082c tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:38.511523 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5f675594-95b2-43a8-81c2-d0535a95082c tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:38.512243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5f675594-95b2-43a8-81c2-d0535a95082c tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:38.513277 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5f675594-95b2-43a8-81c2-d0535a95082c tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:38.513949 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5f675594-95b2-43a8-81c2-d0535a95082c tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:38.514608 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5f675594-95b2-43a8-81c2-d0535a95082c tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:38.550050 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=16 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:38.630360 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5f675594-95b2-43a8-81c2-d0535a95082c tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569a3db98b7a44aeb902f7956af5a710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0fa4883254728921c0c49aa4e60b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:38.640271 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5f675594-95b2-43a8-81c2-d0535a95082c tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] 10.222.0.16 "GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf" status: 200 len: 1596 microversion: 2.1 time: 0.148420 Oct 05 02:49:38.641788 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2267/4522] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:38 2022] GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf => generated 1596 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:38.888927 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-08498a2e-a7f6-49cc-bffe-24f6b44f26af tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/1ce32527-2f68-494a-9b8f-e1a50d3d401f" status: 202 len: 0 microversion: 2.1 time: 0.584653 Oct 05 02:49:38.894044 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2256/4523] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 02:49:38 2022] DELETE /compute/v2.1/os-security-groups/1ce32527-2f68-494a-9b8f-e1a50d3d401f => generated 0 bytes in 590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:49:38.903113 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2ecf90e1-726e-49b0-80f0-caccef78fe64 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:38.903612 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2ecf90e1-726e-49b0-80f0-caccef78fe64 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:38.918869 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ba8ce561-2699-4353-b545-7461aace12c3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:38.920859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ba8ce561-2699-4353-b545-7461aace12c3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: c32101ff-4278-4a35-b328-895629612614] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:38.921703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ecf90e1-726e-49b0-80f0-caccef78fe64 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:38.922211 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ecf90e1-726e-49b0-80f0-caccef78fe64 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:38.922652 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ecf90e1-726e-49b0-80f0-caccef78fe64 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:38.923365 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ecf90e1-726e-49b0-80f0-caccef78fe64 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:38.923821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ecf90e1-726e-49b0-80f0-caccef78fe64 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:38.924253 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ecf90e1-726e-49b0-80f0-caccef78fe64 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:38.934098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ba8ce561-2699-4353-b545-7461aace12c3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:38.935039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ba8ce561-2699-4353-b545-7461aace12c3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:38.936331 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ba8ce561-2699-4353-b545-7461aace12c3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:38.937762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ba8ce561-2699-4353-b545-7461aace12c3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:38.938477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ba8ce561-2699-4353-b545-7461aace12c3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:38.939440 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ba8ce561-2699-4353-b545-7461aace12c3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:38.979014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2ecf90e1-726e-49b0-80f0-caccef78fe64 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:49:39.137862 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2ecf90e1-726e-49b0-80f0-caccef78fe64 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 204 len: 0 microversion: 2.1 time: 0.238284 Oct 05 02:49:39.138839 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2268/4524] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:49:38 2022] DELETE /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:49:39.160013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7865fdd0-261a-4d3d-b6d6-a3d286cd1ad0 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:39.163330 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7865fdd0-261a-4d3d-b6d6-a3d286cd1ad0 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:39.195494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7865fdd0-261a-4d3d-b6d6-a3d286cd1ad0 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:39.196246 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7865fdd0-261a-4d3d-b6d6-a3d286cd1ad0 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:39.196859 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7865fdd0-261a-4d3d-b6d6-a3d286cd1ad0 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:39.198417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7865fdd0-261a-4d3d-b6d6-a3d286cd1ad0 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:39.204240 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7865fdd0-261a-4d3d-b6d6-a3d286cd1ad0 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:39.205690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7865fdd0-261a-4d3d-b6d6-a3d286cd1ad0 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:39.293328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ba8ce561-2699-4353-b545-7461aace12c3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:39.305276 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ba8ce561-2699-4353-b545-7461aace12c3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614" status: 200 len: 1314 microversion: 2.1 time: 0.393773 Oct 05 02:49:39.307456 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2257/4525] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:38 2022] GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614 => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:39.488426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cb0ab7d9-0bc7-4d60-b188-8a0b04ca7291 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:39.489507 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cb0ab7d9-0bc7-4d60-b188-8a0b04ca7291 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7b7df17d-34fa-459d-880c-356dcd4a847f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:39.499171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb0ab7d9-0bc7-4d60-b188-8a0b04ca7291 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:39.499678 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb0ab7d9-0bc7-4d60-b188-8a0b04ca7291 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:39.500113 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb0ab7d9-0bc7-4d60-b188-8a0b04ca7291 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:39.500818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb0ab7d9-0bc7-4d60-b188-8a0b04ca7291 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:39.501480 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb0ab7d9-0bc7-4d60-b188-8a0b04ca7291 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:39.501916 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb0ab7d9-0bc7-4d60-b188-8a0b04ca7291 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:39.678676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7865fdd0-261a-4d3d-b6d6-a3d286cd1ad0 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:39.691821 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7865fdd0-261a-4d3d-b6d6-a3d286cd1ad0 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1511 microversion: 2.1 time: 0.547582 Oct 05 02:49:39.692421 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2269/4526] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:39 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1511 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:39.715451 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-03561da3-710f-4abf-952e-279a933d50c5 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:39.716362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-03561da3-710f-4abf-952e-279a933d50c5 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] [instance: 1f810197-91e4-4965-b93b-bdd3bf2950bf] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:39.723216 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03561da3-710f-4abf-952e-279a933d50c5 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:39.723994 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03561da3-710f-4abf-952e-279a933d50c5 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:39.724781 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03561da3-710f-4abf-952e-279a933d50c5 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:39.725850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03561da3-710f-4abf-952e-279a933d50c5 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:39.726518 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03561da3-710f-4abf-952e-279a933d50c5 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:39.727146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03561da3-710f-4abf-952e-279a933d50c5 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:39.733792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cb0ab7d9-0bc7-4d60-b188-8a0b04ca7291 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:39.755243 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cb0ab7d9-0bc7-4d60-b188-8a0b04ca7291 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f" status: 200 len: 1314 microversion: 2.1 time: 0.267937 Oct 05 02:49:39.758110 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2258/4527] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:39 2022] GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:39.897168 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03561da3-710f-4abf-952e-279a933d50c5 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:39.897872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03561da3-710f-4abf-952e-279a933d50c5 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:39.898330 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03561da3-710f-4abf-952e-279a933d50c5 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:39.899024 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-03561da3-710f-4abf-952e-279a933d50c5 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lazy-loading 'fault' on Instance uuid 1f810197-91e4-4965-b93b-bdd3bf2950bf {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:49:40.023186 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-03561da3-710f-4abf-952e-279a933d50c5 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569a3db98b7a44aeb902f7956af5a710', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a0fa4883254728921c0c49aa4e60b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:40.032299 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-03561da3-710f-4abf-952e-279a933d50c5 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] 10.222.0.16 "GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf" status: 200 len: 1315 microversion: 2.1 time: 0.326337 Oct 05 02:49:40.032940 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2270/4528] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:39 2022] GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:40.333232 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-487a5248-540c-4a1d-8f90-4d2954ea6cd8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:40.333864 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-487a5248-540c-4a1d-8f90-4d2954ea6cd8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: c32101ff-4278-4a35-b328-895629612614] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:40.336110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-a27ea7d4-d08c-4efb-90b1-aaec177cc7a3 req-f9a45d81-d276-4eff-8716-9ec3aa9ad9ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f810197-91e4-4965-b93b-bdd3bf2950bf", "name": "network-vif-deleted", "tag": "7927478e-de48-49be-ab91-0b118325717e"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:49:40.341589 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-487a5248-540c-4a1d-8f90-4d2954ea6cd8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:40.342330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-487a5248-540c-4a1d-8f90-4d2954ea6cd8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:40.343039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-487a5248-540c-4a1d-8f90-4d2954ea6cd8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:40.344231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-487a5248-540c-4a1d-8f90-4d2954ea6cd8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:40.344855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-487a5248-540c-4a1d-8f90-4d2954ea6cd8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:40.345521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-487a5248-540c-4a1d-8f90-4d2954ea6cd8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:40.351835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a27ea7d4-d08c-4efb-90b1-aaec177cc7a3 req-f9a45d81-d276-4eff-8716-9ec3aa9ad9ec service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:40.352491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a27ea7d4-d08c-4efb-90b1-aaec177cc7a3 req-f9a45d81-d276-4eff-8716-9ec3aa9ad9ec service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:40.352964 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a27ea7d4-d08c-4efb-90b1-aaec177cc7a3 req-f9a45d81-d276-4eff-8716-9ec3aa9ad9ec service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:40.370569 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-a27ea7d4-d08c-4efb-90b1-aaec177cc7a3 req-f9a45d81-d276-4eff-8716-9ec3aa9ad9ec service nova] Creating event network-vif-deleted:7927478e-de48-49be-ab91-0b118325717e for instance 1f810197-91e4-4965-b93b-bdd3bf2950bf on n-h2-858272-3 Oct 05 02:49:40.378693 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-a27ea7d4-d08c-4efb-90b1-aaec177cc7a3 req-f9a45d81-d276-4eff-8716-9ec3aa9ad9ec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046061 Oct 05 02:49:40.380588 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2271/4529] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:49:40.575793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-487a5248-540c-4a1d-8f90-4d2954ea6cd8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:40.609079 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-487a5248-540c-4a1d-8f90-4d2954ea6cd8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614" status: 200 len: 1314 microversion: 2.1 time: 0.283932 Oct 05 02:49:40.611682 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2259/4530] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:40 2022] GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:40.721864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c7c1d9e3-a6a0-44ef-90c1-9e8369f91863 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:40.723175 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c7c1d9e3-a6a0-44ef-90c1-9e8369f91863 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:40.732168 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7c1d9e3-a6a0-44ef-90c1-9e8369f91863 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:40.733080 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7c1d9e3-a6a0-44ef-90c1-9e8369f91863 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:40.734136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7c1d9e3-a6a0-44ef-90c1-9e8369f91863 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:40.735700 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7c1d9e3-a6a0-44ef-90c1-9e8369f91863 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:40.736337 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7c1d9e3-a6a0-44ef-90c1-9e8369f91863 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:40.737139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7c1d9e3-a6a0-44ef-90c1-9e8369f91863 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:40.781487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-525d73b5-ae0a-487f-b97a-26e5277956ec tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:40.782416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-525d73b5-ae0a-487f-b97a-26e5277956ec tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7b7df17d-34fa-459d-880c-356dcd4a847f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:40.791450 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-525d73b5-ae0a-487f-b97a-26e5277956ec tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:40.797788 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-525d73b5-ae0a-487f-b97a-26e5277956ec tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:40.800028 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-525d73b5-ae0a-487f-b97a-26e5277956ec tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:40.801778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-525d73b5-ae0a-487f-b97a-26e5277956ec tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:40.802331 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-525d73b5-ae0a-487f-b97a-26e5277956ec tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:40.802973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-525d73b5-ae0a-487f-b97a-26e5277956ec tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:40.956080 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c7c1d9e3-a6a0-44ef-90c1-9e8369f91863 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:40.958817 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:40.970889 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c7c1d9e3-a6a0-44ef-90c1-9e8369f91863 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1511 microversion: 2.1 time: 0.253413 Oct 05 02:49:40.982218 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2272/4531] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:40 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1511 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:41.036297 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-525d73b5-ae0a-487f-b97a-26e5277956ec tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:41.046674 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-525d73b5-ae0a-487f-b97a-26e5277956ec tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f" status: 200 len: 1314 microversion: 2.1 time: 0.269647 Oct 05 02:49:41.047590 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2260/4532] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:40 2022] GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:41.065397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dac882d7-713d-4ea8-9f32-5fcb9299dcd3 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:41.066201 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dac882d7-713d-4ea8-9f32-5fcb9299dcd3 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] [instance: 1f810197-91e4-4965-b93b-bdd3bf2950bf] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:41.077071 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dac882d7-713d-4ea8-9f32-5fcb9299dcd3 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:41.077695 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dac882d7-713d-4ea8-9f32-5fcb9299dcd3 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:41.078888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dac882d7-713d-4ea8-9f32-5fcb9299dcd3 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:41.080479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dac882d7-713d-4ea8-9f32-5fcb9299dcd3 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:41.081269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dac882d7-713d-4ea8-9f32-5fcb9299dcd3 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:41.082122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dac882d7-713d-4ea8-9f32-5fcb9299dcd3 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:41.112852 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-dac882d7-713d-4ea8-9f32-5fcb9299dcd3 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] HTTP exception thrown: Instance 1f810197-91e4-4965-b93b-bdd3bf2950bf could not be found. Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dac882d7-713d-4ea8-9f32-5fcb9299dcd3 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Request method failure captured: Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf HTTP/1.1 Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPBZPwTRxqCsW0i10hZzZCC9ZLb2mo1Q2xwgWYB6iLSWPpynMC-504C8hj6aAZJ38dLUmtqvSGqhUms2Hy45jsrysicN7fJNmFN12A6LVXYsg7LcQ7zwTkwV0F3udqs6EW39CCoTLfdPv4fjuirJ4alLjNew6MnpfxJ6UhFQFWF8aJg Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: a2a0fa4883254728921c0c49aa4e60b1 Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersTestFqdnHostnames-998337746 Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a2a0fa4883254728921c0c49aa4e60b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a2a0fa4883254728921c0c49aa4e60b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a2a0fa4883254728921c0c49aa4e60b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a2a0fa4883254728921c0c49aa4e60b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersTestFqdnHostnames-998337746 Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: a2a0fa4883254728921c0c49aa4e60b1 Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-998337746 Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersTestFqdnHostnames-998337746-project Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 569a3db98b7a44aeb902f7956af5a710 Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersTestFqdnHostnames-998337746-project Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 1f810197-91e4-4965-b93b-bdd3bf2950bf could not be found. Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '1f810197-91e4-4965-b93b-bdd3bf2950bf'} Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f810197-91e4-4965-b93b-bdd3bf2950bf could not be found. Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f810197-91e4-4965-b93b-bdd3bf2950bf could not be found. Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:41.114728 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:41.119990 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:41.119990 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:41.119990 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:41.119990 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:49:41.119990 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:49:41.119990 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f810197-91e4-4965-b93b-bdd3bf2950bf could not be found. Oct 05 02:49:41.119990 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:41.122353 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dac882d7-713d-4ea8-9f32-5fcb9299dcd3 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Returning 404 to user: Instance 1f810197-91e4-4965-b93b-bdd3bf2950bf could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:49:41.123462 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dac882d7-713d-4ea8-9f32-5fcb9299dcd3 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] 10.222.0.16 "GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf" status: 404 len: 111 microversion: 2.1 time: 0.065775 Oct 05 02:49:41.128196 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2273/4533] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:41 2022] GET /compute/v2.1/servers/1f810197-91e4-4965-b93b-bdd3bf2950bf => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:49:41.133057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b726f3db-3cd2-4aaa-b7ad-25da1dbf7cd0 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] Calling method '.version_select at 0x7fccdf22e9d0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:41.175891 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b726f3db-3cd2-4aaa-b7ad-25da1dbf7cd0 tempest-ServersTestFqdnHostnames-998337746 tempest-ServersTestFqdnHostnames-998337746-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-961275917" status: 202 len: 0 microversion: 2.1 time: 0.047104 Oct 05 02:49:41.177327 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2261/4534] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 5 02:49:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-961275917 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:49:41.634563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4280089a-ac88-4a4f-9f3c-c2642d1f937b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:41.636207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4280089a-ac88-4a4f-9f3c-c2642d1f937b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: c32101ff-4278-4a35-b328-895629612614] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:41.655338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4280089a-ac88-4a4f-9f3c-c2642d1f937b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:41.655338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4280089a-ac88-4a4f-9f3c-c2642d1f937b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:41.655338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4280089a-ac88-4a4f-9f3c-c2642d1f937b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:41.655338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4280089a-ac88-4a4f-9f3c-c2642d1f937b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:41.655338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4280089a-ac88-4a4f-9f3c-c2642d1f937b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:41.655338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4280089a-ac88-4a4f-9f3c-c2642d1f937b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:41.943706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4280089a-ac88-4a4f-9f3c-c2642d1f937b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:41.958461 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4280089a-ac88-4a4f-9f3c-c2642d1f937b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614" status: 200 len: 1314 microversion: 2.1 time: 0.328006 Oct 05 02:49:41.959592 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2274/4535] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:41 2022] GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:41.999853 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-739791e4-4311-47e8-b005-35e4215533a5 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:42.001929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-739791e4-4311-47e8-b005-35e4215533a5 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:42.027764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-739791e4-4311-47e8-b005-35e4215533a5 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:42.031998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-739791e4-4311-47e8-b005-35e4215533a5 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:42.032682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-739791e4-4311-47e8-b005-35e4215533a5 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:42.033593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-739791e4-4311-47e8-b005-35e4215533a5 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:42.034171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-739791e4-4311-47e8-b005-35e4215533a5 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:42.034709 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-739791e4-4311-47e8-b005-35e4215533a5 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:42.071964 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-62609922-ba16-455e-a517-0acc9ba1dec6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:42.073460 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-62609922-ba16-455e-a517-0acc9ba1dec6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7b7df17d-34fa-459d-880c-356dcd4a847f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:42.083750 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-62609922-ba16-455e-a517-0acc9ba1dec6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:42.084802 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-62609922-ba16-455e-a517-0acc9ba1dec6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:42.085475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-62609922-ba16-455e-a517-0acc9ba1dec6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:42.086713 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-62609922-ba16-455e-a517-0acc9ba1dec6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:42.087369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-62609922-ba16-455e-a517-0acc9ba1dec6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:42.088284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-62609922-ba16-455e-a517-0acc9ba1dec6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:42.478175 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-62609922-ba16-455e-a517-0acc9ba1dec6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:42.497280 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-62609922-ba16-455e-a517-0acc9ba1dec6 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f" status: 200 len: 1314 microversion: 2.1 time: 0.420466 Oct 05 02:49:42.498354 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2275/4536] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:42 2022] GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:49:42.641075 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-739791e4-4311-47e8-b005-35e4215533a5 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:42.654763 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-739791e4-4311-47e8-b005-35e4215533a5 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1511 microversion: 2.1 time: 0.660396 Oct 05 02:49:42.660821 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2262/4537] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:41 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1511 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:43.006294 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f56d853b-a975-49c6-b8c1-ac783a2497c1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:43.008130 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f56d853b-a975-49c6-b8c1-ac783a2497c1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: c32101ff-4278-4a35-b328-895629612614] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:43.040018 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f56d853b-a975-49c6-b8c1-ac783a2497c1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:43.041976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f56d853b-a975-49c6-b8c1-ac783a2497c1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:43.044836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f56d853b-a975-49c6-b8c1-ac783a2497c1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:43.046847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f56d853b-a975-49c6-b8c1-ac783a2497c1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:43.048816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f56d853b-a975-49c6-b8c1-ac783a2497c1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:43.049452 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f56d853b-a975-49c6-b8c1-ac783a2497c1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:43.092641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-e0ecaf24-882d-462d-838e-f2eeb35bf8bb req-cdf08e8c-0647-467e-bf64-e9450ed76441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b7df17d-34fa-459d-880c-356dcd4a847f", "name": "network-vif-plugged", "status": "completed", "tag": "a7ebbbac-cdb2-4339-b5ea-cace0aa0dd4c"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:49:43.110987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e0ecaf24-882d-462d-838e-f2eeb35bf8bb req-cdf08e8c-0647-467e-bf64-e9450ed76441 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:43.111471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e0ecaf24-882d-462d-838e-f2eeb35bf8bb req-cdf08e8c-0647-467e-bf64-e9450ed76441 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:43.111898 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e0ecaf24-882d-462d-838e-f2eeb35bf8bb req-cdf08e8c-0647-467e-bf64-e9450ed76441 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:43.164642 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-e0ecaf24-882d-462d-838e-f2eeb35bf8bb req-cdf08e8c-0647-467e-bf64-e9450ed76441 service nova] Creating event network-vif-plugged:a7ebbbac-cdb2-4339-b5ea-cace0aa0dd4c for instance 7b7df17d-34fa-459d-880c-356dcd4a847f on n-h2-858272-3 Oct 05 02:49:43.179222 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-e0ecaf24-882d-462d-838e-f2eeb35bf8bb req-cdf08e8c-0647-467e-bf64-e9450ed76441 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091066 Oct 05 02:49:43.190541 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2263/4538] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:49:43.520591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0bf14321-c4cc-4c0b-87af-e909bdab723e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:43.522199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0bf14321-c4cc-4c0b-87af-e909bdab723e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7b7df17d-34fa-459d-880c-356dcd4a847f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:43.551754 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0bf14321-c4cc-4c0b-87af-e909bdab723e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:43.556358 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0bf14321-c4cc-4c0b-87af-e909bdab723e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:43.557760 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0bf14321-c4cc-4c0b-87af-e909bdab723e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:43.559859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0bf14321-c4cc-4c0b-87af-e909bdab723e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:43.563176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0bf14321-c4cc-4c0b-87af-e909bdab723e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:43.563635 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0bf14321-c4cc-4c0b-87af-e909bdab723e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:43.992223 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f56d853b-a975-49c6-b8c1-ac783a2497c1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:44.005728 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f56d853b-a975-49c6-b8c1-ac783a2497c1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614" status: 200 len: 1314 microversion: 2.1 time: 1.024291 Oct 05 02:49:44.006324 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2276/4539] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:42 2022] GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614 => generated 1314 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:44.015260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ff57342f-2e9b-4623-8abf-ced1d53d93d9 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:44.021848 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ff57342f-2e9b-4623-8abf-ced1d53d93d9 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:44.038871 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff57342f-2e9b-4623-8abf-ced1d53d93d9 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:44.039373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff57342f-2e9b-4623-8abf-ced1d53d93d9 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:44.039818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff57342f-2e9b-4623-8abf-ced1d53d93d9 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:44.040530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff57342f-2e9b-4623-8abf-ced1d53d93d9 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:44.041548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff57342f-2e9b-4623-8abf-ced1d53d93d9 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:44.041980 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff57342f-2e9b-4623-8abf-ced1d53d93d9 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:44.438718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0bf14321-c4cc-4c0b-87af-e909bdab723e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:44.443545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ff57342f-2e9b-4623-8abf-ced1d53d93d9 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:44.451883 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ff57342f-2e9b-4623-8abf-ced1d53d93d9 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1511 microversion: 2.1 time: 0.443908 Oct 05 02:49:44.452061 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0bf14321-c4cc-4c0b-87af-e909bdab723e tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f" status: 200 len: 1314 microversion: 2.1 time: 0.936002 Oct 05 02:49:44.454060 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2264/4540] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:43 2022] GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f => generated 1314 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:49:44.470996 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2277/4541] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:44 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1511 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:44.735468 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-142a2b9b-a1d4-46a0-8849-64364f4b859d req-236ae278-9099-445a-8609-9846c338652f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a711b7d-3d62-4118-aa2f-985160e79ffb", "name": "network-vif-deleted", "tag": "93af56e9-cedc-4b3b-80a7-2c94ef741a18"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:49:44.764832 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-142a2b9b-a1d4-46a0-8849-64364f4b859d req-236ae278-9099-445a-8609-9846c338652f service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:44.765378 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-142a2b9b-a1d4-46a0-8849-64364f4b859d req-236ae278-9099-445a-8609-9846c338652f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:44.765870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-142a2b9b-a1d4-46a0-8849-64364f4b859d req-236ae278-9099-445a-8609-9846c338652f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:44.797488 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-142a2b9b-a1d4-46a0-8849-64364f4b859d req-236ae278-9099-445a-8609-9846c338652f service nova] Creating event network-vif-deleted:93af56e9-cedc-4b3b-80a7-2c94ef741a18 for instance 3a711b7d-3d62-4118-aa2f-985160e79ffb on n-h1-858272-3 Oct 05 02:49:44.805176 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-142a2b9b-a1d4-46a0-8849-64364f4b859d req-236ae278-9099-445a-8609-9846c338652f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073419 Oct 05 02:49:44.806304 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2265/4542] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:49:45.033061 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b0988dab-983f-488d-b1b3-d09c0051e7ec tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:45.033894 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b0988dab-983f-488d-b1b3-d09c0051e7ec tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: c32101ff-4278-4a35-b328-895629612614] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:45.042466 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0988dab-983f-488d-b1b3-d09c0051e7ec tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:45.051314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0988dab-983f-488d-b1b3-d09c0051e7ec tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:45.052035 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0988dab-983f-488d-b1b3-d09c0051e7ec tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:45.052791 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0988dab-983f-488d-b1b3-d09c0051e7ec tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:45.053290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0988dab-983f-488d-b1b3-d09c0051e7ec tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:45.054832 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0988dab-983f-488d-b1b3-d09c0051e7ec tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:45.222357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-0329a9d7-ac80-46e1-a736-7bebb27b1383 req-a95508c6-e415-414e-ace2-27f07de1b627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c32101ff-4278-4a35-b328-895629612614", "name": "network-vif-plugged", "status": "completed", "tag": "59567f38-bc61-44be-80c4-4986eccffb6a"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:49:45.251046 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-0329a9d7-ac80-46e1-a736-7bebb27b1383 req-a95508c6-e415-414e-ace2-27f07de1b627 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:45.253876 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-0329a9d7-ac80-46e1-a736-7bebb27b1383 req-a95508c6-e415-414e-ace2-27f07de1b627 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:45.254340 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-0329a9d7-ac80-46e1-a736-7bebb27b1383 req-a95508c6-e415-414e-ace2-27f07de1b627 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:45.269048 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-0329a9d7-ac80-46e1-a736-7bebb27b1383 req-a95508c6-e415-414e-ace2-27f07de1b627 service nova] Creating event network-vif-plugged:59567f38-bc61-44be-80c4-4986eccffb6a for instance c32101ff-4278-4a35-b328-895629612614 on n-h1-858272-3 Oct 05 02:49:45.276707 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-0329a9d7-ac80-46e1-a736-7bebb27b1383 req-a95508c6-e415-414e-ace2-27f07de1b627 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064188 Oct 05 02:49:45.277950 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2266/4543] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:49:45.325920 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b0988dab-983f-488d-b1b3-d09c0051e7ec tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:45.337484 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b0988dab-983f-488d-b1b3-d09c0051e7ec tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614" status: 200 len: 1314 microversion: 2.1 time: 0.308865 Oct 05 02:49:45.339204 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2278/4544] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:45 2022] GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:45.484937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d4740be2-237b-4015-a501-29040f2dcf51 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:45.485841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d4740be2-237b-4015-a501-29040f2dcf51 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7b7df17d-34fa-459d-880c-356dcd4a847f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:45.486268 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1e45ce0b-7fb4-4447-a238-d12bf64f7678 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:45.489229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1e45ce0b-7fb4-4447-a238-d12bf64f7678 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:45.502020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4740be2-237b-4015-a501-29040f2dcf51 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:45.503206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4740be2-237b-4015-a501-29040f2dcf51 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:45.504888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e45ce0b-7fb4-4447-a238-d12bf64f7678 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:45.505634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4740be2-237b-4015-a501-29040f2dcf51 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:45.506538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4740be2-237b-4015-a501-29040f2dcf51 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:45.507567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4740be2-237b-4015-a501-29040f2dcf51 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:45.508063 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e45ce0b-7fb4-4447-a238-d12bf64f7678 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:45.509997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4740be2-237b-4015-a501-29040f2dcf51 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:45.510833 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e45ce0b-7fb4-4447-a238-d12bf64f7678 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:45.513052 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e45ce0b-7fb4-4447-a238-d12bf64f7678 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:45.513750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e45ce0b-7fb4-4447-a238-d12bf64f7678 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:45.516533 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e45ce0b-7fb4-4447-a238-d12bf64f7678 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:45.586983 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:45.654895 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e45ce0b-7fb4-4447-a238-d12bf64f7678 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:45.655772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e45ce0b-7fb4-4447-a238-d12bf64f7678 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:45.657656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e45ce0b-7fb4-4447-a238-d12bf64f7678 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:45.658519 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-1e45ce0b-7fb4-4447-a238-d12bf64f7678 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lazy-loading 'fault' on Instance uuid 3a711b7d-3d62-4118-aa2f-985160e79ffb {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:49:45.896263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1e45ce0b-7fb4-4447-a238-d12bf64f7678 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4660830930074af2905b664500feefe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eab97ab9390449da800dab7d39217da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:45.905252 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1e45ce0b-7fb4-4447-a238-d12bf64f7678 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 200 len: 1313 microversion: 2.1 time: 0.430855 Oct 05 02:49:45.910136 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2267/4545] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:45 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 1313 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:45.987256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d4740be2-237b-4015-a501-29040f2dcf51 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:45.996677 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d4740be2-237b-4015-a501-29040f2dcf51 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f" status: 200 len: 1314 microversion: 2.1 time: 0.523305 Oct 05 02:49:46.000824 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2279/4546] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:45 2022] GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f => generated 1314 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:46.363416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-11e65a80-d0b8-4528-9663-6a15f3e60fed tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:46.364507 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-11e65a80-d0b8-4528-9663-6a15f3e60fed tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: c32101ff-4278-4a35-b328-895629612614] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:46.375007 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11e65a80-d0b8-4528-9663-6a15f3e60fed tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:46.375780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11e65a80-d0b8-4528-9663-6a15f3e60fed tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:46.377217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11e65a80-d0b8-4528-9663-6a15f3e60fed tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:46.378883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11e65a80-d0b8-4528-9663-6a15f3e60fed tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:46.379593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11e65a80-d0b8-4528-9663-6a15f3e60fed tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:46.380229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11e65a80-d0b8-4528-9663-6a15f3e60fed tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:46.664598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-11e65a80-d0b8-4528-9663-6a15f3e60fed tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:46.675826 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-11e65a80-d0b8-4528-9663-6a15f3e60fed tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614" status: 200 len: 1314 microversion: 2.1 time: 0.316163 Oct 05 02:49:46.677264 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2268/4547] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:46 2022] GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:46.938003 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-072cb261-3789-40e8-b2f5-598021c1f740 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:46.938622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-072cb261-3789-40e8-b2f5-598021c1f740 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] [instance: 3a711b7d-3d62-4118-aa2f-985160e79ffb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:46.956681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-072cb261-3789-40e8-b2f5-598021c1f740 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:46.957481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-072cb261-3789-40e8-b2f5-598021c1f740 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:46.957949 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-072cb261-3789-40e8-b2f5-598021c1f740 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:46.960410 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-072cb261-3789-40e8-b2f5-598021c1f740 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:46.961995 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-072cb261-3789-40e8-b2f5-598021c1f740 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:46.966489 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-072cb261-3789-40e8-b2f5-598021c1f740 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:46.997591 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-072cb261-3789-40e8-b2f5-598021c1f740 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] HTTP exception thrown: Instance 3a711b7d-3d62-4118-aa2f-985160e79ffb could not be found. Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-072cb261-3789-40e8-b2f5-598021c1f740 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Request method failure captured: Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb HTTP/1.1 Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPBsLFyR9AHc0BHfvMkndyGmD6NyvDM0yznjLPA2ODI3sz-6xsX4fgmQ6pqFpIOQBmymNVnvzGzw3vQKexahzrJCqMqEKPsb-XBlUImycI7O_eWzEBgnsRchSfIF5gbrB9DcgGSXlsmx8xvtQmqkH6pOuGtqDchal2162XPO5CBhCLw Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 1eab97ab9390449da800dab7d39217da Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1495387555 Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1eab97ab9390449da800dab7d39217da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1eab97ab9390449da800dab7d39217da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1eab97ab9390449da800dab7d39217da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1eab97ab9390449da800dab7d39217da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1495387555 Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 1eab97ab9390449da800dab7d39217da Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1495387555 Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServerRescueTestJSONUnderV235-1495387555-project Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 4660830930074af2905b664500feefe6 Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1495387555-project Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 3a711b7d-3d62-4118-aa2f-985160e79ffb could not be found. Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '3a711b7d-3d62-4118-aa2f-985160e79ffb'} Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a711b7d-3d62-4118-aa2f-985160e79ffb could not be found. Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a711b7d-3d62-4118-aa2f-985160e79ffb could not be found. Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:46.999734 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:47.005713 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:47.005713 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:47.005713 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:47.005713 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:47.005713 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:49:47.005713 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:49:47.005713 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a711b7d-3d62-4118-aa2f-985160e79ffb could not be found. Oct 05 02:49:47.005713 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:47.008928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-072cb261-3789-40e8-b2f5-598021c1f740 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] Returning 404 to user: Instance 3a711b7d-3d62-4118-aa2f-985160e79ffb could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:49:47.011007 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-072cb261-3789-40e8-b2f5-598021c1f740 tempest-ServerRescueTestJSONUnderV235-1495387555 tempest-ServerRescueTestJSONUnderV235-1495387555-project] 10.222.0.16 "GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb" status: 404 len: 111 microversion: 2.1 time: 0.076941 Oct 05 02:49:47.011969 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2280/4548] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:46 2022] GET /compute/v2.1/servers/3a711b7d-3d62-4118-aa2f-985160e79ffb => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:49:47.024620 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b691da76-ef71-4366-bf86-6dbd7cea76ca tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:47.025344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b691da76-ef71-4366-bf86-6dbd7cea76ca tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7b7df17d-34fa-459d-880c-356dcd4a847f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:47.042373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b691da76-ef71-4366-bf86-6dbd7cea76ca tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:47.042879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b691da76-ef71-4366-bf86-6dbd7cea76ca tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:47.043495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b691da76-ef71-4366-bf86-6dbd7cea76ca tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:47.044398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b691da76-ef71-4366-bf86-6dbd7cea76ca tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:47.044838 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b691da76-ef71-4366-bf86-6dbd7cea76ca tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:47.045304 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b691da76-ef71-4366-bf86-6dbd7cea76ca tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:47.489077 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b691da76-ef71-4366-bf86-6dbd7cea76ca tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:47.500143 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b691da76-ef71-4366-bf86-6dbd7cea76ca tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f" status: 200 len: 1501 microversion: 2.1 time: 0.479400 Oct 05 02:49:47.506146 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2269/4549] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:47 2022] GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f => generated 1501 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:47.526806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a020e150-7cb6-4cc5-87e0-ae4f3737da29 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:49:47.527355 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a020e150-7cb6-4cc5-87e0-ae4f3737da29 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7b7df17d-34fa-459d-880c-356dcd4a847f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:47.539608 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a020e150-7cb6-4cc5-87e0-ae4f3737da29 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:47.540136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a020e150-7cb6-4cc5-87e0-ae4f3737da29 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:47.543605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a020e150-7cb6-4cc5-87e0-ae4f3737da29 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:47.544955 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a020e150-7cb6-4cc5-87e0-ae4f3737da29 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:47.545588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a020e150-7cb6-4cc5-87e0-ae4f3737da29 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:47.546855 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a020e150-7cb6-4cc5-87e0-ae4f3737da29 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:47.582284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-a020e150-7cb6-4cc5-87e0-ae4f3737da29 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lazy-loading 'flavor' on Instance uuid 7b7df17d-34fa-459d-880c-356dcd4a847f {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:49:47.702229 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a020e150-7cb6-4cc5-87e0-ae4f3737da29 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "POST /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f/action" status: 202 len: 0 microversion: 2.1 time: 0.180325 Oct 05 02:49:47.703666 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2281/4550] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:49:47 2022] POST /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:49:47.703940 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fbf3cf97-8218-4af1-95f1-12f3a158d06e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:47.704685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fbf3cf97-8218-4af1-95f1-12f3a158d06e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: c32101ff-4278-4a35-b328-895629612614] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:47.712319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fbf3cf97-8218-4af1-95f1-12f3a158d06e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:47.716190 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fbf3cf97-8218-4af1-95f1-12f3a158d06e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:47.716831 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fbf3cf97-8218-4af1-95f1-12f3a158d06e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:47.717792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fbf3cf97-8218-4af1-95f1-12f3a158d06e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:47.719038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3855bbe2-6f26-4fe7-8677-851d756523fc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:47.719201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fbf3cf97-8218-4af1-95f1-12f3a158d06e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:47.719607 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fbf3cf97-8218-4af1-95f1-12f3a158d06e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:47.720744 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3855bbe2-6f26-4fe7-8677-851d756523fc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7b7df17d-34fa-459d-880c-356dcd4a847f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:47.735502 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3855bbe2-6f26-4fe7-8677-851d756523fc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:47.737587 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3855bbe2-6f26-4fe7-8677-851d756523fc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:47.739022 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3855bbe2-6f26-4fe7-8677-851d756523fc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:47.739965 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3855bbe2-6f26-4fe7-8677-851d756523fc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:47.741118 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3855bbe2-6f26-4fe7-8677-851d756523fc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:47.741867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3855bbe2-6f26-4fe7-8677-851d756523fc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:47.970793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fbf3cf97-8218-4af1-95f1-12f3a158d06e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:47.973903 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3855bbe2-6f26-4fe7-8677-851d756523fc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:47.983225 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fbf3cf97-8218-4af1-95f1-12f3a158d06e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614" status: 200 len: 1500 microversion: 2.1 time: 0.282301 Oct 05 02:49:47.983401 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3855bbe2-6f26-4fe7-8677-851d756523fc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f" status: 200 len: 1509 microversion: 2.1 time: 0.274958 Oct 05 02:49:47.983881 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2282/4551] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:47 2022] GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f => generated 1509 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:49:47.984218 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2270/4552] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:47 2022] GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614 => generated 1500 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:49:48.019086 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1292e74f-c47b-47d8-9bc4-93cc20640c16 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:49:48.020136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1292e74f-c47b-47d8-9bc4-93cc20640c16 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: c32101ff-4278-4a35-b328-895629612614] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:48.027009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1292e74f-c47b-47d8-9bc4-93cc20640c16 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:48.027804 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1292e74f-c47b-47d8-9bc4-93cc20640c16 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:48.028453 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1292e74f-c47b-47d8-9bc4-93cc20640c16 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:48.029442 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1292e74f-c47b-47d8-9bc4-93cc20640c16 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:48.030096 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1292e74f-c47b-47d8-9bc4-93cc20640c16 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:48.030710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1292e74f-c47b-47d8-9bc4-93cc20640c16 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:48.189255 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.network.security_group_api [None req-1292e74f-c47b-47d8-9bc4-93cc20640c16 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Removing security group c46e22f6-c694-472f-a468-a3653b354f72 from port 59567f38-bc61-44be-80c4-4986eccffb6a Oct 05 02:49:48.670629 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1292e74f-c47b-47d8-9bc4-93cc20640c16 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614/action" status: 202 len: 0 microversion: 2.1 time: 0.655411 Oct 05 02:49:48.674036 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2283/4553] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:49:48 2022] POST /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614/action => generated 0 bytes in 657 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:49:48.679727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7d01663c-7447-4c96-9223-0bd817be5ee4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:48.680710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7d01663c-7447-4c96-9223-0bd817be5ee4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: c32101ff-4278-4a35-b328-895629612614] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:48.693136 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d01663c-7447-4c96-9223-0bd817be5ee4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:48.694638 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d01663c-7447-4c96-9223-0bd817be5ee4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:48.695079 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d01663c-7447-4c96-9223-0bd817be5ee4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:48.695793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d01663c-7447-4c96-9223-0bd817be5ee4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:48.696241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d01663c-7447-4c96-9223-0bd817be5ee4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:48.699722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d01663c-7447-4c96-9223-0bd817be5ee4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:48.708466 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-b0dda87c-32f3-4089-a2dd-0deb1eba84fa req-4cf9e202-d36c-4fe7-b745-33ae710c49bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c32101ff-4278-4a35-b328-895629612614", "tag": "59567f38-bc61-44be-80c4-4986eccffb6a"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:49:48.737026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b0dda87c-32f3-4089-a2dd-0deb1eba84fa req-4cf9e202-d36c-4fe7-b745-33ae710c49bb service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:48.737515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b0dda87c-32f3-4089-a2dd-0deb1eba84fa req-4cf9e202-d36c-4fe7-b745-33ae710c49bb service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:48.737942 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b0dda87c-32f3-4089-a2dd-0deb1eba84fa req-4cf9e202-d36c-4fe7-b745-33ae710c49bb service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:48.787311 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-b0dda87c-32f3-4089-a2dd-0deb1eba84fa req-4cf9e202-d36c-4fe7-b745-33ae710c49bb service nova] Creating event network-changed:59567f38-bc61-44be-80c4-4986eccffb6a for instance c32101ff-4278-4a35-b328-895629612614 on n-h1-858272-3 Oct 05 02:49:48.804403 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-b0dda87c-32f3-4089-a2dd-0deb1eba84fa req-4cf9e202-d36c-4fe7-b745-33ae710c49bb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102264 Oct 05 02:49:48.814986 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2284/4554] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:49:48.964344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7d01663c-7447-4c96-9223-0bd817be5ee4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:48.989461 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7d01663c-7447-4c96-9223-0bd817be5ee4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614" status: 200 len: 1458 microversion: 2.1 time: 0.313554 Oct 05 02:49:48.993190 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2271/4555] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:48 2022] GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614 => generated 1458 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:49.022118 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b3c4c409-e134-479a-b0be-835124ffe83e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:49.023690 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b3c4c409-e134-479a-b0be-835124ffe83e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:49.027590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c5afa7b2-98bd-4b94-bb85-c6e3ea4ffb14 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:49.030786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c5afa7b2-98bd-4b94-bb85-c6e3ea4ffb14 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7b7df17d-34fa-459d-880c-356dcd4a847f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:49.040652 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3c4c409-e134-479a-b0be-835124ffe83e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:49.045152 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3c4c409-e134-479a-b0be-835124ffe83e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:49.046126 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3c4c409-e134-479a-b0be-835124ffe83e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:49.048119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5afa7b2-98bd-4b94-bb85-c6e3ea4ffb14 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:49.049108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3c4c409-e134-479a-b0be-835124ffe83e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:49.051110 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3c4c409-e134-479a-b0be-835124ffe83e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:49.051880 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5afa7b2-98bd-4b94-bb85-c6e3ea4ffb14 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:49.052616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3c4c409-e134-479a-b0be-835124ffe83e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:49.057898 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5afa7b2-98bd-4b94-bb85-c6e3ea4ffb14 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:49.059036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5afa7b2-98bd-4b94-bb85-c6e3ea4ffb14 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:49.059674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5afa7b2-98bd-4b94-bb85-c6e3ea4ffb14 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:49.060267 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5afa7b2-98bd-4b94-bb85-c6e3ea4ffb14 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:49.408391 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b3c4c409-e134-479a-b0be-835124ffe83e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:49.417253 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b3c4c409-e134-479a-b0be-835124ffe83e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.398992 Oct 05 02:49:49.421980 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2272/4556] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:49 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:49:49.454295 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c5afa7b2-98bd-4b94-bb85-c6e3ea4ffb14 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:49.459998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fb0214fe-406b-4608-a42f-3fb125eeaa85 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:49.461030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fb0214fe-406b-4608-a42f-3fb125eeaa85 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:49.471068 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c5afa7b2-98bd-4b94-bb85-c6e3ea4ffb14 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f" status: 200 len: 1492 microversion: 2.1 time: 0.458008 Oct 05 02:49:49.477393 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2285/4557] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:49 2022] GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f => generated 1492 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:49:49.481159 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb0214fe-406b-4608-a42f-3fb125eeaa85 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:49.482113 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb0214fe-406b-4608-a42f-3fb125eeaa85 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:49.485595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb0214fe-406b-4608-a42f-3fb125eeaa85 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:49.491104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb0214fe-406b-4608-a42f-3fb125eeaa85 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:49.491830 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb0214fe-406b-4608-a42f-3fb125eeaa85 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:49.492476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb0214fe-406b-4608-a42f-3fb125eeaa85 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:49.503573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c0788752-47d5-4ad3-99e2-776b8467c541 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:49.504313 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c0788752-47d5-4ad3-99e2-776b8467c541 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7b7df17d-34fa-459d-880c-356dcd4a847f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:49.519922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c0788752-47d5-4ad3-99e2-776b8467c541 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:49.520459 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c0788752-47d5-4ad3-99e2-776b8467c541 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:49.521703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c0788752-47d5-4ad3-99e2-776b8467c541 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:49.523488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c0788752-47d5-4ad3-99e2-776b8467c541 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:49.526085 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c0788752-47d5-4ad3-99e2-776b8467c541 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:49.527323 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c0788752-47d5-4ad3-99e2-776b8467c541 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:49.594983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c0788752-47d5-4ad3-99e2-776b8467c541 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7b7df17d-34fa-459d-880c-356dcd4a847f] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:49:49.798624 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c0788752-47d5-4ad3-99e2-776b8467c541 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f" status: 204 len: 0 microversion: 2.1 time: 0.298826 Oct 05 02:49:49.799397 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2286/4558] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:49:49 2022] DELETE /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 02:49:49.818825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-335f5dab-448f-4d41-88da-77d8791fd3c3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:49.820527 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-335f5dab-448f-4d41-88da-77d8791fd3c3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7b7df17d-34fa-459d-880c-356dcd4a847f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:49.843016 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-335f5dab-448f-4d41-88da-77d8791fd3c3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:49.846307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-335f5dab-448f-4d41-88da-77d8791fd3c3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:49.846795 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-335f5dab-448f-4d41-88da-77d8791fd3c3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:49.847556 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-335f5dab-448f-4d41-88da-77d8791fd3c3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:49.848028 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-335f5dab-448f-4d41-88da-77d8791fd3c3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:49.848461 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-335f5dab-448f-4d41-88da-77d8791fd3c3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:50.047134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fb0214fe-406b-4608-a42f-3fb125eeaa85 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:50.061634 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fb0214fe-406b-4608-a42f-3fb125eeaa85 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.610570 Oct 05 02:49:50.062220 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2273/4559] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:49 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:50.084617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ee6c3144-7993-4268-898d-ba49f83e210b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:50.085306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ee6c3144-7993-4268-898d-ba49f83e210b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:50.101317 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee6c3144-7993-4268-898d-ba49f83e210b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:50.102235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee6c3144-7993-4268-898d-ba49f83e210b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:50.102451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee6c3144-7993-4268-898d-ba49f83e210b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:50.104626 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee6c3144-7993-4268-898d-ba49f83e210b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:50.105172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee6c3144-7993-4268-898d-ba49f83e210b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:50.105616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee6c3144-7993-4268-898d-ba49f83e210b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:50.676805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-335f5dab-448f-4d41-88da-77d8791fd3c3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:50.711107 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-335f5dab-448f-4d41-88da-77d8791fd3c3 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f" status: 200 len: 1498 microversion: 2.1 time: 0.894390 Oct 05 02:49:50.717547 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2287/4560] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:49 2022] GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f => generated 1498 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:49:51.274646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ee6c3144-7993-4268-898d-ba49f83e210b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:51.287817 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ee6c3144-7993-4268-898d-ba49f83e210b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 1.208152 Oct 05 02:49:51.300593 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2274/4561] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:50 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:49:51.312339 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f14b8166-323b-40ed-bd8b-dd3e9f8bcb5d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:51.313004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f14b8166-323b-40ed-bd8b-dd3e9f8bcb5d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:51.326801 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f14b8166-323b-40ed-bd8b-dd3e9f8bcb5d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:51.327514 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f14b8166-323b-40ed-bd8b-dd3e9f8bcb5d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:51.327962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f14b8166-323b-40ed-bd8b-dd3e9f8bcb5d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:51.328682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f14b8166-323b-40ed-bd8b-dd3e9f8bcb5d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:51.329189 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f14b8166-323b-40ed-bd8b-dd3e9f8bcb5d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:51.329860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f14b8166-323b-40ed-bd8b-dd3e9f8bcb5d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:51.362473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:51.735526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-be707acb-aa34-46cf-8e47-42521ba9d19c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:51.735979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-be707acb-aa34-46cf-8e47-42521ba9d19c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7b7df17d-34fa-459d-880c-356dcd4a847f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:51.752563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be707acb-aa34-46cf-8e47-42521ba9d19c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:51.753107 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be707acb-aa34-46cf-8e47-42521ba9d19c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:51.753554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be707acb-aa34-46cf-8e47-42521ba9d19c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:51.754273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be707acb-aa34-46cf-8e47-42521ba9d19c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:51.754952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be707acb-aa34-46cf-8e47-42521ba9d19c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:51.755543 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be707acb-aa34-46cf-8e47-42521ba9d19c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:52.014706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f14b8166-323b-40ed-bd8b-dd3e9f8bcb5d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:52.039671 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f14b8166-323b-40ed-bd8b-dd3e9f8bcb5d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.731404 Oct 05 02:49:52.040266 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2288/4562] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:51 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:52.226913 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-56ca5acd-1f91-443e-9638-f269015bc265 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-572112063", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "3c7ecbb9-3319-48a3-8bf2-f42adcddf7f9"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:49:52.318175 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-56ca5acd-1f91-443e-9638-f269015bc265 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] validate_networks() for [('3c7ecbb9-3319-48a3-8bf2-f42adcddf7f9', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:49:52.684242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-be707acb-aa34-46cf-8e47-42521ba9d19c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:52.698225 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-be707acb-aa34-46cf-8e47-42521ba9d19c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f" status: 200 len: 1498 microversion: 2.1 time: 0.966572 Oct 05 02:49:52.699301 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2275/4563] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:51 2022] GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f => generated 1498 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:53.669435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-56ca5acd-1f91-443e-9638-f269015bc265 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:49:53.669995 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-56ca5acd-1f91-443e-9638-f269015bc265 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:49:53.670382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-56ca5acd-1f91-443e-9638-f269015bc265 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:49:53.670802 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-56ca5acd-1f91-443e-9638-f269015bc265 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:49:53.671257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-56ca5acd-1f91-443e-9638-f269015bc265 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:49:53.706271 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56ca5acd-1f91-443e-9638-f269015bc265 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:53.706876 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56ca5acd-1f91-443e-9638-f269015bc265 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:53.707328 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56ca5acd-1f91-443e-9638-f269015bc265 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:53.710545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56ca5acd-1f91-443e-9638-f269015bc265 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:53.710545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56ca5acd-1f91-443e-9638-f269015bc265 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:53.710545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56ca5acd-1f91-443e-9638-f269015bc265 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:53.721722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b4a80f73-d509-4ccd-9d60-f9f4c2f1e0bf tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:53.722321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b4a80f73-d509-4ccd-9d60-f9f4c2f1e0bf tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7b7df17d-34fa-459d-880c-356dcd4a847f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:53.737747 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4a80f73-d509-4ccd-9d60-f9f4c2f1e0bf tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:53.738258 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4a80f73-d509-4ccd-9d60-f9f4c2f1e0bf tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:53.738704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4a80f73-d509-4ccd-9d60-f9f4c2f1e0bf tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:53.745710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4a80f73-d509-4ccd-9d60-f9f4c2f1e0bf tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:53.747226 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4a80f73-d509-4ccd-9d60-f9f4c2f1e0bf tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:53.747684 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4a80f73-d509-4ccd-9d60-f9f4c2f1e0bf tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:53.754799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-56ca5acd-1f91-443e-9638-f269015bc265 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Getting quotas for project 1ff63adf9571439d8f8bf9b0fa6c63f9. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:49:53.761405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-56ca5acd-1f91-443e-9638-f269015bc265 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Getting quotas for user 728544ca5e164540b3c5395534542955 and project 1ff63adf9571439d8f8bf9b0fa6c63f9. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:49:53.807493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-56ca5acd-1f91-443e-9638-f269015bc265 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:49:53.810823 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-56ca5acd-1f91-443e-9638-f269015bc265 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:49:53.882703 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-56ca5acd-1f91-443e-9638-f269015bc265 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.659354 Oct 05 02:49:53.886050 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2289/4564] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:49:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:49:53.891967 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-fa771ee0-37a0-4d98-822d-f0c2ad838252 req-94eb4af4-9d23-4682-9cdb-6853537c0c0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b7df17d-34fa-459d-880c-356dcd4a847f", "name": "network-vif-deleted", "tag": "a7ebbbac-cdb2-4339-b5ea-cace0aa0dd4c"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:49:53.903321 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-fa771ee0-37a0-4d98-822d-f0c2ad838252 req-94eb4af4-9d23-4682-9cdb-6853537c0c0b service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:53.904181 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-fa771ee0-37a0-4d98-822d-f0c2ad838252 req-94eb4af4-9d23-4682-9cdb-6853537c0c0b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:53.904766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-fa771ee0-37a0-4d98-822d-f0c2ad838252 req-94eb4af4-9d23-4682-9cdb-6853537c0c0b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:53.925074 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-fa771ee0-37a0-4d98-822d-f0c2ad838252 req-94eb4af4-9d23-4682-9cdb-6853537c0c0b service nova] Creating event network-vif-deleted:a7ebbbac-cdb2-4339-b5ea-cace0aa0dd4c for instance 7b7df17d-34fa-459d-880c-356dcd4a847f on n-h2-858272-3 Oct 05 02:49:53.937248 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-fa771ee0-37a0-4d98-822d-f0c2ad838252 req-94eb4af4-9d23-4682-9cdb-6853537c0c0b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046788 Oct 05 02:49:53.938889 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2290/4565] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:49:53.947266 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-376dad3a-1e37-412d-bbf6-acea4a16f8b8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:53.948357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-376dad3a-1e37-412d-bbf6-acea4a16f8b8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:54.140763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-376dad3a-1e37-412d-bbf6-acea4a16f8b8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:54.144012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b4a80f73-d509-4ccd-9d60-f9f4c2f1e0bf tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff170a5be8a04902b66e5f0e79fd47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd797c0058e8c456290081d056df79292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:54.150971 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-376dad3a-1e37-412d-bbf6-acea4a16f8b8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1214 microversion: 2.1 time: 0.209994 Oct 05 02:49:54.152804 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2291/4566] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:53 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1214 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:54.155886 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b4a80f73-d509-4ccd-9d60-f9f4c2f1e0bf tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f" status: 200 len: 1456 microversion: 2.1 time: 0.438286 Oct 05 02:49:54.156475 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2276/4567] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:53 2022] GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f => generated 1456 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:49:55.177001 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7d3ebd7a-80b9-4135-943d-3e73eb493a08 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:55.179638 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7d3ebd7a-80b9-4135-943d-3e73eb493a08 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:55.189804 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-51c8dd17-8c58-4e4f-909a-b47dac47e2af tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:55.190605 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-51c8dd17-8c58-4e4f-909a-b47dac47e2af tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7b7df17d-34fa-459d-880c-356dcd4a847f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:55.206328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-51c8dd17-8c58-4e4f-909a-b47dac47e2af tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:55.207781 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7d3ebd7a-80b9-4135-943d-3e73eb493a08 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:55.208792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7d3ebd7a-80b9-4135-943d-3e73eb493a08 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:55.212314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7d3ebd7a-80b9-4135-943d-3e73eb493a08 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:55.214402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-51c8dd17-8c58-4e4f-909a-b47dac47e2af tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:55.215176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7d3ebd7a-80b9-4135-943d-3e73eb493a08 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:55.217208 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7d3ebd7a-80b9-4135-943d-3e73eb493a08 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:55.221053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7d3ebd7a-80b9-4135-943d-3e73eb493a08 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:55.222410 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-51c8dd17-8c58-4e4f-909a-b47dac47e2af tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:55.223295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-51c8dd17-8c58-4e4f-909a-b47dac47e2af tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:55.224988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-51c8dd17-8c58-4e4f-909a-b47dac47e2af tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:55.225771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-51c8dd17-8c58-4e4f-909a-b47dac47e2af tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:55.265807 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-51c8dd17-8c58-4e4f-909a-b47dac47e2af tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] HTTP exception thrown: Instance 7b7df17d-34fa-459d-880c-356dcd4a847f could not be found. Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-51c8dd17-8c58-4e4f-909a-b47dac47e2af tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Request method failure captured: Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f HTTP/1.1 Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO9sJgtvOLeTr4nOCD-vOqCqD1zJrAITPFW_zz4yiLyvIoTdHjuR4LJfH4xTHqVQhBEUV87uN4J6FQiHHhnatngFlbfTbJmS6cPceNKMN6UWu-_pNs3jdF8Cb5CgC-hxlx6u-5aGNVi9h5jLYyViTpDjMXgNyRvr5dJZFZQW2uKikA8 Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: d797c0058e8c456290081d056df79292 Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d797c0058e8c456290081d056df79292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d797c0058e8c456290081d056df79292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: d797c0058e8c456290081d056df79292 Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: ff170a5be8a04902b66e5f0e79fd47df Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 7b7df17d-34fa-459d-880c-356dcd4a847f could not be found. Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '7b7df17d-34fa-459d-880c-356dcd4a847f'} Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b7df17d-34fa-459d-880c-356dcd4a847f could not be found. Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b7df17d-34fa-459d-880c-356dcd4a847f could not be found. Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:55.273037 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.277543 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:55.277543 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:55.277543 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:55.277543 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:49:55.277543 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:49:55.277543 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b7df17d-34fa-459d-880c-356dcd4a847f could not be found. Oct 05 02:49:55.277543 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.281290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-51c8dd17-8c58-4e4f-909a-b47dac47e2af tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Returning 404 to user: Instance 7b7df17d-34fa-459d-880c-356dcd4a847f could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:49:55.283558 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-51c8dd17-8c58-4e4f-909a-b47dac47e2af tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f" status: 404 len: 111 microversion: 2.1 time: 0.102054 Oct 05 02:49:55.286423 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2277/4568] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:55 2022] GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:49:55.304700 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d7a565e1-958e-44d6-bec1-64d55df35720 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:55.308598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d7a565e1-958e-44d6-bec1-64d55df35720 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7b7df17d-34fa-459d-880c-356dcd4a847f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:55.319642 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7a565e1-958e-44d6-bec1-64d55df35720 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:55.324501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7a565e1-958e-44d6-bec1-64d55df35720 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:55.325349 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7a565e1-958e-44d6-bec1-64d55df35720 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:55.326407 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7a565e1-958e-44d6-bec1-64d55df35720 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:55.330608 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7a565e1-958e-44d6-bec1-64d55df35720 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:55.331396 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7a565e1-958e-44d6-bec1-64d55df35720 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:55.359906 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-d7a565e1-958e-44d6-bec1-64d55df35720 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] HTTP exception thrown: Instance 7b7df17d-34fa-459d-880c-356dcd4a847f could not be found. Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d7a565e1-958e-44d6-bec1-64d55df35720 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Request method failure captured: Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f HTTP/1.1 Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO9sJgtvOLeTr4nOCD-vOqCqD1zJrAITPFW_zz4yiLyvIoTdHjuR4LJfH4xTHqVQhBEUV87uN4J6FQiHHhnatngFlbfTbJmS6cPceNKMN6UWu-_pNs3jdF8Cb5CgC-hxlx6u-5aGNVi9h5jLYyViTpDjMXgNyRvr5dJZFZQW2uKikA8 Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: d797c0058e8c456290081d056df79292 Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d797c0058e8c456290081d056df79292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d797c0058e8c456290081d056df79292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: d797c0058e8c456290081d056df79292 Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: ff170a5be8a04902b66e5f0e79fd47df Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 7b7df17d-34fa-459d-880c-356dcd4a847f could not be found. Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '7b7df17d-34fa-459d-880c-356dcd4a847f'} Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b7df17d-34fa-459d-880c-356dcd4a847f could not be found. Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:49:55.364723 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:49:55.368734 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b7df17d-34fa-459d-880c-356dcd4a847f could not be found. Oct 05 02:49:55.368734 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.368734 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:55.368734 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.368734 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:55.368734 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:55.368734 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:55.368734 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:49:55.368734 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:49:55.368734 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b7df17d-34fa-459d-880c-356dcd4a847f could not be found. Oct 05 02:49:55.368734 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.372255 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d7a565e1-958e-44d6-bec1-64d55df35720 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Returning 404 to user: Instance 7b7df17d-34fa-459d-880c-356dcd4a847f could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:49:55.375941 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d7a565e1-958e-44d6-bec1-64d55df35720 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f" status: 404 len: 111 microversion: 2.1 time: 0.081712 Oct 05 02:49:55.377685 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2278/4569] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:49:55 2022] DELETE /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:49:55.389383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b7bf21b4-7e79-4e45-9637-1ce7f0d0b866 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:55.391213 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b7bf21b4-7e79-4e45-9637-1ce7f0d0b866 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7b7df17d-34fa-459d-880c-356dcd4a847f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:55.407433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7bf21b4-7e79-4e45-9637-1ce7f0d0b866 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:55.410838 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7bf21b4-7e79-4e45-9637-1ce7f0d0b866 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:55.413386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7bf21b4-7e79-4e45-9637-1ce7f0d0b866 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:55.414876 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7bf21b4-7e79-4e45-9637-1ce7f0d0b866 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:55.417863 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7bf21b4-7e79-4e45-9637-1ce7f0d0b866 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:55.418611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7bf21b4-7e79-4e45-9637-1ce7f0d0b866 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:55.447189 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-b7bf21b4-7e79-4e45-9637-1ce7f0d0b866 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] HTTP exception thrown: Instance 7b7df17d-34fa-459d-880c-356dcd4a847f could not be found. Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b7bf21b4-7e79-4e45-9637-1ce7f0d0b866 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Request method failure captured: Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f HTTP/1.1 Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO9sJgtvOLeTr4nOCD-vOqCqD1zJrAITPFW_zz4yiLyvIoTdHjuR4LJfH4xTHqVQhBEUV87uN4J6FQiHHhnatngFlbfTbJmS6cPceNKMN6UWu-_pNs3jdF8Cb5CgC-hxlx6u-5aGNVi9h5jLYyViTpDjMXgNyRvr5dJZFZQW2uKikA8 Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: d797c0058e8c456290081d056df79292 Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d797c0058e8c456290081d056df79292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d797c0058e8c456290081d056df79292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: d797c0058e8c456290081d056df79292 Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: ff170a5be8a04902b66e5f0e79fd47df Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 7b7df17d-34fa-459d-880c-356dcd4a847f could not be found. Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '7b7df17d-34fa-459d-880c-356dcd4a847f'} Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b7df17d-34fa-459d-880c-356dcd4a847f could not be found. Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b7df17d-34fa-459d-880c-356dcd4a847f could not be found. Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:55.459737 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.464397 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:55.464397 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:55.464397 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:55.464397 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:49:55.464397 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:49:55.464397 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b7df17d-34fa-459d-880c-356dcd4a847f could not be found. Oct 05 02:49:55.464397 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.467028 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b7bf21b4-7e79-4e45-9637-1ce7f0d0b866 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Returning 404 to user: Instance 7b7df17d-34fa-459d-880c-356dcd4a847f could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:49:55.471135 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b7bf21b4-7e79-4e45-9637-1ce7f0d0b866 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f" status: 404 len: 111 microversion: 2.1 time: 0.086755 Oct 05 02:49:55.471752 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2279/4570] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:55 2022] GET /compute/v2.1/servers/7b7df17d-34fa-459d-880c-356dcd4a847f => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:49:55.485657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-88f7499b-1302-4105-b4d3-78acd31e10e2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:55.486387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-88f7499b-1302-4105-b4d3-78acd31e10e2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:55.494829 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88f7499b-1302-4105-b4d3-78acd31e10e2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:55.495859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88f7499b-1302-4105-b4d3-78acd31e10e2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:55.496769 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88f7499b-1302-4105-b4d3-78acd31e10e2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:55.497780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88f7499b-1302-4105-b4d3-78acd31e10e2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:55.498490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88f7499b-1302-4105-b4d3-78acd31e10e2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:55.499152 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88f7499b-1302-4105-b4d3-78acd31e10e2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:55.513977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7d3ebd7a-80b9-4135-943d-3e73eb493a08 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:55.529702 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7d3ebd7a-80b9-4135-943d-3e73eb493a08 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1210 microversion: 2.1 time: 0.356843 Oct 05 02:49:55.530532 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-88f7499b-1302-4105-b4d3-78acd31e10e2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] HTTP exception thrown: Instance 8ec0ae24-68e3-4673-a177-50594e62bff2 could not be found. Oct 05 02:49:55.532123 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2292/4571] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:55 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1210 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-88f7499b-1302-4105-b4d3-78acd31e10e2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Request method failure captured: Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 HTTP/1.1 Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO9sJgtvOLeTr4nOCD-vOqCqD1zJrAITPFW_zz4yiLyvIoTdHjuR4LJfH4xTHqVQhBEUV87uN4J6FQiHHhnatngFlbfTbJmS6cPceNKMN6UWu-_pNs3jdF8Cb5CgC-hxlx6u-5aGNVi9h5jLYyViTpDjMXgNyRvr5dJZFZQW2uKikA8 Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: d797c0058e8c456290081d056df79292 Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d797c0058e8c456290081d056df79292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d797c0058e8c456290081d056df79292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: d797c0058e8c456290081d056df79292 Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: ff170a5be8a04902b66e5f0e79fd47df Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 8ec0ae24-68e3-4673-a177-50594e62bff2 could not be found. Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '8ec0ae24-68e3-4673-a177-50594e62bff2'} Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ec0ae24-68e3-4673-a177-50594e62bff2 could not be found. Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:49:55.534045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:49:55.539271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ec0ae24-68e3-4673-a177-50594e62bff2 could not be found. Oct 05 02:49:55.539271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.539271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:55.539271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.539271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:55.539271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:55.539271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:55.539271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:49:55.539271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:49:55.539271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ec0ae24-68e3-4673-a177-50594e62bff2 could not be found. Oct 05 02:49:55.539271 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.539271 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-88f7499b-1302-4105-b4d3-78acd31e10e2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Returning 404 to user: Instance 8ec0ae24-68e3-4673-a177-50594e62bff2 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:49:55.539271 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-88f7499b-1302-4105-b4d3-78acd31e10e2 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 404 len: 111 microversion: 2.1 time: 0.058418 Oct 05 02:49:55.539271 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2280/4572] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:49:55 2022] DELETE /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:49:55.552641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3796b451-d3d1-4ed0-8f69-086c2cb36c45 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:55.554887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3796b451-d3d1-4ed0-8f69-086c2cb36c45 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 8ec0ae24-68e3-4673-a177-50594e62bff2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:55.571769 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3796b451-d3d1-4ed0-8f69-086c2cb36c45 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:55.576150 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3796b451-d3d1-4ed0-8f69-086c2cb36c45 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:55.577116 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3796b451-d3d1-4ed0-8f69-086c2cb36c45 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:55.578359 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3796b451-d3d1-4ed0-8f69-086c2cb36c45 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:55.579089 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3796b451-d3d1-4ed0-8f69-086c2cb36c45 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:55.579837 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3796b451-d3d1-4ed0-8f69-086c2cb36c45 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:55.614612 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-3796b451-d3d1-4ed0-8f69-086c2cb36c45 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] HTTP exception thrown: Instance 8ec0ae24-68e3-4673-a177-50594e62bff2 could not be found. Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3796b451-d3d1-4ed0-8f69-086c2cb36c45 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Request method failure captured: Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 HTTP/1.1 Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO9sJgtvOLeTr4nOCD-vOqCqD1zJrAITPFW_zz4yiLyvIoTdHjuR4LJfH4xTHqVQhBEUV87uN4J6FQiHHhnatngFlbfTbJmS6cPceNKMN6UWu-_pNs3jdF8Cb5CgC-hxlx6u-5aGNVi9h5jLYyViTpDjMXgNyRvr5dJZFZQW2uKikA8 Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: d797c0058e8c456290081d056df79292 Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d797c0058e8c456290081d056df79292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d797c0058e8c456290081d056df79292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: d797c0058e8c456290081d056df79292 Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: ff170a5be8a04902b66e5f0e79fd47df Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 8ec0ae24-68e3-4673-a177-50594e62bff2 could not be found. Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '8ec0ae24-68e3-4673-a177-50594e62bff2'} Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ec0ae24-68e3-4673-a177-50594e62bff2 could not be found. Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ec0ae24-68e3-4673-a177-50594e62bff2 could not be found. Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:55.618488 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.625153 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:55.625153 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:55.625153 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:55.625153 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:49:55.625153 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:49:55.625153 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ec0ae24-68e3-4673-a177-50594e62bff2 could not be found. Oct 05 02:49:55.625153 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.629150 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3796b451-d3d1-4ed0-8f69-086c2cb36c45 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Returning 404 to user: Instance 8ec0ae24-68e3-4673-a177-50594e62bff2 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:49:55.631150 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3796b451-d3d1-4ed0-8f69-086c2cb36c45 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2" status: 404 len: 111 microversion: 2.1 time: 0.088422 Oct 05 02:49:55.633839 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2293/4573] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:55 2022] GET /compute/v2.1/servers/8ec0ae24-68e3-4673-a177-50594e62bff2 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:49:55.652748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-45519971-2a1a-4de7-9739-0926671d38e9 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:55.653783 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-45519971-2a1a-4de7-9739-0926671d38e9 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:55.676284 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45519971-2a1a-4de7-9739-0926671d38e9 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:55.677296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45519971-2a1a-4de7-9739-0926671d38e9 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:55.682036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45519971-2a1a-4de7-9739-0926671d38e9 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:55.689916 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45519971-2a1a-4de7-9739-0926671d38e9 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:55.692356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45519971-2a1a-4de7-9739-0926671d38e9 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:55.693341 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45519971-2a1a-4de7-9739-0926671d38e9 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:55.737686 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-45519971-2a1a-4de7-9739-0926671d38e9 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] HTTP exception thrown: Instance 161a6f96-e469-47fd-a72f-df5a05e9a62b could not be found. Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-45519971-2a1a-4de7-9739-0926671d38e9 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Request method failure captured: Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b HTTP/1.1 Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO9sJgtvOLeTr4nOCD-vOqCqD1zJrAITPFW_zz4yiLyvIoTdHjuR4LJfH4xTHqVQhBEUV87uN4J6FQiHHhnatngFlbfTbJmS6cPceNKMN6UWu-_pNs3jdF8Cb5CgC-hxlx6u-5aGNVi9h5jLYyViTpDjMXgNyRvr5dJZFZQW2uKikA8 Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: d797c0058e8c456290081d056df79292 Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d797c0058e8c456290081d056df79292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d797c0058e8c456290081d056df79292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: d797c0058e8c456290081d056df79292 Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: ff170a5be8a04902b66e5f0e79fd47df Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 161a6f96-e469-47fd-a72f-df5a05e9a62b could not be found. Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '161a6f96-e469-47fd-a72f-df5a05e9a62b'} Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 161a6f96-e469-47fd-a72f-df5a05e9a62b could not be found. Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:49:55.747080 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:49:55.751101 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 161a6f96-e469-47fd-a72f-df5a05e9a62b could not be found. Oct 05 02:49:55.751101 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.751101 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:55.751101 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.751101 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:55.751101 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:55.751101 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:55.751101 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:49:55.751101 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:49:55.751101 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 161a6f96-e469-47fd-a72f-df5a05e9a62b could not be found. Oct 05 02:49:55.751101 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.751101 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-45519971-2a1a-4de7-9739-0926671d38e9 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Returning 404 to user: Instance 161a6f96-e469-47fd-a72f-df5a05e9a62b could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:49:55.751845 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-45519971-2a1a-4de7-9739-0926671d38e9 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "DELETE /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 404 len: 111 microversion: 2.1 time: 0.106851 Oct 05 02:49:55.752774 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2281/4574] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:49:55 2022] DELETE /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:49:55.762363 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bd821415-f97d-45c8-a591-dd595509a411 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:55.763141 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bd821415-f97d-45c8-a591-dd595509a411 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 161a6f96-e469-47fd-a72f-df5a05e9a62b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:55.771327 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd821415-f97d-45c8-a591-dd595509a411 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:55.772174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd821415-f97d-45c8-a591-dd595509a411 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:55.773430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd821415-f97d-45c8-a591-dd595509a411 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:55.774319 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd821415-f97d-45c8-a591-dd595509a411 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:55.775296 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd821415-f97d-45c8-a591-dd595509a411 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:55.776221 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd821415-f97d-45c8-a591-dd595509a411 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:55.796757 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-bd821415-f97d-45c8-a591-dd595509a411 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] HTTP exception thrown: Instance 161a6f96-e469-47fd-a72f-df5a05e9a62b could not be found. Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bd821415-f97d-45c8-a591-dd595509a411 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Request method failure captured: Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b HTTP/1.1 Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO9sJgtvOLeTr4nOCD-vOqCqD1zJrAITPFW_zz4yiLyvIoTdHjuR4LJfH4xTHqVQhBEUV87uN4J6FQiHHhnatngFlbfTbJmS6cPceNKMN6UWu-_pNs3jdF8Cb5CgC-hxlx6u-5aGNVi9h5jLYyViTpDjMXgNyRvr5dJZFZQW2uKikA8 Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: d797c0058e8c456290081d056df79292 Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d797c0058e8c456290081d056df79292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d797c0058e8c456290081d056df79292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: d797c0058e8c456290081d056df79292 Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: ff170a5be8a04902b66e5f0e79fd47df Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 161a6f96-e469-47fd-a72f-df5a05e9a62b could not be found. Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '161a6f96-e469-47fd-a72f-df5a05e9a62b'} Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 161a6f96-e469-47fd-a72f-df5a05e9a62b could not be found. Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 161a6f96-e469-47fd-a72f-df5a05e9a62b could not be found. Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:55.798468 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.802688 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:55.802688 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:55.802688 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:55.802688 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:49:55.802688 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:49:55.802688 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 161a6f96-e469-47fd-a72f-df5a05e9a62b could not be found. Oct 05 02:49:55.802688 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.802688 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bd821415-f97d-45c8-a591-dd595509a411 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Returning 404 to user: Instance 161a6f96-e469-47fd-a72f-df5a05e9a62b could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:49:55.802688 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bd821415-f97d-45c8-a591-dd595509a411 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b" status: 404 len: 111 microversion: 2.1 time: 0.043548 Oct 05 02:49:55.802688 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2294/4575] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:55 2022] GET /compute/v2.1/servers/161a6f96-e469-47fd-a72f-df5a05e9a62b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:49:55.811224 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a1f0b682-c514-450f-856b-30478921f691 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:55.811917 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a1f0b682-c514-450f-856b-30478921f691 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 11e71f42-f1ec-46ca-a349-265766e0483e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:55.823529 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a1f0b682-c514-450f-856b-30478921f691 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:55.824514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a1f0b682-c514-450f-856b-30478921f691 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:55.827236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a1f0b682-c514-450f-856b-30478921f691 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:55.828343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a1f0b682-c514-450f-856b-30478921f691 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:55.829026 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a1f0b682-c514-450f-856b-30478921f691 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:55.829983 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a1f0b682-c514-450f-856b-30478921f691 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:55.852501 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-a1f0b682-c514-450f-856b-30478921f691 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] HTTP exception thrown: Instance 11e71f42-f1ec-46ca-a349-265766e0483e could not be found. Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a1f0b682-c514-450f-856b-30478921f691 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Request method failure captured: Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e HTTP/1.1 Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO9sJgtvOLeTr4nOCD-vOqCqD1zJrAITPFW_zz4yiLyvIoTdHjuR4LJfH4xTHqVQhBEUV87uN4J6FQiHHhnatngFlbfTbJmS6cPceNKMN6UWu-_pNs3jdF8Cb5CgC-hxlx6u-5aGNVi9h5jLYyViTpDjMXgNyRvr5dJZFZQW2uKikA8 Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: d797c0058e8c456290081d056df79292 Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d797c0058e8c456290081d056df79292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d797c0058e8c456290081d056df79292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: d797c0058e8c456290081d056df79292 Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: ff170a5be8a04902b66e5f0e79fd47df Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 11e71f42-f1ec-46ca-a349-265766e0483e could not be found. Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '11e71f42-f1ec-46ca-a349-265766e0483e'} Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11e71f42-f1ec-46ca-a349-265766e0483e could not be found. Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:49:55.854820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:49:55.859963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11e71f42-f1ec-46ca-a349-265766e0483e could not be found. Oct 05 02:49:55.859963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.859963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:55.859963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.859963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:55.859963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:55.859963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:55.859963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:49:55.859963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:49:55.859963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11e71f42-f1ec-46ca-a349-265766e0483e could not be found. Oct 05 02:49:55.859963 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.862227 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a1f0b682-c514-450f-856b-30478921f691 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Returning 404 to user: Instance 11e71f42-f1ec-46ca-a349-265766e0483e could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:49:55.864233 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a1f0b682-c514-450f-856b-30478921f691 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "DELETE /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e" status: 404 len: 111 microversion: 2.1 time: 0.058861 Oct 05 02:49:55.865497 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2282/4576] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:49:55 2022] DELETE /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:49:55.876170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-beaee04f-a105-4b92-95ad-75bfae2ed28d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:55.880235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-beaee04f-a105-4b92-95ad-75bfae2ed28d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 11e71f42-f1ec-46ca-a349-265766e0483e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:55.893348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-beaee04f-a105-4b92-95ad-75bfae2ed28d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:55.894335 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-beaee04f-a105-4b92-95ad-75bfae2ed28d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:55.895449 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-beaee04f-a105-4b92-95ad-75bfae2ed28d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:55.897238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-beaee04f-a105-4b92-95ad-75bfae2ed28d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:55.898063 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-beaee04f-a105-4b92-95ad-75bfae2ed28d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:55.898734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-beaee04f-a105-4b92-95ad-75bfae2ed28d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:55.957206 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-beaee04f-a105-4b92-95ad-75bfae2ed28d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] HTTP exception thrown: Instance 11e71f42-f1ec-46ca-a349-265766e0483e could not be found. Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-beaee04f-a105-4b92-95ad-75bfae2ed28d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Request method failure captured: Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e HTTP/1.1 Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO9sJgtvOLeTr4nOCD-vOqCqD1zJrAITPFW_zz4yiLyvIoTdHjuR4LJfH4xTHqVQhBEUV87uN4J6FQiHHhnatngFlbfTbJmS6cPceNKMN6UWu-_pNs3jdF8Cb5CgC-hxlx6u-5aGNVi9h5jLYyViTpDjMXgNyRvr5dJZFZQW2uKikA8 Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: d797c0058e8c456290081d056df79292 Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d797c0058e8c456290081d056df79292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d797c0058e8c456290081d056df79292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: d797c0058e8c456290081d056df79292 Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: ff170a5be8a04902b66e5f0e79fd47df Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 11e71f42-f1ec-46ca-a349-265766e0483e could not be found. Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '11e71f42-f1ec-46ca-a349-265766e0483e'} Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11e71f42-f1ec-46ca-a349-265766e0483e could not be found. Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11e71f42-f1ec-46ca-a349-265766e0483e could not be found. Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:55.962110 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.968408 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:55.968408 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:55.968408 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:55.968408 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:49:55.968408 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:49:55.968408 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11e71f42-f1ec-46ca-a349-265766e0483e could not be found. Oct 05 02:49:55.968408 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:55.968408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-beaee04f-a105-4b92-95ad-75bfae2ed28d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Returning 404 to user: Instance 11e71f42-f1ec-46ca-a349-265766e0483e could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:49:55.970909 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-beaee04f-a105-4b92-95ad-75bfae2ed28d tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e" status: 404 len: 111 microversion: 2.1 time: 0.100947 Oct 05 02:49:55.975984 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2295/4577] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:55 2022] GET /compute/v2.1/servers/11e71f42-f1ec-46ca-a349-265766e0483e => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:49:55.982196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-093fc300-9ffb-4e24-8dda-249330348c19 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:55.982749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-093fc300-9ffb-4e24-8dda-249330348c19 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: dc04e91e-b5d5-4583-9de3-b8a4271d4842] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:55.995548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-093fc300-9ffb-4e24-8dda-249330348c19 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:55.996054 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-093fc300-9ffb-4e24-8dda-249330348c19 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:56.000011 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-093fc300-9ffb-4e24-8dda-249330348c19 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:56.002590 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-093fc300-9ffb-4e24-8dda-249330348c19 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:56.003100 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-093fc300-9ffb-4e24-8dda-249330348c19 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:56.003543 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-093fc300-9ffb-4e24-8dda-249330348c19 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:56.047588 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-093fc300-9ffb-4e24-8dda-249330348c19 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] HTTP exception thrown: Instance dc04e91e-b5d5-4583-9de3-b8a4271d4842 could not be found. Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-093fc300-9ffb-4e24-8dda-249330348c19 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Request method failure captured: Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/dc04e91e-b5d5-4583-9de3-b8a4271d4842 HTTP/1.1 Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO9sJgtvOLeTr4nOCD-vOqCqD1zJrAITPFW_zz4yiLyvIoTdHjuR4LJfH4xTHqVQhBEUV87uN4J6FQiHHhnatngFlbfTbJmS6cPceNKMN6UWu-_pNs3jdF8Cb5CgC-hxlx6u-5aGNVi9h5jLYyViTpDjMXgNyRvr5dJZFZQW2uKikA8 Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: d797c0058e8c456290081d056df79292 Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d797c0058e8c456290081d056df79292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d797c0058e8c456290081d056df79292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: d797c0058e8c456290081d056df79292 Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: ff170a5be8a04902b66e5f0e79fd47df Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance dc04e91e-b5d5-4583-9de3-b8a4271d4842 could not be found. Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'dc04e91e-b5d5-4583-9de3-b8a4271d4842'} Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc04e91e-b5d5-4583-9de3-b8a4271d4842 could not be found. Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:49:56.049387 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:49:56.054825 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc04e91e-b5d5-4583-9de3-b8a4271d4842 could not be found. Oct 05 02:49:56.054825 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:56.054825 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:56.054825 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:56.054825 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:56.054825 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:56.054825 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:56.054825 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:49:56.054825 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:49:56.054825 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc04e91e-b5d5-4583-9de3-b8a4271d4842 could not be found. Oct 05 02:49:56.054825 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:49:56.054825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-093fc300-9ffb-4e24-8dda-249330348c19 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Returning 404 to user: Instance dc04e91e-b5d5-4583-9de3-b8a4271d4842 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:49:56.054825 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-093fc300-9ffb-4e24-8dda-249330348c19 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dc04e91e-b5d5-4583-9de3-b8a4271d4842" status: 404 len: 111 microversion: 2.1 time: 0.073616 Oct 05 02:49:56.054825 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2283/4578] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:49:55 2022] DELETE /compute/v2.1/servers/dc04e91e-b5d5-4583-9de3-b8a4271d4842 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:49:56.063267 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-28477e44-c02d-41dd-b78d-8e49bec3e859 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:56.063982 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-28477e44-c02d-41dd-b78d-8e49bec3e859 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: dc04e91e-b5d5-4583-9de3-b8a4271d4842] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:56.074566 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:56.077501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28477e44-c02d-41dd-b78d-8e49bec3e859 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:56.078915 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28477e44-c02d-41dd-b78d-8e49bec3e859 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:56.079383 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28477e44-c02d-41dd-b78d-8e49bec3e859 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:56.081384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28477e44-c02d-41dd-b78d-8e49bec3e859 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:56.081860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28477e44-c02d-41dd-b78d-8e49bec3e859 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:56.082300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28477e44-c02d-41dd-b78d-8e49bec3e859 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:56.130846 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-28477e44-c02d-41dd-b78d-8e49bec3e859 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] HTTP exception thrown: Instance dc04e91e-b5d5-4583-9de3-b8a4271d4842 could not be found. Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-28477e44-c02d-41dd-b78d-8e49bec3e859 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Request method failure captured: Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/dc04e91e-b5d5-4583-9de3-b8a4271d4842 HTTP/1.1 Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO9sJgtvOLeTr4nOCD-vOqCqD1zJrAITPFW_zz4yiLyvIoTdHjuR4LJfH4xTHqVQhBEUV87uN4J6FQiHHhnatngFlbfTbJmS6cPceNKMN6UWu-_pNs3jdF8Cb5CgC-hxlx6u-5aGNVi9h5jLYyViTpDjMXgNyRvr5dJZFZQW2uKikA8 Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: d797c0058e8c456290081d056df79292 Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d797c0058e8c456290081d056df79292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d797c0058e8c456290081d056df79292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: d797c0058e8c456290081d056df79292 Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: ff170a5be8a04902b66e5f0e79fd47df Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance dc04e91e-b5d5-4583-9de3-b8a4271d4842 could not be found. Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'dc04e91e-b5d5-4583-9de3-b8a4271d4842'} Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc04e91e-b5d5-4583-9de3-b8a4271d4842 could not be found. Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc04e91e-b5d5-4583-9de3-b8a4271d4842 could not be found. Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:49:56.135151 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:56.139964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:49:56.139964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:49:56.139964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:49:56.139964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:49:56.139964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:49:56.139964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc04e91e-b5d5-4583-9de3-b8a4271d4842 could not be found. Oct 05 02:49:56.139964 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:49:56.143273 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-28477e44-c02d-41dd-b78d-8e49bec3e859 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Returning 404 to user: Instance dc04e91e-b5d5-4583-9de3-b8a4271d4842 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:49:56.147660 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-28477e44-c02d-41dd-b78d-8e49bec3e859 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/dc04e91e-b5d5-4583-9de3-b8a4271d4842" status: 404 len: 111 microversion: 2.1 time: 0.088339 Oct 05 02:49:56.149654 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2296/4579] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:56 2022] GET /compute/v2.1/servers/dc04e91e-b5d5-4583-9de3-b8a4271d4842 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:49:56.559251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-99153524-9a50-43e0-90e5-23d5c35874b8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:56.559893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-99153524-9a50-43e0-90e5-23d5c35874b8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:56.586301 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99153524-9a50-43e0-90e5-23d5c35874b8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:56.586829 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99153524-9a50-43e0-90e5-23d5c35874b8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:56.587319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99153524-9a50-43e0-90e5-23d5c35874b8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:56.588284 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99153524-9a50-43e0-90e5-23d5c35874b8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:56.596850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99153524-9a50-43e0-90e5-23d5c35874b8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:56.599549 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99153524-9a50-43e0-90e5-23d5c35874b8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:56.775675 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-99153524-9a50-43e0-90e5-23d5c35874b8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:56.788054 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-99153524-9a50-43e0-90e5-23d5c35874b8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1272 microversion: 2.1 time: 0.235583 Oct 05 02:49:56.789201 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2284/4580] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:56 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1272 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:57.820518 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-521a7b41-c53c-4b58-beb1-a4243a38b3a2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:57.821236 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-521a7b41-c53c-4b58-beb1-a4243a38b3a2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:57.837166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-521a7b41-c53c-4b58-beb1-a4243a38b3a2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:57.838215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-521a7b41-c53c-4b58-beb1-a4243a38b3a2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:57.838897 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-521a7b41-c53c-4b58-beb1-a4243a38b3a2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:57.840091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-521a7b41-c53c-4b58-beb1-a4243a38b3a2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:57.841117 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-521a7b41-c53c-4b58-beb1-a4243a38b3a2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:57.841973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-521a7b41-c53c-4b58-beb1-a4243a38b3a2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:58.300728 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-521a7b41-c53c-4b58-beb1-a4243a38b3a2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:49:58.317645 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-521a7b41-c53c-4b58-beb1-a4243a38b3a2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1272 microversion: 2.1 time: 0.501698 Oct 05 02:49:58.318651 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2297/4581] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:57 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1272 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:49:59.349652 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-965e16e8-27de-4a6c-99e1-85e4305d1c78 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:49:59.350282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-965e16e8-27de-4a6c-99e1-85e4305d1c78 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:49:59.369725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-965e16e8-27de-4a6c-99e1-85e4305d1c78 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:59.372755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-965e16e8-27de-4a6c-99e1-85e4305d1c78 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:59.373716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-965e16e8-27de-4a6c-99e1-85e4305d1c78 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:49:59.374673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-965e16e8-27de-4a6c-99e1-85e4305d1c78 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:49:59.377495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-965e16e8-27de-4a6c-99e1-85e4305d1c78 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:49:59.379415 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-965e16e8-27de-4a6c-99e1-85e4305d1c78 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:00.684229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-965e16e8-27de-4a6c-99e1-85e4305d1c78 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:00.692429 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-965e16e8-27de-4a6c-99e1-85e4305d1c78 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1314 microversion: 2.1 time: 1.348841 Oct 05 02:50:00.705317 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2285/4582] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:49:59 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1314 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:01.638252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-4ecaa130-b908-49b1-9e74-3d2f914a9886 req-e7e9e828-109f-4520-ba0e-3e89ba6ffde4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0486ad56-c00a-45ca-b8b6-932ca38690b3", "tag": "d4c9cced-e19b-4c63-ae11-305eee49cbf7"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:50:01.668591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4ecaa130-b908-49b1-9e74-3d2f914a9886 req-e7e9e828-109f-4520-ba0e-3e89ba6ffde4 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:01.671820 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4ecaa130-b908-49b1-9e74-3d2f914a9886 req-e7e9e828-109f-4520-ba0e-3e89ba6ffde4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:01.674628 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4ecaa130-b908-49b1-9e74-3d2f914a9886 req-e7e9e828-109f-4520-ba0e-3e89ba6ffde4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:01.742535 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-4ecaa130-b908-49b1-9e74-3d2f914a9886 req-e7e9e828-109f-4520-ba0e-3e89ba6ffde4 service nova] Creating event network-changed:d4c9cced-e19b-4c63-ae11-305eee49cbf7 for instance 0486ad56-c00a-45ca-b8b6-932ca38690b3 on n-h2-858272-3 Oct 05 02:50:01.755402 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-4ecaa130-b908-49b1-9e74-3d2f914a9886 req-e7e9e828-109f-4520-ba0e-3e89ba6ffde4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124480 Oct 05 02:50:01.756556 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2286/4583] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:50:01.778133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-41bc8c00-cc05-42a9-a272-b3e5d28d97d0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:01.780870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-41bc8c00-cc05-42a9-a272-b3e5d28d97d0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:01.804521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41bc8c00-cc05-42a9-a272-b3e5d28d97d0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:01.805467 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41bc8c00-cc05-42a9-a272-b3e5d28d97d0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:01.806232 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41bc8c00-cc05-42a9-a272-b3e5d28d97d0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:01.807356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41bc8c00-cc05-42a9-a272-b3e5d28d97d0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:01.812446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41bc8c00-cc05-42a9-a272-b3e5d28d97d0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:01.813353 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41bc8c00-cc05-42a9-a272-b3e5d28d97d0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:01.865989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d241bf67-032f-43bf-a747-865b60a26a54 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-796827527", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "9e168ef8-8336-490a-84b5-6c327dfa8d00"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:50:02.038228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-d241bf67-032f-43bf-a747-865b60a26a54 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] validate_networks() for [('9e168ef8-8336-490a-84b5-6c327dfa8d00', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:50:02.675109 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-41bc8c00-cc05-42a9-a272-b3e5d28d97d0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:02.694978 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-41bc8c00-cc05-42a9-a272-b3e5d28d97d0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1314 microversion: 2.1 time: 0.934660 Oct 05 02:50:02.696186 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2287/4584] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:01 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1314 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:02.701767 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-96bbe617-fdbe-41ee-8c0c-98e8e49e40fc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:02.702600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-96bbe617-fdbe-41ee-8c0c-98e8e49e40fc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7517582f-12a1-4f22-bfb9-0690938cafd0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:02.708516 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:02.710282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96bbe617-fdbe-41ee-8c0c-98e8e49e40fc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:02.710998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96bbe617-fdbe-41ee-8c0c-98e8e49e40fc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:02.711800 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96bbe617-fdbe-41ee-8c0c-98e8e49e40fc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:02.712809 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96bbe617-fdbe-41ee-8c0c-98e8e49e40fc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:02.713774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96bbe617-fdbe-41ee-8c0c-98e8e49e40fc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:02.714625 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96bbe617-fdbe-41ee-8c0c-98e8e49e40fc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:02.756804 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-96bbe617-fdbe-41ee-8c0c-98e8e49e40fc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] HTTP exception thrown: Instance 7517582f-12a1-4f22-bfb9-0690938cafd0 could not be found. Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-96bbe617-fdbe-41ee-8c0c-98e8e49e40fc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Request method failure captured: Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0 HTTP/1.1 Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO9sJgtvOLeTr4nOCD-vOqCqD1zJrAITPFW_zz4yiLyvIoTdHjuR4LJfH4xTHqVQhBEUV87uN4J6FQiHHhnatngFlbfTbJmS6cPceNKMN6UWu-_pNs3jdF8Cb5CgC-hxlx6u-5aGNVi9h5jLYyViTpDjMXgNyRvr5dJZFZQW2uKikA8 Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: d797c0058e8c456290081d056df79292 Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d797c0058e8c456290081d056df79292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d797c0058e8c456290081d056df79292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: d797c0058e8c456290081d056df79292 Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: ff170a5be8a04902b66e5f0e79fd47df Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 7517582f-12a1-4f22-bfb9-0690938cafd0 could not be found. Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '7517582f-12a1-4f22-bfb9-0690938cafd0'} Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7517582f-12a1-4f22-bfb9-0690938cafd0 could not be found. Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:50:02.761277 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:50:02.766436 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7517582f-12a1-4f22-bfb9-0690938cafd0 could not be found. Oct 05 02:50:02.766436 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:50:02.766436 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:50:02.766436 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:50:02.766436 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:50:02.766436 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:50:02.766436 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:50:02.766436 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:50:02.766436 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:50:02.766436 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7517582f-12a1-4f22-bfb9-0690938cafd0 could not be found. Oct 05 02:50:02.766436 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:50:02.789611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-96bbe617-fdbe-41ee-8c0c-98e8e49e40fc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Returning 404 to user: Instance 7517582f-12a1-4f22-bfb9-0690938cafd0 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:50:02.794711 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-96bbe617-fdbe-41ee-8c0c-98e8e49e40fc tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0" status: 404 len: 111 microversion: 2.1 time: 0.095068 Oct 05 02:50:02.796378 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2288/4585] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:50:02 2022] DELETE /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:50:02.818890 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-887d79f9-4aeb-48d5-925d-af16861e4e7c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:02.819922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-887d79f9-4aeb-48d5-925d-af16861e4e7c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 7517582f-12a1-4f22-bfb9-0690938cafd0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:02.864361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-887d79f9-4aeb-48d5-925d-af16861e4e7c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:02.868503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-887d79f9-4aeb-48d5-925d-af16861e4e7c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:02.877204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-887d79f9-4aeb-48d5-925d-af16861e4e7c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:02.893649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-887d79f9-4aeb-48d5-925d-af16861e4e7c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:02.898084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-887d79f9-4aeb-48d5-925d-af16861e4e7c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:02.902032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-887d79f9-4aeb-48d5-925d-af16861e4e7c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:02.970633 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-887d79f9-4aeb-48d5-925d-af16861e4e7c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] HTTP exception thrown: Instance 7517582f-12a1-4f22-bfb9-0690938cafd0 could not be found. Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-887d79f9-4aeb-48d5-925d-af16861e4e7c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Request method failure captured: Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0 HTTP/1.1 Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO9sJgtvOLeTr4nOCD-vOqCqD1zJrAITPFW_zz4yiLyvIoTdHjuR4LJfH4xTHqVQhBEUV87uN4J6FQiHHhnatngFlbfTbJmS6cPceNKMN6UWu-_pNs3jdF8Cb5CgC-hxlx6u-5aGNVi9h5jLYyViTpDjMXgNyRvr5dJZFZQW2uKikA8 Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: d797c0058e8c456290081d056df79292 Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d797c0058e8c456290081d056df79292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d797c0058e8c456290081d056df79292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: d797c0058e8c456290081d056df79292 Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: ff170a5be8a04902b66e5f0e79fd47df Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 7517582f-12a1-4f22-bfb9-0690938cafd0 could not be found. Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '7517582f-12a1-4f22-bfb9-0690938cafd0'} Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7517582f-12a1-4f22-bfb9-0690938cafd0 could not be found. Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7517582f-12a1-4f22-bfb9-0690938cafd0 could not be found. Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:50:02.992995 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:50:02.998231 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:50:02.998231 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:50:02.998231 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:50:02.998231 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:50:02.998231 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:50:02.998231 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7517582f-12a1-4f22-bfb9-0690938cafd0 could not be found. Oct 05 02:50:02.998231 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:50:02.998231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-887d79f9-4aeb-48d5-925d-af16861e4e7c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Returning 404 to user: Instance 7517582f-12a1-4f22-bfb9-0690938cafd0 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:50:02.998231 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-887d79f9-4aeb-48d5-925d-af16861e4e7c tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0" status: 404 len: 111 microversion: 2.1 time: 0.193526 Oct 05 02:50:02.998231 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2289/4586] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:02 2022] GET /compute/v2.1/servers/7517582f-12a1-4f22-bfb9-0690938cafd0 => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:50:03.043347 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1f984eb9-c9a6-49bb-a767-614b134277f7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:03.043991 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1f984eb9-c9a6-49bb-a767-614b134277f7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 982726d5-6806-4714-a8c0-551ce0243b54] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:03.069585 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f984eb9-c9a6-49bb-a767-614b134277f7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:03.070009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f984eb9-c9a6-49bb-a767-614b134277f7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:03.070451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f984eb9-c9a6-49bb-a767-614b134277f7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:03.071168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f984eb9-c9a6-49bb-a767-614b134277f7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:03.072309 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f984eb9-c9a6-49bb-a767-614b134277f7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:03.106292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f984eb9-c9a6-49bb-a767-614b134277f7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:03.146062 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-1f984eb9-c9a6-49bb-a767-614b134277f7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] HTTP exception thrown: Instance 982726d5-6806-4714-a8c0-551ce0243b54 could not be found. Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1f984eb9-c9a6-49bb-a767-614b134277f7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Request method failure captured: Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54 HTTP/1.1 Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO9sJgtvOLeTr4nOCD-vOqCqD1zJrAITPFW_zz4yiLyvIoTdHjuR4LJfH4xTHqVQhBEUV87uN4J6FQiHHhnatngFlbfTbJmS6cPceNKMN6UWu-_pNs3jdF8Cb5CgC-hxlx6u-5aGNVi9h5jLYyViTpDjMXgNyRvr5dJZFZQW2uKikA8 Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: d797c0058e8c456290081d056df79292 Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d797c0058e8c456290081d056df79292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d797c0058e8c456290081d056df79292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: d797c0058e8c456290081d056df79292 Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: ff170a5be8a04902b66e5f0e79fd47df Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 982726d5-6806-4714-a8c0-551ce0243b54 could not be found. Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '982726d5-6806-4714-a8c0-551ce0243b54'} Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 982726d5-6806-4714-a8c0-551ce0243b54 could not be found. Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:50:03.147654 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:50:03.152752 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 982726d5-6806-4714-a8c0-551ce0243b54 could not be found. Oct 05 02:50:03.152752 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:50:03.152752 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:50:03.152752 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:50:03.152752 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:50:03.152752 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:50:03.152752 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:50:03.152752 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:50:03.152752 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:50:03.152752 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 982726d5-6806-4714-a8c0-551ce0243b54 could not be found. Oct 05 02:50:03.152752 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:50:03.160682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1f984eb9-c9a6-49bb-a767-614b134277f7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Returning 404 to user: Instance 982726d5-6806-4714-a8c0-551ce0243b54 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:50:03.166830 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1f984eb9-c9a6-49bb-a767-614b134277f7 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "DELETE /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54" status: 404 len: 111 microversion: 2.1 time: 0.161608 Oct 05 02:50:03.176758 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2290/4587] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:50:03 2022] DELETE /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54 => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:50:03.193200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4e032782-0480-484d-855d-feba6f8ab109 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:03.194366 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4e032782-0480-484d-855d-feba6f8ab109 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] [instance: 982726d5-6806-4714-a8c0-551ce0243b54] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:03.222233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e032782-0480-484d-855d-feba6f8ab109 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:03.222233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e032782-0480-484d-855d-feba6f8ab109 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:03.222233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e032782-0480-484d-855d-feba6f8ab109 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:03.222233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e032782-0480-484d-855d-feba6f8ab109 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:03.222601 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e032782-0480-484d-855d-feba6f8ab109 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:03.227443 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e032782-0480-484d-855d-feba6f8ab109 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:03.236747 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:03.294080 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-4e032782-0480-484d-855d-feba6f8ab109 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] HTTP exception thrown: Instance 982726d5-6806-4714-a8c0-551ce0243b54 could not be found. Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4e032782-0480-484d-855d-feba6f8ab109 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Request method failure captured: Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54 HTTP/1.1 Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO9sJgtvOLeTr4nOCD-vOqCqD1zJrAITPFW_zz4yiLyvIoTdHjuR4LJfH4xTHqVQhBEUV87uN4J6FQiHHhnatngFlbfTbJmS6cPceNKMN6UWu-_pNs3jdF8Cb5CgC-hxlx6u-5aGNVi9h5jLYyViTpDjMXgNyRvr5dJZFZQW2uKikA8 Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: d797c0058e8c456290081d056df79292 Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d797c0058e8c456290081d056df79292"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d797c0058e8c456290081d056df79292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d797c0058e8c456290081d056df79292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: d797c0058e8c456290081d056df79292 Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-DeleteServersTestJSON-1775354536 Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: ff170a5be8a04902b66e5f0e79fd47df Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-DeleteServersTestJSON-1775354536-project Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 982726d5-6806-4714-a8c0-551ce0243b54 could not be found. Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '982726d5-6806-4714-a8c0-551ce0243b54'} Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 982726d5-6806-4714-a8c0-551ce0243b54 could not be found. Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 982726d5-6806-4714-a8c0-551ce0243b54 could not be found. Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:50:03.295860 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:50:03.300594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:50:03.300594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:50:03.300594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:50:03.300594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:50:03.300594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:50:03.300594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 982726d5-6806-4714-a8c0-551ce0243b54 could not be found. Oct 05 02:50:03.300594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:50:03.302380 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4e032782-0480-484d-855d-feba6f8ab109 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] Returning 404 to user: Instance 982726d5-6806-4714-a8c0-551ce0243b54 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:50:03.303433 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4e032782-0480-484d-855d-feba6f8ab109 tempest-DeleteServersTestJSON-1775354536 tempest-DeleteServersTestJSON-1775354536-project] 10.222.0.16 "GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54" status: 404 len: 111 microversion: 2.1 time: 0.122356 Oct 05 02:50:03.304484 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2291/4588] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:03 2022] GET /compute/v2.1/servers/982726d5-6806-4714-a8c0-551ce0243b54 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:50:03.719656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8cefb717-d707-4ec6-9d35-e80a21a41fa3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:03.720535 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8cefb717-d707-4ec6-9d35-e80a21a41fa3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:03.721843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:03.732861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cefb717-d707-4ec6-9d35-e80a21a41fa3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:03.737694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cefb717-d707-4ec6-9d35-e80a21a41fa3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:03.738408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cefb717-d707-4ec6-9d35-e80a21a41fa3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:03.739350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cefb717-d707-4ec6-9d35-e80a21a41fa3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:03.740010 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cefb717-d707-4ec6-9d35-e80a21a41fa3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:03.742164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cefb717-d707-4ec6-9d35-e80a21a41fa3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:04.150712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=8 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:04.257519 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8cefb717-d707-4ec6-9d35-e80a21a41fa3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:04.271923 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8cefb717-d707-4ec6-9d35-e80a21a41fa3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1314 microversion: 2.1 time: 0.550546 Oct 05 02:50:04.292252 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2292/4589] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:03 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1314 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:50:04.491872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-d241bf67-032f-43bf-a747-865b60a26a54 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:50:04.492400 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-d241bf67-032f-43bf-a747-865b60a26a54 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:50:04.492763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-d241bf67-032f-43bf-a747-865b60a26a54 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:50:04.493205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-d241bf67-032f-43bf-a747-865b60a26a54 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:50:04.494232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-d241bf67-032f-43bf-a747-865b60a26a54 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:50:04.532588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d241bf67-032f-43bf-a747-865b60a26a54 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:04.536022 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d241bf67-032f-43bf-a747-865b60a26a54 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:04.540131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d241bf67-032f-43bf-a747-865b60a26a54 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:04.546826 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d241bf67-032f-43bf-a747-865b60a26a54 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:04.556182 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d241bf67-032f-43bf-a747-865b60a26a54 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:04.557267 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d241bf67-032f-43bf-a747-865b60a26a54 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:04.626490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-d241bf67-032f-43bf-a747-865b60a26a54 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Getting quotas for project 80fc825cf1534094bab87cebb75a7d2e. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:50:04.646413 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-d241bf67-032f-43bf-a747-865b60a26a54 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Getting quotas for user 7cee670a08f94ba7aa95dbb46ef2eb45 and project 80fc825cf1534094bab87cebb75a7d2e. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:50:04.688530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d241bf67-032f-43bf-a747-865b60a26a54 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:50:04.690977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d241bf67-032f-43bf-a747-865b60a26a54 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] [instance: a881c2ba-9019-439c-a55e-80b630ef27af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:50:04.794462 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d241bf67-032f-43bf-a747-865b60a26a54 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.427334 Oct 05 02:50:04.801577 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2298/4590] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:50:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 3434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:50:04.810054 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-23fc09e3-8703-4745-9c93-b2ddb052ce89 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:04.810839 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-23fc09e3-8703-4745-9c93-b2ddb052ce89 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] [instance: a881c2ba-9019-439c-a55e-80b630ef27af] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:05.027520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-23fc09e3-8703-4745-9c93-b2ddb052ce89 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee670a08f94ba7aa95dbb46ef2eb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fc825cf1534094bab87cebb75a7d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:05.038168 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-23fc09e3-8703-4745-9c93-b2ddb052ce89 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] 10.222.0.16 "GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af" status: 200 len: 1216 microversion: 2.1 time: 0.235155 Oct 05 02:50:05.043552 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2293/4591] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:04 2022] GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af => generated 1216 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:05.300465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fc93fc31-a913-4a91-9b3a-9323ba28c3d0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:05.301426 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fc93fc31-a913-4a91-9b3a-9323ba28c3d0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:05.316735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc93fc31-a913-4a91-9b3a-9323ba28c3d0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:05.317699 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc93fc31-a913-4a91-9b3a-9323ba28c3d0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:05.319152 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc93fc31-a913-4a91-9b3a-9323ba28c3d0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:05.321442 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc93fc31-a913-4a91-9b3a-9323ba28c3d0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:05.321884 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc93fc31-a913-4a91-9b3a-9323ba28c3d0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:05.322325 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc93fc31-a913-4a91-9b3a-9323ba28c3d0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:05.528463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fc93fc31-a913-4a91-9b3a-9323ba28c3d0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:05.540016 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fc93fc31-a913-4a91-9b3a-9323ba28c3d0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1314 microversion: 2.1 time: 0.244069 Oct 05 02:50:05.554158 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2299/4592] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:05 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:06.069815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e9d898d0-60fc-45fd-aa68-b2fd4b59a04b tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:06.070628 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e9d898d0-60fc-45fd-aa68-b2fd4b59a04b tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] [instance: a881c2ba-9019-439c-a55e-80b630ef27af] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:06.103774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e9d898d0-60fc-45fd-aa68-b2fd4b59a04b tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:06.106332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e9d898d0-60fc-45fd-aa68-b2fd4b59a04b tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:06.108293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e9d898d0-60fc-45fd-aa68-b2fd4b59a04b tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:06.110536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e9d898d0-60fc-45fd-aa68-b2fd4b59a04b tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:06.111967 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e9d898d0-60fc-45fd-aa68-b2fd4b59a04b tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:06.114179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e9d898d0-60fc-45fd-aa68-b2fd4b59a04b tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:06.293993 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e9d898d0-60fc-45fd-aa68-b2fd4b59a04b tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee670a08f94ba7aa95dbb46ef2eb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fc825cf1534094bab87cebb75a7d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:06.313163 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e9d898d0-60fc-45fd-aa68-b2fd4b59a04b tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] 10.222.0.16 "GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af" status: 200 len: 1212 microversion: 2.1 time: 0.248676 Oct 05 02:50:06.329709 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2294/4593] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:06 2022] GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af => generated 1212 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:50:06.568725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ec4090d2-265f-4566-b143-e90851a51da3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:06.569508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ec4090d2-265f-4566-b143-e90851a51da3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:06.593414 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec4090d2-265f-4566-b143-e90851a51da3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:06.593955 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec4090d2-265f-4566-b143-e90851a51da3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:06.594405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec4090d2-265f-4566-b143-e90851a51da3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:06.595144 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec4090d2-265f-4566-b143-e90851a51da3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:06.595612 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec4090d2-265f-4566-b143-e90851a51da3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:06.596046 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec4090d2-265f-4566-b143-e90851a51da3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:07.105194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ec4090d2-265f-4566-b143-e90851a51da3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:07.125963 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ec4090d2-265f-4566-b143-e90851a51da3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1314 microversion: 2.1 time: 0.563785 Oct 05 02:50:07.141459 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2300/4594] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:06 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1314 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:07.353920 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ccddd71c-abc8-416b-bd49-bfda5340f690 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:07.354619 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ccddd71c-abc8-416b-bd49-bfda5340f690 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] [instance: a881c2ba-9019-439c-a55e-80b630ef27af] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:07.373562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ccddd71c-abc8-416b-bd49-bfda5340f690 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:07.384940 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ccddd71c-abc8-416b-bd49-bfda5340f690 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:07.386608 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ccddd71c-abc8-416b-bd49-bfda5340f690 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:07.387471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ccddd71c-abc8-416b-bd49-bfda5340f690 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:07.388418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ccddd71c-abc8-416b-bd49-bfda5340f690 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:07.389171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ccddd71c-abc8-416b-bd49-bfda5340f690 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:07.605522 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ccddd71c-abc8-416b-bd49-bfda5340f690 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee670a08f94ba7aa95dbb46ef2eb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fc825cf1534094bab87cebb75a7d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:07.634945 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ccddd71c-abc8-416b-bd49-bfda5340f690 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] 10.222.0.16 "GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af" status: 200 len: 1268 microversion: 2.1 time: 0.285789 Oct 05 02:50:07.635610 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2295/4595] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:07 2022] GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af => generated 1268 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:08.155959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d01184a7-382b-422c-b4c3-90bf9d2458a4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:08.157283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d01184a7-382b-422c-b4c3-90bf9d2458a4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:08.175166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d01184a7-382b-422c-b4c3-90bf9d2458a4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:08.177183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d01184a7-382b-422c-b4c3-90bf9d2458a4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:08.178766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d01184a7-382b-422c-b4c3-90bf9d2458a4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:08.180212 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d01184a7-382b-422c-b4c3-90bf9d2458a4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:08.183956 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d01184a7-382b-422c-b4c3-90bf9d2458a4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:08.185332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d01184a7-382b-422c-b4c3-90bf9d2458a4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:08.661210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d01184a7-382b-422c-b4c3-90bf9d2458a4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:08.663438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4b996a4f-0232-4fe1-9b6d-d101e13b4fd9 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:08.664841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4b996a4f-0232-4fe1-9b6d-d101e13b4fd9 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] [instance: a881c2ba-9019-439c-a55e-80b630ef27af] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:08.680270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4b996a4f-0232-4fe1-9b6d-d101e13b4fd9 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:08.681592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4b996a4f-0232-4fe1-9b6d-d101e13b4fd9 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:08.684701 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4b996a4f-0232-4fe1-9b6d-d101e13b4fd9 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:08.686065 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4b996a4f-0232-4fe1-9b6d-d101e13b4fd9 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:08.686543 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4b996a4f-0232-4fe1-9b6d-d101e13b4fd9 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:08.686979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4b996a4f-0232-4fe1-9b6d-d101e13b4fd9 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:08.715022 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d01184a7-382b-422c-b4c3-90bf9d2458a4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1314 microversion: 2.1 time: 0.565190 Oct 05 02:50:08.728930 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2301/4596] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:08 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1314 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:09.741903 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f2448e01-3a31-4af8-936d-96a6545225f1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:09.742545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f2448e01-3a31-4af8-936d-96a6545225f1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:09.755031 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2448e01-3a31-4af8-936d-96a6545225f1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:09.755544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2448e01-3a31-4af8-936d-96a6545225f1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:09.756006 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2448e01-3a31-4af8-936d-96a6545225f1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:09.756717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2448e01-3a31-4af8-936d-96a6545225f1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:09.757210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2448e01-3a31-4af8-936d-96a6545225f1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:09.757640 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2448e01-3a31-4af8-936d-96a6545225f1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:09.784622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4b996a4f-0232-4fe1-9b6d-d101e13b4fd9 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee670a08f94ba7aa95dbb46ef2eb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fc825cf1534094bab87cebb75a7d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:09.804152 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4b996a4f-0232-4fe1-9b6d-d101e13b4fd9 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] 10.222.0.16 "GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af" status: 200 len: 1316 microversion: 2.1 time: 1.144931 Oct 05 02:50:09.827175 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2296/4597] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:08 2022] GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af => generated 1316 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:10.213920 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f2448e01-3a31-4af8-936d-96a6545225f1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:10.225846 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f2448e01-3a31-4af8-936d-96a6545225f1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1314 microversion: 2.1 time: 0.487596 Oct 05 02:50:10.227528 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2302/4598] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:09 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:50:10.833348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-456be51a-401f-4cca-b39d-870385724659 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:10.835108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-456be51a-401f-4cca-b39d-870385724659 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] [instance: a881c2ba-9019-439c-a55e-80b630ef27af] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:10.862389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-456be51a-401f-4cca-b39d-870385724659 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:10.862901 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-456be51a-401f-4cca-b39d-870385724659 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:10.864851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-456be51a-401f-4cca-b39d-870385724659 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:10.867387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-456be51a-401f-4cca-b39d-870385724659 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:10.867920 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-456be51a-401f-4cca-b39d-870385724659 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:10.869591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-456be51a-401f-4cca-b39d-870385724659 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:11.132282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-f4cc5ad1-4d10-496f-9f65-5249297c3d77 req-ba08491a-52b4-494f-a976-96f26c037539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0486ad56-c00a-45ca-b8b6-932ca38690b3", "name": "network-vif-plugged", "status": "completed", "tag": "d4c9cced-e19b-4c63-ae11-305eee49cbf7"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:50:11.157840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f4cc5ad1-4d10-496f-9f65-5249297c3d77 req-ba08491a-52b4-494f-a976-96f26c037539 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:11.158951 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f4cc5ad1-4d10-496f-9f65-5249297c3d77 req-ba08491a-52b4-494f-a976-96f26c037539 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:11.159980 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f4cc5ad1-4d10-496f-9f65-5249297c3d77 req-ba08491a-52b4-494f-a976-96f26c037539 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:11.199007 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-f4cc5ad1-4d10-496f-9f65-5249297c3d77 req-ba08491a-52b4-494f-a976-96f26c037539 service nova] Creating event network-vif-plugged:d4c9cced-e19b-4c63-ae11-305eee49cbf7 for instance 0486ad56-c00a-45ca-b8b6-932ca38690b3 on n-h2-858272-3 Oct 05 02:50:11.205566 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-f4cc5ad1-4d10-496f-9f65-5249297c3d77 req-ba08491a-52b4-494f-a976-96f26c037539 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076751 Oct 05 02:50:11.206828 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2303/4599] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:50:11.254992 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-550bd4cd-90bc-4ab4-8f96-50eace5cc302 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:11.255854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-550bd4cd-90bc-4ab4-8f96-50eace5cc302 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:11.291148 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-550bd4cd-90bc-4ab4-8f96-50eace5cc302 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:11.291578 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-550bd4cd-90bc-4ab4-8f96-50eace5cc302 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:11.296741 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-550bd4cd-90bc-4ab4-8f96-50eace5cc302 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:11.298409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-550bd4cd-90bc-4ab4-8f96-50eace5cc302 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:11.298903 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-550bd4cd-90bc-4ab4-8f96-50eace5cc302 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:11.299346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-550bd4cd-90bc-4ab4-8f96-50eace5cc302 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:11.308567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-456be51a-401f-4cca-b39d-870385724659 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee670a08f94ba7aa95dbb46ef2eb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fc825cf1534094bab87cebb75a7d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:11.325159 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-456be51a-401f-4cca-b39d-870385724659 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] 10.222.0.16 "GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af" status: 200 len: 1316 microversion: 2.1 time: 0.496290 Oct 05 02:50:11.325770 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2297/4600] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:10 2022] GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af => generated 1316 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:11.739873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-235fa8d6-bcc4-4878-bee7-a0225af8e90c req-0f2c75bc-c6b7-4223-a172-b943dc77051d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a881c2ba-9019-439c-a55e-80b630ef27af", "tag": "6d37a458-bd3b-43b5-a431-3e4ba261b153"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:50:11.756965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-235fa8d6-bcc4-4878-bee7-a0225af8e90c req-0f2c75bc-c6b7-4223-a172-b943dc77051d service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:11.769652 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-235fa8d6-bcc4-4878-bee7-a0225af8e90c req-0f2c75bc-c6b7-4223-a172-b943dc77051d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:11.770314 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-235fa8d6-bcc4-4878-bee7-a0225af8e90c req-0f2c75bc-c6b7-4223-a172-b943dc77051d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:11.792979 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-235fa8d6-bcc4-4878-bee7-a0225af8e90c req-0f2c75bc-c6b7-4223-a172-b943dc77051d service nova] Creating event network-changed:6d37a458-bd3b-43b5-a431-3e4ba261b153 for instance a881c2ba-9019-439c-a55e-80b630ef27af on n-h2-858272-3 Oct 05 02:50:11.809550 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-235fa8d6-bcc4-4878-bee7-a0225af8e90c req-0f2c75bc-c6b7-4223-a172-b943dc77051d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075328 Oct 05 02:50:11.810174 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2298/4601] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:50:11.875855 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-550bd4cd-90bc-4ab4-8f96-50eace5cc302 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:11.897409 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-550bd4cd-90bc-4ab4-8f96-50eace5cc302 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1314 microversion: 2.1 time: 0.647057 Oct 05 02:50:11.901232 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2304/4602] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:11 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1314 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:50:12.358891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c1c946ae-a102-4c16-a822-a6eb87d3fd9e tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:12.360943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c1c946ae-a102-4c16-a822-a6eb87d3fd9e tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] [instance: a881c2ba-9019-439c-a55e-80b630ef27af] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:12.385504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1c946ae-a102-4c16-a822-a6eb87d3fd9e tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:12.388128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1c946ae-a102-4c16-a822-a6eb87d3fd9e tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:12.389028 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1c946ae-a102-4c16-a822-a6eb87d3fd9e tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:12.390267 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1c946ae-a102-4c16-a822-a6eb87d3fd9e tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:12.390739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1c946ae-a102-4c16-a822-a6eb87d3fd9e tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:12.392133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1c946ae-a102-4c16-a822-a6eb87d3fd9e tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:12.949592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-64cbee7f-df7b-45a1-a4de-bb65261534c0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1846886259", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "919761f7-d47e-4772-8ed0-d3152e76dbc3"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:50:13.019665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c1c946ae-a102-4c16-a822-a6eb87d3fd9e tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee670a08f94ba7aa95dbb46ef2eb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fc825cf1534094bab87cebb75a7d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:13.040220 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c1c946ae-a102-4c16-a822-a6eb87d3fd9e tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] 10.222.0.16 "GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af" status: 200 len: 1316 microversion: 2.1 time: 0.690360 Oct 05 02:50:13.041205 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2305/4603] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:12 2022] GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af => generated 1316 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:13.074243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-44c89572-4bd0-4141-ac7c-f03f27045b04 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:13.077738 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-64cbee7f-df7b-45a1-a4de-bb65261534c0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] validate_networks() for [('919761f7-d47e-4772-8ed0-d3152e76dbc3', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:50:13.078035 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-44c89572-4bd0-4141-ac7c-f03f27045b04 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:13.099614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44c89572-4bd0-4141-ac7c-f03f27045b04 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:13.100392 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44c89572-4bd0-4141-ac7c-f03f27045b04 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:13.102825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44c89572-4bd0-4141-ac7c-f03f27045b04 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:13.105892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44c89572-4bd0-4141-ac7c-f03f27045b04 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:13.106714 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44c89572-4bd0-4141-ac7c-f03f27045b04 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:13.107335 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44c89572-4bd0-4141-ac7c-f03f27045b04 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:13.673856 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-44c89572-4bd0-4141-ac7c-f03f27045b04 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:13.684352 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-44c89572-4bd0-4141-ac7c-f03f27045b04 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1314 microversion: 2.1 time: 0.618120 Oct 05 02:50:13.685389 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2306/4604] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:13 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1314 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:14.069805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-420cc63a-7a91-49af-bc8a-643360520cc3 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:14.070613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-420cc63a-7a91-49af-bc8a-643360520cc3 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] [instance: a881c2ba-9019-439c-a55e-80b630ef27af] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:14.082800 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-420cc63a-7a91-49af-bc8a-643360520cc3 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:14.083408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-420cc63a-7a91-49af-bc8a-643360520cc3 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:14.083960 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-420cc63a-7a91-49af-bc8a-643360520cc3 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:14.084962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-420cc63a-7a91-49af-bc8a-643360520cc3 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:14.089073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-420cc63a-7a91-49af-bc8a-643360520cc3 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:14.089775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-420cc63a-7a91-49af-bc8a-643360520cc3 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:14.455323 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-420cc63a-7a91-49af-bc8a-643360520cc3 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee670a08f94ba7aa95dbb46ef2eb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fc825cf1534094bab87cebb75a7d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:14.473359 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-420cc63a-7a91-49af-bc8a-643360520cc3 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] 10.222.0.16 "GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af" status: 200 len: 1316 microversion: 2.1 time: 0.404618 Oct 05 02:50:14.474056 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2307/4605] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:14 2022] GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af => generated 1316 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:50:14.561229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-64cbee7f-df7b-45a1-a4de-bb65261534c0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:50:14.562765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-64cbee7f-df7b-45a1-a4de-bb65261534c0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:50:14.563576 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-64cbee7f-df7b-45a1-a4de-bb65261534c0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:50:14.564477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-64cbee7f-df7b-45a1-a4de-bb65261534c0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:50:14.565281 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-64cbee7f-df7b-45a1-a4de-bb65261534c0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:50:14.580820 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64cbee7f-df7b-45a1-a4de-bb65261534c0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:14.581954 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64cbee7f-df7b-45a1-a4de-bb65261534c0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:14.583408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64cbee7f-df7b-45a1-a4de-bb65261534c0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:14.584701 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64cbee7f-df7b-45a1-a4de-bb65261534c0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:14.585559 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64cbee7f-df7b-45a1-a4de-bb65261534c0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:14.586520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64cbee7f-df7b-45a1-a4de-bb65261534c0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:14.683636 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-64cbee7f-df7b-45a1-a4de-bb65261534c0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Getting quotas for project 4a47a087cd7b4713a6ad1391eda4f4a3. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:50:14.703733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-64cbee7f-df7b-45a1-a4de-bb65261534c0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Getting quotas for user effef5f66f5644fab19ecd3f862d7daa and project 4a47a087cd7b4713a6ad1391eda4f4a3. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:50:14.718371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-69435c88-6db7-4e0f-a793-970744d93afa tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:14.719077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-69435c88-6db7-4e0f-a793-970744d93afa tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:14.730790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:14.736688 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:14.739861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69435c88-6db7-4e0f-a793-970744d93afa tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:14.740550 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69435c88-6db7-4e0f-a793-970744d93afa tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:14.743057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69435c88-6db7-4e0f-a793-970744d93afa tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:14.745080 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69435c88-6db7-4e0f-a793-970744d93afa tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:14.748072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-64cbee7f-df7b-45a1-a4de-bb65261534c0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:50:14.749593 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69435c88-6db7-4e0f-a793-970744d93afa tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:14.752046 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-64cbee7f-df7b-45a1-a4de-bb65261534c0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] [instance: 4ab7776a-b71b-477a-b5ee-8ba797df9d1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:50:14.753354 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69435c88-6db7-4e0f-a793-970744d93afa tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:14.863396 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-64cbee7f-df7b-45a1-a4de-bb65261534c0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.645003 Oct 05 02:50:14.873865 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2299/4606] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 5 02:50:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2656 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 05 02:50:14.879828 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3ff77191-f18d-4a52-bdfa-3a4903fd0ee2 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:14.880782 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3ff77191-f18d-4a52-bdfa-3a4903fd0ee2 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] [instance: 4ab7776a-b71b-477a-b5ee-8ba797df9d1a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:15.043149 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3ff77191-f18d-4a52-bdfa-3a4903fd0ee2 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:15.058940 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3ff77191-f18d-4a52-bdfa-3a4903fd0ee2 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:15.060494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3ff77191-f18d-4a52-bdfa-3a4903fd0ee2 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:15.065763 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3ff77191-f18d-4a52-bdfa-3a4903fd0ee2 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a" status: 200 len: 1262 microversion: 2.26 time: 0.189339 Oct 05 02:50:15.077375 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2300/4607] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:50:14 2022] GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a => generated 1262 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:50:15.162009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-69435c88-6db7-4e0f-a793-970744d93afa tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:15.173153 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-69435c88-6db7-4e0f-a793-970744d93afa tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1501 microversion: 2.1 time: 0.459188 Oct 05 02:50:15.188009 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2308/4608] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:14 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1501 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:15.206391 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-efaae6fa-b0a9-4c55-89f3-5df0260d42c4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:50:15.208067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-efaae6fa-b0a9-4c55-89f3-5df0260d42c4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:15.226873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-efaae6fa-b0a9-4c55-89f3-5df0260d42c4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:15.228652 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-efaae6fa-b0a9-4c55-89f3-5df0260d42c4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:15.230946 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-efaae6fa-b0a9-4c55-89f3-5df0260d42c4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:15.232111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-efaae6fa-b0a9-4c55-89f3-5df0260d42c4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:15.233755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-efaae6fa-b0a9-4c55-89f3-5df0260d42c4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:15.235604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-efaae6fa-b0a9-4c55-89f3-5df0260d42c4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:15.417980 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-efaae6fa-b0a9-4c55-89f3-5df0260d42c4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3/action" status: 202 len: 0 microversion: 2.1 time: 0.222511 Oct 05 02:50:15.419417 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2301/4609] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:50:15 2022] POST /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:50:15.429441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-82d9e29d-8962-4a60-9455-cc44a96c0113 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:15.430702 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-82d9e29d-8962-4a60-9455-cc44a96c0113 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:15.448133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82d9e29d-8962-4a60-9455-cc44a96c0113 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:15.452296 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82d9e29d-8962-4a60-9455-cc44a96c0113 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:15.452893 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82d9e29d-8962-4a60-9455-cc44a96c0113 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:15.458151 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82d9e29d-8962-4a60-9455-cc44a96c0113 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:15.459068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82d9e29d-8962-4a60-9455-cc44a96c0113 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:15.460266 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82d9e29d-8962-4a60-9455-cc44a96c0113 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:15.517059 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fa17bfa0-bc5f-429b-ada6-fc0ad83c020a tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:15.517680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fa17bfa0-bc5f-429b-ada6-fc0ad83c020a tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] [instance: a881c2ba-9019-439c-a55e-80b630ef27af] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:15.532070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa17bfa0-bc5f-429b-ada6-fc0ad83c020a tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:15.534487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa17bfa0-bc5f-429b-ada6-fc0ad83c020a tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:15.535620 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa17bfa0-bc5f-429b-ada6-fc0ad83c020a tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:15.537243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa17bfa0-bc5f-429b-ada6-fc0ad83c020a tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:15.538156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa17bfa0-bc5f-429b-ada6-fc0ad83c020a tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:15.539607 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa17bfa0-bc5f-429b-ada6-fc0ad83c020a tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:15.973661 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-82d9e29d-8962-4a60-9455-cc44a96c0113 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:15.994253 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-82d9e29d-8962-4a60-9455-cc44a96c0113 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1506 microversion: 2.1 time: 0.564696 Oct 05 02:50:15.995054 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2309/4610] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:15 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1506 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:16.100931 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e9d0b499-828a-4886-b092-1b0975fca5b2 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:16.101666 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e9d0b499-828a-4886-b092-1b0975fca5b2 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] [instance: 4ab7776a-b71b-477a-b5ee-8ba797df9d1a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:16.107165 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fa17bfa0-bc5f-429b-ada6-fc0ad83c020a tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee670a08f94ba7aa95dbb46ef2eb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fc825cf1534094bab87cebb75a7d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:16.116306 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e9d0b499-828a-4886-b092-1b0975fca5b2 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:16.116985 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fa17bfa0-bc5f-429b-ada6-fc0ad83c020a tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] 10.222.0.16 "GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af" status: 200 len: 1316 microversion: 2.1 time: 0.609050 Oct 05 02:50:16.120151 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e9d0b499-828a-4886-b092-1b0975fca5b2 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:16.120615 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2302/4611] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:15 2022] GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af => generated 1316 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:16.129989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e9d0b499-828a-4886-b092-1b0975fca5b2 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:16.130902 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e9d0b499-828a-4886-b092-1b0975fca5b2 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:16.134551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e9d0b499-828a-4886-b092-1b0975fca5b2 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:16.135000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e9d0b499-828a-4886-b092-1b0975fca5b2 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:16.313014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e9d0b499-828a-4886-b092-1b0975fca5b2 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:16.336611 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e9d0b499-828a-4886-b092-1b0975fca5b2 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:16.339499 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e9d0b499-828a-4886-b092-1b0975fca5b2 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:16.349651 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e9d0b499-828a-4886-b092-1b0975fca5b2 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a" status: 200 len: 1266 microversion: 2.26 time: 0.255291 Oct 05 02:50:16.350262 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2310/4612] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:50:16 2022] GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:50:17.039215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-afb264ab-50dd-4272-a748-05558e683127 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:17.048009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-afb264ab-50dd-4272-a748-05558e683127 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:17.068413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-afb264ab-50dd-4272-a748-05558e683127 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:17.075535 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-afb264ab-50dd-4272-a748-05558e683127 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:17.078560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-afb264ab-50dd-4272-a748-05558e683127 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:17.082102 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-afb264ab-50dd-4272-a748-05558e683127 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:17.082732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-afb264ab-50dd-4272-a748-05558e683127 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:17.085062 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-afb264ab-50dd-4272-a748-05558e683127 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:17.148858 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d734b595-e479-4a85-999f-6226ed31ff3a tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:17.149564 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d734b595-e479-4a85-999f-6226ed31ff3a tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] [instance: a881c2ba-9019-439c-a55e-80b630ef27af] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:17.176557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d734b595-e479-4a85-999f-6226ed31ff3a tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:17.180514 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d734b595-e479-4a85-999f-6226ed31ff3a tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:17.189025 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d734b595-e479-4a85-999f-6226ed31ff3a tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:17.193089 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d734b595-e479-4a85-999f-6226ed31ff3a tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:17.194999 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d734b595-e479-4a85-999f-6226ed31ff3a tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:17.195639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d734b595-e479-4a85-999f-6226ed31ff3a tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:17.253641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:18.485180 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-afb264ab-50dd-4272-a748-05558e683127 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:18.490279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d734b595-e479-4a85-999f-6226ed31ff3a tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee670a08f94ba7aa95dbb46ef2eb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fc825cf1534094bab87cebb75a7d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:18.498210 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-afb264ab-50dd-4272-a748-05558e683127 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1486 microversion: 2.1 time: 1.481668 Oct 05 02:50:18.499133 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2303/4613] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:17 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1486 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:18.513933 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d734b595-e479-4a85-999f-6226ed31ff3a tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] 10.222.0.16 "GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af" status: 200 len: 1316 microversion: 2.1 time: 1.362997 Oct 05 02:50:18.521306 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2311/4614] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:17 2022] GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af => generated 1316 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:18.530710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0dcfa75e-8504-44f7-9b81-521c9ceb774e tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:18.532318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0dcfa75e-8504-44f7-9b81-521c9ceb774e tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] [instance: 4ab7776a-b71b-477a-b5ee-8ba797df9d1a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:18.533429 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1fb7bcde-9f61-43d1-8b9d-db7e54303bce tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:50:18.534002 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1fb7bcde-9f61-43d1-8b9d-db7e54303bce tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:18.541336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0dcfa75e-8504-44f7-9b81-521c9ceb774e tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:18.542422 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0dcfa75e-8504-44f7-9b81-521c9ceb774e tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:18.543144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0dcfa75e-8504-44f7-9b81-521c9ceb774e tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:18.544104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0dcfa75e-8504-44f7-9b81-521c9ceb774e tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:18.544760 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0dcfa75e-8504-44f7-9b81-521c9ceb774e tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:18.545494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0dcfa75e-8504-44f7-9b81-521c9ceb774e tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:18.558484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1fb7bcde-9f61-43d1-8b9d-db7e54303bce tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:18.558987 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1fb7bcde-9f61-43d1-8b9d-db7e54303bce tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:18.559453 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1fb7bcde-9f61-43d1-8b9d-db7e54303bce tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:18.560189 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1fb7bcde-9f61-43d1-8b9d-db7e54303bce tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:18.564069 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1fb7bcde-9f61-43d1-8b9d-db7e54303bce tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:18.565363 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1fb7bcde-9f61-43d1-8b9d-db7e54303bce tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:18.627555 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-1fb7bcde-9f61-43d1-8b9d-db7e54303bce tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lazy-loading 'flavor' on Instance uuid 0486ad56-c00a-45ca-b8b6-932ca38690b3 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:50:18.695777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0dcfa75e-8504-44f7-9b81-521c9ceb774e tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:18.718244 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0dcfa75e-8504-44f7-9b81-521c9ceb774e tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:18.724326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0dcfa75e-8504-44f7-9b81-521c9ceb774e tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:18.729564 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0dcfa75e-8504-44f7-9b81-521c9ceb774e tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a" status: 200 len: 1320 microversion: 2.26 time: 0.212071 Oct 05 02:50:18.732920 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2304/4615] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:50:18 2022] GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a => generated 1320 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:50:19.053629 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1fb7bcde-9f61-43d1-8b9d-db7e54303bce tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3/action" status: 202 len: 0 microversion: 2.1 time: 0.525411 Oct 05 02:50:19.054796 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2312/4616] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:50:18 2022] POST /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 02:50:19.065766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4676a2aa-f8d5-49a6-8d68-66d722c3ff65 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:19.066529 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4676a2aa-f8d5-49a6-8d68-66d722c3ff65 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:19.081860 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4676a2aa-f8d5-49a6-8d68-66d722c3ff65 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:19.084653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4676a2aa-f8d5-49a6-8d68-66d722c3ff65 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:19.085223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4676a2aa-f8d5-49a6-8d68-66d722c3ff65 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:19.086300 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4676a2aa-f8d5-49a6-8d68-66d722c3ff65 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:19.088403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4676a2aa-f8d5-49a6-8d68-66d722c3ff65 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:19.090541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4676a2aa-f8d5-49a6-8d68-66d722c3ff65 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:19.366629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4676a2aa-f8d5-49a6-8d68-66d722c3ff65 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:19.383169 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4676a2aa-f8d5-49a6-8d68-66d722c3ff65 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1492 microversion: 2.1 time: 0.322976 Oct 05 02:50:19.384988 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2305/4617] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:19 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1492 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:19.534987 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-915fee25-78af-4105-a5d7-e64d5ef1ff11 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:19.537342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-915fee25-78af-4105-a5d7-e64d5ef1ff11 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] [instance: a881c2ba-9019-439c-a55e-80b630ef27af] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:19.554431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-915fee25-78af-4105-a5d7-e64d5ef1ff11 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:19.555317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-915fee25-78af-4105-a5d7-e64d5ef1ff11 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:19.556080 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-915fee25-78af-4105-a5d7-e64d5ef1ff11 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:19.557112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-915fee25-78af-4105-a5d7-e64d5ef1ff11 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:19.557878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-915fee25-78af-4105-a5d7-e64d5ef1ff11 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:19.561481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-915fee25-78af-4105-a5d7-e64d5ef1ff11 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:19.760252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-038f6df7-a02c-4a9e-989d-9555660f4d54 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:19.761801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-038f6df7-a02c-4a9e-989d-9555660f4d54 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] [instance: 4ab7776a-b71b-477a-b5ee-8ba797df9d1a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:19.770604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-038f6df7-a02c-4a9e-989d-9555660f4d54 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:19.771219 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-038f6df7-a02c-4a9e-989d-9555660f4d54 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:19.771955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-038f6df7-a02c-4a9e-989d-9555660f4d54 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:19.772868 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-038f6df7-a02c-4a9e-989d-9555660f4d54 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:19.773550 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-038f6df7-a02c-4a9e-989d-9555660f4d54 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:19.774136 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-038f6df7-a02c-4a9e-989d-9555660f4d54 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:20.616320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-038f6df7-a02c-4a9e-989d-9555660f4d54 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:20.629255 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-915fee25-78af-4105-a5d7-e64d5ef1ff11 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee670a08f94ba7aa95dbb46ef2eb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fc825cf1534094bab87cebb75a7d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:20.630911 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-038f6df7-a02c-4a9e-989d-9555660f4d54 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:20.632388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-038f6df7-a02c-4a9e-989d-9555660f4d54 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:20.634452 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-038f6df7-a02c-4a9e-989d-9555660f4d54 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a" status: 200 len: 1362 microversion: 2.26 time: 0.878898 Oct 05 02:50:20.641482 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-915fee25-78af-4105-a5d7-e64d5ef1ff11 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] 10.222.0.16 "GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af" status: 200 len: 1316 microversion: 2.1 time: 1.110714 Oct 05 02:50:20.643332 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2313/4618] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:19 2022] GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af => generated 1316 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:20.651810 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-261ef428-d1c1-4237-89f0-bc3c958d5ab7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:20.652783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-261ef428-d1c1-4237-89f0-bc3c958d5ab7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:20.653161 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2306/4619] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:50:19 2022] GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a => generated 1362 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:50:20.689807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-261ef428-d1c1-4237-89f0-bc3c958d5ab7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:20.693842 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-261ef428-d1c1-4237-89f0-bc3c958d5ab7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:20.694356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-261ef428-d1c1-4237-89f0-bc3c958d5ab7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:20.695125 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-261ef428-d1c1-4237-89f0-bc3c958d5ab7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:20.695600 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-261ef428-d1c1-4237-89f0-bc3c958d5ab7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:20.696031 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-261ef428-d1c1-4237-89f0-bc3c958d5ab7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:21.081796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-261ef428-d1c1-4237-89f0-bc3c958d5ab7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:21.092587 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-261ef428-d1c1-4237-89f0-bc3c958d5ab7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1513 microversion: 2.1 time: 0.448220 Oct 05 02:50:21.093261 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2314/4620] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:20 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1513 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:21.489826 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-daf06e2f-efdd-4c10-a14b-d0bd63cb692d req-aa082ef3-0273-4809-b5dd-d76092adf02b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a881c2ba-9019-439c-a55e-80b630ef27af", "name": "network-vif-plugged", "status": "completed", "tag": "6d37a458-bd3b-43b5-a431-3e4ba261b153"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:50:21.534246 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-daf06e2f-efdd-4c10-a14b-d0bd63cb692d req-aa082ef3-0273-4809-b5dd-d76092adf02b service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:21.535051 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-daf06e2f-efdd-4c10-a14b-d0bd63cb692d req-aa082ef3-0273-4809-b5dd-d76092adf02b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:21.536851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-daf06e2f-efdd-4c10-a14b-d0bd63cb692d req-aa082ef3-0273-4809-b5dd-d76092adf02b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:21.573712 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-daf06e2f-efdd-4c10-a14b-d0bd63cb692d req-aa082ef3-0273-4809-b5dd-d76092adf02b service nova] Creating event network-vif-plugged:6d37a458-bd3b-43b5-a431-3e4ba261b153 for instance a881c2ba-9019-439c-a55e-80b630ef27af on n-h2-858272-3 Oct 05 02:50:21.586910 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-daf06e2f-efdd-4c10-a14b-d0bd63cb692d req-aa082ef3-0273-4809-b5dd-d76092adf02b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106593 Oct 05 02:50:21.587958 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2307/4621] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:50:21.674035 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a4c98f3c-fe7a-40e8-9409-ccb89dae0ee8 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:21.676265 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b5823efa-df0d-4429-954d-1d13abc891f1 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:21.677591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b5823efa-df0d-4429-954d-1d13abc891f1 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] [instance: 4ab7776a-b71b-477a-b5ee-8ba797df9d1a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:21.678534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a4c98f3c-fe7a-40e8-9409-ccb89dae0ee8 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] [instance: a881c2ba-9019-439c-a55e-80b630ef27af] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:21.703562 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b5823efa-df0d-4429-954d-1d13abc891f1 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:21.704170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b5823efa-df0d-4429-954d-1d13abc891f1 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:21.704967 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a4c98f3c-fe7a-40e8-9409-ccb89dae0ee8 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:21.711411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b5823efa-df0d-4429-954d-1d13abc891f1 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:21.712460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a4c98f3c-fe7a-40e8-9409-ccb89dae0ee8 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:21.713515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b5823efa-df0d-4429-954d-1d13abc891f1 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:21.714208 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a4c98f3c-fe7a-40e8-9409-ccb89dae0ee8 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:21.714910 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b5823efa-df0d-4429-954d-1d13abc891f1 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:21.715927 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a4c98f3c-fe7a-40e8-9409-ccb89dae0ee8 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:21.716594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b5823efa-df0d-4429-954d-1d13abc891f1 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:21.717325 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a4c98f3c-fe7a-40e8-9409-ccb89dae0ee8 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:21.721782 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a4c98f3c-fe7a-40e8-9409-ccb89dae0ee8 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:22.236634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b5823efa-df0d-4429-954d-1d13abc891f1 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:22.244642 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a4c98f3c-fe7a-40e8-9409-ccb89dae0ee8 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee670a08f94ba7aa95dbb46ef2eb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fc825cf1534094bab87cebb75a7d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:22.250391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b5823efa-df0d-4429-954d-1d13abc891f1 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:22.252027 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b5823efa-df0d-4429-954d-1d13abc891f1 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:22.255273 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b5823efa-df0d-4429-954d-1d13abc891f1 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a" status: 200 len: 1362 microversion: 2.26 time: 0.591267 Oct 05 02:50:22.268933 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2315/4622] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:50:21 2022] GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a => generated 1362 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:50:22.268933 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6ec24f85-800e-433f-a842-f08f8c54d76f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:22.268933 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6ec24f85-800e-433f-a842-f08f8c54d76f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:22.279558 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a4c98f3c-fe7a-40e8-9409-ccb89dae0ee8 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] 10.222.0.16 "GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af" status: 200 len: 1316 microversion: 2.1 time: 0.606799 Oct 05 02:50:22.280736 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2308/4623] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:21 2022] GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af => generated 1316 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:22.293891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ec24f85-800e-433f-a842-f08f8c54d76f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:22.294409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ec24f85-800e-433f-a842-f08f8c54d76f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:22.294859 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ec24f85-800e-433f-a842-f08f8c54d76f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:22.295584 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ec24f85-800e-433f-a842-f08f8c54d76f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:22.296044 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ec24f85-800e-433f-a842-f08f8c54d76f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:22.296466 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ec24f85-800e-433f-a842-f08f8c54d76f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:23.096328 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6ec24f85-800e-433f-a842-f08f8c54d76f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:23.116122 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6ec24f85-800e-433f-a842-f08f8c54d76f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1513 microversion: 2.1 time: 0.857218 Oct 05 02:50:23.117454 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2316/4624] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:22 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1513 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:23.216744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-070f1227-45b5-4930-ae12-2291c06234e2 req-af3a8dcf-cedd-47d9-a64c-0856ccd98be1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ab7776a-b71b-477a-b5ee-8ba797df9d1a", "tag": "e0c56020-4fbd-4f0f-9345-4f765d428060"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:50:23.254056 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-070f1227-45b5-4930-ae12-2291c06234e2 req-af3a8dcf-cedd-47d9-a64c-0856ccd98be1 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:23.254580 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-070f1227-45b5-4930-ae12-2291c06234e2 req-af3a8dcf-cedd-47d9-a64c-0856ccd98be1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:23.255022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-070f1227-45b5-4930-ae12-2291c06234e2 req-af3a8dcf-cedd-47d9-a64c-0856ccd98be1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:23.271940 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-070f1227-45b5-4930-ae12-2291c06234e2 req-af3a8dcf-cedd-47d9-a64c-0856ccd98be1 service nova] Creating event network-changed:e0c56020-4fbd-4f0f-9345-4f765d428060 for instance 4ab7776a-b71b-477a-b5ee-8ba797df9d1a on n-h1-858272-3 Oct 05 02:50:23.280060 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-070f1227-45b5-4930-ae12-2291c06234e2 req-af3a8dcf-cedd-47d9-a64c-0856ccd98be1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070579 Oct 05 02:50:23.284609 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2309/4625] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:50:23.287775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-efd03b42-d06c-4248-9830-0019eb89877e tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:23.288454 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-efd03b42-d06c-4248-9830-0019eb89877e tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] [instance: 4ab7776a-b71b-477a-b5ee-8ba797df9d1a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:23.299154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-efd03b42-d06c-4248-9830-0019eb89877e tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:23.299833 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-efd03b42-d06c-4248-9830-0019eb89877e tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:23.302906 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-efd03b42-d06c-4248-9830-0019eb89877e tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:23.303812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-efd03b42-d06c-4248-9830-0019eb89877e tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:23.305407 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-efd03b42-d06c-4248-9830-0019eb89877e tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:23.308600 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-efd03b42-d06c-4248-9830-0019eb89877e tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:23.309032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8e97516d-ebc5-47c4-9c6b-1cad8ba12717 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:23.309751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8e97516d-ebc5-47c4-9c6b-1cad8ba12717 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] [instance: a881c2ba-9019-439c-a55e-80b630ef27af] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:23.321259 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8e97516d-ebc5-47c4-9c6b-1cad8ba12717 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:23.322381 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8e97516d-ebc5-47c4-9c6b-1cad8ba12717 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:23.322825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8e97516d-ebc5-47c4-9c6b-1cad8ba12717 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:23.327830 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8e97516d-ebc5-47c4-9c6b-1cad8ba12717 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:23.328330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8e97516d-ebc5-47c4-9c6b-1cad8ba12717 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:23.328778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8e97516d-ebc5-47c4-9c6b-1cad8ba12717 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:23.725217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8e97516d-ebc5-47c4-9c6b-1cad8ba12717 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee670a08f94ba7aa95dbb46ef2eb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fc825cf1534094bab87cebb75a7d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:23.740114 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8e97516d-ebc5-47c4-9c6b-1cad8ba12717 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] 10.222.0.16 "GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af" status: 200 len: 1316 microversion: 2.1 time: 0.436079 Oct 05 02:50:23.741330 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2310/4626] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:23 2022] GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af => generated 1316 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:50:23.940301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-efd03b42-d06c-4248-9830-0019eb89877e tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:23.949438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-efd03b42-d06c-4248-9830-0019eb89877e tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:23.951346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-efd03b42-d06c-4248-9830-0019eb89877e tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:23.952800 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-efd03b42-d06c-4248-9830-0019eb89877e tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a" status: 200 len: 1362 microversion: 2.26 time: 0.669600 Oct 05 02:50:23.966896 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2317/4627] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:50:23 2022] GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a => generated 1362 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:50:24.145986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c1fce11b-8e52-479f-8871-000c022ee6f8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:24.147463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c1fce11b-8e52-479f-8871-000c022ee6f8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:24.167351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1fce11b-8e52-479f-8871-000c022ee6f8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:24.168257 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1fce11b-8e52-479f-8871-000c022ee6f8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:24.168856 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1fce11b-8e52-479f-8871-000c022ee6f8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:24.171148 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1fce11b-8e52-479f-8871-000c022ee6f8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:24.171893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1fce11b-8e52-479f-8871-000c022ee6f8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:24.172521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1fce11b-8e52-479f-8871-000c022ee6f8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:24.632000 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:24.709854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c1fce11b-8e52-479f-8871-000c022ee6f8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:24.730027 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c1fce11b-8e52-479f-8871-000c022ee6f8 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1513 microversion: 2.1 time: 0.588911 Oct 05 02:50:24.752142 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2311/4628] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:24 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1513 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:24.764613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7e9ee63c-5ea9-4a94-a151-adc8537743f9 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:24.765262 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7e9ee63c-5ea9-4a94-a151-adc8537743f9 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] [instance: a881c2ba-9019-439c-a55e-80b630ef27af] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:24.776148 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e9ee63c-5ea9-4a94-a151-adc8537743f9 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:24.780142 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e9ee63c-5ea9-4a94-a151-adc8537743f9 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:24.780602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e9ee63c-5ea9-4a94-a151-adc8537743f9 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:24.781358 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e9ee63c-5ea9-4a94-a151-adc8537743f9 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:24.781819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e9ee63c-5ea9-4a94-a151-adc8537743f9 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:24.782244 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e9ee63c-5ea9-4a94-a151-adc8537743f9 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:24.983318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fa57acb6-c602-406f-b9fb-c2c6d6c842e7 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:24.983944 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fa57acb6-c602-406f-b9fb-c2c6d6c842e7 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] [instance: 4ab7776a-b71b-477a-b5ee-8ba797df9d1a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:25.003062 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa57acb6-c602-406f-b9fb-c2c6d6c842e7 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:25.003778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa57acb6-c602-406f-b9fb-c2c6d6c842e7 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:25.004533 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa57acb6-c602-406f-b9fb-c2c6d6c842e7 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:25.005496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa57acb6-c602-406f-b9fb-c2c6d6c842e7 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:25.006009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa57acb6-c602-406f-b9fb-c2c6d6c842e7 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:25.006431 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa57acb6-c602-406f-b9fb-c2c6d6c842e7 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:25.019744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:25.053097 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=10 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:25.123290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7e9ee63c-5ea9-4a94-a151-adc8537743f9 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee670a08f94ba7aa95dbb46ef2eb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fc825cf1534094bab87cebb75a7d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:25.137939 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7e9ee63c-5ea9-4a94-a151-adc8537743f9 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] 10.222.0.16 "GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af" status: 200 len: 1505 microversion: 2.1 time: 0.373192 Oct 05 02:50:25.140849 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2318/4629] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:24 2022] GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af => generated 1505 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:25.168944 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-61865fc7-9c2d-4e2b-9b22-05ff6d56ee6e tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:25.170124 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-61865fc7-9c2d-4e2b-9b22-05ff6d56ee6e tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] [instance: a881c2ba-9019-439c-a55e-80b630ef27af] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:25.176984 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-61865fc7-9c2d-4e2b-9b22-05ff6d56ee6e tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:25.178022 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-61865fc7-9c2d-4e2b-9b22-05ff6d56ee6e tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:25.178686 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-61865fc7-9c2d-4e2b-9b22-05ff6d56ee6e tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:25.180076 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-61865fc7-9c2d-4e2b-9b22-05ff6d56ee6e tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:25.181614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-61865fc7-9c2d-4e2b-9b22-05ff6d56ee6e tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:25.182425 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-61865fc7-9c2d-4e2b-9b22-05ff6d56ee6e tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:25.224786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-61865fc7-9c2d-4e2b-9b22-05ff6d56ee6e tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '7cee670a08f94ba7aa95dbb46ef2eb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fc825cf1534094bab87cebb75a7d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:25.226463 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-61865fc7-9c2d-4e2b-9b22-05ff6d56ee6e tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] 10.222.0.16 "GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af/os-instance-actions/req-d241bf67-032f-43bf-a747-865b60a26a54" status: 200 len: 313 microversion: 2.1 time: 0.063540 Oct 05 02:50:25.228221 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2319/4630] 10.222.0.16 () {58 vars in 1419 bytes} [Wed Oct 5 02:50:25 2022] GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af/os-instance-actions/req-d241bf67-032f-43bf-a747-865b60a26a54 => generated 313 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:50:25.249357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-64a4241b-d248-4765-aaaf-f99aea70e66c tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:50:25.253749 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-64a4241b-d248-4765-aaaf-f99aea70e66c tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] [instance: a881c2ba-9019-439c-a55e-80b630ef27af] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:25.273866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64a4241b-d248-4765-aaaf-f99aea70e66c tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:25.274721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64a4241b-d248-4765-aaaf-f99aea70e66c tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:25.275390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64a4241b-d248-4765-aaaf-f99aea70e66c tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:25.276554 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64a4241b-d248-4765-aaaf-f99aea70e66c tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:25.277326 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64a4241b-d248-4765-aaaf-f99aea70e66c tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:25.278098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64a4241b-d248-4765-aaaf-f99aea70e66c tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:25.380504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fa57acb6-c602-406f-b9fb-c2c6d6c842e7 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:25.399071 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fa57acb6-c602-406f-b9fb-c2c6d6c842e7 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:25.401332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fa57acb6-c602-406f-b9fb-c2c6d6c842e7 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:25.402534 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fa57acb6-c602-406f-b9fb-c2c6d6c842e7 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a" status: 200 len: 1362 microversion: 2.26 time: 0.425075 Oct 05 02:50:25.407258 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2312/4631] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:50:24 2022] GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a => generated 1362 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:50:25.512872 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-64a4241b-d248-4765-aaaf-f99aea70e66c tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] 10.222.0.16 "POST /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af/action" status: 202 len: 0 microversion: 2.1 time: 0.274258 Oct 05 02:50:25.523237 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e8cd407d-604f-4936-a745-84a094b92e39 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:25.524138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e8cd407d-604f-4936-a745-84a094b92e39 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] [instance: a881c2ba-9019-439c-a55e-80b630ef27af] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:25.534447 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2320/4632] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:50:25 2022] POST /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 02:50:25.536161 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8cd407d-604f-4936-a745-84a094b92e39 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:25.541518 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8cd407d-604f-4936-a745-84a094b92e39 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:25.544913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8cd407d-604f-4936-a745-84a094b92e39 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:25.549964 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8cd407d-604f-4936-a745-84a094b92e39 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:25.551726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8cd407d-604f-4936-a745-84a094b92e39 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:25.552532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8cd407d-604f-4936-a745-84a094b92e39 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:25.762050 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-08d0310b-4fc8-4285-9dd5-79d6a7f27260 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:25.762836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-08d0310b-4fc8-4285-9dd5-79d6a7f27260 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:25.775655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08d0310b-4fc8-4285-9dd5-79d6a7f27260 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:25.776383 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08d0310b-4fc8-4285-9dd5-79d6a7f27260 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:25.776671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08d0310b-4fc8-4285-9dd5-79d6a7f27260 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:25.778166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08d0310b-4fc8-4285-9dd5-79d6a7f27260 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:25.781798 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08d0310b-4fc8-4285-9dd5-79d6a7f27260 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:25.782623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08d0310b-4fc8-4285-9dd5-79d6a7f27260 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:27.131823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e8cd407d-604f-4936-a745-84a094b92e39 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee670a08f94ba7aa95dbb46ef2eb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fc825cf1534094bab87cebb75a7d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:27.143932 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e8cd407d-604f-4936-a745-84a094b92e39 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] 10.222.0.16 "GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af" status: 200 len: 1507 microversion: 2.1 time: 1.624442 Oct 05 02:50:27.162932 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2313/4633] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:25 2022] GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af => generated 1507 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:50:27.180101 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-e85fab11-bb4e-40e7-a73e-d3ba824ecd26 req-a40b6815-e24b-4239-802b-cb1c6ad22f68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0486ad56-c00a-45ca-b8b6-932ca38690b3", "name": "network-vif-plugged", "status": "completed", "tag": "d4c9cced-e19b-4c63-ae11-305eee49cbf7"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:50:27.198568 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e85fab11-bb4e-40e7-a73e-d3ba824ecd26 req-a40b6815-e24b-4239-802b-cb1c6ad22f68 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:27.199559 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e85fab11-bb4e-40e7-a73e-d3ba824ecd26 req-a40b6815-e24b-4239-802b-cb1c6ad22f68 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:27.200161 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e85fab11-bb4e-40e7-a73e-d3ba824ecd26 req-a40b6815-e24b-4239-802b-cb1c6ad22f68 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:27.240503 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-e85fab11-bb4e-40e7-a73e-d3ba824ecd26 req-a40b6815-e24b-4239-802b-cb1c6ad22f68 service nova] Creating event network-vif-plugged:d4c9cced-e19b-4c63-ae11-305eee49cbf7 for instance 0486ad56-c00a-45ca-b8b6-932ca38690b3 on n-h2-858272-3 Oct 05 02:50:27.248296 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-e85fab11-bb4e-40e7-a73e-d3ba824ecd26 req-a40b6815-e24b-4239-802b-cb1c6ad22f68 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083958 Oct 05 02:50:27.249192 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2314/4634] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:50:27.266709 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0cca75c6-e636-4716-af9b-1690be378ea1 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:27.268580 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0cca75c6-e636-4716-af9b-1690be378ea1 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] [instance: 4ab7776a-b71b-477a-b5ee-8ba797df9d1a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:27.278108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0cca75c6-e636-4716-af9b-1690be378ea1 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:27.279377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0cca75c6-e636-4716-af9b-1690be378ea1 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:27.280307 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0cca75c6-e636-4716-af9b-1690be378ea1 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:27.281336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0cca75c6-e636-4716-af9b-1690be378ea1 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:27.282026 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0cca75c6-e636-4716-af9b-1690be378ea1 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:27.282696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0cca75c6-e636-4716-af9b-1690be378ea1 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:27.531594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-08d0310b-4fc8-4285-9dd5-79d6a7f27260 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:27.541381 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-08d0310b-4fc8-4285-9dd5-79d6a7f27260 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1508 microversion: 2.1 time: 1.783914 Oct 05 02:50:27.549920 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2321/4635] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:25 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1508 bytes in 1793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:50:28.045268 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0cca75c6-e636-4716-af9b-1690be378ea1 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:28.060144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0cca75c6-e636-4716-af9b-1690be378ea1 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:28.064589 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0cca75c6-e636-4716-af9b-1690be378ea1 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:28.066083 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0cca75c6-e636-4716-af9b-1690be378ea1 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a" status: 200 len: 1362 microversion: 2.26 time: 0.815513 Oct 05 02:50:28.066668 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2315/4636] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:50:27 2022] GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a => generated 1362 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:50:28.180411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6cecfc77-398c-4b24-bac2-2c046c4b4535 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:28.182038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6cecfc77-398c-4b24-bac2-2c046c4b4535 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] [instance: a881c2ba-9019-439c-a55e-80b630ef27af] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:28.197398 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:28.199601 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6cecfc77-398c-4b24-bac2-2c046c4b4535 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:28.200399 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6cecfc77-398c-4b24-bac2-2c046c4b4535 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:28.203210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6cecfc77-398c-4b24-bac2-2c046c4b4535 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:28.204183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6cecfc77-398c-4b24-bac2-2c046c4b4535 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:28.204823 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6cecfc77-398c-4b24-bac2-2c046c4b4535 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:28.206992 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6cecfc77-398c-4b24-bac2-2c046c4b4535 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:28.582508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f7cf3bea-26d5-439d-81a2-4cf13342df9c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:28.583680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f7cf3bea-26d5-439d-81a2-4cf13342df9c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:28.593532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7cf3bea-26d5-439d-81a2-4cf13342df9c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:28.594023 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7cf3bea-26d5-439d-81a2-4cf13342df9c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:28.594462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7cf3bea-26d5-439d-81a2-4cf13342df9c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:28.595159 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7cf3bea-26d5-439d-81a2-4cf13342df9c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:28.605422 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7cf3bea-26d5-439d-81a2-4cf13342df9c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:28.606323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7cf3bea-26d5-439d-81a2-4cf13342df9c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:28.836559 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6cecfc77-398c-4b24-bac2-2c046c4b4535 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee670a08f94ba7aa95dbb46ef2eb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fc825cf1534094bab87cebb75a7d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:28.855133 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6cecfc77-398c-4b24-bac2-2c046c4b4535 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] 10.222.0.16 "GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af" status: 200 len: 1507 microversion: 2.1 time: 0.682781 Oct 05 02:50:28.859897 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2322/4637] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:28 2022] GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af => generated 1507 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:29.098279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2cffbb86-c683-42e2-8fae-91dae1711cc0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:29.099320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2cffbb86-c683-42e2-8fae-91dae1711cc0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] [instance: 4ab7776a-b71b-477a-b5ee-8ba797df9d1a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:29.123977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cffbb86-c683-42e2-8fae-91dae1711cc0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:29.131594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cffbb86-c683-42e2-8fae-91dae1711cc0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:29.136771 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cffbb86-c683-42e2-8fae-91dae1711cc0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:29.141394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cffbb86-c683-42e2-8fae-91dae1711cc0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:29.144951 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cffbb86-c683-42e2-8fae-91dae1711cc0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:29.147116 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cffbb86-c683-42e2-8fae-91dae1711cc0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:29.299656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f7cf3bea-26d5-439d-81a2-4cf13342df9c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:29.309528 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f7cf3bea-26d5-439d-81a2-4cf13342df9c tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1508 microversion: 2.1 time: 0.731483 Oct 05 02:50:29.322200 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2316/4638] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:28 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1508 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:50:29.773068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2cffbb86-c683-42e2-8fae-91dae1711cc0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:29.789876 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2cffbb86-c683-42e2-8fae-91dae1711cc0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:29.794132 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2cffbb86-c683-42e2-8fae-91dae1711cc0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:29.796457 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2cffbb86-c683-42e2-8fae-91dae1711cc0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a" status: 200 len: 1362 microversion: 2.26 time: 0.703085 Oct 05 02:50:29.799977 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2323/4639] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:50:29 2022] GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a => generated 1362 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:50:29.883440 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0ebd0b99-55bf-4d8b-9136-21773008c0f7 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:29.885205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0ebd0b99-55bf-4d8b-9136-21773008c0f7 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] [instance: a881c2ba-9019-439c-a55e-80b630ef27af] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:29.895683 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ebd0b99-55bf-4d8b-9136-21773008c0f7 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:29.902303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ebd0b99-55bf-4d8b-9136-21773008c0f7 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:29.903105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ebd0b99-55bf-4d8b-9136-21773008c0f7 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:29.904002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ebd0b99-55bf-4d8b-9136-21773008c0f7 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:29.905489 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ebd0b99-55bf-4d8b-9136-21773008c0f7 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:29.913433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ebd0b99-55bf-4d8b-9136-21773008c0f7 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:30.238719 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0ebd0b99-55bf-4d8b-9136-21773008c0f7 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee670a08f94ba7aa95dbb46ef2eb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fc825cf1534094bab87cebb75a7d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:30.250465 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0ebd0b99-55bf-4d8b-9136-21773008c0f7 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] 10.222.0.16 "GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af" status: 200 len: 1505 microversion: 2.1 time: 0.370929 Oct 05 02:50:30.269091 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2317/4640] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:29 2022] GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af => generated 1505 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:30.279448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e8e541b4-e19d-4a92-8766-0cdf8e1066f0 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Calling method '.version_select at 0x7fcce8059040>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:30.279883 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e8e541b4-e19d-4a92-8766-0cdf8e1066f0 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] [instance: a881c2ba-9019-439c-a55e-80b630ef27af] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:30.287323 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8e541b4-e19d-4a92-8766-0cdf8e1066f0 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:30.287815 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8e541b4-e19d-4a92-8766-0cdf8e1066f0 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:30.288252 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8e541b4-e19d-4a92-8766-0cdf8e1066f0 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:30.296540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8e541b4-e19d-4a92-8766-0cdf8e1066f0 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:30.300827 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8e541b4-e19d-4a92-8766-0cdf8e1066f0 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:30.301364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8e541b4-e19d-4a92-8766-0cdf8e1066f0 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:30.348669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fa9e3247-23af-403e-9e8d-7f139b86c3bb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:30.349730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fa9e3247-23af-403e-9e8d-7f139b86c3bb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:30.366438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa9e3247-23af-403e-9e8d-7f139b86c3bb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:30.366938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa9e3247-23af-403e-9e8d-7f139b86c3bb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:30.367660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa9e3247-23af-403e-9e8d-7f139b86c3bb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:30.370036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa9e3247-23af-403e-9e8d-7f139b86c3bb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:30.370777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa9e3247-23af-403e-9e8d-7f139b86c3bb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:30.373296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa9e3247-23af-403e-9e8d-7f139b86c3bb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:30.398364 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e8e541b4-e19d-4a92-8766-0cdf8e1066f0 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] 10.222.0.16 "GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.125638 Oct 05 02:50:30.413466 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2324/4641] 10.222.0.16 () {58 vars in 1296 bytes} [Wed Oct 5 02:50:30 2022] GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af/os-instance-actions => generated 611 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:50:30.418706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fb56b4d5-d593-41ea-9587-627d06007813 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:30.427051 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fb56b4d5-d593-41ea-9587-627d06007813 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] [instance: a881c2ba-9019-439c-a55e-80b630ef27af] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:30.446609 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb56b4d5-d593-41ea-9587-627d06007813 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:30.449521 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb56b4d5-d593-41ea-9587-627d06007813 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:30.453766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb56b4d5-d593-41ea-9587-627d06007813 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:30.455188 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb56b4d5-d593-41ea-9587-627d06007813 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:30.456178 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb56b4d5-d593-41ea-9587-627d06007813 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:30.458453 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb56b4d5-d593-41ea-9587-627d06007813 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:30.472180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:30.540799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fb56b4d5-d593-41ea-9587-627d06007813 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] [instance: a881c2ba-9019-439c-a55e-80b630ef27af] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:50:30.768013 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fb56b4d5-d593-41ea-9587-627d06007813 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af" status: 204 len: 0 microversion: 2.1 time: 0.351876 Oct 05 02:50:30.771350 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2325/4642] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:50:30 2022] DELETE /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:50:30.784371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8c3311f9-de4e-4925-8561-b470aa471e91 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:30.786346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8c3311f9-de4e-4925-8561-b470aa471e91 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] [instance: a881c2ba-9019-439c-a55e-80b630ef27af] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:30.808815 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c3311f9-de4e-4925-8561-b470aa471e91 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:30.809357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c3311f9-de4e-4925-8561-b470aa471e91 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:30.810062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c3311f9-de4e-4925-8561-b470aa471e91 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:30.811038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c3311f9-de4e-4925-8561-b470aa471e91 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:30.813304 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c3311f9-de4e-4925-8561-b470aa471e91 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:30.814074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c3311f9-de4e-4925-8561-b470aa471e91 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:31.025760 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fa9e3247-23af-403e-9e8d-7f139b86c3bb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:31.061079 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fa9e3247-23af-403e-9e8d-7f139b86c3bb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1508 microversion: 2.1 time: 0.709862 Oct 05 02:50:31.062414 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2318/4643] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:30 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1508 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:31.094527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f5db622e-7a04-46ef-9894-5a692d3fd7ed tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:31.097035 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f5db622e-7a04-46ef-9894-5a692d3fd7ed tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] [instance: 4ab7776a-b71b-477a-b5ee-8ba797df9d1a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:31.112798 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5db622e-7a04-46ef-9894-5a692d3fd7ed tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:31.113884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5db622e-7a04-46ef-9894-5a692d3fd7ed tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:31.116650 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5db622e-7a04-46ef-9894-5a692d3fd7ed tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:31.122091 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5db622e-7a04-46ef-9894-5a692d3fd7ed tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:31.123233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5db622e-7a04-46ef-9894-5a692d3fd7ed tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:31.125199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5db622e-7a04-46ef-9894-5a692d3fd7ed tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:31.260266 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8c3311f9-de4e-4925-8561-b470aa471e91 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee670a08f94ba7aa95dbb46ef2eb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fc825cf1534094bab87cebb75a7d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:31.276746 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8c3311f9-de4e-4925-8561-b470aa471e91 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] 10.222.0.16 "GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af" status: 200 len: 1511 microversion: 2.1 time: 0.499842 Oct 05 02:50:31.283274 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2326/4644] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:30 2022] GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af => generated 1511 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:50:31.654156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f5db622e-7a04-46ef-9894-5a692d3fd7ed tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:31.668875 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f5db622e-7a04-46ef-9894-5a692d3fd7ed tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:31.671467 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f5db622e-7a04-46ef-9894-5a692d3fd7ed tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:31.672680 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f5db622e-7a04-46ef-9894-5a692d3fd7ed tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a" status: 200 len: 1362 microversion: 2.26 time: 0.609035 Oct 05 02:50:31.673273 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2319/4645] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:50:31 2022] GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a => generated 1362 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:50:32.087758 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c8484edf-5927-4d1c-bf29-6dcfa9bc56e2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:32.088394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c8484edf-5927-4d1c-bf29-6dcfa9bc56e2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:32.120145 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8484edf-5927-4d1c-bf29-6dcfa9bc56e2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:32.120145 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8484edf-5927-4d1c-bf29-6dcfa9bc56e2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:32.120145 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8484edf-5927-4d1c-bf29-6dcfa9bc56e2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:32.127106 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8484edf-5927-4d1c-bf29-6dcfa9bc56e2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:32.127106 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8484edf-5927-4d1c-bf29-6dcfa9bc56e2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:32.130652 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8484edf-5927-4d1c-bf29-6dcfa9bc56e2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:32.308566 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4c1f66d1-91f0-4bb5-9223-b8dccc87a6b2 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:32.309263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4c1f66d1-91f0-4bb5-9223-b8dccc87a6b2 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] [instance: a881c2ba-9019-439c-a55e-80b630ef27af] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:32.324843 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c1f66d1-91f0-4bb5-9223-b8dccc87a6b2 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:32.331133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c1f66d1-91f0-4bb5-9223-b8dccc87a6b2 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:32.331595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c1f66d1-91f0-4bb5-9223-b8dccc87a6b2 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:32.332364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c1f66d1-91f0-4bb5-9223-b8dccc87a6b2 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:32.332842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c1f66d1-91f0-4bb5-9223-b8dccc87a6b2 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:32.341626 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c1f66d1-91f0-4bb5-9223-b8dccc87a6b2 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:33.745238 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4c1f66d1-91f0-4bb5-9223-b8dccc87a6b2 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee670a08f94ba7aa95dbb46ef2eb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fc825cf1534094bab87cebb75a7d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:33.761590 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4c1f66d1-91f0-4bb5-9223-b8dccc87a6b2 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] 10.222.0.16 "GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af" status: 200 len: 1511 microversion: 2.1 time: 1.457979 Oct 05 02:50:33.772696 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2320/4646] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:32 2022] GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af => generated 1511 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:33.778881 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-021cfbfe-fff6-4883-90a3-8701bcc51e04 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:33.779822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-021cfbfe-fff6-4883-90a3-8701bcc51e04 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] [instance: 4ab7776a-b71b-477a-b5ee-8ba797df9d1a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:33.790333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:33.795306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-021cfbfe-fff6-4883-90a3-8701bcc51e04 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:33.800048 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-021cfbfe-fff6-4883-90a3-8701bcc51e04 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:33.800797 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-021cfbfe-fff6-4883-90a3-8701bcc51e04 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:33.801896 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-021cfbfe-fff6-4883-90a3-8701bcc51e04 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:33.802860 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-021cfbfe-fff6-4883-90a3-8701bcc51e04 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:33.804245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-021cfbfe-fff6-4883-90a3-8701bcc51e04 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:33.940958 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c8484edf-5927-4d1c-bf29-6dcfa9bc56e2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:33.957468 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c8484edf-5927-4d1c-bf29-6dcfa9bc56e2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1508 microversion: 2.1 time: 1.874320 Oct 05 02:50:33.959414 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2327/4647] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:32 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1508 bytes in 1877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:33.972011 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-37408860-6c03-4c66-a1e3-35db3a1e0727 req-7f242b32-e414-4d73-af1b-c822b57d5cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ab7776a-b71b-477a-b5ee-8ba797df9d1a", "name": "network-vif-plugged", "status": "completed", "tag": "e0c56020-4fbd-4f0f-9345-4f765d428060"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:50:34.003197 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-37408860-6c03-4c66-a1e3-35db3a1e0727 req-7f242b32-e414-4d73-af1b-c822b57d5cda service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:34.004112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-37408860-6c03-4c66-a1e3-35db3a1e0727 req-7f242b32-e414-4d73-af1b-c822b57d5cda service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:34.006133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-37408860-6c03-4c66-a1e3-35db3a1e0727 req-7f242b32-e414-4d73-af1b-c822b57d5cda service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:34.040970 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-37408860-6c03-4c66-a1e3-35db3a1e0727 req-7f242b32-e414-4d73-af1b-c822b57d5cda service nova] Creating event network-vif-plugged:e0c56020-4fbd-4f0f-9345-4f765d428060 for instance 4ab7776a-b71b-477a-b5ee-8ba797df9d1a on n-h1-858272-3 Oct 05 02:50:34.052119 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-37408860-6c03-4c66-a1e3-35db3a1e0727 req-7f242b32-e414-4d73-af1b-c822b57d5cda service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088876 Oct 05 02:50:34.057435 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2328/4648] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:50:34.808297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-030a340c-5c61-437b-bd43-0a1273f060c8 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:34.818084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-030a340c-5c61-437b-bd43-0a1273f060c8 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] [instance: a881c2ba-9019-439c-a55e-80b630ef27af] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:34.839380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-030a340c-5c61-437b-bd43-0a1273f060c8 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:34.840159 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-030a340c-5c61-437b-bd43-0a1273f060c8 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:34.841595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-030a340c-5c61-437b-bd43-0a1273f060c8 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:34.842714 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-030a340c-5c61-437b-bd43-0a1273f060c8 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:34.843353 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-030a340c-5c61-437b-bd43-0a1273f060c8 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:34.843946 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-030a340c-5c61-437b-bd43-0a1273f060c8 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:35.182179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-021cfbfe-fff6-4883-90a3-8701bcc51e04 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:35.192717 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-021cfbfe-fff6-4883-90a3-8701bcc51e04 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:35.198199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-021cfbfe-fff6-4883-90a3-8701bcc51e04 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:35.199416 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-021cfbfe-fff6-4883-90a3-8701bcc51e04 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a" status: 200 len: 1362 microversion: 2.26 time: 1.425287 Oct 05 02:50:35.233618 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2321/4649] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:50:33 2022] GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a => generated 1362 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:50:35.246405 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7f5aeb24-5861-43d0-b165-a4dadd66dd3d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:35.248328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7f5aeb24-5861-43d0-b165-a4dadd66dd3d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:35.270356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f5aeb24-5861-43d0-b165-a4dadd66dd3d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:35.272199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f5aeb24-5861-43d0-b165-a4dadd66dd3d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:35.276053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f5aeb24-5861-43d0-b165-a4dadd66dd3d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:35.280995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f5aeb24-5861-43d0-b165-a4dadd66dd3d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:35.281707 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f5aeb24-5861-43d0-b165-a4dadd66dd3d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:35.282357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f5aeb24-5861-43d0-b165-a4dadd66dd3d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:36.725891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-030a340c-5c61-437b-bd43-0a1273f060c8 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee670a08f94ba7aa95dbb46ef2eb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fc825cf1534094bab87cebb75a7d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:36.735870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7f5aeb24-5861-43d0-b165-a4dadd66dd3d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:36.770596 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-030a340c-5c61-437b-bd43-0a1273f060c8 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] 10.222.0.16 "GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af" status: 200 len: 1511 microversion: 2.1 time: 1.974937 Oct 05 02:50:36.772324 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7f5aeb24-5861-43d0-b165-a4dadd66dd3d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1508 microversion: 2.1 time: 1.534964 Oct 05 02:50:36.773614 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2329/4650] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:34 2022] GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af => generated 1511 bytes in 1982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:36.777971 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2322/4651] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:35 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1508 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:36.818936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0ee084c6-f6b1-48d1-9d6f-79430c1df829 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:36.825702 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0ee084c6-f6b1-48d1-9d6f-79430c1df829 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] [instance: 4ab7776a-b71b-477a-b5ee-8ba797df9d1a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:36.841573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ee084c6-f6b1-48d1-9d6f-79430c1df829 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:36.844448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ee084c6-f6b1-48d1-9d6f-79430c1df829 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:36.845815 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ee084c6-f6b1-48d1-9d6f-79430c1df829 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:36.850327 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ee084c6-f6b1-48d1-9d6f-79430c1df829 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:36.855621 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ee084c6-f6b1-48d1-9d6f-79430c1df829 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:36.857631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ee084c6-f6b1-48d1-9d6f-79430c1df829 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:37.407441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-091e2fb6-fb7b-4839-ae0c-c35c564b72e8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-291183468 tempest-PortsAdminExtendedAttrsIpV6TestJSON-291183468-project-admin] Calling method '.version_select at 0x7fccdf233280>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:37.409617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-091e2fb6-fb7b-4839-ae0c-c35c564b72e8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-291183468 tempest-PortsAdminExtendedAttrsIpV6TestJSON-291183468-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:37.410611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-091e2fb6-fb7b-4839-ae0c-c35c564b72e8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-291183468 tempest-PortsAdminExtendedAttrsIpV6TestJSON-291183468-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:37.411205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-091e2fb6-fb7b-4839-ae0c-c35c564b72e8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-291183468 tempest-PortsAdminExtendedAttrsIpV6TestJSON-291183468-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:37.499846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-091e2fb6-fb7b-4839-ae0c-c35c564b72e8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-291183468 tempest-PortsAdminExtendedAttrsIpV6TestJSON-291183468-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:37.500516 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-091e2fb6-fb7b-4839-ae0c-c35c564b72e8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-291183468 tempest-PortsAdminExtendedAttrsIpV6TestJSON-291183468-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:37.500989 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-091e2fb6-fb7b-4839-ae0c-c35c564b72e8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-291183468 tempest-PortsAdminExtendedAttrsIpV6TestJSON-291183468-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:37.562827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-091e2fb6-fb7b-4839-ae0c-c35c564b72e8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-291183468 tempest-PortsAdminExtendedAttrsIpV6TestJSON-291183468-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:37.563525 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-091e2fb6-fb7b-4839-ae0c-c35c564b72e8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-291183468 tempest-PortsAdminExtendedAttrsIpV6TestJSON-291183468-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:37.564487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-091e2fb6-fb7b-4839-ae0c-c35c564b72e8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-291183468 tempest-PortsAdminExtendedAttrsIpV6TestJSON-291183468-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:37.573356 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-091e2fb6-fb7b-4839-ae0c-c35c564b72e8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-291183468 tempest-PortsAdminExtendedAttrsIpV6TestJSON-291183468-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.793617 Oct 05 02:50:37.583730 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2323/4652] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:50:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:50:37.594626 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-da9850e9-f103-4725-8f56-0efab8a95ab9 req-6f8a0d82-3141-48b0-b78f-4714803cb239 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a881c2ba-9019-439c-a55e-80b630ef27af", "name": "network-vif-deleted", "tag": "6d37a458-bd3b-43b5-a431-3e4ba261b153"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:50:37.610730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-da9850e9-f103-4725-8f56-0efab8a95ab9 req-6f8a0d82-3141-48b0-b78f-4714803cb239 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:37.611567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-da9850e9-f103-4725-8f56-0efab8a95ab9 req-6f8a0d82-3141-48b0-b78f-4714803cb239 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:37.612675 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-da9850e9-f103-4725-8f56-0efab8a95ab9 req-6f8a0d82-3141-48b0-b78f-4714803cb239 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:37.640796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0ee084c6-f6b1-48d1-9d6f-79430c1df829 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:37.700030 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-da9850e9-f103-4725-8f56-0efab8a95ab9 req-6f8a0d82-3141-48b0-b78f-4714803cb239 service nova] Creating event network-vif-deleted:6d37a458-bd3b-43b5-a431-3e4ba261b153 for instance a881c2ba-9019-439c-a55e-80b630ef27af on n-h2-858272-3 Oct 05 02:50:37.711237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0ee084c6-f6b1-48d1-9d6f-79430c1df829 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:37.718205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0ee084c6-f6b1-48d1-9d6f-79430c1df829 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:37.721843 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-da9850e9-f103-4725-8f56-0efab8a95ab9 req-6f8a0d82-3141-48b0-b78f-4714803cb239 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134890 Oct 05 02:50:37.722289 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0ee084c6-f6b1-48d1-9d6f-79430c1df829 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a" status: 200 len: 1546 microversion: 2.26 time: 0.944852 Oct 05 02:50:37.732630 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2324/4653] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:50:37.732832 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2330/4654] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:50:36 2022] GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a => generated 1546 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:50:37.766687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7eab42dd-1538-45d3-b2c3-4c2409ee5769 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '.version_select at 0x7fccdfc33040>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:37.803404 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-22c23b85-3a1e-4671-aa17-04a5b0cf35f3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:37.804389 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-22c23b85-3a1e-4671-aa17-04a5b0cf35f3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:37.817755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7eab42dd-1538-45d3-b2c3-4c2409ee5769 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:37.818585 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7eab42dd-1538-45d3-b2c3-4c2409ee5769 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:37.833795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7eab42dd-1538-45d3-b2c3-4c2409ee5769 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:37.834847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7eab42dd-1538-45d3-b2c3-4c2409ee5769 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] [instance: 4ab7776a-b71b-477a-b5ee-8ba797df9d1a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:37.835175 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22c23b85-3a1e-4671-aa17-04a5b0cf35f3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:37.840550 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22c23b85-3a1e-4671-aa17-04a5b0cf35f3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:37.854548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22c23b85-3a1e-4671-aa17-04a5b0cf35f3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:37.855914 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22c23b85-3a1e-4671-aa17-04a5b0cf35f3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:37.856140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7eab42dd-1538-45d3-b2c3-4c2409ee5769 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:37.856823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7eab42dd-1538-45d3-b2c3-4c2409ee5769 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:37.857972 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22c23b85-3a1e-4671-aa17-04a5b0cf35f3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:37.861807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22c23b85-3a1e-4671-aa17-04a5b0cf35f3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:37.863441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7eab42dd-1538-45d3-b2c3-4c2409ee5769 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:37.865173 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7eab42dd-1538-45d3-b2c3-4c2409ee5769 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:37.865997 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7eab42dd-1538-45d3-b2c3-4c2409ee5769 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:37.870377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7eab42dd-1538-45d3-b2c3-4c2409ee5769 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:37.960041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7eab42dd-1538-45d3-b2c3-4c2409ee5769 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:37.960545 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7eab42dd-1538-45d3-b2c3-4c2409ee5769 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:37.961026 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7eab42dd-1538-45d3-b2c3-4c2409ee5769 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:38.030923 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7eab42dd-1538-45d3-b2c3-4c2409ee5769 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:38.031434 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7eab42dd-1538-45d3-b2c3-4c2409ee5769 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:38.033681 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7eab42dd-1538-45d3-b2c3-4c2409ee5769 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:38.083128 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-7eab42dd-1538-45d3-b2c3-4c2409ee5769 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lazy-loading 'flavor' on Instance uuid 4ab7776a-b71b-477a-b5ee-8ba797df9d1a {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:50:38.128951 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7eab42dd-1538-45d3-b2c3-4c2409ee5769 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "PUT /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags/tempest-tag-1632637790" status: 201 len: 0 microversion: 2.26 time: 0.375396 Oct 05 02:50:38.142467 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2325/4655] 10.222.0.16 () {62 vars in 1380 bytes} [Wed Oct 5 02:50:37 2022] PUT /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags/tempest-tag-1632637790 => generated 0 bytes in 390 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 05 02:50:38.161527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2cf2bef5-c1b0-4c5e-9347-a7b5b392c7ac tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:38.165910 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2cf2bef5-c1b0-4c5e-9347-a7b5b392c7ac tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] [instance: a881c2ba-9019-439c-a55e-80b630ef27af] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:38.187251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2cf2bef5-c1b0-4c5e-9347-a7b5b392c7ac tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:38.187762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2cf2bef5-c1b0-4c5e-9347-a7b5b392c7ac tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:38.188211 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2cf2bef5-c1b0-4c5e-9347-a7b5b392c7ac tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:38.188956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2cf2bef5-c1b0-4c5e-9347-a7b5b392c7ac tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:38.196487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2cf2bef5-c1b0-4c5e-9347-a7b5b392c7ac tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:38.197207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2cf2bef5-c1b0-4c5e-9347-a7b5b392c7ac tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:38.294305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2cf2bef5-c1b0-4c5e-9347-a7b5b392c7ac tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:38.297383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2cf2bef5-c1b0-4c5e-9347-a7b5b392c7ac tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:38.297881 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2cf2bef5-c1b0-4c5e-9347-a7b5b392c7ac tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:38.300956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-2cf2bef5-c1b0-4c5e-9347-a7b5b392c7ac tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lazy-loading 'fault' on Instance uuid a881c2ba-9019-439c-a55e-80b630ef27af {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:50:38.591951 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2cf2bef5-c1b0-4c5e-9347-a7b5b392c7ac tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee670a08f94ba7aa95dbb46ef2eb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fc825cf1534094bab87cebb75a7d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:38.603134 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2cf2bef5-c1b0-4c5e-9347-a7b5b392c7ac tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] 10.222.0.16 "GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af" status: 200 len: 1306 microversion: 2.1 time: 0.458109 Oct 05 02:50:38.603659 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2326/4656] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:38 2022] GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af => generated 1306 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:38.624468 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6e22e572-ff4e-4a4b-8d90-e119bfb6dad5 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '.version_select at 0x7fccdf09a3a0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:38.644681 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e22e572-ff4e-4a4b-8d90-e119bfb6dad5 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:38.651606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e22e572-ff4e-4a4b-8d90-e119bfb6dad5 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:38.652076 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e22e572-ff4e-4a4b-8d90-e119bfb6dad5 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:38.678523 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6e22e572-ff4e-4a4b-8d90-e119bfb6dad5 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags/tempest-tag-1632637790" status: 204 len: 0 microversion: 2.26 time: 0.073304 Oct 05 02:50:38.679711 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2327/4657] 10.222.0.16 () {60 vars in 1361 bytes} [Wed Oct 5 02:50:38 2022] GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags/tempest-tag-1632637790 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 02:50:38.689096 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f5dc6ac3-1c17-42eb-9363-b67751ce73cf tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '.version_select at 0x7fccdf09a160>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:38.709488 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5dc6ac3-1c17-42eb-9363-b67751ce73cf tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:38.710223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5dc6ac3-1c17-42eb-9363-b67751ce73cf tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:38.712297 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5dc6ac3-1c17-42eb-9363-b67751ce73cf tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:38.717466 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f5dc6ac3-1c17-42eb-9363-b67751ce73cf tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] [instance: 4ab7776a-b71b-477a-b5ee-8ba797df9d1a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:38.729588 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5dc6ac3-1c17-42eb-9363-b67751ce73cf tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:38.732926 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5dc6ac3-1c17-42eb-9363-b67751ce73cf tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:38.733728 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5dc6ac3-1c17-42eb-9363-b67751ce73cf tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:38.734995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5dc6ac3-1c17-42eb-9363-b67751ce73cf tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:38.735372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5dc6ac3-1c17-42eb-9363-b67751ce73cf tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:38.736020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5dc6ac3-1c17-42eb-9363-b67751ce73cf tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:38.808444 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-22c23b85-3a1e-4671-aa17-04a5b0cf35f3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:38.819710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:38.835240 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5dc6ac3-1c17-42eb-9363-b67751ce73cf tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:38.835802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5dc6ac3-1c17-42eb-9363-b67751ce73cf tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:38.836251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5dc6ac3-1c17-42eb-9363-b67751ce73cf tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:38.859358 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-22c23b85-3a1e-4671-aa17-04a5b0cf35f3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1508 microversion: 2.1 time: 1.058599 Oct 05 02:50:38.880640 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-f5dc6ac3-1c17-42eb-9363-b67751ce73cf tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lazy-loading 'flavor' on Instance uuid 4ab7776a-b71b-477a-b5ee-8ba797df9d1a {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:50:38.908664 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2331/4658] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:37 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1508 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:38.918905 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f5dc6ac3-1c17-42eb-9363-b67751ce73cf tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags" status: 204 len: 0 microversion: 2.26 time: 0.232203 Oct 05 02:50:38.921707 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2328/4659] 10.222.0.16 () {60 vars in 1295 bytes} [Wed Oct 5 02:50:38 2022] DELETE /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 05 02:50:38.954276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f27f58a5-80fa-4c1e-bc93-b46fa4810110 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '.version_select at 0x7fcce4589ee0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:38.986108 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f27f58a5-80fa-4c1e-bc93-b46fa4810110 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:38.987598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f27f58a5-80fa-4c1e-bc93-b46fa4810110 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:38.990042 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f27f58a5-80fa-4c1e-bc93-b46fa4810110 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:39.037016 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f27f58a5-80fa-4c1e-bc93-b46fa4810110 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags" status: 200 len: 12 microversion: 2.26 time: 0.104669 Oct 05 02:50:39.041193 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2332/4660] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Oct 5 02:50:38 2022] GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags => generated 12 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:39.064823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a3867db6-0e86-4ac5-8089-f3ce5c369d42 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '.version_select at 0x7fccdfc33160>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:39.109673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3867db6-0e86-4ac5-8089-f3ce5c369d42 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:39.110608 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3867db6-0e86-4ac5-8089-f3ce5c369d42 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:39.114141 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3867db6-0e86-4ac5-8089-f3ce5c369d42 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:39.114859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a3867db6-0e86-4ac5-8089-f3ce5c369d42 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] [instance: 4ab7776a-b71b-477a-b5ee-8ba797df9d1a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:39.130121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3867db6-0e86-4ac5-8089-f3ce5c369d42 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:39.130916 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3867db6-0e86-4ac5-8089-f3ce5c369d42 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:39.133497 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3867db6-0e86-4ac5-8089-f3ce5c369d42 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:39.134385 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3867db6-0e86-4ac5-8089-f3ce5c369d42 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:39.134972 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3867db6-0e86-4ac5-8089-f3ce5c369d42 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:39.138764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3867db6-0e86-4ac5-8089-f3ce5c369d42 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:39.208886 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3867db6-0e86-4ac5-8089-f3ce5c369d42 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:39.209410 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3867db6-0e86-4ac5-8089-f3ce5c369d42 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:39.209853 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3867db6-0e86-4ac5-8089-f3ce5c369d42 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:39.240473 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3867db6-0e86-4ac5-8089-f3ce5c369d42 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:39.243915 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3867db6-0e86-4ac5-8089-f3ce5c369d42 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:39.244369 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3867db6-0e86-4ac5-8089-f3ce5c369d42 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:39.309199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-a3867db6-0e86-4ac5-8089-f3ce5c369d42 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lazy-loading 'flavor' on Instance uuid 4ab7776a-b71b-477a-b5ee-8ba797df9d1a {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:50:39.357620 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a3867db6-0e86-4ac5-8089-f3ce5c369d42 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "PUT /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags/tempest-tag-1716086786" status: 201 len: 0 microversion: 2.26 time: 0.308378 Oct 05 02:50:39.358299 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2329/4661] 10.222.0.16 () {62 vars in 1380 bytes} [Wed Oct 5 02:50:39 2022] PUT /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags/tempest-tag-1716086786 => generated 0 bytes in 313 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 05 02:50:39.375336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-328ef7bc-bf41-4bf7-8645-fa9cb1df1404 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '.version_select at 0x7fccdef65790>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:39.396574 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-328ef7bc-bf41-4bf7-8645-fa9cb1df1404 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:39.397102 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-328ef7bc-bf41-4bf7-8645-fa9cb1df1404 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:39.397550 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-328ef7bc-bf41-4bf7-8645-fa9cb1df1404 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:39.451775 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-328ef7bc-bf41-4bf7-8645-fa9cb1df1404 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags" status: 200 len: 36 microversion: 2.26 time: 0.081808 Oct 05 02:50:39.457975 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2333/4662] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Oct 5 02:50:39 2022] GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags => generated 36 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:39.464819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b6ed9c24-8e79-47a7-9799-8cc3311c8127 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '.version_select at 0x7fccdfd1b310>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:39.483985 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b6ed9c24-8e79-47a7-9799-8cc3311c8127 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:39.489791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b6ed9c24-8e79-47a7-9799-8cc3311c8127 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:39.490664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b6ed9c24-8e79-47a7-9799-8cc3311c8127 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:39.491133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b6ed9c24-8e79-47a7-9799-8cc3311c8127 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] [instance: 4ab7776a-b71b-477a-b5ee-8ba797df9d1a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:39.515099 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b6ed9c24-8e79-47a7-9799-8cc3311c8127 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:39.515589 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b6ed9c24-8e79-47a7-9799-8cc3311c8127 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:39.516024 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b6ed9c24-8e79-47a7-9799-8cc3311c8127 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:39.516735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b6ed9c24-8e79-47a7-9799-8cc3311c8127 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:39.523693 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b6ed9c24-8e79-47a7-9799-8cc3311c8127 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:39.524700 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b6ed9c24-8e79-47a7-9799-8cc3311c8127 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:39.589684 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b6ed9c24-8e79-47a7-9799-8cc3311c8127 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:39.590169 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b6ed9c24-8e79-47a7-9799-8cc3311c8127 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:39.590605 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b6ed9c24-8e79-47a7-9799-8cc3311c8127 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:39.633055 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2d7c4e46-8d87-4827-866a-2b7c0408d012 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:39.633900 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2d7c4e46-8d87-4827-866a-2b7c0408d012 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] [instance: a881c2ba-9019-439c-a55e-80b630ef27af] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:39.643427 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-b6ed9c24-8e79-47a7-9799-8cc3311c8127 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lazy-loading 'flavor' on Instance uuid 4ab7776a-b71b-477a-b5ee-8ba797df9d1a {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:50:39.646169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d7c4e46-8d87-4827-866a-2b7c0408d012 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:39.647043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d7c4e46-8d87-4827-866a-2b7c0408d012 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:39.668754 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d7c4e46-8d87-4827-866a-2b7c0408d012 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:39.670554 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d7c4e46-8d87-4827-866a-2b7c0408d012 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:39.671294 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d7c4e46-8d87-4827-866a-2b7c0408d012 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:39.671922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d7c4e46-8d87-4827-866a-2b7c0408d012 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:39.693903 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b6ed9c24-8e79-47a7-9799-8cc3311c8127 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags/tempest-tag-1716086786" status: 204 len: 0 microversion: 2.26 time: 0.234803 Oct 05 02:50:39.694854 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2330/4663] 10.222.0.16 () {60 vars in 1364 bytes} [Wed Oct 5 02:50:39 2022] DELETE /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags/tempest-tag-1716086786 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 02:50:39.703179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f5978b65-eb1b-43c5-aac8-166148100cf5 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '.version_select at 0x7fccdf09a280>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:39.709945 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-2d7c4e46-8d87-4827-866a-2b7c0408d012 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] HTTP exception thrown: Instance a881c2ba-9019-439c-a55e-80b630ef27af could not be found. Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2d7c4e46-8d87-4827-866a-2b7c0408d012 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Request method failure captured: Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af HTTP/1.1 Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPDZ5K2ljc5O7nqJ4cVYWY6hthcRBWNiP-f1Iznp3m0enZWPoM3eZTM67JwHMpMB-wnpAPtXSVyOCZXUpd56IEEdLyy65M2oc-9RX3zT4JVcTgo6bl7qduS1zlYeDJZirTsczpyp1AOjn-JbiO8ywTJKkR1s8yuDoNuCdcRCASu1x1w Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 80fc825cf1534094bab87cebb75a7d2e Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-InstanceActionsTestJSON-1183354723 Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/80fc825cf1534094bab87cebb75a7d2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/80fc825cf1534094bab87cebb75a7d2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/80fc825cf1534094bab87cebb75a7d2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_80fc825cf1534094bab87cebb75a7d2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-InstanceActionsTestJSON-1183354723 Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 80fc825cf1534094bab87cebb75a7d2e Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1183354723 Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-InstanceActionsTestJSON-1183354723-project Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 7cee670a08f94ba7aa95dbb46ef2eb45 Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-InstanceActionsTestJSON-1183354723-project Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance a881c2ba-9019-439c-a55e-80b630ef27af could not be found. Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'a881c2ba-9019-439c-a55e-80b630ef27af'} Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a881c2ba-9019-439c-a55e-80b630ef27af could not be found. Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a881c2ba-9019-439c-a55e-80b630ef27af could not be found. Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:50:39.715373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:50:39.719843 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:50:39.719843 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:50:39.719843 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:50:39.719843 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:50:39.719843 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:50:39.719843 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a881c2ba-9019-439c-a55e-80b630ef27af could not be found. Oct 05 02:50:39.719843 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:50:39.719843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2d7c4e46-8d87-4827-866a-2b7c0408d012 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] Returning 404 to user: Instance a881c2ba-9019-439c-a55e-80b630ef27af could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:50:39.719843 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2d7c4e46-8d87-4827-866a-2b7c0408d012 tempest-InstanceActionsTestJSON-1183354723 tempest-InstanceActionsTestJSON-1183354723-project] 10.222.0.16 "GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af" status: 404 len: 111 microversion: 2.1 time: 0.093553 Oct 05 02:50:39.721885 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2334/4664] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:39 2022] GET /compute/v2.1/servers/a881c2ba-9019-439c-a55e-80b630ef27af => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:50:39.764427 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5978b65-eb1b-43c5-aac8-166148100cf5 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:39.765081 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5978b65-eb1b-43c5-aac8-166148100cf5 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:39.767353 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5978b65-eb1b-43c5-aac8-166148100cf5 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:39.803994 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f5978b65-eb1b-43c5-aac8-166148100cf5 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags" status: 200 len: 12 microversion: 2.26 time: 0.104711 Oct 05 02:50:39.807684 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2331/4665] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Oct 5 02:50:39 2022] GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags => generated 12 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:39.825700 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-873cfbf2-5bfe-4dad-b63c-b7fe132bc590 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '.version_select at 0x7fcce4589af0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:39.856875 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-873cfbf2-5bfe-4dad-b63c-b7fe132bc590 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:39.860315 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-873cfbf2-5bfe-4dad-b63c-b7fe132bc590 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:39.863020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-873cfbf2-5bfe-4dad-b63c-b7fe132bc590 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:39.864261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-873cfbf2-5bfe-4dad-b63c-b7fe132bc590 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] [instance: 4ab7776a-b71b-477a-b5ee-8ba797df9d1a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:39.882892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-873cfbf2-5bfe-4dad-b63c-b7fe132bc590 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:39.884230 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-873cfbf2-5bfe-4dad-b63c-b7fe132bc590 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:39.884877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-873cfbf2-5bfe-4dad-b63c-b7fe132bc590 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:39.885973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-873cfbf2-5bfe-4dad-b63c-b7fe132bc590 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:39.886645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-873cfbf2-5bfe-4dad-b63c-b7fe132bc590 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:39.887275 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-873cfbf2-5bfe-4dad-b63c-b7fe132bc590 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:39.913082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fe1a0937-0846-4f2b-b8a4-345fc365fddb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:39.914613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fe1a0937-0846-4f2b-b8a4-345fc365fddb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:39.929008 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fe1a0937-0846-4f2b-b8a4-345fc365fddb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:39.930959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fe1a0937-0846-4f2b-b8a4-345fc365fddb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:39.934010 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fe1a0937-0846-4f2b-b8a4-345fc365fddb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:39.938105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fe1a0937-0846-4f2b-b8a4-345fc365fddb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:39.939094 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fe1a0937-0846-4f2b-b8a4-345fc365fddb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:39.940152 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fe1a0937-0846-4f2b-b8a4-345fc365fddb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:39.948260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-873cfbf2-5bfe-4dad-b63c-b7fe132bc590 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:39.961284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-873cfbf2-5bfe-4dad-b63c-b7fe132bc590 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:39.962699 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-873cfbf2-5bfe-4dad-b63c-b7fe132bc590 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:39.994573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-873cfbf2-5bfe-4dad-b63c-b7fe132bc590 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lazy-loading 'flavor' on Instance uuid 4ab7776a-b71b-477a-b5ee-8ba797df9d1a {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:50:40.034362 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-873cfbf2-5bfe-4dad-b63c-b7fe132bc590 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags" status: 204 len: 0 microversion: 2.26 time: 0.219957 Oct 05 02:50:40.039691 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2335/4666] 10.222.0.16 () {60 vars in 1295 bytes} [Wed Oct 5 02:50:39 2022] DELETE /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 02:50:40.055960 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-14d5473e-f22e-4f84-9169-7b775de0c64c tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '.version_select at 0x7fccdf75d4c0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:40.069888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14d5473e-f22e-4f84-9169-7b775de0c64c tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:40.070542 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14d5473e-f22e-4f84-9169-7b775de0c64c tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:40.071706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14d5473e-f22e-4f84-9169-7b775de0c64c tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:40.072933 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-14d5473e-f22e-4f84-9169-7b775de0c64c tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] [instance: 4ab7776a-b71b-477a-b5ee-8ba797df9d1a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:40.079751 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14d5473e-f22e-4f84-9169-7b775de0c64c tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:40.080458 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14d5473e-f22e-4f84-9169-7b775de0c64c tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:40.081151 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14d5473e-f22e-4f84-9169-7b775de0c64c tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:40.082829 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14d5473e-f22e-4f84-9169-7b775de0c64c tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:40.083627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14d5473e-f22e-4f84-9169-7b775de0c64c tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:40.084325 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14d5473e-f22e-4f84-9169-7b775de0c64c tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:40.132215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14d5473e-f22e-4f84-9169-7b775de0c64c tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:40.134716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14d5473e-f22e-4f84-9169-7b775de0c64c tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:40.135430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14d5473e-f22e-4f84-9169-7b775de0c64c tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:40.147748 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14d5473e-f22e-4f84-9169-7b775de0c64c tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:40.148620 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14d5473e-f22e-4f84-9169-7b775de0c64c tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:40.149439 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14d5473e-f22e-4f84-9169-7b775de0c64c tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:40.181833 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-14d5473e-f22e-4f84-9169-7b775de0c64c tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lazy-loading 'flavor' on Instance uuid 4ab7776a-b71b-477a-b5ee-8ba797df9d1a {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:50:40.231124 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-14d5473e-f22e-4f84-9169-7b775de0c64c tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "PUT /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags/tempest-tag-1372460382" status: 201 len: 0 microversion: 2.26 time: 0.180602 Oct 05 02:50:40.232540 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2336/4667] 10.222.0.16 () {62 vars in 1380 bytes} [Wed Oct 5 02:50:40 2022] PUT /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags/tempest-tag-1372460382 => generated 0 bytes in 183 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 05 02:50:40.246269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-241146c4-4bf0-4863-95d1-03abebbadcab tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '.version_select at 0x7fcce4114790>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:40.267324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-241146c4-4bf0-4863-95d1-03abebbadcab tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:40.268311 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-241146c4-4bf0-4863-95d1-03abebbadcab tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:40.271999 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-241146c4-4bf0-4863-95d1-03abebbadcab tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:40.272837 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-241146c4-4bf0-4863-95d1-03abebbadcab tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] [instance: 4ab7776a-b71b-477a-b5ee-8ba797df9d1a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:40.280752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-241146c4-4bf0-4863-95d1-03abebbadcab tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:40.281816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-241146c4-4bf0-4863-95d1-03abebbadcab tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:40.282488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-241146c4-4bf0-4863-95d1-03abebbadcab tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:40.283439 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-241146c4-4bf0-4863-95d1-03abebbadcab tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:40.284455 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-241146c4-4bf0-4863-95d1-03abebbadcab tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:40.285211 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-241146c4-4bf0-4863-95d1-03abebbadcab tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:40.342878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-241146c4-4bf0-4863-95d1-03abebbadcab tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:40.345320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-241146c4-4bf0-4863-95d1-03abebbadcab tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:40.349639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-241146c4-4bf0-4863-95d1-03abebbadcab tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:40.370970 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fe1a0937-0846-4f2b-b8a4-345fc365fddb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:40.372038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-241146c4-4bf0-4863-95d1-03abebbadcab tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:40.373793 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-241146c4-4bf0-4863-95d1-03abebbadcab tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:40.375526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-241146c4-4bf0-4863-95d1-03abebbadcab tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:40.387260 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fe1a0937-0846-4f2b-b8a4-345fc365fddb tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1508 microversion: 2.1 time: 0.482190 Oct 05 02:50:40.389328 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2332/4668] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:39 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1508 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:40.444425 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-241146c4-4bf0-4863-95d1-03abebbadcab tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lazy-loading 'flavor' on Instance uuid 4ab7776a-b71b-477a-b5ee-8ba797df9d1a {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:50:40.493812 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-241146c4-4bf0-4863-95d1-03abebbadcab tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "PUT /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags/tempest-tag-798445365" status: 201 len: 0 microversion: 2.26 time: 0.254786 Oct 05 02:50:40.494970 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2337/4669] 10.222.0.16 () {62 vars in 1377 bytes} [Wed Oct 5 02:50:40 2022] PUT /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags/tempest-tag-798445365 => generated 0 bytes in 257 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 05 02:50:40.509239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d5595d19-cded-4fd6-99dc-766614b4ff11 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '.version_select at 0x7fccdf2299d0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:40.525616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5595d19-cded-4fd6-99dc-766614b4ff11 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:40.526667 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5595d19-cded-4fd6-99dc-766614b4ff11 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:40.527339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5595d19-cded-4fd6-99dc-766614b4ff11 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:40.528322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d5595d19-cded-4fd6-99dc-766614b4ff11 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] [instance: 4ab7776a-b71b-477a-b5ee-8ba797df9d1a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:40.535306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5595d19-cded-4fd6-99dc-766614b4ff11 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:40.536130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5595d19-cded-4fd6-99dc-766614b4ff11 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:40.537383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5595d19-cded-4fd6-99dc-766614b4ff11 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:40.538626 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5595d19-cded-4fd6-99dc-766614b4ff11 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:40.539317 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5595d19-cded-4fd6-99dc-766614b4ff11 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:40.540145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5595d19-cded-4fd6-99dc-766614b4ff11 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:40.591343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5595d19-cded-4fd6-99dc-766614b4ff11 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:40.592888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5595d19-cded-4fd6-99dc-766614b4ff11 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:40.596556 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5595d19-cded-4fd6-99dc-766614b4ff11 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:40.627375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-d5595d19-cded-4fd6-99dc-766614b4ff11 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lazy-loading 'flavor' on Instance uuid 4ab7776a-b71b-477a-b5ee-8ba797df9d1a {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:50:40.673227 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d5595d19-cded-4fd6-99dc-766614b4ff11 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags" status: 204 len: 0 microversion: 2.26 time: 0.172254 Oct 05 02:50:40.675820 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2333/4670] 10.222.0.16 () {60 vars in 1295 bytes} [Wed Oct 5 02:50:40 2022] DELETE /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 02:50:40.687176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3d997382-421b-4322-92fa-06270cea21be tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '.version_select at 0x7fcce4766040>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:40.713592 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d997382-421b-4322-92fa-06270cea21be tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:40.714092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d997382-421b-4322-92fa-06270cea21be tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:40.714535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d997382-421b-4322-92fa-06270cea21be tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:40.771490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=3,nova_cell1:DELETE=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:40.806472 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3d997382-421b-4322-92fa-06270cea21be tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags" status: 200 len: 12 microversion: 2.26 time: 0.125016 Oct 05 02:50:40.819740 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2338/4671] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Oct 5 02:50:40 2022] GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags => generated 12 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:40.831182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d15c5061-b195-419b-8682-4a532d76c4d0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '.version_select at 0x7fccdf229700>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:40.847343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d15c5061-b195-419b-8682-4a532d76c4d0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:40.869687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d15c5061-b195-419b-8682-4a532d76c4d0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:40.873277 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d15c5061-b195-419b-8682-4a532d76c4d0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:40.873907 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d15c5061-b195-419b-8682-4a532d76c4d0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] [instance: 4ab7776a-b71b-477a-b5ee-8ba797df9d1a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:40.913916 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d15c5061-b195-419b-8682-4a532d76c4d0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:40.915201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d15c5061-b195-419b-8682-4a532d76c4d0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:40.915664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d15c5061-b195-419b-8682-4a532d76c4d0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:40.921185 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d15c5061-b195-419b-8682-4a532d76c4d0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:40.923884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d15c5061-b195-419b-8682-4a532d76c4d0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:40.926770 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d15c5061-b195-419b-8682-4a532d76c4d0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:41.028486 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d15c5061-b195-419b-8682-4a532d76c4d0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:41.029033 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d15c5061-b195-419b-8682-4a532d76c4d0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:41.029479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d15c5061-b195-419b-8682-4a532d76c4d0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:41.066396 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-d15c5061-b195-419b-8682-4a532d76c4d0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lazy-loading 'flavor' on Instance uuid 4ab7776a-b71b-477a-b5ee-8ba797df9d1a {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:50:41.126930 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d15c5061-b195-419b-8682-4a532d76c4d0 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags" status: 204 len: 0 microversion: 2.26 time: 0.300581 Oct 05 02:50:41.130671 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2334/4672] 10.222.0.16 () {60 vars in 1295 bytes} [Wed Oct 5 02:50:40 2022] DELETE /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 02:50:41.142417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-116d10a5-494a-4619-a1bc-cc0639636cd9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '.version_select at 0x7fccdf3e2700>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:41.186906 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-116d10a5-494a-4619-a1bc-cc0639636cd9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:41.188975 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-116d10a5-494a-4619-a1bc-cc0639636cd9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:41.193565 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-116d10a5-494a-4619-a1bc-cc0639636cd9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:41.194294 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-116d10a5-494a-4619-a1bc-cc0639636cd9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] [instance: 4ab7776a-b71b-477a-b5ee-8ba797df9d1a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:41.211204 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-116d10a5-494a-4619-a1bc-cc0639636cd9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:41.211946 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-116d10a5-494a-4619-a1bc-cc0639636cd9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:41.215729 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-116d10a5-494a-4619-a1bc-cc0639636cd9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:41.216660 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-116d10a5-494a-4619-a1bc-cc0639636cd9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:41.217317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-116d10a5-494a-4619-a1bc-cc0639636cd9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:41.217905 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-116d10a5-494a-4619-a1bc-cc0639636cd9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:41.307348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-116d10a5-494a-4619-a1bc-cc0639636cd9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:41.322472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-116d10a5-494a-4619-a1bc-cc0639636cd9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:41.323231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-116d10a5-494a-4619-a1bc-cc0639636cd9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:41.352674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-116d10a5-494a-4619-a1bc-cc0639636cd9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:41.356525 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-116d10a5-494a-4619-a1bc-cc0639636cd9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:41.357210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-116d10a5-494a-4619-a1bc-cc0639636cd9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:41.417894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-85c74858-6e38-403f-b642-dd49ad73c5e1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:41.420347 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-85c74858-6e38-403f-b642-dd49ad73c5e1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:41.440554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-85c74858-6e38-403f-b642-dd49ad73c5e1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:41.443615 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-85c74858-6e38-403f-b642-dd49ad73c5e1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:41.446623 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-85c74858-6e38-403f-b642-dd49ad73c5e1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:41.447490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-85c74858-6e38-403f-b642-dd49ad73c5e1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:41.447981 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-85c74858-6e38-403f-b642-dd49ad73c5e1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:41.454091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-116d10a5-494a-4619-a1bc-cc0639636cd9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lazy-loading 'flavor' on Instance uuid 4ab7776a-b71b-477a-b5ee-8ba797df9d1a {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:50:41.454687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-85c74858-6e38-403f-b642-dd49ad73c5e1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:41.520541 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-116d10a5-494a-4619-a1bc-cc0639636cd9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "PUT /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags/tempest-tag-313602003" status: 201 len: 0 microversion: 2.26 time: 0.384294 Oct 05 02:50:41.527288 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2339/4673] 10.222.0.16 () {62 vars in 1377 bytes} [Wed Oct 5 02:50:41 2022] PUT /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags/tempest-tag-313602003 => generated 0 bytes in 392 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 05 02:50:41.542828 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-55993c44-696b-4de9-8ed4-7bf9b7dc57e9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '.version_select at 0x7fcce42a7280>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:41.597410 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55993c44-696b-4de9-8ed4-7bf9b7dc57e9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:41.601631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55993c44-696b-4de9-8ed4-7bf9b7dc57e9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:41.605396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55993c44-696b-4de9-8ed4-7bf9b7dc57e9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:41.605981 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-55993c44-696b-4de9-8ed4-7bf9b7dc57e9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] [instance: 4ab7776a-b71b-477a-b5ee-8ba797df9d1a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:41.637627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55993c44-696b-4de9-8ed4-7bf9b7dc57e9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:41.650325 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55993c44-696b-4de9-8ed4-7bf9b7dc57e9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:41.651125 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55993c44-696b-4de9-8ed4-7bf9b7dc57e9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:41.651994 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55993c44-696b-4de9-8ed4-7bf9b7dc57e9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:41.652567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55993c44-696b-4de9-8ed4-7bf9b7dc57e9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:41.654632 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55993c44-696b-4de9-8ed4-7bf9b7dc57e9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:41.728891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55993c44-696b-4de9-8ed4-7bf9b7dc57e9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:41.729986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55993c44-696b-4de9-8ed4-7bf9b7dc57e9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:41.730654 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55993c44-696b-4de9-8ed4-7bf9b7dc57e9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:41.749288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55993c44-696b-4de9-8ed4-7bf9b7dc57e9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:41.750255 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55993c44-696b-4de9-8ed4-7bf9b7dc57e9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:41.750924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55993c44-696b-4de9-8ed4-7bf9b7dc57e9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:41.815766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-55993c44-696b-4de9-8ed4-7bf9b7dc57e9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lazy-loading 'flavor' on Instance uuid 4ab7776a-b71b-477a-b5ee-8ba797df9d1a {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:50:41.845330 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-55993c44-696b-4de9-8ed4-7bf9b7dc57e9 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "PUT /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags/tempest-tag-365200475" status: 201 len: 0 microversion: 2.26 time: 0.314150 Oct 05 02:50:41.846701 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2340/4674] 10.222.0.16 () {62 vars in 1377 bytes} [Wed Oct 5 02:50:41 2022] PUT /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags/tempest-tag-365200475 => generated 0 bytes in 316 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 05 02:50:41.900747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-18fc13bb-f5b4-4d30-89fc-791cc7ce45b8 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Action: 'update_all', calling method: .version_select at 0x7fcce4114ee0>, body: {"tags": ["tempest-tag-341456374", "tempest-tag-1427489903"]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:50:41.934918 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18fc13bb-f5b4-4d30-89fc-791cc7ce45b8 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:41.935465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18fc13bb-f5b4-4d30-89fc-791cc7ce45b8 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:41.935931 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18fc13bb-f5b4-4d30-89fc-791cc7ce45b8 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:41.936490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-18fc13bb-f5b4-4d30-89fc-791cc7ce45b8 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] [instance: 4ab7776a-b71b-477a-b5ee-8ba797df9d1a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:41.956743 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18fc13bb-f5b4-4d30-89fc-791cc7ce45b8 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:41.957306 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18fc13bb-f5b4-4d30-89fc-791cc7ce45b8 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:41.957781 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18fc13bb-f5b4-4d30-89fc-791cc7ce45b8 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:41.958519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18fc13bb-f5b4-4d30-89fc-791cc7ce45b8 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:41.959014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18fc13bb-f5b4-4d30-89fc-791cc7ce45b8 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:41.959537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18fc13bb-f5b4-4d30-89fc-791cc7ce45b8 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:42.011816 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-85c74858-6e38-403f-b642-dd49ad73c5e1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:42.052293 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-85c74858-6e38-403f-b642-dd49ad73c5e1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1508 microversion: 2.1 time: 0.639195 Oct 05 02:50:42.053130 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2335/4675] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:41 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1508 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:50:42.068350 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18fc13bb-f5b4-4d30-89fc-791cc7ce45b8 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:42.069184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18fc13bb-f5b4-4d30-89fc-791cc7ce45b8 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:42.069918 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18fc13bb-f5b4-4d30-89fc-791cc7ce45b8 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:42.138723 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-18fc13bb-f5b4-4d30-89fc-791cc7ce45b8 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lazy-loading 'flavor' on Instance uuid 4ab7776a-b71b-477a-b5ee-8ba797df9d1a {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:50:42.197368 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-18fc13bb-f5b4-4d30-89fc-791cc7ce45b8 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "PUT /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags" status: 200 len: 61 microversion: 2.26 time: 0.328772 Oct 05 02:50:42.200672 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2341/4676] 10.222.0.16 () {62 vars in 1312 bytes} [Wed Oct 5 02:50:41 2022] PUT /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags => generated 61 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:42.210202 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dc4fc801-7b8d-4454-9ea6-2303ccd66238 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '.version_select at 0x7fccdf2fe5e0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:42.232340 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc4fc801-7b8d-4454-9ea6-2303ccd66238 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:42.236162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc4fc801-7b8d-4454-9ea6-2303ccd66238 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:42.236604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc4fc801-7b8d-4454-9ea6-2303ccd66238 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:42.277205 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-dc4fc801-7b8d-4454-9ea6-2303ccd66238 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags" status: 200 len: 61 microversion: 2.26 time: 0.072479 Oct 05 02:50:42.282700 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2336/4677] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Oct 5 02:50:42 2022] GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags => generated 61 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:42.288333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1194f922-a258-46c8-9b66-a91dd82639fa tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '.version_select at 0x7fcce42a75e0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:42.303052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1194f922-a258-46c8-9b66-a91dd82639fa tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:42.303469 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1194f922-a258-46c8-9b66-a91dd82639fa tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:42.303910 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1194f922-a258-46c8-9b66-a91dd82639fa tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:42.304396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1194f922-a258-46c8-9b66-a91dd82639fa tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] [instance: 4ab7776a-b71b-477a-b5ee-8ba797df9d1a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:42.327214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1194f922-a258-46c8-9b66-a91dd82639fa tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:42.327728 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1194f922-a258-46c8-9b66-a91dd82639fa tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:42.328175 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1194f922-a258-46c8-9b66-a91dd82639fa tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:42.328891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1194f922-a258-46c8-9b66-a91dd82639fa tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:42.329376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1194f922-a258-46c8-9b66-a91dd82639fa tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:42.345167 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1194f922-a258-46c8-9b66-a91dd82639fa tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:42.415950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1194f922-a258-46c8-9b66-a91dd82639fa tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:42.416452 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1194f922-a258-46c8-9b66-a91dd82639fa tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:42.416894 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1194f922-a258-46c8-9b66-a91dd82639fa tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:42.461991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-1194f922-a258-46c8-9b66-a91dd82639fa tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lazy-loading 'flavor' on Instance uuid 4ab7776a-b71b-477a-b5ee-8ba797df9d1a {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:50:42.517667 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1194f922-a258-46c8-9b66-a91dd82639fa tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags" status: 204 len: 0 microversion: 2.26 time: 0.233395 Oct 05 02:50:42.520435 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2342/4678] 10.222.0.16 () {60 vars in 1295 bytes} [Wed Oct 5 02:50:42 2022] DELETE /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a/tags => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 02:50:42.530213 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ab0c5244-93a2-4259-9327-948ad87bc359 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:42.530720 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ab0c5244-93a2-4259-9327-948ad87bc359 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] [instance: 4ab7776a-b71b-477a-b5ee-8ba797df9d1a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:42.570374 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab0c5244-93a2-4259-9327-948ad87bc359 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:42.572363 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab0c5244-93a2-4259-9327-948ad87bc359 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:42.572363 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab0c5244-93a2-4259-9327-948ad87bc359 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:42.572636 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab0c5244-93a2-4259-9327-948ad87bc359 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:42.581247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab0c5244-93a2-4259-9327-948ad87bc359 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:42.581933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab0c5244-93a2-4259-9327-948ad87bc359 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:42.691204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ab0c5244-93a2-4259-9327-948ad87bc359 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] [instance: 4ab7776a-b71b-477a-b5ee-8ba797df9d1a] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:50:42.983300 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ab0c5244-93a2-4259-9327-948ad87bc359 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a" status: 204 len: 0 microversion: 2.26 time: 0.453315 Oct 05 02:50:43.002649 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2337/4679] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 5 02:50:42 2022] DELETE /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 02:50:43.007970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-61d2ba73-52c8-4a81-aba4-1e6be0b4f038 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:43.009674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-61d2ba73-52c8-4a81-aba4-1e6be0b4f038 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] [instance: 4ab7776a-b71b-477a-b5ee-8ba797df9d1a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:43.040481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-61d2ba73-52c8-4a81-aba4-1e6be0b4f038 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:43.054826 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-61d2ba73-52c8-4a81-aba4-1e6be0b4f038 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:43.055551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-61d2ba73-52c8-4a81-aba4-1e6be0b4f038 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:43.056334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-61d2ba73-52c8-4a81-aba4-1e6be0b4f038 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:43.056822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-61d2ba73-52c8-4a81-aba4-1e6be0b4f038 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:43.065847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-61d2ba73-52c8-4a81-aba4-1e6be0b4f038 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:43.081403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1ffb27df-ad51-4ca8-a32e-266ad4c4d14b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:43.082769 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1ffb27df-ad51-4ca8-a32e-266ad4c4d14b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:43.160237 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ffb27df-ad51-4ca8-a32e-266ad4c4d14b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:43.161145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ffb27df-ad51-4ca8-a32e-266ad4c4d14b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:43.161776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ffb27df-ad51-4ca8-a32e-266ad4c4d14b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:43.165456 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ffb27df-ad51-4ca8-a32e-266ad4c4d14b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:43.169354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ffb27df-ad51-4ca8-a32e-266ad4c4d14b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:43.174608 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ffb27df-ad51-4ca8-a32e-266ad4c4d14b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:44.430125 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-61d2ba73-52c8-4a81-aba4-1e6be0b4f038 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:44.448949 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-61d2ba73-52c8-4a81-aba4-1e6be0b4f038 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:44.458082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-61d2ba73-52c8-4a81-aba4-1e6be0b4f038 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:44.460356 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-61d2ba73-52c8-4a81-aba4-1e6be0b4f038 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a" status: 200 len: 1552 microversion: 2.26 time: 1.457476 Oct 05 02:50:44.465984 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2343/4680] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:50:43 2022] GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a => generated 1552 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:50:44.534910 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1ffb27df-ad51-4ca8-a32e-266ad4c4d14b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:44.549130 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1ffb27df-ad51-4ca8-a32e-266ad4c4d14b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1508 microversion: 2.1 time: 1.472472 Oct 05 02:50:44.553599 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2338/4681] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:43 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1508 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:45.499393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2d8ee580-837a-4530-9732-6e84f6b9c779 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:45.500548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2d8ee580-837a-4530-9732-6e84f6b9c779 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] [instance: 4ab7776a-b71b-477a-b5ee-8ba797df9d1a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:45.523119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d8ee580-837a-4530-9732-6e84f6b9c779 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:45.534419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d8ee580-837a-4530-9732-6e84f6b9c779 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:45.534878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d8ee580-837a-4530-9732-6e84f6b9c779 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:45.535622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d8ee580-837a-4530-9732-6e84f6b9c779 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:45.536083 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d8ee580-837a-4530-9732-6e84f6b9c779 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:45.536509 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d8ee580-837a-4530-9732-6e84f6b9c779 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:45.581789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-00dee80b-1202-4d11-ac1e-392c602d2ea4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:45.583035 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-00dee80b-1202-4d11-ac1e-392c602d2ea4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:45.603230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-00dee80b-1202-4d11-ac1e-392c602d2ea4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:45.604027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-00dee80b-1202-4d11-ac1e-392c602d2ea4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:45.604644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-00dee80b-1202-4d11-ac1e-392c602d2ea4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:45.605574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-00dee80b-1202-4d11-ac1e-392c602d2ea4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:45.606199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-00dee80b-1202-4d11-ac1e-392c602d2ea4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:45.607309 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-00dee80b-1202-4d11-ac1e-392c602d2ea4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:47.087770 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-00dee80b-1202-4d11-ac1e-392c602d2ea4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:47.109245 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-00dee80b-1202-4d11-ac1e-392c602d2ea4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1508 microversion: 2.1 time: 1.531413 Oct 05 02:50:47.112234 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2339/4682] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:45 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1508 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:47.194923 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2d8ee580-837a-4530-9732-6e84f6b9c779 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:47.243757 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-d8a52fdb-16e3-44df-b61d-96a26e0f6914 req-a0be2635-d410-4b56-aceb-f513671bc4b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ab7776a-b71b-477a-b5ee-8ba797df9d1a", "name": "network-vif-deleted", "tag": "e0c56020-4fbd-4f0f-9345-4f765d428060"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:50:47.251541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2d8ee580-837a-4530-9732-6e84f6b9c779 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:47.277778 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2d8ee580-837a-4530-9732-6e84f6b9c779 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:47.287037 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2d8ee580-837a-4530-9732-6e84f6b9c779 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a" status: 200 len: 1552 microversion: 2.26 time: 1.792637 Oct 05 02:50:47.298274 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2344/4683] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:50:45 2022] GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a => generated 1552 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:50:47.314029 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d8a52fdb-16e3-44df-b61d-96a26e0f6914 req-a0be2635-d410-4b56-aceb-f513671bc4b8 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:47.315032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d8a52fdb-16e3-44df-b61d-96a26e0f6914 req-a0be2635-d410-4b56-aceb-f513671bc4b8 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:47.315815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d8a52fdb-16e3-44df-b61d-96a26e0f6914 req-a0be2635-d410-4b56-aceb-f513671bc4b8 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:47.344797 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=91,nova_cell1:DELETE=4,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:47.350522 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-d8a52fdb-16e3-44df-b61d-96a26e0f6914 req-a0be2635-d410-4b56-aceb-f513671bc4b8 service nova] Creating event network-vif-deleted:e0c56020-4fbd-4f0f-9345-4f765d428060 for instance 4ab7776a-b71b-477a-b5ee-8ba797df9d1a on n-h1-858272-3 Oct 05 02:50:47.364603 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-d8a52fdb-16e3-44df-b61d-96a26e0f6914 req-a0be2635-d410-4b56-aceb-f513671bc4b8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128682 Oct 05 02:50:47.366454 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2340/4684] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:50:48.144248 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-88c28579-c546-415c-9429-437b181510f0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:48.148243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-88c28579-c546-415c-9429-437b181510f0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:48.166089 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-88c28579-c546-415c-9429-437b181510f0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:48.167380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-88c28579-c546-415c-9429-437b181510f0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:48.169519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-88c28579-c546-415c-9429-437b181510f0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:48.172678 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-88c28579-c546-415c-9429-437b181510f0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:48.174048 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-88c28579-c546-415c-9429-437b181510f0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:48.177677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-88c28579-c546-415c-9429-437b181510f0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:48.327197 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-837c5611-e890-4f54-8917-d9e87c5900a7 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:48.329240 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-837c5611-e890-4f54-8917-d9e87c5900a7 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] [instance: 4ab7776a-b71b-477a-b5ee-8ba797df9d1a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:48.347010 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-837c5611-e890-4f54-8917-d9e87c5900a7 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:48.347613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-837c5611-e890-4f54-8917-d9e87c5900a7 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:48.348056 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-837c5611-e890-4f54-8917-d9e87c5900a7 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:48.348797 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-837c5611-e890-4f54-8917-d9e87c5900a7 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:48.353684 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-837c5611-e890-4f54-8917-d9e87c5900a7 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:48.354617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-837c5611-e890-4f54-8917-d9e87c5900a7 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:48.502321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-837c5611-e890-4f54-8917-d9e87c5900a7 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:48.504566 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-837c5611-e890-4f54-8917-d9e87c5900a7 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:48.505142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-837c5611-e890-4f54-8917-d9e87c5900a7 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:48.511593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-837c5611-e890-4f54-8917-d9e87c5900a7 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lazy-loading 'fault' on Instance uuid 4ab7776a-b71b-477a-b5ee-8ba797df9d1a {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:50:48.733109 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-837c5611-e890-4f54-8917-d9e87c5900a7 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:48.760493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-837c5611-e890-4f54-8917-d9e87c5900a7 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:48.765214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-837c5611-e890-4f54-8917-d9e87c5900a7 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'effef5f66f5644fab19ecd3f862d7daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a47a087cd7b4713a6ad1391eda4f4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:48.769392 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-837c5611-e890-4f54-8917-d9e87c5900a7 tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a" status: 200 len: 1352 microversion: 2.26 time: 0.449125 Oct 05 02:50:48.773767 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2341/4685] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:50:48 2022] GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a => generated 1352 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:50:49.003228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-88c28579-c546-415c-9429-437b181510f0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:49.033919 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-88c28579-c546-415c-9429-437b181510f0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1508 microversion: 2.1 time: 0.898633 Oct 05 02:50:49.035153 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2345/4686] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:48 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1508 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:49.801424 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-85f85e81-fad5-4e2c-bbb2-6fe43dea010a tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:49.802646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-85f85e81-fad5-4e2c-bbb2-6fe43dea010a tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] [instance: 4ab7776a-b71b-477a-b5ee-8ba797df9d1a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:49.823785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-85f85e81-fad5-4e2c-bbb2-6fe43dea010a tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:49.824543 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-85f85e81-fad5-4e2c-bbb2-6fe43dea010a tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:49.837896 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-85f85e81-fad5-4e2c-bbb2-6fe43dea010a tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:49.839091 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-85f85e81-fad5-4e2c-bbb2-6fe43dea010a tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:49.839735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-85f85e81-fad5-4e2c-bbb2-6fe43dea010a tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:49.840349 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-85f85e81-fad5-4e2c-bbb2-6fe43dea010a tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:49.877748 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-85f85e81-fad5-4e2c-bbb2-6fe43dea010a tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] HTTP exception thrown: Instance 4ab7776a-b71b-477a-b5ee-8ba797df9d1a could not be found. Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-85f85e81-fad5-4e2c-bbb2-6fe43dea010a tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Request method failure captured: Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a HTTP/1.1 Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPDjTd9v-x0xhuFy-4PQO-CjSgIakbYNkKlQObSJQOD2XpIXfAaRaXOSO38FijevsW4dxVyVaTWh2FXFQahfnPQydIay3tZz28lXjnsKNXa3HqiN0JVCLrkSEdOEfqhdTHgW00xLyhGBBZ6h8yrk2HvZVrPsndV76slmWeLjaFs-Cmo Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: X-Openstack-Nova-Api-Version: 2.26 Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 4a47a087cd7b4713a6ad1391eda4f4a3 Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerTagsTestJSON-640115613 Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4a47a087cd7b4713a6ad1391eda4f4a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4a47a087cd7b4713a6ad1391eda4f4a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4a47a087cd7b4713a6ad1391eda4f4a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4a47a087cd7b4713a6ad1391eda4f4a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerTagsTestJSON-640115613 Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 4a47a087cd7b4713a6ad1391eda4f4a3 Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerTagsTestJSON-640115613 Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerTagsTestJSON-640115613-project Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: effef5f66f5644fab19ecd3f862d7daa Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerTagsTestJSON-640115613-project Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 4ab7776a-b71b-477a-b5ee-8ba797df9d1a could not be found. Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '4ab7776a-b71b-477a-b5ee-8ba797df9d1a'} Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ab7776a-b71b-477a-b5ee-8ba797df9d1a could not be found. Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ab7776a-b71b-477a-b5ee-8ba797df9d1a could not be found. Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:50:49.879955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:50:49.886073 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:50:49.886073 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:50:49.886073 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:50:49.886073 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:50:49.886073 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:50:49.886073 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ab7776a-b71b-477a-b5ee-8ba797df9d1a could not be found. Oct 05 02:50:49.886073 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:50:49.887590 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-85f85e81-fad5-4e2c-bbb2-6fe43dea010a tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] Returning 404 to user: Instance 4ab7776a-b71b-477a-b5ee-8ba797df9d1a could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:50:49.888667 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-85f85e81-fad5-4e2c-bbb2-6fe43dea010a tempest-ServerTagsTestJSON-640115613 tempest-ServerTagsTestJSON-640115613-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a" status: 404 len: 111 microversion: 2.26 time: 0.091272 Oct 05 02:50:49.889781 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2342/4687] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:50:49 2022] GET /compute/v2.1/servers/4ab7776a-b71b-477a-b5ee-8ba797df9d1a => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:50:50.069485 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-148fbe57-770b-4b98-b458-00ecca6571a4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:50.071477 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-148fbe57-770b-4b98-b458-00ecca6571a4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:50.106816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-148fbe57-770b-4b98-b458-00ecca6571a4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:50.109970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-148fbe57-770b-4b98-b458-00ecca6571a4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:50.126426 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-148fbe57-770b-4b98-b458-00ecca6571a4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:50.127641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-148fbe57-770b-4b98-b458-00ecca6571a4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:50.128460 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-148fbe57-770b-4b98-b458-00ecca6571a4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:50.130210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-148fbe57-770b-4b98-b458-00ecca6571a4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:50.738207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-148fbe57-770b-4b98-b458-00ecca6571a4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:50.749256 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-148fbe57-770b-4b98-b458-00ecca6571a4 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1508 microversion: 2.1 time: 0.686743 Oct 05 02:50:50.757072 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2346/4688] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:50 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1508 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:51.778203 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8dd7d95f-ff2d-4535-bc86-4a1fbb42360a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:51.778942 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8dd7d95f-ff2d-4535-bc86-4a1fbb42360a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:51.793270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8dd7d95f-ff2d-4535-bc86-4a1fbb42360a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:51.793776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8dd7d95f-ff2d-4535-bc86-4a1fbb42360a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:51.794220 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8dd7d95f-ff2d-4535-bc86-4a1fbb42360a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:51.809994 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8dd7d95f-ff2d-4535-bc86-4a1fbb42360a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:51.810524 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8dd7d95f-ff2d-4535-bc86-4a1fbb42360a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:51.810985 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8dd7d95f-ff2d-4535-bc86-4a1fbb42360a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:52.760355 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8dd7d95f-ff2d-4535-bc86-4a1fbb42360a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:52.839508 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8dd7d95f-ff2d-4535-bc86-4a1fbb42360a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1508 microversion: 2.1 time: 1.019784 Oct 05 02:50:52.839508 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2343/4689] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:51 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1508 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:53.832925 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-35517055-de92-4753-8644-b72df6ca6358 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:53.834058 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-35517055-de92-4753-8644-b72df6ca6358 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:53.861414 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-35517055-de92-4753-8644-b72df6ca6358 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:53.864550 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-35517055-de92-4753-8644-b72df6ca6358 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:53.865466 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-35517055-de92-4753-8644-b72df6ca6358 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:53.866598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-35517055-de92-4753-8644-b72df6ca6358 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:53.870234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-35517055-de92-4753-8644-b72df6ca6358 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:53.870973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-35517055-de92-4753-8644-b72df6ca6358 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:54.121953 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8dd7d95f-ff2d-4535-bc86-4a1fbb42360a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:54.123632 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8dd7d95f-ff2d-4535-bc86-4a1fbb42360a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002153 Oct 05 02:50:54.124431 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2344/4690] 10.222.0.16 () {56 vars in 886 bytes} [Wed Oct 5 02:50:54 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 05 02:50:54.668110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-35517055-de92-4753-8644-b72df6ca6358 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:54.683966 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-35517055-de92-4753-8644-b72df6ca6358 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1508 microversion: 2.1 time: 0.855008 Oct 05 02:50:54.694930 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2347/4691] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:53 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1508 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:55.722379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-90c27a77-8223-4ec4-85fb-8c1b84f1782a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:55.723175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-90c27a77-8223-4ec4-85fb-8c1b84f1782a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:55.735292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-90c27a77-8223-4ec4-85fb-8c1b84f1782a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:55.735292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-90c27a77-8223-4ec4-85fb-8c1b84f1782a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:55.735634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-90c27a77-8223-4ec4-85fb-8c1b84f1782a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:55.741204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-90c27a77-8223-4ec4-85fb-8c1b84f1782a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:55.744453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-90c27a77-8223-4ec4-85fb-8c1b84f1782a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:55.749452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-90c27a77-8223-4ec4-85fb-8c1b84f1782a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:56.163176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-90c27a77-8223-4ec4-85fb-8c1b84f1782a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:56.180084 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-90c27a77-8223-4ec4-85fb-8c1b84f1782a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1508 microversion: 2.1 time: 0.458064 Oct 05 02:50:56.180948 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2345/4692] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:55 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1508 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:57.210223 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c7d10329-fdbc-431b-84ee-b7431a349351 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:57.212200 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c7d10329-fdbc-431b-84ee-b7431a349351 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:57.223312 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7d10329-fdbc-431b-84ee-b7431a349351 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:57.225184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7d10329-fdbc-431b-84ee-b7431a349351 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:57.228816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7d10329-fdbc-431b-84ee-b7431a349351 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:57.229911 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7d10329-fdbc-431b-84ee-b7431a349351 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:57.231500 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7d10329-fdbc-431b-84ee-b7431a349351 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:57.236016 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c7d10329-fdbc-431b-84ee-b7431a349351 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:57.876159 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c7d10329-fdbc-431b-84ee-b7431a349351 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:57.894482 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c7d10329-fdbc-431b-84ee-b7431a349351 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1508 microversion: 2.1 time: 0.689596 Oct 05 02:50:57.894482 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2348/4693] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:57 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1508 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:50:58.135732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-90c27a77-8223-4ec4-85fb-8c1b84f1782a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:58.136705 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-90c27a77-8223-4ec4-85fb-8c1b84f1782a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001314 Oct 05 02:50:58.137467 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2346/4694] 10.222.0.16 () {56 vars in 886 bytes} [Wed Oct 5 02:50:58 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 05 02:50:58.146504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c7d10329-fdbc-431b-84ee-b7431a349351 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:58.147982 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c7d10329-fdbc-431b-84ee-b7431a349351 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002332 Oct 05 02:50:58.157207 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2349/4695] 10.222.0.16 () {54 vars in 1035 bytes} [Wed Oct 5 02:50:58 2022] GET /compute/v2/ => generated 379 bytes in 12 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 05 02:50:58.157720 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-90c27a77-8223-4ec4-85fb-8c1b84f1782a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:58.159001 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-90c27a77-8223-4ec4-85fb-8c1b84f1782a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002368 Oct 05 02:50:58.159494 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2347/4696] 10.222.0.16 () {54 vars in 1041 bytes} [Wed Oct 5 02:50:58 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:50:58.171474 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c7d10329-fdbc-431b-84ee-b7431a349351 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:58.172459 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c7d10329-fdbc-431b-84ee-b7431a349351 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001320 Oct 05 02:50:58.180448 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2350/4697] 10.222.0.16 () {56 vars in 886 bytes} [Wed Oct 5 02:50:58 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 05 02:50:58.920033 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-689ce214-b61c-4f24-8864-481a1ddcf790 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:50:58.920762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-689ce214-b61c-4f24-8864-481a1ddcf790 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:50:58.936395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-689ce214-b61c-4f24-8864-481a1ddcf790 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:58.937103 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-689ce214-b61c-4f24-8864-481a1ddcf790 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:58.937655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-689ce214-b61c-4f24-8864-481a1ddcf790 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:58.938567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-689ce214-b61c-4f24-8864-481a1ddcf790 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:50:58.939456 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-689ce214-b61c-4f24-8864-481a1ddcf790 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:50:58.942115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-689ce214-b61c-4f24-8864-481a1ddcf790 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:50:59.358377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-689ce214-b61c-4f24-8864-481a1ddcf790 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:50:59.370689 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-689ce214-b61c-4f24-8864-481a1ddcf790 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1505 microversion: 2.1 time: 0.455252 Oct 05 02:50:59.374173 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2348/4698] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:50:58 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1505 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:00.398281 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-74cec1b9-b343-483f-b1d3-3886c51d92e6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:00.399704 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-74cec1b9-b343-483f-b1d3-3886c51d92e6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:00.406686 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:00.410874 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-74cec1b9-b343-483f-b1d3-3886c51d92e6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:00.411582 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-74cec1b9-b343-483f-b1d3-3886c51d92e6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:00.412233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-74cec1b9-b343-483f-b1d3-3886c51d92e6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:00.413052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-74cec1b9-b343-483f-b1d3-3886c51d92e6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:00.413646 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-74cec1b9-b343-483f-b1d3-3886c51d92e6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:00.414080 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-74cec1b9-b343-483f-b1d3-3886c51d92e6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:00.635714 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-74cec1b9-b343-483f-b1d3-3886c51d92e6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:00.651599 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-74cec1b9-b343-483f-b1d3-3886c51d92e6 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1505 microversion: 2.1 time: 0.257413 Oct 05 02:51:00.669292 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2351/4699] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:00 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1505 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:01.547605 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-37e77b69-3bb3-47f4-9ce8-e0122a536abb req-e28f1f17-b599-4c8c-b7a5-2f529003e5db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0486ad56-c00a-45ca-b8b6-932ca38690b3", "name": "network-vif-unplugged", "status": "completed", "tag": "d4c9cced-e19b-4c63-ae11-305eee49cbf7"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:51:01.565034 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-37e77b69-3bb3-47f4-9ce8-e0122a536abb req-e28f1f17-b599-4c8c-b7a5-2f529003e5db service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:01.566435 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-37e77b69-3bb3-47f4-9ce8-e0122a536abb req-e28f1f17-b599-4c8c-b7a5-2f529003e5db service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:01.567087 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-37e77b69-3bb3-47f4-9ce8-e0122a536abb req-e28f1f17-b599-4c8c-b7a5-2f529003e5db service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:01.582276 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.compute.server_external_events [req-37e77b69-3bb3-47f4-9ce8-e0122a536abb req-e28f1f17-b599-4c8c-b7a5-2f529003e5db service nova] Unable to find a host for instance 0486ad56-c00a-45ca-b8b6-932ca38690b3. Dropping event network-vif-unplugged {{(pid=122319) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 05 02:51:01.583798 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-37e77b69-3bb3-47f4-9ce8-e0122a536abb req-e28f1f17-b599-4c8c-b7a5-2f529003e5db service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.040647 Oct 05 02:51:01.585152 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2349/4700] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 05 02:51:01.681143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-119887b9-046e-4672-ab2f-501df37aa538 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:01.682865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-119887b9-046e-4672-ab2f-501df37aa538 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:01.693280 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-119887b9-046e-4672-ab2f-501df37aa538 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:01.693964 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-119887b9-046e-4672-ab2f-501df37aa538 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:01.694924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-119887b9-046e-4672-ab2f-501df37aa538 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:01.696837 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-119887b9-046e-4672-ab2f-501df37aa538 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:01.697355 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-119887b9-046e-4672-ab2f-501df37aa538 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:01.698056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-119887b9-046e-4672-ab2f-501df37aa538 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:01.703830 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:01.867997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-119887b9-046e-4672-ab2f-501df37aa538 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:01.877150 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-119887b9-046e-4672-ab2f-501df37aa538 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 200 len: 1448 microversion: 2.1 time: 0.202069 Oct 05 02:51:01.879680 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2352/4701] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:01 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 1448 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:01.903774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8cf9a530-9461-4f8c-b187-87dc32f94865 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:01.905164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8cf9a530-9461-4f8c-b187-87dc32f94865 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:01.913704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cf9a530-9461-4f8c-b187-87dc32f94865 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:01.915501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cf9a530-9461-4f8c-b187-87dc32f94865 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:01.916211 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cf9a530-9461-4f8c-b187-87dc32f94865 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:01.917016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cf9a530-9461-4f8c-b187-87dc32f94865 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:01.917920 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cf9a530-9461-4f8c-b187-87dc32f94865 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:01.918991 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cf9a530-9461-4f8c-b187-87dc32f94865 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:02.117545 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8cf9a530-9461-4f8c-b187-87dc32f94865 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:02.128321 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8cf9a530-9461-4f8c-b187-87dc32f94865 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.230272 Oct 05 02:51:02.140934 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2350/4702] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:01 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:02.159449 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e9cb2e7b-a665-4e64-80b5-a8e495ebf4ad tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:02.160071 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e9cb2e7b-a665-4e64-80b5-a8e495ebf4ad tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:02.169268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e9cb2e7b-a665-4e64-80b5-a8e495ebf4ad tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:02.169809 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e9cb2e7b-a665-4e64-80b5-a8e495ebf4ad tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:02.170249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e9cb2e7b-a665-4e64-80b5-a8e495ebf4ad tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:02.172064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e9cb2e7b-a665-4e64-80b5-a8e495ebf4ad tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:02.172665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e9cb2e7b-a665-4e64-80b5-a8e495ebf4ad tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:02.173246 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e9cb2e7b-a665-4e64-80b5-a8e495ebf4ad tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:02.361709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e9cb2e7b-a665-4e64-80b5-a8e495ebf4ad tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:02.371932 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e9cb2e7b-a665-4e64-80b5-a8e495ebf4ad tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.216227 Oct 05 02:51:02.373133 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2353/4703] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:02 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:02.399860 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ba24d598-8658-4071-bf87-968dfb4d806a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:02.400801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ba24d598-8658-4071-bf87-968dfb4d806a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:02.411034 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ba24d598-8658-4071-bf87-968dfb4d806a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:02.415032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ba24d598-8658-4071-bf87-968dfb4d806a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:02.415708 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ba24d598-8658-4071-bf87-968dfb4d806a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:02.416453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ba24d598-8658-4071-bf87-968dfb4d806a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:02.416932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ba24d598-8658-4071-bf87-968dfb4d806a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:02.418333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ba24d598-8658-4071-bf87-968dfb4d806a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:02.675940 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ba24d598-8658-4071-bf87-968dfb4d806a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:02.689418 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ba24d598-8658-4071-bf87-968dfb4d806a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.292907 Oct 05 02:51:02.689418 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2351/4704] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:02 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:02.709434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-804e6003-9321-4dcd-bda9-51bd04630352 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:02.711442 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-804e6003-9321-4dcd-bda9-51bd04630352 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:02.723786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-804e6003-9321-4dcd-bda9-51bd04630352 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:02.727744 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-804e6003-9321-4dcd-bda9-51bd04630352 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:02.728705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-804e6003-9321-4dcd-bda9-51bd04630352 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:02.731430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-804e6003-9321-4dcd-bda9-51bd04630352 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:02.732960 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-804e6003-9321-4dcd-bda9-51bd04630352 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:02.733600 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-804e6003-9321-4dcd-bda9-51bd04630352 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:03.000220 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-804e6003-9321-4dcd-bda9-51bd04630352 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:03.015862 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-804e6003-9321-4dcd-bda9-51bd04630352 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.310565 Oct 05 02:51:03.017444 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2354/4705] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:02 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:03.046016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e81080fe-1ff7-42ca-9168-4e7c3d455690 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:51:03.060456 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e81080fe-1ff7-42ca-9168-4e7c3d455690 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:03.065297 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e81080fe-1ff7-42ca-9168-4e7c3d455690 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:03.066019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e81080fe-1ff7-42ca-9168-4e7c3d455690 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:03.121231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e81080fe-1ff7-42ca-9168-4e7c3d455690 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Going to try to stop instance {{(pid=122319) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 05 02:51:03.240003 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e81080fe-1ff7-42ca-9168-4e7c3d455690 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action" status: 202 len: 0 microversion: 2.1 time: 0.199465 Oct 05 02:51:03.248061 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2352/4706] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:51:03 2022] POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:51:03.251907 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8571f144-5d82-4a57-9e42-47c9c4427831 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:03.252532 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8571f144-5d82-4a57-9e42-47c9c4427831 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:03.262909 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8571f144-5d82-4a57-9e42-47c9c4427831 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:03.263961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8571f144-5d82-4a57-9e42-47c9c4427831 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:03.265595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8571f144-5d82-4a57-9e42-47c9c4427831 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:03.266516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8571f144-5d82-4a57-9e42-47c9c4427831 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:03.270331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8571f144-5d82-4a57-9e42-47c9c4427831 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:03.271014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8571f144-5d82-4a57-9e42-47c9c4427831 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:03.848382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8571f144-5d82-4a57-9e42-47c9c4427831 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:03.870332 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8571f144-5d82-4a57-9e42-47c9c4427831 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1679 microversion: 2.1 time: 0.621278 Oct 05 02:51:03.871281 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2355/4707] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:03 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1679 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:04.896337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a6eb51ed-b4f9-4b1e-8517-758955ba51d3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:04.897432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a6eb51ed-b4f9-4b1e-8517-758955ba51d3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:04.909885 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:04.920175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6eb51ed-b4f9-4b1e-8517-758955ba51d3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:04.921316 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6eb51ed-b4f9-4b1e-8517-758955ba51d3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:04.923709 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6eb51ed-b4f9-4b1e-8517-758955ba51d3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:04.925197 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6eb51ed-b4f9-4b1e-8517-758955ba51d3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:04.925894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6eb51ed-b4f9-4b1e-8517-758955ba51d3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:04.927450 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6eb51ed-b4f9-4b1e-8517-758955ba51d3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:05.918774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a6eb51ed-b4f9-4b1e-8517-758955ba51d3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:05.936469 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a6eb51ed-b4f9-4b1e-8517-758955ba51d3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1679 microversion: 2.1 time: 1.043446 Oct 05 02:51:05.939504 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2353/4708] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:04 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1679 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:06.967740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fa737fb1-bcdb-4688-b954-ddaea7c8913d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:06.968445 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fa737fb1-bcdb-4688-b954-ddaea7c8913d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:06.985649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fa737fb1-bcdb-4688-b954-ddaea7c8913d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:06.987662 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fa737fb1-bcdb-4688-b954-ddaea7c8913d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:06.988524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fa737fb1-bcdb-4688-b954-ddaea7c8913d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:06.989721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fa737fb1-bcdb-4688-b954-ddaea7c8913d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:06.991036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fa737fb1-bcdb-4688-b954-ddaea7c8913d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:06.993176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fa737fb1-bcdb-4688-b954-ddaea7c8913d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:07.984783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fa737fb1-bcdb-4688-b954-ddaea7c8913d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:08.011294 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fa737fb1-bcdb-4688-b954-ddaea7c8913d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1679 microversion: 2.1 time: 1.048731 Oct 05 02:51:08.028786 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2356/4709] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:06 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1679 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:09.063595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e2cff467-1b17-4241-94b3-f9c8dc0e8a26 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:09.064934 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e2cff467-1b17-4241-94b3-f9c8dc0e8a26 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:09.080700 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e2cff467-1b17-4241-94b3-f9c8dc0e8a26 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:09.087910 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e2cff467-1b17-4241-94b3-f9c8dc0e8a26 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:09.091880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e2cff467-1b17-4241-94b3-f9c8dc0e8a26 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:09.094160 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e2cff467-1b17-4241-94b3-f9c8dc0e8a26 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:09.097162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e2cff467-1b17-4241-94b3-f9c8dc0e8a26 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:09.098192 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e2cff467-1b17-4241-94b3-f9c8dc0e8a26 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:09.728826 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e2cff467-1b17-4241-94b3-f9c8dc0e8a26 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:09.742280 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e2cff467-1b17-4241-94b3-f9c8dc0e8a26 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1679 microversion: 2.1 time: 0.680456 Oct 05 02:51:09.745204 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2354/4710] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:09 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1679 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:10.774179 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b8629036-bd89-4e4a-835f-cfcb24a7d101 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:10.776122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b8629036-bd89-4e4a-835f-cfcb24a7d101 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:10.806550 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8629036-bd89-4e4a-835f-cfcb24a7d101 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:10.809976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8629036-bd89-4e4a-835f-cfcb24a7d101 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:10.812093 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8629036-bd89-4e4a-835f-cfcb24a7d101 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:10.814020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8629036-bd89-4e4a-835f-cfcb24a7d101 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:10.814808 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8629036-bd89-4e4a-835f-cfcb24a7d101 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:10.817657 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8629036-bd89-4e4a-835f-cfcb24a7d101 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:11.155011 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b8629036-bd89-4e4a-835f-cfcb24a7d101 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:11.169560 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b8629036-bd89-4e4a-835f-cfcb24a7d101 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1679 microversion: 2.1 time: 0.400961 Oct 05 02:51:11.173965 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2357/4711] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:10 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1679 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:12.110672 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1955f0fd-4577-451f-aeb1-0dc63a20db77 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-14730689", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:51:12.198087 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6124e51e-8695-4709-9163-9f22b814e604 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:12.198809 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6124e51e-8695-4709-9163-9f22b814e604 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:12.216848 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6124e51e-8695-4709-9163-9f22b814e604 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:12.218301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6124e51e-8695-4709-9163-9f22b814e604 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:12.219340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6124e51e-8695-4709-9163-9f22b814e604 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:12.221805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6124e51e-8695-4709-9163-9f22b814e604 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:12.222909 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6124e51e-8695-4709-9163-9f22b814e604 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:12.226039 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6124e51e-8695-4709-9163-9f22b814e604 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:12.252396 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-1955f0fd-4577-451f-aeb1-0dc63a20db77 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] validate_networks() for [('e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:51:12.808210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6124e51e-8695-4709-9163-9f22b814e604 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:12.827907 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6124e51e-8695-4709-9163-9f22b814e604 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1679 microversion: 2.1 time: 0.633926 Oct 05 02:51:12.862811 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2358/4712] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:12 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1679 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:13.603924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-1955f0fd-4577-451f-aeb1-0dc63a20db77 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:51:13.604440 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-1955f0fd-4577-451f-aeb1-0dc63a20db77 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:51:13.604819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-1955f0fd-4577-451f-aeb1-0dc63a20db77 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:51:13.605263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-1955f0fd-4577-451f-aeb1-0dc63a20db77 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:51:13.605662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-1955f0fd-4577-451f-aeb1-0dc63a20db77 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:51:13.641237 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1955f0fd-4577-451f-aeb1-0dc63a20db77 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:13.644577 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1955f0fd-4577-451f-aeb1-0dc63a20db77 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:13.645176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1955f0fd-4577-451f-aeb1-0dc63a20db77 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:13.646721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1955f0fd-4577-451f-aeb1-0dc63a20db77 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:13.647505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1955f0fd-4577-451f-aeb1-0dc63a20db77 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:13.648005 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1955f0fd-4577-451f-aeb1-0dc63a20db77 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:13.698149 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-1955f0fd-4577-451f-aeb1-0dc63a20db77 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Getting quotas for project c76521b0c2f8465b866756ccc9c299e4. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:51:13.730776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-1955f0fd-4577-451f-aeb1-0dc63a20db77 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Getting quotas for user fa65476b76e749cdab6ad9e7e77e79b7 and project c76521b0c2f8465b866756ccc9c299e4. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:51:13.758501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1955f0fd-4577-451f-aeb1-0dc63a20db77 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:51:13.758501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1955f0fd-4577-451f-aeb1-0dc63a20db77 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:51:13.848720 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1955f0fd-4577-451f-aeb1-0dc63a20db77 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.160253 Oct 05 02:51:13.850125 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2355/4713] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:51:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:51:13.861960 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5627c8ff-972c-4308-8161-f6a26cd0b399 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:13.862589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5627c8ff-972c-4308-8161-f6a26cd0b399 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:13.878820 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6a84b5ef-074f-4453-9c39-dcc5e2906bc3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:13.879475 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6a84b5ef-074f-4453-9c39-dcc5e2906bc3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:13.896132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a84b5ef-074f-4453-9c39-dcc5e2906bc3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:13.897994 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a84b5ef-074f-4453-9c39-dcc5e2906bc3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:13.900888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a84b5ef-074f-4453-9c39-dcc5e2906bc3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:13.902933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a84b5ef-074f-4453-9c39-dcc5e2906bc3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:13.907988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a84b5ef-074f-4453-9c39-dcc5e2906bc3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:13.908629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a84b5ef-074f-4453-9c39-dcc5e2906bc3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:14.012353 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5627c8ff-972c-4308-8161-f6a26cd0b399 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:14.023974 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5627c8ff-972c-4308-8161-f6a26cd0b399 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1215 microversion: 2.1 time: 0.165733 Oct 05 02:51:14.033166 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2359/4714] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:13 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1215 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:14.240672 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6a84b5ef-074f-4453-9c39-dcc5e2906bc3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:14.250034 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6a84b5ef-074f-4453-9c39-dcc5e2906bc3 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1656 microversion: 2.1 time: 0.382954 Oct 05 02:51:14.261727 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2356/4715] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:13 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1656 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:14.293424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-636fea96-6fa1-4e8a-b4bc-de47728604d7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:51:14.308237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-636fea96-6fa1-4e8a-b4bc-de47728604d7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:14.308746 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-636fea96-6fa1-4e8a-b4bc-de47728604d7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:14.312310 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-636fea96-6fa1-4e8a-b4bc-de47728604d7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:14.389431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-636fea96-6fa1-4e8a-b4bc-de47728604d7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Going to try to start instance {{(pid=122320) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 05 02:51:14.498657 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-636fea96-6fa1-4e8a-b4bc-de47728604d7 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action" status: 202 len: 0 microversion: 2.1 time: 0.216948 Oct 05 02:51:14.502589 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2360/4716] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:51:14 2022] POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:51:14.511871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-31d23f12-1577-4bbf-9f38-900864627078 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:14.514758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-31d23f12-1577-4bbf-9f38-900864627078 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:14.534429 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-31d23f12-1577-4bbf-9f38-900864627078 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:14.535315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-31d23f12-1577-4bbf-9f38-900864627078 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:14.536778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-31d23f12-1577-4bbf-9f38-900864627078 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:14.543780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-31d23f12-1577-4bbf-9f38-900864627078 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:14.545173 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-31d23f12-1577-4bbf-9f38-900864627078 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:14.545963 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-31d23f12-1577-4bbf-9f38-900864627078 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:14.980228 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-31d23f12-1577-4bbf-9f38-900864627078 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:15.024823 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-31d23f12-1577-4bbf-9f38-900864627078 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1665 microversion: 2.1 time: 0.517419 Oct 05 02:51:15.027203 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2357/4717] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:14 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1665 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:15.053055 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a9230fa4-df2a-4f40-9f9e-bc76ad746e56 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:15.055172 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a9230fa4-df2a-4f40-9f9e-bc76ad746e56 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:15.076015 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9230fa4-df2a-4f40-9f9e-bc76ad746e56 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:15.076515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9230fa4-df2a-4f40-9f9e-bc76ad746e56 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:15.090138 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9230fa4-df2a-4f40-9f9e-bc76ad746e56 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:15.091056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9230fa4-df2a-4f40-9f9e-bc76ad746e56 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:15.094068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9230fa4-df2a-4f40-9f9e-bc76ad746e56 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:15.095458 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9230fa4-df2a-4f40-9f9e-bc76ad746e56 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:15.400979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a9230fa4-df2a-4f40-9f9e-bc76ad746e56 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:15.419036 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a9230fa4-df2a-4f40-9f9e-bc76ad746e56 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1219 microversion: 2.1 time: 0.365724 Oct 05 02:51:15.419726 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2361/4718] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:15 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1219 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:16.061261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-37b427d9-9a3f-463f-8d7a-18e0ad403dd5 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:16.061945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-37b427d9-9a3f-463f-8d7a-18e0ad403dd5 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:16.074080 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37b427d9-9a3f-463f-8d7a-18e0ad403dd5 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:16.074578 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37b427d9-9a3f-463f-8d7a-18e0ad403dd5 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:16.075016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37b427d9-9a3f-463f-8d7a-18e0ad403dd5 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:16.084359 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37b427d9-9a3f-463f-8d7a-18e0ad403dd5 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:16.084884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37b427d9-9a3f-463f-8d7a-18e0ad403dd5 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:16.087138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37b427d9-9a3f-463f-8d7a-18e0ad403dd5 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:16.308843 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-37b427d9-9a3f-463f-8d7a-18e0ad403dd5 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:16.318051 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-37b427d9-9a3f-463f-8d7a-18e0ad403dd5 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1665 microversion: 2.1 time: 0.263239 Oct 05 02:51:16.333317 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2358/4719] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:16 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1665 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:16.444507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e01a6bcd-b9da-4f62-be91-a29bfc064e1d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:16.445361 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e01a6bcd-b9da-4f62-be91-a29bfc064e1d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:16.455616 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e01a6bcd-b9da-4f62-be91-a29bfc064e1d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:16.459587 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e01a6bcd-b9da-4f62-be91-a29bfc064e1d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:16.460126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e01a6bcd-b9da-4f62-be91-a29bfc064e1d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:16.461062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e01a6bcd-b9da-4f62-be91-a29bfc064e1d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:16.462923 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e01a6bcd-b9da-4f62-be91-a29bfc064e1d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:16.463464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e01a6bcd-b9da-4f62-be91-a29bfc064e1d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:16.729416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e01a6bcd-b9da-4f62-be91-a29bfc064e1d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:16.744175 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e01a6bcd-b9da-4f62-be91-a29bfc064e1d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1267 microversion: 2.1 time: 0.303993 Oct 05 02:51:16.747039 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2362/4720] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:16 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1267 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:16.854894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-401f3bbc-082e-4979-ac67-c452dfd2807f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:16.855815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-401f3bbc-082e-4979-ac67-c452dfd2807f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:16.885739 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-401f3bbc-082e-4979-ac67-c452dfd2807f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:16.889316 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-401f3bbc-082e-4979-ac67-c452dfd2807f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:16.893157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-401f3bbc-082e-4979-ac67-c452dfd2807f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:16.894449 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-401f3bbc-082e-4979-ac67-c452dfd2807f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:16.897429 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-401f3bbc-082e-4979-ac67-c452dfd2807f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:16.898955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-401f3bbc-082e-4979-ac67-c452dfd2807f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:16.966371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-401f3bbc-082e-4979-ac67-c452dfd2807f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:51:17.054388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:17.131037 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-401f3bbc-082e-4979-ac67-c452dfd2807f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 204 len: 0 microversion: 2.42 time: 0.281929 Oct 05 02:51:17.132153 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2359/4721] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 5 02:51:16 2022] DELETE /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 05 02:51:17.141289 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a5211284-25d5-4857-8795-e76cda4b802e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:17.142462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a5211284-25d5-4857-8795-e76cda4b802e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:17.156399 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5211284-25d5-4857-8795-e76cda4b802e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:17.160163 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5211284-25d5-4857-8795-e76cda4b802e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:17.163058 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5211284-25d5-4857-8795-e76cda4b802e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:17.164545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5211284-25d5-4857-8795-e76cda4b802e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:17.168515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5211284-25d5-4857-8795-e76cda4b802e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:17.181293 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5211284-25d5-4857-8795-e76cda4b802e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:17.364616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fb743293-66df-485e-8fad-ed4f0c461739 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:17.365402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fb743293-66df-485e-8fad-ed4f0c461739 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:17.393464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb743293-66df-485e-8fad-ed4f0c461739 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:17.394446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb743293-66df-485e-8fad-ed4f0c461739 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:17.394950 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb743293-66df-485e-8fad-ed4f0c461739 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:17.395846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb743293-66df-485e-8fad-ed4f0c461739 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:17.396325 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb743293-66df-485e-8fad-ed4f0c461739 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:17.396767 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb743293-66df-485e-8fad-ed4f0c461739 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:18.198719 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fb743293-66df-485e-8fad-ed4f0c461739 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:18.222320 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fb743293-66df-485e-8fad-ed4f0c461739 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.864319 Oct 05 02:51:18.223874 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2360/4722] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:17 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:18.232352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cf179f06-9e0c-4d12-8dac-0933212395f4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:18.233449 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cf179f06-9e0c-4d12-8dac-0933212395f4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:18.262129 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf179f06-9e0c-4d12-8dac-0933212395f4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:18.265809 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf179f06-9e0c-4d12-8dac-0933212395f4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:18.270761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf179f06-9e0c-4d12-8dac-0933212395f4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:18.271971 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf179f06-9e0c-4d12-8dac-0933212395f4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:18.274606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf179f06-9e0c-4d12-8dac-0933212395f4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:18.276188 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf179f06-9e0c-4d12-8dac-0933212395f4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:18.524168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cf179f06-9e0c-4d12-8dac-0933212395f4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:18.535770 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cf179f06-9e0c-4d12-8dac-0933212395f4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1273 microversion: 2.1 time: 0.310678 Oct 05 02:51:18.537772 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2361/4723] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:18 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1273 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:18.552426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-192be588-7801-45b4-a7d3-35006eddd508 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:18.553248 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-192be588-7801-45b4-a7d3-35006eddd508 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:18.565828 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-192be588-7801-45b4-a7d3-35006eddd508 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:18.566714 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-192be588-7801-45b4-a7d3-35006eddd508 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:18.567389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-192be588-7801-45b4-a7d3-35006eddd508 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:18.568380 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-192be588-7801-45b4-a7d3-35006eddd508 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:18.569107 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-192be588-7801-45b4-a7d3-35006eddd508 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:18.569766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-192be588-7801-45b4-a7d3-35006eddd508 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:18.848782 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a5211284-25d5-4857-8795-e76cda4b802e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:18.864605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a5211284-25d5-4857-8795-e76cda4b802e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:18.870351 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a5211284-25d5-4857-8795-e76cda4b802e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:18.871965 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a5211284-25d5-4857-8795-e76cda4b802e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 2963 microversion: 2.42 time: 1.734811 Oct 05 02:51:18.872541 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2363/4724] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:51:17 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 2963 bytes in 1736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:51:18.987762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-192be588-7801-45b4-a7d3-35006eddd508 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:19.000714 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-192be588-7801-45b4-a7d3-35006eddd508 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.452042 Oct 05 02:51:19.001503 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2362/4725] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:18 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:19.035665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cd9ec62e-13eb-415e-8564-43ec8d5fb406 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:19.036291 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cd9ec62e-13eb-415e-8564-43ec8d5fb406 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:19.046069 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd9ec62e-13eb-415e-8564-43ec8d5fb406 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:19.046583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd9ec62e-13eb-415e-8564-43ec8d5fb406 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:19.047011 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd9ec62e-13eb-415e-8564-43ec8d5fb406 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:19.047714 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd9ec62e-13eb-415e-8564-43ec8d5fb406 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:19.048171 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd9ec62e-13eb-415e-8564-43ec8d5fb406 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:19.048596 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd9ec62e-13eb-415e-8564-43ec8d5fb406 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:19.560414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-86f2f1ab-44a7-4e02-975f-6875a5fb8762 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:19.561337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-86f2f1ab-44a7-4e02-975f-6875a5fb8762 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:19.572191 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86f2f1ab-44a7-4e02-975f-6875a5fb8762 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:19.578911 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86f2f1ab-44a7-4e02-975f-6875a5fb8762 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:19.579675 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86f2f1ab-44a7-4e02-975f-6875a5fb8762 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:19.580648 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86f2f1ab-44a7-4e02-975f-6875a5fb8762 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:19.581527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86f2f1ab-44a7-4e02-975f-6875a5fb8762 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:19.582212 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86f2f1ab-44a7-4e02-975f-6875a5fb8762 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:19.691260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cd9ec62e-13eb-415e-8564-43ec8d5fb406 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:19.701948 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cd9ec62e-13eb-415e-8564-43ec8d5fb406 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.670686 Oct 05 02:51:19.703626 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2364/4726] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:19 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:19.740508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a694a950-a465-40e2-a847-ce3cc3ac3418 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:19.744067 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a694a950-a465-40e2-a847-ce3cc3ac3418 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:19.762586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a694a950-a465-40e2-a847-ce3cc3ac3418 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:19.763334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a694a950-a465-40e2-a847-ce3cc3ac3418 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:19.763946 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a694a950-a465-40e2-a847-ce3cc3ac3418 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:19.765141 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a694a950-a465-40e2-a847-ce3cc3ac3418 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:19.765775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a694a950-a465-40e2-a847-ce3cc3ac3418 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:19.766766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a694a950-a465-40e2-a847-ce3cc3ac3418 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:20.103586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-86f2f1ab-44a7-4e02-975f-6875a5fb8762 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:20.112475 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-86f2f1ab-44a7-4e02-975f-6875a5fb8762 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1315 microversion: 2.1 time: 0.555839 Oct 05 02:51:20.136420 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2363/4727] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:19 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1315 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:51:20.142563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6f0f0225-926c-4077-b69b-10c6fad37518 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:20.148140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6f0f0225-926c-4077-b69b-10c6fad37518 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:20.172154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f0f0225-926c-4077-b69b-10c6fad37518 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:20.177245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f0f0225-926c-4077-b69b-10c6fad37518 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:20.177672 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f0f0225-926c-4077-b69b-10c6fad37518 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:20.181273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f0f0225-926c-4077-b69b-10c6fad37518 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:20.181950 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f0f0225-926c-4077-b69b-10c6fad37518 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:20.190514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6f0f0225-926c-4077-b69b-10c6fad37518 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:20.383391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a694a950-a465-40e2-a847-ce3cc3ac3418 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:20.399532 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a694a950-a465-40e2-a847-ce3cc3ac3418 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.672838 Oct 05 02:51:20.411008 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2365/4728] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:19 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:20.431820 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e93592d3-fe36-4e1a-bdc8-52d36ae2f756 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:20.432569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e93592d3-fe36-4e1a-bdc8-52d36ae2f756 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:20.443138 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e93592d3-fe36-4e1a-bdc8-52d36ae2f756 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:20.443541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e93592d3-fe36-4e1a-bdc8-52d36ae2f756 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:20.443980 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e93592d3-fe36-4e1a-bdc8-52d36ae2f756 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:20.444698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e93592d3-fe36-4e1a-bdc8-52d36ae2f756 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:20.453777 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e93592d3-fe36-4e1a-bdc8-52d36ae2f756 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:20.454322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e93592d3-fe36-4e1a-bdc8-52d36ae2f756 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:21.135420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6f0f0225-926c-4077-b69b-10c6fad37518 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:21.170090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6f0f0225-926c-4077-b69b-10c6fad37518 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:21.172097 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6f0f0225-926c-4077-b69b-10c6fad37518 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:21.173763 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6f0f0225-926c-4077-b69b-10c6fad37518 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 2963 microversion: 2.42 time: 1.034969 Oct 05 02:51:21.177313 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2364/4729] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:51:20 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 2963 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:51:21.192092 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b2435d8d-f832-431c-b74c-88e475c52b36 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:21.193462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b2435d8d-f832-431c-b74c-88e475c52b36 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:21.209626 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2435d8d-f832-431c-b74c-88e475c52b36 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:21.210401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2435d8d-f832-431c-b74c-88e475c52b36 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:21.211567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2435d8d-f832-431c-b74c-88e475c52b36 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:21.212694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2435d8d-f832-431c-b74c-88e475c52b36 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:21.213639 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2435d8d-f832-431c-b74c-88e475c52b36 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:21.214524 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2435d8d-f832-431c-b74c-88e475c52b36 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:22.377431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e93592d3-fe36-4e1a-bdc8-52d36ae2f756 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:22.393848 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e93592d3-fe36-4e1a-bdc8-52d36ae2f756 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 1.960026 Oct 05 02:51:22.396809 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2366/4730] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:20 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 1970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:22.413514 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e7d1848f-075b-4cab-b3c1-b937e213394e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:22.414814 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e7d1848f-075b-4cab-b3c1-b937e213394e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:22.431754 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7d1848f-075b-4cab-b3c1-b937e213394e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:22.432586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7d1848f-075b-4cab-b3c1-b937e213394e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:22.434277 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7d1848f-075b-4cab-b3c1-b937e213394e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:22.434847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7d1848f-075b-4cab-b3c1-b937e213394e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:22.435516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7d1848f-075b-4cab-b3c1-b937e213394e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:22.437267 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7d1848f-075b-4cab-b3c1-b937e213394e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:22.759183 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b2435d8d-f832-431c-b74c-88e475c52b36 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:22.769485 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b2435d8d-f832-431c-b74c-88e475c52b36 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1315 microversion: 2.1 time: 1.588351 Oct 05 02:51:22.774535 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2365/4731] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:21 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1315 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:23.162699 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e7d1848f-075b-4cab-b3c1-b937e213394e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:23.185671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e7d1848f-075b-4cab-b3c1-b937e213394e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:23.191902 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e7d1848f-075b-4cab-b3c1-b937e213394e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:23.193681 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e7d1848f-075b-4cab-b3c1-b937e213394e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 2963 microversion: 2.42 time: 0.795260 Oct 05 02:51:23.194807 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2367/4732] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:51:22 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 2963 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:51:23.325137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0c658043-b7f3-4f48-b2fc-1fbef408b86e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:51:23.326044 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0c658043-b7f3-4f48-b2fc-1fbef408b86e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:23.336492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c658043-b7f3-4f48-b2fc-1fbef408b86e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:23.337366 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c658043-b7f3-4f48-b2fc-1fbef408b86e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:23.338320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c658043-b7f3-4f48-b2fc-1fbef408b86e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:23.339554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c658043-b7f3-4f48-b2fc-1fbef408b86e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:23.340689 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c658043-b7f3-4f48-b2fc-1fbef408b86e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:23.341355 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c658043-b7f3-4f48-b2fc-1fbef408b86e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:23.464133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-0c658043-b7f3-4f48-b2fc-1fbef408b86e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lazy-loading 'flavor' on Instance uuid 4388e9ec-13a9-4d5b-9310-7a10953c57d0 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:51:23.682993 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:23.718762 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0c658043-b7f3-4f48-b2fc-1fbef408b86e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action" status: 202 len: 0 microversion: 2.1 time: 0.942550 Oct 05 02:51:23.722041 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2366/4733] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:51:22 2022] POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action => generated 0 bytes in 947 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:51:23.737232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-18c54ad8-a929-4c10-8de5-d0d24354061a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:23.738702 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-18c54ad8-a929-4c10-8de5-d0d24354061a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:23.762937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18c54ad8-a929-4c10-8de5-d0d24354061a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:23.766332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18c54ad8-a929-4c10-8de5-d0d24354061a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:23.767033 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18c54ad8-a929-4c10-8de5-d0d24354061a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:23.768149 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18c54ad8-a929-4c10-8de5-d0d24354061a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:23.768774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18c54ad8-a929-4c10-8de5-d0d24354061a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:23.769379 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18c54ad8-a929-4c10-8de5-d0d24354061a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:23.808485 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:23.817368 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e5716946-5e8b-4d8b-a16c-1ea2010f6257 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:23.817368 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e5716946-5e8b-4d8b-a16c-1ea2010f6257 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:23.840694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5716946-5e8b-4d8b-a16c-1ea2010f6257 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:23.843117 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5716946-5e8b-4d8b-a16c-1ea2010f6257 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:23.845085 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5716946-5e8b-4d8b-a16c-1ea2010f6257 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:23.845830 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5716946-5e8b-4d8b-a16c-1ea2010f6257 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:23.850677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5716946-5e8b-4d8b-a16c-1ea2010f6257 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:23.853695 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5716946-5e8b-4d8b-a16c-1ea2010f6257 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:24.017112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:24.630012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-18c54ad8-a929-4c10-8de5-d0d24354061a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:24.650877 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e5716946-5e8b-4d8b-a16c-1ea2010f6257 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:24.672656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:24.719972 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e5716946-5e8b-4d8b-a16c-1ea2010f6257 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1315 microversion: 2.1 time: 0.909505 Oct 05 02:51:24.722057 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2367/4734] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:23 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1315 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:24.724933 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-18c54ad8-a929-4c10-8de5-d0d24354061a tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1677 microversion: 2.1 time: 0.995361 Oct 05 02:51:24.731008 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2368/4735] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:23 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1677 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:24.745074 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-57c6b0c2-9e96-4d6d-aa68-f341dbdb62a5 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:24.747042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-57c6b0c2-9e96-4d6d-aa68-f341dbdb62a5 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:24.748965 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-bde36da3-8c76-411f-a399-82faf6e306ee req-9b5b5299-4195-4b8a-b01d-f47863dc30ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a710dba5-18ef-4840-835b-06b1fc2bde87", "name": "network-vif-unplugged", "status": "completed", "tag": "88922211-2f92-4989-937c-6c447b45f0b1"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:51:24.767809 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-57c6b0c2-9e96-4d6d-aa68-f341dbdb62a5 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:24.768452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-57c6b0c2-9e96-4d6d-aa68-f341dbdb62a5 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:24.770901 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-57c6b0c2-9e96-4d6d-aa68-f341dbdb62a5 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:24.776196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-57c6b0c2-9e96-4d6d-aa68-f341dbdb62a5 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:24.778533 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-57c6b0c2-9e96-4d6d-aa68-f341dbdb62a5 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:24.782255 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-57c6b0c2-9e96-4d6d-aa68-f341dbdb62a5 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:24.792954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-bde36da3-8c76-411f-a399-82faf6e306ee req-9b5b5299-4195-4b8a-b01d-f47863dc30ae service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:24.793743 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-bde36da3-8c76-411f-a399-82faf6e306ee req-9b5b5299-4195-4b8a-b01d-f47863dc30ae service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:24.794557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-bde36da3-8c76-411f-a399-82faf6e306ee req-9b5b5299-4195-4b8a-b01d-f47863dc30ae service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:24.817264 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-bde36da3-8c76-411f-a399-82faf6e306ee req-9b5b5299-4195-4b8a-b01d-f47863dc30ae service nova] Creating event network-vif-unplugged:88922211-2f92-4989-937c-6c447b45f0b1 for instance a710dba5-18ef-4840-835b-06b1fc2bde87 on n-h1-858272-3 Oct 05 02:51:24.827671 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-bde36da3-8c76-411f-a399-82faf6e306ee req-9b5b5299-4195-4b8a-b01d-f47863dc30ae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092520 Oct 05 02:51:24.828840 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2369/4736] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:51:25.121558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-cd30fa88-a5b4-4113-bb9a-8b760f90a07b req-18d00862-a781-435e-a2db-cd74aa93809d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fded3d6-d275-4d50-a366-d19388f8aaec", "tag": "877cbc45-f570-4bb6-bcd2-91b67dbccdb3"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:51:25.146742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-cd30fa88-a5b4-4113-bb9a-8b760f90a07b req-18d00862-a781-435e-a2db-cd74aa93809d service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:25.147741 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-cd30fa88-a5b4-4113-bb9a-8b760f90a07b req-18d00862-a781-435e-a2db-cd74aa93809d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:25.150186 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-cd30fa88-a5b4-4113-bb9a-8b760f90a07b req-18d00862-a781-435e-a2db-cd74aa93809d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:25.173612 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-cd30fa88-a5b4-4113-bb9a-8b760f90a07b req-18d00862-a781-435e-a2db-cd74aa93809d service nova] Creating event network-changed:877cbc45-f570-4bb6-bcd2-91b67dbccdb3 for instance 1fded3d6-d275-4d50-a366-d19388f8aaec on n-h2-858272-3 Oct 05 02:51:25.187472 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-cd30fa88-a5b4-4113-bb9a-8b760f90a07b req-18d00862-a781-435e-a2db-cd74aa93809d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087259 Oct 05 02:51:25.189430 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2370/4737] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:51:25.767276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3030b466-ac64-4bb3-b616-9846568a5f7e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:25.768734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3030b466-ac64-4bb3-b616-9846568a5f7e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:25.780153 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3030b466-ac64-4bb3-b616-9846568a5f7e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:25.784881 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3030b466-ac64-4bb3-b616-9846568a5f7e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:25.785533 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3030b466-ac64-4bb3-b616-9846568a5f7e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:25.787676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3030b466-ac64-4bb3-b616-9846568a5f7e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:25.791327 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3030b466-ac64-4bb3-b616-9846568a5f7e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:25.795137 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3030b466-ac64-4bb3-b616-9846568a5f7e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:26.166857 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-57c6b0c2-9e96-4d6d-aa68-f341dbdb62a5 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:26.192610 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-57c6b0c2-9e96-4d6d-aa68-f341dbdb62a5 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:26.198734 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-57c6b0c2-9e96-4d6d-aa68-f341dbdb62a5 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:26.202617 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-57c6b0c2-9e96-4d6d-aa68-f341dbdb62a5 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 2942 microversion: 2.42 time: 1.478253 Oct 05 02:51:26.221418 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2368/4738] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:51:24 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 2942 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:51:26.227082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5d563884-d37b-467d-aa26-55c51225f73d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:26.244270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5d563884-d37b-467d-aa26-55c51225f73d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:26.267968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d563884-d37b-467d-aa26-55c51225f73d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:26.270885 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d563884-d37b-467d-aa26-55c51225f73d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:26.274235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d563884-d37b-467d-aa26-55c51225f73d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:26.278617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d563884-d37b-467d-aa26-55c51225f73d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:26.279178 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d563884-d37b-467d-aa26-55c51225f73d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:26.279889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d563884-d37b-467d-aa26-55c51225f73d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:26.732676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3030b466-ac64-4bb3-b616-9846568a5f7e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:26.742180 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3030b466-ac64-4bb3-b616-9846568a5f7e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1660 microversion: 2.1 time: 0.980769 Oct 05 02:51:26.742792 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2371/4739] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:25 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1660 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:51:26.770512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f8348639-604b-48aa-b976-85738d15004f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:51:26.771818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f8348639-604b-48aa-b976-85738d15004f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:26.791709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8348639-604b-48aa-b976-85738d15004f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:26.791709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8348639-604b-48aa-b976-85738d15004f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:26.791709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8348639-604b-48aa-b976-85738d15004f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:26.791709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8348639-604b-48aa-b976-85738d15004f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:26.791709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8348639-604b-48aa-b976-85738d15004f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:26.791709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8348639-604b-48aa-b976-85738d15004f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:26.930034 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f8348639-604b-48aa-b976-85738d15004f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action" status: 202 len: 0 microversion: 2.1 time: 0.163114 Oct 05 02:51:26.936397 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2372/4740] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:51:26 2022] POST /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 02:51:26.942599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-f8b66b0e-a5cc-4456-b71b-4ee409874427 req-4a155371-f2fb-4640-bf7c-a410485a0f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a710dba5-18ef-4840-835b-06b1fc2bde87", "name": "network-vif-unplugged", "status": "completed", "tag": "a4b7823b-7c50-4314-99cb-dea5af5cfe33"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:51:26.957483 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f8b66b0e-a5cc-4456-b71b-4ee409874427 req-4a155371-f2fb-4640-bf7c-a410485a0f51 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:26.958412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f8b66b0e-a5cc-4456-b71b-4ee409874427 req-4a155371-f2fb-4640-bf7c-a410485a0f51 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:26.959209 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f8b66b0e-a5cc-4456-b71b-4ee409874427 req-4a155371-f2fb-4640-bf7c-a410485a0f51 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:26.986361 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-f8b66b0e-a5cc-4456-b71b-4ee409874427 req-4a155371-f2fb-4640-bf7c-a410485a0f51 service nova] Creating event network-vif-unplugged:a4b7823b-7c50-4314-99cb-dea5af5cfe33 for instance a710dba5-18ef-4840-835b-06b1fc2bde87 on n-h1-858272-3 Oct 05 02:51:26.999786 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-f8b66b0e-a5cc-4456-b71b-4ee409874427 req-4a155371-f2fb-4640-bf7c-a410485a0f51 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061247 Oct 05 02:51:27.000419 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2373/4741] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:51:27.011977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-406ce803-5c13-40fe-ac51-5f16fe22ef14 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:27.014383 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-406ce803-5c13-40fe-ac51-5f16fe22ef14 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:27.029849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-406ce803-5c13-40fe-ac51-5f16fe22ef14 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:27.031711 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-406ce803-5c13-40fe-ac51-5f16fe22ef14 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:27.032706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-406ce803-5c13-40fe-ac51-5f16fe22ef14 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:27.034574 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-406ce803-5c13-40fe-ac51-5f16fe22ef14 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:27.035763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-406ce803-5c13-40fe-ac51-5f16fe22ef14 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:27.036425 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-406ce803-5c13-40fe-ac51-5f16fe22ef14 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:27.269342 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5d563884-d37b-467d-aa26-55c51225f73d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:27.282571 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5d563884-d37b-467d-aa26-55c51225f73d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1315 microversion: 2.1 time: 1.059761 Oct 05 02:51:27.299751 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2369/4742] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:26 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1315 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:27.317714 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-671f0ceb-bde5-4c3d-aafe-596d7ff67c69 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:27.318673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-671f0ceb-bde5-4c3d-aafe-596d7ff67c69 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:27.326465 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-671f0ceb-bde5-4c3d-aafe-596d7ff67c69 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:27.328051 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-671f0ceb-bde5-4c3d-aafe-596d7ff67c69 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:27.328742 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-671f0ceb-bde5-4c3d-aafe-596d7ff67c69 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:27.329997 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-671f0ceb-bde5-4c3d-aafe-596d7ff67c69 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:27.330698 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-671f0ceb-bde5-4c3d-aafe-596d7ff67c69 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:27.331373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-671f0ceb-bde5-4c3d-aafe-596d7ff67c69 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:28.265415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-406ce803-5c13-40fe-ac51-5f16fe22ef14 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:28.274506 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-406ce803-5c13-40fe-ac51-5f16fe22ef14 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1666 microversion: 2.1 time: 1.272841 Oct 05 02:51:28.280974 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2374/4743] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:27 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1666 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:28.291653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-354c0e0b-3278-490b-be76-1a5f1ca421bf tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Action: 'create', calling method: .version_select at 0x7fcce804b1f0>, body: {"keypair": {"name": "tempest-keypair-2052496779", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrvEnPtatcdz0CRZiXBOmlhrDWbQMWF40LFJKP0UnLKhnOs5O6rBIezGXB4PmWEGf+NFYfPPMi11f0QyjUrehK7sur8W6hMoj0waCSneqv9spl81oM9WDL/T5oKvK0E1g=="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:51:28.346861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-354c0e0b-3278-490b-be76-1a5f1ca421bf tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Getting quotas for project df7f497ef84645d3bead6c2e54a7603d. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:51:28.358932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-354c0e0b-3278-490b-be76-1a5f1ca421bf tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Getting quotas for user ef5ed582f9d74e2f9bd5ea39f41a5017 and project df7f497ef84645d3bead6c2e54a7603d. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:51:28.387199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-671f0ceb-bde5-4c3d-aafe-596d7ff67c69 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:28.406404 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-354c0e0b-3278-490b-be76-1a5f1ca421bf tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.123183 Oct 05 02:51:28.408136 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2375/4744] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Oct 5 02:51:28 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 126 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 05 02:51:28.418474 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7e9f8c4e-5bb7-4c99-b291-e100d845ca61 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:28.419807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7e9f8c4e-5bb7-4c99-b291-e100d845ca61 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:28.426548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e9f8c4e-5bb7-4c99-b291-e100d845ca61 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:28.427457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e9f8c4e-5bb7-4c99-b291-e100d845ca61 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:28.428078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e9f8c4e-5bb7-4c99-b291-e100d845ca61 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:28.429171 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e9f8c4e-5bb7-4c99-b291-e100d845ca61 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:28.430902 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e9f8c4e-5bb7-4c99-b291-e100d845ca61 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:28.431579 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e9f8c4e-5bb7-4c99-b291-e100d845ca61 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:28.433610 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-671f0ceb-bde5-4c3d-aafe-596d7ff67c69 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:28.447660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-671f0ceb-bde5-4c3d-aafe-596d7ff67c69 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:28.452405 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-671f0ceb-bde5-4c3d-aafe-596d7ff67c69 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 2942 microversion: 2.42 time: 1.136817 Oct 05 02:51:28.470443 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2370/4745] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:51:27 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 2942 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:51:29.108287 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-2cdbb942-b6fa-4dec-8e0f-db71f7d6a7f7 req-ca18580e-8b2b-4c4c-a2dd-2b21ff2512a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a710dba5-18ef-4840-835b-06b1fc2bde87", "name": "network-vif-unplugged", "status": "completed", "tag": "c6b3e9fb-230c-4ce3-abab-896b74e674ca"}, {"server_uuid": "a710dba5-18ef-4840-835b-06b1fc2bde87", "name": "network-vif-unplugged", "status": "completed", "tag": "432071a7-edac-416f-aec1-3041b15ece3c"}, {"server_uuid": "a710dba5-18ef-4840-835b-06b1fc2bde87", "name": "network-vif-unplugged", "status": "completed", "tag": "8a8ea6c2-c534-4a07-92e6-de17c7a31bf2"}, {"server_uuid": "a710dba5-18ef-4840-835b-06b1fc2bde87", "name": "network-vif-unplugged", "status": "completed", "tag": "71f0f4da-1745-4447-9f63-d186fb5b9770"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:51:29.166206 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-2cdbb942-b6fa-4dec-8e0f-db71f7d6a7f7 req-ca18580e-8b2b-4c4c-a2dd-2b21ff2512a8 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:29.175749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-2cdbb942-b6fa-4dec-8e0f-db71f7d6a7f7 req-ca18580e-8b2b-4c4c-a2dd-2b21ff2512a8 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:29.178781 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-2cdbb942-b6fa-4dec-8e0f-db71f7d6a7f7 req-ca18580e-8b2b-4c4c-a2dd-2b21ff2512a8 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:29.241435 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-2cdbb942-b6fa-4dec-8e0f-db71f7d6a7f7 req-ca18580e-8b2b-4c4c-a2dd-2b21ff2512a8 service nova] Creating event network-vif-unplugged:c6b3e9fb-230c-4ce3-abab-896b74e674ca for instance a710dba5-18ef-4840-835b-06b1fc2bde87 on n-h1-858272-3 Oct 05 02:51:29.242881 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-2cdbb942-b6fa-4dec-8e0f-db71f7d6a7f7 req-ca18580e-8b2b-4c4c-a2dd-2b21ff2512a8 service nova] Creating event network-vif-unplugged:432071a7-edac-416f-aec1-3041b15ece3c for instance a710dba5-18ef-4840-835b-06b1fc2bde87 on n-h1-858272-3 Oct 05 02:51:29.243587 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-2cdbb942-b6fa-4dec-8e0f-db71f7d6a7f7 req-ca18580e-8b2b-4c4c-a2dd-2b21ff2512a8 service nova] Creating event network-vif-unplugged:8a8ea6c2-c534-4a07-92e6-de17c7a31bf2 for instance a710dba5-18ef-4840-835b-06b1fc2bde87 on n-h1-858272-3 Oct 05 02:51:29.244162 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-2cdbb942-b6fa-4dec-8e0f-db71f7d6a7f7 req-ca18580e-8b2b-4c4c-a2dd-2b21ff2512a8 service nova] Creating event network-vif-unplugged:71f0f4da-1745-4447-9f63-d186fb5b9770 for instance a710dba5-18ef-4840-835b-06b1fc2bde87 on n-h1-858272-3 Oct 05 02:51:29.263533 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-2cdbb942-b6fa-4dec-8e0f-db71f7d6a7f7 req-ca18580e-8b2b-4c4c-a2dd-2b21ff2512a8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.163125 Oct 05 02:51:29.264153 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2371/4746] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:51:29.308738 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-84a498bd-979b-4abc-80a6-955dcf443912 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:29.309465 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-84a498bd-979b-4abc-80a6-955dcf443912 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:29.320686 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84a498bd-979b-4abc-80a6-955dcf443912 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:29.321429 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84a498bd-979b-4abc-80a6-955dcf443912 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:29.321881 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84a498bd-979b-4abc-80a6-955dcf443912 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:29.322616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84a498bd-979b-4abc-80a6-955dcf443912 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:29.323152 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84a498bd-979b-4abc-80a6-955dcf443912 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:29.328037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84a498bd-979b-4abc-80a6-955dcf443912 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:29.709570 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7e9f8c4e-5bb7-4c99-b291-e100d845ca61 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:29.723949 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7e9f8c4e-5bb7-4c99-b291-e100d845ca61 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1315 microversion: 2.1 time: 1.312630 Oct 05 02:51:29.729723 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2376/4747] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:28 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1315 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:29.744481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-143bce8b-d918-4b93-9bf5-ef64a4d8813d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:29.746024 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-143bce8b-d918-4b93-9bf5-ef64a4d8813d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:29.769562 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-143bce8b-d918-4b93-9bf5-ef64a4d8813d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:29.773256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-143bce8b-d918-4b93-9bf5-ef64a4d8813d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:29.777707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-143bce8b-d918-4b93-9bf5-ef64a4d8813d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:29.778634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-143bce8b-d918-4b93-9bf5-ef64a4d8813d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:29.779230 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-143bce8b-d918-4b93-9bf5-ef64a4d8813d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:29.781405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-143bce8b-d918-4b93-9bf5-ef64a4d8813d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:30.793084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-143bce8b-d918-4b93-9bf5-ef64a4d8813d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:30.803468 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-143bce8b-d918-4b93-9bf5-ef64a4d8813d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:30.811061 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-143bce8b-d918-4b93-9bf5-ef64a4d8813d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:30.815442 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-143bce8b-d918-4b93-9bf5-ef64a4d8813d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 2921 microversion: 2.42 time: 1.078475 Oct 05 02:51:30.829860 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2377/4748] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:51:29 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 2921 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:51:30.847201 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3009d3c7-76f4-4bc0-abe1-e4215299ff89 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:30.850166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3009d3c7-76f4-4bc0-abe1-e4215299ff89 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:30.853236 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:30.883947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3009d3c7-76f4-4bc0-abe1-e4215299ff89 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:30.887506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3009d3c7-76f4-4bc0-abe1-e4215299ff89 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:30.887972 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3009d3c7-76f4-4bc0-abe1-e4215299ff89 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:30.889009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3009d3c7-76f4-4bc0-abe1-e4215299ff89 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:30.893003 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3009d3c7-76f4-4bc0-abe1-e4215299ff89 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:30.893486 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3009d3c7-76f4-4bc0-abe1-e4215299ff89 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:31.537152 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-84a498bd-979b-4abc-80a6-955dcf443912 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:31.548216 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-84a498bd-979b-4abc-80a6-955dcf443912 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1666 microversion: 2.1 time: 2.244105 Oct 05 02:51:31.549154 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2372/4749] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:29 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1666 bytes in 2246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:51:31.853324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3009d3c7-76f4-4bc0-abe1-e4215299ff89 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:31.859158 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-13ae9342-c4df-4201-9d56-274462920b75 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:31.860657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-13ae9342-c4df-4201-9d56-274462920b75 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:31.869367 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3009d3c7-76f4-4bc0-abe1-e4215299ff89 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1315 microversion: 2.1 time: 1.032017 Oct 05 02:51:31.870068 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2378/4750] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:30 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1315 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:31.875271 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-d193eed1-c07c-43a0-8bb1-d9d4c718ffb9 req-9d41af6d-8908-426f-ab6c-983ab2bb9e27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a710dba5-18ef-4840-835b-06b1fc2bde87", "name": "network-vif-deleted", "tag": "8a8ea6c2-c534-4a07-92e6-de17c7a31bf2"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:51:31.886472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13ae9342-c4df-4201-9d56-274462920b75 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:31.888863 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13ae9342-c4df-4201-9d56-274462920b75 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:31.889637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13ae9342-c4df-4201-9d56-274462920b75 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:31.894083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13ae9342-c4df-4201-9d56-274462920b75 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:31.894662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13ae9342-c4df-4201-9d56-274462920b75 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:31.895213 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13ae9342-c4df-4201-9d56-274462920b75 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:31.921367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d193eed1-c07c-43a0-8bb1-d9d4c718ffb9 req-9d41af6d-8908-426f-ab6c-983ab2bb9e27 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:31.921867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d193eed1-c07c-43a0-8bb1-d9d4c718ffb9 req-9d41af6d-8908-426f-ab6c-983ab2bb9e27 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:31.922308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d193eed1-c07c-43a0-8bb1-d9d4c718ffb9 req-9d41af6d-8908-426f-ab6c-983ab2bb9e27 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:31.974381 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-d193eed1-c07c-43a0-8bb1-d9d4c718ffb9 req-9d41af6d-8908-426f-ab6c-983ab2bb9e27 service nova] Creating event network-vif-deleted:8a8ea6c2-c534-4a07-92e6-de17c7a31bf2 for instance a710dba5-18ef-4840-835b-06b1fc2bde87 on n-h1-858272-3 Oct 05 02:51:31.990301 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-d193eed1-c07c-43a0-8bb1-d9d4c718ffb9 req-9d41af6d-8908-426f-ab6c-983ab2bb9e27 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115058 Oct 05 02:51:31.993640 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2379/4751] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:51:32.572193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-13ae9342-c4df-4201-9d56-274462920b75 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:32.581699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-13ae9342-c4df-4201-9d56-274462920b75 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:32.584503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5e4af847-3d9a-4761-a47c-8727da80f8b9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:32.586389 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5e4af847-3d9a-4761-a47c-8727da80f8b9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:32.594700 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-13ae9342-c4df-4201-9d56-274462920b75 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:32.595977 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-13ae9342-c4df-4201-9d56-274462920b75 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 2874 microversion: 2.42 time: 0.742415 Oct 05 02:51:32.597137 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2373/4752] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:51:31 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 2874 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:51:32.598130 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e4af847-3d9a-4761-a47c-8727da80f8b9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:32.599729 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e4af847-3d9a-4761-a47c-8727da80f8b9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:32.601133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e4af847-3d9a-4761-a47c-8727da80f8b9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:32.602598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e4af847-3d9a-4761-a47c-8727da80f8b9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:32.603541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e4af847-3d9a-4761-a47c-8727da80f8b9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:32.604142 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e4af847-3d9a-4761-a47c-8727da80f8b9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:32.900410 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2ca10d0d-c9cb-488f-a24c-490d0aa29b50 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:32.901163 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2ca10d0d-c9cb-488f-a24c-490d0aa29b50 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:32.907038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5e4af847-3d9a-4761-a47c-8727da80f8b9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:32.917230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ca10d0d-c9cb-488f-a24c-490d0aa29b50 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:32.920429 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ca10d0d-c9cb-488f-a24c-490d0aa29b50 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:32.922091 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5e4af847-3d9a-4761-a47c-8727da80f8b9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1666 microversion: 2.1 time: 0.350386 Oct 05 02:51:32.922737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ca10d0d-c9cb-488f-a24c-490d0aa29b50 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:32.923416 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2380/4753] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:32 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1666 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:51:32.927046 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ca10d0d-c9cb-488f-a24c-490d0aa29b50 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:32.927688 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ca10d0d-c9cb-488f-a24c-490d0aa29b50 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:32.928448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ca10d0d-c9cb-488f-a24c-490d0aa29b50 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:33.041228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-07521450-6495-4f3a-a1ad-f1c0d4ccb9c9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-2023076070", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "8bc5be35-321f-41b9-96b3-0d02c9145a3b"}, {"port": "f9e588d4-a8fb-4137-b6aa-9752d8fb56f6", "tag": "port-1"}, {"port": "ac18c1ec-49eb-4408-8eb5-a8e4ce7d4e0d", "tag": "port-2"}, {"uuid": "ebedab04-3c6d-4806-9ab6-2c10085ccb27", "tag": "net-1"}, {"uuid": "ebedab04-3c6d-4806-9ab6-2c10085ccb27"}, {"uuid": "264ae4b3-12a2-432e-af77-64d717979d9f", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "264ae4b3-12a2-432e-af77-64d717979d9f", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "0f232084-a866-427f-b65e-3e2aa292e4cc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "00f6f68c-b4d3-4322-bb97-051c8e87bfd9", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "4c145487-f872-4c79-9c06-47c7f8723705", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1651596536"}], "key_name": "tempest-keypair-2052496779", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:51:33.440439 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-07521450-6495-4f3a-a1ad-f1c0d4ccb9c9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] validate_networks() for [('8bc5be35-321f-41b9-96b3-0d02c9145a3b', None, None, None, None, None), (None, None, 'f9e588d4-a8fb-4137-b6aa-9752d8fb56f6', None, None, None), (None, None, 'ac18c1ec-49eb-4408-8eb5-a8e4ce7d4e0d', None, None, None), ('ebedab04-3c6d-4806-9ab6-2c10085ccb27', None, None, None, None, None), ('ebedab04-3c6d-4806-9ab6-2c10085ccb27', None, None, None, None, None), ('264ae4b3-12a2-432e-af77-64d717979d9f', '10.2.2.100', None, None, None, None), ('264ae4b3-12a2-432e-af77-64d717979d9f', '10.2.2.200', None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:51:33.453676 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2ca10d0d-c9cb-488f-a24c-490d0aa29b50 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:33.462622 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2ca10d0d-c9cb-488f-a24c-490d0aa29b50 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1315 microversion: 2.1 time: 0.566808 Oct 05 02:51:33.477784 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2374/4754] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:32 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1315 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:51:33.631510 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cad3ebf7-5da6-4537-8f58-4e1a7ae7bd5c tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:33.632925 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cad3ebf7-5da6-4537-8f58-4e1a7ae7bd5c tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:33.651842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cad3ebf7-5da6-4537-8f58-4e1a7ae7bd5c tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:33.652619 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cad3ebf7-5da6-4537-8f58-4e1a7ae7bd5c tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:33.653665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cad3ebf7-5da6-4537-8f58-4e1a7ae7bd5c tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:33.655658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cad3ebf7-5da6-4537-8f58-4e1a7ae7bd5c tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:33.657387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cad3ebf7-5da6-4537-8f58-4e1a7ae7bd5c tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:33.658131 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cad3ebf7-5da6-4537-8f58-4e1a7ae7bd5c tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:33.673385 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:34.341497 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cad3ebf7-5da6-4537-8f58-4e1a7ae7bd5c tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:34.358125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cad3ebf7-5da6-4537-8f58-4e1a7ae7bd5c tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:34.360574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cad3ebf7-5da6-4537-8f58-4e1a7ae7bd5c tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:34.364360 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cad3ebf7-5da6-4537-8f58-4e1a7ae7bd5c tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 2713 microversion: 2.42 time: 0.737889 Oct 05 02:51:34.365506 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2375/4755] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:51:33 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 2713 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:51:34.371697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-57491e74-a927-44f6-9c74-8889b953736f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:34.372633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-57491e74-a927-44f6-9c74-8889b953736f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:34.380352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-57491e74-a927-44f6-9c74-8889b953736f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:34.382137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-57491e74-a927-44f6-9c74-8889b953736f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:34.383629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-57491e74-a927-44f6-9c74-8889b953736f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:34.385103 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-57491e74-a927-44f6-9c74-8889b953736f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:34.386104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-57491e74-a927-44f6-9c74-8889b953736f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:34.386878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-57491e74-a927-44f6-9c74-8889b953736f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:34.723883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-57491e74-a927-44f6-9c74-8889b953736f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:34.736809 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-57491e74-a927-44f6-9c74-8889b953736f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.369554 Oct 05 02:51:34.738086 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2376/4756] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:34 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:34.746955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-7d92a0df-3094-41e1-b3ad-b16b85ac6611 req-0ff980a6-ac8a-4baa-84dc-9f093fa9af4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fded3d6-d275-4d50-a366-d19388f8aaec", "name": "network-vif-plugged", "status": "completed", "tag": "877cbc45-f570-4bb6-bcd2-91b67dbccdb3"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:51:34.762657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7d92a0df-3094-41e1-b3ad-b16b85ac6611 req-0ff980a6-ac8a-4baa-84dc-9f093fa9af4a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:34.763507 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7d92a0df-3094-41e1-b3ad-b16b85ac6611 req-0ff980a6-ac8a-4baa-84dc-9f093fa9af4a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:34.764114 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7d92a0df-3094-41e1-b3ad-b16b85ac6611 req-0ff980a6-ac8a-4baa-84dc-9f093fa9af4a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:34.779740 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-7d92a0df-3094-41e1-b3ad-b16b85ac6611 req-0ff980a6-ac8a-4baa-84dc-9f093fa9af4a service nova] Creating event network-vif-plugged:877cbc45-f570-4bb6-bcd2-91b67dbccdb3 for instance 1fded3d6-d275-4d50-a366-d19388f8aaec on n-h2-858272-3 Oct 05 02:51:34.786031 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-7d92a0df-3094-41e1-b3ad-b16b85ac6611 req-0ff980a6-ac8a-4baa-84dc-9f093fa9af4a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045978 Oct 05 02:51:34.786898 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2377/4757] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:51:34.793515 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-952199cd-3994-4cbe-949b-46773f89d51d req-3e3d691f-bfbd-4683-9c8e-71d493dea8b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a710dba5-18ef-4840-835b-06b1fc2bde87", "name": "network-vif-deleted", "tag": "c6b3e9fb-230c-4ce3-abab-896b74e674ca"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:51:34.804847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-952199cd-3994-4cbe-949b-46773f89d51d req-3e3d691f-bfbd-4683-9c8e-71d493dea8b4 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:34.805649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-952199cd-3994-4cbe-949b-46773f89d51d req-3e3d691f-bfbd-4683-9c8e-71d493dea8b4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:34.806248 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-952199cd-3994-4cbe-949b-46773f89d51d req-3e3d691f-bfbd-4683-9c8e-71d493dea8b4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:34.820421 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-952199cd-3994-4cbe-949b-46773f89d51d req-3e3d691f-bfbd-4683-9c8e-71d493dea8b4 service nova] Creating event network-vif-deleted:c6b3e9fb-230c-4ce3-abab-896b74e674ca for instance a710dba5-18ef-4840-835b-06b1fc2bde87 on n-h1-858272-3 Oct 05 02:51:34.826040 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-952199cd-3994-4cbe-949b-46773f89d51d req-3e3d691f-bfbd-4683-9c8e-71d493dea8b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037637 Oct 05 02:51:34.826959 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2378/4758] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:51:34.841158 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1f3900c2-3928-429a-a966-542046b910e9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:34.841862 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1f3900c2-3928-429a-a966-542046b910e9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:34.869878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f3900c2-3928-429a-a966-542046b910e9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:34.872246 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f3900c2-3928-429a-a966-542046b910e9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:34.874388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f3900c2-3928-429a-a966-542046b910e9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:34.875670 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f3900c2-3928-429a-a966-542046b910e9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:34.878288 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f3900c2-3928-429a-a966-542046b910e9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:34.879260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f3900c2-3928-429a-a966-542046b910e9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:35.386049 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1f3900c2-3928-429a-a966-542046b910e9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:35.396692 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1f3900c2-3928-429a-a966-542046b910e9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1315 microversion: 2.1 time: 0.568524 Oct 05 02:51:35.421065 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2379/4759] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:34 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1315 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:35.428827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c2119972-485d-49e5-b673-fa55bb4353c0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:35.430569 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c2119972-485d-49e5-b673-fa55bb4353c0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:35.438196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:35.441525 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2119972-485d-49e5-b673-fa55bb4353c0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:35.442605 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2119972-485d-49e5-b673-fa55bb4353c0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:35.443212 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2119972-485d-49e5-b673-fa55bb4353c0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:35.444555 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2119972-485d-49e5-b673-fa55bb4353c0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:35.445982 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2119972-485d-49e5-b673-fa55bb4353c0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:35.446668 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2119972-485d-49e5-b673-fa55bb4353c0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:35.816790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c2119972-485d-49e5-b673-fa55bb4353c0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:35.836683 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c2119972-485d-49e5-b673-fa55bb4353c0 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1669 microversion: 2.1 time: 0.410899 Oct 05 02:51:35.837350 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2380/4760] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:35 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1669 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:35.847465 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d98d1445-1ab9-4006-b69f-43a7ed6aa610 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:35.858831 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d98d1445-1ab9-4006-b69f-43a7ed6aa610 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:35.869903 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d98d1445-1ab9-4006-b69f-43a7ed6aa610 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:35.870678 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d98d1445-1ab9-4006-b69f-43a7ed6aa610 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:35.871982 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d98d1445-1ab9-4006-b69f-43a7ed6aa610 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:35.872813 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d98d1445-1ab9-4006-b69f-43a7ed6aa610 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:35.873669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d98d1445-1ab9-4006-b69f-43a7ed6aa610 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:35.874302 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d98d1445-1ab9-4006-b69f-43a7ed6aa610 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:36.238882 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d98d1445-1ab9-4006-b69f-43a7ed6aa610 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:36.252730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d98d1445-1ab9-4006-b69f-43a7ed6aa610 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:36.255473 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d98d1445-1ab9-4006-b69f-43a7ed6aa610 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:36.270166 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d98d1445-1ab9-4006-b69f-43a7ed6aa610 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 2505 microversion: 2.42 time: 0.430558 Oct 05 02:51:36.271364 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2381/4761] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:51:35 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 2505 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:51:36.278533 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2ce9e2f6-da19-4962-95b1-874baacb0e6b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:36.279175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2ce9e2f6-da19-4962-95b1-874baacb0e6b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:36.310508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ce9e2f6-da19-4962-95b1-874baacb0e6b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:36.312679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ce9e2f6-da19-4962-95b1-874baacb0e6b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:36.314863 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ce9e2f6-da19-4962-95b1-874baacb0e6b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:36.318690 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ce9e2f6-da19-4962-95b1-874baacb0e6b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:36.321796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ce9e2f6-da19-4962-95b1-874baacb0e6b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:36.322238 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ce9e2f6-da19-4962-95b1-874baacb0e6b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:36.371883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2ce9e2f6-da19-4962-95b1-874baacb0e6b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:51:36.384252 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.compute.api [None req-2ce9e2f6-da19-4962-95b1-874baacb0e6b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Working on deleting snapshot 837da1d4-7b7d-47ce-aac5-3b940a13c75e from shelved instance... Oct 05 02:51:37.705204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2ce9e2f6-da19-4962-95b1-874baacb0e6b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Doing local delete in cell d1723b23-1631-4a56-b9ad-72e4c39197cb(cell1) {{(pid=122319) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 05 02:51:37.706762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ce9e2f6-da19-4962-95b1-874baacb0e6b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:37.707550 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ce9e2f6-da19-4962-95b1-874baacb0e6b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:37.709478 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ce9e2f6-da19-4962-95b1-874baacb0e6b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:37.710240 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.compute.api [None req-2ce9e2f6-da19-4962-95b1-874baacb0e6b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 05 02:51:37.715772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-2ce9e2f6-da19-4962-95b1-874baacb0e6b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] deallocate_for_instance() {{(pid=122319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 05 02:51:38.371822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:39.821877 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-2ce9e2f6-da19-4962-95b1-874baacb0e6b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Updating instance_info_cache with network_info: [] {{(pid=122319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 05 02:51:40.659875 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-07521450-6495-4f3a-a1ad-f1c0d4ccb9c9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:51:40.660478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-07521450-6495-4f3a-a1ad-f1c0d4ccb9c9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:51:40.671367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-07521450-6495-4f3a-a1ad-f1c0d4ccb9c9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:51:40.671916 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-07521450-6495-4f3a-a1ad-f1c0d4ccb9c9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:51:40.673808 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-07521450-6495-4f3a-a1ad-f1c0d4ccb9c9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:51:40.694132 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07521450-6495-4f3a-a1ad-f1c0d4ccb9c9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:40.696047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07521450-6495-4f3a-a1ad-f1c0d4ccb9c9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:40.697912 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07521450-6495-4f3a-a1ad-f1c0d4ccb9c9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:40.701135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07521450-6495-4f3a-a1ad-f1c0d4ccb9c9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:40.703972 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07521450-6495-4f3a-a1ad-f1c0d4ccb9c9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:40.705016 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07521450-6495-4f3a-a1ad-f1c0d4ccb9c9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:40.773511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-07521450-6495-4f3a-a1ad-f1c0d4ccb9c9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Getting quotas for project df7f497ef84645d3bead6c2e54a7603d. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:51:40.790688 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-07521450-6495-4f3a-a1ad-f1c0d4ccb9c9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Getting quotas for user ef5ed582f9d74e2f9bd5ea39f41a5017 and project df7f497ef84645d3bead6c2e54a7603d. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:51:40.863304 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2ce9e2f6-da19-4962-95b1-874baacb0e6b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 204 len: 0 microversion: 2.1 time: 4.590560 Oct 05 02:51:40.864812 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2382/4762] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:51:36 2022] DELETE /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 0 bytes in 4593 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:51:40.870357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-83831059-d84b-48ae-b3ae-88188b832aa1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:40.871185 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-83831059-d84b-48ae-b3ae-88188b832aa1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:40.877739 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-83831059-d84b-48ae-b3ae-88188b832aa1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:40.883205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-83831059-d84b-48ae-b3ae-88188b832aa1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:40.889818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-83831059-d84b-48ae-b3ae-88188b832aa1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:40.891488 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-83831059-d84b-48ae-b3ae-88188b832aa1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:40.891939 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-83831059-d84b-48ae-b3ae-88188b832aa1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:40.892365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-83831059-d84b-48ae-b3ae-88188b832aa1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:41.269792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-83831059-d84b-48ae-b3ae-88188b832aa1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:41.282536 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-83831059-d84b-48ae-b3ae-88188b832aa1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.416361 Oct 05 02:51:41.283136 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2383/4763] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:40 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:41.289174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-07521450-6495-4f3a-a1ad-f1c0d4ccb9c9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:51:41.291947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-07521450-6495-4f3a-a1ad-f1c0d4ccb9c9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='0f232084-a866-427f-b65e-3e2aa292e4cc',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='00f6f68c-b4d3-4322-bb97-051c8e87bfd9',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4c145487-f872-4c79-9c06-47c7f8723705',volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:51:41.337850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-5089f273-c641-45bc-9c70-010f7ae73e47 req-26abaf5c-1973-46c3-9ba0-0875153b86ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a710dba5-18ef-4840-835b-06b1fc2bde87", "name": "network-vif-deleted", "tag": "71f0f4da-1745-4447-9f63-d186fb5b9770"}, {"server_uuid": "a710dba5-18ef-4840-835b-06b1fc2bde87", "name": "network-vif-deleted", "tag": "a4b7823b-7c50-4314-99cb-dea5af5cfe33"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:51:41.383487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5089f273-c641-45bc-9c70-010f7ae73e47 req-26abaf5c-1973-46c3-9ba0-0875153b86ad service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:41.385403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5089f273-c641-45bc-9c70-010f7ae73e47 req-26abaf5c-1973-46c3-9ba0-0875153b86ad service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:41.386086 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5089f273-c641-45bc-9c70-010f7ae73e47 req-26abaf5c-1973-46c3-9ba0-0875153b86ad service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:41.441343 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-5089f273-c641-45bc-9c70-010f7ae73e47 req-26abaf5c-1973-46c3-9ba0-0875153b86ad service nova] Creating event network-vif-deleted:71f0f4da-1745-4447-9f63-d186fb5b9770 for instance a710dba5-18ef-4840-835b-06b1fc2bde87 on n-h1-858272-3 Oct 05 02:51:41.444051 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-5089f273-c641-45bc-9c70-010f7ae73e47 req-26abaf5c-1973-46c3-9ba0-0875153b86ad service nova] Creating event network-vif-deleted:a4b7823b-7c50-4314-99cb-dea5af5cfe33 for instance a710dba5-18ef-4840-835b-06b1fc2bde87 on n-h1-858272-3 Oct 05 02:51:41.471129 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-5089f273-c641-45bc-9c70-010f7ae73e47 req-26abaf5c-1973-46c3-9ba0-0875153b86ad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.186691 Oct 05 02:51:41.471770 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2384/4764] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:51:41.511460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-74cfc3a0-5141-450b-b857-7cf7dc9ec06f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:41.521830 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-74cfc3a0-5141-450b-b857-7cf7dc9ec06f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:41.551998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74cfc3a0-5141-450b-b857-7cf7dc9ec06f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:41.552517 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74cfc3a0-5141-450b-b857-7cf7dc9ec06f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:41.553134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74cfc3a0-5141-450b-b857-7cf7dc9ec06f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:41.554483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74cfc3a0-5141-450b-b857-7cf7dc9ec06f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:41.555334 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74cfc3a0-5141-450b-b857-7cf7dc9ec06f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:41.580845 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74cfc3a0-5141-450b-b857-7cf7dc9ec06f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:41.848634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-74cfc3a0-5141-450b-b857-7cf7dc9ec06f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:41.863740 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-74cfc3a0-5141-450b-b857-7cf7dc9ec06f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:41.872327 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-74cfc3a0-5141-450b-b857-7cf7dc9ec06f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:41.880334 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-74cfc3a0-5141-450b-b857-7cf7dc9ec06f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1604 microversion: 2.42 time: 0.393856 Oct 05 02:51:41.884410 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2385/4765] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:51:41 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1604 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:51:41.927759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a8739942-e664-4ac8-836c-e740ae572c90 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:41.929148 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a8739942-e664-4ac8-836c-e740ae572c90 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 0486ad56-c00a-45ca-b8b6-932ca38690b3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:41.970257 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8739942-e664-4ac8-836c-e740ae572c90 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:41.970980 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8739942-e664-4ac8-836c-e740ae572c90 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:41.974940 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8739942-e664-4ac8-836c-e740ae572c90 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:41.977250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8739942-e664-4ac8-836c-e740ae572c90 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:41.978612 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8739942-e664-4ac8-836c-e740ae572c90 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:41.979858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8739942-e664-4ac8-836c-e740ae572c90 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:42.014920 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-a8739942-e664-4ac8-836c-e740ae572c90 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] HTTP exception thrown: Instance 0486ad56-c00a-45ca-b8b6-932ca38690b3 could not be found. Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a8739942-e664-4ac8-836c-e740ae572c90 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Request method failure captured: Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 HTTP/1.1 Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO7Sif7k2Rw6uRp1-U79PqbkOIEiV2C9maqWOg5HMbTQohV_wI3ZnNHqYwQk7awYRSS07q-kKtBu6GhULl5i3c9ATZsA7i0MdjMTEZGOwFDjxeZA_z2PV0fcLV1ncQTeNhB317y14StT_9d9kGPegGkBw0puNI5HL7TMGXTWx0tieJI Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 1ff63adf9571439d8f8bf9b0fa6c63f9 Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerActionsTestJSON-1915862737 Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ff63adf9571439d8f8bf9b0fa6c63f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ff63adf9571439d8f8bf9b0fa6c63f9"}]}, {"type": "tempest-type-193258006", "name": "tempest-service-692660016", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1ff63adf9571439d8f8bf9b0fa6c63f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1ff63adf9571439d8f8bf9b0fa6c63f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerActionsTestJSON-1915862737 Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 1ff63adf9571439d8f8bf9b0fa6c63f9 Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerActionsTestJSON-1915862737 Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerActionsTestJSON-1915862737-project Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 728544ca5e164540b3c5395534542955 Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerActionsTestJSON-1915862737-project Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 0486ad56-c00a-45ca-b8b6-932ca38690b3 could not be found. Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '0486ad56-c00a-45ca-b8b6-932ca38690b3'} Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0486ad56-c00a-45ca-b8b6-932ca38690b3 could not be found. Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0486ad56-c00a-45ca-b8b6-932ca38690b3 could not be found. Oct 05 02:51:42.017307 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:51:42.022812 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:51:42.022812 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:51:42.022812 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:51:42.022812 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:51:42.022812 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:51:42.022812 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:51:42.022812 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:51:42.022812 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0486ad56-c00a-45ca-b8b6-932ca38690b3 could not be found. Oct 05 02:51:42.022812 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:51:42.026124 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a8739942-e664-4ac8-836c-e740ae572c90 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Returning 404 to user: Instance 0486ad56-c00a-45ca-b8b6-932ca38690b3 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:51:42.028220 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a8739942-e664-4ac8-836c-e740ae572c90 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3" status: 404 len: 111 microversion: 2.1 time: 0.139532 Oct 05 02:51:42.029201 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2386/4766] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:41 2022] GET /compute/v2.1/servers/0486ad56-c00a-45ca-b8b6-932ca38690b3 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:51:42.040412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f4adb75f-4637-41c1-9907-3c12a54eaf64 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-146195853", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:51:42.174401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-f4adb75f-4637-41c1-9907-3c12a54eaf64 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] validate_networks() for [('e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:51:42.612682 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-07521450-6495-4f3a-a1ad-f1c0d4ccb9c9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 9.562027 Oct 05 02:51:42.614031 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2381/4767] 10.222.0.16 () {62 vars in 1189 bytes} [Wed Oct 5 02:51:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 9586 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 05 02:51:42.636741 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b37bf238-3897-4cac-9a61-60bdac1a7c7f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:42.658282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b37bf238-3897-4cac-9a61-60bdac1a7c7f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: c32101ff-4278-4a35-b328-895629612614] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:42.678554 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b37bf238-3897-4cac-9a61-60bdac1a7c7f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:42.679244 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b37bf238-3897-4cac-9a61-60bdac1a7c7f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:42.681842 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b37bf238-3897-4cac-9a61-60bdac1a7c7f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:42.683030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b37bf238-3897-4cac-9a61-60bdac1a7c7f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:42.683929 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b37bf238-3897-4cac-9a61-60bdac1a7c7f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:42.685563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b37bf238-3897-4cac-9a61-60bdac1a7c7f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:42.749092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b37bf238-3897-4cac-9a61-60bdac1a7c7f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: c32101ff-4278-4a35-b328-895629612614] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:51:42.995098 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b37bf238-3897-4cac-9a61-60bdac1a7c7f tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614" status: 204 len: 0 microversion: 2.1 time: 0.371393 Oct 05 02:51:42.998241 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2382/4768] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:51:42 2022] DELETE /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:51:43.019014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8d6ec7c5-e60a-48dc-b128-f6100c78ef8a tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:43.034609 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8d6ec7c5-e60a-48dc-b128-f6100c78ef8a tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:43.296766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8d6ec7c5-e60a-48dc-b128-f6100c78ef8a tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:43.313274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8d6ec7c5-e60a-48dc-b128-f6100c78ef8a tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:43.318842 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8d6ec7c5-e60a-48dc-b128-f6100c78ef8a tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:43.322302 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8d6ec7c5-e60a-48dc-b128-f6100c78ef8a tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1286 microversion: 2.32 time: 0.322587 Oct 05 02:51:43.343050 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2383/4769] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:51:42 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1286 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:51:43.357354 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f170d8f5-77ec-46ee-89ed-7e47d365f943 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:43.359892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f170d8f5-77ec-46ee-89ed-7e47d365f943 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:43.386167 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f170d8f5-77ec-46ee-89ed-7e47d365f943 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:43.386652 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f170d8f5-77ec-46ee-89ed-7e47d365f943 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:43.387279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f170d8f5-77ec-46ee-89ed-7e47d365f943 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:43.388206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f170d8f5-77ec-46ee-89ed-7e47d365f943 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:43.388843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f170d8f5-77ec-46ee-89ed-7e47d365f943 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:43.389514 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f170d8f5-77ec-46ee-89ed-7e47d365f943 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:43.651889 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f170d8f5-77ec-46ee-89ed-7e47d365f943 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:43.673649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f170d8f5-77ec-46ee-89ed-7e47d365f943 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:43.686904 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f170d8f5-77ec-46ee-89ed-7e47d365f943 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:43.695365 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f170d8f5-77ec-46ee-89ed-7e47d365f943 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1604 microversion: 2.42 time: 0.350526 Oct 05 02:51:43.721045 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2384/4770] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:51:43 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1604 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:51:43.727024 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-48779a7b-ef39-45b6-bcc0-c5fd8d01ef0e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:43.750302 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-48779a7b-ef39-45b6-bcc0-c5fd8d01ef0e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: c32101ff-4278-4a35-b328-895629612614] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:43.777431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48779a7b-ef39-45b6-bcc0-c5fd8d01ef0e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:43.782599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48779a7b-ef39-45b6-bcc0-c5fd8d01ef0e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:43.784598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48779a7b-ef39-45b6-bcc0-c5fd8d01ef0e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:43.785492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48779a7b-ef39-45b6-bcc0-c5fd8d01ef0e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:43.790247 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48779a7b-ef39-45b6-bcc0-c5fd8d01ef0e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:43.790941 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48779a7b-ef39-45b6-bcc0-c5fd8d01ef0e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:43.883576 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-f4adb75f-4637-41c1-9907-3c12a54eaf64 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:51:43.884599 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-f4adb75f-4637-41c1-9907-3c12a54eaf64 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:51:43.885298 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-f4adb75f-4637-41c1-9907-3c12a54eaf64 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:51:43.885870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-f4adb75f-4637-41c1-9907-3c12a54eaf64 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:51:43.886458 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-f4adb75f-4637-41c1-9907-3c12a54eaf64 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:51:43.906725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f4adb75f-4637-41c1-9907-3c12a54eaf64 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:43.918134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f4adb75f-4637-41c1-9907-3c12a54eaf64 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:43.919418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f4adb75f-4637-41c1-9907-3c12a54eaf64 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:43.921053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f4adb75f-4637-41c1-9907-3c12a54eaf64 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:43.922966 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f4adb75f-4637-41c1-9907-3c12a54eaf64 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:43.924817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f4adb75f-4637-41c1-9907-3c12a54eaf64 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:43.997144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-f4adb75f-4637-41c1-9907-3c12a54eaf64 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Getting quotas for project c76521b0c2f8465b866756ccc9c299e4. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:51:44.003724 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-f4adb75f-4637-41c1-9907-3c12a54eaf64 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Getting quotas for user fa65476b76e749cdab6ad9e7e77e79b7 and project c76521b0c2f8465b866756ccc9c299e4. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:51:44.018266 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-48779a7b-ef39-45b6-bcc0-c5fd8d01ef0e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:44.032962 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-48779a7b-ef39-45b6-bcc0-c5fd8d01ef0e tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614" status: 200 len: 1464 microversion: 2.1 time: 0.310331 Oct 05 02:51:44.033578 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2385/4771] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:43 2022] GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614 => generated 1464 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:44.035132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f4adb75f-4637-41c1-9907-3c12a54eaf64 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:51:44.040125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f4adb75f-4637-41c1-9907-3c12a54eaf64 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 9133ea4e-7828-4227-a454-681cc3b7b695] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:51:44.047252 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-447e987c-3091-41f4-ab64-9c6c6a9c3cf3 req-8d80804c-0fef-4c09-b6df-1375b0d123c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a710dba5-18ef-4840-835b-06b1fc2bde87", "name": "network-vif-deleted", "tag": "432071a7-edac-416f-aec1-3041b15ece3c"}, {"server_uuid": "0486ad56-c00a-45ca-b8b6-932ca38690b3", "name": "network-vif-deleted", "tag": "d4c9cced-e19b-4c63-ae11-305eee49cbf7"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:51:44.078627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-447e987c-3091-41f4-ab64-9c6c6a9c3cf3 req-8d80804c-0fef-4c09-b6df-1375b0d123c9 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:44.081747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-447e987c-3091-41f4-ab64-9c6c6a9c3cf3 req-8d80804c-0fef-4c09-b6df-1375b0d123c9 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:44.084076 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-447e987c-3091-41f4-ab64-9c6c6a9c3cf3 req-8d80804c-0fef-4c09-b6df-1375b0d123c9 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:44.184059 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-447e987c-3091-41f4-ab64-9c6c6a9c3cf3 req-8d80804c-0fef-4c09-b6df-1375b0d123c9 service nova] Creating event network-vif-deleted:432071a7-edac-416f-aec1-3041b15ece3c for instance a710dba5-18ef-4840-835b-06b1fc2bde87 on n-h1-858272-3 Oct 05 02:51:44.193264 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.compute.server_external_events [req-447e987c-3091-41f4-ab64-9c6c6a9c3cf3 req-8d80804c-0fef-4c09-b6df-1375b0d123c9 service nova] Unable to find a host for instance 0486ad56-c00a-45ca-b8b6-932ca38690b3. Dropping event network-vif-deleted {{(pid=122320) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 05 02:51:44.199575 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f4adb75f-4637-41c1-9907-3c12a54eaf64 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.168935 Oct 05 02:51:44.206499 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2387/4772] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:51:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:51:44.224713 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-447e987c-3091-41f4-ab64-9c6c6a9c3cf3 req-8d80804c-0fef-4c09-b6df-1375b0d123c9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 351 microversion: 2.1 time: 0.182686 Oct 05 02:51:44.229382 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2386/4773] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 351 bytes in 195 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 05 02:51:44.243166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4eadfde8-6d91-4681-a15c-d080a3ef017d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:44.247263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4eadfde8-6d91-4681-a15c-d080a3ef017d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 9133ea4e-7828-4227-a454-681cc3b7b695] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:44.368680 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-eab20b89-0d19-466c-9af8-49deed3671a5 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:44.369441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-eab20b89-0d19-466c-9af8-49deed3671a5 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:44.487919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4eadfde8-6d91-4681-a15c-d080a3ef017d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:44.507728 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4eadfde8-6d91-4681-a15c-d080a3ef017d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695" status: 200 len: 1216 microversion: 2.1 time: 0.293438 Oct 05 02:51:44.540654 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2388/4774] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:44 2022] GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695 => generated 1216 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:44.587057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-eab20b89-0d19-466c-9af8-49deed3671a5 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:44.596461 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-eab20b89-0d19-466c-9af8-49deed3671a5 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:44.607374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-eab20b89-0d19-466c-9af8-49deed3671a5 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:44.609776 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-eab20b89-0d19-466c-9af8-49deed3671a5 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1286 microversion: 2.32 time: 0.246467 Oct 05 02:51:44.615792 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2387/4775] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:51:44 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1286 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:51:44.730370 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-606c7975-97c0-419b-bf79-8fcd64345f83 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:44.733330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-606c7975-97c0-419b-bf79-8fcd64345f83 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:44.745918 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-606c7975-97c0-419b-bf79-8fcd64345f83 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:44.766328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-606c7975-97c0-419b-bf79-8fcd64345f83 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:44.766967 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-606c7975-97c0-419b-bf79-8fcd64345f83 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:44.767856 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-606c7975-97c0-419b-bf79-8fcd64345f83 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:44.768344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-606c7975-97c0-419b-bf79-8fcd64345f83 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:44.768774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-606c7975-97c0-419b-bf79-8fcd64345f83 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:44.983183 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-606c7975-97c0-419b-bf79-8fcd64345f83 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:44.993180 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:45.011127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-606c7975-97c0-419b-bf79-8fcd64345f83 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:45.018410 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-606c7975-97c0-419b-bf79-8fcd64345f83 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:45.028677 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-606c7975-97c0-419b-bf79-8fcd64345f83 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1604 microversion: 2.42 time: 0.298653 Oct 05 02:51:45.031385 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2389/4776] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:51:44 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1604 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:51:45.062679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0707f8d7-1e9c-429d-880c-372f4db19f04 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:45.063975 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0707f8d7-1e9c-429d-880c-372f4db19f04 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: c32101ff-4278-4a35-b328-895629612614] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:45.114276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0707f8d7-1e9c-429d-880c-372f4db19f04 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:45.115832 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0707f8d7-1e9c-429d-880c-372f4db19f04 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:45.123340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0707f8d7-1e9c-429d-880c-372f4db19f04 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:45.124439 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0707f8d7-1e9c-429d-880c-372f4db19f04 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:45.124966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0707f8d7-1e9c-429d-880c-372f4db19f04 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:45.125424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0707f8d7-1e9c-429d-880c-372f4db19f04 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:45.548617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e28cf180-b87b-435d-ab11-43c3a05bc396 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:45.549685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e28cf180-b87b-435d-ab11-43c3a05bc396 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 9133ea4e-7828-4227-a454-681cc3b7b695] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:46.630536 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0707f8d7-1e9c-429d-880c-372f4db19f04 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:46.660584 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0707f8d7-1e9c-429d-880c-372f4db19f04 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614" status: 200 len: 1464 microversion: 2.1 time: 1.602613 Oct 05 02:51:46.664686 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2388/4777] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:45 2022] GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614 => generated 1464 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:46.709781 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c1444ba8-ce50-4479-a6cc-217a19e7f5e1 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:46.711955 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c1444ba8-ce50-4479-a6cc-217a19e7f5e1 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:46.733879 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1444ba8-ce50-4479-a6cc-217a19e7f5e1 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:46.738384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1444ba8-ce50-4479-a6cc-217a19e7f5e1 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:46.738943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1444ba8-ce50-4479-a6cc-217a19e7f5e1 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:46.741698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1444ba8-ce50-4479-a6cc-217a19e7f5e1 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:46.742374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1444ba8-ce50-4479-a6cc-217a19e7f5e1 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:46.750402 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1444ba8-ce50-4479-a6cc-217a19e7f5e1 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:46.779971 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e28cf180-b87b-435d-ab11-43c3a05bc396 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:46.794497 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e28cf180-b87b-435d-ab11-43c3a05bc396 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695" status: 200 len: 1216 microversion: 2.1 time: 1.251110 Oct 05 02:51:46.825419 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2390/4778] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:45 2022] GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695 => generated 1216 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:51:46.841215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8cd541ab-4b0f-4f28-b278-d0e14501213f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:46.847362 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8cd541ab-4b0f-4f28-b278-d0e14501213f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:46.858493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cd541ab-4b0f-4f28-b278-d0e14501213f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:46.862036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cd541ab-4b0f-4f28-b278-d0e14501213f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:46.863148 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cd541ab-4b0f-4f28-b278-d0e14501213f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:46.864536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cd541ab-4b0f-4f28-b278-d0e14501213f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:46.865562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cd541ab-4b0f-4f28-b278-d0e14501213f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:46.869476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cd541ab-4b0f-4f28-b278-d0e14501213f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:47.113098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8cd541ab-4b0f-4f28-b278-d0e14501213f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:47.154814 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8cd541ab-4b0f-4f28-b278-d0e14501213f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:47.166157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8cd541ab-4b0f-4f28-b278-d0e14501213f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:47.184336 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8cd541ab-4b0f-4f28-b278-d0e14501213f tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1604 microversion: 2.42 time: 0.357080 Oct 05 02:51:47.190524 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2391/4779] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:51:46 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1604 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:51:47.208105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-6d2092e8-d628-469b-9598-938c273578bc req-c2f3bf4f-a33f-4c1c-ab63-d8f6f3716d22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c32101ff-4278-4a35-b328-895629612614", "name": "network-vif-deleted", "tag": "59567f38-bc61-44be-80c4-4986eccffb6a"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:51:47.244261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6d2092e8-d628-469b-9598-938c273578bc req-c2f3bf4f-a33f-4c1c-ab63-d8f6f3716d22 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:47.247014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6d2092e8-d628-469b-9598-938c273578bc req-c2f3bf4f-a33f-4c1c-ab63-d8f6f3716d22 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:47.247757 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6d2092e8-d628-469b-9598-938c273578bc req-c2f3bf4f-a33f-4c1c-ab63-d8f6f3716d22 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:47.284004 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-6d2092e8-d628-469b-9598-938c273578bc req-c2f3bf4f-a33f-4c1c-ab63-d8f6f3716d22 service nova] Creating event network-vif-deleted:59567f38-bc61-44be-80c4-4986eccffb6a for instance c32101ff-4278-4a35-b328-895629612614 on n-h1-858272-3 Oct 05 02:51:47.300627 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-6d2092e8-d628-469b-9598-938c273578bc req-c2f3bf4f-a33f-4c1c-ab63-d8f6f3716d22 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106886 Oct 05 02:51:47.301715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c1444ba8-ce50-4479-a6cc-217a19e7f5e1 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:47.306530 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2392/4780] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:51:47.309858 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:47.321174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c1444ba8-ce50-4479-a6cc-217a19e7f5e1 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:47.338473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c1444ba8-ce50-4479-a6cc-217a19e7f5e1 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:47.352577 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c1444ba8-ce50-4479-a6cc-217a19e7f5e1 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1594 microversion: 2.32 time: 0.686069 Oct 05 02:51:47.360667 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2389/4781] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:51:46 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1594 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:51:47.692755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-85e61987-184f-41c3-9b0d-e661b4d7e2ae tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:47.693836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-85e61987-184f-41c3-9b0d-e661b4d7e2ae tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: c32101ff-4278-4a35-b328-895629612614] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:47.715708 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-85e61987-184f-41c3-9b0d-e661b4d7e2ae tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:47.716430 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-85e61987-184f-41c3-9b0d-e661b4d7e2ae tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:47.717128 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-85e61987-184f-41c3-9b0d-e661b4d7e2ae tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:47.718071 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-85e61987-184f-41c3-9b0d-e661b4d7e2ae tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:47.718986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-85e61987-184f-41c3-9b0d-e661b4d7e2ae tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:47.719618 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-85e61987-184f-41c3-9b0d-e661b4d7e2ae tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:47.822296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-85e61987-184f-41c3-9b0d-e661b4d7e2ae tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:47.823637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-85e61987-184f-41c3-9b0d-e661b4d7e2ae tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:47.824282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-85e61987-184f-41c3-9b0d-e661b4d7e2ae tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:47.824980 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-85e61987-184f-41c3-9b0d-e661b4d7e2ae tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lazy-loading 'fault' on Instance uuid c32101ff-4278-4a35-b328-895629612614 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:51:47.828410 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-21c8216b-301e-423a-8612-14589c4e1c52 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:47.829119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-21c8216b-301e-423a-8612-14589c4e1c52 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 9133ea4e-7828-4227-a454-681cc3b7b695] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:47.863311 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-21c8216b-301e-423a-8612-14589c4e1c52 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:47.870393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-21c8216b-301e-423a-8612-14589c4e1c52 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:47.871900 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-21c8216b-301e-423a-8612-14589c4e1c52 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:47.872552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-21c8216b-301e-423a-8612-14589c4e1c52 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:47.873043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-21c8216b-301e-423a-8612-14589c4e1c52 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:47.873473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-21c8216b-301e-423a-8612-14589c4e1c52 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:48.232502 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-21c8216b-301e-423a-8612-14589c4e1c52 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:48.240617 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-21c8216b-301e-423a-8612-14589c4e1c52 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695" status: 200 len: 1274 microversion: 2.1 time: 0.416589 Oct 05 02:51:48.241240 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2390/4782] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:47 2022] GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695 => generated 1274 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:51:48.259949 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-85e61987-184f-41c3-9b0d-e661b4d7e2ae tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:48.268141 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-85e61987-184f-41c3-9b0d-e661b4d7e2ae tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614" status: 200 len: 1304 microversion: 2.1 time: 0.580100 Oct 05 02:51:48.271373 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2393/4783] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:47 2022] GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614 => generated 1304 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:48.272495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-067f1bbc-eaf6-4c90-9a89-0248b82b0f66 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:48.273878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-067f1bbc-eaf6-4c90-9a89-0248b82b0f66 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:48.285295 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-067f1bbc-eaf6-4c90-9a89-0248b82b0f66 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:48.286028 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-067f1bbc-eaf6-4c90-9a89-0248b82b0f66 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:48.296479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-067f1bbc-eaf6-4c90-9a89-0248b82b0f66 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:48.297625 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-067f1bbc-eaf6-4c90-9a89-0248b82b0f66 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:48.298286 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-067f1bbc-eaf6-4c90-9a89-0248b82b0f66 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:48.298928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-067f1bbc-eaf6-4c90-9a89-0248b82b0f66 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:48.391968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9eabb441-d4f5-42bf-9775-e5a95861768d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:48.392888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9eabb441-d4f5-42bf-9775-e5a95861768d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:48.405929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9eabb441-d4f5-42bf-9775-e5a95861768d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:48.406436 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9eabb441-d4f5-42bf-9775-e5a95861768d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:48.406881 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9eabb441-d4f5-42bf-9775-e5a95861768d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:48.407596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9eabb441-d4f5-42bf-9775-e5a95861768d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:48.408054 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9eabb441-d4f5-42bf-9775-e5a95861768d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:48.408483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9eabb441-d4f5-42bf-9775-e5a95861768d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:48.578327 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-067f1bbc-eaf6-4c90-9a89-0248b82b0f66 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:48.588803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-067f1bbc-eaf6-4c90-9a89-0248b82b0f66 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:48.590350 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-067f1bbc-eaf6-4c90-9a89-0248b82b0f66 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:48.591709 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-067f1bbc-eaf6-4c90-9a89-0248b82b0f66 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1604 microversion: 2.42 time: 0.349315 Oct 05 02:51:48.609377 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2391/4784] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:51:48 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1604 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:51:48.763793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9eabb441-d4f5-42bf-9775-e5a95861768d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:48.774558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9eabb441-d4f5-42bf-9775-e5a95861768d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:48.776179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9eabb441-d4f5-42bf-9775-e5a95861768d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:48.777538 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9eabb441-d4f5-42bf-9775-e5a95861768d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1594 microversion: 2.32 time: 0.389861 Oct 05 02:51:48.778584 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2394/4785] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:51:48 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1594 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:51:49.270147 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-235d24ca-f24c-4c3b-8f23-90e7a67c0410 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:49.272814 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-235d24ca-f24c-4c3b-8f23-90e7a67c0410 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 9133ea4e-7828-4227-a454-681cc3b7b695] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:49.290142 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-235d24ca-f24c-4c3b-8f23-90e7a67c0410 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:49.307922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-72f481e8-ff07-4403-a3be-efd67bf8fbbd tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:49.310467 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-72f481e8-ff07-4403-a3be-efd67bf8fbbd tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: c32101ff-4278-4a35-b328-895629612614] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:49.311566 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-235d24ca-f24c-4c3b-8f23-90e7a67c0410 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:49.312024 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-235d24ca-f24c-4c3b-8f23-90e7a67c0410 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:49.312771 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-235d24ca-f24c-4c3b-8f23-90e7a67c0410 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:49.315418 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-235d24ca-f24c-4c3b-8f23-90e7a67c0410 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:49.315867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-235d24ca-f24c-4c3b-8f23-90e7a67c0410 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:49.338376 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72f481e8-ff07-4403-a3be-efd67bf8fbbd tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:49.338889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72f481e8-ff07-4403-a3be-efd67bf8fbbd tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:49.339337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72f481e8-ff07-4403-a3be-efd67bf8fbbd tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:49.345835 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72f481e8-ff07-4403-a3be-efd67bf8fbbd tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:49.349914 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72f481e8-ff07-4403-a3be-efd67bf8fbbd tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:49.351792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72f481e8-ff07-4403-a3be-efd67bf8fbbd tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:49.400666 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-72f481e8-ff07-4403-a3be-efd67bf8fbbd tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] HTTP exception thrown: Instance c32101ff-4278-4a35-b328-895629612614 could not be found. Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-72f481e8-ff07-4403-a3be-efd67bf8fbbd tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Request method failure captured: Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614 HTTP/1.1 Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO7Sif7k2Rw6uRp1-U79PqbkOIEiV2C9maqWOg5HMbTQohV_wI3ZnNHqYwQk7awYRSS07q-kKtBu6GhULl5i3c9ATZsA7i0MdjMTEZGOwFDjxeZA_z2PV0fcLV1ncQTeNhB317y14StT_9d9kGPegGkBw0puNI5HL7TMGXTWx0tieJI Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 1ff63adf9571439d8f8bf9b0fa6c63f9 Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerActionsTestJSON-1915862737 Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ff63adf9571439d8f8bf9b0fa6c63f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ff63adf9571439d8f8bf9b0fa6c63f9"}]}, {"type": "tempest-type-193258006", "name": "tempest-service-692660016", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1ff63adf9571439d8f8bf9b0fa6c63f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1ff63adf9571439d8f8bf9b0fa6c63f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerActionsTestJSON-1915862737 Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 1ff63adf9571439d8f8bf9b0fa6c63f9 Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerActionsTestJSON-1915862737 Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerActionsTestJSON-1915862737-project Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 728544ca5e164540b3c5395534542955 Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerActionsTestJSON-1915862737-project Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance c32101ff-4278-4a35-b328-895629612614 could not be found. Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'c32101ff-4278-4a35-b328-895629612614'} Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c32101ff-4278-4a35-b328-895629612614 could not be found. Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c32101ff-4278-4a35-b328-895629612614 could not be found. Oct 05 02:51:49.408058 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:51:49.413005 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:51:49.413005 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:51:49.413005 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:51:49.413005 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:51:49.413005 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:51:49.413005 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:51:49.413005 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:51:49.413005 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c32101ff-4278-4a35-b328-895629612614 could not be found. Oct 05 02:51:49.413005 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:51:49.416342 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-72f481e8-ff07-4403-a3be-efd67bf8fbbd tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Returning 404 to user: Instance c32101ff-4278-4a35-b328-895629612614 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:51:49.418966 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-72f481e8-ff07-4403-a3be-efd67bf8fbbd tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614" status: 404 len: 111 microversion: 2.1 time: 0.126680 Oct 05 02:51:49.421086 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2395/4786] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:49 2022] GET /compute/v2.1/servers/c32101ff-4278-4a35-b328-895629612614 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:51:49.431294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ee91cfd6-7015-4979-8fa0-a2e6cc516656 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:49.433463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ee91cfd6-7015-4979-8fa0-a2e6cc516656 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: eceb1b06-e5fa-442b-ae37-cce2f99d58ae] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:49.449683 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee91cfd6-7015-4979-8fa0-a2e6cc516656 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:49.452716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee91cfd6-7015-4979-8fa0-a2e6cc516656 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:49.453398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee91cfd6-7015-4979-8fa0-a2e6cc516656 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:49.456165 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee91cfd6-7015-4979-8fa0-a2e6cc516656 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:49.456846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee91cfd6-7015-4979-8fa0-a2e6cc516656 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:49.459192 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee91cfd6-7015-4979-8fa0-a2e6cc516656 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:49.463583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-235d24ca-f24c-4c3b-8f23-90e7a67c0410 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:49.475993 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-235d24ca-f24c-4c3b-8f23-90e7a67c0410 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695" status: 200 len: 1274 microversion: 2.1 time: 0.208288 Oct 05 02:51:49.482356 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2392/4787] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:49 2022] GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695 => generated 1274 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:49.540616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ee91cfd6-7015-4979-8fa0-a2e6cc516656 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: eceb1b06-e5fa-442b-ae37-cce2f99d58ae] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:51:49.633580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-75a6d553-b879-4294-86ba-4fab86c43ec1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:49.634665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-75a6d553-b879-4294-86ba-4fab86c43ec1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:49.652372 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75a6d553-b879-4294-86ba-4fab86c43ec1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:49.655560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75a6d553-b879-4294-86ba-4fab86c43ec1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:49.661512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75a6d553-b879-4294-86ba-4fab86c43ec1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:49.663429 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75a6d553-b879-4294-86ba-4fab86c43ec1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:49.683032 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75a6d553-b879-4294-86ba-4fab86c43ec1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:49.685359 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75a6d553-b879-4294-86ba-4fab86c43ec1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:49.687998 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ee91cfd6-7015-4979-8fa0-a2e6cc516656 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae" status: 204 len: 0 microversion: 2.1 time: 0.262462 Oct 05 02:51:49.689332 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2396/4788] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:51:49 2022] DELETE /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:51:49.701639 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-26b1a457-e448-4f35-82d8-4ca789bc226d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:49.702907 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-26b1a457-e448-4f35-82d8-4ca789bc226d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: eceb1b06-e5fa-442b-ae37-cce2f99d58ae] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:49.712711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26b1a457-e448-4f35-82d8-4ca789bc226d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:49.713577 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26b1a457-e448-4f35-82d8-4ca789bc226d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:49.714314 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26b1a457-e448-4f35-82d8-4ca789bc226d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:49.715346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26b1a457-e448-4f35-82d8-4ca789bc226d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:49.716307 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26b1a457-e448-4f35-82d8-4ca789bc226d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:49.717305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26b1a457-e448-4f35-82d8-4ca789bc226d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:49.892766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-75a6d553-b879-4294-86ba-4fab86c43ec1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:49.924619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-75a6d553-b879-4294-86ba-4fab86c43ec1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:49.926510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-75a6d553-b879-4294-86ba-4fab86c43ec1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:49.927749 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-75a6d553-b879-4294-86ba-4fab86c43ec1 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1604 microversion: 2.42 time: 0.301080 Oct 05 02:51:49.928321 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2393/4789] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:51:49 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1604 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:51:49.965021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1681acfe-eab4-4b4b-9ac2-84eb46cb0142 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:49.970974 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1681acfe-eab4-4b4b-9ac2-84eb46cb0142 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:49.990291 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1681acfe-eab4-4b4b-9ac2-84eb46cb0142 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:49.996122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1681acfe-eab4-4b4b-9ac2-84eb46cb0142 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:49.999881 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1681acfe-eab4-4b4b-9ac2-84eb46cb0142 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:50.003116 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1681acfe-eab4-4b4b-9ac2-84eb46cb0142 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:50.004236 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1681acfe-eab4-4b4b-9ac2-84eb46cb0142 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:50.007900 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1681acfe-eab4-4b4b-9ac2-84eb46cb0142 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:50.736114 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:51.134985 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1681acfe-eab4-4b4b-9ac2-84eb46cb0142 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:51.152352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1681acfe-eab4-4b4b-9ac2-84eb46cb0142 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:51.155400 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1681acfe-eab4-4b4b-9ac2-84eb46cb0142 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:51.156709 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1681acfe-eab4-4b4b-9ac2-84eb46cb0142 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1594 microversion: 2.32 time: 1.214830 Oct 05 02:51:51.157355 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2394/4790] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:51:49 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1594 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:51:51.173622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c5b3ef19-b4fe-41b7-9801-39602fc25617 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:51.175938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c5b3ef19-b4fe-41b7-9801-39602fc25617 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 9133ea4e-7828-4227-a454-681cc3b7b695] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:51.198431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5b3ef19-b4fe-41b7-9801-39602fc25617 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:51.202116 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5b3ef19-b4fe-41b7-9801-39602fc25617 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:51.203913 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5b3ef19-b4fe-41b7-9801-39602fc25617 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:51.206068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5b3ef19-b4fe-41b7-9801-39602fc25617 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:51.209276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5b3ef19-b4fe-41b7-9801-39602fc25617 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:51.211546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5b3ef19-b4fe-41b7-9801-39602fc25617 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:51.738274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-26b1a457-e448-4f35-82d8-4ca789bc226d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:51.749538 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-26b1a457-e448-4f35-82d8-4ca789bc226d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae" status: 200 len: 1507 microversion: 2.1 time: 2.052671 Oct 05 02:51:51.752441 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2397/4791] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:49 2022] GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae => generated 1507 bytes in 2059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:51.761324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8bf7f1de-4d83-4f67-9917-b134b67c2d54 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:51.761945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8bf7f1de-4d83-4f67-9917-b134b67c2d54 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:51.792692 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bf7f1de-4d83-4f67-9917-b134b67c2d54 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:51.795741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bf7f1de-4d83-4f67-9917-b134b67c2d54 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:51.797311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bf7f1de-4d83-4f67-9917-b134b67c2d54 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:51.800263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bf7f1de-4d83-4f67-9917-b134b67c2d54 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:51.800740 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bf7f1de-4d83-4f67-9917-b134b67c2d54 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:51.801417 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bf7f1de-4d83-4f67-9917-b134b67c2d54 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:52.167666 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8bf7f1de-4d83-4f67-9917-b134b67c2d54 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:52.178886 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8bf7f1de-4d83-4f67-9917-b134b67c2d54 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:52.191551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8bf7f1de-4d83-4f67-9917-b134b67c2d54 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:52.194196 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8bf7f1de-4d83-4f67-9917-b134b67c2d54 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1604 microversion: 2.42 time: 0.440651 Oct 05 02:51:52.207176 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2398/4792] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:51:51 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1604 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:51:52.220176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7dc94e06-0239-4250-887d-fe218d5ca122 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:52.221933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7dc94e06-0239-4250-887d-fe218d5ca122 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:52.244414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7dc94e06-0239-4250-887d-fe218d5ca122 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:52.250063 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7dc94e06-0239-4250-887d-fe218d5ca122 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:52.251465 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7dc94e06-0239-4250-887d-fe218d5ca122 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:52.256110 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7dc94e06-0239-4250-887d-fe218d5ca122 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:52.257980 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7dc94e06-0239-4250-887d-fe218d5ca122 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:52.258931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7dc94e06-0239-4250-887d-fe218d5ca122 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:52.473123 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c5b3ef19-b4fe-41b7-9801-39602fc25617 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:52.488600 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c5b3ef19-b4fe-41b7-9801-39602fc25617 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695" status: 200 len: 1316 microversion: 2.1 time: 1.324507 Oct 05 02:51:52.515472 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2395/4793] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:51 2022] GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695 => generated 1316 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:52.779668 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8d965724-1fec-445e-8ea1-715860c642c2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:52.780731 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8d965724-1fec-445e-8ea1-715860c642c2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: eceb1b06-e5fa-442b-ae37-cce2f99d58ae] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:52.794173 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d965724-1fec-445e-8ea1-715860c642c2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:52.795667 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d965724-1fec-445e-8ea1-715860c642c2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:52.796792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d965724-1fec-445e-8ea1-715860c642c2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:52.798443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d965724-1fec-445e-8ea1-715860c642c2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:52.801121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d965724-1fec-445e-8ea1-715860c642c2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:52.803112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d965724-1fec-445e-8ea1-715860c642c2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:53.936853 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:54.311465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8d965724-1fec-445e-8ea1-715860c642c2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:54.326087 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8d965724-1fec-445e-8ea1-715860c642c2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae" status: 200 len: 1507 microversion: 2.1 time: 1.551491 Oct 05 02:51:54.327963 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2396/4794] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:52 2022] GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae => generated 1507 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:54.339627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-85aefd73-75da-410e-9aad-9c2670cf0f83 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:54.341621 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-85aefd73-75da-410e-9aad-9c2670cf0f83 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:54.352726 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85aefd73-75da-410e-9aad-9c2670cf0f83 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:54.359438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85aefd73-75da-410e-9aad-9c2670cf0f83 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:54.360602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85aefd73-75da-410e-9aad-9c2670cf0f83 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:54.363372 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85aefd73-75da-410e-9aad-9c2670cf0f83 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:54.364057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85aefd73-75da-410e-9aad-9c2670cf0f83 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:54.366682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85aefd73-75da-410e-9aad-9c2670cf0f83 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:54.412741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7dc94e06-0239-4250-887d-fe218d5ca122 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:54.431355 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7dc94e06-0239-4250-887d-fe218d5ca122 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:54.440614 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7dc94e06-0239-4250-887d-fe218d5ca122 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:54.443425 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7dc94e06-0239-4250-887d-fe218d5ca122 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1662 microversion: 2.32 time: 2.234392 Oct 05 02:51:54.446201 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2399/4795] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:51:52 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1662 bytes in 2238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:51:54.455249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2aa780e9-d519-4bcc-9684-32fca42726a7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:54.455860 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2aa780e9-d519-4bcc-9684-32fca42726a7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 9133ea4e-7828-4227-a454-681cc3b7b695] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:54.483270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2aa780e9-d519-4bcc-9684-32fca42726a7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:54.483766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2aa780e9-d519-4bcc-9684-32fca42726a7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:54.493176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2aa780e9-d519-4bcc-9684-32fca42726a7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:54.493972 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2aa780e9-d519-4bcc-9684-32fca42726a7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:54.494457 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2aa780e9-d519-4bcc-9684-32fca42726a7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:54.494895 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2aa780e9-d519-4bcc-9684-32fca42726a7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:54.594510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=10 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:54.941936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-85aefd73-75da-410e-9aad-9c2670cf0f83 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:54.965361 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-85aefd73-75da-410e-9aad-9c2670cf0f83 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:54.966926 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-85aefd73-75da-410e-9aad-9c2670cf0f83 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:54.968175 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-85aefd73-75da-410e-9aad-9c2670cf0f83 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1604 microversion: 2.42 time: 0.637500 Oct 05 02:51:54.981792 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2397/4796] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:51:54 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1604 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:51:55.353262 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d99319c3-0618-4db8-99c6-d9dd7b414022 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:55.356332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d99319c3-0618-4db8-99c6-d9dd7b414022 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: eceb1b06-e5fa-442b-ae37-cce2f99d58ae] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:55.385989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d99319c3-0618-4db8-99c6-d9dd7b414022 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:55.391343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d99319c3-0618-4db8-99c6-d9dd7b414022 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:55.391806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d99319c3-0618-4db8-99c6-d9dd7b414022 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:55.392557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d99319c3-0618-4db8-99c6-d9dd7b414022 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:55.393081 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d99319c3-0618-4db8-99c6-d9dd7b414022 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:55.393510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d99319c3-0618-4db8-99c6-d9dd7b414022 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:55.838457 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2aa780e9-d519-4bcc-9684-32fca42726a7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:55.849468 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2aa780e9-d519-4bcc-9684-32fca42726a7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695" status: 200 len: 1316 microversion: 2.1 time: 1.398957 Oct 05 02:51:55.854133 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2400/4797] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:54 2022] GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695 => generated 1316 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:55.873510 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0ce560ee-3b6a-416c-85d7-c917b2cf840f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:55.874949 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0ce560ee-3b6a-416c-85d7-c917b2cf840f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:55.882699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ce560ee-3b6a-416c-85d7-c917b2cf840f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:55.888014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ce560ee-3b6a-416c-85d7-c917b2cf840f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:55.889492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ce560ee-3b6a-416c-85d7-c917b2cf840f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:55.893394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ce560ee-3b6a-416c-85d7-c917b2cf840f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:55.895083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ce560ee-3b6a-416c-85d7-c917b2cf840f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:55.899376 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ce560ee-3b6a-416c-85d7-c917b2cf840f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:55.964740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d99319c3-0618-4db8-99c6-d9dd7b414022 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:55.986720 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d99319c3-0618-4db8-99c6-d9dd7b414022 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae" status: 200 len: 1465 microversion: 2.1 time: 0.638758 Oct 05 02:51:55.990261 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2398/4798] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:55 2022] GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae => generated 1465 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:51:56.005810 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-3947fd26-51b9-43a8-967f-c08debe6c80e req-78cacb2a-18c8-4770-a8ef-d0fcaeed1d47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eceb1b06-e5fa-442b-ae37-cce2f99d58ae", "name": "network-vif-deleted", "tag": "7a2af2b2-9d69-41ec-970a-8afdc30e948d"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:51:56.041221 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3947fd26-51b9-43a8-967f-c08debe6c80e req-78cacb2a-18c8-4770-a8ef-d0fcaeed1d47 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:56.041791 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3947fd26-51b9-43a8-967f-c08debe6c80e req-78cacb2a-18c8-4770-a8ef-d0fcaeed1d47 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:56.043057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3947fd26-51b9-43a8-967f-c08debe6c80e req-78cacb2a-18c8-4770-a8ef-d0fcaeed1d47 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:56.075654 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-3947fd26-51b9-43a8-967f-c08debe6c80e req-78cacb2a-18c8-4770-a8ef-d0fcaeed1d47 service nova] Creating event network-vif-deleted:7a2af2b2-9d69-41ec-970a-8afdc30e948d for instance eceb1b06-e5fa-442b-ae37-cce2f99d58ae on n-h2-858272-3 Oct 05 02:51:56.101202 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-3947fd26-51b9-43a8-967f-c08debe6c80e req-78cacb2a-18c8-4770-a8ef-d0fcaeed1d47 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109293 Oct 05 02:51:56.107238 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2399/4799] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:51:56.115673 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9b26298f-fc38-45a2-b7a7-866ddac22e54 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:56.121959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9b26298f-fc38-45a2-b7a7-866ddac22e54 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:56.142977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b26298f-fc38-45a2-b7a7-866ddac22e54 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:56.143523 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b26298f-fc38-45a2-b7a7-866ddac22e54 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:56.143976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b26298f-fc38-45a2-b7a7-866ddac22e54 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:56.166412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b26298f-fc38-45a2-b7a7-866ddac22e54 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:56.167256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b26298f-fc38-45a2-b7a7-866ddac22e54 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:56.167906 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b26298f-fc38-45a2-b7a7-866ddac22e54 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:56.754935 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9b26298f-fc38-45a2-b7a7-866ddac22e54 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:56.789933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=10 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:56.820621 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9b26298f-fc38-45a2-b7a7-866ddac22e54 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:56.823705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9b26298f-fc38-45a2-b7a7-866ddac22e54 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:56.826499 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9b26298f-fc38-45a2-b7a7-866ddac22e54 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1604 microversion: 2.42 time: 0.716946 Oct 05 02:51:56.829330 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2400/4800] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:51:56 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1604 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:51:56.882402 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d33a97e2-18ba-486e-afe3-3c9ec6e52116 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:56.883054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d33a97e2-18ba-486e-afe3-3c9ec6e52116 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 9133ea4e-7828-4227-a454-681cc3b7b695] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:56.894053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d33a97e2-18ba-486e-afe3-3c9ec6e52116 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:56.895882 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d33a97e2-18ba-486e-afe3-3c9ec6e52116 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:56.897180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d33a97e2-18ba-486e-afe3-3c9ec6e52116 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:56.899952 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d33a97e2-18ba-486e-afe3-3c9ec6e52116 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:56.902168 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d33a97e2-18ba-486e-afe3-3c9ec6e52116 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:56.902799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d33a97e2-18ba-486e-afe3-3c9ec6e52116 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:57.093883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0ce560ee-3b6a-416c-85d7-c917b2cf840f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:57.126739 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0ce560ee-3b6a-416c-85d7-c917b2cf840f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:57.128217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0ce560ee-3b6a-416c-85d7-c917b2cf840f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:57.141590 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0ce560ee-3b6a-416c-85d7-c917b2cf840f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1662 microversion: 2.32 time: 1.281887 Oct 05 02:51:57.143293 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2401/4801] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:51:55 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1662 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:51:57.167391 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a7e78d19-f007-4b07-9d79-c02c23983111 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:57.170743 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a7e78d19-f007-4b07-9d79-c02c23983111 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: eceb1b06-e5fa-442b-ae37-cce2f99d58ae] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:57.190475 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a7e78d19-f007-4b07-9d79-c02c23983111 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:57.191261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a7e78d19-f007-4b07-9d79-c02c23983111 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:57.191930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a7e78d19-f007-4b07-9d79-c02c23983111 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:57.192895 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a7e78d19-f007-4b07-9d79-c02c23983111 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:57.193597 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a7e78d19-f007-4b07-9d79-c02c23983111 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:57.194234 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a7e78d19-f007-4b07-9d79-c02c23983111 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:57.254041 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-a7e78d19-f007-4b07-9d79-c02c23983111 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] HTTP exception thrown: Instance eceb1b06-e5fa-442b-ae37-cce2f99d58ae could not be found. Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a7e78d19-f007-4b07-9d79-c02c23983111 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Request method failure captured: Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae HTTP/1.1 Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO7Sif7k2Rw6uRp1-U79PqbkOIEiV2C9maqWOg5HMbTQohV_wI3ZnNHqYwQk7awYRSS07q-kKtBu6GhULl5i3c9ATZsA7i0MdjMTEZGOwFDjxeZA_z2PV0fcLV1ncQTeNhB317y14StT_9d9kGPegGkBw0puNI5HL7TMGXTWx0tieJI Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 1ff63adf9571439d8f8bf9b0fa6c63f9 Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerActionsTestJSON-1915862737 Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ff63adf9571439d8f8bf9b0fa6c63f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ff63adf9571439d8f8bf9b0fa6c63f9"}]}, {"type": "tempest-type-193258006", "name": "tempest-service-692660016", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1ff63adf9571439d8f8bf9b0fa6c63f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1ff63adf9571439d8f8bf9b0fa6c63f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerActionsTestJSON-1915862737 Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 1ff63adf9571439d8f8bf9b0fa6c63f9 Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerActionsTestJSON-1915862737 Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerActionsTestJSON-1915862737-project Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 728544ca5e164540b3c5395534542955 Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerActionsTestJSON-1915862737-project Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance eceb1b06-e5fa-442b-ae37-cce2f99d58ae could not be found. Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'eceb1b06-e5fa-442b-ae37-cce2f99d58ae'} Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eceb1b06-e5fa-442b-ae37-cce2f99d58ae could not be found. Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eceb1b06-e5fa-442b-ae37-cce2f99d58ae could not be found. Oct 05 02:51:57.257880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:51:57.263538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:51:57.263538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:51:57.263538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:51:57.263538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:51:57.263538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:51:57.263538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:51:57.263538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:51:57.263538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eceb1b06-e5fa-442b-ae37-cce2f99d58ae could not be found. Oct 05 02:51:57.263538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:51:57.267839 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a7e78d19-f007-4b07-9d79-c02c23983111 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Returning 404 to user: Instance eceb1b06-e5fa-442b-ae37-cce2f99d58ae could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:51:57.271301 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a7e78d19-f007-4b07-9d79-c02c23983111 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae" status: 404 len: 111 microversion: 2.1 time: 0.125224 Oct 05 02:51:57.275252 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2402/4802] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:57 2022] GET /compute/v2.1/servers/eceb1b06-e5fa-442b-ae37-cce2f99d58ae => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:51:57.290158 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-746d1d69-cfa5-4ba0-bb18-e54965d15bd2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:57.291792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-746d1d69-cfa5-4ba0-bb18-e54965d15bd2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:57.309413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-746d1d69-cfa5-4ba0-bb18-e54965d15bd2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:57.311324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-746d1d69-cfa5-4ba0-bb18-e54965d15bd2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:57.313661 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-746d1d69-cfa5-4ba0-bb18-e54965d15bd2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:57.315129 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-746d1d69-cfa5-4ba0-bb18-e54965d15bd2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:57.316473 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-746d1d69-cfa5-4ba0-bb18-e54965d15bd2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:57.318000 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-746d1d69-cfa5-4ba0-bb18-e54965d15bd2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:57.408438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-746d1d69-cfa5-4ba0-bb18-e54965d15bd2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:51:57.724502 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-746d1d69-cfa5-4ba0-bb18-e54965d15bd2 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc" status: 204 len: 0 microversion: 2.1 time: 0.440160 Oct 05 02:51:57.726112 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2403/4803] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:51:57 2022] DELETE /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:51:57.743713 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-13f27d32-a656-4884-996f-de3434328b1d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:57.744847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-13f27d32-a656-4884-996f-de3434328b1d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:57.755801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13f27d32-a656-4884-996f-de3434328b1d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:57.758051 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13f27d32-a656-4884-996f-de3434328b1d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:57.760700 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13f27d32-a656-4884-996f-de3434328b1d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:57.761727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13f27d32-a656-4884-996f-de3434328b1d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:57.763033 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13f27d32-a656-4884-996f-de3434328b1d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:57.765226 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13f27d32-a656-4884-996f-de3434328b1d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:57.790115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d33a97e2-18ba-486e-afe3-3c9ec6e52116 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:57.801513 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d33a97e2-18ba-486e-afe3-3c9ec6e52116 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695" status: 200 len: 1316 microversion: 2.1 time: 0.924024 Oct 05 02:51:57.805696 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2401/4804] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:56 2022] GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695 => generated 1316 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:57.864763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c05c4473-9962-43bb-aef1-05dafa810716 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:57.868134 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c05c4473-9962-43bb-aef1-05dafa810716 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:57.880922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c05c4473-9962-43bb-aef1-05dafa810716 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:57.885761 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c05c4473-9962-43bb-aef1-05dafa810716 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:57.887035 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c05c4473-9962-43bb-aef1-05dafa810716 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:57.889951 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c05c4473-9962-43bb-aef1-05dafa810716 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:57.890736 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c05c4473-9962-43bb-aef1-05dafa810716 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:57.891370 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c05c4473-9962-43bb-aef1-05dafa810716 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:58.395799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c05c4473-9962-43bb-aef1-05dafa810716 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:58.419385 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c05c4473-9962-43bb-aef1-05dafa810716 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:58.448631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c05c4473-9962-43bb-aef1-05dafa810716 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:58.453144 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c05c4473-9962-43bb-aef1-05dafa810716 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1604 microversion: 2.42 time: 0.593442 Oct 05 02:51:58.457582 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2402/4805] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:51:57 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1604 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:51:58.475195 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4fadd76f-4bfb-4316-b347-16d4df64a6dc tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:58.476665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4fadd76f-4bfb-4316-b347-16d4df64a6dc tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:58.487180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4fadd76f-4bfb-4316-b347-16d4df64a6dc tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:58.490573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4fadd76f-4bfb-4316-b347-16d4df64a6dc tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:58.491885 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4fadd76f-4bfb-4316-b347-16d4df64a6dc tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:58.497115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4fadd76f-4bfb-4316-b347-16d4df64a6dc tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:58.498071 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4fadd76f-4bfb-4316-b347-16d4df64a6dc tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:58.500270 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4fadd76f-4bfb-4316-b347-16d4df64a6dc tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:59.312342 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-13f27d32-a656-4884-996f-de3434328b1d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:51:59.324295 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-13f27d32-a656-4884-996f-de3434328b1d tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc" status: 200 len: 1493 microversion: 2.1 time: 1.592908 Oct 05 02:51:59.327553 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2404/4806] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:57 2022] GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc => generated 1493 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:51:59.341381 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ed1e3328-1052-4c93-ad19-12efd846ad4f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:51:59.342258 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ed1e3328-1052-4c93-ad19-12efd846ad4f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 9133ea4e-7828-4227-a454-681cc3b7b695] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:51:59.376854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed1e3328-1052-4c93-ad19-12efd846ad4f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:59.381580 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed1e3328-1052-4c93-ad19-12efd846ad4f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:59.382716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed1e3328-1052-4c93-ad19-12efd846ad4f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:51:59.383727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed1e3328-1052-4c93-ad19-12efd846ad4f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:51:59.384439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed1e3328-1052-4c93-ad19-12efd846ad4f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:51:59.385610 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed1e3328-1052-4c93-ad19-12efd846ad4f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:00.443584 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4fadd76f-4bfb-4316-b347-16d4df64a6dc tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:00.462369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4fadd76f-4bfb-4316-b347-16d4df64a6dc tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:00.471740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4fadd76f-4bfb-4316-b347-16d4df64a6dc tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:00.474431 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4fadd76f-4bfb-4316-b347-16d4df64a6dc tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1709 microversion: 2.32 time: 2.015761 Oct 05 02:52:00.479090 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2403/4807] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:51:58 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1709 bytes in 2021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:52:00.776204 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8c5db39f-9912-406c-ba2d-cec937f2ff4d tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Action: 'create', calling method: .version_select at 0x7fcce81715e0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-109281340", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBtCjdR8eTzHAZCKznqXk79D3JmAPXknb76IQtsfaQ7jtDQfQaQD/L6YQDS3z9zG0EBtrc3PXw1BdJ53paYBD5YYU0rAOwWz0RTQgFZgyge5Qdq9uQhtai1aKRskrwYd3A=="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:52:00.788810 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ed1e3328-1052-4c93-ad19-12efd846ad4f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:00.800951 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:52:00.807624 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ed1e3328-1052-4c93-ad19-12efd846ad4f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695" status: 200 len: 1316 microversion: 2.1 time: 1.477716 Oct 05 02:52:00.821516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-8c5db39f-9912-406c-ba2d-cec937f2ff4d tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Getting quotas for project cfa67de433dc46a595baea99d927d156. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:52:00.825892 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2405/4808] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:59 2022] GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695 => generated 1316 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:00.833192 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-2f69be17-b3d5-4d8f-a3cf-933d7cadda2e req-4f26c693-1dc0-4449-a797-3cd1c3d960ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9133ea4e-7828-4227-a454-681cc3b7b695", "tag": "24df2682-34d4-46b6-9dfc-b81e96b90f43"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:52:00.840032 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-8c5db39f-9912-406c-ba2d-cec937f2ff4d tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Getting quotas for user f23b56d519224b22802f978442c7289f and project cfa67de433dc46a595baea99d927d156. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:52:00.848879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-2f69be17-b3d5-4d8f-a3cf-933d7cadda2e req-4f26c693-1dc0-4449-a797-3cd1c3d960ad service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:00.849700 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-2f69be17-b3d5-4d8f-a3cf-933d7cadda2e req-4f26c693-1dc0-4449-a797-3cd1c3d960ad service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:00.850313 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-2f69be17-b3d5-4d8f-a3cf-933d7cadda2e req-4f26c693-1dc0-4449-a797-3cd1c3d960ad service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:00.867390 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-2f69be17-b3d5-4d8f-a3cf-933d7cadda2e req-4f26c693-1dc0-4449-a797-3cd1c3d960ad service nova] Creating event network-changed:24df2682-34d4-46b6-9dfc-b81e96b90f43 for instance 9133ea4e-7828-4227-a454-681cc3b7b695 on n-h1-858272-3 Oct 05 02:52:00.876063 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-2f69be17-b3d5-4d8f-a3cf-933d7cadda2e req-4f26c693-1dc0-4449-a797-3cd1c3d960ad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048092 Oct 05 02:52:00.877840 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2406/4809] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:52:00.884300 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e386be5b-69a9-4526-b14f-d40d07365b43 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:00.885255 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e386be5b-69a9-4526-b14f-d40d07365b43 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:00.902482 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e386be5b-69a9-4526-b14f-d40d07365b43 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:00.903346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e386be5b-69a9-4526-b14f-d40d07365b43 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:00.904069 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e386be5b-69a9-4526-b14f-d40d07365b43 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:00.905588 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e386be5b-69a9-4526-b14f-d40d07365b43 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:00.906617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e386be5b-69a9-4526-b14f-d40d07365b43 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:00.907650 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e386be5b-69a9-4526-b14f-d40d07365b43 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:00.920177 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8c5db39f-9912-406c-ba2d-cec937f2ff4d tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.438108 Oct 05 02:52:00.920790 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2404/4810] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 02:52:00 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:52:00.950362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3eff63cc-a07e-41c5-b394-c6824c712025 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:00.952455 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3eff63cc-a07e-41c5-b394-c6824c712025 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:00.962275 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:52:00.973229 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3eff63cc-a07e-41c5-b394-c6824c712025 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:00.975410 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3eff63cc-a07e-41c5-b394-c6824c712025 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:00.977837 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3eff63cc-a07e-41c5-b394-c6824c712025 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:00.978613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3eff63cc-a07e-41c5-b394-c6824c712025 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:00.980476 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3eff63cc-a07e-41c5-b394-c6824c712025 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:00.982977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3eff63cc-a07e-41c5-b394-c6824c712025 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:01.119356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e386be5b-69a9-4526-b14f-d40d07365b43 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:01.145223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e386be5b-69a9-4526-b14f-d40d07365b43 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:01.149817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e386be5b-69a9-4526-b14f-d40d07365b43 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:01.151217 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e386be5b-69a9-4526-b14f-d40d07365b43 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1604 microversion: 2.42 time: 0.271816 Oct 05 02:52:01.155259 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2407/4811] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:00 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1604 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:52:01.371996 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3eff63cc-a07e-41c5-b394-c6824c712025 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:01.387499 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3eff63cc-a07e-41c5-b394-c6824c712025 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc" status: 200 len: 1451 microversion: 2.1 time: 0.465418 Oct 05 02:52:01.388098 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2405/4812] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:00 2022] GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc => generated 1451 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:01.505630 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6df9533f-11fb-47e5-b83b-891c09dc1e69 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:01.506218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6df9533f-11fb-47e5-b83b-891c09dc1e69 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:01.518828 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6df9533f-11fb-47e5-b83b-891c09dc1e69 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:01.520685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6df9533f-11fb-47e5-b83b-891c09dc1e69 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:01.521530 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6df9533f-11fb-47e5-b83b-891c09dc1e69 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:01.524173 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6df9533f-11fb-47e5-b83b-891c09dc1e69 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:01.524829 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6df9533f-11fb-47e5-b83b-891c09dc1e69 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:01.526109 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6df9533f-11fb-47e5-b83b-891c09dc1e69 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:01.831612 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4f38770d-a14a-4364-b2a5-aae4215e562b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:01.832196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4f38770d-a14a-4364-b2a5-aae4215e562b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 9133ea4e-7828-4227-a454-681cc3b7b695] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:01.844209 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f38770d-a14a-4364-b2a5-aae4215e562b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:01.844726 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f38770d-a14a-4364-b2a5-aae4215e562b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:01.845194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f38770d-a14a-4364-b2a5-aae4215e562b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:01.845908 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f38770d-a14a-4364-b2a5-aae4215e562b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:01.846368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f38770d-a14a-4364-b2a5-aae4215e562b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:01.851749 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f38770d-a14a-4364-b2a5-aae4215e562b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:02.284210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6df9533f-11fb-47e5-b83b-891c09dc1e69 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:02.304207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6df9533f-11fb-47e5-b83b-891c09dc1e69 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:02.305905 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6df9533f-11fb-47e5-b83b-891c09dc1e69 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:02.315845 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6df9533f-11fb-47e5-b83b-891c09dc1e69 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1709 microversion: 2.32 time: 0.806952 Oct 05 02:52:02.332984 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2408/4813] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:01 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1709 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:52:02.332984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-93a05520-6649-4871-b2d2-07d6f7229f49 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:02.332984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-93a05520-6649-4871-b2d2-07d6f7229f49 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:02.351338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93a05520-6649-4871-b2d2-07d6f7229f49 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:02.351664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93a05520-6649-4871-b2d2-07d6f7229f49 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:02.352055 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93a05520-6649-4871-b2d2-07d6f7229f49 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:02.352778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93a05520-6649-4871-b2d2-07d6f7229f49 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:02.355184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93a05520-6649-4871-b2d2-07d6f7229f49 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:02.357258 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93a05520-6649-4871-b2d2-07d6f7229f49 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:02.393577 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4f38770d-a14a-4364-b2a5-aae4215e562b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:02.403276 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4f38770d-a14a-4364-b2a5-aae4215e562b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695" status: 200 len: 1316 microversion: 2.1 time: 0.575552 Oct 05 02:52:02.435025 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2406/4814] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:01 2022] GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695 => generated 1316 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:02.441343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9a50012a-50ff-4736-91f0-d970dd182698 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:02.442057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9a50012a-50ff-4736-91f0-d970dd182698 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: ba5279cc-8f1f-436e-8341-21488398f1dc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:02.466033 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a50012a-50ff-4736-91f0-d970dd182698 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:02.466541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a50012a-50ff-4736-91f0-d970dd182698 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:02.466986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a50012a-50ff-4736-91f0-d970dd182698 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:02.467696 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a50012a-50ff-4736-91f0-d970dd182698 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:02.476469 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a50012a-50ff-4736-91f0-d970dd182698 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:02.481361 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a50012a-50ff-4736-91f0-d970dd182698 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:02.523320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-93a05520-6649-4871-b2d2-07d6f7229f49 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:02.528647 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-9a50012a-50ff-4736-91f0-d970dd182698 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] HTTP exception thrown: Instance ba5279cc-8f1f-436e-8341-21488398f1dc could not be found. Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9a50012a-50ff-4736-91f0-d970dd182698 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Request method failure captured: Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc HTTP/1.1 Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO7Sif7k2Rw6uRp1-U79PqbkOIEiV2C9maqWOg5HMbTQohV_wI3ZnNHqYwQk7awYRSS07q-kKtBu6GhULl5i3c9ATZsA7i0MdjMTEZGOwFDjxeZA_z2PV0fcLV1ncQTeNhB317y14StT_9d9kGPegGkBw0puNI5HL7TMGXTWx0tieJI Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 1ff63adf9571439d8f8bf9b0fa6c63f9 Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServerActionsTestJSON-1915862737 Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ff63adf9571439d8f8bf9b0fa6c63f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ff63adf9571439d8f8bf9b0fa6c63f9"}]}, {"type": "tempest-type-193258006", "name": "tempest-service-692660016", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1ff63adf9571439d8f8bf9b0fa6c63f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1ff63adf9571439d8f8bf9b0fa6c63f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServerActionsTestJSON-1915862737 Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 1ff63adf9571439d8f8bf9b0fa6c63f9 Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServerActionsTestJSON-1915862737 Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServerActionsTestJSON-1915862737-project Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 728544ca5e164540b3c5395534542955 Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServerActionsTestJSON-1915862737-project Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance ba5279cc-8f1f-436e-8341-21488398f1dc could not be found. Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'ba5279cc-8f1f-436e-8341-21488398f1dc'} Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba5279cc-8f1f-436e-8341-21488398f1dc could not be found. Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba5279cc-8f1f-436e-8341-21488398f1dc could not be found. Oct 05 02:52:02.530863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:02.536035 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:02.536035 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:02.536035 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:02.536035 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:02.536035 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:02.536035 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:52:02.536035 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:52:02.536035 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba5279cc-8f1f-436e-8341-21488398f1dc could not be found. Oct 05 02:52:02.536035 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:02.540517 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9a50012a-50ff-4736-91f0-d970dd182698 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Returning 404 to user: Instance ba5279cc-8f1f-436e-8341-21488398f1dc could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:52:02.541631 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9a50012a-50ff-4736-91f0-d970dd182698 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc" status: 404 len: 111 microversion: 2.1 time: 0.105496 Oct 05 02:52:02.545901 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2407/4815] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:02 2022] GET /compute/v2.1/servers/ba5279cc-8f1f-436e-8341-21488398f1dc => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:52:02.546420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-93a05520-6649-4871-b2d2-07d6f7229f49 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:02.549619 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-93a05520-6649-4871-b2d2-07d6f7229f49 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:02.551005 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-93a05520-6649-4871-b2d2-07d6f7229f49 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1604 microversion: 2.42 time: 0.233002 Oct 05 02:52:02.551458 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2409/4816] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:02 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1604 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:52:02.553270 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5a2e06f5-e5c9-4904-bf96-715198426e65 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:02.553818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5a2e06f5-e5c9-4904-bf96-715198426e65 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:02.578040 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5a2e06f5-e5c9-4904-bf96-715198426e65 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:02.579560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5a2e06f5-e5c9-4904-bf96-715198426e65 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:02.580865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5a2e06f5-e5c9-4904-bf96-715198426e65 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:02.582285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5a2e06f5-e5c9-4904-bf96-715198426e65 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:02.582976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5a2e06f5-e5c9-4904-bf96-715198426e65 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:02.583892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5a2e06f5-e5c9-4904-bf96-715198426e65 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:02.650263 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5a2e06f5-e5c9-4904-bf96-715198426e65 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:52:02.660376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:52:02.921138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-c92f21e6-e232-48d8-9eda-fa8215224a2a req-9c42d0f3-4337-471a-a116-2026e81d33cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba5279cc-8f1f-436e-8341-21488398f1dc", "name": "network-vif-deleted", "tag": "8ace94b1-dfa5-4957-9902-856931c12b4c"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:52:02.943217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:52:02.955824 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c92f21e6-e232-48d8-9eda-fa8215224a2a req-9c42d0f3-4337-471a-a116-2026e81d33cb service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:02.956316 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c92f21e6-e232-48d8-9eda-fa8215224a2a req-9c42d0f3-4337-471a-a116-2026e81d33cb service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:02.956757 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c92f21e6-e232-48d8-9eda-fa8215224a2a req-9c42d0f3-4337-471a-a116-2026e81d33cb service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:02.987810 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5a2e06f5-e5c9-4904-bf96-715198426e65 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 204 len: 0 microversion: 2.1 time: 0.440134 Oct 05 02:52:02.989373 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2408/4817] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:52:02 2022] DELETE /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:52:02.999222 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c4aebff0-6844-470e-96bd-ea3ad85e9a59 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:03.000184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c4aebff0-6844-470e-96bd-ea3ad85e9a59 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:03.010410 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-c92f21e6-e232-48d8-9eda-fa8215224a2a req-9c42d0f3-4337-471a-a116-2026e81d33cb service nova] Creating event network-vif-deleted:8ace94b1-dfa5-4957-9902-856931c12b4c for instance ba5279cc-8f1f-436e-8341-21488398f1dc on n-h2-858272-3 Oct 05 02:52:03.018637 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4aebff0-6844-470e-96bd-ea3ad85e9a59 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:03.020541 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-c92f21e6-e232-48d8-9eda-fa8215224a2a req-9c42d0f3-4337-471a-a116-2026e81d33cb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103255 Oct 05 02:52:03.021307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4aebff0-6844-470e-96bd-ea3ad85e9a59 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:03.023485 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4aebff0-6844-470e-96bd-ea3ad85e9a59 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:03.023713 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2410/4818] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:52:03.024680 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4aebff0-6844-470e-96bd-ea3ad85e9a59 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:03.029250 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4aebff0-6844-470e-96bd-ea3ad85e9a59 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:03.029989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4aebff0-6844-470e-96bd-ea3ad85e9a59 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:03.351121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-43736445-2c20-4121-82dd-af3d0a57db19 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:03.352626 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-43736445-2c20-4121-82dd-af3d0a57db19 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:03.364217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43736445-2c20-4121-82dd-af3d0a57db19 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:03.364491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c4aebff0-6844-470e-96bd-ea3ad85e9a59 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:03.367627 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43736445-2c20-4121-82dd-af3d0a57db19 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:03.373398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43736445-2c20-4121-82dd-af3d0a57db19 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:03.374660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43736445-2c20-4121-82dd-af3d0a57db19 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:03.375631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43736445-2c20-4121-82dd-af3d0a57db19 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:03.376621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43736445-2c20-4121-82dd-af3d0a57db19 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:03.379214 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c4aebff0-6844-470e-96bd-ea3ad85e9a59 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1675 microversion: 2.1 time: 0.384994 Oct 05 02:52:03.382862 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2409/4819] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:02 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1675 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:03.433062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f778fd7c-169b-487e-b46c-00140bae2389 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:03.433824 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f778fd7c-169b-487e-b46c-00140bae2389 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 9133ea4e-7828-4227-a454-681cc3b7b695] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:03.463052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f778fd7c-169b-487e-b46c-00140bae2389 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:03.464723 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f778fd7c-169b-487e-b46c-00140bae2389 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:03.467578 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f778fd7c-169b-487e-b46c-00140bae2389 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:03.469238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f778fd7c-169b-487e-b46c-00140bae2389 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:03.474040 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f778fd7c-169b-487e-b46c-00140bae2389 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:03.478785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f778fd7c-169b-487e-b46c-00140bae2389 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:04.013528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-43736445-2c20-4121-82dd-af3d0a57db19 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:04.027167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-43736445-2c20-4121-82dd-af3d0a57db19 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:04.035914 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-43736445-2c20-4121-82dd-af3d0a57db19 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:04.041950 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-43736445-2c20-4121-82dd-af3d0a57db19 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1756 microversion: 2.32 time: 0.699965 Oct 05 02:52:04.043149 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2411/4820] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:03 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1756 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:52:04.062258 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-72bb8b0c-8817-46e6-91cd-b84a516c1c69 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:04.063184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-72bb8b0c-8817-46e6-91cd-b84a516c1c69 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:04.081696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72bb8b0c-8817-46e6-91cd-b84a516c1c69 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:04.082487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72bb8b0c-8817-46e6-91cd-b84a516c1c69 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:04.083435 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72bb8b0c-8817-46e6-91cd-b84a516c1c69 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:04.084372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72bb8b0c-8817-46e6-91cd-b84a516c1c69 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:04.087768 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72bb8b0c-8817-46e6-91cd-b84a516c1c69 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:04.089029 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72bb8b0c-8817-46e6-91cd-b84a516c1c69 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:04.109572 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f778fd7c-169b-487e-b46c-00140bae2389 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:04.124149 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f778fd7c-169b-487e-b46c-00140bae2389 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695" status: 200 len: 1316 microversion: 2.1 time: 0.695420 Oct 05 02:52:04.140991 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2410/4821] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:03 2022] GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695 => generated 1316 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:52:04.313391 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-72bb8b0c-8817-46e6-91cd-b84a516c1c69 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:04.334442 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-72bb8b0c-8817-46e6-91cd-b84a516c1c69 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:04.343016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-72bb8b0c-8817-46e6-91cd-b84a516c1c69 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:04.350126 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-72bb8b0c-8817-46e6-91cd-b84a516c1c69 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1604 microversion: 2.42 time: 0.299969 Oct 05 02:52:04.366451 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2412/4822] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:04 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1604 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:52:04.410684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4eda8b93-f611-447e-bf10-a9257824a6d9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:04.411371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4eda8b93-f611-447e-bf10-a9257824a6d9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:04.422640 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4eda8b93-f611-447e-bf10-a9257824a6d9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:04.423208 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4eda8b93-f611-447e-bf10-a9257824a6d9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:04.423664 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4eda8b93-f611-447e-bf10-a9257824a6d9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:04.425702 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4eda8b93-f611-447e-bf10-a9257824a6d9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:04.427398 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4eda8b93-f611-447e-bf10-a9257824a6d9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:04.428426 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4eda8b93-f611-447e-bf10-a9257824a6d9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:04.885505 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4eda8b93-f611-447e-bf10-a9257824a6d9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:04.898438 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4eda8b93-f611-447e-bf10-a9257824a6d9 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1675 microversion: 2.1 time: 0.492100 Oct 05 02:52:04.901796 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2411/4823] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:04 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1675 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:52:05.076428 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-801df6ce-fd77-4280-8d8b-a5e40813525f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:05.077910 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-801df6ce-fd77-4280-8d8b-a5e40813525f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:05.109190 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-801df6ce-fd77-4280-8d8b-a5e40813525f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:05.110138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-801df6ce-fd77-4280-8d8b-a5e40813525f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:05.114262 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-801df6ce-fd77-4280-8d8b-a5e40813525f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:05.118398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-801df6ce-fd77-4280-8d8b-a5e40813525f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:05.125397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-801df6ce-fd77-4280-8d8b-a5e40813525f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:05.128327 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-801df6ce-fd77-4280-8d8b-a5e40813525f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:05.166572 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ca3729b3-6009-4df0-b476-7422e0f49570 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:05.169028 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ca3729b3-6009-4df0-b476-7422e0f49570 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 9133ea4e-7828-4227-a454-681cc3b7b695] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:05.189284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca3729b3-6009-4df0-b476-7422e0f49570 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:05.193721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca3729b3-6009-4df0-b476-7422e0f49570 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:05.208096 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca3729b3-6009-4df0-b476-7422e0f49570 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:05.223014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca3729b3-6009-4df0-b476-7422e0f49570 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:05.224309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca3729b3-6009-4df0-b476-7422e0f49570 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:05.228083 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca3729b3-6009-4df0-b476-7422e0f49570 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:05.541356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-801df6ce-fd77-4280-8d8b-a5e40813525f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:05.551302 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-801df6ce-fd77-4280-8d8b-a5e40813525f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:05.552747 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-801df6ce-fd77-4280-8d8b-a5e40813525f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:05.553970 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-801df6ce-fd77-4280-8d8b-a5e40813525f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1756 microversion: 2.32 time: 0.488928 Oct 05 02:52:05.571369 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2413/4824] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:05 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1756 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:52:05.588357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ca4347af-5f7f-4a6a-bb81-f7100abb2501 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:05.588933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ca4347af-5f7f-4a6a-bb81-f7100abb2501 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:05.609156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca4347af-5f7f-4a6a-bb81-f7100abb2501 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:05.609909 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca4347af-5f7f-4a6a-bb81-f7100abb2501 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:05.610574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca4347af-5f7f-4a6a-bb81-f7100abb2501 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:05.611645 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca4347af-5f7f-4a6a-bb81-f7100abb2501 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:05.620862 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca4347af-5f7f-4a6a-bb81-f7100abb2501 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:05.622132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca4347af-5f7f-4a6a-bb81-f7100abb2501 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:05.778916 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ca4347af-5f7f-4a6a-bb81-f7100abb2501 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:05.792487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ca4347af-5f7f-4a6a-bb81-f7100abb2501 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:05.799616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ca4347af-5f7f-4a6a-bb81-f7100abb2501 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:05.801410 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ca4347af-5f7f-4a6a-bb81-f7100abb2501 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1604 microversion: 2.42 time: 0.228918 Oct 05 02:52:05.805117 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2414/4825] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:05 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1604 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:52:05.849651 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ca3729b3-6009-4df0-b476-7422e0f49570 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:05.858869 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ca3729b3-6009-4df0-b476-7422e0f49570 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695" status: 200 len: 1316 microversion: 2.1 time: 0.705474 Oct 05 02:52:05.867315 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2412/4826] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:05 2022] GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695 => generated 1316 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:52:05.924387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-237a3838-b773-4f2d-85d9-e5fdd60d9d2b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:05.925202 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-237a3838-b773-4f2d-85d9-e5fdd60d9d2b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:05.938260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-237a3838-b773-4f2d-85d9-e5fdd60d9d2b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:05.938895 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-237a3838-b773-4f2d-85d9-e5fdd60d9d2b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:05.939471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-237a3838-b773-4f2d-85d9-e5fdd60d9d2b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:05.940305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-237a3838-b773-4f2d-85d9-e5fdd60d9d2b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:05.940870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-237a3838-b773-4f2d-85d9-e5fdd60d9d2b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:05.941749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-237a3838-b773-4f2d-85d9-e5fdd60d9d2b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:06.325814 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-237a3838-b773-4f2d-85d9-e5fdd60d9d2b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:06.344772 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-237a3838-b773-4f2d-85d9-e5fdd60d9d2b tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1675 microversion: 2.1 time: 0.424759 Oct 05 02:52:06.348689 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2415/4827] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:05 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1675 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:06.581505 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1127cf35-c9ce-46d5-a420-006258d3b068 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:06.582167 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1127cf35-c9ce-46d5-a420-006258d3b068 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:06.596345 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1127cf35-c9ce-46d5-a420-006258d3b068 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:06.596684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1127cf35-c9ce-46d5-a420-006258d3b068 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:06.602819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1127cf35-c9ce-46d5-a420-006258d3b068 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:06.603679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1127cf35-c9ce-46d5-a420-006258d3b068 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:06.604180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1127cf35-c9ce-46d5-a420-006258d3b068 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:06.604614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1127cf35-c9ce-46d5-a420-006258d3b068 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:06.739458 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4c2ea62d-fc1b-400c-aedb-482965f222c8 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-2000902731", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-109281340", "security_groups": [{"name": "tempest-secgroup-smoke-334306212"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "bc2f5d4d-7da7-4c78-8d14-faf0f0d8502c"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:52:07.487048 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-4c2ea62d-fc1b-400c-aedb-482965f222c8 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] validate_networks() for [('bc2f5d4d-7da7-4c78-8d14-faf0f0d8502c', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:52:07.817682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1127cf35-c9ce-46d5-a420-006258d3b068 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:07.834137 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1127cf35-c9ce-46d5-a420-006258d3b068 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:07.839640 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1127cf35-c9ce-46d5-a420-006258d3b068 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:07.841343 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1127cf35-c9ce-46d5-a420-006258d3b068 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1803 microversion: 2.32 time: 1.264411 Oct 05 02:52:07.858425 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2413/4828] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:06 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1803 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:52:07.871874 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4921576b-b8d7-4ef5-b845-e9412382c9d4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:07.872649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4921576b-b8d7-4ef5-b845-e9412382c9d4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:07.880484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4921576b-b8d7-4ef5-b845-e9412382c9d4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:07.883276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4921576b-b8d7-4ef5-b845-e9412382c9d4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:07.885485 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4921576b-b8d7-4ef5-b845-e9412382c9d4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:07.886531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4921576b-b8d7-4ef5-b845-e9412382c9d4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:07.889262 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4921576b-b8d7-4ef5-b845-e9412382c9d4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:07.889990 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4921576b-b8d7-4ef5-b845-e9412382c9d4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:08.459009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4921576b-b8d7-4ef5-b845-e9412382c9d4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:08.517501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4921576b-b8d7-4ef5-b845-e9412382c9d4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:08.519379 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4921576b-b8d7-4ef5-b845-e9412382c9d4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:08.528610 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4921576b-b8d7-4ef5-b845-e9412382c9d4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1604 microversion: 2.42 time: 0.668570 Oct 05 02:52:08.531044 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2414/4829] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:07 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1604 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:52:08.561384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4369a0e9-4760-43e5-9ab9-e6f42eebe2df tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:08.569657 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4369a0e9-4760-43e5-9ab9-e6f42eebe2df tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 9133ea4e-7828-4227-a454-681cc3b7b695] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:08.594882 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4369a0e9-4760-43e5-9ab9-e6f42eebe2df tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:08.595387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4369a0e9-4760-43e5-9ab9-e6f42eebe2df tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:08.595828 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4369a0e9-4760-43e5-9ab9-e6f42eebe2df tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:08.596576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4369a0e9-4760-43e5-9ab9-e6f42eebe2df tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:08.597058 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4369a0e9-4760-43e5-9ab9-e6f42eebe2df tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:08.597483 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4369a0e9-4760-43e5-9ab9-e6f42eebe2df tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:09.037089 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4369a0e9-4760-43e5-9ab9-e6f42eebe2df tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:09.059196 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4369a0e9-4760-43e5-9ab9-e6f42eebe2df tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695" status: 200 len: 1316 microversion: 2.1 time: 0.510525 Oct 05 02:52:09.067480 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2415/4830] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:08 2022] GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695 => generated 1316 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:09.099286 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dc4db57d-5106-4be8-89aa-c76283aa1ca1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:09.101457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dc4db57d-5106-4be8-89aa-c76283aa1ca1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:09.136709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dc4db57d-5106-4be8-89aa-c76283aa1ca1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:09.138549 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dc4db57d-5106-4be8-89aa-c76283aa1ca1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:09.139172 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dc4db57d-5106-4be8-89aa-c76283aa1ca1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:09.141417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dc4db57d-5106-4be8-89aa-c76283aa1ca1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:09.144682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dc4db57d-5106-4be8-89aa-c76283aa1ca1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:09.145399 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dc4db57d-5106-4be8-89aa-c76283aa1ca1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:09.430339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-4c2ea62d-fc1b-400c-aedb-482965f222c8 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Getting quotas for project cfa67de433dc46a595baea99d927d156. Resources: dict_keys(['metadata_items']) {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:52:09.469837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-4c2ea62d-fc1b-400c-aedb-482965f222c8 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Getting quotas for user f23b56d519224b22802f978442c7289f and project cfa67de433dc46a595baea99d927d156. Resources: dict_keys(['metadata_items']) {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:52:09.471742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dc4db57d-5106-4be8-89aa-c76283aa1ca1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728544ca5e164540b3c5395534542955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:09.498014 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dc4db57d-5106-4be8-89aa-c76283aa1ca1 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 200 len: 1607 microversion: 2.1 time: 0.429346 Oct 05 02:52:09.499585 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2416/4831] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:09 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 1607 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:09.523269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-4c2ea62d-fc1b-400c-aedb-482965f222c8 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:52:09.523513 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-54129048-f6e4-408a-b534-60047463045e req-c17c7890-25e1-4473-a0c2-10ee1e34f98b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9133ea4e-7828-4227-a454-681cc3b7b695", "name": "network-vif-plugged", "status": "completed", "tag": "24df2682-34d4-46b6-9dfc-b81e96b90f43"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:52:09.528643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-4c2ea62d-fc1b-400c-aedb-482965f222c8 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:52:09.529435 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-4c2ea62d-fc1b-400c-aedb-482965f222c8 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:52:09.532978 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-4c2ea62d-fc1b-400c-aedb-482965f222c8 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:52:09.534459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-4c2ea62d-fc1b-400c-aedb-482965f222c8 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:52:09.559036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c2ea62d-fc1b-400c-aedb-482965f222c8 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:09.561308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c2ea62d-fc1b-400c-aedb-482965f222c8 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:09.564335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c2ea62d-fc1b-400c-aedb-482965f222c8 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:09.565775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c2ea62d-fc1b-400c-aedb-482965f222c8 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:09.567551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c2ea62d-fc1b-400c-aedb-482965f222c8 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:09.572317 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c2ea62d-fc1b-400c-aedb-482965f222c8 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:09.577588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-54129048-f6e4-408a-b534-60047463045e req-c17c7890-25e1-4473-a0c2-10ee1e34f98b service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:09.578369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-54129048-f6e4-408a-b534-60047463045e req-c17c7890-25e1-4473-a0c2-10ee1e34f98b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:09.589178 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-54129048-f6e4-408a-b534-60047463045e req-c17c7890-25e1-4473-a0c2-10ee1e34f98b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:09.624224 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-4c2ea62d-fc1b-400c-aedb-482965f222c8 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Getting quotas for project cfa67de433dc46a595baea99d927d156. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:52:09.631128 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-54129048-f6e4-408a-b534-60047463045e req-c17c7890-25e1-4473-a0c2-10ee1e34f98b service nova] Creating event network-vif-plugged:24df2682-34d4-46b6-9dfc-b81e96b90f43 for instance 9133ea4e-7828-4227-a454-681cc3b7b695 on n-h1-858272-3 Oct 05 02:52:09.646527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-4c2ea62d-fc1b-400c-aedb-482965f222c8 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Getting quotas for user f23b56d519224b22802f978442c7289f and project cfa67de433dc46a595baea99d927d156. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:52:09.652369 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-54129048-f6e4-408a-b534-60047463045e req-c17c7890-25e1-4473-a0c2-10ee1e34f98b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151008 Oct 05 02:52:09.669603 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2417/4832] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:52:09.678342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f8828086-a340-489a-b897-f1b654b004f8 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:09.691210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f8828086-a340-489a-b897-f1b654b004f8 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:09.711693 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8828086-a340-489a-b897-f1b654b004f8 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:09.713677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8828086-a340-489a-b897-f1b654b004f8 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:09.714769 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8828086-a340-489a-b897-f1b654b004f8 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:09.728318 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8828086-a340-489a-b897-f1b654b004f8 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:09.729035 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8828086-a340-489a-b897-f1b654b004f8 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:09.729649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8828086-a340-489a-b897-f1b654b004f8 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:09.739241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4c2ea62d-fc1b-400c-aedb-482965f222c8 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:52:09.765297 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4c2ea62d-fc1b-400c-aedb-482965f222c8 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] [instance: a1c78871-374e-41d9-af4a-d8284ccb8508] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:52:09.889547 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4c2ea62d-fc1b-400c-aedb-482965f222c8 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.154105 Oct 05 02:52:09.899063 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2416/4833] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:52:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 3164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:52:09.913001 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b00ce227-afe6-4532-920e-9cc2b8013fca tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:09.914296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b00ce227-afe6-4532-920e-9cc2b8013fca tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:09.937431 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b00ce227-afe6-4532-920e-9cc2b8013fca tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:09.940499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b00ce227-afe6-4532-920e-9cc2b8013fca tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:09.943826 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b00ce227-afe6-4532-920e-9cc2b8013fca tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:09.945438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b00ce227-afe6-4532-920e-9cc2b8013fca tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:09.947657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b00ce227-afe6-4532-920e-9cc2b8013fca tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:09.948250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b00ce227-afe6-4532-920e-9cc2b8013fca tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:10.403373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b00ce227-afe6-4532-920e-9cc2b8013fca tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:10.418781 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b00ce227-afe6-4532-920e-9cc2b8013fca tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:10.424335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b00ce227-afe6-4532-920e-9cc2b8013fca tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:10.426690 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b00ce227-afe6-4532-920e-9cc2b8013fca tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1604 microversion: 2.42 time: 0.526077 Oct 05 02:52:10.442029 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2417/4834] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:09 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1604 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:52:10.458466 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-bb5419bb-96ca-4cd1-93fe-b2e5a9b01173 req-dd39e156-b379-4bde-92fd-131d3a7cf59e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4388e9ec-13a9-4d5b-9310-7a10953c57d0", "name": "network-vif-deleted", "tag": "17b098e0-7358-489c-bec3-6b98c1db0796"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:52:10.488546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-bb5419bb-96ca-4cd1-93fe-b2e5a9b01173 req-dd39e156-b379-4bde-92fd-131d3a7cf59e service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:10.489460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-bb5419bb-96ca-4cd1-93fe-b2e5a9b01173 req-dd39e156-b379-4bde-92fd-131d3a7cf59e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:10.491629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-bb5419bb-96ca-4cd1-93fe-b2e5a9b01173 req-dd39e156-b379-4bde-92fd-131d3a7cf59e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:10.510477 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-bb5419bb-96ca-4cd1-93fe-b2e5a9b01173 req-dd39e156-b379-4bde-92fd-131d3a7cf59e service nova] Creating event network-vif-deleted:17b098e0-7358-489c-bec3-6b98c1db0796 for instance 4388e9ec-13a9-4d5b-9310-7a10953c57d0 on n-h1-858272-3 Oct 05 02:52:10.517424 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-bb5419bb-96ca-4cd1-93fe-b2e5a9b01173 req-dd39e156-b379-4bde-92fd-131d3a7cf59e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064139 Oct 05 02:52:10.519036 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2418/4835] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:52:10.527583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-322013a4-ba17-4675-b9b5-56d8618c8455 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:10.528622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-322013a4-ba17-4675-b9b5-56d8618c8455 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] [instance: a1c78871-374e-41d9-af4a-d8284ccb8508] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:10.761826 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-322013a4-ba17-4675-b9b5-56d8618c8455 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23b56d519224b22802f978442c7289f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa67de433dc46a595baea99d927d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:10.785197 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-322013a4-ba17-4675-b9b5-56d8618c8455 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] 10.222.0.16 "GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508" status: 200 len: 1302 microversion: 2.1 time: 0.260644 Oct 05 02:52:10.792545 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2419/4836] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:10 2022] GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508 => generated 1302 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:10.801762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f8828086-a340-489a-b897-f1b654b004f8 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:10.805357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-342f7e34-b2bb-4657-87b3-9b0d1161034d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:10.806623 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-342f7e34-b2bb-4657-87b3-9b0d1161034d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 9133ea4e-7828-4227-a454-681cc3b7b695] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:10.815900 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-342f7e34-b2bb-4657-87b3-9b0d1161034d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:10.816692 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-342f7e34-b2bb-4657-87b3-9b0d1161034d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:10.817935 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-342f7e34-b2bb-4657-87b3-9b0d1161034d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:10.818955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-342f7e34-b2bb-4657-87b3-9b0d1161034d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:10.820349 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-342f7e34-b2bb-4657-87b3-9b0d1161034d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:10.821942 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f8828086-a340-489a-b897-f1b654b004f8 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:10.822582 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-342f7e34-b2bb-4657-87b3-9b0d1161034d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:10.823915 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f8828086-a340-489a-b897-f1b654b004f8 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:10.825363 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f8828086-a340-489a-b897-f1b654b004f8 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1850 microversion: 2.32 time: 1.154534 Oct 05 02:52:10.827269 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2418/4837] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:09 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1850 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:52:10.836383 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-077e4816-3229-4813-81bc-70c0726a0284 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:10.840781 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-077e4816-3229-4813-81bc-70c0726a0284 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] [instance: 4388e9ec-13a9-4d5b-9310-7a10953c57d0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:10.853774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-077e4816-3229-4813-81bc-70c0726a0284 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:10.857463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-077e4816-3229-4813-81bc-70c0726a0284 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:10.858130 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-077e4816-3229-4813-81bc-70c0726a0284 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:10.859067 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-077e4816-3229-4813-81bc-70c0726a0284 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:10.859889 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-077e4816-3229-4813-81bc-70c0726a0284 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:10.863943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-077e4816-3229-4813-81bc-70c0726a0284 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:10.909471 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:52:10.920696 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-077e4816-3229-4813-81bc-70c0726a0284 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] HTTP exception thrown: Instance 4388e9ec-13a9-4d5b-9310-7a10953c57d0 could not be found. Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-077e4816-3229-4813-81bc-70c0726a0284 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Request method failure captured: Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 HTTP/1.1 Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPO7Sif7k2Rw6uRp1-U79PqbkOIEiV2C9maqWOg5HMbTQohV_wI3ZnNHqYwQk7awYRSS07q-kKtBu6GhULl5i3c9ATZsA7i0MdjMTEZGOwFDjxeZA_z2PV0fcLV1ncQTeNhB317y14StT_9d9kGPegGkBw0puNI5HL7TMGXTWx0tieJI Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 1ff63adf9571439d8f8bf9b0fa6c63f9 Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServerActionsTestJSON-1915862737 Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ff63adf9571439d8f8bf9b0fa6c63f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ff63adf9571439d8f8bf9b0fa6c63f9"}]}, {"type": "tempest-type-193258006", "name": "tempest-service-692660016", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1ff63adf9571439d8f8bf9b0fa6c63f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1ff63adf9571439d8f8bf9b0fa6c63f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServerActionsTestJSON-1915862737 Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 1ff63adf9571439d8f8bf9b0fa6c63f9 Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServerActionsTestJSON-1915862737 Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServerActionsTestJSON-1915862737-project Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 728544ca5e164540b3c5395534542955 Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServerActionsTestJSON-1915862737-project Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 4388e9ec-13a9-4d5b-9310-7a10953c57d0 could not be found. Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '4388e9ec-13a9-4d5b-9310-7a10953c57d0'} Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4388e9ec-13a9-4d5b-9310-7a10953c57d0 could not be found. Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4388e9ec-13a9-4d5b-9310-7a10953c57d0 could not be found. Oct 05 02:52:10.924249 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:10.930451 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:10.930451 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:10.930451 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:10.930451 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:10.930451 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:10.930451 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:52:10.930451 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:52:10.930451 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4388e9ec-13a9-4d5b-9310-7a10953c57d0 could not be found. Oct 05 02:52:10.930451 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:10.933483 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-077e4816-3229-4813-81bc-70c0726a0284 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Returning 404 to user: Instance 4388e9ec-13a9-4d5b-9310-7a10953c57d0 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:52:10.942587 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-077e4816-3229-4813-81bc-70c0726a0284 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0" status: 404 len: 111 microversion: 2.1 time: 0.109577 Oct 05 02:52:10.951824 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2419/4838] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:10 2022] GET /compute/v2.1/servers/4388e9ec-13a9-4d5b-9310-7a10953c57d0 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:52:10.962666 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7e891c0f-dd1a-437f-b92a-b7673b3c3084 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] Calling method '.version_select at 0x7fcce437bc10>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:11.010594 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7e891c0f-dd1a-437f-b92a-b7673b3c3084 tempest-ServerActionsTestJSON-1915862737 tempest-ServerActionsTestJSON-1915862737-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1513811679" status: 202 len: 0 microversion: 2.1 time: 0.057333 Oct 05 02:52:11.013941 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2420/4839] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 5 02:52:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1513811679 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:52:11.240513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-342f7e34-b2bb-4657-87b3-9b0d1161034d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:11.258979 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-342f7e34-b2bb-4657-87b3-9b0d1161034d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695" status: 200 len: 1316 microversion: 2.1 time: 0.464715 Oct 05 02:52:11.262521 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2420/4840] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:10 2022] GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695 => generated 1316 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:11.460378 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-92bd2b7d-df17-444a-852d-2c83578acf4e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:11.463535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-92bd2b7d-df17-444a-852d-2c83578acf4e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:11.499266 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92bd2b7d-df17-444a-852d-2c83578acf4e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:11.499485 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92bd2b7d-df17-444a-852d-2c83578acf4e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:11.501842 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92bd2b7d-df17-444a-852d-2c83578acf4e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:11.504741 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92bd2b7d-df17-444a-852d-2c83578acf4e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:11.505655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92bd2b7d-df17-444a-852d-2c83578acf4e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:11.509408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92bd2b7d-df17-444a-852d-2c83578acf4e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:11.709729 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-92bd2b7d-df17-444a-852d-2c83578acf4e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:11.734826 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-92bd2b7d-df17-444a-852d-2c83578acf4e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:11.737026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-92bd2b7d-df17-444a-852d-2c83578acf4e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:11.739537 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-92bd2b7d-df17-444a-852d-2c83578acf4e tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1604 microversion: 2.42 time: 0.285498 Oct 05 02:52:11.742177 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2421/4841] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:11 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1604 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:52:11.832174 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-eb104ac6-329f-4a69-ad90-570d647d6eac tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:11.833699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-eb104ac6-329f-4a69-ad90-570d647d6eac tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] [instance: a1c78871-374e-41d9-af4a-d8284ccb8508] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:11.856475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4104e1f4-5597-4903-993e-edfdd7170f5f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:11.857763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4104e1f4-5597-4903-993e-edfdd7170f5f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:11.861450 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb104ac6-329f-4a69-ad90-570d647d6eac tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:11.862022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb104ac6-329f-4a69-ad90-570d647d6eac tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:11.862571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb104ac6-329f-4a69-ad90-570d647d6eac tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:11.863225 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb104ac6-329f-4a69-ad90-570d647d6eac tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:11.867669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb104ac6-329f-4a69-ad90-570d647d6eac tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:11.868128 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb104ac6-329f-4a69-ad90-570d647d6eac tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:11.883239 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4104e1f4-5597-4903-993e-edfdd7170f5f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:11.884108 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4104e1f4-5597-4903-993e-edfdd7170f5f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:11.885947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4104e1f4-5597-4903-993e-edfdd7170f5f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:11.888982 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4104e1f4-5597-4903-993e-edfdd7170f5f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:11.889480 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4104e1f4-5597-4903-993e-edfdd7170f5f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:11.889931 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4104e1f4-5597-4903-993e-edfdd7170f5f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:12.046972 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-eb104ac6-329f-4a69-ad90-570d647d6eac tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23b56d519224b22802f978442c7289f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa67de433dc46a595baea99d927d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:12.062751 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-eb104ac6-329f-4a69-ad90-570d647d6eac tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] 10.222.0.16 "GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508" status: 200 len: 1354 microversion: 2.1 time: 0.243671 Oct 05 02:52:12.076927 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2421/4842] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:11 2022] GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508 => generated 1354 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:12.079379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-2c8e0ccf-c7d4-45e9-b804-62d605e721a8 req-b5adacd7-dae1-4d1a-87e9-d0327575e1dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ef11e58-0680-4e15-aa40-a4043a5a357a", "tag": "384505a1-ac43-4ab5-a021-9305e81770ae"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:52:12.113197 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-2c8e0ccf-c7d4-45e9-b804-62d605e721a8 req-b5adacd7-dae1-4d1a-87e9-d0327575e1dc service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:12.113690 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-2c8e0ccf-c7d4-45e9-b804-62d605e721a8 req-b5adacd7-dae1-4d1a-87e9-d0327575e1dc service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:12.114123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-2c8e0ccf-c7d4-45e9-b804-62d605e721a8 req-b5adacd7-dae1-4d1a-87e9-d0327575e1dc service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:12.166369 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-2c8e0ccf-c7d4-45e9-b804-62d605e721a8 req-b5adacd7-dae1-4d1a-87e9-d0327575e1dc service nova] Creating event network-changed:384505a1-ac43-4ab5-a021-9305e81770ae for instance 2ef11e58-0680-4e15-aa40-a4043a5a357a on n-h1-858272-3 Oct 05 02:52:12.176985 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-2c8e0ccf-c7d4-45e9-b804-62d605e721a8 req-b5adacd7-dae1-4d1a-87e9-d0327575e1dc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108397 Oct 05 02:52:12.177609 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2422/4843] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:52:12.287313 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dc2ef758-bbc5-48fc-adc2-6cb1d3e27b6e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:12.288496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-dc2ef758-bbc5-48fc-adc2-6cb1d3e27b6e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 9133ea4e-7828-4227-a454-681cc3b7b695] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:12.305712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc2ef758-bbc5-48fc-adc2-6cb1d3e27b6e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:12.306430 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc2ef758-bbc5-48fc-adc2-6cb1d3e27b6e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:12.309259 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc2ef758-bbc5-48fc-adc2-6cb1d3e27b6e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:12.310244 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc2ef758-bbc5-48fc-adc2-6cb1d3e27b6e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:12.310889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc2ef758-bbc5-48fc-adc2-6cb1d3e27b6e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:12.314287 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc2ef758-bbc5-48fc-adc2-6cb1d3e27b6e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:12.784607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4104e1f4-5597-4903-993e-edfdd7170f5f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:12.800461 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4104e1f4-5597-4903-993e-edfdd7170f5f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:12.802110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4104e1f4-5597-4903-993e-edfdd7170f5f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:12.806715 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4104e1f4-5597-4903-993e-edfdd7170f5f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1850 microversion: 2.32 time: 0.956291 Oct 05 02:52:12.809627 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2422/4844] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:11 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1850 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:52:12.820753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0a0e7afa-a1cd-4dbb-b056-3ab86a04d02d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:12.823887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0a0e7afa-a1cd-4dbb-b056-3ab86a04d02d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:12.837034 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0a0e7afa-a1cd-4dbb-b056-3ab86a04d02d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:12.838359 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0a0e7afa-a1cd-4dbb-b056-3ab86a04d02d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:12.838829 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0a0e7afa-a1cd-4dbb-b056-3ab86a04d02d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:12.840876 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0a0e7afa-a1cd-4dbb-b056-3ab86a04d02d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:12.841362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0a0e7afa-a1cd-4dbb-b056-3ab86a04d02d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:12.841812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0a0e7afa-a1cd-4dbb-b056-3ab86a04d02d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:13.211696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-dc2ef758-bbc5-48fc-adc2-6cb1d3e27b6e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:13.212933 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0a0e7afa-a1cd-4dbb-b056-3ab86a04d02d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:13.228809 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0a0e7afa-a1cd-4dbb-b056-3ab86a04d02d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:13.231481 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-dc2ef758-bbc5-48fc-adc2-6cb1d3e27b6e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695" status: 200 len: 1316 microversion: 2.1 time: 0.944628 Oct 05 02:52:13.233432 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2423/4845] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:12 2022] GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695 => generated 1316 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:52:13.238026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0a0e7afa-a1cd-4dbb-b056-3ab86a04d02d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:13.239305 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0a0e7afa-a1cd-4dbb-b056-3ab86a04d02d tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1604 microversion: 2.42 time: 0.428654 Oct 05 02:52:13.242289 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2423/4846] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:12 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1604 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:52:13.257177 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3b3121bf-ac1c-41ab-93d7-a32538b1f048 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:13.271001 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3b3121bf-ac1c-41ab-93d7-a32538b1f048 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] [instance: a1c78871-374e-41d9-af4a-d8284ccb8508] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:13.284825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3b3121bf-ac1c-41ab-93d7-a32538b1f048 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:13.287358 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3b3121bf-ac1c-41ab-93d7-a32538b1f048 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:13.290159 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3b3121bf-ac1c-41ab-93d7-a32538b1f048 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:13.291179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3b3121bf-ac1c-41ab-93d7-a32538b1f048 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:13.291846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3b3121bf-ac1c-41ab-93d7-a32538b1f048 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:13.292376 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3b3121bf-ac1c-41ab-93d7-a32538b1f048 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:13.480291 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3b3121bf-ac1c-41ab-93d7-a32538b1f048 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23b56d519224b22802f978442c7289f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa67de433dc46a595baea99d927d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:13.494413 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3b3121bf-ac1c-41ab-93d7-a32538b1f048 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] 10.222.0.16 "GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508" status: 200 len: 1360 microversion: 2.1 time: 0.259728 Oct 05 02:52:13.513806 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2424/4847] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:13 2022] GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508 => generated 1360 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:13.836475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3198adbe-5916-4e41-8ddf-48beb1b1a677 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:13.837390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3198adbe-5916-4e41-8ddf-48beb1b1a677 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:13.845612 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3198adbe-5916-4e41-8ddf-48beb1b1a677 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:13.846384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3198adbe-5916-4e41-8ddf-48beb1b1a677 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:13.846992 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3198adbe-5916-4e41-8ddf-48beb1b1a677 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:13.847896 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3198adbe-5916-4e41-8ddf-48beb1b1a677 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:13.848862 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3198adbe-5916-4e41-8ddf-48beb1b1a677 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:13.849474 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3198adbe-5916-4e41-8ddf-48beb1b1a677 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:14.262210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-19c2e511-636c-4169-85a6-a36435919174 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:14.263495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-19c2e511-636c-4169-85a6-a36435919174 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 9133ea4e-7828-4227-a454-681cc3b7b695] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:14.278675 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19c2e511-636c-4169-85a6-a36435919174 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:14.279595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19c2e511-636c-4169-85a6-a36435919174 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:14.280331 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19c2e511-636c-4169-85a6-a36435919174 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:14.281391 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19c2e511-636c-4169-85a6-a36435919174 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:14.282234 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19c2e511-636c-4169-85a6-a36435919174 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:14.282890 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19c2e511-636c-4169-85a6-a36435919174 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:14.409366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3198adbe-5916-4e41-8ddf-48beb1b1a677 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:14.437993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3198adbe-5916-4e41-8ddf-48beb1b1a677 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:14.445426 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3198adbe-5916-4e41-8ddf-48beb1b1a677 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:14.448972 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3198adbe-5916-4e41-8ddf-48beb1b1a677 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1850 microversion: 2.32 time: 0.615175 Oct 05 02:52:14.450806 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2424/4848] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:13 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1850 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:52:14.461298 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ca2af498-3786-42af-a9b2-906fcb08bf76 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:14.462837 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ca2af498-3786-42af-a9b2-906fcb08bf76 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:14.483397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca2af498-3786-42af-a9b2-906fcb08bf76 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:14.484255 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca2af498-3786-42af-a9b2-906fcb08bf76 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:14.487148 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca2af498-3786-42af-a9b2-906fcb08bf76 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:14.489846 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca2af498-3786-42af-a9b2-906fcb08bf76 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:14.490615 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca2af498-3786-42af-a9b2-906fcb08bf76 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:14.492522 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca2af498-3786-42af-a9b2-906fcb08bf76 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:14.672545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ca2af498-3786-42af-a9b2-906fcb08bf76 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:14.687436 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ca2af498-3786-42af-a9b2-906fcb08bf76 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:14.688860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ca2af498-3786-42af-a9b2-906fcb08bf76 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:14.702030 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ca2af498-3786-42af-a9b2-906fcb08bf76 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1604 microversion: 2.42 time: 0.249673 Oct 05 02:52:14.702969 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2425/4849] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:14 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1604 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:52:14.716940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-aa22593f-4e0f-402e-9b41-9c18811d6a02 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:14.717563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-aa22593f-4e0f-402e-9b41-9c18811d6a02 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] [instance: a1c78871-374e-41d9-af4a-d8284ccb8508] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:14.723797 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa22593f-4e0f-402e-9b41-9c18811d6a02 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:14.724297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa22593f-4e0f-402e-9b41-9c18811d6a02 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:14.724744 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa22593f-4e0f-402e-9b41-9c18811d6a02 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:14.733819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa22593f-4e0f-402e-9b41-9c18811d6a02 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:14.734331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa22593f-4e0f-402e-9b41-9c18811d6a02 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:14.734789 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa22593f-4e0f-402e-9b41-9c18811d6a02 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:14.739391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:52:14.843650 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-19c2e511-636c-4169-85a6-a36435919174 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:14.855219 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-19c2e511-636c-4169-85a6-a36435919174 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695" status: 200 len: 1505 microversion: 2.1 time: 0.597563 Oct 05 02:52:14.856756 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2425/4850] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:14 2022] GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695 => generated 1505 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:52:14.884344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1defe3c2-d8a2-4e87-adfd-3edb1c83adb2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:14.885288 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1defe3c2-d8a2-4e87-adfd-3edb1c83adb2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 9133ea4e-7828-4227-a454-681cc3b7b695] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:14.887352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-aa22593f-4e0f-402e-9b41-9c18811d6a02 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23b56d519224b22802f978442c7289f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa67de433dc46a595baea99d927d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:14.897677 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-aa22593f-4e0f-402e-9b41-9c18811d6a02 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] 10.222.0.16 "GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508" status: 200 len: 1360 microversion: 2.1 time: 0.193620 Oct 05 02:52:14.898632 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2426/4851] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:14 2022] GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508 => generated 1360 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:14.899413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1defe3c2-d8a2-4e87-adfd-3edb1c83adb2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:14.900405 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1defe3c2-d8a2-4e87-adfd-3edb1c83adb2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:14.900975 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1defe3c2-d8a2-4e87-adfd-3edb1c83adb2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:14.902351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1defe3c2-d8a2-4e87-adfd-3edb1c83adb2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:14.903345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1defe3c2-d8a2-4e87-adfd-3edb1c83adb2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:14.906569 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1defe3c2-d8a2-4e87-adfd-3edb1c83adb2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:14.949722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1defe3c2-d8a2-4e87-adfd-3edb1c83adb2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 9133ea4e-7828-4227-a454-681cc3b7b695] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:52:14.959401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:52:15.106848 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1defe3c2-d8a2-4e87-adfd-3edb1c83adb2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695" status: 204 len: 0 microversion: 2.1 time: 0.229959 Oct 05 02:52:15.108151 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2426/4852] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:52:14 2022] DELETE /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 02:52:15.117461 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b167da4e-69cd-48db-87d1-20fd98714c88 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:15.118328 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b167da4e-69cd-48db-87d1-20fd98714c88 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 9133ea4e-7828-4227-a454-681cc3b7b695] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:15.136216 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b167da4e-69cd-48db-87d1-20fd98714c88 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:15.137230 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b167da4e-69cd-48db-87d1-20fd98714c88 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:15.137893 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b167da4e-69cd-48db-87d1-20fd98714c88 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:15.138936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b167da4e-69cd-48db-87d1-20fd98714c88 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:15.140095 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b167da4e-69cd-48db-87d1-20fd98714c88 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:15.140916 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b167da4e-69cd-48db-87d1-20fd98714c88 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:15.481686 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f8a531c7-72f5-425b-a19d-8bd3d6766063 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:15.482417 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f8a531c7-72f5-425b-a19d-8bd3d6766063 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:15.503613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f8a531c7-72f5-425b-a19d-8bd3d6766063 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:15.504136 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f8a531c7-72f5-425b-a19d-8bd3d6766063 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:15.509340 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f8a531c7-72f5-425b-a19d-8bd3d6766063 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:15.510237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b167da4e-69cd-48db-87d1-20fd98714c88 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:15.510827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f8a531c7-72f5-425b-a19d-8bd3d6766063 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:15.511561 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f8a531c7-72f5-425b-a19d-8bd3d6766063 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:15.512167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f8a531c7-72f5-425b-a19d-8bd3d6766063 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:15.520326 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b167da4e-69cd-48db-87d1-20fd98714c88 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695" status: 200 len: 1511 microversion: 2.1 time: 0.407581 Oct 05 02:52:15.521753 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2427/4853] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:15 2022] GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695 => generated 1511 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:15.557854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-92c21ae8-9122-4c69-ad5b-3f3065fdb6e3 req-1f6ae213-7d87-405c-9caa-f9bcf92a155a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ef11e58-0680-4e15-aa40-a4043a5a357a", "tag": "f9e588d4-a8fb-4137-b6aa-9752d8fb56f6"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:52:15.578870 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-92c21ae8-9122-4c69-ad5b-3f3065fdb6e3 req-1f6ae213-7d87-405c-9caa-f9bcf92a155a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:15.579949 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-92c21ae8-9122-4c69-ad5b-3f3065fdb6e3 req-1f6ae213-7d87-405c-9caa-f9bcf92a155a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:15.581749 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-92c21ae8-9122-4c69-ad5b-3f3065fdb6e3 req-1f6ae213-7d87-405c-9caa-f9bcf92a155a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:15.602884 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-92c21ae8-9122-4c69-ad5b-3f3065fdb6e3 req-1f6ae213-7d87-405c-9caa-f9bcf92a155a service nova] Creating event network-changed:f9e588d4-a8fb-4137-b6aa-9752d8fb56f6 for instance 2ef11e58-0680-4e15-aa40-a4043a5a357a on n-h1-858272-3 Oct 05 02:52:15.608527 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-92c21ae8-9122-4c69-ad5b-3f3065fdb6e3 req-1f6ae213-7d87-405c-9caa-f9bcf92a155a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057210 Oct 05 02:52:15.609505 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2428/4854] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:52:15.733874 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-99bdb2cf-a544-4996-88df-da4561964ab6 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:15.735490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-99bdb2cf-a544-4996-88df-da4561964ab6 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:15.762501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99bdb2cf-a544-4996-88df-da4561964ab6 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:15.765947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99bdb2cf-a544-4996-88df-da4561964ab6 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:15.766927 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99bdb2cf-a544-4996-88df-da4561964ab6 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:15.770916 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99bdb2cf-a544-4996-88df-da4561964ab6 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:15.773649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99bdb2cf-a544-4996-88df-da4561964ab6 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:15.774911 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99bdb2cf-a544-4996-88df-da4561964ab6 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:16.077370 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-99bdb2cf-a544-4996-88df-da4561964ab6 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:16.097962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-99bdb2cf-a544-4996-88df-da4561964ab6 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:16.101083 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-99bdb2cf-a544-4996-88df-da4561964ab6 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:16.102825 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-99bdb2cf-a544-4996-88df-da4561964ab6 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1604 microversion: 2.42 time: 0.374214 Oct 05 02:52:16.109623 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2429/4855] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:15 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1604 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:52:16.117054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d4504fa4-70ae-4f7b-bb67-dc4f6a93cfba tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:16.138494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d4504fa4-70ae-4f7b-bb67-dc4f6a93cfba tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] [instance: a1c78871-374e-41d9-af4a-d8284ccb8508] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:16.166781 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4504fa4-70ae-4f7b-bb67-dc4f6a93cfba tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:16.170895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4504fa4-70ae-4f7b-bb67-dc4f6a93cfba tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:16.171368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4504fa4-70ae-4f7b-bb67-dc4f6a93cfba tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:16.172129 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4504fa4-70ae-4f7b-bb67-dc4f6a93cfba tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:16.172602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4504fa4-70ae-4f7b-bb67-dc4f6a93cfba tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:16.173060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4504fa4-70ae-4f7b-bb67-dc4f6a93cfba tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:16.305958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f8a531c7-72f5-425b-a19d-8bd3d6766063 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:16.315835 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f8a531c7-72f5-425b-a19d-8bd3d6766063 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:16.328118 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f8a531c7-72f5-425b-a19d-8bd3d6766063 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:16.333692 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f8a531c7-72f5-425b-a19d-8bd3d6766063 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1871 microversion: 2.32 time: 0.856668 Oct 05 02:52:16.349853 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2427/4856] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:15 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1871 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:52:16.544187 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0349b764-b67b-41cb-bb23-d801e894a2e4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:16.544880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0349b764-b67b-41cb-bb23-d801e894a2e4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 9133ea4e-7828-4227-a454-681cc3b7b695] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:16.574339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0349b764-b67b-41cb-bb23-d801e894a2e4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:16.576680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0349b764-b67b-41cb-bb23-d801e894a2e4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:16.578725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0349b764-b67b-41cb-bb23-d801e894a2e4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:16.582044 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0349b764-b67b-41cb-bb23-d801e894a2e4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:16.583287 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0349b764-b67b-41cb-bb23-d801e894a2e4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:16.586460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0349b764-b67b-41cb-bb23-d801e894a2e4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:17.126594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d4504fa4-70ae-4f7b-bb67-dc4f6a93cfba tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23b56d519224b22802f978442c7289f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa67de433dc46a595baea99d927d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:17.140436 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d4504fa4-70ae-4f7b-bb67-dc4f6a93cfba tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] 10.222.0.16 "GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508" status: 200 len: 1427 microversion: 2.1 time: 1.029246 Oct 05 02:52:17.143994 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2430/4857] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:16 2022] GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508 => generated 1427 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:17.163235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f101c1e9-cec7-449a-b5d3-ff3aa48c32d4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:17.164117 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f101c1e9-cec7-449a-b5d3-ff3aa48c32d4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:17.172415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f101c1e9-cec7-449a-b5d3-ff3aa48c32d4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:17.177924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f101c1e9-cec7-449a-b5d3-ff3aa48c32d4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:17.178681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f101c1e9-cec7-449a-b5d3-ff3aa48c32d4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:17.179682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f101c1e9-cec7-449a-b5d3-ff3aa48c32d4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:17.180360 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f101c1e9-cec7-449a-b5d3-ff3aa48c32d4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:17.180989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f101c1e9-cec7-449a-b5d3-ff3aa48c32d4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:17.252375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f101c1e9-cec7-449a-b5d3-ff3aa48c32d4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:17.258464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f101c1e9-cec7-449a-b5d3-ff3aa48c32d4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:17.259134 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f101c1e9-cec7-449a-b5d3-ff3aa48c32d4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:17.260181 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-f101c1e9-cec7-449a-b5d3-ff3aa48c32d4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lazy-loading 'fault' on Instance uuid a710dba5-18ef-4840-835b-06b1fc2bde87 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:52:17.433138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0349b764-b67b-41cb-bb23-d801e894a2e4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:17.446226 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0349b764-b67b-41cb-bb23-d801e894a2e4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695" status: 200 len: 1511 microversion: 2.1 time: 0.906131 Oct 05 02:52:17.448759 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2428/4858] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:16 2022] GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695 => generated 1511 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:52:17.458191 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2f36bf36-7f70-491a-8b8f-4b9fb49da292 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:17.461115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2f36bf36-7f70-491a-8b8f-4b9fb49da292 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:17.477613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f36bf36-7f70-491a-8b8f-4b9fb49da292 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:17.479556 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f36bf36-7f70-491a-8b8f-4b9fb49da292 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:17.481739 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f36bf36-7f70-491a-8b8f-4b9fb49da292 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:17.489738 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f36bf36-7f70-491a-8b8f-4b9fb49da292 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:17.490387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f36bf36-7f70-491a-8b8f-4b9fb49da292 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:17.491464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f36bf36-7f70-491a-8b8f-4b9fb49da292 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:17.561882 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f101c1e9-cec7-449a-b5d3-ff3aa48c32d4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:17.579590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f101c1e9-cec7-449a-b5d3-ff3aa48c32d4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:17.591213 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f101c1e9-cec7-449a-b5d3-ff3aa48c32d4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e8f069e9e2a48549d02a1505b648a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534df890fde640cc913ecd53e83540bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:17.592479 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f101c1e9-cec7-449a-b5d3-ff3aa48c32d4 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 200 len: 1371 microversion: 2.42 time: 0.445801 Oct 05 02:52:17.593073 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2431/4859] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:17 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 1371 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:52:18.157903 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-77cdf222-fcf0-4fb9-9844-46594f4d4cd6 req-6d79746e-3f0b-4009-99bd-d139aa1a9c59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9133ea4e-7828-4227-a454-681cc3b7b695", "name": "network-vif-deleted", "tag": "24df2682-34d4-46b6-9dfc-b81e96b90f43"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:52:18.188077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-77cdf222-fcf0-4fb9-9844-46594f4d4cd6 req-6d79746e-3f0b-4009-99bd-d139aa1a9c59 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:18.190073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-77cdf222-fcf0-4fb9-9844-46594f4d4cd6 req-6d79746e-3f0b-4009-99bd-d139aa1a9c59 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:18.191484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-77cdf222-fcf0-4fb9-9844-46594f4d4cd6 req-6d79746e-3f0b-4009-99bd-d139aa1a9c59 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:18.263152 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-77cdf222-fcf0-4fb9-9844-46594f4d4cd6 req-6d79746e-3f0b-4009-99bd-d139aa1a9c59 service nova] Creating event network-vif-deleted:24df2682-34d4-46b6-9dfc-b81e96b90f43 for instance 9133ea4e-7828-4227-a454-681cc3b7b695 on n-h1-858272-3 Oct 05 02:52:18.273401 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-77cdf222-fcf0-4fb9-9844-46594f4d4cd6 req-6d79746e-3f0b-4009-99bd-d139aa1a9c59 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119306 Oct 05 02:52:18.275307 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2432/4860] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:52:18.296080 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-42e782aa-c567-4980-a61b-ac677a5c098f tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:18.297135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-42e782aa-c567-4980-a61b-ac677a5c098f tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] [instance: a1c78871-374e-41d9-af4a-d8284ccb8508] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:18.312544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42e782aa-c567-4980-a61b-ac677a5c098f tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:18.315712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42e782aa-c567-4980-a61b-ac677a5c098f tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:18.317219 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42e782aa-c567-4980-a61b-ac677a5c098f tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:18.327934 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42e782aa-c567-4980-a61b-ac677a5c098f tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:18.329291 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42e782aa-c567-4980-a61b-ac677a5c098f tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:18.331356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42e782aa-c567-4980-a61b-ac677a5c098f tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:18.698248 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2f36bf36-7f70-491a-8b8f-4b9fb49da292 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:18.712244 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2f36bf36-7f70-491a-8b8f-4b9fb49da292 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:18.721333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2f36bf36-7f70-491a-8b8f-4b9fb49da292 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:18.722711 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2f36bf36-7f70-491a-8b8f-4b9fb49da292 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1871 microversion: 2.32 time: 1.271635 Oct 05 02:52:18.723398 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2429/4861] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:17 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1871 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:52:18.728002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d2647d74-2ee6-4301-b363-9ef1bfeed51e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:18.736424 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d2647d74-2ee6-4301-b363-9ef1bfeed51e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 9133ea4e-7828-4227-a454-681cc3b7b695] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:18.754729 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2647d74-2ee6-4301-b363-9ef1bfeed51e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:18.755402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2647d74-2ee6-4301-b363-9ef1bfeed51e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:18.755970 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2647d74-2ee6-4301-b363-9ef1bfeed51e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:18.757336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2647d74-2ee6-4301-b363-9ef1bfeed51e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:18.757983 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2647d74-2ee6-4301-b363-9ef1bfeed51e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:18.758543 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2647d74-2ee6-4301-b363-9ef1bfeed51e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:18.875170 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2647d74-2ee6-4301-b363-9ef1bfeed51e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:18.875682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2647d74-2ee6-4301-b363-9ef1bfeed51e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:18.887912 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2647d74-2ee6-4301-b363-9ef1bfeed51e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:18.891604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-d2647d74-2ee6-4301-b363-9ef1bfeed51e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lazy-loading 'fault' on Instance uuid 9133ea4e-7828-4227-a454-681cc3b7b695 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:52:19.340244 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d2647d74-2ee6-4301-b363-9ef1bfeed51e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:19.347950 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d2647d74-2ee6-4301-b363-9ef1bfeed51e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695" status: 200 len: 1306 microversion: 2.1 time: 0.623461 Oct 05 02:52:19.364823 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2430/4862] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:18 2022] GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695 => generated 1306 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:19.369943 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-abb36057-6641-4aeb-8775-0000d25ca949 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:19.370847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-abb36057-6641-4aeb-8775-0000d25ca949 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:19.377767 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abb36057-6641-4aeb-8775-0000d25ca949 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:19.378585 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abb36057-6641-4aeb-8775-0000d25ca949 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:19.379245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abb36057-6641-4aeb-8775-0000d25ca949 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:19.380144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abb36057-6641-4aeb-8775-0000d25ca949 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:19.380799 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abb36057-6641-4aeb-8775-0000d25ca949 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:19.381981 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abb36057-6641-4aeb-8775-0000d25ca949 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:19.400258 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-abb36057-6641-4aeb-8775-0000d25ca949 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] HTTP exception thrown: Instance a710dba5-18ef-4840-835b-06b1fc2bde87 could not be found. Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-abb36057-6641-4aeb-8775-0000d25ca949 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Request method failure captured: Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 HTTP/1.1 Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO_qbMktngipTJcPK4KaFlYzkUW4nBn0M4pNqJzZFAEoYlQhqt3fpZFJc6IMqzs7k2lhVsRqmAphHH1_gfkgblkC8eUDPiA-S2x5A4VAV2Pt2t2zYg2L2bTVQhOxxuZ9vJ4OIq6Uym3oQPSVGm0P4EILQ1giENR8XquzfnhxMTqcpOo Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: X-Openstack-Nova-Api-Version: 2.42 Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 534df890fde640cc913ecd53e83540bc Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1453822119 Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/534df890fde640cc913ecd53e83540bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/534df890fde640cc913ecd53e83540bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/534df890fde640cc913ecd53e83540bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_534df890fde640cc913ecd53e83540bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1453822119 Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 534df890fde640cc913ecd53e83540bc Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1453822119 Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TaggedBootDevicesTest_v242-1453822119-project Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 9e8f069e9e2a48549d02a1505b648a88 Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1453822119-project Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance a710dba5-18ef-4840-835b-06b1fc2bde87 could not be found. Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'a710dba5-18ef-4840-835b-06b1fc2bde87'} Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a710dba5-18ef-4840-835b-06b1fc2bde87 could not be found. Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a710dba5-18ef-4840-835b-06b1fc2bde87 could not be found. Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:19.403413 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:19.408052 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:19.408052 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:19.408052 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:19.408052 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:19.408052 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:52:19.408052 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:52:19.408052 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a710dba5-18ef-4840-835b-06b1fc2bde87 could not be found. Oct 05 02:52:19.408052 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:19.408052 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-abb36057-6641-4aeb-8775-0000d25ca949 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Returning 404 to user: Instance a710dba5-18ef-4840-835b-06b1fc2bde87 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:52:19.408052 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-abb36057-6641-4aeb-8775-0000d25ca949 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 404 len: 111 microversion: 2.42 time: 0.038866 Oct 05 02:52:19.411314 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2431/4863] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:19 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:52:19.416673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7a766659-6704-4939-94cd-152d380296d8 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '.version_select at 0x7fccdf007b80>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:19.448432 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7a766659-6704-4939-94cd-152d380296d8 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-550557407" status: 204 len: 0 microversion: 2.42 time: 0.035858 Oct 05 02:52:19.452716 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2432/4864] 10.222.0.16 () {60 vars in 1259 bytes} [Wed Oct 5 02:52:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-550557407 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 02:52:19.469256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-42e782aa-c567-4980-a61b-ac677a5c098f tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23b56d519224b22802f978442c7289f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa67de433dc46a595baea99d927d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:19.478220 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-42e782aa-c567-4980-a61b-ac677a5c098f tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] 10.222.0.16 "GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508" status: 200 len: 1427 microversion: 2.1 time: 1.201662 Oct 05 02:52:19.483932 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2433/4865] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:18 2022] GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508 => generated 1427 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:19.748143 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:52:19.753271 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4d9ed4ec-631c-47b4-9bd8-6102e28362d9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:19.753954 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4d9ed4ec-631c-47b4-9bd8-6102e28362d9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:19.769203 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d9ed4ec-631c-47b4-9bd8-6102e28362d9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:19.769708 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d9ed4ec-631c-47b4-9bd8-6102e28362d9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:19.772807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d9ed4ec-631c-47b4-9bd8-6102e28362d9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:19.773806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d9ed4ec-631c-47b4-9bd8-6102e28362d9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:19.774274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d9ed4ec-631c-47b4-9bd8-6102e28362d9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:19.777012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d9ed4ec-631c-47b4-9bd8-6102e28362d9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:20.331171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4d9ed4ec-631c-47b4-9bd8-6102e28362d9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:20.352000 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4d9ed4ec-631c-47b4-9bd8-6102e28362d9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:20.353521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4d9ed4ec-631c-47b4-9bd8-6102e28362d9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:20.354739 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4d9ed4ec-631c-47b4-9bd8-6102e28362d9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1892 microversion: 2.32 time: 0.608245 Oct 05 02:52:20.355655 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2433/4866] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:19 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1892 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:52:20.372511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-28ff3756-40bf-4896-be74-b616e34038ad tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:20.373333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-28ff3756-40bf-4896-be74-b616e34038ad tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 9133ea4e-7828-4227-a454-681cc3b7b695] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:20.388340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28ff3756-40bf-4896-be74-b616e34038ad tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:20.396264 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28ff3756-40bf-4896-be74-b616e34038ad tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:20.397643 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28ff3756-40bf-4896-be74-b616e34038ad tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:20.398861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28ff3756-40bf-4896-be74-b616e34038ad tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:20.399501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28ff3756-40bf-4896-be74-b616e34038ad tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:20.400186 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28ff3756-40bf-4896-be74-b616e34038ad tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:20.450205 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-28ff3756-40bf-4896-be74-b616e34038ad tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Instance 9133ea4e-7828-4227-a454-681cc3b7b695 could not be found. Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-28ff3756-40bf-4896-be74-b616e34038ad tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695 HTTP/1.1 Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 9133ea4e-7828-4227-a454-681cc3b7b695 could not be found. Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '9133ea4e-7828-4227-a454-681cc3b7b695'} Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9133ea4e-7828-4227-a454-681cc3b7b695 could not be found. Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9133ea4e-7828-4227-a454-681cc3b7b695 could not be found. Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:20.455611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:20.461896 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:20.461896 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:20.461896 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:20.461896 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:52:20.461896 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:52:20.461896 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9133ea4e-7828-4227-a454-681cc3b7b695 could not be found. Oct 05 02:52:20.461896 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:20.465571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-28ff3756-40bf-4896-be74-b616e34038ad tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 404 to user: Instance 9133ea4e-7828-4227-a454-681cc3b7b695 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:52:20.471406 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-28ff3756-40bf-4896-be74-b616e34038ad tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695" status: 404 len: 111 microversion: 2.1 time: 0.101147 Oct 05 02:52:20.481436 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2434/4867] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:20 2022] GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:52:20.489802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-42dd7a34-c88d-4403-a390-54730fbfaff7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:20.491341 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-42dd7a34-c88d-4403-a390-54730fbfaff7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:20.505631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42dd7a34-c88d-4403-a390-54730fbfaff7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:20.514632 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-788b90a5-6bc1-40a5-a594-c3ee6e6c4dde tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:20.515586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-788b90a5-6bc1-40a5-a594-c3ee6e6c4dde tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] [instance: a1c78871-374e-41d9-af4a-d8284ccb8508] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:20.519537 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42dd7a34-c88d-4403-a390-54730fbfaff7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:20.520373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42dd7a34-c88d-4403-a390-54730fbfaff7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:20.526273 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-788b90a5-6bc1-40a5-a594-c3ee6e6c4dde tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:20.526917 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42dd7a34-c88d-4403-a390-54730fbfaff7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:20.529857 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42dd7a34-c88d-4403-a390-54730fbfaff7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:20.530649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42dd7a34-c88d-4403-a390-54730fbfaff7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:20.543031 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-788b90a5-6bc1-40a5-a594-c3ee6e6c4dde tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:20.543548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-788b90a5-6bc1-40a5-a594-c3ee6e6c4dde tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:20.545160 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-788b90a5-6bc1-40a5-a594-c3ee6e6c4dde tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:20.553827 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-788b90a5-6bc1-40a5-a594-c3ee6e6c4dde tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:20.554419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-788b90a5-6bc1-40a5-a594-c3ee6e6c4dde tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:20.769667 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=12 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:52:21.324881 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-788b90a5-6bc1-40a5-a594-c3ee6e6c4dde tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23b56d519224b22802f978442c7289f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa67de433dc46a595baea99d927d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:21.341332 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-788b90a5-6bc1-40a5-a594-c3ee6e6c4dde tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] 10.222.0.16 "GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508" status: 200 len: 1427 microversion: 2.1 time: 0.831269 Oct 05 02:52:21.343034 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2435/4868] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:20 2022] GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508 => generated 1427 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:52:21.348025 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-f5711cd7-6f79-4aba-8f5e-183706ed61f4 req-10446807-9c9e-49b0-a6bd-128241bae45c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1c78871-374e-41d9-af4a-d8284ccb8508", "tag": "cf48c84f-265d-4bc9-bdf9-a08c725b21ec"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:52:21.362317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f5711cd7-6f79-4aba-8f5e-183706ed61f4 req-10446807-9c9e-49b0-a6bd-128241bae45c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:21.363861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f5711cd7-6f79-4aba-8f5e-183706ed61f4 req-10446807-9c9e-49b0-a6bd-128241bae45c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:21.364598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f5711cd7-6f79-4aba-8f5e-183706ed61f4 req-10446807-9c9e-49b0-a6bd-128241bae45c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:21.389800 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-f5711cd7-6f79-4aba-8f5e-183706ed61f4 req-10446807-9c9e-49b0-a6bd-128241bae45c service nova] Creating event network-changed:cf48c84f-265d-4bc9-bdf9-a08c725b21ec for instance a1c78871-374e-41d9-af4a-d8284ccb8508 on n-h2-858272-3 Oct 05 02:52:21.396311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-42dd7a34-c88d-4403-a390-54730fbfaff7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:21.412341 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-42dd7a34-c88d-4403-a390-54730fbfaff7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.921185 Oct 05 02:52:21.414339 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2434/4869] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:20 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:21.419134 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-f5711cd7-6f79-4aba-8f5e-183706ed61f4 req-10446807-9c9e-49b0-a6bd-128241bae45c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074546 Oct 05 02:52:21.422166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8f5792f2-0b56-4fa4-9b55-2055ab841f19 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:21.423329 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2436/4870] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:52:21.424164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8f5792f2-0b56-4fa4-9b55-2055ab841f19 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:21.452779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f5792f2-0b56-4fa4-9b55-2055ab841f19 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:21.460104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f5792f2-0b56-4fa4-9b55-2055ab841f19 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:21.460836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f5792f2-0b56-4fa4-9b55-2055ab841f19 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:21.461776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f5792f2-0b56-4fa4-9b55-2055ab841f19 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:21.462657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f5792f2-0b56-4fa4-9b55-2055ab841f19 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:21.464378 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f5792f2-0b56-4fa4-9b55-2055ab841f19 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:21.581350 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e4cac06a-a5df-4504-be1a-fe332e9fbe32 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e4cac06a-a5df-4504-be1a-fe332e9fbe32 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 163 Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: {"server": {"name": 12345, "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63"}]}} Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'adad3215-1ca6-43bb-9981-0d01aff146ab', 'flavorRef': '452', 'networks': [{'uuid': 'e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63'}]}}} Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 12345 Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:52:21.586525 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:52:21.591776 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:52:21.591776 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 05 02:52:21.591776 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:21.591776 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:21.591776 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:21.591776 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:21.591776 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:21.591776 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:21.591776 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:52:21.591776 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:52:21.591776 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 05 02:52:21.591776 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:21.594056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e4cac06a-a5df-4504-be1a-fe332e9fbe32 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:52:21.595159 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e4cac06a-a5df-4504-be1a-fe332e9fbe32 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.018152 Oct 05 02:52:21.597242 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2437/4871] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:52:21 2022] POST /compute/v2.1/servers => generated 127 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 05 02:52:21.605864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-83104442-99b5-4db2-8050-9da173be0bf4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:21.606594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-83104442-99b5-4db2-8050-9da173be0bf4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:21.613947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83104442-99b5-4db2-8050-9da173be0bf4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:21.614443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83104442-99b5-4db2-8050-9da173be0bf4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:21.614881 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83104442-99b5-4db2-8050-9da173be0bf4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:21.615572 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83104442-99b5-4db2-8050-9da173be0bf4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:21.616789 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83104442-99b5-4db2-8050-9da173be0bf4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:21.617222 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83104442-99b5-4db2-8050-9da173be0bf4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:22.021725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8f5792f2-0b56-4fa4-9b55-2055ab841f19 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:22.036371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8f5792f2-0b56-4fa4-9b55-2055ab841f19 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:22.042650 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8f5792f2-0b56-4fa4-9b55-2055ab841f19 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:22.044800 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8f5792f2-0b56-4fa4-9b55-2055ab841f19 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1892 microversion: 2.32 time: 0.629267 Oct 05 02:52:22.047549 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2435/4872] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:21 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1892 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:52:22.367646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-81cc1334-43d7-4b41-b2e1-31d461c472c8 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:22.368493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-81cc1334-43d7-4b41-b2e1-31d461c472c8 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] [instance: a1c78871-374e-41d9-af4a-d8284ccb8508] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:22.378540 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81cc1334-43d7-4b41-b2e1-31d461c472c8 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:22.379145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81cc1334-43d7-4b41-b2e1-31d461c472c8 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:22.380846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81cc1334-43d7-4b41-b2e1-31d461c472c8 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:22.388115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81cc1334-43d7-4b41-b2e1-31d461c472c8 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:22.388714 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81cc1334-43d7-4b41-b2e1-31d461c472c8 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:22.389260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81cc1334-43d7-4b41-b2e1-31d461c472c8 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:22.512550 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-83104442-99b5-4db2-8050-9da173be0bf4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:22.520507 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-83104442-99b5-4db2-8050-9da173be0bf4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.918314 Oct 05 02:52:22.521126 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2438/4873] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:21 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:22.549069 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4f369785-76b3-448d-88f9-76f7d90c6c59 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:22.549820 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4f369785-76b3-448d-88f9-76f7d90c6c59 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:22.562543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f369785-76b3-448d-88f9-76f7d90c6c59 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:22.563051 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f369785-76b3-448d-88f9-76f7d90c6c59 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:22.563497 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f369785-76b3-448d-88f9-76f7d90c6c59 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:22.564213 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f369785-76b3-448d-88f9-76f7d90c6c59 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:22.564671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f369785-76b3-448d-88f9-76f7d90c6c59 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:22.565126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f369785-76b3-448d-88f9-76f7d90c6c59 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:22.833274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-81cc1334-43d7-4b41-b2e1-31d461c472c8 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23b56d519224b22802f978442c7289f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa67de433dc46a595baea99d927d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:22.848646 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-81cc1334-43d7-4b41-b2e1-31d461c472c8 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] 10.222.0.16 "GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508" status: 200 len: 1427 microversion: 2.1 time: 0.484811 Oct 05 02:52:22.854723 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2436/4874] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:22 2022] GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508 => generated 1427 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:52:22.920590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4f369785-76b3-448d-88f9-76f7d90c6c59 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:22.935443 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4f369785-76b3-448d-88f9-76f7d90c6c59 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.390199 Oct 05 02:52:22.936553 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2439/4875] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:22 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:23.074535 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3cc31980-f0fb-45b8-9d8c-a9d52957f474 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:23.075851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3cc31980-f0fb-45b8-9d8c-a9d52957f474 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:23.086828 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3cc31980-f0fb-45b8-9d8c-a9d52957f474 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:23.097938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3cc31980-f0fb-45b8-9d8c-a9d52957f474 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:23.099083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3cc31980-f0fb-45b8-9d8c-a9d52957f474 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:23.101078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3cc31980-f0fb-45b8-9d8c-a9d52957f474 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:23.102095 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3cc31980-f0fb-45b8-9d8c-a9d52957f474 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:23.103047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3cc31980-f0fb-45b8-9d8c-a9d52957f474 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:23.476730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-914cec62-1ee9-4fb4-a2a7-9a174d56ab33 req-f0e39e8c-c309-4180-90fd-939837e9cf4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ef11e58-0680-4e15-aa40-a4043a5a357a", "tag": "ac18c1ec-49eb-4408-8eb5-a8e4ce7d4e0d"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:52:23.535849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-914cec62-1ee9-4fb4-a2a7-9a174d56ab33 req-f0e39e8c-c309-4180-90fd-939837e9cf4c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:23.536573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-914cec62-1ee9-4fb4-a2a7-9a174d56ab33 req-f0e39e8c-c309-4180-90fd-939837e9cf4c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:23.539347 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-914cec62-1ee9-4fb4-a2a7-9a174d56ab33 req-f0e39e8c-c309-4180-90fd-939837e9cf4c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:23.575161 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-914cec62-1ee9-4fb4-a2a7-9a174d56ab33 req-f0e39e8c-c309-4180-90fd-939837e9cf4c service nova] Creating event network-changed:ac18c1ec-49eb-4408-8eb5-a8e4ce7d4e0d for instance 2ef11e58-0680-4e15-aa40-a4043a5a357a on n-h1-858272-3 Oct 05 02:52:23.601714 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-914cec62-1ee9-4fb4-a2a7-9a174d56ab33 req-f0e39e8c-c309-4180-90fd-939837e9cf4c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129613 Oct 05 02:52:23.603811 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2440/4876] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:52:23.878106 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-56bd95e1-f232-4a19-a0e4-1c2dc61a15e6 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:23.879210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-56bd95e1-f232-4a19-a0e4-1c2dc61a15e6 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] [instance: a1c78871-374e-41d9-af4a-d8284ccb8508] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:23.897309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56bd95e1-f232-4a19-a0e4-1c2dc61a15e6 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:23.899209 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56bd95e1-f232-4a19-a0e4-1c2dc61a15e6 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:23.899675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56bd95e1-f232-4a19-a0e4-1c2dc61a15e6 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:23.903924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56bd95e1-f232-4a19-a0e4-1c2dc61a15e6 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:23.906771 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56bd95e1-f232-4a19-a0e4-1c2dc61a15e6 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:23.907233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56bd95e1-f232-4a19-a0e4-1c2dc61a15e6 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:25.109674 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3cc31980-f0fb-45b8-9d8c-a9d52957f474 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:25.133890 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3cc31980-f0fb-45b8-9d8c-a9d52957f474 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:25.137663 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3cc31980-f0fb-45b8-9d8c-a9d52957f474 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:25.138882 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3cc31980-f0fb-45b8-9d8c-a9d52957f474 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1892 microversion: 2.32 time: 2.069158 Oct 05 02:52:25.143588 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2437/4877] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:23 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1892 bytes in 2074 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:52:25.434430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-56bd95e1-f232-4a19-a0e4-1c2dc61a15e6 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23b56d519224b22802f978442c7289f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa67de433dc46a595baea99d927d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:25.443786 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-56bd95e1-f232-4a19-a0e4-1c2dc61a15e6 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] 10.222.0.16 "GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508" status: 200 len: 1427 microversion: 2.1 time: 1.571800 Oct 05 02:52:25.457370 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2441/4878] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:23 2022] GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508 => generated 1427 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:26.175966 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ded1cf5d-49a0-4d5c-8f87-43597c058a7e tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:26.177261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ded1cf5d-49a0-4d5c-8f87-43597c058a7e tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:26.198232 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ded1cf5d-49a0-4d5c-8f87-43597c058a7e tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:26.199998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ded1cf5d-49a0-4d5c-8f87-43597c058a7e tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:26.201819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ded1cf5d-49a0-4d5c-8f87-43597c058a7e tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:26.204268 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ded1cf5d-49a0-4d5c-8f87-43597c058a7e tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:26.204990 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ded1cf5d-49a0-4d5c-8f87-43597c058a7e tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:26.206649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ded1cf5d-49a0-4d5c-8f87-43597c058a7e tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:26.361837 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-71eb2af7-0156-4894-acd5-f78796257f7a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-104867969", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "80de1cda-dbb9-4fdd-b8e1-08840a34fb28", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:52:26.511090 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-71eb2af7-0156-4894-acd5-f78796257f7a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Block Device 80de1cda-dbb9-4fdd-b8e1-08840a34fb28 is not bootable. Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-71eb2af7-0156-4894-acd5-f78796257f7a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 357 Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-104867969", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "80de1cda-dbb9-4fdd-b8e1-08840a34fb28", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63"}]}} Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: exception: Block Device 80de1cda-dbb9-4fdd-b8e1-08840a34fb28 is not bootable. Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-104867969', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '80de1cda-dbb9-4fdd-b8e1-08840a34fb28'}], 'networks': [{'uuid': 'e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63'}]}}} Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 80de1cda-dbb9-4fdd-b8e1-08840a34fb28 is not bootable. Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:52:26.521461 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:52:26.526934 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:52:26.526934 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:52:26.526934 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:52:26.526934 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 05 02:52:26.526934 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 05 02:52:26.526934 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 05 02:52:26.526934 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 80de1cda-dbb9-4fdd-b8e1-08840a34fb28 is not bootable. Oct 05 02:52:26.526934 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:26.526934 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:26.526934 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:26.526934 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:26.526934 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:26.526934 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:26.526934 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:52:26.526934 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:52:26.526934 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 80de1cda-dbb9-4fdd-b8e1-08840a34fb28 is not bootable. Oct 05 02:52:26.526934 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:26.530677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-71eb2af7-0156-4894-acd5-f78796257f7a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 400 to user: Block Device 80de1cda-dbb9-4fdd-b8e1-08840a34fb28 is not bootable. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:52:26.531758 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-71eb2af7-0156-4894-acd5-f78796257f7a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.174468 Oct 05 02:52:26.532549 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2442/4879] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:52:26 2022] POST /compute/v2.1/servers => generated 110 bytes in 176 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 05 02:52:26.539337 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-117f45a2-718b-4196-824a-edaaa792fa6c tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:26.541273 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-117f45a2-718b-4196-824a-edaaa792fa6c tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] [instance: a1c78871-374e-41d9-af4a-d8284ccb8508] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:26.568048 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-117f45a2-718b-4196-824a-edaaa792fa6c tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:26.568873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-117f45a2-718b-4196-824a-edaaa792fa6c tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:26.569886 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-117f45a2-718b-4196-824a-edaaa792fa6c tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:26.575583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-117f45a2-718b-4196-824a-edaaa792fa6c tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:26.576299 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-117f45a2-718b-4196-824a-edaaa792fa6c tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:26.577005 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-117f45a2-718b-4196-824a-edaaa792fa6c tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:26.988280 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ded1cf5d-49a0-4d5c-8f87-43597c058a7e tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:27.010504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ded1cf5d-49a0-4d5c-8f87-43597c058a7e tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:27.015830 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ded1cf5d-49a0-4d5c-8f87-43597c058a7e tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:27.018580 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ded1cf5d-49a0-4d5c-8f87-43597c058a7e tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1892 microversion: 2.32 time: 0.847071 Oct 05 02:52:27.044614 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2438/4880] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:26 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1892 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:52:27.073002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d0f79b02-fe4d-4aee-9d4a-bcc290f1b117 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:27.074166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d0f79b02-fe4d-4aee-9d4a-bcc290f1b117 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:27.091584 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d0f79b02-fe4d-4aee-9d4a-bcc290f1b117 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:27.092030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d0f79b02-fe4d-4aee-9d4a-bcc290f1b117 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:27.092475 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d0f79b02-fe4d-4aee-9d4a-bcc290f1b117 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:27.093230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d0f79b02-fe4d-4aee-9d4a-bcc290f1b117 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:27.093678 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d0f79b02-fe4d-4aee-9d4a-bcc290f1b117 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:27.094105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d0f79b02-fe4d-4aee-9d4a-bcc290f1b117 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:27.450178 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-117f45a2-718b-4196-824a-edaaa792fa6c tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23b56d519224b22802f978442c7289f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa67de433dc46a595baea99d927d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:27.466357 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-117f45a2-718b-4196-824a-edaaa792fa6c tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] 10.222.0.16 "GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508" status: 200 len: 1427 microversion: 2.1 time: 0.931758 Oct 05 02:52:27.467585 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2443/4881] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:26 2022] GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508 => generated 1427 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:27.472522 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-f36fbcb8-c09f-4000-a48d-184981b7fb57 req-e3938657-7e7b-4283-9537-4d78d6f7a849 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ef11e58-0680-4e15-aa40-a4043a5a357a", "tag": "dcd1d668-f512-4fb6-9bc4-5acd98bc044b"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:52:27.483207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f36fbcb8-c09f-4000-a48d-184981b7fb57 req-e3938657-7e7b-4283-9537-4d78d6f7a849 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:27.484004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f36fbcb8-c09f-4000-a48d-184981b7fb57 req-e3938657-7e7b-4283-9537-4d78d6f7a849 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:27.484616 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f36fbcb8-c09f-4000-a48d-184981b7fb57 req-e3938657-7e7b-4283-9537-4d78d6f7a849 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:27.499020 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-f36fbcb8-c09f-4000-a48d-184981b7fb57 req-e3938657-7e7b-4283-9537-4d78d6f7a849 service nova] Creating event network-changed:dcd1d668-f512-4fb6-9bc4-5acd98bc044b for instance 2ef11e58-0680-4e15-aa40-a4043a5a357a on n-h1-858272-3 Oct 05 02:52:27.505635 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-f36fbcb8-c09f-4000-a48d-184981b7fb57 req-e3938657-7e7b-4283-9537-4d78d6f7a849 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036366 Oct 05 02:52:27.507532 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2444/4882] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:52:28.052608 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-62770d5a-811a-48d2-9bfe-ec772a2e32a9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:28.054123 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-62770d5a-811a-48d2-9bfe-ec772a2e32a9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:28.070928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-62770d5a-811a-48d2-9bfe-ec772a2e32a9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:28.071424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-62770d5a-811a-48d2-9bfe-ec772a2e32a9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:28.072071 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-62770d5a-811a-48d2-9bfe-ec772a2e32a9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:28.073013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-62770d5a-811a-48d2-9bfe-ec772a2e32a9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:28.073645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-62770d5a-811a-48d2-9bfe-ec772a2e32a9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:28.074245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-62770d5a-811a-48d2-9bfe-ec772a2e32a9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:28.259292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d0f79b02-fe4d-4aee-9d4a-bcc290f1b117 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:28.280887 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d0f79b02-fe4d-4aee-9d4a-bcc290f1b117 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 1.233902 Oct 05 02:52:28.295933 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2439/4883] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:27 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:28.309211 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cc9d58f2-5218-48e9-b014-5307a468dfad tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:28.311358 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cc9d58f2-5218-48e9-b014-5307a468dfad tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:28.326235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cc9d58f2-5218-48e9-b014-5307a468dfad tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:28.326834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cc9d58f2-5218-48e9-b014-5307a468dfad tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:28.327688 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cc9d58f2-5218-48e9-b014-5307a468dfad tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:28.328685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cc9d58f2-5218-48e9-b014-5307a468dfad tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:28.336131 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cc9d58f2-5218-48e9-b014-5307a468dfad tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:28.338400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cc9d58f2-5218-48e9-b014-5307a468dfad tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:29.142439 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-62770d5a-811a-48d2-9bfe-ec772a2e32a9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:29.152814 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-62770d5a-811a-48d2-9bfe-ec772a2e32a9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:29.154285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-62770d5a-811a-48d2-9bfe-ec772a2e32a9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:29.155447 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-62770d5a-811a-48d2-9bfe-ec772a2e32a9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1892 microversion: 2.32 time: 1.108413 Oct 05 02:52:29.189984 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2445/4884] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:28 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1892 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:52:29.202481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0b7888df-3c4f-4a95-afa4-c00663c37869 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:29.203393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0b7888df-3c4f-4a95-afa4-c00663c37869 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] [instance: a1c78871-374e-41d9-af4a-d8284ccb8508] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:29.210473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b7888df-3c4f-4a95-afa4-c00663c37869 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:29.211316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b7888df-3c4f-4a95-afa4-c00663c37869 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:29.211983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b7888df-3c4f-4a95-afa4-c00663c37869 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:29.212889 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b7888df-3c4f-4a95-afa4-c00663c37869 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:29.213556 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b7888df-3c4f-4a95-afa4-c00663c37869 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:29.214159 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b7888df-3c4f-4a95-afa4-c00663c37869 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:29.625979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cc9d58f2-5218-48e9-b014-5307a468dfad tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:29.642573 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cc9d58f2-5218-48e9-b014-5307a468dfad tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 1.337494 Oct 05 02:52:29.643175 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2440/4885] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:28 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:29.689820 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-38c463c4-7365-44a8-ab8e-3e751846be4e req-f3fdff0e-a189-48b5-9040-c1ae887f2f09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1c78871-374e-41d9-af4a-d8284ccb8508", "name": "network-vif-plugged", "status": "completed", "tag": "cf48c84f-265d-4bc9-bdf9-a08c725b21ec"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:52:29.701154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-38c463c4-7365-44a8-ab8e-3e751846be4e req-f3fdff0e-a189-48b5-9040-c1ae887f2f09 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:29.701853 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-38c463c4-7365-44a8-ab8e-3e751846be4e req-f3fdff0e-a189-48b5-9040-c1ae887f2f09 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:29.702461 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-38c463c4-7365-44a8-ab8e-3e751846be4e req-f3fdff0e-a189-48b5-9040-c1ae887f2f09 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:29.715772 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-38c463c4-7365-44a8-ab8e-3e751846be4e req-f3fdff0e-a189-48b5-9040-c1ae887f2f09 service nova] Creating event network-vif-plugged:cf48c84f-265d-4bc9-bdf9-a08c725b21ec for instance a1c78871-374e-41d9-af4a-d8284ccb8508 on n-h2-858272-3 Oct 05 02:52:29.721538 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-38c463c4-7365-44a8-ab8e-3e751846be4e req-f3fdff0e-a189-48b5-9040-c1ae887f2f09 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035356 Oct 05 02:52:29.722404 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2441/4886] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:52:29.833476 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0b7888df-3c4f-4a95-afa4-c00663c37869 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23b56d519224b22802f978442c7289f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa67de433dc46a595baea99d927d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:29.850775 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0b7888df-3c4f-4a95-afa4-c00663c37869 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] 10.222.0.16 "GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508" status: 200 len: 1427 microversion: 2.1 time: 0.653832 Oct 05 02:52:29.854832 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2446/4887] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:29 2022] GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508 => generated 1427 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:30.204251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-20b5f137-6296-454b-a94f-90b0ac29c7da tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:30.205146 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-20b5f137-6296-454b-a94f-90b0ac29c7da tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:30.243544 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:52:30.246016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20b5f137-6296-454b-a94f-90b0ac29c7da tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:30.247789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20b5f137-6296-454b-a94f-90b0ac29c7da tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:30.248962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20b5f137-6296-454b-a94f-90b0ac29c7da tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:30.252651 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20b5f137-6296-454b-a94f-90b0ac29c7da tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:30.253660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20b5f137-6296-454b-a94f-90b0ac29c7da tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:30.254347 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20b5f137-6296-454b-a94f-90b0ac29c7da tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:30.876289 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7f444b25-261a-46a1-b36c-bbbbcd1d6de2 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:30.877578 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7f444b25-261a-46a1-b36c-bbbbcd1d6de2 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] [instance: a1c78871-374e-41d9-af4a-d8284ccb8508] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:30.892441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f444b25-261a-46a1-b36c-bbbbcd1d6de2 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:30.893928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f444b25-261a-46a1-b36c-bbbbcd1d6de2 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:30.895422 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f444b25-261a-46a1-b36c-bbbbcd1d6de2 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:30.895422 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f444b25-261a-46a1-b36c-bbbbcd1d6de2 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:30.896117 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f444b25-261a-46a1-b36c-bbbbcd1d6de2 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:30.897110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f444b25-261a-46a1-b36c-bbbbcd1d6de2 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:31.217878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-20b5f137-6296-454b-a94f-90b0ac29c7da tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:31.234030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-20b5f137-6296-454b-a94f-90b0ac29c7da tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:31.236757 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-20b5f137-6296-454b-a94f-90b0ac29c7da tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:31.238169 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-20b5f137-6296-454b-a94f-90b0ac29c7da tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1892 microversion: 2.32 time: 1.039592 Oct 05 02:52:31.239315 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2442/4888] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:30 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1892 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:52:31.244547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-077e3b79-bf2a-4ac5-a646-f8f4b2d86d08 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:31.245942 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-077e3b79-bf2a-4ac5-a646-f8f4b2d86d08 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:31.253224 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-077e3b79-bf2a-4ac5-a646-f8f4b2d86d08 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:31.254031 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-077e3b79-bf2a-4ac5-a646-f8f4b2d86d08 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:31.254657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-077e3b79-bf2a-4ac5-a646-f8f4b2d86d08 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:31.256854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-077e3b79-bf2a-4ac5-a646-f8f4b2d86d08 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:31.257587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-077e3b79-bf2a-4ac5-a646-f8f4b2d86d08 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:31.258188 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-077e3b79-bf2a-4ac5-a646-f8f4b2d86d08 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:31.274510 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-077e3b79-bf2a-4ac5-a646-f8f4b2d86d08 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] HTTP exception thrown: Instance a710dba5-18ef-4840-835b-06b1fc2bde87 could not be found. Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-077e3b79-bf2a-4ac5-a646-f8f4b2d86d08 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Request method failure captured: Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 HTTP/1.1 Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO_qbMktngipTJcPK4KaFlYzkUW4nBn0M4pNqJzZFAEoYlQhqt3fpZFJc6IMqzs7k2lhVsRqmAphHH1_gfkgblkC8eUDPiA-S2x5A4VAV2Pt2t2zYg2L2bTVQhOxxuZ9vJ4OIq6Uym3oQPSVGm0P4EILQ1giENR8XquzfnhxMTqcpOo Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: X-Openstack-Nova-Api-Version: 2.42 Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 534df890fde640cc913ecd53e83540bc Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1453822119 Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/534df890fde640cc913ecd53e83540bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/534df890fde640cc913ecd53e83540bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/534df890fde640cc913ecd53e83540bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_534df890fde640cc913ecd53e83540bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1453822119 Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 534df890fde640cc913ecd53e83540bc Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1453822119 Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TaggedBootDevicesTest_v242-1453822119-project Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 9e8f069e9e2a48549d02a1505b648a88 Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1453822119-project Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance a710dba5-18ef-4840-835b-06b1fc2bde87 could not be found. Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'a710dba5-18ef-4840-835b-06b1fc2bde87'} Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a710dba5-18ef-4840-835b-06b1fc2bde87 could not be found. Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:52:31.280131 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:52:31.285880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a710dba5-18ef-4840-835b-06b1fc2bde87 could not be found. Oct 05 02:52:31.285880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:31.285880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:31.285880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:31.285880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:31.285880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:31.285880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:31.285880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:52:31.285880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:52:31.285880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a710dba5-18ef-4840-835b-06b1fc2bde87 could not be found. Oct 05 02:52:31.285880 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:31.290388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-077e3b79-bf2a-4ac5-a646-f8f4b2d86d08 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Returning 404 to user: Instance a710dba5-18ef-4840-835b-06b1fc2bde87 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:52:31.291509 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-077e3b79-bf2a-4ac5-a646-f8f4b2d86d08 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 404 len: 111 microversion: 2.42 time: 0.051007 Oct 05 02:52:31.296440 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2443/4889] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 5 02:52:31 2022] DELETE /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:52:31.303745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f33dfaa6-e7c9-4a69-b648-466d97fd2967 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:31.304730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f33dfaa6-e7c9-4a69-b648-466d97fd2967 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] [instance: a710dba5-18ef-4840-835b-06b1fc2bde87] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:31.313434 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f33dfaa6-e7c9-4a69-b648-466d97fd2967 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:31.314131 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f33dfaa6-e7c9-4a69-b648-466d97fd2967 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:31.314750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f33dfaa6-e7c9-4a69-b648-466d97fd2967 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:31.315641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f33dfaa6-e7c9-4a69-b648-466d97fd2967 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:31.316360 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f33dfaa6-e7c9-4a69-b648-466d97fd2967 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:31.317139 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f33dfaa6-e7c9-4a69-b648-466d97fd2967 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:31.334084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7f444b25-261a-46a1-b36c-bbbbcd1d6de2 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23b56d519224b22802f978442c7289f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa67de433dc46a595baea99d927d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:31.346322 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-f33dfaa6-e7c9-4a69-b648-466d97fd2967 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] HTTP exception thrown: Instance a710dba5-18ef-4840-835b-06b1fc2bde87 could not be found. Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f33dfaa6-e7c9-4a69-b648-466d97fd2967 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Request method failure captured: Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 HTTP/1.1 Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPO_qbMktngipTJcPK4KaFlYzkUW4nBn0M4pNqJzZFAEoYlQhqt3fpZFJc6IMqzs7k2lhVsRqmAphHH1_gfkgblkC8eUDPiA-S2x5A4VAV2Pt2t2zYg2L2bTVQhOxxuZ9vJ4OIq6Uym3oQPSVGm0P4EILQ1giENR8XquzfnhxMTqcpOo Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: X-Openstack-Nova-Api-Version: 2.42 Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 534df890fde640cc913ecd53e83540bc Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1453822119 Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/534df890fde640cc913ecd53e83540bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/534df890fde640cc913ecd53e83540bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/534df890fde640cc913ecd53e83540bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_534df890fde640cc913ecd53e83540bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1453822119 Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 534df890fde640cc913ecd53e83540bc Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1453822119 Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TaggedBootDevicesTest_v242-1453822119-project Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 9e8f069e9e2a48549d02a1505b648a88 Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1453822119-project Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance a710dba5-18ef-4840-835b-06b1fc2bde87 could not be found. Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'a710dba5-18ef-4840-835b-06b1fc2bde87'} Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a710dba5-18ef-4840-835b-06b1fc2bde87 could not be found. Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a710dba5-18ef-4840-835b-06b1fc2bde87 could not be found. Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:31.350676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:31.360741 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:31.360741 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:31.360741 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:31.360741 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:31.360741 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:52:31.360741 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:52:31.360741 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a710dba5-18ef-4840-835b-06b1fc2bde87 could not be found. Oct 05 02:52:31.360741 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:31.360741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f33dfaa6-e7c9-4a69-b648-466d97fd2967 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] Returning 404 to user: Instance a710dba5-18ef-4840-835b-06b1fc2bde87 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:52:31.360741 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f33dfaa6-e7c9-4a69-b648-466d97fd2967 tempest-TaggedBootDevicesTest_v242-1453822119 tempest-TaggedBootDevicesTest_v242-1453822119-project] 10.222.0.16 "GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87" status: 404 len: 111 microversion: 2.42 time: 0.055136 Oct 05 02:52:31.360741 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2444/4890] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:31 2022] GET /compute/v2.1/servers/a710dba5-18ef-4840-835b-06b1fc2bde87 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:52:31.379310 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7f444b25-261a-46a1-b36c-bbbbcd1d6de2 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] 10.222.0.16 "GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508" status: 200 len: 1427 microversion: 2.1 time: 0.507434 Oct 05 02:52:31.385691 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2447/4891] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:30 2022] GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508 => generated 1427 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:31.738369 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-1015cf8b-3883-4313-8e3b-24c3c10ec6ea req-dfcdecf4-d19f-42e1-a112-6c3a967e3903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ef11e58-0680-4e15-aa40-a4043a5a357a", "tag": "5fa0dbc4-38a1-4d15-bfed-c34585b87d54"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:52:31.765206 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1015cf8b-3883-4313-8e3b-24c3c10ec6ea req-dfcdecf4-d19f-42e1-a112-6c3a967e3903 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:31.765703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1015cf8b-3883-4313-8e3b-24c3c10ec6ea req-dfcdecf4-d19f-42e1-a112-6c3a967e3903 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:31.766143 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1015cf8b-3883-4313-8e3b-24c3c10ec6ea req-dfcdecf4-d19f-42e1-a112-6c3a967e3903 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:31.822790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:52:31.826962 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-1015cf8b-3883-4313-8e3b-24c3c10ec6ea req-dfcdecf4-d19f-42e1-a112-6c3a967e3903 service nova] Creating event network-changed:5fa0dbc4-38a1-4d15-bfed-c34585b87d54 for instance 2ef11e58-0680-4e15-aa40-a4043a5a357a on n-h1-858272-3 Oct 05 02:52:31.845853 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-1015cf8b-3883-4313-8e3b-24c3c10ec6ea req-dfcdecf4-d19f-42e1-a112-6c3a967e3903 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110109 Oct 05 02:52:31.857128 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2445/4892] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:52:32.270775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2c944f96-afa7-47d8-8260-77e3497deccd tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:32.273410 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2c944f96-afa7-47d8-8260-77e3497deccd tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:32.279476 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:52:32.305756 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c944f96-afa7-47d8-8260-77e3497deccd tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:32.307045 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c944f96-afa7-47d8-8260-77e3497deccd tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:32.308228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c944f96-afa7-47d8-8260-77e3497deccd tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:32.314220 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c944f96-afa7-47d8-8260-77e3497deccd tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:32.315475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c944f96-afa7-47d8-8260-77e3497deccd tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:32.316096 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c944f96-afa7-47d8-8260-77e3497deccd tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:32.344331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:52:32.413690 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7fd4693b-9e20-4538-a387-17ab9fc9fa84 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:32.415182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7fd4693b-9e20-4538-a387-17ab9fc9fa84 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] [instance: a1c78871-374e-41d9-af4a-d8284ccb8508] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:32.425852 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fd4693b-9e20-4538-a387-17ab9fc9fa84 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:32.428712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fd4693b-9e20-4538-a387-17ab9fc9fa84 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:32.430336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fd4693b-9e20-4538-a387-17ab9fc9fa84 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:32.431423 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fd4693b-9e20-4538-a387-17ab9fc9fa84 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:32.432823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fd4693b-9e20-4538-a387-17ab9fc9fa84 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:32.433579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fd4693b-9e20-4538-a387-17ab9fc9fa84 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:33.457586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7fd4693b-9e20-4538-a387-17ab9fc9fa84 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23b56d519224b22802f978442c7289f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa67de433dc46a595baea99d927d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:33.467178 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7fd4693b-9e20-4538-a387-17ab9fc9fa84 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] 10.222.0.16 "GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508" status: 200 len: 1427 microversion: 2.1 time: 1.061572 Oct 05 02:52:33.470448 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2446/4893] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:32 2022] GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508 => generated 1427 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:33.489870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2fe333da-8dd0-48b6-8fd9-f7d46d740a07 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-737835038", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "adad3215-1ca6-43bb-9981-0d01aff146ab", "destination_type": "local"}, {"source_type": "volume", "uuid": "80b0483f-8985-4149-ba0d-ce6f417ac9e7", "destination_type": "invalid"}], "networks": [{"uuid": "e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2fe333da-8dd0-48b6-8fd9-f7d46d740a07 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 494 Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-737835038", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "adad3215-1ca6-43bb-9981-0d01aff146ab", "destination_type": "local"}, {"source_type": "volume", "uuid": "80b0483f-8985-4149-ba0d-ce6f417ac9e7", "destination_type": "invalid"}], "networks": [{"uuid": "e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63"}]}} Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-737835038', 'imageRef': 'adad3215-1ca6-43bb-9981-0d01aff146ab', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'adad3215-1ca6-43bb-9981-0d01aff146ab', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '80b0483f-8985-4149-ba0d-ce6f417ac9e7', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63'}]}}} Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'invalid' Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:52:33.494932 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:52:33.500234 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:52:33.500234 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:52:33.500234 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:52:33.500234 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 02:52:33.500234 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 02:52:33.500234 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:52:33.500234 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:52:33.500234 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:52:33.500234 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:52:33.500234 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 05 02:52:33.500234 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:33.500234 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:33.500234 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:33.500234 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:33.500234 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:33.500234 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:33.500234 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:52:33.500234 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:52:33.500234 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 05 02:52:33.500234 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:33.511408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2fe333da-8dd0-48b6-8fd9-f7d46d740a07 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:52:33.513554 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2fe333da-8dd0-48b6-8fd9-f7d46d740a07 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.039535 Oct 05 02:52:33.518561 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2447/4894] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:52:33 2022] POST /compute/v2.1/servers => generated 155 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:52:33.530900 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-27e86e86-1a17-4b15-877a-938c3df8b8ea tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:33.533660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-27e86e86-1a17-4b15-877a-938c3df8b8ea tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:33.551046 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27e86e86-1a17-4b15-877a-938c3df8b8ea tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:33.551853 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27e86e86-1a17-4b15-877a-938c3df8b8ea tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:33.552472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27e86e86-1a17-4b15-877a-938c3df8b8ea tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:33.554252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27e86e86-1a17-4b15-877a-938c3df8b8ea tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:33.554912 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27e86e86-1a17-4b15-877a-938c3df8b8ea tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:33.555589 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27e86e86-1a17-4b15-877a-938c3df8b8ea tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:33.866235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2c944f96-afa7-47d8-8260-77e3497deccd tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:33.886808 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2c944f96-afa7-47d8-8260-77e3497deccd tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:33.888632 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2c944f96-afa7-47d8-8260-77e3497deccd tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:33.892939 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2c944f96-afa7-47d8-8260-77e3497deccd tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 1.627670 Oct 05 02:52:33.893827 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2448/4895] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:32 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:52:34.397462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-27e86e86-1a17-4b15-877a-938c3df8b8ea tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:34.415238 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-27e86e86-1a17-4b15-877a-938c3df8b8ea tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.885202 Oct 05 02:52:34.430616 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2448/4896] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:33 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:34.456160 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-864e3257-bc0d-49a7-b19e-8f8e33967ebf tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:34.456788 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-864e3257-bc0d-49a7-b19e-8f8e33967ebf tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:34.495217 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-864e3257-bc0d-49a7-b19e-8f8e33967ebf tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:34.496807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-864e3257-bc0d-49a7-b19e-8f8e33967ebf tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:34.497928 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9cf78cc5-915a-4e21-bb0f-a8fb7e9372d4 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:34.499006 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-864e3257-bc0d-49a7-b19e-8f8e33967ebf tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:34.500148 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9cf78cc5-915a-4e21-bb0f-a8fb7e9372d4 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] [instance: a1c78871-374e-41d9-af4a-d8284ccb8508] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:34.501062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-864e3257-bc0d-49a7-b19e-8f8e33967ebf tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:34.503951 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-864e3257-bc0d-49a7-b19e-8f8e33967ebf tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:34.505191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-864e3257-bc0d-49a7-b19e-8f8e33967ebf tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:34.516970 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cf78cc5-915a-4e21-bb0f-a8fb7e9372d4 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:34.517713 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cf78cc5-915a-4e21-bb0f-a8fb7e9372d4 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:34.521206 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cf78cc5-915a-4e21-bb0f-a8fb7e9372d4 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:34.525357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cf78cc5-915a-4e21-bb0f-a8fb7e9372d4 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:34.526086 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cf78cc5-915a-4e21-bb0f-a8fb7e9372d4 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:34.526761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cf78cc5-915a-4e21-bb0f-a8fb7e9372d4 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:35.169864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-864e3257-bc0d-49a7-b19e-8f8e33967ebf tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:35.184137 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-864e3257-bc0d-49a7-b19e-8f8e33967ebf tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.741374 Oct 05 02:52:35.185813 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2449/4897] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:34 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:35.201732 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5df1af0d-4da5-4b1e-9f97-6b6a4e19b44c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:35.201732 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5df1af0d-4da5-4b1e-9f97-6b6a4e19b44c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:35.226029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5df1af0d-4da5-4b1e-9f97-6b6a4e19b44c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:35.227143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5df1af0d-4da5-4b1e-9f97-6b6a4e19b44c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:35.227807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5df1af0d-4da5-4b1e-9f97-6b6a4e19b44c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:35.228604 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5df1af0d-4da5-4b1e-9f97-6b6a4e19b44c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:35.239803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5df1af0d-4da5-4b1e-9f97-6b6a4e19b44c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:35.242666 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5df1af0d-4da5-4b1e-9f97-6b6a4e19b44c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:35.916798 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9cf78cc5-915a-4e21-bb0f-a8fb7e9372d4 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23b56d519224b22802f978442c7289f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa67de433dc46a595baea99d927d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:35.930823 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9cf78cc5-915a-4e21-bb0f-a8fb7e9372d4 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] 10.222.0.16 "GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508" status: 200 len: 1608 microversion: 2.1 time: 1.436862 Oct 05 02:52:35.949022 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2449/4898] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:34 2022] GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508 => generated 1608 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:35.977040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-04f678b5-d50c-4c34-a4c1-12cdd0aa92c2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-849208270", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-04f678b5-d50c-4c34-a4c1-12cdd0aa92c2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 491 Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-849208270", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63"}]}} Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-849208270', 'imageRef': 'adad3215-1ca6-43bb-9981-0d01aff146ab', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63'}]}}} Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:35.984885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 05 02:52:35.989022 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 05 02:52:35.989022 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:35.989022 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:35.989022 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:35.989022 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:35.989022 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:35.989022 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:35.989022 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:52:35.989022 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:52:35.989022 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:52:35.989022 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:52:35.989022 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:52:35.989022 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:52:35.989022 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 02:52:35.989022 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 02:52:35.989022 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:52:35.989022 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:52:35.989022 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:52:35.989022 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:52:35.989022 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 05 02:52:35.989022 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:35.989022 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:35.989022 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:35.989022 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:35.989022 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:35.989022 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:35.989022 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:52:35.989022 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:52:35.989022 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 05 02:52:35.989022 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:35.992859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-04f678b5-d50c-4c34-a4c1-12cdd0aa92c2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:52:35.993830 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-04f678b5-d50c-4c34-a4c1-12cdd0aa92c2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.043151 Oct 05 02:52:35.994922 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2450/4899] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:52:35 2022] POST /compute/v2.1/servers => generated 624 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:52:36.128612 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5df1af0d-4da5-4b1e-9f97-6b6a4e19b44c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:36.138874 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5df1af0d-4da5-4b1e-9f97-6b6a4e19b44c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:36.140319 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5df1af0d-4da5-4b1e-9f97-6b6a4e19b44c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:36.141531 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5df1af0d-4da5-4b1e-9f97-6b6a4e19b44c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 0.954363 Oct 05 02:52:36.145904 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2450/4900] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:35 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:52:36.152427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-06080045-9301-43a0-8bba-fab79a4354f6 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:36.161130 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-06080045-9301-43a0-8bba-fab79a4354f6 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] [instance: a1c78871-374e-41d9-af4a-d8284ccb8508] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:36.170117 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-06080045-9301-43a0-8bba-fab79a4354f6 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:36.170783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-06080045-9301-43a0-8bba-fab79a4354f6 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:36.171026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-06080045-9301-43a0-8bba-fab79a4354f6 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:36.171934 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-06080045-9301-43a0-8bba-fab79a4354f6 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:36.172390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-06080045-9301-43a0-8bba-fab79a4354f6 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:36.172814 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-06080045-9301-43a0-8bba-fab79a4354f6 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:36.224601 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9bbee112-436a-4184-b723-c6615ac92628 tempest-ServerGroup264TestJSON-1781328450 tempest-ServerGroup264TestJSON-1781328450-project] Action: 'create', calling method: .version_select at 0x7fccdf18be50>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:52:36.266170 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-9bbee112-436a-4184-b723-c6615ac92628 tempest-ServerGroup264TestJSON-1781328450 tempest-ServerGroup264TestJSON-1781328450-project] Getting quotas for project 4d7f0ec26e874f4291a8f93e864c9ca1. Resources: {'server_groups'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:52:36.277590 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-9bbee112-436a-4184-b723-c6615ac92628 tempest-ServerGroup264TestJSON-1781328450 tempest-ServerGroup264TestJSON-1781328450-project] Getting quotas for user b3760004b7624b8fa6818650856ceaa5 and project 4d7f0ec26e874f4291a8f93e864c9ca1. Resources: {'server_groups'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:52:36.352172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-9bbee112-436a-4184-b723-c6615ac92628 tempest-ServerGroup264TestJSON-1781328450 tempest-ServerGroup264TestJSON-1781328450-project] Getting quotas for project 4d7f0ec26e874f4291a8f93e864c9ca1. Resources: {'server_groups'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:52:36.358281 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-9bbee112-436a-4184-b723-c6615ac92628 tempest-ServerGroup264TestJSON-1781328450 tempest-ServerGroup264TestJSON-1781328450-project] Getting quotas for user b3760004b7624b8fa6818650856ceaa5 and project 4d7f0ec26e874f4291a8f93e864c9ca1. Resources: {'server_groups'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:52:36.413532 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9bbee112-436a-4184-b723-c6615ac92628 tempest-ServerGroup264TestJSON-1781328450 tempest-ServerGroup264TestJSON-1781328450-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.414926 Oct 05 02:52:36.414240 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2451/4901] 10.222.0.16 () {62 vars in 1214 bytes} [Wed Oct 5 02:52:35 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:52:36.438184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-98739a36-5ab3-42b7-87e1-31ed90cdac30 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:36.442947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-98739a36-5ab3-42b7-87e1-31ed90cdac30 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:36.456006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98739a36-5ab3-42b7-87e1-31ed90cdac30 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:36.456694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98739a36-5ab3-42b7-87e1-31ed90cdac30 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:36.457365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98739a36-5ab3-42b7-87e1-31ed90cdac30 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:36.458258 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98739a36-5ab3-42b7-87e1-31ed90cdac30 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:36.458877 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98739a36-5ab3-42b7-87e1-31ed90cdac30 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:36.459610 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98739a36-5ab3-42b7-87e1-31ed90cdac30 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:36.780408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-06080045-9301-43a0-8bba-fab79a4354f6 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23b56d519224b22802f978442c7289f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa67de433dc46a595baea99d927d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:36.807005 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-06080045-9301-43a0-8bba-fab79a4354f6 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] 10.222.0.16 "GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508" status: 200 len: 1608 microversion: 2.1 time: 0.657831 Oct 05 02:52:36.809436 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2451/4902] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:36 2022] GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508 => generated 1608 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:36.828593 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f65b0dcd-8cb9-475c-9a37-d93c2ded82be tempest-ServerGroup264TestJSON-1781328450 tempest-ServerGroup264TestJSON-1781328450-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:36.837883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-98739a36-5ab3-42b7-87e1-31ed90cdac30 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:36.851229 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-98739a36-5ab3-42b7-87e1-31ed90cdac30 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.431483 Oct 05 02:52:36.851960 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2452/4903] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:36 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:36.871074 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f7c114f8-b6ed-4627-8c5a-7f872b2d296c tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:36.873174 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f7c114f8-b6ed-4627-8c5a-7f872b2d296c tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] [instance: a1c78871-374e-41d9-af4a-d8284ccb8508] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:36.878681 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f65b0dcd-8cb9-475c-9a37-d93c2ded82be tempest-ServerGroup264TestJSON-1781328450 tempest-ServerGroup264TestJSON-1781328450-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.062098 Oct 05 02:52:36.878681 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2452/4904] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Oct 5 02:52:36 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:52:36.890655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-336aa189-8c90-4961-9aa0-6d98a81a42e5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:36.891557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-336aa189-8c90-4961-9aa0-6d98a81a42e5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:36.895017 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7c114f8-b6ed-4627-8c5a-7f872b2d296c tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:36.895525 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7c114f8-b6ed-4627-8c5a-7f872b2d296c tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:36.895968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7c114f8-b6ed-4627-8c5a-7f872b2d296c tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:36.904356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7c114f8-b6ed-4627-8c5a-7f872b2d296c tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:36.904865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7c114f8-b6ed-4627-8c5a-7f872b2d296c tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:36.906397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-336aa189-8c90-4961-9aa0-6d98a81a42e5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:36.909249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-336aa189-8c90-4961-9aa0-6d98a81a42e5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:36.910625 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7c114f8-b6ed-4627-8c5a-7f872b2d296c tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:36.918268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-336aa189-8c90-4961-9aa0-6d98a81a42e5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:36.919714 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-336aa189-8c90-4961-9aa0-6d98a81a42e5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:36.922728 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-336aa189-8c90-4961-9aa0-6d98a81a42e5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:36.923243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-336aa189-8c90-4961-9aa0-6d98a81a42e5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:37.737863 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f7c114f8-b6ed-4627-8c5a-7f872b2d296c tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23b56d519224b22802f978442c7289f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa67de433dc46a595baea99d927d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:37.753626 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f7c114f8-b6ed-4627-8c5a-7f872b2d296c tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] 10.222.0.16 "GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508" status: 200 len: 1608 microversion: 2.1 time: 0.895552 Oct 05 02:52:37.754807 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2453/4905] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:36 2022] GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508 => generated 1608 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:37.761895 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e10eb249-24c0-4f4b-8122-1456a53b59ef tempest-ServerGroup264TestJSON-1781328450 tempest-ServerGroup264TestJSON-1781328450-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:37.783564 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e10eb249-24c0-4f4b-8122-1456a53b59ef tempest-ServerGroup264TestJSON-1781328450 tempest-ServerGroup264TestJSON-1781328450-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/f4316803-64bc-456a-89b3-4bd5eb125715" status: 200 len: 235 microversion: 2.64 time: 0.027463 Oct 05 02:52:37.785876 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2454/4906] 10.222.0.16 () {60 vars in 1304 bytes} [Wed Oct 5 02:52:37 2022] GET /compute/v2.1/os-server-groups/f4316803-64bc-456a-89b3-4bd5eb125715 => generated 235 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:52:37.797247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-ddef9ecb-0fb5-42d8-b889-8265ddbf0a9a req-0e40cf2b-0e55-4eb7-a61c-7aa95fc9cf2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ef11e58-0680-4e15-aa40-a4043a5a357a", "tag": "4b351d8f-7fd7-478b-adba-19c746dc4014"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:52:37.824841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ddef9ecb-0fb5-42d8-b889-8265ddbf0a9a req-0e40cf2b-0e55-4eb7-a61c-7aa95fc9cf2a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:37.829907 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ddef9ecb-0fb5-42d8-b889-8265ddbf0a9a req-0e40cf2b-0e55-4eb7-a61c-7aa95fc9cf2a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:37.830710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ddef9ecb-0fb5-42d8-b889-8265ddbf0a9a req-0e40cf2b-0e55-4eb7-a61c-7aa95fc9cf2a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:37.842853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-336aa189-8c90-4961-9aa0-6d98a81a42e5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:37.848079 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-ddef9ecb-0fb5-42d8-b889-8265ddbf0a9a req-0e40cf2b-0e55-4eb7-a61c-7aa95fc9cf2a service nova] Creating event network-changed:4b351d8f-7fd7-478b-adba-19c746dc4014 for instance 2ef11e58-0680-4e15-aa40-a4043a5a357a on n-h1-858272-3 Oct 05 02:52:37.861149 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-336aa189-8c90-4961-9aa0-6d98a81a42e5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.976454 Oct 05 02:52:37.862787 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2453/4907] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:36 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:37.875834 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-ddef9ecb-0fb5-42d8-b889-8265ddbf0a9a req-0e40cf2b-0e55-4eb7-a61c-7aa95fc9cf2a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085973 Oct 05 02:52:37.876857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-34f60247-f144-46d7-a585-1d0890ba1b54 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:37.879879 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-34f60247-f144-46d7-a585-1d0890ba1b54 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:37.886872 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2455/4908] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:52:37.903740 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-88d48bb1-62d6-400c-a083-48f5fc23deae tempest-ServerGroup264TestJSON-1781328450 tempest-ServerGroup264TestJSON-1781328450-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:37.922057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34f60247-f144-46d7-a585-1d0890ba1b54 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:37.922953 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34f60247-f144-46d7-a585-1d0890ba1b54 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:37.924597 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34f60247-f144-46d7-a585-1d0890ba1b54 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:37.927342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34f60247-f144-46d7-a585-1d0890ba1b54 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:37.931479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34f60247-f144-46d7-a585-1d0890ba1b54 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:37.932219 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34f60247-f144-46d7-a585-1d0890ba1b54 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:38.003160 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-88d48bb1-62d6-400c-a083-48f5fc23deae tempest-ServerGroup264TestJSON-1781328450 tempest-ServerGroup264TestJSON-1781328450-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/f4316803-64bc-456a-89b3-4bd5eb125715" status: 204 len: 0 microversion: 2.64 time: 0.114937 Oct 05 02:52:38.004099 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2456/4909] 10.222.0.16 () {60 vars in 1307 bytes} [Wed Oct 5 02:52:37 2022] DELETE /compute/v2.1/os-server-groups/f4316803-64bc-456a-89b3-4bd5eb125715 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 02:52:38.019783 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a5e8e983-8a65-4101-b17c-47420088b083 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a5e8e983-8a65-4101-b17c-47420088b083 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 416 Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63"}]}} Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'adad3215-1ca6-43bb-9981-0d01aff146ab', 'flavorRef': '452', 'networks': [{'uuid': 'e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63'}]}}} Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:38.034237 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:38.039317 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:38.039317 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:38.039317 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:38.039317 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:38.039317 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:52:38.039317 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:52:38.039317 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:52:38.039317 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:52:38.039317 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:52:38.039317 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:52:38.039317 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 02:52:38.039317 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 02:52:38.039317 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:52:38.039317 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:52:38.039317 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:52:38.039317 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:52:38.039317 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 02:52:38.039317 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:38.039317 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:38.039317 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:38.039317 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:38.039317 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:38.039317 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:38.039317 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:52:38.039317 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:52:38.039317 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 02:52:38.039317 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:38.039317 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a5e8e983-8a65-4101-b17c-47420088b083 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:52:38.041765 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a5e8e983-8a65-4101-b17c-47420088b083 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.030069 Oct 05 02:52:38.043066 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2457/4910] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:52:38 2022] POST /compute/v2.1/servers => generated 619 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:52:38.057004 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d73faeb1-6c15-4b8c-a594-54a6159849e8 tempest-ServerGroup264TestJSON-1781328450 tempest-ServerGroup264TestJSON-1781328450-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:38.073262 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-d73faeb1-6c15-4b8c-a594-54a6159849e8 tempest-ServerGroup264TestJSON-1781328450 tempest-ServerGroup264TestJSON-1781328450-project] HTTP exception thrown: Instance group f4316803-64bc-456a-89b3-4bd5eb125715 could not be found. Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d73faeb1-6c15-4b8c-a594-54a6159849e8 tempest-ServerGroup264TestJSON-1781328450 tempest-ServerGroup264TestJSON-1781328450-project] Request method failure captured: Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/os-server-groups/f4316803-64bc-456a-89b3-4bd5eb125715 HTTP/1.1 Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPFzrBMN-g5jZhi1juKsu9DQ5uYxmE3Cr6h5RJwDBCzYMvDY_G-8j4WxZWk0wBMu_iOYszinfouBESDIaEEf8DVIWEqkUBK4cTF8lvgGUD4gobULQiX59ccgP1yYGKb3rc-KUmqn0YLsa61lVRTVtzZ-civkY69KEIuAyhkFKAUn4Jk Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: X-Openstack-Nova-Api-Version: 2.64 Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 4d7f0ec26e874f4291a8f93e864c9ca1 Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerGroup264TestJSON-1781328450 Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d7f0ec26e874f4291a8f93e864c9ca1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d7f0ec26e874f4291a8f93e864c9ca1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4d7f0ec26e874f4291a8f93e864c9ca1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4d7f0ec26e874f4291a8f93e864c9ca1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerGroup264TestJSON-1781328450 Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 4d7f0ec26e874f4291a8f93e864c9ca1 Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1781328450 Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerGroup264TestJSON-1781328450-project Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: b3760004b7624b8fa6818650856ceaa5 Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerGroup264TestJSON-1781328450-project Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance group f4316803-64bc-456a-89b3-4bd5eb125715 could not be found. Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'f4316803-64bc-456a-89b3-4bd5eb125715'} Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f4316803-64bc-456a-89b3-4bd5eb125715 could not be found. Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f4316803-64bc-456a-89b3-4bd5eb125715 could not be found. Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:38.075151 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:38.082392 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:38.082392 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:38.082392 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:52:38.082392 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:52:38.082392 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f4316803-64bc-456a-89b3-4bd5eb125715 could not be found. Oct 05 02:52:38.082392 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:38.082392 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d73faeb1-6c15-4b8c-a594-54a6159849e8 tempest-ServerGroup264TestJSON-1781328450 tempest-ServerGroup264TestJSON-1781328450-project] Returning 404 to user: Instance group f4316803-64bc-456a-89b3-4bd5eb125715 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:52:38.082392 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d73faeb1-6c15-4b8c-a594-54a6159849e8 tempest-ServerGroup264TestJSON-1781328450 tempest-ServerGroup264TestJSON-1781328450-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/f4316803-64bc-456a-89b3-4bd5eb125715" status: 404 len: 117 microversion: 2.64 time: 0.029217 Oct 05 02:52:38.082392 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2458/4911] 10.222.0.16 () {60 vars in 1307 bytes} [Wed Oct 5 02:52:38 2022] DELETE /compute/v2.1/os-server-groups/f4316803-64bc-456a-89b3-4bd5eb125715 => generated 117 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:52:38.086468 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-67330840-fe6b-4e40-8b0a-54385cd7a3f5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:38.093160 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-67330840-fe6b-4e40-8b0a-54385cd7a3f5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:38.114840 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-67330840-fe6b-4e40-8b0a-54385cd7a3f5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:38.115791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-67330840-fe6b-4e40-8b0a-54385cd7a3f5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:38.116486 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-67330840-fe6b-4e40-8b0a-54385cd7a3f5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:38.117749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-67330840-fe6b-4e40-8b0a-54385cd7a3f5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:38.118509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-67330840-fe6b-4e40-8b0a-54385cd7a3f5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:38.119049 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-67330840-fe6b-4e40-8b0a-54385cd7a3f5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:39.513389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-67330840-fe6b-4e40-8b0a-54385cd7a3f5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:39.524585 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-67330840-fe6b-4e40-8b0a-54385cd7a3f5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 1.443118 Oct 05 02:52:39.525219 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2459/4912] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:38 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:39.559483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-639a941e-5b0d-492a-8424-d75b343275a3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:39.560827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-639a941e-5b0d-492a-8424-d75b343275a3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:39.574234 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-639a941e-5b0d-492a-8424-d75b343275a3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:39.577682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-639a941e-5b0d-492a-8424-d75b343275a3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:39.578319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-639a941e-5b0d-492a-8424-d75b343275a3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:39.579240 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-639a941e-5b0d-492a-8424-d75b343275a3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:39.581160 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-639a941e-5b0d-492a-8424-d75b343275a3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:39.582077 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-639a941e-5b0d-492a-8424-d75b343275a3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:39.831503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-34f60247-f144-46d7-a585-1d0890ba1b54 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:39.853819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-34f60247-f144-46d7-a585-1d0890ba1b54 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:39.855682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-34f60247-f144-46d7-a585-1d0890ba1b54 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:39.863584 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-34f60247-f144-46d7-a585-1d0890ba1b54 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 1.996747 Oct 05 02:52:39.866720 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2454/4913] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:37 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 2003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:52:40.154556 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-639a941e-5b0d-492a-8424-d75b343275a3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:40.167957 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-639a941e-5b0d-492a-8424-d75b343275a3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.613251 Oct 05 02:52:40.168567 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2460/4914] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:39 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:40.290329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-09853262-b9d2-4597-ad34-42114e5ce194 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-52310698", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": -1, "networks": [{"uuid": "e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:52:40.321244 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-09853262-b9d2-4597-ad34-42114e5ce194 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Flavor -1 could not be found. Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-09853262-b9d2-4597-ad34-42114e5ce194 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 204 Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-52310698", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": -1, "networks": [{"uuid": "e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63"}]}} Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: exception: Flavor -1 could not be found. Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-52310698', 'imageRef': 'adad3215-1ca6-43bb-9981-0d01aff146ab', 'flavorRef': -1, 'networks': [{'uuid': 'e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63'}]}}} Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:52:40.326804 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:52:40.331448 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:52:40.331448 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:52:40.331448 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:52:40.331448 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:52:40.331448 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 05 02:52:40.331448 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 05 02:52:40.331448 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 05 02:52:40.331448 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 05 02:52:40.331448 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:40.331448 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:40.331448 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:40.331448 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:40.331448 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:40.331448 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:40.331448 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:52:40.331448 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:52:40.331448 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 05 02:52:40.331448 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:40.354182 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-09853262-b9d2-4597-ad34-42114e5ce194 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:52:40.355585 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-09853262-b9d2-4597-ad34-42114e5ce194 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.071386 Oct 05 02:52:40.361285 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2455/4915] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:52:40 2022] POST /compute/v2.1/servers => generated 73 bytes in 77 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 05 02:52:40.366885 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7607d93a-22fc-4071-ad66-7426ef8ceb66 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:40.367511 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7607d93a-22fc-4071-ad66-7426ef8ceb66 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:40.382095 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7607d93a-22fc-4071-ad66-7426ef8ceb66 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:40.382697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7607d93a-22fc-4071-ad66-7426ef8ceb66 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:40.383149 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7607d93a-22fc-4071-ad66-7426ef8ceb66 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:40.383897 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7607d93a-22fc-4071-ad66-7426ef8ceb66 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:40.384414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7607d93a-22fc-4071-ad66-7426ef8ceb66 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:40.384895 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7607d93a-22fc-4071-ad66-7426ef8ceb66 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:40.899689 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-07c34cec-3642-4fc6-9d25-aac6fe7c3a67 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:40.900453 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-07c34cec-3642-4fc6-9d25-aac6fe7c3a67 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:40.914607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07c34cec-3642-4fc6-9d25-aac6fe7c3a67 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:40.915268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07c34cec-3642-4fc6-9d25-aac6fe7c3a67 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:40.916150 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07c34cec-3642-4fc6-9d25-aac6fe7c3a67 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:40.927530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07c34cec-3642-4fc6-9d25-aac6fe7c3a67 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:40.928327 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07c34cec-3642-4fc6-9d25-aac6fe7c3a67 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:40.929215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07c34cec-3642-4fc6-9d25-aac6fe7c3a67 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:41.253487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7607d93a-22fc-4071-ad66-7426ef8ceb66 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:41.283990 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7607d93a-22fc-4071-ad66-7426ef8ceb66 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.921508 Oct 05 02:52:41.288339 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2461/4916] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:40 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:41.320834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-1271401d-a7b2-4b68-91ea-2393ffd07c7b req-43eb88f8-5bc8-4b46-8fac-d2fb0892699a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ef11e58-0680-4e15-aa40-a4043a5a357a", "tag": "5b01513e-6840-4e8a-9f16-5f658f55e045"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:52:41.342635 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1271401d-a7b2-4b68-91ea-2393ffd07c7b req-43eb88f8-5bc8-4b46-8fac-d2fb0892699a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:41.346523 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1271401d-a7b2-4b68-91ea-2393ffd07c7b req-43eb88f8-5bc8-4b46-8fac-d2fb0892699a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:41.347164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1271401d-a7b2-4b68-91ea-2393ffd07c7b req-43eb88f8-5bc8-4b46-8fac-d2fb0892699a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:41.376853 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-1271401d-a7b2-4b68-91ea-2393ffd07c7b req-43eb88f8-5bc8-4b46-8fac-d2fb0892699a service nova] Creating event network-changed:5b01513e-6840-4e8a-9f16-5f658f55e045 for instance 2ef11e58-0680-4e15-aa40-a4043a5a357a on n-h1-858272-3 Oct 05 02:52:41.390912 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-1271401d-a7b2-4b68-91ea-2393ffd07c7b req-43eb88f8-5bc8-4b46-8fac-d2fb0892699a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077211 Oct 05 02:52:41.397911 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2462/4917] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:52:41.403730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-73fd346d-0503-41b7-9462-24da560e3e20 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:41.410262 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-73fd346d-0503-41b7-9462-24da560e3e20 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:41.432736 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-73fd346d-0503-41b7-9462-24da560e3e20 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:41.433296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-73fd346d-0503-41b7-9462-24da560e3e20 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:41.433877 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-73fd346d-0503-41b7-9462-24da560e3e20 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:41.434671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-73fd346d-0503-41b7-9462-24da560e3e20 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:41.435138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-73fd346d-0503-41b7-9462-24da560e3e20 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:41.435583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-73fd346d-0503-41b7-9462-24da560e3e20 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:42.534009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-07c34cec-3642-4fc6-9d25-aac6fe7c3a67 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:42.559470 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-07c34cec-3642-4fc6-9d25-aac6fe7c3a67 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:42.561578 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-07c34cec-3642-4fc6-9d25-aac6fe7c3a67 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:42.563123 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-07c34cec-3642-4fc6-9d25-aac6fe7c3a67 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 1.671309 Oct 05 02:52:42.568562 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2456/4918] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:40 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:52:42.837404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-73fd346d-0503-41b7-9462-24da560e3e20 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:42.857530 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-73fd346d-0503-41b7-9462-24da560e3e20 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 1.451760 Oct 05 02:52:42.858207 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2463/4919] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:41 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:42.961102 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-967d1c76-63e2-4905-ab57-7b1e406e7fcf tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-531285391", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-967d1c76-63e2-4905-ab57-7b1e406e7fcf tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 172 Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-531285391", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63"}]}} Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-531285391', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63'}]}}} Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi -1 Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 02:52:42.977117 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:52:42.982627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:52:42.982627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:52:42.982627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:52:42.982627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 05 02:52:42.982627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:42.982627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:42.982627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:42.982627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:42.982627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:42.982627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:42.982627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:52:42.982627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:52:42.982627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 05 02:52:42.982627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:42.985488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-967d1c76-63e2-4905-ab57-7b1e406e7fcf tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:52:42.985963 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-967d1c76-63e2-4905-ab57-7b1e406e7fcf tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.030642 Oct 05 02:52:42.986848 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2457/4920] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:52:42 2022] POST /compute/v2.1/servers => generated 145 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 05 02:52:42.995686 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5ad64666-0e93-4623-b095-209d99a6c4cd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:42.996304 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5ad64666-0e93-4623-b095-209d99a6c4cd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:43.009215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ad64666-0e93-4623-b095-209d99a6c4cd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:43.010892 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ad64666-0e93-4623-b095-209d99a6c4cd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:43.011725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ad64666-0e93-4623-b095-209d99a6c4cd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:43.014545 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ad64666-0e93-4623-b095-209d99a6c4cd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:43.015976 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ad64666-0e93-4623-b095-209d99a6c4cd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:43.017808 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ad64666-0e93-4623-b095-209d99a6c4cd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:43.594357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-89a3fbf0-ef07-47b2-aaee-6779988a3176 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:43.595225 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-89a3fbf0-ef07-47b2-aaee-6779988a3176 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:43.614667 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89a3fbf0-ef07-47b2-aaee-6779988a3176 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:43.616041 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89a3fbf0-ef07-47b2-aaee-6779988a3176 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:43.619146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89a3fbf0-ef07-47b2-aaee-6779988a3176 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:43.623430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89a3fbf0-ef07-47b2-aaee-6779988a3176 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:43.624864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89a3fbf0-ef07-47b2-aaee-6779988a3176 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:43.625621 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89a3fbf0-ef07-47b2-aaee-6779988a3176 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:43.937445 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5ad64666-0e93-4623-b095-209d99a6c4cd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:43.967572 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5ad64666-0e93-4623-b095-209d99a6c4cd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.969067 Oct 05 02:52:43.993744 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2464/4921] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:42 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:44.010395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c80e2cbf-62fa-40c4-a306-9930f1f584e1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:44.014835 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c80e2cbf-62fa-40c4-a306-9930f1f584e1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:44.029918 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c80e2cbf-62fa-40c4-a306-9930f1f584e1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:44.030915 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c80e2cbf-62fa-40c4-a306-9930f1f584e1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:44.031923 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c80e2cbf-62fa-40c4-a306-9930f1f584e1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:44.033614 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c80e2cbf-62fa-40c4-a306-9930f1f584e1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:44.034475 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c80e2cbf-62fa-40c4-a306-9930f1f584e1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:44.035393 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c80e2cbf-62fa-40c4-a306-9930f1f584e1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:44.727218 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-89a3fbf0-ef07-47b2-aaee-6779988a3176 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:44.745303 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-89a3fbf0-ef07-47b2-aaee-6779988a3176 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:44.747201 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-89a3fbf0-ef07-47b2-aaee-6779988a3176 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:44.748426 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-89a3fbf0-ef07-47b2-aaee-6779988a3176 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 1.159876 Oct 05 02:52:44.749028 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2458/4922] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:43 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:52:44.882972 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c80e2cbf-62fa-40c4-a306-9930f1f584e1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:44.899951 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c80e2cbf-62fa-40c4-a306-9930f1f584e1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.897709 Oct 05 02:52:44.913007 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2465/4923] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:43 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:45.118245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e4cab64a-762b-4551-9600-1a5e29bc32ff tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-311733666", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:52:45.125402 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-e4cab64a-762b-4551-9600-1a5e29bc32ff tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e4cab64a-762b-4551-9600-1a5e29bc32ff tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 215 Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-311733666", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-311733666', 'imageRef': 'adad3215-1ca6-43bb-9981-0d01aff146ab', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:45.133100 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:45.138374 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:45.138374 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:45.138374 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:45.138374 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:45.138374 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:52:45.138374 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:52:45.138374 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 05 02:52:45.138374 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:45.138374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e4cab64a-762b-4551-9600-1a5e29bc32ff tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:52:45.138374 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e4cab64a-762b-4551-9600-1a5e29bc32ff tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.023526 Oct 05 02:52:45.141967 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2459/4924] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:52:45 2022] POST /compute/v2.1/servers => generated 123 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:52:45.147237 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8259e806-3807-4287-9d59-fc43b3177c90 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:45.153747 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8259e806-3807-4287-9d59-fc43b3177c90 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:45.163456 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8259e806-3807-4287-9d59-fc43b3177c90 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:45.168743 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8259e806-3807-4287-9d59-fc43b3177c90 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:45.169708 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8259e806-3807-4287-9d59-fc43b3177c90 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:45.176431 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8259e806-3807-4287-9d59-fc43b3177c90 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:45.177162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8259e806-3807-4287-9d59-fc43b3177c90 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:45.177737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8259e806-3807-4287-9d59-fc43b3177c90 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:45.793495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-14de5841-85f1-4d07-b8e6-c8fa5463c0c5 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:45.795927 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-14de5841-85f1-4d07-b8e6-c8fa5463c0c5 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:45.818342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14de5841-85f1-4d07-b8e6-c8fa5463c0c5 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:45.823905 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14de5841-85f1-4d07-b8e6-c8fa5463c0c5 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:45.824662 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14de5841-85f1-4d07-b8e6-c8fa5463c0c5 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:45.827219 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14de5841-85f1-4d07-b8e6-c8fa5463c0c5 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:45.830852 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14de5841-85f1-4d07-b8e6-c8fa5463c0c5 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:45.831968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14de5841-85f1-4d07-b8e6-c8fa5463c0c5 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:46.389090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=8 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:52:46.407385 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8259e806-3807-4287-9d59-fc43b3177c90 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:46.429122 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8259e806-3807-4287-9d59-fc43b3177c90 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 1.277973 Oct 05 02:52:46.429122 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2466/4925] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:45 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:46.448677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5bae0c4f-de9f-4436-a66a-833bc64080ed tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:46.450063 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5bae0c4f-de9f-4436-a66a-833bc64080ed tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:46.457078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5bae0c4f-de9f-4436-a66a-833bc64080ed tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:46.458193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5bae0c4f-de9f-4436-a66a-833bc64080ed tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:46.458953 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5bae0c4f-de9f-4436-a66a-833bc64080ed tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:46.460672 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5bae0c4f-de9f-4436-a66a-833bc64080ed tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:46.461410 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5bae0c4f-de9f-4436-a66a-833bc64080ed tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:46.462082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5bae0c4f-de9f-4436-a66a-833bc64080ed tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:46.729626 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-14de5841-85f1-4d07-b8e6-c8fa5463c0c5 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:46.745336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-14de5841-85f1-4d07-b8e6-c8fa5463c0c5 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:46.746806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-14de5841-85f1-4d07-b8e6-c8fa5463c0c5 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:46.748022 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-14de5841-85f1-4d07-b8e6-c8fa5463c0c5 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 0.968860 Oct 05 02:52:46.748838 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2460/4926] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:45 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:52:47.203629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5bae0c4f-de9f-4436-a66a-833bc64080ed tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:47.216757 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5bae0c4f-de9f-4436-a66a-833bc64080ed tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.773381 Oct 05 02:52:47.233477 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2467/4927] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:46 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:47.526356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-aa0303c2-2dfd-4aee-8e89-53502e3692b1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2090484474", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "key_name": "tempest-key-1272742368", "networks": [{"uuid": "e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:52:47.602507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-aa0303c2-2dfd-4aee-8e89-53502e3692b1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] validate_networks() for [('e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:52:47.776026 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7a2652ef-632c-4340-84f9-d53dcc72cce5 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:47.776618 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7a2652ef-632c-4340-84f9-d53dcc72cce5 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:47.791960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7a2652ef-632c-4340-84f9-d53dcc72cce5 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:47.793646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7a2652ef-632c-4340-84f9-d53dcc72cce5 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:47.797552 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7a2652ef-632c-4340-84f9-d53dcc72cce5 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:47.798379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7a2652ef-632c-4340-84f9-d53dcc72cce5 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:47.798866 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7a2652ef-632c-4340-84f9-d53dcc72cce5 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:47.799309 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7a2652ef-632c-4340-84f9-d53dcc72cce5 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:48.478714 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-aa0303c2-2dfd-4aee-8e89-53502e3692b1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Invalid key_name provided. Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-aa0303c2-2dfd-4aee-8e89-53502e3692b1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 247 Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2090484474", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "key_name": "tempest-key-1272742368", "networks": [{"uuid": "e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63"}]}} Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: exception: Invalid key_name provided. Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2090484474', 'imageRef': 'adad3215-1ca6-43bb-9981-0d01aff146ab', 'flavorRef': '452', 'key_name': 'tempest-key-1272742368', 'networks': [{'uuid': 'e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63'}]}}} Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1272742368 not found for user fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:48.482022 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:48.490035 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:48.490035 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:52:48.490035 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:52:48.490035 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:52:48.490035 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:52:48.490035 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:52:48.490035 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:52:48.490035 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:52:48.490035 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:52:48.490035 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:52:48.490035 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:52:48.490035 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 05 02:52:48.490035 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 05 02:52:48.490035 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 05 02:52:48.490035 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 05 02:52:48.490035 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:48.490035 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:48.490035 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:48.490035 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:48.490035 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:48.490035 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:48.490035 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:52:48.490035 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:52:48.490035 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 05 02:52:48.490035 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:48.497369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-aa0303c2-2dfd-4aee-8e89-53502e3692b1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 400 to user: Invalid key_name provided. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:52:48.498534 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-aa0303c2-2dfd-4aee-8e89-53502e3692b1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.977401 Oct 05 02:52:48.500487 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2461/4928] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:52:47 2022] POST /compute/v2.1/servers => generated 70 bytes in 980 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 05 02:52:48.508719 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3f9aec08-bba1-49f0-8518-84bced53ac33 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:48.509371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3f9aec08-bba1-49f0-8518-84bced53ac33 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:48.528940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f9aec08-bba1-49f0-8518-84bced53ac33 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:48.529663 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f9aec08-bba1-49f0-8518-84bced53ac33 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:48.530345 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f9aec08-bba1-49f0-8518-84bced53ac33 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:48.531322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f9aec08-bba1-49f0-8518-84bced53ac33 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:48.531892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f9aec08-bba1-49f0-8518-84bced53ac33 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:48.532456 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f9aec08-bba1-49f0-8518-84bced53ac33 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:48.822339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7a2652ef-632c-4340-84f9-d53dcc72cce5 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:48.843634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7a2652ef-632c-4340-84f9-d53dcc72cce5 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:48.848175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7a2652ef-632c-4340-84f9-d53dcc72cce5 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:48.852504 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7a2652ef-632c-4340-84f9-d53dcc72cce5 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 1.080362 Oct 05 02:52:48.854490 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2468/4929] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:47 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:52:49.136991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3f9aec08-bba1-49f0-8518-84bced53ac33 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:49.153881 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3f9aec08-bba1-49f0-8518-84bced53ac33 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.649407 Oct 05 02:52:49.181668 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2462/4930] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:48 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:49.195640 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8808c9b3-50c0-45fe-a0ad-b1acd33abf45 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:49.197271 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8808c9b3-50c0-45fe-a0ad-b1acd33abf45 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:49.211991 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8808c9b3-50c0-45fe-a0ad-b1acd33abf45 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:49.213876 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8808c9b3-50c0-45fe-a0ad-b1acd33abf45 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:49.215655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8808c9b3-50c0-45fe-a0ad-b1acd33abf45 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:49.217985 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8808c9b3-50c0-45fe-a0ad-b1acd33abf45 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:49.219312 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8808c9b3-50c0-45fe-a0ad-b1acd33abf45 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:49.225850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8808c9b3-50c0-45fe-a0ad-b1acd33abf45 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:50.140855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8808c9b3-50c0-45fe-a0ad-b1acd33abf45 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:50.158557 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8808c9b3-50c0-45fe-a0ad-b1acd33abf45 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.964401 Oct 05 02:52:50.159967 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2469/4931] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:49 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:50.168400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fc8859d7-b621-4188-a93b-6275eee80a4c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:50.173847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fc8859d7-b621-4188-a93b-6275eee80a4c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:50.192012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fc8859d7-b621-4188-a93b-6275eee80a4c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:50.192807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fc8859d7-b621-4188-a93b-6275eee80a4c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:50.195649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fc8859d7-b621-4188-a93b-6275eee80a4c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:50.202455 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fc8859d7-b621-4188-a93b-6275eee80a4c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:50.203211 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fc8859d7-b621-4188-a93b-6275eee80a4c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:50.207069 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fc8859d7-b621-4188-a93b-6275eee80a4c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:50.229251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-f078a159-650f-4c83-9627-a2503800659b req-0e702597-bc60-4036-a03b-6863bcc3205f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1c78871-374e-41d9-af4a-d8284ccb8508", "tag": "cf48c84f-265d-4bc9-bdf9-a08c725b21ec"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:52:50.252312 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f078a159-650f-4c83-9627-a2503800659b req-0e702597-bc60-4036-a03b-6863bcc3205f service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:50.252940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f078a159-650f-4c83-9627-a2503800659b req-0e702597-bc60-4036-a03b-6863bcc3205f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:50.253410 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f078a159-650f-4c83-9627-a2503800659b req-0e702597-bc60-4036-a03b-6863bcc3205f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:50.281164 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-f078a159-650f-4c83-9627-a2503800659b req-0e702597-bc60-4036-a03b-6863bcc3205f service nova] Creating event network-changed:cf48c84f-265d-4bc9-bdf9-a08c725b21ec for instance a1c78871-374e-41d9-af4a-d8284ccb8508 on n-h2-858272-3 Oct 05 02:52:50.293543 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-f078a159-650f-4c83-9627-a2503800659b req-0e702597-bc60-4036-a03b-6863bcc3205f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.577038 Oct 05 02:52:50.294502 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2463/4932] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:52:50.402316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6da5cab4-d0ac-43d4-9849-079b14c0b2dd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-113986263", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:52:50.755515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.security_group_api [None req-6da5cab4-d0ac-43d4-9849-079b14c0b2dd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Neutron security group does_not_exist not found {{(pid=122320) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 05 02:52:50.756309 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-6da5cab4-d0ac-43d4-9849-079b14c0b2dd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6da5cab4-d0ac-43d4-9849-079b14c0b2dd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 257 Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-113986263", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63"}]}} Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-113986263', 'imageRef': 'adad3215-1ca6-43bb-9981-0d01aff146ab', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63'}]}}} Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 05 02:52:50.765571 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 05 02:52:50.775205 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:50.789642 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6da5cab4-d0ac-43d4-9849-079b14c0b2dd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:52:50.792017 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6da5cab4-d0ac-43d4-9849-079b14c0b2dd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.391300 Oct 05 02:52:50.793357 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2464/4933] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:52:50 2022] POST /compute/v2.1/servers => generated 106 bytes in 398 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:52:50.805887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5e1c0cf4-9eef-4c56-ae0f-5f3314e7cb7b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:50.806930 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5e1c0cf4-9eef-4c56-ae0f-5f3314e7cb7b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:50.823548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e1c0cf4-9eef-4c56-ae0f-5f3314e7cb7b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:50.824530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e1c0cf4-9eef-4c56-ae0f-5f3314e7cb7b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:50.825403 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e1c0cf4-9eef-4c56-ae0f-5f3314e7cb7b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:50.826729 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e1c0cf4-9eef-4c56-ae0f-5f3314e7cb7b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:50.827461 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e1c0cf4-9eef-4c56-ae0f-5f3314e7cb7b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:50.829065 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e1c0cf4-9eef-4c56-ae0f-5f3314e7cb7b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:51.105985 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fc8859d7-b621-4188-a93b-6275eee80a4c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:51.127617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:52:51.127617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fc8859d7-b621-4188-a93b-6275eee80a4c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:51.130791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fc8859d7-b621-4188-a93b-6275eee80a4c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:51.133915 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fc8859d7-b621-4188-a93b-6275eee80a4c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 0.972685 Oct 05 02:52:51.135650 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2470/4934] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:50 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:52:51.433450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5e1c0cf4-9eef-4c56-ae0f-5f3314e7cb7b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:51.446906 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5e1c0cf4-9eef-4c56-ae0f-5f3314e7cb7b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.648690 Oct 05 02:52:51.465388 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2465/4935] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:50 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:51.471940 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7ed1d1e5-1db3-4811-bf14-1ec74ee8b0c5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:51.472550 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7ed1d1e5-1db3-4811-bf14-1ec74ee8b0c5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:51.480877 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ed1d1e5-1db3-4811-bf14-1ec74ee8b0c5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:51.481630 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ed1d1e5-1db3-4811-bf14-1ec74ee8b0c5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:51.482247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ed1d1e5-1db3-4811-bf14-1ec74ee8b0c5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:51.483135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ed1d1e5-1db3-4811-bf14-1ec74ee8b0c5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:51.483767 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ed1d1e5-1db3-4811-bf14-1ec74ee8b0c5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:51.484367 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ed1d1e5-1db3-4811-bf14-1ec74ee8b0c5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:52.048666 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7ed1d1e5-1db3-4811-bf14-1ec74ee8b0c5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:52.062085 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7ed1d1e5-1db3-4811-bf14-1ec74ee8b0c5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.593873 Oct 05 02:52:52.066038 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2471/4936] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:51 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:52.094593 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8de82794-c830-49ff-a2ab-5f6fb2949416 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:52.095644 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8de82794-c830-49ff-a2ab-5f6fb2949416 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 8d13bd72-ed1d-42a5-8c11-206559e204e6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:52.107893 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-8de82794-c830-49ff-a2ab-5f6fb2949416 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Instance 8d13bd72-ed1d-42a5-8c11-206559e204e6 could not be found. Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8de82794-c830-49ff-a2ab-5f6fb2949416 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/servers/8d13bd72-ed1d-42a5-8c11-206559e204e6 HTTP/1.1 Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 8d13bd72-ed1d-42a5-8c11-206559e204e6 could not be found. Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '8d13bd72-ed1d-42a5-8c11-206559e204e6'} Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d13bd72-ed1d-42a5-8c11-206559e204e6 could not be found. Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d13bd72-ed1d-42a5-8c11-206559e204e6 could not be found. Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:52.116333 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:52.122436 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:52.122436 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:52.122436 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:52.122436 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:52.122436 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:52:52.122436 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:52:52.122436 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d13bd72-ed1d-42a5-8c11-206559e204e6 could not be found. Oct 05 02:52:52.122436 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:52.127032 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8de82794-c830-49ff-a2ab-5f6fb2949416 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 404 to user: Instance 8d13bd72-ed1d-42a5-8c11-206559e204e6 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:52:52.128144 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8de82794-c830-49ff-a2ab-5f6fb2949416 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8d13bd72-ed1d-42a5-8c11-206559e204e6" status: 404 len: 111 microversion: 2.1 time: 0.037677 Oct 05 02:52:52.128920 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2466/4937] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:52:52 2022] DELETE /compute/v2.1/servers/8d13bd72-ed1d-42a5-8c11-206559e204e6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:52:52.138258 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c44885d4-1b93-4b67-8cb7-a2d9380e0925 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:52.139127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c44885d4-1b93-4b67-8cb7-a2d9380e0925 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:52.148376 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c44885d4-1b93-4b67-8cb7-a2d9380e0925 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:52.152104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c44885d4-1b93-4b67-8cb7-a2d9380e0925 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:52.152942 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c44885d4-1b93-4b67-8cb7-a2d9380e0925 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:52.153328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c44885d4-1b93-4b67-8cb7-a2d9380e0925 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:52.153785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c44885d4-1b93-4b67-8cb7-a2d9380e0925 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:52.154208 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c44885d4-1b93-4b67-8cb7-a2d9380e0925 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:52.167528 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-762015f4-c262-4863-8d25-26f43c407b6f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:52.168576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-762015f4-c262-4863-8d25-26f43c407b6f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:52.176727 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-762015f4-c262-4863-8d25-26f43c407b6f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:52.177679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-762015f4-c262-4863-8d25-26f43c407b6f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:52.178412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-762015f4-c262-4863-8d25-26f43c407b6f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:52.179422 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-762015f4-c262-4863-8d25-26f43c407b6f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:52.180111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-762015f4-c262-4863-8d25-26f43c407b6f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:52.181058 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-762015f4-c262-4863-8d25-26f43c407b6f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:53.082234 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c44885d4-1b93-4b67-8cb7-a2d9380e0925 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:53.097057 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c44885d4-1b93-4b67-8cb7-a2d9380e0925 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.962605 Oct 05 02:52:53.110025 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-762015f4-c262-4863-8d25-26f43c407b6f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:53.129070 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2472/4938] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:52 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:53.135689 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5f07896b-54e8-42cc-8669-93f57b3d10e2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:53.137445 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-762015f4-c262-4863-8d25-26f43c407b6f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:53.138155 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5f07896b-54e8-42cc-8669-93f57b3d10e2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:53.139162 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-762015f4-c262-4863-8d25-26f43c407b6f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:53.143514 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-762015f4-c262-4863-8d25-26f43c407b6f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 0.980191 Oct 05 02:52:53.144146 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2467/4939] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:52 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:52:53.161093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f07896b-54e8-42cc-8669-93f57b3d10e2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:53.161974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f07896b-54e8-42cc-8669-93f57b3d10e2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:53.171000 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f07896b-54e8-42cc-8669-93f57b3d10e2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:53.172052 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f07896b-54e8-42cc-8669-93f57b3d10e2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:53.172778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f07896b-54e8-42cc-8669-93f57b3d10e2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:53.173413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f07896b-54e8-42cc-8669-93f57b3d10e2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:53.734692 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5f07896b-54e8-42cc-8669-93f57b3d10e2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:53.742866 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5f07896b-54e8-42cc-8669-93f57b3d10e2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.612216 Oct 05 02:52:53.757492 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2473/4940] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:53 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:53.766753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a7454fca-b4cb-4ec8-a226-bafe9ade5d33 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:53.767666 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a7454fca-b4cb-4ec8-a226-bafe9ade5d33 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Failed to fetch instance by id 9223372036854775808 {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 05 02:52:53.768411 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-a7454fca-b4cb-4ec8-a226-bafe9ade5d33 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a7454fca-b4cb-4ec8-a226-bafe9ade5d33 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 9223372036854775808 could not be found. Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '9223372036854775808'} Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:53.770120 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:53.775238 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:53.775238 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:52:53.775238 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:52:53.775238 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 05 02:52:53.775238 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:53.777213 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a7454fca-b4cb-4ec8-a226-bafe9ade5d33 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:52:53.778425 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a7454fca-b4cb-4ec8-a226-bafe9ade5d33 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.015595 Oct 05 02:52:53.779552 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2468/4941] 10.222.0.16 () {58 vars in 1188 bytes} [Wed Oct 5 02:52:53 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:52:53.788148 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-13a752fb-c2ee-4004-abb1-7ce94a1f1b4f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:53.789137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-13a752fb-c2ee-4004-abb1-7ce94a1f1b4f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:53.795772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13a752fb-c2ee-4004-abb1-7ce94a1f1b4f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:53.795772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13a752fb-c2ee-4004-abb1-7ce94a1f1b4f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:53.796218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13a752fb-c2ee-4004-abb1-7ce94a1f1b4f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:53.796952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13a752fb-c2ee-4004-abb1-7ce94a1f1b4f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:53.797407 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13a752fb-c2ee-4004-abb1-7ce94a1f1b4f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:53.797830 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13a752fb-c2ee-4004-abb1-7ce94a1f1b4f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:54.157363 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-13a752fb-c2ee-4004-abb1-7ce94a1f1b4f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:54.176916 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4d559a6f-0dd3-453d-a51a-b3f23abcfee2 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:54.178292 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-13a752fb-c2ee-4004-abb1-7ce94a1f1b4f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.390652 Oct 05 02:52:54.179827 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4d559a6f-0dd3-453d-a51a-b3f23abcfee2 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:54.181182 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2474/4942] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:53 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:54.203928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d559a6f-0dd3-453d-a51a-b3f23abcfee2 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:54.204630 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d559a6f-0dd3-453d-a51a-b3f23abcfee2 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:54.210062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d559a6f-0dd3-453d-a51a-b3f23abcfee2 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:54.211281 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d559a6f-0dd3-453d-a51a-b3f23abcfee2 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:54.212040 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d559a6f-0dd3-453d-a51a-b3f23abcfee2 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:54.213806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-46e53505-c0b1-4224-994c-522c50786f20 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:54.214434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d559a6f-0dd3-453d-a51a-b3f23abcfee2 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:54.214928 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-46e53505-c0b1-4224-994c-522c50786f20 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:54.225771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46e53505-c0b1-4224-994c-522c50786f20 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:54.226599 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46e53505-c0b1-4224-994c-522c50786f20 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:54.228082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46e53505-c0b1-4224-994c-522c50786f20 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:54.230074 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46e53505-c0b1-4224-994c-522c50786f20 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:54.230984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46e53505-c0b1-4224-994c-522c50786f20 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:54.231786 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46e53505-c0b1-4224-994c-522c50786f20 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:54.852590 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-46e53505-c0b1-4224-994c-522c50786f20 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:54.867000 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-46e53505-c0b1-4224-994c-522c50786f20 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.664779 Oct 05 02:52:54.867642 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2475/4943] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:54 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:54.891770 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9c0b5278-abff-4ab6-9274-1ad97174b539 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:54.892310 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9c0b5278-abff-4ab6-9274-1ad97174b539 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Failed to fetch instance by id -1 {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 05 02:52:54.892882 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-9c0b5278-abff-4ab6-9274-1ad97174b539 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Instance -1 could not be found. Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9c0b5278-abff-4ab6-9274-1ad97174b539 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance -1 could not be found. Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '-1'} Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:54.895474 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:54.904461 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:52:54.904461 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:52:54.904461 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 05 02:52:54.904461 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:54.904461 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9c0b5278-abff-4ab6-9274-1ad97174b539 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 404 to user: Instance -1 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:52:54.904461 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9c0b5278-abff-4ab6-9274-1ad97174b539 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.010017 Oct 05 02:52:54.904461 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2476/4944] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 5 02:52:54 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:52:54.909061 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-15d591cd-9135-45fc-84ab-944dd7b70536 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:54.910010 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-15d591cd-9135-45fc-84ab-944dd7b70536 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:54.917818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15d591cd-9135-45fc-84ab-944dd7b70536 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:54.918647 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15d591cd-9135-45fc-84ab-944dd7b70536 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:54.919365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15d591cd-9135-45fc-84ab-944dd7b70536 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:54.920447 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15d591cd-9135-45fc-84ab-944dd7b70536 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:54.921188 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15d591cd-9135-45fc-84ab-944dd7b70536 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:54.921847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15d591cd-9135-45fc-84ab-944dd7b70536 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:54.992356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4d559a6f-0dd3-453d-a51a-b3f23abcfee2 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:55.010276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4d559a6f-0dd3-453d-a51a-b3f23abcfee2 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:55.012041 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4d559a6f-0dd3-453d-a51a-b3f23abcfee2 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:55.013639 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4d559a6f-0dd3-453d-a51a-b3f23abcfee2 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 0.841972 Oct 05 02:52:55.020811 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2469/4945] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:54 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:52:55.294748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-15d591cd-9135-45fc-84ab-944dd7b70536 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:55.317824 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-15d591cd-9135-45fc-84ab-944dd7b70536 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.415085 Oct 05 02:52:55.319475 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2477/4946] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:54 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:55.344506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-09ebcf3c-fe5f-43c1-87b0-eff622ff8bd6 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:55.345162 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-09ebcf3c-fe5f-43c1-87b0-eff622ff8bd6 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:55.355118 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09ebcf3c-fe5f-43c1-87b0-eff622ff8bd6 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:55.357079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09ebcf3c-fe5f-43c1-87b0-eff622ff8bd6 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:55.357554 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09ebcf3c-fe5f-43c1-87b0-eff622ff8bd6 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:55.358295 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09ebcf3c-fe5f-43c1-87b0-eff622ff8bd6 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:55.358760 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09ebcf3c-fe5f-43c1-87b0-eff622ff8bd6 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:55.359184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09ebcf3c-fe5f-43c1-87b0-eff622ff8bd6 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:55.674640 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-09ebcf3c-fe5f-43c1-87b0-eff622ff8bd6 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:55.688335 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-09ebcf3c-fe5f-43c1-87b0-eff622ff8bd6 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.347907 Oct 05 02:52:55.688963 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2470/4947] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:55 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:55.718100 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-560392c2-711f-4ed8-8c03-ab1a4486840a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:52:55.719469 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-560392c2-711f-4ed8-8c03-ab1a4486840a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: f04d8796-3e5a-4642-bb61-daf6a66ea5df] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:55.727507 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-560392c2-711f-4ed8-8c03-ab1a4486840a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Instance f04d8796-3e5a-4642-bb61-daf6a66ea5df could not be found. Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-560392c2-711f-4ed8-8c03-ab1a4486840a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers/f04d8796-3e5a-4642-bb61-daf6a66ea5df/action HTTP/1.1 Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 19 Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: {"forceDelete": {}} Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance f04d8796-3e5a-4642-bb61-daf6a66ea5df could not be found. Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'f04d8796-3e5a-4642-bb61-daf6a66ea5df', 'body': {'forceDelete': {}}} Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f04d8796-3e5a-4642-bb61-daf6a66ea5df could not be found. Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f04d8796-3e5a-4642-bb61-daf6a66ea5df could not be found. Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:55.735594 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:55.741448 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:52:55.741448 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:52:55.741448 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f04d8796-3e5a-4642-bb61-daf6a66ea5df could not be found. Oct 05 02:52:55.741448 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:55.741448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-560392c2-711f-4ed8-8c03-ab1a4486840a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 404 to user: Instance f04d8796-3e5a-4642-bb61-daf6a66ea5df could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:52:55.742281 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-560392c2-711f-4ed8-8c03-ab1a4486840a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers/f04d8796-3e5a-4642-bb61-daf6a66ea5df/action" status: 404 len: 111 microversion: 2.1 time: 0.028224 Oct 05 02:52:55.743545 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2478/4948] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:52:55 2022] POST /compute/v2.1/servers/f04d8796-3e5a-4642-bb61-daf6a66ea5df/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:52:55.751816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6175a444-2a47-494f-9343-4daf6cba4e7f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:55.752474 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6175a444-2a47-494f-9343-4daf6cba4e7f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:55.759276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6175a444-2a47-494f-9343-4daf6cba4e7f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:55.759782 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6175a444-2a47-494f-9343-4daf6cba4e7f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:55.760214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6175a444-2a47-494f-9343-4daf6cba4e7f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:55.761158 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6175a444-2a47-494f-9343-4daf6cba4e7f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:55.761821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6175a444-2a47-494f-9343-4daf6cba4e7f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:55.762424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6175a444-2a47-494f-9343-4daf6cba4e7f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:55.922744 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6175a444-2a47-494f-9343-4daf6cba4e7f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:55.931663 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6175a444-2a47-494f-9343-4daf6cba4e7f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.184018 Oct 05 02:52:55.948336 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2471/4949] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:55 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:55.957611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6ee46ca4-2ad7-47a8-927a-073a75191939 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:55.958681 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6ee46ca4-2ad7-47a8-927a-073a75191939 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:55.966660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ee46ca4-2ad7-47a8-927a-073a75191939 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:55.967513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ee46ca4-2ad7-47a8-927a-073a75191939 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:55.968353 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ee46ca4-2ad7-47a8-927a-073a75191939 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:55.969999 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ee46ca4-2ad7-47a8-927a-073a75191939 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:55.970713 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ee46ca4-2ad7-47a8-927a-073a75191939 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:55.971444 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ee46ca4-2ad7-47a8-927a-073a75191939 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:56.047018 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-be7675fa-8d7f-43df-afe0-13058b5f3b53 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:56.047800 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-be7675fa-8d7f-43df-afe0-13058b5f3b53 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:56.054684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be7675fa-8d7f-43df-afe0-13058b5f3b53 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:56.055265 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be7675fa-8d7f-43df-afe0-13058b5f3b53 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:56.055805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be7675fa-8d7f-43df-afe0-13058b5f3b53 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:56.056579 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be7675fa-8d7f-43df-afe0-13058b5f3b53 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:56.057315 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be7675fa-8d7f-43df-afe0-13058b5f3b53 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:56.057982 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be7675fa-8d7f-43df-afe0-13058b5f3b53 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:56.139643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6ee46ca4-2ad7-47a8-927a-073a75191939 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:56.150805 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6ee46ca4-2ad7-47a8-927a-073a75191939 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.196885 Oct 05 02:52:56.167521 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2479/4950] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:55 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:56.187606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cef86111-0875-4b0f-9b1d-a542a8ca9b9a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:52:56.195879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cef86111-0875-4b0f-9b1d-a542a8ca9b9a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 4a8e9aef-a1f7-4701-b4a7-35c39be66984] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:56.205929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:52:56.207673 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-cef86111-0875-4b0f-9b1d-a542a8ca9b9a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Instance 4a8e9aef-a1f7-4701-b4a7-35c39be66984 could not be found. Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cef86111-0875-4b0f-9b1d-a542a8ca9b9a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers/4a8e9aef-a1f7-4701-b4a7-35c39be66984/action HTTP/1.1 Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 39 Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: {"os-getConsoleOutput": {"length": 10}} Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 4a8e9aef-a1f7-4701-b4a7-35c39be66984 could not be found. Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '4a8e9aef-a1f7-4701-b4a7-35c39be66984', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a8e9aef-a1f7-4701-b4a7-35c39be66984 could not be found. Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a8e9aef-a1f7-4701-b4a7-35c39be66984 could not be found. Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:56.216008 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:56.224042 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:56.224042 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:56.224042 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:52:56.224042 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:52:56.224042 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a8e9aef-a1f7-4701-b4a7-35c39be66984 could not be found. Oct 05 02:52:56.224042 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:56.228597 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cef86111-0875-4b0f-9b1d-a542a8ca9b9a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 404 to user: Instance 4a8e9aef-a1f7-4701-b4a7-35c39be66984 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:52:56.253464 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cef86111-0875-4b0f-9b1d-a542a8ca9b9a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers/4a8e9aef-a1f7-4701-b4a7-35c39be66984/action" status: 404 len: 111 microversion: 2.1 time: 0.071177 Oct 05 02:52:56.253804 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2480/4951] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:52:56 2022] POST /compute/v2.1/servers/4a8e9aef-a1f7-4701-b4a7-35c39be66984/action => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:52:56.262316 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-db7f3c9a-c332-4ab9-99ce-8f9e831a3044 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:56.263181 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-db7f3c9a-c332-4ab9-99ce-8f9e831a3044 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:56.270710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db7f3c9a-c332-4ab9-99ce-8f9e831a3044 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:56.271994 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db7f3c9a-c332-4ab9-99ce-8f9e831a3044 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:56.272595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db7f3c9a-c332-4ab9-99ce-8f9e831a3044 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:56.273511 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db7f3c9a-c332-4ab9-99ce-8f9e831a3044 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:56.274133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db7f3c9a-c332-4ab9-99ce-8f9e831a3044 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:56.274733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db7f3c9a-c332-4ab9-99ce-8f9e831a3044 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:56.505493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-be7675fa-8d7f-43df-afe0-13058b5f3b53 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:56.538489 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-db7f3c9a-c332-4ab9-99ce-8f9e831a3044 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:56.542950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-be7675fa-8d7f-43df-afe0-13058b5f3b53 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:56.547809 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-db7f3c9a-c332-4ab9-99ce-8f9e831a3044 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.289309 Oct 05 02:52:56.549003 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2481/4952] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:56 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:52:56.550540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-be7675fa-8d7f-43df-afe0-13058b5f3b53 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:56.551843 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-be7675fa-8d7f-43df-afe0-13058b5f3b53 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 0.508999 Oct 05 02:52:56.558041 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2472/4953] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:56 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:52:56.575633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-11a2c7dd-53b3-4342-a9a4-f3be4803520d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:56.576476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-11a2c7dd-53b3-4342-a9a4-f3be4803520d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:56.583224 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11a2c7dd-53b3-4342-a9a4-f3be4803520d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:56.584504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11a2c7dd-53b3-4342-a9a4-f3be4803520d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:56.584982 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11a2c7dd-53b3-4342-a9a4-f3be4803520d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:56.585706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11a2c7dd-53b3-4342-a9a4-f3be4803520d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:56.586245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11a2c7dd-53b3-4342-a9a4-f3be4803520d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:56.586592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11a2c7dd-53b3-4342-a9a4-f3be4803520d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:56.766575 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-11a2c7dd-53b3-4342-a9a4-f3be4803520d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:56.778480 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-11a2c7dd-53b3-4342-a9a4-f3be4803520d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.206578 Oct 05 02:52:56.778871 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2482/4954] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:56 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:56.804998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f495d029-358f-442c-8bb3-c1c6ef42daf8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:56.806521 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f495d029-358f-442c-8bb3-c1c6ef42daf8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 63ec78e9-f950-4cd2-9d4c-436605532e1e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:56.812813 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-f495d029-358f-442c-8bb3-c1c6ef42daf8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Instance 63ec78e9-f950-4cd2-9d4c-436605532e1e could not be found. Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f495d029-358f-442c-8bb3-c1c6ef42daf8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/63ec78e9-f950-4cd2-9d4c-436605532e1e HTTP/1.1 Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 63ec78e9-f950-4cd2-9d4c-436605532e1e could not be found. Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '63ec78e9-f950-4cd2-9d4c-436605532e1e'} Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63ec78e9-f950-4cd2-9d4c-436605532e1e could not be found. Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63ec78e9-f950-4cd2-9d4c-436605532e1e could not be found. Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:56.814738 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:56.820774 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:56.820774 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:52:56.820774 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:52:56.820774 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63ec78e9-f950-4cd2-9d4c-436605532e1e could not be found. Oct 05 02:52:56.820774 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:56.822716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f495d029-358f-442c-8bb3-c1c6ef42daf8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 404 to user: Instance 63ec78e9-f950-4cd2-9d4c-436605532e1e could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:52:56.823834 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f495d029-358f-442c-8bb3-c1c6ef42daf8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/63ec78e9-f950-4cd2-9d4c-436605532e1e" status: 404 len: 111 microversion: 2.1 time: 0.023442 Oct 05 02:52:56.824638 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2473/4955] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:56 2022] GET /compute/v2.1/servers/63ec78e9-f950-4cd2-9d4c-436605532e1e => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:52:56.833454 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3c49be0c-d4bf-4867-bd4a-87ade86b1014 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:56.834103 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3c49be0c-d4bf-4867-bd4a-87ade86b1014 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:56.840984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c49be0c-d4bf-4867-bd4a-87ade86b1014 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:56.841449 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c49be0c-d4bf-4867-bd4a-87ade86b1014 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:56.842370 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c49be0c-d4bf-4867-bd4a-87ade86b1014 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:56.843167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c49be0c-d4bf-4867-bd4a-87ade86b1014 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:56.843702 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c49be0c-d4bf-4867-bd4a-87ade86b1014 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:56.844480 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c49be0c-d4bf-4867-bd4a-87ade86b1014 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:57.008385 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3c49be0c-d4bf-4867-bd4a-87ade86b1014 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:57.018232 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3c49be0c-d4bf-4867-bd4a-87ade86b1014 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.188606 Oct 05 02:52:57.034019 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2483/4956] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:56 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:57.054754 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-12fd9f27-31d0-4d94-a1b1-40bd047c3e04 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:57.055302 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-12fd9f27-31d0-4d94-a1b1-40bd047c3e04 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:57.070877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12fd9f27-31d0-4d94-a1b1-40bd047c3e04 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:57.074444 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12fd9f27-31d0-4d94-a1b1-40bd047c3e04 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:57.075402 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12fd9f27-31d0-4d94-a1b1-40bd047c3e04 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:57.076736 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12fd9f27-31d0-4d94-a1b1-40bd047c3e04 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:57.078236 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12fd9f27-31d0-4d94-a1b1-40bd047c3e04 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:57.079035 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12fd9f27-31d0-4d94-a1b1-40bd047c3e04 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:57.246201 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-12fd9f27-31d0-4d94-a1b1-40bd047c3e04 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:57.250363 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:52:57.256082 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-12fd9f27-31d0-4d94-a1b1-40bd047c3e04 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.205885 Oct 05 02:52:57.256757 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2474/4957] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:57 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:57.325968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8d3b7b80-1f7e-4710-b222-fe7799473636 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1729868057", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8d3b7b80-1f7e-4710-b222-fe7799473636 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 238 Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1729868057", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63"}]}} Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1729868057', 'imageRef': 'adad3215-1ca6-43bb-9981-0d01aff146ab', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63'}]}}} Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:57.346444 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:57.355964 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:57.355964 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:57.355964 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:52:57.355964 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:52:57.355964 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:52:57.355964 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:52:57.355964 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:52:57.355964 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:52:57.355964 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 02:52:57.355964 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 02:52:57.355964 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:52:57.355964 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:52:57.355964 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:52:57.355964 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:52:57.355964 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 05 02:52:57.355964 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:57.355964 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:57.355964 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:57.355964 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:57.355964 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:57.355964 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:57.355964 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:52:57.355964 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:52:57.355964 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 05 02:52:57.355964 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:52:57.355964 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8d3b7b80-1f7e-4710-b222-fe7799473636 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:52:57.355964 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8d3b7b80-1f7e-4710-b222-fe7799473636 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.026806 Oct 05 02:52:57.355964 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2484/4958] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:52:57 2022] POST /compute/v2.1/servers => generated 139 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:52:57.368552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-88a46005-68e5-4eb9-869a-cab838dc545e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:57.369165 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-88a46005-68e5-4eb9-869a-cab838dc545e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:57.378343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-88a46005-68e5-4eb9-869a-cab838dc545e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:57.378833 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-88a46005-68e5-4eb9-869a-cab838dc545e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:57.379267 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-88a46005-68e5-4eb9-869a-cab838dc545e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:57.379968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-88a46005-68e5-4eb9-869a-cab838dc545e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:57.380423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-88a46005-68e5-4eb9-869a-cab838dc545e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:57.381625 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-88a46005-68e5-4eb9-869a-cab838dc545e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:57.535869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-88a46005-68e5-4eb9-869a-cab838dc545e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:57.547671 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-88a46005-68e5-4eb9-869a-cab838dc545e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.191883 Oct 05 02:52:57.560043 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2475/4959] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:57 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:57.574127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d878a964-d7f3-495f-b796-d99ec923370d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:57.574758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d878a964-d7f3-495f-b796-d99ec923370d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:57.590568 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2c8e0411-4e02-42a8-a9a3-afc9c2b2eb93 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:57.591185 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2c8e0411-4e02-42a8-a9a3-afc9c2b2eb93 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:57.608887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c8e0411-4e02-42a8-a9a3-afc9c2b2eb93 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:57.609448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c8e0411-4e02-42a8-a9a3-afc9c2b2eb93 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:57.609892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c8e0411-4e02-42a8-a9a3-afc9c2b2eb93 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:57.610543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c8e0411-4e02-42a8-a9a3-afc9c2b2eb93 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:57.611008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c8e0411-4e02-42a8-a9a3-afc9c2b2eb93 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:57.611439 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2c8e0411-4e02-42a8-a9a3-afc9c2b2eb93 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:57.622128 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d878a964-d7f3-495f-b796-d99ec923370d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:57.622639 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d878a964-d7f3-495f-b796-d99ec923370d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:57.623469 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d878a964-d7f3-495f-b796-d99ec923370d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:57.624290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d878a964-d7f3-495f-b796-d99ec923370d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:57.624753 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d878a964-d7f3-495f-b796-d99ec923370d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:57.625506 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d878a964-d7f3-495f-b796-d99ec923370d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:58.384834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2c8e0411-4e02-42a8-a9a3-afc9c2b2eb93 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:58.405330 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2c8e0411-4e02-42a8-a9a3-afc9c2b2eb93 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:58.409109 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2c8e0411-4e02-42a8-a9a3-afc9c2b2eb93 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:58.410609 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2c8e0411-4e02-42a8-a9a3-afc9c2b2eb93 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 0.828043 Oct 05 02:52:58.413563 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2476/4960] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:57 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:52:58.445539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d878a964-d7f3-495f-b796-d99ec923370d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:58.455760 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d878a964-d7f3-495f-b796-d99ec923370d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.885497 Oct 05 02:52:58.456343 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2485/4961] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:57 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:58.530084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c82e381d-30fa-4f39-8f50-6947fcdd0d39 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-243572397", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c82e381d-30fa-4f39-8f50-6947fcdd0d39 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 234 Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-243572397", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63"}]}} Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-243572397', 'imageRef': 'adad3215-1ca6-43bb-9981-0d01aff146ab', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63'}]}}} Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:58.538069 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:58.543328 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:58.543328 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:58.543328 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:52:58.543328 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:52:58.543328 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:52:58.543328 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:52:58.543328 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:52:58.543328 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:52:58.543328 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 02:52:58.543328 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 02:52:58.543328 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:52:58.543328 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:52:58.543328 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:52:58.543328 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:52:58.543328 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 05 02:52:58.543328 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:58.543328 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:52:58.543328 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:58.543328 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:52:58.543328 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:52:58.543328 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:52:58.543328 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:52:58.543328 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:52:58.543328 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 05 02:52:58.543328 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:52:58.547413 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c82e381d-30fa-4f39-8f50-6947fcdd0d39 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:52:58.548700 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c82e381d-30fa-4f39-8f50-6947fcdd0d39 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.022522 Oct 05 02:52:58.558676 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-aeb288c9-04c5-4280-916f-261a68436b53 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:58.559786 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-aeb288c9-04c5-4280-916f-261a68436b53 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:58.565131 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2477/4962] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:52:58 2022] POST /compute/v2.1/servers => generated 133 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:52:58.569573 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aeb288c9-04c5-4280-916f-261a68436b53 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:58.570657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aeb288c9-04c5-4280-916f-261a68436b53 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:58.571356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aeb288c9-04c5-4280-916f-261a68436b53 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:58.573165 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aeb288c9-04c5-4280-916f-261a68436b53 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:58.574066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aeb288c9-04c5-4280-916f-261a68436b53 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:58.574767 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aeb288c9-04c5-4280-916f-261a68436b53 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:58.995029 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-aeb288c9-04c5-4280-916f-261a68436b53 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:52:59.005037 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-aeb288c9-04c5-4280-916f-261a68436b53 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.450821 Oct 05 02:52:59.010526 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2486/4963] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:58 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:52:59.030349 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-735470f8-18fd-4c20-baf6-59b2630b6ef8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:59.030969 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-735470f8-18fd-4c20-baf6-59b2630b6ef8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:59.039669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-735470f8-18fd-4c20-baf6-59b2630b6ef8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:59.040101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-735470f8-18fd-4c20-baf6-59b2630b6ef8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:59.040544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-735470f8-18fd-4c20-baf6-59b2630b6ef8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:59.041293 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-735470f8-18fd-4c20-baf6-59b2630b6ef8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:59.041750 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-735470f8-18fd-4c20-baf6-59b2630b6ef8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:59.042183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-735470f8-18fd-4c20-baf6-59b2630b6ef8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:59.442402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-712ea2b6-cc5a-4e3b-87fd-bfb4bf2a005d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:52:59.443758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-712ea2b6-cc5a-4e3b-87fd-bfb4bf2a005d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:52:59.454873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-712ea2b6-cc5a-4e3b-87fd-bfb4bf2a005d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:59.455310 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-712ea2b6-cc5a-4e3b-87fd-bfb4bf2a005d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:59.455756 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-712ea2b6-cc5a-4e3b-87fd-bfb4bf2a005d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:52:59.456473 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-712ea2b6-cc5a-4e3b-87fd-bfb4bf2a005d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:52:59.456989 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-712ea2b6-cc5a-4e3b-87fd-bfb4bf2a005d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:52:59.459920 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-712ea2b6-cc5a-4e3b-87fd-bfb4bf2a005d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:00.021050 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-735470f8-18fd-4c20-baf6-59b2630b6ef8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:00.033795 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-735470f8-18fd-4c20-baf6-59b2630b6ef8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 1.007150 Oct 05 02:53:00.034843 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2478/4964] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:52:59 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:00.063853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-74b26c2d-428e-4724-9064-e92eed1f55e2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:53:00.065368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-74b26c2d-428e-4724-9064-e92eed1f55e2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: af6d0bf7-30b9-4502-b1f8-eb2d5ae4984b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:00.080792 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-74b26c2d-428e-4724-9064-e92eed1f55e2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Instance af6d0bf7-30b9-4502-b1f8-eb2d5ae4984b could not be found. Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-74b26c2d-428e-4724-9064-e92eed1f55e2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers/af6d0bf7-30b9-4502-b1f8-eb2d5ae4984b/action HTTP/1.1 Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 13 Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: {"pause": {}} Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance af6d0bf7-30b9-4502-b1f8-eb2d5ae4984b could not be found. Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'af6d0bf7-30b9-4502-b1f8-eb2d5ae4984b', 'body': {'pause': {}}} Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af6d0bf7-30b9-4502-b1f8-eb2d5ae4984b could not be found. Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af6d0bf7-30b9-4502-b1f8-eb2d5ae4984b could not be found. Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:53:00.089406 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:53:00.094196 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:53:00.094196 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:53:00.094196 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af6d0bf7-30b9-4502-b1f8-eb2d5ae4984b could not be found. Oct 05 02:53:00.094196 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:53:00.096336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-74b26c2d-428e-4724-9064-e92eed1f55e2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 404 to user: Instance af6d0bf7-30b9-4502-b1f8-eb2d5ae4984b could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:53:00.098502 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-74b26c2d-428e-4724-9064-e92eed1f55e2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers/af6d0bf7-30b9-4502-b1f8-eb2d5ae4984b/action" status: 404 len: 111 microversion: 2.1 time: 0.039361 Oct 05 02:53:00.104015 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2479/4965] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:53:00 2022] POST /compute/v2.1/servers/af6d0bf7-30b9-4502-b1f8-eb2d5ae4984b/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:53:00.116300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f9cc818c-c267-4d4f-b918-5988417f41b9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:00.117495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f9cc818c-c267-4d4f-b918-5988417f41b9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:00.140549 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9cc818c-c267-4d4f-b918-5988417f41b9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:00.141402 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9cc818c-c267-4d4f-b918-5988417f41b9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:00.142046 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9cc818c-c267-4d4f-b918-5988417f41b9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:00.142956 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9cc818c-c267-4d4f-b918-5988417f41b9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:00.143593 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9cc818c-c267-4d4f-b918-5988417f41b9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:00.144212 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9cc818c-c267-4d4f-b918-5988417f41b9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:00.236774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-712ea2b6-cc5a-4e3b-87fd-bfb4bf2a005d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:00.280510 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-712ea2b6-cc5a-4e3b-87fd-bfb4bf2a005d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:00.293023 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-712ea2b6-cc5a-4e3b-87fd-bfb4bf2a005d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:00.294809 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-712ea2b6-cc5a-4e3b-87fd-bfb4bf2a005d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 0.856265 Oct 05 02:53:00.316808 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2487/4966] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:52:59 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:53:00.956195 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f9cc818c-c267-4d4f-b918-5988417f41b9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:00.971602 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f9cc818c-c267-4d4f-b918-5988417f41b9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.866235 Oct 05 02:53:00.985309 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2480/4967] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:00 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:01.000518 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1ff872ba-798a-4071-85ff-413c1abaaaae tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:01.001485 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1ff872ba-798a-4071-85ff-413c1abaaaae tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:01.015548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ff872ba-798a-4071-85ff-413c1abaaaae tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:01.016343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ff872ba-798a-4071-85ff-413c1abaaaae tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:01.017101 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ff872ba-798a-4071-85ff-413c1abaaaae tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:01.020217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ff872ba-798a-4071-85ff-413c1abaaaae tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:01.021086 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ff872ba-798a-4071-85ff-413c1abaaaae tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:01.022136 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ff872ba-798a-4071-85ff-413c1abaaaae tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:01.328442 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-909135a5-0e02-44c4-8f15-ae20eab8779c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:01.328442 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-909135a5-0e02-44c4-8f15-ae20eab8779c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:01.344099 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-909135a5-0e02-44c4-8f15-ae20eab8779c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:01.346071 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-909135a5-0e02-44c4-8f15-ae20eab8779c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:01.347444 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-909135a5-0e02-44c4-8f15-ae20eab8779c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:01.353530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-909135a5-0e02-44c4-8f15-ae20eab8779c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:01.354619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-909135a5-0e02-44c4-8f15-ae20eab8779c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:01.355664 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-909135a5-0e02-44c4-8f15-ae20eab8779c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:01.498144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1ff872ba-798a-4071-85ff-413c1abaaaae tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:01.506197 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1ff872ba-798a-4071-85ff-413c1abaaaae tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.511203 Oct 05 02:53:01.517655 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2488/4968] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:00 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:01.544186 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-72f85810-aca0-4a6f-b944-424a3ad4fcae tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:53:01.545266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-72f85810-aca0-4a6f-b944-424a3ad4fcae tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:01.555361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72f85810-aca0-4a6f-b944-424a3ad4fcae tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:01.556136 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72f85810-aca0-4a6f-b944-424a3ad4fcae tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:01.560459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72f85810-aca0-4a6f-b944-424a3ad4fcae tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:01.561427 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72f85810-aca0-4a6f-b944-424a3ad4fcae tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:01.562062 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72f85810-aca0-4a6f-b944-424a3ad4fcae tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:01.562654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72f85810-aca0-4a6f-b944-424a3ad4fcae tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:01.703728 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-72f85810-aca0-4a6f-b944-424a3ad4fcae tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec/action" status: 202 len: 0 microversion: 2.1 time: 0.163194 Oct 05 02:53:01.707237 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2489/4969] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:53:01 2022] POST /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 02:53:01.715675 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bc8c8a91-9f41-418e-a83f-b5211eeda12e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:01.721102 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bc8c8a91-9f41-418e-a83f-b5211eeda12e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:01.737287 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bc8c8a91-9f41-418e-a83f-b5211eeda12e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:01.738233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bc8c8a91-9f41-418e-a83f-b5211eeda12e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:01.738849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bc8c8a91-9f41-418e-a83f-b5211eeda12e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:01.742112 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bc8c8a91-9f41-418e-a83f-b5211eeda12e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:01.742796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bc8c8a91-9f41-418e-a83f-b5211eeda12e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:01.743662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bc8c8a91-9f41-418e-a83f-b5211eeda12e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:01.824856 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:02.136739 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bc8c8a91-9f41-418e-a83f-b5211eeda12e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:02.144820 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bc8c8a91-9f41-418e-a83f-b5211eeda12e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1509 microversion: 2.1 time: 0.436075 Oct 05 02:53:02.166601 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2490/4970] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:01 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1509 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:02.347030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-909135a5-0e02-44c4-8f15-ae20eab8779c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:02.362253 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-909135a5-0e02-44c4-8f15-ae20eab8779c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:02.364407 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-909135a5-0e02-44c4-8f15-ae20eab8779c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:02.367627 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-909135a5-0e02-44c4-8f15-ae20eab8779c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 1.043684 Oct 05 02:53:02.373561 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2481/4971] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:53:01 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:53:02.630088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9329ff23-fb15-483b-9953-3804a67b8f52 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-519486436", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:53:02.738494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-9329ff23-fb15-483b-9953-3804a67b8f52 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] validate_networks() for [('d1200f4f-a8c3-4656-8e56-90989f3cb8b8', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:53:03.169133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d99ce21e-4864-4727-b991-c3aa777edf04 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:03.170512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d99ce21e-4864-4727-b991-c3aa777edf04 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:03.178707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=62 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:03.180732 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d99ce21e-4864-4727-b991-c3aa777edf04 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:03.181457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d99ce21e-4864-4727-b991-c3aa777edf04 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:03.182051 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d99ce21e-4864-4727-b991-c3aa777edf04 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:03.183006 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d99ce21e-4864-4727-b991-c3aa777edf04 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:03.183449 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d99ce21e-4864-4727-b991-c3aa777edf04 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:03.187223 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d99ce21e-4864-4727-b991-c3aa777edf04 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:03.412220 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-9329ff23-fb15-483b-9953-3804a67b8f52 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:53:03.412955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-9329ff23-fb15-483b-9953-3804a67b8f52 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:53:03.413628 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-9329ff23-fb15-483b-9953-3804a67b8f52 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:53:03.414210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-9329ff23-fb15-483b-9953-3804a67b8f52 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:53:03.414821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-9329ff23-fb15-483b-9953-3804a67b8f52 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:53:03.426482 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9329ff23-fb15-483b-9953-3804a67b8f52 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:03.427299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9329ff23-fb15-483b-9953-3804a67b8f52 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:03.430239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9329ff23-fb15-483b-9953-3804a67b8f52 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:03.431701 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9329ff23-fb15-483b-9953-3804a67b8f52 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:03.438980 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9329ff23-fb15-483b-9953-3804a67b8f52 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:03.439441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9329ff23-fb15-483b-9953-3804a67b8f52 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:03.487869 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-9329ff23-fb15-483b-9953-3804a67b8f52 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Getting quotas for project 129b5343573f4f9fa648e984a68b6760. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:53:03.503278 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-9329ff23-fb15-483b-9953-3804a67b8f52 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Getting quotas for user a031e94db13d4e7e8947f51abc36d629 and project 129b5343573f4f9fa648e984a68b6760. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:53:03.537376 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9329ff23-fb15-483b-9953-3804a67b8f52 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:53:03.545734 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9329ff23-fb15-483b-9953-3804a67b8f52 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:53:03.579488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d99ce21e-4864-4727-b991-c3aa777edf04 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:03.588726 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d99ce21e-4864-4727-b991-c3aa777edf04 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1489 microversion: 2.1 time: 0.424168 Oct 05 02:53:03.592974 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2482/4972] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:03 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1489 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:53:03.600599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-34053469-faa1-4d61-b953-e54995b1913b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:03.601733 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-34053469-faa1-4d61-b953-e54995b1913b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:03.626131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34053469-faa1-4d61-b953-e54995b1913b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:03.629524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34053469-faa1-4d61-b953-e54995b1913b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:03.631482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34053469-faa1-4d61-b953-e54995b1913b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:03.635918 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34053469-faa1-4d61-b953-e54995b1913b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:03.636787 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34053469-faa1-4d61-b953-e54995b1913b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:03.637491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34053469-faa1-4d61-b953-e54995b1913b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:03.638147 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9329ff23-fb15-483b-9953-3804a67b8f52 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.113295 Oct 05 02:53:03.638803 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2491/4973] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:53:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 1115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:53:03.658455 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4d56616e-6ed0-4104-ae63-d57c8ebb1758 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:53:03.663962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4d56616e-6ed0-4104-ae63-d57c8ebb1758 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:03.679834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d56616e-6ed0-4104-ae63-d57c8ebb1758 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:03.680331 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d56616e-6ed0-4104-ae63-d57c8ebb1758 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:03.680785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d56616e-6ed0-4104-ae63-d57c8ebb1758 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:03.681518 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d56616e-6ed0-4104-ae63-d57c8ebb1758 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:03.686049 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d56616e-6ed0-4104-ae63-d57c8ebb1758 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:03.686595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d56616e-6ed0-4104-ae63-d57c8ebb1758 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:03.980088 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-34053469-faa1-4d61-b953-e54995b1913b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:04.005836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-34053469-faa1-4d61-b953-e54995b1913b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:04.008315 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-34053469-faa1-4d61-b953-e54995b1913b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:04.014563 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-34053469-faa1-4d61-b953-e54995b1913b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 0.419930 Oct 05 02:53:04.016265 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2483/4974] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:53:03 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:53:04.046434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ce8e11ec-1d67-4279-880c-b8a530a94177 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:04.050489 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ce8e11ec-1d67-4279-880c-b8a530a94177 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:04.110456 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-4d56616e-6ed0-4104-ae63-d57c8ebb1758 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Cannot 'pause' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state paused Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4d56616e-6ed0-4104-ae63-d57c8ebb1758 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec/action HTTP/1.1 Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 13 Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: {"pause": {}} Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: exception: Cannot 'pause' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state paused Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '1fded3d6-d275-4d50-a366-d19388f8aaec', 'body': {'pause': {}}} Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1fded3d6-d275-4d50-a366-d19388f8aaec in vm_state paused. Cannot pause while the instance is in this state. Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state paused Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:04.112835 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:53:04.121701 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:53:04.121701 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:53:04.121701 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:53:04.121701 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state paused Oct 05 02:53:04.121701 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:04.123795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4d56616e-6ed0-4104-ae63-d57c8ebb1758 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 409 to user: Cannot 'pause' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state paused {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:53:04.124927 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4d56616e-6ed0-4104-ae63-d57c8ebb1758 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec/action" status: 409 len: 143 microversion: 2.1 time: 0.485156 Oct 05 02:53:04.126526 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2492/4975] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:53:03 2022] POST /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec/action => generated 143 bytes in 487 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:53:04.141116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-46651d33-3a38-435b-9ad3-040362e91409 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:53:04.144692 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-46651d33-3a38-435b-9ad3-040362e91409 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:04.155933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46651d33-3a38-435b-9ad3-040362e91409 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:04.156643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46651d33-3a38-435b-9ad3-040362e91409 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:04.157309 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46651d33-3a38-435b-9ad3-040362e91409 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:04.158477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46651d33-3a38-435b-9ad3-040362e91409 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:04.159120 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46651d33-3a38-435b-9ad3-040362e91409 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:04.159734 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46651d33-3a38-435b-9ad3-040362e91409 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:04.222523 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ce8e11ec-1d67-4279-880c-b8a530a94177 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:04.252588 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ce8e11ec-1d67-4279-880c-b8a530a94177 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378" status: 200 len: 1221 microversion: 2.1 time: 0.227585 Oct 05 02:53:04.266974 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2484/4976] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:04 2022] GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378 => generated 1221 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:04.406193 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-46651d33-3a38-435b-9ad3-040362e91409 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec/action" status: 202 len: 0 microversion: 2.1 time: 0.255142 Oct 05 02:53:04.408102 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2493/4977] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:53:04 2022] POST /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 02:53:04.419893 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1f2d12ef-d9fb-4eb0-9dfb-8f462e2eeabb tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:04.421176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1f2d12ef-d9fb-4eb0-9dfb-8f462e2eeabb tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:04.432720 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1f2d12ef-d9fb-4eb0-9dfb-8f462e2eeabb tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:04.433861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1f2d12ef-d9fb-4eb0-9dfb-8f462e2eeabb tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:04.434548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1f2d12ef-d9fb-4eb0-9dfb-8f462e2eeabb tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:04.435483 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1f2d12ef-d9fb-4eb0-9dfb-8f462e2eeabb tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:04.436294 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1f2d12ef-d9fb-4eb0-9dfb-8f462e2eeabb tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:04.437057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1f2d12ef-d9fb-4eb0-9dfb-8f462e2eeabb tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:04.501566 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-027220dd-75d9-4dbf-80e5-620d31f4abbe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-539134213", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:53:04.634002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-027220dd-75d9-4dbf-80e5-620d31f4abbe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] validate_networks() for [('d1200f4f-a8c3-4656-8e56-90989f3cb8b8', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:53:05.097055 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1f2d12ef-d9fb-4eb0-9dfb-8f462e2eeabb tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:05.113151 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1f2d12ef-d9fb-4eb0-9dfb-8f462e2eeabb tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1496 microversion: 2.1 time: 0.699236 Oct 05 02:53:05.128939 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2485/4978] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:04 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1496 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:53:05.142332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a739d67d-3273-4c56-a359-5a7e9d80b200 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:05.142945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a739d67d-3273-4c56-a359-5a7e9d80b200 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:05.158153 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a739d67d-3273-4c56-a359-5a7e9d80b200 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:05.158649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a739d67d-3273-4c56-a359-5a7e9d80b200 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:05.164860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a739d67d-3273-4c56-a359-5a7e9d80b200 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:05.166854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a739d67d-3273-4c56-a359-5a7e9d80b200 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:05.168516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a739d67d-3273-4c56-a359-5a7e9d80b200 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:05.176364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a739d67d-3273-4c56-a359-5a7e9d80b200 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:05.625512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a739d67d-3273-4c56-a359-5a7e9d80b200 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:05.644345 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a739d67d-3273-4c56-a359-5a7e9d80b200 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:05.650251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a739d67d-3273-4c56-a359-5a7e9d80b200 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:05.655259 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a739d67d-3273-4c56-a359-5a7e9d80b200 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 0.522482 Oct 05 02:53:05.656324 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2486/4979] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:53:05 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:53:06.047754 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-027220dd-75d9-4dbf-80e5-620d31f4abbe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:53:06.048724 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-027220dd-75d9-4dbf-80e5-620d31f4abbe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:53:06.049243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-027220dd-75d9-4dbf-80e5-620d31f4abbe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:53:06.050159 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-027220dd-75d9-4dbf-80e5-620d31f4abbe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:53:06.051004 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-027220dd-75d9-4dbf-80e5-620d31f4abbe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:53:06.070829 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-027220dd-75d9-4dbf-80e5-620d31f4abbe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:06.074771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-027220dd-75d9-4dbf-80e5-620d31f4abbe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:06.075468 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-027220dd-75d9-4dbf-80e5-620d31f4abbe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:06.079175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-027220dd-75d9-4dbf-80e5-620d31f4abbe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:06.079973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-027220dd-75d9-4dbf-80e5-620d31f4abbe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:06.080582 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-027220dd-75d9-4dbf-80e5-620d31f4abbe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:06.139501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-96901f5b-7d8b-410f-8114-9af32482ff42 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:06.140990 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-027220dd-75d9-4dbf-80e5-620d31f4abbe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Getting quotas for project 129b5343573f4f9fa648e984a68b6760. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:53:06.141547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-96901f5b-7d8b-410f-8114-9af32482ff42 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:06.153611 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96901f5b-7d8b-410f-8114-9af32482ff42 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:06.153967 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-027220dd-75d9-4dbf-80e5-620d31f4abbe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Getting quotas for user a031e94db13d4e7e8947f51abc36d629 and project 129b5343573f4f9fa648e984a68b6760. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:53:06.154429 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96901f5b-7d8b-410f-8114-9af32482ff42 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:06.155058 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96901f5b-7d8b-410f-8114-9af32482ff42 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:06.157097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96901f5b-7d8b-410f-8114-9af32482ff42 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:06.158332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96901f5b-7d8b-410f-8114-9af32482ff42 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:06.160088 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96901f5b-7d8b-410f-8114-9af32482ff42 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:06.190373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-027220dd-75d9-4dbf-80e5-620d31f4abbe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:53:06.202844 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-027220dd-75d9-4dbf-80e5-620d31f4abbe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:53:06.282211 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-027220dd-75d9-4dbf-80e5-620d31f4abbe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.786147 Oct 05 02:53:06.283801 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2494/4980] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:53:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 1789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 02:53:06.296445 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-02b82063-60b1-4d29-8852-b9a3d46dcdfa tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:06.297114 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-02b82063-60b1-4d29-8852-b9a3d46dcdfa tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:06.447428 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-02b82063-60b1-4d29-8852-b9a3d46dcdfa tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:06.462789 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-02b82063-60b1-4d29-8852-b9a3d46dcdfa tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1221 microversion: 2.1 time: 0.167119 Oct 05 02:53:06.463454 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2495/4981] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:06 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1221 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:53:06.687529 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d5639081-3f56-4428-a167-2a21aa890ab9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:06.688198 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d5639081-3f56-4428-a167-2a21aa890ab9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:06.707022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5639081-3f56-4428-a167-2a21aa890ab9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:06.709322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5639081-3f56-4428-a167-2a21aa890ab9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:06.711490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5639081-3f56-4428-a167-2a21aa890ab9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:06.721928 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5639081-3f56-4428-a167-2a21aa890ab9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:06.726501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5639081-3f56-4428-a167-2a21aa890ab9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:06.728105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5639081-3f56-4428-a167-2a21aa890ab9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:07.417558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-96901f5b-7d8b-410f-8114-9af32482ff42 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:07.426118 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d5639081-3f56-4428-a167-2a21aa890ab9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:07.435736 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-96901f5b-7d8b-410f-8114-9af32482ff42 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 1.298989 Oct 05 02:53:07.436516 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2487/4982] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:06 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:07.440513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d5639081-3f56-4428-a167-2a21aa890ab9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:07.443680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d5639081-3f56-4428-a167-2a21aa890ab9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:07.445432 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d5639081-3f56-4428-a167-2a21aa890ab9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 0.766154 Oct 05 02:53:07.446202 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2496/4983] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:53:06 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:53:07.473417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e1b16070-c8b3-4109-be34-60d4c21fafbc tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:07.474932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e1b16070-c8b3-4109-be34-60d4c21fafbc tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:07.484853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1b16070-c8b3-4109-be34-60d4c21fafbc tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:07.485822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1b16070-c8b3-4109-be34-60d4c21fafbc tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:07.486530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1b16070-c8b3-4109-be34-60d4c21fafbc tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:07.487492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1b16070-c8b3-4109-be34-60d4c21fafbc tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:07.488150 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1b16070-c8b3-4109-be34-60d4c21fafbc tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:07.488748 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1b16070-c8b3-4109-be34-60d4c21fafbc tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:07.488884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-abdf6dc5-7d1d-4d14-89c1-37a57c14b7a0 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:07.491002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-abdf6dc5-7d1d-4d14-89c1-37a57c14b7a0 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:07.533111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abdf6dc5-7d1d-4d14-89c1-37a57c14b7a0 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:07.534056 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abdf6dc5-7d1d-4d14-89c1-37a57c14b7a0 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:07.534749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abdf6dc5-7d1d-4d14-89c1-37a57c14b7a0 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:07.536144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abdf6dc5-7d1d-4d14-89c1-37a57c14b7a0 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:07.537655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abdf6dc5-7d1d-4d14-89c1-37a57c14b7a0 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:07.538463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-abdf6dc5-7d1d-4d14-89c1-37a57c14b7a0 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:07.705072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-abdf6dc5-7d1d-4d14-89c1-37a57c14b7a0 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:07.716521 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-abdf6dc5-7d1d-4d14-89c1-37a57c14b7a0 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1217 microversion: 2.1 time: 0.229975 Oct 05 02:53:07.717549 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2497/4984] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:07 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1217 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:53:07.829020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e1b16070-c8b3-4109-be34-60d4c21fafbc tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:07.857521 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e1b16070-c8b3-4109-be34-60d4c21fafbc tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.391917 Oct 05 02:53:07.858710 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2488/4985] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:07 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:07.889011 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0fb4cc4d-f69a-4116-afb9-de8336ffc3a7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:53:07.892544 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0fb4cc4d-f69a-4116-afb9-de8336ffc3a7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 9133ea4e-7828-4227-a454-681cc3b7b695] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:07.908240 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0fb4cc4d-f69a-4116-afb9-de8336ffc3a7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:07.918854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0fb4cc4d-f69a-4116-afb9-de8336ffc3a7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:07.919731 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0fb4cc4d-f69a-4116-afb9-de8336ffc3a7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:07.920934 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0fb4cc4d-f69a-4116-afb9-de8336ffc3a7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:07.921778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0fb4cc4d-f69a-4116-afb9-de8336ffc3a7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:07.922497 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0fb4cc4d-f69a-4116-afb9-de8336ffc3a7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:07.962250 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-0fb4cc4d-f69a-4116-afb9-de8336ffc3a7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Instance 9133ea4e-7828-4227-a454-681cc3b7b695 could not be found. Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0fb4cc4d-f69a-4116-afb9-de8336ffc3a7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695/action HTTP/1.1 Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 28 Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: {"reboot": {"type": "SOFT"}} Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 9133ea4e-7828-4227-a454-681cc3b7b695 could not be found. Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '9133ea4e-7828-4227-a454-681cc3b7b695', 'body': {'reboot': {'type': 'SOFT'}}} Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9133ea4e-7828-4227-a454-681cc3b7b695 could not be found. Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:53:07.964362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:53:07.969025 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9133ea4e-7828-4227-a454-681cc3b7b695 could not be found. Oct 05 02:53:07.969025 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:07.969025 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:53:07.969025 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:07.969025 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:07.969025 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:53:07.969025 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:53:07.969025 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:53:07.969025 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:53:07.969025 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9133ea4e-7828-4227-a454-681cc3b7b695 could not be found. Oct 05 02:53:07.969025 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:07.972514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0fb4cc4d-f69a-4116-afb9-de8336ffc3a7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 404 to user: Instance 9133ea4e-7828-4227-a454-681cc3b7b695 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:53:07.973868 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0fb4cc4d-f69a-4116-afb9-de8336ffc3a7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695/action" status: 404 len: 111 microversion: 2.1 time: 0.090773 Oct 05 02:53:07.975103 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2498/4986] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:53:07 2022] POST /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695/action => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:53:07.993427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2736481c-11a5-4b44-8b3b-113ef1ec2360 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:07.996301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2736481c-11a5-4b44-8b3b-113ef1ec2360 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:08.020048 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2736481c-11a5-4b44-8b3b-113ef1ec2360 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:08.020554 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2736481c-11a5-4b44-8b3b-113ef1ec2360 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:08.024661 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2736481c-11a5-4b44-8b3b-113ef1ec2360 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:08.025407 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2736481c-11a5-4b44-8b3b-113ef1ec2360 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:08.026137 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2736481c-11a5-4b44-8b3b-113ef1ec2360 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:08.030437 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2736481c-11a5-4b44-8b3b-113ef1ec2360 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:08.479116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d08c5aa5-f426-457d-bc39-b04381a16a7f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:08.479739 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d08c5aa5-f426-457d-bc39-b04381a16a7f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:08.494837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d08c5aa5-f426-457d-bc39-b04381a16a7f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:08.496550 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d08c5aa5-f426-457d-bc39-b04381a16a7f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:08.499527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d08c5aa5-f426-457d-bc39-b04381a16a7f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:08.502735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d08c5aa5-f426-457d-bc39-b04381a16a7f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:08.505054 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d08c5aa5-f426-457d-bc39-b04381a16a7f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:08.508325 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d08c5aa5-f426-457d-bc39-b04381a16a7f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:08.919591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2736481c-11a5-4b44-8b3b-113ef1ec2360 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:08.927791 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2736481c-11a5-4b44-8b3b-113ef1ec2360 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.947840 Oct 05 02:53:08.940679 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2489/4987] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:07 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:08.949335 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f7b7d0f9-4cef-4c2a-9e63-e6dd732f75cc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:08.956316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f7b7d0f9-4cef-4c2a-9e63-e6dd732f75cc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:08.979794 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7b7d0f9-4cef-4c2a-9e63-e6dd732f75cc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:08.980961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7b7d0f9-4cef-4c2a-9e63-e6dd732f75cc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:08.981795 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7b7d0f9-4cef-4c2a-9e63-e6dd732f75cc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:08.982802 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7b7d0f9-4cef-4c2a-9e63-e6dd732f75cc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:08.984987 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7b7d0f9-4cef-4c2a-9e63-e6dd732f75cc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:08.985890 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f7b7d0f9-4cef-4c2a-9e63-e6dd732f75cc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:09.314961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f7b7d0f9-4cef-4c2a-9e63-e6dd732f75cc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:09.329372 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f7b7d0f9-4cef-4c2a-9e63-e6dd732f75cc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1279 microversion: 2.1 time: 0.388005 Oct 05 02:53:09.330401 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2490/4988] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:08 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1279 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:09.336449 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-db7e4f9f-ee59-4c51-83f0-edbd4c0efc5a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:09.341569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-db7e4f9f-ee59-4c51-83f0-edbd4c0efc5a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:09.361154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db7e4f9f-ee59-4c51-83f0-edbd4c0efc5a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:09.361669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db7e4f9f-ee59-4c51-83f0-edbd4c0efc5a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:09.362116 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db7e4f9f-ee59-4c51-83f0-edbd4c0efc5a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:09.362823 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db7e4f9f-ee59-4c51-83f0-edbd4c0efc5a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:09.363479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db7e4f9f-ee59-4c51-83f0-edbd4c0efc5a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:09.364097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db7e4f9f-ee59-4c51-83f0-edbd4c0efc5a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:09.687940 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d08c5aa5-f426-457d-bc39-b04381a16a7f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:09.704807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d08c5aa5-f426-457d-bc39-b04381a16a7f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:09.707498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d08c5aa5-f426-457d-bc39-b04381a16a7f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:09.710321 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d08c5aa5-f426-457d-bc39-b04381a16a7f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 1.236171 Oct 05 02:53:09.711106 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2499/4989] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:53:08 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:53:10.127178 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-db7e4f9f-ee59-4c51-83f0-edbd4c0efc5a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:10.141897 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-db7e4f9f-ee59-4c51-83f0-edbd4c0efc5a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.804336 Oct 05 02:53:10.143183 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2491/4990] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:09 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:10.166968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-915cfd40-0869-41e3-8b26-d7df62862d67 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:53:10.169425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-915cfd40-0869-41e3-8b26-d7df62862d67 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 3b817c89-63f3-458b-a91b-1f3d3f5da63c] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:10.177246 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-915cfd40-0869-41e3-8b26-d7df62862d67 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Instance 3b817c89-63f3-458b-a91b-1f3d3f5da63c could not be found. Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-915cfd40-0869-41e3-8b26-d7df62862d67 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers/3b817c89-63f3-458b-a91b-1f3d3f5da63c/action HTTP/1.1 Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 28 Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: {"reboot": {"type": "SOFT"}} Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 3b817c89-63f3-458b-a91b-1f3d3f5da63c could not be found. Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '3b817c89-63f3-458b-a91b-1f3d3f5da63c', 'body': {'reboot': {'type': 'SOFT'}}} Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b817c89-63f3-458b-a91b-1f3d3f5da63c could not be found. Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b817c89-63f3-458b-a91b-1f3d3f5da63c could not be found. Oct 05 02:53:10.178955 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:10.187661 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:53:10.187661 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:10.187661 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:10.187661 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:53:10.187661 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:53:10.187661 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:53:10.187661 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:53:10.187661 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b817c89-63f3-458b-a91b-1f3d3f5da63c could not be found. Oct 05 02:53:10.187661 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:10.187661 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-915cfd40-0869-41e3-8b26-d7df62862d67 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 404 to user: Instance 3b817c89-63f3-458b-a91b-1f3d3f5da63c could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:53:10.187661 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-915cfd40-0869-41e3-8b26-d7df62862d67 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers/3b817c89-63f3-458b-a91b-1f3d3f5da63c/action" status: 404 len: 111 microversion: 2.1 time: 0.017906 Oct 05 02:53:10.187661 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2500/4991] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:53:10 2022] POST /compute/v2.1/servers/3b817c89-63f3-458b-a91b-1f3d3f5da63c/action => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:53:10.190653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f2a2c253-03af-422f-b8d7-a5f1292e56e7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:10.190653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f2a2c253-03af-422f-b8d7-a5f1292e56e7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:10.202548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2a2c253-03af-422f-b8d7-a5f1292e56e7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:10.204877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2a2c253-03af-422f-b8d7-a5f1292e56e7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:10.205751 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2a2c253-03af-422f-b8d7-a5f1292e56e7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:10.206065 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2a2c253-03af-422f-b8d7-a5f1292e56e7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:10.206519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2a2c253-03af-422f-b8d7-a5f1292e56e7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:10.206941 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2a2c253-03af-422f-b8d7-a5f1292e56e7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:10.358873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9cd3526d-00b4-491a-972c-6cc65875b60c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:10.360340 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9cd3526d-00b4-491a-972c-6cc65875b60c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:10.384079 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cd3526d-00b4-491a-972c-6cc65875b60c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:10.384613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cd3526d-00b4-491a-972c-6cc65875b60c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:10.385882 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cd3526d-00b4-491a-972c-6cc65875b60c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:10.386620 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cd3526d-00b4-491a-972c-6cc65875b60c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:10.390481 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cd3526d-00b4-491a-972c-6cc65875b60c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:10.410821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cd3526d-00b4-491a-972c-6cc65875b60c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:10.596275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9cd3526d-00b4-491a-972c-6cc65875b60c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:10.623700 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9cd3526d-00b4-491a-972c-6cc65875b60c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1279 microversion: 2.1 time: 0.270352 Oct 05 02:53:10.640926 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2501/4992] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:10 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1279 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:53:10.641689 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f2a2c253-03af-422f-b8d7-a5f1292e56e7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:10.642202 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f2a2c253-03af-422f-b8d7-a5f1292e56e7 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.455748 Oct 05 02:53:10.642331 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2492/4993] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:10 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:10.673494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3968fbe5-8a9a-460a-a28c-a8a474553722 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:10.674127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3968fbe5-8a9a-460a-a28c-a8a474553722 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:10.681380 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3968fbe5-8a9a-460a-a28c-a8a474553722 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:10.682003 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3968fbe5-8a9a-460a-a28c-a8a474553722 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:10.682453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3968fbe5-8a9a-460a-a28c-a8a474553722 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:10.683172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3968fbe5-8a9a-460a-a28c-a8a474553722 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:10.683719 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3968fbe5-8a9a-460a-a28c-a8a474553722 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:10.684159 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3968fbe5-8a9a-460a-a28c-a8a474553722 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:10.738056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e024a02e-71b7-4694-945b-c842b01382ce tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:10.738684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e024a02e-71b7-4694-945b-c842b01382ce tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:10.751039 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e024a02e-71b7-4694-945b-c842b01382ce tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:10.751605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e024a02e-71b7-4694-945b-c842b01382ce tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:10.752054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e024a02e-71b7-4694-945b-c842b01382ce tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:10.757089 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e024a02e-71b7-4694-945b-c842b01382ce tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:10.757609 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e024a02e-71b7-4694-945b-c842b01382ce tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:10.758051 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e024a02e-71b7-4694-945b-c842b01382ce tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:11.901638 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3968fbe5-8a9a-460a-a28c-a8a474553722 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:11.925717 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3968fbe5-8a9a-460a-a28c-a8a474553722 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 1.256402 Oct 05 02:53:11.929013 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2502/4994] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:10 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:11.932533 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e024a02e-71b7-4694-945b-c842b01382ce tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:11.945559 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-203b6949-b953-4243-9ece-627bcaeb2098 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:11.946266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-203b6949-b953-4243-9ece-627bcaeb2098 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:11.947038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e024a02e-71b7-4694-945b-c842b01382ce tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:11.950362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e024a02e-71b7-4694-945b-c842b01382ce tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:11.952144 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e024a02e-71b7-4694-945b-c842b01382ce tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 1.218364 Oct 05 02:53:11.954416 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2493/4995] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:53:10 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:53:11.968432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-203b6949-b953-4243-9ece-627bcaeb2098 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:11.975706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-203b6949-b953-4243-9ece-627bcaeb2098 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:11.976705 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-203b6949-b953-4243-9ece-627bcaeb2098 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:11.977417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a0c37526-78c7-4f77-84fe-300cf9472800 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:53:11.977965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-203b6949-b953-4243-9ece-627bcaeb2098 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:11.978630 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-203b6949-b953-4243-9ece-627bcaeb2098 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:11.979239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-203b6949-b953-4243-9ece-627bcaeb2098 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:11.992652 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a0c37526-78c7-4f77-84fe-300cf9472800 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 9133ea4e-7828-4227-a454-681cc3b7b695] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:12.009218 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a0c37526-78c7-4f77-84fe-300cf9472800 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:12.011051 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a0c37526-78c7-4f77-84fe-300cf9472800 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:12.011621 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a0c37526-78c7-4f77-84fe-300cf9472800 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:12.013843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a0c37526-78c7-4f77-84fe-300cf9472800 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:12.014336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a0c37526-78c7-4f77-84fe-300cf9472800 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:12.015977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a0c37526-78c7-4f77-84fe-300cf9472800 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:12.044382 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-a0c37526-78c7-4f77-84fe-300cf9472800 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Instance 9133ea4e-7828-4227-a454-681cc3b7b695 could not be found. Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a0c37526-78c7-4f77-84fe-300cf9472800 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695/action HTTP/1.1 Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 65 Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: {"rebuild": {"imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab"}} Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 9133ea4e-7828-4227-a454-681cc3b7b695 could not be found. Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '9133ea4e-7828-4227-a454-681cc3b7b695', 'body': {'rebuild': {'imageRef': 'adad3215-1ca6-43bb-9981-0d01aff146ab'}}} Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9133ea4e-7828-4227-a454-681cc3b7b695 could not be found. Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 05 02:53:12.046586 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 05 02:53:12.052079 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 05 02:53:12.052079 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:53:12.052079 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:53:12.052079 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:53:12.052079 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:53:12.052079 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9133ea4e-7828-4227-a454-681cc3b7b695 could not be found. Oct 05 02:53:12.052079 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:53:12.052079 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:53:12.052079 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:53:12.052079 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:12.052079 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:53:12.052079 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:53:12.052079 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:53:12.052079 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:53:12.052079 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9133ea4e-7828-4227-a454-681cc3b7b695 could not be found. Oct 05 02:53:12.052079 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:53:12.056038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a0c37526-78c7-4f77-84fe-300cf9472800 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 404 to user: Instance 9133ea4e-7828-4227-a454-681cc3b7b695 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:53:12.057038 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a0c37526-78c7-4f77-84fe-300cf9472800 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695/action" status: 404 len: 111 microversion: 2.1 time: 0.101237 Oct 05 02:53:12.057791 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2494/4996] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:53:11 2022] POST /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695/action => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:53:12.065760 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-052ba9df-0c84-43f2-b2c0-9d9613bb0b6c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:12.066508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-052ba9df-0c84-43f2-b2c0-9d9613bb0b6c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:12.074331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-052ba9df-0c84-43f2-b2c0-9d9613bb0b6c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:12.074950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-052ba9df-0c84-43f2-b2c0-9d9613bb0b6c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:12.075488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-052ba9df-0c84-43f2-b2c0-9d9613bb0b6c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:12.076294 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-052ba9df-0c84-43f2-b2c0-9d9613bb0b6c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:12.076820 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-052ba9df-0c84-43f2-b2c0-9d9613bb0b6c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:12.077346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-052ba9df-0c84-43f2-b2c0-9d9613bb0b6c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:12.082066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:12.731743 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-052ba9df-0c84-43f2-b2c0-9d9613bb0b6c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:12.740845 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-203b6949-b953-4243-9ece-627bcaeb2098 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:12.744569 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-052ba9df-0c84-43f2-b2c0-9d9613bb0b6c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.682531 Oct 05 02:53:12.756260 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-203b6949-b953-4243-9ece-627bcaeb2098 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1321 microversion: 2.1 time: 0.825989 Oct 05 02:53:12.758021 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2495/4997] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:12 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:53:12.764573 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2503/4998] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:11 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1321 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:12.797712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-aaed2444-e590-4d25-865a-f878dc058f8a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:12.799829 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-aaed2444-e590-4d25-865a-f878dc058f8a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:12.831366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aaed2444-e590-4d25-865a-f878dc058f8a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:12.832056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aaed2444-e590-4d25-865a-f878dc058f8a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:12.840118 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aaed2444-e590-4d25-865a-f878dc058f8a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:12.842064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aaed2444-e590-4d25-865a-f878dc058f8a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:12.851870 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aaed2444-e590-4d25-865a-f878dc058f8a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:12.856538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aaed2444-e590-4d25-865a-f878dc058f8a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:12.984888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ec9fc7d1-9df6-4eb6-9a8f-549f3be6d4ca tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:12.986200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ec9fc7d1-9df6-4eb6-9a8f-549f3be6d4ca tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:13.012456 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec9fc7d1-9df6-4eb6-9a8f-549f3be6d4ca tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:13.013500 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec9fc7d1-9df6-4eb6-9a8f-549f3be6d4ca tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:13.014933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec9fc7d1-9df6-4eb6-9a8f-549f3be6d4ca tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:13.015861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec9fc7d1-9df6-4eb6-9a8f-549f3be6d4ca tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:13.019165 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec9fc7d1-9df6-4eb6-9a8f-549f3be6d4ca tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:13.019842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec9fc7d1-9df6-4eb6-9a8f-549f3be6d4ca tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:13.730883 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-aaed2444-e590-4d25-865a-f878dc058f8a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:13.757453 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-aaed2444-e590-4d25-865a-f878dc058f8a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.966203 Oct 05 02:53:13.758400 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2496/4999] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:12 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:13.787291 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-116ccc8c-34e5-409f-a56c-3b729d83afc0 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:53:13.795079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-116ccc8c-34e5-409f-a56c-3b729d83afc0 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 15d4f84f-1f0e-4227-a7d4-339bf01c844d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:13.804325 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-116ccc8c-34e5-409f-a56c-3b729d83afc0 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Instance 15d4f84f-1f0e-4227-a7d4-339bf01c844d could not be found. Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-116ccc8c-34e5-409f-a56c-3b729d83afc0 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers/15d4f84f-1f0e-4227-a7d4-339bf01c844d/action HTTP/1.1 Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 65 Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: {"rebuild": {"imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab"}} Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 15d4f84f-1f0e-4227-a7d4-339bf01c844d could not be found. Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '15d4f84f-1f0e-4227-a7d4-339bf01c844d', 'body': {'rebuild': {'imageRef': 'adad3215-1ca6-43bb-9981-0d01aff146ab'}}} Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15d4f84f-1f0e-4227-a7d4-339bf01c844d could not be found. Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 05 02:53:13.812471 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:53:13.821056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:53:13.821056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:53:13.821056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:53:13.821056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15d4f84f-1f0e-4227-a7d4-339bf01c844d could not be found. Oct 05 02:53:13.821056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:53:13.821056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:53:13.821056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:53:13.821056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:13.821056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:53:13.821056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:53:13.821056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:53:13.821056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:53:13.821056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15d4f84f-1f0e-4227-a7d4-339bf01c844d could not be found. Oct 05 02:53:13.821056 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:53:13.821056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-116ccc8c-34e5-409f-a56c-3b729d83afc0 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 404 to user: Instance 15d4f84f-1f0e-4227-a7d4-339bf01c844d could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:53:13.821056 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-116ccc8c-34e5-409f-a56c-3b729d83afc0 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers/15d4f84f-1f0e-4227-a7d4-339bf01c844d/action" status: 404 len: 111 microversion: 2.1 time: 0.032949 Oct 05 02:53:13.821056 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2497/5000] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:53:13 2022] POST /compute/v2.1/servers/15d4f84f-1f0e-4227-a7d4-339bf01c844d/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:53:13.825278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-88897f75-a810-437f-8880-84acf30ee891 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:13.830592 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-88897f75-a810-437f-8880-84acf30ee891 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:13.857152 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-88897f75-a810-437f-8880-84acf30ee891 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:13.859840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-88897f75-a810-437f-8880-84acf30ee891 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:13.860299 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-88897f75-a810-437f-8880-84acf30ee891 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:13.861076 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-88897f75-a810-437f-8880-84acf30ee891 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:13.861943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-88897f75-a810-437f-8880-84acf30ee891 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:13.862375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-88897f75-a810-437f-8880-84acf30ee891 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:14.252513 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:14.310927 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ec9fc7d1-9df6-4eb6-9a8f-549f3be6d4ca tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:14.327489 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ec9fc7d1-9df6-4eb6-9a8f-549f3be6d4ca tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:14.329348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ec9fc7d1-9df6-4eb6-9a8f-549f3be6d4ca tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:14.330747 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ec9fc7d1-9df6-4eb6-9a8f-549f3be6d4ca tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 1.350960 Oct 05 02:53:14.332851 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2504/5001] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:53:12 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:53:14.339838 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-bc99f93e-a749-4c33-be72-7747b2368a1d req-2784123b-9aed-41b7-ad9a-afbd4ea50786 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09ae93ee-8f09-4552-b933-ad3c7e157378", "tag": "4ea018df-dd40-468b-9dbd-6d8eb574258f"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:53:14.373943 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-bc99f93e-a749-4c33-be72-7747b2368a1d req-2784123b-9aed-41b7-ad9a-afbd4ea50786 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:14.374801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-bc99f93e-a749-4c33-be72-7747b2368a1d req-2784123b-9aed-41b7-ad9a-afbd4ea50786 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:14.380577 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-bc99f93e-a749-4c33-be72-7747b2368a1d req-2784123b-9aed-41b7-ad9a-afbd4ea50786 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:14.406543 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-bc99f93e-a749-4c33-be72-7747b2368a1d req-2784123b-9aed-41b7-ad9a-afbd4ea50786 service nova] Creating event network-changed:4ea018df-dd40-468b-9dbd-6d8eb574258f for instance 09ae93ee-8f09-4552-b933-ad3c7e157378 on n-h1-858272-3 Oct 05 02:53:14.434566 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-bc99f93e-a749-4c33-be72-7747b2368a1d req-2784123b-9aed-41b7-ad9a-afbd4ea50786 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098285 Oct 05 02:53:14.443961 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2505/5002] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:53:14.450070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2f1b5e85-719a-4421-9265-b52468c0ad09 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:14.452190 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2f1b5e85-719a-4421-9265-b52468c0ad09 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:14.463742 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f1b5e85-719a-4421-9265-b52468c0ad09 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:14.467193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f1b5e85-719a-4421-9265-b52468c0ad09 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:14.469442 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f1b5e85-719a-4421-9265-b52468c0ad09 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:14.470349 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f1b5e85-719a-4421-9265-b52468c0ad09 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:14.473402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f1b5e85-719a-4421-9265-b52468c0ad09 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:14.474124 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f1b5e85-719a-4421-9265-b52468c0ad09 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:14.509214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-88897f75-a810-437f-8880-84acf30ee891 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:14.524211 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-88897f75-a810-437f-8880-84acf30ee891 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1321 microversion: 2.1 time: 0.708299 Oct 05 02:53:14.525994 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2498/5003] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:13 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1321 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:14.969466 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2f1b5e85-719a-4421-9265-b52468c0ad09 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:14.983472 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2f1b5e85-719a-4421-9265-b52468c0ad09 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.533903 Oct 05 02:53:14.984565 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2506/5004] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:14 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:15.036267 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-705b422f-ffa0-4fee-b969-d30134115a0d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:15.038183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-705b422f-ffa0-4fee-b969-d30134115a0d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:15.059215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-705b422f-ffa0-4fee-b969-d30134115a0d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:15.059609 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-705b422f-ffa0-4fee-b969-d30134115a0d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:15.060077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-705b422f-ffa0-4fee-b969-d30134115a0d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:15.064818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-705b422f-ffa0-4fee-b969-d30134115a0d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:15.065070 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-705b422f-ffa0-4fee-b969-d30134115a0d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:15.068276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-705b422f-ffa0-4fee-b969-d30134115a0d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:15.363995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-16505022-13dd-45f6-b37b-a2dbdc1538c4 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:15.365324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-16505022-13dd-45f6-b37b-a2dbdc1538c4 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:15.373489 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-16505022-13dd-45f6-b37b-a2dbdc1538c4 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:15.376059 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-16505022-13dd-45f6-b37b-a2dbdc1538c4 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:15.376770 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-16505022-13dd-45f6-b37b-a2dbdc1538c4 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:15.379796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-16505022-13dd-45f6-b37b-a2dbdc1538c4 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:15.385568 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-16505022-13dd-45f6-b37b-a2dbdc1538c4 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:15.386219 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-16505022-13dd-45f6-b37b-a2dbdc1538c4 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:15.913528 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-705b422f-ffa0-4fee-b969-d30134115a0d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:15.925433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-16505022-13dd-45f6-b37b-a2dbdc1538c4 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:15.928853 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-705b422f-ffa0-4fee-b969-d30134115a0d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.896645 Oct 05 02:53:15.936811 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2499/5005] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:15 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:15.944877 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-16505022-13dd-45f6-b37b-a2dbdc1538c4 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:15.946624 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-16505022-13dd-45f6-b37b-a2dbdc1538c4 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:15.947953 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-16505022-13dd-45f6-b37b-a2dbdc1538c4 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 0.589679 Oct 05 02:53:15.948929 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6f09fdb8-5d67-46b5-b52d-50d3b5623ede tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:15.949576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6f09fdb8-5d67-46b5-b52d-50d3b5623ede tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:15.952826 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2507/5006] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:53:15 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:53:15.997113 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f09fdb8-5d67-46b5-b52d-50d3b5623ede tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:15.997868 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f09fdb8-5d67-46b5-b52d-50d3b5623ede tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:15.998498 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f09fdb8-5d67-46b5-b52d-50d3b5623ede tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:15.999450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f09fdb8-5d67-46b5-b52d-50d3b5623ede tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:16.001564 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f09fdb8-5d67-46b5-b52d-50d3b5623ede tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:16.003251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f09fdb8-5d67-46b5-b52d-50d3b5623ede tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:16.116484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=4 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:16.379450 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-e430e0b3-1db3-4e63-bf6c-958cdd90c5c2 req-dd164aad-d462-4356-b6d7-568b4a523e94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ef11e58-0680-4e15-aa40-a4043a5a357a", "name": "network-vif-plugged", "status": "completed", "tag": "384505a1-ac43-4ab5-a021-9305e81770ae"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:53:16.410339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e430e0b3-1db3-4e63-bf6c-958cdd90c5c2 req-dd164aad-d462-4356-b6d7-568b4a523e94 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:16.415654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e430e0b3-1db3-4e63-bf6c-958cdd90c5c2 req-dd164aad-d462-4356-b6d7-568b4a523e94 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:16.416300 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e430e0b3-1db3-4e63-bf6c-958cdd90c5c2 req-dd164aad-d462-4356-b6d7-568b4a523e94 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:16.435283 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-e430e0b3-1db3-4e63-bf6c-958cdd90c5c2 req-dd164aad-d462-4356-b6d7-568b4a523e94 service nova] Creating event network-vif-plugged:384505a1-ac43-4ab5-a021-9305e81770ae for instance 2ef11e58-0680-4e15-aa40-a4043a5a357a on n-h1-858272-3 Oct 05 02:53:16.451633 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-e430e0b3-1db3-4e63-bf6c-958cdd90c5c2 req-dd164aad-d462-4356-b6d7-568b4a523e94 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.497230 Oct 05 02:53:16.454133 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2508/5007] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:53:16.463698 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=14 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:16.475018 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-90970f39-025d-497b-8059-ea39da21a85f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:53:16.477646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-90970f39-025d-497b-8059-ea39da21a85f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 31faba34-1ed4-49a5-ba18-8d1a0446e781] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:16.485450 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-90970f39-025d-497b-8059-ea39da21a85f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Instance 31faba34-1ed4-49a5-ba18-8d1a0446e781 could not be found. Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-90970f39-025d-497b-8059-ea39da21a85f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers/31faba34-1ed4-49a5-ba18-8d1a0446e781/action HTTP/1.1 Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 15 Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: {"restore": {}} Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 31faba34-1ed4-49a5-ba18-8d1a0446e781 could not be found. Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '31faba34-1ed4-49a5-ba18-8d1a0446e781', 'body': {'restore': {}}} Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31faba34-1ed4-49a5-ba18-8d1a0446e781 could not be found. Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31faba34-1ed4-49a5-ba18-8d1a0446e781 could not be found. Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:53:16.487632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:53:16.502973 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:53:16.502973 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:53:16.502973 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31faba34-1ed4-49a5-ba18-8d1a0446e781 could not be found. Oct 05 02:53:16.502973 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:16.502973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-90970f39-025d-497b-8059-ea39da21a85f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 404 to user: Instance 31faba34-1ed4-49a5-ba18-8d1a0446e781 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:53:16.502973 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-90970f39-025d-497b-8059-ea39da21a85f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers/31faba34-1ed4-49a5-ba18-8d1a0446e781/action" status: 404 len: 111 microversion: 2.1 time: 0.032586 Oct 05 02:53:16.502973 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2509/5008] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:53:16 2022] POST /compute/v2.1/servers/31faba34-1ed4-49a5-ba18-8d1a0446e781/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:53:16.506315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-badbc7a4-4048-45d0-9154-fa1c247f777a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:16.506315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-badbc7a4-4048-45d0-9154-fa1c247f777a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:16.515439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-badbc7a4-4048-45d0-9154-fa1c247f777a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:16.516567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-badbc7a4-4048-45d0-9154-fa1c247f777a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:16.518337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-badbc7a4-4048-45d0-9154-fa1c247f777a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:16.518337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-badbc7a4-4048-45d0-9154-fa1c247f777a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:16.518337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-badbc7a4-4048-45d0-9154-fa1c247f777a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:16.519421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-badbc7a4-4048-45d0-9154-fa1c247f777a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:16.785423 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-badbc7a4-4048-45d0-9154-fa1c247f777a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:16.801657 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-badbc7a4-4048-45d0-9154-fa1c247f777a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.299366 Oct 05 02:53:16.805616 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2510/5009] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:16 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:16.831565 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-5e4ad239-5812-4ce9-83d2-cfb8305fa8b4 req-ad265aed-db90-408a-90d1-a98f524796e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3551a7d0-74d1-41e5-9cb9-252aeb256b95", "tag": "f45eaf3b-7876-4462-b755-dff2d9fa8a45"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:53:16.860033 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5e4ad239-5812-4ce9-83d2-cfb8305fa8b4 req-ad265aed-db90-408a-90d1-a98f524796e3 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:16.860760 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5e4ad239-5812-4ce9-83d2-cfb8305fa8b4 req-ad265aed-db90-408a-90d1-a98f524796e3 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:16.865591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5e4ad239-5812-4ce9-83d2-cfb8305fa8b4 req-ad265aed-db90-408a-90d1-a98f524796e3 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:16.898347 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-5e4ad239-5812-4ce9-83d2-cfb8305fa8b4 req-ad265aed-db90-408a-90d1-a98f524796e3 service nova] Creating event network-changed:f45eaf3b-7876-4462-b755-dff2d9fa8a45 for instance 3551a7d0-74d1-41e5-9cb9-252aeb256b95 on n-h2-858272-3 Oct 05 02:53:16.921751 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-5e4ad239-5812-4ce9-83d2-cfb8305fa8b4 req-ad265aed-db90-408a-90d1-a98f524796e3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110337 Oct 05 02:53:16.922982 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2511/5010] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:53:16.944645 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c2d29553-d0ac-4b29-b0bb-7ba20ff39544 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:16.945425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c2d29553-d0ac-4b29-b0bb-7ba20ff39544 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:16.963830 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2d29553-d0ac-4b29-b0bb-7ba20ff39544 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:16.967306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2d29553-d0ac-4b29-b0bb-7ba20ff39544 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:16.967970 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2d29553-d0ac-4b29-b0bb-7ba20ff39544 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:16.972239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2d29553-d0ac-4b29-b0bb-7ba20ff39544 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:16.972864 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2d29553-d0ac-4b29-b0bb-7ba20ff39544 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:16.973415 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2d29553-d0ac-4b29-b0bb-7ba20ff39544 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:17.014368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6f09fdb8-5d67-46b5-b52d-50d3b5623ede tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:17.038848 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6f09fdb8-5d67-46b5-b52d-50d3b5623ede tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1321 microversion: 2.1 time: 1.100536 Oct 05 02:53:17.044930 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2500/5011] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:15 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1321 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:17.078696 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-32acd3a3-1289-40cb-baef-13d1ef3b93df tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:17.082196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-32acd3a3-1289-40cb-baef-13d1ef3b93df tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:17.096310 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32acd3a3-1289-40cb-baef-13d1ef3b93df tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:17.096995 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32acd3a3-1289-40cb-baef-13d1ef3b93df tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:17.101605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32acd3a3-1289-40cb-baef-13d1ef3b93df tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:17.102560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32acd3a3-1289-40cb-baef-13d1ef3b93df tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:17.103155 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32acd3a3-1289-40cb-baef-13d1ef3b93df tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:17.103691 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32acd3a3-1289-40cb-baef-13d1ef3b93df tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:17.370820 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c2d29553-d0ac-4b29-b0bb-7ba20ff39544 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:17.390773 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c2d29553-d0ac-4b29-b0bb-7ba20ff39544 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.459815 Oct 05 02:53:17.410722 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2512/5012] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:16 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:17.429492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ef56ddae-6a8f-4dba-a887-65a0b5053bef tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:53:17.438223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ef56ddae-6a8f-4dba-a887-65a0b5053bef tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:17.450597 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef56ddae-6a8f-4dba-a887-65a0b5053bef tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:17.453222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef56ddae-6a8f-4dba-a887-65a0b5053bef tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:17.457123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef56ddae-6a8f-4dba-a887-65a0b5053bef tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:17.457727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef56ddae-6a8f-4dba-a887-65a0b5053bef tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:17.461004 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef56ddae-6a8f-4dba-a887-65a0b5053bef tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:17.461576 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef56ddae-6a8f-4dba-a887-65a0b5053bef tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:17.513564 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:17.559864 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-ef56ddae-6a8f-4dba-a887-65a0b5053bef tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Cannot 'restore' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state active Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ef56ddae-6a8f-4dba-a887-65a0b5053bef tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec/action HTTP/1.1 Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 15 Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: {"restore": {}} Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: exception: Cannot 'restore' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state active Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '1fded3d6-d275-4d50-a366-d19388f8aaec', 'body': {'restore': {}}} Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1fded3d6-d275-4d50-a366-d19388f8aaec in vm_state active. Cannot restore while the instance is in this state. Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state active Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:17.566342 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:53:17.572464 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:53:17.572464 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:53:17.572464 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:53:17.572464 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state active Oct 05 02:53:17.572464 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:17.572464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ef56ddae-6a8f-4dba-a887-65a0b5053bef tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 409 to user: Cannot 'restore' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state active {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:53:17.575646 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ef56ddae-6a8f-4dba-a887-65a0b5053bef tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec/action" status: 409 len: 145 microversion: 2.1 time: 0.155173 Oct 05 02:53:17.582154 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2513/5013] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:53:17 2022] POST /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec/action => generated 145 bytes in 163 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:53:17.597427 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-71c79853-22e0-43b0-a9d5-6e794e9de0b9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:17.601683 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-71c79853-22e0-43b0-a9d5-6e794e9de0b9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:17.633193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71c79853-22e0-43b0-a9d5-6e794e9de0b9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:17.637604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71c79853-22e0-43b0-a9d5-6e794e9de0b9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:17.642042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71c79853-22e0-43b0-a9d5-6e794e9de0b9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:17.647145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71c79853-22e0-43b0-a9d5-6e794e9de0b9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:17.651673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71c79853-22e0-43b0-a9d5-6e794e9de0b9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:17.652550 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71c79853-22e0-43b0-a9d5-6e794e9de0b9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:18.454132 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-32acd3a3-1289-40cb-baef-13d1ef3b93df tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:18.478872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-32acd3a3-1289-40cb-baef-13d1ef3b93df tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:18.484155 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-32acd3a3-1289-40cb-baef-13d1ef3b93df tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:18.486119 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-32acd3a3-1289-40cb-baef-13d1ef3b93df tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 1.423889 Oct 05 02:53:18.487810 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2501/5014] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:53:17 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:53:18.499420 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-16c0b919-d9b3-4773-91dd-d470c0afbd22 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:18.501375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-16c0b919-d9b3-4773-91dd-d470c0afbd22 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:18.517345 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16c0b919-d9b3-4773-91dd-d470c0afbd22 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:18.519523 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16c0b919-d9b3-4773-91dd-d470c0afbd22 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:18.520259 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16c0b919-d9b3-4773-91dd-d470c0afbd22 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:18.521902 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16c0b919-d9b3-4773-91dd-d470c0afbd22 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:18.524174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16c0b919-d9b3-4773-91dd-d470c0afbd22 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:18.524886 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16c0b919-d9b3-4773-91dd-d470c0afbd22 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:18.526254 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-71c79853-22e0-43b0-a9d5-6e794e9de0b9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:18.534589 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-71c79853-22e0-43b0-a9d5-6e794e9de0b9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.945585 Oct 05 02:53:18.535675 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2514/5015] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:17 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:18.570863 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c6c609d5-2df6-489b-8fe7-f1d4c0d03d1a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:18.571770 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c6c609d5-2df6-489b-8fe7-f1d4c0d03d1a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:18.584595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6c609d5-2df6-489b-8fe7-f1d4c0d03d1a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:18.585503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6c609d5-2df6-489b-8fe7-f1d4c0d03d1a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:18.586176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6c609d5-2df6-489b-8fe7-f1d4c0d03d1a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:18.587112 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6c609d5-2df6-489b-8fe7-f1d4c0d03d1a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:18.589415 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6c609d5-2df6-489b-8fe7-f1d4c0d03d1a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:18.592679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6c609d5-2df6-489b-8fe7-f1d4c0d03d1a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:19.430595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c6c609d5-2df6-489b-8fe7-f1d4c0d03d1a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:19.469592 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c6c609d5-2df6-489b-8fe7-f1d4c0d03d1a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.899611 Oct 05 02:53:19.473159 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2515/5016] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:18 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:19.510702 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e7bd8ef6-ba58-4c29-a17f-d27256c2a563 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:53:19.511254 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e7bd8ef6-ba58-4c29-a17f-d27256c2a563 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 254e2f8f-d8d2-49f3-aa7d-7d510eb33d79] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:19.523839 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:19.540036 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-e7bd8ef6-ba58-4c29-a17f-d27256c2a563 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Instance 254e2f8f-d8d2-49f3-aa7d-7d510eb33d79 could not be found. Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e7bd8ef6-ba58-4c29-a17f-d27256c2a563 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers/254e2f8f-d8d2-49f3-aa7d-7d510eb33d79/action HTTP/1.1 Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 14 Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: {"resume": {}} Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 254e2f8f-d8d2-49f3-aa7d-7d510eb33d79 could not be found. Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '254e2f8f-d8d2-49f3-aa7d-7d510eb33d79', 'body': {'resume': {}}} Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 254e2f8f-d8d2-49f3-aa7d-7d510eb33d79 could not be found. Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 254e2f8f-d8d2-49f3-aa7d-7d510eb33d79 could not be found. Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:53:19.548045 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:53:19.553968 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:53:19.553968 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:53:19.553968 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 254e2f8f-d8d2-49f3-aa7d-7d510eb33d79 could not be found. Oct 05 02:53:19.553968 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:19.553968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e7bd8ef6-ba58-4c29-a17f-d27256c2a563 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 404 to user: Instance 254e2f8f-d8d2-49f3-aa7d-7d510eb33d79 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:53:19.553968 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e7bd8ef6-ba58-4c29-a17f-d27256c2a563 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers/254e2f8f-d8d2-49f3-aa7d-7d510eb33d79/action" status: 404 len: 111 microversion: 2.1 time: 0.050957 Oct 05 02:53:19.553968 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2516/5017] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:53:19 2022] POST /compute/v2.1/servers/254e2f8f-d8d2-49f3-aa7d-7d510eb33d79/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:53:19.563324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-434339aa-d00a-4759-89fd-2ece4cd4e526 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:19.563935 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-434339aa-d00a-4759-89fd-2ece4cd4e526 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:19.593410 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-434339aa-d00a-4759-89fd-2ece4cd4e526 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:19.594306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-434339aa-d00a-4759-89fd-2ece4cd4e526 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:19.595001 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-434339aa-d00a-4759-89fd-2ece4cd4e526 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:19.596103 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-434339aa-d00a-4759-89fd-2ece4cd4e526 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:19.596940 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-434339aa-d00a-4759-89fd-2ece4cd4e526 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:19.597600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-434339aa-d00a-4759-89fd-2ece4cd4e526 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:19.756990 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-16c0b919-d9b3-4773-91dd-d470c0afbd22 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:19.767009 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-16c0b919-d9b3-4773-91dd-d470c0afbd22 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1321 microversion: 2.1 time: 1.277009 Oct 05 02:53:19.768968 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2502/5018] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:18 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1321 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:19.794723 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4e75cb9c-9a64-4c9c-991a-7789f725600e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:19.795368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4e75cb9c-9a64-4c9c-991a-7789f725600e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:19.820598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e75cb9c-9a64-4c9c-991a-7789f725600e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:19.825161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e75cb9c-9a64-4c9c-991a-7789f725600e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:19.825933 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e75cb9c-9a64-4c9c-991a-7789f725600e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:19.830988 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e75cb9c-9a64-4c9c-991a-7789f725600e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:19.831788 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e75cb9c-9a64-4c9c-991a-7789f725600e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:19.837048 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e75cb9c-9a64-4c9c-991a-7789f725600e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:20.393140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-434339aa-d00a-4759-89fd-2ece4cd4e526 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:20.412586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-434339aa-d00a-4759-89fd-2ece4cd4e526 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:20.414445 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-434339aa-d00a-4759-89fd-2ece4cd4e526 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:20.415757 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-434339aa-d00a-4759-89fd-2ece4cd4e526 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 0.860224 Oct 05 02:53:20.416427 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2517/5019] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:53:19 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:53:20.469559 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4e75cb9c-9a64-4c9c-991a-7789f725600e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:20.503136 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4e75cb9c-9a64-4c9c-991a-7789f725600e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.732507 Oct 05 02:53:20.509384 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2503/5020] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:19 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:20.533710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b4bbd147-cd7b-45b4-b46e-07f930a206bd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:20.534546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b4bbd147-cd7b-45b4-b46e-07f930a206bd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:20.548652 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4bbd147-cd7b-45b4-b46e-07f930a206bd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:20.549934 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4bbd147-cd7b-45b4-b46e-07f930a206bd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:20.552166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4bbd147-cd7b-45b4-b46e-07f930a206bd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:20.562527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4bbd147-cd7b-45b4-b46e-07f930a206bd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:20.563217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4bbd147-cd7b-45b4-b46e-07f930a206bd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:20.563953 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4bbd147-cd7b-45b4-b46e-07f930a206bd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:20.800315 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7c182e4d-dab2-4b4c-995c-9d976bf2a39f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:20.801066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7c182e4d-dab2-4b4c-995c-9d976bf2a39f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:20.820030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c182e4d-dab2-4b4c-995c-9d976bf2a39f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:20.823770 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c182e4d-dab2-4b4c-995c-9d976bf2a39f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:20.825737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c182e4d-dab2-4b4c-995c-9d976bf2a39f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:20.828369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c182e4d-dab2-4b4c-995c-9d976bf2a39f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:20.831478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c182e4d-dab2-4b4c-995c-9d976bf2a39f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:20.835855 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c182e4d-dab2-4b4c-995c-9d976bf2a39f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:21.206357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b4bbd147-cd7b-45b4-b46e-07f930a206bd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:21.218336 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b4bbd147-cd7b-45b4-b46e-07f930a206bd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.688542 Oct 05 02:53:21.232934 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2518/5021] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:20 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:21.248265 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-27f66811-4cca-49c3-92b9-da3793470ca2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:53:21.248805 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-27f66811-4cca-49c3-92b9-da3793470ca2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:21.258815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27f66811-4cca-49c3-92b9-da3793470ca2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:21.259322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27f66811-4cca-49c3-92b9-da3793470ca2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:21.259760 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27f66811-4cca-49c3-92b9-da3793470ca2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:21.275871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27f66811-4cca-49c3-92b9-da3793470ca2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:21.277282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27f66811-4cca-49c3-92b9-da3793470ca2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:21.277753 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27f66811-4cca-49c3-92b9-da3793470ca2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:21.339125 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-27f66811-4cca-49c3-92b9-da3793470ca2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Cannot 'resume' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state active Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-27f66811-4cca-49c3-92b9-da3793470ca2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec/action HTTP/1.1 Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 14 Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: {"resume": {}} Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: exception: Cannot 'resume' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state active Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '1fded3d6-d275-4d50-a366-d19388f8aaec', 'body': {'resume': {}}} Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1fded3d6-d275-4d50-a366-d19388f8aaec in vm_state active. Cannot resume while the instance is in this state. Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state active Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:53:21.345211 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:21.350178 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:21.350178 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:53:21.350178 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:53:21.350178 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:53:21.350178 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:53:21.350178 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state active Oct 05 02:53:21.350178 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:21.355795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-27f66811-4cca-49c3-92b9-da3793470ca2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 409 to user: Cannot 'resume' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state active {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:53:21.360739 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-27f66811-4cca-49c3-92b9-da3793470ca2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec/action" status: 409 len: 144 microversion: 2.1 time: 0.114584 Oct 05 02:53:21.361657 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2519/5022] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:53:21 2022] POST /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec/action => generated 144 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 05 02:53:21.385092 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-93acc760-c9d4-4d72-a5ba-6cb7f9493a27 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:21.386872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-93acc760-c9d4-4d72-a5ba-6cb7f9493a27 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:21.392563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7c182e4d-dab2-4b4c-995c-9d976bf2a39f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:21.399798 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93acc760-c9d4-4d72-a5ba-6cb7f9493a27 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:21.401582 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93acc760-c9d4-4d72-a5ba-6cb7f9493a27 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:21.402285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93acc760-c9d4-4d72-a5ba-6cb7f9493a27 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:21.403259 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93acc760-c9d4-4d72-a5ba-6cb7f9493a27 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:21.404640 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93acc760-c9d4-4d72-a5ba-6cb7f9493a27 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:21.405366 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93acc760-c9d4-4d72-a5ba-6cb7f9493a27 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:21.405840 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7c182e4d-dab2-4b4c-995c-9d976bf2a39f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1321 microversion: 2.1 time: 0.612538 Oct 05 02:53:21.423109 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2504/5023] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:20 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1321 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:21.449434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-49ee65cf-f5f9-45e6-8421-17b982c15d96 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:21.450076 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-49ee65cf-f5f9-45e6-8421-17b982c15d96 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:21.461203 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49ee65cf-f5f9-45e6-8421-17b982c15d96 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:21.466705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49ee65cf-f5f9-45e6-8421-17b982c15d96 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:21.467460 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49ee65cf-f5f9-45e6-8421-17b982c15d96 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:21.468388 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49ee65cf-f5f9-45e6-8421-17b982c15d96 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:21.469085 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49ee65cf-f5f9-45e6-8421-17b982c15d96 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:21.470179 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49ee65cf-f5f9-45e6-8421-17b982c15d96 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:22.197412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-49ee65cf-f5f9-45e6-8421-17b982c15d96 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:22.213117 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-49ee65cf-f5f9-45e6-8421-17b982c15d96 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:22.218060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-49ee65cf-f5f9-45e6-8421-17b982c15d96 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:22.225344 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-49ee65cf-f5f9-45e6-8421-17b982c15d96 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 0.780130 Oct 05 02:53:22.226767 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2505/5024] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:53:21 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:53:22.250794 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-93acc760-c9d4-4d72-a5ba-6cb7f9493a27 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:22.267423 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-93acc760-c9d4-4d72-a5ba-6cb7f9493a27 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.899876 Oct 05 02:53:22.268849 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2520/5025] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:21 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:22.299285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-53daadba-fcbd-48cc-90f3-dfa7c62736fa tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:22.300287 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-53daadba-fcbd-48cc-90f3-dfa7c62736fa tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:22.309555 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53daadba-fcbd-48cc-90f3-dfa7c62736fa tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:22.309685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53daadba-fcbd-48cc-90f3-dfa7c62736fa tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:22.310195 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53daadba-fcbd-48cc-90f3-dfa7c62736fa tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:22.310987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53daadba-fcbd-48cc-90f3-dfa7c62736fa tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:22.311693 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53daadba-fcbd-48cc-90f3-dfa7c62736fa tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:22.312199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53daadba-fcbd-48cc-90f3-dfa7c62736fa tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:22.382042 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3a0c66a5-b747-4953-bc5c-d401a0fa2bee tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1599607316", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "66a8e5ea-39f4-4740-95dd-ca8d7d8600b2"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:53:22.472916 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-3a0c66a5-b747-4953-bc5c-d401a0fa2bee tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] validate_networks() for [('66a8e5ea-39f4-4740-95dd-ca8d7d8600b2', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:53:23.196830 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-53daadba-fcbd-48cc-90f3-dfa7c62736fa tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:23.206531 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-53daadba-fcbd-48cc-90f3-dfa7c62736fa tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.911596 Oct 05 02:53:23.213209 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2521/5026] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:22 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:23.231546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f1285d5d-203c-44bc-9b4b-47e9dcf967c7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:23.232801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f1285d5d-203c-44bc-9b4b-47e9dcf967c7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:23.251382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f1285d5d-203c-44bc-9b4b-47e9dcf967c7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:23.252073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f1285d5d-203c-44bc-9b4b-47e9dcf967c7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:23.252344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f1285d5d-203c-44bc-9b4b-47e9dcf967c7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:23.254400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f1285d5d-203c-44bc-9b4b-47e9dcf967c7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:23.257194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f1285d5d-203c-44bc-9b4b-47e9dcf967c7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:23.257677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f1285d5d-203c-44bc-9b4b-47e9dcf967c7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:23.762686 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f1285d5d-203c-44bc-9b4b-47e9dcf967c7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:23.780629 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f1285d5d-203c-44bc-9b4b-47e9dcf967c7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1321 microversion: 2.1 time: 0.565690 Oct 05 02:53:23.799759 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2522/5027] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:23 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1321 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:23.808235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0239c8f4-c2d6-49af-a7ab-eca6467a0ebb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:23.810579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0239c8f4-c2d6-49af-a7ab-eca6467a0ebb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:23.819013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0239c8f4-c2d6-49af-a7ab-eca6467a0ebb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:23.821825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0239c8f4-c2d6-49af-a7ab-eca6467a0ebb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:23.822500 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0239c8f4-c2d6-49af-a7ab-eca6467a0ebb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:23.823426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0239c8f4-c2d6-49af-a7ab-eca6467a0ebb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:23.824086 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0239c8f4-c2d6-49af-a7ab-eca6467a0ebb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:23.825310 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0239c8f4-c2d6-49af-a7ab-eca6467a0ebb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:24.070863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-3a0c66a5-b747-4953-bc5c-d401a0fa2bee tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:53:24.071388 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-3a0c66a5-b747-4953-bc5c-d401a0fa2bee tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:53:24.071759 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-3a0c66a5-b747-4953-bc5c-d401a0fa2bee tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:53:24.072872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-3a0c66a5-b747-4953-bc5c-d401a0fa2bee tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:53:24.073463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-3a0c66a5-b747-4953-bc5c-d401a0fa2bee tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:53:24.105924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3a0c66a5-b747-4953-bc5c-d401a0fa2bee tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:24.106420 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3a0c66a5-b747-4953-bc5c-d401a0fa2bee tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:24.106856 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3a0c66a5-b747-4953-bc5c-d401a0fa2bee tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:24.107595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3a0c66a5-b747-4953-bc5c-d401a0fa2bee tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:24.108141 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3a0c66a5-b747-4953-bc5c-d401a0fa2bee tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:24.108543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3a0c66a5-b747-4953-bc5c-d401a0fa2bee tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:24.162579 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-3a0c66a5-b747-4953-bc5c-d401a0fa2bee tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Getting quotas for project 8a0c20bf9ac24a0184b2a83bdbe3b7e8. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:53:24.164705 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0239c8f4-c2d6-49af-a7ab-eca6467a0ebb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:24.172413 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-3a0c66a5-b747-4953-bc5c-d401a0fa2bee tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Getting quotas for user 7ef58a16963444eba42e04b0de3747a2 and project 8a0c20bf9ac24a0184b2a83bdbe3b7e8. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:53:24.180353 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0239c8f4-c2d6-49af-a7ab-eca6467a0ebb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:24.188797 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0239c8f4-c2d6-49af-a7ab-eca6467a0ebb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:24.189551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3a0c66a5-b747-4953-bc5c-d401a0fa2bee tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:53:24.190105 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0239c8f4-c2d6-49af-a7ab-eca6467a0ebb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 0.388568 Oct 05 02:53:24.190694 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2523/5028] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:53:23 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:53:24.202869 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7836c8e9-4064-4e77-9427-3b53e67785fb tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:53:24.207819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3a0c66a5-b747-4953-bc5c-d401a0fa2bee tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] [instance: eae2fd86-3940-448d-a3fa-37eae8da4a17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7836c8e9-4064-4e77-9427-3b53e67785fb tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 160 Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: {"server": {"name": "", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63"}]}} Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'body': {'server': {'name': '', 'imageRef': 'adad3215-1ca6-43bb-9981-0d01aff146ab', 'flavorRef': '452', 'networks': [{'uuid': 'e6fb33f3-05c9-4caa-9a22-cd2edcdb7f63'}]}}} Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi '' Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:53:24.210018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:53:24.215088 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:53:24.215088 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 05 02:53:24.215088 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:24.215088 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:53:24.215088 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:24.215088 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:24.215088 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:53:24.215088 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:53:24.215088 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:53:24.215088 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:53:24.215088 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 05 02:53:24.215088 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:24.217295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7836c8e9-4064-4e77-9427-3b53e67785fb tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:53:24.219734 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7836c8e9-4064-4e77-9427-3b53e67785fb tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.027902 Oct 05 02:53:24.227423 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2524/5029] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:53:24 2022] POST /compute/v2.1/servers => generated 108 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:53:24.235519 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fbde0b0a-0def-4fe3-827c-74fea24476a3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:24.236463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fbde0b0a-0def-4fe3-827c-74fea24476a3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:24.253260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fbde0b0a-0def-4fe3-827c-74fea24476a3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:24.254519 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fbde0b0a-0def-4fe3-827c-74fea24476a3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:24.256994 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fbde0b0a-0def-4fe3-827c-74fea24476a3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:24.259905 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fbde0b0a-0def-4fe3-827c-74fea24476a3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:24.261414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fbde0b0a-0def-4fe3-827c-74fea24476a3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:24.262194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fbde0b0a-0def-4fe3-827c-74fea24476a3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:24.311462 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3a0c66a5-b747-4953-bc5c-d401a0fa2bee tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.063118 Oct 05 02:53:24.320204 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2506/5030] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:53:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 02:53:24.326305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9f5d4db2-e9ec-4ccd-94d7-e80a27f5e142 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:24.327336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9f5d4db2-e9ec-4ccd-94d7-e80a27f5e142 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] [instance: eae2fd86-3940-448d-a3fa-37eae8da4a17] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:24.437372 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9f5d4db2-e9ec-4ccd-94d7-e80a27f5e142 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef58a16963444eba42e04b0de3747a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c20bf9ac24a0184b2a83bdbe3b7e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:24.444719 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9f5d4db2-e9ec-4ccd-94d7-e80a27f5e142 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] 10.222.0.16 "GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17" status: 200 len: 1225 microversion: 2.1 time: 0.122917 Oct 05 02:53:24.445844 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2507/5031] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:24 2022] GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17 => generated 1225 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:24.567026 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fbde0b0a-0def-4fe3-827c-74fea24476a3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:24.591539 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fbde0b0a-0def-4fe3-827c-74fea24476a3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.351678 Oct 05 02:53:24.605832 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2525/5032] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:24 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:24.617379 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a11392d0-f892-4409-9b97-4f0390ee4cda tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:24.617937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a11392d0-f892-4409-9b97-4f0390ee4cda tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:24.627114 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a11392d0-f892-4409-9b97-4f0390ee4cda tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:24.627968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a11392d0-f892-4409-9b97-4f0390ee4cda tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:24.628606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a11392d0-f892-4409-9b97-4f0390ee4cda tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:24.633935 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a11392d0-f892-4409-9b97-4f0390ee4cda tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:24.634428 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a11392d0-f892-4409-9b97-4f0390ee4cda tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:24.635418 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a11392d0-f892-4409-9b97-4f0390ee4cda tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:24.813658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-22d11630-c8ba-4573-9846-7d02e8668344 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:24.814299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-22d11630-c8ba-4573-9846-7d02e8668344 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:24.833496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22d11630-c8ba-4573-9846-7d02e8668344 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:24.836064 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22d11630-c8ba-4573-9846-7d02e8668344 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:24.841144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22d11630-c8ba-4573-9846-7d02e8668344 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:24.842354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22d11630-c8ba-4573-9846-7d02e8668344 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:24.843196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22d11630-c8ba-4573-9846-7d02e8668344 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:24.844302 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22d11630-c8ba-4573-9846-7d02e8668344 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:24.924353 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a11392d0-f892-4409-9b97-4f0390ee4cda tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:24.937273 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a11392d0-f892-4409-9b97-4f0390ee4cda tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.325318 Oct 05 02:53:24.940583 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2508/5033] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:24 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:24.976622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1c347528-9e33-43b6-8fac-27372a8134a5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:53:24.977538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1c347528-9e33-43b6-8fac-27372a8134a5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: fb3a2f97-d3c1-41e2-9825-8af951808236] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:24.984605 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-1c347528-9e33-43b6-8fac-27372a8134a5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Instance fb3a2f97-d3c1-41e2-9825-8af951808236 could not be found. Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1c347528-9e33-43b6-8fac-27372a8134a5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers/fb3a2f97-d3c1-41e2-9825-8af951808236/action HTTP/1.1 Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 14 Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: {"shelve": {}} Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance fb3a2f97-d3c1-41e2-9825-8af951808236 could not be found. Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'fb3a2f97-d3c1-41e2-9825-8af951808236', 'body': {'shelve': {}}} Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb3a2f97-d3c1-41e2-9825-8af951808236 could not be found. Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb3a2f97-d3c1-41e2-9825-8af951808236 could not be found. Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:53:24.988086 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:53:24.997682 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:53:24.997682 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:53:24.997682 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb3a2f97-d3c1-41e2-9825-8af951808236 could not be found. Oct 05 02:53:24.997682 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:53:24.999482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1c347528-9e33-43b6-8fac-27372a8134a5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 404 to user: Instance fb3a2f97-d3c1-41e2-9825-8af951808236 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:53:25.000828 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1c347528-9e33-43b6-8fac-27372a8134a5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers/fb3a2f97-d3c1-41e2-9825-8af951808236/action" status: 404 len: 111 microversion: 2.1 time: 0.033932 Oct 05 02:53:25.004289 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2509/5034] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:53:24 2022] POST /compute/v2.1/servers/fb3a2f97-d3c1-41e2-9825-8af951808236/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:53:25.018798 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9eb81808-8a77-4edf-a8f0-048b354b23c5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:25.019489 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9eb81808-8a77-4edf-a8f0-048b354b23c5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:25.049563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9eb81808-8a77-4edf-a8f0-048b354b23c5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:25.051236 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9eb81808-8a77-4edf-a8f0-048b354b23c5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:25.051720 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9eb81808-8a77-4edf-a8f0-048b354b23c5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:25.055339 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9eb81808-8a77-4edf-a8f0-048b354b23c5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:25.055891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9eb81808-8a77-4edf-a8f0-048b354b23c5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:25.056342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9eb81808-8a77-4edf-a8f0-048b354b23c5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:25.211237 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-22d11630-c8ba-4573-9846-7d02e8668344 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:25.225257 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-22d11630-c8ba-4573-9846-7d02e8668344 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1321 microversion: 2.1 time: 0.424031 Oct 05 02:53:25.238186 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2526/5035] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:24 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1321 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:25.246381 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c1baceef-8774-4699-bbe6-76ffd9bdec7b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:25.246992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c1baceef-8774-4699-bbe6-76ffd9bdec7b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:25.255575 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1baceef-8774-4699-bbe6-76ffd9bdec7b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:25.256268 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1baceef-8774-4699-bbe6-76ffd9bdec7b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:25.257179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1baceef-8774-4699-bbe6-76ffd9bdec7b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:25.258743 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1baceef-8774-4699-bbe6-76ffd9bdec7b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:25.259274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1baceef-8774-4699-bbe6-76ffd9bdec7b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:25.259771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1baceef-8774-4699-bbe6-76ffd9bdec7b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:25.335386 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9eb81808-8a77-4edf-a8f0-048b354b23c5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:25.354396 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9eb81808-8a77-4edf-a8f0-048b354b23c5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.344561 Oct 05 02:53:25.377804 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2510/5036] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:25 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:25.385755 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c92dac17-f645-47de-b8ba-dc20261ab619 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:25.386527 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c92dac17-f645-47de-b8ba-dc20261ab619 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:25.394970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c92dac17-f645-47de-b8ba-dc20261ab619 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:25.394970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c92dac17-f645-47de-b8ba-dc20261ab619 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:25.394970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c92dac17-f645-47de-b8ba-dc20261ab619 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:25.397461 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c92dac17-f645-47de-b8ba-dc20261ab619 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:25.398374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c92dac17-f645-47de-b8ba-dc20261ab619 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:25.399438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c92dac17-f645-47de-b8ba-dc20261ab619 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:25.663026 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c1baceef-8774-4699-bbe6-76ffd9bdec7b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:25.675868 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c1baceef-8774-4699-bbe6-76ffd9bdec7b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:25.678929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c1baceef-8774-4699-bbe6-76ffd9bdec7b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:25.684858 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c1baceef-8774-4699-bbe6-76ffd9bdec7b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 0.444809 Oct 05 02:53:25.686069 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2527/5037] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:53:25 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:53:25.690930 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c92dac17-f645-47de-b8ba-dc20261ab619 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:25.693354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e704a461-7ef9-4aa3-b0e8-3a3bd5da57d5 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:25.695304 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e704a461-7ef9-4aa3-b0e8-3a3bd5da57d5 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] [instance: eae2fd86-3940-448d-a3fa-37eae8da4a17] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:25.703598 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c92dac17-f645-47de-b8ba-dc20261ab619 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.323098 Oct 05 02:53:25.704320 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2511/5038] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:25 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:25.709527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e704a461-7ef9-4aa3-b0e8-3a3bd5da57d5 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:25.710269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e704a461-7ef9-4aa3-b0e8-3a3bd5da57d5 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:25.710921 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e704a461-7ef9-4aa3-b0e8-3a3bd5da57d5 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:25.711858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e704a461-7ef9-4aa3-b0e8-3a3bd5da57d5 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:25.712629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e704a461-7ef9-4aa3-b0e8-3a3bd5da57d5 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:25.713260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e704a461-7ef9-4aa3-b0e8-3a3bd5da57d5 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:25.732847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fc5634b4-0f5e-4c64-97c1-4522fbfd881d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:53:25.733423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fc5634b4-0f5e-4c64-97c1-4522fbfd881d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:25.743522 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc5634b4-0f5e-4c64-97c1-4522fbfd881d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:25.745718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc5634b4-0f5e-4c64-97c1-4522fbfd881d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:25.746181 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc5634b4-0f5e-4c64-97c1-4522fbfd881d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:25.746908 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc5634b4-0f5e-4c64-97c1-4522fbfd881d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:25.747371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc5634b4-0f5e-4c64-97c1-4522fbfd881d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:25.747802 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc5634b4-0f5e-4c64-97c1-4522fbfd881d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:25.807603 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-fc5634b4-0f5e-4c64-97c1-4522fbfd881d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lazy-loading 'flavor' on Instance uuid 1fded3d6-d275-4d50-a366-d19388f8aaec {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:53:25.813906 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e704a461-7ef9-4aa3-b0e8-3a3bd5da57d5 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef58a16963444eba42e04b0de3747a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c20bf9ac24a0184b2a83bdbe3b7e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:25.824678 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e704a461-7ef9-4aa3-b0e8-3a3bd5da57d5 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] 10.222.0.16 "GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17" status: 200 len: 1277 microversion: 2.1 time: 0.136842 Oct 05 02:53:25.825291 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2528/5039] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:25 2022] GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17 => generated 1277 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:26.129451 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fc5634b4-0f5e-4c64-97c1-4522fbfd881d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec/action" status: 202 len: 0 microversion: 2.1 time: 0.388385 Oct 05 02:53:26.137308 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2512/5040] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:53:25 2022] POST /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec/action => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 02:53:26.146693 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2ea1de25-9477-4053-a99b-da0bed6b6cbd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:26.147948 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2ea1de25-9477-4053-a99b-da0bed6b6cbd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:26.179762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ea1de25-9477-4053-a99b-da0bed6b6cbd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:26.181266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ea1de25-9477-4053-a99b-da0bed6b6cbd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:26.181984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ea1de25-9477-4053-a99b-da0bed6b6cbd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:26.183355 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ea1de25-9477-4053-a99b-da0bed6b6cbd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:26.184442 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ea1de25-9477-4053-a99b-da0bed6b6cbd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:26.186343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ea1de25-9477-4053-a99b-da0bed6b6cbd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:26.257603 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f6b9fd7e-22ce-49f8-9363-1508b4720afe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:26.258735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f6b9fd7e-22ce-49f8-9363-1508b4720afe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:26.277438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6b9fd7e-22ce-49f8-9363-1508b4720afe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:26.278099 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6b9fd7e-22ce-49f8-9363-1508b4720afe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:26.278739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6b9fd7e-22ce-49f8-9363-1508b4720afe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:26.279758 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6b9fd7e-22ce-49f8-9363-1508b4720afe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:26.281589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6b9fd7e-22ce-49f8-9363-1508b4720afe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:26.282333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6b9fd7e-22ce-49f8-9363-1508b4720afe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:26.307436 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:26.643507 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2ea1de25-9477-4053-a99b-da0bed6b6cbd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:26.660822 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2ea1de25-9477-4053-a99b-da0bed6b6cbd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1510 microversion: 2.1 time: 0.520866 Oct 05 02:53:26.665692 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2529/5041] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:26 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1510 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:26.682027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-dce91e52-465d-49e0-95c7-3ff17e44973d req-b5a6e0cf-f033-4a26-be2e-7e0b9d5d7738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3551a7d0-74d1-41e5-9cb9-252aeb256b95", "name": "network-vif-plugged", "status": "completed", "tag": "f45eaf3b-7876-4462-b755-dff2d9fa8a45"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:53:26.716381 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-dce91e52-465d-49e0-95c7-3ff17e44973d req-b5a6e0cf-f033-4a26-be2e-7e0b9d5d7738 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:26.717460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-dce91e52-465d-49e0-95c7-3ff17e44973d req-b5a6e0cf-f033-4a26-be2e-7e0b9d5d7738 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:26.718498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-dce91e52-465d-49e0-95c7-3ff17e44973d req-b5a6e0cf-f033-4a26-be2e-7e0b9d5d7738 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:26.726497 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f6b9fd7e-22ce-49f8-9363-1508b4720afe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:26.744458 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f6b9fd7e-22ce-49f8-9363-1508b4720afe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1321 microversion: 2.1 time: 0.495182 Oct 05 02:53:26.748080 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2513/5042] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:26 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1321 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:26.760843 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-dce91e52-465d-49e0-95c7-3ff17e44973d req-b5a6e0cf-f033-4a26-be2e-7e0b9d5d7738 service nova] Creating event network-vif-plugged:f45eaf3b-7876-4462-b755-dff2d9fa8a45 for instance 3551a7d0-74d1-41e5-9cb9-252aeb256b95 on n-h2-858272-3 Oct 05 02:53:26.769257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f4be1e58-2e26-4ec6-8793-9e77420efb7b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:26.770121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f4be1e58-2e26-4ec6-8793-9e77420efb7b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:26.781424 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-dce91e52-465d-49e0-95c7-3ff17e44973d req-b5a6e0cf-f033-4a26-be2e-7e0b9d5d7738 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114382 Oct 05 02:53:26.786552 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2530/5043] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:53:26.789732 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4be1e58-2e26-4ec6-8793-9e77420efb7b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:26.790329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4be1e58-2e26-4ec6-8793-9e77420efb7b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:26.793374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4be1e58-2e26-4ec6-8793-9e77420efb7b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:26.794435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4be1e58-2e26-4ec6-8793-9e77420efb7b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:26.795127 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4be1e58-2e26-4ec6-8793-9e77420efb7b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:26.796819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4be1e58-2e26-4ec6-8793-9e77420efb7b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:26.853547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-edbc2a68-6cf1-4bfc-8c6a-9aedbaf45033 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:26.854265 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-edbc2a68-6cf1-4bfc-8c6a-9aedbaf45033 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] [instance: eae2fd86-3940-448d-a3fa-37eae8da4a17] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:26.861785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-edbc2a68-6cf1-4bfc-8c6a-9aedbaf45033 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:26.862286 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-edbc2a68-6cf1-4bfc-8c6a-9aedbaf45033 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:26.862727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-edbc2a68-6cf1-4bfc-8c6a-9aedbaf45033 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:26.863448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-edbc2a68-6cf1-4bfc-8c6a-9aedbaf45033 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:26.863903 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-edbc2a68-6cf1-4bfc-8c6a-9aedbaf45033 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:26.864327 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-edbc2a68-6cf1-4bfc-8c6a-9aedbaf45033 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:27.164852 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-edbc2a68-6cf1-4bfc-8c6a-9aedbaf45033 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef58a16963444eba42e04b0de3747a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c20bf9ac24a0184b2a83bdbe3b7e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:27.177745 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-edbc2a68-6cf1-4bfc-8c6a-9aedbaf45033 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] 10.222.0.16 "GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17" status: 200 len: 1283 microversion: 2.1 time: 0.330396 Oct 05 02:53:27.178716 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2531/5044] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:26 2022] GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17 => generated 1283 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:27.470816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f4be1e58-2e26-4ec6-8793-9e77420efb7b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:27.481755 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f4be1e58-2e26-4ec6-8793-9e77420efb7b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:27.483887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f4be1e58-2e26-4ec6-8793-9e77420efb7b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:27.485530 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f4be1e58-2e26-4ec6-8793-9e77420efb7b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 0.736318 Oct 05 02:53:27.486300 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2514/5045] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:53:26 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:53:27.691202 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-48a8cab0-04d6-4955-9d63-25a11b7bb23c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:27.691846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-48a8cab0-04d6-4955-9d63-25a11b7bb23c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:27.710501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48a8cab0-04d6-4955-9d63-25a11b7bb23c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:27.711562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48a8cab0-04d6-4955-9d63-25a11b7bb23c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:27.713624 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48a8cab0-04d6-4955-9d63-25a11b7bb23c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:27.715711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48a8cab0-04d6-4955-9d63-25a11b7bb23c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:27.717532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48a8cab0-04d6-4955-9d63-25a11b7bb23c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:27.718717 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48a8cab0-04d6-4955-9d63-25a11b7bb23c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:27.784173 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e7543059-af0e-4b4b-a940-61718fd68789 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:27.784820 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e7543059-af0e-4b4b-a940-61718fd68789 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:27.810129 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7543059-af0e-4b4b-a940-61718fd68789 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:27.811277 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7543059-af0e-4b4b-a940-61718fd68789 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:27.811922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7543059-af0e-4b4b-a940-61718fd68789 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:27.812865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7543059-af0e-4b4b-a940-61718fd68789 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:27.813541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7543059-af0e-4b4b-a940-61718fd68789 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:27.815776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7543059-af0e-4b4b-a940-61718fd68789 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:28.122967 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-48a8cab0-04d6-4955-9d63-25a11b7bb23c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:28.137465 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-48a8cab0-04d6-4955-9d63-25a11b7bb23c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1510 microversion: 2.1 time: 0.453295 Oct 05 02:53:28.159423 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2532/5046] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:27 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1510 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:28.205587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2567fea4-cc47-49dc-b41f-e00940f01177 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:28.206123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2567fea4-cc47-49dc-b41f-e00940f01177 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] [instance: eae2fd86-3940-448d-a3fa-37eae8da4a17] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:28.215035 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2567fea4-cc47-49dc-b41f-e00940f01177 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:28.215511 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2567fea4-cc47-49dc-b41f-e00940f01177 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:28.229399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2567fea4-cc47-49dc-b41f-e00940f01177 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:28.230256 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2567fea4-cc47-49dc-b41f-e00940f01177 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:28.230673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2567fea4-cc47-49dc-b41f-e00940f01177 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:28.231115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2567fea4-cc47-49dc-b41f-e00940f01177 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:28.309142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:28.326596 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e7543059-af0e-4b4b-a940-61718fd68789 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:28.343917 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e7543059-af0e-4b4b-a940-61718fd68789 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1321 microversion: 2.1 time: 0.566811 Oct 05 02:53:28.350257 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2515/5047] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:27 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1321 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:28.518149 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8c00204c-20b9-4821-84d4-47794a2bdb04 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:28.518807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8c00204c-20b9-4821-84d4-47794a2bdb04 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:28.529470 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c00204c-20b9-4821-84d4-47794a2bdb04 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:28.530526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c00204c-20b9-4821-84d4-47794a2bdb04 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:28.532145 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c00204c-20b9-4821-84d4-47794a2bdb04 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:28.533135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c00204c-20b9-4821-84d4-47794a2bdb04 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:28.533996 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c00204c-20b9-4821-84d4-47794a2bdb04 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:28.535186 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8c00204c-20b9-4821-84d4-47794a2bdb04 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:28.633072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2567fea4-cc47-49dc-b41f-e00940f01177 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef58a16963444eba42e04b0de3747a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c20bf9ac24a0184b2a83bdbe3b7e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:28.641771 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2567fea4-cc47-49dc-b41f-e00940f01177 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] 10.222.0.16 "GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17" status: 200 len: 1325 microversion: 2.1 time: 0.440338 Oct 05 02:53:28.642359 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2533/5048] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:28 2022] GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17 => generated 1325 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:53:29.166785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-eaffffee-e05a-42dc-ab00-d6818936031f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:29.167923 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-eaffffee-e05a-42dc-ab00-d6818936031f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:29.177087 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eaffffee-e05a-42dc-ab00-d6818936031f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:29.177938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eaffffee-e05a-42dc-ab00-d6818936031f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:29.178658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eaffffee-e05a-42dc-ab00-d6818936031f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:29.180203 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eaffffee-e05a-42dc-ab00-d6818936031f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:29.180943 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eaffffee-e05a-42dc-ab00-d6818936031f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:29.181583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eaffffee-e05a-42dc-ab00-d6818936031f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:29.534295 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8c00204c-20b9-4821-84d4-47794a2bdb04 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:29.555870 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8c00204c-20b9-4821-84d4-47794a2bdb04 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:29.563088 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8c00204c-20b9-4821-84d4-47794a2bdb04 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:29.564974 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8c00204c-20b9-4821-84d4-47794a2bdb04 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 1.054579 Oct 05 02:53:29.581661 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2516/5049] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:53:28 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:53:29.595783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-328e7e53-3feb-4a00-b089-7f599e5d7a5d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:29.597930 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-328e7e53-3feb-4a00-b089-7f599e5d7a5d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:29.617724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-328e7e53-3feb-4a00-b089-7f599e5d7a5d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:29.618290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-328e7e53-3feb-4a00-b089-7f599e5d7a5d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:29.618739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-328e7e53-3feb-4a00-b089-7f599e5d7a5d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:29.619962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-328e7e53-3feb-4a00-b089-7f599e5d7a5d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:29.620613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-328e7e53-3feb-4a00-b089-7f599e5d7a5d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:29.621249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-328e7e53-3feb-4a00-b089-7f599e5d7a5d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:30.002944 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-eaffffee-e05a-42dc-ab00-d6818936031f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:30.024360 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-eaffffee-e05a-42dc-ab00-d6818936031f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1510 microversion: 2.1 time: 0.862904 Oct 05 02:53:30.031029 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2534/5050] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:29 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1510 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:30.041282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0264a7e8-3ba8-457d-b892-6cbe7c70534c tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:30.047102 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0264a7e8-3ba8-457d-b892-6cbe7c70534c tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] [instance: eae2fd86-3940-448d-a3fa-37eae8da4a17] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:30.055313 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-328e7e53-3feb-4a00-b089-7f599e5d7a5d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:30.058664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0264a7e8-3ba8-457d-b892-6cbe7c70534c tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:30.059762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0264a7e8-3ba8-457d-b892-6cbe7c70534c tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:30.060283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0264a7e8-3ba8-457d-b892-6cbe7c70534c tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:30.061329 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0264a7e8-3ba8-457d-b892-6cbe7c70534c tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:30.061804 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0264a7e8-3ba8-457d-b892-6cbe7c70534c tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:30.062238 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0264a7e8-3ba8-457d-b892-6cbe7c70534c tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:30.064994 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-328e7e53-3feb-4a00-b089-7f599e5d7a5d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1514 microversion: 2.1 time: 0.482093 Oct 05 02:53:30.065600 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2517/5051] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:29 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1514 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:30.095712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-90be4d32-92a2-480f-8f8d-137fe47b4ece tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:53:30.105987 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-90be4d32-92a2-480f-8f8d-137fe47b4ece tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:30.122047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-90be4d32-92a2-480f-8f8d-137fe47b4ece tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:30.122725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-90be4d32-92a2-480f-8f8d-137fe47b4ece tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:30.123680 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-90be4d32-92a2-480f-8f8d-137fe47b4ece tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:30.126735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-90be4d32-92a2-480f-8f8d-137fe47b4ece tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:30.128038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-90be4d32-92a2-480f-8f8d-137fe47b4ece tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:30.128542 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-90be4d32-92a2-480f-8f8d-137fe47b4ece tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:30.198917 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-90be4d32-92a2-480f-8f8d-137fe47b4ece tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lazy-loading 'flavor' on Instance uuid 3551a7d0-74d1-41e5-9cb9-252aeb256b95 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:53:30.391604 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-90be4d32-92a2-480f-8f8d-137fe47b4ece tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "POST /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95/action" status: 200 len: 32 microversion: 2.1 time: 0.299788 Oct 05 02:53:30.392980 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2518/5052] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:53:30 2022] POST /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95/action => generated 32 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:53:30.409481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-0d47b1fa-bc78-4506-a55d-18fa5d3d6054 req-dc75a5cf-3e4c-4c8d-8046-62e82134e435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ef11e58-0680-4e15-aa40-a4043a5a357a", "name": "network-vif-plugged", "status": "completed", "tag": "dcd1d668-f512-4fb6-9bc4-5acd98bc044b"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:53:30.423412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0264a7e8-3ba8-457d-b892-6cbe7c70534c tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef58a16963444eba42e04b0de3747a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c20bf9ac24a0184b2a83bdbe3b7e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:30.430528 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-0d47b1fa-bc78-4506-a55d-18fa5d3d6054 req-dc75a5cf-3e4c-4c8d-8046-62e82134e435 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:30.431598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-0d47b1fa-bc78-4506-a55d-18fa5d3d6054 req-dc75a5cf-3e4c-4c8d-8046-62e82134e435 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:30.432699 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-0d47b1fa-bc78-4506-a55d-18fa5d3d6054 req-dc75a5cf-3e4c-4c8d-8046-62e82134e435 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:30.441642 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0264a7e8-3ba8-457d-b892-6cbe7c70534c tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] 10.222.0.16 "GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17" status: 200 len: 1325 microversion: 2.1 time: 0.405498 Oct 05 02:53:30.447381 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2535/5053] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:30 2022] GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17 => generated 1325 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:30.467598 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-0d47b1fa-bc78-4506-a55d-18fa5d3d6054 req-dc75a5cf-3e4c-4c8d-8046-62e82134e435 service nova] Creating event network-vif-plugged:dcd1d668-f512-4fb6-9bc4-5acd98bc044b for instance 2ef11e58-0680-4e15-aa40-a4043a5a357a on n-h1-858272-3 Oct 05 02:53:30.472447 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-aebae019-8e5c-468b-a269-4ec88663c4f7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:30.477791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-aebae019-8e5c-468b-a269-4ec88663c4f7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:30.479099 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-0d47b1fa-bc78-4506-a55d-18fa5d3d6054 req-dc75a5cf-3e4c-4c8d-8046-62e82134e435 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084188 Oct 05 02:53:30.486626 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2519/5054] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:53:30.488589 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aebae019-8e5c-468b-a269-4ec88663c4f7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:30.492452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aebae019-8e5c-468b-a269-4ec88663c4f7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:30.495521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aebae019-8e5c-468b-a269-4ec88663c4f7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:30.497527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aebae019-8e5c-468b-a269-4ec88663c4f7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:30.498326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aebae019-8e5c-468b-a269-4ec88663c4f7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:30.502233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aebae019-8e5c-468b-a269-4ec88663c4f7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:30.596614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-258af844-5631-47ad-b6e5-5f4e44c3f131 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:30.597345 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-258af844-5631-47ad-b6e5-5f4e44c3f131 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:30.610081 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-258af844-5631-47ad-b6e5-5f4e44c3f131 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:30.610577 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-258af844-5631-47ad-b6e5-5f4e44c3f131 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:30.611019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-258af844-5631-47ad-b6e5-5f4e44c3f131 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:30.611726 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-258af844-5631-47ad-b6e5-5f4e44c3f131 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:30.612178 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-258af844-5631-47ad-b6e5-5f4e44c3f131 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:30.612603 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-258af844-5631-47ad-b6e5-5f4e44c3f131 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:30.957569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-258af844-5631-47ad-b6e5-5f4e44c3f131 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:30.969730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-258af844-5631-47ad-b6e5-5f4e44c3f131 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:30.971177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-258af844-5631-47ad-b6e5-5f4e44c3f131 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:30.982906 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-258af844-5631-47ad-b6e5-5f4e44c3f131 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 0.390870 Oct 05 02:53:30.984139 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2520/5055] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:53:30 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:53:31.058604 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5390cf07-c1f2-41d0-a64c-7fad54eafc31 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:31.060075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5390cf07-c1f2-41d0-a64c-7fad54eafc31 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:31.069255 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5390cf07-c1f2-41d0-a64c-7fad54eafc31 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:31.075072 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5390cf07-c1f2-41d0-a64c-7fad54eafc31 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:31.075765 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5390cf07-c1f2-41d0-a64c-7fad54eafc31 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:31.076839 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5390cf07-c1f2-41d0-a64c-7fad54eafc31 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:31.077492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5390cf07-c1f2-41d0-a64c-7fad54eafc31 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:31.079688 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5390cf07-c1f2-41d0-a64c-7fad54eafc31 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:31.118036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-aebae019-8e5c-468b-a269-4ec88663c4f7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:31.130968 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-aebae019-8e5c-468b-a269-4ec88663c4f7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1520 microversion: 2.1 time: 0.681730 Oct 05 02:53:31.131558 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2536/5056] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:30 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1520 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:31.360443 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-72c89577-2e20-428d-8b84-a66c78b30ccd req-28fcfe51-ae7a-4442-ba77-9f4bdc8d8aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eae2fd86-3940-448d-a3fa-37eae8da4a17", "tag": "19f37c3c-c1f8-4fed-becd-ffd58c29ae3d"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:53:31.402654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-72c89577-2e20-428d-8b84-a66c78b30ccd req-28fcfe51-ae7a-4442-ba77-9f4bdc8d8aa9 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:31.403585 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-72c89577-2e20-428d-8b84-a66c78b30ccd req-28fcfe51-ae7a-4442-ba77-9f4bdc8d8aa9 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:31.404587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-72c89577-2e20-428d-8b84-a66c78b30ccd req-28fcfe51-ae7a-4442-ba77-9f4bdc8d8aa9 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:31.436197 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-72c89577-2e20-428d-8b84-a66c78b30ccd req-28fcfe51-ae7a-4442-ba77-9f4bdc8d8aa9 service nova] Creating event network-changed:19f37c3c-c1f8-4fed-becd-ffd58c29ae3d for instance eae2fd86-3940-448d-a3fa-37eae8da4a17 on n-h2-858272-3 Oct 05 02:53:31.445647 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-72c89577-2e20-428d-8b84-a66c78b30ccd req-28fcfe51-ae7a-4442-ba77-9f4bdc8d8aa9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089528 Oct 05 02:53:31.447044 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2537/5057] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:53:31.472029 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8a325aff-8568-4994-bbc8-decb0ad048f1 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:31.473049 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8a325aff-8568-4994-bbc8-decb0ad048f1 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] [instance: eae2fd86-3940-448d-a3fa-37eae8da4a17] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:31.487033 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a325aff-8568-4994-bbc8-decb0ad048f1 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:31.491370 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a325aff-8568-4994-bbc8-decb0ad048f1 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:31.492080 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a325aff-8568-4994-bbc8-decb0ad048f1 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:31.493157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a325aff-8568-4994-bbc8-decb0ad048f1 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:31.493812 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a325aff-8568-4994-bbc8-decb0ad048f1 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:31.495619 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a325aff-8568-4994-bbc8-decb0ad048f1 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:32.012873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5390cf07-c1f2-41d0-a64c-7fad54eafc31 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:32.023560 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5390cf07-c1f2-41d0-a64c-7fad54eafc31 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1510 microversion: 2.1 time: 0.968952 Oct 05 02:53:32.024169 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2521/5058] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:31 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1510 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:53:32.036754 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b3bdd50f-d0bb-40bb-a28c-4b7bd760986b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:32.045968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b3bdd50f-d0bb-40bb-a28c-4b7bd760986b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:32.054088 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3bdd50f-d0bb-40bb-a28c-4b7bd760986b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:32.062129 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3bdd50f-d0bb-40bb-a28c-4b7bd760986b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:32.062690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3bdd50f-d0bb-40bb-a28c-4b7bd760986b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:32.063544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3bdd50f-d0bb-40bb-a28c-4b7bd760986b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:32.064098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3bdd50f-d0bb-40bb-a28c-4b7bd760986b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:32.064648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3bdd50f-d0bb-40bb-a28c-4b7bd760986b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:32.900262 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8a325aff-8568-4994-bbc8-decb0ad048f1 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef58a16963444eba42e04b0de3747a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c20bf9ac24a0184b2a83bdbe3b7e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:32.911862 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8a325aff-8568-4994-bbc8-decb0ad048f1 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] 10.222.0.16 "GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17" status: 200 len: 1325 microversion: 2.1 time: 1.444229 Oct 05 02:53:32.913136 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2538/5059] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:31 2022] GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17 => generated 1325 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:32.939204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d2078483-8cef-4abb-b58c-21e26c2b3e54 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:32.940308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d2078483-8cef-4abb-b58c-21e26c2b3e54 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:32.952197 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2078483-8cef-4abb-b58c-21e26c2b3e54 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:32.953215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2078483-8cef-4abb-b58c-21e26c2b3e54 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:32.953960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2078483-8cef-4abb-b58c-21e26c2b3e54 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:32.955918 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2078483-8cef-4abb-b58c-21e26c2b3e54 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:32.957733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2078483-8cef-4abb-b58c-21e26c2b3e54 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:32.959587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2078483-8cef-4abb-b58c-21e26c2b3e54 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:33.216088 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b3bdd50f-d0bb-40bb-a28c-4b7bd760986b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:33.253158 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b3bdd50f-d0bb-40bb-a28c-4b7bd760986b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:33.255993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b3bdd50f-d0bb-40bb-a28c-4b7bd760986b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:33.257686 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b3bdd50f-d0bb-40bb-a28c-4b7bd760986b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 1.232562 Oct 05 02:53:33.259941 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2522/5060] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:53:32 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:53:33.265055 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-c7f98fae-a763-442a-bfbe-af3133390c41 req-23508547-2e4c-4ea4-8ad9-1f4aef8bd14d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09ae93ee-8f09-4552-b933-ad3c7e157378", "name": "network-vif-plugged", "status": "completed", "tag": "4ea018df-dd40-468b-9dbd-6d8eb574258f"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:53:33.285768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:33.292774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-c7f98fae-a763-442a-bfbe-af3133390c41 req-23508547-2e4c-4ea4-8ad9-1f4aef8bd14d service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:33.293675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-c7f98fae-a763-442a-bfbe-af3133390c41 req-23508547-2e4c-4ea4-8ad9-1f4aef8bd14d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:33.294339 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-c7f98fae-a763-442a-bfbe-af3133390c41 req-23508547-2e4c-4ea4-8ad9-1f4aef8bd14d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:33.309829 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-c7f98fae-a763-442a-bfbe-af3133390c41 req-23508547-2e4c-4ea4-8ad9-1f4aef8bd14d service nova] Creating event network-vif-plugged:4ea018df-dd40-468b-9dbd-6d8eb574258f for instance 09ae93ee-8f09-4552-b933-ad3c7e157378 on n-h1-858272-3 Oct 05 02:53:33.318151 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-c7f98fae-a763-442a-bfbe-af3133390c41 req-23508547-2e4c-4ea4-8ad9-1f4aef8bd14d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056433 Oct 05 02:53:33.319484 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2523/5061] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:53:33.326881 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-55f45c73-359e-4be9-8507-4121cebce57b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:33.328004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-55f45c73-359e-4be9-8507-4121cebce57b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:33.336346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55f45c73-359e-4be9-8507-4121cebce57b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:33.337328 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55f45c73-359e-4be9-8507-4121cebce57b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:33.338016 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55f45c73-359e-4be9-8507-4121cebce57b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:33.338946 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55f45c73-359e-4be9-8507-4121cebce57b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:33.339622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55f45c73-359e-4be9-8507-4121cebce57b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:33.340263 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55f45c73-359e-4be9-8507-4121cebce57b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:33.420241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d2078483-8cef-4abb-b58c-21e26c2b3e54 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:33.433572 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d2078483-8cef-4abb-b58c-21e26c2b3e54 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1520 microversion: 2.1 time: 0.504790 Oct 05 02:53:33.437843 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2539/5062] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:32 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1520 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:33.727589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-55f45c73-359e-4be9-8507-4121cebce57b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:33.735913 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-55f45c73-359e-4be9-8507-4121cebce57b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1510 microversion: 2.1 time: 0.414972 Oct 05 02:53:33.736513 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2524/5063] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:33 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1510 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:33.939725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5e9d176d-b780-43eb-856d-28c703f7d71b tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:33.940832 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5e9d176d-b780-43eb-856d-28c703f7d71b tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] [instance: eae2fd86-3940-448d-a3fa-37eae8da4a17] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:33.952883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e9d176d-b780-43eb-856d-28c703f7d71b tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:33.955065 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e9d176d-b780-43eb-856d-28c703f7d71b tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:33.956311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e9d176d-b780-43eb-856d-28c703f7d71b tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:33.957191 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e9d176d-b780-43eb-856d-28c703f7d71b tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:33.962676 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e9d176d-b780-43eb-856d-28c703f7d71b tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:33.965162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e9d176d-b780-43eb-856d-28c703f7d71b tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:34.218340 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5e9d176d-b780-43eb-856d-28c703f7d71b tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef58a16963444eba42e04b0de3747a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c20bf9ac24a0184b2a83bdbe3b7e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:34.228555 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5e9d176d-b780-43eb-856d-28c703f7d71b tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] 10.222.0.16 "GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17" status: 200 len: 1325 microversion: 2.1 time: 0.292972 Oct 05 02:53:34.229966 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2540/5064] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:33 2022] GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17 => generated 1325 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:34.288281 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f84cad42-278c-4c77-b38d-338b322a63eb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:34.289454 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f84cad42-278c-4c77-b38d-338b322a63eb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:34.304197 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:34.306620 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f84cad42-278c-4c77-b38d-338b322a63eb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:34.307675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f84cad42-278c-4c77-b38d-338b322a63eb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:34.308131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f84cad42-278c-4c77-b38d-338b322a63eb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:34.310461 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f84cad42-278c-4c77-b38d-338b322a63eb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:34.311373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f84cad42-278c-4c77-b38d-338b322a63eb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:34.313305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f84cad42-278c-4c77-b38d-338b322a63eb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:34.443714 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=8 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:34.465682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-91c02526-2ee0-4218-a623-fd4c379b367f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:34.466485 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-91c02526-2ee0-4218-a623-fd4c379b367f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:34.481507 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91c02526-2ee0-4218-a623-fd4c379b367f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:34.483447 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91c02526-2ee0-4218-a623-fd4c379b367f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:34.483916 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91c02526-2ee0-4218-a623-fd4c379b367f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:34.487412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91c02526-2ee0-4218-a623-fd4c379b367f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:34.487922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91c02526-2ee0-4218-a623-fd4c379b367f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:34.488426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91c02526-2ee0-4218-a623-fd4c379b367f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:34.792256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f84cad42-278c-4c77-b38d-338b322a63eb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:34.809660 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f84cad42-278c-4c77-b38d-338b322a63eb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:34.811950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f84cad42-278c-4c77-b38d-338b322a63eb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:34.813388 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f84cad42-278c-4c77-b38d-338b322a63eb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 0.531673 Oct 05 02:53:34.813971 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2525/5065] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:53:34 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:53:34.837300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9233d0bc-20dd-4546-bda0-bce71244e85e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:34.837932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9233d0bc-20dd-4546-bda0-bce71244e85e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:34.844331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9233d0bc-20dd-4546-bda0-bce71244e85e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:34.844821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9233d0bc-20dd-4546-bda0-bce71244e85e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:34.845497 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9233d0bc-20dd-4546-bda0-bce71244e85e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:34.846210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9233d0bc-20dd-4546-bda0-bce71244e85e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:34.846671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9233d0bc-20dd-4546-bda0-bce71244e85e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:34.847095 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9233d0bc-20dd-4546-bda0-bce71244e85e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:35.035445 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-91c02526-2ee0-4218-a623-fd4c379b367f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:35.051517 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-91c02526-2ee0-4218-a623-fd4c379b367f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1520 microversion: 2.1 time: 0.595371 Oct 05 02:53:35.059131 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2541/5066] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:34 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1520 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:53:35.258851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-db248b6e-7546-4200-827b-6c07492b9208 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:35.259990 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-db248b6e-7546-4200-827b-6c07492b9208 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] [instance: eae2fd86-3940-448d-a3fa-37eae8da4a17] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:35.274730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db248b6e-7546-4200-827b-6c07492b9208 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:35.277873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db248b6e-7546-4200-827b-6c07492b9208 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:35.278579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db248b6e-7546-4200-827b-6c07492b9208 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:35.283541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db248b6e-7546-4200-827b-6c07492b9208 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:35.285350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db248b6e-7546-4200-827b-6c07492b9208 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:35.287827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db248b6e-7546-4200-827b-6c07492b9208 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:35.424754 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9233d0bc-20dd-4546-bda0-bce71244e85e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:35.435953 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9233d0bc-20dd-4546-bda0-bce71244e85e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1510 microversion: 2.1 time: 0.608500 Oct 05 02:53:35.436541 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2526/5067] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:34 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1510 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:35.479092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-ace8a413-5e38-49ef-87d2-5c7156e940b3 req-4a29ce21-a7b5-42f0-b083-1af6ca619713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ef11e58-0680-4e15-aa40-a4043a5a357a", "name": "network-vif-plugged", "status": "completed", "tag": "4b351d8f-7fd7-478b-adba-19c746dc4014"}, {"server_uuid": "2ef11e58-0680-4e15-aa40-a4043a5a357a", "name": "network-vif-plugged", "status": "completed", "tag": "5b01513e-6840-4e8a-9f16-5f658f55e045"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:53:35.497454 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ace8a413-5e38-49ef-87d2-5c7156e940b3 req-4a29ce21-a7b5-42f0-b083-1af6ca619713 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:35.499217 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ace8a413-5e38-49ef-87d2-5c7156e940b3 req-4a29ce21-a7b5-42f0-b083-1af6ca619713 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:35.502887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ace8a413-5e38-49ef-87d2-5c7156e940b3 req-4a29ce21-a7b5-42f0-b083-1af6ca619713 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:35.527047 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-ace8a413-5e38-49ef-87d2-5c7156e940b3 req-4a29ce21-a7b5-42f0-b083-1af6ca619713 service nova] Creating event network-vif-plugged:4b351d8f-7fd7-478b-adba-19c746dc4014 for instance 2ef11e58-0680-4e15-aa40-a4043a5a357a on n-h1-858272-3 Oct 05 02:53:35.527917 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-ace8a413-5e38-49ef-87d2-5c7156e940b3 req-4a29ce21-a7b5-42f0-b083-1af6ca619713 service nova] Creating event network-vif-plugged:5b01513e-6840-4e8a-9f16-5f658f55e045 for instance 2ef11e58-0680-4e15-aa40-a4043a5a357a on n-h1-858272-3 Oct 05 02:53:35.534470 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-ace8a413-5e38-49ef-87d2-5c7156e940b3 req-4a29ce21-a7b5-42f0-b083-1af6ca619713 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.068742 Oct 05 02:53:35.535770 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2527/5068] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:53:35.753226 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-db248b6e-7546-4200-827b-6c07492b9208 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef58a16963444eba42e04b0de3747a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c20bf9ac24a0184b2a83bdbe3b7e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:35.764979 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-db248b6e-7546-4200-827b-6c07492b9208 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] 10.222.0.16 "GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17" status: 200 len: 1325 microversion: 2.1 time: 0.509080 Oct 05 02:53:35.765840 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2542/5069] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:35 2022] GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17 => generated 1325 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:53:35.847121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6fcc957c-2854-4995-a3ef-30fd725b2675 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:35.848045 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6fcc957c-2854-4995-a3ef-30fd725b2675 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:35.861318 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6fcc957c-2854-4995-a3ef-30fd725b2675 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:35.866708 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6fcc957c-2854-4995-a3ef-30fd725b2675 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:35.867171 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6fcc957c-2854-4995-a3ef-30fd725b2675 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:35.867919 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6fcc957c-2854-4995-a3ef-30fd725b2675 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:35.868387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6fcc957c-2854-4995-a3ef-30fd725b2675 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:35.870590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6fcc957c-2854-4995-a3ef-30fd725b2675 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:36.084270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0828fa68-e824-4c9c-a73a-e2a8bf1d9890 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:36.084990 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0828fa68-e824-4c9c-a73a-e2a8bf1d9890 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:36.097258 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0828fa68-e824-4c9c-a73a-e2a8bf1d9890 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:36.098074 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0828fa68-e824-4c9c-a73a-e2a8bf1d9890 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:36.100466 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0828fa68-e824-4c9c-a73a-e2a8bf1d9890 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:36.101230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0828fa68-e824-4c9c-a73a-e2a8bf1d9890 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:36.101701 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0828fa68-e824-4c9c-a73a-e2a8bf1d9890 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:36.102136 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0828fa68-e824-4c9c-a73a-e2a8bf1d9890 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:36.210958 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6fcc957c-2854-4995-a3ef-30fd725b2675 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:36.222599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6fcc957c-2854-4995-a3ef-30fd725b2675 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:36.236551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6fcc957c-2854-4995-a3ef-30fd725b2675 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:36.237404 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6fcc957c-2854-4995-a3ef-30fd725b2675 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 0.400613 Oct 05 02:53:36.238580 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2528/5070] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:53:35 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:53:36.432476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0828fa68-e824-4c9c-a73a-e2a8bf1d9890 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:36.441495 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0828fa68-e824-4c9c-a73a-e2a8bf1d9890 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1520 microversion: 2.1 time: 0.361655 Oct 05 02:53:36.449798 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2543/5071] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:36 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1520 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:36.460955 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f4785005-4914-4fca-8535-eb103071e375 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:36.461685 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f4785005-4914-4fca-8535-eb103071e375 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:36.482239 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4785005-4914-4fca-8535-eb103071e375 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:36.484981 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4785005-4914-4fca-8535-eb103071e375 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:36.487139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4785005-4914-4fca-8535-eb103071e375 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:36.488588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4785005-4914-4fca-8535-eb103071e375 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:36.492458 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4785005-4914-4fca-8535-eb103071e375 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:36.492935 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4785005-4914-4fca-8535-eb103071e375 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:36.810872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-15eef64c-b84e-4662-9a78-2d8799e2cfb5 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:36.811766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-15eef64c-b84e-4662-9a78-2d8799e2cfb5 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] [instance: eae2fd86-3940-448d-a3fa-37eae8da4a17] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:36.832652 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15eef64c-b84e-4662-9a78-2d8799e2cfb5 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:36.836230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15eef64c-b84e-4662-9a78-2d8799e2cfb5 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:36.837914 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15eef64c-b84e-4662-9a78-2d8799e2cfb5 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:36.838877 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15eef64c-b84e-4662-9a78-2d8799e2cfb5 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:36.842276 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15eef64c-b84e-4662-9a78-2d8799e2cfb5 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:36.845578 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15eef64c-b84e-4662-9a78-2d8799e2cfb5 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:36.956399 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f4785005-4914-4fca-8535-eb103071e375 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:36.967479 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f4785005-4914-4fca-8535-eb103071e375 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1510 microversion: 2.1 time: 0.511479 Oct 05 02:53:36.968063 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2529/5072] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:36 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1510 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:37.160823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-15eef64c-b84e-4662-9a78-2d8799e2cfb5 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef58a16963444eba42e04b0de3747a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c20bf9ac24a0184b2a83bdbe3b7e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:37.176581 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-15eef64c-b84e-4662-9a78-2d8799e2cfb5 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] 10.222.0.16 "GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17" status: 200 len: 1325 microversion: 2.1 time: 0.371053 Oct 05 02:53:37.195228 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2544/5073] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:36 2022] GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17 => generated 1325 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:37.280032 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-14bee9b9-6a66-417e-901a-7647410d5cd0 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:37.281550 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-14bee9b9-6a66-417e-901a-7647410d5cd0 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:37.321691 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14bee9b9-6a66-417e-901a-7647410d5cd0 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:37.325870 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14bee9b9-6a66-417e-901a-7647410d5cd0 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:37.329992 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14bee9b9-6a66-417e-901a-7647410d5cd0 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:37.335251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14bee9b9-6a66-417e-901a-7647410d5cd0 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:37.338240 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14bee9b9-6a66-417e-901a-7647410d5cd0 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:37.342785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14bee9b9-6a66-417e-901a-7647410d5cd0 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:37.357669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:37.469879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b3f8be80-c913-4d3b-9d57-32da7e8e9144 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:37.472859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b3f8be80-c913-4d3b-9d57-32da7e8e9144 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:37.492800 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3f8be80-c913-4d3b-9d57-32da7e8e9144 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:37.494399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3f8be80-c913-4d3b-9d57-32da7e8e9144 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:37.495825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3f8be80-c913-4d3b-9d57-32da7e8e9144 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:37.496762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3f8be80-c913-4d3b-9d57-32da7e8e9144 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:37.498283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3f8be80-c913-4d3b-9d57-32da7e8e9144 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:37.499567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3f8be80-c913-4d3b-9d57-32da7e8e9144 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:38.050899 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b3f8be80-c913-4d3b-9d57-32da7e8e9144 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:38.073556 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b3f8be80-c913-4d3b-9d57-32da7e8e9144 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1520 microversion: 2.1 time: 0.611450 Oct 05 02:53:38.074909 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2545/5074] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:37 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1520 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:38.082032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-76cced1f-0efe-4dbe-86cd-807a76e907b2 req-27c49732-b6b5-4e06-9756-29a199941c92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ef11e58-0680-4e15-aa40-a4043a5a357a", "name": "network-vif-plugged", "status": "completed", "tag": "ac18c1ec-49eb-4408-8eb5-a8e4ce7d4e0d"}, {"server_uuid": "2ef11e58-0680-4e15-aa40-a4043a5a357a", "name": "network-vif-plugged", "status": "completed", "tag": "5fa0dbc4-38a1-4d15-bfed-c34585b87d54"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:53:38.103438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-14bee9b9-6a66-417e-901a-7647410d5cd0 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:38.110784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-76cced1f-0efe-4dbe-86cd-807a76e907b2 req-27c49732-b6b5-4e06-9756-29a199941c92 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:38.118378 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-76cced1f-0efe-4dbe-86cd-807a76e907b2 req-27c49732-b6b5-4e06-9756-29a199941c92 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:38.119139 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-76cced1f-0efe-4dbe-86cd-807a76e907b2 req-27c49732-b6b5-4e06-9756-29a199941c92 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:38.119300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-14bee9b9-6a66-417e-901a-7647410d5cd0 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:38.120696 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-14bee9b9-6a66-417e-901a-7647410d5cd0 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:38.127625 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-14bee9b9-6a66-417e-901a-7647410d5cd0 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 0.861390 Oct 05 02:53:38.133044 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2530/5075] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:53:37 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:53:38.143857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-10554a2e-ecbd-43a6-a7f4-5373638b5c6a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:38.145287 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-76cced1f-0efe-4dbe-86cd-807a76e907b2 req-27c49732-b6b5-4e06-9756-29a199941c92 service nova] Creating event network-vif-plugged:ac18c1ec-49eb-4408-8eb5-a8e4ce7d4e0d for instance 2ef11e58-0680-4e15-aa40-a4043a5a357a on n-h1-858272-3 Oct 05 02:53:38.145698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-10554a2e-ecbd-43a6-a7f4-5373638b5c6a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:38.156500 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-76cced1f-0efe-4dbe-86cd-807a76e907b2 req-27c49732-b6b5-4e06-9756-29a199941c92 service nova] Creating event network-vif-plugged:5fa0dbc4-38a1-4d15-bfed-c34585b87d54 for instance 2ef11e58-0680-4e15-aa40-a4043a5a357a on n-h1-858272-3 Oct 05 02:53:38.156824 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10554a2e-ecbd-43a6-a7f4-5373638b5c6a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:38.158084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10554a2e-ecbd-43a6-a7f4-5373638b5c6a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:38.159168 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10554a2e-ecbd-43a6-a7f4-5373638b5c6a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:38.160065 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10554a2e-ecbd-43a6-a7f4-5373638b5c6a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:38.160881 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10554a2e-ecbd-43a6-a7f4-5373638b5c6a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:38.162023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10554a2e-ecbd-43a6-a7f4-5373638b5c6a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:38.165887 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-76cced1f-0efe-4dbe-86cd-807a76e907b2 req-27c49732-b6b5-4e06-9756-29a199941c92 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.089203 Oct 05 02:53:38.167266 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2546/5076] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:53:38.205053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6d5d5956-e6fe-42bf-b753-1bea37107e34 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:38.206407 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6d5d5956-e6fe-42bf-b753-1bea37107e34 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] [instance: eae2fd86-3940-448d-a3fa-37eae8da4a17] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:38.219179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6d5d5956-e6fe-42bf-b753-1bea37107e34 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:38.219718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6d5d5956-e6fe-42bf-b753-1bea37107e34 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:38.220169 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6d5d5956-e6fe-42bf-b753-1bea37107e34 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:38.220944 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6d5d5956-e6fe-42bf-b753-1bea37107e34 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:38.221400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6d5d5956-e6fe-42bf-b753-1bea37107e34 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:38.221834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6d5d5956-e6fe-42bf-b753-1bea37107e34 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:38.329329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-10554a2e-ecbd-43a6-a7f4-5373638b5c6a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:38.344015 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-10554a2e-ecbd-43a6-a7f4-5373638b5c6a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1510 microversion: 2.1 time: 0.204579 Oct 05 02:53:38.344939 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2531/5077] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:38 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1510 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:38.512847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6d5d5956-e6fe-42bf-b753-1bea37107e34 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef58a16963444eba42e04b0de3747a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c20bf9ac24a0184b2a83bdbe3b7e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:38.527235 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6d5d5956-e6fe-42bf-b753-1bea37107e34 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] 10.222.0.16 "GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17" status: 200 len: 1325 microversion: 2.1 time: 0.328931 Oct 05 02:53:38.528279 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2547/5078] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:38 2022] GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17 => generated 1325 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:53:39.102772 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f2505820-0984-428a-a27f-e67df02b5ad5 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:39.103976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f2505820-0984-428a-a27f-e67df02b5ad5 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:39.115352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2505820-0984-428a-a27f-e67df02b5ad5 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:39.116238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2505820-0984-428a-a27f-e67df02b5ad5 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:39.117016 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2505820-0984-428a-a27f-e67df02b5ad5 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:39.117984 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2505820-0984-428a-a27f-e67df02b5ad5 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:39.121238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2505820-0984-428a-a27f-e67df02b5ad5 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:39.122517 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2505820-0984-428a-a27f-e67df02b5ad5 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:39.159045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f954ef26-6d92-4309-80cb-486c1a4e8643 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:39.159691 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f954ef26-6d92-4309-80cb-486c1a4e8643 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:39.168717 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f954ef26-6d92-4309-80cb-486c1a4e8643 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:39.170657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f954ef26-6d92-4309-80cb-486c1a4e8643 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:39.171311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f954ef26-6d92-4309-80cb-486c1a4e8643 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:39.172040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f954ef26-6d92-4309-80cb-486c1a4e8643 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:39.173798 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f954ef26-6d92-4309-80cb-486c1a4e8643 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:39.174687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f954ef26-6d92-4309-80cb-486c1a4e8643 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:39.522355 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f2505820-0984-428a-a27f-e67df02b5ad5 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:39.531005 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f2505820-0984-428a-a27f-e67df02b5ad5 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1520 microversion: 2.1 time: 0.433419 Oct 05 02:53:39.532062 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2532/5079] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:39 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1520 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:53:39.540422 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f954ef26-6d92-4309-80cb-486c1a4e8643 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:39.542351 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1b634ee2-1300-4444-9bc5-31c48b89312a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:39.543483 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1b634ee2-1300-4444-9bc5-31c48b89312a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:39.556947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b634ee2-1300-4444-9bc5-31c48b89312a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:39.557200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f954ef26-6d92-4309-80cb-486c1a4e8643 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:39.557446 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b634ee2-1300-4444-9bc5-31c48b89312a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:39.558072 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b634ee2-1300-4444-9bc5-31c48b89312a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:39.558581 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f954ef26-6d92-4309-80cb-486c1a4e8643 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:39.559268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b634ee2-1300-4444-9bc5-31c48b89312a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:39.560113 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b634ee2-1300-4444-9bc5-31c48b89312a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:39.560737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b634ee2-1300-4444-9bc5-31c48b89312a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:39.567318 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f954ef26-6d92-4309-80cb-486c1a4e8643 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 0.408415 Oct 05 02:53:39.568376 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2548/5080] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:53:39 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:53:39.583732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ee967304-da34-4d0a-997c-6befd02c5fae tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:39.584669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ee967304-da34-4d0a-997c-6befd02c5fae tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] [instance: eae2fd86-3940-448d-a3fa-37eae8da4a17] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:39.594778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee967304-da34-4d0a-997c-6befd02c5fae tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:39.595284 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee967304-da34-4d0a-997c-6befd02c5fae tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:39.595728 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee967304-da34-4d0a-997c-6befd02c5fae tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:39.596446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee967304-da34-4d0a-997c-6befd02c5fae tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:39.596961 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee967304-da34-4d0a-997c-6befd02c5fae tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:39.601204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee967304-da34-4d0a-997c-6befd02c5fae tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:39.917549 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1b634ee2-1300-4444-9bc5-31c48b89312a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:39.925676 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1b634ee2-1300-4444-9bc5-31c48b89312a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1510 microversion: 2.1 time: 0.391101 Oct 05 02:53:39.926268 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2533/5081] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:39 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1510 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:39.949304 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ee967304-da34-4d0a-997c-6befd02c5fae tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef58a16963444eba42e04b0de3747a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c20bf9ac24a0184b2a83bdbe3b7e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:39.957764 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ee967304-da34-4d0a-997c-6befd02c5fae tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] 10.222.0.16 "GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17" status: 200 len: 1325 microversion: 2.1 time: 0.377985 Oct 05 02:53:39.959650 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2549/5082] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:39 2022] GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17 => generated 1325 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:40.235161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-58cb885e-c51a-48c1-ae3a-d99622c4a8fd req-805217c2-aeee-450b-9c7c-9902c09992ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ef11e58-0680-4e15-aa40-a4043a5a357a", "name": "network-vif-plugged", "status": "completed", "tag": "f9e588d4-a8fb-4137-b6aa-9752d8fb56f6"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:53:40.247476 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-58cb885e-c51a-48c1-ae3a-d99622c4a8fd req-805217c2-aeee-450b-9c7c-9902c09992ef service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:40.247955 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-58cb885e-c51a-48c1-ae3a-d99622c4a8fd req-805217c2-aeee-450b-9c7c-9902c09992ef service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:40.248613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-58cb885e-c51a-48c1-ae3a-d99622c4a8fd req-805217c2-aeee-450b-9c7c-9902c09992ef service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:40.265313 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-58cb885e-c51a-48c1-ae3a-d99622c4a8fd req-805217c2-aeee-450b-9c7c-9902c09992ef service nova] Creating event network-vif-plugged:f9e588d4-a8fb-4137-b6aa-9752d8fb56f6 for instance 2ef11e58-0680-4e15-aa40-a4043a5a357a on n-h1-858272-3 Oct 05 02:53:40.271643 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-58cb885e-c51a-48c1-ae3a-d99622c4a8fd req-805217c2-aeee-450b-9c7c-9902c09992ef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040864 Oct 05 02:53:40.272659 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2534/5083] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:53:40.557675 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-18c9e3aa-21b5-43b6-831d-a2521dec1fc9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:40.559158 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-18c9e3aa-21b5-43b6-831d-a2521dec1fc9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:40.569685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-18c9e3aa-21b5-43b6-831d-a2521dec1fc9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:40.570441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-18c9e3aa-21b5-43b6-831d-a2521dec1fc9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:40.571327 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-18c9e3aa-21b5-43b6-831d-a2521dec1fc9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:40.572550 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-18c9e3aa-21b5-43b6-831d-a2521dec1fc9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:40.573219 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-18c9e3aa-21b5-43b6-831d-a2521dec1fc9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:40.574230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-18c9e3aa-21b5-43b6-831d-a2521dec1fc9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:40.595500 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e0b1d9be-1d9d-4f96-8151-5309f281c275 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:40.596466 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e0b1d9be-1d9d-4f96-8151-5309f281c275 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:40.612541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0b1d9be-1d9d-4f96-8151-5309f281c275 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:40.616013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0b1d9be-1d9d-4f96-8151-5309f281c275 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:40.617384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0b1d9be-1d9d-4f96-8151-5309f281c275 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:40.618347 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0b1d9be-1d9d-4f96-8151-5309f281c275 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:40.621801 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0b1d9be-1d9d-4f96-8151-5309f281c275 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:40.622364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0b1d9be-1d9d-4f96-8151-5309f281c275 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:40.914533 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-18c9e3aa-21b5-43b6-831d-a2521dec1fc9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:40.931736 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-18c9e3aa-21b5-43b6-831d-a2521dec1fc9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1520 microversion: 2.1 time: 0.378234 Oct 05 02:53:40.935129 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2550/5084] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:40 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1520 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:40.937772 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e0b1d9be-1d9d-4f96-8151-5309f281c275 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:40.949983 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-55920217-5455-41b9-9970-fbe2f8c17ea4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:40.950394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e0b1d9be-1d9d-4f96-8151-5309f281c275 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:40.950641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-55920217-5455-41b9-9970-fbe2f8c17ea4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:40.954128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e0b1d9be-1d9d-4f96-8151-5309f281c275 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:40.955353 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e0b1d9be-1d9d-4f96-8151-5309f281c275 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 0.364608 Oct 05 02:53:40.955944 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2535/5085] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:53:40 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:53:40.958207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55920217-5455-41b9-9970-fbe2f8c17ea4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:40.959124 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55920217-5455-41b9-9970-fbe2f8c17ea4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:40.959776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55920217-5455-41b9-9970-fbe2f8c17ea4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:40.960701 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55920217-5455-41b9-9970-fbe2f8c17ea4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:40.961468 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55920217-5455-41b9-9970-fbe2f8c17ea4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:40.962073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55920217-5455-41b9-9970-fbe2f8c17ea4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:40.984810 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8417024b-3532-438c-a787-9ebfe6788590 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:40.985748 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8417024b-3532-438c-a787-9ebfe6788590 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] [instance: eae2fd86-3940-448d-a3fa-37eae8da4a17] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:41.000398 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8417024b-3532-438c-a787-9ebfe6788590 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:41.001465 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:41.002410 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8417024b-3532-438c-a787-9ebfe6788590 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:41.003073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8417024b-3532-438c-a787-9ebfe6788590 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:41.006468 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8417024b-3532-438c-a787-9ebfe6788590 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:41.008600 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8417024b-3532-438c-a787-9ebfe6788590 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:41.009327 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8417024b-3532-438c-a787-9ebfe6788590 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:41.469176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8417024b-3532-438c-a787-9ebfe6788590 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef58a16963444eba42e04b0de3747a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c20bf9ac24a0184b2a83bdbe3b7e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:41.485408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-55920217-5455-41b9-9970-fbe2f8c17ea4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:41.505617 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-55920217-5455-41b9-9970-fbe2f8c17ea4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1510 microversion: 2.1 time: 0.551547 Oct 05 02:53:41.507410 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2551/5086] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:40 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1510 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:41.513015 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8417024b-3532-438c-a787-9ebfe6788590 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] 10.222.0.16 "GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17" status: 200 len: 1325 microversion: 2.1 time: 0.529814 Oct 05 02:53:41.515170 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2536/5087] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:40 2022] GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17 => generated 1325 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:53:41.962261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0f4fd6cc-e9fd-4a2a-bb6b-878691cd6a72 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:41.963521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0f4fd6cc-e9fd-4a2a-bb6b-878691cd6a72 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:41.980960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0f4fd6cc-e9fd-4a2a-bb6b-878691cd6a72 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:41.982461 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0f4fd6cc-e9fd-4a2a-bb6b-878691cd6a72 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:41.983615 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3e400a4d-3a62-48de-af35-cd2f8a0c5163 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:41.985361 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3e400a4d-3a62-48de-af35-cd2f8a0c5163 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:41.986004 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0f4fd6cc-e9fd-4a2a-bb6b-878691cd6a72 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:41.986784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0f4fd6cc-e9fd-4a2a-bb6b-878691cd6a72 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:41.990561 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0f4fd6cc-e9fd-4a2a-bb6b-878691cd6a72 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:41.991283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0f4fd6cc-e9fd-4a2a-bb6b-878691cd6a72 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:41.998932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e400a4d-3a62-48de-af35-cd2f8a0c5163 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:42.001861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e400a4d-3a62-48de-af35-cd2f8a0c5163 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:42.002489 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e400a4d-3a62-48de-af35-cd2f8a0c5163 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:42.004336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e400a4d-3a62-48de-af35-cd2f8a0c5163 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:42.008419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e400a4d-3a62-48de-af35-cd2f8a0c5163 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:42.009197 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e400a4d-3a62-48de-af35-cd2f8a0c5163 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:42.490439 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3e400a4d-3a62-48de-af35-cd2f8a0c5163 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:42.534137 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3e400a4d-3a62-48de-af35-cd2f8a0c5163 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:42.538081 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3e400a4d-3a62-48de-af35-cd2f8a0c5163 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:42.540668 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3e400a4d-3a62-48de-af35-cd2f8a0c5163 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1880 microversion: 2.32 time: 0.561280 Oct 05 02:53:42.555165 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2537/5088] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:53:41 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1880 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:53:42.568274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-e6fa2451-2ba1-4c2c-9d0d-b406d06daa5f req-0cb39809-0592-4a22-bc14-a21a11d125ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eae2fd86-3940-448d-a3fa-37eae8da4a17", "name": "network-vif-plugged", "status": "completed", "tag": "19f37c3c-c1f8-4fed-becd-ffd58c29ae3d"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:53:42.568537 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0f4fd6cc-e9fd-4a2a-bb6b-878691cd6a72 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:42.584147 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e6fa2451-2ba1-4c2c-9d0d-b406d06daa5f req-0cb39809-0592-4a22-bc14-a21a11d125ba service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:42.585867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e6fa2451-2ba1-4c2c-9d0d-b406d06daa5f req-0cb39809-0592-4a22-bc14-a21a11d125ba service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:42.586473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e6fa2451-2ba1-4c2c-9d0d-b406d06daa5f req-0cb39809-0592-4a22-bc14-a21a11d125ba service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:42.601248 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-e6fa2451-2ba1-4c2c-9d0d-b406d06daa5f req-0cb39809-0592-4a22-bc14-a21a11d125ba service nova] Creating event network-vif-plugged:19f37c3c-c1f8-4fed-becd-ffd58c29ae3d for instance eae2fd86-3940-448d-a3fa-37eae8da4a17 on n-h2-858272-3 Oct 05 02:53:42.603425 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0f4fd6cc-e9fd-4a2a-bb6b-878691cd6a72 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1520 microversion: 2.1 time: 0.642740 Oct 05 02:53:42.604075 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2552/5089] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:41 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1520 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:42.613785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7b751d9f-7aa1-4062-9c80-0c1a69972c41 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:42.613785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7b751d9f-7aa1-4062-9c80-0c1a69972c41 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:42.622967 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-e6fa2451-2ba1-4c2c-9d0d-b406d06daa5f req-0cb39809-0592-4a22-bc14-a21a11d125ba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057936 Oct 05 02:53:42.626323 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2538/5090] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:53:42.631213 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b751d9f-7aa1-4062-9c80-0c1a69972c41 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:42.631444 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b751d9f-7aa1-4062-9c80-0c1a69972c41 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:42.631847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b751d9f-7aa1-4062-9c80-0c1a69972c41 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:42.632575 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b751d9f-7aa1-4062-9c80-0c1a69972c41 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:42.633415 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b751d9f-7aa1-4062-9c80-0c1a69972c41 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:42.633855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b751d9f-7aa1-4062-9c80-0c1a69972c41 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:42.647838 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4efdf9be-9138-4f6e-83d0-86612993ab5f tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:42.649049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4efdf9be-9138-4f6e-83d0-86612993ab5f tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] [instance: eae2fd86-3940-448d-a3fa-37eae8da4a17] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:42.661978 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4efdf9be-9138-4f6e-83d0-86612993ab5f tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:42.665167 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4efdf9be-9138-4f6e-83d0-86612993ab5f tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:42.665909 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4efdf9be-9138-4f6e-83d0-86612993ab5f tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:42.666807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4efdf9be-9138-4f6e-83d0-86612993ab5f tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:42.669332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4efdf9be-9138-4f6e-83d0-86612993ab5f tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:42.669948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4efdf9be-9138-4f6e-83d0-86612993ab5f tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:43.139141 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7b751d9f-7aa1-4062-9c80-0c1a69972c41 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:43.157728 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7b751d9f-7aa1-4062-9c80-0c1a69972c41 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1510 microversion: 2.1 time: 0.550783 Oct 05 02:53:43.158979 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2553/5091] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:42 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1510 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:43.184131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4efdf9be-9138-4f6e-83d0-86612993ab5f tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef58a16963444eba42e04b0de3747a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c20bf9ac24a0184b2a83bdbe3b7e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:43.195815 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4efdf9be-9138-4f6e-83d0-86612993ab5f tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] 10.222.0.16 "GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17" status: 200 len: 1325 microversion: 2.1 time: 0.563391 Oct 05 02:53:43.196721 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2539/5092] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:42 2022] GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17 => generated 1325 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:43.573032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5b6d6303-6dcc-440a-a929-bc5061e5cbc6 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:43.573656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5b6d6303-6dcc-440a-a929-bc5061e5cbc6 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:43.581154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5b6d6303-6dcc-440a-a929-bc5061e5cbc6 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:43.582014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5b6d6303-6dcc-440a-a929-bc5061e5cbc6 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:43.582671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5b6d6303-6dcc-440a-a929-bc5061e5cbc6 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:43.583400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5b6d6303-6dcc-440a-a929-bc5061e5cbc6 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:43.584039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5b6d6303-6dcc-440a-a929-bc5061e5cbc6 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:43.584637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5b6d6303-6dcc-440a-a929-bc5061e5cbc6 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:43.629240 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-47783ea7-0d87-4d6a-9836-7279b8241805 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:43.632683 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-47783ea7-0d87-4d6a-9836-7279b8241805 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:43.648606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47783ea7-0d87-4d6a-9836-7279b8241805 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:43.649652 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47783ea7-0d87-4d6a-9836-7279b8241805 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:43.650283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47783ea7-0d87-4d6a-9836-7279b8241805 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:43.651324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47783ea7-0d87-4d6a-9836-7279b8241805 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:43.652406 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47783ea7-0d87-4d6a-9836-7279b8241805 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:43.653293 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47783ea7-0d87-4d6a-9836-7279b8241805 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:44.080252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5b6d6303-6dcc-440a-a929-bc5061e5cbc6 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:44.090098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-47783ea7-0d87-4d6a-9836-7279b8241805 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:44.099442 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-47783ea7-0d87-4d6a-9836-7279b8241805 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1520 microversion: 2.1 time: 0.476261 Oct 05 02:53:44.115437 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2540/5093] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:43 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1520 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:53:44.115711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5b6d6303-6dcc-440a-a929-bc5061e5cbc6 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:44.115711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5b6d6303-6dcc-440a-a929-bc5061e5cbc6 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:44.115711 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5b6d6303-6dcc-440a-a929-bc5061e5cbc6 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 2833 microversion: 2.32 time: 0.546524 Oct 05 02:53:44.115711 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2554/5094] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:53:43 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 2833 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:53:44.144936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d35c429e-af42-457d-a307-fb8f38f3ccd0 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:44.144936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d35c429e-af42-457d-a307-fb8f38f3ccd0 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:44.155140 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d35c429e-af42-457d-a307-fb8f38f3ccd0 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:44.155915 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d35c429e-af42-457d-a307-fb8f38f3ccd0 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:44.156394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d35c429e-af42-457d-a307-fb8f38f3ccd0 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:44.157532 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d35c429e-af42-457d-a307-fb8f38f3ccd0 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:44.158001 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d35c429e-af42-457d-a307-fb8f38f3ccd0 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:44.158697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d35c429e-af42-457d-a307-fb8f38f3ccd0 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:44.185003 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ce8882a7-0b3d-4e8e-98d7-0b4472654d50 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:44.186597 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ce8882a7-0b3d-4e8e-98d7-0b4472654d50 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:44.198149 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce8882a7-0b3d-4e8e-98d7-0b4472654d50 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:44.198967 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce8882a7-0b3d-4e8e-98d7-0b4472654d50 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:44.199637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce8882a7-0b3d-4e8e-98d7-0b4472654d50 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:44.200521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce8882a7-0b3d-4e8e-98d7-0b4472654d50 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:44.201191 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce8882a7-0b3d-4e8e-98d7-0b4472654d50 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:44.201773 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce8882a7-0b3d-4e8e-98d7-0b4472654d50 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:44.738137 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d35c429e-af42-457d-a307-fb8f38f3ccd0 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.598581 Oct 05 02:53:44.739780 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2541/5095] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Oct 5 02:53:44 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a/os-interface => generated 1831 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:53:44.746748 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5058336e-36f3-4762-aba0-195712547f65 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:44.747647 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5058336e-36f3-4762-aba0-195712547f65 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] [instance: eae2fd86-3940-448d-a3fa-37eae8da4a17] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:44.775416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5058336e-36f3-4762-aba0-195712547f65 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:44.776571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5058336e-36f3-4762-aba0-195712547f65 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:44.777098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5058336e-36f3-4762-aba0-195712547f65 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:44.780030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5058336e-36f3-4762-aba0-195712547f65 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:44.780548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5058336e-36f3-4762-aba0-195712547f65 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:44.782090 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5058336e-36f3-4762-aba0-195712547f65 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:44.869350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ce8882a7-0b3d-4e8e-98d7-0b4472654d50 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:44.889831 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ce8882a7-0b3d-4e8e-98d7-0b4472654d50 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1510 microversion: 2.1 time: 0.709875 Oct 05 02:53:44.890884 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2555/5096] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:44 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1510 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:45.083439 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5058336e-36f3-4762-aba0-195712547f65 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef58a16963444eba42e04b0de3747a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c20bf9ac24a0184b2a83bdbe3b7e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:45.091117 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5058336e-36f3-4762-aba0-195712547f65 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] 10.222.0.16 "GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17" status: 200 len: 1522 microversion: 2.1 time: 0.349009 Oct 05 02:53:45.105858 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2542/5097] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:44 2022] GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17 => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:45.116285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9bc29a72-6bf5-433b-b035-404da5f3550b tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:45.117090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9bc29a72-6bf5-433b-b035-404da5f3550b tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] [instance: eae2fd86-3940-448d-a3fa-37eae8da4a17] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:45.123688 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c1dd7dd2-cc26-4a6e-844d-dd2b2fbf17da tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:45.124576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c1dd7dd2-cc26-4a6e-844d-dd2b2fbf17da tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:45.134013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1dd7dd2-cc26-4a6e-844d-dd2b2fbf17da tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:45.134853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1dd7dd2-cc26-4a6e-844d-dd2b2fbf17da tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:45.135757 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1dd7dd2-cc26-4a6e-844d-dd2b2fbf17da tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:45.136778 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1dd7dd2-cc26-4a6e-844d-dd2b2fbf17da tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:45.137657 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1dd7dd2-cc26-4a6e-844d-dd2b2fbf17da tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:45.138261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1dd7dd2-cc26-4a6e-844d-dd2b2fbf17da tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:45.138722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9bc29a72-6bf5-433b-b035-404da5f3550b tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:45.139341 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9bc29a72-6bf5-433b-b035-404da5f3550b tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:45.142688 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9bc29a72-6bf5-433b-b035-404da5f3550b tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:45.143558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9bc29a72-6bf5-433b-b035-404da5f3550b tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:45.144127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9bc29a72-6bf5-433b-b035-404da5f3550b tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:45.144660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9bc29a72-6bf5-433b-b035-404da5f3550b tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:45.212763 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-9bc29a72-6bf5-433b-b035-404da5f3550b tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] HTTP exception thrown: Action 999 not found Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9bc29a72-6bf5-433b-b035-404da5f3550b tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Request method failure captured: Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17/os-instance-actions/999 HTTP/1.1 Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPGi_LPbZeavoZfSazid6g1mZ4sJQDZXRU6P_YK7aqPbO9yx09vOBXlLgSaNrBTbZO-cGf_MLaz53Nbu-hu3JApaoDNP4YdN3DHMmJB5f7mTg7jG7a7BQY9OdbCNC5_XUpBAzKGSa8kCaaUovdacqkRBO5xY9Ydd7ZLLGfnG7JrmeFE Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 8a0c20bf9ac24a0184b2a83bdbe3b7e8 Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-132896216 Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8a0c20bf9ac24a0184b2a83bdbe3b7e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8a0c20bf9ac24a0184b2a83bdbe3b7e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8a0c20bf9ac24a0184b2a83bdbe3b7e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8a0c20bf9ac24a0184b2a83bdbe3b7e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-132896216 Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 8a0c20bf9ac24a0184b2a83bdbe3b7e8 Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-132896216 Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-InstanceActionsNegativeTestJSON-132896216-project Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 7ef58a16963444eba42e04b0de3747a2 Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-132896216-project Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: exception: Action 999 not found Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'server_id': 'eae2fd86-3940-448d-a3fa-37eae8da4a17', 'id': '999'} Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 05 02:53:45.225638 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:45.230703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9bc29a72-6bf5-433b-b035-404da5f3550b tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Returning 404 to user: Action 999 not found {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:53:45.230703 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9bc29a72-6bf5-433b-b035-404da5f3550b tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] 10.222.0.16 "GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.115524 Oct 05 02:53:45.237304 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2556/5098] 10.222.0.16 () {58 vars in 1308 bytes} [Wed Oct 5 02:53:45 2022] GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17/os-instance-actions/999 => generated 66 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:53:45.246590 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c99e5722-7eb0-40f2-8d0d-c0579916b79d tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Calling method '.version_select at 0x7fccdf196160>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:45.247438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c99e5722-7eb0-40f2-8d0d-c0579916b79d tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] [instance: a97c9bc7-594a-4ff1-8efc-6845361f56bf] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:45.258022 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-c99e5722-7eb0-40f2-8d0d-c0579916b79d tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] HTTP exception thrown: Instance a97c9bc7-594a-4ff1-8efc-6845361f56bf could not be found. Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c99e5722-7eb0-40f2-8d0d-c0579916b79d tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Request method failure captured: Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/a97c9bc7-594a-4ff1-8efc-6845361f56bf/os-instance-actions HTTP/1.1 Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPGi_LPbZeavoZfSazid6g1mZ4sJQDZXRU6P_YK7aqPbO9yx09vOBXlLgSaNrBTbZO-cGf_MLaz53Nbu-hu3JApaoDNP4YdN3DHMmJB5f7mTg7jG7a7BQY9OdbCNC5_XUpBAzKGSa8kCaaUovdacqkRBO5xY9Ydd7ZLLGfnG7JrmeFE Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 8a0c20bf9ac24a0184b2a83bdbe3b7e8 Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-132896216 Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8a0c20bf9ac24a0184b2a83bdbe3b7e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8a0c20bf9ac24a0184b2a83bdbe3b7e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8a0c20bf9ac24a0184b2a83bdbe3b7e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8a0c20bf9ac24a0184b2a83bdbe3b7e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-132896216 Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 8a0c20bf9ac24a0184b2a83bdbe3b7e8 Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-132896216 Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-InstanceActionsNegativeTestJSON-132896216-project Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 7ef58a16963444eba42e04b0de3747a2 Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-132896216-project Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance a97c9bc7-594a-4ff1-8efc-6845361f56bf could not be found. Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'server_id': 'a97c9bc7-594a-4ff1-8efc-6845361f56bf'} Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a97c9bc7-594a-4ff1-8efc-6845361f56bf could not be found. Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:53:45.260668 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:53:45.266068 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a97c9bc7-594a-4ff1-8efc-6845361f56bf could not be found. Oct 05 02:53:45.266068 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:45.266068 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:53:45.266068 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:45.266068 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:45.266068 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:53:45.266068 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:53:45.266068 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:53:45.266068 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:53:45.266068 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a97c9bc7-594a-4ff1-8efc-6845361f56bf could not be found. Oct 05 02:53:45.266068 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:53:45.269015 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c99e5722-7eb0-40f2-8d0d-c0579916b79d tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Returning 404 to user: Instance a97c9bc7-594a-4ff1-8efc-6845361f56bf could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:53:45.271283 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c99e5722-7eb0-40f2-8d0d-c0579916b79d tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] 10.222.0.16 "GET /compute/v2.1/servers/a97c9bc7-594a-4ff1-8efc-6845361f56bf/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.033127 Oct 05 02:53:45.276857 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2557/5099] 10.222.0.16 () {58 vars in 1296 bytes} [Wed Oct 5 02:53:45 2022] GET /compute/v2.1/servers/a97c9bc7-594a-4ff1-8efc-6845361f56bf/os-instance-actions => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:53:45.283901 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d01ac491-ac63-4061-96ca-f4c2529d5a02 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:45.284601 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d01ac491-ac63-4061-96ca-f4c2529d5a02 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] [instance: eae2fd86-3940-448d-a3fa-37eae8da4a17] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:45.294139 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d01ac491-ac63-4061-96ca-f4c2529d5a02 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:45.295165 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d01ac491-ac63-4061-96ca-f4c2529d5a02 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:45.295929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d01ac491-ac63-4061-96ca-f4c2529d5a02 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:45.296819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d01ac491-ac63-4061-96ca-f4c2529d5a02 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:45.297580 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d01ac491-ac63-4061-96ca-f4c2529d5a02 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:45.298181 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d01ac491-ac63-4061-96ca-f4c2529d5a02 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:45.336888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d01ac491-ac63-4061-96ca-f4c2529d5a02 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] [instance: eae2fd86-3940-448d-a3fa-37eae8da4a17] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:53:45.359290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c1dd7dd2-cc26-4a6e-844d-dd2b2fbf17da tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:45.375010 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c1dd7dd2-cc26-4a6e-844d-dd2b2fbf17da tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1520 microversion: 2.1 time: 0.255811 Oct 05 02:53:45.384944 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2543/5100] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:45 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:45.475559 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d01ac491-ac63-4061-96ca-f4c2529d5a02 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17" status: 204 len: 0 microversion: 2.1 time: 0.196591 Oct 05 02:53:45.477001 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2558/5101] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:53:45 2022] DELETE /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:53:45.485321 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e6a3ce64-9111-41c5-a251-22ec12eac91c tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:45.485862 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e6a3ce64-9111-41c5-a251-22ec12eac91c tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] [instance: eae2fd86-3940-448d-a3fa-37eae8da4a17] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:45.493571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e6a3ce64-9111-41c5-a251-22ec12eac91c tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:45.494357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e6a3ce64-9111-41c5-a251-22ec12eac91c tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:45.494986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e6a3ce64-9111-41c5-a251-22ec12eac91c tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:45.495897 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e6a3ce64-9111-41c5-a251-22ec12eac91c tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:45.496363 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e6a3ce64-9111-41c5-a251-22ec12eac91c tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:45.496792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e6a3ce64-9111-41c5-a251-22ec12eac91c tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:45.865925 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e6a3ce64-9111-41c5-a251-22ec12eac91c tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef58a16963444eba42e04b0de3747a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c20bf9ac24a0184b2a83bdbe3b7e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:45.883053 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e6a3ce64-9111-41c5-a251-22ec12eac91c tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] 10.222.0.16 "GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17" status: 200 len: 1528 microversion: 2.1 time: 0.399605 Oct 05 02:53:45.883875 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2544/5102] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:45 2022] GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17 => generated 1528 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:45.921092 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a894df90-9577-4c03-9020-e6714124eece tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:45.922408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a894df90-9577-4c03-9020-e6714124eece tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:45.936339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a894df90-9577-4c03-9020-e6714124eece tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:45.936863 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a894df90-9577-4c03-9020-e6714124eece tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:45.937499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a894df90-9577-4c03-9020-e6714124eece tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:45.938633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a894df90-9577-4c03-9020-e6714124eece tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:45.939486 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a894df90-9577-4c03-9020-e6714124eece tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:45.940916 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a894df90-9577-4c03-9020-e6714124eece tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:46.182367 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a894df90-9577-4c03-9020-e6714124eece tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:46.190787 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a894df90-9577-4c03-9020-e6714124eece tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1510 microversion: 2.1 time: 0.274815 Oct 05 02:53:46.191676 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2559/5103] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:45 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1510 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:46.401459 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c3cd077c-518e-4002-b568-6162340f3103 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:46.402387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c3cd077c-518e-4002-b568-6162340f3103 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:46.409374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3cd077c-518e-4002-b568-6162340f3103 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:46.410162 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3cd077c-518e-4002-b568-6162340f3103 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:46.410607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3cd077c-518e-4002-b568-6162340f3103 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:46.412458 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3cd077c-518e-4002-b568-6162340f3103 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:46.413297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3cd077c-518e-4002-b568-6162340f3103 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:46.413937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3cd077c-518e-4002-b568-6162340f3103 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:46.591736 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c3cd077c-518e-4002-b568-6162340f3103 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:46.605174 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c3cd077c-518e-4002-b568-6162340f3103 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1520 microversion: 2.1 time: 0.207498 Oct 05 02:53:46.610340 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2545/5104] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:46 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:46.907401 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b61b58a5-7365-4d2c-8979-dfccb111198a tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:46.909317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b61b58a5-7365-4d2c-8979-dfccb111198a tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] [instance: eae2fd86-3940-448d-a3fa-37eae8da4a17] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:46.931034 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b61b58a5-7365-4d2c-8979-dfccb111198a tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:46.931851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b61b58a5-7365-4d2c-8979-dfccb111198a tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:46.932482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b61b58a5-7365-4d2c-8979-dfccb111198a tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:46.933434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b61b58a5-7365-4d2c-8979-dfccb111198a tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:46.934278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b61b58a5-7365-4d2c-8979-dfccb111198a tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:46.934895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b61b58a5-7365-4d2c-8979-dfccb111198a tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:46.972204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-a3d373b3-514a-4923-accd-bbb30ed24fa9 req-05da31b9-f213-4179-8503-710fcce095d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ef11e58-0680-4e15-aa40-a4043a5a357a", "tag": "384505a1-ac43-4ab5-a021-9305e81770ae"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:53:46.986553 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a3d373b3-514a-4923-accd-bbb30ed24fa9 req-05da31b9-f213-4179-8503-710fcce095d0 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:46.987148 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a3d373b3-514a-4923-accd-bbb30ed24fa9 req-05da31b9-f213-4179-8503-710fcce095d0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:46.987659 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a3d373b3-514a-4923-accd-bbb30ed24fa9 req-05da31b9-f213-4179-8503-710fcce095d0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:47.003737 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-a3d373b3-514a-4923-accd-bbb30ed24fa9 req-05da31b9-f213-4179-8503-710fcce095d0 service nova] Creating event network-changed:384505a1-ac43-4ab5-a021-9305e81770ae for instance 2ef11e58-0680-4e15-aa40-a4043a5a357a on n-h1-858272-3 Oct 05 02:53:47.011900 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-a3d373b3-514a-4923-accd-bbb30ed24fa9 req-05da31b9-f213-4179-8503-710fcce095d0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.278874 Oct 05 02:53:47.013838 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2560/5105] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:53:47.217077 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6fc34aa6-eaec-4ad7-92b7-2dc4409cf877 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:47.218077 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6fc34aa6-eaec-4ad7-92b7-2dc4409cf877 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:47.227746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6fc34aa6-eaec-4ad7-92b7-2dc4409cf877 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:47.228685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6fc34aa6-eaec-4ad7-92b7-2dc4409cf877 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:47.229557 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6fc34aa6-eaec-4ad7-92b7-2dc4409cf877 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:47.231228 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6fc34aa6-eaec-4ad7-92b7-2dc4409cf877 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:47.232054 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6fc34aa6-eaec-4ad7-92b7-2dc4409cf877 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:47.233301 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6fc34aa6-eaec-4ad7-92b7-2dc4409cf877 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:47.393944 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b61b58a5-7365-4d2c-8979-dfccb111198a tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef58a16963444eba42e04b0de3747a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c20bf9ac24a0184b2a83bdbe3b7e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:47.415394 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b61b58a5-7365-4d2c-8979-dfccb111198a tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] 10.222.0.16 "GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17" status: 200 len: 1528 microversion: 2.1 time: 0.512445 Oct 05 02:53:47.436039 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2546/5106] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:46 2022] GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17 => generated 1528 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:47.633785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-434dbb1c-69c4-4d6d-96f5-9b695ee4fb67 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:47.635050 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-434dbb1c-69c4-4d6d-96f5-9b695ee4fb67 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:47.642441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-434dbb1c-69c4-4d6d-96f5-9b695ee4fb67 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:47.643149 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-434dbb1c-69c4-4d6d-96f5-9b695ee4fb67 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:47.643786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-434dbb1c-69c4-4d6d-96f5-9b695ee4fb67 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:47.644672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-434dbb1c-69c4-4d6d-96f5-9b695ee4fb67 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:47.645546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-434dbb1c-69c4-4d6d-96f5-9b695ee4fb67 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:47.647098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-434dbb1c-69c4-4d6d-96f5-9b695ee4fb67 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:47.711697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6fc34aa6-eaec-4ad7-92b7-2dc4409cf877 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:47.720813 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6fc34aa6-eaec-4ad7-92b7-2dc4409cf877 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1510 microversion: 2.1 time: 0.509083 Oct 05 02:53:47.721433 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2561/5107] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:47 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1510 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:48.179776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-434dbb1c-69c4-4d6d-96f5-9b695ee4fb67 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:48.190427 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-434dbb1c-69c4-4d6d-96f5-9b695ee4fb67 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1520 microversion: 2.1 time: 0.562322 Oct 05 02:53:48.204261 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2547/5108] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:47 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1520 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:53:48.439339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-246fa7ca-f27d-457d-bc71-6b7aa82b65ab tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:48.439974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-246fa7ca-f27d-457d-bc71-6b7aa82b65ab tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] [instance: eae2fd86-3940-448d-a3fa-37eae8da4a17] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:48.461200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-246fa7ca-f27d-457d-bc71-6b7aa82b65ab tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:48.461954 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-246fa7ca-f27d-457d-bc71-6b7aa82b65ab tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:48.462400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-246fa7ca-f27d-457d-bc71-6b7aa82b65ab tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:48.463118 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-246fa7ca-f27d-457d-bc71-6b7aa82b65ab tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:48.463581 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-246fa7ca-f27d-457d-bc71-6b7aa82b65ab tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:48.464051 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-246fa7ca-f27d-457d-bc71-6b7aa82b65ab tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:48.636708 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-246fa7ca-f27d-457d-bc71-6b7aa82b65ab tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef58a16963444eba42e04b0de3747a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c20bf9ac24a0184b2a83bdbe3b7e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:48.653407 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-246fa7ca-f27d-457d-bc71-6b7aa82b65ab tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] 10.222.0.16 "GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17" status: 200 len: 1486 microversion: 2.1 time: 0.215067 Oct 05 02:53:48.655658 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2562/5109] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:48 2022] GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17 => generated 1486 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:48.750483 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-845162c1-8df4-4622-b2ce-7cb16ef50e74 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:48.751364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-845162c1-8df4-4622-b2ce-7cb16ef50e74 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:48.768002 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-845162c1-8df4-4622-b2ce-7cb16ef50e74 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:48.769953 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-845162c1-8df4-4622-b2ce-7cb16ef50e74 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:48.772158 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-845162c1-8df4-4622-b2ce-7cb16ef50e74 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:48.774161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-845162c1-8df4-4622-b2ce-7cb16ef50e74 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:48.774537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-845162c1-8df4-4622-b2ce-7cb16ef50e74 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:48.776036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-845162c1-8df4-4622-b2ce-7cb16ef50e74 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:48.815466 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-8d5a69bb-8de5-4e2b-a979-3d658b07e630 req-f361270c-ba48-4487-9608-c963b1d845bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eae2fd86-3940-448d-a3fa-37eae8da4a17", "name": "network-vif-deleted", "tag": "19f37c3c-c1f8-4fed-becd-ffd58c29ae3d"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:53:48.859074 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-8d5a69bb-8de5-4e2b-a979-3d658b07e630 req-f361270c-ba48-4487-9608-c963b1d845bf service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:48.859556 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-8d5a69bb-8de5-4e2b-a979-3d658b07e630 req-f361270c-ba48-4487-9608-c963b1d845bf service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:48.860067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-8d5a69bb-8de5-4e2b-a979-3d658b07e630 req-f361270c-ba48-4487-9608-c963b1d845bf service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:48.893182 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:48.898912 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-8d5a69bb-8de5-4e2b-a979-3d658b07e630 req-f361270c-ba48-4487-9608-c963b1d845bf service nova] Creating event network-vif-deleted:19f37c3c-c1f8-4fed-becd-ffd58c29ae3d for instance eae2fd86-3940-448d-a3fa-37eae8da4a17 on n-h2-858272-3 Oct 05 02:53:48.937334 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-8d5a69bb-8de5-4e2b-a979-3d658b07e630 req-f361270c-ba48-4487-9608-c963b1d845bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117049 Oct 05 02:53:48.938316 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2563/5110] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:53:49.179980 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-845162c1-8df4-4622-b2ce-7cb16ef50e74 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:49.193721 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-845162c1-8df4-4622-b2ce-7cb16ef50e74 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1510 microversion: 2.1 time: 0.451770 Oct 05 02:53:49.195601 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2548/5111] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:48 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1510 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:49.219619 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-562d7ad5-46c1-42bd-8cff-bf8f9992cf5f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:49.222641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-562d7ad5-46c1-42bd-8cff-bf8f9992cf5f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:49.241345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:49.244151 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-562d7ad5-46c1-42bd-8cff-bf8f9992cf5f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:49.245472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-562d7ad5-46c1-42bd-8cff-bf8f9992cf5f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:49.246334 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-562d7ad5-46c1-42bd-8cff-bf8f9992cf5f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:49.247763 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-562d7ad5-46c1-42bd-8cff-bf8f9992cf5f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:49.248477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-562d7ad5-46c1-42bd-8cff-bf8f9992cf5f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:49.249402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-562d7ad5-46c1-42bd-8cff-bf8f9992cf5f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:49.584287 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-562d7ad5-46c1-42bd-8cff-bf8f9992cf5f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:49.616474 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-562d7ad5-46c1-42bd-8cff-bf8f9992cf5f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1520 microversion: 2.1 time: 0.399244 Oct 05 02:53:49.619418 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2564/5112] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:49 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1520 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:49.683399 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5d74e650-796b-484f-9025-9e3f7e2d7dec tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:49.684023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5d74e650-796b-484f-9025-9e3f7e2d7dec tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] [instance: eae2fd86-3940-448d-a3fa-37eae8da4a17] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:49.691594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d74e650-796b-484f-9025-9e3f7e2d7dec tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:49.693144 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d74e650-796b-484f-9025-9e3f7e2d7dec tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:49.704186 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d74e650-796b-484f-9025-9e3f7e2d7dec tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:49.705163 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d74e650-796b-484f-9025-9e3f7e2d7dec tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:49.710760 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d74e650-796b-484f-9025-9e3f7e2d7dec tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:49.711350 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d74e650-796b-484f-9025-9e3f7e2d7dec tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:49.767784 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d74e650-796b-484f-9025-9e3f7e2d7dec tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:49.768550 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d74e650-796b-484f-9025-9e3f7e2d7dec tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:49.769450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d74e650-796b-484f-9025-9e3f7e2d7dec tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:49.770853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-5d74e650-796b-484f-9025-9e3f7e2d7dec tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lazy-loading 'fault' on Instance uuid eae2fd86-3940-448d-a3fa-37eae8da4a17 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:53:50.219749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-22bfd00a-0a9f-4efd-be5e-910d781beaf6 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:50.220378 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-22bfd00a-0a9f-4efd-be5e-910d781beaf6 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:50.229596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22bfd00a-0a9f-4efd-be5e-910d781beaf6 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:50.230109 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22bfd00a-0a9f-4efd-be5e-910d781beaf6 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:50.232660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22bfd00a-0a9f-4efd-be5e-910d781beaf6 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:50.238500 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22bfd00a-0a9f-4efd-be5e-910d781beaf6 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:50.239509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22bfd00a-0a9f-4efd-be5e-910d781beaf6 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:50.240198 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22bfd00a-0a9f-4efd-be5e-910d781beaf6 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:50.327532 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5d74e650-796b-484f-9025-9e3f7e2d7dec tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef58a16963444eba42e04b0de3747a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a0c20bf9ac24a0184b2a83bdbe3b7e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:50.342940 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5d74e650-796b-484f-9025-9e3f7e2d7dec tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] 10.222.0.16 "GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17" status: 200 len: 1315 microversion: 2.1 time: 0.662464 Oct 05 02:53:50.364421 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2549/5113] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:49 2022] GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17 => generated 1315 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:50.455805 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-22bfd00a-0a9f-4efd-be5e-910d781beaf6 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:50.480115 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-22bfd00a-0a9f-4efd-be5e-910d781beaf6 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1510 microversion: 2.1 time: 0.261214 Oct 05 02:53:50.486662 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2565/5114] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:50 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1510 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:53:50.641996 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e60e8d54-5197-4e0d-a4e9-1e9d40071a40 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:50.642895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e60e8d54-5197-4e0d-a4e9-1e9d40071a40 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:50.649889 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e60e8d54-5197-4e0d-a4e9-1e9d40071a40 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:50.650633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e60e8d54-5197-4e0d-a4e9-1e9d40071a40 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:50.651250 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e60e8d54-5197-4e0d-a4e9-1e9d40071a40 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:50.652129 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e60e8d54-5197-4e0d-a4e9-1e9d40071a40 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:50.652802 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e60e8d54-5197-4e0d-a4e9-1e9d40071a40 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:50.653443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e60e8d54-5197-4e0d-a4e9-1e9d40071a40 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:50.920613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e60e8d54-5197-4e0d-a4e9-1e9d40071a40 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:50.956242 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e60e8d54-5197-4e0d-a4e9-1e9d40071a40 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1520 microversion: 2.1 time: 0.318128 Oct 05 02:53:50.956845 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2550/5115] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:50 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1520 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:51.198715 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-631a1a0b-11be-42b3-aec5-9924a4af7352 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:51.199316 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-631a1a0b-11be-42b3-aec5-9924a4af7352 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] [instance: a1c78871-374e-41d9-af4a-d8284ccb8508] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:51.206068 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-631a1a0b-11be-42b3-aec5-9924a4af7352 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:51.206607 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-631a1a0b-11be-42b3-aec5-9924a4af7352 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:51.207233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-631a1a0b-11be-42b3-aec5-9924a4af7352 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:51.208280 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-631a1a0b-11be-42b3-aec5-9924a4af7352 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:51.208839 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-631a1a0b-11be-42b3-aec5-9924a4af7352 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:51.209479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-631a1a0b-11be-42b3-aec5-9924a4af7352 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:51.236073 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-631a1a0b-11be-42b3-aec5-9924a4af7352 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] 10.222.0.16 "GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.041261 Oct 05 02:53:51.237069 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2566/5116] 10.222.0.16 () {58 vars in 1293 bytes} [Wed Oct 5 02:53:51 2022] GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508/os-server-password => generated 116 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:53:51.370779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cb860a03-f21e-4fae-a2c7-2812e0deb353 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:51.375628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cb860a03-f21e-4fae-a2c7-2812e0deb353 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] [instance: eae2fd86-3940-448d-a3fa-37eae8da4a17] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:51.384310 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cb860a03-f21e-4fae-a2c7-2812e0deb353 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:51.384809 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cb860a03-f21e-4fae-a2c7-2812e0deb353 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:51.385288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cb860a03-f21e-4fae-a2c7-2812e0deb353 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:51.385995 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cb860a03-f21e-4fae-a2c7-2812e0deb353 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:51.386456 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cb860a03-f21e-4fae-a2c7-2812e0deb353 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:51.386877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cb860a03-f21e-4fae-a2c7-2812e0deb353 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:51.410737 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-cb860a03-f21e-4fae-a2c7-2812e0deb353 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] HTTP exception thrown: Instance eae2fd86-3940-448d-a3fa-37eae8da4a17 could not be found. Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cb860a03-f21e-4fae-a2c7-2812e0deb353 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Request method failure captured: Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17 HTTP/1.1 Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPGi_LPbZeavoZfSazid6g1mZ4sJQDZXRU6P_YK7aqPbO9yx09vOBXlLgSaNrBTbZO-cGf_MLaz53Nbu-hu3JApaoDNP4YdN3DHMmJB5f7mTg7jG7a7BQY9OdbCNC5_XUpBAzKGSa8kCaaUovdacqkRBO5xY9Ydd7ZLLGfnG7JrmeFE Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 8a0c20bf9ac24a0184b2a83bdbe3b7e8 Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-132896216 Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8a0c20bf9ac24a0184b2a83bdbe3b7e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8a0c20bf9ac24a0184b2a83bdbe3b7e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8a0c20bf9ac24a0184b2a83bdbe3b7e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8a0c20bf9ac24a0184b2a83bdbe3b7e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-132896216 Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 8a0c20bf9ac24a0184b2a83bdbe3b7e8 Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-132896216 Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-InstanceActionsNegativeTestJSON-132896216-project Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 7ef58a16963444eba42e04b0de3747a2 Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-132896216-project Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance eae2fd86-3940-448d-a3fa-37eae8da4a17 could not be found. Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'eae2fd86-3940-448d-a3fa-37eae8da4a17'} Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eae2fd86-3940-448d-a3fa-37eae8da4a17 could not be found. Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eae2fd86-3940-448d-a3fa-37eae8da4a17 could not be found. Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:53:51.424236 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:53:51.430111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:53:51.430111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:53:51.430111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:53:51.430111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:53:51.430111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:53:51.430111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:53:51.430111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eae2fd86-3940-448d-a3fa-37eae8da4a17 could not be found. Oct 05 02:53:51.430111 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:53:51.430111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cb860a03-f21e-4fae-a2c7-2812e0deb353 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] Returning 404 to user: Instance eae2fd86-3940-448d-a3fa-37eae8da4a17 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:53:51.430111 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cb860a03-f21e-4fae-a2c7-2812e0deb353 tempest-InstanceActionsNegativeTestJSON-132896216 tempest-InstanceActionsNegativeTestJSON-132896216-project] 10.222.0.16 "GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17" status: 404 len: 111 microversion: 2.1 time: 0.059354 Oct 05 02:53:51.430111 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2551/5117] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:51 2022] GET /compute/v2.1/servers/eae2fd86-3940-448d-a3fa-37eae8da4a17 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:53:51.521136 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d1e4f42d-6553-4a1d-9f66-c1e3b6e4933c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:51.522744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d1e4f42d-6553-4a1d-9f66-c1e3b6e4933c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:51.538041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d1e4f42d-6553-4a1d-9f66-c1e3b6e4933c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:51.538853 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d1e4f42d-6553-4a1d-9f66-c1e3b6e4933c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:51.539471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d1e4f42d-6553-4a1d-9f66-c1e3b6e4933c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:51.540375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d1e4f42d-6553-4a1d-9f66-c1e3b6e4933c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:51.541045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d1e4f42d-6553-4a1d-9f66-c1e3b6e4933c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:51.543132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d1e4f42d-6553-4a1d-9f66-c1e3b6e4933c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:51.932178 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d1e4f42d-6553-4a1d-9f66-c1e3b6e4933c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:51.938334 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d1e4f42d-6553-4a1d-9f66-c1e3b6e4933c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1510 microversion: 2.1 time: 0.427746 Oct 05 02:53:51.939478 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2567/5118] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:51 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1510 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:51.990318 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2176d3b7-f0c3-4ce2-a9f4-6d5c4e2cc7f0 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:51.990943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2176d3b7-f0c3-4ce2-a9f4-6d5c4e2cc7f0 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:51.998021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2176d3b7-f0c3-4ce2-a9f4-6d5c4e2cc7f0 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:51.998761 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2176d3b7-f0c3-4ce2-a9f4-6d5c4e2cc7f0 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:51.999402 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2176d3b7-f0c3-4ce2-a9f4-6d5c4e2cc7f0 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:52.000298 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2176d3b7-f0c3-4ce2-a9f4-6d5c4e2cc7f0 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:52.001215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2176d3b7-f0c3-4ce2-a9f4-6d5c4e2cc7f0 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:52.001812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2176d3b7-f0c3-4ce2-a9f4-6d5c4e2cc7f0 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:52.207277 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2176d3b7-f0c3-4ce2-a9f4-6d5c4e2cc7f0 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:52.217271 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2176d3b7-f0c3-4ce2-a9f4-6d5c4e2cc7f0 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1520 microversion: 2.1 time: 0.231638 Oct 05 02:53:52.229525 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2552/5119] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:51 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:52.965158 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-08c5fba0-9b04-4b3d-9a76-64e1cce242f9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:52.966438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-08c5fba0-9b04-4b3d-9a76-64e1cce242f9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:52.982895 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08c5fba0-9b04-4b3d-9a76-64e1cce242f9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:52.983995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08c5fba0-9b04-4b3d-9a76-64e1cce242f9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:52.984613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08c5fba0-9b04-4b3d-9a76-64e1cce242f9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:52.985559 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08c5fba0-9b04-4b3d-9a76-64e1cce242f9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:52.986318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08c5fba0-9b04-4b3d-9a76-64e1cce242f9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:52.987339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08c5fba0-9b04-4b3d-9a76-64e1cce242f9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:53.243257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a36a5c25-8c1b-4885-8ff2-b42bba2ab6f4 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:53.244557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a36a5c25-8c1b-4885-8ff2-b42bba2ab6f4 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:53.255135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-08c5fba0-9b04-4b3d-9a76-64e1cce242f9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:53.255841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a36a5c25-8c1b-4885-8ff2-b42bba2ab6f4 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:53.256338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a36a5c25-8c1b-4885-8ff2-b42bba2ab6f4 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:53.257082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a36a5c25-8c1b-4885-8ff2-b42bba2ab6f4 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:53.258307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a36a5c25-8c1b-4885-8ff2-b42bba2ab6f4 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:53.258978 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a36a5c25-8c1b-4885-8ff2-b42bba2ab6f4 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:53.261609 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a36a5c25-8c1b-4885-8ff2-b42bba2ab6f4 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:53.268354 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-08c5fba0-9b04-4b3d-9a76-64e1cce242f9 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1531 microversion: 2.1 time: 0.309886 Oct 05 02:53:53.269343 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2568/5120] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:52 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1531 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:53.532886 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a36a5c25-8c1b-4885-8ff2-b42bba2ab6f4 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:53.561443 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a36a5c25-8c1b-4885-8ff2-b42bba2ab6f4 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1520 microversion: 2.1 time: 0.322654 Oct 05 02:53:53.562613 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2553/5121] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:53 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1520 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:54.293400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3f69559f-7ba9-41fb-821b-06cb5f1b2774 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:54.294027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3f69559f-7ba9-41fb-821b-06cb5f1b2774 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:54.304396 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f69559f-7ba9-41fb-821b-06cb5f1b2774 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:54.307288 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f69559f-7ba9-41fb-821b-06cb5f1b2774 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:54.308122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f69559f-7ba9-41fb-821b-06cb5f1b2774 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:54.308871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f69559f-7ba9-41fb-821b-06cb5f1b2774 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:54.309377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f69559f-7ba9-41fb-821b-06cb5f1b2774 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:54.309837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f69559f-7ba9-41fb-821b-06cb5f1b2774 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:54.326132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:54.531030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3f69559f-7ba9-41fb-821b-06cb5f1b2774 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:54.546487 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3f69559f-7ba9-41fb-821b-06cb5f1b2774 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1531 microversion: 2.1 time: 0.255156 Oct 05 02:53:54.547383 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2569/5122] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:54 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1531 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:54.587969 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b6453fe2-5db9-491c-b0dc-9dce020ee08f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:54.589361 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b6453fe2-5db9-491c-b0dc-9dce020ee08f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:54.601970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6453fe2-5db9-491c-b0dc-9dce020ee08f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:54.602962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6453fe2-5db9-491c-b0dc-9dce020ee08f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:54.604973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6453fe2-5db9-491c-b0dc-9dce020ee08f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:54.605909 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6453fe2-5db9-491c-b0dc-9dce020ee08f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:54.606551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6453fe2-5db9-491c-b0dc-9dce020ee08f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:54.607159 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6453fe2-5db9-491c-b0dc-9dce020ee08f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:54.875252 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b6453fe2-5db9-491c-b0dc-9dce020ee08f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:54.903157 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b6453fe2-5db9-491c-b0dc-9dce020ee08f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1520 microversion: 2.1 time: 0.319815 Oct 05 02:53:54.905124 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2554/5123] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:54 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1520 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:55.572372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4143b96f-27c1-419b-82e0-2cb149217e76 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:55.573806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4143b96f-27c1-419b-82e0-2cb149217e76 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:55.581860 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4143b96f-27c1-419b-82e0-2cb149217e76 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:55.583469 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4143b96f-27c1-419b-82e0-2cb149217e76 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:55.584339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4143b96f-27c1-419b-82e0-2cb149217e76 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:55.585315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4143b96f-27c1-419b-82e0-2cb149217e76 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:55.585825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4143b96f-27c1-419b-82e0-2cb149217e76 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:55.586424 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4143b96f-27c1-419b-82e0-2cb149217e76 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:55.881209 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4143b96f-27c1-419b-82e0-2cb149217e76 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:55.913907 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4143b96f-27c1-419b-82e0-2cb149217e76 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1531 microversion: 2.1 time: 0.342516 Oct 05 02:53:55.916356 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2570/5124] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:55 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1531 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:55.929804 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3c658699-e3fe-42d0-88c1-16fb38fae1d7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:55.930431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3c658699-e3fe-42d0-88c1-16fb38fae1d7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:55.940321 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3c658699-e3fe-42d0-88c1-16fb38fae1d7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:55.940802 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3c658699-e3fe-42d0-88c1-16fb38fae1d7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:55.949540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3c658699-e3fe-42d0-88c1-16fb38fae1d7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:55.950377 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3c658699-e3fe-42d0-88c1-16fb38fae1d7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:55.951150 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3c658699-e3fe-42d0-88c1-16fb38fae1d7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:55.951564 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3c658699-e3fe-42d0-88c1-16fb38fae1d7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:56.246391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3c658699-e3fe-42d0-88c1-16fb38fae1d7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:56.273633 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3c658699-e3fe-42d0-88c1-16fb38fae1d7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1520 microversion: 2.1 time: 0.348446 Oct 05 02:53:56.287092 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2555/5125] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:55 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1520 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:56.946597 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-317a467d-0447-4bfd-b1b7-cd1e31b3bc57 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:56.947371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-317a467d-0447-4bfd-b1b7-cd1e31b3bc57 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:56.961250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-317a467d-0447-4bfd-b1b7-cd1e31b3bc57 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:56.961850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-317a467d-0447-4bfd-b1b7-cd1e31b3bc57 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:56.962450 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-317a467d-0447-4bfd-b1b7-cd1e31b3bc57 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:56.963400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-317a467d-0447-4bfd-b1b7-cd1e31b3bc57 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:56.964203 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-317a467d-0447-4bfd-b1b7-cd1e31b3bc57 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:56.964955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-317a467d-0447-4bfd-b1b7-cd1e31b3bc57 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:57.251953 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-317a467d-0447-4bfd-b1b7-cd1e31b3bc57 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:57.265305 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-317a467d-0447-4bfd-b1b7-cd1e31b3bc57 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1531 microversion: 2.1 time: 0.325142 Oct 05 02:53:57.266482 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2571/5126] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:56 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1531 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:57.302917 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a309ff43-87cd-4e73-9102-2a245dc03c15 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:57.304659 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a309ff43-87cd-4e73-9102-2a245dc03c15 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:57.316319 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a309ff43-87cd-4e73-9102-2a245dc03c15 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:57.317474 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a309ff43-87cd-4e73-9102-2a245dc03c15 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:57.317985 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a309ff43-87cd-4e73-9102-2a245dc03c15 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:57.319390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a309ff43-87cd-4e73-9102-2a245dc03c15 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:57.320502 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a309ff43-87cd-4e73-9102-2a245dc03c15 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:57.321304 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a309ff43-87cd-4e73-9102-2a245dc03c15 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:57.487136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a309ff43-87cd-4e73-9102-2a245dc03c15 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:57.496529 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a309ff43-87cd-4e73-9102-2a245dc03c15 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1520 microversion: 2.1 time: 0.198314 Oct 05 02:53:57.509331 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2556/5127] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:57 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:58.294526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-22736840-5ed8-4c19-85ef-4c411c4b83c8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:58.295253 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-22736840-5ed8-4c19-85ef-4c411c4b83c8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:58.303858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22736840-5ed8-4c19-85ef-4c411c4b83c8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:58.304501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22736840-5ed8-4c19-85ef-4c411c4b83c8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:58.305116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22736840-5ed8-4c19-85ef-4c411c4b83c8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:58.305963 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22736840-5ed8-4c19-85ef-4c411c4b83c8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:58.306934 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22736840-5ed8-4c19-85ef-4c411c4b83c8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:58.307746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22736840-5ed8-4c19-85ef-4c411c4b83c8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:58.506725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-22736840-5ed8-4c19-85ef-4c411c4b83c8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:58.507481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-2a972d49-6259-42b8-8d13-da17209cbec9 req-91148012-14fc-488c-9830-92061d440e36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fded3d6-d275-4d50-a366-d19388f8aaec", "name": "network-vif-plugged", "status": "completed", "tag": "877cbc45-f570-4bb6-bcd2-91b67dbccdb3"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:53:58.519570 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-22736840-5ed8-4c19-85ef-4c411c4b83c8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1531 microversion: 2.1 time: 0.228735 Oct 05 02:53:58.523213 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2572/5128] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:58 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1531 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:58.533212 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-2a972d49-6259-42b8-8d13-da17209cbec9 req-91148012-14fc-488c-9830-92061d440e36 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:58.537754 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-2a972d49-6259-42b8-8d13-da17209cbec9 req-91148012-14fc-488c-9830-92061d440e36 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:58.539032 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-2a972d49-6259-42b8-8d13-da17209cbec9 req-91148012-14fc-488c-9830-92061d440e36 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:58.555593 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-2a972d49-6259-42b8-8d13-da17209cbec9 req-91148012-14fc-488c-9830-92061d440e36 service nova] Creating event network-vif-plugged:877cbc45-f570-4bb6-bcd2-91b67dbccdb3 for instance 1fded3d6-d275-4d50-a366-d19388f8aaec on n-h2-858272-3 Oct 05 02:53:58.555879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ee5d5a82-b1a8-492f-9b08-6056e819104f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:58.556999 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ee5d5a82-b1a8-492f-9b08-6056e819104f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:58.563053 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-2a972d49-6259-42b8-8d13-da17209cbec9 req-91148012-14fc-488c-9830-92061d440e36 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059618 Oct 05 02:53:58.564590 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2557/5129] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:53:58.572050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee5d5a82-b1a8-492f-9b08-6056e819104f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:58.572793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee5d5a82-b1a8-492f-9b08-6056e819104f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:58.574058 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee5d5a82-b1a8-492f-9b08-6056e819104f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:58.575268 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee5d5a82-b1a8-492f-9b08-6056e819104f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:58.576005 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee5d5a82-b1a8-492f-9b08-6056e819104f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:58.576936 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee5d5a82-b1a8-492f-9b08-6056e819104f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:58.851796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ee5d5a82-b1a8-492f-9b08-6056e819104f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:58.878609 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ee5d5a82-b1a8-492f-9b08-6056e819104f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1520 microversion: 2.1 time: 0.349405 Oct 05 02:53:58.897650 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2573/5130] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:58 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1520 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:59.547588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fd5ccb87-b36a-4eac-9296-3fcde06fa6d3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:59.548927 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fd5ccb87-b36a-4eac-9296-3fcde06fa6d3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:59.561049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fd5ccb87-b36a-4eac-9296-3fcde06fa6d3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:59.562084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fd5ccb87-b36a-4eac-9296-3fcde06fa6d3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:59.563241 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fd5ccb87-b36a-4eac-9296-3fcde06fa6d3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:59.565046 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fd5ccb87-b36a-4eac-9296-3fcde06fa6d3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:59.566114 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fd5ccb87-b36a-4eac-9296-3fcde06fa6d3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:59.567317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fd5ccb87-b36a-4eac-9296-3fcde06fa6d3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:59.839591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-481df170-167b-4e03-a193-cd047dcc91dd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-996709922", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "9db48f3d-4eaf-41a1-b1a3-e77394828488"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:53:59.842699 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fd5ccb87-b36a-4eac-9296-3fcde06fa6d3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:53:59.860859 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fd5ccb87-b36a-4eac-9296-3fcde06fa6d3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1531 microversion: 2.1 time: 0.318072 Oct 05 02:53:59.865209 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2558/5131] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:59 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1531 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:53:59.914764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-481df170-167b-4e03-a193-cd047dcc91dd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] validate_networks() for [('9db48f3d-4eaf-41a1-b1a3-e77394828488', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:53:59.923734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b89f5a9b-f8c9-43ea-b3cc-7faaf2b5ec9b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:53:59.924770 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b89f5a9b-f8c9-43ea-b3cc-7faaf2b5ec9b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:53:59.932380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b89f5a9b-f8c9-43ea-b3cc-7faaf2b5ec9b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:59.933222 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b89f5a9b-f8c9-43ea-b3cc-7faaf2b5ec9b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:59.933845 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b89f5a9b-f8c9-43ea-b3cc-7faaf2b5ec9b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:53:59.934804 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b89f5a9b-f8c9-43ea-b3cc-7faaf2b5ec9b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:53:59.936270 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b89f5a9b-f8c9-43ea-b3cc-7faaf2b5ec9b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:53:59.936962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b89f5a9b-f8c9-43ea-b3cc-7faaf2b5ec9b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:00.292286 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b89f5a9b-f8c9-43ea-b3cc-7faaf2b5ec9b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:00.308500 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b89f5a9b-f8c9-43ea-b3cc-7faaf2b5ec9b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1520 microversion: 2.1 time: 0.384494 Oct 05 02:54:00.309409 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2559/5132] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:53:59 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1520 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:54:00.890727 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-54980939-6339-4492-8f8b-28a1aa312bf5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:00.892277 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-54980939-6339-4492-8f8b-28a1aa312bf5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:00.910983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54980939-6339-4492-8f8b-28a1aa312bf5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:00.913378 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54980939-6339-4492-8f8b-28a1aa312bf5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:00.913841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54980939-6339-4492-8f8b-28a1aa312bf5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:00.916442 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54980939-6339-4492-8f8b-28a1aa312bf5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:00.917502 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54980939-6339-4492-8f8b-28a1aa312bf5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:00.918010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54980939-6339-4492-8f8b-28a1aa312bf5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:01.340823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-481df170-167b-4e03-a193-cd047dcc91dd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:54:01.341462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-481df170-167b-4e03-a193-cd047dcc91dd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:54:01.342121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-481df170-167b-4e03-a193-cd047dcc91dd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:54:01.342715 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-481df170-167b-4e03-a193-cd047dcc91dd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:54:01.343137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-481df170-167b-4e03-a193-cd047dcc91dd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:54:01.362239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-481df170-167b-4e03-a193-cd047dcc91dd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:01.363786 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-481df170-167b-4e03-a193-cd047dcc91dd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:01.364248 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-481df170-167b-4e03-a193-cd047dcc91dd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:01.365097 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-481df170-167b-4e03-a193-cd047dcc91dd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:01.365567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-481df170-167b-4e03-a193-cd047dcc91dd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:01.369941 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-481df170-167b-4e03-a193-cd047dcc91dd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:01.400651 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-54980939-6339-4492-8f8b-28a1aa312bf5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:01.414595 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-54980939-6339-4492-8f8b-28a1aa312bf5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1526 microversion: 2.1 time: 0.531356 Oct 05 02:54:01.416623 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2560/5133] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:00 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1526 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:01.422330 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-380c2c07-fe3f-49e2-abda-5de488164a59 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:01.423132 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-380c2c07-fe3f-49e2-abda-5de488164a59 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:01.423303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-481df170-167b-4e03-a193-cd047dcc91dd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Getting quotas for project dfa44fa2dc3c4df4bc34ff14deaf21ef. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:54:01.431408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-481df170-167b-4e03-a193-cd047dcc91dd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Getting quotas for user 2825041f8aa2462f8719a0f124e0b8a0 and project dfa44fa2dc3c4df4bc34ff14deaf21ef. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:54:01.439708 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-380c2c07-fe3f-49e2-abda-5de488164a59 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:01.440365 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-380c2c07-fe3f-49e2-abda-5de488164a59 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:01.440979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-380c2c07-fe3f-49e2-abda-5de488164a59 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:01.442651 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-380c2c07-fe3f-49e2-abda-5de488164a59 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:01.443529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-380c2c07-fe3f-49e2-abda-5de488164a59 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:01.444133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-380c2c07-fe3f-49e2-abda-5de488164a59 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:01.451812 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-481df170-167b-4e03-a193-cd047dcc91dd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:54:01.454806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-481df170-167b-4e03-a193-cd047dcc91dd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: d39cd597-890f-4cc8-8d05-9a1b65f9ab32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:54:01.536440 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-481df170-167b-4e03-a193-cd047dcc91dd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.943718 Oct 05 02:54:01.553019 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2574/5134] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:53:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 02:54:01.823594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-380c2c07-fe3f-49e2-abda-5de488164a59 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:01.838513 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-380c2c07-fe3f-49e2-abda-5de488164a59 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1520 microversion: 2.1 time: 0.420297 Oct 05 02:54:01.838981 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2561/5135] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:01 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1520 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:01.931564 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-eebfd713-a995-46b9-a6c8-5aa549112dd5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-153837827", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "9db48f3d-4eaf-41a1-b1a3-e77394828488"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:54:02.078285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-eebfd713-a995-46b9-a6c8-5aa549112dd5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] validate_networks() for [('9db48f3d-4eaf-41a1-b1a3-e77394828488', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:54:02.439780 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8ce67529-f4e4-4822-aa3d-7b8d1b91d24f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:02.441104 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8ce67529-f4e4-4822-aa3d-7b8d1b91d24f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:02.454058 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ce67529-f4e4-4822-aa3d-7b8d1b91d24f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:02.457185 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ce67529-f4e4-4822-aa3d-7b8d1b91d24f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:02.459042 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ce67529-f4e4-4822-aa3d-7b8d1b91d24f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:02.461600 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ce67529-f4e4-4822-aa3d-7b8d1b91d24f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:02.463447 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ce67529-f4e4-4822-aa3d-7b8d1b91d24f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:02.465932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ce67529-f4e4-4822-aa3d-7b8d1b91d24f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:03.086238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8ce67529-f4e4-4822-aa3d-7b8d1b91d24f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:03.103629 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8ce67529-f4e4-4822-aa3d-7b8d1b91d24f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1526 microversion: 2.1 time: 0.668255 Oct 05 02:54:03.126910 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2562/5136] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:02 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1526 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:03.153014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-07703346-0a29-40e6-8f7b-18449c7a71a3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:03.155046 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-07703346-0a29-40e6-8f7b-18449c7a71a3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:03.172049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07703346-0a29-40e6-8f7b-18449c7a71a3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:03.181038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07703346-0a29-40e6-8f7b-18449c7a71a3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:03.182833 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07703346-0a29-40e6-8f7b-18449c7a71a3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:03.183610 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07703346-0a29-40e6-8f7b-18449c7a71a3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:03.184085 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07703346-0a29-40e6-8f7b-18449c7a71a3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:03.184518 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07703346-0a29-40e6-8f7b-18449c7a71a3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:03.185382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-eebfd713-a995-46b9-a6c8-5aa549112dd5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:54:03.186437 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-eebfd713-a995-46b9-a6c8-5aa549112dd5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:54:03.187069 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-eebfd713-a995-46b9-a6c8-5aa549112dd5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:54:03.187619 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-eebfd713-a995-46b9-a6c8-5aa549112dd5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:54:03.188480 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-eebfd713-a995-46b9-a6c8-5aa549112dd5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:54:03.202022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eebfd713-a995-46b9-a6c8-5aa549112dd5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:03.202787 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eebfd713-a995-46b9-a6c8-5aa549112dd5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:03.203409 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eebfd713-a995-46b9-a6c8-5aa549112dd5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:03.204464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eebfd713-a995-46b9-a6c8-5aa549112dd5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:03.205151 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eebfd713-a995-46b9-a6c8-5aa549112dd5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:03.205735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eebfd713-a995-46b9-a6c8-5aa549112dd5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:03.231900 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-eebfd713-a995-46b9-a6c8-5aa549112dd5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Getting quotas for project dfa44fa2dc3c4df4bc34ff14deaf21ef. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:54:03.238135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-eebfd713-a995-46b9-a6c8-5aa549112dd5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Getting quotas for user 2825041f8aa2462f8719a0f124e0b8a0 and project dfa44fa2dc3c4df4bc34ff14deaf21ef. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:54:03.252716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-eebfd713-a995-46b9-a6c8-5aa549112dd5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:54:03.255904 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-eebfd713-a995-46b9-a6c8-5aa549112dd5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 318c0ef8-f225-43ef-984f-b5407fa92e1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:54:03.359161 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-eebfd713-a995-46b9-a6c8-5aa549112dd5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.434069 Oct 05 02:54:03.371818 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2575/5137] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:54:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1447 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:54:03.500728 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-07703346-0a29-40e6-8f7b-18449c7a71a3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:03.517949 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-07703346-0a29-40e6-8f7b-18449c7a71a3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1500 microversion: 2.1 time: 0.377825 Oct 05 02:54:03.519080 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2563/5138] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:03 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1500 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:03.548695 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e5d8bba6-0b25-4238-b974-397051d93156 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:03.549828 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e5d8bba6-0b25-4238-b974-397051d93156 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:03.573850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5d8bba6-0b25-4238-b974-397051d93156 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:03.574368 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5d8bba6-0b25-4238-b974-397051d93156 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:03.574821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5d8bba6-0b25-4238-b974-397051d93156 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:03.576820 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5d8bba6-0b25-4238-b974-397051d93156 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:03.577320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5d8bba6-0b25-4238-b974-397051d93156 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:03.577762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5d8bba6-0b25-4238-b974-397051d93156 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:03.658046 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3f2f270d-6c41-407e-ab74-210eacf6047f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-244160838", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "451", "networks": [{"uuid": "9db48f3d-4eaf-41a1-b1a3-e77394828488"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:54:03.743805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=84 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:03.861323 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-3f2f270d-6c41-407e-ab74-210eacf6047f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] validate_networks() for [('9db48f3d-4eaf-41a1-b1a3-e77394828488', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:54:03.944733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e5d8bba6-0b25-4238-b974-397051d93156 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:03.993600 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e5d8bba6-0b25-4238-b974-397051d93156 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378" status: 200 len: 1514 microversion: 2.1 time: 0.450460 Oct 05 02:54:03.996350 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2576/5139] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:03 2022] GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378 => generated 1514 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:04.024136 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7916e3f1-71ff-4d13-b0c5-ccab8632edbf tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:54:04.027623 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7916e3f1-71ff-4d13-b0c5-ccab8632edbf tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: ccf0fe2f-ac9e-422d-9d66-b3e5ca098812] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:04.048981 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-7916e3f1-71ff-4d13-b0c5-ccab8632edbf tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] HTTP exception thrown: Instance ccf0fe2f-ac9e-422d-9d66-b3e5ca098812 could not be found. Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7916e3f1-71ff-4d13-b0c5-ccab8632edbf tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Request method failure captured: Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers/ccf0fe2f-ac9e-422d-9d66-b3e5ca098812/action HTTP/1.1 Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 14 Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPGOLQowIsfBU6KJO-aq50qdRwmBWFeSun5TXHVGHXcRMd_nBRTUvLypi8_xX1_OhJhXqj8Tv9hcB2y77p-h0kTEsykqgEnSv0lMxHhtiAmMmCPjjlgvw91YvvX9SOOQS6JLONmL-pDrthh_0HqZ_QF0o7mi44oPhOdJTsJKEis6xoY Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 129b5343573f4f9fa648e984a68b6760 Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1554781900 Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/129b5343573f4f9fa648e984a68b6760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/129b5343573f4f9fa648e984a68b6760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/129b5343573f4f9fa648e984a68b6760"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_129b5343573f4f9fa648e984a68b6760"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1554781900 Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 129b5343573f4f9fa648e984a68b6760 Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1554781900 Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerRescueNegativeTestJSON-1554781900-project Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: a031e94db13d4e7e8947f51abc36d629 Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1554781900-project Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: {"rescue": {}} Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance ccf0fe2f-ac9e-422d-9d66-b3e5ca098812 could not be found. Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'ccf0fe2f-ac9e-422d-9d66-b3e5ca098812', 'body': {'rescue': {}}} Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccf0fe2f-ac9e-422d-9d66-b3e5ca098812 could not be found. Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccf0fe2f-ac9e-422d-9d66-b3e5ca098812 could not be found. Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:54:04.066305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:54:04.071012 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:54:04.071012 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:54:04.071012 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:54:04.071012 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:54:04.071012 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccf0fe2f-ac9e-422d-9d66-b3e5ca098812 could not be found. Oct 05 02:54:04.071012 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:54:04.072424 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7916e3f1-71ff-4d13-b0c5-ccab8632edbf tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Returning 404 to user: Instance ccf0fe2f-ac9e-422d-9d66-b3e5ca098812 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:54:04.073469 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7916e3f1-71ff-4d13-b0c5-ccab8632edbf tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "POST /compute/v2.1/servers/ccf0fe2f-ac9e-422d-9d66-b3e5ca098812/action" status: 404 len: 111 microversion: 2.1 time: 0.054866 Oct 05 02:54:04.075654 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2577/5140] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:54:04 2022] POST /compute/v2.1/servers/ccf0fe2f-ac9e-422d-9d66-b3e5ca098812/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:54:04.094335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f7673f07-ccb8-4be9-9b2f-f43aa2720fef tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:54:04.094888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f7673f07-ccb8-4be9-9b2f-f43aa2720fef tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:04.108822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7673f07-ccb8-4be9-9b2f-f43aa2720fef tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:04.111911 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7673f07-ccb8-4be9-9b2f-f43aa2720fef tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:04.112577 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7673f07-ccb8-4be9-9b2f-f43aa2720fef tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:04.116015 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7673f07-ccb8-4be9-9b2f-f43aa2720fef tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:04.116707 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7673f07-ccb8-4be9-9b2f-f43aa2720fef tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:04.117463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7673f07-ccb8-4be9-9b2f-f43aa2720fef tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:04.272450 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f7673f07-ccb8-4be9-9b2f-f43aa2720fef tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "POST /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378/action" status: 202 len: 0 microversion: 2.1 time: 0.189047 Oct 05 02:54:04.276321 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2578/5141] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:54:04 2022] POST /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:54:04.290357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-890d13c3-4071-498a-87a3-8d8a71fe7533 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:04.291088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-890d13c3-4071-498a-87a3-8d8a71fe7533 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:04.303071 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-890d13c3-4071-498a-87a3-8d8a71fe7533 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:04.303569 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-890d13c3-4071-498a-87a3-8d8a71fe7533 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:04.306468 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-890d13c3-4071-498a-87a3-8d8a71fe7533 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:04.307581 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-890d13c3-4071-498a-87a3-8d8a71fe7533 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:04.313105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-890d13c3-4071-498a-87a3-8d8a71fe7533 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:04.313805 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-890d13c3-4071-498a-87a3-8d8a71fe7533 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:05.022423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-3f2f270d-6c41-407e-ab74-210eacf6047f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:54:05.023381 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-3f2f270d-6c41-407e-ab74-210eacf6047f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:54:05.024029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-3f2f270d-6c41-407e-ab74-210eacf6047f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:54:05.024370 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-890d13c3-4071-498a-87a3-8d8a71fe7533 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:05.024753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-3f2f270d-6c41-407e-ab74-210eacf6047f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:54:05.025456 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-3f2f270d-6c41-407e-ab74-210eacf6047f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:54:05.035181 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-890d13c3-4071-498a-87a3-8d8a71fe7533 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1526 microversion: 2.1 time: 0.757409 Oct 05 02:54:05.040849 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2579/5142] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:04 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1526 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:05.055228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f2f270d-6c41-407e-ab74-210eacf6047f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:05.055866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f2f270d-6c41-407e-ab74-210eacf6047f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:05.056354 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f2f270d-6c41-407e-ab74-210eacf6047f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:05.056824 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ec65bb19-2ca9-4009-8a44-9eeadbed5cbe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:05.057128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f2f270d-6c41-407e-ab74-210eacf6047f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:05.057591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f2f270d-6c41-407e-ab74-210eacf6047f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:05.058072 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f2f270d-6c41-407e-ab74-210eacf6047f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:05.059130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ec65bb19-2ca9-4009-8a44-9eeadbed5cbe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:05.075400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec65bb19-2ca9-4009-8a44-9eeadbed5cbe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:05.077762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec65bb19-2ca9-4009-8a44-9eeadbed5cbe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:05.079384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec65bb19-2ca9-4009-8a44-9eeadbed5cbe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:05.082450 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec65bb19-2ca9-4009-8a44-9eeadbed5cbe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:05.085177 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec65bb19-2ca9-4009-8a44-9eeadbed5cbe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:05.085921 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec65bb19-2ca9-4009-8a44-9eeadbed5cbe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:05.146904 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-3f2f270d-6c41-407e-ab74-210eacf6047f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Getting quotas for project dfa44fa2dc3c4df4bc34ff14deaf21ef. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:54:05.175593 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-3f2f270d-6c41-407e-ab74-210eacf6047f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Getting quotas for user 2825041f8aa2462f8719a0f124e0b8a0 and project dfa44fa2dc3c4df4bc34ff14deaf21ef. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:54:05.230537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3f2f270d-6c41-407e-ab74-210eacf6047f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:54:05.237396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3f2f270d-6c41-407e-ab74-210eacf6047f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 69a268a7-62f4-4ef2-b5ce-45469cba9c7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:54:05.310476 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3f2f270d-6c41-407e-ab74-210eacf6047f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.666674 Oct 05 02:54:05.312003 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2564/5143] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:54:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 02:54:05.348892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-755a8003-31ec-4aea-89e7-6d5b1118e4d4 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:05.352494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-755a8003-31ec-4aea-89e7-6d5b1118e4d4 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 69a268a7-62f4-4ef2-b5ce-45469cba9c7a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:05.505498 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-755a8003-31ec-4aea-89e7-6d5b1118e4d4 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:05.516560 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-755a8003-31ec-4aea-89e7-6d5b1118e4d4 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a" status: 200 len: 1220 microversion: 2.1 time: 0.196803 Oct 05 02:54:05.517500 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2565/5144] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:05 2022] GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a => generated 1220 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:05.626821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ec65bb19-2ca9-4009-8a44-9eeadbed5cbe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:05.642816 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ec65bb19-2ca9-4009-8a44-9eeadbed5cbe tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378" status: 200 len: 1499 microversion: 2.1 time: 0.597605 Oct 05 02:54:05.656937 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2580/5145] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:05 2022] GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378 => generated 1499 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:05.668669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-42089ce9-84ec-4493-96fd-ad2f5cf91b43 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:54:05.672429 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-42089ce9-84ec-4493-96fd-ad2f5cf91b43 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:05.680787 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42089ce9-84ec-4493-96fd-ad2f5cf91b43 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:05.681717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42089ce9-84ec-4493-96fd-ad2f5cf91b43 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:05.682753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42089ce9-84ec-4493-96fd-ad2f5cf91b43 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:05.684188 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42089ce9-84ec-4493-96fd-ad2f5cf91b43 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:05.684875 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42089ce9-84ec-4493-96fd-ad2f5cf91b43 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:05.685550 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42089ce9-84ec-4493-96fd-ad2f5cf91b43 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:05.719352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-42089ce9-84ec-4493-96fd-ad2f5cf91b43 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lazy-loading 'flavor' on Instance uuid 09ae93ee-8f09-4552-b933-ad3c7e157378 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:54:05.735467 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-42089ce9-84ec-4493-96fd-ad2f5cf91b43 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] HTTP exception thrown: Cannot 'rescue' instance 09ae93ee-8f09-4552-b933-ad3c7e157378 while it is in vm_state paused Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-42089ce9-84ec-4493-96fd-ad2f5cf91b43 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Request method failure captured: Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378/action HTTP/1.1 Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 14 Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPGOLQowIsfBU6KJO-aq50qdRwmBWFeSun5TXHVGHXcRMd_nBRTUvLypi8_xX1_OhJhXqj8Tv9hcB2y77p-h0kTEsykqgEnSv0lMxHhtiAmMmCPjjlgvw91YvvX9SOOQS6JLONmL-pDrthh_0HqZ_QF0o7mi44oPhOdJTsJKEis6xoY Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 129b5343573f4f9fa648e984a68b6760 Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1554781900 Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/129b5343573f4f9fa648e984a68b6760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/129b5343573f4f9fa648e984a68b6760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/129b5343573f4f9fa648e984a68b6760"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_129b5343573f4f9fa648e984a68b6760"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1554781900 Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 129b5343573f4f9fa648e984a68b6760 Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1554781900 Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServerRescueNegativeTestJSON-1554781900-project Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: a031e94db13d4e7e8947f51abc36d629 Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1554781900-project Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: {"rescue": {}} Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: exception: Cannot 'rescue' instance 09ae93ee-8f09-4552-b933-ad3c7e157378 while it is in vm_state paused Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '09ae93ee-8f09-4552-b933-ad3c7e157378', 'body': {'rescue': {}}} Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 09ae93ee-8f09-4552-b933-ad3c7e157378 in vm_state paused. Cannot rescue while the instance is in this state. Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 09ae93ee-8f09-4552-b933-ad3c7e157378 while it is in vm_state paused Oct 05 02:54:05.737865 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:54:05.741268 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:54:05.741268 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:54:05.741268 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:54:05.741268 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:54:05.741268 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:54:05.741268 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:54:05.741268 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:54:05.741268 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 09ae93ee-8f09-4552-b933-ad3c7e157378 while it is in vm_state paused Oct 05 02:54:05.741268 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:54:05.747970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-42089ce9-84ec-4493-96fd-ad2f5cf91b43 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Returning 409 to user: Cannot 'rescue' instance 09ae93ee-8f09-4552-b933-ad3c7e157378 while it is in vm_state paused {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:54:05.749849 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-42089ce9-84ec-4493-96fd-ad2f5cf91b43 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "POST /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378/action" status: 409 len: 144 microversion: 2.1 time: 0.086820 Oct 05 02:54:05.750660 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2566/5146] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:54:05 2022] POST /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378/action => generated 144 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:54:05.760850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-41e16de7-b9a7-41f2-bdeb-f43fd28a0243 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:54:05.761494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-41e16de7-b9a7-41f2-bdeb-f43fd28a0243 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:05.779336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41e16de7-b9a7-41f2-bdeb-f43fd28a0243 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:05.779898 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41e16de7-b9a7-41f2-bdeb-f43fd28a0243 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:05.780324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41e16de7-b9a7-41f2-bdeb-f43fd28a0243 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:05.781554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41e16de7-b9a7-41f2-bdeb-f43fd28a0243 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:05.784477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41e16de7-b9a7-41f2-bdeb-f43fd28a0243 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:05.786309 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41e16de7-b9a7-41f2-bdeb-f43fd28a0243 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:05.964116 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-41e16de7-b9a7-41f2-bdeb-f43fd28a0243 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "POST /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378/action" status: 202 len: 0 microversion: 2.1 time: 0.206837 Oct 05 02:54:05.967009 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2581/5147] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:54:05 2022] POST /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 02:54:05.975586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2bb6ab66-d595-4cf5-a7f6-bcf1ccb941b7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:05.976283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2bb6ab66-d595-4cf5-a7f6-bcf1ccb941b7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:05.986162 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bb6ab66-d595-4cf5-a7f6-bcf1ccb941b7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:05.997879 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bb6ab66-d595-4cf5-a7f6-bcf1ccb941b7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:06.001108 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bb6ab66-d595-4cf5-a7f6-bcf1ccb941b7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:06.002389 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bb6ab66-d595-4cf5-a7f6-bcf1ccb941b7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:06.003086 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bb6ab66-d595-4cf5-a7f6-bcf1ccb941b7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:06.003788 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2bb6ab66-d595-4cf5-a7f6-bcf1ccb941b7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:06.068719 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-86e9f194-21a3-4704-80cc-594741a8099b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:06.069626 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-86e9f194-21a3-4704-80cc-594741a8099b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:06.084095 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86e9f194-21a3-4704-80cc-594741a8099b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:06.087520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86e9f194-21a3-4704-80cc-594741a8099b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:06.089139 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86e9f194-21a3-4704-80cc-594741a8099b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:06.105456 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86e9f194-21a3-4704-80cc-594741a8099b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:06.109991 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86e9f194-21a3-4704-80cc-594741a8099b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:06.114582 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86e9f194-21a3-4704-80cc-594741a8099b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:07.347344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-86e9f194-21a3-4704-80cc-594741a8099b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:07.366442 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-86e9f194-21a3-4704-80cc-594741a8099b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1526 microversion: 2.1 time: 1.302294 Oct 05 02:54:07.368269 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2582/5148] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:06 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1526 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:07.390721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d7ed5fe4-5c7b-4263-a9b1-92655604361c tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:07.392383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d7ed5fe4-5c7b-4263-a9b1-92655604361c tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 69a268a7-62f4-4ef2-b5ce-45469cba9c7a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:07.399045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7ed5fe4-5c7b-4263-a9b1-92655604361c tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:07.399792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7ed5fe4-5c7b-4263-a9b1-92655604361c tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:07.400434 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7ed5fe4-5c7b-4263-a9b1-92655604361c tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:07.402139 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7ed5fe4-5c7b-4263-a9b1-92655604361c tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:07.402818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7ed5fe4-5c7b-4263-a9b1-92655604361c tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:07.403434 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7ed5fe4-5c7b-4263-a9b1-92655604361c tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:07.449501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2bb6ab66-d595-4cf5-a7f6-bcf1ccb941b7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:07.457418 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:07.465331 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2bb6ab66-d595-4cf5-a7f6-bcf1ccb941b7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378" status: 200 len: 1506 microversion: 2.1 time: 1.493023 Oct 05 02:54:07.467838 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2567/5149] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:05 2022] GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378 => generated 1506 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:07.674390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d7ed5fe4-5c7b-4263-a9b1-92655604361c tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:07.691007 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d7ed5fe4-5c7b-4263-a9b1-92655604361c tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a" status: 200 len: 1272 microversion: 2.1 time: 0.307246 Oct 05 02:54:07.691756 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2583/5150] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:07 2022] GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a => generated 1272 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:08.398773 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9b399e9c-2b2e-44ef-958a-a34005d82ca8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:08.402122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9b399e9c-2b2e-44ef-958a-a34005d82ca8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:08.423139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b399e9c-2b2e-44ef-958a-a34005d82ca8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:08.424966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b399e9c-2b2e-44ef-958a-a34005d82ca8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:08.426527 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b399e9c-2b2e-44ef-958a-a34005d82ca8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:08.429539 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b399e9c-2b2e-44ef-958a-a34005d82ca8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:08.431419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b399e9c-2b2e-44ef-958a-a34005d82ca8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:08.434598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b399e9c-2b2e-44ef-958a-a34005d82ca8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:08.497406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-09bdc635-00e5-4965-acd0-30c700857cfc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:08.498828 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-09bdc635-00e5-4965-acd0-30c700857cfc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:08.526443 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-09bdc635-00e5-4965-acd0-30c700857cfc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:08.527531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-09bdc635-00e5-4965-acd0-30c700857cfc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:08.530841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-09bdc635-00e5-4965-acd0-30c700857cfc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:08.532654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-09bdc635-00e5-4965-acd0-30c700857cfc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:08.534957 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-09bdc635-00e5-4965-acd0-30c700857cfc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:08.536718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-09bdc635-00e5-4965-acd0-30c700857cfc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:10.227432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-09bdc635-00e5-4965-acd0-30c700857cfc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:10.243631 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-09bdc635-00e5-4965-acd0-30c700857cfc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378" status: 200 len: 1514 microversion: 2.1 time: 1.751894 Oct 05 02:54:10.249188 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2584/5151] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:08 2022] GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378 => generated 1514 bytes in 1758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:10.264973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0ce01ccc-b636-4477-a623-bc27ffe96327 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:10.266423 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0ce01ccc-b636-4477-a623-bc27ffe96327 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 69a268a7-62f4-4ef2-b5ce-45469cba9c7a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:10.278801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ce01ccc-b636-4477-a623-bc27ffe96327 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:10.279504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ce01ccc-b636-4477-a623-bc27ffe96327 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:10.280097 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ce01ccc-b636-4477-a623-bc27ffe96327 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:10.281128 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ce01ccc-b636-4477-a623-bc27ffe96327 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:10.281865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ce01ccc-b636-4477-a623-bc27ffe96327 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:10.282460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ce01ccc-b636-4477-a623-bc27ffe96327 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:10.451790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9b399e9c-2b2e-44ef-958a-a34005d82ca8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:10.462160 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9b399e9c-2b2e-44ef-958a-a34005d82ca8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1526 microversion: 2.1 time: 2.070995 Oct 05 02:54:10.462328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0ce01ccc-b636-4477-a623-bc27ffe96327 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:10.477823 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0ce01ccc-b636-4477-a623-bc27ffe96327 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a" status: 200 len: 1278 microversion: 2.1 time: 0.224293 Oct 05 02:54:10.481457 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2585/5152] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:10 2022] GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a => generated 1278 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:10.493180 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2568/5153] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:08 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1526 bytes in 2098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:11.496047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bbafd860-5178-426f-926c-341a17c652de tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:11.498963 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bbafd860-5178-426f-926c-341a17c652de tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:11.508314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4dd14382-80b9-4cad-b439-9fa099783312 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:11.509938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4dd14382-80b9-4cad-b439-9fa099783312 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 69a268a7-62f4-4ef2-b5ce-45469cba9c7a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:11.529907 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4dd14382-80b9-4cad-b439-9fa099783312 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:11.534377 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4dd14382-80b9-4cad-b439-9fa099783312 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:11.535070 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4dd14382-80b9-4cad-b439-9fa099783312 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:11.536375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bbafd860-5178-426f-926c-341a17c652de tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:11.542875 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4dd14382-80b9-4cad-b439-9fa099783312 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:11.543306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bbafd860-5178-426f-926c-341a17c652de tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:11.544231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4dd14382-80b9-4cad-b439-9fa099783312 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:11.544778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bbafd860-5178-426f-926c-341a17c652de tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:11.546950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4dd14382-80b9-4cad-b439-9fa099783312 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:11.547637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bbafd860-5178-426f-926c-341a17c652de tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:11.551899 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bbafd860-5178-426f-926c-341a17c652de tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:11.552604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bbafd860-5178-426f-926c-341a17c652de tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:11.577712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:11.877586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4dd14382-80b9-4cad-b439-9fa099783312 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:11.898757 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4dd14382-80b9-4cad-b439-9fa099783312 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a" status: 200 len: 1278 microversion: 2.1 time: 0.394588 Oct 05 02:54:11.917206 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2569/5154] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:11 2022] GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a => generated 1278 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:54:12.041410 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bbafd860-5178-426f-926c-341a17c652de tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:12.049688 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bbafd860-5178-426f-926c-341a17c652de tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1526 microversion: 2.1 time: 0.558736 Oct 05 02:54:12.050273 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2586/5155] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:11 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1526 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:12.178965 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-ac432395-1a50-4a83-aa92-f761e41d4257 req-7d8bf968-43f7-4c2a-9252-c8a97cebc61d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d39cd597-890f-4cc8-8d05-9a1b65f9ab32", "tag": "84d22aa8-b04f-4c22-b0a2-3d56afad55c4"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:54:12.209656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ac432395-1a50-4a83-aa92-f761e41d4257 req-7d8bf968-43f7-4c2a-9252-c8a97cebc61d service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:12.210168 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ac432395-1a50-4a83-aa92-f761e41d4257 req-7d8bf968-43f7-4c2a-9252-c8a97cebc61d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:12.210607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ac432395-1a50-4a83-aa92-f761e41d4257 req-7d8bf968-43f7-4c2a-9252-c8a97cebc61d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:12.248884 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-ac432395-1a50-4a83-aa92-f761e41d4257 req-7d8bf968-43f7-4c2a-9252-c8a97cebc61d service nova] Creating event network-changed:84d22aa8-b04f-4c22-b0a2-3d56afad55c4 for instance d39cd597-890f-4cc8-8d05-9a1b65f9ab32 on n-h2-858272-3 Oct 05 02:54:12.256604 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-ac432395-1a50-4a83-aa92-f761e41d4257 req-7d8bf968-43f7-4c2a-9252-c8a97cebc61d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081523 Oct 05 02:54:12.257979 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2570/5156] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:54:12.937404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1f634af4-5155-47c5-bbaa-57233ed94985 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:12.938395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1f634af4-5155-47c5-bbaa-57233ed94985 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 69a268a7-62f4-4ef2-b5ce-45469cba9c7a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:12.977720 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f634af4-5155-47c5-bbaa-57233ed94985 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:12.982742 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f634af4-5155-47c5-bbaa-57233ed94985 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:12.983322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f634af4-5155-47c5-bbaa-57233ed94985 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:12.986461 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f634af4-5155-47c5-bbaa-57233ed94985 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:12.989860 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f634af4-5155-47c5-bbaa-57233ed94985 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:12.995333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f634af4-5155-47c5-bbaa-57233ed94985 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:13.076279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1e7e22e2-c473-4f8a-8f51-52d2f39a52a2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:13.077952 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1e7e22e2-c473-4f8a-8f51-52d2f39a52a2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:13.102449 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e7e22e2-c473-4f8a-8f51-52d2f39a52a2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:13.106845 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e7e22e2-c473-4f8a-8f51-52d2f39a52a2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:13.108087 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e7e22e2-c473-4f8a-8f51-52d2f39a52a2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:13.110514 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e7e22e2-c473-4f8a-8f51-52d2f39a52a2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:13.111724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e7e22e2-c473-4f8a-8f51-52d2f39a52a2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:13.115333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e7e22e2-c473-4f8a-8f51-52d2f39a52a2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:13.220357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=4 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:13.246847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=12 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:13.775867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1e7e22e2-c473-4f8a-8f51-52d2f39a52a2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:13.789347 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1e7e22e2-c473-4f8a-8f51-52d2f39a52a2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1526 microversion: 2.1 time: 0.716510 Oct 05 02:54:13.805294 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2571/5157] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:13 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1526 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:14.035909 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1f634af4-5155-47c5-bbaa-57233ed94985 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:14.047912 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1f634af4-5155-47c5-bbaa-57233ed94985 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a" status: 200 len: 1320 microversion: 2.1 time: 1.121329 Oct 05 02:54:14.066836 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2587/5158] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:12 2022] GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a => generated 1320 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:14.327476 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0e77f8ff-8854-4ca0-9d0e-eae76bafb964 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:54:14.330591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0e77f8ff-8854-4ca0-9d0e-eae76bafb964 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:14.337844 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e77f8ff-8854-4ca0-9d0e-eae76bafb964 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:14.338689 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e77f8ff-8854-4ca0-9d0e-eae76bafb964 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:14.339346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e77f8ff-8854-4ca0-9d0e-eae76bafb964 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:14.340279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e77f8ff-8854-4ca0-9d0e-eae76bafb964 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:14.340979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e77f8ff-8854-4ca0-9d0e-eae76bafb964 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:14.341617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e77f8ff-8854-4ca0-9d0e-eae76bafb964 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:14.370213 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-0e77f8ff-8854-4ca0-9d0e-eae76bafb964 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lazy-loading 'flavor' on Instance uuid 09ae93ee-8f09-4552-b933-ad3c7e157378 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:54:14.494275 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0e77f8ff-8854-4ca0-9d0e-eae76bafb964 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "POST /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378/action" status: 200 len: 32 microversion: 2.1 time: 0.173218 Oct 05 02:54:14.500604 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2572/5159] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:54:14 2022] POST /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378/action => generated 32 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:54:14.508571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0dad5711-4f8d-4010-a199-4dccf369e4d9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:14.510067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0dad5711-4f8d-4010-a199-4dccf369e4d9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:14.531850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0dad5711-4f8d-4010-a199-4dccf369e4d9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:14.532419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0dad5711-4f8d-4010-a199-4dccf369e4d9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:14.537680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0dad5711-4f8d-4010-a199-4dccf369e4d9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:14.542758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0dad5711-4f8d-4010-a199-4dccf369e4d9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:14.545218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0dad5711-4f8d-4010-a199-4dccf369e4d9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:14.545755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0dad5711-4f8d-4010-a199-4dccf369e4d9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:14.814721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-382d18db-d326-4982-a330-4d4a7ba1d756 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:14.815694 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-382d18db-d326-4982-a330-4d4a7ba1d756 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:14.827355 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-382d18db-d326-4982-a330-4d4a7ba1d756 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:14.828012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-382d18db-d326-4982-a330-4d4a7ba1d756 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:14.828599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-382d18db-d326-4982-a330-4d4a7ba1d756 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:14.829670 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-382d18db-d326-4982-a330-4d4a7ba1d756 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:14.834126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-382d18db-d326-4982-a330-4d4a7ba1d756 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:14.835650 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-382d18db-d326-4982-a330-4d4a7ba1d756 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:15.094555 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:15.111608 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0dad5711-4f8d-4010-a199-4dccf369e4d9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:15.141591 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0dad5711-4f8d-4010-a199-4dccf369e4d9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378" status: 200 len: 1520 microversion: 2.1 time: 0.640227 Oct 05 02:54:15.142194 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2588/5160] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:14 2022] GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378 => generated 1520 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:15.155270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8cb86467-4590-4811-a780-5f28f8dd7156 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:15.156282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8cb86467-4590-4811-a780-5f28f8dd7156 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 69a268a7-62f4-4ef2-b5ce-45469cba9c7a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:15.168685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cb86467-4590-4811-a780-5f28f8dd7156 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:15.169736 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cb86467-4590-4811-a780-5f28f8dd7156 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:15.170363 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cb86467-4590-4811-a780-5f28f8dd7156 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:15.171271 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cb86467-4590-4811-a780-5f28f8dd7156 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:15.173664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cb86467-4590-4811-a780-5f28f8dd7156 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:15.174369 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cb86467-4590-4811-a780-5f28f8dd7156 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:15.510269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=8 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:15.581440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-382d18db-d326-4982-a330-4d4a7ba1d756 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:15.591338 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-382d18db-d326-4982-a330-4d4a7ba1d756 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1526 microversion: 2.1 time: 0.780783 Oct 05 02:54:15.607049 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2573/5161] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:14 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1526 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:15.687929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8cb86467-4590-4811-a780-5f28f8dd7156 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:15.705118 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8cb86467-4590-4811-a780-5f28f8dd7156 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a" status: 200 len: 1320 microversion: 2.1 time: 0.561425 Oct 05 02:54:15.705723 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2589/5162] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:15 2022] GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a => generated 1320 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:16.169028 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a85c8fe2-f153-4d29-ae0c-4ba3b2b08ab4 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:16.169891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a85c8fe2-f153-4d29-ae0c-4ba3b2b08ab4 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:16.180882 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a85c8fe2-f153-4d29-ae0c-4ba3b2b08ab4 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:16.181743 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a85c8fe2-f153-4d29-ae0c-4ba3b2b08ab4 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:16.182411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a85c8fe2-f153-4d29-ae0c-4ba3b2b08ab4 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:16.187493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a85c8fe2-f153-4d29-ae0c-4ba3b2b08ab4 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:16.188375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a85c8fe2-f153-4d29-ae0c-4ba3b2b08ab4 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:16.189069 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a85c8fe2-f153-4d29-ae0c-4ba3b2b08ab4 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:16.624386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-acc03d75-ae07-4b30-b0a4-c99548873e43 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:16.626999 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-acc03d75-ae07-4b30-b0a4-c99548873e43 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:16.636932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-acc03d75-ae07-4b30-b0a4-c99548873e43 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:16.642846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-acc03d75-ae07-4b30-b0a4-c99548873e43 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:16.647341 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-acc03d75-ae07-4b30-b0a4-c99548873e43 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:16.648333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-acc03d75-ae07-4b30-b0a4-c99548873e43 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:16.650626 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-acc03d75-ae07-4b30-b0a4-c99548873e43 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:16.653459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-acc03d75-ae07-4b30-b0a4-c99548873e43 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:17.109136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a85c8fe2-f153-4d29-ae0c-4ba3b2b08ab4 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:17.122168 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a85c8fe2-f153-4d29-ae0c-4ba3b2b08ab4 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378" status: 200 len: 1520 microversion: 2.1 time: 0.957715 Oct 05 02:54:17.130797 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2574/5163] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:16 2022] GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378 => generated 1520 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:17.150967 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0ad17d29-5326-491a-acde-7f2c0855afd8 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:17.151921 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0ad17d29-5326-491a-acde-7f2c0855afd8 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 69a268a7-62f4-4ef2-b5ce-45469cba9c7a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:17.158781 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ad17d29-5326-491a-acde-7f2c0855afd8 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:17.165819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ad17d29-5326-491a-acde-7f2c0855afd8 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:17.166620 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ad17d29-5326-491a-acde-7f2c0855afd8 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:17.167791 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ad17d29-5326-491a-acde-7f2c0855afd8 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:17.168464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ad17d29-5326-491a-acde-7f2c0855afd8 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:17.169132 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ad17d29-5326-491a-acde-7f2c0855afd8 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:17.833184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-acc03d75-ae07-4b30-b0a4-c99548873e43 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:17.843673 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-acc03d75-ae07-4b30-b0a4-c99548873e43 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1526 microversion: 2.1 time: 1.228573 Oct 05 02:54:17.883033 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2590/5164] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:16 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1526 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:17.891683 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-b40aa44b-42b7-4cc8-8b5b-7c2eaaf887e1 req-d10833ae-dc30-4d7c-8b2a-e16c42635782 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "318c0ef8-f225-43ef-984f-b5407fa92e1f", "tag": "bad51ab7-5ef6-467a-a3e8-d282c09f2e0c"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:54:17.916980 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b40aa44b-42b7-4cc8-8b5b-7c2eaaf887e1 req-d10833ae-dc30-4d7c-8b2a-e16c42635782 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:17.917813 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b40aa44b-42b7-4cc8-8b5b-7c2eaaf887e1 req-d10833ae-dc30-4d7c-8b2a-e16c42635782 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:17.918469 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b40aa44b-42b7-4cc8-8b5b-7c2eaaf887e1 req-d10833ae-dc30-4d7c-8b2a-e16c42635782 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:17.937183 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-b40aa44b-42b7-4cc8-8b5b-7c2eaaf887e1 req-d10833ae-dc30-4d7c-8b2a-e16c42635782 service nova] Creating event network-changed:bad51ab7-5ef6-467a-a3e8-d282c09f2e0c for instance 318c0ef8-f225-43ef-984f-b5407fa92e1f on n-h1-858272-3 Oct 05 02:54:17.943365 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-b40aa44b-42b7-4cc8-8b5b-7c2eaaf887e1 req-d10833ae-dc30-4d7c-8b2a-e16c42635782 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057043 Oct 05 02:54:17.944728 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2591/5165] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:54:18.071721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0ad17d29-5326-491a-acde-7f2c0855afd8 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:18.081416 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0ad17d29-5326-491a-acde-7f2c0855afd8 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a" status: 200 len: 1320 microversion: 2.1 time: 0.948332 Oct 05 02:54:18.102789 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2575/5166] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:17 2022] GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a => generated 1320 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:18.159202 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9870fed3-f3db-4bdb-a97e-9bb689cd5c92 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:18.160007 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9870fed3-f3db-4bdb-a97e-9bb689cd5c92 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:18.176151 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9870fed3-f3db-4bdb-a97e-9bb689cd5c92 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:18.177322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9870fed3-f3db-4bdb-a97e-9bb689cd5c92 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:18.178048 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9870fed3-f3db-4bdb-a97e-9bb689cd5c92 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:18.180946 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9870fed3-f3db-4bdb-a97e-9bb689cd5c92 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:18.183616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9870fed3-f3db-4bdb-a97e-9bb689cd5c92 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:18.184312 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9870fed3-f3db-4bdb-a97e-9bb689cd5c92 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:18.873377 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3e432be8-e502-4e2c-bc4a-2cde004eeb5b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:18.873995 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3e432be8-e502-4e2c-bc4a-2cde004eeb5b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:18.890973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e432be8-e502-4e2c-bc4a-2cde004eeb5b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:18.896168 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e432be8-e502-4e2c-bc4a-2cde004eeb5b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:18.899113 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e432be8-e502-4e2c-bc4a-2cde004eeb5b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:18.901718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e432be8-e502-4e2c-bc4a-2cde004eeb5b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:18.903284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e432be8-e502-4e2c-bc4a-2cde004eeb5b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:18.906272 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e432be8-e502-4e2c-bc4a-2cde004eeb5b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:18.920216 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9870fed3-f3db-4bdb-a97e-9bb689cd5c92 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:18.937440 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9870fed3-f3db-4bdb-a97e-9bb689cd5c92 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378" status: 200 len: 1520 microversion: 2.1 time: 0.782855 Oct 05 02:54:18.938822 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2592/5167] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:18 2022] GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378 => generated 1520 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:19.109715 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2e227f36-7fee-4d45-ba91-55f4c1b884cd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:19.110341 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2e227f36-7fee-4d45-ba91-55f4c1b884cd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 69a268a7-62f4-4ef2-b5ce-45469cba9c7a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:19.121102 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e227f36-7fee-4d45-ba91-55f4c1b884cd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:19.122885 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e227f36-7fee-4d45-ba91-55f4c1b884cd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:19.124758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e227f36-7fee-4d45-ba91-55f4c1b884cd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:19.125555 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e227f36-7fee-4d45-ba91-55f4c1b884cd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:19.126024 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e227f36-7fee-4d45-ba91-55f4c1b884cd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:19.126711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e227f36-7fee-4d45-ba91-55f4c1b884cd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:19.165619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3e432be8-e502-4e2c-bc4a-2cde004eeb5b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:19.173361 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3e432be8-e502-4e2c-bc4a-2cde004eeb5b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1526 microversion: 2.1 time: 0.304626 Oct 05 02:54:19.177319 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2576/5168] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:18 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1526 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:19.351733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2e227f36-7fee-4d45-ba91-55f4c1b884cd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:19.368391 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2e227f36-7fee-4d45-ba91-55f4c1b884cd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a" status: 200 len: 1320 microversion: 2.1 time: 0.262368 Oct 05 02:54:19.369814 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2593/5169] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:19 2022] GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a => generated 1320 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:54:19.963610 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1604a969-48c8-4da3-85c4-b931d07364ac tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:19.964537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1604a969-48c8-4da3-85c4-b931d07364ac tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:19.973882 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1604a969-48c8-4da3-85c4-b931d07364ac tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:19.974604 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1604a969-48c8-4da3-85c4-b931d07364ac tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:19.975325 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1604a969-48c8-4da3-85c4-b931d07364ac tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:19.976491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1604a969-48c8-4da3-85c4-b931d07364ac tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:19.977318 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1604a969-48c8-4da3-85c4-b931d07364ac tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:19.978196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1604a969-48c8-4da3-85c4-b931d07364ac tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:19.985367 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-d86d1f95-0b69-4720-bf52-4a4bd10c5690 req-3389839f-d0ab-43b3-ad1f-d1b1ccf5e606 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69a268a7-62f4-4ef2-b5ce-45469cba9c7a", "tag": "fddc21db-621d-48b6-9fa4-da62e16cdb6c"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:54:19.994204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:20.015745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d86d1f95-0b69-4720-bf52-4a4bd10c5690 req-3389839f-d0ab-43b3-ad1f-d1b1ccf5e606 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:20.016256 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d86d1f95-0b69-4720-bf52-4a4bd10c5690 req-3389839f-d0ab-43b3-ad1f-d1b1ccf5e606 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:20.016703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d86d1f95-0b69-4720-bf52-4a4bd10c5690 req-3389839f-d0ab-43b3-ad1f-d1b1ccf5e606 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:20.047130 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-d86d1f95-0b69-4720-bf52-4a4bd10c5690 req-3389839f-d0ab-43b3-ad1f-d1b1ccf5e606 service nova] Creating event network-changed:fddc21db-621d-48b6-9fa4-da62e16cdb6c for instance 69a268a7-62f4-4ef2-b5ce-45469cba9c7a on n-h2-858272-3 Oct 05 02:54:20.064977 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-d86d1f95-0b69-4720-bf52-4a4bd10c5690 req-3389839f-d0ab-43b3-ad1f-d1b1ccf5e606 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086861 Oct 05 02:54:20.069016 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2594/5170] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:54:20.204410 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d248a248-abea-4f23-9886-8611f50f24fb tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:20.205165 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d248a248-abea-4f23-9886-8611f50f24fb tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:20.214370 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d248a248-abea-4f23-9886-8611f50f24fb tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:20.215388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d248a248-abea-4f23-9886-8611f50f24fb tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:20.216441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d248a248-abea-4f23-9886-8611f50f24fb tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:20.218058 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d248a248-abea-4f23-9886-8611f50f24fb tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:20.219214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d248a248-abea-4f23-9886-8611f50f24fb tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:20.220088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d248a248-abea-4f23-9886-8611f50f24fb tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:20.228007 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1604a969-48c8-4da3-85c4-b931d07364ac tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:20.237839 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1604a969-48c8-4da3-85c4-b931d07364ac tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378" status: 200 len: 1520 microversion: 2.1 time: 0.278783 Oct 05 02:54:20.261696 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2577/5171] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:19 2022] GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378 => generated 1520 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:20.392686 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-17e0e5bb-84db-4621-bbd1-3b7f4081d18c tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:20.393801 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-17e0e5bb-84db-4621-bbd1-3b7f4081d18c tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 69a268a7-62f4-4ef2-b5ce-45469cba9c7a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:20.394007 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d248a248-abea-4f23-9886-8611f50f24fb tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:20.403383 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17e0e5bb-84db-4621-bbd1-3b7f4081d18c tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:20.404184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17e0e5bb-84db-4621-bbd1-3b7f4081d18c tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:20.404494 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d248a248-abea-4f23-9886-8611f50f24fb tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1526 microversion: 2.1 time: 0.203964 Oct 05 02:54:20.404843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17e0e5bb-84db-4621-bbd1-3b7f4081d18c tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:20.406068 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2595/5172] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:20 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1526 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:54:20.406483 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17e0e5bb-84db-4621-bbd1-3b7f4081d18c tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:20.407142 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17e0e5bb-84db-4621-bbd1-3b7f4081d18c tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:20.407767 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17e0e5bb-84db-4621-bbd1-3b7f4081d18c tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:20.643606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-17e0e5bb-84db-4621-bbd1-3b7f4081d18c tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:20.669047 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-17e0e5bb-84db-4621-bbd1-3b7f4081d18c tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a" status: 200 len: 1320 microversion: 2.1 time: 0.280874 Oct 05 02:54:20.669467 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2578/5173] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:20 2022] GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a => generated 1320 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:54:20.920150 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-43e87807-21df-452f-aaa0-3dfbb79f5bbe req-e2f63ef1-3a7d-4e63-ad08-7884b14d726f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d39cd597-890f-4cc8-8d05-9a1b65f9ab32", "name": "network-vif-plugged", "status": "completed", "tag": "84d22aa8-b04f-4c22-b0a2-3d56afad55c4"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:54:20.934583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-43e87807-21df-452f-aaa0-3dfbb79f5bbe req-e2f63ef1-3a7d-4e63-ad08-7884b14d726f service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:20.935266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-43e87807-21df-452f-aaa0-3dfbb79f5bbe req-e2f63ef1-3a7d-4e63-ad08-7884b14d726f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:20.936204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-43e87807-21df-452f-aaa0-3dfbb79f5bbe req-e2f63ef1-3a7d-4e63-ad08-7884b14d726f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:20.953971 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-43e87807-21df-452f-aaa0-3dfbb79f5bbe req-e2f63ef1-3a7d-4e63-ad08-7884b14d726f service nova] Creating event network-vif-plugged:84d22aa8-b04f-4c22-b0a2-3d56afad55c4 for instance d39cd597-890f-4cc8-8d05-9a1b65f9ab32 on n-h2-858272-3 Oct 05 02:54:20.960540 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-43e87807-21df-452f-aaa0-3dfbb79f5bbe req-e2f63ef1-3a7d-4e63-ad08-7884b14d726f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044050 Oct 05 02:54:20.961670 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2596/5174] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:54:21.270741 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4b6ecd91-27b1-4c8a-a349-72946726ed93 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:21.271841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4b6ecd91-27b1-4c8a-a349-72946726ed93 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:21.284029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b6ecd91-27b1-4c8a-a349-72946726ed93 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:21.284541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b6ecd91-27b1-4c8a-a349-72946726ed93 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:21.285034 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b6ecd91-27b1-4c8a-a349-72946726ed93 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:21.287066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b6ecd91-27b1-4c8a-a349-72946726ed93 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:21.287545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b6ecd91-27b1-4c8a-a349-72946726ed93 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:21.288091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b6ecd91-27b1-4c8a-a349-72946726ed93 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:21.432671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0b33161f-5682-406e-bad7-64dc0a243d89 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:21.434967 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0b33161f-5682-406e-bad7-64dc0a243d89 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:21.445816 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b33161f-5682-406e-bad7-64dc0a243d89 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:21.449555 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b33161f-5682-406e-bad7-64dc0a243d89 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:21.450265 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b33161f-5682-406e-bad7-64dc0a243d89 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:21.453586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b33161f-5682-406e-bad7-64dc0a243d89 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:21.454559 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b33161f-5682-406e-bad7-64dc0a243d89 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:21.455188 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b33161f-5682-406e-bad7-64dc0a243d89 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:21.782831 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4b6ecd91-27b1-4c8a-a349-72946726ed93 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:21.820602 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4b6ecd91-27b1-4c8a-a349-72946726ed93 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378" status: 200 len: 1520 microversion: 2.1 time: 0.555468 Oct 05 02:54:21.825753 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2579/5175] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:21 2022] GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378 => generated 1520 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:54:21.844126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-485fd6b1-9963-4921-8658-78f6a9b4dfb3 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:21.844841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-485fd6b1-9963-4921-8658-78f6a9b4dfb3 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 69a268a7-62f4-4ef2-b5ce-45469cba9c7a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:21.871182 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-485fd6b1-9963-4921-8658-78f6a9b4dfb3 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:21.875409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-485fd6b1-9963-4921-8658-78f6a9b4dfb3 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:21.875885 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-485fd6b1-9963-4921-8658-78f6a9b4dfb3 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:21.881354 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-485fd6b1-9963-4921-8658-78f6a9b4dfb3 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:21.889604 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-485fd6b1-9963-4921-8658-78f6a9b4dfb3 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:21.890079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-485fd6b1-9963-4921-8658-78f6a9b4dfb3 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:22.897942 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0b33161f-5682-406e-bad7-64dc0a243d89 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:22.906977 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0b33161f-5682-406e-bad7-64dc0a243d89 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1526 microversion: 2.1 time: 1.479040 Oct 05 02:54:22.924251 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2597/5176] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:21 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1526 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:22.935482 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9920a178-b103-4761-afac-ad3a5a6a84b5 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:22.936334 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9920a178-b103-4761-afac-ad3a5a6a84b5 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:22.947848 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9920a178-b103-4761-afac-ad3a5a6a84b5 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:22.951181 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9920a178-b103-4761-afac-ad3a5a6a84b5 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:22.951815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9920a178-b103-4761-afac-ad3a5a6a84b5 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:22.955699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9920a178-b103-4761-afac-ad3a5a6a84b5 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:22.956470 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9920a178-b103-4761-afac-ad3a5a6a84b5 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:22.957157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9920a178-b103-4761-afac-ad3a5a6a84b5 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:23.190698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-485fd6b1-9963-4921-8658-78f6a9b4dfb3 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:23.199586 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-485fd6b1-9963-4921-8658-78f6a9b4dfb3 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a" status: 200 len: 1320 microversion: 2.1 time: 1.371347 Oct 05 02:54:23.200239 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2580/5177] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:21 2022] GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a => generated 1320 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:23.366464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9920a178-b103-4761-afac-ad3a5a6a84b5 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:23.375668 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9920a178-b103-4761-afac-ad3a5a6a84b5 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378" status: 200 len: 1520 microversion: 2.1 time: 0.443945 Oct 05 02:54:23.390157 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2598/5178] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:22 2022] GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378 => generated 1520 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:23.934968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-93e836bb-13c8-4d51-b6a3-51d66f392665 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:23.935928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-93e836bb-13c8-4d51-b6a3-51d66f392665 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:23.944313 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93e836bb-13c8-4d51-b6a3-51d66f392665 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:23.945066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93e836bb-13c8-4d51-b6a3-51d66f392665 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:23.945850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93e836bb-13c8-4d51-b6a3-51d66f392665 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:23.946945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93e836bb-13c8-4d51-b6a3-51d66f392665 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:23.947584 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93e836bb-13c8-4d51-b6a3-51d66f392665 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:23.948187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93e836bb-13c8-4d51-b6a3-51d66f392665 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:24.039633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-75266773-ea89-4fff-a385-dbe78c975513 req-2f90572e-8ae9-48a8-b5c4-b157b0f491ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "318c0ef8-f225-43ef-984f-b5407fa92e1f", "name": "network-vif-plugged", "status": "completed", "tag": "bad51ab7-5ef6-467a-a3e8-d282c09f2e0c"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:54:24.059140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-75266773-ea89-4fff-a385-dbe78c975513 req-2f90572e-8ae9-48a8-b5c4-b157b0f491ac service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:24.059752 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-75266773-ea89-4fff-a385-dbe78c975513 req-2f90572e-8ae9-48a8-b5c4-b157b0f491ac service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:24.060289 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-75266773-ea89-4fff-a385-dbe78c975513 req-2f90572e-8ae9-48a8-b5c4-b157b0f491ac service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:24.074275 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-75266773-ea89-4fff-a385-dbe78c975513 req-2f90572e-8ae9-48a8-b5c4-b157b0f491ac service nova] Creating event network-vif-plugged:bad51ab7-5ef6-467a-a3e8-d282c09f2e0c for instance 318c0ef8-f225-43ef-984f-b5407fa92e1f on n-h1-858272-3 Oct 05 02:54:24.079473 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-75266773-ea89-4fff-a385-dbe78c975513 req-2f90572e-8ae9-48a8-b5c4-b157b0f491ac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044351 Oct 05 02:54:24.080202 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2599/5179] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:54:24.196749 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-93e836bb-13c8-4d51-b6a3-51d66f392665 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:24.205643 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-93e836bb-13c8-4d51-b6a3-51d66f392665 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1526 microversion: 2.1 time: 0.277215 Oct 05 02:54:24.206365 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2581/5180] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:23 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1526 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:24.222382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5e7a7115-5ed0-4b2a-b047-70a0cbb4695a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:24.223307 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5e7a7115-5ed0-4b2a-b047-70a0cbb4695a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 69a268a7-62f4-4ef2-b5ce-45469cba9c7a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:24.229926 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e7a7115-5ed0-4b2a-b047-70a0cbb4695a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:24.230410 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e7a7115-5ed0-4b2a-b047-70a0cbb4695a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:24.230892 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e7a7115-5ed0-4b2a-b047-70a0cbb4695a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:24.231618 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e7a7115-5ed0-4b2a-b047-70a0cbb4695a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:24.232209 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e7a7115-5ed0-4b2a-b047-70a0cbb4695a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:24.232637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e7a7115-5ed0-4b2a-b047-70a0cbb4695a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:24.416159 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c4be37ff-3b89-4d1a-b892-5877e1600ecf tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:24.416778 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c4be37ff-3b89-4d1a-b892-5877e1600ecf tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:24.422951 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4be37ff-3b89-4d1a-b892-5877e1600ecf tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:24.423434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4be37ff-3b89-4d1a-b892-5877e1600ecf tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:24.423862 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4be37ff-3b89-4d1a-b892-5877e1600ecf tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:24.424548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4be37ff-3b89-4d1a-b892-5877e1600ecf tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:24.425025 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4be37ff-3b89-4d1a-b892-5877e1600ecf tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:24.425447 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4be37ff-3b89-4d1a-b892-5877e1600ecf tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:24.436792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5e7a7115-5ed0-4b2a-b047-70a0cbb4695a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:24.445137 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5e7a7115-5ed0-4b2a-b047-70a0cbb4695a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a" status: 200 len: 1320 microversion: 2.1 time: 0.227314 Oct 05 02:54:24.445661 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2600/5181] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:24 2022] GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a => generated 1320 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:54:24.572242 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c4be37ff-3b89-4d1a-b892-5877e1600ecf tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:24.582113 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c4be37ff-3b89-4d1a-b892-5877e1600ecf tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378" status: 200 len: 1520 microversion: 2.1 time: 0.169695 Oct 05 02:54:24.582995 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2582/5182] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:24 2022] GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:54:25.231318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5a3cc757-a508-4137-a286-c07eb20831fd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:25.232428 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5a3cc757-a508-4137-a286-c07eb20831fd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:25.248210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a3cc757-a508-4137-a286-c07eb20831fd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:25.249161 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a3cc757-a508-4137-a286-c07eb20831fd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:25.249769 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a3cc757-a508-4137-a286-c07eb20831fd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:25.250962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a3cc757-a508-4137-a286-c07eb20831fd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:25.252030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a3cc757-a508-4137-a286-c07eb20831fd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:25.252624 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a3cc757-a508-4137-a286-c07eb20831fd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:25.468546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-50a60c92-4474-4a8a-a57b-8a1cfda69fc4 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:25.474634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-50a60c92-4474-4a8a-a57b-8a1cfda69fc4 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 69a268a7-62f4-4ef2-b5ce-45469cba9c7a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:25.483337 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-50a60c92-4474-4a8a-a57b-8a1cfda69fc4 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:25.484176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-50a60c92-4474-4a8a-a57b-8a1cfda69fc4 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:25.484969 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-50a60c92-4474-4a8a-a57b-8a1cfda69fc4 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:25.485878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-50a60c92-4474-4a8a-a57b-8a1cfda69fc4 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:25.486551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-50a60c92-4474-4a8a-a57b-8a1cfda69fc4 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:25.487173 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-50a60c92-4474-4a8a-a57b-8a1cfda69fc4 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:25.543192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:25.845576 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5a3cc757-a508-4137-a286-c07eb20831fd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:25.858349 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-50a60c92-4474-4a8a-a57b-8a1cfda69fc4 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:25.886507 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-50a60c92-4474-4a8a-a57b-8a1cfda69fc4 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a" status: 200 len: 1320 microversion: 2.1 time: 0.406950 Oct 05 02:54:25.892127 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5a3cc757-a508-4137-a286-c07eb20831fd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1508 microversion: 2.1 time: 0.664905 Oct 05 02:54:25.894089 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2583/5183] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:25 2022] GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a => generated 1320 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:25.911539 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2601/5184] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:25 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1508 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:25.918430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-949663c8-1e00-40c3-8d45-fddf6ea0022a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:25.920095 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-949663c8-1e00-40c3-8d45-fddf6ea0022a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:25.935409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-949663c8-1e00-40c3-8d45-fddf6ea0022a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:25.936184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-949663c8-1e00-40c3-8d45-fddf6ea0022a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:25.940785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-949663c8-1e00-40c3-8d45-fddf6ea0022a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:25.942535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-949663c8-1e00-40c3-8d45-fddf6ea0022a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:25.944084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-949663c8-1e00-40c3-8d45-fddf6ea0022a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:25.945532 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-949663c8-1e00-40c3-8d45-fddf6ea0022a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:26.178961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-949663c8-1e00-40c3-8d45-fddf6ea0022a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:26.187331 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-949663c8-1e00-40c3-8d45-fddf6ea0022a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378" status: 200 len: 1520 microversion: 2.1 time: 0.287323 Oct 05 02:54:26.188041 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2584/5185] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:25 2022] GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378 => generated 1520 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:26.900910 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-c481f5b3-2403-44c8-a4a4-7cfdcd3f9955 req-674761dc-60e1-4383-94b6-e0be8b8a5146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69a268a7-62f4-4ef2-b5ce-45469cba9c7a", "name": "network-vif-plugged", "status": "completed", "tag": "fddc21db-621d-48b6-9fa4-da62e16cdb6c"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:54:26.912726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c481f5b3-2403-44c8-a4a4-7cfdcd3f9955 req-674761dc-60e1-4383-94b6-e0be8b8a5146 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:26.913342 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c481f5b3-2403-44c8-a4a4-7cfdcd3f9955 req-674761dc-60e1-4383-94b6-e0be8b8a5146 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:26.913782 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c481f5b3-2403-44c8-a4a4-7cfdcd3f9955 req-674761dc-60e1-4383-94b6-e0be8b8a5146 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:26.914011 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6f949b08-fdb4-4d11-a722-fb493c6111f6 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:26.914629 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6f949b08-fdb4-4d11-a722-fb493c6111f6 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 69a268a7-62f4-4ef2-b5ce-45469cba9c7a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:26.925829 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-c481f5b3-2403-44c8-a4a4-7cfdcd3f9955 req-674761dc-60e1-4383-94b6-e0be8b8a5146 service nova] Creating event network-vif-plugged:fddc21db-621d-48b6-9fa4-da62e16cdb6c for instance 69a268a7-62f4-4ef2-b5ce-45469cba9c7a on n-h2-858272-3 Oct 05 02:54:26.926787 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f949b08-fdb4-4d11-a722-fb493c6111f6 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:26.927867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f949b08-fdb4-4d11-a722-fb493c6111f6 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:26.928448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f949b08-fdb4-4d11-a722-fb493c6111f6 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:26.929727 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f949b08-fdb4-4d11-a722-fb493c6111f6 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:26.930253 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f949b08-fdb4-4d11-a722-fb493c6111f6 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:26.930937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f949b08-fdb4-4d11-a722-fb493c6111f6 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:26.932954 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-c481f5b3-2403-44c8-a4a4-7cfdcd3f9955 req-674761dc-60e1-4383-94b6-e0be8b8a5146 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036614 Oct 05 02:54:26.934362 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2602/5186] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:54:26.943023 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cf539cfa-133a-488b-a67a-1c097a188e0f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:26.944051 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cf539cfa-133a-488b-a67a-1c097a188e0f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:26.951710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf539cfa-133a-488b-a67a-1c097a188e0f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:26.952635 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf539cfa-133a-488b-a67a-1c097a188e0f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:26.953316 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf539cfa-133a-488b-a67a-1c097a188e0f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:26.954906 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf539cfa-133a-488b-a67a-1c097a188e0f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:26.955588 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf539cfa-133a-488b-a67a-1c097a188e0f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:26.956249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf539cfa-133a-488b-a67a-1c097a188e0f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:27.153718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6f949b08-fdb4-4d11-a722-fb493c6111f6 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:27.158774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cf539cfa-133a-488b-a67a-1c097a188e0f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:27.161630 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6f949b08-fdb4-4d11-a722-fb493c6111f6 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a" status: 200 len: 1320 microversion: 2.1 time: 0.251672 Oct 05 02:54:27.162306 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2585/5187] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:26 2022] GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a => generated 1320 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:54:27.167457 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cf539cfa-133a-488b-a67a-1c097a188e0f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1508 microversion: 2.1 time: 0.231528 Oct 05 02:54:27.168062 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2603/5188] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:26 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1508 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:27.211419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bfd3498e-41fe-40d4-b95c-bf9ba0193b15 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:27.212040 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bfd3498e-41fe-40d4-b95c-bf9ba0193b15 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:27.218030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bfd3498e-41fe-40d4-b95c-bf9ba0193b15 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:27.218522 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bfd3498e-41fe-40d4-b95c-bf9ba0193b15 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:27.218964 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bfd3498e-41fe-40d4-b95c-bf9ba0193b15 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:27.219657 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bfd3498e-41fe-40d4-b95c-bf9ba0193b15 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:27.220116 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bfd3498e-41fe-40d4-b95c-bf9ba0193b15 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:27.220548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bfd3498e-41fe-40d4-b95c-bf9ba0193b15 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:27.365753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bfd3498e-41fe-40d4-b95c-bf9ba0193b15 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:27.377096 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bfd3498e-41fe-40d4-b95c-bf9ba0193b15 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378" status: 200 len: 1520 microversion: 2.1 time: 0.168965 Oct 05 02:54:27.377226 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2586/5189] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:27 2022] GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:54:28.187326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d7d90a11-f609-438c-a600-a52b85161e21 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:28.188295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d7d90a11-f609-438c-a600-a52b85161e21 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 69a268a7-62f4-4ef2-b5ce-45469cba9c7a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:28.191647 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f21c5ac0-09c4-421d-9934-6403f53382e4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:28.192323 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f21c5ac0-09c4-421d-9934-6403f53382e4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:28.195795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7d90a11-f609-438c-a600-a52b85161e21 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:28.196306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7d90a11-f609-438c-a600-a52b85161e21 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:28.196759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7d90a11-f609-438c-a600-a52b85161e21 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:28.197681 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7d90a11-f609-438c-a600-a52b85161e21 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:28.198380 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7d90a11-f609-438c-a600-a52b85161e21 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:28.198824 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7d90a11-f609-438c-a600-a52b85161e21 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:28.205138 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f21c5ac0-09c4-421d-9934-6403f53382e4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:28.205646 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f21c5ac0-09c4-421d-9934-6403f53382e4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:28.206090 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f21c5ac0-09c4-421d-9934-6403f53382e4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:28.206818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f21c5ac0-09c4-421d-9934-6403f53382e4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:28.207315 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f21c5ac0-09c4-421d-9934-6403f53382e4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:28.207734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f21c5ac0-09c4-421d-9934-6403f53382e4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:28.429879 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f21c5ac0-09c4-421d-9934-6403f53382e4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:28.443234 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f21c5ac0-09c4-421d-9934-6403f53382e4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1511 microversion: 2.1 time: 0.255384 Oct 05 02:54:28.448605 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2587/5190] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:28 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1511 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:28.466737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d7d90a11-f609-438c-a600-a52b85161e21 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:28.471690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-552dca7d-678a-4aae-83ec-b9b9c133d431 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:28.472314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-552dca7d-678a-4aae-83ec-b9b9c133d431 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:28.482653 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d7d90a11-f609-438c-a600-a52b85161e21 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a" status: 200 len: 1320 microversion: 2.1 time: 0.301125 Oct 05 02:54:28.483508 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2604/5191] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:28 2022] GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a => generated 1320 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:28.493051 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-552dca7d-678a-4aae-83ec-b9b9c133d431 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:28.493724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-552dca7d-678a-4aae-83ec-b9b9c133d431 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:28.494321 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-552dca7d-678a-4aae-83ec-b9b9c133d431 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:28.495153 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-552dca7d-678a-4aae-83ec-b9b9c133d431 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:28.495730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-552dca7d-678a-4aae-83ec-b9b9c133d431 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:28.496283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-552dca7d-678a-4aae-83ec-b9b9c133d431 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:28.503845 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-55e2b16d-b04f-4d50-ac60-0661730abe8e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:28.504689 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-55e2b16d-b04f-4d50-ac60-0661730abe8e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:28.511468 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55e2b16d-b04f-4d50-ac60-0661730abe8e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:28.511971 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55e2b16d-b04f-4d50-ac60-0661730abe8e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:28.512422 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55e2b16d-b04f-4d50-ac60-0661730abe8e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:28.513165 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55e2b16d-b04f-4d50-ac60-0661730abe8e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:28.513636 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55e2b16d-b04f-4d50-ac60-0661730abe8e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:28.514061 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55e2b16d-b04f-4d50-ac60-0661730abe8e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:28.833706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-55e2b16d-b04f-4d50-ac60-0661730abe8e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:28.843196 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-55e2b16d-b04f-4d50-ac60-0661730abe8e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1511 microversion: 2.1 time: 0.357811 Oct 05 02:54:28.843855 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2605/5192] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:28 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1511 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:28.888596 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-552dca7d-678a-4aae-83ec-b9b9c133d431 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:28.898490 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-552dca7d-678a-4aae-83ec-b9b9c133d431 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378" status: 200 len: 1520 microversion: 2.1 time: 0.446273 Oct 05 02:54:28.901492 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2588/5193] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:28 2022] GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378 => generated 1520 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:28.946535 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c1c6dee4-2b54-4a13-9fcd-d13c17ea56da tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:54:28.947082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c1c6dee4-2b54-4a13-9fcd-d13c17ea56da tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:28.954056 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1c6dee4-2b54-4a13-9fcd-d13c17ea56da tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:28.954554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1c6dee4-2b54-4a13-9fcd-d13c17ea56da tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:28.954998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1c6dee4-2b54-4a13-9fcd-d13c17ea56da tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:28.955704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1c6dee4-2b54-4a13-9fcd-d13c17ea56da tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:28.956159 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1c6dee4-2b54-4a13-9fcd-d13c17ea56da tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:28.956574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1c6dee4-2b54-4a13-9fcd-d13c17ea56da tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:28.961804 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:28.978484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-7243c91c-cfd3-4dcb-8899-724f5e13bf43 req-b808d765-2393-4025-bd20-d571943026b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fded3d6-d275-4d50-a366-d19388f8aaec", "name": "network-vif-unplugged", "status": "completed", "tag": "877cbc45-f570-4bb6-bcd2-91b67dbccdb3"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:54:28.985260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-c1c6dee4-2b54-4a13-9fcd-d13c17ea56da tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lazy-loading 'flavor' on Instance uuid 1fded3d6-d275-4d50-a366-d19388f8aaec {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-c1c6dee4-2b54-4a13-9fcd-d13c17ea56da tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Cannot 'shelve' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state shelved_offloaded Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c1c6dee4-2b54-4a13-9fcd-d13c17ea56da tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec/action HTTP/1.1 Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 14 Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: {"shelve": {}} Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: exception: Cannot 'shelve' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state shelved_offloaded Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '1fded3d6-d275-4d50-a366-d19388f8aaec', 'body': {'shelve': {}}} Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1fded3d6-d275-4d50-a366-d19388f8aaec in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:54:29.007421 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 05 02:54:29.011145 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 05 02:54:29.011145 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 05 02:54:29.011145 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 02:54:29.011145 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state shelved_offloaded Oct 05 02:54:29.011145 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:54:29.011145 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:54:29.011145 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:54:29.011145 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:54:29.011145 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:54:29.011145 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:54:29.011145 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:54:29.011145 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:54:29.011145 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state shelved_offloaded Oct 05 02:54:29.011145 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:54:29.011145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c1c6dee4-2b54-4a13-9fcd-d13c17ea56da tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 409 to user: Cannot 'shelve' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state shelved_offloaded {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:54:29.011145 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c1c6dee4-2b54-4a13-9fcd-d13c17ea56da tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec/action" status: 409 len: 155 microversion: 2.1 time: 0.063325 Oct 05 02:54:29.013842 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-7243c91c-cfd3-4dcb-8899-724f5e13bf43 req-b808d765-2393-4025-bd20-d571943026b3 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:29.013946 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2606/5194] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:54:28 2022] POST /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec/action => generated 155 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:54:29.014029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-7243c91c-cfd3-4dcb-8899-724f5e13bf43 req-b808d765-2393-4025-bd20-d571943026b3 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:29.014029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-7243c91c-cfd3-4dcb-8899-724f5e13bf43 req-b808d765-2393-4025-bd20-d571943026b3 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:29.022396 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ed1f54bc-0a5f-4f80-842e-68568f4c3790 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:54:29.023164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ed1f54bc-0a5f-4f80-842e-68568f4c3790 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:29.031189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed1f54bc-0a5f-4f80-842e-68568f4c3790 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:29.031902 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed1f54bc-0a5f-4f80-842e-68568f4c3790 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:29.032511 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed1f54bc-0a5f-4f80-842e-68568f4c3790 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:29.033388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed1f54bc-0a5f-4f80-842e-68568f4c3790 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:29.033987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed1f54bc-0a5f-4f80-842e-68568f4c3790 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:29.034558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed1f54bc-0a5f-4f80-842e-68568f4c3790 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:29.045171 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-7243c91c-cfd3-4dcb-8899-724f5e13bf43 req-b808d765-2393-4025-bd20-d571943026b3 service nova] Creating event network-vif-unplugged:877cbc45-f570-4bb6-bcd2-91b67dbccdb3 for instance 1fded3d6-d275-4d50-a366-d19388f8aaec on n-h2-858272-3 Oct 05 02:54:29.057981 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-7243c91c-cfd3-4dcb-8899-724f5e13bf43 req-b808d765-2393-4025-bd20-d571943026b3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086127 Oct 05 02:54:29.064427 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2589/5195] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:54:29.104688 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ed1f54bc-0a5f-4f80-842e-68568f4c3790 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122319) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 05 02:54:29.233880 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ed1f54bc-0a5f-4f80-842e-68568f4c3790 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec/action" status: 202 len: 0 microversion: 2.1 time: 0.210041 Oct 05 02:54:29.233880 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2607/5196] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:54:29 2022] POST /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:54:29.241126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-83b0913a-8048-40b1-92bb-f4587454d901 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:29.242003 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-83b0913a-8048-40b1-92bb-f4587454d901 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:29.252273 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83b0913a-8048-40b1-92bb-f4587454d901 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:29.252793 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83b0913a-8048-40b1-92bb-f4587454d901 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:29.253210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83b0913a-8048-40b1-92bb-f4587454d901 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:29.255019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83b0913a-8048-40b1-92bb-f4587454d901 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:29.255476 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83b0913a-8048-40b1-92bb-f4587454d901 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:29.255978 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83b0913a-8048-40b1-92bb-f4587454d901 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:29.447898 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-83b0913a-8048-40b1-92bb-f4587454d901 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:29.456502 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-83b0913a-8048-40b1-92bb-f4587454d901 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1519 microversion: 2.1 time: 0.222601 Oct 05 02:54:29.457757 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2590/5197] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:29 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1519 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:29.515650 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ab00e7d1-3c17-4fb3-9860-5ac93a706b7b tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:29.517927 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ab00e7d1-3c17-4fb3-9860-5ac93a706b7b tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 69a268a7-62f4-4ef2-b5ce-45469cba9c7a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:29.531200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab00e7d1-3c17-4fb3-9860-5ac93a706b7b tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:29.534573 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab00e7d1-3c17-4fb3-9860-5ac93a706b7b tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:29.535595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab00e7d1-3c17-4fb3-9860-5ac93a706b7b tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:29.538019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab00e7d1-3c17-4fb3-9860-5ac93a706b7b tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:29.539309 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab00e7d1-3c17-4fb3-9860-5ac93a706b7b tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:29.540474 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab00e7d1-3c17-4fb3-9860-5ac93a706b7b tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:29.732345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ab00e7d1-3c17-4fb3-9860-5ac93a706b7b tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:29.745790 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ab00e7d1-3c17-4fb3-9860-5ac93a706b7b tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a" status: 200 len: 1320 microversion: 2.1 time: 0.241783 Oct 05 02:54:29.746703 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2608/5198] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:29 2022] GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a => generated 1320 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:29.927007 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-94e855f8-3578-4ec6-8597-c128f7ea342d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:29.928068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-94e855f8-3578-4ec6-8597-c128f7ea342d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:29.937860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94e855f8-3578-4ec6-8597-c128f7ea342d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:29.938805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94e855f8-3578-4ec6-8597-c128f7ea342d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:29.938926 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94e855f8-3578-4ec6-8597-c128f7ea342d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:29.939674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94e855f8-3578-4ec6-8597-c128f7ea342d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:29.940157 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94e855f8-3578-4ec6-8597-c128f7ea342d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:29.940581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94e855f8-3578-4ec6-8597-c128f7ea342d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:30.126616 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-94e855f8-3578-4ec6-8597-c128f7ea342d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:30.136422 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-94e855f8-3578-4ec6-8597-c128f7ea342d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378" status: 200 len: 1520 microversion: 2.1 time: 0.214061 Oct 05 02:54:30.137294 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2591/5199] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:29 2022] GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378 => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:30.480671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-215ebe44-00b8-4190-94aa-80956cc2d41a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:30.482032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-215ebe44-00b8-4190-94aa-80956cc2d41a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:30.500749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-215ebe44-00b8-4190-94aa-80956cc2d41a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:30.501512 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-215ebe44-00b8-4190-94aa-80956cc2d41a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:30.502358 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-215ebe44-00b8-4190-94aa-80956cc2d41a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:30.503663 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-215ebe44-00b8-4190-94aa-80956cc2d41a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:30.505130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-215ebe44-00b8-4190-94aa-80956cc2d41a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:30.505755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-215ebe44-00b8-4190-94aa-80956cc2d41a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:30.772467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9dc79f86-500b-405a-9118-6195e86d6a0f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:30.774392 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9dc79f86-500b-405a-9118-6195e86d6a0f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 69a268a7-62f4-4ef2-b5ce-45469cba9c7a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:30.788092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9dc79f86-500b-405a-9118-6195e86d6a0f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:30.788945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9dc79f86-500b-405a-9118-6195e86d6a0f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:30.789733 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9dc79f86-500b-405a-9118-6195e86d6a0f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:30.791558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9dc79f86-500b-405a-9118-6195e86d6a0f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:30.792678 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9dc79f86-500b-405a-9118-6195e86d6a0f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:30.798769 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9dc79f86-500b-405a-9118-6195e86d6a0f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:30.983451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-215ebe44-00b8-4190-94aa-80956cc2d41a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:30.993847 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-215ebe44-00b8-4190-94aa-80956cc2d41a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1459 microversion: 2.1 time: 0.517164 Oct 05 02:54:30.997150 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2609/5200] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:30 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1459 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:31.164960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c62c8ec9-a22d-43d1-acdf-59bf8a5c8af0 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:31.177709 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c62c8ec9-a22d-43d1-acdf-59bf8a5c8af0 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:31.187977 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c62c8ec9-a22d-43d1-acdf-59bf8a5c8af0 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:31.188869 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c62c8ec9-a22d-43d1-acdf-59bf8a5c8af0 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:31.189582 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c62c8ec9-a22d-43d1-acdf-59bf8a5c8af0 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:31.192409 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c62c8ec9-a22d-43d1-acdf-59bf8a5c8af0 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:31.193448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c62c8ec9-a22d-43d1-acdf-59bf8a5c8af0 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:31.194041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c62c8ec9-a22d-43d1-acdf-59bf8a5c8af0 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:31.202126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9dc79f86-500b-405a-9118-6195e86d6a0f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:31.212541 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9dc79f86-500b-405a-9118-6195e86d6a0f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a" status: 200 len: 1511 microversion: 2.1 time: 0.444533 Oct 05 02:54:31.223542 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2592/5201] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:30 2022] GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a => generated 1511 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:31.236269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c1c6cc56-5846-4f72-9096-eb121bb12100 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:31.237187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c1c6cc56-5846-4f72-9096-eb121bb12100 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: d39cd597-890f-4cc8-8d05-9a1b65f9ab32] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:31.247098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1c6cc56-5846-4f72-9096-eb121bb12100 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:31.247607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1c6cc56-5846-4f72-9096-eb121bb12100 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:31.248054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1c6cc56-5846-4f72-9096-eb121bb12100 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:31.249706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1c6cc56-5846-4f72-9096-eb121bb12100 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:31.250167 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1c6cc56-5846-4f72-9096-eb121bb12100 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:31.250606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1c6cc56-5846-4f72-9096-eb121bb12100 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:31.498311 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c1c6cc56-5846-4f72-9096-eb121bb12100 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:31.507887 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c1c6cc56-5846-4f72-9096-eb121bb12100 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32" status: 200 len: 1511 microversion: 2.1 time: 0.276051 Oct 05 02:54:31.529554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c62c8ec9-a22d-43d1-acdf-59bf8a5c8af0 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:31.534122 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2593/5202] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:31 2022] GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32 => generated 1511 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:54:31.538558 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c62c8ec9-a22d-43d1-acdf-59bf8a5c8af0 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378" status: 200 len: 1520 microversion: 2.1 time: 0.382635 Oct 05 02:54:31.539136 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2610/5203] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:31 2022] GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378 => generated 1520 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:54:31.549117 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-854d529d-4ffa-47fc-aeaa-9108a5e65cd9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:31.550092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-854d529d-4ffa-47fc-aeaa-9108a5e65cd9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:31.553661 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4c72297e-5749-48a6-8301-57e5c9120d38 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:31.554536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4c72297e-5749-48a6-8301-57e5c9120d38 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 318c0ef8-f225-43ef-984f-b5407fa92e1f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:31.567051 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-854d529d-4ffa-47fc-aeaa-9108a5e65cd9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:31.567895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-854d529d-4ffa-47fc-aeaa-9108a5e65cd9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:31.568329 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c72297e-5749-48a6-8301-57e5c9120d38 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:31.569049 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c72297e-5749-48a6-8301-57e5c9120d38 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:31.569708 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-854d529d-4ffa-47fc-aeaa-9108a5e65cd9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:31.570507 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c72297e-5749-48a6-8301-57e5c9120d38 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:31.572171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c72297e-5749-48a6-8301-57e5c9120d38 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:31.572668 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-854d529d-4ffa-47fc-aeaa-9108a5e65cd9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:31.573324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-854d529d-4ffa-47fc-aeaa-9108a5e65cd9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:31.573954 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c72297e-5749-48a6-8301-57e5c9120d38 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:31.574573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-854d529d-4ffa-47fc-aeaa-9108a5e65cd9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:31.576616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c72297e-5749-48a6-8301-57e5c9120d38 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:31.933720 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4c72297e-5749-48a6-8301-57e5c9120d38 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:31.944503 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4c72297e-5749-48a6-8301-57e5c9120d38 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/318c0ef8-f225-43ef-984f-b5407fa92e1f" status: 200 len: 1512 microversion: 2.1 time: 0.401467 Oct 05 02:54:31.945350 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2611/5204] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:31 2022] GET /compute/v2.1/servers/318c0ef8-f225-43ef-984f-b5407fa92e1f => generated 1512 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:31.953118 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-854d529d-4ffa-47fc-aeaa-9108a5e65cd9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:31.962450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-854d529d-4ffa-47fc-aeaa-9108a5e65cd9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:31.963868 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-854d529d-4ffa-47fc-aeaa-9108a5e65cd9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:31.965199 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-854d529d-4ffa-47fc-aeaa-9108a5e65cd9 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 2951 microversion: 2.32 time: 0.424920 Oct 05 02:54:31.965761 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2594/5205] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:54:31 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 2951 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:54:31.970193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-47463e5c-9fdd-4703-910e-6ab273fa2e1a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:31.980158 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-47463e5c-9fdd-4703-910e-6ab273fa2e1a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:31.986359 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-47463e5c-9fdd-4703-910e-6ab273fa2e1a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef'} {{(pid=122319) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:54:31.997886 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3201eb2c-3110-4c0a-a022-1cc2b40a9061 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:31.998452 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3201eb2c-3110-4c0a-a022-1cc2b40a9061 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:32.001905 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-47463e5c-9fdd-4703-910e-6ab273fa2e1a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:32.002421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-47463e5c-9fdd-4703-910e-6ab273fa2e1a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:32.002871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-47463e5c-9fdd-4703-910e-6ab273fa2e1a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:32.003674 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-47463e5c-9fdd-4703-910e-6ab273fa2e1a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:32.004229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-47463e5c-9fdd-4703-910e-6ab273fa2e1a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:32.004667 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-47463e5c-9fdd-4703-910e-6ab273fa2e1a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:32.008273 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3201eb2c-3110-4c0a-a022-1cc2b40a9061 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:32.008927 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3201eb2c-3110-4c0a-a022-1cc2b40a9061 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:32.009552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3201eb2c-3110-4c0a-a022-1cc2b40a9061 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:32.010406 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3201eb2c-3110-4c0a-a022-1cc2b40a9061 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:32.010965 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3201eb2c-3110-4c0a-a022-1cc2b40a9061 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:32.011481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3201eb2c-3110-4c0a-a022-1cc2b40a9061 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:32.123423 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.multi_cell_list [None req-47463e5c-9fdd-4703-910e-6ab273fa2e1a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122319) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:54:32.210504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-47463e5c-9fdd-4703-910e-6ab273fa2e1a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:32.217434 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-47463e5c-9fdd-4703-910e-6ab273fa2e1a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:32.218019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-47463e5c-9fdd-4703-910e-6ab273fa2e1a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:32.218656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-47463e5c-9fdd-4703-910e-6ab273fa2e1a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:32.257082 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3201eb2c-3110-4c0a-a022-1cc2b40a9061 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.263927 Oct 05 02:54:32.267201 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2595/5206] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Oct 5 02:54:31 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a/os-interface => generated 1831 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:54:32.267201 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8d2acf5c-51db-4e73-ba3b-31a3a4675e90 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:32.267201 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8d2acf5c-51db-4e73-ba3b-31a3a4675e90 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:32.273895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d2acf5c-51db-4e73-ba3b-31a3a4675e90 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:32.274401 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d2acf5c-51db-4e73-ba3b-31a3a4675e90 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:32.274894 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d2acf5c-51db-4e73-ba3b-31a3a4675e90 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:32.276122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d2acf5c-51db-4e73-ba3b-31a3a4675e90 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:32.276594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d2acf5c-51db-4e73-ba3b-31a3a4675e90 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:32.277656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d2acf5c-51db-4e73-ba3b-31a3a4675e90 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:32.574545 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-47463e5c-9fdd-4703-910e-6ab273fa2e1a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.609202 Oct 05 02:54:32.584992 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2612/5207] 10.222.0.16 () {58 vars in 1167 bytes} [Wed Oct 5 02:54:31 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:54:32.584992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-87dc3a3f-e7ea-46c9-bd42-46dc1877bc06 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:32.584992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-87dc3a3f-e7ea-46c9-bd42-46dc1877bc06 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:32.596680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87dc3a3f-e7ea-46c9-bd42-46dc1877bc06 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:32.596972 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87dc3a3f-e7ea-46c9-bd42-46dc1877bc06 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:32.597930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87dc3a3f-e7ea-46c9-bd42-46dc1877bc06 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:32.599314 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87dc3a3f-e7ea-46c9-bd42-46dc1877bc06 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:32.599314 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87dc3a3f-e7ea-46c9-bd42-46dc1877bc06 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:32.599314 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87dc3a3f-e7ea-46c9-bd42-46dc1877bc06 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:32.637949 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8d2acf5c-51db-4e73-ba3b-31a3a4675e90 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:32.647063 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8d2acf5c-51db-4e73-ba3b-31a3a4675e90 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1517 microversion: 2.1 time: 0.387964 Oct 05 02:54:32.647759 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2596/5208] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:32 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1517 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:32.671726 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-96bb2c0b-c269-422f-a80f-15610d7a2258 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:32.681480 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-96bb2c0b-c269-422f-a80f-15610d7a2258 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:32.682676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-96bb2c0b-c269-422f-a80f-15610d7a2258 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-996709922', 'deleted': False, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef'} {{(pid=122320) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:54:32.689906 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96bb2c0b-c269-422f-a80f-15610d7a2258 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:32.690589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96bb2c0b-c269-422f-a80f-15610d7a2258 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:32.691684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96bb2c0b-c269-422f-a80f-15610d7a2258 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:32.692822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96bb2c0b-c269-422f-a80f-15610d7a2258 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:32.693514 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96bb2c0b-c269-422f-a80f-15610d7a2258 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:32.694184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96bb2c0b-c269-422f-a80f-15610d7a2258 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:32.805184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.multi_cell_list [None req-96bb2c0b-c269-422f-a80f-15610d7a2258 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:54:32.888133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-96bb2c0b-c269-422f-a80f-15610d7a2258 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:32.895640 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96bb2c0b-c269-422f-a80f-15610d7a2258 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:32.896274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96bb2c0b-c269-422f-a80f-15610d7a2258 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:32.896795 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96bb2c0b-c269-422f-a80f-15610d7a2258 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:33.576567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-87dc3a3f-e7ea-46c9-bd42-46dc1877bc06 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:33.591376 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-87dc3a3f-e7ea-46c9-bd42-46dc1877bc06 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378" status: 200 len: 1520 microversion: 2.1 time: 1.012257 Oct 05 02:54:33.592297 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2613/5209] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:32 2022] GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378 => generated 1520 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:33.657812 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-96bb2c0b-c269-422f-a80f-15610d7a2258 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-996709922" status: 200 len: 1514 microversion: 2.1 time: 1.008553 Oct 05 02:54:33.658914 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2597/5210] 10.222.0.16 () {58 vars in 1261 bytes} [Wed Oct 5 02:54:32 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-996709922 => generated 1514 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:33.684765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-47f1908c-2e98-48be-9ff7-fabd20b0ec20 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:33.686054 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-47f1908c-2e98-48be-9ff7-fabd20b0ec20 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:33.686868 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fb590e97-0d54-4338-9e65-5daea619e7ec tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:33.692604 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fb590e97-0d54-4338-9e65-5daea619e7ec tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:33.693403 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fb590e97-0d54-4338-9e65-5daea619e7ec tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef'} {{(pid=122320) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:54:33.698437 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-47f1908c-2e98-48be-9ff7-fabd20b0ec20 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:33.699448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-47f1908c-2e98-48be-9ff7-fabd20b0ec20 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:33.700054 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-47f1908c-2e98-48be-9ff7-fabd20b0ec20 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:33.701132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-47f1908c-2e98-48be-9ff7-fabd20b0ec20 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:33.701804 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-47f1908c-2e98-48be-9ff7-fabd20b0ec20 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:33.702437 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-47f1908c-2e98-48be-9ff7-fabd20b0ec20 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:33.711877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb590e97-0d54-4338-9e65-5daea619e7ec tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:33.712304 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb590e97-0d54-4338-9e65-5daea619e7ec tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:33.712739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb590e97-0d54-4338-9e65-5daea619e7ec tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:33.713483 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb590e97-0d54-4338-9e65-5daea619e7ec tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:33.713943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb590e97-0d54-4338-9e65-5daea619e7ec tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:33.714366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb590e97-0d54-4338-9e65-5daea619e7ec tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:33.872085 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.multi_cell_list [None req-fb590e97-0d54-4338-9e65-5daea619e7ec tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:54:33.997119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fb590e97-0d54-4338-9e65-5daea619e7ec tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:34.006151 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:34.011805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb590e97-0d54-4338-9e65-5daea619e7ec tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:34.013791 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb590e97-0d54-4338-9e65-5daea619e7ec tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:34.014387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb590e97-0d54-4338-9e65-5daea619e7ec tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:34.042502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-47f1908c-2e98-48be-9ff7-fabd20b0ec20 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:34.056120 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-47f1908c-2e98-48be-9ff7-fabd20b0ec20 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1517 microversion: 2.1 time: 0.377570 Oct 05 02:54:34.070886 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2614/5211] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:33 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1517 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:34.388635 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fb590e97-0d54-4338-9e65-5daea619e7ec tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 0.706391 Oct 05 02:54:34.401863 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2598/5212] 10.222.0.16 () {58 vars in 1173 bytes} [Wed Oct 5 02:54:33 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:34.422644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-36d4da4f-a910-42be-a5f8-8a228d5da385 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:34.428950 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-36d4da4f-a910-42be-a5f8-8a228d5da385 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:34.429664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.compute.servers [None req-36d4da4f-a910-42be-a5f8-8a228d5da385 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Removing options 'limit' from query {{(pid=122319) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 05 02:54:34.430602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-36d4da4f-a910-42be-a5f8-8a228d5da385 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Searching by: {'deleted': False, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef'} {{(pid=122319) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:54:34.437641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36d4da4f-a910-42be-a5f8-8a228d5da385 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:34.438433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36d4da4f-a910-42be-a5f8-8a228d5da385 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:34.439064 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36d4da4f-a910-42be-a5f8-8a228d5da385 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:34.439974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36d4da4f-a910-42be-a5f8-8a228d5da385 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:34.440675 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36d4da4f-a910-42be-a5f8-8a228d5da385 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:34.441970 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36d4da4f-a910-42be-a5f8-8a228d5da385 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:34.503170 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-36d4da4f-a910-42be-a5f8-8a228d5da385 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:34.521649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36d4da4f-a910-42be-a5f8-8a228d5da385 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:34.522145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36d4da4f-a910-42be-a5f8-8a228d5da385 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:34.522599 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36d4da4f-a910-42be-a5f8-8a228d5da385 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:34.630213 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b48d1dab-d6b8-4008-a256-f9776c8c0328 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:34.631283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b48d1dab-d6b8-4008-a256-f9776c8c0328 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:34.642277 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b48d1dab-d6b8-4008-a256-f9776c8c0328 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:34.643288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b48d1dab-d6b8-4008-a256-f9776c8c0328 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:34.643961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b48d1dab-d6b8-4008-a256-f9776c8c0328 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:34.646701 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b48d1dab-d6b8-4008-a256-f9776c8c0328 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:34.647543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b48d1dab-d6b8-4008-a256-f9776c8c0328 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:34.648429 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b48d1dab-d6b8-4008-a256-f9776c8c0328 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:34.671890 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:34.953562 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-36d4da4f-a910-42be-a5f8-8a228d5da385 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.534674 Oct 05 02:54:34.954303 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2615/5213] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 5 02:54:34 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:34.981477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-44d1df9b-905b-4f86-b7dd-1784ca99a318 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:34.987210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-44d1df9b-905b-4f86-b7dd-1784ca99a318 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:34.988290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-44d1df9b-905b-4f86-b7dd-1784ca99a318 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef'} {{(pid=122319) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:54:34.994839 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44d1df9b-905b-4f86-b7dd-1784ca99a318 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:34.996290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44d1df9b-905b-4f86-b7dd-1784ca99a318 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:34.996919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44d1df9b-905b-4f86-b7dd-1784ca99a318 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:34.997932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44d1df9b-905b-4f86-b7dd-1784ca99a318 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:34.998718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44d1df9b-905b-4f86-b7dd-1784ca99a318 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:34.999292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44d1df9b-905b-4f86-b7dd-1784ca99a318 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:35.068954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b48d1dab-d6b8-4008-a256-f9776c8c0328 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:35.083823 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b48d1dab-d6b8-4008-a256-f9776c8c0328 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378" status: 200 len: 1500 microversion: 2.1 time: 0.469818 Oct 05 02:54:35.084382 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2599/5214] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:34 2022] GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378 => generated 1500 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:35.106474 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-778cb42e-63fe-430e-9dd5-8f93f1852bd2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:35.107359 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-778cb42e-63fe-430e-9dd5-8f93f1852bd2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:35.115429 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-778cb42e-63fe-430e-9dd5-8f93f1852bd2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:35.118461 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-778cb42e-63fe-430e-9dd5-8f93f1852bd2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:35.119100 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.multi_cell_list [None req-44d1df9b-905b-4f86-b7dd-1784ca99a318 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122319) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:54:35.119328 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-778cb42e-63fe-430e-9dd5-8f93f1852bd2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:35.120112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-778cb42e-63fe-430e-9dd5-8f93f1852bd2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:35.120575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-778cb42e-63fe-430e-9dd5-8f93f1852bd2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:35.121043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-778cb42e-63fe-430e-9dd5-8f93f1852bd2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:35.208861 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-44d1df9b-905b-4f86-b7dd-1784ca99a318 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers?status=active" status: 200 len: 1009 microversion: 2.1 time: 0.231498 Oct 05 02:54:35.209492 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2616/5215] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 5 02:54:34 2022] GET /compute/v2.1/servers?status=active => generated 1009 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:54:35.214792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a3ad6c0b-6a93-4d6c-957a-3038c3affd8c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed36a382-4fad-4852-a352-f0dc19e160d0"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:54:35.217599 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a3ad6c0b-6a93-4d6c-957a-3038c3affd8c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:35.224664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3ad6c0b-6a93-4d6c-957a-3038c3affd8c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:35.225189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3ad6c0b-6a93-4d6c-957a-3038c3affd8c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:35.225811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3ad6c0b-6a93-4d6c-957a-3038c3affd8c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:35.226902 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3ad6c0b-6a93-4d6c-957a-3038c3affd8c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:35.227511 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3ad6c0b-6a93-4d6c-957a-3038c3affd8c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:35.228236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3ad6c0b-6a93-4d6c-957a-3038c3affd8c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:35.261362 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-a3ad6c0b-6a93-4d6c-957a-3038c3affd8c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] HTTP exception thrown: Cannot 'attach_volume' instance 09ae93ee-8f09-4552-b933-ad3c7e157378 while it is in vm_state rescued Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a3ad6c0b-6a93-4d6c-957a-3038c3affd8c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Request method failure captured: Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378/os-volume_attachments HTTP/1.1 Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 74 Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPGOLQowIsfBU6KJO-aq50qdRwmBWFeSun5TXHVGHXcRMd_nBRTUvLypi8_xX1_OhJhXqj8Tv9hcB2y77p-h0kTEsykqgEnSv0lMxHhtiAmMmCPjjlgvw91YvvX9SOOQS6JLONmL-pDrthh_0HqZ_QF0o7mi44oPhOdJTsJKEis6xoY Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 129b5343573f4f9fa648e984a68b6760 Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1554781900 Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/129b5343573f4f9fa648e984a68b6760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/129b5343573f4f9fa648e984a68b6760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/129b5343573f4f9fa648e984a68b6760"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_129b5343573f4f9fa648e984a68b6760"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1554781900 Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 129b5343573f4f9fa648e984a68b6760 Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1554781900 Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerRescueNegativeTestJSON-1554781900-project Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: a031e94db13d4e7e8947f51abc36d629 Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1554781900-project Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: {"volumeAttachment": {"volumeId": "ed36a382-4fad-4852-a352-f0dc19e160d0"}} Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: exception: Cannot 'attach_volume' instance 09ae93ee-8f09-4552-b933-ad3c7e157378 while it is in vm_state rescued Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'server_id': '09ae93ee-8f09-4552-b933-ad3c7e157378', 'body': {'volumeAttachment': {'volumeId': 'ed36a382-4fad-4852-a352-f0dc19e160d0'}}} Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 09ae93ee-8f09-4552-b933-ad3c7e157378 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 05 02:54:35.262956 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 05 02:54:35.267236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 05 02:54:35.267236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 02:54:35.267236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 09ae93ee-8f09-4552-b933-ad3c7e157378 while it is in vm_state rescued Oct 05 02:54:35.267236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:54:35.267236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:54:35.267236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:54:35.267236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:54:35.267236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:54:35.267236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:54:35.267236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:54:35.267236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:54:35.267236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 09ae93ee-8f09-4552-b933-ad3c7e157378 while it is in vm_state rescued Oct 05 02:54:35.267236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:54:35.269119 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a3ad6c0b-6a93-4d6c-957a-3038c3affd8c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Returning 409 to user: Cannot 'attach_volume' instance 09ae93ee-8f09-4552-b933-ad3c7e157378 while it is in vm_state rescued {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:54:35.270936 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a3ad6c0b-6a93-4d6c-957a-3038c3affd8c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "POST /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.060326 Oct 05 02:54:35.271669 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2617/5216] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 02:54:35 2022] POST /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378/os-volume_attachments => generated 152 bytes in 61 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:54:35.276431 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0c1986ce-6ae4-4eab-b893-957dce47a84b tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:35.282112 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0c1986ce-6ae4-4eab-b893-957dce47a84b tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:35.282862 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.compute.servers [None req-0c1986ce-6ae4-4eab-b893-957dce47a84b tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Removing options 'limit' from query {{(pid=122319) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 05 02:54:35.283733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0c1986ce-6ae4-4eab-b893-957dce47a84b tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Searching by: {'deleted': False, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef'} {{(pid=122319) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:54:35.291797 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c1986ce-6ae4-4eab-b893-957dce47a84b tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:35.292524 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c1986ce-6ae4-4eab-b893-957dce47a84b tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:35.293179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c1986ce-6ae4-4eab-b893-957dce47a84b tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:35.294066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c1986ce-6ae4-4eab-b893-957dce47a84b tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:35.294741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c1986ce-6ae4-4eab-b893-957dce47a84b tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:35.295323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c1986ce-6ae4-4eab-b893-957dce47a84b tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:35.328074 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.multi_cell_list [None req-0c1986ce-6ae4-4eab-b893-957dce47a84b tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122319) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:54:35.364041 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0c1986ce-6ae4-4eab-b893-957dce47a84b tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1009 microversion: 2.1 time: 0.090463 Oct 05 02:54:35.365036 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2618/5217] 10.222.0.16 () {58 vars in 1150 bytes} [Wed Oct 5 02:54:35 2022] GET /compute/v2.1/servers?limit=100000 => generated 1009 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:35.369941 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-80ef4cd2-1118-4ec9-8c81-c4f4bedb3cda tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:54:35.370827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-80ef4cd2-1118-4ec9-8c81-c4f4bedb3cda tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:35.378042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-80ef4cd2-1118-4ec9-8c81-c4f4bedb3cda tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:35.378776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-80ef4cd2-1118-4ec9-8c81-c4f4bedb3cda tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:35.379984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-80ef4cd2-1118-4ec9-8c81-c4f4bedb3cda tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:35.381132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-80ef4cd2-1118-4ec9-8c81-c4f4bedb3cda tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:35.381882 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-80ef4cd2-1118-4ec9-8c81-c4f4bedb3cda tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:35.382465 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-80ef4cd2-1118-4ec9-8c81-c4f4bedb3cda tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:35.485533 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-80ef4cd2-1118-4ec9-8c81-c4f4bedb3cda tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "POST /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378/action" status: 202 len: 0 microversion: 2.1 time: 0.118840 Oct 05 02:54:35.486370 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2619/5218] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:54:35 2022] POST /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:54:35.505350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-20236265-95df-45d8-845b-336ec989a535 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:35.517204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-20236265-95df-45d8-845b-336ec989a535 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:35.517932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-20236265-95df-45d8-845b-336ec989a535 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Searching by: {'deleted': False, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef'} {{(pid=122319) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:54:35.531422 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20236265-95df-45d8-845b-336ec989a535 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:35.532154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20236265-95df-45d8-845b-336ec989a535 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:35.532847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20236265-95df-45d8-845b-336ec989a535 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:35.533552 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20236265-95df-45d8-845b-336ec989a535 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:35.534161 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20236265-95df-45d8-845b-336ec989a535 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:35.534740 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20236265-95df-45d8-845b-336ec989a535 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:35.552939 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:35.559287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-778cb42e-63fe-430e-9dd5-8f93f1852bd2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:35.571361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.multi_cell_list [None req-20236265-95df-45d8-845b-336ec989a535 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122319) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:54:35.574258 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-778cb42e-63fe-430e-9dd5-8f93f1852bd2 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1517 microversion: 2.1 time: 0.475924 Oct 05 02:54:35.592120 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2600/5219] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:35 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1517 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:35.600609 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c8df1f11-1286-43d9-ab91-b402343bdd5b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:35.601260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c8df1f11-1286-43d9-ab91-b402343bdd5b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:35.615174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8df1f11-1286-43d9-ab91-b402343bdd5b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:35.615672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8df1f11-1286-43d9-ab91-b402343bdd5b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:35.616107 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8df1f11-1286-43d9-ab91-b402343bdd5b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:35.616815 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8df1f11-1286-43d9-ab91-b402343bdd5b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:35.628410 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8df1f11-1286-43d9-ab91-b402343bdd5b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:35.630095 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8df1f11-1286-43d9-ab91-b402343bdd5b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:35.659518 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-20236265-95df-45d8-845b-336ec989a535 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1009 microversion: 2.1 time: 0.171667 Oct 05 02:54:35.664169 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2620/5220] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 5 02:54:35 2022] GET /compute/v2.1/servers => generated 1009 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:35.683612 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-feba295b-0e09-40eb-89cb-d93b46a94927 req-f99329b6-feaa-4eb4-8ae7-c50f18ae595c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fded3d6-d275-4d50-a366-d19388f8aaec", "tag": "877cbc45-f570-4bb6-bcd2-91b67dbccdb3"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:54:35.704871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-feba295b-0e09-40eb-89cb-d93b46a94927 req-f99329b6-feaa-4eb4-8ae7-c50f18ae595c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:35.705514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-feba295b-0e09-40eb-89cb-d93b46a94927 req-f99329b6-feaa-4eb4-8ae7-c50f18ae595c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:35.705938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-feba295b-0e09-40eb-89cb-d93b46a94927 req-f99329b6-feaa-4eb4-8ae7-c50f18ae595c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:35.721820 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-feba295b-0e09-40eb-89cb-d93b46a94927 req-f99329b6-feaa-4eb4-8ae7-c50f18ae595c service nova] Creating event network-changed:877cbc45-f570-4bb6-bcd2-91b67dbccdb3 for instance 1fded3d6-d275-4d50-a366-d19388f8aaec on n-h1-858272-3 Oct 05 02:54:35.729728 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-feba295b-0e09-40eb-89cb-d93b46a94927 req-f99329b6-feaa-4eb4-8ae7-c50f18ae595c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062567 Oct 05 02:54:35.730714 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2621/5221] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:54:35.736999 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ca6c4449-9a5a-4a8d-a2f8-c7f3d27a7386 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:35.743173 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ca6c4449-9a5a-4a8d-a2f8-c7f3d27a7386 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:35.744223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ca6c4449-9a5a-4a8d-a2f8-c7f3d27a7386 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef'} {{(pid=122319) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:54:35.759376 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca6c4449-9a5a-4a8d-a2f8-c7f3d27a7386 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:35.760112 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca6c4449-9a5a-4a8d-a2f8-c7f3d27a7386 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:35.760775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca6c4449-9a5a-4a8d-a2f8-c7f3d27a7386 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:35.762526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca6c4449-9a5a-4a8d-a2f8-c7f3d27a7386 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:35.763902 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca6c4449-9a5a-4a8d-a2f8-c7f3d27a7386 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:35.764559 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ca6c4449-9a5a-4a8d-a2f8-c7f3d27a7386 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:35.879352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.multi_cell_list [None req-ca6c4449-9a5a-4a8d-a2f8-c7f3d27a7386 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122319) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:54:35.953347 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ca6c4449-9a5a-4a8d-a2f8-c7f3d27a7386 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.220730 Oct 05 02:54:35.954166 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2622/5222] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:54:35 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:54:35.968357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c6703f9a-8be5-462f-88ab-648274f466f6 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:35.974421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c6703f9a-8be5-462f-88ab-648274f466f6 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:35.975100 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.compute.servers [None req-c6703f9a-8be5-462f-88ab-648274f466f6 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Removing options 'limit' from query {{(pid=122319) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 05 02:54:35.975982 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c6703f9a-8be5-462f-88ab-648274f466f6 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Searching by: {'deleted': False, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef'} {{(pid=122319) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:54:35.981461 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6703f9a-8be5-462f-88ab-648274f466f6 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:35.982250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6703f9a-8be5-462f-88ab-648274f466f6 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:35.982957 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6703f9a-8be5-462f-88ab-648274f466f6 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:35.983828 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6703f9a-8be5-462f-88ab-648274f466f6 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:35.984424 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6703f9a-8be5-462f-88ab-648274f466f6 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:35.985089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6703f9a-8be5-462f-88ab-648274f466f6 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:36.014241 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c6703f9a-8be5-462f-88ab-648274f466f6 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.050335 Oct 05 02:54:36.023813 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2623/5223] 10.222.0.16 () {58 vars in 1140 bytes} [Wed Oct 5 02:54:35 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:54:36.029459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-19bc2186-3e1d-4980-84cf-f9e88a920408 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:36.035737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-19bc2186-3e1d-4980-84cf-f9e88a920408 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:36.036775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-19bc2186-3e1d-4980-84cf-f9e88a920408 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-996709922', 'deleted': False, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef'} {{(pid=122319) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:54:36.042926 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19bc2186-3e1d-4980-84cf-f9e88a920408 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:36.043673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19bc2186-3e1d-4980-84cf-f9e88a920408 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:36.044289 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19bc2186-3e1d-4980-84cf-f9e88a920408 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:36.045418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19bc2186-3e1d-4980-84cf-f9e88a920408 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:36.046121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19bc2186-3e1d-4980-84cf-f9e88a920408 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:36.046765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-19bc2186-3e1d-4980-84cf-f9e88a920408 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:36.146441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c8df1f11-1286-43d9-ab91-b402343bdd5b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:36.150312 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.multi_cell_list [None req-19bc2186-3e1d-4980-84cf-f9e88a920408 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122319) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:54:36.158143 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c8df1f11-1286-43d9-ab91-b402343bdd5b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378" status: 200 len: 1508 microversion: 2.1 time: 0.577047 Oct 05 02:54:36.159045 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2601/5224] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:35 2022] GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378 => generated 1508 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:36.243165 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-19bc2186-3e1d-4980-84cf-f9e88a920408 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-996709922" status: 200 len: 345 microversion: 2.1 time: 0.217678 Oct 05 02:54:36.252711 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2624/5225] 10.222.0.16 () {58 vars in 1240 bytes} [Wed Oct 5 02:54:36 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-996709922 => generated 345 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:54:36.258319 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e457b779-c548-498d-a948-2a97a0bd01e3 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:54:36.274463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e457b779-c548-498d-a948-2a97a0bd01e3 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:36.278374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e457b779-c548-498d-a948-2a97a0bd01e3 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:36.279071 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e457b779-c548-498d-a948-2a97a0bd01e3 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:36.309259 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e457b779-c548-498d-a948-2a97a0bd01e3 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: d39cd597-890f-4cc8-8d05-9a1b65f9ab32] Going to try to stop instance {{(pid=122320) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 05 02:54:36.398821 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e457b779-c548-498d-a948-2a97a0bd01e3 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "POST /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32/action" status: 202 len: 0 microversion: 2.1 time: 0.142646 Oct 05 02:54:36.401657 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2602/5226] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:54:36 2022] POST /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:54:36.409612 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-633c05b4-dcb4-4f4a-862e-4135602ac97f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:36.410971 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-633c05b4-dcb4-4f4a-862e-4135602ac97f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: d39cd597-890f-4cc8-8d05-9a1b65f9ab32] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:36.420212 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-633c05b4-dcb4-4f4a-862e-4135602ac97f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:36.425717 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-633c05b4-dcb4-4f4a-862e-4135602ac97f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:36.426221 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-633c05b4-dcb4-4f4a-862e-4135602ac97f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:36.427076 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-633c05b4-dcb4-4f4a-862e-4135602ac97f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:36.427537 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-633c05b4-dcb4-4f4a-862e-4135602ac97f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:36.427962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-633c05b4-dcb4-4f4a-862e-4135602ac97f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:36.606325 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-13b88aed-a111-4540-8e05-c39f14bb359a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:36.607338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-13b88aed-a111-4540-8e05-c39f14bb359a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:36.615665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13b88aed-a111-4540-8e05-c39f14bb359a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:36.616309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13b88aed-a111-4540-8e05-c39f14bb359a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:36.616829 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13b88aed-a111-4540-8e05-c39f14bb359a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:36.617779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13b88aed-a111-4540-8e05-c39f14bb359a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:36.618918 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13b88aed-a111-4540-8e05-c39f14bb359a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:36.619986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13b88aed-a111-4540-8e05-c39f14bb359a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:36.901633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-633c05b4-dcb4-4f4a-862e-4135602ac97f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:36.911336 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-633c05b4-dcb4-4f4a-862e-4135602ac97f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32" status: 200 len: 1521 microversion: 2.1 time: 0.504999 Oct 05 02:54:36.912236 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2625/5227] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:36 2022] GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32 => generated 1521 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:36.979381 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-13b88aed-a111-4540-8e05-c39f14bb359a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:36.992275 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-13b88aed-a111-4540-8e05-c39f14bb359a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1517 microversion: 2.1 time: 0.395974 Oct 05 02:54:36.993046 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2603/5228] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:36 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1517 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:54:37.183416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1c1e810d-978d-4daa-96d1-58f8c3d10fcb tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:37.184956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1c1e810d-978d-4daa-96d1-58f8c3d10fcb tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:37.192571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c1e810d-978d-4daa-96d1-58f8c3d10fcb tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:37.193293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c1e810d-978d-4daa-96d1-58f8c3d10fcb tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:37.193922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c1e810d-978d-4daa-96d1-58f8c3d10fcb tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:37.194973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c1e810d-978d-4daa-96d1-58f8c3d10fcb tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:37.196048 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c1e810d-978d-4daa-96d1-58f8c3d10fcb tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:37.196746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c1e810d-978d-4daa-96d1-58f8c3d10fcb tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:37.365343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1c1e810d-978d-4daa-96d1-58f8c3d10fcb tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:37.373954 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1c1e810d-978d-4daa-96d1-58f8c3d10fcb tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378" status: 200 len: 1508 microversion: 2.1 time: 0.194430 Oct 05 02:54:37.374714 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2626/5229] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:37 2022] GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378 => generated 1508 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:37.939549 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-eb07d23c-8524-425d-be6a-f4f6eb54476a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:37.941822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-eb07d23c-8524-425d-be6a-f4f6eb54476a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: d39cd597-890f-4cc8-8d05-9a1b65f9ab32] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:37.952735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb07d23c-8524-425d-be6a-f4f6eb54476a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:37.953659 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb07d23c-8524-425d-be6a-f4f6eb54476a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:37.954296 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb07d23c-8524-425d-be6a-f4f6eb54476a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:37.955190 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb07d23c-8524-425d-be6a-f4f6eb54476a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:37.956191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb07d23c-8524-425d-be6a-f4f6eb54476a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:37.957776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eb07d23c-8524-425d-be6a-f4f6eb54476a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:38.024431 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-45eb0866-e790-40e0-99b7-2fb11e0df912 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:38.025277 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-45eb0866-e790-40e0-99b7-2fb11e0df912 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:38.038698 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45eb0866-e790-40e0-99b7-2fb11e0df912 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:38.043122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45eb0866-e790-40e0-99b7-2fb11e0df912 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:38.046358 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45eb0866-e790-40e0-99b7-2fb11e0df912 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:38.047827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45eb0866-e790-40e0-99b7-2fb11e0df912 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:38.050630 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45eb0866-e790-40e0-99b7-2fb11e0df912 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:38.052313 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45eb0866-e790-40e0-99b7-2fb11e0df912 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:38.126158 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-eb07d23c-8524-425d-be6a-f4f6eb54476a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:38.135574 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-eb07d23c-8524-425d-be6a-f4f6eb54476a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32" status: 200 len: 1521 microversion: 2.1 time: 0.201776 Oct 05 02:54:38.140102 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2604/5230] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:37 2022] GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:38.252631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-45eb0866-e790-40e0-99b7-2fb11e0df912 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:38.263286 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-45eb0866-e790-40e0-99b7-2fb11e0df912 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1517 microversion: 2.1 time: 0.245262 Oct 05 02:54:38.279726 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2627/5231] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:38 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1517 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:38.398039 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c237e742-9e3c-4370-8f91-4d5148405059 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:38.398665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c237e742-9e3c-4370-8f91-4d5148405059 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:38.415725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c237e742-9e3c-4370-8f91-4d5148405059 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:38.416580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c237e742-9e3c-4370-8f91-4d5148405059 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:38.417400 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c237e742-9e3c-4370-8f91-4d5148405059 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:38.418310 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c237e742-9e3c-4370-8f91-4d5148405059 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:38.419922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c237e742-9e3c-4370-8f91-4d5148405059 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:38.420626 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c237e742-9e3c-4370-8f91-4d5148405059 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:38.934419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c237e742-9e3c-4370-8f91-4d5148405059 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:38.943356 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c237e742-9e3c-4370-8f91-4d5148405059 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378" status: 200 len: 1508 microversion: 2.1 time: 0.549105 Oct 05 02:54:38.958045 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2605/5232] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:38 2022] GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378 => generated 1508 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:39.170448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bf143866-00d6-4622-90ad-fb2bbd91cfa1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:39.171268 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bf143866-00d6-4622-90ad-fb2bbd91cfa1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: d39cd597-890f-4cc8-8d05-9a1b65f9ab32] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:39.185174 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf143866-00d6-4622-90ad-fb2bbd91cfa1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:39.185993 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf143866-00d6-4622-90ad-fb2bbd91cfa1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:39.192507 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf143866-00d6-4622-90ad-fb2bbd91cfa1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:39.193612 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf143866-00d6-4622-90ad-fb2bbd91cfa1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:39.194347 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf143866-00d6-4622-90ad-fb2bbd91cfa1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:39.195380 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf143866-00d6-4622-90ad-fb2bbd91cfa1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:39.288923 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3f2b170c-4441-44f7-bde3-fbbb78fe6556 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:39.289738 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3f2b170c-4441-44f7-bde3-fbbb78fe6556 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:39.302796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f2b170c-4441-44f7-bde3-fbbb78fe6556 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:39.304612 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f2b170c-4441-44f7-bde3-fbbb78fe6556 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:39.305342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f2b170c-4441-44f7-bde3-fbbb78fe6556 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:39.308262 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f2b170c-4441-44f7-bde3-fbbb78fe6556 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:39.309080 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f2b170c-4441-44f7-bde3-fbbb78fe6556 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:39.309696 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f2b170c-4441-44f7-bde3-fbbb78fe6556 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:39.727149 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bf143866-00d6-4622-90ad-fb2bbd91cfa1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:39.746398 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bf143866-00d6-4622-90ad-fb2bbd91cfa1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32" status: 200 len: 1521 microversion: 2.1 time: 0.580674 Oct 05 02:54:39.749195 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2628/5233] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:39 2022] GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32 => generated 1521 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:39.845007 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3f2b170c-4441-44f7-bde3-fbbb78fe6556 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:39.859746 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3f2b170c-4441-44f7-bde3-fbbb78fe6556 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1517 microversion: 2.1 time: 0.576367 Oct 05 02:54:39.862423 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2606/5234] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:39 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1517 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:54:39.968757 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7e234eac-191f-4c21-8e91-79e6c854d02b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:39.969806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7e234eac-191f-4c21-8e91-79e6c854d02b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:39.982497 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e234eac-191f-4c21-8e91-79e6c854d02b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:39.983699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e234eac-191f-4c21-8e91-79e6c854d02b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:39.986390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e234eac-191f-4c21-8e91-79e6c854d02b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:39.989244 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e234eac-191f-4c21-8e91-79e6c854d02b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:39.990964 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e234eac-191f-4c21-8e91-79e6c854d02b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:39.991966 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e234eac-191f-4c21-8e91-79e6c854d02b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:40.396453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7e234eac-191f-4c21-8e91-79e6c854d02b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:40.411567 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7e234eac-191f-4c21-8e91-79e6c854d02b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378" status: 200 len: 1514 microversion: 2.1 time: 0.446119 Oct 05 02:54:40.413259 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2629/5235] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:39 2022] GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378 => generated 1514 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:40.772615 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e19a8e0c-c0d7-4416-87d2-8ab473b9b8ea tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:40.773366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e19a8e0c-c0d7-4416-87d2-8ab473b9b8ea tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: d39cd597-890f-4cc8-8d05-9a1b65f9ab32] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:40.792676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e19a8e0c-c0d7-4416-87d2-8ab473b9b8ea tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:40.793481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e19a8e0c-c0d7-4416-87d2-8ab473b9b8ea tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:40.794198 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e19a8e0c-c0d7-4416-87d2-8ab473b9b8ea tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:40.795192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e19a8e0c-c0d7-4416-87d2-8ab473b9b8ea tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:40.795734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e19a8e0c-c0d7-4416-87d2-8ab473b9b8ea tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:40.797128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e19a8e0c-c0d7-4416-87d2-8ab473b9b8ea tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:40.891717 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-02edf214-1650-4efd-a545-e72bcc0a089e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:40.892429 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-02edf214-1650-4efd-a545-e72bcc0a089e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:40.904509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-02edf214-1650-4efd-a545-e72bcc0a089e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:40.905230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-02edf214-1650-4efd-a545-e72bcc0a089e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:40.906916 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-02edf214-1650-4efd-a545-e72bcc0a089e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:40.907749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-02edf214-1650-4efd-a545-e72bcc0a089e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:40.909415 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-02edf214-1650-4efd-a545-e72bcc0a089e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:40.910792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-02edf214-1650-4efd-a545-e72bcc0a089e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:41.508174 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-02edf214-1650-4efd-a545-e72bcc0a089e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:41.512271 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e19a8e0c-c0d7-4416-87d2-8ab473b9b8ea tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:41.521211 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e19a8e0c-c0d7-4416-87d2-8ab473b9b8ea tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32" status: 200 len: 1521 microversion: 2.1 time: 0.753638 Oct 05 02:54:41.521806 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2607/5236] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:40 2022] GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32 => generated 1521 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:54:41.524817 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-02edf214-1650-4efd-a545-e72bcc0a089e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1517 microversion: 2.1 time: 0.637165 Oct 05 02:54:41.527907 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2630/5237] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:40 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1517 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:42.557997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0f2b9718-19f6-4af1-bc74-5315c4949aef tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:42.558719 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-50ecce12-649c-4aeb-be47-64624854b325 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:42.559619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0f2b9718-19f6-4af1-bc74-5315c4949aef tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: d39cd597-890f-4cc8-8d05-9a1b65f9ab32] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:42.560793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-50ecce12-649c-4aeb-be47-64624854b325 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:42.584334 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50ecce12-649c-4aeb-be47-64624854b325 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:42.587225 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50ecce12-649c-4aeb-be47-64624854b325 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:42.591092 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50ecce12-649c-4aeb-be47-64624854b325 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:42.593657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50ecce12-649c-4aeb-be47-64624854b325 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:42.597251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50ecce12-649c-4aeb-be47-64624854b325 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:42.600618 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50ecce12-649c-4aeb-be47-64624854b325 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:42.611137 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f2b9718-19f6-4af1-bc74-5315c4949aef tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:42.618051 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f2b9718-19f6-4af1-bc74-5315c4949aef tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:42.620431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f2b9718-19f6-4af1-bc74-5315c4949aef tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:42.641983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f2b9718-19f6-4af1-bc74-5315c4949aef tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:42.642630 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f2b9718-19f6-4af1-bc74-5315c4949aef tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:42.643084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f2b9718-19f6-4af1-bc74-5315c4949aef tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:43.401734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0f2b9718-19f6-4af1-bc74-5315c4949aef tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:43.459295 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0f2b9718-19f6-4af1-bc74-5315c4949aef tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32" status: 200 len: 1521 microversion: 2.1 time: 0.911298 Oct 05 02:54:43.462458 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-50ecce12-649c-4aeb-be47-64624854b325 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:43.462969 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2608/5238] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:42 2022] GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32 => generated 1521 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:43.471742 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-50ecce12-649c-4aeb-be47-64624854b325 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1517 microversion: 2.1 time: 0.918144 Oct 05 02:54:43.487055 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a808d23a-2b35-4135-b8e3-d4e0dbe831f2 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Action: 'create', calling method: .version_select at 0x7fccdeddfaf0>, body: {"keypair": {"name": "tempest-keypair-548362238", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDdiCOo8M552ay4msQgqb8FnOcBxRh+3PzRzezsFSgqG+la3p9n1Keg1tbq7rZjUvPGovyYah2K40P82Puk640jPnUo8bppZ5XjtcQ1YTBrjU8FtMl5W1QzyBe1/yGIKA=="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:54:43.492241 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2631/5239] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:42 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1517 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:43.544105 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-a808d23a-2b35-4135-b8e3-d4e0dbe831f2 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Getting quotas for project 129b5343573f4f9fa648e984a68b6760. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:54:43.554650 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-a808d23a-2b35-4135-b8e3-d4e0dbe831f2 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Getting quotas for user a031e94db13d4e7e8947f51abc36d629 and project 129b5343573f4f9fa648e984a68b6760. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:54:43.596084 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a808d23a-2b35-4135-b8e3-d4e0dbe831f2 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.131209 Oct 05 02:54:43.602481 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2609/5240] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 02:54:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:54:44.489506 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=4 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:44.495523 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:44.497367 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4951a592-6c9c-427a-9b77-294964a58271 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:44.498227 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4951a592-6c9c-427a-9b77-294964a58271 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: d39cd597-890f-4cc8-8d05-9a1b65f9ab32] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:44.500482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d3a28111-92f4-4c59-87ff-1acb10821bd8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:44.501338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d3a28111-92f4-4c59-87ff-1acb10821bd8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:44.515258 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4951a592-6c9c-427a-9b77-294964a58271 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:44.516433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4951a592-6c9c-427a-9b77-294964a58271 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:44.517321 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3a28111-92f4-4c59-87ff-1acb10821bd8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:44.517744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4951a592-6c9c-427a-9b77-294964a58271 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:44.518170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3a28111-92f4-4c59-87ff-1acb10821bd8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:44.519033 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3a28111-92f4-4c59-87ff-1acb10821bd8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:44.521768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3a28111-92f4-4c59-87ff-1acb10821bd8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:44.521908 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4951a592-6c9c-427a-9b77-294964a58271 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:44.522319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4951a592-6c9c-427a-9b77-294964a58271 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:44.522884 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3a28111-92f4-4c59-87ff-1acb10821bd8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:44.523878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4951a592-6c9c-427a-9b77-294964a58271 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:44.524498 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3a28111-92f4-4c59-87ff-1acb10821bd8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:45.194959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4951a592-6c9c-427a-9b77-294964a58271 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:45.211206 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4951a592-6c9c-427a-9b77-294964a58271 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32" status: 200 len: 1521 microversion: 2.1 time: 0.724231 Oct 05 02:54:45.253986 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2632/5241] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:44 2022] GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32 => generated 1521 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:45.422610 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d3a28111-92f4-4c59-87ff-1acb10821bd8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:45.434216 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d3a28111-92f4-4c59-87ff-1acb10821bd8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1517 microversion: 2.1 time: 0.939801 Oct 05 02:54:45.479489 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2610/5242] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:44 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1517 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:46.251747 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cd2c70f7-693a-4d5d-a21d-6a03fb37c407 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:46.253846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cd2c70f7-693a-4d5d-a21d-6a03fb37c407 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: d39cd597-890f-4cc8-8d05-9a1b65f9ab32] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:46.267079 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=16 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:46.270571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd2c70f7-693a-4d5d-a21d-6a03fb37c407 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:46.272712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd2c70f7-693a-4d5d-a21d-6a03fb37c407 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:46.273364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd2c70f7-693a-4d5d-a21d-6a03fb37c407 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:46.276650 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd2c70f7-693a-4d5d-a21d-6a03fb37c407 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:46.277541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd2c70f7-693a-4d5d-a21d-6a03fb37c407 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:46.280696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd2c70f7-693a-4d5d-a21d-6a03fb37c407 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:46.492430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d485caf1-8970-49bb-8d9a-1779523c5d6a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:46.493108 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d485caf1-8970-49bb-8d9a-1779523c5d6a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:46.501537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d485caf1-8970-49bb-8d9a-1779523c5d6a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:46.502524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d485caf1-8970-49bb-8d9a-1779523c5d6a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:46.503107 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d485caf1-8970-49bb-8d9a-1779523c5d6a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:46.504684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d485caf1-8970-49bb-8d9a-1779523c5d6a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:46.505576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d485caf1-8970-49bb-8d9a-1779523c5d6a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:46.506149 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d485caf1-8970-49bb-8d9a-1779523c5d6a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:47.267373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cd2c70f7-693a-4d5d-a21d-6a03fb37c407 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:47.279395 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cd2c70f7-693a-4d5d-a21d-6a03fb37c407 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32" status: 200 len: 1521 microversion: 2.1 time: 1.041725 Oct 05 02:54:47.280068 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2633/5243] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:46 2022] GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32 => generated 1521 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:47.288382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d485caf1-8970-49bb-8d9a-1779523c5d6a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:47.296941 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d485caf1-8970-49bb-8d9a-1779523c5d6a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1517 microversion: 2.1 time: 0.810153 Oct 05 02:54:47.297841 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2611/5244] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:46 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1517 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:48.198276 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a4bc99bd-9178-405f-80a2-4c4d3ef5910f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-993166664", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d1200f4f-a8c3-4656-8e56-90989f3cb8b8"}], "security_groups": [{"name": "tempest-securitygroup--2002053395"}], "key_name": "tempest-keypair-548362238", "user_data": "}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:54:48.313314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-251d8a67-e459-4aa4-aaf6-dd299bdc6195 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:48.313899 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-251d8a67-e459-4aa4-aaf6-dd299bdc6195 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: d39cd597-890f-4cc8-8d05-9a1b65f9ab32] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:48.323510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-251d8a67-e459-4aa4-aaf6-dd299bdc6195 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:48.324001 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-251d8a67-e459-4aa4-aaf6-dd299bdc6195 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:48.327067 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-251d8a67-e459-4aa4-aaf6-dd299bdc6195 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:48.330238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-251d8a67-e459-4aa4-aaf6-dd299bdc6195 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:48.333269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-251d8a67-e459-4aa4-aaf6-dd299bdc6195 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:48.334137 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-251d8a67-e459-4aa4-aaf6-dd299bdc6195 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:48.450745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-a4bc99bd-9178-405f-80a2-4c4d3ef5910f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] validate_networks() for [('d1200f4f-a8c3-4656-8e56-90989f3cb8b8', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:54:48.852096 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-251d8a67-e459-4aa4-aaf6-dd299bdc6195 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:48.862964 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-251d8a67-e459-4aa4-aaf6-dd299bdc6195 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32" status: 200 len: 1521 microversion: 2.1 time: 0.553537 Oct 05 02:54:48.864153 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2612/5245] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:48 2022] GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32 => generated 1521 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:48.871443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cf66ef9b-a446-4ced-b63e-67193591c57b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:48.872482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cf66ef9b-a446-4ced-b63e-67193591c57b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:48.882152 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf66ef9b-a446-4ced-b63e-67193591c57b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:48.882878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf66ef9b-a446-4ced-b63e-67193591c57b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:48.883506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf66ef9b-a446-4ced-b63e-67193591c57b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:48.884475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf66ef9b-a446-4ced-b63e-67193591c57b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:48.885192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf66ef9b-a446-4ced-b63e-67193591c57b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:48.885822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf66ef9b-a446-4ced-b63e-67193591c57b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:49.293962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cf66ef9b-a446-4ced-b63e-67193591c57b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:49.322153 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cf66ef9b-a446-4ced-b63e-67193591c57b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1517 microversion: 2.1 time: 0.456135 Oct 05 02:54:49.326768 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2613/5246] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:48 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1517 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:49.424012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-a4bc99bd-9178-405f-80a2-4c4d3ef5910f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:54:49.424444 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-a4bc99bd-9178-405f-80a2-4c4d3ef5910f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:54:49.425000 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-a4bc99bd-9178-405f-80a2-4c4d3ef5910f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:54:49.425452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-a4bc99bd-9178-405f-80a2-4c4d3ef5910f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:54:49.425865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-a4bc99bd-9178-405f-80a2-4c4d3ef5910f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:54:49.450558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a4bc99bd-9178-405f-80a2-4c4d3ef5910f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:49.451131 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a4bc99bd-9178-405f-80a2-4c4d3ef5910f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:49.451856 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a4bc99bd-9178-405f-80a2-4c4d3ef5910f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:49.454282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a4bc99bd-9178-405f-80a2-4c4d3ef5910f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:49.454761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a4bc99bd-9178-405f-80a2-4c4d3ef5910f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:49.455240 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a4bc99bd-9178-405f-80a2-4c4d3ef5910f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:49.490824 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:49.518167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-a4bc99bd-9178-405f-80a2-4c4d3ef5910f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Getting quotas for project 129b5343573f4f9fa648e984a68b6760. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:54:49.536528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-a4bc99bd-9178-405f-80a2-4c4d3ef5910f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Getting quotas for user a031e94db13d4e7e8947f51abc36d629 and project 129b5343573f4f9fa648e984a68b6760. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:54:49.572977 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a4bc99bd-9178-405f-80a2-4c4d3ef5910f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:54:49.578509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a4bc99bd-9178-405f-80a2-4c4d3ef5910f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:54:49.665570 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a4bc99bd-9178-405f-80a2-4c4d3ef5910f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.471787 Oct 05 02:54:49.666974 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2634/5247] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:54:48 2022] POST /compute/v2.1/servers => generated 409 bytes in 1474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:54:49.678565 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-56f4032a-7eb6-4da3-bfaf-116ed4987758 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:49.679183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-56f4032a-7eb6-4da3-bfaf-116ed4987758 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:49.789723 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-56f4032a-7eb6-4da3-bfaf-116ed4987758 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:49.802831 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-56f4032a-7eb6-4da3-bfaf-116ed4987758 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1244 microversion: 2.1 time: 0.128788 Oct 05 02:54:49.803461 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2614/5248] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:49 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1244 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:49.890950 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-91d453fd-3168-4c00-a0b3-7a7aae5e5c1d tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:49.891890 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-91d453fd-3168-4c00-a0b3-7a7aae5e5c1d tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: d39cd597-890f-4cc8-8d05-9a1b65f9ab32] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:49.901172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91d453fd-3168-4c00-a0b3-7a7aae5e5c1d tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:49.901703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91d453fd-3168-4c00-a0b3-7a7aae5e5c1d tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:49.902121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91d453fd-3168-4c00-a0b3-7a7aae5e5c1d tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:49.902904 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91d453fd-3168-4c00-a0b3-7a7aae5e5c1d tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:49.903318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91d453fd-3168-4c00-a0b3-7a7aae5e5c1d tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:49.903696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91d453fd-3168-4c00-a0b3-7a7aae5e5c1d tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:50.101364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-91d453fd-3168-4c00-a0b3-7a7aae5e5c1d tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:50.117756 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-91d453fd-3168-4c00-a0b3-7a7aae5e5c1d tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32" status: 200 len: 1521 microversion: 2.1 time: 0.231423 Oct 05 02:54:50.118848 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2635/5249] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:49 2022] GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:50.358893 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e1ad607b-eb17-44bb-8c46-a3a2a9c7455c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:50.362176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e1ad607b-eb17-44bb-8c46-a3a2a9c7455c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:50.374229 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1ad607b-eb17-44bb-8c46-a3a2a9c7455c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:50.375342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1ad607b-eb17-44bb-8c46-a3a2a9c7455c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:50.376283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1ad607b-eb17-44bb-8c46-a3a2a9c7455c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:50.378219 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1ad607b-eb17-44bb-8c46-a3a2a9c7455c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:50.380230 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1ad607b-eb17-44bb-8c46-a3a2a9c7455c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:50.381946 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1ad607b-eb17-44bb-8c46-a3a2a9c7455c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:50.572827 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e1ad607b-eb17-44bb-8c46-a3a2a9c7455c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:50.581040 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e1ad607b-eb17-44bb-8c46-a3a2a9c7455c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1517 microversion: 2.1 time: 0.229759 Oct 05 02:54:50.585109 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2615/5250] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:50 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1517 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:50.827153 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cdb832bf-1a56-4354-857e-29528fb082d9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:50.827870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cdb832bf-1a56-4354-857e-29528fb082d9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:50.835614 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdb832bf-1a56-4354-857e-29528fb082d9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:50.836183 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdb832bf-1a56-4354-857e-29528fb082d9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:50.836698 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdb832bf-1a56-4354-857e-29528fb082d9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:50.837484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdb832bf-1a56-4354-857e-29528fb082d9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:50.838028 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdb832bf-1a56-4354-857e-29528fb082d9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:50.838532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdb832bf-1a56-4354-857e-29528fb082d9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:50.904680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cdb832bf-1a56-4354-857e-29528fb082d9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:50.921808 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cdb832bf-1a56-4354-857e-29528fb082d9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1296 microversion: 2.1 time: 0.091446 Oct 05 02:54:50.921808 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2636/5251] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:50 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1296 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:51.143471 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e776241a-9fc1-4fb3-b120-711c9b48387f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:51.144854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e776241a-9fc1-4fb3-b120-711c9b48387f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: d39cd597-890f-4cc8-8d05-9a1b65f9ab32] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:51.152954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e776241a-9fc1-4fb3-b120-711c9b48387f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:51.153774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e776241a-9fc1-4fb3-b120-711c9b48387f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:51.154344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e776241a-9fc1-4fb3-b120-711c9b48387f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:51.155261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e776241a-9fc1-4fb3-b120-711c9b48387f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:51.155922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e776241a-9fc1-4fb3-b120-711c9b48387f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:51.156547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e776241a-9fc1-4fb3-b120-711c9b48387f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:51.400973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e776241a-9fc1-4fb3-b120-711c9b48387f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:51.411747 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e776241a-9fc1-4fb3-b120-711c9b48387f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32" status: 200 len: 1521 microversion: 2.1 time: 0.272430 Oct 05 02:54:51.412841 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2616/5252] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:51 2022] GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:51.605938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b4b5e0fc-5f29-4882-a485-cec2817350f6 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:51.606551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b4b5e0fc-5f29-4882-a485-cec2817350f6 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:51.614814 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4b5e0fc-5f29-4882-a485-cec2817350f6 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:51.615309 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4b5e0fc-5f29-4882-a485-cec2817350f6 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:51.615751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4b5e0fc-5f29-4882-a485-cec2817350f6 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:51.616443 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4b5e0fc-5f29-4882-a485-cec2817350f6 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:51.617081 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4b5e0fc-5f29-4882-a485-cec2817350f6 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:51.617810 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4b5e0fc-5f29-4882-a485-cec2817350f6 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:51.640754 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:51.917543 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b4b5e0fc-5f29-4882-a485-cec2817350f6 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:51.926743 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b4b5e0fc-5f29-4882-a485-cec2817350f6 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1517 microversion: 2.1 time: 0.325172 Oct 05 02:54:51.927997 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2637/5253] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:51 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1517 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:51.946915 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0613853c-d1ca-445c-b90a-e05405dcbf37 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:51.947994 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0613853c-d1ca-445c-b90a-e05405dcbf37 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:51.954846 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0613853c-d1ca-445c-b90a-e05405dcbf37 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:51.955482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0613853c-d1ca-445c-b90a-e05405dcbf37 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:51.956768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0613853c-d1ca-445c-b90a-e05405dcbf37 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:51.957876 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0613853c-d1ca-445c-b90a-e05405dcbf37 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:51.958350 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0613853c-d1ca-445c-b90a-e05405dcbf37 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:51.958819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0613853c-d1ca-445c-b90a-e05405dcbf37 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:51.963266 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:52.031104 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0613853c-d1ca-445c-b90a-e05405dcbf37 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:52.044014 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0613853c-d1ca-445c-b90a-e05405dcbf37 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1302 microversion: 2.1 time: 0.109581 Oct 05 02:54:52.046315 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2617/5254] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:51 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1302 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:52.440312 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4342e2c4-bd34-44ff-97a5-79f56549c822 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:52.441568 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4342e2c4-bd34-44ff-97a5-79f56549c822 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: d39cd597-890f-4cc8-8d05-9a1b65f9ab32] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:52.452019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4342e2c4-bd34-44ff-97a5-79f56549c822 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:52.456109 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4342e2c4-bd34-44ff-97a5-79f56549c822 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:52.457466 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4342e2c4-bd34-44ff-97a5-79f56549c822 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:52.465916 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4342e2c4-bd34-44ff-97a5-79f56549c822 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:52.466416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4342e2c4-bd34-44ff-97a5-79f56549c822 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:52.466859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4342e2c4-bd34-44ff-97a5-79f56549c822 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:52.854777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4342e2c4-bd34-44ff-97a5-79f56549c822 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:52.878202 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4342e2c4-bd34-44ff-97a5-79f56549c822 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32" status: 200 len: 1521 microversion: 2.1 time: 0.437599 Oct 05 02:54:52.879654 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2638/5255] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:52 2022] GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32 => generated 1521 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:52.952929 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0c11b4dc-1a93-4d03-b5e8-685a9d58ba91 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:52.954621 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0c11b4dc-1a93-4d03-b5e8-685a9d58ba91 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:52.970843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c11b4dc-1a93-4d03-b5e8-685a9d58ba91 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:52.971587 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c11b4dc-1a93-4d03-b5e8-685a9d58ba91 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:52.977722 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c11b4dc-1a93-4d03-b5e8-685a9d58ba91 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:52.978891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c11b4dc-1a93-4d03-b5e8-685a9d58ba91 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:52.979513 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c11b4dc-1a93-4d03-b5e8-685a9d58ba91 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:52.980099 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c11b4dc-1a93-4d03-b5e8-685a9d58ba91 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:53.073726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-77da4072-1eec-4ee9-99f7-099fc926c257 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:53.074971 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-77da4072-1eec-4ee9-99f7-099fc926c257 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:53.083376 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-77da4072-1eec-4ee9-99f7-099fc926c257 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:53.084233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-77da4072-1eec-4ee9-99f7-099fc926c257 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:53.084823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-77da4072-1eec-4ee9-99f7-099fc926c257 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:53.086625 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-77da4072-1eec-4ee9-99f7-099fc926c257 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:53.087234 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-77da4072-1eec-4ee9-99f7-099fc926c257 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:53.088819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-77da4072-1eec-4ee9-99f7-099fc926c257 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:53.393135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0c11b4dc-1a93-4d03-b5e8-685a9d58ba91 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:53.403202 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0c11b4dc-1a93-4d03-b5e8-685a9d58ba91 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1517 microversion: 2.1 time: 0.454218 Oct 05 02:54:53.403501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-77da4072-1eec-4ee9-99f7-099fc926c257 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:53.403954 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2618/5256] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:52 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1517 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:53.411764 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-77da4072-1eec-4ee9-99f7-099fc926c257 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1370 microversion: 2.1 time: 0.347081 Oct 05 02:54:53.412345 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2639/5257] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:53 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1370 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:53.548919 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-3fa449db-f645-495f-9d66-702ac01856eb req-eda3f777-c154-4808-87a5-7c50d9c49b1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c09b57e-7650-448b-ba76-402bdb4f9552", "tag": "97e75ce5-35d6-42fc-9ea6-ed6afc7040fa"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:54:53.561637 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3fa449db-f645-495f-9d66-702ac01856eb req-eda3f777-c154-4808-87a5-7c50d9c49b1b service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:53.562498 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3fa449db-f645-495f-9d66-702ac01856eb req-eda3f777-c154-4808-87a5-7c50d9c49b1b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:53.563467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3fa449db-f645-495f-9d66-702ac01856eb req-eda3f777-c154-4808-87a5-7c50d9c49b1b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:53.580733 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-3fa449db-f645-495f-9d66-702ac01856eb req-eda3f777-c154-4808-87a5-7c50d9c49b1b service nova] Creating event network-changed:97e75ce5-35d6-42fc-9ea6-ed6afc7040fa for instance 7c09b57e-7650-448b-ba76-402bdb4f9552 on n-h2-858272-3 Oct 05 02:54:53.589640 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-3fa449db-f645-495f-9d66-702ac01856eb req-eda3f777-c154-4808-87a5-7c50d9c49b1b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045159 Oct 05 02:54:53.592392 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2619/5258] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:54:53.904884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9d812153-40ea-441b-ad04-4be84e34465c tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:53.905842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9d812153-40ea-441b-ad04-4be84e34465c tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: d39cd597-890f-4cc8-8d05-9a1b65f9ab32] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:53.913907 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d812153-40ea-441b-ad04-4be84e34465c tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:53.914770 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d812153-40ea-441b-ad04-4be84e34465c tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:53.915454 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d812153-40ea-441b-ad04-4be84e34465c tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:53.916395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d812153-40ea-441b-ad04-4be84e34465c tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:53.917010 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d812153-40ea-441b-ad04-4be84e34465c tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:53.917652 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d812153-40ea-441b-ad04-4be84e34465c tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:54.150388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9d812153-40ea-441b-ad04-4be84e34465c tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:54.163832 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9d812153-40ea-441b-ad04-4be84e34465c tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32" status: 200 len: 1521 microversion: 2.1 time: 0.262550 Oct 05 02:54:54.169232 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2640/5259] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:53 2022] GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:54.430279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ef9aed23-2184-4b73-997a-e445f08eaa29 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:54.432252 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ef9aed23-2184-4b73-997a-e445f08eaa29 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:54.436555 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e063b0a3-a220-4ff3-ad6e-a00b53b77de8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:54.437809 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e063b0a3-a220-4ff3-ad6e-a00b53b77de8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:54.440505 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ef9aed23-2184-4b73-997a-e445f08eaa29 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:54.441944 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ef9aed23-2184-4b73-997a-e445f08eaa29 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:54.442496 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ef9aed23-2184-4b73-997a-e445f08eaa29 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:54.443471 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ef9aed23-2184-4b73-997a-e445f08eaa29 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:54.444317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ef9aed23-2184-4b73-997a-e445f08eaa29 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:54.447232 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e063b0a3-a220-4ff3-ad6e-a00b53b77de8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:54.448028 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e063b0a3-a220-4ff3-ad6e-a00b53b77de8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:54.448617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ef9aed23-2184-4b73-997a-e445f08eaa29 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:54.448817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e063b0a3-a220-4ff3-ad6e-a00b53b77de8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:54.449453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e063b0a3-a220-4ff3-ad6e-a00b53b77de8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:54.449915 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e063b0a3-a220-4ff3-ad6e-a00b53b77de8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:54.450346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e063b0a3-a220-4ff3-ad6e-a00b53b77de8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:54.688232 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e063b0a3-a220-4ff3-ad6e-a00b53b77de8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:54.696673 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ef9aed23-2184-4b73-997a-e445f08eaa29 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:54.706475 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ef9aed23-2184-4b73-997a-e445f08eaa29 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1517 microversion: 2.1 time: 0.282719 Oct 05 02:54:54.708364 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2620/5260] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:54 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1517 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:54.712562 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e063b0a3-a220-4ff3-ad6e-a00b53b77de8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1370 microversion: 2.1 time: 0.277799 Oct 05 02:54:54.714234 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2641/5261] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:54 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1370 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:55.189002 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f1f5d23d-b04f-437e-8ba7-c4adabca12f2 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:55.189786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f1f5d23d-b04f-437e-8ba7-c4adabca12f2 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: d39cd597-890f-4cc8-8d05-9a1b65f9ab32] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:55.196505 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f1f5d23d-b04f-437e-8ba7-c4adabca12f2 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:55.197096 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f1f5d23d-b04f-437e-8ba7-c4adabca12f2 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:55.197633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f1f5d23d-b04f-437e-8ba7-c4adabca12f2 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:55.198531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f1f5d23d-b04f-437e-8ba7-c4adabca12f2 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:55.199055 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f1f5d23d-b04f-437e-8ba7-c4adabca12f2 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:55.199602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f1f5d23d-b04f-437e-8ba7-c4adabca12f2 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:55.363486 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f1f5d23d-b04f-437e-8ba7-c4adabca12f2 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:55.371439 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f1f5d23d-b04f-437e-8ba7-c4adabca12f2 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32" status: 200 len: 1521 microversion: 2.1 time: 0.186617 Oct 05 02:54:55.372008 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2621/5262] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:55 2022] GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:55.731634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3a898447-745b-427e-986f-2716fb28b0af tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:55.733173 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3a898447-745b-427e-986f-2716fb28b0af tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:55.735705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f4c28358-2af3-44e1-ae81-f991ec8ac561 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:55.736337 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f4c28358-2af3-44e1-ae81-f991ec8ac561 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:55.742687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a898447-745b-427e-986f-2716fb28b0af tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:55.743462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a898447-745b-427e-986f-2716fb28b0af tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:55.744100 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a898447-745b-427e-986f-2716fb28b0af tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:55.744748 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4c28358-2af3-44e1-ae81-f991ec8ac561 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:55.745356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4c28358-2af3-44e1-ae81-f991ec8ac561 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:55.745599 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a898447-745b-427e-986f-2716fb28b0af tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:55.745796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4c28358-2af3-44e1-ae81-f991ec8ac561 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:55.746488 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a898447-745b-427e-986f-2716fb28b0af tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:55.746592 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4c28358-2af3-44e1-ae81-f991ec8ac561 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:55.747100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4c28358-2af3-44e1-ae81-f991ec8ac561 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:55.747413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a898447-745b-427e-986f-2716fb28b0af tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:55.747664 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4c28358-2af3-44e1-ae81-f991ec8ac561 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:56.000815 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f4c28358-2af3-44e1-ae81-f991ec8ac561 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:56.010173 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f4c28358-2af3-44e1-ae81-f991ec8ac561 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1370 microversion: 2.1 time: 0.278525 Oct 05 02:54:56.010963 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2622/5263] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:55 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1370 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:54:56.029222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3a898447-745b-427e-986f-2716fb28b0af tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:56.038374 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3a898447-745b-427e-986f-2716fb28b0af tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1517 microversion: 2.1 time: 0.311097 Oct 05 02:54:56.039226 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2642/5264] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:55 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1517 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:56.396412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-30673d0d-cf5f-49cf-adfb-f3068549b3fe tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:56.397060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-30673d0d-cf5f-49cf-adfb-f3068549b3fe tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: d39cd597-890f-4cc8-8d05-9a1b65f9ab32] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:56.403373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30673d0d-cf5f-49cf-adfb-f3068549b3fe tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:56.403859 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30673d0d-cf5f-49cf-adfb-f3068549b3fe tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:56.404339 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30673d0d-cf5f-49cf-adfb-f3068549b3fe tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:56.405058 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30673d0d-cf5f-49cf-adfb-f3068549b3fe tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:56.405511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30673d0d-cf5f-49cf-adfb-f3068549b3fe tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:56.405929 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30673d0d-cf5f-49cf-adfb-f3068549b3fe tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:56.679936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-30673d0d-cf5f-49cf-adfb-f3068549b3fe tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:56.690201 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-30673d0d-cf5f-49cf-adfb-f3068549b3fe tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32" status: 200 len: 1521 microversion: 2.1 time: 0.298340 Oct 05 02:54:56.691816 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2623/5265] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:56 2022] GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32 => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:57.033560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0dcd8629-4008-4dfd-9eb1-45f107804186 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:57.036403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0dcd8629-4008-4dfd-9eb1-45f107804186 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:57.046930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0dcd8629-4008-4dfd-9eb1-45f107804186 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:57.047750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0dcd8629-4008-4dfd-9eb1-45f107804186 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:57.048372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0dcd8629-4008-4dfd-9eb1-45f107804186 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:57.049340 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0dcd8629-4008-4dfd-9eb1-45f107804186 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:57.050208 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0dcd8629-4008-4dfd-9eb1-45f107804186 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:57.050808 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0dcd8629-4008-4dfd-9eb1-45f107804186 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:57.063832 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-39e36e14-62c4-45b5-bbb3-d66e02204091 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:57.065161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-39e36e14-62c4-45b5-bbb3-d66e02204091 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:57.073599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-39e36e14-62c4-45b5-bbb3-d66e02204091 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:57.074434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-39e36e14-62c4-45b5-bbb3-d66e02204091 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:57.075143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-39e36e14-62c4-45b5-bbb3-d66e02204091 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:57.076056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-39e36e14-62c4-45b5-bbb3-d66e02204091 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:57.076731 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-39e36e14-62c4-45b5-bbb3-d66e02204091 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:57.082313 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-39e36e14-62c4-45b5-bbb3-d66e02204091 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:57.749089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0dcd8629-4008-4dfd-9eb1-45f107804186 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:57.752704 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-39e36e14-62c4-45b5-bbb3-d66e02204091 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:57.759791 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0dcd8629-4008-4dfd-9eb1-45f107804186 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1370 microversion: 2.1 time: 0.730788 Oct 05 02:54:57.760379 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2643/5266] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:57 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1370 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:57.762338 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-39e36e14-62c4-45b5-bbb3-d66e02204091 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1517 microversion: 2.1 time: 0.702316 Oct 05 02:54:57.778631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4857e057-3b3b-41f2-a1e0-f5b2cfac4bad tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:57.779245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4857e057-3b3b-41f2-a1e0-f5b2cfac4bad tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: d39cd597-890f-4cc8-8d05-9a1b65f9ab32] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:57.781445 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2624/5267] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:57 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1517 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:57.791168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4857e057-3b3b-41f2-a1e0-f5b2cfac4bad tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:57.791851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4857e057-3b3b-41f2-a1e0-f5b2cfac4bad tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:57.792653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4857e057-3b3b-41f2-a1e0-f5b2cfac4bad tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:57.793712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4857e057-3b3b-41f2-a1e0-f5b2cfac4bad tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:57.794704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4857e057-3b3b-41f2-a1e0-f5b2cfac4bad tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:57.796263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4857e057-3b3b-41f2-a1e0-f5b2cfac4bad tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:58.015390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4857e057-3b3b-41f2-a1e0-f5b2cfac4bad tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:58.023742 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4857e057-3b3b-41f2-a1e0-f5b2cfac4bad tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32" status: 200 len: 1498 microversion: 2.1 time: 0.257693 Oct 05 02:54:58.024306 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2644/5268] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:57 2022] GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32 => generated 1498 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:58.048762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-28769e2a-eebb-42c8-9916-2a19b9286de7 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:58.055920 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-28769e2a-eebb-42c8-9916-2a19b9286de7 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:58.057053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-28769e2a-eebb-42c8-9916-2a19b9286de7 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef'} {{(pid=122320) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:54:58.064191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28769e2a-eebb-42c8-9916-2a19b9286de7 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:58.064657 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28769e2a-eebb-42c8-9916-2a19b9286de7 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:58.066568 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28769e2a-eebb-42c8-9916-2a19b9286de7 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:58.067540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28769e2a-eebb-42c8-9916-2a19b9286de7 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:58.068234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28769e2a-eebb-42c8-9916-2a19b9286de7 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:58.068717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28769e2a-eebb-42c8-9916-2a19b9286de7 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:58.097415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.multi_cell_list [None req-28769e2a-eebb-42c8-9916-2a19b9286de7 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:54:58.165403 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-28769e2a-eebb-42c8-9916-2a19b9286de7 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.117986 Oct 05 02:54:58.173516 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2625/5269] 10.222.0.16 () {58 vars in 1154 bytes} [Wed Oct 5 02:54:58 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:54:58.180328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8159640f-358f-4abd-b490-c568b79965e0 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:54:58.189924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8159640f-358f-4abd-b490-c568b79965e0 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:58.192606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8159640f-358f-4abd-b490-c568b79965e0 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:58.193185 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8159640f-358f-4abd-b490-c568b79965e0 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:58.237325 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8159640f-358f-4abd-b490-c568b79965e0 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: d39cd597-890f-4cc8-8d05-9a1b65f9ab32] Going to try to start instance {{(pid=122319) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 05 02:54:58.306043 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8159640f-358f-4abd-b490-c568b79965e0 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "POST /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32/action" status: 202 len: 0 microversion: 2.1 time: 0.128252 Oct 05 02:54:58.315364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4ceaa71d-1fa9-416a-afa0-2c6830982df1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:58.316728 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4ceaa71d-1fa9-416a-afa0-2c6830982df1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: d39cd597-890f-4cc8-8d05-9a1b65f9ab32] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:58.322644 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2645/5270] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:54:58 2022] POST /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:54:58.327071 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ceaa71d-1fa9-416a-afa0-2c6830982df1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:58.327906 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ceaa71d-1fa9-416a-afa0-2c6830982df1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:58.328530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ceaa71d-1fa9-416a-afa0-2c6830982df1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:58.329346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ceaa71d-1fa9-416a-afa0-2c6830982df1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:58.329855 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ceaa71d-1fa9-416a-afa0-2c6830982df1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:58.330343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ceaa71d-1fa9-416a-afa0-2c6830982df1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:58.628203 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4ceaa71d-1fa9-416a-afa0-2c6830982df1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:58.641154 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4ceaa71d-1fa9-416a-afa0-2c6830982df1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32" status: 200 len: 1507 microversion: 2.1 time: 0.329876 Oct 05 02:54:58.645116 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2626/5271] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:58 2022] GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32 => generated 1507 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:58.788519 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5c936b72-43c2-4025-b108-c716f6e12e99 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:58.789287 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5c936b72-43c2-4025-b108-c716f6e12e99 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:58.796275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c936b72-43c2-4025-b108-c716f6e12e99 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:58.796762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c936b72-43c2-4025-b108-c716f6e12e99 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:58.797233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c936b72-43c2-4025-b108-c716f6e12e99 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:58.797939 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c936b72-43c2-4025-b108-c716f6e12e99 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:58.798390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c936b72-43c2-4025-b108-c716f6e12e99 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:58.798811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c936b72-43c2-4025-b108-c716f6e12e99 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:58.810514 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9507bdcd-40d8-43f2-acfc-0acf3c160ab7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:58.810743 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9507bdcd-40d8-43f2-acfc-0acf3c160ab7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:58.823978 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9507bdcd-40d8-43f2-acfc-0acf3c160ab7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:58.824488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9507bdcd-40d8-43f2-acfc-0acf3c160ab7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:58.832409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9507bdcd-40d8-43f2-acfc-0acf3c160ab7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:58.833251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9507bdcd-40d8-43f2-acfc-0acf3c160ab7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:58.833738 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9507bdcd-40d8-43f2-acfc-0acf3c160ab7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:58.834186 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9507bdcd-40d8-43f2-acfc-0acf3c160ab7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:59.360043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9507bdcd-40d8-43f2-acfc-0acf3c160ab7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:59.372889 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9507bdcd-40d8-43f2-acfc-0acf3c160ab7 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1370 microversion: 2.1 time: 0.566607 Oct 05 02:54:59.373573 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2627/5272] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:58 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1370 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:54:59.426000 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5c936b72-43c2-4025-b108-c716f6e12e99 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:59.438901 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5c936b72-43c2-4025-b108-c716f6e12e99 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1517 microversion: 2.1 time: 0.656093 Oct 05 02:54:59.447377 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2646/5273] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:58 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1517 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:54:59.674312 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-be23013a-a3c1-4d48-a93c-e3e9c46bab16 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:54:59.675187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-be23013a-a3c1-4d48-a93c-e3e9c46bab16 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: d39cd597-890f-4cc8-8d05-9a1b65f9ab32] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:54:59.689334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be23013a-a3c1-4d48-a93c-e3e9c46bab16 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:59.693675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be23013a-a3c1-4d48-a93c-e3e9c46bab16 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:59.694343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be23013a-a3c1-4d48-a93c-e3e9c46bab16 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:59.698663 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be23013a-a3c1-4d48-a93c-e3e9c46bab16 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:54:59.699164 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be23013a-a3c1-4d48-a93c-e3e9c46bab16 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:54:59.699695 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be23013a-a3c1-4d48-a93c-e3e9c46bab16 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:54:59.795007 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=10 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:59.915295 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-be23013a-a3c1-4d48-a93c-e3e9c46bab16 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:54:59.924916 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-be23013a-a3c1-4d48-a93c-e3e9c46bab16 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32" status: 200 len: 1507 microversion: 2.1 time: 0.257590 Oct 05 02:54:59.926005 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2628/5274] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:54:59 2022] GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32 => generated 1507 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:00.418410 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c9e5d420-d34c-481c-92f0-977412652202 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:00.421982 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c9e5d420-d34c-481c-92f0-977412652202 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:00.429782 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:00.430800 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:00.435633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9e5d420-d34c-481c-92f0-977412652202 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:00.436337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9e5d420-d34c-481c-92f0-977412652202 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:00.437899 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9e5d420-d34c-481c-92f0-977412652202 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:00.439678 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9e5d420-d34c-481c-92f0-977412652202 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:00.441098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9e5d420-d34c-481c-92f0-977412652202 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:00.442589 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9e5d420-d34c-481c-92f0-977412652202 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:00.479675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6239a287-4ef9-4dfd-8547-a5fa7c5ee9dd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:00.480568 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6239a287-4ef9-4dfd-8547-a5fa7c5ee9dd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:00.498080 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6239a287-4ef9-4dfd-8547-a5fa7c5ee9dd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:00.498276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6239a287-4ef9-4dfd-8547-a5fa7c5ee9dd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:00.501398 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6239a287-4ef9-4dfd-8547-a5fa7c5ee9dd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:00.506568 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6239a287-4ef9-4dfd-8547-a5fa7c5ee9dd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:00.507525 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6239a287-4ef9-4dfd-8547-a5fa7c5ee9dd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:00.508118 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6239a287-4ef9-4dfd-8547-a5fa7c5ee9dd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:00.730574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c9e5d420-d34c-481c-92f0-977412652202 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:00.761366 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c9e5d420-d34c-481c-92f0-977412652202 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1370 microversion: 2.1 time: 0.348097 Oct 05 02:55:00.778803 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2647/5275] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:00 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1370 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:00.788439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-ee349165-2d93-4315-8742-68e54e4ba985 req-7538db6b-cccf-42ad-ac9c-856c398517f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fded3d6-d275-4d50-a366-d19388f8aaec", "name": "network-vif-plugged", "status": "completed", "tag": "877cbc45-f570-4bb6-bcd2-91b67dbccdb3"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:55:00.814407 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ee349165-2d93-4315-8742-68e54e4ba985 req-7538db6b-cccf-42ad-ac9c-856c398517f7 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:00.815803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ee349165-2d93-4315-8742-68e54e4ba985 req-7538db6b-cccf-42ad-ac9c-856c398517f7 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:00.816862 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ee349165-2d93-4315-8742-68e54e4ba985 req-7538db6b-cccf-42ad-ac9c-856c398517f7 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:00.834186 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-ee349165-2d93-4315-8742-68e54e4ba985 req-7538db6b-cccf-42ad-ac9c-856c398517f7 service nova] Creating event network-vif-plugged:877cbc45-f570-4bb6-bcd2-91b67dbccdb3 for instance 1fded3d6-d275-4d50-a366-d19388f8aaec on n-h1-858272-3 Oct 05 02:55:00.842216 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-ee349165-2d93-4315-8742-68e54e4ba985 req-7538db6b-cccf-42ad-ac9c-856c398517f7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061138 Oct 05 02:55:00.843159 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2648/5276] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:55:00.871204 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6239a287-4ef9-4dfd-8547-a5fa7c5ee9dd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:00.883737 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6239a287-4ef9-4dfd-8547-a5fa7c5ee9dd tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1517 microversion: 2.1 time: 0.423755 Oct 05 02:55:00.897593 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2629/5277] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:00 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1517 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:00.953608 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fd2ede05-6515-491e-aeb7-4286506674fb tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:00.954801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fd2ede05-6515-491e-aeb7-4286506674fb tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: d39cd597-890f-4cc8-8d05-9a1b65f9ab32] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:00.973747 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fd2ede05-6515-491e-aeb7-4286506674fb tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:00.974810 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fd2ede05-6515-491e-aeb7-4286506674fb tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:00.976703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fd2ede05-6515-491e-aeb7-4286506674fb tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:00.977848 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fd2ede05-6515-491e-aeb7-4286506674fb tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:00.978624 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fd2ede05-6515-491e-aeb7-4286506674fb tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:00.979774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fd2ede05-6515-491e-aeb7-4286506674fb tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:01.316203 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fd2ede05-6515-491e-aeb7-4286506674fb tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:01.324219 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fd2ede05-6515-491e-aeb7-4286506674fb tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32" status: 200 len: 1511 microversion: 2.1 time: 0.376174 Oct 05 02:55:01.327588 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2649/5278] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:00 2022] GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32 => generated 1511 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:01.359171 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c41c6b99-94ce-49bc-b327-84a8371041d7 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:01.366367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c41c6b99-94ce-49bc-b327-84a8371041d7 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:01.367345 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.compute.servers [None req-c41c6b99-94ce-49bc-b327-84a8371041d7 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Removing options 'limit' from query {{(pid=122320) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 05 02:55:01.368218 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c41c6b99-94ce-49bc-b327-84a8371041d7 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Searching by: {'deleted': False, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef'} {{(pid=122320) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:55:01.369937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c41c6b99-94ce-49bc-b327-84a8371041d7 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:01.370787 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c41c6b99-94ce-49bc-b327-84a8371041d7 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:01.380088 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c41c6b99-94ce-49bc-b327-84a8371041d7 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:01.382338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c41c6b99-94ce-49bc-b327-84a8371041d7 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:01.383022 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c41c6b99-94ce-49bc-b327-84a8371041d7 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:01.385927 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c41c6b99-94ce-49bc-b327-84a8371041d7 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:01.387443 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c41c6b99-94ce-49bc-b327-84a8371041d7 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.032288 Oct 05 02:55:01.393422 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2630/5279] 10.222.0.16 () {58 vars in 1140 bytes} [Wed Oct 5 02:55:01 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:55:01.401246 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b4d98352-eaa9-4bbf-b771-8f922bf714b1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:01.402030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b4d98352-eaa9-4bbf-b771-8f922bf714b1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: d39cd597-890f-4cc8-8d05-9a1b65f9ab32] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:01.409066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4d98352-eaa9-4bbf-b771-8f922bf714b1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:01.410281 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4d98352-eaa9-4bbf-b771-8f922bf714b1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:01.410952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4d98352-eaa9-4bbf-b771-8f922bf714b1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:01.411809 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4d98352-eaa9-4bbf-b771-8f922bf714b1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:01.412445 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4d98352-eaa9-4bbf-b771-8f922bf714b1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:01.414135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4d98352-eaa9-4bbf-b771-8f922bf714b1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:01.604833 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b4d98352-eaa9-4bbf-b771-8f922bf714b1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:01.615822 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b4d98352-eaa9-4bbf-b771-8f922bf714b1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32" status: 200 len: 1511 microversion: 2.1 time: 0.218199 Oct 05 02:55:01.616997 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2650/5280] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:01 2022] GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32 => generated 1511 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:01.642366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6226c6c6-3436-47b6-8e12-3c0457bc8893 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:01.642967 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6226c6c6-3436-47b6-8e12-3c0457bc8893 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 318c0ef8-f225-43ef-984f-b5407fa92e1f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:01.650936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6226c6c6-3436-47b6-8e12-3c0457bc8893 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:01.651656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6226c6c6-3436-47b6-8e12-3c0457bc8893 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:01.652225 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6226c6c6-3436-47b6-8e12-3c0457bc8893 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:01.653096 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6226c6c6-3436-47b6-8e12-3c0457bc8893 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:01.653698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6226c6c6-3436-47b6-8e12-3c0457bc8893 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:01.654229 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6226c6c6-3436-47b6-8e12-3c0457bc8893 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:01.790653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-feb4ca1d-c97f-4cf7-81f9-455662d52b4c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:01.791274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-feb4ca1d-c97f-4cf7-81f9-455662d52b4c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:01.803529 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-feb4ca1d-c97f-4cf7-81f9-455662d52b4c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:01.808393 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-feb4ca1d-c97f-4cf7-81f9-455662d52b4c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:01.808895 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-feb4ca1d-c97f-4cf7-81f9-455662d52b4c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:01.809657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-feb4ca1d-c97f-4cf7-81f9-455662d52b4c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:01.810131 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-feb4ca1d-c97f-4cf7-81f9-455662d52b4c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:01.810699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-feb4ca1d-c97f-4cf7-81f9-455662d52b4c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:01.877477 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6226c6c6-3436-47b6-8e12-3c0457bc8893 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:01.887471 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6226c6c6-3436-47b6-8e12-3c0457bc8893 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/318c0ef8-f225-43ef-984f-b5407fa92e1f" status: 200 len: 1512 microversion: 2.1 time: 0.248819 Oct 05 02:55:01.891295 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2631/5281] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:01 2022] GET /compute/v2.1/servers/318c0ef8-f225-43ef-984f-b5407fa92e1f => generated 1512 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:01.910587 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-38580bca-29c4-435e-b929-fb4ff94630b1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:01.911205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-38580bca-29c4-435e-b929-fb4ff94630b1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:01.919103 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38580bca-29c4-435e-b929-fb4ff94630b1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:01.920417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38580bca-29c4-435e-b929-fb4ff94630b1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:01.920832 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38580bca-29c4-435e-b929-fb4ff94630b1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:01.923369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38580bca-29c4-435e-b929-fb4ff94630b1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:01.924019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38580bca-29c4-435e-b929-fb4ff94630b1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:01.924592 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38580bca-29c4-435e-b929-fb4ff94630b1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:02.138469 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-feb4ca1d-c97f-4cf7-81f9-455662d52b4c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:02.152002 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-feb4ca1d-c97f-4cf7-81f9-455662d52b4c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1370 microversion: 2.1 time: 0.365936 Oct 05 02:55:02.152930 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2651/5282] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:01 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1370 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:02.157251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f8d95e8d-93bd-4a69-bf13-bd994f465073 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:02.158017 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f8d95e8d-93bd-4a69-bf13-bd994f465073 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 69a268a7-62f4-4ef2-b5ce-45469cba9c7a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:02.164135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f8d95e8d-93bd-4a69-bf13-bd994f465073 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:02.164630 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f8d95e8d-93bd-4a69-bf13-bd994f465073 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:02.165264 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f8d95e8d-93bd-4a69-bf13-bd994f465073 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:02.166121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f8d95e8d-93bd-4a69-bf13-bd994f465073 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:02.166897 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f8d95e8d-93bd-4a69-bf13-bd994f465073 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:02.167490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f8d95e8d-93bd-4a69-bf13-bd994f465073 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:02.243430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-38580bca-29c4-435e-b929-fb4ff94630b1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:02.251891 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-38580bca-29c4-435e-b929-fb4ff94630b1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1517 microversion: 2.1 time: 0.345295 Oct 05 02:55:02.253900 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2632/5283] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:01 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1517 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:02.341719 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f8d95e8d-93bd-4a69-bf13-bd994f465073 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:02.352891 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f8d95e8d-93bd-4a69-bf13-bd994f465073 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a" status: 200 len: 1511 microversion: 2.1 time: 0.199075 Oct 05 02:55:02.353880 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2652/5284] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:02 2022] GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a => generated 1511 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:02.377603 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-12005827-681e-4681-a6f7-5fef3e3305fd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:02.384321 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-12005827-681e-4681-a6f7-5fef3e3305fd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:02.385271 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-12005827-681e-4681-a6f7-5fef3e3305fd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Searching by: {'ip': '172.20.0.11', 'deleted': False, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef'} {{(pid=122320) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:55:02.509546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12005827-681e-4681-a6f7-5fef3e3305fd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:02.510052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12005827-681e-4681-a6f7-5fef3e3305fd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:02.510608 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12005827-681e-4681-a6f7-5fef3e3305fd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:02.511346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12005827-681e-4681-a6f7-5fef3e3305fd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:02.513774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12005827-681e-4681-a6f7-5fef3e3305fd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:02.513774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12005827-681e-4681-a6f7-5fef3e3305fd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:02.607171 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.multi_cell_list [None req-12005827-681e-4681-a6f7-5fef3e3305fd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:55:02.694264 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-12005827-681e-4681-a6f7-5fef3e3305fd tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers?ip=172.20.0.11" status: 200 len: 345 microversion: 2.1 time: 0.320914 Oct 05 02:55:02.697003 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2633/5285] 10.222.0.16 () {58 vars in 1154 bytes} [Wed Oct 5 02:55:02 2022] GET /compute/v2.1/servers?ip=172.20.0.11 => generated 345 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:55:02.713434 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-de5ae510-d162-4ee4-9d3e-19f4f12ea0db tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:02.716992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-de5ae510-d162-4ee4-9d3e-19f4f12ea0db tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: d39cd597-890f-4cc8-8d05-9a1b65f9ab32] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:02.724042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de5ae510-d162-4ee4-9d3e-19f4f12ea0db tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:02.724759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de5ae510-d162-4ee4-9d3e-19f4f12ea0db tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:02.725591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de5ae510-d162-4ee4-9d3e-19f4f12ea0db tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:02.727282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de5ae510-d162-4ee4-9d3e-19f4f12ea0db tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:02.727759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de5ae510-d162-4ee4-9d3e-19f4f12ea0db tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:02.728217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de5ae510-d162-4ee4-9d3e-19f4f12ea0db tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:02.862440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-7ba19ac8-0f54-4d71-89be-db05fb5f22ea req-86a66dbb-acd0-4b7d-a3d5-2f7f36498c65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c09b57e-7650-448b-ba76-402bdb4f9552", "name": "network-vif-plugged", "status": "completed", "tag": "97e75ce5-35d6-42fc-9ea6-ed6afc7040fa"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:55:02.882715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-7ba19ac8-0f54-4d71-89be-db05fb5f22ea req-86a66dbb-acd0-4b7d-a3d5-2f7f36498c65 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:02.883179 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-7ba19ac8-0f54-4d71-89be-db05fb5f22ea req-86a66dbb-acd0-4b7d-a3d5-2f7f36498c65 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:02.883575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-7ba19ac8-0f54-4d71-89be-db05fb5f22ea req-86a66dbb-acd0-4b7d-a3d5-2f7f36498c65 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:02.909118 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-7ba19ac8-0f54-4d71-89be-db05fb5f22ea req-86a66dbb-acd0-4b7d-a3d5-2f7f36498c65 service nova] Creating event network-vif-plugged:97e75ce5-35d6-42fc-9ea6-ed6afc7040fa for instance 7c09b57e-7650-448b-ba76-402bdb4f9552 on n-h2-858272-3 Oct 05 02:55:02.915297 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-7ba19ac8-0f54-4d71-89be-db05fb5f22ea req-86a66dbb-acd0-4b7d-a3d5-2f7f36498c65 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058403 Oct 05 02:55:02.919335 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2634/5286] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:55:02.970770 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-de5ae510-d162-4ee4-9d3e-19f4f12ea0db tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:02.978208 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:02.989632 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-de5ae510-d162-4ee4-9d3e-19f4f12ea0db tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32" status: 200 len: 1511 microversion: 2.1 time: 0.280818 Oct 05 02:55:02.990973 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2653/5287] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:02 2022] GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32 => generated 1511 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:03.016960 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0f32044e-35f9-444f-aa30-955445576ef5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:03.017702 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0f32044e-35f9-444f-aa30-955445576ef5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 318c0ef8-f225-43ef-984f-b5407fa92e1f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:03.039268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f32044e-35f9-444f-aa30-955445576ef5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:03.040026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f32044e-35f9-444f-aa30-955445576ef5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:03.040857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f32044e-35f9-444f-aa30-955445576ef5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:03.042137 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f32044e-35f9-444f-aa30-955445576ef5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:03.043683 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f32044e-35f9-444f-aa30-955445576ef5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:03.044317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0f32044e-35f9-444f-aa30-955445576ef5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:03.072186 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:03.196555 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-68fdb7ac-f954-4694-9932-ca9d464cd6f9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:03.197684 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-68fdb7ac-f954-4694-9932-ca9d464cd6f9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:03.214353 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68fdb7ac-f954-4694-9932-ca9d464cd6f9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:03.215078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68fdb7ac-f954-4694-9932-ca9d464cd6f9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:03.215722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68fdb7ac-f954-4694-9932-ca9d464cd6f9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:03.216658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68fdb7ac-f954-4694-9932-ca9d464cd6f9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:03.217390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68fdb7ac-f954-4694-9932-ca9d464cd6f9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:03.218267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68fdb7ac-f954-4694-9932-ca9d464cd6f9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:03.323230 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0f32044e-35f9-444f-aa30-955445576ef5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:03.333884 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0f32044e-35f9-444f-aa30-955445576ef5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/318c0ef8-f225-43ef-984f-b5407fa92e1f" status: 200 len: 1512 microversion: 2.1 time: 0.321485 Oct 05 02:55:03.348348 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2635/5288] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:03 2022] GET /compute/v2.1/servers/318c0ef8-f225-43ef-984f-b5407fa92e1f => generated 1512 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:55:03.348348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5536bfe1-aa18-49c4-8b10-f2d780914dce tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:03.348348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5536bfe1-aa18-49c4-8b10-f2d780914dce tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:03.348348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5536bfe1-aa18-49c4-8b10-f2d780914dce tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:03.348348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5536bfe1-aa18-49c4-8b10-f2d780914dce tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:03.348806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5536bfe1-aa18-49c4-8b10-f2d780914dce tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:03.349711 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5536bfe1-aa18-49c4-8b10-f2d780914dce tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:03.350304 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5536bfe1-aa18-49c4-8b10-f2d780914dce tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:03.350866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5536bfe1-aa18-49c4-8b10-f2d780914dce tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:03.505995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-68fdb7ac-f954-4694-9932-ca9d464cd6f9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:03.513793 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-68fdb7ac-f954-4694-9932-ca9d464cd6f9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1370 microversion: 2.1 time: 0.323345 Oct 05 02:55:03.514386 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2654/5289] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:03 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1370 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:03.519472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-858a15e0-e2c4-46d9-81e8-d69fc9c400b9 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:03.525743 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-858a15e0-e2c4-46d9-81e8-d69fc9c400b9 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 69a268a7-62f4-4ef2-b5ce-45469cba9c7a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:03.543490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-858a15e0-e2c4-46d9-81e8-d69fc9c400b9 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:03.544198 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-858a15e0-e2c4-46d9-81e8-d69fc9c400b9 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:03.545005 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-858a15e0-e2c4-46d9-81e8-d69fc9c400b9 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:03.545947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-858a15e0-e2c4-46d9-81e8-d69fc9c400b9 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:03.548089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-858a15e0-e2c4-46d9-81e8-d69fc9c400b9 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:03.555171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-858a15e0-e2c4-46d9-81e8-d69fc9c400b9 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:03.685216 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5536bfe1-aa18-49c4-8b10-f2d780914dce tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:03.696161 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5536bfe1-aa18-49c4-8b10-f2d780914dce tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1517 microversion: 2.1 time: 0.359551 Oct 05 02:55:03.696754 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2636/5290] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:03 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1517 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:03.766402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-858a15e0-e2c4-46d9-81e8-d69fc9c400b9 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:03.778212 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-858a15e0-e2c4-46d9-81e8-d69fc9c400b9 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a" status: 200 len: 1511 microversion: 2.1 time: 0.262109 Oct 05 02:55:03.779784 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2655/5291] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:03 2022] GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a => generated 1511 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:03.805183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0d4081ef-269e-4f85-811d-6be540728136 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:03.810106 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0d4081ef-269e-4f85-811d-6be540728136 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:03.811202 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0d4081ef-269e-4f85-811d-6be540728136 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Searching by: {'deleted': False, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef'} {{(pid=122320) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:55:03.818688 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d4081ef-269e-4f85-811d-6be540728136 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:03.819451 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d4081ef-269e-4f85-811d-6be540728136 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:03.820103 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d4081ef-269e-4f85-811d-6be540728136 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:03.821064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d4081ef-269e-4f85-811d-6be540728136 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:03.821720 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d4081ef-269e-4f85-811d-6be540728136 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:03.822324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d4081ef-269e-4f85-811d-6be540728136 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:03.861053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.multi_cell_list [None req-0d4081ef-269e-4f85-811d-6be540728136 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:55:03.906276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0d4081ef-269e-4f85-811d-6be540728136 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:03.915664 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d4081ef-269e-4f85-811d-6be540728136 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:03.916321 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d4081ef-269e-4f85-811d-6be540728136 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:03.916927 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d4081ef-269e-4f85-811d-6be540728136 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:04.078354 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0d4081ef-269e-4f85-811d-6be540728136 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 0.280695 Oct 05 02:55:04.078966 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2637/5292] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:55:03 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:04.106082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a491020d-091a-47b9-a7e3-0e0ba1430cc7 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:04.111123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a491020d-091a-47b9-a7e3-0e0ba1430cc7 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:04.111899 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a491020d-091a-47b9-a7e3-0e0ba1430cc7 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef'} {{(pid=122319) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:55:04.194565 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a491020d-091a-47b9-a7e3-0e0ba1430cc7 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:04.195051 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a491020d-091a-47b9-a7e3-0e0ba1430cc7 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:04.195485 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a491020d-091a-47b9-a7e3-0e0ba1430cc7 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:04.196243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a491020d-091a-47b9-a7e3-0e0ba1430cc7 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:04.197012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a491020d-091a-47b9-a7e3-0e0ba1430cc7 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:04.197629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a491020d-091a-47b9-a7e3-0e0ba1430cc7 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:04.305970 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.multi_cell_list [None req-a491020d-091a-47b9-a7e3-0e0ba1430cc7 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122319) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:55:04.368913 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a491020d-091a-47b9-a7e3-0e0ba1430cc7 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1009 microversion: 2.1 time: 0.266457 Oct 05 02:55:04.380229 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2656/5293] 10.222.0.16 () {58 vars in 1150 bytes} [Wed Oct 5 02:55:04 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1009 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:04.385486 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d167d45f-8e04-4012-b2fc-c513b79f59eb tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:04.390607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d167d45f-8e04-4012-b2fc-c513b79f59eb tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:04.391505 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d167d45f-8e04-4012-b2fc-c513b79f59eb tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef'} {{(pid=122320) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:55:04.394222 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:04.398909 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d167d45f-8e04-4012-b2fc-c513b79f59eb tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:04.399396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d167d45f-8e04-4012-b2fc-c513b79f59eb tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:04.399827 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d167d45f-8e04-4012-b2fc-c513b79f59eb tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:04.400541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d167d45f-8e04-4012-b2fc-c513b79f59eb tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:04.401056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d167d45f-8e04-4012-b2fc-c513b79f59eb tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:04.401480 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d167d45f-8e04-4012-b2fc-c513b79f59eb tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:04.542801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-46a2ab94-a6a6-4110-affc-aa9bb0961d5e tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:04.544711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-46a2ab94-a6a6-4110-affc-aa9bb0961d5e tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:04.557488 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46a2ab94-a6a6-4110-affc-aa9bb0961d5e tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:04.558324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46a2ab94-a6a6-4110-affc-aa9bb0961d5e tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:04.559884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46a2ab94-a6a6-4110-affc-aa9bb0961d5e tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:04.561685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46a2ab94-a6a6-4110-affc-aa9bb0961d5e tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:04.562439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46a2ab94-a6a6-4110-affc-aa9bb0961d5e tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:04.563359 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46a2ab94-a6a6-4110-affc-aa9bb0961d5e tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:04.776374 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-46a2ab94-a6a6-4110-affc-aa9bb0961d5e tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:04.786427 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-46a2ab94-a6a6-4110-affc-aa9bb0961d5e tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1370 microversion: 2.1 time: 0.250180 Oct 05 02:55:04.787908 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2657/5294] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:04 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1370 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:04.792864 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d1daec55-ad1d-442e-986c-5c3479c6c013 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:04.793718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d1daec55-ad1d-442e-986c-5c3479c6c013 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:04.796256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.multi_cell_list [None req-d167d45f-8e04-4012-b2fc-c513b79f59eb tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:55:04.800492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d1daec55-ad1d-442e-986c-5c3479c6c013 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:04.801349 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d1daec55-ad1d-442e-986c-5c3479c6c013 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:04.802017 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d1daec55-ad1d-442e-986c-5c3479c6c013 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:04.802811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d1daec55-ad1d-442e-986c-5c3479c6c013 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:04.803347 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d1daec55-ad1d-442e-986c-5c3479c6c013 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:04.803849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d1daec55-ad1d-442e-986c-5c3479c6c013 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:04.912516 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d167d45f-8e04-4012-b2fc-c513b79f59eb tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1009 microversion: 2.1 time: 0.530687 Oct 05 02:55:04.922687 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2638/5295] 10.222.0.16 () {58 vars in 1212 bytes} [Wed Oct 5 02:55:04 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1009 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:04.930201 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-99be86a4-6f52-404d-b396-49ba4024cfa5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:04.950271 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-99be86a4-6f52-404d-b396-49ba4024cfa5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:04.951569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-99be86a4-6f52-404d-b396-49ba4024cfa5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef'} {{(pid=122320) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:55:04.959388 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99be86a4-6f52-404d-b396-49ba4024cfa5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:04.960010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99be86a4-6f52-404d-b396-49ba4024cfa5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:04.960460 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99be86a4-6f52-404d-b396-49ba4024cfa5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:04.961748 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99be86a4-6f52-404d-b396-49ba4024cfa5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:04.963071 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99be86a4-6f52-404d-b396-49ba4024cfa5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:04.963536 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99be86a4-6f52-404d-b396-49ba4024cfa5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:04.991142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d1daec55-ad1d-442e-986c-5c3479c6c013 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:05.005220 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d1daec55-ad1d-442e-986c-5c3479c6c013 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.214355 Oct 05 02:55:05.006280 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2658/5296] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:04 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:05.029634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1a06cf72-5616-4386-83f1-e1328523019a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:05.030592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1a06cf72-5616-4386-83f1-e1328523019a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:05.039749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a06cf72-5616-4386-83f1-e1328523019a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:05.040253 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a06cf72-5616-4386-83f1-e1328523019a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:05.040865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a06cf72-5616-4386-83f1-e1328523019a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:05.041606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a06cf72-5616-4386-83f1-e1328523019a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:05.042068 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a06cf72-5616-4386-83f1-e1328523019a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:05.042523 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a06cf72-5616-4386-83f1-e1328523019a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:05.077733 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.multi_cell_list [None req-99be86a4-6f52-404d-b396-49ba4024cfa5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:55:05.144691 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-99be86a4-6f52-404d-b396-49ba4024cfa5 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1009 microversion: 2.1 time: 0.219965 Oct 05 02:55:05.149976 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2639/5297] 10.222.0.16 () {58 vars in 1196 bytes} [Wed Oct 5 02:55:04 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1009 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:05.163268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bde25587-60c6-4676-9c5a-45de1201c64a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:05.169149 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bde25587-60c6-4676-9c5a-45de1201c64a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:05.169843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bde25587-60c6-4676-9c5a-45de1201c64a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Searching by: {'name': '-996709922', 'deleted': False, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef'} {{(pid=122320) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:55:05.175441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bde25587-60c6-4676-9c5a-45de1201c64a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:05.176090 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bde25587-60c6-4676-9c5a-45de1201c64a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:05.177982 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bde25587-60c6-4676-9c5a-45de1201c64a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:05.178793 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bde25587-60c6-4676-9c5a-45de1201c64a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:05.179379 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bde25587-60c6-4676-9c5a-45de1201c64a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:05.179839 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bde25587-60c6-4676-9c5a-45de1201c64a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:05.215162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1a06cf72-5616-4386-83f1-e1328523019a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:05.225256 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1a06cf72-5616-4386-83f1-e1328523019a tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.199254 Oct 05 02:55:05.226602 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2659/5298] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:05 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:55:05.264815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-300c773a-bb75-42ed-8c41-e9d132758d0f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:05.265541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-300c773a-bb75-42ed-8c41-e9d132758d0f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:05.274991 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-300c773a-bb75-42ed-8c41-e9d132758d0f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:05.275599 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-300c773a-bb75-42ed-8c41-e9d132758d0f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:05.276117 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-300c773a-bb75-42ed-8c41-e9d132758d0f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:05.276708 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.multi_cell_list [None req-bde25587-60c6-4676-9c5a-45de1201c64a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:55:05.276830 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-300c773a-bb75-42ed-8c41-e9d132758d0f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:05.277592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-300c773a-bb75-42ed-8c41-e9d132758d0f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:05.278229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-300c773a-bb75-42ed-8c41-e9d132758d0f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:05.382425 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bde25587-60c6-4676-9c5a-45de1201c64a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers?name=-996709922" status: 200 len: 345 microversion: 2.1 time: 0.224269 Oct 05 02:55:05.383422 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2640/5299] 10.222.0.16 () {58 vars in 1156 bytes} [Wed Oct 5 02:55:05 2022] GET /compute/v2.1/servers?name=-996709922 => generated 345 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:55:05.397749 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f971f209-0d95-45e9-939f-bb3026abdb53 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:05.403587 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f971f209-0d95-45e9-939f-bb3026abdb53 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:05.404366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f971f209-0d95-45e9-939f-bb3026abdb53 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef'} {{(pid=122320) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:55:05.411144 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f971f209-0d95-45e9-939f-bb3026abdb53 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:05.411734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f971f209-0d95-45e9-939f-bb3026abdb53 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:05.412537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f971f209-0d95-45e9-939f-bb3026abdb53 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:05.413393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f971f209-0d95-45e9-939f-bb3026abdb53 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:05.413930 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f971f209-0d95-45e9-939f-bb3026abdb53 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:05.414428 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f971f209-0d95-45e9-939f-bb3026abdb53 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:05.463342 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-300c773a-bb75-42ed-8c41-e9d132758d0f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:05.473279 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-300c773a-bb75-42ed-8c41-e9d132758d0f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.212999 Oct 05 02:55:05.490926 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2660/5300] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:05 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:55:05.496286 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-36199ccf-ae71-4acf-a704-9d72eb8ea3ed tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:55:05.502076 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-36199ccf-ae71-4acf-a704-9d72eb8ea3ed tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Instance 49f8218f-9599-4bde-badd-a5dfce6f5732 has no mapping to a cell. Oct 05 02:55:05.517122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.multi_cell_list [None req-f971f209-0d95-45e9-939f-bb3026abdb53 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-36199ccf-ae71-4acf-a704-9d72eb8ea3ed tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers/49f8218f-9599-4bde-badd-a5dfce6f5732/action HTTP/1.1 Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 15 Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: {"os-stop": {}} Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 49f8218f-9599-4bde-badd-a5dfce6f5732 has no mapping to a cell. Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '49f8218f-9599-4bde-badd-a5dfce6f5732', 'body': {'os-stop': {}}} Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 49f8218f-9599-4bde-badd-a5dfce6f5732 has no mapping to a cell. Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:55:05.535912 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49f8218f-9599-4bde-badd-a5dfce6f5732 has no mapping to a cell. Oct 05 02:55:05.543365 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:05.543365 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:55:05.543365 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:05.543365 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:05.543365 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:55:05.543365 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:55:05.543365 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:55:05.543365 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:55:05.543365 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49f8218f-9599-4bde-badd-a5dfce6f5732 has no mapping to a cell. Oct 05 02:55:05.543365 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:05.543365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-36199ccf-ae71-4acf-a704-9d72eb8ea3ed tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 404 to user: Instance 49f8218f-9599-4bde-badd-a5dfce6f5732 has no mapping to a cell. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:55:05.543365 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-36199ccf-ae71-4acf-a704-9d72eb8ea3ed tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers/49f8218f-9599-4bde-badd-a5dfce6f5732/action" status: 404 len: 117 microversion: 2.1 time: 0.045665 Oct 05 02:55:05.543365 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2661/5301] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:55:05 2022] POST /compute/v2.1/servers/49f8218f-9599-4bde-badd-a5dfce6f5732/action => generated 117 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:55:05.551958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dfffe5b1-3a21-4b3f-9be0-41c509df68b5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:05.553168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-dfffe5b1-3a21-4b3f-9be0-41c509df68b5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:05.570077 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dfffe5b1-3a21-4b3f-9be0-41c509df68b5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:05.570872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dfffe5b1-3a21-4b3f-9be0-41c509df68b5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:05.571530 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dfffe5b1-3a21-4b3f-9be0-41c509df68b5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:05.572645 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dfffe5b1-3a21-4b3f-9be0-41c509df68b5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:05.573328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dfffe5b1-3a21-4b3f-9be0-41c509df68b5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:05.573941 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dfffe5b1-3a21-4b3f-9be0-41c509df68b5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:05.584620 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f971f209-0d95-45e9-939f-bb3026abdb53 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1009 microversion: 2.1 time: 0.191295 Oct 05 02:55:05.585543 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2641/5302] 10.222.0.16 () {58 vars in 1154 bytes} [Wed Oct 5 02:55:05 2022] GET /compute/v2.1/servers?name=-instance => generated 1009 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:05.611696 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-32364af2-8af3-44b7-b48b-540cd75d102e tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:05.621257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-32364af2-8af3-44b7-b48b-540cd75d102e tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:05.622647 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-32364af2-8af3-44b7-b48b-540cd75d102e tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-99670992', 'deleted': False, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef'} {{(pid=122320) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:55:05.633127 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32364af2-8af3-44b7-b48b-540cd75d102e tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:05.633622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32364af2-8af3-44b7-b48b-540cd75d102e tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:05.634299 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32364af2-8af3-44b7-b48b-540cd75d102e tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:05.635031 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32364af2-8af3-44b7-b48b-540cd75d102e tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:05.635492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32364af2-8af3-44b7-b48b-540cd75d102e tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:05.635966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32364af2-8af3-44b7-b48b-540cd75d102e tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:05.737598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.multi_cell_list [None req-32364af2-8af3-44b7-b48b-540cd75d102e tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:55:05.748738 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-dfffe5b1-3a21-4b3f-9be0-41c509df68b5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:05.758245 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-dfffe5b1-3a21-4b3f-9be0-41c509df68b5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.214545 Oct 05 02:55:05.758822 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2662/5303] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:05 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:05.782574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7abf1e13-7173-4dfd-97b3-47be294e7d7c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:05.783750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7abf1e13-7173-4dfd-97b3-47be294e7d7c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:05.791003 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7abf1e13-7173-4dfd-97b3-47be294e7d7c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:05.791463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7abf1e13-7173-4dfd-97b3-47be294e7d7c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:05.791907 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7abf1e13-7173-4dfd-97b3-47be294e7d7c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:05.792616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7abf1e13-7173-4dfd-97b3-47be294e7d7c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:05.793110 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7abf1e13-7173-4dfd-97b3-47be294e7d7c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:05.793706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7abf1e13-7173-4dfd-97b3-47be294e7d7c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:05.803435 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-32364af2-8af3-44b7-b48b-540cd75d102e tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-99670992" status: 200 len: 345 microversion: 2.1 time: 0.209770 Oct 05 02:55:05.804039 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2642/5304] 10.222.0.16 () {58 vars in 1226 bytes} [Wed Oct 5 02:55:05 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-99670992 => generated 345 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:55:05.817488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fef3cbe1-e464-4e6f-85ec-6c745629d312 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:05.818115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fef3cbe1-e464-4e6f-85ec-6c745629d312 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:05.824239 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fef3cbe1-e464-4e6f-85ec-6c745629d312 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:05.824735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fef3cbe1-e464-4e6f-85ec-6c745629d312 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:05.825213 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fef3cbe1-e464-4e6f-85ec-6c745629d312 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:05.825934 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fef3cbe1-e464-4e6f-85ec-6c745629d312 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:05.826549 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fef3cbe1-e464-4e6f-85ec-6c745629d312 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:05.826983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fef3cbe1-e464-4e6f-85ec-6c745629d312 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:06.060265 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7abf1e13-7173-4dfd-97b3-47be294e7d7c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:06.072741 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7abf1e13-7173-4dfd-97b3-47be294e7d7c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.294640 Oct 05 02:55:06.074012 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2663/5305] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:05 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:55:06.080106 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-507797b1-1410-48de-b06a-11d97ca6f637 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:06.081621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-507797b1-1410-48de-b06a-11d97ca6f637 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 69a268a7-62f4-4ef2-b5ce-45469cba9c7a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:06.090095 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-507797b1-1410-48de-b06a-11d97ca6f637 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:06.090959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-507797b1-1410-48de-b06a-11d97ca6f637 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:06.091586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-507797b1-1410-48de-b06a-11d97ca6f637 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:06.092466 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-507797b1-1410-48de-b06a-11d97ca6f637 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:06.096010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fef3cbe1-e464-4e6f-85ec-6c745629d312 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:06.099078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-507797b1-1410-48de-b06a-11d97ca6f637 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:06.099759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-507797b1-1410-48de-b06a-11d97ca6f637 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:06.121987 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fef3cbe1-e464-4e6f-85ec-6c745629d312 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1564 microversion: 2.1 time: 0.309180 Oct 05 02:55:06.122605 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2643/5306] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:05 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1564 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:55:06.127796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-44bb9668-a307-4ad3-9aa8-b1a4ee0fcf56 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:55:06.129352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-44bb9668-a307-4ad3-9aa8-b1a4ee0fcf56 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 64355150-624f-4ce8-813c-35d7181f1bfa] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:06.137444 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-44bb9668-a307-4ad3-9aa8-b1a4ee0fcf56 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Instance 64355150-624f-4ce8-813c-35d7181f1bfa could not be found. Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-44bb9668-a307-4ad3-9aa8-b1a4ee0fcf56 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers/64355150-624f-4ce8-813c-35d7181f1bfa/action HTTP/1.1 Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 15 Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: {"suspend": {}} Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 64355150-624f-4ce8-813c-35d7181f1bfa could not be found. Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '64355150-624f-4ce8-813c-35d7181f1bfa', 'body': {'suspend': {}}} Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64355150-624f-4ce8-813c-35d7181f1bfa could not be found. Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64355150-624f-4ce8-813c-35d7181f1bfa could not be found. Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:55:06.139473 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:55:06.143295 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:55:06.143295 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:55:06.143295 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64355150-624f-4ce8-813c-35d7181f1bfa could not be found. Oct 05 02:55:06.143295 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:06.145378 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-44bb9668-a307-4ad3-9aa8-b1a4ee0fcf56 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 404 to user: Instance 64355150-624f-4ce8-813c-35d7181f1bfa could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:55:06.145983 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-507797b1-1410-48de-b06a-11d97ca6f637 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 69a268a7-62f4-4ef2-b5ce-45469cba9c7a] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:55:06.146657 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-44bb9668-a307-4ad3-9aa8-b1a4ee0fcf56 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers/64355150-624f-4ce8-813c-35d7181f1bfa/action" status: 404 len: 111 microversion: 2.1 time: 0.022956 Oct 05 02:55:06.147424 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2644/5307] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:55:06 2022] POST /compute/v2.1/servers/64355150-624f-4ce8-813c-35d7181f1bfa/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:55:06.153554 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0505e6ec-3628-4d5b-92a0-d65a4b2dc270 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:06.154656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0505e6ec-3628-4d5b-92a0-d65a4b2dc270 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:06.166615 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0505e6ec-3628-4d5b-92a0-d65a4b2dc270 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:06.167031 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0505e6ec-3628-4d5b-92a0-d65a4b2dc270 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:06.167465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0505e6ec-3628-4d5b-92a0-d65a4b2dc270 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:06.168163 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0505e6ec-3628-4d5b-92a0-d65a4b2dc270 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:06.168612 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0505e6ec-3628-4d5b-92a0-d65a4b2dc270 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:06.169063 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0505e6ec-3628-4d5b-92a0-d65a4b2dc270 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:06.270635 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0505e6ec-3628-4d5b-92a0-d65a4b2dc270 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.121818 Oct 05 02:55:06.271564 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-507797b1-1410-48de-b06a-11d97ca6f637 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "DELETE /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a" status: 204 len: 0 microversion: 2.1 time: 0.195740 Oct 05 02:55:06.272190 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2645/5308] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 02:55:06 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552/os-interface => generated 285 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:55:06.277170 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2664/5309] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:55:06 2022] DELETE /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:55:06.278054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-eca8335e-2582-4744-9816-6281be789cff tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:06.278880 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-eca8335e-2582-4744-9816-6281be789cff tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:06.287634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eca8335e-2582-4744-9816-6281be789cff tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:06.288139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eca8335e-2582-4744-9816-6281be789cff tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:06.288649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eca8335e-2582-4744-9816-6281be789cff tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:06.289393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eca8335e-2582-4744-9816-6281be789cff tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:06.289849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eca8335e-2582-4744-9816-6281be789cff tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:06.290123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c5d97820-2eda-4cf2-8132-b63f1a6be35f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:06.290414 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eca8335e-2582-4744-9816-6281be789cff tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:06.293285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c5d97820-2eda-4cf2-8132-b63f1a6be35f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 69a268a7-62f4-4ef2-b5ce-45469cba9c7a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:06.308340 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5d97820-2eda-4cf2-8132-b63f1a6be35f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:06.310930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5d97820-2eda-4cf2-8132-b63f1a6be35f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:06.311462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5d97820-2eda-4cf2-8132-b63f1a6be35f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:06.312277 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5d97820-2eda-4cf2-8132-b63f1a6be35f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:06.312809 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5d97820-2eda-4cf2-8132-b63f1a6be35f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:06.313937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5d97820-2eda-4cf2-8132-b63f1a6be35f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:06.710204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c5d97820-2eda-4cf2-8132-b63f1a6be35f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:06.718551 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c5d97820-2eda-4cf2-8132-b63f1a6be35f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a" status: 200 len: 1517 microversion: 2.1 time: 0.439926 Oct 05 02:55:06.719154 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2665/5310] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:06 2022] GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a => generated 1517 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:06.730392 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-eca8335e-2582-4744-9816-6281be789cff tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:06.740585 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-eca8335e-2582-4744-9816-6281be789cff tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.466811 Oct 05 02:55:06.741311 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2646/5311] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:06 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:06.768351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8ed34cea-19c6-496b-8ae0-684e9734d26c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:06.769586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8ed34cea-19c6-496b-8ae0-684e9734d26c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:06.778140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ed34cea-19c6-496b-8ae0-684e9734d26c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:06.778648 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ed34cea-19c6-496b-8ae0-684e9734d26c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:06.779313 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ed34cea-19c6-496b-8ae0-684e9734d26c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:06.779989 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ed34cea-19c6-496b-8ae0-684e9734d26c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:06.780451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ed34cea-19c6-496b-8ae0-684e9734d26c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:06.780892 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ed34cea-19c6-496b-8ae0-684e9734d26c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:07.050858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8ed34cea-19c6-496b-8ae0-684e9734d26c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:07.060036 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8ed34cea-19c6-496b-8ae0-684e9734d26c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.295469 Oct 05 02:55:07.061002 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2666/5312] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:06 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:55:07.083624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d1a1723c-c791-49af-b5d6-cde12fae47fa tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:55:07.084887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d1a1723c-c791-49af-b5d6-cde12fae47fa tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:07.093518 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1a1723c-c791-49af-b5d6-cde12fae47fa tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:07.094015 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1a1723c-c791-49af-b5d6-cde12fae47fa tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:07.094506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1a1723c-c791-49af-b5d6-cde12fae47fa tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:07.095208 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1a1723c-c791-49af-b5d6-cde12fae47fa tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:07.095666 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1a1723c-c791-49af-b5d6-cde12fae47fa tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:07.096090 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1a1723c-c791-49af-b5d6-cde12fae47fa tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:07.125697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-d1a1723c-c791-49af-b5d6-cde12fae47fa tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lazy-loading 'flavor' on Instance uuid 1fded3d6-d275-4d50-a366-d19388f8aaec {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:55:07.241725 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d1a1723c-c791-49af-b5d6-cde12fae47fa tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec/action" status: 202 len: 0 microversion: 2.1 time: 0.162841 Oct 05 02:55:07.243245 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2647/5313] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:55:07 2022] POST /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:55:07.251519 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8555ddcf-a5b7-499d-9598-7cfa94457b52 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:07.252145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8555ddcf-a5b7-499d-9598-7cfa94457b52 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:07.263680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8555ddcf-a5b7-499d-9598-7cfa94457b52 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:07.264533 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8555ddcf-a5b7-499d-9598-7cfa94457b52 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:07.265281 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8555ddcf-a5b7-499d-9598-7cfa94457b52 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:07.266245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8555ddcf-a5b7-499d-9598-7cfa94457b52 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:07.267007 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8555ddcf-a5b7-499d-9598-7cfa94457b52 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:07.267657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8555ddcf-a5b7-499d-9598-7cfa94457b52 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:07.553878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8555ddcf-a5b7-499d-9598-7cfa94457b52 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:07.565044 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8555ddcf-a5b7-499d-9598-7cfa94457b52 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1512 microversion: 2.1 time: 0.317397 Oct 05 02:55:07.566648 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2667/5314] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:07 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1512 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:07.748262 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-520b63f2-e995-42a5-91e2-678d49120f5d tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:07.749895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-520b63f2-e995-42a5-91e2-678d49120f5d tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 69a268a7-62f4-4ef2-b5ce-45469cba9c7a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:07.786760 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-520b63f2-e995-42a5-91e2-678d49120f5d tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:07.787849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-520b63f2-e995-42a5-91e2-678d49120f5d tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:07.789990 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-520b63f2-e995-42a5-91e2-678d49120f5d tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:07.792105 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-520b63f2-e995-42a5-91e2-678d49120f5d tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:07.793295 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-520b63f2-e995-42a5-91e2-678d49120f5d tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:07.793948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-520b63f2-e995-42a5-91e2-678d49120f5d tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:08.310355 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-f7788045-81d8-4d85-8805-616fc59661ec req-0dbba5c0-bb41-458b-90b0-2aad54e57bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c09b57e-7650-448b-ba76-402bdb4f9552", "tag": "97e75ce5-35d6-42fc-9ea6-ed6afc7040fa"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:55:08.321805 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 02:55:08.326807 n-d-858272-3 devstack@n-api.service[122319]: Wed Oct 5 02:55:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 05 02:55:08.381007 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f7788045-81d8-4d85-8805-616fc59661ec req-0dbba5c0-bb41-458b-90b0-2aad54e57bb7 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:08.382908 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f7788045-81d8-4d85-8805-616fc59661ec req-0dbba5c0-bb41-458b-90b0-2aad54e57bb7 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:08.385400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f7788045-81d8-4d85-8805-616fc59661ec req-0dbba5c0-bb41-458b-90b0-2aad54e57bb7 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:08.431630 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-f7788045-81d8-4d85-8805-616fc59661ec req-0dbba5c0-bb41-458b-90b0-2aad54e57bb7 service nova] Creating event network-changed:97e75ce5-35d6-42fc-9ea6-ed6afc7040fa for instance 7c09b57e-7650-448b-ba76-402bdb4f9552 on n-h2-858272-3 Oct 05 02:55:08.441831 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-f7788045-81d8-4d85-8805-616fc59661ec req-0dbba5c0-bb41-458b-90b0-2aad54e57bb7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135817 Oct 05 02:55:08.442931 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2668/5315] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:55:08.470126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-520b63f2-e995-42a5-91e2-678d49120f5d tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:08.505084 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-520b63f2-e995-42a5-91e2-678d49120f5d tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a" status: 200 len: 1517 microversion: 2.1 time: 0.753389 Oct 05 02:55:08.505084 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2648/5316] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:07 2022] GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a => generated 1517 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:08.592599 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-71d01a14-b3a0-4d7c-a869-a96996cb0cb8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:08.593627 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-71d01a14-b3a0-4d7c-a869-a96996cb0cb8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:08.606660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71d01a14-b3a0-4d7c-a869-a96996cb0cb8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:08.607175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71d01a14-b3a0-4d7c-a869-a96996cb0cb8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:08.607585 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71d01a14-b3a0-4d7c-a869-a96996cb0cb8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:08.612295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71d01a14-b3a0-4d7c-a869-a96996cb0cb8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:08.613557 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71d01a14-b3a0-4d7c-a869-a96996cb0cb8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:08.616583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71d01a14-b3a0-4d7c-a869-a96996cb0cb8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:09.276019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-71d01a14-b3a0-4d7c-a869-a96996cb0cb8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:09.287694 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-71d01a14-b3a0-4d7c-a869-a96996cb0cb8 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1495 microversion: 2.1 time: 0.699870 Oct 05 02:55:09.289007 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2669/5317] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:08 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1495 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:09.316100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ec9831b8-409d-4fa0-b32e-612b6267edff tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:55:09.316751 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ec9831b8-409d-4fa0-b32e-612b6267edff tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:09.328422 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec9831b8-409d-4fa0-b32e-612b6267edff tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:09.337221 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec9831b8-409d-4fa0-b32e-612b6267edff tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:09.338180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec9831b8-409d-4fa0-b32e-612b6267edff tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:09.338610 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec9831b8-409d-4fa0-b32e-612b6267edff tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:09.339079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec9831b8-409d-4fa0-b32e-612b6267edff tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:09.339516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec9831b8-409d-4fa0-b32e-612b6267edff tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:09.402042 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:09.417618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-ec9831b8-409d-4fa0-b32e-612b6267edff tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lazy-loading 'flavor' on Instance uuid 1fded3d6-d275-4d50-a366-d19388f8aaec {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:55:09.454333 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-ec9831b8-409d-4fa0-b32e-612b6267edff tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Cannot 'suspend' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state suspended Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ec9831b8-409d-4fa0-b32e-612b6267edff tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec/action HTTP/1.1 Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 15 Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: {"suspend": {}} Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: exception: Cannot 'suspend' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state suspended Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '1fded3d6-d275-4d50-a366-d19388f8aaec', 'body': {'suspend': {}}} Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1fded3d6-d275-4d50-a366-d19388f8aaec in vm_state suspended. Cannot suspend while the instance is in this state. Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 05 02:55:09.461888 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 05 02:55:09.466674 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 05 02:55:09.466674 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 02:55:09.466674 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state suspended Oct 05 02:55:09.466674 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:09.466674 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:55:09.466674 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:09.466674 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:09.466674 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:55:09.466674 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:55:09.466674 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:55:09.466674 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:55:09.466674 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state suspended Oct 05 02:55:09.466674 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:09.466674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ec9831b8-409d-4fa0-b32e-612b6267edff tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 409 to user: Cannot 'suspend' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state suspended {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:55:09.468544 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ec9831b8-409d-4fa0-b32e-612b6267edff tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec/action" status: 409 len: 148 microversion: 2.1 time: 0.156026 Oct 05 02:55:09.471575 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2649/5318] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:55:09 2022] POST /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec/action => generated 148 bytes in 161 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:55:09.479820 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0d502c5d-292f-4b8a-a283-e004ec5f25da tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:55:09.492798 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0d502c5d-292f-4b8a-a283-e004ec5f25da tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:09.515988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0d502c5d-292f-4b8a-a283-e004ec5f25da tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:09.520259 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0d502c5d-292f-4b8a-a283-e004ec5f25da tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:09.523334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-02dfbc86-7560-450b-ba3d-95384be7c3d1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:09.523965 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-02dfbc86-7560-450b-ba3d-95384be7c3d1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 69a268a7-62f4-4ef2-b5ce-45469cba9c7a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:09.524274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0d502c5d-292f-4b8a-a283-e004ec5f25da tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:09.525297 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0d502c5d-292f-4b8a-a283-e004ec5f25da tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:09.526179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0d502c5d-292f-4b8a-a283-e004ec5f25da tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:09.526806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0d502c5d-292f-4b8a-a283-e004ec5f25da tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:09.532583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02dfbc86-7560-450b-ba3d-95384be7c3d1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:09.533129 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02dfbc86-7560-450b-ba3d-95384be7c3d1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:09.533574 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02dfbc86-7560-450b-ba3d-95384be7c3d1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:09.537065 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:09.537493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02dfbc86-7560-450b-ba3d-95384be7c3d1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:09.538663 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02dfbc86-7560-450b-ba3d-95384be7c3d1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:09.541425 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02dfbc86-7560-450b-ba3d-95384be7c3d1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:09.669061 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02dfbc86-7560-450b-ba3d-95384be7c3d1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:09.670387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02dfbc86-7560-450b-ba3d-95384be7c3d1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:09.693408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02dfbc86-7560-450b-ba3d-95384be7c3d1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:09.693994 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-02dfbc86-7560-450b-ba3d-95384be7c3d1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lazy-loading 'fault' on Instance uuid 69a268a7-62f4-4ef2-b5ce-45469cba9c7a {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:55:09.699371 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0d502c5d-292f-4b8a-a283-e004ec5f25da tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec/action" status: 202 len: 0 microversion: 2.1 time: 0.223556 Oct 05 02:55:09.703681 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2670/5319] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:55:09 2022] POST /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:55:09.733468 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b801ffb6-1801-48d5-90f1-8093c6044e8c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:09.735142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b801ffb6-1801-48d5-90f1-8093c6044e8c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:09.752018 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b801ffb6-1801-48d5-90f1-8093c6044e8c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:09.752959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b801ffb6-1801-48d5-90f1-8093c6044e8c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:09.756162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b801ffb6-1801-48d5-90f1-8093c6044e8c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:09.757089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b801ffb6-1801-48d5-90f1-8093c6044e8c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:09.758493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b801ffb6-1801-48d5-90f1-8093c6044e8c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:09.758990 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b801ffb6-1801-48d5-90f1-8093c6044e8c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:09.840631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-02dfbc86-7560-450b-ba3d-95384be7c3d1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:09.851249 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-02dfbc86-7560-450b-ba3d-95384be7c3d1 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a" status: 200 len: 1310 microversion: 2.1 time: 0.332098 Oct 05 02:55:09.876168 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2650/5320] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:09 2022] GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a => generated 1310 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:10.149122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b801ffb6-1801-48d5-90f1-8093c6044e8c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:10.164432 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b801ffb6-1801-48d5-90f1-8093c6044e8c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1501 microversion: 2.1 time: 0.449447 Oct 05 02:55:10.167446 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2671/5321] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:09 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1501 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:10.464309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-2c93d821-c18b-4a73-bc60-be7df107c56d req-36e6c0a9-bab4-4472-88c3-111a12868ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69a268a7-62f4-4ef2-b5ce-45469cba9c7a", "name": "network-vif-deleted", "tag": "fddc21db-621d-48b6-9fa4-da62e16cdb6c"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:55:10.491734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-2c93d821-c18b-4a73-bc60-be7df107c56d req-36e6c0a9-bab4-4472-88c3-111a12868ca2 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:10.511848 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-2c93d821-c18b-4a73-bc60-be7df107c56d req-36e6c0a9-bab4-4472-88c3-111a12868ca2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:10.512965 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-2c93d821-c18b-4a73-bc60-be7df107c56d req-36e6c0a9-bab4-4472-88c3-111a12868ca2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:10.537033 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-2c93d821-c18b-4a73-bc60-be7df107c56d req-36e6c0a9-bab4-4472-88c3-111a12868ca2 service nova] Creating event network-vif-deleted:fddc21db-621d-48b6-9fa4-da62e16cdb6c for instance 69a268a7-62f4-4ef2-b5ce-45469cba9c7a on n-h2-858272-3 Oct 05 02:55:10.543159 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-2c93d821-c18b-4a73-bc60-be7df107c56d req-36e6c0a9-bab4-4472-88c3-111a12868ca2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082585 Oct 05 02:55:10.546175 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2651/5322] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:55:10.875355 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-01462249-7769-424b-a11a-60c0084457a8 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:10.877372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-01462249-7769-424b-a11a-60c0084457a8 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 69a268a7-62f4-4ef2-b5ce-45469cba9c7a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:10.885536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01462249-7769-424b-a11a-60c0084457a8 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:10.886148 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01462249-7769-424b-a11a-60c0084457a8 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:10.886588 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01462249-7769-424b-a11a-60c0084457a8 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:10.887520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01462249-7769-424b-a11a-60c0084457a8 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:10.887979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01462249-7769-424b-a11a-60c0084457a8 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:10.888402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01462249-7769-424b-a11a-60c0084457a8 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:10.903467 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-01462249-7769-424b-a11a-60c0084457a8 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] HTTP exception thrown: Instance 69a268a7-62f4-4ef2-b5ce-45469cba9c7a could not be found. Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-01462249-7769-424b-a11a-60c0084457a8 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Request method failure captured: Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a HTTP/1.1 Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPHH_Ix-WbUXYIyq0tVAY2bw3XjHuoujau_RaU4ylHBM6q-vAeFfNYSoTGLUdGXHR2321oO51_YUgCiyc5Eq0uyv60eCR--xTRXa4Du8NTnk737dH9LJvuayGl5HPrjpOA8KVRCqRid20BYMveoGtp0oqMk-oIqk5IH2bMzOITsY9kw Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: dfa44fa2dc3c4df4bc34ff14deaf21ef Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ListServerFiltersTestJSON-1044949199 Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dfa44fa2dc3c4df4bc34ff14deaf21ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dfa44fa2dc3c4df4bc34ff14deaf21ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dfa44fa2dc3c4df4bc34ff14deaf21ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dfa44fa2dc3c4df4bc34ff14deaf21ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ListServerFiltersTestJSON-1044949199 Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: dfa44fa2dc3c4df4bc34ff14deaf21ef Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1044949199 Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ListServerFiltersTestJSON-1044949199-project Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 2825041f8aa2462f8719a0f124e0b8a0 Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ListServerFiltersTestJSON-1044949199-project Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 69a268a7-62f4-4ef2-b5ce-45469cba9c7a could not be found. Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '69a268a7-62f4-4ef2-b5ce-45469cba9c7a'} Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69a268a7-62f4-4ef2-b5ce-45469cba9c7a could not be found. Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69a268a7-62f4-4ef2-b5ce-45469cba9c7a could not be found. Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:55:10.905152 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:10.908626 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:10.908626 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:55:10.908626 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:55:10.908626 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:55:10.908626 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:55:10.908626 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69a268a7-62f4-4ef2-b5ce-45469cba9c7a could not be found. Oct 05 02:55:10.908626 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:10.908626 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-01462249-7769-424b-a11a-60c0084457a8 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Returning 404 to user: Instance 69a268a7-62f4-4ef2-b5ce-45469cba9c7a could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:55:10.908626 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-01462249-7769-424b-a11a-60c0084457a8 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a" status: 404 len: 111 microversion: 2.1 time: 0.035232 Oct 05 02:55:10.909830 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2672/5323] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:10 2022] GET /compute/v2.1/servers/69a268a7-62f4-4ef2-b5ce-45469cba9c7a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:55:10.915790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8a971a5f-e2fc-4561-8a9b-9d33199af25f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:10.916724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8a971a5f-e2fc-4561-8a9b-9d33199af25f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 318c0ef8-f225-43ef-984f-b5407fa92e1f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:10.923148 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a971a5f-e2fc-4561-8a9b-9d33199af25f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:10.923740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a971a5f-e2fc-4561-8a9b-9d33199af25f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:10.924275 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a971a5f-e2fc-4561-8a9b-9d33199af25f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:10.925132 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a971a5f-e2fc-4561-8a9b-9d33199af25f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:10.925688 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a971a5f-e2fc-4561-8a9b-9d33199af25f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:10.926210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a971a5f-e2fc-4561-8a9b-9d33199af25f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:10.960923 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8a971a5f-e2fc-4561-8a9b-9d33199af25f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 318c0ef8-f225-43ef-984f-b5407fa92e1f] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:55:11.044479 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8a971a5f-e2fc-4561-8a9b-9d33199af25f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "DELETE /compute/v2.1/servers/318c0ef8-f225-43ef-984f-b5407fa92e1f" status: 204 len: 0 microversion: 2.1 time: 0.131860 Oct 05 02:55:11.048455 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2652/5324] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:55:10 2022] DELETE /compute/v2.1/servers/318c0ef8-f225-43ef-984f-b5407fa92e1f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 02:55:11.054649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8ba6676b-d547-406c-8d39-c1642b503134 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:11.055428 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8ba6676b-d547-406c-8d39-c1642b503134 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 318c0ef8-f225-43ef-984f-b5407fa92e1f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:11.063223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ba6676b-d547-406c-8d39-c1642b503134 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:11.063717 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ba6676b-d547-406c-8d39-c1642b503134 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:11.064269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ba6676b-d547-406c-8d39-c1642b503134 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:11.065132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ba6676b-d547-406c-8d39-c1642b503134 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:11.066426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ba6676b-d547-406c-8d39-c1642b503134 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:11.067155 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ba6676b-d547-406c-8d39-c1642b503134 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:11.193842 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-27f85ca6-5590-4b6f-99b4-607645d6196d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:11.194809 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-27f85ca6-5590-4b6f-99b4-607645d6196d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:11.201830 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27f85ca6-5590-4b6f-99b4-607645d6196d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:11.203183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27f85ca6-5590-4b6f-99b4-607645d6196d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:11.203794 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27f85ca6-5590-4b6f-99b4-607645d6196d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:11.204715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27f85ca6-5590-4b6f-99b4-607645d6196d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:11.205520 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27f85ca6-5590-4b6f-99b4-607645d6196d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:11.206130 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-27f85ca6-5590-4b6f-99b4-607645d6196d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:11.224572 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8ba6676b-d547-406c-8d39-c1642b503134 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:11.236342 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8ba6676b-d547-406c-8d39-c1642b503134 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/318c0ef8-f225-43ef-984f-b5407fa92e1f" status: 200 len: 1518 microversion: 2.1 time: 0.186218 Oct 05 02:55:11.238445 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2673/5325] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:11 2022] GET /compute/v2.1/servers/318c0ef8-f225-43ef-984f-b5407fa92e1f => generated 1518 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:11.356451 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-27f85ca6-5590-4b6f-99b4-607645d6196d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:11.365991 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-27f85ca6-5590-4b6f-99b4-607645d6196d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1501 microversion: 2.1 time: 0.176927 Oct 05 02:55:11.366584 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2653/5326] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:11 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1501 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:55:12.261495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b40d4a4f-e2d7-4148-b136-ef10521d3be2 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:12.262113 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b40d4a4f-e2d7-4148-b136-ef10521d3be2 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 318c0ef8-f225-43ef-984f-b5407fa92e1f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:12.269797 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b40d4a4f-e2d7-4148-b136-ef10521d3be2 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:12.270287 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b40d4a4f-e2d7-4148-b136-ef10521d3be2 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:12.270723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b40d4a4f-e2d7-4148-b136-ef10521d3be2 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:12.271418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b40d4a4f-e2d7-4148-b136-ef10521d3be2 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:12.271873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b40d4a4f-e2d7-4148-b136-ef10521d3be2 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:12.272305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b40d4a4f-e2d7-4148-b136-ef10521d3be2 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:12.391091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-55195a58-c0ff-47a7-b861-020418b00791 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:12.391716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-55195a58-c0ff-47a7-b861-020418b00791 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:12.401800 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55195a58-c0ff-47a7-b861-020418b00791 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:12.402306 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55195a58-c0ff-47a7-b861-020418b00791 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:12.403496 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55195a58-c0ff-47a7-b861-020418b00791 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:12.404286 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55195a58-c0ff-47a7-b861-020418b00791 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:12.404758 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55195a58-c0ff-47a7-b861-020418b00791 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:12.405232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-55195a58-c0ff-47a7-b861-020418b00791 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:12.423247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b40d4a4f-e2d7-4148-b136-ef10521d3be2 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:12.434256 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b40d4a4f-e2d7-4148-b136-ef10521d3be2 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/318c0ef8-f225-43ef-984f-b5407fa92e1f" status: 200 len: 1518 microversion: 2.1 time: 0.176592 Oct 05 02:55:12.435002 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2674/5327] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:12 2022] GET /compute/v2.1/servers/318c0ef8-f225-43ef-984f-b5407fa92e1f => generated 1518 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:12.570344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-55195a58-c0ff-47a7-b861-020418b00791 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:12.582504 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-55195a58-c0ff-47a7-b861-020418b00791 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.194187 Oct 05 02:55:12.582504 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2654/5328] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:12 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:55:12.607451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6159df36-e473-47f3-b569-6c28a6faf8c0 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:12.608086 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6159df36-e473-47f3-b569-6c28a6faf8c0 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:12.618784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6159df36-e473-47f3-b569-6c28a6faf8c0 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:12.619285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6159df36-e473-47f3-b569-6c28a6faf8c0 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:12.619956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6159df36-e473-47f3-b569-6c28a6faf8c0 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:12.625355 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6159df36-e473-47f3-b569-6c28a6faf8c0 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:12.625850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6159df36-e473-47f3-b569-6c28a6faf8c0 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:12.626291 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6159df36-e473-47f3-b569-6c28a6faf8c0 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:12.777120 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6159df36-e473-47f3-b569-6c28a6faf8c0 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:12.786166 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6159df36-e473-47f3-b569-6c28a6faf8c0 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.182932 Oct 05 02:55:12.787205 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2675/5329] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:12 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:12.808942 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a61586ba-6d60-4fd4-adaa-668fbbcb9ed0 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:55:12.809624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a61586ba-6d60-4fd4-adaa-668fbbcb9ed0 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 2dfd2078-1216-4621-b19e-cfd8c4a7365e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:12.815568 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-a61586ba-6d60-4fd4-adaa-668fbbcb9ed0 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Instance 2dfd2078-1216-4621-b19e-cfd8c4a7365e could not be found. Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a61586ba-6d60-4fd4-adaa-668fbbcb9ed0 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers/2dfd2078-1216-4621-b19e-cfd8c4a7365e/action HTTP/1.1 Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 15 Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: {"unpause": {}} Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 2dfd2078-1216-4621-b19e-cfd8c4a7365e could not be found. Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '2dfd2078-1216-4621-b19e-cfd8c4a7365e', 'body': {'unpause': {}}} Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dfd2078-1216-4621-b19e-cfd8c4a7365e could not be found. Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dfd2078-1216-4621-b19e-cfd8c4a7365e could not be found. Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:55:12.817441 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:55:12.821969 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:55:12.821969 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:55:12.821969 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dfd2078-1216-4621-b19e-cfd8c4a7365e could not be found. Oct 05 02:55:12.821969 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:12.821969 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a61586ba-6d60-4fd4-adaa-668fbbcb9ed0 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 404 to user: Instance 2dfd2078-1216-4621-b19e-cfd8c4a7365e could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:55:12.825132 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a61586ba-6d60-4fd4-adaa-668fbbcb9ed0 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers/2dfd2078-1216-4621-b19e-cfd8c4a7365e/action" status: 404 len: 111 microversion: 2.1 time: 0.018470 Oct 05 02:55:12.829969 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2655/5330] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:55:12 2022] POST /compute/v2.1/servers/2dfd2078-1216-4621-b19e-cfd8c4a7365e/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:55:12.835582 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9111f9ef-3580-48db-911c-e43955e25f88 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:12.836726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9111f9ef-3580-48db-911c-e43955e25f88 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:12.847697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9111f9ef-3580-48db-911c-e43955e25f88 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:12.848488 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9111f9ef-3580-48db-911c-e43955e25f88 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:12.849172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9111f9ef-3580-48db-911c-e43955e25f88 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:12.850083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9111f9ef-3580-48db-911c-e43955e25f88 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:12.851330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9111f9ef-3580-48db-911c-e43955e25f88 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:12.851963 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9111f9ef-3580-48db-911c-e43955e25f88 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:13.129404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9111f9ef-3580-48db-911c-e43955e25f88 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:13.138826 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9111f9ef-3580-48db-911c-e43955e25f88 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.307625 Oct 05 02:55:13.139407 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2676/5331] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:12 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:13.162910 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-eeb84d42-c643-4994-b577-5a16177318fb tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:13.163752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-eeb84d42-c643-4994-b577-5a16177318fb tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:13.174969 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eeb84d42-c643-4994-b577-5a16177318fb tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:13.176498 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eeb84d42-c643-4994-b577-5a16177318fb tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:13.177095 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eeb84d42-c643-4994-b577-5a16177318fb tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:13.178057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eeb84d42-c643-4994-b577-5a16177318fb tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:13.178613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eeb84d42-c643-4994-b577-5a16177318fb tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:13.179221 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eeb84d42-c643-4994-b577-5a16177318fb tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:13.390802 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-eeb84d42-c643-4994-b577-5a16177318fb tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:13.410800 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-eeb84d42-c643-4994-b577-5a16177318fb tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.252346 Oct 05 02:55:13.412646 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2656/5332] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:13 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:13.434164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8fab6473-1c63-4074-a983-1f13d5dd0bf1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:55:13.435264 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8fab6473-1c63-4074-a983-1f13d5dd0bf1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:13.439658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:13.444225 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8fab6473-1c63-4074-a983-1f13d5dd0bf1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:13.444715 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8fab6473-1c63-4074-a983-1f13d5dd0bf1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:13.445147 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8fab6473-1c63-4074-a983-1f13d5dd0bf1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:13.446010 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8fab6473-1c63-4074-a983-1f13d5dd0bf1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:13.446609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8fab6473-1c63-4074-a983-1f13d5dd0bf1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:13.447177 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8fab6473-1c63-4074-a983-1f13d5dd0bf1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:13.459543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ce79741e-ee01-427e-b1be-aab9de5a0e78 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:13.461872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ce79741e-ee01-427e-b1be-aab9de5a0e78 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 318c0ef8-f225-43ef-984f-b5407fa92e1f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:13.475334 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-8fab6473-1c63-4074-a983-1f13d5dd0bf1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Cannot 'unpause' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state active Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8fab6473-1c63-4074-a983-1f13d5dd0bf1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec/action HTTP/1.1 Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 15 Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: {"unpause": {}} Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: exception: Cannot 'unpause' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state active Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '1fded3d6-d275-4d50-a366-d19388f8aaec', 'body': {'unpause': {}}} Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1fded3d6-d275-4d50-a366-d19388f8aaec in vm_state active. Cannot unpause while the instance is in this state. Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state active Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:13.477308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:55:13.483082 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:55:13.483082 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:55:13.483082 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:55:13.483082 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state active Oct 05 02:55:13.483082 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:13.483082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8fab6473-1c63-4074-a983-1f13d5dd0bf1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 409 to user: Cannot 'unpause' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state active {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:55:13.483082 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8fab6473-1c63-4074-a983-1f13d5dd0bf1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec/action" status: 409 len: 145 microversion: 2.1 time: 0.048741 Oct 05 02:55:13.483082 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2677/5333] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:55:13 2022] POST /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec/action => generated 145 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:55:13.488761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f3b2a229-ab66-442e-aa01-e82aef9a2f1f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:13.489396 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f3b2a229-ab66-442e-aa01-e82aef9a2f1f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:13.496540 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3b2a229-ab66-442e-aa01-e82aef9a2f1f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:13.497070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3b2a229-ab66-442e-aa01-e82aef9a2f1f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:13.497693 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3b2a229-ab66-442e-aa01-e82aef9a2f1f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:13.499159 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3b2a229-ab66-442e-aa01-e82aef9a2f1f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:13.499812 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3b2a229-ab66-442e-aa01-e82aef9a2f1f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:13.499932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce79741e-ee01-427e-b1be-aab9de5a0e78 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:13.500489 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3b2a229-ab66-442e-aa01-e82aef9a2f1f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:13.501344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce79741e-ee01-427e-b1be-aab9de5a0e78 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:13.501913 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce79741e-ee01-427e-b1be-aab9de5a0e78 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:13.503104 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce79741e-ee01-427e-b1be-aab9de5a0e78 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:13.510778 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce79741e-ee01-427e-b1be-aab9de5a0e78 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:13.511614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce79741e-ee01-427e-b1be-aab9de5a0e78 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:13.700524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ce79741e-ee01-427e-b1be-aab9de5a0e78 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:13.709402 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ce79741e-ee01-427e-b1be-aab9de5a0e78 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/318c0ef8-f225-43ef-984f-b5407fa92e1f" status: 200 len: 1476 microversion: 2.1 time: 0.253853 Oct 05 02:55:13.726730 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2657/5334] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:13 2022] GET /compute/v2.1/servers/318c0ef8-f225-43ef-984f-b5407fa92e1f => generated 1476 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:13.726730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-4563aa11-b110-41b4-81f6-0dd0976f1d7b req-387352bc-fdca-43ab-96b4-6de9443c4a76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "318c0ef8-f225-43ef-984f-b5407fa92e1f", "name": "network-vif-deleted", "tag": "bad51ab7-5ef6-467a-a3e8-d282c09f2e0c"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:55:13.751909 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4563aa11-b110-41b4-81f6-0dd0976f1d7b req-387352bc-fdca-43ab-96b4-6de9443c4a76 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:13.752398 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4563aa11-b110-41b4-81f6-0dd0976f1d7b req-387352bc-fdca-43ab-96b4-6de9443c4a76 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:13.753139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4563aa11-b110-41b4-81f6-0dd0976f1d7b req-387352bc-fdca-43ab-96b4-6de9443c4a76 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:13.778808 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-4563aa11-b110-41b4-81f6-0dd0976f1d7b req-387352bc-fdca-43ab-96b4-6de9443c4a76 service nova] Creating event network-vif-deleted:bad51ab7-5ef6-467a-a3e8-d282c09f2e0c for instance 318c0ef8-f225-43ef-984f-b5407fa92e1f on n-h1-858272-3 Oct 05 02:55:13.791173 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-4563aa11-b110-41b4-81f6-0dd0976f1d7b req-387352bc-fdca-43ab-96b4-6de9443c4a76 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072474 Oct 05 02:55:13.795619 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2658/5335] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:55:13.828794 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f3b2a229-ab66-442e-aa01-e82aef9a2f1f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:13.839326 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f3b2a229-ab66-442e-aa01-e82aef9a2f1f tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.355065 Oct 05 02:55:13.840450 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2678/5336] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:13 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:13.891577 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6f0a8e0e-fab4-4d94-bc27-500792ac0ff4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:13.895044 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6f0a8e0e-fab4-4d94-bc27-500792ac0ff4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:13.904967 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:13.923506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f0a8e0e-fab4-4d94-bc27-500792ac0ff4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:13.924555 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f0a8e0e-fab4-4d94-bc27-500792ac0ff4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:13.925860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f0a8e0e-fab4-4d94-bc27-500792ac0ff4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:13.933017 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f0a8e0e-fab4-4d94-bc27-500792ac0ff4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:13.933538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f0a8e0e-fab4-4d94-bc27-500792ac0ff4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:13.934025 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f0a8e0e-fab4-4d94-bc27-500792ac0ff4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:14.155467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6f0a8e0e-fab4-4d94-bc27-500792ac0ff4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:14.166814 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6f0a8e0e-fab4-4d94-bc27-500792ac0ff4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.296525 Oct 05 02:55:14.181878 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2659/5337] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:13 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:14.191935 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1bfec406-f267-47d5-ace6-c585cde63410 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:55:14.192555 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1bfec406-f267-47d5-ace6-c585cde63410 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 3b82eefd-5b2d-4999-8d03-cb7ec8e7fb75] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:14.199346 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-1bfec406-f267-47d5-ace6-c585cde63410 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Instance 3b82eefd-5b2d-4999-8d03-cb7ec8e7fb75 could not be found. Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1bfec406-f267-47d5-ace6-c585cde63410 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers/3b82eefd-5b2d-4999-8d03-cb7ec8e7fb75/action HTTP/1.1 Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 18 Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: {"unshelve": null} Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 3b82eefd-5b2d-4999-8d03-cb7ec8e7fb75 could not be found. Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '3b82eefd-5b2d-4999-8d03-cb7ec8e7fb75', 'body': {'unshelve': None}} Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b82eefd-5b2d-4999-8d03-cb7ec8e7fb75 could not be found. Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b82eefd-5b2d-4999-8d03-cb7ec8e7fb75 could not be found. Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:14.200970 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:55:14.204956 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:14.204956 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:14.204956 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:55:14.204956 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:55:14.204956 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:55:14.204956 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:55:14.204956 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b82eefd-5b2d-4999-8d03-cb7ec8e7fb75 could not be found. Oct 05 02:55:14.204956 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:14.204956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1bfec406-f267-47d5-ace6-c585cde63410 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 404 to user: Instance 3b82eefd-5b2d-4999-8d03-cb7ec8e7fb75 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:55:14.204956 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1bfec406-f267-47d5-ace6-c585cde63410 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers/3b82eefd-5b2d-4999-8d03-cb7ec8e7fb75/action" status: 404 len: 111 microversion: 2.1 time: 0.015924 Oct 05 02:55:14.226004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-42d50726-8234-4073-8645-74a9c46dca3c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:14.226645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-42d50726-8234-4073-8645-74a9c46dca3c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:14.232498 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2679/5338] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:55:14 2022] POST /compute/v2.1/servers/3b82eefd-5b2d-4999-8d03-cb7ec8e7fb75/action => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:55:14.240828 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42d50726-8234-4073-8645-74a9c46dca3c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:14.241383 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42d50726-8234-4073-8645-74a9c46dca3c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:14.241834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42d50726-8234-4073-8645-74a9c46dca3c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:14.242557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42d50726-8234-4073-8645-74a9c46dca3c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:14.243054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42d50726-8234-4073-8645-74a9c46dca3c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:14.245188 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42d50726-8234-4073-8645-74a9c46dca3c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:14.419107 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-42d50726-8234-4073-8645-74a9c46dca3c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:14.428559 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-42d50726-8234-4073-8645-74a9c46dca3c tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.220202 Oct 05 02:55:14.451596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e16d5177-14d8-4709-a81a-7384d86aff31 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:14.452748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e16d5177-14d8-4709-a81a-7384d86aff31 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:14.455594 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:14.460878 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2660/5339] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:14 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:14.465414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e16d5177-14d8-4709-a81a-7384d86aff31 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:14.466203 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e16d5177-14d8-4709-a81a-7384d86aff31 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:14.466854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e16d5177-14d8-4709-a81a-7384d86aff31 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:14.467931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e16d5177-14d8-4709-a81a-7384d86aff31 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:14.468595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e16d5177-14d8-4709-a81a-7384d86aff31 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:14.469295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e16d5177-14d8-4709-a81a-7384d86aff31 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:14.629452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e16d5177-14d8-4709-a81a-7384d86aff31 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:14.637820 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e16d5177-14d8-4709-a81a-7384d86aff31 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.190056 Oct 05 02:55:14.638395 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2680/5340] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:14 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:14.664006 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5c121578-f800-422d-ab38-b441bbbb0bec tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:55:14.664827 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5c121578-f800-422d-ab38-b441bbbb0bec tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:14.677075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c121578-f800-422d-ab38-b441bbbb0bec tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:14.677623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c121578-f800-422d-ab38-b441bbbb0bec tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:14.678066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c121578-f800-422d-ab38-b441bbbb0bec tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:14.678774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c121578-f800-422d-ab38-b441bbbb0bec tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:14.679226 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c121578-f800-422d-ab38-b441bbbb0bec tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:14.679864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c121578-f800-422d-ab38-b441bbbb0bec tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:14.728488 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-5c121578-f800-422d-ab38-b441bbbb0bec tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Cannot 'unshelve' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state active Oct 05 02:55:14.733614 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-610561dd-4105-43c5-b96b-fa1dc7d09edb tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:14.734233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-610561dd-4105-43c5-b96b-fa1dc7d09edb tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: 318c0ef8-f225-43ef-984f-b5407fa92e1f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5c121578-f800-422d-ab38-b441bbbb0bec tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec/action HTTP/1.1 Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 18 Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: {"unshelve": null} Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: exception: Cannot 'unshelve' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state active Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '1fded3d6-d275-4d50-a366-d19388f8aaec', 'body': {'unshelve': None}} Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1fded3d6-d275-4d50-a366-d19388f8aaec in vm_state active. Cannot unshelve while the instance is in this state. Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 05 02:55:14.735126 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 02:55:14.739410 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state active Oct 05 02:55:14.739410 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:14.739410 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:55:14.739410 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:14.739410 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:14.739410 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:55:14.739410 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:55:14.739410 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:55:14.739410 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:55:14.739410 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state active Oct 05 02:55:14.739410 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:14.741137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-610561dd-4105-43c5-b96b-fa1dc7d09edb tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:14.741630 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-610561dd-4105-43c5-b96b-fa1dc7d09edb tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:14.741860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5c121578-f800-422d-ab38-b441bbbb0bec tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 409 to user: Cannot 'unshelve' instance 1fded3d6-d275-4d50-a366-d19388f8aaec while it is in vm_state active {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:55:14.742070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-610561dd-4105-43c5-b96b-fa1dc7d09edb tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:14.742763 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-610561dd-4105-43c5-b96b-fa1dc7d09edb tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:14.743221 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-610561dd-4105-43c5-b96b-fa1dc7d09edb tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:14.743620 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5c121578-f800-422d-ab38-b441bbbb0bec tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "POST /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec/action" status: 409 len: 146 microversion: 2.1 time: 0.084004 Oct 05 02:55:14.743724 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-610561dd-4105-43c5-b96b-fa1dc7d09edb tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:14.744793 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2661/5341] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:55:14 2022] POST /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec/action => generated 146 bytes in 86 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:55:14.754196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-821e421b-4e34-4352-aa8b-2744c1d6cb90 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:14.755228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-821e421b-4e34-4352-aa8b-2744c1d6cb90 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:14.764268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-821e421b-4e34-4352-aa8b-2744c1d6cb90 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:14.764847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-821e421b-4e34-4352-aa8b-2744c1d6cb90 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:14.765563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-821e421b-4e34-4352-aa8b-2744c1d6cb90 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:14.766335 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-821e421b-4e34-4352-aa8b-2744c1d6cb90 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:14.767273 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-821e421b-4e34-4352-aa8b-2744c1d6cb90 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:14.768276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-821e421b-4e34-4352-aa8b-2744c1d6cb90 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:14.773817 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-610561dd-4105-43c5-b96b-fa1dc7d09edb tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] HTTP exception thrown: Instance 318c0ef8-f225-43ef-984f-b5407fa92e1f could not be found. Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-610561dd-4105-43c5-b96b-fa1dc7d09edb tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Request method failure captured: Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/318c0ef8-f225-43ef-984f-b5407fa92e1f HTTP/1.1 Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPHH_Ix-WbUXYIyq0tVAY2bw3XjHuoujau_RaU4ylHBM6q-vAeFfNYSoTGLUdGXHR2321oO51_YUgCiyc5Eq0uyv60eCR--xTRXa4Du8NTnk737dH9LJvuayGl5HPrjpOA8KVRCqRid20BYMveoGtp0oqMk-oIqk5IH2bMzOITsY9kw Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: dfa44fa2dc3c4df4bc34ff14deaf21ef Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ListServerFiltersTestJSON-1044949199 Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dfa44fa2dc3c4df4bc34ff14deaf21ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dfa44fa2dc3c4df4bc34ff14deaf21ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dfa44fa2dc3c4df4bc34ff14deaf21ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dfa44fa2dc3c4df4bc34ff14deaf21ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ListServerFiltersTestJSON-1044949199 Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: dfa44fa2dc3c4df4bc34ff14deaf21ef Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1044949199 Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ListServerFiltersTestJSON-1044949199-project Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 2825041f8aa2462f8719a0f124e0b8a0 Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ListServerFiltersTestJSON-1044949199-project Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 318c0ef8-f225-43ef-984f-b5407fa92e1f could not be found. Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '318c0ef8-f225-43ef-984f-b5407fa92e1f'} Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 318c0ef8-f225-43ef-984f-b5407fa92e1f could not be found. Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 318c0ef8-f225-43ef-984f-b5407fa92e1f could not be found. Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:55:14.775432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:14.779160 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:14.779160 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:55:14.779160 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:55:14.779160 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:55:14.779160 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:55:14.779160 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 318c0ef8-f225-43ef-984f-b5407fa92e1f could not be found. Oct 05 02:55:14.779160 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:14.779160 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-610561dd-4105-43c5-b96b-fa1dc7d09edb tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Returning 404 to user: Instance 318c0ef8-f225-43ef-984f-b5407fa92e1f could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:55:14.779160 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-610561dd-4105-43c5-b96b-fa1dc7d09edb tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/318c0ef8-f225-43ef-984f-b5407fa92e1f" status: 404 len: 111 microversion: 2.1 time: 0.047065 Oct 05 02:55:14.782195 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2681/5342] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:14 2022] GET /compute/v2.1/servers/318c0ef8-f225-43ef-984f-b5407fa92e1f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:55:14.789737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ef2f5fd0-fe46-40ce-b2aa-e36b5d9909e4 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:14.790239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ef2f5fd0-fe46-40ce-b2aa-e36b5d9909e4 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: d39cd597-890f-4cc8-8d05-9a1b65f9ab32] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:14.797749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef2f5fd0-fe46-40ce-b2aa-e36b5d9909e4 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:14.798318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef2f5fd0-fe46-40ce-b2aa-e36b5d9909e4 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:14.798762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef2f5fd0-fe46-40ce-b2aa-e36b5d9909e4 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:14.800014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef2f5fd0-fe46-40ce-b2aa-e36b5d9909e4 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:14.800483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef2f5fd0-fe46-40ce-b2aa-e36b5d9909e4 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:14.800981 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef2f5fd0-fe46-40ce-b2aa-e36b5d9909e4 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:14.832935 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ef2f5fd0-fe46-40ce-b2aa-e36b5d9909e4 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: d39cd597-890f-4cc8-8d05-9a1b65f9ab32] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:55:14.939250 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ef2f5fd0-fe46-40ce-b2aa-e36b5d9909e4 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32" status: 204 len: 0 microversion: 2.1 time: 0.155579 Oct 05 02:55:14.939830 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2682/5343] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:55:14 2022] DELETE /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:55:14.966123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6c5c54d5-f0ec-4c04-9ce0-f8ade1b094f0 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:14.969719 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6c5c54d5-f0ec-4c04-9ce0-f8ade1b094f0 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: d39cd597-890f-4cc8-8d05-9a1b65f9ab32] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:14.976242 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-821e421b-4e34-4352-aa8b-2744c1d6cb90 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:14.977891 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c5c54d5-f0ec-4c04-9ce0-f8ade1b094f0 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:14.978845 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c5c54d5-f0ec-4c04-9ce0-f8ade1b094f0 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:14.985279 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-821e421b-4e34-4352-aa8b-2744c1d6cb90 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.236022 Oct 05 02:55:14.985835 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2662/5344] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:14 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:14.990312 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c5c54d5-f0ec-4c04-9ce0-f8ade1b094f0 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:14.991266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c5c54d5-f0ec-4c04-9ce0-f8ade1b094f0 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:14.991879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c5c54d5-f0ec-4c04-9ce0-f8ade1b094f0 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:14.993100 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c5c54d5-f0ec-4c04-9ce0-f8ade1b094f0 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:15.012419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-52560e74-b167-4a9f-9f47-32342035a3b5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:15.013082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-52560e74-b167-4a9f-9f47-32342035a3b5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:15.021874 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52560e74-b167-4a9f-9f47-32342035a3b5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:15.022371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52560e74-b167-4a9f-9f47-32342035a3b5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:15.022975 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52560e74-b167-4a9f-9f47-32342035a3b5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:15.023831 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52560e74-b167-4a9f-9f47-32342035a3b5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:15.024722 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52560e74-b167-4a9f-9f47-32342035a3b5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:15.025320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52560e74-b167-4a9f-9f47-32342035a3b5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:15.218540 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6c5c54d5-f0ec-4c04-9ce0-f8ade1b094f0 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:15.227274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-52560e74-b167-4a9f-9f47-32342035a3b5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:15.238977 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6c5c54d5-f0ec-4c04-9ce0-f8ade1b094f0 tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32" status: 200 len: 1517 microversion: 2.1 time: 0.292723 Oct 05 02:55:15.243483 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-52560e74-b167-4a9f-9f47-32342035a3b5 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.235700 Oct 05 02:55:15.244662 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2683/5345] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:14 2022] GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32 => generated 1517 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:15.245688 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2663/5346] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:15 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:15.273958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-72fe6453-cb9d-4ea6-a979-6b0cf16145e1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1365105573_updated"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:55:15.281130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-72fe6453-cb9d-4ea6-a979-6b0cf16145e1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 86b8dc98-0284-47a6-8bda-90335ac86c34] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-72fe6453-cb9d-4ea6-a979-6b0cf16145e1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Instance 86b8dc98-0284-47a6-8bda-90335ac86c34 could not be found. Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-72fe6453-cb9d-4ea6-a979-6b0cf16145e1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: request: PUT /compute/v2.1/servers/86b8dc98-0284-47a6-8bda-90335ac86c34 HTTP/1.1 Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 81 Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1365105573_updated"}} Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 86b8dc98-0284-47a6-8bda-90335ac86c34 could not be found. Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '86b8dc98-0284-47a6-8bda-90335ac86c34', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1365105573_updated'}}} Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86b8dc98-0284-47a6-8bda-90335ac86c34 could not be found. Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:55:15.292649 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 05 02:55:15.301439 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 05 02:55:15.301439 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 05 02:55:15.301439 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:55:15.301439 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:55:15.301439 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:55:15.301439 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:55:15.301439 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86b8dc98-0284-47a6-8bda-90335ac86c34 could not be found. Oct 05 02:55:15.301439 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:15.301439 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:55:15.301439 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:15.301439 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:15.301439 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:55:15.301439 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:55:15.301439 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:55:15.301439 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:55:15.301439 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86b8dc98-0284-47a6-8bda-90335ac86c34 could not be found. Oct 05 02:55:15.301439 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:15.301439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-72fe6453-cb9d-4ea6-a979-6b0cf16145e1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 404 to user: Instance 86b8dc98-0284-47a6-8bda-90335ac86c34 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:55:15.301439 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-72fe6453-cb9d-4ea6-a979-6b0cf16145e1 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "PUT /compute/v2.1/servers/86b8dc98-0284-47a6-8bda-90335ac86c34" status: 404 len: 111 microversion: 2.1 time: 0.023325 Oct 05 02:55:15.301439 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2684/5347] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Oct 5 02:55:15 2022] PUT /compute/v2.1/servers/86b8dc98-0284-47a6-8bda-90335ac86c34 => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:55:15.310783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e87e590c-9911-46ce-82f4-fbbc216608d3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:15.311825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e87e590c-9911-46ce-82f4-fbbc216608d3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:15.320399 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e87e590c-9911-46ce-82f4-fbbc216608d3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:15.321158 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e87e590c-9911-46ce-82f4-fbbc216608d3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:15.321742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e87e590c-9911-46ce-82f4-fbbc216608d3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:15.322519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e87e590c-9911-46ce-82f4-fbbc216608d3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:15.323060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e87e590c-9911-46ce-82f4-fbbc216608d3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:15.323557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e87e590c-9911-46ce-82f4-fbbc216608d3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:15.519418 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e87e590c-9911-46ce-82f4-fbbc216608d3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:15.527509 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e87e590c-9911-46ce-82f4-fbbc216608d3 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.221797 Oct 05 02:55:15.528241 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2664/5348] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:15 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:15.551974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-15a13aec-0012-4111-ad58-6b943ee67955 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:15.552681 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-15a13aec-0012-4111-ad58-6b943ee67955 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:15.560605 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15a13aec-0012-4111-ad58-6b943ee67955 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:15.561489 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15a13aec-0012-4111-ad58-6b943ee67955 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:15.562065 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15a13aec-0012-4111-ad58-6b943ee67955 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:15.562904 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15a13aec-0012-4111-ad58-6b943ee67955 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:15.563492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15a13aec-0012-4111-ad58-6b943ee67955 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:15.564189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15a13aec-0012-4111-ad58-6b943ee67955 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:15.772866 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-15a13aec-0012-4111-ad58-6b943ee67955 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:15.781570 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-15a13aec-0012-4111-ad58-6b943ee67955 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.234017 Oct 05 02:55:15.782187 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2685/5349] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:15 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:15.808639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4f8cea14-e7f8-4c41-80b7-0abcc58a2f07 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4f8cea14-e7f8-4c41-80b7-0abcc58a2f07 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: request: PUT /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec HTTP/1.1 Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 280 Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '1fded3d6-d275-4d50-a366-d19388f8aaec', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:15.822633 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:15.825670 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:55:15.825670 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:55:15.825670 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:55:15.825670 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:55:15.825670 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:55:15.825670 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:55:15.825670 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:55:15.825670 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:55:15.825670 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 02:55:15.825670 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 02:55:15.825670 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:55:15.825670 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:55:15.825670 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:55:15.825670 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:55:15.825670 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 02:55:15.825670 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:15.825670 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:55:15.825670 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:15.825670 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:15.825670 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:55:15.825670 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:55:15.825670 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:55:15.825670 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:55:15.825670 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 02:55:15.825670 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:15.825670 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4f8cea14-e7f8-4c41-80b7-0abcc58a2f07 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:55:15.825670 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4f8cea14-e7f8-4c41-80b7-0abcc58a2f07 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "PUT /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 400 len: 619 microversion: 2.1 time: 0.021190 Oct 05 02:55:15.828665 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2665/5350] 10.222.0.16 () {60 vars in 1257 bytes} [Wed Oct 5 02:55:15 2022] PUT /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 619 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:55:15.834379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b7be707f-34f3-43b8-8216-8d837d24ea6b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:15.834997 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b7be707f-34f3-43b8-8216-8d837d24ea6b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:15.841222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7be707f-34f3-43b8-8216-8d837d24ea6b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:15.841692 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7be707f-34f3-43b8-8216-8d837d24ea6b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:15.842111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7be707f-34f3-43b8-8216-8d837d24ea6b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:15.842774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7be707f-34f3-43b8-8216-8d837d24ea6b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:15.843222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7be707f-34f3-43b8-8216-8d837d24ea6b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:15.843641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7be707f-34f3-43b8-8216-8d837d24ea6b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:16.006521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b7be707f-34f3-43b8-8216-8d837d24ea6b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:16.017017 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b7be707f-34f3-43b8-8216-8d837d24ea6b tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.187335 Oct 05 02:55:16.017680 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2686/5351] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:15 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:55:16.039795 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=16 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:16.045663 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c1553d7b-ef02-43e9-9ecb-91de02dd73f4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:16.046294 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c1553d7b-ef02-43e9-9ecb-91de02dd73f4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:16.055977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1553d7b-ef02-43e9-9ecb-91de02dd73f4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:16.056452 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1553d7b-ef02-43e9-9ecb-91de02dd73f4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:16.056940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1553d7b-ef02-43e9-9ecb-91de02dd73f4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:16.057636 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1553d7b-ef02-43e9-9ecb-91de02dd73f4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:16.058107 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1553d7b-ef02-43e9-9ecb-91de02dd73f4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:16.058541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1553d7b-ef02-43e9-9ecb-91de02dd73f4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:16.209471 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c1553d7b-ef02-43e9-9ecb-91de02dd73f4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:16.217746 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c1553d7b-ef02-43e9-9ecb-91de02dd73f4 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.179176 Oct 05 02:55:16.218570 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2666/5352] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:16 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:16.240562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-48b96f22-2853-4ea8-bd77-23493b406340 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-48b96f22-2853-4ea8-bd77-23493b406340 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: request: PUT /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec HTTP/1.1 Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 24 Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: {"server": {"name": ""}} Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '1fded3d6-d275-4d50-a366-d19388f8aaec', 'body': {'server': {'name': ''}}} Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise error Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi '' Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 02:55:16.244308 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 02:55:16.247838 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 05 02:55:16.247838 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:16.247838 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:55:16.247838 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:16.247838 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:16.247838 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:55:16.247838 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:55:16.247838 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 02:55:16.247838 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 02:55:16.247838 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 05 02:55:16.247838 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:16.247838 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-48b96f22-2853-4ea8-bd77-23493b406340 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:55:16.247838 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-48b96f22-2853-4ea8-bd77-23493b406340 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "PUT /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 400 len: 108 microversion: 2.1 time: 0.009331 Oct 05 02:55:16.249750 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2687/5353] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Oct 5 02:55:16 2022] PUT /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 108 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:55:16.255579 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-041ad934-30a7-4e5b-bffe-d4a2cf7a7b2d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:16.256460 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-041ad934-30a7-4e5b-bffe-d4a2cf7a7b2d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:16.263407 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-041ad934-30a7-4e5b-bffe-d4a2cf7a7b2d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:16.264063 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-041ad934-30a7-4e5b-bffe-d4a2cf7a7b2d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:16.265062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-041ad934-30a7-4e5b-bffe-d4a2cf7a7b2d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:16.265898 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-041ad934-30a7-4e5b-bffe-d4a2cf7a7b2d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:16.266506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-041ad934-30a7-4e5b-bffe-d4a2cf7a7b2d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:16.266998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-041ad934-30a7-4e5b-bffe-d4a2cf7a7b2d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:16.270972 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6e6f75e9-46e3-45d4-8042-25f59420565f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:16.272033 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6e6f75e9-46e3-45d4-8042-25f59420565f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: d39cd597-890f-4cc8-8d05-9a1b65f9ab32] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:16.279412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e6f75e9-46e3-45d4-8042-25f59420565f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:16.280180 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e6f75e9-46e3-45d4-8042-25f59420565f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:16.280893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e6f75e9-46e3-45d4-8042-25f59420565f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:16.282106 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e6f75e9-46e3-45d4-8042-25f59420565f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:16.282737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e6f75e9-46e3-45d4-8042-25f59420565f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:16.283465 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e6f75e9-46e3-45d4-8042-25f59420565f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:16.500752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-041ad934-30a7-4e5b-bffe-d4a2cf7a7b2d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:16.503079 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6e6f75e9-46e3-45d4-8042-25f59420565f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:16.505262 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:16.506840 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:16.511584 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-041ad934-30a7-4e5b-bffe-d4a2cf7a7b2d tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1504 microversion: 2.1 time: 0.260756 Oct 05 02:55:16.512313 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2667/5354] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:16 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1504 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:16.515573 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6e6f75e9-46e3-45d4-8042-25f59420565f tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32" status: 200 len: 1517 microversion: 2.1 time: 0.251302 Oct 05 02:55:16.516210 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2688/5355] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:16 2022] GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32 => generated 1517 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:17.541322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4949e236-f52c-44c8-ad67-5a166d34c1cc tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:17.542907 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4949e236-f52c-44c8-ad67-5a166d34c1cc tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: d39cd597-890f-4cc8-8d05-9a1b65f9ab32] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:17.557849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4949e236-f52c-44c8-ad67-5a166d34c1cc tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:17.559219 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4949e236-f52c-44c8-ad67-5a166d34c1cc tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:17.560045 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4949e236-f52c-44c8-ad67-5a166d34c1cc tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:17.561363 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4949e236-f52c-44c8-ad67-5a166d34c1cc tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:17.562051 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4949e236-f52c-44c8-ad67-5a166d34c1cc tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:17.563010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4949e236-f52c-44c8-ad67-5a166d34c1cc tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:17.864554 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4949e236-f52c-44c8-ad67-5a166d34c1cc tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2825041f8aa2462f8719a0f124e0b8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:17.875316 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4949e236-f52c-44c8-ad67-5a166d34c1cc tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32" status: 200 len: 1517 microversion: 2.1 time: 0.338494 Oct 05 02:55:17.876138 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2668/5356] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:17 2022] GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32 => generated 1517 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:18.032476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-971dca31-5a46-40f1-b210-3b0f44bfcc5e req-4c81be7c-57a9-4af3-9f37-abefecb2aa7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d39cd597-890f-4cc8-8d05-9a1b65f9ab32", "name": "network-vif-deleted", "tag": "84d22aa8-b04f-4c22-b0a2-3d56afad55c4"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:55:18.058930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-971dca31-5a46-40f1-b210-3b0f44bfcc5e req-4c81be7c-57a9-4af3-9f37-abefecb2aa7f service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:18.062379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-971dca31-5a46-40f1-b210-3b0f44bfcc5e req-4c81be7c-57a9-4af3-9f37-abefecb2aa7f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:18.079655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-971dca31-5a46-40f1-b210-3b0f44bfcc5e req-4c81be7c-57a9-4af3-9f37-abefecb2aa7f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:18.105050 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-971dca31-5a46-40f1-b210-3b0f44bfcc5e req-4c81be7c-57a9-4af3-9f37-abefecb2aa7f service nova] Creating event network-vif-deleted:84d22aa8-b04f-4c22-b0a2-3d56afad55c4 for instance d39cd597-890f-4cc8-8d05-9a1b65f9ab32 on n-h2-858272-3 Oct 05 02:55:18.113940 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-971dca31-5a46-40f1-b210-3b0f44bfcc5e req-4c81be7c-57a9-4af3-9f37-abefecb2aa7f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083588 Oct 05 02:55:18.132061 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2689/5357] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:55:18.913447 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-26df5745-bcf2-42d6-b7df-dc939bbbf86a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:18.914771 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-26df5745-bcf2-42d6-b7df-dc939bbbf86a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] [instance: d39cd597-890f-4cc8-8d05-9a1b65f9ab32] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:18.923212 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-26df5745-bcf2-42d6-b7df-dc939bbbf86a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:18.924019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-26df5745-bcf2-42d6-b7df-dc939bbbf86a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:18.924451 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-26df5745-bcf2-42d6-b7df-dc939bbbf86a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:18.927490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-26df5745-bcf2-42d6-b7df-dc939bbbf86a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:18.928118 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-26df5745-bcf2-42d6-b7df-dc939bbbf86a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:18.928760 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-26df5745-bcf2-42d6-b7df-dc939bbbf86a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:18.944708 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-26df5745-bcf2-42d6-b7df-dc939bbbf86a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] HTTP exception thrown: Instance d39cd597-890f-4cc8-8d05-9a1b65f9ab32 could not be found. Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-26df5745-bcf2-42d6-b7df-dc939bbbf86a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Request method failure captured: Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32 HTTP/1.1 Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPHH_Ix-WbUXYIyq0tVAY2bw3XjHuoujau_RaU4ylHBM6q-vAeFfNYSoTGLUdGXHR2321oO51_YUgCiyc5Eq0uyv60eCR--xTRXa4Du8NTnk737dH9LJvuayGl5HPrjpOA8KVRCqRid20BYMveoGtp0oqMk-oIqk5IH2bMzOITsY9kw Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: dfa44fa2dc3c4df4bc34ff14deaf21ef Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ListServerFiltersTestJSON-1044949199 Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dfa44fa2dc3c4df4bc34ff14deaf21ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dfa44fa2dc3c4df4bc34ff14deaf21ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dfa44fa2dc3c4df4bc34ff14deaf21ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dfa44fa2dc3c4df4bc34ff14deaf21ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ListServerFiltersTestJSON-1044949199 Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: dfa44fa2dc3c4df4bc34ff14deaf21ef Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1044949199 Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ListServerFiltersTestJSON-1044949199-project Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 2825041f8aa2462f8719a0f124e0b8a0 Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ListServerFiltersTestJSON-1044949199-project Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance d39cd597-890f-4cc8-8d05-9a1b65f9ab32 could not be found. Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'd39cd597-890f-4cc8-8d05-9a1b65f9ab32'} Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d39cd597-890f-4cc8-8d05-9a1b65f9ab32 could not be found. Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d39cd597-890f-4cc8-8d05-9a1b65f9ab32 could not be found. Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:55:18.946411 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:18.950121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:18.950121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:55:18.950121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:55:18.950121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:55:18.950121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:55:18.950121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d39cd597-890f-4cc8-8d05-9a1b65f9ab32 could not be found. Oct 05 02:55:18.950121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:18.950121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-26df5745-bcf2-42d6-b7df-dc939bbbf86a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] Returning 404 to user: Instance d39cd597-890f-4cc8-8d05-9a1b65f9ab32 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:55:18.950121 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-26df5745-bcf2-42d6-b7df-dc939bbbf86a tempest-ListServerFiltersTestJSON-1044949199 tempest-ListServerFiltersTestJSON-1044949199-project] 10.222.0.16 "GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32" status: 404 len: 111 microversion: 2.1 time: 0.041989 Oct 05 02:55:18.950121 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2669/5358] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:18 2022] GET /compute/v2.1/servers/d39cd597-890f-4cc8-8d05-9a1b65f9ab32 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:55:22.676465 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ef54adcc-5467-4d8e-86f7-a2d867258ffb tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1963441033", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": "none"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:55:22.762490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-ef54adcc-5467-4d8e-86f7-a2d867258ffb tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:55:22.763102 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-ef54adcc-5467-4d8e-86f7-a2d867258ffb tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:55:22.763751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-ef54adcc-5467-4d8e-86f7-a2d867258ffb tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:55:22.764154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-ef54adcc-5467-4d8e-86f7-a2d867258ffb tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:55:22.764815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-ef54adcc-5467-4d8e-86f7-a2d867258ffb tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:55:22.775039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef54adcc-5467-4d8e-86f7-a2d867258ffb tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:22.775419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef54adcc-5467-4d8e-86f7-a2d867258ffb tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:22.775854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef54adcc-5467-4d8e-86f7-a2d867258ffb tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:22.776583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef54adcc-5467-4d8e-86f7-a2d867258ffb tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:22.777179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef54adcc-5467-4d8e-86f7-a2d867258ffb tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:22.777605 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef54adcc-5467-4d8e-86f7-a2d867258ffb tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:22.801291 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-ef54adcc-5467-4d8e-86f7-a2d867258ffb tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Getting quotas for project d238a08e954c42e7a646cbe300e831a0. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:55:22.815919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-ef54adcc-5467-4d8e-86f7-a2d867258ffb tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Getting quotas for user a21786dcd412436facda618c37ff02b7 and project d238a08e954c42e7a646cbe300e831a0. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:55:22.832760 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ef54adcc-5467-4d8e-86f7-a2d867258ffb tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:55:22.836467 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ef54adcc-5467-4d8e-86f7-a2d867258ffb tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:55:22.908426 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ef54adcc-5467-4d8e-86f7-a2d867258ffb tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.580015 Oct 05 02:55:22.912862 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2690/5359] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 5 02:55:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 05 02:55:22.928625 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-836a0645-3402-4717-a7bb-3c1b2ac955ff tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:22.929354 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-836a0645-3402-4717-a7bb-3c1b2ac955ff tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:23.022274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-836a0645-3402-4717-a7bb-3c1b2ac955ff tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:23.038655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-836a0645-3402-4717-a7bb-3c1b2ac955ff tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:23.040302 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-836a0645-3402-4717-a7bb-3c1b2ac955ff tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:23.041932 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-836a0645-3402-4717-a7bb-3c1b2ac955ff tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1278 microversion: 2.54 time: 0.121555 Oct 05 02:55:23.043350 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2670/5360] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:55:22 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1278 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:55:23.324874 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8c791097-85ac-4a06-bcbc-cea9f9fe6922 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:23.325611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8c791097-85ac-4a06-bcbc-cea9f9fe6922 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 9133ea4e-7828-4227-a454-681cc3b7b695] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:23.340501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c791097-85ac-4a06-bcbc-cea9f9fe6922 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:23.341017 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c791097-85ac-4a06-bcbc-cea9f9fe6922 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:23.341616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c791097-85ac-4a06-bcbc-cea9f9fe6922 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:23.342542 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c791097-85ac-4a06-bcbc-cea9f9fe6922 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:23.343151 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c791097-85ac-4a06-bcbc-cea9f9fe6922 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:23.343729 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c791097-85ac-4a06-bcbc-cea9f9fe6922 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:23.360697 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-8c791097-85ac-4a06-bcbc-cea9f9fe6922 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Instance 9133ea4e-7828-4227-a454-681cc3b7b695 could not be found. Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8c791097-85ac-4a06-bcbc-cea9f9fe6922 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695 HTTP/1.1 Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 9133ea4e-7828-4227-a454-681cc3b7b695 could not be found. Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '9133ea4e-7828-4227-a454-681cc3b7b695'} Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9133ea4e-7828-4227-a454-681cc3b7b695 could not be found. Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:55:23.364716 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:55:23.369150 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9133ea4e-7828-4227-a454-681cc3b7b695 could not be found. Oct 05 02:55:23.369150 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:23.369150 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:55:23.369150 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:23.369150 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:23.369150 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:55:23.369150 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:55:23.369150 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:55:23.369150 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:55:23.369150 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9133ea4e-7828-4227-a454-681cc3b7b695 could not be found. Oct 05 02:55:23.369150 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:23.385601 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8c791097-85ac-4a06-bcbc-cea9f9fe6922 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 404 to user: Instance 9133ea4e-7828-4227-a454-681cc3b7b695 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:55:23.386705 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8c791097-85ac-4a06-bcbc-cea9f9fe6922 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695" status: 404 len: 111 microversion: 2.1 time: 0.066076 Oct 05 02:55:23.389597 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2691/5361] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:55:23 2022] DELETE /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:55:23.402594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-aa846ea5-9034-42fb-ada1-77dd602988ae tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:23.404442 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-aa846ea5-9034-42fb-ada1-77dd602988ae tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 9133ea4e-7828-4227-a454-681cc3b7b695] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:23.421486 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa846ea5-9034-42fb-ada1-77dd602988ae tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:23.422006 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa846ea5-9034-42fb-ada1-77dd602988ae tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:23.422574 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa846ea5-9034-42fb-ada1-77dd602988ae tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:23.423294 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa846ea5-9034-42fb-ada1-77dd602988ae tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:23.426117 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa846ea5-9034-42fb-ada1-77dd602988ae tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:23.426784 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa846ea5-9034-42fb-ada1-77dd602988ae tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:23.456726 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-aa846ea5-9034-42fb-ada1-77dd602988ae tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Instance 9133ea4e-7828-4227-a454-681cc3b7b695 could not be found. Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-aa846ea5-9034-42fb-ada1-77dd602988ae tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695 HTTP/1.1 Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 9133ea4e-7828-4227-a454-681cc3b7b695 could not be found. Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '9133ea4e-7828-4227-a454-681cc3b7b695'} Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9133ea4e-7828-4227-a454-681cc3b7b695 could not be found. Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9133ea4e-7828-4227-a454-681cc3b7b695 could not be found. Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:55:23.458458 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:23.462724 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:23.462724 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:55:23.462724 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:55:23.462724 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:55:23.462724 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:55:23.462724 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9133ea4e-7828-4227-a454-681cc3b7b695 could not be found. Oct 05 02:55:23.462724 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:55:23.462724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-aa846ea5-9034-42fb-ada1-77dd602988ae tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 404 to user: Instance 9133ea4e-7828-4227-a454-681cc3b7b695 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:55:23.462724 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-aa846ea5-9034-42fb-ada1-77dd602988ae tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695" status: 404 len: 111 microversion: 2.1 time: 0.066451 Oct 05 02:55:23.469245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ec0bd1dd-5e7f-46b9-8645-02800ed43def tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:23.469725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ec0bd1dd-5e7f-46b9-8645-02800ed43def tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:23.487219 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec0bd1dd-5e7f-46b9-8645-02800ed43def tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:23.487721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec0bd1dd-5e7f-46b9-8645-02800ed43def tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:23.489479 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2671/5362] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:23 2022] GET /compute/v2.1/servers/9133ea4e-7828-4227-a454-681cc3b7b695 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:55:23.489788 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec0bd1dd-5e7f-46b9-8645-02800ed43def tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:23.490527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec0bd1dd-5e7f-46b9-8645-02800ed43def tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:23.490988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec0bd1dd-5e7f-46b9-8645-02800ed43def tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:23.491415 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec0bd1dd-5e7f-46b9-8645-02800ed43def tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:23.552164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ec0bd1dd-5e7f-46b9-8645-02800ed43def tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:55:23.707911 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ec0bd1dd-5e7f-46b9-8645-02800ed43def tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 204 len: 0 microversion: 2.1 time: 0.239881 Oct 05 02:55:23.711268 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2692/5363] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:55:23 2022] DELETE /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:55:23.721994 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-58164432-c5f1-439a-822f-b1d98076fb7e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:23.723183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-58164432-c5f1-439a-822f-b1d98076fb7e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:23.730345 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58164432-c5f1-439a-822f-b1d98076fb7e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:23.731009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58164432-c5f1-439a-822f-b1d98076fb7e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:23.731553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58164432-c5f1-439a-822f-b1d98076fb7e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:23.732391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58164432-c5f1-439a-822f-b1d98076fb7e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:23.732978 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58164432-c5f1-439a-822f-b1d98076fb7e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:23.733569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58164432-c5f1-439a-822f-b1d98076fb7e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:23.899616 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-58164432-c5f1-439a-822f-b1d98076fb7e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:23.943471 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-58164432-c5f1-439a-822f-b1d98076fb7e tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1510 microversion: 2.1 time: 0.227633 Oct 05 02:55:23.944082 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2672/5364] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:23 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1510 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:24.075722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f4ed09c2-bffa-4247-b497-952b899ecd3b tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:24.076670 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f4ed09c2-bffa-4247-b497-952b899ecd3b tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:24.087078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f4ed09c2-bffa-4247-b497-952b899ecd3b tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:24.087811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f4ed09c2-bffa-4247-b497-952b899ecd3b tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:24.088848 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f4ed09c2-bffa-4247-b497-952b899ecd3b tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:24.089782 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f4ed09c2-bffa-4247-b497-952b899ecd3b tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:24.091025 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f4ed09c2-bffa-4247-b497-952b899ecd3b tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:24.091628 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f4ed09c2-bffa-4247-b497-952b899ecd3b tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:24.197405 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f4ed09c2-bffa-4247-b497-952b899ecd3b tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:24.209296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f4ed09c2-bffa-4247-b497-952b899ecd3b tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:24.211309 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f4ed09c2-bffa-4247-b497-952b899ecd3b tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:24.212743 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f4ed09c2-bffa-4247-b497-952b899ecd3b tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1330 microversion: 2.54 time: 0.142870 Oct 05 02:55:24.213550 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2693/5365] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:55:24 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1330 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:55:24.967443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-043854ec-80b5-457c-9cfc-961b3d885379 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:24.968071 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-043854ec-80b5-457c-9cfc-961b3d885379 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:24.975357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-043854ec-80b5-457c-9cfc-961b3d885379 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:24.976619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-043854ec-80b5-457c-9cfc-961b3d885379 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:24.977192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-043854ec-80b5-457c-9cfc-961b3d885379 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:24.977809 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-043854ec-80b5-457c-9cfc-961b3d885379 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:24.978338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-043854ec-80b5-457c-9cfc-961b3d885379 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:24.978701 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-043854ec-80b5-457c-9cfc-961b3d885379 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:25.169469 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-043854ec-80b5-457c-9cfc-961b3d885379 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:25.178408 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-043854ec-80b5-457c-9cfc-961b3d885379 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1510 microversion: 2.1 time: 0.214750 Oct 05 02:55:25.179276 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2673/5366] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:24 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1510 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:25.249516 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9bf1e191-6497-4bae-9d7b-7f2180414dbe tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:25.250942 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9bf1e191-6497-4bae-9d7b-7f2180414dbe tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:25.262342 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9bf1e191-6497-4bae-9d7b-7f2180414dbe tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:25.263592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9bf1e191-6497-4bae-9d7b-7f2180414dbe tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:25.264300 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9bf1e191-6497-4bae-9d7b-7f2180414dbe tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:25.265357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9bf1e191-6497-4bae-9d7b-7f2180414dbe tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:25.266435 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9bf1e191-6497-4bae-9d7b-7f2180414dbe tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:25.267349 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9bf1e191-6497-4bae-9d7b-7f2180414dbe tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:25.360652 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9bf1e191-6497-4bae-9d7b-7f2180414dbe tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:25.372518 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9bf1e191-6497-4bae-9d7b-7f2180414dbe tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:25.373999 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9bf1e191-6497-4bae-9d7b-7f2180414dbe tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:25.377186 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9bf1e191-6497-4bae-9d7b-7f2180414dbe tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1336 microversion: 2.54 time: 0.135038 Oct 05 02:55:25.378536 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2694/5367] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:55:25 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1336 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:55:26.202330 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6852f740-b881-401e-9523-c2b232ce1a73 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:26.203625 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6852f740-b881-401e-9523-c2b232ce1a73 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:26.213524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6852f740-b881-401e-9523-c2b232ce1a73 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:26.214023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6852f740-b881-401e-9523-c2b232ce1a73 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:26.214457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6852f740-b881-401e-9523-c2b232ce1a73 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:26.219925 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6852f740-b881-401e-9523-c2b232ce1a73 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:26.220568 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6852f740-b881-401e-9523-c2b232ce1a73 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:26.221176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6852f740-b881-401e-9523-c2b232ce1a73 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:26.408548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8b0bf402-59a7-4336-90ec-15d9749abb15 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:26.411022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8b0bf402-59a7-4336-90ec-15d9749abb15 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:26.422515 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b0bf402-59a7-4336-90ec-15d9749abb15 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:26.423346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b0bf402-59a7-4336-90ec-15d9749abb15 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:26.424223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b0bf402-59a7-4336-90ec-15d9749abb15 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:26.425333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b0bf402-59a7-4336-90ec-15d9749abb15 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:26.426780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b0bf402-59a7-4336-90ec-15d9749abb15 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:26.428446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b0bf402-59a7-4336-90ec-15d9749abb15 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:26.482684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6852f740-b881-401e-9523-c2b232ce1a73 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa65476b76e749cdab6ad9e7e77e79b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76521b0c2f8465b866756ccc9c299e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:26.496251 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6852f740-b881-401e-9523-c2b232ce1a73 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 200 len: 1510 microversion: 2.1 time: 0.297699 Oct 05 02:55:26.498132 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2674/5368] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:26 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 1510 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:26.557888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8b0bf402-59a7-4336-90ec-15d9749abb15 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:26.574207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8b0bf402-59a7-4336-90ec-15d9749abb15 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:26.575903 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8b0bf402-59a7-4336-90ec-15d9749abb15 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:26.577248 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8b0bf402-59a7-4336-90ec-15d9749abb15 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1336 microversion: 2.54 time: 0.177235 Oct 05 02:55:26.578365 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2695/5369] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:55:26 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1336 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:55:26.799492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-94acf952-8280-401a-85ee-c128d888ff8e req-72bb6472-6331-4ff4-95e4-f1a08a629853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fded3d6-d275-4d50-a366-d19388f8aaec", "name": "network-vif-deleted", "tag": "877cbc45-f570-4bb6-bcd2-91b67dbccdb3"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:55:26.835363 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-94acf952-8280-401a-85ee-c128d888ff8e req-72bb6472-6331-4ff4-95e4-f1a08a629853 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:26.847297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-94acf952-8280-401a-85ee-c128d888ff8e req-72bb6472-6331-4ff4-95e4-f1a08a629853 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:26.847297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-94acf952-8280-401a-85ee-c128d888ff8e req-72bb6472-6331-4ff4-95e4-f1a08a629853 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:26.872749 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-94acf952-8280-401a-85ee-c128d888ff8e req-72bb6472-6331-4ff4-95e4-f1a08a629853 service nova] Creating event network-vif-deleted:877cbc45-f570-4bb6-bcd2-91b67dbccdb3 for instance 1fded3d6-d275-4d50-a366-d19388f8aaec on n-h1-858272-3 Oct 05 02:55:26.887382 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-94acf952-8280-401a-85ee-c128d888ff8e req-72bb6472-6331-4ff4-95e4-f1a08a629853 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092150 Oct 05 02:55:26.890323 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2675/5370] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:55:27.521635 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-528d39dd-4fed-41dc-a628-f78757fb5592 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:27.523251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-528d39dd-4fed-41dc-a628-f78757fb5592 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] [instance: 1fded3d6-d275-4d50-a366-d19388f8aaec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:27.532888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-528d39dd-4fed-41dc-a628-f78757fb5592 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:27.533408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-528d39dd-4fed-41dc-a628-f78757fb5592 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:27.533904 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-528d39dd-4fed-41dc-a628-f78757fb5592 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:27.535045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-528d39dd-4fed-41dc-a628-f78757fb5592 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:27.546467 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-528d39dd-4fed-41dc-a628-f78757fb5592 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:27.548631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-528d39dd-4fed-41dc-a628-f78757fb5592 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:27.568811 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-528d39dd-4fed-41dc-a628-f78757fb5592 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] HTTP exception thrown: Instance 1fded3d6-d275-4d50-a366-d19388f8aaec could not be found. Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-528d39dd-4fed-41dc-a628-f78757fb5592 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Request method failure captured: Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec HTTP/1.1 Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPEfL9KOMqR8feAF30UaMKkzsGYboDweiWeIwrZIAxGCd9oC4djlukHaPdFBp9d5V-UvMSRHoxHxJtCzWj08lDJiY6PLO_NkOmtyUy6IR-HwoMwD2w60WzOqUuIGaJRvBm_ZIh4fd5YGVJgUu4IeIygUag_FAoERwGemPJ3r64fiBPI Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c76521b0c2f8465b866756ccc9c299e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: c76521b0c2f8465b866756ccc9c299e4 Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1848628160 Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: fa65476b76e749cdab6ad9e7e77e79b7 Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersNegativeTestJSON-1848628160-project Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 1fded3d6-d275-4d50-a366-d19388f8aaec could not be found. Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '1fded3d6-d275-4d50-a366-d19388f8aaec'} Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fded3d6-d275-4d50-a366-d19388f8aaec could not be found. Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fded3d6-d275-4d50-a366-d19388f8aaec could not be found. Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:55:27.570471 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:27.574690 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:27.574690 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:55:27.574690 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:55:27.574690 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:55:27.574690 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:55:27.574690 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fded3d6-d275-4d50-a366-d19388f8aaec could not be found. Oct 05 02:55:27.574690 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:27.574690 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-528d39dd-4fed-41dc-a628-f78757fb5592 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] Returning 404 to user: Instance 1fded3d6-d275-4d50-a366-d19388f8aaec could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:55:27.574690 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-528d39dd-4fed-41dc-a628-f78757fb5592 tempest-ServersNegativeTestJSON-1848628160 tempest-ServersNegativeTestJSON-1848628160-project] 10.222.0.16 "GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec" status: 404 len: 111 microversion: 2.1 time: 0.056383 Oct 05 02:55:27.577231 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2696/5371] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:27 2022] GET /compute/v2.1/servers/1fded3d6-d275-4d50-a366-d19388f8aaec => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:55:27.609924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-264eb758-5013-4597-abe1-3e0d9450d98f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:27.611064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-264eb758-5013-4597-abe1-3e0d9450d98f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:27.618740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-264eb758-5013-4597-abe1-3e0d9450d98f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:27.619317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-264eb758-5013-4597-abe1-3e0d9450d98f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:27.619877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-264eb758-5013-4597-abe1-3e0d9450d98f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:27.620980 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-264eb758-5013-4597-abe1-3e0d9450d98f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:27.622303 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-264eb758-5013-4597-abe1-3e0d9450d98f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:27.622831 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-264eb758-5013-4597-abe1-3e0d9450d98f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:27.723871 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-264eb758-5013-4597-abe1-3e0d9450d98f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:27.740336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-264eb758-5013-4597-abe1-3e0d9450d98f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:27.742219 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-264eb758-5013-4597-abe1-3e0d9450d98f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:27.743899 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-264eb758-5013-4597-abe1-3e0d9450d98f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1336 microversion: 2.54 time: 0.140877 Oct 05 02:55:27.744477 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2676/5372] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:55:27 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1336 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:55:28.772149 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d102b344-6b60-4855-972c-b303d4d439d3 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:28.772768 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d102b344-6b60-4855-972c-b303d4d439d3 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:28.793494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d102b344-6b60-4855-972c-b303d4d439d3 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:28.794569 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d102b344-6b60-4855-972c-b303d4d439d3 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:28.795027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d102b344-6b60-4855-972c-b303d4d439d3 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:28.795775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d102b344-6b60-4855-972c-b303d4d439d3 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:28.796745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d102b344-6b60-4855-972c-b303d4d439d3 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:28.797213 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d102b344-6b60-4855-972c-b303d4d439d3 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:28.914135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d102b344-6b60-4855-972c-b303d4d439d3 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:28.937275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d102b344-6b60-4855-972c-b303d4d439d3 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:28.939100 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d102b344-6b60-4855-972c-b303d4d439d3 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:28.942591 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d102b344-6b60-4855-972c-b303d4d439d3 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1336 microversion: 2.54 time: 0.174850 Oct 05 02:55:28.943365 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2697/5373] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:55:28 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1336 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:55:29.969383 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cdeba0c0-8a38-4d2a-be17-684a4cb4dd13 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:29.969993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cdeba0c0-8a38-4d2a-be17-684a4cb4dd13 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:29.989116 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdeba0c0-8a38-4d2a-be17-684a4cb4dd13 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:29.989501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdeba0c0-8a38-4d2a-be17-684a4cb4dd13 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:29.989935 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdeba0c0-8a38-4d2a-be17-684a4cb4dd13 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:29.990637 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdeba0c0-8a38-4d2a-be17-684a4cb4dd13 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:29.991112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdeba0c0-8a38-4d2a-be17-684a4cb4dd13 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:29.991499 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdeba0c0-8a38-4d2a-be17-684a4cb4dd13 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:30.103062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cdeba0c0-8a38-4d2a-be17-684a4cb4dd13 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:30.114287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cdeba0c0-8a38-4d2a-be17-684a4cb4dd13 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:30.116183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cdeba0c0-8a38-4d2a-be17-684a4cb4dd13 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:30.117718 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cdeba0c0-8a38-4d2a-be17-684a4cb4dd13 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1357 microversion: 2.54 time: 0.152168 Oct 05 02:55:30.118921 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2677/5374] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:55:29 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:55:30.152856 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-601b6318-d34a-448c-b3c3-3976b73aaf29 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Action: 'create', calling method: .version_select at 0x7fcce812cdc0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1979860779", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHxZCCho+/DmXOXoYvsBq/jnfKLI0krdT3QvxaeKGzoWP2pYMf1PBouzSM7zgva//vX5mS9fdVjZBjhxAR77QBaPnFTmJXu41fmgyMYD745RuQVrsMRSTya7BUa0Eyxiw=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:55:30.193228 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-601b6318-d34a-448c-b3c3-3976b73aaf29 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Getting quotas for project d238a08e954c42e7a646cbe300e831a0. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:55:30.213096 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-601b6318-d34a-448c-b3c3-3976b73aaf29 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Getting quotas for user a21786dcd412436facda618c37ff02b7 and project d238a08e954c42e7a646cbe300e831a0. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:55:30.273948 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-601b6318-d34a-448c-b3c3-3976b73aaf29 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.124840 Oct 05 02:55:30.274549 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2698/5375] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Oct 5 02:55:30 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 127 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 05 02:55:30.287891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dd9852dc-3761-43d3-8b81-36dde29c19b8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1979860779", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:55:30.291530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dd9852dc-3761-43d3-8b81-36dde29c19b8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:30.305181 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd9852dc-3761-43d3-8b81-36dde29c19b8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:30.308123 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd9852dc-3761-43d3-8b81-36dde29c19b8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:30.308574 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd9852dc-3761-43d3-8b81-36dde29c19b8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:30.312654 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd9852dc-3761-43d3-8b81-36dde29c19b8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:30.313328 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd9852dc-3761-43d3-8b81-36dde29c19b8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:30.314100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd9852dc-3761-43d3-8b81-36dde29c19b8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:30.508714 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-dd9852dc-3761-43d3-8b81-36dde29c19b8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:55:30.514497 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-dd9852dc-3761-43d3-8b81-36dde29c19b8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:55:30.516199 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-dd9852dc-3761-43d3-8b81-36dde29c19b8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:55:30.516642 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-dd9852dc-3761-43d3-8b81-36dde29c19b8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:55:30.519212 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-dd9852dc-3761-43d3-8b81-36dde29c19b8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:55:30.706595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dd9852dc-3761-43d3-8b81-36dde29c19b8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:30.713788 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd9852dc-3761-43d3-8b81-36dde29c19b8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:30.714487 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd9852dc-3761-43d3-8b81-36dde29c19b8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:30.715081 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd9852dc-3761-43d3-8b81-36dde29c19b8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:30.715940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd9852dc-3761-43d3-8b81-36dde29c19b8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:30.716551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd9852dc-3761-43d3-8b81-36dde29c19b8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:30.717223 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd9852dc-3761-43d3-8b81-36dde29c19b8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:30.764894 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dd9852dc-3761-43d3-8b81-36dde29c19b8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "POST /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0/action" status: 202 len: 1140 microversion: 2.54 time: 0.482162 Oct 05 02:55:30.765836 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2678/5376] 10.222.0.16 () {62 vars in 1320 bytes} [Wed Oct 5 02:55:30 2022] POST /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0/action => generated 1140 bytes in 484 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 05 02:55:30.788817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-404289a9-3d6e-4d8d-b239-0c16176bc738 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:30.789483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-404289a9-3d6e-4d8d-b239-0c16176bc738 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:30.796807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-404289a9-3d6e-4d8d-b239-0c16176bc738 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:30.798895 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-404289a9-3d6e-4d8d-b239-0c16176bc738 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:30.799343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-404289a9-3d6e-4d8d-b239-0c16176bc738 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:30.804939 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-404289a9-3d6e-4d8d-b239-0c16176bc738 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:30.806664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-404289a9-3d6e-4d8d-b239-0c16176bc738 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:30.807273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-404289a9-3d6e-4d8d-b239-0c16176bc738 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:30.938370 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-404289a9-3d6e-4d8d-b239-0c16176bc738 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:30.951144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-404289a9-3d6e-4d8d-b239-0c16176bc738 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:30.953671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-404289a9-3d6e-4d8d-b239-0c16176bc738 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:30.955068 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-404289a9-3d6e-4d8d-b239-0c16176bc738 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1409 microversion: 2.54 time: 0.170758 Oct 05 02:55:30.955715 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2699/5377] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:55:30 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1409 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:55:31.985734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ad80a472-7422-404e-9f65-9c431b2b2490 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:31.987513 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ad80a472-7422-404e-9f65-9c431b2b2490 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:32.004576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad80a472-7422-404e-9f65-9c431b2b2490 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:32.005382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad80a472-7422-404e-9f65-9c431b2b2490 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:32.005950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad80a472-7422-404e-9f65-9c431b2b2490 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:32.007216 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad80a472-7422-404e-9f65-9c431b2b2490 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:32.009654 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad80a472-7422-404e-9f65-9c431b2b2490 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:32.010326 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad80a472-7422-404e-9f65-9c431b2b2490 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:32.144523 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ad80a472-7422-404e-9f65-9c431b2b2490 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:32.154481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ad80a472-7422-404e-9f65-9c431b2b2490 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:32.156192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ad80a472-7422-404e-9f65-9c431b2b2490 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:32.157631 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ad80a472-7422-404e-9f65-9c431b2b2490 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1409 microversion: 2.54 time: 0.178691 Oct 05 02:55:32.183886 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2679/5378] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:55:31 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1409 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:55:33.190244 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-54427daf-1562-4a84-98cb-d0d27a21ed38 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:33.190849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-54427daf-1562-4a84-98cb-d0d27a21ed38 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:33.201261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:33.203401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-54427daf-1562-4a84-98cb-d0d27a21ed38 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:33.204066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-54427daf-1562-4a84-98cb-d0d27a21ed38 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:33.204765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-54427daf-1562-4a84-98cb-d0d27a21ed38 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:33.206276 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-54427daf-1562-4a84-98cb-d0d27a21ed38 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:33.206982 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-54427daf-1562-4a84-98cb-d0d27a21ed38 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:33.207927 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-54427daf-1562-4a84-98cb-d0d27a21ed38 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:33.335050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-54427daf-1562-4a84-98cb-d0d27a21ed38 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:33.344242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-54427daf-1562-4a84-98cb-d0d27a21ed38 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:33.349649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-54427daf-1562-4a84-98cb-d0d27a21ed38 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:33.349649 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-54427daf-1562-4a84-98cb-d0d27a21ed38 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1409 microversion: 2.54 time: 0.162044 Oct 05 02:55:33.349649 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2700/5379] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:55:33 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1409 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:55:34.059366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:34.220978 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-010f14db-2d63-4523-989e-a4b2f756375c tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] Calling method '.version_select at 0x7fccdf151790>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:34.292751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-515a4a35-158e-470d-894e-20d647c7c4af tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1141687411", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "4c0bcff9-830b-40ba-b530-35fb8a6382d4"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:55:34.293325 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-010f14db-2d63-4523-989e-a4b2f756375c tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/a2b62f05af6545b4981c135da7197b55/defaults" status: 200 len: 371 microversion: 2.1 time: 0.244792 Oct 05 02:55:34.293704 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2680/5380] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 5 02:55:34 2022] GET /compute/v2.1/os-quota-sets/a2b62f05af6545b4981c135da7197b55/defaults => generated 371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:55:34.305360 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-904810fd-ddc2-453d-922e-e096152bab7f tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] Calling method '.version_select at 0x7fcce4cfc8b0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:34.357686 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-515a4a35-158e-470d-894e-20d647c7c4af tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] validate_networks() for [('4c0bcff9-830b-40ba-b530-35fb8a6382d4', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:55:34.368735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:34.388741 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-904810fd-ddc2-453d-922e-e096152bab7f tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/a2b62f05af6545b4981c135da7197b55" status: 200 len: 371 microversion: 2.1 time: 0.086987 Oct 05 02:55:34.389981 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2681/5381] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 5 02:55:34 2022] GET /compute/v2.1/os-quota-sets/a2b62f05af6545b4981c135da7197b55 => generated 371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:55:34.395320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b710a46b-4aa6-4d97-82b3-49f5bbb86ac7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:34.395947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b710a46b-4aa6-4d97-82b3-49f5bbb86ac7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:34.402903 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b710a46b-4aa6-4d97-82b3-49f5bbb86ac7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:34.403416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b710a46b-4aa6-4d97-82b3-49f5bbb86ac7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:34.403861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b710a46b-4aa6-4d97-82b3-49f5bbb86ac7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:34.404577 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b710a46b-4aa6-4d97-82b3-49f5bbb86ac7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:34.405081 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b710a46b-4aa6-4d97-82b3-49f5bbb86ac7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:34.405516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b710a46b-4aa6-4d97-82b3-49f5bbb86ac7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:34.493699 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b710a46b-4aa6-4d97-82b3-49f5bbb86ac7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:34.502815 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b710a46b-4aa6-4d97-82b3-49f5bbb86ac7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:34.505039 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b710a46b-4aa6-4d97-82b3-49f5bbb86ac7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:34.506240 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b710a46b-4aa6-4d97-82b3-49f5bbb86ac7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1409 microversion: 2.54 time: 0.115141 Oct 05 02:55:34.506792 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2682/5382] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:55:34 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1409 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:55:34.511499 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5b1103f4-87af-4f98-a44f-fbaf287c3675 tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] Calling method '.version_select at 0x7fcce8106d30>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:34.578244 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5b1103f4-87af-4f98-a44f-fbaf287c3675 tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/a2b62f05af6545b4981c135da7197b55/defaults" status: 200 len: 371 microversion: 2.1 time: 0.070199 Oct 05 02:55:34.578836 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2683/5383] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 5 02:55:34 2022] GET /compute/v2.1/os-quota-sets/a2b62f05af6545b4981c135da7197b55/defaults => generated 371 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:55:34.594207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0130542b-c4ce-49a8-8f11-30f99e130bff tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] Calling method '.version_select at 0x7fcce81428b0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:34.669528 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0130542b-c4ce-49a8-8f11-30f99e130bff tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/a2b62f05af6545b4981c135da7197b55" status: 200 len: 371 microversion: 2.1 time: 0.078807 Oct 05 02:55:34.673296 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2684/5384] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 5 02:55:34 2022] GET /compute/v2.1/os-quota-sets/a2b62f05af6545b4981c135da7197b55 => generated 371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:55:34.682276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d12d98fc-d6dd-4559-9ef3-8886a4420b2b tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] Calling method '.version_select at 0x7fcce80f0550>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:34.765383 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d12d98fc-d6dd-4559-9ef3-8886a4420b2b tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/a2b62f05af6545b4981c135da7197b55?user_id=507a2bdedc4441e48f7de00c4ef3b1e0" status: 200 len: 371 microversion: 2.1 time: 0.086991 Oct 05 02:55:34.765980 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2685/5385] 10.222.0.16 () {58 vars in 1323 bytes} [Wed Oct 5 02:55:34 2022] GET /compute/v2.1/os-quota-sets/a2b62f05af6545b4981c135da7197b55?user_id=507a2bdedc4441e48f7de00c4ef3b1e0 => generated 371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:55:34.843757 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-515a4a35-158e-470d-894e-20d647c7c4af tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:55:34.844181 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-515a4a35-158e-470d-894e-20d647c7c4af tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:55:34.844656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-515a4a35-158e-470d-894e-20d647c7c4af tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:55:34.845100 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-515a4a35-158e-470d-894e-20d647c7c4af tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:55:34.845533 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-515a4a35-158e-470d-894e-20d647c7c4af tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:55:34.855819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-515a4a35-158e-470d-894e-20d647c7c4af tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:34.856623 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-515a4a35-158e-470d-894e-20d647c7c4af tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:34.857344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-515a4a35-158e-470d-894e-20d647c7c4af tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:34.858308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-515a4a35-158e-470d-894e-20d647c7c4af tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:34.858948 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-515a4a35-158e-470d-894e-20d647c7c4af tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:34.859475 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-515a4a35-158e-470d-894e-20d647c7c4af tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:34.878662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-515a4a35-158e-470d-894e-20d647c7c4af tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Getting quotas for project 10aa8602b45c45a2b5d30052aaa01e42. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:55:34.884842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-515a4a35-158e-470d-894e-20d647c7c4af tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Getting quotas for user ba34319166e041129b4a05926efa2af3 and project 10aa8602b45c45a2b5d30052aaa01e42. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:55:34.906766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-515a4a35-158e-470d-894e-20d647c7c4af tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:55:34.909352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-515a4a35-158e-470d-894e-20d647c7c4af tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] [instance: 8e79e9df-c543-4c29-b760-63312d8d0ee6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:55:34.975808 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-515a4a35-158e-470d-894e-20d647c7c4af tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.759196 Oct 05 02:55:34.976542 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2701/5386] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:55:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 02:55:34.988140 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a5e7ea7c-1a03-4491-b597-cca25dda60a1 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:34.988887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a5e7ea7c-1a03-4491-b597-cca25dda60a1 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] [instance: 8e79e9df-c543-4c29-b760-63312d8d0ee6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:35.045878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a5e7ea7c-1a03-4491-b597-cca25dda60a1 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba34319166e041129b4a05926efa2af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aa8602b45c45a2b5d30052aaa01e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:35.055163 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a5e7ea7c-1a03-4491-b597-cca25dda60a1 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] 10.222.0.16 "GET /compute/v2.1/servers/8e79e9df-c543-4c29-b760-63312d8d0ee6" status: 200 len: 1214 microversion: 2.1 time: 0.071287 Oct 05 02:55:35.071554 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2686/5387] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:34 2022] GET /compute/v2.1/servers/8e79e9df-c543-4c29-b760-63312d8d0ee6 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:35.539879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0b05c1ca-9dfa-4adb-a0ba-cfc56035192a tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:35.541864 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0b05c1ca-9dfa-4adb-a0ba-cfc56035192a tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:35.553518 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b05c1ca-9dfa-4adb-a0ba-cfc56035192a tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:35.554570 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b05c1ca-9dfa-4adb-a0ba-cfc56035192a tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:35.557542 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b05c1ca-9dfa-4adb-a0ba-cfc56035192a tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:35.558882 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b05c1ca-9dfa-4adb-a0ba-cfc56035192a tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:35.560414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b05c1ca-9dfa-4adb-a0ba-cfc56035192a tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:35.561813 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b05c1ca-9dfa-4adb-a0ba-cfc56035192a tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:35.720780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0b05c1ca-9dfa-4adb-a0ba-cfc56035192a tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:35.735770 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0b05c1ca-9dfa-4adb-a0ba-cfc56035192a tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:35.743195 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0b05c1ca-9dfa-4adb-a0ba-cfc56035192a tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:35.746330 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0b05c1ca-9dfa-4adb-a0ba-cfc56035192a tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1409 microversion: 2.54 time: 0.213415 Oct 05 02:55:35.758376 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2702/5388] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:55:35 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1409 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:55:36.078580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-34bde8c3-2b7c-43f8-8948-5c86d6049ac3 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:36.079217 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-34bde8c3-2b7c-43f8-8948-5c86d6049ac3 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] [instance: 8e79e9df-c543-4c29-b760-63312d8d0ee6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:36.087718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34bde8c3-2b7c-43f8-8948-5c86d6049ac3 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:36.088526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34bde8c3-2b7c-43f8-8948-5c86d6049ac3 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:36.089159 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34bde8c3-2b7c-43f8-8948-5c86d6049ac3 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:36.090067 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34bde8c3-2b7c-43f8-8948-5c86d6049ac3 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:36.090821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34bde8c3-2b7c-43f8-8948-5c86d6049ac3 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:36.091260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34bde8c3-2b7c-43f8-8948-5c86d6049ac3 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:36.175299 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-34bde8c3-2b7c-43f8-8948-5c86d6049ac3 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba34319166e041129b4a05926efa2af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aa8602b45c45a2b5d30052aaa01e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:36.184414 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-34bde8c3-2b7c-43f8-8948-5c86d6049ac3 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] 10.222.0.16 "GET /compute/v2.1/servers/8e79e9df-c543-4c29-b760-63312d8d0ee6" status: 200 len: 1210 microversion: 2.1 time: 0.109596 Oct 05 02:55:36.185602 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2687/5389] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:36 2022] GET /compute/v2.1/servers/8e79e9df-c543-4c29-b760-63312d8d0ee6 => generated 1210 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:36.774216 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c2ea41b5-4389-477a-a5d5-95d3634c074d tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:36.775492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c2ea41b5-4389-477a-a5d5-95d3634c074d tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:36.779771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=7 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:36.787439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2ea41b5-4389-477a-a5d5-95d3634c074d tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:36.787988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2ea41b5-4389-477a-a5d5-95d3634c074d tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:36.791664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2ea41b5-4389-477a-a5d5-95d3634c074d tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:36.792711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2ea41b5-4389-477a-a5d5-95d3634c074d tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:36.793218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2ea41b5-4389-477a-a5d5-95d3634c074d tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:36.793792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2ea41b5-4389-477a-a5d5-95d3634c074d tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:36.878248 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c2ea41b5-4389-477a-a5d5-95d3634c074d tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:36.890094 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c2ea41b5-4389-477a-a5d5-95d3634c074d tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:36.896060 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c2ea41b5-4389-477a-a5d5-95d3634c074d tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:36.897111 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c2ea41b5-4389-477a-a5d5-95d3634c074d tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1409 microversion: 2.54 time: 0.126779 Oct 05 02:55:36.901754 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2703/5390] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:55:36 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1409 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:55:37.212364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-062dd94f-61c6-432a-baa8-f96c7902d16c tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:37.214376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-062dd94f-61c6-432a-baa8-f96c7902d16c tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] [instance: 8e79e9df-c543-4c29-b760-63312d8d0ee6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:37.241027 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-062dd94f-61c6-432a-baa8-f96c7902d16c tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:37.241922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-062dd94f-61c6-432a-baa8-f96c7902d16c tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:37.242527 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-062dd94f-61c6-432a-baa8-f96c7902d16c tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:37.243375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-062dd94f-61c6-432a-baa8-f96c7902d16c tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:37.243976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-062dd94f-61c6-432a-baa8-f96c7902d16c tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:37.244548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-062dd94f-61c6-432a-baa8-f96c7902d16c tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:37.346133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-062dd94f-61c6-432a-baa8-f96c7902d16c tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba34319166e041129b4a05926efa2af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aa8602b45c45a2b5d30052aaa01e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:37.357746 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-062dd94f-61c6-432a-baa8-f96c7902d16c tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] 10.222.0.16 "GET /compute/v2.1/servers/8e79e9df-c543-4c29-b760-63312d8d0ee6" status: 200 len: 1272 microversion: 2.1 time: 0.151103 Oct 05 02:55:37.367946 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2688/5391] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:37 2022] GET /compute/v2.1/servers/8e79e9df-c543-4c29-b760-63312d8d0ee6 => generated 1272 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:37.927583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6e0a3ce1-e0bf-4507-826e-61ef6b3cb232 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:37.928209 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6e0a3ce1-e0bf-4507-826e-61ef6b3cb232 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:37.937780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e0a3ce1-e0bf-4507-826e-61ef6b3cb232 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:37.938811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e0a3ce1-e0bf-4507-826e-61ef6b3cb232 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:37.939407 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e0a3ce1-e0bf-4507-826e-61ef6b3cb232 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:37.940416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e0a3ce1-e0bf-4507-826e-61ef6b3cb232 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:37.941206 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e0a3ce1-e0bf-4507-826e-61ef6b3cb232 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:37.942638 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e0a3ce1-e0bf-4507-826e-61ef6b3cb232 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:38.045111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6e0a3ce1-e0bf-4507-826e-61ef6b3cb232 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:38.067411 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6e0a3ce1-e0bf-4507-826e-61ef6b3cb232 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:38.069238 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6e0a3ce1-e0bf-4507-826e-61ef6b3cb232 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:38.070619 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6e0a3ce1-e0bf-4507-826e-61ef6b3cb232 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1409 microversion: 2.54 time: 0.150478 Oct 05 02:55:38.071694 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2704/5392] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:55:37 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1409 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:55:38.388880 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3118902b-55fa-4353-bd6e-49fe38c864f0 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:38.389526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3118902b-55fa-4353-bd6e-49fe38c864f0 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] [instance: 8e79e9df-c543-4c29-b760-63312d8d0ee6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:38.402560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3118902b-55fa-4353-bd6e-49fe38c864f0 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:38.403964 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3118902b-55fa-4353-bd6e-49fe38c864f0 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:38.404472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3118902b-55fa-4353-bd6e-49fe38c864f0 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:38.405292 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3118902b-55fa-4353-bd6e-49fe38c864f0 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:38.405881 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3118902b-55fa-4353-bd6e-49fe38c864f0 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:38.406464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3118902b-55fa-4353-bd6e-49fe38c864f0 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:38.482850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-e3237984-eb84-4211-9a46-f4f2f7acbcd7 req-5330607b-716e-44b0-9428-0cb26ecab6b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e79e9df-c543-4c29-b760-63312d8d0ee6", "tag": "e8ca26f4-74ef-4958-b68d-e09f86c2f94a"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:55:38.497978 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e3237984-eb84-4211-9a46-f4f2f7acbcd7 req-5330607b-716e-44b0-9428-0cb26ecab6b4 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:38.498839 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e3237984-eb84-4211-9a46-f4f2f7acbcd7 req-5330607b-716e-44b0-9428-0cb26ecab6b4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:38.499319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e3237984-eb84-4211-9a46-f4f2f7acbcd7 req-5330607b-716e-44b0-9428-0cb26ecab6b4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:38.514441 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-e3237984-eb84-4211-9a46-f4f2f7acbcd7 req-5330607b-716e-44b0-9428-0cb26ecab6b4 service nova] Creating event network-changed:e8ca26f4-74ef-4958-b68d-e09f86c2f94a for instance 8e79e9df-c543-4c29-b760-63312d8d0ee6 on n-h1-858272-3 Oct 05 02:55:38.523600 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-e3237984-eb84-4211-9a46-f4f2f7acbcd7 req-5330607b-716e-44b0-9428-0cb26ecab6b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052420 Oct 05 02:55:38.529083 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2705/5393] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:55:38.795743 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3118902b-55fa-4353-bd6e-49fe38c864f0 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba34319166e041129b4a05926efa2af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aa8602b45c45a2b5d30052aaa01e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:38.807375 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3118902b-55fa-4353-bd6e-49fe38c864f0 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] 10.222.0.16 "GET /compute/v2.1/servers/8e79e9df-c543-4c29-b760-63312d8d0ee6" status: 200 len: 1314 microversion: 2.1 time: 0.429301 Oct 05 02:55:38.816519 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2689/5394] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:38 2022] GET /compute/v2.1/servers/8e79e9df-c543-4c29-b760-63312d8d0ee6 => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:39.102234 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-374925dd-231e-4d1b-bd49-88e65342fcf5 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:39.103037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-374925dd-231e-4d1b-bd49-88e65342fcf5 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:39.110983 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-374925dd-231e-4d1b-bd49-88e65342fcf5 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:39.111502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-374925dd-231e-4d1b-bd49-88e65342fcf5 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:39.112494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-374925dd-231e-4d1b-bd49-88e65342fcf5 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:39.115554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-374925dd-231e-4d1b-bd49-88e65342fcf5 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:39.119636 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-374925dd-231e-4d1b-bd49-88e65342fcf5 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:39.120101 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-374925dd-231e-4d1b-bd49-88e65342fcf5 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:39.218204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-374925dd-231e-4d1b-bd49-88e65342fcf5 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:39.244716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-374925dd-231e-4d1b-bd49-88e65342fcf5 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:39.246576 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-374925dd-231e-4d1b-bd49-88e65342fcf5 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:39.248964 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-374925dd-231e-4d1b-bd49-88e65342fcf5 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1409 microversion: 2.54 time: 0.153059 Oct 05 02:55:39.249559 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2706/5395] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:55:39 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1409 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:55:39.832558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-39bfe093-85ab-42e8-81c8-ddac09e75d98 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:39.833856 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-39bfe093-85ab-42e8-81c8-ddac09e75d98 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] [instance: 8e79e9df-c543-4c29-b760-63312d8d0ee6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:39.840960 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-39bfe093-85ab-42e8-81c8-ddac09e75d98 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:39.841758 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-39bfe093-85ab-42e8-81c8-ddac09e75d98 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:39.842709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-39bfe093-85ab-42e8-81c8-ddac09e75d98 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:39.843796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-39bfe093-85ab-42e8-81c8-ddac09e75d98 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:39.844258 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-39bfe093-85ab-42e8-81c8-ddac09e75d98 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:39.844671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-39bfe093-85ab-42e8-81c8-ddac09e75d98 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:39.985957 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-39bfe093-85ab-42e8-81c8-ddac09e75d98 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba34319166e041129b4a05926efa2af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aa8602b45c45a2b5d30052aaa01e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:39.997931 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-39bfe093-85ab-42e8-81c8-ddac09e75d98 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] 10.222.0.16 "GET /compute/v2.1/servers/8e79e9df-c543-4c29-b760-63312d8d0ee6" status: 200 len: 1314 microversion: 2.1 time: 0.170061 Oct 05 02:55:39.999175 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2690/5396] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:39 2022] GET /compute/v2.1/servers/8e79e9df-c543-4c29-b760-63312d8d0ee6 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:40.277883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-80d37c90-a45a-4fa6-bf59-90d0c20948a1 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:40.278558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-80d37c90-a45a-4fa6-bf59-90d0c20948a1 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:40.285810 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-80d37c90-a45a-4fa6-bf59-90d0c20948a1 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:40.286372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-80d37c90-a45a-4fa6-bf59-90d0c20948a1 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:40.286961 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-80d37c90-a45a-4fa6-bf59-90d0c20948a1 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:40.287703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-80d37c90-a45a-4fa6-bf59-90d0c20948a1 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:40.288218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-80d37c90-a45a-4fa6-bf59-90d0c20948a1 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:40.288643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-80d37c90-a45a-4fa6-bf59-90d0c20948a1 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:40.378994 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-80d37c90-a45a-4fa6-bf59-90d0c20948a1 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:40.387827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-80d37c90-a45a-4fa6-bf59-90d0c20948a1 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:40.389478 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-80d37c90-a45a-4fa6-bf59-90d0c20948a1 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:40.390639 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-80d37c90-a45a-4fa6-bf59-90d0c20948a1 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1409 microversion: 2.54 time: 0.117256 Oct 05 02:55:40.391199 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2707/5397] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:55:40 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1409 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:55:41.022984 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4c672828-1f0c-4c7e-8602-f17061d9a59e tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:41.024487 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4c672828-1f0c-4c7e-8602-f17061d9a59e tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] [instance: 8e79e9df-c543-4c29-b760-63312d8d0ee6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:41.039042 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c672828-1f0c-4c7e-8602-f17061d9a59e tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:41.040894 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c672828-1f0c-4c7e-8602-f17061d9a59e tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:41.041865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c672828-1f0c-4c7e-8602-f17061d9a59e tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:41.042948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c672828-1f0c-4c7e-8602-f17061d9a59e tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:41.043760 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c672828-1f0c-4c7e-8602-f17061d9a59e tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:41.044564 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c672828-1f0c-4c7e-8602-f17061d9a59e tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:41.054339 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:41.233535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4c672828-1f0c-4c7e-8602-f17061d9a59e tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba34319166e041129b4a05926efa2af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aa8602b45c45a2b5d30052aaa01e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:41.249508 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4c672828-1f0c-4c7e-8602-f17061d9a59e tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] 10.222.0.16 "GET /compute/v2.1/servers/8e79e9df-c543-4c29-b760-63312d8d0ee6" status: 200 len: 1314 microversion: 2.1 time: 0.231975 Oct 05 02:55:41.264957 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2691/5398] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:41 2022] GET /compute/v2.1/servers/8e79e9df-c543-4c29-b760-63312d8d0ee6 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:41.417351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-de8dd760-dfbc-44fb-b4cb-c488ba4b688f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:41.418648 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-de8dd760-dfbc-44fb-b4cb-c488ba4b688f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:41.434680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de8dd760-dfbc-44fb-b4cb-c488ba4b688f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:41.435220 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de8dd760-dfbc-44fb-b4cb-c488ba4b688f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:41.437653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de8dd760-dfbc-44fb-b4cb-c488ba4b688f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:41.438459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de8dd760-dfbc-44fb-b4cb-c488ba4b688f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:41.438916 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de8dd760-dfbc-44fb-b4cb-c488ba4b688f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:41.441941 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de8dd760-dfbc-44fb-b4cb-c488ba4b688f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:41.621630 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-de8dd760-dfbc-44fb-b4cb-c488ba4b688f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:41.625947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:41.642725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-de8dd760-dfbc-44fb-b4cb-c488ba4b688f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:41.656349 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-de8dd760-dfbc-44fb-b4cb-c488ba4b688f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:41.658034 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-de8dd760-dfbc-44fb-b4cb-c488ba4b688f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1409 microversion: 2.54 time: 0.244575 Oct 05 02:55:41.658427 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2708/5399] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:55:41 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1409 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:55:42.274860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4ae3e1ff-e34b-4b36-a095-2903bbd50097 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:42.275517 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4ae3e1ff-e34b-4b36-a095-2903bbd50097 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] [instance: 8e79e9df-c543-4c29-b760-63312d8d0ee6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:42.286695 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ae3e1ff-e34b-4b36-a095-2903bbd50097 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:42.287217 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ae3e1ff-e34b-4b36-a095-2903bbd50097 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:42.287867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ae3e1ff-e34b-4b36-a095-2903bbd50097 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:42.288736 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ae3e1ff-e34b-4b36-a095-2903bbd50097 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:42.289302 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ae3e1ff-e34b-4b36-a095-2903bbd50097 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:42.289858 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ae3e1ff-e34b-4b36-a095-2903bbd50097 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:42.477750 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4ae3e1ff-e34b-4b36-a095-2903bbd50097 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba34319166e041129b4a05926efa2af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aa8602b45c45a2b5d30052aaa01e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:42.486780 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4ae3e1ff-e34b-4b36-a095-2903bbd50097 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] 10.222.0.16 "GET /compute/v2.1/servers/8e79e9df-c543-4c29-b760-63312d8d0ee6" status: 200 len: 1314 microversion: 2.1 time: 0.216779 Oct 05 02:55:42.487433 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2692/5400] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:42 2022] GET /compute/v2.1/servers/8e79e9df-c543-4c29-b760-63312d8d0ee6 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:55:42.688997 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-421f98e9-8c9b-433c-8bfd-48bfe5d85ca8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:42.689803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-421f98e9-8c9b-433c-8bfd-48bfe5d85ca8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:42.702217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-421f98e9-8c9b-433c-8bfd-48bfe5d85ca8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:42.703132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-421f98e9-8c9b-433c-8bfd-48bfe5d85ca8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:42.703791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-421f98e9-8c9b-433c-8bfd-48bfe5d85ca8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:42.704818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-421f98e9-8c9b-433c-8bfd-48bfe5d85ca8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:42.706147 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-421f98e9-8c9b-433c-8bfd-48bfe5d85ca8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:42.706807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-421f98e9-8c9b-433c-8bfd-48bfe5d85ca8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:42.837509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-421f98e9-8c9b-433c-8bfd-48bfe5d85ca8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:42.850761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-421f98e9-8c9b-433c-8bfd-48bfe5d85ca8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:42.852958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-421f98e9-8c9b-433c-8bfd-48bfe5d85ca8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:42.854254 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-421f98e9-8c9b-433c-8bfd-48bfe5d85ca8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1409 microversion: 2.54 time: 0.170330 Oct 05 02:55:42.868927 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2709/5401] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:55:42 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1409 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:55:43.510588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e67773a3-1a63-43b4-a921-25a4e2ab3fa7 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:43.511205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e67773a3-1a63-43b4-a921-25a4e2ab3fa7 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] [instance: 8e79e9df-c543-4c29-b760-63312d8d0ee6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:43.525950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e67773a3-1a63-43b4-a921-25a4e2ab3fa7 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:43.526690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e67773a3-1a63-43b4-a921-25a4e2ab3fa7 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:43.527317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e67773a3-1a63-43b4-a921-25a4e2ab3fa7 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:43.528214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e67773a3-1a63-43b4-a921-25a4e2ab3fa7 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:43.528856 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e67773a3-1a63-43b4-a921-25a4e2ab3fa7 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:43.529482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e67773a3-1a63-43b4-a921-25a4e2ab3fa7 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:43.758397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e67773a3-1a63-43b4-a921-25a4e2ab3fa7 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba34319166e041129b4a05926efa2af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aa8602b45c45a2b5d30052aaa01e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:43.767250 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e67773a3-1a63-43b4-a921-25a4e2ab3fa7 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] 10.222.0.16 "GET /compute/v2.1/servers/8e79e9df-c543-4c29-b760-63312d8d0ee6" status: 200 len: 1314 microversion: 2.1 time: 0.260402 Oct 05 02:55:43.781857 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2693/5402] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:43 2022] GET /compute/v2.1/servers/8e79e9df-c543-4c29-b760-63312d8d0ee6 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:43.884996 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d74b3de1-886b-4542-8613-0c2c3737fdb4 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:43.885541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d74b3de1-886b-4542-8613-0c2c3737fdb4 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:43.892482 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d74b3de1-886b-4542-8613-0c2c3737fdb4 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:43.893849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d74b3de1-886b-4542-8613-0c2c3737fdb4 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:43.894483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d74b3de1-886b-4542-8613-0c2c3737fdb4 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:43.895405 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d74b3de1-886b-4542-8613-0c2c3737fdb4 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:43.896042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d74b3de1-886b-4542-8613-0c2c3737fdb4 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:43.896649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d74b3de1-886b-4542-8613-0c2c3737fdb4 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:44.012396 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d74b3de1-886b-4542-8613-0c2c3737fdb4 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:44.021727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d74b3de1-886b-4542-8613-0c2c3737fdb4 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:44.023727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d74b3de1-886b-4542-8613-0c2c3737fdb4 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:44.025299 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d74b3de1-886b-4542-8613-0c2c3737fdb4 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1409 microversion: 2.54 time: 0.144121 Oct 05 02:55:44.026388 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2710/5403] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:55:43 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1409 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:55:44.795352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-28ea80be-dac5-48b1-8b2b-e775aa88f3ac tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:44.795977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-28ea80be-dac5-48b1-8b2b-e775aa88f3ac tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] [instance: 8e79e9df-c543-4c29-b760-63312d8d0ee6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:44.808354 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28ea80be-dac5-48b1-8b2b-e775aa88f3ac tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:44.809675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28ea80be-dac5-48b1-8b2b-e775aa88f3ac tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:44.810234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28ea80be-dac5-48b1-8b2b-e775aa88f3ac tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:44.811130 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28ea80be-dac5-48b1-8b2b-e775aa88f3ac tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:44.812041 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28ea80be-dac5-48b1-8b2b-e775aa88f3ac tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:44.813197 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28ea80be-dac5-48b1-8b2b-e775aa88f3ac tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:45.028391 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-28753a55-c9ec-4eb3-93b5-42f0ff83aca0 req-42178bcd-0773-41c6-8e1e-7b6a447771b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e79e9df-c543-4c29-b760-63312d8d0ee6", "name": "network-vif-plugged", "status": "completed", "tag": "e8ca26f4-74ef-4958-b68d-e09f86c2f94a"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:55:45.038431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-28ea80be-dac5-48b1-8b2b-e775aa88f3ac tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba34319166e041129b4a05926efa2af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aa8602b45c45a2b5d30052aaa01e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:45.041407 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:45.043463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=16 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:45.050300 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-28ea80be-dac5-48b1-8b2b-e775aa88f3ac tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] 10.222.0.16 "GET /compute/v2.1/servers/8e79e9df-c543-4c29-b760-63312d8d0ee6" status: 200 len: 1314 microversion: 2.1 time: 0.259771 Oct 05 02:55:45.053593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-28753a55-c9ec-4eb3-93b5-42f0ff83aca0 req-42178bcd-0773-41c6-8e1e-7b6a447771b3 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:45.054375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-28753a55-c9ec-4eb3-93b5-42f0ff83aca0 req-42178bcd-0773-41c6-8e1e-7b6a447771b3 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:45.054878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-28753a55-c9ec-4eb3-93b5-42f0ff83aca0 req-42178bcd-0773-41c6-8e1e-7b6a447771b3 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:45.060164 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2694/5404] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:44 2022] GET /compute/v2.1/servers/8e79e9df-c543-4c29-b760-63312d8d0ee6 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:45.073908 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1aae9af3-cb42-4f90-b513-d4690282fa56 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:45.074155 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-28753a55-c9ec-4eb3-93b5-42f0ff83aca0 req-42178bcd-0773-41c6-8e1e-7b6a447771b3 service nova] Creating event network-vif-plugged:e8ca26f4-74ef-4958-b68d-e09f86c2f94a for instance 8e79e9df-c543-4c29-b760-63312d8d0ee6 on n-h1-858272-3 Oct 05 02:55:45.074544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1aae9af3-cb42-4f90-b513-d4690282fa56 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:45.081545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=10 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:45.083624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1aae9af3-cb42-4f90-b513-d4690282fa56 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:45.084232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1aae9af3-cb42-4f90-b513-d4690282fa56 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:45.084682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1aae9af3-cb42-4f90-b513-d4690282fa56 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:45.085434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1aae9af3-cb42-4f90-b513-d4690282fa56 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:45.085967 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1aae9af3-cb42-4f90-b513-d4690282fa56 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:45.086423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1aae9af3-cb42-4f90-b513-d4690282fa56 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:45.092389 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-28753a55-c9ec-4eb3-93b5-42f0ff83aca0 req-42178bcd-0773-41c6-8e1e-7b6a447771b3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070089 Oct 05 02:55:45.093750 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2711/5405] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:55:45.197220 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1aae9af3-cb42-4f90-b513-d4690282fa56 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:45.207804 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1aae9af3-cb42-4f90-b513-d4690282fa56 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:45.209388 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1aae9af3-cb42-4f90-b513-d4690282fa56 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:45.210860 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1aae9af3-cb42-4f90-b513-d4690282fa56 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1409 microversion: 2.54 time: 0.149369 Oct 05 02:55:45.211431 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2695/5406] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:55:45 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1409 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:55:46.078311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-17131933-634c-4517-813a-684ee093694d tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:46.079046 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-17131933-634c-4517-813a-684ee093694d tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] [instance: 8e79e9df-c543-4c29-b760-63312d8d0ee6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:46.087285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17131933-634c-4517-813a-684ee093694d tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:46.087908 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17131933-634c-4517-813a-684ee093694d tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:46.088618 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17131933-634c-4517-813a-684ee093694d tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:46.089803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17131933-634c-4517-813a-684ee093694d tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:46.090261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17131933-634c-4517-813a-684ee093694d tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:46.090841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17131933-634c-4517-813a-684ee093694d tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:46.240171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-17131933-634c-4517-813a-684ee093694d tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba34319166e041129b4a05926efa2af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aa8602b45c45a2b5d30052aaa01e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:46.243401 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f14647d6-b972-4378-8b9a-2a24ee710b06 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:46.244818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f14647d6-b972-4378-8b9a-2a24ee710b06 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:46.252053 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-17131933-634c-4517-813a-684ee093694d tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] 10.222.0.16 "GET /compute/v2.1/servers/8e79e9df-c543-4c29-b760-63312d8d0ee6" status: 200 len: 1314 microversion: 2.1 time: 0.179038 Oct 05 02:55:46.258212 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f14647d6-b972-4378-8b9a-2a24ee710b06 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:46.258708 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f14647d6-b972-4378-8b9a-2a24ee710b06 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:46.259143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f14647d6-b972-4378-8b9a-2a24ee710b06 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:46.259844 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f14647d6-b972-4378-8b9a-2a24ee710b06 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:46.260333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f14647d6-b972-4378-8b9a-2a24ee710b06 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:46.260774 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2712/5407] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:46 2022] GET /compute/v2.1/servers/8e79e9df-c543-4c29-b760-63312d8d0ee6 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:55:46.261401 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f14647d6-b972-4378-8b9a-2a24ee710b06 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:46.336853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f14647d6-b972-4378-8b9a-2a24ee710b06 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:46.346573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f14647d6-b972-4378-8b9a-2a24ee710b06 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:46.348214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f14647d6-b972-4378-8b9a-2a24ee710b06 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:46.349749 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f14647d6-b972-4378-8b9a-2a24ee710b06 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1409 microversion: 2.54 time: 0.116158 Oct 05 02:55:46.350451 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2696/5408] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:55:46 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1409 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:55:47.287067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b6719119-a140-43da-b3a5-555b3296b178 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:47.288239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b6719119-a140-43da-b3a5-555b3296b178 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] [instance: 8e79e9df-c543-4c29-b760-63312d8d0ee6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:47.300586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b6719119-a140-43da-b3a5-555b3296b178 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:47.301187 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b6719119-a140-43da-b3a5-555b3296b178 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:47.301704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b6719119-a140-43da-b3a5-555b3296b178 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:47.302557 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b6719119-a140-43da-b3a5-555b3296b178 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:47.303081 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b6719119-a140-43da-b3a5-555b3296b178 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:47.303581 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b6719119-a140-43da-b3a5-555b3296b178 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:47.382915 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1a1e25f7-a110-45d3-9020-697b308dc510 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:47.383725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1a1e25f7-a110-45d3-9020-697b308dc510 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:47.393717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a1e25f7-a110-45d3-9020-697b308dc510 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:47.395270 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a1e25f7-a110-45d3-9020-697b308dc510 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:47.398878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a1e25f7-a110-45d3-9020-697b308dc510 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:47.401152 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a1e25f7-a110-45d3-9020-697b308dc510 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:47.402914 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a1e25f7-a110-45d3-9020-697b308dc510 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:47.406938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a1e25f7-a110-45d3-9020-697b308dc510 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:47.504373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b6719119-a140-43da-b3a5-555b3296b178 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba34319166e041129b4a05926efa2af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aa8602b45c45a2b5d30052aaa01e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:47.519287 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b6719119-a140-43da-b3a5-555b3296b178 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] 10.222.0.16 "GET /compute/v2.1/servers/8e79e9df-c543-4c29-b760-63312d8d0ee6" status: 200 len: 1498 microversion: 2.1 time: 0.238307 Oct 05 02:55:47.520195 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2713/5409] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:47 2022] GET /compute/v2.1/servers/8e79e9df-c543-4c29-b760-63312d8d0ee6 => generated 1498 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:47.555121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1a1e25f7-a110-45d3-9020-697b308dc510 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:47.566132 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1a1e25f7-a110-45d3-9020-697b308dc510 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:47.567641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1a1e25f7-a110-45d3-9020-697b308dc510 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:47.569238 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1a1e25f7-a110-45d3-9020-697b308dc510 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1409 microversion: 2.54 time: 0.192022 Oct 05 02:55:47.570339 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2697/5410] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:55:47 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1409 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:55:48.604184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-55f1f4a9-57ce-4793-8ba7-01c4f8ee5ecd tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:48.605147 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-55f1f4a9-57ce-4793-8ba7-01c4f8ee5ecd tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:48.613908 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55f1f4a9-57ce-4793-8ba7-01c4f8ee5ecd tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:48.614575 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55f1f4a9-57ce-4793-8ba7-01c4f8ee5ecd tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:48.615199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55f1f4a9-57ce-4793-8ba7-01c4f8ee5ecd tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:48.616138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55f1f4a9-57ce-4793-8ba7-01c4f8ee5ecd tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:48.616802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55f1f4a9-57ce-4793-8ba7-01c4f8ee5ecd tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:48.617653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55f1f4a9-57ce-4793-8ba7-01c4f8ee5ecd tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:48.696709 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-55f1f4a9-57ce-4793-8ba7-01c4f8ee5ecd tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:48.707376 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-55f1f4a9-57ce-4793-8ba7-01c4f8ee5ecd tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:48.709073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-55f1f4a9-57ce-4793-8ba7-01c4f8ee5ecd tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:48.710480 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-55f1f4a9-57ce-4793-8ba7-01c4f8ee5ecd tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1409 microversion: 2.54 time: 0.113523 Oct 05 02:55:48.722471 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2714/5411] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:55:48 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1409 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:55:49.737943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3dea1fd7-3299-49e9-bc86-03774f5ae95f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:49.738796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3dea1fd7-3299-49e9-bc86-03774f5ae95f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:49.745569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3dea1fd7-3299-49e9-bc86-03774f5ae95f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:49.746350 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3dea1fd7-3299-49e9-bc86-03774f5ae95f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:49.746984 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3dea1fd7-3299-49e9-bc86-03774f5ae95f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:49.747934 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3dea1fd7-3299-49e9-bc86-03774f5ae95f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:49.748747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3dea1fd7-3299-49e9-bc86-03774f5ae95f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:49.749387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3dea1fd7-3299-49e9-bc86-03774f5ae95f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:49.827994 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3dea1fd7-3299-49e9-bc86-03774f5ae95f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:49.836716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3dea1fd7-3299-49e9-bc86-03774f5ae95f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:49.838636 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3dea1fd7-3299-49e9-bc86-03774f5ae95f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:49.840209 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3dea1fd7-3299-49e9-bc86-03774f5ae95f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1409 microversion: 2.54 time: 0.106417 Oct 05 02:55:49.840772 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2698/5412] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:55:49 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1409 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:55:50.152350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0e2c6f79-696d-4251-a77e-785b86955fb4 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:50.153554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0e2c6f79-696d-4251-a77e-785b86955fb4 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] [instance: 8e79e9df-c543-4c29-b760-63312d8d0ee6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:50.163329 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e2c6f79-696d-4251-a77e-785b86955fb4 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:50.163820 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e2c6f79-696d-4251-a77e-785b86955fb4 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:50.164430 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e2c6f79-696d-4251-a77e-785b86955fb4 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:50.165184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e2c6f79-696d-4251-a77e-785b86955fb4 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:50.165697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e2c6f79-696d-4251-a77e-785b86955fb4 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:50.166125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e2c6f79-696d-4251-a77e-785b86955fb4 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:50.196079 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0e2c6f79-696d-4251-a77e-785b86955fb4 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] [instance: 8e79e9df-c543-4c29-b760-63312d8d0ee6] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:55:50.285069 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0e2c6f79-696d-4251-a77e-785b86955fb4 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8e79e9df-c543-4c29-b760-63312d8d0ee6" status: 204 len: 0 microversion: 2.1 time: 0.137182 Oct 05 02:55:50.285920 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2715/5413] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:55:50 2022] DELETE /compute/v2.1/servers/8e79e9df-c543-4c29-b760-63312d8d0ee6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:55:50.294042 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ed45993f-2c2b-4d40-b06a-98ea77ad442c tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:50.294885 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ed45993f-2c2b-4d40-b06a-98ea77ad442c tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] [instance: 8e79e9df-c543-4c29-b760-63312d8d0ee6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:50.302105 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed45993f-2c2b-4d40-b06a-98ea77ad442c tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:50.302740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed45993f-2c2b-4d40-b06a-98ea77ad442c tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:50.303277 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed45993f-2c2b-4d40-b06a-98ea77ad442c tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:50.304099 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed45993f-2c2b-4d40-b06a-98ea77ad442c tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:50.304653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed45993f-2c2b-4d40-b06a-98ea77ad442c tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:50.305322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed45993f-2c2b-4d40-b06a-98ea77ad442c tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:50.447182 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ed45993f-2c2b-4d40-b06a-98ea77ad442c tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba34319166e041129b4a05926efa2af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aa8602b45c45a2b5d30052aaa01e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:50.456524 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ed45993f-2c2b-4d40-b06a-98ea77ad442c tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] 10.222.0.16 "GET /compute/v2.1/servers/8e79e9df-c543-4c29-b760-63312d8d0ee6" status: 200 len: 1504 microversion: 2.1 time: 0.166215 Oct 05 02:55:50.457960 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2699/5414] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:50 2022] GET /compute/v2.1/servers/8e79e9df-c543-4c29-b760-63312d8d0ee6 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:55:50.868744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0548e682-7a25-4429-a541-96b266b011ef tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:50.869484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0548e682-7a25-4429-a541-96b266b011ef tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:50.875598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0548e682-7a25-4429-a541-96b266b011ef tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:50.876098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0548e682-7a25-4429-a541-96b266b011ef tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:50.876541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0548e682-7a25-4429-a541-96b266b011ef tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:50.877809 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0548e682-7a25-4429-a541-96b266b011ef tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:50.878605 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0548e682-7a25-4429-a541-96b266b011ef tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:50.879030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0548e682-7a25-4429-a541-96b266b011ef tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:50.948018 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0548e682-7a25-4429-a541-96b266b011ef tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:50.960276 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0548e682-7a25-4429-a541-96b266b011ef tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:50.962397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0548e682-7a25-4429-a541-96b266b011ef tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:50.963709 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0548e682-7a25-4429-a541-96b266b011ef tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1409 microversion: 2.54 time: 0.099210 Oct 05 02:55:50.964296 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2716/5415] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:55:50 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1409 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:55:51.481896 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-15522173-a722-41aa-be7d-0cf793ea99ce tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:51.482812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-15522173-a722-41aa-be7d-0cf793ea99ce tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] [instance: 8e79e9df-c543-4c29-b760-63312d8d0ee6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:51.490807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-15522173-a722-41aa-be7d-0cf793ea99ce tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:51.491298 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-15522173-a722-41aa-be7d-0cf793ea99ce tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:51.491749 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-15522173-a722-41aa-be7d-0cf793ea99ce tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:51.492458 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-15522173-a722-41aa-be7d-0cf793ea99ce tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:51.493093 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-15522173-a722-41aa-be7d-0cf793ea99ce tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:51.493528 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-15522173-a722-41aa-be7d-0cf793ea99ce tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:51.787000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-15522173-a722-41aa-be7d-0cf793ea99ce tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba34319166e041129b4a05926efa2af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aa8602b45c45a2b5d30052aaa01e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:51.797263 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-15522173-a722-41aa-be7d-0cf793ea99ce tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] 10.222.0.16 "GET /compute/v2.1/servers/8e79e9df-c543-4c29-b760-63312d8d0ee6" status: 200 len: 1504 microversion: 2.1 time: 0.319286 Oct 05 02:55:51.798161 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2700/5416] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:51 2022] GET /compute/v2.1/servers/8e79e9df-c543-4c29-b760-63312d8d0ee6 => generated 1504 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:55:51.997016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-db58e44c-3336-4cbc-9ca3-3dcbc20ed0c1 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:51.999057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-db58e44c-3336-4cbc-9ca3-3dcbc20ed0c1 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:52.012718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db58e44c-3336-4cbc-9ca3-3dcbc20ed0c1 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:52.015329 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db58e44c-3336-4cbc-9ca3-3dcbc20ed0c1 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:52.016194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db58e44c-3336-4cbc-9ca3-3dcbc20ed0c1 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:52.017374 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db58e44c-3336-4cbc-9ca3-3dcbc20ed0c1 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:52.018876 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db58e44c-3336-4cbc-9ca3-3dcbc20ed0c1 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:52.019539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db58e44c-3336-4cbc-9ca3-3dcbc20ed0c1 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:52.120606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-db58e44c-3336-4cbc-9ca3-3dcbc20ed0c1 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:52.134335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-db58e44c-3336-4cbc-9ca3-3dcbc20ed0c1 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:52.141606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-db58e44c-3336-4cbc-9ca3-3dcbc20ed0c1 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:52.141606 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-db58e44c-3336-4cbc-9ca3-3dcbc20ed0c1 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1409 microversion: 2.54 time: 0.154100 Oct 05 02:55:52.142518 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2717/5417] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:55:51 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1409 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:55:52.467932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-074df1a0-6bad-46f3-af66-5e32205ce1da req-b7cf7a34-7e5e-404d-b91c-5200095847cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e79e9df-c543-4c29-b760-63312d8d0ee6", "name": "network-vif-deleted", "tag": "e8ca26f4-74ef-4958-b68d-e09f86c2f94a"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:55:52.479691 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-074df1a0-6bad-46f3-af66-5e32205ce1da req-b7cf7a34-7e5e-404d-b91c-5200095847cd service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:52.480464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-074df1a0-6bad-46f3-af66-5e32205ce1da req-b7cf7a34-7e5e-404d-b91c-5200095847cd service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:52.481079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-074df1a0-6bad-46f3-af66-5e32205ce1da req-b7cf7a34-7e5e-404d-b91c-5200095847cd service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:52.495316 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-074df1a0-6bad-46f3-af66-5e32205ce1da req-b7cf7a34-7e5e-404d-b91c-5200095847cd service nova] Creating event network-vif-deleted:e8ca26f4-74ef-4958-b68d-e09f86c2f94a for instance 8e79e9df-c543-4c29-b760-63312d8d0ee6 on n-h1-858272-3 Oct 05 02:55:52.506830 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-074df1a0-6bad-46f3-af66-5e32205ce1da req-b7cf7a34-7e5e-404d-b91c-5200095847cd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042696 Oct 05 02:55:52.507500 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2701/5418] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:55:52.823479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1684dcb0-a121-474f-b307-542b61377d9e tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:52.824098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1684dcb0-a121-474f-b307-542b61377d9e tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] [instance: 8e79e9df-c543-4c29-b760-63312d8d0ee6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:52.831479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1684dcb0-a121-474f-b307-542b61377d9e tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:52.832183 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1684dcb0-a121-474f-b307-542b61377d9e tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:52.832625 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1684dcb0-a121-474f-b307-542b61377d9e tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:52.833375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1684dcb0-a121-474f-b307-542b61377d9e tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:52.834000 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1684dcb0-a121-474f-b307-542b61377d9e tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:52.834432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1684dcb0-a121-474f-b307-542b61377d9e tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:52.871644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1684dcb0-a121-474f-b307-542b61377d9e tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:52.872371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1684dcb0-a121-474f-b307-542b61377d9e tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:52.873036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1684dcb0-a121-474f-b307-542b61377d9e tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:52.884292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-1684dcb0-a121-474f-b307-542b61377d9e tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lazy-loading 'fault' on Instance uuid 8e79e9df-c543-4c29-b760-63312d8d0ee6 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:55:52.940598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1684dcb0-a121-474f-b307-542b61377d9e tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba34319166e041129b4a05926efa2af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10aa8602b45c45a2b5d30052aaa01e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:52.951621 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1684dcb0-a121-474f-b307-542b61377d9e tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] 10.222.0.16 "GET /compute/v2.1/servers/8e79e9df-c543-4c29-b760-63312d8d0ee6" status: 200 len: 1304 microversion: 2.1 time: 0.131578 Oct 05 02:55:52.952734 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2718/5419] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:52 2022] GET /compute/v2.1/servers/8e79e9df-c543-4c29-b760-63312d8d0ee6 => generated 1304 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:53.168512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-df166bd1-4f3d-4d97-99cc-e776957b57e7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:53.169967 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-df166bd1-4f3d-4d97-99cc-e776957b57e7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:53.177705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df166bd1-4f3d-4d97-99cc-e776957b57e7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:53.178900 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df166bd1-4f3d-4d97-99cc-e776957b57e7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:53.179921 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df166bd1-4f3d-4d97-99cc-e776957b57e7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:53.181082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df166bd1-4f3d-4d97-99cc-e776957b57e7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:53.181880 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df166bd1-4f3d-4d97-99cc-e776957b57e7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:53.182721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df166bd1-4f3d-4d97-99cc-e776957b57e7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:53.267579 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-df166bd1-4f3d-4d97-99cc-e776957b57e7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:53.282562 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-df166bd1-4f3d-4d97-99cc-e776957b57e7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:53.284800 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-df166bd1-4f3d-4d97-99cc-e776957b57e7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:53.286049 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-df166bd1-4f3d-4d97-99cc-e776957b57e7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1409 microversion: 2.54 time: 0.122029 Oct 05 02:55:53.286621 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2702/5420] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:55:53 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1409 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:55:53.976985 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a05b579a-b2cb-46ad-b5ea-83bba68f3602 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:53.978286 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a05b579a-b2cb-46ad-b5ea-83bba68f3602 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] [instance: 8e79e9df-c543-4c29-b760-63312d8d0ee6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:53.988800 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a05b579a-b2cb-46ad-b5ea-83bba68f3602 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:53.989545 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a05b579a-b2cb-46ad-b5ea-83bba68f3602 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:53.990420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a05b579a-b2cb-46ad-b5ea-83bba68f3602 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:53.991357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a05b579a-b2cb-46ad-b5ea-83bba68f3602 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:53.992033 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a05b579a-b2cb-46ad-b5ea-83bba68f3602 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:53.992665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a05b579a-b2cb-46ad-b5ea-83bba68f3602 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:54.011221 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-a05b579a-b2cb-46ad-b5ea-83bba68f3602 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] HTTP exception thrown: Instance 8e79e9df-c543-4c29-b760-63312d8d0ee6 could not be found. Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a05b579a-b2cb-46ad-b5ea-83bba68f3602 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Request method failure captured: Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/8e79e9df-c543-4c29-b760-63312d8d0ee6 HTTP/1.1 Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPIkMKLxVZSDgKZYKxLEcWnumUX60eamq8vcY6nXHu5U-AC5qQRmwFBXuql3HsXSYqcGogIbn3An6N93VOjVFEkVjUhJrjs9RSo80xlJRxg8Dcgit0_84QmhpQUtpG6RxScEijVyUJ3AG_HAw_RTW_hnOKlovVjxwZBTe914tVFd-tU Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 10aa8602b45c45a2b5d30052aaa01e42 Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-VolumesActionsTest-915229109 Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10aa8602b45c45a2b5d30052aaa01e42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/10aa8602b45c45a2b5d30052aaa01e42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/10aa8602b45c45a2b5d30052aaa01e42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_10aa8602b45c45a2b5d30052aaa01e42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-VolumesActionsTest-915229109 Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 10aa8602b45c45a2b5d30052aaa01e42 Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-VolumesActionsTest-915229109 Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-VolumesActionsTest-915229109-project Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: ba34319166e041129b4a05926efa2af3 Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-VolumesActionsTest-915229109-project Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 8e79e9df-c543-4c29-b760-63312d8d0ee6 could not be found. Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '8e79e9df-c543-4c29-b760-63312d8d0ee6'} Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e79e9df-c543-4c29-b760-63312d8d0ee6 could not be found. Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e79e9df-c543-4c29-b760-63312d8d0ee6 could not be found. Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:55:54.013820 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:54.018726 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:55:54.018726 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:55:54.018726 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:55:54.018726 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:55:54.018726 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:55:54.018726 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e79e9df-c543-4c29-b760-63312d8d0ee6 could not be found. Oct 05 02:55:54.018726 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:55:54.021498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a05b579a-b2cb-46ad-b5ea-83bba68f3602 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] Returning 404 to user: Instance 8e79e9df-c543-4c29-b760-63312d8d0ee6 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:55:54.022562 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a05b579a-b2cb-46ad-b5ea-83bba68f3602 tempest-VolumesActionsTest-915229109 tempest-VolumesActionsTest-915229109-project] 10.222.0.16 "GET /compute/v2.1/servers/8e79e9df-c543-4c29-b760-63312d8d0ee6" status: 404 len: 111 microversion: 2.1 time: 0.050419 Oct 05 02:55:54.023947 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2719/5421] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:53 2022] GET /compute/v2.1/servers/8e79e9df-c543-4c29-b760-63312d8d0ee6 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:55:54.314249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8d5a164e-90a6-433b-a42a-297b3085df54 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:54.314932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8d5a164e-90a6-433b-a42a-297b3085df54 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:54.323937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d5a164e-90a6-433b-a42a-297b3085df54 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:54.324537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d5a164e-90a6-433b-a42a-297b3085df54 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:54.324851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d5a164e-90a6-433b-a42a-297b3085df54 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:54.325575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d5a164e-90a6-433b-a42a-297b3085df54 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:54.326026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d5a164e-90a6-433b-a42a-297b3085df54 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:54.326437 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d5a164e-90a6-433b-a42a-297b3085df54 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:54.423260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8d5a164e-90a6-433b-a42a-297b3085df54 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:54.435098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8d5a164e-90a6-433b-a42a-297b3085df54 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:54.442912 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8d5a164e-90a6-433b-a42a-297b3085df54 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:54.445189 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8d5a164e-90a6-433b-a42a-297b3085df54 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1409 microversion: 2.54 time: 0.134241 Oct 05 02:55:54.463305 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2703/5422] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:55:54 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1409 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:55:55.475590 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b5792e6a-0031-471b-9094-9ebcf42a8c73 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:55.477673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b5792e6a-0031-471b-9094-9ebcf42a8c73 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:55.489377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5792e6a-0031-471b-9094-9ebcf42a8c73 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:55.493037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5792e6a-0031-471b-9094-9ebcf42a8c73 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:55.496080 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5792e6a-0031-471b-9094-9ebcf42a8c73 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:55.501574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5792e6a-0031-471b-9094-9ebcf42a8c73 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:55.502389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5792e6a-0031-471b-9094-9ebcf42a8c73 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:55.503862 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5792e6a-0031-471b-9094-9ebcf42a8c73 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:55.671320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b5792e6a-0031-471b-9094-9ebcf42a8c73 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:55.684410 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b5792e6a-0031-471b-9094-9ebcf42a8c73 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:55.686710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b5792e6a-0031-471b-9094-9ebcf42a8c73 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:55.688258 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b5792e6a-0031-471b-9094-9ebcf42a8c73 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1409 microversion: 2.54 time: 0.218399 Oct 05 02:55:55.697440 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2720/5423] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:55:55 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1409 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:55:56.716978 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0581287b-d3fc-41d9-9502-b41b6f37b100 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:56.717617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0581287b-d3fc-41d9-9502-b41b6f37b100 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:56.731403 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0581287b-d3fc-41d9-9502-b41b6f37b100 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:56.732582 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0581287b-d3fc-41d9-9502-b41b6f37b100 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:56.734834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0581287b-d3fc-41d9-9502-b41b6f37b100 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:56.735850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0581287b-d3fc-41d9-9502-b41b6f37b100 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:56.736246 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0581287b-d3fc-41d9-9502-b41b6f37b100 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:56.737672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0581287b-d3fc-41d9-9502-b41b6f37b100 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:56.825417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0581287b-d3fc-41d9-9502-b41b6f37b100 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:56.835352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0581287b-d3fc-41d9-9502-b41b6f37b100 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:56.836954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0581287b-d3fc-41d9-9502-b41b6f37b100 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:56.838524 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0581287b-d3fc-41d9-9502-b41b6f37b100 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1409 microversion: 2.54 time: 0.125885 Oct 05 02:55:56.839369 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2704/5424] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:55:56 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1409 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:55:57.764013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b3837c90-f7e6-406d-8c98-dd6fa89b9de6 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1371789637", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "5d65842c-94e4-451b-b58e-57d4c677e30d"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:55:57.823565 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-b3837c90-f7e6-406d-8c98-dd6fa89b9de6 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] validate_networks() for [('5d65842c-94e4-451b-b58e-57d4c677e30d', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:55:57.868404 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-52c03675-74b1-40f8-ada3-9e951f14dabd tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:57.869004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-52c03675-74b1-40f8-ada3-9e951f14dabd tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:57.877905 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52c03675-74b1-40f8-ada3-9e951f14dabd tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:57.878899 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52c03675-74b1-40f8-ada3-9e951f14dabd tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:57.879335 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52c03675-74b1-40f8-ada3-9e951f14dabd tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:57.880035 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52c03675-74b1-40f8-ada3-9e951f14dabd tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:57.880482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52c03675-74b1-40f8-ada3-9e951f14dabd tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:57.881105 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52c03675-74b1-40f8-ada3-9e951f14dabd tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:57.954254 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-52c03675-74b1-40f8-ada3-9e951f14dabd tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:57.963357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-52c03675-74b1-40f8-ada3-9e951f14dabd tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:57.964805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-52c03675-74b1-40f8-ada3-9e951f14dabd tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:57.967931 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-52c03675-74b1-40f8-ada3-9e951f14dabd tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1415 microversion: 2.54 time: 0.103588 Oct 05 02:55:57.968498 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2705/5425] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:55:57 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1415 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:55:58.216820 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-b3837c90-f7e6-406d-8c98-dd6fa89b9de6 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:55:58.217330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-b3837c90-f7e6-406d-8c98-dd6fa89b9de6 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:55:58.217807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-b3837c90-f7e6-406d-8c98-dd6fa89b9de6 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:55:58.218217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-b3837c90-f7e6-406d-8c98-dd6fa89b9de6 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:55:58.218627 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-b3837c90-f7e6-406d-8c98-dd6fa89b9de6 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:55:58.229556 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3837c90-f7e6-406d-8c98-dd6fa89b9de6 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:58.230086 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3837c90-f7e6-406d-8c98-dd6fa89b9de6 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:58.230571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3837c90-f7e6-406d-8c98-dd6fa89b9de6 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:58.231294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3837c90-f7e6-406d-8c98-dd6fa89b9de6 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:58.231748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3837c90-f7e6-406d-8c98-dd6fa89b9de6 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:58.232180 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3837c90-f7e6-406d-8c98-dd6fa89b9de6 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:58.250427 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-b3837c90-f7e6-406d-8c98-dd6fa89b9de6 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Getting quotas for project 6345a777ff224f558120171bee710f6a. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:55:58.256716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-b3837c90-f7e6-406d-8c98-dd6fa89b9de6 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Getting quotas for user de963cdc932941c7bac32406ee190634 and project 6345a777ff224f558120171bee710f6a. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:55:58.269913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b3837c90-f7e6-406d-8c98-dd6fa89b9de6 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:55:58.272254 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b3837c90-f7e6-406d-8c98-dd6fa89b9de6 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: 3ad95026-ac80-442e-b377-45e769c67de7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:55:58.321202 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b3837c90-f7e6-406d-8c98-dd6fa89b9de6 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.561097 Oct 05 02:55:58.321977 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2721/5426] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:55:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:55:58.332983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fc5dd204-8254-4abf-9166-a5d29c2e0535 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:58.333807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fc5dd204-8254-4abf-9166-a5d29c2e0535 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: 3ad95026-ac80-442e-b377-45e769c67de7] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:58.417265 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fc5dd204-8254-4abf-9166-a5d29c2e0535 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de963cdc932941c7bac32406ee190634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6345a777ff224f558120171bee710f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:58.425602 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fc5dd204-8254-4abf-9166-a5d29c2e0535 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "GET /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7" status: 200 len: 1219 microversion: 2.1 time: 0.096117 Oct 05 02:55:58.426385 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2706/5427] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:58 2022] GET /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:58.996250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2bfad579-3922-4b9c-9eef-ebb61096d30e tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:58.997013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2bfad579-3922-4b9c-9eef-ebb61096d30e tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:59.004489 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2bfad579-3922-4b9c-9eef-ebb61096d30e tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:59.005003 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2bfad579-3922-4b9c-9eef-ebb61096d30e tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:59.005442 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2bfad579-3922-4b9c-9eef-ebb61096d30e tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:59.006140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2bfad579-3922-4b9c-9eef-ebb61096d30e tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:59.006592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2bfad579-3922-4b9c-9eef-ebb61096d30e tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:59.007013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2bfad579-3922-4b9c-9eef-ebb61096d30e tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:59.073325 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2bfad579-3922-4b9c-9eef-ebb61096d30e tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:59.083286 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2bfad579-3922-4b9c-9eef-ebb61096d30e tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:59.085294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2bfad579-3922-4b9c-9eef-ebb61096d30e tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:59.086645 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2bfad579-3922-4b9c-9eef-ebb61096d30e tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1415 microversion: 2.54 time: 0.095924 Oct 05 02:55:59.087306 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2722/5428] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:55:58 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1415 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:55:59.449279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-148fa640-ae33-4482-ac43-a63eb5b78f67 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:55:59.450187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-148fa640-ae33-4482-ac43-a63eb5b78f67 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: 3ad95026-ac80-442e-b377-45e769c67de7] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:55:59.461177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-148fa640-ae33-4482-ac43-a63eb5b78f67 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:59.461763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-148fa640-ae33-4482-ac43-a63eb5b78f67 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:59.462274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-148fa640-ae33-4482-ac43-a63eb5b78f67 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:59.463106 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-148fa640-ae33-4482-ac43-a63eb5b78f67 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:55:59.463639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-148fa640-ae33-4482-ac43-a63eb5b78f67 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:55:59.464135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-148fa640-ae33-4482-ac43-a63eb5b78f67 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:55:59.539734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-148fa640-ae33-4482-ac43-a63eb5b78f67 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de963cdc932941c7bac32406ee190634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6345a777ff224f558120171bee710f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:55:59.553047 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-148fa640-ae33-4482-ac43-a63eb5b78f67 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "GET /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7" status: 200 len: 1271 microversion: 2.1 time: 0.105583 Oct 05 02:55:59.553945 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2707/5429] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:55:59 2022] GET /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7 => generated 1271 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:56:00.116241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8bbfa1be-5a1d-45fe-ad0c-9f1e8999dfbe tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:00.117246 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8bbfa1be-5a1d-45fe-ad0c-9f1e8999dfbe tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:00.124417 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bbfa1be-5a1d-45fe-ad0c-9f1e8999dfbe tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:00.125523 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bbfa1be-5a1d-45fe-ad0c-9f1e8999dfbe tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:00.126759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bbfa1be-5a1d-45fe-ad0c-9f1e8999dfbe tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:00.128727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bbfa1be-5a1d-45fe-ad0c-9f1e8999dfbe tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:00.129436 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bbfa1be-5a1d-45fe-ad0c-9f1e8999dfbe tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:00.130061 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8bbfa1be-5a1d-45fe-ad0c-9f1e8999dfbe tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:00.240239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8bbfa1be-5a1d-45fe-ad0c-9f1e8999dfbe tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:00.256529 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8bbfa1be-5a1d-45fe-ad0c-9f1e8999dfbe tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:00.259310 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8bbfa1be-5a1d-45fe-ad0c-9f1e8999dfbe tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:00.261440 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8bbfa1be-5a1d-45fe-ad0c-9f1e8999dfbe tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1415 microversion: 2.54 time: 0.149452 Oct 05 02:56:00.263124 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2723/5430] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:00 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1415 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:00.577293 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-039a6a45-3ac8-4a42-9a49-b7eb0037350a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:00.577757 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-039a6a45-3ac8-4a42-9a49-b7eb0037350a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: 3ad95026-ac80-442e-b377-45e769c67de7] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:00.585146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-039a6a45-3ac8-4a42-9a49-b7eb0037350a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:00.585724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-039a6a45-3ac8-4a42-9a49-b7eb0037350a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:00.586096 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-039a6a45-3ac8-4a42-9a49-b7eb0037350a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:00.586806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-039a6a45-3ac8-4a42-9a49-b7eb0037350a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:00.587309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-039a6a45-3ac8-4a42-9a49-b7eb0037350a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:00.587679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-039a6a45-3ac8-4a42-9a49-b7eb0037350a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:00.837100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-039a6a45-3ac8-4a42-9a49-b7eb0037350a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de963cdc932941c7bac32406ee190634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6345a777ff224f558120171bee710f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:00.844960 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-039a6a45-3ac8-4a42-9a49-b7eb0037350a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "GET /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7" status: 200 len: 1319 microversion: 2.1 time: 0.272126 Oct 05 02:56:00.846224 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2708/5431] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:56:00 2022] GET /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7 => generated 1319 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:56:01.237209 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-fd3265c3-ed71-4127-be9f-4b8160a11bef req-747c59a4-cfe9-4756-b2d6-0afedfea482e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ad95026-ac80-442e-b377-45e769c67de7", "tag": "10f8bb12-de52-45fa-a1be-80bd71bedbee"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:56:01.253664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-fd3265c3-ed71-4127-be9f-4b8160a11bef req-747c59a4-cfe9-4756-b2d6-0afedfea482e service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:01.254522 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-fd3265c3-ed71-4127-be9f-4b8160a11bef req-747c59a4-cfe9-4756-b2d6-0afedfea482e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:01.255116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-fd3265c3-ed71-4127-be9f-4b8160a11bef req-747c59a4-cfe9-4756-b2d6-0afedfea482e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:01.280887 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-fd3265c3-ed71-4127-be9f-4b8160a11bef req-747c59a4-cfe9-4756-b2d6-0afedfea482e service nova] Creating event network-changed:10f8bb12-de52-45fa-a1be-80bd71bedbee for instance 3ad95026-ac80-442e-b377-45e769c67de7 on n-h1-858272-3 Oct 05 02:56:01.290900 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-610c223d-2e18-4063-b13c-25739550839d tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:01.291156 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-fd3265c3-ed71-4127-be9f-4b8160a11bef req-747c59a4-cfe9-4756-b2d6-0afedfea482e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058461 Oct 05 02:56:01.291519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-610c223d-2e18-4063-b13c-25739550839d tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:01.292769 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2724/5432] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:56:01.300602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-610c223d-2e18-4063-b13c-25739550839d tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:01.302510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-610c223d-2e18-4063-b13c-25739550839d tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:01.303297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-610c223d-2e18-4063-b13c-25739550839d tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:01.304718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-610c223d-2e18-4063-b13c-25739550839d tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:01.305514 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-610c223d-2e18-4063-b13c-25739550839d tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:01.306155 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-610c223d-2e18-4063-b13c-25739550839d tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:01.329776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:01.401676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-610c223d-2e18-4063-b13c-25739550839d tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:01.412034 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-610c223d-2e18-4063-b13c-25739550839d tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:01.414459 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-610c223d-2e18-4063-b13c-25739550839d tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:01.415635 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-610c223d-2e18-4063-b13c-25739550839d tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1415 microversion: 2.54 time: 0.129372 Oct 05 02:56:01.416359 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2709/5433] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:01 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1415 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:56:01.868229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2383902e-7f82-4563-a98d-7036dcf06ff8 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:01.869015 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2383902e-7f82-4563-a98d-7036dcf06ff8 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: 3ad95026-ac80-442e-b377-45e769c67de7] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:01.875571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2383902e-7f82-4563-a98d-7036dcf06ff8 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:01.876070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2383902e-7f82-4563-a98d-7036dcf06ff8 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:01.876540 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2383902e-7f82-4563-a98d-7036dcf06ff8 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:01.877853 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2383902e-7f82-4563-a98d-7036dcf06ff8 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:01.879030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2383902e-7f82-4563-a98d-7036dcf06ff8 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:01.879718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2383902e-7f82-4563-a98d-7036dcf06ff8 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:02.025780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2383902e-7f82-4563-a98d-7036dcf06ff8 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de963cdc932941c7bac32406ee190634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6345a777ff224f558120171bee710f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:02.033428 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2383902e-7f82-4563-a98d-7036dcf06ff8 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "GET /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7" status: 200 len: 1319 microversion: 2.1 time: 0.169431 Oct 05 02:56:02.033999 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2725/5434] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:56:01 2022] GET /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:56:02.443253 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-358b2524-02f1-456f-9c4f-5a34eb4dc037 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:02.444689 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-358b2524-02f1-456f-9c4f-5a34eb4dc037 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:02.458434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-358b2524-02f1-456f-9c4f-5a34eb4dc037 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:02.459084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-358b2524-02f1-456f-9c4f-5a34eb4dc037 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:02.459518 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-358b2524-02f1-456f-9c4f-5a34eb4dc037 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:02.460228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-358b2524-02f1-456f-9c4f-5a34eb4dc037 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:02.460875 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-358b2524-02f1-456f-9c4f-5a34eb4dc037 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:02.461320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-358b2524-02f1-456f-9c4f-5a34eb4dc037 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:02.536742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-358b2524-02f1-456f-9c4f-5a34eb4dc037 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:02.547655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-358b2524-02f1-456f-9c4f-5a34eb4dc037 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:02.549637 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-358b2524-02f1-456f-9c4f-5a34eb4dc037 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:02.550820 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-358b2524-02f1-456f-9c4f-5a34eb4dc037 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1400 microversion: 2.54 time: 0.113295 Oct 05 02:56:02.551379 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2710/5435] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:02 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1400 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:02.577532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dd08e067-e4b6-4de9-95a7-fe59f26ba25f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '.version_select at 0x7fccdfca81f0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:02.598953 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-dd08e067-e4b6-4de9-95a7-fe59f26ba25f tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1979860779" status: 204 len: 0 microversion: 2.54 time: 0.025541 Oct 05 02:56:02.599536 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2726/5436] 10.222.0.16 () {60 vars in 1319 bytes} [Wed Oct 5 02:56:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1979860779 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 02:56:02.617080 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1557915d-0881-4e81-afc7-e4c90be39e1a tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:02.617668 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1557915d-0881-4e81-afc7-e4c90be39e1a tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:02.624681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1557915d-0881-4e81-afc7-e4c90be39e1a tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:02.625421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1557915d-0881-4e81-afc7-e4c90be39e1a tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:02.626139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1557915d-0881-4e81-afc7-e4c90be39e1a tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:02.627698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1557915d-0881-4e81-afc7-e4c90be39e1a tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:02.629300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1557915d-0881-4e81-afc7-e4c90be39e1a tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:02.629928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1557915d-0881-4e81-afc7-e4c90be39e1a tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:02.656289 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1557915d-0881-4e81-afc7-e4c90be39e1a tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:56:02.742724 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1557915d-0881-4e81-afc7-e4c90be39e1a tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 204 len: 0 microversion: 2.54 time: 0.131175 Oct 05 02:56:02.743477 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2711/5437] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 5 02:56:02 2022] DELETE /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 05 02:56:02.752354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a5c30569-cb5c-4010-971e-887a83baf7c8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:02.753350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a5c30569-cb5c-4010-971e-887a83baf7c8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:02.764131 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5c30569-cb5c-4010-971e-887a83baf7c8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:02.764722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5c30569-cb5c-4010-971e-887a83baf7c8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:02.765321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5c30569-cb5c-4010-971e-887a83baf7c8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:02.765994 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5c30569-cb5c-4010-971e-887a83baf7c8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:02.766447 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5c30569-cb5c-4010-971e-887a83baf7c8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:02.766869 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5c30569-cb5c-4010-971e-887a83baf7c8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:02.771355 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:02.871108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a5c30569-cb5c-4010-971e-887a83baf7c8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:02.880386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a5c30569-cb5c-4010-971e-887a83baf7c8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:02.881982 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a5c30569-cb5c-4010-971e-887a83baf7c8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:02.884260 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a5c30569-cb5c-4010-971e-887a83baf7c8 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1406 microversion: 2.54 time: 0.135672 Oct 05 02:56:02.885165 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2727/5438] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:02 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1406 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:56:03.057597 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6178348c-7140-48fd-a39c-1688df4624f2 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:03.058307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6178348c-7140-48fd-a39c-1688df4624f2 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: 3ad95026-ac80-442e-b377-45e769c67de7] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:03.067200 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6178348c-7140-48fd-a39c-1688df4624f2 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:03.067708 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6178348c-7140-48fd-a39c-1688df4624f2 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:03.068147 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6178348c-7140-48fd-a39c-1688df4624f2 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:03.068872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6178348c-7140-48fd-a39c-1688df4624f2 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:03.069466 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6178348c-7140-48fd-a39c-1688df4624f2 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:03.069899 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6178348c-7140-48fd-a39c-1688df4624f2 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:03.255495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6178348c-7140-48fd-a39c-1688df4624f2 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de963cdc932941c7bac32406ee190634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6345a777ff224f558120171bee710f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:03.263666 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6178348c-7140-48fd-a39c-1688df4624f2 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "GET /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7" status: 200 len: 1319 microversion: 2.1 time: 0.210833 Oct 05 02:56:03.264247 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2712/5439] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:56:03 2022] GET /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:56:03.911242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e34edd12-0772-4c46-a579-cdbe8dd6dee7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:03.914115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e34edd12-0772-4c46-a579-cdbe8dd6dee7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:03.924217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e34edd12-0772-4c46-a579-cdbe8dd6dee7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:03.925101 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e34edd12-0772-4c46-a579-cdbe8dd6dee7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:03.926923 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e34edd12-0772-4c46-a579-cdbe8dd6dee7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:03.928214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e34edd12-0772-4c46-a579-cdbe8dd6dee7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:03.928875 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e34edd12-0772-4c46-a579-cdbe8dd6dee7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:03.929496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e34edd12-0772-4c46-a579-cdbe8dd6dee7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:04.034305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e34edd12-0772-4c46-a579-cdbe8dd6dee7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:04.044245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e34edd12-0772-4c46-a579-cdbe8dd6dee7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:04.046304 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e34edd12-0772-4c46-a579-cdbe8dd6dee7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:04.048569 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e34edd12-0772-4c46-a579-cdbe8dd6dee7 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1406 microversion: 2.54 time: 0.141766 Oct 05 02:56:04.063083 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2728/5440] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:03 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:04.288162 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fc6aef31-9282-4f41-9e14-58924f219eb2 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:04.288922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fc6aef31-9282-4f41-9e14-58924f219eb2 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: 3ad95026-ac80-442e-b377-45e769c67de7] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:04.295254 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc6aef31-9282-4f41-9e14-58924f219eb2 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:04.295745 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc6aef31-9282-4f41-9e14-58924f219eb2 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:04.296231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc6aef31-9282-4f41-9e14-58924f219eb2 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:04.296933 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc6aef31-9282-4f41-9e14-58924f219eb2 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:04.297552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc6aef31-9282-4f41-9e14-58924f219eb2 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:04.297979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc6aef31-9282-4f41-9e14-58924f219eb2 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:04.444755 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fc6aef31-9282-4f41-9e14-58924f219eb2 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de963cdc932941c7bac32406ee190634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6345a777ff224f558120171bee710f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:04.453466 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fc6aef31-9282-4f41-9e14-58924f219eb2 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "GET /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7" status: 200 len: 1319 microversion: 2.1 time: 0.170842 Oct 05 02:56:04.454158 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2713/5441] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:56:04 2022] GET /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:56:05.076806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6218f129-578f-416d-b136-a0c1855abe68 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:05.077637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6218f129-578f-416d-b136-a0c1855abe68 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:05.084568 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6218f129-578f-416d-b136-a0c1855abe68 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:05.085116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6218f129-578f-416d-b136-a0c1855abe68 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:05.085553 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6218f129-578f-416d-b136-a0c1855abe68 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:05.086462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6218f129-578f-416d-b136-a0c1855abe68 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:05.086923 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6218f129-578f-416d-b136-a0c1855abe68 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:05.087348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6218f129-578f-416d-b136-a0c1855abe68 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:05.150916 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6218f129-578f-416d-b136-a0c1855abe68 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:05.151406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6218f129-578f-416d-b136-a0c1855abe68 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:05.152105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6218f129-578f-416d-b136-a0c1855abe68 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:05.152716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-6218f129-578f-416d-b136-a0c1855abe68 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lazy-loading 'fault' on Instance uuid 2e367859-3b25-4219-84cd-0fa70dc93ca0 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:56:05.199250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6218f129-578f-416d-b136-a0c1855abe68 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:05.210754 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6218f129-578f-416d-b136-a0c1855abe68 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:05.212491 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6218f129-578f-416d-b136-a0c1855abe68 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a21786dcd412436facda618c37ff02b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd238a08e954c42e7a646cbe300e831a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:05.213900 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6218f129-578f-416d-b136-a0c1855abe68 tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 200 len: 1411 microversion: 2.54 time: 0.141120 Oct 05 02:56:05.214634 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2729/5442] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:05 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 1411 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:05.475897 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a81aa9f7-9ed8-4c8f-81d9-373b7cf6f5b1 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:05.477062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a81aa9f7-9ed8-4c8f-81d9-373b7cf6f5b1 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: 3ad95026-ac80-442e-b377-45e769c67de7] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:05.483332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:05.485073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a81aa9f7-9ed8-4c8f-81d9-373b7cf6f5b1 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:05.485954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a81aa9f7-9ed8-4c8f-81d9-373b7cf6f5b1 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:05.487204 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a81aa9f7-9ed8-4c8f-81d9-373b7cf6f5b1 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:05.488073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a81aa9f7-9ed8-4c8f-81d9-373b7cf6f5b1 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:05.488525 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a81aa9f7-9ed8-4c8f-81d9-373b7cf6f5b1 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:05.488967 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a81aa9f7-9ed8-4c8f-81d9-373b7cf6f5b1 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:05.631655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a81aa9f7-9ed8-4c8f-81d9-373b7cf6f5b1 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de963cdc932941c7bac32406ee190634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6345a777ff224f558120171bee710f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:05.640107 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a81aa9f7-9ed8-4c8f-81d9-373b7cf6f5b1 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "GET /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7" status: 200 len: 1319 microversion: 2.1 time: 0.168292 Oct 05 02:56:05.640708 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2714/5443] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:56:05 2022] GET /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:56:06.243801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9b398387-8289-4e0e-8c31-2b4b86ecf5ef tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:06.244425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9b398387-8289-4e0e-8c31-2b4b86ecf5ef tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] [instance: 2e367859-3b25-4219-84cd-0fa70dc93ca0] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:06.251681 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b398387-8289-4e0e-8c31-2b4b86ecf5ef tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:06.252870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b398387-8289-4e0e-8c31-2b4b86ecf5ef tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:06.253364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b398387-8289-4e0e-8c31-2b4b86ecf5ef tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:06.254335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b398387-8289-4e0e-8c31-2b4b86ecf5ef tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:06.254797 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b398387-8289-4e0e-8c31-2b4b86ecf5ef tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:06.255222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b398387-8289-4e0e-8c31-2b4b86ecf5ef tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:06.270015 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-9b398387-8289-4e0e-8c31-2b4b86ecf5ef tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] HTTP exception thrown: Instance 2e367859-3b25-4219-84cd-0fa70dc93ca0 could not be found. Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9b398387-8289-4e0e-8c31-2b4b86ecf5ef tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Request method failure captured: Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 HTTP/1.1 Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPIa25OIqTIfBIymNMGdAmqtotOeR7x3Fh5zp0StBGRw8mtoQ3V1oHE1416wB9zR-ruunH-petr0JiJbHeRU6lPCcEgqpXKo7OuZF-K9ajlrJ08zaLOVul_IhWJ8ML8mVmjfI5RAnmqcMOTJRtaDZtWSvAkfpWJsAyOqi4dO_h7VvzU Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: X-Openstack-Nova-Api-Version: 2.54 Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: d238a08e954c42e7a646cbe300e831a0 Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerShowV254Test-1382740793 Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d238a08e954c42e7a646cbe300e831a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d238a08e954c42e7a646cbe300e831a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d238a08e954c42e7a646cbe300e831a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d238a08e954c42e7a646cbe300e831a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerShowV254Test-1382740793 Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: d238a08e954c42e7a646cbe300e831a0 Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerShowV254Test-1382740793 Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerShowV254Test-1382740793-project Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: a21786dcd412436facda618c37ff02b7 Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerShowV254Test-1382740793-project Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 2e367859-3b25-4219-84cd-0fa70dc93ca0 could not be found. Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '2e367859-3b25-4219-84cd-0fa70dc93ca0'} Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e367859-3b25-4219-84cd-0fa70dc93ca0 could not be found. Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e367859-3b25-4219-84cd-0fa70dc93ca0 could not be found. Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:56:06.271698 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:56:06.277218 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:56:06.277218 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:56:06.277218 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:56:06.277218 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:56:06.277218 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:56:06.277218 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e367859-3b25-4219-84cd-0fa70dc93ca0 could not be found. Oct 05 02:56:06.277218 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:56:06.277218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9b398387-8289-4e0e-8c31-2b4b86ecf5ef tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] Returning 404 to user: Instance 2e367859-3b25-4219-84cd-0fa70dc93ca0 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:56:06.277218 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9b398387-8289-4e0e-8c31-2b4b86ecf5ef tempest-ServerShowV254Test-1382740793 tempest-ServerShowV254Test-1382740793-project] 10.222.0.16 "GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0" status: 404 len: 111 microversion: 2.54 time: 0.033446 Oct 05 02:56:06.277218 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2730/5444] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:06 2022] GET /compute/v2.1/servers/2e367859-3b25-4219-84cd-0fa70dc93ca0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:56:06.665633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-aae55290-256a-4e33-952e-89e808b1232e tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:06.666255 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-aae55290-256a-4e33-952e-89e808b1232e tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: 3ad95026-ac80-442e-b377-45e769c67de7] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:06.683719 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aae55290-256a-4e33-952e-89e808b1232e tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:06.684516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aae55290-256a-4e33-952e-89e808b1232e tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:06.685591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aae55290-256a-4e33-952e-89e808b1232e tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:06.686913 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aae55290-256a-4e33-952e-89e808b1232e tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:06.687617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aae55290-256a-4e33-952e-89e808b1232e tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:06.688311 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aae55290-256a-4e33-952e-89e808b1232e tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:06.953778 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-aae55290-256a-4e33-952e-89e808b1232e tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de963cdc932941c7bac32406ee190634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6345a777ff224f558120171bee710f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:06.962599 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-aae55290-256a-4e33-952e-89e808b1232e tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "GET /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7" status: 200 len: 1319 microversion: 2.1 time: 0.300996 Oct 05 02:56:06.963211 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2715/5445] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:56:06 2022] GET /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7 => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:56:07.137416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-a3491d8e-b6be-4340-9385-4f1bc4420134 req-8425969a-a163-43de-909c-916c78f1bc14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ad95026-ac80-442e-b377-45e769c67de7", "name": "network-vif-plugged", "status": "completed", "tag": "10f8bb12-de52-45fa-a1be-80bd71bedbee"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:56:07.144197 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:07.151533 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a3491d8e-b6be-4340-9385-4f1bc4420134 req-8425969a-a163-43de-909c-916c78f1bc14 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:07.152231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a3491d8e-b6be-4340-9385-4f1bc4420134 req-8425969a-a163-43de-909c-916c78f1bc14 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:07.152668 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a3491d8e-b6be-4340-9385-4f1bc4420134 req-8425969a-a163-43de-909c-916c78f1bc14 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:07.167235 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-a3491d8e-b6be-4340-9385-4f1bc4420134 req-8425969a-a163-43de-909c-916c78f1bc14 service nova] Creating event network-vif-plugged:10f8bb12-de52-45fa-a1be-80bd71bedbee for instance 3ad95026-ac80-442e-b377-45e769c67de7 on n-h1-858272-3 Oct 05 02:56:07.172281 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-a3491d8e-b6be-4340-9385-4f1bc4420134 req-8425969a-a163-43de-909c-916c78f1bc14 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038481 Oct 05 02:56:07.172886 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2731/5446] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:56:07.990334 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-052c5bc8-a30f-409b-b81b-d5c31c63e2ba tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:07.991618 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-052c5bc8-a30f-409b-b81b-d5c31c63e2ba tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: 3ad95026-ac80-442e-b377-45e769c67de7] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:08.001068 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-052c5bc8-a30f-409b-b81b-d5c31c63e2ba tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:08.001567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-052c5bc8-a30f-409b-b81b-d5c31c63e2ba tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:08.002057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-052c5bc8-a30f-409b-b81b-d5c31c63e2ba tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:08.002765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-052c5bc8-a30f-409b-b81b-d5c31c63e2ba tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:08.003219 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-052c5bc8-a30f-409b-b81b-d5c31c63e2ba tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:08.003905 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-052c5bc8-a30f-409b-b81b-d5c31c63e2ba tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:08.067187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fb7cb518-daa4-4bc3-a4a0-9c600c6c59df tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-257119208", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": "none"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:56:08.128362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-fb7cb518-daa4-4bc3-a4a0-9c600c6c59df tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:56:08.129133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-fb7cb518-daa4-4bc3-a4a0-9c600c6c59df tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:56:08.129631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-fb7cb518-daa4-4bc3-a4a0-9c600c6c59df tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:56:08.130086 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-fb7cb518-daa4-4bc3-a4a0-9c600c6c59df tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:56:08.130606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-fb7cb518-daa4-4bc3-a4a0-9c600c6c59df tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:56:08.140715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb7cb518-daa4-4bc3-a4a0-9c600c6c59df tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:08.141258 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb7cb518-daa4-4bc3-a4a0-9c600c6c59df tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:08.141690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb7cb518-daa4-4bc3-a4a0-9c600c6c59df tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:08.143961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb7cb518-daa4-4bc3-a4a0-9c600c6c59df tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:08.144621 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb7cb518-daa4-4bc3-a4a0-9c600c6c59df tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:08.145049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb7cb518-daa4-4bc3-a4a0-9c600c6c59df tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:08.163454 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-fb7cb518-daa4-4bc3-a4a0-9c600c6c59df tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Getting quotas for project 9789e2e26a5e4679b6f83e0feff71c2c. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:56:08.169582 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-fb7cb518-daa4-4bc3-a4a0-9c600c6c59df tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Getting quotas for user 2879c269c66546329d7b2417e99a7d9c and project 9789e2e26a5e4679b6f83e0feff71c2c. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:56:08.177544 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-052c5bc8-a30f-409b-b81b-d5c31c63e2ba tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de963cdc932941c7bac32406ee190634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6345a777ff224f558120171bee710f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:08.183213 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fb7cb518-daa4-4bc3-a4a0-9c600c6c59df tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:56:08.185720 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fb7cb518-daa4-4bc3-a4a0-9c600c6c59df tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:56:08.186089 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-052c5bc8-a30f-409b-b81b-d5c31c63e2ba tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "GET /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7" status: 200 len: 1319 microversion: 2.1 time: 0.202914 Oct 05 02:56:08.201630 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2732/5447] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:56:07 2022] GET /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:56:08.237020 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fb7cb518-daa4-4bc3-a4a0-9c600c6c59df tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.315780 Oct 05 02:56:08.237799 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2716/5448] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 5 02:56:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 318 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 05 02:56:08.248857 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dbe6b315-deba-46f1-aea3-6b7e1e9aed90 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:08.249488 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-dbe6b315-deba-46f1-aea3-6b7e1e9aed90 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:08.251435 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:08.274509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:08.309918 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-dbe6b315-deba-46f1-aea3-6b7e1e9aed90 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:08.319334 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-dbe6b315-deba-46f1-aea3-6b7e1e9aed90 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:08.320762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-dbe6b315-deba-46f1-aea3-6b7e1e9aed90 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:08.321950 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-dbe6b315-deba-46f1-aea3-6b7e1e9aed90 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1277 microversion: 2.57 time: 0.076948 Oct 05 02:56:08.322721 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2733/5449] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:08 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1277 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:09.210600 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3547466e-491e-47d0-9a99-08311957a418 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:09.211289 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3547466e-491e-47d0-9a99-08311957a418 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: 3ad95026-ac80-442e-b377-45e769c67de7] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:09.221762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3547466e-491e-47d0-9a99-08311957a418 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:09.222290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3547466e-491e-47d0-9a99-08311957a418 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:09.222864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3547466e-491e-47d0-9a99-08311957a418 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:09.223594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3547466e-491e-47d0-9a99-08311957a418 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:09.224211 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3547466e-491e-47d0-9a99-08311957a418 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:09.224645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3547466e-491e-47d0-9a99-08311957a418 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:09.348604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7c19ee37-c999-4735-8c3d-5e30d296b9ee tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:09.349245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7c19ee37-c999-4735-8c3d-5e30d296b9ee tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:09.357067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7c19ee37-c999-4735-8c3d-5e30d296b9ee tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:09.357815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7c19ee37-c999-4735-8c3d-5e30d296b9ee tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:09.358434 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7c19ee37-c999-4735-8c3d-5e30d296b9ee tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:09.359235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7c19ee37-c999-4735-8c3d-5e30d296b9ee tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:09.359695 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7c19ee37-c999-4735-8c3d-5e30d296b9ee tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:09.360115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7c19ee37-c999-4735-8c3d-5e30d296b9ee tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:09.365662 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3547466e-491e-47d0-9a99-08311957a418 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de963cdc932941c7bac32406ee190634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6345a777ff224f558120171bee710f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:09.376187 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3547466e-491e-47d0-9a99-08311957a418 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "GET /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7" status: 200 len: 1508 microversion: 2.1 time: 0.170743 Oct 05 02:56:09.377793 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2717/5450] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:56:09 2022] GET /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7 => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:56:09.433599 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7c19ee37-c999-4735-8c3d-5e30d296b9ee tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:09.444864 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7c19ee37-c999-4735-8c3d-5e30d296b9ee tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:09.446687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7c19ee37-c999-4735-8c3d-5e30d296b9ee tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:09.448104 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7c19ee37-c999-4735-8c3d-5e30d296b9ee tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1329 microversion: 2.57 time: 0.104354 Oct 05 02:56:09.466859 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2734/5451] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:09 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1329 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:56:10.477032 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f496f3d0-f13a-4f54-999a-88bdafb17d38 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:10.478224 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f496f3d0-f13a-4f54-999a-88bdafb17d38 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:10.486975 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f496f3d0-f13a-4f54-999a-88bdafb17d38 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:10.487861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f496f3d0-f13a-4f54-999a-88bdafb17d38 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:10.488455 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f496f3d0-f13a-4f54-999a-88bdafb17d38 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:10.489504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f496f3d0-f13a-4f54-999a-88bdafb17d38 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:10.490183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f496f3d0-f13a-4f54-999a-88bdafb17d38 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:10.490788 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f496f3d0-f13a-4f54-999a-88bdafb17d38 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:10.573147 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f496f3d0-f13a-4f54-999a-88bdafb17d38 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:10.597147 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f496f3d0-f13a-4f54-999a-88bdafb17d38 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:10.599494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f496f3d0-f13a-4f54-999a-88bdafb17d38 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:10.611219 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f496f3d0-f13a-4f54-999a-88bdafb17d38 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1335 microversion: 2.57 time: 0.137047 Oct 05 02:56:10.612750 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2718/5452] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:10 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1335 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:11.642071 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-53f203d6-4c4b-4f41-bd74-c041b9a39e03 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:11.643706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-53f203d6-4c4b-4f41-bd74-c041b9a39e03 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:11.650694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53f203d6-4c4b-4f41-bd74-c041b9a39e03 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:11.651222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53f203d6-4c4b-4f41-bd74-c041b9a39e03 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:11.651658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53f203d6-4c4b-4f41-bd74-c041b9a39e03 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:11.652357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53f203d6-4c4b-4f41-bd74-c041b9a39e03 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:11.653110 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53f203d6-4c4b-4f41-bd74-c041b9a39e03 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:11.653541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53f203d6-4c4b-4f41-bd74-c041b9a39e03 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:11.735458 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-53f203d6-4c4b-4f41-bd74-c041b9a39e03 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:11.749650 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-53f203d6-4c4b-4f41-bd74-c041b9a39e03 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:11.751116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-53f203d6-4c4b-4f41-bd74-c041b9a39e03 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:11.753897 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-53f203d6-4c4b-4f41-bd74-c041b9a39e03 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1335 microversion: 2.57 time: 0.115449 Oct 05 02:56:11.754482 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2735/5453] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:11 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1335 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:12.785966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f796b16c-6312-460b-8398-2333f8dad1e4 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:12.787500 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f796b16c-6312-460b-8398-2333f8dad1e4 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:12.795884 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f796b16c-6312-460b-8398-2333f8dad1e4 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:12.796679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f796b16c-6312-460b-8398-2333f8dad1e4 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:12.797775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f796b16c-6312-460b-8398-2333f8dad1e4 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:12.798586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f796b16c-6312-460b-8398-2333f8dad1e4 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:12.799859 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f796b16c-6312-460b-8398-2333f8dad1e4 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:12.800488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f796b16c-6312-460b-8398-2333f8dad1e4 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:12.867717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f796b16c-6312-460b-8398-2333f8dad1e4 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:12.876057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f796b16c-6312-460b-8398-2333f8dad1e4 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:12.878133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f796b16c-6312-460b-8398-2333f8dad1e4 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:12.879591 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f796b16c-6312-460b-8398-2333f8dad1e4 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1335 microversion: 2.57 time: 0.098661 Oct 05 02:56:12.880156 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2719/5454] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:12 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1335 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:13.905806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5a16c20d-9573-4896-9828-2e6974fe7010 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:13.906711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5a16c20d-9573-4896-9828-2e6974fe7010 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:13.914389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a16c20d-9573-4896-9828-2e6974fe7010 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:13.915067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a16c20d-9573-4896-9828-2e6974fe7010 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:13.917704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a16c20d-9573-4896-9828-2e6974fe7010 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:13.918491 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a16c20d-9573-4896-9828-2e6974fe7010 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:13.918887 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a16c20d-9573-4896-9828-2e6974fe7010 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:13.919831 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a16c20d-9573-4896-9828-2e6974fe7010 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:13.993520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5a16c20d-9573-4896-9828-2e6974fe7010 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:14.003241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5a16c20d-9573-4896-9828-2e6974fe7010 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:14.005018 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5a16c20d-9573-4896-9828-2e6974fe7010 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:14.006203 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5a16c20d-9573-4896-9828-2e6974fe7010 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1356 microversion: 2.57 time: 0.104796 Oct 05 02:56:14.006766 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2736/5455] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:13 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1356 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:14.042248 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ec58f174-511b-489b-b893-f19b5cc29dde tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:56:14.045556 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ec58f174-511b-489b-b893-f19b5cc29dde tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:14.056396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec58f174-511b-489b-b893-f19b5cc29dde tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:14.057215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec58f174-511b-489b-b893-f19b5cc29dde tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:14.057640 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec58f174-511b-489b-b893-f19b5cc29dde tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:14.060224 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec58f174-511b-489b-b893-f19b5cc29dde tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:14.060721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec58f174-511b-489b-b893-f19b5cc29dde tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:14.061187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec58f174-511b-489b-b893-f19b5cc29dde tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:14.193869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-ec58f174-511b-489b-b893-f19b5cc29dde tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:56:14.194295 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-ec58f174-511b-489b-b893-f19b5cc29dde tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:56:14.194923 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-ec58f174-511b-489b-b893-f19b5cc29dde tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:56:14.195347 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-ec58f174-511b-489b-b893-f19b5cc29dde tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:56:14.195767 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-ec58f174-511b-489b-b893-f19b5cc29dde tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:56:14.270072 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ec58f174-511b-489b-b893-f19b5cc29dde tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:14.276563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec58f174-511b-489b-b893-f19b5cc29dde tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:14.277091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec58f174-511b-489b-b893-f19b5cc29dde tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:14.277764 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec58f174-511b-489b-b893-f19b5cc29dde tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:14.278647 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec58f174-511b-489b-b893-f19b5cc29dde tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:14.279278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec58f174-511b-489b-b893-f19b5cc29dde tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:14.279979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec58f174-511b-489b-b893-f19b5cc29dde tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:14.314497 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ec58f174-511b-489b-b893-f19b5cc29dde tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "POST /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290/action" status: 202 len: 1137 microversion: 2.57 time: 0.276562 Oct 05 02:56:14.331924 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2720/5456] 10.222.0.16 () {62 vars in 1320 bytes} [Wed Oct 5 02:56:14 2022] POST /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290/action => generated 1137 bytes in 279 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 05 02:56:14.341016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dc034b3d-f1b4-4a2b-951f-ecd462797ca5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:14.341821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-dc034b3d-f1b4-4a2b-951f-ecd462797ca5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:14.349424 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc034b3d-f1b4-4a2b-951f-ecd462797ca5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:14.350081 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc034b3d-f1b4-4a2b-951f-ecd462797ca5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:14.350530 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc034b3d-f1b4-4a2b-951f-ecd462797ca5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:14.351242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc034b3d-f1b4-4a2b-951f-ecd462797ca5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:14.351704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc034b3d-f1b4-4a2b-951f-ecd462797ca5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:14.352132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc034b3d-f1b4-4a2b-951f-ecd462797ca5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:14.434419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-dc034b3d-f1b4-4a2b-951f-ecd462797ca5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:14.457639 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-dc034b3d-f1b4-4a2b-951f-ecd462797ca5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:14.459081 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-dc034b3d-f1b4-4a2b-951f-ecd462797ca5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:14.460487 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-dc034b3d-f1b4-4a2b-951f-ecd462797ca5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1365 microversion: 2.57 time: 0.123898 Oct 05 02:56:14.461778 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2737/5457] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:14 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1365 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:15.488293 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2e785ffd-8c2c-4d91-9f25-84cedb72d393 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:15.488988 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2e785ffd-8c2c-4d91-9f25-84cedb72d393 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:15.496457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2e785ffd-8c2c-4d91-9f25-84cedb72d393 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:15.496968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2e785ffd-8c2c-4d91-9f25-84cedb72d393 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:15.497414 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2e785ffd-8c2c-4d91-9f25-84cedb72d393 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:15.498105 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2e785ffd-8c2c-4d91-9f25-84cedb72d393 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:15.498557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2e785ffd-8c2c-4d91-9f25-84cedb72d393 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:15.498975 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2e785ffd-8c2c-4d91-9f25-84cedb72d393 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:15.583224 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2e785ffd-8c2c-4d91-9f25-84cedb72d393 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:15.592207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2e785ffd-8c2c-4d91-9f25-84cedb72d393 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:15.593947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2e785ffd-8c2c-4d91-9f25-84cedb72d393 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:15.595394 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2e785ffd-8c2c-4d91-9f25-84cedb72d393 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1365 microversion: 2.57 time: 0.111663 Oct 05 02:56:15.597335 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2721/5458] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:15 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1365 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:16.623371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-94894ee9-7b4a-4343-ad9d-c59c7810b88c tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:16.623981 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-94894ee9-7b4a-4343-ad9d-c59c7810b88c tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:16.632206 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94894ee9-7b4a-4343-ad9d-c59c7810b88c tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:16.632696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94894ee9-7b4a-4343-ad9d-c59c7810b88c tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:16.633164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94894ee9-7b4a-4343-ad9d-c59c7810b88c tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:16.633861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94894ee9-7b4a-4343-ad9d-c59c7810b88c tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:16.634314 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94894ee9-7b4a-4343-ad9d-c59c7810b88c tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:16.634738 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94894ee9-7b4a-4343-ad9d-c59c7810b88c tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:16.706314 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-94894ee9-7b4a-4343-ad9d-c59c7810b88c tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:16.715003 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-94894ee9-7b4a-4343-ad9d-c59c7810b88c tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:16.716579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-94894ee9-7b4a-4343-ad9d-c59c7810b88c tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:16.717848 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-94894ee9-7b4a-4343-ad9d-c59c7810b88c tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1365 microversion: 2.57 time: 0.098425 Oct 05 02:56:16.718403 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2738/5459] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:16 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1365 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:17.745474 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e658fc87-01d9-4564-bec8-d808b881ac0e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:17.746654 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e658fc87-01d9-4564-bec8-d808b881ac0e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:17.756042 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e658fc87-01d9-4564-bec8-d808b881ac0e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:17.757049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e658fc87-01d9-4564-bec8-d808b881ac0e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:17.757703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e658fc87-01d9-4564-bec8-d808b881ac0e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:17.758663 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e658fc87-01d9-4564-bec8-d808b881ac0e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:17.759601 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e658fc87-01d9-4564-bec8-d808b881ac0e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:17.760238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e658fc87-01d9-4564-bec8-d808b881ac0e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:17.844035 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e658fc87-01d9-4564-bec8-d808b881ac0e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:17.859817 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e658fc87-01d9-4564-bec8-d808b881ac0e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:17.862344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e658fc87-01d9-4564-bec8-d808b881ac0e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:17.863778 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e658fc87-01d9-4564-bec8-d808b881ac0e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1365 microversion: 2.57 time: 0.122885 Oct 05 02:56:17.864558 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2722/5460] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:17 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1365 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:18.890047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-effa9c8c-4fb2-45ea-b092-a633c6264a35 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:18.890649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-effa9c8c-4fb2-45ea-b092-a633c6264a35 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:18.895133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:18.899755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-effa9c8c-4fb2-45ea-b092-a633c6264a35 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:18.900244 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-effa9c8c-4fb2-45ea-b092-a633c6264a35 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:18.900871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-effa9c8c-4fb2-45ea-b092-a633c6264a35 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:18.901599 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-effa9c8c-4fb2-45ea-b092-a633c6264a35 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:18.902053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-effa9c8c-4fb2-45ea-b092-a633c6264a35 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:18.902473 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-effa9c8c-4fb2-45ea-b092-a633c6264a35 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:18.988842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-effa9c8c-4fb2-45ea-b092-a633c6264a35 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:18.998729 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-effa9c8c-4fb2-45ea-b092-a633c6264a35 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:19.001293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-effa9c8c-4fb2-45ea-b092-a633c6264a35 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:19.003082 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-effa9c8c-4fb2-45ea-b092-a633c6264a35 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1365 microversion: 2.57 time: 0.116954 Oct 05 02:56:19.003656 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2739/5461] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:18 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1365 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:20.031198 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9314a594-f7ed-40d5-9e63-a68617675ffa tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:20.032396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9314a594-f7ed-40d5-9e63-a68617675ffa tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:20.034576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:20.035892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=8 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:20.043587 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9314a594-f7ed-40d5-9e63-a68617675ffa tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:20.044074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9314a594-f7ed-40d5-9e63-a68617675ffa tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:20.044511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9314a594-f7ed-40d5-9e63-a68617675ffa tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:20.045240 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9314a594-f7ed-40d5-9e63-a68617675ffa tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:20.045690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9314a594-f7ed-40d5-9e63-a68617675ffa tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:20.046109 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9314a594-f7ed-40d5-9e63-a68617675ffa tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:20.050932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:20.116065 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9314a594-f7ed-40d5-9e63-a68617675ffa tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:20.125894 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9314a594-f7ed-40d5-9e63-a68617675ffa tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:20.127896 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9314a594-f7ed-40d5-9e63-a68617675ffa tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:20.129424 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9314a594-f7ed-40d5-9e63-a68617675ffa tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1365 microversion: 2.57 time: 0.102005 Oct 05 02:56:20.129979 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2723/5462] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:20 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1365 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:21.155893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-60ed9aa5-cbc7-4f7d-a42c-57c973f14120 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:21.156501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-60ed9aa5-cbc7-4f7d-a42c-57c973f14120 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:21.163702 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60ed9aa5-cbc7-4f7d-a42c-57c973f14120 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:21.164186 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60ed9aa5-cbc7-4f7d-a42c-57c973f14120 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:21.164622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60ed9aa5-cbc7-4f7d-a42c-57c973f14120 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:21.165326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60ed9aa5-cbc7-4f7d-a42c-57c973f14120 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:21.165777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60ed9aa5-cbc7-4f7d-a42c-57c973f14120 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:21.166197 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60ed9aa5-cbc7-4f7d-a42c-57c973f14120 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:21.231006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-60ed9aa5-cbc7-4f7d-a42c-57c973f14120 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:21.240310 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-60ed9aa5-cbc7-4f7d-a42c-57c973f14120 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:21.241760 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-60ed9aa5-cbc7-4f7d-a42c-57c973f14120 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:21.242925 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-60ed9aa5-cbc7-4f7d-a42c-57c973f14120 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1365 microversion: 2.57 time: 0.090948 Oct 05 02:56:21.243483 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2740/5463] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:21 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1365 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:22.269658 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f980bf17-fdf6-4cd0-8661-5b9f99d243e2 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:22.270319 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f980bf17-fdf6-4cd0-8661-5b9f99d243e2 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:22.277472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f980bf17-fdf6-4cd0-8661-5b9f99d243e2 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:22.278337 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f980bf17-fdf6-4cd0-8661-5b9f99d243e2 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:22.278980 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f980bf17-fdf6-4cd0-8661-5b9f99d243e2 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:22.280417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f980bf17-fdf6-4cd0-8661-5b9f99d243e2 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:22.281248 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f980bf17-fdf6-4cd0-8661-5b9f99d243e2 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:22.281945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f980bf17-fdf6-4cd0-8661-5b9f99d243e2 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:22.359775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f980bf17-fdf6-4cd0-8661-5b9f99d243e2 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:22.368551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f980bf17-fdf6-4cd0-8661-5b9f99d243e2 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:22.371615 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f980bf17-fdf6-4cd0-8661-5b9f99d243e2 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:22.373184 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f980bf17-fdf6-4cd0-8661-5b9f99d243e2 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1365 microversion: 2.57 time: 0.107808 Oct 05 02:56:22.373925 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2724/5464] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:22 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1365 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:22.925711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2d722f2c-5e2f-4bf0-a3c1-89c9d8753861 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fa49dc3-3ef8-4833-b902-ab5dbd0e7c81"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:56:22.944437 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2d722f2c-5e2f-4bf0-a3c1-89c9d8753861 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:22.973897 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2d722f2c-5e2f-4bf0-a3c1-89c9d8753861 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:22.974406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2d722f2c-5e2f-4bf0-a3c1-89c9d8753861 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:22.974849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2d722f2c-5e2f-4bf0-a3c1-89c9d8753861 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:22.975593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2d722f2c-5e2f-4bf0-a3c1-89c9d8753861 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:22.976057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2d722f2c-5e2f-4bf0-a3c1-89c9d8753861 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:22.976519 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2d722f2c-5e2f-4bf0-a3c1-89c9d8753861 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:23.387942 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2d722f2c-5e2f-4bf0-a3c1-89c9d8753861 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "POST /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.473847 Oct 05 02:56:23.388604 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2741/5465] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 02:56:22 2022] POST /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552/os-volume_attachments => generated 194 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:56:23.410769 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c5220414-dbf0-4dee-8ae8-d039cf0ba221 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:23.414824 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c5220414-dbf0-4dee-8ae8-d039cf0ba221 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:23.426507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5220414-dbf0-4dee-8ae8-d039cf0ba221 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:23.428873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5220414-dbf0-4dee-8ae8-d039cf0ba221 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:23.429592 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5220414-dbf0-4dee-8ae8-d039cf0ba221 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:23.430619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5220414-dbf0-4dee-8ae8-d039cf0ba221 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:23.431479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5220414-dbf0-4dee-8ae8-d039cf0ba221 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:23.432064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5220414-dbf0-4dee-8ae8-d039cf0ba221 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:23.612419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c5220414-dbf0-4dee-8ae8-d039cf0ba221 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:23.624891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c5220414-dbf0-4dee-8ae8-d039cf0ba221 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:23.627918 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c5220414-dbf0-4dee-8ae8-d039cf0ba221 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:23.629982 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c5220414-dbf0-4dee-8ae8-d039cf0ba221 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1365 microversion: 2.57 time: 0.230721 Oct 05 02:56:23.631053 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2725/5466] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:23 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:24.661264 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e9edbf6b-ef2e-4c38-a685-f2f4a0fb3c91 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:24.662493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e9edbf6b-ef2e-4c38-a685-f2f4a0fb3c91 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:24.669119 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e9edbf6b-ef2e-4c38-a685-f2f4a0fb3c91 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:24.669848 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e9edbf6b-ef2e-4c38-a685-f2f4a0fb3c91 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:24.670460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e9edbf6b-ef2e-4c38-a685-f2f4a0fb3c91 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:24.673352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e9edbf6b-ef2e-4c38-a685-f2f4a0fb3c91 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:24.674017 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e9edbf6b-ef2e-4c38-a685-f2f4a0fb3c91 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:24.674667 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e9edbf6b-ef2e-4c38-a685-f2f4a0fb3c91 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:24.767748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e9edbf6b-ef2e-4c38-a685-f2f4a0fb3c91 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:24.778660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e9edbf6b-ef2e-4c38-a685-f2f4a0fb3c91 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:24.780101 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e9edbf6b-ef2e-4c38-a685-f2f4a0fb3c91 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:24.786042 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e9edbf6b-ef2e-4c38-a685-f2f4a0fb3c91 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1365 microversion: 2.57 time: 0.126618 Oct 05 02:56:24.790549 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2742/5467] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:24 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1365 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:25.466386 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-57514e94-6215-4bd5-968e-a911f0e6096f tempest-PortsAdminExtendedAttrsTestJSON-1635090122 tempest-PortsAdminExtendedAttrsTestJSON-1635090122-project-admin] Calling method '.version_select at 0x7fccdf72d0d0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:25.468956 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57514e94-6215-4bd5-968e-a911f0e6096f tempest-PortsAdminExtendedAttrsTestJSON-1635090122 tempest-PortsAdminExtendedAttrsTestJSON-1635090122-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:25.469618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57514e94-6215-4bd5-968e-a911f0e6096f tempest-PortsAdminExtendedAttrsTestJSON-1635090122 tempest-PortsAdminExtendedAttrsTestJSON-1635090122-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:25.470209 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57514e94-6215-4bd5-968e-a911f0e6096f tempest-PortsAdminExtendedAttrsTestJSON-1635090122 tempest-PortsAdminExtendedAttrsTestJSON-1635090122-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:25.487867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57514e94-6215-4bd5-968e-a911f0e6096f tempest-PortsAdminExtendedAttrsTestJSON-1635090122 tempest-PortsAdminExtendedAttrsTestJSON-1635090122-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:25.488856 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57514e94-6215-4bd5-968e-a911f0e6096f tempest-PortsAdminExtendedAttrsTestJSON-1635090122 tempest-PortsAdminExtendedAttrsTestJSON-1635090122-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:25.489546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57514e94-6215-4bd5-968e-a911f0e6096f tempest-PortsAdminExtendedAttrsTestJSON-1635090122 tempest-PortsAdminExtendedAttrsTestJSON-1635090122-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:25.501904 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57514e94-6215-4bd5-968e-a911f0e6096f tempest-PortsAdminExtendedAttrsTestJSON-1635090122 tempest-PortsAdminExtendedAttrsTestJSON-1635090122-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:25.502788 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57514e94-6215-4bd5-968e-a911f0e6096f tempest-PortsAdminExtendedAttrsTestJSON-1635090122 tempest-PortsAdminExtendedAttrsTestJSON-1635090122-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:25.503438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57514e94-6215-4bd5-968e-a911f0e6096f tempest-PortsAdminExtendedAttrsTestJSON-1635090122 tempest-PortsAdminExtendedAttrsTestJSON-1635090122-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:25.511270 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-57514e94-6215-4bd5-968e-a911f0e6096f tempest-PortsAdminExtendedAttrsTestJSON-1635090122 tempest-PortsAdminExtendedAttrsTestJSON-1635090122-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.263109 Oct 05 02:56:25.512675 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2726/5468] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:56:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:56:25.822287 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4f74052c-c3ab-46b3-9eb2-ec29b512337e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:25.822909 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4f74052c-c3ab-46b3-9eb2-ec29b512337e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:25.832427 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f74052c-c3ab-46b3-9eb2-ec29b512337e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:25.836090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f74052c-c3ab-46b3-9eb2-ec29b512337e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:25.837343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f74052c-c3ab-46b3-9eb2-ec29b512337e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:25.839409 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f74052c-c3ab-46b3-9eb2-ec29b512337e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:25.839954 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f74052c-c3ab-46b3-9eb2-ec29b512337e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:25.840942 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f74052c-c3ab-46b3-9eb2-ec29b512337e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:25.958693 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4f74052c-c3ab-46b3-9eb2-ec29b512337e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:25.968835 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4f74052c-c3ab-46b3-9eb2-ec29b512337e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:25.971487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4f74052c-c3ab-46b3-9eb2-ec29b512337e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:25.974142 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4f74052c-c3ab-46b3-9eb2-ec29b512337e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1365 microversion: 2.57 time: 0.156529 Oct 05 02:56:25.975560 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2743/5469] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:25 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:27.003321 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f765d122-ce4b-4f4f-8371-4c38d03c2b59 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:27.005141 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f765d122-ce4b-4f4f-8371-4c38d03c2b59 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:27.013720 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f765d122-ce4b-4f4f-8371-4c38d03c2b59 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:27.014573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f765d122-ce4b-4f4f-8371-4c38d03c2b59 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:27.015270 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f765d122-ce4b-4f4f-8371-4c38d03c2b59 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:27.016131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f765d122-ce4b-4f4f-8371-4c38d03c2b59 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:27.016858 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f765d122-ce4b-4f4f-8371-4c38d03c2b59 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:27.018046 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f765d122-ce4b-4f4f-8371-4c38d03c2b59 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:27.119709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f765d122-ce4b-4f4f-8371-4c38d03c2b59 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:27.134752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f765d122-ce4b-4f4f-8371-4c38d03c2b59 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:27.138401 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f765d122-ce4b-4f4f-8371-4c38d03c2b59 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:27.141182 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f765d122-ce4b-4f4f-8371-4c38d03c2b59 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1365 microversion: 2.57 time: 0.143655 Oct 05 02:56:27.155414 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2727/5470] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:26 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:28.169958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1a1f5653-c98c-4024-90e7-dcb3f66499b5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:28.170567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1a1f5653-c98c-4024-90e7-dcb3f66499b5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:28.182558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a1f5653-c98c-4024-90e7-dcb3f66499b5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:28.189887 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a1f5653-c98c-4024-90e7-dcb3f66499b5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:28.191191 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a1f5653-c98c-4024-90e7-dcb3f66499b5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:28.192508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a1f5653-c98c-4024-90e7-dcb3f66499b5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:28.193503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a1f5653-c98c-4024-90e7-dcb3f66499b5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:28.194560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a1f5653-c98c-4024-90e7-dcb3f66499b5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:28.245488 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:28.350535 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1a1f5653-c98c-4024-90e7-dcb3f66499b5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:28.366382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1a1f5653-c98c-4024-90e7-dcb3f66499b5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:28.368928 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1a1f5653-c98c-4024-90e7-dcb3f66499b5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:28.371459 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1a1f5653-c98c-4024-90e7-dcb3f66499b5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1365 microversion: 2.57 time: 0.205461 Oct 05 02:56:28.388826 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2744/5471] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:28 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:28.593308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-85d825a7-773b-456d-8ade-0ff3df913f29 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1ef3d23-77b3-4f75-bf6f-afdf7a034511", "device": "/dev/sdb"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:56:28.597668 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-85d825a7-773b-456d-8ade-0ff3df913f29 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: 3ad95026-ac80-442e-b377-45e769c67de7] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:28.605316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85d825a7-773b-456d-8ade-0ff3df913f29 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:28.606074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85d825a7-773b-456d-8ade-0ff3df913f29 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:28.606989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85d825a7-773b-456d-8ade-0ff3df913f29 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:28.607612 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85d825a7-773b-456d-8ade-0ff3df913f29 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:28.608049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85d825a7-773b-456d-8ade-0ff3df913f29 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:28.608562 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85d825a7-773b-456d-8ade-0ff3df913f29 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:28.930007 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-85d825a7-773b-456d-8ade-0ff3df913f29 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "POST /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.340626 Oct 05 02:56:28.931067 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2728/5472] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 02:56:28 2022] POST /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7/os-volume_attachments => generated 194 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:56:29.403398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6e550373-d18a-4c30-8520-6e42371fd230 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:29.404578 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6e550373-d18a-4c30-8520-6e42371fd230 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:29.412983 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e550373-d18a-4c30-8520-6e42371fd230 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:29.413833 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e550373-d18a-4c30-8520-6e42371fd230 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:29.414419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e550373-d18a-4c30-8520-6e42371fd230 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:29.415292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e550373-d18a-4c30-8520-6e42371fd230 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:29.415894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e550373-d18a-4c30-8520-6e42371fd230 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:29.416468 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e550373-d18a-4c30-8520-6e42371fd230 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:29.512178 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6e550373-d18a-4c30-8520-6e42371fd230 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:29.527275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6e550373-d18a-4c30-8520-6e42371fd230 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:29.529602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6e550373-d18a-4c30-8520-6e42371fd230 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:29.531171 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6e550373-d18a-4c30-8520-6e42371fd230 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1365 microversion: 2.57 time: 0.132777 Oct 05 02:56:29.532532 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2745/5473] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:29 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1365 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:30.564391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a94c6919-746d-40f8-9f21-5e78f33a0717 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:30.565975 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a94c6919-746d-40f8-9f21-5e78f33a0717 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:30.580820 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a94c6919-746d-40f8-9f21-5e78f33a0717 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:30.581457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a94c6919-746d-40f8-9f21-5e78f33a0717 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:30.582492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a94c6919-746d-40f8-9f21-5e78f33a0717 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:30.593591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a94c6919-746d-40f8-9f21-5e78f33a0717 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:30.596770 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a94c6919-746d-40f8-9f21-5e78f33a0717 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:30.597364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a94c6919-746d-40f8-9f21-5e78f33a0717 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:30.711897 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a94c6919-746d-40f8-9f21-5e78f33a0717 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:30.724184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a94c6919-746d-40f8-9f21-5e78f33a0717 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:30.725700 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a94c6919-746d-40f8-9f21-5e78f33a0717 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:30.726912 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a94c6919-746d-40f8-9f21-5e78f33a0717 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1365 microversion: 2.57 time: 0.168950 Oct 05 02:56:30.727486 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2729/5474] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:30 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:31.765681 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5d104407-ebb7-4f10-98d0-c296a74a2952 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:31.768684 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5d104407-ebb7-4f10-98d0-c296a74a2952 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:31.788692 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d104407-ebb7-4f10-98d0-c296a74a2952 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:31.789499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d104407-ebb7-4f10-98d0-c296a74a2952 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:31.791111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d104407-ebb7-4f10-98d0-c296a74a2952 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:31.793924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d104407-ebb7-4f10-98d0-c296a74a2952 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:31.795116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d104407-ebb7-4f10-98d0-c296a74a2952 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:31.795116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d104407-ebb7-4f10-98d0-c296a74a2952 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:31.955554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5d104407-ebb7-4f10-98d0-c296a74a2952 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:31.968789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5d104407-ebb7-4f10-98d0-c296a74a2952 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:31.977421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5d104407-ebb7-4f10-98d0-c296a74a2952 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:31.979435 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5d104407-ebb7-4f10-98d0-c296a74a2952 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1365 microversion: 2.57 time: 0.223818 Oct 05 02:56:31.980946 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2746/5475] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:31 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:56:33.026810 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d29e7ccd-c4f0-424b-a7bd-e8a1e3f03100 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:33.029543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d29e7ccd-c4f0-424b-a7bd-e8a1e3f03100 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:33.046156 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d29e7ccd-c4f0-424b-a7bd-e8a1e3f03100 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:33.047676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d29e7ccd-c4f0-424b-a7bd-e8a1e3f03100 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:33.048761 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d29e7ccd-c4f0-424b-a7bd-e8a1e3f03100 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:33.048980 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d29e7ccd-c4f0-424b-a7bd-e8a1e3f03100 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:33.049433 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d29e7ccd-c4f0-424b-a7bd-e8a1e3f03100 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:33.049843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d29e7ccd-c4f0-424b-a7bd-e8a1e3f03100 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:33.182629 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d29e7ccd-c4f0-424b-a7bd-e8a1e3f03100 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:33.193878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d29e7ccd-c4f0-424b-a7bd-e8a1e3f03100 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:33.196350 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d29e7ccd-c4f0-424b-a7bd-e8a1e3f03100 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:33.197760 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d29e7ccd-c4f0-424b-a7bd-e8a1e3f03100 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1365 microversion: 2.57 time: 0.191627 Oct 05 02:56:33.198684 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2730/5476] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:33 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:34.224620 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9f3c872a-4e9d-40cf-beef-35c1e4677818 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:34.225279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9f3c872a-4e9d-40cf-beef-35c1e4677818 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:34.232623 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9f3c872a-4e9d-40cf-beef-35c1e4677818 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:34.233157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9f3c872a-4e9d-40cf-beef-35c1e4677818 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:34.233603 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9f3c872a-4e9d-40cf-beef-35c1e4677818 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:34.234326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9f3c872a-4e9d-40cf-beef-35c1e4677818 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:34.234806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9f3c872a-4e9d-40cf-beef-35c1e4677818 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:34.235241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9f3c872a-4e9d-40cf-beef-35c1e4677818 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:34.391310 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9f3c872a-4e9d-40cf-beef-35c1e4677818 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:34.414250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9f3c872a-4e9d-40cf-beef-35c1e4677818 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:34.416172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9f3c872a-4e9d-40cf-beef-35c1e4677818 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:34.427556 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9f3c872a-4e9d-40cf-beef-35c1e4677818 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1365 microversion: 2.57 time: 0.197905 Oct 05 02:56:34.430473 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2747/5477] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:34 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:35.462981 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e1a1a6e4-0e6d-4670-9d7c-b05707606f56 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:35.463633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e1a1a6e4-0e6d-4670-9d7c-b05707606f56 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:35.483519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1a1a6e4-0e6d-4670-9d7c-b05707606f56 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:35.484024 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1a1a6e4-0e6d-4670-9d7c-b05707606f56 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:35.484467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1a1a6e4-0e6d-4670-9d7c-b05707606f56 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:35.485206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1a1a6e4-0e6d-4670-9d7c-b05707606f56 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:35.485711 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1a1a6e4-0e6d-4670-9d7c-b05707606f56 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:35.486235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1a1a6e4-0e6d-4670-9d7c-b05707606f56 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:35.586577 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e1a1a6e4-0e6d-4670-9d7c-b05707606f56 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:35.596693 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e1a1a6e4-0e6d-4670-9d7c-b05707606f56 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:35.599664 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e1a1a6e4-0e6d-4670-9d7c-b05707606f56 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:35.601346 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e1a1a6e4-0e6d-4670-9d7c-b05707606f56 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1365 microversion: 2.57 time: 0.144312 Oct 05 02:56:35.621228 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2731/5478] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:35 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:36.333188 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9b2c912d-e752-403f-bd3a-a5a475468430 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:56:36.335487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9b2c912d-e752-403f-bd3a-a5a475468430 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:36.344412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b2c912d-e752-403f-bd3a-a5a475468430 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:36.344934 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b2c912d-e752-403f-bd3a-a5a475468430 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:36.345439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b2c912d-e752-403f-bd3a-a5a475468430 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:36.346353 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b2c912d-e752-403f-bd3a-a5a475468430 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:36.346812 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b2c912d-e752-403f-bd3a-a5a475468430 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:36.347242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b2c912d-e752-403f-bd3a-a5a475468430 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:36.373579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-9b2c912d-e752-403f-bd3a-a5a475468430 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lazy-loading 'flavor' on Instance uuid 7c09b57e-7650-448b-ba76-402bdb4f9552 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:56:36.532040 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9b2c912d-e752-403f-bd3a-a5a475468430 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "POST /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552/action" status: 200 len: 32 microversion: 2.1 time: 0.203336 Oct 05 02:56:36.533312 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2748/5479] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:56:36 2022] POST /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552/action => generated 32 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:56:36.543543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a482332b-1516-4ad8-b72c-e72ceb2859f8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:36.553061 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a482332b-1516-4ad8-b72c-e72ceb2859f8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:36.561846 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:36.578507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a482332b-1516-4ad8-b72c-e72ceb2859f8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:36.579250 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a482332b-1516-4ad8-b72c-e72ceb2859f8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:36.579829 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a482332b-1516-4ad8-b72c-e72ceb2859f8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:36.580546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a482332b-1516-4ad8-b72c-e72ceb2859f8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:36.581053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a482332b-1516-4ad8-b72c-e72ceb2859f8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:36.581485 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a482332b-1516-4ad8-b72c-e72ceb2859f8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:36.634726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-44af1114-17fa-49bb-8839-03c72e511c4d tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:36.635440 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-44af1114-17fa-49bb-8839-03c72e511c4d tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:36.657401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44af1114-17fa-49bb-8839-03c72e511c4d tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:36.675980 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44af1114-17fa-49bb-8839-03c72e511c4d tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:36.676449 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44af1114-17fa-49bb-8839-03c72e511c4d tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:36.677251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44af1114-17fa-49bb-8839-03c72e511c4d tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:36.677737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44af1114-17fa-49bb-8839-03c72e511c4d tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:36.678712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44af1114-17fa-49bb-8839-03c72e511c4d tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:36.796817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-44af1114-17fa-49bb-8839-03c72e511c4d tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:36.816369 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-44af1114-17fa-49bb-8839-03c72e511c4d tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:36.817842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-44af1114-17fa-49bb-8839-03c72e511c4d tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:36.819029 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-44af1114-17fa-49bb-8839-03c72e511c4d tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1365 microversion: 2.57 time: 0.189140 Oct 05 02:56:36.819611 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2749/5480] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:36 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:56:36.895348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a482332b-1516-4ad8-b72c-e72ceb2859f8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:36.906505 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a482332b-1516-4ad8-b72c-e72ceb2859f8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1735 microversion: 2.1 time: 0.366717 Oct 05 02:56:36.910217 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2732/5481] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:56:36 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1735 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:56:37.680847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-762f68ae-1869-4af0-a982-cf322922b0b7 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:37.682047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-762f68ae-1869-4af0-a982-cf322922b0b7 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:37.690340 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-762f68ae-1869-4af0-a982-cf322922b0b7 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:37.691532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-762f68ae-1869-4af0-a982-cf322922b0b7 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:37.692065 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-762f68ae-1869-4af0-a982-cf322922b0b7 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:37.692969 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-762f68ae-1869-4af0-a982-cf322922b0b7 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:37.694117 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-762f68ae-1869-4af0-a982-cf322922b0b7 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:37.694659 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-762f68ae-1869-4af0-a982-cf322922b0b7 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:37.724295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-762f68ae-1869-4af0-a982-cf322922b0b7 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:56:37.820932 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-762f68ae-1869-4af0-a982-cf322922b0b7 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 204 len: 0 microversion: 2.32 time: 0.414180 Oct 05 02:56:37.822686 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2750/5482] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 5 02:56:37 2022] DELETE /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 02:56:37.832461 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b51ef2ad-7519-416c-9e1a-2fbeaf93ccea tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:37.833891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b51ef2ad-7519-416c-9e1a-2fbeaf93ccea tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:37.842703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b51ef2ad-7519-416c-9e1a-2fbeaf93ccea tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:37.843519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b51ef2ad-7519-416c-9e1a-2fbeaf93ccea tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:37.844298 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b51ef2ad-7519-416c-9e1a-2fbeaf93ccea tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:37.845543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b51ef2ad-7519-416c-9e1a-2fbeaf93ccea tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:37.846350 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b51ef2ad-7519-416c-9e1a-2fbeaf93ccea tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:37.846997 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-54243062-e29e-48ef-ad90-f7e11eb2baa5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:37.847162 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b51ef2ad-7519-416c-9e1a-2fbeaf93ccea tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:37.847713 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-54243062-e29e-48ef-ad90-f7e11eb2baa5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:37.854905 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-54243062-e29e-48ef-ad90-f7e11eb2baa5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:37.855593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-54243062-e29e-48ef-ad90-f7e11eb2baa5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:37.856035 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-54243062-e29e-48ef-ad90-f7e11eb2baa5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:37.856881 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-54243062-e29e-48ef-ad90-f7e11eb2baa5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:37.857412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-54243062-e29e-48ef-ad90-f7e11eb2baa5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:37.857839 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-54243062-e29e-48ef-ad90-f7e11eb2baa5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:37.981786 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-54243062-e29e-48ef-ad90-f7e11eb2baa5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:37.993404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-54243062-e29e-48ef-ad90-f7e11eb2baa5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:37.996001 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-54243062-e29e-48ef-ad90-f7e11eb2baa5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:37.998362 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-54243062-e29e-48ef-ad90-f7e11eb2baa5 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1365 microversion: 2.57 time: 0.156695 Oct 05 02:56:38.019097 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2751/5483] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:37 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:38.029719 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dd2fa720-b180-4bf0-987f-a561b068dadb tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:38.030605 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-dd2fa720-b180-4bf0-987f-a561b068dadb tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:38.037522 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:38.038957 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dd2fa720-b180-4bf0-987f-a561b068dadb tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:38.039462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dd2fa720-b180-4bf0-987f-a561b068dadb tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:38.039914 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dd2fa720-b180-4bf0-987f-a561b068dadb tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:38.040633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dd2fa720-b180-4bf0-987f-a561b068dadb tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:38.041190 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dd2fa720-b180-4bf0-987f-a561b068dadb tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:38.041629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dd2fa720-b180-4bf0-987f-a561b068dadb tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:38.206557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b51ef2ad-7519-416c-9e1a-2fbeaf93ccea tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:38.216317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b51ef2ad-7519-416c-9e1a-2fbeaf93ccea tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:38.217785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b51ef2ad-7519-416c-9e1a-2fbeaf93ccea tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:38.219030 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b51ef2ad-7519-416c-9e1a-2fbeaf93ccea tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 2957 microversion: 2.32 time: 0.392040 Oct 05 02:56:38.219612 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2733/5484] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:37 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 2957 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:38.323189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-dd2fa720-b180-4bf0-987f-a561b068dadb tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:38.333033 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-dd2fa720-b180-4bf0-987f-a561b068dadb tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1735 microversion: 2.1 time: 0.312713 Oct 05 02:56:38.334125 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2752/5485] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:56:38 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1735 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:56:39.033638 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-49d8e436-01ea-4e23-9fdf-997dacb92473 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:39.034333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-49d8e436-01ea-4e23-9fdf-997dacb92473 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:39.041739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49d8e436-01ea-4e23-9fdf-997dacb92473 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:39.042227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49d8e436-01ea-4e23-9fdf-997dacb92473 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:39.043353 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49d8e436-01ea-4e23-9fdf-997dacb92473 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:39.044266 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49d8e436-01ea-4e23-9fdf-997dacb92473 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:39.044730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49d8e436-01ea-4e23-9fdf-997dacb92473 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:39.045206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49d8e436-01ea-4e23-9fdf-997dacb92473 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:39.121382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-49d8e436-01ea-4e23-9fdf-997dacb92473 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:39.131982 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-49d8e436-01ea-4e23-9fdf-997dacb92473 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:39.133784 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-49d8e436-01ea-4e23-9fdf-997dacb92473 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:39.134975 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-49d8e436-01ea-4e23-9fdf-997dacb92473 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1365 microversion: 2.57 time: 0.105572 Oct 05 02:56:39.135841 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2734/5486] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:39 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1365 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:39.250170 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-48da7c90-7c65-45a9-8813-5926e7cc6f57 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:39.250665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-48da7c90-7c65-45a9-8813-5926e7cc6f57 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:39.258562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48da7c90-7c65-45a9-8813-5926e7cc6f57 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:39.259289 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48da7c90-7c65-45a9-8813-5926e7cc6f57 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:39.259877 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48da7c90-7c65-45a9-8813-5926e7cc6f57 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:39.260766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48da7c90-7c65-45a9-8813-5926e7cc6f57 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:39.261648 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48da7c90-7c65-45a9-8813-5926e7cc6f57 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:39.262250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48da7c90-7c65-45a9-8813-5926e7cc6f57 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:39.362762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-eccf9a86-c6a8-42b3-a000-1940259c1efd tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:39.365023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-eccf9a86-c6a8-42b3-a000-1940259c1efd tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:39.382706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eccf9a86-c6a8-42b3-a000-1940259c1efd tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:39.383421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eccf9a86-c6a8-42b3-a000-1940259c1efd tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:39.383860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eccf9a86-c6a8-42b3-a000-1940259c1efd tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:39.384557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eccf9a86-c6a8-42b3-a000-1940259c1efd tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:39.385455 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eccf9a86-c6a8-42b3-a000-1940259c1efd tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:39.386049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eccf9a86-c6a8-42b3-a000-1940259c1efd tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:39.598505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-48da7c90-7c65-45a9-8813-5926e7cc6f57 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:39.613182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-48da7c90-7c65-45a9-8813-5926e7cc6f57 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:39.614645 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-48da7c90-7c65-45a9-8813-5926e7cc6f57 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:39.616144 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-48da7c90-7c65-45a9-8813-5926e7cc6f57 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 2957 microversion: 2.32 time: 0.370114 Oct 05 02:56:39.617740 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2753/5487] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:39 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 2957 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:39.677943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-eccf9a86-c6a8-42b3-a000-1940259c1efd tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:39.695064 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-eccf9a86-c6a8-42b3-a000-1940259c1efd tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1735 microversion: 2.1 time: 0.340236 Oct 05 02:56:39.696168 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2735/5488] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:56:39 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1735 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:56:40.166609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d3bfba1f-3d79-4600-8c2c-04dc9091598f tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:40.167531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d3bfba1f-3d79-4600-8c2c-04dc9091598f tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:40.179290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d3bfba1f-3d79-4600-8c2c-04dc9091598f tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:40.180585 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d3bfba1f-3d79-4600-8c2c-04dc9091598f tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:40.181424 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d3bfba1f-3d79-4600-8c2c-04dc9091598f tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:40.183113 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d3bfba1f-3d79-4600-8c2c-04dc9091598f tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:40.183853 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d3bfba1f-3d79-4600-8c2c-04dc9091598f tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:40.184651 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d3bfba1f-3d79-4600-8c2c-04dc9091598f tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:40.272351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d3bfba1f-3d79-4600-8c2c-04dc9091598f tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:40.286806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d3bfba1f-3d79-4600-8c2c-04dc9091598f tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:40.289370 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d3bfba1f-3d79-4600-8c2c-04dc9091598f tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:40.292074 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d3bfba1f-3d79-4600-8c2c-04dc9091598f tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1365 microversion: 2.57 time: 0.132320 Oct 05 02:56:40.293010 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2754/5489] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:40 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1365 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:40.649460 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4af1e88c-cfeb-4e8c-9ed0-68861a94118f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:40.651813 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4af1e88c-cfeb-4e8c-9ed0-68861a94118f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:40.665334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4af1e88c-cfeb-4e8c-9ed0-68861a94118f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:40.666411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4af1e88c-cfeb-4e8c-9ed0-68861a94118f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:40.667043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4af1e88c-cfeb-4e8c-9ed0-68861a94118f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:40.670193 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4af1e88c-cfeb-4e8c-9ed0-68861a94118f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:40.671146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4af1e88c-cfeb-4e8c-9ed0-68861a94118f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:40.672108 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4af1e88c-cfeb-4e8c-9ed0-68861a94118f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:40.719869 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-11f5becd-5eba-406a-9c0d-0d1518c90acc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:40.721190 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-11f5becd-5eba-406a-9c0d-0d1518c90acc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:40.729280 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11f5becd-5eba-406a-9c0d-0d1518c90acc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:40.729783 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11f5becd-5eba-406a-9c0d-0d1518c90acc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:40.730223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11f5becd-5eba-406a-9c0d-0d1518c90acc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:40.730926 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11f5becd-5eba-406a-9c0d-0d1518c90acc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:40.731382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11f5becd-5eba-406a-9c0d-0d1518c90acc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:40.733959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11f5becd-5eba-406a-9c0d-0d1518c90acc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:41.023831 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-11f5becd-5eba-406a-9c0d-0d1518c90acc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:41.038646 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-11f5becd-5eba-406a-9c0d-0d1518c90acc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1735 microversion: 2.1 time: 0.318016 Oct 05 02:56:41.039295 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2755/5490] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:56:40 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1735 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:56:41.053812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4af1e88c-cfeb-4e8c-9ed0-68861a94118f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:41.066535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4af1e88c-cfeb-4e8c-9ed0-68861a94118f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:41.071035 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4af1e88c-cfeb-4e8c-9ed0-68861a94118f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:41.076787 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4af1e88c-cfeb-4e8c-9ed0-68861a94118f tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 2957 microversion: 2.32 time: 0.431459 Oct 05 02:56:41.077699 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2736/5491] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:40 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 2957 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:41.321659 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3df0c6a4-c317-4f21-bfd8-a37f8ec36e11 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:41.322285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3df0c6a4-c317-4f21-bfd8-a37f8ec36e11 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:41.340200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3df0c6a4-c317-4f21-bfd8-a37f8ec36e11 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:41.344054 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3df0c6a4-c317-4f21-bfd8-a37f8ec36e11 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:41.345222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3df0c6a4-c317-4f21-bfd8-a37f8ec36e11 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:41.347756 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3df0c6a4-c317-4f21-bfd8-a37f8ec36e11 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:41.348398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3df0c6a4-c317-4f21-bfd8-a37f8ec36e11 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:41.349161 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3df0c6a4-c317-4f21-bfd8-a37f8ec36e11 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:41.475383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3df0c6a4-c317-4f21-bfd8-a37f8ec36e11 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:41.484715 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3df0c6a4-c317-4f21-bfd8-a37f8ec36e11 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:41.487147 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3df0c6a4-c317-4f21-bfd8-a37f8ec36e11 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:41.488341 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3df0c6a4-c317-4f21-bfd8-a37f8ec36e11 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1383 microversion: 2.57 time: 0.171900 Oct 05 02:56:41.488992 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2756/5492] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:41 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1383 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:56:42.066408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cce7f2d2-cfb9-4296-ab1b-b285fe45ef4a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:42.069176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cce7f2d2-cfb9-4296-ab1b-b285fe45ef4a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:42.084733 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cce7f2d2-cfb9-4296-ab1b-b285fe45ef4a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:42.085872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cce7f2d2-cfb9-4296-ab1b-b285fe45ef4a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:42.087869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cce7f2d2-cfb9-4296-ab1b-b285fe45ef4a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:42.089166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cce7f2d2-cfb9-4296-ab1b-b285fe45ef4a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:42.089938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cce7f2d2-cfb9-4296-ab1b-b285fe45ef4a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:42.090678 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cce7f2d2-cfb9-4296-ab1b-b285fe45ef4a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:42.113177 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-45e926c7-4eea-4f2f-ac60-2381b683b203 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:42.114345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-45e926c7-4eea-4f2f-ac60-2381b683b203 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:42.126047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45e926c7-4eea-4f2f-ac60-2381b683b203 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:42.133413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45e926c7-4eea-4f2f-ac60-2381b683b203 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:42.133960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45e926c7-4eea-4f2f-ac60-2381b683b203 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:42.134715 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45e926c7-4eea-4f2f-ac60-2381b683b203 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:42.135338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45e926c7-4eea-4f2f-ac60-2381b683b203 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:42.135794 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45e926c7-4eea-4f2f-ac60-2381b683b203 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:42.187968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:43.063305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cce7f2d2-cfb9-4296-ab1b-b285fe45ef4a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:43.073171 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cce7f2d2-cfb9-4296-ab1b-b285fe45ef4a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1735 microversion: 2.1 time: 1.012824 Oct 05 02:56:43.077482 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2737/5493] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:56:42 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1735 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:56:43.097106 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1661dd08-69d8-47f1-86a6-d3356fce8e23 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:43.098065 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1661dd08-69d8-47f1-86a6-d3356fce8e23 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:43.108870 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1661dd08-69d8-47f1-86a6-d3356fce8e23 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:43.109712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1661dd08-69d8-47f1-86a6-d3356fce8e23 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:43.110392 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1661dd08-69d8-47f1-86a6-d3356fce8e23 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:43.111843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1661dd08-69d8-47f1-86a6-d3356fce8e23 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:43.113440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1661dd08-69d8-47f1-86a6-d3356fce8e23 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:43.114112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1661dd08-69d8-47f1-86a6-d3356fce8e23 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:43.161131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:43.165814 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-45e926c7-4eea-4f2f-ac60-2381b683b203 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:43.176850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-45e926c7-4eea-4f2f-ac60-2381b683b203 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:43.178353 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-45e926c7-4eea-4f2f-ac60-2381b683b203 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:43.179644 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-45e926c7-4eea-4f2f-ac60-2381b683b203 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 2957 microversion: 2.32 time: 1.071682 Oct 05 02:56:43.197303 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2757/5494] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:42 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 2957 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:43.261943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1661dd08-69d8-47f1-86a6-d3356fce8e23 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:43.283355 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1661dd08-69d8-47f1-86a6-d3356fce8e23 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:43.287920 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1661dd08-69d8-47f1-86a6-d3356fce8e23 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:43.290125 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1661dd08-69d8-47f1-86a6-d3356fce8e23 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1371 microversion: 2.57 time: 0.210829 Oct 05 02:56:43.291980 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2738/5495] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:43 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1371 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:43.344660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-1bacb8cc-3725-4518-a2bb-71b3b11b9c30 req-a9de9b08-87c9-451c-90fe-f888791b6d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ef11e58-0680-4e15-aa40-a4043a5a357a", "name": "network-vif-unplugged", "status": "completed", "tag": "dcd1d668-f512-4fb6-9bc4-5acd98bc044b"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:56:43.356425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1bacb8cc-3725-4518-a2bb-71b3b11b9c30 req-a9de9b08-87c9-451c-90fe-f888791b6d89 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:43.357196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1bacb8cc-3725-4518-a2bb-71b3b11b9c30 req-a9de9b08-87c9-451c-90fe-f888791b6d89 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:43.357873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1bacb8cc-3725-4518-a2bb-71b3b11b9c30 req-a9de9b08-87c9-451c-90fe-f888791b6d89 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:43.372982 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-1bacb8cc-3725-4518-a2bb-71b3b11b9c30 req-a9de9b08-87c9-451c-90fe-f888791b6d89 service nova] Creating event network-vif-unplugged:dcd1d668-f512-4fb6-9bc4-5acd98bc044b for instance 2ef11e58-0680-4e15-aa40-a4043a5a357a on n-h1-858272-3 Oct 05 02:56:43.379779 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-1bacb8cc-3725-4518-a2bb-71b3b11b9c30 req-a9de9b08-87c9-451c-90fe-f888791b6d89 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038632 Oct 05 02:56:43.381071 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2758/5496] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:56:44.100777 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cbada283-e253-4827-acee-0adfa2514f9f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:44.102019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cbada283-e253-4827-acee-0adfa2514f9f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:44.121722 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbada283-e253-4827-acee-0adfa2514f9f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:44.122488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbada283-e253-4827-acee-0adfa2514f9f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:44.123352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbada283-e253-4827-acee-0adfa2514f9f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:44.124349 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbada283-e253-4827-acee-0adfa2514f9f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:44.125029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbada283-e253-4827-acee-0adfa2514f9f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:44.125653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbada283-e253-4827-acee-0adfa2514f9f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:44.210560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1de37653-4339-490b-b7c2-75c9fb8c0f44 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:44.211277 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1de37653-4339-490b-b7c2-75c9fb8c0f44 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:44.230080 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1de37653-4339-490b-b7c2-75c9fb8c0f44 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:44.231011 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1de37653-4339-490b-b7c2-75c9fb8c0f44 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:44.232750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1de37653-4339-490b-b7c2-75c9fb8c0f44 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:44.234593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1de37653-4339-490b-b7c2-75c9fb8c0f44 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:44.237108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1de37653-4339-490b-b7c2-75c9fb8c0f44 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:44.240454 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1de37653-4339-490b-b7c2-75c9fb8c0f44 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:44.614692 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1de37653-4339-490b-b7c2-75c9fb8c0f44 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:44.637217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1de37653-4339-490b-b7c2-75c9fb8c0f44 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:44.637217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1de37653-4339-490b-b7c2-75c9fb8c0f44 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:44.637217 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1de37653-4339-490b-b7c2-75c9fb8c0f44 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 2936 microversion: 2.32 time: 0.427291 Oct 05 02:56:44.637217 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2759/5497] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:44 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 2936 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:44.638758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3fb795c2-cb30-4046-8e5d-240fe5761114 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:44.639745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3fb795c2-cb30-4046-8e5d-240fe5761114 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:44.649417 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3fb795c2-cb30-4046-8e5d-240fe5761114 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:44.650195 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3fb795c2-cb30-4046-8e5d-240fe5761114 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:44.650829 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3fb795c2-cb30-4046-8e5d-240fe5761114 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:44.651937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3fb795c2-cb30-4046-8e5d-240fe5761114 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:44.652612 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3fb795c2-cb30-4046-8e5d-240fe5761114 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:44.653309 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3fb795c2-cb30-4046-8e5d-240fe5761114 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:44.792058 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cbada283-e253-4827-acee-0adfa2514f9f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:44.825908 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cbada283-e253-4827-acee-0adfa2514f9f tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1735 microversion: 2.1 time: 0.724594 Oct 05 02:56:44.827123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3fb795c2-cb30-4046-8e5d-240fe5761114 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:44.828245 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2739/5498] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:56:44 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1735 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:56:44.844121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3fb795c2-cb30-4046-8e5d-240fe5761114 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:44.851062 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3fb795c2-cb30-4046-8e5d-240fe5761114 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:44.853403 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3fb795c2-cb30-4046-8e5d-240fe5761114 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1371 microversion: 2.57 time: 0.218125 Oct 05 02:56:44.854871 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2760/5499] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:44 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1371 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:45.408863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-17827cb5-614f-4527-a33d-2bfbe2a46d48 req-12e8b5c6-c014-4dc9-a164-d8878d5a4060 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ef11e58-0680-4e15-aa40-a4043a5a357a", "name": "network-vif-unplugged", "status": "completed", "tag": "384505a1-ac43-4ab5-a021-9305e81770ae"}, {"server_uuid": "2ef11e58-0680-4e15-aa40-a4043a5a357a", "name": "network-vif-unplugged", "status": "completed", "tag": "5b01513e-6840-4e8a-9f16-5f658f55e045"}, {"server_uuid": "2ef11e58-0680-4e15-aa40-a4043a5a357a", "name": "network-vif-unplugged", "status": "completed", "tag": "4b351d8f-7fd7-478b-adba-19c746dc4014"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:56:45.422066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-17827cb5-614f-4527-a33d-2bfbe2a46d48 req-12e8b5c6-c014-4dc9-a164-d8878d5a4060 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:45.422903 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-17827cb5-614f-4527-a33d-2bfbe2a46d48 req-12e8b5c6-c014-4dc9-a164-d8878d5a4060 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:45.423680 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-17827cb5-614f-4527-a33d-2bfbe2a46d48 req-12e8b5c6-c014-4dc9-a164-d8878d5a4060 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:45.441351 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-17827cb5-614f-4527-a33d-2bfbe2a46d48 req-12e8b5c6-c014-4dc9-a164-d8878d5a4060 service nova] Creating event network-vif-unplugged:384505a1-ac43-4ab5-a021-9305e81770ae for instance 2ef11e58-0680-4e15-aa40-a4043a5a357a on n-h1-858272-3 Oct 05 02:56:45.457165 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-17827cb5-614f-4527-a33d-2bfbe2a46d48 req-12e8b5c6-c014-4dc9-a164-d8878d5a4060 service nova] Creating event network-vif-unplugged:5b01513e-6840-4e8a-9f16-5f658f55e045 for instance 2ef11e58-0680-4e15-aa40-a4043a5a357a on n-h1-858272-3 Oct 05 02:56:45.459174 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-17827cb5-614f-4527-a33d-2bfbe2a46d48 req-12e8b5c6-c014-4dc9-a164-d8878d5a4060 service nova] Creating event network-vif-unplugged:4b351d8f-7fd7-478b-adba-19c746dc4014 for instance 2ef11e58-0680-4e15-aa40-a4043a5a357a on n-h1-858272-3 Oct 05 02:56:45.468710 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-17827cb5-614f-4527-a33d-2bfbe2a46d48 req-12e8b5c6-c014-4dc9-a164-d8878d5a4060 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.065800 Oct 05 02:56:45.470513 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2740/5500] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:56:45.666441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4ab6c91b-7946-4de1-9c9f-539bdb535560 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:45.667727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4ab6c91b-7946-4de1-9c9f-539bdb535560 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:45.684673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ab6c91b-7946-4de1-9c9f-539bdb535560 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:45.685595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ab6c91b-7946-4de1-9c9f-539bdb535560 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:45.686247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ab6c91b-7946-4de1-9c9f-539bdb535560 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:45.687152 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ab6c91b-7946-4de1-9c9f-539bdb535560 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:45.687781 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ab6c91b-7946-4de1-9c9f-539bdb535560 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:45.688366 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ab6c91b-7946-4de1-9c9f-539bdb535560 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:45.860982 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0e6204dd-8f93-4d77-97b6-f0193abc0922 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:45.861959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0e6204dd-8f93-4d77-97b6-f0193abc0922 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:45.871955 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e6204dd-8f93-4d77-97b6-f0193abc0922 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:45.883341 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e6204dd-8f93-4d77-97b6-f0193abc0922 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:45.885354 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e6204dd-8f93-4d77-97b6-f0193abc0922 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:45.886223 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e6204dd-8f93-4d77-97b6-f0193abc0922 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:45.889003 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e6204dd-8f93-4d77-97b6-f0193abc0922 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:45.896821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e6204dd-8f93-4d77-97b6-f0193abc0922 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:46.188101 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4ab6c91b-7946-4de1-9c9f-539bdb535560 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:46.206830 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4ab6c91b-7946-4de1-9c9f-539bdb535560 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:46.208606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4ab6c91b-7946-4de1-9c9f-539bdb535560 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:46.210210 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4ab6c91b-7946-4de1-9c9f-539bdb535560 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 2868 microversion: 2.32 time: 0.550848 Oct 05 02:56:46.211358 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2761/5501] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:45 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 2868 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:46.219042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-44a2e273-bfa8-4134-9d54-f769f699f91e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:46.220539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-44a2e273-bfa8-4134-9d54-f769f699f91e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:46.238638 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44a2e273-bfa8-4134-9d54-f769f699f91e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:46.239415 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44a2e273-bfa8-4134-9d54-f769f699f91e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:46.240088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44a2e273-bfa8-4134-9d54-f769f699f91e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:46.241086 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44a2e273-bfa8-4134-9d54-f769f699f91e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:46.241813 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44a2e273-bfa8-4134-9d54-f769f699f91e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:46.242450 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44a2e273-bfa8-4134-9d54-f769f699f91e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:46.257487 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0e6204dd-8f93-4d77-97b6-f0193abc0922 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:46.272259 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0e6204dd-8f93-4d77-97b6-f0193abc0922 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1735 microversion: 2.1 time: 0.416288 Oct 05 02:56:46.272861 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2741/5502] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:56:45 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1735 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:56:46.433822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-44a2e273-bfa8-4134-9d54-f769f699f91e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:46.453703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-44a2e273-bfa8-4134-9d54-f769f699f91e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:46.455275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-44a2e273-bfa8-4134-9d54-f769f699f91e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:46.462088 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-44a2e273-bfa8-4134-9d54-f769f699f91e tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1356 microversion: 2.57 time: 0.249319 Oct 05 02:56:46.475326 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2762/5503] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:46 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1356 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:46.502078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-142c4553-ec0a-48a9-a0ff-9c539b625b51 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:46.502829 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-142c4553-ec0a-48a9-a0ff-9c539b625b51 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:46.525629 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-142c4553-ec0a-48a9-a0ff-9c539b625b51 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:46.526187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-142c4553-ec0a-48a9-a0ff-9c539b625b51 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:46.526640 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-142c4553-ec0a-48a9-a0ff-9c539b625b51 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:46.527392 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-142c4553-ec0a-48a9-a0ff-9c539b625b51 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:46.527854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-142c4553-ec0a-48a9-a0ff-9c539b625b51 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:46.528473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-142c4553-ec0a-48a9-a0ff-9c539b625b51 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:46.578239 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-142c4553-ec0a-48a9-a0ff-9c539b625b51 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:56:46.645072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-9d993ca7-ec3d-4a1e-ae42-1d6ba3dabdfe req-8b082154-1b2e-4ad2-806b-65b10b9a8795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ef11e58-0680-4e15-aa40-a4043a5a357a", "name": "network-vif-deleted", "tag": "384505a1-ac43-4ab5-a021-9305e81770ae"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:56:46.679722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9d993ca7-ec3d-4a1e-ae42-1d6ba3dabdfe req-8b082154-1b2e-4ad2-806b-65b10b9a8795 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:46.685403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9d993ca7-ec3d-4a1e-ae42-1d6ba3dabdfe req-8b082154-1b2e-4ad2-806b-65b10b9a8795 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:46.685880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9d993ca7-ec3d-4a1e-ae42-1d6ba3dabdfe req-8b082154-1b2e-4ad2-806b-65b10b9a8795 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:46.717347 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-9d993ca7-ec3d-4a1e-ae42-1d6ba3dabdfe req-8b082154-1b2e-4ad2-806b-65b10b9a8795 service nova] Creating event network-vif-deleted:384505a1-ac43-4ab5-a021-9305e81770ae for instance 2ef11e58-0680-4e15-aa40-a4043a5a357a on n-h1-858272-3 Oct 05 02:56:46.729109 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-9d993ca7-ec3d-4a1e-ae42-1d6ba3dabdfe req-8b082154-1b2e-4ad2-806b-65b10b9a8795 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088944 Oct 05 02:56:46.730441 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2763/5504] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:56:46.776851 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-142c4553-ec0a-48a9-a0ff-9c539b625b51 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "DELETE /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 204 len: 0 microversion: 2.57 time: 0.278572 Oct 05 02:56:46.778221 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2742/5505] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 5 02:56:46 2022] DELETE /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 02:56:46.789504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b432d2f4-1fc1-4bae-adcc-9a2d96f8741d tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:46.790360 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b432d2f4-1fc1-4bae-adcc-9a2d96f8741d tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:46.808794 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b432d2f4-1fc1-4bae-adcc-9a2d96f8741d tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:46.810998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b432d2f4-1fc1-4bae-adcc-9a2d96f8741d tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:46.812030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b432d2f4-1fc1-4bae-adcc-9a2d96f8741d tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:46.812928 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b432d2f4-1fc1-4bae-adcc-9a2d96f8741d tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:46.813552 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b432d2f4-1fc1-4bae-adcc-9a2d96f8741d tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:46.814153 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b432d2f4-1fc1-4bae-adcc-9a2d96f8741d tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:47.079078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b432d2f4-1fc1-4bae-adcc-9a2d96f8741d tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:47.098941 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b432d2f4-1fc1-4bae-adcc-9a2d96f8741d tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:47.106298 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b432d2f4-1fc1-4bae-adcc-9a2d96f8741d tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:47.112874 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b432d2f4-1fc1-4bae-adcc-9a2d96f8741d tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1362 microversion: 2.57 time: 0.330336 Oct 05 02:56:47.117234 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2764/5506] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:46 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1362 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:56:47.245674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f9bed319-da13-440c-9d32-b43a24dda715 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:47.245674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f9bed319-da13-440c-9d32-b43a24dda715 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:47.263040 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9bed319-da13-440c-9d32-b43a24dda715 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:47.263040 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9bed319-da13-440c-9d32-b43a24dda715 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:47.268133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9bed319-da13-440c-9d32-b43a24dda715 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:47.268717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9bed319-da13-440c-9d32-b43a24dda715 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:47.277322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9bed319-da13-440c-9d32-b43a24dda715 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:47.278443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9bed319-da13-440c-9d32-b43a24dda715 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:47.306699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8257ff5a-8c1e-4716-b814-5efce675ccd2 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:47.307705 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8257ff5a-8c1e-4716-b814-5efce675ccd2 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:47.316939 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8257ff5a-8c1e-4716-b814-5efce675ccd2 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:47.325283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8257ff5a-8c1e-4716-b814-5efce675ccd2 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:47.326146 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8257ff5a-8c1e-4716-b814-5efce675ccd2 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:47.327083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8257ff5a-8c1e-4716-b814-5efce675ccd2 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:47.328762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8257ff5a-8c1e-4716-b814-5efce675ccd2 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:47.331040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8257ff5a-8c1e-4716-b814-5efce675ccd2 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:47.870563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f9bed319-da13-440c-9d32-b43a24dda715 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:47.888280 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f9bed319-da13-440c-9d32-b43a24dda715 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:47.901645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f9bed319-da13-440c-9d32-b43a24dda715 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:47.903197 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f9bed319-da13-440c-9d32-b43a24dda715 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 2581 microversion: 2.32 time: 0.662935 Oct 05 02:56:47.904450 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2743/5507] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:47 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 2581 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:47.922066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-2f33afe2-d127-4b89-b0eb-6a1822f99a53 req-03e1ec28-e9de-46db-aad9-20b2b14eae2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ef11e58-0680-4e15-aa40-a4043a5a357a", "name": "network-vif-unplugged", "status": "completed", "tag": "5fa0dbc4-38a1-4d15-bfed-c34585b87d54"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:56:47.945779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-2f33afe2-d127-4b89-b0eb-6a1822f99a53 req-03e1ec28-e9de-46db-aad9-20b2b14eae2c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:47.951569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-2f33afe2-d127-4b89-b0eb-6a1822f99a53 req-03e1ec28-e9de-46db-aad9-20b2b14eae2c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:47.952510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-2f33afe2-d127-4b89-b0eb-6a1822f99a53 req-03e1ec28-e9de-46db-aad9-20b2b14eae2c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:48.003242 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-2f33afe2-d127-4b89-b0eb-6a1822f99a53 req-03e1ec28-e9de-46db-aad9-20b2b14eae2c service nova] Creating event network-vif-unplugged:5fa0dbc4-38a1-4d15-bfed-c34585b87d54 for instance 2ef11e58-0680-4e15-aa40-a4043a5a357a on n-h1-858272-3 Oct 05 02:56:48.021504 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-2f33afe2-d127-4b89-b0eb-6a1822f99a53 req-03e1ec28-e9de-46db-aad9-20b2b14eae2c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115544 Oct 05 02:56:48.022430 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2744/5508] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:56:48.084097 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8257ff5a-8c1e-4716-b814-5efce675ccd2 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:48.094927 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8257ff5a-8c1e-4716-b814-5efce675ccd2 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1735 microversion: 2.1 time: 0.791950 Oct 05 02:56:48.096716 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2765/5509] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:56:47 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1735 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:56:48.174857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1bb4c7b4-ba02-4282-90ca-c894ef7777dc tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:48.183075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1bb4c7b4-ba02-4282-90ca-c894ef7777dc tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:48.208262 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bb4c7b4-ba02-4282-90ca-c894ef7777dc tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:48.227814 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bb4c7b4-ba02-4282-90ca-c894ef7777dc tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:48.227814 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bb4c7b4-ba02-4282-90ca-c894ef7777dc tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:48.233456 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bb4c7b4-ba02-4282-90ca-c894ef7777dc tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:48.234214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bb4c7b4-ba02-4282-90ca-c894ef7777dc tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:48.234881 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bb4c7b4-ba02-4282-90ca-c894ef7777dc tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:48.492729 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1bb4c7b4-ba02-4282-90ca-c894ef7777dc tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:48.508473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1bb4c7b4-ba02-4282-90ca-c894ef7777dc tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:48.514892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1bb4c7b4-ba02-4282-90ca-c894ef7777dc tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:48.523608 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1bb4c7b4-ba02-4282-90ca-c894ef7777dc tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1362 microversion: 2.57 time: 0.375876 Oct 05 02:56:48.524663 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2745/5510] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:48 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1362 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:48.811751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-3c1dfd4e-b208-4eab-b924-6fd012e49ae4 req-965648bf-c39a-443b-b663-038ab6899b0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ef11e58-0680-4e15-aa40-a4043a5a357a", "name": "network-vif-deleted", "tag": "5fa0dbc4-38a1-4d15-bfed-c34585b87d54"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:56:48.827788 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-3c1dfd4e-b208-4eab-b924-6fd012e49ae4 req-965648bf-c39a-443b-b663-038ab6899b0d service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:48.828671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-3c1dfd4e-b208-4eab-b924-6fd012e49ae4 req-965648bf-c39a-443b-b663-038ab6899b0d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:48.829331 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-3c1dfd4e-b208-4eab-b924-6fd012e49ae4 req-965648bf-c39a-443b-b663-038ab6899b0d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:48.851465 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-3c1dfd4e-b208-4eab-b924-6fd012e49ae4 req-965648bf-c39a-443b-b663-038ab6899b0d service nova] Creating event network-vif-deleted:5fa0dbc4-38a1-4d15-bfed-c34585b87d54 for instance 2ef11e58-0680-4e15-aa40-a4043a5a357a on n-h1-858272-3 Oct 05 02:56:48.865719 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-3c1dfd4e-b208-4eab-b924-6fd012e49ae4 req-965648bf-c39a-443b-b663-038ab6899b0d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055106 Oct 05 02:56:48.868686 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2766/5511] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:56:48.934853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-709b2732-db2f-4948-8ee4-f70a5c37e041 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:48.936128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-709b2732-db2f-4948-8ee4-f70a5c37e041 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:48.945291 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-709b2732-db2f-4948-8ee4-f70a5c37e041 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:48.946023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-709b2732-db2f-4948-8ee4-f70a5c37e041 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:48.946620 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-709b2732-db2f-4948-8ee4-f70a5c37e041 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:48.947514 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-709b2732-db2f-4948-8ee4-f70a5c37e041 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:48.948128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-709b2732-db2f-4948-8ee4-f70a5c37e041 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:48.948698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-709b2732-db2f-4948-8ee4-f70a5c37e041 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:49.122342 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f96142a9-af5d-4ddf-b759-98c908dd9aa9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:49.125403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f96142a9-af5d-4ddf-b759-98c908dd9aa9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:49.143904 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f96142a9-af5d-4ddf-b759-98c908dd9aa9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:49.150039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f96142a9-af5d-4ddf-b759-98c908dd9aa9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:49.151557 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f96142a9-af5d-4ddf-b759-98c908dd9aa9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:49.153055 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f96142a9-af5d-4ddf-b759-98c908dd9aa9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:49.153785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f96142a9-af5d-4ddf-b759-98c908dd9aa9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:49.155454 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f96142a9-af5d-4ddf-b759-98c908dd9aa9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:49.200535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-709b2732-db2f-4948-8ee4-f70a5c37e041 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:49.210822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-709b2732-db2f-4948-8ee4-f70a5c37e041 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:49.212274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-709b2732-db2f-4948-8ee4-f70a5c37e041 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:49.215745 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-709b2732-db2f-4948-8ee4-f70a5c37e041 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 2374 microversion: 2.32 time: 0.284938 Oct 05 02:56:49.216327 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2746/5512] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:48 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 2374 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:56:49.543016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f96142a9-af5d-4ddf-b759-98c908dd9aa9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:49.560879 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a9056c15-b81a-4069-bcd4-8f516c9e8bb8 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:49.562152 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a9056c15-b81a-4069-bcd4-8f516c9e8bb8 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:49.603223 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f96142a9-af5d-4ddf-b759-98c908dd9aa9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1735 microversion: 2.1 time: 0.481569 Oct 05 02:56:49.606858 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9056c15-b81a-4069-bcd4-8f516c9e8bb8 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:49.629880 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2767/5513] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:56:49 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1735 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:56:49.631274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9056c15-b81a-4069-bcd4-8f516c9e8bb8 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:49.631966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9056c15-b81a-4069-bcd4-8f516c9e8bb8 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:49.653600 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9056c15-b81a-4069-bcd4-8f516c9e8bb8 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:49.653600 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9056c15-b81a-4069-bcd4-8f516c9e8bb8 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:49.669228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9056c15-b81a-4069-bcd4-8f516c9e8bb8 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:49.802053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9056c15-b81a-4069-bcd4-8f516c9e8bb8 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:49.802559 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9056c15-b81a-4069-bcd4-8f516c9e8bb8 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:49.811025 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9056c15-b81a-4069-bcd4-8f516c9e8bb8 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:49.811847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-a9056c15-b81a-4069-bcd4-8f516c9e8bb8 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lazy-loading 'fault' on Instance uuid 48ba6625-c9d1-4ca8-9932-001f299a9290 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:56:49.917953 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a9056c15-b81a-4069-bcd4-8f516c9e8bb8 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:49.931300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a9056c15-b81a-4069-bcd4-8f516c9e8bb8 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:49.933202 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a9056c15-b81a-4069-bcd4-8f516c9e8bb8 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2879c269c66546329d7b2417e99a7d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9789e2e26a5e4679b6f83e0feff71c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:49.937164 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a9056c15-b81a-4069-bcd4-8f516c9e8bb8 tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 200 len: 1367 microversion: 2.57 time: 0.381734 Oct 05 02:56:49.938430 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2747/5514] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:49 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 1367 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:50.249057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-96bca46c-fe13-4283-bf2a-6d46d309fdbb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:50.249680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-96bca46c-fe13-4283-bf2a-6d46d309fdbb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:50.280294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96bca46c-fe13-4283-bf2a-6d46d309fdbb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:50.281129 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96bca46c-fe13-4283-bf2a-6d46d309fdbb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:50.281755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96bca46c-fe13-4283-bf2a-6d46d309fdbb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:50.282779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96bca46c-fe13-4283-bf2a-6d46d309fdbb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:50.283501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96bca46c-fe13-4283-bf2a-6d46d309fdbb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:50.284179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96bca46c-fe13-4283-bf2a-6d46d309fdbb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:50.669477 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-29ecebae-c73b-4365-933c-8b95b60238be tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:50.671162 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-29ecebae-c73b-4365-933c-8b95b60238be tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:50.693467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29ecebae-c73b-4365-933c-8b95b60238be tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:50.696276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29ecebae-c73b-4365-933c-8b95b60238be tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:50.697865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29ecebae-c73b-4365-933c-8b95b60238be tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:50.699438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29ecebae-c73b-4365-933c-8b95b60238be tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:50.700423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29ecebae-c73b-4365-933c-8b95b60238be tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:50.701421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29ecebae-c73b-4365-933c-8b95b60238be tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:50.887896 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-96bca46c-fe13-4283-bf2a-6d46d309fdbb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:50.902602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-96bca46c-fe13-4283-bf2a-6d46d309fdbb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:50.904460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-96bca46c-fe13-4283-bf2a-6d46d309fdbb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:50.910456 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-96bca46c-fe13-4283-bf2a-6d46d309fdbb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 2259 microversion: 2.32 time: 0.666766 Oct 05 02:56:50.911658 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2768/5515] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:50 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 2259 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:50.919428 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-96e9e214-1102-4217-9497-b0f7f1a9e68e req-68fcc4e8-a513-406a-856c-3c28587cf558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ef11e58-0680-4e15-aa40-a4043a5a357a", "name": "network-vif-deleted", "tag": "dcd1d668-f512-4fb6-9bc4-5acd98bc044b"}, {"server_uuid": "2ef11e58-0680-4e15-aa40-a4043a5a357a", "name": "network-vif-deleted", "tag": "4b351d8f-7fd7-478b-adba-19c746dc4014"}, {"server_uuid": "2ef11e58-0680-4e15-aa40-a4043a5a357a", "name": "network-vif-deleted", "tag": "5b01513e-6840-4e8a-9f16-5f658f55e045"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:56:50.944519 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-96e9e214-1102-4217-9497-b0f7f1a9e68e req-68fcc4e8-a513-406a-856c-3c28587cf558 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:50.945478 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-96e9e214-1102-4217-9497-b0f7f1a9e68e req-68fcc4e8-a513-406a-856c-3c28587cf558 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:50.947732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-96e9e214-1102-4217-9497-b0f7f1a9e68e req-68fcc4e8-a513-406a-856c-3c28587cf558 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:50.984637 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-96e9e214-1102-4217-9497-b0f7f1a9e68e req-68fcc4e8-a513-406a-856c-3c28587cf558 service nova] Creating event network-vif-deleted:dcd1d668-f512-4fb6-9bc4-5acd98bc044b for instance 2ef11e58-0680-4e15-aa40-a4043a5a357a on n-h1-858272-3 Oct 05 02:56:50.988486 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-96e9e214-1102-4217-9497-b0f7f1a9e68e req-68fcc4e8-a513-406a-856c-3c28587cf558 service nova] Creating event network-vif-deleted:4b351d8f-7fd7-478b-adba-19c746dc4014 for instance 2ef11e58-0680-4e15-aa40-a4043a5a357a on n-h1-858272-3 Oct 05 02:56:50.992435 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-96e9e214-1102-4217-9497-b0f7f1a9e68e req-68fcc4e8-a513-406a-856c-3c28587cf558 service nova] Creating event network-vif-deleted:5b01513e-6840-4e8a-9f16-5f658f55e045 for instance 2ef11e58-0680-4e15-aa40-a4043a5a357a on n-h1-858272-3 Oct 05 02:56:51.012993 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-96e9e214-1102-4217-9497-b0f7f1a9e68e req-68fcc4e8-a513-406a-856c-3c28587cf558 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.091652 Oct 05 02:56:51.014151 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2769/5516] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:56:51.023219 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ac61ac60-70c1-4170-aabc-8dd115d7f27c tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:51.038042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ac61ac60-70c1-4170-aabc-8dd115d7f27c tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] [instance: 48ba6625-c9d1-4ca8-9932-001f299a9290] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:51.059997 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac61ac60-70c1-4170-aabc-8dd115d7f27c tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:51.067580 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac61ac60-70c1-4170-aabc-8dd115d7f27c tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:51.068154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac61ac60-70c1-4170-aabc-8dd115d7f27c tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:51.069109 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac61ac60-70c1-4170-aabc-8dd115d7f27c tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:51.069702 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac61ac60-70c1-4170-aabc-8dd115d7f27c tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:51.070235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac61ac60-70c1-4170-aabc-8dd115d7f27c tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:51.100003 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-ac61ac60-70c1-4170-aabc-8dd115d7f27c tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] HTTP exception thrown: Instance 48ba6625-c9d1-4ca8-9932-001f299a9290 could not be found. Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ac61ac60-70c1-4170-aabc-8dd115d7f27c tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Request method failure captured: Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 HTTP/1.1 Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPJHrA0S7HaICoXjo83UsXlpFXNoInM4YKZBYyscFIupj9L173xVpUb2MU1kGDqeAK729Y1V1W2rW_5qIwY-tDpsPI1BBF7FF8R5Rfie8ZzkxMzauxrmbTCh2vgIUqs8NvfIDNcC3WkaWT5jJ0O_IEV5v3le5spZ2kalpxQDolLjFLk Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: X-Openstack-Nova-Api-Version: 2.57 Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 9789e2e26a5e4679b6f83e0feff71c2c Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerShowV257Test-1932141144 Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9789e2e26a5e4679b6f83e0feff71c2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9789e2e26a5e4679b6f83e0feff71c2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9789e2e26a5e4679b6f83e0feff71c2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9789e2e26a5e4679b6f83e0feff71c2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerShowV257Test-1932141144 Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 9789e2e26a5e4679b6f83e0feff71c2c Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerShowV257Test-1932141144 Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerShowV257Test-1932141144-project Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 2879c269c66546329d7b2417e99a7d9c Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerShowV257Test-1932141144-project Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 48ba6625-c9d1-4ca8-9932-001f299a9290 could not be found. Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '48ba6625-c9d1-4ca8-9932-001f299a9290'} Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48ba6625-c9d1-4ca8-9932-001f299a9290 could not be found. Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48ba6625-c9d1-4ca8-9932-001f299a9290 could not be found. Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:56:51.102230 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:56:51.106242 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:56:51.106242 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:56:51.106242 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:56:51.106242 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:56:51.106242 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:56:51.106242 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48ba6625-c9d1-4ca8-9932-001f299a9290 could not be found. Oct 05 02:56:51.106242 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:56:51.108249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ac61ac60-70c1-4170-aabc-8dd115d7f27c tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] Returning 404 to user: Instance 48ba6625-c9d1-4ca8-9932-001f299a9290 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:56:51.109403 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ac61ac60-70c1-4170-aabc-8dd115d7f27c tempest-ServerShowV257Test-1932141144 tempest-ServerShowV257Test-1932141144-project] 10.222.0.16 "GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290" status: 404 len: 111 microversion: 2.57 time: 0.094014 Oct 05 02:56:51.111061 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2770/5517] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:51 2022] GET /compute/v2.1/servers/48ba6625-c9d1-4ca8-9932-001f299a9290 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:56:51.169272 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-29ecebae-c73b-4365-933c-8b95b60238be tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:51.181638 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-29ecebae-c73b-4365-933c-8b95b60238be tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1735 microversion: 2.1 time: 0.530277 Oct 05 02:56:51.189397 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2748/5518] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:56:50 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1735 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:56:51.942489 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0172a309-5730-4b9e-b2fb-c13f9e178cbf tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:51.943100 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0172a309-5730-4b9e-b2fb-c13f9e178cbf tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:51.970330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0172a309-5730-4b9e-b2fb-c13f9e178cbf tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:51.970937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0172a309-5730-4b9e-b2fb-c13f9e178cbf tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:51.971629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0172a309-5730-4b9e-b2fb-c13f9e178cbf tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:51.984275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0172a309-5730-4b9e-b2fb-c13f9e178cbf tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:51.984275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0172a309-5730-4b9e-b2fb-c13f9e178cbf tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:51.984446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0172a309-5730-4b9e-b2fb-c13f9e178cbf tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:52.141827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0172a309-5730-4b9e-b2fb-c13f9e178cbf tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:52.164435 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0172a309-5730-4b9e-b2fb-c13f9e178cbf tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:52.169600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0172a309-5730-4b9e-b2fb-c13f9e178cbf tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:52.172438 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0172a309-5730-4b9e-b2fb-c13f9e178cbf tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1605 microversion: 2.32 time: 0.234033 Oct 05 02:56:52.175609 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2771/5519] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:51 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1605 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:52.219119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-44c8f7c5-35b3-4795-b1b2-828dbd69fe39 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:52.221100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-44c8f7c5-35b3-4795-b1b2-828dbd69fe39 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:52.245082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44c8f7c5-35b3-4795-b1b2-828dbd69fe39 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:52.246971 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44c8f7c5-35b3-4795-b1b2-828dbd69fe39 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:52.249595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44c8f7c5-35b3-4795-b1b2-828dbd69fe39 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:52.251009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44c8f7c5-35b3-4795-b1b2-828dbd69fe39 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:52.254959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44c8f7c5-35b3-4795-b1b2-828dbd69fe39 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:52.257707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44c8f7c5-35b3-4795-b1b2-828dbd69fe39 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:53.210376 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-be6eed82-43c9-417e-8b15-583070afcb95 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:53.211644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-be6eed82-43c9-417e-8b15-583070afcb95 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:53.221344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-44c8f7c5-35b3-4795-b1b2-828dbd69fe39 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:53.238086 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be6eed82-43c9-417e-8b15-583070afcb95 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:53.239026 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be6eed82-43c9-417e-8b15-583070afcb95 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:53.239502 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-44c8f7c5-35b3-4795-b1b2-828dbd69fe39 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1735 microversion: 2.1 time: 1.021914 Oct 05 02:56:53.241227 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2749/5520] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:56:52 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1735 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:56:53.241431 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be6eed82-43c9-417e-8b15-583070afcb95 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:53.243480 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be6eed82-43c9-417e-8b15-583070afcb95 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:53.244139 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be6eed82-43c9-417e-8b15-583070afcb95 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:53.255318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be6eed82-43c9-417e-8b15-583070afcb95 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:53.374480 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-be6eed82-43c9-417e-8b15-583070afcb95 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:53.387863 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-be6eed82-43c9-417e-8b15-583070afcb95 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:53.389767 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-be6eed82-43c9-417e-8b15-583070afcb95 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:53.391301 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-be6eed82-43c9-417e-8b15-583070afcb95 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1605 microversion: 2.32 time: 0.185272 Oct 05 02:56:53.392399 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2772/5521] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:53 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1605 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:56:54.303845 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-aa539494-c921-4699-bf4f-93ef4a297780 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:54.319722 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-aa539494-c921-4699-bf4f-93ef4a297780 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:54.349440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa539494-c921-4699-bf4f-93ef4a297780 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:54.356528 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa539494-c921-4699-bf4f-93ef4a297780 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:54.357842 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa539494-c921-4699-bf4f-93ef4a297780 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:54.358833 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa539494-c921-4699-bf4f-93ef4a297780 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:54.359503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa539494-c921-4699-bf4f-93ef4a297780 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:54.360270 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa539494-c921-4699-bf4f-93ef4a297780 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:54.418755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-93eb7df6-48a4-4993-b0db-32a10e74f3da tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:54.420042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-93eb7df6-48a4-4993-b0db-32a10e74f3da tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:54.433147 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93eb7df6-48a4-4993-b0db-32a10e74f3da tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:54.436251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93eb7df6-48a4-4993-b0db-32a10e74f3da tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:54.445205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93eb7df6-48a4-4993-b0db-32a10e74f3da tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:54.446290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93eb7df6-48a4-4993-b0db-32a10e74f3da tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:54.448293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93eb7df6-48a4-4993-b0db-32a10e74f3da tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:54.449239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-93eb7df6-48a4-4993-b0db-32a10e74f3da tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:54.672211 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-93eb7df6-48a4-4993-b0db-32a10e74f3da tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:54.690747 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-93eb7df6-48a4-4993-b0db-32a10e74f3da tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:54.695747 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-93eb7df6-48a4-4993-b0db-32a10e74f3da tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:54.699325 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-93eb7df6-48a4-4993-b0db-32a10e74f3da tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1605 microversion: 2.32 time: 0.284583 Oct 05 02:56:54.717938 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2773/5522] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:54 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1605 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:56:54.819591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-aa539494-c921-4699-bf4f-93ef4a297780 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:54.831003 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-aa539494-c921-4699-bf4f-93ef4a297780 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1735 microversion: 2.1 time: 0.559860 Oct 05 02:56:54.831613 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2750/5523] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:56:54 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1735 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:56:55.731963 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-06a265e2-78b3-44e4-a195-9d7a59437dd3 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:55.733191 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-06a265e2-78b3-44e4-a195-9d7a59437dd3 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:55.744518 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06a265e2-78b3-44e4-a195-9d7a59437dd3 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:55.749910 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06a265e2-78b3-44e4-a195-9d7a59437dd3 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:55.755722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06a265e2-78b3-44e4-a195-9d7a59437dd3 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:55.757894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06a265e2-78b3-44e4-a195-9d7a59437dd3 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:55.758734 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06a265e2-78b3-44e4-a195-9d7a59437dd3 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:55.759354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06a265e2-78b3-44e4-a195-9d7a59437dd3 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:55.858330 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c09744da-b0f9-4782-8a47-067c31580735 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:55.859674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c09744da-b0f9-4782-8a47-067c31580735 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:55.877324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c09744da-b0f9-4782-8a47-067c31580735 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:55.878252 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c09744da-b0f9-4782-8a47-067c31580735 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:55.879833 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c09744da-b0f9-4782-8a47-067c31580735 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:55.884811 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c09744da-b0f9-4782-8a47-067c31580735 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:55.885610 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c09744da-b0f9-4782-8a47-067c31580735 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:55.886305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c09744da-b0f9-4782-8a47-067c31580735 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:55.930194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-06a265e2-78b3-44e4-a195-9d7a59437dd3 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:55.953360 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-06a265e2-78b3-44e4-a195-9d7a59437dd3 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:55.962459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-06a265e2-78b3-44e4-a195-9d7a59437dd3 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:55.964756 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-06a265e2-78b3-44e4-a195-9d7a59437dd3 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1605 microversion: 2.32 time: 0.236825 Oct 05 02:56:55.965665 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2774/5524] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:55 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1605 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:56.106299 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c09744da-b0f9-4782-8a47-067c31580735 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:56.118077 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c09744da-b0f9-4782-8a47-067c31580735 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1735 microversion: 2.1 time: 0.263645 Oct 05 02:56:56.118677 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2751/5525] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:56:55 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1735 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:56:56.996337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-98a3c08c-5317-4c7c-83d9-4095a30bdf46 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:56.997304 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-98a3c08c-5317-4c7c-83d9-4095a30bdf46 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:57.012860 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98a3c08c-5317-4c7c-83d9-4095a30bdf46 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:57.013401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98a3c08c-5317-4c7c-83d9-4095a30bdf46 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:57.014938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98a3c08c-5317-4c7c-83d9-4095a30bdf46 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:57.017356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98a3c08c-5317-4c7c-83d9-4095a30bdf46 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:57.018627 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98a3c08c-5317-4c7c-83d9-4095a30bdf46 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:57.019067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98a3c08c-5317-4c7c-83d9-4095a30bdf46 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:57.147607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-459f4d30-c219-4bc0-bae8-80ffcad256c8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:57.148782 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-459f4d30-c219-4bc0-bae8-80ffcad256c8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:57.166734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-459f4d30-c219-4bc0-bae8-80ffcad256c8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:57.167573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-459f4d30-c219-4bc0-bae8-80ffcad256c8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:57.169305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-459f4d30-c219-4bc0-bae8-80ffcad256c8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:57.170301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-459f4d30-c219-4bc0-bae8-80ffcad256c8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:57.170981 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-459f4d30-c219-4bc0-bae8-80ffcad256c8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:57.172034 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-459f4d30-c219-4bc0-bae8-80ffcad256c8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:57.224876 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-98a3c08c-5317-4c7c-83d9-4095a30bdf46 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:57.245913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-98a3c08c-5317-4c7c-83d9-4095a30bdf46 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:57.256009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-98a3c08c-5317-4c7c-83d9-4095a30bdf46 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:57.260085 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-98a3c08c-5317-4c7c-83d9-4095a30bdf46 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1605 microversion: 2.32 time: 0.268241 Oct 05 02:56:57.263721 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2775/5526] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:56 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1605 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:57.475209 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-459f4d30-c219-4bc0-bae8-80ffcad256c8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:57.487999 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-459f4d30-c219-4bc0-bae8-80ffcad256c8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1715 microversion: 2.1 time: 0.345235 Oct 05 02:56:57.492812 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2752/5527] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:56:57 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1715 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:56:57.758423 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-742ed05c-4323-4305-a527-c474ffbfeedc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:57.759297 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-742ed05c-4323-4305-a527-c474ffbfeedc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:57.795034 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-742ed05c-4323-4305-a527-c474ffbfeedc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:57.795549 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-742ed05c-4323-4305-a527-c474ffbfeedc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:57.796005 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-742ed05c-4323-4305-a527-c474ffbfeedc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:57.806799 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-742ed05c-4323-4305-a527-c474ffbfeedc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:57.807414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-742ed05c-4323-4305-a527-c474ffbfeedc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:57.807918 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-742ed05c-4323-4305-a527-c474ffbfeedc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:57.997409 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-742ed05c-4323-4305-a527-c474ffbfeedc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] HTTP exception thrown: Cannot 'detach_volume' instance 7c09b57e-7650-448b-ba76-402bdb4f9552 while it is in vm_state rescued Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-742ed05c-4323-4305-a527-c474ffbfeedc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Request method failure captured: Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552/os-volume_attachments/5fa49dc3-3ef8-4833-b902-ab5dbd0e7c81 HTTP/1.1 Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPGOLQowIsfBU6KJO-aq50qdRwmBWFeSun5TXHVGHXcRMd_nBRTUvLypi8_xX1_OhJhXqj8Tv9hcB2y77p-h0kTEsykqgEnSv0lMxHhtiAmMmCPjjlgvw91YvvX9SOOQS6JLONmL-pDrthh_0HqZ_QF0o7mi44oPhOdJTsJKEis6xoY Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 129b5343573f4f9fa648e984a68b6760 Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1554781900 Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/129b5343573f4f9fa648e984a68b6760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/129b5343573f4f9fa648e984a68b6760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/129b5343573f4f9fa648e984a68b6760"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_129b5343573f4f9fa648e984a68b6760"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1554781900 Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 129b5343573f4f9fa648e984a68b6760 Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1554781900 Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerRescueNegativeTestJSON-1554781900-project Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: a031e94db13d4e7e8947f51abc36d629 Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1554781900-project Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: exception: Cannot 'detach_volume' instance 7c09b57e-7650-448b-ba76-402bdb4f9552 while it is in vm_state rescued Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'server_id': '7c09b57e-7650-448b-ba76-402bdb4f9552', 'id': '5fa49dc3-3ef8-4833-b902-ab5dbd0e7c81'} Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7c09b57e-7650-448b-ba76-402bdb4f9552 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7c09b57e-7650-448b-ba76-402bdb4f9552 while it is in vm_state rescued Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:56:58.000141 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:56:58.005656 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:56:58.005656 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:56:58.005656 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:56:58.005656 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:56:58.005656 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7c09b57e-7650-448b-ba76-402bdb4f9552 while it is in vm_state rescued Oct 05 02:56:58.005656 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:56:58.008122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-742ed05c-4323-4305-a527-c474ffbfeedc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Returning 409 to user: Cannot 'detach_volume' instance 7c09b57e-7650-448b-ba76-402bdb4f9552 while it is in vm_state rescued {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:56:58.009339 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-742ed05c-4323-4305-a527-c474ffbfeedc tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552/os-volume_attachments/5fa49dc3-3ef8-4833-b902-ab5dbd0e7c81" status: 409 len: 152 microversion: 2.1 time: 0.255474 Oct 05 02:56:58.010477 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2776/5528] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 02:56:57 2022] DELETE /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552/os-volume_attachments/5fa49dc3-3ef8-4833-b902-ab5dbd0e7c81 => generated 152 bytes in 257 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:56:58.019568 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2268d9c8-19bc-4f55-92cd-a8c07f2234e8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:56:58.020138 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2268d9c8-19bc-4f55-92cd-a8c07f2234e8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:58.036384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2268d9c8-19bc-4f55-92cd-a8c07f2234e8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:58.036799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2268d9c8-19bc-4f55-92cd-a8c07f2234e8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:58.043156 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2268d9c8-19bc-4f55-92cd-a8c07f2234e8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:58.047595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2268d9c8-19bc-4f55-92cd-a8c07f2234e8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:58.052244 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2268d9c8-19bc-4f55-92cd-a8c07f2234e8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:58.052725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2268d9c8-19bc-4f55-92cd-a8c07f2234e8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:58.205961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:58.274772 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2268d9c8-19bc-4f55-92cd-a8c07f2234e8 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "POST /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552/action" status: 202 len: 0 microversion: 2.1 time: 0.259968 Oct 05 02:56:58.278678 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2753/5529] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:56:58 2022] POST /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:56:58.294571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ee6579f1-c5bf-4d43-9773-a114ccbebaa9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:58.303051 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ee6579f1-c5bf-4d43-9773-a114ccbebaa9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:58.315773 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fb44085c-2aae-4075-8b11-6d57ae37df99 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:58.327294 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fb44085c-2aae-4075-8b11-6d57ae37df99 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:58.335342 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee6579f1-c5bf-4d43-9773-a114ccbebaa9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:58.335861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee6579f1-c5bf-4d43-9773-a114ccbebaa9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:58.348063 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee6579f1-c5bf-4d43-9773-a114ccbebaa9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:58.348851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee6579f1-c5bf-4d43-9773-a114ccbebaa9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:58.349362 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee6579f1-c5bf-4d43-9773-a114ccbebaa9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:58.349803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee6579f1-c5bf-4d43-9773-a114ccbebaa9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:58.354136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb44085c-2aae-4075-8b11-6d57ae37df99 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:58.354860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb44085c-2aae-4075-8b11-6d57ae37df99 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:58.355497 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb44085c-2aae-4075-8b11-6d57ae37df99 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:58.356887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb44085c-2aae-4075-8b11-6d57ae37df99 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:58.360052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb44085c-2aae-4075-8b11-6d57ae37df99 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:58.361311 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb44085c-2aae-4075-8b11-6d57ae37df99 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:58.394600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:58.671090 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fb44085c-2aae-4075-8b11-6d57ae37df99 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:58.687608 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fb44085c-2aae-4075-8b11-6d57ae37df99 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:58.691938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fb44085c-2aae-4075-8b11-6d57ae37df99 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:58.694979 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fb44085c-2aae-4075-8b11-6d57ae37df99 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1605 microversion: 2.32 time: 0.396696 Oct 05 02:56:58.709637 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2754/5530] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:58 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1605 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:56:58.779002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ee6579f1-c5bf-4d43-9773-a114ccbebaa9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:58.789045 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ee6579f1-c5bf-4d43-9773-a114ccbebaa9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1723 microversion: 2.1 time: 0.506914 Oct 05 02:56:58.789624 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2777/5531] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:56:58 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1723 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:56:59.731806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7682ded1-6f31-47c2-8ea6-4d48dae0154b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:59.732516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7682ded1-6f31-47c2-8ea6-4d48dae0154b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:59.748422 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7682ded1-6f31-47c2-8ea6-4d48dae0154b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:59.750269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7682ded1-6f31-47c2-8ea6-4d48dae0154b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:59.750731 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7682ded1-6f31-47c2-8ea6-4d48dae0154b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:59.753898 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7682ded1-6f31-47c2-8ea6-4d48dae0154b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:59.754441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7682ded1-6f31-47c2-8ea6-4d48dae0154b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:59.755792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7682ded1-6f31-47c2-8ea6-4d48dae0154b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:59.818222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-91b706fc-0a94-4661-94d4-f47f16ab88e3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:56:59.819036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-91b706fc-0a94-4661-94d4-f47f16ab88e3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:56:59.839017 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91b706fc-0a94-4661-94d4-f47f16ab88e3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:59.839652 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91b706fc-0a94-4661-94d4-f47f16ab88e3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:59.840106 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91b706fc-0a94-4661-94d4-f47f16ab88e3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:59.840851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91b706fc-0a94-4661-94d4-f47f16ab88e3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:56:59.841333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91b706fc-0a94-4661-94d4-f47f16ab88e3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:56:59.841760 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91b706fc-0a94-4661-94d4-f47f16ab88e3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:56:59.948784 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7682ded1-6f31-47c2-8ea6-4d48dae0154b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:59.958943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7682ded1-6f31-47c2-8ea6-4d48dae0154b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:59.960383 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7682ded1-6f31-47c2-8ea6-4d48dae0154b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:56:59.970539 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7682ded1-6f31-47c2-8ea6-4d48dae0154b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1605 microversion: 2.32 time: 0.242973 Oct 05 02:56:59.985945 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2755/5532] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:56:59 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1605 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:57:00.249112 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-91b706fc-0a94-4661-94d4-f47f16ab88e3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:00.294165 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-91b706fc-0a94-4661-94d4-f47f16ab88e3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1723 microversion: 2.1 time: 0.480888 Oct 05 02:57:00.295310 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2778/5533] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:56:59 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1723 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:57:01.002890 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-43310817-ea4f-45a0-9e9f-62a2778d3c89 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:01.004085 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-43310817-ea4f-45a0-9e9f-62a2778d3c89 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:01.017647 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-43310817-ea4f-45a0-9e9f-62a2778d3c89 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:01.021591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-43310817-ea4f-45a0-9e9f-62a2778d3c89 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:01.024482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-43310817-ea4f-45a0-9e9f-62a2778d3c89 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:01.026228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-43310817-ea4f-45a0-9e9f-62a2778d3c89 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:01.027858 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-43310817-ea4f-45a0-9e9f-62a2778d3c89 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:01.028451 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-43310817-ea4f-45a0-9e9f-62a2778d3c89 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:01.308191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-43310817-ea4f-45a0-9e9f-62a2778d3c89 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:01.322117 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c7a18f4b-4c7a-418f-ab47-a4e97e77ad94 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:01.323278 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c7a18f4b-4c7a-418f-ab47-a4e97e77ad94 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:01.324100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-43310817-ea4f-45a0-9e9f-62a2778d3c89 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:01.326741 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-43310817-ea4f-45a0-9e9f-62a2778d3c89 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:01.331377 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-43310817-ea4f-45a0-9e9f-62a2778d3c89 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1605 microversion: 2.32 time: 0.333715 Oct 05 02:57:01.345090 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2756/5534] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:57:00 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1605 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:57:01.345336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c7a18f4b-4c7a-418f-ab47-a4e97e77ad94 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:01.345336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c7a18f4b-4c7a-418f-ab47-a4e97e77ad94 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:01.345336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c7a18f4b-4c7a-418f-ab47-a4e97e77ad94 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:01.345336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c7a18f4b-4c7a-418f-ab47-a4e97e77ad94 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:01.345336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c7a18f4b-4c7a-418f-ab47-a4e97e77ad94 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:01.346310 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c7a18f4b-4c7a-418f-ab47-a4e97e77ad94 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:01.801508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c7a18f4b-4c7a-418f-ab47-a4e97e77ad94 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:01.818352 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c7a18f4b-4c7a-418f-ab47-a4e97e77ad94 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1723 microversion: 2.1 time: 0.500194 Oct 05 02:57:01.832955 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2779/5535] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:57:01 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1723 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:57:02.380008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5e13b306-7c50-4ee8-8aa5-7712d1bf7d57 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:02.380637 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5e13b306-7c50-4ee8-8aa5-7712d1bf7d57 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:02.398835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e13b306-7c50-4ee8-8aa5-7712d1bf7d57 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:02.399352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e13b306-7c50-4ee8-8aa5-7712d1bf7d57 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:02.399791 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e13b306-7c50-4ee8-8aa5-7712d1bf7d57 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:02.400543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e13b306-7c50-4ee8-8aa5-7712d1bf7d57 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:02.402928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e13b306-7c50-4ee8-8aa5-7712d1bf7d57 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:02.403420 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e13b306-7c50-4ee8-8aa5-7712d1bf7d57 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:02.608100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5e13b306-7c50-4ee8-8aa5-7712d1bf7d57 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:02.628414 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5e13b306-7c50-4ee8-8aa5-7712d1bf7d57 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:02.635789 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5e13b306-7c50-4ee8-8aa5-7712d1bf7d57 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:02.642555 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5e13b306-7c50-4ee8-8aa5-7712d1bf7d57 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1605 microversion: 2.32 time: 0.281197 Oct 05 02:57:02.644695 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2757/5536] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:57:02 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1605 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:57:02.848083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8b29a895-fab1-41a5-b2bf-04c27cb8e858 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:02.848765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8b29a895-fab1-41a5-b2bf-04c27cb8e858 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:02.863432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b29a895-fab1-41a5-b2bf-04c27cb8e858 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:02.863938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b29a895-fab1-41a5-b2bf-04c27cb8e858 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:02.864380 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b29a895-fab1-41a5-b2bf-04c27cb8e858 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:02.865129 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b29a895-fab1-41a5-b2bf-04c27cb8e858 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:02.865766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b29a895-fab1-41a5-b2bf-04c27cb8e858 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:02.870049 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b29a895-fab1-41a5-b2bf-04c27cb8e858 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:03.178360 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-655f75b7-5cd6-4925-a67d-1e6297e1dbab tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:03.179131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-655f75b7-5cd6-4925-a67d-1e6297e1dbab tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: 3ad95026-ac80-442e-b377-45e769c67de7] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:03.190393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-655f75b7-5cd6-4925-a67d-1e6297e1dbab tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:03.194255 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-655f75b7-5cd6-4925-a67d-1e6297e1dbab tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:03.195026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-655f75b7-5cd6-4925-a67d-1e6297e1dbab tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:03.199107 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-655f75b7-5cd6-4925-a67d-1e6297e1dbab tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:03.199812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-655f75b7-5cd6-4925-a67d-1e6297e1dbab tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:03.200465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-655f75b7-5cd6-4925-a67d-1e6297e1dbab tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:03.231148 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8b29a895-fab1-41a5-b2bf-04c27cb8e858 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:03.240181 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8b29a895-fab1-41a5-b2bf-04c27cb8e858 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1729 microversion: 2.1 time: 0.396392 Oct 05 02:57:03.240776 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2780/5537] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:57:02 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1729 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:57:03.269128 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a6529626-5a00-4a06-82b7-7a44c717a15b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:03.269290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a6529626-5a00-4a06-82b7-7a44c717a15b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:03.278716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6529626-5a00-4a06-82b7-7a44c717a15b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:03.281403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6529626-5a00-4a06-82b7-7a44c717a15b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:03.285219 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6529626-5a00-4a06-82b7-7a44c717a15b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:03.286980 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6529626-5a00-4a06-82b7-7a44c717a15b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:03.290611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6529626-5a00-4a06-82b7-7a44c717a15b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:03.291082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6529626-5a00-4a06-82b7-7a44c717a15b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:03.405483 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-655f75b7-5cd6-4925-a67d-1e6297e1dbab tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lazy-loading 'services' on Instance uuid 3ad95026-ac80-442e-b377-45e769c67de7 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:57:03.430567 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a6529626-5a00-4a06-82b7-7a44c717a15b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.166444 Oct 05 02:57:03.439192 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2781/5538] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 02:57:03 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552/os-interface => generated 285 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:57:03.525816 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-655f75b7-5cd6-4925-a67d-1e6297e1dbab tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7/os-volume_attachments/c1ef3d23-77b3-4f75-bf6f-afdf7a034511" status: 202 len: 0 microversion: 2.1 time: 0.349489 Oct 05 02:57:03.528718 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2758/5539] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 02:57:03 2022] DELETE /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7/os-volume_attachments/c1ef3d23-77b3-4f75-bf6f-afdf7a034511 => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 02:57:03.675323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6567b632-e976-40bd-87f9-82ce234ae1c4 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:03.676393 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6567b632-e976-40bd-87f9-82ce234ae1c4 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:03.687521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6567b632-e976-40bd-87f9-82ce234ae1c4 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:03.690913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6567b632-e976-40bd-87f9-82ce234ae1c4 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:03.692615 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6567b632-e976-40bd-87f9-82ce234ae1c4 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:03.693869 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6567b632-e976-40bd-87f9-82ce234ae1c4 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:03.695949 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6567b632-e976-40bd-87f9-82ce234ae1c4 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:03.696617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6567b632-e976-40bd-87f9-82ce234ae1c4 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:03.856164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6567b632-e976-40bd-87f9-82ce234ae1c4 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:03.868812 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6567b632-e976-40bd-87f9-82ce234ae1c4 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:03.870303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6567b632-e976-40bd-87f9-82ce234ae1c4 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:03.871869 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6567b632-e976-40bd-87f9-82ce234ae1c4 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1605 microversion: 2.32 time: 0.202275 Oct 05 02:57:03.874985 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2782/5540] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:57:03 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1605 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:57:04.909614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-93594cf8-f364-40f1-83d2-6c798728bbcb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:04.910769 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-93594cf8-f364-40f1-83d2-6c798728bbcb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:04.924337 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93594cf8-f364-40f1-83d2-6c798728bbcb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:04.925409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93594cf8-f364-40f1-83d2-6c798728bbcb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:04.926462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93594cf8-f364-40f1-83d2-6c798728bbcb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:04.927756 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93594cf8-f364-40f1-83d2-6c798728bbcb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:04.928784 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93594cf8-f364-40f1-83d2-6c798728bbcb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:04.929656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-93594cf8-f364-40f1-83d2-6c798728bbcb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:05.092974 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-93594cf8-f364-40f1-83d2-6c798728bbcb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:05.104618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-93594cf8-f364-40f1-83d2-6c798728bbcb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:05.106226 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-93594cf8-f364-40f1-83d2-6c798728bbcb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:05.107462 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-93594cf8-f364-40f1-83d2-6c798728bbcb tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1605 microversion: 2.32 time: 0.207389 Oct 05 02:57:05.112334 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2759/5541] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:57:04 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1605 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:57:05.540120 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-d8e7ec48-204c-4d16-8ebb-f28a94d9097c req-78c5fae2-b66c-4d1d-a927-b2f6f5bace42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c09b57e-7650-448b-ba76-402bdb4f9552", "tag": "97e75ce5-35d6-42fc-9ea6-ed6afc7040fa"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:57:05.563026 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d8e7ec48-204c-4d16-8ebb-f28a94d9097c req-78c5fae2-b66c-4d1d-a927-b2f6f5bace42 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:05.563576 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d8e7ec48-204c-4d16-8ebb-f28a94d9097c req-78c5fae2-b66c-4d1d-a927-b2f6f5bace42 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:05.565215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d8e7ec48-204c-4d16-8ebb-f28a94d9097c req-78c5fae2-b66c-4d1d-a927-b2f6f5bace42 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:05.604653 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-d8e7ec48-204c-4d16-8ebb-f28a94d9097c req-78c5fae2-b66c-4d1d-a927-b2f6f5bace42 service nova] Creating event network-changed:97e75ce5-35d6-42fc-9ea6-ed6afc7040fa for instance 7c09b57e-7650-448b-ba76-402bdb4f9552 on n-h2-858272-3 Oct 05 02:57:05.614705 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-d8e7ec48-204c-4d16-8ebb-f28a94d9097c req-78c5fae2-b66c-4d1d-a927-b2f6f5bace42 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078568 Oct 05 02:57:05.616101 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2783/5542] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:57:06.136080 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ff1988f7-8dba-47a4-8143-eee968868d79 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:06.136714 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ff1988f7-8dba-47a4-8143-eee968868d79 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:06.148444 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff1988f7-8dba-47a4-8143-eee968868d79 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:06.148976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff1988f7-8dba-47a4-8143-eee968868d79 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:06.149424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff1988f7-8dba-47a4-8143-eee968868d79 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:06.150136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff1988f7-8dba-47a4-8143-eee968868d79 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:06.150599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff1988f7-8dba-47a4-8143-eee968868d79 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:06.151036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff1988f7-8dba-47a4-8143-eee968868d79 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:06.286815 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ff1988f7-8dba-47a4-8143-eee968868d79 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:06.297275 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ff1988f7-8dba-47a4-8143-eee968868d79 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:06.299963 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ff1988f7-8dba-47a4-8143-eee968868d79 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:06.313999 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ff1988f7-8dba-47a4-8143-eee968868d79 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1605 microversion: 2.32 time: 0.169075 Oct 05 02:57:06.315655 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2760/5543] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:57:06 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1605 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:57:07.346180 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d2e2a518-c452-47b2-a49a-aa4e8e44c0be tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:07.347476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d2e2a518-c452-47b2-a49a-aa4e8e44c0be tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:07.365322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2e2a518-c452-47b2-a49a-aa4e8e44c0be tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:07.365818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2e2a518-c452-47b2-a49a-aa4e8e44c0be tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:07.366268 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2e2a518-c452-47b2-a49a-aa4e8e44c0be tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:07.367943 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2e2a518-c452-47b2-a49a-aa4e8e44c0be tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:07.368592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2e2a518-c452-47b2-a49a-aa4e8e44c0be tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:07.370678 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2e2a518-c452-47b2-a49a-aa4e8e44c0be tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:07.473055 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d2e2a518-c452-47b2-a49a-aa4e8e44c0be tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:07.487516 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d2e2a518-c452-47b2-a49a-aa4e8e44c0be tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:07.491261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d2e2a518-c452-47b2-a49a-aa4e8e44c0be tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:07.494026 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d2e2a518-c452-47b2-a49a-aa4e8e44c0be tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1605 microversion: 2.32 time: 0.153523 Oct 05 02:57:07.505379 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2784/5544] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:57:07 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1605 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:57:07.635565 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-3199dc2b-1322-4739-804c-a764d3d25f81 req-4a32e2bc-5632-4aa4-99bb-1e131def627a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c09b57e-7650-448b-ba76-402bdb4f9552", "tag": "97e75ce5-35d6-42fc-9ea6-ed6afc7040fa"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:57:07.649102 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:07.651340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3199dc2b-1322-4739-804c-a764d3d25f81 req-4a32e2bc-5632-4aa4-99bb-1e131def627a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:07.652127 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3199dc2b-1322-4739-804c-a764d3d25f81 req-4a32e2bc-5632-4aa4-99bb-1e131def627a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:07.652714 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3199dc2b-1322-4739-804c-a764d3d25f81 req-4a32e2bc-5632-4aa4-99bb-1e131def627a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:07.675039 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-3199dc2b-1322-4739-804c-a764d3d25f81 req-4a32e2bc-5632-4aa4-99bb-1e131def627a service nova] Creating event network-changed:97e75ce5-35d6-42fc-9ea6-ed6afc7040fa for instance 7c09b57e-7650-448b-ba76-402bdb4f9552 on n-h2-858272-3 Oct 05 02:57:07.684080 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-3199dc2b-1322-4739-804c-a764d3d25f81 req-4a32e2bc-5632-4aa4-99bb-1e131def627a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050702 Oct 05 02:57:07.684942 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2761/5545] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:57:08.521326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e33026e9-3959-4711-a454-996d780069d2 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:08.522627 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e33026e9-3959-4711-a454-996d780069d2 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:08.526543 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=66 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:08.530436 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e33026e9-3959-4711-a454-996d780069d2 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:08.530936 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e33026e9-3959-4711-a454-996d780069d2 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:08.531371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e33026e9-3959-4711-a454-996d780069d2 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:08.532147 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e33026e9-3959-4711-a454-996d780069d2 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:08.532604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e33026e9-3959-4711-a454-996d780069d2 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:08.533077 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e33026e9-3959-4711-a454-996d780069d2 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:08.607565 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e33026e9-3959-4711-a454-996d780069d2 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:08.619974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e33026e9-3959-4711-a454-996d780069d2 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:08.621500 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e33026e9-3959-4711-a454-996d780069d2 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:08.622749 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e33026e9-3959-4711-a454-996d780069d2 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1605 microversion: 2.32 time: 0.105827 Oct 05 02:57:08.628455 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2785/5546] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:57:08 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1605 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:57:09.651173 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-78ef42e3-cf83-45d3-889d-64369b81b59b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:09.651877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-78ef42e3-cf83-45d3-889d-64369b81b59b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:09.660454 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78ef42e3-cf83-45d3-889d-64369b81b59b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:09.660975 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78ef42e3-cf83-45d3-889d-64369b81b59b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:09.661618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78ef42e3-cf83-45d3-889d-64369b81b59b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:09.662493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78ef42e3-cf83-45d3-889d-64369b81b59b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:09.663108 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78ef42e3-cf83-45d3-889d-64369b81b59b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:09.663688 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78ef42e3-cf83-45d3-889d-64369b81b59b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:09.739564 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-78ef42e3-cf83-45d3-889d-64369b81b59b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:09.753934 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-78ef42e3-cf83-45d3-889d-64369b81b59b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:09.756846 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-78ef42e3-cf83-45d3-889d-64369b81b59b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:09.758664 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-78ef42e3-cf83-45d3-889d-64369b81b59b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1605 microversion: 2.32 time: 0.112646 Oct 05 02:57:09.760191 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2762/5547] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:57:09 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1605 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:57:10.787629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-056a2ca9-28ab-4cdc-a729-e288c755c51d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:10.787629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-056a2ca9-28ab-4cdc-a729-e288c755c51d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:10.805903 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-056a2ca9-28ab-4cdc-a729-e288c755c51d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:10.806340 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-056a2ca9-28ab-4cdc-a729-e288c755c51d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:10.807899 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-056a2ca9-28ab-4cdc-a729-e288c755c51d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:10.809446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-056a2ca9-28ab-4cdc-a729-e288c755c51d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:10.810830 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-056a2ca9-28ab-4cdc-a729-e288c755c51d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:10.812634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-056a2ca9-28ab-4cdc-a729-e288c755c51d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:10.870945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-49deddca-3c2d-45c5-8d56-5b51725e9c9b tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:10.873442 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-49deddca-3c2d-45c5-8d56-5b51725e9c9b tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: 3ad95026-ac80-442e-b377-45e769c67de7] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:10.882336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49deddca-3c2d-45c5-8d56-5b51725e9c9b tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:10.883039 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49deddca-3c2d-45c5-8d56-5b51725e9c9b tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:10.883640 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49deddca-3c2d-45c5-8d56-5b51725e9c9b tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:10.884492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49deddca-3c2d-45c5-8d56-5b51725e9c9b tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:10.885144 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49deddca-3c2d-45c5-8d56-5b51725e9c9b tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:10.885745 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49deddca-3c2d-45c5-8d56-5b51725e9c9b tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:10.924979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-49deddca-3c2d-45c5-8d56-5b51725e9c9b tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: 3ad95026-ac80-442e-b377-45e769c67de7] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:57:10.959922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-056a2ca9-28ab-4cdc-a729-e288c755c51d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:10.969222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-056a2ca9-28ab-4cdc-a729-e288c755c51d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:10.971283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-056a2ca9-28ab-4cdc-a729-e288c755c51d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:10.972680 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-056a2ca9-28ab-4cdc-a729-e288c755c51d tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1605 microversion: 2.32 time: 0.190444 Oct 05 02:57:10.973734 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2786/5548] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:57:10 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1605 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:57:11.052011 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-49deddca-3c2d-45c5-8d56-5b51725e9c9b tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7" status: 204 len: 0 microversion: 2.1 time: 0.184469 Oct 05 02:57:11.053391 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2763/5549] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:57:10 2022] DELETE /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:57:11.063588 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c256b695-f1b5-4c77-a3f2-e7eea255c54a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:11.064629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c256b695-f1b5-4c77-a3f2-e7eea255c54a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: 3ad95026-ac80-442e-b377-45e769c67de7] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:11.075638 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c256b695-f1b5-4c77-a3f2-e7eea255c54a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:11.076815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c256b695-f1b5-4c77-a3f2-e7eea255c54a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:11.077546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c256b695-f1b5-4c77-a3f2-e7eea255c54a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:11.078699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c256b695-f1b5-4c77-a3f2-e7eea255c54a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:11.080040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c256b695-f1b5-4c77-a3f2-e7eea255c54a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:11.080978 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c256b695-f1b5-4c77-a3f2-e7eea255c54a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:11.445797 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c256b695-f1b5-4c77-a3f2-e7eea255c54a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de963cdc932941c7bac32406ee190634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6345a777ff224f558120171bee710f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:11.456425 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c256b695-f1b5-4c77-a3f2-e7eea255c54a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "GET /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7" status: 200 len: 1514 microversion: 2.1 time: 0.398596 Oct 05 02:57:11.470396 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2787/5550] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:57:11 2022] GET /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7 => generated 1514 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:57:12.001854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1c9cbd57-fd4a-4177-9a6b-8121ac0d6c54 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:12.003698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1c9cbd57-fd4a-4177-9a6b-8121ac0d6c54 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:12.012446 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c9cbd57-fd4a-4177-9a6b-8121ac0d6c54 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:12.013656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c9cbd57-fd4a-4177-9a6b-8121ac0d6c54 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:12.014305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c9cbd57-fd4a-4177-9a6b-8121ac0d6c54 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:12.015475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c9cbd57-fd4a-4177-9a6b-8121ac0d6c54 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:12.016222 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c9cbd57-fd4a-4177-9a6b-8121ac0d6c54 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:12.017516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c9cbd57-fd4a-4177-9a6b-8121ac0d6c54 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:12.502810 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-897e5a7b-7c5c-4cbb-9d10-fb5b364ed08a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:12.504261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-897e5a7b-7c5c-4cbb-9d10-fb5b364ed08a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: 3ad95026-ac80-442e-b377-45e769c67de7] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:12.525295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-897e5a7b-7c5c-4cbb-9d10-fb5b364ed08a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:12.529445 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-897e5a7b-7c5c-4cbb-9d10-fb5b364ed08a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:12.530083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-897e5a7b-7c5c-4cbb-9d10-fb5b364ed08a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:12.531296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-897e5a7b-7c5c-4cbb-9d10-fb5b364ed08a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:12.532843 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-897e5a7b-7c5c-4cbb-9d10-fb5b364ed08a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:12.533861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-897e5a7b-7c5c-4cbb-9d10-fb5b364ed08a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:12.601240 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1c9cbd57-fd4a-4177-9a6b-8121ac0d6c54 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:12.619217 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1c9cbd57-fd4a-4177-9a6b-8121ac0d6c54 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:12.622168 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1c9cbd57-fd4a-4177-9a6b-8121ac0d6c54 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:12.623408 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1c9cbd57-fd4a-4177-9a6b-8121ac0d6c54 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1605 microversion: 2.32 time: 0.627396 Oct 05 02:57:12.674674 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2764/5551] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:57:11 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1605 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:57:12.771819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-897e5a7b-7c5c-4cbb-9d10-fb5b364ed08a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de963cdc932941c7bac32406ee190634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6345a777ff224f558120171bee710f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:12.781196 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-897e5a7b-7c5c-4cbb-9d10-fb5b364ed08a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "GET /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7" status: 200 len: 1514 microversion: 2.1 time: 0.287110 Oct 05 02:57:12.796727 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2788/5552] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:57:12 2022] GET /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7 => generated 1514 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:57:13.674711 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-367f26b5-89bf-4e5f-a41b-d26beb8c35ec tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:13.678308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-45f0eb69-b73e-4d2a-8b8c-ec0d5a9b3b59 req-6e9d17cf-6ddf-4fe7-ba52-aed8b45494b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ad95026-ac80-442e-b377-45e769c67de7", "name": "network-vif-deleted", "tag": "10f8bb12-de52-45fa-a1be-80bd71bedbee"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:57:13.682978 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-367f26b5-89bf-4e5f-a41b-d26beb8c35ec tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:13.701174 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-45f0eb69-b73e-4d2a-8b8c-ec0d5a9b3b59 req-6e9d17cf-6ddf-4fe7-ba52-aed8b45494b4 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:13.701972 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-45f0eb69-b73e-4d2a-8b8c-ec0d5a9b3b59 req-6e9d17cf-6ddf-4fe7-ba52-aed8b45494b4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:13.702687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-45f0eb69-b73e-4d2a-8b8c-ec0d5a9b3b59 req-6e9d17cf-6ddf-4fe7-ba52-aed8b45494b4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:13.705277 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-367f26b5-89bf-4e5f-a41b-d26beb8c35ec tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:13.705538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-367f26b5-89bf-4e5f-a41b-d26beb8c35ec tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:13.705985 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-367f26b5-89bf-4e5f-a41b-d26beb8c35ec tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:13.706698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-367f26b5-89bf-4e5f-a41b-d26beb8c35ec tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:13.707244 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-367f26b5-89bf-4e5f-a41b-d26beb8c35ec tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:13.707571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-367f26b5-89bf-4e5f-a41b-d26beb8c35ec tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:13.729139 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-45f0eb69-b73e-4d2a-8b8c-ec0d5a9b3b59 req-6e9d17cf-6ddf-4fe7-ba52-aed8b45494b4 service nova] Creating event network-vif-deleted:10f8bb12-de52-45fa-a1be-80bd71bedbee for instance 3ad95026-ac80-442e-b377-45e769c67de7 on n-h1-858272-3 Oct 05 02:57:13.750408 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-45f0eb69-b73e-4d2a-8b8c-ec0d5a9b3b59 req-6e9d17cf-6ddf-4fe7-ba52-aed8b45494b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078720 Oct 05 02:57:13.756307 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2789/5553] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:57:13.807210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-468532a9-d33b-4ac2-8795-ae9eede70216 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:13.809373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-468532a9-d33b-4ac2-8795-ae9eede70216 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: 3ad95026-ac80-442e-b377-45e769c67de7] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:13.828931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-468532a9-d33b-4ac2-8795-ae9eede70216 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:13.831837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-468532a9-d33b-4ac2-8795-ae9eede70216 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:13.832618 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-468532a9-d33b-4ac2-8795-ae9eede70216 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:13.835649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-468532a9-d33b-4ac2-8795-ae9eede70216 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:13.836242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-468532a9-d33b-4ac2-8795-ae9eede70216 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:13.836996 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-468532a9-d33b-4ac2-8795-ae9eede70216 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:13.849164 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-367f26b5-89bf-4e5f-a41b-d26beb8c35ec tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:13.867518 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-367f26b5-89bf-4e5f-a41b-d26beb8c35ec tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:13.872513 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-367f26b5-89bf-4e5f-a41b-d26beb8c35ec tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:13.876788 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-367f26b5-89bf-4e5f-a41b-d26beb8c35ec tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1605 microversion: 2.32 time: 0.208121 Oct 05 02:57:13.878073 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2765/5554] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:57:13 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1605 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:57:13.955784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-468532a9-d33b-4ac2-8795-ae9eede70216 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:13.958803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-468532a9-d33b-4ac2-8795-ae9eede70216 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:13.977277 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-468532a9-d33b-4ac2-8795-ae9eede70216 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:13.978041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-468532a9-d33b-4ac2-8795-ae9eede70216 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lazy-loading 'fault' on Instance uuid 3ad95026-ac80-442e-b377-45e769c67de7 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:57:14.041487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-468532a9-d33b-4ac2-8795-ae9eede70216 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de963cdc932941c7bac32406ee190634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6345a777ff224f558120171bee710f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:14.075092 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-468532a9-d33b-4ac2-8795-ae9eede70216 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "GET /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7" status: 200 len: 1309 microversion: 2.1 time: 0.270463 Oct 05 02:57:14.077403 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2790/5555] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:57:13 2022] GET /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7 => generated 1309 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:57:14.910474 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cbfe6a36-2bd5-44c1-b3db-91ee57b5a52b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:14.911294 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cbfe6a36-2bd5-44c1-b3db-91ee57b5a52b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:14.926131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbfe6a36-2bd5-44c1-b3db-91ee57b5a52b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:14.927414 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbfe6a36-2bd5-44c1-b3db-91ee57b5a52b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:14.929855 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbfe6a36-2bd5-44c1-b3db-91ee57b5a52b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:14.935126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbfe6a36-2bd5-44c1-b3db-91ee57b5a52b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:14.937078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbfe6a36-2bd5-44c1-b3db-91ee57b5a52b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:14.938004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbfe6a36-2bd5-44c1-b3db-91ee57b5a52b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:15.061691 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cbfe6a36-2bd5-44c1-b3db-91ee57b5a52b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:15.077008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cbfe6a36-2bd5-44c1-b3db-91ee57b5a52b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:15.085865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cbfe6a36-2bd5-44c1-b3db-91ee57b5a52b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:15.088075 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cbfe6a36-2bd5-44c1-b3db-91ee57b5a52b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1605 microversion: 2.32 time: 0.182431 Oct 05 02:57:15.105518 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2766/5556] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:57:14 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1605 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:57:15.109510 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d97d9f14-09ac-419c-b5ee-7d8905580cf4 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:15.111661 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d97d9f14-09ac-419c-b5ee-7d8905580cf4 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: 3ad95026-ac80-442e-b377-45e769c67de7] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:15.126222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d97d9f14-09ac-419c-b5ee-7d8905580cf4 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:15.130452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d97d9f14-09ac-419c-b5ee-7d8905580cf4 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:15.131903 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d97d9f14-09ac-419c-b5ee-7d8905580cf4 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:15.135340 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d97d9f14-09ac-419c-b5ee-7d8905580cf4 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:15.135939 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d97d9f14-09ac-419c-b5ee-7d8905580cf4 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:15.136443 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d97d9f14-09ac-419c-b5ee-7d8905580cf4 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:15.170006 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-d97d9f14-09ac-419c-b5ee-7d8905580cf4 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] HTTP exception thrown: Instance 3ad95026-ac80-442e-b377-45e769c67de7 could not be found. Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d97d9f14-09ac-419c-b5ee-7d8905580cf4 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Request method failure captured: Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7 HTTP/1.1 Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPH3yp5it_aX5p8uGQ0JheGFWY3hVGXHcWfqsWMUKy3tqdp7QmPWFGXX0miN3R7G8apJNPXF_eJTABKQo0gmEMT4-sOtI59-L-mDckEPnMweYpg1PI8Uasc_GtW26YYubE5MMT7Nmirv_vjJ8B7UlQk0QPjrsyHR-vVtHqDsbN3M8Wg Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 6345a777ff224f558120171bee710f6a Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-VolumesSnapshotTestJSON-541121951 Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6345a777ff224f558120171bee710f6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6345a777ff224f558120171bee710f6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6345a777ff224f558120171bee710f6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6345a777ff224f558120171bee710f6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-VolumesSnapshotTestJSON-541121951 Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 6345a777ff224f558120171bee710f6a Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-541121951 Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-VolumesSnapshotTestJSON-541121951-project Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: de963cdc932941c7bac32406ee190634 Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-VolumesSnapshotTestJSON-541121951-project Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 3ad95026-ac80-442e-b377-45e769c67de7 could not be found. Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '3ad95026-ac80-442e-b377-45e769c67de7'} Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ad95026-ac80-442e-b377-45e769c67de7 could not be found. Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ad95026-ac80-442e-b377-45e769c67de7 could not be found. Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:57:15.174653 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:57:15.179358 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:57:15.179358 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:57:15.179358 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:57:15.179358 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:57:15.179358 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:57:15.179358 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ad95026-ac80-442e-b377-45e769c67de7 could not be found. Oct 05 02:57:15.179358 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:57:15.179976 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d97d9f14-09ac-419c-b5ee-7d8905580cf4 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Returning 404 to user: Instance 3ad95026-ac80-442e-b377-45e769c67de7 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:57:15.182199 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d97d9f14-09ac-419c-b5ee-7d8905580cf4 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "GET /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7" status: 404 len: 111 microversion: 2.1 time: 0.085705 Oct 05 02:57:15.184486 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2791/5557] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:57:15 2022] GET /compute/v2.1/servers/3ad95026-ac80-442e-b377-45e769c67de7 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:57:16.117457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-89e6e526-1eb3-46fc-9524-168318a3a1d1 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:16.118022 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-89e6e526-1eb3-46fc-9524-168318a3a1d1 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:16.132537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89e6e526-1eb3-46fc-9524-168318a3a1d1 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:16.133167 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89e6e526-1eb3-46fc-9524-168318a3a1d1 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:16.133783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89e6e526-1eb3-46fc-9524-168318a3a1d1 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:16.134668 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89e6e526-1eb3-46fc-9524-168318a3a1d1 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:16.135809 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89e6e526-1eb3-46fc-9524-168318a3a1d1 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:16.138715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89e6e526-1eb3-46fc-9524-168318a3a1d1 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:16.222728 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89e6e526-1eb3-46fc-9524-168318a3a1d1 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:16.223752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89e6e526-1eb3-46fc-9524-168318a3a1d1 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:16.225681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89e6e526-1eb3-46fc-9524-168318a3a1d1 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:16.228106 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-89e6e526-1eb3-46fc-9524-168318a3a1d1 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lazy-loading 'fault' on Instance uuid 2ef11e58-0680-4e15-aa40-a4043a5a357a {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:57:16.335793 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-89e6e526-1eb3-46fc-9524-168318a3a1d1 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:16.351873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-89e6e526-1eb3-46fc-9524-168318a3a1d1 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:16.353742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-89e6e526-1eb3-46fc-9524-168318a3a1d1 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef5ed582f9d74e2f9bd5ea39f41a5017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7f497ef84645d3bead6c2e54a7603d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:16.356793 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-89e6e526-1eb3-46fc-9524-168318a3a1d1 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 200 len: 1610 microversion: 2.32 time: 0.243436 Oct 05 02:57:16.373089 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2767/5558] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:57:16 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 1610 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:57:17.395295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3ddf0f2d-bea9-4b8a-9ab4-18af8c6411b3 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:17.395954 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3ddf0f2d-bea9-4b8a-9ab4-18af8c6411b3 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:17.424478 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3ddf0f2d-bea9-4b8a-9ab4-18af8c6411b3 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:17.433959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3ddf0f2d-bea9-4b8a-9ab4-18af8c6411b3 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:17.434832 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3ddf0f2d-bea9-4b8a-9ab4-18af8c6411b3 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:17.435590 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3ddf0f2d-bea9-4b8a-9ab4-18af8c6411b3 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:17.436061 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3ddf0f2d-bea9-4b8a-9ab4-18af8c6411b3 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:17.436492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3ddf0f2d-bea9-4b8a-9ab4-18af8c6411b3 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:17.469821 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-3ddf0f2d-bea9-4b8a-9ab4-18af8c6411b3 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] HTTP exception thrown: Instance 2ef11e58-0680-4e15-aa40-a4043a5a357a could not be found. Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3ddf0f2d-bea9-4b8a-9ab4-18af8c6411b3 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Request method failure captured: Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a HTTP/1.1 Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPDzTOmtar6nycuux5cHVV-PsHI5U7AnPtK33_hLWD95ZeRHst_xScLIRxnXlNZg4WA1ItMuuQaeZKEoo23Acb31QWaZTrLMyZkAzj6JZVCC4eacT5WQ3NcUDgrNH0OUBpgzDvApB9DzuuvUQXN_GEP2Sw-7-EfiKrSeczXcB89hDT8 Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: X-Openstack-Nova-Api-Version: 2.32 Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: df7f497ef84645d3bead6c2e54a7603d Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TaggedBootDevicesTest-1755767021 Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/df7f497ef84645d3bead6c2e54a7603d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/df7f497ef84645d3bead6c2e54a7603d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/df7f497ef84645d3bead6c2e54a7603d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_df7f497ef84645d3bead6c2e54a7603d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TaggedBootDevicesTest-1755767021 Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: df7f497ef84645d3bead6c2e54a7603d Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1755767021 Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TaggedBootDevicesTest-1755767021-project Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: ef5ed582f9d74e2f9bd5ea39f41a5017 Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TaggedBootDevicesTest-1755767021-project Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 2ef11e58-0680-4e15-aa40-a4043a5a357a could not be found. Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '2ef11e58-0680-4e15-aa40-a4043a5a357a'} Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ef11e58-0680-4e15-aa40-a4043a5a357a could not be found. Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ef11e58-0680-4e15-aa40-a4043a5a357a could not be found. Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:57:17.471889 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:57:17.475874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:57:17.475874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:57:17.475874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:57:17.475874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:57:17.475874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:57:17.475874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:57:17.475874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ef11e58-0680-4e15-aa40-a4043a5a357a could not be found. Oct 05 02:57:17.475874 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:57:17.482505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3ddf0f2d-bea9-4b8a-9ab4-18af8c6411b3 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Returning 404 to user: Instance 2ef11e58-0680-4e15-aa40-a4043a5a357a could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:57:17.486304 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3ddf0f2d-bea9-4b8a-9ab4-18af8c6411b3 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 404 len: 111 microversion: 2.32 time: 0.101447 Oct 05 02:57:17.486899 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2792/5559] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:57:17 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:57:17.500064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c67cd57d-72f9-44f6-993a-facd6718d037 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '.version_select at 0x7fcce8263e50>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:17.542394 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c67cd57d-72f9-44f6-993a-facd6718d037 tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2052496779" status: 204 len: 0 microversion: 2.32 time: 0.050692 Oct 05 02:57:17.543397 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2768/5560] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Oct 5 02:57:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2052496779 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 02:57:25.022651 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-64e52277-9554-40b4-bdd1-607ddfec178c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:25.023249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-64e52277-9554-40b4-bdd1-607ddfec178c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:25.030842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64e52277-9554-40b4-bdd1-607ddfec178c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:25.032263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64e52277-9554-40b4-bdd1-607ddfec178c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:25.032837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64e52277-9554-40b4-bdd1-607ddfec178c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:25.033579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64e52277-9554-40b4-bdd1-607ddfec178c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:25.034211 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64e52277-9554-40b4-bdd1-607ddfec178c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:25.034647 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64e52277-9554-40b4-bdd1-607ddfec178c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:25.050643 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-64e52277-9554-40b4-bdd1-607ddfec178c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] HTTP exception thrown: Instance 2ef11e58-0680-4e15-aa40-a4043a5a357a could not be found. Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-64e52277-9554-40b4-bdd1-607ddfec178c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Request method failure captured: Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a HTTP/1.1 Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPDzTOmtar6nycuux5cHVV-PsHI5U7AnPtK33_hLWD95ZeRHst_xScLIRxnXlNZg4WA1ItMuuQaeZKEoo23Acb31QWaZTrLMyZkAzj6JZVCC4eacT5WQ3NcUDgrNH0OUBpgzDvApB9DzuuvUQXN_GEP2Sw-7-EfiKrSeczXcB89hDT8 Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: X-Openstack-Nova-Api-Version: 2.32 Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: df7f497ef84645d3bead6c2e54a7603d Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TaggedBootDevicesTest-1755767021 Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/df7f497ef84645d3bead6c2e54a7603d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/df7f497ef84645d3bead6c2e54a7603d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/df7f497ef84645d3bead6c2e54a7603d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_df7f497ef84645d3bead6c2e54a7603d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TaggedBootDevicesTest-1755767021 Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: df7f497ef84645d3bead6c2e54a7603d Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1755767021 Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TaggedBootDevicesTest-1755767021-project Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: ef5ed582f9d74e2f9bd5ea39f41a5017 Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TaggedBootDevicesTest-1755767021-project Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 2ef11e58-0680-4e15-aa40-a4043a5a357a could not be found. Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '2ef11e58-0680-4e15-aa40-a4043a5a357a'} Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ef11e58-0680-4e15-aa40-a4043a5a357a could not be found. Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:57:25.052288 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:57:25.056346 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ef11e58-0680-4e15-aa40-a4043a5a357a could not be found. Oct 05 02:57:25.056346 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:57:25.056346 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:57:25.056346 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:57:25.056346 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:57:25.056346 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:57:25.056346 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:57:25.056346 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:57:25.056346 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:57:25.056346 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ef11e58-0680-4e15-aa40-a4043a5a357a could not be found. Oct 05 02:57:25.056346 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:57:25.057901 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-64e52277-9554-40b4-bdd1-607ddfec178c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Returning 404 to user: Instance 2ef11e58-0680-4e15-aa40-a4043a5a357a could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:57:25.058929 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-64e52277-9554-40b4-bdd1-607ddfec178c tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 404 len: 111 microversion: 2.32 time: 0.040369 Oct 05 02:57:25.063306 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2793/5561] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 5 02:57:25 2022] DELETE /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 02:57:25.070159 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a9df0c04-f838-443e-9fce-39255265c16b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:25.071390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a9df0c04-f838-443e-9fce-39255265c16b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] [instance: 2ef11e58-0680-4e15-aa40-a4043a5a357a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:25.080937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9df0c04-f838-443e-9fce-39255265c16b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:25.081507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9df0c04-f838-443e-9fce-39255265c16b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:25.082088 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9df0c04-f838-443e-9fce-39255265c16b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:25.082794 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9df0c04-f838-443e-9fce-39255265c16b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:25.083250 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9df0c04-f838-443e-9fce-39255265c16b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:25.083665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9df0c04-f838-443e-9fce-39255265c16b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:25.100822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:25.102483 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-a9df0c04-f838-443e-9fce-39255265c16b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] HTTP exception thrown: Instance 2ef11e58-0680-4e15-aa40-a4043a5a357a could not be found. Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a9df0c04-f838-443e-9fce-39255265c16b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Request method failure captured: Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a HTTP/1.1 Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPDzTOmtar6nycuux5cHVV-PsHI5U7AnPtK33_hLWD95ZeRHst_xScLIRxnXlNZg4WA1ItMuuQaeZKEoo23Acb31QWaZTrLMyZkAzj6JZVCC4eacT5WQ3NcUDgrNH0OUBpgzDvApB9DzuuvUQXN_GEP2Sw-7-EfiKrSeczXcB89hDT8 Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: X-Openstack-Nova-Api-Version: 2.32 Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: df7f497ef84645d3bead6c2e54a7603d Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-TaggedBootDevicesTest-1755767021 Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/df7f497ef84645d3bead6c2e54a7603d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/df7f497ef84645d3bead6c2e54a7603d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/df7f497ef84645d3bead6c2e54a7603d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_df7f497ef84645d3bead6c2e54a7603d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-TaggedBootDevicesTest-1755767021 Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: df7f497ef84645d3bead6c2e54a7603d Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1755767021 Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-TaggedBootDevicesTest-1755767021-project Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: ef5ed582f9d74e2f9bd5ea39f41a5017 Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-TaggedBootDevicesTest-1755767021-project Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 2ef11e58-0680-4e15-aa40-a4043a5a357a could not be found. Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '2ef11e58-0680-4e15-aa40-a4043a5a357a'} Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ef11e58-0680-4e15-aa40-a4043a5a357a could not be found. Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ef11e58-0680-4e15-aa40-a4043a5a357a could not be found. Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:57:25.104196 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:57:25.108144 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:57:25.108144 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:57:25.108144 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:57:25.108144 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:57:25.108144 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:57:25.108144 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:57:25.108144 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ef11e58-0680-4e15-aa40-a4043a5a357a could not be found. Oct 05 02:57:25.108144 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:57:25.108144 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a9df0c04-f838-443e-9fce-39255265c16b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] Returning 404 to user: Instance 2ef11e58-0680-4e15-aa40-a4043a5a357a could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:57:25.108144 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a9df0c04-f838-443e-9fce-39255265c16b tempest-TaggedBootDevicesTest-1755767021 tempest-TaggedBootDevicesTest-1755767021-project] 10.222.0.16 "GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a" status: 404 len: 111 microversion: 2.32 time: 0.040203 Oct 05 02:57:25.108144 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2769/5562] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:57:25 2022] GET /compute/v2.1/servers/2ef11e58-0680-4e15-aa40-a4043a5a357a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 05 02:57:25.217012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-87cd16e3-b555-47cc-881b-319af7d18be9 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-148648593", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "5d65842c-94e4-451b-b58e-57d4c677e30d"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:57:25.343154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-87cd16e3-b555-47cc-881b-319af7d18be9 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] validate_networks() for [('5d65842c-94e4-451b-b58e-57d4c677e30d', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:57:26.110266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-87cd16e3-b555-47cc-881b-319af7d18be9 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:57:26.111344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-87cd16e3-b555-47cc-881b-319af7d18be9 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:57:26.112146 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-87cd16e3-b555-47cc-881b-319af7d18be9 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:57:26.113286 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-87cd16e3-b555-47cc-881b-319af7d18be9 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:57:26.113887 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-87cd16e3-b555-47cc-881b-319af7d18be9 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:57:26.135593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87cd16e3-b555-47cc-881b-319af7d18be9 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:26.136082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87cd16e3-b555-47cc-881b-319af7d18be9 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:26.136516 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87cd16e3-b555-47cc-881b-319af7d18be9 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:26.137266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87cd16e3-b555-47cc-881b-319af7d18be9 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:26.137719 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87cd16e3-b555-47cc-881b-319af7d18be9 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:26.138146 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87cd16e3-b555-47cc-881b-319af7d18be9 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:26.183214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-87cd16e3-b555-47cc-881b-319af7d18be9 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Getting quotas for project 6345a777ff224f558120171bee710f6a. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:57:26.196373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-87cd16e3-b555-47cc-881b-319af7d18be9 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Getting quotas for user de963cdc932941c7bac32406ee190634 and project 6345a777ff224f558120171bee710f6a. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:57:26.226051 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-87cd16e3-b555-47cc-881b-319af7d18be9 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:57:26.228745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-87cd16e3-b555-47cc-881b-319af7d18be9 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: be028745-08ea-4ddd-853f-a893d54eedc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:57:26.338492 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-87cd16e3-b555-47cc-881b-319af7d18be9 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.125260 Oct 05 02:57:26.339190 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2794/5563] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:57:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:57:26.354115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6e2935ff-c261-4437-9354-fc13ebc2631e tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:26.355663 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6e2935ff-c261-4437-9354-fc13ebc2631e tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: be028745-08ea-4ddd-853f-a893d54eedc1] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:26.522088 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6e2935ff-c261-4437-9354-fc13ebc2631e tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de963cdc932941c7bac32406ee190634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6345a777ff224f558120171bee710f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:26.543656 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6e2935ff-c261-4437-9354-fc13ebc2631e tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1" status: 200 len: 1218 microversion: 2.1 time: 0.195498 Oct 05 02:57:26.548535 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2770/5564] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:57:26 2022] GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1 => generated 1218 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:57:27.573665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-212306eb-c317-4e9d-8ff3-1735b43cd1f7 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:27.574972 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-212306eb-c317-4e9d-8ff3-1735b43cd1f7 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: be028745-08ea-4ddd-853f-a893d54eedc1] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:27.584425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-212306eb-c317-4e9d-8ff3-1735b43cd1f7 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:27.585369 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-212306eb-c317-4e9d-8ff3-1735b43cd1f7 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:27.586039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-212306eb-c317-4e9d-8ff3-1735b43cd1f7 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:27.590535 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-212306eb-c317-4e9d-8ff3-1735b43cd1f7 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:27.591241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-212306eb-c317-4e9d-8ff3-1735b43cd1f7 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:27.591903 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-212306eb-c317-4e9d-8ff3-1735b43cd1f7 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:27.722252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-212306eb-c317-4e9d-8ff3-1735b43cd1f7 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de963cdc932941c7bac32406ee190634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6345a777ff224f558120171bee710f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:27.735135 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-212306eb-c317-4e9d-8ff3-1735b43cd1f7 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1" status: 200 len: 1270 microversion: 2.1 time: 0.166047 Oct 05 02:57:27.743248 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2795/5565] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:57:27 2022] GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1 => generated 1270 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:57:28.769790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-320608fb-48b6-4797-8930-283460d7b450 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:28.770457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-320608fb-48b6-4797-8930-283460d7b450 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: be028745-08ea-4ddd-853f-a893d54eedc1] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:28.785914 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-320608fb-48b6-4797-8930-283460d7b450 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:28.788887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-320608fb-48b6-4797-8930-283460d7b450 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:28.789528 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-320608fb-48b6-4797-8930-283460d7b450 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:28.790417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-320608fb-48b6-4797-8930-283460d7b450 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:28.791026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-320608fb-48b6-4797-8930-283460d7b450 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:28.792987 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-320608fb-48b6-4797-8930-283460d7b450 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:28.926708 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-320608fb-48b6-4797-8930-283460d7b450 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de963cdc932941c7bac32406ee190634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6345a777ff224f558120171bee710f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:28.938468 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-320608fb-48b6-4797-8930-283460d7b450 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1" status: 200 len: 1276 microversion: 2.1 time: 0.170474 Oct 05 02:57:28.939825 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2771/5566] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:57:28 2022] GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1 => generated 1276 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:57:29.969492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9b3246ae-ea4f-41bd-8a77-46e362528ad3 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:29.971232 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9b3246ae-ea4f-41bd-8a77-46e362528ad3 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: be028745-08ea-4ddd-853f-a893d54eedc1] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:29.993144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b3246ae-ea4f-41bd-8a77-46e362528ad3 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:29.999037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b3246ae-ea4f-41bd-8a77-46e362528ad3 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:30.004303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b3246ae-ea4f-41bd-8a77-46e362528ad3 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:30.005443 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b3246ae-ea4f-41bd-8a77-46e362528ad3 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:30.012877 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b3246ae-ea4f-41bd-8a77-46e362528ad3 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:30.013746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b3246ae-ea4f-41bd-8a77-46e362528ad3 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:30.019425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=87 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:30.519930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9b3246ae-ea4f-41bd-8a77-46e362528ad3 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de963cdc932941c7bac32406ee190634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6345a777ff224f558120171bee710f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:30.532451 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9b3246ae-ea4f-41bd-8a77-46e362528ad3 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1" status: 200 len: 1318 microversion: 2.1 time: 0.569052 Oct 05 02:57:30.534580 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2796/5567] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:57:29 2022] GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1 => generated 1318 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:57:31.225447 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-9ab887dd-b557-4c41-9ffb-93252a344a39 req-50fab00f-2d6f-4653-926c-08d29c271e60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be028745-08ea-4ddd-853f-a893d54eedc1", "tag": "9bc3a128-0ee4-4202-a229-c52dff78eff5"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:57:31.251261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-9ab887dd-b557-4c41-9ffb-93252a344a39 req-50fab00f-2d6f-4653-926c-08d29c271e60 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:31.252038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-9ab887dd-b557-4c41-9ffb-93252a344a39 req-50fab00f-2d6f-4653-926c-08d29c271e60 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:31.252672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-9ab887dd-b557-4c41-9ffb-93252a344a39 req-50fab00f-2d6f-4653-926c-08d29c271e60 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:31.277735 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-9ab887dd-b557-4c41-9ffb-93252a344a39 req-50fab00f-2d6f-4653-926c-08d29c271e60 service nova] Creating event network-changed:9bc3a128-0ee4-4202-a229-c52dff78eff5 for instance be028745-08ea-4ddd-853f-a893d54eedc1 on n-h1-858272-3 Oct 05 02:57:31.288485 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-9ab887dd-b557-4c41-9ffb-93252a344a39 req-50fab00f-2d6f-4653-926c-08d29c271e60 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066575 Oct 05 02:57:31.289148 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2772/5568] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:57:31.561167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-202f2847-25fc-4997-b711-4b295d39f3f7 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:31.561906 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-202f2847-25fc-4997-b711-4b295d39f3f7 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: be028745-08ea-4ddd-853f-a893d54eedc1] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:31.572472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-202f2847-25fc-4997-b711-4b295d39f3f7 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:31.573198 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-202f2847-25fc-4997-b711-4b295d39f3f7 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:31.573720 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-202f2847-25fc-4997-b711-4b295d39f3f7 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:31.574633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-202f2847-25fc-4997-b711-4b295d39f3f7 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:31.575456 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-202f2847-25fc-4997-b711-4b295d39f3f7 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:31.576102 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-202f2847-25fc-4997-b711-4b295d39f3f7 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:31.866087 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-202f2847-25fc-4997-b711-4b295d39f3f7 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de963cdc932941c7bac32406ee190634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6345a777ff224f558120171bee710f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:31.879919 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-202f2847-25fc-4997-b711-4b295d39f3f7 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1" status: 200 len: 1318 microversion: 2.1 time: 0.324355 Oct 05 02:57:31.880777 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2797/5569] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:57:31 2022] GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1 => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:57:32.907840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bee2ee6d-bc79-43f8-86cd-35da97bf0b09 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:32.914567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bee2ee6d-bc79-43f8-86cd-35da97bf0b09 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: be028745-08ea-4ddd-853f-a893d54eedc1] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:32.947075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bee2ee6d-bc79-43f8-86cd-35da97bf0b09 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:32.947588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bee2ee6d-bc79-43f8-86cd-35da97bf0b09 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:32.948029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bee2ee6d-bc79-43f8-86cd-35da97bf0b09 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:32.948749 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bee2ee6d-bc79-43f8-86cd-35da97bf0b09 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:32.949227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bee2ee6d-bc79-43f8-86cd-35da97bf0b09 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:32.953151 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bee2ee6d-bc79-43f8-86cd-35da97bf0b09 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:33.237231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bee2ee6d-bc79-43f8-86cd-35da97bf0b09 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de963cdc932941c7bac32406ee190634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6345a777ff224f558120171bee710f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:33.245827 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bee2ee6d-bc79-43f8-86cd-35da97bf0b09 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1" status: 200 len: 1318 microversion: 2.1 time: 0.345186 Oct 05 02:57:33.246344 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2773/5570] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:57:32 2022] GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1 => generated 1318 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:57:34.271613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a947258a-8c64-47a1-b102-0ca8f4416846 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:34.272244 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a947258a-8c64-47a1-b102-0ca8f4416846 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: be028745-08ea-4ddd-853f-a893d54eedc1] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:34.299259 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a947258a-8c64-47a1-b102-0ca8f4416846 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:34.306999 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a947258a-8c64-47a1-b102-0ca8f4416846 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:34.317670 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a947258a-8c64-47a1-b102-0ca8f4416846 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:34.321383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a947258a-8c64-47a1-b102-0ca8f4416846 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:34.322145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a947258a-8c64-47a1-b102-0ca8f4416846 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:34.322837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a947258a-8c64-47a1-b102-0ca8f4416846 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:35.540795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a947258a-8c64-47a1-b102-0ca8f4416846 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de963cdc932941c7bac32406ee190634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6345a777ff224f558120171bee710f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:35.552798 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a947258a-8c64-47a1-b102-0ca8f4416846 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1" status: 200 len: 1318 microversion: 2.1 time: 1.286324 Oct 05 02:57:35.561170 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2798/5571] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:57:34 2022] GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1 => generated 1318 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:57:36.597156 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-53271612-01b5-4453-9b58-d252877c1170 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:36.598271 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-53271612-01b5-4453-9b58-d252877c1170 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: be028745-08ea-4ddd-853f-a893d54eedc1] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:36.627578 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:36.631507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-53271612-01b5-4453-9b58-d252877c1170 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:36.632598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-53271612-01b5-4453-9b58-d252877c1170 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:36.634000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-53271612-01b5-4453-9b58-d252877c1170 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:36.648525 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-53271612-01b5-4453-9b58-d252877c1170 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:36.653708 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-53271612-01b5-4453-9b58-d252877c1170 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:36.661727 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-53271612-01b5-4453-9b58-d252877c1170 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:37.463050 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-53271612-01b5-4453-9b58-d252877c1170 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de963cdc932941c7bac32406ee190634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6345a777ff224f558120171bee710f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:37.484080 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-53271612-01b5-4453-9b58-d252877c1170 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1" status: 200 len: 1318 microversion: 2.1 time: 0.896554 Oct 05 02:57:37.487833 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2774/5572] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:57:36 2022] GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1 => generated 1318 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:57:38.439678 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-fb9781a2-ac5b-4ac6-ba77-5d59df261c2b req-97be840a-90c8-4d55-b13a-20faa4dee583 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be028745-08ea-4ddd-853f-a893d54eedc1", "name": "network-vif-plugged", "status": "completed", "tag": "9bc3a128-0ee4-4202-a229-c52dff78eff5"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:57:38.454400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:38.455139 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:38.464697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-fb9781a2-ac5b-4ac6-ba77-5d59df261c2b req-97be840a-90c8-4d55-b13a-20faa4dee583 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:38.465779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-fb9781a2-ac5b-4ac6-ba77-5d59df261c2b req-97be840a-90c8-4d55-b13a-20faa4dee583 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:38.468441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-fb9781a2-ac5b-4ac6-ba77-5d59df261c2b req-97be840a-90c8-4d55-b13a-20faa4dee583 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:38.496604 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-fb9781a2-ac5b-4ac6-ba77-5d59df261c2b req-97be840a-90c8-4d55-b13a-20faa4dee583 service nova] Creating event network-vif-plugged:9bc3a128-0ee4-4202-a229-c52dff78eff5 for instance be028745-08ea-4ddd-853f-a893d54eedc1 on n-h1-858272-3 Oct 05 02:57:38.518421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f126b905-8676-400e-87bf-f7943eca5136 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:38.521239 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f126b905-8676-400e-87bf-f7943eca5136 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: be028745-08ea-4ddd-853f-a893d54eedc1] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:38.522598 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-fb9781a2-ac5b-4ac6-ba77-5d59df261c2b req-97be840a-90c8-4d55-b13a-20faa4dee583 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087360 Oct 05 02:57:38.523672 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2799/5573] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:57:38.535084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f126b905-8676-400e-87bf-f7943eca5136 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:38.538855 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f126b905-8676-400e-87bf-f7943eca5136 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:38.539491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f126b905-8676-400e-87bf-f7943eca5136 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:38.540426 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f126b905-8676-400e-87bf-f7943eca5136 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:38.542364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f126b905-8676-400e-87bf-f7943eca5136 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:38.548146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f126b905-8676-400e-87bf-f7943eca5136 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:38.976578 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f126b905-8676-400e-87bf-f7943eca5136 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de963cdc932941c7bac32406ee190634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6345a777ff224f558120171bee710f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:38.989967 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f126b905-8676-400e-87bf-f7943eca5136 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1" status: 200 len: 1318 microversion: 2.1 time: 0.476229 Oct 05 02:57:39.006371 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2775/5574] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:57:38 2022] GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1 => generated 1318 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:57:40.019078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-540a57ab-23ac-468b-9efe-84f8abe93f5b tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:40.020154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-540a57ab-23ac-468b-9efe-84f8abe93f5b tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: be028745-08ea-4ddd-853f-a893d54eedc1] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:40.034998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:40.039011 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-540a57ab-23ac-468b-9efe-84f8abe93f5b tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:40.040976 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-540a57ab-23ac-468b-9efe-84f8abe93f5b tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:40.044932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-540a57ab-23ac-468b-9efe-84f8abe93f5b tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:40.045998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-540a57ab-23ac-468b-9efe-84f8abe93f5b tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:40.046812 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-540a57ab-23ac-468b-9efe-84f8abe93f5b tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:40.047756 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-540a57ab-23ac-468b-9efe-84f8abe93f5b tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:40.412069 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-540a57ab-23ac-468b-9efe-84f8abe93f5b tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de963cdc932941c7bac32406ee190634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6345a777ff224f558120171bee710f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:40.439940 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-540a57ab-23ac-468b-9efe-84f8abe93f5b tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1" status: 200 len: 1318 microversion: 2.1 time: 0.424977 Oct 05 02:57:40.461578 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2800/5575] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:57:40 2022] GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1 => generated 1318 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:57:41.476334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8717ea77-0e7f-4daa-ae35-d0f7250a1070 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:41.477587 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8717ea77-0e7f-4daa-ae35-d0f7250a1070 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: be028745-08ea-4ddd-853f-a893d54eedc1] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:41.500162 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:41.502302 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8717ea77-0e7f-4daa-ae35-d0f7250a1070 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:41.505239 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8717ea77-0e7f-4daa-ae35-d0f7250a1070 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:41.505239 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8717ea77-0e7f-4daa-ae35-d0f7250a1070 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:41.505239 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8717ea77-0e7f-4daa-ae35-d0f7250a1070 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:41.505239 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8717ea77-0e7f-4daa-ae35-d0f7250a1070 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:41.505239 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8717ea77-0e7f-4daa-ae35-d0f7250a1070 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:42.004064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8717ea77-0e7f-4daa-ae35-d0f7250a1070 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de963cdc932941c7bac32406ee190634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6345a777ff224f558120171bee710f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:42.012780 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8717ea77-0e7f-4daa-ae35-d0f7250a1070 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1" status: 200 len: 1507 microversion: 2.1 time: 0.540306 Oct 05 02:57:42.025830 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2776/5576] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:57:41 2022] GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1 => generated 1507 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:57:42.045414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b1904fe6-72f4-48f8-9cb4-cc07724dc41d tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc27b47e-d1b4-4e93-9e95-59df84b3fa34", "device": "/dev/sdb"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:57:42.049563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b1904fe6-72f4-48f8-9cb4-cc07724dc41d tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: be028745-08ea-4ddd-853f-a893d54eedc1] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:42.069394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b1904fe6-72f4-48f8-9cb4-cc07724dc41d tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:42.078796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b1904fe6-72f4-48f8-9cb4-cc07724dc41d tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:42.080084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b1904fe6-72f4-48f8-9cb4-cc07724dc41d tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:42.082319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b1904fe6-72f4-48f8-9cb4-cc07724dc41d tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:42.087394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b1904fe6-72f4-48f8-9cb4-cc07724dc41d tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:42.090297 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b1904fe6-72f4-48f8-9cb4-cc07724dc41d tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:42.633090 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b1904fe6-72f4-48f8-9cb4-cc07724dc41d tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "POST /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.593559 Oct 05 02:57:42.681953 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2801/5577] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 02:57:42 2022] POST /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1/os-volume_attachments => generated 194 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:57:45.813213 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a6d4933a-7c0d-420a-ab8b-652d44c844de tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1214295633", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "4c105559-4f55-4f9d-bddc-2309be57561d"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:57:45.899797 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-a6d4933a-7c0d-420a-ab8b-652d44c844de tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] validate_networks() for [('4c105559-4f55-4f9d-bddc-2309be57561d', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:57:46.847986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-a6d4933a-7c0d-420a-ab8b-652d44c844de tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:57:46.848553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-a6d4933a-7c0d-420a-ab8b-652d44c844de tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:57:46.849184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-a6d4933a-7c0d-420a-ab8b-652d44c844de tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:57:46.850231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-a6d4933a-7c0d-420a-ab8b-652d44c844de tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:57:46.851486 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-a6d4933a-7c0d-420a-ab8b-652d44c844de tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:57:46.873092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6d4933a-7c0d-420a-ab8b-652d44c844de tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:46.876750 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6d4933a-7c0d-420a-ab8b-652d44c844de tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:46.877331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6d4933a-7c0d-420a-ab8b-652d44c844de tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:46.879393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6d4933a-7c0d-420a-ab8b-652d44c844de tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:46.881950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6d4933a-7c0d-420a-ab8b-652d44c844de tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:46.883124 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6d4933a-7c0d-420a-ab8b-652d44c844de tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:46.940084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-a6d4933a-7c0d-420a-ab8b-652d44c844de tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Getting quotas for project 259ca05c46454743a9819915d50370a7. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:57:46.961459 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-a6d4933a-7c0d-420a-ab8b-652d44c844de tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Getting quotas for user 7cb038e111434aa581b9ebc7a578b196 and project 259ca05c46454743a9819915d50370a7. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:57:47.010660 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a6d4933a-7c0d-420a-ab8b-652d44c844de tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:57:47.013394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a6d4933a-7c0d-420a-ab8b-652d44c844de tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 2cd80810-a36b-4bd6-929b-4a9aaa896365] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:57:47.109466 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a6d4933a-7c0d-420a-ab8b-652d44c844de tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.308092 Oct 05 02:57:47.110944 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2777/5578] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:57:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1310 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:57:47.125468 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-635e1d0a-4cfa-4c1e-b412-054e2f414940 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:47.127794 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-635e1d0a-4cfa-4c1e-b412-054e2f414940 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 2cd80810-a36b-4bd6-929b-4a9aaa896365] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:47.324707 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-635e1d0a-4cfa-4c1e-b412-054e2f414940 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb038e111434aa581b9ebc7a578b196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259ca05c46454743a9819915d50370a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:47.334714 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-635e1d0a-4cfa-4c1e-b412-054e2f414940 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365" status: 200 len: 1214 microversion: 2.1 time: 0.216274 Oct 05 02:57:47.349938 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2802/5579] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:57:47 2022] GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365 => generated 1214 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:57:48.362480 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a90f181e-66d7-40b2-aac8-dc68f1826c77 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:48.363237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a90f181e-66d7-40b2-aac8-dc68f1826c77 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 2cd80810-a36b-4bd6-929b-4a9aaa896365] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:48.379269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a90f181e-66d7-40b2-aac8-dc68f1826c77 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:48.382896 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a90f181e-66d7-40b2-aac8-dc68f1826c77 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:48.383870 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a90f181e-66d7-40b2-aac8-dc68f1826c77 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:48.386799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a90f181e-66d7-40b2-aac8-dc68f1826c77 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:48.387364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a90f181e-66d7-40b2-aac8-dc68f1826c77 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:48.389338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a90f181e-66d7-40b2-aac8-dc68f1826c77 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:48.766690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a90f181e-66d7-40b2-aac8-dc68f1826c77 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb038e111434aa581b9ebc7a578b196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259ca05c46454743a9819915d50370a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:48.778224 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a90f181e-66d7-40b2-aac8-dc68f1826c77 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365" status: 200 len: 1266 microversion: 2.1 time: 0.421968 Oct 05 02:57:48.790800 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2778/5580] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:57:48 2022] GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365 => generated 1266 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:57:49.815498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-18c4de1a-a993-479a-b0d4-7d63d3c5e6ec tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:49.816952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-18c4de1a-a993-479a-b0d4-7d63d3c5e6ec tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 2cd80810-a36b-4bd6-929b-4a9aaa896365] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:49.833245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-18c4de1a-a993-479a-b0d4-7d63d3c5e6ec tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:49.834111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-18c4de1a-a993-479a-b0d4-7d63d3c5e6ec tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:49.835466 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-18c4de1a-a993-479a-b0d4-7d63d3c5e6ec tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:49.837949 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-18c4de1a-a993-479a-b0d4-7d63d3c5e6ec tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:49.839642 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-18c4de1a-a993-479a-b0d4-7d63d3c5e6ec tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:49.840413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-18c4de1a-a993-479a-b0d4-7d63d3c5e6ec tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:49.933249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-18c4de1a-a993-479a-b0d4-7d63d3c5e6ec tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb038e111434aa581b9ebc7a578b196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259ca05c46454743a9819915d50370a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:49.941092 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-18c4de1a-a993-479a-b0d4-7d63d3c5e6ec tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365" status: 200 len: 1272 microversion: 2.1 time: 0.129947 Oct 05 02:57:49.942227 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2803/5581] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:57:49 2022] GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365 => generated 1272 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:57:50.971456 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-24d4ee04-89bf-42fe-9af8-ddaf1eec1d12 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:50.977440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-24d4ee04-89bf-42fe-9af8-ddaf1eec1d12 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 2cd80810-a36b-4bd6-929b-4a9aaa896365] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:50.986898 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24d4ee04-89bf-42fe-9af8-ddaf1eec1d12 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:50.987901 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24d4ee04-89bf-42fe-9af8-ddaf1eec1d12 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:50.993490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24d4ee04-89bf-42fe-9af8-ddaf1eec1d12 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:50.994359 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24d4ee04-89bf-42fe-9af8-ddaf1eec1d12 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:50.994896 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24d4ee04-89bf-42fe-9af8-ddaf1eec1d12 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:50.995464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24d4ee04-89bf-42fe-9af8-ddaf1eec1d12 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:51.257921 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-24d4ee04-89bf-42fe-9af8-ddaf1eec1d12 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb038e111434aa581b9ebc7a578b196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259ca05c46454743a9819915d50370a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:51.270085 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-24d4ee04-89bf-42fe-9af8-ddaf1eec1d12 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365" status: 200 len: 1314 microversion: 2.1 time: 0.305851 Oct 05 02:57:51.272592 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2779/5582] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:57:50 2022] GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:57:52.299233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-87253018-754b-4686-9f22-ef2b1aff0e2e tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:52.299726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-87253018-754b-4686-9f22-ef2b1aff0e2e tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 2cd80810-a36b-4bd6-929b-4a9aaa896365] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:52.313301 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87253018-754b-4686-9f22-ef2b1aff0e2e tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:52.316687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87253018-754b-4686-9f22-ef2b1aff0e2e tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:52.317337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87253018-754b-4686-9f22-ef2b1aff0e2e tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:52.321860 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87253018-754b-4686-9f22-ef2b1aff0e2e tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:52.322342 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87253018-754b-4686-9f22-ef2b1aff0e2e tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:52.322771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87253018-754b-4686-9f22-ef2b1aff0e2e tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:52.682601 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-87253018-754b-4686-9f22-ef2b1aff0e2e tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb038e111434aa581b9ebc7a578b196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259ca05c46454743a9819915d50370a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:52.697680 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-87253018-754b-4686-9f22-ef2b1aff0e2e tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365" status: 200 len: 1314 microversion: 2.1 time: 0.404201 Oct 05 02:57:52.709277 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2804/5583] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:57:52 2022] GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365 => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:57:52.728864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-69f58fd8-ce3e-43f7-a954-ffccea3cbab6 req-12d27224-e560-4e38-9b8b-d202ac89bd56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cd80810-a36b-4bd6-929b-4a9aaa896365", "tag": "9152227f-f099-487a-a923-290e5b526d56"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:57:52.741297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-69f58fd8-ce3e-43f7-a954-ffccea3cbab6 req-12d27224-e560-4e38-9b8b-d202ac89bd56 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:52.742057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-69f58fd8-ce3e-43f7-a954-ffccea3cbab6 req-12d27224-e560-4e38-9b8b-d202ac89bd56 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:52.743074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-69f58fd8-ce3e-43f7-a954-ffccea3cbab6 req-12d27224-e560-4e38-9b8b-d202ac89bd56 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:52.758359 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-69f58fd8-ce3e-43f7-a954-ffccea3cbab6 req-12d27224-e560-4e38-9b8b-d202ac89bd56 service nova] Creating event network-changed:9152227f-f099-487a-a923-290e5b526d56 for instance 2cd80810-a36b-4bd6-929b-4a9aaa896365 on n-h2-858272-3 Oct 05 02:57:52.764534 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-69f58fd8-ce3e-43f7-a954-ffccea3cbab6 req-12d27224-e560-4e38-9b8b-d202ac89bd56 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039809 Oct 05 02:57:52.766341 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2780/5584] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:57:52.939873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e4e1edff-a486-4e56-a791-2afdf64e1c77 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:52.940607 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e4e1edff-a486-4e56-a791-2afdf64e1c77 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:52.947750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4e1edff-a486-4e56-a791-2afdf64e1c77 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:52.948760 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4e1edff-a486-4e56-a791-2afdf64e1c77 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:52.949586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4e1edff-a486-4e56-a791-2afdf64e1c77 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:52.950791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4e1edff-a486-4e56-a791-2afdf64e1c77 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:52.951521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4e1edff-a486-4e56-a791-2afdf64e1c77 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:52.952111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4e1edff-a486-4e56-a791-2afdf64e1c77 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:53.073315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-e4e1edff-a486-4e56-a791-2afdf64e1c77 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lazy-loading 'services' on Instance uuid 7c09b57e-7650-448b-ba76-402bdb4f9552 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:57:53.234214 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e4e1edff-a486-4e56-a791-2afdf64e1c77 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552/os-volume_attachments/5fa49dc3-3ef8-4833-b902-ab5dbd0e7c81" status: 202 len: 0 microversion: 2.1 time: 0.298968 Oct 05 02:57:53.236559 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2805/5585] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 02:57:52 2022] DELETE /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552/os-volume_attachments/5fa49dc3-3ef8-4833-b902-ab5dbd0e7c81 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:57:53.256156 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-63a0c458-f499-4053-a8bc-e637efff4fe3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:53.263010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-63a0c458-f499-4053-a8bc-e637efff4fe3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:53.286209 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63a0c458-f499-4053-a8bc-e637efff4fe3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:53.288060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63a0c458-f499-4053-a8bc-e637efff4fe3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:53.288512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63a0c458-f499-4053-a8bc-e637efff4fe3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:53.291078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63a0c458-f499-4053-a8bc-e637efff4fe3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:53.293503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63a0c458-f499-4053-a8bc-e637efff4fe3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:53.294254 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63a0c458-f499-4053-a8bc-e637efff4fe3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:53.384230 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-63a0c458-f499-4053-a8bc-e637efff4fe3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142877 Oct 05 02:57:53.386437 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2781/5586] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 02:57:53 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:57:53.754351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5fb9765a-5dab-4773-9106-95ce7d5a80f5 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:53.755986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5fb9765a-5dab-4773-9106-95ce7d5a80f5 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 2cd80810-a36b-4bd6-929b-4a9aaa896365] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:53.764723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5fb9765a-5dab-4773-9106-95ce7d5a80f5 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:53.765700 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5fb9765a-5dab-4773-9106-95ce7d5a80f5 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:53.766453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5fb9765a-5dab-4773-9106-95ce7d5a80f5 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:53.767494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5fb9765a-5dab-4773-9106-95ce7d5a80f5 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:53.768711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5fb9765a-5dab-4773-9106-95ce7d5a80f5 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:53.774686 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5fb9765a-5dab-4773-9106-95ce7d5a80f5 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:54.143403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5fb9765a-5dab-4773-9106-95ce7d5a80f5 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb038e111434aa581b9ebc7a578b196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259ca05c46454743a9819915d50370a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:54.153836 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5fb9765a-5dab-4773-9106-95ce7d5a80f5 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365" status: 200 len: 1314 microversion: 2.1 time: 0.404896 Oct 05 02:57:54.154874 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2806/5587] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:57:53 2022] GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365 => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:57:54.398991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-baad95dc-b29a-46f8-850b-402e2ab87930 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:54.401885 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-baad95dc-b29a-46f8-850b-402e2ab87930 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:54.411416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-baad95dc-b29a-46f8-850b-402e2ab87930 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:54.412367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-baad95dc-b29a-46f8-850b-402e2ab87930 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:54.413161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-baad95dc-b29a-46f8-850b-402e2ab87930 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:54.413910 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-baad95dc-b29a-46f8-850b-402e2ab87930 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:54.414372 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-baad95dc-b29a-46f8-850b-402e2ab87930 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:54.414794 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-baad95dc-b29a-46f8-850b-402e2ab87930 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:54.452596 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-baad95dc-b29a-46f8-850b-402e2ab87930 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058056 Oct 05 02:57:54.460756 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2782/5588] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 02:57:54 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:57:55.099819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2bef7bb1-339f-41e9-9cb8-c935c5815c28 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:55.101168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2bef7bb1-339f-41e9-9cb8-c935c5815c28 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] [instance: a1c78871-374e-41d9-af4a-d8284ccb8508] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:55.114036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2bef7bb1-339f-41e9-9cb8-c935c5815c28 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:55.119096 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2bef7bb1-339f-41e9-9cb8-c935c5815c28 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:55.120107 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2bef7bb1-339f-41e9-9cb8-c935c5815c28 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:55.123571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2bef7bb1-339f-41e9-9cb8-c935c5815c28 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:55.124830 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2bef7bb1-339f-41e9-9cb8-c935c5815c28 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:55.127507 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2bef7bb1-339f-41e9-9cb8-c935c5815c28 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:55.180599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e0c36887-7e50-40a8-9ad5-adae59ece524 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:55.181512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e0c36887-7e50-40a8-9ad5-adae59ece524 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 2cd80810-a36b-4bd6-929b-4a9aaa896365] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:55.190501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2bef7bb1-339f-41e9-9cb8-c935c5815c28 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] [instance: a1c78871-374e-41d9-af4a-d8284ccb8508] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:57:55.192585 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0c36887-7e50-40a8-9ad5-adae59ece524 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:55.195743 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0c36887-7e50-40a8-9ad5-adae59ece524 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:55.196430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0c36887-7e50-40a8-9ad5-adae59ece524 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:55.197384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0c36887-7e50-40a8-9ad5-adae59ece524 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:55.199769 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0c36887-7e50-40a8-9ad5-adae59ece524 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:55.200415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0c36887-7e50-40a8-9ad5-adae59ece524 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:55.364713 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2bef7bb1-339f-41e9-9cb8-c935c5815c28 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508" status: 204 len: 0 microversion: 2.1 time: 0.589406 Oct 05 02:57:55.366565 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2807/5589] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:57:54 2022] DELETE /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:57:55.376969 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f79f00c0-3540-4631-8477-e55f4ed6e9e0 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:55.377941 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f79f00c0-3540-4631-8477-e55f4ed6e9e0 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] [instance: a1c78871-374e-41d9-af4a-d8284ccb8508] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:55.388269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f79f00c0-3540-4631-8477-e55f4ed6e9e0 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:55.389793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f79f00c0-3540-4631-8477-e55f4ed6e9e0 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:55.390303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f79f00c0-3540-4631-8477-e55f4ed6e9e0 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:55.391061 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f79f00c0-3540-4631-8477-e55f4ed6e9e0 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:55.393560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f79f00c0-3540-4631-8477-e55f4ed6e9e0 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:55.394618 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f79f00c0-3540-4631-8477-e55f4ed6e9e0 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:55.697415 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f79f00c0-3540-4631-8477-e55f4ed6e9e0 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23b56d519224b22802f978442c7289f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa67de433dc46a595baea99d927d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:55.715849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e0c36887-7e50-40a8-9ad5-adae59ece524 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb038e111434aa581b9ebc7a578b196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259ca05c46454743a9819915d50370a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:55.727404 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f79f00c0-3540-4631-8477-e55f4ed6e9e0 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] 10.222.0.16 "GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508" status: 200 len: 1733 microversion: 2.1 time: 0.339291 Oct 05 02:57:55.739430 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2808/5590] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:57:55 2022] GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508 => generated 1733 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:57:55.746010 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8a5b6c59-aade-4838-896f-5e2cbe23446c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:55.746548 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e0c36887-7e50-40a8-9ad5-adae59ece524 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365" status: 200 len: 1314 microversion: 2.1 time: 0.570229 Oct 05 02:57:55.748080 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2783/5591] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:57:55 2022] GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365 => generated 1314 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:57:55.749145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8a5b6c59-aade-4838-896f-5e2cbe23446c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:55.756431 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a5b6c59-aade-4838-896f-5e2cbe23446c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:55.757176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a5b6c59-aade-4838-896f-5e2cbe23446c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:55.757818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a5b6c59-aade-4838-896f-5e2cbe23446c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:55.758677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a5b6c59-aade-4838-896f-5e2cbe23446c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:55.759535 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a5b6c59-aade-4838-896f-5e2cbe23446c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:55.760290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a5b6c59-aade-4838-896f-5e2cbe23446c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:55.810455 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8a5b6c59-aade-4838-896f-5e2cbe23446c tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068896 Oct 05 02:57:55.811600 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2809/5592] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 02:57:55 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:57:56.757544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-449719cc-e3b2-4170-991f-c305c392aa2b tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:56.758363 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-449719cc-e3b2-4170-991f-c305c392aa2b tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] [instance: a1c78871-374e-41d9-af4a-d8284ccb8508] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:56.768965 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-449719cc-e3b2-4170-991f-c305c392aa2b tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:56.769780 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-449719cc-e3b2-4170-991f-c305c392aa2b tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:56.770555 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-449719cc-e3b2-4170-991f-c305c392aa2b tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:56.772933 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-449719cc-e3b2-4170-991f-c305c392aa2b tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:56.773638 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-449719cc-e3b2-4170-991f-c305c392aa2b tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:56.774218 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-449719cc-e3b2-4170-991f-c305c392aa2b tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:56.774654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-44375fbc-2544-44b0-995e-9086e7ed46e0 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:56.775865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-44375fbc-2544-44b0-995e-9086e7ed46e0 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 2cd80810-a36b-4bd6-929b-4a9aaa896365] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:56.782162 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=67 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:56.783657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44375fbc-2544-44b0-995e-9086e7ed46e0 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:56.785288 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44375fbc-2544-44b0-995e-9086e7ed46e0 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:56.786943 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44375fbc-2544-44b0-995e-9086e7ed46e0 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:56.787716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44375fbc-2544-44b0-995e-9086e7ed46e0 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:56.788178 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44375fbc-2544-44b0-995e-9086e7ed46e0 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:56.792452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44375fbc-2544-44b0-995e-9086e7ed46e0 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:56.908386 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:56.987878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:57.331642 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:57.494151 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-449719cc-e3b2-4170-991f-c305c392aa2b tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23b56d519224b22802f978442c7289f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa67de433dc46a595baea99d927d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:57.511216 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-449719cc-e3b2-4170-991f-c305c392aa2b tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] 10.222.0.16 "GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508" status: 200 len: 1733 microversion: 2.1 time: 0.759382 Oct 05 02:57:57.512425 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2784/5593] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:57:56 2022] GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508 => generated 1733 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:57:57.521282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c4ba0764-0800-4815-bd41-3ab73462c1a3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:57.523878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c4ba0764-0800-4815-bd41-3ab73462c1a3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:57.538168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-44375fbc-2544-44b0-995e-9086e7ed46e0 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb038e111434aa581b9ebc7a578b196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259ca05c46454743a9819915d50370a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:57.540990 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:57.542529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4ba0764-0800-4815-bd41-3ab73462c1a3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:57.543342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4ba0764-0800-4815-bd41-3ab73462c1a3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:57.546420 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4ba0764-0800-4815-bd41-3ab73462c1a3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:57.548184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4ba0764-0800-4815-bd41-3ab73462c1a3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:57.551145 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4ba0764-0800-4815-bd41-3ab73462c1a3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:57.553625 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4ba0764-0800-4815-bd41-3ab73462c1a3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:57.553757 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-44375fbc-2544-44b0-995e-9086e7ed46e0 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365" status: 200 len: 1314 microversion: 2.1 time: 0.780869 Oct 05 02:57:57.572484 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2810/5594] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:57:56 2022] GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365 => generated 1314 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:57:57.661011 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c4ba0764-0800-4815-bd41-3ab73462c1a3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146872 Oct 05 02:57:57.661906 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2785/5595] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 02:57:57 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:57:58.538427 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8cf657b6-a52b-4233-9b0f-19910fa07f50 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:58.539899 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8cf657b6-a52b-4233-9b0f-19910fa07f50 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] [instance: a1c78871-374e-41d9-af4a-d8284ccb8508] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:58.559441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cf657b6-a52b-4233-9b0f-19910fa07f50 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:58.562435 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cf657b6-a52b-4233-9b0f-19910fa07f50 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:58.563322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cf657b6-a52b-4233-9b0f-19910fa07f50 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:58.565503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cf657b6-a52b-4233-9b0f-19910fa07f50 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:58.568552 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cf657b6-a52b-4233-9b0f-19910fa07f50 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:58.569279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8cf657b6-a52b-4233-9b0f-19910fa07f50 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:58.581888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-662e5ea3-ef9a-4460-852b-512525603264 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:58.582513 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-662e5ea3-ef9a-4460-852b-512525603264 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 2cd80810-a36b-4bd6-929b-4a9aaa896365] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:58.594773 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-662e5ea3-ef9a-4460-852b-512525603264 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:58.600723 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-662e5ea3-ef9a-4460-852b-512525603264 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:58.601424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-662e5ea3-ef9a-4460-852b-512525603264 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:58.602472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-662e5ea3-ef9a-4460-852b-512525603264 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:58.602982 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-662e5ea3-ef9a-4460-852b-512525603264 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:58.603420 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-662e5ea3-ef9a-4460-852b-512525603264 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:59.881613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8cf657b6-a52b-4233-9b0f-19910fa07f50 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23b56d519224b22802f978442c7289f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa67de433dc46a595baea99d927d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:59.899327 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8cf657b6-a52b-4233-9b0f-19910fa07f50 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] 10.222.0.16 "GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508" status: 200 len: 1733 microversion: 2.1 time: 1.366621 Oct 05 02:57:59.901561 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2811/5596] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:57:58 2022] GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508 => generated 1733 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:57:59.939183 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0a3af9f2-751c-4ced-b3f4-1bfe86bb392b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:57:59.943277 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0a3af9f2-751c-4ced-b3f4-1bfe86bb392b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:57:59.970750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a3af9f2-751c-4ced-b3f4-1bfe86bb392b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:59.972727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a3af9f2-751c-4ced-b3f4-1bfe86bb392b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:59.974414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a3af9f2-751c-4ced-b3f4-1bfe86bb392b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:59.976348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a3af9f2-751c-4ced-b3f4-1bfe86bb392b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:57:59.977166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a3af9f2-751c-4ced-b3f4-1bfe86bb392b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:57:59.977969 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a3af9f2-751c-4ced-b3f4-1bfe86bb392b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:57:59.979075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-662e5ea3-ef9a-4460-852b-512525603264 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb038e111434aa581b9ebc7a578b196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259ca05c46454743a9819915d50370a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:57:59.992329 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-662e5ea3-ef9a-4460-852b-512525603264 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365" status: 200 len: 1314 microversion: 2.1 time: 1.416387 Oct 05 02:57:59.995689 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2786/5597] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:57:58 2022] GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365 => generated 1314 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:58:00.096757 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0a3af9f2-751c-4ced-b3f4-1bfe86bb392b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170318 Oct 05 02:58:00.098391 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2812/5598] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 02:57:59 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:58:00.934975 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1d7f5784-069a-4b55-b947-e284b32b61f4 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:00.935532 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1d7f5784-069a-4b55-b947-e284b32b61f4 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] [instance: a1c78871-374e-41d9-af4a-d8284ccb8508] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:00.951927 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d7f5784-069a-4b55-b947-e284b32b61f4 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:00.958484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d7f5784-069a-4b55-b947-e284b32b61f4 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:00.959282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d7f5784-069a-4b55-b947-e284b32b61f4 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:00.967867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d7f5784-069a-4b55-b947-e284b32b61f4 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:00.975137 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d7f5784-069a-4b55-b947-e284b32b61f4 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:00.978520 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d7f5784-069a-4b55-b947-e284b32b61f4 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:01.023632 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-33c10d45-8ad6-441d-8824-f09b621f78aa tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:01.024066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-33c10d45-8ad6-441d-8824-f09b621f78aa tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 2cd80810-a36b-4bd6-929b-4a9aaa896365] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:01.045211 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-33c10d45-8ad6-441d-8824-f09b621f78aa tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:01.051066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-33c10d45-8ad6-441d-8824-f09b621f78aa tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:01.052697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-33c10d45-8ad6-441d-8824-f09b621f78aa tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:01.059083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-33c10d45-8ad6-441d-8824-f09b621f78aa tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:01.060769 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-33c10d45-8ad6-441d-8824-f09b621f78aa tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:01.061281 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-33c10d45-8ad6-441d-8824-f09b621f78aa tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:01.407490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1d7f5784-069a-4b55-b947-e284b32b61f4 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23b56d519224b22802f978442c7289f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa67de433dc46a595baea99d927d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:01.416872 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1d7f5784-069a-4b55-b947-e284b32b61f4 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] 10.222.0.16 "GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508" status: 200 len: 1666 microversion: 2.1 time: 0.488197 Oct 05 02:58:01.425711 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2787/5599] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:00 2022] GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508 => generated 1666 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:01.430644 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-854c6150-5316-4b21-88a8-9e6e9086bc92 req-77114dc8-fd9c-44b6-9d89-5b12b6942be6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cd80810-a36b-4bd6-929b-4a9aaa896365", "name": "network-vif-plugged", "status": "completed", "tag": "9152227f-f099-487a-a923-290e5b526d56"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:58:01.456393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-854c6150-5316-4b21-88a8-9e6e9086bc92 req-77114dc8-fd9c-44b6-9d89-5b12b6942be6 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:01.457184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-854c6150-5316-4b21-88a8-9e6e9086bc92 req-77114dc8-fd9c-44b6-9d89-5b12b6942be6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:01.462562 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-854c6150-5316-4b21-88a8-9e6e9086bc92 req-77114dc8-fd9c-44b6-9d89-5b12b6942be6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:01.489552 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-854c6150-5316-4b21-88a8-9e6e9086bc92 req-77114dc8-fd9c-44b6-9d89-5b12b6942be6 service nova] Creating event network-vif-plugged:9152227f-f099-487a-a923-290e5b526d56 for instance 2cd80810-a36b-4bd6-929b-4a9aaa896365 on n-h2-858272-3 Oct 05 02:58:01.504406 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-854c6150-5316-4b21-88a8-9e6e9086bc92 req-77114dc8-fd9c-44b6-9d89-5b12b6942be6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077187 Oct 05 02:58:01.508471 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2788/5600] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:58:01.517089 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a0042976-4242-42f8-97ef-4610dc4aee1a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:01.519825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a0042976-4242-42f8-97ef-4610dc4aee1a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:01.556877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a0042976-4242-42f8-97ef-4610dc4aee1a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:01.558687 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a0042976-4242-42f8-97ef-4610dc4aee1a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:01.561196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a0042976-4242-42f8-97ef-4610dc4aee1a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:01.562309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a0042976-4242-42f8-97ef-4610dc4aee1a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:01.564464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a0042976-4242-42f8-97ef-4610dc4aee1a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:01.565130 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a0042976-4242-42f8-97ef-4610dc4aee1a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:01.643293 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a0042976-4242-42f8-97ef-4610dc4aee1a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133127 Oct 05 02:58:01.646326 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2789/5601] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 02:58:01 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:58:02.130109 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-33c10d45-8ad6-441d-8824-f09b621f78aa tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb038e111434aa581b9ebc7a578b196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259ca05c46454743a9819915d50370a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:02.158424 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-33c10d45-8ad6-441d-8824-f09b621f78aa tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365" status: 200 len: 1314 microversion: 2.1 time: 1.139230 Oct 05 02:58:02.161156 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2813/5602] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:01 2022] GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365 => generated 1314 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:02.268049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-b426b1b3-a79e-4708-a5bc-103774328b47 req-845d95a8-bcc5-48d9-962a-0da63ae1a132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1c78871-374e-41d9-af4a-d8284ccb8508", "name": "network-vif-deleted", "tag": "cf48c84f-265d-4bc9-bdf9-a08c725b21ec"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:58:02.306888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b426b1b3-a79e-4708-a5bc-103774328b47 req-845d95a8-bcc5-48d9-962a-0da63ae1a132 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:02.307385 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b426b1b3-a79e-4708-a5bc-103774328b47 req-845d95a8-bcc5-48d9-962a-0da63ae1a132 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:02.307821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b426b1b3-a79e-4708-a5bc-103774328b47 req-845d95a8-bcc5-48d9-962a-0da63ae1a132 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:02.330182 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-b426b1b3-a79e-4708-a5bc-103774328b47 req-845d95a8-bcc5-48d9-962a-0da63ae1a132 service nova] Creating event network-vif-deleted:cf48c84f-265d-4bc9-bdf9-a08c725b21ec for instance a1c78871-374e-41d9-af4a-d8284ccb8508 on n-h2-858272-3 Oct 05 02:58:02.337420 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-b426b1b3-a79e-4708-a5bc-103774328b47 req-845d95a8-bcc5-48d9-962a-0da63ae1a132 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.376963 Oct 05 02:58:02.338648 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2790/5603] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:58:02.454127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ee5733ce-2da7-4604-8153-3434eb67b78f tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:02.454760 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ee5733ce-2da7-4604-8153-3434eb67b78f tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] [instance: a1c78871-374e-41d9-af4a-d8284ccb8508] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:02.471056 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee5733ce-2da7-4604-8153-3434eb67b78f tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:02.471570 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee5733ce-2da7-4604-8153-3434eb67b78f tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:02.472008 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee5733ce-2da7-4604-8153-3434eb67b78f tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:02.472751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee5733ce-2da7-4604-8153-3434eb67b78f tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:02.473341 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee5733ce-2da7-4604-8153-3434eb67b78f tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:02.482436 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee5733ce-2da7-4604-8153-3434eb67b78f tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:02.587790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee5733ce-2da7-4604-8153-3434eb67b78f tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:02.590094 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee5733ce-2da7-4604-8153-3434eb67b78f tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:02.590799 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee5733ce-2da7-4604-8153-3434eb67b78f tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:02.592648 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-ee5733ce-2da7-4604-8153-3434eb67b78f tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lazy-loading 'fault' on Instance uuid a1c78871-374e-41d9-af4a-d8284ccb8508 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:58:02.929739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-421f5e3f-3947-4818-a83a-1eb27b525e8d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:02.933546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-421f5e3f-3947-4818-a83a-1eb27b525e8d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:02.941590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-421f5e3f-3947-4818-a83a-1eb27b525e8d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:02.942329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-421f5e3f-3947-4818-a83a-1eb27b525e8d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:02.943033 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-421f5e3f-3947-4818-a83a-1eb27b525e8d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:02.943931 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-421f5e3f-3947-4818-a83a-1eb27b525e8d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:02.944783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-421f5e3f-3947-4818-a83a-1eb27b525e8d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:02.945471 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-421f5e3f-3947-4818-a83a-1eb27b525e8d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:02.967031 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ee5733ce-2da7-4604-8153-3434eb67b78f tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f23b56d519224b22802f978442c7289f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa67de433dc46a595baea99d927d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:02.986758 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ee5733ce-2da7-4604-8153-3434eb67b78f tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] 10.222.0.16 "GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508" status: 200 len: 1388 microversion: 2.1 time: 0.536522 Oct 05 02:58:02.989765 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2814/5604] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:02 2022] GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508 => generated 1388 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:03.047041 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-421f5e3f-3947-4818-a83a-1eb27b525e8d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.391538 Oct 05 02:58:03.051885 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2791/5605] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 02:58:02 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552/os-volume_attachments => generated 197 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:58:03.188809 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1ee251f1-1a35-4af5-ac7d-fcefab8ea2ff tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:03.191787 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1ee251f1-1a35-4af5-ac7d-fcefab8ea2ff tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 2cd80810-a36b-4bd6-929b-4a9aaa896365] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:03.202669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ee251f1-1a35-4af5-ac7d-fcefab8ea2ff tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:03.204347 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ee251f1-1a35-4af5-ac7d-fcefab8ea2ff tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:03.205166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ee251f1-1a35-4af5-ac7d-fcefab8ea2ff tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:03.206090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ee251f1-1a35-4af5-ac7d-fcefab8ea2ff tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:03.206925 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ee251f1-1a35-4af5-ac7d-fcefab8ea2ff tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:03.207532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ee251f1-1a35-4af5-ac7d-fcefab8ea2ff tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:03.723387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1ee251f1-1a35-4af5-ac7d-fcefab8ea2ff tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb038e111434aa581b9ebc7a578b196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259ca05c46454743a9819915d50370a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:03.736825 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1ee251f1-1a35-4af5-ac7d-fcefab8ea2ff tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365" status: 200 len: 1314 microversion: 2.1 time: 0.554644 Oct 05 02:58:03.745343 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2815/5606] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:03 2022] GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365 => generated 1314 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:04.014847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1de3f005-a864-45e7-a974-6178f8e5777b tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:04.016194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1de3f005-a864-45e7-a974-6178f8e5777b tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] [instance: a1c78871-374e-41d9-af4a-d8284ccb8508] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:04.029566 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1de3f005-a864-45e7-a974-6178f8e5777b tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:04.032027 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1de3f005-a864-45e7-a974-6178f8e5777b tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:04.034268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1de3f005-a864-45e7-a974-6178f8e5777b tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:04.035539 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1de3f005-a864-45e7-a974-6178f8e5777b tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:04.037613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1de3f005-a864-45e7-a974-6178f8e5777b tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:04.038357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1de3f005-a864-45e7-a974-6178f8e5777b tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:04.059824 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6ce43e1d-4bbb-42a3-bc44-dc27c7695d4b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:04.063126 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6ce43e1d-4bbb-42a3-bc44-dc27c7695d4b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:04.075437 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ce43e1d-4bbb-42a3-bc44-dc27c7695d4b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:04.085519 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ce43e1d-4bbb-42a3-bc44-dc27c7695d4b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:04.093163 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ce43e1d-4bbb-42a3-bc44-dc27c7695d4b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:04.095792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ce43e1d-4bbb-42a3-bc44-dc27c7695d4b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:04.097806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ce43e1d-4bbb-42a3-bc44-dc27c7695d4b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:04.100398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ce43e1d-4bbb-42a3-bc44-dc27c7695d4b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:04.114528 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-1de3f005-a864-45e7-a974-6178f8e5777b tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] HTTP exception thrown: Instance a1c78871-374e-41d9-af4a-d8284ccb8508 could not be found. Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1de3f005-a864-45e7-a974-6178f8e5777b tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Request method failure captured: Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508 HTTP/1.1 Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPFC6ORliUSB6zXea8r5P_SMS8uaqUckIQ4_Ctbbvy0IQe_S0yrLswcyBhpz2tZO9jDW-4aB5A1X1sDUSkWuyUZUWOvFpw4ywoBrqOJfJJQAdJtTpCq8y0KSflbtsxP4BIcSd0dQJZ_30BQvj9DdKsT248IZcwFlSLpONFtXA7Adx8Y Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: cfa67de433dc46a595baea99d927d156 Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-TestServerBasicOps-1869124925 Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cfa67de433dc46a595baea99d927d156"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cfa67de433dc46a595baea99d927d156"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cfa67de433dc46a595baea99d927d156"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cfa67de433dc46a595baea99d927d156"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-TestServerBasicOps-1869124925 Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: cfa67de433dc46a595baea99d927d156 Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-TestServerBasicOps-1869124925 Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-TestServerBasicOps-1869124925-project Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: f23b56d519224b22802f978442c7289f Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-TestServerBasicOps-1869124925-project Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance a1c78871-374e-41d9-af4a-d8284ccb8508 could not be found. Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'a1c78871-374e-41d9-af4a-d8284ccb8508'} Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1c78871-374e-41d9-af4a-d8284ccb8508 could not be found. Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1c78871-374e-41d9-af4a-d8284ccb8508 could not be found. Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:58:04.118150 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:58:04.123267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:04.123267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:58:04.123267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:58:04.123267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:58:04.123267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:58:04.123267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1c78871-374e-41d9-af4a-d8284ccb8508 could not be found. Oct 05 02:58:04.123267 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:58:04.126198 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1de3f005-a864-45e7-a974-6178f8e5777b tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Returning 404 to user: Instance a1c78871-374e-41d9-af4a-d8284ccb8508 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:58:04.133883 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1de3f005-a864-45e7-a974-6178f8e5777b tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] 10.222.0.16 "GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508" status: 404 len: 111 microversion: 2.1 time: 0.120441 Oct 05 02:58:04.136458 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2792/5607] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:04 2022] GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:58:04.191256 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6ce43e1d-4bbb-42a3-bc44-dc27c7695d4b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135368 Oct 05 02:58:04.200690 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2816/5608] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 02:58:04 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:58:04.760583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-adb7d68d-b95f-4f2b-a300-23f6008d907a tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:04.761601 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-adb7d68d-b95f-4f2b-a300-23f6008d907a tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 2cd80810-a36b-4bd6-929b-4a9aaa896365] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:04.770822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-adb7d68d-b95f-4f2b-a300-23f6008d907a tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:04.774416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-adb7d68d-b95f-4f2b-a300-23f6008d907a tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:04.776921 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-adb7d68d-b95f-4f2b-a300-23f6008d907a tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:04.778261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-adb7d68d-b95f-4f2b-a300-23f6008d907a tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:04.781603 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-adb7d68d-b95f-4f2b-a300-23f6008d907a tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:04.782476 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-adb7d68d-b95f-4f2b-a300-23f6008d907a tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:05.119831 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-adb7d68d-b95f-4f2b-a300-23f6008d907a tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb038e111434aa581b9ebc7a578b196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259ca05c46454743a9819915d50370a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:05.135562 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-adb7d68d-b95f-4f2b-a300-23f6008d907a tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365" status: 200 len: 1498 microversion: 2.1 time: 0.378971 Oct 05 02:58:05.153400 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2793/5609] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:04 2022] GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365 => generated 1498 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:05.208456 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9505b9c2-be7c-492a-8b7a-5f46b5db409e tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:05.210642 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9505b9c2-be7c-492a-8b7a-5f46b5db409e tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:05.229168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9505b9c2-be7c-492a-8b7a-5f46b5db409e tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:05.229845 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9505b9c2-be7c-492a-8b7a-5f46b5db409e tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:05.230444 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9505b9c2-be7c-492a-8b7a-5f46b5db409e tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:05.231520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9505b9c2-be7c-492a-8b7a-5f46b5db409e tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:05.232128 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9505b9c2-be7c-492a-8b7a-5f46b5db409e tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:05.233079 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9505b9c2-be7c-492a-8b7a-5f46b5db409e tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:05.321681 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9505b9c2-be7c-492a-8b7a-5f46b5db409e tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.117811 Oct 05 02:58:05.322690 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2817/5610] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 02:58:05 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552/os-volume_attachments => generated 25 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:58:05.472875 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6455760a-303b-4238-9043-e38e75c859e3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:58:05.475222 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6455760a-303b-4238-9043-e38e75c859e3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:05.493329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6455760a-303b-4238-9043-e38e75c859e3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:05.493819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6455760a-303b-4238-9043-e38e75c859e3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:05.494441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6455760a-303b-4238-9043-e38e75c859e3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:05.495340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6455760a-303b-4238-9043-e38e75c859e3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:05.495954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6455760a-303b-4238-9043-e38e75c859e3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:05.496535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6455760a-303b-4238-9043-e38e75c859e3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:05.559303 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-6455760a-303b-4238-9043-e38e75c859e3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] HTTP exception thrown: Cannot 'reboot' instance 3551a7d0-74d1-41e5-9cb9-252aeb256b95 while it is in vm_state rescued Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6455760a-303b-4238-9043-e38e75c859e3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Request method failure captured: Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95/action HTTP/1.1 Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 28 Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPGOLQowIsfBU6KJO-aq50qdRwmBWFeSun5TXHVGHXcRMd_nBRTUvLypi8_xX1_OhJhXqj8Tv9hcB2y77p-h0kTEsykqgEnSv0lMxHhtiAmMmCPjjlgvw91YvvX9SOOQS6JLONmL-pDrthh_0HqZ_QF0o7mi44oPhOdJTsJKEis6xoY Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 129b5343573f4f9fa648e984a68b6760 Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1554781900 Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/129b5343573f4f9fa648e984a68b6760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/129b5343573f4f9fa648e984a68b6760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/129b5343573f4f9fa648e984a68b6760"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_129b5343573f4f9fa648e984a68b6760"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1554781900 Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 129b5343573f4f9fa648e984a68b6760 Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1554781900 Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServerRescueNegativeTestJSON-1554781900-project Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: a031e94db13d4e7e8947f51abc36d629 Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1554781900-project Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: {"reboot": {"type": "HARD"}} Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: exception: Cannot 'reboot' instance 3551a7d0-74d1-41e5-9cb9-252aeb256b95 while it is in vm_state rescued Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '3551a7d0-74d1-41e5-9cb9-252aeb256b95', 'body': {'reboot': {'type': 'HARD'}}} Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3551a7d0-74d1-41e5-9cb9-252aeb256b95 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 05 02:58:05.561955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 02:58:05.566766 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 3551a7d0-74d1-41e5-9cb9-252aeb256b95 while it is in vm_state rescued Oct 05 02:58:05.566766 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:58:05.566766 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:58:05.566766 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:58:05.566766 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:05.566766 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:58:05.566766 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:58:05.566766 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:58:05.566766 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:58:05.566766 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 3551a7d0-74d1-41e5-9cb9-252aeb256b95 while it is in vm_state rescued Oct 05 02:58:05.566766 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:58:05.568798 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6455760a-303b-4238-9043-e38e75c859e3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Returning 409 to user: Cannot 'reboot' instance 3551a7d0-74d1-41e5-9cb9-252aeb256b95 while it is in vm_state rescued {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:58:05.571934 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6455760a-303b-4238-9043-e38e75c859e3 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "POST /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95/action" status: 409 len: 145 microversion: 2.1 time: 0.104735 Oct 05 02:58:05.573992 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2794/5611] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:58:05 2022] POST /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95/action => generated 145 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:58:05.583175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-11e793bb-8e29-4d28-8a5a-9145f3161c1d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:58:05.586317 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-11e793bb-8e29-4d28-8a5a-9145f3161c1d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:05.615987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11e793bb-8e29-4d28-8a5a-9145f3161c1d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:05.616576 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11e793bb-8e29-4d28-8a5a-9145f3161c1d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:05.616938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11e793bb-8e29-4d28-8a5a-9145f3161c1d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:05.617688 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11e793bb-8e29-4d28-8a5a-9145f3161c1d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:05.618126 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11e793bb-8e29-4d28-8a5a-9145f3161c1d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:05.618553 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11e793bb-8e29-4d28-8a5a-9145f3161c1d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:05.779801 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-11e793bb-8e29-4d28-8a5a-9145f3161c1d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] HTTP exception thrown: Cannot 'rebuild' instance 3551a7d0-74d1-41e5-9cb9-252aeb256b95 while it is in vm_state rescued Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-11e793bb-8e29-4d28-8a5a-9145f3161c1d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Request method failure captured: Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95/action HTTP/1.1 Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 65 Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPGOLQowIsfBU6KJO-aq50qdRwmBWFeSun5TXHVGHXcRMd_nBRTUvLypi8_xX1_OhJhXqj8Tv9hcB2y77p-h0kTEsykqgEnSv0lMxHhtiAmMmCPjjlgvw91YvvX9SOOQS6JLONmL-pDrthh_0HqZ_QF0o7mi44oPhOdJTsJKEis6xoY Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 129b5343573f4f9fa648e984a68b6760 Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1554781900 Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/129b5343573f4f9fa648e984a68b6760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/129b5343573f4f9fa648e984a68b6760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/129b5343573f4f9fa648e984a68b6760"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_129b5343573f4f9fa648e984a68b6760"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1554781900 Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 129b5343573f4f9fa648e984a68b6760 Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1554781900 Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerRescueNegativeTestJSON-1554781900-project Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: a031e94db13d4e7e8947f51abc36d629 Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1554781900-project Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: {"rebuild": {"imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab"}} Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: exception: Cannot 'rebuild' instance 3551a7d0-74d1-41e5-9cb9-252aeb256b95 while it is in vm_state rescued Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '3551a7d0-74d1-41e5-9cb9-252aeb256b95', 'body': {'rebuild': {'imageRef': 'adad3215-1ca6-43bb-9981-0d01aff146ab'}}} Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3551a7d0-74d1-41e5-9cb9-252aeb256b95 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:58:05.803939 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 02:58:05.817125 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 02:58:05.817125 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 05 02:58:05.817125 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 05 02:58:05.817125 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 05 02:58:05.817125 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 05 02:58:05.817125 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 02:58:05.817125 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 3551a7d0-74d1-41e5-9cb9-252aeb256b95 while it is in vm_state rescued Oct 05 02:58:05.817125 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:05.817125 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:58:05.817125 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:05.817125 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:05.817125 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:58:05.817125 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:58:05.817125 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:58:05.817125 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:58:05.817125 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 3551a7d0-74d1-41e5-9cb9-252aeb256b95 while it is in vm_state rescued Oct 05 02:58:05.817125 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:05.824732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-11e793bb-8e29-4d28-8a5a-9145f3161c1d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Returning 409 to user: Cannot 'rebuild' instance 3551a7d0-74d1-41e5-9cb9-252aeb256b95 while it is in vm_state rescued {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:58:05.825984 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-11e793bb-8e29-4d28-8a5a-9145f3161c1d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "POST /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95/action" status: 409 len: 146 microversion: 2.1 time: 0.246888 Oct 05 02:58:05.830370 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2818/5612] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 02:58:05 2022] POST /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95/action => generated 146 bytes in 252 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 02:58:05.838901 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-403639ef-75b3-4e65-9728-42123aad8424 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:05.839845 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-403639ef-75b3-4e65-9728-42123aad8424 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:05.850869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-403639ef-75b3-4e65-9728-42123aad8424 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:05.851594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-403639ef-75b3-4e65-9728-42123aad8424 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:05.852225 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-403639ef-75b3-4e65-9728-42123aad8424 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:05.856613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-403639ef-75b3-4e65-9728-42123aad8424 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:05.857343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-403639ef-75b3-4e65-9728-42123aad8424 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:05.857948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-403639ef-75b3-4e65-9728-42123aad8424 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:05.916581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-403639ef-75b3-4e65-9728-42123aad8424 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:58:06.033215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-20845bd7-3eca-480f-95ce-bb7378e3c99c tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:06.033965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-20845bd7-3eca-480f-95ce-bb7378e3c99c tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 2cd80810-a36b-4bd6-929b-4a9aaa896365] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:06.052873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20845bd7-3eca-480f-95ce-bb7378e3c99c tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:06.054113 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20845bd7-3eca-480f-95ce-bb7378e3c99c tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:06.054864 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20845bd7-3eca-480f-95ce-bb7378e3c99c tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:06.055796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20845bd7-3eca-480f-95ce-bb7378e3c99c tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:06.056570 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20845bd7-3eca-480f-95ce-bb7378e3c99c tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:06.057609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20845bd7-3eca-480f-95ce-bb7378e3c99c tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:06.074853 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-403639ef-75b3-4e65-9728-42123aad8424 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 204 len: 0 microversion: 2.1 time: 0.240095 Oct 05 02:58:06.076581 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2795/5613] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:58:05 2022] DELETE /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:58:06.086093 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c26f9ac7-d1a8-4df0-a8ce-59bb68a27e28 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:06.087121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c26f9ac7-d1a8-4df0-a8ce-59bb68a27e28 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:06.096545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c26f9ac7-d1a8-4df0-a8ce-59bb68a27e28 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:06.098411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c26f9ac7-d1a8-4df0-a8ce-59bb68a27e28 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:06.099464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c26f9ac7-d1a8-4df0-a8ce-59bb68a27e28 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:06.100769 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c26f9ac7-d1a8-4df0-a8ce-59bb68a27e28 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:06.101589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c26f9ac7-d1a8-4df0-a8ce-59bb68a27e28 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:06.102226 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c26f9ac7-d1a8-4df0-a8ce-59bb68a27e28 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:06.121589 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-20845bd7-3eca-480f-95ce-bb7378e3c99c tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 2cd80810-a36b-4bd6-929b-4a9aaa896365] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:58:06.334993 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-20845bd7-3eca-480f-95ce-bb7378e3c99c tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365" status: 204 len: 0 microversion: 2.1 time: 0.308473 Oct 05 02:58:06.337233 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2819/5614] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:58:06 2022] DELETE /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:58:06.349803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7d3cbb87-9a9b-4d90-b1d4-d31e5efc49ac tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:06.351380 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7d3cbb87-9a9b-4d90-b1d4-d31e5efc49ac tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] [instance: a1c78871-374e-41d9-af4a-d8284ccb8508] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:06.366913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d3cbb87-9a9b-4d90-b1d4-d31e5efc49ac tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:06.367505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d3cbb87-9a9b-4d90-b1d4-d31e5efc49ac tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:06.368045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d3cbb87-9a9b-4d90-b1d4-d31e5efc49ac tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:06.368952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d3cbb87-9a9b-4d90-b1d4-d31e5efc49ac tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:06.369627 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d3cbb87-9a9b-4d90-b1d4-d31e5efc49ac tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:06.370280 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d3cbb87-9a9b-4d90-b1d4-d31e5efc49ac tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:06.389758 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-7d3cbb87-9a9b-4d90-b1d4-d31e5efc49ac tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] HTTP exception thrown: Instance a1c78871-374e-41d9-af4a-d8284ccb8508 could not be found. Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7d3cbb87-9a9b-4d90-b1d4-d31e5efc49ac tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Request method failure captured: Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508 HTTP/1.1 Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPFC6ORliUSB6zXea8r5P_SMS8uaqUckIQ4_Ctbbvy0IQe_S0yrLswcyBhpz2tZO9jDW-4aB5A1X1sDUSkWuyUZUWOvFpw4ywoBrqOJfJJQAdJtTpCq8y0KSflbtsxP4BIcSd0dQJZ_30BQvj9DdKsT248IZcwFlSLpONFtXA7Adx8Y Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: cfa67de433dc46a595baea99d927d156 Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TestServerBasicOps-1869124925 Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cfa67de433dc46a595baea99d927d156"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cfa67de433dc46a595baea99d927d156"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cfa67de433dc46a595baea99d927d156"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cfa67de433dc46a595baea99d927d156"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TestServerBasicOps-1869124925 Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: cfa67de433dc46a595baea99d927d156 Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TestServerBasicOps-1869124925 Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TestServerBasicOps-1869124925-project Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: f23b56d519224b22802f978442c7289f Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TestServerBasicOps-1869124925-project Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance a1c78871-374e-41d9-af4a-d8284ccb8508 could not be found. Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'a1c78871-374e-41d9-af4a-d8284ccb8508'} Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1c78871-374e-41d9-af4a-d8284ccb8508 could not be found. Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:58:06.392677 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:58:06.397309 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1c78871-374e-41d9-af4a-d8284ccb8508 could not be found. Oct 05 02:58:06.397309 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:06.397309 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:58:06.397309 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:06.397309 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:06.397309 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:58:06.397309 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:58:06.397309 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:58:06.397309 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:58:06.397309 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1c78871-374e-41d9-af4a-d8284ccb8508 could not be found. Oct 05 02:58:06.397309 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:06.399253 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c26f9ac7-d1a8-4df0-a8ce-59bb68a27e28 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:06.401377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7d3cbb87-9a9b-4d90-b1d4-d31e5efc49ac tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Returning 404 to user: Instance a1c78871-374e-41d9-af4a-d8284ccb8508 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:58:06.402412 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c26f9ac7-d1a8-4df0-a8ce-59bb68a27e28 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1689 microversion: 2.1 time: 0.321439 Oct 05 02:58:06.402829 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7d3cbb87-9a9b-4d90-b1d4-d31e5efc49ac tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508" status: 404 len: 111 microversion: 2.1 time: 0.061529 Oct 05 02:58:06.417180 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2796/5615] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:06 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1689 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:06.417180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-039e339b-5fae-40b1-b3d2-a46d9ec3ea14 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:06.417180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-039e339b-5fae-40b1-b3d2-a46d9ec3ea14 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 2cd80810-a36b-4bd6-929b-4a9aaa896365] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:06.426523 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2820/5616] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:58:06 2022] DELETE /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:58:06.427195 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-039e339b-5fae-40b1-b3d2-a46d9ec3ea14 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:06.427698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-039e339b-5fae-40b1-b3d2-a46d9ec3ea14 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:06.428135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-039e339b-5fae-40b1-b3d2-a46d9ec3ea14 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:06.428841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-039e339b-5fae-40b1-b3d2-a46d9ec3ea14 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:06.429409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-039e339b-5fae-40b1-b3d2-a46d9ec3ea14 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:06.429843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-039e339b-5fae-40b1-b3d2-a46d9ec3ea14 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:06.443482 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d38c72dc-bce7-423e-8866-8771b3811895 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:06.444377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d38c72dc-bce7-423e-8866-8771b3811895 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] [instance: a1c78871-374e-41d9-af4a-d8284ccb8508] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:06.458199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d38c72dc-bce7-423e-8866-8771b3811895 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:06.458936 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d38c72dc-bce7-423e-8866-8771b3811895 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:06.463880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d38c72dc-bce7-423e-8866-8771b3811895 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:06.464860 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d38c72dc-bce7-423e-8866-8771b3811895 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:06.465514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d38c72dc-bce7-423e-8866-8771b3811895 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:06.466099 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d38c72dc-bce7-423e-8866-8771b3811895 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:06.488424 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-d38c72dc-bce7-423e-8866-8771b3811895 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] HTTP exception thrown: Instance a1c78871-374e-41d9-af4a-d8284ccb8508 could not be found. Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d38c72dc-bce7-423e-8866-8771b3811895 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Request method failure captured: Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508 HTTP/1.1 Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPFC6ORliUSB6zXea8r5P_SMS8uaqUckIQ4_Ctbbvy0IQe_S0yrLswcyBhpz2tZO9jDW-4aB5A1X1sDUSkWuyUZUWOvFpw4ywoBrqOJfJJQAdJtTpCq8y0KSflbtsxP4BIcSd0dQJZ_30BQvj9DdKsT248IZcwFlSLpONFtXA7Adx8Y Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: cfa67de433dc46a595baea99d927d156 Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TestServerBasicOps-1869124925 Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cfa67de433dc46a595baea99d927d156"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cfa67de433dc46a595baea99d927d156"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cfa67de433dc46a595baea99d927d156"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cfa67de433dc46a595baea99d927d156"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TestServerBasicOps-1869124925 Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: cfa67de433dc46a595baea99d927d156 Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TestServerBasicOps-1869124925 Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TestServerBasicOps-1869124925-project Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: f23b56d519224b22802f978442c7289f Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TestServerBasicOps-1869124925-project Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance a1c78871-374e-41d9-af4a-d8284ccb8508 could not be found. Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'a1c78871-374e-41d9-af4a-d8284ccb8508'} Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1c78871-374e-41d9-af4a-d8284ccb8508 could not be found. Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1c78871-374e-41d9-af4a-d8284ccb8508 could not be found. Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:58:06.490071 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:06.494344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:06.494344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:58:06.494344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:58:06.494344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:58:06.494344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:58:06.494344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1c78871-374e-41d9-af4a-d8284ccb8508 could not be found. Oct 05 02:58:06.494344 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:06.494344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d38c72dc-bce7-423e-8866-8771b3811895 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Returning 404 to user: Instance a1c78871-374e-41d9-af4a-d8284ccb8508 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:58:06.494344 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d38c72dc-bce7-423e-8866-8771b3811895 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] 10.222.0.16 "GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508" status: 404 len: 111 microversion: 2.1 time: 0.060711 Oct 05 02:58:06.494344 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2821/5617] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:06 2022] GET /compute/v2.1/servers/a1c78871-374e-41d9-af4a-d8284ccb8508 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:58:06.806293 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-039e339b-5fae-40b1-b3d2-a46d9ec3ea14 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb038e111434aa581b9ebc7a578b196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259ca05c46454743a9819915d50370a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:06.818421 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-039e339b-5fae-40b1-b3d2-a46d9ec3ea14 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365" status: 200 len: 1504 microversion: 2.1 time: 0.409520 Oct 05 02:58:06.833013 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2797/5618] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:06 2022] GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365 => generated 1504 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:06.962666 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a7346d4e-d932-4201-924b-ef91291d0660 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] Calling method '.version_select at 0x7fccdf041670>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:07.011771 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a7346d4e-d932-4201-924b-ef91291d0660 tempest-TestServerBasicOps-1869124925 tempest-TestServerBasicOps-1869124925-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-109281340" status: 202 len: 0 microversion: 2.1 time: 0.053195 Oct 05 02:58:07.012409 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2822/5619] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 5 02:58:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-109281340 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:58:07.428566 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-91ac2d55-251f-4d41-b0b3-18b8700f72c2 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:07.429276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-91ac2d55-251f-4d41-b0b3-18b8700f72c2 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:07.462208 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91ac2d55-251f-4d41-b0b3-18b8700f72c2 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:07.462813 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91ac2d55-251f-4d41-b0b3-18b8700f72c2 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:07.463269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91ac2d55-251f-4d41-b0b3-18b8700f72c2 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:07.463995 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91ac2d55-251f-4d41-b0b3-18b8700f72c2 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:07.478827 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91ac2d55-251f-4d41-b0b3-18b8700f72c2 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:07.479287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91ac2d55-251f-4d41-b0b3-18b8700f72c2 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:07.795271 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-91ac2d55-251f-4d41-b0b3-18b8700f72c2 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:07.804856 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-91ac2d55-251f-4d41-b0b3-18b8700f72c2 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1689 microversion: 2.1 time: 0.381779 Oct 05 02:58:07.815857 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2798/5620] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:07 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1689 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:07.851483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-262dbd3c-ab6e-43e4-a378-f7fd7b6e450b tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:07.852756 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-262dbd3c-ab6e-43e4-a378-f7fd7b6e450b tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 2cd80810-a36b-4bd6-929b-4a9aaa896365] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:07.861008 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-262dbd3c-ab6e-43e4-a378-f7fd7b6e450b tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:07.861526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-262dbd3c-ab6e-43e4-a378-f7fd7b6e450b tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:07.862031 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-262dbd3c-ab6e-43e4-a378-f7fd7b6e450b tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:07.863054 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-262dbd3c-ab6e-43e4-a378-f7fd7b6e450b tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:07.863604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-262dbd3c-ab6e-43e4-a378-f7fd7b6e450b tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:07.864251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-262dbd3c-ab6e-43e4-a378-f7fd7b6e450b tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:08.151942 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-262dbd3c-ab6e-43e4-a378-f7fd7b6e450b tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb038e111434aa581b9ebc7a578b196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259ca05c46454743a9819915d50370a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:08.160467 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-262dbd3c-ab6e-43e4-a378-f7fd7b6e450b tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365" status: 200 len: 1504 microversion: 2.1 time: 0.314903 Oct 05 02:58:08.168968 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2823/5621] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:07 2022] GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365 => generated 1504 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:08.833960 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-38b7724a-2aea-4dee-b509-e8fb8d00ba51 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:08.835331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-38b7724a-2aea-4dee-b509-e8fb8d00ba51 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:08.846096 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38b7724a-2aea-4dee-b509-e8fb8d00ba51 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:08.846725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38b7724a-2aea-4dee-b509-e8fb8d00ba51 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:08.847257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38b7724a-2aea-4dee-b509-e8fb8d00ba51 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:08.848034 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38b7724a-2aea-4dee-b509-e8fb8d00ba51 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:08.848566 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38b7724a-2aea-4dee-b509-e8fb8d00ba51 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:08.849154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38b7724a-2aea-4dee-b509-e8fb8d00ba51 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:09.057573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-38b7724a-2aea-4dee-b509-e8fb8d00ba51 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:09.068208 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-38b7724a-2aea-4dee-b509-e8fb8d00ba51 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1689 microversion: 2.1 time: 0.238045 Oct 05 02:58:09.084096 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2799/5622] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:08 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1689 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:09.198736 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bdf0323a-b71f-414e-b658-ca6c05d1364b tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:09.199133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bdf0323a-b71f-414e-b658-ca6c05d1364b tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 2cd80810-a36b-4bd6-929b-4a9aaa896365] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:09.209853 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bdf0323a-b71f-414e-b658-ca6c05d1364b tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:09.210389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bdf0323a-b71f-414e-b658-ca6c05d1364b tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:09.210842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bdf0323a-b71f-414e-b658-ca6c05d1364b tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:09.211573 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bdf0323a-b71f-414e-b658-ca6c05d1364b tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:09.212027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bdf0323a-b71f-414e-b658-ca6c05d1364b tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:09.214941 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bdf0323a-b71f-414e-b658-ca6c05d1364b tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:09.503017 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bdf0323a-b71f-414e-b658-ca6c05d1364b tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb038e111434aa581b9ebc7a578b196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259ca05c46454743a9819915d50370a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:09.514773 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bdf0323a-b71f-414e-b658-ca6c05d1364b tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365" status: 200 len: 1504 microversion: 2.1 time: 0.320492 Oct 05 02:58:09.526972 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2824/5623] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:09 2022] GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365 => generated 1504 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:10.094489 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b6ae093e-95b2-4bf3-87f8-d5d758fde347 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:10.095717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b6ae093e-95b2-4bf3-87f8-d5d758fde347 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:10.112856 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6ae093e-95b2-4bf3-87f8-d5d758fde347 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:10.119049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6ae093e-95b2-4bf3-87f8-d5d758fde347 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:10.120528 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6ae093e-95b2-4bf3-87f8-d5d758fde347 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:10.126883 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6ae093e-95b2-4bf3-87f8-d5d758fde347 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:10.127729 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6ae093e-95b2-4bf3-87f8-d5d758fde347 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:10.128810 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6ae093e-95b2-4bf3-87f8-d5d758fde347 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:10.399468 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b6ae093e-95b2-4bf3-87f8-d5d758fde347 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:10.415250 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b6ae093e-95b2-4bf3-87f8-d5d758fde347 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1689 microversion: 2.1 time: 0.326135 Oct 05 02:58:10.415852 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2800/5624] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:10 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1689 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:10.507951 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d2c3160b-3676-4e49-b2a0-e2d87ae7fa48 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1902216721", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "f43e45c0-e77b-490a-baf0-c0049818e1e1"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:58:10.520786 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:58:10.542428 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3672c3d1-deac-4d86-848b-15b3a4b32325 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:10.543043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3672c3d1-deac-4d86-848b-15b3a4b32325 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 2cd80810-a36b-4bd6-929b-4a9aaa896365] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:10.552234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3672c3d1-deac-4d86-848b-15b3a4b32325 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:10.554313 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3672c3d1-deac-4d86-848b-15b3a4b32325 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:10.556977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3672c3d1-deac-4d86-848b-15b3a4b32325 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:10.559356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3672c3d1-deac-4d86-848b-15b3a4b32325 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:10.559909 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3672c3d1-deac-4d86-848b-15b3a4b32325 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:10.561060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3672c3d1-deac-4d86-848b-15b3a4b32325 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:10.596759 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:58:10.627571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-d2c3160b-3676-4e49-b2a0-e2d87ae7fa48 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] validate_networks() for [('f43e45c0-e77b-490a-baf0-c0049818e1e1', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:58:10.971123 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3672c3d1-deac-4d86-848b-15b3a4b32325 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb038e111434aa581b9ebc7a578b196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259ca05c46454743a9819915d50370a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:10.992447 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3672c3d1-deac-4d86-848b-15b3a4b32325 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365" status: 200 len: 1504 microversion: 2.1 time: 0.454687 Oct 05 02:58:11.008944 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2801/5625] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:10 2022] GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365 => generated 1504 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:11.442602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0d3f83a2-9f4c-47c2-9def-6918ad5866a9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:11.443261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0d3f83a2-9f4c-47c2-9def-6918ad5866a9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:11.462413 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d3f83a2-9f4c-47c2-9def-6918ad5866a9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:11.462950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d3f83a2-9f4c-47c2-9def-6918ad5866a9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:11.463714 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d3f83a2-9f4c-47c2-9def-6918ad5866a9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:11.464468 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d3f83a2-9f4c-47c2-9def-6918ad5866a9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:11.465136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d3f83a2-9f4c-47c2-9def-6918ad5866a9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:11.465806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d3f83a2-9f4c-47c2-9def-6918ad5866a9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:11.825344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-d2c3160b-3676-4e49-b2a0-e2d87ae7fa48 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:58:11.825776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-d2c3160b-3676-4e49-b2a0-e2d87ae7fa48 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:58:11.826216 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-d2c3160b-3676-4e49-b2a0-e2d87ae7fa48 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:58:11.827055 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-d2c3160b-3676-4e49-b2a0-e2d87ae7fa48 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:58:11.827694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-d2c3160b-3676-4e49-b2a0-e2d87ae7fa48 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:58:11.838454 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2c3160b-3676-4e49-b2a0-e2d87ae7fa48 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:11.839166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2c3160b-3676-4e49-b2a0-e2d87ae7fa48 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:11.843967 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2c3160b-3676-4e49-b2a0-e2d87ae7fa48 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:11.845225 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2c3160b-3676-4e49-b2a0-e2d87ae7fa48 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:11.845927 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2c3160b-3676-4e49-b2a0-e2d87ae7fa48 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:11.846552 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2c3160b-3676-4e49-b2a0-e2d87ae7fa48 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:11.896096 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-d2c3160b-3676-4e49-b2a0-e2d87ae7fa48 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Getting quotas for project 1d8dfc2b9fa14888ad008ee075da8170. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:58:11.914410 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-d2c3160b-3676-4e49-b2a0-e2d87ae7fa48 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Getting quotas for user 78ecb250db344080990dd801dacbde48 and project 1d8dfc2b9fa14888ad008ee075da8170. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:58:11.941591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d2c3160b-3676-4e49-b2a0-e2d87ae7fa48 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:58:11.944279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d2c3160b-3676-4e49-b2a0-e2d87ae7fa48 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] [instance: c34e85b7-df59-45a0-b132-3bf5b5f487a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:58:12.022245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0d3f83a2-9f4c-47c2-9def-6918ad5866a9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:12.031905 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0d3f83a2-9f4c-47c2-9def-6918ad5866a9 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1689 microversion: 2.1 time: 0.593157 Oct 05 02:58:12.042016 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2802/5626] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:11 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1689 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:12.047684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b8bf394f-16e7-4685-a20e-68d7160b6cca tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:12.054778 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d2c3160b-3676-4e49-b2a0-e2d87ae7fa48 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.839449 Oct 05 02:58:12.056061 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2825/5627] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:58:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 02:58:12.057112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b8bf394f-16e7-4685-a20e-68d7160b6cca tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 2cd80810-a36b-4bd6-929b-4a9aaa896365] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:12.059294 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:58:12.068580 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0dbc3b7b-734e-4c5d-957f-5329b20141ea tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:12.076031 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0dbc3b7b-734e-4c5d-957f-5329b20141ea tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] [instance: c34e85b7-df59-45a0-b132-3bf5b5f487a8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:12.084048 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8bf394f-16e7-4685-a20e-68d7160b6cca tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:12.089880 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8bf394f-16e7-4685-a20e-68d7160b6cca tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:12.091952 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8bf394f-16e7-4685-a20e-68d7160b6cca tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:12.094551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8bf394f-16e7-4685-a20e-68d7160b6cca tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:12.097308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8bf394f-16e7-4685-a20e-68d7160b6cca tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:12.098678 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8bf394f-16e7-4685-a20e-68d7160b6cca tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:12.256353 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0dbc3b7b-734e-4c5d-957f-5329b20141ea tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ecb250db344080990dd801dacbde48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8dfc2b9fa14888ad008ee075da8170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:12.278286 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0dbc3b7b-734e-4c5d-957f-5329b20141ea tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] 10.222.0.16 "GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8" status: 200 len: 1216 microversion: 2.1 time: 0.211795 Oct 05 02:58:12.303993 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2826/5628] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:12 2022] GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8 => generated 1216 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:12.593780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-1ae1bc37-436c-481a-b4b6-69ec67b399bc req-931bf91c-3b0b-4da4-8375-0b07f98b666e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cd80810-a36b-4bd6-929b-4a9aaa896365", "name": "network-vif-deleted", "tag": "9152227f-f099-487a-a923-290e5b526d56"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:58:12.603274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b8bf394f-16e7-4685-a20e-68d7160b6cca tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb038e111434aa581b9ebc7a578b196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259ca05c46454743a9819915d50370a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:12.618094 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b8bf394f-16e7-4685-a20e-68d7160b6cca tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365" status: 200 len: 1504 microversion: 2.1 time: 0.574556 Oct 05 02:58:12.625413 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2803/5629] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:12 2022] GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365 => generated 1504 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:13.069856 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-04abf9f6-2f2c-45cb-8165-17ffe83d2d47 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:13.070499 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-04abf9f6-2f2c-45cb-8165-17ffe83d2d47 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:13.079916 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04abf9f6-2f2c-45cb-8165-17ffe83d2d47 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:13.081511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04abf9f6-2f2c-45cb-8165-17ffe83d2d47 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:13.082153 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04abf9f6-2f2c-45cb-8165-17ffe83d2d47 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:13.085448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04abf9f6-2f2c-45cb-8165-17ffe83d2d47 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:13.086359 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04abf9f6-2f2c-45cb-8165-17ffe83d2d47 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:13.087030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04abf9f6-2f2c-45cb-8165-17ffe83d2d47 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:13.308008 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1ae1bc37-436c-481a-b4b6-69ec67b399bc req-931bf91c-3b0b-4da4-8375-0b07f98b666e service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:13.308636 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1ae1bc37-436c-481a-b4b6-69ec67b399bc req-931bf91c-3b0b-4da4-8375-0b07f98b666e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:13.309200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1ae1bc37-436c-481a-b4b6-69ec67b399bc req-931bf91c-3b0b-4da4-8375-0b07f98b666e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:13.332852 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-1ae1bc37-436c-481a-b4b6-69ec67b399bc req-931bf91c-3b0b-4da4-8375-0b07f98b666e service nova] Creating event network-vif-deleted:9152227f-f099-487a-a923-290e5b526d56 for instance 2cd80810-a36b-4bd6-929b-4a9aaa896365 on n-h2-858272-3 Oct 05 02:58:13.339115 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-1ae1bc37-436c-481a-b4b6-69ec67b399bc req-931bf91c-3b0b-4da4-8375-0b07f98b666e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.750427 Oct 05 02:58:13.339986 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2827/5630] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:58:13.351958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0de76079-0394-4d9e-b9bf-0dbbf1504774 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:13.353512 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0de76079-0394-4d9e-b9bf-0dbbf1504774 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] [instance: c34e85b7-df59-45a0-b132-3bf5b5f487a8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:13.841719 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0de76079-0394-4d9e-b9bf-0dbbf1504774 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ecb250db344080990dd801dacbde48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8dfc2b9fa14888ad008ee075da8170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:13.861410 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-04abf9f6-2f2c-45cb-8165-17ffe83d2d47 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:13.875385 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-04abf9f6-2f2c-45cb-8165-17ffe83d2d47 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1689 microversion: 2.1 time: 0.810192 Oct 05 02:58:13.882742 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0de76079-0394-4d9e-b9bf-0dbbf1504774 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] 10.222.0.16 "GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8" status: 200 len: 1216 microversion: 2.1 time: 0.541018 Oct 05 02:58:13.884794 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2804/5631] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:13 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1689 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:13.901704 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fde1966f-e849-47a9-af9e-1f0b5b639c72 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:13.902536 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fde1966f-e849-47a9-af9e-1f0b5b639c72 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: be028745-08ea-4ddd-853f-a893d54eedc1] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:13.904619 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2828/5632] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:13 2022] GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8 => generated 1216 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:13.939651 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-377a5b4a-935d-446e-8246-dfc11adbb2d9 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:13.942968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-377a5b4a-935d-446e-8246-dfc11adbb2d9 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 2cd80810-a36b-4bd6-929b-4a9aaa896365] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:13.950874 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-377a5b4a-935d-446e-8246-dfc11adbb2d9 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:13.951086 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fde1966f-e849-47a9-af9e-1f0b5b639c72 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:13.951373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-377a5b4a-935d-446e-8246-dfc11adbb2d9 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:13.951491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fde1966f-e849-47a9-af9e-1f0b5b639c72 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:13.951805 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-377a5b4a-935d-446e-8246-dfc11adbb2d9 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:13.951950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fde1966f-e849-47a9-af9e-1f0b5b639c72 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:13.952829 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fde1966f-e849-47a9-af9e-1f0b5b639c72 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:13.953305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-377a5b4a-935d-446e-8246-dfc11adbb2d9 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:13.953566 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fde1966f-e849-47a9-af9e-1f0b5b639c72 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:13.954277 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fde1966f-e849-47a9-af9e-1f0b5b639c72 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:13.955628 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-377a5b4a-935d-446e-8246-dfc11adbb2d9 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:13.956363 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-377a5b4a-935d-446e-8246-dfc11adbb2d9 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:13.992443 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-377a5b4a-935d-446e-8246-dfc11adbb2d9 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] HTTP exception thrown: Instance 2cd80810-a36b-4bd6-929b-4a9aaa896365 could not be found. Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-377a5b4a-935d-446e-8246-dfc11adbb2d9 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Request method failure captured: Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365 HTTP/1.1 Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPKlraLKIazVRBdxW48unYps6itJTlS_HNoSPMihsKZegCF91a10wBvHtZJshkTUT97ply17i57onhAN8a4Z7BVZB-OkM9U9bWsZcCwJMDNxaax7RFKBZMdBQTl4i-0GBVuWxe1J64h0Qrnm1Oa_BjZ1FIsboAzXkMRa4z_z1DjLodc Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 259ca05c46454743a9819915d50370a7 Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-VolumesActionsTest-1219574421 Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/259ca05c46454743a9819915d50370a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/259ca05c46454743a9819915d50370a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/259ca05c46454743a9819915d50370a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_259ca05c46454743a9819915d50370a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-VolumesActionsTest-1219574421 Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 259ca05c46454743a9819915d50370a7 Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-VolumesActionsTest-1219574421 Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-VolumesActionsTest-1219574421-project Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 7cb038e111434aa581b9ebc7a578b196 Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-VolumesActionsTest-1219574421-project Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 2cd80810-a36b-4bd6-929b-4a9aaa896365 could not be found. Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '2cd80810-a36b-4bd6-929b-4a9aaa896365'} Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cd80810-a36b-4bd6-929b-4a9aaa896365 could not be found. Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cd80810-a36b-4bd6-929b-4a9aaa896365 could not be found. Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:58:13.994164 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:13.998018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:13.998018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:58:13.998018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:58:13.998018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:58:13.998018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:58:13.998018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cd80810-a36b-4bd6-929b-4a9aaa896365 could not be found. Oct 05 02:58:13.998018 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:13.998771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-377a5b4a-935d-446e-8246-dfc11adbb2d9 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Returning 404 to user: Instance 2cd80810-a36b-4bd6-929b-4a9aaa896365 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:58:14.001582 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-377a5b4a-935d-446e-8246-dfc11adbb2d9 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365" status: 404 len: 111 microversion: 2.1 time: 0.091616 Oct 05 02:58:14.002355 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2829/5633] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:13 2022] GET /compute/v2.1/servers/2cd80810-a36b-4bd6-929b-4a9aaa896365 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:58:14.140507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-fde1966f-e849-47a9-af9e-1f0b5b639c72 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lazy-loading 'services' on Instance uuid be028745-08ea-4ddd-853f-a893d54eedc1 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:58:14.295676 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fde1966f-e849-47a9-af9e-1f0b5b639c72 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "DELETE /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1/os-volume_attachments/cc27b47e-d1b4-4e93-9e95-59df84b3fa34" status: 202 len: 0 microversion: 2.1 time: 0.406733 Oct 05 02:58:14.299917 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2805/5634] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 02:58:13 2022] DELETE /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1/os-volume_attachments/cc27b47e-d1b4-4e93-9e95-59df84b3fa34 => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:58:14.305941 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8780a8a4-eb4e-4303-9ef5-e2672781148f tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-830174791", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "4c105559-4f55-4f9d-bddc-2309be57561d"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:58:14.404823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-8780a8a4-eb4e-4303-9ef5-e2672781148f tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] validate_networks() for [('4c105559-4f55-4f9d-bddc-2309be57561d', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:58:14.915022 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d96e6087-bf75-4912-9a65-7a46dbf0c405 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:14.915845 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d96e6087-bf75-4912-9a65-7a46dbf0c405 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:14.952505 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d96e6087-bf75-4912-9a65-7a46dbf0c405 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:14.957675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d96e6087-bf75-4912-9a65-7a46dbf0c405 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:14.959704 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d96e6087-bf75-4912-9a65-7a46dbf0c405 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:14.960691 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d96e6087-bf75-4912-9a65-7a46dbf0c405 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:14.962653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d96e6087-bf75-4912-9a65-7a46dbf0c405 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:14.964786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d96e6087-bf75-4912-9a65-7a46dbf0c405 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:15.771177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d96e6087-bf75-4912-9a65-7a46dbf0c405 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:15.786624 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d96e6087-bf75-4912-9a65-7a46dbf0c405 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 200 len: 1329 microversion: 2.1 time: 0.879243 Oct 05 02:58:15.813795 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2806/5635] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:14 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 1329 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:15.834033 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-a2830ceb-f0bc-4c1a-b6ec-33bfdf06a4da req-14faeda9-df87-4a5c-9473-d6cfa48e953d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c09b57e-7650-448b-ba76-402bdb4f9552", "name": "network-vif-deleted", "tag": "97e75ce5-35d6-42fc-9ea6-ed6afc7040fa"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:58:15.860926 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a2830ceb-f0bc-4c1a-b6ec-33bfdf06a4da req-14faeda9-df87-4a5c-9473-d6cfa48e953d service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:15.861866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a2830ceb-f0bc-4c1a-b6ec-33bfdf06a4da req-14faeda9-df87-4a5c-9473-d6cfa48e953d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:15.862549 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a2830ceb-f0bc-4c1a-b6ec-33bfdf06a4da req-14faeda9-df87-4a5c-9473-d6cfa48e953d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:15.886404 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-a2830ceb-f0bc-4c1a-b6ec-33bfdf06a4da req-14faeda9-df87-4a5c-9473-d6cfa48e953d service nova] Creating event network-vif-deleted:97e75ce5-35d6-42fc-9ea6-ed6afc7040fa for instance 7c09b57e-7650-448b-ba76-402bdb4f9552 on n-h2-858272-3 Oct 05 02:58:15.900413 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-a2830ceb-f0bc-4c1a-b6ec-33bfdf06a4da req-14faeda9-df87-4a5c-9473-d6cfa48e953d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083987 Oct 05 02:58:15.901633 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2807/5636] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:58:15.929749 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2643c7f7-f616-42ff-8490-211595a19684 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:15.937754 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2643c7f7-f616-42ff-8490-211595a19684 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] [instance: c34e85b7-df59-45a0-b132-3bf5b5f487a8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:15.965948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2643c7f7-f616-42ff-8490-211595a19684 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:15.967497 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2643c7f7-f616-42ff-8490-211595a19684 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:15.977716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2643c7f7-f616-42ff-8490-211595a19684 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:15.979401 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2643c7f7-f616-42ff-8490-211595a19684 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:15.980257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2643c7f7-f616-42ff-8490-211595a19684 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:15.986318 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2643c7f7-f616-42ff-8490-211595a19684 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:16.367380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2643c7f7-f616-42ff-8490-211595a19684 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ecb250db344080990dd801dacbde48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8dfc2b9fa14888ad008ee075da8170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:16.382935 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2643c7f7-f616-42ff-8490-211595a19684 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] 10.222.0.16 "GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8" status: 200 len: 1274 microversion: 2.1 time: 0.475591 Oct 05 02:58:16.383930 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2808/5637] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:15 2022] GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8 => generated 1274 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:16.820053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ae852d83-2849-4a95-a9ae-f9d5dc586076 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:16.821657 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ae852d83-2849-4a95-a9ae-f9d5dc586076 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 7c09b57e-7650-448b-ba76-402bdb4f9552] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:16.838961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae852d83-2849-4a95-a9ae-f9d5dc586076 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:16.842913 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae852d83-2849-4a95-a9ae-f9d5dc586076 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:16.844888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae852d83-2849-4a95-a9ae-f9d5dc586076 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:16.845799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae852d83-2849-4a95-a9ae-f9d5dc586076 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:16.850714 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae852d83-2849-4a95-a9ae-f9d5dc586076 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:16.851356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae852d83-2849-4a95-a9ae-f9d5dc586076 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:16.904630 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-ae852d83-2849-4a95-a9ae-f9d5dc586076 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] HTTP exception thrown: Instance 7c09b57e-7650-448b-ba76-402bdb4f9552 could not be found. Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ae852d83-2849-4a95-a9ae-f9d5dc586076 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Request method failure captured: Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 HTTP/1.1 Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPGOLQowIsfBU6KJO-aq50qdRwmBWFeSun5TXHVGHXcRMd_nBRTUvLypi8_xX1_OhJhXqj8Tv9hcB2y77p-h0kTEsykqgEnSv0lMxHhtiAmMmCPjjlgvw91YvvX9SOOQS6JLONmL-pDrthh_0HqZ_QF0o7mi44oPhOdJTsJKEis6xoY Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 129b5343573f4f9fa648e984a68b6760 Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1554781900 Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/129b5343573f4f9fa648e984a68b6760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/129b5343573f4f9fa648e984a68b6760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/129b5343573f4f9fa648e984a68b6760"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_129b5343573f4f9fa648e984a68b6760"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1554781900 Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 129b5343573f4f9fa648e984a68b6760 Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1554781900 Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServerRescueNegativeTestJSON-1554781900-project Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: a031e94db13d4e7e8947f51abc36d629 Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1554781900-project Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 7c09b57e-7650-448b-ba76-402bdb4f9552 could not be found. Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '7c09b57e-7650-448b-ba76-402bdb4f9552'} Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c09b57e-7650-448b-ba76-402bdb4f9552 could not be found. Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c09b57e-7650-448b-ba76-402bdb4f9552 could not be found. Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:58:16.908529 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:58:16.913326 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:58:16.913326 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:16.913326 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:58:16.913326 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:58:16.913326 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:58:16.913326 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:58:16.913326 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c09b57e-7650-448b-ba76-402bdb4f9552 could not be found. Oct 05 02:58:16.913326 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:58:16.913326 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ae852d83-2849-4a95-a9ae-f9d5dc586076 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Returning 404 to user: Instance 7c09b57e-7650-448b-ba76-402bdb4f9552 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:58:16.913973 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ae852d83-2849-4a95-a9ae-f9d5dc586076 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552" status: 404 len: 111 microversion: 2.1 time: 0.097785 Oct 05 02:58:16.918909 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2809/5638] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:16 2022] GET /compute/v2.1/servers/7c09b57e-7650-448b-ba76-402bdb4f9552 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:58:16.945527 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9e094c83-91d7-44ef-9dca-516994658d09 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '.version_select at 0x7fcce433a160>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:17.034933 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9e094c83-91d7-44ef-9dca-516994658d09 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-548362238" status: 202 len: 0 microversion: 2.1 time: 0.114777 Oct 05 02:58:17.035593 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2810/5639] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 5 02:58:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-548362238 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 02:58:17.409412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6291c3a6-ce0d-4461-b9ef-008f8aa3ba88 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:17.410364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6291c3a6-ce0d-4461-b9ef-008f8aa3ba88 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] [instance: c34e85b7-df59-45a0-b132-3bf5b5f487a8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:17.416864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6291c3a6-ce0d-4461-b9ef-008f8aa3ba88 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:17.417690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6291c3a6-ce0d-4461-b9ef-008f8aa3ba88 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:17.419510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6291c3a6-ce0d-4461-b9ef-008f8aa3ba88 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:17.421066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6291c3a6-ce0d-4461-b9ef-008f8aa3ba88 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:17.421776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6291c3a6-ce0d-4461-b9ef-008f8aa3ba88 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:17.422403 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6291c3a6-ce0d-4461-b9ef-008f8aa3ba88 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:17.982164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-8780a8a4-eb4e-4303-9ef5-e2672781148f tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:58:17.984647 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-8780a8a4-eb4e-4303-9ef5-e2672781148f tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:58:17.985284 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-8780a8a4-eb4e-4303-9ef5-e2672781148f tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:58:17.985698 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-8780a8a4-eb4e-4303-9ef5-e2672781148f tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:58:17.986243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-8780a8a4-eb4e-4303-9ef5-e2672781148f tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:58:18.012801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8780a8a4-eb4e-4303-9ef5-e2672781148f tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:18.016555 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8780a8a4-eb4e-4303-9ef5-e2672781148f tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:18.016555 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8780a8a4-eb4e-4303-9ef5-e2672781148f tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:18.017402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8780a8a4-eb4e-4303-9ef5-e2672781148f tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:18.025039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8780a8a4-eb4e-4303-9ef5-e2672781148f tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:18.025543 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8780a8a4-eb4e-4303-9ef5-e2672781148f tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:18.054851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6291c3a6-ce0d-4461-b9ef-008f8aa3ba88 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ecb250db344080990dd801dacbde48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8dfc2b9fa14888ad008ee075da8170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:18.074422 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6291c3a6-ce0d-4461-b9ef-008f8aa3ba88 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] 10.222.0.16 "GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8" status: 200 len: 1274 microversion: 2.1 time: 0.668307 Oct 05 02:58:18.089726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-8780a8a4-eb4e-4303-9ef5-e2672781148f tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Getting quotas for project 259ca05c46454743a9819915d50370a7. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:58:18.097330 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2811/5640] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:17 2022] GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8 => generated 1274 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:18.103356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-8780a8a4-eb4e-4303-9ef5-e2672781148f tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Getting quotas for user 7cb038e111434aa581b9ebc7a578b196 and project 259ca05c46454743a9819915d50370a7. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:58:18.138324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8780a8a4-eb4e-4303-9ef5-e2672781148f tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:58:18.143140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8780a8a4-eb4e-4303-9ef5-e2672781148f tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 7a147a55-22e3-4d18-b263-c35766ab20bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:58:18.239554 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8780a8a4-eb4e-4303-9ef5-e2672781148f tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.938328 Oct 05 02:58:18.240733 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2830/5641] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:58:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 3940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:58:18.255663 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c9d129bb-fe2e-4355-b58b-b803d3eaedec tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:18.256562 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c9d129bb-fe2e-4355-b58b-b803d3eaedec tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 7a147a55-22e3-4d18-b263-c35766ab20bd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:18.626333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c9d129bb-fe2e-4355-b58b-b803d3eaedec tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb038e111434aa581b9ebc7a578b196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259ca05c46454743a9819915d50370a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:18.645807 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c9d129bb-fe2e-4355-b58b-b803d3eaedec tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "GET /compute/v2.1/servers/7a147a55-22e3-4d18-b263-c35766ab20bd" status: 200 len: 1213 microversion: 2.1 time: 0.395787 Oct 05 02:58:18.671954 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2812/5642] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:18 2022] GET /compute/v2.1/servers/7a147a55-22e3-4d18-b263-c35766ab20bd => generated 1213 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:19.101224 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-adc58893-16c3-444d-a1d5-88cd76497757 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:19.101892 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-adc58893-16c3-444d-a1d5-88cd76497757 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] [instance: c34e85b7-df59-45a0-b132-3bf5b5f487a8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:19.113269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-adc58893-16c3-444d-a1d5-88cd76497757 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:19.113778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-adc58893-16c3-444d-a1d5-88cd76497757 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:19.114217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-adc58893-16c3-444d-a1d5-88cd76497757 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:19.114945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-adc58893-16c3-444d-a1d5-88cd76497757 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:19.115384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-adc58893-16c3-444d-a1d5-88cd76497757 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:19.115811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-adc58893-16c3-444d-a1d5-88cd76497757 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:19.232568 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-adc58893-16c3-444d-a1d5-88cd76497757 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ecb250db344080990dd801dacbde48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8dfc2b9fa14888ad008ee075da8170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:19.260390 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-adc58893-16c3-444d-a1d5-88cd76497757 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] 10.222.0.16 "GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8" status: 200 len: 1274 microversion: 2.1 time: 0.163629 Oct 05 02:58:19.262587 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2831/5643] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:19 2022] GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8 => generated 1274 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:19.673281 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-10b05b39-2f3b-4e62-9b1e-31c7c0640474 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:19.677416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-10b05b39-2f3b-4e62-9b1e-31c7c0640474 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 7a147a55-22e3-4d18-b263-c35766ab20bd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:19.685324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10b05b39-2f3b-4e62-9b1e-31c7c0640474 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:19.686156 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10b05b39-2f3b-4e62-9b1e-31c7c0640474 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:19.687456 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10b05b39-2f3b-4e62-9b1e-31c7c0640474 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:19.688565 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10b05b39-2f3b-4e62-9b1e-31c7c0640474 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:19.689330 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10b05b39-2f3b-4e62-9b1e-31c7c0640474 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:19.689976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10b05b39-2f3b-4e62-9b1e-31c7c0640474 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:20.164159 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-10b05b39-2f3b-4e62-9b1e-31c7c0640474 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb038e111434aa581b9ebc7a578b196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259ca05c46454743a9819915d50370a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:20.176420 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-10b05b39-2f3b-4e62-9b1e-31c7c0640474 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "GET /compute/v2.1/servers/7a147a55-22e3-4d18-b263-c35766ab20bd" status: 200 len: 1265 microversion: 2.1 time: 0.509607 Oct 05 02:58:20.177845 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2813/5644] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:19 2022] GET /compute/v2.1/servers/7a147a55-22e3-4d18-b263-c35766ab20bd => generated 1265 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:20.291388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-eeca8c09-d5b9-4b71-b4f7-303252c44016 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:20.291919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-eeca8c09-d5b9-4b71-b4f7-303252c44016 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] [instance: c34e85b7-df59-45a0-b132-3bf5b5f487a8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:20.301384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eeca8c09-d5b9-4b71-b4f7-303252c44016 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:20.302422 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eeca8c09-d5b9-4b71-b4f7-303252c44016 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:20.303374 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eeca8c09-d5b9-4b71-b4f7-303252c44016 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:20.303957 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eeca8c09-d5b9-4b71-b4f7-303252c44016 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:20.304424 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eeca8c09-d5b9-4b71-b4f7-303252c44016 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:20.305078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eeca8c09-d5b9-4b71-b4f7-303252c44016 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:21.001506 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-eeca8c09-d5b9-4b71-b4f7-303252c44016 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ecb250db344080990dd801dacbde48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8dfc2b9fa14888ad008ee075da8170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:21.004705 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:58:21.043175 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-eeca8c09-d5b9-4b71-b4f7-303252c44016 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] 10.222.0.16 "GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8" status: 200 len: 1316 microversion: 2.1 time: 0.753762 Oct 05 02:58:21.044213 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2832/5645] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:20 2022] GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8 => generated 1316 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:21.201083 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c3f0a4e1-a9c4-46f7-b00a-6a18eaa10aaf tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:21.202300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c3f0a4e1-a9c4-46f7-b00a-6a18eaa10aaf tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 7a147a55-22e3-4d18-b263-c35766ab20bd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:21.212340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3f0a4e1-a9c4-46f7-b00a-6a18eaa10aaf tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:21.212988 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3f0a4e1-a9c4-46f7-b00a-6a18eaa10aaf tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:21.213508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3f0a4e1-a9c4-46f7-b00a-6a18eaa10aaf tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:21.214850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3f0a4e1-a9c4-46f7-b00a-6a18eaa10aaf tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:21.215563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3f0a4e1-a9c4-46f7-b00a-6a18eaa10aaf tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:21.216049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3f0a4e1-a9c4-46f7-b00a-6a18eaa10aaf tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:21.753324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c3f0a4e1-a9c4-46f7-b00a-6a18eaa10aaf tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb038e111434aa581b9ebc7a578b196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259ca05c46454743a9819915d50370a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:21.771086 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c3f0a4e1-a9c4-46f7-b00a-6a18eaa10aaf tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "GET /compute/v2.1/servers/7a147a55-22e3-4d18-b263-c35766ab20bd" status: 200 len: 1313 microversion: 2.1 time: 0.573384 Oct 05 02:58:21.771686 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2814/5646] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:21 2022] GET /compute/v2.1/servers/7a147a55-22e3-4d18-b263-c35766ab20bd => generated 1313 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:22.073124 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bb728344-ba42-4638-a872-22dfd7c14d5c tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:22.082521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bb728344-ba42-4638-a872-22dfd7c14d5c tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] [instance: c34e85b7-df59-45a0-b132-3bf5b5f487a8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:22.106460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bb728344-ba42-4638-a872-22dfd7c14d5c tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:22.107228 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bb728344-ba42-4638-a872-22dfd7c14d5c tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:22.107881 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bb728344-ba42-4638-a872-22dfd7c14d5c tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:22.108845 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bb728344-ba42-4638-a872-22dfd7c14d5c tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:22.109610 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bb728344-ba42-4638-a872-22dfd7c14d5c tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:22.110249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bb728344-ba42-4638-a872-22dfd7c14d5c tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:22.165613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-d8e28c20-70ce-41f1-acc3-283ca73d71a5 req-3f85cc24-1bc4-4aa8-ae20-8e47f19d29be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a147a55-22e3-4d18-b263-c35766ab20bd", "tag": "c8b149dd-69d6-49df-81f5-c264f6a7dacc"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:58:22.186084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d8e28c20-70ce-41f1-acc3-283ca73d71a5 req-3f85cc24-1bc4-4aa8-ae20-8e47f19d29be service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:22.205968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d8e28c20-70ce-41f1-acc3-283ca73d71a5 req-3f85cc24-1bc4-4aa8-ae20-8e47f19d29be service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:22.205968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d8e28c20-70ce-41f1-acc3-283ca73d71a5 req-3f85cc24-1bc4-4aa8-ae20-8e47f19d29be service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:22.226449 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-d8e28c20-70ce-41f1-acc3-283ca73d71a5 req-3f85cc24-1bc4-4aa8-ae20-8e47f19d29be service nova] Creating event network-changed:c8b149dd-69d6-49df-81f5-c264f6a7dacc for instance 7a147a55-22e3-4d18-b263-c35766ab20bd on n-h2-858272-3 Oct 05 02:58:22.233120 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-d8e28c20-70ce-41f1-acc3-283ca73d71a5 req-3f85cc24-1bc4-4aa8-ae20-8e47f19d29be service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071312 Oct 05 02:58:22.234275 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2815/5647] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:58:22.621398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bb728344-ba42-4638-a872-22dfd7c14d5c tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ecb250db344080990dd801dacbde48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8dfc2b9fa14888ad008ee075da8170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:22.646675 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bb728344-ba42-4638-a872-22dfd7c14d5c tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] 10.222.0.16 "GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8" status: 200 len: 1316 microversion: 2.1 time: 0.579775 Oct 05 02:58:22.646675 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2833/5648] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:22 2022] GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8 => generated 1316 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:22.808167 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d340171e-e034-47af-bc57-77501671d369 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:22.809367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d340171e-e034-47af-bc57-77501671d369 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 7a147a55-22e3-4d18-b263-c35766ab20bd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:22.821529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d340171e-e034-47af-bc57-77501671d369 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:22.822380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d340171e-e034-47af-bc57-77501671d369 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:22.823014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d340171e-e034-47af-bc57-77501671d369 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:22.824623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d340171e-e034-47af-bc57-77501671d369 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:22.825387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d340171e-e034-47af-bc57-77501671d369 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:22.826006 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d340171e-e034-47af-bc57-77501671d369 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:23.279123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e325a9f3-d6a7-434c-89b6-7882f32181d1 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:23.281380 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e325a9f3-d6a7-434c-89b6-7882f32181d1 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: be028745-08ea-4ddd-853f-a893d54eedc1] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:23.288627 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e325a9f3-d6a7-434c-89b6-7882f32181d1 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:23.289505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e325a9f3-d6a7-434c-89b6-7882f32181d1 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:23.290551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e325a9f3-d6a7-434c-89b6-7882f32181d1 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:23.291488 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e325a9f3-d6a7-434c-89b6-7882f32181d1 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:23.292170 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e325a9f3-d6a7-434c-89b6-7882f32181d1 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:23.293086 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e325a9f3-d6a7-434c-89b6-7882f32181d1 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:23.295682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d340171e-e034-47af-bc57-77501671d369 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb038e111434aa581b9ebc7a578b196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259ca05c46454743a9819915d50370a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:23.316558 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d340171e-e034-47af-bc57-77501671d369 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "GET /compute/v2.1/servers/7a147a55-22e3-4d18-b263-c35766ab20bd" status: 200 len: 1313 microversion: 2.1 time: 0.520992 Oct 05 02:58:23.334813 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2816/5649] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:22 2022] GET /compute/v2.1/servers/7a147a55-22e3-4d18-b263-c35766ab20bd => generated 1313 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:23.345384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e325a9f3-d6a7-434c-89b6-7882f32181d1 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: be028745-08ea-4ddd-853f-a893d54eedc1] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:58:23.479093 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e325a9f3-d6a7-434c-89b6-7882f32181d1 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "DELETE /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1" status: 204 len: 0 microversion: 2.1 time: 0.202692 Oct 05 02:58:23.481210 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2834/5650] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:58:23 2022] DELETE /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 02:58:23.492966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-eeaf58ce-974c-448e-bc48-aec708321b2a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:23.493589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-eeaf58ce-974c-448e-bc48-aec708321b2a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: be028745-08ea-4ddd-853f-a893d54eedc1] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:23.501663 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eeaf58ce-974c-448e-bc48-aec708321b2a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:23.502649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eeaf58ce-974c-448e-bc48-aec708321b2a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:23.503847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eeaf58ce-974c-448e-bc48-aec708321b2a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:23.504721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eeaf58ce-974c-448e-bc48-aec708321b2a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:23.505352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eeaf58ce-974c-448e-bc48-aec708321b2a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:23.505927 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eeaf58ce-974c-448e-bc48-aec708321b2a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:23.637329 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-35aea9af-a2be-43e4-a268-617a2896c71c req-fb00e5b8-31d4-4a42-a51f-39ac19fde6df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c34e85b7-df59-45a0-b132-3bf5b5f487a8", "tag": "8a8f2340-f928-4758-a5cf-271d4cf2f7d4"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:58:23.648625 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-35aea9af-a2be-43e4-a268-617a2896c71c req-fb00e5b8-31d4-4a42-a51f-39ac19fde6df service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:23.649735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-35aea9af-a2be-43e4-a268-617a2896c71c req-fb00e5b8-31d4-4a42-a51f-39ac19fde6df service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:23.650540 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-35aea9af-a2be-43e4-a268-617a2896c71c req-fb00e5b8-31d4-4a42-a51f-39ac19fde6df service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:23.676661 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-35aea9af-a2be-43e4-a268-617a2896c71c req-fb00e5b8-31d4-4a42-a51f-39ac19fde6df service nova] Creating event network-changed:8a8f2340-f928-4758-a5cf-271d4cf2f7d4 for instance c34e85b7-df59-45a0-b132-3bf5b5f487a8 on n-h1-858272-3 Oct 05 02:58:23.682697 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-35aea9af-a2be-43e4-a268-617a2896c71c req-fb00e5b8-31d4-4a42-a51f-39ac19fde6df service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049826 Oct 05 02:58:23.683904 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2835/5651] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:58:23.691535 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8ba24466-c35f-49af-bb06-616f3ce61f08 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:23.692462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8ba24466-c35f-49af-bb06-616f3ce61f08 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] [instance: c34e85b7-df59-45a0-b132-3bf5b5f487a8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:23.700052 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ba24466-c35f-49af-bb06-616f3ce61f08 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:23.700873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ba24466-c35f-49af-bb06-616f3ce61f08 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:23.701566 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ba24466-c35f-49af-bb06-616f3ce61f08 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:23.702669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ba24466-c35f-49af-bb06-616f3ce61f08 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:23.703340 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ba24466-c35f-49af-bb06-616f3ce61f08 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:23.703976 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ba24466-c35f-49af-bb06-616f3ce61f08 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:23.919329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-eeaf58ce-974c-448e-bc48-aec708321b2a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de963cdc932941c7bac32406ee190634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6345a777ff224f558120171bee710f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:23.932170 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-eeaf58ce-974c-448e-bc48-aec708321b2a tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1" status: 200 len: 1513 microversion: 2.1 time: 0.445089 Oct 05 02:58:23.949006 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2817/5652] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:23 2022] GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1 => generated 1513 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:23.992354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8ba24466-c35f-49af-bb06-616f3ce61f08 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ecb250db344080990dd801dacbde48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8dfc2b9fa14888ad008ee075da8170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:24.013793 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8ba24466-c35f-49af-bb06-616f3ce61f08 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] 10.222.0.16 "GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8" status: 200 len: 1316 microversion: 2.1 time: 0.327884 Oct 05 02:58:24.016555 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2836/5653] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:23 2022] GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8 => generated 1316 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:24.342466 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-31ccf193-9c84-4dfd-bc04-c10a930953f6 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:24.343939 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-31ccf193-9c84-4dfd-bc04-c10a930953f6 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 7a147a55-22e3-4d18-b263-c35766ab20bd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:24.351433 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-31ccf193-9c84-4dfd-bc04-c10a930953f6 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:24.352149 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-31ccf193-9c84-4dfd-bc04-c10a930953f6 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:24.352759 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-31ccf193-9c84-4dfd-bc04-c10a930953f6 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:24.353891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-31ccf193-9c84-4dfd-bc04-c10a930953f6 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:24.354503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-31ccf193-9c84-4dfd-bc04-c10a930953f6 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:24.355081 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-31ccf193-9c84-4dfd-bc04-c10a930953f6 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:24.656668 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-31ccf193-9c84-4dfd-bc04-c10a930953f6 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb038e111434aa581b9ebc7a578b196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259ca05c46454743a9819915d50370a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:24.678451 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-31ccf193-9c84-4dfd-bc04-c10a930953f6 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "GET /compute/v2.1/servers/7a147a55-22e3-4d18-b263-c35766ab20bd" status: 200 len: 1313 microversion: 2.1 time: 0.339734 Oct 05 02:58:24.693357 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2818/5654] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:24 2022] GET /compute/v2.1/servers/7a147a55-22e3-4d18-b263-c35766ab20bd => generated 1313 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:24.960093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-24c5f017-b23e-494a-94df-2096a1d407b1 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:24.961394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-24c5f017-b23e-494a-94df-2096a1d407b1 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: be028745-08ea-4ddd-853f-a893d54eedc1] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:24.981530 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-24c5f017-b23e-494a-94df-2096a1d407b1 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:24.982322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-24c5f017-b23e-494a-94df-2096a1d407b1 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:24.982958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-24c5f017-b23e-494a-94df-2096a1d407b1 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:24.984410 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-24c5f017-b23e-494a-94df-2096a1d407b1 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:24.985299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-24c5f017-b23e-494a-94df-2096a1d407b1 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:24.985902 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-24c5f017-b23e-494a-94df-2096a1d407b1 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:25.047632 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a801e6cb-c49c-4a07-9bdc-1a6bede5830b tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:25.048376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a801e6cb-c49c-4a07-9bdc-1a6bede5830b tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] [instance: c34e85b7-df59-45a0-b132-3bf5b5f487a8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:25.061865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a801e6cb-c49c-4a07-9bdc-1a6bede5830b tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:25.068528 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a801e6cb-c49c-4a07-9bdc-1a6bede5830b tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:25.069416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a801e6cb-c49c-4a07-9bdc-1a6bede5830b tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:25.070404 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a801e6cb-c49c-4a07-9bdc-1a6bede5830b tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:25.071099 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a801e6cb-c49c-4a07-9bdc-1a6bede5830b tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:25.071730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a801e6cb-c49c-4a07-9bdc-1a6bede5830b tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:25.930301 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-24c5f017-b23e-494a-94df-2096a1d407b1 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de963cdc932941c7bac32406ee190634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6345a777ff224f558120171bee710f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:25.940310 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-24c5f017-b23e-494a-94df-2096a1d407b1 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1" status: 200 len: 1513 microversion: 2.1 time: 0.984220 Oct 05 02:58:25.955302 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2837/5655] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:24 2022] GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1 => generated 1513 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:25.964539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-691ead9a-698b-4d28-9b3a-b0eada748885 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:25.966117 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-691ead9a-698b-4d28-9b3a-b0eada748885 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 7a147a55-22e3-4d18-b263-c35766ab20bd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:25.974527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-691ead9a-698b-4d28-9b3a-b0eada748885 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:25.975348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-691ead9a-698b-4d28-9b3a-b0eada748885 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:25.976168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-691ead9a-698b-4d28-9b3a-b0eada748885 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:25.977129 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-691ead9a-698b-4d28-9b3a-b0eada748885 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:25.977743 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-691ead9a-698b-4d28-9b3a-b0eada748885 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:25.978342 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-691ead9a-698b-4d28-9b3a-b0eada748885 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:26.049941 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a801e6cb-c49c-4a07-9bdc-1a6bede5830b tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ecb250db344080990dd801dacbde48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8dfc2b9fa14888ad008ee075da8170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:26.058253 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a801e6cb-c49c-4a07-9bdc-1a6bede5830b tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] 10.222.0.16 "GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8" status: 200 len: 1316 microversion: 2.1 time: 1.016690 Oct 05 02:58:26.059164 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2819/5656] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:25 2022] GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8 => generated 1316 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:26.666109 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-691ead9a-698b-4d28-9b3a-b0eada748885 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb038e111434aa581b9ebc7a578b196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259ca05c46454743a9819915d50370a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:26.678041 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-691ead9a-698b-4d28-9b3a-b0eada748885 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "GET /compute/v2.1/servers/7a147a55-22e3-4d18-b263-c35766ab20bd" status: 200 len: 1313 microversion: 2.1 time: 0.721230 Oct 05 02:58:26.683807 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2838/5657] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:25 2022] GET /compute/v2.1/servers/7a147a55-22e3-4d18-b263-c35766ab20bd => generated 1313 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:26.968415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-396eeed0-d10b-4ba5-aa53-4317efefdd92 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:26.970092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-396eeed0-d10b-4ba5-aa53-4317efefdd92 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: be028745-08ea-4ddd-853f-a893d54eedc1] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:26.984713 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-396eeed0-d10b-4ba5-aa53-4317efefdd92 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:26.987547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-396eeed0-d10b-4ba5-aa53-4317efefdd92 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:26.989691 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-396eeed0-d10b-4ba5-aa53-4317efefdd92 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:26.992745 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-396eeed0-d10b-4ba5-aa53-4317efefdd92 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:26.993381 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-396eeed0-d10b-4ba5-aa53-4317efefdd92 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:26.993915 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-396eeed0-d10b-4ba5-aa53-4317efefdd92 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:27.082088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4e0be764-db73-42b0-8215-17188951b5c5 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:27.082950 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4e0be764-db73-42b0-8215-17188951b5c5 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] [instance: c34e85b7-df59-45a0-b132-3bf5b5f487a8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:27.097663 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e0be764-db73-42b0-8215-17188951b5c5 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:27.099011 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e0be764-db73-42b0-8215-17188951b5c5 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:27.101157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e0be764-db73-42b0-8215-17188951b5c5 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:27.102235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e0be764-db73-42b0-8215-17188951b5c5 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:27.104358 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e0be764-db73-42b0-8215-17188951b5c5 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:27.105549 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e0be764-db73-42b0-8215-17188951b5c5 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:27.565816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-396eeed0-d10b-4ba5-aa53-4317efefdd92 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de963cdc932941c7bac32406ee190634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6345a777ff224f558120171bee710f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:27.575985 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-396eeed0-d10b-4ba5-aa53-4317efefdd92 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1" status: 200 len: 1513 microversion: 2.1 time: 0.611732 Oct 05 02:58:27.577300 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2820/5658] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:26 2022] GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1 => generated 1513 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:27.621468 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4e0be764-db73-42b0-8215-17188951b5c5 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ecb250db344080990dd801dacbde48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8dfc2b9fa14888ad008ee075da8170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:27.632447 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4e0be764-db73-42b0-8215-17188951b5c5 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] 10.222.0.16 "GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8" status: 200 len: 1316 microversion: 2.1 time: 0.554571 Oct 05 02:58:27.633341 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2839/5659] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:27 2022] GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8 => generated 1316 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:58:27.714885 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2a85ff73-3820-4c15-b847-fc85dd7e7928 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:27.716153 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2a85ff73-3820-4c15-b847-fc85dd7e7928 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 7a147a55-22e3-4d18-b263-c35766ab20bd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:27.729540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2a85ff73-3820-4c15-b847-fc85dd7e7928 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:27.731349 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2a85ff73-3820-4c15-b847-fc85dd7e7928 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:27.733346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2a85ff73-3820-4c15-b847-fc85dd7e7928 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:27.734807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2a85ff73-3820-4c15-b847-fc85dd7e7928 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:27.735690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2a85ff73-3820-4c15-b847-fc85dd7e7928 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:27.736378 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2a85ff73-3820-4c15-b847-fc85dd7e7928 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:27.785525 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:58:28.312407 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2a85ff73-3820-4c15-b847-fc85dd7e7928 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb038e111434aa581b9ebc7a578b196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259ca05c46454743a9819915d50370a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:28.344160 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2a85ff73-3820-4c15-b847-fc85dd7e7928 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "GET /compute/v2.1/servers/7a147a55-22e3-4d18-b263-c35766ab20bd" status: 200 len: 1313 microversion: 2.1 time: 0.632160 Oct 05 02:58:28.346589 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2821/5660] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:27 2022] GET /compute/v2.1/servers/7a147a55-22e3-4d18-b263-c35766ab20bd => generated 1313 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:28.604608 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a851c6d5-b2e2-40c7-8aea-6e12d2b3af14 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:28.606055 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a851c6d5-b2e2-40c7-8aea-6e12d2b3af14 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: be028745-08ea-4ddd-853f-a893d54eedc1] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:28.615318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=4 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:58:28.619022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=16 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:58:28.622130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a851c6d5-b2e2-40c7-8aea-6e12d2b3af14 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:28.622994 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a851c6d5-b2e2-40c7-8aea-6e12d2b3af14 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:28.623608 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a851c6d5-b2e2-40c7-8aea-6e12d2b3af14 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:28.625086 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a851c6d5-b2e2-40c7-8aea-6e12d2b3af14 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:28.625764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a851c6d5-b2e2-40c7-8aea-6e12d2b3af14 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:28.626350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a851c6d5-b2e2-40c7-8aea-6e12d2b3af14 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:28.656523 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ed57c9c1-8fb7-41de-ae10-41becf4829dc tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:28.657800 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ed57c9c1-8fb7-41de-ae10-41becf4829dc tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] [instance: c34e85b7-df59-45a0-b132-3bf5b5f487a8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:28.671309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:58:28.673524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed57c9c1-8fb7-41de-ae10-41becf4829dc tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:28.680958 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed57c9c1-8fb7-41de-ae10-41becf4829dc tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:28.684115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed57c9c1-8fb7-41de-ae10-41becf4829dc tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:28.686866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed57c9c1-8fb7-41de-ae10-41becf4829dc tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:28.690792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed57c9c1-8fb7-41de-ae10-41becf4829dc tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:28.693382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed57c9c1-8fb7-41de-ae10-41becf4829dc tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:28.758483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a851c6d5-b2e2-40c7-8aea-6e12d2b3af14 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de963cdc932941c7bac32406ee190634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6345a777ff224f558120171bee710f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:28.771343 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a851c6d5-b2e2-40c7-8aea-6e12d2b3af14 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1" status: 200 len: 1471 microversion: 2.1 time: 0.167355 Oct 05 02:58:28.772506 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2840/5661] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:28 2022] GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1 => generated 1471 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:28.785353 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-7389002e-489e-4acc-97aa-fc4765288abf req-892f5e22-25a3-4a3b-bebe-c7c48ccf3e78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be028745-08ea-4ddd-853f-a893d54eedc1", "name": "network-vif-deleted", "tag": "9bc3a128-0ee4-4202-a229-c52dff78eff5"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:58:28.820355 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7389002e-489e-4acc-97aa-fc4765288abf req-892f5e22-25a3-4a3b-bebe-c7c48ccf3e78 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:28.821186 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7389002e-489e-4acc-97aa-fc4765288abf req-892f5e22-25a3-4a3b-bebe-c7c48ccf3e78 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:28.821805 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7389002e-489e-4acc-97aa-fc4765288abf req-892f5e22-25a3-4a3b-bebe-c7c48ccf3e78 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:28.845391 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-7389002e-489e-4acc-97aa-fc4765288abf req-892f5e22-25a3-4a3b-bebe-c7c48ccf3e78 service nova] Creating event network-vif-deleted:9bc3a128-0ee4-4202-a229-c52dff78eff5 for instance be028745-08ea-4ddd-853f-a893d54eedc1 on n-h1-858272-3 Oct 05 02:58:28.865166 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-7389002e-489e-4acc-97aa-fc4765288abf req-892f5e22-25a3-4a3b-bebe-c7c48ccf3e78 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080561 Oct 05 02:58:28.866267 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2841/5662] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:58:29.171544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ed57c9c1-8fb7-41de-ae10-41becf4829dc tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ecb250db344080990dd801dacbde48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8dfc2b9fa14888ad008ee075da8170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:29.183025 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ed57c9c1-8fb7-41de-ae10-41becf4829dc tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] 10.222.0.16 "GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8" status: 200 len: 1316 microversion: 2.1 time: 0.531167 Oct 05 02:58:29.184740 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2822/5663] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:28 2022] GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8 => generated 1316 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:58:29.376457 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-36c6d629-97c3-4039-9b24-837afbf0db27 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:29.382331 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-36c6d629-97c3-4039-9b24-837afbf0db27 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 7a147a55-22e3-4d18-b263-c35766ab20bd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:29.397367 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36c6d629-97c3-4039-9b24-837afbf0db27 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:29.398836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36c6d629-97c3-4039-9b24-837afbf0db27 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:29.400784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36c6d629-97c3-4039-9b24-837afbf0db27 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:29.401865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36c6d629-97c3-4039-9b24-837afbf0db27 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:29.404889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36c6d629-97c3-4039-9b24-837afbf0db27 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:29.408122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36c6d629-97c3-4039-9b24-837afbf0db27 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:29.722459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-36c6d629-97c3-4039-9b24-837afbf0db27 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb038e111434aa581b9ebc7a578b196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259ca05c46454743a9819915d50370a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:29.741084 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-36c6d629-97c3-4039-9b24-837afbf0db27 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "GET /compute/v2.1/servers/7a147a55-22e3-4d18-b263-c35766ab20bd" status: 200 len: 1313 microversion: 2.1 time: 0.373160 Oct 05 02:58:29.745387 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2842/5664] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:29 2022] GET /compute/v2.1/servers/7a147a55-22e3-4d18-b263-c35766ab20bd => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:29.802690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ad0b8496-3539-4ee8-a40d-21cbed75616b tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:29.803865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ad0b8496-3539-4ee8-a40d-21cbed75616b tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: be028745-08ea-4ddd-853f-a893d54eedc1] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:29.815854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad0b8496-3539-4ee8-a40d-21cbed75616b tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:29.825652 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad0b8496-3539-4ee8-a40d-21cbed75616b tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:29.826324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad0b8496-3539-4ee8-a40d-21cbed75616b tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:29.831283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad0b8496-3539-4ee8-a40d-21cbed75616b tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:29.831943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad0b8496-3539-4ee8-a40d-21cbed75616b tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:29.832531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad0b8496-3539-4ee8-a40d-21cbed75616b tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:29.849364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9d98f054-f5c3-40dd-8c45-1874795d9757 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:29.850453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9d98f054-f5c3-40dd-8c45-1874795d9757 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:29.861259 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d98f054-f5c3-40dd-8c45-1874795d9757 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:29.862038 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d98f054-f5c3-40dd-8c45-1874795d9757 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:29.863227 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d98f054-f5c3-40dd-8c45-1874795d9757 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:29.864133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d98f054-f5c3-40dd-8c45-1874795d9757 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:29.864750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d98f054-f5c3-40dd-8c45-1874795d9757 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:29.865367 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d98f054-f5c3-40dd-8c45-1874795d9757 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:29.893227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad0b8496-3539-4ee8-a40d-21cbed75616b tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:29.893715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad0b8496-3539-4ee8-a40d-21cbed75616b tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:29.894174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad0b8496-3539-4ee8-a40d-21cbed75616b tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:29.894635 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-ad0b8496-3539-4ee8-a40d-21cbed75616b tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lazy-loading 'fault' on Instance uuid be028745-08ea-4ddd-853f-a893d54eedc1 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:58:29.896654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9d98f054-f5c3-40dd-8c45-1874795d9757 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:58:29.993410 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ad0b8496-3539-4ee8-a40d-21cbed75616b tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de963cdc932941c7bac32406ee190634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6345a777ff224f558120171bee710f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:30.006917 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ad0b8496-3539-4ee8-a40d-21cbed75616b tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1" status: 200 len: 1308 microversion: 2.1 time: 0.207675 Oct 05 02:58:30.025519 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2823/5665] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:29 2022] GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1 => generated 1308 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:30.057799 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9d98f054-f5c3-40dd-8c45-1874795d9757 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 204 len: 0 microversion: 2.1 time: 0.208916 Oct 05 02:58:30.059233 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2843/5666] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:58:29 2022] DELETE /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 02:58:30.069180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a223bffd-714b-4d17-aa96-33d51eae178b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:30.070098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a223bffd-714b-4d17-aa96-33d51eae178b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:30.080436 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a223bffd-714b-4d17-aa96-33d51eae178b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:30.081340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a223bffd-714b-4d17-aa96-33d51eae178b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:30.082671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a223bffd-714b-4d17-aa96-33d51eae178b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:30.084251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a223bffd-714b-4d17-aa96-33d51eae178b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:30.096891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a223bffd-714b-4d17-aa96-33d51eae178b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:30.097391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a223bffd-714b-4d17-aa96-33d51eae178b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:30.208308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7f2b688d-9f67-4705-aa10-12a1e02ee522 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:30.209601 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7f2b688d-9f67-4705-aa10-12a1e02ee522 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] [instance: c34e85b7-df59-45a0-b132-3bf5b5f487a8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:30.221561 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f2b688d-9f67-4705-aa10-12a1e02ee522 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:30.224404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f2b688d-9f67-4705-aa10-12a1e02ee522 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:30.232609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f2b688d-9f67-4705-aa10-12a1e02ee522 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:30.233704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f2b688d-9f67-4705-aa10-12a1e02ee522 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:30.235483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f2b688d-9f67-4705-aa10-12a1e02ee522 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:30.237622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f2b688d-9f67-4705-aa10-12a1e02ee522 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:30.424730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a223bffd-714b-4d17-aa96-33d51eae178b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:30.435183 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a223bffd-714b-4d17-aa96-33d51eae178b tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1506 microversion: 2.1 time: 0.370115 Oct 05 02:58:30.444452 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2824/5667] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:30 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1506 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:30.489121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7f2b688d-9f67-4705-aa10-12a1e02ee522 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ecb250db344080990dd801dacbde48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8dfc2b9fa14888ad008ee075da8170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:30.497811 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7f2b688d-9f67-4705-aa10-12a1e02ee522 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] 10.222.0.16 "GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8" status: 200 len: 1316 microversion: 2.1 time: 0.293937 Oct 05 02:58:30.502881 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2844/5668] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:30 2022] GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8 => generated 1316 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:58:30.782780 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cd471d82-d18f-4f43-a529-aba6a43ef2fd tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:30.783681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cd471d82-d18f-4f43-a529-aba6a43ef2fd tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 7a147a55-22e3-4d18-b263-c35766ab20bd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:30.793371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd471d82-d18f-4f43-a529-aba6a43ef2fd tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:30.793878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd471d82-d18f-4f43-a529-aba6a43ef2fd tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:30.794969 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd471d82-d18f-4f43-a529-aba6a43ef2fd tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:30.800292 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd471d82-d18f-4f43-a529-aba6a43ef2fd tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:30.803434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd471d82-d18f-4f43-a529-aba6a43ef2fd tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:30.805811 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd471d82-d18f-4f43-a529-aba6a43ef2fd tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:31.218455 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-524ccec3-ed61-4a5e-adbd-a516b02439b8 req-41af72af-cf96-4a83-92a1-b7cf5b41fe31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a147a55-22e3-4d18-b263-c35766ab20bd", "name": "network-vif-plugged", "status": "completed", "tag": "c8b149dd-69d6-49df-81f5-c264f6a7dacc"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:58:31.228944 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-524ccec3-ed61-4a5e-adbd-a516b02439b8 req-41af72af-cf96-4a83-92a1-b7cf5b41fe31 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:31.229565 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cd471d82-d18f-4f43-a529-aba6a43ef2fd tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb038e111434aa581b9ebc7a578b196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259ca05c46454743a9819915d50370a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:31.229802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-524ccec3-ed61-4a5e-adbd-a516b02439b8 req-41af72af-cf96-4a83-92a1-b7cf5b41fe31 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:31.230501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-524ccec3-ed61-4a5e-adbd-a516b02439b8 req-41af72af-cf96-4a83-92a1-b7cf5b41fe31 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:31.244402 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-524ccec3-ed61-4a5e-adbd-a516b02439b8 req-41af72af-cf96-4a83-92a1-b7cf5b41fe31 service nova] Creating event network-vif-plugged:c8b149dd-69d6-49df-81f5-c264f6a7dacc for instance 7a147a55-22e3-4d18-b263-c35766ab20bd on n-h2-858272-3 Oct 05 02:58:31.250401 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-524ccec3-ed61-4a5e-adbd-a516b02439b8 req-41af72af-cf96-4a83-92a1-b7cf5b41fe31 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.238304 Oct 05 02:58:31.251872 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2845/5669] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:58:31.258333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-12cef62c-9882-4236-8f7a-fd4db3204c08 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:31.258524 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cd471d82-d18f-4f43-a529-aba6a43ef2fd tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "GET /compute/v2.1/servers/7a147a55-22e3-4d18-b263-c35766ab20bd" status: 200 len: 1313 microversion: 2.1 time: 0.494410 Oct 05 02:58:31.263040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-12cef62c-9882-4236-8f7a-fd4db3204c08 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: be028745-08ea-4ddd-853f-a893d54eedc1] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:31.272957 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12cef62c-9882-4236-8f7a-fd4db3204c08 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:31.273760 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12cef62c-9882-4236-8f7a-fd4db3204c08 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:31.274462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12cef62c-9882-4236-8f7a-fd4db3204c08 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:31.275467 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12cef62c-9882-4236-8f7a-fd4db3204c08 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:31.276247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12cef62c-9882-4236-8f7a-fd4db3204c08 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:31.276840 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12cef62c-9882-4236-8f7a-fd4db3204c08 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:31.279214 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2825/5670] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:30 2022] GET /compute/v2.1/servers/7a147a55-22e3-4d18-b263-c35766ab20bd => generated 1313 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:31.331525 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12cef62c-9882-4236-8f7a-fd4db3204c08 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:31.332662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12cef62c-9882-4236-8f7a-fd4db3204c08 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:31.333315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12cef62c-9882-4236-8f7a-fd4db3204c08 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:31.334853 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-12cef62c-9882-4236-8f7a-fd4db3204c08 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lazy-loading 'fault' on Instance uuid be028745-08ea-4ddd-853f-a893d54eedc1 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:58:31.400162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-12cef62c-9882-4236-8f7a-fd4db3204c08 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de963cdc932941c7bac32406ee190634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6345a777ff224f558120171bee710f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:31.420628 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-12cef62c-9882-4236-8f7a-fd4db3204c08 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1" status: 200 len: 1308 microversion: 2.1 time: 0.166807 Oct 05 02:58:31.441206 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2846/5671] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:31 2022] GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1 => generated 1308 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:31.471928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-adf1a781-329d-42b8-b671-b2c6f15abfba tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:31.472930 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-adf1a781-329d-42b8-b671-b2c6f15abfba tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:31.484411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-adf1a781-329d-42b8-b671-b2c6f15abfba tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:31.488145 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-adf1a781-329d-42b8-b671-b2c6f15abfba tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:31.488603 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-adf1a781-329d-42b8-b671-b2c6f15abfba tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:31.489551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-adf1a781-329d-42b8-b671-b2c6f15abfba tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:31.490587 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-adf1a781-329d-42b8-b671-b2c6f15abfba tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:31.491205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-adf1a781-329d-42b8-b671-b2c6f15abfba tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:31.531186 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4d188245-46c4-4e9e-9f1e-805fc339167c tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:31.531996 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4d188245-46c4-4e9e-9f1e-805fc339167c tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] [instance: c34e85b7-df59-45a0-b132-3bf5b5f487a8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:31.549747 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d188245-46c4-4e9e-9f1e-805fc339167c tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:31.552773 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d188245-46c4-4e9e-9f1e-805fc339167c tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:31.553387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d188245-46c4-4e9e-9f1e-805fc339167c tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:31.554268 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d188245-46c4-4e9e-9f1e-805fc339167c tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:31.556711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d188245-46c4-4e9e-9f1e-805fc339167c tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:31.557826 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d188245-46c4-4e9e-9f1e-805fc339167c tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:32.019213 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-adf1a781-329d-42b8-b671-b2c6f15abfba tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:32.029861 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-adf1a781-329d-42b8-b671-b2c6f15abfba tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1506 microversion: 2.1 time: 0.562522 Oct 05 02:58:32.030931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4d188245-46c4-4e9e-9f1e-805fc339167c tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ecb250db344080990dd801dacbde48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8dfc2b9fa14888ad008ee075da8170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:32.034492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:58:32.042553 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2826/5672] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:31 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1506 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:32.048094 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4d188245-46c4-4e9e-9f1e-805fc339167c tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] 10.222.0.16 "GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8" status: 200 len: 1316 microversion: 2.1 time: 0.522120 Oct 05 02:58:32.049342 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2847/5673] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:31 2022] GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8 => generated 1316 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:32.288061 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-86f418d1-8ab7-443b-b705-bb8426a7596e tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:32.289795 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-86f418d1-8ab7-443b-b705-bb8426a7596e tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 7a147a55-22e3-4d18-b263-c35766ab20bd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:32.300155 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-86f418d1-8ab7-443b-b705-bb8426a7596e tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:32.323000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-86f418d1-8ab7-443b-b705-bb8426a7596e tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:32.323943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-86f418d1-8ab7-443b-b705-bb8426a7596e tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:32.325087 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-86f418d1-8ab7-443b-b705-bb8426a7596e tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:32.325989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-86f418d1-8ab7-443b-b705-bb8426a7596e tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:32.326689 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-86f418d1-8ab7-443b-b705-bb8426a7596e tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:32.448913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cdc48b06-e49f-4e54-b4a7-5b465e0acf32 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:32.449629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cdc48b06-e49f-4e54-b4a7-5b465e0acf32 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] [instance: be028745-08ea-4ddd-853f-a893d54eedc1] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:32.469761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdc48b06-e49f-4e54-b4a7-5b465e0acf32 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:32.470270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdc48b06-e49f-4e54-b4a7-5b465e0acf32 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:32.470715 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdc48b06-e49f-4e54-b4a7-5b465e0acf32 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:32.472380 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdc48b06-e49f-4e54-b4a7-5b465e0acf32 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:32.472988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdc48b06-e49f-4e54-b4a7-5b465e0acf32 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:32.474930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdc48b06-e49f-4e54-b4a7-5b465e0acf32 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:32.514783 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-cdc48b06-e49f-4e54-b4a7-5b465e0acf32 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] HTTP exception thrown: Instance be028745-08ea-4ddd-853f-a893d54eedc1 could not be found. Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cdc48b06-e49f-4e54-b4a7-5b465e0acf32 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Request method failure captured: Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1 HTTP/1.1 Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPH3yp5it_aX5p8uGQ0JheGFWY3hVGXHcWfqsWMUKy3tqdp7QmPWFGXX0miN3R7G8apJNPXF_eJTABKQo0gmEMT4-sOtI59-L-mDckEPnMweYpg1PI8Uasc_GtW26YYubE5MMT7Nmirv_vjJ8B7UlQk0QPjrsyHR-vVtHqDsbN3M8Wg Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 6345a777ff224f558120171bee710f6a Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-VolumesSnapshotTestJSON-541121951 Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6345a777ff224f558120171bee710f6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6345a777ff224f558120171bee710f6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6345a777ff224f558120171bee710f6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6345a777ff224f558120171bee710f6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-VolumesSnapshotTestJSON-541121951 Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 6345a777ff224f558120171bee710f6a Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-541121951 Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-VolumesSnapshotTestJSON-541121951-project Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: de963cdc932941c7bac32406ee190634 Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-VolumesSnapshotTestJSON-541121951-project Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance be028745-08ea-4ddd-853f-a893d54eedc1 could not be found. Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'be028745-08ea-4ddd-853f-a893d54eedc1'} Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be028745-08ea-4ddd-853f-a893d54eedc1 could not be found. Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be028745-08ea-4ddd-853f-a893d54eedc1 could not be found. Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:58:32.519124 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:32.523989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:32.523989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:58:32.523989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:58:32.523989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:58:32.523989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:58:32.523989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be028745-08ea-4ddd-853f-a893d54eedc1 could not be found. Oct 05 02:58:32.523989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:32.523989 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cdc48b06-e49f-4e54-b4a7-5b465e0acf32 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] Returning 404 to user: Instance be028745-08ea-4ddd-853f-a893d54eedc1 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:58:32.523989 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cdc48b06-e49f-4e54-b4a7-5b465e0acf32 tempest-VolumesSnapshotTestJSON-541121951 tempest-VolumesSnapshotTestJSON-541121951-project] 10.222.0.16 "GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1" status: 404 len: 111 microversion: 2.1 time: 0.077208 Oct 05 02:58:32.523989 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2848/5674] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:32 2022] GET /compute/v2.1/servers/be028745-08ea-4ddd-853f-a893d54eedc1 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:58:32.541152 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-9d54bdd8-20a7-4146-b724-3bbb180ac5df req-5bec7e97-ab52-43f9-82f2-985370a10b75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3551a7d0-74d1-41e5-9cb9-252aeb256b95", "name": "network-vif-deleted", "tag": "f45eaf3b-7876-4462-b755-dff2d9fa8a45"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:58:32.567254 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9d54bdd8-20a7-4146-b724-3bbb180ac5df req-5bec7e97-ab52-43f9-82f2-985370a10b75 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:32.568057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9d54bdd8-20a7-4146-b724-3bbb180ac5df req-5bec7e97-ab52-43f9-82f2-985370a10b75 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:32.568865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9d54bdd8-20a7-4146-b724-3bbb180ac5df req-5bec7e97-ab52-43f9-82f2-985370a10b75 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:32.584589 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-9d54bdd8-20a7-4146-b724-3bbb180ac5df req-5bec7e97-ab52-43f9-82f2-985370a10b75 service nova] Creating event network-vif-deleted:f45eaf3b-7876-4462-b755-dff2d9fa8a45 for instance 3551a7d0-74d1-41e5-9cb9-252aeb256b95 on n-h2-858272-3 Oct 05 02:58:32.603984 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-9d54bdd8-20a7-4146-b724-3bbb180ac5df req-5bec7e97-ab52-43f9-82f2-985370a10b75 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078827 Oct 05 02:58:32.604606 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2849/5675] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:58:33.063162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cf67de57-56a8-4cd3-a590-7f3568fb2545 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:33.063885 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cf67de57-56a8-4cd3-a590-7f3568fb2545 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:33.088167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf67de57-56a8-4cd3-a590-7f3568fb2545 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:33.090067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf67de57-56a8-4cd3-a590-7f3568fb2545 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:33.092269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf67de57-56a8-4cd3-a590-7f3568fb2545 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:33.093841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf67de57-56a8-4cd3-a590-7f3568fb2545 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:33.099660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf67de57-56a8-4cd3-a590-7f3568fb2545 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:33.100429 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf67de57-56a8-4cd3-a590-7f3568fb2545 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:33.207498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf67de57-56a8-4cd3-a590-7f3568fb2545 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:33.210848 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf67de57-56a8-4cd3-a590-7f3568fb2545 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:33.211419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cf67de57-56a8-4cd3-a590-7f3568fb2545 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:33.211958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-cf67de57-56a8-4cd3-a590-7f3568fb2545 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lazy-loading 'fault' on Instance uuid 3551a7d0-74d1-41e5-9cb9-252aeb256b95 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:58:33.355600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cf67de57-56a8-4cd3-a590-7f3568fb2545 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:33.370732 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cf67de57-56a8-4cd3-a590-7f3568fb2545 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 200 len: 1311 microversion: 2.1 time: 0.314445 Oct 05 02:58:33.374917 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2850/5676] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:33 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 1311 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:33.387100 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-df52447d-dc83-49fc-b2e2-5434ad186712 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:33.388629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-df52447d-dc83-49fc-b2e2-5434ad186712 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] [instance: c34e85b7-df59-45a0-b132-3bf5b5f487a8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:33.399019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:58:33.412875 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-df52447d-dc83-49fc-b2e2-5434ad186712 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:33.416187 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-df52447d-dc83-49fc-b2e2-5434ad186712 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:33.417235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-df52447d-dc83-49fc-b2e2-5434ad186712 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:33.418533 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-df52447d-dc83-49fc-b2e2-5434ad186712 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:33.419169 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-df52447d-dc83-49fc-b2e2-5434ad186712 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:33.420234 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-df52447d-dc83-49fc-b2e2-5434ad186712 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:33.784321 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-86f418d1-8ab7-443b-b705-bb8426a7596e tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb038e111434aa581b9ebc7a578b196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259ca05c46454743a9819915d50370a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:33.808523 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-86f418d1-8ab7-443b-b705-bb8426a7596e tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "GET /compute/v2.1/servers/7a147a55-22e3-4d18-b263-c35766ab20bd" status: 200 len: 1313 microversion: 2.1 time: 1.518335 Oct 05 02:58:33.816214 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2827/5677] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:32 2022] GET /compute/v2.1/servers/7a147a55-22e3-4d18-b263-c35766ab20bd => generated 1313 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:33.890579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-df52447d-dc83-49fc-b2e2-5434ad186712 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ecb250db344080990dd801dacbde48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8dfc2b9fa14888ad008ee075da8170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:33.903855 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-df52447d-dc83-49fc-b2e2-5434ad186712 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] 10.222.0.16 "GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8" status: 200 len: 1316 microversion: 2.1 time: 0.526227 Oct 05 02:58:33.906243 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2851/5678] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:33 2022] GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8 => generated 1316 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:34.408723 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1289ce1b-4c35-4113-b01e-63e8c3a9618a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:34.409625 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1289ce1b-4c35-4113-b01e-63e8c3a9618a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 3551a7d0-74d1-41e5-9cb9-252aeb256b95] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:34.418251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1289ce1b-4c35-4113-b01e-63e8c3a9618a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:34.419171 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1289ce1b-4c35-4113-b01e-63e8c3a9618a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:34.419841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1289ce1b-4c35-4113-b01e-63e8c3a9618a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:34.422977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1289ce1b-4c35-4113-b01e-63e8c3a9618a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:34.423883 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1289ce1b-4c35-4113-b01e-63e8c3a9618a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:34.424699 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1289ce1b-4c35-4113-b01e-63e8c3a9618a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:34.456711 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-1289ce1b-4c35-4113-b01e-63e8c3a9618a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] HTTP exception thrown: Instance 3551a7d0-74d1-41e5-9cb9-252aeb256b95 could not be found. Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1289ce1b-4c35-4113-b01e-63e8c3a9618a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Request method failure captured: Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 HTTP/1.1 Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPGOLQowIsfBU6KJO-aq50qdRwmBWFeSun5TXHVGHXcRMd_nBRTUvLypi8_xX1_OhJhXqj8Tv9hcB2y77p-h0kTEsykqgEnSv0lMxHhtiAmMmCPjjlgvw91YvvX9SOOQS6JLONmL-pDrthh_0HqZ_QF0o7mi44oPhOdJTsJKEis6xoY Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 129b5343573f4f9fa648e984a68b6760 Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1554781900 Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/129b5343573f4f9fa648e984a68b6760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/129b5343573f4f9fa648e984a68b6760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/129b5343573f4f9fa648e984a68b6760"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_129b5343573f4f9fa648e984a68b6760"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1554781900 Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 129b5343573f4f9fa648e984a68b6760 Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1554781900 Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServerRescueNegativeTestJSON-1554781900-project Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: a031e94db13d4e7e8947f51abc36d629 Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1554781900-project Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 3551a7d0-74d1-41e5-9cb9-252aeb256b95 could not be found. Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '3551a7d0-74d1-41e5-9cb9-252aeb256b95'} Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3551a7d0-74d1-41e5-9cb9-252aeb256b95 could not be found. Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3551a7d0-74d1-41e5-9cb9-252aeb256b95 could not be found. Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:58:34.462373 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:58:34.467397 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:58:34.467397 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:34.467397 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:58:34.467397 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:58:34.467397 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:58:34.467397 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:58:34.467397 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3551a7d0-74d1-41e5-9cb9-252aeb256b95 could not be found. Oct 05 02:58:34.467397 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:58:34.467397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1289ce1b-4c35-4113-b01e-63e8c3a9618a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Returning 404 to user: Instance 3551a7d0-74d1-41e5-9cb9-252aeb256b95 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:58:34.467397 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1289ce1b-4c35-4113-b01e-63e8c3a9618a tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95" status: 404 len: 111 microversion: 2.1 time: 0.064979 Oct 05 02:58:34.467397 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2828/5679] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:34 2022] GET /compute/v2.1/servers/3551a7d0-74d1-41e5-9cb9-252aeb256b95 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:58:34.474294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6e333792-a185-4f88-989a-5dcb2f257c91 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:34.474893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6e333792-a185-4f88-989a-5dcb2f257c91 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:34.502116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e333792-a185-4f88-989a-5dcb2f257c91 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:34.502978 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e333792-a185-4f88-989a-5dcb2f257c91 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:34.503642 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e333792-a185-4f88-989a-5dcb2f257c91 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:34.505172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e333792-a185-4f88-989a-5dcb2f257c91 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:34.506141 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e333792-a185-4f88-989a-5dcb2f257c91 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:34.507262 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6e333792-a185-4f88-989a-5dcb2f257c91 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:34.545580 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6e333792-a185-4f88-989a-5dcb2f257c91 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:58:34.690372 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6e333792-a185-4f88-989a-5dcb2f257c91 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "DELETE /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378" status: 204 len: 0 microversion: 2.1 time: 0.218350 Oct 05 02:58:34.692162 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2852/5680] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:58:34 2022] DELETE /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:58:34.704798 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6bafca2b-0620-4588-8628-1099b42a7d0d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:34.706313 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6bafca2b-0620-4588-8628-1099b42a7d0d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:34.730743 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6bafca2b-0620-4588-8628-1099b42a7d0d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:34.732605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6bafca2b-0620-4588-8628-1099b42a7d0d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:34.734704 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6bafca2b-0620-4588-8628-1099b42a7d0d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:34.736002 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6bafca2b-0620-4588-8628-1099b42a7d0d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:34.737757 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6bafca2b-0620-4588-8628-1099b42a7d0d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:34.739074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6bafca2b-0620-4588-8628-1099b42a7d0d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:34.845044 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-35201480-bcd0-4887-b981-b9cf0e9507a3 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:34.847483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-35201480-bcd0-4887-b981-b9cf0e9507a3 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 7a147a55-22e3-4d18-b263-c35766ab20bd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:34.856390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35201480-bcd0-4887-b981-b9cf0e9507a3 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:34.857462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35201480-bcd0-4887-b981-b9cf0e9507a3 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:34.858835 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35201480-bcd0-4887-b981-b9cf0e9507a3 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:34.862018 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35201480-bcd0-4887-b981-b9cf0e9507a3 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:34.865014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35201480-bcd0-4887-b981-b9cf0e9507a3 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:34.865729 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35201480-bcd0-4887-b981-b9cf0e9507a3 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:35.376500 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6bafca2b-0620-4588-8628-1099b42a7d0d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:35.380409 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-35201480-bcd0-4887-b981-b9cf0e9507a3 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb038e111434aa581b9ebc7a578b196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259ca05c46454743a9819915d50370a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:35.392094 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-35201480-bcd0-4887-b981-b9cf0e9507a3 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "GET /compute/v2.1/servers/7a147a55-22e3-4d18-b263-c35766ab20bd" status: 200 len: 1498 microversion: 2.1 time: 0.556324 Oct 05 02:58:35.393280 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2853/5681] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:34 2022] GET /compute/v2.1/servers/7a147a55-22e3-4d18-b263-c35766ab20bd => generated 1498 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:58:35.401046 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0acfad95-028b-40f1-8031-0e61faeda6c5 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:35.403872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0acfad95-028b-40f1-8031-0e61faeda6c5 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] [instance: c34e85b7-df59-45a0-b132-3bf5b5f487a8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:35.411349 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6bafca2b-0620-4588-8628-1099b42a7d0d tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378" status: 200 len: 1520 microversion: 2.1 time: 0.714957 Oct 05 02:58:35.413598 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2829/5682] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:34 2022] GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378 => generated 1520 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:35.418941 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0acfad95-028b-40f1-8031-0e61faeda6c5 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:35.419769 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0acfad95-028b-40f1-8031-0e61faeda6c5 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:35.420271 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0acfad95-028b-40f1-8031-0e61faeda6c5 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:35.421495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0acfad95-028b-40f1-8031-0e61faeda6c5 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:35.421960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0acfad95-028b-40f1-8031-0e61faeda6c5 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:35.422394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0acfad95-028b-40f1-8031-0e61faeda6c5 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:35.437269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-63ff2e38-391d-4bcd-8e87-cb6513ebd99d req-0b2b4e4c-c451-469d-b0c9-26730f669846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c34e85b7-df59-45a0-b132-3bf5b5f487a8", "name": "network-vif-plugged", "status": "completed", "tag": "8a8f2340-f928-4758-a5cf-271d4cf2f7d4"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:58:35.470990 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-63ff2e38-391d-4bcd-8e87-cb6513ebd99d req-0b2b4e4c-c451-469d-b0c9-26730f669846 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:35.472282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-63ff2e38-391d-4bcd-8e87-cb6513ebd99d req-0b2b4e4c-c451-469d-b0c9-26730f669846 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:35.473620 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-63ff2e38-391d-4bcd-8e87-cb6513ebd99d req-0b2b4e4c-c451-469d-b0c9-26730f669846 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:35.489135 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-63ff2e38-391d-4bcd-8e87-cb6513ebd99d req-0b2b4e4c-c451-469d-b0c9-26730f669846 service nova] Creating event network-vif-plugged:8a8f2340-f928-4758-a5cf-271d4cf2f7d4 for instance c34e85b7-df59-45a0-b132-3bf5b5f487a8 on n-h1-858272-3 Oct 05 02:58:35.497135 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-63ff2e38-391d-4bcd-8e87-cb6513ebd99d req-0b2b4e4c-c451-469d-b0c9-26730f669846 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080123 Oct 05 02:58:35.498354 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2830/5683] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:58:35.671712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0acfad95-028b-40f1-8031-0e61faeda6c5 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ecb250db344080990dd801dacbde48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8dfc2b9fa14888ad008ee075da8170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:35.687066 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0acfad95-028b-40f1-8031-0e61faeda6c5 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] 10.222.0.16 "GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8" status: 200 len: 1316 microversion: 2.1 time: 0.290107 Oct 05 02:58:35.687870 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2854/5684] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:35 2022] GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8 => generated 1316 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:36.174484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-54f2da3f-f5a1-4630-80ac-bc90c29dcfbd tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:36.175409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-54f2da3f-f5a1-4630-80ac-bc90c29dcfbd tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 7a147a55-22e3-4d18-b263-c35766ab20bd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:36.187329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54f2da3f-f5a1-4630-80ac-bc90c29dcfbd tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:36.188261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54f2da3f-f5a1-4630-80ac-bc90c29dcfbd tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:36.189977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54f2da3f-f5a1-4630-80ac-bc90c29dcfbd tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:36.193322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54f2da3f-f5a1-4630-80ac-bc90c29dcfbd tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:36.194100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54f2da3f-f5a1-4630-80ac-bc90c29dcfbd tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:36.194849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54f2da3f-f5a1-4630-80ac-bc90c29dcfbd tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:36.268155 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-54f2da3f-f5a1-4630-80ac-bc90c29dcfbd tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 7a147a55-22e3-4d18-b263-c35766ab20bd] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:58:36.432805 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-54f2da3f-f5a1-4630-80ac-bc90c29dcfbd tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7a147a55-22e3-4d18-b263-c35766ab20bd" status: 204 len: 0 microversion: 2.1 time: 0.262714 Oct 05 02:58:36.433839 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2831/5685] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:58:36 2022] DELETE /compute/v2.1/servers/7a147a55-22e3-4d18-b263-c35766ab20bd => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:58:36.444738 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-da0614e8-0d6b-470a-b878-ed22d0dfdf90 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:36.445977 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-da0614e8-0d6b-470a-b878-ed22d0dfdf90 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 7a147a55-22e3-4d18-b263-c35766ab20bd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:36.448761 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fa1e8b5a-b625-4caa-ae90-6caaa59e81db tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:36.449781 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fa1e8b5a-b625-4caa-ae90-6caaa59e81db tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:36.458235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da0614e8-0d6b-470a-b878-ed22d0dfdf90 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:36.459677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da0614e8-0d6b-470a-b878-ed22d0dfdf90 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:36.462574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da0614e8-0d6b-470a-b878-ed22d0dfdf90 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:36.465304 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da0614e8-0d6b-470a-b878-ed22d0dfdf90 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:36.465965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da0614e8-0d6b-470a-b878-ed22d0dfdf90 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:36.466708 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fa1e8b5a-b625-4caa-ae90-6caaa59e81db tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:36.466821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da0614e8-0d6b-470a-b878-ed22d0dfdf90 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:36.468752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fa1e8b5a-b625-4caa-ae90-6caaa59e81db tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:36.469411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fa1e8b5a-b625-4caa-ae90-6caaa59e81db tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:36.473282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fa1e8b5a-b625-4caa-ae90-6caaa59e81db tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:36.474012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fa1e8b5a-b625-4caa-ae90-6caaa59e81db tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:36.474732 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fa1e8b5a-b625-4caa-ae90-6caaa59e81db tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:37.084276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fa1e8b5a-b625-4caa-ae90-6caaa59e81db tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:37.131711 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fa1e8b5a-b625-4caa-ae90-6caaa59e81db tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378" status: 200 len: 1520 microversion: 2.1 time: 0.679131 Oct 05 02:58:37.137978 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2832/5686] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:36 2022] GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378 => generated 1520 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 02:58:37.142915 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f2073c91-7e7c-4c23-a01a-f954a45a90ca tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:37.149743 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f2073c91-7e7c-4c23-a01a-f954a45a90ca tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] [instance: c34e85b7-df59-45a0-b132-3bf5b5f487a8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:37.169947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2073c91-7e7c-4c23-a01a-f954a45a90ca tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:37.170555 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2073c91-7e7c-4c23-a01a-f954a45a90ca tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:37.171674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2073c91-7e7c-4c23-a01a-f954a45a90ca tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:37.172724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2073c91-7e7c-4c23-a01a-f954a45a90ca tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:37.177616 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2073c91-7e7c-4c23-a01a-f954a45a90ca tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:37.178153 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f2073c91-7e7c-4c23-a01a-f954a45a90ca tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:37.300005 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-da0614e8-0d6b-470a-b878-ed22d0dfdf90 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb038e111434aa581b9ebc7a578b196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259ca05c46454743a9819915d50370a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:37.312717 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-da0614e8-0d6b-470a-b878-ed22d0dfdf90 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "GET /compute/v2.1/servers/7a147a55-22e3-4d18-b263-c35766ab20bd" status: 200 len: 1504 microversion: 2.1 time: 0.872533 Oct 05 02:58:37.324568 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2855/5687] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:36 2022] GET /compute/v2.1/servers/7a147a55-22e3-4d18-b263-c35766ab20bd => generated 1504 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:37.838894 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f2073c91-7e7c-4c23-a01a-f954a45a90ca tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ecb250db344080990dd801dacbde48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8dfc2b9fa14888ad008ee075da8170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:37.852172 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f2073c91-7e7c-4c23-a01a-f954a45a90ca tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] 10.222.0.16 "GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8" status: 200 len: 1316 microversion: 2.1 time: 0.711382 Oct 05 02:58:37.852801 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2833/5688] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:37 2022] GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8 => generated 1316 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:38.162508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-350dcd54-127f-4f38-b9a0-eedbbbc101b1 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:38.163129 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-350dcd54-127f-4f38-b9a0-eedbbbc101b1 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:38.173330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-350dcd54-127f-4f38-b9a0-eedbbbc101b1 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:38.177253 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-350dcd54-127f-4f38-b9a0-eedbbbc101b1 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:38.177734 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-350dcd54-127f-4f38-b9a0-eedbbbc101b1 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:38.180562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-350dcd54-127f-4f38-b9a0-eedbbbc101b1 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:38.181239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-350dcd54-127f-4f38-b9a0-eedbbbc101b1 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:38.181862 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-350dcd54-127f-4f38-b9a0-eedbbbc101b1 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:38.348890 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2ad67f42-b316-44e3-a789-2a567c0d4478 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:38.349595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2ad67f42-b316-44e3-a789-2a567c0d4478 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 7a147a55-22e3-4d18-b263-c35766ab20bd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:38.359675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ad67f42-b316-44e3-a789-2a567c0d4478 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:38.361022 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ad67f42-b316-44e3-a789-2a567c0d4478 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:38.361747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ad67f42-b316-44e3-a789-2a567c0d4478 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:38.362396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ad67f42-b316-44e3-a789-2a567c0d4478 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:38.363047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ad67f42-b316-44e3-a789-2a567c0d4478 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:38.363490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ad67f42-b316-44e3-a789-2a567c0d4478 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:39.032389 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2ad67f42-b316-44e3-a789-2a567c0d4478 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb038e111434aa581b9ebc7a578b196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259ca05c46454743a9819915d50370a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:39.051301 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2ad67f42-b316-44e3-a789-2a567c0d4478 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "GET /compute/v2.1/servers/7a147a55-22e3-4d18-b263-c35766ab20bd" status: 200 len: 1504 microversion: 2.1 time: 0.705742 Oct 05 02:58:39.055091 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2834/5689] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:38 2022] GET /compute/v2.1/servers/7a147a55-22e3-4d18-b263-c35766ab20bd => generated 1504 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:39.066856 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-497d937c-e89e-4149-a89f-7adcbab4bccd tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:39.071101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-497d937c-e89e-4149-a89f-7adcbab4bccd tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] [instance: c34e85b7-df59-45a0-b132-3bf5b5f487a8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:39.090779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-497d937c-e89e-4149-a89f-7adcbab4bccd tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:39.096169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-497d937c-e89e-4149-a89f-7adcbab4bccd tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:39.097024 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-497d937c-e89e-4149-a89f-7adcbab4bccd tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:39.105524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-497d937c-e89e-4149-a89f-7adcbab4bccd tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:39.108517 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-497d937c-e89e-4149-a89f-7adcbab4bccd tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:39.109260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-497d937c-e89e-4149-a89f-7adcbab4bccd tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:39.307558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-350dcd54-127f-4f38-b9a0-eedbbbc101b1 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:39.318114 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-350dcd54-127f-4f38-b9a0-eedbbbc101b1 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378" status: 200 len: 1520 microversion: 2.1 time: 1.159545 Oct 05 02:58:39.321899 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2856/5690] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:38 2022] GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378 => generated 1520 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:39.611338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-27a2b20a-98dd-427d-8635-978664b82325 req-81e32c88-ebeb-4bb7-81f9-f11a1c202b8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a147a55-22e3-4d18-b263-c35766ab20bd", "name": "network-vif-deleted", "tag": "c8b149dd-69d6-49df-81f5-c264f6a7dacc"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:58:39.625016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-27a2b20a-98dd-427d-8635-978664b82325 req-81e32c88-ebeb-4bb7-81f9-f11a1c202b8f service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:39.625933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-27a2b20a-98dd-427d-8635-978664b82325 req-81e32c88-ebeb-4bb7-81f9-f11a1c202b8f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:39.626585 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-27a2b20a-98dd-427d-8635-978664b82325 req-81e32c88-ebeb-4bb7-81f9-f11a1c202b8f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:39.643193 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-27a2b20a-98dd-427d-8635-978664b82325 req-81e32c88-ebeb-4bb7-81f9-f11a1c202b8f service nova] Creating event network-vif-deleted:c8b149dd-69d6-49df-81f5-c264f6a7dacc for instance 7a147a55-22e3-4d18-b263-c35766ab20bd on n-h2-858272-3 Oct 05 02:58:39.649571 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-27a2b20a-98dd-427d-8635-978664b82325 req-81e32c88-ebeb-4bb7-81f9-f11a1c202b8f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042843 Oct 05 02:58:39.650249 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2857/5691] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:58:39.693683 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-497d937c-e89e-4149-a89f-7adcbab4bccd tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ecb250db344080990dd801dacbde48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8dfc2b9fa14888ad008ee075da8170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:39.714062 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-497d937c-e89e-4149-a89f-7adcbab4bccd tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] 10.222.0.16 "GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8" status: 200 len: 1505 microversion: 2.1 time: 0.649595 Oct 05 02:58:39.714783 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2835/5692] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:39 2022] GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8 => generated 1505 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:39.719727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-72c3bbe1-3d01-4331-be30-65e18acc1ddf req-96df6156-0ee3-4bfc-8c8e-23f980630edc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09ae93ee-8f09-4552-b933-ad3c7e157378", "name": "network-vif-deleted", "tag": "4ea018df-dd40-468b-9dbd-6d8eb574258f"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:58:39.739623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8ddbdc8d-839c-4fbd-a6d0-7cc9dae33482 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:39.740123 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8ddbdc8d-839c-4fbd-a6d0-7cc9dae33482 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] [instance: c34e85b7-df59-45a0-b132-3bf5b5f487a8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:39.744856 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-72c3bbe1-3d01-4331-be30-65e18acc1ddf req-96df6156-0ee3-4bfc-8c8e-23f980630edc service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:39.745680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-72c3bbe1-3d01-4331-be30-65e18acc1ddf req-96df6156-0ee3-4bfc-8c8e-23f980630edc service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:39.746242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-72c3bbe1-3d01-4331-be30-65e18acc1ddf req-96df6156-0ee3-4bfc-8c8e-23f980630edc service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:39.753461 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ddbdc8d-839c-4fbd-a6d0-7cc9dae33482 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:39.755186 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ddbdc8d-839c-4fbd-a6d0-7cc9dae33482 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:39.756182 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ddbdc8d-839c-4fbd-a6d0-7cc9dae33482 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:39.757805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ddbdc8d-839c-4fbd-a6d0-7cc9dae33482 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:39.760238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ddbdc8d-839c-4fbd-a6d0-7cc9dae33482 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:39.761121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ddbdc8d-839c-4fbd-a6d0-7cc9dae33482 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:39.779630 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-72c3bbe1-3d01-4331-be30-65e18acc1ddf req-96df6156-0ee3-4bfc-8c8e-23f980630edc service nova] Creating event network-vif-deleted:4ea018df-dd40-468b-9dbd-6d8eb574258f for instance 09ae93ee-8f09-4552-b933-ad3c7e157378 on n-h1-858272-3 Oct 05 02:58:39.803667 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-72c3bbe1-3d01-4331-be30-65e18acc1ddf req-96df6156-0ee3-4bfc-8c8e-23f980630edc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082835 Oct 05 02:58:39.804340 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2858/5693] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:58:39.840166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:58:39.855062 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8ddbdc8d-839c-4fbd-a6d0-7cc9dae33482 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.119572 Oct 05 02:58:39.856343 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2836/5694] 10.222.0.16 () {58 vars in 1296 bytes} [Wed Oct 5 02:58:39 2022] DELETE /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8/os-server-password => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 02:58:39.868402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-87b744ce-6898-4f11-b581-624c63229d32 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:39.869242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-87b744ce-6898-4f11-b581-624c63229d32 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] [instance: c34e85b7-df59-45a0-b132-3bf5b5f487a8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:39.897852 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87b744ce-6898-4f11-b581-624c63229d32 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:39.898580 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87b744ce-6898-4f11-b581-624c63229d32 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:39.899192 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87b744ce-6898-4f11-b581-624c63229d32 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:39.900817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87b744ce-6898-4f11-b581-624c63229d32 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:39.902051 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87b744ce-6898-4f11-b581-624c63229d32 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:39.902678 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87b744ce-6898-4f11-b581-624c63229d32 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:39.965916 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-87b744ce-6898-4f11-b581-624c63229d32 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] 10.222.0.16 "GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.102412 Oct 05 02:58:39.968432 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2859/5695] 10.222.0.16 () {58 vars in 1293 bytes} [Wed Oct 5 02:58:39 2022] GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8/os-server-password => generated 16 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 02:58:39.981013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cd534003-75e8-40cf-9800-0682027aef7e tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:39.981869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cd534003-75e8-40cf-9800-0682027aef7e tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] [instance: c34e85b7-df59-45a0-b132-3bf5b5f487a8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:40.006114 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd534003-75e8-40cf-9800-0682027aef7e tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:40.009412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd534003-75e8-40cf-9800-0682027aef7e tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:40.018222 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd534003-75e8-40cf-9800-0682027aef7e tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:40.019700 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd534003-75e8-40cf-9800-0682027aef7e tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:40.020762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd534003-75e8-40cf-9800-0682027aef7e tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:40.021607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd534003-75e8-40cf-9800-0682027aef7e tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:40.077822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-261f4749-130a-49dc-8401-83f54f60e06d tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:40.078564 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-261f4749-130a-49dc-8401-83f54f60e06d tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 7a147a55-22e3-4d18-b263-c35766ab20bd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:40.087521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-261f4749-130a-49dc-8401-83f54f60e06d tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:40.088254 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-261f4749-130a-49dc-8401-83f54f60e06d tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:40.088856 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-261f4749-130a-49dc-8401-83f54f60e06d tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:40.089776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-261f4749-130a-49dc-8401-83f54f60e06d tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:40.090388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-261f4749-130a-49dc-8401-83f54f60e06d tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:40.090965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-261f4749-130a-49dc-8401-83f54f60e06d tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:40.102430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cd534003-75e8-40cf-9800-0682027aef7e tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] [instance: c34e85b7-df59-45a0-b132-3bf5b5f487a8] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:58:40.172400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-261f4749-130a-49dc-8401-83f54f60e06d tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:40.178055 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-261f4749-130a-49dc-8401-83f54f60e06d tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:40.179155 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-261f4749-130a-49dc-8401-83f54f60e06d tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:40.179644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-261f4749-130a-49dc-8401-83f54f60e06d tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lazy-loading 'fault' on Instance uuid 7a147a55-22e3-4d18-b263-c35766ab20bd {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:58:40.310974 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cd534003-75e8-40cf-9800-0682027aef7e tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8" status: 204 len: 0 microversion: 2.1 time: 0.336034 Oct 05 02:58:40.315343 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2837/5696] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:58:39 2022] DELETE /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 02:58:40.335484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-35defa64-3a5f-4c26-be3c-a2b4d0cfcb5e tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:40.336219 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-35defa64-3a5f-4c26-be3c-a2b4d0cfcb5e tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] [instance: c34e85b7-df59-45a0-b132-3bf5b5f487a8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:40.337743 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-261f4749-130a-49dc-8401-83f54f60e06d tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cb038e111434aa581b9ebc7a578b196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259ca05c46454743a9819915d50370a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:40.345278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-35defa64-3a5f-4c26-be3c-a2b4d0cfcb5e tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:40.345981 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-35defa64-3a5f-4c26-be3c-a2b4d0cfcb5e tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:40.346732 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-35defa64-3a5f-4c26-be3c-a2b4d0cfcb5e tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:40.347692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-35defa64-3a5f-4c26-be3c-a2b4d0cfcb5e tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:40.348305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-35defa64-3a5f-4c26-be3c-a2b4d0cfcb5e tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:40.348931 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-35defa64-3a5f-4c26-be3c-a2b4d0cfcb5e tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:40.357846 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-261f4749-130a-49dc-8401-83f54f60e06d tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "GET /compute/v2.1/servers/7a147a55-22e3-4d18-b263-c35766ab20bd" status: 200 len: 1303 microversion: 2.1 time: 0.286921 Oct 05 02:58:40.375059 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2860/5697] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:40 2022] GET /compute/v2.1/servers/7a147a55-22e3-4d18-b263-c35766ab20bd => generated 1303 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:40.396453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-27888331-640b-433f-88be-76299b829354 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:40.397901 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-27888331-640b-433f-88be-76299b829354 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:40.418575 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27888331-640b-433f-88be-76299b829354 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:40.419975 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27888331-640b-433f-88be-76299b829354 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:40.424071 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27888331-640b-433f-88be-76299b829354 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:40.427150 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27888331-640b-433f-88be-76299b829354 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:40.427654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27888331-640b-433f-88be-76299b829354 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:40.429335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27888331-640b-433f-88be-76299b829354 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:40.532931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27888331-640b-433f-88be-76299b829354 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:40.535609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27888331-640b-433f-88be-76299b829354 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:40.536083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27888331-640b-433f-88be-76299b829354 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:40.536566 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-27888331-640b-433f-88be-76299b829354 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lazy-loading 'fault' on Instance uuid 09ae93ee-8f09-4552-b933-ad3c7e157378 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:58:40.602759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-27888331-640b-433f-88be-76299b829354 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a031e94db13d4e7e8947f51abc36d629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b5343573f4f9fa648e984a68b6760', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:40.614237 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-27888331-640b-433f-88be-76299b829354 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378" status: 200 len: 1311 microversion: 2.1 time: 0.236822 Oct 05 02:58:40.614828 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2861/5698] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:40 2022] GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378 => generated 1311 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:40.870682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-35defa64-3a5f-4c26-be3c-a2b4d0cfcb5e tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ecb250db344080990dd801dacbde48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8dfc2b9fa14888ad008ee075da8170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:40.883313 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-35defa64-3a5f-4c26-be3c-a2b4d0cfcb5e tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] 10.222.0.16 "GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8" status: 200 len: 1511 microversion: 2.1 time: 0.566589 Oct 05 02:58:40.884668 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2838/5699] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:40 2022] GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8 => generated 1511 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:41.403208 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cbb5ea4d-84ec-494b-a39e-a160ee5cc665 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:41.404099 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cbb5ea4d-84ec-494b-a39e-a160ee5cc665 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] [instance: 7a147a55-22e3-4d18-b263-c35766ab20bd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:41.427470 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cbb5ea4d-84ec-494b-a39e-a160ee5cc665 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:41.430431 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cbb5ea4d-84ec-494b-a39e-a160ee5cc665 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:41.433406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cbb5ea4d-84ec-494b-a39e-a160ee5cc665 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:41.434356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cbb5ea4d-84ec-494b-a39e-a160ee5cc665 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:41.434954 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cbb5ea4d-84ec-494b-a39e-a160ee5cc665 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:41.436169 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cbb5ea4d-84ec-494b-a39e-a160ee5cc665 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:41.476355 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-cbb5ea4d-84ec-494b-a39e-a160ee5cc665 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] HTTP exception thrown: Instance 7a147a55-22e3-4d18-b263-c35766ab20bd could not be found. Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cbb5ea4d-84ec-494b-a39e-a160ee5cc665 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Request method failure captured: Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/7a147a55-22e3-4d18-b263-c35766ab20bd HTTP/1.1 Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPKlraLKIazVRBdxW48unYps6itJTlS_HNoSPMihsKZegCF91a10wBvHtZJshkTUT97ply17i57onhAN8a4Z7BVZB-OkM9U9bWsZcCwJMDNxaax7RFKBZMdBQTl4i-0GBVuWxe1J64h0Qrnm1Oa_BjZ1FIsboAzXkMRa4z_z1DjLodc Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 259ca05c46454743a9819915d50370a7 Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-VolumesActionsTest-1219574421 Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/259ca05c46454743a9819915d50370a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/259ca05c46454743a9819915d50370a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/259ca05c46454743a9819915d50370a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_259ca05c46454743a9819915d50370a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-VolumesActionsTest-1219574421 Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 259ca05c46454743a9819915d50370a7 Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-VolumesActionsTest-1219574421 Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-VolumesActionsTest-1219574421-project Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 7cb038e111434aa581b9ebc7a578b196 Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-VolumesActionsTest-1219574421-project Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 7a147a55-22e3-4d18-b263-c35766ab20bd could not be found. Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '7a147a55-22e3-4d18-b263-c35766ab20bd'} Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a147a55-22e3-4d18-b263-c35766ab20bd could not be found. Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a147a55-22e3-4d18-b263-c35766ab20bd could not be found. Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:58:41.479236 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:41.483814 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:41.483814 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:58:41.483814 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:58:41.483814 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:58:41.483814 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:58:41.483814 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a147a55-22e3-4d18-b263-c35766ab20bd could not be found. Oct 05 02:58:41.483814 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:41.487648 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cbb5ea4d-84ec-494b-a39e-a160ee5cc665 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] Returning 404 to user: Instance 7a147a55-22e3-4d18-b263-c35766ab20bd could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:58:41.489689 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cbb5ea4d-84ec-494b-a39e-a160ee5cc665 tempest-VolumesActionsTest-1219574421 tempest-VolumesActionsTest-1219574421-project] 10.222.0.16 "GET /compute/v2.1/servers/7a147a55-22e3-4d18-b263-c35766ab20bd" status: 404 len: 111 microversion: 2.1 time: 0.090915 Oct 05 02:58:41.491266 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2862/5700] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:41 2022] GET /compute/v2.1/servers/7a147a55-22e3-4d18-b263-c35766ab20bd => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:58:41.642576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4b1d4378-31b6-4658-b04a-01b7127d2377 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:41.643242 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4b1d4378-31b6-4658-b04a-01b7127d2377 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] [instance: 09ae93ee-8f09-4552-b933-ad3c7e157378] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:41.669633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b1d4378-31b6-4658-b04a-01b7127d2377 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:41.670214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b1d4378-31b6-4658-b04a-01b7127d2377 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:41.676612 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b1d4378-31b6-4658-b04a-01b7127d2377 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:41.677564 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b1d4378-31b6-4658-b04a-01b7127d2377 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:41.678038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b1d4378-31b6-4658-b04a-01b7127d2377 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:41.683602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b1d4378-31b6-4658-b04a-01b7127d2377 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:41.761041 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-4b1d4378-31b6-4658-b04a-01b7127d2377 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] HTTP exception thrown: Instance 09ae93ee-8f09-4552-b933-ad3c7e157378 could not be found. Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4b1d4378-31b6-4658-b04a-01b7127d2377 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Request method failure captured: Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378 HTTP/1.1 Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPGOLQowIsfBU6KJO-aq50qdRwmBWFeSun5TXHVGHXcRMd_nBRTUvLypi8_xX1_OhJhXqj8Tv9hcB2y77p-h0kTEsykqgEnSv0lMxHhtiAmMmCPjjlgvw91YvvX9SOOQS6JLONmL-pDrthh_0HqZ_QF0o7mi44oPhOdJTsJKEis6xoY Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 129b5343573f4f9fa648e984a68b6760 Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1554781900 Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/129b5343573f4f9fa648e984a68b6760"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/129b5343573f4f9fa648e984a68b6760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/129b5343573f4f9fa648e984a68b6760"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_129b5343573f4f9fa648e984a68b6760"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1554781900 Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 129b5343573f4f9fa648e984a68b6760 Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1554781900 Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServerRescueNegativeTestJSON-1554781900-project Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: a031e94db13d4e7e8947f51abc36d629 Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1554781900-project Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 09ae93ee-8f09-4552-b933-ad3c7e157378 could not be found. Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '09ae93ee-8f09-4552-b933-ad3c7e157378'} Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09ae93ee-8f09-4552-b933-ad3c7e157378 could not be found. Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09ae93ee-8f09-4552-b933-ad3c7e157378 could not be found. Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:58:41.765300 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:58:41.770316 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:58:41.770316 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:41.770316 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:58:41.770316 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:58:41.770316 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:58:41.770316 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:58:41.770316 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09ae93ee-8f09-4552-b933-ad3c7e157378 could not be found. Oct 05 02:58:41.770316 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 02:58:41.775900 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4b1d4378-31b6-4658-b04a-01b7127d2377 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] Returning 404 to user: Instance 09ae93ee-8f09-4552-b933-ad3c7e157378 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:58:41.777575 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4b1d4378-31b6-4658-b04a-01b7127d2377 tempest-ServerRescueNegativeTestJSON-1554781900 tempest-ServerRescueNegativeTestJSON-1554781900-project] 10.222.0.16 "GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378" status: 404 len: 111 microversion: 2.1 time: 0.139719 Oct 05 02:58:41.778525 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2839/5701] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:41 2022] GET /compute/v2.1/servers/09ae93ee-8f09-4552-b933-ad3c7e157378 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 02:58:41.914701 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-187a4125-068b-42e2-ba36-463da2a56036 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:41.915328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-187a4125-068b-42e2-ba36-463da2a56036 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] [instance: c34e85b7-df59-45a0-b132-3bf5b5f487a8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:41.935778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-187a4125-068b-42e2-ba36-463da2a56036 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:41.941695 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-187a4125-068b-42e2-ba36-463da2a56036 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:41.943114 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-187a4125-068b-42e2-ba36-463da2a56036 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:41.943948 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-187a4125-068b-42e2-ba36-463da2a56036 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:41.948255 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-187a4125-068b-42e2-ba36-463da2a56036 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:41.951168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-187a4125-068b-42e2-ba36-463da2a56036 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:42.378729 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-187a4125-068b-42e2-ba36-463da2a56036 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ecb250db344080990dd801dacbde48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8dfc2b9fa14888ad008ee075da8170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:42.392884 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-187a4125-068b-42e2-ba36-463da2a56036 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] 10.222.0.16 "GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8" status: 200 len: 1511 microversion: 2.1 time: 0.483193 Oct 05 02:58:42.393433 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2863/5702] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:41 2022] GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8 => generated 1511 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:43.416345 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a9702178-df14-45de-8101-d16be91a0351 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:43.417185 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a9702178-df14-45de-8101-d16be91a0351 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] [instance: c34e85b7-df59-45a0-b132-3bf5b5f487a8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:43.435291 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:58:43.443599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9702178-df14-45de-8101-d16be91a0351 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:43.444583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9702178-df14-45de-8101-d16be91a0351 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:43.449648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9702178-df14-45de-8101-d16be91a0351 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:43.451534 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9702178-df14-45de-8101-d16be91a0351 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:43.455358 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9702178-df14-45de-8101-d16be91a0351 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:43.456018 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9702178-df14-45de-8101-d16be91a0351 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:44.740202 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a9702178-df14-45de-8101-d16be91a0351 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ecb250db344080990dd801dacbde48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8dfc2b9fa14888ad008ee075da8170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:44.752778 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a9702178-df14-45de-8101-d16be91a0351 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] 10.222.0.16 "GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8" status: 200 len: 1511 microversion: 2.1 time: 1.340866 Oct 05 02:58:44.756284 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2840/5703] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:43 2022] GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8 => generated 1511 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:45.739823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-47b04d11-cec7-43af-acbe-44f35d244044 req-d49a7b7d-0433-4300-9a18-df299a56ff46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c34e85b7-df59-45a0-b132-3bf5b5f487a8", "name": "network-vif-deleted", "tag": "8a8f2340-f928-4758-a5cf-271d4cf2f7d4"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:58:45.777611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-47b04d11-cec7-43af-acbe-44f35d244044 req-d49a7b7d-0433-4300-9a18-df299a56ff46 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:45.778108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-47b04d11-cec7-43af-acbe-44f35d244044 req-d49a7b7d-0433-4300-9a18-df299a56ff46 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:45.778542 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-47b04d11-cec7-43af-acbe-44f35d244044 req-d49a7b7d-0433-4300-9a18-df299a56ff46 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:45.798978 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-673e4361-1bd6-432e-b703-3a590abb2fdd tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:45.800841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-673e4361-1bd6-432e-b703-3a590abb2fdd tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] [instance: c34e85b7-df59-45a0-b132-3bf5b5f487a8] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:45.832422 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-673e4361-1bd6-432e-b703-3a590abb2fdd tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:45.833057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-673e4361-1bd6-432e-b703-3a590abb2fdd tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:45.833557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-673e4361-1bd6-432e-b703-3a590abb2fdd tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:45.839856 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-673e4361-1bd6-432e-b703-3a590abb2fdd tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:45.840516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-673e4361-1bd6-432e-b703-3a590abb2fdd tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:45.845614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-673e4361-1bd6-432e-b703-3a590abb2fdd tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:45.857055 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-47b04d11-cec7-43af-acbe-44f35d244044 req-d49a7b7d-0433-4300-9a18-df299a56ff46 service nova] Creating event network-vif-deleted:8a8f2340-f928-4758-a5cf-271d4cf2f7d4 for instance c34e85b7-df59-45a0-b132-3bf5b5f487a8 on n-h1-858272-3 Oct 05 02:58:45.903738 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-47b04d11-cec7-43af-acbe-44f35d244044 req-d49a7b7d-0433-4300-9a18-df299a56ff46 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158124 Oct 05 02:58:45.906647 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2864/5704] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 02:58:46.079550 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-673e4361-1bd6-432e-b703-3a590abb2fdd tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ecb250db344080990dd801dacbde48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8dfc2b9fa14888ad008ee075da8170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:58:46.091880 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-673e4361-1bd6-432e-b703-3a590abb2fdd tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] 10.222.0.16 "GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8" status: 200 len: 1301 microversion: 2.1 time: 0.301678 Oct 05 02:58:46.092625 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2841/5705] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:45 2022] GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8 => generated 1301 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:58:47.121054 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dbf52333-8ec3-40b8-91a8-6736151bb955 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:58:47.121924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-dbf52333-8ec3-40b8-91a8-6736151bb955 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] [instance: c34e85b7-df59-45a0-b132-3bf5b5f487a8] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:58:47.140519 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dbf52333-8ec3-40b8-91a8-6736151bb955 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:47.147922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dbf52333-8ec3-40b8-91a8-6736151bb955 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:47.154697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dbf52333-8ec3-40b8-91a8-6736151bb955 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:47.179364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dbf52333-8ec3-40b8-91a8-6736151bb955 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:58:47.186683 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dbf52333-8ec3-40b8-91a8-6736151bb955 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:58:47.189355 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dbf52333-8ec3-40b8-91a8-6736151bb955 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:58:47.252819 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-dbf52333-8ec3-40b8-91a8-6736151bb955 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] HTTP exception thrown: Instance c34e85b7-df59-45a0-b132-3bf5b5f487a8 could not be found. Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dbf52333-8ec3-40b8-91a8-6736151bb955 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Request method failure captured: Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8 HTTP/1.1 Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPLBAxKs8C4mgTMwNizZO0B6p9YQPMB1J19XQnCWpRekCL8OzLlHxpEl9WQKy3VYSLpyqka-m_IMGddj8KHF_B7Ta9Eb-ZLUd-XuoHHNmJ89R2pZVyDYMszgmkF0Qx1fdZInI0HqC4Ij7JGDTDDYcSNrb9FYR9m3YmSBrGW8H5NAcQw Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 1d8dfc2b9fa14888ad008ee075da8170 Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerPasswordTestJSON-714229058 Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d8dfc2b9fa14888ad008ee075da8170"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d8dfc2b9fa14888ad008ee075da8170"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1d8dfc2b9fa14888ad008ee075da8170"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1d8dfc2b9fa14888ad008ee075da8170"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerPasswordTestJSON-714229058 Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 1d8dfc2b9fa14888ad008ee075da8170 Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerPasswordTestJSON-714229058 Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerPasswordTestJSON-714229058-project Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 78ecb250db344080990dd801dacbde48 Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerPasswordTestJSON-714229058-project Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance c34e85b7-df59-45a0-b132-3bf5b5f487a8 could not be found. Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'c34e85b7-df59-45a0-b132-3bf5b5f487a8'} Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c34e85b7-df59-45a0-b132-3bf5b5f487a8 could not be found. Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c34e85b7-df59-45a0-b132-3bf5b5f487a8 could not be found. Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 02:58:47.267144 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:47.271278 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 02:58:47.271278 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 02:58:47.271278 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 02:58:47.271278 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 02:58:47.271278 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 02:58:47.271278 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c34e85b7-df59-45a0-b132-3bf5b5f487a8 could not be found. Oct 05 02:58:47.271278 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 02:58:47.274053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dbf52333-8ec3-40b8-91a8-6736151bb955 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] Returning 404 to user: Instance c34e85b7-df59-45a0-b132-3bf5b5f487a8 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 02:58:47.277836 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-dbf52333-8ec3-40b8-91a8-6736151bb955 tempest-ServerPasswordTestJSON-714229058 tempest-ServerPasswordTestJSON-714229058-project] 10.222.0.16 "GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8" status: 404 len: 111 microversion: 2.1 time: 0.161072 Oct 05 02:58:47.283083 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2865/5706] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:58:47 2022] GET /compute/v2.1/servers/c34e85b7-df59-45a0-b132-3bf5b5f487a8 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 02:59:06.682532 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:06.683376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=5,nova_cell1:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:07.102133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-683e70d0-c664-4194-b586-46013eb4a140 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-913460270", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": "none"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:59:07.213344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-683e70d0-c664-4194-b586-46013eb4a140 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:59:07.214490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-683e70d0-c664-4194-b586-46013eb4a140 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:59:07.214990 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-683e70d0-c664-4194-b586-46013eb4a140 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:59:07.215447 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-683e70d0-c664-4194-b586-46013eb4a140 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:59:07.216319 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-683e70d0-c664-4194-b586-46013eb4a140 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:59:07.239730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-683e70d0-c664-4194-b586-46013eb4a140 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:07.240568 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-683e70d0-c664-4194-b586-46013eb4a140 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:07.241211 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-683e70d0-c664-4194-b586-46013eb4a140 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:07.242101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-683e70d0-c664-4194-b586-46013eb4a140 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:07.242867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-683e70d0-c664-4194-b586-46013eb4a140 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:07.246039 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-683e70d0-c664-4194-b586-46013eb4a140 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:07.291986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-683e70d0-c664-4194-b586-46013eb4a140 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Getting quotas for project daa97e7f606c4374a629c460de97aed9. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:59:07.306391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-683e70d0-c664-4194-b586-46013eb4a140 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Getting quotas for user d80cfe5906384b0db35364d904725750 and project daa97e7f606c4374a629c460de97aed9. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:59:07.327894 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-683e70d0-c664-4194-b586-46013eb4a140 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:59:07.339502 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-683e70d0-c664-4194-b586-46013eb4a140 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: fc1a259d-f92e-4b1a-852b-ac19acdb0681] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:59:07.466677 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-683e70d0-c664-4194-b586-46013eb4a140 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.787460 Oct 05 02:59:07.469317 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2842/5707] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 5 02:59:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 05 02:59:07.485429 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-209cc288-2fee-4f64-a881-5a5ffd4b31ab tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:07.486315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-209cc288-2fee-4f64-a881-5a5ffd4b31ab tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: fc1a259d-f92e-4b1a-852b-ac19acdb0681] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:07.493701 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:07.494478 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:07.646006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-209cc288-2fee-4f64-a881-5a5ffd4b31ab tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:07.695242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-209cc288-2fee-4f64-a881-5a5ffd4b31ab tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:07.698695 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-209cc288-2fee-4f64-a881-5a5ffd4b31ab tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:07.704537 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-209cc288-2fee-4f64-a881-5a5ffd4b31ab tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "GET /compute/v2.1/servers/fc1a259d-f92e-4b1a-852b-ac19acdb0681" status: 200 len: 1277 microversion: 2.47 time: 0.227237 Oct 05 02:59:07.707415 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2866/5708] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:59:07 2022] GET /compute/v2.1/servers/fc1a259d-f92e-4b1a-852b-ac19acdb0681 => generated 1277 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:59:07.809412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-91e683c2-84e9-45e6-b17b-400ce970a9fe tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-141171250", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": "none"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:59:08.011978 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-91e683c2-84e9-45e6-b17b-400ce970a9fe tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:59:08.012595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-91e683c2-84e9-45e6-b17b-400ce970a9fe tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:59:08.013192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-91e683c2-84e9-45e6-b17b-400ce970a9fe tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:59:08.013891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-91e683c2-84e9-45e6-b17b-400ce970a9fe tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:59:08.015922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-91e683c2-84e9-45e6-b17b-400ce970a9fe tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:59:08.089274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91e683c2-84e9-45e6-b17b-400ce970a9fe tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:08.090705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91e683c2-84e9-45e6-b17b-400ce970a9fe tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:08.091450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91e683c2-84e9-45e6-b17b-400ce970a9fe tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:08.094891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91e683c2-84e9-45e6-b17b-400ce970a9fe tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:08.100369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91e683c2-84e9-45e6-b17b-400ce970a9fe tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:08.101773 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-91e683c2-84e9-45e6-b17b-400ce970a9fe tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:08.190362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-91e683c2-84e9-45e6-b17b-400ce970a9fe tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Getting quotas for project daa97e7f606c4374a629c460de97aed9. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:59:08.206760 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-91e683c2-84e9-45e6-b17b-400ce970a9fe tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Getting quotas for user d80cfe5906384b0db35364d904725750 and project daa97e7f606c4374a629c460de97aed9. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:59:08.247521 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-91e683c2-84e9-45e6-b17b-400ce970a9fe tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:59:08.254803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-91e683c2-84e9-45e6-b17b-400ce970a9fe tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: 8dadc22e-64c8-46e3-b921-1eec8faf3bed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:59:08.361623 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-91e683c2-84e9-45e6-b17b-400ce970a9fe tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.554708 Oct 05 02:59:08.362949 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2843/5709] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Oct 5 02:59:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 05 02:59:08.376022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d285df8b-c851-48c7-b02e-ebcc37bc5ae6 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:59:08.378699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d285df8b-c851-48c7-b02e-ebcc37bc5ae6 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: 8dadc22e-64c8-46e3-b921-1eec8faf3bed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:08.529392 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d285df8b-c851-48c7-b02e-ebcc37bc5ae6 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "PUT /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed" status: 200 len: 991 microversion: 2.47 time: 0.141952 Oct 05 02:59:08.532310 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2867/5710] 10.222.0.16 () {62 vars in 1297 bytes} [Wed Oct 5 02:59:08 2022] PUT /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed => generated 991 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 02:59:08.563390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-90a011b4-a1eb-4663-b20a-156cdc9c6afa tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:08.564390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-90a011b4-a1eb-4663-b20a-156cdc9c6afa tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: 8dadc22e-64c8-46e3-b921-1eec8faf3bed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:08.988587 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-90a011b4-a1eb-4663-b20a-156cdc9c6afa tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:08.998195 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-90a011b4-a1eb-4663-b20a-156cdc9c6afa tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:09.001020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-90a011b4-a1eb-4663-b20a-156cdc9c6afa tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:09.012292 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-90a011b4-a1eb-4663-b20a-156cdc9c6afa tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed" status: 200 len: 1277 microversion: 2.47 time: 0.453800 Oct 05 02:59:09.013202 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2844/5711] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:59:08 2022] GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed => generated 1277 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:59:10.043712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c3f1d3c5-ceed-424d-904d-1837536429da tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:10.044556 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c3f1d3c5-ceed-424d-904d-1837536429da tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: 8dadc22e-64c8-46e3-b921-1eec8faf3bed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:10.090248 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3f1d3c5-ceed-424d-904d-1837536429da tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:10.090947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3f1d3c5-ceed-424d-904d-1837536429da tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:10.091217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3f1d3c5-ceed-424d-904d-1837536429da tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:10.091967 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3f1d3c5-ceed-424d-904d-1837536429da tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:10.093122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3f1d3c5-ceed-424d-904d-1837536429da tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:10.104926 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3f1d3c5-ceed-424d-904d-1837536429da tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:11.362719 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c3f1d3c5-ceed-424d-904d-1837536429da tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:11.378955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c3f1d3c5-ceed-424d-904d-1837536429da tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:11.384301 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c3f1d3c5-ceed-424d-904d-1837536429da tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:11.386493 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c3f1d3c5-ceed-424d-904d-1837536429da tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed" status: 200 len: 1273 microversion: 2.47 time: 1.346773 Oct 05 02:59:11.389629 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2868/5712] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:59:10 2022] GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed => generated 1273 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:59:12.420058 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-99f0a79e-8553-4235-9a57-e37f4ca77778 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:12.421531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-99f0a79e-8553-4235-9a57-e37f4ca77778 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: 8dadc22e-64c8-46e3-b921-1eec8faf3bed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:12.430842 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99f0a79e-8553-4235-9a57-e37f4ca77778 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:12.438232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99f0a79e-8553-4235-9a57-e37f4ca77778 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:12.439063 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99f0a79e-8553-4235-9a57-e37f4ca77778 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:12.440030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99f0a79e-8553-4235-9a57-e37f4ca77778 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:12.440853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99f0a79e-8553-4235-9a57-e37f4ca77778 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:12.442123 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99f0a79e-8553-4235-9a57-e37f4ca77778 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:13.062165 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-99f0a79e-8553-4235-9a57-e37f4ca77778 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:13.091717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-99f0a79e-8553-4235-9a57-e37f4ca77778 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:13.094713 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-99f0a79e-8553-4235-9a57-e37f4ca77778 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:13.140849 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-99f0a79e-8553-4235-9a57-e37f4ca77778 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed" status: 200 len: 1337 microversion: 2.47 time: 0.715798 Oct 05 02:59:13.149083 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2845/5713] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:59:12 2022] GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed => generated 1337 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:59:14.183611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3bbe1a98-d9e3-4178-a1be-fbac7378b7a0 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:14.185105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3bbe1a98-d9e3-4178-a1be-fbac7378b7a0 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: 8dadc22e-64c8-46e3-b921-1eec8faf3bed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:14.202870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bbe1a98-d9e3-4178-a1be-fbac7378b7a0 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:14.205641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bbe1a98-d9e3-4178-a1be-fbac7378b7a0 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:14.206412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bbe1a98-d9e3-4178-a1be-fbac7378b7a0 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:14.208605 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bbe1a98-d9e3-4178-a1be-fbac7378b7a0 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:14.213303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bbe1a98-d9e3-4178-a1be-fbac7378b7a0 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:14.214610 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bbe1a98-d9e3-4178-a1be-fbac7378b7a0 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:15.004671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3bbe1a98-d9e3-4178-a1be-fbac7378b7a0 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:15.015587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3bbe1a98-d9e3-4178-a1be-fbac7378b7a0 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:15.021858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3bbe1a98-d9e3-4178-a1be-fbac7378b7a0 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:15.023206 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3bbe1a98-d9e3-4178-a1be-fbac7378b7a0 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed" status: 200 len: 1335 microversion: 2.47 time: 0.847409 Oct 05 02:59:15.026111 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2869/5714] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:59:14 2022] GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed => generated 1335 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:59:16.057104 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dd597181-5b50-42dd-bcf1-aafd43679dbd tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:16.057971 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dd597181-5b50-42dd-bcf1-aafd43679dbd tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: 8dadc22e-64c8-46e3-b921-1eec8faf3bed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:16.087683 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd597181-5b50-42dd-bcf1-aafd43679dbd tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:16.097258 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd597181-5b50-42dd-bcf1-aafd43679dbd tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:16.101446 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd597181-5b50-42dd-bcf1-aafd43679dbd tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:16.102686 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd597181-5b50-42dd-bcf1-aafd43679dbd tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:16.103525 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd597181-5b50-42dd-bcf1-aafd43679dbd tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:16.104258 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd597181-5b50-42dd-bcf1-aafd43679dbd tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:16.498957 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dd597181-5b50-42dd-bcf1-aafd43679dbd tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:16.530671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dd597181-5b50-42dd-bcf1-aafd43679dbd tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:16.539871 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dd597181-5b50-42dd-bcf1-aafd43679dbd tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:16.541583 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dd597181-5b50-42dd-bcf1-aafd43679dbd tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed" status: 200 len: 1335 microversion: 2.47 time: 0.490314 Oct 05 02:59:16.550304 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2846/5715] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:59:16 2022] GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed => generated 1335 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:59:17.578713 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a1ab62f6-7203-4c4a-97a7-d01878c194b6 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:17.580006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a1ab62f6-7203-4c4a-97a7-d01878c194b6 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: 8dadc22e-64c8-46e3-b921-1eec8faf3bed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:17.592828 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a1ab62f6-7203-4c4a-97a7-d01878c194b6 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:17.593681 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a1ab62f6-7203-4c4a-97a7-d01878c194b6 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:17.595925 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a1ab62f6-7203-4c4a-97a7-d01878c194b6 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:17.596836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a1ab62f6-7203-4c4a-97a7-d01878c194b6 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:17.598441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a1ab62f6-7203-4c4a-97a7-d01878c194b6 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:17.599044 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a1ab62f6-7203-4c4a-97a7-d01878c194b6 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:17.715072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:18.249777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a1ab62f6-7203-4c4a-97a7-d01878c194b6 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:18.265396 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a1ab62f6-7203-4c4a-97a7-d01878c194b6 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:18.269180 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a1ab62f6-7203-4c4a-97a7-d01878c194b6 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:18.272972 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a1ab62f6-7203-4c4a-97a7-d01878c194b6 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed" status: 200 len: 1335 microversion: 2.47 time: 0.698020 Oct 05 02:59:18.273873 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2870/5716] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:59:17 2022] GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed => generated 1335 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:59:19.302425 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-290c586b-e3d5-40f8-a22f-caad07def743 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:19.303999 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-290c586b-e3d5-40f8-a22f-caad07def743 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: 8dadc22e-64c8-46e3-b921-1eec8faf3bed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:19.307656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:19.310498 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=14 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:19.336782 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-290c586b-e3d5-40f8-a22f-caad07def743 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:19.337289 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-290c586b-e3d5-40f8-a22f-caad07def743 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:19.354577 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-290c586b-e3d5-40f8-a22f-caad07def743 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:19.355342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-290c586b-e3d5-40f8-a22f-caad07def743 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:19.359367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-290c586b-e3d5-40f8-a22f-caad07def743 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:19.360207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-290c586b-e3d5-40f8-a22f-caad07def743 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:19.788793 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-290c586b-e3d5-40f8-a22f-caad07def743 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:19.798677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-290c586b-e3d5-40f8-a22f-caad07def743 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:19.800114 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-290c586b-e3d5-40f8-a22f-caad07def743 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:19.801331 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-290c586b-e3d5-40f8-a22f-caad07def743 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed" status: 200 len: 1356 microversion: 2.47 time: 0.503467 Oct 05 02:59:19.814783 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2847/5717] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:59:19 2022] GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed => generated 1356 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:59:19.844390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-350303d8-002a-42e3-a221-891ece34c441 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:59:19.858058 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-350303d8-002a-42e3-a221-891ece34c441 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: 8dadc22e-64c8-46e3-b921-1eec8faf3bed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:19.880603 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-350303d8-002a-42e3-a221-891ece34c441 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:19.883672 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-350303d8-002a-42e3-a221-891ece34c441 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:19.884220 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-350303d8-002a-42e3-a221-891ece34c441 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:19.888022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-350303d8-002a-42e3-a221-891ece34c441 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:19.891275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-350303d8-002a-42e3-a221-891ece34c441 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:19.892271 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-350303d8-002a-42e3-a221-891ece34c441 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:29.388326 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:29.510048 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-37a221b2-f6d8-4986-abf7-54ae0f716c0f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-345630077", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "10f7eabf-9521-4437-a838-b9f76044e586"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:59:29.797584 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=22 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:29.881658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=20 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:29.955420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=22 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:38.157772 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-37a221b2-f6d8-4986-abf7-54ae0f716c0f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] validate_networks() for [('10f7eabf-9521-4437-a838-b9f76044e586', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:59:38.191009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-350303d8-002a-42e3-a221-891ece34c441 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:59:38.192129 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-350303d8-002a-42e3-a221-891ece34c441 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:59:38.193181 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-350303d8-002a-42e3-a221-891ece34c441 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:59:38.193790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-350303d8-002a-42e3-a221-891ece34c441 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:59:38.194605 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-350303d8-002a-42e3-a221-891ece34c441 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:59:38.351051 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-350303d8-002a-42e3-a221-891ece34c441 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: 8dadc22e-64c8-46e3-b921-1eec8faf3bed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:38.393087 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-350303d8-002a-42e3-a221-891ece34c441 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:38.398006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-350303d8-002a-42e3-a221-891ece34c441 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:38.398486 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-350303d8-002a-42e3-a221-891ece34c441 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:38.401526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-350303d8-002a-42e3-a221-891ece34c441 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:38.403452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-350303d8-002a-42e3-a221-891ece34c441 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:38.408591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-350303d8-002a-42e3-a221-891ece34c441 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:38.485569 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-350303d8-002a-42e3-a221-891ece34c441 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "POST /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed/action" status: 202 len: 1078 microversion: 2.47 time: 18.647660 Oct 05 02:59:38.488604 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2871/5718] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Oct 5 02:59:19 2022] POST /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed/action => generated 1078 bytes in 18652 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 05 02:59:38.507358 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d9eeb840-677e-4f06-8b8d-ab49679897a4 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:38.508561 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d9eeb840-677e-4f06-8b8d-ab49679897a4 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: 8dadc22e-64c8-46e3-b921-1eec8faf3bed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:38.533742 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d9eeb840-677e-4f06-8b8d-ab49679897a4 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:38.534368 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d9eeb840-677e-4f06-8b8d-ab49679897a4 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:38.540720 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d9eeb840-677e-4f06-8b8d-ab49679897a4 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:38.542685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d9eeb840-677e-4f06-8b8d-ab49679897a4 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:38.543187 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d9eeb840-677e-4f06-8b8d-ab49679897a4 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:38.543634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d9eeb840-677e-4f06-8b8d-ab49679897a4 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:38.762366 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d9eeb840-677e-4f06-8b8d-ab49679897a4 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:38.786584 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d9eeb840-677e-4f06-8b8d-ab49679897a4 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:38.788036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d9eeb840-677e-4f06-8b8d-ab49679897a4 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:38.789295 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d9eeb840-677e-4f06-8b8d-ab49679897a4 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed" status: 200 len: 1365 microversion: 2.47 time: 0.286339 Oct 05 02:59:38.790037 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2872/5719] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:59:38 2022] GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed => generated 1365 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:59:39.080847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-37a221b2-f6d8-4986-abf7-54ae0f716c0f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:59:39.081644 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-37a221b2-f6d8-4986-abf7-54ae0f716c0f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:59:39.082371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-37a221b2-f6d8-4986-abf7-54ae0f716c0f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:59:39.083052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-37a221b2-f6d8-4986-abf7-54ae0f716c0f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:59:39.083844 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-37a221b2-f6d8-4986-abf7-54ae0f716c0f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:59:39.114991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-37a221b2-f6d8-4986-abf7-54ae0f716c0f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:39.116146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-37a221b2-f6d8-4986-abf7-54ae0f716c0f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:39.119466 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-37a221b2-f6d8-4986-abf7-54ae0f716c0f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:39.121671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-37a221b2-f6d8-4986-abf7-54ae0f716c0f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:39.126531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-37a221b2-f6d8-4986-abf7-54ae0f716c0f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:39.127632 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-37a221b2-f6d8-4986-abf7-54ae0f716c0f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:39.184605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-37a221b2-f6d8-4986-abf7-54ae0f716c0f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Getting quotas for project f477959bd24b4db881b62dab54861aa5. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:59:39.202679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-37a221b2-f6d8-4986-abf7-54ae0f716c0f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Getting quotas for user 12d0128e850f4f22a2172800c44074a4 and project f477959bd24b4db881b62dab54861aa5. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:59:39.229234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-37a221b2-f6d8-4986-abf7-54ae0f716c0f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 02:59:39.235453 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-37a221b2-f6d8-4986-abf7-54ae0f716c0f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 02:59:39.298560 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-37a221b2-f6d8-4986-abf7-54ae0f716c0f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.945470 Oct 05 02:59:39.300245 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2848/5720] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:59:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 9948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 02:59:39.311213 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bf688191-dde9-4bbf-b182-542a0b33fa42 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:39.312742 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bf688191-dde9-4bbf-b182-542a0b33fa42 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:39.431952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bf688191-dde9-4bbf-b182-542a0b33fa42 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:39.444287 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bf688191-dde9-4bbf-b182-542a0b33fa42 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7" status: 200 len: 1192 microversion: 2.1 time: 0.136743 Oct 05 02:59:39.445938 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2873/5721] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:59:39 2022] GET /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7 => generated 1192 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:59:39.820649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8838d081-754a-4da1-94f9-fda678d732c2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:39.822166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8838d081-754a-4da1-94f9-fda678d732c2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: 8dadc22e-64c8-46e3-b921-1eec8faf3bed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:39.841259 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8838d081-754a-4da1-94f9-fda678d732c2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:39.844825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8838d081-754a-4da1-94f9-fda678d732c2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:39.846372 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8838d081-754a-4da1-94f9-fda678d732c2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:39.852000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8838d081-754a-4da1-94f9-fda678d732c2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:39.853796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8838d081-754a-4da1-94f9-fda678d732c2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:39.856331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8838d081-754a-4da1-94f9-fda678d732c2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:40.339734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8838d081-754a-4da1-94f9-fda678d732c2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:40.367240 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8838d081-754a-4da1-94f9-fda678d732c2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:40.379753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8838d081-754a-4da1-94f9-fda678d732c2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:40.389443 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8838d081-754a-4da1-94f9-fda678d732c2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed" status: 200 len: 1365 microversion: 2.47 time: 0.573274 Oct 05 02:59:40.406469 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2849/5722] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:59:39 2022] GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed => generated 1365 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:59:40.471791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9e2f1750-de15-4727-8336-6e0b42f2ff95 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:40.472404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9e2f1750-de15-4727-8336-6e0b42f2ff95 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:40.494917 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9e2f1750-de15-4727-8336-6e0b42f2ff95 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:40.500365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9e2f1750-de15-4727-8336-6e0b42f2ff95 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:40.500835 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9e2f1750-de15-4727-8336-6e0b42f2ff95 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:40.501660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9e2f1750-de15-4727-8336-6e0b42f2ff95 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:40.507445 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9e2f1750-de15-4727-8336-6e0b42f2ff95 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:40.508300 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9e2f1750-de15-4727-8336-6e0b42f2ff95 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:40.923882 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9e2f1750-de15-4727-8336-6e0b42f2ff95 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:40.933484 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9e2f1750-de15-4727-8336-6e0b42f2ff95 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7" status: 200 len: 1188 microversion: 2.1 time: 0.465561 Oct 05 02:59:40.953645 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2874/5723] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:59:40 2022] GET /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7 => generated 1188 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:59:41.426873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-186c2d10-931f-443b-904d-b26387d23397 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:41.429984 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-186c2d10-931f-443b-904d-b26387d23397 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: 8dadc22e-64c8-46e3-b921-1eec8faf3bed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:41.458211 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-186c2d10-931f-443b-904d-b26387d23397 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:41.459173 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-186c2d10-931f-443b-904d-b26387d23397 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:41.459638 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-186c2d10-931f-443b-904d-b26387d23397 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:41.462900 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-186c2d10-931f-443b-904d-b26387d23397 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:41.467308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-186c2d10-931f-443b-904d-b26387d23397 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:41.467993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-186c2d10-931f-443b-904d-b26387d23397 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:41.823249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-186c2d10-931f-443b-904d-b26387d23397 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:41.846803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-186c2d10-931f-443b-904d-b26387d23397 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:41.851938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-186c2d10-931f-443b-904d-b26387d23397 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:41.853554 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-186c2d10-931f-443b-904d-b26387d23397 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed" status: 200 len: 1365 microversion: 2.47 time: 0.434793 Oct 05 02:59:41.854138 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2850/5724] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:59:41 2022] GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed => generated 1365 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:59:41.959905 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8f1582e8-dcd7-4c55-a0a0-46333cdb6fa9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:41.961947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8f1582e8-dcd7-4c55-a0a0-46333cdb6fa9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:41.978285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f1582e8-dcd7-4c55-a0a0-46333cdb6fa9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:41.980150 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f1582e8-dcd7-4c55-a0a0-46333cdb6fa9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:41.980801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f1582e8-dcd7-4c55-a0a0-46333cdb6fa9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:41.981932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f1582e8-dcd7-4c55-a0a0-46333cdb6fa9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:41.983184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f1582e8-dcd7-4c55-a0a0-46333cdb6fa9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:41.984769 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8f1582e8-dcd7-4c55-a0a0-46333cdb6fa9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:42.217742 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8f1582e8-dcd7-4c55-a0a0-46333cdb6fa9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:42.232026 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8f1582e8-dcd7-4c55-a0a0-46333cdb6fa9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7" status: 200 len: 1250 microversion: 2.1 time: 0.275294 Oct 05 02:59:42.234366 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2875/5725] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:59:41 2022] GET /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7 => generated 1250 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:59:42.881156 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-61e37dc5-d529-4037-bb6c-f516c379bf3c tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:42.881913 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-61e37dc5-d529-4037-bb6c-f516c379bf3c tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: 8dadc22e-64c8-46e3-b921-1eec8faf3bed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:42.900394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-61e37dc5-d529-4037-bb6c-f516c379bf3c tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:42.901737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-61e37dc5-d529-4037-bb6c-f516c379bf3c tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:42.902527 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-61e37dc5-d529-4037-bb6c-f516c379bf3c tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:42.905299 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-61e37dc5-d529-4037-bb6c-f516c379bf3c tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:42.910690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-61e37dc5-d529-4037-bb6c-f516c379bf3c tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:42.912763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-61e37dc5-d529-4037-bb6c-f516c379bf3c tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:43.180135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-61e37dc5-d529-4037-bb6c-f516c379bf3c tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:43.200425 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-61e37dc5-d529-4037-bb6c-f516c379bf3c tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:43.203337 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-61e37dc5-d529-4037-bb6c-f516c379bf3c tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:43.205473 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-61e37dc5-d529-4037-bb6c-f516c379bf3c tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed" status: 200 len: 1365 microversion: 2.47 time: 0.328376 Oct 05 02:59:43.208639 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2851/5726] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:59:42 2022] GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed => generated 1365 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:59:43.261282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e7e2fe53-14ed-4488-be66-e93602bbbd12 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:43.261941 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e7e2fe53-14ed-4488-be66-e93602bbbd12 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:43.281810 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7e2fe53-14ed-4488-be66-e93602bbbd12 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:43.286620 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7e2fe53-14ed-4488-be66-e93602bbbd12 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:43.287380 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7e2fe53-14ed-4488-be66-e93602bbbd12 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:43.292880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7e2fe53-14ed-4488-be66-e93602bbbd12 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:43.294058 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7e2fe53-14ed-4488-be66-e93602bbbd12 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:43.297518 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7e2fe53-14ed-4488-be66-e93602bbbd12 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:43.806420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e7e2fe53-14ed-4488-be66-e93602bbbd12 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:43.823728 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e7e2fe53-14ed-4488-be66-e93602bbbd12 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7" status: 200 len: 1292 microversion: 2.1 time: 0.564726 Oct 05 02:59:43.830341 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2876/5727] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:59:43 2022] GET /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7 => generated 1292 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:59:44.240741 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cd423cc9-fe51-4907-8d9d-4ff55027d0cd tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:44.242252 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cd423cc9-fe51-4907-8d9d-4ff55027d0cd tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: 8dadc22e-64c8-46e3-b921-1eec8faf3bed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:44.258120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd423cc9-fe51-4907-8d9d-4ff55027d0cd tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:44.260023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd423cc9-fe51-4907-8d9d-4ff55027d0cd tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:44.261447 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd423cc9-fe51-4907-8d9d-4ff55027d0cd tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:44.275368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd423cc9-fe51-4907-8d9d-4ff55027d0cd tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:44.276815 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd423cc9-fe51-4907-8d9d-4ff55027d0cd tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:44.277545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd423cc9-fe51-4907-8d9d-4ff55027d0cd tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:44.703333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cd423cc9-fe51-4907-8d9d-4ff55027d0cd tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:44.719174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cd423cc9-fe51-4907-8d9d-4ff55027d0cd tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:44.724675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cd423cc9-fe51-4907-8d9d-4ff55027d0cd tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:44.745495 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cd423cc9-fe51-4907-8d9d-4ff55027d0cd tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed" status: 200 len: 1365 microversion: 2.47 time: 0.505997 Oct 05 02:59:44.750407 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2852/5728] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:59:44 2022] GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed => generated 1365 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:59:44.865353 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4f05a753-770b-4790-9554-168e22155119 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:44.867577 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4f05a753-770b-4790-9554-168e22155119 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:44.884592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f05a753-770b-4790-9554-168e22155119 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:44.886978 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f05a753-770b-4790-9554-168e22155119 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:44.887900 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f05a753-770b-4790-9554-168e22155119 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:44.889445 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f05a753-770b-4790-9554-168e22155119 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:44.891895 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f05a753-770b-4790-9554-168e22155119 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:44.892366 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f05a753-770b-4790-9554-168e22155119 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:45.337478 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4f05a753-770b-4790-9554-168e22155119 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:45.349558 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4f05a753-770b-4790-9554-168e22155119 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7" status: 200 len: 1292 microversion: 2.1 time: 0.487043 Oct 05 02:59:45.360723 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2877/5729] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:59:44 2022] GET /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7 => generated 1292 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:59:45.586011 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-36027a5f-1139-485c-b765-a0b8c7a68861 req-fe3614b3-c071-483f-aa35-b840ce886dab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7", "tag": "c6288e2b-cd6c-4e8f-b7d8-e00bfd946a12"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:59:45.672849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-36027a5f-1139-485c-b765-a0b8c7a68861 req-fe3614b3-c071-483f-aa35-b840ce886dab service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:45.673353 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-36027a5f-1139-485c-b765-a0b8c7a68861 req-fe3614b3-c071-483f-aa35-b840ce886dab service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:45.680070 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-36027a5f-1139-485c-b765-a0b8c7a68861 req-fe3614b3-c071-483f-aa35-b840ce886dab service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:45.722130 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-36027a5f-1139-485c-b765-a0b8c7a68861 req-fe3614b3-c071-483f-aa35-b840ce886dab service nova] Creating event network-changed:c6288e2b-cd6c-4e8f-b7d8-e00bfd946a12 for instance c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7 on n-h1-858272-3 Oct 05 02:59:45.741799 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-36027a5f-1139-485c-b765-a0b8c7a68861 req-fe3614b3-c071-483f-aa35-b840ce886dab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161515 Oct 05 02:59:45.750840 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2853/5730] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:59:45.776632 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-afa00537-da55-4530-bc36-aadfd8ac908e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:45.778177 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-afa00537-da55-4530-bc36-aadfd8ac908e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: 8dadc22e-64c8-46e3-b921-1eec8faf3bed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:45.816346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-afa00537-da55-4530-bc36-aadfd8ac908e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:45.816859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-afa00537-da55-4530-bc36-aadfd8ac908e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:45.817352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-afa00537-da55-4530-bc36-aadfd8ac908e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:45.818075 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-afa00537-da55-4530-bc36-aadfd8ac908e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:45.818534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-afa00537-da55-4530-bc36-aadfd8ac908e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:45.818961 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-afa00537-da55-4530-bc36-aadfd8ac908e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:46.110190 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-afa00537-da55-4530-bc36-aadfd8ac908e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:46.137195 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-afa00537-da55-4530-bc36-aadfd8ac908e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:46.149489 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-afa00537-da55-4530-bc36-aadfd8ac908e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:46.154765 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-afa00537-da55-4530-bc36-aadfd8ac908e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed" status: 200 len: 1365 microversion: 2.47 time: 0.382334 Oct 05 02:59:46.173047 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2878/5731] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:59:45 2022] GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed => generated 1365 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:59:46.383439 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8adcb659-a50b-462a-8ea7-948c053b1482 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:46.384886 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8adcb659-a50b-462a-8ea7-948c053b1482 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:46.394207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8adcb659-a50b-462a-8ea7-948c053b1482 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:46.401710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8adcb659-a50b-462a-8ea7-948c053b1482 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:46.405710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8adcb659-a50b-462a-8ea7-948c053b1482 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:46.409797 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8adcb659-a50b-462a-8ea7-948c053b1482 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:46.414477 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8adcb659-a50b-462a-8ea7-948c053b1482 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:46.419054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8adcb659-a50b-462a-8ea7-948c053b1482 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:46.884239 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8adcb659-a50b-462a-8ea7-948c053b1482 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:46.896332 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8adcb659-a50b-462a-8ea7-948c053b1482 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7" status: 200 len: 1292 microversion: 2.1 time: 0.518186 Oct 05 02:59:46.902493 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2854/5732] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:59:46 2022] GET /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7 => generated 1292 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:59:47.191299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a1dd21e2-a40b-4f12-a6f3-2477d68f4042 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:47.193169 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a1dd21e2-a40b-4f12-a6f3-2477d68f4042 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: 8dadc22e-64c8-46e3-b921-1eec8faf3bed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:47.217292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a1dd21e2-a40b-4f12-a6f3-2477d68f4042 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:47.218661 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a1dd21e2-a40b-4f12-a6f3-2477d68f4042 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:47.220842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a1dd21e2-a40b-4f12-a6f3-2477d68f4042 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:47.223211 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a1dd21e2-a40b-4f12-a6f3-2477d68f4042 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:47.224775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a1dd21e2-a40b-4f12-a6f3-2477d68f4042 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:47.225432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a1dd21e2-a40b-4f12-a6f3-2477d68f4042 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:47.477394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a1dd21e2-a40b-4f12-a6f3-2477d68f4042 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:47.512354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a1dd21e2-a40b-4f12-a6f3-2477d68f4042 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:47.516358 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a1dd21e2-a40b-4f12-a6f3-2477d68f4042 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:47.520515 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a1dd21e2-a40b-4f12-a6f3-2477d68f4042 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed" status: 200 len: 1365 microversion: 2.47 time: 0.333944 Oct 05 02:59:47.534213 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2879/5733] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:59:47 2022] GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed => generated 1365 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:59:47.974730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-52c5e235-2c90-4b00-88a7-760b957ecb67 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:47.975408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-52c5e235-2c90-4b00-88a7-760b957ecb67 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:48.009311 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52c5e235-2c90-4b00-88a7-760b957ecb67 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:48.009826 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52c5e235-2c90-4b00-88a7-760b957ecb67 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:48.010274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52c5e235-2c90-4b00-88a7-760b957ecb67 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:48.011017 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52c5e235-2c90-4b00-88a7-760b957ecb67 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:48.011481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52c5e235-2c90-4b00-88a7-760b957ecb67 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:48.011907 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52c5e235-2c90-4b00-88a7-760b957ecb67 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:48.589420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-21207532-98bf-41f2-bd92-bc8fb4e5bfd2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:48.592579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-21207532-98bf-41f2-bd92-bc8fb4e5bfd2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: 8dadc22e-64c8-46e3-b921-1eec8faf3bed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:48.622412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-21207532-98bf-41f2-bd92-bc8fb4e5bfd2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:48.624049 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-21207532-98bf-41f2-bd92-bc8fb4e5bfd2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:48.629014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-21207532-98bf-41f2-bd92-bc8fb4e5bfd2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:48.633659 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-21207532-98bf-41f2-bd92-bc8fb4e5bfd2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:48.638871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-21207532-98bf-41f2-bd92-bc8fb4e5bfd2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:48.642945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-21207532-98bf-41f2-bd92-bc8fb4e5bfd2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:48.993480 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-52c5e235-2c90-4b00-88a7-760b957ecb67 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:49.028638 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-52c5e235-2c90-4b00-88a7-760b957ecb67 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7" status: 200 len: 1292 microversion: 2.1 time: 1.104667 Oct 05 02:59:49.041780 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2855/5734] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:59:47 2022] GET /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7 => generated 1292 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:59:49.108966 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-21207532-98bf-41f2-bd92-bc8fb4e5bfd2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:49.166958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-21207532-98bf-41f2-bd92-bc8fb4e5bfd2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:49.186806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-21207532-98bf-41f2-bd92-bc8fb4e5bfd2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:49.198163 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-21207532-98bf-41f2-bd92-bc8fb4e5bfd2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed" status: 200 len: 1365 microversion: 2.47 time: 0.613496 Oct 05 02:59:49.220335 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2880/5735] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:59:48 2022] GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed => generated 1365 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:59:50.124941 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:50.127224 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:50.133007 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-78e6c6c3-54c2-4bfa-bdc3-60c00de982c9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:50.134198 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-78e6c6c3-54c2-4bfa-bdc3-60c00de982c9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:50.155876 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78e6c6c3-54c2-4bfa-bdc3-60c00de982c9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:50.161746 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78e6c6c3-54c2-4bfa-bdc3-60c00de982c9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:50.163042 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78e6c6c3-54c2-4bfa-bdc3-60c00de982c9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:50.164778 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78e6c6c3-54c2-4bfa-bdc3-60c00de982c9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:50.165629 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78e6c6c3-54c2-4bfa-bdc3-60c00de982c9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:50.168665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78e6c6c3-54c2-4bfa-bdc3-60c00de982c9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:50.268754 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ad89d68e-6e59-40dd-ae47-6a8c37496297 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:50.270072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ad89d68e-6e59-40dd-ae47-6a8c37496297 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: 8dadc22e-64c8-46e3-b921-1eec8faf3bed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:50.278431 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:50.283894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad89d68e-6e59-40dd-ae47-6a8c37496297 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:50.287789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad89d68e-6e59-40dd-ae47-6a8c37496297 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:50.289202 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad89d68e-6e59-40dd-ae47-6a8c37496297 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:50.291745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad89d68e-6e59-40dd-ae47-6a8c37496297 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:50.293464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad89d68e-6e59-40dd-ae47-6a8c37496297 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:50.294151 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad89d68e-6e59-40dd-ae47-6a8c37496297 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:50.798564 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ad89d68e-6e59-40dd-ae47-6a8c37496297 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:50.808205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ad89d68e-6e59-40dd-ae47-6a8c37496297 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:50.821334 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ad89d68e-6e59-40dd-ae47-6a8c37496297 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:50.830667 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ad89d68e-6e59-40dd-ae47-6a8c37496297 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed" status: 200 len: 1365 microversion: 2.47 time: 0.566057 Oct 05 02:59:50.836088 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2881/5736] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:59:50 2022] GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed => generated 1365 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:59:51.135640 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-78e6c6c3-54c2-4bfa-bdc3-60c00de982c9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:51.151823 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-78e6c6c3-54c2-4bfa-bdc3-60c00de982c9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7" status: 200 len: 1292 microversion: 2.1 time: 1.027660 Oct 05 02:59:51.157117 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2856/5737] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:59:50 2022] GET /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7 => generated 1292 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:59:51.884159 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ff42420d-43d5-4cee-87d7-3d9fa2351929 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:51.884861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ff42420d-43d5-4cee-87d7-3d9fa2351929 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: 8dadc22e-64c8-46e3-b921-1eec8faf3bed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:51.894145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff42420d-43d5-4cee-87d7-3d9fa2351929 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:51.894853 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff42420d-43d5-4cee-87d7-3d9fa2351929 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:51.895338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff42420d-43d5-4cee-87d7-3d9fa2351929 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:51.897043 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff42420d-43d5-4cee-87d7-3d9fa2351929 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:51.897669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff42420d-43d5-4cee-87d7-3d9fa2351929 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:51.898631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff42420d-43d5-4cee-87d7-3d9fa2351929 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:52.007445 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ff42420d-43d5-4cee-87d7-3d9fa2351929 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:52.033432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ff42420d-43d5-4cee-87d7-3d9fa2351929 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:52.035352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ff42420d-43d5-4cee-87d7-3d9fa2351929 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:52.037165 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ff42420d-43d5-4cee-87d7-3d9fa2351929 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed" status: 200 len: 1371 microversion: 2.47 time: 0.158024 Oct 05 02:59:52.037746 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2882/5738] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:59:51 2022] GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:59:52.195189 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fe210398-593f-4c44-afac-8b4e27b152e5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:52.196557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fe210398-593f-4c44-afac-8b4e27b152e5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:52.211973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe210398-593f-4c44-afac-8b4e27b152e5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:52.218553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe210398-593f-4c44-afac-8b4e27b152e5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:52.219248 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe210398-593f-4c44-afac-8b4e27b152e5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:52.221202 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe210398-593f-4c44-afac-8b4e27b152e5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:52.222687 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe210398-593f-4c44-afac-8b4e27b152e5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:52.224786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe210398-593f-4c44-afac-8b4e27b152e5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:52.750517 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fe210398-593f-4c44-afac-8b4e27b152e5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:52.767178 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fe210398-593f-4c44-afac-8b4e27b152e5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7" status: 200 len: 1292 microversion: 2.1 time: 0.576065 Oct 05 02:59:52.767524 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2857/5739] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:59:52 2022] GET /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7 => generated 1292 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:59:53.069261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ae701b0b-c80b-4818-a23f-d41423cf10e8 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:53.070476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ae701b0b-c80b-4818-a23f-d41423cf10e8 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: 8dadc22e-64c8-46e3-b921-1eec8faf3bed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:53.080745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae701b0b-c80b-4818-a23f-d41423cf10e8 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:53.081964 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae701b0b-c80b-4818-a23f-d41423cf10e8 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:53.082590 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae701b0b-c80b-4818-a23f-d41423cf10e8 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:53.083641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae701b0b-c80b-4818-a23f-d41423cf10e8 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:53.084252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae701b0b-c80b-4818-a23f-d41423cf10e8 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:53.084834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae701b0b-c80b-4818-a23f-d41423cf10e8 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:53.180202 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ae701b0b-c80b-4818-a23f-d41423cf10e8 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:53.197570 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ae701b0b-c80b-4818-a23f-d41423cf10e8 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:53.199135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ae701b0b-c80b-4818-a23f-d41423cf10e8 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:53.200386 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ae701b0b-c80b-4818-a23f-d41423cf10e8 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed" status: 200 len: 1371 microversion: 2.47 time: 0.136772 Oct 05 02:59:53.222465 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2883/5740] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:59:53 2022] GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:59:53.790404 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4987cb3a-3a10-410e-b2b3-05ed447f4120 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:53.791055 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4987cb3a-3a10-410e-b2b3-05ed447f4120 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:53.800565 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4987cb3a-3a10-410e-b2b3-05ed447f4120 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:53.801650 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4987cb3a-3a10-410e-b2b3-05ed447f4120 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:53.803400 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4987cb3a-3a10-410e-b2b3-05ed447f4120 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:53.804548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4987cb3a-3a10-410e-b2b3-05ed447f4120 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:53.805284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4987cb3a-3a10-410e-b2b3-05ed447f4120 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:53.806147 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4987cb3a-3a10-410e-b2b3-05ed447f4120 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:54.102752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4987cb3a-3a10-410e-b2b3-05ed447f4120 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:54.111718 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4987cb3a-3a10-410e-b2b3-05ed447f4120 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7" status: 200 len: 1292 microversion: 2.1 time: 0.325289 Oct 05 02:59:54.112334 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2858/5741] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:59:53 2022] GET /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7 => generated 1292 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:59:54.230025 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2c1e851a-2be5-41e6-9f03-211a0dca4acf tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:54.230891 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2c1e851a-2be5-41e6-9f03-211a0dca4acf tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: 8dadc22e-64c8-46e3-b921-1eec8faf3bed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:54.243715 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c1e851a-2be5-41e6-9f03-211a0dca4acf tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:54.245211 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c1e851a-2be5-41e6-9f03-211a0dca4acf tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:54.247018 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c1e851a-2be5-41e6-9f03-211a0dca4acf tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:54.250648 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c1e851a-2be5-41e6-9f03-211a0dca4acf tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:54.251397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c1e851a-2be5-41e6-9f03-211a0dca4acf tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:54.251925 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c1e851a-2be5-41e6-9f03-211a0dca4acf tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:54.473803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-9b26223a-9bd6-4a4d-b518-8c734a71c6be req-0304fa5c-2e64-4e70-94a4-0055ac3a299e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7", "name": "network-vif-plugged", "status": "completed", "tag": "c6288e2b-cd6c-4e8f-b7d8-e00bfd946a12"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:59:54.491931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2c1e851a-2be5-41e6-9f03-211a0dca4acf tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:54.496239 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-9b26223a-9bd6-4a4d-b518-8c734a71c6be req-0304fa5c-2e64-4e70-94a4-0055ac3a299e service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:54.498769 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-9b26223a-9bd6-4a4d-b518-8c734a71c6be req-0304fa5c-2e64-4e70-94a4-0055ac3a299e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:54.501295 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-9b26223a-9bd6-4a4d-b518-8c734a71c6be req-0304fa5c-2e64-4e70-94a4-0055ac3a299e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:54.502108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2c1e851a-2be5-41e6-9f03-211a0dca4acf tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:54.510062 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2c1e851a-2be5-41e6-9f03-211a0dca4acf tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:54.511568 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2c1e851a-2be5-41e6-9f03-211a0dca4acf tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed" status: 200 len: 1371 microversion: 2.47 time: 0.285806 Oct 05 02:59:54.538734 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2884/5742] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:59:54 2022] GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed => generated 1371 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:59:54.545385 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-9b26223a-9bd6-4a4d-b518-8c734a71c6be req-0304fa5c-2e64-4e70-94a4-0055ac3a299e service nova] Creating event network-vif-plugged:c6288e2b-cd6c-4e8f-b7d8-e00bfd946a12 for instance c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7 on n-h1-858272-3 Oct 05 02:59:54.558483 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-9b26223a-9bd6-4a4d-b518-8c734a71c6be req-0304fa5c-2e64-4e70-94a4-0055ac3a299e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091649 Oct 05 02:59:54.561225 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2859/5743] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 02:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 02:59:55.135108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bf549b2e-2c54-4d5a-b3b0-f647161cc0ee tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:55.136280 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bf549b2e-2c54-4d5a-b3b0-f647161cc0ee tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:55.145144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf549b2e-2c54-4d5a-b3b0-f647161cc0ee tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:55.148305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf549b2e-2c54-4d5a-b3b0-f647161cc0ee tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:55.149130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf549b2e-2c54-4d5a-b3b0-f647161cc0ee tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:55.154924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf549b2e-2c54-4d5a-b3b0-f647161cc0ee tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:55.155613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf549b2e-2c54-4d5a-b3b0-f647161cc0ee tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:55.157111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf549b2e-2c54-4d5a-b3b0-f647161cc0ee tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:55.545547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bbbbf034-4836-4a3e-887e-fb3a245b6c63 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:55.546570 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bbbbf034-4836-4a3e-887e-fb3a245b6c63 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: 8dadc22e-64c8-46e3-b921-1eec8faf3bed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:55.558846 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bbbbf034-4836-4a3e-887e-fb3a245b6c63 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:55.569600 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bbbbf034-4836-4a3e-887e-fb3a245b6c63 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:55.573885 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bbbbf034-4836-4a3e-887e-fb3a245b6c63 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:55.574819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bbbbf034-4836-4a3e-887e-fb3a245b6c63 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:55.575414 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bbbbf034-4836-4a3e-887e-fb3a245b6c63 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:55.576480 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bbbbf034-4836-4a3e-887e-fb3a245b6c63 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:55.678930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bf549b2e-2c54-4d5a-b3b0-f647161cc0ee tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:55.688668 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bf549b2e-2c54-4d5a-b3b0-f647161cc0ee tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7" status: 200 len: 1292 microversion: 2.1 time: 0.557835 Oct 05 02:59:55.693637 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2885/5744] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:59:55 2022] GET /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7 => generated 1292 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:59:55.852417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bbbbf034-4836-4a3e-887e-fb3a245b6c63 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:55.869381 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bbbbf034-4836-4a3e-887e-fb3a245b6c63 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:55.875928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bbbbf034-4836-4a3e-887e-fb3a245b6c63 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:55.877757 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bbbbf034-4836-4a3e-887e-fb3a245b6c63 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed" status: 200 len: 1356 microversion: 2.47 time: 0.337800 Oct 05 02:59:55.893084 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2860/5745] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:59:55 2022] GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed => generated 1356 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 02:59:55.910088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1c9e9332-3f0d-4016-849f-debad932b51e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:55.915468 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1c9e9332-3f0d-4016-849f-debad932b51e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:55.916364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1c9e9332-3f0d-4016-849f-debad932b51e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Searching by: {'deleted': False, 'project_id': 'daa97e7f606c4374a629c460de97aed9'} {{(pid=122319) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 02:59:55.922655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c9e9332-3f0d-4016-849f-debad932b51e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:55.926083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c9e9332-3f0d-4016-849f-debad932b51e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:55.926083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c9e9332-3f0d-4016-849f-debad932b51e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:55.926083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c9e9332-3f0d-4016-849f-debad932b51e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:55.926083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c9e9332-3f0d-4016-849f-debad932b51e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:55.926083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c9e9332-3f0d-4016-849f-debad932b51e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:56.119370 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.multi_cell_list [None req-1c9e9332-3f0d-4016-849f-debad932b51e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122319) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 02:59:56.304621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:56.376684 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1c9e9332-3f0d-4016-849f-debad932b51e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:56.389555 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c9e9332-3f0d-4016-849f-debad932b51e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:56.389555 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c9e9332-3f0d-4016-849f-debad932b51e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:56.389807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c9e9332-3f0d-4016-849f-debad932b51e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:56.410092 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1c9e9332-3f0d-4016-849f-debad932b51e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:56.412458 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1c9e9332-3f0d-4016-849f-debad932b51e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:56.521719 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1c9e9332-3f0d-4016-849f-debad932b51e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.615363 Oct 05 02:59:56.534932 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2886/5746] 10.222.0.16 () {60 vars in 1187 bytes} [Wed Oct 5 02:59:55 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:59:56.558509 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5b48d860-f521-4f42-a849-6b155ce18d71 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:56.559650 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5b48d860-f521-4f42-a849-6b155ce18d71 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: 8dadc22e-64c8-46e3-b921-1eec8faf3bed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:56.569688 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b48d860-f521-4f42-a849-6b155ce18d71 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:56.570447 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b48d860-f521-4f42-a849-6b155ce18d71 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:56.571263 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b48d860-f521-4f42-a849-6b155ce18d71 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:56.572195 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b48d860-f521-4f42-a849-6b155ce18d71 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:56.572816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b48d860-f521-4f42-a849-6b155ce18d71 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:56.573567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b48d860-f521-4f42-a849-6b155ce18d71 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:56.610833 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5b48d860-f521-4f42-a849-6b155ce18d71 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: 8dadc22e-64c8-46e3-b921-1eec8faf3bed] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 02:59:56.715702 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c90759d7-1cf0-41b7-8f99-ade263c37b0a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:56.717180 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c90759d7-1cf0-41b7-8f99-ade263c37b0a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:56.726939 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c90759d7-1cf0-41b7-8f99-ade263c37b0a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:56.731478 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c90759d7-1cf0-41b7-8f99-ade263c37b0a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:56.732375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c90759d7-1cf0-41b7-8f99-ade263c37b0a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:56.734717 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c90759d7-1cf0-41b7-8f99-ade263c37b0a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:56.736157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c90759d7-1cf0-41b7-8f99-ade263c37b0a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:56.738047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c90759d7-1cf0-41b7-8f99-ade263c37b0a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:56.750910 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5b48d860-f521-4f42-a849-6b155ce18d71 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed" status: 204 len: 0 microversion: 2.47 time: 0.197891 Oct 05 02:59:56.756736 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2861/5747] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 5 02:59:56 2022] DELETE /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 02:59:56.788162 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a5daa96d-50c4-42f6-8383-e23f9947568b tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:56.789548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a5daa96d-50c4-42f6-8383-e23f9947568b tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: 8dadc22e-64c8-46e3-b921-1eec8faf3bed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:56.808662 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5daa96d-50c4-42f6-8383-e23f9947568b tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:56.809608 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5daa96d-50c4-42f6-8383-e23f9947568b tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:56.811013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5daa96d-50c4-42f6-8383-e23f9947568b tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:56.812196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5daa96d-50c4-42f6-8383-e23f9947568b tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:56.813538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5daa96d-50c4-42f6-8383-e23f9947568b tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:56.815921 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5daa96d-50c4-42f6-8383-e23f9947568b tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:57.064424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a5daa96d-50c4-42f6-8383-e23f9947568b tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:57.080283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a5daa96d-50c4-42f6-8383-e23f9947568b tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:57.081960 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a5daa96d-50c4-42f6-8383-e23f9947568b tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:57.086571 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a5daa96d-50c4-42f6-8383-e23f9947568b tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed" status: 200 len: 1362 microversion: 2.47 time: 0.322128 Oct 05 02:59:57.098832 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2862/5748] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:59:56 2022] GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed => generated 1362 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:59:57.246934 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c90759d7-1cf0-41b7-8f99-ade263c37b0a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:57.274974 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c90759d7-1cf0-41b7-8f99-ade263c37b0a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7" status: 200 len: 1473 microversion: 2.1 time: 0.562740 Oct 05 02:59:57.292736 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2887/5749] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:59:56 2022] GET /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7 => generated 1473 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 02:59:57.589040 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3c0eab43-1c71-4d7c-bc3b-81af6b3a8e02 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-160647856", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 02:59:57.681703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-3c0eab43-1c71-4d7c-bc3b-81af6b3a8e02 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] validate_networks() for [('10f7eabf-9521-4437-a838-b9f76044e586', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 02:59:58.126894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ff2bbe29-5144-484a-942f-7626c8678288 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:58.129600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ff2bbe29-5144-484a-942f-7626c8678288 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: 8dadc22e-64c8-46e3-b921-1eec8faf3bed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:58.158994 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff2bbe29-5144-484a-942f-7626c8678288 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:58.159536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff2bbe29-5144-484a-942f-7626c8678288 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:58.159985 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff2bbe29-5144-484a-942f-7626c8678288 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:58.162145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff2bbe29-5144-484a-942f-7626c8678288 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:58.164283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff2bbe29-5144-484a-942f-7626c8678288 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:58.166655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff2bbe29-5144-484a-942f-7626c8678288 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:58.683135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ff2bbe29-5144-484a-942f-7626c8678288 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:58.698994 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ff2bbe29-5144-484a-942f-7626c8678288 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:58.701538 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ff2bbe29-5144-484a-942f-7626c8678288 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 02:59:58.704791 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ff2bbe29-5144-484a-942f-7626c8678288 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed" status: 200 len: 1362 microversion: 2.47 time: 0.586736 Oct 05 02:59:58.732408 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2888/5750] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:59:58 2022] GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed => generated 1362 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 02:59:59.737692 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b3770cf4-d80a-4728-a14f-7391fb96caaf tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 02:59:59.738364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b3770cf4-d80a-4728-a14f-7391fb96caaf tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: 8dadc22e-64c8-46e3-b921-1eec8faf3bed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 02:59:59.763623 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3770cf4-d80a-4728-a14f-7391fb96caaf tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:59.764701 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3770cf4-d80a-4728-a14f-7391fb96caaf tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:59.767372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3770cf4-d80a-4728-a14f-7391fb96caaf tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:59.768332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3770cf4-d80a-4728-a14f-7391fb96caaf tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:59.771720 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3770cf4-d80a-4728-a14f-7391fb96caaf tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:59.772175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3770cf4-d80a-4728-a14f-7391fb96caaf tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:59.819369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-3c0eab43-1c71-4d7c-bc3b-81af6b3a8e02 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 02:59:59.820414 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-3c0eab43-1c71-4d7c-bc3b-81af6b3a8e02 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 02:59:59.821147 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-3c0eab43-1c71-4d7c-bc3b-81af6b3a8e02 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 02:59:59.821758 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-3c0eab43-1c71-4d7c-bc3b-81af6b3a8e02 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 02:59:59.822336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-3c0eab43-1c71-4d7c-bc3b-81af6b3a8e02 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 02:59:59.831869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:59.858408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3c0eab43-1c71-4d7c-bc3b-81af6b3a8e02 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:59.860437 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3c0eab43-1c71-4d7c-bc3b-81af6b3a8e02 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:59.861443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3c0eab43-1c71-4d7c-bc3b-81af6b3a8e02 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:59.862833 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3c0eab43-1c71-4d7c-bc3b-81af6b3a8e02 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:59.863824 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3c0eab43-1c71-4d7c-bc3b-81af6b3a8e02 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:59.866754 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3c0eab43-1c71-4d7c-bc3b-81af6b3a8e02 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:59.873883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3770cf4-d80a-4728-a14f-7391fb96caaf tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 02:59:59.882011 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3770cf4-d80a-4728-a14f-7391fb96caaf tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 02:59:59.882864 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3770cf4-d80a-4728-a14f-7391fb96caaf tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 02:59:59.883745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-b3770cf4-d80a-4728-a14f-7391fb96caaf tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lazy-loading 'fault' on Instance uuid 8dadc22e-64c8-46e3-b921-1eec8faf3bed {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 02:59:59.886628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:59.946753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-3c0eab43-1c71-4d7c-bc3b-81af6b3a8e02 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Getting quotas for project f477959bd24b4db881b62dab54861aa5. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 02:59:59.962136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-3c0eab43-1c71-4d7c-bc3b-81af6b3a8e02 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Getting quotas for user 12d0128e850f4f22a2172800c44074a4 and project f477959bd24b4db881b62dab54861aa5. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 02:59:59.994538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3c0eab43-1c71-4d7c-bc3b-81af6b3a8e02 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:00:00.005706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3c0eab43-1c71-4d7c-bc3b-81af6b3a8e02 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: e704e426-cae4-4cc3-b2be-24f3fe4e52dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:00:00.103110 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3c0eab43-1c71-4d7c-bc3b-81af6b3a8e02 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.518820 Oct 05 03:00:00.112877 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2863/5751] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:59:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:00:00.137342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-27a67887-8755-40fa-99a7-abb6d697248a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:00.137863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-27a67887-8755-40fa-99a7-abb6d697248a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: e704e426-cae4-4cc3-b2be-24f3fe4e52dc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:00.176626 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b3770cf4-d80a-4728-a14f-7391fb96caaf tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:00.186806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b3770cf4-d80a-4728-a14f-7391fb96caaf tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:00.197121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b3770cf4-d80a-4728-a14f-7391fb96caaf tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:00.199866 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b3770cf4-d80a-4728-a14f-7391fb96caaf tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed" status: 200 len: 1367 microversion: 2.47 time: 0.467869 Oct 05 03:00:00.223890 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2889/5752] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 02:59:59 2022] GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed => generated 1367 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 03:00:00.244874 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-27a67887-8755-40fa-99a7-abb6d697248a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: e704e426-cae4-4cc3-b2be-24f3fe4e52dc] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:00:01.025250 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.scheduler.client.report [None req-27a67887-8755-40fa-99a7-abb6d697248a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Deleted allocations for instance e704e426-cae4-4cc3-b2be-24f3fe4e52dc Oct 05 03:00:01.032182 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.compute.api [None req-27a67887-8755-40fa-99a7-abb6d697248a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: e704e426-cae4-4cc3-b2be-24f3fe4e52dc] Instance Mapping does not exist while attempting local delete cleanup. Oct 05 03:00:01.033417 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-27a67887-8755-40fa-99a7-abb6d697248a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e704e426-cae4-4cc3-b2be-24f3fe4e52dc" status: 204 len: 0 microversion: 2.1 time: 0.912467 Oct 05 03:00:01.033719 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2864/5753] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:00:00 2022] DELETE /compute/v2.1/servers/e704e426-cae4-4cc3-b2be-24f3fe4e52dc => generated 0 bytes in 914 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:00:01.042100 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1d87258d-8227-44c8-956a-4a65ea481a19 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:01.042892 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1d87258d-8227-44c8-956a-4a65ea481a19 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: e704e426-cae4-4cc3-b2be-24f3fe4e52dc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:01.063016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=47 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:01.064377 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-1d87258d-8227-44c8-956a-4a65ea481a19 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] HTTP exception thrown: Instance e704e426-cae4-4cc3-b2be-24f3fe4e52dc could not be found. Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1d87258d-8227-44c8-956a-4a65ea481a19 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Request method failure captured: Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/e704e426-cae4-4cc3-b2be-24f3fe4e52dc HTTP/1.1 Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPMRSX2gjlikFUspC1UWD3LpY1ceHV7QevQM_Ijag9QQ0seWSmWQwasVLfA-3qPo60WBeSjn_ysZhLr4smwuTcgmq5PXaeLA0zkzWirUA1z0qMp7vToCduQRast94phmM-CNx-XY-K9McRIC58Qrl_qL_n7FYacRtEkL0ls1cybFzQg Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f477959bd24b4db881b62dab54861aa5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersTestJSON-1099213797 Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersTestJSON-1099213797-project Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 12d0128e850f4f22a2172800c44074a4 Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersTestJSON-1099213797-project Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance e704e426-cae4-4cc3-b2be-24f3fe4e52dc could not be found. Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'e704e426-cae4-4cc3-b2be-24f3fe4e52dc'} Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e704e426-cae4-4cc3-b2be-24f3fe4e52dc could not be found. Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e704e426-cae4-4cc3-b2be-24f3fe4e52dc could not be found. Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:00:01.065989 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:00:01.072012 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:00:01.072012 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:00:01.072012 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:00:01.072012 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e704e426-cae4-4cc3-b2be-24f3fe4e52dc could not be found. Oct 05 03:00:01.072012 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:00:01.073938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1d87258d-8227-44c8-956a-4a65ea481a19 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Returning 404 to user: Instance e704e426-cae4-4cc3-b2be-24f3fe4e52dc could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:00:01.074813 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1d87258d-8227-44c8-956a-4a65ea481a19 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/e704e426-cae4-4cc3-b2be-24f3fe4e52dc" status: 404 len: 111 microversion: 2.1 time: 0.036896 Oct 05 03:00:01.089691 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2890/5754] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:01 2022] GET /compute/v2.1/servers/e704e426-cae4-4cc3-b2be-24f3fe4e52dc => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:00:01.230684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-51e1a058-235d-4d4a-8886-31fce2e1cff9 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:01.231962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-51e1a058-235d-4d4a-8886-31fce2e1cff9 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: 8dadc22e-64c8-46e3-b921-1eec8faf3bed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:01.253591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51e1a058-235d-4d4a-8886-31fce2e1cff9 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:01.256555 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51e1a058-235d-4d4a-8886-31fce2e1cff9 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:01.257880 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51e1a058-235d-4d4a-8886-31fce2e1cff9 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:01.261405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51e1a058-235d-4d4a-8886-31fce2e1cff9 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:01.277761 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51e1a058-235d-4d4a-8886-31fce2e1cff9 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:01.281595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51e1a058-235d-4d4a-8886-31fce2e1cff9 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:01.329176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-830e87c4-2902-4d51-8107-035964eb4aab tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1487891731", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "10f7eabf-9521-4437-a838-b9f76044e586"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:00:01.351087 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-51e1a058-235d-4d4a-8886-31fce2e1cff9 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] HTTP exception thrown: Instance 8dadc22e-64c8-46e3-b921-1eec8faf3bed could not be found. Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-51e1a058-235d-4d4a-8886-31fce2e1cff9 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Request method failure captured: Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed HTTP/1.1 Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPL60utku98_oLjhToCJ0GUkQQ77jDyHcBQXQVRISVAwm_8gOUFAI7gUnNlIrVWIheZ4uEJu_onbeYr0x6rJ2frQ9-0rhuLhq-FnMYhYGsEuxuEwtvmJdu09gVsQw_XKFKG8myDM81qVdKvFh1p539_1X1nxSJdDYLAwMR1JaYEjGxc Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: X-Openstack-Nova-Api-Version: 2.47 Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: daa97e7f606c4374a629c460de97aed9 Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServerShowV247Test-492117551 Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/daa97e7f606c4374a629c460de97aed9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/daa97e7f606c4374a629c460de97aed9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/daa97e7f606c4374a629c460de97aed9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_daa97e7f606c4374a629c460de97aed9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServerShowV247Test-492117551 Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: daa97e7f606c4374a629c460de97aed9 Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServerShowV247Test-492117551 Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServerShowV247Test-492117551-project Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: d80cfe5906384b0db35364d904725750 Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServerShowV247Test-492117551-project Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 8dadc22e-64c8-46e3-b921-1eec8faf3bed could not be found. Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '8dadc22e-64c8-46e3-b921-1eec8faf3bed'} Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dadc22e-64c8-46e3-b921-1eec8faf3bed could not be found. Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dadc22e-64c8-46e3-b921-1eec8faf3bed could not be found. Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:00:01.352815 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:00:01.359919 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:00:01.359919 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:00:01.359919 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:00:01.359919 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:00:01.359919 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:00:01.359919 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dadc22e-64c8-46e3-b921-1eec8faf3bed could not be found. Oct 05 03:00:01.359919 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:00:01.359919 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-51e1a058-235d-4d4a-8886-31fce2e1cff9 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Returning 404 to user: Instance 8dadc22e-64c8-46e3-b921-1eec8faf3bed could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:00:01.359919 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-51e1a058-235d-4d4a-8886-31fce2e1cff9 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed" status: 404 len: 111 microversion: 2.47 time: 0.127965 Oct 05 03:00:01.359919 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2865/5755] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 03:00:01 2022] GET /compute/v2.1/servers/8dadc22e-64c8-46e3-b921-1eec8faf3bed => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 03:00:01.384464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-444fe7b1-0fba-4d69-8a29-57e9fcc8d44e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:01.385006 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-444fe7b1-0fba-4d69-8a29-57e9fcc8d44e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: fc1a259d-f92e-4b1a-852b-ac19acdb0681] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:01.424984 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-444fe7b1-0fba-4d69-8a29-57e9fcc8d44e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:01.425485 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-444fe7b1-0fba-4d69-8a29-57e9fcc8d44e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:01.425925 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-444fe7b1-0fba-4d69-8a29-57e9fcc8d44e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:01.426642 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-444fe7b1-0fba-4d69-8a29-57e9fcc8d44e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:01.427105 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-444fe7b1-0fba-4d69-8a29-57e9fcc8d44e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:01.448696 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-444fe7b1-0fba-4d69-8a29-57e9fcc8d44e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:01.475417 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-830e87c4-2902-4d51-8107-035964eb4aab tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] validate_networks() for [('10f7eabf-9521-4437-a838-b9f76044e586', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:00:01.546330 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-444fe7b1-0fba-4d69-8a29-57e9fcc8d44e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: fc1a259d-f92e-4b1a-852b-ac19acdb0681] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:00:01.819638 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-444fe7b1-0fba-4d69-8a29-57e9fcc8d44e tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fc1a259d-f92e-4b1a-852b-ac19acdb0681" status: 204 len: 0 microversion: 2.47 time: 0.443493 Oct 05 03:00:01.823669 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2866/5756] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Oct 5 03:00:01 2022] DELETE /compute/v2.1/servers/fc1a259d-f92e-4b1a-852b-ac19acdb0681 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 03:00:01.830912 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1c0a61cf-2c96-44f8-b03a-976c7ff098f2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:01.831687 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1c0a61cf-2c96-44f8-b03a-976c7ff098f2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: fc1a259d-f92e-4b1a-852b-ac19acdb0681] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:01.847686 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c0a61cf-2c96-44f8-b03a-976c7ff098f2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:01.852021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c0a61cf-2c96-44f8-b03a-976c7ff098f2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:01.852601 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c0a61cf-2c96-44f8-b03a-976c7ff098f2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:01.853469 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c0a61cf-2c96-44f8-b03a-976c7ff098f2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:01.854033 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c0a61cf-2c96-44f8-b03a-976c7ff098f2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:01.854563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c0a61cf-2c96-44f8-b03a-976c7ff098f2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:02.092453 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1c0a61cf-2c96-44f8-b03a-976c7ff098f2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:02.106112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1c0a61cf-2c96-44f8-b03a-976c7ff098f2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:02.115020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1c0a61cf-2c96-44f8-b03a-976c7ff098f2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:02.116431 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1c0a61cf-2c96-44f8-b03a-976c7ff098f2 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "GET /compute/v2.1/servers/fc1a259d-f92e-4b1a-852b-ac19acdb0681" status: 200 len: 1362 microversion: 2.47 time: 0.290909 Oct 05 03:00:02.117225 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2867/5757] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 03:00:01 2022] GET /compute/v2.1/servers/fc1a259d-f92e-4b1a-852b-ac19acdb0681 => generated 1362 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 03:00:02.736276 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-830e87c4-2902-4d51-8107-035964eb4aab tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:00:02.737480 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-830e87c4-2902-4d51-8107-035964eb4aab tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:00:02.737995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-830e87c4-2902-4d51-8107-035964eb4aab tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:00:02.738415 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-830e87c4-2902-4d51-8107-035964eb4aab tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:00:02.738837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-830e87c4-2902-4d51-8107-035964eb4aab tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:00:02.761012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-830e87c4-2902-4d51-8107-035964eb4aab tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:02.761513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-830e87c4-2902-4d51-8107-035964eb4aab tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:02.762501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-830e87c4-2902-4d51-8107-035964eb4aab tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:02.766875 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-830e87c4-2902-4d51-8107-035964eb4aab tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:02.767335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-830e87c4-2902-4d51-8107-035964eb4aab tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:02.767779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-830e87c4-2902-4d51-8107-035964eb4aab tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:02.859444 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-830e87c4-2902-4d51-8107-035964eb4aab tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Getting quotas for project f477959bd24b4db881b62dab54861aa5. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:00:02.870492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-830e87c4-2902-4d51-8107-035964eb4aab tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Getting quotas for user 12d0128e850f4f22a2172800c44074a4 and project f477959bd24b4db881b62dab54861aa5. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:00:02.891456 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-830e87c4-2902-4d51-8107-035964eb4aab tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:00:02.910963 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-830e87c4-2902-4d51-8107-035964eb4aab tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 33e7e716-e8e1-4773-b9f3-ceb8ccc86153] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:00:03.042271 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-830e87c4-2902-4d51-8107-035964eb4aab tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.716963 Oct 05 03:00:03.046548 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2891/5758] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:00:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:00:03.065050 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a341fb41-636b-46e4-be13-85d365091c4f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:03.066384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a341fb41-636b-46e4-be13-85d365091c4f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 33e7e716-e8e1-4773-b9f3-ceb8ccc86153] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:03.149368 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8508e906-7198-47ac-926c-7fb9f7d95918 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:03.150293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8508e906-7198-47ac-926c-7fb9f7d95918 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: fc1a259d-f92e-4b1a-852b-ac19acdb0681] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:03.164345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8508e906-7198-47ac-926c-7fb9f7d95918 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:03.181043 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8508e906-7198-47ac-926c-7fb9f7d95918 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:03.181885 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8508e906-7198-47ac-926c-7fb9f7d95918 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:03.186643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8508e906-7198-47ac-926c-7fb9f7d95918 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:03.187760 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8508e906-7198-47ac-926c-7fb9f7d95918 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:03.189586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8508e906-7198-47ac-926c-7fb9f7d95918 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:03.194720 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a341fb41-636b-46e4-be13-85d365091c4f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:03.205908 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a341fb41-636b-46e4-be13-85d365091c4f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153" status: 200 len: 1221 microversion: 2.1 time: 0.149935 Oct 05 03:00:03.231397 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2868/5759] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:03 2022] GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153 => generated 1221 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:00:03.384352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8508e906-7198-47ac-926c-7fb9f7d95918 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:03.418552 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8508e906-7198-47ac-926c-7fb9f7d95918 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:03.428339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8508e906-7198-47ac-926c-7fb9f7d95918 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:03.428339 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8508e906-7198-47ac-926c-7fb9f7d95918 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "GET /compute/v2.1/servers/fc1a259d-f92e-4b1a-852b-ac19acdb0681" status: 200 len: 1362 microversion: 2.47 time: 0.281491 Oct 05 03:00:03.459642 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2892/5760] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 03:00:03 2022] GET /compute/v2.1/servers/fc1a259d-f92e-4b1a-852b-ac19acdb0681 => generated 1362 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 03:00:04.237189 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4759762a-8899-4997-b748-e375db274191 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:04.237803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4759762a-8899-4997-b748-e375db274191 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 33e7e716-e8e1-4773-b9f3-ceb8ccc86153] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:04.257487 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4759762a-8899-4997-b748-e375db274191 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:04.266685 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4759762a-8899-4997-b748-e375db274191 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:04.267413 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4759762a-8899-4997-b748-e375db274191 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:04.269143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4759762a-8899-4997-b748-e375db274191 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:04.270136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4759762a-8899-4997-b748-e375db274191 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:04.270728 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4759762a-8899-4997-b748-e375db274191 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:04.456309 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-90bc2fbc-b0b5-4756-9bff-433f573e37e3 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:04.457257 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-90bc2fbc-b0b5-4756-9bff-433f573e37e3 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: fc1a259d-f92e-4b1a-852b-ac19acdb0681] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:04.483470 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-90bc2fbc-b0b5-4756-9bff-433f573e37e3 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:04.484032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-90bc2fbc-b0b5-4756-9bff-433f573e37e3 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:04.484503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-90bc2fbc-b0b5-4756-9bff-433f573e37e3 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:04.486082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-90bc2fbc-b0b5-4756-9bff-433f573e37e3 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:04.488790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-90bc2fbc-b0b5-4756-9bff-433f573e37e3 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:04.489725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-90bc2fbc-b0b5-4756-9bff-433f573e37e3 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:04.545283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4759762a-8899-4997-b748-e375db274191 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:04.563542 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4759762a-8899-4997-b748-e375db274191 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153" status: 200 len: 1225 microversion: 2.1 time: 0.331520 Oct 05 03:00:04.568100 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2869/5761] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:04 2022] GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153 => generated 1225 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:00:04.664384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-90bc2fbc-b0b5-4756-9bff-433f573e37e3 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:04.664384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-90bc2fbc-b0b5-4756-9bff-433f573e37e3 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:04.664384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-90bc2fbc-b0b5-4756-9bff-433f573e37e3 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:04.664710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-90bc2fbc-b0b5-4756-9bff-433f573e37e3 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lazy-loading 'fault' on Instance uuid fc1a259d-f92e-4b1a-852b-ac19acdb0681 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:00:04.743261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-90bc2fbc-b0b5-4756-9bff-433f573e37e3 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:04.772115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-90bc2fbc-b0b5-4756-9bff-433f573e37e3 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:04.775002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-90bc2fbc-b0b5-4756-9bff-433f573e37e3 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd80cfe5906384b0db35364d904725750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa97e7f606c4374a629c460de97aed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:04.780049 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-90bc2fbc-b0b5-4756-9bff-433f573e37e3 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "GET /compute/v2.1/servers/fc1a259d-f92e-4b1a-852b-ac19acdb0681" status: 200 len: 1367 microversion: 2.47 time: 0.326814 Oct 05 03:00:04.780941 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2893/5762] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 03:00:04 2022] GET /compute/v2.1/servers/fc1a259d-f92e-4b1a-852b-ac19acdb0681 => generated 1367 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 03:00:05.598320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d84a7555-e87f-467d-89ba-0727af7f2d2a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:05.599249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d84a7555-e87f-467d-89ba-0727af7f2d2a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 33e7e716-e8e1-4773-b9f3-ceb8ccc86153] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:05.625901 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d84a7555-e87f-467d-89ba-0727af7f2d2a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:05.629068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d84a7555-e87f-467d-89ba-0727af7f2d2a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:05.633798 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d84a7555-e87f-467d-89ba-0727af7f2d2a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:05.636165 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d84a7555-e87f-467d-89ba-0727af7f2d2a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:05.636762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d84a7555-e87f-467d-89ba-0727af7f2d2a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:05.638641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d84a7555-e87f-467d-89ba-0727af7f2d2a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:05.820050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-79f5aded-8cb3-4528-9361-317ec0b30757 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:05.820803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-79f5aded-8cb3-4528-9361-317ec0b30757 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] [instance: fc1a259d-f92e-4b1a-852b-ac19acdb0681] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:05.846052 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79f5aded-8cb3-4528-9361-317ec0b30757 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:05.846573 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79f5aded-8cb3-4528-9361-317ec0b30757 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:05.857625 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79f5aded-8cb3-4528-9361-317ec0b30757 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:05.858521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79f5aded-8cb3-4528-9361-317ec0b30757 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:05.862757 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79f5aded-8cb3-4528-9361-317ec0b30757 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:05.863526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79f5aded-8cb3-4528-9361-317ec0b30757 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:05.902246 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-79f5aded-8cb3-4528-9361-317ec0b30757 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] HTTP exception thrown: Instance fc1a259d-f92e-4b1a-852b-ac19acdb0681 could not be found. Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-79f5aded-8cb3-4528-9361-317ec0b30757 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Request method failure captured: Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/fc1a259d-f92e-4b1a-852b-ac19acdb0681 HTTP/1.1 Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPL60utku98_oLjhToCJ0GUkQQ77jDyHcBQXQVRISVAwm_8gOUFAI7gUnNlIrVWIheZ4uEJu_onbeYr0x6rJ2frQ9-0rhuLhq-FnMYhYGsEuxuEwtvmJdu09gVsQw_XKFKG8myDM81qVdKvFh1p539_1X1nxSJdDYLAwMR1JaYEjGxc Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: X-Openstack-Nova-Api-Version: 2.47 Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: daa97e7f606c4374a629c460de97aed9 Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerShowV247Test-492117551 Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/daa97e7f606c4374a629c460de97aed9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/daa97e7f606c4374a629c460de97aed9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/daa97e7f606c4374a629c460de97aed9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_daa97e7f606c4374a629c460de97aed9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerShowV247Test-492117551 Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: daa97e7f606c4374a629c460de97aed9 Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerShowV247Test-492117551 Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerShowV247Test-492117551-project Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: d80cfe5906384b0db35364d904725750 Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerShowV247Test-492117551-project Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance fc1a259d-f92e-4b1a-852b-ac19acdb0681 could not be found. Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'fc1a259d-f92e-4b1a-852b-ac19acdb0681'} Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc1a259d-f92e-4b1a-852b-ac19acdb0681 could not be found. Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc1a259d-f92e-4b1a-852b-ac19acdb0681 could not be found. Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:00:05.910035 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:00:05.915092 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:00:05.915092 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:00:05.915092 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:00:05.915092 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:00:05.915092 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:00:05.915092 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc1a259d-f92e-4b1a-852b-ac19acdb0681 could not be found. Oct 05 03:00:05.915092 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:00:05.915092 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-79f5aded-8cb3-4528-9361-317ec0b30757 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] Returning 404 to user: Instance fc1a259d-f92e-4b1a-852b-ac19acdb0681 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:00:05.915092 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-79f5aded-8cb3-4528-9361-317ec0b30757 tempest-ServerShowV247Test-492117551 tempest-ServerShowV247Test-492117551-project] 10.222.0.16 "GET /compute/v2.1/servers/fc1a259d-f92e-4b1a-852b-ac19acdb0681" status: 404 len: 111 microversion: 2.47 time: 0.102314 Oct 05 03:00:05.916258 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2894/5763] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Oct 5 03:00:05 2022] GET /compute/v2.1/servers/fc1a259d-f92e-4b1a-852b-ac19acdb0681 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 03:00:05.976204 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d84a7555-e87f-467d-89ba-0727af7f2d2a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:05.994525 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d84a7555-e87f-467d-89ba-0727af7f2d2a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153" status: 200 len: 1291 microversion: 2.1 time: 0.399423 Oct 05 03:00:05.995438 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2870/5764] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:05 2022] GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153 => generated 1291 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:00:07.032452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-db13ef7a-a640-454e-a95b-34a0c6318e06 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:07.033255 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-db13ef7a-a640-454e-a95b-34a0c6318e06 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 33e7e716-e8e1-4773-b9f3-ceb8ccc86153] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:07.049192 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db13ef7a-a640-454e-a95b-34a0c6318e06 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:07.049724 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db13ef7a-a640-454e-a95b-34a0c6318e06 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:07.050144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db13ef7a-a640-454e-a95b-34a0c6318e06 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:07.051365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db13ef7a-a640-454e-a95b-34a0c6318e06 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:07.051825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db13ef7a-a640-454e-a95b-34a0c6318e06 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:07.052252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db13ef7a-a640-454e-a95b-34a0c6318e06 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:07.957112 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-db13ef7a-a640-454e-a95b-34a0c6318e06 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:07.968546 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-db13ef7a-a640-454e-a95b-34a0c6318e06 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153" status: 200 len: 1321 microversion: 2.1 time: 0.952186 Oct 05 03:00:07.973064 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2895/5765] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:07 2022] GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153 => generated 1321 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:00:08.993267 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f4639e07-51d3-42e0-a2df-79d812159d03 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:08.993968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f4639e07-51d3-42e0-a2df-79d812159d03 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 33e7e716-e8e1-4773-b9f3-ceb8ccc86153] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:09.018918 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4639e07-51d3-42e0-a2df-79d812159d03 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:09.020743 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4639e07-51d3-42e0-a2df-79d812159d03 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:09.021356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4639e07-51d3-42e0-a2df-79d812159d03 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:09.023283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4639e07-51d3-42e0-a2df-79d812159d03 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:09.024064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4639e07-51d3-42e0-a2df-79d812159d03 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:09.030433 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4639e07-51d3-42e0-a2df-79d812159d03 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:09.532799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f4639e07-51d3-42e0-a2df-79d812159d03 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:09.545241 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f4639e07-51d3-42e0-a2df-79d812159d03 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153" status: 200 len: 1321 microversion: 2.1 time: 0.553553 Oct 05 03:00:09.557965 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2871/5766] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:08 2022] GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153 => generated 1321 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:00:09.568105 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 03:00:09.568705 n-d-858272-3 devstack@n-api.service[122319]: Wed Oct 5 03:00:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 05 03:00:10.127941 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:10.160145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-7a26ce73-bac9-46ad-81d1-81f2c3db346a req-0716e8f8-fa8e-4870-85ba-c3c326f4a73f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33e7e716-e8e1-4773-b9f3-ceb8ccc86153", "tag": "8ec07fc5-c3f5-4368-9264-c0460b9e654b"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:00:10.202871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7a26ce73-bac9-46ad-81d1-81f2c3db346a req-0716e8f8-fa8e-4870-85ba-c3c326f4a73f service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:10.212136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7917e4d4-19b1-4605-aceb-0289621a9a5e tempest-ExtensionsTest-175433627 tempest-ExtensionsTest-175433627-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:10.214144 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7917e4d4-19b1-4605-aceb-0289621a9a5e tempest-ExtensionsTest-175433627 tempest-ExtensionsTest-175433627-project] 10.222.0.16 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.092191 Oct 05 03:00:10.214836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7a26ce73-bac9-46ad-81d1-81f2c3db346a req-0716e8f8-fa8e-4870-85ba-c3c326f4a73f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:10.215549 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2872/5767] 10.222.0.16 () {58 vars in 1170 bytes} [Wed Oct 5 03:00:10 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:00:10.215665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7a26ce73-bac9-46ad-81d1-81f2c3db346a req-0716e8f8-fa8e-4870-85ba-c3c326f4a73f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:10.226631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e60e9e74-f9f9-4ba5-b8ae-9f657ec3d488 tempest-ExtensionsTest-175433627 tempest-ExtensionsTest-175433627-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:10.232701 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e60e9e74-f9f9-4ba5-b8ae-9f657ec3d488 tempest-ExtensionsTest-175433627 tempest-ExtensionsTest-175433627-project] 10.222.0.16 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.010528 Oct 05 03:00:10.234081 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2873/5768] 10.222.0.16 () {58 vars in 1134 bytes} [Wed Oct 5 03:00:10 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 03:00:10.252333 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-7a26ce73-bac9-46ad-81d1-81f2c3db346a req-0716e8f8-fa8e-4870-85ba-c3c326f4a73f service nova] Creating event network-changed:8ec07fc5-c3f5-4368-9264-c0460b9e654b for instance 33e7e716-e8e1-4773-b9f3-ceb8ccc86153 on n-h2-858272-3 Oct 05 03:00:10.316409 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-7a26ce73-bac9-46ad-81d1-81f2c3db346a req-0716e8f8-fa8e-4870-85ba-c3c326f4a73f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.754448 Oct 05 03:00:10.317060 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2896/5769] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:00:10.574644 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-85244943-e4be-422e-9fa5-98c381c3eaed tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:10.576132 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-85244943-e4be-422e-9fa5-98c381c3eaed tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 33e7e716-e8e1-4773-b9f3-ceb8ccc86153] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:10.594375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85244943-e4be-422e-9fa5-98c381c3eaed tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:10.595199 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85244943-e4be-422e-9fa5-98c381c3eaed tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:10.595900 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85244943-e4be-422e-9fa5-98c381c3eaed tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:10.599198 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85244943-e4be-422e-9fa5-98c381c3eaed tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:10.600725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85244943-e4be-422e-9fa5-98c381c3eaed tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:10.601416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85244943-e4be-422e-9fa5-98c381c3eaed tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:11.048348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-85244943-e4be-422e-9fa5-98c381c3eaed tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:11.065446 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-85244943-e4be-422e-9fa5-98c381c3eaed tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153" status: 200 len: 1321 microversion: 2.1 time: 0.496000 Oct 05 03:00:11.084260 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2874/5770] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:10 2022] GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153 => generated 1321 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:00:12.092743 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-15ef6599-2a8e-4082-ac71-036d1abe3aef tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:12.093506 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-15ef6599-2a8e-4082-ac71-036d1abe3aef tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 33e7e716-e8e1-4773-b9f3-ceb8ccc86153] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:12.105833 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15ef6599-2a8e-4082-ac71-036d1abe3aef tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:12.106331 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15ef6599-2a8e-4082-ac71-036d1abe3aef tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:12.106911 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15ef6599-2a8e-4082-ac71-036d1abe3aef tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:12.107623 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15ef6599-2a8e-4082-ac71-036d1abe3aef tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:12.108090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15ef6599-2a8e-4082-ac71-036d1abe3aef tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:12.108524 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15ef6599-2a8e-4082-ac71-036d1abe3aef tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:12.791574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-15ef6599-2a8e-4082-ac71-036d1abe3aef tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:12.804162 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-15ef6599-2a8e-4082-ac71-036d1abe3aef tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153" status: 200 len: 1321 microversion: 2.1 time: 0.717184 Oct 05 03:00:12.806844 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2897/5771] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:12 2022] GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153 => generated 1321 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:00:13.841484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ffb13b3b-6c45-47fc-9fb5-0fa8cd85a679 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:13.842834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ffb13b3b-6c45-47fc-9fb5-0fa8cd85a679 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 33e7e716-e8e1-4773-b9f3-ceb8ccc86153] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:13.850288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=10 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:13.854308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ffb13b3b-6c45-47fc-9fb5-0fa8cd85a679 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:13.855756 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ffb13b3b-6c45-47fc-9fb5-0fa8cd85a679 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:13.857146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ffb13b3b-6c45-47fc-9fb5-0fa8cd85a679 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:13.858574 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ffb13b3b-6c45-47fc-9fb5-0fa8cd85a679 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:13.864090 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ffb13b3b-6c45-47fc-9fb5-0fa8cd85a679 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:13.864612 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ffb13b3b-6c45-47fc-9fb5-0fa8cd85a679 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:14.445035 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ffb13b3b-6c45-47fc-9fb5-0fa8cd85a679 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:14.455039 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ffb13b3b-6c45-47fc-9fb5-0fa8cd85a679 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153" status: 200 len: 1321 microversion: 2.1 time: 0.626660 Oct 05 03:00:14.460876 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2875/5772] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:13 2022] GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153 => generated 1321 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:00:15.486076 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5faf8508-f429-41ac-8e0b-1856adccabc5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:15.486744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5faf8508-f429-41ac-8e0b-1856adccabc5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 33e7e716-e8e1-4773-b9f3-ceb8ccc86153] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:15.490759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=4 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:15.493679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=8 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:15.507425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5faf8508-f429-41ac-8e0b-1856adccabc5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:15.510921 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5faf8508-f429-41ac-8e0b-1856adccabc5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:15.511621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5faf8508-f429-41ac-8e0b-1856adccabc5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:15.517211 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5faf8508-f429-41ac-8e0b-1856adccabc5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:15.518046 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5faf8508-f429-41ac-8e0b-1856adccabc5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:15.519014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5faf8508-f429-41ac-8e0b-1856adccabc5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:16.106106 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5faf8508-f429-41ac-8e0b-1856adccabc5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:16.119320 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5faf8508-f429-41ac-8e0b-1856adccabc5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153" status: 200 len: 1321 microversion: 2.1 time: 0.637829 Oct 05 03:00:16.140919 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2898/5773] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:15 2022] GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153 => generated 1321 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:00:17.158523 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-95df8772-cc30-47f6-a0ca-ab65581907e2 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:17.159743 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-95df8772-cc30-47f6-a0ca-ab65581907e2 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 33e7e716-e8e1-4773-b9f3-ceb8ccc86153] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:17.176335 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-95df8772-cc30-47f6-a0ca-ab65581907e2 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:17.178247 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-95df8772-cc30-47f6-a0ca-ab65581907e2 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:17.178247 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-95df8772-cc30-47f6-a0ca-ab65581907e2 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:17.179211 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-95df8772-cc30-47f6-a0ca-ab65581907e2 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:17.180045 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-95df8772-cc30-47f6-a0ca-ab65581907e2 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:17.180974 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-95df8772-cc30-47f6-a0ca-ab65581907e2 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:18.186994 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-95df8772-cc30-47f6-a0ca-ab65581907e2 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:18.196091 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-95df8772-cc30-47f6-a0ca-ab65581907e2 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153" status: 200 len: 1321 microversion: 2.1 time: 1.051982 Oct 05 03:00:18.196682 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2876/5774] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:17 2022] GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153 => generated 1321 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:00:19.221614 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b689cd71-e87e-4dce-98b3-aeffa7b9f948 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:19.222771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b689cd71-e87e-4dce-98b3-aeffa7b9f948 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 33e7e716-e8e1-4773-b9f3-ceb8ccc86153] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:19.237216 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b689cd71-e87e-4dce-98b3-aeffa7b9f948 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:19.242071 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b689cd71-e87e-4dce-98b3-aeffa7b9f948 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:19.243629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b689cd71-e87e-4dce-98b3-aeffa7b9f948 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:19.246000 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b689cd71-e87e-4dce-98b3-aeffa7b9f948 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:19.249579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b689cd71-e87e-4dce-98b3-aeffa7b9f948 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:19.252842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b689cd71-e87e-4dce-98b3-aeffa7b9f948 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:19.946456 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b689cd71-e87e-4dce-98b3-aeffa7b9f948 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:19.969273 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b689cd71-e87e-4dce-98b3-aeffa7b9f948 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153" status: 200 len: 1321 microversion: 2.1 time: 0.753011 Oct 05 03:00:19.984213 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2899/5775] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:19 2022] GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153 => generated 1321 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:00:20.103206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-5971c942-f8fc-43e4-977d-f8279e7ae0ac req-c089cb66-cd50-435f-8625-aa8703b6222e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e7e716-e8e1-4773-b9f3-ceb8ccc86153", "name": "network-vif-plugged", "status": "completed", "tag": "8ec07fc5-c3f5-4368-9264-c0460b9e654b"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:00:20.126547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-5971c942-f8fc-43e4-977d-f8279e7ae0ac req-c089cb66-cd50-435f-8625-aa8703b6222e service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:20.131486 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-5971c942-f8fc-43e4-977d-f8279e7ae0ac req-c089cb66-cd50-435f-8625-aa8703b6222e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:20.132312 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-5971c942-f8fc-43e4-977d-f8279e7ae0ac req-c089cb66-cd50-435f-8625-aa8703b6222e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:20.172107 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-5971c942-f8fc-43e4-977d-f8279e7ae0ac req-c089cb66-cd50-435f-8625-aa8703b6222e service nova] Creating event network-vif-plugged:8ec07fc5-c3f5-4368-9264-c0460b9e654b for instance 33e7e716-e8e1-4773-b9f3-ceb8ccc86153 on n-h2-858272-3 Oct 05 03:00:20.191230 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-5971c942-f8fc-43e4-977d-f8279e7ae0ac req-c089cb66-cd50-435f-8625-aa8703b6222e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091482 Oct 05 03:00:20.193500 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2877/5776] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:00:21.000434 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-89a7e50c-f7f4-4764-83a9-aa17ce0b31ac tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:21.001254 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-89a7e50c-f7f4-4764-83a9-aa17ce0b31ac tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 33e7e716-e8e1-4773-b9f3-ceb8ccc86153] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:21.016865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-89a7e50c-f7f4-4764-83a9-aa17ce0b31ac tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:21.020102 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-89a7e50c-f7f4-4764-83a9-aa17ce0b31ac tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:21.020588 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-89a7e50c-f7f4-4764-83a9-aa17ce0b31ac tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:21.021447 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-89a7e50c-f7f4-4764-83a9-aa17ce0b31ac tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:21.022189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-89a7e50c-f7f4-4764-83a9-aa17ce0b31ac tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:21.023963 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-89a7e50c-f7f4-4764-83a9-aa17ce0b31ac tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:21.368069 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-89a7e50c-f7f4-4764-83a9-aa17ce0b31ac tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:21.385702 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-89a7e50c-f7f4-4764-83a9-aa17ce0b31ac tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153" status: 200 len: 1321 microversion: 2.1 time: 0.391423 Oct 05 03:00:21.388429 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2900/5777] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:20 2022] GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153 => generated 1321 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:00:22.417978 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5428bad9-6843-4e64-bd3e-9176f4cdd7b2 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:22.418706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5428bad9-6843-4e64-bd3e-9176f4cdd7b2 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 33e7e716-e8e1-4773-b9f3-ceb8ccc86153] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:22.451231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5428bad9-6843-4e64-bd3e-9176f4cdd7b2 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:22.457937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5428bad9-6843-4e64-bd3e-9176f4cdd7b2 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:22.458429 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5428bad9-6843-4e64-bd3e-9176f4cdd7b2 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:22.459170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5428bad9-6843-4e64-bd3e-9176f4cdd7b2 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:22.468441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5428bad9-6843-4e64-bd3e-9176f4cdd7b2 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:22.468441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5428bad9-6843-4e64-bd3e-9176f4cdd7b2 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:22.806017 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5428bad9-6843-4e64-bd3e-9176f4cdd7b2 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:22.819930 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5428bad9-6843-4e64-bd3e-9176f4cdd7b2 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153" status: 200 len: 1503 microversion: 2.1 time: 0.407393 Oct 05 03:00:22.825779 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2878/5778] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:22 2022] GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153 => generated 1503 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:00:22.847958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5938faa1-c5c0-497f-8ea8-93271bd65a73 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:22.848578 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5938faa1-c5c0-497f-8ea8-93271bd65a73 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 33e7e716-e8e1-4773-b9f3-ceb8ccc86153] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:22.855644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5938faa1-c5c0-497f-8ea8-93271bd65a73 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:22.856943 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5938faa1-c5c0-497f-8ea8-93271bd65a73 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:22.857608 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5938faa1-c5c0-497f-8ea8-93271bd65a73 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:22.858462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5938faa1-c5c0-497f-8ea8-93271bd65a73 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:22.859057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5938faa1-c5c0-497f-8ea8-93271bd65a73 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:22.859642 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5938faa1-c5c0-497f-8ea8-93271bd65a73 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:23.066046 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5938faa1-c5c0-497f-8ea8-93271bd65a73 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:23.075692 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5938faa1-c5c0-497f-8ea8-93271bd65a73 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153" status: 200 len: 1503 microversion: 2.1 time: 0.231755 Oct 05 03:00:23.089715 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2901/5779] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:22 2022] GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153 => generated 1503 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:00:23.104283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-209ec72e-1676-4354-ab7b-c9be8e38b422 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:23.105043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-209ec72e-1676-4354-ab7b-c9be8e38b422 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 33e7e716-e8e1-4773-b9f3-ceb8ccc86153] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:23.116867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-209ec72e-1676-4354-ab7b-c9be8e38b422 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:23.117916 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-209ec72e-1676-4354-ab7b-c9be8e38b422 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:23.118507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-209ec72e-1676-4354-ab7b-c9be8e38b422 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:23.120005 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-209ec72e-1676-4354-ab7b-c9be8e38b422 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:23.120469 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-209ec72e-1676-4354-ab7b-c9be8e38b422 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:23.127103 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-209ec72e-1676-4354-ab7b-c9be8e38b422 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:23.191542 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-209ec72e-1676-4354-ab7b-c9be8e38b422 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 33e7e716-e8e1-4773-b9f3-ceb8ccc86153] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:00:23.465914 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-209ec72e-1676-4354-ab7b-c9be8e38b422 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "DELETE /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153" status: 204 len: 0 microversion: 2.1 time: 0.361906 Oct 05 03:00:23.465914 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2879/5780] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:00:23 2022] DELETE /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:00:23.477142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-585825d7-db0a-404b-9c9a-f62081bedc4a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:23.477767 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-585825d7-db0a-404b-9c9a-f62081bedc4a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 33e7e716-e8e1-4773-b9f3-ceb8ccc86153] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:23.491381 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-585825d7-db0a-404b-9c9a-f62081bedc4a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:23.491869 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-585825d7-db0a-404b-9c9a-f62081bedc4a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:23.492508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-585825d7-db0a-404b-9c9a-f62081bedc4a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:23.493415 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-585825d7-db0a-404b-9c9a-f62081bedc4a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:23.494030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-585825d7-db0a-404b-9c9a-f62081bedc4a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:23.494846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-585825d7-db0a-404b-9c9a-f62081bedc4a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:23.804919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-585825d7-db0a-404b-9c9a-f62081bedc4a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:23.813632 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-585825d7-db0a-404b-9c9a-f62081bedc4a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153" status: 200 len: 1509 microversion: 2.1 time: 0.345322 Oct 05 03:00:23.830820 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2902/5781] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:23 2022] GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153 => generated 1509 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:00:24.840266 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4432fee4-48e7-4ae0-a74f-b0010bc98f85 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:24.843075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4432fee4-48e7-4ae0-a74f-b0010bc98f85 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 33e7e716-e8e1-4773-b9f3-ceb8ccc86153] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:24.882490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4432fee4-48e7-4ae0-a74f-b0010bc98f85 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:24.883056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4432fee4-48e7-4ae0-a74f-b0010bc98f85 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:24.885795 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4432fee4-48e7-4ae0-a74f-b0010bc98f85 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:24.892226 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4432fee4-48e7-4ae0-a74f-b0010bc98f85 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:24.892766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4432fee4-48e7-4ae0-a74f-b0010bc98f85 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:24.894572 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4432fee4-48e7-4ae0-a74f-b0010bc98f85 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:25.563881 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4432fee4-48e7-4ae0-a74f-b0010bc98f85 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:25.581594 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4432fee4-48e7-4ae0-a74f-b0010bc98f85 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153" status: 200 len: 1509 microversion: 2.1 time: 0.743883 Oct 05 03:00:25.582753 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2880/5782] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:24 2022] GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153 => generated 1509 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:00:26.610915 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-23557f58-0083-4894-b18e-6e79fc33a3a9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:26.612978 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-23557f58-0083-4894-b18e-6e79fc33a3a9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 33e7e716-e8e1-4773-b9f3-ceb8ccc86153] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:26.643055 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23557f58-0083-4894-b18e-6e79fc33a3a9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:26.649740 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23557f58-0083-4894-b18e-6e79fc33a3a9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:26.653926 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23557f58-0083-4894-b18e-6e79fc33a3a9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:26.657738 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23557f58-0083-4894-b18e-6e79fc33a3a9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:26.660785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23557f58-0083-4894-b18e-6e79fc33a3a9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:26.662188 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23557f58-0083-4894-b18e-6e79fc33a3a9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:26.667571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=85 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:26.928864 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-23557f58-0083-4894-b18e-6e79fc33a3a9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:26.942376 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-23557f58-0083-4894-b18e-6e79fc33a3a9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153" status: 200 len: 1467 microversion: 2.1 time: 0.336715 Oct 05 03:00:26.951817 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2903/5783] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:26 2022] GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153 => generated 1467 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:00:27.328002 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-305fe2b4-e2e4-4679-94d9-de9392033939 req-0afddc88-a4c6-478e-8123-290d68b80420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e7e716-e8e1-4773-b9f3-ceb8ccc86153", "name": "network-vif-deleted", "tag": "8ec07fc5-c3f5-4368-9264-c0460b9e654b"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:00:27.369130 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-305fe2b4-e2e4-4679-94d9-de9392033939 req-0afddc88-a4c6-478e-8123-290d68b80420 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:27.369952 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-305fe2b4-e2e4-4679-94d9-de9392033939 req-0afddc88-a4c6-478e-8123-290d68b80420 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:27.370551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-305fe2b4-e2e4-4679-94d9-de9392033939 req-0afddc88-a4c6-478e-8123-290d68b80420 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:27.427551 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-305fe2b4-e2e4-4679-94d9-de9392033939 req-0afddc88-a4c6-478e-8123-290d68b80420 service nova] Creating event network-vif-deleted:8ec07fc5-c3f5-4368-9264-c0460b9e654b for instance 33e7e716-e8e1-4773-b9f3-ceb8ccc86153 on n-h2-858272-3 Oct 05 03:00:27.436013 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-305fe2b4-e2e4-4679-94d9-de9392033939 req-0afddc88-a4c6-478e-8123-290d68b80420 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112652 Oct 05 03:00:27.441744 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2881/5784] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:00:27.976943 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3609c3eb-e907-429a-ad47-196ba820d67f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:27.977556 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3609c3eb-e907-429a-ad47-196ba820d67f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 33e7e716-e8e1-4773-b9f3-ceb8ccc86153] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:27.991912 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3609c3eb-e907-429a-ad47-196ba820d67f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:27.992526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3609c3eb-e907-429a-ad47-196ba820d67f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:27.993085 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3609c3eb-e907-429a-ad47-196ba820d67f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:27.993894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3609c3eb-e907-429a-ad47-196ba820d67f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:27.994541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3609c3eb-e907-429a-ad47-196ba820d67f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:27.998223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3609c3eb-e907-429a-ad47-196ba820d67f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:28.047327 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3609c3eb-e907-429a-ad47-196ba820d67f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:28.048100 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3609c3eb-e907-429a-ad47-196ba820d67f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:28.048704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3609c3eb-e907-429a-ad47-196ba820d67f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:28.049343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-3609c3eb-e907-429a-ad47-196ba820d67f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lazy-loading 'fault' on Instance uuid 33e7e716-e8e1-4773-b9f3-ceb8ccc86153 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:00:28.155875 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3609c3eb-e907-429a-ad47-196ba820d67f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:28.166351 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3609c3eb-e907-429a-ad47-196ba820d67f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153" status: 200 len: 1311 microversion: 2.1 time: 0.194177 Oct 05 03:00:28.166960 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2904/5785] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:27 2022] GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153 => generated 1311 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:00:29.195783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8731073a-e9ea-4cc0-8a76-909ce90f0eaf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:29.197974 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8731073a-e9ea-4cc0-8a76-909ce90f0eaf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 33e7e716-e8e1-4773-b9f3-ceb8ccc86153] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:29.219865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8731073a-e9ea-4cc0-8a76-909ce90f0eaf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:29.220394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8731073a-e9ea-4cc0-8a76-909ce90f0eaf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:29.220846 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8731073a-e9ea-4cc0-8a76-909ce90f0eaf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:29.225211 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8731073a-e9ea-4cc0-8a76-909ce90f0eaf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:29.225712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8731073a-e9ea-4cc0-8a76-909ce90f0eaf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:29.236340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8731073a-e9ea-4cc0-8a76-909ce90f0eaf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:29.286056 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-8731073a-e9ea-4cc0-8a76-909ce90f0eaf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] HTTP exception thrown: Instance 33e7e716-e8e1-4773-b9f3-ceb8ccc86153 could not be found. Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8731073a-e9ea-4cc0-8a76-909ce90f0eaf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Request method failure captured: Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153 HTTP/1.1 Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPMRSX2gjlikFUspC1UWD3LpY1ceHV7QevQM_Ijag9QQ0seWSmWQwasVLfA-3qPo60WBeSjn_ysZhLr4smwuTcgmq5PXaeLA0zkzWirUA1z0qMp7vToCduQRast94phmM-CNx-XY-K9McRIC58Qrl_qL_n7FYacRtEkL0ls1cybFzQg Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f477959bd24b4db881b62dab54861aa5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersTestJSON-1099213797 Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersTestJSON-1099213797-project Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 12d0128e850f4f22a2172800c44074a4 Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersTestJSON-1099213797-project Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 33e7e716-e8e1-4773-b9f3-ceb8ccc86153 could not be found. Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '33e7e716-e8e1-4773-b9f3-ceb8ccc86153'} Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33e7e716-e8e1-4773-b9f3-ceb8ccc86153 could not be found. Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33e7e716-e8e1-4773-b9f3-ceb8ccc86153 could not be found. Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:00:29.292226 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:00:29.297446 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:00:29.297446 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:00:29.297446 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:00:29.297446 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:00:29.297446 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:00:29.297446 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33e7e716-e8e1-4773-b9f3-ceb8ccc86153 could not be found. Oct 05 03:00:29.297446 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:00:29.297446 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8731073a-e9ea-4cc0-8a76-909ce90f0eaf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Returning 404 to user: Instance 33e7e716-e8e1-4773-b9f3-ceb8ccc86153 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:00:29.297446 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8731073a-e9ea-4cc0-8a76-909ce90f0eaf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153" status: 404 len: 111 microversion: 2.1 time: 0.105224 Oct 05 03:00:29.300964 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2882/5786] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:29 2022] GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:00:29.310701 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d5576395-ce17-4df7-af38-33a14aee9462 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Action: 'create', calling method: .version_select at 0x7fccdf1799d0>, body: {"keypair": {"name": "tempest-key-892267486", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1YjktNeixrJZtZREaf/mXSxP1fh1mKr50tHDUMqq3zVXi/+CohLJVW318hOB058/7qmf/N3aXtGUfyIWFHzvrxw7zufImvCWYhdgqXe0/rL2VVQSlO0n2x1x0KVVIRzg=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:00:29.351184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-d5576395-ce17-4df7-af38-33a14aee9462 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Getting quotas for project f477959bd24b4db881b62dab54861aa5. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:00:29.360945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-d5576395-ce17-4df7-af38-33a14aee9462 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Getting quotas for user 12d0128e850f4f22a2172800c44074a4 and project f477959bd24b4db881b62dab54861aa5. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:00:29.396553 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d5576395-ce17-4df7-af38-33a14aee9462 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.089930 Oct 05 03:00:29.397364 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2905/5787] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 03:00:29 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:00:29.409788 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-baadd0e5-7eee-42b5-9800-d9e6d22e8a07 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '.version_select at 0x7fccdf179700>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:29.414558 n-d-858272-3 devstack@n-api.service[122320]: WARNING oslo_db.sqlalchemy.utils [None req-baadd0e5-7eee-42b5-9800-d9e6d22e8a07 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 05 03:00:29.430270 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-baadd0e5-7eee-42b5-9800-d9e6d22e8a07 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.023592 Oct 05 03:00:29.431267 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2883/5788] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 5 03:00:29 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:00:29.723863 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a42c9a98-e7e4-463b-99f7-11c4d3c26c29 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-27124197", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "key_name": "tempest-key-892267486", "networks": [{"uuid": "10f7eabf-9521-4437-a838-b9f76044e586"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:00:29.839555 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-a42c9a98-e7e4-463b-99f7-11c4d3c26c29 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] validate_networks() for [('10f7eabf-9521-4437-a838-b9f76044e586', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:00:31.024873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-a42c9a98-e7e4-463b-99f7-11c4d3c26c29 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:00:31.025641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-a42c9a98-e7e4-463b-99f7-11c4d3c26c29 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:00:31.025893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-a42c9a98-e7e4-463b-99f7-11c4d3c26c29 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:00:31.026486 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-a42c9a98-e7e4-463b-99f7-11c4d3c26c29 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:00:31.027386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-a42c9a98-e7e4-463b-99f7-11c4d3c26c29 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:00:31.058739 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a42c9a98-e7e4-463b-99f7-11c4d3c26c29 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:31.062103 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a42c9a98-e7e4-463b-99f7-11c4d3c26c29 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:31.063721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a42c9a98-e7e4-463b-99f7-11c4d3c26c29 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:31.064619 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a42c9a98-e7e4-463b-99f7-11c4d3c26c29 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:31.068696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a42c9a98-e7e4-463b-99f7-11c4d3c26c29 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:31.070048 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a42c9a98-e7e4-463b-99f7-11c4d3c26c29 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:31.114459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-a42c9a98-e7e4-463b-99f7-11c4d3c26c29 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Getting quotas for project f477959bd24b4db881b62dab54861aa5. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:00:31.121314 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-a42c9a98-e7e4-463b-99f7-11c4d3c26c29 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Getting quotas for user 12d0128e850f4f22a2172800c44074a4 and project f477959bd24b4db881b62dab54861aa5. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:00:31.146737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a42c9a98-e7e4-463b-99f7-11c4d3c26c29 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:00:31.150016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a42c9a98-e7e4-463b-99f7-11c4d3c26c29 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 9214c7d5-14aa-4547-aabb-abdcfff33001] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:00:31.236823 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a42c9a98-e7e4-463b-99f7-11c4d3c26c29 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.519381 Oct 05 03:00:31.238659 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2906/5789] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:00:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:00:31.254164 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c0f1b924-e591-42bd-bf13-cc126477bdac tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:31.255552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c0f1b924-e591-42bd-bf13-cc126477bdac tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 9214c7d5-14aa-4547-aabb-abdcfff33001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:31.264594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:31.751589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c0f1b924-e591-42bd-bf13-cc126477bdac tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:31.769399 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c0f1b924-e591-42bd-bf13-cc126477bdac tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001" status: 200 len: 1226 microversion: 2.1 time: 0.520934 Oct 05 03:00:31.779730 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2884/5790] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:31 2022] GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001 => generated 1226 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:00:32.796840 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4e0f894d-261e-4108-a2f9-a32152c6174d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:32.797486 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4e0f894d-261e-4108-a2f9-a32152c6174d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 9214c7d5-14aa-4547-aabb-abdcfff33001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:32.812874 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=7 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:32.818015 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e0f894d-261e-4108-a2f9-a32152c6174d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:32.818533 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e0f894d-261e-4108-a2f9-a32152c6174d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:32.818976 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e0f894d-261e-4108-a2f9-a32152c6174d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:32.824657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e0f894d-261e-4108-a2f9-a32152c6174d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:32.825811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e0f894d-261e-4108-a2f9-a32152c6174d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:32.826253 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e0f894d-261e-4108-a2f9-a32152c6174d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:33.065723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4e0f894d-261e-4108-a2f9-a32152c6174d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:33.080459 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4e0f894d-261e-4108-a2f9-a32152c6174d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001" status: 200 len: 1230 microversion: 2.1 time: 0.287351 Oct 05 03:00:33.083585 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2907/5791] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:32 2022] GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001 => generated 1230 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:00:34.109553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c2a26cbf-78c3-48d6-99df-a1f7aa0d03c6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:34.110180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c2a26cbf-78c3-48d6-99df-a1f7aa0d03c6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 9214c7d5-14aa-4547-aabb-abdcfff33001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:34.121019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2a26cbf-78c3-48d6-99df-a1f7aa0d03c6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:34.135898 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2a26cbf-78c3-48d6-99df-a1f7aa0d03c6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:34.136455 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2a26cbf-78c3-48d6-99df-a1f7aa0d03c6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:34.137305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2a26cbf-78c3-48d6-99df-a1f7aa0d03c6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:34.138389 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2a26cbf-78c3-48d6-99df-a1f7aa0d03c6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:34.138832 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2a26cbf-78c3-48d6-99df-a1f7aa0d03c6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:34.151972 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:34.285967 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c2a26cbf-78c3-48d6-99df-a1f7aa0d03c6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:34.295327 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c2a26cbf-78c3-48d6-99df-a1f7aa0d03c6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001" status: 200 len: 1222 microversion: 2.1 time: 0.190243 Oct 05 03:00:34.295927 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2885/5792] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:34 2022] GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001 => generated 1222 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:00:35.324476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d13d1101-bbff-4f6b-80c1-2d201c2cee22 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:35.325659 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d13d1101-bbff-4f6b-80c1-2d201c2cee22 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 9214c7d5-14aa-4547-aabb-abdcfff33001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:35.343947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d13d1101-bbff-4f6b-80c1-2d201c2cee22 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:35.344453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d13d1101-bbff-4f6b-80c1-2d201c2cee22 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:35.351293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d13d1101-bbff-4f6b-80c1-2d201c2cee22 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:35.354470 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d13d1101-bbff-4f6b-80c1-2d201c2cee22 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:35.356873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d13d1101-bbff-4f6b-80c1-2d201c2cee22 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:35.360733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d13d1101-bbff-4f6b-80c1-2d201c2cee22 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:35.590468 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d13d1101-bbff-4f6b-80c1-2d201c2cee22 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:35.609963 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d13d1101-bbff-4f6b-80c1-2d201c2cee22 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001" status: 200 len: 1284 microversion: 2.1 time: 0.284008 Oct 05 03:00:35.613089 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2908/5793] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:35 2022] GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001 => generated 1284 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:00:36.645164 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ae79dad8-936e-44e9-b112-de69efa9eeb9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:36.646844 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ae79dad8-936e-44e9-b112-de69efa9eeb9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 9214c7d5-14aa-4547-aabb-abdcfff33001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:36.663090 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae79dad8-936e-44e9-b112-de69efa9eeb9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:36.664525 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae79dad8-936e-44e9-b112-de69efa9eeb9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:36.666764 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae79dad8-936e-44e9-b112-de69efa9eeb9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:36.669680 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae79dad8-936e-44e9-b112-de69efa9eeb9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:36.670620 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae79dad8-936e-44e9-b112-de69efa9eeb9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:36.672558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae79dad8-936e-44e9-b112-de69efa9eeb9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:36.929958 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ae79dad8-936e-44e9-b112-de69efa9eeb9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:36.938927 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ae79dad8-936e-44e9-b112-de69efa9eeb9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001" status: 200 len: 1284 microversion: 2.1 time: 0.299715 Oct 05 03:00:36.961322 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2886/5794] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:36 2022] GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001 => generated 1284 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:00:37.967508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-43f69e21-f97e-4868-929f-54d823188b88 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:37.968130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-43f69e21-f97e-4868-929f-54d823188b88 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 9214c7d5-14aa-4547-aabb-abdcfff33001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:37.982897 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43f69e21-f97e-4868-929f-54d823188b88 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:37.983406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43f69e21-f97e-4868-929f-54d823188b88 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:37.985868 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43f69e21-f97e-4868-929f-54d823188b88 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:37.986635 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43f69e21-f97e-4868-929f-54d823188b88 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:37.991477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43f69e21-f97e-4868-929f-54d823188b88 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:37.991958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43f69e21-f97e-4868-929f-54d823188b88 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:38.828225 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-43f69e21-f97e-4868-929f-54d823188b88 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:38.854148 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-43f69e21-f97e-4868-929f-54d823188b88 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001" status: 200 len: 1326 microversion: 2.1 time: 0.891517 Oct 05 03:00:38.868225 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2909/5795] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:37 2022] GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001 => generated 1326 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:00:39.899692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cd437d8d-0172-47ec-88eb-10b12ecd881b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:39.904687 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cd437d8d-0172-47ec-88eb-10b12ecd881b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 9214c7d5-14aa-4547-aabb-abdcfff33001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:39.914252 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd437d8d-0172-47ec-88eb-10b12ecd881b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:39.916114 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd437d8d-0172-47ec-88eb-10b12ecd881b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:39.917155 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd437d8d-0172-47ec-88eb-10b12ecd881b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:39.927176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd437d8d-0172-47ec-88eb-10b12ecd881b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:39.928199 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd437d8d-0172-47ec-88eb-10b12ecd881b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:39.928884 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd437d8d-0172-47ec-88eb-10b12ecd881b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:40.440737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cd437d8d-0172-47ec-88eb-10b12ecd881b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:40.451339 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cd437d8d-0172-47ec-88eb-10b12ecd881b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001" status: 200 len: 1326 microversion: 2.1 time: 0.559338 Oct 05 03:00:40.452117 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2887/5796] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:39 2022] GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001 => generated 1326 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:00:40.738554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-4b5cddfa-e5e1-46cd-a9b0-37b0f437ac2f req-c7f09506-ac22-4099-b553-793319a7f0e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9214c7d5-14aa-4547-aabb-abdcfff33001", "tag": "386fe12c-8ccd-44e8-968c-3a6748124ff9"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:00:40.761653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4b5cddfa-e5e1-46cd-a9b0-37b0f437ac2f req-c7f09506-ac22-4099-b553-793319a7f0e4 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:40.762696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4b5cddfa-e5e1-46cd-a9b0-37b0f437ac2f req-c7f09506-ac22-4099-b553-793319a7f0e4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:40.763548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4b5cddfa-e5e1-46cd-a9b0-37b0f437ac2f req-c7f09506-ac22-4099-b553-793319a7f0e4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:40.805691 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-4b5cddfa-e5e1-46cd-a9b0-37b0f437ac2f req-c7f09506-ac22-4099-b553-793319a7f0e4 service nova] Creating event network-changed:386fe12c-8ccd-44e8-968c-3a6748124ff9 for instance 9214c7d5-14aa-4547-aabb-abdcfff33001 on n-h2-858272-3 Oct 05 03:00:40.812369 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-4b5cddfa-e5e1-46cd-a9b0-37b0f437ac2f req-c7f09506-ac22-4099-b553-793319a7f0e4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086409 Oct 05 03:00:40.813655 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2910/5797] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:00:41.472341 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:41.474018 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=10 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:41.482001 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7a1994ec-ed6f-4b10-a846-6a5246cff954 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:41.483190 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7a1994ec-ed6f-4b10-a846-6a5246cff954 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 9214c7d5-14aa-4547-aabb-abdcfff33001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:41.499018 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7a1994ec-ed6f-4b10-a846-6a5246cff954 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:41.499893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7a1994ec-ed6f-4b10-a846-6a5246cff954 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:41.500574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7a1994ec-ed6f-4b10-a846-6a5246cff954 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:41.503112 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7a1994ec-ed6f-4b10-a846-6a5246cff954 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:41.504938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7a1994ec-ed6f-4b10-a846-6a5246cff954 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:41.505640 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7a1994ec-ed6f-4b10-a846-6a5246cff954 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:41.757193 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:41.849467 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7a1994ec-ed6f-4b10-a846-6a5246cff954 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:41.868689 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7a1994ec-ed6f-4b10-a846-6a5246cff954 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001" status: 200 len: 1326 microversion: 2.1 time: 0.396746 Oct 05 03:00:41.874128 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2911/5798] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:41 2022] GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001 => generated 1326 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:00:41.939415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-366dae90-3f2e-4444-b1a9-a976a170d38b tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-857768377", "availability_zone": "foo_zone"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:00:41.946227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.aggregate [None req-366dae90-3f2e-4444-b1a9-a976a170d38b tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] Generated uuid fe97f43b-5015-4895-91b5-293e540f5616 for aggregate {{(pid=122320) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 03:00:42.081018 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-366dae90-3f2e-4444-b1a9-a976a170d38b tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 1.078868 Oct 05 03:00:42.083391 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2888/5799] 10.222.0.16 () {60 vars in 1164 bytes} [Wed Oct 5 03:00:40 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:00:42.097919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e37fb2e1-f3e3-44d0-adcc-ecf6e894f617 tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:00:42.154654 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e37fb2e1-f3e3-44d0-adcc-ecf6e894f617 tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.055145 Oct 05 03:00:42.155852 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2912/5800] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Oct 5 03:00:42 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:00:42.167747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-753beb6a-0dfb-4605-a4e0-c7461aca741f tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:42.173313 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-753beb6a-0dfb-4605-a4e0-c7461aca741f tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:42.173814 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-753beb6a-0dfb-4605-a4e0-c7461aca741f tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:42.174255 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-753beb6a-0dfb-4605-a4e0-c7461aca741f tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:42.175008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-753beb6a-0dfb-4605-a4e0-c7461aca741f tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:42.175462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-753beb6a-0dfb-4605-a4e0-c7461aca741f tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:42.175888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-753beb6a-0dfb-4605-a4e0-c7461aca741f tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:42.279171 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-753beb6a-0dfb-4605-a4e0-c7461aca741f tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.115023 Oct 05 03:00:42.295505 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2889/5801] 10.222.0.16 () {58 vars in 1176 bytes} [Wed Oct 5 03:00:42 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:00:42.297165 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8c371c85-6d2b-46ed-aa0f-9f29d4e04b1b tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:42.320961 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8c371c85-6d2b-46ed-aa0f-9f29d4e04b1b tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.029028 Oct 05 03:00:42.327867 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2913/5802] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 5 03:00:42 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:00:42.337481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-aa100180-9004-4283-bcf7-c2f3a0c94f83 tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858272-3"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:00:42.353291 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa100180-9004-4283-bcf7-c2f3a0c94f83 tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:42.354797 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa100180-9004-4283-bcf7-c2f3a0c94f83 tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:42.356285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa100180-9004-4283-bcf7-c2f3a0c94f83 tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:42.766476 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-aa100180-9004-4283-bcf7-c2f3a0c94f83 tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.433234 Oct 05 03:00:42.774081 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2890/5803] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Oct 5 03:00:42 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:00:42.780276 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5ae847c2-e7d8-4820-af7b-2162a338a465 tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:42.798623 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5ae847c2-e7d8-4820-af7b-2162a338a465 tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.022701 Oct 05 03:00:42.806602 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2914/5804] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 5 03:00:42 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:00:42.812541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ed7e2888-5570-4b6e-a513-8f9daae0fffe tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1623405065", "availability_zone": "foo_zone"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:00:42.905269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-72c3311f-e291-41b9-8164-33b6b88e0096 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:42.909342 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-72c3311f-e291-41b9-8164-33b6b88e0096 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 9214c7d5-14aa-4547-aabb-abdcfff33001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:42.945127 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ed7e2888-5570-4b6e-a513-8f9daae0fffe tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.123633 Oct 05 03:00:42.945127 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2891/5805] 10.222.0.16 () {60 vars in 1173 bytes} [Wed Oct 5 03:00:42 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:00:42.969419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8c22dcf0-776b-4864-ac14-edc233c69f48 tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:00:42.972585 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72c3311f-e291-41b9-8164-33b6b88e0096 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:42.978388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72c3311f-e291-41b9-8164-33b6b88e0096 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:42.980611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72c3311f-e291-41b9-8164-33b6b88e0096 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:42.982437 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72c3311f-e291-41b9-8164-33b6b88e0096 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:42.987551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72c3311f-e291-41b9-8164-33b6b88e0096 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:42.988379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72c3311f-e291-41b9-8164-33b6b88e0096 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:43.052339 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8c22dcf0-776b-4864-ac14-edc233c69f48 tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.103563 Oct 05 03:00:43.055556 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2892/5806] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Oct 5 03:00:42 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:00:43.073744 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0f342b78-2242-44d7-a202-f590523a035d tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:43.119598 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0f342b78-2242-44d7-a202-f590523a035d tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.053886 Oct 05 03:00:43.127914 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2893/5807] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 5 03:00:43 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:00:43.138277 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-37610f6d-4850-4946-bafc-a7433c570b48 tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858272-3"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:00:43.211463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-37610f6d-4850-4946-bafc-a7433c570b48 tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:43.212749 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-37610f6d-4850-4946-bafc-a7433c570b48 tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:43.217394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-37610f6d-4850-4946-bafc-a7433c570b48 tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:43.350040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-72c3311f-e291-41b9-8164-33b6b88e0096 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:43.373053 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-72c3311f-e291-41b9-8164-33b6b88e0096 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001" status: 200 len: 1330 microversion: 2.1 time: 0.476950 Oct 05 03:00:43.376765 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2915/5808] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:42 2022] GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001 => generated 1330 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:00:43.502432 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-37610f6d-4850-4946-bafc-a7433c570b48 tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.371776 Oct 05 03:00:43.505451 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2894/5809] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Oct 5 03:00:43 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:00:43.524469 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ae6c6ccb-40a6-419f-b816-2d007cf2e461 tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:43.582548 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ae6c6ccb-40a6-419f-b816-2d007cf2e461 tempest-TestAggregatesBasicOps-1399234754 tempest-TestAggregatesBasicOps-1399234754-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.066698 Oct 05 03:00:43.585399 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2916/5810] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 5 03:00:43 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 03:00:44.409710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-29e3637b-f8fe-4c9e-a384-c0b6c78b4843 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:44.411492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-29e3637b-f8fe-4c9e-a384-c0b6c78b4843 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 9214c7d5-14aa-4547-aabb-abdcfff33001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:44.428400 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29e3637b-f8fe-4c9e-a384-c0b6c78b4843 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:44.431010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29e3637b-f8fe-4c9e-a384-c0b6c78b4843 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:44.431651 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29e3637b-f8fe-4c9e-a384-c0b6c78b4843 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:44.432589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29e3637b-f8fe-4c9e-a384-c0b6c78b4843 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:44.434332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29e3637b-f8fe-4c9e-a384-c0b6c78b4843 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:44.435983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29e3637b-f8fe-4c9e-a384-c0b6c78b4843 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:45.709956 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-29e3637b-f8fe-4c9e-a384-c0b6c78b4843 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:45.729899 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-29e3637b-f8fe-4c9e-a384-c0b6c78b4843 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001" status: 200 len: 1326 microversion: 2.1 time: 1.328774 Oct 05 03:00:45.734353 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2895/5811] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:44 2022] GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001 => generated 1326 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:00:46.774214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-239fda86-1788-40f4-9f69-727cb94c5b6e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:46.775521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-239fda86-1788-40f4-9f69-727cb94c5b6e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 9214c7d5-14aa-4547-aabb-abdcfff33001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:46.821060 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-239fda86-1788-40f4-9f69-727cb94c5b6e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:46.824669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-239fda86-1788-40f4-9f69-727cb94c5b6e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:46.825509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-239fda86-1788-40f4-9f69-727cb94c5b6e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:46.826506 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-239fda86-1788-40f4-9f69-727cb94c5b6e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:46.827183 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-239fda86-1788-40f4-9f69-727cb94c5b6e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:46.830885 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-239fda86-1788-40f4-9f69-727cb94c5b6e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:47.592622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-239fda86-1788-40f4-9f69-727cb94c5b6e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:47.602726 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-239fda86-1788-40f4-9f69-727cb94c5b6e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001" status: 200 len: 1326 microversion: 2.1 time: 0.839338 Oct 05 03:00:47.604723 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2917/5812] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:46 2022] GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001 => generated 1326 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:00:48.629220 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ffcf98a5-87b0-4bda-8f45-161ea9fea708 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:48.630427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ffcf98a5-87b0-4bda-8f45-161ea9fea708 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 9214c7d5-14aa-4547-aabb-abdcfff33001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:48.643556 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ffcf98a5-87b0-4bda-8f45-161ea9fea708 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:48.647291 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ffcf98a5-87b0-4bda-8f45-161ea9fea708 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:48.647938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ffcf98a5-87b0-4bda-8f45-161ea9fea708 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:48.656283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ffcf98a5-87b0-4bda-8f45-161ea9fea708 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:48.657905 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ffcf98a5-87b0-4bda-8f45-161ea9fea708 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:48.665535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ffcf98a5-87b0-4bda-8f45-161ea9fea708 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:49.002944 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ffcf98a5-87b0-4bda-8f45-161ea9fea708 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:49.017513 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ffcf98a5-87b0-4bda-8f45-161ea9fea708 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001" status: 200 len: 1326 microversion: 2.1 time: 0.393565 Oct 05 03:00:49.018865 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2896/5813] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:48 2022] GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001 => generated 1326 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:00:49.950019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-a200e3dc-3c1c-4ebc-9989-ababb0923d56 req-6ba3e4a7-9d1f-461e-8353-b45ea8a7d06e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9214c7d5-14aa-4547-aabb-abdcfff33001", "name": "network-vif-plugged", "status": "completed", "tag": "386fe12c-8ccd-44e8-968c-3a6748124ff9"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:00:49.976597 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a200e3dc-3c1c-4ebc-9989-ababb0923d56 req-6ba3e4a7-9d1f-461e-8353-b45ea8a7d06e service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:49.981507 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a200e3dc-3c1c-4ebc-9989-ababb0923d56 req-6ba3e4a7-9d1f-461e-8353-b45ea8a7d06e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:49.981998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a200e3dc-3c1c-4ebc-9989-ababb0923d56 req-6ba3e4a7-9d1f-461e-8353-b45ea8a7d06e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:50.044110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0798bc4d-ceeb-4567-adbf-50dd51f64f17 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:50.045400 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0798bc4d-ceeb-4567-adbf-50dd51f64f17 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 9214c7d5-14aa-4547-aabb-abdcfff33001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:50.063315 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-a200e3dc-3c1c-4ebc-9989-ababb0923d56 req-6ba3e4a7-9d1f-461e-8353-b45ea8a7d06e service nova] Creating event network-vif-plugged:386fe12c-8ccd-44e8-968c-3a6748124ff9 for instance 9214c7d5-14aa-4547-aabb-abdcfff33001 on n-h2-858272-3 Oct 05 03:00:50.073432 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0798bc4d-ceeb-4567-adbf-50dd51f64f17 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:50.074309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0798bc4d-ceeb-4567-adbf-50dd51f64f17 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:50.074960 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0798bc4d-ceeb-4567-adbf-50dd51f64f17 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:50.087666 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0798bc4d-ceeb-4567-adbf-50dd51f64f17 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:50.088516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0798bc4d-ceeb-4567-adbf-50dd51f64f17 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:50.089617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0798bc4d-ceeb-4567-adbf-50dd51f64f17 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:50.096108 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-a200e3dc-3c1c-4ebc-9989-ababb0923d56 req-6ba3e4a7-9d1f-461e-8353-b45ea8a7d06e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148993 Oct 05 03:00:50.102192 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2918/5814] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:00:50.477320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0798bc4d-ceeb-4567-adbf-50dd51f64f17 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:50.487646 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0798bc4d-ceeb-4567-adbf-50dd51f64f17 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001" status: 200 len: 1326 microversion: 2.1 time: 0.449913 Oct 05 03:00:50.490889 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2897/5815] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:50 2022] GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001 => generated 1326 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:00:51.513722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4dc11ac4-31e7-44d7-8514-fb0879d8e6c4 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:51.514504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4dc11ac4-31e7-44d7-8514-fb0879d8e6c4 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 9214c7d5-14aa-4547-aabb-abdcfff33001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:51.526390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4dc11ac4-31e7-44d7-8514-fb0879d8e6c4 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:51.526890 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4dc11ac4-31e7-44d7-8514-fb0879d8e6c4 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:51.527335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4dc11ac4-31e7-44d7-8514-fb0879d8e6c4 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:51.528657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4dc11ac4-31e7-44d7-8514-fb0879d8e6c4 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:51.529152 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4dc11ac4-31e7-44d7-8514-fb0879d8e6c4 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:51.529584 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4dc11ac4-31e7-44d7-8514-fb0879d8e6c4 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:52.026737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4dc11ac4-31e7-44d7-8514-fb0879d8e6c4 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:52.035644 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4dc11ac4-31e7-44d7-8514-fb0879d8e6c4 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001" status: 200 len: 1326 microversion: 2.1 time: 0.527576 Oct 05 03:00:52.052959 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2919/5816] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:51 2022] GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001 => generated 1326 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:00:53.069311 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2ef63e62-95f0-4c15-a319-b16a09cd53b1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:53.070265 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2ef63e62-95f0-4c15-a319-b16a09cd53b1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 9214c7d5-14aa-4547-aabb-abdcfff33001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:53.077043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:53.088099 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ef63e62-95f0-4c15-a319-b16a09cd53b1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:53.093823 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ef63e62-95f0-4c15-a319-b16a09cd53b1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:53.094672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ef63e62-95f0-4c15-a319-b16a09cd53b1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:53.095557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ef63e62-95f0-4c15-a319-b16a09cd53b1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:53.097237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ef63e62-95f0-4c15-a319-b16a09cd53b1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:53.098635 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2ef63e62-95f0-4c15-a319-b16a09cd53b1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:53.467410 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2ef63e62-95f0-4c15-a319-b16a09cd53b1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:53.479106 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2ef63e62-95f0-4c15-a319-b16a09cd53b1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001" status: 200 len: 1507 microversion: 2.1 time: 0.415628 Oct 05 03:00:53.480317 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2898/5817] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:53 2022] GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001 => generated 1507 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:00:53.506496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3eb0dee4-adf3-4ee8-92ae-ccc7a1ced60e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:53.507847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3eb0dee4-adf3-4ee8-92ae-ccc7a1ced60e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 9214c7d5-14aa-4547-aabb-abdcfff33001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:53.529051 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3eb0dee4-adf3-4ee8-92ae-ccc7a1ced60e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:53.530114 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3eb0dee4-adf3-4ee8-92ae-ccc7a1ced60e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:53.530850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3eb0dee4-adf3-4ee8-92ae-ccc7a1ced60e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:53.533593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3eb0dee4-adf3-4ee8-92ae-ccc7a1ced60e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:53.534373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3eb0dee4-adf3-4ee8-92ae-ccc7a1ced60e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:53.536733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3eb0dee4-adf3-4ee8-92ae-ccc7a1ced60e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:53.886090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3eb0dee4-adf3-4ee8-92ae-ccc7a1ced60e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:53.896383 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3eb0dee4-adf3-4ee8-92ae-ccc7a1ced60e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001" status: 200 len: 1507 microversion: 2.1 time: 0.394360 Oct 05 03:00:53.901811 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2920/5818] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:53 2022] GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001 => generated 1507 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:00:53.921463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-51e9ed6f-5462-4efd-8f97-ec049fd78799 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:53.922367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-51e9ed6f-5462-4efd-8f97-ec049fd78799 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 9214c7d5-14aa-4547-aabb-abdcfff33001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:53.933494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51e9ed6f-5462-4efd-8f97-ec049fd78799 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:53.935391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51e9ed6f-5462-4efd-8f97-ec049fd78799 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:53.936354 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51e9ed6f-5462-4efd-8f97-ec049fd78799 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:53.937331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51e9ed6f-5462-4efd-8f97-ec049fd78799 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:53.938237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51e9ed6f-5462-4efd-8f97-ec049fd78799 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:53.938885 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51e9ed6f-5462-4efd-8f97-ec049fd78799 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:53.970129 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-51e9ed6f-5462-4efd-8f97-ec049fd78799 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 9214c7d5-14aa-4547-aabb-abdcfff33001] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:00:54.198677 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-51e9ed6f-5462-4efd-8f97-ec049fd78799 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001" status: 204 len: 0 microversion: 2.1 time: 0.281950 Oct 05 03:00:54.201891 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2899/5819] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:00:53 2022] DELETE /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:00:54.211103 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-28f62e7e-9c4d-4bbf-b6c0-c9d0b2a6c65b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:54.211959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-28f62e7e-9c4d-4bbf-b6c0-c9d0b2a6c65b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 9214c7d5-14aa-4547-aabb-abdcfff33001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:54.223075 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28f62e7e-9c4d-4bbf-b6c0-c9d0b2a6c65b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:54.223769 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28f62e7e-9c4d-4bbf-b6c0-c9d0b2a6c65b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:54.224560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28f62e7e-9c4d-4bbf-b6c0-c9d0b2a6c65b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:54.225566 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28f62e7e-9c4d-4bbf-b6c0-c9d0b2a6c65b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:54.226382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28f62e7e-9c4d-4bbf-b6c0-c9d0b2a6c65b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:54.227022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28f62e7e-9c4d-4bbf-b6c0-c9d0b2a6c65b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:54.718972 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-28f62e7e-9c4d-4bbf-b6c0-c9d0b2a6c65b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:54.734664 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-28f62e7e-9c4d-4bbf-b6c0-c9d0b2a6c65b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001" status: 200 len: 1513 microversion: 2.1 time: 0.528027 Oct 05 03:00:54.735796 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2921/5820] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:54 2022] GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001 => generated 1513 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:00:55.763795 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0d3a3ec1-5b13-4c13-97ee-7e8f6b4c53ac tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:55.764510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0d3a3ec1-5b13-4c13-97ee-7e8f6b4c53ac tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 9214c7d5-14aa-4547-aabb-abdcfff33001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:55.783342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d3a3ec1-5b13-4c13-97ee-7e8f6b4c53ac tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:55.783994 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d3a3ec1-5b13-4c13-97ee-7e8f6b4c53ac tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:55.784274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d3a3ec1-5b13-4c13-97ee-7e8f6b4c53ac tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:55.784997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d3a3ec1-5b13-4c13-97ee-7e8f6b4c53ac tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:55.785452 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d3a3ec1-5b13-4c13-97ee-7e8f6b4c53ac tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:55.785868 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d3a3ec1-5b13-4c13-97ee-7e8f6b4c53ac tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:56.081825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0d3a3ec1-5b13-4c13-97ee-7e8f6b4c53ac tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:56.093229 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0d3a3ec1-5b13-4c13-97ee-7e8f6b4c53ac tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001" status: 200 len: 1513 microversion: 2.1 time: 0.337132 Oct 05 03:00:56.096208 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2900/5821] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:55 2022] GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001 => generated 1513 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:00:57.124847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-446aa30c-9fd9-4071-ae03-11edaf47bddd tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:57.126217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-446aa30c-9fd9-4071-ae03-11edaf47bddd tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 9214c7d5-14aa-4547-aabb-abdcfff33001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:57.145565 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-446aa30c-9fd9-4071-ae03-11edaf47bddd tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:57.150326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-446aa30c-9fd9-4071-ae03-11edaf47bddd tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:57.152090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-446aa30c-9fd9-4071-ae03-11edaf47bddd tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:57.154246 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-446aa30c-9fd9-4071-ae03-11edaf47bddd tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:57.157457 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-446aa30c-9fd9-4071-ae03-11edaf47bddd tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:57.159826 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-446aa30c-9fd9-4071-ae03-11edaf47bddd tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:57.173855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=74 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:57.378665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-446aa30c-9fd9-4071-ae03-11edaf47bddd tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:00:57.388073 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-446aa30c-9fd9-4071-ae03-11edaf47bddd tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001" status: 200 len: 1471 microversion: 2.1 time: 0.268245 Oct 05 03:00:57.408928 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2922/5822] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:57 2022] GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001 => generated 1471 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:00:57.548432 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-a818cad6-3331-4029-a202-520a36735c45 req-6d91e37d-702a-4ecc-9c58-d1c97029e406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9214c7d5-14aa-4547-aabb-abdcfff33001", "name": "network-vif-deleted", "tag": "386fe12c-8ccd-44e8-968c-3a6748124ff9"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:00:57.597443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a818cad6-3331-4029-a202-520a36735c45 req-6d91e37d-702a-4ecc-9c58-d1c97029e406 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:57.618558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a818cad6-3331-4029-a202-520a36735c45 req-6d91e37d-702a-4ecc-9c58-d1c97029e406 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:57.619046 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a818cad6-3331-4029-a202-520a36735c45 req-6d91e37d-702a-4ecc-9c58-d1c97029e406 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:57.677645 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-a818cad6-3331-4029-a202-520a36735c45 req-6d91e37d-702a-4ecc-9c58-d1c97029e406 service nova] Creating event network-vif-deleted:386fe12c-8ccd-44e8-968c-3a6748124ff9 for instance 9214c7d5-14aa-4547-aabb-abdcfff33001 on n-h2-858272-3 Oct 05 03:00:57.706473 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-a818cad6-3331-4029-a202-520a36735c45 req-6d91e37d-702a-4ecc-9c58-d1c97029e406 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167789 Oct 05 03:00:57.707323 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2901/5823] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:00:58.431676 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a68fa45c-ab20-4a0b-99c4-afef7e8f8738 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:58.433119 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a68fa45c-ab20-4a0b-99c4-afef7e8f8738 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 9214c7d5-14aa-4547-aabb-abdcfff33001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:00:58.454622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a68fa45c-ab20-4a0b-99c4-afef7e8f8738 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:58.456751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a68fa45c-ab20-4a0b-99c4-afef7e8f8738 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:58.458956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a68fa45c-ab20-4a0b-99c4-afef7e8f8738 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:58.459951 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a68fa45c-ab20-4a0b-99c4-afef7e8f8738 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:58.460842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a68fa45c-ab20-4a0b-99c4-afef7e8f8738 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:58.464281 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a68fa45c-ab20-4a0b-99c4-afef7e8f8738 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:58.519873 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-a68fa45c-ab20-4a0b-99c4-afef7e8f8738 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] HTTP exception thrown: Instance 9214c7d5-14aa-4547-aabb-abdcfff33001 could not be found. Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a68fa45c-ab20-4a0b-99c4-afef7e8f8738 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Request method failure captured: Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001 HTTP/1.1 Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPMRSX2gjlikFUspC1UWD3LpY1ceHV7QevQM_Ijag9QQ0seWSmWQwasVLfA-3qPo60WBeSjn_ysZhLr4smwuTcgmq5PXaeLA0zkzWirUA1z0qMp7vToCduQRast94phmM-CNx-XY-K9McRIC58Qrl_qL_n7FYacRtEkL0ls1cybFzQg Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f477959bd24b4db881b62dab54861aa5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersTestJSON-1099213797 Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersTestJSON-1099213797-project Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 12d0128e850f4f22a2172800c44074a4 Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersTestJSON-1099213797-project Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 9214c7d5-14aa-4547-aabb-abdcfff33001 could not be found. Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '9214c7d5-14aa-4547-aabb-abdcfff33001'} Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9214c7d5-14aa-4547-aabb-abdcfff33001 could not be found. Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9214c7d5-14aa-4547-aabb-abdcfff33001 could not be found. Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:00:58.534360 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:00:58.541928 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:00:58.541928 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:00:58.541928 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:00:58.541928 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:00:58.541928 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:00:58.541928 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9214c7d5-14aa-4547-aabb-abdcfff33001 could not be found. Oct 05 03:00:58.541928 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:00:58.541928 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a68fa45c-ab20-4a0b-99c4-afef7e8f8738 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Returning 404 to user: Instance 9214c7d5-14aa-4547-aabb-abdcfff33001 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:00:58.541928 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a68fa45c-ab20-4a0b-99c4-afef7e8f8738 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001" status: 404 len: 111 microversion: 2.1 time: 0.108307 Oct 05 03:00:58.541928 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2923/5824] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:00:58 2022] GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:00:58.546470 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-32047f49-5e99-4efd-a5cc-59013074b2ff tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '.version_select at 0x7fcce8084280>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:00:58.611780 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-32047f49-5e99-4efd-a5cc-59013074b2ff tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-key-892267486" status: 202 len: 0 microversion: 2.1 time: 0.070662 Oct 05 03:00:58.625301 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2902/5825] 10.222.0.16 () {58 vars in 1206 bytes} [Wed Oct 5 03:00:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-892267486 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 03:00:58.864697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-483a52ca-5f02-4a04-90db-b9af98c395cc tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-701279312", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "10f7eabf-9521-4437-a838-b9f76044e586"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:00:58.946847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-483a52ca-5f02-4a04-90db-b9af98c395cc tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] validate_networks() for [('10f7eabf-9521-4437-a838-b9f76044e586', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:00:59.958729 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-483a52ca-5f02-4a04-90db-b9af98c395cc tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:00:59.960294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-483a52ca-5f02-4a04-90db-b9af98c395cc tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:00:59.962090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-483a52ca-5f02-4a04-90db-b9af98c395cc tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:00:59.962546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-483a52ca-5f02-4a04-90db-b9af98c395cc tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:00:59.963163 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-483a52ca-5f02-4a04-90db-b9af98c395cc tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:00:59.974520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-483a52ca-5f02-4a04-90db-b9af98c395cc tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:59.975056 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-483a52ca-5f02-4a04-90db-b9af98c395cc tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:59.975499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-483a52ca-5f02-4a04-90db-b9af98c395cc tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:00:59.979251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-483a52ca-5f02-4a04-90db-b9af98c395cc tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:00:59.979740 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-483a52ca-5f02-4a04-90db-b9af98c395cc tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:00:59.980194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-483a52ca-5f02-4a04-90db-b9af98c395cc tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:00.051742 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-483a52ca-5f02-4a04-90db-b9af98c395cc tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Getting quotas for project f477959bd24b4db881b62dab54861aa5. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:01:00.058301 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-483a52ca-5f02-4a04-90db-b9af98c395cc tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Getting quotas for user 12d0128e850f4f22a2172800c44074a4 and project f477959bd24b4db881b62dab54861aa5. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:01:00.101269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-483a52ca-5f02-4a04-90db-b9af98c395cc tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:01:00.103644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-483a52ca-5f02-4a04-90db-b9af98c395cc tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 6275bdb7-ef4e-42f5-8a43-d9c812d99feb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:01:00.272292 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-483a52ca-5f02-4a04-90db-b9af98c395cc tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.415608 Oct 05 03:01:00.279732 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2924/5826] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:00:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:01:00.289120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9d3caa34-0b13-4577-ad73-9233b3eeecdf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:00.290660 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9d3caa34-0b13-4577-ad73-9233b3eeecdf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 6275bdb7-ef4e-42f5-8a43-d9c812d99feb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:00.566063 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9d3caa34-0b13-4577-ad73-9233b3eeecdf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:00.581312 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9d3caa34-0b13-4577-ad73-9233b3eeecdf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb" status: 200 len: 1208 microversion: 2.1 time: 0.296527 Oct 05 03:01:00.584035 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2903/5827] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:00 2022] GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb => generated 1208 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:01.623756 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4ac97a6f-f45b-4815-bc9b-4f8ce096a56d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:01.625064 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4ac97a6f-f45b-4815-bc9b-4f8ce096a56d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 6275bdb7-ef4e-42f5-8a43-d9c812d99feb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:01.678834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ac97a6f-f45b-4815-bc9b-4f8ce096a56d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:01.680811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ac97a6f-f45b-4815-bc9b-4f8ce096a56d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:01.681425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ac97a6f-f45b-4815-bc9b-4f8ce096a56d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:01.688441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ac97a6f-f45b-4815-bc9b-4f8ce096a56d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:01.694926 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ac97a6f-f45b-4815-bc9b-4f8ce096a56d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:01.695628 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ac97a6f-f45b-4815-bc9b-4f8ce096a56d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:01.884436 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4ac97a6f-f45b-4815-bc9b-4f8ce096a56d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:01.896224 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4ac97a6f-f45b-4815-bc9b-4f8ce096a56d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb" status: 200 len: 1212 microversion: 2.1 time: 0.284076 Oct 05 03:01:01.896823 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2925/5828] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:01 2022] GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb => generated 1212 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:02.921238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a8b83b12-91aa-4339-9378-c6e44a23aa14 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:02.921988 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a8b83b12-91aa-4339-9378-c6e44a23aa14 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 6275bdb7-ef4e-42f5-8a43-d9c812d99feb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:02.925305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:02.939052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8b83b12-91aa-4339-9378-c6e44a23aa14 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:02.941590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8b83b12-91aa-4339-9378-c6e44a23aa14 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:02.942327 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8b83b12-91aa-4339-9378-c6e44a23aa14 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:02.945426 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8b83b12-91aa-4339-9378-c6e44a23aa14 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:02.946105 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8b83b12-91aa-4339-9378-c6e44a23aa14 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:02.947769 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8b83b12-91aa-4339-9378-c6e44a23aa14 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:03.106405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a8b83b12-91aa-4339-9378-c6e44a23aa14 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:03.122165 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a8b83b12-91aa-4339-9378-c6e44a23aa14 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb" status: 200 len: 1278 microversion: 2.1 time: 0.200578 Oct 05 03:01:03.123239 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2904/5829] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:02 2022] GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb => generated 1278 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:04.153752 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3aad12d8-a254-4f33-9b2f-41ed212d4569 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:04.155646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3aad12d8-a254-4f33-9b2f-41ed212d4569 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 6275bdb7-ef4e-42f5-8a43-d9c812d99feb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:04.157923 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:04.168162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3aad12d8-a254-4f33-9b2f-41ed212d4569 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:04.169271 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3aad12d8-a254-4f33-9b2f-41ed212d4569 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:04.169884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3aad12d8-a254-4f33-9b2f-41ed212d4569 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:04.170776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3aad12d8-a254-4f33-9b2f-41ed212d4569 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:04.171399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3aad12d8-a254-4f33-9b2f-41ed212d4569 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:04.171992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3aad12d8-a254-4f33-9b2f-41ed212d4569 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:04.414512 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3aad12d8-a254-4f33-9b2f-41ed212d4569 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:04.459252 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3aad12d8-a254-4f33-9b2f-41ed212d4569 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb" status: 200 len: 1308 microversion: 2.1 time: 0.298016 Oct 05 03:01:04.462489 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2926/5830] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:04 2022] GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb => generated 1308 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:05.492803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9ae3f73e-f977-4684-8bf5-f70ec06e8cf9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:05.493715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9ae3f73e-f977-4684-8bf5-f70ec06e8cf9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 6275bdb7-ef4e-42f5-8a43-d9c812d99feb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:05.519625 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ae3f73e-f977-4684-8bf5-f70ec06e8cf9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:05.520151 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ae3f73e-f977-4684-8bf5-f70ec06e8cf9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:05.520597 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ae3f73e-f977-4684-8bf5-f70ec06e8cf9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:05.525556 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ae3f73e-f977-4684-8bf5-f70ec06e8cf9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:05.527341 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ae3f73e-f977-4684-8bf5-f70ec06e8cf9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:05.528747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ae3f73e-f977-4684-8bf5-f70ec06e8cf9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:05.562132 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:06.019863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9ae3f73e-f977-4684-8bf5-f70ec06e8cf9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:06.038372 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9ae3f73e-f977-4684-8bf5-f70ec06e8cf9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb" status: 200 len: 1308 microversion: 2.1 time: 0.550582 Oct 05 03:01:06.038991 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2905/5831] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:05 2022] GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb => generated 1308 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:06.707389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-6660d069-be8d-48b1-8f26-b3958c8e8719 req-92484b3d-4d60-44ab-919e-8632e8d3862c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6275bdb7-ef4e-42f5-8a43-d9c812d99feb", "tag": "01dd0914-8cb4-466d-b2dc-ff21d5d378ad"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:01:06.743902 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6660d069-be8d-48b1-8f26-b3958c8e8719 req-92484b3d-4d60-44ab-919e-8632e8d3862c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:06.744468 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6660d069-be8d-48b1-8f26-b3958c8e8719 req-92484b3d-4d60-44ab-919e-8632e8d3862c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:06.746854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6660d069-be8d-48b1-8f26-b3958c8e8719 req-92484b3d-4d60-44ab-919e-8632e8d3862c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:06.782208 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-6660d069-be8d-48b1-8f26-b3958c8e8719 req-92484b3d-4d60-44ab-919e-8632e8d3862c service nova] Creating event network-changed:01dd0914-8cb4-466d-b2dc-ff21d5d378ad for instance 6275bdb7-ef4e-42f5-8a43-d9c812d99feb on n-h2-858272-3 Oct 05 03:01:06.797466 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-6660d069-be8d-48b1-8f26-b3958c8e8719 req-92484b3d-4d60-44ab-919e-8632e8d3862c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089092 Oct 05 03:01:06.798863 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2927/5832] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:01:07.062070 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f0be4a0d-03f2-48bf-b728-0c67f81268f6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:07.063907 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f0be4a0d-03f2-48bf-b728-0c67f81268f6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 6275bdb7-ef4e-42f5-8a43-d9c812d99feb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:07.082501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0be4a0d-03f2-48bf-b728-0c67f81268f6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:07.083099 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0be4a0d-03f2-48bf-b728-0c67f81268f6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:07.083578 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0be4a0d-03f2-48bf-b728-0c67f81268f6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:07.084644 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0be4a0d-03f2-48bf-b728-0c67f81268f6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:07.085299 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0be4a0d-03f2-48bf-b728-0c67f81268f6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:07.085733 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0be4a0d-03f2-48bf-b728-0c67f81268f6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:07.514815 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f0be4a0d-03f2-48bf-b728-0c67f81268f6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:07.526713 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f0be4a0d-03f2-48bf-b728-0c67f81268f6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb" status: 200 len: 1308 microversion: 2.1 time: 0.466245 Oct 05 03:01:07.544815 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2906/5833] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:07 2022] GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb => generated 1308 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:08.552606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b5e20c4f-7b24-4b91-ad8f-c2f15bd4caa9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:08.553335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b5e20c4f-7b24-4b91-ad8f-c2f15bd4caa9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 6275bdb7-ef4e-42f5-8a43-d9c812d99feb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:08.561924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5e20c4f-7b24-4b91-ad8f-c2f15bd4caa9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:08.562414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5e20c4f-7b24-4b91-ad8f-c2f15bd4caa9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:08.562857 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5e20c4f-7b24-4b91-ad8f-c2f15bd4caa9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:08.563559 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5e20c4f-7b24-4b91-ad8f-c2f15bd4caa9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:08.564020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5e20c4f-7b24-4b91-ad8f-c2f15bd4caa9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:08.564447 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5e20c4f-7b24-4b91-ad8f-c2f15bd4caa9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:09.052332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b5e20c4f-7b24-4b91-ad8f-c2f15bd4caa9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:09.060156 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b5e20c4f-7b24-4b91-ad8f-c2f15bd4caa9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb" status: 200 len: 1308 microversion: 2.1 time: 0.511683 Oct 05 03:01:09.079666 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2928/5834] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:08 2022] GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb => generated 1308 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:10.087480 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8d367e84-602e-4ad5-91b4-1f1905e9f95e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:10.088251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8d367e84-602e-4ad5-91b4-1f1905e9f95e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 6275bdb7-ef4e-42f5-8a43-d9c812d99feb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:10.099115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d367e84-602e-4ad5-91b4-1f1905e9f95e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:10.099627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d367e84-602e-4ad5-91b4-1f1905e9f95e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:10.100042 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d367e84-602e-4ad5-91b4-1f1905e9f95e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:10.100759 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d367e84-602e-4ad5-91b4-1f1905e9f95e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:10.125540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d367e84-602e-4ad5-91b4-1f1905e9f95e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:10.126034 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d367e84-602e-4ad5-91b4-1f1905e9f95e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:10.438980 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8d367e84-602e-4ad5-91b4-1f1905e9f95e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:10.453993 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8d367e84-602e-4ad5-91b4-1f1905e9f95e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb" status: 200 len: 1308 microversion: 2.1 time: 0.370698 Oct 05 03:01:10.456821 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2907/5835] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:10 2022] GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb => generated 1308 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:11.479208 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cd744bd1-1aa8-4a05-9780-2f55cedbd1ca tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:11.479960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cd744bd1-1aa8-4a05-9780-2f55cedbd1ca tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 6275bdb7-ef4e-42f5-8a43-d9c812d99feb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:11.489454 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:11.490257 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:11.496125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd744bd1-1aa8-4a05-9780-2f55cedbd1ca tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:11.496681 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd744bd1-1aa8-4a05-9780-2f55cedbd1ca tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:11.497826 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd744bd1-1aa8-4a05-9780-2f55cedbd1ca tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:11.499134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd744bd1-1aa8-4a05-9780-2f55cedbd1ca tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:11.501129 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd744bd1-1aa8-4a05-9780-2f55cedbd1ca tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:11.501637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd744bd1-1aa8-4a05-9780-2f55cedbd1ca tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:11.968313 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cd744bd1-1aa8-4a05-9780-2f55cedbd1ca tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:11.981412 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cd744bd1-1aa8-4a05-9780-2f55cedbd1ca tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb" status: 200 len: 1308 microversion: 2.1 time: 0.501170 Oct 05 03:01:11.993037 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2929/5836] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:11 2022] GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb => generated 1308 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:13.007581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3e441100-a17f-4172-a0c4-41e34cd45577 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:13.008207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3e441100-a17f-4172-a0c4-41e34cd45577 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 6275bdb7-ef4e-42f5-8a43-d9c812d99feb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:13.017908 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:13.028152 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e441100-a17f-4172-a0c4-41e34cd45577 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:13.028538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e441100-a17f-4172-a0c4-41e34cd45577 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:13.029016 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e441100-a17f-4172-a0c4-41e34cd45577 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:13.029737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e441100-a17f-4172-a0c4-41e34cd45577 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:13.030193 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e441100-a17f-4172-a0c4-41e34cd45577 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:13.030618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e441100-a17f-4172-a0c4-41e34cd45577 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:13.547075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3e441100-a17f-4172-a0c4-41e34cd45577 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:13.562633 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3e441100-a17f-4172-a0c4-41e34cd45577 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb" status: 200 len: 1308 microversion: 2.1 time: 0.558790 Oct 05 03:01:13.563482 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2908/5837] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:13 2022] GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb => generated 1308 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:14.591453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c07e5d11-b5e0-469b-911c-4e3c65dbb8d5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:14.593505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c07e5d11-b5e0-469b-911c-4e3c65dbb8d5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 6275bdb7-ef4e-42f5-8a43-d9c812d99feb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:14.613096 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c07e5d11-b5e0-469b-911c-4e3c65dbb8d5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:14.614498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c07e5d11-b5e0-469b-911c-4e3c65dbb8d5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:14.615180 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c07e5d11-b5e0-469b-911c-4e3c65dbb8d5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:14.624352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c07e5d11-b5e0-469b-911c-4e3c65dbb8d5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:14.625595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c07e5d11-b5e0-469b-911c-4e3c65dbb8d5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:14.626847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c07e5d11-b5e0-469b-911c-4e3c65dbb8d5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:15.187389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c07e5d11-b5e0-469b-911c-4e3c65dbb8d5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:15.201696 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c07e5d11-b5e0-469b-911c-4e3c65dbb8d5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb" status: 200 len: 1308 microversion: 2.1 time: 0.615822 Oct 05 03:01:15.205515 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2930/5838] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:14 2022] GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb => generated 1308 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:16.232450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7579bb61-35f8-40f4-b12d-3ac04513971c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:16.233489 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7579bb61-35f8-40f4-b12d-3ac04513971c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 6275bdb7-ef4e-42f5-8a43-d9c812d99feb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:16.246923 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7579bb61-35f8-40f4-b12d-3ac04513971c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:16.247488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7579bb61-35f8-40f4-b12d-3ac04513971c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:16.247948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7579bb61-35f8-40f4-b12d-3ac04513971c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:16.248681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7579bb61-35f8-40f4-b12d-3ac04513971c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:16.249177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7579bb61-35f8-40f4-b12d-3ac04513971c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:16.249609 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7579bb61-35f8-40f4-b12d-3ac04513971c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:16.524541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7579bb61-35f8-40f4-b12d-3ac04513971c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:16.549074 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7579bb61-35f8-40f4-b12d-3ac04513971c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb" status: 200 len: 1308 microversion: 2.1 time: 0.327185 Oct 05 03:01:16.552379 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2909/5839] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:16 2022] GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb => generated 1308 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:01:17.573778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4d79a8d1-3d7a-4c81-9374-216e6918f73e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:17.574781 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4d79a8d1-3d7a-4c81-9374-216e6918f73e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 6275bdb7-ef4e-42f5-8a43-d9c812d99feb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:17.592347 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d79a8d1-3d7a-4c81-9374-216e6918f73e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:17.592996 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d79a8d1-3d7a-4c81-9374-216e6918f73e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:17.593316 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d79a8d1-3d7a-4c81-9374-216e6918f73e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:17.594038 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d79a8d1-3d7a-4c81-9374-216e6918f73e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:17.594500 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d79a8d1-3d7a-4c81-9374-216e6918f73e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:17.594932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d79a8d1-3d7a-4c81-9374-216e6918f73e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:18.161681 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4d79a8d1-3d7a-4c81-9374-216e6918f73e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:18.170408 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4d79a8d1-3d7a-4c81-9374-216e6918f73e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb" status: 200 len: 1308 microversion: 2.1 time: 0.600161 Oct 05 03:01:18.171393 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2931/5840] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:17 2022] GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb => generated 1308 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:19.206736 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9a30ef2c-9be7-4ade-90f6-0ef12eab7b6a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:19.207280 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9a30ef2c-9be7-4ade-90f6-0ef12eab7b6a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 6275bdb7-ef4e-42f5-8a43-d9c812d99feb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:19.220213 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a30ef2c-9be7-4ade-90f6-0ef12eab7b6a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:19.233562 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a30ef2c-9be7-4ade-90f6-0ef12eab7b6a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:19.236672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a30ef2c-9be7-4ade-90f6-0ef12eab7b6a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:19.237562 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a30ef2c-9be7-4ade-90f6-0ef12eab7b6a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:19.238061 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a30ef2c-9be7-4ade-90f6-0ef12eab7b6a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:19.238508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a30ef2c-9be7-4ade-90f6-0ef12eab7b6a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:19.334635 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-ef2b4a46-e40d-4755-95a5-1d1c06c791fa req-1f93c22d-b980-4df3-8bc3-0357ecd6000c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6275bdb7-ef4e-42f5-8a43-d9c812d99feb", "name": "network-vif-plugged", "status": "completed", "tag": "01dd0914-8cb4-466d-b2dc-ff21d5d378ad"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:01:19.355146 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ef2b4a46-e40d-4755-95a5-1d1c06c791fa req-1f93c22d-b980-4df3-8bc3-0357ecd6000c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:19.358549 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ef2b4a46-e40d-4755-95a5-1d1c06c791fa req-1f93c22d-b980-4df3-8bc3-0357ecd6000c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:19.362039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ef2b4a46-e40d-4755-95a5-1d1c06c791fa req-1f93c22d-b980-4df3-8bc3-0357ecd6000c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:19.388679 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-ef2b4a46-e40d-4755-95a5-1d1c06c791fa req-1f93c22d-b980-4df3-8bc3-0357ecd6000c service nova] Creating event network-vif-plugged:01dd0914-8cb4-466d-b2dc-ff21d5d378ad for instance 6275bdb7-ef4e-42f5-8a43-d9c812d99feb on n-h2-858272-3 Oct 05 03:01:19.405513 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-ef2b4a46-e40d-4755-95a5-1d1c06c791fa req-1f93c22d-b980-4df3-8bc3-0357ecd6000c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073749 Oct 05 03:01:19.408178 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2932/5841] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:01:20.511962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7221e8b2-9c69-4568-add0-1d5b9553d809 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Action: 'create', calling method: .version_select at 0x7fcce8273b80>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1969576053", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8wSFaZgjfFJHMrtxapND2QSkFj9OpRjYo7GUvM5ASBfMsGqMR2jdooqJmrOjNTePvm3TGNt0Szg03qRk3aKYSTl4eP34dkLEgGz0T0RoLQEY0OyR5omgzTDg7pDZNFRg=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:01:20.550623 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-7221e8b2-9c69-4568-add0-1d5b9553d809 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Getting quotas for project 5152e5e306d2474bac12338a8e722a00. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:01:20.564664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-7221e8b2-9c69-4568-add0-1d5b9553d809 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Getting quotas for user 67c2b26730184ce58b866e37ebe43794 and project 5152e5e306d2474bac12338a8e722a00. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:01:20.633661 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7221e8b2-9c69-4568-add0-1d5b9553d809 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.127913 Oct 05 03:01:20.635045 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2933/5842] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 03:01:20 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:01:20.689925 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9a30ef2c-9be7-4ade-90f6-0ef12eab7b6a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:20.699321 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9a30ef2c-9be7-4ade-90f6-0ef12eab7b6a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb" status: 200 len: 1308 microversion: 2.1 time: 1.496953 Oct 05 03:01:20.699863 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2910/5843] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:19 2022] GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb => generated 1308 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:21.728018 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d4c1b97e-a8d2-4a70-9b39-47d5a14c7d69 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:21.728945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d4c1b97e-a8d2-4a70-9b39-47d5a14c7d69 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 6275bdb7-ef4e-42f5-8a43-d9c812d99feb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:21.746926 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4c1b97e-a8d2-4a70-9b39-47d5a14c7d69 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:21.746926 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4c1b97e-a8d2-4a70-9b39-47d5a14c7d69 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:21.747406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4c1b97e-a8d2-4a70-9b39-47d5a14c7d69 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:21.748160 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4c1b97e-a8d2-4a70-9b39-47d5a14c7d69 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:21.748621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4c1b97e-a8d2-4a70-9b39-47d5a14c7d69 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:21.749086 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4c1b97e-a8d2-4a70-9b39-47d5a14c7d69 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:22.185885 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d4c1b97e-a8d2-4a70-9b39-47d5a14c7d69 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:22.203579 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d4c1b97e-a8d2-4a70-9b39-47d5a14c7d69 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb" status: 200 len: 1490 microversion: 2.1 time: 0.479445 Oct 05 03:01:22.220942 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2934/5844] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:21 2022] GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb => generated 1490 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:22.421280 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8806b4e9-b989-43e1-beb2-eb007345b5f5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-701279312", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "10f7eabf-9521-4437-a838-b9f76044e586"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:01:22.600332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-8806b4e9-b989-43e1-beb2-eb007345b5f5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] validate_networks() for [('10f7eabf-9521-4437-a838-b9f76044e586', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:01:24.212193 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-8806b4e9-b989-43e1-beb2-eb007345b5f5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:01:24.212863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-8806b4e9-b989-43e1-beb2-eb007345b5f5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:01:24.213126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-8806b4e9-b989-43e1-beb2-eb007345b5f5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:01:24.213548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-8806b4e9-b989-43e1-beb2-eb007345b5f5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:01:24.213970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-8806b4e9-b989-43e1-beb2-eb007345b5f5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:01:24.236361 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8806b4e9-b989-43e1-beb2-eb007345b5f5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:24.237036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8806b4e9-b989-43e1-beb2-eb007345b5f5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:24.237317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8806b4e9-b989-43e1-beb2-eb007345b5f5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:24.238177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8806b4e9-b989-43e1-beb2-eb007345b5f5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:24.238609 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8806b4e9-b989-43e1-beb2-eb007345b5f5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:24.239058 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8806b4e9-b989-43e1-beb2-eb007345b5f5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:24.282617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-8806b4e9-b989-43e1-beb2-eb007345b5f5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Getting quotas for project f477959bd24b4db881b62dab54861aa5. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:01:24.295658 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-8806b4e9-b989-43e1-beb2-eb007345b5f5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Getting quotas for user 12d0128e850f4f22a2172800c44074a4 and project f477959bd24b4db881b62dab54861aa5. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:01:24.321316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8806b4e9-b989-43e1-beb2-eb007345b5f5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:01:24.338223 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8806b4e9-b989-43e1-beb2-eb007345b5f5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:01:24.475976 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8806b4e9-b989-43e1-beb2-eb007345b5f5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.058400 Oct 05 03:01:24.481229 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2911/5845] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:01:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:01:24.490337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0ec1db18-8f8c-492b-8bc9-8fcd1c6e1ba1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:24.491202 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0ec1db18-8f8c-492b-8bc9-8fcd1c6e1ba1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:24.845671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0ec1db18-8f8c-492b-8bc9-8fcd1c6e1ba1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:24.852685 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0ec1db18-8f8c-492b-8bc9-8fcd1c6e1ba1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec" status: 200 len: 1208 microversion: 2.1 time: 0.366138 Oct 05 03:01:24.865759 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2935/5846] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:24 2022] GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec => generated 1208 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:24.994502 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0420892d-1cd5-4975-8a29-a1a7d03fbefe tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-531464323", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "dee70860-6543-4c37-b92b-e2f7191d8739"}], "key_name": "tempest-TestNetworkBasicOps-1969576053", "security_groups": [{"name": "tempest-secgroup-smoke-621814420"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:01:25.432864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-0420892d-1cd5-4975-8a29-a1a7d03fbefe tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] validate_networks() for [('dee70860-6543-4c37-b92b-e2f7191d8739', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:01:25.877513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-741fbd3c-7263-41fc-9248-4e64903f7cb6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:25.878450 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-741fbd3c-7263-41fc-9248-4e64903f7cb6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:25.891301 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-741fbd3c-7263-41fc-9248-4e64903f7cb6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:25.899179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-741fbd3c-7263-41fc-9248-4e64903f7cb6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:25.901366 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-741fbd3c-7263-41fc-9248-4e64903f7cb6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:25.902298 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-741fbd3c-7263-41fc-9248-4e64903f7cb6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:25.904563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-741fbd3c-7263-41fc-9248-4e64903f7cb6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:25.905157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-741fbd3c-7263-41fc-9248-4e64903f7cb6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:26.101090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-741fbd3c-7263-41fc-9248-4e64903f7cb6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:26.116092 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-741fbd3c-7263-41fc-9248-4e64903f7cb6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec" status: 200 len: 1204 microversion: 2.1 time: 0.242327 Oct 05 03:01:26.123652 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2936/5847] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:25 2022] GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec => generated 1204 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:27.149729 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-43e9d3f0-80f0-4d2f-92a9-d5210572fcba tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:27.150339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-43e9d3f0-80f0-4d2f-92a9-d5210572fcba tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:27.161373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43e9d3f0-80f0-4d2f-92a9-d5210572fcba tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:27.172264 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43e9d3f0-80f0-4d2f-92a9-d5210572fcba tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:27.172679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43e9d3f0-80f0-4d2f-92a9-d5210572fcba tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:27.173462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43e9d3f0-80f0-4d2f-92a9-d5210572fcba tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:27.176777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43e9d3f0-80f0-4d2f-92a9-d5210572fcba tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:27.176777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43e9d3f0-80f0-4d2f-92a9-d5210572fcba tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:27.177972 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-0420892d-1cd5-4975-8a29-a1a7d03fbefe tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:01:27.178718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-0420892d-1cd5-4975-8a29-a1a7d03fbefe tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:01:27.179392 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-0420892d-1cd5-4975-8a29-a1a7d03fbefe tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:01:27.180195 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-0420892d-1cd5-4975-8a29-a1a7d03fbefe tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:01:27.180856 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-0420892d-1cd5-4975-8a29-a1a7d03fbefe tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:01:27.220092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0420892d-1cd5-4975-8a29-a1a7d03fbefe tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:27.220852 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0420892d-1cd5-4975-8a29-a1a7d03fbefe tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:27.221492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0420892d-1cd5-4975-8a29-a1a7d03fbefe tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:27.222995 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0420892d-1cd5-4975-8a29-a1a7d03fbefe tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:27.223645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0420892d-1cd5-4975-8a29-a1a7d03fbefe tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:27.226799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0420892d-1cd5-4975-8a29-a1a7d03fbefe tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:27.254453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=62 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:27.317231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-0420892d-1cd5-4975-8a29-a1a7d03fbefe tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Getting quotas for project 5152e5e306d2474bac12338a8e722a00. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:01:27.336735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-0420892d-1cd5-4975-8a29-a1a7d03fbefe tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Getting quotas for user 67c2b26730184ce58b866e37ebe43794 and project 5152e5e306d2474bac12338a8e722a00. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:01:27.369366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0420892d-1cd5-4975-8a29-a1a7d03fbefe tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:01:27.383499 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0420892d-1cd5-4975-8a29-a1a7d03fbefe tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 16f4a218-7c09-4282-9670-6b280970a99f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:01:27.501096 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-43e9d3f0-80f0-4d2f-92a9-d5210572fcba tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:27.514912 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-43e9d3f0-80f0-4d2f-92a9-d5210572fcba tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec" status: 200 len: 1260 microversion: 2.1 time: 0.367522 Oct 05 03:01:27.516268 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2937/5848] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:27 2022] GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec => generated 1260 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:01:27.526595 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0420892d-1cd5-4975-8a29-a1a7d03fbefe tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.537099 Oct 05 03:01:27.528500 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2912/5849] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:01:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 2540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:01:27.541290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-56501e51-885a-4a1d-8d95-5a8cb1e2412d tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:27.541922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-56501e51-885a-4a1d-8d95-5a8cb1e2412d tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 16f4a218-7c09-4282-9670-6b280970a99f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:28.166722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-56501e51-885a-4a1d-8d95-5a8cb1e2412d tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:28.177222 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-56501e51-885a-4a1d-8d95-5a8cb1e2412d tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f" status: 200 len: 1248 microversion: 2.1 time: 0.639920 Oct 05 03:01:28.179255 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2938/5850] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:27 2022] GET /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f => generated 1248 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:28.543515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-89823aa6-14a9-4a4f-947b-4093afe7b0ef tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:28.545179 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-89823aa6-14a9-4a4f-947b-4093afe7b0ef tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:28.559908 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89823aa6-14a9-4a4f-947b-4093afe7b0ef tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:28.563795 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89823aa6-14a9-4a4f-947b-4093afe7b0ef tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:28.564358 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89823aa6-14a9-4a4f-947b-4093afe7b0ef tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:28.565891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89823aa6-14a9-4a4f-947b-4093afe7b0ef tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:28.566534 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89823aa6-14a9-4a4f-947b-4093afe7b0ef tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:28.567484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89823aa6-14a9-4a4f-947b-4093afe7b0ef tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:29.169787 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-89823aa6-14a9-4a4f-947b-4093afe7b0ef tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:29.193010 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-89823aa6-14a9-4a4f-947b-4093afe7b0ef tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec" status: 200 len: 1266 microversion: 2.1 time: 0.655356 Oct 05 03:01:29.208387 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2913/5851] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:28 2022] GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec => generated 1266 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:29.215470 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ee0ee4a7-2db0-441f-bee7-e853b24d1d08 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:29.216232 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ee0ee4a7-2db0-441f-bee7-e853b24d1d08 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 16f4a218-7c09-4282-9670-6b280970a99f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:29.251431 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee0ee4a7-2db0-441f-bee7-e853b24d1d08 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:29.251670 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee0ee4a7-2db0-441f-bee7-e853b24d1d08 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:29.270425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee0ee4a7-2db0-441f-bee7-e853b24d1d08 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:29.273817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee0ee4a7-2db0-441f-bee7-e853b24d1d08 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:29.281472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee0ee4a7-2db0-441f-bee7-e853b24d1d08 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:29.282023 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee0ee4a7-2db0-441f-bee7-e853b24d1d08 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:30.109218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ee0ee4a7-2db0-441f-bee7-e853b24d1d08 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:30.127298 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ee0ee4a7-2db0-441f-bee7-e853b24d1d08 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f" status: 200 len: 1244 microversion: 2.1 time: 0.918186 Oct 05 03:01:30.127964 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2939/5852] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:29 2022] GET /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f => generated 1244 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:01:30.218993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5b7fbe8b-75f4-4b15-a11f-b24c524cb9af tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:30.220930 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5b7fbe8b-75f4-4b15-a11f-b24c524cb9af tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:30.236646 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b7fbe8b-75f4-4b15-a11f-b24c524cb9af tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:30.237183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b7fbe8b-75f4-4b15-a11f-b24c524cb9af tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:30.237620 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b7fbe8b-75f4-4b15-a11f-b24c524cb9af tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:30.241934 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b7fbe8b-75f4-4b15-a11f-b24c524cb9af tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:30.244826 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b7fbe8b-75f4-4b15-a11f-b24c524cb9af tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:30.245850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b7fbe8b-75f4-4b15-a11f-b24c524cb9af tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:31.036331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5b7fbe8b-75f4-4b15-a11f-b24c524cb9af tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:31.049475 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5b7fbe8b-75f4-4b15-a11f-b24c524cb9af tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec" status: 200 len: 1308 microversion: 2.1 time: 0.834931 Oct 05 03:01:31.054163 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2914/5853] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:30 2022] GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec => generated 1308 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:31.157655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1f751ebf-3a5d-4b15-b37f-05dfde51ad9e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:31.158274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1f751ebf-3a5d-4b15-b37f-05dfde51ad9e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 16f4a218-7c09-4282-9670-6b280970a99f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:31.222946 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f751ebf-3a5d-4b15-b37f-05dfde51ad9e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:31.226637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f751ebf-3a5d-4b15-b37f-05dfde51ad9e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:31.228710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f751ebf-3a5d-4b15-b37f-05dfde51ad9e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:31.233260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f751ebf-3a5d-4b15-b37f-05dfde51ad9e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:31.234103 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f751ebf-3a5d-4b15-b37f-05dfde51ad9e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:31.234103 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f751ebf-3a5d-4b15-b37f-05dfde51ad9e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:31.509021 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1f751ebf-3a5d-4b15-b37f-05dfde51ad9e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:31.523750 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1f751ebf-3a5d-4b15-b37f-05dfde51ad9e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f" status: 200 len: 1306 microversion: 2.1 time: 0.372325 Oct 05 03:01:31.546145 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2940/5854] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:31 2022] GET /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f => generated 1306 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:32.080703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-151655d3-0a7e-4e98-a2ab-a9ceb683e925 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:32.081483 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-151655d3-0a7e-4e98-a2ab-a9ceb683e925 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:32.091759 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-151655d3-0a7e-4e98-a2ab-a9ceb683e925 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:32.092256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-151655d3-0a7e-4e98-a2ab-a9ceb683e925 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:32.092757 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-151655d3-0a7e-4e98-a2ab-a9ceb683e925 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:32.093483 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-151655d3-0a7e-4e98-a2ab-a9ceb683e925 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:32.098187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-151655d3-0a7e-4e98-a2ab-a9ceb683e925 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:32.099375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-151655d3-0a7e-4e98-a2ab-a9ceb683e925 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:32.577527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5a48ccca-a72e-4bb4-bdfc-71dd85a71c6e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:32.578265 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5a48ccca-a72e-4bb4-bdfc-71dd85a71c6e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 16f4a218-7c09-4282-9670-6b280970a99f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:32.597418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a48ccca-a72e-4bb4-bdfc-71dd85a71c6e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:32.597418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a48ccca-a72e-4bb4-bdfc-71dd85a71c6e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:32.597418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a48ccca-a72e-4bb4-bdfc-71dd85a71c6e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:32.597418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a48ccca-a72e-4bb4-bdfc-71dd85a71c6e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:32.601827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a48ccca-a72e-4bb4-bdfc-71dd85a71c6e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:32.602627 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a48ccca-a72e-4bb4-bdfc-71dd85a71c6e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:32.607228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-151655d3-0a7e-4e98-a2ab-a9ceb683e925 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:32.619277 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-151655d3-0a7e-4e98-a2ab-a9ceb683e925 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec" status: 200 len: 1308 microversion: 2.1 time: 0.542745 Oct 05 03:01:32.625171 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2915/5855] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:32 2022] GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec => generated 1308 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:33.070969 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5a48ccca-a72e-4bb4-bdfc-71dd85a71c6e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:33.090622 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5a48ccca-a72e-4bb4-bdfc-71dd85a71c6e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f" status: 200 len: 1373 microversion: 2.1 time: 0.518541 Oct 05 03:01:33.091838 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2941/5856] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:32 2022] GET /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f => generated 1373 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:33.494012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-bec2ca37-a298-42e0-aa8e-e3117f897c54 req-eb53097d-fbd9-436e-b1ac-3ff4ad084501 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16f4a218-7c09-4282-9670-6b280970a99f", "tag": "51dd156b-188b-4a9d-9e0a-c45fac1f9f55"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:01:33.505683 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:33.527382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-bec2ca37-a298-42e0-aa8e-e3117f897c54 req-eb53097d-fbd9-436e-b1ac-3ff4ad084501 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:33.529192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-bec2ca37-a298-42e0-aa8e-e3117f897c54 req-eb53097d-fbd9-436e-b1ac-3ff4ad084501 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:33.531726 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-bec2ca37-a298-42e0-aa8e-e3117f897c54 req-eb53097d-fbd9-436e-b1ac-3ff4ad084501 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:33.573909 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-bec2ca37-a298-42e0-aa8e-e3117f897c54 req-eb53097d-fbd9-436e-b1ac-3ff4ad084501 service nova] Creating event network-changed:51dd156b-188b-4a9d-9e0a-c45fac1f9f55 for instance 16f4a218-7c09-4282-9670-6b280970a99f on n-h2-858272-3 Oct 05 03:01:33.584978 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-bec2ca37-a298-42e0-aa8e-e3117f897c54 req-eb53097d-fbd9-436e-b1ac-3ff4ad084501 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098653 Oct 05 03:01:33.586719 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2916/5857] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:01:33.649613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ade19214-ba5d-4cf9-907e-de00cff894db tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:33.650890 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ade19214-ba5d-4cf9-907e-de00cff894db tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:33.664308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ade19214-ba5d-4cf9-907e-de00cff894db tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:33.667621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ade19214-ba5d-4cf9-907e-de00cff894db tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:33.668318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ade19214-ba5d-4cf9-907e-de00cff894db tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:33.669527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ade19214-ba5d-4cf9-907e-de00cff894db tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:33.670899 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ade19214-ba5d-4cf9-907e-de00cff894db tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:33.673166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ade19214-ba5d-4cf9-907e-de00cff894db tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:34.125570 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-afdd8261-7886-4927-925a-7c3aae30b087 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:34.126888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-afdd8261-7886-4927-925a-7c3aae30b087 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 16f4a218-7c09-4282-9670-6b280970a99f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:34.165651 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afdd8261-7886-4927-925a-7c3aae30b087 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:34.166555 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afdd8261-7886-4927-925a-7c3aae30b087 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:34.167373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afdd8261-7886-4927-925a-7c3aae30b087 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:34.175962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afdd8261-7886-4927-925a-7c3aae30b087 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:34.176839 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afdd8261-7886-4927-925a-7c3aae30b087 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:34.180345 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afdd8261-7886-4927-925a-7c3aae30b087 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:34.478939 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ade19214-ba5d-4cf9-907e-de00cff894db tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:34.530360 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ade19214-ba5d-4cf9-907e-de00cff894db tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec" status: 200 len: 1308 microversion: 2.1 time: 0.885845 Oct 05 03:01:34.531918 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2942/5858] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:33 2022] GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec => generated 1308 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:34.546638 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-a0e16481-4115-497a-9e90-1bb0fe178018 req-d89d6b55-f7b6-4e7c-9f63-20f7fd6f0e27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a0e8591-93a5-43b0-94ba-e7e9a175e7ec", "tag": "edaef6f4-0059-48a8-8c1b-5d0dd1e33715"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:01:34.581153 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:34.593289 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a0e16481-4115-497a-9e90-1bb0fe178018 req-d89d6b55-f7b6-4e7c-9f63-20f7fd6f0e27 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:34.594561 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a0e16481-4115-497a-9e90-1bb0fe178018 req-d89d6b55-f7b6-4e7c-9f63-20f7fd6f0e27 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:34.595674 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a0e16481-4115-497a-9e90-1bb0fe178018 req-d89d6b55-f7b6-4e7c-9f63-20f7fd6f0e27 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:34.644583 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-a0e16481-4115-497a-9e90-1bb0fe178018 req-d89d6b55-f7b6-4e7c-9f63-20f7fd6f0e27 service nova] Creating event network-changed:edaef6f4-0059-48a8-8c1b-5d0dd1e33715 for instance 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec on n-h1-858272-3 Oct 05 03:01:34.693811 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-a0e16481-4115-497a-9e90-1bb0fe178018 req-d89d6b55-f7b6-4e7c-9f63-20f7fd6f0e27 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159403 Oct 05 03:01:34.695561 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2943/5859] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:01:34.744034 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-afdd8261-7886-4927-925a-7c3aae30b087 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:34.768048 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-afdd8261-7886-4927-925a-7c3aae30b087 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f" status: 200 len: 1373 microversion: 2.1 time: 0.651954 Oct 05 03:01:34.768980 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2917/5860] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:34 2022] GET /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f => generated 1373 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:35.575097 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-32b911d6-2e84-40bb-8a1c-489f8cc17101 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:35.575097 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-32b911d6-2e84-40bb-8a1c-489f8cc17101 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:35.579795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32b911d6-2e84-40bb-8a1c-489f8cc17101 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:35.580564 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32b911d6-2e84-40bb-8a1c-489f8cc17101 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:35.581248 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32b911d6-2e84-40bb-8a1c-489f8cc17101 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:35.582188 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32b911d6-2e84-40bb-8a1c-489f8cc17101 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:35.582884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32b911d6-2e84-40bb-8a1c-489f8cc17101 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:35.583524 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32b911d6-2e84-40bb-8a1c-489f8cc17101 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:35.791196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f8a42164-e1ca-4759-b8e8-6869d1b3aa62 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:35.791820 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f8a42164-e1ca-4759-b8e8-6869d1b3aa62 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 16f4a218-7c09-4282-9670-6b280970a99f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:35.801482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8a42164-e1ca-4759-b8e8-6869d1b3aa62 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:35.802716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8a42164-e1ca-4759-b8e8-6869d1b3aa62 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:35.803838 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8a42164-e1ca-4759-b8e8-6869d1b3aa62 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:35.804868 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8a42164-e1ca-4759-b8e8-6869d1b3aa62 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:35.805573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8a42164-e1ca-4759-b8e8-6869d1b3aa62 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:35.806397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8a42164-e1ca-4759-b8e8-6869d1b3aa62 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:35.812755 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=66 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:36.166717 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-32b911d6-2e84-40bb-8a1c-489f8cc17101 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:36.182346 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-32b911d6-2e84-40bb-8a1c-489f8cc17101 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec" status: 200 len: 1308 microversion: 2.1 time: 0.616288 Oct 05 03:01:36.183184 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2944/5861] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:35 2022] GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec => generated 1308 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:36.242791 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f8a42164-e1ca-4759-b8e8-6869d1b3aa62 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:36.264540 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f8a42164-e1ca-4759-b8e8-6869d1b3aa62 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f" status: 200 len: 1373 microversion: 2.1 time: 0.477329 Oct 05 03:01:36.267173 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2918/5862] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:35 2022] GET /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f => generated 1373 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:01:37.254755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-44ef004f-4223-4319-91d8-f380980774d6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:37.268390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-44ef004f-4223-4319-91d8-f380980774d6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:37.284656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44ef004f-4223-4319-91d8-f380980774d6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:37.285542 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44ef004f-4223-4319-91d8-f380980774d6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:37.291722 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-702294b4-72c3-4b58-bdaa-499ebcaf438c tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:37.293572 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-702294b4-72c3-4b58-bdaa-499ebcaf438c tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 16f4a218-7c09-4282-9670-6b280970a99f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:37.296640 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:37.299394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44ef004f-4223-4319-91d8-f380980774d6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:37.309299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44ef004f-4223-4319-91d8-f380980774d6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:37.310068 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44ef004f-4223-4319-91d8-f380980774d6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:37.314297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-702294b4-72c3-4b58-bdaa-499ebcaf438c tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:37.315533 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44ef004f-4223-4319-91d8-f380980774d6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:37.320419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-702294b4-72c3-4b58-bdaa-499ebcaf438c tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:37.323177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-702294b4-72c3-4b58-bdaa-499ebcaf438c tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:37.325232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-702294b4-72c3-4b58-bdaa-499ebcaf438c tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:37.333532 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-702294b4-72c3-4b58-bdaa-499ebcaf438c tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:37.335879 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-702294b4-72c3-4b58-bdaa-499ebcaf438c tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:37.382173 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=12 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:37.740956 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-702294b4-72c3-4b58-bdaa-499ebcaf438c tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:37.754461 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-702294b4-72c3-4b58-bdaa-499ebcaf438c tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f" status: 200 len: 1373 microversion: 2.1 time: 0.467095 Oct 05 03:01:37.757233 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2919/5863] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:37 2022] GET /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f => generated 1373 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:37.763152 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-44ef004f-4223-4319-91d8-f380980774d6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:37.775415 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-44ef004f-4223-4319-91d8-f380980774d6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec" status: 200 len: 1308 microversion: 2.1 time: 0.561116 Oct 05 03:01:37.776008 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2945/5864] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:37 2022] GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec => generated 1308 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:38.782074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9d1ea826-4238-4140-a40e-248e5b5220cd tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:38.782759 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9d1ea826-4238-4140-a40e-248e5b5220cd tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 16f4a218-7c09-4282-9670-6b280970a99f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:38.798262 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2317639f-5f45-4223-99ec-07eef5a83ffe tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:38.798969 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2317639f-5f45-4223-99ec-07eef5a83ffe tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:38.819419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d1ea826-4238-4140-a40e-248e5b5220cd tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:38.821039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=8 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:38.827567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d1ea826-4238-4140-a40e-248e5b5220cd tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:38.828280 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d1ea826-4238-4140-a40e-248e5b5220cd tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:38.829654 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d1ea826-4238-4140-a40e-248e5b5220cd tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:38.830223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2317639f-5f45-4223-99ec-07eef5a83ffe tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:38.830973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2317639f-5f45-4223-99ec-07eef5a83ffe tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:38.831609 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d1ea826-4238-4140-a40e-248e5b5220cd tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:38.832227 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2317639f-5f45-4223-99ec-07eef5a83ffe tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:38.838091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d1ea826-4238-4140-a40e-248e5b5220cd tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:38.843035 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2317639f-5f45-4223-99ec-07eef5a83ffe tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:38.843548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2317639f-5f45-4223-99ec-07eef5a83ffe tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:38.843988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2317639f-5f45-4223-99ec-07eef5a83ffe tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:39.446185 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2317639f-5f45-4223-99ec-07eef5a83ffe tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:39.461621 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2317639f-5f45-4223-99ec-07eef5a83ffe tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec" status: 200 len: 1308 microversion: 2.1 time: 0.666471 Oct 05 03:01:39.482274 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2946/5865] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:38 2022] GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec => generated 1308 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:39.550402 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9d1ea826-4238-4140-a40e-248e5b5220cd tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:39.563689 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9d1ea826-4238-4140-a40e-248e5b5220cd tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f" status: 200 len: 1373 microversion: 2.1 time: 0.786531 Oct 05 03:01:39.568699 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2920/5866] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:38 2022] GET /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f => generated 1373 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:40.493947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1c1ffba3-47e7-4f8b-bd93-0959433b54e7 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:40.494559 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1c1ffba3-47e7-4f8b-bd93-0959433b54e7 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:40.516892 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c1ffba3-47e7-4f8b-bd93-0959433b54e7 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:40.517413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c1ffba3-47e7-4f8b-bd93-0959433b54e7 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:40.517850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c1ffba3-47e7-4f8b-bd93-0959433b54e7 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:40.518561 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c1ffba3-47e7-4f8b-bd93-0959433b54e7 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:40.519016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c1ffba3-47e7-4f8b-bd93-0959433b54e7 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:40.519546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c1ffba3-47e7-4f8b-bd93-0959433b54e7 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:40.595425 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bd8ebb01-739a-4db9-b262-081b0dad3578 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:40.596054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bd8ebb01-739a-4db9-b262-081b0dad3578 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 16f4a218-7c09-4282-9670-6b280970a99f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:40.604984 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd8ebb01-739a-4db9-b262-081b0dad3578 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:40.605800 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd8ebb01-739a-4db9-b262-081b0dad3578 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:40.606403 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd8ebb01-739a-4db9-b262-081b0dad3578 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:40.607404 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd8ebb01-739a-4db9-b262-081b0dad3578 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:40.608041 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd8ebb01-739a-4db9-b262-081b0dad3578 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:40.608674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd8ebb01-739a-4db9-b262-081b0dad3578 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:40.940743 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1c1ffba3-47e7-4f8b-bd93-0959433b54e7 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:40.954049 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1c1ffba3-47e7-4f8b-bd93-0959433b54e7 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec" status: 200 len: 1308 microversion: 2.1 time: 0.464686 Oct 05 03:01:40.963138 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2947/5867] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:40 2022] GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec => generated 1308 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:40.981085 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bd8ebb01-739a-4db9-b262-081b0dad3578 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:40.992309 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bd8ebb01-739a-4db9-b262-081b0dad3578 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f" status: 200 len: 1373 microversion: 2.1 time: 0.400679 Oct 05 03:01:40.993120 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2921/5868] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:40 2022] GET /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f => generated 1373 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:01:41.184020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-8ce37c54-b04f-4211-88fd-13f17b345fc9 req-9419cb48-4a3c-4537-b3d5-c35737e14902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16f4a218-7c09-4282-9670-6b280970a99f", "name": "network-vif-plugged", "status": "completed", "tag": "51dd156b-188b-4a9d-9e0a-c45fac1f9f55"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:01:41.207563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-8ce37c54-b04f-4211-88fd-13f17b345fc9 req-9419cb48-4a3c-4537-b3d5-c35737e14902 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:41.208268 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-8ce37c54-b04f-4211-88fd-13f17b345fc9 req-9419cb48-4a3c-4537-b3d5-c35737e14902 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:41.208867 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-8ce37c54-b04f-4211-88fd-13f17b345fc9 req-9419cb48-4a3c-4537-b3d5-c35737e14902 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:41.234653 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-8ce37c54-b04f-4211-88fd-13f17b345fc9 req-9419cb48-4a3c-4537-b3d5-c35737e14902 service nova] Creating event network-vif-plugged:51dd156b-188b-4a9d-9e0a-c45fac1f9f55 for instance 16f4a218-7c09-4282-9670-6b280970a99f on n-h2-858272-3 Oct 05 03:01:41.255616 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-8ce37c54-b04f-4211-88fd-13f17b345fc9 req-9419cb48-4a3c-4537-b3d5-c35737e14902 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078098 Oct 05 03:01:41.257241 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2948/5869] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:01:41.985973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c103eb63-6c03-4087-87de-fe3e80863bfb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:41.986593 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c103eb63-6c03-4087-87de-fe3e80863bfb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:42.000850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c103eb63-6c03-4087-87de-fe3e80863bfb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:42.001388 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c103eb63-6c03-4087-87de-fe3e80863bfb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:42.001830 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c103eb63-6c03-4087-87de-fe3e80863bfb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:42.003101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c103eb63-6c03-4087-87de-fe3e80863bfb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:42.003578 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c103eb63-6c03-4087-87de-fe3e80863bfb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:42.004013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c103eb63-6c03-4087-87de-fe3e80863bfb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:42.025177 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1b937a2f-0299-4e2f-9d6f-01911a905147 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:42.026141 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1b937a2f-0299-4e2f-9d6f-01911a905147 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 16f4a218-7c09-4282-9670-6b280970a99f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:42.041482 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b937a2f-0299-4e2f-9d6f-01911a905147 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:42.045586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b937a2f-0299-4e2f-9d6f-01911a905147 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:42.046453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b937a2f-0299-4e2f-9d6f-01911a905147 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:42.047705 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b937a2f-0299-4e2f-9d6f-01911a905147 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:42.048334 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b937a2f-0299-4e2f-9d6f-01911a905147 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:42.048979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b937a2f-0299-4e2f-9d6f-01911a905147 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:42.601961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c103eb63-6c03-4087-87de-fe3e80863bfb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:42.622291 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1b937a2f-0299-4e2f-9d6f-01911a905147 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:42.667618 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1b937a2f-0299-4e2f-9d6f-01911a905147 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f" status: 200 len: 1373 microversion: 2.1 time: 0.654708 Oct 05 03:01:42.670937 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c103eb63-6c03-4087-87de-fe3e80863bfb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec" status: 200 len: 1308 microversion: 2.1 time: 0.688207 Oct 05 03:01:42.686865 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2922/5870] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:41 2022] GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec => generated 1308 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:42.687420 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2949/5871] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:42 2022] GET /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f => generated 1373 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:01:43.275313 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-6cffb333-9451-45b5-9169-76b217d05252 req-b0ec13a5-13dc-4607-8df6-14b889539442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a0e8591-93a5-43b0-94ba-e7e9a175e7ec", "name": "network-vif-plugged", "status": "completed", "tag": "edaef6f4-0059-48a8-8c1b-5d0dd1e33715"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:01:43.299477 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-6cffb333-9451-45b5-9169-76b217d05252 req-b0ec13a5-13dc-4607-8df6-14b889539442 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:43.300286 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-6cffb333-9451-45b5-9169-76b217d05252 req-b0ec13a5-13dc-4607-8df6-14b889539442 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:43.302309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-6cffb333-9451-45b5-9169-76b217d05252 req-b0ec13a5-13dc-4607-8df6-14b889539442 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:43.337323 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-6cffb333-9451-45b5-9169-76b217d05252 req-b0ec13a5-13dc-4607-8df6-14b889539442 service nova] Creating event network-vif-plugged:edaef6f4-0059-48a8-8c1b-5d0dd1e33715 for instance 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec on n-h1-858272-3 Oct 05 03:01:43.368987 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-6cffb333-9451-45b5-9169-76b217d05252 req-b0ec13a5-13dc-4607-8df6-14b889539442 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096040 Oct 05 03:01:43.371365 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2923/5872] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:01:43.702735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-00735a59-a4a2-406a-8b4e-3b834a1e50ce tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:43.706270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-00735a59-a4a2-406a-8b4e-3b834a1e50ce tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:43.713083 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-425205e7-70c2-48ef-8229-c14306349fc0 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:43.714152 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-425205e7-70c2-48ef-8229-c14306349fc0 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 16f4a218-7c09-4282-9670-6b280970a99f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:43.724368 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-00735a59-a4a2-406a-8b4e-3b834a1e50ce tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:43.726164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-00735a59-a4a2-406a-8b4e-3b834a1e50ce tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:43.726949 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-00735a59-a4a2-406a-8b4e-3b834a1e50ce tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:43.728406 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-425205e7-70c2-48ef-8229-c14306349fc0 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:43.728927 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-425205e7-70c2-48ef-8229-c14306349fc0 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:43.729362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-425205e7-70c2-48ef-8229-c14306349fc0 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:43.730421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-00735a59-a4a2-406a-8b4e-3b834a1e50ce tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:43.730589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-425205e7-70c2-48ef-8229-c14306349fc0 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:43.731147 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-00735a59-a4a2-406a-8b4e-3b834a1e50ce tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:43.731279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-425205e7-70c2-48ef-8229-c14306349fc0 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:43.731658 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-425205e7-70c2-48ef-8229-c14306349fc0 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:43.732685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-00735a59-a4a2-406a-8b4e-3b834a1e50ce tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:44.145377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-00735a59-a4a2-406a-8b4e-3b834a1e50ce tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:44.153546 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-00735a59-a4a2-406a-8b4e-3b834a1e50ce tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec" status: 200 len: 1308 microversion: 2.1 time: 0.459256 Oct 05 03:01:44.154130 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2950/5873] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:43 2022] GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec => generated 1308 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:44.231795 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-425205e7-70c2-48ef-8229-c14306349fc0 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:44.241922 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-425205e7-70c2-48ef-8229-c14306349fc0 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f" status: 200 len: 1545 microversion: 2.1 time: 0.531676 Oct 05 03:01:44.246485 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2924/5874] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:43 2022] GET /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f => generated 1545 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:44.274376 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-30addc47-1017-47cd-bba0-c9c0622675f9 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:44.275319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-30addc47-1017-47cd-bba0-c9c0622675f9 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 16f4a218-7c09-4282-9670-6b280970a99f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:44.282485 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-30addc47-1017-47cd-bba0-c9c0622675f9 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:44.283400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-30addc47-1017-47cd-bba0-c9c0622675f9 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:44.284061 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-30addc47-1017-47cd-bba0-c9c0622675f9 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:44.285204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-30addc47-1017-47cd-bba0-c9c0622675f9 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:44.285952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-30addc47-1017-47cd-bba0-c9c0622675f9 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:44.286634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-30addc47-1017-47cd-bba0-c9c0622675f9 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:44.521521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-30addc47-1017-47cd-bba0-c9c0622675f9 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:44.537933 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-30addc47-1017-47cd-bba0-c9c0622675f9 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f" status: 200 len: 1545 microversion: 2.1 time: 0.271649 Oct 05 03:01:44.539494 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2951/5875] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:44 2022] GET /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f => generated 1545 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:45.177620 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-eebf3158-9e3b-4bc5-b0f7-a272cf7f6fe9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:45.178249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-eebf3158-9e3b-4bc5-b0f7-a272cf7f6fe9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:45.185547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eebf3158-9e3b-4bc5-b0f7-a272cf7f6fe9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:45.186377 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eebf3158-9e3b-4bc5-b0f7-a272cf7f6fe9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:45.187061 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eebf3158-9e3b-4bc5-b0f7-a272cf7f6fe9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:45.188000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eebf3158-9e3b-4bc5-b0f7-a272cf7f6fe9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:45.188465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eebf3158-9e3b-4bc5-b0f7-a272cf7f6fe9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:45.188925 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eebf3158-9e3b-4bc5-b0f7-a272cf7f6fe9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:45.483522 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-eebf3158-9e3b-4bc5-b0f7-a272cf7f6fe9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:45.497336 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-eebf3158-9e3b-4bc5-b0f7-a272cf7f6fe9 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec" status: 200 len: 1308 microversion: 2.1 time: 0.322926 Oct 05 03:01:45.498183 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2925/5876] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:45 2022] GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec => generated 1308 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:46.523088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c83840f9-8483-423f-9f1f-69560ac70d53 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:46.523784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c83840f9-8483-423f-9f1f-69560ac70d53 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:46.543823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c83840f9-8483-423f-9f1f-69560ac70d53 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:46.544318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c83840f9-8483-423f-9f1f-69560ac70d53 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:46.544805 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c83840f9-8483-423f-9f1f-69560ac70d53 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:46.545781 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c83840f9-8483-423f-9f1f-69560ac70d53 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:46.546273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c83840f9-8483-423f-9f1f-69560ac70d53 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:46.546846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c83840f9-8483-423f-9f1f-69560ac70d53 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:46.877539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c83840f9-8483-423f-9f1f-69560ac70d53 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:46.889317 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c83840f9-8483-423f-9f1f-69560ac70d53 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec" status: 200 len: 1489 microversion: 2.1 time: 0.370426 Oct 05 03:01:46.891905 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2952/5877] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:46 2022] GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec => generated 1489 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:46.923199 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1b26e3a7-c75f-4ef7-ad55-b2f44b7ebcf6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:46.924535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1b26e3a7-c75f-4ef7-ad55-b2f44b7ebcf6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 6275bdb7-ef4e-42f5-8a43-d9c812d99feb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:46.937055 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b26e3a7-c75f-4ef7-ad55-b2f44b7ebcf6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:46.939085 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b26e3a7-c75f-4ef7-ad55-b2f44b7ebcf6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:46.942538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b26e3a7-c75f-4ef7-ad55-b2f44b7ebcf6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:46.943519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b26e3a7-c75f-4ef7-ad55-b2f44b7ebcf6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:46.944293 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b26e3a7-c75f-4ef7-ad55-b2f44b7ebcf6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:46.944945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b26e3a7-c75f-4ef7-ad55-b2f44b7ebcf6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:47.366576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1b26e3a7-c75f-4ef7-ad55-b2f44b7ebcf6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:47.377110 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1b26e3a7-c75f-4ef7-ad55-b2f44b7ebcf6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb" status: 200 len: 1490 microversion: 2.1 time: 0.458396 Oct 05 03:01:47.381646 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2926/5878] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:46 2022] GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb => generated 1490 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:47.419171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-22df3bbd-ce6e-4bc7-89f5-7b46946cf288 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:47.420333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-22df3bbd-ce6e-4bc7-89f5-7b46946cf288 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:47.429998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22df3bbd-ce6e-4bc7-89f5-7b46946cf288 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:47.432007 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22df3bbd-ce6e-4bc7-89f5-7b46946cf288 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:47.432780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22df3bbd-ce6e-4bc7-89f5-7b46946cf288 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:47.436304 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22df3bbd-ce6e-4bc7-89f5-7b46946cf288 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:47.436991 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22df3bbd-ce6e-4bc7-89f5-7b46946cf288 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:47.439970 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-22df3bbd-ce6e-4bc7-89f5-7b46946cf288 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:47.794685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-22df3bbd-ce6e-4bc7-89f5-7b46946cf288 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:47.811146 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-22df3bbd-ce6e-4bc7-89f5-7b46946cf288 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec" status: 200 len: 1489 microversion: 2.1 time: 0.391305 Oct 05 03:01:47.811887 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2953/5879] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:47 2022] GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec => generated 1489 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:47.848380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6b249971-c9e8-4289-ba90-f0a4729f8ff1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:47.848888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6b249971-c9e8-4289-ba90-f0a4729f8ff1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:47.857114 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b249971-c9e8-4289-ba90-f0a4729f8ff1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:47.858256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b249971-c9e8-4289-ba90-f0a4729f8ff1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:47.858871 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b249971-c9e8-4289-ba90-f0a4729f8ff1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:47.859789 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b249971-c9e8-4289-ba90-f0a4729f8ff1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:47.860715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b249971-c9e8-4289-ba90-f0a4729f8ff1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:47.861429 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b249971-c9e8-4289-ba90-f0a4729f8ff1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:47.932635 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6b249971-c9e8-4289-ba90-f0a4729f8ff1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:01:48.121049 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6b249971-c9e8-4289-ba90-f0a4729f8ff1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec" status: 204 len: 0 microversion: 2.1 time: 0.275497 Oct 05 03:01:48.122338 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2927/5880] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:01:47 2022] DELETE /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 03:01:48.131000 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-33593338-170e-490d-9274-7657cffb2125 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:48.131513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-33593338-170e-490d-9274-7657cffb2125 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:48.142600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-33593338-170e-490d-9274-7657cffb2125 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:48.143110 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-33593338-170e-490d-9274-7657cffb2125 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:48.143548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-33593338-170e-490d-9274-7657cffb2125 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:48.145372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-33593338-170e-490d-9274-7657cffb2125 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:48.145835 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-33593338-170e-490d-9274-7657cffb2125 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:48.146265 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-33593338-170e-490d-9274-7657cffb2125 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:48.421343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-33593338-170e-490d-9274-7657cffb2125 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:48.430872 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-33593338-170e-490d-9274-7657cffb2125 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec" status: 200 len: 1495 microversion: 2.1 time: 0.304149 Oct 05 03:01:48.432313 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2954/5881] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:48 2022] GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec => generated 1495 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:01:48.477124 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-53b7bfab-1425-45c1-8a58-80e0263be363 req-d7aadea4-a088-47c8-9864-3f1c95bd44ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16f4a218-7c09-4282-9670-6b280970a99f", "tag": "51dd156b-188b-4a9d-9e0a-c45fac1f9f55"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:01:48.496008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-53b7bfab-1425-45c1-8a58-80e0263be363 req-d7aadea4-a088-47c8-9864-3f1c95bd44ba service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:48.496837 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-53b7bfab-1425-45c1-8a58-80e0263be363 req-d7aadea4-a088-47c8-9864-3f1c95bd44ba service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:48.497964 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-53b7bfab-1425-45c1-8a58-80e0263be363 req-d7aadea4-a088-47c8-9864-3f1c95bd44ba service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:48.527647 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-53b7bfab-1425-45c1-8a58-80e0263be363 req-d7aadea4-a088-47c8-9864-3f1c95bd44ba service nova] Creating event network-changed:51dd156b-188b-4a9d-9e0a-c45fac1f9f55 for instance 16f4a218-7c09-4282-9670-6b280970a99f on n-h2-858272-3 Oct 05 03:01:48.533597 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-53b7bfab-1425-45c1-8a58-80e0263be363 req-d7aadea4-a088-47c8-9864-3f1c95bd44ba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061132 Oct 05 03:01:48.534798 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2928/5882] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:01:49.456549 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3e95f409-3709-4e1f-b336-19cb331b18b4 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:49.457272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3e95f409-3709-4e1f-b336-19cb331b18b4 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:49.471646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e95f409-3709-4e1f-b336-19cb331b18b4 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:49.472416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e95f409-3709-4e1f-b336-19cb331b18b4 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:49.474339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e95f409-3709-4e1f-b336-19cb331b18b4 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:49.475248 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e95f409-3709-4e1f-b336-19cb331b18b4 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:49.477344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e95f409-3709-4e1f-b336-19cb331b18b4 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:49.477989 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e95f409-3709-4e1f-b336-19cb331b18b4 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:50.033643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3e95f409-3709-4e1f-b336-19cb331b18b4 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:50.046534 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3e95f409-3709-4e1f-b336-19cb331b18b4 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec" status: 200 len: 1495 microversion: 2.1 time: 0.594009 Oct 05 03:01:50.047230 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2955/5883] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:49 2022] GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec => generated 1495 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:51.084529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-92aa03ab-2272-44d0-96ba-ab8148cdf663 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:51.085278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-92aa03ab-2272-44d0-96ba-ab8148cdf663 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:51.096702 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-35699559-9dc4-48c7-bc4c-67d654b5a032 req-912516a4-e2cd-473b-871c-32c63b64180e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a0e8591-93a5-43b0-94ba-e7e9a175e7ec", "name": "network-vif-deleted", "tag": "edaef6f4-0059-48a8-8c1b-5d0dd1e33715"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:01:51.136425 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92aa03ab-2272-44d0-96ba-ab8148cdf663 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:51.141349 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-35699559-9dc4-48c7-bc4c-67d654b5a032 req-912516a4-e2cd-473b-871c-32c63b64180e service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:51.141750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-35699559-9dc4-48c7-bc4c-67d654b5a032 req-912516a4-e2cd-473b-871c-32c63b64180e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:51.142211 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-35699559-9dc4-48c7-bc4c-67d654b5a032 req-912516a4-e2cd-473b-871c-32c63b64180e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:51.142826 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92aa03ab-2272-44d0-96ba-ab8148cdf663 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:51.144081 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92aa03ab-2272-44d0-96ba-ab8148cdf663 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:51.148325 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92aa03ab-2272-44d0-96ba-ab8148cdf663 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:51.148823 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92aa03ab-2272-44d0-96ba-ab8148cdf663 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:51.149303 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92aa03ab-2272-44d0-96ba-ab8148cdf663 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:51.156535 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:51.223355 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-35699559-9dc4-48c7-bc4c-67d654b5a032 req-912516a4-e2cd-473b-871c-32c63b64180e service nova] Creating event network-vif-deleted:edaef6f4-0059-48a8-8c1b-5d0dd1e33715 for instance 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec on n-h1-858272-3 Oct 05 03:01:51.243982 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-35699559-9dc4-48c7-bc4c-67d654b5a032 req-912516a4-e2cd-473b-871c-32c63b64180e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150976 Oct 05 03:01:51.251466 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2956/5884] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:01:51.815908 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-92aa03ab-2272-44d0-96ba-ab8148cdf663 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:51.825344 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-92aa03ab-2272-44d0-96ba-ab8148cdf663 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec" status: 200 len: 1453 microversion: 2.1 time: 0.755719 Oct 05 03:01:51.826605 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2929/5885] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:51 2022] GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec => generated 1453 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:52.850430 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-64bb1b34-bbf3-4967-90ac-5bf80941e1cf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:52.851165 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-64bb1b34-bbf3-4967-90ac-5bf80941e1cf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:52.875233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64bb1b34-bbf3-4967-90ac-5bf80941e1cf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:52.876440 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64bb1b34-bbf3-4967-90ac-5bf80941e1cf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:52.877114 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64bb1b34-bbf3-4967-90ac-5bf80941e1cf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:52.878013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64bb1b34-bbf3-4967-90ac-5bf80941e1cf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:52.878654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64bb1b34-bbf3-4967-90ac-5bf80941e1cf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:52.879256 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64bb1b34-bbf3-4967-90ac-5bf80941e1cf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:52.899580 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-64bb1b34-bbf3-4967-90ac-5bf80941e1cf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] HTTP exception thrown: Instance 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec could not be found. Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-64bb1b34-bbf3-4967-90ac-5bf80941e1cf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Request method failure captured: Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec HTTP/1.1 Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPMRSX2gjlikFUspC1UWD3LpY1ceHV7QevQM_Ijag9QQ0seWSmWQwasVLfA-3qPo60WBeSjn_ysZhLr4smwuTcgmq5PXaeLA0zkzWirUA1z0qMp7vToCduQRast94phmM-CNx-XY-K9McRIC58Qrl_qL_n7FYacRtEkL0ls1cybFzQg Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f477959bd24b4db881b62dab54861aa5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersTestJSON-1099213797 Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersTestJSON-1099213797-project Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 12d0128e850f4f22a2172800c44074a4 Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersTestJSON-1099213797-project Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec could not be found. Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '3a0e8591-93a5-43b0-94ba-e7e9a175e7ec'} Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec could not be found. Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec could not be found. Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:01:52.902804 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:01:52.912673 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:01:52.912673 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:01:52.912673 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:01:52.912673 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:01:52.912673 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:01:52.912673 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec could not be found. Oct 05 03:01:52.912673 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:01:52.912673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-64bb1b34-bbf3-4967-90ac-5bf80941e1cf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Returning 404 to user: Instance 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:01:52.912673 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-64bb1b34-bbf3-4967-90ac-5bf80941e1cf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec" status: 404 len: 111 microversion: 2.1 time: 0.059051 Oct 05 03:01:52.918093 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2957/5886] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:52 2022] GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:01:52.929305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-85de77bd-4c0d-4b5e-b98c-d63e62a9e8d8 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:52.929902 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-85de77bd-4c0d-4b5e-b98c-d63e62a9e8d8 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 6275bdb7-ef4e-42f5-8a43-d9c812d99feb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:52.945055 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85de77bd-4c0d-4b5e-b98c-d63e62a9e8d8 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:52.945748 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85de77bd-4c0d-4b5e-b98c-d63e62a9e8d8 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:52.946369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85de77bd-4c0d-4b5e-b98c-d63e62a9e8d8 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:52.948238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85de77bd-4c0d-4b5e-b98c-d63e62a9e8d8 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:52.948861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85de77bd-4c0d-4b5e-b98c-d63e62a9e8d8 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:52.949463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85de77bd-4c0d-4b5e-b98c-d63e62a9e8d8 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:53.029435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-85de77bd-4c0d-4b5e-b98c-d63e62a9e8d8 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 6275bdb7-ef4e-42f5-8a43-d9c812d99feb] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:01:53.207950 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-85de77bd-4c0d-4b5e-b98c-d63e62a9e8d8 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb" status: 204 len: 0 microversion: 2.1 time: 0.284480 Oct 05 03:01:53.208825 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2930/5887] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:01:52 2022] DELETE /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:01:53.217465 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5ea431c7-5ac8-49e4-b0b3-591bb54af82e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:53.218081 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5ea431c7-5ac8-49e4-b0b3-591bb54af82e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 6275bdb7-ef4e-42f5-8a43-d9c812d99feb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:53.227128 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ea431c7-5ac8-49e4-b0b3-591bb54af82e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:53.230761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ea431c7-5ac8-49e4-b0b3-591bb54af82e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:53.231706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ea431c7-5ac8-49e4-b0b3-591bb54af82e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:53.233282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ea431c7-5ac8-49e4-b0b3-591bb54af82e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:53.239381 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ea431c7-5ac8-49e4-b0b3-591bb54af82e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:53.240139 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ea431c7-5ac8-49e4-b0b3-591bb54af82e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:53.893274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5ea431c7-5ac8-49e4-b0b3-591bb54af82e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:53.908505 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5ea431c7-5ac8-49e4-b0b3-591bb54af82e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb" status: 200 len: 1496 microversion: 2.1 time: 0.694970 Oct 05 03:01:53.909351 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2958/5888] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:53 2022] GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb => generated 1496 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:54.942097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9b2176cc-cf10-4d5c-ac2d-ae06787ea19b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:54.942819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9b2176cc-cf10-4d5c-ac2d-ae06787ea19b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 6275bdb7-ef4e-42f5-8a43-d9c812d99feb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:54.953000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b2176cc-cf10-4d5c-ac2d-ae06787ea19b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:54.953794 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b2176cc-cf10-4d5c-ac2d-ae06787ea19b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:54.954402 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b2176cc-cf10-4d5c-ac2d-ae06787ea19b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:54.955318 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b2176cc-cf10-4d5c-ac2d-ae06787ea19b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:54.955943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b2176cc-cf10-4d5c-ac2d-ae06787ea19b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:54.956532 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b2176cc-cf10-4d5c-ac2d-ae06787ea19b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:55.408707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9b2176cc-cf10-4d5c-ac2d-ae06787ea19b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:55.422238 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9b2176cc-cf10-4d5c-ac2d-ae06787ea19b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb" status: 200 len: 1496 microversion: 2.1 time: 0.486020 Oct 05 03:01:55.425074 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2931/5889] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:54 2022] GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb => generated 1496 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:55.997315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-4210c957-40f3-4edd-b216-c495b1252532 req-3a75d644-58f1-463a-97fb-863eb9ffc992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6275bdb7-ef4e-42f5-8a43-d9c812d99feb", "name": "network-vif-deleted", "tag": "01dd0914-8cb4-466d-b2dc-ff21d5d378ad"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:01:56.036040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4210c957-40f3-4edd-b216-c495b1252532 req-3a75d644-58f1-463a-97fb-863eb9ffc992 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:56.038448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4210c957-40f3-4edd-b216-c495b1252532 req-3a75d644-58f1-463a-97fb-863eb9ffc992 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:56.039536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4210c957-40f3-4edd-b216-c495b1252532 req-3a75d644-58f1-463a-97fb-863eb9ffc992 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:56.071813 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-4210c957-40f3-4edd-b216-c495b1252532 req-3a75d644-58f1-463a-97fb-863eb9ffc992 service nova] Creating event network-vif-deleted:01dd0914-8cb4-466d-b2dc-ff21d5d378ad for instance 6275bdb7-ef4e-42f5-8a43-d9c812d99feb on n-h2-858272-3 Oct 05 03:01:56.089579 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-4210c957-40f3-4edd-b216-c495b1252532 req-3a75d644-58f1-463a-97fb-863eb9ffc992 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095579 Oct 05 03:01:56.090201 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2959/5890] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:01:56.455471 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-43360cb4-4757-435a-83a0-c42ff29f9a6d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:56.455471 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-43360cb4-4757-435a-83a0-c42ff29f9a6d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 6275bdb7-ef4e-42f5-8a43-d9c812d99feb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:56.490593 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-43360cb4-4757-435a-83a0-c42ff29f9a6d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:56.491093 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-43360cb4-4757-435a-83a0-c42ff29f9a6d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:56.491531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-43360cb4-4757-435a-83a0-c42ff29f9a6d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:56.499287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-43360cb4-4757-435a-83a0-c42ff29f9a6d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:56.499851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-43360cb4-4757-435a-83a0-c42ff29f9a6d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:56.512033 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-43360cb4-4757-435a-83a0-c42ff29f9a6d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:56.618289 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-43360cb4-4757-435a-83a0-c42ff29f9a6d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:56.619009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-43360cb4-4757-435a-83a0-c42ff29f9a6d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:56.619612 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-43360cb4-4757-435a-83a0-c42ff29f9a6d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:56.621474 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-43360cb4-4757-435a-83a0-c42ff29f9a6d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lazy-loading 'fault' on Instance uuid 6275bdb7-ef4e-42f5-8a43-d9c812d99feb {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:01:56.660068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:56.782557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-43360cb4-4757-435a-83a0-c42ff29f9a6d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:56.801983 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-43360cb4-4757-435a-83a0-c42ff29f9a6d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb" status: 200 len: 1298 microversion: 2.1 time: 0.349265 Oct 05 03:01:56.806595 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2932/5891] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:56 2022] GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb => generated 1298 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:01:57.831205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0ed6c188-271a-42d9-a586-6cdcdf97171a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:57.831909 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0ed6c188-271a-42d9-a586-6cdcdf97171a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 6275bdb7-ef4e-42f5-8a43-d9c812d99feb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:57.843599 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ed6c188-271a-42d9-a586-6cdcdf97171a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:57.848598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ed6c188-271a-42d9-a586-6cdcdf97171a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:57.849312 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ed6c188-271a-42d9-a586-6cdcdf97171a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:57.850235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ed6c188-271a-42d9-a586-6cdcdf97171a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:57.850886 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ed6c188-271a-42d9-a586-6cdcdf97171a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:57.856874 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ed6c188-271a-42d9-a586-6cdcdf97171a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:57.882133 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-0ed6c188-271a-42d9-a586-6cdcdf97171a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] HTTP exception thrown: Instance 6275bdb7-ef4e-42f5-8a43-d9c812d99feb could not be found. Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0ed6c188-271a-42d9-a586-6cdcdf97171a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Request method failure captured: Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb HTTP/1.1 Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPMRSX2gjlikFUspC1UWD3LpY1ceHV7QevQM_Ijag9QQ0seWSmWQwasVLfA-3qPo60WBeSjn_ysZhLr4smwuTcgmq5PXaeLA0zkzWirUA1z0qMp7vToCduQRast94phmM-CNx-XY-K9McRIC58Qrl_qL_n7FYacRtEkL0ls1cybFzQg Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f477959bd24b4db881b62dab54861aa5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersTestJSON-1099213797 Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersTestJSON-1099213797-project Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 12d0128e850f4f22a2172800c44074a4 Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersTestJSON-1099213797-project Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 6275bdb7-ef4e-42f5-8a43-d9c812d99feb could not be found. Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '6275bdb7-ef4e-42f5-8a43-d9c812d99feb'} Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6275bdb7-ef4e-42f5-8a43-d9c812d99feb could not be found. Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6275bdb7-ef4e-42f5-8a43-d9c812d99feb could not be found. Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:01:57.888764 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:01:57.893362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:01:57.893362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:01:57.893362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:01:57.893362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:01:57.893362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:01:57.893362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6275bdb7-ef4e-42f5-8a43-d9c812d99feb could not be found. Oct 05 03:01:57.893362 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:01:57.894661 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0ed6c188-271a-42d9-a586-6cdcdf97171a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Returning 404 to user: Instance 6275bdb7-ef4e-42f5-8a43-d9c812d99feb could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:01:57.895538 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0ed6c188-271a-42d9-a586-6cdcdf97171a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb" status: 404 len: 111 microversion: 2.1 time: 0.069767 Oct 05 03:01:57.896114 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2960/5892] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:57 2022] GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:01:58.103378 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0ae58d63-2f20-43c0-9340-e91455abb636 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1093906313", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "10f7eabf-9521-4437-a838-b9f76044e586"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:01:58.209952 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-0ae58d63-2f20-43c0-9340-e91455abb636 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] validate_networks() for [('10f7eabf-9521-4437-a838-b9f76044e586', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:01:59.688005 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-0ae58d63-2f20-43c0-9340-e91455abb636 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:01:59.688655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-0ae58d63-2f20-43c0-9340-e91455abb636 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:01:59.689129 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-0ae58d63-2f20-43c0-9340-e91455abb636 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:01:59.689538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-0ae58d63-2f20-43c0-9340-e91455abb636 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:01:59.689943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-0ae58d63-2f20-43c0-9340-e91455abb636 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:01:59.702635 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ae58d63-2f20-43c0-9340-e91455abb636 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:59.703302 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ae58d63-2f20-43c0-9340-e91455abb636 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:59.703898 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ae58d63-2f20-43c0-9340-e91455abb636 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:59.704799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ae58d63-2f20-43c0-9340-e91455abb636 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:01:59.705460 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ae58d63-2f20-43c0-9340-e91455abb636 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:01:59.706048 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ae58d63-2f20-43c0-9340-e91455abb636 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:01:59.736069 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-0ae58d63-2f20-43c0-9340-e91455abb636 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Getting quotas for project f477959bd24b4db881b62dab54861aa5. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:01:59.762444 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-0ae58d63-2f20-43c0-9340-e91455abb636 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Getting quotas for user 12d0128e850f4f22a2172800c44074a4 and project f477959bd24b4db881b62dab54861aa5. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:01:59.800635 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0ae58d63-2f20-43c0-9340-e91455abb636 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:01:59.803537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0ae58d63-2f20-43c0-9340-e91455abb636 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 5a857452-5ff9-49c4-ac71-331d2a468a6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:01:59.863610 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0ae58d63-2f20-43c0-9340-e91455abb636 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.763479 Oct 05 03:01:59.865130 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2933/5893] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:01:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:01:59.876182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-67e23beb-2d45-404f-91aa-e6d0cf664ec8 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:01:59.877524 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-67e23beb-2d45-404f-91aa-e6d0cf664ec8 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 5a857452-5ff9-49c4-ac71-331d2a468a6f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:01:59.974469 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-67e23beb-2d45-404f-91aa-e6d0cf664ec8 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:01:59.984941 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-67e23beb-2d45-404f-91aa-e6d0cf664ec8 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f" status: 200 len: 1209 microversion: 2.1 time: 0.112479 Oct 05 03:02:00.002123 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2961/5894] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:01:59 2022] GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f => generated 1209 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:01.041508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ec64509f-0e04-4309-b980-78d958feab49 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:01.045461 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ec64509f-0e04-4309-b980-78d958feab49 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 5a857452-5ff9-49c4-ac71-331d2a468a6f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:01.056961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec64509f-0e04-4309-b980-78d958feab49 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:01.058325 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec64509f-0e04-4309-b980-78d958feab49 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:01.060410 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec64509f-0e04-4309-b980-78d958feab49 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:01.065155 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec64509f-0e04-4309-b980-78d958feab49 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:01.065700 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec64509f-0e04-4309-b980-78d958feab49 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:01.066149 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec64509f-0e04-4309-b980-78d958feab49 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:01.259031 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ec64509f-0e04-4309-b980-78d958feab49 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:01.272283 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ec64509f-0e04-4309-b980-78d958feab49 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f" status: 200 len: 1261 microversion: 2.1 time: 0.261698 Oct 05 03:02:01.284929 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2934/5895] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:01 2022] GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f => generated 1261 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:02.302994 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-17432f4f-6652-4c47-ab8e-1eafba52ba9c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:02.305936 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-17432f4f-6652-4c47-ab8e-1eafba52ba9c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 5a857452-5ff9-49c4-ac71-331d2a468a6f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:02.329718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17432f4f-6652-4c47-ab8e-1eafba52ba9c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:02.330175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17432f4f-6652-4c47-ab8e-1eafba52ba9c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:02.330618 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17432f4f-6652-4c47-ab8e-1eafba52ba9c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:02.332184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17432f4f-6652-4c47-ab8e-1eafba52ba9c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:02.339871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17432f4f-6652-4c47-ab8e-1eafba52ba9c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:02.340373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17432f4f-6652-4c47-ab8e-1eafba52ba9c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:02.534260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-17432f4f-6652-4c47-ab8e-1eafba52ba9c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:02.542567 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-17432f4f-6652-4c47-ab8e-1eafba52ba9c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f" status: 200 len: 1267 microversion: 2.1 time: 0.248639 Oct 05 03:02:02.547172 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2962/5896] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:02 2022] GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f => generated 1267 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:03.576273 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5d132995-5446-4e48-a400-c6d8744b9bc0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:03.577460 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5d132995-5446-4e48-a400-c6d8744b9bc0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 5a857452-5ff9-49c4-ac71-331d2a468a6f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:03.581327 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:03.593898 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d132995-5446-4e48-a400-c6d8744b9bc0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:03.594860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d132995-5446-4e48-a400-c6d8744b9bc0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:03.595551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d132995-5446-4e48-a400-c6d8744b9bc0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:03.596836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d132995-5446-4e48-a400-c6d8744b9bc0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:03.597565 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d132995-5446-4e48-a400-c6d8744b9bc0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:03.598274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d132995-5446-4e48-a400-c6d8744b9bc0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:04.177314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5d132995-5446-4e48-a400-c6d8744b9bc0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:04.187122 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5d132995-5446-4e48-a400-c6d8744b9bc0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f" status: 200 len: 1309 microversion: 2.1 time: 0.616788 Oct 05 03:02:04.187737 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2935/5897] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:03 2022] GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f => generated 1309 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:05.212426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-630a89c3-befb-48a5-90f2-8fd0e3c2ca82 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:05.213280 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-630a89c3-befb-48a5-90f2-8fd0e3c2ca82 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 5a857452-5ff9-49c4-ac71-331d2a468a6f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:05.221100 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=42 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:05.223156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-630a89c3-befb-48a5-90f2-8fd0e3c2ca82 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:05.223652 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-630a89c3-befb-48a5-90f2-8fd0e3c2ca82 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:05.224140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-630a89c3-befb-48a5-90f2-8fd0e3c2ca82 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:05.224857 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-630a89c3-befb-48a5-90f2-8fd0e3c2ca82 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:05.225435 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-630a89c3-befb-48a5-90f2-8fd0e3c2ca82 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:05.225931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-630a89c3-befb-48a5-90f2-8fd0e3c2ca82 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:05.441677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-ac720e7c-4832-41b9-8666-8833ae20105e req-fec34078-9053-4b66-9b80-329fa3c65b3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a857452-5ff9-49c4-ac71-331d2a468a6f", "tag": "cad3ac14-43ba-4f03-a0a8-e0877844a460"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:02:05.458750 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ac720e7c-4832-41b9-8666-8833ae20105e req-fec34078-9053-4b66-9b80-329fa3c65b3b service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:05.459243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ac720e7c-4832-41b9-8666-8833ae20105e req-fec34078-9053-4b66-9b80-329fa3c65b3b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:05.460834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ac720e7c-4832-41b9-8666-8833ae20105e req-fec34078-9053-4b66-9b80-329fa3c65b3b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:05.489239 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-ac720e7c-4832-41b9-8666-8833ae20105e req-fec34078-9053-4b66-9b80-329fa3c65b3b service nova] Creating event network-changed:cad3ac14-43ba-4f03-a0a8-e0877844a460 for instance 5a857452-5ff9-49c4-ac71-331d2a468a6f on n-h1-858272-3 Oct 05 03:02:05.498462 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-ac720e7c-4832-41b9-8666-8833ae20105e req-fec34078-9053-4b66-9b80-329fa3c65b3b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061694 Oct 05 03:02:05.500324 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2936/5898] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:02:05.628122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-630a89c3-befb-48a5-90f2-8fd0e3c2ca82 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:05.637138 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-630a89c3-befb-48a5-90f2-8fd0e3c2ca82 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f" status: 200 len: 1309 microversion: 2.1 time: 0.428840 Oct 05 03:02:05.637557 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2963/5899] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:05 2022] GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f => generated 1309 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:06.667785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-44262e71-fe81-4ee7-b566-fbd6ffc01be6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:06.668827 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-44262e71-fe81-4ee7-b566-fbd6ffc01be6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 5a857452-5ff9-49c4-ac71-331d2a468a6f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:06.675691 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44262e71-fe81-4ee7-b566-fbd6ffc01be6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:06.677906 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44262e71-fe81-4ee7-b566-fbd6ffc01be6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:06.681672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44262e71-fe81-4ee7-b566-fbd6ffc01be6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:06.683180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44262e71-fe81-4ee7-b566-fbd6ffc01be6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:06.683835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44262e71-fe81-4ee7-b566-fbd6ffc01be6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:06.684436 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44262e71-fe81-4ee7-b566-fbd6ffc01be6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:07.257909 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-44262e71-fe81-4ee7-b566-fbd6ffc01be6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:07.271369 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-44262e71-fe81-4ee7-b566-fbd6ffc01be6 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f" status: 200 len: 1309 microversion: 2.1 time: 0.606745 Oct 05 03:02:07.272583 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2937/5900] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:06 2022] GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f => generated 1309 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:02:08.301679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7bbce1e4-77d5-4a41-8467-f36d73256792 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:08.303262 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7bbce1e4-77d5-4a41-8467-f36d73256792 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 5a857452-5ff9-49c4-ac71-331d2a468a6f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:08.320514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7bbce1e4-77d5-4a41-8467-f36d73256792 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:08.320892 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7bbce1e4-77d5-4a41-8467-f36d73256792 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:08.321322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7bbce1e4-77d5-4a41-8467-f36d73256792 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:08.322054 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7bbce1e4-77d5-4a41-8467-f36d73256792 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:08.325991 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7bbce1e4-77d5-4a41-8467-f36d73256792 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:08.326449 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7bbce1e4-77d5-4a41-8467-f36d73256792 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:08.781066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7bbce1e4-77d5-4a41-8467-f36d73256792 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:08.793434 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7bbce1e4-77d5-4a41-8467-f36d73256792 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f" status: 200 len: 1309 microversion: 2.1 time: 0.497312 Oct 05 03:02:08.807023 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2964/5901] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:08 2022] GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f => generated 1309 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:09.819932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a13fc293-9a30-429f-aae3-39005068ec5d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:09.823205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a13fc293-9a30-429f-aae3-39005068ec5d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 5a857452-5ff9-49c4-ac71-331d2a468a6f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:09.831937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:09.834319 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:09.838285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a13fc293-9a30-429f-aae3-39005068ec5d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:09.839638 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a13fc293-9a30-429f-aae3-39005068ec5d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:09.841016 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a13fc293-9a30-429f-aae3-39005068ec5d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:09.843386 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a13fc293-9a30-429f-aae3-39005068ec5d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:09.845841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a13fc293-9a30-429f-aae3-39005068ec5d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:09.847296 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a13fc293-9a30-429f-aae3-39005068ec5d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:10.373172 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a13fc293-9a30-429f-aae3-39005068ec5d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:10.386260 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a13fc293-9a30-429f-aae3-39005068ec5d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f" status: 200 len: 1309 microversion: 2.1 time: 0.571243 Oct 05 03:02:10.387392 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2938/5902] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:09 2022] GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f => generated 1309 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:11.411971 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-483a7c32-af63-432e-bf77-98a24e26177f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:11.413276 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-483a7c32-af63-432e-bf77-98a24e26177f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 5a857452-5ff9-49c4-ac71-331d2a468a6f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:11.424712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:11.428551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-483a7c32-af63-432e-bf77-98a24e26177f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:11.437893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-483a7c32-af63-432e-bf77-98a24e26177f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:11.439164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-483a7c32-af63-432e-bf77-98a24e26177f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:11.440164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-483a7c32-af63-432e-bf77-98a24e26177f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:11.440655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-483a7c32-af63-432e-bf77-98a24e26177f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:11.441183 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-483a7c32-af63-432e-bf77-98a24e26177f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:11.830136 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-483a7c32-af63-432e-bf77-98a24e26177f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:11.843501 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-483a7c32-af63-432e-bf77-98a24e26177f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f" status: 200 len: 1309 microversion: 2.1 time: 0.435614 Oct 05 03:02:11.844605 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2965/5903] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:11 2022] GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f => generated 1309 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:12.857104 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-8b45e242-9ed0-49cb-bba0-359de50b8e2e req-71a7b85c-bc39-421d-a467-7633d10d46c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a857452-5ff9-49c4-ac71-331d2a468a6f", "name": "network-vif-plugged", "status": "completed", "tag": "cad3ac14-43ba-4f03-a0a8-e0877844a460"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:02:12.872354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fa75e654-4f6c-41f3-9119-691cb08e3b98 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:12.873248 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fa75e654-4f6c-41f3-9119-691cb08e3b98 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 5a857452-5ff9-49c4-ac71-331d2a468a6f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:12.903936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-8b45e242-9ed0-49cb-bba0-359de50b8e2e req-71a7b85c-bc39-421d-a467-7633d10d46c6 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:12.904690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-8b45e242-9ed0-49cb-bba0-359de50b8e2e req-71a7b85c-bc39-421d-a467-7633d10d46c6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:12.906094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-8b45e242-9ed0-49cb-bba0-359de50b8e2e req-71a7b85c-bc39-421d-a467-7633d10d46c6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:12.910344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa75e654-4f6c-41f3-9119-691cb08e3b98 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:12.912959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa75e654-4f6c-41f3-9119-691cb08e3b98 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:12.913667 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa75e654-4f6c-41f3-9119-691cb08e3b98 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:12.915198 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa75e654-4f6c-41f3-9119-691cb08e3b98 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:12.917637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa75e654-4f6c-41f3-9119-691cb08e3b98 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:12.919803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa75e654-4f6c-41f3-9119-691cb08e3b98 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:12.928256 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-8b45e242-9ed0-49cb-bba0-359de50b8e2e req-71a7b85c-bc39-421d-a467-7633d10d46c6 service nova] Creating event network-vif-plugged:cad3ac14-43ba-4f03-a0a8-e0877844a460 for instance 5a857452-5ff9-49c4-ac71-331d2a468a6f on n-h1-858272-3 Oct 05 03:02:12.934848 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-8b45e242-9ed0-49cb-bba0-359de50b8e2e req-71a7b85c-bc39-421d-a467-7633d10d46c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082200 Oct 05 03:02:12.946113 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2939/5904] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:02:13.383942 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fa75e654-4f6c-41f3-9119-691cb08e3b98 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:13.398152 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fa75e654-4f6c-41f3-9119-691cb08e3b98 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f" status: 200 len: 1309 microversion: 2.1 time: 0.533990 Oct 05 03:02:13.399351 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2966/5905] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:12 2022] GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f => generated 1309 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:02:14.430466 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9e2db625-e00d-441a-8ff2-d3a93cdc42d0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:14.431708 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9e2db625-e00d-441a-8ff2-d3a93cdc42d0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 5a857452-5ff9-49c4-ac71-331d2a468a6f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:14.439436 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e2db625-e00d-441a-8ff2-d3a93cdc42d0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:14.439935 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e2db625-e00d-441a-8ff2-d3a93cdc42d0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:14.440387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e2db625-e00d-441a-8ff2-d3a93cdc42d0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:14.441112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e2db625-e00d-441a-8ff2-d3a93cdc42d0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:14.441571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e2db625-e00d-441a-8ff2-d3a93cdc42d0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:14.442006 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e2db625-e00d-441a-8ff2-d3a93cdc42d0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:14.644873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9e2db625-e00d-441a-8ff2-d3a93cdc42d0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:14.661393 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9e2db625-e00d-441a-8ff2-d3a93cdc42d0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f" status: 200 len: 1309 microversion: 2.1 time: 0.235410 Oct 05 03:02:14.661872 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2940/5906] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:14 2022] GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f => generated 1309 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:02:15.692074 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c3b52600-d4f8-4515-a90e-3403cb1a0039 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:15.692836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c3b52600-d4f8-4515-a90e-3403cb1a0039 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 5a857452-5ff9-49c4-ac71-331d2a468a6f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:15.703844 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3b52600-d4f8-4515-a90e-3403cb1a0039 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:15.704454 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3b52600-d4f8-4515-a90e-3403cb1a0039 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:15.711623 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3b52600-d4f8-4515-a90e-3403cb1a0039 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:15.711623 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3b52600-d4f8-4515-a90e-3403cb1a0039 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:15.711623 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3b52600-d4f8-4515-a90e-3403cb1a0039 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:15.712269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3b52600-d4f8-4515-a90e-3403cb1a0039 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:15.995153 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c3b52600-d4f8-4515-a90e-3403cb1a0039 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:16.012131 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c3b52600-d4f8-4515-a90e-3403cb1a0039 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f" status: 200 len: 1491 microversion: 2.1 time: 0.323634 Oct 05 03:02:16.019106 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2967/5907] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:15 2022] GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f => generated 1491 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:16.048039 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f812244f-3682-48f7-86ce-a197d10247cb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:02:16.052040 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f812244f-3682-48f7-86ce-a197d10247cb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 5a857452-5ff9-49c4-ac71-331d2a468a6f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:16.061289 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f812244f-3682-48f7-86ce-a197d10247cb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:16.062899 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f812244f-3682-48f7-86ce-a197d10247cb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:16.063577 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f812244f-3682-48f7-86ce-a197d10247cb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:16.064518 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f812244f-3682-48f7-86ce-a197d10247cb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:16.065264 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f812244f-3682-48f7-86ce-a197d10247cb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:16.066068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f812244f-3682-48f7-86ce-a197d10247cb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:16.171039 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f812244f-3682-48f7-86ce-a197d10247cb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "PUT /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f" status: 200 len: 1086 microversion: 2.1 time: 0.128794 Oct 05 03:02:16.172172 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2941/5908] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Oct 5 03:02:16 2022] PUT /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f => generated 1086 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:16.196512 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-52fa449a-d936-451a-ae91-33da5ac92091 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:16.199598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-52fa449a-d936-451a-ae91-33da5ac92091 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 5a857452-5ff9-49c4-ac71-331d2a468a6f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:16.212213 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52fa449a-d936-451a-ae91-33da5ac92091 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:16.214229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52fa449a-d936-451a-ae91-33da5ac92091 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:16.216361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52fa449a-d936-451a-ae91-33da5ac92091 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:16.219717 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52fa449a-d936-451a-ae91-33da5ac92091 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:16.220379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52fa449a-d936-451a-ae91-33da5ac92091 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:16.221014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52fa449a-d936-451a-ae91-33da5ac92091 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:16.429930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-52fa449a-d936-451a-ae91-33da5ac92091 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:16.439527 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-52fa449a-d936-451a-ae91-33da5ac92091 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f" status: 200 len: 1512 microversion: 2.1 time: 0.249027 Oct 05 03:02:16.440490 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2968/5909] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:16 2022] GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f => generated 1512 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:16.472531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f0d2012e-9b68-49d6-a99f-a71395f23f53 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:16.473184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f0d2012e-9b68-49d6-a99f-a71395f23f53 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 5a857452-5ff9-49c4-ac71-331d2a468a6f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:16.494231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0d2012e-9b68-49d6-a99f-a71395f23f53 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:16.495621 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0d2012e-9b68-49d6-a99f-a71395f23f53 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:16.496266 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0d2012e-9b68-49d6-a99f-a71395f23f53 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:16.497400 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0d2012e-9b68-49d6-a99f-a71395f23f53 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:16.498036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0d2012e-9b68-49d6-a99f-a71395f23f53 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:16.498637 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0d2012e-9b68-49d6-a99f-a71395f23f53 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:16.815393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f0d2012e-9b68-49d6-a99f-a71395f23f53 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:16.825719 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f0d2012e-9b68-49d6-a99f-a71395f23f53 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f" status: 200 len: 1512 microversion: 2.1 time: 0.357239 Oct 05 03:02:16.826954 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2942/5910] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:16 2022] GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f => generated 1512 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:16.853553 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c5818a2f-eb2a-41b4-bd22-b60156972b3c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:16.854795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c5818a2f-eb2a-41b4-bd22-b60156972b3c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 5a857452-5ff9-49c4-ac71-331d2a468a6f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:16.883743 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5818a2f-eb2a-41b4-bd22-b60156972b3c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:16.884265 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5818a2f-eb2a-41b4-bd22-b60156972b3c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:16.885056 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5818a2f-eb2a-41b4-bd22-b60156972b3c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:16.886638 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5818a2f-eb2a-41b4-bd22-b60156972b3c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:16.887301 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5818a2f-eb2a-41b4-bd22-b60156972b3c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:16.887736 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c5818a2f-eb2a-41b4-bd22-b60156972b3c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:16.917326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c5818a2f-eb2a-41b4-bd22-b60156972b3c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 5a857452-5ff9-49c4-ac71-331d2a468a6f] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:02:17.205942 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c5818a2f-eb2a-41b4-bd22-b60156972b3c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f" status: 204 len: 0 microversion: 2.1 time: 0.355234 Oct 05 03:02:17.207693 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2969/5911] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:02:16 2022] DELETE /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:02:17.216191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4dbcc4dd-fa96-4424-bcab-0e0abe62c690 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:17.216860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4dbcc4dd-fa96-4424-bcab-0e0abe62c690 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 5a857452-5ff9-49c4-ac71-331d2a468a6f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:17.225979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4dbcc4dd-fa96-4424-bcab-0e0abe62c690 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:17.226519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4dbcc4dd-fa96-4424-bcab-0e0abe62c690 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:17.227464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4dbcc4dd-fa96-4424-bcab-0e0abe62c690 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:17.228178 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4dbcc4dd-fa96-4424-bcab-0e0abe62c690 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:17.228680 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4dbcc4dd-fa96-4424-bcab-0e0abe62c690 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:17.229200 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4dbcc4dd-fa96-4424-bcab-0e0abe62c690 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:17.429084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4dbcc4dd-fa96-4424-bcab-0e0abe62c690 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:17.462004 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4dbcc4dd-fa96-4424-bcab-0e0abe62c690 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f" status: 200 len: 1518 microversion: 2.1 time: 0.249165 Oct 05 03:02:17.463157 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2943/5912] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:17 2022] GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f => generated 1518 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:02:18.494096 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-babfb505-734d-4db8-b636-3116c165e168 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:18.495388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-babfb505-734d-4db8-b636-3116c165e168 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 5a857452-5ff9-49c4-ac71-331d2a468a6f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:18.522754 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-babfb505-734d-4db8-b636-3116c165e168 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:18.523260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-babfb505-734d-4db8-b636-3116c165e168 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:18.525945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-babfb505-734d-4db8-b636-3116c165e168 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:18.527226 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-babfb505-734d-4db8-b636-3116c165e168 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:18.527422 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-babfb505-734d-4db8-b636-3116c165e168 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:18.545710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-babfb505-734d-4db8-b636-3116c165e168 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:18.949218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-babfb505-734d-4db8-b636-3116c165e168 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:18.959397 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-babfb505-734d-4db8-b636-3116c165e168 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f" status: 200 len: 1518 microversion: 2.1 time: 0.469426 Oct 05 03:02:18.967367 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2970/5913] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:18 2022] GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f => generated 1518 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:19.478531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-47afa886-cba7-453a-812b-1fd004541db4 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:02:19.481421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-47afa886-cba7-453a-812b-1fd004541db4 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 16f4a218-7c09-4282-9670-6b280970a99f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:19.508630 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47afa886-cba7-453a-812b-1fd004541db4 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:19.509170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47afa886-cba7-453a-812b-1fd004541db4 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:19.514382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47afa886-cba7-453a-812b-1fd004541db4 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:19.515395 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47afa886-cba7-453a-812b-1fd004541db4 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:19.516061 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47afa886-cba7-453a-812b-1fd004541db4 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:19.516654 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47afa886-cba7-453a-812b-1fd004541db4 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:19.640104 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-47afa886-cba7-453a-812b-1fd004541db4 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "POST /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f/action" status: 200 len: 24534 microversion: 2.1 time: 0.176543 Oct 05 03:02:19.643437 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2944/5914] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:02:19 2022] POST /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f/action => generated 24534 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 03:02:19.992166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-30d85dfb-79d8-4584-a958-30a3a07a2335 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:20.000417 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-30d85dfb-79d8-4584-a958-30a3a07a2335 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 5a857452-5ff9-49c4-ac71-331d2a468a6f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:20.015312 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-30d85dfb-79d8-4584-a958-30a3a07a2335 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:20.016379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-30d85dfb-79d8-4584-a958-30a3a07a2335 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:20.017038 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-30d85dfb-79d8-4584-a958-30a3a07a2335 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:20.017990 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-30d85dfb-79d8-4584-a958-30a3a07a2335 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:20.018644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-30d85dfb-79d8-4584-a958-30a3a07a2335 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:20.019464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-30d85dfb-79d8-4584-a958-30a3a07a2335 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:20.607430 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-30d85dfb-79d8-4584-a958-30a3a07a2335 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:20.629481 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-30d85dfb-79d8-4584-a958-30a3a07a2335 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f" status: 200 len: 1518 microversion: 2.1 time: 0.643231 Oct 05 03:02:20.630094 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2971/5915] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:19 2022] GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f => generated 1518 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:20.719604 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-4a69ebb8-77f9-49ae-a384-d84dad2aef0c req-eddcfe08-3b01-4afb-b001-459e670576f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a857452-5ff9-49c4-ac71-331d2a468a6f", "name": "network-vif-deleted", "tag": "cad3ac14-43ba-4f03-a0a8-e0877844a460"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:02:20.734285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4a69ebb8-77f9-49ae-a384-d84dad2aef0c req-eddcfe08-3b01-4afb-b001-459e670576f1 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:20.735639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4a69ebb8-77f9-49ae-a384-d84dad2aef0c req-eddcfe08-3b01-4afb-b001-459e670576f1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:20.737030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4a69ebb8-77f9-49ae-a384-d84dad2aef0c req-eddcfe08-3b01-4afb-b001-459e670576f1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:20.759052 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-4a69ebb8-77f9-49ae-a384-d84dad2aef0c req-eddcfe08-3b01-4afb-b001-459e670576f1 service nova] Creating event network-vif-deleted:cad3ac14-43ba-4f03-a0a8-e0877844a460 for instance 5a857452-5ff9-49c4-ac71-331d2a468a6f on n-h1-858272-3 Oct 05 03:02:20.767507 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-4a69ebb8-77f9-49ae-a384-d84dad2aef0c req-eddcfe08-3b01-4afb-b001-459e670576f1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058417 Oct 05 03:02:20.768726 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2945/5916] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:02:21.664450 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ae01928c-b41c-41c3-bb25-a5b59ccb3709 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:21.665663 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ae01928c-b41c-41c3-bb25-a5b59ccb3709 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 5a857452-5ff9-49c4-ac71-331d2a468a6f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:21.673832 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae01928c-b41c-41c3-bb25-a5b59ccb3709 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:21.674859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae01928c-b41c-41c3-bb25-a5b59ccb3709 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:21.674993 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae01928c-b41c-41c3-bb25-a5b59ccb3709 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:21.675682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae01928c-b41c-41c3-bb25-a5b59ccb3709 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:21.676146 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae01928c-b41c-41c3-bb25-a5b59ccb3709 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:21.676576 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae01928c-b41c-41c3-bb25-a5b59ccb3709 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:21.716313 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:21.717753 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-ae01928c-b41c-41c3-bb25-a5b59ccb3709 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] HTTP exception thrown: Instance 5a857452-5ff9-49c4-ac71-331d2a468a6f could not be found. Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ae01928c-b41c-41c3-bb25-a5b59ccb3709 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Request method failure captured: Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f HTTP/1.1 Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPMRSX2gjlikFUspC1UWD3LpY1ceHV7QevQM_Ijag9QQ0seWSmWQwasVLfA-3qPo60WBeSjn_ysZhLr4smwuTcgmq5PXaeLA0zkzWirUA1z0qMp7vToCduQRast94phmM-CNx-XY-K9McRIC58Qrl_qL_n7FYacRtEkL0ls1cybFzQg Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f477959bd24b4db881b62dab54861aa5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersTestJSON-1099213797 Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersTestJSON-1099213797-project Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 12d0128e850f4f22a2172800c44074a4 Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersTestJSON-1099213797-project Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 5a857452-5ff9-49c4-ac71-331d2a468a6f could not be found. Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '5a857452-5ff9-49c4-ac71-331d2a468a6f'} Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a857452-5ff9-49c4-ac71-331d2a468a6f could not be found. Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a857452-5ff9-49c4-ac71-331d2a468a6f could not be found. Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:02:21.723462 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:02:21.735329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:02:21.735329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:02:21.735329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:02:21.735329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:02:21.735329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:02:21.735329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a857452-5ff9-49c4-ac71-331d2a468a6f could not be found. Oct 05 03:02:21.735329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:02:21.735329 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ae01928c-b41c-41c3-bb25-a5b59ccb3709 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Returning 404 to user: Instance 5a857452-5ff9-49c4-ac71-331d2a468a6f could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:02:21.735329 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ae01928c-b41c-41c3-bb25-a5b59ccb3709 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f" status: 404 len: 111 microversion: 2.1 time: 0.064939 Oct 05 03:02:21.735329 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2972/5917] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:21 2022] GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:02:21.921139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3b4a7ea1-cbc5-4264-99f2-ff7ed6a8ae24 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-349992180", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "10f7eabf-9521-4437-a838-b9f76044e586"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:02:21.998251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-3b4a7ea1-cbc5-4264-99f2-ff7ed6a8ae24 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] validate_networks() for [('10f7eabf-9521-4437-a838-b9f76044e586', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:02:22.722065 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-3b4a7ea1-cbc5-4264-99f2-ff7ed6a8ae24 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:02:22.722705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-3b4a7ea1-cbc5-4264-99f2-ff7ed6a8ae24 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:02:22.723345 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-3b4a7ea1-cbc5-4264-99f2-ff7ed6a8ae24 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:02:22.723915 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-3b4a7ea1-cbc5-4264-99f2-ff7ed6a8ae24 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:02:22.724738 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-3b4a7ea1-cbc5-4264-99f2-ff7ed6a8ae24 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:02:22.741979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3b4a7ea1-cbc5-4264-99f2-ff7ed6a8ae24 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:22.744225 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3b4a7ea1-cbc5-4264-99f2-ff7ed6a8ae24 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:22.758167 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3b4a7ea1-cbc5-4264-99f2-ff7ed6a8ae24 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:22.758167 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3b4a7ea1-cbc5-4264-99f2-ff7ed6a8ae24 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:22.759297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3b4a7ea1-cbc5-4264-99f2-ff7ed6a8ae24 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:22.759297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3b4a7ea1-cbc5-4264-99f2-ff7ed6a8ae24 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:22.833462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-3b4a7ea1-cbc5-4264-99f2-ff7ed6a8ae24 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Getting quotas for project f477959bd24b4db881b62dab54861aa5. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:02:22.846025 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-3b4a7ea1-cbc5-4264-99f2-ff7ed6a8ae24 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Getting quotas for user 12d0128e850f4f22a2172800c44074a4 and project f477959bd24b4db881b62dab54861aa5. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:02:22.874415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3b4a7ea1-cbc5-4264-99f2-ff7ed6a8ae24 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:02:22.877732 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3b4a7ea1-cbc5-4264-99f2-ff7ed6a8ae24 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:02:22.949155 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3b4a7ea1-cbc5-4264-99f2-ff7ed6a8ae24 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.034656 Oct 05 03:02:22.951313 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2946/5918] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:02:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:02:22.961970 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8d96671e-cf9f-4055-9d72-a5e2f216ce84 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:22.962745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8d96671e-cf9f-4055-9d72-a5e2f216ce84 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:23.087810 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8d96671e-cf9f-4055-9d72-a5e2f216ce84 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:23.110777 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8d96671e-cf9f-4055-9d72-a5e2f216ce84 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1208 microversion: 2.1 time: 0.147511 Oct 05 03:02:23.124550 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2973/5919] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:22 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1208 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:24.131491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4e04c202-2988-49fc-86bf-453c2b9e4bbb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:24.133289 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4e04c202-2988-49fc-86bf-453c2b9e4bbb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:24.155389 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e04c202-2988-49fc-86bf-453c2b9e4bbb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:24.156091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e04c202-2988-49fc-86bf-453c2b9e4bbb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:24.156720 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e04c202-2988-49fc-86bf-453c2b9e4bbb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:24.161841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e04c202-2988-49fc-86bf-453c2b9e4bbb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:24.162593 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e04c202-2988-49fc-86bf-453c2b9e4bbb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:24.164326 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e04c202-2988-49fc-86bf-453c2b9e4bbb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:24.261078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4e04c202-2988-49fc-86bf-453c2b9e4bbb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:24.282225 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4e04c202-2988-49fc-86bf-453c2b9e4bbb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1260 microversion: 2.1 time: 0.153643 Oct 05 03:02:24.296203 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2947/5920] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:24 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:25.321593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4fc24ddd-656e-4827-9ac6-7ba02c5281e1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:25.322240 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4fc24ddd-656e-4827-9ac6-7ba02c5281e1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:25.330289 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4fc24ddd-656e-4827-9ac6-7ba02c5281e1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:25.330793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4fc24ddd-656e-4827-9ac6-7ba02c5281e1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:25.332237 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4fc24ddd-656e-4827-9ac6-7ba02c5281e1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:25.333998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4fc24ddd-656e-4827-9ac6-7ba02c5281e1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:25.334916 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4fc24ddd-656e-4827-9ac6-7ba02c5281e1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:25.335536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4fc24ddd-656e-4827-9ac6-7ba02c5281e1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:25.465448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4fc24ddd-656e-4827-9ac6-7ba02c5281e1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:25.478742 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4fc24ddd-656e-4827-9ac6-7ba02c5281e1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1266 microversion: 2.1 time: 0.161315 Oct 05 03:02:25.480624 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2974/5921] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:25 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:26.506991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a2c80565-caee-4160-b44f-9403825d5422 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:26.508330 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a2c80565-caee-4160-b44f-9403825d5422 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:26.528924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2c80565-caee-4160-b44f-9403825d5422 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:26.529688 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2c80565-caee-4160-b44f-9403825d5422 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:26.530334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2c80565-caee-4160-b44f-9403825d5422 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:26.531308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2c80565-caee-4160-b44f-9403825d5422 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:26.531961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2c80565-caee-4160-b44f-9403825d5422 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:26.532628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2c80565-caee-4160-b44f-9403825d5422 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:26.885321 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a2c80565-caee-4160-b44f-9403825d5422 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:26.899497 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:26.910560 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a2c80565-caee-4160-b44f-9403825d5422 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1308 microversion: 2.1 time: 0.407392 Oct 05 03:02:26.911692 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2948/5922] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:26 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1308 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:27.641222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-d07a069c-234a-4ba0-b0f5-f2c149fc9b34 req-d428212e-6c30-49d9-8fd5-5e5784465991 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23f0cd1f-4da6-484e-98d9-ede9fb143a0f", "tag": "796f8563-6c42-4852-9e8c-a18e878c7a47"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:02:27.685567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d07a069c-234a-4ba0-b0f5-f2c149fc9b34 req-d428212e-6c30-49d9-8fd5-5e5784465991 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:27.686122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d07a069c-234a-4ba0-b0f5-f2c149fc9b34 req-d428212e-6c30-49d9-8fd5-5e5784465991 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:27.686501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d07a069c-234a-4ba0-b0f5-f2c149fc9b34 req-d428212e-6c30-49d9-8fd5-5e5784465991 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:27.714946 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-d07a069c-234a-4ba0-b0f5-f2c149fc9b34 req-d428212e-6c30-49d9-8fd5-5e5784465991 service nova] Creating event network-changed:796f8563-6c42-4852-9e8c-a18e878c7a47 for instance 23f0cd1f-4da6-484e-98d9-ede9fb143a0f on n-h1-858272-3 Oct 05 03:02:27.728631 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-d07a069c-234a-4ba0-b0f5-f2c149fc9b34 req-d428212e-6c30-49d9-8fd5-5e5784465991 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091724 Oct 05 03:02:27.730269 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2975/5923] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:02:27.937119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8b99e3a9-86f7-4677-a37f-e7c390b3643b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:27.938370 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8b99e3a9-86f7-4677-a37f-e7c390b3643b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:27.970690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b99e3a9-86f7-4677-a37f-e7c390b3643b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:27.983172 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b99e3a9-86f7-4677-a37f-e7c390b3643b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:27.985645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b99e3a9-86f7-4677-a37f-e7c390b3643b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:27.986674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b99e3a9-86f7-4677-a37f-e7c390b3643b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:27.988498 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b99e3a9-86f7-4677-a37f-e7c390b3643b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:27.990369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b99e3a9-86f7-4677-a37f-e7c390b3643b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:28.614330 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8b99e3a9-86f7-4677-a37f-e7c390b3643b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:28.652094 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8b99e3a9-86f7-4677-a37f-e7c390b3643b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1308 microversion: 2.1 time: 0.717319 Oct 05 03:02:28.654250 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2949/5924] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:27 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1308 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:29.680242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d47828aa-565b-4def-9a31-39d2aa2cfaf3 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:29.680921 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d47828aa-565b-4def-9a31-39d2aa2cfaf3 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:29.696377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d47828aa-565b-4def-9a31-39d2aa2cfaf3 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:29.696885 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d47828aa-565b-4def-9a31-39d2aa2cfaf3 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:29.697348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d47828aa-565b-4def-9a31-39d2aa2cfaf3 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:29.698116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d47828aa-565b-4def-9a31-39d2aa2cfaf3 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:29.698573 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d47828aa-565b-4def-9a31-39d2aa2cfaf3 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:29.702258 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d47828aa-565b-4def-9a31-39d2aa2cfaf3 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:30.036176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d47828aa-565b-4def-9a31-39d2aa2cfaf3 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:30.045454 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d47828aa-565b-4def-9a31-39d2aa2cfaf3 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1308 microversion: 2.1 time: 0.372282 Oct 05 03:02:30.047867 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2976/5925] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:29 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1308 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:31.071826 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cd2f88fc-1f9e-4f71-a1ba-f5c5a29009d1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:31.073780 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cd2f88fc-1f9e-4f71-a1ba-f5c5a29009d1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:31.089343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd2f88fc-1f9e-4f71-a1ba-f5c5a29009d1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:31.090122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd2f88fc-1f9e-4f71-a1ba-f5c5a29009d1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:31.091081 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd2f88fc-1f9e-4f71-a1ba-f5c5a29009d1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:31.092033 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd2f88fc-1f9e-4f71-a1ba-f5c5a29009d1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:31.092716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd2f88fc-1f9e-4f71-a1ba-f5c5a29009d1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:31.093660 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd2f88fc-1f9e-4f71-a1ba-f5c5a29009d1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:31.476101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cd2f88fc-1f9e-4f71-a1ba-f5c5a29009d1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:31.487253 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cd2f88fc-1f9e-4f71-a1ba-f5c5a29009d1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1308 microversion: 2.1 time: 0.419862 Oct 05 03:02:31.493265 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2950/5926] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:31 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1308 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:32.511774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e362a43c-c1d7-4bbc-a3f0-ab18fce8c7c1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:32.512398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e362a43c-c1d7-4bbc-a3f0-ab18fce8c7c1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:32.545772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e362a43c-c1d7-4bbc-a3f0-ab18fce8c7c1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:32.549601 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e362a43c-c1d7-4bbc-a3f0-ab18fce8c7c1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:32.550244 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e362a43c-c1d7-4bbc-a3f0-ab18fce8c7c1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:32.551293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e362a43c-c1d7-4bbc-a3f0-ab18fce8c7c1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:32.555954 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e362a43c-c1d7-4bbc-a3f0-ab18fce8c7c1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:32.558591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e362a43c-c1d7-4bbc-a3f0-ab18fce8c7c1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:32.942252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e362a43c-c1d7-4bbc-a3f0-ab18fce8c7c1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:32.955468 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e362a43c-c1d7-4bbc-a3f0-ab18fce8c7c1 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1308 microversion: 2.1 time: 0.447636 Oct 05 03:02:32.956082 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2977/5927] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:32 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1308 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:33.979733 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a765cffd-6c3c-45a1-be49-ad1c658b8191 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:33.981111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a765cffd-6c3c-45a1-be49-ad1c658b8191 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:33.991112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:33.992368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:33.993251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:33.996549 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a765cffd-6c3c-45a1-be49-ad1c658b8191 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:33.997603 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a765cffd-6c3c-45a1-be49-ad1c658b8191 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:33.998851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a765cffd-6c3c-45a1-be49-ad1c658b8191 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:34.000064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a765cffd-6c3c-45a1-be49-ad1c658b8191 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:34.001658 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a765cffd-6c3c-45a1-be49-ad1c658b8191 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:34.002527 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a765cffd-6c3c-45a1-be49-ad1c658b8191 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:34.208020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a765cffd-6c3c-45a1-be49-ad1c658b8191 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:34.225289 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a765cffd-6c3c-45a1-be49-ad1c658b8191 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1308 microversion: 2.1 time: 0.249927 Oct 05 03:02:34.226545 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2951/5928] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:33 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1308 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:35.075257 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-19e0dce3-f3b3-46a0-b4d6-bcae9b2ce4bb req-63a80aab-3622-43f1-8a57-85e893681dfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f0cd1f-4da6-484e-98d9-ede9fb143a0f", "name": "network-vif-plugged", "status": "completed", "tag": "796f8563-6c42-4852-9e8c-a18e878c7a47"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:02:35.090179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:35.095611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-19e0dce3-f3b3-46a0-b4d6-bcae9b2ce4bb req-63a80aab-3622-43f1-8a57-85e893681dfc service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:35.096309 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-19e0dce3-f3b3-46a0-b4d6-bcae9b2ce4bb req-63a80aab-3622-43f1-8a57-85e893681dfc service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:35.099242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-19e0dce3-f3b3-46a0-b4d6-bcae9b2ce4bb req-63a80aab-3622-43f1-8a57-85e893681dfc service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:35.129635 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-19e0dce3-f3b3-46a0-b4d6-bcae9b2ce4bb req-63a80aab-3622-43f1-8a57-85e893681dfc service nova] Creating event network-vif-plugged:796f8563-6c42-4852-9e8c-a18e878c7a47 for instance 23f0cd1f-4da6-484e-98d9-ede9fb143a0f on n-h1-858272-3 Oct 05 03:02:35.140048 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-19e0dce3-f3b3-46a0-b4d6-bcae9b2ce4bb req-63a80aab-3622-43f1-8a57-85e893681dfc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070449 Oct 05 03:02:35.140755 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2978/5929] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:02:35.250588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cc279541-1b95-46ee-a927-16f50cba186d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:35.251866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cc279541-1b95-46ee-a927-16f50cba186d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:35.267839 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cc279541-1b95-46ee-a927-16f50cba186d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:35.268343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cc279541-1b95-46ee-a927-16f50cba186d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:35.268869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cc279541-1b95-46ee-a927-16f50cba186d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:35.269794 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cc279541-1b95-46ee-a927-16f50cba186d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:35.270397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cc279541-1b95-46ee-a927-16f50cba186d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:35.270974 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cc279541-1b95-46ee-a927-16f50cba186d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:36.080300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cc279541-1b95-46ee-a927-16f50cba186d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:36.088726 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cc279541-1b95-46ee-a927-16f50cba186d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1308 microversion: 2.1 time: 0.841976 Oct 05 03:02:36.102089 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2952/5930] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:35 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1308 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:37.118674 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8675e307-1441-44d6-be30-7782b44a27e2 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:37.121509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8675e307-1441-44d6-be30-7782b44a27e2 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:37.130106 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:37.141452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8675e307-1441-44d6-be30-7782b44a27e2 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:37.143489 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8675e307-1441-44d6-be30-7782b44a27e2 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:37.144927 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8675e307-1441-44d6-be30-7782b44a27e2 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:37.147227 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8675e307-1441-44d6-be30-7782b44a27e2 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:37.149425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8675e307-1441-44d6-be30-7782b44a27e2 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:37.151745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8675e307-1441-44d6-be30-7782b44a27e2 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:37.422150 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8675e307-1441-44d6-be30-7782b44a27e2 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:37.449180 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8675e307-1441-44d6-be30-7782b44a27e2 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1308 microversion: 2.1 time: 0.333008 Oct 05 03:02:37.449876 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2979/5931] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:37 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1308 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:38.474288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-297c1cf3-e96b-4aa1-875d-acb62d6b05eb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:38.475573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-297c1cf3-e96b-4aa1-875d-acb62d6b05eb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:38.488970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-297c1cf3-e96b-4aa1-875d-acb62d6b05eb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:38.489719 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-297c1cf3-e96b-4aa1-875d-acb62d6b05eb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:38.490454 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-297c1cf3-e96b-4aa1-875d-acb62d6b05eb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:38.491327 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-297c1cf3-e96b-4aa1-875d-acb62d6b05eb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:38.493992 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-297c1cf3-e96b-4aa1-875d-acb62d6b05eb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:38.494680 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-297c1cf3-e96b-4aa1-875d-acb62d6b05eb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:38.971896 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-297c1cf3-e96b-4aa1-875d-acb62d6b05eb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:38.986278 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-297c1cf3-e96b-4aa1-875d-acb62d6b05eb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1490 microversion: 2.1 time: 0.515761 Oct 05 03:02:38.988836 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2953/5932] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:38 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1490 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:39.023319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c338893e-03bc-4b48-b95e-6b16b9345e9f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-221333467"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:02:39.023319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c338893e-03bc-4b48-b95e-6b16b9345e9f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:39.047296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c338893e-03bc-4b48-b95e-6b16b9345e9f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:39.052396 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c338893e-03bc-4b48-b95e-6b16b9345e9f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:39.052927 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c338893e-03bc-4b48-b95e-6b16b9345e9f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:39.056189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c338893e-03bc-4b48-b95e-6b16b9345e9f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:39.056775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c338893e-03bc-4b48-b95e-6b16b9345e9f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:39.060987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c338893e-03bc-4b48-b95e-6b16b9345e9f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:39.217108 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c338893e-03bc-4b48-b95e-6b16b9345e9f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "PUT /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1075 microversion: 2.1 time: 0.207048 Oct 05 03:02:39.234999 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2980/5933] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Oct 5 03:02:39 2022] PUT /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1075 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:39.241397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9f1a27f4-d69f-42be-999e-fac603276a2d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:39.242200 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9f1a27f4-d69f-42be-999e-fac603276a2d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:39.254284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9f1a27f4-d69f-42be-999e-fac603276a2d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:39.255630 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9f1a27f4-d69f-42be-999e-fac603276a2d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:39.257335 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9f1a27f4-d69f-42be-999e-fac603276a2d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:39.259471 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9f1a27f4-d69f-42be-999e-fac603276a2d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:39.261582 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9f1a27f4-d69f-42be-999e-fac603276a2d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:39.262757 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9f1a27f4-d69f-42be-999e-fac603276a2d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:39.764951 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9f1a27f4-d69f-42be-999e-fac603276a2d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:39.778660 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9f1a27f4-d69f-42be-999e-fac603276a2d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1501 microversion: 2.1 time: 0.537054 Oct 05 03:02:39.781712 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2954/5934] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:39 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1501 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:39.804271 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b16fd9af-a266-4d23-915b-4896acb050b5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:39.805165 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b16fd9af-a266-4d23-915b-4896acb050b5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:39.814593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b16fd9af-a266-4d23-915b-4896acb050b5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:39.828509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b16fd9af-a266-4d23-915b-4896acb050b5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:39.829208 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b16fd9af-a266-4d23-915b-4896acb050b5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:39.830009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b16fd9af-a266-4d23-915b-4896acb050b5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:39.830485 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b16fd9af-a266-4d23-915b-4896acb050b5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:39.830892 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b16fd9af-a266-4d23-915b-4896acb050b5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:40.320167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b16fd9af-a266-4d23-915b-4896acb050b5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:40.331441 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b16fd9af-a266-4d23-915b-4896acb050b5 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1501 microversion: 2.1 time: 0.531115 Oct 05 03:02:40.337680 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2981/5935] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:39 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1501 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:40.361606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-eca14f60-1501-411d-bbff-ebc0b615e144 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:02:40.376790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eca14f60-1501-411d-bbff-ebc0b615e144 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:40.377620 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eca14f60-1501-411d-bbff-ebc0b615e144 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:40.379141 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eca14f60-1501-411d-bbff-ebc0b615e144 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:40.409205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-eca14f60-1501-411d-bbff-ebc0b615e144 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Going to try to stop instance {{(pid=122320) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 05 03:02:40.532235 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-eca14f60-1501-411d-bbff-ebc0b615e144 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "POST /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f/action" status: 202 len: 0 microversion: 2.1 time: 0.174006 Oct 05 03:02:40.536840 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2955/5936] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:02:40 2022] POST /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:02:40.544182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ac39d5a2-8f05-423f-a93b-7d8cc6a6517d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:40.544821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ac39d5a2-8f05-423f-a93b-7d8cc6a6517d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:40.552430 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac39d5a2-8f05-423f-a93b-7d8cc6a6517d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:40.553608 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac39d5a2-8f05-423f-a93b-7d8cc6a6517d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:40.554093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac39d5a2-8f05-423f-a93b-7d8cc6a6517d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:40.554880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac39d5a2-8f05-423f-a93b-7d8cc6a6517d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:40.555337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac39d5a2-8f05-423f-a93b-7d8cc6a6517d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:40.555805 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac39d5a2-8f05-423f-a93b-7d8cc6a6517d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:40.964583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ac39d5a2-8f05-423f-a93b-7d8cc6a6517d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:40.983208 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ac39d5a2-8f05-423f-a93b-7d8cc6a6517d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1511 microversion: 2.1 time: 0.444389 Oct 05 03:02:40.998906 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2982/5937] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:40 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1511 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:42.026535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7c83c1f7-c6bb-4fb6-bd8e-3870f957d667 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:42.027876 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7c83c1f7-c6bb-4fb6-bd8e-3870f957d667 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:42.046613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c83c1f7-c6bb-4fb6-bd8e-3870f957d667 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:42.047128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c83c1f7-c6bb-4fb6-bd8e-3870f957d667 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:42.047571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c83c1f7-c6bb-4fb6-bd8e-3870f957d667 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:42.052560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c83c1f7-c6bb-4fb6-bd8e-3870f957d667 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:42.053145 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c83c1f7-c6bb-4fb6-bd8e-3870f957d667 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:42.053589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c83c1f7-c6bb-4fb6-bd8e-3870f957d667 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:42.337137 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7c83c1f7-c6bb-4fb6-bd8e-3870f957d667 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:42.347746 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7c83c1f7-c6bb-4fb6-bd8e-3870f957d667 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1511 microversion: 2.1 time: 0.328057 Oct 05 03:02:42.348942 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2956/5938] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:42 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1511 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:43.372262 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-edf0e883-24d1-4ef9-965c-34fbbd7e6ebb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:43.372883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-edf0e883-24d1-4ef9-965c-34fbbd7e6ebb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:43.390212 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-edf0e883-24d1-4ef9-965c-34fbbd7e6ebb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:43.394037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-edf0e883-24d1-4ef9-965c-34fbbd7e6ebb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:43.394718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-edf0e883-24d1-4ef9-965c-34fbbd7e6ebb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:43.395794 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-edf0e883-24d1-4ef9-965c-34fbbd7e6ebb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:43.397508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-edf0e883-24d1-4ef9-965c-34fbbd7e6ebb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:43.398921 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-edf0e883-24d1-4ef9-965c-34fbbd7e6ebb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:43.605337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-edf0e883-24d1-4ef9-965c-34fbbd7e6ebb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:43.615241 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-edf0e883-24d1-4ef9-965c-34fbbd7e6ebb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1511 microversion: 2.1 time: 0.247503 Oct 05 03:02:43.616457 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2983/5939] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:43 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1511 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:02:44.640198 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d7edc58e-fbac-40b2-b552-1d0903f9e86f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:44.641053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d7edc58e-fbac-40b2-b552-1d0903f9e86f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:44.655690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7edc58e-fbac-40b2-b552-1d0903f9e86f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:44.657308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7edc58e-fbac-40b2-b552-1d0903f9e86f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:44.658076 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7edc58e-fbac-40b2-b552-1d0903f9e86f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:44.659689 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7edc58e-fbac-40b2-b552-1d0903f9e86f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:44.661756 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7edc58e-fbac-40b2-b552-1d0903f9e86f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:44.662272 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7edc58e-fbac-40b2-b552-1d0903f9e86f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:44.995029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d7edc58e-fbac-40b2-b552-1d0903f9e86f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:45.004894 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d7edc58e-fbac-40b2-b552-1d0903f9e86f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1511 microversion: 2.1 time: 0.369812 Oct 05 03:02:45.006563 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2957/5940] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:44 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1511 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:46.035015 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e944e9fb-455e-4401-a21b-d68466bd477c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:46.035470 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e944e9fb-455e-4401-a21b-d68466bd477c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:46.049180 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e944e9fb-455e-4401-a21b-d68466bd477c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:46.049879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e944e9fb-455e-4401-a21b-d68466bd477c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:46.053295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e944e9fb-455e-4401-a21b-d68466bd477c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:46.054090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e944e9fb-455e-4401-a21b-d68466bd477c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:46.054504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e944e9fb-455e-4401-a21b-d68466bd477c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:46.056548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e944e9fb-455e-4401-a21b-d68466bd477c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:46.271414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e944e9fb-455e-4401-a21b-d68466bd477c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:46.281862 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e944e9fb-455e-4401-a21b-d68466bd477c tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1511 microversion: 2.1 time: 0.253192 Oct 05 03:02:46.283107 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2984/5941] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:46 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1511 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:47.312679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-03354fd1-2a8d-4e31-89af-28ef40d7e963 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:47.313328 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-03354fd1-2a8d-4e31-89af-28ef40d7e963 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:47.327926 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03354fd1-2a8d-4e31-89af-28ef40d7e963 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:47.328450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03354fd1-2a8d-4e31-89af-28ef40d7e963 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:47.328892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03354fd1-2a8d-4e31-89af-28ef40d7e963 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:47.329624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03354fd1-2a8d-4e31-89af-28ef40d7e963 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:47.330079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03354fd1-2a8d-4e31-89af-28ef40d7e963 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:47.330501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03354fd1-2a8d-4e31-89af-28ef40d7e963 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:47.602702 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-03354fd1-2a8d-4e31-89af-28ef40d7e963 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:47.613402 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-03354fd1-2a8d-4e31-89af-28ef40d7e963 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1511 microversion: 2.1 time: 0.304461 Oct 05 03:02:47.614977 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2958/5942] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:47 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1511 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:48.643134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f4d6844f-9827-4b0c-a8f8-3afc6ed5ca49 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:48.643893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f4d6844f-9827-4b0c-a8f8-3afc6ed5ca49 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:48.660520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f4d6844f-9827-4b0c-a8f8-3afc6ed5ca49 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:48.662744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f4d6844f-9827-4b0c-a8f8-3afc6ed5ca49 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:48.663407 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f4d6844f-9827-4b0c-a8f8-3afc6ed5ca49 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:48.667523 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f4d6844f-9827-4b0c-a8f8-3afc6ed5ca49 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:48.668807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f4d6844f-9827-4b0c-a8f8-3afc6ed5ca49 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:48.669227 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f4d6844f-9827-4b0c-a8f8-3afc6ed5ca49 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:48.881344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f4d6844f-9827-4b0c-a8f8-3afc6ed5ca49 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:48.904354 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f4d6844f-9827-4b0c-a8f8-3afc6ed5ca49 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1511 microversion: 2.1 time: 0.267132 Oct 05 03:02:48.913009 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2985/5943] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:48 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1511 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:49.928142 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1ffc8711-9c9e-43fa-b7df-2dc37237267f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:49.929265 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1ffc8711-9c9e-43fa-b7df-2dc37237267f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:49.942094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1ffc8711-9c9e-43fa-b7df-2dc37237267f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:49.942891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1ffc8711-9c9e-43fa-b7df-2dc37237267f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:49.943528 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1ffc8711-9c9e-43fa-b7df-2dc37237267f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:49.944492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1ffc8711-9c9e-43fa-b7df-2dc37237267f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:49.945404 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1ffc8711-9c9e-43fa-b7df-2dc37237267f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:49.946034 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1ffc8711-9c9e-43fa-b7df-2dc37237267f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:50.245107 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1ffc8711-9c9e-43fa-b7df-2dc37237267f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:50.258056 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1ffc8711-9c9e-43fa-b7df-2dc37237267f tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1511 microversion: 2.1 time: 0.330829 Oct 05 03:02:50.258858 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2959/5944] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:49 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1511 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:51.311909 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e96b5712-266d-43b6-9385-e79411c3f082 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:51.312669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e96b5712-266d-43b6-9385-e79411c3f082 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:51.326344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e96b5712-266d-43b6-9385-e79411c3f082 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:51.326847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e96b5712-266d-43b6-9385-e79411c3f082 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:51.327603 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e96b5712-266d-43b6-9385-e79411c3f082 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:51.328513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e96b5712-266d-43b6-9385-e79411c3f082 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:51.329020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e96b5712-266d-43b6-9385-e79411c3f082 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:51.329436 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e96b5712-266d-43b6-9385-e79411c3f082 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:51.573366 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e96b5712-266d-43b6-9385-e79411c3f082 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:51.583451 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e96b5712-266d-43b6-9385-e79411c3f082 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1511 microversion: 2.1 time: 0.275452 Oct 05 03:02:51.597762 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2986/5945] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:51 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1511 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:52.608036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8494946a-26aa-429d-860f-b1f40d88a80d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:52.608649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8494946a-26aa-429d-860f-b1f40d88a80d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:52.616219 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8494946a-26aa-429d-860f-b1f40d88a80d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:52.616724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8494946a-26aa-429d-860f-b1f40d88a80d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:52.617194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8494946a-26aa-429d-860f-b1f40d88a80d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:52.617909 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8494946a-26aa-429d-860f-b1f40d88a80d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:52.618370 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8494946a-26aa-429d-860f-b1f40d88a80d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:52.618798 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8494946a-26aa-429d-860f-b1f40d88a80d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:52.794856 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8494946a-26aa-429d-860f-b1f40d88a80d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:52.804832 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8494946a-26aa-429d-860f-b1f40d88a80d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1511 microversion: 2.1 time: 0.201124 Oct 05 03:02:52.817616 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2960/5946] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:52 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1511 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:53.596537 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0e662427-2baf-4f64-ac02-73841f5e66bf tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Action: 'create', calling method: .version_select at 0x7fccdfc50dc0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1302824976", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCo2RBhsexLzseurK4UeaXsOduNa+V88NFXVuAm7h4TpDw3E75UB1p2ZqNrNYt0kILCqRW2oJ6rKhFDjyJZr9vavZRp1HaNV10RrCzb+L5Q6AxguDNJcglc7g8t6vSlHuA=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:02:53.615122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-0e662427-2baf-4f64-ac02-73841f5e66bf tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Getting quotas for project feef1976405a442eb7ee441d12c9a1d9. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:02:53.623598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-0e662427-2baf-4f64-ac02-73841f5e66bf tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Getting quotas for user 329523b6f089401face7b477d08ca7d6 and project feef1976405a442eb7ee441d12c9a1d9. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:02:53.658804 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0e662427-2baf-4f64-ac02-73841f5e66bf tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.064820 Oct 05 03:02:53.676308 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2987/5947] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 03:02:53 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:02:53.830320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d5d3fdef-bec4-442c-8527-a0783a95a73a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:53.830977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d5d3fdef-bec4-442c-8527-a0783a95a73a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:53.842542 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5d3fdef-bec4-442c-8527-a0783a95a73a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:53.843058 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5d3fdef-bec4-442c-8527-a0783a95a73a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:53.843526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5d3fdef-bec4-442c-8527-a0783a95a73a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:53.844255 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5d3fdef-bec4-442c-8527-a0783a95a73a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:53.844717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5d3fdef-bec4-442c-8527-a0783a95a73a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:53.845187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5d3fdef-bec4-442c-8527-a0783a95a73a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:54.127504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d5d3fdef-bec4-442c-8527-a0783a95a73a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:54.138839 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d5d3fdef-bec4-442c-8527-a0783a95a73a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1511 microversion: 2.1 time: 0.313471 Oct 05 03:02:54.140084 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2961/5948] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:53 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1511 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:55.154561 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0ea4c10e-47fd-4ae3-90b9-9181d3167cf1 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-633040251", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3b23e6ca-9277-4ae6-9862-fd66b8ca5ef5", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1302824976", "security_groups": [{"name": "tempest-secgroup-smoke-80259649"}], "networks": [{"uuid": "853d6714-af1d-4edf-88f5-2445c56dc272"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:02:55.165207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-096a9af9-4fa3-48d5-99ec-1c14a5414fe0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:55.165903 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-096a9af9-4fa3-48d5-99ec-1c14a5414fe0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:55.186322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-096a9af9-4fa3-48d5-99ec-1c14a5414fe0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:55.190134 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-096a9af9-4fa3-48d5-99ec-1c14a5414fe0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:55.191628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-096a9af9-4fa3-48d5-99ec-1c14a5414fe0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:55.193551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-096a9af9-4fa3-48d5-99ec-1c14a5414fe0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:55.195195 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-096a9af9-4fa3-48d5-99ec-1c14a5414fe0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:55.195776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-096a9af9-4fa3-48d5-99ec-1c14a5414fe0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:55.644799 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-0ea4c10e-47fd-4ae3-90b9-9181d3167cf1 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] validate_networks() for [('853d6714-af1d-4edf-88f5-2445c56dc272', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:02:55.693004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-096a9af9-4fa3-48d5-99ec-1c14a5414fe0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:55.706400 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-096a9af9-4fa3-48d5-99ec-1c14a5414fe0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1511 microversion: 2.1 time: 0.545259 Oct 05 03:02:55.707017 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2962/5949] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:55 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1511 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:02:56.611606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0ea4c10e-47fd-4ae3-90b9-9181d3167cf1 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:02:56.612058 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0ea4c10e-47fd-4ae3-90b9-9181d3167cf1 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:02:56.612479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0ea4c10e-47fd-4ae3-90b9-9181d3167cf1 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:02:56.612919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0ea4c10e-47fd-4ae3-90b9-9181d3167cf1 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:02:56.613616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0ea4c10e-47fd-4ae3-90b9-9181d3167cf1 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:02:56.632646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ea4c10e-47fd-4ae3-90b9-9181d3167cf1 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:56.633487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ea4c10e-47fd-4ae3-90b9-9181d3167cf1 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:56.633966 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ea4c10e-47fd-4ae3-90b9-9181d3167cf1 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:56.638773 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ea4c10e-47fd-4ae3-90b9-9181d3167cf1 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:56.639309 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ea4c10e-47fd-4ae3-90b9-9181d3167cf1 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:56.639772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ea4c10e-47fd-4ae3-90b9-9181d3167cf1 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:56.664077 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:56.702465 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-0ea4c10e-47fd-4ae3-90b9-9181d3167cf1 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Getting quotas for project feef1976405a442eb7ee441d12c9a1d9. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:02:56.718387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-0ea4c10e-47fd-4ae3-90b9-9181d3167cf1 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Getting quotas for user 329523b6f089401face7b477d08ca7d6 and project feef1976405a442eb7ee441d12c9a1d9. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:02:56.748932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-24675d6d-aea8-4f26-8f5d-32712c1f4f78 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:56.749576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-24675d6d-aea8-4f26-8f5d-32712c1f4f78 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:56.775679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24675d6d-aea8-4f26-8f5d-32712c1f4f78 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:56.776230 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24675d6d-aea8-4f26-8f5d-32712c1f4f78 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:56.776891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24675d6d-aea8-4f26-8f5d-32712c1f4f78 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:56.777778 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24675d6d-aea8-4f26-8f5d-32712c1f4f78 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:56.778315 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24675d6d-aea8-4f26-8f5d-32712c1f4f78 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:56.778741 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24675d6d-aea8-4f26-8f5d-32712c1f4f78 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:56.885183 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0ea4c10e-47fd-4ae3-90b9-9181d3167cf1 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:02:56.887831 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0ea4c10e-47fd-4ae3-90b9-9181d3167cf1 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] [instance: 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3b23e6ca-9277-4ae6-9862-fd66b8ca5ef5',volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:02:57.130749 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-24675d6d-aea8-4f26-8f5d-32712c1f4f78 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:57.142957 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-24675d6d-aea8-4f26-8f5d-32712c1f4f78 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1511 microversion: 2.1 time: 0.412954 Oct 05 03:02:57.147234 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2963/5950] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:56 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1511 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:02:57.192664 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0ea4c10e-47fd-4ae3-90b9-9181d3167cf1 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.043055 Oct 05 03:02:57.193377 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2988/5951] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:02:55 2022] POST /compute/v2.1/servers => generated 404 bytes in 2045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:02:57.210007 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-212f3f84-5f71-48aa-b5d5-3f2e711d3f73 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:57.210992 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-212f3f84-5f71-48aa-b5d5-3f2e711d3f73 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] [instance: 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:57.307077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-212f3f84-5f71-48aa-b5d5-3f2e711d3f73 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329523b6f089401face7b477d08ca7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feef1976405a442eb7ee441d12c9a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:57.324758 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-212f3f84-5f71-48aa-b5d5-3f2e711d3f73 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00" status: 200 len: 1098 microversion: 2.1 time: 0.121343 Oct 05 03:02:57.344928 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2964/5952] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:57 2022] GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 => generated 1098 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:02:57.453848 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9fd5bf89-e193-4ce9-ab27-92647973f4d5 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Action: 'create', calling method: .version_select at 0x7fccdf265820>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-878525032", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxfevfwbPIlpp7aM3vSrvU+riDGc+J761ewc3nZr/qiPGRgBYXDS4X1QcokoD5ws6LVtV5bIgepxV4h0qXFnOFACtyL6pFRjIqTTJvC6OVVXxs3dWqs6RhtsqyuGo9xHg=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:02:57.500030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-9fd5bf89-e193-4ce9-ab27-92647973f4d5 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Getting quotas for project 5152e5e306d2474bac12338a8e722a00. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:02:57.509064 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-9fd5bf89-e193-4ce9-ab27-92647973f4d5 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Getting quotas for user 67c2b26730184ce58b866e37ebe43794 and project 5152e5e306d2474bac12338a8e722a00. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:02:57.546803 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9fd5bf89-e193-4ce9-ab27-92647973f4d5 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.098274 Oct 05 03:02:57.547672 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2989/5953] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 03:02:57 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:02:58.172432 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-69bc50a4-6133-4f74-adf0-d2664681353e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:58.173070 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-69bc50a4-6133-4f74-adf0-d2664681353e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:58.200456 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69bc50a4-6133-4f74-adf0-d2664681353e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:58.204468 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69bc50a4-6133-4f74-adf0-d2664681353e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:58.205227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69bc50a4-6133-4f74-adf0-d2664681353e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:58.207753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69bc50a4-6133-4f74-adf0-d2664681353e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:58.210634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69bc50a4-6133-4f74-adf0-d2664681353e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:58.211632 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69bc50a4-6133-4f74-adf0-d2664681353e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:58.224937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:58.362528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-06712c1b-acf3-4109-bcc3-70738be71703 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:58.364008 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-06712c1b-acf3-4109-bcc3-70738be71703 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] [instance: 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:58.383141 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06712c1b-acf3-4109-bcc3-70738be71703 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:58.383596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06712c1b-acf3-4109-bcc3-70738be71703 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:58.385467 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06712c1b-acf3-4109-bcc3-70738be71703 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:58.391234 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06712c1b-acf3-4109-bcc3-70738be71703 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:58.393471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06712c1b-acf3-4109-bcc3-70738be71703 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:58.394308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06712c1b-acf3-4109-bcc3-70738be71703 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:58.639105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-06712c1b-acf3-4109-bcc3-70738be71703 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329523b6f089401face7b477d08ca7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feef1976405a442eb7ee441d12c9a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:58.644605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-69bc50a4-6133-4f74-adf0-d2664681353e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:58.661536 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-69bc50a4-6133-4f74-adf0-d2664681353e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1511 microversion: 2.1 time: 0.494327 Oct 05 03:02:58.662859 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2965/5954] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:58 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1511 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:58.667282 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-06712c1b-acf3-4109-bcc3-70738be71703 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00" status: 200 len: 1140 microversion: 2.1 time: 0.309613 Oct 05 03:02:58.669754 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2990/5955] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:58 2022] GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 => generated 1140 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:02:59.732625 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-029c2758-929f-4035-be15-2d968973f2ff tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:59.733276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-029c2758-929f-4035-be15-2d968973f2ff tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:59.735295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8264fb0d-930a-440a-a9fa-9743530b2687 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:02:59.735983 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8264fb0d-930a-440a-a9fa-9743530b2687 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] [instance: 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:02:59.750371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8264fb0d-930a-440a-a9fa-9743530b2687 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:59.750866 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8264fb0d-930a-440a-a9fa-9743530b2687 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:59.751304 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8264fb0d-930a-440a-a9fa-9743530b2687 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:59.752015 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8264fb0d-930a-440a-a9fa-9743530b2687 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:59.752470 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8264fb0d-930a-440a-a9fa-9743530b2687 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:59.752893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8264fb0d-930a-440a-a9fa-9743530b2687 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:59.755619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-029c2758-929f-4035-be15-2d968973f2ff tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:59.756115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-029c2758-929f-4035-be15-2d968973f2ff tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:59.756547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-029c2758-929f-4035-be15-2d968973f2ff tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:59.757277 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-029c2758-929f-4035-be15-2d968973f2ff tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:02:59.757726 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-029c2758-929f-4035-be15-2d968973f2ff tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:02:59.758145 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-029c2758-929f-4035-be15-2d968973f2ff tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:02:59.945564 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8264fb0d-930a-440a-a9fa-9743530b2687 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329523b6f089401face7b477d08ca7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feef1976405a442eb7ee441d12c9a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:02:59.957095 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8264fb0d-930a-440a-a9fa-9743530b2687 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00" status: 200 len: 1214 microversion: 2.1 time: 0.232180 Oct 05 03:02:59.957692 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2991/5956] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:59 2022] GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 => generated 1214 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:00.266084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-029c2758-929f-4035-be15-2d968973f2ff tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:00.274528 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-029c2758-929f-4035-be15-2d968973f2ff tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1511 microversion: 2.1 time: 0.551506 Oct 05 03:03:00.277871 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2966/5957] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:02:59 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1511 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:03:00.722892 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3848f056-8ec9-44a3-963f-99f67700b172 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1657951583", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "91105286-ea4f-40e1-b2eb-13b6d91dc649"}], "key_name": "tempest-TestNetworkBasicOps-878525032", "security_groups": [{"name": "tempest-secgroup-smoke-1584061580"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:03:00.941556 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-3848f056-8ec9-44a3-963f-99f67700b172 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] validate_networks() for [('91105286-ea4f-40e1-b2eb-13b6d91dc649', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:03:00.989173 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-58921b4b-3896-4ca1-9347-34e61b4d717a tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:00.991086 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-58921b4b-3896-4ca1-9347-34e61b4d717a tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] [instance: 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:01.020120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58921b4b-3896-4ca1-9347-34e61b4d717a tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:01.021366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58921b4b-3896-4ca1-9347-34e61b4d717a tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:01.022520 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58921b4b-3896-4ca1-9347-34e61b4d717a tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:01.024735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58921b4b-3896-4ca1-9347-34e61b4d717a tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:01.025193 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58921b4b-3896-4ca1-9347-34e61b4d717a tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:01.027308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58921b4b-3896-4ca1-9347-34e61b4d717a tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:01.510177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-58921b4b-3896-4ca1-9347-34e61b4d717a tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329523b6f089401face7b477d08ca7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feef1976405a442eb7ee441d12c9a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:01.519776 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-58921b4b-3896-4ca1-9347-34e61b4d717a tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00" status: 200 len: 1280 microversion: 2.1 time: 0.536094 Oct 05 03:03:01.530057 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2967/5958] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:00 2022] GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 => generated 1280 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:01.549544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a12745ae-a914-4a07-868a-b1be10ee4530 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:01.550498 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a12745ae-a914-4a07-868a-b1be10ee4530 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:01.575779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a12745ae-a914-4a07-868a-b1be10ee4530 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:01.577779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a12745ae-a914-4a07-868a-b1be10ee4530 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:01.587763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a12745ae-a914-4a07-868a-b1be10ee4530 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:01.591226 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a12745ae-a914-4a07-868a-b1be10ee4530 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:01.592929 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a12745ae-a914-4a07-868a-b1be10ee4530 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:01.593537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a12745ae-a914-4a07-868a-b1be10ee4530 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:02.288970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a12745ae-a914-4a07-868a-b1be10ee4530 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:02.304985 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a12745ae-a914-4a07-868a-b1be10ee4530 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1511 microversion: 2.1 time: 0.773480 Oct 05 03:03:02.305929 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2968/5959] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:01 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1511 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:02.452871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-3848f056-8ec9-44a3-963f-99f67700b172 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:03:02.453409 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-3848f056-8ec9-44a3-963f-99f67700b172 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:03:02.453900 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-3848f056-8ec9-44a3-963f-99f67700b172 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:03:02.455364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-3848f056-8ec9-44a3-963f-99f67700b172 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:03:02.455364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-3848f056-8ec9-44a3-963f-99f67700b172 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:03:02.482619 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3848f056-8ec9-44a3-963f-99f67700b172 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:02.483555 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3848f056-8ec9-44a3-963f-99f67700b172 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:02.484196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3848f056-8ec9-44a3-963f-99f67700b172 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:02.485667 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3848f056-8ec9-44a3-963f-99f67700b172 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:02.486906 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3848f056-8ec9-44a3-963f-99f67700b172 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:02.487768 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3848f056-8ec9-44a3-963f-99f67700b172 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:02.527244 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-3848f056-8ec9-44a3-963f-99f67700b172 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Getting quotas for project 5152e5e306d2474bac12338a8e722a00. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:03:02.554899 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d780e05e-9c4d-43d0-911c-79bf6b5b857e tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:02.555604 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d780e05e-9c4d-43d0-911c-79bf6b5b857e tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] [instance: 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:02.592728 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-3848f056-8ec9-44a3-963f-99f67700b172 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Getting quotas for user 67c2b26730184ce58b866e37ebe43794 and project 5152e5e306d2474bac12338a8e722a00. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:03:02.633553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d780e05e-9c4d-43d0-911c-79bf6b5b857e tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:02.637156 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d780e05e-9c4d-43d0-911c-79bf6b5b857e tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:02.638194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d780e05e-9c4d-43d0-911c-79bf6b5b857e tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:02.639140 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d780e05e-9c4d-43d0-911c-79bf6b5b857e tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:02.639919 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d780e05e-9c4d-43d0-911c-79bf6b5b857e tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:02.640632 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d780e05e-9c4d-43d0-911c-79bf6b5b857e tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:02.651284 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3848f056-8ec9-44a3-963f-99f67700b172 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:03:02.661209 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3848f056-8ec9-44a3-963f-99f67700b172 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:03:02.861148 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3848f056-8ec9-44a3-963f-99f67700b172 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.123745 Oct 05 03:03:02.861148 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2992/5960] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:03:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 2139 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:03:02.877310 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1f56b25e-1916-497b-8d44-f30fa0cdab1c tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:02.878374 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1f56b25e-1916-497b-8d44-f30fa0cdab1c tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:02.936308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d780e05e-9c4d-43d0-911c-79bf6b5b857e tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329523b6f089401face7b477d08ca7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feef1976405a442eb7ee441d12c9a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:02.953663 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d780e05e-9c4d-43d0-911c-79bf6b5b857e tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00" status: 200 len: 1280 microversion: 2.1 time: 0.403099 Oct 05 03:03:02.974384 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2969/5961] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:02 2022] GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 => generated 1280 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:03:03.023202 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1f56b25e-1916-497b-8d44-f30fa0cdab1c tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:03.037584 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1f56b25e-1916-497b-8d44-f30fa0cdab1c tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98" status: 200 len: 1248 microversion: 2.1 time: 0.172009 Oct 05 03:03:03.039209 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2993/5962] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:02 2022] GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98 => generated 1248 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:03.165161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-3d86c377-f31c-4e24-a4d9-0863ed7d2fb2 req-a2009372-6f99-4a49-b2ce-9a6c5f219ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb16ac5-263b-4180-b36f-ca3a9c7a7e00", "tag": "2f992c30-d1e1-4034-a6a6-792e3ba1ffe1"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:03:03.178743 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3d86c377-f31c-4e24-a4d9-0863ed7d2fb2 req-a2009372-6f99-4a49-b2ce-9a6c5f219ff7 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:03.179230 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3d86c377-f31c-4e24-a4d9-0863ed7d2fb2 req-a2009372-6f99-4a49-b2ce-9a6c5f219ff7 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:03.179877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3d86c377-f31c-4e24-a4d9-0863ed7d2fb2 req-a2009372-6f99-4a49-b2ce-9a6c5f219ff7 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:03.224700 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-3d86c377-f31c-4e24-a4d9-0863ed7d2fb2 req-a2009372-6f99-4a49-b2ce-9a6c5f219ff7 service nova] Creating event network-changed:2f992c30-d1e1-4034-a6a6-792e3ba1ffe1 for instance 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 on n-h2-858272-3 Oct 05 03:03:03.240924 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-3d86c377-f31c-4e24-a4d9-0863ed7d2fb2 req-a2009372-6f99-4a49-b2ce-9a6c5f219ff7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081780 Oct 05 03:03:03.243754 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2970/5963] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:03:03.335913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-60408a2e-497f-4b08-b935-50124d4af750 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:03.336704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-60408a2e-497f-4b08-b935-50124d4af750 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:03.347426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60408a2e-497f-4b08-b935-50124d4af750 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:03.348166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60408a2e-497f-4b08-b935-50124d4af750 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:03.348831 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60408a2e-497f-4b08-b935-50124d4af750 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:03.350038 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60408a2e-497f-4b08-b935-50124d4af750 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:03.350708 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60408a2e-497f-4b08-b935-50124d4af750 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:03.373321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60408a2e-497f-4b08-b935-50124d4af750 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:03.774701 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-60408a2e-497f-4b08-b935-50124d4af750 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:03.792537 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-60408a2e-497f-4b08-b935-50124d4af750 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1511 microversion: 2.1 time: 0.463841 Oct 05 03:03:03.819696 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2994/5964] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:03 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1511 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:03.993100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2b606a51-ad97-4450-a54e-d69c2b2a62d4 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:03.995321 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2b606a51-ad97-4450-a54e-d69c2b2a62d4 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] [instance: 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:04.026847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b606a51-ad97-4450-a54e-d69c2b2a62d4 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:04.029994 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b606a51-ad97-4450-a54e-d69c2b2a62d4 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:04.031871 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b606a51-ad97-4450-a54e-d69c2b2a62d4 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:04.034086 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b606a51-ad97-4450-a54e-d69c2b2a62d4 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:04.035785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b606a51-ad97-4450-a54e-d69c2b2a62d4 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:04.042322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b606a51-ad97-4450-a54e-d69c2b2a62d4 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:04.065739 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7d192f9d-e763-4c4e-a445-251793b9fc36 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:04.070836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7d192f9d-e763-4c4e-a445-251793b9fc36 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:04.084663 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d192f9d-e763-4c4e-a445-251793b9fc36 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:04.086381 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d192f9d-e763-4c4e-a445-251793b9fc36 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:04.088159 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d192f9d-e763-4c4e-a445-251793b9fc36 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:04.089833 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d192f9d-e763-4c4e-a445-251793b9fc36 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:04.090669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d192f9d-e763-4c4e-a445-251793b9fc36 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:04.091246 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d192f9d-e763-4c4e-a445-251793b9fc36 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:04.279962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7d192f9d-e763-4c4e-a445-251793b9fc36 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:04.290757 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7d192f9d-e763-4c4e-a445-251793b9fc36 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98" status: 200 len: 1252 microversion: 2.1 time: 0.228169 Oct 05 03:03:04.292368 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2995/5965] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:04 2022] GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98 => generated 1252 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:03:04.633615 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2b606a51-ad97-4450-a54e-d69c2b2a62d4 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329523b6f089401face7b477d08ca7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feef1976405a442eb7ee441d12c9a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:04.695210 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2b606a51-ad97-4450-a54e-d69c2b2a62d4 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00" status: 200 len: 1280 microversion: 2.1 time: 0.703650 Oct 05 03:03:04.706589 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2971/5966] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:03 2022] GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 => generated 1280 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:04.833455 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1b919b5a-bb65-45c1-a3ef-0b31e59400fb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:04.834741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1b919b5a-bb65-45c1-a3ef-0b31e59400fb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:04.852692 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b919b5a-bb65-45c1-a3ef-0b31e59400fb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:04.853363 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b919b5a-bb65-45c1-a3ef-0b31e59400fb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:04.854068 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b919b5a-bb65-45c1-a3ef-0b31e59400fb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:04.854994 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b919b5a-bb65-45c1-a3ef-0b31e59400fb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:04.855662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b919b5a-bb65-45c1-a3ef-0b31e59400fb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:04.856513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b919b5a-bb65-45c1-a3ef-0b31e59400fb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:05.327509 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4da6aaa0-4f29-4e7e-b3cd-4388b5c754c0 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:05.328736 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4da6aaa0-4f29-4e7e-b3cd-4388b5c754c0 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:05.334357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=44 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:05.342473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4da6aaa0-4f29-4e7e-b3cd-4388b5c754c0 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:05.347719 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4da6aaa0-4f29-4e7e-b3cd-4388b5c754c0 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:05.351946 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4da6aaa0-4f29-4e7e-b3cd-4388b5c754c0 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:05.352937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4da6aaa0-4f29-4e7e-b3cd-4388b5c754c0 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:05.358039 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4da6aaa0-4f29-4e7e-b3cd-4388b5c754c0 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:05.358792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4da6aaa0-4f29-4e7e-b3cd-4388b5c754c0 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:05.580755 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4da6aaa0-4f29-4e7e-b3cd-4388b5c754c0 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:05.610972 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4da6aaa0-4f29-4e7e-b3cd-4388b5c754c0 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98" status: 200 len: 1318 microversion: 2.1 time: 0.287601 Oct 05 03:03:05.617103 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2972/5967] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:05 2022] GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98 => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:03:05.642878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1b919b5a-bb65-45c1-a3ef-0b31e59400fb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:05.659838 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1b919b5a-bb65-45c1-a3ef-0b31e59400fb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1511 microversion: 2.1 time: 0.824283 Oct 05 03:03:05.660722 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2996/5968] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:04 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1511 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:05.739430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-96420dba-8f79-4158-bab6-ef47dab293e6 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:05.741149 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-96420dba-8f79-4158-bab6-ef47dab293e6 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] [instance: 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:05.765252 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96420dba-8f79-4158-bab6-ef47dab293e6 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:05.773953 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96420dba-8f79-4158-bab6-ef47dab293e6 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:05.774714 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96420dba-8f79-4158-bab6-ef47dab293e6 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:05.787191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96420dba-8f79-4158-bab6-ef47dab293e6 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:05.792204 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96420dba-8f79-4158-bab6-ef47dab293e6 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:05.796125 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96420dba-8f79-4158-bab6-ef47dab293e6 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:06.193805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-96420dba-8f79-4158-bab6-ef47dab293e6 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329523b6f089401face7b477d08ca7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feef1976405a442eb7ee441d12c9a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:06.205116 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-96420dba-8f79-4158-bab6-ef47dab293e6 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00" status: 200 len: 1280 microversion: 2.1 time: 0.470103 Oct 05 03:03:06.207216 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2973/5969] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:05 2022] GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 => generated 1280 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:06.660566 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2c394aad-bb3a-4590-baef-5a3818f63f33 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:06.662105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2c394aad-bb3a-4590-baef-5a3818f63f33 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:06.685095 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-11782b4e-619b-4709-a04a-ebf658be4626 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:06.686297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-11782b4e-619b-4709-a04a-ebf658be4626 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:06.697174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11782b4e-619b-4709-a04a-ebf658be4626 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:06.697710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c394aad-bb3a-4590-baef-5a3818f63f33 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:06.698435 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c394aad-bb3a-4590-baef-5a3818f63f33 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:06.699146 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c394aad-bb3a-4590-baef-5a3818f63f33 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:06.701247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c394aad-bb3a-4590-baef-5a3818f63f33 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:06.701965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c394aad-bb3a-4590-baef-5a3818f63f33 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:06.703958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c394aad-bb3a-4590-baef-5a3818f63f33 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:06.724447 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11782b4e-619b-4709-a04a-ebf658be4626 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:06.724928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11782b4e-619b-4709-a04a-ebf658be4626 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:06.726452 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11782b4e-619b-4709-a04a-ebf658be4626 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:06.726452 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11782b4e-619b-4709-a04a-ebf658be4626 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:06.726642 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11782b4e-619b-4709-a04a-ebf658be4626 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:06.839046 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2c394aad-bb3a-4590-baef-5a3818f63f33 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:06.848276 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2c394aad-bb3a-4590-baef-5a3818f63f33 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98" status: 200 len: 1306 microversion: 2.1 time: 0.191405 Oct 05 03:03:06.849522 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2997/5970] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:06 2022] GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98 => generated 1306 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:07.233047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ac189f39-bb97-4676-bb56-f9dbecd12c04 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:07.234009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ac189f39-bb97-4676-bb56-f9dbecd12c04 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] [instance: 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:07.253114 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=8 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:07.255408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac189f39-bb97-4676-bb56-f9dbecd12c04 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:07.256135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac189f39-bb97-4676-bb56-f9dbecd12c04 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:07.256793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac189f39-bb97-4676-bb56-f9dbecd12c04 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:07.257817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac189f39-bb97-4676-bb56-f9dbecd12c04 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:07.258501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac189f39-bb97-4676-bb56-f9dbecd12c04 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:07.262947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac189f39-bb97-4676-bb56-f9dbecd12c04 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:07.323814 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:07.490161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-11782b4e-619b-4709-a04a-ebf658be4626 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:07.502384 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-11782b4e-619b-4709-a04a-ebf658be4626 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1488 microversion: 2.1 time: 0.822206 Oct 05 03:03:07.503219 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2974/5971] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:06 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1488 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:03:07.537098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6ed638fe-36d4-4557-b819-1c2098d95690 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-803889516"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:03:07.540028 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6ed638fe-36d4-4557-b819-1c2098d95690 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:07.555079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ed638fe-36d4-4557-b819-1c2098d95690 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:07.555596 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ed638fe-36d4-4557-b819-1c2098d95690 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:07.556043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ed638fe-36d4-4557-b819-1c2098d95690 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:07.557900 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ed638fe-36d4-4557-b819-1c2098d95690 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:07.558057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ed638fe-36d4-4557-b819-1c2098d95690 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:07.558405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ed638fe-36d4-4557-b819-1c2098d95690 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:07.763178 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6ed638fe-36d4-4557-b819-1c2098d95690 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "PUT /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1061 microversion: 2.1 time: 0.226609 Oct 05 03:03:07.777134 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2975/5972] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Oct 5 03:03:07 2022] PUT /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1061 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:03:07.794646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ac189f39-bb97-4676-bb56-f9dbecd12c04 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329523b6f089401face7b477d08ca7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feef1976405a442eb7ee441d12c9a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:07.795505 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fe17c5fc-7640-49f7-8843-5d4f963e94f0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:07.796637 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fe17c5fc-7640-49f7-8843-5d4f963e94f0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:07.805352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe17c5fc-7640-49f7-8843-5d4f963e94f0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:07.807593 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe17c5fc-7640-49f7-8843-5d4f963e94f0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:07.808306 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe17c5fc-7640-49f7-8843-5d4f963e94f0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:07.809381 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe17c5fc-7640-49f7-8843-5d4f963e94f0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:07.810186 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe17c5fc-7640-49f7-8843-5d4f963e94f0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:07.810766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe17c5fc-7640-49f7-8843-5d4f963e94f0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:07.812975 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ac189f39-bb97-4676-bb56-f9dbecd12c04 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00" status: 200 len: 1280 microversion: 2.1 time: 0.585159 Oct 05 03:03:07.826204 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2998/5973] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:07 2022] GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 => generated 1280 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:07.872990 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5c8facfd-1c97-40e2-ae83-4eba0fb90a7c tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:07.873770 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5c8facfd-1c97-40e2-ae83-4eba0fb90a7c tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:07.885973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c8facfd-1c97-40e2-ae83-4eba0fb90a7c tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:07.887567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c8facfd-1c97-40e2-ae83-4eba0fb90a7c tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:07.888260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c8facfd-1c97-40e2-ae83-4eba0fb90a7c tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:07.890090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c8facfd-1c97-40e2-ae83-4eba0fb90a7c tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:07.892057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c8facfd-1c97-40e2-ae83-4eba0fb90a7c tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:07.895180 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c8facfd-1c97-40e2-ae83-4eba0fb90a7c tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:08.613722 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fe17c5fc-7640-49f7-8843-5d4f963e94f0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:08.639718 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fe17c5fc-7640-49f7-8843-5d4f963e94f0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1488 microversion: 2.1 time: 0.850207 Oct 05 03:03:08.640640 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2976/5974] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:07 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1488 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:08.678431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e4895eac-48bd-4b40-bfc6-a709facfef16 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:08.679841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e4895eac-48bd-4b40-bfc6-a709facfef16 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:08.696489 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4895eac-48bd-4b40-bfc6-a709facfef16 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:08.697597 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4895eac-48bd-4b40-bfc6-a709facfef16 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:08.698306 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4895eac-48bd-4b40-bfc6-a709facfef16 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:08.699166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4895eac-48bd-4b40-bfc6-a709facfef16 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:08.699779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4895eac-48bd-4b40-bfc6-a709facfef16 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:08.700387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4895eac-48bd-4b40-bfc6-a709facfef16 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:08.819794 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5c8facfd-1c97-40e2-ae83-4eba0fb90a7c tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:08.828928 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5c8facfd-1c97-40e2-ae83-4eba0fb90a7c tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98" status: 200 len: 1374 microversion: 2.1 time: 0.961028 Oct 05 03:03:08.838198 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 2999/5975] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:07 2022] GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98 => generated 1374 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:08.854097 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b3f423df-c148-4ff3-8bf4-c840e693aa53 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:08.856831 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b3f423df-c148-4ff3-8bf4-c840e693aa53 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] [instance: 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:08.871399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3f423df-c148-4ff3-8bf4-c840e693aa53 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:08.874198 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3f423df-c148-4ff3-8bf4-c840e693aa53 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:08.876273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3f423df-c148-4ff3-8bf4-c840e693aa53 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:08.878600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3f423df-c148-4ff3-8bf4-c840e693aa53 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:08.879318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3f423df-c148-4ff3-8bf4-c840e693aa53 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:08.882316 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3f423df-c148-4ff3-8bf4-c840e693aa53 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:09.041739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e4895eac-48bd-4b40-bfc6-a709facfef16 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:09.049764 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e4895eac-48bd-4b40-bfc6-a709facfef16 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1488 microversion: 2.1 time: 0.375075 Oct 05 03:03:09.050347 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2977/5976] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:08 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1488 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:03:09.079021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-667cc5d2-1a7e-4334-af81-c6da23406de4 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:09.079633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-667cc5d2-1a7e-4334-af81-c6da23406de4 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:09.101464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-667cc5d2-1a7e-4334-af81-c6da23406de4 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:09.102072 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-667cc5d2-1a7e-4334-af81-c6da23406de4 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:09.102589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-667cc5d2-1a7e-4334-af81-c6da23406de4 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:09.104063 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-667cc5d2-1a7e-4334-af81-c6da23406de4 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:09.110502 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-667cc5d2-1a7e-4334-af81-c6da23406de4 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:09.111055 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-667cc5d2-1a7e-4334-af81-c6da23406de4 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:09.194677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-667cc5d2-1a7e-4334-af81-c6da23406de4 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:03:09.442920 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-667cc5d2-1a7e-4334-af81-c6da23406de4 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "DELETE /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 204 len: 0 microversion: 2.1 time: 0.369098 Oct 05 03:03:09.443907 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2978/5977] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:03:09 2022] DELETE /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:03:09.453714 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-857ec9ec-cb55-4bf1-92be-2490429071db tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:09.454862 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-857ec9ec-cb55-4bf1-92be-2490429071db tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:09.467071 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-857ec9ec-cb55-4bf1-92be-2490429071db tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:09.467791 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-857ec9ec-cb55-4bf1-92be-2490429071db tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:09.468382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-857ec9ec-cb55-4bf1-92be-2490429071db tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:09.469268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-857ec9ec-cb55-4bf1-92be-2490429071db tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:09.469895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-857ec9ec-cb55-4bf1-92be-2490429071db tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:09.474094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-857ec9ec-cb55-4bf1-92be-2490429071db tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:09.590876 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b3f423df-c148-4ff3-8bf4-c840e693aa53 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329523b6f089401face7b477d08ca7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feef1976405a442eb7ee441d12c9a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:09.614946 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b3f423df-c148-4ff3-8bf4-c840e693aa53 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00" status: 200 len: 1280 microversion: 2.1 time: 0.767155 Oct 05 03:03:09.615747 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3000/5978] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:08 2022] GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 => generated 1280 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:03:09.803133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-857ec9ec-cb55-4bf1-92be-2490429071db tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:09.812767 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-857ec9ec-cb55-4bf1-92be-2490429071db tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1494 microversion: 2.1 time: 0.363498 Oct 05 03:03:09.816614 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2979/5979] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:09 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1494 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:03:09.864726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-44968542-7396-442d-ac48-b3a9569b6676 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:09.865976 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-44968542-7396-442d-ac48-b3a9569b6676 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:09.876984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44968542-7396-442d-ac48-b3a9569b6676 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:09.880093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44968542-7396-442d-ac48-b3a9569b6676 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:09.882190 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44968542-7396-442d-ac48-b3a9569b6676 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:09.883105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44968542-7396-442d-ac48-b3a9569b6676 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:09.885793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44968542-7396-442d-ac48-b3a9569b6676 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:09.886393 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44968542-7396-442d-ac48-b3a9569b6676 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:10.241876 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-44968542-7396-442d-ac48-b3a9569b6676 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:10.259351 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-44968542-7396-442d-ac48-b3a9569b6676 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98" status: 200 len: 1374 microversion: 2.1 time: 0.398665 Oct 05 03:03:10.260516 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3001/5980] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:09 2022] GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98 => generated 1374 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:10.661494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d5a4ac33-38db-4334-97d7-17dff8c809f2 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:10.673576 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d5a4ac33-38db-4334-97d7-17dff8c809f2 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] [instance: 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:10.705710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5a4ac33-38db-4334-97d7-17dff8c809f2 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:10.714653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5a4ac33-38db-4334-97d7-17dff8c809f2 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:10.719257 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5a4ac33-38db-4334-97d7-17dff8c809f2 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:10.744711 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-3d2cf23a-763a-4ef7-8a5e-16fb81cd9f9f req-2f2118b5-3650-4724-b48e-23bf4b931cbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98", "tag": "fd341ff3-1d1b-4802-b759-1caf9f208c09"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:03:10.752725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5a4ac33-38db-4334-97d7-17dff8c809f2 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:10.757663 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5a4ac33-38db-4334-97d7-17dff8c809f2 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:10.762044 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5a4ac33-38db-4334-97d7-17dff8c809f2 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:10.846774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3d2cf23a-763a-4ef7-8a5e-16fb81cd9f9f req-2f2118b5-3650-4724-b48e-23bf4b931cbe service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:10.847269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3d2cf23a-763a-4ef7-8a5e-16fb81cd9f9f req-2f2118b5-3650-4724-b48e-23bf4b931cbe service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:10.847716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3d2cf23a-763a-4ef7-8a5e-16fb81cd9f9f req-2f2118b5-3650-4724-b48e-23bf4b931cbe service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:10.852356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:10.892163 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-3d2cf23a-763a-4ef7-8a5e-16fb81cd9f9f req-2f2118b5-3650-4724-b48e-23bf4b931cbe service nova] Creating event network-changed:fd341ff3-1d1b-4802-b759-1caf9f208c09 for instance ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98 on n-h2-858272-3 Oct 05 03:03:10.913988 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-3d2cf23a-763a-4ef7-8a5e-16fb81cd9f9f req-2f2118b5-3650-4724-b48e-23bf4b931cbe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.558344 Oct 05 03:03:10.916786 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2980/5981] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:03:10.928711 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-04bee104-1d10-4ca8-8efd-27919c2eafae tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:10.929490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-04bee104-1d10-4ca8-8efd-27919c2eafae tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:10.943072 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04bee104-1d10-4ca8-8efd-27919c2eafae tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:10.943692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04bee104-1d10-4ca8-8efd-27919c2eafae tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:10.950746 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04bee104-1d10-4ca8-8efd-27919c2eafae tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:10.952075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04bee104-1d10-4ca8-8efd-27919c2eafae tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:10.952577 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04bee104-1d10-4ca8-8efd-27919c2eafae tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:10.953048 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04bee104-1d10-4ca8-8efd-27919c2eafae tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:11.520791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d5a4ac33-38db-4334-97d7-17dff8c809f2 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329523b6f089401face7b477d08ca7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feef1976405a442eb7ee441d12c9a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:11.536954 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d5a4ac33-38db-4334-97d7-17dff8c809f2 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00" status: 200 len: 1280 microversion: 2.1 time: 0.891153 Oct 05 03:03:11.537816 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3002/5982] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:10 2022] GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 => generated 1280 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:03:11.561051 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-58ba07d7-5c6b-4fd3-b682-82beab5444c1 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:11.562002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-58ba07d7-5c6b-4fd3-b682-82beab5444c1 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:11.569522 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58ba07d7-5c6b-4fd3-b682-82beab5444c1 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:11.570344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58ba07d7-5c6b-4fd3-b682-82beab5444c1 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:11.571147 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58ba07d7-5c6b-4fd3-b682-82beab5444c1 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:11.572687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58ba07d7-5c6b-4fd3-b682-82beab5444c1 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:11.573530 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58ba07d7-5c6b-4fd3-b682-82beab5444c1 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:11.574225 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58ba07d7-5c6b-4fd3-b682-82beab5444c1 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:11.623869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-04bee104-1d10-4ca8-8efd-27919c2eafae tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:11.637789 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-04bee104-1d10-4ca8-8efd-27919c2eafae tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1494 microversion: 2.1 time: 0.716349 Oct 05 03:03:11.643415 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2981/5983] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:10 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1494 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:11.862912 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-58ba07d7-5c6b-4fd3-b682-82beab5444c1 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:11.875572 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-58ba07d7-5c6b-4fd3-b682-82beab5444c1 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98" status: 200 len: 1374 microversion: 2.1 time: 0.324099 Oct 05 03:03:11.877960 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3003/5984] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:11 2022] GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98 => generated 1374 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:12.568861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-60413aea-56b9-4b0a-b14c-0c2678bf3ff4 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:12.569553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-60413aea-56b9-4b0a-b14c-0c2678bf3ff4 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] [instance: 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:12.585831 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60413aea-56b9-4b0a-b14c-0c2678bf3ff4 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:12.586368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60413aea-56b9-4b0a-b14c-0c2678bf3ff4 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:12.586808 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60413aea-56b9-4b0a-b14c-0c2678bf3ff4 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:12.587563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60413aea-56b9-4b0a-b14c-0c2678bf3ff4 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:12.588021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60413aea-56b9-4b0a-b14c-0c2678bf3ff4 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:12.588436 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60413aea-56b9-4b0a-b14c-0c2678bf3ff4 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:12.674207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-970ba51e-2d6e-4c04-a00b-7a3061645a94 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:12.674837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-970ba51e-2d6e-4c04-a00b-7a3061645a94 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:12.682110 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=4 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:12.701275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-970ba51e-2d6e-4c04-a00b-7a3061645a94 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:12.703754 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-970ba51e-2d6e-4c04-a00b-7a3061645a94 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:12.704196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-970ba51e-2d6e-4c04-a00b-7a3061645a94 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:12.704930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-970ba51e-2d6e-4c04-a00b-7a3061645a94 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:12.705420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-970ba51e-2d6e-4c04-a00b-7a3061645a94 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:12.705843 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-970ba51e-2d6e-4c04-a00b-7a3061645a94 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:12.812491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-60413aea-56b9-4b0a-b14c-0c2678bf3ff4 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329523b6f089401face7b477d08ca7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feef1976405a442eb7ee441d12c9a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:12.821016 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-60413aea-56b9-4b0a-b14c-0c2678bf3ff4 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00" status: 200 len: 1268 microversion: 2.1 time: 0.258051 Oct 05 03:03:12.823050 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2982/5985] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:12 2022] GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 => generated 1268 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:12.843894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-970ba51e-2d6e-4c04-a00b-7a3061645a94 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:12.844612 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-970ba51e-2d6e-4c04-a00b-7a3061645a94 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:12.845251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-970ba51e-2d6e-4c04-a00b-7a3061645a94 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:12.845876 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-970ba51e-2d6e-4c04-a00b-7a3061645a94 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lazy-loading 'fault' on Instance uuid 23f0cd1f-4da6-484e-98d9-ede9fb143a0f {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:03:12.906051 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-970ba51e-2d6e-4c04-a00b-7a3061645a94 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:12.919392 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-25021eed-fdd4-4b66-aae0-13513345f826 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:12.920165 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-25021eed-fdd4-4b66-aae0-13513345f826 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:12.931844 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25021eed-fdd4-4b66-aae0-13513345f826 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:12.932359 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25021eed-fdd4-4b66-aae0-13513345f826 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:12.932803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25021eed-fdd4-4b66-aae0-13513345f826 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:12.933552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25021eed-fdd4-4b66-aae0-13513345f826 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:12.934277 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25021eed-fdd4-4b66-aae0-13513345f826 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:12.935389 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25021eed-fdd4-4b66-aae0-13513345f826 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:12.945892 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-970ba51e-2d6e-4c04-a00b-7a3061645a94 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 200 len: 1309 microversion: 2.1 time: 0.278538 Oct 05 03:03:12.954438 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3004/5986] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:12 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 1309 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:03:12.961261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-569b73ed-5df9-473e-a0df-6f3ab59b80a5 req-51806fcb-9ef7-4859-84e0-47dabdb4002f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f0cd1f-4da6-484e-98d9-ede9fb143a0f", "name": "network-vif-deleted", "tag": "796f8563-6c42-4852-9e8c-a18e878c7a47"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:03:12.975245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-569b73ed-5df9-473e-a0df-6f3ab59b80a5 req-51806fcb-9ef7-4859-84e0-47dabdb4002f service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:12.976373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-569b73ed-5df9-473e-a0df-6f3ab59b80a5 req-51806fcb-9ef7-4859-84e0-47dabdb4002f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:12.981056 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-569b73ed-5df9-473e-a0df-6f3ab59b80a5 req-51806fcb-9ef7-4859-84e0-47dabdb4002f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:13.036060 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-569b73ed-5df9-473e-a0df-6f3ab59b80a5 req-51806fcb-9ef7-4859-84e0-47dabdb4002f service nova] Creating event network-vif-deleted:796f8563-6c42-4852-9e8c-a18e878c7a47 for instance 23f0cd1f-4da6-484e-98d9-ede9fb143a0f on n-h1-858272-3 Oct 05 03:03:13.052922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=22 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:13.066588 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-569b73ed-5df9-473e-a0df-6f3ab59b80a5 req-51806fcb-9ef7-4859-84e0-47dabdb4002f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110249 Oct 05 03:03:13.078213 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3005/5987] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:03:13.191747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-25021eed-fdd4-4b66-aae0-13513345f826 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:13.205809 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-25021eed-fdd4-4b66-aae0-13513345f826 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98" status: 200 len: 1374 microversion: 2.1 time: 0.291272 Oct 05 03:03:13.223705 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2983/5988] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:12 2022] GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98 => generated 1374 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:13.858966 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-67bde08f-b5f1-4f27-9fb2-d5808807b917 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:13.859949 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-67bde08f-b5f1-4f27-9fb2-d5808807b917 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] [instance: 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:13.872077 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-67bde08f-b5f1-4f27-9fb2-d5808807b917 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:13.872773 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-67bde08f-b5f1-4f27-9fb2-d5808807b917 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:13.873390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-67bde08f-b5f1-4f27-9fb2-d5808807b917 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:13.874295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-67bde08f-b5f1-4f27-9fb2-d5808807b917 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:13.874758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-67bde08f-b5f1-4f27-9fb2-d5808807b917 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:13.875233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-67bde08f-b5f1-4f27-9fb2-d5808807b917 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:13.976087 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ebb0952b-9a20-4821-a76a-7a5c10b81374 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:13.976650 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ebb0952b-9a20-4821-a76a-7a5c10b81374 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:13.991113 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ebb0952b-9a20-4821-a76a-7a5c10b81374 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:13.991620 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ebb0952b-9a20-4821-a76a-7a5c10b81374 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:13.992063 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ebb0952b-9a20-4821-a76a-7a5c10b81374 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:13.992780 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ebb0952b-9a20-4821-a76a-7a5c10b81374 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:13.993281 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ebb0952b-9a20-4821-a76a-7a5c10b81374 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:13.993756 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ebb0952b-9a20-4821-a76a-7a5c10b81374 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:14.027126 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-ebb0952b-9a20-4821-a76a-7a5c10b81374 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] HTTP exception thrown: Instance 23f0cd1f-4da6-484e-98d9-ede9fb143a0f could not be found. Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ebb0952b-9a20-4821-a76a-7a5c10b81374 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Request method failure captured: Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f HTTP/1.1 Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPMRSX2gjlikFUspC1UWD3LpY1ceHV7QevQM_Ijag9QQ0seWSmWQwasVLfA-3qPo60WBeSjn_ysZhLr4smwuTcgmq5PXaeLA0zkzWirUA1z0qMp7vToCduQRast94phmM-CNx-XY-K9McRIC58Qrl_qL_n7FYacRtEkL0ls1cybFzQg Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f477959bd24b4db881b62dab54861aa5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersTestJSON-1099213797-project Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 12d0128e850f4f22a2172800c44074a4 Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersTestJSON-1099213797-project Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 23f0cd1f-4da6-484e-98d9-ede9fb143a0f could not be found. Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '23f0cd1f-4da6-484e-98d9-ede9fb143a0f'} Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23f0cd1f-4da6-484e-98d9-ede9fb143a0f could not be found. Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23f0cd1f-4da6-484e-98d9-ede9fb143a0f could not be found. Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:03:14.029292 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.032883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.032883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:03:14.032883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:03:14.032883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:03:14.032883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:03:14.032883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23f0cd1f-4da6-484e-98d9-ede9fb143a0f could not be found. Oct 05 03:03:14.032883 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.035126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ebb0952b-9a20-4821-a76a-7a5c10b81374 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Returning 404 to user: Instance 23f0cd1f-4da6-484e-98d9-ede9fb143a0f could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:03:14.036646 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ebb0952b-9a20-4821-a76a-7a5c10b81374 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 404 len: 111 microversion: 2.1 time: 0.064265 Oct 05 03:03:14.037873 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2984/5989] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:13 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:03:14.053423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0bf27eaa-18e5-4894-89f0-43c0262453a3 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:14.054089 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0bf27eaa-18e5-4894-89f0-43c0262453a3 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:14.060289 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0bf27eaa-18e5-4894-89f0-43c0262453a3 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:14.060783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0bf27eaa-18e5-4894-89f0-43c0262453a3 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:14.061247 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0bf27eaa-18e5-4894-89f0-43c0262453a3 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:14.061942 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0bf27eaa-18e5-4894-89f0-43c0262453a3 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:14.062396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0bf27eaa-18e5-4894-89f0-43c0262453a3 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:14.062814 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0bf27eaa-18e5-4894-89f0-43c0262453a3 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:14.073272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-67bde08f-b5f1-4f27-9fb2-d5808807b917 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329523b6f089401face7b477d08ca7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feef1976405a442eb7ee441d12c9a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:14.085302 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-67bde08f-b5f1-4f27-9fb2-d5808807b917 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00" status: 200 len: 1268 microversion: 2.1 time: 0.234311 Oct 05 03:03:14.097537 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3006/5990] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:13 2022] GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 => generated 1268 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:14.100416 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-0bf27eaa-18e5-4894-89f0-43c0262453a3 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] HTTP exception thrown: Instance 23f0cd1f-4da6-484e-98d9-ede9fb143a0f could not be found. Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0bf27eaa-18e5-4894-89f0-43c0262453a3 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Request method failure captured: Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f HTTP/1.1 Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPMRSX2gjlikFUspC1UWD3LpY1ceHV7QevQM_Ijag9QQ0seWSmWQwasVLfA-3qPo60WBeSjn_ysZhLr4smwuTcgmq5PXaeLA0zkzWirUA1z0qMp7vToCduQRast94phmM-CNx-XY-K9McRIC58Qrl_qL_n7FYacRtEkL0ls1cybFzQg Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f477959bd24b4db881b62dab54861aa5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersTestJSON-1099213797-project Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 12d0128e850f4f22a2172800c44074a4 Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersTestJSON-1099213797-project Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 23f0cd1f-4da6-484e-98d9-ede9fb143a0f could not be found. Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '23f0cd1f-4da6-484e-98d9-ede9fb143a0f'} Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23f0cd1f-4da6-484e-98d9-ede9fb143a0f could not be found. Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:03:14.102008 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23f0cd1f-4da6-484e-98d9-ede9fb143a0f could not be found. Oct 05 03:03:14.106247 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.106247 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:03:14.106247 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.106247 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.106247 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:03:14.106247 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:03:14.106247 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:03:14.106247 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:03:14.106247 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23f0cd1f-4da6-484e-98d9-ede9fb143a0f could not be found. Oct 05 03:03:14.106247 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.106247 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0bf27eaa-18e5-4894-89f0-43c0262453a3 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Returning 404 to user: Instance 23f0cd1f-4da6-484e-98d9-ede9fb143a0f could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:03:14.106981 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0bf27eaa-18e5-4894-89f0-43c0262453a3 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "DELETE /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 404 len: 111 microversion: 2.1 time: 0.057412 Oct 05 03:03:14.109759 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2985/5991] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:03:14 2022] DELETE /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:03:14.117336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-69c7fc9f-0079-4e16-98d7-73a6d0c91e16 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:14.118181 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-69c7fc9f-0079-4e16-98d7-73a6d0c91e16 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 23f0cd1f-4da6-484e-98d9-ede9fb143a0f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:14.125015 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69c7fc9f-0079-4e16-98d7-73a6d0c91e16 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:14.125707 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69c7fc9f-0079-4e16-98d7-73a6d0c91e16 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:14.126169 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69c7fc9f-0079-4e16-98d7-73a6d0c91e16 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:14.149098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69c7fc9f-0079-4e16-98d7-73a6d0c91e16 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:14.152325 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69c7fc9f-0079-4e16-98d7-73a6d0c91e16 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:14.157074 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69c7fc9f-0079-4e16-98d7-73a6d0c91e16 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:14.182606 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-69c7fc9f-0079-4e16-98d7-73a6d0c91e16 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] HTTP exception thrown: Instance 23f0cd1f-4da6-484e-98d9-ede9fb143a0f could not be found. Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-69c7fc9f-0079-4e16-98d7-73a6d0c91e16 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Request method failure captured: Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f HTTP/1.1 Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPMRSX2gjlikFUspC1UWD3LpY1ceHV7QevQM_Ijag9QQ0seWSmWQwasVLfA-3qPo60WBeSjn_ysZhLr4smwuTcgmq5PXaeLA0zkzWirUA1z0qMp7vToCduQRast94phmM-CNx-XY-K9McRIC58Qrl_qL_n7FYacRtEkL0ls1cybFzQg Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f477959bd24b4db881b62dab54861aa5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersTestJSON-1099213797-project Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 12d0128e850f4f22a2172800c44074a4 Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersTestJSON-1099213797-project Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 23f0cd1f-4da6-484e-98d9-ede9fb143a0f could not be found. Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '23f0cd1f-4da6-484e-98d9-ede9fb143a0f'} Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23f0cd1f-4da6-484e-98d9-ede9fb143a0f could not be found. Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23f0cd1f-4da6-484e-98d9-ede9fb143a0f could not be found. Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:03:14.185538 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.189173 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.189173 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:03:14.189173 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:03:14.189173 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:03:14.189173 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:03:14.189173 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23f0cd1f-4da6-484e-98d9-ede9fb143a0f could not be found. Oct 05 03:03:14.189173 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.189173 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-69c7fc9f-0079-4e16-98d7-73a6d0c91e16 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Returning 404 to user: Instance 23f0cd1f-4da6-484e-98d9-ede9fb143a0f could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:03:14.189173 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-69c7fc9f-0079-4e16-98d7-73a6d0c91e16 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f" status: 404 len: 111 microversion: 2.1 time: 0.074112 Oct 05 03:03:14.189173 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3007/5992] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:14 2022] GET /compute/v2.1/servers/23f0cd1f-4da6-484e-98d9-ede9fb143a0f => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:03:14.196248 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5e906bec-b0b9-42c0-9c3a-4ae50198c632 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:14.197108 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5e906bec-b0b9-42c0-9c3a-4ae50198c632 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 5a857452-5ff9-49c4-ac71-331d2a468a6f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:14.204362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e906bec-b0b9-42c0-9c3a-4ae50198c632 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:14.205139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e906bec-b0b9-42c0-9c3a-4ae50198c632 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:14.205725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e906bec-b0b9-42c0-9c3a-4ae50198c632 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:14.206890 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e906bec-b0b9-42c0-9c3a-4ae50198c632 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:14.207632 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e906bec-b0b9-42c0-9c3a-4ae50198c632 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:14.208214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e906bec-b0b9-42c0-9c3a-4ae50198c632 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:14.225345 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-5e906bec-b0b9-42c0-9c3a-4ae50198c632 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] HTTP exception thrown: Instance 5a857452-5ff9-49c4-ac71-331d2a468a6f could not be found. Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5e906bec-b0b9-42c0-9c3a-4ae50198c632 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Request method failure captured: Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f HTTP/1.1 Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPMRSX2gjlikFUspC1UWD3LpY1ceHV7QevQM_Ijag9QQ0seWSmWQwasVLfA-3qPo60WBeSjn_ysZhLr4smwuTcgmq5PXaeLA0zkzWirUA1z0qMp7vToCduQRast94phmM-CNx-XY-K9McRIC58Qrl_qL_n7FYacRtEkL0ls1cybFzQg Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f477959bd24b4db881b62dab54861aa5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersTestJSON-1099213797-project Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 12d0128e850f4f22a2172800c44074a4 Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersTestJSON-1099213797-project Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 5a857452-5ff9-49c4-ac71-331d2a468a6f could not be found. Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '5a857452-5ff9-49c4-ac71-331d2a468a6f'} Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a857452-5ff9-49c4-ac71-331d2a468a6f could not be found. Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:03:14.227371 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a857452-5ff9-49c4-ac71-331d2a468a6f could not be found. Oct 05 03:03:14.230858 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.230858 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:03:14.230858 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.230858 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.230858 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:03:14.230858 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:03:14.230858 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:03:14.230858 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:03:14.230858 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a857452-5ff9-49c4-ac71-331d2a468a6f could not be found. Oct 05 03:03:14.230858 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.233628 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-edb9cc2c-300b-47a0-9559-a5394bbd61f2 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:14.234029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5e906bec-b0b9-42c0-9c3a-4ae50198c632 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Returning 404 to user: Instance 5a857452-5ff9-49c4-ac71-331d2a468a6f could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:03:14.234250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-edb9cc2c-300b-47a0-9559-a5394bbd61f2 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:14.235514 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5e906bec-b0b9-42c0-9c3a-4ae50198c632 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f" status: 404 len: 111 microversion: 2.1 time: 0.043378 Oct 05 03:03:14.236717 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2986/5993] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:03:14 2022] DELETE /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 03:03:14.241722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-edb9cc2c-300b-47a0-9559-a5394bbd61f2 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:14.242414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-edb9cc2c-300b-47a0-9559-a5394bbd61f2 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:14.242907 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-edb9cc2c-300b-47a0-9559-a5394bbd61f2 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:14.244337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-edb9cc2c-300b-47a0-9559-a5394bbd61f2 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:14.245014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-edb9cc2c-300b-47a0-9559-a5394bbd61f2 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:14.245452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-edb9cc2c-300b-47a0-9559-a5394bbd61f2 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:14.247376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b08f6528-5a82-4909-b769-118b8995a527 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:14.248573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b08f6528-5a82-4909-b769-118b8995a527 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 5a857452-5ff9-49c4-ac71-331d2a468a6f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:14.265821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b08f6528-5a82-4909-b769-118b8995a527 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:14.266681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b08f6528-5a82-4909-b769-118b8995a527 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:14.267480 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b08f6528-5a82-4909-b769-118b8995a527 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:14.268571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b08f6528-5a82-4909-b769-118b8995a527 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:14.269347 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b08f6528-5a82-4909-b769-118b8995a527 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:14.269983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b08f6528-5a82-4909-b769-118b8995a527 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:14.287533 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-b08f6528-5a82-4909-b769-118b8995a527 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] HTTP exception thrown: Instance 5a857452-5ff9-49c4-ac71-331d2a468a6f could not be found. Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b08f6528-5a82-4909-b769-118b8995a527 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Request method failure captured: Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f HTTP/1.1 Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPMRSX2gjlikFUspC1UWD3LpY1ceHV7QevQM_Ijag9QQ0seWSmWQwasVLfA-3qPo60WBeSjn_ysZhLr4smwuTcgmq5PXaeLA0zkzWirUA1z0qMp7vToCduQRast94phmM-CNx-XY-K9McRIC58Qrl_qL_n7FYacRtEkL0ls1cybFzQg Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f477959bd24b4db881b62dab54861aa5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersTestJSON-1099213797-project Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 12d0128e850f4f22a2172800c44074a4 Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersTestJSON-1099213797-project Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 5a857452-5ff9-49c4-ac71-331d2a468a6f could not be found. Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '5a857452-5ff9-49c4-ac71-331d2a468a6f'} Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a857452-5ff9-49c4-ac71-331d2a468a6f could not be found. Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a857452-5ff9-49c4-ac71-331d2a468a6f could not be found. Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:03:14.289121 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.293317 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.293317 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:03:14.293317 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:03:14.293317 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:03:14.293317 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:03:14.293317 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a857452-5ff9-49c4-ac71-331d2a468a6f could not be found. Oct 05 03:03:14.293317 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.293317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b08f6528-5a82-4909-b769-118b8995a527 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Returning 404 to user: Instance 5a857452-5ff9-49c4-ac71-331d2a468a6f could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:03:14.297883 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b08f6528-5a82-4909-b769-118b8995a527 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f" status: 404 len: 111 microversion: 2.1 time: 0.057072 Oct 05 03:03:14.298682 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2987/5994] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:14 2022] GET /compute/v2.1/servers/5a857452-5ff9-49c4-ac71-331d2a468a6f => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:03:14.314219 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-47dab5c3-9763-4ad9-9168-ecd06d537edf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:14.314784 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-47dab5c3-9763-4ad9-9168-ecd06d537edf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:14.321121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47dab5c3-9763-4ad9-9168-ecd06d537edf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:14.322169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47dab5c3-9763-4ad9-9168-ecd06d537edf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:14.322607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47dab5c3-9763-4ad9-9168-ecd06d537edf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:14.323328 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47dab5c3-9763-4ad9-9168-ecd06d537edf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:14.323789 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47dab5c3-9763-4ad9-9168-ecd06d537edf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:14.324215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47dab5c3-9763-4ad9-9168-ecd06d537edf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:14.345838 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-47dab5c3-9763-4ad9-9168-ecd06d537edf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] HTTP exception thrown: Instance 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec could not be found. Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-47dab5c3-9763-4ad9-9168-ecd06d537edf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Request method failure captured: Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec HTTP/1.1 Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPMRSX2gjlikFUspC1UWD3LpY1ceHV7QevQM_Ijag9QQ0seWSmWQwasVLfA-3qPo60WBeSjn_ysZhLr4smwuTcgmq5PXaeLA0zkzWirUA1z0qMp7vToCduQRast94phmM-CNx-XY-K9McRIC58Qrl_qL_n7FYacRtEkL0ls1cybFzQg Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f477959bd24b4db881b62dab54861aa5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersTestJSON-1099213797-project Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 12d0128e850f4f22a2172800c44074a4 Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersTestJSON-1099213797-project Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec could not be found. Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '3a0e8591-93a5-43b0-94ba-e7e9a175e7ec'} Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec could not be found. Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:03:14.347415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec could not be found. Oct 05 03:03:14.350936 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.350936 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:03:14.350936 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.350936 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.350936 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:03:14.350936 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:03:14.350936 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:03:14.350936 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:03:14.350936 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec could not be found. Oct 05 03:03:14.350936 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.350936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-47dab5c3-9763-4ad9-9168-ecd06d537edf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Returning 404 to user: Instance 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:03:14.350936 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-47dab5c3-9763-4ad9-9168-ecd06d537edf tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec" status: 404 len: 111 microversion: 2.1 time: 0.038782 Oct 05 03:03:14.350936 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2988/5995] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:03:14 2022] DELETE /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:03:14.382583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-59d385eb-129b-4f03-ba28-c93f2685480d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:14.383645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-59d385eb-129b-4f03-ba28-c93f2685480d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:14.396478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-59d385eb-129b-4f03-ba28-c93f2685480d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:14.397031 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-59d385eb-129b-4f03-ba28-c93f2685480d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:14.397474 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-59d385eb-129b-4f03-ba28-c93f2685480d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:14.398691 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-59d385eb-129b-4f03-ba28-c93f2685480d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:14.399008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-59d385eb-129b-4f03-ba28-c93f2685480d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:14.399443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-59d385eb-129b-4f03-ba28-c93f2685480d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-59d385eb-129b-4f03-ba28-c93f2685480d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] HTTP exception thrown: Instance 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec could not be found. Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-59d385eb-129b-4f03-ba28-c93f2685480d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Request method failure captured: Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec HTTP/1.1 Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPMRSX2gjlikFUspC1UWD3LpY1ceHV7QevQM_Ijag9QQ0seWSmWQwasVLfA-3qPo60WBeSjn_ysZhLr4smwuTcgmq5PXaeLA0zkzWirUA1z0qMp7vToCduQRast94phmM-CNx-XY-K9McRIC58Qrl_qL_n7FYacRtEkL0ls1cybFzQg Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f477959bd24b4db881b62dab54861aa5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersTestJSON-1099213797-project Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 12d0128e850f4f22a2172800c44074a4 Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersTestJSON-1099213797-project Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec could not be found. Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '3a0e8591-93a5-43b0-94ba-e7e9a175e7ec'} Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec could not be found. Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:03:14.420494 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:03:14.423953 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec could not be found. Oct 05 03:03:14.423953 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.423953 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:03:14.423953 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.423953 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.423953 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:03:14.423953 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:03:14.423953 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:03:14.423953 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:03:14.423953 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec could not be found. Oct 05 03:03:14.423953 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.423953 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-59d385eb-129b-4f03-ba28-c93f2685480d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Returning 404 to user: Instance 3a0e8591-93a5-43b0-94ba-e7e9a175e7ec could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:03:14.423953 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-59d385eb-129b-4f03-ba28-c93f2685480d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec" status: 404 len: 111 microversion: 2.1 time: 0.066517 Oct 05 03:03:14.424668 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-edb9cc2c-300b-47a0-9559-a5394bbd61f2 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:14.424754 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2989/5996] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:14 2022] GET /compute/v2.1/servers/3a0e8591-93a5-43b0-94ba-e7e9a175e7ec => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:03:14.429955 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e9545588-81b3-41e1-aa99-391509e4028d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:14.430535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e9545588-81b3-41e1-aa99-391509e4028d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 6275bdb7-ef4e-42f5-8a43-d9c812d99feb] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:14.431084 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-edb9cc2c-300b-47a0-9559-a5394bbd61f2 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98" status: 200 len: 1374 microversion: 2.1 time: 0.203486 Oct 05 03:03:14.431694 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3008/5997] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:14 2022] GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98 => generated 1374 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:14.439683 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e9545588-81b3-41e1-aa99-391509e4028d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:14.440259 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e9545588-81b3-41e1-aa99-391509e4028d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:14.440763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e9545588-81b3-41e1-aa99-391509e4028d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:14.441568 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e9545588-81b3-41e1-aa99-391509e4028d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:14.442132 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e9545588-81b3-41e1-aa99-391509e4028d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:14.442622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e9545588-81b3-41e1-aa99-391509e4028d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:14.458495 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-e9545588-81b3-41e1-aa99-391509e4028d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] HTTP exception thrown: Instance 6275bdb7-ef4e-42f5-8a43-d9c812d99feb could not be found. Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e9545588-81b3-41e1-aa99-391509e4028d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Request method failure captured: Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb HTTP/1.1 Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPMRSX2gjlikFUspC1UWD3LpY1ceHV7QevQM_Ijag9QQ0seWSmWQwasVLfA-3qPo60WBeSjn_ysZhLr4smwuTcgmq5PXaeLA0zkzWirUA1z0qMp7vToCduQRast94phmM-CNx-XY-K9McRIC58Qrl_qL_n7FYacRtEkL0ls1cybFzQg Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f477959bd24b4db881b62dab54861aa5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersTestJSON-1099213797-project Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 12d0128e850f4f22a2172800c44074a4 Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersTestJSON-1099213797-project Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 6275bdb7-ef4e-42f5-8a43-d9c812d99feb could not be found. Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '6275bdb7-ef4e-42f5-8a43-d9c812d99feb'} Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6275bdb7-ef4e-42f5-8a43-d9c812d99feb could not be found. Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:03:14.460253 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6275bdb7-ef4e-42f5-8a43-d9c812d99feb could not be found. Oct 05 03:03:14.464955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.464955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:03:14.464955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.464955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.464955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:03:14.464955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:03:14.464955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:03:14.464955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:03:14.464955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6275bdb7-ef4e-42f5-8a43-d9c812d99feb could not be found. Oct 05 03:03:14.464955 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.464955 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e9545588-81b3-41e1-aa99-391509e4028d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Returning 404 to user: Instance 6275bdb7-ef4e-42f5-8a43-d9c812d99feb could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:03:14.464955 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e9545588-81b3-41e1-aa99-391509e4028d tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb" status: 404 len: 111 microversion: 2.1 time: 0.038150 Oct 05 03:03:14.465973 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2990/5998] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:03:14 2022] DELETE /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:03:14.474004 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4146989d-684b-4902-afff-0d438c05f966 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:14.474654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4146989d-684b-4902-afff-0d438c05f966 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 6275bdb7-ef4e-42f5-8a43-d9c812d99feb] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:14.481355 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4146989d-684b-4902-afff-0d438c05f966 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:14.481949 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4146989d-684b-4902-afff-0d438c05f966 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:14.482400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4146989d-684b-4902-afff-0d438c05f966 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:14.483120 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4146989d-684b-4902-afff-0d438c05f966 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:14.483569 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4146989d-684b-4902-afff-0d438c05f966 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:14.484001 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4146989d-684b-4902-afff-0d438c05f966 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:14.488122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:14.498763 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-4146989d-684b-4902-afff-0d438c05f966 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] HTTP exception thrown: Instance 6275bdb7-ef4e-42f5-8a43-d9c812d99feb could not be found. Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4146989d-684b-4902-afff-0d438c05f966 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Request method failure captured: Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb HTTP/1.1 Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPMRSX2gjlikFUspC1UWD3LpY1ceHV7QevQM_Ijag9QQ0seWSmWQwasVLfA-3qPo60WBeSjn_ysZhLr4smwuTcgmq5PXaeLA0zkzWirUA1z0qMp7vToCduQRast94phmM-CNx-XY-K9McRIC58Qrl_qL_n7FYacRtEkL0ls1cybFzQg Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f477959bd24b4db881b62dab54861aa5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersTestJSON-1099213797-project Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 12d0128e850f4f22a2172800c44074a4 Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersTestJSON-1099213797-project Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 6275bdb7-ef4e-42f5-8a43-d9c812d99feb could not be found. Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '6275bdb7-ef4e-42f5-8a43-d9c812d99feb'} Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6275bdb7-ef4e-42f5-8a43-d9c812d99feb could not be found. Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6275bdb7-ef4e-42f5-8a43-d9c812d99feb could not be found. Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:03:14.500289 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.508351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.508351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:03:14.508351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:03:14.508351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:03:14.508351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:03:14.508351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6275bdb7-ef4e-42f5-8a43-d9c812d99feb could not be found. Oct 05 03:03:14.508351 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.508351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4146989d-684b-4902-afff-0d438c05f966 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Returning 404 to user: Instance 6275bdb7-ef4e-42f5-8a43-d9c812d99feb could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:03:14.508351 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4146989d-684b-4902-afff-0d438c05f966 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb" status: 404 len: 111 microversion: 2.1 time: 0.031568 Oct 05 03:03:14.508351 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3009/5999] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:14 2022] GET /compute/v2.1/servers/6275bdb7-ef4e-42f5-8a43-d9c812d99feb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 03:03:14.513336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-188ebed8-40ee-486f-bc37-a47e2039849a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:14.513892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-188ebed8-40ee-486f-bc37-a47e2039849a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 9214c7d5-14aa-4547-aabb-abdcfff33001] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:14.520179 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-188ebed8-40ee-486f-bc37-a47e2039849a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:14.520681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-188ebed8-40ee-486f-bc37-a47e2039849a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:14.521154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-188ebed8-40ee-486f-bc37-a47e2039849a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:14.521856 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-188ebed8-40ee-486f-bc37-a47e2039849a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:14.522567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-188ebed8-40ee-486f-bc37-a47e2039849a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:14.523205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-188ebed8-40ee-486f-bc37-a47e2039849a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:14.542114 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-188ebed8-40ee-486f-bc37-a47e2039849a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] HTTP exception thrown: Instance 9214c7d5-14aa-4547-aabb-abdcfff33001 could not be found. Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-188ebed8-40ee-486f-bc37-a47e2039849a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Request method failure captured: Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001 HTTP/1.1 Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPMRSX2gjlikFUspC1UWD3LpY1ceHV7QevQM_Ijag9QQ0seWSmWQwasVLfA-3qPo60WBeSjn_ysZhLr4smwuTcgmq5PXaeLA0zkzWirUA1z0qMp7vToCduQRast94phmM-CNx-XY-K9McRIC58Qrl_qL_n7FYacRtEkL0ls1cybFzQg Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f477959bd24b4db881b62dab54861aa5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersTestJSON-1099213797-project Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 12d0128e850f4f22a2172800c44074a4 Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersTestJSON-1099213797-project Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 9214c7d5-14aa-4547-aabb-abdcfff33001 could not be found. Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '9214c7d5-14aa-4547-aabb-abdcfff33001'} Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9214c7d5-14aa-4547-aabb-abdcfff33001 could not be found. Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:03:14.544372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9214c7d5-14aa-4547-aabb-abdcfff33001 could not be found. Oct 05 03:03:14.548179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.548179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:03:14.548179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.548179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.548179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:03:14.548179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:03:14.548179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:03:14.548179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:03:14.548179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9214c7d5-14aa-4547-aabb-abdcfff33001 could not be found. Oct 05 03:03:14.548179 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.550165 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-188ebed8-40ee-486f-bc37-a47e2039849a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Returning 404 to user: Instance 9214c7d5-14aa-4547-aabb-abdcfff33001 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:03:14.551567 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-188ebed8-40ee-486f-bc37-a47e2039849a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001" status: 404 len: 111 microversion: 2.1 time: 0.042959 Oct 05 03:03:14.552630 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2991/6000] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:03:14 2022] DELETE /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:03:14.561504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cdbfcb86-bfad-4209-86e6-c676d8847a03 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:14.562691 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cdbfcb86-bfad-4209-86e6-c676d8847a03 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 9214c7d5-14aa-4547-aabb-abdcfff33001] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:14.577489 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdbfcb86-bfad-4209-86e6-c676d8847a03 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:14.578323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdbfcb86-bfad-4209-86e6-c676d8847a03 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:14.579008 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdbfcb86-bfad-4209-86e6-c676d8847a03 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:14.579999 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdbfcb86-bfad-4209-86e6-c676d8847a03 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:14.580873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdbfcb86-bfad-4209-86e6-c676d8847a03 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:14.582437 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdbfcb86-bfad-4209-86e6-c676d8847a03 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:14.615296 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-cdbfcb86-bfad-4209-86e6-c676d8847a03 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] HTTP exception thrown: Instance 9214c7d5-14aa-4547-aabb-abdcfff33001 could not be found. Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cdbfcb86-bfad-4209-86e6-c676d8847a03 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Request method failure captured: Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001 HTTP/1.1 Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPMRSX2gjlikFUspC1UWD3LpY1ceHV7QevQM_Ijag9QQ0seWSmWQwasVLfA-3qPo60WBeSjn_ysZhLr4smwuTcgmq5PXaeLA0zkzWirUA1z0qMp7vToCduQRast94phmM-CNx-XY-K9McRIC58Qrl_qL_n7FYacRtEkL0ls1cybFzQg Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f477959bd24b4db881b62dab54861aa5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersTestJSON-1099213797-project Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 12d0128e850f4f22a2172800c44074a4 Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersTestJSON-1099213797-project Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 9214c7d5-14aa-4547-aabb-abdcfff33001 could not be found. Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '9214c7d5-14aa-4547-aabb-abdcfff33001'} Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9214c7d5-14aa-4547-aabb-abdcfff33001 could not be found. Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9214c7d5-14aa-4547-aabb-abdcfff33001 could not be found. Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:03:14.617501 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.621913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.621913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:03:14.621913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:03:14.621913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:03:14.621913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:03:14.621913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9214c7d5-14aa-4547-aabb-abdcfff33001 could not be found. Oct 05 03:03:14.621913 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.625711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cdbfcb86-bfad-4209-86e6-c676d8847a03 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Returning 404 to user: Instance 9214c7d5-14aa-4547-aabb-abdcfff33001 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:03:14.634967 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cdbfcb86-bfad-4209-86e6-c676d8847a03 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001" status: 404 len: 111 microversion: 2.1 time: 0.077422 Oct 05 03:03:14.636178 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3010/6001] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:14 2022] GET /compute/v2.1/servers/9214c7d5-14aa-4547-aabb-abdcfff33001 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 03:03:14.646430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8ab179f1-291d-4d6b-bd4d-adac26067a6a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:14.647232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8ab179f1-291d-4d6b-bd4d-adac26067a6a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 33e7e716-e8e1-4773-b9f3-ceb8ccc86153] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:14.666120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ab179f1-291d-4d6b-bd4d-adac26067a6a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:14.666619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ab179f1-291d-4d6b-bd4d-adac26067a6a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:14.667056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ab179f1-291d-4d6b-bd4d-adac26067a6a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:14.670504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ab179f1-291d-4d6b-bd4d-adac26067a6a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:14.671235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ab179f1-291d-4d6b-bd4d-adac26067a6a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:14.672009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ab179f1-291d-4d6b-bd4d-adac26067a6a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:14.720468 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-8ab179f1-291d-4d6b-bd4d-adac26067a6a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] HTTP exception thrown: Instance 33e7e716-e8e1-4773-b9f3-ceb8ccc86153 could not be found. Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8ab179f1-291d-4d6b-bd4d-adac26067a6a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Request method failure captured: Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153 HTTP/1.1 Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPMRSX2gjlikFUspC1UWD3LpY1ceHV7QevQM_Ijag9QQ0seWSmWQwasVLfA-3qPo60WBeSjn_ysZhLr4smwuTcgmq5PXaeLA0zkzWirUA1z0qMp7vToCduQRast94phmM-CNx-XY-K9McRIC58Qrl_qL_n7FYacRtEkL0ls1cybFzQg Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f477959bd24b4db881b62dab54861aa5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersTestJSON-1099213797-project Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 12d0128e850f4f22a2172800c44074a4 Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersTestJSON-1099213797-project Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 33e7e716-e8e1-4773-b9f3-ceb8ccc86153 could not be found. Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '33e7e716-e8e1-4773-b9f3-ceb8ccc86153'} Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33e7e716-e8e1-4773-b9f3-ceb8ccc86153 could not be found. Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:03:14.737983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33e7e716-e8e1-4773-b9f3-ceb8ccc86153 could not be found. Oct 05 03:03:14.741825 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.741825 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:03:14.741825 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.741825 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.741825 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:03:14.741825 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:03:14.741825 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:03:14.741825 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:03:14.741825 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33e7e716-e8e1-4773-b9f3-ceb8ccc86153 could not be found. Oct 05 03:03:14.741825 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.741825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8ab179f1-291d-4d6b-bd4d-adac26067a6a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Returning 404 to user: Instance 33e7e716-e8e1-4773-b9f3-ceb8ccc86153 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:03:14.741825 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8ab179f1-291d-4d6b-bd4d-adac26067a6a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "DELETE /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153" status: 404 len: 111 microversion: 2.1 time: 0.098887 Oct 05 03:03:14.743428 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2992/6002] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:03:14 2022] DELETE /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:03:14.751020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ce3b9433-5add-497c-9ef9-905b17e75ddb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:14.751884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ce3b9433-5add-497c-9ef9-905b17e75ddb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: 33e7e716-e8e1-4773-b9f3-ceb8ccc86153] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:14.760516 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce3b9433-5add-497c-9ef9-905b17e75ddb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:14.760974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce3b9433-5add-497c-9ef9-905b17e75ddb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:14.761972 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce3b9433-5add-497c-9ef9-905b17e75ddb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:14.762910 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce3b9433-5add-497c-9ef9-905b17e75ddb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:14.763674 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce3b9433-5add-497c-9ef9-905b17e75ddb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:14.764332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce3b9433-5add-497c-9ef9-905b17e75ddb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:14.812594 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-ce3b9433-5add-497c-9ef9-905b17e75ddb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] HTTP exception thrown: Instance 33e7e716-e8e1-4773-b9f3-ceb8ccc86153 could not be found. Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ce3b9433-5add-497c-9ef9-905b17e75ddb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Request method failure captured: Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153 HTTP/1.1 Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPMRSX2gjlikFUspC1UWD3LpY1ceHV7QevQM_Ijag9QQ0seWSmWQwasVLfA-3qPo60WBeSjn_ysZhLr4smwuTcgmq5PXaeLA0zkzWirUA1z0qMp7vToCduQRast94phmM-CNx-XY-K9McRIC58Qrl_qL_n7FYacRtEkL0ls1cybFzQg Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f477959bd24b4db881b62dab54861aa5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersTestJSON-1099213797-project Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 12d0128e850f4f22a2172800c44074a4 Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersTestJSON-1099213797-project Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 33e7e716-e8e1-4773-b9f3-ceb8ccc86153 could not be found. Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '33e7e716-e8e1-4773-b9f3-ceb8ccc86153'} Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33e7e716-e8e1-4773-b9f3-ceb8ccc86153 could not be found. Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33e7e716-e8e1-4773-b9f3-ceb8ccc86153 could not be found. Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:03:14.821373 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.825883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.825883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:03:14.825883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:03:14.825883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:03:14.825883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:03:14.825883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33e7e716-e8e1-4773-b9f3-ceb8ccc86153 could not be found. Oct 05 03:03:14.825883 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.825883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ce3b9433-5add-497c-9ef9-905b17e75ddb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Returning 404 to user: Instance 33e7e716-e8e1-4773-b9f3-ceb8ccc86153 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:03:14.825883 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ce3b9433-5add-497c-9ef9-905b17e75ddb tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153" status: 404 len: 111 microversion: 2.1 time: 0.079025 Oct 05 03:03:14.831716 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3011/6003] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:14 2022] GET /compute/v2.1/servers/33e7e716-e8e1-4773-b9f3-ceb8ccc86153 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:03:14.833832 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a8034527-3b74-42a2-b67d-320d3b6842d3 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:14.834486 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a8034527-3b74-42a2-b67d-320d3b6842d3 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: e704e426-cae4-4cc3-b2be-24f3fe4e52dc] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:14.841043 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-a8034527-3b74-42a2-b67d-320d3b6842d3 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] HTTP exception thrown: Instance e704e426-cae4-4cc3-b2be-24f3fe4e52dc could not be found. Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a8034527-3b74-42a2-b67d-320d3b6842d3 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Request method failure captured: Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/servers/e704e426-cae4-4cc3-b2be-24f3fe4e52dc HTTP/1.1 Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPMRSX2gjlikFUspC1UWD3LpY1ceHV7QevQM_Ijag9QQ0seWSmWQwasVLfA-3qPo60WBeSjn_ysZhLr4smwuTcgmq5PXaeLA0zkzWirUA1z0qMp7vToCduQRast94phmM-CNx-XY-K9McRIC58Qrl_qL_n7FYacRtEkL0ls1cybFzQg Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f477959bd24b4db881b62dab54861aa5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersTestJSON-1099213797-project Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 12d0128e850f4f22a2172800c44074a4 Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersTestJSON-1099213797-project Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance e704e426-cae4-4cc3-b2be-24f3fe4e52dc could not be found. Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'e704e426-cae4-4cc3-b2be-24f3fe4e52dc'} Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e704e426-cae4-4cc3-b2be-24f3fe4e52dc could not be found. Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e704e426-cae4-4cc3-b2be-24f3fe4e52dc could not be found. Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:03:14.843303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.847320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.847320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:03:14.847320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:03:14.847320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:03:14.847320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:03:14.847320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e704e426-cae4-4cc3-b2be-24f3fe4e52dc could not be found. Oct 05 03:03:14.847320 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.849669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a8034527-3b74-42a2-b67d-320d3b6842d3 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Returning 404 to user: Instance e704e426-cae4-4cc3-b2be-24f3fe4e52dc could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:03:14.850835 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a8034527-3b74-42a2-b67d-320d3b6842d3 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e704e426-cae4-4cc3-b2be-24f3fe4e52dc" status: 404 len: 111 microversion: 2.1 time: 0.022311 Oct 05 03:03:14.851917 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2993/6004] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:03:14 2022] DELETE /compute/v2.1/servers/e704e426-cae4-4cc3-b2be-24f3fe4e52dc => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:03:14.861273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1c5df846-d59d-4ef3-8250-427e59d618a0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:14.862012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1c5df846-d59d-4ef3-8250-427e59d618a0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: e704e426-cae4-4cc3-b2be-24f3fe4e52dc] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:14.867840 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-1c5df846-d59d-4ef3-8250-427e59d618a0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] HTTP exception thrown: Instance e704e426-cae4-4cc3-b2be-24f3fe4e52dc could not be found. Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1c5df846-d59d-4ef3-8250-427e59d618a0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Request method failure captured: Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/e704e426-cae4-4cc3-b2be-24f3fe4e52dc HTTP/1.1 Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPMRSX2gjlikFUspC1UWD3LpY1ceHV7QevQM_Ijag9QQ0seWSmWQwasVLfA-3qPo60WBeSjn_ysZhLr4smwuTcgmq5PXaeLA0zkzWirUA1z0qMp7vToCduQRast94phmM-CNx-XY-K9McRIC58Qrl_qL_n7FYacRtEkL0ls1cybFzQg Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f477959bd24b4db881b62dab54861aa5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersTestJSON-1099213797-project Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 12d0128e850f4f22a2172800c44074a4 Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersTestJSON-1099213797-project Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance e704e426-cae4-4cc3-b2be-24f3fe4e52dc could not be found. Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'e704e426-cae4-4cc3-b2be-24f3fe4e52dc'} Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e704e426-cae4-4cc3-b2be-24f3fe4e52dc could not be found. Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e704e426-cae4-4cc3-b2be-24f3fe4e52dc could not be found. Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:14.870766 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:03:14.874292 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:03:14.874292 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:03:14.874292 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:03:14.874292 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e704e426-cae4-4cc3-b2be-24f3fe4e52dc could not be found. Oct 05 03:03:14.874292 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:03:14.875805 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1c5df846-d59d-4ef3-8250-427e59d618a0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Returning 404 to user: Instance e704e426-cae4-4cc3-b2be-24f3fe4e52dc could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:03:14.877763 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1c5df846-d59d-4ef3-8250-427e59d618a0 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/e704e426-cae4-4cc3-b2be-24f3fe4e52dc" status: 404 len: 111 microversion: 2.1 time: 0.021885 Oct 05 03:03:14.881468 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3012/6005] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:14 2022] GET /compute/v2.1/servers/e704e426-cae4-4cc3-b2be-24f3fe4e52dc => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:03:14.889215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3056cb2a-90b4-4aa0-bfd8-6039df09513e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:14.890064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3056cb2a-90b4-4aa0-bfd8-6039df09513e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:14.898019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3056cb2a-90b4-4aa0-bfd8-6039df09513e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:14.898942 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3056cb2a-90b4-4aa0-bfd8-6039df09513e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:14.899666 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3056cb2a-90b4-4aa0-bfd8-6039df09513e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:14.900724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3056cb2a-90b4-4aa0-bfd8-6039df09513e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:14.901428 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3056cb2a-90b4-4aa0-bfd8-6039df09513e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:14.902398 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3056cb2a-90b4-4aa0-bfd8-6039df09513e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:14.960584 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3056cb2a-90b4-4aa0-bfd8-6039df09513e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:03:15.112716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fd80bd1a-9560-4958-bd16-a48b5773c6fc tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:15.115020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fd80bd1a-9560-4958-bd16-a48b5773c6fc tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] [instance: 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:15.124871 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3056cb2a-90b4-4aa0-bfd8-6039df09513e tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7" status: 204 len: 0 microversion: 2.1 time: 0.241208 Oct 05 03:03:15.126427 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2994/6006] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:03:14 2022] DELETE /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:03:15.133082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fd80bd1a-9560-4958-bd16-a48b5773c6fc tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:15.141100 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fd80bd1a-9560-4958-bd16-a48b5773c6fc tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:15.141791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fd80bd1a-9560-4958-bd16-a48b5773c6fc tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:15.143069 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fd80bd1a-9560-4958-bd16-a48b5773c6fc tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:15.143496 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-be4ce0ba-f4d9-4942-aa3e-40334e4ce3ef tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:15.144320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-be4ce0ba-f4d9-4942-aa3e-40334e4ce3ef tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:15.145035 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fd80bd1a-9560-4958-bd16-a48b5773c6fc tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:15.149222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fd80bd1a-9560-4958-bd16-a48b5773c6fc tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:15.158547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be4ce0ba-f4d9-4942-aa3e-40334e4ce3ef tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:15.159993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be4ce0ba-f4d9-4942-aa3e-40334e4ce3ef tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:15.160578 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be4ce0ba-f4d9-4942-aa3e-40334e4ce3ef tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:15.161477 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be4ce0ba-f4d9-4942-aa3e-40334e4ce3ef tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:15.169646 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be4ce0ba-f4d9-4942-aa3e-40334e4ce3ef tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:15.170292 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be4ce0ba-f4d9-4942-aa3e-40334e4ce3ef tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:15.412692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-be4ce0ba-f4d9-4942-aa3e-40334e4ce3ef tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:15.427988 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-be4ce0ba-f4d9-4942-aa3e-40334e4ce3ef tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7" status: 200 len: 1479 microversion: 2.1 time: 0.292895 Oct 05 03:03:15.429303 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2995/6007] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:15 2022] GET /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7 => generated 1479 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:15.453397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2e6bb661-bc1c-44b5-8528-962510f04188 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:15.454502 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2e6bb661-bc1c-44b5-8528-962510f04188 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:15.465758 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2e6bb661-bc1c-44b5-8528-962510f04188 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:15.466475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2e6bb661-bc1c-44b5-8528-962510f04188 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:15.466903 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2e6bb661-bc1c-44b5-8528-962510f04188 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:15.467813 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2e6bb661-bc1c-44b5-8528-962510f04188 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:15.468565 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2e6bb661-bc1c-44b5-8528-962510f04188 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:15.474835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2e6bb661-bc1c-44b5-8528-962510f04188 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:15.730252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fd80bd1a-9560-4958-bd16-a48b5773c6fc tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329523b6f089401face7b477d08ca7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feef1976405a442eb7ee441d12c9a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:15.754046 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fd80bd1a-9560-4958-bd16-a48b5773c6fc tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00" status: 200 len: 1268 microversion: 2.1 time: 0.638596 Oct 05 03:03:15.756592 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3013/6008] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:15 2022] GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 => generated 1268 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:15.794234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2e6bb661-bc1c-44b5-8528-962510f04188 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:15.804457 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2e6bb661-bc1c-44b5-8528-962510f04188 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98" status: 200 len: 1374 microversion: 2.1 time: 0.354519 Oct 05 03:03:15.807100 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2996/6009] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:15 2022] GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98 => generated 1374 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:03:16.455468 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8fecaa4d-b2f9-4730-9a09-794c0766380b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:16.456084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8fecaa4d-b2f9-4730-9a09-794c0766380b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:16.463622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8fecaa4d-b2f9-4730-9a09-794c0766380b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:16.464318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8fecaa4d-b2f9-4730-9a09-794c0766380b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:16.464928 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8fecaa4d-b2f9-4730-9a09-794c0766380b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:16.465814 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8fecaa4d-b2f9-4730-9a09-794c0766380b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:16.466422 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8fecaa4d-b2f9-4730-9a09-794c0766380b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:16.467001 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8fecaa4d-b2f9-4730-9a09-794c0766380b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:16.644458 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8fecaa4d-b2f9-4730-9a09-794c0766380b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:16.660392 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8fecaa4d-b2f9-4730-9a09-794c0766380b tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7" status: 200 len: 1479 microversion: 2.1 time: 0.208616 Oct 05 03:03:16.670690 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3014/6010] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:16 2022] GET /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7 => generated 1479 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:16.780146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-85720bdc-cd0d-4a79-b798-15f7039490d5 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:16.780951 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-85720bdc-cd0d-4a79-b798-15f7039490d5 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] [instance: 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:16.792480 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85720bdc-cd0d-4a79-b798-15f7039490d5 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:16.798534 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85720bdc-cd0d-4a79-b798-15f7039490d5 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:16.799479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85720bdc-cd0d-4a79-b798-15f7039490d5 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:16.800456 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85720bdc-cd0d-4a79-b798-15f7039490d5 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:16.801220 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85720bdc-cd0d-4a79-b798-15f7039490d5 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:16.801863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85720bdc-cd0d-4a79-b798-15f7039490d5 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:16.831647 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-98b3f346-d289-494d-8a35-eaf16b19a20f tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:16.832689 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-98b3f346-d289-494d-8a35-eaf16b19a20f tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:16.846721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98b3f346-d289-494d-8a35-eaf16b19a20f tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:16.847430 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98b3f346-d289-494d-8a35-eaf16b19a20f tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:16.848031 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98b3f346-d289-494d-8a35-eaf16b19a20f tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:16.848947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98b3f346-d289-494d-8a35-eaf16b19a20f tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:16.854123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98b3f346-d289-494d-8a35-eaf16b19a20f tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:16.854759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98b3f346-d289-494d-8a35-eaf16b19a20f tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:17.215002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-98b3f346-d289-494d-8a35-eaf16b19a20f tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:17.224070 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-98b3f346-d289-494d-8a35-eaf16b19a20f tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98" status: 200 len: 1374 microversion: 2.1 time: 0.396359 Oct 05 03:03:17.224885 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3015/6011] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:16 2022] GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98 => generated 1374 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:03:17.233676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-85720bdc-cd0d-4a79-b798-15f7039490d5 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329523b6f089401face7b477d08ca7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feef1976405a442eb7ee441d12c9a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:17.249492 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-85720bdc-cd0d-4a79-b798-15f7039490d5 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00" status: 200 len: 1268 microversion: 2.1 time: 0.472758 Oct 05 03:03:17.250111 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2997/6012] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:16 2022] GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 => generated 1268 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:17.569635 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-9507733b-5271-4694-b947-5752c0ebe77f req-7d0cf013-a20c-4077-8a6c-39c281da6072 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98", "name": "network-vif-plugged", "status": "completed", "tag": "fd341ff3-1d1b-4802-b759-1caf9f208c09"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:03:17.586622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9507733b-5271-4694-b947-5752c0ebe77f req-7d0cf013-a20c-4077-8a6c-39c281da6072 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:17.601927 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9507733b-5271-4694-b947-5752c0ebe77f req-7d0cf013-a20c-4077-8a6c-39c281da6072 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:17.602401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9507733b-5271-4694-b947-5752c0ebe77f req-7d0cf013-a20c-4077-8a6c-39c281da6072 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:17.632822 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-9507733b-5271-4694-b947-5752c0ebe77f req-7d0cf013-a20c-4077-8a6c-39c281da6072 service nova] Creating event network-vif-plugged:fd341ff3-1d1b-4802-b759-1caf9f208c09 for instance ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98 on n-h2-858272-3 Oct 05 03:03:17.650169 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-9507733b-5271-4694-b947-5752c0ebe77f req-7d0cf013-a20c-4077-8a6c-39c281da6072 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083779 Oct 05 03:03:17.651289 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3016/6013] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:03:17.695102 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-03230172-7bdc-4481-8132-b4b75d9a6a15 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:17.695729 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-03230172-7bdc-4481-8132-b4b75d9a6a15 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:17.707861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03230172-7bdc-4481-8132-b4b75d9a6a15 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:17.710723 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03230172-7bdc-4481-8132-b4b75d9a6a15 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:17.711284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03230172-7bdc-4481-8132-b4b75d9a6a15 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:17.711409 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-bb2aef99-39d0-4fd2-9324-3decbd984234 req-e760e597-844b-4019-b010-39fd58e8def7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7", "name": "network-vif-deleted", "tag": "c6288e2b-cd6c-4e8f-b7d8-e00bfd946a12"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:03:17.712014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03230172-7bdc-4481-8132-b4b75d9a6a15 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:17.715403 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03230172-7bdc-4481-8132-b4b75d9a6a15 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:17.715849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03230172-7bdc-4481-8132-b4b75d9a6a15 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:17.741495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-bb2aef99-39d0-4fd2-9324-3decbd984234 req-e760e597-844b-4019-b010-39fd58e8def7 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:17.742482 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-bb2aef99-39d0-4fd2-9324-3decbd984234 req-e760e597-844b-4019-b010-39fd58e8def7 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:17.743521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-bb2aef99-39d0-4fd2-9324-3decbd984234 req-e760e597-844b-4019-b010-39fd58e8def7 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:17.779705 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-bb2aef99-39d0-4fd2-9324-3decbd984234 req-e760e597-844b-4019-b010-39fd58e8def7 service nova] Creating event network-vif-deleted:c6288e2b-cd6c-4e8f-b7d8-e00bfd946a12 for instance c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7 on n-h1-858272-3 Oct 05 03:03:17.793779 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-bb2aef99-39d0-4fd2-9324-3decbd984234 req-e760e597-844b-4019-b010-39fd58e8def7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086576 Oct 05 03:03:17.796968 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3017/6014] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:03:17.860642 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-03230172-7bdc-4481-8132-b4b75d9a6a15 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d0128e850f4f22a2172800c44074a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f477959bd24b4db881b62dab54861aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:17.876657 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-03230172-7bdc-4481-8132-b4b75d9a6a15 tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7" status: 200 len: 1437 microversion: 2.1 time: 0.185471 Oct 05 03:03:17.877901 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2998/6015] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:17 2022] GET /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7 => generated 1437 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:18.254425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f3175226-1ec9-494f-9436-88064692151a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:18.255214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f3175226-1ec9-494f-9436-88064692151a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:18.266820 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3175226-1ec9-494f-9436-88064692151a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:18.267332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3175226-1ec9-494f-9436-88064692151a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:18.267772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3175226-1ec9-494f-9436-88064692151a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:18.271471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3175226-1ec9-494f-9436-88064692151a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:18.272158 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3175226-1ec9-494f-9436-88064692151a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:18.277537 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3175226-1ec9-494f-9436-88064692151a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:18.279382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f51ea819-ad72-4c4a-a8e4-a9d54b299509 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:18.282682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f51ea819-ad72-4c4a-a8e4-a9d54b299509 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] [instance: 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:18.303109 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f51ea819-ad72-4c4a-a8e4-a9d54b299509 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:18.309557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f51ea819-ad72-4c4a-a8e4-a9d54b299509 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:18.310144 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f51ea819-ad72-4c4a-a8e4-a9d54b299509 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:18.311006 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f51ea819-ad72-4c4a-a8e4-a9d54b299509 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:18.312138 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f51ea819-ad72-4c4a-a8e4-a9d54b299509 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:18.312818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f51ea819-ad72-4c4a-a8e4-a9d54b299509 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:18.735998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f51ea819-ad72-4c4a-a8e4-a9d54b299509 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329523b6f089401face7b477d08ca7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feef1976405a442eb7ee441d12c9a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:18.747971 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f51ea819-ad72-4c4a-a8e4-a9d54b299509 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00" status: 200 len: 1268 microversion: 2.1 time: 0.474352 Oct 05 03:03:18.751085 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 2999/6016] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:18 2022] GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 => generated 1268 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:18.788345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f3175226-1ec9-494f-9436-88064692151a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:18.803357 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f3175226-1ec9-494f-9436-88064692151a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98" status: 200 len: 1374 microversion: 2.1 time: 0.553786 Oct 05 03:03:18.817826 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3018/6017] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:18 2022] GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98 => generated 1374 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:18.913439 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ecdec5cd-bfec-4297-854e-68b7e77a1b9a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:18.915141 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ecdec5cd-bfec-4297-854e-68b7e77a1b9a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] [instance: c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:18.934220 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ecdec5cd-bfec-4297-854e-68b7e77a1b9a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:18.934987 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ecdec5cd-bfec-4297-854e-68b7e77a1b9a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:18.936287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ecdec5cd-bfec-4297-854e-68b7e77a1b9a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:18.937527 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ecdec5cd-bfec-4297-854e-68b7e77a1b9a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:18.938224 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ecdec5cd-bfec-4297-854e-68b7e77a1b9a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:18.938854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ecdec5cd-bfec-4297-854e-68b7e77a1b9a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:18.987971 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-ecdec5cd-bfec-4297-854e-68b7e77a1b9a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] HTTP exception thrown: Instance c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7 could not be found. Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ecdec5cd-bfec-4297-854e-68b7e77a1b9a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Request method failure captured: Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7 HTTP/1.1 Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPMRSX2gjlikFUspC1UWD3LpY1ceHV7QevQM_Ijag9QQ0seWSmWQwasVLfA-3qPo60WBeSjn_ysZhLr4smwuTcgmq5PXaeLA0zkzWirUA1z0qMp7vToCduQRast94phmM-CNx-XY-K9McRIC58Qrl_qL_n7FYacRtEkL0ls1cybFzQg Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f477959bd24b4db881b62dab54861aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f477959bd24b4db881b62dab54861aa5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersTestJSON-1099213797 Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: f477959bd24b4db881b62dab54861aa5 Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersTestJSON-1099213797 Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersTestJSON-1099213797-project Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 12d0128e850f4f22a2172800c44074a4 Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersTestJSON-1099213797-project Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7 could not be found. Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7'} Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7 could not be found. Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7 could not be found. Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:03:18.990744 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:18.996329 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:03:18.996329 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:03:18.996329 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:03:18.996329 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:03:18.996329 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:03:18.996329 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7 could not be found. Oct 05 03:03:18.996329 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:03:18.996329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ecdec5cd-bfec-4297-854e-68b7e77a1b9a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] Returning 404 to user: Instance c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:03:18.997880 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ecdec5cd-bfec-4297-854e-68b7e77a1b9a tempest-ServersTestJSON-1099213797 tempest-ServersTestJSON-1099213797-project] 10.222.0.16 "GET /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7" status: 404 len: 111 microversion: 2.1 time: 0.099530 Oct 05 03:03:18.999089 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3000/6018] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:18 2022] GET /compute/v2.1/servers/c42ae8cd-60b7-4e5a-a65f-0b43901ff3e7 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:03:19.780765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1bc01da4-51c6-4bc5-aed1-1ea0ad224504 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:19.783610 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1bc01da4-51c6-4bc5-aed1-1ea0ad224504 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] [instance: 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:19.799697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1bc01da4-51c6-4bc5-aed1-1ea0ad224504 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:19.800876 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1bc01da4-51c6-4bc5-aed1-1ea0ad224504 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:19.801509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1bc01da4-51c6-4bc5-aed1-1ea0ad224504 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:19.804958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1bc01da4-51c6-4bc5-aed1-1ea0ad224504 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:19.806361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1bc01da4-51c6-4bc5-aed1-1ea0ad224504 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:19.807392 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1bc01da4-51c6-4bc5-aed1-1ea0ad224504 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:19.832660 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e53c050b-c1f7-4e55-9bd1-bffcd97f604a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:19.833557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e53c050b-c1f7-4e55-9bd1-bffcd97f604a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:19.846771 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e53c050b-c1f7-4e55-9bd1-bffcd97f604a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:19.847738 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e53c050b-c1f7-4e55-9bd1-bffcd97f604a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:19.848878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e53c050b-c1f7-4e55-9bd1-bffcd97f604a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:19.850074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e53c050b-c1f7-4e55-9bd1-bffcd97f604a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:19.850740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e53c050b-c1f7-4e55-9bd1-bffcd97f604a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:19.851303 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e53c050b-c1f7-4e55-9bd1-bffcd97f604a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:20.437709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e53c050b-c1f7-4e55-9bd1-bffcd97f604a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:20.444528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1bc01da4-51c6-4bc5-aed1-1ea0ad224504 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329523b6f089401face7b477d08ca7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feef1976405a442eb7ee441d12c9a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:20.456230 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1bc01da4-51c6-4bc5-aed1-1ea0ad224504 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00" status: 200 len: 1268 microversion: 2.1 time: 0.685164 Oct 05 03:03:20.456828 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3019/6019] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:19 2022] GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 => generated 1268 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:03:20.457028 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e53c050b-c1f7-4e55-9bd1-bffcd97f604a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98" status: 200 len: 1374 microversion: 2.1 time: 0.629411 Oct 05 03:03:20.476994 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3001/6020] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:19 2022] GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98 => generated 1374 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:21.486422 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-08d0671d-9342-478f-883e-df3e4c9b5a93 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:21.487916 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-08d0671d-9342-478f-883e-df3e4c9b5a93 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] [instance: 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:21.490810 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-571d00fb-c853-4e93-9e4b-faff37596e43 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:21.491475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-571d00fb-c853-4e93-9e4b-faff37596e43 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:21.502805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-571d00fb-c853-4e93-9e4b-faff37596e43 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:21.503587 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-571d00fb-c853-4e93-9e4b-faff37596e43 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:21.504169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-571d00fb-c853-4e93-9e4b-faff37596e43 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:21.505301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-571d00fb-c853-4e93-9e4b-faff37596e43 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:21.505899 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-571d00fb-c853-4e93-9e4b-faff37596e43 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:21.506236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08d0671d-9342-478f-883e-df3e4c9b5a93 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:21.506655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-571d00fb-c853-4e93-9e4b-faff37596e43 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:21.507488 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08d0671d-9342-478f-883e-df3e4c9b5a93 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:21.509239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08d0671d-9342-478f-883e-df3e4c9b5a93 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:21.511304 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08d0671d-9342-478f-883e-df3e4c9b5a93 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:21.512600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08d0671d-9342-478f-883e-df3e4c9b5a93 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:21.514681 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08d0671d-9342-478f-883e-df3e4c9b5a93 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:21.994488 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-08d0671d-9342-478f-883e-df3e4c9b5a93 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329523b6f089401face7b477d08ca7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feef1976405a442eb7ee441d12c9a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:22.011652 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-08d0671d-9342-478f-883e-df3e4c9b5a93 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00" status: 200 len: 1268 microversion: 2.1 time: 0.530575 Oct 05 03:03:22.012522 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3020/6021] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:21 2022] GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 => generated 1268 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:22.043088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-025fe709-ee16-4e9a-bdff-fb282cb6f654 req-f4c5a4d0-7409-4faa-a71a-5d798c09ce7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb16ac5-263b-4180-b36f-ca3a9c7a7e00", "name": "network-vif-plugged", "status": "completed", "tag": "2f992c30-d1e1-4034-a6a6-792e3ba1ffe1"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:03:22.071495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-025fe709-ee16-4e9a-bdff-fb282cb6f654 req-f4c5a4d0-7409-4faa-a71a-5d798c09ce7d service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:22.071869 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-025fe709-ee16-4e9a-bdff-fb282cb6f654 req-f4c5a4d0-7409-4faa-a71a-5d798c09ce7d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:22.072443 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-025fe709-ee16-4e9a-bdff-fb282cb6f654 req-f4c5a4d0-7409-4faa-a71a-5d798c09ce7d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:22.111282 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-025fe709-ee16-4e9a-bdff-fb282cb6f654 req-f4c5a4d0-7409-4faa-a71a-5d798c09ce7d service nova] Creating event network-vif-plugged:2f992c30-d1e1-4034-a6a6-792e3ba1ffe1 for instance 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 on n-h2-858272-3 Oct 05 03:03:22.123051 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-025fe709-ee16-4e9a-bdff-fb282cb6f654 req-f4c5a4d0-7409-4faa-a71a-5d798c09ce7d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093247 Oct 05 03:03:22.124327 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3021/6022] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:03:22.470739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-571d00fb-c853-4e93-9e4b-faff37596e43 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:22.486157 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-571d00fb-c853-4e93-9e4b-faff37596e43 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98" status: 200 len: 1546 microversion: 2.1 time: 0.999127 Oct 05 03:03:22.486835 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3002/6023] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:21 2022] GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98 => generated 1546 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:03:22.511561 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e1998654-7bf3-48c9-8cd7-a6f0ed38acdb tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:22.513225 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e1998654-7bf3-48c9-8cd7-a6f0ed38acdb tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:22.534842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e1998654-7bf3-48c9-8cd7-a6f0ed38acdb tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:22.535367 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e1998654-7bf3-48c9-8cd7-a6f0ed38acdb tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:22.535820 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e1998654-7bf3-48c9-8cd7-a6f0ed38acdb tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:22.538965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e1998654-7bf3-48c9-8cd7-a6f0ed38acdb tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:22.542206 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e1998654-7bf3-48c9-8cd7-a6f0ed38acdb tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:22.542677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e1998654-7bf3-48c9-8cd7-a6f0ed38acdb tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:22.851056 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e1998654-7bf3-48c9-8cd7-a6f0ed38acdb tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:22.861424 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e1998654-7bf3-48c9-8cd7-a6f0ed38acdb tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98" status: 200 len: 1546 microversion: 2.1 time: 0.356228 Oct 05 03:03:22.862497 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3022/6024] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:22 2022] GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98 => generated 1546 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:23.036313 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3f3be34d-5c40-476a-9cf5-43868f02855b tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:23.037282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3f3be34d-5c40-476a-9cf5-43868f02855b tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] [instance: 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:23.049250 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f3be34d-5c40-476a-9cf5-43868f02855b tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:23.051464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f3be34d-5c40-476a-9cf5-43868f02855b tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:23.053056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f3be34d-5c40-476a-9cf5-43868f02855b tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:23.054664 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f3be34d-5c40-476a-9cf5-43868f02855b tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:23.056649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f3be34d-5c40-476a-9cf5-43868f02855b tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:23.058086 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f3be34d-5c40-476a-9cf5-43868f02855b tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:23.095639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:23.374147 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3f3be34d-5c40-476a-9cf5-43868f02855b tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329523b6f089401face7b477d08ca7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feef1976405a442eb7ee441d12c9a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:23.386025 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3f3be34d-5c40-476a-9cf5-43868f02855b tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00" status: 200 len: 1268 microversion: 2.1 time: 0.354242 Oct 05 03:03:23.387511 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3003/6025] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:23 2022] GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 => generated 1268 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:24.429360 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-83c6003a-ebf7-4bf7-a483-49c70d053d7a tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:24.430504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-83c6003a-ebf7-4bf7-a483-49c70d053d7a tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] [instance: 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:24.438118 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-83c6003a-ebf7-4bf7-a483-49c70d053d7a tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:24.438853 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-83c6003a-ebf7-4bf7-a483-49c70d053d7a tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:24.439474 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-83c6003a-ebf7-4bf7-a483-49c70d053d7a tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:24.440592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-83c6003a-ebf7-4bf7-a483-49c70d053d7a tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:24.441249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-83c6003a-ebf7-4bf7-a483-49c70d053d7a tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:24.441857 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-83c6003a-ebf7-4bf7-a483-49c70d053d7a tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:25.015018 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-83c6003a-ebf7-4bf7-a483-49c70d053d7a tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329523b6f089401face7b477d08ca7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feef1976405a442eb7ee441d12c9a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:25.044678 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-83c6003a-ebf7-4bf7-a483-49c70d053d7a tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00" status: 200 len: 1456 microversion: 2.1 time: 0.612791 Oct 05 03:03:25.046109 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3023/6026] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:24 2022] GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 => generated 1456 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:25.076094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e708f317-6d32-41c8-8121-42cc9d851554 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:25.079711 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e708f317-6d32-41c8-8121-42cc9d851554 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] [instance: 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:25.086506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e708f317-6d32-41c8-8121-42cc9d851554 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:25.087047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e708f317-6d32-41c8-8121-42cc9d851554 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:25.087777 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e708f317-6d32-41c8-8121-42cc9d851554 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:25.088812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e708f317-6d32-41c8-8121-42cc9d851554 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:25.089291 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e708f317-6d32-41c8-8121-42cc9d851554 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:25.089871 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e708f317-6d32-41c8-8121-42cc9d851554 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:25.332592 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e708f317-6d32-41c8-8121-42cc9d851554 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329523b6f089401face7b477d08ca7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feef1976405a442eb7ee441d12c9a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:25.344406 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e708f317-6d32-41c8-8121-42cc9d851554 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00" status: 200 len: 1456 microversion: 2.1 time: 0.274470 Oct 05 03:03:25.345668 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3004/6027] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:25 2022] GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 => generated 1456 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:28.986653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-86215f75-13d8-465c-a311-c5f488d992b9 req-9140e912-05b4-43c4-a69e-3689c257fd76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb16ac5-263b-4180-b36f-ca3a9c7a7e00", "tag": "2f992c30-d1e1-4034-a6a6-792e3ba1ffe1"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:03:29.021152 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-86215f75-13d8-465c-a311-c5f488d992b9 req-9140e912-05b4-43c4-a69e-3689c257fd76 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:29.021797 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-86215f75-13d8-465c-a311-c5f488d992b9 req-9140e912-05b4-43c4-a69e-3689c257fd76 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:29.023046 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-86215f75-13d8-465c-a311-c5f488d992b9 req-9140e912-05b4-43c4-a69e-3689c257fd76 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:29.057982 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-86215f75-13d8-465c-a311-c5f488d992b9 req-9140e912-05b4-43c4-a69e-3689c257fd76 service nova] Creating event network-changed:2f992c30-d1e1-4034-a6a6-792e3ba1ffe1 for instance 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 on n-h2-858272-3 Oct 05 03:03:29.073627 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-86215f75-13d8-465c-a311-c5f488d992b9 req-9140e912-05b4-43c4-a69e-3689c257fd76 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092175 Oct 05 03:03:29.080986 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3024/6028] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:03:36.635904 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-ab1a4539-cc42-470a-812a-681c6619d1bc req-06b1afbe-9a05-4be7-87f4-0e09fd811018 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb16ac5-263b-4180-b36f-ca3a9c7a7e00", "tag": "2f992c30-d1e1-4034-a6a6-792e3ba1ffe1"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:03:36.689826 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 03:03:36.690021 n-d-858272-3 devstack@n-api.service[122320]: Wed Oct 5 03:03:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 05 03:03:36.691269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:36.694976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=9 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:36.705127 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ab1a4539-cc42-470a-812a-681c6619d1bc req-06b1afbe-9a05-4be7-87f4-0e09fd811018 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:36.705906 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ab1a4539-cc42-470a-812a-681c6619d1bc req-06b1afbe-9a05-4be7-87f4-0e09fd811018 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:36.714329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ab1a4539-cc42-470a-812a-681c6619d1bc req-06b1afbe-9a05-4be7-87f4-0e09fd811018 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:36.783581 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-ab1a4539-cc42-470a-812a-681c6619d1bc req-06b1afbe-9a05-4be7-87f4-0e09fd811018 service nova] Creating event network-changed:2f992c30-d1e1-4034-a6a6-792e3ba1ffe1 for instance 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 on n-h2-858272-3 Oct 05 03:03:36.808143 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-ab1a4539-cc42-470a-812a-681c6619d1bc req-06b1afbe-9a05-4be7-87f4-0e09fd811018 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172915 Oct 05 03:03:36.811163 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3005/6029] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:03:38.831709 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-021d11bb-05ad-4b0d-b238-778db5f590b3 req-800acbda-3004-475f-b4cd-65a6b5a120a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb16ac5-263b-4180-b36f-ca3a9c7a7e00", "tag": "2f992c30-d1e1-4034-a6a6-792e3ba1ffe1"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:03:38.840927 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=56 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:38.881197 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-021d11bb-05ad-4b0d-b238-778db5f590b3 req-800acbda-3004-475f-b4cd-65a6b5a120a0 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:38.881796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-021d11bb-05ad-4b0d-b238-778db5f590b3 req-800acbda-3004-475f-b4cd-65a6b5a120a0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:38.882419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-021d11bb-05ad-4b0d-b238-778db5f590b3 req-800acbda-3004-475f-b4cd-65a6b5a120a0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:38.963656 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-021d11bb-05ad-4b0d-b238-778db5f590b3 req-800acbda-3004-475f-b4cd-65a6b5a120a0 service nova] Creating event network-changed:2f992c30-d1e1-4034-a6a6-792e3ba1ffe1 for instance 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 on n-h2-858272-3 Oct 05 03:03:38.976764 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-021d11bb-05ad-4b0d-b238-778db5f590b3 req-800acbda-3004-475f-b4cd-65a6b5a120a0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148914 Oct 05 03:03:38.979733 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3025/6030] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:03:39.691872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-028148a2-0dfb-4985-a8c7-ab540c46b297 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Action: 'create', calling method: .version_select at 0x7fccde8cd550>, body: {"keypair": {"name": "tempest-keypair-488209073", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgK0TcPTBpXPoqbY/jW//Lpe5ClzdKoL5YQ+w+/ZRwURADNlbt2q0oAM/oA1r04NDsJSUNQ/SyqivHZmMxbLfGoUdDAxAjDLGC3Ak1L6h1MZVfS7tn1uTYyIs4AN9fHeg=="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:03:39.716316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-028148a2-0dfb-4985-a8c7-ab540c46b297 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Getting quotas for project 7b99b6a5b1764f64a68793f37d4f9b96. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:03:39.741410 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-028148a2-0dfb-4985-a8c7-ab540c46b297 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Getting quotas for user 881baf1ede7e4fb5acf65268a81241ad and project 7b99b6a5b1764f64a68793f37d4f9b96. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:03:39.802902 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-028148a2-0dfb-4985-a8c7-ab540c46b297 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.382365 Oct 05 03:03:39.811102 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3006/6031] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 03:03:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:03:43.234048 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-11681078-e6c1-4616-b0cb-59fe6029717c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1326129442", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dbc27df4-8913-4a58-8837-a72d1d361dca"}], "security_groups": [{"name": "tempest-securitygroup--433834653"}], "key_name": "tempest-keypair-488209073", "user_data": "}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:03:43.459488 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-11681078-e6c1-4616-b0cb-59fe6029717c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] validate_networks() for [('dbc27df4-8913-4a58-8837-a72d1d361dca', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:03:44.236375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-11681078-e6c1-4616-b0cb-59fe6029717c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:03:44.237130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-11681078-e6c1-4616-b0cb-59fe6029717c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:03:44.237565 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-11681078-e6c1-4616-b0cb-59fe6029717c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:03:44.237985 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-11681078-e6c1-4616-b0cb-59fe6029717c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:03:44.241747 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-11681078-e6c1-4616-b0cb-59fe6029717c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:03:44.259207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11681078-e6c1-4616-b0cb-59fe6029717c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:44.259731 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11681078-e6c1-4616-b0cb-59fe6029717c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:44.260405 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11681078-e6c1-4616-b0cb-59fe6029717c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:44.264060 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11681078-e6c1-4616-b0cb-59fe6029717c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:44.264880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11681078-e6c1-4616-b0cb-59fe6029717c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:44.265542 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11681078-e6c1-4616-b0cb-59fe6029717c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:44.336016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-11681078-e6c1-4616-b0cb-59fe6029717c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Getting quotas for project 7b99b6a5b1764f64a68793f37d4f9b96. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:03:44.349673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-11681078-e6c1-4616-b0cb-59fe6029717c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Getting quotas for user 881baf1ede7e4fb5acf65268a81241ad and project 7b99b6a5b1764f64a68793f37d4f9b96. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:03:44.371983 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-11681078-e6c1-4616-b0cb-59fe6029717c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:03:44.377348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-11681078-e6c1-4616-b0cb-59fe6029717c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:03:44.447610 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-11681078-e6c1-4616-b0cb-59fe6029717c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.225722 Oct 05 03:03:44.448388 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3026/6032] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:03:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 1228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:03:44.467291 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5e62dc00-0957-430c-8e53-79217fb42b69 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:44.468714 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5e62dc00-0957-430c-8e53-79217fb42b69 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:44.556954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5e62dc00-0957-430c-8e53-79217fb42b69 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:44.564337 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5e62dc00-0957-430c-8e53-79217fb42b69 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9" status: 200 len: 1241 microversion: 2.1 time: 0.106537 Oct 05 03:03:44.567208 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3007/6033] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:44 2022] GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 => generated 1241 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:03:45.591897 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5900ca31-5909-43da-993c-b89357958dd3 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:45.592781 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5900ca31-5909-43da-993c-b89357958dd3 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:45.735514 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5900ca31-5909-43da-993c-b89357958dd3 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:45.745601 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5900ca31-5909-43da-993c-b89357958dd3 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9" status: 200 len: 1241 microversion: 2.1 time: 0.158030 Oct 05 03:03:45.753031 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3008/6034] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:45 2022] GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 => generated 1241 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:45.827227 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e1f4e29b-9e65-42ee-bc1e-37140d5be1d0 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Action: 'create', calling method: .version_select at 0x7fccdf196280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2094650385", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCy1VQ5VEMuumzNwiEe4Z/qHaVQWZbadufezBZTHBGoKX3n8p1I3X1+VjkZONsQbD2pp6aDHrS/VZJiXqGkY/us3fKNZilaQiz1F0Ic+/AnPwfnCG3ptMOeDFvD6+KiE4g=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:03:45.876845 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-e1f4e29b-9e65-42ee-bc1e-37140d5be1d0 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Getting quotas for project a86e3137c6764eeb948b9c7dab895c34. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:03:45.886778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-e1f4e29b-9e65-42ee-bc1e-37140d5be1d0 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Getting quotas for user ad3a53da0c764f0a893966aea6505fa7 and project a86e3137c6764eeb948b9c7dab895c34. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:03:45.943087 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e1f4e29b-9e65-42ee-bc1e-37140d5be1d0 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.512363 Oct 05 03:03:45.944365 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3027/6035] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 03:03:45 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:03:46.772931 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-955fafe3-0e5d-4dd5-a566-06178cbf7d63 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:46.775974 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-955fafe3-0e5d-4dd5-a566-06178cbf7d63 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:46.800891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:46.803244 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-955fafe3-0e5d-4dd5-a566-06178cbf7d63 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:46.806504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-955fafe3-0e5d-4dd5-a566-06178cbf7d63 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:46.807327 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-955fafe3-0e5d-4dd5-a566-06178cbf7d63 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:46.809457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-955fafe3-0e5d-4dd5-a566-06178cbf7d63 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:46.810069 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-955fafe3-0e5d-4dd5-a566-06178cbf7d63 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:46.811843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-955fafe3-0e5d-4dd5-a566-06178cbf7d63 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:47.190998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-955fafe3-0e5d-4dd5-a566-06178cbf7d63 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:47.214429 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-955fafe3-0e5d-4dd5-a566-06178cbf7d63 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9" status: 200 len: 1299 microversion: 2.1 time: 0.445473 Oct 05 03:03:47.215664 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3009/6036] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:46 2022] GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 => generated 1299 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:48.245389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a8471783-42f8-4f44-b3da-828bf44dce5f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:48.246076 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a8471783-42f8-4f44-b3da-828bf44dce5f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:48.259656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8471783-42f8-4f44-b3da-828bf44dce5f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:48.260475 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8471783-42f8-4f44-b3da-828bf44dce5f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:48.261143 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8471783-42f8-4f44-b3da-828bf44dce5f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:48.262439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8471783-42f8-4f44-b3da-828bf44dce5f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:48.263446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8471783-42f8-4f44-b3da-828bf44dce5f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:48.264089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8471783-42f8-4f44-b3da-828bf44dce5f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:48.268189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=66 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:48.579159 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a8471783-42f8-4f44-b3da-828bf44dce5f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:48.589394 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a8471783-42f8-4f44-b3da-828bf44dce5f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9" status: 200 len: 1366 microversion: 2.1 time: 0.351467 Oct 05 03:03:48.593294 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3028/6037] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:48 2022] GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 => generated 1366 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:49.594963 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-2a01ee6b-577d-4d08-bb66-394fd3f7cb3a req-18eb7a43-0ab8-4e6f-bd76-98f6685d9ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9", "tag": "7b878a19-3085-4472-97f6-453e6e753a7e"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:03:49.611842 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-2a01ee6b-577d-4d08-bb66-394fd3f7cb3a req-18eb7a43-0ab8-4e6f-bd76-98f6685d9ad5 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:49.613188 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-2a01ee6b-577d-4d08-bb66-394fd3f7cb3a req-18eb7a43-0ab8-4e6f-bd76-98f6685d9ad5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:49.613825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-2a01ee6b-577d-4d08-bb66-394fd3f7cb3a req-18eb7a43-0ab8-4e6f-bd76-98f6685d9ad5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:49.626249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a48f7a8b-7a6a-4420-9243-36aab2ba053d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:49.627728 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a48f7a8b-7a6a-4420-9243-36aab2ba053d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:49.642126 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a48f7a8b-7a6a-4420-9243-36aab2ba053d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:49.642960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a48f7a8b-7a6a-4420-9243-36aab2ba053d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:49.643634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a48f7a8b-7a6a-4420-9243-36aab2ba053d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:49.645944 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a48f7a8b-7a6a-4420-9243-36aab2ba053d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:49.648214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a48f7a8b-7a6a-4420-9243-36aab2ba053d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:49.664402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a48f7a8b-7a6a-4420-9243-36aab2ba053d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:49.668148 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-2a01ee6b-577d-4d08-bb66-394fd3f7cb3a req-18eb7a43-0ab8-4e6f-bd76-98f6685d9ad5 service nova] Creating event network-changed:7b878a19-3085-4472-97f6-453e6e753a7e for instance 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 on n-h1-858272-3 Oct 05 03:03:49.685258 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-2a01ee6b-577d-4d08-bb66-394fd3f7cb3a req-18eb7a43-0ab8-4e6f-bd76-98f6685d9ad5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103093 Oct 05 03:03:49.690115 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3010/6038] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:03:49.958459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a48f7a8b-7a6a-4420-9243-36aab2ba053d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:49.970285 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a48f7a8b-7a6a-4420-9243-36aab2ba053d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9" status: 200 len: 1366 microversion: 2.1 time: 0.347818 Oct 05 03:03:50.002205 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3029/6039] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:49 2022] GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 => generated 1366 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:03:51.013762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-23a7d067-0622-4744-b015-737cb718965b tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:51.014475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-23a7d067-0622-4744-b015-737cb718965b tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:51.022566 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23a7d067-0622-4744-b015-737cb718965b tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:51.023307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23a7d067-0622-4744-b015-737cb718965b tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:51.024036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23a7d067-0622-4744-b015-737cb718965b tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:51.026099 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23a7d067-0622-4744-b015-737cb718965b tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:51.027507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23a7d067-0622-4744-b015-737cb718965b tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:51.028181 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23a7d067-0622-4744-b015-737cb718965b tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:51.345541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-23a7d067-0622-4744-b015-737cb718965b tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:51.355359 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-23a7d067-0622-4744-b015-737cb718965b tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9" status: 200 len: 1366 microversion: 2.1 time: 0.348769 Oct 05 03:03:51.355965 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3011/6040] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:51 2022] GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 => generated 1366 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:52.385106 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5eb3c543-1de5-486b-a5ec-4652ab45bf19 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:52.388476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5eb3c543-1de5-486b-a5ec-4652ab45bf19 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:52.405846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5eb3c543-1de5-486b-a5ec-4652ab45bf19 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:52.408876 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5eb3c543-1de5-486b-a5ec-4652ab45bf19 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:52.410928 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5eb3c543-1de5-486b-a5ec-4652ab45bf19 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:52.411811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5eb3c543-1de5-486b-a5ec-4652ab45bf19 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:52.412373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5eb3c543-1de5-486b-a5ec-4652ab45bf19 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:52.416319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5eb3c543-1de5-486b-a5ec-4652ab45bf19 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:52.950255 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5eb3c543-1de5-486b-a5ec-4652ab45bf19 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:52.967192 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5eb3c543-1de5-486b-a5ec-4652ab45bf19 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9" status: 200 len: 1366 microversion: 2.1 time: 0.592085 Oct 05 03:03:52.969983 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3030/6041] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:52 2022] GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 => generated 1366 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:54.003485 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a90dfae1-4c6f-43d6-853e-00654cdac53f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:54.011151 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a90dfae1-4c6f-43d6-853e-00654cdac53f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:54.054296 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a90dfae1-4c6f-43d6-853e-00654cdac53f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:54.054852 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a90dfae1-4c6f-43d6-853e-00654cdac53f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:54.055536 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a90dfae1-4c6f-43d6-853e-00654cdac53f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:54.056665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a90dfae1-4c6f-43d6-853e-00654cdac53f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:54.057479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a90dfae1-4c6f-43d6-853e-00654cdac53f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:54.058707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a90dfae1-4c6f-43d6-853e-00654cdac53f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:54.329113 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a90dfae1-4c6f-43d6-853e-00654cdac53f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:54.352315 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a90dfae1-4c6f-43d6-853e-00654cdac53f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9" status: 200 len: 1366 microversion: 2.1 time: 0.356753 Oct 05 03:03:54.368974 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3012/6042] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:53 2022] GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 => generated 1366 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:55.378285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e7791852-7217-4a6f-b2c9-33aee336df2a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:55.378914 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e7791852-7217-4a6f-b2c9-33aee336df2a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:55.388009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:55.400747 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7791852-7217-4a6f-b2c9-33aee336df2a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:55.402878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7791852-7217-4a6f-b2c9-33aee336df2a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:55.403773 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7791852-7217-4a6f-b2c9-33aee336df2a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:55.406016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7791852-7217-4a6f-b2c9-33aee336df2a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:55.407472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7791852-7217-4a6f-b2c9-33aee336df2a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:55.409117 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e7791852-7217-4a6f-b2c9-33aee336df2a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:55.783941 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e7791852-7217-4a6f-b2c9-33aee336df2a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:55.797722 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e7791852-7217-4a6f-b2c9-33aee336df2a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9" status: 200 len: 1366 microversion: 2.1 time: 0.419554 Oct 05 03:03:55.798373 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3031/6043] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:55 2022] GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 => generated 1366 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:03:55.833172 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f708cc64-ba5e-4218-9645-36507617a082 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1057413760", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "1c2032cb-4a9e-40e1-a1cb-e977ca735a19"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2094650385", "security_groups": [{"name": "tempest-secgroup-smoke-54724840"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:03:55.860194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=8 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:55.995253 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-f708cc64-ba5e-4218-9645-36507617a082 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] validate_networks() for [('1c2032cb-4a9e-40e1-a1cb-e977ca735a19', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:03:56.616929 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-f708cc64-ba5e-4218-9645-36507617a082 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:03:56.617466 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-f708cc64-ba5e-4218-9645-36507617a082 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:03:56.619671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-f708cc64-ba5e-4218-9645-36507617a082 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:03:56.620215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-f708cc64-ba5e-4218-9645-36507617a082 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:03:56.620993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-f708cc64-ba5e-4218-9645-36507617a082 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:03:56.632798 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f708cc64-ba5e-4218-9645-36507617a082 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:56.634280 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f708cc64-ba5e-4218-9645-36507617a082 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:56.635130 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f708cc64-ba5e-4218-9645-36507617a082 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:56.636091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f708cc64-ba5e-4218-9645-36507617a082 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:56.636763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f708cc64-ba5e-4218-9645-36507617a082 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:56.637719 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f708cc64-ba5e-4218-9645-36507617a082 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:56.678655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-f708cc64-ba5e-4218-9645-36507617a082 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Getting quotas for project a86e3137c6764eeb948b9c7dab895c34. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:03:56.686838 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-f708cc64-ba5e-4218-9645-36507617a082 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Getting quotas for user ad3a53da0c764f0a893966aea6505fa7 and project a86e3137c6764eeb948b9c7dab895c34. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:03:56.704166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f708cc64-ba5e-4218-9645-36507617a082 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:03:56.706793 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f708cc64-ba5e-4218-9645-36507617a082 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:03:56.825694 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f708cc64-ba5e-4218-9645-36507617a082 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.995646 Oct 05 03:03:56.826443 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3013/6044] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:03:55 2022] POST /compute/v2.1/servers => generated 404 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:03:56.841966 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fba3e040-602a-49d8-a3ba-2f944fdf37e9 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:56.843116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fba3e040-602a-49d8-a3ba-2f944fdf37e9 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:56.855550 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d2b757be-e8e2-4c5d-ac98-ac278607ad71 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:56.858618 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=10 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:56.862474 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fba3e040-602a-49d8-a3ba-2f944fdf37e9 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:56.863606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fba3e040-602a-49d8-a3ba-2f944fdf37e9 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:56.864449 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fba3e040-602a-49d8-a3ba-2f944fdf37e9 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:56.866212 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fba3e040-602a-49d8-a3ba-2f944fdf37e9 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:56.867014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fba3e040-602a-49d8-a3ba-2f944fdf37e9 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:56.867850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fba3e040-602a-49d8-a3ba-2f944fdf37e9 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:56.873861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d2b757be-e8e2-4c5d-ac98-ac278607ad71 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:57.037902 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d2b757be-e8e2-4c5d-ac98-ac278607ad71 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:57.047099 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d2b757be-e8e2-4c5d-ac98-ac278607ad71 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1267 microversion: 2.1 time: 0.212574 Oct 05 03:03:57.073246 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3014/6045] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:56 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1267 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:57.185846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fba3e040-602a-49d8-a3ba-2f944fdf37e9 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:57.199827 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fba3e040-602a-49d8-a3ba-2f944fdf37e9 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9" status: 200 len: 1366 microversion: 2.1 time: 0.374178 Oct 05 03:03:57.213238 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3032/6046] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:56 2022] GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 => generated 1366 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:57.924723 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-bd9d0d6c-65c4-4ffb-95b9-2e69ab1d2a11 req-dca42338-fa42-4471-a914-d26dee45da06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9", "name": "network-vif-plugged", "status": "completed", "tag": "7b878a19-3085-4472-97f6-453e6e753a7e"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:03:57.942685 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-bd9d0d6c-65c4-4ffb-95b9-2e69ab1d2a11 req-dca42338-fa42-4471-a914-d26dee45da06 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:57.945075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-bd9d0d6c-65c4-4ffb-95b9-2e69ab1d2a11 req-dca42338-fa42-4471-a914-d26dee45da06 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:57.947641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-bd9d0d6c-65c4-4ffb-95b9-2e69ab1d2a11 req-dca42338-fa42-4471-a914-d26dee45da06 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:57.976235 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-bd9d0d6c-65c4-4ffb-95b9-2e69ab1d2a11 req-dca42338-fa42-4471-a914-d26dee45da06 service nova] Creating event network-vif-plugged:7b878a19-3085-4472-97f6-453e6e753a7e for instance 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 on n-h1-858272-3 Oct 05 03:03:57.989872 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-bd9d0d6c-65c4-4ffb-95b9-2e69ab1d2a11 req-dca42338-fa42-4471-a914-d26dee45da06 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188572 Oct 05 03:03:57.991564 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3015/6047] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:03:58.084057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ddc65e1a-b3a6-4e56-9610-9310d5ddbe9b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:58.089753 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ddc65e1a-b3a6-4e56-9610-9310d5ddbe9b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:58.106191 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ddc65e1a-b3a6-4e56-9610-9310d5ddbe9b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:58.119368 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ddc65e1a-b3a6-4e56-9610-9310d5ddbe9b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:58.120126 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ddc65e1a-b3a6-4e56-9610-9310d5ddbe9b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:58.121419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ddc65e1a-b3a6-4e56-9610-9310d5ddbe9b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:58.124073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ddc65e1a-b3a6-4e56-9610-9310d5ddbe9b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:58.124769 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ddc65e1a-b3a6-4e56-9610-9310d5ddbe9b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:58.233947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-551ccbd4-0339-43b7-b5f9-570106ff5e03 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:58.235033 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-551ccbd4-0339-43b7-b5f9-570106ff5e03 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:58.246998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-551ccbd4-0339-43b7-b5f9-570106ff5e03 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:58.249308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-551ccbd4-0339-43b7-b5f9-570106ff5e03 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:58.250194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-551ccbd4-0339-43b7-b5f9-570106ff5e03 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:58.252343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-551ccbd4-0339-43b7-b5f9-570106ff5e03 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:58.254221 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-551ccbd4-0339-43b7-b5f9-570106ff5e03 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:58.255784 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-551ccbd4-0339-43b7-b5f9-570106ff5e03 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:58.454729 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ddc65e1a-b3a6-4e56-9610-9310d5ddbe9b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:58.468373 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ddc65e1a-b3a6-4e56-9610-9310d5ddbe9b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1263 microversion: 2.1 time: 0.394135 Oct 05 03:03:58.469561 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3033/6048] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:58 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1263 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:03:58.712563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-551ccbd4-0339-43b7-b5f9-570106ff5e03 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:03:58.724785 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-551ccbd4-0339-43b7-b5f9-570106ff5e03 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9" status: 200 len: 1366 microversion: 2.1 time: 0.495973 Oct 05 03:03:58.728544 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3016/6049] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:58 2022] GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 => generated 1366 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:03:59.500050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-303db94d-10c5-4480-95e7-bb462d688027 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:59.501343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-303db94d-10c5-4480-95e7-bb462d688027 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:59.540640 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-303db94d-10c5-4480-95e7-bb462d688027 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:59.544367 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-303db94d-10c5-4480-95e7-bb462d688027 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:59.581846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-303db94d-10c5-4480-95e7-bb462d688027 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:59.588154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-303db94d-10c5-4480-95e7-bb462d688027 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:59.589032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-303db94d-10c5-4480-95e7-bb462d688027 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:59.589750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-303db94d-10c5-4480-95e7-bb462d688027 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:59.749345 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9a50cb3e-b24d-464e-9cb9-d4dd9b521a64 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:03:59.749999 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9a50cb3e-b24d-464e-9cb9-d4dd9b521a64 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:03:59.763263 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a50cb3e-b24d-464e-9cb9-d4dd9b521a64 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:59.764299 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a50cb3e-b24d-464e-9cb9-d4dd9b521a64 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:59.765047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a50cb3e-b24d-464e-9cb9-d4dd9b521a64 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:03:59.765991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a50cb3e-b24d-464e-9cb9-d4dd9b521a64 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:03:59.766675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a50cb3e-b24d-464e-9cb9-d4dd9b521a64 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:03:59.767355 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a50cb3e-b24d-464e-9cb9-d4dd9b521a64 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:00.224569 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-303db94d-10c5-4480-95e7-bb462d688027 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:00.233300 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-303db94d-10c5-4480-95e7-bb462d688027 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1325 microversion: 2.1 time: 0.741425 Oct 05 03:04:00.234542 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3034/6050] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:59 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1325 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:00.415208 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9a50cb3e-b24d-464e-9cb9-d4dd9b521a64 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:00.423905 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9a50cb3e-b24d-464e-9cb9-d4dd9b521a64 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9" status: 200 len: 1366 microversion: 2.1 time: 0.679926 Oct 05 03:04:00.424821 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3017/6051] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:03:59 2022] GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 => generated 1366 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:04:01.265527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4244455e-2998-4124-b3da-d930322c8cbd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:01.266716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4244455e-2998-4124-b3da-d930322c8cbd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:01.314046 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4244455e-2998-4124-b3da-d930322c8cbd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:01.315487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4244455e-2998-4124-b3da-d930322c8cbd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:01.319460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4244455e-2998-4124-b3da-d930322c8cbd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:01.320357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4244455e-2998-4124-b3da-d930322c8cbd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:01.329100 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4244455e-2998-4124-b3da-d930322c8cbd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:01.330038 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4244455e-2998-4124-b3da-d930322c8cbd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:01.448734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-44a46ae1-0a63-4a01-9de5-0e37a776cbad tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:01.449418 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-44a46ae1-0a63-4a01-9de5-0e37a776cbad tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:01.466624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44a46ae1-0a63-4a01-9de5-0e37a776cbad tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:01.469037 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44a46ae1-0a63-4a01-9de5-0e37a776cbad tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:01.491949 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44a46ae1-0a63-4a01-9de5-0e37a776cbad tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:01.493429 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44a46ae1-0a63-4a01-9de5-0e37a776cbad tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:01.495309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44a46ae1-0a63-4a01-9de5-0e37a776cbad tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:01.496150 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44a46ae1-0a63-4a01-9de5-0e37a776cbad tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:01.927582 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4244455e-2998-4124-b3da-d930322c8cbd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:01.942252 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4244455e-2998-4124-b3da-d930322c8cbd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1391 microversion: 2.1 time: 0.688714 Oct 05 03:04:01.947037 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3035/6052] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:01 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1391 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:02.039878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e693ab31-8cfe-45d3-833d-5dcbd9576adc tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:02.040705 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e693ab31-8cfe-45d3-833d-5dcbd9576adc tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:02.047224 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-44a46ae1-0a63-4a01-9de5-0e37a776cbad tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:02.047894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e693ab31-8cfe-45d3-833d-5dcbd9576adc tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:02.048742 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e693ab31-8cfe-45d3-833d-5dcbd9576adc tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:02.049035 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e693ab31-8cfe-45d3-833d-5dcbd9576adc tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:02.058503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e693ab31-8cfe-45d3-833d-5dcbd9576adc tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:02.059014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e693ab31-8cfe-45d3-833d-5dcbd9576adc tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:02.059477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e693ab31-8cfe-45d3-833d-5dcbd9576adc tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:02.065120 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-44a46ae1-0a63-4a01-9de5-0e37a776cbad tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9" status: 200 len: 1555 microversion: 2.1 time: 0.620521 Oct 05 03:04:02.066595 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3018/6053] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:01 2022] GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 => generated 1555 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:02.095015 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f971b8b6-ce6a-4a48-9d7b-cbe3da510975 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:02.095712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f971b8b6-ce6a-4a48-9d7b-cbe3da510975 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:02.109844 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f971b8b6-ce6a-4a48-9d7b-cbe3da510975 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:02.110612 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f971b8b6-ce6a-4a48-9d7b-cbe3da510975 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:02.111251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f971b8b6-ce6a-4a48-9d7b-cbe3da510975 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:02.113926 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f971b8b6-ce6a-4a48-9d7b-cbe3da510975 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:02.114553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f971b8b6-ce6a-4a48-9d7b-cbe3da510975 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:02.118278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f971b8b6-ce6a-4a48-9d7b-cbe3da510975 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:02.158532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e693ab31-8cfe-45d3-833d-5dcbd9576adc tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:04:02.390039 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e693ab31-8cfe-45d3-833d-5dcbd9576adc tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98" status: 204 len: 0 microversion: 2.1 time: 0.353868 Oct 05 03:04:02.390643 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3036/6054] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:04:02 2022] DELETE /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 03:04:02.400279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-438d0c26-8ff3-4fb4-aaba-8bfdaa7c8b1a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:02.401241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-438d0c26-8ff3-4fb4-aaba-8bfdaa7c8b1a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:02.409496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-438d0c26-8ff3-4fb4-aaba-8bfdaa7c8b1a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:02.410262 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-438d0c26-8ff3-4fb4-aaba-8bfdaa7c8b1a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:02.410880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-438d0c26-8ff3-4fb4-aaba-8bfdaa7c8b1a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:02.411749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-438d0c26-8ff3-4fb4-aaba-8bfdaa7c8b1a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:02.412363 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-438d0c26-8ff3-4fb4-aaba-8bfdaa7c8b1a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:02.413025 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-438d0c26-8ff3-4fb4-aaba-8bfdaa7c8b1a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:02.429829 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f971b8b6-ce6a-4a48-9d7b-cbe3da510975 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.339772 Oct 05 03:04:02.431766 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3019/6055] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 03:04:02 2022] GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9/os-interface => generated 284 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:04:02.844116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-438d0c26-8ff3-4fb4-aaba-8bfdaa7c8b1a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:02.860008 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-438d0c26-8ff3-4fb4-aaba-8bfdaa7c8b1a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98" status: 200 len: 1552 microversion: 2.1 time: 0.462518 Oct 05 03:04:02.861216 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3037/6056] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:02 2022] GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98 => generated 1552 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:02.973336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4920dd78-fe0b-400e-9101-fbc8d7392444 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:02.974744 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4920dd78-fe0b-400e-9101-fbc8d7392444 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:02.997137 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4920dd78-fe0b-400e-9101-fbc8d7392444 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:02.997817 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4920dd78-fe0b-400e-9101-fbc8d7392444 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:02.998455 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4920dd78-fe0b-400e-9101-fbc8d7392444 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:03.000494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4920dd78-fe0b-400e-9101-fbc8d7392444 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:03.002060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4920dd78-fe0b-400e-9101-fbc8d7392444 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:03.002940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4920dd78-fe0b-400e-9101-fbc8d7392444 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:03.287869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4920dd78-fe0b-400e-9101-fbc8d7392444 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:03.296715 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4920dd78-fe0b-400e-9101-fbc8d7392444 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1391 microversion: 2.1 time: 0.331444 Oct 05 03:04:03.298102 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3020/6057] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:02 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1391 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:03.426088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-58c9ab1b-c911-4cb8-a5ee-6f5b3cbf0fa2 req-0db8970e-085f-4a98-a3a3-83acb2594e23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8276749-cb0f-4aaa-a37d-10e9a99a49d3", "tag": "8821de78-ad20-42ce-9987-e279a5e9e2bc"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:04:03.446595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-58c9ab1b-c911-4cb8-a5ee-6f5b3cbf0fa2 req-0db8970e-085f-4a98-a3a3-83acb2594e23 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:03.447855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-58c9ab1b-c911-4cb8-a5ee-6f5b3cbf0fa2 req-0db8970e-085f-4a98-a3a3-83acb2594e23 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:03.448520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-58c9ab1b-c911-4cb8-a5ee-6f5b3cbf0fa2 req-0db8970e-085f-4a98-a3a3-83acb2594e23 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:03.502811 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-58c9ab1b-c911-4cb8-a5ee-6f5b3cbf0fa2 req-0db8970e-085f-4a98-a3a3-83acb2594e23 service nova] Creating event network-changed:8821de78-ad20-42ce-9987-e279a5e9e2bc for instance b8276749-cb0f-4aaa-a37d-10e9a99a49d3 on n-h2-858272-3 Oct 05 03:04:03.518885 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-58c9ab1b-c911-4cb8-a5ee-6f5b3cbf0fa2 req-0db8970e-085f-4a98-a3a3-83acb2594e23 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096652 Oct 05 03:04:03.519953 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3038/6058] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:04:03.888665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-33e633bd-f082-43e5-9159-a1e205e0b802 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:03.889411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-33e633bd-f082-43e5-9159-a1e205e0b802 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:03.905329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33e633bd-f082-43e5-9159-a1e205e0b802 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:03.905958 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33e633bd-f082-43e5-9159-a1e205e0b802 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:03.906276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33e633bd-f082-43e5-9159-a1e205e0b802 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:03.915210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33e633bd-f082-43e5-9159-a1e205e0b802 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:03.915972 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33e633bd-f082-43e5-9159-a1e205e0b802 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:03.916326 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33e633bd-f082-43e5-9159-a1e205e0b802 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:03.961914 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-bc68243d-189c-4d2a-bdc1-eed50d281142 req-4fedd874-7ffb-4417-a3c6-deab157a8110 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9", "tag": "7b878a19-3085-4472-97f6-453e6e753a7e"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:04:03.980888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-bc68243d-189c-4d2a-bdc1-eed50d281142 req-4fedd874-7ffb-4417-a3c6-deab157a8110 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:03.981858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-bc68243d-189c-4d2a-bdc1-eed50d281142 req-4fedd874-7ffb-4417-a3c6-deab157a8110 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:03.982496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-bc68243d-189c-4d2a-bdc1-eed50d281142 req-4fedd874-7ffb-4417-a3c6-deab157a8110 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:04.024981 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-bc68243d-189c-4d2a-bdc1-eed50d281142 req-4fedd874-7ffb-4417-a3c6-deab157a8110 service nova] Creating event network-changed:7b878a19-3085-4472-97f6-453e6e753a7e for instance 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 on n-h1-858272-3 Oct 05 03:04:04.056709 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-bc68243d-189c-4d2a-bdc1-eed50d281142 req-4fedd874-7ffb-4417-a3c6-deab157a8110 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099432 Oct 05 03:04:04.060232 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3039/6059] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:04:04.328498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3bab5648-b302-4379-a68b-c097886d2b11 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:04.329426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3bab5648-b302-4379-a68b-c097886d2b11 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:04.342269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bab5648-b302-4379-a68b-c097886d2b11 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:04.343720 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bab5648-b302-4379-a68b-c097886d2b11 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:04.344330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bab5648-b302-4379-a68b-c097886d2b11 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:04.345238 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bab5648-b302-4379-a68b-c097886d2b11 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:04.345875 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bab5648-b302-4379-a68b-c097886d2b11 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:04.349537 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bab5648-b302-4379-a68b-c097886d2b11 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:04.695508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-33e633bd-f082-43e5-9159-a1e205e0b802 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:04.709810 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-33e633bd-f082-43e5-9159-a1e205e0b802 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98" status: 200 len: 1552 microversion: 2.1 time: 0.825291 Oct 05 03:04:04.712342 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3021/6060] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:03 2022] GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98 => generated 1552 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:04.810970 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3bab5648-b302-4379-a68b-c097886d2b11 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:04.825970 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3bab5648-b302-4379-a68b-c097886d2b11 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1391 microversion: 2.1 time: 0.501821 Oct 05 03:04:04.838158 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3040/6061] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:04 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1391 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:04:05.740541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b81acd05-94af-4253-b260-94e64d8f5d24 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:05.741769 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b81acd05-94af-4253-b260-94e64d8f5d24 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:05.754201 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b81acd05-94af-4253-b260-94e64d8f5d24 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:05.755285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b81acd05-94af-4253-b260-94e64d8f5d24 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:05.761417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b81acd05-94af-4253-b260-94e64d8f5d24 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:05.762292 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b81acd05-94af-4253-b260-94e64d8f5d24 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:05.763099 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b81acd05-94af-4253-b260-94e64d8f5d24 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:05.763643 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b81acd05-94af-4253-b260-94e64d8f5d24 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:05.855158 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d04853a6-97a8-431e-a224-440753e32fe6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:05.855990 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d04853a6-97a8-431e-a224-440753e32fe6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:05.868814 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d04853a6-97a8-431e-a224-440753e32fe6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:05.869829 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b81acd05-94af-4253-b260-94e64d8f5d24 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:05.872418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d04853a6-97a8-431e-a224-440753e32fe6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:05.873405 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d04853a6-97a8-431e-a224-440753e32fe6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:05.874898 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d04853a6-97a8-431e-a224-440753e32fe6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:05.878842 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b81acd05-94af-4253-b260-94e64d8f5d24 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98" status: 200 len: 1484 microversion: 2.1 time: 0.143261 Oct 05 03:04:05.879521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d04853a6-97a8-431e-a224-440753e32fe6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:05.880114 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d04853a6-97a8-431e-a224-440753e32fe6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:05.893462 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3022/6062] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:05 2022] GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98 => generated 1484 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:06.081691 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d04853a6-97a8-431e-a224-440753e32fe6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:06.090338 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d04853a6-97a8-431e-a224-440753e32fe6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1391 microversion: 2.1 time: 0.239632 Oct 05 03:04:06.091402 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3041/6063] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:05 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1391 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:06.098009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-dd2ab3b5-c7e2-4bf0-ae36-2ef4eac6bfa6 req-63aeee93-f481-4e14-820e-0fb7ace4d786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98", "name": "network-vif-deleted", "tag": "fd341ff3-1d1b-4802-b759-1caf9f208c09"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:04:06.108597 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-dd2ab3b5-c7e2-4bf0-ae36-2ef4eac6bfa6 req-63aeee93-f481-4e14-820e-0fb7ace4d786 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:06.108942 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-dd2ab3b5-c7e2-4bf0-ae36-2ef4eac6bfa6 req-63aeee93-f481-4e14-820e-0fb7ace4d786 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:06.109378 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-dd2ab3b5-c7e2-4bf0-ae36-2ef4eac6bfa6 req-63aeee93-f481-4e14-820e-0fb7ace4d786 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:06.122388 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-dd2ab3b5-c7e2-4bf0-ae36-2ef4eac6bfa6 req-63aeee93-f481-4e14-820e-0fb7ace4d786 service nova] Creating event network-vif-deleted:fd341ff3-1d1b-4802-b759-1caf9f208c09 for instance ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98 on n-h2-858272-3 Oct 05 03:04:06.128187 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-dd2ab3b5-c7e2-4bf0-ae36-2ef4eac6bfa6 req-63aeee93-f481-4e14-820e-0fb7ace4d786 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033792 Oct 05 03:04:06.128797 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3023/6064] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:04:06.909806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2530b67e-d68f-45a7-a82b-9af73b5bf0a2 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:06.911129 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2530b67e-d68f-45a7-a82b-9af73b5bf0a2 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:06.922304 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2530b67e-d68f-45a7-a82b-9af73b5bf0a2 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:06.923069 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2530b67e-d68f-45a7-a82b-9af73b5bf0a2 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:06.923732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2530b67e-d68f-45a7-a82b-9af73b5bf0a2 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:06.925313 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2530b67e-d68f-45a7-a82b-9af73b5bf0a2 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:06.926143 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2530b67e-d68f-45a7-a82b-9af73b5bf0a2 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:06.926996 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2530b67e-d68f-45a7-a82b-9af73b5bf0a2 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:07.025972 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2530b67e-d68f-45a7-a82b-9af73b5bf0a2 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:07.043974 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2530b67e-d68f-45a7-a82b-9af73b5bf0a2 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98" status: 200 len: 1484 microversion: 2.1 time: 0.142175 Oct 05 03:04:07.057442 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3042/6065] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:06 2022] GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98 => generated 1484 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:07.122173 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-84182555-2a90-4aca-b665-f113807c4783 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:07.125730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-84182555-2a90-4aca-b665-f113807c4783 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:07.128261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:07.137966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=8 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:07.140624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:07.154730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84182555-2a90-4aca-b665-f113807c4783 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:07.156049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84182555-2a90-4aca-b665-f113807c4783 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:07.156568 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84182555-2a90-4aca-b665-f113807c4783 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:07.157470 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84182555-2a90-4aca-b665-f113807c4783 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:07.157945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84182555-2a90-4aca-b665-f113807c4783 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:07.158376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-84182555-2a90-4aca-b665-f113807c4783 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:07.465975 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-84182555-2a90-4aca-b665-f113807c4783 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:07.480395 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-84182555-2a90-4aca-b665-f113807c4783 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1391 microversion: 2.1 time: 0.368102 Oct 05 03:04:07.491854 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3024/6066] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:07 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1391 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:07.567949 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e897a0ab-1607-4ce2-b56d-4c29cb5d14ce tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:07.568611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e897a0ab-1607-4ce2-b56d-4c29cb5d14ce tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] [instance: 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:07.579529 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e897a0ab-1607-4ce2-b56d-4c29cb5d14ce tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:07.582403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e897a0ab-1607-4ce2-b56d-4c29cb5d14ce tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:07.582992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e897a0ab-1607-4ce2-b56d-4c29cb5d14ce tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:07.585524 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e897a0ab-1607-4ce2-b56d-4c29cb5d14ce tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:07.587200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e897a0ab-1607-4ce2-b56d-4c29cb5d14ce tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:07.590788 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e897a0ab-1607-4ce2-b56d-4c29cb5d14ce tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:07.691384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e897a0ab-1607-4ce2-b56d-4c29cb5d14ce tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] [instance: 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:04:07.748793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:07.871062 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e897a0ab-1607-4ce2-b56d-4c29cb5d14ce tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00" status: 204 len: 0 microversion: 2.1 time: 0.307339 Oct 05 03:04:07.874316 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3043/6067] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:04:07 2022] DELETE /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:04:07.884237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-00d1eef4-cfd8-4e46-92a5-aa438a69570b tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:07.884865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-00d1eef4-cfd8-4e46-92a5-aa438a69570b tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] [instance: 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:07.903573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-00d1eef4-cfd8-4e46-92a5-aa438a69570b tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:07.910045 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-00d1eef4-cfd8-4e46-92a5-aa438a69570b tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:07.912275 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-00d1eef4-cfd8-4e46-92a5-aa438a69570b tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:07.917805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-00d1eef4-cfd8-4e46-92a5-aa438a69570b tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:07.920970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-00d1eef4-cfd8-4e46-92a5-aa438a69570b tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:07.924824 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-00d1eef4-cfd8-4e46-92a5-aa438a69570b tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:08.073163 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b3fdcd35-88b1-426f-ad20-ab5fd204ce3f tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:08.073952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b3fdcd35-88b1-426f-ad20-ab5fd204ce3f tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:08.103200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3fdcd35-88b1-426f-ad20-ab5fd204ce3f tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:08.103706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3fdcd35-88b1-426f-ad20-ab5fd204ce3f tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:08.104159 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3fdcd35-88b1-426f-ad20-ab5fd204ce3f tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:08.108702 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3fdcd35-88b1-426f-ad20-ab5fd204ce3f tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:08.109401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3fdcd35-88b1-426f-ad20-ab5fd204ce3f tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:08.112265 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3fdcd35-88b1-426f-ad20-ab5fd204ce3f tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:08.178891 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-b3fdcd35-88b1-426f-ad20-ab5fd204ce3f tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] HTTP exception thrown: Instance ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98 could not be found. Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b3fdcd35-88b1-426f-ad20-ab5fd204ce3f tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Request method failure captured: Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98 HTTP/1.1 Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPNwznjwkzH4385Wmuu9gocROGuZ13TcZ43NcOOcOW7e_9P-997tIaVKKhvNDp8ALbJmk_WuhGmG9xxcH80ub6_kQqWwVWVE7-M3rSmqWehT07GjEPso6ybD-TIikPlBsrl6Tw4psm4dWeeSOAfEZO3e9X3oOax0DgXMkw6OnmHwO5A Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 5152e5e306d2474bac12338a8e722a00 Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TestNetworkBasicOps-207914990 Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5152e5e306d2474bac12338a8e722a00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5152e5e306d2474bac12338a8e722a00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5152e5e306d2474bac12338a8e722a00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5152e5e306d2474bac12338a8e722a00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TestNetworkBasicOps-207914990 Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 5152e5e306d2474bac12338a8e722a00 Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TestNetworkBasicOps-207914990 Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TestNetworkBasicOps-207914990-project Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 67c2b26730184ce58b866e37ebe43794 Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TestNetworkBasicOps-207914990-project Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98 could not be found. Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98'} Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98 could not be found. Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98 could not be found. Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:04:08.182494 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:04:08.187155 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:04:08.187155 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:04:08.187155 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:04:08.187155 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:04:08.187155 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:04:08.187155 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98 could not be found. Oct 05 03:04:08.187155 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:04:08.192182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b3fdcd35-88b1-426f-ad20-ab5fd204ce3f tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Returning 404 to user: Instance ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:04:08.194052 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b3fdcd35-88b1-426f-ad20-ab5fd204ce3f tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98" status: 404 len: 111 microversion: 2.1 time: 0.125520 Oct 05 03:04:08.197417 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3044/6068] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:08 2022] GET /compute/v2.1/servers/ea07d1a7-34d1-4732-90e6-ea8bd0ac4d98 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 03:04:08.219819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-446e9580-6f05-4cc5-b506-b6b848598cf7 req-7d9cd8c2-1efc-497a-a41c-0aea1a9a97be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb16ac5-263b-4180-b36f-ca3a9c7a7e00", "tag": "2f992c30-d1e1-4034-a6a6-792e3ba1ffe1"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:04:08.259790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-446e9580-6f05-4cc5-b506-b6b848598cf7 req-7d9cd8c2-1efc-497a-a41c-0aea1a9a97be service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:08.262850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-446e9580-6f05-4cc5-b506-b6b848598cf7 req-7d9cd8c2-1efc-497a-a41c-0aea1a9a97be service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:08.263438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-446e9580-6f05-4cc5-b506-b6b848598cf7 req-7d9cd8c2-1efc-497a-a41c-0aea1a9a97be service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:08.291344 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-446e9580-6f05-4cc5-b506-b6b848598cf7 req-7d9cd8c2-1efc-497a-a41c-0aea1a9a97be service nova] Creating event network-changed:2f992c30-d1e1-4034-a6a6-792e3ba1ffe1 for instance 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 on n-h2-858272-3 Oct 05 03:04:08.299492 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-446e9580-6f05-4cc5-b506-b6b848598cf7 req-7d9cd8c2-1efc-497a-a41c-0aea1a9a97be service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091604 Oct 05 03:04:08.300435 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3045/6069] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:04:08.345624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-00d1eef4-cfd8-4e46-92a5-aa438a69570b tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329523b6f089401face7b477d08ca7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feef1976405a442eb7ee441d12c9a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:08.358559 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-00d1eef4-cfd8-4e46-92a5-aa438a69570b tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00" status: 200 len: 1580 microversion: 2.1 time: 0.479486 Oct 05 03:04:08.374790 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3025/6070] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:07 2022] GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 => generated 1580 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:08.506901 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5796f0e3-ba6d-4f30-a89e-f257f5554479 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:08.507706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5796f0e3-ba6d-4f30-a89e-f257f5554479 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:08.520709 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5796f0e3-ba6d-4f30-a89e-f257f5554479 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:08.521304 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5796f0e3-ba6d-4f30-a89e-f257f5554479 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:08.521962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5796f0e3-ba6d-4f30-a89e-f257f5554479 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:08.526654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5796f0e3-ba6d-4f30-a89e-f257f5554479 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:08.527158 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5796f0e3-ba6d-4f30-a89e-f257f5554479 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:08.527673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5796f0e3-ba6d-4f30-a89e-f257f5554479 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:08.533190 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-71530689-140a-4413-a6c2-79ee7f874f1d tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '.version_select at 0x7fccdef999d0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:08.626042 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-71530689-140a-4413-a6c2-79ee7f874f1d tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-878525032" status: 202 len: 0 microversion: 2.1 time: 0.096380 Oct 05 03:04:08.630494 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3026/6071] 10.222.0.16 () {58 vars in 1254 bytes} [Wed Oct 5 03:04:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-878525032 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 03:04:08.947484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5796f0e3-ba6d-4f30-a89e-f257f5554479 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:08.959941 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5796f0e3-ba6d-4f30-a89e-f257f5554479 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1391 microversion: 2.1 time: 0.457121 Oct 05 03:04:08.960552 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3046/6072] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:08 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1391 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:09.404449 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1692af40-9f4f-475e-83b2-947c17a440db tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:09.405270 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1692af40-9f4f-475e-83b2-947c17a440db tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] [instance: 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:09.412692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1692af40-9f4f-475e-83b2-947c17a440db tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:09.413464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1692af40-9f4f-475e-83b2-947c17a440db tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:09.414063 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1692af40-9f4f-475e-83b2-947c17a440db tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:09.416026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1692af40-9f4f-475e-83b2-947c17a440db tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:09.417104 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1692af40-9f4f-475e-83b2-947c17a440db tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:09.417700 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1692af40-9f4f-475e-83b2-947c17a440db tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:09.643352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1692af40-9f4f-475e-83b2-947c17a440db tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329523b6f089401face7b477d08ca7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feef1976405a442eb7ee441d12c9a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:09.657012 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1692af40-9f4f-475e-83b2-947c17a440db tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00" status: 200 len: 1580 microversion: 2.1 time: 0.256086 Oct 05 03:04:09.681490 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3027/6073] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:09 2022] GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 => generated 1580 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:09.990659 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d55fce58-79b7-46a2-b6f6-93d26701e10e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:09.991913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d55fce58-79b7-46a2-b6f6-93d26701e10e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:10.000798 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:10.011643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d55fce58-79b7-46a2-b6f6-93d26701e10e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:10.020945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d55fce58-79b7-46a2-b6f6-93d26701e10e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:10.021502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d55fce58-79b7-46a2-b6f6-93d26701e10e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:10.022330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d55fce58-79b7-46a2-b6f6-93d26701e10e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:10.022986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d55fce58-79b7-46a2-b6f6-93d26701e10e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:10.023641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d55fce58-79b7-46a2-b6f6-93d26701e10e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:10.363913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d55fce58-79b7-46a2-b6f6-93d26701e10e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:10.386426 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d55fce58-79b7-46a2-b6f6-93d26701e10e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1391 microversion: 2.1 time: 0.403291 Oct 05 03:04:10.387963 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3047/6074] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:09 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1391 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:10.461884 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-86a83f40-947f-4346-b716-e9a7d97026b1 req-a42205c8-2cd7-457c-9d4b-8e467aa81760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8276749-cb0f-4aaa-a37d-10e9a99a49d3", "name": "network-vif-plugged", "status": "completed", "tag": "8821de78-ad20-42ce-9987-e279a5e9e2bc"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:04:10.475482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-86a83f40-947f-4346-b716-e9a7d97026b1 req-a42205c8-2cd7-457c-9d4b-8e467aa81760 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:10.476305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-86a83f40-947f-4346-b716-e9a7d97026b1 req-a42205c8-2cd7-457c-9d4b-8e467aa81760 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:10.477628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-86a83f40-947f-4346-b716-e9a7d97026b1 req-a42205c8-2cd7-457c-9d4b-8e467aa81760 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:10.492805 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-86a83f40-947f-4346-b716-e9a7d97026b1 req-a42205c8-2cd7-457c-9d4b-8e467aa81760 service nova] Creating event network-vif-plugged:8821de78-ad20-42ce-9987-e279a5e9e2bc for instance b8276749-cb0f-4aaa-a37d-10e9a99a49d3 on n-h2-858272-3 Oct 05 03:04:10.501799 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-86a83f40-947f-4346-b716-e9a7d97026b1 req-a42205c8-2cd7-457c-9d4b-8e467aa81760 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044498 Oct 05 03:04:10.505100 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3028/6075] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:04:10.688474 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bd4cd84d-803e-4984-9ec1-3046dda4a3bb tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:10.690113 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bd4cd84d-803e-4984-9ec1-3046dda4a3bb tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] [instance: 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:10.706290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd4cd84d-803e-4984-9ec1-3046dda4a3bb tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:10.709369 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd4cd84d-803e-4984-9ec1-3046dda4a3bb tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:10.710265 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd4cd84d-803e-4984-9ec1-3046dda4a3bb tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:10.713439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd4cd84d-803e-4984-9ec1-3046dda4a3bb tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:10.714137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd4cd84d-803e-4984-9ec1-3046dda4a3bb tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:10.714790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd4cd84d-803e-4984-9ec1-3046dda4a3bb tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:11.190891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-0397f64a-12c7-4794-a796-ae2d3964defc req-85233c90-6ae1-4307-baed-6681d7ae48f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb16ac5-263b-4180-b36f-ca3a9c7a7e00", "name": "network-vif-deleted", "tag": "2f992c30-d1e1-4034-a6a6-792e3ba1ffe1"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:04:11.201963 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-0397f64a-12c7-4794-a796-ae2d3964defc req-85233c90-6ae1-4307-baed-6681d7ae48f2 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:11.202553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-0397f64a-12c7-4794-a796-ae2d3964defc req-85233c90-6ae1-4307-baed-6681d7ae48f2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:11.203050 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-0397f64a-12c7-4794-a796-ae2d3964defc req-85233c90-6ae1-4307-baed-6681d7ae48f2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:11.215233 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-0397f64a-12c7-4794-a796-ae2d3964defc req-85233c90-6ae1-4307-baed-6681d7ae48f2 service nova] Creating event network-vif-deleted:2f992c30-d1e1-4034-a6a6-792e3ba1ffe1 for instance 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 on n-h2-858272-3 Oct 05 03:04:11.222606 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-0397f64a-12c7-4794-a796-ae2d3964defc req-85233c90-6ae1-4307-baed-6681d7ae48f2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035764 Oct 05 03:04:11.230320 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3029/6076] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:04:11.415796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3ff4f296-4b68-4863-8489-43411edfe52c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:11.417848 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3ff4f296-4b68-4863-8489-43411edfe52c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:11.424872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3ff4f296-4b68-4863-8489-43411edfe52c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:11.425362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3ff4f296-4b68-4863-8489-43411edfe52c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:11.426613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3ff4f296-4b68-4863-8489-43411edfe52c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:11.427331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3ff4f296-4b68-4863-8489-43411edfe52c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:11.427960 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3ff4f296-4b68-4863-8489-43411edfe52c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:11.428563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3ff4f296-4b68-4863-8489-43411edfe52c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:11.622855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bd4cd84d-803e-4984-9ec1-3046dda4a3bb tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329523b6f089401face7b477d08ca7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feef1976405a442eb7ee441d12c9a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:11.669993 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bd4cd84d-803e-4984-9ec1-3046dda4a3bb tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00" status: 200 len: 1462 microversion: 2.1 time: 0.989557 Oct 05 03:04:11.698217 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3048/6077] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:10 2022] GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 => generated 1462 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:11.864287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3ff4f296-4b68-4863-8489-43411edfe52c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:11.881044 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3ff4f296-4b68-4863-8489-43411edfe52c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1391 microversion: 2.1 time: 0.470189 Oct 05 03:04:11.890890 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3030/6078] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:11 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1391 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:04:12.697172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c644412b-ac62-4e29-a507-c2e3d858c858 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:12.697172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c644412b-ac62-4e29-a507-c2e3d858c858 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] [instance: 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:12.712520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c644412b-ac62-4e29-a507-c2e3d858c858 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:12.713103 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c644412b-ac62-4e29-a507-c2e3d858c858 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:12.713554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c644412b-ac62-4e29-a507-c2e3d858c858 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:12.714275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c644412b-ac62-4e29-a507-c2e3d858c858 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:12.714741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c644412b-ac62-4e29-a507-c2e3d858c858 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:12.715172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c644412b-ac62-4e29-a507-c2e3d858c858 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:12.877409 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c644412b-ac62-4e29-a507-c2e3d858c858 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329523b6f089401face7b477d08ca7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feef1976405a442eb7ee441d12c9a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:12.896752 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c644412b-ac62-4e29-a507-c2e3d858c858 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00" status: 200 len: 1229 microversion: 2.1 time: 0.200868 Oct 05 03:04:12.897247 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-60f37116-c02b-4756-82f4-3e23a4387317 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:12.897751 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-60f37116-c02b-4756-82f4-3e23a4387317 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 16f4a218-7c09-4282-9670-6b280970a99f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:12.899586 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3049/6079] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:12 2022] GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 => generated 1229 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:12.914764 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60f37116-c02b-4756-82f4-3e23a4387317 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:12.915488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60f37116-c02b-4756-82f4-3e23a4387317 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:12.916203 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60f37116-c02b-4756-82f4-3e23a4387317 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:12.917088 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60f37116-c02b-4756-82f4-3e23a4387317 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:12.917688 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60f37116-c02b-4756-82f4-3e23a4387317 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:12.918284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60f37116-c02b-4756-82f4-3e23a4387317 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:12.929215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-29729f82-4533-40f6-ab40-45f30c8ee1ea req-45d661a2-3130-4f66-af03-e928a71067ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16f4a218-7c09-4282-9670-6b280970a99f", "tag": "51dd156b-188b-4a9d-9e0a-c45fac1f9f55"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:04:12.947942 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-29729f82-4533-40f6-ab40-45f30c8ee1ea req-45d661a2-3130-4f66-af03-e928a71067ae service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:12.948435 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-29729f82-4533-40f6-ab40-45f30c8ee1ea req-45d661a2-3130-4f66-af03-e928a71067ae service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:12.948874 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-29729f82-4533-40f6-ab40-45f30c8ee1ea req-45d661a2-3130-4f66-af03-e928a71067ae service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:12.971916 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-29729f82-4533-40f6-ab40-45f30c8ee1ea req-45d661a2-3130-4f66-af03-e928a71067ae service nova] Creating event network-changed:51dd156b-188b-4a9d-9e0a-c45fac1f9f55 for instance 16f4a218-7c09-4282-9670-6b280970a99f on n-h2-858272-3 Oct 05 03:04:12.978675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-60f37116-c02b-4756-82f4-3e23a4387317 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 16f4a218-7c09-4282-9670-6b280970a99f] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:04:12.979339 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-29729f82-4533-40f6-ab40-45f30c8ee1ea req-45d661a2-3130-4f66-af03-e928a71067ae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066807 Oct 05 03:04:12.980812 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3050/6080] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:04:12.982032 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:12.991541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6df62746-c15d-4aa9-b87d-b18d89c8d919 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:12.992179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6df62746-c15d-4aa9-b87d-b18d89c8d919 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:13.003733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6df62746-c15d-4aa9-b87d-b18d89c8d919 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:13.005909 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6df62746-c15d-4aa9-b87d-b18d89c8d919 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:13.006655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6df62746-c15d-4aa9-b87d-b18d89c8d919 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:13.007548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6df62746-c15d-4aa9-b87d-b18d89c8d919 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:13.008864 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6df62746-c15d-4aa9-b87d-b18d89c8d919 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:13.009618 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6df62746-c15d-4aa9-b87d-b18d89c8d919 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:13.143965 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-60f37116-c02b-4756-82f4-3e23a4387317 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "DELETE /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f" status: 204 len: 0 microversion: 2.1 time: 0.250592 Oct 05 03:04:13.148352 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3031/6081] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:04:12 2022] DELETE /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 03:04:13.161058 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-37e1e622-3848-4e67-95ec-00b0a9782821 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:13.161954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-37e1e622-3848-4e67-95ec-00b0a9782821 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 16f4a218-7c09-4282-9670-6b280970a99f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:13.181075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-37e1e622-3848-4e67-95ec-00b0a9782821 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:13.186662 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-37e1e622-3848-4e67-95ec-00b0a9782821 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:13.187449 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-37e1e622-3848-4e67-95ec-00b0a9782821 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:13.188477 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-37e1e622-3848-4e67-95ec-00b0a9782821 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:13.190805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-37e1e622-3848-4e67-95ec-00b0a9782821 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:13.191642 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-37e1e622-3848-4e67-95ec-00b0a9782821 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:13.520122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6df62746-c15d-4aa9-b87d-b18d89c8d919 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:13.530741 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6df62746-c15d-4aa9-b87d-b18d89c8d919 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1562 microversion: 2.1 time: 0.548056 Oct 05 03:04:13.539858 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3051/6082] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:12 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1562 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:13.553883 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-37e1e622-3848-4e67-95ec-00b0a9782821 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:13.566412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8c80abce-4203-4b32-9147-a9c6d85b003d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:13.567269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8c80abce-4203-4b32-9147-a9c6d85b003d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:13.571144 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-37e1e622-3848-4e67-95ec-00b0a9782821 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f" status: 200 len: 1669 microversion: 2.1 time: 0.420139 Oct 05 03:04:13.577622 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3032/6083] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:13 2022] GET /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f => generated 1669 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:13.580076 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c80abce-4203-4b32-9147-a9c6d85b003d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:13.580745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c80abce-4203-4b32-9147-a9c6d85b003d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:13.581364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c80abce-4203-4b32-9147-a9c6d85b003d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:13.582234 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c80abce-4203-4b32-9147-a9c6d85b003d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:13.582835 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c80abce-4203-4b32-9147-a9c6d85b003d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:13.583408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c80abce-4203-4b32-9147-a9c6d85b003d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:13.830968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8c80abce-4203-4b32-9147-a9c6d85b003d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:13.840992 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8c80abce-4203-4b32-9147-a9c6d85b003d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1562 microversion: 2.1 time: 0.279458 Oct 05 03:04:13.842357 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3052/6084] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:13 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1562 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:04:13.928462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9114feac-3be7-40f0-a9d3-33e29f40fa65 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:13.929163 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9114feac-3be7-40f0-a9d3-33e29f40fa65 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] [instance: 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:13.935670 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9114feac-3be7-40f0-a9d3-33e29f40fa65 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:13.936166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9114feac-3be7-40f0-a9d3-33e29f40fa65 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:13.936600 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9114feac-3be7-40f0-a9d3-33e29f40fa65 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:13.939500 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9114feac-3be7-40f0-a9d3-33e29f40fa65 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:13.939977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9114feac-3be7-40f0-a9d3-33e29f40fa65 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:13.940411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9114feac-3be7-40f0-a9d3-33e29f40fa65 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:14.079174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9114feac-3be7-40f0-a9d3-33e29f40fa65 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329523b6f089401face7b477d08ca7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feef1976405a442eb7ee441d12c9a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:14.093683 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9114feac-3be7-40f0-a9d3-33e29f40fa65 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00" status: 200 len: 1229 microversion: 2.1 time: 0.171745 Oct 05 03:04:14.094488 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3033/6085] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:13 2022] GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 => generated 1229 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:04:14.605456 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-430f366b-015b-4f4a-8e77-d53473a2422b tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:14.606275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-430f366b-015b-4f4a-8e77-d53473a2422b tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 16f4a218-7c09-4282-9670-6b280970a99f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:14.618338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-430f366b-015b-4f4a-8e77-d53473a2422b tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:14.619071 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-430f366b-015b-4f4a-8e77-d53473a2422b tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:14.619695 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-430f366b-015b-4f4a-8e77-d53473a2422b tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:14.620564 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-430f366b-015b-4f4a-8e77-d53473a2422b tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:14.621201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-430f366b-015b-4f4a-8e77-d53473a2422b tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:14.621778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-430f366b-015b-4f4a-8e77-d53473a2422b tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:14.990773 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-430f366b-015b-4f4a-8e77-d53473a2422b tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:15.001996 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-430f366b-015b-4f4a-8e77-d53473a2422b tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f" status: 200 len: 1669 microversion: 2.1 time: 0.403612 Oct 05 03:04:15.017084 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3053/6086] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:14 2022] GET /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f => generated 1669 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:15.118599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-495b47b7-3981-4f6b-a20d-15dbfb66c3ed tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:15.119295 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-495b47b7-3981-4f6b-a20d-15dbfb66c3ed tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] [instance: 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:15.135111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-495b47b7-3981-4f6b-a20d-15dbfb66c3ed tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:15.135833 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-495b47b7-3981-4f6b-a20d-15dbfb66c3ed tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:15.136607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-495b47b7-3981-4f6b-a20d-15dbfb66c3ed tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:15.138629 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-495b47b7-3981-4f6b-a20d-15dbfb66c3ed tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:15.142511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-495b47b7-3981-4f6b-a20d-15dbfb66c3ed tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:15.143175 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-495b47b7-3981-4f6b-a20d-15dbfb66c3ed tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:15.268437 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-495b47b7-3981-4f6b-a20d-15dbfb66c3ed tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329523b6f089401face7b477d08ca7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feef1976405a442eb7ee441d12c9a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:15.280604 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-495b47b7-3981-4f6b-a20d-15dbfb66c3ed tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00" status: 200 len: 1229 microversion: 2.1 time: 0.166925 Oct 05 03:04:15.298720 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3034/6087] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:15 2022] GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 => generated 1229 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:15.824278 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-58df1c61-e538-45ff-aa3a-173f8056ba5c req-cd7bbbf1-9091-4df5-b2e7-03f303717027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16f4a218-7c09-4282-9670-6b280970a99f", "name": "network-vif-deleted", "tag": "51dd156b-188b-4a9d-9e0a-c45fac1f9f55"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:04:15.837730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-58df1c61-e538-45ff-aa3a-173f8056ba5c req-cd7bbbf1-9091-4df5-b2e7-03f303717027 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:15.838521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-58df1c61-e538-45ff-aa3a-173f8056ba5c req-cd7bbbf1-9091-4df5-b2e7-03f303717027 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:15.839242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-58df1c61-e538-45ff-aa3a-173f8056ba5c req-cd7bbbf1-9091-4df5-b2e7-03f303717027 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:15.884251 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-58df1c61-e538-45ff-aa3a-173f8056ba5c req-cd7bbbf1-9091-4df5-b2e7-03f303717027 service nova] Creating event network-vif-deleted:51dd156b-188b-4a9d-9e0a-c45fac1f9f55 for instance 16f4a218-7c09-4282-9670-6b280970a99f on n-h2-858272-3 Oct 05 03:04:15.895975 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-58df1c61-e538-45ff-aa3a-173f8056ba5c req-cd7bbbf1-9091-4df5-b2e7-03f303717027 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075718 Oct 05 03:04:15.902959 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3054/6088] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:04:16.059397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d8e26a41-d202-49bd-95b2-44271c157861 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:16.060142 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d8e26a41-d202-49bd-95b2-44271c157861 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 16f4a218-7c09-4282-9670-6b280970a99f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:16.075989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d8e26a41-d202-49bd-95b2-44271c157861 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:16.081798 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d8e26a41-d202-49bd-95b2-44271c157861 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:16.083038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d8e26a41-d202-49bd-95b2-44271c157861 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:16.086483 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d8e26a41-d202-49bd-95b2-44271c157861 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:16.087932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d8e26a41-d202-49bd-95b2-44271c157861 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:16.091361 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d8e26a41-d202-49bd-95b2-44271c157861 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:16.186034 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d8e26a41-d202-49bd-95b2-44271c157861 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:16.186625 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d8e26a41-d202-49bd-95b2-44271c157861 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:16.187278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d8e26a41-d202-49bd-95b2-44271c157861 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:16.187742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-d8e26a41-d202-49bd-95b2-44271c157861 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lazy-loading 'fault' on Instance uuid 16f4a218-7c09-4282-9670-6b280970a99f {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:04:16.292932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d8e26a41-d202-49bd-95b2-44271c157861 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:16.310913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ba0e00f5-c788-4239-ad31-10acba933e18 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:16.312288 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ba0e00f5-c788-4239-ad31-10acba933e18 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] [instance: 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:16.320143 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d8e26a41-d202-49bd-95b2-44271c157861 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f" status: 200 len: 1338 microversion: 2.1 time: 0.278813 Oct 05 03:04:16.322798 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3035/6089] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:16 2022] GET /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f => generated 1338 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:16.327314 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ba0e00f5-c788-4239-ad31-10acba933e18 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:16.328007 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ba0e00f5-c788-4239-ad31-10acba933e18 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:16.328653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ba0e00f5-c788-4239-ad31-10acba933e18 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:16.329544 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ba0e00f5-c788-4239-ad31-10acba933e18 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:16.330171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ba0e00f5-c788-4239-ad31-10acba933e18 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:16.331034 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ba0e00f5-c788-4239-ad31-10acba933e18 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:16.497290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ba0e00f5-c788-4239-ad31-10acba933e18 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329523b6f089401face7b477d08ca7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feef1976405a442eb7ee441d12c9a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:16.508781 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ba0e00f5-c788-4239-ad31-10acba933e18 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00" status: 200 len: 1229 microversion: 2.1 time: 0.202362 Oct 05 03:04:16.510051 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3055/6090] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:16 2022] GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 => generated 1229 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:17.348841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5fa56181-f0c4-4539-8eff-4c894029fbe8 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:17.349493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5fa56181-f0c4-4539-8eff-4c894029fbe8 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 16f4a218-7c09-4282-9670-6b280970a99f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:17.363796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5fa56181-f0c4-4539-8eff-4c894029fbe8 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:17.364303 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5fa56181-f0c4-4539-8eff-4c894029fbe8 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:17.364746 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5fa56181-f0c4-4539-8eff-4c894029fbe8 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:17.365490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5fa56181-f0c4-4539-8eff-4c894029fbe8 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:17.365957 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5fa56181-f0c4-4539-8eff-4c894029fbe8 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:17.366391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5fa56181-f0c4-4539-8eff-4c894029fbe8 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:17.403921 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-5fa56181-f0c4-4539-8eff-4c894029fbe8 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] HTTP exception thrown: Instance 16f4a218-7c09-4282-9670-6b280970a99f could not be found. Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5fa56181-f0c4-4539-8eff-4c894029fbe8 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Request method failure captured: Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f HTTP/1.1 Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPNwznjwkzH4385Wmuu9gocROGuZ13TcZ43NcOOcOW7e_9P-997tIaVKKhvNDp8ALbJmk_WuhGmG9xxcH80ub6_kQqWwVWVE7-M3rSmqWehT07GjEPso6ybD-TIikPlBsrl6Tw4psm4dWeeSOAfEZO3e9X3oOax0DgXMkw6OnmHwO5A Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 5152e5e306d2474bac12338a8e722a00 Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-TestNetworkBasicOps-207914990 Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5152e5e306d2474bac12338a8e722a00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5152e5e306d2474bac12338a8e722a00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5152e5e306d2474bac12338a8e722a00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5152e5e306d2474bac12338a8e722a00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-TestNetworkBasicOps-207914990 Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 5152e5e306d2474bac12338a8e722a00 Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-TestNetworkBasicOps-207914990 Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-TestNetworkBasicOps-207914990-project Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 67c2b26730184ce58b866e37ebe43794 Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-TestNetworkBasicOps-207914990-project Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 16f4a218-7c09-4282-9670-6b280970a99f could not be found. Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '16f4a218-7c09-4282-9670-6b280970a99f'} Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16f4a218-7c09-4282-9670-6b280970a99f could not be found. Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16f4a218-7c09-4282-9670-6b280970a99f could not be found. Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:04:17.418924 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:04:17.422836 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:04:17.422836 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:04:17.422836 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:04:17.422836 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:04:17.422836 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:04:17.422836 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16f4a218-7c09-4282-9670-6b280970a99f could not be found. Oct 05 03:04:17.422836 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:04:17.422836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5fa56181-f0c4-4539-8eff-4c894029fbe8 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Returning 404 to user: Instance 16f4a218-7c09-4282-9670-6b280970a99f could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:04:17.422836 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5fa56181-f0c4-4539-8eff-4c894029fbe8 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f" status: 404 len: 111 microversion: 2.1 time: 0.076308 Oct 05 03:04:17.422836 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3036/6091] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:17 2022] GET /compute/v2.1/servers/16f4a218-7c09-4282-9670-6b280970a99f => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:04:17.537145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f3af328c-79ae-4a6c-bd9d-2e222ce5e6ad tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:17.537825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f3af328c-79ae-4a6c-bd9d-2e222ce5e6ad tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] [instance: 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:17.551384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3af328c-79ae-4a6c-bd9d-2e222ce5e6ad tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:17.553353 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3af328c-79ae-4a6c-bd9d-2e222ce5e6ad tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:17.555778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3af328c-79ae-4a6c-bd9d-2e222ce5e6ad tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:17.558505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3af328c-79ae-4a6c-bd9d-2e222ce5e6ad tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:17.559218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3af328c-79ae-4a6c-bd9d-2e222ce5e6ad tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:17.561050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3af328c-79ae-4a6c-bd9d-2e222ce5e6ad tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:17.587366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-419c3e52-3c2c-441a-8b22-98c19458919d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:17.588422 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-419c3e52-3c2c-441a-8b22-98c19458919d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:17.608175 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-419c3e52-3c2c-441a-8b22-98c19458919d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:17.608946 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-419c3e52-3c2c-441a-8b22-98c19458919d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:17.609628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-419c3e52-3c2c-441a-8b22-98c19458919d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:17.610611 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-419c3e52-3c2c-441a-8b22-98c19458919d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:17.611298 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-419c3e52-3c2c-441a-8b22-98c19458919d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:17.613367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-419c3e52-3c2c-441a-8b22-98c19458919d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:17.758565 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f3af328c-79ae-4a6c-bd9d-2e222ce5e6ad tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329523b6f089401face7b477d08ca7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feef1976405a442eb7ee441d12c9a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:17.769182 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f3af328c-79ae-4a6c-bd9d-2e222ce5e6ad tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00" status: 200 len: 1229 microversion: 2.1 time: 0.237657 Oct 05 03:04:17.770089 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3056/6092] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:17 2022] GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 => generated 1229 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:17.779014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-4d57f913-2b29-4f30-a062-0d1578b47eaf req-fb512162-ca50-49b8-985b-a03b2d80c52e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8276749-cb0f-4aaa-a37d-10e9a99a49d3", "tag": "8821de78-ad20-42ce-9987-e279a5e9e2bc"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:04:17.801590 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4d57f913-2b29-4f30-a062-0d1578b47eaf req-fb512162-ca50-49b8-985b-a03b2d80c52e service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:17.802438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4d57f913-2b29-4f30-a062-0d1578b47eaf req-fb512162-ca50-49b8-985b-a03b2d80c52e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:17.803087 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4d57f913-2b29-4f30-a062-0d1578b47eaf req-fb512162-ca50-49b8-985b-a03b2d80c52e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:17.841285 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-4d57f913-2b29-4f30-a062-0d1578b47eaf req-fb512162-ca50-49b8-985b-a03b2d80c52e service nova] Creating event network-changed:8821de78-ad20-42ce-9987-e279a5e9e2bc for instance b8276749-cb0f-4aaa-a37d-10e9a99a49d3 on n-h2-858272-3 Oct 05 03:04:17.857791 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-4d57f913-2b29-4f30-a062-0d1578b47eaf req-fb512162-ca50-49b8-985b-a03b2d80c52e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084773 Oct 05 03:04:17.863667 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3057/6093] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:04:18.173329 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-21434370-9eb4-4fa3-aa5a-4bc3fb54bf00 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '.version_select at 0x7fccdf0acc10>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:18.199407 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-419c3e52-3c2c-441a-8b22-98c19458919d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:18.209553 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-419c3e52-3c2c-441a-8b22-98c19458919d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1562 microversion: 2.1 time: 0.629413 Oct 05 03:04:18.221928 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3037/6094] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:17 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1562 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:04:18.223265 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-21434370-9eb4-4fa3-aa5a-4bc3fb54bf00 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1969576053" status: 202 len: 0 microversion: 2.1 time: 0.060644 Oct 05 03:04:18.223857 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3058/6095] 10.222.0.16 () {58 vars in 1257 bytes} [Wed Oct 5 03:04:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1969576053 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 03:04:19.147871 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ce8bfe91-6dd7-45c8-8f8e-3aa58581c875 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:19.149760 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ce8bfe91-6dd7-45c8-8f8e-3aa58581c875 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] [instance: 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:19.159292 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce8bfe91-6dd7-45c8-8f8e-3aa58581c875 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:19.161073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce8bfe91-6dd7-45c8-8f8e-3aa58581c875 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:19.165077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce8bfe91-6dd7-45c8-8f8e-3aa58581c875 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:19.166963 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce8bfe91-6dd7-45c8-8f8e-3aa58581c875 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:19.169054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce8bfe91-6dd7-45c8-8f8e-3aa58581c875 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:19.172377 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce8bfe91-6dd7-45c8-8f8e-3aa58581c875 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:19.243678 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce8bfe91-6dd7-45c8-8f8e-3aa58581c875 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:19.244497 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce8bfe91-6dd7-45c8-8f8e-3aa58581c875 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:19.245146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ce8bfe91-6dd7-45c8-8f8e-3aa58581c875 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:19.245766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-ce8bfe91-6dd7-45c8-8f8e-3aa58581c875 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lazy-loading 'fault' on Instance uuid 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:04:19.341340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ce8bfe91-6dd7-45c8-8f8e-3aa58581c875 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329523b6f089401face7b477d08ca7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feef1976405a442eb7ee441d12c9a1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:19.357137 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ce8bfe91-6dd7-45c8-8f8e-3aa58581c875 tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00" status: 200 len: 1188 microversion: 2.1 time: 0.563521 Oct 05 03:04:19.365891 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3038/6096] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:18 2022] GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 => generated 1188 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:20.388412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d4071561-3848-4d38-9b7f-174b0c68c0ee tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:20.390080 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d4071561-3848-4d38-9b7f-174b0c68c0ee tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] [instance: 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:20.402586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4071561-3848-4d38-9b7f-174b0c68c0ee tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:20.403372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4071561-3848-4d38-9b7f-174b0c68c0ee tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:20.403970 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4071561-3848-4d38-9b7f-174b0c68c0ee tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:20.404855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4071561-3848-4d38-9b7f-174b0c68c0ee tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:20.405493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4071561-3848-4d38-9b7f-174b0c68c0ee tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:20.406076 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4071561-3848-4d38-9b7f-174b0c68c0ee tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:20.421087 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-d4071561-3848-4d38-9b7f-174b0c68c0ee tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] HTTP exception thrown: Instance 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 could not be found. Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d4071561-3848-4d38-9b7f-174b0c68c0ee tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Request method failure captured: Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 HTTP/1.1 Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPLoEfBwl4sHBGGYnRvhQgLvtIRGNVW3Npawj3IKjNIN0Kc_yQiomAaCaEMsGjqDusdX9MB4VoSHU7-WoQZU9huGUvU5hRHRvUcn2SyB6NivUxaNXeHySW-Ule2ghisaar4RB9MQgr54UWeMVdCKm1MnbV2HH2sZjlVhUT73eJoS5hg Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: feef1976405a442eb7ee441d12c9a1d9 Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TestVolumeBackupRestore-1948218770 Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/feef1976405a442eb7ee441d12c9a1d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/feef1976405a442eb7ee441d12c9a1d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/feef1976405a442eb7ee441d12c9a1d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_feef1976405a442eb7ee441d12c9a1d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TestVolumeBackupRestore-1948218770 Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: feef1976405a442eb7ee441d12c9a1d9 Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1948218770 Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TestVolumeBackupRestore-1948218770-project Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 329523b6f089401face7b477d08ca7d6 Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TestVolumeBackupRestore-1948218770-project Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 could not be found. Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '4eb16ac5-263b-4180-b36f-ca3a9c7a7e00'} Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 could not be found. Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 could not be found. Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:04:20.423273 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:04:20.427968 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:04:20.427968 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:04:20.427968 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:04:20.427968 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:04:20.427968 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:04:20.427968 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 could not be found. Oct 05 03:04:20.427968 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:04:20.429173 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d4071561-3848-4d38-9b7f-174b0c68c0ee tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Returning 404 to user: Instance 4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:04:20.430555 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d4071561-3848-4d38-9b7f-174b0c68c0ee tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] 10.222.0.16 "GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00" status: 404 len: 111 microversion: 2.1 time: 0.053123 Oct 05 03:04:20.432145 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3059/6097] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:20 2022] GET /compute/v2.1/servers/4eb16ac5-263b-4180-b36f-ca3a9c7a7e00 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:04:21.059040 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cc37ea77-e783-421f-bcea-f03add84839c tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] Calling method '.version_select at 0x7fccdf75db80>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:21.107318 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cc37ea77-e783-421f-bcea-f03add84839c tempest-TestVolumeBackupRestore-1948218770 tempest-TestVolumeBackupRestore-1948218770-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1302824976" status: 202 len: 0 microversion: 2.1 time: 0.054446 Oct 05 03:04:21.108142 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3039/6098] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 5 03:04:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1302824976 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:04:35.277317 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e60ee46f-735f-4813-8bea-3460fd93c332 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Action: 'create', calling method: .version_select at 0x7fccdf0acc10>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-106937329", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8t/gIA5S/jKANReWI2ZQfKM7aHkyRI5D6CrelzaXmEm7rDVeIucqWMzb2N7MJf1KB1aobJbMwE5fVefbg2lfq2+SOUgcbMz1h2ulr9U4yWOTK7Rkw8lE/gKDRgRF0M3A=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:04:35.310441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:35.321009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:35.380295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-e60ee46f-735f-4813-8bea-3460fd93c332 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Getting quotas for project 5152e5e306d2474bac12338a8e722a00. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:04:35.392766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-e60ee46f-735f-4813-8bea-3460fd93c332 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Getting quotas for user 67c2b26730184ce58b866e37ebe43794 and project 5152e5e306d2474bac12338a8e722a00. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:04:35.453489 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e60ee46f-735f-4813-8bea-3460fd93c332 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.187250 Oct 05 03:04:35.454284 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3060/6099] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 03:04:35 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:04:37.856015 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-57ec927d-6f5e-4cd0-9255-f782c3e24022 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1740301648", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "cf49d089-53da-4ffb-acfe-aba1c2366c8c"}], "key_name": "tempest-TestNetworkBasicOps-106937329", "security_groups": [{"name": "tempest-secgroup-smoke-599914627"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:04:37.881491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:37.883845 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:38.015100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-57ec927d-6f5e-4cd0-9255-f782c3e24022 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] validate_networks() for [('cf49d089-53da-4ffb-acfe-aba1c2366c8c', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:04:39.540970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-57ec927d-6f5e-4cd0-9255-f782c3e24022 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:04:39.541562 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-57ec927d-6f5e-4cd0-9255-f782c3e24022 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:04:39.542178 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-57ec927d-6f5e-4cd0-9255-f782c3e24022 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:04:39.542617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-57ec927d-6f5e-4cd0-9255-f782c3e24022 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:04:39.543025 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-57ec927d-6f5e-4cd0-9255-f782c3e24022 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:04:39.553608 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57ec927d-6f5e-4cd0-9255-f782c3e24022 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:39.554263 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57ec927d-6f5e-4cd0-9255-f782c3e24022 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:39.555284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57ec927d-6f5e-4cd0-9255-f782c3e24022 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:39.556334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57ec927d-6f5e-4cd0-9255-f782c3e24022 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:39.556862 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57ec927d-6f5e-4cd0-9255-f782c3e24022 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:39.557374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-57ec927d-6f5e-4cd0-9255-f782c3e24022 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:39.584832 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-57ec927d-6f5e-4cd0-9255-f782c3e24022 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Getting quotas for project 5152e5e306d2474bac12338a8e722a00. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:04:39.590699 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-57ec927d-6f5e-4cd0-9255-f782c3e24022 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Getting quotas for user 67c2b26730184ce58b866e37ebe43794 and project 5152e5e306d2474bac12338a8e722a00. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:04:39.609768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-57ec927d-6f5e-4cd0-9255-f782c3e24022 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:04:39.612180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-57ec927d-6f5e-4cd0-9255-f782c3e24022 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 75b557e6-a0a4-4791-b043-96983fed78e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:04:39.696778 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-57ec927d-6f5e-4cd0-9255-f782c3e24022 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.847425 Oct 05 03:04:39.703984 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3040/6100] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:04:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 1855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:04:39.710872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ab31d373-644a-475a-9eb7-b8c43fce5913 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:39.712685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ab31d373-644a-475a-9eb7-b8c43fce5913 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 75b557e6-a0a4-4791-b043-96983fed78e6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:39.808023 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ab31d373-644a-475a-9eb7-b8c43fce5913 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:39.818735 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ab31d373-644a-475a-9eb7-b8c43fce5913 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6" status: 200 len: 1248 microversion: 2.1 time: 0.112828 Oct 05 03:04:39.831233 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3061/6101] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:39 2022] GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6 => generated 1248 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:04:40.869666 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0e7b9d2d-33d5-4a8e-b58b-628d2268a8d7 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:40.873100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0e7b9d2d-33d5-4a8e-b58b-628d2268a8d7 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 75b557e6-a0a4-4791-b043-96983fed78e6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:40.900618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e7b9d2d-33d5-4a8e-b58b-628d2268a8d7 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:40.901110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e7b9d2d-33d5-4a8e-b58b-628d2268a8d7 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:40.901545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e7b9d2d-33d5-4a8e-b58b-628d2268a8d7 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:40.902565 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e7b9d2d-33d5-4a8e-b58b-628d2268a8d7 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:40.905236 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e7b9d2d-33d5-4a8e-b58b-628d2268a8d7 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:40.905881 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e7b9d2d-33d5-4a8e-b58b-628d2268a8d7 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:41.092566 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0e7b9d2d-33d5-4a8e-b58b-628d2268a8d7 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:41.102442 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0e7b9d2d-33d5-4a8e-b58b-628d2268a8d7 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6" status: 200 len: 1244 microversion: 2.1 time: 0.251543 Oct 05 03:04:41.114556 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3041/6102] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:40 2022] GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6 => generated 1244 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:42.129816 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1c1a7d61-da86-46a5-9525-9661f1eb5807 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:42.130963 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1c1a7d61-da86-46a5-9525-9661f1eb5807 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 75b557e6-a0a4-4791-b043-96983fed78e6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:42.146128 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c1a7d61-da86-46a5-9525-9661f1eb5807 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:42.146836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c1a7d61-da86-46a5-9525-9661f1eb5807 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:42.148722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c1a7d61-da86-46a5-9525-9661f1eb5807 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:42.150013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c1a7d61-da86-46a5-9525-9661f1eb5807 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:42.150886 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c1a7d61-da86-46a5-9525-9661f1eb5807 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:42.151471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c1a7d61-da86-46a5-9525-9661f1eb5807 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:42.573182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1c1a7d61-da86-46a5-9525-9661f1eb5807 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:42.587151 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1c1a7d61-da86-46a5-9525-9661f1eb5807 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6" status: 200 len: 1306 microversion: 2.1 time: 0.461777 Oct 05 03:04:42.609454 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3062/6103] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:42 2022] GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6 => generated 1306 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:43.614934 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ea9fd3e9-b6f6-4567-b08d-f2b48083f79e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:43.618354 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ea9fd3e9-b6f6-4567-b08d-f2b48083f79e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 75b557e6-a0a4-4791-b043-96983fed78e6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:43.640192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea9fd3e9-b6f6-4567-b08d-f2b48083f79e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:43.641753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea9fd3e9-b6f6-4567-b08d-f2b48083f79e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:43.670205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea9fd3e9-b6f6-4567-b08d-f2b48083f79e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:43.670911 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea9fd3e9-b6f6-4567-b08d-f2b48083f79e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:43.671516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea9fd3e9-b6f6-4567-b08d-f2b48083f79e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:43.672715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea9fd3e9-b6f6-4567-b08d-f2b48083f79e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:43.880594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ea9fd3e9-b6f6-4567-b08d-f2b48083f79e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:43.893926 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ea9fd3e9-b6f6-4567-b08d-f2b48083f79e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6" status: 200 len: 1306 microversion: 2.1 time: 0.282960 Oct 05 03:04:43.896668 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3042/6104] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:43 2022] GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6 => generated 1306 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:44.927833 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fd4eaa33-d519-4ad7-a33c-2529f26ea243 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:44.928398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fd4eaa33-d519-4ad7-a33c-2529f26ea243 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 75b557e6-a0a4-4791-b043-96983fed78e6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:44.950078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fd4eaa33-d519-4ad7-a33c-2529f26ea243 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:44.951932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fd4eaa33-d519-4ad7-a33c-2529f26ea243 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:44.952492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fd4eaa33-d519-4ad7-a33c-2529f26ea243 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:44.957110 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fd4eaa33-d519-4ad7-a33c-2529f26ea243 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:44.957890 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fd4eaa33-d519-4ad7-a33c-2529f26ea243 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:44.959634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fd4eaa33-d519-4ad7-a33c-2529f26ea243 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:45.276490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fd4eaa33-d519-4ad7-a33c-2529f26ea243 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:45.290574 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fd4eaa33-d519-4ad7-a33c-2529f26ea243 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6" status: 200 len: 1373 microversion: 2.1 time: 0.370367 Oct 05 03:04:45.301337 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3063/6105] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:44 2022] GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6 => generated 1373 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:45.460084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-a34fc5b7-3f97-4b41-96b3-2d374def2beb req-906ac32a-cb83-47b6-b6d9-078fbf20377a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75b557e6-a0a4-4791-b043-96983fed78e6", "tag": "1d970f8d-2848-4c97-8466-eb8b9fb29921"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:04:45.474245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a34fc5b7-3f97-4b41-96b3-2d374def2beb req-906ac32a-cb83-47b6-b6d9-078fbf20377a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:45.475261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a34fc5b7-3f97-4b41-96b3-2d374def2beb req-906ac32a-cb83-47b6-b6d9-078fbf20377a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:45.476118 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a34fc5b7-3f97-4b41-96b3-2d374def2beb req-906ac32a-cb83-47b6-b6d9-078fbf20377a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:45.493000 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-a34fc5b7-3f97-4b41-96b3-2d374def2beb req-906ac32a-cb83-47b6-b6d9-078fbf20377a service nova] Creating event network-changed:1d970f8d-2848-4c97-8466-eb8b9fb29921 for instance 75b557e6-a0a4-4791-b043-96983fed78e6 on n-h2-858272-3 Oct 05 03:04:45.499408 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-a34fc5b7-3f97-4b41-96b3-2d374def2beb req-906ac32a-cb83-47b6-b6d9-078fbf20377a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047021 Oct 05 03:04:45.500366 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3043/6106] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:04:46.322847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ec3a3621-2641-4e4e-bc2f-1c966d307731 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:46.323534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ec3a3621-2641-4e4e-bc2f-1c966d307731 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 75b557e6-a0a4-4791-b043-96983fed78e6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:46.330633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec3a3621-2641-4e4e-bc2f-1c966d307731 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:46.331294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec3a3621-2641-4e4e-bc2f-1c966d307731 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:46.331744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec3a3621-2641-4e4e-bc2f-1c966d307731 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:46.332456 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec3a3621-2641-4e4e-bc2f-1c966d307731 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:46.332930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec3a3621-2641-4e4e-bc2f-1c966d307731 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:46.333371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec3a3621-2641-4e4e-bc2f-1c966d307731 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:46.492217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ec3a3621-2641-4e4e-bc2f-1c966d307731 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:46.499844 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ec3a3621-2641-4e4e-bc2f-1c966d307731 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6" status: 200 len: 1373 microversion: 2.1 time: 0.181884 Oct 05 03:04:46.500428 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3064/6107] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:46 2022] GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6 => generated 1373 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:47.541818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6f3e85bf-4660-413c-b7f0-870d70e845c6 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:47.542555 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6f3e85bf-4660-413c-b7f0-870d70e845c6 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 75b557e6-a0a4-4791-b043-96983fed78e6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:47.566728 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f3e85bf-4660-413c-b7f0-870d70e845c6 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:47.567236 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f3e85bf-4660-413c-b7f0-870d70e845c6 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:47.567680 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f3e85bf-4660-413c-b7f0-870d70e845c6 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:47.568393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f3e85bf-4660-413c-b7f0-870d70e845c6 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:47.568859 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f3e85bf-4660-413c-b7f0-870d70e845c6 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:47.569317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f3e85bf-4660-413c-b7f0-870d70e845c6 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:47.658972 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-638747c8-dcc4-436d-9832-d2f36caa1d60 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:04:47.661366 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-638747c8-dcc4-436d-9832-d2f36caa1d60 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:47.678192 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-638747c8-dcc4-436d-9832-d2f36caa1d60 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:47.679958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-638747c8-dcc4-436d-9832-d2f36caa1d60 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:47.680927 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-638747c8-dcc4-436d-9832-d2f36caa1d60 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:47.681911 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-638747c8-dcc4-436d-9832-d2f36caa1d60 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:47.682532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-638747c8-dcc4-436d-9832-d2f36caa1d60 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:47.683164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-638747c8-dcc4-436d-9832-d2f36caa1d60 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:47.764584 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6f3e85bf-4660-413c-b7f0-870d70e845c6 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:47.778732 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6f3e85bf-4660-413c-b7f0-870d70e845c6 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6" status: 200 len: 1373 microversion: 2.1 time: 0.258382 Oct 05 03:04:47.785034 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3044/6108] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:47 2022] GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6 => generated 1373 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:48.295407 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-638747c8-dcc4-436d-9832-d2f36caa1d60 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "POST /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3/action" status: 200 len: 24567 microversion: 2.1 time: 0.640038 Oct 05 03:04:48.296125 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3065/6109] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:04:47 2022] POST /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3/action => generated 24567 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 03:04:48.803191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-67dd7428-91b8-49b8-b5f7-8c4429c1859d tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:48.803825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-67dd7428-91b8-49b8-b5f7-8c4429c1859d tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 75b557e6-a0a4-4791-b043-96983fed78e6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:48.830573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-67dd7428-91b8-49b8-b5f7-8c4429c1859d tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:48.835006 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-67dd7428-91b8-49b8-b5f7-8c4429c1859d tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:48.838315 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-67dd7428-91b8-49b8-b5f7-8c4429c1859d tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:48.839735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-67dd7428-91b8-49b8-b5f7-8c4429c1859d tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:48.840575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-67dd7428-91b8-49b8-b5f7-8c4429c1859d tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:48.844092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-67dd7428-91b8-49b8-b5f7-8c4429c1859d tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:49.042953 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-67dd7428-91b8-49b8-b5f7-8c4429c1859d tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:49.051461 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-67dd7428-91b8-49b8-b5f7-8c4429c1859d tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6" status: 200 len: 1373 microversion: 2.1 time: 0.252479 Oct 05 03:04:49.053225 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3045/6110] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:48 2022] GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6 => generated 1373 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:50.079182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-11ab207a-cd32-4cd9-bf4c-20a1e11b8ccf tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:50.080426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-11ab207a-cd32-4cd9-bf4c-20a1e11b8ccf tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 75b557e6-a0a4-4791-b043-96983fed78e6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:50.089955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:50.092565 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11ab207a-cd32-4cd9-bf4c-20a1e11b8ccf tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:50.093959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11ab207a-cd32-4cd9-bf4c-20a1e11b8ccf tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:50.094697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11ab207a-cd32-4cd9-bf4c-20a1e11b8ccf tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:50.095659 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11ab207a-cd32-4cd9-bf4c-20a1e11b8ccf tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:50.097411 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11ab207a-cd32-4cd9-bf4c-20a1e11b8ccf tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:50.098345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11ab207a-cd32-4cd9-bf4c-20a1e11b8ccf tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:50.267461 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-11ab207a-cd32-4cd9-bf4c-20a1e11b8ccf tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:50.276550 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-11ab207a-cd32-4cd9-bf4c-20a1e11b8ccf tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6" status: 200 len: 1373 microversion: 2.1 time: 0.203203 Oct 05 03:04:50.277208 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3066/6111] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:50 2022] GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6 => generated 1373 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:51.302071 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c9ba86be-1877-4311-8f8a-e0de92eae186 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:51.303347 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c9ba86be-1877-4311-8f8a-e0de92eae186 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 75b557e6-a0a4-4791-b043-96983fed78e6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:51.309066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:51.310850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:51.317754 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c9ba86be-1877-4311-8f8a-e0de92eae186 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:51.318639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c9ba86be-1877-4311-8f8a-e0de92eae186 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:51.319240 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c9ba86be-1877-4311-8f8a-e0de92eae186 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:51.320671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c9ba86be-1877-4311-8f8a-e0de92eae186 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:51.321339 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c9ba86be-1877-4311-8f8a-e0de92eae186 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:51.321928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c9ba86be-1877-4311-8f8a-e0de92eae186 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:51.570590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c9ba86be-1877-4311-8f8a-e0de92eae186 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:51.582517 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c9ba86be-1877-4311-8f8a-e0de92eae186 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6" status: 200 len: 1373 microversion: 2.1 time: 0.286121 Oct 05 03:04:51.599639 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3046/6112] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:51 2022] GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6 => generated 1373 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:52.182733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-9b1efa89-4316-43ae-8566-292954aa5b08 req-c9c23fb5-cb19-499e-b1d3-e482af56ac0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75b557e6-a0a4-4791-b043-96983fed78e6", "name": "network-vif-plugged", "status": "completed", "tag": "1d970f8d-2848-4c97-8466-eb8b9fb29921"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:04:52.231247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9b1efa89-4316-43ae-8566-292954aa5b08 req-c9c23fb5-cb19-499e-b1d3-e482af56ac0f service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:52.231957 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9b1efa89-4316-43ae-8566-292954aa5b08 req-c9c23fb5-cb19-499e-b1d3-e482af56ac0f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:52.233132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9b1efa89-4316-43ae-8566-292954aa5b08 req-c9c23fb5-cb19-499e-b1d3-e482af56ac0f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:52.252300 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-9b1efa89-4316-43ae-8566-292954aa5b08 req-c9c23fb5-cb19-499e-b1d3-e482af56ac0f service nova] Creating event network-vif-plugged:1d970f8d-2848-4c97-8466-eb8b9fb29921 for instance 75b557e6-a0a4-4791-b043-96983fed78e6 on n-h2-858272-3 Oct 05 03:04:52.259524 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-9b1efa89-4316-43ae-8566-292954aa5b08 req-c9c23fb5-cb19-499e-b1d3-e482af56ac0f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088119 Oct 05 03:04:52.262008 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3067/6113] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:04:52.607907 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-54a3979b-f34d-493d-969d-f5d75e292a3a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:52.609513 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-54a3979b-f34d-493d-969d-f5d75e292a3a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 75b557e6-a0a4-4791-b043-96983fed78e6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:52.617204 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54a3979b-f34d-493d-969d-f5d75e292a3a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:52.617717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54a3979b-f34d-493d-969d-f5d75e292a3a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:52.618351 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54a3979b-f34d-493d-969d-f5d75e292a3a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:52.619160 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54a3979b-f34d-493d-969d-f5d75e292a3a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:52.619919 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54a3979b-f34d-493d-969d-f5d75e292a3a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:52.620639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54a3979b-f34d-493d-969d-f5d75e292a3a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:52.849790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-54a3979b-f34d-493d-969d-f5d75e292a3a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:52.861812 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-54a3979b-f34d-493d-969d-f5d75e292a3a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6" status: 200 len: 1373 microversion: 2.1 time: 0.258638 Oct 05 03:04:52.862506 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3047/6114] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:52 2022] GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6 => generated 1373 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:53.889595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6cdf0011-45c1-47c8-8c4e-f7fe355ddc4a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:53.890502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6cdf0011-45c1-47c8-8c4e-f7fe355ddc4a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 75b557e6-a0a4-4791-b043-96983fed78e6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:53.898659 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6cdf0011-45c1-47c8-8c4e-f7fe355ddc4a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:53.899609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6cdf0011-45c1-47c8-8c4e-f7fe355ddc4a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:53.900464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6cdf0011-45c1-47c8-8c4e-f7fe355ddc4a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:53.901523 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6cdf0011-45c1-47c8-8c4e-f7fe355ddc4a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:53.902223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6cdf0011-45c1-47c8-8c4e-f7fe355ddc4a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:53.902819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6cdf0011-45c1-47c8-8c4e-f7fe355ddc4a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:54.051941 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6cdf0011-45c1-47c8-8c4e-f7fe355ddc4a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:54.061200 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6cdf0011-45c1-47c8-8c4e-f7fe355ddc4a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6" status: 200 len: 1544 microversion: 2.1 time: 0.176179 Oct 05 03:04:54.062097 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3068/6115] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:53 2022] GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6 => generated 1544 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:54.085669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f75508f7-58ec-49d3-9aa9-4f8c31b23925 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:54.086279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f75508f7-58ec-49d3-9aa9-4f8c31b23925 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 75b557e6-a0a4-4791-b043-96983fed78e6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:54.093873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f75508f7-58ec-49d3-9aa9-4f8c31b23925 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:54.094556 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f75508f7-58ec-49d3-9aa9-4f8c31b23925 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:54.096091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f75508f7-58ec-49d3-9aa9-4f8c31b23925 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:54.097530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f75508f7-58ec-49d3-9aa9-4f8c31b23925 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:54.098283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f75508f7-58ec-49d3-9aa9-4f8c31b23925 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:54.098872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f75508f7-58ec-49d3-9aa9-4f8c31b23925 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:54.277165 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f75508f7-58ec-49d3-9aa9-4f8c31b23925 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:54.287393 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f75508f7-58ec-49d3-9aa9-4f8c31b23925 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6" status: 200 len: 1544 microversion: 2.1 time: 0.205530 Oct 05 03:04:54.293505 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3048/6116] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:54 2022] GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6 => generated 1544 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:56.561554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-6d89bee8-cd4f-4a2f-a4ea-dd4c5d362c1b req-915bd484-6c89-42de-a1d7-8ce9ed48b9be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75b557e6-a0a4-4791-b043-96983fed78e6", "tag": "1d970f8d-2848-4c97-8466-eb8b9fb29921"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:04:56.575496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6d89bee8-cd4f-4a2f-a4ea-dd4c5d362c1b req-915bd484-6c89-42de-a1d7-8ce9ed48b9be service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:56.576303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6d89bee8-cd4f-4a2f-a4ea-dd4c5d362c1b req-915bd484-6c89-42de-a1d7-8ce9ed48b9be service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:56.577024 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6d89bee8-cd4f-4a2f-a4ea-dd4c5d362c1b req-915bd484-6c89-42de-a1d7-8ce9ed48b9be service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:56.590304 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-6d89bee8-cd4f-4a2f-a4ea-dd4c5d362c1b req-915bd484-6c89-42de-a1d7-8ce9ed48b9be service nova] Creating event network-changed:1d970f8d-2848-4c97-8466-eb8b9fb29921 for instance 75b557e6-a0a4-4791-b043-96983fed78e6 on n-h2-858272-3 Oct 05 03:04:56.596318 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-6d89bee8-cd4f-4a2f-a4ea-dd4c5d362c1b req-915bd484-6c89-42de-a1d7-8ce9ed48b9be service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038780 Oct 05 03:04:56.598936 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3069/6117] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:04:56.692941 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6467b6bd-db66-4051-aaeb-96a1e5bb4868 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-2023897017", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:04:56.755272 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-6467b6bd-db66-4051-aaeb-96a1e5bb4868 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] validate_networks() for None {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:04:57.255831 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-6467b6bd-db66-4051-aaeb-96a1e5bb4868 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:04:57.257686 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-6467b6bd-db66-4051-aaeb-96a1e5bb4868 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:04:57.258811 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-6467b6bd-db66-4051-aaeb-96a1e5bb4868 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:04:57.259688 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-6467b6bd-db66-4051-aaeb-96a1e5bb4868 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:04:57.260114 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-6467b6bd-db66-4051-aaeb-96a1e5bb4868 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:04:57.270091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6467b6bd-db66-4051-aaeb-96a1e5bb4868 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:57.270580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6467b6bd-db66-4051-aaeb-96a1e5bb4868 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:57.271017 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6467b6bd-db66-4051-aaeb-96a1e5bb4868 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:57.271796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6467b6bd-db66-4051-aaeb-96a1e5bb4868 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:57.272255 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6467b6bd-db66-4051-aaeb-96a1e5bb4868 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:57.272684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6467b6bd-db66-4051-aaeb-96a1e5bb4868 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:57.291110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-6467b6bd-db66-4051-aaeb-96a1e5bb4868 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Getting quotas for project ab1edf3cfeff48e7a295daa9dcb1877a. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:04:57.296562 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-6467b6bd-db66-4051-aaeb-96a1e5bb4868 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Getting quotas for user ea7fccf567094c43aec0de4b4399538e and project ab1edf3cfeff48e7a295daa9dcb1877a. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:04:57.310777 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6467b6bd-db66-4051-aaeb-96a1e5bb4868 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:04:57.313157 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6467b6bd-db66-4051-aaeb-96a1e5bb4868 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] [instance: 6205bc97-60e8-4ef7-892d-c7e3957e8fdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:04:57.365878 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6467b6bd-db66-4051-aaeb-96a1e5bb4868 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.676725 Oct 05 03:04:57.373218 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3049/6118] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:04:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:04:57.380951 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e53ecc01-e3c5-4c1c-a1c9-2510515a35ea tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:57.381816 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e53ecc01-e3c5-4c1c-a1c9-2510515a35ea tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] [instance: 6205bc97-60e8-4ef7-892d-c7e3957e8fdf] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:57.521625 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e53ecc01-e3c5-4c1c-a1c9-2510515a35ea tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7fccf567094c43aec0de4b4399538e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1edf3cfeff48e7a295daa9dcb1877a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:57.534119 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e53ecc01-e3c5-4c1c-a1c9-2510515a35ea tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] 10.222.0.16 "GET /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf" status: 200 len: 1214 microversion: 2.1 time: 0.156766 Oct 05 03:04:57.535626 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3070/6119] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:57 2022] GET /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf => generated 1214 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:04:58.559975 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-aa488c3a-a257-4155-b740-9f39d43ae78c tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:58.560792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-aa488c3a-a257-4155-b740-9f39d43ae78c tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] [instance: 6205bc97-60e8-4ef7-892d-c7e3957e8fdf] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:58.571294 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa488c3a-a257-4155-b740-9f39d43ae78c tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:58.571790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa488c3a-a257-4155-b740-9f39d43ae78c tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:58.572229 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa488c3a-a257-4155-b740-9f39d43ae78c tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:58.572954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa488c3a-a257-4155-b740-9f39d43ae78c tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:58.573416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa488c3a-a257-4155-b740-9f39d43ae78c tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:58.573834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa488c3a-a257-4155-b740-9f39d43ae78c tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:58.696252 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-aa488c3a-a257-4155-b740-9f39d43ae78c tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7fccf567094c43aec0de4b4399538e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1edf3cfeff48e7a295daa9dcb1877a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:58.704485 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-aa488c3a-a257-4155-b740-9f39d43ae78c tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] 10.222.0.16 "GET /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf" status: 200 len: 1274 microversion: 2.1 time: 0.148686 Oct 05 03:04:58.705532 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3050/6120] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:58 2022] GET /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf => generated 1274 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:04:59.728475 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2a9ef261-1cd3-4f8e-8245-5e8801fcd6a4 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:04:59.729118 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2a9ef261-1cd3-4f8e-8245-5e8801fcd6a4 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] [instance: 6205bc97-60e8-4ef7-892d-c7e3957e8fdf] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:04:59.748647 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a9ef261-1cd3-4f8e-8245-5e8801fcd6a4 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:59.749173 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a9ef261-1cd3-4f8e-8245-5e8801fcd6a4 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:59.749608 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a9ef261-1cd3-4f8e-8245-5e8801fcd6a4 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:59.750321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a9ef261-1cd3-4f8e-8245-5e8801fcd6a4 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:04:59.750774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a9ef261-1cd3-4f8e-8245-5e8801fcd6a4 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:04:59.752801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a9ef261-1cd3-4f8e-8245-5e8801fcd6a4 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:04:59.986862 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2a9ef261-1cd3-4f8e-8245-5e8801fcd6a4 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7fccf567094c43aec0de4b4399538e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1edf3cfeff48e7a295daa9dcb1877a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:04:59.997360 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2a9ef261-1cd3-4f8e-8245-5e8801fcd6a4 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] 10.222.0.16 "GET /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf" status: 200 len: 1314 microversion: 2.1 time: 0.273337 Oct 05 03:04:59.998038 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3071/6121] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:04:59 2022] GET /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:00.360333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-2bae05fe-3ee4-4db9-9a6c-011345776c8c req-651b5d0f-1d56-466f-b9ef-171e950c7426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6205bc97-60e8-4ef7-892d-c7e3957e8fdf", "tag": "af9e1939-9fe5-4656-b89f-526c27b400db"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:05:00.390381 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-2bae05fe-3ee4-4db9-9a6c-011345776c8c req-651b5d0f-1d56-466f-b9ef-171e950c7426 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:00.390947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-2bae05fe-3ee4-4db9-9a6c-011345776c8c req-651b5d0f-1d56-466f-b9ef-171e950c7426 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:00.391579 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-2bae05fe-3ee4-4db9-9a6c-011345776c8c req-651b5d0f-1d56-466f-b9ef-171e950c7426 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:00.403541 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-2bae05fe-3ee4-4db9-9a6c-011345776c8c req-651b5d0f-1d56-466f-b9ef-171e950c7426 service nova] Creating event network-changed:af9e1939-9fe5-4656-b89f-526c27b400db for instance 6205bc97-60e8-4ef7-892d-c7e3957e8fdf on n-h1-858272-3 Oct 05 03:05:00.408417 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-2bae05fe-3ee4-4db9-9a6c-011345776c8c req-651b5d0f-1d56-466f-b9ef-171e950c7426 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051790 Oct 05 03:05:00.409155 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3051/6122] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:05:01.022431 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-98e86a91-2b51-4659-a47e-897092a0f1e6 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:01.022964 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-98e86a91-2b51-4659-a47e-897092a0f1e6 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] [instance: 6205bc97-60e8-4ef7-892d-c7e3957e8fdf] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:01.030281 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98e86a91-2b51-4659-a47e-897092a0f1e6 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:01.030722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98e86a91-2b51-4659-a47e-897092a0f1e6 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:01.031244 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98e86a91-2b51-4659-a47e-897092a0f1e6 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:01.032035 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98e86a91-2b51-4659-a47e-897092a0f1e6 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:01.032598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98e86a91-2b51-4659-a47e-897092a0f1e6 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:01.033055 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98e86a91-2b51-4659-a47e-897092a0f1e6 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:01.165174 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-98e86a91-2b51-4659-a47e-897092a0f1e6 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7fccf567094c43aec0de4b4399538e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1edf3cfeff48e7a295daa9dcb1877a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:01.172963 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-98e86a91-2b51-4659-a47e-897092a0f1e6 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] 10.222.0.16 "GET /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf" status: 200 len: 1314 microversion: 2.1 time: 0.154640 Oct 05 03:05:01.173701 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3072/6123] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:01 2022] GET /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:02.198833 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d8a41d0c-93a5-43ac-bce6-88e2b5687a49 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:02.199537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d8a41d0c-93a5-43ac-bce6-88e2b5687a49 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] [instance: 6205bc97-60e8-4ef7-892d-c7e3957e8fdf] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:02.205988 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d8a41d0c-93a5-43ac-bce6-88e2b5687a49 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:02.206473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d8a41d0c-93a5-43ac-bce6-88e2b5687a49 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:02.206912 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d8a41d0c-93a5-43ac-bce6-88e2b5687a49 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:02.207617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d8a41d0c-93a5-43ac-bce6-88e2b5687a49 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:02.208056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d8a41d0c-93a5-43ac-bce6-88e2b5687a49 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:02.208483 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d8a41d0c-93a5-43ac-bce6-88e2b5687a49 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:02.355888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d8a41d0c-93a5-43ac-bce6-88e2b5687a49 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7fccf567094c43aec0de4b4399538e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1edf3cfeff48e7a295daa9dcb1877a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:02.363625 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d8a41d0c-93a5-43ac-bce6-88e2b5687a49 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] 10.222.0.16 "GET /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf" status: 200 len: 1314 microversion: 2.1 time: 0.170469 Oct 05 03:05:02.364404 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3052/6124] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:02 2022] GET /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:03.387922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1a2de171-c3cb-453d-a567-562507004c77 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:03.388488 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1a2de171-c3cb-453d-a567-562507004c77 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] [instance: 6205bc97-60e8-4ef7-892d-c7e3957e8fdf] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:03.396288 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a2de171-c3cb-453d-a567-562507004c77 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:03.396945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a2de171-c3cb-453d-a567-562507004c77 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:03.397480 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a2de171-c3cb-453d-a567-562507004c77 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:03.398213 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a2de171-c3cb-453d-a567-562507004c77 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:03.398795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a2de171-c3cb-453d-a567-562507004c77 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:03.399396 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1a2de171-c3cb-453d-a567-562507004c77 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:03.598293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1a2de171-c3cb-453d-a567-562507004c77 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7fccf567094c43aec0de4b4399538e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1edf3cfeff48e7a295daa9dcb1877a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:03.607765 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1a2de171-c3cb-453d-a567-562507004c77 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] 10.222.0.16 "GET /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf" status: 200 len: 1314 microversion: 2.1 time: 0.223813 Oct 05 03:05:03.608357 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3073/6125] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:03 2022] GET /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:04.631885 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0b1aa443-45d6-42ef-ac99-76da365e957d tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:04.632719 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0b1aa443-45d6-42ef-ac99-76da365e957d tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] [instance: 6205bc97-60e8-4ef7-892d-c7e3957e8fdf] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:04.639670 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b1aa443-45d6-42ef-ac99-76da365e957d tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:04.640153 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b1aa443-45d6-42ef-ac99-76da365e957d tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:04.640586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b1aa443-45d6-42ef-ac99-76da365e957d tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:04.641298 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b1aa443-45d6-42ef-ac99-76da365e957d tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:04.641752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b1aa443-45d6-42ef-ac99-76da365e957d tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:04.642172 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b1aa443-45d6-42ef-ac99-76da365e957d tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:04.777533 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0b1aa443-45d6-42ef-ac99-76da365e957d tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7fccf567094c43aec0de4b4399538e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1edf3cfeff48e7a295daa9dcb1877a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:04.785508 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0b1aa443-45d6-42ef-ac99-76da365e957d tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] 10.222.0.16 "GET /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf" status: 200 len: 1314 microversion: 2.1 time: 0.157683 Oct 05 03:05:04.786086 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3053/6126] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:04 2022] GET /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:05.809143 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4e817afd-3ea9-4761-a92a-70cda27798d0 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:05.809764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4e817afd-3ea9-4761-a92a-70cda27798d0 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] [instance: 6205bc97-60e8-4ef7-892d-c7e3957e8fdf] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:05.812604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:05:05.818408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e817afd-3ea9-4761-a92a-70cda27798d0 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:05.818899 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e817afd-3ea9-4761-a92a-70cda27798d0 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:05.819333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e817afd-3ea9-4761-a92a-70cda27798d0 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:05.820032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e817afd-3ea9-4761-a92a-70cda27798d0 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:05.820487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e817afd-3ea9-4761-a92a-70cda27798d0 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:05.820923 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e817afd-3ea9-4761-a92a-70cda27798d0 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:05.827831 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=57 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:05:05.957446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4e817afd-3ea9-4761-a92a-70cda27798d0 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7fccf567094c43aec0de4b4399538e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1edf3cfeff48e7a295daa9dcb1877a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:05.965579 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4e817afd-3ea9-4761-a92a-70cda27798d0 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] 10.222.0.16 "GET /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf" status: 200 len: 1314 microversion: 2.1 time: 0.160519 Oct 05 03:05:05.966162 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3074/6127] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:05 2022] GET /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:06.268173 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b7a3d766-d46b-494e-ac6c-a5262712ddbf tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:06.268658 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b7a3d766-d46b-494e-ac6c-a5262712ddbf tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:06.276275 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b7a3d766-d46b-494e-ac6c-a5262712ddbf tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:06.276767 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b7a3d766-d46b-494e-ac6c-a5262712ddbf tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:06.277234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b7a3d766-d46b-494e-ac6c-a5262712ddbf tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:06.277938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b7a3d766-d46b-494e-ac6c-a5262712ddbf tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:06.278395 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b7a3d766-d46b-494e-ac6c-a5262712ddbf tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:06.278829 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b7a3d766-d46b-494e-ac6c-a5262712ddbf tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:06.313210 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b7a3d766-d46b-494e-ac6c-a5262712ddbf tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9/ips" status: 200 len: 149 microversion: 2.1 time: 0.047760 Oct 05 03:05:06.313210 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3054/6128] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 03:05:06 2022] GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9/ips => generated 149 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:05:06.988675 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bf86b6a8-5c69-46aa-a6fe-91f7989db491 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:06.989239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bf86b6a8-5c69-46aa-a6fe-91f7989db491 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] [instance: 6205bc97-60e8-4ef7-892d-c7e3957e8fdf] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:06.996487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf86b6a8-5c69-46aa-a6fe-91f7989db491 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:06.996994 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf86b6a8-5c69-46aa-a6fe-91f7989db491 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:06.997430 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf86b6a8-5c69-46aa-a6fe-91f7989db491 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:06.998122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf86b6a8-5c69-46aa-a6fe-91f7989db491 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:06.998571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf86b6a8-5c69-46aa-a6fe-91f7989db491 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:06.998992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf86b6a8-5c69-46aa-a6fe-91f7989db491 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:07.135649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bf86b6a8-5c69-46aa-a6fe-91f7989db491 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7fccf567094c43aec0de4b4399538e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1edf3cfeff48e7a295daa9dcb1877a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:07.144343 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bf86b6a8-5c69-46aa-a6fe-91f7989db491 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] 10.222.0.16 "GET /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf" status: 200 len: 1314 microversion: 2.1 time: 0.159439 Oct 05 03:05:07.144941 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3075/6129] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:06 2022] GET /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:07.379732 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-c805f1e1-17e4-49ef-a5f8-e3409bc9051f req-323d704d-2efc-4b56-b17a-17e2889e1e2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6205bc97-60e8-4ef7-892d-c7e3957e8fdf", "name": "network-vif-plugged", "status": "completed", "tag": "af9e1939-9fe5-4656-b89f-526c27b400db"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:05:07.394731 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:05:07.404688 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:05:07.414945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-c805f1e1-17e4-49ef-a5f8-e3409bc9051f req-323d704d-2efc-4b56-b17a-17e2889e1e2a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:07.415540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-c805f1e1-17e4-49ef-a5f8-e3409bc9051f req-323d704d-2efc-4b56-b17a-17e2889e1e2a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:07.416327 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-c805f1e1-17e4-49ef-a5f8-e3409bc9051f req-323d704d-2efc-4b56-b17a-17e2889e1e2a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:07.434950 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-c805f1e1-17e4-49ef-a5f8-e3409bc9051f req-323d704d-2efc-4b56-b17a-17e2889e1e2a service nova] Creating event network-vif-plugged:af9e1939-9fe5-4656-b89f-526c27b400db for instance 6205bc97-60e8-4ef7-892d-c7e3957e8fdf on n-h1-858272-3 Oct 05 03:05:07.441062 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-c805f1e1-17e4-49ef-a5f8-e3409bc9051f req-323d704d-2efc-4b56-b17a-17e2889e1e2a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064768 Oct 05 03:05:07.442116 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3055/6130] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:05:07.691965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5cb0c2a3-bd22-4366-8f56-fd468311249a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93dfe6d6-9a28-4861-905b-a10ce7b4cabe"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:05:07.694383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5cb0c2a3-bd22-4366-8f56-fd468311249a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:07.696495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:05:07.702246 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5cb0c2a3-bd22-4366-8f56-fd468311249a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:07.702746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5cb0c2a3-bd22-4366-8f56-fd468311249a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:07.703187 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5cb0c2a3-bd22-4366-8f56-fd468311249a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:07.703920 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5cb0c2a3-bd22-4366-8f56-fd468311249a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:07.704380 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5cb0c2a3-bd22-4366-8f56-fd468311249a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:07.704810 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5cb0c2a3-bd22-4366-8f56-fd468311249a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:08.161170 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5cb0c2a3-bd22-4366-8f56-fd468311249a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "POST /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.472979 Oct 05 03:05:08.161858 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3076/6131] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 03:05:07 2022] POST /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9/os-volume_attachments => generated 194 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:05:08.170689 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-10295816-8d6a-469b-99fa-f38307a71feb tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:08.171609 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-10295816-8d6a-469b-99fa-f38307a71feb tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] [instance: 6205bc97-60e8-4ef7-892d-c7e3957e8fdf] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:08.173681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:05:08.181846 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10295816-8d6a-469b-99fa-f38307a71feb tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:08.182443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10295816-8d6a-469b-99fa-f38307a71feb tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:08.182965 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10295816-8d6a-469b-99fa-f38307a71feb tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:08.183748 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10295816-8d6a-469b-99fa-f38307a71feb tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:08.184279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10295816-8d6a-469b-99fa-f38307a71feb tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:08.184780 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10295816-8d6a-469b-99fa-f38307a71feb tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:08.189147 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=75 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:05:08.341894 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-10295816-8d6a-469b-99fa-f38307a71feb tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7fccf567094c43aec0de4b4399538e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1edf3cfeff48e7a295daa9dcb1877a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:08.350936 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-10295816-8d6a-469b-99fa-f38307a71feb tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] 10.222.0.16 "GET /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf" status: 200 len: 1314 microversion: 2.1 time: 0.185039 Oct 05 03:05:08.351495 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3056/6132] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:08 2022] GET /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:05:09.374875 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-47cf03d7-0e17-4ee0-93af-4658ea103278 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:09.376178 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-47cf03d7-0e17-4ee0-93af-4658ea103278 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] [instance: 6205bc97-60e8-4ef7-892d-c7e3957e8fdf] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:09.385920 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-47cf03d7-0e17-4ee0-93af-4658ea103278 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:09.386651 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-47cf03d7-0e17-4ee0-93af-4658ea103278 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:09.387686 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-47cf03d7-0e17-4ee0-93af-4658ea103278 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:09.388582 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-47cf03d7-0e17-4ee0-93af-4658ea103278 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:09.389680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-47cf03d7-0e17-4ee0-93af-4658ea103278 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:09.390262 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-47cf03d7-0e17-4ee0-93af-4658ea103278 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:09.560072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-47cf03d7-0e17-4ee0-93af-4658ea103278 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7fccf567094c43aec0de4b4399538e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1edf3cfeff48e7a295daa9dcb1877a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:09.570989 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-47cf03d7-0e17-4ee0-93af-4658ea103278 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] 10.222.0.16 "GET /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf" status: 200 len: 1464 microversion: 2.1 time: 0.200727 Oct 05 03:05:09.584928 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3077/6133] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:09 2022] GET /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf => generated 1464 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:09.597301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9b2f5c6a-ffa5-4d02-a117-660c169dbdeb tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5021c143-51ae-43ae-9951-f44fdb56a173", "device": "/dev/sdb"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:05:09.600026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9b2f5c6a-ffa5-4d02-a117-660c169dbdeb tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] [instance: 6205bc97-60e8-4ef7-892d-c7e3957e8fdf] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:09.614490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b2f5c6a-ffa5-4d02-a117-660c169dbdeb tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:09.614997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b2f5c6a-ffa5-4d02-a117-660c169dbdeb tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:09.615514 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b2f5c6a-ffa5-4d02-a117-660c169dbdeb tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:09.616995 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b2f5c6a-ffa5-4d02-a117-660c169dbdeb tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:09.617444 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b2f5c6a-ffa5-4d02-a117-660c169dbdeb tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:09.618121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b2f5c6a-ffa5-4d02-a117-660c169dbdeb tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:09.921577 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9b2f5c6a-ffa5-4d02-a117-660c169dbdeb tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] 10.222.0.16 "POST /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329360 Oct 05 03:05:09.922473 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3057/6134] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 03:05:09 2022] POST /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:05:18.653759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d0be03d2-f670-4d86-a54a-464986e01a71 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:18.653759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d0be03d2-f670-4d86-a54a-464986e01a71 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:18.659516 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d0be03d2-f670-4d86-a54a-464986e01a71 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:18.660215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d0be03d2-f670-4d86-a54a-464986e01a71 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:18.660837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d0be03d2-f670-4d86-a54a-464986e01a71 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:18.661780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d0be03d2-f670-4d86-a54a-464986e01a71 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:18.662419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d0be03d2-f670-4d86-a54a-464986e01a71 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:18.663218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d0be03d2-f670-4d86-a54a-464986e01a71 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:18.963694 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d0be03d2-f670-4d86-a54a-464986e01a71 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1832 microversion: 2.1 time: 0.324733 Oct 05 03:05:18.964945 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3078/6135] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:18 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1832 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:18.989176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a052cac8-8955-4729-84fc-5aafcc7bc59c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:18.989898 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a052cac8-8955-4729-84fc-5aafcc7bc59c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:18.997380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a052cac8-8955-4729-84fc-5aafcc7bc59c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:18.997881 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a052cac8-8955-4729-84fc-5aafcc7bc59c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:18.998330 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a052cac8-8955-4729-84fc-5aafcc7bc59c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:18.999043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a052cac8-8955-4729-84fc-5aafcc7bc59c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:18.999503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a052cac8-8955-4729-84fc-5aafcc7bc59c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:18.999930 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a052cac8-8955-4729-84fc-5aafcc7bc59c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:19.143260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a052cac8-8955-4729-84fc-5aafcc7bc59c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:19.152217 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a052cac8-8955-4729-84fc-5aafcc7bc59c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1681 microversion: 2.1 time: 0.168712 Oct 05 03:05:19.152934 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3058/6136] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:18 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:19.261093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-46de2933-c06e-4295-8bd4-89e6bc478bd3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:05:19.263541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-46de2933-c06e-4295-8bd4-89e6bc478bd3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:19.270414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46de2933-c06e-4295-8bd4-89e6bc478bd3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:19.270895 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46de2933-c06e-4295-8bd4-89e6bc478bd3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:19.271530 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46de2933-c06e-4295-8bd4-89e6bc478bd3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:19.272937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46de2933-c06e-4295-8bd4-89e6bc478bd3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:19.273550 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46de2933-c06e-4295-8bd4-89e6bc478bd3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:19.274131 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46de2933-c06e-4295-8bd4-89e6bc478bd3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:19.348032 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-46de2933-c06e-4295-8bd4-89e6bc478bd3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "POST /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3/action" status: 200 len: 32633 microversion: 2.1 time: 0.090719 Oct 05 03:05:19.348699 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3079/6137] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:05:19 2022] POST /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3/action => generated 32633 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 03:05:19.571062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-21982e7d-ba88-41e4-9f3e-65da816599df tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:05:19.571645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-21982e7d-ba88-41e4-9f3e-65da816599df tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:19.578207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-21982e7d-ba88-41e4-9f3e-65da816599df tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:19.578705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-21982e7d-ba88-41e4-9f3e-65da816599df tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:19.579142 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-21982e7d-ba88-41e4-9f3e-65da816599df tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:19.580081 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-21982e7d-ba88-41e4-9f3e-65da816599df tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:19.580543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-21982e7d-ba88-41e4-9f3e-65da816599df tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:19.581008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-21982e7d-ba88-41e4-9f3e-65da816599df tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:19.627179 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-21982e7d-ba88-41e4-9f3e-65da816599df tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0589f01c6bb44698b9e060a659c8679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '519c294387a04ca5bcdeab3e4e574eb5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:19.627937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-21982e7d-ba88-41e4-9f3e-65da816599df tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] flavor_id is None. Assuming migration. {{(pid=122320) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 05 03:05:19.628389 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-21982e7d-ba88-41e4-9f3e-65da816599df tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122320) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 05 03:05:19.912619 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-21982e7d-ba88-41e4-9f3e-65da816599df tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3/action" status: 202 len: 0 microversion: 2.1 time: 0.345300 Oct 05 03:05:19.917698 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3059/6138] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:05:19 2022] POST /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:05:19.925122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a7513a4b-bbc1-4a89-a3a0-88c5c8e6602a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:19.926689 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a7513a4b-bbc1-4a89-a3a0-88c5c8e6602a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:19.936020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a7513a4b-bbc1-4a89-a3a0-88c5c8e6602a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:19.936528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a7513a4b-bbc1-4a89-a3a0-88c5c8e6602a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:19.937039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a7513a4b-bbc1-4a89-a3a0-88c5c8e6602a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:19.937701 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a7513a4b-bbc1-4a89-a3a0-88c5c8e6602a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:19.938154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a7513a4b-bbc1-4a89-a3a0-88c5c8e6602a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:19.938579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a7513a4b-bbc1-4a89-a3a0-88c5c8e6602a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:20.174617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a7513a4b-bbc1-4a89-a3a0-88c5c8e6602a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:20.186976 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a7513a4b-bbc1-4a89-a3a0-88c5c8e6602a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1690 microversion: 2.1 time: 0.267667 Oct 05 03:05:20.187687 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3080/6139] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:19 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1690 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:05:21.213596 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e84d7440-ba18-4bf1-a298-ba6c3cc53494 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:21.214278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e84d7440-ba18-4bf1-a298-ba6c3cc53494 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:21.221569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e84d7440-ba18-4bf1-a298-ba6c3cc53494 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:21.222206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e84d7440-ba18-4bf1-a298-ba6c3cc53494 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:21.222657 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e84d7440-ba18-4bf1-a298-ba6c3cc53494 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:21.223351 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e84d7440-ba18-4bf1-a298-ba6c3cc53494 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:21.223812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e84d7440-ba18-4bf1-a298-ba6c3cc53494 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:21.224237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e84d7440-ba18-4bf1-a298-ba6c3cc53494 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:21.370599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e84d7440-ba18-4bf1-a298-ba6c3cc53494 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:21.380086 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e84d7440-ba18-4bf1-a298-ba6c3cc53494 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1690 microversion: 2.1 time: 0.172122 Oct 05 03:05:21.380673 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3060/6140] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:21 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1690 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:22.406325 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0da20b21-8aa3-4c49-8217-cb53ebe3677b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:22.406946 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0da20b21-8aa3-4c49-8217-cb53ebe3677b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:22.418715 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0da20b21-8aa3-4c49-8217-cb53ebe3677b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:22.419418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0da20b21-8aa3-4c49-8217-cb53ebe3677b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:22.420193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0da20b21-8aa3-4c49-8217-cb53ebe3677b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:22.421120 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0da20b21-8aa3-4c49-8217-cb53ebe3677b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:22.422299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0da20b21-8aa3-4c49-8217-cb53ebe3677b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:22.422988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0da20b21-8aa3-4c49-8217-cb53ebe3677b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:22.725055 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0da20b21-8aa3-4c49-8217-cb53ebe3677b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:22.749091 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0da20b21-8aa3-4c49-8217-cb53ebe3677b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1690 microversion: 2.1 time: 0.346481 Oct 05 03:05:22.750520 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3081/6141] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:22 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1690 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:22.997767 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6921533a-3f09-4b7d-ac2f-561b6209c69a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Action: 'create', calling method: .version_select at 0x7fccdefd3b80>, body: {"keypair": {"name": "tempest-keypair-1932580661", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7863oZLNUQ0aTIwuZ6ljn11uyPfJ+n7vMoS5i0xXsomye6v/PydLoBtnv9fJxXhPz1qO6hS0ocM4pXhvuDalB4Mfyivt7BksSiAZEnRi+eqXcZydCqix1NsNKWTlUUfQ=="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:05:23.021861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-6921533a-3f09-4b7d-ac2f-561b6209c69a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Getting quotas for project 7b99b6a5b1764f64a68793f37d4f9b96. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:05:23.030025 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-6921533a-3f09-4b7d-ac2f-561b6209c69a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Getting quotas for user 881baf1ede7e4fb5acf65268a81241ad and project 7b99b6a5b1764f64a68793f37d4f9b96. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:05:23.058326 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6921533a-3f09-4b7d-ac2f-561b6209c69a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.065355 Oct 05 03:05:23.058968 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3061/6142] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 03:05:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:05:23.775577 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a8bab65c-ef6f-4dd3-9b6e-88ff6584d5bd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:23.776871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a8bab65c-ef6f-4dd3-9b6e-88ff6584d5bd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:23.784630 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8bab65c-ef6f-4dd3-9b6e-88ff6584d5bd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:23.785493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8bab65c-ef6f-4dd3-9b6e-88ff6584d5bd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:23.786148 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8bab65c-ef6f-4dd3-9b6e-88ff6584d5bd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:23.787056 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8bab65c-ef6f-4dd3-9b6e-88ff6584d5bd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:23.787495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8bab65c-ef6f-4dd3-9b6e-88ff6584d5bd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:23.788318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8bab65c-ef6f-4dd3-9b6e-88ff6584d5bd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:23.973243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a8bab65c-ef6f-4dd3-9b6e-88ff6584d5bd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:23.987208 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a8bab65c-ef6f-4dd3-9b6e-88ff6584d5bd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1695 microversion: 2.1 time: 0.216422 Oct 05 03:05:23.987960 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3082/6143] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:23 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1695 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:24.901911 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-68082662-f562-41f7-a756-99b72cfa5b20 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1978182734", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dbc27df4-8913-4a58-8837-a72d1d361dca"}], "security_groups": [{"name": "tempest-securitygroup--721510992"}], "key_name": "tempest-keypair-1932580661", "user_data": "}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:05:25.011430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-68082662-f562-41f7-a756-99b72cfa5b20 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] validate_networks() for [('dbc27df4-8913-4a58-8837-a72d1d361dca', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:05:25.019420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-23ea3a98-bf88-425b-8cf7-89bbb6ac4956 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:25.020024 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-23ea3a98-bf88-425b-8cf7-89bbb6ac4956 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:25.028840 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23ea3a98-bf88-425b-8cf7-89bbb6ac4956 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:25.029364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23ea3a98-bf88-425b-8cf7-89bbb6ac4956 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:25.029859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23ea3a98-bf88-425b-8cf7-89bbb6ac4956 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:25.030496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23ea3a98-bf88-425b-8cf7-89bbb6ac4956 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:25.030948 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23ea3a98-bf88-425b-8cf7-89bbb6ac4956 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:25.031372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23ea3a98-bf88-425b-8cf7-89bbb6ac4956 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:25.228630 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-23ea3a98-bf88-425b-8cf7-89bbb6ac4956 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:25.236850 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-23ea3a98-bf88-425b-8cf7-89bbb6ac4956 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1695 microversion: 2.1 time: 0.221353 Oct 05 03:05:25.237458 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3083/6144] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:25 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1695 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:05:25.495187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-68082662-f562-41f7-a756-99b72cfa5b20 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:05:25.495612 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-68082662-f562-41f7-a756-99b72cfa5b20 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:05:25.496080 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-68082662-f562-41f7-a756-99b72cfa5b20 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:05:25.496633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-68082662-f562-41f7-a756-99b72cfa5b20 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:05:25.497091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-68082662-f562-41f7-a756-99b72cfa5b20 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:05:25.507473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68082662-f562-41f7-a756-99b72cfa5b20 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:25.508016 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68082662-f562-41f7-a756-99b72cfa5b20 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:25.508455 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68082662-f562-41f7-a756-99b72cfa5b20 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:25.509255 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68082662-f562-41f7-a756-99b72cfa5b20 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:25.509705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68082662-f562-41f7-a756-99b72cfa5b20 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:25.510130 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68082662-f562-41f7-a756-99b72cfa5b20 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:25.527798 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-68082662-f562-41f7-a756-99b72cfa5b20 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Getting quotas for project 7b99b6a5b1764f64a68793f37d4f9b96. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:05:25.533411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-68082662-f562-41f7-a756-99b72cfa5b20 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Getting quotas for user 881baf1ede7e4fb5acf65268a81241ad and project 7b99b6a5b1764f64a68793f37d4f9b96. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:05:25.547097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-68082662-f562-41f7-a756-99b72cfa5b20 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:05:25.549409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-68082662-f562-41f7-a756-99b72cfa5b20 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:05:25.647891 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-68082662-f562-41f7-a756-99b72cfa5b20 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.751236 Oct 05 03:05:25.655399 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3062/6145] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:05:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:05:25.666348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a74d3dec-08a2-43bb-8367-4a7a65976172 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:25.667201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a74d3dec-08a2-43bb-8367-4a7a65976172 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:25.751236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a74d3dec-08a2-43bb-8367-4a7a65976172 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:25.759012 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a74d3dec-08a2-43bb-8367-4a7a65976172 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02" status: 200 len: 1242 microversion: 2.1 time: 0.101905 Oct 05 03:05:25.759589 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3084/6146] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:25 2022] GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 => generated 1242 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:26.261732 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ad0a4a31-7e26-4bc3-81d4-a92a5346fa05 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:26.262337 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ad0a4a31-7e26-4bc3-81d4-a92a5346fa05 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:26.269483 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad0a4a31-7e26-4bc3-81d4-a92a5346fa05 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:26.269966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad0a4a31-7e26-4bc3-81d4-a92a5346fa05 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:26.270400 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad0a4a31-7e26-4bc3-81d4-a92a5346fa05 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:26.271551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad0a4a31-7e26-4bc3-81d4-a92a5346fa05 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:26.272010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad0a4a31-7e26-4bc3-81d4-a92a5346fa05 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:26.273229 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad0a4a31-7e26-4bc3-81d4-a92a5346fa05 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:26.433233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ad0a4a31-7e26-4bc3-81d4-a92a5346fa05 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:26.447903 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ad0a4a31-7e26-4bc3-81d4-a92a5346fa05 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1695 microversion: 2.1 time: 0.191005 Oct 05 03:05:26.449501 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3063/6147] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:26 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1695 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:26.782077 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-33109178-fd11-40eb-b2a6-4bb6384d6b8a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:26.782690 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-33109178-fd11-40eb-b2a6-4bb6384d6b8a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:26.791127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-33109178-fd11-40eb-b2a6-4bb6384d6b8a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:26.791490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-33109178-fd11-40eb-b2a6-4bb6384d6b8a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:26.792024 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-33109178-fd11-40eb-b2a6-4bb6384d6b8a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:26.793841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-33109178-fd11-40eb-b2a6-4bb6384d6b8a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:26.793841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-33109178-fd11-40eb-b2a6-4bb6384d6b8a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:26.793841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-33109178-fd11-40eb-b2a6-4bb6384d6b8a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:26.880300 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-33109178-fd11-40eb-b2a6-4bb6384d6b8a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:26.890044 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-33109178-fd11-40eb-b2a6-4bb6384d6b8a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02" status: 200 len: 1294 microversion: 2.1 time: 0.111725 Oct 05 03:05:26.891230 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3085/6148] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:26 2022] GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 => generated 1294 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:27.474000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e6faff33-adaf-453b-8e22-79695f0da87f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:27.474618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e6faff33-adaf-453b-8e22-79695f0da87f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:27.481810 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e6faff33-adaf-453b-8e22-79695f0da87f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:27.482349 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e6faff33-adaf-453b-8e22-79695f0da87f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:27.483047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e6faff33-adaf-453b-8e22-79695f0da87f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:27.483957 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e6faff33-adaf-453b-8e22-79695f0da87f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:27.484612 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e6faff33-adaf-453b-8e22-79695f0da87f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:27.485072 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e6faff33-adaf-453b-8e22-79695f0da87f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:27.708488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e6faff33-adaf-453b-8e22-79695f0da87f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:27.717361 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e6faff33-adaf-453b-8e22-79695f0da87f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1695 microversion: 2.1 time: 0.247177 Oct 05 03:05:27.717954 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3064/6149] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:27 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1695 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:27.914359 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8a64c4b9-e335-4a14-9ff2-99365840d7a4 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:27.916359 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8a64c4b9-e335-4a14-9ff2-99365840d7a4 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:27.923675 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a64c4b9-e335-4a14-9ff2-99365840d7a4 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:27.924383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a64c4b9-e335-4a14-9ff2-99365840d7a4 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:27.925030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a64c4b9-e335-4a14-9ff2-99365840d7a4 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:27.925912 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a64c4b9-e335-4a14-9ff2-99365840d7a4 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:27.926527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a64c4b9-e335-4a14-9ff2-99365840d7a4 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:27.927144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a64c4b9-e335-4a14-9ff2-99365840d7a4 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:28.143547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8a64c4b9-e335-4a14-9ff2-99365840d7a4 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:28.158232 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8a64c4b9-e335-4a14-9ff2-99365840d7a4 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02" status: 200 len: 1367 microversion: 2.1 time: 0.248266 Oct 05 03:05:28.159090 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3086/6150] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:27 2022] GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:28.743062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8b18effe-6413-4cae-952c-d4d869a50c42 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:28.744547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8b18effe-6413-4cae-952c-d4d869a50c42 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:28.752150 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b18effe-6413-4cae-952c-d4d869a50c42 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:28.752703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b18effe-6413-4cae-952c-d4d869a50c42 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:28.753341 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b18effe-6413-4cae-952c-d4d869a50c42 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:28.754191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b18effe-6413-4cae-952c-d4d869a50c42 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:28.755088 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b18effe-6413-4cae-952c-d4d869a50c42 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:28.755678 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8b18effe-6413-4cae-952c-d4d869a50c42 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:28.803109 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-8508f938-825c-4f36-86f8-938c87663412 req-f06ffab7-9a22-43e7-8330-f46134ea3ace service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8642a9ef-f4cc-4ba0-97dd-4443e73bcd02", "tag": "1dc61bd7-0385-4309-a420-491598fbc27d"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:05:28.819975 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-8508f938-825c-4f36-86f8-938c87663412 req-f06ffab7-9a22-43e7-8330-f46134ea3ace service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:28.820795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-8508f938-825c-4f36-86f8-938c87663412 req-f06ffab7-9a22-43e7-8330-f46134ea3ace service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:28.821443 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-8508f938-825c-4f36-86f8-938c87663412 req-f06ffab7-9a22-43e7-8330-f46134ea3ace service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:28.833337 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-8508f938-825c-4f36-86f8-938c87663412 req-f06ffab7-9a22-43e7-8330-f46134ea3ace service nova] Creating event network-changed:1dc61bd7-0385-4309-a420-491598fbc27d for instance 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 on n-h2-858272-3 Oct 05 03:05:28.839804 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-8508f938-825c-4f36-86f8-938c87663412 req-f06ffab7-9a22-43e7-8330-f46134ea3ace service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047512 Oct 05 03:05:28.840968 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3087/6151] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:05:29.018446 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8b18effe-6413-4cae-952c-d4d869a50c42 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:29.028091 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8b18effe-6413-4cae-952c-d4d869a50c42 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1695 microversion: 2.1 time: 0.290953 Oct 05 03:05:29.038236 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3065/6152] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:28 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1695 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:29.186776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-03bd58ef-808d-4c8c-83df-f787a06933bd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:29.188527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-03bd58ef-808d-4c8c-83df-f787a06933bd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:29.198002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-03bd58ef-808d-4c8c-83df-f787a06933bd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:29.198698 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-03bd58ef-808d-4c8c-83df-f787a06933bd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:29.199617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-03bd58ef-808d-4c8c-83df-f787a06933bd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:29.200472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-03bd58ef-808d-4c8c-83df-f787a06933bd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:29.201601 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-03bd58ef-808d-4c8c-83df-f787a06933bd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:29.202185 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-03bd58ef-808d-4c8c-83df-f787a06933bd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:29.395231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-03bd58ef-808d-4c8c-83df-f787a06933bd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:29.405012 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-03bd58ef-808d-4c8c-83df-f787a06933bd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02" status: 200 len: 1367 microversion: 2.1 time: 0.223381 Oct 05 03:05:29.409336 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3088/6153] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:29 2022] GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:30.053358 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fc3c7b0c-5130-4d84-8c0b-c116bc2c911d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:30.055597 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fc3c7b0c-5130-4d84-8c0b-c116bc2c911d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:30.063429 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc3c7b0c-5130-4d84-8c0b-c116bc2c911d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:30.063915 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc3c7b0c-5130-4d84-8c0b-c116bc2c911d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:30.064540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc3c7b0c-5130-4d84-8c0b-c116bc2c911d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:30.065286 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc3c7b0c-5130-4d84-8c0b-c116bc2c911d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:30.065812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc3c7b0c-5130-4d84-8c0b-c116bc2c911d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:30.066244 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc3c7b0c-5130-4d84-8c0b-c116bc2c911d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:30.203667 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fc3c7b0c-5130-4d84-8c0b-c116bc2c911d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:30.212506 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fc3c7b0c-5130-4d84-8c0b-c116bc2c911d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1695 microversion: 2.1 time: 0.163037 Oct 05 03:05:30.213233 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3066/6154] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:30 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:30.429439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d8c92d9f-63be-4176-a748-5b33283e1565 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:30.430650 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d8c92d9f-63be-4176-a748-5b33283e1565 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:30.437984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8c92d9f-63be-4176-a748-5b33283e1565 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:30.438459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8c92d9f-63be-4176-a748-5b33283e1565 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:30.438887 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8c92d9f-63be-4176-a748-5b33283e1565 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:30.439603 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8c92d9f-63be-4176-a748-5b33283e1565 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:30.440055 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8c92d9f-63be-4176-a748-5b33283e1565 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:30.440595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8c92d9f-63be-4176-a748-5b33283e1565 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:30.591237 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d8c92d9f-63be-4176-a748-5b33283e1565 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:30.599732 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d8c92d9f-63be-4176-a748-5b33283e1565 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02" status: 200 len: 1367 microversion: 2.1 time: 0.174931 Oct 05 03:05:30.613183 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3089/6155] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:30 2022] GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:30.985424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5df3a054-1168-40e9-a2a4-f54aa4100064 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:05:30.987865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5df3a054-1168-40e9-a2a4-f54aa4100064 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 75b557e6-a0a4-4791-b043-96983fed78e6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:30.995530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5df3a054-1168-40e9-a2a4-f54aa4100064 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:30.996251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5df3a054-1168-40e9-a2a4-f54aa4100064 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:30.996576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5df3a054-1168-40e9-a2a4-f54aa4100064 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:30.997316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5df3a054-1168-40e9-a2a4-f54aa4100064 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:30.997866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5df3a054-1168-40e9-a2a4-f54aa4100064 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:30.998177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5df3a054-1168-40e9-a2a4-f54aa4100064 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:31.235984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5dc929e8-365b-40f2-9f9a-29b41898aef1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:31.236605 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5dc929e8-365b-40f2-9f9a-29b41898aef1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:31.243145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5dc929e8-365b-40f2-9f9a-29b41898aef1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:31.243629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5dc929e8-365b-40f2-9f9a-29b41898aef1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:31.244089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5dc929e8-365b-40f2-9f9a-29b41898aef1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:31.244772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5dc929e8-365b-40f2-9f9a-29b41898aef1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:31.245295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5dc929e8-365b-40f2-9f9a-29b41898aef1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:31.245706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5dc929e8-365b-40f2-9f9a-29b41898aef1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:31.382834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5dc929e8-365b-40f2-9f9a-29b41898aef1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:31.390869 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5dc929e8-365b-40f2-9f9a-29b41898aef1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1695 microversion: 2.1 time: 0.158859 Oct 05 03:05:31.391751 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3090/6156] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:31 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:05:31.625314 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1decca89-94da-4f1b-9c6e-e99088fec665 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:31.626706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1decca89-94da-4f1b-9c6e-e99088fec665 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:31.636809 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1decca89-94da-4f1b-9c6e-e99088fec665 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:31.637272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1decca89-94da-4f1b-9c6e-e99088fec665 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:31.637742 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1decca89-94da-4f1b-9c6e-e99088fec665 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:31.638697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1decca89-94da-4f1b-9c6e-e99088fec665 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:31.639610 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1decca89-94da-4f1b-9c6e-e99088fec665 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:31.640221 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1decca89-94da-4f1b-9c6e-e99088fec665 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:31.669933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:05:31.699898 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5df3a054-1168-40e9-a2a4-f54aa4100064 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "POST /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6/action" status: 200 len: 24572 microversion: 2.1 time: 0.718603 Oct 05 03:05:31.701292 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3067/6157] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:05:30 2022] POST /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6/action => generated 24572 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 03:05:31.901321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1decca89-94da-4f1b-9c6e-e99088fec665 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:31.909360 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1decca89-94da-4f1b-9c6e-e99088fec665 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02" status: 200 len: 1367 microversion: 2.1 time: 0.288053 Oct 05 03:05:31.910424 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3091/6158] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:31 2022] GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 => generated 1367 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:05:32.416388 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-63282f5f-b82c-48af-a189-623555704264 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:32.417215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-63282f5f-b82c-48af-a189-623555704264 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:32.424882 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63282f5f-b82c-48af-a189-623555704264 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:32.425395 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63282f5f-b82c-48af-a189-623555704264 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:32.426044 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63282f5f-b82c-48af-a189-623555704264 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:32.426729 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63282f5f-b82c-48af-a189-623555704264 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:32.427325 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63282f5f-b82c-48af-a189-623555704264 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:32.427741 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63282f5f-b82c-48af-a189-623555704264 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:32.586381 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-63282f5f-b82c-48af-a189-623555704264 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:32.595364 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-63282f5f-b82c-48af-a189-623555704264 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1695 microversion: 2.1 time: 0.184179 Oct 05 03:05:32.596088 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3068/6159] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:32 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1695 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:32.935592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7d10783f-d9c1-48fd-a688-b668e19c56bb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:32.936198 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7d10783f-d9c1-48fd-a688-b668e19c56bb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:32.943383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d10783f-d9c1-48fd-a688-b668e19c56bb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:32.944230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d10783f-d9c1-48fd-a688-b668e19c56bb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:32.944686 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d10783f-d9c1-48fd-a688-b668e19c56bb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:32.945391 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d10783f-d9c1-48fd-a688-b668e19c56bb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:32.945844 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d10783f-d9c1-48fd-a688-b668e19c56bb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:32.946264 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d10783f-d9c1-48fd-a688-b668e19c56bb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:33.117060 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7d10783f-d9c1-48fd-a688-b668e19c56bb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:33.124867 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7d10783f-d9c1-48fd-a688-b668e19c56bb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02" status: 200 len: 1367 microversion: 2.1 time: 0.193116 Oct 05 03:05:33.125467 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3092/6160] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:32 2022] GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:33.620778 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0563347d-3c36-458c-aec7-e2c988a1ea0a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:33.621745 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0563347d-3c36-458c-aec7-e2c988a1ea0a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:33.630577 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0563347d-3c36-458c-aec7-e2c988a1ea0a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:33.631072 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0563347d-3c36-458c-aec7-e2c988a1ea0a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:33.631508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0563347d-3c36-458c-aec7-e2c988a1ea0a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:33.633649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0563347d-3c36-458c-aec7-e2c988a1ea0a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:33.634116 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0563347d-3c36-458c-aec7-e2c988a1ea0a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:33.634544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0563347d-3c36-458c-aec7-e2c988a1ea0a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:33.787354 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0563347d-3c36-458c-aec7-e2c988a1ea0a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:33.797284 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0563347d-3c36-458c-aec7-e2c988a1ea0a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1695 microversion: 2.1 time: 0.181331 Oct 05 03:05:33.797894 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3069/6161] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:33 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1695 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:34.150253 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-78e4dbc3-f14e-439e-8656-b8039c906e7e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:34.150959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-78e4dbc3-f14e-439e-8656-b8039c906e7e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:34.159523 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-78e4dbc3-f14e-439e-8656-b8039c906e7e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:34.160028 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-78e4dbc3-f14e-439e-8656-b8039c906e7e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:34.160490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-78e4dbc3-f14e-439e-8656-b8039c906e7e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:34.161750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-78e4dbc3-f14e-439e-8656-b8039c906e7e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:34.162111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-78e4dbc3-f14e-439e-8656-b8039c906e7e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:34.162524 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-78e4dbc3-f14e-439e-8656-b8039c906e7e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:34.312691 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-6f4761f5-e5e3-4515-a38c-41539273ec6e req-ca396822-dc0b-4985-9e7d-490350980868 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8642a9ef-f4cc-4ba0-97dd-4443e73bcd02", "name": "network-vif-plugged", "status": "completed", "tag": "1dc61bd7-0385-4309-a420-491598fbc27d"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:05:34.358017 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-6f4761f5-e5e3-4515-a38c-41539273ec6e req-ca396822-dc0b-4985-9e7d-490350980868 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:34.378829 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-6f4761f5-e5e3-4515-a38c-41539273ec6e req-ca396822-dc0b-4985-9e7d-490350980868 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:34.385861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-6f4761f5-e5e3-4515-a38c-41539273ec6e req-ca396822-dc0b-4985-9e7d-490350980868 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:34.406889 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-6f4761f5-e5e3-4515-a38c-41539273ec6e req-ca396822-dc0b-4985-9e7d-490350980868 service nova] Creating event network-vif-plugged:1dc61bd7-0385-4309-a420-491598fbc27d for instance 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 on n-h2-858272-3 Oct 05 03:05:34.412440 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-6f4761f5-e5e3-4515-a38c-41539273ec6e req-ca396822-dc0b-4985-9e7d-490350980868 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118167 Oct 05 03:05:34.413919 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3070/6162] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:05:34.418051 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-78e4dbc3-f14e-439e-8656-b8039c906e7e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:34.430783 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-78e4dbc3-f14e-439e-8656-b8039c906e7e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02" status: 200 len: 1367 microversion: 2.1 time: 0.284249 Oct 05 03:05:34.431394 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3093/6163] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:34 2022] GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 => generated 1367 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:34.822052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0a2c857e-ea75-4808-b766-95b4577c9bda tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:34.822715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0a2c857e-ea75-4808-b766-95b4577c9bda tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:34.828911 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0a2c857e-ea75-4808-b766-95b4577c9bda tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:34.829415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0a2c857e-ea75-4808-b766-95b4577c9bda tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:34.829854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0a2c857e-ea75-4808-b766-95b4577c9bda tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:34.830542 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0a2c857e-ea75-4808-b766-95b4577c9bda tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:34.830995 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0a2c857e-ea75-4808-b766-95b4577c9bda tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:34.831416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0a2c857e-ea75-4808-b766-95b4577c9bda tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:34.969326 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0a2c857e-ea75-4808-b766-95b4577c9bda tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:34.978183 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0a2c857e-ea75-4808-b766-95b4577c9bda tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1695 microversion: 2.1 time: 0.160486 Oct 05 03:05:34.978764 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3071/6164] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:34 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:35.455284 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bd7496fb-bd1b-462a-a09b-3a6832804968 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:35.455853 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bd7496fb-bd1b-462a-a09b-3a6832804968 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:35.463523 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd7496fb-bd1b-462a-a09b-3a6832804968 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:35.464046 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd7496fb-bd1b-462a-a09b-3a6832804968 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:35.464498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd7496fb-bd1b-462a-a09b-3a6832804968 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:35.465231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd7496fb-bd1b-462a-a09b-3a6832804968 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:35.465697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd7496fb-bd1b-462a-a09b-3a6832804968 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:35.466128 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bd7496fb-bd1b-462a-a09b-3a6832804968 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:35.602081 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bd7496fb-bd1b-462a-a09b-3a6832804968 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:35.609710 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bd7496fb-bd1b-462a-a09b-3a6832804968 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02" status: 200 len: 1367 microversion: 2.1 time: 0.158474 Oct 05 03:05:35.610279 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3094/6165] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:35 2022] GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:36.001723 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-03b3fab9-16a4-4804-9be0-ade4a05df9b4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:36.002233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-03b3fab9-16a4-4804-9be0-ade4a05df9b4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:36.005023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:05:36.006063 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=10 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:05:36.013016 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03b3fab9-16a4-4804-9be0-ade4a05df9b4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:36.013735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03b3fab9-16a4-4804-9be0-ade4a05df9b4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:36.014567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03b3fab9-16a4-4804-9be0-ade4a05df9b4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:36.015605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03b3fab9-16a4-4804-9be0-ade4a05df9b4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:36.016070 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03b3fab9-16a4-4804-9be0-ade4a05df9b4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:36.016505 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03b3fab9-16a4-4804-9be0-ade4a05df9b4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:36.036158 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:05:36.174625 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-03b3fab9-16a4-4804-9be0-ade4a05df9b4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:36.184197 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-03b3fab9-16a4-4804-9be0-ade4a05df9b4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1695 microversion: 2.1 time: 0.186459 Oct 05 03:05:36.184919 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3072/6166] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:35 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1695 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:36.633201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9a134971-d6ce-4f5c-86c7-b3a8eac4e5b1 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:36.634171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9a134971-d6ce-4f5c-86c7-b3a8eac4e5b1 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:36.637289 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:05:36.640321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=44 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:05:36.644751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a134971-d6ce-4f5c-86c7-b3a8eac4e5b1 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:36.645272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a134971-d6ce-4f5c-86c7-b3a8eac4e5b1 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:36.645722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a134971-d6ce-4f5c-86c7-b3a8eac4e5b1 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:36.646403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a134971-d6ce-4f5c-86c7-b3a8eac4e5b1 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:36.647537 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a134971-d6ce-4f5c-86c7-b3a8eac4e5b1 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:36.647961 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a134971-d6ce-4f5c-86c7-b3a8eac4e5b1 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:36.803040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9a134971-d6ce-4f5c-86c7-b3a8eac4e5b1 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:36.812099 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9a134971-d6ce-4f5c-86c7-b3a8eac4e5b1 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02" status: 200 len: 1557 microversion: 2.1 time: 0.182875 Oct 05 03:05:36.813153 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3095/6167] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:36 2022] GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 => generated 1557 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:36.834869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3e30f223-2e9e-4ade-a0b8-adaf12b5e69e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:36.835520 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3e30f223-2e9e-4ade-a0b8-adaf12b5e69e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:36.842131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e30f223-2e9e-4ade-a0b8-adaf12b5e69e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:36.842940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e30f223-2e9e-4ade-a0b8-adaf12b5e69e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:36.843720 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e30f223-2e9e-4ade-a0b8-adaf12b5e69e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:36.844586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e30f223-2e9e-4ade-a0b8-adaf12b5e69e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:36.845311 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e30f223-2e9e-4ade-a0b8-adaf12b5e69e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:36.845991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3e30f223-2e9e-4ade-a0b8-adaf12b5e69e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:36.928952 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3e30f223-2e9e-4ade-a0b8-adaf12b5e69e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097565 Oct 05 03:05:36.929556 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3073/6168] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 03:05:36 2022] GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:05:37.207853 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9b51fd06-a2ed-4132-921d-fefd76272de4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:37.208387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9b51fd06-a2ed-4132-921d-fefd76272de4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:37.215349 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b51fd06-a2ed-4132-921d-fefd76272de4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:37.215845 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b51fd06-a2ed-4132-921d-fefd76272de4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:37.216283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b51fd06-a2ed-4132-921d-fefd76272de4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:37.217020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b51fd06-a2ed-4132-921d-fefd76272de4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:37.217479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b51fd06-a2ed-4132-921d-fefd76272de4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:37.217907 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b51fd06-a2ed-4132-921d-fefd76272de4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:37.363363 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9b51fd06-a2ed-4132-921d-fefd76272de4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:37.371740 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9b51fd06-a2ed-4132-921d-fefd76272de4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1695 microversion: 2.1 time: 0.167948 Oct 05 03:05:37.388249 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3096/6169] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:37 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1695 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:38.092118 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-7709aa18-77d3-455d-937e-a800d8c698e2 req-b312187f-d53a-4ce8-b884-e4ed756dc7f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8642a9ef-f4cc-4ba0-97dd-4443e73bcd02", "tag": "1dc61bd7-0385-4309-a420-491598fbc27d"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:05:38.104887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-7709aa18-77d3-455d-937e-a800d8c698e2 req-b312187f-d53a-4ce8-b884-e4ed756dc7f2 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:38.105317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-7709aa18-77d3-455d-937e-a800d8c698e2 req-b312187f-d53a-4ce8-b884-e4ed756dc7f2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:38.106120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-7709aa18-77d3-455d-937e-a800d8c698e2 req-b312187f-d53a-4ce8-b884-e4ed756dc7f2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:38.119349 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-7709aa18-77d3-455d-937e-a800d8c698e2 req-b312187f-d53a-4ce8-b884-e4ed756dc7f2 service nova] Creating event network-changed:1dc61bd7-0385-4309-a420-491598fbc27d for instance 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 on n-h2-858272-3 Oct 05 03:05:38.124241 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-7709aa18-77d3-455d-937e-a800d8c698e2 req-b312187f-d53a-4ce8-b884-e4ed756dc7f2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186496 Oct 05 03:05:38.124834 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3074/6170] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:05:38.395977 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b5bf42d4-92f8-4e7a-b31f-c5c87bdc01e8 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:38.398318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b5bf42d4-92f8-4e7a-b31f-c5c87bdc01e8 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:38.406788 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5bf42d4-92f8-4e7a-b31f-c5c87bdc01e8 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:38.407796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5bf42d4-92f8-4e7a-b31f-c5c87bdc01e8 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:38.408727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5bf42d4-92f8-4e7a-b31f-c5c87bdc01e8 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:38.409758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5bf42d4-92f8-4e7a-b31f-c5c87bdc01e8 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:38.410615 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5bf42d4-92f8-4e7a-b31f-c5c87bdc01e8 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:38.411303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b5bf42d4-92f8-4e7a-b31f-c5c87bdc01e8 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:38.554895 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b5bf42d4-92f8-4e7a-b31f-c5c87bdc01e8 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:38.562944 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b5bf42d4-92f8-4e7a-b31f-c5c87bdc01e8 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1695 microversion: 2.1 time: 0.171715 Oct 05 03:05:38.563790 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3097/6171] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:38 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1695 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:39.591278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-10b45c0a-ce24-4438-8f93-4df5d7e78355 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:39.592928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-10b45c0a-ce24-4438-8f93-4df5d7e78355 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:39.595214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:05:39.602438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10b45c0a-ce24-4438-8f93-4df5d7e78355 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:39.603182 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10b45c0a-ce24-4438-8f93-4df5d7e78355 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:39.603682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10b45c0a-ce24-4438-8f93-4df5d7e78355 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:39.604430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10b45c0a-ce24-4438-8f93-4df5d7e78355 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:39.604865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10b45c0a-ce24-4438-8f93-4df5d7e78355 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:39.605344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-10b45c0a-ce24-4438-8f93-4df5d7e78355 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:39.774257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-10b45c0a-ce24-4438-8f93-4df5d7e78355 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:39.786251 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-10b45c0a-ce24-4438-8f93-4df5d7e78355 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1695 microversion: 2.1 time: 0.201647 Oct 05 03:05:39.786882 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3075/6172] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:39 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1695 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:40.814514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5db979f5-8453-4d7e-be52-bad1c62939ab tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:40.820577 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5db979f5-8453-4d7e-be52-bad1c62939ab tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:40.832861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5db979f5-8453-4d7e-be52-bad1c62939ab tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:40.833381 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5db979f5-8453-4d7e-be52-bad1c62939ab tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:40.833822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5db979f5-8453-4d7e-be52-bad1c62939ab tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:40.834526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5db979f5-8453-4d7e-be52-bad1c62939ab tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:40.838174 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5db979f5-8453-4d7e-be52-bad1c62939ab tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:40.838823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5db979f5-8453-4d7e-be52-bad1c62939ab tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:40.877696 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-5090f39b-81b2-4402-a157-3230b758e5d6 req-93627cde-064d-484b-b498-7becf9ef2473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8276749-cb0f-4aaa-a37d-10e9a99a49d3", "name": "network-vif-unplugged", "status": "completed", "tag": "8821de78-ad20-42ce-9987-e279a5e9e2bc"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:05:40.892923 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-5090f39b-81b2-4402-a157-3230b758e5d6 req-93627cde-064d-484b-b498-7becf9ef2473 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:40.893413 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-5090f39b-81b2-4402-a157-3230b758e5d6 req-93627cde-064d-484b-b498-7becf9ef2473 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:40.893837 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-5090f39b-81b2-4402-a157-3230b758e5d6 req-93627cde-064d-484b-b498-7becf9ef2473 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:40.908799 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-5090f39b-81b2-4402-a157-3230b758e5d6 req-93627cde-064d-484b-b498-7becf9ef2473 service nova] Creating event network-vif-unplugged:8821de78-ad20-42ce-9987-e279a5e9e2bc for instance b8276749-cb0f-4aaa-a37d-10e9a99a49d3 on n-h1-858272-3 Oct 05 03:05:40.914888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [req-5090f39b-81b2-4402-a157-3230b758e5d6 req-93627cde-064d-484b-b498-7becf9ef2473 service nova] Instance b8276749-cb0f-4aaa-a37d-10e9a99a49d3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 03:05:40.927615 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-5090f39b-81b2-4402-a157-3230b758e5d6 req-93627cde-064d-484b-b498-7becf9ef2473 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053700 Oct 05 03:05:40.928506 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3076/6173] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:05:41.452388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5db979f5-8453-4d7e-be52-bad1c62939ab tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:41.460414 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5db979f5-8453-4d7e-be52-bad1c62939ab tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1694 microversion: 2.1 time: 0.650772 Oct 05 03:05:41.461774 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3098/6174] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:40 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1694 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:42.487685 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f12211d5-0047-4c51-b241-b430f6dd8318 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:42.488573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f12211d5-0047-4c51-b241-b430f6dd8318 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:42.495237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f12211d5-0047-4c51-b241-b430f6dd8318 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:42.496969 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f12211d5-0047-4c51-b241-b430f6dd8318 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:42.497440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f12211d5-0047-4c51-b241-b430f6dd8318 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:42.498296 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f12211d5-0047-4c51-b241-b430f6dd8318 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:42.498751 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f12211d5-0047-4c51-b241-b430f6dd8318 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:42.499182 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f12211d5-0047-4c51-b241-b430f6dd8318 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:42.642463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f12211d5-0047-4c51-b241-b430f6dd8318 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:42.651033 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f12211d5-0047-4c51-b241-b430f6dd8318 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1692 microversion: 2.1 time: 0.168690 Oct 05 03:05:42.651610 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3077/6175] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:42 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:05:43.221845 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-361efb74-3c2d-485d-b38d-23df30848492 req-c71956c9-0967-489d-9ff4-1feab1402b0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8276749-cb0f-4aaa-a37d-10e9a99a49d3", "tag": "8821de78-ad20-42ce-9987-e279a5e9e2bc"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:05:43.232705 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-361efb74-3c2d-485d-b38d-23df30848492 req-c71956c9-0967-489d-9ff4-1feab1402b0a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:43.233218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-361efb74-3c2d-485d-b38d-23df30848492 req-c71956c9-0967-489d-9ff4-1feab1402b0a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:43.233645 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-361efb74-3c2d-485d-b38d-23df30848492 req-c71956c9-0967-489d-9ff4-1feab1402b0a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:43.245483 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-361efb74-3c2d-485d-b38d-23df30848492 req-c71956c9-0967-489d-9ff4-1feab1402b0a service nova] Creating event network-changed:8821de78-ad20-42ce-9987-e279a5e9e2bc for instance b8276749-cb0f-4aaa-a37d-10e9a99a49d3 on n-h1-858272-3 Oct 05 03:05:43.251105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [req-361efb74-3c2d-485d-b38d-23df30848492 req-c71956c9-0967-489d-9ff4-1feab1402b0a service nova] Instance b8276749-cb0f-4aaa-a37d-10e9a99a49d3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122319) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 03:05:43.262727 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-361efb74-3c2d-485d-b38d-23df30848492 req-c71956c9-0967-489d-9ff4-1feab1402b0a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044458 Oct 05 03:05:43.264004 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3099/6176] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:05:43.674838 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9a31e4af-538c-4089-a959-d651832baf37 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:43.675526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9a31e4af-538c-4089-a959-d651832baf37 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:43.683471 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a31e4af-538c-4089-a959-d651832baf37 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:43.684161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a31e4af-538c-4089-a959-d651832baf37 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:43.684673 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a31e4af-538c-4089-a959-d651832baf37 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:43.685478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a31e4af-538c-4089-a959-d651832baf37 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:43.686000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a31e4af-538c-4089-a959-d651832baf37 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:43.686485 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a31e4af-538c-4089-a959-d651832baf37 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:43.906048 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9a31e4af-538c-4089-a959-d651832baf37 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:43.914617 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9a31e4af-538c-4089-a959-d651832baf37 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1692 microversion: 2.1 time: 0.243208 Oct 05 03:05:43.915228 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3078/6177] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:43 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1692 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:44.939944 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a5df93b4-9e8f-402e-a865-e85ff1913bfb tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:44.940667 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a5df93b4-9e8f-402e-a865-e85ff1913bfb tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:44.947874 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5df93b4-9e8f-402e-a865-e85ff1913bfb tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:44.948365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5df93b4-9e8f-402e-a865-e85ff1913bfb tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:44.948801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5df93b4-9e8f-402e-a865-e85ff1913bfb tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:44.949751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5df93b4-9e8f-402e-a865-e85ff1913bfb tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:44.950210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5df93b4-9e8f-402e-a865-e85ff1913bfb tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:44.950841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a5df93b4-9e8f-402e-a865-e85ff1913bfb tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:45.187144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a5df93b4-9e8f-402e-a865-e85ff1913bfb tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:45.205358 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a5df93b4-9e8f-402e-a865-e85ff1913bfb tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1692 microversion: 2.1 time: 0.270403 Oct 05 03:05:45.206139 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3100/6178] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:44 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1692 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:46.230612 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-336c5411-f05e-469e-a658-ccc3437bce5c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:46.232966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-336c5411-f05e-469e-a658-ccc3437bce5c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:46.243383 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-336c5411-f05e-469e-a658-ccc3437bce5c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:46.244345 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-336c5411-f05e-469e-a658-ccc3437bce5c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:46.244986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-336c5411-f05e-469e-a658-ccc3437bce5c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:46.245719 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-336c5411-f05e-469e-a658-ccc3437bce5c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:46.246327 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-336c5411-f05e-469e-a658-ccc3437bce5c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:46.246935 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-336c5411-f05e-469e-a658-ccc3437bce5c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:46.426040 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-336c5411-f05e-469e-a658-ccc3437bce5c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:46.435586 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-336c5411-f05e-469e-a658-ccc3437bce5c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1689 microversion: 2.1 time: 0.210546 Oct 05 03:05:46.436174 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3079/6179] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:46 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1689 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:46.458878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-425e89be-3efa-49a3-96c4-d504fa5621e2 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:05:46.459691 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-425e89be-3efa-49a3-96c4-d504fa5621e2 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:46.467524 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-425e89be-3efa-49a3-96c4-d504fa5621e2 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:46.468059 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-425e89be-3efa-49a3-96c4-d504fa5621e2 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:46.468483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-425e89be-3efa-49a3-96c4-d504fa5621e2 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:46.469207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-425e89be-3efa-49a3-96c4-d504fa5621e2 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:46.469983 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-425e89be-3efa-49a3-96c4-d504fa5621e2 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:46.470776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-425e89be-3efa-49a3-96c4-d504fa5621e2 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:46.546834 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-425e89be-3efa-49a3-96c4-d504fa5621e2 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "POST /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3/action" status: 204 len: 0 microversion: 2.1 time: 0.091138 Oct 05 03:05:46.547679 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3101/6180] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:05:46 2022] POST /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3/action => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:05:46.556927 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dd19af6c-b3ae-4550-994e-a913bc05be06 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:46.557570 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dd19af6c-b3ae-4550-994e-a913bc05be06 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:46.563753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd19af6c-b3ae-4550-994e-a913bc05be06 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:46.564248 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd19af6c-b3ae-4550-994e-a913bc05be06 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:46.564686 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd19af6c-b3ae-4550-994e-a913bc05be06 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:46.565437 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd19af6c-b3ae-4550-994e-a913bc05be06 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:46.566222 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd19af6c-b3ae-4550-994e-a913bc05be06 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:46.566902 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd19af6c-b3ae-4550-994e-a913bc05be06 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:46.792041 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dd19af6c-b3ae-4550-994e-a913bc05be06 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:46.802439 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dd19af6c-b3ae-4550-994e-a913bc05be06 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1689 microversion: 2.1 time: 0.249731 Oct 05 03:05:46.803037 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3080/6181] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:46 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1689 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:47.597117 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-7ba1f884-f293-463b-92ef-c45ce6199396 req-e7041522-502f-4ede-ae76-4af3f17d579c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8276749-cb0f-4aaa-a37d-10e9a99a49d3", "name": "network-vif-plugged", "status": "completed", "tag": "8821de78-ad20-42ce-9987-e279a5e9e2bc"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:05:47.612732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7ba1f884-f293-463b-92ef-c45ce6199396 req-e7041522-502f-4ede-ae76-4af3f17d579c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:47.613409 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7ba1f884-f293-463b-92ef-c45ce6199396 req-e7041522-502f-4ede-ae76-4af3f17d579c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:47.614126 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7ba1f884-f293-463b-92ef-c45ce6199396 req-e7041522-502f-4ede-ae76-4af3f17d579c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:47.628600 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-7ba1f884-f293-463b-92ef-c45ce6199396 req-e7041522-502f-4ede-ae76-4af3f17d579c service nova] Creating event network-vif-plugged:8821de78-ad20-42ce-9987-e279a5e9e2bc for instance b8276749-cb0f-4aaa-a37d-10e9a99a49d3 on n-h1-858272-3 Oct 05 03:05:47.638627 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [req-7ba1f884-f293-463b-92ef-c45ce6199396 req-e7041522-502f-4ede-ae76-4af3f17d579c service nova] Instance b8276749-cb0f-4aaa-a37d-10e9a99a49d3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122319) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 03:05:47.650218 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-7ba1f884-f293-463b-92ef-c45ce6199396 req-e7041522-502f-4ede-ae76-4af3f17d579c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057726 Oct 05 03:05:47.650979 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3102/6182] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:05:47.826190 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9e5622ed-95a6-4801-9d45-b88ede04b69b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:47.826715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9e5622ed-95a6-4801-9d45-b88ede04b69b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:47.833938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e5622ed-95a6-4801-9d45-b88ede04b69b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:47.834426 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e5622ed-95a6-4801-9d45-b88ede04b69b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:47.834861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e5622ed-95a6-4801-9d45-b88ede04b69b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:47.835537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e5622ed-95a6-4801-9d45-b88ede04b69b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:47.835989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e5622ed-95a6-4801-9d45-b88ede04b69b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:47.836409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e5622ed-95a6-4801-9d45-b88ede04b69b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:47.991449 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9e5622ed-95a6-4801-9d45-b88ede04b69b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:48.002375 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9e5622ed-95a6-4801-9d45-b88ede04b69b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1689 microversion: 2.1 time: 0.180085 Oct 05 03:05:48.002969 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3081/6183] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:47 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1689 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:05:49.028725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-95be53a7-e4f1-47e8-8e5a-11f99d9214ff tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:05:49.029516 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-95be53a7-e4f1-47e8-8e5a-11f99d9214ff tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:05:49.037215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-95be53a7-e4f1-47e8-8e5a-11f99d9214ff tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:49.037689 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-95be53a7-e4f1-47e8-8e5a-11f99d9214ff tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:49.038126 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-95be53a7-e4f1-47e8-8e5a-11f99d9214ff tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:49.038825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-95be53a7-e4f1-47e8-8e5a-11f99d9214ff tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:05:49.039273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-95be53a7-e4f1-47e8-8e5a-11f99d9214ff tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:05:49.039692 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-95be53a7-e4f1-47e8-8e5a-11f99d9214ff tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:05:49.184141 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-95be53a7-e4f1-47e8-8e5a-11f99d9214ff tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:05:49.193634 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-95be53a7-e4f1-47e8-8e5a-11f99d9214ff tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1681 microversion: 2.1 time: 0.170031 Oct 05 03:05:49.208927 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3103/6184] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:05:49 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:06:10.983218 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7c1b1e82-859b-4450-8c09-9edb6a84df4e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:06:10.985455 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7c1b1e82-859b-4450-8c09-9edb6a84df4e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 75b557e6-a0a4-4791-b043-96983fed78e6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:10.987690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=13 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:06:10.988646 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=49 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:06:10.995314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c1b1e82-859b-4450-8c09-9edb6a84df4e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:10.995816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c1b1e82-859b-4450-8c09-9edb6a84df4e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:10.996259 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c1b1e82-859b-4450-8c09-9edb6a84df4e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:10.997012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c1b1e82-859b-4450-8c09-9edb6a84df4e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:10.997475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c1b1e82-859b-4450-8c09-9edb6a84df4e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:10.997904 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c1b1e82-859b-4450-8c09-9edb6a84df4e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:11.074474 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7c1b1e82-859b-4450-8c09-9edb6a84df4e tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "POST /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6/action" status: 200 len: 32648 microversion: 2.1 time: 0.094924 Oct 05 03:06:11.075613 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3082/6185] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:06:10 2022] POST /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6/action => generated 32648 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 03:06:12.114323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-812a22e2-ebdc-415a-9e37-86b1e97fcf42 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:12.115380 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-812a22e2-ebdc-415a-9e37-86b1e97fcf42 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 75b557e6-a0a4-4791-b043-96983fed78e6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:12.121799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-7c56df65-1893-471a-b257-8ed192e402e9 req-9f9c772f-2868-47eb-af98-0f1d81a6d58d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75b557e6-a0a4-4791-b043-96983fed78e6", "tag": "1d970f8d-2848-4c97-8466-eb8b9fb29921"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:06:12.130775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=17 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:06:12.131655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:06:12.144357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-812a22e2-ebdc-415a-9e37-86b1e97fcf42 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:12.144855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-812a22e2-ebdc-415a-9e37-86b1e97fcf42 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:12.146846 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-7c56df65-1893-471a-b257-8ed192e402e9 req-9f9c772f-2868-47eb-af98-0f1d81a6d58d service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:12.147484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-812a22e2-ebdc-415a-9e37-86b1e97fcf42 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:12.148194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-812a22e2-ebdc-415a-9e37-86b1e97fcf42 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:12.148656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-812a22e2-ebdc-415a-9e37-86b1e97fcf42 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:12.149115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-812a22e2-ebdc-415a-9e37-86b1e97fcf42 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:12.150609 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-7c56df65-1893-471a-b257-8ed192e402e9 req-9f9c772f-2868-47eb-af98-0f1d81a6d58d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:12.151045 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-7c56df65-1893-471a-b257-8ed192e402e9 req-9f9c772f-2868-47eb-af98-0f1d81a6d58d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:12.169630 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-7c56df65-1893-471a-b257-8ed192e402e9 req-9f9c772f-2868-47eb-af98-0f1d81a6d58d service nova] Creating event network-changed:1d970f8d-2848-4c97-8466-eb8b9fb29921 for instance 75b557e6-a0a4-4791-b043-96983fed78e6 on n-h2-858272-3 Oct 05 03:06:12.176626 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-7c56df65-1893-471a-b257-8ed192e402e9 req-9f9c772f-2868-47eb-af98-0f1d81a6d58d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059393 Oct 05 03:06:12.178419 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3083/6186] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:06:12.184543 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-812a22e2-ebdc-415a-9e37-86b1e97fcf42 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 75b557e6-a0a4-4791-b043-96983fed78e6] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:06:12.288274 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-812a22e2-ebdc-415a-9e37-86b1e97fcf42 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "DELETE /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6" status: 204 len: 0 microversion: 2.1 time: 0.177683 Oct 05 03:06:12.289471 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3104/6187] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:06:12 2022] DELETE /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:06:12.304878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4f2c4336-c3a9-446b-be42-d6e30fa429ee tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:12.306822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4f2c4336-c3a9-446b-be42-d6e30fa429ee tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 75b557e6-a0a4-4791-b043-96983fed78e6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:12.313886 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f2c4336-c3a9-446b-be42-d6e30fa429ee tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:12.314765 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f2c4336-c3a9-446b-be42-d6e30fa429ee tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:12.315356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f2c4336-c3a9-446b-be42-d6e30fa429ee tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:12.316274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f2c4336-c3a9-446b-be42-d6e30fa429ee tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:12.317068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f2c4336-c3a9-446b-be42-d6e30fa429ee tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:12.317660 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f2c4336-c3a9-446b-be42-d6e30fa429ee tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:12.755470 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4f2c4336-c3a9-446b-be42-d6e30fa429ee tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:06:12.764557 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4f2c4336-c3a9-446b-be42-d6e30fa429ee tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6" status: 200 len: 1669 microversion: 2.1 time: 0.469850 Oct 05 03:06:12.765648 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3084/6188] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:12 2022] GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6 => generated 1669 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:06:13.789630 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bce34a82-6f94-4e13-a001-4fe7652d1f8a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:13.791193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bce34a82-6f94-4e13-a001-4fe7652d1f8a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 75b557e6-a0a4-4791-b043-96983fed78e6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:13.798144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bce34a82-6f94-4e13-a001-4fe7652d1f8a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:13.798639 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bce34a82-6f94-4e13-a001-4fe7652d1f8a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:13.799081 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bce34a82-6f94-4e13-a001-4fe7652d1f8a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:13.799784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bce34a82-6f94-4e13-a001-4fe7652d1f8a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:13.800241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bce34a82-6f94-4e13-a001-4fe7652d1f8a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:13.800673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bce34a82-6f94-4e13-a001-4fe7652d1f8a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:13.952912 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bce34a82-6f94-4e13-a001-4fe7652d1f8a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:06:13.960880 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bce34a82-6f94-4e13-a001-4fe7652d1f8a tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6" status: 200 len: 1669 microversion: 2.1 time: 0.175693 Oct 05 03:06:13.961490 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3105/6189] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:13 2022] GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6 => generated 1669 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:06:14.514337 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-a3d9dce4-7072-40d5-8451-edb70c10e871 req-85300492-71df-4f3e-af46-6a921803f84d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75b557e6-a0a4-4791-b043-96983fed78e6", "name": "network-vif-deleted", "tag": "1d970f8d-2848-4c97-8466-eb8b9fb29921"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:06:14.528812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a3d9dce4-7072-40d5-8451-edb70c10e871 req-85300492-71df-4f3e-af46-6a921803f84d service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:14.529402 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a3d9dce4-7072-40d5-8451-edb70c10e871 req-85300492-71df-4f3e-af46-6a921803f84d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:14.529835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a3d9dce4-7072-40d5-8451-edb70c10e871 req-85300492-71df-4f3e-af46-6a921803f84d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:14.544079 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-a3d9dce4-7072-40d5-8451-edb70c10e871 req-85300492-71df-4f3e-af46-6a921803f84d service nova] Creating event network-vif-deleted:1d970f8d-2848-4c97-8466-eb8b9fb29921 for instance 75b557e6-a0a4-4791-b043-96983fed78e6 on n-h2-858272-3 Oct 05 03:06:14.549487 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-a3d9dce4-7072-40d5-8451-edb70c10e871 req-85300492-71df-4f3e-af46-6a921803f84d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040100 Oct 05 03:06:14.562083 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3085/6190] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:06:14.984668 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-db0d68ca-cbd9-47c5-880c-8a56b37f58d7 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:14.985999 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-db0d68ca-cbd9-47c5-880c-8a56b37f58d7 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 75b557e6-a0a4-4791-b043-96983fed78e6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:14.995711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db0d68ca-cbd9-47c5-880c-8a56b37f58d7 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:14.996283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db0d68ca-cbd9-47c5-880c-8a56b37f58d7 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:14.996758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db0d68ca-cbd9-47c5-880c-8a56b37f58d7 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:14.997723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db0d68ca-cbd9-47c5-880c-8a56b37f58d7 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:14.998278 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db0d68ca-cbd9-47c5-880c-8a56b37f58d7 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:14.998768 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db0d68ca-cbd9-47c5-880c-8a56b37f58d7 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:15.055185 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db0d68ca-cbd9-47c5-880c-8a56b37f58d7 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:15.056450 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db0d68ca-cbd9-47c5-880c-8a56b37f58d7 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:15.056890 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db0d68ca-cbd9-47c5-880c-8a56b37f58d7 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:15.057376 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-db0d68ca-cbd9-47c5-880c-8a56b37f58d7 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lazy-loading 'fault' on Instance uuid 75b557e6-a0a4-4791-b043-96983fed78e6 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:06:15.123451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-db0d68ca-cbd9-47c5-880c-8a56b37f58d7 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2b26730184ce58b866e37ebe43794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5152e5e306d2474bac12338a8e722a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:06:15.131612 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-db0d68ca-cbd9-47c5-880c-8a56b37f58d7 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6" status: 200 len: 1338 microversion: 2.1 time: 0.151533 Oct 05 03:06:15.132268 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3106/6191] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:14 2022] GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6 => generated 1338 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:06:16.157329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ff605dbe-f94b-4920-82fe-f3fab6e93d49 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:16.158761 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ff605dbe-f94b-4920-82fe-f3fab6e93d49 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] [instance: 75b557e6-a0a4-4791-b043-96983fed78e6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:16.166992 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff605dbe-f94b-4920-82fe-f3fab6e93d49 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:16.167584 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff605dbe-f94b-4920-82fe-f3fab6e93d49 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:16.167909 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff605dbe-f94b-4920-82fe-f3fab6e93d49 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:16.168615 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff605dbe-f94b-4920-82fe-f3fab6e93d49 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:16.169227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff605dbe-f94b-4920-82fe-f3fab6e93d49 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:16.169525 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff605dbe-f94b-4920-82fe-f3fab6e93d49 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:16.185038 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-ff605dbe-f94b-4920-82fe-f3fab6e93d49 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] HTTP exception thrown: Instance 75b557e6-a0a4-4791-b043-96983fed78e6 could not be found. Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ff605dbe-f94b-4920-82fe-f3fab6e93d49 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Request method failure captured: Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6 HTTP/1.1 Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPNwznjwkzH4385Wmuu9gocROGuZ13TcZ43NcOOcOW7e_9P-997tIaVKKhvNDp8ALbJmk_WuhGmG9xxcH80ub6_kQqWwVWVE7-M3rSmqWehT07GjEPso6ybD-TIikPlBsrl6Tw4psm4dWeeSOAfEZO3e9X3oOax0DgXMkw6OnmHwO5A Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 5152e5e306d2474bac12338a8e722a00 Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-TestNetworkBasicOps-207914990 Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5152e5e306d2474bac12338a8e722a00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5152e5e306d2474bac12338a8e722a00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5152e5e306d2474bac12338a8e722a00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5152e5e306d2474bac12338a8e722a00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-TestNetworkBasicOps-207914990 Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 5152e5e306d2474bac12338a8e722a00 Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-TestNetworkBasicOps-207914990 Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-TestNetworkBasicOps-207914990-project Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 67c2b26730184ce58b866e37ebe43794 Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-TestNetworkBasicOps-207914990-project Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 75b557e6-a0a4-4791-b043-96983fed78e6 could not be found. Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '75b557e6-a0a4-4791-b043-96983fed78e6'} Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75b557e6-a0a4-4791-b043-96983fed78e6 could not be found. Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75b557e6-a0a4-4791-b043-96983fed78e6 could not be found. Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:06:16.186585 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:06:16.191187 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:06:16.191187 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:06:16.191187 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:06:16.191187 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:06:16.191187 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:06:16.191187 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75b557e6-a0a4-4791-b043-96983fed78e6 could not be found. Oct 05 03:06:16.191187 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:06:16.191187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ff605dbe-f94b-4920-82fe-f3fab6e93d49 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Returning 404 to user: Instance 75b557e6-a0a4-4791-b043-96983fed78e6 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:06:16.191187 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ff605dbe-f94b-4920-82fe-f3fab6e93d49 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6" status: 404 len: 111 microversion: 2.1 time: 0.036264 Oct 05 03:06:16.191187 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3086/6192] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:16 2022] GET /compute/v2.1/servers/75b557e6-a0a4-4791-b043-96983fed78e6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:06:16.388080 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3cc6f8cd-1db6-48ed-8807-8b95a9b638d1 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] Calling method '.version_select at 0x7fcce80c2c10>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:16.423567 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3cc6f8cd-1db6-48ed-8807-8b95a9b638d1 tempest-TestNetworkBasicOps-207914990 tempest-TestNetworkBasicOps-207914990-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-106937329" status: 202 len: 0 microversion: 2.1 time: 0.040040 Oct 05 03:06:16.424097 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3107/6193] 10.222.0.16 () {58 vars in 1254 bytes} [Wed Oct 5 03:06:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-106937329 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:06:18.137269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9583e59a-0153-4801-8015-44b8663e5e49 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:18.137828 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9583e59a-0153-4801-8015-44b8663e5e49 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] [instance: 6205bc97-60e8-4ef7-892d-c7e3957e8fdf] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:18.145362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9583e59a-0153-4801-8015-44b8663e5e49 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:18.145944 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9583e59a-0153-4801-8015-44b8663e5e49 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:18.146454 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9583e59a-0153-4801-8015-44b8663e5e49 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:18.147235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9583e59a-0153-4801-8015-44b8663e5e49 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:18.147765 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9583e59a-0153-4801-8015-44b8663e5e49 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:18.148264 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9583e59a-0153-4801-8015-44b8663e5e49 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:18.233111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-9583e59a-0153-4801-8015-44b8663e5e49 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lazy-loading 'services' on Instance uuid 6205bc97-60e8-4ef7-892d-c7e3957e8fdf {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:06:18.317550 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9583e59a-0153-4801-8015-44b8663e5e49 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf/os-volume_attachments/5021c143-51ae-43ae-9951-f44fdb56a173" status: 202 len: 0 microversion: 2.1 time: 0.185036 Oct 05 03:06:18.329879 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3087/6194] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 03:06:18 2022] DELETE /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf/os-volume_attachments/5021c143-51ae-43ae-9951-f44fdb56a173 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:06:19.432638 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-81d113f2-3a90-48a5-89ec-38931cbedc97 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:06:19.435669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-81d113f2-3a90-48a5-89ec-38931cbedc97 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:19.443822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81d113f2-3a90-48a5-89ec-38931cbedc97 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:19.444421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81d113f2-3a90-48a5-89ec-38931cbedc97 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:19.445133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81d113f2-3a90-48a5-89ec-38931cbedc97 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:19.446888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81d113f2-3a90-48a5-89ec-38931cbedc97 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:19.447567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81d113f2-3a90-48a5-89ec-38931cbedc97 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:19.448209 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81d113f2-3a90-48a5-89ec-38931cbedc97 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:19.567294 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-81d113f2-3a90-48a5-89ec-38931cbedc97 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "POST /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3/action" status: 200 len: 24574 microversion: 2.1 time: 0.139494 Oct 05 03:06:19.567962 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3108/6195] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:06:19 2022] POST /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3/action => generated 24574 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 03:06:23.124709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e0ba897a-29b2-4e7b-90cd-6def89f863cb tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Action: 'create', calling method: .version_select at 0x7fccdefd30d0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1285308353", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLs1I4ENH/TUN5FQQX+w1Gy0z4u1g/hQNd22LO+myWgBqaSc/tMu9ieZgiOYNYkIXfHg16usep/vMn+4yvcUOFVk+N0a2PWS3e4yfk3WlLATEpGfIkP/ualer5KVJOX9A=="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:06:23.142443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-e0ba897a-29b2-4e7b-90cd-6def89f863cb tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Getting quotas for project 68101269cd8447ec89411b4eab950d51. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:06:23.148856 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-e0ba897a-29b2-4e7b-90cd-6def89f863cb tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Getting quotas for user ac015152532a44609827594179c68aa8 and project 68101269cd8447ec89411b4eab950d51. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:06:23.177902 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e0ba897a-29b2-4e7b-90cd-6def89f863cb tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.238541 Oct 05 03:06:23.178532 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3088/6196] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 03:06:22 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:06:23.742768 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b8934504-6372-496c-aa8e-bd9cc64ff984 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:23.744036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b8934504-6372-496c-aa8e-bd9cc64ff984 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] [instance: 6205bc97-60e8-4ef7-892d-c7e3957e8fdf] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:23.751824 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8934504-6372-496c-aa8e-bd9cc64ff984 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:23.752307 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8934504-6372-496c-aa8e-bd9cc64ff984 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:23.752838 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8934504-6372-496c-aa8e-bd9cc64ff984 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:23.753632 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8934504-6372-496c-aa8e-bd9cc64ff984 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:23.754163 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8934504-6372-496c-aa8e-bd9cc64ff984 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:23.754599 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8934504-6372-496c-aa8e-bd9cc64ff984 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:23.780672 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b8934504-6372-496c-aa8e-bd9cc64ff984 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] [instance: 6205bc97-60e8-4ef7-892d-c7e3957e8fdf] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:06:23.875191 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b8934504-6372-496c-aa8e-bd9cc64ff984 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf" status: 204 len: 0 microversion: 2.1 time: 0.135983 Oct 05 03:06:23.876504 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3109/6197] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:06:23 2022] DELETE /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:06:23.886937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b0ed3856-9424-4eb6-8f41-ee82fcad0228 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:23.888062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b0ed3856-9424-4eb6-8f41-ee82fcad0228 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] [instance: 6205bc97-60e8-4ef7-892d-c7e3957e8fdf] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:23.895682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0ed3856-9424-4eb6-8f41-ee82fcad0228 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:23.896287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0ed3856-9424-4eb6-8f41-ee82fcad0228 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:23.896726 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0ed3856-9424-4eb6-8f41-ee82fcad0228 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:23.897463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0ed3856-9424-4eb6-8f41-ee82fcad0228 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:23.897920 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0ed3856-9424-4eb6-8f41-ee82fcad0228 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:23.898343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0ed3856-9424-4eb6-8f41-ee82fcad0228 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:24.147767 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b0ed3856-9424-4eb6-8f41-ee82fcad0228 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7fccf567094c43aec0de4b4399538e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1edf3cfeff48e7a295daa9dcb1877a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:06:24.159944 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b0ed3856-9424-4eb6-8f41-ee82fcad0228 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] 10.222.0.16 "GET /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf" status: 200 len: 1470 microversion: 2.1 time: 0.279109 Oct 05 03:06:24.160540 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3089/6198] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:23 2022] GET /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf => generated 1470 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:06:25.188882 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-20e919d9-f7ee-4dc9-a115-177d76f63b47 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:25.189917 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-20e919d9-f7ee-4dc9-a115-177d76f63b47 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] [instance: 6205bc97-60e8-4ef7-892d-c7e3957e8fdf] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:25.197795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20e919d9-f7ee-4dc9-a115-177d76f63b47 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:25.198634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20e919d9-f7ee-4dc9-a115-177d76f63b47 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:25.199170 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20e919d9-f7ee-4dc9-a115-177d76f63b47 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:25.200004 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20e919d9-f7ee-4dc9-a115-177d76f63b47 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:25.200663 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20e919d9-f7ee-4dc9-a115-177d76f63b47 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:25.201336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20e919d9-f7ee-4dc9-a115-177d76f63b47 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:25.403050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-20e919d9-f7ee-4dc9-a115-177d76f63b47 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7fccf567094c43aec0de4b4399538e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1edf3cfeff48e7a295daa9dcb1877a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:06:25.412278 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-20e919d9-f7ee-4dc9-a115-177d76f63b47 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] 10.222.0.16 "GET /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf" status: 200 len: 1470 microversion: 2.1 time: 0.227726 Oct 05 03:06:25.413022 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3110/6199] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:25 2022] GET /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf => generated 1470 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:06:26.437310 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b5d14e37-3be5-405f-a4a1-54b368b390f0 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:26.437917 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b5d14e37-3be5-405f-a4a1-54b368b390f0 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] [instance: 6205bc97-60e8-4ef7-892d-c7e3957e8fdf] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:26.449827 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b5d14e37-3be5-405f-a4a1-54b368b390f0 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:26.450334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b5d14e37-3be5-405f-a4a1-54b368b390f0 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:26.450776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b5d14e37-3be5-405f-a4a1-54b368b390f0 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:26.451482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b5d14e37-3be5-405f-a4a1-54b368b390f0 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:26.451941 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b5d14e37-3be5-405f-a4a1-54b368b390f0 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:26.452363 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b5d14e37-3be5-405f-a4a1-54b368b390f0 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:26.584212 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b5d14e37-3be5-405f-a4a1-54b368b390f0 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7fccf567094c43aec0de4b4399538e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1edf3cfeff48e7a295daa9dcb1877a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:06:26.607795 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b5d14e37-3be5-405f-a4a1-54b368b390f0 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] 10.222.0.16 "GET /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf" status: 200 len: 1428 microversion: 2.1 time: 0.174953 Oct 05 03:06:26.610497 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3090/6200] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:26 2022] GET /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf => generated 1428 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:06:26.700878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-f68e8165-3cec-48d1-acc9-e0dc17f0ad08 req-7c993bd8-4190-4462-9e37-c02e9f42691a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6205bc97-60e8-4ef7-892d-c7e3957e8fdf", "name": "network-vif-deleted", "tag": "af9e1939-9fe5-4656-b89f-526c27b400db"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:06:26.718508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f68e8165-3cec-48d1-acc9-e0dc17f0ad08 req-7c993bd8-4190-4462-9e37-c02e9f42691a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:26.719222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f68e8165-3cec-48d1-acc9-e0dc17f0ad08 req-7c993bd8-4190-4462-9e37-c02e9f42691a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:26.719827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f68e8165-3cec-48d1-acc9-e0dc17f0ad08 req-7c993bd8-4190-4462-9e37-c02e9f42691a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:26.732845 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-f68e8165-3cec-48d1-acc9-e0dc17f0ad08 req-7c993bd8-4190-4462-9e37-c02e9f42691a service nova] Creating event network-vif-deleted:af9e1939-9fe5-4656-b89f-526c27b400db for instance 6205bc97-60e8-4ef7-892d-c7e3957e8fdf on n-h1-858272-3 Oct 05 03:06:26.738195 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-f68e8165-3cec-48d1-acc9-e0dc17f0ad08 req-7c993bd8-4190-4462-9e37-c02e9f42691a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041885 Oct 05 03:06:26.742205 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3111/6201] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:06:27.636796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1429eaee-5d21-43bf-85c7-3cc2fb4ba5d7 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:27.638134 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1429eaee-5d21-43bf-85c7-3cc2fb4ba5d7 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] [instance: 6205bc97-60e8-4ef7-892d-c7e3957e8fdf] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:27.645251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1429eaee-5d21-43bf-85c7-3cc2fb4ba5d7 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:27.646070 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1429eaee-5d21-43bf-85c7-3cc2fb4ba5d7 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:27.646710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1429eaee-5d21-43bf-85c7-3cc2fb4ba5d7 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:27.647615 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1429eaee-5d21-43bf-85c7-3cc2fb4ba5d7 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:27.648267 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1429eaee-5d21-43bf-85c7-3cc2fb4ba5d7 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:27.648891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1429eaee-5d21-43bf-85c7-3cc2fb4ba5d7 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:27.686023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1429eaee-5d21-43bf-85c7-3cc2fb4ba5d7 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:27.686526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1429eaee-5d21-43bf-85c7-3cc2fb4ba5d7 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:27.687176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1429eaee-5d21-43bf-85c7-3cc2fb4ba5d7 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:27.687641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-1429eaee-5d21-43bf-85c7-3cc2fb4ba5d7 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lazy-loading 'fault' on Instance uuid 6205bc97-60e8-4ef7-892d-c7e3957e8fdf {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:06:27.750074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1429eaee-5d21-43bf-85c7-3cc2fb4ba5d7 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7fccf567094c43aec0de4b4399538e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1edf3cfeff48e7a295daa9dcb1877a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:06:27.758147 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1429eaee-5d21-43bf-85c7-3cc2fb4ba5d7 tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] 10.222.0.16 "GET /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf" status: 200 len: 1304 microversion: 2.1 time: 0.126265 Oct 05 03:06:27.759467 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3091/6202] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:27 2022] GET /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf => generated 1304 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:06:28.786860 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9133fbcc-7734-4131-b463-6fd196b8ca2e tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:28.788415 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9133fbcc-7734-4131-b463-6fd196b8ca2e tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] [instance: 6205bc97-60e8-4ef7-892d-c7e3957e8fdf] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:28.797315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9133fbcc-7734-4131-b463-6fd196b8ca2e tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:28.798084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9133fbcc-7734-4131-b463-6fd196b8ca2e tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:28.798680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9133fbcc-7734-4131-b463-6fd196b8ca2e tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:28.799733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9133fbcc-7734-4131-b463-6fd196b8ca2e tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:28.800355 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9133fbcc-7734-4131-b463-6fd196b8ca2e tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:28.801088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9133fbcc-7734-4131-b463-6fd196b8ca2e tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:28.820457 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-9133fbcc-7734-4131-b463-6fd196b8ca2e tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] HTTP exception thrown: Instance 6205bc97-60e8-4ef7-892d-c7e3957e8fdf could not be found. Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9133fbcc-7734-4131-b463-6fd196b8ca2e tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Request method failure captured: Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf HTTP/1.1 Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPRVho79DVaB001QcAQamehv4DEQ7zDOKhq83-iHUVZVEHRw9xT1RIE3AllxRecIpT6eZNYk_tr2JZq0aV6K4w1vgmp4umehJNQyfP2AFb1wMeVdqDE89EywVK2uHaDPde01FSqCWhKM2NvcAcO0Zg57beWhAssUhU_53wtGbzFhHG0 Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: ab1edf3cfeff48e7a295daa9dcb1877a Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-VolumesBackupsTest-872947740 Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab1edf3cfeff48e7a295daa9dcb1877a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab1edf3cfeff48e7a295daa9dcb1877a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ab1edf3cfeff48e7a295daa9dcb1877a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ab1edf3cfeff48e7a295daa9dcb1877a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-VolumesBackupsTest-872947740 Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: ab1edf3cfeff48e7a295daa9dcb1877a Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-VolumesBackupsTest-872947740 Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-VolumesBackupsTest-872947740-project Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: ea7fccf567094c43aec0de4b4399538e Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-VolumesBackupsTest-872947740-project Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 6205bc97-60e8-4ef7-892d-c7e3957e8fdf could not be found. Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '6205bc97-60e8-4ef7-892d-c7e3957e8fdf'} Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6205bc97-60e8-4ef7-892d-c7e3957e8fdf could not be found. Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6205bc97-60e8-4ef7-892d-c7e3957e8fdf could not be found. Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:06:28.823859 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:06:28.828782 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:06:28.828782 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:06:28.828782 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:06:28.828782 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:06:28.828782 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:06:28.828782 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6205bc97-60e8-4ef7-892d-c7e3957e8fdf could not be found. Oct 05 03:06:28.828782 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:06:28.831322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9133fbcc-7734-4131-b463-6fd196b8ca2e tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] Returning 404 to user: Instance 6205bc97-60e8-4ef7-892d-c7e3957e8fdf could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:06:28.833430 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9133fbcc-7734-4131-b463-6fd196b8ca2e tempest-VolumesBackupsTest-872947740 tempest-VolumesBackupsTest-872947740-project] 10.222.0.16 "GET /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf" status: 404 len: 111 microversion: 2.1 time: 0.052741 Oct 05 03:06:28.839540 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3112/6203] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:28 2022] GET /compute/v2.1/servers/6205bc97-60e8-4ef7-892d-c7e3957e8fdf => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:06:29.440269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8a2c7cc5-b151-4a1f-84c4-a1e7763000ba tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-341123616-access_point-1940546177", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "fad98804-bdac-4730-a803-f8550f8aa995"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1285308353", "security_groups": [{"name": "tempest-secgroup_access--1360349566"}, {"name": "tempest-secgroup_general--1747375494"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:06:29.635460 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-8a2c7cc5-b151-4a1f-84c4-a1e7763000ba tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] validate_networks() for [('fad98804-bdac-4730-a803-f8550f8aa995', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:06:30.057579 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-8a2c7cc5-b151-4a1f-84c4-a1e7763000ba tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:06:30.058127 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-8a2c7cc5-b151-4a1f-84c4-a1e7763000ba tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:06:30.058681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-8a2c7cc5-b151-4a1f-84c4-a1e7763000ba tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:06:30.059162 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-8a2c7cc5-b151-4a1f-84c4-a1e7763000ba tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:06:30.059644 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-8a2c7cc5-b151-4a1f-84c4-a1e7763000ba tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:06:30.074813 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a2c7cc5-b151-4a1f-84c4-a1e7763000ba tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:30.077679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a2c7cc5-b151-4a1f-84c4-a1e7763000ba tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:30.078146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a2c7cc5-b151-4a1f-84c4-a1e7763000ba tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:30.079228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a2c7cc5-b151-4a1f-84c4-a1e7763000ba tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:30.079710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a2c7cc5-b151-4a1f-84c4-a1e7763000ba tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:30.080203 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a2c7cc5-b151-4a1f-84c4-a1e7763000ba tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:30.103593 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-8a2c7cc5-b151-4a1f-84c4-a1e7763000ba tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Getting quotas for project 68101269cd8447ec89411b4eab950d51. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:06:30.111076 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-8a2c7cc5-b151-4a1f-84c4-a1e7763000ba tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Getting quotas for user ac015152532a44609827594179c68aa8 and project 68101269cd8447ec89411b4eab950d51. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:06:30.125215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8a2c7cc5-b151-4a1f-84c4-a1e7763000ba tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:06:30.127217 n-d-858272-3 devstack@n-api.service[122320]: WARNING nova.utils [None req-8a2c7cc5-b151-4a1f-84c4-a1e7763000ba tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-341123616-access_point-1940546177 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-341123616-acc Oct 05 03:06:30.127968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8a2c7cc5-b151-4a1f-84c4-a1e7763000ba tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: f4cd4aa7-8674-456c-a4a3-7750478f5cb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:06:30.181102 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8a2c7cc5-b151-4a1f-84c4-a1e7763000ba tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 0.744871 Oct 05 03:06:30.181863 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3092/6204] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:06:29 2022] POST /compute/v2.1/servers => generated 458 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:06:30.193230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-25726c0b-d58c-4f84-b17d-9acde8305344 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:30.193764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-25726c0b-d58c-4f84-b17d-9acde8305344 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: f4cd4aa7-8674-456c-a4a3-7750478f5cb9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:30.259748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-25726c0b-d58c-4f84-b17d-9acde8305344 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac015152532a44609827594179c68aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68101269cd8447ec89411b4eab950d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:06:30.270780 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-25726c0b-d58c-4f84-b17d-9acde8305344 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9" status: 200 len: 1294 microversion: 2.1 time: 0.081391 Oct 05 03:06:30.271360 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3113/6205] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:30 2022] GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9 => generated 1294 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:06:31.296164 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-49adfe86-0302-4c86-8451-9b178a64cab5 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:31.296994 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-49adfe86-0302-4c86-8451-9b178a64cab5 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: f4cd4aa7-8674-456c-a4a3-7750478f5cb9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:31.304889 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49adfe86-0302-4c86-8451-9b178a64cab5 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:31.305462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49adfe86-0302-4c86-8451-9b178a64cab5 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:31.305897 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49adfe86-0302-4c86-8451-9b178a64cab5 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:31.306601 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49adfe86-0302-4c86-8451-9b178a64cab5 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:31.307086 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49adfe86-0302-4c86-8451-9b178a64cab5 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:31.307719 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49adfe86-0302-4c86-8451-9b178a64cab5 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:31.375679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-49adfe86-0302-4c86-8451-9b178a64cab5 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac015152532a44609827594179c68aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68101269cd8447ec89411b4eab950d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:06:31.384460 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-49adfe86-0302-4c86-8451-9b178a64cab5 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9" status: 200 len: 1346 microversion: 2.1 time: 0.092190 Oct 05 03:06:31.385179 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3093/6206] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:31 2022] GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9 => generated 1346 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:06:32.409973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-463e5868-afed-4bbf-95cb-4e1511319ef7 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:32.410591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-463e5868-afed-4bbf-95cb-4e1511319ef7 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: f4cd4aa7-8674-456c-a4a3-7750478f5cb9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:32.420074 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-463e5868-afed-4bbf-95cb-4e1511319ef7 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:32.420803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-463e5868-afed-4bbf-95cb-4e1511319ef7 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:32.421430 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-463e5868-afed-4bbf-95cb-4e1511319ef7 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:32.422356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-463e5868-afed-4bbf-95cb-4e1511319ef7 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:32.426412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-463e5868-afed-4bbf-95cb-4e1511319ef7 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:32.427411 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-463e5868-afed-4bbf-95cb-4e1511319ef7 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:32.721996 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-463e5868-afed-4bbf-95cb-4e1511319ef7 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac015152532a44609827594179c68aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68101269cd8447ec89411b4eab950d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:06:32.732728 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-463e5868-afed-4bbf-95cb-4e1511319ef7 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9" status: 200 len: 1472 microversion: 2.1 time: 0.327697 Oct 05 03:06:32.737281 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3114/6207] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:32 2022] GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9 => generated 1472 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:06:33.435212 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-87982511-660c-4dee-af40-26cf0d05ce78 req-64e2f2bb-d118-48dc-a9dc-975d1f85d029 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4cd4aa7-8674-456c-a4a3-7750478f5cb9", "tag": "beb8429b-f510-4361-8dac-96330c34c9c7"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:06:33.456590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-87982511-660c-4dee-af40-26cf0d05ce78 req-64e2f2bb-d118-48dc-a9dc-975d1f85d029 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:33.458658 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-87982511-660c-4dee-af40-26cf0d05ce78 req-64e2f2bb-d118-48dc-a9dc-975d1f85d029 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:33.460339 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-87982511-660c-4dee-af40-26cf0d05ce78 req-64e2f2bb-d118-48dc-a9dc-975d1f85d029 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:33.479855 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-87982511-660c-4dee-af40-26cf0d05ce78 req-64e2f2bb-d118-48dc-a9dc-975d1f85d029 service nova] Creating event network-changed:beb8429b-f510-4361-8dac-96330c34c9c7 for instance f4cd4aa7-8674-456c-a4a3-7750478f5cb9 on n-h1-858272-3 Oct 05 03:06:33.486120 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-87982511-660c-4dee-af40-26cf0d05ce78 req-64e2f2bb-d118-48dc-a9dc-975d1f85d029 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056014 Oct 05 03:06:33.488992 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3094/6208] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:06:33.755659 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-80b265bf-78b2-4d8e-9e46-f85b1cff4bfd tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:33.756267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-80b265bf-78b2-4d8e-9e46-f85b1cff4bfd tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: f4cd4aa7-8674-456c-a4a3-7750478f5cb9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:33.764018 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-80b265bf-78b2-4d8e-9e46-f85b1cff4bfd tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:33.764774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-80b265bf-78b2-4d8e-9e46-f85b1cff4bfd tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:33.765286 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-80b265bf-78b2-4d8e-9e46-f85b1cff4bfd tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:33.766265 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-80b265bf-78b2-4d8e-9e46-f85b1cff4bfd tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:33.766721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-80b265bf-78b2-4d8e-9e46-f85b1cff4bfd tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:33.767146 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-80b265bf-78b2-4d8e-9e46-f85b1cff4bfd tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:34.010335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-80b265bf-78b2-4d8e-9e46-f85b1cff4bfd tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac015152532a44609827594179c68aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68101269cd8447ec89411b4eab950d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:06:34.025219 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-80b265bf-78b2-4d8e-9e46-f85b1cff4bfd tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9" status: 200 len: 1472 microversion: 2.1 time: 0.272440 Oct 05 03:06:34.025500 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3115/6209] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:33 2022] GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9 => generated 1472 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:06:35.050732 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9d84ad3b-e6be-44ee-b7be-91ea47c7d065 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:35.051554 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9d84ad3b-e6be-44ee-b7be-91ea47c7d065 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: f4cd4aa7-8674-456c-a4a3-7750478f5cb9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:35.058853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d84ad3b-e6be-44ee-b7be-91ea47c7d065 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:35.059343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d84ad3b-e6be-44ee-b7be-91ea47c7d065 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:35.059777 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d84ad3b-e6be-44ee-b7be-91ea47c7d065 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:35.060473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d84ad3b-e6be-44ee-b7be-91ea47c7d065 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:35.060944 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d84ad3b-e6be-44ee-b7be-91ea47c7d065 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:35.061699 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9d84ad3b-e6be-44ee-b7be-91ea47c7d065 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:35.210698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9d84ad3b-e6be-44ee-b7be-91ea47c7d065 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac015152532a44609827594179c68aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68101269cd8447ec89411b4eab950d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:06:35.219787 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9d84ad3b-e6be-44ee-b7be-91ea47c7d065 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9" status: 200 len: 1472 microversion: 2.1 time: 0.174144 Oct 05 03:06:35.220579 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3095/6210] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:35 2022] GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9 => generated 1472 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:06:36.243964 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4db6c60c-6439-4509-83d0-2ddf7ec0efab tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:36.244673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4db6c60c-6439-4509-83d0-2ddf7ec0efab tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: f4cd4aa7-8674-456c-a4a3-7750478f5cb9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:36.251937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4db6c60c-6439-4509-83d0-2ddf7ec0efab tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:36.252421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4db6c60c-6439-4509-83d0-2ddf7ec0efab tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:36.252855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4db6c60c-6439-4509-83d0-2ddf7ec0efab tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:36.253574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4db6c60c-6439-4509-83d0-2ddf7ec0efab tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:36.254024 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4db6c60c-6439-4509-83d0-2ddf7ec0efab tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:36.254450 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4db6c60c-6439-4509-83d0-2ddf7ec0efab tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:36.469848 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4db6c60c-6439-4509-83d0-2ddf7ec0efab tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac015152532a44609827594179c68aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68101269cd8447ec89411b4eab950d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:06:36.478330 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4db6c60c-6439-4509-83d0-2ddf7ec0efab tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9" status: 200 len: 1472 microversion: 2.1 time: 0.239114 Oct 05 03:06:36.494512 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3116/6211] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:36 2022] GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9 => generated 1472 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:06:37.503852 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8670fb29-9be3-457c-baf4-03d4e439dba8 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:37.504385 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8670fb29-9be3-457c-baf4-03d4e439dba8 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: f4cd4aa7-8674-456c-a4a3-7750478f5cb9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:37.512435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8670fb29-9be3-457c-baf4-03d4e439dba8 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:37.512950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8670fb29-9be3-457c-baf4-03d4e439dba8 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:37.513395 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8670fb29-9be3-457c-baf4-03d4e439dba8 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:37.514098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8670fb29-9be3-457c-baf4-03d4e439dba8 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:37.514554 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8670fb29-9be3-457c-baf4-03d4e439dba8 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:37.514980 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8670fb29-9be3-457c-baf4-03d4e439dba8 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:37.668124 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8670fb29-9be3-457c-baf4-03d4e439dba8 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac015152532a44609827594179c68aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68101269cd8447ec89411b4eab950d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:06:37.676831 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8670fb29-9be3-457c-baf4-03d4e439dba8 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9" status: 200 len: 1472 microversion: 2.1 time: 0.177057 Oct 05 03:06:37.677694 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3096/6212] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:37 2022] GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9 => generated 1472 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:06:38.700375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1d7c84c5-94bf-4b49-9778-8bf7cc90108b tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:38.701318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1d7c84c5-94bf-4b49-9778-8bf7cc90108b tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: f4cd4aa7-8674-456c-a4a3-7750478f5cb9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:38.708305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d7c84c5-94bf-4b49-9778-8bf7cc90108b tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:38.709137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d7c84c5-94bf-4b49-9778-8bf7cc90108b tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:38.709802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d7c84c5-94bf-4b49-9778-8bf7cc90108b tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:38.710528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d7c84c5-94bf-4b49-9778-8bf7cc90108b tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:38.710985 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d7c84c5-94bf-4b49-9778-8bf7cc90108b tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:38.711597 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d7c84c5-94bf-4b49-9778-8bf7cc90108b tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:38.860466 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1d7c84c5-94bf-4b49-9778-8bf7cc90108b tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac015152532a44609827594179c68aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68101269cd8447ec89411b4eab950d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:06:38.868404 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1d7c84c5-94bf-4b49-9778-8bf7cc90108b tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9" status: 200 len: 1472 microversion: 2.1 time: 0.172673 Oct 05 03:06:38.869004 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3117/6213] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:38 2022] GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9 => generated 1472 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:06:39.871127 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-753bba83-16bc-4b7f-a78e-d4bdbd8f1aeb req-22cbcbcc-d126-47d6-8e53-e6bf1d2786ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4cd4aa7-8674-456c-a4a3-7750478f5cb9", "name": "network-vif-plugged", "status": "completed", "tag": "beb8429b-f510-4361-8dac-96330c34c9c7"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:06:39.882610 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-753bba83-16bc-4b7f-a78e-d4bdbd8f1aeb req-22cbcbcc-d126-47d6-8e53-e6bf1d2786ae service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:39.883243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-753bba83-16bc-4b7f-a78e-d4bdbd8f1aeb req-22cbcbcc-d126-47d6-8e53-e6bf1d2786ae service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:39.883681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-753bba83-16bc-4b7f-a78e-d4bdbd8f1aeb req-22cbcbcc-d126-47d6-8e53-e6bf1d2786ae service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:39.892473 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b545228d-9ca6-442b-8cd9-43143cfbf616 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:39.893121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b545228d-9ca6-442b-8cd9-43143cfbf616 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: f4cd4aa7-8674-456c-a4a3-7750478f5cb9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:39.899279 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-753bba83-16bc-4b7f-a78e-d4bdbd8f1aeb req-22cbcbcc-d126-47d6-8e53-e6bf1d2786ae service nova] Creating event network-vif-plugged:beb8429b-f510-4361-8dac-96330c34c9c7 for instance f4cd4aa7-8674-456c-a4a3-7750478f5cb9 on n-h1-858272-3 Oct 05 03:06:39.901790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b545228d-9ca6-442b-8cd9-43143cfbf616 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:39.902349 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b545228d-9ca6-442b-8cd9-43143cfbf616 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:39.902858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b545228d-9ca6-442b-8cd9-43143cfbf616 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:39.903573 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b545228d-9ca6-442b-8cd9-43143cfbf616 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:39.904057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b545228d-9ca6-442b-8cd9-43143cfbf616 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:39.904492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b545228d-9ca6-442b-8cd9-43143cfbf616 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:39.904865 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-753bba83-16bc-4b7f-a78e-d4bdbd8f1aeb req-22cbcbcc-d126-47d6-8e53-e6bf1d2786ae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037851 Oct 05 03:06:39.905594 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3097/6214] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:06:40.136138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b545228d-9ca6-442b-8cd9-43143cfbf616 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac015152532a44609827594179c68aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68101269cd8447ec89411b4eab950d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:06:40.144503 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b545228d-9ca6-442b-8cd9-43143cfbf616 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9" status: 200 len: 1472 microversion: 2.1 time: 0.256359 Oct 05 03:06:40.145205 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3118/6215] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:39 2022] GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9 => generated 1472 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:06:41.165027 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:06:41.167212 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=10 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:06:41.172960 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2decf518-7df0-4cb4-95ac-75b0e1ce3396 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:41.173672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2decf518-7df0-4cb4-95ac-75b0e1ce3396 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: f4cd4aa7-8674-456c-a4a3-7750478f5cb9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:41.175682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:06:41.184487 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2decf518-7df0-4cb4-95ac-75b0e1ce3396 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:41.185074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2decf518-7df0-4cb4-95ac-75b0e1ce3396 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:41.185576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2decf518-7df0-4cb4-95ac-75b0e1ce3396 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:41.186287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2decf518-7df0-4cb4-95ac-75b0e1ce3396 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:41.186749 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2decf518-7df0-4cb4-95ac-75b0e1ce3396 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:41.187177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2decf518-7df0-4cb4-95ac-75b0e1ce3396 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:41.190571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=70,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:06:41.373915 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2decf518-7df0-4cb4-95ac-75b0e1ce3396 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac015152532a44609827594179c68aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68101269cd8447ec89411b4eab950d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:06:41.382077 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2decf518-7df0-4cb4-95ac-75b0e1ce3396 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9" status: 200 len: 1472 microversion: 2.1 time: 0.217989 Oct 05 03:06:41.382670 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3098/6216] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:41 2022] GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9 => generated 1472 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:06:42.265076 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-84da0224-c2c8-4b28-b009-1d2d8f7ac1d8 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:42.265904 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-84da0224-c2c8-4b28-b009-1d2d8f7ac1d8 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:42.267836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:06:42.269503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:06:42.276631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84da0224-c2c8-4b28-b009-1d2d8f7ac1d8 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:42.277160 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84da0224-c2c8-4b28-b009-1d2d8f7ac1d8 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:42.277604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84da0224-c2c8-4b28-b009-1d2d8f7ac1d8 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:42.278590 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84da0224-c2c8-4b28-b009-1d2d8f7ac1d8 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:42.279054 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84da0224-c2c8-4b28-b009-1d2d8f7ac1d8 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:42.279487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84da0224-c2c8-4b28-b009-1d2d8f7ac1d8 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:42.282836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:06:42.414733 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c2ceefa7-29df-42b0-84ed-1901748baeef tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:42.415554 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c2ceefa7-29df-42b0-84ed-1901748baeef tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: f4cd4aa7-8674-456c-a4a3-7750478f5cb9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:42.426033 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2ceefa7-29df-42b0-84ed-1901748baeef tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:42.426593 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2ceefa7-29df-42b0-84ed-1901748baeef tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:42.426986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2ceefa7-29df-42b0-84ed-1901748baeef tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:42.427867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2ceefa7-29df-42b0-84ed-1901748baeef tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:42.428498 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2ceefa7-29df-42b0-84ed-1901748baeef tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:42.429156 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2ceefa7-29df-42b0-84ed-1901748baeef tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:42.473593 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-84da0224-c2c8-4b28-b009-1d2d8f7ac1d8 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1832 microversion: 2.1 time: 0.212266 Oct 05 03:06:42.476999 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3119/6217] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:42 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1832 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:06:42.593307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c2ceefa7-29df-42b0-84ed-1901748baeef tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac015152532a44609827594179c68aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68101269cd8447ec89411b4eab950d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:06:42.601014 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c2ceefa7-29df-42b0-84ed-1901748baeef tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9" status: 200 len: 1645 microversion: 2.1 time: 0.197672 Oct 05 03:06:42.601595 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3099/6218] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:42 2022] GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9 => generated 1645 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:06:42.623586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1739f7fa-bb95-4667-a635-92bd855457b3 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:42.624201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1739f7fa-bb95-4667-a635-92bd855457b3 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: f4cd4aa7-8674-456c-a4a3-7750478f5cb9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:42.631225 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1739f7fa-bb95-4667-a635-92bd855457b3 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:42.631721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1739f7fa-bb95-4667-a635-92bd855457b3 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:42.632155 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1739f7fa-bb95-4667-a635-92bd855457b3 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:42.632849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1739f7fa-bb95-4667-a635-92bd855457b3 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:42.633326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1739f7fa-bb95-4667-a635-92bd855457b3 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:42.633745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1739f7fa-bb95-4667-a635-92bd855457b3 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:42.784037 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d1274418-d40c-40ca-9945-a4f8c007d742 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:42.784896 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d1274418-d40c-40ca-9945-a4f8c007d742 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:42.791501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1274418-d40c-40ca-9945-a4f8c007d742 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:42.792287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1274418-d40c-40ca-9945-a4f8c007d742 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:42.792971 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1274418-d40c-40ca-9945-a4f8c007d742 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:42.794141 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1274418-d40c-40ca-9945-a4f8c007d742 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:42.794814 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1274418-d40c-40ca-9945-a4f8c007d742 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:42.795465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1274418-d40c-40ca-9945-a4f8c007d742 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:42.795947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1739f7fa-bb95-4667-a635-92bd855457b3 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac015152532a44609827594179c68aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68101269cd8447ec89411b4eab950d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:06:42.805746 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1739f7fa-bb95-4667-a635-92bd855457b3 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9" status: 200 len: 1645 microversion: 2.1 time: 0.186113 Oct 05 03:06:42.807986 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3120/6219] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:42 2022] GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9 => generated 1645 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:06:42.826381 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d1274418-d40c-40ca-9945-a4f8c007d742 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02/ips" status: 200 len: 149 microversion: 2.1 time: 0.046367 Oct 05 03:06:42.833362 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2369853e-2a37-4b60-b62d-f6e6c93800c5 tempest-TestSecurityGroupsBasicOps-512529858 tempest-TestSecurityGroupsBasicOps-512529858-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:42.833362 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2369853e-2a37-4b60-b62d-f6e6c93800c5 tempest-TestSecurityGroupsBasicOps-512529858 tempest-TestSecurityGroupsBasicOps-512529858-project-admin] [instance: f4cd4aa7-8674-456c-a4a3-7750478f5cb9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:42.834878 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3100/6220] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 03:06:42 2022] GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02/ips => generated 149 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:06:42.835805 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2369853e-2a37-4b60-b62d-f6e6c93800c5 tempest-TestSecurityGroupsBasicOps-512529858 tempest-TestSecurityGroupsBasicOps-512529858-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:42.836303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2369853e-2a37-4b60-b62d-f6e6c93800c5 tempest-TestSecurityGroupsBasicOps-512529858 tempest-TestSecurityGroupsBasicOps-512529858-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:42.836793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2369853e-2a37-4b60-b62d-f6e6c93800c5 tempest-TestSecurityGroupsBasicOps-512529858 tempest-TestSecurityGroupsBasicOps-512529858-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:42.837468 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2369853e-2a37-4b60-b62d-f6e6c93800c5 tempest-TestSecurityGroupsBasicOps-512529858 tempest-TestSecurityGroupsBasicOps-512529858-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:42.838506 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2369853e-2a37-4b60-b62d-f6e6c93800c5 tempest-TestSecurityGroupsBasicOps-512529858 tempest-TestSecurityGroupsBasicOps-512529858-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:42.838933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2369853e-2a37-4b60-b62d-f6e6c93800c5 tempest-TestSecurityGroupsBasicOps-512529858 tempest-TestSecurityGroupsBasicOps-512529858-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:42.841970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8ba72756-8be3-4706-bf60-4ef5dd4d8571 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93dfe6d6-9a28-4861-905b-a10ce7b4cabe"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:06:42.844738 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8ba72756-8be3-4706-bf60-4ef5dd4d8571 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:42.851135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ba72756-8be3-4706-bf60-4ef5dd4d8571 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:42.851908 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ba72756-8be3-4706-bf60-4ef5dd4d8571 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:42.852579 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ba72756-8be3-4706-bf60-4ef5dd4d8571 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:42.853588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ba72756-8be3-4706-bf60-4ef5dd4d8571 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:42.854873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ba72756-8be3-4706-bf60-4ef5dd4d8571 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:42.855683 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ba72756-8be3-4706-bf60-4ef5dd4d8571 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:42.949513 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-8ba72756-8be3-4706-bf60-4ef5dd4d8571 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] HTTP exception thrown: Invalid volume: volume 93dfe6d6-9a28-4861-905b-a10ce7b4cabe is already attached to instances: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8ba72756-8be3-4706-bf60-4ef5dd4d8571 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Request method failure captured: Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02/os-volume_attachments HTTP/1.1 Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 74 Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPQLbaCJcQoINHOY2GKTbE6oK5DZKXlvS9cTUJZgUsjhzJ11GCBMxKRG2ZW2HydnkNGtZ8u98fUAxnzQFqGG-K-d7yptqwDawf-PQoraVusgo1XYypQQkhEqqbJdJFh02G9QsSpvTDhdtNr6cnzMOTz-5c9_S6hWETgH6FWjUbmuXPI Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 7b99b6a5b1764f64a68793f37d4f9b96 Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 7b99b6a5b1764f64a68793f37d4f9b96 Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-AttachVolumeNegativeTest-2082311660-project Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 881baf1ede7e4fb5acf65268a81241ad Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-AttachVolumeNegativeTest-2082311660-project Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: {"volumeAttachment": {"volumeId": "93dfe6d6-9a28-4861-905b-a10ce7b4cabe"}} Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: exception: Invalid volume: volume 93dfe6d6-9a28-4861-905b-a10ce7b4cabe is already attached to instances: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'server_id': '8642a9ef-f4cc-4ba0-97dd-4443e73bcd02', 'body': {'volumeAttachment': {'volumeId': '93dfe6d6-9a28-4861-905b-a10ce7b4cabe'}}} Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 93dfe6d6-9a28-4861-905b-a10ce7b4cabe is already attached to instances: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 03:06:42.951809 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 03:06:42.956676 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 03:06:42.956676 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 03:06:42.956676 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 05 03:06:42.956676 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 05 03:06:42.956676 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 93dfe6d6-9a28-4861-905b-a10ce7b4cabe is already attached to instances: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 Oct 05 03:06:42.956676 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:06:42.956676 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:06:42.956676 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:06:42.956676 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:06:42.956676 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:06:42.956676 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:06:42.956676 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:06:42.956676 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:06:42.956676 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 93dfe6d6-9a28-4861-905b-a10ce7b4cabe is already attached to instances: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 Oct 05 03:06:42.956676 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:06:42.956676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8ba72756-8be3-4706-bf60-4ef5dd4d8571 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Returning 400 to user: Invalid volume: volume 93dfe6d6-9a28-4861-905b-a10ce7b4cabe is already attached to instances: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:06:42.956676 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8ba72756-8be3-4706-bf60-4ef5dd4d8571 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "POST /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.117780 Oct 05 03:06:42.959684 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3101/6221] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 03:06:42 2022] POST /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02/os-volume_attachments => generated 174 bytes in 120 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 03:06:42.966283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-44a0e4fc-5f17-4c9e-9e64-827256e58908 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:42.966944 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-44a0e4fc-5f17-4c9e-9e64-827256e58908 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:42.973570 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44a0e4fc-5f17-4c9e-9e64-827256e58908 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:42.974185 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44a0e4fc-5f17-4c9e-9e64-827256e58908 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:42.974720 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44a0e4fc-5f17-4c9e-9e64-827256e58908 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:42.975712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44a0e4fc-5f17-4c9e-9e64-827256e58908 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:42.976340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44a0e4fc-5f17-4c9e-9e64-827256e58908 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:42.976876 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-44a0e4fc-5f17-4c9e-9e64-827256e58908 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:43.021166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-44a0e4fc-5f17-4c9e-9e64-827256e58908 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:06:43.137656 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-44a0e4fc-5f17-4c9e-9e64-827256e58908 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02" status: 204 len: 0 microversion: 2.1 time: 0.175553 Oct 05 03:06:43.153823 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2369853e-2a37-4b60-b62d-f6e6c93800c5 tempest-TestSecurityGroupsBasicOps-512529858 tempest-TestSecurityGroupsBasicOps-512529858-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9" status: 200 len: 1796 microversion: 2.1 time: 0.327951 Oct 05 03:06:43.153981 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3102/6222] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:06:42 2022] DELETE /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:06:43.160206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b76736f3-c101-461a-bfdc-34a2859b349c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:43.160937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b76736f3-c101-461a-bfdc-34a2859b349c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:43.167560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b76736f3-c101-461a-bfdc-34a2859b349c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:43.168059 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b76736f3-c101-461a-bfdc-34a2859b349c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:43.168542 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b76736f3-c101-461a-bfdc-34a2859b349c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:43.169585 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b76736f3-c101-461a-bfdc-34a2859b349c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:43.170088 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b76736f3-c101-461a-bfdc-34a2859b349c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:43.170519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b76736f3-c101-461a-bfdc-34a2859b349c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:43.174261 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3121/6223] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:42 2022] GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9 => generated 1796 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:06:43.433966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b76736f3-c101-461a-bfdc-34a2859b349c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:06:43.444953 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b76736f3-c101-461a-bfdc-34a2859b349c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02" status: 200 len: 1681 microversion: 2.1 time: 0.289554 Oct 05 03:06:43.446436 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3103/6224] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:43 2022] GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 => generated 1681 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:06:43.837683 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8d6aa885-959b-4949-92bf-d6ce4cfd48df tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:43.838316 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8d6aa885-959b-4949-92bf-d6ce4cfd48df tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:43.842698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-f90ac409-d8c8-4499-90c7-0107bcb84050 req-1bced620-a898-4c38-80d9-37947d2dd829 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8276749-cb0f-4aaa-a37d-10e9a99a49d3", "tag": "8821de78-ad20-42ce-9987-e279a5e9e2bc"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:06:43.851553 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d6aa885-959b-4949-92bf-d6ce4cfd48df tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:43.852053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d6aa885-959b-4949-92bf-d6ce4cfd48df tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:43.852491 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d6aa885-959b-4949-92bf-d6ce4cfd48df tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:43.853235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d6aa885-959b-4949-92bf-d6ce4cfd48df tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:43.853430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f90ac409-d8c8-4499-90c7-0107bcb84050 req-1bced620-a898-4c38-80d9-37947d2dd829 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:43.855012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f90ac409-d8c8-4499-90c7-0107bcb84050 req-1bced620-a898-4c38-80d9-37947d2dd829 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:43.855633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f90ac409-d8c8-4499-90c7-0107bcb84050 req-1bced620-a898-4c38-80d9-37947d2dd829 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:43.861618 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d6aa885-959b-4949-92bf-d6ce4cfd48df tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:43.862173 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d6aa885-959b-4949-92bf-d6ce4cfd48df tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:43.872435 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-f90ac409-d8c8-4499-90c7-0107bcb84050 req-1bced620-a898-4c38-80d9-37947d2dd829 service nova] Creating event network-changed:8821de78-ad20-42ce-9987-e279a5e9e2bc for instance b8276749-cb0f-4aaa-a37d-10e9a99a49d3 on n-h1-858272-3 Oct 05 03:06:43.879469 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-f90ac409-d8c8-4499-90c7-0107bcb84050 req-1bced620-a898-4c38-80d9-37947d2dd829 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040257 Oct 05 03:06:43.884621 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3104/6225] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:06:43.908681 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8d6aa885-959b-4949-92bf-d6ce4cfd48df tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:06:44.021631 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8d6aa885-959b-4949-92bf-d6ce4cfd48df tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 204 len: 0 microversion: 2.1 time: 0.187517 Oct 05 03:06:44.025426 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3122/6226] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:06:43 2022] DELETE /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:06:44.036059 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b7d478cc-253d-430a-b92f-2f8232db5488 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:44.036936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b7d478cc-253d-430a-b92f-2f8232db5488 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:44.044441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b7d478cc-253d-430a-b92f-2f8232db5488 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:44.045251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b7d478cc-253d-430a-b92f-2f8232db5488 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:44.045914 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b7d478cc-253d-430a-b92f-2f8232db5488 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:44.046844 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b7d478cc-253d-430a-b92f-2f8232db5488 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:44.047508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b7d478cc-253d-430a-b92f-2f8232db5488 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:44.048072 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b7d478cc-253d-430a-b92f-2f8232db5488 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:44.305531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b7d478cc-253d-430a-b92f-2f8232db5488 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:06:44.315717 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b7d478cc-253d-430a-b92f-2f8232db5488 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1687 microversion: 2.1 time: 0.285205 Oct 05 03:06:44.317260 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3105/6227] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:44 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1687 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:06:44.472273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-aaca030a-1893-4343-9f5e-ba1bc26b19d0 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:44.473030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-aaca030a-1893-4343-9f5e-ba1bc26b19d0 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:44.480477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aaca030a-1893-4343-9f5e-ba1bc26b19d0 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:44.489315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aaca030a-1893-4343-9f5e-ba1bc26b19d0 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:44.490134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aaca030a-1893-4343-9f5e-ba1bc26b19d0 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:44.493821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aaca030a-1893-4343-9f5e-ba1bc26b19d0 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:44.498546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aaca030a-1893-4343-9f5e-ba1bc26b19d0 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:44.499010 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aaca030a-1893-4343-9f5e-ba1bc26b19d0 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:44.819847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-aaca030a-1893-4343-9f5e-ba1bc26b19d0 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:06:44.830170 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-aaca030a-1893-4343-9f5e-ba1bc26b19d0 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02" status: 200 len: 1681 microversion: 2.1 time: 0.362019 Oct 05 03:06:44.831460 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3123/6228] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:44 2022] GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 => generated 1681 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:06:45.340495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-94220acc-aff4-4e25-9a63-c49a13ecb499 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:45.341821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-94220acc-aff4-4e25-9a63-c49a13ecb499 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:45.348935 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94220acc-aff4-4e25-9a63-c49a13ecb499 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:45.349427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94220acc-aff4-4e25-9a63-c49a13ecb499 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:45.349869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94220acc-aff4-4e25-9a63-c49a13ecb499 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:45.350581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94220acc-aff4-4e25-9a63-c49a13ecb499 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:45.351042 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94220acc-aff4-4e25-9a63-c49a13ecb499 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:45.351468 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94220acc-aff4-4e25-9a63-c49a13ecb499 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:45.800168 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-94220acc-aff4-4e25-9a63-c49a13ecb499 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:06:45.808794 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-94220acc-aff4-4e25-9a63-c49a13ecb499 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1687 microversion: 2.1 time: 0.472487 Oct 05 03:06:45.809920 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3106/6229] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:45 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1687 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:06:45.854671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ce08d9b6-14ef-4c3c-8cba-41886fabd5fa tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:45.855292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ce08d9b6-14ef-4c3c-8cba-41886fabd5fa tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:45.862865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce08d9b6-14ef-4c3c-8cba-41886fabd5fa tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:45.863356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce08d9b6-14ef-4c3c-8cba-41886fabd5fa tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:45.863796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce08d9b6-14ef-4c3c-8cba-41886fabd5fa tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:45.864502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce08d9b6-14ef-4c3c-8cba-41886fabd5fa tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:45.864994 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce08d9b6-14ef-4c3c-8cba-41886fabd5fa tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:45.865419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce08d9b6-14ef-4c3c-8cba-41886fabd5fa tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:46.724707 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ce08d9b6-14ef-4c3c-8cba-41886fabd5fa tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:06:46.734477 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ce08d9b6-14ef-4c3c-8cba-41886fabd5fa tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02" status: 200 len: 1681 microversion: 2.1 time: 0.884418 Oct 05 03:06:46.735272 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3124/6230] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:45 2022] GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 => generated 1681 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:06:46.835147 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3ea4e02b-fd3a-4759-89c9-796594702e90 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:46.835750 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3ea4e02b-fd3a-4759-89c9-796594702e90 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:46.846163 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3ea4e02b-fd3a-4759-89c9-796594702e90 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:46.846994 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3ea4e02b-fd3a-4759-89c9-796594702e90 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:46.847630 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3ea4e02b-fd3a-4759-89c9-796594702e90 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:46.848419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3ea4e02b-fd3a-4759-89c9-796594702e90 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:46.848975 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3ea4e02b-fd3a-4759-89c9-796594702e90 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:46.849472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3ea4e02b-fd3a-4759-89c9-796594702e90 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:47.252408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3ea4e02b-fd3a-4759-89c9-796594702e90 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:06:47.271278 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3ea4e02b-fd3a-4759-89c9-796594702e90 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1687 microversion: 2.1 time: 0.442445 Oct 05 03:06:47.287242 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3107/6231] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:46 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1687 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:06:47.428155 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-61d2c281-790c-4e7c-a54a-439d0b5d408f req-70b8e173-7e06-4e8f-a7e7-e4fc33d5c4b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4cd4aa7-8674-456c-a4a3-7750478f5cb9", "tag": "beb8429b-f510-4361-8dac-96330c34c9c7"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:06:47.459700 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-61d2c281-790c-4e7c-a54a-439d0b5d408f req-70b8e173-7e06-4e8f-a7e7-e4fc33d5c4b0 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:47.460730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-61d2c281-790c-4e7c-a54a-439d0b5d408f req-70b8e173-7e06-4e8f-a7e7-e4fc33d5c4b0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:47.461662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-61d2c281-790c-4e7c-a54a-439d0b5d408f req-70b8e173-7e06-4e8f-a7e7-e4fc33d5c4b0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:47.491591 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-61d2c281-790c-4e7c-a54a-439d0b5d408f req-70b8e173-7e06-4e8f-a7e7-e4fc33d5c4b0 service nova] Creating event network-changed:beb8429b-f510-4361-8dac-96330c34c9c7 for instance f4cd4aa7-8674-456c-a4a3-7750478f5cb9 on n-h1-858272-3 Oct 05 03:06:47.502412 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-61d2c281-790c-4e7c-a54a-439d0b5d408f req-70b8e173-7e06-4e8f-a7e7-e4fc33d5c4b0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078560 Oct 05 03:06:47.531161 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3125/6232] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:06:47.757668 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d9afa2a5-1982-419e-b675-821ca2c817dd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:47.758687 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d9afa2a5-1982-419e-b675-821ca2c817dd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:47.772619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d9afa2a5-1982-419e-b675-821ca2c817dd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:47.777627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d9afa2a5-1982-419e-b675-821ca2c817dd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:47.778676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d9afa2a5-1982-419e-b675-821ca2c817dd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:47.779882 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d9afa2a5-1982-419e-b675-821ca2c817dd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:47.784062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d9afa2a5-1982-419e-b675-821ca2c817dd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:47.785472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d9afa2a5-1982-419e-b675-821ca2c817dd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:48.111933 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d9afa2a5-1982-419e-b675-821ca2c817dd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:06:48.127042 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d9afa2a5-1982-419e-b675-821ca2c817dd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02" status: 200 len: 1614 microversion: 2.1 time: 0.373167 Oct 05 03:06:48.130205 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3108/6233] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:47 2022] GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 => generated 1614 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:06:48.303426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0732f5a6-6291-4442-96b2-ef3927f4ec29 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:48.304414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0732f5a6-6291-4442-96b2-ef3927f4ec29 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:48.317369 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0732f5a6-6291-4442-96b2-ef3927f4ec29 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:48.321510 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0732f5a6-6291-4442-96b2-ef3927f4ec29 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:48.323236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0732f5a6-6291-4442-96b2-ef3927f4ec29 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:48.324331 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0732f5a6-6291-4442-96b2-ef3927f4ec29 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:48.324816 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0732f5a6-6291-4442-96b2-ef3927f4ec29 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:48.325314 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0732f5a6-6291-4442-96b2-ef3927f4ec29 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:48.401996 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0732f5a6-6291-4442-96b2-ef3927f4ec29 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:48.402615 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0732f5a6-6291-4442-96b2-ef3927f4ec29 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:48.403014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0732f5a6-6291-4442-96b2-ef3927f4ec29 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:48.406683 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-0732f5a6-6291-4442-96b2-ef3927f4ec29 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lazy-loading 'fault' on Instance uuid b8276749-cb0f-4aaa-a37d-10e9a99a49d3 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:06:48.493093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0732f5a6-6291-4442-96b2-ef3927f4ec29 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:06:48.507552 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0732f5a6-6291-4442-96b2-ef3927f4ec29 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 200 len: 1357 microversion: 2.1 time: 0.204078 Oct 05 03:06:48.524996 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3126/6234] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:48 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 1357 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:06:49.156313 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4cd1d7c3-e442-477e-a1c0-274c45421211 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:49.157027 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4cd1d7c3-e442-477e-a1c0-274c45421211 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:49.164252 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4cd1d7c3-e442-477e-a1c0-274c45421211 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:49.164761 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4cd1d7c3-e442-477e-a1c0-274c45421211 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:49.165252 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4cd1d7c3-e442-477e-a1c0-274c45421211 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:49.166146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4cd1d7c3-e442-477e-a1c0-274c45421211 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:49.166640 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4cd1d7c3-e442-477e-a1c0-274c45421211 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:49.167075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4cd1d7c3-e442-477e-a1c0-274c45421211 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:49.189510 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-4cd1d7c3-e442-477e-a1c0-274c45421211 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] HTTP exception thrown: Instance 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 could not be found. Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4cd1d7c3-e442-477e-a1c0-274c45421211 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Request method failure captured: Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 HTTP/1.1 Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPQLbaCJcQoINHOY2GKTbE6oK5DZKXlvS9cTUJZgUsjhzJ11GCBMxKRG2ZW2HydnkNGtZ8u98fUAxnzQFqGG-K-d7yptqwDawf-PQoraVusgo1XYypQQkhEqqbJdJFh02G9QsSpvTDhdtNr6cnzMOTz-5c9_S6hWETgH6FWjUbmuXPI Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 7b99b6a5b1764f64a68793f37d4f9b96 Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 7b99b6a5b1764f64a68793f37d4f9b96 Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-AttachVolumeNegativeTest-2082311660-project Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 881baf1ede7e4fb5acf65268a81241ad Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-AttachVolumeNegativeTest-2082311660-project Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 could not be found. Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '8642a9ef-f4cc-4ba0-97dd-4443e73bcd02'} Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 could not be found. Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 could not be found. Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:06:49.191393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:06:49.195494 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:06:49.195494 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:06:49.195494 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:06:49.195494 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:06:49.195494 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:06:49.195494 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 could not be found. Oct 05 03:06:49.195494 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:06:49.195494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4cd1d7c3-e442-477e-a1c0-274c45421211 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Returning 404 to user: Instance 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:06:49.195494 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4cd1d7c3-e442-477e-a1c0-274c45421211 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02" status: 404 len: 111 microversion: 2.1 time: 0.040599 Oct 05 03:06:49.198117 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3109/6235] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:49 2022] GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:06:49.203382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-72046f3a-b2fc-41a1-8dac-92000d757966 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '.version_select at 0x7fccdf540820>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:49.226652 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-72046f3a-b2fc-41a1-8dac-92000d757966 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1932580661" status: 202 len: 0 microversion: 2.1 time: 0.027044 Oct 05 03:06:49.227250 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3127/6236] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 5 03:06:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1932580661 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:06:49.533757 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-076558b5-2f88-49b9-9b07-fdd63c584058 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:49.534509 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-076558b5-2f88-49b9-9b07-fdd63c584058 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: b8276749-cb0f-4aaa-a37d-10e9a99a49d3] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:49.542113 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-076558b5-2f88-49b9-9b07-fdd63c584058 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:49.542626 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-076558b5-2f88-49b9-9b07-fdd63c584058 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:49.543069 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-076558b5-2f88-49b9-9b07-fdd63c584058 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:49.543784 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-076558b5-2f88-49b9-9b07-fdd63c584058 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:49.544243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-076558b5-2f88-49b9-9b07-fdd63c584058 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:49.544670 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-076558b5-2f88-49b9-9b07-fdd63c584058 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:49.569943 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-076558b5-2f88-49b9-9b07-fdd63c584058 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] HTTP exception thrown: Instance b8276749-cb0f-4aaa-a37d-10e9a99a49d3 could not be found. Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-076558b5-2f88-49b9-9b07-fdd63c584058 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Request method failure captured: Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 HTTP/1.1 Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPQQaPdY80Cpcj7cnlUwviGOgibF1hELwwBhNlNnP0MqbdNiw25tncanzi7qWvBbOvFGmFxbhq_pYUvMd-n-xjmhM4x8o5emmLCp2GN5-d1zUtR_w4L-Z_KZTshYbgGB04rNkRVV36r2lGPYux6FzpfN97MB3YiAErpveqwDREaePkw Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: a86e3137c6764eeb948b9c7dab895c34 Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-344873080 Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a86e3137c6764eeb948b9c7dab895c34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a86e3137c6764eeb948b9c7dab895c34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a86e3137c6764eeb948b9c7dab895c34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a86e3137c6764eeb948b9c7dab895c34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-TestNetworkAdvancedServerOps-344873080 Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: a86e3137c6764eeb948b9c7dab895c34 Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-344873080 Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-TestNetworkAdvancedServerOps-344873080-project Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: ad3a53da0c764f0a893966aea6505fa7 Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-TestNetworkAdvancedServerOps-344873080-project Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance b8276749-cb0f-4aaa-a37d-10e9a99a49d3 could not be found. Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'b8276749-cb0f-4aaa-a37d-10e9a99a49d3'} Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8276749-cb0f-4aaa-a37d-10e9a99a49d3 could not be found. Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8276749-cb0f-4aaa-a37d-10e9a99a49d3 could not be found. Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:06:49.572465 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:06:49.576792 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:06:49.576792 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:06:49.576792 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:06:49.576792 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:06:49.576792 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:06:49.576792 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:06:49.576792 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8276749-cb0f-4aaa-a37d-10e9a99a49d3 could not be found. Oct 05 03:06:49.576792 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:06:49.578604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-ec8e78ba-bab8-4d72-850f-1b8e78e3fd1a req-45e552da-caf6-4545-a0d6-6aab379b5ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8276749-cb0f-4aaa-a37d-10e9a99a49d3", "name": "network-vif-deleted", "tag": "8821de78-ad20-42ce-9987-e279a5e9e2bc"}, {"server_uuid": "8642a9ef-f4cc-4ba0-97dd-4443e73bcd02", "name": "network-vif-deleted", "tag": "1dc61bd7-0385-4309-a420-491598fbc27d"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:06:49.579893 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-076558b5-2f88-49b9-9b07-fdd63c584058 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Returning 404 to user: Instance b8276749-cb0f-4aaa-a37d-10e9a99a49d3 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:06:49.581011 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-076558b5-2f88-49b9-9b07-fdd63c584058 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3" status: 404 len: 111 microversion: 2.1 time: 0.052565 Oct 05 03:06:49.582134 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3110/6237] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:49 2022] GET /compute/v2.1/servers/b8276749-cb0f-4aaa-a37d-10e9a99a49d3 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:06:49.594199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ec8e78ba-bab8-4d72-850f-1b8e78e3fd1a req-45e552da-caf6-4545-a0d6-6aab379b5ae4 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:49.594687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ec8e78ba-bab8-4d72-850f-1b8e78e3fd1a req-45e552da-caf6-4545-a0d6-6aab379b5ae4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:49.595121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ec8e78ba-bab8-4d72-850f-1b8e78e3fd1a req-45e552da-caf6-4545-a0d6-6aab379b5ae4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:49.610067 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-ec8e78ba-bab8-4d72-850f-1b8e78e3fd1a req-45e552da-caf6-4545-a0d6-6aab379b5ae4 service nova] Creating event network-vif-deleted:8821de78-ad20-42ce-9987-e279a5e9e2bc for instance b8276749-cb0f-4aaa-a37d-10e9a99a49d3 on n-h1-858272-3 Oct 05 03:06:49.610929 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-ec8e78ba-bab8-4d72-850f-1b8e78e3fd1a req-45e552da-caf6-4545-a0d6-6aab379b5ae4 service nova] Creating event network-vif-deleted:1dc61bd7-0385-4309-a420-491598fbc27d for instance 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 on n-h2-858272-3 Oct 05 03:06:49.623639 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-ec8e78ba-bab8-4d72-850f-1b8e78e3fd1a req-45e552da-caf6-4545-a0d6-6aab379b5ae4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.056424 Oct 05 03:06:49.624701 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3128/6238] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:06:50.013169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7b6319db-2fc6-4ebf-8929-3eea4bb4169a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:50.013800 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7b6319db-2fc6-4ebf-8929-3eea4bb4169a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:50.020827 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7b6319db-2fc6-4ebf-8929-3eea4bb4169a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:50.021390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7b6319db-2fc6-4ebf-8929-3eea4bb4169a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:50.021835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7b6319db-2fc6-4ebf-8929-3eea4bb4169a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:50.022598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7b6319db-2fc6-4ebf-8929-3eea4bb4169a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:50.023064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7b6319db-2fc6-4ebf-8929-3eea4bb4169a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:50.023509 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7b6319db-2fc6-4ebf-8929-3eea4bb4169a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:50.122231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-7b6319db-2fc6-4ebf-8929-3eea4bb4169a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lazy-loading 'services' on Instance uuid 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:06:50.239336 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7b6319db-2fc6-4ebf-8929-3eea4bb4169a tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9/os-volume_attachments/93dfe6d6-9a28-4861-905b-a10ce7b4cabe" status: 202 len: 0 microversion: 2.1 time: 0.230746 Oct 05 03:06:50.241090 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3111/6239] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 03:06:50 2022] DELETE /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9/os-volume_attachments/93dfe6d6-9a28-4861-905b-a10ce7b4cabe => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:06:50.251770 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-304808c7-ccb2-44e3-94c3-173340ef2ce8 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:50.255289 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-304808c7-ccb2-44e3-94c3-173340ef2ce8 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:50.263498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-304808c7-ccb2-44e3-94c3-173340ef2ce8 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:50.264147 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-304808c7-ccb2-44e3-94c3-173340ef2ce8 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:50.264664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-304808c7-ccb2-44e3-94c3-173340ef2ce8 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:50.266056 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-304808c7-ccb2-44e3-94c3-173340ef2ce8 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:50.266557 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-304808c7-ccb2-44e3-94c3-173340ef2ce8 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:50.267279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-304808c7-ccb2-44e3-94c3-173340ef2ce8 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:50.305829 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-304808c7-ccb2-44e3-94c3-173340ef2ce8 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059249 Oct 05 03:06:50.306417 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3129/6240] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:06:50 2022] GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:06:51.320016 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-293e42eb-c727-450d-bc32-1edec95e7e63 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:51.323833 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-293e42eb-c727-450d-bc32-1edec95e7e63 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:51.330406 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-293e42eb-c727-450d-bc32-1edec95e7e63 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:51.330930 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-293e42eb-c727-450d-bc32-1edec95e7e63 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:51.331375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-293e42eb-c727-450d-bc32-1edec95e7e63 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:51.332073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-293e42eb-c727-450d-bc32-1edec95e7e63 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:51.332536 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-293e42eb-c727-450d-bc32-1edec95e7e63 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:51.333004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-293e42eb-c727-450d-bc32-1edec95e7e63 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:51.366481 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-293e42eb-c727-450d-bc32-1edec95e7e63 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051518 Oct 05 03:06:51.371688 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3112/6241] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:06:51 2022] GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:06:52.382437 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f2dd7330-3eb5-464d-8207-fcec3e39ae3b tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:52.386221 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f2dd7330-3eb5-464d-8207-fcec3e39ae3b tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:52.397924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f2dd7330-3eb5-464d-8207-fcec3e39ae3b tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:52.398873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f2dd7330-3eb5-464d-8207-fcec3e39ae3b tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:52.399967 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f2dd7330-3eb5-464d-8207-fcec3e39ae3b tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:52.401091 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f2dd7330-3eb5-464d-8207-fcec3e39ae3b tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:52.402379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f2dd7330-3eb5-464d-8207-fcec3e39ae3b tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:52.402973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f2dd7330-3eb5-464d-8207-fcec3e39ae3b tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:52.444792 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f2dd7330-3eb5-464d-8207-fcec3e39ae3b tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069485 Oct 05 03:06:52.445977 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3130/6242] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:06:52 2022] GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:06:53.325694 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cc93316e-89a2-498e-915b-684de6b5a10c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '.version_select at 0x7fccdfe8c8b0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:53.359704 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cc93316e-89a2-498e-915b-684de6b5a10c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2094650385" status: 202 len: 0 microversion: 2.1 time: 0.041308 Oct 05 03:06:53.362604 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3113/6243] 10.222.0.16 () {58 vars in 1284 bytes} [Wed Oct 5 03:06:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2094650385 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:06:53.403363 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cfa72507-fa32-48f0-94e0-c71c50693ef2 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Action: 'create', calling method: .version_select at 0x7fccdec20550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-230329541", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO73mqsM+dX/Ki1FTBo8B/bVpcpnNj99xv9i78ezMI/n/hXoxutF0BHT/V5lMdy8011SJiJDlR+1ghleSb9UHI59UZPsAQ9FzppVWBEdOafmojaI1ikSBE+0z4sfDdu2vQ=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:06:53.425906 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-cfa72507-fa32-48f0-94e0-c71c50693ef2 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Getting quotas for project a86e3137c6764eeb948b9c7dab895c34. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:06:53.436295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-cfa72507-fa32-48f0-94e0-c71c50693ef2 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Getting quotas for user ad3a53da0c764f0a893966aea6505fa7 and project a86e3137c6764eeb948b9c7dab895c34. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:06:53.457933 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cbb5e5f1-f26b-4bb5-9b82-49e1077caef2 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:53.460458 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cbb5e5f1-f26b-4bb5-9b82-49e1077caef2 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:53.468695 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbb5e5f1-f26b-4bb5-9b82-49e1077caef2 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:53.469355 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbb5e5f1-f26b-4bb5-9b82-49e1077caef2 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:53.469901 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbb5e5f1-f26b-4bb5-9b82-49e1077caef2 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:53.470769 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbb5e5f1-f26b-4bb5-9b82-49e1077caef2 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:53.471382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbb5e5f1-f26b-4bb5-9b82-49e1077caef2 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:53.471794 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cfa72507-fa32-48f0-94e0-c71c50693ef2 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.074012 Oct 05 03:06:53.471964 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbb5e5f1-f26b-4bb5-9b82-49e1077caef2 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:53.472724 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3131/6244] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 03:06:53 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:06:53.522202 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cbb5e5f1-f26b-4bb5-9b82-49e1077caef2 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068260 Oct 05 03:06:53.522913 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3114/6245] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:06:53 2022] GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:06:54.538053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-45da56dd-2f79-4f9c-9983-7d3406e9c529 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:54.540596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-45da56dd-2f79-4f9c-9983-7d3406e9c529 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:54.548268 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45da56dd-2f79-4f9c-9983-7d3406e9c529 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:54.548884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45da56dd-2f79-4f9c-9983-7d3406e9c529 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:54.549367 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45da56dd-2f79-4f9c-9983-7d3406e9c529 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:54.550088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45da56dd-2f79-4f9c-9983-7d3406e9c529 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:54.550702 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45da56dd-2f79-4f9c-9983-7d3406e9c529 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:54.551440 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45da56dd-2f79-4f9c-9983-7d3406e9c529 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:54.587064 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-45da56dd-2f79-4f9c-9983-7d3406e9c529 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054223 Oct 05 03:06:54.592215 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3132/6246] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:06:54 2022] GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:06:55.599925 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bab60d19-d61c-455d-828d-fb2aa56e49db tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:55.602144 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bab60d19-d61c-455d-828d-fb2aa56e49db tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:55.609574 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bab60d19-d61c-455d-828d-fb2aa56e49db tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:55.610113 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bab60d19-d61c-455d-828d-fb2aa56e49db tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:55.611527 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bab60d19-d61c-455d-828d-fb2aa56e49db tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:55.612417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bab60d19-d61c-455d-828d-fb2aa56e49db tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:55.612871 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bab60d19-d61c-455d-828d-fb2aa56e49db tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:55.613326 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bab60d19-d61c-455d-828d-fb2aa56e49db tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:55.642363 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:06:55.647877 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bab60d19-d61c-455d-828d-fb2aa56e49db tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052510 Oct 05 03:06:55.653044 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3115/6247] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:06:55 2022] GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 03:06:55.732394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-eb06bec4-c585-4688-bce2-98dc9046742e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:55.733555 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-eb06bec4-c585-4688-bce2-98dc9046742e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:55.740091 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb06bec4-c585-4688-bce2-98dc9046742e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:55.740575 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb06bec4-c585-4688-bce2-98dc9046742e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:55.741036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb06bec4-c585-4688-bce2-98dc9046742e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:55.741732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb06bec4-c585-4688-bce2-98dc9046742e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:55.742206 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb06bec4-c585-4688-bce2-98dc9046742e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:55.742796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb06bec4-c585-4688-bce2-98dc9046742e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:55.773505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-eb06bec4-c585-4688-bce2-98dc9046742e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:06:55.867703 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-eb06bec4-c585-4688-bce2-98dc9046742e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9" status: 204 len: 0 microversion: 2.1 time: 0.140157 Oct 05 03:06:55.868620 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3133/6248] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:06:55 2022] DELETE /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:06:55.878939 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1bee238d-e373-4891-8cbe-677634582e54 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:55.879836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1bee238d-e373-4891-8cbe-677634582e54 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:55.888985 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bee238d-e373-4891-8cbe-677634582e54 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:55.889827 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bee238d-e373-4891-8cbe-677634582e54 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:55.890337 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bee238d-e373-4891-8cbe-677634582e54 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:55.891795 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bee238d-e373-4891-8cbe-677634582e54 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:55.892462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bee238d-e373-4891-8cbe-677634582e54 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:55.893122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bee238d-e373-4891-8cbe-677634582e54 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:56.201574 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1bee238d-e373-4891-8cbe-677634582e54 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:06:56.209767 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1bee238d-e373-4891-8cbe-677634582e54 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9" status: 200 len: 1680 microversion: 2.1 time: 0.335927 Oct 05 03:06:56.210529 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3116/6249] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:55 2022] GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 => generated 1680 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:06:57.238084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2a91f981-049f-4ad1-9926-5677f58bbd8d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:57.239108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2a91f981-049f-4ad1-9926-5677f58bbd8d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:57.256707 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a91f981-049f-4ad1-9926-5677f58bbd8d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:57.257146 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a91f981-049f-4ad1-9926-5677f58bbd8d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:57.257595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a91f981-049f-4ad1-9926-5677f58bbd8d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:57.258703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a91f981-049f-4ad1-9926-5677f58bbd8d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:57.258870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a91f981-049f-4ad1-9926-5677f58bbd8d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:57.259201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a91f981-049f-4ad1-9926-5677f58bbd8d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:57.684159 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2a91f981-049f-4ad1-9926-5677f58bbd8d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:06:57.695270 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2a91f981-049f-4ad1-9926-5677f58bbd8d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9" status: 200 len: 1680 microversion: 2.1 time: 0.464803 Oct 05 03:06:57.699734 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3134/6250] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:57 2022] GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 => generated 1680 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:06:58.736777 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bd51d9d7-d14e-4ed6-8189-0e689165edf7 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:06:58.737466 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bd51d9d7-d14e-4ed6-8189-0e689165edf7 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:06:58.747004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd51d9d7-d14e-4ed6-8189-0e689165edf7 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:58.747427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd51d9d7-d14e-4ed6-8189-0e689165edf7 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:58.747865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd51d9d7-d14e-4ed6-8189-0e689165edf7 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:58.748581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd51d9d7-d14e-4ed6-8189-0e689165edf7 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:58.749064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd51d9d7-d14e-4ed6-8189-0e689165edf7 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:58.755884 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd51d9d7-d14e-4ed6-8189-0e689165edf7 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:59.012454 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bd51d9d7-d14e-4ed6-8189-0e689165edf7 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:06:59.021174 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bd51d9d7-d14e-4ed6-8189-0e689165edf7 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9" status: 200 len: 1680 microversion: 2.1 time: 0.294811 Oct 05 03:06:59.021767 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3117/6251] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:06:58 2022] GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 => generated 1680 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:06:59.872472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-ccf8b44c-6312-4523-8aee-a0e813ab5e37 req-b477eabd-400b-4d20-80e2-de1dce805b06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9", "name": "network-vif-deleted", "tag": "7b878a19-3085-4472-97f6-453e6e753a7e"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:06:59.922051 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 03:06:59.924929 n-d-858272-3 devstack@n-api.service[122319]: Wed Oct 5 03:06:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 05 03:06:59.929480 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ccf8b44c-6312-4523-8aee-a0e813ab5e37 req-b477eabd-400b-4d20-80e2-de1dce805b06 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:06:59.930246 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ccf8b44c-6312-4523-8aee-a0e813ab5e37 req-b477eabd-400b-4d20-80e2-de1dce805b06 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:06:59.930873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ccf8b44c-6312-4523-8aee-a0e813ab5e37 req-b477eabd-400b-4d20-80e2-de1dce805b06 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:06:59.951362 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-ccf8b44c-6312-4523-8aee-a0e813ab5e37 req-b477eabd-400b-4d20-80e2-de1dce805b06 service nova] Creating event network-vif-deleted:7b878a19-3085-4472-97f6-453e6e753a7e for instance 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 on n-h1-858272-3 Oct 05 03:06:59.957174 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-ccf8b44c-6312-4523-8aee-a0e813ab5e37 req-b477eabd-400b-4d20-80e2-de1dce805b06 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093692 Oct 05 03:06:59.958637 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3135/6252] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:07:00.054310 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e271fc63-665b-4397-aae2-4b5fe13c93dd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:07:00.058161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e271fc63-665b-4397-aae2-4b5fe13c93dd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:07:00.078932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e271fc63-665b-4397-aae2-4b5fe13c93dd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:00.079831 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e271fc63-665b-4397-aae2-4b5fe13c93dd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:00.081823 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e271fc63-665b-4397-aae2-4b5fe13c93dd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:00.083401 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e271fc63-665b-4397-aae2-4b5fe13c93dd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:00.084573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e271fc63-665b-4397-aae2-4b5fe13c93dd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:00.086044 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e271fc63-665b-4397-aae2-4b5fe13c93dd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:00.178864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e271fc63-665b-4397-aae2-4b5fe13c93dd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:00.179375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e271fc63-665b-4397-aae2-4b5fe13c93dd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:00.179832 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e271fc63-665b-4397-aae2-4b5fe13c93dd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:00.180300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-e271fc63-665b-4397-aae2-4b5fe13c93dd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lazy-loading 'fault' on Instance uuid 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:07:00.232550 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cedec77c-bbc4-4a08-a1ac-78c8b2137269 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1602203721", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "9e7a5182-d546-4ee1-8055-2577764b3c19"}], "key_name": "tempest-TestNetworkAdvancedServerOps-230329541", "security_groups": [{"name": "tempest-secgroup-smoke-780293163"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:07:00.269127 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e271fc63-665b-4397-aae2-4b5fe13c93dd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:07:00.287267 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e271fc63-665b-4397-aae2-4b5fe13c93dd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9" status: 200 len: 1331 microversion: 2.1 time: 0.238022 Oct 05 03:07:00.301442 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3118/6253] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:07:00 2022] GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 => generated 1331 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:07:00.411654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-cedec77c-bbc4-4a08-a1ac-78c8b2137269 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] validate_networks() for [('9e7a5182-d546-4ee1-8055-2577764b3c19', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:07:01.076283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-cedec77c-bbc4-4a08-a1ac-78c8b2137269 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:07:01.076962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-cedec77c-bbc4-4a08-a1ac-78c8b2137269 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:07:01.077233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-cedec77c-bbc4-4a08-a1ac-78c8b2137269 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:07:01.077710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-cedec77c-bbc4-4a08-a1ac-78c8b2137269 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:07:01.078140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-cedec77c-bbc4-4a08-a1ac-78c8b2137269 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:07:01.090660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cedec77c-bbc4-4a08-a1ac-78c8b2137269 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:01.091906 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cedec77c-bbc4-4a08-a1ac-78c8b2137269 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:01.092624 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cedec77c-bbc4-4a08-a1ac-78c8b2137269 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:01.093675 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cedec77c-bbc4-4a08-a1ac-78c8b2137269 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:01.094475 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cedec77c-bbc4-4a08-a1ac-78c8b2137269 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:01.095132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cedec77c-bbc4-4a08-a1ac-78c8b2137269 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:01.109127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:07:01.123436 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-cedec77c-bbc4-4a08-a1ac-78c8b2137269 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Getting quotas for project a86e3137c6764eeb948b9c7dab895c34. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:07:01.130697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-cedec77c-bbc4-4a08-a1ac-78c8b2137269 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Getting quotas for user ad3a53da0c764f0a893966aea6505fa7 and project a86e3137c6764eeb948b9c7dab895c34. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:07:01.155184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cedec77c-bbc4-4a08-a1ac-78c8b2137269 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:07:01.158483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cedec77c-bbc4-4a08-a1ac-78c8b2137269 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:07:01.225270 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cedec77c-bbc4-4a08-a1ac-78c8b2137269 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.997471 Oct 05 03:07:01.226359 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3136/6254] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:07:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 1000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:07:01.238858 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-506243be-e031-41e6-9ecb-b502f19e7824 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:07:01.240722 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-506243be-e031-41e6-9ecb-b502f19e7824 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:07:01.313019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fac0b665-e9c1-4bfd-83e5-0513b01f7a97 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:07:01.313637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fac0b665-e9c1-4bfd-83e5-0513b01f7a97 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:07:01.324772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fac0b665-e9c1-4bfd-83e5-0513b01f7a97 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:01.326195 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fac0b665-e9c1-4bfd-83e5-0513b01f7a97 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:01.327022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fac0b665-e9c1-4bfd-83e5-0513b01f7a97 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:01.327977 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fac0b665-e9c1-4bfd-83e5-0513b01f7a97 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:01.328654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fac0b665-e9c1-4bfd-83e5-0513b01f7a97 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:01.330396 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fac0b665-e9c1-4bfd-83e5-0513b01f7a97 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:01.349435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-506243be-e031-41e6-9ecb-b502f19e7824 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:07:01.358250 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-506243be-e031-41e6-9ecb-b502f19e7824 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1266 microversion: 2.1 time: 0.123334 Oct 05 03:07:01.364100 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-fac0b665-e9c1-4bfd-83e5-0513b01f7a97 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] HTTP exception thrown: Instance 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 could not be found. Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fac0b665-e9c1-4bfd-83e5-0513b01f7a97 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Request method failure captured: Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 HTTP/1.1 Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPQLbaCJcQoINHOY2GKTbE6oK5DZKXlvS9cTUJZgUsjhzJ11GCBMxKRG2ZW2HydnkNGtZ8u98fUAxnzQFqGG-K-d7yptqwDawf-PQoraVusgo1XYypQQkhEqqbJdJFh02G9QsSpvTDhdtNr6cnzMOTz-5c9_S6hWETgH6FWjUbmuXPI Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 7b99b6a5b1764f64a68793f37d4f9b96 Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 7b99b6a5b1764f64a68793f37d4f9b96 Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-AttachVolumeNegativeTest-2082311660-project Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 881baf1ede7e4fb5acf65268a81241ad Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-AttachVolumeNegativeTest-2082311660-project Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 could not be found. Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9'} Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 could not be found. Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 could not be found. Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:07:01.365789 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:07:01.371806 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:07:01.371806 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:07:01.371806 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:07:01.371806 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:07:01.371806 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:07:01.371806 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 could not be found. Oct 05 03:07:01.371806 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:07:01.377111 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3119/6255] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:07:01 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:07:01.378073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fac0b665-e9c1-4bfd-83e5-0513b01f7a97 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Returning 404 to user: Instance 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:07:01.379010 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fac0b665-e9c1-4bfd-83e5-0513b01f7a97 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9" status: 404 len: 111 microversion: 2.1 time: 0.071049 Oct 05 03:07:01.379504 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3137/6256] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:07:01 2022] GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 03:07:01.394330 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-021e0e82-856b-4ad4-b088-e6ab8af0d08b tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '.version_select at 0x7fccdf72d1f0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:07:01.439192 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-021e0e82-856b-4ad4-b088-e6ab8af0d08b tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-488209073" status: 202 len: 0 microversion: 2.1 time: 0.049340 Oct 05 03:07:01.444524 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3120/6257] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 5 03:07:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-488209073 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:07:02.389389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-214d92b7-0c01-4cd7-aa5a-17876cced150 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:07:02.391971 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-214d92b7-0c01-4cd7-aa5a-17876cced150 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:07:02.404895 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-214d92b7-0c01-4cd7-aa5a-17876cced150 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:02.405869 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-214d92b7-0c01-4cd7-aa5a-17876cced150 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:02.406675 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-214d92b7-0c01-4cd7-aa5a-17876cced150 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:02.407912 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-214d92b7-0c01-4cd7-aa5a-17876cced150 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:02.408077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b95cf8d4-59b7-4a15-9fab-c9807b9e9e49 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Action: 'create', calling method: .version_select at 0x7fcce4182550>, body: {"keypair": {"name": "tempest-keypair-1923160457", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG85ZNXQkFO+CY1P2iwXr2K2PND/KU+HJvy/AHDgMZixaVmrDEL5zye1X4hqpJFJrq/YI09afoUxrmvOkoLpLYZlhGr1JZg16Q1DF7rFdEvywalR/188h6xd4r97upnJ3w=="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:07:02.408852 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-214d92b7-0c01-4cd7-aa5a-17876cced150 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:02.409657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-214d92b7-0c01-4cd7-aa5a-17876cced150 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:02.436525 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-b95cf8d4-59b7-4a15-9fab-c9807b9e9e49 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Getting quotas for project 7b99b6a5b1764f64a68793f37d4f9b96. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:07:02.445098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-b95cf8d4-59b7-4a15-9fab-c9807b9e9e49 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Getting quotas for user 881baf1ede7e4fb5acf65268a81241ad and project 7b99b6a5b1764f64a68793f37d4f9b96. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:07:02.479368 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b95cf8d4-59b7-4a15-9fab-c9807b9e9e49 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.078224 Oct 05 03:07:02.480291 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3121/6258] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 03:07:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:07:02.516946 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-214d92b7-0c01-4cd7-aa5a-17876cced150 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:07:02.526451 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-214d92b7-0c01-4cd7-aa5a-17876cced150 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1318 microversion: 2.1 time: 0.145205 Oct 05 03:07:02.527350 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3138/6259] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:07:02 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:07:03.552367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-49004030-7ddd-4aa9-ac3c-276750885b53 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:07:03.553176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-49004030-7ddd-4aa9-ac3c-276750885b53 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:07:03.565282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49004030-7ddd-4aa9-ac3c-276750885b53 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:03.569334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49004030-7ddd-4aa9-ac3c-276750885b53 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:03.569911 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49004030-7ddd-4aa9-ac3c-276750885b53 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:03.570760 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49004030-7ddd-4aa9-ac3c-276750885b53 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:03.571298 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49004030-7ddd-4aa9-ac3c-276750885b53 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:03.572443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-49004030-7ddd-4aa9-ac3c-276750885b53 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:03.689506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-49004030-7ddd-4aa9-ac3c-276750885b53 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:07:03.699017 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-49004030-7ddd-4aa9-ac3c-276750885b53 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1324 microversion: 2.1 time: 0.151797 Oct 05 03:07:03.703179 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3122/6260] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:07:03 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1324 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:07:04.516851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-207d4174-92c9-4c5e-aab0-7eb6fa614189 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1787436345", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dbc27df4-8913-4a58-8837-a72d1d361dca"}], "security_groups": [{"name": "tempest-securitygroup--1440373154"}], "key_name": "tempest-keypair-1923160457", "user_data": "}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:07:04.730008 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-207d4174-92c9-4c5e-aab0-7eb6fa614189 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] validate_networks() for [('dbc27df4-8913-4a58-8837-a72d1d361dca', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:07:04.730863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0d5fc9c6-b6c0-4cd7-9075-b0d441f1e04c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:07:04.731494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0d5fc9c6-b6c0-4cd7-9075-b0d441f1e04c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:07:04.741244 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d5fc9c6-b6c0-4cd7-9075-b0d441f1e04c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:04.742094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d5fc9c6-b6c0-4cd7-9075-b0d441f1e04c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:04.742879 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d5fc9c6-b6c0-4cd7-9075-b0d441f1e04c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:04.744430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d5fc9c6-b6c0-4cd7-9075-b0d441f1e04c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:04.745464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d5fc9c6-b6c0-4cd7-9075-b0d441f1e04c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:04.746582 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d5fc9c6-b6c0-4cd7-9075-b0d441f1e04c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:05.084351 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0d5fc9c6-b6c0-4cd7-9075-b0d441f1e04c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:07:05.092966 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0d5fc9c6-b6c0-4cd7-9075-b0d441f1e04c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1391 microversion: 2.1 time: 0.368643 Oct 05 03:07:05.093546 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3123/6261] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:07:04 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1391 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:07:05.168278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-6a502649-34f9-4692-9000-2664b7f34647 req-aa2aa674-22d4-4249-b267-c843d5e998e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed", "tag": "66189cc2-bc2e-49ce-91a4-6d9acf4efc4e"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:07:05.177809 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-6a502649-34f9-4692-9000-2664b7f34647 req-aa2aa674-22d4-4249-b267-c843d5e998e7 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:05.178289 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-6a502649-34f9-4692-9000-2664b7f34647 req-aa2aa674-22d4-4249-b267-c843d5e998e7 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:05.178713 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-6a502649-34f9-4692-9000-2664b7f34647 req-aa2aa674-22d4-4249-b267-c843d5e998e7 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:05.194080 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-6a502649-34f9-4692-9000-2664b7f34647 req-aa2aa674-22d4-4249-b267-c843d5e998e7 service nova] Creating event network-changed:66189cc2-bc2e-49ce-91a4-6d9acf4efc4e for instance a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed on n-h2-858272-3 Oct 05 03:07:05.201181 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-6a502649-34f9-4692-9000-2664b7f34647 req-aa2aa674-22d4-4249-b267-c843d5e998e7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038279 Oct 05 03:07:05.201797 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3124/6262] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:07:05.528764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-207d4174-92c9-4c5e-aab0-7eb6fa614189 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:07:05.529380 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-207d4174-92c9-4c5e-aab0-7eb6fa614189 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:07:05.530169 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-207d4174-92c9-4c5e-aab0-7eb6fa614189 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:07:05.530620 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-207d4174-92c9-4c5e-aab0-7eb6fa614189 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:07:05.531040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-207d4174-92c9-4c5e-aab0-7eb6fa614189 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:07:05.542145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-207d4174-92c9-4c5e-aab0-7eb6fa614189 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:05.542564 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-207d4174-92c9-4c5e-aab0-7eb6fa614189 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:05.543191 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-207d4174-92c9-4c5e-aab0-7eb6fa614189 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:05.543943 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-207d4174-92c9-4c5e-aab0-7eb6fa614189 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:05.544405 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-207d4174-92c9-4c5e-aab0-7eb6fa614189 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:05.544842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-207d4174-92c9-4c5e-aab0-7eb6fa614189 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:05.566345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-207d4174-92c9-4c5e-aab0-7eb6fa614189 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Getting quotas for project 7b99b6a5b1764f64a68793f37d4f9b96. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:07:05.571502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-207d4174-92c9-4c5e-aab0-7eb6fa614189 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Getting quotas for user 881baf1ede7e4fb5acf65268a81241ad and project 7b99b6a5b1764f64a68793f37d4f9b96. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:07:05.585249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-207d4174-92c9-4c5e-aab0-7eb6fa614189 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:07:05.587442 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-207d4174-92c9-4c5e-aab0-7eb6fa614189 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4e3cdf79-2ab1-4e8f-b132-075fb38000da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:07:05.636527 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-207d4174-92c9-4c5e-aab0-7eb6fa614189 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.124961 Oct 05 03:07:05.637409 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3139/6263] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:07:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:07:05.670696 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-179da671-f27b-4580-a466-8a5fd4bd64f1 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:07:05.672116 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-179da671-f27b-4580-a466-8a5fd4bd64f1 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4e3cdf79-2ab1-4e8f-b132-075fb38000da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:07:05.752840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-179da671-f27b-4580-a466-8a5fd4bd64f1 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:07:05.770239 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-179da671-f27b-4580-a466-8a5fd4bd64f1 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da" status: 200 len: 1242 microversion: 2.1 time: 0.125173 Oct 05 03:07:05.771772 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3125/6264] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:07:05 2022] GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da => generated 1242 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:07:06.121233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-42fb3739-6a06-4578-a292-8bb71a11120b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:07:06.121818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-42fb3739-6a06-4578-a292-8bb71a11120b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:07:06.123759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:07:06.129671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42fb3739-6a06-4578-a292-8bb71a11120b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:06.130161 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42fb3739-6a06-4578-a292-8bb71a11120b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:06.130596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42fb3739-6a06-4578-a292-8bb71a11120b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:06.131290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42fb3739-6a06-4578-a292-8bb71a11120b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:06.131740 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42fb3739-6a06-4578-a292-8bb71a11120b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:06.132162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42fb3739-6a06-4578-a292-8bb71a11120b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:06.273973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-42fb3739-6a06-4578-a292-8bb71a11120b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:07:06.282665 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-42fb3739-6a06-4578-a292-8bb71a11120b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1391 microversion: 2.1 time: 0.165416 Oct 05 03:07:06.283492 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3140/6265] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:07:06 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:07:06.794039 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ed631c44-41fd-4ec7-8804-4a3c294d91a6 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:07:06.794665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ed631c44-41fd-4ec7-8804-4a3c294d91a6 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4e3cdf79-2ab1-4e8f-b132-075fb38000da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:07:06.802347 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed631c44-41fd-4ec7-8804-4a3c294d91a6 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:06.802837 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed631c44-41fd-4ec7-8804-4a3c294d91a6 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:06.803279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed631c44-41fd-4ec7-8804-4a3c294d91a6 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:06.803997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed631c44-41fd-4ec7-8804-4a3c294d91a6 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:06.804452 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed631c44-41fd-4ec7-8804-4a3c294d91a6 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:06.804878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ed631c44-41fd-4ec7-8804-4a3c294d91a6 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:06.866948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ed631c44-41fd-4ec7-8804-4a3c294d91a6 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:07:06.875440 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ed631c44-41fd-4ec7-8804-4a3c294d91a6 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da" status: 200 len: 1246 microversion: 2.1 time: 0.085665 Oct 05 03:07:06.876018 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3126/6266] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:07:06 2022] GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:07:07.311534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bb5c0e61-f10f-4470-985f-4d6a3eb37f4f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:07:07.312185 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bb5c0e61-f10f-4470-985f-4d6a3eb37f4f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:07:07.319113 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bb5c0e61-f10f-4470-985f-4d6a3eb37f4f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:07.319599 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bb5c0e61-f10f-4470-985f-4d6a3eb37f4f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:07.320037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bb5c0e61-f10f-4470-985f-4d6a3eb37f4f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:07.320727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bb5c0e61-f10f-4470-985f-4d6a3eb37f4f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:07.321205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bb5c0e61-f10f-4470-985f-4d6a3eb37f4f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:07.321632 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bb5c0e61-f10f-4470-985f-4d6a3eb37f4f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:07.464619 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bb5c0e61-f10f-4470-985f-4d6a3eb37f4f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:07:07.472443 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bb5c0e61-f10f-4470-985f-4d6a3eb37f4f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1391 microversion: 2.1 time: 0.164865 Oct 05 03:07:07.473040 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3141/6267] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:07:07 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:07:07.898649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c504e7d3-95ad-4122-b6c2-062ff586b4d2 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:07:07.900590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c504e7d3-95ad-4122-b6c2-062ff586b4d2 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4e3cdf79-2ab1-4e8f-b132-075fb38000da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:07:07.908364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c504e7d3-95ad-4122-b6c2-062ff586b4d2 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:07.909631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c504e7d3-95ad-4122-b6c2-062ff586b4d2 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:07.910273 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c504e7d3-95ad-4122-b6c2-062ff586b4d2 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:07.911207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c504e7d3-95ad-4122-b6c2-062ff586b4d2 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:07.911999 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c504e7d3-95ad-4122-b6c2-062ff586b4d2 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:07.913143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c504e7d3-95ad-4122-b6c2-062ff586b4d2 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:08.012579 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c504e7d3-95ad-4122-b6c2-062ff586b4d2 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:07:08.023239 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c504e7d3-95ad-4122-b6c2-062ff586b4d2 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da" status: 200 len: 1294 microversion: 2.1 time: 0.128401 Oct 05 03:07:08.024893 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3127/6268] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:07:07 2022] GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da => generated 1294 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:07:08.497336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c184ff8d-8b85-4d4b-b83c-ad417dfb68f3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:07:08.498826 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c184ff8d-8b85-4d4b-b83c-ad417dfb68f3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:07:08.507176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c184ff8d-8b85-4d4b-b83c-ad417dfb68f3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:08.508060 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c184ff8d-8b85-4d4b-b83c-ad417dfb68f3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:08.508877 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c184ff8d-8b85-4d4b-b83c-ad417dfb68f3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:08.509932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c184ff8d-8b85-4d4b-b83c-ad417dfb68f3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:08.510610 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c184ff8d-8b85-4d4b-b83c-ad417dfb68f3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:08.511187 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c184ff8d-8b85-4d4b-b83c-ad417dfb68f3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:08.734882 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c184ff8d-8b85-4d4b-b83c-ad417dfb68f3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:07:08.745310 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c184ff8d-8b85-4d4b-b83c-ad417dfb68f3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1391 microversion: 2.1 time: 0.252015 Oct 05 03:07:08.757754 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3142/6269] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:07:08 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1391 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:07:09.050060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e7db38a6-b6ae-4191-8af9-3b83ad450baf tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:07:09.050674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e7db38a6-b6ae-4191-8af9-3b83ad450baf tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4e3cdf79-2ab1-4e8f-b132-075fb38000da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:07:09.058614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7db38a6-b6ae-4191-8af9-3b83ad450baf tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:09.059115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7db38a6-b6ae-4191-8af9-3b83ad450baf tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:09.059559 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7db38a6-b6ae-4191-8af9-3b83ad450baf tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:09.060261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7db38a6-b6ae-4191-8af9-3b83ad450baf tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:09.060718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7db38a6-b6ae-4191-8af9-3b83ad450baf tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:09.061373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7db38a6-b6ae-4191-8af9-3b83ad450baf tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:09.141251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e7db38a6-b6ae-4191-8af9-3b83ad450baf tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:07:09.150870 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e7db38a6-b6ae-4191-8af9-3b83ad450baf tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da" status: 200 len: 1300 microversion: 2.1 time: 0.103525 Oct 05 03:07:09.151846 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3128/6270] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:07:09 2022] GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da => generated 1300 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:07:09.772039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1e8040bd-5fb4-439e-8535-e1661deb82d4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:07:09.773745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1e8040bd-5fb4-439e-8535-e1661deb82d4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:07:09.781680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e8040bd-5fb4-439e-8535-e1661deb82d4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:09.782486 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e8040bd-5fb4-439e-8535-e1661deb82d4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:09.783104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e8040bd-5fb4-439e-8535-e1661deb82d4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:09.783809 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e8040bd-5fb4-439e-8535-e1661deb82d4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:09.784434 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e8040bd-5fb4-439e-8535-e1661deb82d4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:09.784867 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1e8040bd-5fb4-439e-8535-e1661deb82d4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:10.014682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1e8040bd-5fb4-439e-8535-e1661deb82d4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:07:10.026214 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1e8040bd-5fb4-439e-8535-e1661deb82d4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1391 microversion: 2.1 time: 0.258530 Oct 05 03:07:10.035506 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3143/6271] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:07:09 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1391 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:07:10.174590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ef6d1802-322a-45a4-a2b9-c16e8df39e96 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:07:10.175202 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ef6d1802-322a-45a4-a2b9-c16e8df39e96 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4e3cdf79-2ab1-4e8f-b132-075fb38000da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:07:10.182664 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ef6d1802-322a-45a4-a2b9-c16e8df39e96 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:10.183153 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ef6d1802-322a-45a4-a2b9-c16e8df39e96 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:10.183648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ef6d1802-322a-45a4-a2b9-c16e8df39e96 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:10.184341 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ef6d1802-322a-45a4-a2b9-c16e8df39e96 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:10.184793 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ef6d1802-322a-45a4-a2b9-c16e8df39e96 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:10.185241 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ef6d1802-322a-45a4-a2b9-c16e8df39e96 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:10.398712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ef6d1802-322a-45a4-a2b9-c16e8df39e96 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:07:10.407734 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ef6d1802-322a-45a4-a2b9-c16e8df39e96 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da" status: 200 len: 1368 microversion: 2.1 time: 0.236922 Oct 05 03:07:10.408655 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3129/6272] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:07:10 2022] GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da => generated 1368 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:07:10.484078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-78041a70-e1de-4e97-a85c-72cf918f2234 req-b45fcf27-cdec-4f7a-a5ae-7604d3e2496b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e3cdf79-2ab1-4e8f-b132-075fb38000da", "tag": "d616f44d-9273-4159-95a1-3938762de913"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:07:10.500628 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-78041a70-e1de-4e97-a85c-72cf918f2234 req-b45fcf27-cdec-4f7a-a5ae-7604d3e2496b service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:10.502864 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-78041a70-e1de-4e97-a85c-72cf918f2234 req-b45fcf27-cdec-4f7a-a5ae-7604d3e2496b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:10.504012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-78041a70-e1de-4e97-a85c-72cf918f2234 req-b45fcf27-cdec-4f7a-a5ae-7604d3e2496b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:10.520531 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-78041a70-e1de-4e97-a85c-72cf918f2234 req-b45fcf27-cdec-4f7a-a5ae-7604d3e2496b service nova] Creating event network-changed:d616f44d-9273-4159-95a1-3938762de913 for instance 4e3cdf79-2ab1-4e8f-b132-075fb38000da on n-h2-858272-3 Oct 05 03:07:10.526294 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-78041a70-e1de-4e97-a85c-72cf918f2234 req-b45fcf27-cdec-4f7a-a5ae-7604d3e2496b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047476 Oct 05 03:07:10.527315 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3144/6273] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:07:10.721420 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-96b8984a-9d6e-47c0-bf03-c4b4fc4bd64f req-f0f5c682-37cc-4b30-9a9f-7b2e3442e36d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed", "name": "network-vif-plugged", "status": "completed", "tag": "66189cc2-bc2e-49ce-91a4-6d9acf4efc4e"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:07:10.737097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-96b8984a-9d6e-47c0-bf03-c4b4fc4bd64f req-f0f5c682-37cc-4b30-9a9f-7b2e3442e36d service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:10.737822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-96b8984a-9d6e-47c0-bf03-c4b4fc4bd64f req-f0f5c682-37cc-4b30-9a9f-7b2e3442e36d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:10.738769 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-96b8984a-9d6e-47c0-bf03-c4b4fc4bd64f req-f0f5c682-37cc-4b30-9a9f-7b2e3442e36d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:10.752503 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-96b8984a-9d6e-47c0-bf03-c4b4fc4bd64f req-f0f5c682-37cc-4b30-9a9f-7b2e3442e36d service nova] Creating event network-vif-plugged:66189cc2-bc2e-49ce-91a4-6d9acf4efc4e for instance a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed on n-h2-858272-3 Oct 05 03:07:10.762144 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-96b8984a-9d6e-47c0-bf03-c4b4fc4bd64f req-f0f5c682-37cc-4b30-9a9f-7b2e3442e36d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048133 Oct 05 03:07:10.763325 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3130/6274] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:07:11.055028 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6213d551-e6a2-4d26-840f-3e00e2c0e892 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:07:11.056285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6213d551-e6a2-4d26-840f-3e00e2c0e892 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:07:11.070966 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6213d551-e6a2-4d26-840f-3e00e2c0e892 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:11.073735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6213d551-e6a2-4d26-840f-3e00e2c0e892 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:11.074467 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6213d551-e6a2-4d26-840f-3e00e2c0e892 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:11.075228 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6213d551-e6a2-4d26-840f-3e00e2c0e892 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:11.075853 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6213d551-e6a2-4d26-840f-3e00e2c0e892 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:11.076300 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6213d551-e6a2-4d26-840f-3e00e2c0e892 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:11.223350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6213d551-e6a2-4d26-840f-3e00e2c0e892 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:07:11.231266 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6213d551-e6a2-4d26-840f-3e00e2c0e892 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1391 microversion: 2.1 time: 0.184279 Oct 05 03:07:11.231846 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3145/6275] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:07:11 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1391 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:07:11.430418 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-03ead398-291e-4da2-a39a-11c1b8f80b87 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:07:11.431588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-03ead398-291e-4da2-a39a-11c1b8f80b87 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4e3cdf79-2ab1-4e8f-b132-075fb38000da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:07:11.435107 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:07:11.440707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03ead398-291e-4da2-a39a-11c1b8f80b87 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:11.441226 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03ead398-291e-4da2-a39a-11c1b8f80b87 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:11.441671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03ead398-291e-4da2-a39a-11c1b8f80b87 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:11.442369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03ead398-291e-4da2-a39a-11c1b8f80b87 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:11.442827 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03ead398-291e-4da2-a39a-11c1b8f80b87 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:11.443257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-03ead398-291e-4da2-a39a-11c1b8f80b87 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:11.581442 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-03ead398-291e-4da2-a39a-11c1b8f80b87 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:07:11.589323 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-03ead398-291e-4da2-a39a-11c1b8f80b87 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da" status: 200 len: 1368 microversion: 2.1 time: 0.163161 Oct 05 03:07:11.589935 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3131/6276] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:07:11 2022] GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:07:12.255313 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-75868c55-b41b-43c5-aa5b-4ecf8e454c66 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:07:12.255953 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-75868c55-b41b-43c5-aa5b-4ecf8e454c66 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:07:12.262710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75868c55-b41b-43c5-aa5b-4ecf8e454c66 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:12.263192 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75868c55-b41b-43c5-aa5b-4ecf8e454c66 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:12.263621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75868c55-b41b-43c5-aa5b-4ecf8e454c66 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:12.264307 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75868c55-b41b-43c5-aa5b-4ecf8e454c66 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:12.264758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75868c55-b41b-43c5-aa5b-4ecf8e454c66 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:12.265204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75868c55-b41b-43c5-aa5b-4ecf8e454c66 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:12.414791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-75868c55-b41b-43c5-aa5b-4ecf8e454c66 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:07:12.423875 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-75868c55-b41b-43c5-aa5b-4ecf8e454c66 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1391 microversion: 2.1 time: 0.172393 Oct 05 03:07:12.424651 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3146/6277] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:07:12 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:07:12.611928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-354e4bef-8a64-47b8-97ae-21795eeda659 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:07:12.612537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-354e4bef-8a64-47b8-97ae-21795eeda659 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4e3cdf79-2ab1-4e8f-b132-075fb38000da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:07:12.620043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-354e4bef-8a64-47b8-97ae-21795eeda659 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:12.620530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-354e4bef-8a64-47b8-97ae-21795eeda659 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:12.620989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-354e4bef-8a64-47b8-97ae-21795eeda659 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:12.621670 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-354e4bef-8a64-47b8-97ae-21795eeda659 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:12.622120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-354e4bef-8a64-47b8-97ae-21795eeda659 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:12.622538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-354e4bef-8a64-47b8-97ae-21795eeda659 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:12.758065 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-354e4bef-8a64-47b8-97ae-21795eeda659 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:07:12.766065 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-354e4bef-8a64-47b8-97ae-21795eeda659 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da" status: 200 len: 1368 microversion: 2.1 time: 0.158402 Oct 05 03:07:12.766907 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3132/6278] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:07:12 2022] GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:07:13.449369 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-46c405ea-41a3-41bd-9b0a-5d046e28559b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:07:13.450055 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-46c405ea-41a3-41bd-9b0a-5d046e28559b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:07:13.456677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46c405ea-41a3-41bd-9b0a-5d046e28559b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:13.457264 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46c405ea-41a3-41bd-9b0a-5d046e28559b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:13.457770 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46c405ea-41a3-41bd-9b0a-5d046e28559b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:13.458532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46c405ea-41a3-41bd-9b0a-5d046e28559b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:13.458982 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46c405ea-41a3-41bd-9b0a-5d046e28559b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:13.459404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46c405ea-41a3-41bd-9b0a-5d046e28559b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:13.590465 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-46c405ea-41a3-41bd-9b0a-5d046e28559b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:07:13.598388 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-46c405ea-41a3-41bd-9b0a-5d046e28559b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1391 microversion: 2.1 time: 0.153627 Oct 05 03:07:13.598964 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3147/6279] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:07:13 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:07:13.791703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7f2b4055-4dbc-4e9f-9962-182bbedf4775 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:07:13.792414 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7f2b4055-4dbc-4e9f-9962-182bbedf4775 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4e3cdf79-2ab1-4e8f-b132-075fb38000da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:07:13.799890 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f2b4055-4dbc-4e9f-9962-182bbedf4775 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:13.800482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f2b4055-4dbc-4e9f-9962-182bbedf4775 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:13.801026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f2b4055-4dbc-4e9f-9962-182bbedf4775 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:13.801961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f2b4055-4dbc-4e9f-9962-182bbedf4775 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:13.802494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f2b4055-4dbc-4e9f-9962-182bbedf4775 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:13.803002 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7f2b4055-4dbc-4e9f-9962-182bbedf4775 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:14.000655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7f2b4055-4dbc-4e9f-9962-182bbedf4775 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:07:14.008418 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7f2b4055-4dbc-4e9f-9962-182bbedf4775 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da" status: 200 len: 1368 microversion: 2.1 time: 0.221638 Oct 05 03:07:14.009580 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3133/6280] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:07:13 2022] GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da => generated 1368 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:07:14.623584 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1ea7bb82-054d-4671-bb2a-e07c6aa84095 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:07:14.624229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1ea7bb82-054d-4671-bb2a-e07c6aa84095 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:07:14.631798 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ea7bb82-054d-4671-bb2a-e07c6aa84095 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:14.632742 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ea7bb82-054d-4671-bb2a-e07c6aa84095 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:14.633217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ea7bb82-054d-4671-bb2a-e07c6aa84095 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:14.635127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ea7bb82-054d-4671-bb2a-e07c6aa84095 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:14.635588 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ea7bb82-054d-4671-bb2a-e07c6aa84095 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:14.636016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ea7bb82-054d-4671-bb2a-e07c6aa84095 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:14.794407 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1ea7bb82-054d-4671-bb2a-e07c6aa84095 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:07:14.802533 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1ea7bb82-054d-4671-bb2a-e07c6aa84095 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1563 microversion: 2.1 time: 0.184405 Oct 05 03:07:14.803119 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3148/6281] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:07:14 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1563 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:07:14.826633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b8eb760f-e207-4755-a9fc-df06a402248c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:07:14.827261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b8eb760f-e207-4755-a9fc-df06a402248c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:07:14.834292 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8eb760f-e207-4755-a9fc-df06a402248c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:14.834786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8eb760f-e207-4755-a9fc-df06a402248c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:14.835230 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8eb760f-e207-4755-a9fc-df06a402248c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:14.835929 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8eb760f-e207-4755-a9fc-df06a402248c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:14.836421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8eb760f-e207-4755-a9fc-df06a402248c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:14.836849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8eb760f-e207-4755-a9fc-df06a402248c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:14.969363 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b8eb760f-e207-4755-a9fc-df06a402248c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:07:14.978527 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b8eb760f-e207-4755-a9fc-df06a402248c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1563 microversion: 2.1 time: 0.155885 Oct 05 03:07:14.979352 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3134/6282] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:07:14 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:07:15.032053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9954d96e-122e-4e33-8ef1-4b4cfc9fb639 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:07:15.032700 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9954d96e-122e-4e33-8ef1-4b4cfc9fb639 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4e3cdf79-2ab1-4e8f-b132-075fb38000da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:07:15.038790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9954d96e-122e-4e33-8ef1-4b4cfc9fb639 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:15.039294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9954d96e-122e-4e33-8ef1-4b4cfc9fb639 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:15.039852 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9954d96e-122e-4e33-8ef1-4b4cfc9fb639 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:15.040482 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9954d96e-122e-4e33-8ef1-4b4cfc9fb639 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:15.041642 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9954d96e-122e-4e33-8ef1-4b4cfc9fb639 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:15.042084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9954d96e-122e-4e33-8ef1-4b4cfc9fb639 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:15.316320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9954d96e-122e-4e33-8ef1-4b4cfc9fb639 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:07:15.325307 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9954d96e-122e-4e33-8ef1-4b4cfc9fb639 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da" status: 200 len: 1368 microversion: 2.1 time: 0.297173 Oct 05 03:07:15.325982 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3149/6283] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:07:15 2022] GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da => generated 1368 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:07:16.349924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dcf5e7e1-72a4-48a2-a214-1fb112e2acb1 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:07:16.350551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dcf5e7e1-72a4-48a2-a214-1fb112e2acb1 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4e3cdf79-2ab1-4e8f-b132-075fb38000da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:07:16.353768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=8 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:07:16.359570 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dcf5e7e1-72a4-48a2-a214-1fb112e2acb1 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:16.360069 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dcf5e7e1-72a4-48a2-a214-1fb112e2acb1 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:16.360514 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dcf5e7e1-72a4-48a2-a214-1fb112e2acb1 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:16.361255 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dcf5e7e1-72a4-48a2-a214-1fb112e2acb1 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:16.361746 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dcf5e7e1-72a4-48a2-a214-1fb112e2acb1 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:16.362175 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dcf5e7e1-72a4-48a2-a214-1fb112e2acb1 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:16.746276 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-088bb9e1-1c90-45cf-9671-036f42ae05bd req-f0c58496-768a-40da-9e22-1c94209f4039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e3cdf79-2ab1-4e8f-b132-075fb38000da", "name": "network-vif-plugged", "status": "completed", "tag": "d616f44d-9273-4159-95a1-3938762de913"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:07:16.786560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=4 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:07:16.787945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=16 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:07:16.797913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-088bb9e1-1c90-45cf-9671-036f42ae05bd req-f0c58496-768a-40da-9e22-1c94209f4039 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:16.798695 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-088bb9e1-1c90-45cf-9671-036f42ae05bd req-f0c58496-768a-40da-9e22-1c94209f4039 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:16.799313 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-088bb9e1-1c90-45cf-9671-036f42ae05bd req-f0c58496-768a-40da-9e22-1c94209f4039 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:16.823335 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-088bb9e1-1c90-45cf-9671-036f42ae05bd req-f0c58496-768a-40da-9e22-1c94209f4039 service nova] Creating event network-vif-plugged:d616f44d-9273-4159-95a1-3938762de913 for instance 4e3cdf79-2ab1-4e8f-b132-075fb38000da on n-h2-858272-3 Oct 05 03:07:16.829032 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-088bb9e1-1c90-45cf-9671-036f42ae05bd req-f0c58496-768a-40da-9e22-1c94209f4039 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089870 Oct 05 03:07:16.829907 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3150/6284] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:07:16.860286 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dcf5e7e1-72a4-48a2-a214-1fb112e2acb1 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:07:16.869711 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dcf5e7e1-72a4-48a2-a214-1fb112e2acb1 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da" status: 200 len: 1368 microversion: 2.1 time: 0.523480 Oct 05 03:07:16.870578 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3135/6285] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:07:16 2022] GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da => generated 1368 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:07:17.171272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-04d59a07-1335-4b68-8ea2-3f73a9f40473 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:07:17.177006 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-abbd8bff-0808-4d6f-a8a5-e12b44cdc202 req-0e85b065-4354-440e-8161-9fd79403e4c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed", "tag": "66189cc2-bc2e-49ce-91a4-6d9acf4efc4e"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:07:17.182010 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-04d59a07-1335-4b68-8ea2-3f73a9f40473 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:07:17.190647 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-04d59a07-1335-4b68-8ea2-3f73a9f40473 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:17.193383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-04d59a07-1335-4b68-8ea2-3f73a9f40473 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:17.194931 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-abbd8bff-0808-4d6f-a8a5-e12b44cdc202 req-0e85b065-4354-440e-8161-9fd79403e4c1 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:17.195467 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-04d59a07-1335-4b68-8ea2-3f73a9f40473 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:17.196263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-04d59a07-1335-4b68-8ea2-3f73a9f40473 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:17.197047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-abbd8bff-0808-4d6f-a8a5-e12b44cdc202 req-0e85b065-4354-440e-8161-9fd79403e4c1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:17.197616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-04d59a07-1335-4b68-8ea2-3f73a9f40473 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:17.198320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-04d59a07-1335-4b68-8ea2-3f73a9f40473 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:17.198851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-abbd8bff-0808-4d6f-a8a5-e12b44cdc202 req-0e85b065-4354-440e-8161-9fd79403e4c1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:17.219151 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-abbd8bff-0808-4d6f-a8a5-e12b44cdc202 req-0e85b065-4354-440e-8161-9fd79403e4c1 service nova] Creating event network-changed:66189cc2-bc2e-49ce-91a4-6d9acf4efc4e for instance a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed on n-h2-858272-3 Oct 05 03:07:17.224806 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-abbd8bff-0808-4d6f-a8a5-e12b44cdc202 req-0e85b065-4354-440e-8161-9fd79403e4c1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051291 Oct 05 03:07:17.226054 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3136/6286] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:07:17.378211 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-04d59a07-1335-4b68-8ea2-3f73a9f40473 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:07:17.387599 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-04d59a07-1335-4b68-8ea2-3f73a9f40473 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1563 microversion: 2.1 time: 0.220366 Oct 05 03:07:17.391818 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3151/6287] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:07:17 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1563 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:07:17.896618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-add56dd1-4e27-4504-84cd-8b62b16e3048 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:07:17.897342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-add56dd1-4e27-4504-84cd-8b62b16e3048 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4e3cdf79-2ab1-4e8f-b132-075fb38000da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:07:17.904332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-add56dd1-4e27-4504-84cd-8b62b16e3048 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:17.904826 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-add56dd1-4e27-4504-84cd-8b62b16e3048 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:17.905286 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-add56dd1-4e27-4504-84cd-8b62b16e3048 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:17.905985 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-add56dd1-4e27-4504-84cd-8b62b16e3048 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:17.906439 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-add56dd1-4e27-4504-84cd-8b62b16e3048 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:17.906859 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-add56dd1-4e27-4504-84cd-8b62b16e3048 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:18.138543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-add56dd1-4e27-4504-84cd-8b62b16e3048 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:07:18.150243 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-add56dd1-4e27-4504-84cd-8b62b16e3048 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da" status: 200 len: 1368 microversion: 2.1 time: 0.256684 Oct 05 03:07:18.153738 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3137/6288] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:07:17 2022] GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da => generated 1368 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:07:19.177818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-70611e79-7a4a-4cb2-a5b2-f95221c62247 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:07:19.178446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-70611e79-7a4a-4cb2-a5b2-f95221c62247 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4e3cdf79-2ab1-4e8f-b132-075fb38000da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:07:19.185255 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-70611e79-7a4a-4cb2-a5b2-f95221c62247 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:19.185755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-70611e79-7a4a-4cb2-a5b2-f95221c62247 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:19.186206 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-70611e79-7a4a-4cb2-a5b2-f95221c62247 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:19.186917 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-70611e79-7a4a-4cb2-a5b2-f95221c62247 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:19.187378 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-70611e79-7a4a-4cb2-a5b2-f95221c62247 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:19.188062 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-70611e79-7a4a-4cb2-a5b2-f95221c62247 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:19.330477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-70611e79-7a4a-4cb2-a5b2-f95221c62247 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:07:19.339222 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-70611e79-7a4a-4cb2-a5b2-f95221c62247 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da" status: 200 len: 1558 microversion: 2.1 time: 0.165427 Oct 05 03:07:19.340028 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3152/6289] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:07:19 2022] GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:07:19.367119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f5543ab4-d1fb-4fab-b7ac-21eb951ff5b2 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:07:19.367622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f5543ab4-d1fb-4fab-b7ac-21eb951ff5b2 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4e3cdf79-2ab1-4e8f-b132-075fb38000da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:07:19.374246 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5543ab4-d1fb-4fab-b7ac-21eb951ff5b2 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:19.374738 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5543ab4-d1fb-4fab-b7ac-21eb951ff5b2 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:19.375188 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5543ab4-d1fb-4fab-b7ac-21eb951ff5b2 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:19.375883 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5543ab4-d1fb-4fab-b7ac-21eb951ff5b2 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:19.376343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5543ab4-d1fb-4fab-b7ac-21eb951ff5b2 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:19.376775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5543ab4-d1fb-4fab-b7ac-21eb951ff5b2 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:19.380517 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:07:19.454967 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f5543ab4-d1fb-4fab-b7ac-21eb951ff5b2 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091696 Oct 05 03:07:19.455690 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3138/6290] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 03:07:19 2022] GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:07:20.769336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-0737466c-0e87-4f4f-b3a6-3f970a9e0a1a req-5752f95c-d7cd-474e-afce-0a9cfb67a0f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e3cdf79-2ab1-4e8f-b132-075fb38000da", "tag": "d616f44d-9273-4159-95a1-3938762de913"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:07:20.781940 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-0737466c-0e87-4f4f-b3a6-3f970a9e0a1a req-5752f95c-d7cd-474e-afce-0a9cfb67a0f7 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:20.782428 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-0737466c-0e87-4f4f-b3a6-3f970a9e0a1a req-5752f95c-d7cd-474e-afce-0a9cfb67a0f7 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:20.782996 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-0737466c-0e87-4f4f-b3a6-3f970a9e0a1a req-5752f95c-d7cd-474e-afce-0a9cfb67a0f7 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:20.794917 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-0737466c-0e87-4f4f-b3a6-3f970a9e0a1a req-5752f95c-d7cd-474e-afce-0a9cfb67a0f7 service nova] Creating event network-changed:d616f44d-9273-4159-95a1-3938762de913 for instance 4e3cdf79-2ab1-4e8f-b132-075fb38000da on n-h2-858272-3 Oct 05 03:07:20.799895 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-0737466c-0e87-4f4f-b3a6-3f970a9e0a1a req-5752f95c-d7cd-474e-afce-0a9cfb67a0f7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034630 Oct 05 03:07:20.801985 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3153/6291] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:07:50.686644 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=15 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:07:50.687630 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:07:50.703523 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e9b14108-2902-48a7-9ff7-5decb52b0044 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:07:50.705969 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e9b14108-2902-48a7-9ff7-5decb52b0044 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:07:50.724073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e9b14108-2902-48a7-9ff7-5decb52b0044 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:50.724560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e9b14108-2902-48a7-9ff7-5decb52b0044 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:50.725023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e9b14108-2902-48a7-9ff7-5decb52b0044 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:50.725720 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e9b14108-2902-48a7-9ff7-5decb52b0044 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:50.726167 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e9b14108-2902-48a7-9ff7-5decb52b0044 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:50.726590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e9b14108-2902-48a7-9ff7-5decb52b0044 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:50.800115 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e9b14108-2902-48a7-9ff7-5decb52b0044 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "POST /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed/action" status: 200 len: 24573 microversion: 2.1 time: 0.115081 Oct 05 03:07:50.801342 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3139/6292] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:07:50 2022] POST /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed/action => generated 24573 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 03:07:56.048428 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0ff76539-2bdf-4516-aba2-b439d9001902 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1731584425", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "332fe0cb-2499-4ea2-8a0b-2e60e11dfa97"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1285308353", "security_groups": []}, "os:scheduler_hints": {"different_host": ["f4cd4aa7-8674-456c-a4a3-7750478f5cb9"]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:07:56.083665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=27 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:07:56.084564 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=83 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:07:56.135740 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-0ff76539-2bdf-4516-aba2-b439d9001902 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] validate_networks() for [('332fe0cb-2499-4ea2-8a0b-2e60e11dfa97', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:07:56.710027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0ff76539-2bdf-4516-aba2-b439d9001902 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:07:56.710460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0ff76539-2bdf-4516-aba2-b439d9001902 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:07:56.710938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0ff76539-2bdf-4516-aba2-b439d9001902 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:07:56.711489 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0ff76539-2bdf-4516-aba2-b439d9001902 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:07:56.711911 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0ff76539-2bdf-4516-aba2-b439d9001902 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:07:56.727278 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ff76539-2bdf-4516-aba2-b439d9001902 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:56.727782 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ff76539-2bdf-4516-aba2-b439d9001902 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:56.728235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ff76539-2bdf-4516-aba2-b439d9001902 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:56.729868 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ff76539-2bdf-4516-aba2-b439d9001902 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:56.733733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ff76539-2bdf-4516-aba2-b439d9001902 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:56.734452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ff76539-2bdf-4516-aba2-b439d9001902 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:56.759524 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-0ff76539-2bdf-4516-aba2-b439d9001902 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Getting quotas for project 68101269cd8447ec89411b4eab950d51. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:07:56.766674 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-0ff76539-2bdf-4516-aba2-b439d9001902 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Getting quotas for user ac015152532a44609827594179c68aa8 and project 68101269cd8447ec89411b4eab950d51. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:07:56.782676 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0ff76539-2bdf-4516-aba2-b439d9001902 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:07:56.798362 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0ff76539-2bdf-4516-aba2-b439d9001902 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: 79193c93-2cc6-4327-893e-29edaa84d594] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:07:56.866399 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0ff76539-2bdf-4516-aba2-b439d9001902 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.822909 Oct 05 03:07:56.867634 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3154/6293] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:07:56 2022] POST /compute/v2.1/servers => generated 361 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:07:56.893014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4d18850a-2187-43dc-a26a-0b3c435afaea tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:07:56.900228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4d18850a-2187-43dc-a26a-0b3c435afaea tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: 79193c93-2cc6-4327-893e-29edaa84d594] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:07:57.015215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4d18850a-2187-43dc-a26a-0b3c435afaea tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac015152532a44609827594179c68aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68101269cd8447ec89411b4eab950d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:07:57.025384 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4d18850a-2187-43dc-a26a-0b3c435afaea tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594" status: 200 len: 1242 microversion: 2.1 time: 0.148085 Oct 05 03:07:57.030490 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3140/6294] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:07:56 2022] GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594 => generated 1242 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:07:58.058624 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-82291edb-4634-48db-beea-25e418b46913 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:07:58.059236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-82291edb-4634-48db-beea-25e418b46913 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: 79193c93-2cc6-4327-893e-29edaa84d594] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:07:58.065946 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-82291edb-4634-48db-beea-25e418b46913 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:58.066440 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-82291edb-4634-48db-beea-25e418b46913 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:58.066893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-82291edb-4634-48db-beea-25e418b46913 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:58.067606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-82291edb-4634-48db-beea-25e418b46913 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:58.068065 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-82291edb-4634-48db-beea-25e418b46913 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:58.068679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-82291edb-4634-48db-beea-25e418b46913 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:58.133293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-82291edb-4634-48db-beea-25e418b46913 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac015152532a44609827594179c68aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68101269cd8447ec89411b4eab950d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:07:58.141906 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-82291edb-4634-48db-beea-25e418b46913 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594" status: 200 len: 1294 microversion: 2.1 time: 0.089158 Oct 05 03:07:58.142735 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3155/6295] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:07:58 2022] GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594 => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:07:59.165585 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-be083be7-bb82-4a4b-a2e7-912b2507cdfd tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:07:59.166195 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-be083be7-bb82-4a4b-a2e7-912b2507cdfd tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: 79193c93-2cc6-4327-893e-29edaa84d594] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:07:59.181574 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be083be7-bb82-4a4b-a2e7-912b2507cdfd tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:59.183923 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be083be7-bb82-4a4b-a2e7-912b2507cdfd tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:59.184643 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be083be7-bb82-4a4b-a2e7-912b2507cdfd tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:59.185420 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be083be7-bb82-4a4b-a2e7-912b2507cdfd tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:07:59.189612 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be083be7-bb82-4a4b-a2e7-912b2507cdfd tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:07:59.190256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be083be7-bb82-4a4b-a2e7-912b2507cdfd tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:07:59.427925 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-be083be7-bb82-4a4b-a2e7-912b2507cdfd tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac015152532a44609827594179c68aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68101269cd8447ec89411b4eab950d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:07:59.440932 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-be083be7-bb82-4a4b-a2e7-912b2507cdfd tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594" status: 200 len: 1300 microversion: 2.1 time: 0.280047 Oct 05 03:07:59.444467 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3141/6296] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:07:59 2022] GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594 => generated 1300 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:00.094359 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-f7dd1269-1b77-489a-85bb-09b49437e449 req-564767d6-bf9b-49ba-bc82-4d6801a00ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79193c93-2cc6-4327-893e-29edaa84d594", "tag": "69003acd-ac55-4331-aa5d-5ab3d649e98e"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:08:00.108809 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f7dd1269-1b77-489a-85bb-09b49437e449 req-564767d6-bf9b-49ba-bc82-4d6801a00ff4 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:00.109429 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f7dd1269-1b77-489a-85bb-09b49437e449 req-564767d6-bf9b-49ba-bc82-4d6801a00ff4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:00.109926 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f7dd1269-1b77-489a-85bb-09b49437e449 req-564767d6-bf9b-49ba-bc82-4d6801a00ff4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:00.123082 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-f7dd1269-1b77-489a-85bb-09b49437e449 req-564767d6-bf9b-49ba-bc82-4d6801a00ff4 service nova] Creating event network-changed:69003acd-ac55-4331-aa5d-5ab3d649e98e for instance 79193c93-2cc6-4327-893e-29edaa84d594 on n-h2-858272-3 Oct 05 03:08:00.129447 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-f7dd1269-1b77-489a-85bb-09b49437e449 req-564767d6-bf9b-49ba-bc82-4d6801a00ff4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040800 Oct 05 03:08:00.130815 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3156/6297] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:08:00.472503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4af17d71-7402-4f18-9f58-f550504cdbbd tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:00.473260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4af17d71-7402-4f18-9f58-f550504cdbbd tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: 79193c93-2cc6-4327-893e-29edaa84d594] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:00.481270 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4af17d71-7402-4f18-9f58-f550504cdbbd tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:00.481854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4af17d71-7402-4f18-9f58-f550504cdbbd tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:00.482365 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4af17d71-7402-4f18-9f58-f550504cdbbd tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:00.483154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4af17d71-7402-4f18-9f58-f550504cdbbd tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:00.483682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4af17d71-7402-4f18-9f58-f550504cdbbd tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:00.484175 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4af17d71-7402-4f18-9f58-f550504cdbbd tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:00.578441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4af17d71-7402-4f18-9f58-f550504cdbbd tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac015152532a44609827594179c68aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68101269cd8447ec89411b4eab950d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:00.587366 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4af17d71-7402-4f18-9f58-f550504cdbbd tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594" status: 200 len: 1300 microversion: 2.1 time: 0.120526 Oct 05 03:08:00.587946 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3142/6298] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:00 2022] GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594 => generated 1300 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:08:01.613503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bed248e5-6fd0-4c6a-873e-e5d501c9737d tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:01.614296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bed248e5-6fd0-4c6a-873e-e5d501c9737d tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: 79193c93-2cc6-4327-893e-29edaa84d594] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:01.622339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bed248e5-6fd0-4c6a-873e-e5d501c9737d tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:01.622836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bed248e5-6fd0-4c6a-873e-e5d501c9737d tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:01.623282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bed248e5-6fd0-4c6a-873e-e5d501c9737d tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:01.623986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bed248e5-6fd0-4c6a-873e-e5d501c9737d tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:01.624453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bed248e5-6fd0-4c6a-873e-e5d501c9737d tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:01.624887 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bed248e5-6fd0-4c6a-873e-e5d501c9737d tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:01.713653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bed248e5-6fd0-4c6a-873e-e5d501c9737d tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac015152532a44609827594179c68aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68101269cd8447ec89411b4eab950d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:01.721528 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bed248e5-6fd0-4c6a-873e-e5d501c9737d tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594" status: 200 len: 1300 microversion: 2.1 time: 0.112458 Oct 05 03:08:01.722112 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3157/6299] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:01 2022] GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594 => generated 1300 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:02.746058 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1c2a647f-be01-4cef-8419-9534e39b5dab tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:02.746672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1c2a647f-be01-4cef-8419-9534e39b5dab tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: 79193c93-2cc6-4327-893e-29edaa84d594] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:02.753638 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c2a647f-be01-4cef-8419-9534e39b5dab tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:02.754121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c2a647f-be01-4cef-8419-9534e39b5dab tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:02.754562 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c2a647f-be01-4cef-8419-9534e39b5dab tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:02.755248 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c2a647f-be01-4cef-8419-9534e39b5dab tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:02.755704 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c2a647f-be01-4cef-8419-9534e39b5dab tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:02.756125 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c2a647f-be01-4cef-8419-9534e39b5dab tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:02.872863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1c2a647f-be01-4cef-8419-9534e39b5dab tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac015152532a44609827594179c68aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68101269cd8447ec89411b4eab950d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:02.880993 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1c2a647f-be01-4cef-8419-9534e39b5dab tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594" status: 200 len: 1300 microversion: 2.1 time: 0.139362 Oct 05 03:08:02.881586 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3143/6300] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:02 2022] GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594 => generated 1300 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:03.906149 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-68876596-5c62-4118-b89e-2245665f87ad tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:03.906940 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-68876596-5c62-4118-b89e-2245665f87ad tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: 79193c93-2cc6-4327-893e-29edaa84d594] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:03.913801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68876596-5c62-4118-b89e-2245665f87ad tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:03.914288 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68876596-5c62-4118-b89e-2245665f87ad tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:03.914732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68876596-5c62-4118-b89e-2245665f87ad tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:03.915426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68876596-5c62-4118-b89e-2245665f87ad tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:03.915883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68876596-5c62-4118-b89e-2245665f87ad tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:03.916879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68876596-5c62-4118-b89e-2245665f87ad tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:03.998377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-68876596-5c62-4118-b89e-2245665f87ad tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac015152532a44609827594179c68aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68101269cd8447ec89411b4eab950d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:04.006384 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-68876596-5c62-4118-b89e-2245665f87ad tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594" status: 200 len: 1300 microversion: 2.1 time: 0.104272 Oct 05 03:08:04.017341 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3158/6301] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:03 2022] GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594 => generated 1300 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:05.029969 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cfb8dace-063a-4af6-a206-af8a20123e89 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:05.030583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cfb8dace-063a-4af6-a206-af8a20123e89 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: 79193c93-2cc6-4327-893e-29edaa84d594] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:05.037444 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cfb8dace-063a-4af6-a206-af8a20123e89 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:05.037929 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cfb8dace-063a-4af6-a206-af8a20123e89 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:05.038364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cfb8dace-063a-4af6-a206-af8a20123e89 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:05.039051 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cfb8dace-063a-4af6-a206-af8a20123e89 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:05.039503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cfb8dace-063a-4af6-a206-af8a20123e89 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:05.039925 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cfb8dace-063a-4af6-a206-af8a20123e89 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:05.129146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cfb8dace-063a-4af6-a206-af8a20123e89 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac015152532a44609827594179c68aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68101269cd8447ec89411b4eab950d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:05.137456 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cfb8dace-063a-4af6-a206-af8a20123e89 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594" status: 200 len: 1300 microversion: 2.1 time: 0.111890 Oct 05 03:08:05.138046 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3144/6302] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:05 2022] GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594 => generated 1300 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:06.160481 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c8964345-2c63-42d9-9bc2-fa9ec93d9896 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:06.161135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c8964345-2c63-42d9-9bc2-fa9ec93d9896 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: 79193c93-2cc6-4327-893e-29edaa84d594] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:06.168661 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c8964345-2c63-42d9-9bc2-fa9ec93d9896 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:06.169181 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c8964345-2c63-42d9-9bc2-fa9ec93d9896 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:06.169614 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c8964345-2c63-42d9-9bc2-fa9ec93d9896 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:06.170314 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c8964345-2c63-42d9-9bc2-fa9ec93d9896 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:06.170762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c8964345-2c63-42d9-9bc2-fa9ec93d9896 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:06.171183 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c8964345-2c63-42d9-9bc2-fa9ec93d9896 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:06.252279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c8964345-2c63-42d9-9bc2-fa9ec93d9896 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac015152532a44609827594179c68aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68101269cd8447ec89411b4eab950d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:06.260411 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c8964345-2c63-42d9-9bc2-fa9ec93d9896 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594" status: 200 len: 1300 microversion: 2.1 time: 0.103690 Oct 05 03:08:06.261518 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3159/6303] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:06 2022] GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594 => generated 1300 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:06.928786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-f78445c4-b87a-4ad1-b7a6-8b75e2450420 req-b9e8c257-16bf-4814-b37f-e7a1ba55ea88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79193c93-2cc6-4327-893e-29edaa84d594", "name": "network-vif-plugged", "status": "completed", "tag": "69003acd-ac55-4331-aa5d-5ab3d649e98e"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:08:06.940317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f78445c4-b87a-4ad1-b7a6-8b75e2450420 req-b9e8c257-16bf-4814-b37f-e7a1ba55ea88 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:06.940802 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f78445c4-b87a-4ad1-b7a6-8b75e2450420 req-b9e8c257-16bf-4814-b37f-e7a1ba55ea88 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:06.941274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f78445c4-b87a-4ad1-b7a6-8b75e2450420 req-b9e8c257-16bf-4814-b37f-e7a1ba55ea88 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:06.953322 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-f78445c4-b87a-4ad1-b7a6-8b75e2450420 req-b9e8c257-16bf-4814-b37f-e7a1ba55ea88 service nova] Creating event network-vif-plugged:69003acd-ac55-4331-aa5d-5ab3d649e98e for instance 79193c93-2cc6-4327-893e-29edaa84d594 on n-h2-858272-3 Oct 05 03:08:06.959538 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-f78445c4-b87a-4ad1-b7a6-8b75e2450420 req-b9e8c257-16bf-4814-b37f-e7a1ba55ea88 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033994 Oct 05 03:08:06.960518 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3145/6304] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:08:07.285609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0440d1e7-361e-4b8d-a27e-c9830539f47e tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:07.286242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0440d1e7-361e-4b8d-a27e-c9830539f47e tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: 79193c93-2cc6-4327-893e-29edaa84d594] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:07.288232 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:08:07.289133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:08:07.296999 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0440d1e7-361e-4b8d-a27e-c9830539f47e tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:07.297493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0440d1e7-361e-4b8d-a27e-c9830539f47e tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:07.297925 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0440d1e7-361e-4b8d-a27e-c9830539f47e tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:07.298649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0440d1e7-361e-4b8d-a27e-c9830539f47e tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:07.299277 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0440d1e7-361e-4b8d-a27e-c9830539f47e tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:07.299700 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0440d1e7-361e-4b8d-a27e-c9830539f47e tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:07.382667 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0440d1e7-361e-4b8d-a27e-c9830539f47e tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac015152532a44609827594179c68aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68101269cd8447ec89411b4eab950d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:07.391362 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0440d1e7-361e-4b8d-a27e-c9830539f47e tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594" status: 200 len: 1300 microversion: 2.1 time: 0.109670 Oct 05 03:08:07.391941 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3160/6305] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:07 2022] GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594 => generated 1300 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:08.412098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:08:08.417506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bab21fc0-59f6-4d2a-a964-beb1c51f945a tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:08.418292 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bab21fc0-59f6-4d2a-a964-beb1c51f945a tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: 79193c93-2cc6-4327-893e-29edaa84d594] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:08.424969 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bab21fc0-59f6-4d2a-a964-beb1c51f945a tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:08.425453 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bab21fc0-59f6-4d2a-a964-beb1c51f945a tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:08.425885 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bab21fc0-59f6-4d2a-a964-beb1c51f945a tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:08.426573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bab21fc0-59f6-4d2a-a964-beb1c51f945a tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:08.427019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bab21fc0-59f6-4d2a-a964-beb1c51f945a tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:08.427439 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bab21fc0-59f6-4d2a-a964-beb1c51f945a tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:08.523866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bab21fc0-59f6-4d2a-a964-beb1c51f945a tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac015152532a44609827594179c68aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68101269cd8447ec89411b4eab950d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:08.537183 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bab21fc0-59f6-4d2a-a964-beb1c51f945a tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594" status: 200 len: 1300 microversion: 2.1 time: 0.125857 Oct 05 03:08:08.549047 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3146/6306] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:08 2022] GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594 => generated 1300 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:09.562629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-90267ed4-cf4f-412c-a76b-90b760186cae tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:09.563249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-90267ed4-cf4f-412c-a76b-90b760186cae tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: 79193c93-2cc6-4327-893e-29edaa84d594] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:09.570558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-90267ed4-cf4f-412c-a76b-90b760186cae tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:09.571055 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-90267ed4-cf4f-412c-a76b-90b760186cae tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:09.571495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-90267ed4-cf4f-412c-a76b-90b760186cae tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:09.572213 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-90267ed4-cf4f-412c-a76b-90b760186cae tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:09.572668 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-90267ed4-cf4f-412c-a76b-90b760186cae tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:09.573213 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-90267ed4-cf4f-412c-a76b-90b760186cae tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:09.662367 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-90267ed4-cf4f-412c-a76b-90b760186cae tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac015152532a44609827594179c68aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68101269cd8447ec89411b4eab950d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:09.674474 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-90267ed4-cf4f-412c-a76b-90b760186cae tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594" status: 200 len: 1473 microversion: 2.1 time: 0.115531 Oct 05 03:08:09.675198 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3161/6307] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:09 2022] GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594 => generated 1473 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:08:09.696849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e50f0274-6b71-4db3-8773-39d4d68534b2 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:09.698082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e50f0274-6b71-4db3-8773-39d4d68534b2 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: 79193c93-2cc6-4327-893e-29edaa84d594] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:09.705170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e50f0274-6b71-4db3-8773-39d4d68534b2 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:09.705659 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e50f0274-6b71-4db3-8773-39d4d68534b2 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:09.706091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e50f0274-6b71-4db3-8773-39d4d68534b2 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:09.706773 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e50f0274-6b71-4db3-8773-39d4d68534b2 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:09.707222 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e50f0274-6b71-4db3-8773-39d4d68534b2 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:09.707641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e50f0274-6b71-4db3-8773-39d4d68534b2 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:09.790441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e50f0274-6b71-4db3-8773-39d4d68534b2 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac015152532a44609827594179c68aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68101269cd8447ec89411b4eab950d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:09.798582 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e50f0274-6b71-4db3-8773-39d4d68534b2 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594" status: 200 len: 1473 microversion: 2.1 time: 0.105582 Oct 05 03:08:09.799157 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3147/6308] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:09 2022] GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594 => generated 1473 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:09.821127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d3018230-a1ff-4a57-bf12-34b72a5cdc3c tempest-TestSecurityGroupsBasicOps-512529858 tempest-TestSecurityGroupsBasicOps-512529858-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:09.821677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d3018230-a1ff-4a57-bf12-34b72a5cdc3c tempest-TestSecurityGroupsBasicOps-512529858 tempest-TestSecurityGroupsBasicOps-512529858-project-admin] [instance: 79193c93-2cc6-4327-893e-29edaa84d594] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:09.828580 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d3018230-a1ff-4a57-bf12-34b72a5cdc3c tempest-TestSecurityGroupsBasicOps-512529858 tempest-TestSecurityGroupsBasicOps-512529858-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:09.829117 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d3018230-a1ff-4a57-bf12-34b72a5cdc3c tempest-TestSecurityGroupsBasicOps-512529858 tempest-TestSecurityGroupsBasicOps-512529858-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:09.829586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d3018230-a1ff-4a57-bf12-34b72a5cdc3c tempest-TestSecurityGroupsBasicOps-512529858 tempest-TestSecurityGroupsBasicOps-512529858-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:09.830278 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d3018230-a1ff-4a57-bf12-34b72a5cdc3c tempest-TestSecurityGroupsBasicOps-512529858 tempest-TestSecurityGroupsBasicOps-512529858-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:09.830735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d3018230-a1ff-4a57-bf12-34b72a5cdc3c tempest-TestSecurityGroupsBasicOps-512529858 tempest-TestSecurityGroupsBasicOps-512529858-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:09.831162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d3018230-a1ff-4a57-bf12-34b72a5cdc3c tempest-TestSecurityGroupsBasicOps-512529858 tempest-TestSecurityGroupsBasicOps-512529858-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:09.914339 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d3018230-a1ff-4a57-bf12-34b72a5cdc3c tempest-TestSecurityGroupsBasicOps-512529858 tempest-TestSecurityGroupsBasicOps-512529858-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594" status: 200 len: 1624 microversion: 2.1 time: 0.096943 Oct 05 03:08:09.915075 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3162/6309] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:09 2022] GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594 => generated 1624 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:09.943093 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7e3663e6-abbd-481e-b872-f7cd613d6df3 tempest-TestSecurityGroupsBasicOps-512529858 tempest-TestSecurityGroupsBasicOps-512529858-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:09.943714 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7e3663e6-abbd-481e-b872-f7cd613d6df3 tempest-TestSecurityGroupsBasicOps-512529858 tempest-TestSecurityGroupsBasicOps-512529858-project-admin] [instance: f4cd4aa7-8674-456c-a4a3-7750478f5cb9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:09.950502 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e3663e6-abbd-481e-b872-f7cd613d6df3 tempest-TestSecurityGroupsBasicOps-512529858 tempest-TestSecurityGroupsBasicOps-512529858-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:09.951000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e3663e6-abbd-481e-b872-f7cd613d6df3 tempest-TestSecurityGroupsBasicOps-512529858 tempest-TestSecurityGroupsBasicOps-512529858-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:09.951443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e3663e6-abbd-481e-b872-f7cd613d6df3 tempest-TestSecurityGroupsBasicOps-512529858 tempest-TestSecurityGroupsBasicOps-512529858-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:09.952145 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e3663e6-abbd-481e-b872-f7cd613d6df3 tempest-TestSecurityGroupsBasicOps-512529858 tempest-TestSecurityGroupsBasicOps-512529858-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:09.952607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e3663e6-abbd-481e-b872-f7cd613d6df3 tempest-TestSecurityGroupsBasicOps-512529858 tempest-TestSecurityGroupsBasicOps-512529858-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:09.953071 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e3663e6-abbd-481e-b872-f7cd613d6df3 tempest-TestSecurityGroupsBasicOps-512529858 tempest-TestSecurityGroupsBasicOps-512529858-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:10.095660 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7e3663e6-abbd-481e-b872-f7cd613d6df3 tempest-TestSecurityGroupsBasicOps-512529858 tempest-TestSecurityGroupsBasicOps-512529858-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9" status: 200 len: 1915 microversion: 2.1 time: 0.156253 Oct 05 03:08:10.096345 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3148/6310] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:09 2022] GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9 => generated 1915 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:10.162134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-84643a9d-dd47-4c83-a08b-b4afbe1ca2d5 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:10.162758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-84643a9d-dd47-4c83-a08b-b4afbe1ca2d5 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: 79193c93-2cc6-4327-893e-29edaa84d594] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:10.169135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84643a9d-dd47-4c83-a08b-b4afbe1ca2d5 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:10.169634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84643a9d-dd47-4c83-a08b-b4afbe1ca2d5 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:10.170078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84643a9d-dd47-4c83-a08b-b4afbe1ca2d5 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:10.170789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84643a9d-dd47-4c83-a08b-b4afbe1ca2d5 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:10.171251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84643a9d-dd47-4c83-a08b-b4afbe1ca2d5 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:10.171686 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-84643a9d-dd47-4c83-a08b-b4afbe1ca2d5 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:10.198104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-84643a9d-dd47-4c83-a08b-b4afbe1ca2d5 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: 79193c93-2cc6-4327-893e-29edaa84d594] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:08:10.281097 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-84643a9d-dd47-4c83-a08b-b4afbe1ca2d5 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "DELETE /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594" status: 204 len: 0 microversion: 2.1 time: 0.122377 Oct 05 03:08:10.281819 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3163/6311] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:08:10 2022] DELETE /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:08:10.290879 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2835ffd1-18f4-4ecd-83ab-9c2fe9207862 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:10.291685 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2835ffd1-18f4-4ecd-83ab-9c2fe9207862 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: 79193c93-2cc6-4327-893e-29edaa84d594] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:10.297986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2835ffd1-18f4-4ecd-83ab-9c2fe9207862 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:10.298482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2835ffd1-18f4-4ecd-83ab-9c2fe9207862 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:10.298916 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2835ffd1-18f4-4ecd-83ab-9c2fe9207862 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:10.299611 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2835ffd1-18f4-4ecd-83ab-9c2fe9207862 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:10.300063 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2835ffd1-18f4-4ecd-83ab-9c2fe9207862 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:10.300689 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2835ffd1-18f4-4ecd-83ab-9c2fe9207862 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:10.387457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2835ffd1-18f4-4ecd-83ab-9c2fe9207862 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac015152532a44609827594179c68aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68101269cd8447ec89411b4eab950d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:10.395834 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2835ffd1-18f4-4ecd-83ab-9c2fe9207862 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594" status: 200 len: 1479 microversion: 2.1 time: 0.108972 Oct 05 03:08:10.396476 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3149/6312] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:10 2022] GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594 => generated 1479 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:08:11.420195 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5b9a308c-1544-4d14-9204-bdd3079990c8 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:11.420951 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5b9a308c-1544-4d14-9204-bdd3079990c8 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: 79193c93-2cc6-4327-893e-29edaa84d594] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:11.427849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5b9a308c-1544-4d14-9204-bdd3079990c8 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:11.428283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5b9a308c-1544-4d14-9204-bdd3079990c8 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:11.428710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5b9a308c-1544-4d14-9204-bdd3079990c8 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:11.429421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5b9a308c-1544-4d14-9204-bdd3079990c8 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:11.429870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5b9a308c-1544-4d14-9204-bdd3079990c8 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:11.430289 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5b9a308c-1544-4d14-9204-bdd3079990c8 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:11.518217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5b9a308c-1544-4d14-9204-bdd3079990c8 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac015152532a44609827594179c68aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68101269cd8447ec89411b4eab950d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:11.526873 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5b9a308c-1544-4d14-9204-bdd3079990c8 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594" status: 200 len: 1479 microversion: 2.1 time: 0.111243 Oct 05 03:08:11.527442 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3164/6313] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:11 2022] GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594 => generated 1479 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:08:12.474034 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-9cc73e21-c926-4c64-8a60-4eb89576164c req-b0c8c726-4c9d-476f-9df2-24f421515e00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79193c93-2cc6-4327-893e-29edaa84d594", "name": "network-vif-deleted", "tag": "69003acd-ac55-4331-aa5d-5ab3d649e98e"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:08:12.488321 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-9cc73e21-c926-4c64-8a60-4eb89576164c req-b0c8c726-4c9d-476f-9df2-24f421515e00 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:12.488801 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-9cc73e21-c926-4c64-8a60-4eb89576164c req-b0c8c726-4c9d-476f-9df2-24f421515e00 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:12.489256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-9cc73e21-c926-4c64-8a60-4eb89576164c req-b0c8c726-4c9d-476f-9df2-24f421515e00 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:12.510834 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-9cc73e21-c926-4c64-8a60-4eb89576164c req-b0c8c726-4c9d-476f-9df2-24f421515e00 service nova] Creating event network-vif-deleted:69003acd-ac55-4331-aa5d-5ab3d649e98e for instance 79193c93-2cc6-4327-893e-29edaa84d594 on n-h2-858272-3 Oct 05 03:08:12.523019 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-9cc73e21-c926-4c64-8a60-4eb89576164c req-b0c8c726-4c9d-476f-9df2-24f421515e00 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132458 Oct 05 03:08:12.528316 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3150/6314] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:08:12.550711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-55d327aa-240a-4676-979d-5af0b3427b92 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:12.551333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-55d327aa-240a-4676-979d-5af0b3427b92 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: 79193c93-2cc6-4327-893e-29edaa84d594] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:12.560247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55d327aa-240a-4676-979d-5af0b3427b92 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:12.560783 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55d327aa-240a-4676-979d-5af0b3427b92 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:12.561467 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55d327aa-240a-4676-979d-5af0b3427b92 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:12.562185 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55d327aa-240a-4676-979d-5af0b3427b92 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:12.562647 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55d327aa-240a-4676-979d-5af0b3427b92 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:12.563081 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55d327aa-240a-4676-979d-5af0b3427b92 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:12.598404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55d327aa-240a-4676-979d-5af0b3427b92 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:12.598822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55d327aa-240a-4676-979d-5af0b3427b92 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:12.599262 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55d327aa-240a-4676-979d-5af0b3427b92 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:12.599721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-55d327aa-240a-4676-979d-5af0b3427b92 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lazy-loading 'fault' on Instance uuid 79193c93-2cc6-4327-893e-29edaa84d594 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:08:12.651695 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-55d327aa-240a-4676-979d-5af0b3427b92 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac015152532a44609827594179c68aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68101269cd8447ec89411b4eab950d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:12.663042 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-55d327aa-240a-4676-979d-5af0b3427b92 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594" status: 200 len: 1332 microversion: 2.1 time: 0.116050 Oct 05 03:08:12.665038 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3165/6315] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:12 2022] GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594 => generated 1332 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:13.690357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-88dde93b-8fe4-47a8-a99a-56c46a0d4fa6 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:13.691055 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-88dde93b-8fe4-47a8-a99a-56c46a0d4fa6 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: 79193c93-2cc6-4327-893e-29edaa84d594] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:13.697234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-88dde93b-8fe4-47a8-a99a-56c46a0d4fa6 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:13.697726 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-88dde93b-8fe4-47a8-a99a-56c46a0d4fa6 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:13.698160 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-88dde93b-8fe4-47a8-a99a-56c46a0d4fa6 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:13.698837 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-88dde93b-8fe4-47a8-a99a-56c46a0d4fa6 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:13.699287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-88dde93b-8fe4-47a8-a99a-56c46a0d4fa6 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:13.699709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-88dde93b-8fe4-47a8-a99a-56c46a0d4fa6 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:13.712730 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-88dde93b-8fe4-47a8-a99a-56c46a0d4fa6 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] HTTP exception thrown: Instance 79193c93-2cc6-4327-893e-29edaa84d594 could not be found. Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-88dde93b-8fe4-47a8-a99a-56c46a0d4fa6 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Request method failure captured: Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594 HTTP/1.1 Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPStfwHGx7ANsv0ALqD0tRVJw9LHvBB1bKDDDY_9sL5rN2YKDbVzEs6w7gCKQP3gCJA-SkEPyT1Zv0PhGwhRagEiuRfe236wa2EZ2h7m1hHswNuEzGvSMghmc2yrAtboDSKY7wr8x76UgnLP24meeA7-1xzm01TCEK-T09h7nVYY3LA Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 68101269cd8447ec89411b4eab950d51 Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-341123616 Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68101269cd8447ec89411b4eab950d51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68101269cd8447ec89411b4eab950d51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/68101269cd8447ec89411b4eab950d51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_68101269cd8447ec89411b4eab950d51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-TestSecurityGroupsBasicOps-341123616 Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 68101269cd8447ec89411b4eab950d51 Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-341123616 Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-TestSecurityGroupsBasicOps-341123616-project Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: ac015152532a44609827594179c68aa8 Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-TestSecurityGroupsBasicOps-341123616-project Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 79193c93-2cc6-4327-893e-29edaa84d594 could not be found. Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '79193c93-2cc6-4327-893e-29edaa84d594'} Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79193c93-2cc6-4327-893e-29edaa84d594 could not be found. Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79193c93-2cc6-4327-893e-29edaa84d594 could not be found. Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:08:13.714438 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:08:13.719372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:08:13.719372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:08:13.719372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:08:13.719372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:08:13.719372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:08:13.719372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79193c93-2cc6-4327-893e-29edaa84d594 could not be found. Oct 05 03:08:13.719372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:08:13.719372 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-88dde93b-8fe4-47a8-a99a-56c46a0d4fa6 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Returning 404 to user: Instance 79193c93-2cc6-4327-893e-29edaa84d594 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:08:13.719372 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-88dde93b-8fe4-47a8-a99a-56c46a0d4fa6 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594" status: 404 len: 111 microversion: 2.1 time: 0.030702 Oct 05 03:08:13.719372 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3151/6316] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:13 2022] GET /compute/v2.1/servers/79193c93-2cc6-4327-893e-29edaa84d594 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:08:18.463926 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9ac25752-a421-4b96-b3b9-dcc4ef3657e9 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:18.465736 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9ac25752-a421-4b96-b3b9-dcc4ef3657e9 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: f4cd4aa7-8674-456c-a4a3-7750478f5cb9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:18.467602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-675ad7a1-bed6-4c1a-a4c9-c9c87b6bb902 req-630064b2-80bb-4cd6-9ae1-1c13d81690ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4cd4aa7-8674-456c-a4a3-7750478f5cb9", "tag": "beb8429b-f510-4361-8dac-96330c34c9c7"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:08:18.485259 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-675ad7a1-bed6-4c1a-a4c9-c9c87b6bb902 req-630064b2-80bb-4cd6-9ae1-1c13d81690ee service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:18.486196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-675ad7a1-bed6-4c1a-a4c9-c9c87b6bb902 req-630064b2-80bb-4cd6-9ae1-1c13d81690ee service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:18.486654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ac25752-a421-4b96-b3b9-dcc4ef3657e9 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:18.486988 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-675ad7a1-bed6-4c1a-a4c9-c9c87b6bb902 req-630064b2-80bb-4cd6-9ae1-1c13d81690ee service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:18.487154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ac25752-a421-4b96-b3b9-dcc4ef3657e9 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:18.488167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ac25752-a421-4b96-b3b9-dcc4ef3657e9 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:18.488937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ac25752-a421-4b96-b3b9-dcc4ef3657e9 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:18.489393 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ac25752-a421-4b96-b3b9-dcc4ef3657e9 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:18.489824 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ac25752-a421-4b96-b3b9-dcc4ef3657e9 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:18.500414 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-675ad7a1-bed6-4c1a-a4c9-c9c87b6bb902 req-630064b2-80bb-4cd6-9ae1-1c13d81690ee service nova] Creating event network-changed:beb8429b-f510-4361-8dac-96330c34c9c7 for instance f4cd4aa7-8674-456c-a4a3-7750478f5cb9 on n-h1-858272-3 Oct 05 03:08:18.518433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9ac25752-a421-4b96-b3b9-dcc4ef3657e9 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: f4cd4aa7-8674-456c-a4a3-7750478f5cb9] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:08:18.519071 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-675ad7a1-bed6-4c1a-a4c9-c9c87b6bb902 req-630064b2-80bb-4cd6-9ae1-1c13d81690ee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057288 Oct 05 03:08:18.523945 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3152/6317] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:08:18.661743 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9ac25752-a421-4b96-b3b9-dcc4ef3657e9 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9" status: 204 len: 0 microversion: 2.1 time: 0.202094 Oct 05 03:08:18.662697 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3166/6318] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:08:18 2022] DELETE /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:08:18.672385 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-85679bca-dde7-4f4f-a93d-ece34fe9e06e tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:18.673138 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-85679bca-dde7-4f4f-a93d-ece34fe9e06e tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: f4cd4aa7-8674-456c-a4a3-7750478f5cb9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:18.679906 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85679bca-dde7-4f4f-a93d-ece34fe9e06e tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:18.680258 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85679bca-dde7-4f4f-a93d-ece34fe9e06e tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:18.680822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85679bca-dde7-4f4f-a93d-ece34fe9e06e tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:18.681438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85679bca-dde7-4f4f-a93d-ece34fe9e06e tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:18.682472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85679bca-dde7-4f4f-a93d-ece34fe9e06e tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:18.682947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85679bca-dde7-4f4f-a93d-ece34fe9e06e tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:18.890781 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-85679bca-dde7-4f4f-a93d-ece34fe9e06e tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac015152532a44609827594179c68aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68101269cd8447ec89411b4eab950d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:18.899369 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-85679bca-dde7-4f4f-a93d-ece34fe9e06e tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9" status: 200 len: 1770 microversion: 2.1 time: 0.231244 Oct 05 03:08:18.899967 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3153/6319] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:18 2022] GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9 => generated 1770 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:19.925667 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-956bc1e4-c4ef-4465-9277-186d44ee7dba tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:19.926450 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-956bc1e4-c4ef-4465-9277-186d44ee7dba tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: f4cd4aa7-8674-456c-a4a3-7750478f5cb9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:19.933628 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-956bc1e4-c4ef-4465-9277-186d44ee7dba tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:19.934194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-956bc1e4-c4ef-4465-9277-186d44ee7dba tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:19.934994 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-956bc1e4-c4ef-4465-9277-186d44ee7dba tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:19.935646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-956bc1e4-c4ef-4465-9277-186d44ee7dba tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:19.936468 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-956bc1e4-c4ef-4465-9277-186d44ee7dba tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:19.937137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-956bc1e4-c4ef-4465-9277-186d44ee7dba tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:20.161107 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-956bc1e4-c4ef-4465-9277-186d44ee7dba tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac015152532a44609827594179c68aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68101269cd8447ec89411b4eab950d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:20.171734 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-956bc1e4-c4ef-4465-9277-186d44ee7dba tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9" status: 200 len: 1770 microversion: 2.1 time: 0.250673 Oct 05 03:08:20.172365 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3167/6320] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:19 2022] GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9 => generated 1770 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:20.790184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-7de3fa00-a7ce-4d59-ab58-2ab295a1e109 req-a8102c11-e006-4456-93d5-4e33d1352512 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4cd4aa7-8674-456c-a4a3-7750478f5cb9", "name": "network-vif-deleted", "tag": "beb8429b-f510-4361-8dac-96330c34c9c7"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:08:20.800565 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=33 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:08:20.807420 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-7de3fa00-a7ce-4d59-ab58-2ab295a1e109 req-a8102c11-e006-4456-93d5-4e33d1352512 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:20.808107 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-7de3fa00-a7ce-4d59-ab58-2ab295a1e109 req-a8102c11-e006-4456-93d5-4e33d1352512 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:20.808540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-7de3fa00-a7ce-4d59-ab58-2ab295a1e109 req-a8102c11-e006-4456-93d5-4e33d1352512 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:20.813208 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=67 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:08:20.824359 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-7de3fa00-a7ce-4d59-ab58-2ab295a1e109 req-a8102c11-e006-4456-93d5-4e33d1352512 service nova] Creating event network-vif-deleted:beb8429b-f510-4361-8dac-96330c34c9c7 for instance f4cd4aa7-8674-456c-a4a3-7750478f5cb9 on n-h1-858272-3 Oct 05 03:08:20.830659 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-7de3fa00-a7ce-4d59-ab58-2ab295a1e109 req-a8102c11-e006-4456-93d5-4e33d1352512 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044095 Oct 05 03:08:20.831268 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3154/6321] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:08:21.195379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-64566c7c-9be7-46e1-9b5d-9e5622beeb49 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:21.196608 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-64566c7c-9be7-46e1-9b5d-9e5622beeb49 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: f4cd4aa7-8674-456c-a4a3-7750478f5cb9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:21.204998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64566c7c-9be7-46e1-9b5d-9e5622beeb49 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:21.205791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64566c7c-9be7-46e1-9b5d-9e5622beeb49 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:21.206339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64566c7c-9be7-46e1-9b5d-9e5622beeb49 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:21.206919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64566c7c-9be7-46e1-9b5d-9e5622beeb49 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:21.207395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64566c7c-9be7-46e1-9b5d-9e5622beeb49 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:21.207784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64566c7c-9be7-46e1-9b5d-9e5622beeb49 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:21.213791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:08:21.248251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64566c7c-9be7-46e1-9b5d-9e5622beeb49 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:21.248739 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64566c7c-9be7-46e1-9b5d-9e5622beeb49 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:21.249369 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64566c7c-9be7-46e1-9b5d-9e5622beeb49 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:21.249822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-64566c7c-9be7-46e1-9b5d-9e5622beeb49 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lazy-loading 'fault' on Instance uuid f4cd4aa7-8674-456c-a4a3-7750478f5cb9 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:08:21.295966 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-64566c7c-9be7-46e1-9b5d-9e5622beeb49 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac015152532a44609827594179c68aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68101269cd8447ec89411b4eab950d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:21.303864 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-64566c7c-9be7-46e1-9b5d-9e5622beeb49 tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9" status: 200 len: 1384 microversion: 2.1 time: 0.112379 Oct 05 03:08:21.304365 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3168/6322] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:21 2022] GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9 => generated 1384 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:22.329360 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c747a278-36a8-4bec-9c70-f753ace3289c tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:22.330023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c747a278-36a8-4bec-9c70-f753ace3289c tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] [instance: f4cd4aa7-8674-456c-a4a3-7750478f5cb9] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:22.336362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c747a278-36a8-4bec-9c70-f753ace3289c tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:22.336853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c747a278-36a8-4bec-9c70-f753ace3289c tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:22.337478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c747a278-36a8-4bec-9c70-f753ace3289c tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:22.339228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c747a278-36a8-4bec-9c70-f753ace3289c tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:22.339697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c747a278-36a8-4bec-9c70-f753ace3289c tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:22.340133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c747a278-36a8-4bec-9c70-f753ace3289c tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:22.355122 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-c747a278-36a8-4bec-9c70-f753ace3289c tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] HTTP exception thrown: Instance f4cd4aa7-8674-456c-a4a3-7750478f5cb9 could not be found. Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c747a278-36a8-4bec-9c70-f753ace3289c tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Request method failure captured: Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9 HTTP/1.1 Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPStfwHGx7ANsv0ALqD0tRVJw9LHvBB1bKDDDY_9sL5rN2YKDbVzEs6w7gCKQP3gCJA-SkEPyT1Zv0PhGwhRagEiuRfe236wa2EZ2h7m1hHswNuEzGvSMghmc2yrAtboDSKY7wr8x76UgnLP24meeA7-1xzm01TCEK-T09h7nVYY3LA Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 68101269cd8447ec89411b4eab950d51 Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-341123616 Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68101269cd8447ec89411b4eab950d51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68101269cd8447ec89411b4eab950d51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/68101269cd8447ec89411b4eab950d51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_68101269cd8447ec89411b4eab950d51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-TestSecurityGroupsBasicOps-341123616 Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 68101269cd8447ec89411b4eab950d51 Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-341123616 Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-TestSecurityGroupsBasicOps-341123616-project Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: ac015152532a44609827594179c68aa8 Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-TestSecurityGroupsBasicOps-341123616-project Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance f4cd4aa7-8674-456c-a4a3-7750478f5cb9 could not be found. Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'f4cd4aa7-8674-456c-a4a3-7750478f5cb9'} Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4cd4aa7-8674-456c-a4a3-7750478f5cb9 could not be found. Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4cd4aa7-8674-456c-a4a3-7750478f5cb9 could not be found. Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:08:22.356828 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:08:22.361812 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:08:22.361812 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:08:22.361812 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:08:22.361812 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:08:22.361812 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:08:22.361812 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4cd4aa7-8674-456c-a4a3-7750478f5cb9 could not be found. Oct 05 03:08:22.361812 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:08:22.361812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c747a278-36a8-4bec-9c70-f753ace3289c tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Returning 404 to user: Instance f4cd4aa7-8674-456c-a4a3-7750478f5cb9 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:08:22.361812 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c747a278-36a8-4bec-9c70-f753ace3289c tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9" status: 404 len: 111 microversion: 2.1 time: 0.034182 Oct 05 03:08:22.361812 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3155/6323] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:22 2022] GET /compute/v2.1/servers/f4cd4aa7-8674-456c-a4a3-7750478f5cb9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 03:08:25.529108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fae3636e-211c-40c8-b27e-397400045ef6 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:25.530891 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fae3636e-211c-40c8-b27e-397400045ef6 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4e3cdf79-2ab1-4e8f-b132-075fb38000da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:25.540541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fae3636e-211c-40c8-b27e-397400045ef6 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:25.542876 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fae3636e-211c-40c8-b27e-397400045ef6 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:25.543576 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fae3636e-211c-40c8-b27e-397400045ef6 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:25.547670 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fae3636e-211c-40c8-b27e-397400045ef6 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:25.549367 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fae3636e-211c-40c8-b27e-397400045ef6 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:25.549845 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fae3636e-211c-40c8-b27e-397400045ef6 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:25.585380 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fae3636e-211c-40c8-b27e-397400045ef6 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da/ips" status: 200 len: 149 microversion: 2.1 time: 0.061374 Oct 05 03:08:25.587234 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3169/6324] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 03:08:25 2022] GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da/ips => generated 149 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:08:26.247809 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4dea4af0-5326-4001-a145-5b278842917f tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] Calling method '.version_select at 0x7fcce4a9fb80>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:26.272628 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4dea4af0-5326-4001-a145-5b278842917f tempest-TestSecurityGroupsBasicOps-341123616 tempest-TestSecurityGroupsBasicOps-341123616-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1285308353" status: 202 len: 0 microversion: 2.1 time: 0.029524 Oct 05 03:08:26.273342 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3156/6325] 10.222.0.16 () {58 vars in 1278 bytes} [Wed Oct 5 03:08:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1285308353 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:08:27.057799 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b7a7ab9c-16fa-4837-a7e9-284066f603d7 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e9c4105-a473-413c-a933-398afb1b1970"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:08:27.060681 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b7a7ab9c-16fa-4837-a7e9-284066f603d7 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4e3cdf79-2ab1-4e8f-b132-075fb38000da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:27.067937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:08:27.071045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7a7ab9c-16fa-4837-a7e9-284066f603d7 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:27.071045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7a7ab9c-16fa-4837-a7e9-284066f603d7 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:27.071045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7a7ab9c-16fa-4837-a7e9-284066f603d7 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:27.073895 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7a7ab9c-16fa-4837-a7e9-284066f603d7 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:27.074446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7a7ab9c-16fa-4837-a7e9-284066f603d7 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:27.074898 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7a7ab9c-16fa-4837-a7e9-284066f603d7 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:27.429202 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b7a7ab9c-16fa-4837-a7e9-284066f603d7 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "POST /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.376956 Oct 05 03:08:27.435490 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3170/6326] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 03:08:27 2022] POST /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da/os-volume_attachments => generated 194 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:08:29.758643 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c2f27ff1-a242-47b2-98b1-13405518a0b7 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:29.760875 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c2f27ff1-a242-47b2-98b1-13405518a0b7 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:29.766841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2f27ff1-a242-47b2-98b1-13405518a0b7 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:29.767331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2f27ff1-a242-47b2-98b1-13405518a0b7 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:29.768022 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2f27ff1-a242-47b2-98b1-13405518a0b7 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:29.768712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2f27ff1-a242-47b2-98b1-13405518a0b7 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:29.769194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2f27ff1-a242-47b2-98b1-13405518a0b7 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:29.769623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2f27ff1-a242-47b2-98b1-13405518a0b7 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:29.912603 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c2f27ff1-a242-47b2-98b1-13405518a0b7 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1832 microversion: 2.1 time: 0.158764 Oct 05 03:08:29.913252 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3157/6327] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:29 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1832 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:29.939104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-87abb831-5358-468a-aad5-b92532d09787 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:29.939832 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-87abb831-5358-468a-aad5-b92532d09787 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:29.946593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87abb831-5358-468a-aad5-b92532d09787 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:29.947256 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87abb831-5358-468a-aad5-b92532d09787 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:29.948306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87abb831-5358-468a-aad5-b92532d09787 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:29.949083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87abb831-5358-468a-aad5-b92532d09787 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:29.949579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87abb831-5358-468a-aad5-b92532d09787 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:29.949995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87abb831-5358-468a-aad5-b92532d09787 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:30.091909 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-87abb831-5358-468a-aad5-b92532d09787 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:30.099788 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-87abb831-5358-468a-aad5-b92532d09787 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1681 microversion: 2.1 time: 0.166024 Oct 05 03:08:30.100367 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3171/6328] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:29 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:30.201687 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-58420b77-0c7d-488d-b102-70e01a5160c0 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:08:30.203915 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-58420b77-0c7d-488d-b102-70e01a5160c0 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:30.210129 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58420b77-0c7d-488d-b102-70e01a5160c0 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:30.210627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58420b77-0c7d-488d-b102-70e01a5160c0 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:30.211067 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58420b77-0c7d-488d-b102-70e01a5160c0 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:30.211794 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58420b77-0c7d-488d-b102-70e01a5160c0 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:30.212251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58420b77-0c7d-488d-b102-70e01a5160c0 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:30.213487 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58420b77-0c7d-488d-b102-70e01a5160c0 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:30.289538 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-58420b77-0c7d-488d-b102-70e01a5160c0 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "POST /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed/action" status: 200 len: 32640 microversion: 2.1 time: 0.091998 Oct 05 03:08:30.296884 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3158/6329] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:08:30 2022] POST /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed/action => generated 32640 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 03:08:30.459274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2abd99d3-bd66-4237-b196-b8757b1c171d tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:08:30.460146 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2abd99d3-bd66-4237-b196-b8757b1c171d tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:30.466964 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2abd99d3-bd66-4237-b196-b8757b1c171d tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:30.467452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2abd99d3-bd66-4237-b196-b8757b1c171d tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:30.467893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2abd99d3-bd66-4237-b196-b8757b1c171d tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:30.468598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2abd99d3-bd66-4237-b196-b8757b1c171d tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:30.469075 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2abd99d3-bd66-4237-b196-b8757b1c171d tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:30.469525 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2abd99d3-bd66-4237-b196-b8757b1c171d tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:30.513807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2abd99d3-bd66-4237-b196-b8757b1c171d tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0589f01c6bb44698b9e060a659c8679b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '519c294387a04ca5bcdeab3e4e574eb5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:30.514906 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2abd99d3-bd66-4237-b196-b8757b1c171d tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] flavor_id is None. Assuming migration. {{(pid=122319) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 05 03:08:30.515718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2abd99d3-bd66-4237-b196-b8757b1c171d tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122319) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 05 03:08:30.828888 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2abd99d3-bd66-4237-b196-b8757b1c171d tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed/action" status: 202 len: 0 microversion: 2.1 time: 0.373384 Oct 05 03:08:30.829717 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3172/6330] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:08:30 2022] POST /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:08:30.848182 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d96da2c7-a0a6-4d90-b6f5-64369b8e2007 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:30.849395 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d96da2c7-a0a6-4d90-b6f5-64369b8e2007 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:30.859181 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d96da2c7-a0a6-4d90-b6f5-64369b8e2007 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:30.859706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d96da2c7-a0a6-4d90-b6f5-64369b8e2007 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:30.860138 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d96da2c7-a0a6-4d90-b6f5-64369b8e2007 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:30.862201 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d96da2c7-a0a6-4d90-b6f5-64369b8e2007 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:30.862201 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d96da2c7-a0a6-4d90-b6f5-64369b8e2007 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:30.862201 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d96da2c7-a0a6-4d90-b6f5-64369b8e2007 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:31.015078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d96da2c7-a0a6-4d90-b6f5-64369b8e2007 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:31.028664 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d96da2c7-a0a6-4d90-b6f5-64369b8e2007 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1690 microversion: 2.1 time: 0.194582 Oct 05 03:08:31.029284 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3159/6331] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:30 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1690 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:32.053416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ba6995e1-0758-4904-b21e-eded850fbe20 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:32.054384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ba6995e1-0758-4904-b21e-eded850fbe20 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:32.067432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ba6995e1-0758-4904-b21e-eded850fbe20 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:32.067432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ba6995e1-0758-4904-b21e-eded850fbe20 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:32.067432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ba6995e1-0758-4904-b21e-eded850fbe20 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:32.067432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ba6995e1-0758-4904-b21e-eded850fbe20 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:32.067432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ba6995e1-0758-4904-b21e-eded850fbe20 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:32.067432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ba6995e1-0758-4904-b21e-eded850fbe20 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:32.253971 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ba6995e1-0758-4904-b21e-eded850fbe20 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:32.263428 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ba6995e1-0758-4904-b21e-eded850fbe20 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1690 microversion: 2.1 time: 0.214701 Oct 05 03:08:32.264173 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3173/6332] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:32 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1690 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:08:33.288359 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d2f732f1-b2e0-4be7-b212-d2917872b17b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:33.289792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d2f732f1-b2e0-4be7-b212-d2917872b17b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:33.297373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2f732f1-b2e0-4be7-b212-d2917872b17b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:33.297869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2f732f1-b2e0-4be7-b212-d2917872b17b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:33.298318 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2f732f1-b2e0-4be7-b212-d2917872b17b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:33.299077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2f732f1-b2e0-4be7-b212-d2917872b17b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:33.299538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2f732f1-b2e0-4be7-b212-d2917872b17b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:33.299968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2f732f1-b2e0-4be7-b212-d2917872b17b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:33.439010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d2f732f1-b2e0-4be7-b212-d2917872b17b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:33.446999 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d2f732f1-b2e0-4be7-b212-d2917872b17b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1695 microversion: 2.1 time: 0.162558 Oct 05 03:08:33.448126 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3160/6333] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:33 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:34.472622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9ad38a31-b0a7-490e-a749-c2fc0b1dd243 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:34.473224 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9ad38a31-b0a7-490e-a749-c2fc0b1dd243 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:34.480782 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ad38a31-b0a7-490e-a749-c2fc0b1dd243 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:34.481297 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ad38a31-b0a7-490e-a749-c2fc0b1dd243 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:34.481769 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ad38a31-b0a7-490e-a749-c2fc0b1dd243 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:34.482468 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ad38a31-b0a7-490e-a749-c2fc0b1dd243 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:34.482929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ad38a31-b0a7-490e-a749-c2fc0b1dd243 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:34.483356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ad38a31-b0a7-490e-a749-c2fc0b1dd243 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:34.618385 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9ad38a31-b0a7-490e-a749-c2fc0b1dd243 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:34.627653 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9ad38a31-b0a7-490e-a749-c2fc0b1dd243 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1695 microversion: 2.1 time: 0.159018 Oct 05 03:08:34.628433 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3174/6334] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:34 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:35.651922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9f597bef-516a-46eb-a134-ea519fd6631c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:35.652611 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9f597bef-516a-46eb-a134-ea519fd6631c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:35.659771 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9f597bef-516a-46eb-a134-ea519fd6631c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:35.660268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9f597bef-516a-46eb-a134-ea519fd6631c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:35.667155 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9f597bef-516a-46eb-a134-ea519fd6631c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:35.667155 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9f597bef-516a-46eb-a134-ea519fd6631c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:35.667155 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9f597bef-516a-46eb-a134-ea519fd6631c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:35.667155 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9f597bef-516a-46eb-a134-ea519fd6631c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:35.798490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9f597bef-516a-46eb-a134-ea519fd6631c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:35.807031 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9f597bef-516a-46eb-a134-ea519fd6631c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1695 microversion: 2.1 time: 0.159352 Oct 05 03:08:35.807775 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3161/6335] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:35 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:36.831513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-52abad7e-c3f8-41ea-af80-d8d03c5148fa tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:36.832131 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-52abad7e-c3f8-41ea-af80-d8d03c5148fa tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:36.839686 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52abad7e-c3f8-41ea-af80-d8d03c5148fa tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:36.840172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52abad7e-c3f8-41ea-af80-d8d03c5148fa tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:36.840612 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52abad7e-c3f8-41ea-af80-d8d03c5148fa tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:36.841330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52abad7e-c3f8-41ea-af80-d8d03c5148fa tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:36.841786 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52abad7e-c3f8-41ea-af80-d8d03c5148fa tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:36.842214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52abad7e-c3f8-41ea-af80-d8d03c5148fa tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:37.008430 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-52abad7e-c3f8-41ea-af80-d8d03c5148fa tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:37.017477 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-52abad7e-c3f8-41ea-af80-d8d03c5148fa tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1695 microversion: 2.1 time: 0.189891 Oct 05 03:08:37.018336 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3175/6336] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:36 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1695 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:38.042989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-994216c0-a290-4742-a252-6a96c3e965e3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:38.043537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-994216c0-a290-4742-a252-6a96c3e965e3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:38.050521 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-994216c0-a290-4742-a252-6a96c3e965e3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:38.051015 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-994216c0-a290-4742-a252-6a96c3e965e3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:38.051455 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-994216c0-a290-4742-a252-6a96c3e965e3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:38.052154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-994216c0-a290-4742-a252-6a96c3e965e3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:38.052614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-994216c0-a290-4742-a252-6a96c3e965e3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:38.053077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-994216c0-a290-4742-a252-6a96c3e965e3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:38.205465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-994216c0-a290-4742-a252-6a96c3e965e3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:38.214511 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-994216c0-a290-4742-a252-6a96c3e965e3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1695 microversion: 2.1 time: 0.176042 Oct 05 03:08:38.215130 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3162/6337] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:38 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1695 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:39.239450 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-024147f8-e647-444a-b356-2f885fc6c6e6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:39.240551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-024147f8-e647-444a-b356-2f885fc6c6e6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:39.250157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-024147f8-e647-444a-b356-2f885fc6c6e6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:39.251018 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-024147f8-e647-444a-b356-2f885fc6c6e6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:39.251478 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-024147f8-e647-444a-b356-2f885fc6c6e6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:39.252196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-024147f8-e647-444a-b356-2f885fc6c6e6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:39.253015 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-024147f8-e647-444a-b356-2f885fc6c6e6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:39.253745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-024147f8-e647-444a-b356-2f885fc6c6e6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:39.408207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-024147f8-e647-444a-b356-2f885fc6c6e6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:39.417516 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-024147f8-e647-444a-b356-2f885fc6c6e6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1695 microversion: 2.1 time: 0.183243 Oct 05 03:08:39.418118 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3176/6338] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:39 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1695 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:40.441554 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e620cf45-3c50-489b-99c7-df2fdfd834af tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:40.442198 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e620cf45-3c50-489b-99c7-df2fdfd834af tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:40.449972 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e620cf45-3c50-489b-99c7-df2fdfd834af tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:40.450507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e620cf45-3c50-489b-99c7-df2fdfd834af tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:40.450946 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e620cf45-3c50-489b-99c7-df2fdfd834af tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:40.451640 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e620cf45-3c50-489b-99c7-df2fdfd834af tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:40.452093 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e620cf45-3c50-489b-99c7-df2fdfd834af tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:40.452515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e620cf45-3c50-489b-99c7-df2fdfd834af tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:40.543157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-adfcada3-d35f-4368-a0be-3c039f6b457e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e9c4105-a473-413c-a933-398afb1b1970"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:08:40.545592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-adfcada3-d35f-4368-a0be-3c039f6b457e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4e3cdf79-2ab1-4e8f-b132-075fb38000da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:40.553813 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-adfcada3-d35f-4368-a0be-3c039f6b457e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:40.554297 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-adfcada3-d35f-4368-a0be-3c039f6b457e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:40.554732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-adfcada3-d35f-4368-a0be-3c039f6b457e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:40.555419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-adfcada3-d35f-4368-a0be-3c039f6b457e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:40.556835 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-adfcada3-d35f-4368-a0be-3c039f6b457e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:40.557477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-adfcada3-d35f-4368-a0be-3c039f6b457e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:40.610433 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e620cf45-3c50-489b-99c7-df2fdfd834af tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:40.639311 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e620cf45-3c50-489b-99c7-df2fdfd834af tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1695 microversion: 2.1 time: 0.201782 Oct 05 03:08:40.661834 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3163/6339] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:40 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1695 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:40.666344 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-adfcada3-d35f-4368-a0be-3c039f6b457e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] HTTP exception thrown: Invalid volume: volume 5e9c4105-a473-413c-a933-398afb1b1970 is already attached to instances: 4e3cdf79-2ab1-4e8f-b132-075fb38000da Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-adfcada3-d35f-4368-a0be-3c039f6b457e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Request method failure captured: Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da/os-volume_attachments HTTP/1.1 Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 74 Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPQLbaCJcQoINHOY2GKTbE6oK5DZKXlvS9cTUJZgUsjhzJ11GCBMxKRG2ZW2HydnkNGtZ8u98fUAxnzQFqGG-K-d7yptqwDawf-PQoraVusgo1XYypQQkhEqqbJdJFh02G9QsSpvTDhdtNr6cnzMOTz-5c9_S6hWETgH6FWjUbmuXPI Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 7b99b6a5b1764f64a68793f37d4f9b96 Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 7b99b6a5b1764f64a68793f37d4f9b96 Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-AttachVolumeNegativeTest-2082311660-project Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 881baf1ede7e4fb5acf65268a81241ad Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-AttachVolumeNegativeTest-2082311660-project Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: {"volumeAttachment": {"volumeId": "5e9c4105-a473-413c-a933-398afb1b1970"}} Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: exception: Invalid volume: volume 5e9c4105-a473-413c-a933-398afb1b1970 is already attached to instances: 4e3cdf79-2ab1-4e8f-b132-075fb38000da Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'server_id': '4e3cdf79-2ab1-4e8f-b132-075fb38000da', 'body': {'volumeAttachment': {'volumeId': '5e9c4105-a473-413c-a933-398afb1b1970'}}} Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5e9c4105-a473-413c-a933-398afb1b1970 is already attached to instances: 4e3cdf79-2ab1-4e8f-b132-075fb38000da Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 03:08:40.669547 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 03:08:40.674903 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 03:08:40.674903 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 03:08:40.674903 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 05 03:08:40.674903 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 05 03:08:40.674903 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5e9c4105-a473-413c-a933-398afb1b1970 is already attached to instances: 4e3cdf79-2ab1-4e8f-b132-075fb38000da Oct 05 03:08:40.674903 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:08:40.674903 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:08:40.674903 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:08:40.674903 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:08:40.674903 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:08:40.674903 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:08:40.674903 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:08:40.674903 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:08:40.674903 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5e9c4105-a473-413c-a933-398afb1b1970 is already attached to instances: 4e3cdf79-2ab1-4e8f-b132-075fb38000da Oct 05 03:08:40.674903 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:08:40.674903 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-adfcada3-d35f-4368-a0be-3c039f6b457e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Returning 400 to user: Invalid volume: volume 5e9c4105-a473-413c-a933-398afb1b1970 is already attached to instances: 4e3cdf79-2ab1-4e8f-b132-075fb38000da {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:08:40.674903 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-adfcada3-d35f-4368-a0be-3c039f6b457e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "POST /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.132133 Oct 05 03:08:40.674903 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3177/6340] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 03:08:40 2022] POST /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da/os-volume_attachments => generated 174 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 05 03:08:40.782410 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0dcf5702-ece8-40ce-b9e6-f42a22c83874 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:40.782914 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0dcf5702-ece8-40ce-b9e6-f42a22c83874 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4e3cdf79-2ab1-4e8f-b132-075fb38000da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:40.789238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0dcf5702-ece8-40ce-b9e6-f42a22c83874 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:40.789729 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0dcf5702-ece8-40ce-b9e6-f42a22c83874 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:40.790740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0dcf5702-ece8-40ce-b9e6-f42a22c83874 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:40.791512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0dcf5702-ece8-40ce-b9e6-f42a22c83874 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:40.791968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0dcf5702-ece8-40ce-b9e6-f42a22c83874 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:40.792552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0dcf5702-ece8-40ce-b9e6-f42a22c83874 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:40.904487 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-0dcf5702-ece8-40ce-b9e6-f42a22c83874 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lazy-loading 'services' on Instance uuid 4e3cdf79-2ab1-4e8f-b132-075fb38000da {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:08:40.996492 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0dcf5702-ece8-40ce-b9e6-f42a22c83874 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da/os-volume_attachments/5e9c4105-a473-413c-a933-398afb1b1970" status: 202 len: 0 microversion: 2.1 time: 0.218278 Oct 05 03:08:41.007706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6fb5b54e-4fe1-413c-b2f0-c51bdda2cb25 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:41.008529 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3164/6341] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 03:08:40 2022] DELETE /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da/os-volume_attachments/5e9c4105-a473-413c-a933-398afb1b1970 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:08:41.011753 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6fb5b54e-4fe1-413c-b2f0-c51bdda2cb25 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4e3cdf79-2ab1-4e8f-b132-075fb38000da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:41.021770 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6fb5b54e-4fe1-413c-b2f0-c51bdda2cb25 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:41.022281 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6fb5b54e-4fe1-413c-b2f0-c51bdda2cb25 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:41.022648 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6fb5b54e-4fe1-413c-b2f0-c51bdda2cb25 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:41.023724 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6fb5b54e-4fe1-413c-b2f0-c51bdda2cb25 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:41.027039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6fb5b54e-4fe1-413c-b2f0-c51bdda2cb25 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:41.028065 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6fb5b54e-4fe1-413c-b2f0-c51bdda2cb25 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:41.099946 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6fb5b54e-4fe1-413c-b2f0-c51bdda2cb25 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096469 Oct 05 03:08:41.107734 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3178/6342] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:08:41 2022] GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:08:41.671613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-23d0e208-f57c-4e2a-8e92-6653fbf1b796 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:41.672413 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-23d0e208-f57c-4e2a-8e92-6653fbf1b796 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:41.681911 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23d0e208-f57c-4e2a-8e92-6653fbf1b796 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:41.682460 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23d0e208-f57c-4e2a-8e92-6653fbf1b796 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:41.682977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23d0e208-f57c-4e2a-8e92-6653fbf1b796 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:41.683763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23d0e208-f57c-4e2a-8e92-6653fbf1b796 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:41.684297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23d0e208-f57c-4e2a-8e92-6653fbf1b796 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:41.684838 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23d0e208-f57c-4e2a-8e92-6653fbf1b796 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:41.860956 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-23d0e208-f57c-4e2a-8e92-6653fbf1b796 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:41.872266 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-23d0e208-f57c-4e2a-8e92-6653fbf1b796 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1695 microversion: 2.1 time: 0.207879 Oct 05 03:08:41.873702 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3165/6343] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:41 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1695 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:42.114977 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a6feadbf-26f4-4b37-beba-9dacd58cd1cc tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:42.117725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a6feadbf-26f4-4b37-beba-9dacd58cd1cc tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4e3cdf79-2ab1-4e8f-b132-075fb38000da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:42.135270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6feadbf-26f4-4b37-beba-9dacd58cd1cc tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:42.136229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6feadbf-26f4-4b37-beba-9dacd58cd1cc tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:42.136674 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6feadbf-26f4-4b37-beba-9dacd58cd1cc tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:42.137432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6feadbf-26f4-4b37-beba-9dacd58cd1cc tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:42.137974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6feadbf-26f4-4b37-beba-9dacd58cd1cc tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:42.138302 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6feadbf-26f4-4b37-beba-9dacd58cd1cc tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:42.184717 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a6feadbf-26f4-4b37-beba-9dacd58cd1cc tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073500 Oct 05 03:08:42.186429 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3179/6344] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:08:42 2022] GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:08:42.897320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e5da2e17-1f3a-4129-aee6-27fbbec990aa tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:42.898013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e5da2e17-1f3a-4129-aee6-27fbbec990aa tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:42.907129 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5da2e17-1f3a-4129-aee6-27fbbec990aa tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:42.907784 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5da2e17-1f3a-4129-aee6-27fbbec990aa tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:42.908291 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5da2e17-1f3a-4129-aee6-27fbbec990aa tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:42.909301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5da2e17-1f3a-4129-aee6-27fbbec990aa tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:42.909824 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5da2e17-1f3a-4129-aee6-27fbbec990aa tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:42.910469 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5da2e17-1f3a-4129-aee6-27fbbec990aa tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:43.057940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e5da2e17-1f3a-4129-aee6-27fbbec990aa tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:43.071678 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e5da2e17-1f3a-4129-aee6-27fbbec990aa tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1695 microversion: 2.1 time: 0.178625 Oct 05 03:08:43.075688 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3166/6345] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:42 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1695 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:43.205446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f7c4f840-510c-448b-bebf-5d4d3303eeeb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:43.207658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f7c4f840-510c-448b-bebf-5d4d3303eeeb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4e3cdf79-2ab1-4e8f-b132-075fb38000da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:43.218195 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7c4f840-510c-448b-bebf-5d4d3303eeeb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:43.218960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7c4f840-510c-448b-bebf-5d4d3303eeeb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:43.222168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7c4f840-510c-448b-bebf-5d4d3303eeeb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:43.222993 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7c4f840-510c-448b-bebf-5d4d3303eeeb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:43.223401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7c4f840-510c-448b-bebf-5d4d3303eeeb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:43.223975 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f7c4f840-510c-448b-bebf-5d4d3303eeeb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:43.265176 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f7c4f840-510c-448b-bebf-5d4d3303eeeb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070728 Oct 05 03:08:43.265997 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3180/6346] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:08:43 2022] GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:08:44.097005 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1d9327d0-94a9-4e72-a2cb-4b2d168e1d3e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:44.097621 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1d9327d0-94a9-4e72-a2cb-4b2d168e1d3e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:44.104933 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d9327d0-94a9-4e72-a2cb-4b2d168e1d3e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:44.105435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d9327d0-94a9-4e72-a2cb-4b2d168e1d3e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:44.105867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d9327d0-94a9-4e72-a2cb-4b2d168e1d3e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:44.106563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d9327d0-94a9-4e72-a2cb-4b2d168e1d3e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:44.107020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d9327d0-94a9-4e72-a2cb-4b2d168e1d3e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:44.107443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d9327d0-94a9-4e72-a2cb-4b2d168e1d3e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:44.241598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1d9327d0-94a9-4e72-a2cb-4b2d168e1d3e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:44.253342 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1d9327d0-94a9-4e72-a2cb-4b2d168e1d3e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1695 microversion: 2.1 time: 0.160029 Oct 05 03:08:44.254063 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3167/6347] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:44 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:44.278386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c2fff23c-a0ea-4c9f-9b37-edfe8a8def4f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:44.280574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c2fff23c-a0ea-4c9f-9b37-edfe8a8def4f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4e3cdf79-2ab1-4e8f-b132-075fb38000da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:44.287707 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2fff23c-a0ea-4c9f-9b37-edfe8a8def4f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:44.288199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2fff23c-a0ea-4c9f-9b37-edfe8a8def4f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:44.288645 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2fff23c-a0ea-4c9f-9b37-edfe8a8def4f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:44.289367 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2fff23c-a0ea-4c9f-9b37-edfe8a8def4f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:44.290921 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2fff23c-a0ea-4c9f-9b37-edfe8a8def4f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:44.291439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c2fff23c-a0ea-4c9f-9b37-edfe8a8def4f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:44.317774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:08:44.323916 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c2fff23c-a0ea-4c9f-9b37-edfe8a8def4f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050050 Oct 05 03:08:44.324502 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3181/6348] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:08:44 2022] GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:08:45.335787 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e4eee90b-c3ed-41ec-b06f-24c801bfbfa4 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:45.338373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e4eee90b-c3ed-41ec-b06f-24c801bfbfa4 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4e3cdf79-2ab1-4e8f-b132-075fb38000da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:45.347240 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4eee90b-c3ed-41ec-b06f-24c801bfbfa4 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:45.347802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4eee90b-c3ed-41ec-b06f-24c801bfbfa4 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:45.348293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4eee90b-c3ed-41ec-b06f-24c801bfbfa4 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:45.349503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4eee90b-c3ed-41ec-b06f-24c801bfbfa4 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:45.350174 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4eee90b-c3ed-41ec-b06f-24c801bfbfa4 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:45.350900 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4eee90b-c3ed-41ec-b06f-24c801bfbfa4 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:45.388131 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e4eee90b-c3ed-41ec-b06f-24c801bfbfa4 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056269 Oct 05 03:08:45.389563 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3182/6349] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:08:45 2022] GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:08:45.571587 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-de5737d5-485d-443c-9c4f-350d69b2f864 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:45.572806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-de5737d5-485d-443c-9c4f-350d69b2f864 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:45.579364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-de5737d5-485d-443c-9c4f-350d69b2f864 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:45.582383 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-de5737d5-485d-443c-9c4f-350d69b2f864 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:45.585348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-de5737d5-485d-443c-9c4f-350d69b2f864 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:45.586115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-de5737d5-485d-443c-9c4f-350d69b2f864 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:45.589377 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-de5737d5-485d-443c-9c4f-350d69b2f864 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:45.590912 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-de5737d5-485d-443c-9c4f-350d69b2f864 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:45.778713 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-9186455b-c077-410c-a769-eb4952fa9ed4 req-ae8ae1fc-56d9-4a6c-8323-c45e63e78ccc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed", "name": "network-vif-unplugged", "status": "completed", "tag": "66189cc2-bc2e-49ce-91a4-6d9acf4efc4e"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:08:45.788504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9186455b-c077-410c-a769-eb4952fa9ed4 req-ae8ae1fc-56d9-4a6c-8323-c45e63e78ccc service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:45.789455 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9186455b-c077-410c-a769-eb4952fa9ed4 req-ae8ae1fc-56d9-4a6c-8323-c45e63e78ccc service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:45.790053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9186455b-c077-410c-a769-eb4952fa9ed4 req-ae8ae1fc-56d9-4a6c-8323-c45e63e78ccc service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:45.821373 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-9186455b-c077-410c-a769-eb4952fa9ed4 req-ae8ae1fc-56d9-4a6c-8323-c45e63e78ccc service nova] Creating event network-vif-unplugged:66189cc2-bc2e-49ce-91a4-6d9acf4efc4e for instance a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed on n-h1-858272-3 Oct 05 03:08:45.829468 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [req-9186455b-c077-410c-a769-eb4952fa9ed4 req-ae8ae1fc-56d9-4a6c-8323-c45e63e78ccc service nova] Instance a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122319) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 03:08:45.843107 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-9186455b-c077-410c-a769-eb4952fa9ed4 req-ae8ae1fc-56d9-4a6c-8323-c45e63e78ccc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067987 Oct 05 03:08:45.844345 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3183/6350] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:08:45.849370 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-de5737d5-485d-443c-9c4f-350d69b2f864 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:45.863739 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-de5737d5-485d-443c-9c4f-350d69b2f864 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1694 microversion: 2.1 time: 0.589820 Oct 05 03:08:45.877953 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3168/6351] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:45 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1694 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:46.402859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3f4f01f0-5bfb-4a64-af67-c282df9a3863 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:46.406714 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3f4f01f0-5bfb-4a64-af67-c282df9a3863 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4e3cdf79-2ab1-4e8f-b132-075fb38000da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:46.415113 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f4f01f0-5bfb-4a64-af67-c282df9a3863 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:46.416016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f4f01f0-5bfb-4a64-af67-c282df9a3863 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:46.416589 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f4f01f0-5bfb-4a64-af67-c282df9a3863 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:46.417637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f4f01f0-5bfb-4a64-af67-c282df9a3863 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:46.418167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f4f01f0-5bfb-4a64-af67-c282df9a3863 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:46.418607 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f4f01f0-5bfb-4a64-af67-c282df9a3863 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:46.459035 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3f4f01f0-5bfb-4a64-af67-c282df9a3863 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061018 Oct 05 03:08:46.459987 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3184/6352] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:08:46 2022] GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 03:08:46.534959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-62659478-6739-40fc-8bce-a3bb86159f38 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:46.535623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-62659478-6739-40fc-8bce-a3bb86159f38 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4e3cdf79-2ab1-4e8f-b132-075fb38000da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:46.544138 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-62659478-6739-40fc-8bce-a3bb86159f38 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:46.544740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-62659478-6739-40fc-8bce-a3bb86159f38 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:46.545303 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-62659478-6739-40fc-8bce-a3bb86159f38 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:46.546584 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-62659478-6739-40fc-8bce-a3bb86159f38 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:46.547160 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-62659478-6739-40fc-8bce-a3bb86159f38 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:46.547665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-62659478-6739-40fc-8bce-a3bb86159f38 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:46.578650 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-62659478-6739-40fc-8bce-a3bb86159f38 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4e3cdf79-2ab1-4e8f-b132-075fb38000da] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:08:46.683737 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-62659478-6739-40fc-8bce-a3bb86159f38 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da" status: 204 len: 0 microversion: 2.1 time: 0.152085 Oct 05 03:08:46.684351 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3169/6353] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:08:46 2022] DELETE /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 03:08:46.692415 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0d84ffba-0d49-4b66-b958-a25677737cef tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:46.693097 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0d84ffba-0d49-4b66-b958-a25677737cef tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4e3cdf79-2ab1-4e8f-b132-075fb38000da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:46.699439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0d84ffba-0d49-4b66-b958-a25677737cef tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:46.699926 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0d84ffba-0d49-4b66-b958-a25677737cef tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:46.700358 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0d84ffba-0d49-4b66-b958-a25677737cef tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:46.701082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0d84ffba-0d49-4b66-b958-a25677737cef tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:46.701528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0d84ffba-0d49-4b66-b958-a25677737cef tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:46.702155 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0d84ffba-0d49-4b66-b958-a25677737cef tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:46.891361 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4e89f821-be2d-410b-a882-56d82277695c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:46.892419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4e89f821-be2d-410b-a882-56d82277695c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:46.898613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e89f821-be2d-410b-a882-56d82277695c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:46.899489 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e89f821-be2d-410b-a882-56d82277695c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:46.899836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e89f821-be2d-410b-a882-56d82277695c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:46.900624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e89f821-be2d-410b-a882-56d82277695c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:46.901176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e89f821-be2d-410b-a882-56d82277695c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:46.901674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e89f821-be2d-410b-a882-56d82277695c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:46.916406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0d84ffba-0d49-4b66-b958-a25677737cef tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:46.930299 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0d84ffba-0d49-4b66-b958-a25677737cef tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da" status: 200 len: 1682 microversion: 2.1 time: 0.241167 Oct 05 03:08:46.932257 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3185/6354] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:46 2022] GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da => generated 1682 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:47.061448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4e89f821-be2d-410b-a882-56d82277695c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:47.072800 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4e89f821-be2d-410b-a882-56d82277695c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1694 microversion: 2.1 time: 0.185529 Oct 05 03:08:47.073471 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3170/6355] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:46 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1694 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:47.863988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-595a306a-0fcb-4a23-845b-c07149e4a2ad req-06872b70-8091-4135-bbdb-a22e1bae1dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed", "tag": "66189cc2-bc2e-49ce-91a4-6d9acf4efc4e"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:08:47.874499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-595a306a-0fcb-4a23-845b-c07149e4a2ad req-06872b70-8091-4135-bbdb-a22e1bae1dd3 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:47.874979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-595a306a-0fcb-4a23-845b-c07149e4a2ad req-06872b70-8091-4135-bbdb-a22e1bae1dd3 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:47.875426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-595a306a-0fcb-4a23-845b-c07149e4a2ad req-06872b70-8091-4135-bbdb-a22e1bae1dd3 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:47.887983 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-595a306a-0fcb-4a23-845b-c07149e4a2ad req-06872b70-8091-4135-bbdb-a22e1bae1dd3 service nova] Creating event network-changed:66189cc2-bc2e-49ce-91a4-6d9acf4efc4e for instance a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed on n-h1-858272-3 Oct 05 03:08:47.893649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [req-595a306a-0fcb-4a23-845b-c07149e4a2ad req-06872b70-8091-4135-bbdb-a22e1bae1dd3 service nova] Instance a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122319) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 03:08:47.905240 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-595a306a-0fcb-4a23-845b-c07149e4a2ad req-06872b70-8091-4135-bbdb-a22e1bae1dd3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044975 Oct 05 03:08:47.905857 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3186/6356] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:08:47.956017 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6f4ddc74-ef7c-4378-b328-5bd61a4248a9 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:47.956888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6f4ddc74-ef7c-4378-b328-5bd61a4248a9 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4e3cdf79-2ab1-4e8f-b132-075fb38000da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:47.969129 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f4ddc74-ef7c-4378-b328-5bd61a4248a9 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:47.970566 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f4ddc74-ef7c-4378-b328-5bd61a4248a9 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:47.972009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f4ddc74-ef7c-4378-b328-5bd61a4248a9 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:47.974138 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f4ddc74-ef7c-4378-b328-5bd61a4248a9 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:47.974609 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f4ddc74-ef7c-4378-b328-5bd61a4248a9 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:47.975038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f4ddc74-ef7c-4378-b328-5bd61a4248a9 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:47.980465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:08:48.098470 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2f9dddc0-83ce-4cca-93bc-8be6cde6ed9d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:48.099528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2f9dddc0-83ce-4cca-93bc-8be6cde6ed9d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:48.108460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f9dddc0-83ce-4cca-93bc-8be6cde6ed9d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:48.109412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f9dddc0-83ce-4cca-93bc-8be6cde6ed9d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:48.109934 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f9dddc0-83ce-4cca-93bc-8be6cde6ed9d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:48.110776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f9dddc0-83ce-4cca-93bc-8be6cde6ed9d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:48.111506 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f9dddc0-83ce-4cca-93bc-8be6cde6ed9d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:48.111946 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f9dddc0-83ce-4cca-93bc-8be6cde6ed9d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:48.625043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6f4ddc74-ef7c-4378-b328-5bd61a4248a9 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:48.633680 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6f4ddc74-ef7c-4378-b328-5bd61a4248a9 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da" status: 200 len: 1682 microversion: 2.1 time: 0.681489 Oct 05 03:08:48.635738 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3171/6357] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:47 2022] GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da => generated 1682 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:48.709979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2f9dddc0-83ce-4cca-93bc-8be6cde6ed9d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:48.720341 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2f9dddc0-83ce-4cca-93bc-8be6cde6ed9d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1692 microversion: 2.1 time: 0.626301 Oct 05 03:08:48.721685 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3187/6358] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:48 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1692 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:08:49.451368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-11549a0f-e55f-4fb7-a31c-d54c7423d694 req-fd65a50b-d548-41c1-a96d-4ee6763031ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e3cdf79-2ab1-4e8f-b132-075fb38000da", "name": "network-vif-deleted", "tag": "d616f44d-9273-4159-95a1-3938762de913"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:08:49.463597 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-11549a0f-e55f-4fb7-a31c-d54c7423d694 req-fd65a50b-d548-41c1-a96d-4ee6763031ac service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:49.464137 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-11549a0f-e55f-4fb7-a31c-d54c7423d694 req-fd65a50b-d548-41c1-a96d-4ee6763031ac service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:49.464575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-11549a0f-e55f-4fb7-a31c-d54c7423d694 req-fd65a50b-d548-41c1-a96d-4ee6763031ac service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:49.476994 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-11549a0f-e55f-4fb7-a31c-d54c7423d694 req-fd65a50b-d548-41c1-a96d-4ee6763031ac service nova] Creating event network-vif-deleted:d616f44d-9273-4159-95a1-3938762de913 for instance 4e3cdf79-2ab1-4e8f-b132-075fb38000da on n-h2-858272-3 Oct 05 03:08:49.483329 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-11549a0f-e55f-4fb7-a31c-d54c7423d694 req-fd65a50b-d548-41c1-a96d-4ee6763031ac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036084 Oct 05 03:08:49.488124 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3172/6359] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:08:49.663901 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2fc0f237-9092-4872-8ac7-4cf4357670fe tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:49.664854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2fc0f237-9092-4872-8ac7-4cf4357670fe tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4e3cdf79-2ab1-4e8f-b132-075fb38000da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:49.688006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fc0f237-9092-4872-8ac7-4cf4357670fe tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:49.693195 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fc0f237-9092-4872-8ac7-4cf4357670fe tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:49.693883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fc0f237-9092-4872-8ac7-4cf4357670fe tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:49.695826 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fc0f237-9092-4872-8ac7-4cf4357670fe tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:49.697735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fc0f237-9092-4872-8ac7-4cf4357670fe tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:49.698509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fc0f237-9092-4872-8ac7-4cf4357670fe tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:49.754964 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d847d641-c81c-4695-b369-15b126b1d608 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:49.759641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d847d641-c81c-4695-b369-15b126b1d608 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:49.763096 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fc0f237-9092-4872-8ac7-4cf4357670fe tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:49.774083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fc0f237-9092-4872-8ac7-4cf4357670fe tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:49.775334 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fc0f237-9092-4872-8ac7-4cf4357670fe tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:49.776073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-2fc0f237-9092-4872-8ac7-4cf4357670fe tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lazy-loading 'fault' on Instance uuid 4e3cdf79-2ab1-4e8f-b132-075fb38000da {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:08:49.779924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d847d641-c81c-4695-b369-15b126b1d608 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:49.780870 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d847d641-c81c-4695-b369-15b126b1d608 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:49.783382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d847d641-c81c-4695-b369-15b126b1d608 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:49.784285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d847d641-c81c-4695-b369-15b126b1d608 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:49.786369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d847d641-c81c-4695-b369-15b126b1d608 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:49.787912 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d847d641-c81c-4695-b369-15b126b1d608 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:49.851714 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2fc0f237-9092-4872-8ac7-4cf4357670fe tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:49.862827 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2fc0f237-9092-4872-8ac7-4cf4357670fe tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da" status: 200 len: 1332 microversion: 2.1 time: 0.207970 Oct 05 03:08:49.874235 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3188/6360] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:49 2022] GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da => generated 1332 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:50.047087 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d847d641-c81c-4695-b369-15b126b1d608 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:50.061048 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d847d641-c81c-4695-b369-15b126b1d608 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1692 microversion: 2.1 time: 0.317009 Oct 05 03:08:50.062094 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3173/6361] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:49 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1692 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:50.887030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-94feee64-87fc-4bb6-bec9-9a6c236560af tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:50.887904 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-94feee64-87fc-4bb6-bec9-9a6c236560af tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4e3cdf79-2ab1-4e8f-b132-075fb38000da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:50.896228 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94feee64-87fc-4bb6-bec9-9a6c236560af tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:50.897011 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94feee64-87fc-4bb6-bec9-9a6c236560af tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:50.897780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94feee64-87fc-4bb6-bec9-9a6c236560af tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:50.899991 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94feee64-87fc-4bb6-bec9-9a6c236560af tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:50.900453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94feee64-87fc-4bb6-bec9-9a6c236560af tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:50.900883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94feee64-87fc-4bb6-bec9-9a6c236560af tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:50.919098 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-94feee64-87fc-4bb6-bec9-9a6c236560af tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] HTTP exception thrown: Instance 4e3cdf79-2ab1-4e8f-b132-075fb38000da could not be found. Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-94feee64-87fc-4bb6-bec9-9a6c236560af tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Request method failure captured: Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da HTTP/1.1 Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPQLbaCJcQoINHOY2GKTbE6oK5DZKXlvS9cTUJZgUsjhzJ11GCBMxKRG2ZW2HydnkNGtZ8u98fUAxnzQFqGG-K-d7yptqwDawf-PQoraVusgo1XYypQQkhEqqbJdJFh02G9QsSpvTDhdtNr6cnzMOTz-5c9_S6hWETgH6FWjUbmuXPI Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 7b99b6a5b1764f64a68793f37d4f9b96 Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 7b99b6a5b1764f64a68793f37d4f9b96 Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-AttachVolumeNegativeTest-2082311660-project Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 881baf1ede7e4fb5acf65268a81241ad Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-AttachVolumeNegativeTest-2082311660-project Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 4e3cdf79-2ab1-4e8f-b132-075fb38000da could not be found. Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '4e3cdf79-2ab1-4e8f-b132-075fb38000da'} Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e3cdf79-2ab1-4e8f-b132-075fb38000da could not be found. Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e3cdf79-2ab1-4e8f-b132-075fb38000da could not be found. Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:08:50.921084 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:08:50.927043 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:08:50.927043 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:08:50.927043 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:08:50.927043 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:08:50.927043 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:08:50.927043 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e3cdf79-2ab1-4e8f-b132-075fb38000da could not be found. Oct 05 03:08:50.927043 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:08:50.927043 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-94feee64-87fc-4bb6-bec9-9a6c236560af tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Returning 404 to user: Instance 4e3cdf79-2ab1-4e8f-b132-075fb38000da could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:08:50.927043 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-94feee64-87fc-4bb6-bec9-9a6c236560af tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da" status: 404 len: 111 microversion: 2.1 time: 0.039953 Oct 05 03:08:50.932526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-df60cb54-1578-446e-8b89-a05e0c54f458 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '.version_select at 0x7fcce804b550>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:50.937009 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3189/6362] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:50 2022] GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:08:50.945191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:08:50.960307 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-df60cb54-1578-446e-8b89-a05e0c54f458 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1923160457" status: 202 len: 0 microversion: 2.1 time: 0.032583 Oct 05 03:08:50.960929 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3174/6363] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 5 03:08:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1923160457 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 03:08:51.089935 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b820c7ae-ef41-4408-b4ad-18458e311852 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:51.090571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b820c7ae-ef41-4408-b4ad-18458e311852 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:51.109122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b820c7ae-ef41-4408-b4ad-18458e311852 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:51.109716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b820c7ae-ef41-4408-b4ad-18458e311852 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:51.110187 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b820c7ae-ef41-4408-b4ad-18458e311852 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:51.111004 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b820c7ae-ef41-4408-b4ad-18458e311852 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:51.111490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b820c7ae-ef41-4408-b4ad-18458e311852 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:51.112345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b820c7ae-ef41-4408-b4ad-18458e311852 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:51.333198 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b820c7ae-ef41-4408-b4ad-18458e311852 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:51.341988 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b820c7ae-ef41-4408-b4ad-18458e311852 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1689 microversion: 2.1 time: 0.257602 Oct 05 03:08:51.357292 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3190/6364] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:51 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1689 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:51.368449 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b128be4a-06a2-4c12-9e0f-2ea8998dc68f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:08:51.369431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b128be4a-06a2-4c12-9e0f-2ea8998dc68f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:51.379507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b128be4a-06a2-4c12-9e0f-2ea8998dc68f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:51.380273 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b128be4a-06a2-4c12-9e0f-2ea8998dc68f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:51.380940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b128be4a-06a2-4c12-9e0f-2ea8998dc68f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:51.382001 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b128be4a-06a2-4c12-9e0f-2ea8998dc68f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:51.382633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b128be4a-06a2-4c12-9e0f-2ea8998dc68f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:51.383235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b128be4a-06a2-4c12-9e0f-2ea8998dc68f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:51.537969 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b128be4a-06a2-4c12-9e0f-2ea8998dc68f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "POST /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed/action" status: 202 len: 0 microversion: 2.1 time: 0.173264 Oct 05 03:08:51.538727 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3175/6365] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:08:51 2022] POST /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:08:51.547910 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-96af46b9-d92f-46b0-80d5-764ad26fbdc5 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:51.548915 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-96af46b9-d92f-46b0-80d5-764ad26fbdc5 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:51.554965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96af46b9-d92f-46b0-80d5-764ad26fbdc5 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:51.556069 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96af46b9-d92f-46b0-80d5-764ad26fbdc5 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:51.556580 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96af46b9-d92f-46b0-80d5-764ad26fbdc5 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:51.557344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96af46b9-d92f-46b0-80d5-764ad26fbdc5 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:51.557804 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96af46b9-d92f-46b0-80d5-764ad26fbdc5 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:51.558233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96af46b9-d92f-46b0-80d5-764ad26fbdc5 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:51.778063 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7e76501d-d6da-47cc-9418-28d121f77e3c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Action: 'create', calling method: .version_select at 0x7fcce8097550>, body: {"keypair": {"name": "tempest-keypair-333353936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+d2JIsNGdg2qbKSzRk2fo1zIvvv5rXJcxWhcS+7ZImXn847gtQhXZ03nzanwcmxjtM20xDgMwzs2SUFsEriyjT1CAbQeK2bKuw0EqCvmhH7lZKVurin1GPsZSjdZJg7Q=="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:08:51.794057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-7e76501d-d6da-47cc-9418-28d121f77e3c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Getting quotas for project 7b99b6a5b1764f64a68793f37d4f9b96. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:08:51.800148 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-7e76501d-d6da-47cc-9418-28d121f77e3c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Getting quotas for user 881baf1ede7e4fb5acf65268a81241ad and project 7b99b6a5b1764f64a68793f37d4f9b96. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:08:51.828099 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7e76501d-d6da-47cc-9418-28d121f77e3c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054240 Oct 05 03:08:51.829313 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3176/6366] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 03:08:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:08:51.836084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-96af46b9-d92f-46b0-80d5-764ad26fbdc5 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:51.846420 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-96af46b9-d92f-46b0-80d5-764ad26fbdc5 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1688 microversion: 2.1 time: 0.302575 Oct 05 03:08:51.847596 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3191/6367] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:51 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1688 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:52.451510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-e47c410b-2314-476d-b974-24f898d5adcf req-d5a7f6ed-95b0-40c7-95c8-40cb543fa11a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed", "name": "network-vif-plugged", "status": "completed", "tag": "66189cc2-bc2e-49ce-91a4-6d9acf4efc4e"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:08:52.467026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e47c410b-2314-476d-b974-24f898d5adcf req-d5a7f6ed-95b0-40c7-95c8-40cb543fa11a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:52.467512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e47c410b-2314-476d-b974-24f898d5adcf req-d5a7f6ed-95b0-40c7-95c8-40cb543fa11a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:52.467943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e47c410b-2314-476d-b974-24f898d5adcf req-d5a7f6ed-95b0-40c7-95c8-40cb543fa11a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:52.481463 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-e47c410b-2314-476d-b974-24f898d5adcf req-d5a7f6ed-95b0-40c7-95c8-40cb543fa11a service nova] Creating event network-vif-plugged:66189cc2-bc2e-49ce-91a4-6d9acf4efc4e for instance a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed on n-h1-858272-3 Oct 05 03:08:52.499801 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [req-e47c410b-2314-476d-b974-24f898d5adcf req-d5a7f6ed-95b0-40c7-95c8-40cb543fa11a service nova] Instance a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 03:08:52.514778 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-e47c410b-2314-476d-b974-24f898d5adcf req-d5a7f6ed-95b0-40c7-95c8-40cb543fa11a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069846 Oct 05 03:08:52.515644 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3177/6368] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:08:52.870872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bc66a919-c8f0-4b4d-8446-45bfb19ee443 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:52.871488 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bc66a919-c8f0-4b4d-8446-45bfb19ee443 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:52.878948 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bc66a919-c8f0-4b4d-8446-45bfb19ee443 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:52.879440 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bc66a919-c8f0-4b4d-8446-45bfb19ee443 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:52.879875 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bc66a919-c8f0-4b4d-8446-45bfb19ee443 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:52.880567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bc66a919-c8f0-4b4d-8446-45bfb19ee443 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:52.881048 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bc66a919-c8f0-4b4d-8446-45bfb19ee443 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:52.881471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bc66a919-c8f0-4b4d-8446-45bfb19ee443 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:53.028858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bc66a919-c8f0-4b4d-8446-45bfb19ee443 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:53.039043 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bc66a919-c8f0-4b4d-8446-45bfb19ee443 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1688 microversion: 2.1 time: 0.172104 Oct 05 03:08:53.039925 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3192/6369] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:52 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:53.220036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fff19ebf-13b5-44b3-9870-2a2bf765e976 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1516041153", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dbc27df4-8913-4a58-8837-a72d1d361dca"}], "security_groups": [{"name": "tempest-securitygroup--1736855165"}], "key_name": "tempest-keypair-333353936", "user_data": "}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:08:53.329364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-fff19ebf-13b5-44b3-9870-2a2bf765e976 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] validate_networks() for [('dbc27df4-8913-4a58-8837-a72d1d361dca', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:08:53.719636 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-fff19ebf-13b5-44b3-9870-2a2bf765e976 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:08:53.720126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-fff19ebf-13b5-44b3-9870-2a2bf765e976 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:08:53.720514 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-fff19ebf-13b5-44b3-9870-2a2bf765e976 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:08:53.720970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-fff19ebf-13b5-44b3-9870-2a2bf765e976 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:08:53.721667 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-fff19ebf-13b5-44b3-9870-2a2bf765e976 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:08:53.731946 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fff19ebf-13b5-44b3-9870-2a2bf765e976 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:53.732437 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fff19ebf-13b5-44b3-9870-2a2bf765e976 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:53.733152 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fff19ebf-13b5-44b3-9870-2a2bf765e976 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:53.733896 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fff19ebf-13b5-44b3-9870-2a2bf765e976 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:53.734438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fff19ebf-13b5-44b3-9870-2a2bf765e976 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:53.734734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fff19ebf-13b5-44b3-9870-2a2bf765e976 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:53.755048 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-fff19ebf-13b5-44b3-9870-2a2bf765e976 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Getting quotas for project 7b99b6a5b1764f64a68793f37d4f9b96. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:08:53.760487 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-fff19ebf-13b5-44b3-9870-2a2bf765e976 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Getting quotas for user 881baf1ede7e4fb5acf65268a81241ad and project 7b99b6a5b1764f64a68793f37d4f9b96. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:08:53.775292 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fff19ebf-13b5-44b3-9870-2a2bf765e976 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:08:53.777763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fff19ebf-13b5-44b3-9870-2a2bf765e976 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 768c2f84-34f0-4885-9521-fb0c4fd09256] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:08:53.831941 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fff19ebf-13b5-44b3-9870-2a2bf765e976 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.616711 Oct 05 03:08:53.832970 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3178/6370] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:08:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:08:53.844479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cb721c43-6c86-42ca-8fae-7904965bcb9c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:53.845300 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cb721c43-6c86-42ca-8fae-7904965bcb9c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 768c2f84-34f0-4885-9521-fb0c4fd09256] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:53.905321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cb721c43-6c86-42ca-8fae-7904965bcb9c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:53.914157 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cb721c43-6c86-42ca-8fae-7904965bcb9c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256" status: 200 len: 1241 microversion: 2.1 time: 0.073643 Oct 05 03:08:53.914769 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3193/6371] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:53 2022] GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:54.066745 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-76ca6c50-166c-4274-90e5-4e05e6f2eb96 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:54.067816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-76ca6c50-166c-4274-90e5-4e05e6f2eb96 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:54.076486 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-76ca6c50-166c-4274-90e5-4e05e6f2eb96 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:54.077329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-76ca6c50-166c-4274-90e5-4e05e6f2eb96 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:54.077768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-76ca6c50-166c-4274-90e5-4e05e6f2eb96 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:54.078467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-76ca6c50-166c-4274-90e5-4e05e6f2eb96 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:54.079021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-76ca6c50-166c-4274-90e5-4e05e6f2eb96 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:54.079395 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-76ca6c50-166c-4274-90e5-4e05e6f2eb96 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:54.262519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-76ca6c50-166c-4274-90e5-4e05e6f2eb96 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:54.271961 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-76ca6c50-166c-4274-90e5-4e05e6f2eb96 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1688 microversion: 2.1 time: 0.211450 Oct 05 03:08:54.273256 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3179/6372] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:54 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1688 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:54.937605 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-18d144d1-3c61-4489-b68e-e26b491b6616 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:54.938221 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-18d144d1-3c61-4489-b68e-e26b491b6616 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 768c2f84-34f0-4885-9521-fb0c4fd09256] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:54.946718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-18d144d1-3c61-4489-b68e-e26b491b6616 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:54.947210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-18d144d1-3c61-4489-b68e-e26b491b6616 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:54.947880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-18d144d1-3c61-4489-b68e-e26b491b6616 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:54.948825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-18d144d1-3c61-4489-b68e-e26b491b6616 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:54.949467 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-18d144d1-3c61-4489-b68e-e26b491b6616 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:54.949898 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-18d144d1-3c61-4489-b68e-e26b491b6616 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:55.030502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-18d144d1-3c61-4489-b68e-e26b491b6616 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:55.039605 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-18d144d1-3c61-4489-b68e-e26b491b6616 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256" status: 200 len: 1293 microversion: 2.1 time: 0.105730 Oct 05 03:08:55.045002 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3194/6373] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:54 2022] GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256 => generated 1293 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:55.300243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ec05780a-1bab-48c0-9042-60b8b9a344c6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:55.300927 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ec05780a-1bab-48c0-9042-60b8b9a344c6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:55.315310 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec05780a-1bab-48c0-9042-60b8b9a344c6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:55.316110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec05780a-1bab-48c0-9042-60b8b9a344c6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:55.316599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec05780a-1bab-48c0-9042-60b8b9a344c6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:55.317412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec05780a-1bab-48c0-9042-60b8b9a344c6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:55.317880 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec05780a-1bab-48c0-9042-60b8b9a344c6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:55.318422 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec05780a-1bab-48c0-9042-60b8b9a344c6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:55.335850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-f780d2a7-a223-477d-8c0e-6f8a2cc90dcf req-80e1a3a2-a363-479e-89d0-b110315594fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed", "name": "network-vif-unplugged", "status": "completed", "tag": "66189cc2-bc2e-49ce-91a4-6d9acf4efc4e"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:08:55.352783 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f780d2a7-a223-477d-8c0e-6f8a2cc90dcf req-80e1a3a2-a363-479e-89d0-b110315594fe service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:55.353859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f780d2a7-a223-477d-8c0e-6f8a2cc90dcf req-80e1a3a2-a363-479e-89d0-b110315594fe service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:55.354658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f780d2a7-a223-477d-8c0e-6f8a2cc90dcf req-80e1a3a2-a363-479e-89d0-b110315594fe service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:55.378329 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-f780d2a7-a223-477d-8c0e-6f8a2cc90dcf req-80e1a3a2-a363-479e-89d0-b110315594fe service nova] Creating event network-vif-unplugged:66189cc2-bc2e-49ce-91a4-6d9acf4efc4e for instance a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed on n-h2-858272-3 Oct 05 03:08:55.385090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [req-f780d2a7-a223-477d-8c0e-6f8a2cc90dcf req-80e1a3a2-a363-479e-89d0-b110315594fe service nova] Instance a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122319) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 03:08:55.405269 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-f780d2a7-a223-477d-8c0e-6f8a2cc90dcf req-80e1a3a2-a363-479e-89d0-b110315594fe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065338 Oct 05 03:08:55.406289 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3195/6374] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:08:55.522704 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ec05780a-1bab-48c0-9042-60b8b9a344c6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:55.531546 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ec05780a-1bab-48c0-9042-60b8b9a344c6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1688 microversion: 2.1 time: 0.239102 Oct 05 03:08:55.532151 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3180/6375] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:55 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1688 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:56.064367 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2a8e6646-2ab1-499f-ba16-d1398e686b87 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:56.065112 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2a8e6646-2ab1-499f-ba16-d1398e686b87 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 768c2f84-34f0-4885-9521-fb0c4fd09256] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:56.077194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a8e6646-2ab1-499f-ba16-d1398e686b87 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:56.078080 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a8e6646-2ab1-499f-ba16-d1398e686b87 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:56.078990 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a8e6646-2ab1-499f-ba16-d1398e686b87 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:56.081397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a8e6646-2ab1-499f-ba16-d1398e686b87 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:56.083705 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a8e6646-2ab1-499f-ba16-d1398e686b87 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:56.084568 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a8e6646-2ab1-499f-ba16-d1398e686b87 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:56.444171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2a8e6646-2ab1-499f-ba16-d1398e686b87 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:56.462721 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2a8e6646-2ab1-499f-ba16-d1398e686b87 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256" status: 200 len: 1367 microversion: 2.1 time: 0.403121 Oct 05 03:08:56.468948 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3196/6376] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:56 2022] GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256 => generated 1367 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:56.558627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9be8c7fe-1c5d-4448-8050-dd18dec2a44e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:56.559485 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9be8c7fe-1c5d-4448-8050-dd18dec2a44e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:56.591161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9be8c7fe-1c5d-4448-8050-dd18dec2a44e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:56.598295 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9be8c7fe-1c5d-4448-8050-dd18dec2a44e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:56.599006 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9be8c7fe-1c5d-4448-8050-dd18dec2a44e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:56.600985 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9be8c7fe-1c5d-4448-8050-dd18dec2a44e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:56.601657 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9be8c7fe-1c5d-4448-8050-dd18dec2a44e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:56.605472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9be8c7fe-1c5d-4448-8050-dd18dec2a44e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:56.937783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9be8c7fe-1c5d-4448-8050-dd18dec2a44e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:56.950960 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9be8c7fe-1c5d-4448-8050-dd18dec2a44e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1688 microversion: 2.1 time: 0.396687 Oct 05 03:08:56.953213 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3181/6377] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:56 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1688 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:57.352360 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-b1cc9662-51bf-4d87-bfaf-3c44b2ea3ddc req-b4f3633d-eb36-4561-985b-cbf268830185 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "768c2f84-34f0-4885-9521-fb0c4fd09256", "tag": "99d40578-6e7f-48ee-895e-ceebb7732568"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:08:57.358365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=60 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:08:57.363969 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b1cc9662-51bf-4d87-bfaf-3c44b2ea3ddc req-b4f3633d-eb36-4561-985b-cbf268830185 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:57.364454 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b1cc9662-51bf-4d87-bfaf-3c44b2ea3ddc req-b4f3633d-eb36-4561-985b-cbf268830185 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:57.364998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b1cc9662-51bf-4d87-bfaf-3c44b2ea3ddc req-b4f3633d-eb36-4561-985b-cbf268830185 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:57.378072 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-b1cc9662-51bf-4d87-bfaf-3c44b2ea3ddc req-b4f3633d-eb36-4561-985b-cbf268830185 service nova] Creating event network-changed:99d40578-6e7f-48ee-895e-ceebb7732568 for instance 768c2f84-34f0-4885-9521-fb0c4fd09256 on n-h1-858272-3 Oct 05 03:08:57.382840 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-b1cc9662-51bf-4d87-bfaf-3c44b2ea3ddc req-b4f3633d-eb36-4561-985b-cbf268830185 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035297 Oct 05 03:08:57.383659 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3197/6378] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:08:57.450460 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-98ef8d38-71e6-4c7b-97a7-8bbd83f474d0 req-0c7cb2da-817e-4bae-a970-cd246bfa3903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed", "tag": "66189cc2-bc2e-49ce-91a4-6d9acf4efc4e"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:08:57.460687 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-98ef8d38-71e6-4c7b-97a7-8bbd83f474d0 req-0c7cb2da-817e-4bae-a970-cd246bfa3903 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:57.461742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-98ef8d38-71e6-4c7b-97a7-8bbd83f474d0 req-0c7cb2da-817e-4bae-a970-cd246bfa3903 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:57.462354 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-98ef8d38-71e6-4c7b-97a7-8bbd83f474d0 req-0c7cb2da-817e-4bae-a970-cd246bfa3903 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:57.476400 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-98ef8d38-71e6-4c7b-97a7-8bbd83f474d0 req-0c7cb2da-817e-4bae-a970-cd246bfa3903 service nova] Creating event network-changed:66189cc2-bc2e-49ce-91a4-6d9acf4efc4e for instance a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed on n-h2-858272-3 Oct 05 03:08:57.484724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [req-98ef8d38-71e6-4c7b-97a7-8bbd83f474d0 req-0c7cb2da-817e-4bae-a970-cd246bfa3903 service nova] Instance a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 03:08:57.486510 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-68f031f9-4231-4f38-afe3-63b990faa4fb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:57.487450 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-68f031f9-4231-4f38-afe3-63b990faa4fb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 768c2f84-34f0-4885-9521-fb0c4fd09256] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:57.495393 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68f031f9-4231-4f38-afe3-63b990faa4fb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:57.496088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68f031f9-4231-4f38-afe3-63b990faa4fb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:57.496971 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68f031f9-4231-4f38-afe3-63b990faa4fb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:57.497841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68f031f9-4231-4f38-afe3-63b990faa4fb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:57.498457 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68f031f9-4231-4f38-afe3-63b990faa4fb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:57.499047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68f031f9-4231-4f38-afe3-63b990faa4fb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:57.503822 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-98ef8d38-71e6-4c7b-97a7-8bbd83f474d0 req-0c7cb2da-817e-4bae-a970-cd246bfa3903 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056998 Oct 05 03:08:57.504611 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3182/6379] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:08:57.802439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-68f031f9-4231-4f38-afe3-63b990faa4fb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:57.811691 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-68f031f9-4231-4f38-afe3-63b990faa4fb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256" status: 200 len: 1367 microversion: 2.1 time: 0.329280 Oct 05 03:08:57.812529 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3198/6380] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:57 2022] GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256 => generated 1367 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:08:57.978621 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d1ad474e-f72a-4ec6-a939-185ebd306acc tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:57.979350 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d1ad474e-f72a-4ec6-a939-185ebd306acc tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:57.986117 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1ad474e-f72a-4ec6-a939-185ebd306acc tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:57.986622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1ad474e-f72a-4ec6-a939-185ebd306acc tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:57.987057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1ad474e-f72a-4ec6-a939-185ebd306acc tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:57.987770 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1ad474e-f72a-4ec6-a939-185ebd306acc tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:57.988222 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1ad474e-f72a-4ec6-a939-185ebd306acc tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:57.988648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d1ad474e-f72a-4ec6-a939-185ebd306acc tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:58.393912 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d1ad474e-f72a-4ec6-a939-185ebd306acc tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:58.403184 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d1ad474e-f72a-4ec6-a939-185ebd306acc tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1688 microversion: 2.1 time: 0.431032 Oct 05 03:08:58.404028 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3183/6381] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:57 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1688 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:58.835660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-de0c7c2c-5db3-4c80-98b6-a71c0376fe3d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:58.837312 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-de0c7c2c-5db3-4c80-98b6-a71c0376fe3d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 768c2f84-34f0-4885-9521-fb0c4fd09256] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:58.843722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de0c7c2c-5db3-4c80-98b6-a71c0376fe3d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:58.844205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de0c7c2c-5db3-4c80-98b6-a71c0376fe3d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:58.844644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de0c7c2c-5db3-4c80-98b6-a71c0376fe3d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:58.845365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de0c7c2c-5db3-4c80-98b6-a71c0376fe3d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:58.845815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de0c7c2c-5db3-4c80-98b6-a71c0376fe3d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:58.846239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de0c7c2c-5db3-4c80-98b6-a71c0376fe3d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:58.983106 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-de0c7c2c-5db3-4c80-98b6-a71c0376fe3d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:58.991041 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-de0c7c2c-5db3-4c80-98b6-a71c0376fe3d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256" status: 200 len: 1367 microversion: 2.1 time: 0.159229 Oct 05 03:08:58.991613 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3199/6382] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:58 2022] GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:08:59.437588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e502ddf1-202e-45b1-8ab9-1a3ee079e88b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:08:59.438437 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e502ddf1-202e-45b1-8ab9-1a3ee079e88b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:08:59.446703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e502ddf1-202e-45b1-8ab9-1a3ee079e88b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:59.447205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e502ddf1-202e-45b1-8ab9-1a3ee079e88b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:59.447648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e502ddf1-202e-45b1-8ab9-1a3ee079e88b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:59.448368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e502ddf1-202e-45b1-8ab9-1a3ee079e88b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:08:59.449001 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e502ddf1-202e-45b1-8ab9-1a3ee079e88b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:08:59.450336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e502ddf1-202e-45b1-8ab9-1a3ee079e88b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:08:59.608420 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e502ddf1-202e-45b1-8ab9-1a3ee079e88b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:08:59.616594 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e502ddf1-202e-45b1-8ab9-1a3ee079e88b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1688 microversion: 2.1 time: 0.182830 Oct 05 03:08:59.617308 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3184/6383] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:08:59 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1688 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:09:00.019202 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9309be6f-a76e-46e9-baf2-cd959678d5bb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:09:00.020412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9309be6f-a76e-46e9-baf2-cd959678d5bb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 768c2f84-34f0-4885-9521-fb0c4fd09256] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:09:00.027768 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9309be6f-a76e-46e9-baf2-cd959678d5bb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:00.028188 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9309be6f-a76e-46e9-baf2-cd959678d5bb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:00.028626 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9309be6f-a76e-46e9-baf2-cd959678d5bb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:00.029357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9309be6f-a76e-46e9-baf2-cd959678d5bb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:00.029910 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9309be6f-a76e-46e9-baf2-cd959678d5bb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:00.030447 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9309be6f-a76e-46e9-baf2-cd959678d5bb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:00.173119 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9309be6f-a76e-46e9-baf2-cd959678d5bb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:09:00.181386 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9309be6f-a76e-46e9-baf2-cd959678d5bb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256" status: 200 len: 1367 microversion: 2.1 time: 0.167177 Oct 05 03:09:00.182086 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3200/6384] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:09:00 2022] GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:09:00.641121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-abe4fd8e-aad4-4df4-b415-b8e3a93396e4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:09:00.642030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-abe4fd8e-aad4-4df4-b415-b8e3a93396e4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:09:00.650178 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-abe4fd8e-aad4-4df4-b415-b8e3a93396e4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:00.650822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-abe4fd8e-aad4-4df4-b415-b8e3a93396e4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:00.651361 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-abe4fd8e-aad4-4df4-b415-b8e3a93396e4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:00.652174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-abe4fd8e-aad4-4df4-b415-b8e3a93396e4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:00.652735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-abe4fd8e-aad4-4df4-b415-b8e3a93396e4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:00.653661 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-abe4fd8e-aad4-4df4-b415-b8e3a93396e4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:00.921268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-abe4fd8e-aad4-4df4-b415-b8e3a93396e4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:09:00.929347 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-abe4fd8e-aad4-4df4-b415-b8e3a93396e4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1681 microversion: 2.1 time: 0.292330 Oct 05 03:09:00.930341 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3185/6385] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:09:00 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1681 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:09:01.204802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5fd5c75a-6b19-497d-95e5-308c64bb3908 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:09:01.206226 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5fd5c75a-6b19-497d-95e5-308c64bb3908 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 768c2f84-34f0-4885-9521-fb0c4fd09256] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:09:01.214409 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5fd5c75a-6b19-497d-95e5-308c64bb3908 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:01.214908 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5fd5c75a-6b19-497d-95e5-308c64bb3908 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:01.215352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5fd5c75a-6b19-497d-95e5-308c64bb3908 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:01.216068 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5fd5c75a-6b19-497d-95e5-308c64bb3908 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:01.216526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5fd5c75a-6b19-497d-95e5-308c64bb3908 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:01.216985 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5fd5c75a-6b19-497d-95e5-308c64bb3908 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:01.239581 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:09:01.376538 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5fd5c75a-6b19-497d-95e5-308c64bb3908 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:09:01.386910 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5fd5c75a-6b19-497d-95e5-308c64bb3908 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256" status: 200 len: 1367 microversion: 2.1 time: 0.186606 Oct 05 03:09:01.396036 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3201/6386] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:09:01 2022] GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:09:02.410389 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-966ac541-c44f-4915-ad3e-fdc86562f7e6 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:09:02.411005 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-966ac541-c44f-4915-ad3e-fdc86562f7e6 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 768c2f84-34f0-4885-9521-fb0c4fd09256] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:09:02.418182 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-966ac541-c44f-4915-ad3e-fdc86562f7e6 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:02.418676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-966ac541-c44f-4915-ad3e-fdc86562f7e6 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:02.419112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-966ac541-c44f-4915-ad3e-fdc86562f7e6 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:02.419807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-966ac541-c44f-4915-ad3e-fdc86562f7e6 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:02.420263 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-966ac541-c44f-4915-ad3e-fdc86562f7e6 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:02.420687 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-966ac541-c44f-4915-ad3e-fdc86562f7e6 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:02.579581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-966ac541-c44f-4915-ad3e-fdc86562f7e6 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:09:02.590355 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-966ac541-c44f-4915-ad3e-fdc86562f7e6 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256" status: 200 len: 1367 microversion: 2.1 time: 0.183714 Oct 05 03:09:02.590966 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3186/6387] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:09:02 2022] GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:09:03.268304 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-7f705a53-9d75-4eb3-83f6-e481b9e23986 req-9fc96862-93fd-461f-af72-5b49e6e2c96c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed", "name": "network-vif-plugged", "status": "completed", "tag": "66189cc2-bc2e-49ce-91a4-6d9acf4efc4e"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:09:03.279004 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7f705a53-9d75-4eb3-83f6-e481b9e23986 req-9fc96862-93fd-461f-af72-5b49e6e2c96c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:03.279647 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7f705a53-9d75-4eb3-83f6-e481b9e23986 req-9fc96862-93fd-461f-af72-5b49e6e2c96c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:03.280089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7f705a53-9d75-4eb3-83f6-e481b9e23986 req-9fc96862-93fd-461f-af72-5b49e6e2c96c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:03.292402 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-7f705a53-9d75-4eb3-83f6-e481b9e23986 req-9fc96862-93fd-461f-af72-5b49e6e2c96c service nova] Creating event network-vif-plugged:66189cc2-bc2e-49ce-91a4-6d9acf4efc4e for instance a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed on n-h2-858272-3 Oct 05 03:09:03.297250 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-7f705a53-9d75-4eb3-83f6-e481b9e23986 req-9fc96862-93fd-461f-af72-5b49e6e2c96c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117041 Oct 05 03:09:03.297852 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3202/6388] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:09:03.613348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-640a029d-e907-410c-b0ba-971147c7244e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:09:03.614137 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-640a029d-e907-410c-b0ba-971147c7244e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 768c2f84-34f0-4885-9521-fb0c4fd09256] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:09:03.621613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-640a029d-e907-410c-b0ba-971147c7244e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:03.622171 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-640a029d-e907-410c-b0ba-971147c7244e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:03.622621 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-640a029d-e907-410c-b0ba-971147c7244e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:03.623331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-640a029d-e907-410c-b0ba-971147c7244e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:03.623775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-640a029d-e907-410c-b0ba-971147c7244e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:03.624207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-640a029d-e907-410c-b0ba-971147c7244e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:03.743015 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:09:03.759698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-640a029d-e907-410c-b0ba-971147c7244e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:09:03.767730 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-640a029d-e907-410c-b0ba-971147c7244e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256" status: 200 len: 1367 microversion: 2.1 time: 0.158613 Oct 05 03:09:03.768420 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3187/6389] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:09:03 2022] GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:09:04.790311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:09:04.795321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6ebad293-cd35-4275-9a42-be14d6edbbf0 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:09:04.796025 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6ebad293-cd35-4275-9a42-be14d6edbbf0 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 768c2f84-34f0-4885-9521-fb0c4fd09256] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:09:04.802596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ebad293-cd35-4275-9a42-be14d6edbbf0 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:04.803082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ebad293-cd35-4275-9a42-be14d6edbbf0 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:04.803517 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ebad293-cd35-4275-9a42-be14d6edbbf0 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:04.804205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ebad293-cd35-4275-9a42-be14d6edbbf0 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:04.804747 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ebad293-cd35-4275-9a42-be14d6edbbf0 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:04.805206 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ebad293-cd35-4275-9a42-be14d6edbbf0 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:04.947762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6ebad293-cd35-4275-9a42-be14d6edbbf0 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:09:04.955550 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6ebad293-cd35-4275-9a42-be14d6edbbf0 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256" status: 200 len: 1367 microversion: 2.1 time: 0.166890 Oct 05 03:09:04.956338 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3203/6390] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:09:04 2022] GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:09:05.316089 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-b0cefdd8-6dda-45a0-b42f-bad377f65fb1 req-2b7dc701-28d6-4285-8ae5-8e217d6a13a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "768c2f84-34f0-4885-9521-fb0c4fd09256", "name": "network-vif-plugged", "status": "completed", "tag": "99d40578-6e7f-48ee-895e-ceebb7732568"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:09:05.322284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=10 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:09:05.328608 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b0cefdd8-6dda-45a0-b42f-bad377f65fb1 req-2b7dc701-28d6-4285-8ae5-8e217d6a13a6 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:05.329182 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b0cefdd8-6dda-45a0-b42f-bad377f65fb1 req-2b7dc701-28d6-4285-8ae5-8e217d6a13a6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:05.329638 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b0cefdd8-6dda-45a0-b42f-bad377f65fb1 req-2b7dc701-28d6-4285-8ae5-8e217d6a13a6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:05.344670 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-b0cefdd8-6dda-45a0-b42f-bad377f65fb1 req-2b7dc701-28d6-4285-8ae5-8e217d6a13a6 service nova] Creating event network-vif-plugged:99d40578-6e7f-48ee-895e-ceebb7732568 for instance 768c2f84-34f0-4885-9521-fb0c4fd09256 on n-h1-858272-3 Oct 05 03:09:05.349627 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-b0cefdd8-6dda-45a0-b42f-bad377f65fb1 req-2b7dc701-28d6-4285-8ae5-8e217d6a13a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037478 Oct 05 03:09:05.350222 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3188/6391] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:09:05.979871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0c0345e6-b1fe-4811-b582-5a0c59369757 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:09:05.980583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0c0345e6-b1fe-4811-b582-5a0c59369757 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 768c2f84-34f0-4885-9521-fb0c4fd09256] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:09:05.988027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c0345e6-b1fe-4811-b582-5a0c59369757 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:05.988513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c0345e6-b1fe-4811-b582-5a0c59369757 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:05.988989 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c0345e6-b1fe-4811-b582-5a0c59369757 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:05.989693 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c0345e6-b1fe-4811-b582-5a0c59369757 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:05.990145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c0345e6-b1fe-4811-b582-5a0c59369757 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:05.990568 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c0345e6-b1fe-4811-b582-5a0c59369757 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:06.129390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0c0345e6-b1fe-4811-b582-5a0c59369757 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:09:06.137552 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0c0345e6-b1fe-4811-b582-5a0c59369757 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256" status: 200 len: 1367 microversion: 2.1 time: 0.162306 Oct 05 03:09:06.138125 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3204/6392] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:09:05 2022] GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:09:07.161726 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-886e2dd5-4109-4402-8f0a-e43f2e73bd85 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:09:07.162490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-886e2dd5-4109-4402-8f0a-e43f2e73bd85 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 768c2f84-34f0-4885-9521-fb0c4fd09256] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:09:07.169696 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-886e2dd5-4109-4402-8f0a-e43f2e73bd85 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:07.170185 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-886e2dd5-4109-4402-8f0a-e43f2e73bd85 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:07.170621 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-886e2dd5-4109-4402-8f0a-e43f2e73bd85 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:07.171312 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-886e2dd5-4109-4402-8f0a-e43f2e73bd85 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:07.171766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-886e2dd5-4109-4402-8f0a-e43f2e73bd85 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:07.172191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-886e2dd5-4109-4402-8f0a-e43f2e73bd85 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:07.310703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-886e2dd5-4109-4402-8f0a-e43f2e73bd85 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:09:07.318533 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-886e2dd5-4109-4402-8f0a-e43f2e73bd85 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256" status: 200 len: 1556 microversion: 2.1 time: 0.161213 Oct 05 03:09:07.319115 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3189/6393] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:09:07 2022] GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256 => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:09:07.341843 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9e5ef28a-65c6-4ec9-883f-da3cbd655ebd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:09:07.342454 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9e5ef28a-65c6-4ec9-883f-da3cbd655ebd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 768c2f84-34f0-4885-9521-fb0c4fd09256] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:09:07.349929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9e5ef28a-65c6-4ec9-883f-da3cbd655ebd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:07.350987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9e5ef28a-65c6-4ec9-883f-da3cbd655ebd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:07.351475 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9e5ef28a-65c6-4ec9-883f-da3cbd655ebd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:07.352292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9e5ef28a-65c6-4ec9-883f-da3cbd655ebd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:07.352751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9e5ef28a-65c6-4ec9-883f-da3cbd655ebd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:07.353213 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9e5ef28a-65c6-4ec9-883f-da3cbd655ebd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:07.434835 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9e5ef28a-65c6-4ec9-883f-da3cbd655ebd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096895 Oct 05 03:09:07.435449 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3205/6394] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 03:09:07 2022] GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:09:08.424822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-a99fa7e7-3674-4baf-ad2d-b64dfab1692f req-62fcd6f2-62b3-47c8-8b8f-a438b5d2690e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "768c2f84-34f0-4885-9521-fb0c4fd09256", "tag": "99d40578-6e7f-48ee-895e-ceebb7732568"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:09:08.436130 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a99fa7e7-3674-4baf-ad2d-b64dfab1692f req-62fcd6f2-62b3-47c8-8b8f-a438b5d2690e service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:08.436631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a99fa7e7-3674-4baf-ad2d-b64dfab1692f req-62fcd6f2-62b3-47c8-8b8f-a438b5d2690e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:08.437224 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a99fa7e7-3674-4baf-ad2d-b64dfab1692f req-62fcd6f2-62b3-47c8-8b8f-a438b5d2690e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:08.449981 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-a99fa7e7-3674-4baf-ad2d-b64dfab1692f req-62fcd6f2-62b3-47c8-8b8f-a438b5d2690e service nova] Creating event network-changed:99d40578-6e7f-48ee-895e-ceebb7732568 for instance 768c2f84-34f0-4885-9521-fb0c4fd09256 on n-h1-858272-3 Oct 05 03:09:08.454853 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-a99fa7e7-3674-4baf-ad2d-b64dfab1692f req-62fcd6f2-62b3-47c8-8b8f-a438b5d2690e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033716 Oct 05 03:09:08.455520 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3190/6395] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:09:31.202379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=17 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:09:31.203158 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=20 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:09:31.208368 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c05fdaa7-4119-488f-bfb7-7e2283f4c05f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:09:31.210875 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c05fdaa7-4119-488f-bfb7-7e2283f4c05f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:09:31.217883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c05fdaa7-4119-488f-bfb7-7e2283f4c05f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:31.218443 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c05fdaa7-4119-488f-bfb7-7e2283f4c05f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:31.218914 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c05fdaa7-4119-488f-bfb7-7e2283f4c05f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:31.219614 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c05fdaa7-4119-488f-bfb7-7e2283f4c05f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:31.220068 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c05fdaa7-4119-488f-bfb7-7e2283f4c05f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:31.220502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c05fdaa7-4119-488f-bfb7-7e2283f4c05f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:31.293049 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c05fdaa7-4119-488f-bfb7-7e2283f4c05f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "POST /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed/action" status: 200 len: 62948 microversion: 2.1 time: 0.092707 Oct 05 03:09:31.294908 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3206/6396] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:09:31 2022] POST /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed/action => generated 62948 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 03:09:47.629217 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:09:47.630136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:09:47.767605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a726fe56-6d9d-4374-a9c5-01438df8a61c tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:09:47.768519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a726fe56-6d9d-4374-a9c5-01438df8a61c tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:09:47.775280 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a726fe56-6d9d-4374-a9c5-01438df8a61c tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:47.775995 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a726fe56-6d9d-4374-a9c5-01438df8a61c tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:47.776625 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a726fe56-6d9d-4374-a9c5-01438df8a61c tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:47.777351 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a726fe56-6d9d-4374-a9c5-01438df8a61c tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:47.777811 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a726fe56-6d9d-4374-a9c5-01438df8a61c tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:47.778231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a726fe56-6d9d-4374-a9c5-01438df8a61c tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:48.002311 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a726fe56-6d9d-4374-a9c5-01438df8a61c tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1832 microversion: 2.1 time: 0.376270 Oct 05 03:09:48.003473 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3191/6397] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:09:47 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1832 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:09:48.885933 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-39d35e1d-2b45-4c1e-b171-5754bcf3a0d6 req-682abaa0-593c-4c3a-90d1-00a3c6f72009 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed", "tag": "66189cc2-bc2e-49ce-91a4-6d9acf4efc4e"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:09:48.891712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e06ce3bc-189e-4073-96bb-5e043a4dbae0 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:09:48.892144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e06ce3bc-189e-4073-96bb-5e043a4dbae0 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:09:48.902039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:09:48.902718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=4 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:09:48.904986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e06ce3bc-189e-4073-96bb-5e043a4dbae0 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:48.905485 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e06ce3bc-189e-4073-96bb-5e043a4dbae0 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:48.905922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e06ce3bc-189e-4073-96bb-5e043a4dbae0 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:48.906631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e06ce3bc-189e-4073-96bb-5e043a4dbae0 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:48.907086 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e06ce3bc-189e-4073-96bb-5e043a4dbae0 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:48.907514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e06ce3bc-189e-4073-96bb-5e043a4dbae0 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:48.913883 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-39d35e1d-2b45-4c1e-b171-5754bcf3a0d6 req-682abaa0-593c-4c3a-90d1-00a3c6f72009 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:48.914365 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-39d35e1d-2b45-4c1e-b171-5754bcf3a0d6 req-682abaa0-593c-4c3a-90d1-00a3c6f72009 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:48.914796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-39d35e1d-2b45-4c1e-b171-5754bcf3a0d6 req-682abaa0-593c-4c3a-90d1-00a3c6f72009 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:48.926826 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-39d35e1d-2b45-4c1e-b171-5754bcf3a0d6 req-682abaa0-593c-4c3a-90d1-00a3c6f72009 service nova] Creating event network-changed:66189cc2-bc2e-49ce-91a4-6d9acf4efc4e for instance a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed on n-h2-858272-3 Oct 05 03:09:48.948361 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-39d35e1d-2b45-4c1e-b171-5754bcf3a0d6 req-682abaa0-593c-4c3a-90d1-00a3c6f72009 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065780 Oct 05 03:09:48.949217 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3192/6398] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:09:48.958880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e06ce3bc-189e-4073-96bb-5e043a4dbae0 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:09:49.059545 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e06ce3bc-189e-4073-96bb-5e043a4dbae0 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 204 len: 0 microversion: 2.1 time: 0.181306 Oct 05 03:09:49.060947 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3207/6399] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:09:48 2022] DELETE /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:09:49.071734 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-304c87b0-e2c7-450c-b134-640dabe99017 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:09:49.072946 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-304c87b0-e2c7-450c-b134-640dabe99017 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:09:49.081017 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-304c87b0-e2c7-450c-b134-640dabe99017 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:49.081820 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-304c87b0-e2c7-450c-b134-640dabe99017 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:49.082679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-304c87b0-e2c7-450c-b134-640dabe99017 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:49.083604 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-304c87b0-e2c7-450c-b134-640dabe99017 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:49.084288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-304c87b0-e2c7-450c-b134-640dabe99017 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:49.085271 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-304c87b0-e2c7-450c-b134-640dabe99017 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:49.232281 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-304c87b0-e2c7-450c-b134-640dabe99017 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:09:49.240614 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-304c87b0-e2c7-450c-b134-640dabe99017 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1687 microversion: 2.1 time: 0.173266 Oct 05 03:09:49.241380 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3193/6400] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:09:49 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1687 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:09:50.264315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-328f17ad-0b68-4cb8-9774-5b9118ca61eb tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:09:50.265040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-328f17ad-0b68-4cb8-9774-5b9118ca61eb tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:09:50.273561 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-328f17ad-0b68-4cb8-9774-5b9118ca61eb tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:50.274054 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-328f17ad-0b68-4cb8-9774-5b9118ca61eb tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:50.274545 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-328f17ad-0b68-4cb8-9774-5b9118ca61eb tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:50.275163 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-328f17ad-0b68-4cb8-9774-5b9118ca61eb tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:50.275615 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-328f17ad-0b68-4cb8-9774-5b9118ca61eb tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:50.276034 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-328f17ad-0b68-4cb8-9774-5b9118ca61eb tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:50.420562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-328f17ad-0b68-4cb8-9774-5b9118ca61eb tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:09:50.428731 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-328f17ad-0b68-4cb8-9774-5b9118ca61eb tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1687 microversion: 2.1 time: 0.168862 Oct 05 03:09:50.429394 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3208/6401] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:09:50 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:09:51.453230 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6a49eb4b-ea68-4575-80cd-0d22a5c6af12 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:09:51.453921 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6a49eb4b-ea68-4575-80cd-0d22a5c6af12 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:09:51.473130 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a49eb4b-ea68-4575-80cd-0d22a5c6af12 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:51.473793 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a49eb4b-ea68-4575-80cd-0d22a5c6af12 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:51.474218 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a49eb4b-ea68-4575-80cd-0d22a5c6af12 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:51.474892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a49eb4b-ea68-4575-80cd-0d22a5c6af12 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:51.475343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a49eb4b-ea68-4575-80cd-0d22a5c6af12 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:51.475762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a49eb4b-ea68-4575-80cd-0d22a5c6af12 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:51.495896 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-a48edfbb-ead3-4263-b1a5-3a8b5331abb0 req-b4e85c15-fa8a-48f6-ac45-cb236ef330cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed", "name": "network-vif-deleted", "tag": "66189cc2-bc2e-49ce-91a4-6d9acf4efc4e"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:09:51.506816 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a48edfbb-ead3-4263-b1a5-3a8b5331abb0 req-b4e85c15-fa8a-48f6-ac45-cb236ef330cd service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:51.507204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a48edfbb-ead3-4263-b1a5-3a8b5331abb0 req-b4e85c15-fa8a-48f6-ac45-cb236ef330cd service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:51.507634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a48edfbb-ead3-4263-b1a5-3a8b5331abb0 req-b4e85c15-fa8a-48f6-ac45-cb236ef330cd service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:51.520265 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-a48edfbb-ead3-4263-b1a5-3a8b5331abb0 req-b4e85c15-fa8a-48f6-ac45-cb236ef330cd service nova] Creating event network-vif-deleted:66189cc2-bc2e-49ce-91a4-6d9acf4efc4e for instance a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed on n-h2-858272-3 Oct 05 03:09:51.525376 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-a48edfbb-ead3-4263-b1a5-3a8b5331abb0 req-b4e85c15-fa8a-48f6-ac45-cb236ef330cd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033141 Oct 05 03:09:51.526002 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3209/6402] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:09:51.551440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6a49eb4b-ea68-4575-80cd-0d22a5c6af12 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:09:51.559998 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6a49eb4b-ea68-4575-80cd-0d22a5c6af12 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 200 len: 1502 microversion: 2.1 time: 0.110888 Oct 05 03:09:51.560706 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3194/6403] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:09:51 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 1502 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:09:52.585564 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3b3bf45d-e8cf-43e1-bbf4-f6833ef136ae tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:09:52.586270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3b3bf45d-e8cf-43e1-bbf4-f6833ef136ae tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:09:52.592554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3b3bf45d-e8cf-43e1-bbf4-f6833ef136ae tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:52.593095 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3b3bf45d-e8cf-43e1-bbf4-f6833ef136ae tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:52.593540 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3b3bf45d-e8cf-43e1-bbf4-f6833ef136ae tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:52.594240 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3b3bf45d-e8cf-43e1-bbf4-f6833ef136ae tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:09:52.594695 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3b3bf45d-e8cf-43e1-bbf4-f6833ef136ae tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:09:52.596138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3b3bf45d-e8cf-43e1-bbf4-f6833ef136ae tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:09:52.609593 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-3b3bf45d-e8cf-43e1-bbf4-f6833ef136ae tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] HTTP exception thrown: Instance a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed could not be found. Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3b3bf45d-e8cf-43e1-bbf4-f6833ef136ae tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Request method failure captured: Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed HTTP/1.1 Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPQQaPdY80Cpcj7cnlUwviGOgibF1hELwwBhNlNnP0MqbdNiw25tncanzi7qWvBbOvFGmFxbhq_pYUvMd-n-xjmhM4x8o5emmLCp2GN5-d1zUtR_w4L-Z_KZTshYbgGB04rNkRVV36r2lGPYux6FzpfN97MB3YiAErpveqwDREaePkw Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: a86e3137c6764eeb948b9c7dab895c34 Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-344873080 Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a86e3137c6764eeb948b9c7dab895c34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a86e3137c6764eeb948b9c7dab895c34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a86e3137c6764eeb948b9c7dab895c34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a86e3137c6764eeb948b9c7dab895c34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TestNetworkAdvancedServerOps-344873080 Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: a86e3137c6764eeb948b9c7dab895c34 Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-344873080 Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TestNetworkAdvancedServerOps-344873080-project Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: ad3a53da0c764f0a893966aea6505fa7 Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TestNetworkAdvancedServerOps-344873080-project Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed could not be found. Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed'} Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed could not be found. Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed could not be found. Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:09:52.612479 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:09:52.617133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:09:52.617133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:09:52.617133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:09:52.617133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:09:52.617133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:09:52.617133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:09:52.617133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed could not be found. Oct 05 03:09:52.617133 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:09:52.617133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3b3bf45d-e8cf-43e1-bbf4-f6833ef136ae tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Returning 404 to user: Instance a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:09:52.617133 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3b3bf45d-e8cf-43e1-bbf4-f6833ef136ae tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed" status: 404 len: 111 microversion: 2.1 time: 0.034065 Oct 05 03:09:52.617133 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3210/6404] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:09:52 2022] GET /compute/v2.1/servers/a5edf6e5-bbb6-4ce9-acaf-7b803cf714ed => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:09:56.092473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8e07cce0-716f-4238-828d-37e4ae58701a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '.version_select at 0x7fccdf1ad670>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:09:56.118529 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8e07cce0-716f-4238-828d-37e4ae58701a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-230329541" status: 202 len: 0 microversion: 2.1 time: 0.030515 Oct 05 03:09:56.122074 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3195/6405] 10.222.0.16 () {58 vars in 1281 bytes} [Wed Oct 5 03:09:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-230329541 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:09:56.158766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7e3f4f98-8ee7-4eef-96eb-b188bca2f5d5 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Action: 'create', calling method: .version_select at 0x7fccdebfbee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-62350238", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPDe0OC0D4pSzRLdOVSnAd5gIzkuElrK54RlPWbtpvlAEdVhOL1kgm6rq81otlpUISprMvW8389C2/ohQN7HCwB0W/zOqveNpionDyqaIRivqS2G2glEWVmIFUmskzs+A=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:09:56.179999 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-7e3f4f98-8ee7-4eef-96eb-b188bca2f5d5 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Getting quotas for project a86e3137c6764eeb948b9c7dab895c34. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:09:56.185656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-7e3f4f98-8ee7-4eef-96eb-b188bca2f5d5 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Getting quotas for user ad3a53da0c764f0a893966aea6505fa7 and project a86e3137c6764eeb948b9c7dab895c34. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:09:56.212980 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7e3f4f98-8ee7-4eef-96eb-b188bca2f5d5 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.058328 Oct 05 03:09:56.213764 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3211/6406] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 03:09:56 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:10:02.839113 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=20 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:02.849237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a5e5037f-6ed3-488c-8094-e8ce991b591e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-131548554", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "ba084756-73ea-44fe-af37-799b41964106"}], "key_name": "tempest-TestNetworkAdvancedServerOps-62350238", "security_groups": [{"name": "tempest-secgroup-smoke-1556986487"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:10:02.968511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-a5e5037f-6ed3-488c-8094-e8ce991b591e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] validate_networks() for [('ba084756-73ea-44fe-af37-799b41964106', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:10:03.702671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-a5e5037f-6ed3-488c-8094-e8ce991b591e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:10:03.703669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-a5e5037f-6ed3-488c-8094-e8ce991b591e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:10:03.704863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-a5e5037f-6ed3-488c-8094-e8ce991b591e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:10:03.705313 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-a5e5037f-6ed3-488c-8094-e8ce991b591e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:10:03.705737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-a5e5037f-6ed3-488c-8094-e8ce991b591e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:10:03.718525 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5e5037f-6ed3-488c-8094-e8ce991b591e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:03.720028 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5e5037f-6ed3-488c-8094-e8ce991b591e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:03.720538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5e5037f-6ed3-488c-8094-e8ce991b591e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:03.721453 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5e5037f-6ed3-488c-8094-e8ce991b591e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:03.721989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5e5037f-6ed3-488c-8094-e8ce991b591e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:03.722430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5e5037f-6ed3-488c-8094-e8ce991b591e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:03.748359 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-a5e5037f-6ed3-488c-8094-e8ce991b591e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Getting quotas for project a86e3137c6764eeb948b9c7dab895c34. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:10:03.756173 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-a5e5037f-6ed3-488c-8094-e8ce991b591e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Getting quotas for user ad3a53da0c764f0a893966aea6505fa7 and project a86e3137c6764eeb948b9c7dab895c34. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:10:03.778470 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a5e5037f-6ed3-488c-8094-e8ce991b591e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:10:03.781042 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a5e5037f-6ed3-488c-8094-e8ce991b591e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:10:03.852224 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a5e5037f-6ed3-488c-8094-e8ce991b591e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.014487 Oct 05 03:10:03.866440 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dc36f4c5-7793-409e-9e2f-2af3f83c5eb1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:03.867932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-dc36f4c5-7793-409e-9e2f-2af3f83c5eb1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:03.872001 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:03.879741 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3196/6407] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:10:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:10:04.032670 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-dc36f4c5-7793-409e-9e2f-2af3f83c5eb1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:04.047743 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-dc36f4c5-7793-409e-9e2f-2af3f83c5eb1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2" status: 200 len: 1264 microversion: 2.1 time: 0.185087 Oct 05 03:10:04.048202 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3212/6408] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:03 2022] GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2 => generated 1264 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:05.075544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ab5c9ac4-2e5a-4fb4-a29d-ea04826b28a9 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:05.076795 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ab5c9ac4-2e5a-4fb4-a29d-ea04826b28a9 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:05.099004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ab5c9ac4-2e5a-4fb4-a29d-ea04826b28a9 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:05.101492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ab5c9ac4-2e5a-4fb4-a29d-ea04826b28a9 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:05.102117 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ab5c9ac4-2e5a-4fb4-a29d-ea04826b28a9 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:05.107352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ab5c9ac4-2e5a-4fb4-a29d-ea04826b28a9 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:05.108058 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ab5c9ac4-2e5a-4fb4-a29d-ea04826b28a9 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:05.108669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ab5c9ac4-2e5a-4fb4-a29d-ea04826b28a9 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:05.181605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ab5c9ac4-2e5a-4fb4-a29d-ea04826b28a9 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:05.193956 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ab5c9ac4-2e5a-4fb4-a29d-ea04826b28a9 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2" status: 200 len: 1316 microversion: 2.1 time: 0.123173 Oct 05 03:10:05.194894 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3197/6409] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:05 2022] GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2 => generated 1316 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:06.221291 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d1d8759e-6f84-401d-a65b-bb24a36b6af1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:06.222036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d1d8759e-6f84-401d-a65b-bb24a36b6af1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:06.238705 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d1d8759e-6f84-401d-a65b-bb24a36b6af1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:06.239852 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d1d8759e-6f84-401d-a65b-bb24a36b6af1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:06.241590 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d1d8759e-6f84-401d-a65b-bb24a36b6af1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:06.242574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d1d8759e-6f84-401d-a65b-bb24a36b6af1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:06.243925 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d1d8759e-6f84-401d-a65b-bb24a36b6af1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:06.245442 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d1d8759e-6f84-401d-a65b-bb24a36b6af1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:06.493467 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d1d8759e-6f84-401d-a65b-bb24a36b6af1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:06.508921 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d1d8759e-6f84-401d-a65b-bb24a36b6af1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2" status: 200 len: 1390 microversion: 2.1 time: 0.292781 Oct 05 03:10:06.509878 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3213/6410] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:06 2022] GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2 => generated 1390 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:07.108580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-1a4d3bd0-6cdc-4650-b702-393be9b04f20 req-f6ef6bfc-9b08-402d-aff0-4b6b2442a2ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60fff54d-55b0-4e52-aae5-698c60e914c2", "tag": "839b84fa-e1fb-4925-85dd-0d318c9b6d36"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:10:07.122510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1a4d3bd0-6cdc-4650-b702-393be9b04f20 req-f6ef6bfc-9b08-402d-aff0-4b6b2442a2ea service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:07.123361 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1a4d3bd0-6cdc-4650-b702-393be9b04f20 req-f6ef6bfc-9b08-402d-aff0-4b6b2442a2ea service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:07.125241 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1a4d3bd0-6cdc-4650-b702-393be9b04f20 req-f6ef6bfc-9b08-402d-aff0-4b6b2442a2ea service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:07.142837 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-1a4d3bd0-6cdc-4650-b702-393be9b04f20 req-f6ef6bfc-9b08-402d-aff0-4b6b2442a2ea service nova] Creating event network-changed:839b84fa-e1fb-4925-85dd-0d318c9b6d36 for instance 60fff54d-55b0-4e52-aae5-698c60e914c2 on n-h2-858272-3 Oct 05 03:10:07.148507 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-1a4d3bd0-6cdc-4650-b702-393be9b04f20 req-f6ef6bfc-9b08-402d-aff0-4b6b2442a2ea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045781 Oct 05 03:10:07.150023 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3198/6411] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:10:07.534073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-aaeef1c9-c8d0-43d3-9f35-713f333f9904 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:07.534705 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-aaeef1c9-c8d0-43d3-9f35-713f333f9904 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:07.541911 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aaeef1c9-c8d0-43d3-9f35-713f333f9904 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:07.542515 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aaeef1c9-c8d0-43d3-9f35-713f333f9904 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:07.542968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aaeef1c9-c8d0-43d3-9f35-713f333f9904 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:07.543694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aaeef1c9-c8d0-43d3-9f35-713f333f9904 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:07.544207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aaeef1c9-c8d0-43d3-9f35-713f333f9904 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:07.544645 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aaeef1c9-c8d0-43d3-9f35-713f333f9904 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:07.692682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-aaeef1c9-c8d0-43d3-9f35-713f333f9904 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:07.701039 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-aaeef1c9-c8d0-43d3-9f35-713f333f9904 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2" status: 200 len: 1390 microversion: 2.1 time: 0.171514 Oct 05 03:10:07.701716 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3214/6412] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:07 2022] GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2 => generated 1390 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:08.731455 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-07e8c26e-4443-448e-91df-fc33f1e9035b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:08.731455 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-07e8c26e-4443-448e-91df-fc33f1e9035b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:08.735260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07e8c26e-4443-448e-91df-fc33f1e9035b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:08.735750 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07e8c26e-4443-448e-91df-fc33f1e9035b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:08.736189 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07e8c26e-4443-448e-91df-fc33f1e9035b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:08.736920 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07e8c26e-4443-448e-91df-fc33f1e9035b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:08.737425 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07e8c26e-4443-448e-91df-fc33f1e9035b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:08.737879 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07e8c26e-4443-448e-91df-fc33f1e9035b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:08.914918 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-07e8c26e-4443-448e-91df-fc33f1e9035b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:08.923975 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-07e8c26e-4443-448e-91df-fc33f1e9035b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2" status: 200 len: 1390 microversion: 2.1 time: 0.203185 Oct 05 03:10:08.924572 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3199/6413] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:08 2022] GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2 => generated 1390 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:09.952867 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4f357076-787f-4fed-bec1-a5ebd79176f1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:09.954565 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4f357076-787f-4fed-bec1-a5ebd79176f1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:09.962508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f357076-787f-4fed-bec1-a5ebd79176f1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:09.962998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f357076-787f-4fed-bec1-a5ebd79176f1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:09.963432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f357076-787f-4fed-bec1-a5ebd79176f1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:09.964132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f357076-787f-4fed-bec1-a5ebd79176f1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:09.964587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f357076-787f-4fed-bec1-a5ebd79176f1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:09.965036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f357076-787f-4fed-bec1-a5ebd79176f1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:10.117305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4f357076-787f-4fed-bec1-a5ebd79176f1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:10.125319 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4f357076-787f-4fed-bec1-a5ebd79176f1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2" status: 200 len: 1390 microversion: 2.1 time: 0.177086 Oct 05 03:10:10.125903 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3215/6414] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:09 2022] GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2 => generated 1390 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:11.151285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4bc1f8a5-fdb3-4750-86c1-72b147db6154 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:11.151996 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4bc1f8a5-fdb3-4750-86c1-72b147db6154 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:11.160324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4bc1f8a5-fdb3-4750-86c1-72b147db6154 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:11.161014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4bc1f8a5-fdb3-4750-86c1-72b147db6154 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:11.161556 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4bc1f8a5-fdb3-4750-86c1-72b147db6154 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:11.162616 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4bc1f8a5-fdb3-4750-86c1-72b147db6154 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:11.163093 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4bc1f8a5-fdb3-4750-86c1-72b147db6154 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:11.163631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4bc1f8a5-fdb3-4750-86c1-72b147db6154 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:11.316117 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4bc1f8a5-fdb3-4750-86c1-72b147db6154 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:11.325141 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4bc1f8a5-fdb3-4750-86c1-72b147db6154 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2" status: 200 len: 1390 microversion: 2.1 time: 0.177639 Oct 05 03:10:11.337745 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3200/6415] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:11 2022] GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2 => generated 1390 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:12.349680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cdea80fb-52a8-4031-9df6-fca5bf0ebae4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:12.350293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cdea80fb-52a8-4031-9df6-fca5bf0ebae4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:12.357171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdea80fb-52a8-4031-9df6-fca5bf0ebae4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:12.357660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdea80fb-52a8-4031-9df6-fca5bf0ebae4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:12.358095 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdea80fb-52a8-4031-9df6-fca5bf0ebae4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:12.358791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdea80fb-52a8-4031-9df6-fca5bf0ebae4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:12.359359 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdea80fb-52a8-4031-9df6-fca5bf0ebae4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:12.359787 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdea80fb-52a8-4031-9df6-fca5bf0ebae4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:12.503736 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cdea80fb-52a8-4031-9df6-fca5bf0ebae4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:12.511944 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cdea80fb-52a8-4031-9df6-fca5bf0ebae4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2" status: 200 len: 1390 microversion: 2.1 time: 0.166069 Oct 05 03:10:12.512626 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3216/6416] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:12 2022] GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2 => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:12.879479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-74ab0c5e-a7ff-43f7-96e9-a2f8245837d5 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:12.880013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-74ab0c5e-a7ff-43f7-96e9-a2f8245837d5 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 768c2f84-34f0-4885-9521-fb0c4fd09256] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:12.887177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-74ab0c5e-a7ff-43f7-96e9-a2f8245837d5 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:12.887762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-74ab0c5e-a7ff-43f7-96e9-a2f8245837d5 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:12.888269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-74ab0c5e-a7ff-43f7-96e9-a2f8245837d5 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:12.889089 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-74ab0c5e-a7ff-43f7-96e9-a2f8245837d5 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:12.889635 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-74ab0c5e-a7ff-43f7-96e9-a2f8245837d5 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:12.890321 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-74ab0c5e-a7ff-43f7-96e9-a2f8245837d5 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:12.922213 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-74ab0c5e-a7ff-43f7-96e9-a2f8245837d5 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256/ips" status: 200 len: 149 microversion: 2.1 time: 0.046055 Oct 05 03:10:12.930565 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3201/6417] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 03:10:12 2022] GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256/ips => generated 149 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:10:13.419542 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-5a37cfb3-8a9c-4e51-a610-f020e10883f5 req-8a09ed9b-ac59-4cce-bad6-e91f46186714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60fff54d-55b0-4e52-aae5-698c60e914c2", "name": "network-vif-plugged", "status": "completed", "tag": "839b84fa-e1fb-4925-85dd-0d318c9b6d36"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:10:13.434686 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5a37cfb3-8a9c-4e51-a610-f020e10883f5 req-8a09ed9b-ac59-4cce-bad6-e91f46186714 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:13.435500 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5a37cfb3-8a9c-4e51-a610-f020e10883f5 req-8a09ed9b-ac59-4cce-bad6-e91f46186714 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:13.436170 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5a37cfb3-8a9c-4e51-a610-f020e10883f5 req-8a09ed9b-ac59-4cce-bad6-e91f46186714 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:13.449305 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-5a37cfb3-8a9c-4e51-a610-f020e10883f5 req-8a09ed9b-ac59-4cce-bad6-e91f46186714 service nova] Creating event network-vif-plugged:839b84fa-e1fb-4925-85dd-0d318c9b6d36 for instance 60fff54d-55b0-4e52-aae5-698c60e914c2 on n-h2-858272-3 Oct 05 03:10:13.455514 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-5a37cfb3-8a9c-4e51-a610-f020e10883f5 req-8a09ed9b-ac59-4cce-bad6-e91f46186714 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039607 Oct 05 03:10:13.456682 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3217/6418] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:10:13.536291 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bdf9ad72-de4e-452b-8d4b-9868a7d7b4e7 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:13.537309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bdf9ad72-de4e-452b-8d4b-9868a7d7b4e7 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:13.549887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bdf9ad72-de4e-452b-8d4b-9868a7d7b4e7 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:13.550438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bdf9ad72-de4e-452b-8d4b-9868a7d7b4e7 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:13.551087 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bdf9ad72-de4e-452b-8d4b-9868a7d7b4e7 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:13.552129 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bdf9ad72-de4e-452b-8d4b-9868a7d7b4e7 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:13.552751 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bdf9ad72-de4e-452b-8d4b-9868a7d7b4e7 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:13.553432 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bdf9ad72-de4e-452b-8d4b-9868a7d7b4e7 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:13.736326 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bdf9ad72-de4e-452b-8d4b-9868a7d7b4e7 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:13.739899 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:13.746030 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bdf9ad72-de4e-452b-8d4b-9868a7d7b4e7 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2" status: 200 len: 1390 microversion: 2.1 time: 0.214674 Oct 05 03:10:13.746610 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3202/6419] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:13 2022] GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2 => generated 1390 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:14.276028 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:14.281295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9742eef0-e27a-46c5-84e6-f4435c60e8f3 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "adc16408-bdd8-489d-ad70-fd838eee39f8"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:10:14.283703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9742eef0-e27a-46c5-84e6-f4435c60e8f3 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 768c2f84-34f0-4885-9521-fb0c4fd09256] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:14.290246 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9742eef0-e27a-46c5-84e6-f4435c60e8f3 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:14.290736 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9742eef0-e27a-46c5-84e6-f4435c60e8f3 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:14.291175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9742eef0-e27a-46c5-84e6-f4435c60e8f3 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:14.291873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9742eef0-e27a-46c5-84e6-f4435c60e8f3 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:14.292329 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9742eef0-e27a-46c5-84e6-f4435c60e8f3 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:14.292758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9742eef0-e27a-46c5-84e6-f4435c60e8f3 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:14.568031 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9742eef0-e27a-46c5-84e6-f4435c60e8f3 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "POST /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292709 Oct 05 03:10:14.568732 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3218/6420] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 03:10:14 2022] POST /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:10:14.770853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b488a116-42ff-46cf-bd72-93fc9ee22359 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:14.771470 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b488a116-42ff-46cf-bd72-93fc9ee22359 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:14.773655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:14.781675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b488a116-42ff-46cf-bd72-93fc9ee22359 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:14.782320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b488a116-42ff-46cf-bd72-93fc9ee22359 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:14.782771 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b488a116-42ff-46cf-bd72-93fc9ee22359 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:14.783479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b488a116-42ff-46cf-bd72-93fc9ee22359 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:14.783936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b488a116-42ff-46cf-bd72-93fc9ee22359 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:14.784362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b488a116-42ff-46cf-bd72-93fc9ee22359 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:14.960042 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b488a116-42ff-46cf-bd72-93fc9ee22359 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:14.969799 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b488a116-42ff-46cf-bd72-93fc9ee22359 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2" status: 200 len: 1390 microversion: 2.1 time: 0.203054 Oct 05 03:10:14.970886 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3203/6421] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:14 2022] GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2 => generated 1390 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:15.999799 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-98776df9-49c1-4607-9dee-383c00795076 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:16.000445 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-98776df9-49c1-4607-9dee-383c00795076 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:16.006705 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98776df9-49c1-4607-9dee-383c00795076 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:16.007187 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98776df9-49c1-4607-9dee-383c00795076 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:16.007618 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98776df9-49c1-4607-9dee-383c00795076 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:16.008323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98776df9-49c1-4607-9dee-383c00795076 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:16.008777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98776df9-49c1-4607-9dee-383c00795076 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:16.009223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98776df9-49c1-4607-9dee-383c00795076 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:16.149509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-98776df9-49c1-4607-9dee-383c00795076 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:16.157770 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-98776df9-49c1-4607-9dee-383c00795076 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2" status: 200 len: 1563 microversion: 2.1 time: 0.163798 Oct 05 03:10:16.158656 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3219/6422] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:15 2022] GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2 => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:10:16.184842 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a58e5934-2337-4718-865b-6682ddb58c76 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:16.187209 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a58e5934-2337-4718-865b-6682ddb58c76 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:16.194666 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a58e5934-2337-4718-865b-6682ddb58c76 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:16.195170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a58e5934-2337-4718-865b-6682ddb58c76 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:16.195890 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a58e5934-2337-4718-865b-6682ddb58c76 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:16.196613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a58e5934-2337-4718-865b-6682ddb58c76 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:16.197101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a58e5934-2337-4718-865b-6682ddb58c76 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:16.197610 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a58e5934-2337-4718-865b-6682ddb58c76 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:16.367450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a58e5934-2337-4718-865b-6682ddb58c76 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:16.377393 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a58e5934-2337-4718-865b-6682ddb58c76 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2" status: 200 len: 1563 microversion: 2.1 time: 0.197352 Oct 05 03:10:16.378635 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3204/6423] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:16 2022] GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2 => generated 1563 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:18.658558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f0def9e9-b286-4dbe-8e86-3856b5ec9ff7 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:18.659490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f0def9e9-b286-4dbe-8e86-3856b5ec9ff7 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:18.667966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-85ba6ab5-ddcb-4ad5-8c3c-c6465f3b98fb req-14095b7d-5843-46ed-bfc6-c9ff2cf2e4bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60fff54d-55b0-4e52-aae5-698c60e914c2", "tag": "839b84fa-e1fb-4925-85dd-0d318c9b6d36"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:10:18.672452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0def9e9-b286-4dbe-8e86-3856b5ec9ff7 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:18.673482 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0def9e9-b286-4dbe-8e86-3856b5ec9ff7 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:18.673994 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0def9e9-b286-4dbe-8e86-3856b5ec9ff7 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:18.674824 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0def9e9-b286-4dbe-8e86-3856b5ec9ff7 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:18.675515 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0def9e9-b286-4dbe-8e86-3856b5ec9ff7 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:18.675955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0def9e9-b286-4dbe-8e86-3856b5ec9ff7 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:18.682471 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:18.685007 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-85ba6ab5-ddcb-4ad5-8c3c-c6465f3b98fb req-14095b7d-5843-46ed-bfc6-c9ff2cf2e4bc service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:18.685863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-85ba6ab5-ddcb-4ad5-8c3c-c6465f3b98fb req-14095b7d-5843-46ed-bfc6-c9ff2cf2e4bc service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:18.687342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-85ba6ab5-ddcb-4ad5-8c3c-c6465f3b98fb req-14095b7d-5843-46ed-bfc6-c9ff2cf2e4bc service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:18.717868 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-85ba6ab5-ddcb-4ad5-8c3c-c6465f3b98fb req-14095b7d-5843-46ed-bfc6-c9ff2cf2e4bc service nova] Creating event network-changed:839b84fa-e1fb-4925-85dd-0d318c9b6d36 for instance 60fff54d-55b0-4e52-aae5-698c60e914c2 on n-h2-858272-3 Oct 05 03:10:18.728601 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-85ba6ab5-ddcb-4ad5-8c3c-c6465f3b98fb req-14095b7d-5843-46ed-bfc6-c9ff2cf2e4bc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071471 Oct 05 03:10:18.729305 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3205/6424] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:10:18.892984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f0def9e9-b286-4dbe-8e86-3856b5ec9ff7 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:18.904074 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f0def9e9-b286-4dbe-8e86-3856b5ec9ff7 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2" status: 200 len: 1563 microversion: 2.1 time: 0.260919 Oct 05 03:10:18.905270 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3220/6425] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:18 2022] GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2 => generated 1563 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:26.671112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-51c64387-a646-4617-a847-32aabe7585a3 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:26.671777 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-51c64387-a646-4617-a847-32aabe7585a3 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 768c2f84-34f0-4885-9521-fb0c4fd09256] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:26.683918 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51c64387-a646-4617-a847-32aabe7585a3 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:26.684417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51c64387-a646-4617-a847-32aabe7585a3 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:26.685675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51c64387-a646-4617-a847-32aabe7585a3 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:26.686907 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51c64387-a646-4617-a847-32aabe7585a3 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:26.687378 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51c64387-a646-4617-a847-32aabe7585a3 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:26.687818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51c64387-a646-4617-a847-32aabe7585a3 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:26.773780 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-51c64387-a646-4617-a847-32aabe7585a3 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lazy-loading 'services' on Instance uuid 768c2f84-34f0-4885-9521-fb0c4fd09256 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:10:26.870777 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-51c64387-a646-4617-a847-32aabe7585a3 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "DELETE /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256/os-volume_attachments/adc16408-bdd8-489d-ad70-fd838eee39f8" status: 202 len: 0 microversion: 2.1 time: 0.204997 Oct 05 03:10:26.879506 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3206/6426] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 03:10:26 2022] DELETE /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256/os-volume_attachments/adc16408-bdd8-489d-ad70-fd838eee39f8 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:10:26.885422 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d103acb4-5cc5-46b1-8262-e5db78f48896 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:26.889311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d103acb4-5cc5-46b1-8262-e5db78f48896 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 768c2f84-34f0-4885-9521-fb0c4fd09256] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:26.894888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:26.906420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d103acb4-5cc5-46b1-8262-e5db78f48896 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:26.907413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d103acb4-5cc5-46b1-8262-e5db78f48896 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:26.909182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d103acb4-5cc5-46b1-8262-e5db78f48896 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:26.911036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d103acb4-5cc5-46b1-8262-e5db78f48896 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:26.912031 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d103acb4-5cc5-46b1-8262-e5db78f48896 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:26.912752 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d103acb4-5cc5-46b1-8262-e5db78f48896 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:26.955467 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d103acb4-5cc5-46b1-8262-e5db78f48896 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078351 Oct 05 03:10:26.956038 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3221/6427] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:10:26 2022] GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:10:27.968673 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-92a8d449-cade-4000-b761-ecc135326d4b tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:27.971463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-92a8d449-cade-4000-b761-ecc135326d4b tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 768c2f84-34f0-4885-9521-fb0c4fd09256] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:27.978385 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92a8d449-cade-4000-b761-ecc135326d4b tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:27.978949 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92a8d449-cade-4000-b761-ecc135326d4b tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:27.979471 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92a8d449-cade-4000-b761-ecc135326d4b tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:27.980514 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92a8d449-cade-4000-b761-ecc135326d4b tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:27.981063 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92a8d449-cade-4000-b761-ecc135326d4b tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:27.982049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92a8d449-cade-4000-b761-ecc135326d4b tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:28.016437 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-92a8d449-cade-4000-b761-ecc135326d4b tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052238 Oct 05 03:10:28.017066 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3207/6428] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:10:27 2022] GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:10:29.029417 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-344a7133-3f29-4b43-8dfc-74ddbec299eb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:29.032733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-344a7133-3f29-4b43-8dfc-74ddbec299eb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 768c2f84-34f0-4885-9521-fb0c4fd09256] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:29.040443 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-344a7133-3f29-4b43-8dfc-74ddbec299eb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:29.040962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-344a7133-3f29-4b43-8dfc-74ddbec299eb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:29.041536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-344a7133-3f29-4b43-8dfc-74ddbec299eb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:29.042230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-344a7133-3f29-4b43-8dfc-74ddbec299eb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:29.042685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-344a7133-3f29-4b43-8dfc-74ddbec299eb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:29.043111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-344a7133-3f29-4b43-8dfc-74ddbec299eb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:29.080353 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-344a7133-3f29-4b43-8dfc-74ddbec299eb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055461 Oct 05 03:10:29.080957 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3222/6429] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:10:29 2022] GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:10:30.093552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ba9f5bb0-3f77-4e8a-89a0-8992a4448a95 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:30.096349 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ba9f5bb0-3f77-4e8a-89a0-8992a4448a95 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 768c2f84-34f0-4885-9521-fb0c4fd09256] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:30.104644 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ba9f5bb0-3f77-4e8a-89a0-8992a4448a95 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:30.105367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ba9f5bb0-3f77-4e8a-89a0-8992a4448a95 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:30.105656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ba9f5bb0-3f77-4e8a-89a0-8992a4448a95 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:30.107176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ba9f5bb0-3f77-4e8a-89a0-8992a4448a95 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:30.107612 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ba9f5bb0-3f77-4e8a-89a0-8992a4448a95 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:30.108049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ba9f5bb0-3f77-4e8a-89a0-8992a4448a95 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:30.142883 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ba9f5bb0-3f77-4e8a-89a0-8992a4448a95 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053815 Oct 05 03:10:30.144092 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3208/6430] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:10:30 2022] GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:10:31.156420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-41ae2e33-84a3-4608-82fc-79e930cdb445 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:31.159357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-41ae2e33-84a3-4608-82fc-79e930cdb445 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 768c2f84-34f0-4885-9521-fb0c4fd09256] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:31.166499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41ae2e33-84a3-4608-82fc-79e930cdb445 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:31.167147 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41ae2e33-84a3-4608-82fc-79e930cdb445 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:31.168004 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41ae2e33-84a3-4608-82fc-79e930cdb445 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:31.169384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41ae2e33-84a3-4608-82fc-79e930cdb445 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:31.169384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41ae2e33-84a3-4608-82fc-79e930cdb445 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:31.169991 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41ae2e33-84a3-4608-82fc-79e930cdb445 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:31.205025 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-41ae2e33-84a3-4608-82fc-79e930cdb445 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053156 Oct 05 03:10:31.205675 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3223/6431] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:10:31 2022] GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:10:32.217656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c9fd0a5b-6307-4de7-bc35-35253f4f4cca tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:32.219840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c9fd0a5b-6307-4de7-bc35-35253f4f4cca tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 768c2f84-34f0-4885-9521-fb0c4fd09256] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:32.226530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c9fd0a5b-6307-4de7-bc35-35253f4f4cca tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:32.227254 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c9fd0a5b-6307-4de7-bc35-35253f4f4cca tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:32.227706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c9fd0a5b-6307-4de7-bc35-35253f4f4cca tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:32.228417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c9fd0a5b-6307-4de7-bc35-35253f4f4cca tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:32.228876 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c9fd0a5b-6307-4de7-bc35-35253f4f4cca tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:32.229337 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c9fd0a5b-6307-4de7-bc35-35253f4f4cca tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:32.270204 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c9fd0a5b-6307-4de7-bc35-35253f4f4cca tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056863 Oct 05 03:10:32.276455 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3209/6432] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:10:32 2022] GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 03:10:32.341808 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-505f342b-dcb5-41d0-92a5-e254d9f403e3 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:32.342323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-505f342b-dcb5-41d0-92a5-e254d9f403e3 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 768c2f84-34f0-4885-9521-fb0c4fd09256] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:32.349278 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-505f342b-dcb5-41d0-92a5-e254d9f403e3 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:32.349875 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-505f342b-dcb5-41d0-92a5-e254d9f403e3 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:32.350375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-505f342b-dcb5-41d0-92a5-e254d9f403e3 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:32.351481 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-505f342b-dcb5-41d0-92a5-e254d9f403e3 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:32.352127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-505f342b-dcb5-41d0-92a5-e254d9f403e3 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:32.352558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-505f342b-dcb5-41d0-92a5-e254d9f403e3 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:32.384362 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-505f342b-dcb5-41d0-92a5-e254d9f403e3 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 768c2f84-34f0-4885-9521-fb0c4fd09256] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:10:32.474242 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-505f342b-dcb5-41d0-92a5-e254d9f403e3 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "DELETE /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256" status: 204 len: 0 microversion: 2.1 time: 0.136218 Oct 05 03:10:32.475056 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3224/6433] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:10:32 2022] DELETE /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:10:32.487838 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2dcafd64-8a61-4f02-ba6c-e90541274aac tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:32.489175 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2dcafd64-8a61-4f02-ba6c-e90541274aac tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 768c2f84-34f0-4885-9521-fb0c4fd09256] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:32.498519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2dcafd64-8a61-4f02-ba6c-e90541274aac tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:32.499250 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2dcafd64-8a61-4f02-ba6c-e90541274aac tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:32.499917 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2dcafd64-8a61-4f02-ba6c-e90541274aac tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:32.501018 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2dcafd64-8a61-4f02-ba6c-e90541274aac tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:32.501728 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2dcafd64-8a61-4f02-ba6c-e90541274aac tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:32.502380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2dcafd64-8a61-4f02-ba6c-e90541274aac tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:32.643907 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2dcafd64-8a61-4f02-ba6c-e90541274aac tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:32.659310 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2dcafd64-8a61-4f02-ba6c-e90541274aac tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256" status: 200 len: 1681 microversion: 2.1 time: 0.179030 Oct 05 03:10:32.672230 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3210/6434] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:32 2022] GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256 => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:33.589289 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ab9c2fc9-fd54-4870-957b-a6a92f1ff88a tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-536165134", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "9dfd6b53-87c5-4d8c-99cd-7b297eaaf178"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:10:33.642669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-ab9c2fc9-fd54-4870-957b-a6a92f1ff88a tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] validate_networks() for [('9dfd6b53-87c5-4d8c-99cd-7b297eaaf178', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:10:33.685642 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fe31487b-06ee-4398-a167-72f3779f492f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:33.686411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fe31487b-06ee-4398-a167-72f3779f492f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 768c2f84-34f0-4885-9521-fb0c4fd09256] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:33.693475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe31487b-06ee-4398-a167-72f3779f492f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:33.693997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe31487b-06ee-4398-a167-72f3779f492f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:33.694450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe31487b-06ee-4398-a167-72f3779f492f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:33.695154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe31487b-06ee-4398-a167-72f3779f492f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:33.695634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe31487b-06ee-4398-a167-72f3779f492f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:33.696048 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe31487b-06ee-4398-a167-72f3779f492f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:33.701141 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:33.905479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fe31487b-06ee-4398-a167-72f3779f492f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:33.913683 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fe31487b-06ee-4398-a167-72f3779f492f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256" status: 200 len: 1681 microversion: 2.1 time: 0.232616 Oct 05 03:10:33.914357 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3211/6435] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:33 2022] GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256 => generated 1681 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:10:34.064348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-ab9c2fc9-fd54-4870-957b-a6a92f1ff88a tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:10:34.064786 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-ab9c2fc9-fd54-4870-957b-a6a92f1ff88a tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:10:34.065290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-ab9c2fc9-fd54-4870-957b-a6a92f1ff88a tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:10:34.065702 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-ab9c2fc9-fd54-4870-957b-a6a92f1ff88a tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:10:34.066114 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-ab9c2fc9-fd54-4870-957b-a6a92f1ff88a tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:10:34.074984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab9c2fc9-fd54-4870-957b-a6a92f1ff88a tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:34.075470 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab9c2fc9-fd54-4870-957b-a6a92f1ff88a tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:34.075910 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab9c2fc9-fd54-4870-957b-a6a92f1ff88a tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:34.076636 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab9c2fc9-fd54-4870-957b-a6a92f1ff88a tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:34.077122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab9c2fc9-fd54-4870-957b-a6a92f1ff88a tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:34.077551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab9c2fc9-fd54-4870-957b-a6a92f1ff88a tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:34.084803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:34.097945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-ab9c2fc9-fd54-4870-957b-a6a92f1ff88a tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Getting quotas for project 7870e0fcc68d4c72b38433b9842776e9. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:10:34.103222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-ab9c2fc9-fd54-4870-957b-a6a92f1ff88a tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Getting quotas for user df2916e2193240d691e61a20e9f1b205 and project 7870e0fcc68d4c72b38433b9842776e9. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:10:34.116788 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ab9c2fc9-fd54-4870-957b-a6a92f1ff88a tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:10:34.119204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ab9c2fc9-fd54-4870-957b-a6a92f1ff88a tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] [instance: 65e616c6-e587-40a3-a7e1-c21d7214a126] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:10:34.163371 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ab9c2fc9-fd54-4870-957b-a6a92f1ff88a tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.693127 Oct 05 03:10:34.164340 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3225/6436] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:10:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:10:34.176012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ce9c92a7-1173-4745-991a-041c7db9d201 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:34.176621 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ce9c92a7-1173-4745-991a-041c7db9d201 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] [instance: 65e616c6-e587-40a3-a7e1-c21d7214a126] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:34.243180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ce9c92a7-1173-4745-991a-041c7db9d201 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2916e2193240d691e61a20e9f1b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7870e0fcc68d4c72b38433b9842776e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:34.251819 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ce9c92a7-1173-4745-991a-041c7db9d201 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] 10.222.0.16 "GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126" status: 200 len: 1214 microversion: 2.1 time: 0.079470 Oct 05 03:10:34.252774 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3212/6437] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:34 2022] GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:34.938700 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4f956d69-b462-496d-bf3a-375d1f01d756 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:34.939390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4f956d69-b462-496d-bf3a-375d1f01d756 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 768c2f84-34f0-4885-9521-fb0c4fd09256] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:34.946945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f956d69-b462-496d-bf3a-375d1f01d756 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:34.947511 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f956d69-b462-496d-bf3a-375d1f01d756 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:34.947959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f956d69-b462-496d-bf3a-375d1f01d756 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:34.948667 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f956d69-b462-496d-bf3a-375d1f01d756 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:34.949362 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f956d69-b462-496d-bf3a-375d1f01d756 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:34.950281 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f956d69-b462-496d-bf3a-375d1f01d756 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:35.040038 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4f956d69-b462-496d-bf3a-375d1f01d756 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881baf1ede7e4fb5acf65268a81241ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b99b6a5b1764f64a68793f37d4f9b96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:35.048695 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4f956d69-b462-496d-bf3a-375d1f01d756 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256" status: 200 len: 1613 microversion: 2.1 time: 0.115469 Oct 05 03:10:35.049325 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3226/6438] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:34 2022] GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256 => generated 1613 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:35.145994 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-4e69cc38-f346-4556-bade-f0d6475598c0 req-d5841002-3f69-4d9e-be23-92a7f2b73866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "768c2f84-34f0-4885-9521-fb0c4fd09256", "name": "network-vif-deleted", "tag": "99d40578-6e7f-48ee-895e-ceebb7732568"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:10:35.157235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4e69cc38-f346-4556-bade-f0d6475598c0 req-d5841002-3f69-4d9e-be23-92a7f2b73866 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:35.157813 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4e69cc38-f346-4556-bade-f0d6475598c0 req-d5841002-3f69-4d9e-be23-92a7f2b73866 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:35.158309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4e69cc38-f346-4556-bade-f0d6475598c0 req-d5841002-3f69-4d9e-be23-92a7f2b73866 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:35.169376 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-4e69cc38-f346-4556-bade-f0d6475598c0 req-d5841002-3f69-4d9e-be23-92a7f2b73866 service nova] Creating event network-vif-deleted:99d40578-6e7f-48ee-895e-ceebb7732568 for instance 768c2f84-34f0-4885-9521-fb0c4fd09256 on n-h1-858272-3 Oct 05 03:10:35.174947 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-4e69cc38-f346-4556-bade-f0d6475598c0 req-d5841002-3f69-4d9e-be23-92a7f2b73866 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032701 Oct 05 03:10:35.177060 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3213/6439] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:10:35.275813 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ff88f073-8fed-47b8-a5a3-c1e5eec2e57e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:35.276813 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ff88f073-8fed-47b8-a5a3-c1e5eec2e57e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] [instance: 65e616c6-e587-40a3-a7e1-c21d7214a126] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:35.295371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff88f073-8fed-47b8-a5a3-c1e5eec2e57e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:35.296189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff88f073-8fed-47b8-a5a3-c1e5eec2e57e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:35.296814 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff88f073-8fed-47b8-a5a3-c1e5eec2e57e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:35.297830 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff88f073-8fed-47b8-a5a3-c1e5eec2e57e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:35.298458 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff88f073-8fed-47b8-a5a3-c1e5eec2e57e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:35.299065 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff88f073-8fed-47b8-a5a3-c1e5eec2e57e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:35.409905 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ff88f073-8fed-47b8-a5a3-c1e5eec2e57e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2916e2193240d691e61a20e9f1b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7870e0fcc68d4c72b38433b9842776e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:35.423600 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ff88f073-8fed-47b8-a5a3-c1e5eec2e57e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] 10.222.0.16 "GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126" status: 200 len: 1274 microversion: 2.1 time: 0.151637 Oct 05 03:10:35.436033 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3227/6440] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:35 2022] GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126 => generated 1274 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:36.073389 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9e005f4b-a2dd-4487-a0c5-0ec07d35530c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:36.074099 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9e005f4b-a2dd-4487-a0c5-0ec07d35530c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 768c2f84-34f0-4885-9521-fb0c4fd09256] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:36.082293 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e005f4b-a2dd-4487-a0c5-0ec07d35530c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:36.082789 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e005f4b-a2dd-4487-a0c5-0ec07d35530c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:36.083645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e005f4b-a2dd-4487-a0c5-0ec07d35530c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:36.084446 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e005f4b-a2dd-4487-a0c5-0ec07d35530c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:36.085153 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e005f4b-a2dd-4487-a0c5-0ec07d35530c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:36.085407 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e005f4b-a2dd-4487-a0c5-0ec07d35530c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:36.101470 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-9e005f4b-a2dd-4487-a0c5-0ec07d35530c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] HTTP exception thrown: Instance 768c2f84-34f0-4885-9521-fb0c4fd09256 could not be found. Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9e005f4b-a2dd-4487-a0c5-0ec07d35530c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Request method failure captured: Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256 HTTP/1.1 Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPQLbaCJcQoINHOY2GKTbE6oK5DZKXlvS9cTUJZgUsjhzJ11GCBMxKRG2ZW2HydnkNGtZ8u98fUAxnzQFqGG-K-d7yptqwDawf-PQoraVusgo1XYypQQkhEqqbJdJFh02G9QsSpvTDhdtNr6cnzMOTz-5c9_S6hWETgH6FWjUbmuXPI Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 7b99b6a5b1764f64a68793f37d4f9b96 Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 7b99b6a5b1764f64a68793f37d4f9b96 Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-AttachVolumeNegativeTest-2082311660-project Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 881baf1ede7e4fb5acf65268a81241ad Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-AttachVolumeNegativeTest-2082311660-project Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 768c2f84-34f0-4885-9521-fb0c4fd09256 could not be found. Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '768c2f84-34f0-4885-9521-fb0c4fd09256'} Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 768c2f84-34f0-4885-9521-fb0c4fd09256 could not be found. Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 768c2f84-34f0-4885-9521-fb0c4fd09256 could not be found. Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:10:36.103434 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:10:36.108824 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:10:36.108824 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:10:36.108824 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:10:36.108824 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:10:36.108824 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:10:36.108824 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 768c2f84-34f0-4885-9521-fb0c4fd09256 could not be found. Oct 05 03:10:36.108824 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:10:36.108824 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9e005f4b-a2dd-4487-a0c5-0ec07d35530c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Returning 404 to user: Instance 768c2f84-34f0-4885-9521-fb0c4fd09256 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:10:36.108824 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9e005f4b-a2dd-4487-a0c5-0ec07d35530c tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256" status: 404 len: 111 microversion: 2.1 time: 0.036135 Oct 05 03:10:36.108824 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3214/6441] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:36 2022] GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:10:36.117891 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d2a3243f-3dc6-41c8-8afe-6972d4e3be0b tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '.version_select at 0x7fccdeb7cca0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:36.139497 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d2a3243f-3dc6-41c8-8afe-6972d4e3be0b tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-333353936" status: 202 len: 0 microversion: 2.1 time: 0.025423 Oct 05 03:10:36.140093 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3228/6442] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 5 03:10:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-333353936 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:10:36.451476 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c4d28cdc-317b-4087-b8c8-dd656acd5c23 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:36.452171 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c4d28cdc-317b-4087-b8c8-dd656acd5c23 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] [instance: 65e616c6-e587-40a3-a7e1-c21d7214a126] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:36.463106 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4d28cdc-317b-4087-b8c8-dd656acd5c23 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:36.464038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4d28cdc-317b-4087-b8c8-dd656acd5c23 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:36.464913 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4d28cdc-317b-4087-b8c8-dd656acd5c23 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:36.465890 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4d28cdc-317b-4087-b8c8-dd656acd5c23 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:36.466677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4d28cdc-317b-4087-b8c8-dd656acd5c23 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:36.467560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4d28cdc-317b-4087-b8c8-dd656acd5c23 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:36.705176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c4d28cdc-317b-4087-b8c8-dd656acd5c23 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2916e2193240d691e61a20e9f1b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7870e0fcc68d4c72b38433b9842776e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:36.713482 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c4d28cdc-317b-4087-b8c8-dd656acd5c23 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] 10.222.0.16 "GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126" status: 200 len: 1314 microversion: 2.1 time: 0.267226 Oct 05 03:10:36.714260 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3215/6443] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:36 2022] GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:37.211565 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-d3cd5e4a-ac21-40fd-b1e5-c8568b1de862 req-a71cce3e-f428-4a57-9507-fc70a042322d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65e616c6-e587-40a3-a7e1-c21d7214a126", "tag": "5b720215-0092-408b-b90f-3ced670c4c13"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:10:37.224182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d3cd5e4a-ac21-40fd-b1e5-c8568b1de862 req-a71cce3e-f428-4a57-9507-fc70a042322d service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:37.225067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d3cd5e4a-ac21-40fd-b1e5-c8568b1de862 req-a71cce3e-f428-4a57-9507-fc70a042322d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:37.225499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d3cd5e4a-ac21-40fd-b1e5-c8568b1de862 req-a71cce3e-f428-4a57-9507-fc70a042322d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:37.237200 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-d3cd5e4a-ac21-40fd-b1e5-c8568b1de862 req-a71cce3e-f428-4a57-9507-fc70a042322d service nova] Creating event network-changed:5b720215-0092-408b-b90f-3ced670c4c13 for instance 65e616c6-e587-40a3-a7e1-c21d7214a126 on n-h1-858272-3 Oct 05 03:10:37.247949 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-d3cd5e4a-ac21-40fd-b1e5-c8568b1de862 req-a71cce3e-f428-4a57-9507-fc70a042322d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046970 Oct 05 03:10:37.249219 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3229/6444] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:10:37.737831 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-85123c7f-3349-4775-a177-bd7a4d3f613e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:37.738426 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-85123c7f-3349-4775-a177-bd7a4d3f613e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] [instance: 65e616c6-e587-40a3-a7e1-c21d7214a126] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:37.745964 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85123c7f-3349-4775-a177-bd7a4d3f613e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:37.746522 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85123c7f-3349-4775-a177-bd7a4d3f613e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:37.747057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85123c7f-3349-4775-a177-bd7a4d3f613e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:37.747761 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85123c7f-3349-4775-a177-bd7a4d3f613e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:37.748217 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85123c7f-3349-4775-a177-bd7a4d3f613e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:37.748642 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85123c7f-3349-4775-a177-bd7a4d3f613e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:37.882323 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-85123c7f-3349-4775-a177-bd7a4d3f613e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2916e2193240d691e61a20e9f1b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7870e0fcc68d4c72b38433b9842776e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:37.891256 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-85123c7f-3349-4775-a177-bd7a4d3f613e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] 10.222.0.16 "GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126" status: 200 len: 1314 microversion: 2.1 time: 0.157431 Oct 05 03:10:37.891842 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3216/6445] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:37 2022] GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:38.915985 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-74cef9da-8e5c-4580-aba4-a7cd450d0f6f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:38.916767 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-74cef9da-8e5c-4580-aba4-a7cd450d0f6f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] [instance: 65e616c6-e587-40a3-a7e1-c21d7214a126] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:38.923293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74cef9da-8e5c-4580-aba4-a7cd450d0f6f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:38.923792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74cef9da-8e5c-4580-aba4-a7cd450d0f6f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:38.924232 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74cef9da-8e5c-4580-aba4-a7cd450d0f6f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:38.924946 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74cef9da-8e5c-4580-aba4-a7cd450d0f6f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:38.925405 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74cef9da-8e5c-4580-aba4-a7cd450d0f6f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:38.925832 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-74cef9da-8e5c-4580-aba4-a7cd450d0f6f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:39.065065 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-74cef9da-8e5c-4580-aba4-a7cd450d0f6f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2916e2193240d691e61a20e9f1b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7870e0fcc68d4c72b38433b9842776e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:39.072916 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-74cef9da-8e5c-4580-aba4-a7cd450d0f6f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] 10.222.0.16 "GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126" status: 200 len: 1314 microversion: 2.1 time: 0.161896 Oct 05 03:10:39.073769 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3230/6446] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:38 2022] GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:40.088645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-644b3944-e878-4cf8-9973-d3f42a16a750 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:40.089873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-644b3944-e878-4cf8-9973-d3f42a16a750 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 768c2f84-34f0-4885-9521-fb0c4fd09256] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:40.096163 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2fcd6135-feb5-4e1d-af1d-b11f29ec3f66 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:40.096761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2fcd6135-feb5-4e1d-af1d-b11f29ec3f66 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] [instance: 65e616c6-e587-40a3-a7e1-c21d7214a126] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:40.111356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-644b3944-e878-4cf8-9973-d3f42a16a750 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:40.113344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fcd6135-feb5-4e1d-af1d-b11f29ec3f66 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:40.114491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-644b3944-e878-4cf8-9973-d3f42a16a750 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:40.114931 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-644b3944-e878-4cf8-9973-d3f42a16a750 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:40.115651 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-644b3944-e878-4cf8-9973-d3f42a16a750 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:40.116099 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-644b3944-e878-4cf8-9973-d3f42a16a750 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:40.116477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fcd6135-feb5-4e1d-af1d-b11f29ec3f66 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:40.117116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fcd6135-feb5-4e1d-af1d-b11f29ec3f66 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:40.117978 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fcd6135-feb5-4e1d-af1d-b11f29ec3f66 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:40.118600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fcd6135-feb5-4e1d-af1d-b11f29ec3f66 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:40.119026 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fcd6135-feb5-4e1d-af1d-b11f29ec3f66 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:40.124231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-644b3944-e878-4cf8-9973-d3f42a16a750 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:40.154232 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-644b3944-e878-4cf8-9973-d3f42a16a750 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] HTTP exception thrown: Instance 768c2f84-34f0-4885-9521-fb0c4fd09256 could not be found. Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-644b3944-e878-4cf8-9973-d3f42a16a750 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Request method failure captured: Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256 HTTP/1.1 Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPQLbaCJcQoINHOY2GKTbE6oK5DZKXlvS9cTUJZgUsjhzJ11GCBMxKRG2ZW2HydnkNGtZ8u98fUAxnzQFqGG-K-d7yptqwDawf-PQoraVusgo1XYypQQkhEqqbJdJFh02G9QsSpvTDhdtNr6cnzMOTz-5c9_S6hWETgH6FWjUbmuXPI Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 7b99b6a5b1764f64a68793f37d4f9b96 Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 7b99b6a5b1764f64a68793f37d4f9b96 Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-AttachVolumeNegativeTest-2082311660-project Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 881baf1ede7e4fb5acf65268a81241ad Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-AttachVolumeNegativeTest-2082311660-project Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 768c2f84-34f0-4885-9521-fb0c4fd09256 could not be found. Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '768c2f84-34f0-4885-9521-fb0c4fd09256'} Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 768c2f84-34f0-4885-9521-fb0c4fd09256 could not be found. Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:10:40.156400 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:10:40.160543 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 768c2f84-34f0-4885-9521-fb0c4fd09256 could not be found. Oct 05 03:10:40.160543 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:10:40.160543 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:10:40.160543 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:10:40.160543 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:10:40.160543 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:10:40.160543 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:10:40.160543 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:10:40.160543 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:10:40.160543 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 768c2f84-34f0-4885-9521-fb0c4fd09256 could not be found. Oct 05 03:10:40.160543 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:10:40.164721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-644b3944-e878-4cf8-9973-d3f42a16a750 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Returning 404 to user: Instance 768c2f84-34f0-4885-9521-fb0c4fd09256 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:10:40.166630 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-644b3944-e878-4cf8-9973-d3f42a16a750 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "DELETE /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256" status: 404 len: 111 microversion: 2.1 time: 0.081125 Oct 05 03:10:40.169931 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3217/6447] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:10:40 2022] DELETE /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:10:40.179083 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-771c8c64-5f08-4353-8482-145e76ac841d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:40.179979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-771c8c64-5f08-4353-8482-145e76ac841d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 768c2f84-34f0-4885-9521-fb0c4fd09256] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:40.188599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-771c8c64-5f08-4353-8482-145e76ac841d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:40.189326 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-771c8c64-5f08-4353-8482-145e76ac841d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:40.190385 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-771c8c64-5f08-4353-8482-145e76ac841d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:40.191846 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-771c8c64-5f08-4353-8482-145e76ac841d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:40.192709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-771c8c64-5f08-4353-8482-145e76ac841d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:40.193424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-771c8c64-5f08-4353-8482-145e76ac841d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:40.212160 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-771c8c64-5f08-4353-8482-145e76ac841d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] HTTP exception thrown: Instance 768c2f84-34f0-4885-9521-fb0c4fd09256 could not be found. Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-771c8c64-5f08-4353-8482-145e76ac841d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Request method failure captured: Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256 HTTP/1.1 Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPQLbaCJcQoINHOY2GKTbE6oK5DZKXlvS9cTUJZgUsjhzJ11GCBMxKRG2ZW2HydnkNGtZ8u98fUAxnzQFqGG-K-d7yptqwDawf-PQoraVusgo1XYypQQkhEqqbJdJFh02G9QsSpvTDhdtNr6cnzMOTz-5c9_S6hWETgH6FWjUbmuXPI Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 7b99b6a5b1764f64a68793f37d4f9b96 Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 7b99b6a5b1764f64a68793f37d4f9b96 Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-AttachVolumeNegativeTest-2082311660-project Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 881baf1ede7e4fb5acf65268a81241ad Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-AttachVolumeNegativeTest-2082311660-project Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 768c2f84-34f0-4885-9521-fb0c4fd09256 could not be found. Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '768c2f84-34f0-4885-9521-fb0c4fd09256'} Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 768c2f84-34f0-4885-9521-fb0c4fd09256 could not be found. Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 768c2f84-34f0-4885-9521-fb0c4fd09256 could not be found. Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:10:40.214372 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:10:40.219303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:10:40.219303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:10:40.219303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:10:40.219303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:10:40.219303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:10:40.219303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 768c2f84-34f0-4885-9521-fb0c4fd09256 could not be found. Oct 05 03:10:40.219303 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:10:40.221283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-771c8c64-5f08-4353-8482-145e76ac841d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Returning 404 to user: Instance 768c2f84-34f0-4885-9521-fb0c4fd09256 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:10:40.222982 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-771c8c64-5f08-4353-8482-145e76ac841d tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256" status: 404 len: 111 microversion: 2.1 time: 0.048449 Oct 05 03:10:40.224175 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3218/6448] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:40 2022] GET /compute/v2.1/servers/768c2f84-34f0-4885-9521-fb0c4fd09256 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:10:40.298447 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2fcd6135-feb5-4e1d-af1d-b11f29ec3f66 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2916e2193240d691e61a20e9f1b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7870e0fcc68d4c72b38433b9842776e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:40.307417 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2fcd6135-feb5-4e1d-af1d-b11f29ec3f66 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] 10.222.0.16 "GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126" status: 200 len: 1314 microversion: 2.1 time: 0.215568 Oct 05 03:10:40.308668 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3231/6449] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:40 2022] GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:10:41.333228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-878a2778-b13c-4762-b08c-438f4b954b87 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:41.334083 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-878a2778-b13c-4762-b08c-438f4b954b87 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] [instance: 65e616c6-e587-40a3-a7e1-c21d7214a126] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:41.342522 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-878a2778-b13c-4762-b08c-438f4b954b87 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:41.343101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-878a2778-b13c-4762-b08c-438f4b954b87 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:41.343619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-878a2778-b13c-4762-b08c-438f4b954b87 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:41.345039 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-878a2778-b13c-4762-b08c-438f4b954b87 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:41.345580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-878a2778-b13c-4762-b08c-438f4b954b87 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:41.346085 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-878a2778-b13c-4762-b08c-438f4b954b87 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:41.514960 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-878a2778-b13c-4762-b08c-438f4b954b87 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2916e2193240d691e61a20e9f1b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7870e0fcc68d4c72b38433b9842776e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:41.523331 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-878a2778-b13c-4762-b08c-438f4b954b87 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] 10.222.0.16 "GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126" status: 200 len: 1314 microversion: 2.1 time: 0.194209 Oct 05 03:10:41.523937 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3219/6450] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:41 2022] GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:42.547162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-123393f0-f4f1-48f0-8d58-ddcfde441bee tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:42.547904 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-123393f0-f4f1-48f0-8d58-ddcfde441bee tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] [instance: 65e616c6-e587-40a3-a7e1-c21d7214a126] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:42.554880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-123393f0-f4f1-48f0-8d58-ddcfde441bee tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:42.555437 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-123393f0-f4f1-48f0-8d58-ddcfde441bee tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:42.555876 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-123393f0-f4f1-48f0-8d58-ddcfde441bee tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:42.556566 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-123393f0-f4f1-48f0-8d58-ddcfde441bee tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:42.557047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-123393f0-f4f1-48f0-8d58-ddcfde441bee tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:42.557467 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-123393f0-f4f1-48f0-8d58-ddcfde441bee tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:42.693986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-123393f0-f4f1-48f0-8d58-ddcfde441bee tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2916e2193240d691e61a20e9f1b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7870e0fcc68d4c72b38433b9842776e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:42.703019 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-123393f0-f4f1-48f0-8d58-ddcfde441bee tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] 10.222.0.16 "GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126" status: 200 len: 1314 microversion: 2.1 time: 0.160158 Oct 05 03:10:42.703535 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3232/6451] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:42 2022] GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:43.062783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-1f6f32c4-6d87-4d36-9d6b-7df7abdd0111 req-6cff43d7-0f12-4444-848b-d320e7bfe890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65e616c6-e587-40a3-a7e1-c21d7214a126", "name": "network-vif-plugged", "status": "completed", "tag": "5b720215-0092-408b-b90f-3ced670c4c13"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:10:43.073290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1f6f32c4-6d87-4d36-9d6b-7df7abdd0111 req-6cff43d7-0f12-4444-848b-d320e7bfe890 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:43.075228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1f6f32c4-6d87-4d36-9d6b-7df7abdd0111 req-6cff43d7-0f12-4444-848b-d320e7bfe890 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:43.076001 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1f6f32c4-6d87-4d36-9d6b-7df7abdd0111 req-6cff43d7-0f12-4444-848b-d320e7bfe890 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:43.088475 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-1f6f32c4-6d87-4d36-9d6b-7df7abdd0111 req-6cff43d7-0f12-4444-848b-d320e7bfe890 service nova] Creating event network-vif-plugged:5b720215-0092-408b-b90f-3ced670c4c13 for instance 65e616c6-e587-40a3-a7e1-c21d7214a126 on n-h1-858272-3 Oct 05 03:10:43.095508 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-1f6f32c4-6d87-4d36-9d6b-7df7abdd0111 req-6cff43d7-0f12-4444-848b-d320e7bfe890 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037135 Oct 05 03:10:43.096131 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3220/6452] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:10:43.534192 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ea55d7f4-14a2-4c96-9c50-18f5d7d7a86e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:43.534625 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ea55d7f4-14a2-4c96-9c50-18f5d7d7a86e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4e3cdf79-2ab1-4e8f-b132-075fb38000da] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:43.540964 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ea55d7f4-14a2-4c96-9c50-18f5d7d7a86e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:43.541462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ea55d7f4-14a2-4c96-9c50-18f5d7d7a86e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:43.541906 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ea55d7f4-14a2-4c96-9c50-18f5d7d7a86e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:43.542610 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ea55d7f4-14a2-4c96-9c50-18f5d7d7a86e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:43.543070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ea55d7f4-14a2-4c96-9c50-18f5d7d7a86e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:43.543505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ea55d7f4-14a2-4c96-9c50-18f5d7d7a86e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:43.557717 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-ea55d7f4-14a2-4c96-9c50-18f5d7d7a86e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] HTTP exception thrown: Instance 4e3cdf79-2ab1-4e8f-b132-075fb38000da could not be found. Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ea55d7f4-14a2-4c96-9c50-18f5d7d7a86e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Request method failure captured: Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da HTTP/1.1 Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPQLbaCJcQoINHOY2GKTbE6oK5DZKXlvS9cTUJZgUsjhzJ11GCBMxKRG2ZW2HydnkNGtZ8u98fUAxnzQFqGG-K-d7yptqwDawf-PQoraVusgo1XYypQQkhEqqbJdJFh02G9QsSpvTDhdtNr6cnzMOTz-5c9_S6hWETgH6FWjUbmuXPI Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 7b99b6a5b1764f64a68793f37d4f9b96 Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 7b99b6a5b1764f64a68793f37d4f9b96 Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-AttachVolumeNegativeTest-2082311660-project Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 881baf1ede7e4fb5acf65268a81241ad Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-AttachVolumeNegativeTest-2082311660-project Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 4e3cdf79-2ab1-4e8f-b132-075fb38000da could not be found. Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '4e3cdf79-2ab1-4e8f-b132-075fb38000da'} Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e3cdf79-2ab1-4e8f-b132-075fb38000da could not be found. Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:10:43.559951 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:10:43.565780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e3cdf79-2ab1-4e8f-b132-075fb38000da could not be found. Oct 05 03:10:43.565780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:10:43.565780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:10:43.565780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:10:43.565780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:10:43.565780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:10:43.565780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:10:43.565780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:10:43.565780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:10:43.565780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e3cdf79-2ab1-4e8f-b132-075fb38000da could not be found. Oct 05 03:10:43.565780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:10:43.565780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ea55d7f4-14a2-4c96-9c50-18f5d7d7a86e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Returning 404 to user: Instance 4e3cdf79-2ab1-4e8f-b132-075fb38000da could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:10:43.565780 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ea55d7f4-14a2-4c96-9c50-18f5d7d7a86e tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da" status: 404 len: 111 microversion: 2.1 time: 0.032443 Oct 05 03:10:43.565780 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3233/6453] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:10:43 2022] DELETE /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:10:43.571654 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e4d3e759-d23b-4efe-9eda-44b3d7a2b7bd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:43.572481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e4d3e759-d23b-4efe-9eda-44b3d7a2b7bd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4e3cdf79-2ab1-4e8f-b132-075fb38000da] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:43.580706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4d3e759-d23b-4efe-9eda-44b3d7a2b7bd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:43.581220 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4d3e759-d23b-4efe-9eda-44b3d7a2b7bd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:43.581704 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4d3e759-d23b-4efe-9eda-44b3d7a2b7bd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:43.582858 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4d3e759-d23b-4efe-9eda-44b3d7a2b7bd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:43.583349 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4d3e759-d23b-4efe-9eda-44b3d7a2b7bd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:43.583778 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4d3e759-d23b-4efe-9eda-44b3d7a2b7bd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:43.598772 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-e4d3e759-d23b-4efe-9eda-44b3d7a2b7bd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] HTTP exception thrown: Instance 4e3cdf79-2ab1-4e8f-b132-075fb38000da could not be found. Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e4d3e759-d23b-4efe-9eda-44b3d7a2b7bd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Request method failure captured: Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da HTTP/1.1 Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPQLbaCJcQoINHOY2GKTbE6oK5DZKXlvS9cTUJZgUsjhzJ11GCBMxKRG2ZW2HydnkNGtZ8u98fUAxnzQFqGG-K-d7yptqwDawf-PQoraVusgo1XYypQQkhEqqbJdJFh02G9QsSpvTDhdtNr6cnzMOTz-5c9_S6hWETgH6FWjUbmuXPI Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 7b99b6a5b1764f64a68793f37d4f9b96 Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 7b99b6a5b1764f64a68793f37d4f9b96 Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-AttachVolumeNegativeTest-2082311660-project Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 881baf1ede7e4fb5acf65268a81241ad Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-AttachVolumeNegativeTest-2082311660-project Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 4e3cdf79-2ab1-4e8f-b132-075fb38000da could not be found. Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '4e3cdf79-2ab1-4e8f-b132-075fb38000da'} Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e3cdf79-2ab1-4e8f-b132-075fb38000da could not be found. Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e3cdf79-2ab1-4e8f-b132-075fb38000da could not be found. Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:10:43.600611 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:10:43.605790 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:10:43.605790 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:10:43.605790 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:10:43.605790 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:10:43.605790 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:10:43.605790 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e3cdf79-2ab1-4e8f-b132-075fb38000da could not be found. Oct 05 03:10:43.605790 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:10:43.605790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e4d3e759-d23b-4efe-9eda-44b3d7a2b7bd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Returning 404 to user: Instance 4e3cdf79-2ab1-4e8f-b132-075fb38000da could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:10:43.605790 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e4d3e759-d23b-4efe-9eda-44b3d7a2b7bd tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da" status: 404 len: 111 microversion: 2.1 time: 0.034656 Oct 05 03:10:43.605790 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3221/6454] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:43 2022] GET /compute/v2.1/servers/4e3cdf79-2ab1-4e8f-b132-075fb38000da => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 03:10:43.610750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2dba2e69-65c9-4616-b563-b87502f1309f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:43.611248 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2dba2e69-65c9-4616-b563-b87502f1309f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:43.617186 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2dba2e69-65c9-4616-b563-b87502f1309f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:43.617673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2dba2e69-65c9-4616-b563-b87502f1309f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:43.618107 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2dba2e69-65c9-4616-b563-b87502f1309f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:43.618792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2dba2e69-65c9-4616-b563-b87502f1309f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:43.619244 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2dba2e69-65c9-4616-b563-b87502f1309f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:43.619671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2dba2e69-65c9-4616-b563-b87502f1309f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:43.634459 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-2dba2e69-65c9-4616-b563-b87502f1309f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] HTTP exception thrown: Instance 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 could not be found. Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2dba2e69-65c9-4616-b563-b87502f1309f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Request method failure captured: Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 HTTP/1.1 Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPQLbaCJcQoINHOY2GKTbE6oK5DZKXlvS9cTUJZgUsjhzJ11GCBMxKRG2ZW2HydnkNGtZ8u98fUAxnzQFqGG-K-d7yptqwDawf-PQoraVusgo1XYypQQkhEqqbJdJFh02G9QsSpvTDhdtNr6cnzMOTz-5c9_S6hWETgH6FWjUbmuXPI Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 7b99b6a5b1764f64a68793f37d4f9b96 Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 7b99b6a5b1764f64a68793f37d4f9b96 Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-AttachVolumeNegativeTest-2082311660-project Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 881baf1ede7e4fb5acf65268a81241ad Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-AttachVolumeNegativeTest-2082311660-project Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 could not be found. Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '8642a9ef-f4cc-4ba0-97dd-4443e73bcd02'} Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 could not be found. Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:10:43.635979 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:10:43.641432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 could not be found. Oct 05 03:10:43.641432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:10:43.641432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:10:43.641432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:10:43.641432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:10:43.641432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:10:43.641432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:10:43.641432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:10:43.641432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:10:43.641432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 could not be found. Oct 05 03:10:43.641432 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:10:43.641432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2dba2e69-65c9-4616-b563-b87502f1309f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Returning 404 to user: Instance 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:10:43.641432 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2dba2e69-65c9-4616-b563-b87502f1309f tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02" status: 404 len: 111 microversion: 2.1 time: 0.031416 Oct 05 03:10:43.641432 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3234/6455] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:10:43 2022] DELETE /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:10:43.649943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e0d0a211-ebfa-4158-b701-1b25b3f8d7c4 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:43.650571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e0d0a211-ebfa-4158-b701-1b25b3f8d7c4 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:43.659142 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0d0a211-ebfa-4158-b701-1b25b3f8d7c4 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:43.659648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0d0a211-ebfa-4158-b701-1b25b3f8d7c4 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:43.660093 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0d0a211-ebfa-4158-b701-1b25b3f8d7c4 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:43.660807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0d0a211-ebfa-4158-b701-1b25b3f8d7c4 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:43.661474 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0d0a211-ebfa-4158-b701-1b25b3f8d7c4 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:43.661909 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0d0a211-ebfa-4158-b701-1b25b3f8d7c4 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:43.684739 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-e0d0a211-ebfa-4158-b701-1b25b3f8d7c4 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] HTTP exception thrown: Instance 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 could not be found. Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e0d0a211-ebfa-4158-b701-1b25b3f8d7c4 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Request method failure captured: Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 HTTP/1.1 Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPQLbaCJcQoINHOY2GKTbE6oK5DZKXlvS9cTUJZgUsjhzJ11GCBMxKRG2ZW2HydnkNGtZ8u98fUAxnzQFqGG-K-d7yptqwDawf-PQoraVusgo1XYypQQkhEqqbJdJFh02G9QsSpvTDhdtNr6cnzMOTz-5c9_S6hWETgH6FWjUbmuXPI Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 7b99b6a5b1764f64a68793f37d4f9b96 Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 7b99b6a5b1764f64a68793f37d4f9b96 Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-AttachVolumeNegativeTest-2082311660-project Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 881baf1ede7e4fb5acf65268a81241ad Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-AttachVolumeNegativeTest-2082311660-project Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 could not be found. Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '8642a9ef-f4cc-4ba0-97dd-4443e73bcd02'} Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 could not be found. Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 could not be found. Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:10:43.686415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:10:43.691422 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:10:43.691422 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:10:43.691422 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:10:43.691422 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:10:43.691422 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:10:43.691422 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 could not be found. Oct 05 03:10:43.691422 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:10:43.691422 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e0d0a211-ebfa-4158-b701-1b25b3f8d7c4 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Returning 404 to user: Instance 8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:10:43.691422 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e0d0a211-ebfa-4158-b701-1b25b3f8d7c4 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02" status: 404 len: 111 microversion: 2.1 time: 0.041756 Oct 05 03:10:43.691422 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3222/6456] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:43 2022] GET /compute/v2.1/servers/8642a9ef-f4cc-4ba0-97dd-4443e73bcd02 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:10:43.726210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-69620183-1cff-45ac-9177-d70596bf775d tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:43.726930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-69620183-1cff-45ac-9177-d70596bf775d tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] [instance: 65e616c6-e587-40a3-a7e1-c21d7214a126] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:43.734227 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69620183-1cff-45ac-9177-d70596bf775d tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:43.734726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69620183-1cff-45ac-9177-d70596bf775d tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:43.735252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69620183-1cff-45ac-9177-d70596bf775d tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:43.735885 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69620183-1cff-45ac-9177-d70596bf775d tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:43.736345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69620183-1cff-45ac-9177-d70596bf775d tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:43.736776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-69620183-1cff-45ac-9177-d70596bf775d tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:43.901740 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-69620183-1cff-45ac-9177-d70596bf775d tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2916e2193240d691e61a20e9f1b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7870e0fcc68d4c72b38433b9842776e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:43.912039 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-69620183-1cff-45ac-9177-d70596bf775d tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] 10.222.0.16 "GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126" status: 200 len: 1314 microversion: 2.1 time: 0.189565 Oct 05 03:10:43.914105 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3235/6457] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:43 2022] GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:44.937794 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-02504678-877f-4152-ba4b-000bd5587240 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:44.938503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-02504678-877f-4152-ba4b-000bd5587240 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] [instance: 65e616c6-e587-40a3-a7e1-c21d7214a126] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:44.945469 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:44.950095 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02504678-877f-4152-ba4b-000bd5587240 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:44.950680 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02504678-877f-4152-ba4b-000bd5587240 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:44.951197 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02504678-877f-4152-ba4b-000bd5587240 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:44.951968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02504678-877f-4152-ba4b-000bd5587240 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:44.952506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02504678-877f-4152-ba4b-000bd5587240 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:44.953031 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-02504678-877f-4152-ba4b-000bd5587240 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:45.089612 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-02504678-877f-4152-ba4b-000bd5587240 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2916e2193240d691e61a20e9f1b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7870e0fcc68d4c72b38433b9842776e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:45.101744 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-02504678-877f-4152-ba4b-000bd5587240 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] 10.222.0.16 "GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126" status: 200 len: 1501 microversion: 2.1 time: 0.168068 Oct 05 03:10:45.102440 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3223/6458] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:44 2022] GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126 => generated 1501 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:45.125238 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cd4ac6f6-9800-4d94-b0b9-95b9ae476f6f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:45.125850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cd4ac6f6-9800-4d94-b0b9-95b9ae476f6f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] [instance: 65e616c6-e587-40a3-a7e1-c21d7214a126] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:45.127783 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:45.128455 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:45.137090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd4ac6f6-9800-4d94-b0b9-95b9ae476f6f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:45.137696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd4ac6f6-9800-4d94-b0b9-95b9ae476f6f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:45.138010 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd4ac6f6-9800-4d94-b0b9-95b9ae476f6f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:45.138704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd4ac6f6-9800-4d94-b0b9-95b9ae476f6f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:45.139153 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd4ac6f6-9800-4d94-b0b9-95b9ae476f6f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:45.139572 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd4ac6f6-9800-4d94-b0b9-95b9ae476f6f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:45.276085 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cd4ac6f6-9800-4d94-b0b9-95b9ae476f6f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2916e2193240d691e61a20e9f1b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7870e0fcc68d4c72b38433b9842776e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:45.284554 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cd4ac6f6-9800-4d94-b0b9-95b9ae476f6f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] 10.222.0.16 "GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126" status: 200 len: 1501 microversion: 2.1 time: 0.163235 Oct 05 03:10:45.285172 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3236/6459] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:45 2022] GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126 => generated 1501 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:45.309891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-56db255d-b516-462c-aef9-cf0b541dec4e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:10:45.310461 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-56db255d-b516-462c-aef9-cf0b541dec4e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] [instance: 65e616c6-e587-40a3-a7e1-c21d7214a126] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:45.316641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56db255d-b516-462c-aef9-cf0b541dec4e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:45.317181 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56db255d-b516-462c-aef9-cf0b541dec4e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:45.317623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56db255d-b516-462c-aef9-cf0b541dec4e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:45.318506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56db255d-b516-462c-aef9-cf0b541dec4e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:45.318967 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56db255d-b516-462c-aef9-cf0b541dec4e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:45.319570 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56db255d-b516-462c-aef9-cf0b541dec4e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:45.344170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-56db255d-b516-462c-aef9-cf0b541dec4e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lazy-loading 'flavor' on Instance uuid 65e616c6-e587-40a3-a7e1-c21d7214a126 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:10:45.410597 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-56db255d-b516-462c-aef9-cf0b541dec4e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] 10.222.0.16 "POST /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126/action" status: 202 len: 0 microversion: 2.1 time: 0.104954 Oct 05 03:10:45.411516 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3224/6460] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:10:45 2022] POST /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:10:45.420636 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-554835be-008d-4775-8d19-a43d0be95db9 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:45.421442 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-554835be-008d-4775-8d19-a43d0be95db9 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] [instance: 65e616c6-e587-40a3-a7e1-c21d7214a126] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:45.428562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-554835be-008d-4775-8d19-a43d0be95db9 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:45.429391 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-554835be-008d-4775-8d19-a43d0be95db9 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:45.430068 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-554835be-008d-4775-8d19-a43d0be95db9 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:45.431499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-554835be-008d-4775-8d19-a43d0be95db9 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:45.432612 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-554835be-008d-4775-8d19-a43d0be95db9 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:45.433425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-554835be-008d-4775-8d19-a43d0be95db9 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:45.564534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-554835be-008d-4775-8d19-a43d0be95db9 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2916e2193240d691e61a20e9f1b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7870e0fcc68d4c72b38433b9842776e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:45.572280 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-554835be-008d-4775-8d19-a43d0be95db9 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] 10.222.0.16 "GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126" status: 200 len: 1509 microversion: 2.1 time: 0.155973 Oct 05 03:10:45.572853 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3237/6461] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:45 2022] GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:46.598277 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-99de9835-fda1-4e69-a747-632a128c85f6 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:46.599095 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-99de9835-fda1-4e69-a747-632a128c85f6 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] [instance: 65e616c6-e587-40a3-a7e1-c21d7214a126] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:46.605509 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99de9835-fda1-4e69-a747-632a128c85f6 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:46.605996 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99de9835-fda1-4e69-a747-632a128c85f6 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:46.606431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99de9835-fda1-4e69-a747-632a128c85f6 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:46.607155 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99de9835-fda1-4e69-a747-632a128c85f6 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:46.607606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99de9835-fda1-4e69-a747-632a128c85f6 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:46.608029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-99de9835-fda1-4e69-a747-632a128c85f6 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:46.743379 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-99de9835-fda1-4e69-a747-632a128c85f6 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2916e2193240d691e61a20e9f1b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7870e0fcc68d4c72b38433b9842776e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:46.751977 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-99de9835-fda1-4e69-a747-632a128c85f6 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] 10.222.0.16 "GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126" status: 200 len: 1492 microversion: 2.1 time: 0.159155 Oct 05 03:10:46.752550 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3225/6462] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:46 2022] GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126 => generated 1492 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:46.775479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-affa78a1-a097-4683-8229-0e0668f91ddd tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:10:46.776092 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-affa78a1-a097-4683-8229-0e0668f91ddd tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] [instance: 65e616c6-e587-40a3-a7e1-c21d7214a126] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:46.783198 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-affa78a1-a097-4683-8229-0e0668f91ddd tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:46.783763 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-affa78a1-a097-4683-8229-0e0668f91ddd tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:46.784281 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-affa78a1-a097-4683-8229-0e0668f91ddd tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:46.785066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-affa78a1-a097-4683-8229-0e0668f91ddd tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:46.785588 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-affa78a1-a097-4683-8229-0e0668f91ddd tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:46.786083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-affa78a1-a097-4683-8229-0e0668f91ddd tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:46.856180 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-affa78a1-a097-4683-8229-0e0668f91ddd tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] 10.222.0.16 "POST /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126/action" status: 202 len: 0 microversion: 2.1 time: 0.084279 Oct 05 03:10:46.857091 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3238/6463] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:10:46 2022] POST /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:10:46.864891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b3410547-816c-44b6-a336-f262f92d3aeb tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:46.865661 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b3410547-816c-44b6-a336-f262f92d3aeb tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] [instance: 65e616c6-e587-40a3-a7e1-c21d7214a126] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:46.872771 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3410547-816c-44b6-a336-f262f92d3aeb tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:46.873539 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3410547-816c-44b6-a336-f262f92d3aeb tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:46.874146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3410547-816c-44b6-a336-f262f92d3aeb tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:46.875051 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3410547-816c-44b6-a336-f262f92d3aeb tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:46.875617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3410547-816c-44b6-a336-f262f92d3aeb tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:46.876374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b3410547-816c-44b6-a336-f262f92d3aeb tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:46.985175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4839a9ca-15b4-4090-bb8f-239045c7e7cb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:46.986144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4839a9ca-15b4-4090-bb8f-239045c7e7cb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:46.993838 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4839a9ca-15b4-4090-bb8f-239045c7e7cb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:46.994327 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4839a9ca-15b4-4090-bb8f-239045c7e7cb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:46.994945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4839a9ca-15b4-4090-bb8f-239045c7e7cb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:46.996491 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4839a9ca-15b4-4090-bb8f-239045c7e7cb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:46.997383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4839a9ca-15b4-4090-bb8f-239045c7e7cb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:46.997828 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4839a9ca-15b4-4090-bb8f-239045c7e7cb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:47.013712 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-4839a9ca-15b4-4090-bb8f-239045c7e7cb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] HTTP exception thrown: Instance 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 could not be found. Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4839a9ca-15b4-4090-bb8f-239045c7e7cb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Request method failure captured: Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 HTTP/1.1 Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPQLbaCJcQoINHOY2GKTbE6oK5DZKXlvS9cTUJZgUsjhzJ11GCBMxKRG2ZW2HydnkNGtZ8u98fUAxnzQFqGG-K-d7yptqwDawf-PQoraVusgo1XYypQQkhEqqbJdJFh02G9QsSpvTDhdtNr6cnzMOTz-5c9_S6hWETgH6FWjUbmuXPI Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 7b99b6a5b1764f64a68793f37d4f9b96 Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 7b99b6a5b1764f64a68793f37d4f9b96 Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-AttachVolumeNegativeTest-2082311660-project Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 881baf1ede7e4fb5acf65268a81241ad Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-AttachVolumeNegativeTest-2082311660-project Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 could not be found. Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9'} Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 could not be found. Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:10:47.015408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:10:47.019811 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 could not be found. Oct 05 03:10:47.019811 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:10:47.019811 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:10:47.019811 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:10:47.019811 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:10:47.019811 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:10:47.019811 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:10:47.019811 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:10:47.019811 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:10:47.019811 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 could not be found. Oct 05 03:10:47.019811 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:10:47.019811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4839a9ca-15b4-4090-bb8f-239045c7e7cb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Returning 404 to user: Instance 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:10:47.019811 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4839a9ca-15b4-4090-bb8f-239045c7e7cb tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9" status: 404 len: 111 microversion: 2.1 time: 0.038038 Oct 05 03:10:47.019811 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3239/6464] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:10:46 2022] DELETE /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:10:47.025912 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2092ce92-0dac-46fb-ba0d-8630078d3310 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:47.026643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2092ce92-0dac-46fb-ba0d-8630078d3310 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] [instance: 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:47.033236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2092ce92-0dac-46fb-ba0d-8630078d3310 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:47.033835 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2092ce92-0dac-46fb-ba0d-8630078d3310 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:47.034344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2092ce92-0dac-46fb-ba0d-8630078d3310 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:47.035114 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2092ce92-0dac-46fb-ba0d-8630078d3310 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:47.035644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2092ce92-0dac-46fb-ba0d-8630078d3310 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:47.036143 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2092ce92-0dac-46fb-ba0d-8630078d3310 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:47.051674 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-2092ce92-0dac-46fb-ba0d-8630078d3310 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] HTTP exception thrown: Instance 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 could not be found. Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2092ce92-0dac-46fb-ba0d-8630078d3310 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Request method failure captured: Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 HTTP/1.1 Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPQLbaCJcQoINHOY2GKTbE6oK5DZKXlvS9cTUJZgUsjhzJ11GCBMxKRG2ZW2HydnkNGtZ8u98fUAxnzQFqGG-K-d7yptqwDawf-PQoraVusgo1XYypQQkhEqqbJdJFh02G9QsSpvTDhdtNr6cnzMOTz-5c9_S6hWETgH6FWjUbmuXPI Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 7b99b6a5b1764f64a68793f37d4f9b96 Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b99b6a5b1764f64a68793f37d4f9b96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 7b99b6a5b1764f64a68793f37d4f9b96 Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2082311660 Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-AttachVolumeNegativeTest-2082311660-project Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 881baf1ede7e4fb5acf65268a81241ad Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-AttachVolumeNegativeTest-2082311660-project Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 could not be found. Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9'} Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 could not be found. Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 could not be found. Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:10:47.053352 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:10:47.059185 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:10:47.059185 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:10:47.059185 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:10:47.059185 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:10:47.059185 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:10:47.059185 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 could not be found. Oct 05 03:10:47.059185 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:10:47.059185 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2092ce92-0dac-46fb-ba0d-8630078d3310 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] Returning 404 to user: Instance 4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:10:47.059185 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2092ce92-0dac-46fb-ba0d-8630078d3310 tempest-AttachVolumeNegativeTest-2082311660 tempest-AttachVolumeNegativeTest-2082311660-project] 10.222.0.16 "GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9" status: 404 len: 111 microversion: 2.1 time: 0.034138 Oct 05 03:10:47.059185 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3240/6465] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:47 2022] GET /compute/v2.1/servers/4a1f1f20-7b8c-4a27-9d1b-2dfbd46869d9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:10:47.462773 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b3410547-816c-44b6-a336-f262f92d3aeb tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2916e2193240d691e61a20e9f1b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7870e0fcc68d4c72b38433b9842776e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:47.472225 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b3410547-816c-44b6-a336-f262f92d3aeb tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] 10.222.0.16 "GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126" status: 200 len: 1498 microversion: 2.1 time: 0.611078 Oct 05 03:10:47.488323 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3226/6466] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:46 2022] GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126 => generated 1498 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:48.496081 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6d15aa4d-8b2c-41b5-bb45-c9bcd9aead32 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:48.496705 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6d15aa4d-8b2c-41b5-bb45-c9bcd9aead32 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] [instance: 65e616c6-e587-40a3-a7e1-c21d7214a126] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:48.508018 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6d15aa4d-8b2c-41b5-bb45-c9bcd9aead32 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:48.508329 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6d15aa4d-8b2c-41b5-bb45-c9bcd9aead32 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:48.509111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6d15aa4d-8b2c-41b5-bb45-c9bcd9aead32 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:48.510095 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6d15aa4d-8b2c-41b5-bb45-c9bcd9aead32 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:48.511227 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6d15aa4d-8b2c-41b5-bb45-c9bcd9aead32 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:48.511737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6d15aa4d-8b2c-41b5-bb45-c9bcd9aead32 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:48.663460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6d15aa4d-8b2c-41b5-bb45-c9bcd9aead32 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2916e2193240d691e61a20e9f1b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7870e0fcc68d4c72b38433b9842776e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:48.674894 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6d15aa4d-8b2c-41b5-bb45-c9bcd9aead32 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] 10.222.0.16 "GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126" status: 200 len: 1498 microversion: 2.1 time: 0.182915 Oct 05 03:10:48.675750 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3241/6467] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:48 2022] GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126 => generated 1498 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:49.699659 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-73628566-36e9-4d1e-aff8-d84a5589a485 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:49.700266 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-73628566-36e9-4d1e-aff8-d84a5589a485 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] [instance: 65e616c6-e587-40a3-a7e1-c21d7214a126] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:49.708328 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-73628566-36e9-4d1e-aff8-d84a5589a485 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:49.708837 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-73628566-36e9-4d1e-aff8-d84a5589a485 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:49.709275 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-73628566-36e9-4d1e-aff8-d84a5589a485 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:49.709972 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-73628566-36e9-4d1e-aff8-d84a5589a485 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:49.710421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-73628566-36e9-4d1e-aff8-d84a5589a485 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:49.710839 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-73628566-36e9-4d1e-aff8-d84a5589a485 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:49.939157 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-73628566-36e9-4d1e-aff8-d84a5589a485 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2916e2193240d691e61a20e9f1b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7870e0fcc68d4c72b38433b9842776e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:49.950669 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-73628566-36e9-4d1e-aff8-d84a5589a485 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] 10.222.0.16 "GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126" status: 200 len: 1501 microversion: 2.1 time: 0.255548 Oct 05 03:10:49.961587 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3227/6468] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:49 2022] GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126 => generated 1501 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:49.975442 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a9f3e971-4f41-4592-8fd7-6ec78e2841b4 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:10:49.976723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a9f3e971-4f41-4592-8fd7-6ec78e2841b4 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] [instance: 65e616c6-e587-40a3-a7e1-c21d7214a126] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:49.985398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9f3e971-4f41-4592-8fd7-6ec78e2841b4 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:49.986266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9f3e971-4f41-4592-8fd7-6ec78e2841b4 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:49.986960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9f3e971-4f41-4592-8fd7-6ec78e2841b4 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:49.987920 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9f3e971-4f41-4592-8fd7-6ec78e2841b4 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:49.988613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9f3e971-4f41-4592-8fd7-6ec78e2841b4 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:49.991304 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9f3e971-4f41-4592-8fd7-6ec78e2841b4 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:50.022574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-a9f3e971-4f41-4592-8fd7-6ec78e2841b4 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lazy-loading 'flavor' on Instance uuid 65e616c6-e587-40a3-a7e1-c21d7214a126 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:10:50.109027 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a9f3e971-4f41-4592-8fd7-6ec78e2841b4 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] 10.222.0.16 "POST /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126/action" status: 202 len: 0 microversion: 2.1 time: 0.138087 Oct 05 03:10:50.109682 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3242/6469] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:10:49 2022] POST /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:10:50.118370 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5315028a-7611-4a6a-ba9d-3fa7805b5acc tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:50.118997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5315028a-7611-4a6a-ba9d-3fa7805b5acc tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] [instance: 65e616c6-e587-40a3-a7e1-c21d7214a126] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:50.125629 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5315028a-7611-4a6a-ba9d-3fa7805b5acc tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:50.126332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5315028a-7611-4a6a-ba9d-3fa7805b5acc tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:50.126954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5315028a-7611-4a6a-ba9d-3fa7805b5acc tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:50.127658 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5315028a-7611-4a6a-ba9d-3fa7805b5acc tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:50.128116 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5315028a-7611-4a6a-ba9d-3fa7805b5acc tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:50.128540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5315028a-7611-4a6a-ba9d-3fa7805b5acc tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:50.357785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f9760c4a-1b63-4fd1-bf55-d3136f8ad74a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:10:50.360847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f9760c4a-1b63-4fd1-bf55-d3136f8ad74a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:50.367623 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9760c4a-1b63-4fd1-bf55-d3136f8ad74a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:50.368185 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9760c4a-1b63-4fd1-bf55-d3136f8ad74a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:50.368836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9760c4a-1b63-4fd1-bf55-d3136f8ad74a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:50.371210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9760c4a-1b63-4fd1-bf55-d3136f8ad74a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:50.371851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9760c4a-1b63-4fd1-bf55-d3136f8ad74a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:50.373689 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9760c4a-1b63-4fd1-bf55-d3136f8ad74a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:50.387666 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5315028a-7611-4a6a-ba9d-3fa7805b5acc tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2916e2193240d691e61a20e9f1b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7870e0fcc68d4c72b38433b9842776e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:50.396484 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5315028a-7611-4a6a-ba9d-3fa7805b5acc tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] 10.222.0.16 "GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126" status: 200 len: 1509 microversion: 2.1 time: 0.281991 Oct 05 03:10:50.397309 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3228/6470] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:50 2022] GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126 => generated 1509 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:10:50.456932 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f9760c4a-1b63-4fd1-bf55-d3136f8ad74a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "POST /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2/action" status: 200 len: 24563 microversion: 2.1 time: 0.105688 Oct 05 03:10:50.458080 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3243/6471] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:10:50 2022] POST /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2/action => generated 24563 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 03:10:51.422622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b78b8dc9-cbad-4d6d-9de3-418595b8bc2f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:51.423229 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b78b8dc9-cbad-4d6d-9de3-418595b8bc2f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] [instance: 65e616c6-e587-40a3-a7e1-c21d7214a126] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:51.429898 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b78b8dc9-cbad-4d6d-9de3-418595b8bc2f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:51.430583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b78b8dc9-cbad-4d6d-9de3-418595b8bc2f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:51.431014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b78b8dc9-cbad-4d6d-9de3-418595b8bc2f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:51.431692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b78b8dc9-cbad-4d6d-9de3-418595b8bc2f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:51.432867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b78b8dc9-cbad-4d6d-9de3-418595b8bc2f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:51.433585 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b78b8dc9-cbad-4d6d-9de3-418595b8bc2f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:51.571898 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b78b8dc9-cbad-4d6d-9de3-418595b8bc2f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2916e2193240d691e61a20e9f1b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7870e0fcc68d4c72b38433b9842776e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:51.580689 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b78b8dc9-cbad-4d6d-9de3-418595b8bc2f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] 10.222.0.16 "GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126" status: 200 len: 1492 microversion: 2.1 time: 0.161869 Oct 05 03:10:51.581430 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3229/6472] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:51 2022] GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126 => generated 1492 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:51.604674 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f3768a8b-353b-4183-b392-24a1aff8990e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:10:51.606106 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f3768a8b-353b-4183-b392-24a1aff8990e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] [instance: 65e616c6-e587-40a3-a7e1-c21d7214a126] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:51.614162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3768a8b-353b-4183-b392-24a1aff8990e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:51.614749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3768a8b-353b-4183-b392-24a1aff8990e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:51.615218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3768a8b-353b-4183-b392-24a1aff8990e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:51.615981 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3768a8b-353b-4183-b392-24a1aff8990e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:51.616528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3768a8b-353b-4183-b392-24a1aff8990e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:51.616977 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3768a8b-353b-4183-b392-24a1aff8990e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:51.634851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:51.695090 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f3768a8b-353b-4183-b392-24a1aff8990e tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] 10.222.0.16 "POST /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126/action" status: 202 len: 0 microversion: 2.1 time: 0.094581 Oct 05 03:10:51.696959 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3244/6473] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:10:51 2022] POST /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:10:51.711573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5d1f05f8-5543-404c-beb2-f390315e2f90 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:51.713576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5d1f05f8-5543-404c-beb2-f390315e2f90 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] [instance: 65e616c6-e587-40a3-a7e1-c21d7214a126] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:51.721201 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d1f05f8-5543-404c-beb2-f390315e2f90 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:51.721704 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d1f05f8-5543-404c-beb2-f390315e2f90 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:51.722143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d1f05f8-5543-404c-beb2-f390315e2f90 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:51.722947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d1f05f8-5543-404c-beb2-f390315e2f90 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:51.723408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d1f05f8-5543-404c-beb2-f390315e2f90 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:51.723834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d1f05f8-5543-404c-beb2-f390315e2f90 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:51.917334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5d1f05f8-5543-404c-beb2-f390315e2f90 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2916e2193240d691e61a20e9f1b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7870e0fcc68d4c72b38433b9842776e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:51.925014 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5d1f05f8-5543-404c-beb2-f390315e2f90 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] 10.222.0.16 "GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126" status: 200 len: 1498 microversion: 2.1 time: 0.217332 Oct 05 03:10:51.925594 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3230/6474] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:51 2022] GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126 => generated 1498 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:52.951105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ee5bea22-0b56-4161-8e04-d0fb5daf341f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:52.951955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ee5bea22-0b56-4161-8e04-d0fb5daf341f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] [instance: 65e616c6-e587-40a3-a7e1-c21d7214a126] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:52.958551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee5bea22-0b56-4161-8e04-d0fb5daf341f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:52.959034 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee5bea22-0b56-4161-8e04-d0fb5daf341f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:52.959663 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee5bea22-0b56-4161-8e04-d0fb5daf341f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:52.960366 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee5bea22-0b56-4161-8e04-d0fb5daf341f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:52.960823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee5bea22-0b56-4161-8e04-d0fb5daf341f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:52.961345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee5bea22-0b56-4161-8e04-d0fb5daf341f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:53.102528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ee5bea22-0b56-4161-8e04-d0fb5daf341f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2916e2193240d691e61a20e9f1b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7870e0fcc68d4c72b38433b9842776e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:53.113111 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ee5bea22-0b56-4161-8e04-d0fb5daf341f tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] 10.222.0.16 "GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126" status: 200 len: 1498 microversion: 2.1 time: 0.167902 Oct 05 03:10:53.113724 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3245/6475] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:52 2022] GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126 => generated 1498 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:53.486749 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5970418e-74eb-4d3d-b0f2-a4ca3635a8e1 tempest-VolumesTestJSON-1187645854 tempest-VolumesTestJSON-1187645854-project] Calling method '.version_select at 0x7fcce825c790>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:53.536175 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5970418e-74eb-4d3d-b0f2-a4ca3635a8e1 tempest-VolumesTestJSON-1187645854 tempest-VolumesTestJSON-1187645854-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/c3b12eb3-50c3-4bc2-aea9-7bb2a7dab82a" status: 200 len: 351 microversion: 2.1 time: 0.053249 Oct 05 03:10:53.536764 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3231/6476] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 03:10:53 2022] GET /compute/v2.1/os-volumes/c3b12eb3-50c3-4bc2-aea9-7bb2a7dab82a => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:10:54.138499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-75e163d8-1b56-4c59-acb2-d3507ff30cb6 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:54.139128 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-75e163d8-1b56-4c59-acb2-d3507ff30cb6 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] [instance: 65e616c6-e587-40a3-a7e1-c21d7214a126] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:54.146093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75e163d8-1b56-4c59-acb2-d3507ff30cb6 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:54.146587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75e163d8-1b56-4c59-acb2-d3507ff30cb6 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:54.147032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75e163d8-1b56-4c59-acb2-d3507ff30cb6 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:54.147734 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75e163d8-1b56-4c59-acb2-d3507ff30cb6 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:54.148195 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75e163d8-1b56-4c59-acb2-d3507ff30cb6 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:54.148625 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75e163d8-1b56-4c59-acb2-d3507ff30cb6 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:54.283373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-75e163d8-1b56-4c59-acb2-d3507ff30cb6 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2916e2193240d691e61a20e9f1b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7870e0fcc68d4c72b38433b9842776e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:54.291783 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-75e163d8-1b56-4c59-acb2-d3507ff30cb6 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] 10.222.0.16 "GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126" status: 200 len: 1501 microversion: 2.1 time: 0.157251 Oct 05 03:10:54.292354 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3246/6477] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:54 2022] GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126 => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:54.315030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-249d37cb-a32b-4f0d-8560-663f95d1301c tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:54.315528 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-249d37cb-a32b-4f0d-8560-663f95d1301c tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] [instance: 65e616c6-e587-40a3-a7e1-c21d7214a126] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:54.323659 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-249d37cb-a32b-4f0d-8560-663f95d1301c tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:54.324352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-249d37cb-a32b-4f0d-8560-663f95d1301c tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:54.325071 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-249d37cb-a32b-4f0d-8560-663f95d1301c tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:54.325768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-249d37cb-a32b-4f0d-8560-663f95d1301c tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:54.326225 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-249d37cb-a32b-4f0d-8560-663f95d1301c tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:54.326648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-249d37cb-a32b-4f0d-8560-663f95d1301c tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:54.351547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-249d37cb-a32b-4f0d-8560-663f95d1301c tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] [instance: 65e616c6-e587-40a3-a7e1-c21d7214a126] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:10:54.354863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:54.444155 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-249d37cb-a32b-4f0d-8560-663f95d1301c tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] 10.222.0.16 "DELETE /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126" status: 204 len: 0 microversion: 2.1 time: 0.132383 Oct 05 03:10:54.444703 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3232/6478] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:10:54 2022] DELETE /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:10:54.454495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b335bb15-713e-4255-8e2e-fb666289d130 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:54.455125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b335bb15-713e-4255-8e2e-fb666289d130 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] [instance: 65e616c6-e587-40a3-a7e1-c21d7214a126] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:54.461311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b335bb15-713e-4255-8e2e-fb666289d130 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:54.461803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b335bb15-713e-4255-8e2e-fb666289d130 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:54.462242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b335bb15-713e-4255-8e2e-fb666289d130 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:54.462954 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b335bb15-713e-4255-8e2e-fb666289d130 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:54.463549 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b335bb15-713e-4255-8e2e-fb666289d130 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:54.464074 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b335bb15-713e-4255-8e2e-fb666289d130 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:54.609417 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b335bb15-713e-4255-8e2e-fb666289d130 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2916e2193240d691e61a20e9f1b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7870e0fcc68d4c72b38433b9842776e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:54.617909 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b335bb15-713e-4255-8e2e-fb666289d130 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] 10.222.0.16 "GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126" status: 200 len: 1507 microversion: 2.1 time: 0.167332 Oct 05 03:10:54.618489 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3247/6479] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:54 2022] GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126 => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:10:54.878898 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ca0c2dc3-eddf-4db5-8014-864d278d0f7b tempest-VolumesTestJSON-1187645854 tempest-VolumesTestJSON-1187645854-project] Calling method '.version_select at 0x7fccdfd9a4c0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:54.926766 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ca0c2dc3-eddf-4db5-8014-864d278d0f7b tempest-VolumesTestJSON-1187645854 tempest-VolumesTestJSON-1187645854-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/a20a19aa-a147-42d1-a796-a75108682400" status: 200 len: 351 microversion: 2.1 time: 0.052052 Oct 05 03:10:54.927441 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3233/6480] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 03:10:54 2022] GET /compute/v2.1/os-volumes/a20a19aa-a147-42d1-a796-a75108682400 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:10:55.642122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-52e5b8d0-86cb-4890-94ec-846f98e9aa65 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:55.642671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-52e5b8d0-86cb-4890-94ec-846f98e9aa65 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] [instance: 65e616c6-e587-40a3-a7e1-c21d7214a126] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:55.649650 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52e5b8d0-86cb-4890-94ec-846f98e9aa65 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:55.650134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52e5b8d0-86cb-4890-94ec-846f98e9aa65 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:55.651088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52e5b8d0-86cb-4890-94ec-846f98e9aa65 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:55.651917 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52e5b8d0-86cb-4890-94ec-846f98e9aa65 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:55.652358 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52e5b8d0-86cb-4890-94ec-846f98e9aa65 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:55.652778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52e5b8d0-86cb-4890-94ec-846f98e9aa65 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:55.782789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-52e5b8d0-86cb-4890-94ec-846f98e9aa65 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2916e2193240d691e61a20e9f1b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7870e0fcc68d4c72b38433b9842776e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:55.791493 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-52e5b8d0-86cb-4890-94ec-846f98e9aa65 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] 10.222.0.16 "GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126" status: 200 len: 1507 microversion: 2.1 time: 0.153232 Oct 05 03:10:55.792165 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3248/6481] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:55 2022] GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:56.268387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5268d805-3136-4370-be1c-faa3b361014a tempest-VolumesTestJSON-1187645854 tempest-VolumesTestJSON-1187645854-project] Calling method '.version_select at 0x7fcce42d0790>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:56.317332 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5268d805-3136-4370-be1c-faa3b361014a tempest-VolumesTestJSON-1187645854 tempest-VolumesTestJSON-1187645854-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/01623cd7-8559-42c8-b18b-ca1f9a76737c" status: 200 len: 350 microversion: 2.1 time: 0.053623 Oct 05 03:10:56.317920 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3234/6482] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 03:10:56 2022] GET /compute/v2.1/os-volumes/01623cd7-8559-42c8-b18b-ca1f9a76737c => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:10:56.330856 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d7908ba6-f2ab-4cc8-b919-9cd98b2324e0 tempest-VolumesTestJSON-1187645854 tempest-VolumesTestJSON-1187645854-project] Calling method '.version_select at 0x7fccdeb54280>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:56.412812 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d7908ba6-f2ab-4cc8-b919-9cd98b2324e0 tempest-VolumesTestJSON-1187645854 tempest-VolumesTestJSON-1187645854-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.085663 Oct 05 03:10:56.413457 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3249/6483] 10.222.0.16 () {58 vars in 1134 bytes} [Wed Oct 5 03:10:56 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:56.427981 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-97ba0971-3a21-4484-9a66-8b7fca5af61b tempest-VolumesTestJSON-1187645854 tempest-VolumesTestJSON-1187645854-project] Calling method '.version_select at 0x7fcce42d0b80>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:56.514041 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-97ba0971-3a21-4484-9a66-8b7fca5af61b tempest-VolumesTestJSON-1187645854 tempest-VolumesTestJSON-1187645854-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.089834 Oct 05 03:10:56.514637 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3235/6484] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Oct 5 03:10:56 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:10:56.529268 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0d6558f0-59de-4560-8bf2-d6534601089c tempest-VolumesTestJSON-1187645854 tempest-VolumesTestJSON-1187645854-project] Calling method '.version_select at 0x7fccdfd15f70>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:56.616923 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0d6558f0-59de-4560-8bf2-d6534601089c tempest-VolumesTestJSON-1187645854 tempest-VolumesTestJSON-1187645854-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.092050 Oct 05 03:10:56.617513 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3250/6485] 10.222.0.16 () {58 vars in 1134 bytes} [Wed Oct 5 03:10:56 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:56.631381 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d6b1587e-05c7-4a5f-9603-bed159010f7c tempest-VolumesTestJSON-1187645854 tempest-VolumesTestJSON-1187645854-project] Calling method '.version_select at 0x7fccdfd9adc0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:56.716799 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d6b1587e-05c7-4a5f-9603-bed159010f7c tempest-VolumesTestJSON-1187645854 tempest-VolumesTestJSON-1187645854-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089357 Oct 05 03:10:56.717416 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3236/6486] 10.222.0.16 () {58 vars in 1167 bytes} [Wed Oct 5 03:10:56 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:10:56.735400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2b6b7987-0ad0-4e08-99f1-09f178df4db4 tempest-VolumesTestJSON-1187645854 tempest-VolumesTestJSON-1187645854-project] Calling method '.version_select at 0x7fccdeb47c10>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:56.815134 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f91ae056-6d62-4e37-8172-09398f4ed69a tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:56.815870 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f91ae056-6d62-4e37-8172-09398f4ed69a tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] [instance: 65e616c6-e587-40a3-a7e1-c21d7214a126] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:56.818556 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:56.824843 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2b6b7987-0ad0-4e08-99f1-09f178df4db4 tempest-VolumesTestJSON-1187645854 tempest-VolumesTestJSON-1187645854-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.097476 Oct 05 03:10:56.825588 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3251/6487] 10.222.0.16 () {58 vars in 1170 bytes} [Wed Oct 5 03:10:56 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:10:56.825746 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f91ae056-6d62-4e37-8172-09398f4ed69a tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:56.826207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f91ae056-6d62-4e37-8172-09398f4ed69a tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:56.826639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f91ae056-6d62-4e37-8172-09398f4ed69a tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:56.827536 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f91ae056-6d62-4e37-8172-09398f4ed69a tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:56.828002 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f91ae056-6d62-4e37-8172-09398f4ed69a tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:56.828426 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f91ae056-6d62-4e37-8172-09398f4ed69a tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:56.842090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0ed73e4c-6d5e-41e6-8349-3f9984dff6ba tempest-VolumesTestJSON-1187645854 tempest-VolumesTestJSON-1187645854-project] Calling method '.version_select at 0x7fccdeb0c550>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:56.929450 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0ed73e4c-6d5e-41e6-8349-3f9984dff6ba tempest-VolumesTestJSON-1187645854 tempest-VolumesTestJSON-1187645854-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.093313 Oct 05 03:10:56.930020 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3252/6488] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 5 03:10:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:10:56.944988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c37aa6ee-69bc-4232-b248-84016ce7caf7 tempest-VolumesTestJSON-1187645854 tempest-VolumesTestJSON-1187645854-project] Calling method '.version_select at 0x7fccdeb94f70>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:57.030600 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c37aa6ee-69bc-4232-b248-84016ce7caf7 tempest-VolumesTestJSON-1187645854 tempest-VolumesTestJSON-1187645854-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089610 Oct 05 03:10:57.031344 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3253/6489] 10.222.0.16 () {58 vars in 1188 bytes} [Wed Oct 5 03:10:56 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:10:57.045717 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1bacaaee-a3f5-48df-b1fd-be57f4097252 tempest-VolumesTestJSON-1187645854 tempest-VolumesTestJSON-1187645854-project] Calling method '.version_select at 0x7fccdebea310>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:57.117310 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f91ae056-6d62-4e37-8172-09398f4ed69a tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2916e2193240d691e61a20e9f1b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7870e0fcc68d4c72b38433b9842776e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:10:57.129043 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f91ae056-6d62-4e37-8172-09398f4ed69a tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] 10.222.0.16 "GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126" status: 200 len: 1507 microversion: 2.1 time: 0.317607 Oct 05 03:10:57.129638 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3237/6490] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:56 2022] GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126 => generated 1507 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:57.135987 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-fb58ef67-c2a4-44ba-8ed6-59e74bce2314 req-74da5a64-1c2b-4609-a337-ecebad5bf26a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65e616c6-e587-40a3-a7e1-c21d7214a126", "name": "network-vif-deleted", "tag": "5b720215-0092-408b-b90f-3ced670c4c13"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:10:57.145953 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-fb58ef67-c2a4-44ba-8ed6-59e74bce2314 req-74da5a64-1c2b-4609-a337-ecebad5bf26a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:57.146511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-fb58ef67-c2a4-44ba-8ed6-59e74bce2314 req-74da5a64-1c2b-4609-a337-ecebad5bf26a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:57.146943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-fb58ef67-c2a4-44ba-8ed6-59e74bce2314 req-74da5a64-1c2b-4609-a337-ecebad5bf26a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:57.147694 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1bacaaee-a3f5-48df-b1fd-be57f4097252 tempest-VolumesTestJSON-1187645854 tempest-VolumesTestJSON-1187645854-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.106807 Oct 05 03:10:57.157824 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3254/6491] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 5 03:10:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:10:57.160343 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-fb58ef67-c2a4-44ba-8ed6-59e74bce2314 req-74da5a64-1c2b-4609-a337-ecebad5bf26a service nova] Creating event network-vif-deleted:5b720215-0092-408b-b90f-3ced670c4c13 for instance 65e616c6-e587-40a3-a7e1-c21d7214a126 on n-h1-858272-3 Oct 05 03:10:57.165299 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-fb58ef67-c2a4-44ba-8ed6-59e74bce2314 req-74da5a64-1c2b-4609-a337-ecebad5bf26a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034286 Oct 05 03:10:57.166631 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3238/6492] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:10:58.166582 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-294acc26-1ff5-4633-8b54-4125b69a9c12 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:10:58.167142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-294acc26-1ff5-4633-8b54-4125b69a9c12 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] [instance: 65e616c6-e587-40a3-a7e1-c21d7214a126] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:10:58.169108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:58.175106 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-294acc26-1ff5-4633-8b54-4125b69a9c12 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:58.175673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-294acc26-1ff5-4633-8b54-4125b69a9c12 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:58.176110 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-294acc26-1ff5-4633-8b54-4125b69a9c12 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:58.176803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-294acc26-1ff5-4633-8b54-4125b69a9c12 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:10:58.177287 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-294acc26-1ff5-4633-8b54-4125b69a9c12 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:10:58.177711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-294acc26-1ff5-4633-8b54-4125b69a9c12 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:10:58.193533 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-294acc26-1ff5-4633-8b54-4125b69a9c12 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] HTTP exception thrown: Instance 65e616c6-e587-40a3-a7e1-c21d7214a126 could not be found. Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-294acc26-1ff5-4633-8b54-4125b69a9c12 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Request method failure captured: Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126 HTTP/1.1 Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPWo8QFuINsMP2c5phuBiThvU40Vhi8lOf6yLi1RohEuSlMVb1WNxXUgelu2xIXvN_3oWTFUSAP2E-P4VTJFZ-V3Q0rI7dqaKSoeqslvqhBdY280EL1ZxFYttDlm54VEapYMHCOjaN9hPPlPrZbKaW_64co7lGeNUA_xwd1IpHNlhoQ Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 7870e0fcc68d4c72b38433b9842776e9 Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TestServerAdvancedOps-1919023608 Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7870e0fcc68d4c72b38433b9842776e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7870e0fcc68d4c72b38433b9842776e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7870e0fcc68d4c72b38433b9842776e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7870e0fcc68d4c72b38433b9842776e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TestServerAdvancedOps-1919023608 Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 7870e0fcc68d4c72b38433b9842776e9 Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TestServerAdvancedOps-1919023608 Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TestServerAdvancedOps-1919023608-project Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: df2916e2193240d691e61a20e9f1b205 Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TestServerAdvancedOps-1919023608-project Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 65e616c6-e587-40a3-a7e1-c21d7214a126 could not be found. Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '65e616c6-e587-40a3-a7e1-c21d7214a126'} Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65e616c6-e587-40a3-a7e1-c21d7214a126 could not be found. Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65e616c6-e587-40a3-a7e1-c21d7214a126 could not be found. Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:10:58.195337 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:10:58.207186 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:10:58.207186 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:10:58.207186 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:10:58.207186 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:10:58.207186 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:10:58.207186 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65e616c6-e587-40a3-a7e1-c21d7214a126 could not be found. Oct 05 03:10:58.207186 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:10:58.207186 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-294acc26-1ff5-4633-8b54-4125b69a9c12 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] Returning 404 to user: Instance 65e616c6-e587-40a3-a7e1-c21d7214a126 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:10:58.207186 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-294acc26-1ff5-4633-8b54-4125b69a9c12 tempest-TestServerAdvancedOps-1919023608 tempest-TestServerAdvancedOps-1919023608-project] 10.222.0.16 "GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126" status: 404 len: 111 microversion: 2.1 time: 0.035592 Oct 05 03:10:58.207186 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3255/6493] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:10:58 2022] GET /compute/v2.1/servers/65e616c6-e587-40a3-a7e1-c21d7214a126 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:11:05.241908 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-05fa9f54-0673-4344-a8c2-749f0583b15e tempest-VolumesNegativeTest-932505285 tempest-VolumesNegativeTest-932505285-project] Action: 'create', calling method: .version_select at 0x7fcce8186550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1849634682", "metadata": {"Type": "work"}}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-05fa9f54-0673-4344-a8c2-749f0583b15e tempest-VolumesNegativeTest-932505285 tempest-VolumesNegativeTest-932505285-project] Request method failure captured: Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 122 Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPXJYmIosKrZVzYoNWJLIHXee9tWOultp1xKBhbtnYMwYtWZdcejUHUbMDDNYjt_yqjAw_SkcjGjKpiXsd-gLs5Do7WEFXX0x2nSngoxMBL_dsm62_o7RxTTZLm-bhJxybB2bRGl68h8bvIzPmgx-MCJdsOFh8zscg3Z3h6oAoRq5-o Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: eed7dc8e2aa2451b832b14079fa5b1fe Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-VolumesNegativeTest-932505285 Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eed7dc8e2aa2451b832b14079fa5b1fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eed7dc8e2aa2451b832b14079fa5b1fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eed7dc8e2aa2451b832b14079fa5b1fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eed7dc8e2aa2451b832b14079fa5b1fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-VolumesNegativeTest-932505285 Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: eed7dc8e2aa2451b832b14079fa5b1fe Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-VolumesNegativeTest-932505285 Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-VolumesNegativeTest-932505285-project Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 207a74cf9d5b4aaca82071817589c517 Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-VolumesNegativeTest-932505285-project Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1849634682", "metadata": {"Type": "work"}}} Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1849634682', 'metadata': {'Type': 'work'}}}} Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise error Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi '#$%' Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 03:11:05.245662 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 03:11:05.251104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 05 03:11:05.251104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.251104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:11:05.251104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.251104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:11:05.251104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:11:05.251104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:11:05.251104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 03:11:05.251104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 03:11:05.251104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 05 03:11:05.251104 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.251104 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-05fa9f54-0673-4344-a8c2-749f0583b15e tempest-VolumesNegativeTest-932505285 tempest-VolumesNegativeTest-932505285-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:11:05.251104 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-05fa9f54-0673-4344-a8c2-749f0583b15e tempest-VolumesNegativeTest-932505285 tempest-VolumesNegativeTest-932505285-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.126091 Oct 05 03:11:05.251104 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3239/6494] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Oct 5 03:11:05 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 03:11:05.257263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f2c41469-b0bb-4d33-8c8b-ab0c9b62873c tempest-VolumesNegativeTest-932505285 tempest-VolumesNegativeTest-932505285-project] Action: 'create', calling method: .version_select at 0x7fccdefe4310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-687397601", "metadata": {"Type": "work"}}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f2c41469-b0bb-4d33-8c8b-ab0c9b62873c tempest-VolumesNegativeTest-932505285 tempest-VolumesNegativeTest-932505285-project] Request method failure captured: Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 119 Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPXJYmIosKrZVzYoNWJLIHXee9tWOultp1xKBhbtnYMwYtWZdcejUHUbMDDNYjt_yqjAw_SkcjGjKpiXsd-gLs5Do7WEFXX0x2nSngoxMBL_dsm62_o7RxTTZLm-bhJxybB2bRGl68h8bvIzPmgx-MCJdsOFh8zscg3Z3h6oAoRq5-o Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: eed7dc8e2aa2451b832b14079fa5b1fe Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-VolumesNegativeTest-932505285 Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eed7dc8e2aa2451b832b14079fa5b1fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eed7dc8e2aa2451b832b14079fa5b1fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eed7dc8e2aa2451b832b14079fa5b1fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eed7dc8e2aa2451b832b14079fa5b1fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-VolumesNegativeTest-932505285 Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: eed7dc8e2aa2451b832b14079fa5b1fe Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-VolumesNegativeTest-932505285 Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-VolumesNegativeTest-932505285-project Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 207a74cf9d5b4aaca82071817589c517 Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-VolumesNegativeTest-932505285-project Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-687397601", "metadata": {"Type": "work"}}} Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-687397601', 'metadata': {'Type': 'work'}}}} Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise error Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi '0' Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 03:11:05.261604 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 03:11:05.267053 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 05 03:11:05.267053 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.267053 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:11:05.267053 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.267053 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:11:05.267053 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:11:05.267053 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:11:05.267053 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 03:11:05.267053 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 03:11:05.267053 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 05 03:11:05.267053 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.267053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f2c41469-b0bb-4d33-8c8b-ab0c9b62873c tempest-VolumesNegativeTest-932505285 tempest-VolumesNegativeTest-932505285-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:11:05.267053 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f2c41469-b0bb-4d33-8c8b-ab0c9b62873c tempest-VolumesNegativeTest-932505285 tempest-VolumesNegativeTest-932505285-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009974 Oct 05 03:11:05.267053 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3256/6495] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Oct 5 03:11:05 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 05 03:11:05.272581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-830ef536-97c1-41a8-a167-3a4a787a7c6c tempest-VolumesNegativeTest-932505285 tempest-VolumesNegativeTest-932505285-project] Action: 'create', calling method: .version_select at 0x7fcce81e19d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1344127779", "metadata": {"Type": "work"}}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-830ef536-97c1-41a8-a167-3a4a787a7c6c tempest-VolumesNegativeTest-932505285 tempest-VolumesNegativeTest-932505285-project] Request method failure captured: Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 119 Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPXJYmIosKrZVzYoNWJLIHXee9tWOultp1xKBhbtnYMwYtWZdcejUHUbMDDNYjt_yqjAw_SkcjGjKpiXsd-gLs5Do7WEFXX0x2nSngoxMBL_dsm62_o7RxTTZLm-bhJxybB2bRGl68h8bvIzPmgx-MCJdsOFh8zscg3Z3h6oAoRq5-o Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: eed7dc8e2aa2451b832b14079fa5b1fe Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-VolumesNegativeTest-932505285 Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eed7dc8e2aa2451b832b14079fa5b1fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eed7dc8e2aa2451b832b14079fa5b1fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eed7dc8e2aa2451b832b14079fa5b1fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eed7dc8e2aa2451b832b14079fa5b1fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-VolumesNegativeTest-932505285 Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: eed7dc8e2aa2451b832b14079fa5b1fe Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-VolumesNegativeTest-932505285 Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-VolumesNegativeTest-932505285-project Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 207a74cf9d5b4aaca82071817589c517 Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-VolumesNegativeTest-932505285-project Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1344127779", "metadata": {"Type": "work"}}} Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1344127779', 'metadata': {'Type': 'work'}}}} Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise error Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi '' Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 03:11:05.276811 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 03:11:05.282115 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 05 03:11:05.282115 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.282115 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:11:05.282115 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.282115 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:11:05.282115 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:11:05.282115 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:11:05.282115 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 03:11:05.282115 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 03:11:05.282115 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 05 03:11:05.282115 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.282115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-830ef536-97c1-41a8-a167-3a4a787a7c6c tempest-VolumesNegativeTest-932505285 tempest-VolumesNegativeTest-932505285-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:11:05.282115 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-830ef536-97c1-41a8-a167-3a4a787a7c6c tempest-VolumesNegativeTest-932505285 tempest-VolumesNegativeTest-932505285-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009387 Oct 05 03:11:05.282115 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3240/6496] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Oct 5 03:11:05 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 03:11:05.288792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b7352bcb-cb4c-4a0a-a717-66cd23866f8c tempest-VolumesNegativeTest-932505285 tempest-VolumesNegativeTest-932505285-project] Calling method '.version_select at 0x7fccdfc22310>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:11:05.320585 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-b7352bcb-cb4c-4a0a-a717-66cd23866f8c tempest-VolumesNegativeTest-932505285 tempest-VolumesNegativeTest-932505285-project] HTTP exception thrown: Volume tempest-invalid-1042134486 could not be found. Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b7352bcb-cb4c-4a0a-a717-66cd23866f8c tempest-VolumesNegativeTest-932505285 tempest-VolumesNegativeTest-932505285-project] Request method failure captured: Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1042134486 HTTP/1.1 Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPXJYmIosKrZVzYoNWJLIHXee9tWOultp1xKBhbtnYMwYtWZdcejUHUbMDDNYjt_yqjAw_SkcjGjKpiXsd-gLs5Do7WEFXX0x2nSngoxMBL_dsm62_o7RxTTZLm-bhJxybB2bRGl68h8bvIzPmgx-MCJdsOFh8zscg3Z3h6oAoRq5-o Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: eed7dc8e2aa2451b832b14079fa5b1fe Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-VolumesNegativeTest-932505285 Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eed7dc8e2aa2451b832b14079fa5b1fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eed7dc8e2aa2451b832b14079fa5b1fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eed7dc8e2aa2451b832b14079fa5b1fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eed7dc8e2aa2451b832b14079fa5b1fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-VolumesNegativeTest-932505285 Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: eed7dc8e2aa2451b832b14079fa5b1fe Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-VolumesNegativeTest-932505285 Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-VolumesNegativeTest-932505285-project Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 207a74cf9d5b4aaca82071817589c517 Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-VolumesNegativeTest-932505285-project Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: exception: Volume tempest-invalid-1042134486 could not be found. Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'tempest-invalid-1042134486'} Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1042134486 could not be found. (HTTP 404) (Request-ID: req-bceead2f-c1d1-471b-adef-1cd6d1dc7fce) Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 03:11:05.322562 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1042134486 could not be found. Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1042134486 could not be found. Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1042134486 could not be found. Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b7352bcb-cb4c-4a0a-a717-66cd23866f8c tempest-VolumesNegativeTest-932505285 tempest-VolumesNegativeTest-932505285-project] Returning 404 to user: Volume tempest-invalid-1042134486 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b7352bcb-cb4c-4a0a-a717-66cd23866f8c tempest-VolumesNegativeTest-932505285 tempest-VolumesNegativeTest-932505285-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1042134486" status: 404 len: 99 microversion: 2.1 time: 0.040481 Oct 05 03:11:05.327671 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3257/6497] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 5 03:11:05 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1042134486 => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 03:11:05.334617 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-77dc4d30-47a0-4645-96ab-f5549de83994 tempest-VolumesNegativeTest-932505285 tempest-VolumesNegativeTest-932505285-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003845 Oct 05 03:11:05.335149 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3241/6498] 10.222.0.16 () {58 vars in 1140 bytes} [Wed Oct 5 03:11:05 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 05 03:11:05.343792 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-58665695-e6fa-4728-a768-d51ca5816afc tempest-VolumesNegativeTest-932505285 tempest-VolumesNegativeTest-932505285-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003669 Oct 05 03:11:05.344284 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3258/6499] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 5 03:11:05 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 05 03:11:05.352237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b0082cb6-f7c1-4af8-8ef3-aed8c8c24fc7 tempest-VolumesNegativeTest-932505285 tempest-VolumesNegativeTest-932505285-project] Calling method '.version_select at 0x7fcce81f4af0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:11:05.381866 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-b0082cb6-f7c1-4af8-8ef3-aed8c8c24fc7 tempest-VolumesNegativeTest-932505285 tempest-VolumesNegativeTest-932505285-project] HTTP exception thrown: Volume 61dbba8d-7a01-42e7-89c6-4c72bd5c5321 could not be found. Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b0082cb6-f7c1-4af8-8ef3-aed8c8c24fc7 tempest-VolumesNegativeTest-932505285 tempest-VolumesNegativeTest-932505285-project] Request method failure captured: Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/os-volumes/61dbba8d-7a01-42e7-89c6-4c72bd5c5321 HTTP/1.1 Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPXJYmIosKrZVzYoNWJLIHXee9tWOultp1xKBhbtnYMwYtWZdcejUHUbMDDNYjt_yqjAw_SkcjGjKpiXsd-gLs5Do7WEFXX0x2nSngoxMBL_dsm62_o7RxTTZLm-bhJxybB2bRGl68h8bvIzPmgx-MCJdsOFh8zscg3Z3h6oAoRq5-o Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: eed7dc8e2aa2451b832b14079fa5b1fe Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-VolumesNegativeTest-932505285 Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eed7dc8e2aa2451b832b14079fa5b1fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eed7dc8e2aa2451b832b14079fa5b1fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eed7dc8e2aa2451b832b14079fa5b1fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eed7dc8e2aa2451b832b14079fa5b1fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-VolumesNegativeTest-932505285 Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: eed7dc8e2aa2451b832b14079fa5b1fe Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-VolumesNegativeTest-932505285 Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-VolumesNegativeTest-932505285-project Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 207a74cf9d5b4aaca82071817589c517 Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-VolumesNegativeTest-932505285-project Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: method: Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: exception: Volume 61dbba8d-7a01-42e7-89c6-4c72bd5c5321 could not be found. Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '61dbba8d-7a01-42e7-89c6-4c72bd5c5321'} Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 61dbba8d-7a01-42e7-89c6-4c72bd5c5321 could not be found. (HTTP 404) (Request-ID: req-7109d394-9228-4928-b5fb-0d2093bcc260) Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 03:11:05.383863 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 61dbba8d-7a01-42e7-89c6-4c72bd5c5321 could not be found. Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 61dbba8d-7a01-42e7-89c6-4c72bd5c5321 could not be found. Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 61dbba8d-7a01-42e7-89c6-4c72bd5c5321 could not be found. Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b0082cb6-f7c1-4af8-8ef3-aed8c8c24fc7 tempest-VolumesNegativeTest-932505285 tempest-VolumesNegativeTest-932505285-project] Returning 404 to user: Volume 61dbba8d-7a01-42e7-89c6-4c72bd5c5321 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b0082cb6-f7c1-4af8-8ef3-aed8c8c24fc7 tempest-VolumesNegativeTest-932505285 tempest-VolumesNegativeTest-932505285-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/61dbba8d-7a01-42e7-89c6-4c72bd5c5321" status: 404 len: 109 microversion: 2.1 time: 0.036824 Oct 05 03:11:05.389376 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3242/6500] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 03:11:05 2022] DELETE /compute/v2.1/os-volumes/61dbba8d-7a01-42e7-89c6-4c72bd5c5321 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 03:11:05.395354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ced20604-3a3f-4e74-8f42-323652d13102 tempest-VolumesNegativeTest-932505285 tempest-VolumesNegativeTest-932505285-project] Calling method '.version_select at 0x7fccdec30160>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:11:05.423733 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-ced20604-3a3f-4e74-8f42-323652d13102 tempest-VolumesNegativeTest-932505285 tempest-VolumesNegativeTest-932505285-project] HTTP exception thrown: Volume 25f51fd9-3628-498e-9430-8f9e28605a42 could not be found. Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ced20604-3a3f-4e74-8f42-323652d13102 tempest-VolumesNegativeTest-932505285 tempest-VolumesNegativeTest-932505285-project] Request method failure captured: Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/os-volumes/25f51fd9-3628-498e-9430-8f9e28605a42 HTTP/1.1 Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPXJYmIosKrZVzYoNWJLIHXee9tWOultp1xKBhbtnYMwYtWZdcejUHUbMDDNYjt_yqjAw_SkcjGjKpiXsd-gLs5Do7WEFXX0x2nSngoxMBL_dsm62_o7RxTTZLm-bhJxybB2bRGl68h8bvIzPmgx-MCJdsOFh8zscg3Z3h6oAoRq5-o Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: eed7dc8e2aa2451b832b14079fa5b1fe Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-VolumesNegativeTest-932505285 Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eed7dc8e2aa2451b832b14079fa5b1fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eed7dc8e2aa2451b832b14079fa5b1fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eed7dc8e2aa2451b832b14079fa5b1fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eed7dc8e2aa2451b832b14079fa5b1fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-VolumesNegativeTest-932505285 Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: eed7dc8e2aa2451b832b14079fa5b1fe Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-VolumesNegativeTest-932505285 Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-VolumesNegativeTest-932505285-project Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 207a74cf9d5b4aaca82071817589c517 Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-VolumesNegativeTest-932505285-project Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: method: Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: exception: Volume 25f51fd9-3628-498e-9430-8f9e28605a42 could not be found. Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '25f51fd9-3628-498e-9430-8f9e28605a42'} Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 25f51fd9-3628-498e-9430-8f9e28605a42 could not be found. (HTTP 404) (Request-ID: req-883dc8d9-c628-43f0-b759-f775e84dbe39) Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 03:11:05.425697 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 25f51fd9-3628-498e-9430-8f9e28605a42 could not be found. Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 25f51fd9-3628-498e-9430-8f9e28605a42 could not be found. Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 25f51fd9-3628-498e-9430-8f9e28605a42 could not be found. Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ced20604-3a3f-4e74-8f42-323652d13102 tempest-VolumesNegativeTest-932505285 tempest-VolumesNegativeTest-932505285-project] Returning 404 to user: Volume 25f51fd9-3628-498e-9430-8f9e28605a42 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ced20604-3a3f-4e74-8f42-323652d13102 tempest-VolumesNegativeTest-932505285 tempest-VolumesNegativeTest-932505285-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/25f51fd9-3628-498e-9430-8f9e28605a42" status: 404 len: 109 microversion: 2.1 time: 0.035990 Oct 05 03:11:05.430872 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3259/6501] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 03:11:05 2022] GET /compute/v2.1/os-volumes/25f51fd9-3628-498e-9430-8f9e28605a42 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:11:29.566157 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:29.567414 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:29.572835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b198eda6-4e77-4477-a7ba-c8b904e8d56e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:11:29.573580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b198eda6-4e77-4477-a7ba-c8b904e8d56e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:11:29.581516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b198eda6-4e77-4477-a7ba-c8b904e8d56e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:29.582008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b198eda6-4e77-4477-a7ba-c8b904e8d56e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:29.582442 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b198eda6-4e77-4477-a7ba-c8b904e8d56e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:29.583133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b198eda6-4e77-4477-a7ba-c8b904e8d56e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:29.583583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b198eda6-4e77-4477-a7ba-c8b904e8d56e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:29.584004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b198eda6-4e77-4477-a7ba-c8b904e8d56e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:29.729427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b198eda6-4e77-4477-a7ba-c8b904e8d56e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:11:29.737819 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b198eda6-4e77-4477-a7ba-c8b904e8d56e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2" status: 200 len: 1681 microversion: 2.1 time: 0.173525 Oct 05 03:11:29.738385 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3243/6502] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:11:29 2022] GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2 => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:11:29.840952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:29.841912 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:29.846359 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-507e16be-8889-4768-8236-6931a662c965 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:11:29.848584 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-507e16be-8889-4768-8236-6931a662c965 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:11:29.856545 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-507e16be-8889-4768-8236-6931a662c965 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:29.857269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-507e16be-8889-4768-8236-6931a662c965 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:29.857709 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-507e16be-8889-4768-8236-6931a662c965 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:29.858404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-507e16be-8889-4768-8236-6931a662c965 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:29.858855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-507e16be-8889-4768-8236-6931a662c965 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:29.859279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-507e16be-8889-4768-8236-6931a662c965 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:29.929091 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-507e16be-8889-4768-8236-6931a662c965 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "POST /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2/action" status: 200 len: 32638 microversion: 2.1 time: 0.090868 Oct 05 03:11:29.929976 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3260/6503] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:11:29 2022] POST /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2/action => generated 32638 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 03:11:30.086696 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bde4c170-a119-4822-8856-6e3f9ee822bd tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:11:30.087296 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bde4c170-a119-4822-8856-6e3f9ee822bd tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:11:30.093686 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bde4c170-a119-4822-8856-6e3f9ee822bd tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:30.094176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bde4c170-a119-4822-8856-6e3f9ee822bd tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:30.094610 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bde4c170-a119-4822-8856-6e3f9ee822bd tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:30.095312 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bde4c170-a119-4822-8856-6e3f9ee822bd tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:30.095761 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bde4c170-a119-4822-8856-6e3f9ee822bd tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:30.096184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bde4c170-a119-4822-8856-6e3f9ee822bd tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:30.475067 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bde4c170-a119-4822-8856-6e3f9ee822bd tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2" status: 200 len: 1832 microversion: 2.1 time: 0.392573 Oct 05 03:11:30.475660 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3244/6504] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:11:30 2022] GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2 => generated 1832 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:11:30.505250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c3b30012-91e4-40a5-b363-ee09ae4f6230 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:11:30.509144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c3b30012-91e4-40a5-b363-ee09ae4f6230 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:11:30.516323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3b30012-91e4-40a5-b363-ee09ae4f6230 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:30.516819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3b30012-91e4-40a5-b363-ee09ae4f6230 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:30.517288 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3b30012-91e4-40a5-b363-ee09ae4f6230 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:30.517993 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3b30012-91e4-40a5-b363-ee09ae4f6230 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:30.518456 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3b30012-91e4-40a5-b363-ee09ae4f6230 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:30.518887 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c3b30012-91e4-40a5-b363-ee09ae4f6230 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:30.546416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-c3b30012-91e4-40a5-b363-ee09ae4f6230 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lazy-loading 'flavor' on Instance uuid 60fff54d-55b0-4e52-aae5-698c60e914c2 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:11:30.560013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c3b30012-91e4-40a5-b363-ee09ae4f6230 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Going to try to live migrate instance to another host {{(pid=122319) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 05 03:11:32.610989 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c3b30012-91e4-40a5-b363-ee09ae4f6230 tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2/action" status: 202 len: 0 microversion: 2.1 time: 2.110214 Oct 05 03:11:32.612025 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3261/6505] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:11:30 2022] POST /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2/action => generated 0 bytes in 2112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:11:32.621434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0be31603-6a2b-4d36-84d8-1c11b6c184b1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:11:32.622187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0be31603-6a2b-4d36-84d8-1c11b6c184b1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:11:32.630458 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0be31603-6a2b-4d36-84d8-1c11b6c184b1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:32.630948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0be31603-6a2b-4d36-84d8-1c11b6c184b1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:32.631386 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0be31603-6a2b-4d36-84d8-1c11b6c184b1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:32.632821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0be31603-6a2b-4d36-84d8-1c11b6c184b1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:32.633307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0be31603-6a2b-4d36-84d8-1c11b6c184b1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:32.633733 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0be31603-6a2b-4d36-84d8-1c11b6c184b1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:32.838434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0be31603-6a2b-4d36-84d8-1c11b6c184b1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:11:32.847374 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0be31603-6a2b-4d36-84d8-1c11b6c184b1 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2" status: 200 len: 1691 microversion: 2.1 time: 0.230616 Oct 05 03:11:32.847978 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3245/6506] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:11:32 2022] GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2 => generated 1691 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:11:33.872616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-106b4c52-4840-4e92-b81a-d51fe0638b54 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:11:33.873383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-106b4c52-4840-4e92-b81a-d51fe0638b54 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:11:33.881321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-106b4c52-4840-4e92-b81a-d51fe0638b54 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:33.882224 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-106b4c52-4840-4e92-b81a-d51fe0638b54 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:33.883407 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-106b4c52-4840-4e92-b81a-d51fe0638b54 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:33.884298 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-106b4c52-4840-4e92-b81a-d51fe0638b54 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:33.884950 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-106b4c52-4840-4e92-b81a-d51fe0638b54 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:33.885559 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-106b4c52-4840-4e92-b81a-d51fe0638b54 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:33.910135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-a8f64a3e-6ec9-483e-ae98-4dfbee8671d6 req-376ccdeb-6ac1-4b62-9ea0-094380031e76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60fff54d-55b0-4e52-aae5-698c60e914c2", "name": "network-vif-unplugged", "status": "completed", "tag": "839b84fa-e1fb-4925-85dd-0d318c9b6d36"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:11:33.927712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a8f64a3e-6ec9-483e-ae98-4dfbee8671d6 req-376ccdeb-6ac1-4b62-9ea0-094380031e76 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:33.927712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a8f64a3e-6ec9-483e-ae98-4dfbee8671d6 req-376ccdeb-6ac1-4b62-9ea0-094380031e76 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:33.927712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a8f64a3e-6ec9-483e-ae98-4dfbee8671d6 req-376ccdeb-6ac1-4b62-9ea0-094380031e76 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:33.951555 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-a8f64a3e-6ec9-483e-ae98-4dfbee8671d6 req-376ccdeb-6ac1-4b62-9ea0-094380031e76 service nova] Creating event network-vif-unplugged:839b84fa-e1fb-4925-85dd-0d318c9b6d36 for instance 60fff54d-55b0-4e52-aae5-698c60e914c2 on n-h2-858272-3 Oct 05 03:11:33.957905 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-a8f64a3e-6ec9-483e-ae98-4dfbee8671d6 req-376ccdeb-6ac1-4b62-9ea0-094380031e76 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051530 Oct 05 03:11:33.959076 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3246/6507] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:11:34.174852 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-106b4c52-4840-4e92-b81a-d51fe0638b54 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:11:34.184199 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-106b4c52-4840-4e92-b81a-d51fe0638b54 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2" status: 200 len: 1691 microversion: 2.1 time: 0.316155 Oct 05 03:11:34.185074 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3262/6508] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:11:33 2022] GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2 => generated 1691 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:11:35.209913 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d4f1b02c-930d-4357-a6cd-8f4d0f1fee15 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:11:35.210543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d4f1b02c-930d-4357-a6cd-8f4d0f1fee15 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:11:35.217084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4f1b02c-930d-4357-a6cd-8f4d0f1fee15 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:35.217649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4f1b02c-930d-4357-a6cd-8f4d0f1fee15 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:35.218183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4f1b02c-930d-4357-a6cd-8f4d0f1fee15 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:35.219031 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4f1b02c-930d-4357-a6cd-8f4d0f1fee15 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:35.219490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4f1b02c-930d-4357-a6cd-8f4d0f1fee15 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:35.220074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4f1b02c-930d-4357-a6cd-8f4d0f1fee15 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:35.373159 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d4f1b02c-930d-4357-a6cd-8f4d0f1fee15 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:11:35.382658 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d4f1b02c-930d-4357-a6cd-8f4d0f1fee15 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2" status: 200 len: 1691 microversion: 2.1 time: 0.177716 Oct 05 03:11:35.383262 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3247/6509] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:11:35 2022] GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2 => generated 1691 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:11:35.973295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-ba47d9c5-1345-4086-9bb9-670f5f194644 req-3967027c-4457-4344-8c12-64d7bd64878a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60fff54d-55b0-4e52-aae5-698c60e914c2", "tag": "839b84fa-e1fb-4925-85dd-0d318c9b6d36"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:11:35.986672 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ba47d9c5-1345-4086-9bb9-670f5f194644 req-3967027c-4457-4344-8c12-64d7bd64878a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:35.987149 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ba47d9c5-1345-4086-9bb9-670f5f194644 req-3967027c-4457-4344-8c12-64d7bd64878a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:35.987578 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ba47d9c5-1345-4086-9bb9-670f5f194644 req-3967027c-4457-4344-8c12-64d7bd64878a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:35.998571 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-ba47d9c5-1345-4086-9bb9-670f5f194644 req-3967027c-4457-4344-8c12-64d7bd64878a service nova] Creating event network-changed:839b84fa-e1fb-4925-85dd-0d318c9b6d36 for instance 60fff54d-55b0-4e52-aae5-698c60e914c2 on n-h2-858272-3 Oct 05 03:11:36.003487 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-ba47d9c5-1345-4086-9bb9-670f5f194644 req-3967027c-4457-4344-8c12-64d7bd64878a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034090 Oct 05 03:11:36.004537 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3263/6510] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:11:36.407298 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-69a40d61-938e-481a-bc94-0f67b871caeb tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:11:36.407858 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-69a40d61-938e-481a-bc94-0f67b871caeb tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:11:36.415396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69a40d61-938e-481a-bc94-0f67b871caeb tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:36.415887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69a40d61-938e-481a-bc94-0f67b871caeb tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:36.416323 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69a40d61-938e-481a-bc94-0f67b871caeb tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:36.417055 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69a40d61-938e-481a-bc94-0f67b871caeb tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:36.417514 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69a40d61-938e-481a-bc94-0f67b871caeb tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:36.417938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69a40d61-938e-481a-bc94-0f67b871caeb tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:36.562962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-69a40d61-938e-481a-bc94-0f67b871caeb tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:11:36.571221 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-69a40d61-938e-481a-bc94-0f67b871caeb tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2" status: 200 len: 1691 microversion: 2.1 time: 0.167909 Oct 05 03:11:36.571807 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3248/6511] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:11:36 2022] GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:11:37.596102 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-87eac2d0-ae0f-402b-96cc-54c4ab9d67cc tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:11:37.597116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-87eac2d0-ae0f-402b-96cc-54c4ab9d67cc tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:11:37.604099 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87eac2d0-ae0f-402b-96cc-54c4ab9d67cc tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:37.604663 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87eac2d0-ae0f-402b-96cc-54c4ab9d67cc tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:37.605403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87eac2d0-ae0f-402b-96cc-54c4ab9d67cc tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:37.606111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87eac2d0-ae0f-402b-96cc-54c4ab9d67cc tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:37.606575 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87eac2d0-ae0f-402b-96cc-54c4ab9d67cc tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:37.607034 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-87eac2d0-ae0f-402b-96cc-54c4ab9d67cc tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:37.752916 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-87eac2d0-ae0f-402b-96cc-54c4ab9d67cc tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:11:37.762381 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-87eac2d0-ae0f-402b-96cc-54c4ab9d67cc tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2" status: 200 len: 1691 microversion: 2.1 time: 0.171386 Oct 05 03:11:37.767845 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3264/6512] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:11:37 2022] GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2 => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:11:38.786262 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f1eadcfd-543c-458f-8e08-0cef5175ae00 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:11:38.786873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f1eadcfd-543c-458f-8e08-0cef5175ae00 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:11:38.794319 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f1eadcfd-543c-458f-8e08-0cef5175ae00 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:38.794803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f1eadcfd-543c-458f-8e08-0cef5175ae00 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:38.795239 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f1eadcfd-543c-458f-8e08-0cef5175ae00 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:38.795955 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f1eadcfd-543c-458f-8e08-0cef5175ae00 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:38.796406 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f1eadcfd-543c-458f-8e08-0cef5175ae00 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:38.796830 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f1eadcfd-543c-458f-8e08-0cef5175ae00 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:38.942436 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f1eadcfd-543c-458f-8e08-0cef5175ae00 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:11:38.950750 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f1eadcfd-543c-458f-8e08-0cef5175ae00 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2" status: 200 len: 1691 microversion: 2.1 time: 0.168396 Oct 05 03:11:38.951333 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3249/6513] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:11:38 2022] GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2 => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:11:39.975311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-df280f22-48cb-4f76-8a6b-2d47c090880e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:11:39.976010 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-df280f22-48cb-4f76-8a6b-2d47c090880e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:11:39.982837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-df280f22-48cb-4f76-8a6b-2d47c090880e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:39.983335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-df280f22-48cb-4f76-8a6b-2d47c090880e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:39.983780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-df280f22-48cb-4f76-8a6b-2d47c090880e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:39.984494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-df280f22-48cb-4f76-8a6b-2d47c090880e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:39.984965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-df280f22-48cb-4f76-8a6b-2d47c090880e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:39.985395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-df280f22-48cb-4f76-8a6b-2d47c090880e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:40.143852 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-df280f22-48cb-4f76-8a6b-2d47c090880e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:11:40.154107 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-df280f22-48cb-4f76-8a6b-2d47c090880e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2" status: 200 len: 1691 microversion: 2.1 time: 0.183211 Oct 05 03:11:40.154606 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3265/6514] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:11:39 2022] GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2 => generated 1691 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:11:41.180370 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5bba981c-238e-4f4a-bfdf-b5a4a366ff3d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:11:41.181073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5bba981c-238e-4f4a-bfdf-b5a4a366ff3d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:11:41.188801 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5bba981c-238e-4f4a-bfdf-b5a4a366ff3d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:41.189336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5bba981c-238e-4f4a-bfdf-b5a4a366ff3d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:41.190058 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5bba981c-238e-4f4a-bfdf-b5a4a366ff3d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:41.190828 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5bba981c-238e-4f4a-bfdf-b5a4a366ff3d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:41.191292 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5bba981c-238e-4f4a-bfdf-b5a4a366ff3d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:41.191846 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5bba981c-238e-4f4a-bfdf-b5a4a366ff3d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:41.341708 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5bba981c-238e-4f4a-bfdf-b5a4a366ff3d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:11:41.350475 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5bba981c-238e-4f4a-bfdf-b5a4a366ff3d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2" status: 200 len: 1691 microversion: 2.1 time: 0.175440 Oct 05 03:11:41.351064 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3250/6515] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:11:41 2022] GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2 => generated 1691 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:11:42.374562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2bea9687-79c1-42da-b9d1-b26d88204798 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:11:42.375280 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2bea9687-79c1-42da-b9d1-b26d88204798 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:11:42.383818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2bea9687-79c1-42da-b9d1-b26d88204798 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:42.384418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2bea9687-79c1-42da-b9d1-b26d88204798 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:42.384952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2bea9687-79c1-42da-b9d1-b26d88204798 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:42.385728 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2bea9687-79c1-42da-b9d1-b26d88204798 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:42.386262 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2bea9687-79c1-42da-b9d1-b26d88204798 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:42.386696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2bea9687-79c1-42da-b9d1-b26d88204798 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:42.907966 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2bea9687-79c1-42da-b9d1-b26d88204798 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:11:42.917160 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2bea9687-79c1-42da-b9d1-b26d88204798 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2" status: 200 len: 1691 microversion: 2.1 time: 0.546483 Oct 05 03:11:42.917755 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3266/6516] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:11:42 2022] GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2 => generated 1691 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:11:43.941462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a7b39680-4154-4cce-83e0-c87db278b50d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:11:43.941936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a7b39680-4154-4cce-83e0-c87db278b50d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:11:43.948822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7b39680-4154-4cce-83e0-c87db278b50d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:43.949515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7b39680-4154-4cce-83e0-c87db278b50d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:43.949954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7b39680-4154-4cce-83e0-c87db278b50d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:43.951056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7b39680-4154-4cce-83e0-c87db278b50d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:43.951517 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7b39680-4154-4cce-83e0-c87db278b50d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:43.952077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7b39680-4154-4cce-83e0-c87db278b50d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:44.200028 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a7b39680-4154-4cce-83e0-c87db278b50d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:11:44.210089 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a7b39680-4154-4cce-83e0-c87db278b50d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2" status: 200 len: 1691 microversion: 2.1 time: 0.271395 Oct 05 03:11:44.210393 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3251/6517] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:11:43 2022] GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2 => generated 1691 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:11:45.233917 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d5ae20de-d4d9-4785-8628-205e757c2c16 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:11:45.234568 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d5ae20de-d4d9-4785-8628-205e757c2c16 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:11:45.241850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5ae20de-d4d9-4785-8628-205e757c2c16 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:45.242348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5ae20de-d4d9-4785-8628-205e757c2c16 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:45.242871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5ae20de-d4d9-4785-8628-205e757c2c16 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:45.243480 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5ae20de-d4d9-4785-8628-205e757c2c16 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:45.244123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5ae20de-d4d9-4785-8628-205e757c2c16 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:45.244600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5ae20de-d4d9-4785-8628-205e757c2c16 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:45.542743 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d5ae20de-d4d9-4785-8628-205e757c2c16 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:11:45.551967 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d5ae20de-d4d9-4785-8628-205e757c2c16 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2" status: 200 len: 1681 microversion: 2.1 time: 0.321895 Oct 05 03:11:45.564923 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3267/6518] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:11:45 2022] GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2 => generated 1681 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:11:45.575222 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f236546c-8396-4de4-922d-cfbfaaf470ff tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:11:45.575953 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f236546c-8396-4de4-922d-cfbfaaf470ff tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:11:45.583080 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f236546c-8396-4de4-922d-cfbfaaf470ff tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:45.584290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f236546c-8396-4de4-922d-cfbfaaf470ff tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:45.585003 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f236546c-8396-4de4-922d-cfbfaaf470ff tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:45.585794 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f236546c-8396-4de4-922d-cfbfaaf470ff tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:45.586322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f236546c-8396-4de4-922d-cfbfaaf470ff tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:45.586861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f236546c-8396-4de4-922d-cfbfaaf470ff tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:45.807504 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f236546c-8396-4de4-922d-cfbfaaf470ff tempest-TestNetworkAdvancedServerOps-1431159567 tempest-TestNetworkAdvancedServerOps-1431159567-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2" status: 200 len: 1832 microversion: 2.1 time: 0.235952 Oct 05 03:11:45.824222 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3252/6519] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:11:45 2022] GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2 => generated 1832 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:11:45.832040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e0ceef75-f2d1-4c8e-b300-7dcaa783fada tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:11:45.832810 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e0ceef75-f2d1-4c8e-b300-7dcaa783fada tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:11:45.841176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e0ceef75-f2d1-4c8e-b300-7dcaa783fada tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:45.841773 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e0ceef75-f2d1-4c8e-b300-7dcaa783fada tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:45.842703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e0ceef75-f2d1-4c8e-b300-7dcaa783fada tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:45.843480 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e0ceef75-f2d1-4c8e-b300-7dcaa783fada tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:45.845607 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e0ceef75-f2d1-4c8e-b300-7dcaa783fada tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:45.846132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e0ceef75-f2d1-4c8e-b300-7dcaa783fada tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:45.997031 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e0ceef75-f2d1-4c8e-b300-7dcaa783fada tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:11:46.005249 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e0ceef75-f2d1-4c8e-b300-7dcaa783fada tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2" status: 200 len: 1681 microversion: 2.1 time: 0.176994 Oct 05 03:11:46.006741 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3268/6520] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:11:45 2022] GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2 => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:11:46.107198 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e317852f-22eb-460f-bfe2-9cb87a62eed5 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:11:46.109441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e317852f-22eb-460f-bfe2-9cb87a62eed5 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:11:46.116206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e317852f-22eb-460f-bfe2-9cb87a62eed5 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:46.116701 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e317852f-22eb-460f-bfe2-9cb87a62eed5 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:46.117241 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e317852f-22eb-460f-bfe2-9cb87a62eed5 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:46.117932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e317852f-22eb-460f-bfe2-9cb87a62eed5 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:46.118393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e317852f-22eb-460f-bfe2-9cb87a62eed5 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:46.118809 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e317852f-22eb-460f-bfe2-9cb87a62eed5 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:46.184809 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e317852f-22eb-460f-bfe2-9cb87a62eed5 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "POST /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2/action" status: 200 len: 38321 microversion: 2.1 time: 0.081364 Oct 05 03:11:46.185520 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3253/6521] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:11:46 2022] POST /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2/action => generated 38321 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 03:11:47.511209 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e936ef4e-2e57-4350-916d-6197f419c29c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:11:47.511793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e936ef4e-2e57-4350-916d-6197f419c29c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:11:47.512200 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-ee3d9766-b9d5-4e79-84ad-67c3a20ccbc5 req-873c9567-4337-4b56-80db-916df5742cfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60fff54d-55b0-4e52-aae5-698c60e914c2", "tag": "839b84fa-e1fb-4925-85dd-0d318c9b6d36"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:11:47.519026 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e936ef4e-2e57-4350-916d-6197f419c29c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:47.519523 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e936ef4e-2e57-4350-916d-6197f419c29c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:47.519959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e936ef4e-2e57-4350-916d-6197f419c29c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:47.520661 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e936ef4e-2e57-4350-916d-6197f419c29c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:47.522163 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e936ef4e-2e57-4350-916d-6197f419c29c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:47.522596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e936ef4e-2e57-4350-916d-6197f419c29c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:47.540113 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ee3d9766-b9d5-4e79-84ad-67c3a20ccbc5 req-873c9567-4337-4b56-80db-916df5742cfd service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:47.540880 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ee3d9766-b9d5-4e79-84ad-67c3a20ccbc5 req-873c9567-4337-4b56-80db-916df5742cfd service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:47.541340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ee3d9766-b9d5-4e79-84ad-67c3a20ccbc5 req-873c9567-4337-4b56-80db-916df5742cfd service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:47.552012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e936ef4e-2e57-4350-916d-6197f419c29c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:11:47.554140 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-ee3d9766-b9d5-4e79-84ad-67c3a20ccbc5 req-873c9567-4337-4b56-80db-916df5742cfd service nova] Creating event network-changed:839b84fa-e1fb-4925-85dd-0d318c9b6d36 for instance 60fff54d-55b0-4e52-aae5-698c60e914c2 on n-h1-858272-3 Oct 05 03:11:47.559355 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-ee3d9766-b9d5-4e79-84ad-67c3a20ccbc5 req-873c9567-4337-4b56-80db-916df5742cfd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051284 Oct 05 03:11:47.560482 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3254/6522] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:11:47.681296 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e936ef4e-2e57-4350-916d-6197f419c29c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "DELETE /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2" status: 204 len: 0 microversion: 2.1 time: 0.175843 Oct 05 03:11:47.682273 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3269/6523] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:11:47 2022] DELETE /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:11:47.692087 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1e94fe6a-05ab-4949-98d1-f92de767a159 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:11:47.694056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1e94fe6a-05ab-4949-98d1-f92de767a159 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:11:47.702380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e94fe6a-05ab-4949-98d1-f92de767a159 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:47.703946 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e94fe6a-05ab-4949-98d1-f92de767a159 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:47.704574 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e94fe6a-05ab-4949-98d1-f92de767a159 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:47.705513 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e94fe6a-05ab-4949-98d1-f92de767a159 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:47.705982 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e94fe6a-05ab-4949-98d1-f92de767a159 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:47.706412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e94fe6a-05ab-4949-98d1-f92de767a159 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:47.887614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1e94fe6a-05ab-4949-98d1-f92de767a159 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:11:47.897020 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1e94fe6a-05ab-4949-98d1-f92de767a159 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2" status: 200 len: 1687 microversion: 2.1 time: 0.210018 Oct 05 03:11:47.897966 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3255/6524] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:11:47 2022] GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2 => generated 1687 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:11:48.924409 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-552a4fbe-b259-4c10-9756-a439fb20aae6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:11:48.925129 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-552a4fbe-b259-4c10-9756-a439fb20aae6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:11:48.931907 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-552a4fbe-b259-4c10-9756-a439fb20aae6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:48.932398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-552a4fbe-b259-4c10-9756-a439fb20aae6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:48.932849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-552a4fbe-b259-4c10-9756-a439fb20aae6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:48.933580 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-552a4fbe-b259-4c10-9756-a439fb20aae6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:48.934037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-552a4fbe-b259-4c10-9756-a439fb20aae6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:48.934464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-552a4fbe-b259-4c10-9756-a439fb20aae6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:49.243697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-552a4fbe-b259-4c10-9756-a439fb20aae6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:11:49.251613 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-552a4fbe-b259-4c10-9756-a439fb20aae6 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2" status: 200 len: 1569 microversion: 2.1 time: 0.331759 Oct 05 03:11:49.252191 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3270/6525] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:11:48 2022] GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2 => generated 1569 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:11:49.574698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-b3ce0330-ef70-48a6-8a63-f5bfa4e9ffab req-40e8cf36-efad-4e79-a30c-93af56fd6b93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60fff54d-55b0-4e52-aae5-698c60e914c2", "name": "network-vif-deleted", "tag": "839b84fa-e1fb-4925-85dd-0d318c9b6d36"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:11:49.587305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b3ce0330-ef70-48a6-8a63-f5bfa4e9ffab req-40e8cf36-efad-4e79-a30c-93af56fd6b93 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:49.587893 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b3ce0330-ef70-48a6-8a63-f5bfa4e9ffab req-40e8cf36-efad-4e79-a30c-93af56fd6b93 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:49.588401 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b3ce0330-ef70-48a6-8a63-f5bfa4e9ffab req-40e8cf36-efad-4e79-a30c-93af56fd6b93 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:49.606558 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-b3ce0330-ef70-48a6-8a63-f5bfa4e9ffab req-40e8cf36-efad-4e79-a30c-93af56fd6b93 service nova] Creating event network-vif-deleted:839b84fa-e1fb-4925-85dd-0d318c9b6d36 for instance 60fff54d-55b0-4e52-aae5-698c60e914c2 on n-h1-858272-3 Oct 05 03:11:49.612764 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-b3ce0330-ef70-48a6-8a63-f5bfa4e9ffab req-40e8cf36-efad-4e79-a30c-93af56fd6b93 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041846 Oct 05 03:11:49.613906 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3256/6526] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:11:50.275980 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c6a4110f-cfaf-4389-b54e-1cf6ec0b9a66 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:11:50.276540 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c6a4110f-cfaf-4389-b54e-1cf6ec0b9a66 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: 60fff54d-55b0-4e52-aae5-698c60e914c2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:11:50.283557 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6a4110f-cfaf-4389-b54e-1cf6ec0b9a66 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:50.284056 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6a4110f-cfaf-4389-b54e-1cf6ec0b9a66 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:50.284505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6a4110f-cfaf-4389-b54e-1cf6ec0b9a66 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:50.285235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6a4110f-cfaf-4389-b54e-1cf6ec0b9a66 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:11:50.285702 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6a4110f-cfaf-4389-b54e-1cf6ec0b9a66 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:11:50.286132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c6a4110f-cfaf-4389-b54e-1cf6ec0b9a66 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:11:50.299806 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-c6a4110f-cfaf-4389-b54e-1cf6ec0b9a66 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] HTTP exception thrown: Instance 60fff54d-55b0-4e52-aae5-698c60e914c2 could not be found. Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c6a4110f-cfaf-4389-b54e-1cf6ec0b9a66 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Request method failure captured: Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2 HTTP/1.1 Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPQQaPdY80Cpcj7cnlUwviGOgibF1hELwwBhNlNnP0MqbdNiw25tncanzi7qWvBbOvFGmFxbhq_pYUvMd-n-xjmhM4x8o5emmLCp2GN5-d1zUtR_w4L-Z_KZTshYbgGB04rNkRVV36r2lGPYux6FzpfN97MB3YiAErpveqwDREaePkw Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: a86e3137c6764eeb948b9c7dab895c34 Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-344873080 Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a86e3137c6764eeb948b9c7dab895c34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a86e3137c6764eeb948b9c7dab895c34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a86e3137c6764eeb948b9c7dab895c34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a86e3137c6764eeb948b9c7dab895c34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TestNetworkAdvancedServerOps-344873080 Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: a86e3137c6764eeb948b9c7dab895c34 Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-344873080 Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TestNetworkAdvancedServerOps-344873080-project Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: ad3a53da0c764f0a893966aea6505fa7 Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TestNetworkAdvancedServerOps-344873080-project Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 60fff54d-55b0-4e52-aae5-698c60e914c2 could not be found. Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '60fff54d-55b0-4e52-aae5-698c60e914c2'} Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60fff54d-55b0-4e52-aae5-698c60e914c2 could not be found. Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60fff54d-55b0-4e52-aae5-698c60e914c2 could not be found. Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:11:50.301490 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:11:50.307699 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:11:50.307699 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:11:50.307699 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:11:50.307699 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:11:50.307699 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:11:50.307699 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:11:50.307699 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60fff54d-55b0-4e52-aae5-698c60e914c2 could not be found. Oct 05 03:11:50.307699 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:11:50.307699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c6a4110f-cfaf-4389-b54e-1cf6ec0b9a66 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Returning 404 to user: Instance 60fff54d-55b0-4e52-aae5-698c60e914c2 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:11:50.307699 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c6a4110f-cfaf-4389-b54e-1cf6ec0b9a66 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2" status: 404 len: 111 microversion: 2.1 time: 0.031101 Oct 05 03:11:50.307699 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3271/6527] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:11:50 2022] GET /compute/v2.1/servers/60fff54d-55b0-4e52-aae5-698c60e914c2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:11:53.882099 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9fab20f3-b42c-4f9e-b442-837fa4890f2a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '.version_select at 0x7fccdfccdf70>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:11:53.908564 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9fab20f3-b42c-4f9e-b442-837fa4890f2a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-62350238" status: 202 len: 0 microversion: 2.1 time: 0.041930 Oct 05 03:11:53.909224 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3257/6528] 10.222.0.16 () {58 vars in 1278 bytes} [Wed Oct 5 03:11:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-62350238 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:11:53.942025 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a3ee424d-0fef-4388-abc7-333a7f348013 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Action: 'create', calling method: .version_select at 0x7fccdeb7cb80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-964410943", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTtb8W/1rvRt0iRHZw+USdjioqb9bL5YmrTVgnjVif4vWSqTl8KqmPQzb/o4W21l8TEOfPNXPe91gIW3eNoN/bXYNYoYmKIpfcxEeTh4wNAES6aynlqBxNPn33//Sjb5w=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:11:53.959850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-a3ee424d-0fef-4388-abc7-333a7f348013 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Getting quotas for project a86e3137c6764eeb948b9c7dab895c34. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:11:53.966419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-a3ee424d-0fef-4388-abc7-333a7f348013 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Getting quotas for user ad3a53da0c764f0a893966aea6505fa7 and project a86e3137c6764eeb948b9c7dab895c34. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:11:53.991955 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a3ee424d-0fef-4388-abc7-333a7f348013 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053931 Oct 05 03:11:53.992968 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3272/6529] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 03:11:53 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:12:00.741367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c81bd8c0-a628-4bf7-9fe0-79bba9553cae tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-781052244", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "f58d443a-d96d-4161-b6e7-0947a0fff187"}], "key_name": "tempest-TestNetworkAdvancedServerOps-964410943", "security_groups": [{"name": "tempest-secgroup-smoke-1842279947"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:12:00.753016 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=70 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:12:00.753794 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:12:01.316394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-c81bd8c0-a628-4bf7-9fe0-79bba9553cae tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] validate_networks() for [('f58d443a-d96d-4161-b6e7-0947a0fff187', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:12:02.041674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-c81bd8c0-a628-4bf7-9fe0-79bba9553cae tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:12:02.042827 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-c81bd8c0-a628-4bf7-9fe0-79bba9553cae tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:12:02.043492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-c81bd8c0-a628-4bf7-9fe0-79bba9553cae tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:12:02.044109 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-c81bd8c0-a628-4bf7-9fe0-79bba9553cae tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:12:02.044782 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-c81bd8c0-a628-4bf7-9fe0-79bba9553cae tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:12:02.055390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c81bd8c0-a628-4bf7-9fe0-79bba9553cae tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:12:02.056332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c81bd8c0-a628-4bf7-9fe0-79bba9553cae tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:12:02.056771 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c81bd8c0-a628-4bf7-9fe0-79bba9553cae tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:12:02.057565 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c81bd8c0-a628-4bf7-9fe0-79bba9553cae tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:12:02.058019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c81bd8c0-a628-4bf7-9fe0-79bba9553cae tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:12:02.058627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c81bd8c0-a628-4bf7-9fe0-79bba9553cae tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:12:02.078218 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-c81bd8c0-a628-4bf7-9fe0-79bba9553cae tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Getting quotas for project a86e3137c6764eeb948b9c7dab895c34. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:12:02.084543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-c81bd8c0-a628-4bf7-9fe0-79bba9553cae tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Getting quotas for user ad3a53da0c764f0a893966aea6505fa7 and project a86e3137c6764eeb948b9c7dab895c34. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:12:02.100628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c81bd8c0-a628-4bf7-9fe0-79bba9553cae tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:12:02.103415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c81bd8c0-a628-4bf7-9fe0-79bba9553cae tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:12:02.154834 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c81bd8c0-a628-4bf7-9fe0-79bba9553cae tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.417957 Oct 05 03:12:02.155781 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3258/6530] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:12:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 1420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:12:02.168469 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c22469e8-cdac-4185-b785-1f51d38d9e9c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:12:02.170016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c22469e8-cdac-4185-b785-1f51d38d9e9c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:12:02.179706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:12:02.182556 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:12:02.430041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c22469e8-cdac-4185-b785-1f51d38d9e9c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:12:02.439576 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c22469e8-cdac-4185-b785-1f51d38d9e9c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2" status: 200 len: 1265 microversion: 2.1 time: 0.275377 Oct 05 03:12:02.440372 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3273/6531] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:12:02 2022] GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 => generated 1265 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:12:03.465332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6ace3cbd-00d7-4b10-92a9-535aca8aa772 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:12:03.466614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6ace3cbd-00d7-4b10-92a9-535aca8aa772 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:12:03.480288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ace3cbd-00d7-4b10-92a9-535aca8aa772 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:12:03.481205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ace3cbd-00d7-4b10-92a9-535aca8aa772 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:12:03.482165 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ace3cbd-00d7-4b10-92a9-535aca8aa772 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:12:03.483644 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ace3cbd-00d7-4b10-92a9-535aca8aa772 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:12:03.484279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ace3cbd-00d7-4b10-92a9-535aca8aa772 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:12:03.484879 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ace3cbd-00d7-4b10-92a9-535aca8aa772 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:12:03.562700 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6ace3cbd-00d7-4b10-92a9-535aca8aa772 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:12:03.573395 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6ace3cbd-00d7-4b10-92a9-535aca8aa772 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2" status: 200 len: 1335 microversion: 2.1 time: 0.112792 Oct 05 03:12:03.574001 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3259/6532] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:12:03 2022] GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 => generated 1335 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:12:04.597175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-384327ae-13c9-4dce-84ba-229f6f9a2348 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:12:04.597775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-384327ae-13c9-4dce-84ba-229f6f9a2348 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:12:04.605998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-384327ae-13c9-4dce-84ba-229f6f9a2348 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:12:04.611746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-384327ae-13c9-4dce-84ba-229f6f9a2348 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:12:04.612264 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-384327ae-13c9-4dce-84ba-229f6f9a2348 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:12:04.613175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-384327ae-13c9-4dce-84ba-229f6f9a2348 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:12:04.613987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-384327ae-13c9-4dce-84ba-229f6f9a2348 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:12:04.614421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-384327ae-13c9-4dce-84ba-229f6f9a2348 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:12:04.679015 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-384327ae-13c9-4dce-84ba-229f6f9a2348 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:12:04.686784 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-384327ae-13c9-4dce-84ba-229f6f9a2348 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2" status: 200 len: 1323 microversion: 2.1 time: 0.093912 Oct 05 03:12:04.687368 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3274/6533] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:12:04 2022] GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 => generated 1323 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:12:05.712269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7083a980-9e3e-4f78-aef8-ff8275116723 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:12:05.712894 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7083a980-9e3e-4f78-aef8-ff8275116723 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:12:05.719741 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7083a980-9e3e-4f78-aef8-ff8275116723 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:12:05.720237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7083a980-9e3e-4f78-aef8-ff8275116723 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:12:05.721170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7083a980-9e3e-4f78-aef8-ff8275116723 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:12:05.721521 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7083a980-9e3e-4f78-aef8-ff8275116723 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:12:05.721856 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7083a980-9e3e-4f78-aef8-ff8275116723 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:12:05.722883 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7083a980-9e3e-4f78-aef8-ff8275116723 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:12:05.967265 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7083a980-9e3e-4f78-aef8-ff8275116723 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:12:05.983875 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7083a980-9e3e-4f78-aef8-ff8275116723 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2" status: 200 len: 1391 microversion: 2.1 time: 0.276170 Oct 05 03:12:05.984498 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3260/6534] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:12:05 2022] GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 => generated 1391 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:12:06.018944 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-7d0e474f-27c6-43fe-a100-4a47b31b1ba5 req-ce67d3e3-fd1d-4024-bad3-210a0c15ab15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4e9743d-f24d-4704-aac9-6c2c8a3803a2", "tag": "cf5fd187-609f-4705-8530-0f40dc651c3c"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:12:06.031148 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7d0e474f-27c6-43fe-a100-4a47b31b1ba5 req-ce67d3e3-fd1d-4024-bad3-210a0c15ab15 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:12:06.031638 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7d0e474f-27c6-43fe-a100-4a47b31b1ba5 req-ce67d3e3-fd1d-4024-bad3-210a0c15ab15 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:12:06.032071 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7d0e474f-27c6-43fe-a100-4a47b31b1ba5 req-ce67d3e3-fd1d-4024-bad3-210a0c15ab15 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:12:06.046278 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-7d0e474f-27c6-43fe-a100-4a47b31b1ba5 req-ce67d3e3-fd1d-4024-bad3-210a0c15ab15 service nova] Creating event network-changed:cf5fd187-609f-4705-8530-0f40dc651c3c for instance c4e9743d-f24d-4704-aac9-6c2c8a3803a2 on n-h2-858272-3 Oct 05 03:12:06.053293 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-7d0e474f-27c6-43fe-a100-4a47b31b1ba5 req-ce67d3e3-fd1d-4024-bad3-210a0c15ab15 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173916 Oct 05 03:12:06.054202 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3275/6535] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:12:07.009059 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e669c241-ed38-474c-903e-23d31555bc57 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:12:07.009812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e669c241-ed38-474c-903e-23d31555bc57 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:12:07.017176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e669c241-ed38-474c-903e-23d31555bc57 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:12:07.017662 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e669c241-ed38-474c-903e-23d31555bc57 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:12:07.018096 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e669c241-ed38-474c-903e-23d31555bc57 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:12:07.018948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e669c241-ed38-474c-903e-23d31555bc57 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:12:07.019420 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e669c241-ed38-474c-903e-23d31555bc57 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:12:07.019844 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e669c241-ed38-474c-903e-23d31555bc57 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:12:07.247652 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e669c241-ed38-474c-903e-23d31555bc57 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:12:07.257144 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e669c241-ed38-474c-903e-23d31555bc57 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2" status: 200 len: 1391 microversion: 2.1 time: 0.252102 Oct 05 03:12:07.257729 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3261/6536] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:12:07 2022] GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 => generated 1391 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:12:08.282306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2c50b8a5-9dc4-4935-9445-f88da9aaa65c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:12:08.283136 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2c50b8a5-9dc4-4935-9445-f88da9aaa65c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:12:08.290544 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c50b8a5-9dc4-4935-9445-f88da9aaa65c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:12:08.291037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c50b8a5-9dc4-4935-9445-f88da9aaa65c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:12:08.291478 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c50b8a5-9dc4-4935-9445-f88da9aaa65c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:12:08.292179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c50b8a5-9dc4-4935-9445-f88da9aaa65c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:12:08.292658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c50b8a5-9dc4-4935-9445-f88da9aaa65c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:12:08.293135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2c50b8a5-9dc4-4935-9445-f88da9aaa65c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:12:08.500344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2c50b8a5-9dc4-4935-9445-f88da9aaa65c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:12:08.509552 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2c50b8a5-9dc4-4935-9445-f88da9aaa65c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2" status: 200 len: 1391 microversion: 2.1 time: 0.232683 Oct 05 03:12:08.510145 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3276/6537] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:12:08 2022] GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 => generated 1391 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:12:09.532858 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-006426bc-09e1-445f-b045-a0960a4335e9 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:12:09.534094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-006426bc-09e1-445f-b045-a0960a4335e9 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:12:09.540971 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-006426bc-09e1-445f-b045-a0960a4335e9 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:12:09.541695 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-006426bc-09e1-445f-b045-a0960a4335e9 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:12:09.542139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-006426bc-09e1-445f-b045-a0960a4335e9 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:12:09.543125 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-006426bc-09e1-445f-b045-a0960a4335e9 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:12:09.543820 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-006426bc-09e1-445f-b045-a0960a4335e9 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:12:09.544183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-006426bc-09e1-445f-b045-a0960a4335e9 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:12:09.790366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-006426bc-09e1-445f-b045-a0960a4335e9 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:12:09.799588 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-006426bc-09e1-445f-b045-a0960a4335e9 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2" status: 200 len: 1391 microversion: 2.1 time: 0.270609 Oct 05 03:12:09.800297 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3262/6538] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:12:09 2022] GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 => generated 1391 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:12:10.824637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1f6e55d4-e16d-4856-9ebc-db419da6a13c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:12:10.825893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1f6e55d4-e16d-4856-9ebc-db419da6a13c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:12:10.834665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f6e55d4-e16d-4856-9ebc-db419da6a13c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:12:10.835342 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f6e55d4-e16d-4856-9ebc-db419da6a13c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:12:10.835965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f6e55d4-e16d-4856-9ebc-db419da6a13c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:12:10.837094 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f6e55d4-e16d-4856-9ebc-db419da6a13c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:12:10.838659 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f6e55d4-e16d-4856-9ebc-db419da6a13c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:12:10.840135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f6e55d4-e16d-4856-9ebc-db419da6a13c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:12:11.023114 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1f6e55d4-e16d-4856-9ebc-db419da6a13c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:12:11.032250 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1f6e55d4-e16d-4856-9ebc-db419da6a13c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2" status: 200 len: 1391 microversion: 2.1 time: 0.212008 Oct 05 03:12:11.044927 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3277/6539] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:12:10 2022] GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 => generated 1391 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:12:11.940447 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-9ebc6a17-2e9b-46d3-8123-8a978069341d req-a53257e2-d0d8-49ac-81a1-19dba9c852cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4e9743d-f24d-4704-aac9-6c2c8a3803a2", "name": "network-vif-plugged", "status": "completed", "tag": "cf5fd187-609f-4705-8530-0f40dc651c3c"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:12:11.953427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-9ebc6a17-2e9b-46d3-8123-8a978069341d req-a53257e2-d0d8-49ac-81a1-19dba9c852cf service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:12:11.955280 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-9ebc6a17-2e9b-46d3-8123-8a978069341d req-a53257e2-d0d8-49ac-81a1-19dba9c852cf service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:12:11.955719 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-9ebc6a17-2e9b-46d3-8123-8a978069341d req-a53257e2-d0d8-49ac-81a1-19dba9c852cf service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:12:11.971315 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-9ebc6a17-2e9b-46d3-8123-8a978069341d req-a53257e2-d0d8-49ac-81a1-19dba9c852cf service nova] Creating event network-vif-plugged:cf5fd187-609f-4705-8530-0f40dc651c3c for instance c4e9743d-f24d-4704-aac9-6c2c8a3803a2 on n-h2-858272-3 Oct 05 03:12:11.977333 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-9ebc6a17-2e9b-46d3-8123-8a978069341d req-a53257e2-d0d8-49ac-81a1-19dba9c852cf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040884 Oct 05 03:12:11.977960 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3263/6540] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:12:12.056439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-747d0aa2-59f5-4b4d-9211-ed6dc3fe5b61 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:12:12.057098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-747d0aa2-59f5-4b4d-9211-ed6dc3fe5b61 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:12:12.066089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-747d0aa2-59f5-4b4d-9211-ed6dc3fe5b61 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:12:12.066632 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-747d0aa2-59f5-4b4d-9211-ed6dc3fe5b61 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:12:12.067372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-747d0aa2-59f5-4b4d-9211-ed6dc3fe5b61 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:12:12.067801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-747d0aa2-59f5-4b4d-9211-ed6dc3fe5b61 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:12:12.068253 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-747d0aa2-59f5-4b4d-9211-ed6dc3fe5b61 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:12:12.068930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-747d0aa2-59f5-4b4d-9211-ed6dc3fe5b61 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:12:12.208311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-747d0aa2-59f5-4b4d-9211-ed6dc3fe5b61 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:12:12.217602 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-747d0aa2-59f5-4b4d-9211-ed6dc3fe5b61 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2" status: 200 len: 1391 microversion: 2.1 time: 0.165152 Oct 05 03:12:12.232942 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3278/6541] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:12:12 2022] GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:12:13.240527 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:12:13.242370 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:12:13.252512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-096945ce-8d25-4a7d-8306-08e78f491f8f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:12:13.253594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-096945ce-8d25-4a7d-8306-08e78f491f8f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:12:13.262574 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-096945ce-8d25-4a7d-8306-08e78f491f8f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:12:13.263374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-096945ce-8d25-4a7d-8306-08e78f491f8f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:12:13.263943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-096945ce-8d25-4a7d-8306-08e78f491f8f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:12:13.264818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-096945ce-8d25-4a7d-8306-08e78f491f8f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:12:13.265543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-096945ce-8d25-4a7d-8306-08e78f491f8f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:12:13.266135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-096945ce-8d25-4a7d-8306-08e78f491f8f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:12:13.417516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-096945ce-8d25-4a7d-8306-08e78f491f8f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:12:13.425371 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-096945ce-8d25-4a7d-8306-08e78f491f8f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2" status: 200 len: 1391 microversion: 2.1 time: 0.186843 Oct 05 03:12:13.426130 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3264/6542] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:12:13 2022] GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 => generated 1391 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:12:14.448958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-07afd86f-94ed-4bdf-8040-2715f159dc3a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:12:14.450262 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-07afd86f-94ed-4bdf-8040-2715f159dc3a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:12:14.452469 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:12:14.459092 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-07afd86f-94ed-4bdf-8040-2715f159dc3a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:12:14.459587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-07afd86f-94ed-4bdf-8040-2715f159dc3a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:12:14.460160 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-07afd86f-94ed-4bdf-8040-2715f159dc3a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:12:14.460869 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-07afd86f-94ed-4bdf-8040-2715f159dc3a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:12:14.461370 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-07afd86f-94ed-4bdf-8040-2715f159dc3a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:12:14.461789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-07afd86f-94ed-4bdf-8040-2715f159dc3a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:12:14.601409 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-07afd86f-94ed-4bdf-8040-2715f159dc3a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:12:14.611488 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-07afd86f-94ed-4bdf-8040-2715f159dc3a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2" status: 200 len: 1563 microversion: 2.1 time: 0.166113 Oct 05 03:12:14.612970 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3279/6543] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:12:14 2022] GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 => generated 1563 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:12:14.635759 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4be590e7-c325-40ab-9fc7-e13e97354ebd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:12:14.636433 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4be590e7-c325-40ab-9fc7-e13e97354ebd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:12:14.643267 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4be590e7-c325-40ab-9fc7-e13e97354ebd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:12:14.643756 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4be590e7-c325-40ab-9fc7-e13e97354ebd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:12:14.644198 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4be590e7-c325-40ab-9fc7-e13e97354ebd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:12:14.645000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4be590e7-c325-40ab-9fc7-e13e97354ebd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:12:14.645461 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4be590e7-c325-40ab-9fc7-e13e97354ebd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:12:14.645888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4be590e7-c325-40ab-9fc7-e13e97354ebd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:12:14.794761 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4be590e7-c325-40ab-9fc7-e13e97354ebd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:12:14.803411 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4be590e7-c325-40ab-9fc7-e13e97354ebd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2" status: 200 len: 1563 microversion: 2.1 time: 0.171527 Oct 05 03:12:14.804004 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3265/6544] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:12:14 2022] GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:12:16.841504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c1d9a06e-046c-4998-8207-056b2f4baa6c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:12:16.843015 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c1d9a06e-046c-4998-8207-056b2f4baa6c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:12:16.850065 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-41f8b43c-4a6e-4488-9de5-2078f0ed1bf3 req-5be54823-0398-41b0-964f-d1c92f4898e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4e9743d-f24d-4704-aac9-6c2c8a3803a2", "tag": "cf5fd187-609f-4705-8530-0f40dc651c3c"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:12:16.866692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-41f8b43c-4a6e-4488-9de5-2078f0ed1bf3 req-5be54823-0398-41b0-964f-d1c92f4898e0 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:12:16.867760 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1d9a06e-046c-4998-8207-056b2f4baa6c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:12:16.868327 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1d9a06e-046c-4998-8207-056b2f4baa6c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:12:16.868841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1d9a06e-046c-4998-8207-056b2f4baa6c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:12:16.869316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-41f8b43c-4a6e-4488-9de5-2078f0ed1bf3 req-5be54823-0398-41b0-964f-d1c92f4898e0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:12:16.869718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1d9a06e-046c-4998-8207-056b2f4baa6c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:12:16.869856 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-41f8b43c-4a6e-4488-9de5-2078f0ed1bf3 req-5be54823-0398-41b0-964f-d1c92f4898e0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:12:16.870560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1d9a06e-046c-4998-8207-056b2f4baa6c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:12:16.871216 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1d9a06e-046c-4998-8207-056b2f4baa6c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:12:16.886998 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-41f8b43c-4a6e-4488-9de5-2078f0ed1bf3 req-5be54823-0398-41b0-964f-d1c92f4898e0 service nova] Creating event network-changed:cf5fd187-609f-4705-8530-0f40dc651c3c for instance c4e9743d-f24d-4704-aac9-6c2c8a3803a2 on n-h2-858272-3 Oct 05 03:12:16.896123 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-41f8b43c-4a6e-4488-9de5-2078f0ed1bf3 req-5be54823-0398-41b0-964f-d1c92f4898e0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050079 Oct 05 03:12:16.896996 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3266/6545] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:12:17.040441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c1d9a06e-046c-4998-8207-056b2f4baa6c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:12:17.049441 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c1d9a06e-046c-4998-8207-056b2f4baa6c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2" status: 200 len: 1563 microversion: 2.1 time: 0.211721 Oct 05 03:12:17.050035 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3280/6546] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:12:16 2022] GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 => generated 1563 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:12:50.351730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:12:50.352858 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=42 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:12:50.357333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0598bbb4-d11d-45b5-a1be-f249686acdc2 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:12:50.359648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0598bbb4-d11d-45b5-a1be-f249686acdc2 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:12:50.367872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0598bbb4-d11d-45b5-a1be-f249686acdc2 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:12:50.368405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0598bbb4-d11d-45b5-a1be-f249686acdc2 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:12:50.368872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0598bbb4-d11d-45b5-a1be-f249686acdc2 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:12:50.369585 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0598bbb4-d11d-45b5-a1be-f249686acdc2 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:12:50.370036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0598bbb4-d11d-45b5-a1be-f249686acdc2 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:12:50.370462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0598bbb4-d11d-45b5-a1be-f249686acdc2 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:12:50.461292 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0598bbb4-d11d-45b5-a1be-f249686acdc2 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "POST /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2/action" status: 200 len: 24564 microversion: 2.1 time: 0.111622 Oct 05 03:12:50.462222 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3267/6547] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:12:50 2022] POST /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2/action => generated 24564 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 03:13:20.847345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-92e4f7e9-d6d1-4eca-8333-651ef998241e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:13:20.852147 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-92e4f7e9-d6d1-4eca-8333-651ef998241e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:13:20.854628 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=17 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:13:20.855360 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=38 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:13:20.863024 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92e4f7e9-d6d1-4eca-8333-651ef998241e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:20.863521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92e4f7e9-d6d1-4eca-8333-651ef998241e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:20.864200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92e4f7e9-d6d1-4eca-8333-651ef998241e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:20.865038 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92e4f7e9-d6d1-4eca-8333-651ef998241e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:20.865502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92e4f7e9-d6d1-4eca-8333-651ef998241e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:20.865938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92e4f7e9-d6d1-4eca-8333-651ef998241e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:20.953375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-92e4f7e9-d6d1-4eca-8333-651ef998241e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:13:20.953800 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-92e4f7e9-d6d1-4eca-8333-651ef998241e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:13:20.954273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-92e4f7e9-d6d1-4eca-8333-651ef998241e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:13:20.954675 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-92e4f7e9-d6d1-4eca-8333-651ef998241e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:13:20.955084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-92e4f7e9-d6d1-4eca-8333-651ef998241e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:13:21.038115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-92e4f7e9-d6d1-4eca-8333-651ef998241e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:13:21.044504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92e4f7e9-d6d1-4eca-8333-651ef998241e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:21.045367 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92e4f7e9-d6d1-4eca-8333-651ef998241e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:21.045504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92e4f7e9-d6d1-4eca-8333-651ef998241e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:21.047252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92e4f7e9-d6d1-4eca-8333-651ef998241e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:21.048135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92e4f7e9-d6d1-4eca-8333-651ef998241e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:21.048669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92e4f7e9-d6d1-4eca-8333-651ef998241e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:21.080282 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-92e4f7e9-d6d1-4eca-8333-651ef998241e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "POST /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2/action" status: 202 len: 1137 microversion: 2.1 time: 0.240449 Oct 05 03:13:21.089342 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3281/6548] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:13:20 2022] POST /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2/action => generated 1137 bytes in 251 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 05 03:13:21.102854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-200cedab-08e8-4c42-992e-cf73f49dac84 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:13:21.103571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-200cedab-08e8-4c42-992e-cf73f49dac84 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:13:21.106600 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:13:21.107482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:13:21.125521 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-200cedab-08e8-4c42-992e-cf73f49dac84 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:21.126235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-200cedab-08e8-4c42-992e-cf73f49dac84 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:21.126851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-200cedab-08e8-4c42-992e-cf73f49dac84 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:21.129489 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-200cedab-08e8-4c42-992e-cf73f49dac84 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:21.131262 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-200cedab-08e8-4c42-992e-cf73f49dac84 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:21.132040 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-200cedab-08e8-4c42-992e-cf73f49dac84 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:21.290854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-200cedab-08e8-4c42-992e-cf73f49dac84 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:13:21.298844 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-200cedab-08e8-4c42-992e-cf73f49dac84 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2" status: 200 len: 1691 microversion: 2.1 time: 0.200886 Oct 05 03:13:21.299413 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3268/6549] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:13:21 2022] GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 => generated 1691 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:13:22.322060 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a07e1cf3-58e2-41e5-920b-1837ca77667a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:13:22.322958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a07e1cf3-58e2-41e5-920b-1837ca77667a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:13:22.331614 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a07e1cf3-58e2-41e5-920b-1837ca77667a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:22.332101 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a07e1cf3-58e2-41e5-920b-1837ca77667a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:22.332559 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a07e1cf3-58e2-41e5-920b-1837ca77667a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:22.333295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a07e1cf3-58e2-41e5-920b-1837ca77667a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:22.333753 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a07e1cf3-58e2-41e5-920b-1837ca77667a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:22.334293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a07e1cf3-58e2-41e5-920b-1837ca77667a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:22.530743 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a07e1cf3-58e2-41e5-920b-1837ca77667a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:13:22.539068 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a07e1cf3-58e2-41e5-920b-1837ca77667a tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2" status: 200 len: 1691 microversion: 2.1 time: 0.220952 Oct 05 03:13:22.539650 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3282/6550] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:13:22 2022] GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 => generated 1691 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:13:23.563590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-287c978a-540e-4bf0-90ab-ee6a4355b4ee tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:13:23.564226 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-287c978a-540e-4bf0-90ab-ee6a4355b4ee tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:13:23.571952 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-287c978a-540e-4bf0-90ab-ee6a4355b4ee tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:23.572450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-287c978a-540e-4bf0-90ab-ee6a4355b4ee tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:23.572910 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-287c978a-540e-4bf0-90ab-ee6a4355b4ee tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:23.573617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-287c978a-540e-4bf0-90ab-ee6a4355b4ee tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:23.574084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-287c978a-540e-4bf0-90ab-ee6a4355b4ee tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:23.574513 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-287c978a-540e-4bf0-90ab-ee6a4355b4ee tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:23.726407 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-287c978a-540e-4bf0-90ab-ee6a4355b4ee tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:13:23.734372 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-287c978a-540e-4bf0-90ab-ee6a4355b4ee tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2" status: 200 len: 1691 microversion: 2.1 time: 0.175852 Oct 05 03:13:23.734943 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3269/6551] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:13:23 2022] GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 => generated 1691 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:13:24.758173 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1611121d-4f00-48d3-b6dc-1567f2668247 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:13:24.758790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1611121d-4f00-48d3-b6dc-1567f2668247 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:13:24.765961 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1611121d-4f00-48d3-b6dc-1567f2668247 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:24.766449 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1611121d-4f00-48d3-b6dc-1567f2668247 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:24.766883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1611121d-4f00-48d3-b6dc-1567f2668247 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:24.767793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1611121d-4f00-48d3-b6dc-1567f2668247 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:24.768253 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1611121d-4f00-48d3-b6dc-1567f2668247 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:24.768692 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1611121d-4f00-48d3-b6dc-1567f2668247 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:24.929815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1611121d-4f00-48d3-b6dc-1567f2668247 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:13:24.937723 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1611121d-4f00-48d3-b6dc-1567f2668247 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2" status: 200 len: 1691 microversion: 2.1 time: 0.183379 Oct 05 03:13:24.938304 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3283/6552] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:13:24 2022] GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 => generated 1691 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:13:25.963009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-228fe2ad-9831-4f01-839c-a5f275dbd907 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:13:25.963946 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-228fe2ad-9831-4f01-839c-a5f275dbd907 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:13:25.975195 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-228fe2ad-9831-4f01-839c-a5f275dbd907 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:25.975694 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-228fe2ad-9831-4f01-839c-a5f275dbd907 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:25.976135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-228fe2ad-9831-4f01-839c-a5f275dbd907 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:25.976872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-228fe2ad-9831-4f01-839c-a5f275dbd907 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:25.977308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-228fe2ad-9831-4f01-839c-a5f275dbd907 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:25.977783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-228fe2ad-9831-4f01-839c-a5f275dbd907 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:26.119860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-228fe2ad-9831-4f01-839c-a5f275dbd907 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:13:26.129428 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-228fe2ad-9831-4f01-839c-a5f275dbd907 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2" status: 200 len: 1691 microversion: 2.1 time: 0.170944 Oct 05 03:13:26.129992 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3270/6553] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:13:25 2022] GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:13:27.154273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e661fe4b-d4c9-446f-9b5f-21eb2364988f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:13:27.155615 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e661fe4b-d4c9-446f-9b5f-21eb2364988f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:13:27.162627 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e661fe4b-d4c9-446f-9b5f-21eb2364988f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:27.163125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e661fe4b-d4c9-446f-9b5f-21eb2364988f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:27.163574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e661fe4b-d4c9-446f-9b5f-21eb2364988f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:27.164276 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e661fe4b-d4c9-446f-9b5f-21eb2364988f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:27.164741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e661fe4b-d4c9-446f-9b5f-21eb2364988f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:27.165195 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e661fe4b-d4c9-446f-9b5f-21eb2364988f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:27.343792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e661fe4b-d4c9-446f-9b5f-21eb2364988f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:13:27.355369 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e661fe4b-d4c9-446f-9b5f-21eb2364988f tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2" status: 200 len: 1691 microversion: 2.1 time: 0.204220 Oct 05 03:13:27.368924 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3284/6554] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:13:27 2022] GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 => generated 1691 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:13:28.381033 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-abbdc493-414c-4c75-8e9e-628f674d537b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:13:28.381718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-abbdc493-414c-4c75-8e9e-628f674d537b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:13:28.389548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-abbdc493-414c-4c75-8e9e-628f674d537b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:28.390061 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-abbdc493-414c-4c75-8e9e-628f674d537b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:28.390662 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-abbdc493-414c-4c75-8e9e-628f674d537b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:28.391375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-abbdc493-414c-4c75-8e9e-628f674d537b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:28.391857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-abbdc493-414c-4c75-8e9e-628f674d537b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:28.392255 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-abbdc493-414c-4c75-8e9e-628f674d537b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:28.526118 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-abbdc493-414c-4c75-8e9e-628f674d537b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:13:28.533995 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-abbdc493-414c-4c75-8e9e-628f674d537b tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2" status: 200 len: 1691 microversion: 2.1 time: 0.157161 Oct 05 03:13:28.534745 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3271/6555] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:13:28 2022] GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:13:29.557533 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fb6f8f96-536b-4970-bb09-1e0bbe6b4a7d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:13:29.558155 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fb6f8f96-536b-4970-bb09-1e0bbe6b4a7d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:13:29.565409 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb6f8f96-536b-4970-bb09-1e0bbe6b4a7d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:29.565897 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb6f8f96-536b-4970-bb09-1e0bbe6b4a7d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:29.566337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb6f8f96-536b-4970-bb09-1e0bbe6b4a7d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:29.567116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb6f8f96-536b-4970-bb09-1e0bbe6b4a7d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:29.567489 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb6f8f96-536b-4970-bb09-1e0bbe6b4a7d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:29.567915 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fb6f8f96-536b-4970-bb09-1e0bbe6b4a7d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:29.719388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fb6f8f96-536b-4970-bb09-1e0bbe6b4a7d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:13:29.727371 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fb6f8f96-536b-4970-bb09-1e0bbe6b4a7d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2" status: 200 len: 1691 microversion: 2.1 time: 0.173811 Oct 05 03:13:29.727955 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3285/6556] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:13:29 2022] GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 => generated 1691 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:13:30.756282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a628cfe9-cf56-49d9-b179-45a86efeef05 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:13:30.757083 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a628cfe9-cf56-49d9-b179-45a86efeef05 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:13:30.764001 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a628cfe9-cf56-49d9-b179-45a86efeef05 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:30.764484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a628cfe9-cf56-49d9-b179-45a86efeef05 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:30.765556 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a628cfe9-cf56-49d9-b179-45a86efeef05 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:30.766251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a628cfe9-cf56-49d9-b179-45a86efeef05 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:30.766706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a628cfe9-cf56-49d9-b179-45a86efeef05 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:30.767135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a628cfe9-cf56-49d9-b179-45a86efeef05 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:31.012024 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a628cfe9-cf56-49d9-b179-45a86efeef05 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:13:31.020253 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a628cfe9-cf56-49d9-b179-45a86efeef05 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2" status: 200 len: 1691 microversion: 2.1 time: 0.267947 Oct 05 03:13:31.020822 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3272/6557] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:13:30 2022] GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 => generated 1691 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:13:32.043436 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9b74fc61-de06-4554-9cca-192675eb76e4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:13:32.044067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9b74fc61-de06-4554-9cca-192675eb76e4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:13:32.055496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b74fc61-de06-4554-9cca-192675eb76e4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:32.055999 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b74fc61-de06-4554-9cca-192675eb76e4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:32.056442 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b74fc61-de06-4554-9cca-192675eb76e4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:32.057186 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b74fc61-de06-4554-9cca-192675eb76e4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:32.057648 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b74fc61-de06-4554-9cca-192675eb76e4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:32.058082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b74fc61-de06-4554-9cca-192675eb76e4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:32.197900 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9b74fc61-de06-4554-9cca-192675eb76e4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:13:32.207141 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9b74fc61-de06-4554-9cca-192675eb76e4 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2" status: 200 len: 1691 microversion: 2.1 time: 0.168285 Oct 05 03:13:32.207710 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3286/6558] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:13:32 2022] GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:13:33.231343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-846f63c4-1dd1-4bf2-bc52-0861e445f05e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:13:33.231966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-846f63c4-1dd1-4bf2-bc52-0861e445f05e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:13:33.240104 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-846f63c4-1dd1-4bf2-bc52-0861e445f05e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:33.240700 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-846f63c4-1dd1-4bf2-bc52-0861e445f05e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:33.241243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-846f63c4-1dd1-4bf2-bc52-0861e445f05e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:33.242010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-846f63c4-1dd1-4bf2-bc52-0861e445f05e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:33.242579 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-846f63c4-1dd1-4bf2-bc52-0861e445f05e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:33.243060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-846f63c4-1dd1-4bf2-bc52-0861e445f05e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:33.386304 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-846f63c4-1dd1-4bf2-bc52-0861e445f05e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:13:33.395105 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-846f63c4-1dd1-4bf2-bc52-0861e445f05e tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2" status: 200 len: 1697 microversion: 2.1 time: 0.167637 Oct 05 03:13:33.395701 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3273/6559] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:13:33 2022] GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 => generated 1697 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:13:34.418368 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-66ee8a44-8f1a-481f-829a-975a6918f24d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:13:34.418987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-66ee8a44-8f1a-481f-829a-975a6918f24d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:13:34.425985 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-66ee8a44-8f1a-481f-829a-975a6918f24d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:34.426473 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-66ee8a44-8f1a-481f-829a-975a6918f24d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:34.426912 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-66ee8a44-8f1a-481f-829a-975a6918f24d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:34.427599 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-66ee8a44-8f1a-481f-829a-975a6918f24d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:34.428051 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-66ee8a44-8f1a-481f-829a-975a6918f24d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:34.428472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-66ee8a44-8f1a-481f-829a-975a6918f24d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:34.568732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-66ee8a44-8f1a-481f-829a-975a6918f24d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:13:34.577279 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-66ee8a44-8f1a-481f-829a-975a6918f24d tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2" status: 200 len: 1697 microversion: 2.1 time: 0.162618 Oct 05 03:13:34.577886 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3287/6560] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:13:34 2022] GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:13:35.601927 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4e69400c-0bd9-4d75-9592-69980a4f9242 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:13:35.602758 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4e69400c-0bd9-4d75-9592-69980a4f9242 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:13:35.610497 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e69400c-0bd9-4d75-9592-69980a4f9242 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:35.611077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e69400c-0bd9-4d75-9592-69980a4f9242 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:35.611584 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e69400c-0bd9-4d75-9592-69980a4f9242 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:35.612348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e69400c-0bd9-4d75-9592-69980a4f9242 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:35.612875 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e69400c-0bd9-4d75-9592-69980a4f9242 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:35.613401 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e69400c-0bd9-4d75-9592-69980a4f9242 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:35.763169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4e69400c-0bd9-4d75-9592-69980a4f9242 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:13:35.773002 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4e69400c-0bd9-4d75-9592-69980a4f9242 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2" status: 200 len: 1697 microversion: 2.1 time: 0.175070 Oct 05 03:13:35.773702 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3274/6561] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:13:35 2022] GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 => generated 1697 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:13:36.795525 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-72b15043-ad0a-436f-b043-d9da3bbf1182 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:13:36.797505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-72b15043-ad0a-436f-b043-d9da3bbf1182 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:13:36.804539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72b15043-ad0a-436f-b043-d9da3bbf1182 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:36.805074 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72b15043-ad0a-436f-b043-d9da3bbf1182 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:36.805522 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72b15043-ad0a-436f-b043-d9da3bbf1182 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:36.806228 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72b15043-ad0a-436f-b043-d9da3bbf1182 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:36.806691 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72b15043-ad0a-436f-b043-d9da3bbf1182 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:36.807124 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72b15043-ad0a-436f-b043-d9da3bbf1182 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:36.950172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-72b15043-ad0a-436f-b043-d9da3bbf1182 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:13:36.959173 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-72b15043-ad0a-436f-b043-d9da3bbf1182 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2" status: 200 len: 1697 microversion: 2.1 time: 0.167541 Oct 05 03:13:36.959749 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3288/6562] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:13:36 2022] GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 => generated 1697 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:13:37.982803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-35a41096-d116-4369-8b24-86fbf53caddf tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:13:37.983372 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-35a41096-d116-4369-8b24-86fbf53caddf tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:13:37.991271 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-35a41096-d116-4369-8b24-86fbf53caddf tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:37.991800 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-35a41096-d116-4369-8b24-86fbf53caddf tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:37.992242 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-35a41096-d116-4369-8b24-86fbf53caddf tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:37.992961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-35a41096-d116-4369-8b24-86fbf53caddf tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:37.993423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-35a41096-d116-4369-8b24-86fbf53caddf tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:37.993849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-35a41096-d116-4369-8b24-86fbf53caddf tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:38.131269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-35a41096-d116-4369-8b24-86fbf53caddf tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:13:38.140761 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-35a41096-d116-4369-8b24-86fbf53caddf tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2" status: 200 len: 1682 microversion: 2.1 time: 0.161666 Oct 05 03:13:38.143555 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3275/6563] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:13:37 2022] GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:13:38.290059 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-823245ff-f55f-4822-887d-1d3cdbf345b9 req-4b005f1e-c8a1-4573-bf47-a6673eee6322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4e9743d-f24d-4704-aac9-6c2c8a3803a2", "name": "network-vif-unplugged", "status": "completed", "tag": "cf5fd187-609f-4705-8530-0f40dc651c3c"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:13:38.302511 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-823245ff-f55f-4822-887d-1d3cdbf345b9 req-4b005f1e-c8a1-4573-bf47-a6673eee6322 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:38.303113 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-823245ff-f55f-4822-887d-1d3cdbf345b9 req-4b005f1e-c8a1-4573-bf47-a6673eee6322 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:38.303666 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-823245ff-f55f-4822-887d-1d3cdbf345b9 req-4b005f1e-c8a1-4573-bf47-a6673eee6322 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:38.320093 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-823245ff-f55f-4822-887d-1d3cdbf345b9 req-4b005f1e-c8a1-4573-bf47-a6673eee6322 service nova] Creating event network-vif-unplugged:cf5fd187-609f-4705-8530-0f40dc651c3c for instance c4e9743d-f24d-4704-aac9-6c2c8a3803a2 on n-h2-858272-3 Oct 05 03:13:38.325743 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-823245ff-f55f-4822-887d-1d3cdbf345b9 req-4b005f1e-c8a1-4573-bf47-a6673eee6322 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039427 Oct 05 03:13:38.326621 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3289/6564] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:13:40.394878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-6840e97a-003a-4db9-b6df-5d99a8cd9a27 req-4f1aca15-4940-4dcc-9c1e-486221523b73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4e9743d-f24d-4704-aac9-6c2c8a3803a2", "name": "network-vif-plugged", "status": "completed", "tag": "cf5fd187-609f-4705-8530-0f40dc651c3c"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:13:40.406697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-6840e97a-003a-4db9-b6df-5d99a8cd9a27 req-4f1aca15-4940-4dcc-9c1e-486221523b73 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:13:40.407203 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-6840e97a-003a-4db9-b6df-5d99a8cd9a27 req-4f1aca15-4940-4dcc-9c1e-486221523b73 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:13:40.407837 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-6840e97a-003a-4db9-b6df-5d99a8cd9a27 req-4f1aca15-4940-4dcc-9c1e-486221523b73 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:13:40.427319 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-6840e97a-003a-4db9-b6df-5d99a8cd9a27 req-4f1aca15-4940-4dcc-9c1e-486221523b73 service nova] Creating event network-vif-plugged:cf5fd187-609f-4705-8530-0f40dc651c3c for instance c4e9743d-f24d-4704-aac9-6c2c8a3803a2 on n-h2-858272-3 Oct 05 03:13:40.432551 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-6840e97a-003a-4db9-b6df-5d99a8cd9a27 req-4f1aca15-4940-4dcc-9c1e-486221523b73 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043456 Oct 05 03:13:40.433194 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3276/6565] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:14:12.389696 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 03:14:12.390304 n-d-858272-3 devstack@n-api.service[122319]: Wed Oct 5 03:14:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2/action (ip 10.222.0.16) !!! Oct 05 03:14:12.392271 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=22 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:14:12.393132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:14:12.604424 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-904335af-094e-4a75-ad07-08ecdfbfcaee tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:14:12.607371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-904335af-094e-4a75-ad07-08ecdfbfcaee tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:14:12.613877 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-904335af-094e-4a75-ad07-08ecdfbfcaee tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:14:12.614361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-904335af-094e-4a75-ad07-08ecdfbfcaee tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:14:12.614795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-904335af-094e-4a75-ad07-08ecdfbfcaee tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:14:12.615487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-904335af-094e-4a75-ad07-08ecdfbfcaee tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:14:12.615937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-904335af-094e-4a75-ad07-08ecdfbfcaee tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:14:12.616356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-904335af-094e-4a75-ad07-08ecdfbfcaee tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:14:12.690326 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-904335af-094e-4a75-ad07-08ecdfbfcaee tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "POST /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2/action" status: 200 len: 24573 microversion: 2.1 time: 0.302441 Oct 05 03:14:12.691110 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3290/6566] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:14:12 2022] POST /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2/action => generated 24573 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 03:14:44.084282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-9df54759-27d5-414f-a7e2-b5c01ff5a03a req-0e2cb6d5-255d-46b9-9329-c874709c54b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4e9743d-f24d-4704-aac9-6c2c8a3803a2", "tag": "cf5fd187-609f-4705-8530-0f40dc651c3c"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:14:44.085392 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 05 03:14:44.087186 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 03:14:44.087186 n-d-858272-3 devstack@n-api.service[122320]: Wed Oct 5 03:14:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 (ip 10.222.0.16) !!! Oct 05 03:14:44.094329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=18 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:14:44.095101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=50 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:14:44.106234 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:14:44.106913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=4 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:14:44.108409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9774cd87-e557-43ca-8365-e2c2a1073e73 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:14:44.109068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9774cd87-e557-43ca-8365-e2c2a1073e73 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:14:44.119018 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9df54759-27d5-414f-a7e2-b5c01ff5a03a req-0e2cb6d5-255d-46b9-9329-c874709c54b8 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:14:44.119534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9df54759-27d5-414f-a7e2-b5c01ff5a03a req-0e2cb6d5-255d-46b9-9329-c874709c54b8 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:14:44.128566 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9774cd87-e557-43ca-8365-e2c2a1073e73 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:14:44.129627 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9df54759-27d5-414f-a7e2-b5c01ff5a03a req-0e2cb6d5-255d-46b9-9329-c874709c54b8 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:14:44.134691 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9774cd87-e557-43ca-8365-e2c2a1073e73 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:14:44.135768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9774cd87-e557-43ca-8365-e2c2a1073e73 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:14:44.136716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9774cd87-e557-43ca-8365-e2c2a1073e73 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:14:44.137229 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9774cd87-e557-43ca-8365-e2c2a1073e73 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:14:44.137657 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9774cd87-e557-43ca-8365-e2c2a1073e73 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:14:44.157976 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-9df54759-27d5-414f-a7e2-b5c01ff5a03a req-0e2cb6d5-255d-46b9-9329-c874709c54b8 service nova] Creating event network-changed:cf5fd187-609f-4705-8530-0f40dc651c3c for instance c4e9743d-f24d-4704-aac9-6c2c8a3803a2 on n-h2-858272-3 Oct 05 03:14:44.165947 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-9df54759-27d5-414f-a7e2-b5c01ff5a03a req-0e2cb6d5-255d-46b9-9329-c874709c54b8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086848 Oct 05 03:14:44.168407 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3291/6567] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:14:44.182281 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9774cd87-e557-43ca-8365-e2c2a1073e73 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:14:44.290433 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9774cd87-e557-43ca-8365-e2c2a1073e73 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2" status: 204 len: 0 microversion: 2.1 time: 0.214492 Oct 05 03:14:44.292220 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3277/6568] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:14:44 2022] DELETE /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 03:14:44.301041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6fd4d6ea-789a-490f-a38a-a0686b903ce3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:14:44.302012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6fd4d6ea-789a-490f-a38a-a0686b903ce3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:14:44.309642 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6fd4d6ea-789a-490f-a38a-a0686b903ce3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:14:44.310423 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6fd4d6ea-789a-490f-a38a-a0686b903ce3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:14:44.311055 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6fd4d6ea-789a-490f-a38a-a0686b903ce3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:14:44.311942 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6fd4d6ea-789a-490f-a38a-a0686b903ce3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:14:44.312561 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6fd4d6ea-789a-490f-a38a-a0686b903ce3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:14:44.313188 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6fd4d6ea-789a-490f-a38a-a0686b903ce3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:14:44.472839 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6fd4d6ea-789a-490f-a38a-a0686b903ce3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:14:44.483485 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6fd4d6ea-789a-490f-a38a-a0686b903ce3 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2" status: 200 len: 1688 microversion: 2.1 time: 0.186489 Oct 05 03:14:44.496923 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3292/6569] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:14:44 2022] GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 => generated 1688 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:14:45.508348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3586fcbc-3b8d-4cab-b7f7-acd14a37085c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:14:45.509079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3586fcbc-3b8d-4cab-b7f7-acd14a37085c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:14:45.516168 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3586fcbc-3b8d-4cab-b7f7-acd14a37085c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:14:45.516655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3586fcbc-3b8d-4cab-b7f7-acd14a37085c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:14:45.517129 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3586fcbc-3b8d-4cab-b7f7-acd14a37085c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:14:45.517825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3586fcbc-3b8d-4cab-b7f7-acd14a37085c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:14:45.518282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3586fcbc-3b8d-4cab-b7f7-acd14a37085c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:14:45.518716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3586fcbc-3b8d-4cab-b7f7-acd14a37085c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:14:45.657875 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3586fcbc-3b8d-4cab-b7f7-acd14a37085c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:14:45.665776 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3586fcbc-3b8d-4cab-b7f7-acd14a37085c tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2" status: 200 len: 1688 microversion: 2.1 time: 0.161720 Oct 05 03:14:45.667011 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3278/6570] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:14:45 2022] GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:14:46.508719 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-83452e31-418b-4c86-b87e-b20d5380fef6 req-da3bf44b-794c-4b72-8719-762a1204e28b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4e9743d-f24d-4704-aac9-6c2c8a3803a2", "name": "network-vif-deleted", "tag": "cf5fd187-609f-4705-8530-0f40dc651c3c"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:14:46.523081 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-83452e31-418b-4c86-b87e-b20d5380fef6 req-da3bf44b-794c-4b72-8719-762a1204e28b service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:14:46.523471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-83452e31-418b-4c86-b87e-b20d5380fef6 req-da3bf44b-794c-4b72-8719-762a1204e28b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:14:46.523899 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-83452e31-418b-4c86-b87e-b20d5380fef6 req-da3bf44b-794c-4b72-8719-762a1204e28b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:14:46.537185 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-83452e31-418b-4c86-b87e-b20d5380fef6 req-da3bf44b-794c-4b72-8719-762a1204e28b service nova] Creating event network-vif-deleted:cf5fd187-609f-4705-8530-0f40dc651c3c for instance c4e9743d-f24d-4704-aac9-6c2c8a3803a2 on n-h2-858272-3 Oct 05 03:14:46.544063 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-83452e31-418b-4c86-b87e-b20d5380fef6 req-da3bf44b-794c-4b72-8719-762a1204e28b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038968 Oct 05 03:14:46.545211 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3293/6571] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:14:46.688998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e221068f-5634-4b14-9b72-328210318eab tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:14:46.689680 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e221068f-5634-4b14-9b72-328210318eab tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:14:46.696497 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e221068f-5634-4b14-9b72-328210318eab tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:14:46.697125 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e221068f-5634-4b14-9b72-328210318eab tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:14:46.697627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e221068f-5634-4b14-9b72-328210318eab tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:14:46.698387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e221068f-5634-4b14-9b72-328210318eab tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:14:46.698934 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e221068f-5634-4b14-9b72-328210318eab tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:14:46.699586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e221068f-5634-4b14-9b72-328210318eab tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:14:46.734622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e221068f-5634-4b14-9b72-328210318eab tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:14:46.735110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e221068f-5634-4b14-9b72-328210318eab tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:14:46.735543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e221068f-5634-4b14-9b72-328210318eab tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:14:46.735998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-e221068f-5634-4b14-9b72-328210318eab tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lazy-loading 'fault' on Instance uuid c4e9743d-f24d-4704-aac9-6c2c8a3803a2 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:14:46.782718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e221068f-5634-4b14-9b72-328210318eab tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a53da0c764f0a893966aea6505fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86e3137c6764eeb948b9c7dab895c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:14:46.791924 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e221068f-5634-4b14-9b72-328210318eab tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2" status: 200 len: 1355 microversion: 2.1 time: 0.106002 Oct 05 03:14:46.792776 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3279/6572] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:14:46 2022] GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 => generated 1355 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:14:47.815264 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-41ec92b6-0ca0-49cd-9e53-89a1ca02cfcd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:14:47.815907 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-41ec92b6-0ca0-49cd-9e53-89a1ca02cfcd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] [instance: c4e9743d-f24d-4704-aac9-6c2c8a3803a2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:14:47.823996 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41ec92b6-0ca0-49cd-9e53-89a1ca02cfcd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:14:47.824488 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41ec92b6-0ca0-49cd-9e53-89a1ca02cfcd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:14:47.824954 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41ec92b6-0ca0-49cd-9e53-89a1ca02cfcd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:14:47.825680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41ec92b6-0ca0-49cd-9e53-89a1ca02cfcd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:14:47.826166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41ec92b6-0ca0-49cd-9e53-89a1ca02cfcd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:14:47.826594 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-41ec92b6-0ca0-49cd-9e53-89a1ca02cfcd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:14:47.840752 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-41ec92b6-0ca0-49cd-9e53-89a1ca02cfcd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] HTTP exception thrown: Instance c4e9743d-f24d-4704-aac9-6c2c8a3803a2 could not be found. Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-41ec92b6-0ca0-49cd-9e53-89a1ca02cfcd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Request method failure captured: Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 HTTP/1.1 Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPQQaPdY80Cpcj7cnlUwviGOgibF1hELwwBhNlNnP0MqbdNiw25tncanzi7qWvBbOvFGmFxbhq_pYUvMd-n-xjmhM4x8o5emmLCp2GN5-d1zUtR_w4L-Z_KZTshYbgGB04rNkRVV36r2lGPYux6FzpfN97MB3YiAErpveqwDREaePkw Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: a86e3137c6764eeb948b9c7dab895c34 Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-344873080 Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a86e3137c6764eeb948b9c7dab895c34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a86e3137c6764eeb948b9c7dab895c34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a86e3137c6764eeb948b9c7dab895c34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a86e3137c6764eeb948b9c7dab895c34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TestNetworkAdvancedServerOps-344873080 Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: a86e3137c6764eeb948b9c7dab895c34 Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-344873080 Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TestNetworkAdvancedServerOps-344873080-project Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: ad3a53da0c764f0a893966aea6505fa7 Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TestNetworkAdvancedServerOps-344873080-project Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance c4e9743d-f24d-4704-aac9-6c2c8a3803a2 could not be found. Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'c4e9743d-f24d-4704-aac9-6c2c8a3803a2'} Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4e9743d-f24d-4704-aac9-6c2c8a3803a2 could not be found. Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4e9743d-f24d-4704-aac9-6c2c8a3803a2 could not be found. Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:14:47.842408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:14:47.851549 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:14:47.851549 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:14:47.851549 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:14:47.851549 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:14:47.851549 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:14:47.851549 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:14:47.851549 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4e9743d-f24d-4704-aac9-6c2c8a3803a2 could not be found. Oct 05 03:14:47.851549 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:14:47.851549 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-41ec92b6-0ca0-49cd-9e53-89a1ca02cfcd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Returning 404 to user: Instance c4e9743d-f24d-4704-aac9-6c2c8a3803a2 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:14:47.851549 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-41ec92b6-0ca0-49cd-9e53-89a1ca02cfcd tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2" status: 404 len: 111 microversion: 2.1 time: 0.032820 Oct 05 03:14:47.851549 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3294/6573] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:14:47 2022] GET /compute/v2.1/servers/c4e9743d-f24d-4704-aac9-6c2c8a3803a2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:14:51.646683 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a94a4dd4-d0a2-4856-8f6b-479b529040d0 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] Calling method '.version_select at 0x7fcce816be50>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:14:51.718983 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a94a4dd4-d0a2-4856-8f6b-479b529040d0 tempest-TestNetworkAdvancedServerOps-344873080 tempest-TestNetworkAdvancedServerOps-344873080-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-964410943" status: 202 len: 0 microversion: 2.1 time: 0.083857 Oct 05 03:14:51.718983 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3280/6574] 10.222.0.16 () {58 vars in 1281 bytes} [Wed Oct 5 03:14:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-964410943 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:15:05.531346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=8 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:15:05.532130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=12 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:15:05.678586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3c5f6fb0-c71a-470f-87f0-83f290d9c4b9 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:05.680726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c5f6fb0-c71a-470f-87f0-83f290d9c4b9 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:05.681418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c5f6fb0-c71a-470f-87f0-83f290d9c4b9 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:05.681931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c5f6fb0-c71a-470f-87f0-83f290d9c4b9 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:05.682919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c5f6fb0-c71a-470f-87f0-83f290d9c4b9 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:05.683480 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c5f6fb0-c71a-470f-87f0-83f290d9c4b9 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:05.684146 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c5f6fb0-c71a-470f-87f0-83f290d9c4b9 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:05.712073 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3c5f6fb0-c71a-470f-87f0-83f290d9c4b9 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.185147 Oct 05 03:15:05.720497 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3295/6575] 10.222.0.16 () {58 vars in 1185 bytes} [Wed Oct 5 03:15:05 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:15:05.839531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:15:05.841022 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:15:05.846400 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2b41304d-08d6-4069-922d-01a5c6ba12de tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1758231413", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "availability_zone": "nova:n-h1-858272-3", "networks": [{"uuid": "31015f7a-bceb-418a-8e70-e4531aea87ab"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:15:05.956227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-2b41304d-08d6-4069-922d-01a5c6ba12de tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] validate_networks() for [('31015f7a-bceb-418a-8e70-e4531aea87ab', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:15:06.508462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-2b41304d-08d6-4069-922d-01a5c6ba12de tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:15:06.509344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-2b41304d-08d6-4069-922d-01a5c6ba12de tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:15:06.510029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-2b41304d-08d6-4069-922d-01a5c6ba12de tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:15:06.510446 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-2b41304d-08d6-4069-922d-01a5c6ba12de tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:15:06.510863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-2b41304d-08d6-4069-922d-01a5c6ba12de tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:15:06.522485 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b41304d-08d6-4069-922d-01a5c6ba12de tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:06.523224 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b41304d-08d6-4069-922d-01a5c6ba12de tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:06.524646 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b41304d-08d6-4069-922d-01a5c6ba12de tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:06.525712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b41304d-08d6-4069-922d-01a5c6ba12de tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:06.526559 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b41304d-08d6-4069-922d-01a5c6ba12de tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:06.526999 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b41304d-08d6-4069-922d-01a5c6ba12de tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:06.546675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-2b41304d-08d6-4069-922d-01a5c6ba12de tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Getting quotas for project f6a21383a93d439a930235e08ca9bffc. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:15:06.552036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-2b41304d-08d6-4069-922d-01a5c6ba12de tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Getting quotas for user 2f912483147f473cbdbe2a2e0cf49136 and project f6a21383a93d439a930235e08ca9bffc. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:15:06.565521 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2b41304d-08d6-4069-922d-01a5c6ba12de tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:15:06.567916 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2b41304d-08d6-4069-922d-01a5c6ba12de tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 1ea69362-f67b-43f6-bd01-8115aff64fe4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:15:06.620591 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2b41304d-08d6-4069-922d-01a5c6ba12de tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.783847 Oct 05 03:15:06.621287 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3281/6576] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:15:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 03:15:06.632459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8fe41c5f-0fc2-4da4-8d34-73902c137f6f tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:06.633817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8fe41c5f-0fc2-4da4-8d34-73902c137f6f tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 1ea69362-f67b-43f6-bd01-8115aff64fe4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:06.702921 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8fe41c5f-0fc2-4da4-8d34-73902c137f6f tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4" status: 200 len: 1329 microversion: 2.1 time: 0.074305 Oct 05 03:15:06.703581 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3296/6577] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:06 2022] GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4 => generated 1329 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:07.727433 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fa02f8b6-6b65-4f07-a32d-cace49d9cd62 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:07.729604 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fa02f8b6-6b65-4f07-a32d-cace49d9cd62 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 1ea69362-f67b-43f6-bd01-8115aff64fe4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:07.826766 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fa02f8b6-6b65-4f07-a32d-cace49d9cd62 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4" status: 200 len: 1329 microversion: 2.1 time: 0.104611 Oct 05 03:15:07.827924 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3282/6578] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:07 2022] GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4 => generated 1329 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:08.854613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cb308947-25e0-4d4f-a08e-7e0fc57ba8c4 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:08.855492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cb308947-25e0-4d4f-a08e-7e0fc57ba8c4 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 1ea69362-f67b-43f6-bd01-8115aff64fe4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:08.866513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb308947-25e0-4d4f-a08e-7e0fc57ba8c4 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:08.868145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb308947-25e0-4d4f-a08e-7e0fc57ba8c4 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:08.868977 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb308947-25e0-4d4f-a08e-7e0fc57ba8c4 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:08.869951 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb308947-25e0-4d4f-a08e-7e0fc57ba8c4 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:08.870414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb308947-25e0-4d4f-a08e-7e0fc57ba8c4 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:08.871046 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cb308947-25e0-4d4f-a08e-7e0fc57ba8c4 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:08.966662 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cb308947-25e0-4d4f-a08e-7e0fc57ba8c4 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4" status: 200 len: 1346 microversion: 2.1 time: 0.116419 Oct 05 03:15:08.984118 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3297/6579] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:08 2022] GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4 => generated 1346 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:09.989219 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-afa8e6e7-61e9-46e3-8592-dcbce7e764e9 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:09.990069 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-afa8e6e7-61e9-46e3-8592-dcbce7e764e9 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 1ea69362-f67b-43f6-bd01-8115aff64fe4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:09.999228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afa8e6e7-61e9-46e3-8592-dcbce7e764e9 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:09.999684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afa8e6e7-61e9-46e3-8592-dcbce7e764e9 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:10.000393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afa8e6e7-61e9-46e3-8592-dcbce7e764e9 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:10.001172 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afa8e6e7-61e9-46e3-8592-dcbce7e764e9 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:10.002704 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afa8e6e7-61e9-46e3-8592-dcbce7e764e9 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:10.002704 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-afa8e6e7-61e9-46e3-8592-dcbce7e764e9 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:10.079358 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-afa8e6e7-61e9-46e3-8592-dcbce7e764e9 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4" status: 200 len: 1416 microversion: 2.1 time: 0.094203 Oct 05 03:15:10.080318 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3283/6580] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:09 2022] GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4 => generated 1416 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:11.103680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-81a527fc-c993-4c43-a016-4e0b3dc28d30 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:11.105287 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-81a527fc-c993-4c43-a016-4e0b3dc28d30 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 1ea69362-f67b-43f6-bd01-8115aff64fe4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:11.121854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81a527fc-c993-4c43-a016-4e0b3dc28d30 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:11.122621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81a527fc-c993-4c43-a016-4e0b3dc28d30 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:11.123070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81a527fc-c993-4c43-a016-4e0b3dc28d30 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:11.123807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81a527fc-c993-4c43-a016-4e0b3dc28d30 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:11.124248 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81a527fc-c993-4c43-a016-4e0b3dc28d30 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:11.126695 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81a527fc-c993-4c43-a016-4e0b3dc28d30 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:11.451199 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-81a527fc-c993-4c43-a016-4e0b3dc28d30 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4" status: 200 len: 1464 microversion: 2.1 time: 0.351138 Oct 05 03:15:11.451890 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3298/6581] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:11 2022] GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4 => generated 1464 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:12.008306 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-a17860e9-f7e4-47fc-b6a7-4a174051f055 req-b3cbcee2-4b9d-4f91-9017-e0aa279640e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ea69362-f67b-43f6-bd01-8115aff64fe4", "tag": "5f96a0c5-d996-4a51-959a-fc938a2e2abb"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:15:12.018932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a17860e9-f7e4-47fc-b6a7-4a174051f055 req-b3cbcee2-4b9d-4f91-9017-e0aa279640e4 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:12.019474 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a17860e9-f7e4-47fc-b6a7-4a174051f055 req-b3cbcee2-4b9d-4f91-9017-e0aa279640e4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:12.019840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a17860e9-f7e4-47fc-b6a7-4a174051f055 req-b3cbcee2-4b9d-4f91-9017-e0aa279640e4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:12.031767 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-a17860e9-f7e4-47fc-b6a7-4a174051f055 req-b3cbcee2-4b9d-4f91-9017-e0aa279640e4 service nova] Creating event network-changed:5f96a0c5-d996-4a51-959a-fc938a2e2abb for instance 1ea69362-f67b-43f6-bd01-8115aff64fe4 on n-h1-858272-3 Oct 05 03:15:12.037732 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-a17860e9-f7e4-47fc-b6a7-4a174051f055 req-b3cbcee2-4b9d-4f91-9017-e0aa279640e4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195924 Oct 05 03:15:12.038695 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3284/6582] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:15:12.475250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-28c02d1a-29f6-43c4-8f56-a4e5a355832f tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:12.475804 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-28c02d1a-29f6-43c4-8f56-a4e5a355832f tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 1ea69362-f67b-43f6-bd01-8115aff64fe4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:12.482682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28c02d1a-29f6-43c4-8f56-a4e5a355832f tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:12.483164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28c02d1a-29f6-43c4-8f56-a4e5a355832f tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:12.483818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28c02d1a-29f6-43c4-8f56-a4e5a355832f tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:12.484509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28c02d1a-29f6-43c4-8f56-a4e5a355832f tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:12.484982 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28c02d1a-29f6-43c4-8f56-a4e5a355832f tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:12.485410 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28c02d1a-29f6-43c4-8f56-a4e5a355832f tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:12.623371 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-28c02d1a-29f6-43c4-8f56-a4e5a355832f tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4" status: 200 len: 1464 microversion: 2.1 time: 0.151880 Oct 05 03:15:12.623973 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3299/6583] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:12 2022] GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4 => generated 1464 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:15:13.647580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d531aa8a-8126-4e59-9b39-19dd4626ed94 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:13.649231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d531aa8a-8126-4e59-9b39-19dd4626ed94 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 1ea69362-f67b-43f6-bd01-8115aff64fe4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:13.655551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d531aa8a-8126-4e59-9b39-19dd4626ed94 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:13.656041 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d531aa8a-8126-4e59-9b39-19dd4626ed94 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:13.656486 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d531aa8a-8126-4e59-9b39-19dd4626ed94 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:13.657228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d531aa8a-8126-4e59-9b39-19dd4626ed94 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:13.657687 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d531aa8a-8126-4e59-9b39-19dd4626ed94 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:13.658109 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d531aa8a-8126-4e59-9b39-19dd4626ed94 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:13.790575 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d531aa8a-8126-4e59-9b39-19dd4626ed94 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4" status: 200 len: 1464 microversion: 2.1 time: 0.147892 Oct 05 03:15:13.791153 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3285/6584] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:13 2022] GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4 => generated 1464 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:14.813467 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-21378d5a-e8ca-40b1-8696-2eb18b8527f7 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:14.814829 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-21378d5a-e8ca-40b1-8696-2eb18b8527f7 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 1ea69362-f67b-43f6-bd01-8115aff64fe4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:14.822278 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-21378d5a-e8ca-40b1-8696-2eb18b8527f7 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:14.822765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-21378d5a-e8ca-40b1-8696-2eb18b8527f7 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:14.823199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-21378d5a-e8ca-40b1-8696-2eb18b8527f7 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:14.823893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-21378d5a-e8ca-40b1-8696-2eb18b8527f7 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:14.824476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-21378d5a-e8ca-40b1-8696-2eb18b8527f7 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:14.824922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-21378d5a-e8ca-40b1-8696-2eb18b8527f7 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:14.983846 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-21378d5a-e8ca-40b1-8696-2eb18b8527f7 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4" status: 200 len: 1464 microversion: 2.1 time: 0.173958 Oct 05 03:15:14.984740 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3300/6585] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:14 2022] GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4 => generated 1464 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:16.008221 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-749d260a-968a-4af1-a8a0-345ea811fdb7 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:16.008966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-749d260a-968a-4af1-a8a0-345ea811fdb7 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 1ea69362-f67b-43f6-bd01-8115aff64fe4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:16.015947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-749d260a-968a-4af1-a8a0-345ea811fdb7 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:16.016440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-749d260a-968a-4af1-a8a0-345ea811fdb7 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:16.016885 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-749d260a-968a-4af1-a8a0-345ea811fdb7 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:16.017594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-749d260a-968a-4af1-a8a0-345ea811fdb7 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:16.018055 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-749d260a-968a-4af1-a8a0-345ea811fdb7 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:16.018484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-749d260a-968a-4af1-a8a0-345ea811fdb7 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:16.174192 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-749d260a-968a-4af1-a8a0-345ea811fdb7 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4" status: 200 len: 1464 microversion: 2.1 time: 0.170246 Oct 05 03:15:16.175189 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3286/6586] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:16 2022] GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4 => generated 1464 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:17.201951 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9a9c0d85-ec7f-4f7e-b4e0-16e4fbad45e8 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:17.202592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9a9c0d85-ec7f-4f7e-b4e0-16e4fbad45e8 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 1ea69362-f67b-43f6-bd01-8115aff64fe4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:17.204480 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:15:17.206001 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:15:17.212160 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a9c0d85-ec7f-4f7e-b4e0-16e4fbad45e8 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:17.212650 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a9c0d85-ec7f-4f7e-b4e0-16e4fbad45e8 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:17.213115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a9c0d85-ec7f-4f7e-b4e0-16e4fbad45e8 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:17.213814 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a9c0d85-ec7f-4f7e-b4e0-16e4fbad45e8 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:17.214270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a9c0d85-ec7f-4f7e-b4e0-16e4fbad45e8 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:17.214754 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a9c0d85-ec7f-4f7e-b4e0-16e4fbad45e8 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:17.351673 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9a9c0d85-ec7f-4f7e-b4e0-16e4fbad45e8 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4" status: 200 len: 1464 microversion: 2.1 time: 0.152795 Oct 05 03:15:17.352411 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3301/6587] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:17 2022] GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4 => generated 1464 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:15:18.378783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-859aaede-03dd-4557-baec-b707e88fcf52 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:18.379924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-859aaede-03dd-4557-baec-b707e88fcf52 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 1ea69362-f67b-43f6-bd01-8115aff64fe4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:18.389484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:15:18.393587 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=8 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:15:18.401758 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-859aaede-03dd-4557-baec-b707e88fcf52 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:18.405891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-859aaede-03dd-4557-baec-b707e88fcf52 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:18.410234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-859aaede-03dd-4557-baec-b707e88fcf52 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:18.412982 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-859aaede-03dd-4557-baec-b707e88fcf52 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:18.418014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-859aaede-03dd-4557-baec-b707e88fcf52 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:18.419900 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-859aaede-03dd-4557-baec-b707e88fcf52 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:18.589172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-3f619971-e110-43df-999a-7f83fa0315ce req-de751e15-d44d-4fa5-872c-ab9d8cd7b70b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ea69362-f67b-43f6-bd01-8115aff64fe4", "name": "network-vif-plugged", "status": "completed", "tag": "5f96a0c5-d996-4a51-959a-fc938a2e2abb"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:15:18.600392 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-3f619971-e110-43df-999a-7f83fa0315ce req-de751e15-d44d-4fa5-872c-ab9d8cd7b70b service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:18.601133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-3f619971-e110-43df-999a-7f83fa0315ce req-de751e15-d44d-4fa5-872c-ab9d8cd7b70b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:18.601821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-3f619971-e110-43df-999a-7f83fa0315ce req-de751e15-d44d-4fa5-872c-ab9d8cd7b70b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:18.619114 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-3f619971-e110-43df-999a-7f83fa0315ce req-de751e15-d44d-4fa5-872c-ab9d8cd7b70b service nova] Creating event network-vif-plugged:5f96a0c5-d996-4a51-959a-fc938a2e2abb for instance 1ea69362-f67b-43f6-bd01-8115aff64fe4 on n-h1-858272-3 Oct 05 03:15:18.624478 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-3f619971-e110-43df-999a-7f83fa0315ce req-de751e15-d44d-4fa5-872c-ab9d8cd7b70b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143884 Oct 05 03:15:18.625121 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3302/6588] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:15:18.666226 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-859aaede-03dd-4557-baec-b707e88fcf52 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4" status: 200 len: 1464 microversion: 2.1 time: 0.292283 Oct 05 03:15:18.682033 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3287/6589] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:18 2022] GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4 => generated 1464 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:19.692924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dcedb767-fed0-4e8e-9ee9-693b11f16694 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:19.693639 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-dcedb767-fed0-4e8e-9ee9-693b11f16694 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 1ea69362-f67b-43f6-bd01-8115aff64fe4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:19.700292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dcedb767-fed0-4e8e-9ee9-693b11f16694 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:19.700781 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dcedb767-fed0-4e8e-9ee9-693b11f16694 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:19.701256 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dcedb767-fed0-4e8e-9ee9-693b11f16694 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:19.701952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dcedb767-fed0-4e8e-9ee9-693b11f16694 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:19.702411 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dcedb767-fed0-4e8e-9ee9-693b11f16694 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:19.702840 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dcedb767-fed0-4e8e-9ee9-693b11f16694 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:19.841623 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-dcedb767-fed0-4e8e-9ee9-693b11f16694 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4" status: 200 len: 1464 microversion: 2.1 time: 0.153630 Oct 05 03:15:19.842205 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3303/6590] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:19 2022] GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4 => generated 1464 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:20.867006 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-25861a32-16ad-4c5e-81e5-a4d095a386a3 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:20.867793 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-25861a32-16ad-4c5e-81e5-a4d095a386a3 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 1ea69362-f67b-43f6-bd01-8115aff64fe4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:20.874652 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25861a32-16ad-4c5e-81e5-a4d095a386a3 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:20.875225 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25861a32-16ad-4c5e-81e5-a4d095a386a3 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:20.875762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25861a32-16ad-4c5e-81e5-a4d095a386a3 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:20.876535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25861a32-16ad-4c5e-81e5-a4d095a386a3 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:20.877107 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25861a32-16ad-4c5e-81e5-a4d095a386a3 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:20.877611 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25861a32-16ad-4c5e-81e5-a4d095a386a3 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:21.009051 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-25861a32-16ad-4c5e-81e5-a4d095a386a3 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4" status: 200 len: 1649 microversion: 2.1 time: 0.146336 Oct 05 03:15:21.009895 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3288/6591] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:20 2022] GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4 => generated 1649 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:21.031990 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d017e5a1-64ac-4cf4-a4f5-f6855eabc08d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:21.032615 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d017e5a1-64ac-4cf4-a4f5-f6855eabc08d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 1ea69362-f67b-43f6-bd01-8115aff64fe4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:21.040504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d017e5a1-64ac-4cf4-a4f5-f6855eabc08d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:21.041017 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d017e5a1-64ac-4cf4-a4f5-f6855eabc08d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:21.041648 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d017e5a1-64ac-4cf4-a4f5-f6855eabc08d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:21.042362 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d017e5a1-64ac-4cf4-a4f5-f6855eabc08d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:21.042821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d017e5a1-64ac-4cf4-a4f5-f6855eabc08d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:21.043255 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d017e5a1-64ac-4cf4-a4f5-f6855eabc08d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:21.203970 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d017e5a1-64ac-4cf4-a4f5-f6855eabc08d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4" status: 200 len: 1649 microversion: 2.1 time: 0.175608 Oct 05 03:15:21.204663 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3304/6592] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:21 2022] GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4 => generated 1649 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:21.226721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5e5ec25a-a1f3-4587-aedc-d59fe1e06de0 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:21.227341 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5e5ec25a-a1f3-4587-aedc-d59fe1e06de0 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 1ea69362-f67b-43f6-bd01-8115aff64fe4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:21.233599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e5ec25a-a1f3-4587-aedc-d59fe1e06de0 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:21.234066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e5ec25a-a1f3-4587-aedc-d59fe1e06de0 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:21.234507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e5ec25a-a1f3-4587-aedc-d59fe1e06de0 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:21.235209 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e5ec25a-a1f3-4587-aedc-d59fe1e06de0 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:21.235672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e5ec25a-a1f3-4587-aedc-d59fe1e06de0 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:21.236096 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e5ec25a-a1f3-4587-aedc-d59fe1e06de0 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:21.371871 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5e5ec25a-a1f3-4587-aedc-d59fe1e06de0 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4" status: 200 len: 1649 microversion: 2.1 time: 0.148968 Oct 05 03:15:21.372838 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3289/6593] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:21 2022] GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4 => generated 1649 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:21.442459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-074a76de-c981-4566-967d-fc2a321d0f5d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1571054729", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "availability_zone": "nova:n-h2-858272-3", "networks": [{"uuid": "31015f7a-bceb-418a-8e70-e4531aea87ab"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:15:21.505162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-074a76de-c981-4566-967d-fc2a321d0f5d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] validate_networks() for [('31015f7a-bceb-418a-8e70-e4531aea87ab', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:15:21.939565 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-074a76de-c981-4566-967d-fc2a321d0f5d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:15:21.939990 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-074a76de-c981-4566-967d-fc2a321d0f5d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:15:21.940499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-074a76de-c981-4566-967d-fc2a321d0f5d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:15:21.940941 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-074a76de-c981-4566-967d-fc2a321d0f5d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:15:21.941361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-074a76de-c981-4566-967d-fc2a321d0f5d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:15:21.951790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-074a76de-c981-4566-967d-fc2a321d0f5d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:21.952281 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-074a76de-c981-4566-967d-fc2a321d0f5d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:21.952720 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-074a76de-c981-4566-967d-fc2a321d0f5d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:21.953678 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-074a76de-c981-4566-967d-fc2a321d0f5d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:21.954145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-074a76de-c981-4566-967d-fc2a321d0f5d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:21.954574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-074a76de-c981-4566-967d-fc2a321d0f5d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:21.977935 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-074a76de-c981-4566-967d-fc2a321d0f5d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Getting quotas for project f6a21383a93d439a930235e08ca9bffc. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:15:21.983617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-074a76de-c981-4566-967d-fc2a321d0f5d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Getting quotas for user 2f912483147f473cbdbe2a2e0cf49136 and project f6a21383a93d439a930235e08ca9bffc. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:15:21.997332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-074a76de-c981-4566-967d-fc2a321d0f5d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:15:21.999663 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-074a76de-c981-4566-967d-fc2a321d0f5d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 217ce30c-f930-4c3f-ad1e-d14d746d317d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:15:22.046050 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-074a76de-c981-4566-967d-fc2a321d0f5d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607289 Oct 05 03:15:22.046982 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3305/6594] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:15:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:15:22.058284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9ed84e35-3369-449e-bd7d-77320edcadec tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:22.058905 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9ed84e35-3369-449e-bd7d-77320edcadec tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 217ce30c-f930-4c3f-ad1e-d14d746d317d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:22.120863 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9ed84e35-3369-449e-bd7d-77320edcadec tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d" status: 200 len: 1329 microversion: 2.1 time: 0.066945 Oct 05 03:15:22.121462 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3290/6595] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:22 2022] GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d => generated 1329 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:15:23.146468 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-351c3a87-178a-482e-a649-943aafb6ea4d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:23.147747 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-351c3a87-178a-482e-a649-943aafb6ea4d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 217ce30c-f930-4c3f-ad1e-d14d746d317d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:23.171020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-351c3a87-178a-482e-a649-943aafb6ea4d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:23.171677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-351c3a87-178a-482e-a649-943aafb6ea4d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:23.173061 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-351c3a87-178a-482e-a649-943aafb6ea4d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:23.173924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-351c3a87-178a-482e-a649-943aafb6ea4d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:23.176185 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-351c3a87-178a-482e-a649-943aafb6ea4d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:23.177344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-351c3a87-178a-482e-a649-943aafb6ea4d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:23.269527 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-351c3a87-178a-482e-a649-943aafb6ea4d tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d" status: 200 len: 1424 microversion: 2.1 time: 0.125679 Oct 05 03:15:23.270217 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3306/6596] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:23 2022] GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d => generated 1424 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:24.293731 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bb15e0cb-b496-42c0-92a6-dd8b9d39fc3c tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:24.294933 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bb15e0cb-b496-42c0-92a6-dd8b9d39fc3c tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 217ce30c-f930-4c3f-ad1e-d14d746d317d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:24.302493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb15e0cb-b496-42c0-92a6-dd8b9d39fc3c tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:24.302956 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb15e0cb-b496-42c0-92a6-dd8b9d39fc3c tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:24.303391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb15e0cb-b496-42c0-92a6-dd8b9d39fc3c tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:24.304091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb15e0cb-b496-42c0-92a6-dd8b9d39fc3c tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:24.305303 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb15e0cb-b496-42c0-92a6-dd8b9d39fc3c tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:24.305962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb15e0cb-b496-42c0-92a6-dd8b9d39fc3c tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:24.453112 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bb15e0cb-b496-42c0-92a6-dd8b9d39fc3c tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d" status: 200 len: 1464 microversion: 2.1 time: 0.162931 Oct 05 03:15:24.453960 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3291/6597] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:24 2022] GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d => generated 1464 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:24.747962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-79136cfe-e8dd-4d89-969c-f7ab60b82d91 req-e16db9a3-5f3c-43dd-90e9-841df5764c53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "217ce30c-f930-4c3f-ad1e-d14d746d317d", "tag": "8619f46c-5db3-453b-8e62-d0df56599f48"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:15:24.766606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-79136cfe-e8dd-4d89-969c-f7ab60b82d91 req-e16db9a3-5f3c-43dd-90e9-841df5764c53 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:24.767092 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-79136cfe-e8dd-4d89-969c-f7ab60b82d91 req-e16db9a3-5f3c-43dd-90e9-841df5764c53 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:24.767682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-79136cfe-e8dd-4d89-969c-f7ab60b82d91 req-e16db9a3-5f3c-43dd-90e9-841df5764c53 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:24.779549 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-79136cfe-e8dd-4d89-969c-f7ab60b82d91 req-e16db9a3-5f3c-43dd-90e9-841df5764c53 service nova] Creating event network-changed:8619f46c-5db3-453b-8e62-d0df56599f48 for instance 217ce30c-f930-4c3f-ad1e-d14d746d317d on n-h2-858272-3 Oct 05 03:15:24.785007 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-79136cfe-e8dd-4d89-969c-f7ab60b82d91 req-e16db9a3-5f3c-43dd-90e9-841df5764c53 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047233 Oct 05 03:15:24.785789 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3307/6598] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:15:25.477806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1b9c5ac5-3694-451e-a2ea-d5785ccf2e73 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:25.478656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1b9c5ac5-3694-451e-a2ea-d5785ccf2e73 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 217ce30c-f930-4c3f-ad1e-d14d746d317d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:25.485966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b9c5ac5-3694-451e-a2ea-d5785ccf2e73 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:25.486604 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b9c5ac5-3694-451e-a2ea-d5785ccf2e73 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:25.487166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b9c5ac5-3694-451e-a2ea-d5785ccf2e73 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:25.487976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b9c5ac5-3694-451e-a2ea-d5785ccf2e73 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:25.488574 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b9c5ac5-3694-451e-a2ea-d5785ccf2e73 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:25.489140 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b9c5ac5-3694-451e-a2ea-d5785ccf2e73 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:25.623193 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1b9c5ac5-3694-451e-a2ea-d5785ccf2e73 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d" status: 200 len: 1464 microversion: 2.1 time: 0.150179 Oct 05 03:15:25.623773 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3292/6599] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:25 2022] GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d => generated 1464 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:26.232340 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8d053b9c-c0b1-4c18-935a-96281d4ac915 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1604080883", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:15:26.283024 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-8d053b9c-c0b1-4c18-935a-96281d4ac915 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] validate_networks() for None {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:15:26.472471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-8d053b9c-c0b1-4c18-935a-96281d4ac915 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:15:26.472892 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-8d053b9c-c0b1-4c18-935a-96281d4ac915 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:15:26.473438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-8d053b9c-c0b1-4c18-935a-96281d4ac915 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:15:26.473845 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-8d053b9c-c0b1-4c18-935a-96281d4ac915 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:15:26.474251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-8d053b9c-c0b1-4c18-935a-96281d4ac915 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:15:26.483797 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d053b9c-c0b1-4c18-935a-96281d4ac915 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:26.484637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d053b9c-c0b1-4c18-935a-96281d4ac915 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:26.485119 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d053b9c-c0b1-4c18-935a-96281d4ac915 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:26.485841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d053b9c-c0b1-4c18-935a-96281d4ac915 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:26.486297 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d053b9c-c0b1-4c18-935a-96281d4ac915 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:26.486718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d053b9c-c0b1-4c18-935a-96281d4ac915 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:26.503816 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-8d053b9c-c0b1-4c18-935a-96281d4ac915 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Getting quotas for project 08d3a8fbab994baa993e2e4b20a9df43. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:15:26.509107 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-8d053b9c-c0b1-4c18-935a-96281d4ac915 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Getting quotas for user a9aa70e1e7424553a51aa91e215b093e and project 08d3a8fbab994baa993e2e4b20a9df43. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:15:26.521143 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8d053b9c-c0b1-4c18-935a-96281d4ac915 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:15:26.523997 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8d053b9c-c0b1-4c18-935a-96281d4ac915 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] [instance: 46b1b62d-520a-4894-b676-aa76862b3ae6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:15:26.568178 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8d053b9c-c0b1-4c18-935a-96281d4ac915 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.341359 Oct 05 03:15:26.568838 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3308/6600] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:15:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 343 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 03:15:26.579903 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-45a5bd5d-75c0-4744-bb5c-7b9a87fcf4a1 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:26.580513 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-45a5bd5d-75c0-4744-bb5c-7b9a87fcf4a1 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] [instance: 46b1b62d-520a-4894-b676-aa76862b3ae6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:26.641391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-45a5bd5d-75c0-4744-bb5c-7b9a87fcf4a1 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9aa70e1e7424553a51aa91e215b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d3a8fbab994baa993e2e4b20a9df43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:15:26.646001 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1fbd89a6-71c4-40cc-b5a0-f97a26c96fab tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:26.646720 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1fbd89a6-71c4-40cc-b5a0-f97a26c96fab tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 217ce30c-f930-4c3f-ad1e-d14d746d317d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:26.650268 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-45a5bd5d-75c0-4744-bb5c-7b9a87fcf4a1 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] 10.222.0.16 "GET /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6" status: 200 len: 1215 microversion: 2.1 time: 0.074145 Oct 05 03:15:26.651147 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3293/6601] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:26 2022] GET /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6 => generated 1215 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:26.660569 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1fbd89a6-71c4-40cc-b5a0-f97a26c96fab tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:26.660569 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1fbd89a6-71c4-40cc-b5a0-f97a26c96fab tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:26.660569 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1fbd89a6-71c4-40cc-b5a0-f97a26c96fab tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:26.660569 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1fbd89a6-71c4-40cc-b5a0-f97a26c96fab tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:26.660569 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1fbd89a6-71c4-40cc-b5a0-f97a26c96fab tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:26.660569 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1fbd89a6-71c4-40cc-b5a0-f97a26c96fab tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:26.789614 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1fbd89a6-71c4-40cc-b5a0-f97a26c96fab tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d" status: 200 len: 1464 microversion: 2.1 time: 0.147204 Oct 05 03:15:26.790303 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3309/6602] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:26 2022] GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d => generated 1464 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:15:27.673687 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-36c0682b-5ff8-4b3d-bfc1-8c9e7ba3be44 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:27.674322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-36c0682b-5ff8-4b3d-bfc1-8c9e7ba3be44 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] [instance: 46b1b62d-520a-4894-b676-aa76862b3ae6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:27.682980 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36c0682b-5ff8-4b3d-bfc1-8c9e7ba3be44 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:27.683479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36c0682b-5ff8-4b3d-bfc1-8c9e7ba3be44 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:27.683916 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36c0682b-5ff8-4b3d-bfc1-8c9e7ba3be44 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:27.684772 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36c0682b-5ff8-4b3d-bfc1-8c9e7ba3be44 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:27.685263 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36c0682b-5ff8-4b3d-bfc1-8c9e7ba3be44 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:27.685695 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36c0682b-5ff8-4b3d-bfc1-8c9e7ba3be44 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:27.753008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-36c0682b-5ff8-4b3d-bfc1-8c9e7ba3be44 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9aa70e1e7424553a51aa91e215b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d3a8fbab994baa993e2e4b20a9df43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:15:27.761111 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-36c0682b-5ff8-4b3d-bfc1-8c9e7ba3be44 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] 10.222.0.16 "GET /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6" status: 200 len: 1211 microversion: 2.1 time: 0.091271 Oct 05 03:15:27.761784 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3294/6603] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:27 2022] GET /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6 => generated 1211 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:27.812801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bf06f4ff-ba58-4acb-b2b4-13b4c2323652 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:27.813484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bf06f4ff-ba58-4acb-b2b4-13b4c2323652 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 217ce30c-f930-4c3f-ad1e-d14d746d317d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:27.820169 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf06f4ff-ba58-4acb-b2b4-13b4c2323652 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:27.820643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf06f4ff-ba58-4acb-b2b4-13b4c2323652 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:27.821116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf06f4ff-ba58-4acb-b2b4-13b4c2323652 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:27.821986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf06f4ff-ba58-4acb-b2b4-13b4c2323652 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:27.822595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf06f4ff-ba58-4acb-b2b4-13b4c2323652 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:27.823033 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf06f4ff-ba58-4acb-b2b4-13b4c2323652 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:27.967802 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bf06f4ff-ba58-4acb-b2b4-13b4c2323652 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d" status: 200 len: 1464 microversion: 2.1 time: 0.158828 Oct 05 03:15:27.968387 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3310/6604] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:27 2022] GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d => generated 1464 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:28.786301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-506f41b9-1819-4913-9649-7009bad6f589 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:28.786833 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-506f41b9-1819-4913-9649-7009bad6f589 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] [instance: 46b1b62d-520a-4894-b676-aa76862b3ae6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:28.796246 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-506f41b9-1819-4913-9649-7009bad6f589 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:28.796743 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-506f41b9-1819-4913-9649-7009bad6f589 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:28.797420 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-506f41b9-1819-4913-9649-7009bad6f589 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:28.798137 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-506f41b9-1819-4913-9649-7009bad6f589 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:28.798596 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-506f41b9-1819-4913-9649-7009bad6f589 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:28.799026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-506f41b9-1819-4913-9649-7009bad6f589 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:28.875071 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-506f41b9-1819-4913-9649-7009bad6f589 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9aa70e1e7424553a51aa91e215b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d3a8fbab994baa993e2e4b20a9df43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:15:28.884617 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-506f41b9-1819-4913-9649-7009bad6f589 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] 10.222.0.16 "GET /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6" status: 200 len: 1273 microversion: 2.1 time: 0.103342 Oct 05 03:15:28.885249 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3295/6605] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:28 2022] GET /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6 => generated 1273 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:28.990982 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-68910e7d-f552-4f93-8497-f2cea0359762 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:28.991604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-68910e7d-f552-4f93-8497-f2cea0359762 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 217ce30c-f930-4c3f-ad1e-d14d746d317d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:28.998741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68910e7d-f552-4f93-8497-f2cea0359762 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:28.999247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68910e7d-f552-4f93-8497-f2cea0359762 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:28.999679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68910e7d-f552-4f93-8497-f2cea0359762 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:29.000370 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68910e7d-f552-4f93-8497-f2cea0359762 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:29.000820 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68910e7d-f552-4f93-8497-f2cea0359762 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:29.001264 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68910e7d-f552-4f93-8497-f2cea0359762 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:29.223371 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-68910e7d-f552-4f93-8497-f2cea0359762 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d" status: 200 len: 1464 microversion: 2.1 time: 0.235967 Oct 05 03:15:29.237641 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3311/6606] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:28 2022] GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d => generated 1464 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:29.909456 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c948062f-01f9-45c8-8408-92019ec3b386 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:29.910081 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c948062f-01f9-45c8-8408-92019ec3b386 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] [instance: 46b1b62d-520a-4894-b676-aa76862b3ae6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:29.917466 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c948062f-01f9-45c8-8408-92019ec3b386 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:29.917971 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c948062f-01f9-45c8-8408-92019ec3b386 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:29.918412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c948062f-01f9-45c8-8408-92019ec3b386 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:29.919111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c948062f-01f9-45c8-8408-92019ec3b386 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:29.919571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c948062f-01f9-45c8-8408-92019ec3b386 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:29.920000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c948062f-01f9-45c8-8408-92019ec3b386 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:30.154235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c948062f-01f9-45c8-8408-92019ec3b386 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9aa70e1e7424553a51aa91e215b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d3a8fbab994baa993e2e4b20a9df43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:15:30.162018 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c948062f-01f9-45c8-8408-92019ec3b386 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] 10.222.0.16 "GET /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6" status: 200 len: 1315 microversion: 2.1 time: 0.256525 Oct 05 03:15:30.162955 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3296/6607] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:29 2022] GET /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:30.248315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-94b6a38f-2fc9-4fef-9a5d-2422d0feedab tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:30.248938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-94b6a38f-2fc9-4fef-9a5d-2422d0feedab tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 217ce30c-f930-4c3f-ad1e-d14d746d317d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:30.255716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94b6a38f-2fc9-4fef-9a5d-2422d0feedab tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:30.256192 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94b6a38f-2fc9-4fef-9a5d-2422d0feedab tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:30.256627 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94b6a38f-2fc9-4fef-9a5d-2422d0feedab tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:30.258050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94b6a38f-2fc9-4fef-9a5d-2422d0feedab tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:30.258538 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94b6a38f-2fc9-4fef-9a5d-2422d0feedab tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:30.258960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94b6a38f-2fc9-4fef-9a5d-2422d0feedab tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:30.366525 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-807f0a13-7dd1-42e9-a70b-215d844d6ce1 req-a8c63d34-b795-4989-acf7-8761769b26ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46b1b62d-520a-4894-b676-aa76862b3ae6", "tag": "148f5bd2-883e-4b8f-964a-8a3cf6805fc3"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:15:30.378362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-807f0a13-7dd1-42e9-a70b-215d844d6ce1 req-a8c63d34-b795-4989-acf7-8761769b26ca service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:30.378930 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-807f0a13-7dd1-42e9-a70b-215d844d6ce1 req-a8c63d34-b795-4989-acf7-8761769b26ca service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:30.379424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-807f0a13-7dd1-42e9-a70b-215d844d6ce1 req-a8c63d34-b795-4989-acf7-8761769b26ca service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:30.392446 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-807f0a13-7dd1-42e9-a70b-215d844d6ce1 req-a8c63d34-b795-4989-acf7-8761769b26ca service nova] Creating event network-changed:148f5bd2-883e-4b8f-964a-8a3cf6805fc3 for instance 46b1b62d-520a-4894-b676-aa76862b3ae6 on n-h2-858272-3 Oct 05 03:15:30.397343 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-807f0a13-7dd1-42e9-a70b-215d844d6ce1 req-a8c63d34-b795-4989-acf7-8761769b26ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034940 Oct 05 03:15:30.397950 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3297/6608] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:15:30.486164 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-94b6a38f-2fc9-4fef-9a5d-2422d0feedab tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d" status: 200 len: 1464 microversion: 2.1 time: 0.241474 Oct 05 03:15:30.486743 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3312/6609] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:30 2022] GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d => generated 1464 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:30.775146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-4b3f9e0e-1d7c-4c5f-9970-f1d5ac846778 req-9359be7b-02f8-4f8c-80c9-7ffa78da4069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "217ce30c-f930-4c3f-ad1e-d14d746d317d", "name": "network-vif-plugged", "status": "completed", "tag": "8619f46c-5db3-453b-8e62-d0df56599f48"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:15:30.788149 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4b3f9e0e-1d7c-4c5f-9970-f1d5ac846778 req-9359be7b-02f8-4f8c-80c9-7ffa78da4069 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:30.789504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4b3f9e0e-1d7c-4c5f-9970-f1d5ac846778 req-9359be7b-02f8-4f8c-80c9-7ffa78da4069 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:30.790151 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4b3f9e0e-1d7c-4c5f-9970-f1d5ac846778 req-9359be7b-02f8-4f8c-80c9-7ffa78da4069 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:30.802211 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-4b3f9e0e-1d7c-4c5f-9970-f1d5ac846778 req-9359be7b-02f8-4f8c-80c9-7ffa78da4069 service nova] Creating event network-vif-plugged:8619f46c-5db3-453b-8e62-d0df56599f48 for instance 217ce30c-f930-4c3f-ad1e-d14d746d317d on n-h2-858272-3 Oct 05 03:15:30.808204 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-4b3f9e0e-1d7c-4c5f-9970-f1d5ac846778 req-9359be7b-02f8-4f8c-80c9-7ffa78da4069 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038184 Oct 05 03:15:30.808892 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3298/6610] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:15:31.184912 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a68029aa-3eaa-4d42-8d96-1524eebb2ab1 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:31.185554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a68029aa-3eaa-4d42-8d96-1524eebb2ab1 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] [instance: 46b1b62d-520a-4894-b676-aa76862b3ae6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:31.191511 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a68029aa-3eaa-4d42-8d96-1524eebb2ab1 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:31.191993 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a68029aa-3eaa-4d42-8d96-1524eebb2ab1 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:31.192429 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a68029aa-3eaa-4d42-8d96-1524eebb2ab1 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:31.193150 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a68029aa-3eaa-4d42-8d96-1524eebb2ab1 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:31.193606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a68029aa-3eaa-4d42-8d96-1524eebb2ab1 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:31.194030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a68029aa-3eaa-4d42-8d96-1524eebb2ab1 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:31.327114 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a68029aa-3eaa-4d42-8d96-1524eebb2ab1 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9aa70e1e7424553a51aa91e215b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d3a8fbab994baa993e2e4b20a9df43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:15:31.334725 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a68029aa-3eaa-4d42-8d96-1524eebb2ab1 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] 10.222.0.16 "GET /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6" status: 200 len: 1315 microversion: 2.1 time: 0.153714 Oct 05 03:15:31.335361 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3313/6611] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:31 2022] GET /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:31.510306 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-29ebefed-1a62-45eb-9525-af3fc6a4b01b tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:31.510928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-29ebefed-1a62-45eb-9525-af3fc6a4b01b tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 217ce30c-f930-4c3f-ad1e-d14d746d317d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:31.517983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29ebefed-1a62-45eb-9525-af3fc6a4b01b tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:31.518465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29ebefed-1a62-45eb-9525-af3fc6a4b01b tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:31.518897 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29ebefed-1a62-45eb-9525-af3fc6a4b01b tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:31.519600 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29ebefed-1a62-45eb-9525-af3fc6a4b01b tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:31.520071 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29ebefed-1a62-45eb-9525-af3fc6a4b01b tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:31.520614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29ebefed-1a62-45eb-9525-af3fc6a4b01b tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:31.650455 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-29ebefed-1a62-45eb-9525-af3fc6a4b01b tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d" status: 200 len: 1464 microversion: 2.1 time: 0.144817 Oct 05 03:15:31.651040 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3299/6612] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:31 2022] GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d => generated 1464 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:32.358222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-06de082d-3d3d-481e-aa14-db1ba4fcd9e8 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:32.358743 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-06de082d-3d3d-481e-aa14-db1ba4fcd9e8 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] [instance: 46b1b62d-520a-4894-b676-aa76862b3ae6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:32.365593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06de082d-3d3d-481e-aa14-db1ba4fcd9e8 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:32.366078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06de082d-3d3d-481e-aa14-db1ba4fcd9e8 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:32.366516 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06de082d-3d3d-481e-aa14-db1ba4fcd9e8 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:32.367457 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06de082d-3d3d-481e-aa14-db1ba4fcd9e8 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:32.367913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06de082d-3d3d-481e-aa14-db1ba4fcd9e8 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:32.368335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06de082d-3d3d-481e-aa14-db1ba4fcd9e8 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:32.502742 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-06de082d-3d3d-481e-aa14-db1ba4fcd9e8 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9aa70e1e7424553a51aa91e215b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d3a8fbab994baa993e2e4b20a9df43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:15:32.510680 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-06de082d-3d3d-481e-aa14-db1ba4fcd9e8 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] 10.222.0.16 "GET /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6" status: 200 len: 1315 microversion: 2.1 time: 0.156419 Oct 05 03:15:32.511245 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3314/6613] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:32 2022] GET /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:32.673584 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4f0528ea-fd46-4044-a99a-dbba19fd9bf2 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:32.674203 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4f0528ea-fd46-4044-a99a-dbba19fd9bf2 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 217ce30c-f930-4c3f-ad1e-d14d746d317d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:32.681233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f0528ea-fd46-4044-a99a-dbba19fd9bf2 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:32.681708 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f0528ea-fd46-4044-a99a-dbba19fd9bf2 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:32.682145 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f0528ea-fd46-4044-a99a-dbba19fd9bf2 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:32.682829 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f0528ea-fd46-4044-a99a-dbba19fd9bf2 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:32.683287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f0528ea-fd46-4044-a99a-dbba19fd9bf2 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:32.683709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f0528ea-fd46-4044-a99a-dbba19fd9bf2 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:32.805394 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4f0528ea-fd46-4044-a99a-dbba19fd9bf2 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d" status: 200 len: 1464 microversion: 2.1 time: 0.135471 Oct 05 03:15:32.805980 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3300/6614] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:32 2022] GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d => generated 1464 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:33.533800 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6bd8320d-3db3-4c32-bb20-eac4b1fe16aa tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:33.534415 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6bd8320d-3db3-4c32-bb20-eac4b1fe16aa tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] [instance: 46b1b62d-520a-4894-b676-aa76862b3ae6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:33.542034 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6bd8320d-3db3-4c32-bb20-eac4b1fe16aa tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:33.542519 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6bd8320d-3db3-4c32-bb20-eac4b1fe16aa tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:33.542953 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6bd8320d-3db3-4c32-bb20-eac4b1fe16aa tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:33.543638 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6bd8320d-3db3-4c32-bb20-eac4b1fe16aa tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:33.544090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6bd8320d-3db3-4c32-bb20-eac4b1fe16aa tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:33.544509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6bd8320d-3db3-4c32-bb20-eac4b1fe16aa tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:33.676844 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6bd8320d-3db3-4c32-bb20-eac4b1fe16aa tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9aa70e1e7424553a51aa91e215b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d3a8fbab994baa993e2e4b20a9df43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:15:33.681132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:15:33.686097 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6bd8320d-3db3-4c32-bb20-eac4b1fe16aa tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] 10.222.0.16 "GET /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6" status: 200 len: 1315 microversion: 2.1 time: 0.156174 Oct 05 03:15:33.686681 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3315/6615] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:33 2022] GET /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:33.828324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d337b39d-cbe7-4031-a7d3-193403be0f0e tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:33.829011 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d337b39d-cbe7-4031-a7d3-193403be0f0e tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 217ce30c-f930-4c3f-ad1e-d14d746d317d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:33.835861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d337b39d-cbe7-4031-a7d3-193403be0f0e tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:33.836352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d337b39d-cbe7-4031-a7d3-193403be0f0e tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:33.837306 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d337b39d-cbe7-4031-a7d3-193403be0f0e tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:33.837993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d337b39d-cbe7-4031-a7d3-193403be0f0e tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:33.838455 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d337b39d-cbe7-4031-a7d3-193403be0f0e tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:33.838883 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d337b39d-cbe7-4031-a7d3-193403be0f0e tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:34.035781 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d337b39d-cbe7-4031-a7d3-193403be0f0e tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d" status: 200 len: 1464 microversion: 2.1 time: 0.211052 Oct 05 03:15:34.036362 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3301/6616] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:33 2022] GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d => generated 1464 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:34.708509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a61b25fd-4868-4e9e-922d-c29b1431d274 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:34.709189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a61b25fd-4868-4e9e-922d-c29b1431d274 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] [instance: 46b1b62d-520a-4894-b676-aa76862b3ae6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:34.716806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a61b25fd-4868-4e9e-922d-c29b1431d274 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:34.717348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a61b25fd-4868-4e9e-922d-c29b1431d274 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:34.717792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a61b25fd-4868-4e9e-922d-c29b1431d274 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:34.718517 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a61b25fd-4868-4e9e-922d-c29b1431d274 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:34.718980 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a61b25fd-4868-4e9e-922d-c29b1431d274 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:34.719413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a61b25fd-4868-4e9e-922d-c29b1431d274 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:34.857195 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a61b25fd-4868-4e9e-922d-c29b1431d274 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9aa70e1e7424553a51aa91e215b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d3a8fbab994baa993e2e4b20a9df43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:15:34.865235 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a61b25fd-4868-4e9e-922d-c29b1431d274 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] 10.222.0.16 "GET /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6" status: 200 len: 1315 microversion: 2.1 time: 0.160829 Oct 05 03:15:34.865816 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3316/6617] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:34 2022] GET /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:35.059199 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1a28d87a-9201-4015-9425-c567bbfb5141 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:35.059818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1a28d87a-9201-4015-9425-c567bbfb5141 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 217ce30c-f930-4c3f-ad1e-d14d746d317d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:35.066738 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a28d87a-9201-4015-9425-c567bbfb5141 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:35.067263 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a28d87a-9201-4015-9425-c567bbfb5141 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:35.067695 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a28d87a-9201-4015-9425-c567bbfb5141 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:35.068378 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a28d87a-9201-4015-9425-c567bbfb5141 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:35.068821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a28d87a-9201-4015-9425-c567bbfb5141 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:35.069274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1a28d87a-9201-4015-9425-c567bbfb5141 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:35.198764 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1a28d87a-9201-4015-9425-c567bbfb5141 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d" status: 200 len: 1650 microversion: 2.1 time: 0.143874 Oct 05 03:15:35.199491 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3302/6618] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:35 2022] GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d => generated 1650 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:35.222352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b8406a24-5249-4ad0-9092-3a228d690475 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:35.222963 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b8406a24-5249-4ad0-9092-3a228d690475 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 217ce30c-f930-4c3f-ad1e-d14d746d317d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:35.229515 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8406a24-5249-4ad0-9092-3a228d690475 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:35.229996 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8406a24-5249-4ad0-9092-3a228d690475 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:35.230426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8406a24-5249-4ad0-9092-3a228d690475 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:35.231109 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8406a24-5249-4ad0-9092-3a228d690475 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:35.231557 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8406a24-5249-4ad0-9092-3a228d690475 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:35.231980 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b8406a24-5249-4ad0-9092-3a228d690475 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:35.363715 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b8406a24-5249-4ad0-9092-3a228d690475 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d" status: 200 len: 1650 microversion: 2.1 time: 0.145080 Oct 05 03:15:35.364321 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3317/6619] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:35 2022] GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d => generated 1650 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:35.385774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3607bb1b-4734-4f1d-aab9-0bcea74e80f4 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:35.386422 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3607bb1b-4734-4f1d-aab9-0bcea74e80f4 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 217ce30c-f930-4c3f-ad1e-d14d746d317d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:35.392851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3607bb1b-4734-4f1d-aab9-0bcea74e80f4 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:35.393308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3607bb1b-4734-4f1d-aab9-0bcea74e80f4 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:35.393744 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3607bb1b-4734-4f1d-aab9-0bcea74e80f4 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:35.394438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3607bb1b-4734-4f1d-aab9-0bcea74e80f4 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:35.394892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3607bb1b-4734-4f1d-aab9-0bcea74e80f4 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:35.395317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3607bb1b-4734-4f1d-aab9-0bcea74e80f4 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:35.399847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=100 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:15:35.524723 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3607bb1b-4734-4f1d-aab9-0bcea74e80f4 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d" status: 200 len: 1650 microversion: 2.1 time: 0.142313 Oct 05 03:15:35.525332 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3303/6620] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:35 2022] GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d => generated 1650 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:35.547222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0b4842e6-57b3-424b-ad2b-a29f9134eb0e tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:35.547729 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0b4842e6-57b3-424b-ad2b-a29f9134eb0e tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 217ce30c-f930-4c3f-ad1e-d14d746d317d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:35.549675 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:15:35.554986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b4842e6-57b3-424b-ad2b-a29f9134eb0e tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:35.555507 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b4842e6-57b3-424b-ad2b-a29f9134eb0e tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:35.555950 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b4842e6-57b3-424b-ad2b-a29f9134eb0e tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:35.556677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b4842e6-57b3-424b-ad2b-a29f9134eb0e tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:35.557169 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b4842e6-57b3-424b-ad2b-a29f9134eb0e tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:35.557600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0b4842e6-57b3-424b-ad2b-a29f9134eb0e tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:35.590547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0b4842e6-57b3-424b-ad2b-a29f9134eb0e tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 217ce30c-f930-4c3f-ad1e-d14d746d317d] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:15:35.665160 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0b4842e6-57b3-424b-ad2b-a29f9134eb0e tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d" status: 204 len: 0 microversion: 2.1 time: 0.121258 Oct 05 03:15:35.666068 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3318/6621] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:15:35 2022] DELETE /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 03:15:35.674411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d7b1e0e2-5a66-4f3d-b2d3-3362163e1225 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:35.675038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d7b1e0e2-5a66-4f3d-b2d3-3362163e1225 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 217ce30c-f930-4c3f-ad1e-d14d746d317d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:35.681301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7b1e0e2-5a66-4f3d-b2d3-3362163e1225 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:35.681791 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7b1e0e2-5a66-4f3d-b2d3-3362163e1225 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:35.682227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7b1e0e2-5a66-4f3d-b2d3-3362163e1225 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:35.682918 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7b1e0e2-5a66-4f3d-b2d3-3362163e1225 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:35.683392 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7b1e0e2-5a66-4f3d-b2d3-3362163e1225 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:35.683819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7b1e0e2-5a66-4f3d-b2d3-3362163e1225 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:35.810385 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d7b1e0e2-5a66-4f3d-b2d3-3362163e1225 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d" status: 200 len: 1656 microversion: 2.1 time: 0.139620 Oct 05 03:15:35.811010 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3304/6622] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:35 2022] GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d => generated 1656 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:15:35.890854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b0d94e3d-3595-4c02-8fef-95ef330d90e7 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:35.891554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b0d94e3d-3595-4c02-8fef-95ef330d90e7 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] [instance: 46b1b62d-520a-4894-b676-aa76862b3ae6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:35.898354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0d94e3d-3595-4c02-8fef-95ef330d90e7 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:35.898854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0d94e3d-3595-4c02-8fef-95ef330d90e7 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:35.899895 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0d94e3d-3595-4c02-8fef-95ef330d90e7 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:35.900586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0d94e3d-3595-4c02-8fef-95ef330d90e7 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:35.901057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0d94e3d-3595-4c02-8fef-95ef330d90e7 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:35.901481 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0d94e3d-3595-4c02-8fef-95ef330d90e7 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:36.031871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b0d94e3d-3595-4c02-8fef-95ef330d90e7 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9aa70e1e7424553a51aa91e215b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d3a8fbab994baa993e2e4b20a9df43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:15:36.039455 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b0d94e3d-3595-4c02-8fef-95ef330d90e7 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] 10.222.0.16 "GET /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6" status: 200 len: 1315 microversion: 2.1 time: 0.152862 Oct 05 03:15:36.040107 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3319/6623] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:35 2022] GET /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:36.792165 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-13475f7e-dfb4-4d65-b207-b229f85ba90f req-d42a9a1f-0e7d-42f8-87d0-e268097f3280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46b1b62d-520a-4894-b676-aa76862b3ae6", "name": "network-vif-plugged", "status": "completed", "tag": "148f5bd2-883e-4b8f-964a-8a3cf6805fc3"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:15:36.797926 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:15:36.798594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:15:36.806324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-13475f7e-dfb4-4d65-b207-b229f85ba90f req-d42a9a1f-0e7d-42f8-87d0-e268097f3280 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:36.806817 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-13475f7e-dfb4-4d65-b207-b229f85ba90f req-d42a9a1f-0e7d-42f8-87d0-e268097f3280 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:36.807252 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-13475f7e-dfb4-4d65-b207-b229f85ba90f req-d42a9a1f-0e7d-42f8-87d0-e268097f3280 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:36.821695 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-13475f7e-dfb4-4d65-b207-b229f85ba90f req-d42a9a1f-0e7d-42f8-87d0-e268097f3280 service nova] Creating event network-vif-plugged:148f5bd2-883e-4b8f-964a-8a3cf6805fc3 for instance 46b1b62d-520a-4894-b676-aa76862b3ae6 on n-h2-858272-3 Oct 05 03:15:36.828837 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-13475f7e-dfb4-4d65-b207-b229f85ba90f req-d42a9a1f-0e7d-42f8-87d0-e268097f3280 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040610 Oct 05 03:15:36.829847 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3305/6624] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:15:36.834534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d920b2cf-d7f9-49a6-bb7c-fbdcc1323cd5 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:36.835332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d920b2cf-d7f9-49a6-bb7c-fbdcc1323cd5 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 217ce30c-f930-4c3f-ad1e-d14d746d317d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:36.838070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=4 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:15:36.838745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=12 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:15:36.844849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d920b2cf-d7f9-49a6-bb7c-fbdcc1323cd5 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:36.845370 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d920b2cf-d7f9-49a6-bb7c-fbdcc1323cd5 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:36.845811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d920b2cf-d7f9-49a6-bb7c-fbdcc1323cd5 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:36.846590 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d920b2cf-d7f9-49a6-bb7c-fbdcc1323cd5 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:36.847046 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d920b2cf-d7f9-49a6-bb7c-fbdcc1323cd5 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:36.847471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d920b2cf-d7f9-49a6-bb7c-fbdcc1323cd5 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:36.986837 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d920b2cf-d7f9-49a6-bb7c-fbdcc1323cd5 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d" status: 200 len: 1656 microversion: 2.1 time: 0.156259 Oct 05 03:15:36.987424 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3320/6625] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:36 2022] GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d => generated 1656 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:15:37.063283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d14d88f9-636e-4e2e-a4c5-a2951e20fdfc tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:37.063985 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d14d88f9-636e-4e2e-a4c5-a2951e20fdfc tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] [instance: 46b1b62d-520a-4894-b676-aa76862b3ae6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:37.069946 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d14d88f9-636e-4e2e-a4c5-a2951e20fdfc tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:37.070448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d14d88f9-636e-4e2e-a4c5-a2951e20fdfc tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:37.071059 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d14d88f9-636e-4e2e-a4c5-a2951e20fdfc tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:37.071750 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d14d88f9-636e-4e2e-a4c5-a2951e20fdfc tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:37.072202 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d14d88f9-636e-4e2e-a4c5-a2951e20fdfc tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:37.072626 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d14d88f9-636e-4e2e-a4c5-a2951e20fdfc tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:37.266409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d14d88f9-636e-4e2e-a4c5-a2951e20fdfc tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9aa70e1e7424553a51aa91e215b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d3a8fbab994baa993e2e4b20a9df43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:15:37.275036 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d14d88f9-636e-4e2e-a4c5-a2951e20fdfc tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] 10.222.0.16 "GET /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6" status: 200 len: 1315 microversion: 2.1 time: 0.216093 Oct 05 03:15:37.275611 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3306/6626] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:37 2022] GET /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:38.010671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6c34466e-5686-4836-a1ee-9411ba5da981 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:38.011291 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6c34466e-5686-4836-a1ee-9411ba5da981 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 217ce30c-f930-4c3f-ad1e-d14d746d317d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:38.018176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c34466e-5686-4836-a1ee-9411ba5da981 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:38.018666 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c34466e-5686-4836-a1ee-9411ba5da981 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:38.019105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c34466e-5686-4836-a1ee-9411ba5da981 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:38.019796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c34466e-5686-4836-a1ee-9411ba5da981 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:38.020251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c34466e-5686-4836-a1ee-9411ba5da981 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:38.020681 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6c34466e-5686-4836-a1ee-9411ba5da981 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:38.246405 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6c34466e-5686-4836-a1ee-9411ba5da981 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d" status: 200 len: 1656 microversion: 2.1 time: 0.239356 Oct 05 03:15:38.246991 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3321/6627] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:38 2022] GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d => generated 1656 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:38.297620 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e0518e19-0fd9-4da2-a76d-d58cfa314bcf tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:38.298250 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e0518e19-0fd9-4da2-a76d-d58cfa314bcf tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] [instance: 46b1b62d-520a-4894-b676-aa76862b3ae6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:38.305821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0518e19-0fd9-4da2-a76d-d58cfa314bcf tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:38.306339 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0518e19-0fd9-4da2-a76d-d58cfa314bcf tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:38.306792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0518e19-0fd9-4da2-a76d-d58cfa314bcf tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:38.307503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0518e19-0fd9-4da2-a76d-d58cfa314bcf tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:38.307964 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0518e19-0fd9-4da2-a76d-d58cfa314bcf tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:38.308398 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0518e19-0fd9-4da2-a76d-d58cfa314bcf tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:38.493685 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e0518e19-0fd9-4da2-a76d-d58cfa314bcf tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9aa70e1e7424553a51aa91e215b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d3a8fbab994baa993e2e4b20a9df43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:15:38.502284 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e0518e19-0fd9-4da2-a76d-d58cfa314bcf tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] 10.222.0.16 "GET /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6" status: 200 len: 1315 microversion: 2.1 time: 0.208521 Oct 05 03:15:38.502873 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3307/6628] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:38 2022] GET /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:38.580368 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-8b510820-c3f6-4e08-8de1-96345aa96a02 req-2e2f0ad2-c1ad-47f4-80a8-60e2bc661211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "217ce30c-f930-4c3f-ad1e-d14d746d317d", "name": "network-vif-deleted", "tag": "8619f46c-5db3-453b-8e62-d0df56599f48"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:15:38.614517 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-8b510820-c3f6-4e08-8de1-96345aa96a02 req-2e2f0ad2-c1ad-47f4-80a8-60e2bc661211 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:38.615342 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-8b510820-c3f6-4e08-8de1-96345aa96a02 req-2e2f0ad2-c1ad-47f4-80a8-60e2bc661211 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:38.615975 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-8b510820-c3f6-4e08-8de1-96345aa96a02 req-2e2f0ad2-c1ad-47f4-80a8-60e2bc661211 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:38.629347 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-8b510820-c3f6-4e08-8de1-96345aa96a02 req-2e2f0ad2-c1ad-47f4-80a8-60e2bc661211 service nova] Creating event network-vif-deleted:8619f46c-5db3-453b-8e62-d0df56599f48 for instance 217ce30c-f930-4c3f-ad1e-d14d746d317d on n-h2-858272-3 Oct 05 03:15:38.634886 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-8b510820-c3f6-4e08-8de1-96345aa96a02 req-2e2f0ad2-c1ad-47f4-80a8-60e2bc661211 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058626 Oct 05 03:15:38.636274 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3322/6629] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:15:39.270718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4f43e099-a3d6-4e76-abf9-b3ff28a09906 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:39.271256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4f43e099-a3d6-4e76-abf9-b3ff28a09906 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 217ce30c-f930-4c3f-ad1e-d14d746d317d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:39.277606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f43e099-a3d6-4e76-abf9-b3ff28a09906 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:39.278094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f43e099-a3d6-4e76-abf9-b3ff28a09906 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:39.278547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f43e099-a3d6-4e76-abf9-b3ff28a09906 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:39.279225 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f43e099-a3d6-4e76-abf9-b3ff28a09906 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:39.279675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f43e099-a3d6-4e76-abf9-b3ff28a09906 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:39.280094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f43e099-a3d6-4e76-abf9-b3ff28a09906 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:39.312705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f43e099-a3d6-4e76-abf9-b3ff28a09906 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:39.313418 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f43e099-a3d6-4e76-abf9-b3ff28a09906 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:39.313750 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f43e099-a3d6-4e76-abf9-b3ff28a09906 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:39.314223 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-4f43e099-a3d6-4e76-abf9-b3ff28a09906 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lazy-loading 'fault' on Instance uuid 217ce30c-f930-4c3f-ad1e-d14d746d317d {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:15:39.365430 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4f43e099-a3d6-4e76-abf9-b3ff28a09906 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d" status: 200 len: 1454 microversion: 2.1 time: 0.099718 Oct 05 03:15:39.366117 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3308/6630] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:39 2022] GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d => generated 1454 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:39.527454 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3bd420b0-7bff-415f-ae32-dfc2552a7bdb tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:39.528116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3bd420b0-7bff-415f-ae32-dfc2552a7bdb tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] [instance: 46b1b62d-520a-4894-b676-aa76862b3ae6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:39.534339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bd420b0-7bff-415f-ae32-dfc2552a7bdb tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:39.534827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bd420b0-7bff-415f-ae32-dfc2552a7bdb tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:39.535266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bd420b0-7bff-415f-ae32-dfc2552a7bdb tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:39.535955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bd420b0-7bff-415f-ae32-dfc2552a7bdb tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:39.536411 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bd420b0-7bff-415f-ae32-dfc2552a7bdb tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:39.536842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bd420b0-7bff-415f-ae32-dfc2552a7bdb tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:39.670157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3bd420b0-7bff-415f-ae32-dfc2552a7bdb tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9aa70e1e7424553a51aa91e215b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d3a8fbab994baa993e2e4b20a9df43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:15:39.678079 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3bd420b0-7bff-415f-ae32-dfc2552a7bdb tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] 10.222.0.16 "GET /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6" status: 200 len: 1465 microversion: 2.1 time: 0.155828 Oct 05 03:15:39.678647 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3323/6631] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:39 2022] GET /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6 => generated 1465 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:15:39.724522 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f6023eab-d92e-4671-8239-ef645a212c5b tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:39.725151 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f6023eab-d92e-4671-8239-ef645a212c5b tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] [instance: 46b1b62d-520a-4894-b676-aa76862b3ae6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:39.731796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6023eab-d92e-4671-8239-ef645a212c5b tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:39.732367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6023eab-d92e-4671-8239-ef645a212c5b tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:39.732806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6023eab-d92e-4671-8239-ef645a212c5b tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:39.733524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6023eab-d92e-4671-8239-ef645a212c5b tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:39.733983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6023eab-d92e-4671-8239-ef645a212c5b tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:39.734406 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6023eab-d92e-4671-8239-ef645a212c5b tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:39.759840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f6023eab-d92e-4671-8239-ef645a212c5b tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] [instance: 46b1b62d-520a-4894-b676-aa76862b3ae6] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:15:39.832686 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f6023eab-d92e-4671-8239-ef645a212c5b tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] 10.222.0.16 "DELETE /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6" status: 204 len: 0 microversion: 2.1 time: 0.111942 Oct 05 03:15:39.833358 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3309/6632] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:15:39 2022] DELETE /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:15:39.842387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-36477611-d0b2-4f88-a840-b0a4007ea421 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:39.843000 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-36477611-d0b2-4f88-a840-b0a4007ea421 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] [instance: 46b1b62d-520a-4894-b676-aa76862b3ae6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:39.849208 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36477611-d0b2-4f88-a840-b0a4007ea421 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:39.849708 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36477611-d0b2-4f88-a840-b0a4007ea421 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:39.850123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36477611-d0b2-4f88-a840-b0a4007ea421 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:39.850804 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36477611-d0b2-4f88-a840-b0a4007ea421 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:39.851252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36477611-d0b2-4f88-a840-b0a4007ea421 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:39.851668 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36477611-d0b2-4f88-a840-b0a4007ea421 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:39.978448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-36477611-d0b2-4f88-a840-b0a4007ea421 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9aa70e1e7424553a51aa91e215b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d3a8fbab994baa993e2e4b20a9df43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:15:39.986592 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-36477611-d0b2-4f88-a840-b0a4007ea421 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] 10.222.0.16 "GET /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6" status: 200 len: 1471 microversion: 2.1 time: 0.148088 Oct 05 03:15:39.987159 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3324/6633] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:39 2022] GET /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6 => generated 1471 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:15:40.390774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-429252be-cb8e-4bb2-8573-9ef58cf70d3f tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:40.391478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-429252be-cb8e-4bb2-8573-9ef58cf70d3f tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 217ce30c-f930-4c3f-ad1e-d14d746d317d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:40.397940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-429252be-cb8e-4bb2-8573-9ef58cf70d3f tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:40.398430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-429252be-cb8e-4bb2-8573-9ef58cf70d3f tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:40.399591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-429252be-cb8e-4bb2-8573-9ef58cf70d3f tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:40.400286 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-429252be-cb8e-4bb2-8573-9ef58cf70d3f tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:40.400744 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-429252be-cb8e-4bb2-8573-9ef58cf70d3f tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:40.401197 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-429252be-cb8e-4bb2-8573-9ef58cf70d3f tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:40.414829 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-429252be-cb8e-4bb2-8573-9ef58cf70d3f tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] HTTP exception thrown: Instance 217ce30c-f930-4c3f-ad1e-d14d746d317d could not be found. Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-429252be-cb8e-4bb2-8573-9ef58cf70d3f tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Request method failure captured: Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d HTTP/1.1 Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPa5OdaRlFr-Whc3whsINv5jQZ26nQ6WBuuRxUBmIm0OC9bwcqnjG7PpnFjO0ogN3DSvL3XyCa2qOKazeBCJ9W_LMDo-aAkJS5_it2xvCo_VTWGQEL4EsgP_jDt1MWLez5pPcUJFwKILUzMDSWN794dZwFWMAae6GbkunH1M8DMBgWI Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: f6a21383a93d439a930235e08ca9bffc Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-TestServerMultinode-1560360457 Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: X-Role: admin,member,reader Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: admin,member,reader Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f6a21383a93d439a930235e08ca9bffc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f6a21383a93d439a930235e08ca9bffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f6a21383a93d439a930235e08ca9bffc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f6a21383a93d439a930235e08ca9bffc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-TestServerMultinode-1560360457 Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: f6a21383a93d439a930235e08ca9bffc Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-TestServerMultinode-1560360457 Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-TestServerMultinode-1560360457-project-admin Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 2f912483147f473cbdbe2a2e0cf49136 Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-TestServerMultinode-1560360457-project-admin Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 217ce30c-f930-4c3f-ad1e-d14d746d317d could not be found. Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '217ce30c-f930-4c3f-ad1e-d14d746d317d'} Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 217ce30c-f930-4c3f-ad1e-d14d746d317d could not be found. Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 217ce30c-f930-4c3f-ad1e-d14d746d317d could not be found. Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:15:40.416490 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:15:40.420428 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:15:40.420428 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:15:40.420428 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:15:40.420428 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:15:40.420428 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:15:40.420428 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 217ce30c-f930-4c3f-ad1e-d14d746d317d could not be found. Oct 05 03:15:40.420428 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:15:40.420428 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-429252be-cb8e-4bb2-8573-9ef58cf70d3f tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Returning 404 to user: Instance 217ce30c-f930-4c3f-ad1e-d14d746d317d could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:15:40.420428 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-429252be-cb8e-4bb2-8573-9ef58cf70d3f tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d" status: 404 len: 111 microversion: 2.1 time: 0.031220 Oct 05 03:15:40.420428 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3310/6634] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:40 2022] GET /compute/v2.1/servers/217ce30c-f930-4c3f-ad1e-d14d746d317d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:15:40.426268 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-56ebe9ed-fc65-4977-808f-1d5e4e22938c tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:40.426763 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-56ebe9ed-fc65-4977-808f-1d5e4e22938c tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 1ea69362-f67b-43f6-bd01-8115aff64fe4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:40.432684 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-56ebe9ed-fc65-4977-808f-1d5e4e22938c tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:40.433201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-56ebe9ed-fc65-4977-808f-1d5e4e22938c tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:40.433629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-56ebe9ed-fc65-4977-808f-1d5e4e22938c tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:40.434304 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-56ebe9ed-fc65-4977-808f-1d5e4e22938c tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:40.434756 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-56ebe9ed-fc65-4977-808f-1d5e4e22938c tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:40.435176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-56ebe9ed-fc65-4977-808f-1d5e4e22938c tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:40.459481 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-56ebe9ed-fc65-4977-808f-1d5e4e22938c tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 1ea69362-f67b-43f6-bd01-8115aff64fe4] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:15:40.536894 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-56ebe9ed-fc65-4977-808f-1d5e4e22938c tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4" status: 204 len: 0 microversion: 2.1 time: 0.113980 Oct 05 03:15:40.540760 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3325/6635] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:15:40 2022] DELETE /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:15:40.546546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fe031702-2943-4e48-a08d-66da0cfca3ea tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:40.547163 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fe031702-2943-4e48-a08d-66da0cfca3ea tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 1ea69362-f67b-43f6-bd01-8115aff64fe4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:40.553131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe031702-2943-4e48-a08d-66da0cfca3ea tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:40.553619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe031702-2943-4e48-a08d-66da0cfca3ea tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:40.554058 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe031702-2943-4e48-a08d-66da0cfca3ea tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:40.554747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe031702-2943-4e48-a08d-66da0cfca3ea tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:40.555869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe031702-2943-4e48-a08d-66da0cfca3ea tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:40.556315 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe031702-2943-4e48-a08d-66da0cfca3ea tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:40.686715 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fe031702-2943-4e48-a08d-66da0cfca3ea tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4" status: 200 len: 1655 microversion: 2.1 time: 0.144612 Oct 05 03:15:40.687288 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3311/6636] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:40 2022] GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4 => generated 1655 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:41.011063 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-65279c69-15bc-4c28-a8f8-31987efa22c1 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:41.011774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-65279c69-15bc-4c28-a8f8-31987efa22c1 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] [instance: 46b1b62d-520a-4894-b676-aa76862b3ae6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:41.017843 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65279c69-15bc-4c28-a8f8-31987efa22c1 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:41.018346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65279c69-15bc-4c28-a8f8-31987efa22c1 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:41.018790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65279c69-15bc-4c28-a8f8-31987efa22c1 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:41.019485 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65279c69-15bc-4c28-a8f8-31987efa22c1 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:41.019945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65279c69-15bc-4c28-a8f8-31987efa22c1 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:41.020370 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65279c69-15bc-4c28-a8f8-31987efa22c1 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:41.153863 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-65279c69-15bc-4c28-a8f8-31987efa22c1 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9aa70e1e7424553a51aa91e215b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d3a8fbab994baa993e2e4b20a9df43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:15:41.161999 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-65279c69-15bc-4c28-a8f8-31987efa22c1 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] 10.222.0.16 "GET /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6" status: 200 len: 1471 microversion: 2.1 time: 0.155927 Oct 05 03:15:41.162524 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3326/6637] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:41 2022] GET /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6 => generated 1471 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:41.710541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-07d80328-3f70-45ac-9ea1-85d9dd3f5c37 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:41.711179 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-07d80328-3f70-45ac-9ea1-85d9dd3f5c37 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 1ea69362-f67b-43f6-bd01-8115aff64fe4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:41.719002 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07d80328-3f70-45ac-9ea1-85d9dd3f5c37 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:41.719486 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07d80328-3f70-45ac-9ea1-85d9dd3f5c37 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:41.719919 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07d80328-3f70-45ac-9ea1-85d9dd3f5c37 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:41.720624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07d80328-3f70-45ac-9ea1-85d9dd3f5c37 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:41.721115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07d80328-3f70-45ac-9ea1-85d9dd3f5c37 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:41.721537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07d80328-3f70-45ac-9ea1-85d9dd3f5c37 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:41.955743 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-07d80328-3f70-45ac-9ea1-85d9dd3f5c37 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4" status: 200 len: 1655 microversion: 2.1 time: 0.248803 Oct 05 03:15:41.956416 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3312/6638] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:41 2022] GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4 => generated 1655 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:42.186409 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a9ffd2bb-f099-4052-b435-d32bcbbb6ae8 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:42.187060 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a9ffd2bb-f099-4052-b435-d32bcbbb6ae8 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] [instance: 46b1b62d-520a-4894-b676-aa76862b3ae6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:42.194193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9ffd2bb-f099-4052-b435-d32bcbbb6ae8 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:42.194685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9ffd2bb-f099-4052-b435-d32bcbbb6ae8 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:42.195286 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9ffd2bb-f099-4052-b435-d32bcbbb6ae8 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:42.196547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9ffd2bb-f099-4052-b435-d32bcbbb6ae8 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:42.197231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9ffd2bb-f099-4052-b435-d32bcbbb6ae8 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:42.197689 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9ffd2bb-f099-4052-b435-d32bcbbb6ae8 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:42.328691 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a9ffd2bb-f099-4052-b435-d32bcbbb6ae8 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9aa70e1e7424553a51aa91e215b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d3a8fbab994baa993e2e4b20a9df43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:15:42.339824 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a9ffd2bb-f099-4052-b435-d32bcbbb6ae8 tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] 10.222.0.16 "GET /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6" status: 200 len: 1429 microversion: 2.1 time: 0.157216 Oct 05 03:15:42.351167 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3327/6639] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:42 2022] GET /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6 => generated 1429 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:15:42.358893 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-b11647dc-9883-4220-a0d4-70c3fdba7631 req-d1a2e742-666c-49f3-910d-923c35a58c8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46b1b62d-520a-4894-b676-aa76862b3ae6", "name": "network-vif-deleted", "tag": "148f5bd2-883e-4b8f-964a-8a3cf6805fc3"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:15:42.372864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b11647dc-9883-4220-a0d4-70c3fdba7631 req-d1a2e742-666c-49f3-910d-923c35a58c8b service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:42.373386 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b11647dc-9883-4220-a0d4-70c3fdba7631 req-d1a2e742-666c-49f3-910d-923c35a58c8b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:42.373818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-b11647dc-9883-4220-a0d4-70c3fdba7631 req-d1a2e742-666c-49f3-910d-923c35a58c8b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:42.391826 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-b11647dc-9883-4220-a0d4-70c3fdba7631 req-d1a2e742-666c-49f3-910d-923c35a58c8b service nova] Creating event network-vif-deleted:148f5bd2-883e-4b8f-964a-8a3cf6805fc3 for instance 46b1b62d-520a-4894-b676-aa76862b3ae6 on n-h2-858272-3 Oct 05 03:15:42.397687 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-b11647dc-9883-4220-a0d4-70c3fdba7631 req-d1a2e742-666c-49f3-910d-923c35a58c8b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044586 Oct 05 03:15:42.398516 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3313/6640] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:15:42.981167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-48613a97-a2a7-44b5-a763-e82b678630ff tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:42.981825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-48613a97-a2a7-44b5-a763-e82b678630ff tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 1ea69362-f67b-43f6-bd01-8115aff64fe4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:42.989724 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48613a97-a2a7-44b5-a763-e82b678630ff tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:42.990224 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48613a97-a2a7-44b5-a763-e82b678630ff tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:42.990662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48613a97-a2a7-44b5-a763-e82b678630ff tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:42.992176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48613a97-a2a7-44b5-a763-e82b678630ff tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:42.993244 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48613a97-a2a7-44b5-a763-e82b678630ff tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:42.993672 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48613a97-a2a7-44b5-a763-e82b678630ff tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:43.286375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48613a97-a2a7-44b5-a763-e82b678630ff tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:43.287150 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48613a97-a2a7-44b5-a763-e82b678630ff tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:43.287440 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48613a97-a2a7-44b5-a763-e82b678630ff tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:43.288285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-48613a97-a2a7-44b5-a763-e82b678630ff tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lazy-loading 'fault' on Instance uuid 1ea69362-f67b-43f6-bd01-8115aff64fe4 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:15:43.337097 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-48613a97-a2a7-44b5-a763-e82b678630ff tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4" status: 200 len: 1454 microversion: 2.1 time: 0.361094 Oct 05 03:15:43.337726 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3328/6641] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:42 2022] GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4 => generated 1454 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:15:43.371076 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0b2d3c39-cc58-4faa-851a-a2d27212dcae tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:43.371779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0b2d3c39-cc58-4faa-851a-a2d27212dcae tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] [instance: 46b1b62d-520a-4894-b676-aa76862b3ae6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:43.378037 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b2d3c39-cc58-4faa-851a-a2d27212dcae tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:43.378525 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b2d3c39-cc58-4faa-851a-a2d27212dcae tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:43.378963 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b2d3c39-cc58-4faa-851a-a2d27212dcae tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:43.379650 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b2d3c39-cc58-4faa-851a-a2d27212dcae tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:43.380107 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b2d3c39-cc58-4faa-851a-a2d27212dcae tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:43.380532 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b2d3c39-cc58-4faa-851a-a2d27212dcae tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:43.396089 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-0b2d3c39-cc58-4faa-851a-a2d27212dcae tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] HTTP exception thrown: Instance 46b1b62d-520a-4894-b676-aa76862b3ae6 could not be found. Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0b2d3c39-cc58-4faa-851a-a2d27212dcae tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Request method failure captured: Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6 HTTP/1.1 Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPbMxyIJhpjMkn-VYFh_Iep5Xia2isSvwSf5F-sLJnWhVn7PpYs7irPkcvHbcdi0vMB-hRs3ckxhQodIT5DryyJH7G0lU4jQdtyPkIxTqUaZBjM122eHDPqC07j5cnoYVynGJ5PVlV9AgFwnPNxaDDW79XT0UR9sWuiGYMl6rvIad44 Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 08d3a8fbab994baa993e2e4b20a9df43 Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-VolumesNegativeTest-1655372341 Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/08d3a8fbab994baa993e2e4b20a9df43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/08d3a8fbab994baa993e2e4b20a9df43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/08d3a8fbab994baa993e2e4b20a9df43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_08d3a8fbab994baa993e2e4b20a9df43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-VolumesNegativeTest-1655372341 Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 08d3a8fbab994baa993e2e4b20a9df43 Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-VolumesNegativeTest-1655372341 Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-VolumesNegativeTest-1655372341-project Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: a9aa70e1e7424553a51aa91e215b093e Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-VolumesNegativeTest-1655372341-project Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 46b1b62d-520a-4894-b676-aa76862b3ae6 could not be found. Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '46b1b62d-520a-4894-b676-aa76862b3ae6'} Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46b1b62d-520a-4894-b676-aa76862b3ae6 could not be found. Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46b1b62d-520a-4894-b676-aa76862b3ae6 could not be found. Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:15:43.397741 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:15:43.401579 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:15:43.401579 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:15:43.401579 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:15:43.401579 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:15:43.401579 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:15:43.401579 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46b1b62d-520a-4894-b676-aa76862b3ae6 could not be found. Oct 05 03:15:43.401579 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:15:43.401579 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0b2d3c39-cc58-4faa-851a-a2d27212dcae tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] Returning 404 to user: Instance 46b1b62d-520a-4894-b676-aa76862b3ae6 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:15:43.401579 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0b2d3c39-cc58-4faa-851a-a2d27212dcae tempest-VolumesNegativeTest-1655372341 tempest-VolumesNegativeTest-1655372341-project] 10.222.0.16 "GET /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6" status: 404 len: 111 microversion: 2.1 time: 0.034247 Oct 05 03:15:43.401579 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3314/6642] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:43 2022] GET /compute/v2.1/servers/46b1b62d-520a-4894-b676-aa76862b3ae6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:15:44.361900 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c48840f6-a76a-4565-a271-fd93ec72bbc6 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:15:44.362534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c48840f6-a76a-4565-a271-fd93ec72bbc6 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] [instance: 1ea69362-f67b-43f6-bd01-8115aff64fe4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:15:44.370505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c48840f6-a76a-4565-a271-fd93ec72bbc6 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:44.371073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c48840f6-a76a-4565-a271-fd93ec72bbc6 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:44.371516 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c48840f6-a76a-4565-a271-fd93ec72bbc6 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:44.372222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c48840f6-a76a-4565-a271-fd93ec72bbc6 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:44.372995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c48840f6-a76a-4565-a271-fd93ec72bbc6 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:44.373121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c48840f6-a76a-4565-a271-fd93ec72bbc6 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:44.386724 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-c48840f6-a76a-4565-a271-fd93ec72bbc6 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] HTTP exception thrown: Instance 1ea69362-f67b-43f6-bd01-8115aff64fe4 could not be found. Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c48840f6-a76a-4565-a271-fd93ec72bbc6 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Request method failure captured: Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4 HTTP/1.1 Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPa5OdaRlFr-Whc3whsINv5jQZ26nQ6WBuuRxUBmIm0OC9bwcqnjG7PpnFjO0ogN3DSvL3XyCa2qOKazeBCJ9W_LMDo-aAkJS5_it2xvCo_VTWGQEL4EsgP_jDt1MWLez5pPcUJFwKILUzMDSWN794dZwFWMAae6GbkunH1M8DMBgWI Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: f6a21383a93d439a930235e08ca9bffc Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TestServerMultinode-1560360457 Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: X-Role: admin,member,reader Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: admin,member,reader Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f6a21383a93d439a930235e08ca9bffc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f6a21383a93d439a930235e08ca9bffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f6a21383a93d439a930235e08ca9bffc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f6a21383a93d439a930235e08ca9bffc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TestServerMultinode-1560360457 Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: f6a21383a93d439a930235e08ca9bffc Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TestServerMultinode-1560360457 Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TestServerMultinode-1560360457-project-admin Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 2f912483147f473cbdbe2a2e0cf49136 Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TestServerMultinode-1560360457-project-admin Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 1ea69362-f67b-43f6-bd01-8115aff64fe4 could not be found. Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '1ea69362-f67b-43f6-bd01-8115aff64fe4'} Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ea69362-f67b-43f6-bd01-8115aff64fe4 could not be found. Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ea69362-f67b-43f6-bd01-8115aff64fe4 could not be found. Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:15:44.388379 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:15:44.391645 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:15:44.391645 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:15:44.391645 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:15:44.391645 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:15:44.391645 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:15:44.391645 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ea69362-f67b-43f6-bd01-8115aff64fe4 could not be found. Oct 05 03:15:44.391645 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:15:44.391645 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c48840f6-a76a-4565-a271-fd93ec72bbc6 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] Returning 404 to user: Instance 1ea69362-f67b-43f6-bd01-8115aff64fe4 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:15:44.391645 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c48840f6-a76a-4565-a271-fd93ec72bbc6 tempest-TestServerMultinode-1560360457 tempest-TestServerMultinode-1560360457-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4" status: 404 len: 111 microversion: 2.1 time: 0.031879 Oct 05 03:15:44.391645 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3329/6643] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:15:44 2022] GET /compute/v2.1/servers/1ea69362-f67b-43f6-bd01-8115aff64fe4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:15:44.419548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-da3099fb-586f-46b9-a66b-1a0bd40d2b5e req-d53500f5-6a3d-44ac-bf15-aeaeb4bf66b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ea69362-f67b-43f6-bd01-8115aff64fe4", "name": "network-vif-deleted", "tag": "5f96a0c5-d996-4a51-959a-fc938a2e2abb"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:15:44.430294 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-da3099fb-586f-46b9-a66b-1a0bd40d2b5e req-d53500f5-6a3d-44ac-bf15-aeaeb4bf66b1 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:15:44.430935 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-da3099fb-586f-46b9-a66b-1a0bd40d2b5e req-d53500f5-6a3d-44ac-bf15-aeaeb4bf66b1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:15:44.431333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-da3099fb-586f-46b9-a66b-1a0bd40d2b5e req-d53500f5-6a3d-44ac-bf15-aeaeb4bf66b1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:15:44.442893 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-da3099fb-586f-46b9-a66b-1a0bd40d2b5e req-d53500f5-6a3d-44ac-bf15-aeaeb4bf66b1 service nova] Creating event network-vif-deleted:5f96a0c5-d996-4a51-959a-fc938a2e2abb for instance 1ea69362-f67b-43f6-bd01-8115aff64fe4 on n-h1-858272-3 Oct 05 03:15:44.449232 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-da3099fb-586f-46b9-a66b-1a0bd40d2b5e req-d53500f5-6a3d-44ac-bf15-aeaeb4bf66b1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032738 Oct 05 03:15:44.450249 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3315/6644] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:16:02.204594 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-44e28590-f45e-4472-9a59-297bf5484d1d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-803561561", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8ef1d2be-c702-4d73-a47b-ae569cb6d46b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fa70d413-7436-41df-9105-d3173bf249ed"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:16:02.216511 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:16:02.217308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:16:02.271296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-44e28590-f45e-4472-9a59-297bf5484d1d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] validate_networks() for [('fa70d413-7436-41df-9105-d3173bf249ed', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:16:02.645574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-44e28590-f45e-4472-9a59-297bf5484d1d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:16:02.645992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-44e28590-f45e-4472-9a59-297bf5484d1d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:16:02.646489 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-44e28590-f45e-4472-9a59-297bf5484d1d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:16:02.646893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-44e28590-f45e-4472-9a59-297bf5484d1d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:16:02.647841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-44e28590-f45e-4472-9a59-297bf5484d1d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:16:02.656922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44e28590-f45e-4472-9a59-297bf5484d1d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:02.657422 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44e28590-f45e-4472-9a59-297bf5484d1d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:02.657854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44e28590-f45e-4472-9a59-297bf5484d1d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:02.658577 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44e28590-f45e-4472-9a59-297bf5484d1d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:02.659460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44e28590-f45e-4472-9a59-297bf5484d1d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:02.659890 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44e28590-f45e-4472-9a59-297bf5484d1d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:02.678212 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-44e28590-f45e-4472-9a59-297bf5484d1d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Getting quotas for project 713e3a431a2441548123f404b23ce0da. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:16:02.683441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-44e28590-f45e-4472-9a59-297bf5484d1d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Getting quotas for user ee8daf94c54c4dd7b69310674d73211a and project 713e3a431a2441548123f404b23ce0da. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:16:02.742341 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-44e28590-f45e-4472-9a59-297bf5484d1d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:16:02.744334 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-44e28590-f45e-4472-9a59-297bf5484d1d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 33cef123-07de-4a7b-9200-a47901462512] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8ef1d2be-c702-4d73-a47b-ae569cb6d46b',volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:16:02.889833 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-44e28590-f45e-4472-9a59-297bf5484d1d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.689323 Oct 05 03:16:02.890695 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3330/6645] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:16:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:16:02.901230 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:16:02.901899 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:16:02.906221 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d38fce5e-3abf-4ba4-8b70-5c27154461c3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:02.907204 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d38fce5e-3abf-4ba4-8b70-5c27154461c3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 33cef123-07de-4a7b-9200-a47901462512] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:02.974240 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d38fce5e-3abf-4ba4-8b70-5c27154461c3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:02.982758 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d38fce5e-3abf-4ba4-8b70-5c27154461c3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512" status: 200 len: 1056 microversion: 2.1 time: 0.083906 Oct 05 03:16:02.997768 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3316/6646] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:02 2022] GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512 => generated 1056 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:04.009175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-68b97d4c-482d-4f5b-9043-c9b083efb959 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:04.009889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-68b97d4c-482d-4f5b-9043-c9b083efb959 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 33cef123-07de-4a7b-9200-a47901462512] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:04.016389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68b97d4c-482d-4f5b-9043-c9b083efb959 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:04.016924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68b97d4c-482d-4f5b-9043-c9b083efb959 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:04.017446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68b97d4c-482d-4f5b-9043-c9b083efb959 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:04.018219 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68b97d4c-482d-4f5b-9043-c9b083efb959 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:04.018862 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68b97d4c-482d-4f5b-9043-c9b083efb959 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:04.019294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-68b97d4c-482d-4f5b-9043-c9b083efb959 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:04.087737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-68b97d4c-482d-4f5b-9043-c9b083efb959 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:04.096070 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-68b97d4c-482d-4f5b-9043-c9b083efb959 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512" status: 200 len: 1154 microversion: 2.1 time: 0.092631 Oct 05 03:16:04.096639 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3331/6647] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:04 2022] GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512 => generated 1154 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:05.124061 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4534017e-56ca-4a1b-9cff-a75110ec7fc7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:05.125358 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4534017e-56ca-4a1b-9cff-a75110ec7fc7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 33cef123-07de-4a7b-9200-a47901462512] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:05.135572 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4534017e-56ca-4a1b-9cff-a75110ec7fc7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:05.136318 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4534017e-56ca-4a1b-9cff-a75110ec7fc7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:05.137024 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4534017e-56ca-4a1b-9cff-a75110ec7fc7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:05.138511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4534017e-56ca-4a1b-9cff-a75110ec7fc7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:05.139170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4534017e-56ca-4a1b-9cff-a75110ec7fc7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:05.139789 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4534017e-56ca-4a1b-9cff-a75110ec7fc7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:05.518473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4534017e-56ca-4a1b-9cff-a75110ec7fc7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:05.526705 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4534017e-56ca-4a1b-9cff-a75110ec7fc7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512" status: 200 len: 1214 microversion: 2.1 time: 0.407502 Oct 05 03:16:05.527515 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3317/6648] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:05 2022] GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512 => generated 1214 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:05.860768 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-01314a57-d417-4a97-9f5d-b94c0df1359c req-1ce9b62c-1e49-45bb-8ca6-487dfa20492e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33cef123-07de-4a7b-9200-a47901462512", "tag": "48a4c410-b022-4859-b241-053f4f40a6e9"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:16:05.878271 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-01314a57-d417-4a97-9f5d-b94c0df1359c req-1ce9b62c-1e49-45bb-8ca6-487dfa20492e service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:05.878755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-01314a57-d417-4a97-9f5d-b94c0df1359c req-1ce9b62c-1e49-45bb-8ca6-487dfa20492e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:05.879218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-01314a57-d417-4a97-9f5d-b94c0df1359c req-1ce9b62c-1e49-45bb-8ca6-487dfa20492e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:05.896042 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-01314a57-d417-4a97-9f5d-b94c0df1359c req-1ce9b62c-1e49-45bb-8ca6-487dfa20492e service nova] Creating event network-changed:48a4c410-b022-4859-b241-053f4f40a6e9 for instance 33cef123-07de-4a7b-9200-a47901462512 on n-h2-858272-3 Oct 05 03:16:05.901753 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-01314a57-d417-4a97-9f5d-b94c0df1359c req-1ce9b62c-1e49-45bb-8ca6-487dfa20492e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048826 Oct 05 03:16:05.903046 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3332/6649] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:16:06.550936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5e089e94-23db-438a-bd17-597e425acf34 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:06.551599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5e089e94-23db-438a-bd17-597e425acf34 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 33cef123-07de-4a7b-9200-a47901462512] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:06.559836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e089e94-23db-438a-bd17-597e425acf34 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:06.560263 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e089e94-23db-438a-bd17-597e425acf34 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:06.560706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e089e94-23db-438a-bd17-597e425acf34 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:06.561461 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e089e94-23db-438a-bd17-597e425acf34 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:06.561922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e089e94-23db-438a-bd17-597e425acf34 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:06.562541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e089e94-23db-438a-bd17-597e425acf34 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:06.792727 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5e089e94-23db-438a-bd17-597e425acf34 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:06.801194 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5e089e94-23db-438a-bd17-597e425acf34 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512" status: 200 len: 1214 microversion: 2.1 time: 0.254092 Oct 05 03:16:06.802005 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3318/6650] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:06 2022] GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512 => generated 1214 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:07.826084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f6041783-fd4a-4f2a-9087-42623bf58a45 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:07.826903 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f6041783-fd4a-4f2a-9087-42623bf58a45 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 33cef123-07de-4a7b-9200-a47901462512] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:07.833189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6041783-fd4a-4f2a-9087-42623bf58a45 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:07.833690 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6041783-fd4a-4f2a-9087-42623bf58a45 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:07.834136 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6041783-fd4a-4f2a-9087-42623bf58a45 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:07.835491 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6041783-fd4a-4f2a-9087-42623bf58a45 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:07.835951 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6041783-fd4a-4f2a-9087-42623bf58a45 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:07.836386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6041783-fd4a-4f2a-9087-42623bf58a45 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:07.973334 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f6041783-fd4a-4f2a-9087-42623bf58a45 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:07.982148 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f6041783-fd4a-4f2a-9087-42623bf58a45 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512" status: 200 len: 1214 microversion: 2.1 time: 0.161196 Oct 05 03:16:07.982781 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3333/6651] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:07 2022] GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512 => generated 1214 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:09.004886 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5c232c0b-3ea2-44e8-9c98-0dcd9da4e8c8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:09.005523 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5c232c0b-3ea2-44e8-9c98-0dcd9da4e8c8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 33cef123-07de-4a7b-9200-a47901462512] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:09.012450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c232c0b-3ea2-44e8-9c98-0dcd9da4e8c8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:09.012966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c232c0b-3ea2-44e8-9c98-0dcd9da4e8c8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:09.013432 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c232c0b-3ea2-44e8-9c98-0dcd9da4e8c8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:09.014105 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c232c0b-3ea2-44e8-9c98-0dcd9da4e8c8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:09.014653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c232c0b-3ea2-44e8-9c98-0dcd9da4e8c8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:09.015127 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c232c0b-3ea2-44e8-9c98-0dcd9da4e8c8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:09.486677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5c232c0b-3ea2-44e8-9c98-0dcd9da4e8c8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:09.495673 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5c232c0b-3ea2-44e8-9c98-0dcd9da4e8c8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512" status: 200 len: 1214 microversion: 2.1 time: 0.494473 Oct 05 03:16:09.496260 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3319/6652] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:08 2022] GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512 => generated 1214 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:10.520460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b4242cac-337b-4e59-8964-a13172b2fc14 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:10.521019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b4242cac-337b-4e59-8964-a13172b2fc14 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 33cef123-07de-4a7b-9200-a47901462512] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:10.528506 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4242cac-337b-4e59-8964-a13172b2fc14 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:10.529028 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4242cac-337b-4e59-8964-a13172b2fc14 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:10.529472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4242cac-337b-4e59-8964-a13172b2fc14 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:10.530197 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4242cac-337b-4e59-8964-a13172b2fc14 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:10.530660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4242cac-337b-4e59-8964-a13172b2fc14 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:10.531089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4242cac-337b-4e59-8964-a13172b2fc14 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:10.658572 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b4242cac-337b-4e59-8964-a13172b2fc14 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:10.667115 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b4242cac-337b-4e59-8964-a13172b2fc14 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512" status: 200 len: 1202 microversion: 2.1 time: 0.150500 Oct 05 03:16:10.667608 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3334/6653] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:10 2022] GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512 => generated 1202 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:11.690411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e832a77d-7107-4bbc-8ba0-1eec8978a978 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:11.691026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e832a77d-7107-4bbc-8ba0-1eec8978a978 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 33cef123-07de-4a7b-9200-a47901462512] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:11.698515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e832a77d-7107-4bbc-8ba0-1eec8978a978 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:11.699030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e832a77d-7107-4bbc-8ba0-1eec8978a978 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:11.699471 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e832a77d-7107-4bbc-8ba0-1eec8978a978 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:11.700166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e832a77d-7107-4bbc-8ba0-1eec8978a978 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:11.700628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e832a77d-7107-4bbc-8ba0-1eec8978a978 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:11.701086 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e832a77d-7107-4bbc-8ba0-1eec8978a978 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:11.831060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e832a77d-7107-4bbc-8ba0-1eec8978a978 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:11.838728 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e832a77d-7107-4bbc-8ba0-1eec8978a978 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512" status: 200 len: 1202 microversion: 2.1 time: 0.152345 Oct 05 03:16:11.839302 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3320/6654] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:11 2022] GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512 => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:12.861735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b6cd7aad-ec1a-4ca6-bbce-cceee35a25cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:12.862349 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b6cd7aad-ec1a-4ca6-bbce-cceee35a25cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 33cef123-07de-4a7b-9200-a47901462512] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:12.865203 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:16:12.866144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:16:12.871831 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b6cd7aad-ec1a-4ca6-bbce-cceee35a25cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:12.872321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b6cd7aad-ec1a-4ca6-bbce-cceee35a25cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:12.872760 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b6cd7aad-ec1a-4ca6-bbce-cceee35a25cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:12.873508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b6cd7aad-ec1a-4ca6-bbce-cceee35a25cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:12.873964 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b6cd7aad-ec1a-4ca6-bbce-cceee35a25cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:12.874392 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b6cd7aad-ec1a-4ca6-bbce-cceee35a25cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:13.002463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b6cd7aad-ec1a-4ca6-bbce-cceee35a25cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:13.010585 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b6cd7aad-ec1a-4ca6-bbce-cceee35a25cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512" status: 200 len: 1202 microversion: 2.1 time: 0.152667 Oct 05 03:16:13.011159 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3335/6655] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:12 2022] GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512 => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:14.034130 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1b55088b-c733-458e-97bb-bb3c2dc4c4bb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:14.034764 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1b55088b-c733-458e-97bb-bb3c2dc4c4bb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 33cef123-07de-4a7b-9200-a47901462512] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:14.037530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:16:14.043143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b55088b-c733-458e-97bb-bb3c2dc4c4bb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:14.043635 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b55088b-c733-458e-97bb-bb3c2dc4c4bb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:14.044070 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b55088b-c733-458e-97bb-bb3c2dc4c4bb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:14.044813 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b55088b-c733-458e-97bb-bb3c2dc4c4bb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:14.045297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b55088b-c733-458e-97bb-bb3c2dc4c4bb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:14.045722 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b55088b-c733-458e-97bb-bb3c2dc4c4bb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:14.181283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1b55088b-c733-458e-97bb-bb3c2dc4c4bb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:14.189495 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1b55088b-c733-458e-97bb-bb3c2dc4c4bb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512" status: 200 len: 1202 microversion: 2.1 time: 0.159224 Oct 05 03:16:14.190101 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3321/6656] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:14 2022] GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512 => generated 1202 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:15.214597 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ef4dc551-ff91-4d5a-8419-934f5942a882 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:15.215222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ef4dc551-ff91-4d5a-8419-934f5942a882 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 33cef123-07de-4a7b-9200-a47901462512] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:15.222351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef4dc551-ff91-4d5a-8419-934f5942a882 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:15.222844 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef4dc551-ff91-4d5a-8419-934f5942a882 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:15.223289 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef4dc551-ff91-4d5a-8419-934f5942a882 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:15.223996 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef4dc551-ff91-4d5a-8419-934f5942a882 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:15.224454 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef4dc551-ff91-4d5a-8419-934f5942a882 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:15.224884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef4dc551-ff91-4d5a-8419-934f5942a882 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:15.354221 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ef4dc551-ff91-4d5a-8419-934f5942a882 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:15.361995 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ef4dc551-ff91-4d5a-8419-934f5942a882 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512" status: 200 len: 1202 microversion: 2.1 time: 0.151326 Oct 05 03:16:15.362570 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3336/6657] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:15 2022] GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512 => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:16.385752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-df572e8f-1c98-4b0f-a329-a959b73b223d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:16.386288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-df572e8f-1c98-4b0f-a329-a959b73b223d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 33cef123-07de-4a7b-9200-a47901462512] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:16.393138 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df572e8f-1c98-4b0f-a329-a959b73b223d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:16.393617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df572e8f-1c98-4b0f-a329-a959b73b223d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:16.394046 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df572e8f-1c98-4b0f-a329-a959b73b223d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:16.394723 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df572e8f-1c98-4b0f-a329-a959b73b223d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:16.395170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df572e8f-1c98-4b0f-a329-a959b73b223d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:16.395588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df572e8f-1c98-4b0f-a329-a959b73b223d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:16.524032 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-df572e8f-1c98-4b0f-a329-a959b73b223d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:16.531580 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-df572e8f-1c98-4b0f-a329-a959b73b223d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512" status: 200 len: 1202 microversion: 2.1 time: 0.150652 Oct 05 03:16:16.532160 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3322/6658] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:16 2022] GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512 => generated 1202 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:17.554580 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1213cd1d-ab4f-4c7c-b20e-a3e33e385bf9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:17.555209 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1213cd1d-ab4f-4c7c-b20e-a3e33e385bf9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 33cef123-07de-4a7b-9200-a47901462512] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:17.562238 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1213cd1d-ab4f-4c7c-b20e-a3e33e385bf9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:17.562737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1213cd1d-ab4f-4c7c-b20e-a3e33e385bf9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:17.563187 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1213cd1d-ab4f-4c7c-b20e-a3e33e385bf9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:17.563889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1213cd1d-ab4f-4c7c-b20e-a3e33e385bf9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:17.564361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1213cd1d-ab4f-4c7c-b20e-a3e33e385bf9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:17.564786 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1213cd1d-ab4f-4c7c-b20e-a3e33e385bf9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:17.697638 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1213cd1d-ab4f-4c7c-b20e-a3e33e385bf9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:17.705438 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1213cd1d-ab4f-4c7c-b20e-a3e33e385bf9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512" status: 200 len: 1202 microversion: 2.1 time: 0.155352 Oct 05 03:16:17.706014 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3337/6659] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:17 2022] GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512 => generated 1202 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:18.728735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c5f532fb-6714-45d9-a830-5afc94c1961e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:18.729372 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c5f532fb-6714-45d9-a830-5afc94c1961e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 33cef123-07de-4a7b-9200-a47901462512] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:18.736174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5f532fb-6714-45d9-a830-5afc94c1961e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:18.736652 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5f532fb-6714-45d9-a830-5afc94c1961e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:18.737121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5f532fb-6714-45d9-a830-5afc94c1961e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:18.737799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5f532fb-6714-45d9-a830-5afc94c1961e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:18.738249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5f532fb-6714-45d9-a830-5afc94c1961e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:18.738670 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5f532fb-6714-45d9-a830-5afc94c1961e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:18.869246 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c5f532fb-6714-45d9-a830-5afc94c1961e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:18.877095 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c5f532fb-6714-45d9-a830-5afc94c1961e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512" status: 200 len: 1202 microversion: 2.1 time: 0.152235 Oct 05 03:16:18.877677 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3323/6660] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:18 2022] GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512 => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:19.030895 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-c9f77e6a-f65e-4c93-9c19-ba10554752f7 req-3c80ad5b-8eca-4ad9-8335-f2ec385ffbb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33cef123-07de-4a7b-9200-a47901462512", "name": "network-vif-plugged", "status": "completed", "tag": "48a4c410-b022-4859-b241-053f4f40a6e9"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:16:19.044451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c9f77e6a-f65e-4c93-9c19-ba10554752f7 req-3c80ad5b-8eca-4ad9-8335-f2ec385ffbb0 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:19.044451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c9f77e6a-f65e-4c93-9c19-ba10554752f7 req-3c80ad5b-8eca-4ad9-8335-f2ec385ffbb0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:19.044451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c9f77e6a-f65e-4c93-9c19-ba10554752f7 req-3c80ad5b-8eca-4ad9-8335-f2ec385ffbb0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:19.057452 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-c9f77e6a-f65e-4c93-9c19-ba10554752f7 req-3c80ad5b-8eca-4ad9-8335-f2ec385ffbb0 service nova] Creating event network-vif-plugged:48a4c410-b022-4859-b241-053f4f40a6e9 for instance 33cef123-07de-4a7b-9200-a47901462512 on n-h2-858272-3 Oct 05 03:16:19.062507 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-c9f77e6a-f65e-4c93-9c19-ba10554752f7 req-3c80ad5b-8eca-4ad9-8335-f2ec385ffbb0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035343 Oct 05 03:16:19.063115 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3338/6661] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:16:19.900743 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-90861805-21d1-44b2-81ff-e1c7318d1b7b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:19.901385 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-90861805-21d1-44b2-81ff-e1c7318d1b7b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 33cef123-07de-4a7b-9200-a47901462512] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:19.908315 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-90861805-21d1-44b2-81ff-e1c7318d1b7b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:19.908798 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-90861805-21d1-44b2-81ff-e1c7318d1b7b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:19.909294 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-90861805-21d1-44b2-81ff-e1c7318d1b7b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:19.909978 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-90861805-21d1-44b2-81ff-e1c7318d1b7b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:19.910429 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-90861805-21d1-44b2-81ff-e1c7318d1b7b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:19.910857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-90861805-21d1-44b2-81ff-e1c7318d1b7b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:20.036741 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-90861805-21d1-44b2-81ff-e1c7318d1b7b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:20.044484 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-90861805-21d1-44b2-81ff-e1c7318d1b7b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512" status: 200 len: 1202 microversion: 2.1 time: 0.148688 Oct 05 03:16:20.045081 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3324/6662] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:19 2022] GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512 => generated 1202 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:21.067278 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7e63d4cf-b223-4155-ab91-ff5625e41f5d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:21.067978 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7e63d4cf-b223-4155-ab91-ff5625e41f5d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 33cef123-07de-4a7b-9200-a47901462512] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:21.075878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e63d4cf-b223-4155-ab91-ff5625e41f5d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:21.076203 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e63d4cf-b223-4155-ab91-ff5625e41f5d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:21.076639 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e63d4cf-b223-4155-ab91-ff5625e41f5d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:21.077357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e63d4cf-b223-4155-ab91-ff5625e41f5d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:21.077811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e63d4cf-b223-4155-ab91-ff5625e41f5d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:21.078236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7e63d4cf-b223-4155-ab91-ff5625e41f5d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:21.211717 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7e63d4cf-b223-4155-ab91-ff5625e41f5d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:21.219514 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7e63d4cf-b223-4155-ab91-ff5625e41f5d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512" status: 200 len: 1389 microversion: 2.1 time: 0.156444 Oct 05 03:16:21.220084 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3339/6663] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:21 2022] GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512 => generated 1389 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:21.242440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f35f90d2-1ffa-4b0f-a121-9859e878357e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:21.243061 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f35f90d2-1ffa-4b0f-a121-9859e878357e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 33cef123-07de-4a7b-9200-a47901462512] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:21.249933 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f35f90d2-1ffa-4b0f-a121-9859e878357e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:21.250423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f35f90d2-1ffa-4b0f-a121-9859e878357e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:21.250864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f35f90d2-1ffa-4b0f-a121-9859e878357e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:21.251553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f35f90d2-1ffa-4b0f-a121-9859e878357e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:21.252009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f35f90d2-1ffa-4b0f-a121-9859e878357e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:21.252438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f35f90d2-1ffa-4b0f-a121-9859e878357e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:21.384009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f35f90d2-1ffa-4b0f-a121-9859e878357e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:21.391717 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f35f90d2-1ffa-4b0f-a121-9859e878357e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512" status: 200 len: 1389 microversion: 2.1 time: 0.153426 Oct 05 03:16:21.392293 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3325/6664] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:21 2022] GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512 => generated 1389 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:21.413765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0c58d437-b502-41b0-89df-e6db57688417 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:21.414418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0c58d437-b502-41b0-89df-e6db57688417 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 33cef123-07de-4a7b-9200-a47901462512] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:21.420289 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c58d437-b502-41b0-89df-e6db57688417 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:21.420777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c58d437-b502-41b0-89df-e6db57688417 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:21.421253 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c58d437-b502-41b0-89df-e6db57688417 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:21.421939 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c58d437-b502-41b0-89df-e6db57688417 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:21.422393 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c58d437-b502-41b0-89df-e6db57688417 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:21.422815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c58d437-b502-41b0-89df-e6db57688417 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:21.552161 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0c58d437-b502-41b0-89df-e6db57688417 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:21.560697 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0c58d437-b502-41b0-89df-e6db57688417 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512" status: 200 len: 1389 microversion: 2.1 time: 0.151486 Oct 05 03:16:21.561315 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3340/6665] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:21 2022] GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512 => generated 1389 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:21.582297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-125fe788-85e0-4e11-abfb-f51160ddd674 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:21.582797 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-125fe788-85e0-4e11-abfb-f51160ddd674 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 33cef123-07de-4a7b-9200-a47901462512] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:21.588828 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-125fe788-85e0-4e11-abfb-f51160ddd674 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:21.589348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-125fe788-85e0-4e11-abfb-f51160ddd674 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:21.589785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-125fe788-85e0-4e11-abfb-f51160ddd674 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:21.590470 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-125fe788-85e0-4e11-abfb-f51160ddd674 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:21.590927 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-125fe788-85e0-4e11-abfb-f51160ddd674 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:21.591355 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-125fe788-85e0-4e11-abfb-f51160ddd674 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:21.615589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-125fe788-85e0-4e11-abfb-f51160ddd674 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 33cef123-07de-4a7b-9200-a47901462512] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:16:21.696247 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-125fe788-85e0-4e11-abfb-f51160ddd674 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "DELETE /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512" status: 204 len: 0 microversion: 2.1 time: 0.115677 Oct 05 03:16:21.697040 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3326/6666] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:16:21 2022] DELETE /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 03:16:21.705120 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3c2c4dd0-f8e6-463f-9279-4c8dbce515d6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:21.705733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3c2c4dd0-f8e6-463f-9279-4c8dbce515d6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 33cef123-07de-4a7b-9200-a47901462512] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:21.711917 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c2c4dd0-f8e6-463f-9279-4c8dbce515d6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:21.712344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c2c4dd0-f8e6-463f-9279-4c8dbce515d6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:21.712923 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c2c4dd0-f8e6-463f-9279-4c8dbce515d6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:21.713606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c2c4dd0-f8e6-463f-9279-4c8dbce515d6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:21.714066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c2c4dd0-f8e6-463f-9279-4c8dbce515d6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:21.714495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c2c4dd0-f8e6-463f-9279-4c8dbce515d6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:21.846231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3c2c4dd0-f8e6-463f-9279-4c8dbce515d6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:21.854592 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3c2c4dd0-f8e6-463f-9279-4c8dbce515d6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512" status: 200 len: 1395 microversion: 2.1 time: 0.153348 Oct 05 03:16:21.855161 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3341/6667] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:21 2022] GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512 => generated 1395 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:22.878248 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0fea8b23-a107-465b-bd7a-995290cb8ebe tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:22.878961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0fea8b23-a107-465b-bd7a-995290cb8ebe tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 33cef123-07de-4a7b-9200-a47901462512] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:22.889105 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0fea8b23-a107-465b-bd7a-995290cb8ebe tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:22.889595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0fea8b23-a107-465b-bd7a-995290cb8ebe tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:22.890036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0fea8b23-a107-465b-bd7a-995290cb8ebe tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:22.890726 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0fea8b23-a107-465b-bd7a-995290cb8ebe tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:22.891184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0fea8b23-a107-465b-bd7a-995290cb8ebe tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:22.891611 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0fea8b23-a107-465b-bd7a-995290cb8ebe tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:23.024800 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0fea8b23-a107-465b-bd7a-995290cb8ebe tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:23.032571 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0fea8b23-a107-465b-bd7a-995290cb8ebe tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512" status: 200 len: 1395 microversion: 2.1 time: 0.158667 Oct 05 03:16:23.033179 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3327/6668] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:22 2022] GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512 => generated 1395 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:23.854891 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-d47302a3-efa2-49fb-a424-16557665b1a4 req-5826e3b2-5617-4b8f-b826-3dd42222193b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33cef123-07de-4a7b-9200-a47901462512", "name": "network-vif-deleted", "tag": "48a4c410-b022-4859-b241-053f4f40a6e9"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:16:23.864584 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d47302a3-efa2-49fb-a424-16557665b1a4 req-5826e3b2-5617-4b8f-b826-3dd42222193b service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:23.865365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d47302a3-efa2-49fb-a424-16557665b1a4 req-5826e3b2-5617-4b8f-b826-3dd42222193b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:23.865777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d47302a3-efa2-49fb-a424-16557665b1a4 req-5826e3b2-5617-4b8f-b826-3dd42222193b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:23.884217 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-d47302a3-efa2-49fb-a424-16557665b1a4 req-5826e3b2-5617-4b8f-b826-3dd42222193b service nova] Creating event network-vif-deleted:48a4c410-b022-4859-b241-053f4f40a6e9 for instance 33cef123-07de-4a7b-9200-a47901462512 on n-h2-858272-3 Oct 05 03:16:23.890205 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-d47302a3-efa2-49fb-a424-16557665b1a4 req-5826e3b2-5617-4b8f-b826-3dd42222193b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039870 Oct 05 03:16:23.890916 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3342/6669] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:16:24.056197 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-75aa8862-0dc6-474a-8491-e39cee3f78cf tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:24.056707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-75aa8862-0dc6-474a-8491-e39cee3f78cf tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 33cef123-07de-4a7b-9200-a47901462512] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:24.063780 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75aa8862-0dc6-474a-8491-e39cee3f78cf tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:24.064266 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75aa8862-0dc6-474a-8491-e39cee3f78cf tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:24.064703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75aa8862-0dc6-474a-8491-e39cee3f78cf tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:24.065409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75aa8862-0dc6-474a-8491-e39cee3f78cf tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:24.065865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75aa8862-0dc6-474a-8491-e39cee3f78cf tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:24.066286 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75aa8862-0dc6-474a-8491-e39cee3f78cf tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:24.130877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-75aa8862-0dc6-474a-8491-e39cee3f78cf tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:24.141613 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-75aa8862-0dc6-474a-8491-e39cee3f78cf tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512" status: 200 len: 1187 microversion: 2.1 time: 0.089836 Oct 05 03:16:24.142204 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3328/6670] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:24 2022] GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512 => generated 1187 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:25.166547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7af7b88a-78fd-44e5-9119-a9d72b77c65f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:25.167272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7af7b88a-78fd-44e5-9119-a9d72b77c65f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 33cef123-07de-4a7b-9200-a47901462512] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:25.174902 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7af7b88a-78fd-44e5-9119-a9d72b77c65f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:25.175409 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7af7b88a-78fd-44e5-9119-a9d72b77c65f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:25.175850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7af7b88a-78fd-44e5-9119-a9d72b77c65f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:25.176563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7af7b88a-78fd-44e5-9119-a9d72b77c65f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:25.177057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7af7b88a-78fd-44e5-9119-a9d72b77c65f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:25.177486 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7af7b88a-78fd-44e5-9119-a9d72b77c65f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:25.243581 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7af7b88a-78fd-44e5-9119-a9d72b77c65f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:25.251762 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7af7b88a-78fd-44e5-9119-a9d72b77c65f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512" status: 200 len: 1187 microversion: 2.1 time: 0.090466 Oct 05 03:16:25.252419 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3343/6671] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:25 2022] GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512 => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:26.275295 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9de86129-4dfd-407d-9996-970674fa7caa tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:26.275915 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9de86129-4dfd-407d-9996-970674fa7caa tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 33cef123-07de-4a7b-9200-a47901462512] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:26.283792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9de86129-4dfd-407d-9996-970674fa7caa tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:26.284297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9de86129-4dfd-407d-9996-970674fa7caa tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:26.284738 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9de86129-4dfd-407d-9996-970674fa7caa tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:26.285552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9de86129-4dfd-407d-9996-970674fa7caa tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:26.286043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9de86129-4dfd-407d-9996-970674fa7caa tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:26.286473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9de86129-4dfd-407d-9996-970674fa7caa tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:26.355134 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9de86129-4dfd-407d-9996-970674fa7caa tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:26.363163 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9de86129-4dfd-407d-9996-970674fa7caa tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512" status: 200 len: 1187 microversion: 2.1 time: 0.091847 Oct 05 03:16:26.363830 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3329/6672] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:26 2022] GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512 => generated 1187 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:27.387536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a9b87996-23bc-4e6d-90d5-348f5b22424c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:27.388159 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a9b87996-23bc-4e6d-90d5-348f5b22424c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 33cef123-07de-4a7b-9200-a47901462512] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:27.395150 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9b87996-23bc-4e6d-90d5-348f5b22424c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:27.395589 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9b87996-23bc-4e6d-90d5-348f5b22424c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:27.396032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9b87996-23bc-4e6d-90d5-348f5b22424c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:27.396731 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9b87996-23bc-4e6d-90d5-348f5b22424c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:27.397219 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9b87996-23bc-4e6d-90d5-348f5b22424c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:27.397671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9b87996-23bc-4e6d-90d5-348f5b22424c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:27.459539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a9b87996-23bc-4e6d-90d5-348f5b22424c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:27.468782 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a9b87996-23bc-4e6d-90d5-348f5b22424c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512" status: 200 len: 1187 microversion: 2.1 time: 0.085322 Oct 05 03:16:27.469385 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3344/6673] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:27 2022] GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512 => generated 1187 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:16:28.492377 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-26bacd37-74a9-43a7-b6d1-99be57efc456 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:28.493131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-26bacd37-74a9-43a7-b6d1-99be57efc456 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 33cef123-07de-4a7b-9200-a47901462512] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:28.500391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-26bacd37-74a9-43a7-b6d1-99be57efc456 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:28.500974 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-26bacd37-74a9-43a7-b6d1-99be57efc456 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:28.501436 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-26bacd37-74a9-43a7-b6d1-99be57efc456 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:28.503063 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-26bacd37-74a9-43a7-b6d1-99be57efc456 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:28.503796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-26bacd37-74a9-43a7-b6d1-99be57efc456 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:28.504238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-26bacd37-74a9-43a7-b6d1-99be57efc456 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:28.518955 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-26bacd37-74a9-43a7-b6d1-99be57efc456 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] HTTP exception thrown: Instance 33cef123-07de-4a7b-9200-a47901462512 could not be found. Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-26bacd37-74a9-43a7-b6d1-99be57efc456 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Request method failure captured: Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512 HTTP/1.1 Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPbrQKtYWOrgIE3M1fpHMFzvjQh4iLX1nAzEklsHFOch728asjV7SItEDt5qDq-ufTutAq3QkdKbEFAclvkEjD6DmQ6dye6ArfBgrG8mjckzaoUeygHR0aBhtzZzZQl0gGW5mk16tBGgd6IoBji5V99Q_6th4Uy5PRVF9Hx8YdoF6tU Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 713e3a431a2441548123f404b23ce0da Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-TestVolumeBootPattern-847109256 Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713e3a431a2441548123f404b23ce0da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713e3a431a2441548123f404b23ce0da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/713e3a431a2441548123f404b23ce0da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_713e3a431a2441548123f404b23ce0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-TestVolumeBootPattern-847109256 Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 713e3a431a2441548123f404b23ce0da Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-TestVolumeBootPattern-847109256 Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-TestVolumeBootPattern-847109256-project Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: ee8daf94c54c4dd7b69310674d73211a Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-TestVolumeBootPattern-847109256-project Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 33cef123-07de-4a7b-9200-a47901462512 could not be found. Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '33cef123-07de-4a7b-9200-a47901462512'} Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33cef123-07de-4a7b-9200-a47901462512 could not be found. Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33cef123-07de-4a7b-9200-a47901462512 could not be found. Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:16:28.520643 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:16:28.524312 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:16:28.524312 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:16:28.524312 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:16:28.524312 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:16:28.524312 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:16:28.524312 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33cef123-07de-4a7b-9200-a47901462512 could not be found. Oct 05 03:16:28.524312 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:16:28.524312 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-26bacd37-74a9-43a7-b6d1-99be57efc456 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Returning 404 to user: Instance 33cef123-07de-4a7b-9200-a47901462512 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:16:28.524312 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-26bacd37-74a9-43a7-b6d1-99be57efc456 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512" status: 404 len: 111 microversion: 2.1 time: 0.034512 Oct 05 03:16:28.524312 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3330/6674] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:28 2022] GET /compute/v2.1/servers/33cef123-07de-4a7b-9200-a47901462512 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:16:33.438877 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2e4708eb-e892-4272-89f9-20e8582d482d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-125250705", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "7068ef3c-2ae9-46bb-919a-bd09e55dfae6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fa70d413-7436-41df-9105-d3173bf249ed"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:16:33.450077 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:16:33.501397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-2e4708eb-e892-4272-89f9-20e8582d482d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] validate_networks() for [('fa70d413-7436-41df-9105-d3173bf249ed', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:16:33.865787 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-2e4708eb-e892-4272-89f9-20e8582d482d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:16:33.866219 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-2e4708eb-e892-4272-89f9-20e8582d482d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:16:33.866718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-2e4708eb-e892-4272-89f9-20e8582d482d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:16:33.867239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-2e4708eb-e892-4272-89f9-20e8582d482d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:16:33.867677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-2e4708eb-e892-4272-89f9-20e8582d482d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:16:33.876558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e4708eb-e892-4272-89f9-20e8582d482d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:33.877075 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e4708eb-e892-4272-89f9-20e8582d482d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:33.877510 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e4708eb-e892-4272-89f9-20e8582d482d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:33.878231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e4708eb-e892-4272-89f9-20e8582d482d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:33.878683 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e4708eb-e892-4272-89f9-20e8582d482d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:33.879171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e4708eb-e892-4272-89f9-20e8582d482d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:33.885127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=75 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:16:33.897218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-2e4708eb-e892-4272-89f9-20e8582d482d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Getting quotas for project 713e3a431a2441548123f404b23ce0da. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:16:33.903098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-2e4708eb-e892-4272-89f9-20e8582d482d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Getting quotas for user ee8daf94c54c4dd7b69310674d73211a and project 713e3a431a2441548123f404b23ce0da. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:16:33.958756 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2e4708eb-e892-4272-89f9-20e8582d482d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:16:33.961432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2e4708eb-e892-4272-89f9-20e8582d482d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 4e1863fd-4463-456c-8d86-529bba944cb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7068ef3c-2ae9-46bb-919a-bd09e55dfae6',volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:16:34.085869 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2e4708eb-e892-4272-89f9-20e8582d482d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.650771 Oct 05 03:16:34.086760 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3345/6675] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:16:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:16:34.097886 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ee502de2-080f-42e2-8ccc-818bf82b4892 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:34.098601 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ee502de2-080f-42e2-8ccc-818bf82b4892 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 4e1863fd-4463-456c-8d86-529bba944cb5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:34.102423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:16:34.155675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ee502de2-080f-42e2-8ccc-818bf82b4892 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:34.163528 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ee502de2-080f-42e2-8ccc-818bf82b4892 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5" status: 200 len: 1056 microversion: 2.1 time: 0.069103 Oct 05 03:16:34.164428 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3331/6676] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:34 2022] GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5 => generated 1056 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:35.186224 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b4368c71-e03d-4c9b-8c0b-bdd36fb38620 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:35.186766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b4368c71-e03d-4c9b-8c0b-bdd36fb38620 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 4e1863fd-4463-456c-8d86-529bba944cb5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:35.195001 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4368c71-e03d-4c9b-8c0b-bdd36fb38620 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:35.195942 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4368c71-e03d-4c9b-8c0b-bdd36fb38620 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:35.197236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4368c71-e03d-4c9b-8c0b-bdd36fb38620 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:35.198025 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4368c71-e03d-4c9b-8c0b-bdd36fb38620 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:35.198833 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4368c71-e03d-4c9b-8c0b-bdd36fb38620 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:35.199282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4368c71-e03d-4c9b-8c0b-bdd36fb38620 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:35.289763 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b4368c71-e03d-4c9b-8c0b-bdd36fb38620 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:35.297711 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b4368c71-e03d-4c9b-8c0b-bdd36fb38620 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5" status: 200 len: 1162 microversion: 2.1 time: 0.115534 Oct 05 03:16:35.298292 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3346/6677] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:35 2022] GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5 => generated 1162 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:16:36.322599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0e55adff-f0cd-4e04-9c38-5428b5d1e5d4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:36.323983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0e55adff-f0cd-4e04-9c38-5428b5d1e5d4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 4e1863fd-4463-456c-8d86-529bba944cb5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:36.334905 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e55adff-f0cd-4e04-9c38-5428b5d1e5d4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:36.335779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e55adff-f0cd-4e04-9c38-5428b5d1e5d4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:36.336434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e55adff-f0cd-4e04-9c38-5428b5d1e5d4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:36.337367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e55adff-f0cd-4e04-9c38-5428b5d1e5d4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:36.338037 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e55adff-f0cd-4e04-9c38-5428b5d1e5d4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:36.338469 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e55adff-f0cd-4e04-9c38-5428b5d1e5d4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:36.342741 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:16:36.564723 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0e55adff-f0cd-4e04-9c38-5428b5d1e5d4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:36.572857 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0e55adff-f0cd-4e04-9c38-5428b5d1e5d4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5" status: 200 len: 1214 microversion: 2.1 time: 0.255842 Oct 05 03:16:36.573679 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3332/6678] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:36 2022] GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5 => generated 1214 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:36.729607 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-4d114f70-ddf5-4ebb-b0b5-41b39b7a0bf5 req-124118a1-8310-428e-a759-ed5d0c21ea8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e1863fd-4463-456c-8d86-529bba944cb5", "tag": "2afa8fd8-b712-46e5-a93e-ea0a4c53a4a9"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:16:36.740516 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4d114f70-ddf5-4ebb-b0b5-41b39b7a0bf5 req-124118a1-8310-428e-a759-ed5d0c21ea8d service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:36.744268 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4d114f70-ddf5-4ebb-b0b5-41b39b7a0bf5 req-124118a1-8310-428e-a759-ed5d0c21ea8d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:36.745169 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4d114f70-ddf5-4ebb-b0b5-41b39b7a0bf5 req-124118a1-8310-428e-a759-ed5d0c21ea8d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:36.759034 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-4d114f70-ddf5-4ebb-b0b5-41b39b7a0bf5 req-124118a1-8310-428e-a759-ed5d0c21ea8d service nova] Creating event network-changed:2afa8fd8-b712-46e5-a93e-ea0a4c53a4a9 for instance 4e1863fd-4463-456c-8d86-529bba944cb5 on n-h2-858272-3 Oct 05 03:16:36.764867 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-4d114f70-ddf5-4ebb-b0b5-41b39b7a0bf5 req-124118a1-8310-428e-a759-ed5d0c21ea8d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039206 Oct 05 03:16:36.766157 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3347/6679] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:16:37.605070 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9132f947-a44e-4bc7-a416-44e1ca5e328a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:37.606226 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9132f947-a44e-4bc7-a416-44e1ca5e328a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 4e1863fd-4463-456c-8d86-529bba944cb5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:37.614746 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9132f947-a44e-4bc7-a416-44e1ca5e328a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:37.615400 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9132f947-a44e-4bc7-a416-44e1ca5e328a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:37.616479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9132f947-a44e-4bc7-a416-44e1ca5e328a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:37.617391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9132f947-a44e-4bc7-a416-44e1ca5e328a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:37.617959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9132f947-a44e-4bc7-a416-44e1ca5e328a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:37.618495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9132f947-a44e-4bc7-a416-44e1ca5e328a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:37.776236 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9132f947-a44e-4bc7-a416-44e1ca5e328a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:37.784280 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9132f947-a44e-4bc7-a416-44e1ca5e328a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5" status: 200 len: 1214 microversion: 2.1 time: 0.192005 Oct 05 03:16:37.784979 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3333/6680] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:37 2022] GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5 => generated 1214 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:16:38.808996 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e6d48667-f811-4e94-8251-d8b381ded59f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:38.809707 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e6d48667-f811-4e94-8251-d8b381ded59f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 4e1863fd-4463-456c-8d86-529bba944cb5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:38.815922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6d48667-f811-4e94-8251-d8b381ded59f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:38.816417 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6d48667-f811-4e94-8251-d8b381ded59f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:38.816858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6d48667-f811-4e94-8251-d8b381ded59f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:38.817653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6d48667-f811-4e94-8251-d8b381ded59f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:38.818120 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6d48667-f811-4e94-8251-d8b381ded59f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:38.818554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6d48667-f811-4e94-8251-d8b381ded59f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:38.959351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e6d48667-f811-4e94-8251-d8b381ded59f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:38.968146 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e6d48667-f811-4e94-8251-d8b381ded59f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5" status: 200 len: 1214 microversion: 2.1 time: 0.164377 Oct 05 03:16:38.968752 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3348/6681] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:38 2022] GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5 => generated 1214 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:39.991601 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bc95ff07-9429-43c7-b098-7a5a033b4eb9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:39.992231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bc95ff07-9429-43c7-b098-7a5a033b4eb9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 4e1863fd-4463-456c-8d86-529bba944cb5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:39.999314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bc95ff07-9429-43c7-b098-7a5a033b4eb9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:39.999811 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bc95ff07-9429-43c7-b098-7a5a033b4eb9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:40.000248 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bc95ff07-9429-43c7-b098-7a5a033b4eb9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:40.000986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bc95ff07-9429-43c7-b098-7a5a033b4eb9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:40.001446 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bc95ff07-9429-43c7-b098-7a5a033b4eb9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:40.001870 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bc95ff07-9429-43c7-b098-7a5a033b4eb9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:40.145531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bc95ff07-9429-43c7-b098-7a5a033b4eb9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:40.154136 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bc95ff07-9429-43c7-b098-7a5a033b4eb9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5" status: 200 len: 1214 microversion: 2.1 time: 0.167289 Oct 05 03:16:40.154717 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3334/6682] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:39 2022] GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5 => generated 1214 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:41.177468 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5a92d9a7-0983-4974-ab00-0e1f394205fd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:41.178090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5a92d9a7-0983-4974-ab00-0e1f394205fd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 4e1863fd-4463-456c-8d86-529bba944cb5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:41.185923 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a92d9a7-0983-4974-ab00-0e1f394205fd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:41.186426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a92d9a7-0983-4974-ab00-0e1f394205fd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:41.186870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a92d9a7-0983-4974-ab00-0e1f394205fd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:41.187582 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a92d9a7-0983-4974-ab00-0e1f394205fd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:41.188042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a92d9a7-0983-4974-ab00-0e1f394205fd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:41.188477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a92d9a7-0983-4974-ab00-0e1f394205fd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:41.317645 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5a92d9a7-0983-4974-ab00-0e1f394205fd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:41.326366 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5a92d9a7-0983-4974-ab00-0e1f394205fd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5" status: 200 len: 1202 microversion: 2.1 time: 0.152718 Oct 05 03:16:41.327027 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3349/6683] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:41 2022] GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5 => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:42.350072 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b342af3e-842d-4cf2-b4c6-78afdbb2a054 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:42.351097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b342af3e-842d-4cf2-b4c6-78afdbb2a054 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 4e1863fd-4463-456c-8d86-529bba944cb5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:42.357478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b342af3e-842d-4cf2-b4c6-78afdbb2a054 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:42.357969 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b342af3e-842d-4cf2-b4c6-78afdbb2a054 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:42.358404 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b342af3e-842d-4cf2-b4c6-78afdbb2a054 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:42.359091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b342af3e-842d-4cf2-b4c6-78afdbb2a054 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:42.359546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b342af3e-842d-4cf2-b4c6-78afdbb2a054 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:42.359972 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b342af3e-842d-4cf2-b4c6-78afdbb2a054 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:42.504344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b342af3e-842d-4cf2-b4c6-78afdbb2a054 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:42.512523 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b342af3e-842d-4cf2-b4c6-78afdbb2a054 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5" status: 200 len: 1202 microversion: 2.1 time: 0.166650 Oct 05 03:16:42.513123 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3335/6684] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:42 2022] GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5 => generated 1202 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:43.535376 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5288f69e-644a-426d-86f0-7e2c1ae60776 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:43.535922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5288f69e-644a-426d-86f0-7e2c1ae60776 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 4e1863fd-4463-456c-8d86-529bba944cb5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:43.543426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5288f69e-644a-426d-86f0-7e2c1ae60776 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:43.543928 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5288f69e-644a-426d-86f0-7e2c1ae60776 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:43.544372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5288f69e-644a-426d-86f0-7e2c1ae60776 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:43.545109 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5288f69e-644a-426d-86f0-7e2c1ae60776 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:43.545568 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5288f69e-644a-426d-86f0-7e2c1ae60776 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:43.545999 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5288f69e-644a-426d-86f0-7e2c1ae60776 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:43.680547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5288f69e-644a-426d-86f0-7e2c1ae60776 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:43.688579 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5288f69e-644a-426d-86f0-7e2c1ae60776 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5" status: 200 len: 1202 microversion: 2.1 time: 0.157328 Oct 05 03:16:43.689200 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3350/6685] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:43 2022] GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5 => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:44.712914 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-63b7b954-827a-45dc-bceb-dcfb677113a8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:44.713564 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-63b7b954-827a-45dc-bceb-dcfb677113a8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 4e1863fd-4463-456c-8d86-529bba944cb5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:44.716334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:16:44.721803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63b7b954-827a-45dc-bceb-dcfb677113a8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:44.722286 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63b7b954-827a-45dc-bceb-dcfb677113a8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:44.722717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63b7b954-827a-45dc-bceb-dcfb677113a8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:44.723515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63b7b954-827a-45dc-bceb-dcfb677113a8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:44.723972 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63b7b954-827a-45dc-bceb-dcfb677113a8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:44.724392 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63b7b954-827a-45dc-bceb-dcfb677113a8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:44.853283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-63b7b954-827a-45dc-bceb-dcfb677113a8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:44.861015 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-63b7b954-827a-45dc-bceb-dcfb677113a8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5" status: 200 len: 1202 microversion: 2.1 time: 0.153450 Oct 05 03:16:44.861603 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3336/6686] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:44 2022] GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5 => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:45.167776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-de4d4398-a78c-4aff-acc8-02f7076b1f69 req-4d12387d-ffe6-4faf-b618-d71620cf0bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1863fd-4463-456c-8d86-529bba944cb5", "name": "network-vif-plugged", "status": "completed", "tag": "2afa8fd8-b712-46e5-a93e-ea0a4c53a4a9"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:16:45.172748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:16:45.173528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:16:45.181633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-de4d4398-a78c-4aff-acc8-02f7076b1f69 req-4d12387d-ffe6-4faf-b618-d71620cf0bd7 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:45.182126 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-de4d4398-a78c-4aff-acc8-02f7076b1f69 req-4d12387d-ffe6-4faf-b618-d71620cf0bd7 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:45.182562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-de4d4398-a78c-4aff-acc8-02f7076b1f69 req-4d12387d-ffe6-4faf-b618-d71620cf0bd7 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:45.194482 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-de4d4398-a78c-4aff-acc8-02f7076b1f69 req-4d12387d-ffe6-4faf-b618-d71620cf0bd7 service nova] Creating event network-vif-plugged:2afa8fd8-b712-46e5-a93e-ea0a4c53a4a9 for instance 4e1863fd-4463-456c-8d86-529bba944cb5 on n-h2-858272-3 Oct 05 03:16:45.199632 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-de4d4398-a78c-4aff-acc8-02f7076b1f69 req-4d12387d-ffe6-4faf-b618-d71620cf0bd7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035641 Oct 05 03:16:45.200248 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3351/6687] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:16:45.884787 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5b5d07c6-7e3b-4b80-b954-544ce84dd73a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:45.885452 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5b5d07c6-7e3b-4b80-b954-544ce84dd73a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 4e1863fd-4463-456c-8d86-529bba944cb5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:45.892209 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b5d07c6-7e3b-4b80-b954-544ce84dd73a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:45.892694 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b5d07c6-7e3b-4b80-b954-544ce84dd73a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:45.893162 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b5d07c6-7e3b-4b80-b954-544ce84dd73a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:45.893841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b5d07c6-7e3b-4b80-b954-544ce84dd73a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:45.894307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b5d07c6-7e3b-4b80-b954-544ce84dd73a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:45.894714 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5b5d07c6-7e3b-4b80-b954-544ce84dd73a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:46.021261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5b5d07c6-7e3b-4b80-b954-544ce84dd73a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:46.029416 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5b5d07c6-7e3b-4b80-b954-544ce84dd73a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5" status: 200 len: 1202 microversion: 2.1 time: 0.148572 Oct 05 03:16:46.029989 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3337/6688] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:45 2022] GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5 => generated 1202 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:47.053957 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8b10af7e-5674-40b4-9cec-fd1e92fb5c2f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:47.054652 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8b10af7e-5674-40b4-9cec-fd1e92fb5c2f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 4e1863fd-4463-456c-8d86-529bba944cb5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:47.061360 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b10af7e-5674-40b4-9cec-fd1e92fb5c2f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:47.061852 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b10af7e-5674-40b4-9cec-fd1e92fb5c2f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:47.062386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b10af7e-5674-40b4-9cec-fd1e92fb5c2f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:47.063108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b10af7e-5674-40b4-9cec-fd1e92fb5c2f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:47.063726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b10af7e-5674-40b4-9cec-fd1e92fb5c2f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:47.064156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b10af7e-5674-40b4-9cec-fd1e92fb5c2f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:47.257419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8b10af7e-5674-40b4-9cec-fd1e92fb5c2f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:47.265280 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8b10af7e-5674-40b4-9cec-fd1e92fb5c2f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5" status: 200 len: 1389 microversion: 2.1 time: 0.217378 Oct 05 03:16:47.266062 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3352/6689] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:47 2022] GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5 => generated 1389 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:47.288725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-29e52d12-3be0-44fd-b567-2c26841549f3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:47.289460 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-29e52d12-3be0-44fd-b567-2c26841549f3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 4e1863fd-4463-456c-8d86-529bba944cb5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:47.296502 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29e52d12-3be0-44fd-b567-2c26841549f3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:47.297178 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29e52d12-3be0-44fd-b567-2c26841549f3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:47.297691 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29e52d12-3be0-44fd-b567-2c26841549f3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:47.298391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29e52d12-3be0-44fd-b567-2c26841549f3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:47.298851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29e52d12-3be0-44fd-b567-2c26841549f3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:47.299282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29e52d12-3be0-44fd-b567-2c26841549f3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:47.496986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-29e52d12-3be0-44fd-b567-2c26841549f3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:47.505590 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-29e52d12-3be0-44fd-b567-2c26841549f3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5" status: 200 len: 1389 microversion: 2.1 time: 0.221444 Oct 05 03:16:47.506786 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3338/6690] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:47 2022] GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5 => generated 1389 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:47.528934 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-756f029f-6b1b-4d4f-b389-ab2ce6e6a4b2 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:47.529558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-756f029f-6b1b-4d4f-b389-ab2ce6e6a4b2 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 4e1863fd-4463-456c-8d86-529bba944cb5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:47.536107 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-756f029f-6b1b-4d4f-b389-ab2ce6e6a4b2 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:47.536584 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-756f029f-6b1b-4d4f-b389-ab2ce6e6a4b2 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:47.537059 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-756f029f-6b1b-4d4f-b389-ab2ce6e6a4b2 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:47.537745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-756f029f-6b1b-4d4f-b389-ab2ce6e6a4b2 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:47.538197 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-756f029f-6b1b-4d4f-b389-ab2ce6e6a4b2 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:47.538619 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-756f029f-6b1b-4d4f-b389-ab2ce6e6a4b2 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:47.668395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-756f029f-6b1b-4d4f-b389-ab2ce6e6a4b2 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:47.676302 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-756f029f-6b1b-4d4f-b389-ab2ce6e6a4b2 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5" status: 200 len: 1389 microversion: 2.1 time: 0.151477 Oct 05 03:16:47.676923 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3353/6691] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:47 2022] GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5 => generated 1389 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:47.698724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-82a0472c-28e9-4eb9-af59-a27ec21109dc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:47.699259 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-82a0472c-28e9-4eb9-af59-a27ec21109dc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 4e1863fd-4463-456c-8d86-529bba944cb5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:47.705235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82a0472c-28e9-4eb9-af59-a27ec21109dc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:47.705725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82a0472c-28e9-4eb9-af59-a27ec21109dc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:47.706166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82a0472c-28e9-4eb9-af59-a27ec21109dc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:47.706851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82a0472c-28e9-4eb9-af59-a27ec21109dc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:47.707307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82a0472c-28e9-4eb9-af59-a27ec21109dc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:47.707733 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82a0472c-28e9-4eb9-af59-a27ec21109dc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:47.732173 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-82a0472c-28e9-4eb9-af59-a27ec21109dc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 4e1863fd-4463-456c-8d86-529bba944cb5] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:16:47.805225 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-82a0472c-28e9-4eb9-af59-a27ec21109dc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5" status: 204 len: 0 microversion: 2.1 time: 0.110070 Oct 05 03:16:47.806052 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3339/6692] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:16:47 2022] DELETE /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:16:47.814160 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-eeabbd02-836d-4c5f-be9e-4dd0c7c73ca4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:47.814779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-eeabbd02-836d-4c5f-be9e-4dd0c7c73ca4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 4e1863fd-4463-456c-8d86-529bba944cb5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:47.820966 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eeabbd02-836d-4c5f-be9e-4dd0c7c73ca4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:47.821491 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eeabbd02-836d-4c5f-be9e-4dd0c7c73ca4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:47.821936 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eeabbd02-836d-4c5f-be9e-4dd0c7c73ca4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:47.822639 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eeabbd02-836d-4c5f-be9e-4dd0c7c73ca4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:47.823095 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eeabbd02-836d-4c5f-be9e-4dd0c7c73ca4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:47.823521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eeabbd02-836d-4c5f-be9e-4dd0c7c73ca4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:47.953946 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-eeabbd02-836d-4c5f-be9e-4dd0c7c73ca4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:47.962237 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-eeabbd02-836d-4c5f-be9e-4dd0c7c73ca4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5" status: 200 len: 1395 microversion: 2.1 time: 0.151933 Oct 05 03:16:47.962805 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3354/6693] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:47 2022] GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5 => generated 1395 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:48.986892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8fc27f59-4f94-4b93-985a-9022d7f7cd20 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:48.987602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8fc27f59-4f94-4b93-985a-9022d7f7cd20 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 4e1863fd-4463-456c-8d86-529bba944cb5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:48.996238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8fc27f59-4f94-4b93-985a-9022d7f7cd20 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:48.996732 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8fc27f59-4f94-4b93-985a-9022d7f7cd20 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:48.997204 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8fc27f59-4f94-4b93-985a-9022d7f7cd20 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:48.997905 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8fc27f59-4f94-4b93-985a-9022d7f7cd20 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:48.998368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8fc27f59-4f94-4b93-985a-9022d7f7cd20 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:48.998798 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8fc27f59-4f94-4b93-985a-9022d7f7cd20 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:49.129534 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8fc27f59-4f94-4b93-985a-9022d7f7cd20 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:49.137620 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8fc27f59-4f94-4b93-985a-9022d7f7cd20 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5" status: 200 len: 1395 microversion: 2.1 time: 0.155060 Oct 05 03:16:49.138193 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3340/6694] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:48 2022] GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5 => generated 1395 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:50.159854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-59c85bd8-1717-4750-b86b-6fdb77228917 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:50.160468 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-59c85bd8-1717-4750-b86b-6fdb77228917 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 4e1863fd-4463-456c-8d86-529bba944cb5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:50.167889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-59c85bd8-1717-4750-b86b-6fdb77228917 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:50.168393 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-59c85bd8-1717-4750-b86b-6fdb77228917 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:50.168842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-59c85bd8-1717-4750-b86b-6fdb77228917 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:50.170191 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-59c85bd8-1717-4750-b86b-6fdb77228917 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:50.170668 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-59c85bd8-1717-4750-b86b-6fdb77228917 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:50.171104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-59c85bd8-1717-4750-b86b-6fdb77228917 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:50.417302 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-abe05d87-2936-4254-a8db-09b7bf0efb94 req-f191cf00-3864-4b22-b216-e353e153289c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1863fd-4463-456c-8d86-529bba944cb5", "name": "network-vif-deleted", "tag": "2afa8fd8-b712-46e5-a93e-ea0a4c53a4a9"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:16:50.420289 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-59c85bd8-1717-4750-b86b-6fdb77228917 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:50.429196 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-59c85bd8-1717-4750-b86b-6fdb77228917 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5" status: 200 len: 1395 microversion: 2.1 time: 0.273120 Oct 05 03:16:50.440587 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3355/6695] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:50 2022] GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5 => generated 1395 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:50.441141 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-abe05d87-2936-4254-a8db-09b7bf0efb94 req-f191cf00-3864-4b22-b216-e353e153289c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:50.441141 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-abe05d87-2936-4254-a8db-09b7bf0efb94 req-f191cf00-3864-4b22-b216-e353e153289c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:50.441141 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-abe05d87-2936-4254-a8db-09b7bf0efb94 req-f191cf00-3864-4b22-b216-e353e153289c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:50.451728 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-abe05d87-2936-4254-a8db-09b7bf0efb94 req-f191cf00-3864-4b22-b216-e353e153289c service nova] Creating event network-vif-deleted:2afa8fd8-b712-46e5-a93e-ea0a4c53a4a9 for instance 4e1863fd-4463-456c-8d86-529bba944cb5 on n-h2-858272-3 Oct 05 03:16:50.457591 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-abe05d87-2936-4254-a8db-09b7bf0efb94 req-f191cf00-3864-4b22-b216-e353e153289c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044252 Oct 05 03:16:50.458294 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3341/6696] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:16:51.452669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-865e7dff-f477-4420-937a-985245f51df4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:51.453310 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-865e7dff-f477-4420-937a-985245f51df4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 4e1863fd-4463-456c-8d86-529bba944cb5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:51.460979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-865e7dff-f477-4420-937a-985245f51df4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:51.461477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-865e7dff-f477-4420-937a-985245f51df4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:51.461920 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-865e7dff-f477-4420-937a-985245f51df4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:51.462621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-865e7dff-f477-4420-937a-985245f51df4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:51.463082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-865e7dff-f477-4420-937a-985245f51df4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:51.463518 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-865e7dff-f477-4420-937a-985245f51df4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:51.531726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-865e7dff-f477-4420-937a-985245f51df4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:51.539745 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-865e7dff-f477-4420-937a-985245f51df4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5" status: 200 len: 1187 microversion: 2.1 time: 0.091003 Oct 05 03:16:51.540327 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3356/6697] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:51 2022] GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5 => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:52.565179 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8e5dbe68-3ce2-4ae8-952a-566a1281fb03 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:52.566015 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8e5dbe68-3ce2-4ae8-952a-566a1281fb03 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 4e1863fd-4463-456c-8d86-529bba944cb5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:52.573959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e5dbe68-3ce2-4ae8-952a-566a1281fb03 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:52.574451 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e5dbe68-3ce2-4ae8-952a-566a1281fb03 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:52.574885 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e5dbe68-3ce2-4ae8-952a-566a1281fb03 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:52.575573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e5dbe68-3ce2-4ae8-952a-566a1281fb03 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:52.576049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e5dbe68-3ce2-4ae8-952a-566a1281fb03 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:52.576633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e5dbe68-3ce2-4ae8-952a-566a1281fb03 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:52.640993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8e5dbe68-3ce2-4ae8-952a-566a1281fb03 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:52.649960 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8e5dbe68-3ce2-4ae8-952a-566a1281fb03 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5" status: 200 len: 1187 microversion: 2.1 time: 0.089905 Oct 05 03:16:52.650747 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3342/6698] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:52 2022] GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5 => generated 1187 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:53.673430 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7f7547a5-8603-4963-9c89-60def44cb843 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:53.674062 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7f7547a5-8603-4963-9c89-60def44cb843 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 4e1863fd-4463-456c-8d86-529bba944cb5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:53.681480 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f7547a5-8603-4963-9c89-60def44cb843 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:53.681986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f7547a5-8603-4963-9c89-60def44cb843 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:53.682430 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f7547a5-8603-4963-9c89-60def44cb843 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:53.683155 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f7547a5-8603-4963-9c89-60def44cb843 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:53.683621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f7547a5-8603-4963-9c89-60def44cb843 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:53.684065 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f7547a5-8603-4963-9c89-60def44cb843 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:53.750808 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7f7547a5-8603-4963-9c89-60def44cb843 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:53.759384 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7f7547a5-8603-4963-9c89-60def44cb843 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5" status: 200 len: 1187 microversion: 2.1 time: 0.089818 Oct 05 03:16:53.759978 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3357/6699] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:53 2022] GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5 => generated 1187 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:54.782843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5196e3e2-afac-48ba-8b91-22c6f50e6889 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:54.783352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5196e3e2-afac-48ba-8b91-22c6f50e6889 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 4e1863fd-4463-456c-8d86-529bba944cb5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:54.790991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5196e3e2-afac-48ba-8b91-22c6f50e6889 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:54.791477 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5196e3e2-afac-48ba-8b91-22c6f50e6889 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:54.791915 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5196e3e2-afac-48ba-8b91-22c6f50e6889 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:54.792600 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5196e3e2-afac-48ba-8b91-22c6f50e6889 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:54.793087 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5196e3e2-afac-48ba-8b91-22c6f50e6889 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:54.793519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5196e3e2-afac-48ba-8b91-22c6f50e6889 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:54.826307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5196e3e2-afac-48ba-8b91-22c6f50e6889 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:54.826790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5196e3e2-afac-48ba-8b91-22c6f50e6889 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:54.827228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5196e3e2-afac-48ba-8b91-22c6f50e6889 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:54.827670 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-5196e3e2-afac-48ba-8b91-22c6f50e6889 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lazy-loading 'fault' on Instance uuid 4e1863fd-4463-456c-8d86-529bba944cb5 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:16:54.868316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5196e3e2-afac-48ba-8b91-22c6f50e6889 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:16:54.876049 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5196e3e2-afac-48ba-8b91-22c6f50e6889 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5" status: 200 len: 1192 microversion: 2.1 time: 0.097194 Oct 05 03:16:54.876633 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3343/6700] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:54 2022] GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5 => generated 1192 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:16:55.899503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a6384d97-0233-4c72-94cb-17f2133733be tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:16:55.900138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a6384d97-0233-4c72-94cb-17f2133733be tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 4e1863fd-4463-456c-8d86-529bba944cb5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:16:55.907272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6384d97-0233-4c72-94cb-17f2133733be tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:55.907766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6384d97-0233-4c72-94cb-17f2133733be tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:55.908212 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6384d97-0233-4c72-94cb-17f2133733be tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:55.908924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6384d97-0233-4c72-94cb-17f2133733be tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:16:55.909393 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6384d97-0233-4c72-94cb-17f2133733be tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:16:55.909822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6384d97-0233-4c72-94cb-17f2133733be tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:16:55.923690 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-a6384d97-0233-4c72-94cb-17f2133733be tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] HTTP exception thrown: Instance 4e1863fd-4463-456c-8d86-529bba944cb5 could not be found. Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a6384d97-0233-4c72-94cb-17f2133733be tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Request method failure captured: Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5 HTTP/1.1 Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPbrQKtYWOrgIE3M1fpHMFzvjQh4iLX1nAzEklsHFOch728asjV7SItEDt5qDq-ufTutAq3QkdKbEFAclvkEjD6DmQ6dye6ArfBgrG8mjckzaoUeygHR0aBhtzZzZQl0gGW5mk16tBGgd6IoBji5V99Q_6th4Uy5PRVF9Hx8YdoF6tU Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 713e3a431a2441548123f404b23ce0da Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TestVolumeBootPattern-847109256 Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713e3a431a2441548123f404b23ce0da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713e3a431a2441548123f404b23ce0da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/713e3a431a2441548123f404b23ce0da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_713e3a431a2441548123f404b23ce0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TestVolumeBootPattern-847109256 Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 713e3a431a2441548123f404b23ce0da Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TestVolumeBootPattern-847109256 Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TestVolumeBootPattern-847109256-project Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: ee8daf94c54c4dd7b69310674d73211a Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TestVolumeBootPattern-847109256-project Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 4e1863fd-4463-456c-8d86-529bba944cb5 could not be found. Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '4e1863fd-4463-456c-8d86-529bba944cb5'} Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e1863fd-4463-456c-8d86-529bba944cb5 could not be found. Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e1863fd-4463-456c-8d86-529bba944cb5 could not be found. Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:16:55.925303 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:16:55.929676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:16:55.929676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:16:55.929676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:16:55.929676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:16:55.929676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:16:55.929676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e1863fd-4463-456c-8d86-529bba944cb5 could not be found. Oct 05 03:16:55.929676 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:16:55.929676 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a6384d97-0233-4c72-94cb-17f2133733be tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Returning 404 to user: Instance 4e1863fd-4463-456c-8d86-529bba944cb5 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:16:55.929676 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a6384d97-0233-4c72-94cb-17f2133733be tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5" status: 404 len: 111 microversion: 2.1 time: 0.031535 Oct 05 03:16:55.929676 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3358/6701] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:16:55 2022] GET /compute/v2.1/servers/4e1863fd-4463-456c-8d86-529bba944cb5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:17:16.916047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-77f65baa-2c65-4e76-8c22-9e32e5248ff5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-706097482", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "78199e05-6451-4dd0-995c-10d5c48b9d56", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "fa70d413-7436-41df-9105-d3173bf249ed"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:17:16.926773 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:17:16.927598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:17:17.132142 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-77f65baa-2c65-4e76-8c22-9e32e5248ff5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] validate_networks() for [('fa70d413-7436-41df-9105-d3173bf249ed', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:17:17.495847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-77f65baa-2c65-4e76-8c22-9e32e5248ff5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:17:17.496269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-77f65baa-2c65-4e76-8c22-9e32e5248ff5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:17:17.496741 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-77f65baa-2c65-4e76-8c22-9e32e5248ff5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:17:17.497182 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-77f65baa-2c65-4e76-8c22-9e32e5248ff5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:17:17.497587 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-77f65baa-2c65-4e76-8c22-9e32e5248ff5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:17:17.507564 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-77f65baa-2c65-4e76-8c22-9e32e5248ff5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:17.508041 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-77f65baa-2c65-4e76-8c22-9e32e5248ff5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:17.508474 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-77f65baa-2c65-4e76-8c22-9e32e5248ff5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:17.509217 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-77f65baa-2c65-4e76-8c22-9e32e5248ff5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:17.509673 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-77f65baa-2c65-4e76-8c22-9e32e5248ff5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:17.510098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-77f65baa-2c65-4e76-8c22-9e32e5248ff5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:17.526997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-77f65baa-2c65-4e76-8c22-9e32e5248ff5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Getting quotas for project 713e3a431a2441548123f404b23ce0da. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:17:17.532140 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-77f65baa-2c65-4e76-8c22-9e32e5248ff5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Getting quotas for user ee8daf94c54c4dd7b69310674d73211a and project 713e3a431a2441548123f404b23ce0da. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:17:17.545134 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-77f65baa-2c65-4e76-8c22-9e32e5248ff5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:17:17.547139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-77f65baa-2c65-4e76-8c22-9e32e5248ff5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='78199e05-6451-4dd0-995c-10d5c48b9d56',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:17:17.623175 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-77f65baa-2c65-4e76-8c22-9e32e5248ff5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.711212 Oct 05 03:17:17.624482 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3344/6702] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:17:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:17:17.636696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0ffbc8ad-66f3-4f38-8dd4-e6068f10ca6d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:17.637459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0ffbc8ad-66f3-4f38-8dd4-e6068f10ca6d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:17.641547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:17:17.642223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=67 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:17:17.824154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0ffbc8ad-66f3-4f38-8dd4-e6068f10ca6d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:17:17.831156 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0ffbc8ad-66f3-4f38-8dd4-e6068f10ca6d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 200 len: 1056 microversion: 2.1 time: 0.199157 Oct 05 03:17:17.831727 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3359/6703] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:17 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 1056 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:17:18.854162 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-aed27506-54fa-4d59-a0cc-7e6088eba64a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:18.854790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-aed27506-54fa-4d59-a0cc-7e6088eba64a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:18.861669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aed27506-54fa-4d59-a0cc-7e6088eba64a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:18.862165 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aed27506-54fa-4d59-a0cc-7e6088eba64a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:18.862613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aed27506-54fa-4d59-a0cc-7e6088eba64a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:18.863632 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aed27506-54fa-4d59-a0cc-7e6088eba64a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:18.864252 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aed27506-54fa-4d59-a0cc-7e6088eba64a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:18.864685 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aed27506-54fa-4d59-a0cc-7e6088eba64a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:18.938972 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-aed27506-54fa-4d59-a0cc-7e6088eba64a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:17:18.947805 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-aed27506-54fa-4d59-a0cc-7e6088eba64a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 200 len: 1126 microversion: 2.1 time: 0.097344 Oct 05 03:17:18.948401 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3345/6704] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:18 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 1126 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:17:19.972023 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7d3b176e-be9e-4000-a11b-f1542378664e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:19.973543 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7d3b176e-be9e-4000-a11b-f1542378664e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:19.983083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d3b176e-be9e-4000-a11b-f1542378664e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:19.983759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d3b176e-be9e-4000-a11b-f1542378664e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:19.984212 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d3b176e-be9e-4000-a11b-f1542378664e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:19.984963 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d3b176e-be9e-4000-a11b-f1542378664e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:19.985435 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d3b176e-be9e-4000-a11b-f1542378664e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:19.985864 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d3b176e-be9e-4000-a11b-f1542378664e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:20.198864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-066d70a3-5511-418f-bb32-c937917d020b req-e8686cda-46de-483f-99b9-4583d2d4a459 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec3313f1-edaa-4d8e-8f96-e372ed602086", "tag": "35e5ba70-ec01-47fd-b36a-d4c40de4d90a"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:17:20.214158 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-066d70a3-5511-418f-bb32-c937917d020b req-e8686cda-46de-483f-99b9-4583d2d4a459 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:20.214643 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-066d70a3-5511-418f-bb32-c937917d020b req-e8686cda-46de-483f-99b9-4583d2d4a459 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:20.215284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-066d70a3-5511-418f-bb32-c937917d020b req-e8686cda-46de-483f-99b9-4583d2d4a459 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:20.228071 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-066d70a3-5511-418f-bb32-c937917d020b req-e8686cda-46de-483f-99b9-4583d2d4a459 service nova] Creating event network-changed:35e5ba70-ec01-47fd-b36a-d4c40de4d90a for instance ec3313f1-edaa-4d8e-8f96-e372ed602086 on n-h2-858272-3 Oct 05 03:17:20.234282 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-066d70a3-5511-418f-bb32-c937917d020b req-e8686cda-46de-483f-99b9-4583d2d4a459 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039855 Oct 05 03:17:20.235438 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3346/6705] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:17:20.246096 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7d3b176e-be9e-4000-a11b-f1542378664e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:17:20.263066 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7d3b176e-be9e-4000-a11b-f1542378664e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 200 len: 1168 microversion: 2.1 time: 0.294990 Oct 05 03:17:20.264036 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3360/6706] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:19 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 1168 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:17:21.291941 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5aa59b19-e1c5-46d1-a637-c2b5fda978ba tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:21.292764 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5aa59b19-e1c5-46d1-a637-c2b5fda978ba tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:21.299040 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5aa59b19-e1c5-46d1-a637-c2b5fda978ba tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:21.299526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5aa59b19-e1c5-46d1-a637-c2b5fda978ba tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:21.299964 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5aa59b19-e1c5-46d1-a637-c2b5fda978ba tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:21.301333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5aa59b19-e1c5-46d1-a637-c2b5fda978ba tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:21.301888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5aa59b19-e1c5-46d1-a637-c2b5fda978ba tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:21.302316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5aa59b19-e1c5-46d1-a637-c2b5fda978ba tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:21.438802 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5aa59b19-e1c5-46d1-a637-c2b5fda978ba tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:17:21.446819 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5aa59b19-e1c5-46d1-a637-c2b5fda978ba tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 200 len: 1168 microversion: 2.1 time: 0.159929 Oct 05 03:17:21.447393 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3347/6707] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:21 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 1168 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:17:22.471215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-60f8b962-8fb9-449b-b67f-794a655c54b9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:22.472818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-60f8b962-8fb9-449b-b67f-794a655c54b9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:22.481296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60f8b962-8fb9-449b-b67f-794a655c54b9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:22.482172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60f8b962-8fb9-449b-b67f-794a655c54b9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:22.482724 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60f8b962-8fb9-449b-b67f-794a655c54b9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:22.483529 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60f8b962-8fb9-449b-b67f-794a655c54b9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:22.484015 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60f8b962-8fb9-449b-b67f-794a655c54b9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:22.484463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60f8b962-8fb9-449b-b67f-794a655c54b9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:22.682675 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-60f8b962-8fb9-449b-b67f-794a655c54b9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:17:22.693423 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-60f8b962-8fb9-449b-b67f-794a655c54b9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 200 len: 1168 microversion: 2.1 time: 0.227581 Oct 05 03:17:22.694147 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3361/6708] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:22 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 1168 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:17:23.734405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e0b7b9d3-f490-4e74-b749-32e976dc8c9c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:23.736171 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e0b7b9d3-f490-4e74-b749-32e976dc8c9c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:23.743983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0b7b9d3-f490-4e74-b749-32e976dc8c9c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:23.744438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0b7b9d3-f490-4e74-b749-32e976dc8c9c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:23.745151 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0b7b9d3-f490-4e74-b749-32e976dc8c9c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:23.747048 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0b7b9d3-f490-4e74-b749-32e976dc8c9c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:23.747048 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0b7b9d3-f490-4e74-b749-32e976dc8c9c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:23.747288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0b7b9d3-f490-4e74-b749-32e976dc8c9c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:23.958752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e0b7b9d3-f490-4e74-b749-32e976dc8c9c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:17:23.973777 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e0b7b9d3-f490-4e74-b749-32e976dc8c9c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 200 len: 1168 microversion: 2.1 time: 0.244663 Oct 05 03:17:23.977431 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3348/6709] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:23 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 1168 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:17:25.018329 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-992790c0-485b-4679-a77a-6349c881de12 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:25.019997 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-992790c0-485b-4679-a77a-6349c881de12 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:25.026393 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-992790c0-485b-4679-a77a-6349c881de12 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:25.026896 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-992790c0-485b-4679-a77a-6349c881de12 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:25.027470 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-992790c0-485b-4679-a77a-6349c881de12 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:25.028134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-992790c0-485b-4679-a77a-6349c881de12 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:25.028817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-992790c0-485b-4679-a77a-6349c881de12 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:25.029669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-992790c0-485b-4679-a77a-6349c881de12 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:25.197391 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-992790c0-485b-4679-a77a-6349c881de12 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:17:25.205659 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-992790c0-485b-4679-a77a-6349c881de12 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 200 len: 1168 microversion: 2.1 time: 0.193738 Oct 05 03:17:25.215837 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3362/6710] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:25 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 1168 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:17:26.228951 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-946c6bb2-cb0c-46a5-a70b-ecfdf6bd8940 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:26.229648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-946c6bb2-cb0c-46a5-a70b-ecfdf6bd8940 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:26.236521 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-946c6bb2-cb0c-46a5-a70b-ecfdf6bd8940 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:26.237073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-946c6bb2-cb0c-46a5-a70b-ecfdf6bd8940 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:26.238279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-946c6bb2-cb0c-46a5-a70b-ecfdf6bd8940 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:26.239207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-946c6bb2-cb0c-46a5-a70b-ecfdf6bd8940 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:26.239679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-946c6bb2-cb0c-46a5-a70b-ecfdf6bd8940 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:26.240096 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-946c6bb2-cb0c-46a5-a70b-ecfdf6bd8940 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:26.373186 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-946c6bb2-cb0c-46a5-a70b-ecfdf6bd8940 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:17:26.381538 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-946c6bb2-cb0c-46a5-a70b-ecfdf6bd8940 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 200 len: 1168 microversion: 2.1 time: 0.156574 Oct 05 03:17:26.382100 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3349/6711] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:26 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 1168 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:17:27.403946 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7f1468ef-673f-4296-9c4a-a47afbd6858a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:27.404564 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7f1468ef-673f-4296-9c4a-a47afbd6858a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:27.411690 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f1468ef-673f-4296-9c4a-a47afbd6858a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:27.412174 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f1468ef-673f-4296-9c4a-a47afbd6858a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:27.412613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f1468ef-673f-4296-9c4a-a47afbd6858a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:27.413328 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f1468ef-673f-4296-9c4a-a47afbd6858a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:27.413782 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f1468ef-673f-4296-9c4a-a47afbd6858a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:27.414205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f1468ef-673f-4296-9c4a-a47afbd6858a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:27.543513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7f1468ef-673f-4296-9c4a-a47afbd6858a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:17:27.551271 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7f1468ef-673f-4296-9c4a-a47afbd6858a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 200 len: 1168 microversion: 2.1 time: 0.151564 Oct 05 03:17:27.551844 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3363/6712] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:27 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 1168 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:17:28.575028 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-31ad789f-0c96-4c76-8c6a-5ef22d3e492c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:28.575649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-31ad789f-0c96-4c76-8c6a-5ef22d3e492c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:28.579610 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:17:28.580471 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:17:28.585912 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-31ad789f-0c96-4c76-8c6a-5ef22d3e492c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:28.586416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-31ad789f-0c96-4c76-8c6a-5ef22d3e492c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:28.586849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-31ad789f-0c96-4c76-8c6a-5ef22d3e492c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:28.587578 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-31ad789f-0c96-4c76-8c6a-5ef22d3e492c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:28.588031 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-31ad789f-0c96-4c76-8c6a-5ef22d3e492c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:28.588450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-31ad789f-0c96-4c76-8c6a-5ef22d3e492c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:28.731584 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-31ad789f-0c96-4c76-8c6a-5ef22d3e492c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:17:28.740277 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-31ad789f-0c96-4c76-8c6a-5ef22d3e492c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 200 len: 1168 microversion: 2.1 time: 0.169202 Oct 05 03:17:28.740861 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3350/6713] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:28 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 1168 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:17:29.763795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cfb7f90d-22ea-497f-b8d4-3afacfd789ce tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:29.765036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cfb7f90d-22ea-497f-b8d4-3afacfd789ce tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:29.767112 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:17:29.773443 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cfb7f90d-22ea-497f-b8d4-3afacfd789ce tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:29.773933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cfb7f90d-22ea-497f-b8d4-3afacfd789ce tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:29.774404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cfb7f90d-22ea-497f-b8d4-3afacfd789ce tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:29.775103 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cfb7f90d-22ea-497f-b8d4-3afacfd789ce tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:29.775560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cfb7f90d-22ea-497f-b8d4-3afacfd789ce tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:29.775984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cfb7f90d-22ea-497f-b8d4-3afacfd789ce tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:29.915694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cfb7f90d-22ea-497f-b8d4-3afacfd789ce tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:17:29.924089 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cfb7f90d-22ea-497f-b8d4-3afacfd789ce tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 200 len: 1168 microversion: 2.1 time: 0.164043 Oct 05 03:17:29.924618 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3364/6714] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:29 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 1168 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:17:30.947609 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-78bc50ef-c827-4ffe-8f4b-c11189ebf319 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:30.948157 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-78bc50ef-c827-4ffe-8f4b-c11189ebf319 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:30.955293 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78bc50ef-c827-4ffe-8f4b-c11189ebf319 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:30.955790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78bc50ef-c827-4ffe-8f4b-c11189ebf319 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:30.957556 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78bc50ef-c827-4ffe-8f4b-c11189ebf319 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:30.958260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78bc50ef-c827-4ffe-8f4b-c11189ebf319 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:30.958856 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78bc50ef-c827-4ffe-8f4b-c11189ebf319 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:30.959294 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78bc50ef-c827-4ffe-8f4b-c11189ebf319 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:31.102736 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-78bc50ef-c827-4ffe-8f4b-c11189ebf319 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:17:31.120421 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-78bc50ef-c827-4ffe-8f4b-c11189ebf319 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 200 len: 1168 microversion: 2.1 time: 0.176726 Oct 05 03:17:31.121026 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3351/6715] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:30 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 1168 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:17:32.146704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2d8e7d82-b6df-430f-8145-ce55b14466ef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:32.147373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2d8e7d82-b6df-430f-8145-ce55b14466ef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:32.154415 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2d8e7d82-b6df-430f-8145-ce55b14466ef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:32.154909 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2d8e7d82-b6df-430f-8145-ce55b14466ef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:32.155353 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2d8e7d82-b6df-430f-8145-ce55b14466ef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:32.156063 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2d8e7d82-b6df-430f-8145-ce55b14466ef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:32.156527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2d8e7d82-b6df-430f-8145-ce55b14466ef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:32.156991 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2d8e7d82-b6df-430f-8145-ce55b14466ef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:32.293379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2d8e7d82-b6df-430f-8145-ce55b14466ef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:17:32.301909 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2d8e7d82-b6df-430f-8145-ce55b14466ef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 200 len: 1168 microversion: 2.1 time: 0.160130 Oct 05 03:17:32.302497 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3365/6716] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:32 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 1168 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:17:33.324824 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fc8d39fb-467d-41b4-ba99-20dbfc440f8f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:33.325503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fc8d39fb-467d-41b4-ba99-20dbfc440f8f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:33.332371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc8d39fb-467d-41b4-ba99-20dbfc440f8f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:33.332870 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc8d39fb-467d-41b4-ba99-20dbfc440f8f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:33.333538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc8d39fb-467d-41b4-ba99-20dbfc440f8f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:33.334405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc8d39fb-467d-41b4-ba99-20dbfc440f8f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:33.335133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc8d39fb-467d-41b4-ba99-20dbfc440f8f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:33.335744 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc8d39fb-467d-41b4-ba99-20dbfc440f8f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:33.467553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fc8d39fb-467d-41b4-ba99-20dbfc440f8f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:17:33.475847 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fc8d39fb-467d-41b4-ba99-20dbfc440f8f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 200 len: 1202 microversion: 2.1 time: 0.155032 Oct 05 03:17:33.476353 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3352/6717] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:33 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:17:34.499051 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7fb9f5de-574c-49cb-8da3-5672c0263268 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:34.499659 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7fb9f5de-574c-49cb-8da3-5672c0263268 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:34.507183 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fb9f5de-574c-49cb-8da3-5672c0263268 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:34.507669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fb9f5de-574c-49cb-8da3-5672c0263268 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:34.508111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fb9f5de-574c-49cb-8da3-5672c0263268 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:34.508804 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fb9f5de-574c-49cb-8da3-5672c0263268 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:34.509290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fb9f5de-574c-49cb-8da3-5672c0263268 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:34.509723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fb9f5de-574c-49cb-8da3-5672c0263268 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:34.642695 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7fb9f5de-574c-49cb-8da3-5672c0263268 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:17:34.650721 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7fb9f5de-574c-49cb-8da3-5672c0263268 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 200 len: 1202 microversion: 2.1 time: 0.155516 Oct 05 03:17:34.651297 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3366/6718] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:34 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 1202 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:17:35.674281 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3940adac-5e9c-4d29-927a-9000f771bd29 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:35.675606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3940adac-5e9c-4d29-927a-9000f771bd29 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:35.682029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3940adac-5e9c-4d29-927a-9000f771bd29 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:35.682509 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3940adac-5e9c-4d29-927a-9000f771bd29 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:35.682943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3940adac-5e9c-4d29-927a-9000f771bd29 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:35.683626 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3940adac-5e9c-4d29-927a-9000f771bd29 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:35.684079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3940adac-5e9c-4d29-927a-9000f771bd29 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:35.684498 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3940adac-5e9c-4d29-927a-9000f771bd29 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:35.811251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3940adac-5e9c-4d29-927a-9000f771bd29 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:17:35.819985 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3940adac-5e9c-4d29-927a-9000f771bd29 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 200 len: 1202 microversion: 2.1 time: 0.149745 Oct 05 03:17:35.820574 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3353/6719] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:35 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 1202 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:17:36.842726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b41b79da-3a15-4f16-a573-f7803411644a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:36.843340 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b41b79da-3a15-4f16-a573-f7803411644a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:36.850915 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b41b79da-3a15-4f16-a573-f7803411644a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:36.851406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b41b79da-3a15-4f16-a573-f7803411644a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:36.851844 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b41b79da-3a15-4f16-a573-f7803411644a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:36.852535 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b41b79da-3a15-4f16-a573-f7803411644a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:36.853014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b41b79da-3a15-4f16-a573-f7803411644a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:36.853441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b41b79da-3a15-4f16-a573-f7803411644a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:36.986299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b41b79da-3a15-4f16-a573-f7803411644a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:17:36.994286 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b41b79da-3a15-4f16-a573-f7803411644a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 200 len: 1202 microversion: 2.1 time: 0.155515 Oct 05 03:17:36.994864 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3367/6720] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:36 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 1202 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:17:38.016888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d01fac58-784f-44c9-a7be-ff167278cd19 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:38.017557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d01fac58-784f-44c9-a7be-ff167278cd19 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:38.024947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d01fac58-784f-44c9-a7be-ff167278cd19 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:38.025447 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d01fac58-784f-44c9-a7be-ff167278cd19 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:38.025894 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d01fac58-784f-44c9-a7be-ff167278cd19 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:38.026589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d01fac58-784f-44c9-a7be-ff167278cd19 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:38.027057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d01fac58-784f-44c9-a7be-ff167278cd19 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:38.027488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d01fac58-784f-44c9-a7be-ff167278cd19 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:38.157059 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d01fac58-784f-44c9-a7be-ff167278cd19 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:17:38.165340 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d01fac58-784f-44c9-a7be-ff167278cd19 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 200 len: 1202 microversion: 2.1 time: 0.152445 Oct 05 03:17:38.165920 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3354/6721] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:38 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:17:39.187764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cd636886-65c9-456b-90b3-4fb5a069636d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:39.188374 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cd636886-65c9-456b-90b3-4fb5a069636d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:39.196108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd636886-65c9-456b-90b3-4fb5a069636d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:39.196598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd636886-65c9-456b-90b3-4fb5a069636d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:39.197065 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd636886-65c9-456b-90b3-4fb5a069636d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:39.197759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd636886-65c9-456b-90b3-4fb5a069636d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:39.198213 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd636886-65c9-456b-90b3-4fb5a069636d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:39.198635 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd636886-65c9-456b-90b3-4fb5a069636d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:39.334082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cd636886-65c9-456b-90b3-4fb5a069636d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:17:39.341786 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cd636886-65c9-456b-90b3-4fb5a069636d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 200 len: 1202 microversion: 2.1 time: 0.157933 Oct 05 03:17:39.342356 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3368/6722] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:39 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:17:40.364589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4ba39328-f593-49c8-8b3e-0e5085f455ab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:40.365214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4ba39328-f593-49c8-8b3e-0e5085f455ab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:40.371964 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ba39328-f593-49c8-8b3e-0e5085f455ab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:40.372450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ba39328-f593-49c8-8b3e-0e5085f455ab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:40.372884 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ba39328-f593-49c8-8b3e-0e5085f455ab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:40.373594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ba39328-f593-49c8-8b3e-0e5085f455ab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:40.374050 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ba39328-f593-49c8-8b3e-0e5085f455ab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:40.374477 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ba39328-f593-49c8-8b3e-0e5085f455ab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:40.502088 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4ba39328-f593-49c8-8b3e-0e5085f455ab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:17:40.510775 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4ba39328-f593-49c8-8b3e-0e5085f455ab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 200 len: 1202 microversion: 2.1 time: 0.150466 Oct 05 03:17:40.511360 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3355/6723] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:40 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 1202 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:17:41.534223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-96816ee5-b30a-42d8-bde6-e0b514f3de1b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:41.535546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-96816ee5-b30a-42d8-bde6-e0b514f3de1b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:41.543285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96816ee5-b30a-42d8-bde6-e0b514f3de1b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:41.543887 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96816ee5-b30a-42d8-bde6-e0b514f3de1b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:41.544421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96816ee5-b30a-42d8-bde6-e0b514f3de1b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:41.545295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96816ee5-b30a-42d8-bde6-e0b514f3de1b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:41.545829 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96816ee5-b30a-42d8-bde6-e0b514f3de1b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:41.546353 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96816ee5-b30a-42d8-bde6-e0b514f3de1b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:41.702388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-96816ee5-b30a-42d8-bde6-e0b514f3de1b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:17:41.710320 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-96816ee5-b30a-42d8-bde6-e0b514f3de1b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 200 len: 1202 microversion: 2.1 time: 0.180724 Oct 05 03:17:41.710896 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3369/6724] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:41 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 1202 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:17:42.733564 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-234aa0ea-efa6-4725-8127-988f55a67f48 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:42.734191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-234aa0ea-efa6-4725-8127-988f55a67f48 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:42.742193 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-234aa0ea-efa6-4725-8127-988f55a67f48 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:42.742681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-234aa0ea-efa6-4725-8127-988f55a67f48 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:42.743121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-234aa0ea-efa6-4725-8127-988f55a67f48 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:42.743812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-234aa0ea-efa6-4725-8127-988f55a67f48 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:42.744270 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-234aa0ea-efa6-4725-8127-988f55a67f48 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:42.744699 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-234aa0ea-efa6-4725-8127-988f55a67f48 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:42.876364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-234aa0ea-efa6-4725-8127-988f55a67f48 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:17:42.884277 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-234aa0ea-efa6-4725-8127-988f55a67f48 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 200 len: 1202 microversion: 2.1 time: 0.154560 Oct 05 03:17:42.884881 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3356/6725] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:42 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:17:43.754330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-15960280-b2df-4f41-8319-ee9e2efebce1 req-ce8dfd8d-d589-4800-a589-5a90b6b52039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec3313f1-edaa-4d8e-8f96-e372ed602086", "name": "network-vif-plugged", "status": "completed", "tag": "35e5ba70-ec01-47fd-b36a-d4c40de4d90a"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:17:43.759590 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 03:17:43.759748 n-d-858272-3 devstack@n-api.service[122319]: Wed Oct 5 03:17:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 05 03:17:43.771634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-15960280-b2df-4f41-8319-ee9e2efebce1 req-ce8dfd8d-d589-4800-a589-5a90b6b52039 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:43.772133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-15960280-b2df-4f41-8319-ee9e2efebce1 req-ce8dfd8d-d589-4800-a589-5a90b6b52039 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:43.772561 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-15960280-b2df-4f41-8319-ee9e2efebce1 req-ce8dfd8d-d589-4800-a589-5a90b6b52039 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:43.783983 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-15960280-b2df-4f41-8319-ee9e2efebce1 req-ce8dfd8d-d589-4800-a589-5a90b6b52039 service nova] Creating event network-vif-plugged:35e5ba70-ec01-47fd-b36a-d4c40de4d90a for instance ec3313f1-edaa-4d8e-8f96-e372ed602086 on n-h2-858272-3 Oct 05 03:17:43.790444 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-15960280-b2df-4f41-8319-ee9e2efebce1 req-ce8dfd8d-d589-4800-a589-5a90b6b52039 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040198 Oct 05 03:17:43.791621 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3370/6726] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:17:43.907102 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e1ba243b-f017-4373-b594-cb7fb0b72e7d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:43.907719 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e1ba243b-f017-4373-b594-cb7fb0b72e7d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:43.914974 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1ba243b-f017-4373-b594-cb7fb0b72e7d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:43.915464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1ba243b-f017-4373-b594-cb7fb0b72e7d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:43.915905 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1ba243b-f017-4373-b594-cb7fb0b72e7d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:43.916597 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1ba243b-f017-4373-b594-cb7fb0b72e7d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:43.917085 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1ba243b-f017-4373-b594-cb7fb0b72e7d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:43.917512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1ba243b-f017-4373-b594-cb7fb0b72e7d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:44.101457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e1ba243b-f017-4373-b594-cb7fb0b72e7d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:17:44.109193 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e1ba243b-f017-4373-b594-cb7fb0b72e7d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 200 len: 1202 microversion: 2.1 time: 0.205916 Oct 05 03:17:44.109774 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3357/6727] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:43 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 1202 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:17:45.133624 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-16bcf605-070e-4644-bf3a-de0cef6a785b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:45.134365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-16bcf605-070e-4644-bf3a-de0cef6a785b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:45.141624 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-16bcf605-070e-4644-bf3a-de0cef6a785b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:45.142119 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-16bcf605-070e-4644-bf3a-de0cef6a785b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:45.142558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-16bcf605-070e-4644-bf3a-de0cef6a785b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:45.143256 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-16bcf605-070e-4644-bf3a-de0cef6a785b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:45.143740 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-16bcf605-070e-4644-bf3a-de0cef6a785b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:45.144196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-16bcf605-070e-4644-bf3a-de0cef6a785b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:45.273132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-16bcf605-070e-4644-bf3a-de0cef6a785b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:17:45.280860 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-16bcf605-070e-4644-bf3a-de0cef6a785b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 200 len: 1202 microversion: 2.1 time: 0.151565 Oct 05 03:17:45.281446 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3371/6728] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:45 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:17:46.304355 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2f396708-bfa6-46ee-8c08-7b01973678d3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:46.305234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2f396708-bfa6-46ee-8c08-7b01973678d3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:46.312984 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f396708-bfa6-46ee-8c08-7b01973678d3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:46.313477 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f396708-bfa6-46ee-8c08-7b01973678d3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:46.313913 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f396708-bfa6-46ee-8c08-7b01973678d3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:46.314596 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f396708-bfa6-46ee-8c08-7b01973678d3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:46.315050 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f396708-bfa6-46ee-8c08-7b01973678d3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:46.315984 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f396708-bfa6-46ee-8c08-7b01973678d3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:46.447899 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2f396708-bfa6-46ee-8c08-7b01973678d3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:17:46.455722 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2f396708-bfa6-46ee-8c08-7b01973678d3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 200 len: 1389 microversion: 2.1 time: 0.155378 Oct 05 03:17:46.456776 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3358/6729] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:46 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 1389 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:17:46.478223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3bc1ed76-003b-453c-8b7b-c06fde653b47 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:46.478843 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3bc1ed76-003b-453c-8b7b-c06fde653b47 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:46.485803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bc1ed76-003b-453c-8b7b-c06fde653b47 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:46.486281 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bc1ed76-003b-453c-8b7b-c06fde653b47 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:46.486724 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bc1ed76-003b-453c-8b7b-c06fde653b47 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:46.488183 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bc1ed76-003b-453c-8b7b-c06fde653b47 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:46.488646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bc1ed76-003b-453c-8b7b-c06fde653b47 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:46.489113 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3bc1ed76-003b-453c-8b7b-c06fde653b47 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:46.621019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3bc1ed76-003b-453c-8b7b-c06fde653b47 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:17:46.629506 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3bc1ed76-003b-453c-8b7b-c06fde653b47 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 200 len: 1389 microversion: 2.1 time: 0.155091 Oct 05 03:17:46.630086 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3372/6730] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:46 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 1389 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:17:46.651208 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e48be684-a5fb-4ec5-9547-6612fcaf359c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:46.651765 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e48be684-a5fb-4ec5-9547-6612fcaf359c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:46.657858 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e48be684-a5fb-4ec5-9547-6612fcaf359c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:46.658352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e48be684-a5fb-4ec5-9547-6612fcaf359c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:46.658795 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e48be684-a5fb-4ec5-9547-6612fcaf359c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:46.659660 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e48be684-a5fb-4ec5-9547-6612fcaf359c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:46.660134 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e48be684-a5fb-4ec5-9547-6612fcaf359c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:46.660559 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e48be684-a5fb-4ec5-9547-6612fcaf359c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:46.791075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e48be684-a5fb-4ec5-9547-6612fcaf359c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:17:46.799291 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e48be684-a5fb-4ec5-9547-6612fcaf359c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 200 len: 1389 microversion: 2.1 time: 0.152337 Oct 05 03:17:46.799929 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3359/6731] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:46 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 1389 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:17:46.881644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9c9d5cdf-e613-4c71-b9b7-a067d66c9a67 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:46.882143 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9c9d5cdf-e613-4c71-b9b7-a067d66c9a67 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:46.888263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c9d5cdf-e613-4c71-b9b7-a067d66c9a67 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:46.888758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c9d5cdf-e613-4c71-b9b7-a067d66c9a67 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:46.889235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c9d5cdf-e613-4c71-b9b7-a067d66c9a67 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:46.889935 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c9d5cdf-e613-4c71-b9b7-a067d66c9a67 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:46.890400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c9d5cdf-e613-4c71-b9b7-a067d66c9a67 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:46.890835 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c9d5cdf-e613-4c71-b9b7-a067d66c9a67 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:46.920737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9c9d5cdf-e613-4c71-b9b7-a067d66c9a67 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:17:47.003719 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9c9d5cdf-e613-4c71-b9b7-a067d66c9a67 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 204 len: 0 microversion: 2.1 time: 0.126321 Oct 05 03:17:47.004456 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3373/6732] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:17:46 2022] DELETE /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:17:47.012683 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8a18af3f-2e71-4786-8cf1-30875d46625d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:47.013369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8a18af3f-2e71-4786-8cf1-30875d46625d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:47.015337 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:17:47.020829 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a18af3f-2e71-4786-8cf1-30875d46625d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:47.021348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a18af3f-2e71-4786-8cf1-30875d46625d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:47.021786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a18af3f-2e71-4786-8cf1-30875d46625d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:47.022473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a18af3f-2e71-4786-8cf1-30875d46625d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:47.022929 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a18af3f-2e71-4786-8cf1-30875d46625d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:47.023358 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a18af3f-2e71-4786-8cf1-30875d46625d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:47.028100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=89 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:17:47.154188 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8a18af3f-2e71-4786-8cf1-30875d46625d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:17:47.162942 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8a18af3f-2e71-4786-8cf1-30875d46625d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 200 len: 1395 microversion: 2.1 time: 0.154184 Oct 05 03:17:47.163517 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3360/6733] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:47 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 1395 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:17:48.187604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-45dd16f5-8370-434b-bad9-f49897a6bff0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:48.188308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-45dd16f5-8370-434b-bad9-f49897a6bff0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:48.191867 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:17:48.197416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45dd16f5-8370-434b-bad9-f49897a6bff0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:48.197913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45dd16f5-8370-434b-bad9-f49897a6bff0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:48.198356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45dd16f5-8370-434b-bad9-f49897a6bff0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:48.199348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45dd16f5-8370-434b-bad9-f49897a6bff0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:48.199923 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45dd16f5-8370-434b-bad9-f49897a6bff0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:48.200357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-45dd16f5-8370-434b-bad9-f49897a6bff0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:48.206227 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:17:48.341718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-45dd16f5-8370-434b-bad9-f49897a6bff0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:17:48.350566 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-45dd16f5-8370-434b-bad9-f49897a6bff0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 200 len: 1395 microversion: 2.1 time: 0.167294 Oct 05 03:17:48.351148 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3374/6734] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:48 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 1395 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:17:49.217910 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-913f2ed8-24a2-4bfb-9127-d28bafffa4ef req-0842f779-b7d4-46fa-890d-75fe702b1944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec3313f1-edaa-4d8e-8f96-e372ed602086", "name": "network-vif-deleted", "tag": "35e5ba70-ec01-47fd-b36a-d4c40de4d90a"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:17:49.229199 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-913f2ed8-24a2-4bfb-9127-d28bafffa4ef req-0842f779-b7d4-46fa-890d-75fe702b1944 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:49.229677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-913f2ed8-24a2-4bfb-9127-d28bafffa4ef req-0842f779-b7d4-46fa-890d-75fe702b1944 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:49.230103 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-913f2ed8-24a2-4bfb-9127-d28bafffa4ef req-0842f779-b7d4-46fa-890d-75fe702b1944 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:49.247851 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-913f2ed8-24a2-4bfb-9127-d28bafffa4ef req-0842f779-b7d4-46fa-890d-75fe702b1944 service nova] Creating event network-vif-deleted:35e5ba70-ec01-47fd-b36a-d4c40de4d90a for instance ec3313f1-edaa-4d8e-8f96-e372ed602086 on n-h2-858272-3 Oct 05 03:17:49.253647 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-913f2ed8-24a2-4bfb-9127-d28bafffa4ef req-0842f779-b7d4-46fa-890d-75fe702b1944 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039412 Oct 05 03:17:49.254460 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3361/6735] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:17:49.374736 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7f72f169-36c7-4666-90f5-e4eb8406c40d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:49.375458 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7f72f169-36c7-4666-90f5-e4eb8406c40d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:49.382258 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f72f169-36c7-4666-90f5-e4eb8406c40d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:49.382752 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f72f169-36c7-4666-90f5-e4eb8406c40d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:49.383188 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f72f169-36c7-4666-90f5-e4eb8406c40d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:49.383886 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f72f169-36c7-4666-90f5-e4eb8406c40d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:49.384337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f72f169-36c7-4666-90f5-e4eb8406c40d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:49.384761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f72f169-36c7-4666-90f5-e4eb8406c40d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:49.446873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7f72f169-36c7-4666-90f5-e4eb8406c40d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:17:49.454910 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7f72f169-36c7-4666-90f5-e4eb8406c40d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 200 len: 1187 microversion: 2.1 time: 0.084086 Oct 05 03:17:49.455489 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3375/6736] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:49 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 1187 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:17:50.481413 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-be266367-05ae-4bf1-95ff-3aac5a060ba1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:50.482050 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-be266367-05ae-4bf1-95ff-3aac5a060ba1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:50.488606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be266367-05ae-4bf1-95ff-3aac5a060ba1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:50.489135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be266367-05ae-4bf1-95ff-3aac5a060ba1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:50.489579 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be266367-05ae-4bf1-95ff-3aac5a060ba1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:50.490282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be266367-05ae-4bf1-95ff-3aac5a060ba1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:50.490747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be266367-05ae-4bf1-95ff-3aac5a060ba1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:50.491180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be266367-05ae-4bf1-95ff-3aac5a060ba1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:50.553596 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-be266367-05ae-4bf1-95ff-3aac5a060ba1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:17:50.561606 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-be266367-05ae-4bf1-95ff-3aac5a060ba1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 200 len: 1187 microversion: 2.1 time: 0.085623 Oct 05 03:17:50.562195 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3362/6737] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:50 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 1187 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:17:51.586014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ae2c63ca-f1ff-4c5d-a4ed-53fe522f7205 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:51.586014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ae2c63ca-f1ff-4c5d-a4ed-53fe522f7205 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:51.592865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae2c63ca-f1ff-4c5d-a4ed-53fe522f7205 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:51.593396 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae2c63ca-f1ff-4c5d-a4ed-53fe522f7205 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:51.593843 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae2c63ca-f1ff-4c5d-a4ed-53fe522f7205 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:51.594560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae2c63ca-f1ff-4c5d-a4ed-53fe522f7205 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:51.595026 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae2c63ca-f1ff-4c5d-a4ed-53fe522f7205 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:51.595462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ae2c63ca-f1ff-4c5d-a4ed-53fe522f7205 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:51.672158 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ae2c63ca-f1ff-4c5d-a4ed-53fe522f7205 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:17:51.681581 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ae2c63ca-f1ff-4c5d-a4ed-53fe522f7205 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 200 len: 1187 microversion: 2.1 time: 0.100604 Oct 05 03:17:51.682492 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3376/6738] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:51 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 1187 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:17:52.704510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e722b9d6-fdb4-49e4-8fa4-960cd53d25bd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:52.705153 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e722b9d6-fdb4-49e4-8fa4-960cd53d25bd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:52.714453 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e722b9d6-fdb4-49e4-8fa4-960cd53d25bd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:52.714943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e722b9d6-fdb4-49e4-8fa4-960cd53d25bd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:52.715378 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e722b9d6-fdb4-49e4-8fa4-960cd53d25bd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:52.716080 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e722b9d6-fdb4-49e4-8fa4-960cd53d25bd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:52.716538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e722b9d6-fdb4-49e4-8fa4-960cd53d25bd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:52.716986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e722b9d6-fdb4-49e4-8fa4-960cd53d25bd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:52.784975 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e722b9d6-fdb4-49e4-8fa4-960cd53d25bd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:17:52.792822 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e722b9d6-fdb4-49e4-8fa4-960cd53d25bd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 200 len: 1187 microversion: 2.1 time: 0.092462 Oct 05 03:17:52.793424 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3363/6739] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:52 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 1187 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:17:53.818332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bf3dd394-c960-44cf-9cd4-2e247cacf5cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:53.818968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bf3dd394-c960-44cf-9cd4-2e247cacf5cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:53.826476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf3dd394-c960-44cf-9cd4-2e247cacf5cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:53.827061 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf3dd394-c960-44cf-9cd4-2e247cacf5cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:53.827585 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf3dd394-c960-44cf-9cd4-2e247cacf5cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:53.828397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf3dd394-c960-44cf-9cd4-2e247cacf5cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:53.828958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf3dd394-c960-44cf-9cd4-2e247cacf5cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:53.829698 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf3dd394-c960-44cf-9cd4-2e247cacf5cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:53.865729 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf3dd394-c960-44cf-9cd4-2e247cacf5cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:53.866377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf3dd394-c960-44cf-9cd4-2e247cacf5cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:53.867050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bf3dd394-c960-44cf-9cd4-2e247cacf5cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:53.867609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-bf3dd394-c960-44cf-9cd4-2e247cacf5cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lazy-loading 'fault' on Instance uuid ec3313f1-edaa-4d8e-8f96-e372ed602086 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:17:53.912589 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bf3dd394-c960-44cf-9cd4-2e247cacf5cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:17:53.919833 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bf3dd394-c960-44cf-9cd4-2e247cacf5cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 200 len: 1146 microversion: 2.1 time: 0.106820 Oct 05 03:17:53.920407 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3377/6740] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:53 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 1146 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:17:54.944400 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-65e0c53c-9450-4b2b-8ef4-421420e955f3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:54.945023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-65e0c53c-9450-4b2b-8ef4-421420e955f3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:54.952286 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-65e0c53c-9450-4b2b-8ef4-421420e955f3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:54.952776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-65e0c53c-9450-4b2b-8ef4-421420e955f3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:54.953247 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-65e0c53c-9450-4b2b-8ef4-421420e955f3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:54.953937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-65e0c53c-9450-4b2b-8ef4-421420e955f3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:54.954394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-65e0c53c-9450-4b2b-8ef4-421420e955f3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:54.954815 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-65e0c53c-9450-4b2b-8ef4-421420e955f3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:54.969288 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-65e0c53c-9450-4b2b-8ef4-421420e955f3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] HTTP exception thrown: Instance ec3313f1-edaa-4d8e-8f96-e372ed602086 could not be found. Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-65e0c53c-9450-4b2b-8ef4-421420e955f3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Request method failure captured: Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 HTTP/1.1 Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPbrQKtYWOrgIE3M1fpHMFzvjQh4iLX1nAzEklsHFOch728asjV7SItEDt5qDq-ufTutAq3QkdKbEFAclvkEjD6DmQ6dye6ArfBgrG8mjckzaoUeygHR0aBhtzZzZQl0gGW5mk16tBGgd6IoBji5V99Q_6th4Uy5PRVF9Hx8YdoF6tU Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 713e3a431a2441548123f404b23ce0da Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-TestVolumeBootPattern-847109256 Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713e3a431a2441548123f404b23ce0da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713e3a431a2441548123f404b23ce0da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/713e3a431a2441548123f404b23ce0da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_713e3a431a2441548123f404b23ce0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-TestVolumeBootPattern-847109256 Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 713e3a431a2441548123f404b23ce0da Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-TestVolumeBootPattern-847109256 Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-TestVolumeBootPattern-847109256-project Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: ee8daf94c54c4dd7b69310674d73211a Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-TestVolumeBootPattern-847109256-project Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance ec3313f1-edaa-4d8e-8f96-e372ed602086 could not be found. Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'ec3313f1-edaa-4d8e-8f96-e372ed602086'} Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec3313f1-edaa-4d8e-8f96-e372ed602086 could not be found. Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec3313f1-edaa-4d8e-8f96-e372ed602086 could not be found. Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:17:54.970954 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:17:54.976775 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:17:54.976775 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:17:54.976775 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:17:54.976775 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:17:54.976775 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:17:54.976775 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec3313f1-edaa-4d8e-8f96-e372ed602086 could not be found. Oct 05 03:17:54.976775 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:17:54.976775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-65e0c53c-9450-4b2b-8ef4-421420e955f3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Returning 404 to user: Instance ec3313f1-edaa-4d8e-8f96-e372ed602086 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:17:54.976775 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-65e0c53c-9450-4b2b-8ef4-421420e955f3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 404 len: 111 microversion: 2.1 time: 0.033363 Oct 05 03:17:54.977618 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3364/6741] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:54 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:17:57.128673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f71b253d-ac3b-444d-9d39-8149ef53719a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:57.129229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f71b253d-ac3b-444d-9d39-8149ef53719a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:57.136219 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f71b253d-ac3b-444d-9d39-8149ef53719a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:57.136717 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f71b253d-ac3b-444d-9d39-8149ef53719a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:57.137281 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f71b253d-ac3b-444d-9d39-8149ef53719a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:57.137989 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f71b253d-ac3b-444d-9d39-8149ef53719a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:57.138456 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f71b253d-ac3b-444d-9d39-8149ef53719a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:57.138892 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f71b253d-ac3b-444d-9d39-8149ef53719a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:57.152997 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-f71b253d-ac3b-444d-9d39-8149ef53719a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] HTTP exception thrown: Instance ec3313f1-edaa-4d8e-8f96-e372ed602086 could not be found. Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f71b253d-ac3b-444d-9d39-8149ef53719a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Request method failure captured: Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 HTTP/1.1 Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPbrQKtYWOrgIE3M1fpHMFzvjQh4iLX1nAzEklsHFOch728asjV7SItEDt5qDq-ufTutAq3QkdKbEFAclvkEjD6DmQ6dye6ArfBgrG8mjckzaoUeygHR0aBhtzZzZQl0gGW5mk16tBGgd6IoBji5V99Q_6th4Uy5PRVF9Hx8YdoF6tU Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 713e3a431a2441548123f404b23ce0da Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TestVolumeBootPattern-847109256 Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713e3a431a2441548123f404b23ce0da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713e3a431a2441548123f404b23ce0da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/713e3a431a2441548123f404b23ce0da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_713e3a431a2441548123f404b23ce0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TestVolumeBootPattern-847109256 Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 713e3a431a2441548123f404b23ce0da Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TestVolumeBootPattern-847109256 Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TestVolumeBootPattern-847109256-project Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: ee8daf94c54c4dd7b69310674d73211a Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TestVolumeBootPattern-847109256-project Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance ec3313f1-edaa-4d8e-8f96-e372ed602086 could not be found. Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'ec3313f1-edaa-4d8e-8f96-e372ed602086'} Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec3313f1-edaa-4d8e-8f96-e372ed602086 could not be found. Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:17:57.154733 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:17:57.159394 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec3313f1-edaa-4d8e-8f96-e372ed602086 could not be found. Oct 05 03:17:57.159394 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:17:57.159394 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:17:57.159394 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:17:57.159394 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:17:57.159394 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:17:57.159394 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:17:57.159394 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:17:57.159394 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:17:57.159394 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec3313f1-edaa-4d8e-8f96-e372ed602086 could not be found. Oct 05 03:17:57.159394 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:17:57.159394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f71b253d-ac3b-444d-9d39-8149ef53719a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Returning 404 to user: Instance ec3313f1-edaa-4d8e-8f96-e372ed602086 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:17:57.159394 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f71b253d-ac3b-444d-9d39-8149ef53719a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 404 len: 111 microversion: 2.1 time: 0.031470 Oct 05 03:17:57.159394 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3378/6742] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:17:57 2022] DELETE /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:17:57.165413 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d7b868fe-25a6-4f8e-8a68-2b4a90da8447 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:17:57.166040 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d7b868fe-25a6-4f8e-8a68-2b4a90da8447 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: ec3313f1-edaa-4d8e-8f96-e372ed602086] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:17:57.173074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7b868fe-25a6-4f8e-8a68-2b4a90da8447 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:57.173576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7b868fe-25a6-4f8e-8a68-2b4a90da8447 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:57.174023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7b868fe-25a6-4f8e-8a68-2b4a90da8447 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:57.175012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7b868fe-25a6-4f8e-8a68-2b4a90da8447 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:17:57.175519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7b868fe-25a6-4f8e-8a68-2b4a90da8447 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:17:57.175956 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7b868fe-25a6-4f8e-8a68-2b4a90da8447 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:17:57.189695 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-d7b868fe-25a6-4f8e-8a68-2b4a90da8447 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] HTTP exception thrown: Instance ec3313f1-edaa-4d8e-8f96-e372ed602086 could not be found. Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d7b868fe-25a6-4f8e-8a68-2b4a90da8447 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Request method failure captured: Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 HTTP/1.1 Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPbrQKtYWOrgIE3M1fpHMFzvjQh4iLX1nAzEklsHFOch728asjV7SItEDt5qDq-ufTutAq3QkdKbEFAclvkEjD6DmQ6dye6ArfBgrG8mjckzaoUeygHR0aBhtzZzZQl0gGW5mk16tBGgd6IoBji5V99Q_6th4Uy5PRVF9Hx8YdoF6tU Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 713e3a431a2441548123f404b23ce0da Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-TestVolumeBootPattern-847109256 Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713e3a431a2441548123f404b23ce0da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713e3a431a2441548123f404b23ce0da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/713e3a431a2441548123f404b23ce0da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_713e3a431a2441548123f404b23ce0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-TestVolumeBootPattern-847109256 Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 713e3a431a2441548123f404b23ce0da Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-TestVolumeBootPattern-847109256 Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-TestVolumeBootPattern-847109256-project Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: ee8daf94c54c4dd7b69310674d73211a Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-TestVolumeBootPattern-847109256-project Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance ec3313f1-edaa-4d8e-8f96-e372ed602086 could not be found. Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'ec3313f1-edaa-4d8e-8f96-e372ed602086'} Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec3313f1-edaa-4d8e-8f96-e372ed602086 could not be found. Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec3313f1-edaa-4d8e-8f96-e372ed602086 could not be found. Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:17:57.191383 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:17:57.195653 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:17:57.195653 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:17:57.195653 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:17:57.195653 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:17:57.195653 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:17:57.195653 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec3313f1-edaa-4d8e-8f96-e372ed602086 could not be found. Oct 05 03:17:57.195653 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:17:57.195653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d7b868fe-25a6-4f8e-8a68-2b4a90da8447 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Returning 404 to user: Instance ec3313f1-edaa-4d8e-8f96-e372ed602086 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:17:57.195653 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d7b868fe-25a6-4f8e-8a68-2b4a90da8447 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086" status: 404 len: 111 microversion: 2.1 time: 0.031237 Oct 05 03:17:57.195653 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3365/6743] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:17:57 2022] GET /compute/v2.1/servers/ec3313f1-edaa-4d8e-8f96-e372ed602086 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:18:16.890735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0062e6bf-162b-4072-a28a-8457e7e27aef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-76496993", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "c60817d3-942c-4078-b0b0-700777a60052", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "fa70d413-7436-41df-9105-d3173bf249ed"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:18:16.901172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=11 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:18:16.901854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=27 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:18:16.954650 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-0062e6bf-162b-4072-a28a-8457e7e27aef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] validate_networks() for [('fa70d413-7436-41df-9105-d3173bf249ed', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:18:17.324456 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0062e6bf-162b-4072-a28a-8457e7e27aef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:18:17.324880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0062e6bf-162b-4072-a28a-8457e7e27aef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:18:17.325375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0062e6bf-162b-4072-a28a-8457e7e27aef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:18:17.325784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0062e6bf-162b-4072-a28a-8457e7e27aef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:18:17.326197 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0062e6bf-162b-4072-a28a-8457e7e27aef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:18:17.335534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0062e6bf-162b-4072-a28a-8457e7e27aef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:17.336016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0062e6bf-162b-4072-a28a-8457e7e27aef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:17.336452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0062e6bf-162b-4072-a28a-8457e7e27aef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:17.337208 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0062e6bf-162b-4072-a28a-8457e7e27aef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:17.337669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0062e6bf-162b-4072-a28a-8457e7e27aef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:17.338096 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0062e6bf-162b-4072-a28a-8457e7e27aef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:17.355195 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-0062e6bf-162b-4072-a28a-8457e7e27aef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Getting quotas for project 713e3a431a2441548123f404b23ce0da. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:18:17.360398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-0062e6bf-162b-4072-a28a-8457e7e27aef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Getting quotas for user ee8daf94c54c4dd7b69310674d73211a and project 713e3a431a2441548123f404b23ce0da. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:18:17.418292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0062e6bf-162b-4072-a28a-8457e7e27aef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:18:17.420406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0062e6bf-162b-4072-a28a-8457e7e27aef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c60817d3-942c-4078-b0b0-700777a60052',volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:18:17.551186 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0062e6bf-162b-4072-a28a-8457e7e27aef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.664434 Oct 05 03:18:17.552196 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3379/6744] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:18:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:18:17.562990 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bc88997b-c309-4dce-b388-6e96ac7751cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:17.564262 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bc88997b-c309-4dce-b388-6e96ac7751cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:17.567474 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 03:18:17.567648 n-d-858272-3 devstack@n-api.service[122320]: Wed Oct 5 03:18:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 (ip 10.222.0.16) !!! Oct 05 03:18:17.569315 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=11 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:18:17.570377 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=23 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:18:17.628439 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bc88997b-c309-4dce-b388-6e96ac7751cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:17.636450 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bc88997b-c309-4dce-b388-6e96ac7751cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6" status: 200 len: 1069 microversion: 2.1 time: 0.077331 Oct 05 03:18:17.637027 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3366/6745] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:17 2022] GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 => generated 1069 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:18:18.662632 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2fe983fc-f4c1-4fbf-98e5-b2a0cf738aab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:18.663303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2fe983fc-f4c1-4fbf-98e5-b2a0cf738aab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:18.671458 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fe983fc-f4c1-4fbf-98e5-b2a0cf738aab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:18.671982 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fe983fc-f4c1-4fbf-98e5-b2a0cf738aab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:18.673288 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fe983fc-f4c1-4fbf-98e5-b2a0cf738aab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:18.674235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fe983fc-f4c1-4fbf-98e5-b2a0cf738aab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:18.674660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fe983fc-f4c1-4fbf-98e5-b2a0cf738aab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:18.675525 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2fe983fc-f4c1-4fbf-98e5-b2a0cf738aab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:18.783054 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2fe983fc-f4c1-4fbf-98e5-b2a0cf738aab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:18.791300 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2fe983fc-f4c1-4fbf-98e5-b2a0cf738aab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6" status: 200 len: 1185 microversion: 2.1 time: 0.135137 Oct 05 03:18:18.792103 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3380/6746] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:18 2022] GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 => generated 1185 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:18:19.817257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-798e5b3a-ce00-44cc-aedb-4b15fcae55f0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:19.818612 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-798e5b3a-ce00-44cc-aedb-4b15fcae55f0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:19.825965 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-798e5b3a-ce00-44cc-aedb-4b15fcae55f0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:19.826854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-798e5b3a-ce00-44cc-aedb-4b15fcae55f0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:19.827258 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-798e5b3a-ce00-44cc-aedb-4b15fcae55f0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:19.828193 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-798e5b3a-ce00-44cc-aedb-4b15fcae55f0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:19.828655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-798e5b3a-ce00-44cc-aedb-4b15fcae55f0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:19.829297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-798e5b3a-ce00-44cc-aedb-4b15fcae55f0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:20.046052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-798e5b3a-ce00-44cc-aedb-4b15fcae55f0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:20.055920 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-798e5b3a-ce00-44cc-aedb-4b15fcae55f0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6" status: 200 len: 1227 microversion: 2.1 time: 0.242653 Oct 05 03:18:20.056733 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3367/6747] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:19 2022] GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 => generated 1227 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:18:20.411250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-1aed5be9-ab39-4e7d-acd7-fc252f6ec5c4 req-44d526ad-1cfb-4134-836e-5eb903448ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6", "tag": "8d9e2361-baba-4312-9bbe-facb23dde179"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:18:20.423045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1aed5be9-ab39-4e7d-acd7-fc252f6ec5c4 req-44d526ad-1cfb-4134-836e-5eb903448ef1 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:20.423685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1aed5be9-ab39-4e7d-acd7-fc252f6ec5c4 req-44d526ad-1cfb-4134-836e-5eb903448ef1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:20.424221 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1aed5be9-ab39-4e7d-acd7-fc252f6ec5c4 req-44d526ad-1cfb-4134-836e-5eb903448ef1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:20.436572 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-1aed5be9-ab39-4e7d-acd7-fc252f6ec5c4 req-44d526ad-1cfb-4134-836e-5eb903448ef1 service nova] Creating event network-changed:8d9e2361-baba-4312-9bbe-facb23dde179 for instance 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 on n-h2-858272-3 Oct 05 03:18:20.441998 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-1aed5be9-ab39-4e7d-acd7-fc252f6ec5c4 req-44d526ad-1cfb-4134-836e-5eb903448ef1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035444 Oct 05 03:18:20.442732 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3381/6748] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:18:21.078464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bf408852-111b-4b72-b112-46b5c039af1b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:21.079341 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bf408852-111b-4b72-b112-46b5c039af1b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:21.086484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf408852-111b-4b72-b112-46b5c039af1b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:21.086985 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf408852-111b-4b72-b112-46b5c039af1b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:21.087424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf408852-111b-4b72-b112-46b5c039af1b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:21.088127 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf408852-111b-4b72-b112-46b5c039af1b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:21.088585 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf408852-111b-4b72-b112-46b5c039af1b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:21.089047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf408852-111b-4b72-b112-46b5c039af1b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:21.295111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bf408852-111b-4b72-b112-46b5c039af1b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:21.303767 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bf408852-111b-4b72-b112-46b5c039af1b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6" status: 200 len: 1227 microversion: 2.1 time: 0.229223 Oct 05 03:18:21.304490 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3368/6749] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:21 2022] GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 => generated 1227 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:18:22.330169 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0fb84560-fbbf-4d2c-83b4-4a4ec002a2e5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:22.330925 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0fb84560-fbbf-4d2c-83b4-4a4ec002a2e5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:22.337316 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0fb84560-fbbf-4d2c-83b4-4a4ec002a2e5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:22.337807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0fb84560-fbbf-4d2c-83b4-4a4ec002a2e5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:22.338249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0fb84560-fbbf-4d2c-83b4-4a4ec002a2e5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:22.338977 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0fb84560-fbbf-4d2c-83b4-4a4ec002a2e5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:22.339435 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0fb84560-fbbf-4d2c-83b4-4a4ec002a2e5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:22.339866 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0fb84560-fbbf-4d2c-83b4-4a4ec002a2e5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:22.473984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0fb84560-fbbf-4d2c-83b4-4a4ec002a2e5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:22.481877 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0fb84560-fbbf-4d2c-83b4-4a4ec002a2e5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6" status: 200 len: 1227 microversion: 2.1 time: 0.157755 Oct 05 03:18:22.482540 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3382/6750] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:22 2022] GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 => generated 1227 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:18:23.505308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5c001599-03c7-4eeb-9bf7-7a1dbeffd26e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:23.506003 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5c001599-03c7-4eeb-9bf7-7a1dbeffd26e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:23.513355 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c001599-03c7-4eeb-9bf7-7a1dbeffd26e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:23.513852 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c001599-03c7-4eeb-9bf7-7a1dbeffd26e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:23.514289 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c001599-03c7-4eeb-9bf7-7a1dbeffd26e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:23.514974 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c001599-03c7-4eeb-9bf7-7a1dbeffd26e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:23.515429 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c001599-03c7-4eeb-9bf7-7a1dbeffd26e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:23.516029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c001599-03c7-4eeb-9bf7-7a1dbeffd26e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:23.666075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5c001599-03c7-4eeb-9bf7-7a1dbeffd26e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:23.674028 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5c001599-03c7-4eeb-9bf7-7a1dbeffd26e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6" status: 200 len: 1227 microversion: 2.1 time: 0.172645 Oct 05 03:18:23.674602 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3369/6751] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:23 2022] GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 => generated 1227 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:18:24.697198 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1bc4b07e-b7fd-4d69-a20c-738abbef1ef7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:24.697821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1bc4b07e-b7fd-4d69-a20c-738abbef1ef7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:24.707394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1bc4b07e-b7fd-4d69-a20c-738abbef1ef7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:24.707901 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1bc4b07e-b7fd-4d69-a20c-738abbef1ef7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:24.708347 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1bc4b07e-b7fd-4d69-a20c-738abbef1ef7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:24.709215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1bc4b07e-b7fd-4d69-a20c-738abbef1ef7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:24.709864 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1bc4b07e-b7fd-4d69-a20c-738abbef1ef7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:24.710394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1bc4b07e-b7fd-4d69-a20c-738abbef1ef7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:24.850138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1bc4b07e-b7fd-4d69-a20c-738abbef1ef7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:24.857830 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1bc4b07e-b7fd-4d69-a20c-738abbef1ef7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6" status: 200 len: 1215 microversion: 2.1 time: 0.164658 Oct 05 03:18:24.858418 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3383/6752] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:24 2022] GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 => generated 1215 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:18:25.881943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-64c247d9-11c2-4bd0-90a5-7ba19b826c06 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:25.882593 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-64c247d9-11c2-4bd0-90a5-7ba19b826c06 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:25.889401 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64c247d9-11c2-4bd0-90a5-7ba19b826c06 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:25.889893 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64c247d9-11c2-4bd0-90a5-7ba19b826c06 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:25.890331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64c247d9-11c2-4bd0-90a5-7ba19b826c06 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:25.891017 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64c247d9-11c2-4bd0-90a5-7ba19b826c06 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:25.891499 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64c247d9-11c2-4bd0-90a5-7ba19b826c06 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:25.891922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64c247d9-11c2-4bd0-90a5-7ba19b826c06 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:26.023855 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-64c247d9-11c2-4bd0-90a5-7ba19b826c06 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:26.031528 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-64c247d9-11c2-4bd0-90a5-7ba19b826c06 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6" status: 200 len: 1215 microversion: 2.1 time: 0.153583 Oct 05 03:18:26.032111 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3370/6753] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:25 2022] GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 => generated 1215 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:18:27.055093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4da32f7f-2429-4de0-bfc5-c0f3b6924fd4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:27.055982 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4da32f7f-2429-4de0-bfc5-c0f3b6924fd4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:27.063103 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4da32f7f-2429-4de0-bfc5-c0f3b6924fd4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:27.063590 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4da32f7f-2429-4de0-bfc5-c0f3b6924fd4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:27.065227 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4da32f7f-2429-4de0-bfc5-c0f3b6924fd4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:27.065946 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4da32f7f-2429-4de0-bfc5-c0f3b6924fd4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:27.066416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4da32f7f-2429-4de0-bfc5-c0f3b6924fd4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:27.066855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4da32f7f-2429-4de0-bfc5-c0f3b6924fd4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:27.194781 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4da32f7f-2429-4de0-bfc5-c0f3b6924fd4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:27.202612 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4da32f7f-2429-4de0-bfc5-c0f3b6924fd4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6" status: 200 len: 1215 microversion: 2.1 time: 0.151460 Oct 05 03:18:27.203208 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3384/6754] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:27 2022] GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 => generated 1215 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:18:28.226689 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5aa0bcfd-bf41-494b-99c3-f12554def393 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:28.227206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5aa0bcfd-bf41-494b-99c3-f12554def393 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:28.229979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:18:28.235342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5aa0bcfd-bf41-494b-99c3-f12554def393 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:28.235865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5aa0bcfd-bf41-494b-99c3-f12554def393 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:28.236552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5aa0bcfd-bf41-494b-99c3-f12554def393 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:28.237256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5aa0bcfd-bf41-494b-99c3-f12554def393 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:28.237711 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5aa0bcfd-bf41-494b-99c3-f12554def393 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:28.238134 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5aa0bcfd-bf41-494b-99c3-f12554def393 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:28.369553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5aa0bcfd-bf41-494b-99c3-f12554def393 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:28.378364 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5aa0bcfd-bf41-494b-99c3-f12554def393 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6" status: 200 len: 1215 microversion: 2.1 time: 0.155693 Oct 05 03:18:28.378942 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3371/6755] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:28 2022] GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 => generated 1215 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:18:29.401683 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ea3c03d3-e307-4817-bec2-6293bf7b89f1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:29.402292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ea3c03d3-e307-4817-bec2-6293bf7b89f1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:29.404247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:18:29.404934 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:18:29.412639 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ea3c03d3-e307-4817-bec2-6293bf7b89f1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:29.413156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ea3c03d3-e307-4817-bec2-6293bf7b89f1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:29.413596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ea3c03d3-e307-4817-bec2-6293bf7b89f1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:29.414282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ea3c03d3-e307-4817-bec2-6293bf7b89f1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:29.414738 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ea3c03d3-e307-4817-bec2-6293bf7b89f1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:29.415161 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ea3c03d3-e307-4817-bec2-6293bf7b89f1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:29.549153 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ea3c03d3-e307-4817-bec2-6293bf7b89f1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:29.557041 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ea3c03d3-e307-4817-bec2-6293bf7b89f1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6" status: 200 len: 1215 microversion: 2.1 time: 0.159370 Oct 05 03:18:29.557640 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3385/6756] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:29 2022] GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 => generated 1215 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:18:30.580931 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9b4bceb1-542a-4e9f-9a25-b0783f0f6c3e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:30.581564 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9b4bceb1-542a-4e9f-9a25-b0783f0f6c3e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:30.588531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b4bceb1-542a-4e9f-9a25-b0783f0f6c3e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:30.589060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b4bceb1-542a-4e9f-9a25-b0783f0f6c3e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:30.589504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b4bceb1-542a-4e9f-9a25-b0783f0f6c3e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:30.590194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b4bceb1-542a-4e9f-9a25-b0783f0f6c3e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:30.590658 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b4bceb1-542a-4e9f-9a25-b0783f0f6c3e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:30.591083 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b4bceb1-542a-4e9f-9a25-b0783f0f6c3e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:30.721005 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9b4bceb1-542a-4e9f-9a25-b0783f0f6c3e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:30.728763 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9b4bceb1-542a-4e9f-9a25-b0783f0f6c3e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6" status: 200 len: 1215 microversion: 2.1 time: 0.152288 Oct 05 03:18:30.729443 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3372/6757] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:30 2022] GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 => generated 1215 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:18:31.754538 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e295d2da-054f-4ac0-a02c-2829eb8af99e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:31.755166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e295d2da-054f-4ac0-a02c-2829eb8af99e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:31.763796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e295d2da-054f-4ac0-a02c-2829eb8af99e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:31.764294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e295d2da-054f-4ac0-a02c-2829eb8af99e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:31.764741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e295d2da-054f-4ac0-a02c-2829eb8af99e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:31.765476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e295d2da-054f-4ac0-a02c-2829eb8af99e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:31.765935 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e295d2da-054f-4ac0-a02c-2829eb8af99e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:31.766360 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e295d2da-054f-4ac0-a02c-2829eb8af99e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:31.900231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e295d2da-054f-4ac0-a02c-2829eb8af99e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:31.909967 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e295d2da-054f-4ac0-a02c-2829eb8af99e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6" status: 200 len: 1215 microversion: 2.1 time: 0.161153 Oct 05 03:18:31.910547 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3386/6758] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:31 2022] GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 => generated 1215 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:18:32.932472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5c1e698d-842d-4db5-9ded-d67e2026db82 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:32.933076 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5c1e698d-842d-4db5-9ded-d67e2026db82 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:32.939976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c1e698d-842d-4db5-9ded-d67e2026db82 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:32.940461 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c1e698d-842d-4db5-9ded-d67e2026db82 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:32.940893 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c1e698d-842d-4db5-9ded-d67e2026db82 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:32.941607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c1e698d-842d-4db5-9ded-d67e2026db82 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:32.942060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c1e698d-842d-4db5-9ded-d67e2026db82 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:32.942481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c1e698d-842d-4db5-9ded-d67e2026db82 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:33.070827 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5c1e698d-842d-4db5-9ded-d67e2026db82 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:33.078501 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5c1e698d-842d-4db5-9ded-d67e2026db82 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6" status: 200 len: 1215 microversion: 2.1 time: 0.149993 Oct 05 03:18:33.079609 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3373/6759] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:32 2022] GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 => generated 1215 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:18:33.730851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-87af6b7a-0d73-46bf-8543-4c6999d28d46 req-37a15774-1024-4dad-afb9-fa776d9a98b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6", "name": "network-vif-plugged", "status": "completed", "tag": "8d9e2361-baba-4312-9bbe-facb23dde179"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:18:33.742108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-87af6b7a-0d73-46bf-8543-4c6999d28d46 req-37a15774-1024-4dad-afb9-fa776d9a98b5 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:33.742596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-87af6b7a-0d73-46bf-8543-4c6999d28d46 req-37a15774-1024-4dad-afb9-fa776d9a98b5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:33.743038 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-87af6b7a-0d73-46bf-8543-4c6999d28d46 req-37a15774-1024-4dad-afb9-fa776d9a98b5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:33.755007 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-87af6b7a-0d73-46bf-8543-4c6999d28d46 req-37a15774-1024-4dad-afb9-fa776d9a98b5 service nova] Creating event network-vif-plugged:8d9e2361-baba-4312-9bbe-facb23dde179 for instance 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 on n-h2-858272-3 Oct 05 03:18:33.759969 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-87af6b7a-0d73-46bf-8543-4c6999d28d46 req-37a15774-1024-4dad-afb9-fa776d9a98b5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032842 Oct 05 03:18:33.760763 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3387/6760] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:18:34.102010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cdba25c7-0e53-4b3a-8310-3d5381385727 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:34.102654 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cdba25c7-0e53-4b3a-8310-3d5381385727 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:34.109154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdba25c7-0e53-4b3a-8310-3d5381385727 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:34.109644 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdba25c7-0e53-4b3a-8310-3d5381385727 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:34.110075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdba25c7-0e53-4b3a-8310-3d5381385727 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:34.110755 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdba25c7-0e53-4b3a-8310-3d5381385727 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:34.111462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdba25c7-0e53-4b3a-8310-3d5381385727 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:34.112008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdba25c7-0e53-4b3a-8310-3d5381385727 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:34.243869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cdba25c7-0e53-4b3a-8310-3d5381385727 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:34.251709 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cdba25c7-0e53-4b3a-8310-3d5381385727 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6" status: 200 len: 1215 microversion: 2.1 time: 0.153845 Oct 05 03:18:34.252794 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3374/6761] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:34 2022] GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 => generated 1215 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:18:35.276784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4811a888-00eb-4a89-87c0-776f44a9601a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:35.277443 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4811a888-00eb-4a89-87c0-776f44a9601a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:35.284330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4811a888-00eb-4a89-87c0-776f44a9601a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:35.284841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4811a888-00eb-4a89-87c0-776f44a9601a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:35.285500 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4811a888-00eb-4a89-87c0-776f44a9601a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:35.286221 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4811a888-00eb-4a89-87c0-776f44a9601a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:35.286669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4811a888-00eb-4a89-87c0-776f44a9601a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:35.287101 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4811a888-00eb-4a89-87c0-776f44a9601a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:35.425857 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4811a888-00eb-4a89-87c0-776f44a9601a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:35.433574 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4811a888-00eb-4a89-87c0-776f44a9601a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6" status: 200 len: 1215 microversion: 2.1 time: 0.162065 Oct 05 03:18:35.434146 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3388/6762] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:35 2022] GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 => generated 1215 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:18:36.456407 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-09313252-e452-42d0-a896-7cba0d16297a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:36.457054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-09313252-e452-42d0-a896-7cba0d16297a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:36.463953 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09313252-e452-42d0-a896-7cba0d16297a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:36.464443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09313252-e452-42d0-a896-7cba0d16297a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:36.464878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09313252-e452-42d0-a896-7cba0d16297a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:36.465590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09313252-e452-42d0-a896-7cba0d16297a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:36.466044 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09313252-e452-42d0-a896-7cba0d16297a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:36.466467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09313252-e452-42d0-a896-7cba0d16297a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:36.598687 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-09313252-e452-42d0-a896-7cba0d16297a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:36.606370 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-09313252-e452-42d0-a896-7cba0d16297a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6" status: 200 len: 1402 microversion: 2.1 time: 0.154035 Oct 05 03:18:36.606936 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3375/6763] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:36 2022] GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 => generated 1402 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:18:36.628834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-27bafff6-db11-43c7-a163-776a1c6195f2 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:36.629617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-27bafff6-db11-43c7-a163-776a1c6195f2 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:36.636416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27bafff6-db11-43c7-a163-776a1c6195f2 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:36.636922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27bafff6-db11-43c7-a163-776a1c6195f2 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:36.637365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27bafff6-db11-43c7-a163-776a1c6195f2 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:36.638056 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27bafff6-db11-43c7-a163-776a1c6195f2 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:36.638511 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27bafff6-db11-43c7-a163-776a1c6195f2 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:36.638937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27bafff6-db11-43c7-a163-776a1c6195f2 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:36.768062 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-27bafff6-db11-43c7-a163-776a1c6195f2 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:36.775889 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-27bafff6-db11-43c7-a163-776a1c6195f2 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6" status: 200 len: 1402 microversion: 2.1 time: 0.151067 Oct 05 03:18:36.776462 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3389/6764] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:36 2022] GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 => generated 1402 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:18:36.798286 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9dbea781-d4c4-4d9d-95b2-48265fc096cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-334104105"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:18:36.801241 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9dbea781-d4c4-4d9d-95b2-48265fc096cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:36.807237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9dbea781-d4c4-4d9d-95b2-48265fc096cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:36.807729 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9dbea781-d4c4-4d9d-95b2-48265fc096cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:36.808167 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9dbea781-d4c4-4d9d-95b2-48265fc096cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:36.808856 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9dbea781-d4c4-4d9d-95b2-48265fc096cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:36.809340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9dbea781-d4c4-4d9d-95b2-48265fc096cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:36.809768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9dbea781-d4c4-4d9d-95b2-48265fc096cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:36.906372 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.compute.api [None req-9dbea781-d4c4-4d9d-95b2-48265fc096cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] Attempting to quiesce instance before volume snapshot. Oct 05 03:18:36.983574 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.compute.api [None req-9dbea781-d4c4-4d9d-95b2-48265fc096cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 05 03:18:37.060369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9dbea781-d4c4-4d9d-95b2-48265fc096cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] Creating snapshot from volume c60817d3-942c-4078-b0b0-700777a60052. {{(pid=122320) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 05 03:18:37.891868 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9dbea781-d4c4-4d9d-95b2-48265fc096cc tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "POST /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6/action" status: 202 len: 0 microversion: 2.1 time: 1.097433 Oct 05 03:18:37.896267 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3376/6765] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:18:36 2022] POST /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6/action => generated 0 bytes in 1099 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 05 03:18:39.048340 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d6c0e7f1-698c-40f0-a5d6-aa43bed09e3e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-668717167", "imageRef": "1a5b18b8-a051-45fc-9b46-5b07c47382f3", "flavorRef": "452", "networks": [{"uuid": "fa70d413-7436-41df-9105-d3173bf249ed"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:18:39.104444 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-d6c0e7f1-698c-40f0-a5d6-aa43bed09e3e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] validate_networks() for [('fa70d413-7436-41df-9105-d3173bf249ed', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:18:39.467843 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-d6c0e7f1-698c-40f0-a5d6-aa43bed09e3e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:18:39.468608 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-d6c0e7f1-698c-40f0-a5d6-aa43bed09e3e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:18:39.469128 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-d6c0e7f1-698c-40f0-a5d6-aa43bed09e3e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:18:39.469553 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-d6c0e7f1-698c-40f0-a5d6-aa43bed09e3e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:18:39.469969 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-d6c0e7f1-698c-40f0-a5d6-aa43bed09e3e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:18:39.479776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d6c0e7f1-698c-40f0-a5d6-aa43bed09e3e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:39.480265 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d6c0e7f1-698c-40f0-a5d6-aa43bed09e3e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:39.480705 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d6c0e7f1-698c-40f0-a5d6-aa43bed09e3e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:39.481501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d6c0e7f1-698c-40f0-a5d6-aa43bed09e3e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:39.481964 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d6c0e7f1-698c-40f0-a5d6-aa43bed09e3e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:39.482392 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d6c0e7f1-698c-40f0-a5d6-aa43bed09e3e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:39.503545 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-d6c0e7f1-698c-40f0-a5d6-aa43bed09e3e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Getting quotas for project 713e3a431a2441548123f404b23ce0da. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:18:39.508771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-d6c0e7f1-698c-40f0-a5d6-aa43bed09e3e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Getting quotas for user ee8daf94c54c4dd7b69310674d73211a and project 713e3a431a2441548123f404b23ce0da. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:18:39.521104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d6c0e7f1-698c-40f0-a5d6-aa43bed09e3e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:18:39.523674 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d6c0e7f1-698c-40f0-a5d6-aa43bed09e3e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='e63a9403-0c7a-4310-b744-0f26c42bfa49',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:18:39.600183 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d6c0e7f1-698c-40f0-a5d6-aa43bed09e3e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.555485 Oct 05 03:18:39.600848 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3390/6766] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:18:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:18:39.614423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a3880dee-dc54-4771-ad1d-3eccf64d6b45 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:39.615255 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a3880dee-dc54-4771-ad1d-3eccf64d6b45 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:39.676670 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a3880dee-dc54-4771-ad1d-3eccf64d6b45 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:39.683537 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a3880dee-dc54-4771-ad1d-3eccf64d6b45 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 200 len: 1229 microversion: 2.1 time: 0.075209 Oct 05 03:18:39.684180 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3377/6767] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:39 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 1229 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:18:40.706138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b0fa54a1-7b7c-4cd2-82cb-c5e15f9e5721 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:40.706860 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b0fa54a1-7b7c-4cd2-82cb-c5e15f9e5721 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:40.713960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0fa54a1-7b7c-4cd2-82cb-c5e15f9e5721 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:40.714447 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0fa54a1-7b7c-4cd2-82cb-c5e15f9e5721 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:40.714887 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0fa54a1-7b7c-4cd2-82cb-c5e15f9e5721 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:40.715582 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0fa54a1-7b7c-4cd2-82cb-c5e15f9e5721 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:40.716034 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0fa54a1-7b7c-4cd2-82cb-c5e15f9e5721 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:40.716621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b0fa54a1-7b7c-4cd2-82cb-c5e15f9e5721 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:40.796332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b0fa54a1-7b7c-4cd2-82cb-c5e15f9e5721 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:40.805264 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b0fa54a1-7b7c-4cd2-82cb-c5e15f9e5721 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 200 len: 1299 microversion: 2.1 time: 0.103065 Oct 05 03:18:40.805938 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3391/6768] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:40 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 1299 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:18:41.829761 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7ca1aaf2-beb9-4beb-a7fc-7b459e3e305f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:41.832090 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7ca1aaf2-beb9-4beb-a7fc-7b459e3e305f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:41.841092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7ca1aaf2-beb9-4beb-a7fc-7b459e3e305f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:41.841849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7ca1aaf2-beb9-4beb-a7fc-7b459e3e305f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:41.842506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7ca1aaf2-beb9-4beb-a7fc-7b459e3e305f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:41.843674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7ca1aaf2-beb9-4beb-a7fc-7b459e3e305f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:41.844319 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7ca1aaf2-beb9-4beb-a7fc-7b459e3e305f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:41.845032 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7ca1aaf2-beb9-4beb-a7fc-7b459e3e305f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:42.177896 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7ca1aaf2-beb9-4beb-a7fc-7b459e3e305f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:42.187721 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7ca1aaf2-beb9-4beb-a7fc-7b459e3e305f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 200 len: 1341 microversion: 2.1 time: 0.362571 Oct 05 03:18:42.201850 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3378/6769] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:41 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 1341 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:18:42.309958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-24562d85-b121-41fa-9582-77075347db34 req-d49f4b6e-1b03-4cd7-82ab-2924df3b7d86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83caa943-6f58-4395-8000-559e9594be5d", "tag": "a6b79c48-d30d-4906-96bb-1d69756c19da"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:18:42.328127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-24562d85-b121-41fa-9582-77075347db34 req-d49f4b6e-1b03-4cd7-82ab-2924df3b7d86 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:42.329500 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-24562d85-b121-41fa-9582-77075347db34 req-d49f4b6e-1b03-4cd7-82ab-2924df3b7d86 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:42.331266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-24562d85-b121-41fa-9582-77075347db34 req-d49f4b6e-1b03-4cd7-82ab-2924df3b7d86 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:42.345825 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-24562d85-b121-41fa-9582-77075347db34 req-d49f4b6e-1b03-4cd7-82ab-2924df3b7d86 service nova] Creating event network-changed:a6b79c48-d30d-4906-96bb-1d69756c19da for instance 83caa943-6f58-4395-8000-559e9594be5d on n-h1-858272-3 Oct 05 03:18:42.354269 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-24562d85-b121-41fa-9582-77075347db34 req-d49f4b6e-1b03-4cd7-82ab-2924df3b7d86 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049457 Oct 05 03:18:42.356117 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3392/6770] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:18:43.212488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-63a9b65f-0af8-4de3-a8c5-e24f5caaa30a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:43.213869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-63a9b65f-0af8-4de3-a8c5-e24f5caaa30a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:43.220964 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63a9b65f-0af8-4de3-a8c5-e24f5caaa30a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:43.222303 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63a9b65f-0af8-4de3-a8c5-e24f5caaa30a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:43.222904 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63a9b65f-0af8-4de3-a8c5-e24f5caaa30a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:43.227146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63a9b65f-0af8-4de3-a8c5-e24f5caaa30a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:43.227146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63a9b65f-0af8-4de3-a8c5-e24f5caaa30a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:43.227146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-63a9b65f-0af8-4de3-a8c5-e24f5caaa30a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:43.419047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-63a9b65f-0af8-4de3-a8c5-e24f5caaa30a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:43.426527 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-63a9b65f-0af8-4de3-a8c5-e24f5caaa30a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 200 len: 1341 microversion: 2.1 time: 0.217950 Oct 05 03:18:43.427112 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3379/6771] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:43 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 1341 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:18:44.450527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4eff9eac-bbd3-43c2-ab1f-036ea945ccf1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:44.451919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4eff9eac-bbd3-43c2-ab1f-036ea945ccf1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:44.460188 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4eff9eac-bbd3-43c2-ab1f-036ea945ccf1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:44.460957 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4eff9eac-bbd3-43c2-ab1f-036ea945ccf1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:44.461711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4eff9eac-bbd3-43c2-ab1f-036ea945ccf1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:44.462440 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4eff9eac-bbd3-43c2-ab1f-036ea945ccf1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:44.463069 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4eff9eac-bbd3-43c2-ab1f-036ea945ccf1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:44.463668 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4eff9eac-bbd3-43c2-ab1f-036ea945ccf1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:44.647298 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4eff9eac-bbd3-43c2-ab1f-036ea945ccf1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:44.656371 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4eff9eac-bbd3-43c2-ab1f-036ea945ccf1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 200 len: 1341 microversion: 2.1 time: 0.210303 Oct 05 03:18:44.656997 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3393/6772] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:44 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 1341 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:18:45.681969 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c8ed800b-de7e-4d30-b613-280c40b4d41a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:45.682781 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c8ed800b-de7e-4d30-b613-280c40b4d41a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:45.691712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8ed800b-de7e-4d30-b613-280c40b4d41a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:45.692790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8ed800b-de7e-4d30-b613-280c40b4d41a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:45.693453 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8ed800b-de7e-4d30-b613-280c40b4d41a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:45.694284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8ed800b-de7e-4d30-b613-280c40b4d41a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:45.694645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8ed800b-de7e-4d30-b613-280c40b4d41a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:45.695087 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8ed800b-de7e-4d30-b613-280c40b4d41a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:45.879589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c8ed800b-de7e-4d30-b613-280c40b4d41a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:45.887965 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c8ed800b-de7e-4d30-b613-280c40b4d41a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 200 len: 1341 microversion: 2.1 time: 0.210692 Oct 05 03:18:45.888542 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3380/6773] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:45 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 1341 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:18:46.919048 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4613cf72-ab6b-408b-9806-2bcdc571e3fd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:46.919818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4613cf72-ab6b-408b-9806-2bcdc571e3fd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:46.923169 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:18:46.932771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4613cf72-ab6b-408b-9806-2bcdc571e3fd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:46.933439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4613cf72-ab6b-408b-9806-2bcdc571e3fd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:46.933940 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4613cf72-ab6b-408b-9806-2bcdc571e3fd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:46.934789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4613cf72-ab6b-408b-9806-2bcdc571e3fd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:46.935251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4613cf72-ab6b-408b-9806-2bcdc571e3fd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:46.935791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4613cf72-ab6b-408b-9806-2bcdc571e3fd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:46.938745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=71 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:18:47.100268 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4613cf72-ab6b-408b-9806-2bcdc571e3fd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:47.107085 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4613cf72-ab6b-408b-9806-2bcdc571e3fd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 200 len: 1341 microversion: 2.1 time: 0.192614 Oct 05 03:18:47.120960 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3394/6774] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:46 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 1341 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:18:48.131559 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ff478031-94fd-4999-a9cf-8d73fcfbd602 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:48.132809 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ff478031-94fd-4999-a9cf-8d73fcfbd602 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:48.137082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=35 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:18:48.142132 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff478031-94fd-4999-a9cf-8d73fcfbd602 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:48.143264 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff478031-94fd-4999-a9cf-8d73fcfbd602 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:48.143728 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff478031-94fd-4999-a9cf-8d73fcfbd602 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:48.144941 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff478031-94fd-4999-a9cf-8d73fcfbd602 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:48.145625 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff478031-94fd-4999-a9cf-8d73fcfbd602 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:48.146288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff478031-94fd-4999-a9cf-8d73fcfbd602 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:48.152184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:18:48.379704 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ff478031-94fd-4999-a9cf-8d73fcfbd602 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:48.389915 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ff478031-94fd-4999-a9cf-8d73fcfbd602 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 200 len: 1341 microversion: 2.1 time: 0.262950 Oct 05 03:18:48.390507 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3381/6775] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:48 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 1341 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:18:49.415802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9d6d13c8-705f-4ad4-a540-6c862225fd83 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:49.416433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9d6d13c8-705f-4ad4-a540-6c862225fd83 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:49.423123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d6d13c8-705f-4ad4-a540-6c862225fd83 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:49.423677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d6d13c8-705f-4ad4-a540-6c862225fd83 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:49.424640 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d6d13c8-705f-4ad4-a540-6c862225fd83 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:49.425389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d6d13c8-705f-4ad4-a540-6c862225fd83 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:49.425857 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d6d13c8-705f-4ad4-a540-6c862225fd83 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:49.426294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d6d13c8-705f-4ad4-a540-6c862225fd83 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:49.491070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:18:49.515026 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:18:49.557574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9d6d13c8-705f-4ad4-a540-6c862225fd83 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:49.565405 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9d6d13c8-705f-4ad4-a540-6c862225fd83 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 200 len: 1341 microversion: 2.1 time: 0.153604 Oct 05 03:18:49.565981 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3395/6776] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:49 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 1341 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:18:50.588322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9e7cf009-f5a4-4d9d-a359-2ed567374280 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:50.588979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9e7cf009-f5a4-4d9d-a359-2ed567374280 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:50.591777 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:18:50.597433 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e7cf009-f5a4-4d9d-a359-2ed567374280 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:50.597940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e7cf009-f5a4-4d9d-a359-2ed567374280 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:50.598392 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e7cf009-f5a4-4d9d-a359-2ed567374280 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:50.599100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e7cf009-f5a4-4d9d-a359-2ed567374280 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:50.599574 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e7cf009-f5a4-4d9d-a359-2ed567374280 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:50.600012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e7cf009-f5a4-4d9d-a359-2ed567374280 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:50.737410 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9e7cf009-f5a4-4d9d-a359-2ed567374280 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:50.745232 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9e7cf009-f5a4-4d9d-a359-2ed567374280 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 200 len: 1341 microversion: 2.1 time: 0.160820 Oct 05 03:18:50.745834 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3382/6777] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:50 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 1341 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:18:51.768934 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-be827ca6-8ddf-4ffa-9da9-da6cda9be2a7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:51.769772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-be827ca6-8ddf-4ffa-9da9-da6cda9be2a7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:51.777455 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be827ca6-8ddf-4ffa-9da9-da6cda9be2a7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:51.777949 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be827ca6-8ddf-4ffa-9da9-da6cda9be2a7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:51.778556 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be827ca6-8ddf-4ffa-9da9-da6cda9be2a7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:51.779268 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be827ca6-8ddf-4ffa-9da9-da6cda9be2a7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:51.779725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be827ca6-8ddf-4ffa-9da9-da6cda9be2a7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:51.780175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be827ca6-8ddf-4ffa-9da9-da6cda9be2a7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:51.918227 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-be827ca6-8ddf-4ffa-9da9-da6cda9be2a7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:51.927148 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-be827ca6-8ddf-4ffa-9da9-da6cda9be2a7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 200 len: 1341 microversion: 2.1 time: 0.163280 Oct 05 03:18:51.927757 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3396/6778] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:51 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 1341 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:18:52.950523 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-37edd56a-b4d4-41fe-ba53-d0f5a06b63c1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:52.951170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-37edd56a-b4d4-41fe-ba53-d0f5a06b63c1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:52.958319 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-37edd56a-b4d4-41fe-ba53-d0f5a06b63c1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:52.958808 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-37edd56a-b4d4-41fe-ba53-d0f5a06b63c1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:52.959257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-37edd56a-b4d4-41fe-ba53-d0f5a06b63c1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:52.959961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-37edd56a-b4d4-41fe-ba53-d0f5a06b63c1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:52.960423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-37edd56a-b4d4-41fe-ba53-d0f5a06b63c1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:52.960853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-37edd56a-b4d4-41fe-ba53-d0f5a06b63c1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:53.108160 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-37edd56a-b4d4-41fe-ba53-d0f5a06b63c1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:53.117041 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-37edd56a-b4d4-41fe-ba53-d0f5a06b63c1 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 200 len: 1341 microversion: 2.1 time: 0.170370 Oct 05 03:18:53.117622 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3383/6779] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:52 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 1341 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:18:54.142616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-98498982-1070-4040-a42f-a67db96d8613 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:54.143310 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-98498982-1070-4040-a42f-a67db96d8613 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:54.150390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98498982-1070-4040-a42f-a67db96d8613 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:54.150880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98498982-1070-4040-a42f-a67db96d8613 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:54.151323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98498982-1070-4040-a42f-a67db96d8613 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:54.152023 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98498982-1070-4040-a42f-a67db96d8613 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:54.152481 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98498982-1070-4040-a42f-a67db96d8613 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:54.152924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98498982-1070-4040-a42f-a67db96d8613 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:54.612519 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-98498982-1070-4040-a42f-a67db96d8613 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:54.621765 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-98498982-1070-4040-a42f-a67db96d8613 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 200 len: 1341 microversion: 2.1 time: 0.483278 Oct 05 03:18:54.622484 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3397/6780] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:54 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 1341 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:18:55.644727 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3428c2d3-7179-4ad5-86bc-078f9060cc3b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:55.645416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3428c2d3-7179-4ad5-86bc-078f9060cc3b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:55.652424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3428c2d3-7179-4ad5-86bc-078f9060cc3b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:55.652952 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3428c2d3-7179-4ad5-86bc-078f9060cc3b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:55.653412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3428c2d3-7179-4ad5-86bc-078f9060cc3b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:55.654127 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3428c2d3-7179-4ad5-86bc-078f9060cc3b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:55.654601 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3428c2d3-7179-4ad5-86bc-078f9060cc3b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:55.655044 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3428c2d3-7179-4ad5-86bc-078f9060cc3b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:55.785943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3428c2d3-7179-4ad5-86bc-078f9060cc3b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:55.793594 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3428c2d3-7179-4ad5-86bc-078f9060cc3b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 200 len: 1375 microversion: 2.1 time: 0.152858 Oct 05 03:18:55.794170 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3384/6781] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:55 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 1375 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:18:56.816873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9a58e3a0-f9d6-4c62-87ef-378cab7bf6c3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:56.817513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9a58e3a0-f9d6-4c62-87ef-378cab7bf6c3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:56.824934 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a58e3a0-f9d6-4c62-87ef-378cab7bf6c3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:56.825419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a58e3a0-f9d6-4c62-87ef-378cab7bf6c3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:56.825860 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a58e3a0-f9d6-4c62-87ef-378cab7bf6c3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:56.826551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a58e3a0-f9d6-4c62-87ef-378cab7bf6c3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:56.827046 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a58e3a0-f9d6-4c62-87ef-378cab7bf6c3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:56.827472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a58e3a0-f9d6-4c62-87ef-378cab7bf6c3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:56.963340 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9a58e3a0-f9d6-4c62-87ef-378cab7bf6c3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:56.971975 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9a58e3a0-f9d6-4c62-87ef-378cab7bf6c3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 200 len: 1375 microversion: 2.1 time: 0.159600 Oct 05 03:18:56.972644 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3398/6782] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:56 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:18:57.996053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2a8b4f2f-e384-4790-921e-62152bd90415 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:57.996625 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2a8b4f2f-e384-4790-921e-62152bd90415 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:58.003515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2a8b4f2f-e384-4790-921e-62152bd90415 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:58.004772 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2a8b4f2f-e384-4790-921e-62152bd90415 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:58.005402 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2a8b4f2f-e384-4790-921e-62152bd90415 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:58.006196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2a8b4f2f-e384-4790-921e-62152bd90415 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:58.006589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2a8b4f2f-e384-4790-921e-62152bd90415 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:58.007037 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2a8b4f2f-e384-4790-921e-62152bd90415 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:58.141469 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2a8b4f2f-e384-4790-921e-62152bd90415 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:58.150528 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2a8b4f2f-e384-4790-921e-62152bd90415 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 200 len: 1375 microversion: 2.1 time: 0.158373 Oct 05 03:18:58.151115 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3385/6783] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:57 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:18:59.176382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-594ca80a-4d68-4a6a-94af-715fe774c321 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:18:59.177030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-594ca80a-4d68-4a6a-94af-715fe774c321 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:18:59.184511 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-594ca80a-4d68-4a6a-94af-715fe774c321 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:59.185198 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-594ca80a-4d68-4a6a-94af-715fe774c321 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:59.185746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-594ca80a-4d68-4a6a-94af-715fe774c321 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:59.186615 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-594ca80a-4d68-4a6a-94af-715fe774c321 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:18:59.187153 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-594ca80a-4d68-4a6a-94af-715fe774c321 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:18:59.187760 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-594ca80a-4d68-4a6a-94af-715fe774c321 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:18:59.331511 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-594ca80a-4d68-4a6a-94af-715fe774c321 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:18:59.340774 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-594ca80a-4d68-4a6a-94af-715fe774c321 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 200 len: 1375 microversion: 2.1 time: 0.170043 Oct 05 03:18:59.341502 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3399/6784] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:18:59 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:19:00.364044 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e0512c7e-81ff-42da-96b9-82ff0fe7ed7e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:00.364772 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e0512c7e-81ff-42da-96b9-82ff0fe7ed7e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:00.371620 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0512c7e-81ff-42da-96b9-82ff0fe7ed7e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:00.372119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0512c7e-81ff-42da-96b9-82ff0fe7ed7e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:00.372571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0512c7e-81ff-42da-96b9-82ff0fe7ed7e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:00.373290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0512c7e-81ff-42da-96b9-82ff0fe7ed7e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:00.373761 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0512c7e-81ff-42da-96b9-82ff0fe7ed7e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:00.374222 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0512c7e-81ff-42da-96b9-82ff0fe7ed7e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:00.515896 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e0512c7e-81ff-42da-96b9-82ff0fe7ed7e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:19:00.523753 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e0512c7e-81ff-42da-96b9-82ff0fe7ed7e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 200 len: 1375 microversion: 2.1 time: 0.163883 Oct 05 03:19:00.524323 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3386/6785] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:00 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:19:01.546563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f17bf5dd-a1a1-4916-a5ef-3d09e50b056d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:01.547179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f17bf5dd-a1a1-4916-a5ef-3d09e50b056d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:01.554839 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f17bf5dd-a1a1-4916-a5ef-3d09e50b056d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:01.555323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f17bf5dd-a1a1-4916-a5ef-3d09e50b056d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:01.555758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f17bf5dd-a1a1-4916-a5ef-3d09e50b056d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:01.556452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f17bf5dd-a1a1-4916-a5ef-3d09e50b056d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:01.556935 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f17bf5dd-a1a1-4916-a5ef-3d09e50b056d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:01.557345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f17bf5dd-a1a1-4916-a5ef-3d09e50b056d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:01.689445 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f17bf5dd-a1a1-4916-a5ef-3d09e50b056d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:19:01.698835 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f17bf5dd-a1a1-4916-a5ef-3d09e50b056d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 200 len: 1375 microversion: 2.1 time: 0.156117 Oct 05 03:19:01.699481 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3400/6786] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:01 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:19:02.723082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-15a4c307-3b68-430a-9b83-aea877604720 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:02.723706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-15a4c307-3b68-430a-9b83-aea877604720 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:02.730736 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-15a4c307-3b68-430a-9b83-aea877604720 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:02.731232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-15a4c307-3b68-430a-9b83-aea877604720 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:02.731680 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-15a4c307-3b68-430a-9b83-aea877604720 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:02.732373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-15a4c307-3b68-430a-9b83-aea877604720 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:02.732838 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-15a4c307-3b68-430a-9b83-aea877604720 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:02.733297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-15a4c307-3b68-430a-9b83-aea877604720 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:02.874812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-15a4c307-3b68-430a-9b83-aea877604720 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:19:02.884155 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-15a4c307-3b68-430a-9b83-aea877604720 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 200 len: 1375 microversion: 2.1 time: 0.164928 Oct 05 03:19:02.884752 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3387/6787] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:02 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:19:03.908372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5bf560d8-5117-4382-bd83-66176306ae79 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:03.909072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5bf560d8-5117-4382-bd83-66176306ae79 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:03.916497 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5bf560d8-5117-4382-bd83-66176306ae79 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:03.917031 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5bf560d8-5117-4382-bd83-66176306ae79 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:03.917587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5bf560d8-5117-4382-bd83-66176306ae79 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:03.918221 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5bf560d8-5117-4382-bd83-66176306ae79 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:03.918680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5bf560d8-5117-4382-bd83-66176306ae79 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:03.919135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5bf560d8-5117-4382-bd83-66176306ae79 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:04.055560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5bf560d8-5117-4382-bd83-66176306ae79 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:19:04.064153 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5bf560d8-5117-4382-bd83-66176306ae79 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 200 len: 1375 microversion: 2.1 time: 0.159914 Oct 05 03:19:04.064772 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3401/6788] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:03 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:19:05.088720 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1227d601-9bf2-4eb8-8f54-1355304ad8d4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:05.089469 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1227d601-9bf2-4eb8-8f54-1355304ad8d4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:05.096186 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1227d601-9bf2-4eb8-8f54-1355304ad8d4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:05.096692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1227d601-9bf2-4eb8-8f54-1355304ad8d4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:05.097177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1227d601-9bf2-4eb8-8f54-1355304ad8d4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:05.097956 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1227d601-9bf2-4eb8-8f54-1355304ad8d4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:05.098460 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1227d601-9bf2-4eb8-8f54-1355304ad8d4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:05.098924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1227d601-9bf2-4eb8-8f54-1355304ad8d4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:05.244086 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1227d601-9bf2-4eb8-8f54-1355304ad8d4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:19:05.252450 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1227d601-9bf2-4eb8-8f54-1355304ad8d4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 200 len: 1375 microversion: 2.1 time: 0.168269 Oct 05 03:19:05.253087 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3388/6789] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:05 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:19:06.277324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-59f3a9e0-32bb-4ea2-9e71-533aaf3b940e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:06.277853 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-59f3a9e0-32bb-4ea2-9e71-533aaf3b940e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:06.284395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-59f3a9e0-32bb-4ea2-9e71-533aaf3b940e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:06.284889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-59f3a9e0-32bb-4ea2-9e71-533aaf3b940e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:06.285356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-59f3a9e0-32bb-4ea2-9e71-533aaf3b940e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:06.286073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-59f3a9e0-32bb-4ea2-9e71-533aaf3b940e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:06.286516 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-59f3a9e0-32bb-4ea2-9e71-533aaf3b940e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:06.286948 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-59f3a9e0-32bb-4ea2-9e71-533aaf3b940e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:06.414775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-59f3a9e0-32bb-4ea2-9e71-533aaf3b940e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:19:06.422497 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-59f3a9e0-32bb-4ea2-9e71-533aaf3b940e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 200 len: 1375 microversion: 2.1 time: 0.149692 Oct 05 03:19:06.423069 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3402/6790] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:06 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 1375 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:19:07.449377 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4d3a4ee2-391a-4ed9-b641-7faed343fc15 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:07.450013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4d3a4ee2-391a-4ed9-b641-7faed343fc15 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:07.457047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d3a4ee2-391a-4ed9-b641-7faed343fc15 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:07.457557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d3a4ee2-391a-4ed9-b641-7faed343fc15 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:07.458009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d3a4ee2-391a-4ed9-b641-7faed343fc15 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:07.458724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d3a4ee2-391a-4ed9-b641-7faed343fc15 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:07.459195 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d3a4ee2-391a-4ed9-b641-7faed343fc15 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:07.459859 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4d3a4ee2-391a-4ed9-b641-7faed343fc15 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:07.616360 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-6a055e12-5ddd-4f50-b278-bb2ed81dcf4c req-e85e75e3-f8c2-4984-890c-e14aadfef936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83caa943-6f58-4395-8000-559e9594be5d", "name": "network-vif-plugged", "status": "completed", "tag": "a6b79c48-d30d-4906-96bb-1d69756c19da"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:19:07.624204 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4d3a4ee2-391a-4ed9-b641-7faed343fc15 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:19:07.629088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6a055e12-5ddd-4f50-b278-bb2ed81dcf4c req-e85e75e3-f8c2-4984-890c-e14aadfef936 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:07.629659 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6a055e12-5ddd-4f50-b278-bb2ed81dcf4c req-e85e75e3-f8c2-4984-890c-e14aadfef936 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:07.630391 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6a055e12-5ddd-4f50-b278-bb2ed81dcf4c req-e85e75e3-f8c2-4984-890c-e14aadfef936 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:07.638186 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4d3a4ee2-391a-4ed9-b641-7faed343fc15 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 200 len: 1375 microversion: 2.1 time: 0.194379 Oct 05 03:19:07.639518 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3389/6791] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:07 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 1375 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:19:07.654652 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-6a055e12-5ddd-4f50-b278-bb2ed81dcf4c req-e85e75e3-f8c2-4984-890c-e14aadfef936 service nova] Creating event network-vif-plugged:a6b79c48-d30d-4906-96bb-1d69756c19da for instance 83caa943-6f58-4395-8000-559e9594be5d on n-h1-858272-3 Oct 05 03:19:07.660148 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-6a055e12-5ddd-4f50-b278-bb2ed81dcf4c req-e85e75e3-f8c2-4984-890c-e14aadfef936 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047375 Oct 05 03:19:07.662703 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3403/6792] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:19:08.665690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-07aa8bc1-be34-4530-b648-8ee6425dbfde tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:08.666307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-07aa8bc1-be34-4530-b648-8ee6425dbfde tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:08.673398 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07aa8bc1-be34-4530-b648-8ee6425dbfde tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:08.673898 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07aa8bc1-be34-4530-b648-8ee6425dbfde tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:08.674340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07aa8bc1-be34-4530-b648-8ee6425dbfde tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:08.675044 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07aa8bc1-be34-4530-b648-8ee6425dbfde tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:08.675512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07aa8bc1-be34-4530-b648-8ee6425dbfde tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:08.675946 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-07aa8bc1-be34-4530-b648-8ee6425dbfde tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:08.806124 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-07aa8bc1-be34-4530-b648-8ee6425dbfde tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:19:08.813868 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-07aa8bc1-be34-4530-b648-8ee6425dbfde tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 200 len: 1375 microversion: 2.1 time: 0.152691 Oct 05 03:19:08.814447 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3390/6793] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:08 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 1375 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:19:09.838467 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0335e9c0-0dd9-4226-bb66-80f83aef318f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:09.839177 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0335e9c0-0dd9-4226-bb66-80f83aef318f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:09.845502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0335e9c0-0dd9-4226-bb66-80f83aef318f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:09.845995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0335e9c0-0dd9-4226-bb66-80f83aef318f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:09.846435 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0335e9c0-0dd9-4226-bb66-80f83aef318f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:09.847156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0335e9c0-0dd9-4226-bb66-80f83aef318f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:09.847592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0335e9c0-0dd9-4226-bb66-80f83aef318f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:09.848018 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0335e9c0-0dd9-4226-bb66-80f83aef318f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:09.981548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0335e9c0-0dd9-4226-bb66-80f83aef318f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:19:09.989789 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0335e9c0-0dd9-4226-bb66-80f83aef318f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 200 len: 1562 microversion: 2.1 time: 0.156557 Oct 05 03:19:09.990363 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3404/6794] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:09 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:19:10.012774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0de55d2d-fe71-4011-9530-a185bf87068c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:10.013464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0de55d2d-fe71-4011-9530-a185bf87068c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:10.020230 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0de55d2d-fe71-4011-9530-a185bf87068c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:10.020737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0de55d2d-fe71-4011-9530-a185bf87068c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:10.021233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0de55d2d-fe71-4011-9530-a185bf87068c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:10.021945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0de55d2d-fe71-4011-9530-a185bf87068c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:10.022423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0de55d2d-fe71-4011-9530-a185bf87068c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:10.022867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0de55d2d-fe71-4011-9530-a185bf87068c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:10.150527 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0de55d2d-fe71-4011-9530-a185bf87068c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:19:10.158395 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0de55d2d-fe71-4011-9530-a185bf87068c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 200 len: 1562 microversion: 2.1 time: 0.149504 Oct 05 03:19:10.158979 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3391/6795] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:10 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:19:10.243092 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5c9e2e82-cfe2-49a7-a999-e458081ee440 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:10.243785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5c9e2e82-cfe2-49a7-a999-e458081ee440 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:10.250317 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c9e2e82-cfe2-49a7-a999-e458081ee440 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:10.250812 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c9e2e82-cfe2-49a7-a999-e458081ee440 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:10.251253 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c9e2e82-cfe2-49a7-a999-e458081ee440 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:10.251954 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c9e2e82-cfe2-49a7-a999-e458081ee440 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:10.252416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c9e2e82-cfe2-49a7-a999-e458081ee440 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:10.252847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c9e2e82-cfe2-49a7-a999-e458081ee440 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:10.279527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5c9e2e82-cfe2-49a7-a999-e458081ee440 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:19:10.356546 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5c9e2e82-cfe2-49a7-a999-e458081ee440 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "DELETE /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 204 len: 0 microversion: 2.1 time: 0.117142 Oct 05 03:19:10.357100 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3405/6796] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:19:10 2022] DELETE /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:19:10.365508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6bec63e6-f3a4-44c3-a6b9-8ebe0fb620bf tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:10.366141 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6bec63e6-f3a4-44c3-a6b9-8ebe0fb620bf tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:10.372172 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6bec63e6-f3a4-44c3-a6b9-8ebe0fb620bf tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:10.372674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6bec63e6-f3a4-44c3-a6b9-8ebe0fb620bf tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:10.373155 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6bec63e6-f3a4-44c3-a6b9-8ebe0fb620bf tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:10.373860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6bec63e6-f3a4-44c3-a6b9-8ebe0fb620bf tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:10.374335 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6bec63e6-f3a4-44c3-a6b9-8ebe0fb620bf tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:10.374775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6bec63e6-f3a4-44c3-a6b9-8ebe0fb620bf tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:10.506665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6bec63e6-f3a4-44c3-a6b9-8ebe0fb620bf tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:19:10.514847 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6bec63e6-f3a4-44c3-a6b9-8ebe0fb620bf tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 200 len: 1568 microversion: 2.1 time: 0.153127 Oct 05 03:19:10.515462 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3392/6797] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:10 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:19:11.542191 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-62a3c397-23ab-48f8-bc31-59b3daf9278e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:11.542919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-62a3c397-23ab-48f8-bc31-59b3daf9278e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:11.549693 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62a3c397-23ab-48f8-bc31-59b3daf9278e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:11.550176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62a3c397-23ab-48f8-bc31-59b3daf9278e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:11.550609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62a3c397-23ab-48f8-bc31-59b3daf9278e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:11.551292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62a3c397-23ab-48f8-bc31-59b3daf9278e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:11.551746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62a3c397-23ab-48f8-bc31-59b3daf9278e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:11.552164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62a3c397-23ab-48f8-bc31-59b3daf9278e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:11.686330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-62a3c397-23ab-48f8-bc31-59b3daf9278e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:19:11.694197 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-62a3c397-23ab-48f8-bc31-59b3daf9278e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 200 len: 1568 microversion: 2.1 time: 0.157032 Oct 05 03:19:11.694961 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3406/6798] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:11 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:19:12.574502 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-34325c56-4ed4-4cdd-84d7-d3e6d0667386 req-2824edf3-d3c5-4644-a4df-cbe369309568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83caa943-6f58-4395-8000-559e9594be5d", "name": "network-vif-deleted", "tag": "a6b79c48-d30d-4906-96bb-1d69756c19da"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:19:12.596784 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-34325c56-4ed4-4cdd-84d7-d3e6d0667386 req-2824edf3-d3c5-4644-a4df-cbe369309568 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:12.597803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-34325c56-4ed4-4cdd-84d7-d3e6d0667386 req-2824edf3-d3c5-4644-a4df-cbe369309568 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:12.598468 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-34325c56-4ed4-4cdd-84d7-d3e6d0667386 req-2824edf3-d3c5-4644-a4df-cbe369309568 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:12.615774 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-34325c56-4ed4-4cdd-84d7-d3e6d0667386 req-2824edf3-d3c5-4644-a4df-cbe369309568 service nova] Creating event network-vif-deleted:a6b79c48-d30d-4906-96bb-1d69756c19da for instance 83caa943-6f58-4395-8000-559e9594be5d on n-h1-858272-3 Oct 05 03:19:12.622563 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-34325c56-4ed4-4cdd-84d7-d3e6d0667386 req-2824edf3-d3c5-4644-a4df-cbe369309568 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054469 Oct 05 03:19:12.623651 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3393/6799] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:19:12.719700 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3fdc23ce-a2b5-4346-b8b7-2b36e4579c79 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:12.720483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3fdc23ce-a2b5-4346-b8b7-2b36e4579c79 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:12.728460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3fdc23ce-a2b5-4346-b8b7-2b36e4579c79 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:12.729203 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3fdc23ce-a2b5-4346-b8b7-2b36e4579c79 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:12.729659 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3fdc23ce-a2b5-4346-b8b7-2b36e4579c79 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:12.730519 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3fdc23ce-a2b5-4346-b8b7-2b36e4579c79 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:12.731005 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3fdc23ce-a2b5-4346-b8b7-2b36e4579c79 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:12.731421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3fdc23ce-a2b5-4346-b8b7-2b36e4579c79 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:12.800016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3fdc23ce-a2b5-4346-b8b7-2b36e4579c79 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:19:12.809088 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3fdc23ce-a2b5-4346-b8b7-2b36e4579c79 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 200 len: 1360 microversion: 2.1 time: 0.093242 Oct 05 03:19:12.809800 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3407/6800] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:12 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 1360 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:19:13.836356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8e466655-12e5-4933-8c59-8545cca55988 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:13.838857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8e466655-12e5-4933-8c59-8545cca55988 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:13.846576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e466655-12e5-4933-8c59-8545cca55988 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:13.847080 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e466655-12e5-4933-8c59-8545cca55988 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:13.847672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e466655-12e5-4933-8c59-8545cca55988 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:13.848394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e466655-12e5-4933-8c59-8545cca55988 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:13.849007 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e466655-12e5-4933-8c59-8545cca55988 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:13.849445 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e466655-12e5-4933-8c59-8545cca55988 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:13.921546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8e466655-12e5-4933-8c59-8545cca55988 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:19:13.930465 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8e466655-12e5-4933-8c59-8545cca55988 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 200 len: 1360 microversion: 2.1 time: 0.100185 Oct 05 03:19:13.931125 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3394/6801] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:13 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 1360 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:19:14.954343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-acdd03cf-656f-43ea-a5ed-010ffc9c50b0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:14.955020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-acdd03cf-656f-43ea-a5ed-010ffc9c50b0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:14.963894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-acdd03cf-656f-43ea-a5ed-010ffc9c50b0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:14.964104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-acdd03cf-656f-43ea-a5ed-010ffc9c50b0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:14.964876 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-acdd03cf-656f-43ea-a5ed-010ffc9c50b0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:14.965619 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-acdd03cf-656f-43ea-a5ed-010ffc9c50b0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:14.966090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-acdd03cf-656f-43ea-a5ed-010ffc9c50b0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:14.966556 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-acdd03cf-656f-43ea-a5ed-010ffc9c50b0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:15.042491 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-acdd03cf-656f-43ea-a5ed-010ffc9c50b0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:19:15.051585 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-acdd03cf-656f-43ea-a5ed-010ffc9c50b0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 200 len: 1360 microversion: 2.1 time: 0.101532 Oct 05 03:19:15.052292 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3408/6802] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:14 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 1360 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:19:16.076436 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-68aae22a-2fed-41d3-a654-8a6a41e60408 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:16.077093 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-68aae22a-2fed-41d3-a654-8a6a41e60408 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:16.084030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68aae22a-2fed-41d3-a654-8a6a41e60408 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:16.084535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68aae22a-2fed-41d3-a654-8a6a41e60408 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:16.085049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68aae22a-2fed-41d3-a654-8a6a41e60408 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:16.085759 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68aae22a-2fed-41d3-a654-8a6a41e60408 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:16.086234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68aae22a-2fed-41d3-a654-8a6a41e60408 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:16.086675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68aae22a-2fed-41d3-a654-8a6a41e60408 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:16.156496 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-68aae22a-2fed-41d3-a654-8a6a41e60408 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:19:16.165041 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-68aae22a-2fed-41d3-a654-8a6a41e60408 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 200 len: 1360 microversion: 2.1 time: 0.092677 Oct 05 03:19:16.165711 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3395/6803] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:16 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 1360 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:19:17.189399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-82c01fc2-6787-4cee-9364-bde628b780ac tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:17.189946 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-82c01fc2-6787-4cee-9364-bde628b780ac tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:17.192798 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:19:17.198694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-82c01fc2-6787-4cee-9364-bde628b780ac tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:17.199193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-82c01fc2-6787-4cee-9364-bde628b780ac tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:17.199643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-82c01fc2-6787-4cee-9364-bde628b780ac tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:17.200351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-82c01fc2-6787-4cee-9364-bde628b780ac tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:17.200815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-82c01fc2-6787-4cee-9364-bde628b780ac tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:17.201272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-82c01fc2-6787-4cee-9364-bde628b780ac tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:17.206270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:19:17.247010 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-82c01fc2-6787-4cee-9364-bde628b780ac tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:17.247520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-82c01fc2-6787-4cee-9364-bde628b780ac tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:17.247951 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-82c01fc2-6787-4cee-9364-bde628b780ac tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:17.248407 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-82c01fc2-6787-4cee-9364-bde628b780ac tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lazy-loading 'fault' on Instance uuid 83caa943-6f58-4395-8000-559e9594be5d {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:19:17.290285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-82c01fc2-6787-4cee-9364-bde628b780ac tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:19:17.298234 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-82c01fc2-6787-4cee-9364-bde628b780ac tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 200 len: 1365 microversion: 2.1 time: 0.112881 Oct 05 03:19:17.298823 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3409/6804] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:17 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 1365 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:19:18.322550 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-596b7b15-789c-4a93-a683-eaa1e41a67f0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:18.323195 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-596b7b15-789c-4a93-a683-eaa1e41a67f0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:18.326168 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=30 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:19:18.331891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-596b7b15-789c-4a93-a683-eaa1e41a67f0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:18.332416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-596b7b15-789c-4a93-a683-eaa1e41a67f0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:18.332877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-596b7b15-789c-4a93-a683-eaa1e41a67f0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:18.333644 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-596b7b15-789c-4a93-a683-eaa1e41a67f0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:18.334124 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-596b7b15-789c-4a93-a683-eaa1e41a67f0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:18.334570 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-596b7b15-789c-4a93-a683-eaa1e41a67f0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:18.338638 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=86 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:19:18.350902 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-596b7b15-789c-4a93-a683-eaa1e41a67f0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] HTTP exception thrown: Instance 83caa943-6f58-4395-8000-559e9594be5d could not be found. Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-596b7b15-789c-4a93-a683-eaa1e41a67f0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Request method failure captured: Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d HTTP/1.1 Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPbrQKtYWOrgIE3M1fpHMFzvjQh4iLX1nAzEklsHFOch728asjV7SItEDt5qDq-ufTutAq3QkdKbEFAclvkEjD6DmQ6dye6ArfBgrG8mjckzaoUeygHR0aBhtzZzZQl0gGW5mk16tBGgd6IoBji5V99Q_6th4Uy5PRVF9Hx8YdoF6tU Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 713e3a431a2441548123f404b23ce0da Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-TestVolumeBootPattern-847109256 Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713e3a431a2441548123f404b23ce0da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713e3a431a2441548123f404b23ce0da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/713e3a431a2441548123f404b23ce0da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_713e3a431a2441548123f404b23ce0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-TestVolumeBootPattern-847109256 Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 713e3a431a2441548123f404b23ce0da Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-TestVolumeBootPattern-847109256 Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-TestVolumeBootPattern-847109256-project Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: ee8daf94c54c4dd7b69310674d73211a Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-TestVolumeBootPattern-847109256-project Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 83caa943-6f58-4395-8000-559e9594be5d could not be found. Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '83caa943-6f58-4395-8000-559e9594be5d'} Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83caa943-6f58-4395-8000-559e9594be5d could not be found. Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83caa943-6f58-4395-8000-559e9594be5d could not be found. Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:19:18.352823 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:19:18.357393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:19:18.357393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:19:18.357393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:19:18.357393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:19:18.357393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:19:18.357393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83caa943-6f58-4395-8000-559e9594be5d could not be found. Oct 05 03:19:18.357393 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:19:18.357393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-596b7b15-789c-4a93-a683-eaa1e41a67f0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Returning 404 to user: Instance 83caa943-6f58-4395-8000-559e9594be5d could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:19:18.357393 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-596b7b15-789c-4a93-a683-eaa1e41a67f0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 404 len: 111 microversion: 2.1 time: 0.036513 Oct 05 03:19:18.357393 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3396/6805] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:18 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:19:22.635966 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-32b39ec6-50de-4357-b643-1da362d494d4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:22.636472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-32b39ec6-50de-4357-b643-1da362d494d4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:22.643141 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32b39ec6-50de-4357-b643-1da362d494d4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:22.643630 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32b39ec6-50de-4357-b643-1da362d494d4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:22.644072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32b39ec6-50de-4357-b643-1da362d494d4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:22.644770 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32b39ec6-50de-4357-b643-1da362d494d4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:22.645275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32b39ec6-50de-4357-b643-1da362d494d4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:22.645703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32b39ec6-50de-4357-b643-1da362d494d4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:22.672404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-32b39ec6-50de-4357-b643-1da362d494d4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:19:22.747297 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-32b39ec6-50de-4357-b643-1da362d494d4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "DELETE /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6" status: 204 len: 0 microversion: 2.1 time: 0.115015 Oct 05 03:19:22.747959 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3410/6806] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:19:22 2022] DELETE /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:19:22.756143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f02e93da-38cd-4fbf-84fa-aba12836214a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:22.757448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f02e93da-38cd-4fbf-84fa-aba12836214a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:22.764330 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f02e93da-38cd-4fbf-84fa-aba12836214a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:22.764835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f02e93da-38cd-4fbf-84fa-aba12836214a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:22.765314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f02e93da-38cd-4fbf-84fa-aba12836214a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:22.766016 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f02e93da-38cd-4fbf-84fa-aba12836214a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:22.766486 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f02e93da-38cd-4fbf-84fa-aba12836214a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:22.766925 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f02e93da-38cd-4fbf-84fa-aba12836214a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:22.895746 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f02e93da-38cd-4fbf-84fa-aba12836214a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:19:22.904491 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f02e93da-38cd-4fbf-84fa-aba12836214a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6" status: 200 len: 1408 microversion: 2.1 time: 0.152273 Oct 05 03:19:22.905095 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3397/6807] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:22 2022] GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:19:23.928234 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-90c43a40-4ba7-4ae9-8829-c1392429e757 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:23.929026 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-90c43a40-4ba7-4ae9-8829-c1392429e757 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:23.937811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-90c43a40-4ba7-4ae9-8829-c1392429e757 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:23.938296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-90c43a40-4ba7-4ae9-8829-c1392429e757 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:23.938733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-90c43a40-4ba7-4ae9-8829-c1392429e757 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:23.939419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-90c43a40-4ba7-4ae9-8829-c1392429e757 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:23.939870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-90c43a40-4ba7-4ae9-8829-c1392429e757 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:23.940293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-90c43a40-4ba7-4ae9-8829-c1392429e757 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:24.074386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-90c43a40-4ba7-4ae9-8829-c1392429e757 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:19:24.082741 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-90c43a40-4ba7-4ae9-8829-c1392429e757 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6" status: 200 len: 1408 microversion: 2.1 time: 0.158847 Oct 05 03:19:24.083331 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3411/6808] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:23 2022] GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:19:25.107068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-52355461-26cd-4fe0-93b6-f855db4775fa tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:25.108255 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-52355461-26cd-4fe0-93b6-f855db4775fa tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:25.117724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52355461-26cd-4fe0-93b6-f855db4775fa tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:25.120575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52355461-26cd-4fe0-93b6-f855db4775fa tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:25.120575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52355461-26cd-4fe0-93b6-f855db4775fa tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:25.120575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52355461-26cd-4fe0-93b6-f855db4775fa tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:25.120575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52355461-26cd-4fe0-93b6-f855db4775fa tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:25.120575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52355461-26cd-4fe0-93b6-f855db4775fa tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:25.153521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-b9748717-7ac9-479c-86f9-0c7af4d2b38b req-4f2fba5f-ee42-41f2-9d1e-5ed8bfea0ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6", "name": "network-vif-deleted", "tag": "8d9e2361-baba-4312-9bbe-facb23dde179"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:19:25.164141 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b9748717-7ac9-479c-86f9-0c7af4d2b38b req-4f2fba5f-ee42-41f2-9d1e-5ed8bfea0ec6 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:25.164968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b9748717-7ac9-479c-86f9-0c7af4d2b38b req-4f2fba5f-ee42-41f2-9d1e-5ed8bfea0ec6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:25.165373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b9748717-7ac9-479c-86f9-0c7af4d2b38b req-4f2fba5f-ee42-41f2-9d1e-5ed8bfea0ec6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:25.177514 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-b9748717-7ac9-479c-86f9-0c7af4d2b38b req-4f2fba5f-ee42-41f2-9d1e-5ed8bfea0ec6 service nova] Creating event network-vif-deleted:8d9e2361-baba-4312-9bbe-facb23dde179 for instance 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 on n-h2-858272-3 Oct 05 03:19:25.183983 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-b9748717-7ac9-479c-86f9-0c7af4d2b38b req-4f2fba5f-ee42-41f2-9d1e-5ed8bfea0ec6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034141 Oct 05 03:19:25.184863 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3412/6809] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:19:25.206311 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-52355461-26cd-4fe0-93b6-f855db4775fa tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:19:25.215200 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-52355461-26cd-4fe0-93b6-f855db4775fa tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6" status: 200 len: 1366 microversion: 2.1 time: 0.112207 Oct 05 03:19:25.215831 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3398/6810] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:25 2022] GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 => generated 1366 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:19:26.241104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ac901e36-bf23-44f5-8c22-a91b0bae835a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:26.242082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ac901e36-bf23-44f5-8c22-a91b0bae835a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:26.248140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac901e36-bf23-44f5-8c22-a91b0bae835a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:26.248627 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac901e36-bf23-44f5-8c22-a91b0bae835a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:26.249101 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac901e36-bf23-44f5-8c22-a91b0bae835a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:26.249804 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac901e36-bf23-44f5-8c22-a91b0bae835a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:26.250259 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac901e36-bf23-44f5-8c22-a91b0bae835a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:26.250686 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac901e36-bf23-44f5-8c22-a91b0bae835a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:26.313785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ac901e36-bf23-44f5-8c22-a91b0bae835a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:19:26.322358 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ac901e36-bf23-44f5-8c22-a91b0bae835a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6" status: 200 len: 1200 microversion: 2.1 time: 0.086888 Oct 05 03:19:26.322937 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3413/6811] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:26 2022] GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 => generated 1200 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:19:27.346863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1e449be2-c8c4-4bdd-9a2c-d1f305f8ef7f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:27.347504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1e449be2-c8c4-4bdd-9a2c-d1f305f8ef7f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:27.355032 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e449be2-c8c4-4bdd-9a2c-d1f305f8ef7f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:27.355552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e449be2-c8c4-4bdd-9a2c-d1f305f8ef7f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:27.356006 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e449be2-c8c4-4bdd-9a2c-d1f305f8ef7f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:27.356725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e449be2-c8c4-4bdd-9a2c-d1f305f8ef7f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:27.357228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e449be2-c8c4-4bdd-9a2c-d1f305f8ef7f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:27.357676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e449be2-c8c4-4bdd-9a2c-d1f305f8ef7f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:27.421064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1e449be2-c8c4-4bdd-9a2c-d1f305f8ef7f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:19:27.429568 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1e449be2-c8c4-4bdd-9a2c-d1f305f8ef7f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6" status: 200 len: 1200 microversion: 2.1 time: 0.086522 Oct 05 03:19:27.430152 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3399/6812] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:27 2022] GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 => generated 1200 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:19:28.452635 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-149b2998-57db-4238-ae31-f04d69a104ef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:28.453285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-149b2998-57db-4238-ae31-f04d69a104ef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:28.460153 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-149b2998-57db-4238-ae31-f04d69a104ef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:28.460650 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-149b2998-57db-4238-ae31-f04d69a104ef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:28.461130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-149b2998-57db-4238-ae31-f04d69a104ef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:28.461839 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-149b2998-57db-4238-ae31-f04d69a104ef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:28.462297 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-149b2998-57db-4238-ae31-f04d69a104ef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:28.462731 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-149b2998-57db-4238-ae31-f04d69a104ef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:28.525207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-149b2998-57db-4238-ae31-f04d69a104ef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:19:28.533183 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-149b2998-57db-4238-ae31-f04d69a104ef tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6" status: 200 len: 1200 microversion: 2.1 time: 0.084579 Oct 05 03:19:28.533761 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3414/6813] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:28 2022] GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 => generated 1200 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:19:29.555380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4dbb6f1b-9da0-43e9-9c35-73b09b42c168 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:29.556012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4dbb6f1b-9da0-43e9-9c35-73b09b42c168 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:29.562930 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4dbb6f1b-9da0-43e9-9c35-73b09b42c168 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:29.563432 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4dbb6f1b-9da0-43e9-9c35-73b09b42c168 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:29.563885 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4dbb6f1b-9da0-43e9-9c35-73b09b42c168 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:29.564596 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4dbb6f1b-9da0-43e9-9c35-73b09b42c168 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:29.565113 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4dbb6f1b-9da0-43e9-9c35-73b09b42c168 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:29.565562 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4dbb6f1b-9da0-43e9-9c35-73b09b42c168 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:29.596731 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4dbb6f1b-9da0-43e9-9c35-73b09b42c168 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:29.597275 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4dbb6f1b-9da0-43e9-9c35-73b09b42c168 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:29.597727 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4dbb6f1b-9da0-43e9-9c35-73b09b42c168 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:29.598185 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-4dbb6f1b-9da0-43e9-9c35-73b09b42c168 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lazy-loading 'fault' on Instance uuid 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:19:29.648475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4dbb6f1b-9da0-43e9-9c35-73b09b42c168 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:19:29.660673 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4dbb6f1b-9da0-43e9-9c35-73b09b42c168 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6" status: 200 len: 1205 microversion: 2.1 time: 0.108957 Oct 05 03:19:29.662251 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3400/6814] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:29 2022] GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 => generated 1205 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:19:30.688490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9ec75e2a-cc4b-4e1c-afba-2bda7b610b5b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:30.689255 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9ec75e2a-cc4b-4e1c-afba-2bda7b610b5b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:30.698260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ec75e2a-cc4b-4e1c-afba-2bda7b610b5b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:30.698765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ec75e2a-cc4b-4e1c-afba-2bda7b610b5b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:30.699216 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ec75e2a-cc4b-4e1c-afba-2bda7b610b5b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:30.699935 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ec75e2a-cc4b-4e1c-afba-2bda7b610b5b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:30.700397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ec75e2a-cc4b-4e1c-afba-2bda7b610b5b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:30.700829 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ec75e2a-cc4b-4e1c-afba-2bda7b610b5b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:30.716411 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-9ec75e2a-cc4b-4e1c-afba-2bda7b610b5b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] HTTP exception thrown: Instance 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 could not be found. Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9ec75e2a-cc4b-4e1c-afba-2bda7b610b5b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Request method failure captured: Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 HTTP/1.1 Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPbrQKtYWOrgIE3M1fpHMFzvjQh4iLX1nAzEklsHFOch728asjV7SItEDt5qDq-ufTutAq3QkdKbEFAclvkEjD6DmQ6dye6ArfBgrG8mjckzaoUeygHR0aBhtzZzZQl0gGW5mk16tBGgd6IoBji5V99Q_6th4Uy5PRVF9Hx8YdoF6tU Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 713e3a431a2441548123f404b23ce0da Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TestVolumeBootPattern-847109256 Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713e3a431a2441548123f404b23ce0da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713e3a431a2441548123f404b23ce0da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/713e3a431a2441548123f404b23ce0da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_713e3a431a2441548123f404b23ce0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TestVolumeBootPattern-847109256 Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 713e3a431a2441548123f404b23ce0da Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TestVolumeBootPattern-847109256 Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TestVolumeBootPattern-847109256-project Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: ee8daf94c54c4dd7b69310674d73211a Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TestVolumeBootPattern-847109256-project Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 could not be found. Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6'} Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 could not be found. Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 could not be found. Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:19:30.718127 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:19:30.721938 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:19:30.721938 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:19:30.721938 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:19:30.721938 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:19:30.721938 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:19:30.721938 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 could not be found. Oct 05 03:19:30.721938 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:19:30.721938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9ec75e2a-cc4b-4e1c-afba-2bda7b610b5b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Returning 404 to user: Instance 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:19:30.721938 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9ec75e2a-cc4b-4e1c-afba-2bda7b610b5b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6" status: 404 len: 111 microversion: 2.1 time: 0.035089 Oct 05 03:19:30.721938 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3415/6815] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:30 2022] GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 03:19:32.864517 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ab99df07-00e6-4425-b42d-6726b896c117 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:32.865062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ab99df07-00e6-4425-b42d-6726b896c117 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:32.872312 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ab99df07-00e6-4425-b42d-6726b896c117 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:32.872807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ab99df07-00e6-4425-b42d-6726b896c117 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:32.873283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ab99df07-00e6-4425-b42d-6726b896c117 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:32.873988 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ab99df07-00e6-4425-b42d-6726b896c117 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:32.874453 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ab99df07-00e6-4425-b42d-6726b896c117 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:32.874887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ab99df07-00e6-4425-b42d-6726b896c117 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:32.890165 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-ab99df07-00e6-4425-b42d-6726b896c117 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] HTTP exception thrown: Instance 83caa943-6f58-4395-8000-559e9594be5d could not be found. Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ab99df07-00e6-4425-b42d-6726b896c117 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Request method failure captured: Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d HTTP/1.1 Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPbrQKtYWOrgIE3M1fpHMFzvjQh4iLX1nAzEklsHFOch728asjV7SItEDt5qDq-ufTutAq3QkdKbEFAclvkEjD6DmQ6dye6ArfBgrG8mjckzaoUeygHR0aBhtzZzZQl0gGW5mk16tBGgd6IoBji5V99Q_6th4Uy5PRVF9Hx8YdoF6tU Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 713e3a431a2441548123f404b23ce0da Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-TestVolumeBootPattern-847109256 Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713e3a431a2441548123f404b23ce0da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713e3a431a2441548123f404b23ce0da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/713e3a431a2441548123f404b23ce0da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_713e3a431a2441548123f404b23ce0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-TestVolumeBootPattern-847109256 Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 713e3a431a2441548123f404b23ce0da Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-TestVolumeBootPattern-847109256 Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-TestVolumeBootPattern-847109256-project Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: ee8daf94c54c4dd7b69310674d73211a Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-TestVolumeBootPattern-847109256-project Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 83caa943-6f58-4395-8000-559e9594be5d could not be found. Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '83caa943-6f58-4395-8000-559e9594be5d'} Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83caa943-6f58-4395-8000-559e9594be5d could not be found. Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:19:32.891665 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:19:32.895940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83caa943-6f58-4395-8000-559e9594be5d could not be found. Oct 05 03:19:32.895940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:19:32.895940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:19:32.895940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:19:32.895940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:19:32.895940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:19:32.895940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:19:32.895940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:19:32.895940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:19:32.895940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83caa943-6f58-4395-8000-559e9594be5d could not be found. Oct 05 03:19:32.895940 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:19:32.895940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ab99df07-00e6-4425-b42d-6726b896c117 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Returning 404 to user: Instance 83caa943-6f58-4395-8000-559e9594be5d could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:19:32.895940 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ab99df07-00e6-4425-b42d-6726b896c117 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "DELETE /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 404 len: 111 microversion: 2.1 time: 0.032568 Oct 05 03:19:32.898046 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3401/6816] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:19:32 2022] DELETE /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:19:32.903110 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ef174d1f-83f9-4e45-bfe3-6b0045d2972f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:32.903738 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ef174d1f-83f9-4e45-bfe3-6b0045d2972f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 83caa943-6f58-4395-8000-559e9594be5d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:32.911689 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef174d1f-83f9-4e45-bfe3-6b0045d2972f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:32.912828 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef174d1f-83f9-4e45-bfe3-6b0045d2972f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:32.913355 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef174d1f-83f9-4e45-bfe3-6b0045d2972f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:32.914078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef174d1f-83f9-4e45-bfe3-6b0045d2972f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:32.914548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef174d1f-83f9-4e45-bfe3-6b0045d2972f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:32.914992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef174d1f-83f9-4e45-bfe3-6b0045d2972f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:32.933118 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-ef174d1f-83f9-4e45-bfe3-6b0045d2972f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] HTTP exception thrown: Instance 83caa943-6f58-4395-8000-559e9594be5d could not be found. Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ef174d1f-83f9-4e45-bfe3-6b0045d2972f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Request method failure captured: Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d HTTP/1.1 Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPbrQKtYWOrgIE3M1fpHMFzvjQh4iLX1nAzEklsHFOch728asjV7SItEDt5qDq-ufTutAq3QkdKbEFAclvkEjD6DmQ6dye6ArfBgrG8mjckzaoUeygHR0aBhtzZzZQl0gGW5mk16tBGgd6IoBji5V99Q_6th4Uy5PRVF9Hx8YdoF6tU Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 713e3a431a2441548123f404b23ce0da Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TestVolumeBootPattern-847109256 Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713e3a431a2441548123f404b23ce0da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713e3a431a2441548123f404b23ce0da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/713e3a431a2441548123f404b23ce0da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_713e3a431a2441548123f404b23ce0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TestVolumeBootPattern-847109256 Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 713e3a431a2441548123f404b23ce0da Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TestVolumeBootPattern-847109256 Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TestVolumeBootPattern-847109256-project Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: ee8daf94c54c4dd7b69310674d73211a Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TestVolumeBootPattern-847109256-project Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 83caa943-6f58-4395-8000-559e9594be5d could not be found. Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '83caa943-6f58-4395-8000-559e9594be5d'} Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83caa943-6f58-4395-8000-559e9594be5d could not be found. Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83caa943-6f58-4395-8000-559e9594be5d could not be found. Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:19:32.934780 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:19:32.941848 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:19:32.941848 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:19:32.941848 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:19:32.941848 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:19:32.941848 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:19:32.941848 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83caa943-6f58-4395-8000-559e9594be5d could not be found. Oct 05 03:19:32.941848 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:19:32.941848 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ef174d1f-83f9-4e45-bfe3-6b0045d2972f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Returning 404 to user: Instance 83caa943-6f58-4395-8000-559e9594be5d could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:19:32.941848 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ef174d1f-83f9-4e45-bfe3-6b0045d2972f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d" status: 404 len: 111 microversion: 2.1 time: 0.037092 Oct 05 03:19:32.941848 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3416/6817] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:32 2022] GET /compute/v2.1/servers/83caa943-6f58-4395-8000-559e9594be5d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:19:33.328740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-96caacd5-e9d3-4809-9c3b-9883dd405b0d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:33.329302 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-96caacd5-e9d3-4809-9c3b-9883dd405b0d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:33.336011 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96caacd5-e9d3-4809-9c3b-9883dd405b0d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:33.336510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96caacd5-e9d3-4809-9c3b-9883dd405b0d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:33.337018 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96caacd5-e9d3-4809-9c3b-9883dd405b0d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:33.337722 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96caacd5-e9d3-4809-9c3b-9883dd405b0d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:33.338196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96caacd5-e9d3-4809-9c3b-9883dd405b0d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:33.338631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96caacd5-e9d3-4809-9c3b-9883dd405b0d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:33.359912 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-96caacd5-e9d3-4809-9c3b-9883dd405b0d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] HTTP exception thrown: Instance 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 could not be found. Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-96caacd5-e9d3-4809-9c3b-9883dd405b0d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Request method failure captured: Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 HTTP/1.1 Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPbrQKtYWOrgIE3M1fpHMFzvjQh4iLX1nAzEklsHFOch728asjV7SItEDt5qDq-ufTutAq3QkdKbEFAclvkEjD6DmQ6dye6ArfBgrG8mjckzaoUeygHR0aBhtzZzZQl0gGW5mk16tBGgd6IoBji5V99Q_6th4Uy5PRVF9Hx8YdoF6tU Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 713e3a431a2441548123f404b23ce0da Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-TestVolumeBootPattern-847109256 Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713e3a431a2441548123f404b23ce0da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713e3a431a2441548123f404b23ce0da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/713e3a431a2441548123f404b23ce0da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_713e3a431a2441548123f404b23ce0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-TestVolumeBootPattern-847109256 Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 713e3a431a2441548123f404b23ce0da Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-TestVolumeBootPattern-847109256 Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-TestVolumeBootPattern-847109256-project Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: ee8daf94c54c4dd7b69310674d73211a Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-TestVolumeBootPattern-847109256-project Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 could not be found. Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6'} Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 could not be found. Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:19:33.361533 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:19:33.365836 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 could not be found. Oct 05 03:19:33.365836 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:19:33.365836 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:19:33.365836 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:19:33.365836 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:19:33.365836 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:19:33.365836 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:19:33.365836 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:19:33.365836 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:19:33.365836 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 could not be found. Oct 05 03:19:33.365836 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:19:33.365836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-96caacd5-e9d3-4809-9c3b-9883dd405b0d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Returning 404 to user: Instance 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:19:33.365836 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-96caacd5-e9d3-4809-9c3b-9883dd405b0d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "DELETE /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6" status: 404 len: 111 microversion: 2.1 time: 0.038152 Oct 05 03:19:33.365836 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3402/6818] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:19:33 2022] DELETE /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:19:33.371846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d625bc7b-088d-4d89-82e2-1ebe5582d320 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:33.372472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d625bc7b-088d-4d89-82e2-1ebe5582d320 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:33.378662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d625bc7b-088d-4d89-82e2-1ebe5582d320 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:33.379150 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d625bc7b-088d-4d89-82e2-1ebe5582d320 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:33.379594 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d625bc7b-088d-4d89-82e2-1ebe5582d320 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:33.380284 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d625bc7b-088d-4d89-82e2-1ebe5582d320 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:33.381259 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d625bc7b-088d-4d89-82e2-1ebe5582d320 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:33.381694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d625bc7b-088d-4d89-82e2-1ebe5582d320 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:33.395239 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-d625bc7b-088d-4d89-82e2-1ebe5582d320 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] HTTP exception thrown: Instance 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 could not be found. Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d625bc7b-088d-4d89-82e2-1ebe5582d320 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Request method failure captured: Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 HTTP/1.1 Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPbrQKtYWOrgIE3M1fpHMFzvjQh4iLX1nAzEklsHFOch728asjV7SItEDt5qDq-ufTutAq3QkdKbEFAclvkEjD6DmQ6dye6ArfBgrG8mjckzaoUeygHR0aBhtzZzZQl0gGW5mk16tBGgd6IoBji5V99Q_6th4Uy5PRVF9Hx8YdoF6tU Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 713e3a431a2441548123f404b23ce0da Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TestVolumeBootPattern-847109256 Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713e3a431a2441548123f404b23ce0da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713e3a431a2441548123f404b23ce0da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/713e3a431a2441548123f404b23ce0da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_713e3a431a2441548123f404b23ce0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TestVolumeBootPattern-847109256 Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 713e3a431a2441548123f404b23ce0da Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TestVolumeBootPattern-847109256 Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TestVolumeBootPattern-847109256-project Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: ee8daf94c54c4dd7b69310674d73211a Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TestVolumeBootPattern-847109256-project Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 could not be found. Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6'} Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 could not be found. Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 could not be found. Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:19:33.397414 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:19:33.401761 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:19:33.401761 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:19:33.401761 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:19:33.401761 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:19:33.401761 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:19:33.401761 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 could not be found. Oct 05 03:19:33.401761 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:19:33.401761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d625bc7b-088d-4d89-82e2-1ebe5582d320 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Returning 404 to user: Instance 98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:19:33.401761 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d625bc7b-088d-4d89-82e2-1ebe5582d320 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6" status: 404 len: 111 microversion: 2.1 time: 0.030827 Oct 05 03:19:33.401761 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3417/6819] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:33 2022] GET /compute/v2.1/servers/98a49701-6cdb-4c7a-bcb5-014a2dc9d9c6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:19:33.472494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-62bd397f-99fe-46ec-b3ab-56f39a9d3a94 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Action: 'create', calling method: .version_select at 0x7fccdfd16af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-383498722", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGw1mzl7cyodkSCHGTcsM49njDYmOUUoapb3OwNB9ghqvPn40w7MoaC8Ka3DBmXwg7UmUu+pKS6JcOX4YmKIwrGmc2MSH9HQZq5B3YiqLro+/vi2NNrjcVeISsj+RV5lg=="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:19:33.487998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-62bd397f-99fe-46ec-b3ab-56f39a9d3a94 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Getting quotas for project 713e3a431a2441548123f404b23ce0da. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:19:33.493655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-62bd397f-99fe-46ec-b3ab-56f39a9d3a94 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Getting quotas for user ee8daf94c54c4dd7b69310674d73211a and project 713e3a431a2441548123f404b23ce0da. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:19:33.521286 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-62bd397f-99fe-46ec-b3ab-56f39a9d3a94 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.052549 Oct 05 03:19:33.522113 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3403/6820] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 03:19:33 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:19:49.741427 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-26a13c0f-feba-410f-a3cc-8e056c33467a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1960041694", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-383498722", "security_groups": [{"name": "tempest-secgroup-smoke-1461955712"}], "block_device_mapping_v2": [{"uuid": "fcb49137-50d8-4c44-9288-1b3ad052ecc7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fa70d413-7436-41df-9105-d3173bf249ed"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:19:49.751941 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:19:49.752603 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:19:49.858720 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-26a13c0f-feba-410f-a3cc-8e056c33467a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] validate_networks() for [('fa70d413-7436-41df-9105-d3173bf249ed', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:19:50.224218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-26a13c0f-feba-410f-a3cc-8e056c33467a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:19:50.224641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-26a13c0f-feba-410f-a3cc-8e056c33467a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:19:50.225183 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-26a13c0f-feba-410f-a3cc-8e056c33467a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:19:50.225629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-26a13c0f-feba-410f-a3cc-8e056c33467a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:19:50.226076 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-26a13c0f-feba-410f-a3cc-8e056c33467a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:19:50.235114 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26a13c0f-feba-410f-a3cc-8e056c33467a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:50.235596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26a13c0f-feba-410f-a3cc-8e056c33467a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:50.236028 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26a13c0f-feba-410f-a3cc-8e056c33467a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:50.236748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26a13c0f-feba-410f-a3cc-8e056c33467a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:50.237238 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26a13c0f-feba-410f-a3cc-8e056c33467a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:50.237664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26a13c0f-feba-410f-a3cc-8e056c33467a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:50.254249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-26a13c0f-feba-410f-a3cc-8e056c33467a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Getting quotas for project 713e3a431a2441548123f404b23ce0da. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:19:50.260008 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-26a13c0f-feba-410f-a3cc-8e056c33467a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Getting quotas for user ee8daf94c54c4dd7b69310674d73211a and project 713e3a431a2441548123f404b23ce0da. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:19:50.320805 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-26a13c0f-feba-410f-a3cc-8e056c33467a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:19:50.322944 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-26a13c0f-feba-410f-a3cc-8e056c33467a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 8cf94a42-6a5f-42e7-b69d-01b112562cb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fcb49137-50d8-4c44-9288-1b3ad052ecc7',volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:19:50.449194 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-26a13c0f-feba-410f-a3cc-8e056c33467a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.712169 Oct 05 03:19:50.449862 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3418/6821] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:19:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:19:50.461419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-805161ac-f084-4404-b8ed-1a91181cee72 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:50.462103 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-805161ac-f084-4404-b8ed-1a91181cee72 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 8cf94a42-6a5f-42e7-b69d-01b112562cb6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:50.464277 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=31 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:19:50.464997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:19:50.465954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:19:50.522170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-805161ac-f084-4404-b8ed-1a91181cee72 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:19:50.530937 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-805161ac-f084-4404-b8ed-1a91181cee72 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6" status: 200 len: 1094 microversion: 2.1 time: 0.073814 Oct 05 03:19:50.531708 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3404/6822] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:50 2022] GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:19:51.555702 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-489a8dae-d6f8-4ba7-ac8a-bc53cd1083cb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:51.556427 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-489a8dae-d6f8-4ba7-ac8a-bc53cd1083cb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 8cf94a42-6a5f-42e7-b69d-01b112562cb6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:51.564996 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-489a8dae-d6f8-4ba7-ac8a-bc53cd1083cb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:51.566178 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-489a8dae-d6f8-4ba7-ac8a-bc53cd1083cb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:51.566786 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-489a8dae-d6f8-4ba7-ac8a-bc53cd1083cb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:51.567772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-489a8dae-d6f8-4ba7-ac8a-bc53cd1083cb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:51.568386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-489a8dae-d6f8-4ba7-ac8a-bc53cd1083cb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:51.569064 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-489a8dae-d6f8-4ba7-ac8a-bc53cd1083cb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:51.660104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-489a8dae-d6f8-4ba7-ac8a-bc53cd1083cb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:19:51.669065 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-489a8dae-d6f8-4ba7-ac8a-bc53cd1083cb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6" status: 200 len: 1210 microversion: 2.1 time: 0.118372 Oct 05 03:19:51.669675 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3419/6823] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:51 2022] GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 => generated 1210 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:19:52.694294 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-89b3ca41-4904-4409-98bf-38c6896399d8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:52.695504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-89b3ca41-4904-4409-98bf-38c6896399d8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 8cf94a42-6a5f-42e7-b69d-01b112562cb6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:52.704609 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89b3ca41-4904-4409-98bf-38c6896399d8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:52.705050 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89b3ca41-4904-4409-98bf-38c6896399d8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:52.705544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89b3ca41-4904-4409-98bf-38c6896399d8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:52.706278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89b3ca41-4904-4409-98bf-38c6896399d8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:52.706949 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89b3ca41-4904-4409-98bf-38c6896399d8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:52.707408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89b3ca41-4904-4409-98bf-38c6896399d8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:52.933208 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-89b3ca41-4904-4409-98bf-38c6896399d8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:19:52.942002 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-89b3ca41-4904-4409-98bf-38c6896399d8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6" status: 200 len: 1278 microversion: 2.1 time: 0.252612 Oct 05 03:19:52.942693 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3405/6824] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:52 2022] GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 => generated 1278 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:19:53.094844 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-1a8eacb7-0434-4b65-a4ed-9862d4b7e3e0 req-64844100-376f-4973-beb0-87a20e2c133e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cf94a42-6a5f-42e7-b69d-01b112562cb6", "tag": "55abf3ae-44c8-41ae-b6a2-dc11ca430a31"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:19:53.109750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1a8eacb7-0434-4b65-a4ed-9862d4b7e3e0 req-64844100-376f-4973-beb0-87a20e2c133e service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:53.110812 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1a8eacb7-0434-4b65-a4ed-9862d4b7e3e0 req-64844100-376f-4973-beb0-87a20e2c133e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:53.111378 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1a8eacb7-0434-4b65-a4ed-9862d4b7e3e0 req-64844100-376f-4973-beb0-87a20e2c133e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:53.123650 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-1a8eacb7-0434-4b65-a4ed-9862d4b7e3e0 req-64844100-376f-4973-beb0-87a20e2c133e service nova] Creating event network-changed:55abf3ae-44c8-41ae-b6a2-dc11ca430a31 for instance 8cf94a42-6a5f-42e7-b69d-01b112562cb6 on n-h2-858272-3 Oct 05 03:19:53.128813 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-1a8eacb7-0434-4b65-a4ed-9862d4b7e3e0 req-64844100-376f-4973-beb0-87a20e2c133e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037548 Oct 05 03:19:53.129472 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3420/6825] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:19:53.965824 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d2c6d5db-2e36-4432-b6bb-53ae82e69336 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:53.966473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d2c6d5db-2e36-4432-b6bb-53ae82e69336 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 8cf94a42-6a5f-42e7-b69d-01b112562cb6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:53.978736 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2c6d5db-2e36-4432-b6bb-53ae82e69336 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:53.979551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2c6d5db-2e36-4432-b6bb-53ae82e69336 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:53.980301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2c6d5db-2e36-4432-b6bb-53ae82e69336 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:53.981244 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2c6d5db-2e36-4432-b6bb-53ae82e69336 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:53.981881 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2c6d5db-2e36-4432-b6bb-53ae82e69336 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:53.982490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2c6d5db-2e36-4432-b6bb-53ae82e69336 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:54.197117 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d2c6d5db-2e36-4432-b6bb-53ae82e69336 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:19:54.205426 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d2c6d5db-2e36-4432-b6bb-53ae82e69336 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6" status: 200 len: 1278 microversion: 2.1 time: 0.243657 Oct 05 03:19:54.206111 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3406/6826] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:53 2022] GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 => generated 1278 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:19:55.229567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2a8ede2a-378f-4fb0-8824-463280f944d9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:55.230145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2a8ede2a-378f-4fb0-8824-463280f944d9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 8cf94a42-6a5f-42e7-b69d-01b112562cb6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:55.236656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a8ede2a-378f-4fb0-8824-463280f944d9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:55.237170 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a8ede2a-378f-4fb0-8824-463280f944d9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:55.237610 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a8ede2a-378f-4fb0-8824-463280f944d9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:55.238293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a8ede2a-378f-4fb0-8824-463280f944d9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:55.238747 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a8ede2a-378f-4fb0-8824-463280f944d9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:55.239169 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2a8ede2a-378f-4fb0-8824-463280f944d9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:55.377292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2a8ede2a-378f-4fb0-8824-463280f944d9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:19:55.386100 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2a8ede2a-378f-4fb0-8824-463280f944d9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6" status: 200 len: 1278 microversion: 2.1 time: 0.162231 Oct 05 03:19:55.386678 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3421/6827] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:55 2022] GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:19:56.409171 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e2617ef8-7972-434b-a6f0-43a8ee37f0ec tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:56.409735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e2617ef8-7972-434b-a6f0-43a8ee37f0ec tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 8cf94a42-6a5f-42e7-b69d-01b112562cb6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:56.418224 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2617ef8-7972-434b-a6f0-43a8ee37f0ec tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:56.418732 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2617ef8-7972-434b-a6f0-43a8ee37f0ec tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:56.419190 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2617ef8-7972-434b-a6f0-43a8ee37f0ec tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:56.419913 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2617ef8-7972-434b-a6f0-43a8ee37f0ec tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:56.420388 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2617ef8-7972-434b-a6f0-43a8ee37f0ec tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:56.420834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e2617ef8-7972-434b-a6f0-43a8ee37f0ec tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:56.568997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e2617ef8-7972-434b-a6f0-43a8ee37f0ec tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:19:56.577580 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e2617ef8-7972-434b-a6f0-43a8ee37f0ec tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6" status: 200 len: 1278 microversion: 2.1 time: 0.172390 Oct 05 03:19:56.578371 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3407/6828] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:56 2022] GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 => generated 1278 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:19:57.606482 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2ec80444-fa05-4769-a7d8-872cfd5d0694 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:57.607103 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2ec80444-fa05-4769-a7d8-872cfd5d0694 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 8cf94a42-6a5f-42e7-b69d-01b112562cb6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:57.617036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ec80444-fa05-4769-a7d8-872cfd5d0694 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:57.617536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ec80444-fa05-4769-a7d8-872cfd5d0694 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:57.617981 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ec80444-fa05-4769-a7d8-872cfd5d0694 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:57.618688 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ec80444-fa05-4769-a7d8-872cfd5d0694 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:57.619153 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ec80444-fa05-4769-a7d8-872cfd5d0694 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:57.619589 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2ec80444-fa05-4769-a7d8-872cfd5d0694 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:57.755572 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2ec80444-fa05-4769-a7d8-872cfd5d0694 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:19:57.763449 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2ec80444-fa05-4769-a7d8-872cfd5d0694 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6" status: 200 len: 1266 microversion: 2.1 time: 0.161356 Oct 05 03:19:57.764028 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3422/6829] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:57 2022] GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:19:58.787617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-83da3e6f-d2a9-4511-8d81-e80f70f74f0c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:58.788295 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-83da3e6f-d2a9-4511-8d81-e80f70f74f0c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 8cf94a42-6a5f-42e7-b69d-01b112562cb6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:58.791254 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 03:19:58.791420 n-d-858272-3 devstack@n-api.service[122320]: Wed Oct 5 03:19:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 (ip 10.222.0.16) !!! Oct 05 03:19:58.798344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83da3e6f-d2a9-4511-8d81-e80f70f74f0c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:58.798852 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83da3e6f-d2a9-4511-8d81-e80f70f74f0c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:58.799309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83da3e6f-d2a9-4511-8d81-e80f70f74f0c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:58.800031 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83da3e6f-d2a9-4511-8d81-e80f70f74f0c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:58.800505 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83da3e6f-d2a9-4511-8d81-e80f70f74f0c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:58.800981 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83da3e6f-d2a9-4511-8d81-e80f70f74f0c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:58.944494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-83da3e6f-d2a9-4511-8d81-e80f70f74f0c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:19:58.952256 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-83da3e6f-d2a9-4511-8d81-e80f70f74f0c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6" status: 200 len: 1266 microversion: 2.1 time: 0.168775 Oct 05 03:19:58.952822 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3408/6830] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:58 2022] GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:19:59.974903 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bbb81972-a15a-40e3-8d15-67df96d628c7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:19:59.975487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bbb81972-a15a-40e3-8d15-67df96d628c7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 8cf94a42-6a5f-42e7-b69d-01b112562cb6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:19:59.982374 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bbb81972-a15a-40e3-8d15-67df96d628c7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:59.982868 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bbb81972-a15a-40e3-8d15-67df96d628c7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:59.983314 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bbb81972-a15a-40e3-8d15-67df96d628c7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:19:59.984270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bbb81972-a15a-40e3-8d15-67df96d628c7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:19:59.984731 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bbb81972-a15a-40e3-8d15-67df96d628c7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:19:59.985188 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bbb81972-a15a-40e3-8d15-67df96d628c7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:20:00.118384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bbb81972-a15a-40e3-8d15-67df96d628c7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:20:00.126671 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bbb81972-a15a-40e3-8d15-67df96d628c7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6" status: 200 len: 1266 microversion: 2.1 time: 0.155910 Oct 05 03:20:00.127246 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3423/6831] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:19:59 2022] GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:20:01.151702 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-151402f8-1f5a-466f-a2f0-0c2f3e15adf6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:20:01.152242 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-151402f8-1f5a-466f-a2f0-0c2f3e15adf6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 8cf94a42-6a5f-42e7-b69d-01b112562cb6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:20:01.155005 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:20:01.160295 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-151402f8-1f5a-466f-a2f0-0c2f3e15adf6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:20:01.160790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-151402f8-1f5a-466f-a2f0-0c2f3e15adf6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:20:01.161260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-151402f8-1f5a-466f-a2f0-0c2f3e15adf6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:20:01.162603 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-151402f8-1f5a-466f-a2f0-0c2f3e15adf6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:20:01.163098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-151402f8-1f5a-466f-a2f0-0c2f3e15adf6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:20:01.163511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-151402f8-1f5a-466f-a2f0-0c2f3e15adf6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:20:01.302334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-151402f8-1f5a-466f-a2f0-0c2f3e15adf6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:20:01.311151 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-151402f8-1f5a-466f-a2f0-0c2f3e15adf6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6" status: 200 len: 1266 microversion: 2.1 time: 0.163412 Oct 05 03:20:01.311759 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3409/6832] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:20:01 2022] GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:20:02.335659 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-784f8a4d-236b-47aa-b141-26a3da810384 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:20:02.336248 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-784f8a4d-236b-47aa-b141-26a3da810384 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 8cf94a42-6a5f-42e7-b69d-01b112562cb6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:20:02.338217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:20:02.338885 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:20:02.346190 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-784f8a4d-236b-47aa-b141-26a3da810384 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:20:02.346671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-784f8a4d-236b-47aa-b141-26a3da810384 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:20:02.347108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-784f8a4d-236b-47aa-b141-26a3da810384 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:20:02.347801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-784f8a4d-236b-47aa-b141-26a3da810384 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:20:02.348256 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-784f8a4d-236b-47aa-b141-26a3da810384 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:20:02.348678 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-784f8a4d-236b-47aa-b141-26a3da810384 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:20:02.482016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-784f8a4d-236b-47aa-b141-26a3da810384 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:20:02.490046 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-784f8a4d-236b-47aa-b141-26a3da810384 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6" status: 200 len: 1266 microversion: 2.1 time: 0.158519 Oct 05 03:20:02.490660 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3424/6833] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:20:02 2022] GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:20:03.513205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-aaf6f373-3893-4189-9382-199091431e33 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:20:03.513844 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-aaf6f373-3893-4189-9382-199091431e33 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 8cf94a42-6a5f-42e7-b69d-01b112562cb6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:20:03.520745 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aaf6f373-3893-4189-9382-199091431e33 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:20:03.521909 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aaf6f373-3893-4189-9382-199091431e33 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:20:03.522371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aaf6f373-3893-4189-9382-199091431e33 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:20:03.523068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aaf6f373-3893-4189-9382-199091431e33 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:20:03.523533 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aaf6f373-3893-4189-9382-199091431e33 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:20:03.523976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aaf6f373-3893-4189-9382-199091431e33 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:20:03.659997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-aaf6f373-3893-4189-9382-199091431e33 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:20:03.667863 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-aaf6f373-3893-4189-9382-199091431e33 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6" status: 200 len: 1266 microversion: 2.1 time: 0.158571 Oct 05 03:20:03.668452 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3410/6834] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:20:03 2022] GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:20:04.690282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-add26735-3e85-45c5-9744-2626bf6ca1c9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:20:04.690932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-add26735-3e85-45c5-9744-2626bf6ca1c9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 8cf94a42-6a5f-42e7-b69d-01b112562cb6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:20:04.698124 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-add26735-3e85-45c5-9744-2626bf6ca1c9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:20:04.698620 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-add26735-3e85-45c5-9744-2626bf6ca1c9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:20:04.699062 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-add26735-3e85-45c5-9744-2626bf6ca1c9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:20:04.699765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-add26735-3e85-45c5-9744-2626bf6ca1c9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:20:04.700227 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-add26735-3e85-45c5-9744-2626bf6ca1c9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:20:04.700660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-add26735-3e85-45c5-9744-2626bf6ca1c9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:20:04.832674 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-add26735-3e85-45c5-9744-2626bf6ca1c9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:20:04.840997 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-add26735-3e85-45c5-9744-2626bf6ca1c9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6" status: 200 len: 1266 microversion: 2.1 time: 0.154590 Oct 05 03:20:04.841579 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3425/6835] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:20:04 2022] GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:20:05.863867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-31a42458-40be-4757-ae71-c9c660fefdee tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:20:05.864503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-31a42458-40be-4757-ae71-c9c660fefdee tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 8cf94a42-6a5f-42e7-b69d-01b112562cb6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:20:05.871260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-31a42458-40be-4757-ae71-c9c660fefdee tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:20:05.871768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-31a42458-40be-4757-ae71-c9c660fefdee tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:20:05.872220 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-31a42458-40be-4757-ae71-c9c660fefdee tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:20:05.872948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-31a42458-40be-4757-ae71-c9c660fefdee tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:20:05.873421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-31a42458-40be-4757-ae71-c9c660fefdee tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:20:05.873864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-31a42458-40be-4757-ae71-c9c660fefdee tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:20:06.002397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-31a42458-40be-4757-ae71-c9c660fefdee tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:20:06.010733 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-31a42458-40be-4757-ae71-c9c660fefdee tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6" status: 200 len: 1266 microversion: 2.1 time: 0.150793 Oct 05 03:20:06.011306 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3411/6836] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:20:05 2022] GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:20:06.256859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-19ba6611-9285-4b06-a5ba-546b010974d3 req-01f2af18-fd3a-4c2a-9331-f75281a0c795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cf94a42-6a5f-42e7-b69d-01b112562cb6", "name": "network-vif-plugged", "status": "completed", "tag": "55abf3ae-44c8-41ae-b6a2-dc11ca430a31"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:20:06.268483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-19ba6611-9285-4b06-a5ba-546b010974d3 req-01f2af18-fd3a-4c2a-9331-f75281a0c795 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:20:06.269117 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-19ba6611-9285-4b06-a5ba-546b010974d3 req-01f2af18-fd3a-4c2a-9331-f75281a0c795 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:20:06.269551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-19ba6611-9285-4b06-a5ba-546b010974d3 req-01f2af18-fd3a-4c2a-9331-f75281a0c795 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:20:06.281298 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-19ba6611-9285-4b06-a5ba-546b010974d3 req-01f2af18-fd3a-4c2a-9331-f75281a0c795 service nova] Creating event network-vif-plugged:55abf3ae-44c8-41ae-b6a2-dc11ca430a31 for instance 8cf94a42-6a5f-42e7-b69d-01b112562cb6 on n-h2-858272-3 Oct 05 03:20:06.286203 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-19ba6611-9285-4b06-a5ba-546b010974d3 req-01f2af18-fd3a-4c2a-9331-f75281a0c795 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034364 Oct 05 03:20:06.287502 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3426/6837] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:20:07.034333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9da921a4-21a8-44e5-b317-7e0c9ab8a86f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:20:07.034968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9da921a4-21a8-44e5-b317-7e0c9ab8a86f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 8cf94a42-6a5f-42e7-b69d-01b112562cb6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:20:07.042466 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9da921a4-21a8-44e5-b317-7e0c9ab8a86f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:20:07.042975 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9da921a4-21a8-44e5-b317-7e0c9ab8a86f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:20:07.043427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9da921a4-21a8-44e5-b317-7e0c9ab8a86f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:20:07.044125 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9da921a4-21a8-44e5-b317-7e0c9ab8a86f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:20:07.044597 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9da921a4-21a8-44e5-b317-7e0c9ab8a86f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:20:07.045070 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9da921a4-21a8-44e5-b317-7e0c9ab8a86f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:20:07.174437 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9da921a4-21a8-44e5-b317-7e0c9ab8a86f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:20:07.182246 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9da921a4-21a8-44e5-b317-7e0c9ab8a86f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6" status: 200 len: 1266 microversion: 2.1 time: 0.151801 Oct 05 03:20:07.182812 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3412/6838] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:20:07 2022] GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:20:08.207105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-56a93e1a-2f3c-4bd8-9832-a4da1c804118 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:20:08.207806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-56a93e1a-2f3c-4bd8-9832-a4da1c804118 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 8cf94a42-6a5f-42e7-b69d-01b112562cb6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:20:08.214968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-56a93e1a-2f3c-4bd8-9832-a4da1c804118 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:20:08.215457 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-56a93e1a-2f3c-4bd8-9832-a4da1c804118 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:20:08.215893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-56a93e1a-2f3c-4bd8-9832-a4da1c804118 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:20:08.216588 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-56a93e1a-2f3c-4bd8-9832-a4da1c804118 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:20:08.217078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-56a93e1a-2f3c-4bd8-9832-a4da1c804118 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:20:08.217559 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-56a93e1a-2f3c-4bd8-9832-a4da1c804118 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:20:08.383244 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-56a93e1a-2f3c-4bd8-9832-a4da1c804118 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:20:08.395523 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-56a93e1a-2f3c-4bd8-9832-a4da1c804118 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6" status: 200 len: 1453 microversion: 2.1 time: 0.193653 Oct 05 03:20:08.396101 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3427/6839] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:20:08 2022] GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 => generated 1453 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:20:08.418540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dda5fceb-3f1a-4584-b48c-d84202855654 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:20:08.419547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dda5fceb-3f1a-4584-b48c-d84202855654 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 8cf94a42-6a5f-42e7-b69d-01b112562cb6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:20:08.428742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dda5fceb-3f1a-4584-b48c-d84202855654 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:20:08.429291 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dda5fceb-3f1a-4584-b48c-d84202855654 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:20:08.429884 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dda5fceb-3f1a-4584-b48c-d84202855654 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:20:08.430614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dda5fceb-3f1a-4584-b48c-d84202855654 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:20:08.431089 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dda5fceb-3f1a-4584-b48c-d84202855654 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:20:08.431531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dda5fceb-3f1a-4584-b48c-d84202855654 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:20:08.592385 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dda5fceb-3f1a-4584-b48c-d84202855654 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:20:08.600386 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dda5fceb-3f1a-4584-b48c-d84202855654 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6" status: 200 len: 1453 microversion: 2.1 time: 0.185808 Oct 05 03:20:08.600993 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3413/6840] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:20:08 2022] GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 => generated 1453 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:20:10.566940 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-52c8fca3-d8f2-456e-b282-8d4cb04299d2 req-8572e387-abe4-4e9b-b8b7-a836e0d010cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cf94a42-6a5f-42e7-b69d-01b112562cb6", "tag": "55abf3ae-44c8-41ae-b6a2-dc11ca430a31"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:20:10.576531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-52c8fca3-d8f2-456e-b282-8d4cb04299d2 req-8572e387-abe4-4e9b-b8b7-a836e0d010cc service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:20:10.577032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-52c8fca3-d8f2-456e-b282-8d4cb04299d2 req-8572e387-abe4-4e9b-b8b7-a836e0d010cc service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:20:10.577461 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-52c8fca3-d8f2-456e-b282-8d4cb04299d2 req-8572e387-abe4-4e9b-b8b7-a836e0d010cc service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:20:10.589977 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-52c8fca3-d8f2-456e-b282-8d4cb04299d2 req-8572e387-abe4-4e9b-b8b7-a836e0d010cc service nova] Creating event network-changed:55abf3ae-44c8-41ae-b6a2-dc11ca430a31 for instance 8cf94a42-6a5f-42e7-b69d-01b112562cb6 on n-h2-858272-3 Oct 05 03:20:10.595083 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-52c8fca3-d8f2-456e-b282-8d4cb04299d2 req-8572e387-abe4-4e9b-b8b7-a836e0d010cc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099913 Oct 05 03:20:10.595698 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3428/6841] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:22:05.916234 n-d-858272-3 devstack@n-api.service[122320]: ERROR oslo.messaging._drivers.impl_rabbit [-] [478c9060-5882-4902-b074-d751d7d6fe39] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 05 03:22:05.917073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=22 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:22:05.918403 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=54 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:22:05.919194 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 03:22:05.919345 n-d-858272-3 devstack@n-api.service[122320]: Wed Oct 5 03:22:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 (ip 10.222.0.16) !!! Oct 05 03:22:05.920370 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 05 03:22:05.987902 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7e49c553-d770-4aa6-a93d-bca865287b53 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:22:05.988421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7e49c553-d770-4aa6-a93d-bca865287b53 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 8cf94a42-6a5f-42e7-b69d-01b112562cb6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:22:05.994478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e49c553-d770-4aa6-a93d-bca865287b53 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:05.994979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e49c553-d770-4aa6-a93d-bca865287b53 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:05.995432 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e49c553-d770-4aa6-a93d-bca865287b53 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:05.996747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e49c553-d770-4aa6-a93d-bca865287b53 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:05.997424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e49c553-d770-4aa6-a93d-bca865287b53 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:05.997871 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e49c553-d770-4aa6-a93d-bca865287b53 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:06.022814 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7e49c553-d770-4aa6-a93d-bca865287b53 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 8cf94a42-6a5f-42e7-b69d-01b112562cb6] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:22:06.096876 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7e49c553-d770-4aa6-a93d-bca865287b53 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6" status: 204 len: 0 microversion: 2.1 time: 0.182528 Oct 05 03:22:06.097690 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3414/6842] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:22:05 2022] DELETE /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:22:06.104625 n-d-858272-3 devstack@n-api.service[122319]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6905525b-80d2-47ff-94c4-6512d0d2e7d6] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 05 03:22:06.107049 n-d-858272-3 devstack@n-api.service[122319]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9ea01e0c-5288-45ec-999a-5c236fd0352e] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 05 03:22:06.107841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:22:06.108611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=50 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:22:06.110096 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 05 03:22:06.110251 n-d-858272-3 devstack@n-api.service[122319]: Wed Oct 5 03:22:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 (ip 10.222.0.16) !!! Oct 05 03:22:06.111261 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 03:22:06.111551 n-d-858272-3 devstack@n-api.service[122319]: Wed Oct 5 03:22:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 (ip 10.222.0.16) !!! Oct 05 03:22:06.117185 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e82bfdc0-603d-4a2f-a34c-a33ca2d97db5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:22:06.117895 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e82bfdc0-603d-4a2f-a34c-a33ca2d97db5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 8cf94a42-6a5f-42e7-b69d-01b112562cb6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:22:06.128794 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e82bfdc0-603d-4a2f-a34c-a33ca2d97db5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:06.129323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e82bfdc0-603d-4a2f-a34c-a33ca2d97db5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:06.129764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e82bfdc0-603d-4a2f-a34c-a33ca2d97db5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:06.130471 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e82bfdc0-603d-4a2f-a34c-a33ca2d97db5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:06.130932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e82bfdc0-603d-4a2f-a34c-a33ca2d97db5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:06.131361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e82bfdc0-603d-4a2f-a34c-a33ca2d97db5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:06.262493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e82bfdc0-603d-4a2f-a34c-a33ca2d97db5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:22:06.270416 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e82bfdc0-603d-4a2f-a34c-a33ca2d97db5 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6" status: 200 len: 1578 microversion: 2.1 time: 0.168017 Oct 05 03:22:06.270988 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3429/6843] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:22:06 2022] GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 => generated 1578 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:22:07.294802 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9667ef24-ca12-42f2-9878-3f797c0b147e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:22:07.295511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9667ef24-ca12-42f2-9878-3f797c0b147e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 8cf94a42-6a5f-42e7-b69d-01b112562cb6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:22:07.304805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9667ef24-ca12-42f2-9878-3f797c0b147e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:07.305334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9667ef24-ca12-42f2-9878-3f797c0b147e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:07.305783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9667ef24-ca12-42f2-9878-3f797c0b147e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:07.306483 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9667ef24-ca12-42f2-9878-3f797c0b147e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:07.306951 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9667ef24-ca12-42f2-9878-3f797c0b147e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:07.307414 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9667ef24-ca12-42f2-9878-3f797c0b147e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:07.311214 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [-] [478c9060-5882-4902-b074-d751d7d6fe39] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 43134. Oct 05 03:22:07.461989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9667ef24-ca12-42f2-9878-3f797c0b147e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:22:07.471229 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9667ef24-ca12-42f2-9878-3f797c0b147e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6" status: 200 len: 1578 microversion: 2.1 time: 0.180697 Oct 05 03:22:07.471840 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3415/6844] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:22:07 2022] GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 => generated 1578 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:22:08.494344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-65ff09c1-d25d-48e5-9f97-aab77dd7e7d3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:22:08.494963 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-65ff09c1-d25d-48e5-9f97-aab77dd7e7d3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 8cf94a42-6a5f-42e7-b69d-01b112562cb6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:22:08.504230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65ff09c1-d25d-48e5-9f97-aab77dd7e7d3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:08.504732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65ff09c1-d25d-48e5-9f97-aab77dd7e7d3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:08.505201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65ff09c1-d25d-48e5-9f97-aab77dd7e7d3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:08.505916 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65ff09c1-d25d-48e5-9f97-aab77dd7e7d3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:08.506384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65ff09c1-d25d-48e5-9f97-aab77dd7e7d3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:08.506814 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-65ff09c1-d25d-48e5-9f97-aab77dd7e7d3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:08.524820 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] [6905525b-80d2-47ff-94c4-6512d0d2e7d6] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 43138. Oct 05 03:22:08.525671 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] [9ea01e0c-5288-45ec-999a-5c236fd0352e] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 43140. Oct 05 03:22:08.750894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-65ff09c1-d25d-48e5-9f97-aab77dd7e7d3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:22:08.758831 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-65ff09c1-d25d-48e5-9f97-aab77dd7e7d3 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6" status: 200 len: 1578 microversion: 2.1 time: 0.268378 Oct 05 03:22:08.759517 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3430/6845] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:22:08 2022] GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 => generated 1578 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:22:09.049887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-79876de7-7b7d-46f3-ae37-dd2cab4cea3f req-f8d440b1-71a9-4250-9acb-efa45ca24a62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cf94a42-6a5f-42e7-b69d-01b112562cb6", "name": "network-vif-deleted", "tag": "55abf3ae-44c8-41ae-b6a2-dc11ca430a31"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:22:09.065334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-79876de7-7b7d-46f3-ae37-dd2cab4cea3f req-f8d440b1-71a9-4250-9acb-efa45ca24a62 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:09.065886 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-79876de7-7b7d-46f3-ae37-dd2cab4cea3f req-f8d440b1-71a9-4250-9acb-efa45ca24a62 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:09.066321 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-79876de7-7b7d-46f3-ae37-dd2cab4cea3f req-f8d440b1-71a9-4250-9acb-efa45ca24a62 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:09.083111 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-79876de7-7b7d-46f3-ae37-dd2cab4cea3f req-f8d440b1-71a9-4250-9acb-efa45ca24a62 service nova] Creating event network-vif-deleted:55abf3ae-44c8-41ae-b6a2-dc11ca430a31 for instance 8cf94a42-6a5f-42e7-b69d-01b112562cb6 on n-h2-858272-3 Oct 05 03:22:09.089076 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-79876de7-7b7d-46f3-ae37-dd2cab4cea3f req-f8d440b1-71a9-4250-9acb-efa45ca24a62 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114869 Oct 05 03:22:09.090138 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3416/6846] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:22:09.783739 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-849088b0-3801-4262-9d10-b49170c468fd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:22:09.785045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-849088b0-3801-4262-9d10-b49170c468fd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 8cf94a42-6a5f-42e7-b69d-01b112562cb6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:22:09.793060 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-849088b0-3801-4262-9d10-b49170c468fd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:09.793573 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-849088b0-3801-4262-9d10-b49170c468fd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:09.794698 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-849088b0-3801-4262-9d10-b49170c468fd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:09.795448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-849088b0-3801-4262-9d10-b49170c468fd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:09.795916 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-849088b0-3801-4262-9d10-b49170c468fd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:09.796353 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-849088b0-3801-4262-9d10-b49170c468fd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:09.872789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-849088b0-3801-4262-9d10-b49170c468fd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:22:09.881899 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-849088b0-3801-4262-9d10-b49170c468fd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6" status: 200 len: 1225 microversion: 2.1 time: 0.102159 Oct 05 03:22:09.888462 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3431/6847] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:22:09 2022] GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:22:10.907535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7331fe34-ee57-47d9-a50d-7d8cc55e9685 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:22:10.908245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7331fe34-ee57-47d9-a50d-7d8cc55e9685 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 8cf94a42-6a5f-42e7-b69d-01b112562cb6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:22:10.915010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7331fe34-ee57-47d9-a50d-7d8cc55e9685 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:10.915551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7331fe34-ee57-47d9-a50d-7d8cc55e9685 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:10.915956 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7331fe34-ee57-47d9-a50d-7d8cc55e9685 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:10.916655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7331fe34-ee57-47d9-a50d-7d8cc55e9685 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:10.917155 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7331fe34-ee57-47d9-a50d-7d8cc55e9685 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:10.917588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7331fe34-ee57-47d9-a50d-7d8cc55e9685 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:10.983194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7331fe34-ee57-47d9-a50d-7d8cc55e9685 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:22:10.991277 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7331fe34-ee57-47d9-a50d-7d8cc55e9685 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6" status: 200 len: 1225 microversion: 2.1 time: 0.089612 Oct 05 03:22:10.991858 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3417/6848] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:22:10 2022] GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:22:12.014832 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-716174b9-de6c-478a-8152-737601aebf9b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:22:12.015488 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-716174b9-de6c-478a-8152-737601aebf9b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 8cf94a42-6a5f-42e7-b69d-01b112562cb6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:22:12.022697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-716174b9-de6c-478a-8152-737601aebf9b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:12.023199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-716174b9-de6c-478a-8152-737601aebf9b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:12.023648 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-716174b9-de6c-478a-8152-737601aebf9b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:12.024355 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-716174b9-de6c-478a-8152-737601aebf9b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:12.024818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-716174b9-de6c-478a-8152-737601aebf9b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:12.025283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-716174b9-de6c-478a-8152-737601aebf9b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:12.090563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-716174b9-de6c-478a-8152-737601aebf9b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:22:12.099303 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-716174b9-de6c-478a-8152-737601aebf9b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6" status: 200 len: 1225 microversion: 2.1 time: 0.088558 Oct 05 03:22:12.099897 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3432/6849] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:22:12 2022] GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:22:13.124401 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-29f9d8d6-e8aa-4927-b67e-c15e7c2f78ab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:22:13.125088 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-29f9d8d6-e8aa-4927-b67e-c15e7c2f78ab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 8cf94a42-6a5f-42e7-b69d-01b112562cb6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:22:13.132332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29f9d8d6-e8aa-4927-b67e-c15e7c2f78ab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:13.132847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29f9d8d6-e8aa-4927-b67e-c15e7c2f78ab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:13.133353 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29f9d8d6-e8aa-4927-b67e-c15e7c2f78ab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:13.134083 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29f9d8d6-e8aa-4927-b67e-c15e7c2f78ab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:13.134558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29f9d8d6-e8aa-4927-b67e-c15e7c2f78ab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:13.135003 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-29f9d8d6-e8aa-4927-b67e-c15e7c2f78ab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:13.199261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-29f9d8d6-e8aa-4927-b67e-c15e7c2f78ab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:22:13.207048 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-29f9d8d6-e8aa-4927-b67e-c15e7c2f78ab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6" status: 200 len: 1225 microversion: 2.1 time: 0.087433 Oct 05 03:22:13.207621 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3418/6850] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:22:13 2022] GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:22:14.230218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6ed05f9e-3d1a-420c-8f13-d56a37f34373 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:22:14.230862 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6ed05f9e-3d1a-420c-8f13-d56a37f34373 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 8cf94a42-6a5f-42e7-b69d-01b112562cb6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:22:14.238359 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ed05f9e-3d1a-420c-8f13-d56a37f34373 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:14.238850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ed05f9e-3d1a-420c-8f13-d56a37f34373 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:14.239288 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ed05f9e-3d1a-420c-8f13-d56a37f34373 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:14.239995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ed05f9e-3d1a-420c-8f13-d56a37f34373 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:14.240435 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ed05f9e-3d1a-420c-8f13-d56a37f34373 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:14.240888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ed05f9e-3d1a-420c-8f13-d56a37f34373 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:14.255220 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-6ed05f9e-3d1a-420c-8f13-d56a37f34373 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] HTTP exception thrown: Instance 8cf94a42-6a5f-42e7-b69d-01b112562cb6 could not be found. Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6ed05f9e-3d1a-420c-8f13-d56a37f34373 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Request method failure captured: Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 HTTP/1.1 Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPbrQKtYWOrgIE3M1fpHMFzvjQh4iLX1nAzEklsHFOch728asjV7SItEDt5qDq-ufTutAq3QkdKbEFAclvkEjD6DmQ6dye6ArfBgrG8mjckzaoUeygHR0aBhtzZzZQl0gGW5mk16tBGgd6IoBji5V99Q_6th4Uy5PRVF9Hx8YdoF6tU Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 713e3a431a2441548123f404b23ce0da Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TestVolumeBootPattern-847109256 Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713e3a431a2441548123f404b23ce0da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713e3a431a2441548123f404b23ce0da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/713e3a431a2441548123f404b23ce0da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_713e3a431a2441548123f404b23ce0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TestVolumeBootPattern-847109256 Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 713e3a431a2441548123f404b23ce0da Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TestVolumeBootPattern-847109256 Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TestVolumeBootPattern-847109256-project Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: ee8daf94c54c4dd7b69310674d73211a Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TestVolumeBootPattern-847109256-project Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 8cf94a42-6a5f-42e7-b69d-01b112562cb6 could not be found. Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '8cf94a42-6a5f-42e7-b69d-01b112562cb6'} Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cf94a42-6a5f-42e7-b69d-01b112562cb6 could not be found. Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cf94a42-6a5f-42e7-b69d-01b112562cb6 could not be found. Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:22:14.256890 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:22:14.261588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:22:14.261588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:22:14.261588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:22:14.261588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:22:14.261588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:22:14.261588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cf94a42-6a5f-42e7-b69d-01b112562cb6 could not be found. Oct 05 03:22:14.261588 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:22:14.261588 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6ed05f9e-3d1a-420c-8f13-d56a37f34373 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Returning 404 to user: Instance 8cf94a42-6a5f-42e7-b69d-01b112562cb6 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:22:14.261588 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6ed05f9e-3d1a-420c-8f13-d56a37f34373 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6" status: 404 len: 111 microversion: 2.1 time: 0.032072 Oct 05 03:22:14.261588 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3433/6851] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:22:14 2022] GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:22:14.306301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ca97fb8f-5bbd-4f17-b20c-f7eb9a8bb99a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1241277090", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-383498722", "security_groups": [{"name": "tempest-secgroup-smoke-1461955712"}], "block_device_mapping_v2": [{"uuid": "fcb49137-50d8-4c44-9288-1b3ad052ecc7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fa70d413-7436-41df-9105-d3173bf249ed"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:22:14.417649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-ca97fb8f-5bbd-4f17-b20c-f7eb9a8bb99a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] validate_networks() for [('fa70d413-7436-41df-9105-d3173bf249ed', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:22:14.853935 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-ca97fb8f-5bbd-4f17-b20c-f7eb9a8bb99a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:22:14.854375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-ca97fb8f-5bbd-4f17-b20c-f7eb9a8bb99a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:22:14.854866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-ca97fb8f-5bbd-4f17-b20c-f7eb9a8bb99a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:22:14.855292 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-ca97fb8f-5bbd-4f17-b20c-f7eb9a8bb99a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:22:14.855717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-ca97fb8f-5bbd-4f17-b20c-f7eb9a8bb99a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:22:14.865279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca97fb8f-5bbd-4f17-b20c-f7eb9a8bb99a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:14.865776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca97fb8f-5bbd-4f17-b20c-f7eb9a8bb99a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:14.866226 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca97fb8f-5bbd-4f17-b20c-f7eb9a8bb99a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:14.866966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca97fb8f-5bbd-4f17-b20c-f7eb9a8bb99a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:14.867438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca97fb8f-5bbd-4f17-b20c-f7eb9a8bb99a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:14.867877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca97fb8f-5bbd-4f17-b20c-f7eb9a8bb99a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:14.885175 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-ca97fb8f-5bbd-4f17-b20c-f7eb9a8bb99a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Getting quotas for project 713e3a431a2441548123f404b23ce0da. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:22:14.890974 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-ca97fb8f-5bbd-4f17-b20c-f7eb9a8bb99a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Getting quotas for user ee8daf94c54c4dd7b69310674d73211a and project 713e3a431a2441548123f404b23ce0da. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:22:14.953807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ca97fb8f-5bbd-4f17-b20c-f7eb9a8bb99a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:22:14.955930 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ca97fb8f-5bbd-4f17-b20c-f7eb9a8bb99a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 74e1d1f2-0257-48dd-a775-b29a6efb59b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fcb49137-50d8-4c44-9288-1b3ad052ecc7',volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:22:15.085149 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ca97fb8f-5bbd-4f17-b20c-f7eb9a8bb99a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.782605 Oct 05 03:22:15.086108 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3419/6852] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:22:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:22:15.097596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a47e9f7b-0686-48c6-a301-b1a9fca7a909 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:22:15.098294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a47e9f7b-0686-48c6-a301-b1a9fca7a909 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 74e1d1f2-0257-48dd-a775-b29a6efb59b2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:22:15.151231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a47e9f7b-0686-48c6-a301-b1a9fca7a909 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:22:15.158596 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a47e9f7b-0686-48c6-a301-b1a9fca7a909 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2" status: 200 len: 1094 microversion: 2.1 time: 0.064841 Oct 05 03:22:15.159173 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3434/6853] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:22:15 2022] GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:22:16.182193 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1dee5eea-53fb-4f42-8f89-3742b5120c32 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:22:16.182835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1dee5eea-53fb-4f42-8f89-3742b5120c32 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 74e1d1f2-0257-48dd-a775-b29a6efb59b2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:22:16.189878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1dee5eea-53fb-4f42-8f89-3742b5120c32 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:16.190402 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1dee5eea-53fb-4f42-8f89-3742b5120c32 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:16.190855 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1dee5eea-53fb-4f42-8f89-3742b5120c32 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:16.191575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1dee5eea-53fb-4f42-8f89-3742b5120c32 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:16.192615 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1dee5eea-53fb-4f42-8f89-3742b5120c32 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:16.192615 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1dee5eea-53fb-4f42-8f89-3742b5120c32 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:16.267861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1dee5eea-53fb-4f42-8f89-3742b5120c32 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:22:16.275973 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1dee5eea-53fb-4f42-8f89-3742b5120c32 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2" status: 200 len: 1200 microversion: 2.1 time: 0.098773 Oct 05 03:22:16.277109 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3420/6854] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:22:16 2022] GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2 => generated 1200 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:22:17.299524 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-431f927e-e43d-423d-9e0d-a3dbc33c36b7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:22:17.300322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-431f927e-e43d-423d-9e0d-a3dbc33c36b7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 74e1d1f2-0257-48dd-a775-b29a6efb59b2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:22:17.308324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-431f927e-e43d-423d-9e0d-a3dbc33c36b7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:17.308922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-431f927e-e43d-423d-9e0d-a3dbc33c36b7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:17.309464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-431f927e-e43d-423d-9e0d-a3dbc33c36b7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:17.310900 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-431f927e-e43d-423d-9e0d-a3dbc33c36b7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:17.311558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-431f927e-e43d-423d-9e0d-a3dbc33c36b7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:17.312156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-431f927e-e43d-423d-9e0d-a3dbc33c36b7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:17.618829 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-431f927e-e43d-423d-9e0d-a3dbc33c36b7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:22:17.629364 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-431f927e-e43d-423d-9e0d-a3dbc33c36b7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2" status: 200 len: 1278 microversion: 2.1 time: 0.333699 Oct 05 03:22:17.630094 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3435/6855] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:22:17 2022] GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2 => generated 1278 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:22:17.768308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-8df33ffa-790a-4ef3-9d0e-136589a53221 req-abd66774-76cb-45ad-8aa5-fd171e889b20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74e1d1f2-0257-48dd-a775-b29a6efb59b2", "tag": "2e725af8-c531-46d1-8bd3-abf08127865f"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:22:17.785060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-8df33ffa-790a-4ef3-9d0e-136589a53221 req-abd66774-76cb-45ad-8aa5-fd171e889b20 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:17.785862 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-8df33ffa-790a-4ef3-9d0e-136589a53221 req-abd66774-76cb-45ad-8aa5-fd171e889b20 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:17.786318 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-8df33ffa-790a-4ef3-9d0e-136589a53221 req-abd66774-76cb-45ad-8aa5-fd171e889b20 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:17.798196 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-8df33ffa-790a-4ef3-9d0e-136589a53221 req-abd66774-76cb-45ad-8aa5-fd171e889b20 service nova] Creating event network-changed:2e725af8-c531-46d1-8bd3-abf08127865f for instance 74e1d1f2-0257-48dd-a775-b29a6efb59b2 on n-h2-858272-3 Oct 05 03:22:17.803391 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-8df33ffa-790a-4ef3-9d0e-136589a53221 req-abd66774-76cb-45ad-8aa5-fd171e889b20 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045005 Oct 05 03:22:17.804025 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3421/6856] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:22:18.653170 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9c103e65-fb3d-42ea-a720-d27d1a9d61bd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:22:18.655044 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9c103e65-fb3d-42ea-a720-d27d1a9d61bd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 74e1d1f2-0257-48dd-a775-b29a6efb59b2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:22:18.662857 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c103e65-fb3d-42ea-a720-d27d1a9d61bd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:18.663505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c103e65-fb3d-42ea-a720-d27d1a9d61bd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:18.664020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c103e65-fb3d-42ea-a720-d27d1a9d61bd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:18.665539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c103e65-fb3d-42ea-a720-d27d1a9d61bd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:18.666148 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c103e65-fb3d-42ea-a720-d27d1a9d61bd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:18.666728 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c103e65-fb3d-42ea-a720-d27d1a9d61bd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:18.848492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9c103e65-fb3d-42ea-a720-d27d1a9d61bd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:22:18.856679 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9c103e65-fb3d-42ea-a720-d27d1a9d61bd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2" status: 200 len: 1278 microversion: 2.1 time: 0.207261 Oct 05 03:22:18.858080 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3436/6857] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:22:18 2022] GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2 => generated 1278 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:22:19.882328 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9a5debbc-b05c-4f6a-be85-f9bb3992966f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:22:19.883042 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9a5debbc-b05c-4f6a-be85-f9bb3992966f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 74e1d1f2-0257-48dd-a775-b29a6efb59b2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:22:19.890268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a5debbc-b05c-4f6a-be85-f9bb3992966f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:19.890914 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a5debbc-b05c-4f6a-be85-f9bb3992966f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:19.891444 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a5debbc-b05c-4f6a-be85-f9bb3992966f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:19.892243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a5debbc-b05c-4f6a-be85-f9bb3992966f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:19.892745 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a5debbc-b05c-4f6a-be85-f9bb3992966f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:19.893374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9a5debbc-b05c-4f6a-be85-f9bb3992966f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:20.085677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9a5debbc-b05c-4f6a-be85-f9bb3992966f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:22:20.094132 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9a5debbc-b05c-4f6a-be85-f9bb3992966f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2" status: 200 len: 1278 microversion: 2.1 time: 0.216956 Oct 05 03:22:20.094751 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3422/6858] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:22:19 2022] GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2 => generated 1278 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:22:21.117640 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ddf820df-36fd-4524-8105-db16e108afe7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:22:21.118255 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ddf820df-36fd-4524-8105-db16e108afe7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 74e1d1f2-0257-48dd-a775-b29a6efb59b2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:22:21.125242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ddf820df-36fd-4524-8105-db16e108afe7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:21.125731 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ddf820df-36fd-4524-8105-db16e108afe7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:21.126165 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ddf820df-36fd-4524-8105-db16e108afe7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:21.126868 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ddf820df-36fd-4524-8105-db16e108afe7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:21.127321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ddf820df-36fd-4524-8105-db16e108afe7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:21.127745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ddf820df-36fd-4524-8105-db16e108afe7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:21.590133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ddf820df-36fd-4524-8105-db16e108afe7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:22:21.598227 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ddf820df-36fd-4524-8105-db16e108afe7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2" status: 200 len: 1278 microversion: 2.1 time: 0.484457 Oct 05 03:22:21.598805 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3437/6859] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:22:21 2022] GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2 => generated 1278 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:22:22.621232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f0956fc7-6670-4401-b1e9-ccd439b46057 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:22:22.621859 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f0956fc7-6670-4401-b1e9-ccd439b46057 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 74e1d1f2-0257-48dd-a775-b29a6efb59b2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:22:22.629185 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0956fc7-6670-4401-b1e9-ccd439b46057 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:22.629685 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0956fc7-6670-4401-b1e9-ccd439b46057 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:22.630139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0956fc7-6670-4401-b1e9-ccd439b46057 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:22.630843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0956fc7-6670-4401-b1e9-ccd439b46057 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:22.631307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0956fc7-6670-4401-b1e9-ccd439b46057 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:22.631737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f0956fc7-6670-4401-b1e9-ccd439b46057 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:22.766284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f0956fc7-6670-4401-b1e9-ccd439b46057 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:22:22.774040 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f0956fc7-6670-4401-b1e9-ccd439b46057 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2" status: 200 len: 1266 microversion: 2.1 time: 0.156802 Oct 05 03:22:22.774649 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3423/6860] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:22:22 2022] GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:22:23.798104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-91db8273-0e9d-422f-b3a5-3df8506b0d29 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:22:23.798718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-91db8273-0e9d-422f-b3a5-3df8506b0d29 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 74e1d1f2-0257-48dd-a775-b29a6efb59b2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:22:23.805501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91db8273-0e9d-422f-b3a5-3df8506b0d29 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:23.805987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91db8273-0e9d-422f-b3a5-3df8506b0d29 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:23.806420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91db8273-0e9d-422f-b3a5-3df8506b0d29 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:23.807109 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91db8273-0e9d-422f-b3a5-3df8506b0d29 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:23.807564 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91db8273-0e9d-422f-b3a5-3df8506b0d29 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:23.807988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91db8273-0e9d-422f-b3a5-3df8506b0d29 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:23.943841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-91db8273-0e9d-422f-b3a5-3df8506b0d29 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:22:23.951867 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-91db8273-0e9d-422f-b3a5-3df8506b0d29 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2" status: 200 len: 1266 microversion: 2.1 time: 0.158219 Oct 05 03:22:23.952492 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3438/6861] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:22:23 2022] GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:22:24.974550 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d09fba7d-c4f1-4e7e-bc5e-b8e15b37bd64 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:22:24.975107 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d09fba7d-c4f1-4e7e-bc5e-b8e15b37bd64 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 74e1d1f2-0257-48dd-a775-b29a6efb59b2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:22:24.977989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:22:24.978858 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:22:24.985725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d09fba7d-c4f1-4e7e-bc5e-b8e15b37bd64 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:24.986230 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d09fba7d-c4f1-4e7e-bc5e-b8e15b37bd64 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:24.986687 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d09fba7d-c4f1-4e7e-bc5e-b8e15b37bd64 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:24.987394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d09fba7d-c4f1-4e7e-bc5e-b8e15b37bd64 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:24.987865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d09fba7d-c4f1-4e7e-bc5e-b8e15b37bd64 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:24.988307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d09fba7d-c4f1-4e7e-bc5e-b8e15b37bd64 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:25.117041 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d09fba7d-c4f1-4e7e-bc5e-b8e15b37bd64 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:22:25.125426 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d09fba7d-c4f1-4e7e-bc5e-b8e15b37bd64 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2" status: 200 len: 1266 microversion: 2.1 time: 0.154846 Oct 05 03:22:25.126034 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3424/6862] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:22:24 2022] GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:22:26.148794 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7d521308-3541-45ac-a4a7-f6c37e5b166d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:22:26.149443 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7d521308-3541-45ac-a4a7-f6c37e5b166d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 74e1d1f2-0257-48dd-a775-b29a6efb59b2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:22:26.152119 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:22:26.157692 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d521308-3541-45ac-a4a7-f6c37e5b166d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:26.158185 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d521308-3541-45ac-a4a7-f6c37e5b166d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:26.158626 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d521308-3541-45ac-a4a7-f6c37e5b166d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:26.159358 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d521308-3541-45ac-a4a7-f6c37e5b166d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:26.159821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d521308-3541-45ac-a4a7-f6c37e5b166d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:26.160248 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d521308-3541-45ac-a4a7-f6c37e5b166d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:26.297530 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7d521308-3541-45ac-a4a7-f6c37e5b166d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:22:26.305291 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7d521308-3541-45ac-a4a7-f6c37e5b166d tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2" status: 200 len: 1266 microversion: 2.1 time: 0.160400 Oct 05 03:22:26.305854 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3439/6863] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:22:26 2022] GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:22:27.328854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8abbe552-c912-4c8e-b44b-426293e45d83 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:22:27.329582 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8abbe552-c912-4c8e-b44b-426293e45d83 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 74e1d1f2-0257-48dd-a775-b29a6efb59b2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:22:27.336477 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8abbe552-c912-4c8e-b44b-426293e45d83 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:27.337008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8abbe552-c912-4c8e-b44b-426293e45d83 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:27.337455 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8abbe552-c912-4c8e-b44b-426293e45d83 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:27.338150 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8abbe552-c912-4c8e-b44b-426293e45d83 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:27.338617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8abbe552-c912-4c8e-b44b-426293e45d83 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:27.339051 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8abbe552-c912-4c8e-b44b-426293e45d83 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:27.469233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8abbe552-c912-4c8e-b44b-426293e45d83 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:22:27.477277 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8abbe552-c912-4c8e-b44b-426293e45d83 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2" status: 200 len: 1266 microversion: 2.1 time: 0.153023 Oct 05 03:22:27.477845 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3425/6864] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:22:27 2022] GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:22:28.499402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-60d9dd6c-b62c-4530-b22c-8f25ddefd2e7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:22:28.500039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-60d9dd6c-b62c-4530-b22c-8f25ddefd2e7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 74e1d1f2-0257-48dd-a775-b29a6efb59b2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:22:28.506970 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60d9dd6c-b62c-4530-b22c-8f25ddefd2e7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:28.507454 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60d9dd6c-b62c-4530-b22c-8f25ddefd2e7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:28.507887 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60d9dd6c-b62c-4530-b22c-8f25ddefd2e7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:28.508574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60d9dd6c-b62c-4530-b22c-8f25ddefd2e7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:28.509054 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60d9dd6c-b62c-4530-b22c-8f25ddefd2e7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:28.509488 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60d9dd6c-b62c-4530-b22c-8f25ddefd2e7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:28.637562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-60d9dd6c-b62c-4530-b22c-8f25ddefd2e7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:22:28.645828 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-60d9dd6c-b62c-4530-b22c-8f25ddefd2e7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2" status: 200 len: 1266 microversion: 2.1 time: 0.150392 Oct 05 03:22:28.646398 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3440/6865] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:22:28 2022] GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:22:29.668749 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a5a70062-3376-4eee-afef-2db913bde63e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:22:29.669406 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a5a70062-3376-4eee-afef-2db913bde63e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 74e1d1f2-0257-48dd-a775-b29a6efb59b2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:22:29.676865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5a70062-3376-4eee-afef-2db913bde63e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:29.677395 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5a70062-3376-4eee-afef-2db913bde63e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:29.677843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5a70062-3376-4eee-afef-2db913bde63e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:29.678564 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5a70062-3376-4eee-afef-2db913bde63e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:29.679030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5a70062-3376-4eee-afef-2db913bde63e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:29.679463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5a70062-3376-4eee-afef-2db913bde63e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:29.812551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a5a70062-3376-4eee-afef-2db913bde63e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:22:29.820274 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a5a70062-3376-4eee-afef-2db913bde63e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2" status: 200 len: 1266 microversion: 2.1 time: 0.155419 Oct 05 03:22:29.820844 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3426/6866] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:22:29 2022] GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:22:30.842860 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4d25fd92-8725-4700-92f5-a2d29dd374e8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:22:30.843625 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4d25fd92-8725-4700-92f5-a2d29dd374e8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 74e1d1f2-0257-48dd-a775-b29a6efb59b2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:22:30.850563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d25fd92-8725-4700-92f5-a2d29dd374e8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:30.851050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d25fd92-8725-4700-92f5-a2d29dd374e8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:30.851485 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d25fd92-8725-4700-92f5-a2d29dd374e8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:30.852178 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d25fd92-8725-4700-92f5-a2d29dd374e8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:30.852633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d25fd92-8725-4700-92f5-a2d29dd374e8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:30.853113 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4d25fd92-8725-4700-92f5-a2d29dd374e8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:30.992200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4d25fd92-8725-4700-92f5-a2d29dd374e8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:22:31.001154 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4d25fd92-8725-4700-92f5-a2d29dd374e8 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2" status: 200 len: 1266 microversion: 2.1 time: 0.162232 Oct 05 03:22:31.001907 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3441/6867] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:22:30 2022] GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:22:31.061344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-a039bc9b-a8b6-4a83-948a-75d087352f37 req-f459a6b5-c4b9-4f5f-8477-efc1fd72153c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74e1d1f2-0257-48dd-a775-b29a6efb59b2", "name": "network-vif-plugged", "status": "completed", "tag": "2e725af8-c531-46d1-8bd3-abf08127865f"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:22:31.072436 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a039bc9b-a8b6-4a83-948a-75d087352f37 req-f459a6b5-c4b9-4f5f-8477-efc1fd72153c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:31.072966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a039bc9b-a8b6-4a83-948a-75d087352f37 req-f459a6b5-c4b9-4f5f-8477-efc1fd72153c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:31.073438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a039bc9b-a8b6-4a83-948a-75d087352f37 req-f459a6b5-c4b9-4f5f-8477-efc1fd72153c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:31.084520 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-a039bc9b-a8b6-4a83-948a-75d087352f37 req-f459a6b5-c4b9-4f5f-8477-efc1fd72153c service nova] Creating event network-vif-plugged:2e725af8-c531-46d1-8bd3-abf08127865f for instance 74e1d1f2-0257-48dd-a775-b29a6efb59b2 on n-h2-858272-3 Oct 05 03:22:31.090238 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-a039bc9b-a8b6-4a83-948a-75d087352f37 req-f459a6b5-c4b9-4f5f-8477-efc1fd72153c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097626 Oct 05 03:22:31.090871 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3427/6868] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:22:32.023761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-77e4c247-6ee1-499d-b05a-c14303a3eea6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:22:32.024291 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-77e4c247-6ee1-499d-b05a-c14303a3eea6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 74e1d1f2-0257-48dd-a775-b29a6efb59b2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:22:32.031482 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-77e4c247-6ee1-499d-b05a-c14303a3eea6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:32.031974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-77e4c247-6ee1-499d-b05a-c14303a3eea6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:32.032416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-77e4c247-6ee1-499d-b05a-c14303a3eea6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:32.033136 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-77e4c247-6ee1-499d-b05a-c14303a3eea6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:32.033646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-77e4c247-6ee1-499d-b05a-c14303a3eea6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:32.034081 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-77e4c247-6ee1-499d-b05a-c14303a3eea6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:32.163223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-77e4c247-6ee1-499d-b05a-c14303a3eea6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:22:32.171040 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-77e4c247-6ee1-499d-b05a-c14303a3eea6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2" status: 200 len: 1266 microversion: 2.1 time: 0.151317 Oct 05 03:22:32.171617 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3442/6869] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:22:32 2022] GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:22:33.195032 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9ccea371-f384-4c80-ac3c-66e8073b9f8b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:22:33.195740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9ccea371-f384-4c80-ac3c-66e8073b9f8b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 74e1d1f2-0257-48dd-a775-b29a6efb59b2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:22:33.202469 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ccea371-f384-4c80-ac3c-66e8073b9f8b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:33.203112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ccea371-f384-4c80-ac3c-66e8073b9f8b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:33.203562 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ccea371-f384-4c80-ac3c-66e8073b9f8b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:33.204256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ccea371-f384-4c80-ac3c-66e8073b9f8b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:33.204719 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ccea371-f384-4c80-ac3c-66e8073b9f8b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:33.205182 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ccea371-f384-4c80-ac3c-66e8073b9f8b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:33.336239 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9ccea371-f384-4c80-ac3c-66e8073b9f8b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:22:33.344830 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9ccea371-f384-4c80-ac3c-66e8073b9f8b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2" status: 200 len: 1454 microversion: 2.1 time: 0.154877 Oct 05 03:22:33.345434 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3428/6870] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:22:33 2022] GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2 => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:22:33.367377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-db3917ee-958f-48dd-8364-9b98b34c0f36 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:22:33.367924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-db3917ee-958f-48dd-8364-9b98b34c0f36 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 74e1d1f2-0257-48dd-a775-b29a6efb59b2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:22:33.374928 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db3917ee-958f-48dd-8364-9b98b34c0f36 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:33.375411 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db3917ee-958f-48dd-8364-9b98b34c0f36 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:33.375846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db3917ee-958f-48dd-8364-9b98b34c0f36 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:33.376532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db3917ee-958f-48dd-8364-9b98b34c0f36 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:33.377071 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db3917ee-958f-48dd-8364-9b98b34c0f36 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:33.377505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db3917ee-958f-48dd-8364-9b98b34c0f36 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:33.511421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-db3917ee-958f-48dd-8364-9b98b34c0f36 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:22:33.519813 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-db3917ee-958f-48dd-8364-9b98b34c0f36 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2" status: 200 len: 1454 microversion: 2.1 time: 0.156483 Oct 05 03:22:33.520394 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3443/6871] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:22:33 2022] GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2 => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:22:35.128850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-17ac8af2-43de-4be4-92b2-bc2c0f522b00 req-88f757a1-2b01-44d5-856a-6ada3c149346 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74e1d1f2-0257-48dd-a775-b29a6efb59b2", "tag": "2e725af8-c531-46d1-8bd3-abf08127865f"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:22:35.138968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-17ac8af2-43de-4be4-92b2-bc2c0f522b00 req-88f757a1-2b01-44d5-856a-6ada3c149346 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:22:35.139915 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-17ac8af2-43de-4be4-92b2-bc2c0f522b00 req-88f757a1-2b01-44d5-856a-6ada3c149346 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:22:35.140448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-17ac8af2-43de-4be4-92b2-bc2c0f522b00 req-88f757a1-2b01-44d5-856a-6ada3c149346 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:22:35.151675 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-17ac8af2-43de-4be4-92b2-bc2c0f522b00 req-88f757a1-2b01-44d5-856a-6ada3c149346 service nova] Creating event network-changed:2e725af8-c531-46d1-8bd3-abf08127865f for instance 74e1d1f2-0257-48dd-a775-b29a6efb59b2 on n-h2-858272-3 Oct 05 03:22:35.157802 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-17ac8af2-43de-4be4-92b2-bc2c0f522b00 req-88f757a1-2b01-44d5-856a-6ada3c149346 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032609 Oct 05 03:22:35.158402 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3429/6872] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:24:13.576332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=32 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:24:13.577117 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=80 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:24:13.578059 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 03:24:13.578212 n-d-858272-3 devstack@n-api.service[122319]: Wed Oct 5 03:24:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Oct 05 03:24:13.589974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0ac5e239-79c8-47f3-8930-71ff4c68150a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1269749794", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-383498722", "security_groups": [{"name": "tempest-secgroup-smoke-1461955712"}], "block_device_mapping_v2": [{"uuid": "c175b489-8002-4e63-9b79-d62632cc41b3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fa70d413-7436-41df-9105-d3173bf249ed"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:24:13.705726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-0ac5e239-79c8-47f3-8930-71ff4c68150a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] validate_networks() for [('fa70d413-7436-41df-9105-d3173bf249ed', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:24:14.151931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0ac5e239-79c8-47f3-8930-71ff4c68150a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:24:14.152364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0ac5e239-79c8-47f3-8930-71ff4c68150a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:24:14.152840 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0ac5e239-79c8-47f3-8930-71ff4c68150a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:24:14.153301 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0ac5e239-79c8-47f3-8930-71ff4c68150a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:24:14.153717 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0ac5e239-79c8-47f3-8930-71ff4c68150a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:24:14.162481 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ac5e239-79c8-47f3-8930-71ff4c68150a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:14.162969 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ac5e239-79c8-47f3-8930-71ff4c68150a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:14.163407 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ac5e239-79c8-47f3-8930-71ff4c68150a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:14.164142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ac5e239-79c8-47f3-8930-71ff4c68150a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:14.164600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ac5e239-79c8-47f3-8930-71ff4c68150a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:14.165058 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ac5e239-79c8-47f3-8930-71ff4c68150a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:14.182245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-0ac5e239-79c8-47f3-8930-71ff4c68150a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Getting quotas for project 713e3a431a2441548123f404b23ce0da. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:24:14.187632 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-0ac5e239-79c8-47f3-8930-71ff4c68150a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Getting quotas for user ee8daf94c54c4dd7b69310674d73211a and project 713e3a431a2441548123f404b23ce0da. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:24:14.249371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0ac5e239-79c8-47f3-8930-71ff4c68150a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:24:14.251487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0ac5e239-79c8-47f3-8930-71ff4c68150a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 73abb964-9a04-447c-aff6-4bebc253071a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c175b489-8002-4e63-9b79-d62632cc41b3',volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:24:14.384592 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0ac5e239-79c8-47f3-8930-71ff4c68150a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.810298 Oct 05 03:24:14.385280 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3444/6873] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:24:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:24:14.394580 n-d-858272-3 devstack@n-api.service[122320]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f8dec5f5-af45-49c2-a8e7-bbd40c1c5148] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 05 03:24:14.396277 n-d-858272-3 devstack@n-api.service[122320]: ERROR oslo.messaging._drivers.impl_rabbit [-] [478c9060-5882-4902-b074-d751d7d6fe39] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 05 03:24:14.397044 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:24:14.397880 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:24:14.405085 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d859d78e-8c75-4daa-8124-80be375e7a8f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:24:14.405812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d859d78e-8c75-4daa-8124-80be375e7a8f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 73abb964-9a04-447c-aff6-4bebc253071a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:24:14.463446 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d859d78e-8c75-4daa-8124-80be375e7a8f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:24:14.470365 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d859d78e-8c75-4daa-8124-80be375e7a8f tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a" status: 200 len: 1094 microversion: 2.1 time: 0.077866 Oct 05 03:24:14.470940 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3430/6874] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:24:14 2022] GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:24:15.494877 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6eef2e75-66eb-4222-8ef4-8d0986fc73ab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:24:15.495497 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6eef2e75-66eb-4222-8ef4-8d0986fc73ab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 73abb964-9a04-447c-aff6-4bebc253071a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:24:15.551564 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6eef2e75-66eb-4222-8ef4-8d0986fc73ab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:24:15.558907 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6eef2e75-66eb-4222-8ef4-8d0986fc73ab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a" status: 200 len: 1094 microversion: 2.1 time: 0.068825 Oct 05 03:24:15.559539 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3445/6875] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:24:15 2022] GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:24:16.582754 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d9a41d92-4754-4718-8d69-dba0d2a4ab4c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:24:16.583381 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d9a41d92-4754-4718-8d69-dba0d2a4ab4c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 73abb964-9a04-447c-aff6-4bebc253071a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:24:16.609557 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [-] [478c9060-5882-4902-b074-d751d7d6fe39] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 43342. Oct 05 03:24:16.610291 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [-] [f8dec5f5-af45-49c2-a8e7-bbd40c1c5148] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 43340. Oct 05 03:24:16.641567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d9a41d92-4754-4718-8d69-dba0d2a4ab4c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:24:16.653570 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d9a41d92-4754-4718-8d69-dba0d2a4ab4c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a" status: 200 len: 1094 microversion: 2.1 time: 0.075156 Oct 05 03:24:16.654159 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3431/6876] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:24:16 2022] GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:24:17.675656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-28aff2e7-f47b-49ed-8a62-bc4ba17a98bb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:24:17.676816 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-28aff2e7-f47b-49ed-8a62-bc4ba17a98bb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 73abb964-9a04-447c-aff6-4bebc253071a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:24:17.684321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28aff2e7-f47b-49ed-8a62-bc4ba17a98bb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:17.684815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28aff2e7-f47b-49ed-8a62-bc4ba17a98bb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:17.685294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28aff2e7-f47b-49ed-8a62-bc4ba17a98bb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:17.685987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28aff2e7-f47b-49ed-8a62-bc4ba17a98bb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:17.686451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28aff2e7-f47b-49ed-8a62-bc4ba17a98bb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:17.686886 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28aff2e7-f47b-49ed-8a62-bc4ba17a98bb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:17.747041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-28aff2e7-f47b-49ed-8a62-bc4ba17a98bb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:24:17.754822 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-28aff2e7-f47b-49ed-8a62-bc4ba17a98bb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a" status: 200 len: 1144 microversion: 2.1 time: 0.083124 Oct 05 03:24:17.755398 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3446/6877] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:24:17 2022] GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:24:18.777628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9da09731-0a76-48e0-a25c-6fc4d0d56aeb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:24:18.778341 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9da09731-0a76-48e0-a25c-6fc4d0d56aeb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 73abb964-9a04-447c-aff6-4bebc253071a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:24:18.786788 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9da09731-0a76-48e0-a25c-6fc4d0d56aeb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:18.787377 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9da09731-0a76-48e0-a25c-6fc4d0d56aeb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:18.787893 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9da09731-0a76-48e0-a25c-6fc4d0d56aeb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:18.788848 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9da09731-0a76-48e0-a25c-6fc4d0d56aeb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:18.789405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9da09731-0a76-48e0-a25c-6fc4d0d56aeb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:18.789922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9da09731-0a76-48e0-a25c-6fc4d0d56aeb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:18.862443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9da09731-0a76-48e0-a25c-6fc4d0d56aeb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:24:18.870503 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9da09731-0a76-48e0-a25c-6fc4d0d56aeb tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a" status: 200 len: 1210 microversion: 2.1 time: 0.096960 Oct 05 03:24:18.871233 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3432/6878] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:24:18 2022] GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a => generated 1210 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:24:19.896227 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1f07a025-ad66-427e-b673-b9b2c6d2c0b7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:24:19.896968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1f07a025-ad66-427e-b673-b9b2c6d2c0b7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 73abb964-9a04-447c-aff6-4bebc253071a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:24:19.905548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f07a025-ad66-427e-b673-b9b2c6d2c0b7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:19.906197 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f07a025-ad66-427e-b673-b9b2c6d2c0b7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:19.906720 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f07a025-ad66-427e-b673-b9b2c6d2c0b7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:19.907448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f07a025-ad66-427e-b673-b9b2c6d2c0b7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:19.907914 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f07a025-ad66-427e-b673-b9b2c6d2c0b7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:19.908349 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f07a025-ad66-427e-b673-b9b2c6d2c0b7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:20.155166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1f07a025-ad66-427e-b673-b9b2c6d2c0b7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:24:20.166678 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1f07a025-ad66-427e-b673-b9b2c6d2c0b7 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a" status: 200 len: 1278 microversion: 2.1 time: 0.275680 Oct 05 03:24:20.167428 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3447/6879] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:24:19 2022] GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a => generated 1278 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:24:20.419463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-94ae97ec-7229-4aa6-9f5d-a8c1d409774e req-678b0eb9-f2df-4a72-b4cd-de3aa6821dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73abb964-9a04-447c-aff6-4bebc253071a", "tag": "e6412db9-cba8-413b-bf10-39cdd95056ee"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:24:20.431988 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-94ae97ec-7229-4aa6-9f5d-a8c1d409774e req-678b0eb9-f2df-4a72-b4cd-de3aa6821dc0 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:20.432775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-94ae97ec-7229-4aa6-9f5d-a8c1d409774e req-678b0eb9-f2df-4a72-b4cd-de3aa6821dc0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:20.433218 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-94ae97ec-7229-4aa6-9f5d-a8c1d409774e req-678b0eb9-f2df-4a72-b4cd-de3aa6821dc0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:20.446688 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-94ae97ec-7229-4aa6-9f5d-a8c1d409774e req-678b0eb9-f2df-4a72-b4cd-de3aa6821dc0 service nova] Creating event network-changed:e6412db9-cba8-413b-bf10-39cdd95056ee for instance 73abb964-9a04-447c-aff6-4bebc253071a on n-h1-858272-3 Oct 05 03:24:20.452480 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-94ae97ec-7229-4aa6-9f5d-a8c1d409774e req-678b0eb9-f2df-4a72-b4cd-de3aa6821dc0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037161 Oct 05 03:24:20.453506 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3433/6880] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:24:21.191126 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3cc531f5-eebe-4df5-a4b7-e00100c43e05 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:24:21.193793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3cc531f5-eebe-4df5-a4b7-e00100c43e05 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 73abb964-9a04-447c-aff6-4bebc253071a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:24:21.201231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3cc531f5-eebe-4df5-a4b7-e00100c43e05 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:21.201738 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3cc531f5-eebe-4df5-a4b7-e00100c43e05 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:21.202189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3cc531f5-eebe-4df5-a4b7-e00100c43e05 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:21.202897 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3cc531f5-eebe-4df5-a4b7-e00100c43e05 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:21.203363 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3cc531f5-eebe-4df5-a4b7-e00100c43e05 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:21.203823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3cc531f5-eebe-4df5-a4b7-e00100c43e05 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:21.421640 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3cc531f5-eebe-4df5-a4b7-e00100c43e05 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:24:21.430618 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3cc531f5-eebe-4df5-a4b7-e00100c43e05 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a" status: 200 len: 1278 microversion: 2.1 time: 0.243467 Oct 05 03:24:21.431339 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3448/6881] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:24:21 2022] GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a => generated 1278 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:24:22.455272 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b8c99b1b-aeea-49f9-9bc1-ced1f953f6e9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:24:22.455971 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b8c99b1b-aeea-49f9-9bc1-ced1f953f6e9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 73abb964-9a04-447c-aff6-4bebc253071a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:24:22.463140 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8c99b1b-aeea-49f9-9bc1-ced1f953f6e9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:22.463643 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8c99b1b-aeea-49f9-9bc1-ced1f953f6e9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:22.464092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8c99b1b-aeea-49f9-9bc1-ced1f953f6e9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:22.464804 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8c99b1b-aeea-49f9-9bc1-ced1f953f6e9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:22.465306 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8c99b1b-aeea-49f9-9bc1-ced1f953f6e9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:22.465743 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8c99b1b-aeea-49f9-9bc1-ced1f953f6e9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:22.604318 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b8c99b1b-aeea-49f9-9bc1-ced1f953f6e9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:24:22.613042 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b8c99b1b-aeea-49f9-9bc1-ced1f953f6e9 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a" status: 200 len: 1278 microversion: 2.1 time: 0.162795 Oct 05 03:24:22.613971 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3434/6882] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:24:22 2022] GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:24:23.636329 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2cc2d78e-6e70-4bc4-9764-96103458dfd6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:24:23.637038 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2cc2d78e-6e70-4bc4-9764-96103458dfd6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 73abb964-9a04-447c-aff6-4bebc253071a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:24:23.644018 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2cc2d78e-6e70-4bc4-9764-96103458dfd6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:23.644543 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2cc2d78e-6e70-4bc4-9764-96103458dfd6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:23.645122 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2cc2d78e-6e70-4bc4-9764-96103458dfd6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:23.645828 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2cc2d78e-6e70-4bc4-9764-96103458dfd6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:23.646284 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2cc2d78e-6e70-4bc4-9764-96103458dfd6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:23.646712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2cc2d78e-6e70-4bc4-9764-96103458dfd6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:23.780773 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2cc2d78e-6e70-4bc4-9764-96103458dfd6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:24:23.788552 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2cc2d78e-6e70-4bc4-9764-96103458dfd6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a" status: 200 len: 1278 microversion: 2.1 time: 0.156177 Oct 05 03:24:23.789156 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3449/6883] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:24:23 2022] GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:24:24.811804 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-039716ec-0b78-420f-a5db-a19871a4f30a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:24:24.812484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-039716ec-0b78-420f-a5db-a19871a4f30a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 73abb964-9a04-447c-aff6-4bebc253071a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:24:24.820424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-039716ec-0b78-420f-a5db-a19871a4f30a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:24.821079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-039716ec-0b78-420f-a5db-a19871a4f30a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:24.821490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-039716ec-0b78-420f-a5db-a19871a4f30a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:24.822221 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-039716ec-0b78-420f-a5db-a19871a4f30a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:24.822693 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-039716ec-0b78-420f-a5db-a19871a4f30a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:24.823191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-039716ec-0b78-420f-a5db-a19871a4f30a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:24.967887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-039716ec-0b78-420f-a5db-a19871a4f30a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:24:24.976131 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-039716ec-0b78-420f-a5db-a19871a4f30a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a" status: 200 len: 1266 microversion: 2.1 time: 0.168205 Oct 05 03:24:24.976714 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3435/6884] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:24:24 2022] GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:24:25.999868 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3f2d23a9-7425-4e8b-9b90-f587f5de6348 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:24:26.000655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3f2d23a9-7425-4e8b-9b90-f587f5de6348 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 73abb964-9a04-447c-aff6-4bebc253071a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:24:26.002573 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:24:26.004455 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=8 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:24:26.010356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f2d23a9-7425-4e8b-9b90-f587f5de6348 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:26.010850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f2d23a9-7425-4e8b-9b90-f587f5de6348 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:26.011294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f2d23a9-7425-4e8b-9b90-f587f5de6348 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:26.011997 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f2d23a9-7425-4e8b-9b90-f587f5de6348 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:26.012461 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f2d23a9-7425-4e8b-9b90-f587f5de6348 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:26.012889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f2d23a9-7425-4e8b-9b90-f587f5de6348 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:26.147675 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3f2d23a9-7425-4e8b-9b90-f587f5de6348 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:24:26.155423 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3f2d23a9-7425-4e8b-9b90-f587f5de6348 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a" status: 200 len: 1266 microversion: 2.1 time: 0.159440 Oct 05 03:24:26.156004 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3450/6885] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:24:25 2022] GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:24:27.178845 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2d444cdb-3219-44fb-94ce-70c906600e07 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:24:27.179479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2d444cdb-3219-44fb-94ce-70c906600e07 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 73abb964-9a04-447c-aff6-4bebc253071a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:24:27.182315 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:24:27.187750 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d444cdb-3219-44fb-94ce-70c906600e07 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:27.188249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d444cdb-3219-44fb-94ce-70c906600e07 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:27.188699 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d444cdb-3219-44fb-94ce-70c906600e07 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:27.189426 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d444cdb-3219-44fb-94ce-70c906600e07 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:27.189900 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d444cdb-3219-44fb-94ce-70c906600e07 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:27.190340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d444cdb-3219-44fb-94ce-70c906600e07 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:27.322779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2d444cdb-3219-44fb-94ce-70c906600e07 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:24:27.330476 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2d444cdb-3219-44fb-94ce-70c906600e07 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a" status: 200 len: 1266 microversion: 2.1 time: 0.156174 Oct 05 03:24:27.331050 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3436/6886] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:24:27 2022] GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:24:28.353403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b9e9e04a-ec53-47fc-975c-7019e4f71d10 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:24:28.354019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b9e9e04a-ec53-47fc-975c-7019e4f71d10 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 73abb964-9a04-447c-aff6-4bebc253071a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:24:28.361196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9e9e04a-ec53-47fc-975c-7019e4f71d10 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:28.361688 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9e9e04a-ec53-47fc-975c-7019e4f71d10 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:28.362129 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9e9e04a-ec53-47fc-975c-7019e4f71d10 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:28.362826 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9e9e04a-ec53-47fc-975c-7019e4f71d10 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:28.363318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9e9e04a-ec53-47fc-975c-7019e4f71d10 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:28.363762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9e9e04a-ec53-47fc-975c-7019e4f71d10 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:28.496004 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b9e9e04a-ec53-47fc-975c-7019e4f71d10 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:24:28.504302 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b9e9e04a-ec53-47fc-975c-7019e4f71d10 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a" status: 200 len: 1266 microversion: 2.1 time: 0.154259 Oct 05 03:24:28.504889 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3451/6887] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:24:28 2022] GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:24:29.526672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-06566d86-a639-4d3a-845a-80a19b147335 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:24:29.527231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-06566d86-a639-4d3a-845a-80a19b147335 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 73abb964-9a04-447c-aff6-4bebc253071a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:24:29.534080 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-06566d86-a639-4d3a-845a-80a19b147335 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:29.534578 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-06566d86-a639-4d3a-845a-80a19b147335 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:29.535652 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-06566d86-a639-4d3a-845a-80a19b147335 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:29.536358 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-06566d86-a639-4d3a-845a-80a19b147335 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:29.536832 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-06566d86-a639-4d3a-845a-80a19b147335 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:29.537322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-06566d86-a639-4d3a-845a-80a19b147335 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:29.676359 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-06566d86-a639-4d3a-845a-80a19b147335 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:24:29.684264 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-06566d86-a639-4d3a-845a-80a19b147335 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a" status: 200 len: 1266 microversion: 2.1 time: 0.161581 Oct 05 03:24:29.684849 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3437/6888] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:24:29 2022] GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:24:30.707438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a50bf08f-ec2d-42fd-af5e-a64026363899 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:24:30.708047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a50bf08f-ec2d-42fd-af5e-a64026363899 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 73abb964-9a04-447c-aff6-4bebc253071a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:24:30.715866 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a50bf08f-ec2d-42fd-af5e-a64026363899 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:30.716357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a50bf08f-ec2d-42fd-af5e-a64026363899 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:30.716796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a50bf08f-ec2d-42fd-af5e-a64026363899 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:30.717516 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a50bf08f-ec2d-42fd-af5e-a64026363899 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:30.717976 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a50bf08f-ec2d-42fd-af5e-a64026363899 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:30.718406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a50bf08f-ec2d-42fd-af5e-a64026363899 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:30.847269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a50bf08f-ec2d-42fd-af5e-a64026363899 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:24:30.855466 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a50bf08f-ec2d-42fd-af5e-a64026363899 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a" status: 200 len: 1266 microversion: 2.1 time: 0.151927 Oct 05 03:24:30.856057 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3452/6889] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:24:30 2022] GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:24:31.877994 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6886bac4-509f-46a6-b0c6-69f8dced38ab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:24:31.878753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6886bac4-509f-46a6-b0c6-69f8dced38ab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 73abb964-9a04-447c-aff6-4bebc253071a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:24:31.885678 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6886bac4-509f-46a6-b0c6-69f8dced38ab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:31.886224 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6886bac4-509f-46a6-b0c6-69f8dced38ab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:31.886673 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6886bac4-509f-46a6-b0c6-69f8dced38ab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:31.887363 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6886bac4-509f-46a6-b0c6-69f8dced38ab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:31.887854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6886bac4-509f-46a6-b0c6-69f8dced38ab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:31.888286 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6886bac4-509f-46a6-b0c6-69f8dced38ab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:32.027228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6886bac4-509f-46a6-b0c6-69f8dced38ab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:24:32.035705 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6886bac4-509f-46a6-b0c6-69f8dced38ab tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a" status: 200 len: 1266 microversion: 2.1 time: 0.160880 Oct 05 03:24:32.036292 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3438/6890] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:24:31 2022] GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:24:33.058497 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4a08c6ef-0b19-4809-82c0-e4d412a348e6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:24:33.059121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4a08c6ef-0b19-4809-82c0-e4d412a348e6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 73abb964-9a04-447c-aff6-4bebc253071a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:24:33.066084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a08c6ef-0b19-4809-82c0-e4d412a348e6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:33.066578 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a08c6ef-0b19-4809-82c0-e4d412a348e6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:33.067024 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a08c6ef-0b19-4809-82c0-e4d412a348e6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:33.067732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a08c6ef-0b19-4809-82c0-e4d412a348e6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:33.068193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a08c6ef-0b19-4809-82c0-e4d412a348e6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:33.068630 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4a08c6ef-0b19-4809-82c0-e4d412a348e6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:33.200937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4a08c6ef-0b19-4809-82c0-e4d412a348e6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:24:33.209417 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4a08c6ef-0b19-4809-82c0-e4d412a348e6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a" status: 200 len: 1266 microversion: 2.1 time: 0.154864 Oct 05 03:24:33.209998 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3453/6891] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:24:33 2022] GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:24:34.231959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1273cd3e-e495-4281-951f-6af362adb999 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:24:34.232513 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1273cd3e-e495-4281-951f-6af362adb999 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 73abb964-9a04-447c-aff6-4bebc253071a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:24:34.239558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1273cd3e-e495-4281-951f-6af362adb999 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:34.240057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1273cd3e-e495-4281-951f-6af362adb999 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:34.240505 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1273cd3e-e495-4281-951f-6af362adb999 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:34.241223 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1273cd3e-e495-4281-951f-6af362adb999 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:34.241708 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1273cd3e-e495-4281-951f-6af362adb999 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:34.242176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1273cd3e-e495-4281-951f-6af362adb999 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:34.371673 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1273cd3e-e495-4281-951f-6af362adb999 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:24:34.380268 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1273cd3e-e495-4281-951f-6af362adb999 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a" status: 200 len: 1266 microversion: 2.1 time: 0.152535 Oct 05 03:24:34.380843 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3439/6892] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:24:34 2022] GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:24:35.404336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0a23a101-2199-4732-aa38-7fb0a57b8e78 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:24:35.404979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0a23a101-2199-4732-aa38-7fb0a57b8e78 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 73abb964-9a04-447c-aff6-4bebc253071a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:24:35.412554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a23a101-2199-4732-aa38-7fb0a57b8e78 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:35.413443 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a23a101-2199-4732-aa38-7fb0a57b8e78 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:35.413576 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a23a101-2199-4732-aa38-7fb0a57b8e78 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:35.413664 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-afd46beb-0298-46b7-bdda-c23781f5f981 req-b0ca7a7f-03de-45ae-82d6-3b2611e288fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73abb964-9a04-447c-aff6-4bebc253071a", "name": "network-vif-plugged", "status": "completed", "tag": "e6412db9-cba8-413b-bf10-39cdd95056ee"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:24:35.414188 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a23a101-2199-4732-aa38-7fb0a57b8e78 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:35.414639 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a23a101-2199-4732-aa38-7fb0a57b8e78 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:35.415260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a23a101-2199-4732-aa38-7fb0a57b8e78 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:35.425311 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-afd46beb-0298-46b7-bdda-c23781f5f981 req-b0ca7a7f-03de-45ae-82d6-3b2611e288fb service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:35.426426 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-afd46beb-0298-46b7-bdda-c23781f5f981 req-b0ca7a7f-03de-45ae-82d6-3b2611e288fb service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:35.427119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-afd46beb-0298-46b7-bdda-c23781f5f981 req-b0ca7a7f-03de-45ae-82d6-3b2611e288fb service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:35.439475 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-afd46beb-0298-46b7-bdda-c23781f5f981 req-b0ca7a7f-03de-45ae-82d6-3b2611e288fb service nova] Creating event network-vif-plugged:e6412db9-cba8-413b-bf10-39cdd95056ee for instance 73abb964-9a04-447c-aff6-4bebc253071a on n-h1-858272-3 Oct 05 03:24:35.444793 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-afd46beb-0298-46b7-bdda-c23781f5f981 req-b0ca7a7f-03de-45ae-82d6-3b2611e288fb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036124 Oct 05 03:24:35.445759 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3440/6893] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:24:35.589784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0a23a101-2199-4732-aa38-7fb0a57b8e78 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:24:35.598728 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0a23a101-2199-4732-aa38-7fb0a57b8e78 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a" status: 200 len: 1266 microversion: 2.1 time: 0.197746 Oct 05 03:24:35.599323 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3454/6894] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:24:35 2022] GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:24:36.623397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3bc3a9ae-e650-4da1-97de-bb07ebf142df tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:24:36.624134 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3bc3a9ae-e650-4da1-97de-bb07ebf142df tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 73abb964-9a04-447c-aff6-4bebc253071a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:24:36.631070 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3bc3a9ae-e650-4da1-97de-bb07ebf142df tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:36.631572 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3bc3a9ae-e650-4da1-97de-bb07ebf142df tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:36.632018 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3bc3a9ae-e650-4da1-97de-bb07ebf142df tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:36.632712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3bc3a9ae-e650-4da1-97de-bb07ebf142df tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:36.633206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3bc3a9ae-e650-4da1-97de-bb07ebf142df tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:36.633640 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3bc3a9ae-e650-4da1-97de-bb07ebf142df tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:36.769047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3bc3a9ae-e650-4da1-97de-bb07ebf142df tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:24:36.776870 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3bc3a9ae-e650-4da1-97de-bb07ebf142df tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a" status: 200 len: 1266 microversion: 2.1 time: 0.158525 Oct 05 03:24:36.777459 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3441/6895] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:24:36 2022] GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:24:37.799265 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4ee77391-8a21-42d1-973d-6be9a0210860 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:24:37.799882 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4ee77391-8a21-42d1-973d-6be9a0210860 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 73abb964-9a04-447c-aff6-4bebc253071a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:24:37.807535 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ee77391-8a21-42d1-973d-6be9a0210860 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:37.808022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ee77391-8a21-42d1-973d-6be9a0210860 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:37.808456 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ee77391-8a21-42d1-973d-6be9a0210860 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:37.809179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ee77391-8a21-42d1-973d-6be9a0210860 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:37.809634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ee77391-8a21-42d1-973d-6be9a0210860 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:37.810061 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ee77391-8a21-42d1-973d-6be9a0210860 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:37.942854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4ee77391-8a21-42d1-973d-6be9a0210860 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:24:37.950631 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4ee77391-8a21-42d1-973d-6be9a0210860 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a" status: 200 len: 1454 microversion: 2.1 time: 0.155284 Oct 05 03:24:37.951199 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3455/6896] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:24:37 2022] GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:24:37.972345 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c3ba79c6-322d-45a6-a177-0f738b0e512a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:24:37.973004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c3ba79c6-322d-45a6-a177-0f738b0e512a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 73abb964-9a04-447c-aff6-4bebc253071a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:24:37.980143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3ba79c6-322d-45a6-a177-0f738b0e512a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:37.980645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3ba79c6-322d-45a6-a177-0f738b0e512a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:37.981110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3ba79c6-322d-45a6-a177-0f738b0e512a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:37.981833 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3ba79c6-322d-45a6-a177-0f738b0e512a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:37.982298 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3ba79c6-322d-45a6-a177-0f738b0e512a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:37.982739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c3ba79c6-322d-45a6-a177-0f738b0e512a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:38.116865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c3ba79c6-322d-45a6-a177-0f738b0e512a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:24:38.124761 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c3ba79c6-322d-45a6-a177-0f738b0e512a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a" status: 200 len: 1454 microversion: 2.1 time: 0.156359 Oct 05 03:24:38.125365 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3442/6897] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:24:37 2022] GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:24:39.712779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-4ee5a879-2722-4839-935a-fb3efa313b0e req-17134287-1f15-43ac-a905-bdf2eea6fbce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73abb964-9a04-447c-aff6-4bebc253071a", "tag": "e6412db9-cba8-413b-bf10-39cdd95056ee"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:24:39.723020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4ee5a879-2722-4839-935a-fb3efa313b0e req-17134287-1f15-43ac-a905-bdf2eea6fbce service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:24:39.723555 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4ee5a879-2722-4839-935a-fb3efa313b0e req-17134287-1f15-43ac-a905-bdf2eea6fbce service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:24:39.723992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4ee5a879-2722-4839-935a-fb3efa313b0e req-17134287-1f15-43ac-a905-bdf2eea6fbce service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:24:39.735561 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-4ee5a879-2722-4839-935a-fb3efa313b0e req-17134287-1f15-43ac-a905-bdf2eea6fbce service nova] Creating event network-changed:e6412db9-cba8-413b-bf10-39cdd95056ee for instance 73abb964-9a04-447c-aff6-4bebc253071a on n-h1-858272-3 Oct 05 03:24:39.742385 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-4ee5a879-2722-4839-935a-fb3efa313b0e req-17134287-1f15-43ac-a905-bdf2eea6fbce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033613 Oct 05 03:24:39.742981 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3456/6898] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:26:22.379589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=30 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:26:22.380747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=58 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:26:22.382108 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 03:26:22.382241 n-d-858272-3 devstack@n-api.service[122320]: Wed Oct 5 03:26:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a (ip 10.222.0.16) !!! Oct 05 03:26:22.384407 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 03:26:22.384817 n-d-858272-3 devstack@n-api.service[122320]: Wed Oct 5 03:26:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a (ip 10.222.0.16) !!! Oct 05 03:26:22.404014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-09987bb2-177e-4499-9d42-3816c0f1396c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:26:22.404630 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-09987bb2-177e-4499-9d42-3816c0f1396c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 73abb964-9a04-447c-aff6-4bebc253071a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:26:22.412134 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09987bb2-177e-4499-9d42-3816c0f1396c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:22.412956 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09987bb2-177e-4499-9d42-3816c0f1396c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:22.414057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09987bb2-177e-4499-9d42-3816c0f1396c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:22.415466 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09987bb2-177e-4499-9d42-3816c0f1396c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:22.416369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09987bb2-177e-4499-9d42-3816c0f1396c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:22.417747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09987bb2-177e-4499-9d42-3816c0f1396c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:22.451803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-09987bb2-177e-4499-9d42-3816c0f1396c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 73abb964-9a04-447c-aff6-4bebc253071a] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:26:22.518979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:26:22.519911 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=64 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:26:22.520934 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 03:26:22.521225 n-d-858272-3 devstack@n-api.service[122319]: Wed Oct 5 03:26:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 05 03:26:22.558147 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-09987bb2-177e-4499-9d42-3816c0f1396c tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "DELETE /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a" status: 204 len: 0 microversion: 2.1 time: 0.181015 Oct 05 03:26:22.560936 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3443/6899] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:26:22 2022] DELETE /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:26:22.568377 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e0dee982-c776-4d5a-bbe6-5c88293b43b0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:26:22.569120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e0dee982-c776-4d5a-bbe6-5c88293b43b0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 73abb964-9a04-447c-aff6-4bebc253071a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:26:22.575703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0dee982-c776-4d5a-bbe6-5c88293b43b0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:22.576202 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0dee982-c776-4d5a-bbe6-5c88293b43b0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:22.576650 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0dee982-c776-4d5a-bbe6-5c88293b43b0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:22.577390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0dee982-c776-4d5a-bbe6-5c88293b43b0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:22.577857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0dee982-c776-4d5a-bbe6-5c88293b43b0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:22.578474 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0dee982-c776-4d5a-bbe6-5c88293b43b0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:22.630888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-72c0c8d0-2418-44ab-b699-9a6ac072b30c req-433db89d-0499-4247-866b-904ad1da3065 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73abb964-9a04-447c-aff6-4bebc253071a", "tag": "e6412db9-cba8-413b-bf10-39cdd95056ee"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:26:22.643100 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-72c0c8d0-2418-44ab-b699-9a6ac072b30c req-433db89d-0499-4247-866b-904ad1da3065 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:22.644413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-72c0c8d0-2418-44ab-b699-9a6ac072b30c req-433db89d-0499-4247-866b-904ad1da3065 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:22.644959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-72c0c8d0-2418-44ab-b699-9a6ac072b30c req-433db89d-0499-4247-866b-904ad1da3065 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:22.659048 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-72c0c8d0-2418-44ab-b699-9a6ac072b30c req-433db89d-0499-4247-866b-904ad1da3065 service nova] Creating event network-changed:e6412db9-cba8-413b-bf10-39cdd95056ee for instance 73abb964-9a04-447c-aff6-4bebc253071a on n-h1-858272-3 Oct 05 03:26:22.667508 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-72c0c8d0-2418-44ab-b699-9a6ac072b30c req-433db89d-0499-4247-866b-904ad1da3065 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150303 Oct 05 03:26:22.668509 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3457/6900] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:26:22.862414 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e0dee982-c776-4d5a-bbe6-5c88293b43b0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:26:22.871161 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e0dee982-c776-4d5a-bbe6-5c88293b43b0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a" status: 200 len: 1579 microversion: 2.1 time: 0.307552 Oct 05 03:26:22.872048 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3444/6901] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:26:22 2022] GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a => generated 1579 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:26:23.896194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-831fc0e4-4f4d-4151-99b1-28286f454990 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:26:23.896933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-831fc0e4-4f4d-4151-99b1-28286f454990 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 73abb964-9a04-447c-aff6-4bebc253071a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:26:23.906786 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-831fc0e4-4f4d-4151-99b1-28286f454990 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:23.907280 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-831fc0e4-4f4d-4151-99b1-28286f454990 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:23.907723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-831fc0e4-4f4d-4151-99b1-28286f454990 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:23.908421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-831fc0e4-4f4d-4151-99b1-28286f454990 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:23.908882 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-831fc0e4-4f4d-4151-99b1-28286f454990 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:23.909336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-831fc0e4-4f4d-4151-99b1-28286f454990 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:24.152421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-831fc0e4-4f4d-4151-99b1-28286f454990 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:26:24.160210 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-831fc0e4-4f4d-4151-99b1-28286f454990 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a" status: 200 len: 1579 microversion: 2.1 time: 0.268265 Oct 05 03:26:24.160840 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3458/6902] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:26:23 2022] GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a => generated 1579 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:26:24.915294 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-67ef293c-3137-4695-a294-c1aea86d18b3 req-421307f2-1f02-4dd0-9b23-d7eea0d6204b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73abb964-9a04-447c-aff6-4bebc253071a", "name": "network-vif-deleted", "tag": "e6412db9-cba8-413b-bf10-39cdd95056ee"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:26:24.925905 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-67ef293c-3137-4695-a294-c1aea86d18b3 req-421307f2-1f02-4dd0-9b23-d7eea0d6204b service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:24.926323 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-67ef293c-3137-4695-a294-c1aea86d18b3 req-421307f2-1f02-4dd0-9b23-d7eea0d6204b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:24.926761 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-67ef293c-3137-4695-a294-c1aea86d18b3 req-421307f2-1f02-4dd0-9b23-d7eea0d6204b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:24.938490 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-67ef293c-3137-4695-a294-c1aea86d18b3 req-421307f2-1f02-4dd0-9b23-d7eea0d6204b service nova] Creating event network-vif-deleted:e6412db9-cba8-413b-bf10-39cdd95056ee for instance 73abb964-9a04-447c-aff6-4bebc253071a on n-h1-858272-3 Oct 05 03:26:24.943698 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-67ef293c-3137-4695-a294-c1aea86d18b3 req-421307f2-1f02-4dd0-9b23-d7eea0d6204b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032914 Oct 05 03:26:24.944311 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3445/6903] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:26:25.184514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f760708f-0d10-49d8-ad74-b4eba645d153 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:26:25.185254 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f760708f-0d10-49d8-ad74-b4eba645d153 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 73abb964-9a04-447c-aff6-4bebc253071a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:26:25.192577 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f760708f-0d10-49d8-ad74-b4eba645d153 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:25.193185 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f760708f-0d10-49d8-ad74-b4eba645d153 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:25.193696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f760708f-0d10-49d8-ad74-b4eba645d153 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:25.195183 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f760708f-0d10-49d8-ad74-b4eba645d153 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:25.195801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f760708f-0d10-49d8-ad74-b4eba645d153 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:25.196238 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f760708f-0d10-49d8-ad74-b4eba645d153 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:25.265963 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f760708f-0d10-49d8-ad74-b4eba645d153 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:26:25.274618 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f760708f-0d10-49d8-ad74-b4eba645d153 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a" status: 200 len: 1225 microversion: 2.1 time: 0.094391 Oct 05 03:26:25.275600 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3459/6904] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:26:25 2022] GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:26:26.300136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c33bc92f-09fe-4457-940d-aa555f7d41c4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:26:26.300852 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c33bc92f-09fe-4457-940d-aa555f7d41c4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 73abb964-9a04-447c-aff6-4bebc253071a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:26:26.307835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c33bc92f-09fe-4457-940d-aa555f7d41c4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:26.308341 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c33bc92f-09fe-4457-940d-aa555f7d41c4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:26.308789 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c33bc92f-09fe-4457-940d-aa555f7d41c4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:26.309514 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c33bc92f-09fe-4457-940d-aa555f7d41c4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:26.309981 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c33bc92f-09fe-4457-940d-aa555f7d41c4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:26.310416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c33bc92f-09fe-4457-940d-aa555f7d41c4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:26.373261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c33bc92f-09fe-4457-940d-aa555f7d41c4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:26:26.381114 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c33bc92f-09fe-4457-940d-aa555f7d41c4 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a" status: 200 len: 1225 microversion: 2.1 time: 0.086086 Oct 05 03:26:26.381703 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3446/6905] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:26:26 2022] GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:26:27.405176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dde25113-f692-41fa-94b5-cedab0fcca2b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:26:27.405713 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-dde25113-f692-41fa-94b5-cedab0fcca2b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 73abb964-9a04-447c-aff6-4bebc253071a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:26:27.413134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dde25113-f692-41fa-94b5-cedab0fcca2b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:27.413696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dde25113-f692-41fa-94b5-cedab0fcca2b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:27.414194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dde25113-f692-41fa-94b5-cedab0fcca2b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:27.414905 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dde25113-f692-41fa-94b5-cedab0fcca2b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:27.415372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dde25113-f692-41fa-94b5-cedab0fcca2b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:27.415809 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dde25113-f692-41fa-94b5-cedab0fcca2b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:27.490345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-dde25113-f692-41fa-94b5-cedab0fcca2b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:26:27.499988 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-dde25113-f692-41fa-94b5-cedab0fcca2b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a" status: 200 len: 1225 microversion: 2.1 time: 0.098888 Oct 05 03:26:27.500579 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3460/6906] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:26:27 2022] GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:26:28.524183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4e0a21bb-b1f0-4663-9dbb-264bd49fa089 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:26:28.524707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4e0a21bb-b1f0-4663-9dbb-264bd49fa089 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 73abb964-9a04-447c-aff6-4bebc253071a] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:26:28.531710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e0a21bb-b1f0-4663-9dbb-264bd49fa089 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:28.532218 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e0a21bb-b1f0-4663-9dbb-264bd49fa089 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:28.532682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e0a21bb-b1f0-4663-9dbb-264bd49fa089 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:28.533417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e0a21bb-b1f0-4663-9dbb-264bd49fa089 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:28.533896 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e0a21bb-b1f0-4663-9dbb-264bd49fa089 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:28.534344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e0a21bb-b1f0-4663-9dbb-264bd49fa089 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:28.599106 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4e0a21bb-b1f0-4663-9dbb-264bd49fa089 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:26:28.607414 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4e0a21bb-b1f0-4663-9dbb-264bd49fa089 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a" status: 200 len: 1225 microversion: 2.1 time: 0.088570 Oct 05 03:26:28.608224 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3447/6907] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:26:28 2022] GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:26:29.630137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fad35cd7-9ee7-439d-b286-f8100b72f272 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:26:29.630866 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fad35cd7-9ee7-439d-b286-f8100b72f272 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 73abb964-9a04-447c-aff6-4bebc253071a] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:26:29.637637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fad35cd7-9ee7-439d-b286-f8100b72f272 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:29.638131 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fad35cd7-9ee7-439d-b286-f8100b72f272 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:29.638572 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fad35cd7-9ee7-439d-b286-f8100b72f272 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:29.639270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fad35cd7-9ee7-439d-b286-f8100b72f272 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:29.639729 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fad35cd7-9ee7-439d-b286-f8100b72f272 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:29.640158 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fad35cd7-9ee7-439d-b286-f8100b72f272 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:29.654380 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-fad35cd7-9ee7-439d-b286-f8100b72f272 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] HTTP exception thrown: Instance 73abb964-9a04-447c-aff6-4bebc253071a could not be found. Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fad35cd7-9ee7-439d-b286-f8100b72f272 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Request method failure captured: Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a HTTP/1.1 Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPbrQKtYWOrgIE3M1fpHMFzvjQh4iLX1nAzEklsHFOch728asjV7SItEDt5qDq-ufTutAq3QkdKbEFAclvkEjD6DmQ6dye6ArfBgrG8mjckzaoUeygHR0aBhtzZzZQl0gGW5mk16tBGgd6IoBji5V99Q_6th4Uy5PRVF9Hx8YdoF6tU Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 713e3a431a2441548123f404b23ce0da Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TestVolumeBootPattern-847109256 Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713e3a431a2441548123f404b23ce0da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713e3a431a2441548123f404b23ce0da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/713e3a431a2441548123f404b23ce0da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_713e3a431a2441548123f404b23ce0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TestVolumeBootPattern-847109256 Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 713e3a431a2441548123f404b23ce0da Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TestVolumeBootPattern-847109256 Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TestVolumeBootPattern-847109256-project Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: ee8daf94c54c4dd7b69310674d73211a Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TestVolumeBootPattern-847109256-project Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 73abb964-9a04-447c-aff6-4bebc253071a could not be found. Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '73abb964-9a04-447c-aff6-4bebc253071a'} Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73abb964-9a04-447c-aff6-4bebc253071a could not be found. Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73abb964-9a04-447c-aff6-4bebc253071a could not be found. Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:26:29.656038 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:26:29.660219 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:26:29.660219 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:26:29.660219 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:26:29.660219 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:26:29.660219 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:26:29.660219 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73abb964-9a04-447c-aff6-4bebc253071a could not be found. Oct 05 03:26:29.660219 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:26:29.660219 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fad35cd7-9ee7-439d-b286-f8100b72f272 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Returning 404 to user: Instance 73abb964-9a04-447c-aff6-4bebc253071a could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:26:29.660219 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fad35cd7-9ee7-439d-b286-f8100b72f272 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a" status: 404 len: 111 microversion: 2.1 time: 0.031291 Oct 05 03:26:29.660219 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3461/6908] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:26:29 2022] GET /compute/v2.1/servers/73abb964-9a04-447c-aff6-4bebc253071a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:26:35.877486 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-642495f4-7da4-45f5-a216-36e39541b3dd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:26:35.878480 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-642495f4-7da4-45f5-a216-36e39541b3dd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 74e1d1f2-0257-48dd-a775-b29a6efb59b2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:26:35.890167 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-642495f4-7da4-45f5-a216-36e39541b3dd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:35.890672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-642495f4-7da4-45f5-a216-36e39541b3dd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:35.891122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-642495f4-7da4-45f5-a216-36e39541b3dd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:35.891835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-642495f4-7da4-45f5-a216-36e39541b3dd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:35.892365 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-642495f4-7da4-45f5-a216-36e39541b3dd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:35.893012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-642495f4-7da4-45f5-a216-36e39541b3dd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:35.923660 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-642495f4-7da4-45f5-a216-36e39541b3dd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 74e1d1f2-0257-48dd-a775-b29a6efb59b2] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:26:36.001720 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-3ad323d4-cb13-4c9a-9731-28c8258b75b4 req-59cd309d-e686-4ef5-9ff2-f9ffe578f276 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74e1d1f2-0257-48dd-a775-b29a6efb59b2", "tag": "2e725af8-c531-46d1-8bd3-abf08127865f"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:26:36.012749 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-642495f4-7da4-45f5-a216-36e39541b3dd tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "DELETE /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2" status: 204 len: 0 microversion: 2.1 time: 0.139302 Oct 05 03:26:36.014069 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3448/6909] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:26:35 2022] DELETE /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:26:36.014699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-3ad323d4-cb13-4c9a-9731-28c8258b75b4 req-59cd309d-e686-4ef5-9ff2-f9ffe578f276 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:36.015180 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-3ad323d4-cb13-4c9a-9731-28c8258b75b4 req-59cd309d-e686-4ef5-9ff2-f9ffe578f276 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:36.015632 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-3ad323d4-cb13-4c9a-9731-28c8258b75b4 req-59cd309d-e686-4ef5-9ff2-f9ffe578f276 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:36.023278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fc8696f6-9e06-471a-a198-bb605d4b3a4b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:26:36.024250 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fc8696f6-9e06-471a-a198-bb605d4b3a4b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 74e1d1f2-0257-48dd-a775-b29a6efb59b2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:26:36.029915 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-3ad323d4-cb13-4c9a-9731-28c8258b75b4 req-59cd309d-e686-4ef5-9ff2-f9ffe578f276 service nova] Creating event network-changed:2e725af8-c531-46d1-8bd3-abf08127865f for instance 74e1d1f2-0257-48dd-a775-b29a6efb59b2 on n-h2-858272-3 Oct 05 03:26:36.031242 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc8696f6-9e06-471a-a198-bb605d4b3a4b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:36.031874 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc8696f6-9e06-471a-a198-bb605d4b3a4b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:36.032432 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc8696f6-9e06-471a-a198-bb605d4b3a4b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:36.033431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc8696f6-9e06-471a-a198-bb605d4b3a4b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:36.034047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc8696f6-9e06-471a-a198-bb605d4b3a4b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:36.034560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc8696f6-9e06-471a-a198-bb605d4b3a4b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:36.035837 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-3ad323d4-cb13-4c9a-9731-28c8258b75b4 req-59cd309d-e686-4ef5-9ff2-f9ffe578f276 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097262 Oct 05 03:26:36.037122 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3462/6910] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:26:36.167793 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fc8696f6-9e06-471a-a198-bb605d4b3a4b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:26:36.175794 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fc8696f6-9e06-471a-a198-bb605d4b3a4b tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2" status: 200 len: 1579 microversion: 2.1 time: 0.157377 Oct 05 03:26:36.176299 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3449/6911] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:26:36 2022] GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2 => generated 1579 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:26:37.201838 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-04867840-003a-48ff-b669-0f2f0c6926a6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:26:37.202564 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-04867840-003a-48ff-b669-0f2f0c6926a6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 74e1d1f2-0257-48dd-a775-b29a6efb59b2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:26:37.210377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-04867840-003a-48ff-b669-0f2f0c6926a6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:37.211145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-04867840-003a-48ff-b669-0f2f0c6926a6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:37.211691 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-04867840-003a-48ff-b669-0f2f0c6926a6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:37.212417 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-04867840-003a-48ff-b669-0f2f0c6926a6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:37.212895 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-04867840-003a-48ff-b669-0f2f0c6926a6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:37.213383 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-04867840-003a-48ff-b669-0f2f0c6926a6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:37.377262 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-04867840-003a-48ff-b669-0f2f0c6926a6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:26:37.385167 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-04867840-003a-48ff-b669-0f2f0c6926a6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2" status: 200 len: 1579 microversion: 2.1 time: 0.188398 Oct 05 03:26:37.385741 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3463/6912] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:26:37 2022] GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2 => generated 1579 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:26:38.245068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-8f245547-fbd9-4088-abb9-c4c0a3bd383d req-94d29c49-9c98-4db7-9754-da238573a9c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74e1d1f2-0257-48dd-a775-b29a6efb59b2", "name": "network-vif-deleted", "tag": "2e725af8-c531-46d1-8bd3-abf08127865f"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:26:38.255494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-8f245547-fbd9-4088-abb9-c4c0a3bd383d req-94d29c49-9c98-4db7-9754-da238573a9c9 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:38.256014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-8f245547-fbd9-4088-abb9-c4c0a3bd383d req-94d29c49-9c98-4db7-9754-da238573a9c9 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:38.256996 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-8f245547-fbd9-4088-abb9-c4c0a3bd383d req-94d29c49-9c98-4db7-9754-da238573a9c9 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:38.273642 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-8f245547-fbd9-4088-abb9-c4c0a3bd383d req-94d29c49-9c98-4db7-9754-da238573a9c9 service nova] Creating event network-vif-deleted:2e725af8-c531-46d1-8bd3-abf08127865f for instance 74e1d1f2-0257-48dd-a775-b29a6efb59b2 on n-h2-858272-3 Oct 05 03:26:38.278897 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-8f245547-fbd9-4088-abb9-c4c0a3bd383d req-94d29c49-9c98-4db7-9754-da238573a9c9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037607 Oct 05 03:26:38.279509 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3450/6913] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:26:38.407858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4f7a1601-556c-454e-8be9-d9c3063cc356 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:26:38.408531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4f7a1601-556c-454e-8be9-d9c3063cc356 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 74e1d1f2-0257-48dd-a775-b29a6efb59b2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:26:38.415682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f7a1601-556c-454e-8be9-d9c3063cc356 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:38.416167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f7a1601-556c-454e-8be9-d9c3063cc356 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:38.416604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f7a1601-556c-454e-8be9-d9c3063cc356 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:38.417326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f7a1601-556c-454e-8be9-d9c3063cc356 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:38.417785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f7a1601-556c-454e-8be9-d9c3063cc356 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:38.418210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f7a1601-556c-454e-8be9-d9c3063cc356 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:38.483042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4f7a1601-556c-454e-8be9-d9c3063cc356 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:26:38.491465 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4f7a1601-556c-454e-8be9-d9c3063cc356 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2" status: 200 len: 1225 microversion: 2.1 time: 0.087042 Oct 05 03:26:38.492659 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3464/6914] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:26:38 2022] GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:26:39.516802 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-59ed1c0f-33de-4725-abf2-69799e3287c6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:26:39.517508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-59ed1c0f-33de-4725-abf2-69799e3287c6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 74e1d1f2-0257-48dd-a775-b29a6efb59b2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:26:39.524092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-59ed1c0f-33de-4725-abf2-69799e3287c6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:39.524594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-59ed1c0f-33de-4725-abf2-69799e3287c6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:39.525075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-59ed1c0f-33de-4725-abf2-69799e3287c6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:39.525779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-59ed1c0f-33de-4725-abf2-69799e3287c6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:39.526248 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-59ed1c0f-33de-4725-abf2-69799e3287c6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:39.526684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-59ed1c0f-33de-4725-abf2-69799e3287c6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:39.593671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-59ed1c0f-33de-4725-abf2-69799e3287c6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:26:39.602058 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-59ed1c0f-33de-4725-abf2-69799e3287c6 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2" status: 200 len: 1225 microversion: 2.1 time: 0.090400 Oct 05 03:26:39.602706 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3451/6915] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:26:39 2022] GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:26:40.626443 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-25718751-66f2-4af7-b82e-7962f472252a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:26:40.627082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-25718751-66f2-4af7-b82e-7962f472252a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 74e1d1f2-0257-48dd-a775-b29a6efb59b2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:26:40.633929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-25718751-66f2-4af7-b82e-7962f472252a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:40.634427 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-25718751-66f2-4af7-b82e-7962f472252a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:40.634869 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-25718751-66f2-4af7-b82e-7962f472252a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:40.635582 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-25718751-66f2-4af7-b82e-7962f472252a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:40.636042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-25718751-66f2-4af7-b82e-7962f472252a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:40.636472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-25718751-66f2-4af7-b82e-7962f472252a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:40.707127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-25718751-66f2-4af7-b82e-7962f472252a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:26:40.715444 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-25718751-66f2-4af7-b82e-7962f472252a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2" status: 200 len: 1225 microversion: 2.1 time: 0.093377 Oct 05 03:26:40.716044 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3465/6916] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:26:40 2022] GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:26:41.739064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1cf2e35e-80f3-490b-ba92-02ba09e9f52a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:26:41.739807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1cf2e35e-80f3-490b-ba92-02ba09e9f52a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 74e1d1f2-0257-48dd-a775-b29a6efb59b2] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:26:41.747527 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1cf2e35e-80f3-490b-ba92-02ba09e9f52a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:41.748031 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1cf2e35e-80f3-490b-ba92-02ba09e9f52a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:41.748488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1cf2e35e-80f3-490b-ba92-02ba09e9f52a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:41.749218 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1cf2e35e-80f3-490b-ba92-02ba09e9f52a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:41.749803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1cf2e35e-80f3-490b-ba92-02ba09e9f52a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:41.750288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1cf2e35e-80f3-490b-ba92-02ba09e9f52a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:41.819989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1cf2e35e-80f3-490b-ba92-02ba09e9f52a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8daf94c54c4dd7b69310674d73211a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713e3a431a2441548123f404b23ce0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:26:41.828389 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1cf2e35e-80f3-490b-ba92-02ba09e9f52a tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2" status: 200 len: 1225 microversion: 2.1 time: 0.093364 Oct 05 03:26:41.829211 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3452/6917] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:26:41 2022] GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:26:42.853474 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-36d6727b-0550-4f5b-a9ec-742dd94e868e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:26:42.854092 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-36d6727b-0550-4f5b-a9ec-742dd94e868e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 74e1d1f2-0257-48dd-a775-b29a6efb59b2] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:26:42.861033 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36d6727b-0550-4f5b-a9ec-742dd94e868e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:42.861518 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36d6727b-0550-4f5b-a9ec-742dd94e868e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:42.861960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36d6727b-0550-4f5b-a9ec-742dd94e868e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:42.862658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36d6727b-0550-4f5b-a9ec-742dd94e868e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:42.863113 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36d6727b-0550-4f5b-a9ec-742dd94e868e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:42.863542 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-36d6727b-0550-4f5b-a9ec-742dd94e868e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:42.878770 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-36d6727b-0550-4f5b-a9ec-742dd94e868e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] HTTP exception thrown: Instance 74e1d1f2-0257-48dd-a775-b29a6efb59b2 could not be found. Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-36d6727b-0550-4f5b-a9ec-742dd94e868e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Request method failure captured: Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2 HTTP/1.1 Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPbrQKtYWOrgIE3M1fpHMFzvjQh4iLX1nAzEklsHFOch728asjV7SItEDt5qDq-ufTutAq3QkdKbEFAclvkEjD6DmQ6dye6ArfBgrG8mjckzaoUeygHR0aBhtzZzZQl0gGW5mk16tBGgd6IoBji5V99Q_6th4Uy5PRVF9Hx8YdoF6tU Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 713e3a431a2441548123f404b23ce0da Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TestVolumeBootPattern-847109256 Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713e3a431a2441548123f404b23ce0da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713e3a431a2441548123f404b23ce0da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/713e3a431a2441548123f404b23ce0da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_713e3a431a2441548123f404b23ce0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TestVolumeBootPattern-847109256 Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 713e3a431a2441548123f404b23ce0da Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TestVolumeBootPattern-847109256 Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TestVolumeBootPattern-847109256-project Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: ee8daf94c54c4dd7b69310674d73211a Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TestVolumeBootPattern-847109256-project Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 74e1d1f2-0257-48dd-a775-b29a6efb59b2 could not be found. Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '74e1d1f2-0257-48dd-a775-b29a6efb59b2'} Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74e1d1f2-0257-48dd-a775-b29a6efb59b2 could not be found. Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74e1d1f2-0257-48dd-a775-b29a6efb59b2 could not be found. Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:26:42.880451 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:26:42.885097 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:26:42.885097 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:26:42.885097 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:26:42.885097 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:26:42.885097 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:26:42.885097 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74e1d1f2-0257-48dd-a775-b29a6efb59b2 could not be found. Oct 05 03:26:42.885097 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:26:42.885097 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-36d6727b-0550-4f5b-a9ec-742dd94e868e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Returning 404 to user: Instance 74e1d1f2-0257-48dd-a775-b29a6efb59b2 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:26:42.885097 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-36d6727b-0550-4f5b-a9ec-742dd94e868e tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2" status: 404 len: 111 microversion: 2.1 time: 0.035338 Oct 05 03:26:42.885097 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3466/6918] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:26:42 2022] GET /compute/v2.1/servers/74e1d1f2-0257-48dd-a775-b29a6efb59b2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:26:43.362621 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e3fecd3f-6a54-4ea5-9a51-e95e92dbff32 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:26:43.363164 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e3fecd3f-6a54-4ea5-9a51-e95e92dbff32 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 8cf94a42-6a5f-42e7-b69d-01b112562cb6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:26:43.370127 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e3fecd3f-6a54-4ea5-9a51-e95e92dbff32 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:43.370625 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e3fecd3f-6a54-4ea5-9a51-e95e92dbff32 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:43.371074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e3fecd3f-6a54-4ea5-9a51-e95e92dbff32 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:43.371766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e3fecd3f-6a54-4ea5-9a51-e95e92dbff32 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:43.372235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e3fecd3f-6a54-4ea5-9a51-e95e92dbff32 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:43.372669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e3fecd3f-6a54-4ea5-9a51-e95e92dbff32 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:43.386386 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-e3fecd3f-6a54-4ea5-9a51-e95e92dbff32 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] HTTP exception thrown: Instance 8cf94a42-6a5f-42e7-b69d-01b112562cb6 could not be found. Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e3fecd3f-6a54-4ea5-9a51-e95e92dbff32 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Request method failure captured: Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 HTTP/1.1 Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPbrQKtYWOrgIE3M1fpHMFzvjQh4iLX1nAzEklsHFOch728asjV7SItEDt5qDq-ufTutAq3QkdKbEFAclvkEjD6DmQ6dye6ArfBgrG8mjckzaoUeygHR0aBhtzZzZQl0gGW5mk16tBGgd6IoBji5V99Q_6th4Uy5PRVF9Hx8YdoF6tU Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 713e3a431a2441548123f404b23ce0da Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-TestVolumeBootPattern-847109256 Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713e3a431a2441548123f404b23ce0da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713e3a431a2441548123f404b23ce0da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/713e3a431a2441548123f404b23ce0da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_713e3a431a2441548123f404b23ce0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-TestVolumeBootPattern-847109256 Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 713e3a431a2441548123f404b23ce0da Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-TestVolumeBootPattern-847109256 Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-TestVolumeBootPattern-847109256-project Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: ee8daf94c54c4dd7b69310674d73211a Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-TestVolumeBootPattern-847109256-project Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 8cf94a42-6a5f-42e7-b69d-01b112562cb6 could not be found. Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '8cf94a42-6a5f-42e7-b69d-01b112562cb6'} Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cf94a42-6a5f-42e7-b69d-01b112562cb6 could not be found. Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:26:43.388083 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:26:43.392983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cf94a42-6a5f-42e7-b69d-01b112562cb6 could not be found. Oct 05 03:26:43.392983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:26:43.392983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:26:43.392983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:26:43.392983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:26:43.392983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:26:43.392983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:26:43.392983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:26:43.392983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:26:43.392983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cf94a42-6a5f-42e7-b69d-01b112562cb6 could not be found. Oct 05 03:26:43.392983 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:26:43.392983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e3fecd3f-6a54-4ea5-9a51-e95e92dbff32 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Returning 404 to user: Instance 8cf94a42-6a5f-42e7-b69d-01b112562cb6 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:26:43.392983 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e3fecd3f-6a54-4ea5-9a51-e95e92dbff32 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6" status: 404 len: 111 microversion: 2.1 time: 0.030876 Oct 05 03:26:43.392983 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3453/6919] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:26:43 2022] DELETE /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:26:43.399379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-27381b33-e313-45f6-96aa-d5173b9a4fd0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:26:43.400041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-27381b33-e313-45f6-96aa-d5173b9a4fd0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] [instance: 8cf94a42-6a5f-42e7-b69d-01b112562cb6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:26:43.406052 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27381b33-e313-45f6-96aa-d5173b9a4fd0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:43.406532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27381b33-e313-45f6-96aa-d5173b9a4fd0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:43.406966 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27381b33-e313-45f6-96aa-d5173b9a4fd0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:43.407651 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27381b33-e313-45f6-96aa-d5173b9a4fd0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:26:43.408098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27381b33-e313-45f6-96aa-d5173b9a4fd0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:26:43.408517 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-27381b33-e313-45f6-96aa-d5173b9a4fd0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:26:43.422646 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-27381b33-e313-45f6-96aa-d5173b9a4fd0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] HTTP exception thrown: Instance 8cf94a42-6a5f-42e7-b69d-01b112562cb6 could not be found. Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-27381b33-e313-45f6-96aa-d5173b9a4fd0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Request method failure captured: Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 HTTP/1.1 Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPbrQKtYWOrgIE3M1fpHMFzvjQh4iLX1nAzEklsHFOch728asjV7SItEDt5qDq-ufTutAq3QkdKbEFAclvkEjD6DmQ6dye6ArfBgrG8mjckzaoUeygHR0aBhtzZzZQl0gGW5mk16tBGgd6IoBji5V99Q_6th4Uy5PRVF9Hx8YdoF6tU Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 713e3a431a2441548123f404b23ce0da Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TestVolumeBootPattern-847109256 Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713e3a431a2441548123f404b23ce0da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713e3a431a2441548123f404b23ce0da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/713e3a431a2441548123f404b23ce0da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_713e3a431a2441548123f404b23ce0da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TestVolumeBootPattern-847109256 Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 713e3a431a2441548123f404b23ce0da Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TestVolumeBootPattern-847109256 Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TestVolumeBootPattern-847109256-project Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: ee8daf94c54c4dd7b69310674d73211a Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TestVolumeBootPattern-847109256-project Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 8cf94a42-6a5f-42e7-b69d-01b112562cb6 could not be found. Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '8cf94a42-6a5f-42e7-b69d-01b112562cb6'} Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cf94a42-6a5f-42e7-b69d-01b112562cb6 could not be found. Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cf94a42-6a5f-42e7-b69d-01b112562cb6 could not be found. Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:26:43.424167 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:26:43.428408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:26:43.428408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:26:43.428408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:26:43.428408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:26:43.428408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:26:43.428408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cf94a42-6a5f-42e7-b69d-01b112562cb6 could not be found. Oct 05 03:26:43.428408 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:26:43.428408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-27381b33-e313-45f6-96aa-d5173b9a4fd0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Returning 404 to user: Instance 8cf94a42-6a5f-42e7-b69d-01b112562cb6 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:26:43.428408 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-27381b33-e313-45f6-96aa-d5173b9a4fd0 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6" status: 404 len: 111 microversion: 2.1 time: 0.031054 Oct 05 03:26:43.428408 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3467/6920] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:26:43 2022] GET /compute/v2.1/servers/8cf94a42-6a5f-42e7-b69d-01b112562cb6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 03:26:46.849569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-884076c8-4393-4dfb-b296-13d6bb839347 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] Calling method '.version_select at 0x7fcce8164dc0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:26:46.887774 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-884076c8-4393-4dfb-b296-13d6bb839347 tempest-TestVolumeBootPattern-847109256 tempest-TestVolumeBootPattern-847109256-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-383498722" status: 202 len: 0 microversion: 2.1 time: 0.041586 Oct 05 03:26:46.888729 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3454/6921] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 5 03:26:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-383498722 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:27:05.036209 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=22 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:27:05.037233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=46 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:27:05.144771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0fa22487-78e7-422a-a6e6-296fd6aa075a tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-174403752", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:27:05.196917 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-0fa22487-78e7-422a-a6e6-296fd6aa075a tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] validate_networks() for None {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:27:05.387292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0fa22487-78e7-422a-a6e6-296fd6aa075a tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:27:05.387715 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0fa22487-78e7-422a-a6e6-296fd6aa075a tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:27:05.388190 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0fa22487-78e7-422a-a6e6-296fd6aa075a tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:27:05.388595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0fa22487-78e7-422a-a6e6-296fd6aa075a tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:27:05.389039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-0fa22487-78e7-422a-a6e6-296fd6aa075a tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:27:05.402879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0fa22487-78e7-422a-a6e6-296fd6aa075a tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:05.403370 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0fa22487-78e7-422a-a6e6-296fd6aa075a tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:05.403804 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0fa22487-78e7-422a-a6e6-296fd6aa075a tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:05.404529 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0fa22487-78e7-422a-a6e6-296fd6aa075a tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:05.405006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0fa22487-78e7-422a-a6e6-296fd6aa075a tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:05.405434 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0fa22487-78e7-422a-a6e6-296fd6aa075a tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:05.425180 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-0fa22487-78e7-422a-a6e6-296fd6aa075a tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Getting quotas for project bfeb755072464c4688e55c2b2e5e9581. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:27:05.432981 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-0fa22487-78e7-422a-a6e6-296fd6aa075a tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Getting quotas for user b1bfbb2a47dc4ad0bbea68ac5ad864bb and project bfeb755072464c4688e55c2b2e5e9581. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:27:05.445262 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0fa22487-78e7-422a-a6e6-296fd6aa075a tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:27:05.447487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0fa22487-78e7-422a-a6e6-296fd6aa075a tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] [instance: 98934c76-744f-4f72-bd27-3702a3af9ebd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:27:05.492889 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0fa22487-78e7-422a-a6e6-296fd6aa075a tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.462198 Oct 05 03:27:05.493570 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3468/6922] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:27:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 464 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:27:05.503925 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:27:05.505218 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:27:05.509809 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6f153210-b32a-4f0c-a38d-4c2bb144c429 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:05.510413 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6f153210-b32a-4f0c-a38d-4c2bb144c429 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] [instance: 98934c76-744f-4f72-bd27-3702a3af9ebd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:05.580533 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6f153210-b32a-4f0c-a38d-4c2bb144c429 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bfbb2a47dc4ad0bbea68ac5ad864bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfeb755072464c4688e55c2b2e5e9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:05.591993 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6f153210-b32a-4f0c-a38d-4c2bb144c429 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] 10.222.0.16 "GET /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd" status: 200 len: 1221 microversion: 2.1 time: 0.089728 Oct 05 03:27:05.593113 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3455/6923] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:05 2022] GET /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd => generated 1221 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:06.617496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-52e52df7-f16b-4e19-8ecd-6bf041e6eebb tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:06.619000 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-52e52df7-f16b-4e19-8ecd-6bf041e6eebb tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] [instance: 98934c76-744f-4f72-bd27-3702a3af9ebd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:06.627359 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52e52df7-f16b-4e19-8ecd-6bf041e6eebb tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:06.628093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52e52df7-f16b-4e19-8ecd-6bf041e6eebb tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:06.628716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52e52df7-f16b-4e19-8ecd-6bf041e6eebb tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:06.629526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52e52df7-f16b-4e19-8ecd-6bf041e6eebb tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:06.630144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52e52df7-f16b-4e19-8ecd-6bf041e6eebb tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:06.630903 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52e52df7-f16b-4e19-8ecd-6bf041e6eebb tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:06.709441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-52e52df7-f16b-4e19-8ecd-6bf041e6eebb tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bfbb2a47dc4ad0bbea68ac5ad864bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfeb755072464c4688e55c2b2e5e9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:06.718653 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-52e52df7-f16b-4e19-8ecd-6bf041e6eebb tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] 10.222.0.16 "GET /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd" status: 200 len: 1291 microversion: 2.1 time: 0.106688 Oct 05 03:27:06.719258 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3469/6924] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:06 2022] GET /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd => generated 1291 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:07.743249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b57860ee-22e4-45d6-aa24-41cb9b1e58e5 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:07.743887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b57860ee-22e4-45d6-aa24-41cb9b1e58e5 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] [instance: 98934c76-744f-4f72-bd27-3702a3af9ebd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:07.750768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b57860ee-22e4-45d6-aa24-41cb9b1e58e5 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:07.751279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b57860ee-22e4-45d6-aa24-41cb9b1e58e5 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:07.751731 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b57860ee-22e4-45d6-aa24-41cb9b1e58e5 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:07.752446 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b57860ee-22e4-45d6-aa24-41cb9b1e58e5 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:07.753120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b57860ee-22e4-45d6-aa24-41cb9b1e58e5 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:07.753558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b57860ee-22e4-45d6-aa24-41cb9b1e58e5 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:07.897046 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b57860ee-22e4-45d6-aa24-41cb9b1e58e5 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bfbb2a47dc4ad0bbea68ac5ad864bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfeb755072464c4688e55c2b2e5e9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:07.905093 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b57860ee-22e4-45d6-aa24-41cb9b1e58e5 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] 10.222.0.16 "GET /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd" status: 200 len: 1321 microversion: 2.1 time: 0.165679 Oct 05 03:27:07.906126 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3456/6925] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:07 2022] GET /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:08.394482 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-a0e005cd-2fbd-454a-a1b8-ac47f4b0fd1d req-0fd94eaa-7c4d-4779-9acb-1e3810c29db4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98934c76-744f-4f72-bd27-3702a3af9ebd", "tag": "66c07729-4c2a-4b7a-996e-8cc7c825fb56"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:27:08.406868 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a0e005cd-2fbd-454a-a1b8-ac47f4b0fd1d req-0fd94eaa-7c4d-4779-9acb-1e3810c29db4 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:08.407463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a0e005cd-2fbd-454a-a1b8-ac47f4b0fd1d req-0fd94eaa-7c4d-4779-9acb-1e3810c29db4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:08.407911 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a0e005cd-2fbd-454a-a1b8-ac47f4b0fd1d req-0fd94eaa-7c4d-4779-9acb-1e3810c29db4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:08.420074 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-a0e005cd-2fbd-454a-a1b8-ac47f4b0fd1d req-0fd94eaa-7c4d-4779-9acb-1e3810c29db4 service nova] Creating event network-changed:66c07729-4c2a-4b7a-996e-8cc7c825fb56 for instance 98934c76-744f-4f72-bd27-3702a3af9ebd on n-h2-858272-3 Oct 05 03:27:08.425510 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-a0e005cd-2fbd-454a-a1b8-ac47f4b0fd1d req-0fd94eaa-7c4d-4779-9acb-1e3810c29db4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034810 Oct 05 03:27:08.426299 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3470/6926] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:27:08.931058 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7c911f2a-703d-464b-95f6-3a0f28fecafd tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:08.931599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7c911f2a-703d-464b-95f6-3a0f28fecafd tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] [instance: 98934c76-744f-4f72-bd27-3702a3af9ebd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:08.938505 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c911f2a-703d-464b-95f6-3a0f28fecafd tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:08.939011 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c911f2a-703d-464b-95f6-3a0f28fecafd tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:08.939467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c911f2a-703d-464b-95f6-3a0f28fecafd tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:08.940181 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c911f2a-703d-464b-95f6-3a0f28fecafd tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:08.940654 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c911f2a-703d-464b-95f6-3a0f28fecafd tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:08.941131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c911f2a-703d-464b-95f6-3a0f28fecafd tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:09.077807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7c911f2a-703d-464b-95f6-3a0f28fecafd tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bfbb2a47dc4ad0bbea68ac5ad864bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfeb755072464c4688e55c2b2e5e9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:09.086572 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7c911f2a-703d-464b-95f6-3a0f28fecafd tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] 10.222.0.16 "GET /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd" status: 200 len: 1321 microversion: 2.1 time: 0.160068 Oct 05 03:27:09.087139 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3457/6927] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:08 2022] GET /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:10.111422 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8ae9998b-a8f0-402d-814b-bb625afdd7e0 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:10.112127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8ae9998b-a8f0-402d-814b-bb625afdd7e0 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] [instance: 98934c76-744f-4f72-bd27-3702a3af9ebd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:10.118459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ae9998b-a8f0-402d-814b-bb625afdd7e0 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:10.118946 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ae9998b-a8f0-402d-814b-bb625afdd7e0 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:10.119389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ae9998b-a8f0-402d-814b-bb625afdd7e0 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:10.120080 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ae9998b-a8f0-402d-814b-bb625afdd7e0 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:10.120538 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ae9998b-a8f0-402d-814b-bb625afdd7e0 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:10.120994 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8ae9998b-a8f0-402d-814b-bb625afdd7e0 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:10.248816 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8ae9998b-a8f0-402d-814b-bb625afdd7e0 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bfbb2a47dc4ad0bbea68ac5ad864bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfeb755072464c4688e55c2b2e5e9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:10.257848 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8ae9998b-a8f0-402d-814b-bb625afdd7e0 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] 10.222.0.16 "GET /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd" status: 200 len: 1321 microversion: 2.1 time: 0.151563 Oct 05 03:27:10.258440 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3471/6928] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:10 2022] GET /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:11.281665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-144efff2-8752-46ab-93b6-cc96ca8d58dc tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:11.282306 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-144efff2-8752-46ab-93b6-cc96ca8d58dc tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] [instance: 98934c76-744f-4f72-bd27-3702a3af9ebd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:11.290025 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-144efff2-8752-46ab-93b6-cc96ca8d58dc tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:11.290559 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-144efff2-8752-46ab-93b6-cc96ca8d58dc tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:11.291004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-144efff2-8752-46ab-93b6-cc96ca8d58dc tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:11.291770 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-144efff2-8752-46ab-93b6-cc96ca8d58dc tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:11.292184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-144efff2-8752-46ab-93b6-cc96ca8d58dc tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:11.292622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-144efff2-8752-46ab-93b6-cc96ca8d58dc tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:11.423185 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-144efff2-8752-46ab-93b6-cc96ca8d58dc tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bfbb2a47dc4ad0bbea68ac5ad864bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfeb755072464c4688e55c2b2e5e9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:11.430909 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-144efff2-8752-46ab-93b6-cc96ca8d58dc tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] 10.222.0.16 "GET /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd" status: 200 len: 1321 microversion: 2.1 time: 0.153148 Oct 05 03:27:11.431502 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3458/6929] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:11 2022] GET /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:12.454152 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ec3f7b7d-26e5-43c0-813b-08177d4afefe tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:12.454778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ec3f7b7d-26e5-43c0-813b-08177d4afefe tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] [instance: 98934c76-744f-4f72-bd27-3702a3af9ebd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:12.462223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec3f7b7d-26e5-43c0-813b-08177d4afefe tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:12.462718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec3f7b7d-26e5-43c0-813b-08177d4afefe tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:12.463164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec3f7b7d-26e5-43c0-813b-08177d4afefe tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:12.463865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec3f7b7d-26e5-43c0-813b-08177d4afefe tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:12.464336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec3f7b7d-26e5-43c0-813b-08177d4afefe tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:12.464768 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ec3f7b7d-26e5-43c0-813b-08177d4afefe tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:12.601214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ec3f7b7d-26e5-43c0-813b-08177d4afefe tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bfbb2a47dc4ad0bbea68ac5ad864bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfeb755072464c4688e55c2b2e5e9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:12.609190 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ec3f7b7d-26e5-43c0-813b-08177d4afefe tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] 10.222.0.16 "GET /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd" status: 200 len: 1321 microversion: 2.1 time: 0.158944 Oct 05 03:27:12.609764 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3472/6930] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:12 2022] GET /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:13.632323 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1bad2583-fa88-464c-b4ca-cbd71313ae32 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:13.633050 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1bad2583-fa88-464c-b4ca-cbd71313ae32 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] [instance: 98934c76-744f-4f72-bd27-3702a3af9ebd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:13.640002 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bad2583-fa88-464c-b4ca-cbd71313ae32 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:13.640499 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bad2583-fa88-464c-b4ca-cbd71313ae32 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:13.640965 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bad2583-fa88-464c-b4ca-cbd71313ae32 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:13.641665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bad2583-fa88-464c-b4ca-cbd71313ae32 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:13.642201 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bad2583-fa88-464c-b4ca-cbd71313ae32 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:13.642647 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bad2583-fa88-464c-b4ca-cbd71313ae32 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:13.773068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1bad2583-fa88-464c-b4ca-cbd71313ae32 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bfbb2a47dc4ad0bbea68ac5ad864bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfeb755072464c4688e55c2b2e5e9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:13.781190 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1bad2583-fa88-464c-b4ca-cbd71313ae32 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] 10.222.0.16 "GET /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd" status: 200 len: 1321 microversion: 2.1 time: 0.153398 Oct 05 03:27:13.781778 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3459/6931] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:13 2022] GET /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:14.804495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-395e18e7-945c-404a-9e37-a1162d12cf20 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:14.805156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-395e18e7-945c-404a-9e37-a1162d12cf20 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] [instance: 98934c76-744f-4f72-bd27-3702a3af9ebd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:14.812064 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-395e18e7-945c-404a-9e37-a1162d12cf20 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:14.812552 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-395e18e7-945c-404a-9e37-a1162d12cf20 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:14.813156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-395e18e7-945c-404a-9e37-a1162d12cf20 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:14.813741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-395e18e7-945c-404a-9e37-a1162d12cf20 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:14.814182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-395e18e7-945c-404a-9e37-a1162d12cf20 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:14.814608 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-395e18e7-945c-404a-9e37-a1162d12cf20 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:14.950315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-395e18e7-945c-404a-9e37-a1162d12cf20 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bfbb2a47dc4ad0bbea68ac5ad864bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfeb755072464c4688e55c2b2e5e9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:14.958749 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-395e18e7-945c-404a-9e37-a1162d12cf20 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] 10.222.0.16 "GET /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd" status: 200 len: 1321 microversion: 2.1 time: 0.157587 Oct 05 03:27:14.959323 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3473/6932] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:14 2022] GET /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:15.981768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-331e8da9-e344-4604-8f83-a38f4a269fba tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:15.982456 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-331e8da9-e344-4604-8f83-a38f4a269fba tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] [instance: 98934c76-744f-4f72-bd27-3702a3af9ebd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:15.985274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:27:15.990778 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-331e8da9-e344-4604-8f83-a38f4a269fba tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:15.991315 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-331e8da9-e344-4604-8f83-a38f4a269fba tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:15.991737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-331e8da9-e344-4604-8f83-a38f4a269fba tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:15.992450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-331e8da9-e344-4604-8f83-a38f4a269fba tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:15.992941 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-331e8da9-e344-4604-8f83-a38f4a269fba tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:15.993388 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-331e8da9-e344-4604-8f83-a38f4a269fba tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:16.134648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-331e8da9-e344-4604-8f83-a38f4a269fba tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bfbb2a47dc4ad0bbea68ac5ad864bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfeb755072464c4688e55c2b2e5e9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:16.144986 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-331e8da9-e344-4604-8f83-a38f4a269fba tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] 10.222.0.16 "GET /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd" status: 200 len: 1321 microversion: 2.1 time: 0.167150 Oct 05 03:27:16.146380 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3460/6933] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:15 2022] GET /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:16.176134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:27:16.177544 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:27:16.237233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-1614dbc0-7abb-485e-8dc9-1e4c5bb64784 req-3bcc5e10-029e-42df-918b-1f4a9f96be65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98934c76-744f-4f72-bd27-3702a3af9ebd", "name": "network-vif-plugged", "status": "completed", "tag": "66c07729-4c2a-4b7a-996e-8cc7c825fb56"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:27:16.247195 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1614dbc0-7abb-485e-8dc9-1e4c5bb64784 req-3bcc5e10-029e-42df-918b-1f4a9f96be65 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:16.247677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1614dbc0-7abb-485e-8dc9-1e4c5bb64784 req-3bcc5e10-029e-42df-918b-1f4a9f96be65 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:16.248109 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1614dbc0-7abb-485e-8dc9-1e4c5bb64784 req-3bcc5e10-029e-42df-918b-1f4a9f96be65 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:16.259137 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-1614dbc0-7abb-485e-8dc9-1e4c5bb64784 req-3bcc5e10-029e-42df-918b-1f4a9f96be65 service nova] Creating event network-vif-plugged:66c07729-4c2a-4b7a-996e-8cc7c825fb56 for instance 98934c76-744f-4f72-bd27-3702a3af9ebd on n-h2-858272-3 Oct 05 03:27:16.264099 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-1614dbc0-7abb-485e-8dc9-1e4c5bb64784 req-3bcc5e10-029e-42df-918b-1f4a9f96be65 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094180 Oct 05 03:27:16.264870 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3474/6934] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:27:17.170044 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-82a79772-edba-4e51-bfce-ba731fd6022b tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:17.170698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-82a79772-edba-4e51-bfce-ba731fd6022b tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] [instance: 98934c76-744f-4f72-bd27-3702a3af9ebd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:17.177902 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82a79772-edba-4e51-bfce-ba731fd6022b tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:17.178409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82a79772-edba-4e51-bfce-ba731fd6022b tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:17.178865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82a79772-edba-4e51-bfce-ba731fd6022b tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:17.179573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82a79772-edba-4e51-bfce-ba731fd6022b tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:17.180049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82a79772-edba-4e51-bfce-ba731fd6022b tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:17.180493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-82a79772-edba-4e51-bfce-ba731fd6022b tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:17.310260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-82a79772-edba-4e51-bfce-ba731fd6022b tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bfbb2a47dc4ad0bbea68ac5ad864bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfeb755072464c4688e55c2b2e5e9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:17.318506 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-82a79772-edba-4e51-bfce-ba731fd6022b tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] 10.222.0.16 "GET /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd" status: 200 len: 1321 microversion: 2.1 time: 0.152568 Oct 05 03:27:17.319074 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3461/6935] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:17 2022] GET /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:18.343264 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-46bd2dc4-eeee-4081-b3f2-062945fadab1 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:18.344282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-46bd2dc4-eeee-4081-b3f2-062945fadab1 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] [instance: 98934c76-744f-4f72-bd27-3702a3af9ebd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:18.351180 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46bd2dc4-eeee-4081-b3f2-062945fadab1 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:18.351676 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46bd2dc4-eeee-4081-b3f2-062945fadab1 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:18.352115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46bd2dc4-eeee-4081-b3f2-062945fadab1 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:18.352822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46bd2dc4-eeee-4081-b3f2-062945fadab1 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:18.353567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46bd2dc4-eeee-4081-b3f2-062945fadab1 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:18.353995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46bd2dc4-eeee-4081-b3f2-062945fadab1 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:18.493974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-46bd2dc4-eeee-4081-b3f2-062945fadab1 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bfbb2a47dc4ad0bbea68ac5ad864bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfeb755072464c4688e55c2b2e5e9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:18.502443 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-46bd2dc4-eeee-4081-b3f2-062945fadab1 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] 10.222.0.16 "GET /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd" status: 200 len: 1470 microversion: 2.1 time: 0.164332 Oct 05 03:27:18.503014 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3475/6936] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:18 2022] GET /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd => generated 1470 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:18.596455 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-30daa120-a0a1-4316-a9e8-8d68818bd6b9 tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Calling method '.version_select at 0x7fccde989f70>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:18.666674 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-30daa120-a0a1-4316-a9e8-8d68818bd6b9 tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/f77a6c5863034f4bae1c4f907ecb67ad" status: 200 len: 371 microversion: 2.1 time: 0.142775 Oct 05 03:27:18.666865 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3462/6937] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 5 03:27:18 2022] GET /compute/v2.1/os-quota-sets/f77a6c5863034f4bae1c4f907ecb67ad => generated 371 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:27:18.680352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0a5a7fb4-a05a-4c91-8fac-225921362c36 tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-650610041", "id": 1850952737, "os-flavor-access:is_public": "True"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:27:18.699187 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0a5a7fb4-a05a-4c91-8fac-225921362c36 tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.023122 Oct 05 03:27:18.699954 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3476/6938] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:27:18 2022] POST /compute/v2.1/flavors => generated 437 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:27:18.713628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0b7a3149-7702-4cdb-bc56-e60fd14106ed tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1850952737"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:27:18.716440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0b7a3149-7702-4cdb-bc56-e60fd14106ed tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] [instance: 98934c76-744f-4f72-bd27-3702a3af9ebd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:18.724809 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b7a3149-7702-4cdb-bc56-e60fd14106ed tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:18.725537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b7a3149-7702-4cdb-bc56-e60fd14106ed tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:18.725999 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b7a3149-7702-4cdb-bc56-e60fd14106ed tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:18.726783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b7a3149-7702-4cdb-bc56-e60fd14106ed tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:18.727262 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b7a3149-7702-4cdb-bc56-e60fd14106ed tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:18.728293 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b7a3149-7702-4cdb-bc56-e60fd14106ed tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:18.997242 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0b7a3149-7702-4cdb-bc56-e60fd14106ed tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'cbd917c4db784cf0a4c34a643176359f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a6c5863034f4bae1c4f907ecb67ad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:19.005024 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0b7a3149-7702-4cdb-bc56-e60fd14106ed tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] [instance: 98934c76-744f-4f72-bd27-3702a3af9ebd] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-650610041 {{(pid=122320) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 05 03:27:19.012220 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b7a3149-7702-4cdb-bc56-e60fd14106ed tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:19.012737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b7a3149-7702-4cdb-bc56-e60fd14106ed tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:19.013205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b7a3149-7702-4cdb-bc56-e60fd14106ed tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:19.013951 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b7a3149-7702-4cdb-bc56-e60fd14106ed tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:19.014422 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b7a3149-7702-4cdb-bc56-e60fd14106ed tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:19.014859 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b7a3149-7702-4cdb-bc56-e60fd14106ed tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:19.038367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-0b7a3149-7702-4cdb-bc56-e60fd14106ed tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Getting quotas for project bfeb755072464c4688e55c2b2e5e9581. Resources: {'cores', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:27:19.043368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-0b7a3149-7702-4cdb-bc56-e60fd14106ed tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Getting quotas for user b1bfbb2a47dc4ad0bbea68ac5ad864bb and project bfeb755072464c4688e55c2b2e5e9581. Resources: {'cores', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:27:19.055344 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.compute.api [None req-0b7a3149-7702-4cdb-bc56-e60fd14106ed tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] ram quota exceeded for f77a6c5863034f4bae1c4f907ecb67ad, tried to resize instance. Oct 05 03:27:19.056179 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-0b7a3149-7702-4cdb-bc56-e60fd14106ed tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0b7a3149-7702-4cdb-bc56-e60fd14106ed tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Request method failure captured: Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd/action HTTP/1.1 Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 39 Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPmIlh3ftfrxasNLpava7jMMdGwY59ctDmrPSVIw0dLk3sA3bK_lxPuWUnmn926W2TJy0EC69bZb5qtqxgMKnnVkj56hu7fRsZyTuO090O0HURSVamWtUcEBSnYW4y_5sG3ygtxjORLrzWkoeyz94YqGZLyxZaRl_fdIWnxxNJPeXVA Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: f77a6c5863034f4bae1c4f907ecb67ad Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-108461897 Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: X-Role: admin,member,reader Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: admin,member,reader Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f77a6c5863034f4bae1c4f907ecb67ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f77a6c5863034f4bae1c4f907ecb67ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f77a6c5863034f4bae1c4f907ecb67ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f77a6c5863034f4bae1c4f907ecb67ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersAdminNegativeTestJSON-108461897 Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: f77a6c5863034f4bae1c4f907ecb67ad Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-108461897 Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersAdminNegativeTestJSON-108461897-project-admin Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: cbd917c4db784cf0a4c34a643176359f Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersAdminNegativeTestJSON-108461897-project-admin Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: {"resize": {"flavorRef": "1850952737"}} Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '98934c76-744f-4f72-bd27-3702a3af9ebd', 'body': {'resize': {'flavorRef': '1850952737'}}} Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 03:27:19.070630 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0b7a3149-7702-4cdb-bc56-e60fd14106ed tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0b7a3149-7702-4cdb-bc56-e60fd14106ed tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd/action" status: 403 len: 118 microversion: 2.1 time: 0.359946 Oct 05 03:27:19.077208 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3463/6939] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:27:18 2022] POST /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd/action => generated 118 bytes in 361 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 05 03:27:19.081807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5a9acbf7-0324-4c62-8fda-cd36616cd5a3 tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:19.096677 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5a9acbf7-0324-4c62-8fda-cd36616cd5a3 tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1850952737" status: 202 len: 0 microversion: 2.1 time: 0.021830 Oct 05 03:27:19.097281 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3477/6940] 10.222.0.16 () {58 vars in 1161 bytes} [Wed Oct 5 03:27:19 2022] DELETE /compute/v2.1/flavors/1850952737 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:27:19.106074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5320c5ef-a15a-44e9-9cae-d7c8214f8e08 tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:19.127329 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5320c5ef-a15a-44e9-9cae-d7c8214f8e08 tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025074 Oct 05 03:27:19.127817 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3464/6941] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 03:27:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:27:19.148680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-25e34936-fe53-4bbb-885e-e4e9ab682d1b tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Calling method '.version_select at 0x7fccdfdb89d0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:19.221934 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-25e34936-fe53-4bbb-885e-e4e9ab682d1b tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/f77a6c5863034f4bae1c4f907ecb67ad" status: 200 len: 371 microversion: 2.1 time: 0.077453 Oct 05 03:27:19.222555 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3478/6942] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 5 03:27:19 2022] GET /compute/v2.1/os-quota-sets/f77a6c5863034f4bae1c4f907ecb67ad => generated 371 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:27:19.235327 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-08937fdf-4d26-4ce5-a09a-2ed7bc68200b tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-537715643", "id": 333033505, "os-flavor-access:is_public": "True"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:27:19.255015 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-08937fdf-4d26-4ce5-a09a-2ed7bc68200b tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.022964 Oct 05 03:27:19.255905 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3465/6943] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:27:19 2022] POST /compute/v2.1/flavors => generated 433 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:27:19.268200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c88f10fe-0d55-4e30-b826-6ec76f6d3c5d tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "333033505"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:27:19.271322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c88f10fe-0d55-4e30-b826-6ec76f6d3c5d tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] [instance: 98934c76-744f-4f72-bd27-3702a3af9ebd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:19.277401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c88f10fe-0d55-4e30-b826-6ec76f6d3c5d tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:19.277894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c88f10fe-0d55-4e30-b826-6ec76f6d3c5d tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:19.278334 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c88f10fe-0d55-4e30-b826-6ec76f6d3c5d tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:19.279036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c88f10fe-0d55-4e30-b826-6ec76f6d3c5d tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:19.279495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c88f10fe-0d55-4e30-b826-6ec76f6d3c5d tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:19.279925 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c88f10fe-0d55-4e30-b826-6ec76f6d3c5d tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:19.439830 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c88f10fe-0d55-4e30-b826-6ec76f6d3c5d tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'cbd917c4db784cf0a4c34a643176359f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a6c5863034f4bae1c4f907ecb67ad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:19.446173 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c88f10fe-0d55-4e30-b826-6ec76f6d3c5d tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] [instance: 98934c76-744f-4f72-bd27-3702a3af9ebd] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-537715643 {{(pid=122319) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 05 03:27:19.452764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c88f10fe-0d55-4e30-b826-6ec76f6d3c5d tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:19.453270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c88f10fe-0d55-4e30-b826-6ec76f6d3c5d tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:19.453703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c88f10fe-0d55-4e30-b826-6ec76f6d3c5d tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:19.454421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c88f10fe-0d55-4e30-b826-6ec76f6d3c5d tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:19.454872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c88f10fe-0d55-4e30-b826-6ec76f6d3c5d tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:19.455291 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c88f10fe-0d55-4e30-b826-6ec76f6d3c5d tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:19.477440 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-c88f10fe-0d55-4e30-b826-6ec76f6d3c5d tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Getting quotas for project bfeb755072464c4688e55c2b2e5e9581. Resources: {'cores', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:27:19.482645 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-c88f10fe-0d55-4e30-b826-6ec76f6d3c5d tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Getting quotas for user b1bfbb2a47dc4ad0bbea68ac5ad864bb and project bfeb755072464c4688e55c2b2e5e9581. Resources: {'cores', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:27:19.497511 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.compute.api [None req-c88f10fe-0d55-4e30-b826-6ec76f6d3c5d tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] cores quota exceeded for f77a6c5863034f4bae1c4f907ecb67ad, tried to resize instance. Oct 05 03:27:19.498044 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-c88f10fe-0d55-4e30-b826-6ec76f6d3c5d tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c88f10fe-0d55-4e30-b826-6ec76f6d3c5d tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Request method failure captured: Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd/action HTTP/1.1 Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 38 Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPmIlh3ftfrxasNLpava7jMMdGwY59ctDmrPSVIw0dLk3sA3bK_lxPuWUnmn926W2TJy0EC69bZb5qtqxgMKnnVkj56hu7fRsZyTuO090O0HURSVamWtUcEBSnYW4y_5sG3ygtxjORLrzWkoeyz94YqGZLyxZaRl_fdIWnxxNJPeXVA Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: f77a6c5863034f4bae1c4f907ecb67ad Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-108461897 Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: X-Role: admin,member,reader Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: admin,member,reader Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f77a6c5863034f4bae1c4f907ecb67ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f77a6c5863034f4bae1c4f907ecb67ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f77a6c5863034f4bae1c4f907ecb67ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f77a6c5863034f4bae1c4f907ecb67ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersAdminNegativeTestJSON-108461897 Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: f77a6c5863034f4bae1c4f907ecb67ad Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-108461897 Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersAdminNegativeTestJSON-108461897-project-admin Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: cbd917c4db784cf0a4c34a643176359f Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersAdminNegativeTestJSON-108461897-project-admin Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: {"resize": {"flavorRef": "333033505"}} Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '98934c76-744f-4f72-bd27-3702a3af9ebd', 'body': {'resize': {'flavorRef': '333033505'}}} Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 03:27:19.500093 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c88f10fe-0d55-4e30-b826-6ec76f6d3c5d tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c88f10fe-0d55-4e30-b826-6ec76f6d3c5d tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd/action" status: 403 len: 113 microversion: 2.1 time: 0.237319 Oct 05 03:27:19.504411 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3479/6944] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:27:19 2022] POST /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd/action => generated 113 bytes in 238 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:27:19.510451 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d6027765-0af8-4c18-9864-5e39639d1c42 tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:19.527179 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d6027765-0af8-4c18-9864-5e39639d1c42 tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/333033505" status: 202 len: 0 microversion: 2.1 time: 0.020598 Oct 05 03:27:19.527752 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3466/6945] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 5 03:27:19 2022] DELETE /compute/v2.1/flavors/333033505 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:27:19.536581 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a92ada3d-e0ff-4c1b-8006-bf44ec60421c tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:19.556712 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a92ada3d-e0ff-4c1b-8006-bf44ec60421c tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024818 Oct 05 03:27:19.557485 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3480/6946] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 03:27:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:19.578588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-42f896f2-efd9-4ccc-8d37-e162d5c77911 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:19.579122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-42f896f2-efd9-4ccc-8d37-e162d5c77911 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] [instance: 98934c76-744f-4f72-bd27-3702a3af9ebd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:19.590212 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42f896f2-efd9-4ccc-8d37-e162d5c77911 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:19.590713 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42f896f2-efd9-4ccc-8d37-e162d5c77911 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:19.591171 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42f896f2-efd9-4ccc-8d37-e162d5c77911 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:19.591871 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42f896f2-efd9-4ccc-8d37-e162d5c77911 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:19.592336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42f896f2-efd9-4ccc-8d37-e162d5c77911 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:19.592771 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42f896f2-efd9-4ccc-8d37-e162d5c77911 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:19.618109 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-42f896f2-efd9-4ccc-8d37-e162d5c77911 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] [instance: 98934c76-744f-4f72-bd27-3702a3af9ebd] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:27:19.694735 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-42f896f2-efd9-4ccc-8d37-e162d5c77911 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] 10.222.0.16 "DELETE /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd" status: 204 len: 0 microversion: 2.1 time: 0.120149 Oct 05 03:27:19.695422 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3467/6947] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:27:19 2022] DELETE /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:27:19.703830 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7633a944-873f-443a-909d-9713798875e2 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:19.704452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7633a944-873f-443a-909d-9713798875e2 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] [instance: 98934c76-744f-4f72-bd27-3702a3af9ebd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:19.711144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7633a944-873f-443a-909d-9713798875e2 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:19.711637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7633a944-873f-443a-909d-9713798875e2 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:19.712109 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7633a944-873f-443a-909d-9713798875e2 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:19.712808 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7633a944-873f-443a-909d-9713798875e2 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:19.713340 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7633a944-873f-443a-909d-9713798875e2 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:19.713775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7633a944-873f-443a-909d-9713798875e2 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:19.847931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7633a944-873f-443a-909d-9713798875e2 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bfbb2a47dc4ad0bbea68ac5ad864bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfeb755072464c4688e55c2b2e5e9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:19.856673 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7633a944-873f-443a-909d-9713798875e2 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] 10.222.0.16 "GET /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd" status: 200 len: 1476 microversion: 2.1 time: 0.156762 Oct 05 03:27:19.857290 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3481/6948] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:19 2022] GET /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd => generated 1476 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:20.880702 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c0ea0bcb-0c7b-4cd3-bc88-7b9f1e7cc91e tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:20.881438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c0ea0bcb-0c7b-4cd3-bc88-7b9f1e7cc91e tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] [instance: 98934c76-744f-4f72-bd27-3702a3af9ebd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:20.888214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c0ea0bcb-0c7b-4cd3-bc88-7b9f1e7cc91e tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:20.888703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c0ea0bcb-0c7b-4cd3-bc88-7b9f1e7cc91e tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:20.889180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c0ea0bcb-0c7b-4cd3-bc88-7b9f1e7cc91e tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:20.889872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c0ea0bcb-0c7b-4cd3-bc88-7b9f1e7cc91e tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:20.890336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c0ea0bcb-0c7b-4cd3-bc88-7b9f1e7cc91e tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:20.890766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c0ea0bcb-0c7b-4cd3-bc88-7b9f1e7cc91e tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:21.024457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c0ea0bcb-0c7b-4cd3-bc88-7b9f1e7cc91e tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bfbb2a47dc4ad0bbea68ac5ad864bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfeb755072464c4688e55c2b2e5e9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:21.032674 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c0ea0bcb-0c7b-4cd3-bc88-7b9f1e7cc91e tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] 10.222.0.16 "GET /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd" status: 200 len: 1476 microversion: 2.1 time: 0.156622 Oct 05 03:27:21.033288 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3468/6949] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:20 2022] GET /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd => generated 1476 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:21.732762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-e32e8160-7d24-4939-b37d-74a8d9df692b req-ded67b66-48f4-4a02-91bc-41c7a44e3ecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98934c76-744f-4f72-bd27-3702a3af9ebd", "name": "network-vif-deleted", "tag": "66c07729-4c2a-4b7a-996e-8cc7c825fb56"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:27:21.748125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e32e8160-7d24-4939-b37d-74a8d9df692b req-ded67b66-48f4-4a02-91bc-41c7a44e3ecd service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:21.749514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e32e8160-7d24-4939-b37d-74a8d9df692b req-ded67b66-48f4-4a02-91bc-41c7a44e3ecd service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:21.750532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e32e8160-7d24-4939-b37d-74a8d9df692b req-ded67b66-48f4-4a02-91bc-41c7a44e3ecd service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:21.769801 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-e32e8160-7d24-4939-b37d-74a8d9df692b req-ded67b66-48f4-4a02-91bc-41c7a44e3ecd service nova] Creating event network-vif-deleted:66c07729-4c2a-4b7a-996e-8cc7c825fb56 for instance 98934c76-744f-4f72-bd27-3702a3af9ebd on n-h2-858272-3 Oct 05 03:27:21.776472 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-e32e8160-7d24-4939-b37d-74a8d9df692b req-ded67b66-48f4-4a02-91bc-41c7a44e3ecd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047924 Oct 05 03:27:21.777133 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3482/6950] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:27:22.056235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-af6f9915-0696-451c-9ca6-faa858321715 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:22.056918 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-af6f9915-0696-451c-9ca6-faa858321715 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] [instance: 98934c76-744f-4f72-bd27-3702a3af9ebd] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:22.064089 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af6f9915-0696-451c-9ca6-faa858321715 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:22.064628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af6f9915-0696-451c-9ca6-faa858321715 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:22.065116 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af6f9915-0696-451c-9ca6-faa858321715 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:22.065863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af6f9915-0696-451c-9ca6-faa858321715 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:22.066339 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af6f9915-0696-451c-9ca6-faa858321715 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:22.066892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af6f9915-0696-451c-9ca6-faa858321715 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:22.097742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af6f9915-0696-451c-9ca6-faa858321715 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:22.098276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af6f9915-0696-451c-9ca6-faa858321715 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:22.098721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af6f9915-0696-451c-9ca6-faa858321715 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:22.099163 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-af6f9915-0696-451c-9ca6-faa858321715 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lazy-loading 'fault' on Instance uuid 98934c76-744f-4f72-bd27-3702a3af9ebd {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:27:22.140895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-af6f9915-0696-451c-9ca6-faa858321715 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1bfbb2a47dc4ad0bbea68ac5ad864bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfeb755072464c4688e55c2b2e5e9581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:22.148573 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-af6f9915-0696-451c-9ca6-faa858321715 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] 10.222.0.16 "GET /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd" status: 200 len: 1311 microversion: 2.1 time: 0.096302 Oct 05 03:27:22.149359 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3469/6951] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:22 2022] GET /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:23.172348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1c52dfcc-fe14-44e5-909f-6e9cf1b48be7 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:23.173085 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1c52dfcc-fe14-44e5-909f-6e9cf1b48be7 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] [instance: 98934c76-744f-4f72-bd27-3702a3af9ebd] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:23.180336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c52dfcc-fe14-44e5-909f-6e9cf1b48be7 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:23.180819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c52dfcc-fe14-44e5-909f-6e9cf1b48be7 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:23.181283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c52dfcc-fe14-44e5-909f-6e9cf1b48be7 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:23.181973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c52dfcc-fe14-44e5-909f-6e9cf1b48be7 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:23.182427 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c52dfcc-fe14-44e5-909f-6e9cf1b48be7 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:23.182854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c52dfcc-fe14-44e5-909f-6e9cf1b48be7 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:23.196928 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-1c52dfcc-fe14-44e5-909f-6e9cf1b48be7 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] HTTP exception thrown: Instance 98934c76-744f-4f72-bd27-3702a3af9ebd could not be found. Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1c52dfcc-fe14-44e5-909f-6e9cf1b48be7 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Request method failure captured: Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd HTTP/1.1 Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPmIcgordSsmkQWf8q3LwUHN_ReDsfMqhUVpzlvXwVp93v-T_P9CqrSwcAUzuBtKrzuLiUWskcNDB27YW5Mn24tGLu-SpcGJqAz3Xmc4C8A1_Hq2o1NDJ09GGMdqs2u_Fw7IxBkaZQ0xQRa_-hkfuWinRpmFCGsvnnouYEXHnCPXnUA Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: bfeb755072464c4688e55c2b2e5e9581 Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-567047586 Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bfeb755072464c4688e55c2b2e5e9581"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bfeb755072464c4688e55c2b2e5e9581"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bfeb755072464c4688e55c2b2e5e9581"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bfeb755072464c4688e55c2b2e5e9581"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersAdminNegativeTestJSON-567047586 Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: bfeb755072464c4688e55c2b2e5e9581 Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-567047586 Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersAdminNegativeTestJSON-567047586-project Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: b1bfbb2a47dc4ad0bbea68ac5ad864bb Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersAdminNegativeTestJSON-567047586-project Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 98934c76-744f-4f72-bd27-3702a3af9ebd could not be found. Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '98934c76-744f-4f72-bd27-3702a3af9ebd'} Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98934c76-744f-4f72-bd27-3702a3af9ebd could not be found. Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98934c76-744f-4f72-bd27-3702a3af9ebd could not be found. Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:27:23.198530 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:27:23.202861 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:27:23.202861 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:27:23.202861 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:27:23.202861 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:27:23.202861 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:27:23.202861 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:27:23.202861 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98934c76-744f-4f72-bd27-3702a3af9ebd could not be found. Oct 05 03:27:23.202861 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:27:23.202861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1c52dfcc-fe14-44e5-909f-6e9cf1b48be7 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] Returning 404 to user: Instance 98934c76-744f-4f72-bd27-3702a3af9ebd could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:27:23.202861 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1c52dfcc-fe14-44e5-909f-6e9cf1b48be7 tempest-ServersAdminNegativeTestJSON-567047586 tempest-ServersAdminNegativeTestJSON-567047586-project] 10.222.0.16 "GET /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd" status: 404 len: 111 microversion: 2.1 time: 0.031909 Oct 05 03:27:23.202861 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3483/6952] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:23 2022] GET /compute/v2.1/servers/98934c76-744f-4f72-bd27-3702a3af9ebd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:27:29.308792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:27:29.309620 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:27:29.441326 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c533af47-66d5-4472-ab90-9c019bed7ab6 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1281830232", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "263b9b84-a105-44f0-9884-677d34acf4d4"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:27:29.501032 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-c533af47-66d5-4472-ab90-9c019bed7ab6 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] validate_networks() for [('263b9b84-a105-44f0-9884-677d34acf4d4', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:27:29.903654 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-c533af47-66d5-4472-ab90-9c019bed7ab6 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:27:29.904114 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-c533af47-66d5-4472-ab90-9c019bed7ab6 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:27:29.904766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-c533af47-66d5-4472-ab90-9c019bed7ab6 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:27:29.905230 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-c533af47-66d5-4472-ab90-9c019bed7ab6 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:27:29.905655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-c533af47-66d5-4472-ab90-9c019bed7ab6 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:27:29.914763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c533af47-66d5-4472-ab90-9c019bed7ab6 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:29.915280 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c533af47-66d5-4472-ab90-9c019bed7ab6 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:29.915727 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c533af47-66d5-4472-ab90-9c019bed7ab6 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:29.916461 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c533af47-66d5-4472-ab90-9c019bed7ab6 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:29.916947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c533af47-66d5-4472-ab90-9c019bed7ab6 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:29.917403 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c533af47-66d5-4472-ab90-9c019bed7ab6 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:29.934235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-c533af47-66d5-4472-ab90-9c019bed7ab6 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Getting quotas for project 7dbe394870c44ea89d4af55ef70552b9. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:27:29.941010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-c533af47-66d5-4472-ab90-9c019bed7ab6 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Getting quotas for user 8992b0e6086d49f29a831c6fb498dcbe and project 7dbe394870c44ea89d4af55ef70552b9. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:27:29.956824 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c533af47-66d5-4472-ab90-9c019bed7ab6 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:27:29.959961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c533af47-66d5-4472-ab90-9c019bed7ab6 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:27:30.009452 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c533af47-66d5-4472-ab90-9c019bed7ab6 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.708968 Oct 05 03:27:30.016364 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3470/6953] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:27:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:27:30.022397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-98edb43a-4021-417f-a88e-1a2f6b05bf85 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:30.023202 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-98edb43a-4021-417f-a88e-1a2f6b05bf85 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:30.030905 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:27:30.031728 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:27:30.087019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-98edb43a-4021-417f-a88e-1a2f6b05bf85 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:30.094886 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-98edb43a-4021-417f-a88e-1a2f6b05bf85 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1215 microversion: 2.1 time: 0.077096 Oct 05 03:27:30.095842 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3484/6954] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:30 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1215 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:31.120107 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-430e0390-f20b-49b4-bd92-b229fa22d741 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:31.120738 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-430e0390-f20b-49b4-bd92-b229fa22d741 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:31.128548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-430e0390-f20b-49b4-bd92-b229fa22d741 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:31.129076 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-430e0390-f20b-49b4-bd92-b229fa22d741 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:31.129524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-430e0390-f20b-49b4-bd92-b229fa22d741 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:31.130225 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-430e0390-f20b-49b4-bd92-b229fa22d741 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:31.130764 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-430e0390-f20b-49b4-bd92-b229fa22d741 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:31.131177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-430e0390-f20b-49b4-bd92-b229fa22d741 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:31.207487 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-430e0390-f20b-49b4-bd92-b229fa22d741 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:31.216869 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-430e0390-f20b-49b4-bd92-b229fa22d741 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1275 microversion: 2.1 time: 0.101470 Oct 05 03:27:31.218064 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3471/6955] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:31 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1275 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:32.243790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4911681a-3005-42c0-b7de-f834a4855c65 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:32.245516 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4911681a-3005-42c0-b7de-f834a4855c65 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:32.256716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4911681a-3005-42c0-b7de-f834a4855c65 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:32.257384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4911681a-3005-42c0-b7de-f834a4855c65 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:32.258658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4911681a-3005-42c0-b7de-f834a4855c65 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:32.259477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4911681a-3005-42c0-b7de-f834a4855c65 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:32.260021 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4911681a-3005-42c0-b7de-f834a4855c65 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:32.260565 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4911681a-3005-42c0-b7de-f834a4855c65 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:32.432070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4911681a-3005-42c0-b7de-f834a4855c65 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:32.440448 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4911681a-3005-42c0-b7de-f834a4855c65 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1315 microversion: 2.1 time: 0.202543 Oct 05 03:27:32.441134 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3485/6956] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:32 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:32.997483 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-32a1a417-d6bf-44ed-933d-7c6cb4337a3e req-655750d3-49cd-4e93-9afa-89c2c49b3d36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51eef65e-f229-4200-be66-9518f1c27f28", "tag": "a89c28e3-30f6-4081-ac9f-b87e113fc1ad"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:27:33.010915 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-32a1a417-d6bf-44ed-933d-7c6cb4337a3e req-655750d3-49cd-4e93-9afa-89c2c49b3d36 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:33.012884 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-32a1a417-d6bf-44ed-933d-7c6cb4337a3e req-655750d3-49cd-4e93-9afa-89c2c49b3d36 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:33.013374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-32a1a417-d6bf-44ed-933d-7c6cb4337a3e req-655750d3-49cd-4e93-9afa-89c2c49b3d36 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:33.031754 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-32a1a417-d6bf-44ed-933d-7c6cb4337a3e req-655750d3-49cd-4e93-9afa-89c2c49b3d36 service nova] Creating event network-changed:a89c28e3-30f6-4081-ac9f-b87e113fc1ad for instance 51eef65e-f229-4200-be66-9518f1c27f28 on n-h2-858272-3 Oct 05 03:27:33.043281 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-32a1a417-d6bf-44ed-933d-7c6cb4337a3e req-655750d3-49cd-4e93-9afa-89c2c49b3d36 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050234 Oct 05 03:27:33.044446 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3472/6957] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:27:33.465972 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-43d1c486-2af3-482a-af35-e8a176723700 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:33.466656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-43d1c486-2af3-482a-af35-e8a176723700 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:33.473855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43d1c486-2af3-482a-af35-e8a176723700 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:33.477438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43d1c486-2af3-482a-af35-e8a176723700 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:33.477438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43d1c486-2af3-482a-af35-e8a176723700 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:33.477438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43d1c486-2af3-482a-af35-e8a176723700 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:33.477438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43d1c486-2af3-482a-af35-e8a176723700 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:33.477438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-43d1c486-2af3-482a-af35-e8a176723700 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:33.610676 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-43d1c486-2af3-482a-af35-e8a176723700 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:33.618453 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-43d1c486-2af3-482a-af35-e8a176723700 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1315 microversion: 2.1 time: 0.156616 Oct 05 03:27:33.619023 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3486/6958] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:33 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:34.643437 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ae024bcd-926b-4ca6-95e1-7736423c0b41 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:34.644165 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ae024bcd-926b-4ca6-95e1-7736423c0b41 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:34.654680 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae024bcd-926b-4ca6-95e1-7736423c0b41 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:34.655959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae024bcd-926b-4ca6-95e1-7736423c0b41 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:34.655959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae024bcd-926b-4ca6-95e1-7736423c0b41 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:34.657422 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae024bcd-926b-4ca6-95e1-7736423c0b41 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:34.657894 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae024bcd-926b-4ca6-95e1-7736423c0b41 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:34.658335 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae024bcd-926b-4ca6-95e1-7736423c0b41 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:34.798665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ae024bcd-926b-4ca6-95e1-7736423c0b41 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:34.806569 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ae024bcd-926b-4ca6-95e1-7736423c0b41 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1315 microversion: 2.1 time: 0.168417 Oct 05 03:27:34.807145 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3473/6959] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:34 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:35.829453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-40f86b29-213c-446b-9b29-0a880729ef32 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:35.830075 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-40f86b29-213c-446b-9b29-0a880729ef32 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:35.832755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:27:35.838322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40f86b29-213c-446b-9b29-0a880729ef32 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:35.838819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40f86b29-213c-446b-9b29-0a880729ef32 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:35.839258 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40f86b29-213c-446b-9b29-0a880729ef32 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:35.839962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40f86b29-213c-446b-9b29-0a880729ef32 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:35.840418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40f86b29-213c-446b-9b29-0a880729ef32 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:35.840847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40f86b29-213c-446b-9b29-0a880729ef32 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:35.845723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=72 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:27:35.976932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-40f86b29-213c-446b-9b29-0a880729ef32 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:35.985087 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-40f86b29-213c-446b-9b29-0a880729ef32 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1315 microversion: 2.1 time: 0.159549 Oct 05 03:27:35.985668 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3487/6960] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:35 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:37.009076 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ec88c414-270d-477c-ad51-089100c9ebee tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:37.009621 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ec88c414-270d-477c-ad51-089100c9ebee tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:37.012435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:27:37.017772 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec88c414-270d-477c-ad51-089100c9ebee tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:37.018271 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec88c414-270d-477c-ad51-089100c9ebee tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:37.018725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec88c414-270d-477c-ad51-089100c9ebee tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:37.019420 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec88c414-270d-477c-ad51-089100c9ebee tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:37.019882 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec88c414-270d-477c-ad51-089100c9ebee tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:37.020314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec88c414-270d-477c-ad51-089100c9ebee tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:37.023931 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:27:37.158322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ec88c414-270d-477c-ad51-089100c9ebee tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:37.166717 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ec88c414-270d-477c-ad51-089100c9ebee tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1315 microversion: 2.1 time: 0.162524 Oct 05 03:27:37.167286 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3474/6961] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:37 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:38.190662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-be6e6fbe-9c9a-458e-a6ca-f18c2080a53c tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:38.191283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-be6e6fbe-9c9a-458e-a6ca-f18c2080a53c tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:38.198761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be6e6fbe-9c9a-458e-a6ca-f18c2080a53c tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:38.199278 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be6e6fbe-9c9a-458e-a6ca-f18c2080a53c tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:38.199717 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be6e6fbe-9c9a-458e-a6ca-f18c2080a53c tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:38.200426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be6e6fbe-9c9a-458e-a6ca-f18c2080a53c tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:38.200886 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be6e6fbe-9c9a-458e-a6ca-f18c2080a53c tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:38.201341 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be6e6fbe-9c9a-458e-a6ca-f18c2080a53c tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:38.332966 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-be6e6fbe-9c9a-458e-a6ca-f18c2080a53c tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:38.340686 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-be6e6fbe-9c9a-458e-a6ca-f18c2080a53c tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1315 microversion: 2.1 time: 0.153963 Oct 05 03:27:38.341288 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3488/6962] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:38 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:39.363634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a4088a87-a6ec-4e43-8642-eadada672d1b tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:39.364253 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a4088a87-a6ec-4e43-8642-eadada672d1b tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:39.371086 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a4088a87-a6ec-4e43-8642-eadada672d1b tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:39.371605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a4088a87-a6ec-4e43-8642-eadada672d1b tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:39.372054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a4088a87-a6ec-4e43-8642-eadada672d1b tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:39.372741 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a4088a87-a6ec-4e43-8642-eadada672d1b tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:39.373236 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a4088a87-a6ec-4e43-8642-eadada672d1b tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:39.373675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a4088a87-a6ec-4e43-8642-eadada672d1b tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:39.503739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a4088a87-a6ec-4e43-8642-eadada672d1b tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:39.512666 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a4088a87-a6ec-4e43-8642-eadada672d1b tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1315 microversion: 2.1 time: 0.152818 Oct 05 03:27:39.513215 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3475/6963] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:39 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:40.242529 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-34d76d1d-6642-40fe-9d71-f07bea519407 req-4e865910-ca87-46b3-afb9-a5722ba72280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51eef65e-f229-4200-be66-9518f1c27f28", "name": "network-vif-plugged", "status": "completed", "tag": "a89c28e3-30f6-4081-ac9f-b87e113fc1ad"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:27:40.248009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:27:40.255472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-34d76d1d-6642-40fe-9d71-f07bea519407 req-4e865910-ca87-46b3-afb9-a5722ba72280 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:40.255961 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-34d76d1d-6642-40fe-9d71-f07bea519407 req-4e865910-ca87-46b3-afb9-a5722ba72280 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:40.256395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-34d76d1d-6642-40fe-9d71-f07bea519407 req-4e865910-ca87-46b3-afb9-a5722ba72280 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:40.268861 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-34d76d1d-6642-40fe-9d71-f07bea519407 req-4e865910-ca87-46b3-afb9-a5722ba72280 service nova] Creating event network-vif-plugged:a89c28e3-30f6-4081-ac9f-b87e113fc1ad for instance 51eef65e-f229-4200-be66-9518f1c27f28 on n-h2-858272-3 Oct 05 03:27:40.274958 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-34d76d1d-6642-40fe-9d71-f07bea519407 req-4e865910-ca87-46b3-afb9-a5722ba72280 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036469 Oct 05 03:27:40.275574 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3489/6964] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:27:40.536744 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5cce6092-6364-4c82-bf6b-93e2e4669aa7 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:40.537686 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5cce6092-6364-4c82-bf6b-93e2e4669aa7 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:40.540473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:27:40.541341 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:27:40.548025 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5cce6092-6364-4c82-bf6b-93e2e4669aa7 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:40.548524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5cce6092-6364-4c82-bf6b-93e2e4669aa7 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:40.549074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5cce6092-6364-4c82-bf6b-93e2e4669aa7 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:40.549995 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5cce6092-6364-4c82-bf6b-93e2e4669aa7 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:40.550470 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5cce6092-6364-4c82-bf6b-93e2e4669aa7 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:40.550907 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5cce6092-6364-4c82-bf6b-93e2e4669aa7 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:40.680205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5cce6092-6364-4c82-bf6b-93e2e4669aa7 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:40.687826 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5cce6092-6364-4c82-bf6b-93e2e4669aa7 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1315 microversion: 2.1 time: 0.154986 Oct 05 03:27:40.688393 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3476/6965] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:40 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:41.710876 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1586e32a-a4a1-422e-9f44-9a0c7ac45557 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:41.711574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1586e32a-a4a1-422e-9f44-9a0c7ac45557 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:41.718881 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1586e32a-a4a1-422e-9f44-9a0c7ac45557 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:41.719367 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1586e32a-a4a1-422e-9f44-9a0c7ac45557 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:41.719802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1586e32a-a4a1-422e-9f44-9a0c7ac45557 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:41.720491 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1586e32a-a4a1-422e-9f44-9a0c7ac45557 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:41.720966 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1586e32a-a4a1-422e-9f44-9a0c7ac45557 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:41.722083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1586e32a-a4a1-422e-9f44-9a0c7ac45557 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:41.868101 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1586e32a-a4a1-422e-9f44-9a0c7ac45557 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:41.876101 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1586e32a-a4a1-422e-9f44-9a0c7ac45557 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1315 microversion: 2.1 time: 0.169436 Oct 05 03:27:41.889087 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3490/6966] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:41 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:42.900275 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c0888d69-6129-4108-818e-c0ecdb0c7eef tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:42.900824 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c0888d69-6129-4108-818e-c0ecdb0c7eef tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:42.907740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c0888d69-6129-4108-818e-c0ecdb0c7eef tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:42.908238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c0888d69-6129-4108-818e-c0ecdb0c7eef tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:42.908691 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c0888d69-6129-4108-818e-c0ecdb0c7eef tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:42.909425 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c0888d69-6129-4108-818e-c0ecdb0c7eef tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:42.909894 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c0888d69-6129-4108-818e-c0ecdb0c7eef tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:42.910335 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c0888d69-6129-4108-818e-c0ecdb0c7eef tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:43.047240 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c0888d69-6129-4108-818e-c0ecdb0c7eef tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:43.055784 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c0888d69-6129-4108-818e-c0ecdb0c7eef tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1502 microversion: 2.1 time: 0.159673 Oct 05 03:27:43.056366 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3477/6967] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:42 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:43.078917 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-06b3f749-84c9-4bf0-82a6-3e656fcf7d45 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:27:43.081258 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-06b3f749-84c9-4bf0-82a6-3e656fcf7d45 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:43.088241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06b3f749-84c9-4bf0-82a6-3e656fcf7d45 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:43.088725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06b3f749-84c9-4bf0-82a6-3e656fcf7d45 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:43.089185 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06b3f749-84c9-4bf0-82a6-3e656fcf7d45 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:43.089874 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06b3f749-84c9-4bf0-82a6-3e656fcf7d45 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:43.090326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06b3f749-84c9-4bf0-82a6-3e656fcf7d45 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:43.090752 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06b3f749-84c9-4bf0-82a6-3e656fcf7d45 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:43.119131 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-06b3f749-84c9-4bf0-82a6-3e656fcf7d45 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:43.124527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-06b3f749-84c9-4bf0-82a6-3e656fcf7d45 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Old instance type m1.heat2, new instance type m1.heat {{(pid=122319) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 05 03:27:43.131033 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-06b3f749-84c9-4bf0-82a6-3e656fcf7d45 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:27:43.131459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-06b3f749-84c9-4bf0-82a6-3e656fcf7d45 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:27:43.131956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-06b3f749-84c9-4bf0-82a6-3e656fcf7d45 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:27:43.132997 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-06b3f749-84c9-4bf0-82a6-3e656fcf7d45 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:27:43.133412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-06b3f749-84c9-4bf0-82a6-3e656fcf7d45 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:27:43.196240 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-06b3f749-84c9-4bf0-82a6-3e656fcf7d45 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "POST /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28/action" status: 202 len: 0 microversion: 2.1 time: 0.121142 Oct 05 03:27:43.196784 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3491/6968] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:27:43 2022] POST /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:27:43.204962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8d152a42-9013-4282-a2d8-0af543bee2a7 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:43.205591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8d152a42-9013-4282-a2d8-0af543bee2a7 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:43.211996 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d152a42-9013-4282-a2d8-0af543bee2a7 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:43.212498 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d152a42-9013-4282-a2d8-0af543bee2a7 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:43.212964 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d152a42-9013-4282-a2d8-0af543bee2a7 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:43.213666 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d152a42-9013-4282-a2d8-0af543bee2a7 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:43.214131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d152a42-9013-4282-a2d8-0af543bee2a7 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:43.214566 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8d152a42-9013-4282-a2d8-0af543bee2a7 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:43.362795 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8d152a42-9013-4282-a2d8-0af543bee2a7 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:43.371451 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8d152a42-9013-4282-a2d8-0af543bee2a7 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1511 microversion: 2.1 time: 0.170425 Oct 05 03:27:43.372080 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3478/6969] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:43 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1511 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:27:44.395172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1d2b4d04-f1c6-417d-9d42-5406969572b4 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:44.395796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1d2b4d04-f1c6-417d-9d42-5406969572b4 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:44.404432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d2b4d04-f1c6-417d-9d42-5406969572b4 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:44.405006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d2b4d04-f1c6-417d-9d42-5406969572b4 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:44.405453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d2b4d04-f1c6-417d-9d42-5406969572b4 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:44.406164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d2b4d04-f1c6-417d-9d42-5406969572b4 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:44.406626 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d2b4d04-f1c6-417d-9d42-5406969572b4 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:44.407060 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d2b4d04-f1c6-417d-9d42-5406969572b4 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:44.543697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1d2b4d04-f1c6-417d-9d42-5406969572b4 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:44.551427 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1d2b4d04-f1c6-417d-9d42-5406969572b4 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1511 microversion: 2.1 time: 0.161434 Oct 05 03:27:44.552001 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3492/6970] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:44 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:45.574683 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8ed580f2-9589-40d5-9ab4-041b9144d250 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:45.575317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8ed580f2-9589-40d5-9ab4-041b9144d250 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:45.582201 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ed580f2-9589-40d5-9ab4-041b9144d250 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:45.582701 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ed580f2-9589-40d5-9ab4-041b9144d250 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:45.583153 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ed580f2-9589-40d5-9ab4-041b9144d250 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:45.583854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ed580f2-9589-40d5-9ab4-041b9144d250 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:45.584324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ed580f2-9589-40d5-9ab4-041b9144d250 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:45.584757 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8ed580f2-9589-40d5-9ab4-041b9144d250 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:45.717317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8ed580f2-9589-40d5-9ab4-041b9144d250 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:45.725066 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8ed580f2-9589-40d5-9ab4-041b9144d250 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1516 microversion: 2.1 time: 0.154324 Oct 05 03:27:45.726159 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3479/6971] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:45 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:27:46.749934 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fe974c01-4027-4f27-a0e3-8c52bb584194 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:46.750591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fe974c01-4027-4f27-a0e3-8c52bb584194 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:46.758425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fe974c01-4027-4f27-a0e3-8c52bb584194 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:46.758912 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fe974c01-4027-4f27-a0e3-8c52bb584194 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:46.759351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fe974c01-4027-4f27-a0e3-8c52bb584194 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:46.760050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fe974c01-4027-4f27-a0e3-8c52bb584194 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:46.760508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fe974c01-4027-4f27-a0e3-8c52bb584194 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:46.760964 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fe974c01-4027-4f27-a0e3-8c52bb584194 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:46.897110 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fe974c01-4027-4f27-a0e3-8c52bb584194 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:46.905012 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fe974c01-4027-4f27-a0e3-8c52bb584194 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1516 microversion: 2.1 time: 0.158954 Oct 05 03:27:46.905594 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3493/6972] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:46 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:47.929679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ec59382b-635c-462d-adb4-dd54d808e4c7 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:47.930231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ec59382b-635c-462d-adb4-dd54d808e4c7 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:47.936343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec59382b-635c-462d-adb4-dd54d808e4c7 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:47.936839 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec59382b-635c-462d-adb4-dd54d808e4c7 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:47.937316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec59382b-635c-462d-adb4-dd54d808e4c7 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:47.938010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec59382b-635c-462d-adb4-dd54d808e4c7 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:47.938470 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec59382b-635c-462d-adb4-dd54d808e4c7 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:47.938902 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec59382b-635c-462d-adb4-dd54d808e4c7 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:48.068607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ec59382b-635c-462d-adb4-dd54d808e4c7 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:48.077145 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ec59382b-635c-462d-adb4-dd54d808e4c7 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1516 microversion: 2.1 time: 0.151894 Oct 05 03:27:48.077718 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3480/6973] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:47 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:49.100706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2d466699-1f9d-414d-a134-f55521b193f5 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:49.101455 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2d466699-1f9d-414d-a134-f55521b193f5 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:49.108638 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2d466699-1f9d-414d-a134-f55521b193f5 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:49.109154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2d466699-1f9d-414d-a134-f55521b193f5 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:49.109597 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2d466699-1f9d-414d-a134-f55521b193f5 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:49.110294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2d466699-1f9d-414d-a134-f55521b193f5 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:49.110751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2d466699-1f9d-414d-a134-f55521b193f5 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:49.111182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2d466699-1f9d-414d-a134-f55521b193f5 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:49.242765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2d466699-1f9d-414d-a134-f55521b193f5 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:49.250657 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2d466699-1f9d-414d-a134-f55521b193f5 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1516 microversion: 2.1 time: 0.153934 Oct 05 03:27:49.251302 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3494/6974] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:49 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:27:50.274237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-633b3c6d-4add-4a58-87f8-9e11b6f3b10e tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:50.274842 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-633b3c6d-4add-4a58-87f8-9e11b6f3b10e tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:50.281683 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-633b3c6d-4add-4a58-87f8-9e11b6f3b10e tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:50.282178 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-633b3c6d-4add-4a58-87f8-9e11b6f3b10e tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:50.282622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-633b3c6d-4add-4a58-87f8-9e11b6f3b10e tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:50.283314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-633b3c6d-4add-4a58-87f8-9e11b6f3b10e tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:50.283778 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-633b3c6d-4add-4a58-87f8-9e11b6f3b10e tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:50.284211 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-633b3c6d-4add-4a58-87f8-9e11b6f3b10e tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:50.413485 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-633b3c6d-4add-4a58-87f8-9e11b6f3b10e tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:50.421356 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-633b3c6d-4add-4a58-87f8-9e11b6f3b10e tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1516 microversion: 2.1 time: 0.151125 Oct 05 03:27:50.421933 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3481/6975] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:50 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:51.445908 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-40d7fa68-fde6-4b94-b162-eef19984f75f tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:51.446516 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-40d7fa68-fde6-4b94-b162-eef19984f75f tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:51.453511 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40d7fa68-fde6-4b94-b162-eef19984f75f tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:51.453995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40d7fa68-fde6-4b94-b162-eef19984f75f tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:51.454426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40d7fa68-fde6-4b94-b162-eef19984f75f tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:51.455108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40d7fa68-fde6-4b94-b162-eef19984f75f tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:51.455558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40d7fa68-fde6-4b94-b162-eef19984f75f tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:51.455982 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40d7fa68-fde6-4b94-b162-eef19984f75f tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:51.587068 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-40d7fa68-fde6-4b94-b162-eef19984f75f tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:51.594722 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-40d7fa68-fde6-4b94-b162-eef19984f75f tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1516 microversion: 2.1 time: 0.153301 Oct 05 03:27:51.595302 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3495/6976] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:51 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:52.618827 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d7c86b57-9266-4f61-b60c-46721bce9ee4 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:52.619454 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d7c86b57-9266-4f61-b60c-46721bce9ee4 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:52.626319 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7c86b57-9266-4f61-b60c-46721bce9ee4 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:52.626818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7c86b57-9266-4f61-b60c-46721bce9ee4 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:52.627265 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7c86b57-9266-4f61-b60c-46721bce9ee4 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:52.627956 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7c86b57-9266-4f61-b60c-46721bce9ee4 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:52.628421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7c86b57-9266-4f61-b60c-46721bce9ee4 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:52.628853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d7c86b57-9266-4f61-b60c-46721bce9ee4 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:52.766064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d7c86b57-9266-4f61-b60c-46721bce9ee4 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:52.774253 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d7c86b57-9266-4f61-b60c-46721bce9ee4 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1516 microversion: 2.1 time: 0.159546 Oct 05 03:27:52.774832 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3482/6977] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:52 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:53.797835 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ad914e88-72bb-4a33-abbd-91cb5df18018 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:53.798453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ad914e88-72bb-4a33-abbd-91cb5df18018 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:53.806103 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad914e88-72bb-4a33-abbd-91cb5df18018 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:53.806590 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad914e88-72bb-4a33-abbd-91cb5df18018 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:53.807027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad914e88-72bb-4a33-abbd-91cb5df18018 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:53.807721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad914e88-72bb-4a33-abbd-91cb5df18018 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:53.808178 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad914e88-72bb-4a33-abbd-91cb5df18018 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:53.808608 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad914e88-72bb-4a33-abbd-91cb5df18018 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:53.937529 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ad914e88-72bb-4a33-abbd-91cb5df18018 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:53.945643 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ad914e88-72bb-4a33-abbd-91cb5df18018 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1516 microversion: 2.1 time: 0.151649 Oct 05 03:27:53.946253 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3496/6978] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:53 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:54.973670 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ca4bcb31-1125-464f-947e-30bfa4dc4fba tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:54.974220 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ca4bcb31-1125-464f-947e-30bfa4dc4fba tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:54.982095 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca4bcb31-1125-464f-947e-30bfa4dc4fba tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:54.982596 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca4bcb31-1125-464f-947e-30bfa4dc4fba tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:54.983045 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca4bcb31-1125-464f-947e-30bfa4dc4fba tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:54.983745 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca4bcb31-1125-464f-947e-30bfa4dc4fba tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:54.984247 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca4bcb31-1125-464f-947e-30bfa4dc4fba tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:54.984725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca4bcb31-1125-464f-947e-30bfa4dc4fba tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:55.116634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ca4bcb31-1125-464f-947e-30bfa4dc4fba tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:55.124442 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ca4bcb31-1125-464f-947e-30bfa4dc4fba tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1516 microversion: 2.1 time: 0.154845 Oct 05 03:27:55.125049 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3483/6979] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:54 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:56.149254 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-da043637-9d63-4470-a52f-c67beb33b627 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:56.149874 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-da043637-9d63-4470-a52f-c67beb33b627 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:56.156719 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da043637-9d63-4470-a52f-c67beb33b627 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:56.157236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da043637-9d63-4470-a52f-c67beb33b627 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:56.157677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da043637-9d63-4470-a52f-c67beb33b627 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:56.158401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da043637-9d63-4470-a52f-c67beb33b627 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:56.158859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da043637-9d63-4470-a52f-c67beb33b627 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:56.159289 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da043637-9d63-4470-a52f-c67beb33b627 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:56.288350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-da043637-9d63-4470-a52f-c67beb33b627 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:56.296692 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-da043637-9d63-4470-a52f-c67beb33b627 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1516 microversion: 2.1 time: 0.152252 Oct 05 03:27:56.297310 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3497/6980] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:56 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:57.321044 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6b23ed43-6a2c-48e5-aefc-f53ae9ec2652 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:57.321673 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6b23ed43-6a2c-48e5-aefc-f53ae9ec2652 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:57.328495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b23ed43-6a2c-48e5-aefc-f53ae9ec2652 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:57.329053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b23ed43-6a2c-48e5-aefc-f53ae9ec2652 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:57.329508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b23ed43-6a2c-48e5-aefc-f53ae9ec2652 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:57.330286 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b23ed43-6a2c-48e5-aefc-f53ae9ec2652 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:57.330766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b23ed43-6a2c-48e5-aefc-f53ae9ec2652 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:57.331205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b23ed43-6a2c-48e5-aefc-f53ae9ec2652 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:57.459061 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6b23ed43-6a2c-48e5-aefc-f53ae9ec2652 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:57.467337 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6b23ed43-6a2c-48e5-aefc-f53ae9ec2652 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1516 microversion: 2.1 time: 0.150245 Oct 05 03:27:57.467918 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3484/6981] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:57 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:58.491698 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ad2f34e8-0d64-4beb-abd2-a4cf7c68c4bf tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:58.492261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ad2f34e8-0d64-4beb-abd2-a4cf7c68c4bf tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:58.498986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad2f34e8-0d64-4beb-abd2-a4cf7c68c4bf tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:58.499474 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad2f34e8-0d64-4beb-abd2-a4cf7c68c4bf tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:58.499913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad2f34e8-0d64-4beb-abd2-a4cf7c68c4bf tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:58.500597 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad2f34e8-0d64-4beb-abd2-a4cf7c68c4bf tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:58.501075 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad2f34e8-0d64-4beb-abd2-a4cf7c68c4bf tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:58.501503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad2f34e8-0d64-4beb-abd2-a4cf7c68c4bf tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:58.637784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ad2f34e8-0d64-4beb-abd2-a4cf7c68c4bf tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:58.645397 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ad2f34e8-0d64-4beb-abd2-a4cf7c68c4bf tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1516 microversion: 2.1 time: 0.158207 Oct 05 03:27:58.645963 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3498/6982] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:58 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:27:59.668730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-59f9d396-e497-4a31-aafc-2141026870a8 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:27:59.669407 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-59f9d396-e497-4a31-aafc-2141026870a8 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:27:59.676328 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-59f9d396-e497-4a31-aafc-2141026870a8 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:59.676832 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-59f9d396-e497-4a31-aafc-2141026870a8 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:59.677315 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-59f9d396-e497-4a31-aafc-2141026870a8 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:59.678020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-59f9d396-e497-4a31-aafc-2141026870a8 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:27:59.678528 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-59f9d396-e497-4a31-aafc-2141026870a8 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:27:59.679147 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-59f9d396-e497-4a31-aafc-2141026870a8 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:27:59.807683 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-59f9d396-e497-4a31-aafc-2141026870a8 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:27:59.815370 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-59f9d396-e497-4a31-aafc-2141026870a8 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1516 microversion: 2.1 time: 0.150574 Oct 05 03:27:59.815938 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3485/6983] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:27:59 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:00.838368 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-657ec2a1-92d5-4cf5-99f2-d07fdce68462 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:00.838990 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-657ec2a1-92d5-4cf5-99f2-d07fdce68462 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:00.845904 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-657ec2a1-92d5-4cf5-99f2-d07fdce68462 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:00.846397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-657ec2a1-92d5-4cf5-99f2-d07fdce68462 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:00.846836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-657ec2a1-92d5-4cf5-99f2-d07fdce68462 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:00.847533 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-657ec2a1-92d5-4cf5-99f2-d07fdce68462 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:00.847988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-657ec2a1-92d5-4cf5-99f2-d07fdce68462 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:00.848416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-657ec2a1-92d5-4cf5-99f2-d07fdce68462 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:00.993929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-657ec2a1-92d5-4cf5-99f2-d07fdce68462 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:01.001754 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-657ec2a1-92d5-4cf5-99f2-d07fdce68462 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1516 microversion: 2.1 time: 0.167382 Oct 05 03:28:01.002331 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3499/6984] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:00 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:02.026361 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-36d237c6-c48e-4850-875d-0b5a2287ad1e tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:02.026905 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-36d237c6-c48e-4850-875d-0b5a2287ad1e tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:02.033796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36d237c6-c48e-4850-875d-0b5a2287ad1e tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:02.034297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36d237c6-c48e-4850-875d-0b5a2287ad1e tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:02.034752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36d237c6-c48e-4850-875d-0b5a2287ad1e tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:02.035455 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36d237c6-c48e-4850-875d-0b5a2287ad1e tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:02.035922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36d237c6-c48e-4850-875d-0b5a2287ad1e tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:02.036360 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36d237c6-c48e-4850-875d-0b5a2287ad1e tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:02.167033 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-36d237c6-c48e-4850-875d-0b5a2287ad1e tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:02.174777 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-36d237c6-c48e-4850-875d-0b5a2287ad1e tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1516 microversion: 2.1 time: 0.153259 Oct 05 03:28:02.175368 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3486/6985] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:02 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:03.198337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-842dc0c1-21ef-4ce4-b25f-f3a6c2e48024 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:03.198947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-842dc0c1-21ef-4ce4-b25f-f3a6c2e48024 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:03.206732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-842dc0c1-21ef-4ce4-b25f-f3a6c2e48024 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:03.207222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-842dc0c1-21ef-4ce4-b25f-f3a6c2e48024 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:03.207656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-842dc0c1-21ef-4ce4-b25f-f3a6c2e48024 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:03.208346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-842dc0c1-21ef-4ce4-b25f-f3a6c2e48024 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:03.208797 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-842dc0c1-21ef-4ce4-b25f-f3a6c2e48024 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:03.209247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-842dc0c1-21ef-4ce4-b25f-f3a6c2e48024 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:03.345601 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-842dc0c1-21ef-4ce4-b25f-f3a6c2e48024 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:03.353843 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-842dc0c1-21ef-4ce4-b25f-f3a6c2e48024 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1516 microversion: 2.1 time: 0.159453 Oct 05 03:28:03.354415 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3500/6986] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:03 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:04.377761 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a8287b4a-2c18-42e6-999b-110b5e3199b4 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:04.378396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a8287b4a-2c18-42e6-999b-110b5e3199b4 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:04.386164 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8287b4a-2c18-42e6-999b-110b5e3199b4 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:04.386664 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8287b4a-2c18-42e6-999b-110b5e3199b4 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:04.387110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8287b4a-2c18-42e6-999b-110b5e3199b4 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:04.387806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8287b4a-2c18-42e6-999b-110b5e3199b4 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:04.388270 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8287b4a-2c18-42e6-999b-110b5e3199b4 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:04.388706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8287b4a-2c18-42e6-999b-110b5e3199b4 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:04.516977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a8287b4a-2c18-42e6-999b-110b5e3199b4 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:04.525582 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a8287b4a-2c18-42e6-999b-110b5e3199b4 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1516 microversion: 2.1 time: 0.151668 Oct 05 03:28:04.526195 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3487/6987] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:04 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:05.549660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8009c716-fd32-45d2-a5ae-c44120f1a3ba tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:05.550311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8009c716-fd32-45d2-a5ae-c44120f1a3ba tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:05.557744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8009c716-fd32-45d2-a5ae-c44120f1a3ba tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:05.558233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8009c716-fd32-45d2-a5ae-c44120f1a3ba tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:05.558669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8009c716-fd32-45d2-a5ae-c44120f1a3ba tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:05.559361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8009c716-fd32-45d2-a5ae-c44120f1a3ba tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:05.559816 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8009c716-fd32-45d2-a5ae-c44120f1a3ba tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:05.560242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8009c716-fd32-45d2-a5ae-c44120f1a3ba tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:05.699784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8009c716-fd32-45d2-a5ae-c44120f1a3ba tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:05.707499 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8009c716-fd32-45d2-a5ae-c44120f1a3ba tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1516 microversion: 2.1 time: 0.161757 Oct 05 03:28:05.708076 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3501/6988] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:05 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:06.733275 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-62787b13-8d4e-435f-a50b-238a53110729 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:06.733930 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-62787b13-8d4e-435f-a50b-238a53110729 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:06.740768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-62787b13-8d4e-435f-a50b-238a53110729 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:06.741299 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-62787b13-8d4e-435f-a50b-238a53110729 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:06.741751 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-62787b13-8d4e-435f-a50b-238a53110729 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:06.743025 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-62787b13-8d4e-435f-a50b-238a53110729 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:06.743500 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-62787b13-8d4e-435f-a50b-238a53110729 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:06.743936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-62787b13-8d4e-435f-a50b-238a53110729 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:06.874782 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-62787b13-8d4e-435f-a50b-238a53110729 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:06.882426 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-62787b13-8d4e-435f-a50b-238a53110729 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1516 microversion: 2.1 time: 0.155694 Oct 05 03:28:06.883790 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3488/6989] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:06 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:07.910946 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0a9a8889-d7c1-41ff-87c3-7f46e8739066 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:07.911555 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0a9a8889-d7c1-41ff-87c3-7f46e8739066 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:07.915041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=34 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:28:07.920411 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a9a8889-d7c1-41ff-87c3-7f46e8739066 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:07.920861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a9a8889-d7c1-41ff-87c3-7f46e8739066 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:07.921306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a9a8889-d7c1-41ff-87c3-7f46e8739066 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:07.921996 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a9a8889-d7c1-41ff-87c3-7f46e8739066 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:07.922448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a9a8889-d7c1-41ff-87c3-7f46e8739066 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:07.922870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a9a8889-d7c1-41ff-87c3-7f46e8739066 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:07.925641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:28:08.051781 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0a9a8889-d7c1-41ff-87c3-7f46e8739066 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:08.060217 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0a9a8889-d7c1-41ff-87c3-7f46e8739066 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1516 microversion: 2.1 time: 0.153185 Oct 05 03:28:08.060789 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3502/6990] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:07 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:09.083313 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a981222a-2e6f-44a6-bbe7-0acec9591661 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:09.083947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a981222a-2e6f-44a6-bbe7-0acec9591661 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:09.087574 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=30 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:28:09.092762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a981222a-2e6f-44a6-bbe7-0acec9591661 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:09.093300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a981222a-2e6f-44a6-bbe7-0acec9591661 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:09.093775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a981222a-2e6f-44a6-bbe7-0acec9591661 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:09.094473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a981222a-2e6f-44a6-bbe7-0acec9591661 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:09.094941 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a981222a-2e6f-44a6-bbe7-0acec9591661 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:09.095382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a981222a-2e6f-44a6-bbe7-0acec9591661 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:09.099478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=90 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:28:09.226049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a981222a-2e6f-44a6-bbe7-0acec9591661 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:09.234787 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a981222a-2e6f-44a6-bbe7-0acec9591661 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1516 microversion: 2.1 time: 0.155385 Oct 05 03:28:09.235362 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3489/6991] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:09 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:10.257995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-32485f72-5478-4e7e-a2a7-a258c5816922 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:10.258608 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-32485f72-5478-4e7e-a2a7-a258c5816922 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:10.264780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32485f72-5478-4e7e-a2a7-a258c5816922 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:10.265295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32485f72-5478-4e7e-a2a7-a258c5816922 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:10.265734 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32485f72-5478-4e7e-a2a7-a258c5816922 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:10.266421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32485f72-5478-4e7e-a2a7-a258c5816922 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:10.266874 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32485f72-5478-4e7e-a2a7-a258c5816922 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:10.267297 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32485f72-5478-4e7e-a2a7-a258c5816922 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:10.392967 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-32485f72-5478-4e7e-a2a7-a258c5816922 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:10.400670 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-32485f72-5478-4e7e-a2a7-a258c5816922 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1516 microversion: 2.1 time: 0.147089 Oct 05 03:28:10.401274 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3503/6992] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:10 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1516 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:11.423530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a71878a9-e743-47be-b4aa-9c4c3e6f77d3 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:11.424166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a71878a9-e743-47be-b4aa-9c4c3e6f77d3 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:11.431360 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a71878a9-e743-47be-b4aa-9c4c3e6f77d3 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:11.431862 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a71878a9-e743-47be-b4aa-9c4c3e6f77d3 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:11.432311 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a71878a9-e743-47be-b4aa-9c4c3e6f77d3 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:11.433037 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a71878a9-e743-47be-b4aa-9c4c3e6f77d3 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:11.433508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a71878a9-e743-47be-b4aa-9c4c3e6f77d3 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:11.433945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a71878a9-e743-47be-b4aa-9c4c3e6f77d3 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:11.559774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a71878a9-e743-47be-b4aa-9c4c3e6f77d3 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:11.567533 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a71878a9-e743-47be-b4aa-9c4c3e6f77d3 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1516 microversion: 2.1 time: 0.147881 Oct 05 03:28:11.568105 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3490/6993] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:11 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1516 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:12.591596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5c082773-ad88-470e-b465-c62ab4f3de5a tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:12.592215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5c082773-ad88-470e-b465-c62ab4f3de5a tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:12.599098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c082773-ad88-470e-b465-c62ab4f3de5a tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:12.599590 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c082773-ad88-470e-b465-c62ab4f3de5a tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:12.600031 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c082773-ad88-470e-b465-c62ab4f3de5a tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:12.600741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c082773-ad88-470e-b465-c62ab4f3de5a tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:12.601229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c082773-ad88-470e-b465-c62ab4f3de5a tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:12.601657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c082773-ad88-470e-b465-c62ab4f3de5a tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:12.850822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5c082773-ad88-470e-b465-c62ab4f3de5a tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:12.859138 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5c082773-ad88-470e-b465-c62ab4f3de5a tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1515 microversion: 2.1 time: 0.271390 Oct 05 03:28:12.859719 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3504/6994] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:12 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1515 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:12.971868 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-1896b08c-a65e-4cfd-ab36-3b54a9d535f1 req-88b2bf8e-19f5-4fd5-b1aa-6b85925f2a69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51eef65e-f229-4200-be66-9518f1c27f28", "name": "network-vif-unplugged", "status": "completed", "tag": "a89c28e3-30f6-4081-ac9f-b87e113fc1ad"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:28:12.984431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1896b08c-a65e-4cfd-ab36-3b54a9d535f1 req-88b2bf8e-19f5-4fd5-b1aa-6b85925f2a69 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:12.984803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1896b08c-a65e-4cfd-ab36-3b54a9d535f1 req-88b2bf8e-19f5-4fd5-b1aa-6b85925f2a69 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:12.985309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1896b08c-a65e-4cfd-ab36-3b54a9d535f1 req-88b2bf8e-19f5-4fd5-b1aa-6b85925f2a69 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:12.999373 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-1896b08c-a65e-4cfd-ab36-3b54a9d535f1 req-88b2bf8e-19f5-4fd5-b1aa-6b85925f2a69 service nova] Creating event network-vif-unplugged:a89c28e3-30f6-4081-ac9f-b87e113fc1ad for instance 51eef65e-f229-4200-be66-9518f1c27f28 on n-h1-858272-3 Oct 05 03:28:13.005206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [req-1896b08c-a65e-4cfd-ab36-3b54a9d535f1 req-88b2bf8e-19f5-4fd5-b1aa-6b85925f2a69 service nova] Instance 51eef65e-f229-4200-be66-9518f1c27f28 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 03:28:13.018838 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-1896b08c-a65e-4cfd-ab36-3b54a9d535f1 req-88b2bf8e-19f5-4fd5-b1aa-6b85925f2a69 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050881 Oct 05 03:28:13.019769 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3491/6995] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:28:13.884118 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3b017abd-a5f2-41b8-8494-e3b5e65e5415 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:13.884774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3b017abd-a5f2-41b8-8494-e3b5e65e5415 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:13.891780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3b017abd-a5f2-41b8-8494-e3b5e65e5415 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:13.892268 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3b017abd-a5f2-41b8-8494-e3b5e65e5415 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:13.892709 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3b017abd-a5f2-41b8-8494-e3b5e65e5415 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:13.893438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3b017abd-a5f2-41b8-8494-e3b5e65e5415 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:13.894009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3b017abd-a5f2-41b8-8494-e3b5e65e5415 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:13.894450 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3b017abd-a5f2-41b8-8494-e3b5e65e5415 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:14.106212 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3b017abd-a5f2-41b8-8494-e3b5e65e5415 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:14.114114 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3b017abd-a5f2-41b8-8494-e3b5e65e5415 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1515 microversion: 2.1 time: 0.234619 Oct 05 03:28:14.114693 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3505/6996] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:13 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1515 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:28:15.043173 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-dc6e9aac-3e00-4984-b7cb-9df9ca42b670 req-52bb5205-e958-4909-899c-61f7813c56f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51eef65e-f229-4200-be66-9518f1c27f28", "tag": "a89c28e3-30f6-4081-ac9f-b87e113fc1ad"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:28:15.052672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-dc6e9aac-3e00-4984-b7cb-9df9ca42b670 req-52bb5205-e958-4909-899c-61f7813c56f2 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:15.053210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-dc6e9aac-3e00-4984-b7cb-9df9ca42b670 req-52bb5205-e958-4909-899c-61f7813c56f2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:15.053648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-dc6e9aac-3e00-4984-b7cb-9df9ca42b670 req-52bb5205-e958-4909-899c-61f7813c56f2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:15.064876 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-dc6e9aac-3e00-4984-b7cb-9df9ca42b670 req-52bb5205-e958-4909-899c-61f7813c56f2 service nova] Creating event network-changed:a89c28e3-30f6-4081-ac9f-b87e113fc1ad for instance 51eef65e-f229-4200-be66-9518f1c27f28 on n-h1-858272-3 Oct 05 03:28:15.070076 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [req-dc6e9aac-3e00-4984-b7cb-9df9ca42b670 req-52bb5205-e958-4909-899c-61f7813c56f2 service nova] Instance 51eef65e-f229-4200-be66-9518f1c27f28 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 03:28:15.080570 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-dc6e9aac-3e00-4984-b7cb-9df9ca42b670 req-52bb5205-e958-4909-899c-61f7813c56f2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043130 Oct 05 03:28:15.081198 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3492/6997] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:28:15.138047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2969ca44-44de-4de0-ba48-9bca5e91e100 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:15.138695 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2969ca44-44de-4de0-ba48-9bca5e91e100 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:15.146067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2969ca44-44de-4de0-ba48-9bca5e91e100 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:15.146653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2969ca44-44de-4de0-ba48-9bca5e91e100 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:15.147098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2969ca44-44de-4de0-ba48-9bca5e91e100 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:15.147809 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2969ca44-44de-4de0-ba48-9bca5e91e100 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:15.148275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2969ca44-44de-4de0-ba48-9bca5e91e100 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:15.148706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2969ca44-44de-4de0-ba48-9bca5e91e100 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:15.286809 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2969ca44-44de-4de0-ba48-9bca5e91e100 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:15.295852 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2969ca44-44de-4de0-ba48-9bca5e91e100 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1513 microversion: 2.1 time: 0.161747 Oct 05 03:28:15.296741 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3506/6998] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:15 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:16.322946 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-87e5f88c-96a5-4e42-b712-9519c40a1d7f tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:16.324046 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-87e5f88c-96a5-4e42-b712-9519c40a1d7f tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:16.333102 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-87e5f88c-96a5-4e42-b712-9519c40a1d7f tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:16.333898 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-87e5f88c-96a5-4e42-b712-9519c40a1d7f tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:16.334583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-87e5f88c-96a5-4e42-b712-9519c40a1d7f tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:16.335653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-87e5f88c-96a5-4e42-b712-9519c40a1d7f tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:16.336383 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-87e5f88c-96a5-4e42-b712-9519c40a1d7f tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:16.337095 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-87e5f88c-96a5-4e42-b712-9519c40a1d7f tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:16.470707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-87e5f88c-96a5-4e42-b712-9519c40a1d7f tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:16.479305 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-87e5f88c-96a5-4e42-b712-9519c40a1d7f tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1513 microversion: 2.1 time: 0.163400 Oct 05 03:28:16.479884 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3493/6999] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:16 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:17.502253 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8deecf6c-5eb5-407e-8f9b-249568505c1b tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:17.502788 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8deecf6c-5eb5-407e-8f9b-249568505c1b tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:17.509723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8deecf6c-5eb5-407e-8f9b-249568505c1b tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:17.510215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8deecf6c-5eb5-407e-8f9b-249568505c1b tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:17.510653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8deecf6c-5eb5-407e-8f9b-249568505c1b tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:17.511348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8deecf6c-5eb5-407e-8f9b-249568505c1b tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:17.511805 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8deecf6c-5eb5-407e-8f9b-249568505c1b tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:17.512232 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8deecf6c-5eb5-407e-8f9b-249568505c1b tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:17.645160 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8deecf6c-5eb5-407e-8f9b-249568505c1b tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:17.654043 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8deecf6c-5eb5-407e-8f9b-249568505c1b tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1510 microversion: 2.1 time: 0.155715 Oct 05 03:28:17.654631 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3507/7000] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:17 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:17.676637 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b78e9fc5-8d94-44a6-b55e-b83d94abc5f2 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:17.677176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b78e9fc5-8d94-44a6-b55e-b83d94abc5f2 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:17.683585 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b78e9fc5-8d94-44a6-b55e-b83d94abc5f2 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:17.684094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b78e9fc5-8d94-44a6-b55e-b83d94abc5f2 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:17.684547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b78e9fc5-8d94-44a6-b55e-b83d94abc5f2 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:17.685283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b78e9fc5-8d94-44a6-b55e-b83d94abc5f2 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:17.685758 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b78e9fc5-8d94-44a6-b55e-b83d94abc5f2 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:17.686200 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b78e9fc5-8d94-44a6-b55e-b83d94abc5f2 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:17.720539 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b78e9fc5-8d94-44a6-b55e-b83d94abc5f2 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:28:17.780022 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.compute.api [None req-b78e9fc5-8d94-44a6-b55e-b83d94abc5f2 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Found an unconfirmed migration during delete, id: 16, status: finished Oct 05 03:28:19.342132 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b78e9fc5-8d94-44a6-b55e-b83d94abc5f2 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "DELETE /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 204 len: 0 microversion: 2.1 time: 1.669478 Oct 05 03:28:19.342874 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3494/7001] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:28:17 2022] DELETE /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 0 bytes in 1671 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:28:19.353424 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-14cb3580-f22b-44c7-9f33-b464e5c1d1cc tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:19.354064 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-14cb3580-f22b-44c7-9f33-b464e5c1d1cc tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:19.361302 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-14cb3580-f22b-44c7-9f33-b464e5c1d1cc tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:19.361784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-14cb3580-f22b-44c7-9f33-b464e5c1d1cc tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:19.362215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-14cb3580-f22b-44c7-9f33-b464e5c1d1cc tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:19.362897 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-14cb3580-f22b-44c7-9f33-b464e5c1d1cc tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:19.363346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-14cb3580-f22b-44c7-9f33-b464e5c1d1cc tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:19.363766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-14cb3580-f22b-44c7-9f33-b464e5c1d1cc tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:19.496330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-14cb3580-f22b-44c7-9f33-b464e5c1d1cc tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:19.504180 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-14cb3580-f22b-44c7-9f33-b464e5c1d1cc tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1502 microversion: 2.1 time: 0.156098 Oct 05 03:28:19.504764 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3508/7002] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:19 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:20.529533 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-253a921c-a6ee-4bef-9d7d-b2cb936a6931 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:20.530391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-253a921c-a6ee-4bef-9d7d-b2cb936a6931 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:20.537381 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-253a921c-a6ee-4bef-9d7d-b2cb936a6931 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:20.537915 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-253a921c-a6ee-4bef-9d7d-b2cb936a6931 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:20.538349 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-253a921c-a6ee-4bef-9d7d-b2cb936a6931 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:20.539075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-253a921c-a6ee-4bef-9d7d-b2cb936a6931 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:20.540638 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-253a921c-a6ee-4bef-9d7d-b2cb936a6931 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:20.541160 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-253a921c-a6ee-4bef-9d7d-b2cb936a6931 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:20.642932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-5a5c3be2-1916-465c-8adb-355afb9fa7c6 req-cc34c5f5-7c6b-4fbf-b063-a1805467a061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51eef65e-f229-4200-be66-9518f1c27f28", "name": "network-vif-plugged", "status": "completed", "tag": "a89c28e3-30f6-4081-ac9f-b87e113fc1ad"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:28:20.665696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5a5c3be2-1916-465c-8adb-355afb9fa7c6 req-cc34c5f5-7c6b-4fbf-b063-a1805467a061 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:20.666476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5a5c3be2-1916-465c-8adb-355afb9fa7c6 req-cc34c5f5-7c6b-4fbf-b063-a1805467a061 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:20.667141 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5a5c3be2-1916-465c-8adb-355afb9fa7c6 req-cc34c5f5-7c6b-4fbf-b063-a1805467a061 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:20.679573 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-5a5c3be2-1916-465c-8adb-355afb9fa7c6 req-cc34c5f5-7c6b-4fbf-b063-a1805467a061 service nova] Creating event network-vif-plugged:a89c28e3-30f6-4081-ac9f-b87e113fc1ad for instance 51eef65e-f229-4200-be66-9518f1c27f28 on n-h1-858272-3 Oct 05 03:28:20.685335 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-5a5c3be2-1916-465c-8adb-355afb9fa7c6 req-cc34c5f5-7c6b-4fbf-b063-a1805467a061 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049098 Oct 05 03:28:20.685954 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3509/7003] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:28:20.714284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-253a921c-a6ee-4bef-9d7d-b2cb936a6931 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8992b0e6086d49f29a831c6fb498dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbe394870c44ea89d4af55ef70552b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:20.732918 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-253a921c-a6ee-4bef-9d7d-b2cb936a6931 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 200 len: 1502 microversion: 2.1 time: 0.208861 Oct 05 03:28:20.733521 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3495/7004] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:20 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 1502 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:21.381812 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-8ce1d825-4baa-4c83-93c8-218c608b0559 req-9b49e813-6af2-424d-8474-b0383247ca30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51eef65e-f229-4200-be66-9518f1c27f28", "name": "network-vif-deleted", "tag": "a89c28e3-30f6-4081-ac9f-b87e113fc1ad"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:28:21.393305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-8ce1d825-4baa-4c83-93c8-218c608b0559 req-9b49e813-6af2-424d-8474-b0383247ca30 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:21.393793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-8ce1d825-4baa-4c83-93c8-218c608b0559 req-9b49e813-6af2-424d-8474-b0383247ca30 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:21.394226 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-8ce1d825-4baa-4c83-93c8-218c608b0559 req-9b49e813-6af2-424d-8474-b0383247ca30 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:21.407082 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-8ce1d825-4baa-4c83-93c8-218c608b0559 req-9b49e813-6af2-424d-8474-b0383247ca30 service nova] Creating event network-vif-deleted:a89c28e3-30f6-4081-ac9f-b87e113fc1ad for instance 51eef65e-f229-4200-be66-9518f1c27f28 on n-h1-858272-3 Oct 05 03:28:21.412271 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-8ce1d825-4baa-4c83-93c8-218c608b0559 req-9b49e813-6af2-424d-8474-b0383247ca30 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034302 Oct 05 03:28:21.412808 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3510/7005] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:28:21.759794 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7457d00f-f6e9-48ca-aba8-d2bff208361d tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:21.760461 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7457d00f-f6e9-48ca-aba8-d2bff208361d tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:21.767331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7457d00f-f6e9-48ca-aba8-d2bff208361d tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:21.767806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7457d00f-f6e9-48ca-aba8-d2bff208361d tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:21.768248 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7457d00f-f6e9-48ca-aba8-d2bff208361d tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:21.768955 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7457d00f-f6e9-48ca-aba8-d2bff208361d tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:21.769422 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7457d00f-f6e9-48ca-aba8-d2bff208361d tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:21.769854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7457d00f-f6e9-48ca-aba8-d2bff208361d tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:21.783740 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-7457d00f-f6e9-48ca-aba8-d2bff208361d tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] HTTP exception thrown: Instance 51eef65e-f229-4200-be66-9518f1c27f28 could not be found. Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7457d00f-f6e9-48ca-aba8-d2bff208361d tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Request method failure captured: Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 HTTP/1.1 Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPmhrzfq4O7CP7v6HdhIIeWF8J_A_ecitPPDZ7i6XivG-Fcl1eOXOxaL_SJihB_LFvwdECE7-b_6rNtW4HCRP6lK-2abIhYNH1iM_vJHhca2DagDWLFrTR_Yr_ndhY5vc6XT2z0c2IQ6o0QC5MPnxkveffVVfMHJbq_iOgINF4WjFWI Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 7dbe394870c44ea89d4af55ef70552b9 Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-DeleteServersTestJSON-356605240 Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7dbe394870c44ea89d4af55ef70552b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7dbe394870c44ea89d4af55ef70552b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7dbe394870c44ea89d4af55ef70552b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7dbe394870c44ea89d4af55ef70552b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-DeleteServersTestJSON-356605240 Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 7dbe394870c44ea89d4af55ef70552b9 Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-DeleteServersTestJSON-356605240 Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-DeleteServersTestJSON-356605240-project Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 8992b0e6086d49f29a831c6fb498dcbe Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-DeleteServersTestJSON-356605240-project Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 51eef65e-f229-4200-be66-9518f1c27f28 could not be found. Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '51eef65e-f229-4200-be66-9518f1c27f28'} Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51eef65e-f229-4200-be66-9518f1c27f28 could not be found. Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51eef65e-f229-4200-be66-9518f1c27f28 could not be found. Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:28:21.785390 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:28:21.791015 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:28:21.791015 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:28:21.791015 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:28:21.791015 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:28:21.791015 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:28:21.791015 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51eef65e-f229-4200-be66-9518f1c27f28 could not be found. Oct 05 03:28:21.791015 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:28:21.791015 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7457d00f-f6e9-48ca-aba8-d2bff208361d tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Returning 404 to user: Instance 51eef65e-f229-4200-be66-9518f1c27f28 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:28:21.791015 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7457d00f-f6e9-48ca-aba8-d2bff208361d tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 404 len: 111 microversion: 2.1 time: 0.031128 Oct 05 03:28:21.791015 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3496/7006] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:21 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:28:21.802755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d06b40af-e264-425e-b662-ec7d23179576 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:21.803992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d06b40af-e264-425e-b662-ec7d23179576 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:21.810920 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d06b40af-e264-425e-b662-ec7d23179576 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:21.811581 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d06b40af-e264-425e-b662-ec7d23179576 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:21.812137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d06b40af-e264-425e-b662-ec7d23179576 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:21.812842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d06b40af-e264-425e-b662-ec7d23179576 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:21.813356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d06b40af-e264-425e-b662-ec7d23179576 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:21.813806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d06b40af-e264-425e-b662-ec7d23179576 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:21.827731 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-d06b40af-e264-425e-b662-ec7d23179576 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] HTTP exception thrown: Instance 51eef65e-f229-4200-be66-9518f1c27f28 could not be found. Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d06b40af-e264-425e-b662-ec7d23179576 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Request method failure captured: Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 HTTP/1.1 Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPmhrzfq4O7CP7v6HdhIIeWF8J_A_ecitPPDZ7i6XivG-Fcl1eOXOxaL_SJihB_LFvwdECE7-b_6rNtW4HCRP6lK-2abIhYNH1iM_vJHhca2DagDWLFrTR_Yr_ndhY5vc6XT2z0c2IQ6o0QC5MPnxkveffVVfMHJbq_iOgINF4WjFWI Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 7dbe394870c44ea89d4af55ef70552b9 Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-DeleteServersTestJSON-356605240 Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7dbe394870c44ea89d4af55ef70552b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7dbe394870c44ea89d4af55ef70552b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7dbe394870c44ea89d4af55ef70552b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7dbe394870c44ea89d4af55ef70552b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-DeleteServersTestJSON-356605240 Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 7dbe394870c44ea89d4af55ef70552b9 Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-DeleteServersTestJSON-356605240 Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-DeleteServersTestJSON-356605240-project Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 8992b0e6086d49f29a831c6fb498dcbe Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-DeleteServersTestJSON-356605240-project Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 51eef65e-f229-4200-be66-9518f1c27f28 could not be found. Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '51eef65e-f229-4200-be66-9518f1c27f28'} Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51eef65e-f229-4200-be66-9518f1c27f28 could not be found. Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:28:21.829386 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:28:21.833840 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51eef65e-f229-4200-be66-9518f1c27f28 could not be found. Oct 05 03:28:21.833840 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:28:21.833840 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:28:21.833840 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:28:21.833840 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:28:21.833840 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:28:21.833840 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:28:21.833840 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:28:21.833840 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:28:21.833840 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51eef65e-f229-4200-be66-9518f1c27f28 could not be found. Oct 05 03:28:21.833840 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:28:21.833840 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d06b40af-e264-425e-b662-ec7d23179576 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Returning 404 to user: Instance 51eef65e-f229-4200-be66-9518f1c27f28 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:28:21.833840 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d06b40af-e264-425e-b662-ec7d23179576 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "DELETE /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 404 len: 111 microversion: 2.1 time: 0.033644 Oct 05 03:28:21.833840 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3511/7007] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:28:21 2022] DELETE /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:28:21.840131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-11422458-1cd3-4360-8aa2-a623884a21f1 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:21.840781 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-11422458-1cd3-4360-8aa2-a623884a21f1 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] [instance: 51eef65e-f229-4200-be66-9518f1c27f28] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:21.846768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11422458-1cd3-4360-8aa2-a623884a21f1 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:21.847258 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11422458-1cd3-4360-8aa2-a623884a21f1 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:21.847701 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11422458-1cd3-4360-8aa2-a623884a21f1 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:21.848393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11422458-1cd3-4360-8aa2-a623884a21f1 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:21.848859 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11422458-1cd3-4360-8aa2-a623884a21f1 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:21.849320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-11422458-1cd3-4360-8aa2-a623884a21f1 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:21.863313 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-11422458-1cd3-4360-8aa2-a623884a21f1 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] HTTP exception thrown: Instance 51eef65e-f229-4200-be66-9518f1c27f28 could not be found. Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-11422458-1cd3-4360-8aa2-a623884a21f1 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Request method failure captured: Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 HTTP/1.1 Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPmhrzfq4O7CP7v6HdhIIeWF8J_A_ecitPPDZ7i6XivG-Fcl1eOXOxaL_SJihB_LFvwdECE7-b_6rNtW4HCRP6lK-2abIhYNH1iM_vJHhca2DagDWLFrTR_Yr_ndhY5vc6XT2z0c2IQ6o0QC5MPnxkveffVVfMHJbq_iOgINF4WjFWI Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 7dbe394870c44ea89d4af55ef70552b9 Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-DeleteServersTestJSON-356605240 Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7dbe394870c44ea89d4af55ef70552b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7dbe394870c44ea89d4af55ef70552b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7dbe394870c44ea89d4af55ef70552b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7dbe394870c44ea89d4af55ef70552b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-DeleteServersTestJSON-356605240 Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 7dbe394870c44ea89d4af55ef70552b9 Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-DeleteServersTestJSON-356605240 Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-DeleteServersTestJSON-356605240-project Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 8992b0e6086d49f29a831c6fb498dcbe Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-DeleteServersTestJSON-356605240-project Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 51eef65e-f229-4200-be66-9518f1c27f28 could not be found. Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '51eef65e-f229-4200-be66-9518f1c27f28'} Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51eef65e-f229-4200-be66-9518f1c27f28 could not be found. Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51eef65e-f229-4200-be66-9518f1c27f28 could not be found. Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:28:21.864946 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:28:21.869248 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:28:21.869248 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:28:21.869248 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:28:21.869248 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:28:21.869248 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:28:21.869248 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51eef65e-f229-4200-be66-9518f1c27f28 could not be found. Oct 05 03:28:21.869248 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:28:21.869248 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-11422458-1cd3-4360-8aa2-a623884a21f1 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] Returning 404 to user: Instance 51eef65e-f229-4200-be66-9518f1c27f28 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:28:21.869248 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-11422458-1cd3-4360-8aa2-a623884a21f1 tempest-DeleteServersTestJSON-356605240 tempest-DeleteServersTestJSON-356605240-project] 10.222.0.16 "GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28" status: 404 len: 111 microversion: 2.1 time: 0.030728 Oct 05 03:28:21.869248 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3497/7008] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:21 2022] GET /compute/v2.1/servers/51eef65e-f229-4200-be66-9518f1c27f28 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:28:30.124636 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-99a4ed78-2945-43f3-8721-dc91bf6f478f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-410882558", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "9982c4b1-8b0e-4239-8af9-b26786966df4"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:28:30.183227 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-99a4ed78-2945-43f3-8721-dc91bf6f478f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] validate_networks() for [('9982c4b1-8b0e-4239-8af9-b26786966df4', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:28:30.577131 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-99a4ed78-2945-43f3-8721-dc91bf6f478f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:28:30.577495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-99a4ed78-2945-43f3-8721-dc91bf6f478f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:28:30.577992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-99a4ed78-2945-43f3-8721-dc91bf6f478f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:28:30.578399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-99a4ed78-2945-43f3-8721-dc91bf6f478f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:28:30.578808 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-99a4ed78-2945-43f3-8721-dc91bf6f478f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:28:30.588699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99a4ed78-2945-43f3-8721-dc91bf6f478f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:30.589244 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99a4ed78-2945-43f3-8721-dc91bf6f478f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:30.589718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99a4ed78-2945-43f3-8721-dc91bf6f478f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:30.590455 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99a4ed78-2945-43f3-8721-dc91bf6f478f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:30.590926 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99a4ed78-2945-43f3-8721-dc91bf6f478f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:30.591356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99a4ed78-2945-43f3-8721-dc91bf6f478f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:30.611153 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-99a4ed78-2945-43f3-8721-dc91bf6f478f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Getting quotas for project 1ac0643217d0435887d49994cd7620e4. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:28:30.616601 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-99a4ed78-2945-43f3-8721-dc91bf6f478f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Getting quotas for user 4e9ae5054256463d8c9b1a0b8f627283 and project 1ac0643217d0435887d49994cd7620e4. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:28:30.630476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-99a4ed78-2945-43f3-8721-dc91bf6f478f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:28:30.632807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-99a4ed78-2945-43f3-8721-dc91bf6f478f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:28:30.685386 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-99a4ed78-2945-43f3-8721-dc91bf6f478f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.680166 Oct 05 03:28:30.686378 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3512/7009] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:28:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:28:30.697553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d504aa8d-3a83-4a2b-8d1a-09b066039976 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:30.698189 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d504aa8d-3a83-4a2b-8d1a-09b066039976 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:30.777381 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d504aa8d-3a83-4a2b-8d1a-09b066039976 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:30.786102 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d504aa8d-3a83-4a2b-8d1a-09b066039976 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1217 microversion: 2.1 time: 0.092455 Oct 05 03:28:30.786849 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3498/7010] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:30 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:31.816235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7b01824b-09df-4962-b85e-3f7a2c6e8dd6 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:31.816861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7b01824b-09df-4962-b85e-3f7a2c6e8dd6 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:31.825894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b01824b-09df-4962-b85e-3f7a2c6e8dd6 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:31.827020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b01824b-09df-4962-b85e-3f7a2c6e8dd6 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:31.827636 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b01824b-09df-4962-b85e-3f7a2c6e8dd6 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:31.828526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b01824b-09df-4962-b85e-3f7a2c6e8dd6 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:31.829004 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b01824b-09df-4962-b85e-3f7a2c6e8dd6 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:31.829433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b01824b-09df-4962-b85e-3f7a2c6e8dd6 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:31.940332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7b01824b-09df-4962-b85e-3f7a2c6e8dd6 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:31.950406 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7b01824b-09df-4962-b85e-3f7a2c6e8dd6 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1277 microversion: 2.1 time: 0.140103 Oct 05 03:28:31.950991 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3513/7011] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:31 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1277 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:28:32.975960 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d82c6c96-135c-4949-b7ba-c6139a9972b4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:32.977861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d82c6c96-135c-4949-b7ba-c6139a9972b4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:32.983996 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:28:32.987742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d82c6c96-135c-4949-b7ba-c6139a9972b4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:32.988245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d82c6c96-135c-4949-b7ba-c6139a9972b4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:32.988893 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d82c6c96-135c-4949-b7ba-c6139a9972b4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:32.989672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d82c6c96-135c-4949-b7ba-c6139a9972b4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:32.990148 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d82c6c96-135c-4949-b7ba-c6139a9972b4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:32.990588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d82c6c96-135c-4949-b7ba-c6139a9972b4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:33.219811 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d82c6c96-135c-4949-b7ba-c6139a9972b4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:33.229030 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d82c6c96-135c-4949-b7ba-c6139a9972b4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1317 microversion: 2.1 time: 0.257535 Oct 05 03:28:33.230173 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3499/7012] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:32 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:33.820293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-a239a89d-52b8-4094-8926-b819173655d1 req-a1d2d8e2-5e20-46e2-8332-eea2ec95fb54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ca51737-c661-4544-83ef-7733bc65a968", "tag": "8ea49264-041b-4718-b9ed-2837fec522b7"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:28:33.841283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a239a89d-52b8-4094-8926-b819173655d1 req-a1d2d8e2-5e20-46e2-8332-eea2ec95fb54 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:33.841776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a239a89d-52b8-4094-8926-b819173655d1 req-a1d2d8e2-5e20-46e2-8332-eea2ec95fb54 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:33.842205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a239a89d-52b8-4094-8926-b819173655d1 req-a1d2d8e2-5e20-46e2-8332-eea2ec95fb54 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:33.856616 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-a239a89d-52b8-4094-8926-b819173655d1 req-a1d2d8e2-5e20-46e2-8332-eea2ec95fb54 service nova] Creating event network-changed:8ea49264-041b-4718-b9ed-2837fec522b7 for instance 3ca51737-c661-4544-83ef-7733bc65a968 on n-h1-858272-3 Oct 05 03:28:33.864605 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-a239a89d-52b8-4094-8926-b819173655d1 req-a1d2d8e2-5e20-46e2-8332-eea2ec95fb54 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048126 Oct 05 03:28:33.865625 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3514/7013] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:28:34.254222 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-deb23d1f-d7ed-4d44-874d-ca9d14a6519e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:34.255431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-deb23d1f-d7ed-4d44-874d-ca9d14a6519e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:34.263548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-deb23d1f-d7ed-4d44-874d-ca9d14a6519e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:34.264318 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-deb23d1f-d7ed-4d44-874d-ca9d14a6519e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:34.265063 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-deb23d1f-d7ed-4d44-874d-ca9d14a6519e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:34.265939 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-deb23d1f-d7ed-4d44-874d-ca9d14a6519e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:34.266661 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-deb23d1f-d7ed-4d44-874d-ca9d14a6519e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:34.267098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-deb23d1f-d7ed-4d44-874d-ca9d14a6519e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:34.409407 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-deb23d1f-d7ed-4d44-874d-ca9d14a6519e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:34.417165 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-deb23d1f-d7ed-4d44-874d-ca9d14a6519e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1317 microversion: 2.1 time: 0.167164 Oct 05 03:28:34.417752 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3500/7014] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:34 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:35.441083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-54644351-d1fe-4868-8d3d-382109e7b9b4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:35.441746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-54644351-d1fe-4868-8d3d-382109e7b9b4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:35.448306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-54644351-d1fe-4868-8d3d-382109e7b9b4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:35.448803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-54644351-d1fe-4868-8d3d-382109e7b9b4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:35.449363 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-54644351-d1fe-4868-8d3d-382109e7b9b4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:35.450076 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-54644351-d1fe-4868-8d3d-382109e7b9b4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:35.450538 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-54644351-d1fe-4868-8d3d-382109e7b9b4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:35.450969 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-54644351-d1fe-4868-8d3d-382109e7b9b4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:35.581483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-54644351-d1fe-4868-8d3d-382109e7b9b4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:35.590015 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-54644351-d1fe-4868-8d3d-382109e7b9b4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1317 microversion: 2.1 time: 0.154140 Oct 05 03:28:35.590583 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3515/7015] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:35 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:36.613044 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9073cd14-ac14-4abc-9177-628d418ae1be tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:36.613759 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9073cd14-ac14-4abc-9177-628d418ae1be tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:36.621301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9073cd14-ac14-4abc-9177-628d418ae1be tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:36.621804 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9073cd14-ac14-4abc-9177-628d418ae1be tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:36.622250 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9073cd14-ac14-4abc-9177-628d418ae1be tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:36.622952 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9073cd14-ac14-4abc-9177-628d418ae1be tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:36.623415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9073cd14-ac14-4abc-9177-628d418ae1be tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:36.623850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9073cd14-ac14-4abc-9177-628d418ae1be tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:36.801264 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9073cd14-ac14-4abc-9177-628d418ae1be tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:36.809570 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9073cd14-ac14-4abc-9177-628d418ae1be tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1317 microversion: 2.1 time: 0.200380 Oct 05 03:28:36.810151 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3501/7016] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:36 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:37.834025 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-79aa0eb5-fe6c-48b8-8d40-98eee36a638a tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:37.834574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-79aa0eb5-fe6c-48b8-8d40-98eee36a638a tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:37.841522 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79aa0eb5-fe6c-48b8-8d40-98eee36a638a tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:37.842010 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79aa0eb5-fe6c-48b8-8d40-98eee36a638a tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:37.842448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79aa0eb5-fe6c-48b8-8d40-98eee36a638a tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:37.843131 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79aa0eb5-fe6c-48b8-8d40-98eee36a638a tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:37.843642 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79aa0eb5-fe6c-48b8-8d40-98eee36a638a tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:37.844069 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79aa0eb5-fe6c-48b8-8d40-98eee36a638a tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:37.984526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-79aa0eb5-fe6c-48b8-8d40-98eee36a638a tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:37.986926 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=68 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:28:37.994615 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-79aa0eb5-fe6c-48b8-8d40-98eee36a638a tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1317 microversion: 2.1 time: 0.164514 Oct 05 03:28:37.995234 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3516/7017] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:37 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:39.017244 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c1b03c77-9c33-4e76-8529-ae9c048fadda tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:39.017877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c1b03c77-9c33-4e76-8529-ae9c048fadda tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:39.025298 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1b03c77-9c33-4e76-8529-ae9c048fadda tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:39.025825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1b03c77-9c33-4e76-8529-ae9c048fadda tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:39.026274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1b03c77-9c33-4e76-8529-ae9c048fadda tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:39.026982 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1b03c77-9c33-4e76-8529-ae9c048fadda tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:39.027450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1b03c77-9c33-4e76-8529-ae9c048fadda tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:39.027889 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c1b03c77-9c33-4e76-8529-ae9c048fadda tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:39.161883 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c1b03c77-9c33-4e76-8529-ae9c048fadda tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:39.170593 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c1b03c77-9c33-4e76-8529-ae9c048fadda tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1317 microversion: 2.1 time: 0.157321 Oct 05 03:28:39.171175 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3502/7018] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:39 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:40.195107 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dc479b28-10b0-40a3-9e8e-df52b4a5757f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:40.195722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-dc479b28-10b0-40a3-9e8e-df52b4a5757f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:40.198568 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:28:40.203936 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc479b28-10b0-40a3-9e8e-df52b4a5757f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:40.204419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc479b28-10b0-40a3-9e8e-df52b4a5757f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:40.204852 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc479b28-10b0-40a3-9e8e-df52b4a5757f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:40.205562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc479b28-10b0-40a3-9e8e-df52b4a5757f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:40.206012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc479b28-10b0-40a3-9e8e-df52b4a5757f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:40.206433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dc479b28-10b0-40a3-9e8e-df52b4a5757f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:40.336194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-dc479b28-10b0-40a3-9e8e-df52b4a5757f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:40.344627 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-dc479b28-10b0-40a3-9e8e-df52b4a5757f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1317 microversion: 2.1 time: 0.153418 Oct 05 03:28:40.345245 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3517/7019] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:40 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:40.697958 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-168b6c18-b437-4806-8c6a-0e8b8b8c0134 req-cea19c82-0fa9-4751-8e25-cb15502d7270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ca51737-c661-4544-83ef-7733bc65a968", "name": "network-vif-plugged", "status": "completed", "tag": "8ea49264-041b-4718-b9ed-2837fec522b7"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:28:40.703830 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:28:40.709807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-168b6c18-b437-4806-8c6a-0e8b8b8c0134 req-cea19c82-0fa9-4751-8e25-cb15502d7270 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:40.710320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-168b6c18-b437-4806-8c6a-0e8b8b8c0134 req-cea19c82-0fa9-4751-8e25-cb15502d7270 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:40.710766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-168b6c18-b437-4806-8c6a-0e8b8b8c0134 req-cea19c82-0fa9-4751-8e25-cb15502d7270 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:40.723295 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-168b6c18-b437-4806-8c6a-0e8b8b8c0134 req-cea19c82-0fa9-4751-8e25-cb15502d7270 service nova] Creating event network-vif-plugged:8ea49264-041b-4718-b9ed-2837fec522b7 for instance 3ca51737-c661-4544-83ef-7733bc65a968 on n-h1-858272-3 Oct 05 03:28:40.728731 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-168b6c18-b437-4806-8c6a-0e8b8b8c0134 req-cea19c82-0fa9-4751-8e25-cb15502d7270 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035247 Oct 05 03:28:40.729379 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3503/7020] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:28:41.367716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8b67274b-8bd8-49a4-ad6f-495c928aadc0 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:41.368832 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8b67274b-8bd8-49a4-ad6f-495c928aadc0 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:41.370779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:28:41.371680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:28:41.378488 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b67274b-8bd8-49a4-ad6f-495c928aadc0 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:41.378989 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b67274b-8bd8-49a4-ad6f-495c928aadc0 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:41.379432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b67274b-8bd8-49a4-ad6f-495c928aadc0 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:41.380142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b67274b-8bd8-49a4-ad6f-495c928aadc0 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:41.380601 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b67274b-8bd8-49a4-ad6f-495c928aadc0 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:41.381052 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b67274b-8bd8-49a4-ad6f-495c928aadc0 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:41.517335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8b67274b-8bd8-49a4-ad6f-495c928aadc0 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:41.525585 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8b67274b-8bd8-49a4-ad6f-495c928aadc0 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1317 microversion: 2.1 time: 0.161750 Oct 05 03:28:41.526169 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3518/7021] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:41 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:42.546579 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:28:42.551973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-54918359-53fa-4c30-90f2-bb06b4decd36 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:42.552743 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-54918359-53fa-4c30-90f2-bb06b4decd36 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:42.560363 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54918359-53fa-4c30-90f2-bb06b4decd36 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:42.560862 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54918359-53fa-4c30-90f2-bb06b4decd36 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:42.561337 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54918359-53fa-4c30-90f2-bb06b4decd36 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:42.562030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54918359-53fa-4c30-90f2-bb06b4decd36 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:42.562495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54918359-53fa-4c30-90f2-bb06b4decd36 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:42.562926 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54918359-53fa-4c30-90f2-bb06b4decd36 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:42.691213 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-54918359-53fa-4c30-90f2-bb06b4decd36 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:42.699060 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-54918359-53fa-4c30-90f2-bb06b4decd36 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1506 microversion: 2.1 time: 0.153465 Oct 05 03:28:42.699637 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3504/7022] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:42 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:42.721510 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4caefa25-56c2-4ad5-827c-110cb1bf92ca tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:42.722145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4caefa25-56c2-4ad5-827c-110cb1bf92ca tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:42.729819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4caefa25-56c2-4ad5-827c-110cb1bf92ca tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:42.730305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4caefa25-56c2-4ad5-827c-110cb1bf92ca tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:42.730737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4caefa25-56c2-4ad5-827c-110cb1bf92ca tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:42.731427 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4caefa25-56c2-4ad5-827c-110cb1bf92ca tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:42.731878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4caefa25-56c2-4ad5-827c-110cb1bf92ca tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:42.732301 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4caefa25-56c2-4ad5-827c-110cb1bf92ca tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:42.872324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4caefa25-56c2-4ad5-827c-110cb1bf92ca tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:42.880483 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4caefa25-56c2-4ad5-827c-110cb1bf92ca tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1506 microversion: 2.1 time: 0.162887 Oct 05 03:28:42.881102 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3519/7023] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:42 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:42.903712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-00a5b829-ca77-405f-b7da-d5b58ab97197 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:28:42.906243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-00a5b829-ca77-405f-b7da-d5b58ab97197 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:42.912213 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-00a5b829-ca77-405f-b7da-d5b58ab97197 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:42.912710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-00a5b829-ca77-405f-b7da-d5b58ab97197 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:42.913199 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-00a5b829-ca77-405f-b7da-d5b58ab97197 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:42.913901 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-00a5b829-ca77-405f-b7da-d5b58ab97197 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:42.914373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-00a5b829-ca77-405f-b7da-d5b58ab97197 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:42.914811 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-00a5b829-ca77-405f-b7da-d5b58ab97197 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:42.976768 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-00a5b829-ca77-405f-b7da-d5b58ab97197 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "PUT /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1078 microversion: 2.1 time: 0.077656 Oct 05 03:28:42.978533 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3505/7024] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Oct 5 03:28:42 2022] PUT /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1078 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:42.996838 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-711c47f4-54ba-4993-88aa-9130faff6962 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:42.997478 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-711c47f4-54ba-4993-88aa-9130faff6962 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:43.003407 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-711c47f4-54ba-4993-88aa-9130faff6962 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:43.003905 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-711c47f4-54ba-4993-88aa-9130faff6962 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:43.004325 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-711c47f4-54ba-4993-88aa-9130faff6962 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:43.005029 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-711c47f4-54ba-4993-88aa-9130faff6962 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:43.005486 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-711c47f4-54ba-4993-88aa-9130faff6962 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:43.005905 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-711c47f4-54ba-4993-88aa-9130faff6962 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:43.135865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-711c47f4-54ba-4993-88aa-9130faff6962 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:43.143650 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-711c47f4-54ba-4993-88aa-9130faff6962 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1504 microversion: 2.1 time: 0.150799 Oct 05 03:28:43.144223 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3520/7025] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:42 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:43.165255 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a76458a4-472c-4711-a582-ffde166b4d5e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:43.166506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a76458a4-472c-4711-a582-ffde166b4d5e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:43.172594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a76458a4-472c-4711-a582-ffde166b4d5e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:43.173145 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a76458a4-472c-4711-a582-ffde166b4d5e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:43.173592 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a76458a4-472c-4711-a582-ffde166b4d5e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:43.174288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a76458a4-472c-4711-a582-ffde166b4d5e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:43.174751 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a76458a4-472c-4711-a582-ffde166b4d5e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:43.175183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a76458a4-472c-4711-a582-ffde166b4d5e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:43.307179 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a76458a4-472c-4711-a582-ffde166b4d5e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:43.314971 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a76458a4-472c-4711-a582-ffde166b4d5e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1504 microversion: 2.1 time: 0.153527 Oct 05 03:28:43.315545 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3506/7026] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:43 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:43.337145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8a3f5895-768e-41e0-8694-c9375da3eadb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:28:43.342779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8a3f5895-768e-41e0-8694-c9375da3eadb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:43.349529 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a3f5895-768e-41e0-8694-c9375da3eadb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:43.350058 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a3f5895-768e-41e0-8694-c9375da3eadb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:43.350503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a3f5895-768e-41e0-8694-c9375da3eadb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:43.351222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a3f5895-768e-41e0-8694-c9375da3eadb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:43.351682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a3f5895-768e-41e0-8694-c9375da3eadb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:43.352112 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8a3f5895-768e-41e0-8694-c9375da3eadb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:43.382498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8a3f5895-768e-41e0-8694-c9375da3eadb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:43.387905 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8a3f5895-768e-41e0-8694-c9375da3eadb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Old instance type m1.heat2, new instance type m1.heat {{(pid=122319) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 05 03:28:43.394809 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-8a3f5895-768e-41e0-8694-c9375da3eadb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:28:43.395242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-8a3f5895-768e-41e0-8694-c9375da3eadb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:28:43.395719 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-8a3f5895-768e-41e0-8694-c9375da3eadb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:28:43.396130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-8a3f5895-768e-41e0-8694-c9375da3eadb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:28:43.396543 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-8a3f5895-768e-41e0-8694-c9375da3eadb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:28:43.459302 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8a3f5895-768e-41e0-8694-c9375da3eadb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "POST /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968/action" status: 202 len: 0 microversion: 2.1 time: 0.126073 Oct 05 03:28:43.460439 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3521/7027] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:28:43 2022] POST /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:28:43.469404 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c27b06e2-0ea8-4e7a-b3a3-1a21325ca463 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:43.470117 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c27b06e2-0ea8-4e7a-b3a3-1a21325ca463 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:43.476368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c27b06e2-0ea8-4e7a-b3a3-1a21325ca463 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:43.476968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c27b06e2-0ea8-4e7a-b3a3-1a21325ca463 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:43.477787 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c27b06e2-0ea8-4e7a-b3a3-1a21325ca463 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:43.479251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c27b06e2-0ea8-4e7a-b3a3-1a21325ca463 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:43.479792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c27b06e2-0ea8-4e7a-b3a3-1a21325ca463 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:43.480227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c27b06e2-0ea8-4e7a-b3a3-1a21325ca463 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:43.618558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c27b06e2-0ea8-4e7a-b3a3-1a21325ca463 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:43.626558 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c27b06e2-0ea8-4e7a-b3a3-1a21325ca463 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1515 microversion: 2.1 time: 0.160984 Oct 05 03:28:43.627126 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3507/7028] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:43 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:28:44.651766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-97dea97c-74e5-40de-9461-4de3f80637af tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:44.652379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-97dea97c-74e5-40de-9461-4de3f80637af tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:44.659501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-97dea97c-74e5-40de-9461-4de3f80637af tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:44.659925 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-97dea97c-74e5-40de-9461-4de3f80637af tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:44.660360 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-97dea97c-74e5-40de-9461-4de3f80637af tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:44.661088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-97dea97c-74e5-40de-9461-4de3f80637af tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:44.661537 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-97dea97c-74e5-40de-9461-4de3f80637af tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:44.661960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-97dea97c-74e5-40de-9461-4de3f80637af tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:44.871700 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-97dea97c-74e5-40de-9461-4de3f80637af tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:44.882495 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-97dea97c-74e5-40de-9461-4de3f80637af tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1515 microversion: 2.1 time: 0.235896 Oct 05 03:28:44.883113 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3522/7029] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:44 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1515 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:45.906541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-48854c8a-9d8f-4cf3-8b85-b63844f0ef6f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:45.907078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-48854c8a-9d8f-4cf3-8b85-b63844f0ef6f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:45.914228 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48854c8a-9d8f-4cf3-8b85-b63844f0ef6f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:45.914762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48854c8a-9d8f-4cf3-8b85-b63844f0ef6f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:45.915871 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48854c8a-9d8f-4cf3-8b85-b63844f0ef6f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:45.916580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48854c8a-9d8f-4cf3-8b85-b63844f0ef6f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:45.917073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48854c8a-9d8f-4cf3-8b85-b63844f0ef6f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:45.917511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48854c8a-9d8f-4cf3-8b85-b63844f0ef6f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:46.051439 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-48854c8a-9d8f-4cf3-8b85-b63844f0ef6f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:46.059640 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-48854c8a-9d8f-4cf3-8b85-b63844f0ef6f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1520 microversion: 2.1 time: 0.157035 Oct 05 03:28:46.060250 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3508/7030] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:45 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:47.082886 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f0d4a6d9-60cb-4b8f-a07a-e9cb73a1e824 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:47.083507 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f0d4a6d9-60cb-4b8f-a07a-e9cb73a1e824 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:47.091481 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0d4a6d9-60cb-4b8f-a07a-e9cb73a1e824 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:47.091966 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0d4a6d9-60cb-4b8f-a07a-e9cb73a1e824 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:47.092403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0d4a6d9-60cb-4b8f-a07a-e9cb73a1e824 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:47.093195 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0d4a6d9-60cb-4b8f-a07a-e9cb73a1e824 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:47.093653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0d4a6d9-60cb-4b8f-a07a-e9cb73a1e824 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:47.094080 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0d4a6d9-60cb-4b8f-a07a-e9cb73a1e824 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:47.231304 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f0d4a6d9-60cb-4b8f-a07a-e9cb73a1e824 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:47.239117 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f0d4a6d9-60cb-4b8f-a07a-e9cb73a1e824 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1520 microversion: 2.1 time: 0.160262 Oct 05 03:28:47.239685 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3523/7031] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:47 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:48.263378 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1d6830e4-a619-4d9e-9a7e-8233efaab3a8 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:48.264000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1d6830e4-a619-4d9e-9a7e-8233efaab3a8 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:48.270821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d6830e4-a619-4d9e-9a7e-8233efaab3a8 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:48.271318 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d6830e4-a619-4d9e-9a7e-8233efaab3a8 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:48.271761 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d6830e4-a619-4d9e-9a7e-8233efaab3a8 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:48.272455 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d6830e4-a619-4d9e-9a7e-8233efaab3a8 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:48.272934 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d6830e4-a619-4d9e-9a7e-8233efaab3a8 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:48.273374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d6830e4-a619-4d9e-9a7e-8233efaab3a8 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:48.405300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1d6830e4-a619-4d9e-9a7e-8233efaab3a8 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:48.413049 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1d6830e4-a619-4d9e-9a7e-8233efaab3a8 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1520 microversion: 2.1 time: 0.154139 Oct 05 03:28:48.413630 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3509/7032] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:48 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:49.438593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-31d58e7e-9eaf-4f47-a70b-03e62b5e2a1f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:49.439206 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-31d58e7e-9eaf-4f47-a70b-03e62b5e2a1f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:49.446039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-31d58e7e-9eaf-4f47-a70b-03e62b5e2a1f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:49.446520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-31d58e7e-9eaf-4f47-a70b-03e62b5e2a1f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:49.446952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-31d58e7e-9eaf-4f47-a70b-03e62b5e2a1f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:49.447790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-31d58e7e-9eaf-4f47-a70b-03e62b5e2a1f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:49.448243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-31d58e7e-9eaf-4f47-a70b-03e62b5e2a1f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:49.448663 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-31d58e7e-9eaf-4f47-a70b-03e62b5e2a1f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:49.589353 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-31d58e7e-9eaf-4f47-a70b-03e62b5e2a1f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:49.597323 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-31d58e7e-9eaf-4f47-a70b-03e62b5e2a1f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1520 microversion: 2.1 time: 0.162592 Oct 05 03:28:49.597902 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3524/7033] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:49 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:50.621441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e5c82fcd-dee7-4cdd-b0cb-d37437088dd2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:50.622073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e5c82fcd-dee7-4cdd-b0cb-d37437088dd2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:50.629133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5c82fcd-dee7-4cdd-b0cb-d37437088dd2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:50.629631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5c82fcd-dee7-4cdd-b0cb-d37437088dd2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:50.630084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5c82fcd-dee7-4cdd-b0cb-d37437088dd2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:50.630778 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5c82fcd-dee7-4cdd-b0cb-d37437088dd2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:50.631246 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5c82fcd-dee7-4cdd-b0cb-d37437088dd2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:50.631683 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e5c82fcd-dee7-4cdd-b0cb-d37437088dd2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:50.757493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e5c82fcd-dee7-4cdd-b0cb-d37437088dd2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:50.765203 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e5c82fcd-dee7-4cdd-b0cb-d37437088dd2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1520 microversion: 2.1 time: 0.148579 Oct 05 03:28:50.765780 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3510/7034] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:50 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:51.788363 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c57b86bb-f905-4e49-8f44-f7ac73aa4277 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:51.789010 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c57b86bb-f905-4e49-8f44-f7ac73aa4277 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:51.796247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c57b86bb-f905-4e49-8f44-f7ac73aa4277 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:51.796746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c57b86bb-f905-4e49-8f44-f7ac73aa4277 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:51.797209 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c57b86bb-f905-4e49-8f44-f7ac73aa4277 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:51.797908 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c57b86bb-f905-4e49-8f44-f7ac73aa4277 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:51.798359 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c57b86bb-f905-4e49-8f44-f7ac73aa4277 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:51.798837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c57b86bb-f905-4e49-8f44-f7ac73aa4277 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:51.949081 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c57b86bb-f905-4e49-8f44-f7ac73aa4277 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:51.956859 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c57b86bb-f905-4e49-8f44-f7ac73aa4277 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1520 microversion: 2.1 time: 0.172504 Oct 05 03:28:51.957455 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3525/7035] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:51 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:52.980443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-200d6917-9771-4f0f-9289-4c7c83b190fb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:52.981017 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-200d6917-9771-4f0f-9289-4c7c83b190fb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:52.988028 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-200d6917-9771-4f0f-9289-4c7c83b190fb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:52.988512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-200d6917-9771-4f0f-9289-4c7c83b190fb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:52.989018 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-200d6917-9771-4f0f-9289-4c7c83b190fb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:52.989724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-200d6917-9771-4f0f-9289-4c7c83b190fb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:52.990193 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-200d6917-9771-4f0f-9289-4c7c83b190fb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:52.990630 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-200d6917-9771-4f0f-9289-4c7c83b190fb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:53.116532 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-200d6917-9771-4f0f-9289-4c7c83b190fb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:53.125119 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-200d6917-9771-4f0f-9289-4c7c83b190fb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1520 microversion: 2.1 time: 0.149015 Oct 05 03:28:53.125694 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3511/7036] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:52 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:54.148807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-44d0db0e-d840-458c-a017-a5a4137f5b3d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:54.149466 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-44d0db0e-d840-458c-a017-a5a4137f5b3d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:54.157521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44d0db0e-d840-458c-a017-a5a4137f5b3d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:54.158015 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44d0db0e-d840-458c-a017-a5a4137f5b3d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:54.158457 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44d0db0e-d840-458c-a017-a5a4137f5b3d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:54.159156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44d0db0e-d840-458c-a017-a5a4137f5b3d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:54.159616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44d0db0e-d840-458c-a017-a5a4137f5b3d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:54.160046 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44d0db0e-d840-458c-a017-a5a4137f5b3d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:54.293098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-44d0db0e-d840-458c-a017-a5a4137f5b3d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:54.300925 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-44d0db0e-d840-458c-a017-a5a4137f5b3d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1520 microversion: 2.1 time: 0.155948 Oct 05 03:28:54.301506 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3526/7037] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:54 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:55.324287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d3d6654d-52ee-4426-a2b1-545761162b3b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:55.324933 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d3d6654d-52ee-4426-a2b1-545761162b3b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:55.331747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3d6654d-52ee-4426-a2b1-545761162b3b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:55.332238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3d6654d-52ee-4426-a2b1-545761162b3b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:55.332682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3d6654d-52ee-4426-a2b1-545761162b3b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:55.333405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3d6654d-52ee-4426-a2b1-545761162b3b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:55.333865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3d6654d-52ee-4426-a2b1-545761162b3b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:55.334297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3d6654d-52ee-4426-a2b1-545761162b3b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:55.470240 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d3d6654d-52ee-4426-a2b1-545761162b3b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:55.478115 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d3d6654d-52ee-4426-a2b1-545761162b3b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1520 microversion: 2.1 time: 0.157848 Oct 05 03:28:55.478693 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3512/7038] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:55 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:56.501203 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bb40a755-570f-419c-8c58-379f0ed97319 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:56.501810 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bb40a755-570f-419c-8c58-379f0ed97319 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:56.508625 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bb40a755-570f-419c-8c58-379f0ed97319 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:56.509151 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bb40a755-570f-419c-8c58-379f0ed97319 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:56.509732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bb40a755-570f-419c-8c58-379f0ed97319 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:56.510429 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bb40a755-570f-419c-8c58-379f0ed97319 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:56.510887 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bb40a755-570f-419c-8c58-379f0ed97319 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:56.511321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bb40a755-570f-419c-8c58-379f0ed97319 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:56.643320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bb40a755-570f-419c-8c58-379f0ed97319 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:56.652056 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bb40a755-570f-419c-8c58-379f0ed97319 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1520 microversion: 2.1 time: 0.154585 Oct 05 03:28:56.652755 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3527/7039] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:56 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:57.675656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cd957e28-49a4-4867-a03e-4f177ad14440 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:57.676283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cd957e28-49a4-4867-a03e-4f177ad14440 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:57.683215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd957e28-49a4-4867-a03e-4f177ad14440 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:57.683709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd957e28-49a4-4867-a03e-4f177ad14440 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:57.684158 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd957e28-49a4-4867-a03e-4f177ad14440 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:57.684857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd957e28-49a4-4867-a03e-4f177ad14440 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:57.685365 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd957e28-49a4-4867-a03e-4f177ad14440 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:57.685802 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cd957e28-49a4-4867-a03e-4f177ad14440 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:57.815808 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cd957e28-49a4-4867-a03e-4f177ad14440 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:57.823610 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cd957e28-49a4-4867-a03e-4f177ad14440 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1520 microversion: 2.1 time: 0.151851 Oct 05 03:28:57.824200 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3513/7040] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:57 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:28:58.847449 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-99b15ec0-4a50-4351-a2f6-c50f5f7a2ce3 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:28:58.848096 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-99b15ec0-4a50-4351-a2f6-c50f5f7a2ce3 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:28:58.855857 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99b15ec0-4a50-4351-a2f6-c50f5f7a2ce3 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:58.856349 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99b15ec0-4a50-4351-a2f6-c50f5f7a2ce3 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:58.856793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99b15ec0-4a50-4351-a2f6-c50f5f7a2ce3 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:58.857524 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99b15ec0-4a50-4351-a2f6-c50f5f7a2ce3 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:28:58.857987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99b15ec0-4a50-4351-a2f6-c50f5f7a2ce3 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:28:58.858418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99b15ec0-4a50-4351-a2f6-c50f5f7a2ce3 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:28:58.990332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-99b15ec0-4a50-4351-a2f6-c50f5f7a2ce3 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:28:58.998065 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-99b15ec0-4a50-4351-a2f6-c50f5f7a2ce3 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1520 microversion: 2.1 time: 0.154570 Oct 05 03:28:58.998639 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3528/7041] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:28:58 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:00.021713 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a62c6f2e-4cfb-4f44-b3e5-3fc18de1ac09 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:00.022291 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a62c6f2e-4cfb-4f44-b3e5-3fc18de1ac09 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:00.030179 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a62c6f2e-4cfb-4f44-b3e5-3fc18de1ac09 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:00.030976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a62c6f2e-4cfb-4f44-b3e5-3fc18de1ac09 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:00.031678 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a62c6f2e-4cfb-4f44-b3e5-3fc18de1ac09 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:00.032782 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a62c6f2e-4cfb-4f44-b3e5-3fc18de1ac09 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:00.033553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a62c6f2e-4cfb-4f44-b3e5-3fc18de1ac09 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:00.034147 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a62c6f2e-4cfb-4f44-b3e5-3fc18de1ac09 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:00.166813 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a62c6f2e-4cfb-4f44-b3e5-3fc18de1ac09 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:00.174543 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a62c6f2e-4cfb-4f44-b3e5-3fc18de1ac09 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1520 microversion: 2.1 time: 0.156868 Oct 05 03:29:00.175118 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3514/7042] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:00 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:01.198493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5ea22681-9cca-4dd6-938b-3c26d100b996 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:01.199117 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5ea22681-9cca-4dd6-938b-3c26d100b996 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:01.205799 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ea22681-9cca-4dd6-938b-3c26d100b996 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:01.206283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ea22681-9cca-4dd6-938b-3c26d100b996 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:01.206719 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ea22681-9cca-4dd6-938b-3c26d100b996 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:01.207418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ea22681-9cca-4dd6-938b-3c26d100b996 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:01.207867 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ea22681-9cca-4dd6-938b-3c26d100b996 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:01.208285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ea22681-9cca-4dd6-938b-3c26d100b996 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:01.340423 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5ea22681-9cca-4dd6-938b-3c26d100b996 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:01.348156 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5ea22681-9cca-4dd6-938b-3c26d100b996 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1520 microversion: 2.1 time: 0.153613 Oct 05 03:29:01.348730 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3529/7043] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:01 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:02.371685 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dfbebcc8-fca6-4f3c-9df7-2b1c4a16cbc1 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:02.372340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dfbebcc8-fca6-4f3c-9df7-2b1c4a16cbc1 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:02.379274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfbebcc8-fca6-4f3c-9df7-2b1c4a16cbc1 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:02.379770 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfbebcc8-fca6-4f3c-9df7-2b1c4a16cbc1 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:02.380214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfbebcc8-fca6-4f3c-9df7-2b1c4a16cbc1 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:02.380928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfbebcc8-fca6-4f3c-9df7-2b1c4a16cbc1 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:02.381393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfbebcc8-fca6-4f3c-9df7-2b1c4a16cbc1 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:02.381828 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfbebcc8-fca6-4f3c-9df7-2b1c4a16cbc1 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:02.399564 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:29:02.514345 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dfbebcc8-fca6-4f3c-9df7-2b1c4a16cbc1 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:02.522013 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dfbebcc8-fca6-4f3c-9df7-2b1c4a16cbc1 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1520 microversion: 2.1 time: 0.154547 Oct 05 03:29:02.522585 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3515/7044] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:02 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:03.545425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b198bd13-5134-4356-a391-b932b39878c9 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:03.546047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b198bd13-5134-4356-a391-b932b39878c9 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:03.553097 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b198bd13-5134-4356-a391-b932b39878c9 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:03.553524 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b198bd13-5134-4356-a391-b932b39878c9 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:03.553963 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b198bd13-5134-4356-a391-b932b39878c9 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:03.554658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b198bd13-5134-4356-a391-b932b39878c9 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:03.555119 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b198bd13-5134-4356-a391-b932b39878c9 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:03.555546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b198bd13-5134-4356-a391-b932b39878c9 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:03.686384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b198bd13-5134-4356-a391-b932b39878c9 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:03.694720 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b198bd13-5134-4356-a391-b932b39878c9 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1520 microversion: 2.1 time: 0.153885 Oct 05 03:29:03.695294 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3530/7045] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:03 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:04.717978 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-aa945293-c69d-48d3-9a05-8e8b797af04c tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:04.718596 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-aa945293-c69d-48d3-9a05-8e8b797af04c tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:04.725636 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa945293-c69d-48d3-9a05-8e8b797af04c tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:04.726127 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa945293-c69d-48d3-9a05-8e8b797af04c tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:04.726569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa945293-c69d-48d3-9a05-8e8b797af04c tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:04.727509 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa945293-c69d-48d3-9a05-8e8b797af04c tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:04.728478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa945293-c69d-48d3-9a05-8e8b797af04c tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:04.728924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa945293-c69d-48d3-9a05-8e8b797af04c tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:04.868524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-aa945293-c69d-48d3-9a05-8e8b797af04c tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:04.876943 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-aa945293-c69d-48d3-9a05-8e8b797af04c tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1520 microversion: 2.1 time: 0.162809 Oct 05 03:29:04.877529 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3516/7046] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:04 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:29:05.900210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4f5f6b82-9a1a-4b64-a815-e21e9578c8a2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:05.900928 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4f5f6b82-9a1a-4b64-a815-e21e9578c8a2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:05.907789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f5f6b82-9a1a-4b64-a815-e21e9578c8a2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:05.908278 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f5f6b82-9a1a-4b64-a815-e21e9578c8a2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:05.908731 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f5f6b82-9a1a-4b64-a815-e21e9578c8a2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:05.909442 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f5f6b82-9a1a-4b64-a815-e21e9578c8a2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:05.909900 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f5f6b82-9a1a-4b64-a815-e21e9578c8a2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:05.910331 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f5f6b82-9a1a-4b64-a815-e21e9578c8a2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:06.048446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4f5f6b82-9a1a-4b64-a815-e21e9578c8a2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:06.056659 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4f5f6b82-9a1a-4b64-a815-e21e9578c8a2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1520 microversion: 2.1 time: 0.160250 Oct 05 03:29:06.057370 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3531/7047] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:05 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:07.080835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-993b7dc4-435b-497c-a58c-f358071119fc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:07.081502 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-993b7dc4-435b-497c-a58c-f358071119fc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:07.089260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-993b7dc4-435b-497c-a58c-f358071119fc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:07.089761 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-993b7dc4-435b-497c-a58c-f358071119fc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:07.090212 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-993b7dc4-435b-497c-a58c-f358071119fc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:07.090916 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-993b7dc4-435b-497c-a58c-f358071119fc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:07.091391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-993b7dc4-435b-497c-a58c-f358071119fc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:07.091862 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-993b7dc4-435b-497c-a58c-f358071119fc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:07.219926 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-993b7dc4-435b-497c-a58c-f358071119fc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:07.227897 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-993b7dc4-435b-497c-a58c-f358071119fc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1520 microversion: 2.1 time: 0.150747 Oct 05 03:29:07.228484 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3517/7048] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:07 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:08.251037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-411332c3-8dce-4990-a8a3-f6e10a86a639 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:08.251647 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-411332c3-8dce-4990-a8a3-f6e10a86a639 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:08.258527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-411332c3-8dce-4990-a8a3-f6e10a86a639 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:08.259037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-411332c3-8dce-4990-a8a3-f6e10a86a639 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:08.259534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-411332c3-8dce-4990-a8a3-f6e10a86a639 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:08.260220 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-411332c3-8dce-4990-a8a3-f6e10a86a639 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:08.260671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-411332c3-8dce-4990-a8a3-f6e10a86a639 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:08.261129 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-411332c3-8dce-4990-a8a3-f6e10a86a639 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:08.265019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:29:08.394019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-411332c3-8dce-4990-a8a3-f6e10a86a639 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:08.402486 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-411332c3-8dce-4990-a8a3-f6e10a86a639 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1520 microversion: 2.1 time: 0.155416 Oct 05 03:29:08.403064 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3532/7049] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:08 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:29:09.426029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e4efcbfd-28fd-4a35-b867-011c8a91814f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:09.426657 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e4efcbfd-28fd-4a35-b867-011c8a91814f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:09.434088 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4efcbfd-28fd-4a35-b867-011c8a91814f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:09.434583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4efcbfd-28fd-4a35-b867-011c8a91814f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:09.435019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4efcbfd-28fd-4a35-b867-011c8a91814f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:09.435707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4efcbfd-28fd-4a35-b867-011c8a91814f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:09.436168 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4efcbfd-28fd-4a35-b867-011c8a91814f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:09.436599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4efcbfd-28fd-4a35-b867-011c8a91814f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:09.563830 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e4efcbfd-28fd-4a35-b867-011c8a91814f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:09.572201 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e4efcbfd-28fd-4a35-b867-011c8a91814f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1520 microversion: 2.1 time: 0.149399 Oct 05 03:29:09.572775 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3518/7050] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:09 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:10.596091 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e16851b3-c2aa-4c29-8827-0ec509f61e88 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:10.596743 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e16851b3-c2aa-4c29-8827-0ec509f61e88 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:10.598784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=36 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:29:10.605124 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e16851b3-c2aa-4c29-8827-0ec509f61e88 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:10.605607 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e16851b3-c2aa-4c29-8827-0ec509f61e88 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:10.606041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e16851b3-c2aa-4c29-8827-0ec509f61e88 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:10.606728 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e16851b3-c2aa-4c29-8827-0ec509f61e88 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:10.607181 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e16851b3-c2aa-4c29-8827-0ec509f61e88 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:10.607600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e16851b3-c2aa-4c29-8827-0ec509f61e88 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:10.736502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e16851b3-c2aa-4c29-8827-0ec509f61e88 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:10.744331 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e16851b3-c2aa-4c29-8827-0ec509f61e88 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1520 microversion: 2.1 time: 0.152339 Oct 05 03:29:10.744918 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3533/7051] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:10 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:11.767451 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-67cfdc43-6e83-4b5f-b166-3081182de2be tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:11.768071 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-67cfdc43-6e83-4b5f-b166-3081182de2be tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:11.770801 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=32 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:29:11.776471 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-67cfdc43-6e83-4b5f-b166-3081182de2be tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:11.776993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-67cfdc43-6e83-4b5f-b166-3081182de2be tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:11.777442 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-67cfdc43-6e83-4b5f-b166-3081182de2be tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:11.778135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-67cfdc43-6e83-4b5f-b166-3081182de2be tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:11.778598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-67cfdc43-6e83-4b5f-b166-3081182de2be tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:11.779031 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-67cfdc43-6e83-4b5f-b166-3081182de2be tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:11.916309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-67cfdc43-6e83-4b5f-b166-3081182de2be tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:11.924068 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-67cfdc43-6e83-4b5f-b166-3081182de2be tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1520 microversion: 2.1 time: 0.160490 Oct 05 03:29:11.924788 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3519/7052] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:11 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:12.948186 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-496299f5-a99e-4654-ad9d-27d4b3a0922c tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:12.948828 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-496299f5-a99e-4654-ad9d-27d4b3a0922c tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:12.955606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-496299f5-a99e-4654-ad9d-27d4b3a0922c tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:12.956091 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-496299f5-a99e-4654-ad9d-27d4b3a0922c tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:12.956524 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-496299f5-a99e-4654-ad9d-27d4b3a0922c tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:12.957241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-496299f5-a99e-4654-ad9d-27d4b3a0922c tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:12.957696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-496299f5-a99e-4654-ad9d-27d4b3a0922c tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:12.958119 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-496299f5-a99e-4654-ad9d-27d4b3a0922c tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:13.027943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-149402d7-8770-42b9-8a48-763a01d0c487 req-c30ba72f-01ae-4e29-b13b-3a872b82ebbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ca51737-c661-4544-83ef-7733bc65a968", "name": "network-vif-unplugged", "status": "completed", "tag": "8ea49264-041b-4718-b9ed-2837fec522b7"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:29:13.037993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-149402d7-8770-42b9-8a48-763a01d0c487 req-c30ba72f-01ae-4e29-b13b-3a872b82ebbc service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:13.038493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-149402d7-8770-42b9-8a48-763a01d0c487 req-c30ba72f-01ae-4e29-b13b-3a872b82ebbc service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:13.038944 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-149402d7-8770-42b9-8a48-763a01d0c487 req-c30ba72f-01ae-4e29-b13b-3a872b82ebbc service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:13.058021 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-149402d7-8770-42b9-8a48-763a01d0c487 req-c30ba72f-01ae-4e29-b13b-3a872b82ebbc service nova] Creating event network-vif-unplugged:8ea49264-041b-4718-b9ed-2837fec522b7 for instance 3ca51737-c661-4544-83ef-7733bc65a968 on n-h2-858272-3 Oct 05 03:29:13.064208 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [req-149402d7-8770-42b9-8a48-763a01d0c487 req-c30ba72f-01ae-4e29-b13b-3a872b82ebbc service nova] Instance 3ca51737-c661-4544-83ef-7733bc65a968 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 03:29:13.075907 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-149402d7-8770-42b9-8a48-763a01d0c487 req-c30ba72f-01ae-4e29-b13b-3a872b82ebbc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052089 Oct 05 03:29:13.076799 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3520/7053] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:29:13.101439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-496299f5-a99e-4654-ad9d-27d4b3a0922c tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:13.110490 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-496299f5-a99e-4654-ad9d-27d4b3a0922c tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1519 microversion: 2.1 time: 0.166806 Oct 05 03:29:13.111078 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3534/7054] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:12 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:14.136586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-af500c47-ae62-4bf6-96cd-d619d1892ecd tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:14.137316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-af500c47-ae62-4bf6-96cd-d619d1892ecd tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:14.143373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af500c47-ae62-4bf6-96cd-d619d1892ecd tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:14.143868 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af500c47-ae62-4bf6-96cd-d619d1892ecd tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:14.144310 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af500c47-ae62-4bf6-96cd-d619d1892ecd tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:14.145039 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af500c47-ae62-4bf6-96cd-d619d1892ecd tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:14.145503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af500c47-ae62-4bf6-96cd-d619d1892ecd tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:14.145938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-af500c47-ae62-4bf6-96cd-d619d1892ecd tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:14.279092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-af500c47-ae62-4bf6-96cd-d619d1892ecd tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:14.286840 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-af500c47-ae62-4bf6-96cd-d619d1892ecd tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1519 microversion: 2.1 time: 0.156048 Oct 05 03:29:14.287420 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3521/7055] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:14 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:15.093147 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-280c7b5d-3ff4-43f9-9187-4fe6476dc45a req-cb76c535-a3d2-4ca8-bc8b-f2b983637aba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ca51737-c661-4544-83ef-7733bc65a968", "tag": "8ea49264-041b-4718-b9ed-2837fec522b7"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:29:15.105192 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-280c7b5d-3ff4-43f9-9187-4fe6476dc45a req-cb76c535-a3d2-4ca8-bc8b-f2b983637aba service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:15.106063 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-280c7b5d-3ff4-43f9-9187-4fe6476dc45a req-cb76c535-a3d2-4ca8-bc8b-f2b983637aba service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:15.106833 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-280c7b5d-3ff4-43f9-9187-4fe6476dc45a req-cb76c535-a3d2-4ca8-bc8b-f2b983637aba service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:15.126372 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-280c7b5d-3ff4-43f9-9187-4fe6476dc45a req-cb76c535-a3d2-4ca8-bc8b-f2b983637aba service nova] Creating event network-changed:8ea49264-041b-4718-b9ed-2837fec522b7 for instance 3ca51737-c661-4544-83ef-7733bc65a968 on n-h2-858272-3 Oct 05 03:29:15.131824 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [req-280c7b5d-3ff4-43f9-9187-4fe6476dc45a req-cb76c535-a3d2-4ca8-bc8b-f2b983637aba service nova] Instance 3ca51737-c661-4544-83ef-7733bc65a968 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122319) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 03:29:15.142987 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-280c7b5d-3ff4-43f9-9187-4fe6476dc45a req-cb76c535-a3d2-4ca8-bc8b-f2b983637aba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053551 Oct 05 03:29:15.143596 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3535/7056] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:29:15.310247 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0c369898-b8f8-464e-bd54-cbaf4ebe72cb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:15.310888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0c369898-b8f8-464e-bd54-cbaf4ebe72cb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:15.318311 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c369898-b8f8-464e-bd54-cbaf4ebe72cb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:15.318816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c369898-b8f8-464e-bd54-cbaf4ebe72cb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:15.319261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c369898-b8f8-464e-bd54-cbaf4ebe72cb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:15.319964 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c369898-b8f8-464e-bd54-cbaf4ebe72cb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:15.320437 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c369898-b8f8-464e-bd54-cbaf4ebe72cb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:15.320870 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c369898-b8f8-464e-bd54-cbaf4ebe72cb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:15.540158 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0c369898-b8f8-464e-bd54-cbaf4ebe72cb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:15.548588 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0c369898-b8f8-464e-bd54-cbaf4ebe72cb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1517 microversion: 2.1 time: 0.242326 Oct 05 03:29:15.549207 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3522/7057] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:15 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1517 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:16.574378 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-23e3ca33-423f-46df-8757-ed6588c4801b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:16.575073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-23e3ca33-423f-46df-8757-ed6588c4801b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:16.581382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23e3ca33-423f-46df-8757-ed6588c4801b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:16.581874 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23e3ca33-423f-46df-8757-ed6588c4801b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:16.582320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23e3ca33-423f-46df-8757-ed6588c4801b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:16.583013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23e3ca33-423f-46df-8757-ed6588c4801b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:16.583474 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23e3ca33-423f-46df-8757-ed6588c4801b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:16.583906 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-23e3ca33-423f-46df-8757-ed6588c4801b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:16.722666 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-23e3ca33-423f-46df-8757-ed6588c4801b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:16.730874 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-23e3ca33-423f-46df-8757-ed6588c4801b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1517 microversion: 2.1 time: 0.162051 Oct 05 03:29:16.731462 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3536/7058] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:16 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:17.754286 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1d34d260-1f34-40fd-a0eb-274daf264d58 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:17.754952 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1d34d260-1f34-40fd-a0eb-274daf264d58 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:17.761869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d34d260-1f34-40fd-a0eb-274daf264d58 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:17.762368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d34d260-1f34-40fd-a0eb-274daf264d58 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:17.762823 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d34d260-1f34-40fd-a0eb-274daf264d58 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:17.763578 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d34d260-1f34-40fd-a0eb-274daf264d58 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:17.764289 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d34d260-1f34-40fd-a0eb-274daf264d58 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:17.764979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d34d260-1f34-40fd-a0eb-274daf264d58 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:17.898620 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1d34d260-1f34-40fd-a0eb-274daf264d58 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:17.906987 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1d34d260-1f34-40fd-a0eb-274daf264d58 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1514 microversion: 2.1 time: 0.156783 Oct 05 03:29:17.907568 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3523/7059] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:17 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:17.930325 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-deb31e85-10dd-423e-97d6-60603b9a8591 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:29:17.930844 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-deb31e85-10dd-423e-97d6-60603b9a8591 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:17.938303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-deb31e85-10dd-423e-97d6-60603b9a8591 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:17.938793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-deb31e85-10dd-423e-97d6-60603b9a8591 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:17.939235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-deb31e85-10dd-423e-97d6-60603b9a8591 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:17.939949 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-deb31e85-10dd-423e-97d6-60603b9a8591 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:17.940389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-deb31e85-10dd-423e-97d6-60603b9a8591 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:17.940819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-deb31e85-10dd-423e-97d6-60603b9a8591 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:18.000051 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-deb31e85-10dd-423e-97d6-60603b9a8591 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "POST /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968/action" status: 204 len: 0 microversion: 2.1 time: 0.073556 Oct 05 03:29:18.000725 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3537/7060] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:29:17 2022] POST /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:29:18.009109 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4f4563a8-6cd5-4093-ac65-f00239494335 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:18.010308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4f4563a8-6cd5-4093-ac65-f00239494335 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:18.016463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f4563a8-6cd5-4093-ac65-f00239494335 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:18.017273 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f4563a8-6cd5-4093-ac65-f00239494335 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:18.017731 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f4563a8-6cd5-4093-ac65-f00239494335 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:18.018453 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f4563a8-6cd5-4093-ac65-f00239494335 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:18.018925 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f4563a8-6cd5-4093-ac65-f00239494335 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:18.019558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f4563a8-6cd5-4093-ac65-f00239494335 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:18.238526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4f4563a8-6cd5-4093-ac65-f00239494335 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:18.247141 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4f4563a8-6cd5-4093-ac65-f00239494335 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1514 microversion: 2.1 time: 0.242106 Oct 05 03:29:18.247723 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3524/7061] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:18 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1514 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:19.271528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4c1d7da4-eb1a-40ca-9a64-241f91ddec94 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:19.272243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4c1d7da4-eb1a-40ca-9a64-241f91ddec94 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:19.278469 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c1d7da4-eb1a-40ca-9a64-241f91ddec94 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:19.278959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c1d7da4-eb1a-40ca-9a64-241f91ddec94 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:19.279403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c1d7da4-eb1a-40ca-9a64-241f91ddec94 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:19.280100 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c1d7da4-eb1a-40ca-9a64-241f91ddec94 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:19.280558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c1d7da4-eb1a-40ca-9a64-241f91ddec94 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:19.281022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c1d7da4-eb1a-40ca-9a64-241f91ddec94 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:19.415163 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4c1d7da4-eb1a-40ca-9a64-241f91ddec94 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:19.423063 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4c1d7da4-eb1a-40ca-9a64-241f91ddec94 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1514 microversion: 2.1 time: 0.156631 Oct 05 03:29:19.423640 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3538/7062] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:19 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:20.446598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0486b27b-67ea-47b0-a780-b8ff6ac22cad tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:20.447257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0486b27b-67ea-47b0-a780-b8ff6ac22cad tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:20.457159 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0486b27b-67ea-47b0-a780-b8ff6ac22cad tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:20.457679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0486b27b-67ea-47b0-a780-b8ff6ac22cad tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:20.458147 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0486b27b-67ea-47b0-a780-b8ff6ac22cad tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:20.458901 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0486b27b-67ea-47b0-a780-b8ff6ac22cad tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:20.459381 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0486b27b-67ea-47b0-a780-b8ff6ac22cad tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:20.459977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0486b27b-67ea-47b0-a780-b8ff6ac22cad tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:20.607905 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0486b27b-67ea-47b0-a780-b8ff6ac22cad tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:20.617069 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0486b27b-67ea-47b0-a780-b8ff6ac22cad tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1506 microversion: 2.1 time: 0.174192 Oct 05 03:29:20.628923 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3525/7063] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:20 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1506 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:20.641047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-273465a8-1832-43f6-a965-c267f1d3f227 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:20.641709 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-273465a8-1832-43f6-a965-c267f1d3f227 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:20.649663 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-273465a8-1832-43f6-a965-c267f1d3f227 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:20.650167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-273465a8-1832-43f6-a965-c267f1d3f227 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:20.651454 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-273465a8-1832-43f6-a965-c267f1d3f227 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:20.652638 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-273465a8-1832-43f6-a965-c267f1d3f227 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:20.653152 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-273465a8-1832-43f6-a965-c267f1d3f227 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:20.653620 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-273465a8-1832-43f6-a965-c267f1d3f227 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:20.807516 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-273465a8-1832-43f6-a965-c267f1d3f227 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:20.816176 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-273465a8-1832-43f6-a965-c267f1d3f227 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1506 microversion: 2.1 time: 0.179025 Oct 05 03:29:20.816767 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3539/7064] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:20 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1506 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:20.845599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-134d07d9-310c-4b6a-89ca-d6f2d45e95aa tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Action: 'create', calling method: .version_select at 0x7fccdc063f70>, body: {"keypair": {"name": "tempest-keypair-1306575731", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0fjVPLJNjmAiGKhSGioTDF9xx219BuCan+fosYVw2a+a7b1voKQ/b6BIDUpL4fyMlmaflxyPHo0IC8n+HSGtBhZ8ZHxIdhE+WDNxlFvYTBhs64y+CUWq0hPhzqSb7AAQ=="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:29:20.865760 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-134d07d9-310c-4b6a-89ca-d6f2d45e95aa tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Getting quotas for project 1ac0643217d0435887d49994cd7620e4. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:29:20.872704 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-134d07d9-310c-4b6a-89ca-d6f2d45e95aa tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Getting quotas for user 4e9ae5054256463d8c9b1a0b8f627283 and project 1ac0643217d0435887d49994cd7620e4. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:29:20.886063 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-8ec71207-afd1-4b1e-b91f-ecbfe228caf6 req-9787885d-4e47-4a78-aeb2-256c40c8f4c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ca51737-c661-4544-83ef-7733bc65a968", "name": "network-vif-plugged", "status": "completed", "tag": "8ea49264-041b-4718-b9ed-2837fec522b7"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:29:20.904627 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-8ec71207-afd1-4b1e-b91f-ecbfe228caf6 req-9787885d-4e47-4a78-aeb2-256c40c8f4c7 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:20.905301 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-8ec71207-afd1-4b1e-b91f-ecbfe228caf6 req-9787885d-4e47-4a78-aeb2-256c40c8f4c7 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:20.905968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-8ec71207-afd1-4b1e-b91f-ecbfe228caf6 req-9787885d-4e47-4a78-aeb2-256c40c8f4c7 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:20.910668 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-134d07d9-310c-4b6a-89ca-d6f2d45e95aa tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.070588 Oct 05 03:29:20.912545 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3526/7065] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 03:29:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:29:20.921425 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-8ec71207-afd1-4b1e-b91f-ecbfe228caf6 req-9787885d-4e47-4a78-aeb2-256c40c8f4c7 service nova] Creating event network-vif-plugged:8ea49264-041b-4718-b9ed-2837fec522b7 for instance 3ca51737-c661-4544-83ef-7733bc65a968 on n-h2-858272-3 Oct 05 03:29:20.928353 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-8ec71207-afd1-4b1e-b91f-ecbfe228caf6 req-9787885d-4e47-4a78-aeb2-256c40c8f4c7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046169 Oct 05 03:29:20.929181 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3540/7066] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:29:22.111693 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-52bce9e0-1a92-4a10-9f51-a62b8a0c8e39 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:22.112322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-52bce9e0-1a92-4a10-9f51-a62b8a0c8e39 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:22.118861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52bce9e0-1a92-4a10-9f51-a62b8a0c8e39 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:22.120021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52bce9e0-1a92-4a10-9f51-a62b8a0c8e39 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:22.120470 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52bce9e0-1a92-4a10-9f51-a62b8a0c8e39 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:22.121192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52bce9e0-1a92-4a10-9f51-a62b8a0c8e39 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:22.121664 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52bce9e0-1a92-4a10-9f51-a62b8a0c8e39 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:22.122104 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52bce9e0-1a92-4a10-9f51-a62b8a0c8e39 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:22.250364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-52bce9e0-1a92-4a10-9f51-a62b8a0c8e39 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:22.258299 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-52bce9e0-1a92-4a10-9f51-a62b8a0c8e39 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 200 len: 1506 microversion: 2.1 time: 0.151387 Oct 05 03:29:22.258871 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3527/7067] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:22 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:29:22.281810 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f659e7fb-0947-483d-b8f6-2d6a5520eaaa tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:22.282390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f659e7fb-0947-483d-b8f6-2d6a5520eaaa tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:22.289454 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f659e7fb-0947-483d-b8f6-2d6a5520eaaa tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:22.289931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f659e7fb-0947-483d-b8f6-2d6a5520eaaa tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:22.290364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f659e7fb-0947-483d-b8f6-2d6a5520eaaa tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:22.291128 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f659e7fb-0947-483d-b8f6-2d6a5520eaaa tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:22.291609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f659e7fb-0947-483d-b8f6-2d6a5520eaaa tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:22.292031 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f659e7fb-0947-483d-b8f6-2d6a5520eaaa tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:22.317086 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f659e7fb-0947-483d-b8f6-2d6a5520eaaa tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:29:22.393461 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f659e7fb-0947-483d-b8f6-2d6a5520eaaa tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 204 len: 0 microversion: 2.1 time: 0.115500 Oct 05 03:29:22.393971 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3541/7068] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:29:22 2022] DELETE /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:29:22.451059 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9ee7cea3-2204-44f5-901f-fd5336850c6e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1543164693", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "9982c4b1-8b0e-4239-8af9-b26786966df4"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:29:22.503886 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-9ee7cea3-2204-44f5-901f-fd5336850c6e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] validate_networks() for [('9982c4b1-8b0e-4239-8af9-b26786966df4', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:29:22.873895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-9ee7cea3-2204-44f5-901f-fd5336850c6e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:29:22.874337 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-9ee7cea3-2204-44f5-901f-fd5336850c6e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:29:22.874831 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-9ee7cea3-2204-44f5-901f-fd5336850c6e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:29:22.875260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-9ee7cea3-2204-44f5-901f-fd5336850c6e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:29:22.875688 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-9ee7cea3-2204-44f5-901f-fd5336850c6e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:29:22.884443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ee7cea3-2204-44f5-901f-fd5336850c6e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:22.885504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ee7cea3-2204-44f5-901f-fd5336850c6e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:22.885964 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ee7cea3-2204-44f5-901f-fd5336850c6e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:22.886719 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ee7cea3-2204-44f5-901f-fd5336850c6e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:22.887197 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ee7cea3-2204-44f5-901f-fd5336850c6e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:22.887644 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9ee7cea3-2204-44f5-901f-fd5336850c6e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:22.904671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-9ee7cea3-2204-44f5-901f-fd5336850c6e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Getting quotas for project 1ac0643217d0435887d49994cd7620e4. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:29:22.909866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-9ee7cea3-2204-44f5-901f-fd5336850c6e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Getting quotas for user 4e9ae5054256463d8c9b1a0b8f627283 and project 1ac0643217d0435887d49994cd7620e4. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:29:22.923276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9ee7cea3-2204-44f5-901f-fd5336850c6e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:29:22.925991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9ee7cea3-2204-44f5-901f-fd5336850c6e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:29:22.971764 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9ee7cea3-2204-44f5-901f-fd5336850c6e tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525464 Oct 05 03:29:22.972423 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3528/7069] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:29:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:29:22.985054 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7e4209b7-1531-41f3-94f4-8f6d64628b4c tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:22.985758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7e4209b7-1531-41f3-94f4-8f6d64628b4c tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:23.040339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7e4209b7-1531-41f3-94f4-8f6d64628b4c tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:23.048292 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7e4209b7-1531-41f3-94f4-8f6d64628b4c tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1218 microversion: 2.1 time: 0.067467 Oct 05 03:29:23.048979 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3542/7070] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:22 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:24.073607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-31e53b69-0ef4-4653-953c-7e147dd71ec2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:24.074284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-31e53b69-0ef4-4653-953c-7e147dd71ec2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:24.080311 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-31e53b69-0ef4-4653-953c-7e147dd71ec2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:24.080806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-31e53b69-0ef4-4653-953c-7e147dd71ec2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:24.081288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-31e53b69-0ef4-4653-953c-7e147dd71ec2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:24.081990 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-31e53b69-0ef4-4653-953c-7e147dd71ec2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:24.082458 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-31e53b69-0ef4-4653-953c-7e147dd71ec2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:24.082895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-31e53b69-0ef4-4653-953c-7e147dd71ec2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:24.145411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-31e53b69-0ef4-4653-953c-7e147dd71ec2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:24.153222 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-31e53b69-0ef4-4653-953c-7e147dd71ec2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1270 microversion: 2.1 time: 0.085355 Oct 05 03:29:24.153794 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3529/7071] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:24 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:24.698099 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-3974d42e-ae62-4084-a4f4-c4b04c188442 req-fb1dcd55-7521-4ed6-9a2d-a751f776889e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ca51737-c661-4544-83ef-7733bc65a968", "name": "network-vif-deleted", "tag": "8ea49264-041b-4718-b9ed-2837fec522b7"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:29:24.719037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-3974d42e-ae62-4084-a4f4-c4b04c188442 req-fb1dcd55-7521-4ed6-9a2d-a751f776889e service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:24.719789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-3974d42e-ae62-4084-a4f4-c4b04c188442 req-fb1dcd55-7521-4ed6-9a2d-a751f776889e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:24.720217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-3974d42e-ae62-4084-a4f4-c4b04c188442 req-fb1dcd55-7521-4ed6-9a2d-a751f776889e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:24.735663 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-3974d42e-ae62-4084-a4f4-c4b04c188442 req-fb1dcd55-7521-4ed6-9a2d-a751f776889e service nova] Creating event network-vif-deleted:8ea49264-041b-4718-b9ed-2837fec522b7 for instance 3ca51737-c661-4544-83ef-7733bc65a968 on n-h2-858272-3 Oct 05 03:29:24.741707 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-3974d42e-ae62-4084-a4f4-c4b04c188442 req-fb1dcd55-7521-4ed6-9a2d-a751f776889e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049657 Oct 05 03:29:24.742484 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3543/7072] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:29:25.175741 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9774c894-f51e-484e-a74f-d4026b2a5ffa tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:25.176864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9774c894-f51e-484e-a74f-d4026b2a5ffa tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:25.184143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9774c894-f51e-484e-a74f-d4026b2a5ffa tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:25.184652 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9774c894-f51e-484e-a74f-d4026b2a5ffa tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:25.185140 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9774c894-f51e-484e-a74f-d4026b2a5ffa tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:25.186085 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9774c894-f51e-484e-a74f-d4026b2a5ffa tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:25.187868 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9774c894-f51e-484e-a74f-d4026b2a5ffa tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:25.188318 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9774c894-f51e-484e-a74f-d4026b2a5ffa tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:25.461033 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9774c894-f51e-484e-a74f-d4026b2a5ffa tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:25.469098 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9774c894-f51e-484e-a74f-d4026b2a5ffa tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1318 microversion: 2.1 time: 0.297209 Oct 05 03:29:25.471084 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3530/7073] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:25 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:25.860862 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-77ad7d23-c20a-4ce3-9ecf-ea446507ed6c req-eeb07ca7-b77b-4ced-adbf-4295d57b8d95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b33bb2b9-2db7-4f0e-80c2-47c62d3a6165", "tag": "3eaf6eff-2c07-4a53-9364-3b0b0bd82ac0"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:29:25.872674 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-77ad7d23-c20a-4ce3-9ecf-ea446507ed6c req-eeb07ca7-b77b-4ced-adbf-4295d57b8d95 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:25.873233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-77ad7d23-c20a-4ce3-9ecf-ea446507ed6c req-eeb07ca7-b77b-4ced-adbf-4295d57b8d95 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:25.873606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-77ad7d23-c20a-4ce3-9ecf-ea446507ed6c req-eeb07ca7-b77b-4ced-adbf-4295d57b8d95 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:25.884705 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-77ad7d23-c20a-4ce3-9ecf-ea446507ed6c req-eeb07ca7-b77b-4ced-adbf-4295d57b8d95 service nova] Creating event network-changed:3eaf6eff-2c07-4a53-9364-3b0b0bd82ac0 for instance b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 on n-h2-858272-3 Oct 05 03:29:25.889481 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-77ad7d23-c20a-4ce3-9ecf-ea446507ed6c req-eeb07ca7-b77b-4ced-adbf-4295d57b8d95 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032672 Oct 05 03:29:25.890073 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3544/7074] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:29:26.493529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dfdd3b73-d205-4fac-9d32-2bf6c85dacce tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:26.494161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dfdd3b73-d205-4fac-9d32-2bf6c85dacce tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:26.501094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfdd3b73-d205-4fac-9d32-2bf6c85dacce tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:26.501598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfdd3b73-d205-4fac-9d32-2bf6c85dacce tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:26.502046 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfdd3b73-d205-4fac-9d32-2bf6c85dacce tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:26.502741 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfdd3b73-d205-4fac-9d32-2bf6c85dacce tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:26.503210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfdd3b73-d205-4fac-9d32-2bf6c85dacce tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:26.503649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfdd3b73-d205-4fac-9d32-2bf6c85dacce tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:26.634892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dfdd3b73-d205-4fac-9d32-2bf6c85dacce tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:26.643057 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dfdd3b73-d205-4fac-9d32-2bf6c85dacce tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1318 microversion: 2.1 time: 0.153420 Oct 05 03:29:26.643633 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3531/7075] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:26 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:27.668182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-277f33bc-23b4-472c-bb94-b6b0fabf4dc2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:27.668931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-277f33bc-23b4-472c-bb94-b6b0fabf4dc2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:27.675126 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-277f33bc-23b4-472c-bb94-b6b0fabf4dc2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:27.675607 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-277f33bc-23b4-472c-bb94-b6b0fabf4dc2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:27.676042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-277f33bc-23b4-472c-bb94-b6b0fabf4dc2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:27.676727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-277f33bc-23b4-472c-bb94-b6b0fabf4dc2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:27.677210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-277f33bc-23b4-472c-bb94-b6b0fabf4dc2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:27.677633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-277f33bc-23b4-472c-bb94-b6b0fabf4dc2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:27.803564 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-277f33bc-23b4-472c-bb94-b6b0fabf4dc2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:27.811499 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-277f33bc-23b4-472c-bb94-b6b0fabf4dc2 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1318 microversion: 2.1 time: 0.149167 Oct 05 03:29:27.812076 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3545/7076] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:27 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:28.834288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cfe02b9d-4be9-4fa6-a43b-96c049ebe6fc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:28.835000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cfe02b9d-4be9-4fa6-a43b-96c049ebe6fc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:28.842591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cfe02b9d-4be9-4fa6-a43b-96c049ebe6fc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:28.843117 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cfe02b9d-4be9-4fa6-a43b-96c049ebe6fc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:28.843560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cfe02b9d-4be9-4fa6-a43b-96c049ebe6fc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:28.844253 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cfe02b9d-4be9-4fa6-a43b-96c049ebe6fc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:28.844717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cfe02b9d-4be9-4fa6-a43b-96c049ebe6fc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:28.845179 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cfe02b9d-4be9-4fa6-a43b-96c049ebe6fc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:28.976041 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cfe02b9d-4be9-4fa6-a43b-96c049ebe6fc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:28.985771 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cfe02b9d-4be9-4fa6-a43b-96c049ebe6fc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1318 microversion: 2.1 time: 0.155111 Oct 05 03:29:28.986819 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3532/7077] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:28 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:30.012763 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5dca1f78-a95d-40f8-959d-06f351b99c29 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:30.013359 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5dca1f78-a95d-40f8-959d-06f351b99c29 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:30.020196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5dca1f78-a95d-40f8-959d-06f351b99c29 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:30.020682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5dca1f78-a95d-40f8-959d-06f351b99c29 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:30.021161 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5dca1f78-a95d-40f8-959d-06f351b99c29 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:30.021852 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5dca1f78-a95d-40f8-959d-06f351b99c29 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:30.022306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5dca1f78-a95d-40f8-959d-06f351b99c29 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:30.022730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5dca1f78-a95d-40f8-959d-06f351b99c29 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:30.150416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5dca1f78-a95d-40f8-959d-06f351b99c29 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:30.158368 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5dca1f78-a95d-40f8-959d-06f351b99c29 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1318 microversion: 2.1 time: 0.150268 Oct 05 03:29:30.158961 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3546/7078] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:30 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:31.181703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b112810e-e5fa-41e2-9e07-7df345d892bb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:31.182595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b112810e-e5fa-41e2-9e07-7df345d892bb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:31.193230 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b112810e-e5fa-41e2-9e07-7df345d892bb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:31.194205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b112810e-e5fa-41e2-9e07-7df345d892bb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:31.195014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b112810e-e5fa-41e2-9e07-7df345d892bb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:31.196192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b112810e-e5fa-41e2-9e07-7df345d892bb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:31.196971 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b112810e-e5fa-41e2-9e07-7df345d892bb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:31.198207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b112810e-e5fa-41e2-9e07-7df345d892bb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:31.338836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b112810e-e5fa-41e2-9e07-7df345d892bb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:31.346486 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b112810e-e5fa-41e2-9e07-7df345d892bb tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1318 microversion: 2.1 time: 0.168688 Oct 05 03:29:31.347056 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3533/7079] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:31 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:32.369647 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-72bbc87c-dfd4-4f89-801c-b52efa64227d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:32.370266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-72bbc87c-dfd4-4f89-801c-b52efa64227d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:32.377162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72bbc87c-dfd4-4f89-801c-b52efa64227d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:32.377654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72bbc87c-dfd4-4f89-801c-b52efa64227d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:32.378092 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72bbc87c-dfd4-4f89-801c-b52efa64227d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:32.378781 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72bbc87c-dfd4-4f89-801c-b52efa64227d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:32.379234 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72bbc87c-dfd4-4f89-801c-b52efa64227d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:32.379662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72bbc87c-dfd4-4f89-801c-b52efa64227d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:32.509795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-72bbc87c-dfd4-4f89-801c-b52efa64227d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:32.518090 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-72bbc87c-dfd4-4f89-801c-b52efa64227d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1318 microversion: 2.1 time: 0.152518 Oct 05 03:29:32.518666 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3547/7080] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:32 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:32.757786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-0f4535ab-ad4e-4c3e-8327-c4bf343827f3 req-6e13f705-7603-4f2d-b38e-7c6183cbb723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b33bb2b9-2db7-4f0e-80c2-47c62d3a6165", "name": "network-vif-plugged", "status": "completed", "tag": "3eaf6eff-2c07-4a53-9364-3b0b0bd82ac0"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:29:32.771259 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-0f4535ab-ad4e-4c3e-8327-c4bf343827f3 req-6e13f705-7603-4f2d-b38e-7c6183cbb723 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:32.771757 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-0f4535ab-ad4e-4c3e-8327-c4bf343827f3 req-6e13f705-7603-4f2d-b38e-7c6183cbb723 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:32.772194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-0f4535ab-ad4e-4c3e-8327-c4bf343827f3 req-6e13f705-7603-4f2d-b38e-7c6183cbb723 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:32.777288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=99 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:29:32.788029 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-0f4535ab-ad4e-4c3e-8327-c4bf343827f3 req-6e13f705-7603-4f2d-b38e-7c6183cbb723 service nova] Creating event network-vif-plugged:3eaf6eff-2c07-4a53-9364-3b0b0bd82ac0 for instance b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 on n-h2-858272-3 Oct 05 03:29:32.793530 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-0f4535ab-ad4e-4c3e-8327-c4bf343827f3 req-6e13f705-7603-4f2d-b38e-7c6183cbb723 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039460 Oct 05 03:29:32.794146 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3534/7081] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:29:33.540965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6fe9c50a-a3da-498a-843a-f5f3a32736e1 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:33.542063 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6fe9c50a-a3da-498a-843a-f5f3a32736e1 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:33.544031 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:29:33.550320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6fe9c50a-a3da-498a-843a-f5f3a32736e1 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:33.550825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6fe9c50a-a3da-498a-843a-f5f3a32736e1 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:33.551253 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6fe9c50a-a3da-498a-843a-f5f3a32736e1 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:33.551953 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6fe9c50a-a3da-498a-843a-f5f3a32736e1 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:33.552407 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6fe9c50a-a3da-498a-843a-f5f3a32736e1 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:33.552836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6fe9c50a-a3da-498a-843a-f5f3a32736e1 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:33.689070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6fe9c50a-a3da-498a-843a-f5f3a32736e1 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:33.696808 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6fe9c50a-a3da-498a-843a-f5f3a32736e1 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1318 microversion: 2.1 time: 0.159701 Oct 05 03:29:33.697416 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3548/7082] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:33 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:34.721462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a68d3092-065e-4c70-a118-951b663a1347 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:34.722173 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a68d3092-065e-4c70-a118-951b663a1347 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:34.724143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:29:34.724823 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=10 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:29:34.731898 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a68d3092-065e-4c70-a118-951b663a1347 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:34.732389 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a68d3092-065e-4c70-a118-951b663a1347 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:34.732830 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a68d3092-065e-4c70-a118-951b663a1347 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:34.733547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a68d3092-065e-4c70-a118-951b663a1347 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:34.734011 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a68d3092-065e-4c70-a118-951b663a1347 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:34.734443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a68d3092-065e-4c70-a118-951b663a1347 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:34.863210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a68d3092-065e-4c70-a118-951b663a1347 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:34.871287 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a68d3092-065e-4c70-a118-951b663a1347 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1508 microversion: 2.1 time: 0.153755 Oct 05 03:29:34.871830 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3535/7083] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:34 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:34.893894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-48e19a0e-5b9f-428f-bcbe-16b36e2d0d98 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:34.894511 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-48e19a0e-5b9f-428f-bcbe-16b36e2d0d98 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:34.901353 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48e19a0e-5b9f-428f-bcbe-16b36e2d0d98 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:34.901842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48e19a0e-5b9f-428f-bcbe-16b36e2d0d98 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:34.902955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48e19a0e-5b9f-428f-bcbe-16b36e2d0d98 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:34.903646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48e19a0e-5b9f-428f-bcbe-16b36e2d0d98 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:34.904105 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48e19a0e-5b9f-428f-bcbe-16b36e2d0d98 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:34.904534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48e19a0e-5b9f-428f-bcbe-16b36e2d0d98 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:34.908496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:29:35.035323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-48e19a0e-5b9f-428f-bcbe-16b36e2d0d98 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:35.043083 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-48e19a0e-5b9f-428f-bcbe-16b36e2d0d98 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1508 microversion: 2.1 time: 0.152985 Oct 05 03:29:35.043653 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3549/7084] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:34 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:35.065566 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cff168b4-dde2-4410-b52d-b0d0ae99965f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:29:35.067914 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cff168b4-dde2-4410-b52d-b0d0ae99965f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:35.073863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cff168b4-dde2-4410-b52d-b0d0ae99965f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:35.075091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cff168b4-dde2-4410-b52d-b0d0ae99965f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:35.075551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cff168b4-dde2-4410-b52d-b0d0ae99965f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:35.076282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cff168b4-dde2-4410-b52d-b0d0ae99965f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:35.076753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cff168b4-dde2-4410-b52d-b0d0ae99965f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:35.077222 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cff168b4-dde2-4410-b52d-b0d0ae99965f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:35.105056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cff168b4-dde2-4410-b52d-b0d0ae99965f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:35.111775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cff168b4-dde2-4410-b52d-b0d0ae99965f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Old instance type m1.heat2, new instance type m1.heat {{(pid=122320) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 05 03:29:35.118319 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-cff168b4-dde2-4410-b52d-b0d0ae99965f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:29:35.118750 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-cff168b4-dde2-4410-b52d-b0d0ae99965f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:29:35.119233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-cff168b4-dde2-4410-b52d-b0d0ae99965f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:29:35.119683 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-cff168b4-dde2-4410-b52d-b0d0ae99965f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:29:35.120105 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-cff168b4-dde2-4410-b52d-b0d0ae99965f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:29:35.183950 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cff168b4-dde2-4410-b52d-b0d0ae99965f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "POST /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165/action" status: 202 len: 0 microversion: 2.1 time: 0.121611 Oct 05 03:29:35.187587 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3536/7085] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:29:35 2022] POST /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:29:35.192502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-53562979-b55c-471c-bd2b-f3c0ccfbd7e4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:35.193163 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-53562979-b55c-471c-bd2b-f3c0ccfbd7e4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:35.199852 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53562979-b55c-471c-bd2b-f3c0ccfbd7e4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:35.200379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53562979-b55c-471c-bd2b-f3c0ccfbd7e4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:35.200819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53562979-b55c-471c-bd2b-f3c0ccfbd7e4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:35.201546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53562979-b55c-471c-bd2b-f3c0ccfbd7e4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:35.202003 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53562979-b55c-471c-bd2b-f3c0ccfbd7e4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:35.202434 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-53562979-b55c-471c-bd2b-f3c0ccfbd7e4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:35.359413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-53562979-b55c-471c-bd2b-f3c0ccfbd7e4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:35.367369 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-53562979-b55c-471c-bd2b-f3c0ccfbd7e4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1515 microversion: 2.1 time: 0.178690 Oct 05 03:29:35.367969 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3550/7086] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:35 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1515 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:36.393095 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-526b7282-4163-44df-b5a0-85b8d42f9ebf tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:36.393644 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-526b7282-4163-44df-b5a0-85b8d42f9ebf tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:36.400384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-526b7282-4163-44df-b5a0-85b8d42f9ebf tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:36.400880 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-526b7282-4163-44df-b5a0-85b8d42f9ebf tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:36.401348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-526b7282-4163-44df-b5a0-85b8d42f9ebf tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:36.402719 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-526b7282-4163-44df-b5a0-85b8d42f9ebf tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:36.404068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-526b7282-4163-44df-b5a0-85b8d42f9ebf tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:36.404545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-526b7282-4163-44df-b5a0-85b8d42f9ebf tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:36.615423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-526b7282-4163-44df-b5a0-85b8d42f9ebf tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:36.624343 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-526b7282-4163-44df-b5a0-85b8d42f9ebf tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1515 microversion: 2.1 time: 0.236054 Oct 05 03:29:36.625031 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3537/7087] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:36 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1515 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:37.647771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d2214aab-fe41-4b42-a2a9-b9737d52eec8 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:37.648298 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d2214aab-fe41-4b42-a2a9-b9737d52eec8 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:37.656400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2214aab-fe41-4b42-a2a9-b9737d52eec8 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:37.656884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2214aab-fe41-4b42-a2a9-b9737d52eec8 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:37.657339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2214aab-fe41-4b42-a2a9-b9737d52eec8 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:37.658067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2214aab-fe41-4b42-a2a9-b9737d52eec8 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:37.658518 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2214aab-fe41-4b42-a2a9-b9737d52eec8 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:37.658942 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2214aab-fe41-4b42-a2a9-b9737d52eec8 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:37.791338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d2214aab-fe41-4b42-a2a9-b9737d52eec8 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:37.799787 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d2214aab-fe41-4b42-a2a9-b9737d52eec8 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1520 microversion: 2.1 time: 0.155991 Oct 05 03:29:37.800370 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3551/7088] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:37 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:38.823625 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-08d012b8-21ef-45f2-b106-849f4ae8192b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:38.824823 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-08d012b8-21ef-45f2-b106-849f4ae8192b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:38.831778 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08d012b8-21ef-45f2-b106-849f4ae8192b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:38.832288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08d012b8-21ef-45f2-b106-849f4ae8192b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:38.832736 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08d012b8-21ef-45f2-b106-849f4ae8192b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:38.833474 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08d012b8-21ef-45f2-b106-849f4ae8192b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:38.833940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08d012b8-21ef-45f2-b106-849f4ae8192b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:38.834377 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08d012b8-21ef-45f2-b106-849f4ae8192b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:38.962108 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-08d012b8-21ef-45f2-b106-849f4ae8192b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:38.969847 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-08d012b8-21ef-45f2-b106-849f4ae8192b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1520 microversion: 2.1 time: 0.150167 Oct 05 03:29:38.970429 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3538/7089] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:38 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:39.992687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-14363500-f1d2-4872-85e3-265dec8db35b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:39.993254 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-14363500-f1d2-4872-85e3-265dec8db35b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:40.000157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-14363500-f1d2-4872-85e3-265dec8db35b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:40.000643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-14363500-f1d2-4872-85e3-265dec8db35b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:40.001118 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-14363500-f1d2-4872-85e3-265dec8db35b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:40.001811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-14363500-f1d2-4872-85e3-265dec8db35b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:40.002262 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-14363500-f1d2-4872-85e3-265dec8db35b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:40.002688 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-14363500-f1d2-4872-85e3-265dec8db35b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:40.132045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-14363500-f1d2-4872-85e3-265dec8db35b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:40.140056 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-14363500-f1d2-4872-85e3-265dec8db35b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1520 microversion: 2.1 time: 0.151344 Oct 05 03:29:40.140638 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3552/7090] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:39 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:41.163849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fc6e7c64-b7a8-4c1d-8d12-dae4a0e5b3dc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:41.164508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fc6e7c64-b7a8-4c1d-8d12-dae4a0e5b3dc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:41.171659 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc6e7c64-b7a8-4c1d-8d12-dae4a0e5b3dc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:41.172156 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc6e7c64-b7a8-4c1d-8d12-dae4a0e5b3dc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:41.172603 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc6e7c64-b7a8-4c1d-8d12-dae4a0e5b3dc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:41.173328 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc6e7c64-b7a8-4c1d-8d12-dae4a0e5b3dc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:41.173793 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc6e7c64-b7a8-4c1d-8d12-dae4a0e5b3dc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:41.174224 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc6e7c64-b7a8-4c1d-8d12-dae4a0e5b3dc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:41.312692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fc6e7c64-b7a8-4c1d-8d12-dae4a0e5b3dc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:41.320402 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fc6e7c64-b7a8-4c1d-8d12-dae4a0e5b3dc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1520 microversion: 2.1 time: 0.160749 Oct 05 03:29:41.321080 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3539/7091] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:41 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:42.343939 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3e81250f-0859-46c4-9fa1-3034909033cd tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:42.344548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3e81250f-0859-46c4-9fa1-3034909033cd tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:42.347231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:29:42.352789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e81250f-0859-46c4-9fa1-3034909033cd tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:42.353292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e81250f-0859-46c4-9fa1-3034909033cd tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:42.353725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e81250f-0859-46c4-9fa1-3034909033cd tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:42.354414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e81250f-0859-46c4-9fa1-3034909033cd tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:42.355497 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e81250f-0859-46c4-9fa1-3034909033cd tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:42.355777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3e81250f-0859-46c4-9fa1-3034909033cd tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:42.491225 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3e81250f-0859-46c4-9fa1-3034909033cd tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:42.499189 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3e81250f-0859-46c4-9fa1-3034909033cd tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1520 microversion: 2.1 time: 0.159177 Oct 05 03:29:42.499765 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3553/7092] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:42 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:43.523077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a22b371b-82e2-4555-803d-f00aaa67ca5a tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:43.523713 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a22b371b-82e2-4555-803d-f00aaa67ca5a tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:43.526477 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:29:43.532399 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a22b371b-82e2-4555-803d-f00aaa67ca5a tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:43.532922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a22b371b-82e2-4555-803d-f00aaa67ca5a tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:43.533371 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a22b371b-82e2-4555-803d-f00aaa67ca5a tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:43.534076 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a22b371b-82e2-4555-803d-f00aaa67ca5a tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:43.534539 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a22b371b-82e2-4555-803d-f00aaa67ca5a tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:43.534998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a22b371b-82e2-4555-803d-f00aaa67ca5a tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:43.667852 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a22b371b-82e2-4555-803d-f00aaa67ca5a tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:43.675753 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a22b371b-82e2-4555-803d-f00aaa67ca5a tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1520 microversion: 2.1 time: 0.156576 Oct 05 03:29:43.676324 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3540/7093] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:43 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:44.699647 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-64b59093-cc64-486b-b138-8fdaf3f15180 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:44.700272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-64b59093-cc64-486b-b138-8fdaf3f15180 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:44.702650 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 03:29:44.702779 n-d-858272-3 devstack@n-api.service[122319]: Wed Oct 5 03:29:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 (ip 10.222.0.16) !!! Oct 05 03:29:44.713034 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64b59093-cc64-486b-b138-8fdaf3f15180 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:44.713521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64b59093-cc64-486b-b138-8fdaf3f15180 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:44.713956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64b59093-cc64-486b-b138-8fdaf3f15180 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:44.714683 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64b59093-cc64-486b-b138-8fdaf3f15180 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:44.715151 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64b59093-cc64-486b-b138-8fdaf3f15180 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:44.715571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-64b59093-cc64-486b-b138-8fdaf3f15180 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:44.845138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-64b59093-cc64-486b-b138-8fdaf3f15180 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:44.853177 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-64b59093-cc64-486b-b138-8fdaf3f15180 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1520 microversion: 2.1 time: 0.157859 Oct 05 03:29:44.853755 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3554/7094] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:44 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:45.877111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-56de4063-7e36-4348-9229-efc3f038890d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:45.877743 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-56de4063-7e36-4348-9229-efc3f038890d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:45.885217 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56de4063-7e36-4348-9229-efc3f038890d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:45.885719 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56de4063-7e36-4348-9229-efc3f038890d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:45.886907 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56de4063-7e36-4348-9229-efc3f038890d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:45.887640 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56de4063-7e36-4348-9229-efc3f038890d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:45.888113 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56de4063-7e36-4348-9229-efc3f038890d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:45.888552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-56de4063-7e36-4348-9229-efc3f038890d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:46.026419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-56de4063-7e36-4348-9229-efc3f038890d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:46.035197 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-56de4063-7e36-4348-9229-efc3f038890d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1520 microversion: 2.1 time: 0.161983 Oct 05 03:29:46.035781 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3541/7095] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:45 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:47.060057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-81045145-7db5-402c-b858-7b4f90efb962 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:47.060667 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-81045145-7db5-402c-b858-7b4f90efb962 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:47.067601 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81045145-7db5-402c-b858-7b4f90efb962 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:47.068082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81045145-7db5-402c-b858-7b4f90efb962 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:47.068513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81045145-7db5-402c-b858-7b4f90efb962 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:47.069250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81045145-7db5-402c-b858-7b4f90efb962 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:47.069697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81045145-7db5-402c-b858-7b4f90efb962 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:47.070123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81045145-7db5-402c-b858-7b4f90efb962 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:47.197579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-81045145-7db5-402c-b858-7b4f90efb962 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:47.206013 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-81045145-7db5-402c-b858-7b4f90efb962 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1520 microversion: 2.1 time: 0.150387 Oct 05 03:29:47.206585 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3555/7096] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:47 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:48.229426 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-32e90762-2c79-4157-b4f5-d6450e13f281 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:48.230613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-32e90762-2c79-4157-b4f5-d6450e13f281 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:48.236977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32e90762-2c79-4157-b4f5-d6450e13f281 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:48.237483 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32e90762-2c79-4157-b4f5-d6450e13f281 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:48.237937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32e90762-2c79-4157-b4f5-d6450e13f281 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:48.238641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32e90762-2c79-4157-b4f5-d6450e13f281 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:48.239141 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32e90762-2c79-4157-b4f5-d6450e13f281 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:48.239586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-32e90762-2c79-4157-b4f5-d6450e13f281 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:48.371120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-32e90762-2c79-4157-b4f5-d6450e13f281 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:48.378893 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-32e90762-2c79-4157-b4f5-d6450e13f281 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1520 microversion: 2.1 time: 0.153841 Oct 05 03:29:48.379465 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3542/7097] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:48 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:49.406583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0a4b4c5b-63ca-4d6f-8492-0d9b9a8789b7 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:49.407199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0a4b4c5b-63ca-4d6f-8492-0d9b9a8789b7 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:49.416549 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a4b4c5b-63ca-4d6f-8492-0d9b9a8789b7 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:49.417109 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a4b4c5b-63ca-4d6f-8492-0d9b9a8789b7 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:49.417699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a4b4c5b-63ca-4d6f-8492-0d9b9a8789b7 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:49.418407 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a4b4c5b-63ca-4d6f-8492-0d9b9a8789b7 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:49.418867 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a4b4c5b-63ca-4d6f-8492-0d9b9a8789b7 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:49.419296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a4b4c5b-63ca-4d6f-8492-0d9b9a8789b7 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:49.548296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0a4b4c5b-63ca-4d6f-8492-0d9b9a8789b7 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:49.555966 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0a4b4c5b-63ca-4d6f-8492-0d9b9a8789b7 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1520 microversion: 2.1 time: 0.156483 Oct 05 03:29:49.556554 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3556/7098] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:49 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:50.580004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6ea971a6-b68b-4e71-bf09-b5de11ae733f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:50.580633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6ea971a6-b68b-4e71-bf09-b5de11ae733f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:50.587487 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ea971a6-b68b-4e71-bf09-b5de11ae733f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:50.587982 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ea971a6-b68b-4e71-bf09-b5de11ae733f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:50.588428 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ea971a6-b68b-4e71-bf09-b5de11ae733f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:50.589897 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ea971a6-b68b-4e71-bf09-b5de11ae733f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:50.590370 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ea971a6-b68b-4e71-bf09-b5de11ae733f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:50.590806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6ea971a6-b68b-4e71-bf09-b5de11ae733f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:50.718649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6ea971a6-b68b-4e71-bf09-b5de11ae733f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:50.726439 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6ea971a6-b68b-4e71-bf09-b5de11ae733f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1520 microversion: 2.1 time: 0.150397 Oct 05 03:29:50.727267 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3543/7099] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:50 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:51.753783 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cde92650-fbbb-440f-8808-f4dc4fcf3312 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:51.754402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cde92650-fbbb-440f-8808-f4dc4fcf3312 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:51.761242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cde92650-fbbb-440f-8808-f4dc4fcf3312 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:51.761730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cde92650-fbbb-440f-8808-f4dc4fcf3312 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:51.762165 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cde92650-fbbb-440f-8808-f4dc4fcf3312 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:51.762859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cde92650-fbbb-440f-8808-f4dc4fcf3312 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:51.763310 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cde92650-fbbb-440f-8808-f4dc4fcf3312 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:51.763738 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cde92650-fbbb-440f-8808-f4dc4fcf3312 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:51.898221 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cde92650-fbbb-440f-8808-f4dc4fcf3312 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:51.906746 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cde92650-fbbb-440f-8808-f4dc4fcf3312 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1520 microversion: 2.1 time: 0.156903 Oct 05 03:29:51.907335 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3557/7100] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:51 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:52.930447 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-589a4daa-60f9-46ec-96ff-6fd1110ec2f4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:52.931319 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-589a4daa-60f9-46ec-96ff-6fd1110ec2f4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:52.939062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-589a4daa-60f9-46ec-96ff-6fd1110ec2f4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:52.939559 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-589a4daa-60f9-46ec-96ff-6fd1110ec2f4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:52.940001 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-589a4daa-60f9-46ec-96ff-6fd1110ec2f4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:52.940699 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-589a4daa-60f9-46ec-96ff-6fd1110ec2f4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:52.941189 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-589a4daa-60f9-46ec-96ff-6fd1110ec2f4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:52.941623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-589a4daa-60f9-46ec-96ff-6fd1110ec2f4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:53.073241 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-589a4daa-60f9-46ec-96ff-6fd1110ec2f4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:53.081145 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-589a4daa-60f9-46ec-96ff-6fd1110ec2f4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1520 microversion: 2.1 time: 0.155050 Oct 05 03:29:53.081717 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3544/7101] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:52 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:54.105366 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d7316404-df92-4614-be3b-1c4b34c045d4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:54.106514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d7316404-df92-4614-be3b-1c4b34c045d4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:54.113437 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7316404-df92-4614-be3b-1c4b34c045d4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:54.113920 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7316404-df92-4614-be3b-1c4b34c045d4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:54.114351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7316404-df92-4614-be3b-1c4b34c045d4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:54.115038 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7316404-df92-4614-be3b-1c4b34c045d4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:54.115490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7316404-df92-4614-be3b-1c4b34c045d4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:54.115912 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d7316404-df92-4614-be3b-1c4b34c045d4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:54.247711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d7316404-df92-4614-be3b-1c4b34c045d4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:54.255429 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d7316404-df92-4614-be3b-1c4b34c045d4 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1520 microversion: 2.1 time: 0.154262 Oct 05 03:29:54.255983 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3558/7102] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:54 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:55.277635 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1d73fc36-5a13-4ecc-b192-1ea35c2c6598 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:55.278256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1d73fc36-5a13-4ecc-b192-1ea35c2c6598 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:55.286078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d73fc36-5a13-4ecc-b192-1ea35c2c6598 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:55.286575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d73fc36-5a13-4ecc-b192-1ea35c2c6598 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:55.287020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d73fc36-5a13-4ecc-b192-1ea35c2c6598 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:55.287715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d73fc36-5a13-4ecc-b192-1ea35c2c6598 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:55.288188 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d73fc36-5a13-4ecc-b192-1ea35c2c6598 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:55.288618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1d73fc36-5a13-4ecc-b192-1ea35c2c6598 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:55.417099 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1d73fc36-5a13-4ecc-b192-1ea35c2c6598 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:55.424685 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1d73fc36-5a13-4ecc-b192-1ea35c2c6598 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1520 microversion: 2.1 time: 0.151034 Oct 05 03:29:55.425284 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3545/7103] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:55 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:56.447787 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9870be3e-4875-424e-b0a0-c7c4815511f6 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:56.448409 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9870be3e-4875-424e-b0a0-c7c4815511f6 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:56.455916 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9870be3e-4875-424e-b0a0-c7c4815511f6 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:56.456402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9870be3e-4875-424e-b0a0-c7c4815511f6 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:56.456836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9870be3e-4875-424e-b0a0-c7c4815511f6 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:56.457558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9870be3e-4875-424e-b0a0-c7c4815511f6 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:56.458010 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9870be3e-4875-424e-b0a0-c7c4815511f6 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:56.458437 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9870be3e-4875-424e-b0a0-c7c4815511f6 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:56.590979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9870be3e-4875-424e-b0a0-c7c4815511f6 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:56.598739 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9870be3e-4875-424e-b0a0-c7c4815511f6 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1520 microversion: 2.1 time: 0.154905 Oct 05 03:29:56.599312 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3559/7104] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:56 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:57.623004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1c9f442f-6ec7-4d7c-aac3-1f4a1c419929 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:57.623597 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1c9f442f-6ec7-4d7c-aac3-1f4a1c419929 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:57.630476 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c9f442f-6ec7-4d7c-aac3-1f4a1c419929 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:57.630970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c9f442f-6ec7-4d7c-aac3-1f4a1c419929 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:57.631414 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c9f442f-6ec7-4d7c-aac3-1f4a1c419929 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:57.632103 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c9f442f-6ec7-4d7c-aac3-1f4a1c419929 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:57.632563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c9f442f-6ec7-4d7c-aac3-1f4a1c419929 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:57.633032 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c9f442f-6ec7-4d7c-aac3-1f4a1c419929 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:57.761505 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1c9f442f-6ec7-4d7c-aac3-1f4a1c419929 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:57.769319 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1c9f442f-6ec7-4d7c-aac3-1f4a1c419929 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1520 microversion: 2.1 time: 0.150495 Oct 05 03:29:57.769898 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3546/7105] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:57 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:58.793773 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c9510041-e4f4-47a1-9abf-be8b22cdb7c3 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:58.794556 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c9510041-e4f4-47a1-9abf-be8b22cdb7c3 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:58.801458 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9510041-e4f4-47a1-9abf-be8b22cdb7c3 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:58.801947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9510041-e4f4-47a1-9abf-be8b22cdb7c3 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:58.802388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9510041-e4f4-47a1-9abf-be8b22cdb7c3 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:58.803084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9510041-e4f4-47a1-9abf-be8b22cdb7c3 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:58.803540 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9510041-e4f4-47a1-9abf-be8b22cdb7c3 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:58.803966 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9510041-e4f4-47a1-9abf-be8b22cdb7c3 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:58.934855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c9510041-e4f4-47a1-9abf-be8b22cdb7c3 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:29:58.942620 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c9510041-e4f4-47a1-9abf-be8b22cdb7c3 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1520 microversion: 2.1 time: 0.153444 Oct 05 03:29:58.943197 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3560/7106] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:58 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:29:59.965953 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-14e651a0-84cb-411f-9b97-8b4df895f91c tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:29:59.966537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-14e651a0-84cb-411f-9b97-8b4df895f91c tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:29:59.973311 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14e651a0-84cb-411f-9b97-8b4df895f91c tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:59.973815 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14e651a0-84cb-411f-9b97-8b4df895f91c tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:59.974269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14e651a0-84cb-411f-9b97-8b4df895f91c tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:29:59.974977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14e651a0-84cb-411f-9b97-8b4df895f91c tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:29:59.975445 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14e651a0-84cb-411f-9b97-8b4df895f91c tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:29:59.975885 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14e651a0-84cb-411f-9b97-8b4df895f91c tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:00.379008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-14e651a0-84cb-411f-9b97-8b4df895f91c tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:30:00.386749 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-14e651a0-84cb-411f-9b97-8b4df895f91c tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1520 microversion: 2.1 time: 0.424959 Oct 05 03:30:00.387321 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3547/7107] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:29:59 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1520 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:30:01.409741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-97afb53c-2687-42c6-8005-d9ef088dfd04 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:30:01.410364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-97afb53c-2687-42c6-8005-d9ef088dfd04 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:30:01.417246 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-97afb53c-2687-42c6-8005-d9ef088dfd04 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:01.417761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-97afb53c-2687-42c6-8005-d9ef088dfd04 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:01.418241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-97afb53c-2687-42c6-8005-d9ef088dfd04 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:01.418928 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-97afb53c-2687-42c6-8005-d9ef088dfd04 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:01.419380 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-97afb53c-2687-42c6-8005-d9ef088dfd04 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:01.419807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-97afb53c-2687-42c6-8005-d9ef088dfd04 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:01.594469 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-97afb53c-2687-42c6-8005-d9ef088dfd04 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:30:01.604029 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-97afb53c-2687-42c6-8005-d9ef088dfd04 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1520 microversion: 2.1 time: 0.198069 Oct 05 03:30:01.605795 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3561/7108] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:30:01 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:30:02.628259 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f9a7b67a-b507-4095-b9b1-05c1c01abdd1 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:30:02.628936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f9a7b67a-b507-4095-b9b1-05c1c01abdd1 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:30:02.635739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9a7b67a-b507-4095-b9b1-05c1c01abdd1 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:02.636237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9a7b67a-b507-4095-b9b1-05c1c01abdd1 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:02.636725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9a7b67a-b507-4095-b9b1-05c1c01abdd1 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:02.637449 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9a7b67a-b507-4095-b9b1-05c1c01abdd1 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:02.637927 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9a7b67a-b507-4095-b9b1-05c1c01abdd1 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:02.638365 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9a7b67a-b507-4095-b9b1-05c1c01abdd1 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:02.782455 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f9a7b67a-b507-4095-b9b1-05c1c01abdd1 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:30:02.790299 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f9a7b67a-b507-4095-b9b1-05c1c01abdd1 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1520 microversion: 2.1 time: 0.165990 Oct 05 03:30:02.790865 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3548/7109] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:30:02 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:30:03.814516 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ff673ba8-2390-42d8-990a-35dd4b1bff0b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:30:03.815194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ff673ba8-2390-42d8-990a-35dd4b1bff0b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:30:03.822110 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff673ba8-2390-42d8-990a-35dd4b1bff0b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:03.822601 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff673ba8-2390-42d8-990a-35dd4b1bff0b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:03.823043 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff673ba8-2390-42d8-990a-35dd4b1bff0b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:03.823741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff673ba8-2390-42d8-990a-35dd4b1bff0b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:03.824804 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff673ba8-2390-42d8-990a-35dd4b1bff0b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:03.825267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff673ba8-2390-42d8-990a-35dd4b1bff0b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:03.955883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ff673ba8-2390-42d8-990a-35dd4b1bff0b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:30:03.963681 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ff673ba8-2390-42d8-990a-35dd4b1bff0b tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1520 microversion: 2.1 time: 0.153083 Oct 05 03:30:03.964255 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3562/7110] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:30:03 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:30:04.665285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-105b3e5a-f63b-4e59-b495-fb681ba26b19 req-74d78798-8da1-4584-98e8-081887dff827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b33bb2b9-2db7-4f0e-80c2-47c62d3a6165", "name": "network-vif-unplugged", "status": "completed", "tag": "3eaf6eff-2c07-4a53-9364-3b0b0bd82ac0"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:30:04.679339 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-105b3e5a-f63b-4e59-b495-fb681ba26b19 req-74d78798-8da1-4584-98e8-081887dff827 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:04.679835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-105b3e5a-f63b-4e59-b495-fb681ba26b19 req-74d78798-8da1-4584-98e8-081887dff827 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:04.680278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-105b3e5a-f63b-4e59-b495-fb681ba26b19 req-74d78798-8da1-4584-98e8-081887dff827 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:04.684085 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:30:04.693243 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-105b3e5a-f63b-4e59-b495-fb681ba26b19 req-74d78798-8da1-4584-98e8-081887dff827 service nova] Creating event network-vif-unplugged:3eaf6eff-2c07-4a53-9364-3b0b0bd82ac0 for instance b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 on n-h1-858272-3 Oct 05 03:30:04.701563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [req-105b3e5a-f63b-4e59-b495-fb681ba26b19 req-74d78798-8da1-4584-98e8-081887dff827 service nova] Instance b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 03:30:04.712995 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-105b3e5a-f63b-4e59-b495-fb681ba26b19 req-74d78798-8da1-4584-98e8-081887dff827 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051680 Oct 05 03:30:04.713779 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3549/7111] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:30:04.987664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8398dc4e-231c-414a-8c82-4ecebbbb86fc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:30:04.988537 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8398dc4e-231c-414a-8c82-4ecebbbb86fc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:30:04.996415 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8398dc4e-231c-414a-8c82-4ecebbbb86fc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:04.997013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8398dc4e-231c-414a-8c82-4ecebbbb86fc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:04.997464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8398dc4e-231c-414a-8c82-4ecebbbb86fc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:04.998286 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8398dc4e-231c-414a-8c82-4ecebbbb86fc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:04.998958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8398dc4e-231c-414a-8c82-4ecebbbb86fc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:04.999398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8398dc4e-231c-414a-8c82-4ecebbbb86fc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:05.003768 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=83 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:30:05.250868 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8398dc4e-231c-414a-8c82-4ecebbbb86fc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:30:05.258867 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8398dc4e-231c-414a-8c82-4ecebbbb86fc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1519 microversion: 2.1 time: 0.275296 Oct 05 03:30:05.272926 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3563/7112] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:30:04 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1519 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:30:06.284409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ca67b9d7-a0da-46d1-a48c-fb947581ae31 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:30:06.285158 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ca67b9d7-a0da-46d1-a48c-fb947581ae31 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:30:06.292539 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca67b9d7-a0da-46d1-a48c-fb947581ae31 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:06.293171 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca67b9d7-a0da-46d1-a48c-fb947581ae31 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:06.293529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca67b9d7-a0da-46d1-a48c-fb947581ae31 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:06.294226 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca67b9d7-a0da-46d1-a48c-fb947581ae31 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:06.294698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca67b9d7-a0da-46d1-a48c-fb947581ae31 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:06.295142 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca67b9d7-a0da-46d1-a48c-fb947581ae31 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:06.423482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ca67b9d7-a0da-46d1-a48c-fb947581ae31 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:30:06.431250 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ca67b9d7-a0da-46d1-a48c-fb947581ae31 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1517 microversion: 2.1 time: 0.151092 Oct 05 03:30:06.431814 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3550/7113] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:30:06 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:30:06.735145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-8df2d774-0b7a-4e66-9947-235253bbeb01 req-c78f9a55-a75a-4966-a06d-e5dad99293bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b33bb2b9-2db7-4f0e-80c2-47c62d3a6165", "tag": "3eaf6eff-2c07-4a53-9364-3b0b0bd82ac0"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:30:06.745292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-8df2d774-0b7a-4e66-9947-235253bbeb01 req-c78f9a55-a75a-4966-a06d-e5dad99293bb service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:06.746306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-8df2d774-0b7a-4e66-9947-235253bbeb01 req-c78f9a55-a75a-4966-a06d-e5dad99293bb service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:06.746777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-8df2d774-0b7a-4e66-9947-235253bbeb01 req-c78f9a55-a75a-4966-a06d-e5dad99293bb service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:06.757949 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-8df2d774-0b7a-4e66-9947-235253bbeb01 req-c78f9a55-a75a-4966-a06d-e5dad99293bb service nova] Creating event network-changed:3eaf6eff-2c07-4a53-9364-3b0b0bd82ac0 for instance b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 on n-h1-858272-3 Oct 05 03:30:06.763771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [req-8df2d774-0b7a-4e66-9947-235253bbeb01 req-c78f9a55-a75a-4966-a06d-e5dad99293bb service nova] Instance b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122319) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 03:30:06.774244 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-8df2d774-0b7a-4e66-9947-235253bbeb01 req-c78f9a55-a75a-4966-a06d-e5dad99293bb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042920 Oct 05 03:30:06.774820 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3564/7114] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:30:07.453945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2cf102fc-11a6-4b56-b95e-41cab2d9a7e9 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:30:07.454577 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2cf102fc-11a6-4b56-b95e-41cab2d9a7e9 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:30:07.461347 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cf102fc-11a6-4b56-b95e-41cab2d9a7e9 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:07.461840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cf102fc-11a6-4b56-b95e-41cab2d9a7e9 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:07.462285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cf102fc-11a6-4b56-b95e-41cab2d9a7e9 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:07.462973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cf102fc-11a6-4b56-b95e-41cab2d9a7e9 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:07.463434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cf102fc-11a6-4b56-b95e-41cab2d9a7e9 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:07.463866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2cf102fc-11a6-4b56-b95e-41cab2d9a7e9 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:07.595508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2cf102fc-11a6-4b56-b95e-41cab2d9a7e9 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:30:07.603417 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2cf102fc-11a6-4b56-b95e-41cab2d9a7e9 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1517 microversion: 2.1 time: 0.153371 Oct 05 03:30:07.603986 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3551/7115] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:30:07 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:30:08.629715 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ac307d5d-127c-4a18-b0af-e8c8ec334c11 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:30:08.630641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ac307d5d-127c-4a18-b0af-e8c8ec334c11 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:30:08.638045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac307d5d-127c-4a18-b0af-e8c8ec334c11 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:08.638708 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac307d5d-127c-4a18-b0af-e8c8ec334c11 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:08.639266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac307d5d-127c-4a18-b0af-e8c8ec334c11 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:08.640191 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac307d5d-127c-4a18-b0af-e8c8ec334c11 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:08.640692 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac307d5d-127c-4a18-b0af-e8c8ec334c11 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:08.641242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac307d5d-127c-4a18-b0af-e8c8ec334c11 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:08.859278 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ac307d5d-127c-4a18-b0af-e8c8ec334c11 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:30:08.867314 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ac307d5d-127c-4a18-b0af-e8c8ec334c11 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1514 microversion: 2.1 time: 0.242821 Oct 05 03:30:08.867894 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3565/7116] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:30:08 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1514 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:30:08.890003 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-156d2215-580a-446d-9d63-8bc19a342e81 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:30:08.890728 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-156d2215-580a-446d-9d63-8bc19a342e81 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:30:08.897705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-156d2215-580a-446d-9d63-8bc19a342e81 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:08.898211 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-156d2215-580a-446d-9d63-8bc19a342e81 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:08.898667 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-156d2215-580a-446d-9d63-8bc19a342e81 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:08.899382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-156d2215-580a-446d-9d63-8bc19a342e81 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:08.899856 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-156d2215-580a-446d-9d63-8bc19a342e81 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:08.900296 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-156d2215-580a-446d-9d63-8bc19a342e81 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:08.960462 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-156d2215-580a-446d-9d63-8bc19a342e81 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "POST /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165/action" status: 204 len: 0 microversion: 2.1 time: 0.074207 Oct 05 03:30:08.961288 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3552/7117] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:30:08 2022] POST /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:30:08.971123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0c413ed8-41c2-48e4-913f-ec07e7ee4bfd tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:30:08.971741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0c413ed8-41c2-48e4-913f-ec07e7ee4bfd tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:30:08.978484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c413ed8-41c2-48e4-913f-ec07e7ee4bfd tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:08.979136 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c413ed8-41c2-48e4-913f-ec07e7ee4bfd tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:08.979590 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c413ed8-41c2-48e4-913f-ec07e7ee4bfd tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:08.981983 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c413ed8-41c2-48e4-913f-ec07e7ee4bfd tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:08.982611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c413ed8-41c2-48e4-913f-ec07e7ee4bfd tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:08.983523 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c413ed8-41c2-48e4-913f-ec07e7ee4bfd tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:09.324048 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0c413ed8-41c2-48e4-913f-ec07e7ee4bfd tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:30:09.332233 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0c413ed8-41c2-48e4-913f-ec07e7ee4bfd tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1514 microversion: 2.1 time: 0.366246 Oct 05 03:30:09.333019 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3566/7118] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:30:08 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1514 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:30:10.358558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ec82858c-4556-4114-9415-f387e3465680 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:30:10.359276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ec82858c-4556-4114-9415-f387e3465680 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:30:10.365454 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec82858c-4556-4114-9415-f387e3465680 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:10.365954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec82858c-4556-4114-9415-f387e3465680 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:10.366396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec82858c-4556-4114-9415-f387e3465680 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:10.367097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec82858c-4556-4114-9415-f387e3465680 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:10.367564 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec82858c-4556-4114-9415-f387e3465680 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:10.367997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ec82858c-4556-4114-9415-f387e3465680 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:10.508956 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ec82858c-4556-4114-9415-f387e3465680 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:30:10.517381 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ec82858c-4556-4114-9415-f387e3465680 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1506 microversion: 2.1 time: 0.163935 Oct 05 03:30:10.517971 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3553/7119] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:30:10 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:30:10.541969 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8df54ec6-0cba-4a03-93bc-b13254d1991f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:30:10.542745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8df54ec6-0cba-4a03-93bc-b13254d1991f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:30:10.549538 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8df54ec6-0cba-4a03-93bc-b13254d1991f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:10.550027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8df54ec6-0cba-4a03-93bc-b13254d1991f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:10.550465 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8df54ec6-0cba-4a03-93bc-b13254d1991f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:10.551158 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8df54ec6-0cba-4a03-93bc-b13254d1991f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:10.551613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8df54ec6-0cba-4a03-93bc-b13254d1991f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:10.552041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8df54ec6-0cba-4a03-93bc-b13254d1991f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:10.682033 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8df54ec6-0cba-4a03-93bc-b13254d1991f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:30:10.690757 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8df54ec6-0cba-4a03-93bc-b13254d1991f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1506 microversion: 2.1 time: 0.152771 Oct 05 03:30:10.691334 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3567/7120] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:30:10 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:30:10.712720 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bf423e78-1a9c-4a94-8165-0ee0e7082800 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:30:10.713374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bf423e78-1a9c-4a94-8165-0ee0e7082800 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:30:10.719344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf423e78-1a9c-4a94-8165-0ee0e7082800 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:10.719843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf423e78-1a9c-4a94-8165-0ee0e7082800 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:10.720296 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf423e78-1a9c-4a94-8165-0ee0e7082800 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:10.721020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf423e78-1a9c-4a94-8165-0ee0e7082800 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:10.721497 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf423e78-1a9c-4a94-8165-0ee0e7082800 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:10.721938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf423e78-1a9c-4a94-8165-0ee0e7082800 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:10.848427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bf423e78-1a9c-4a94-8165-0ee0e7082800 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:30:10.857535 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bf423e78-1a9c-4a94-8165-0ee0e7082800 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1506 microversion: 2.1 time: 0.148604 Oct 05 03:30:10.858117 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3554/7121] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:30:10 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:30:10.880342 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-199239ab-90e6-48a4-a7ec-3f90b370a11f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:30:10.880789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-199239ab-90e6-48a4-a7ec-3f90b370a11f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:30:10.886889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-199239ab-90e6-48a4-a7ec-3f90b370a11f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:10.887378 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-199239ab-90e6-48a4-a7ec-3f90b370a11f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:10.887828 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-199239ab-90e6-48a4-a7ec-3f90b370a11f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:10.888526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-199239ab-90e6-48a4-a7ec-3f90b370a11f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:10.889016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-199239ab-90e6-48a4-a7ec-3f90b370a11f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:10.889453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-199239ab-90e6-48a4-a7ec-3f90b370a11f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:10.914035 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-199239ab-90e6-48a4-a7ec-3f90b370a11f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:30:10.990450 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-199239ab-90e6-48a4-a7ec-3f90b370a11f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 204 len: 0 microversion: 2.1 time: 0.113600 Oct 05 03:30:10.991044 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3568/7122] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:30:10 2022] DELETE /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:30:11.009326 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5898fd2a-57cb-42cb-804e-2468b6c82a4d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:30:11.009839 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5898fd2a-57cb-42cb-804e-2468b6c82a4d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:30:11.015960 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5898fd2a-57cb-42cb-804e-2468b6c82a4d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:11.016454 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5898fd2a-57cb-42cb-804e-2468b6c82a4d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:11.016918 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5898fd2a-57cb-42cb-804e-2468b6c82a4d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:11.017618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5898fd2a-57cb-42cb-804e-2468b6c82a4d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:11.018088 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5898fd2a-57cb-42cb-804e-2468b6c82a4d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:11.018521 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5898fd2a-57cb-42cb-804e-2468b6c82a4d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:11.044479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5898fd2a-57cb-42cb-804e-2468b6c82a4d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:30:11.087118 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.compute.api [None req-5898fd2a-57cb-42cb-804e-2468b6c82a4d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Instance is already in deleting state, ignoring this request Oct 05 03:30:11.088115 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5898fd2a-57cb-42cb-804e-2468b6c82a4d tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 204 len: 0 microversion: 2.1 time: 0.082663 Oct 05 03:30:11.088708 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3555/7123] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:30:11 2022] DELETE /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 03:30:11.098068 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7a8f6ab7-95fc-4903-ab76-3eb991f2ea94 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:30:11.098850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7a8f6ab7-95fc-4903-ab76-3eb991f2ea94 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:30:11.105783 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7a8f6ab7-95fc-4903-ab76-3eb991f2ea94 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:11.106282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7a8f6ab7-95fc-4903-ab76-3eb991f2ea94 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:11.106574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7a8f6ab7-95fc-4903-ab76-3eb991f2ea94 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:11.107255 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7a8f6ab7-95fc-4903-ab76-3eb991f2ea94 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:11.107708 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7a8f6ab7-95fc-4903-ab76-3eb991f2ea94 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:11.108130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7a8f6ab7-95fc-4903-ab76-3eb991f2ea94 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:11.252433 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-15d19da5-df32-4442-b608-ea372b3b453e req-f8d72fcb-6dd7-49d9-96d8-8669eabbe5a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b33bb2b9-2db7-4f0e-80c2-47c62d3a6165", "name": "network-vif-plugged", "status": "completed", "tag": "3eaf6eff-2c07-4a53-9364-3b0b0bd82ac0"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:30:11.255808 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7a8f6ab7-95fc-4903-ab76-3eb991f2ea94 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:30:11.264542 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-15d19da5-df32-4442-b608-ea372b3b453e req-f8d72fcb-6dd7-49d9-96d8-8669eabbe5a6 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:11.265152 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-15d19da5-df32-4442-b608-ea372b3b453e req-f8d72fcb-6dd7-49d9-96d8-8669eabbe5a6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:11.265660 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-15d19da5-df32-4442-b608-ea372b3b453e req-f8d72fcb-6dd7-49d9-96d8-8669eabbe5a6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:11.266033 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7a8f6ab7-95fc-4903-ab76-3eb991f2ea94 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1512 microversion: 2.1 time: 0.171885 Oct 05 03:30:11.266640 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3569/7124] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:30:11 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:30:11.281126 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-15d19da5-df32-4442-b608-ea372b3b453e req-f8d72fcb-6dd7-49d9-96d8-8669eabbe5a6 service nova] Creating event network-vif-plugged:3eaf6eff-2c07-4a53-9364-3b0b0bd82ac0 for instance b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 on n-h1-858272-3 Oct 05 03:30:11.283320 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-15d19da5-df32-4442-b608-ea372b3b453e req-f8d72fcb-6dd7-49d9-96d8-8669eabbe5a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034677 Oct 05 03:30:11.283997 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3556/7125] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:30:12.291092 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-990b5fc3-d276-49a5-b33b-1058501f5e45 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:30:12.291693 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-990b5fc3-d276-49a5-b33b-1058501f5e45 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:30:12.299564 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-990b5fc3-d276-49a5-b33b-1058501f5e45 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:12.300060 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-990b5fc3-d276-49a5-b33b-1058501f5e45 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:12.300501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-990b5fc3-d276-49a5-b33b-1058501f5e45 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:12.301246 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-990b5fc3-d276-49a5-b33b-1058501f5e45 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:12.301704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-990b5fc3-d276-49a5-b33b-1058501f5e45 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:12.302181 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-990b5fc3-d276-49a5-b33b-1058501f5e45 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:12.436273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-990b5fc3-d276-49a5-b33b-1058501f5e45 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9ae5054256463d8c9b1a0b8f627283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac0643217d0435887d49994cd7620e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:30:12.444426 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-990b5fc3-d276-49a5-b33b-1058501f5e45 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 200 len: 1512 microversion: 2.1 time: 0.157127 Oct 05 03:30:12.445076 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3570/7126] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:30:12 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:30:13.020082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-3a080a21-af36-455c-9007-eabf4ab596d4 req-179e6bda-a1f1-4952-ace4-362467052512 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b33bb2b9-2db7-4f0e-80c2-47c62d3a6165", "name": "network-vif-deleted", "tag": "3eaf6eff-2c07-4a53-9364-3b0b0bd82ac0"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:30:13.034456 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3a080a21-af36-455c-9007-eabf4ab596d4 req-179e6bda-a1f1-4952-ace4-362467052512 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:13.035130 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3a080a21-af36-455c-9007-eabf4ab596d4 req-179e6bda-a1f1-4952-ace4-362467052512 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:13.035654 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3a080a21-af36-455c-9007-eabf4ab596d4 req-179e6bda-a1f1-4952-ace4-362467052512 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:13.050010 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-3a080a21-af36-455c-9007-eabf4ab596d4 req-179e6bda-a1f1-4952-ace4-362467052512 service nova] Creating event network-vif-deleted:3eaf6eff-2c07-4a53-9364-3b0b0bd82ac0 for instance b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 on n-h1-858272-3 Oct 05 03:30:13.056355 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-3a080a21-af36-455c-9007-eabf4ab596d4 req-179e6bda-a1f1-4952-ace4-362467052512 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040901 Oct 05 03:30:13.057408 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3557/7127] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:30:13.468296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-13df106a-9de4-4077-b8df-6e8b4bf2761f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:30:13.468838 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-13df106a-9de4-4077-b8df-6e8b4bf2761f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: b33bb2b9-2db7-4f0e-80c2-47c62d3a6165] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:30:13.471707 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:30:13.477631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13df106a-9de4-4077-b8df-6e8b4bf2761f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:13.478474 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13df106a-9de4-4077-b8df-6e8b4bf2761f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:13.480634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13df106a-9de4-4077-b8df-6e8b4bf2761f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:13.481366 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13df106a-9de4-4077-b8df-6e8b4bf2761f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:13.481822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13df106a-9de4-4077-b8df-6e8b4bf2761f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:13.482248 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-13df106a-9de4-4077-b8df-6e8b4bf2761f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:13.496798 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-13df106a-9de4-4077-b8df-6e8b4bf2761f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] HTTP exception thrown: Instance b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 could not be found. Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-13df106a-9de4-4077-b8df-6e8b4bf2761f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Request method failure captured: Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 HTTP/1.1 Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPndp1J_hcTEhOsJzbv3xNn53xk9A8bNCRjGSS4NAI0S59obA1aquYZ-qlApN-z1X1mjw4O4016KI_8MhDGP8B4__B6QgaCT8L_ltCV60m_O9HeUUb--W0trkwILmP7lMsWUWwb7ntlP_xwfA8Nk39wLu_7a8oVxljSD7Z6plj-4oZY Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 1ac0643217d0435887d49994cd7620e4 Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerDiskConfigTestJSON-806607880 Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ac0643217d0435887d49994cd7620e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ac0643217d0435887d49994cd7620e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1ac0643217d0435887d49994cd7620e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1ac0643217d0435887d49994cd7620e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerDiskConfigTestJSON-806607880 Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 1ac0643217d0435887d49994cd7620e4 Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-806607880 Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerDiskConfigTestJSON-806607880-project Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 4e9ae5054256463d8c9b1a0b8f627283 Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerDiskConfigTestJSON-806607880-project Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 could not be found. Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'b33bb2b9-2db7-4f0e-80c2-47c62d3a6165'} Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 could not be found. Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 could not be found. Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:30:13.498487 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:30:13.502953 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:30:13.502953 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:30:13.502953 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:30:13.502953 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:30:13.502953 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:30:13.502953 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 could not be found. Oct 05 03:30:13.502953 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:30:13.502953 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-13df106a-9de4-4077-b8df-6e8b4bf2761f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Returning 404 to user: Instance b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:30:13.502953 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-13df106a-9de4-4077-b8df-6e8b4bf2761f tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165" status: 404 len: 111 microversion: 2.1 time: 0.036283 Oct 05 03:30:13.502953 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3571/7128] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:30:13 2022] GET /compute/v2.1/servers/b33bb2b9-2db7-4f0e-80c2-47c62d3a6165 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:30:13.509077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0ba66dcd-7928-4b99-8bb0-d4173866d7d3 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '.version_select at 0x7fccdc041820>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:30:13.530231 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0ba66dcd-7928-4b99-8bb0-d4173866d7d3 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1306575731" status: 202 len: 0 microversion: 2.1 time: 0.025200 Oct 05 03:30:13.530804 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3558/7129] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 5 03:30:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1306575731 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:30:14.124445 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9212e933-252e-4767-a14d-e2db834060bc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:30:14.124983 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9212e933-252e-4767-a14d-e2db834060bc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:30:14.131030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9212e933-252e-4767-a14d-e2db834060bc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:14.131514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9212e933-252e-4767-a14d-e2db834060bc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:14.131952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9212e933-252e-4767-a14d-e2db834060bc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:14.132647 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9212e933-252e-4767-a14d-e2db834060bc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:14.133137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9212e933-252e-4767-a14d-e2db834060bc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:14.133765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9212e933-252e-4767-a14d-e2db834060bc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:14.147773 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-9212e933-252e-4767-a14d-e2db834060bc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] HTTP exception thrown: Instance 3ca51737-c661-4544-83ef-7733bc65a968 could not be found. Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9212e933-252e-4767-a14d-e2db834060bc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Request method failure captured: Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 HTTP/1.1 Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPndp1J_hcTEhOsJzbv3xNn53xk9A8bNCRjGSS4NAI0S59obA1aquYZ-qlApN-z1X1mjw4O4016KI_8MhDGP8B4__B6QgaCT8L_ltCV60m_O9HeUUb--W0trkwILmP7lMsWUWwb7ntlP_xwfA8Nk39wLu_7a8oVxljSD7Z6plj-4oZY Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 1ac0643217d0435887d49994cd7620e4 Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerDiskConfigTestJSON-806607880 Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ac0643217d0435887d49994cd7620e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ac0643217d0435887d49994cd7620e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1ac0643217d0435887d49994cd7620e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1ac0643217d0435887d49994cd7620e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerDiskConfigTestJSON-806607880 Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 1ac0643217d0435887d49994cd7620e4 Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-806607880 Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerDiskConfigTestJSON-806607880-project Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 4e9ae5054256463d8c9b1a0b8f627283 Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerDiskConfigTestJSON-806607880-project Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 3ca51737-c661-4544-83ef-7733bc65a968 could not be found. Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '3ca51737-c661-4544-83ef-7733bc65a968'} Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ca51737-c661-4544-83ef-7733bc65a968 could not be found. Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:30:14.149329 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:30:14.153687 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ca51737-c661-4544-83ef-7733bc65a968 could not be found. Oct 05 03:30:14.153687 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:30:14.153687 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:30:14.153687 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:30:14.153687 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:30:14.153687 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:30:14.153687 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:30:14.153687 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:30:14.153687 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:30:14.153687 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ca51737-c661-4544-83ef-7733bc65a968 could not be found. Oct 05 03:30:14.153687 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:30:14.153687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9212e933-252e-4767-a14d-e2db834060bc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Returning 404 to user: Instance 3ca51737-c661-4544-83ef-7733bc65a968 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:30:14.153687 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9212e933-252e-4767-a14d-e2db834060bc tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 404 len: 111 microversion: 2.1 time: 0.031038 Oct 05 03:30:14.153687 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3572/7130] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:30:14 2022] DELETE /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:30:14.159203 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9917ce07-c6f1-46d7-b636-8a54768c4144 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:30:14.159959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9917ce07-c6f1-46d7-b636-8a54768c4144 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] [instance: 3ca51737-c661-4544-83ef-7733bc65a968] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:30:14.162708 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:30:14.168958 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9917ce07-c6f1-46d7-b636-8a54768c4144 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:14.169465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9917ce07-c6f1-46d7-b636-8a54768c4144 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:14.169919 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9917ce07-c6f1-46d7-b636-8a54768c4144 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:14.170620 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9917ce07-c6f1-46d7-b636-8a54768c4144 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:14.171092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9917ce07-c6f1-46d7-b636-8a54768c4144 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:14.171533 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9917ce07-c6f1-46d7-b636-8a54768c4144 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:14.185762 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-9917ce07-c6f1-46d7-b636-8a54768c4144 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] HTTP exception thrown: Instance 3ca51737-c661-4544-83ef-7733bc65a968 could not be found. Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9917ce07-c6f1-46d7-b636-8a54768c4144 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Request method failure captured: Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 HTTP/1.1 Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPndp1J_hcTEhOsJzbv3xNn53xk9A8bNCRjGSS4NAI0S59obA1aquYZ-qlApN-z1X1mjw4O4016KI_8MhDGP8B4__B6QgaCT8L_ltCV60m_O9HeUUb--W0trkwILmP7lMsWUWwb7ntlP_xwfA8Nk39wLu_7a8oVxljSD7Z6plj-4oZY Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 1ac0643217d0435887d49994cd7620e4 Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServerDiskConfigTestJSON-806607880 Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ac0643217d0435887d49994cd7620e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ac0643217d0435887d49994cd7620e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1ac0643217d0435887d49994cd7620e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1ac0643217d0435887d49994cd7620e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServerDiskConfigTestJSON-806607880 Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 1ac0643217d0435887d49994cd7620e4 Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-806607880 Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServerDiskConfigTestJSON-806607880-project Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 4e9ae5054256463d8c9b1a0b8f627283 Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServerDiskConfigTestJSON-806607880-project Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 3ca51737-c661-4544-83ef-7733bc65a968 could not be found. Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '3ca51737-c661-4544-83ef-7733bc65a968'} Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ca51737-c661-4544-83ef-7733bc65a968 could not be found. Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ca51737-c661-4544-83ef-7733bc65a968 could not be found. Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:30:14.187403 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:30:14.191716 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:30:14.191716 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:30:14.191716 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:30:14.191716 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:30:14.191716 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:30:14.191716 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ca51737-c661-4544-83ef-7733bc65a968 could not be found. Oct 05 03:30:14.191716 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:30:14.191716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9917ce07-c6f1-46d7-b636-8a54768c4144 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] Returning 404 to user: Instance 3ca51737-c661-4544-83ef-7733bc65a968 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:30:14.191716 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9917ce07-c6f1-46d7-b636-8a54768c4144 tempest-ServerDiskConfigTestJSON-806607880 tempest-ServerDiskConfigTestJSON-806607880-project] 10.222.0.16 "GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968" status: 404 len: 111 microversion: 2.1 time: 0.033498 Oct 05 03:30:14.191716 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3559/7131] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:30:14 2022] GET /compute/v2.1/servers/3ca51737-c661-4544-83ef-7733bc65a968 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:30:23.036251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-91e8c8b3-fa6b-48e7-89cc-5598e3e5ba88 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Action: 'create', calling method: .version_select at 0x7fccdf203670>, body: {"keypair": {"name": "tempest-keypair-904238654", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvUeKbNMoVOu2xlv8r49axrXAQGwlHutXqOA3ljliMHYwWc1CaGTv/EnBmYgTr9MXKC/H98lWysOJbOLMlv9T6aDMlRmOEzaue8qxwLJuEj39aIuy5GNPhMDVCi6s466w=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:30:23.053321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-91e8c8b3-fa6b-48e7-89cc-5598e3e5ba88 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Getting quotas for project cb907a92ab7949ebb3cb2e3b5d372ece. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:30:23.059031 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-91e8c8b3-fa6b-48e7-89cc-5598e3e5ba88 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Getting quotas for user 64375d765c0949dbb75c91906f8bca3c and project cb907a92ab7949ebb3cb2e3b5d372ece. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:30:23.087279 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-91e8c8b3-fa6b-48e7-89cc-5598e3e5ba88 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.179777 Oct 05 03:30:23.088092 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3573/7132] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 03:30:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:30:24.729433 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-db86decb-03fa-4f9f-aa03-a62c2b482f2c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-87285937", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e3e1b2b6-bb43-4574-b227-e8169188bcd9"}], "security_groups": [{"name": "tempest-securitygroup--711774869"}], "key_name": "tempest-keypair-904238654", "user_data": "}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:30:24.738353 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:30:24.739186 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:30:24.845332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-db86decb-03fa-4f9f-aa03-a62c2b482f2c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] validate_networks() for [('e3e1b2b6-bb43-4574-b227-e8169188bcd9', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:30:25.254752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-db86decb-03fa-4f9f-aa03-a62c2b482f2c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:30:25.255202 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-db86decb-03fa-4f9f-aa03-a62c2b482f2c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:30:25.255711 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-db86decb-03fa-4f9f-aa03-a62c2b482f2c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:30:25.256311 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-db86decb-03fa-4f9f-aa03-a62c2b482f2c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:30:25.256764 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-db86decb-03fa-4f9f-aa03-a62c2b482f2c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:30:25.266143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db86decb-03fa-4f9f-aa03-a62c2b482f2c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:25.266642 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db86decb-03fa-4f9f-aa03-a62c2b482f2c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:25.267269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db86decb-03fa-4f9f-aa03-a62c2b482f2c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:25.268055 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db86decb-03fa-4f9f-aa03-a62c2b482f2c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:25.268492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db86decb-03fa-4f9f-aa03-a62c2b482f2c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:25.268944 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db86decb-03fa-4f9f-aa03-a62c2b482f2c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:25.287316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-db86decb-03fa-4f9f-aa03-a62c2b482f2c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Getting quotas for project cb907a92ab7949ebb3cb2e3b5d372ece. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:30:25.293433 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-db86decb-03fa-4f9f-aa03-a62c2b482f2c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Getting quotas for user 64375d765c0949dbb75c91906f8bca3c and project cb907a92ab7949ebb3cb2e3b5d372ece. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:30:25.307872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-db86decb-03fa-4f9f-aa03-a62c2b482f2c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:30:25.310295 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-db86decb-03fa-4f9f-aa03-a62c2b482f2c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:30:25.367210 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-db86decb-03fa-4f9f-aa03-a62c2b482f2c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.642683 Oct 05 03:30:25.382858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:30:25.389671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4430e9a0-c6a3-462a-9f2c-3f32923ad2bf tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:30:25.391653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4430e9a0-c6a3-462a-9f2c-3f32923ad2bf tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:30:25.401273 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3560/7133] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:30:24 2022] POST /compute/v2.1/servers => generated 408 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:30:25.460116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4430e9a0-c6a3-462a-9f2c-3f32923ad2bf tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:30:25.471272 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4430e9a0-c6a3-462a-9f2c-3f32923ad2bf tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1236 microversion: 2.1 time: 0.089883 Oct 05 03:30:25.473481 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3574/7134] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:30:25 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1236 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:30:26.496686 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-332e693f-8449-4fbf-89e9-61e44d48ce17 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:30:26.497457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-332e693f-8449-4fbf-89e9-61e44d48ce17 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:30:26.504543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-332e693f-8449-4fbf-89e9-61e44d48ce17 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:26.505011 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-332e693f-8449-4fbf-89e9-61e44d48ce17 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:26.505492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-332e693f-8449-4fbf-89e9-61e44d48ce17 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:26.506206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-332e693f-8449-4fbf-89e9-61e44d48ce17 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:26.506788 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-332e693f-8449-4fbf-89e9-61e44d48ce17 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:26.507261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-332e693f-8449-4fbf-89e9-61e44d48ce17 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:26.613821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-332e693f-8449-4fbf-89e9-61e44d48ce17 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:30:26.622747 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-332e693f-8449-4fbf-89e9-61e44d48ce17 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1296 microversion: 2.1 time: 0.131030 Oct 05 03:30:26.623404 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3561/7135] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:30:26 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1296 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:30:27.647165 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-07906e79-c116-4593-a09b-fe84534fbd7a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:30:27.648235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-07906e79-c116-4593-a09b-fe84534fbd7a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:30:27.655236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-07906e79-c116-4593-a09b-fe84534fbd7a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:27.655727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-07906e79-c116-4593-a09b-fe84534fbd7a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:27.656160 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-07906e79-c116-4593-a09b-fe84534fbd7a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:27.656889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-07906e79-c116-4593-a09b-fe84534fbd7a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:27.657367 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-07906e79-c116-4593-a09b-fe84534fbd7a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:27.657789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-07906e79-c116-4593-a09b-fe84534fbd7a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:27.891401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-07906e79-c116-4593-a09b-fe84534fbd7a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:30:27.899773 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-07906e79-c116-4593-a09b-fe84534fbd7a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1361 microversion: 2.1 time: 0.256472 Oct 05 03:30:27.900354 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3575/7136] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:30:27 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1361 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:30:28.116567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-fe9f051e-3a54-4b11-9bb5-383898c4f240 req-090f3a61-46a1-464e-a9d3-007f7a0f76ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd06f250-ceb9-4d45-bc1d-842f06cb7589", "tag": "09f9c901-45ce-4a1d-a0f5-bf3dd1f43e7c"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:30:28.129197 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-fe9f051e-3a54-4b11-9bb5-383898c4f240 req-090f3a61-46a1-464e-a9d3-007f7a0f76ef service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:28.130440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-fe9f051e-3a54-4b11-9bb5-383898c4f240 req-090f3a61-46a1-464e-a9d3-007f7a0f76ef service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:28.131035 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-fe9f051e-3a54-4b11-9bb5-383898c4f240 req-090f3a61-46a1-464e-a9d3-007f7a0f76ef service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:28.144814 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-fe9f051e-3a54-4b11-9bb5-383898c4f240 req-090f3a61-46a1-464e-a9d3-007f7a0f76ef service nova] Creating event network-changed:09f9c901-45ce-4a1d-a0f5-bf3dd1f43e7c for instance bd06f250-ceb9-4d45-bc1d-842f06cb7589 on n-h1-858272-3 Oct 05 03:30:28.149751 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-fe9f051e-3a54-4b11-9bb5-383898c4f240 req-090f3a61-46a1-464e-a9d3-007f7a0f76ef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037010 Oct 05 03:30:28.150655 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3562/7137] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:30:28.923033 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-933030e1-4556-4a50-9eeb-db24bd97f7f1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:30:28.923676 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-933030e1-4556-4a50-9eeb-db24bd97f7f1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:30:28.930515 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-933030e1-4556-4a50-9eeb-db24bd97f7f1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:28.930995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-933030e1-4556-4a50-9eeb-db24bd97f7f1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:28.931433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-933030e1-4556-4a50-9eeb-db24bd97f7f1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:28.932112 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-933030e1-4556-4a50-9eeb-db24bd97f7f1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:28.932603 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-933030e1-4556-4a50-9eeb-db24bd97f7f1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:28.933490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-933030e1-4556-4a50-9eeb-db24bd97f7f1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:29.067620 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-933030e1-4556-4a50-9eeb-db24bd97f7f1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:30:29.076201 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-933030e1-4556-4a50-9eeb-db24bd97f7f1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1361 microversion: 2.1 time: 0.157022 Oct 05 03:30:29.076781 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3576/7138] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:30:28 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:30:30.099962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-68bae39d-5913-4f30-8614-ca3d8a22d674 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:30:30.100696 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-68bae39d-5913-4f30-8614-ca3d8a22d674 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:30:30.107747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68bae39d-5913-4f30-8614-ca3d8a22d674 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:30.108242 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68bae39d-5913-4f30-8614-ca3d8a22d674 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:30.108717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68bae39d-5913-4f30-8614-ca3d8a22d674 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:30.109442 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68bae39d-5913-4f30-8614-ca3d8a22d674 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:30.109910 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68bae39d-5913-4f30-8614-ca3d8a22d674 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:30.110345 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68bae39d-5913-4f30-8614-ca3d8a22d674 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:30.239099 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-68bae39d-5913-4f30-8614-ca3d8a22d674 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:30:30.247047 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-68bae39d-5913-4f30-8614-ca3d8a22d674 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1361 microversion: 2.1 time: 0.152204 Oct 05 03:30:30.247615 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3563/7139] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:30:30 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:30:31.270706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a09085d2-7b88-4c40-b80a-7cfc0701f13c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:30:31.271252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a09085d2-7b88-4c40-b80a-7cfc0701f13c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:30:31.278724 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a09085d2-7b88-4c40-b80a-7cfc0701f13c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:31.279209 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a09085d2-7b88-4c40-b80a-7cfc0701f13c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:31.279640 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a09085d2-7b88-4c40-b80a-7cfc0701f13c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:31.280321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a09085d2-7b88-4c40-b80a-7cfc0701f13c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:31.280772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a09085d2-7b88-4c40-b80a-7cfc0701f13c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:31.281230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a09085d2-7b88-4c40-b80a-7cfc0701f13c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:31.410151 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a09085d2-7b88-4c40-b80a-7cfc0701f13c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:30:31.418565 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a09085d2-7b88-4c40-b80a-7cfc0701f13c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1361 microversion: 2.1 time: 0.152007 Oct 05 03:30:31.419138 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3577/7140] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:30:31 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:30:32.440998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-71c62d58-f0ac-45ca-acaa-9f0558099b17 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:30:32.441631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-71c62d58-f0ac-45ca-acaa-9f0558099b17 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:30:32.449344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71c62d58-f0ac-45ca-acaa-9f0558099b17 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:32.449851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71c62d58-f0ac-45ca-acaa-9f0558099b17 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:32.450309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71c62d58-f0ac-45ca-acaa-9f0558099b17 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:32.451007 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71c62d58-f0ac-45ca-acaa-9f0558099b17 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:32.451478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71c62d58-f0ac-45ca-acaa-9f0558099b17 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:32.451918 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71c62d58-f0ac-45ca-acaa-9f0558099b17 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:32.583154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-71c62d58-f0ac-45ca-acaa-9f0558099b17 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:30:32.591474 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-71c62d58-f0ac-45ca-acaa-9f0558099b17 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1361 microversion: 2.1 time: 0.154458 Oct 05 03:30:32.592027 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3564/7141] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:30:32 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:30:33.614348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6b0cfe39-80bc-4592-bd15-0185ecb530fc tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:30:33.615047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6b0cfe39-80bc-4592-bd15-0185ecb530fc tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:30:33.622824 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b0cfe39-80bc-4592-bd15-0185ecb530fc tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:33.623364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b0cfe39-80bc-4592-bd15-0185ecb530fc tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:33.623818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b0cfe39-80bc-4592-bd15-0185ecb530fc tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:33.624536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b0cfe39-80bc-4592-bd15-0185ecb530fc tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:33.625027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b0cfe39-80bc-4592-bd15-0185ecb530fc tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:33.625462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b0cfe39-80bc-4592-bd15-0185ecb530fc tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:33.758223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6b0cfe39-80bc-4592-bd15-0185ecb530fc tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:30:33.766340 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6b0cfe39-80bc-4592-bd15-0185ecb530fc tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1361 microversion: 2.1 time: 0.155986 Oct 05 03:30:33.766993 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3578/7142] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:30:33 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:30:34.789757 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1dd3301d-ba8a-4887-ab69-41c91728f9b1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:30:34.790391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1dd3301d-ba8a-4887-ab69-41c91728f9b1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:30:34.797209 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1dd3301d-ba8a-4887-ab69-41c91728f9b1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:34.797709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1dd3301d-ba8a-4887-ab69-41c91728f9b1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:34.798156 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1dd3301d-ba8a-4887-ab69-41c91728f9b1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:34.798869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1dd3301d-ba8a-4887-ab69-41c91728f9b1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:34.799318 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1dd3301d-ba8a-4887-ab69-41c91728f9b1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:34.799755 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1dd3301d-ba8a-4887-ab69-41c91728f9b1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:34.932787 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1dd3301d-ba8a-4887-ab69-41c91728f9b1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:30:34.940704 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1dd3301d-ba8a-4887-ab69-41c91728f9b1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1361 microversion: 2.1 time: 0.154851 Oct 05 03:30:34.941326 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3565/7143] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:30:34 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:30:35.283326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-29473c0d-0a6d-42a7-acd4-f427235e0613 req-603574c2-f637-44f6-9594-ef1763e33368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd06f250-ceb9-4d45-bc1d-842f06cb7589", "name": "network-vif-plugged", "status": "completed", "tag": "09f9c901-45ce-4a1d-a0f5-bf3dd1f43e7c"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:30:35.294131 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-29473c0d-0a6d-42a7-acd4-f427235e0613 req-603574c2-f637-44f6-9594-ef1763e33368 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:35.294620 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-29473c0d-0a6d-42a7-acd4-f427235e0613 req-603574c2-f637-44f6-9594-ef1763e33368 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:35.295052 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-29473c0d-0a6d-42a7-acd4-f427235e0613 req-603574c2-f637-44f6-9594-ef1763e33368 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:35.318071 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-29473c0d-0a6d-42a7-acd4-f427235e0613 req-603574c2-f637-44f6-9594-ef1763e33368 service nova] Creating event network-vif-plugged:09f9c901-45ce-4a1d-a0f5-bf3dd1f43e7c for instance bd06f250-ceb9-4d45-bc1d-842f06cb7589 on n-h1-858272-3 Oct 05 03:30:35.323067 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-29473c0d-0a6d-42a7-acd4-f427235e0613 req-603574c2-f637-44f6-9594-ef1763e33368 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043440 Oct 05 03:30:35.323687 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3579/7144] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:30:35.963720 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9feb8e36-85d6-4665-aab7-ea4eaecc139f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:30:35.964384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9feb8e36-85d6-4665-aab7-ea4eaecc139f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:30:35.966430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:30:35.967150 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:30:35.973913 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9feb8e36-85d6-4665-aab7-ea4eaecc139f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:35.974427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9feb8e36-85d6-4665-aab7-ea4eaecc139f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:35.974890 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9feb8e36-85d6-4665-aab7-ea4eaecc139f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:35.975604 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9feb8e36-85d6-4665-aab7-ea4eaecc139f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:35.976121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9feb8e36-85d6-4665-aab7-ea4eaecc139f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:35.976570 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9feb8e36-85d6-4665-aab7-ea4eaecc139f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:36.126442 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9feb8e36-85d6-4665-aab7-ea4eaecc139f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:30:36.134505 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9feb8e36-85d6-4665-aab7-ea4eaecc139f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1361 microversion: 2.1 time: 0.174700 Oct 05 03:30:36.135100 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3566/7145] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:30:35 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:30:37.155403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:30:37.160591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d0a77957-f725-4d2e-8b8c-be83fdb97954 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:30:37.161317 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d0a77957-f725-4d2e-8b8c-be83fdb97954 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:30:37.167859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d0a77957-f725-4d2e-8b8c-be83fdb97954 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:37.168340 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d0a77957-f725-4d2e-8b8c-be83fdb97954 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:37.168780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d0a77957-f725-4d2e-8b8c-be83fdb97954 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:37.169498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d0a77957-f725-4d2e-8b8c-be83fdb97954 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:37.169956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d0a77957-f725-4d2e-8b8c-be83fdb97954 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:37.170411 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d0a77957-f725-4d2e-8b8c-be83fdb97954 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:37.303882 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d0a77957-f725-4d2e-8b8c-be83fdb97954 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:30:37.312145 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d0a77957-f725-4d2e-8b8c-be83fdb97954 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1549 microversion: 2.1 time: 0.157712 Oct 05 03:30:37.312719 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3580/7146] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:30:37 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:30:37.335234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-94af0232-0fbb-4418-a2a6-848a4592b58e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:30:37.335737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-94af0232-0fbb-4418-a2a6-848a4592b58e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:30:37.342792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94af0232-0fbb-4418-a2a6-848a4592b58e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:37.343292 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94af0232-0fbb-4418-a2a6-848a4592b58e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:37.343747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94af0232-0fbb-4418-a2a6-848a4592b58e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:37.344456 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94af0232-0fbb-4418-a2a6-848a4592b58e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:37.344958 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94af0232-0fbb-4418-a2a6-848a4592b58e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:37.345405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-94af0232-0fbb-4418-a2a6-848a4592b58e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:37.429081 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-94af0232-0fbb-4418-a2a6-848a4592b58e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097700 Oct 05 03:30:37.429786 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3567/7147] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 03:30:37 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:30:38.346746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-11dbc0c3-4005-43dd-be2f-cc1b893bc00b req-6d27b75b-a6ab-408a-99e4-eb706c0d0193 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd06f250-ceb9-4d45-bc1d-842f06cb7589", "tag": "09f9c901-45ce-4a1d-a0f5-bf3dd1f43e7c"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:30:38.357871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-11dbc0c3-4005-43dd-be2f-cc1b893bc00b req-6d27b75b-a6ab-408a-99e4-eb706c0d0193 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:30:38.358351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-11dbc0c3-4005-43dd-be2f-cc1b893bc00b req-6d27b75b-a6ab-408a-99e4-eb706c0d0193 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:30:38.358779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-11dbc0c3-4005-43dd-be2f-cc1b893bc00b req-6d27b75b-a6ab-408a-99e4-eb706c0d0193 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:30:38.369791 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-11dbc0c3-4005-43dd-be2f-cc1b893bc00b req-6d27b75b-a6ab-408a-99e4-eb706c0d0193 service nova] Creating event network-changed:09f9c901-45ce-4a1d-a0f5-bf3dd1f43e7c for instance bd06f250-ceb9-4d45-bc1d-842f06cb7589 on n-h1-858272-3 Oct 05 03:30:38.375438 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-11dbc0c3-4005-43dd-be2f-cc1b893bc00b req-6d27b75b-a6ab-408a-99e4-eb706c0d0193 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032450 Oct 05 03:30:38.377631 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3581/7148] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:31:43.061396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:31:43.062189 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=38 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:31:43.067379 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a5f3b53d-cc55-402f-9d5a-cd9f20d58823 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:31:43.068006 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a5f3b53d-cc55-402f-9d5a-cd9f20d58823 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:31:43.076781 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5f3b53d-cc55-402f-9d5a-cd9f20d58823 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:43.077304 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5f3b53d-cc55-402f-9d5a-cd9f20d58823 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:43.077754 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5f3b53d-cc55-402f-9d5a-cd9f20d58823 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:43.078451 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5f3b53d-cc55-402f-9d5a-cd9f20d58823 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:43.078917 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5f3b53d-cc55-402f-9d5a-cd9f20d58823 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:43.079352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a5f3b53d-cc55-402f-9d5a-cd9f20d58823 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:43.262182 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a5f3b53d-cc55-402f-9d5a-cd9f20d58823 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:31:43.269901 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a5f3b53d-cc55-402f-9d5a-cd9f20d58823 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1668 microversion: 2.1 time: 0.211430 Oct 05 03:31:43.270476 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3568/7149] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:31:43 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1668 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:31:43.290942 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:31:43.292345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=34 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:31:43.293153 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 03:31:43.293338 n-d-858272-3 devstack@n-api.service[122319]: Wed Oct 5 03:31:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 (ip 10.222.0.16) !!! Oct 05 03:31:43.299488 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-60f44157-f4ea-4014-83f8-498622d5b8d7 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:31:43.300193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-60f44157-f4ea-4014-83f8-498622d5b8d7 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:31:43.309611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60f44157-f4ea-4014-83f8-498622d5b8d7 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:43.310099 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60f44157-f4ea-4014-83f8-498622d5b8d7 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:43.310539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60f44157-f4ea-4014-83f8-498622d5b8d7 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:43.311230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60f44157-f4ea-4014-83f8-498622d5b8d7 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:43.311735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60f44157-f4ea-4014-83f8-498622d5b8d7 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:43.312123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60f44157-f4ea-4014-83f8-498622d5b8d7 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:43.498104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-60f44157-f4ea-4014-83f8-498622d5b8d7 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:31:43.505857 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-60f44157-f4ea-4014-83f8-498622d5b8d7 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1668 microversion: 2.1 time: 0.217688 Oct 05 03:31:43.506431 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3582/7150] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:31:43 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1668 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:31:43.528070 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5af831e8-254c-43aa-8178-34dd6f5c74c1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:31:43.528706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5af831e8-254c-43aa-8178-34dd6f5c74c1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:31:43.534728 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5af831e8-254c-43aa-8178-34dd6f5c74c1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:43.535237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5af831e8-254c-43aa-8178-34dd6f5c74c1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:43.535738 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5af831e8-254c-43aa-8178-34dd6f5c74c1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:43.536446 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5af831e8-254c-43aa-8178-34dd6f5c74c1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:43.536941 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5af831e8-254c-43aa-8178-34dd6f5c74c1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:43.537388 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5af831e8-254c-43aa-8178-34dd6f5c74c1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:43.668954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5af831e8-254c-43aa-8178-34dd6f5c74c1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:31:43.676732 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5af831e8-254c-43aa-8178-34dd6f5c74c1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1668 microversion: 2.1 time: 0.152689 Oct 05 03:31:43.677348 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3569/7151] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:31:43 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:31:43.699245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e1a0f25d-9b85-4e98-9b92-9afe35581cb6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:31:43.701514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e1a0f25d-9b85-4e98-9b92-9afe35581cb6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:31:43.707475 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e1a0f25d-9b85-4e98-9b92-9afe35581cb6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:43.707973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e1a0f25d-9b85-4e98-9b92-9afe35581cb6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:43.708402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e1a0f25d-9b85-4e98-9b92-9afe35581cb6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:43.709123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e1a0f25d-9b85-4e98-9b92-9afe35581cb6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:43.709583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e1a0f25d-9b85-4e98-9b92-9afe35581cb6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:43.710009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e1a0f25d-9b85-4e98-9b92-9afe35581cb6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:43.739276 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e1a0f25d-9b85-4e98-9b92-9afe35581cb6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:31:43.744790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e1a0f25d-9b85-4e98-9b92-9afe35581cb6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Old instance type m1.heat2, new instance type m1.heat {{(pid=122319) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 05 03:31:43.751344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e1a0f25d-9b85-4e98-9b92-9afe35581cb6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:31:43.751770 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e1a0f25d-9b85-4e98-9b92-9afe35581cb6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:31:43.752271 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e1a0f25d-9b85-4e98-9b92-9afe35581cb6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:31:43.752677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e1a0f25d-9b85-4e98-9b92-9afe35581cb6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:31:43.753115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e1a0f25d-9b85-4e98-9b92-9afe35581cb6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:31:43.815718 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e1a0f25d-9b85-4e98-9b92-9afe35581cb6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "POST /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589/action" status: 202 len: 0 microversion: 2.1 time: 0.120396 Oct 05 03:31:43.816338 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3583/7152] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:31:43 2022] POST /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:31:43.825352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a2a3a746-5ef0-4a67-b50c-caad050febc2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:31:43.825982 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a2a3a746-5ef0-4a67-b50c-caad050febc2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:31:43.831852 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2a3a746-5ef0-4a67-b50c-caad050febc2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:43.832337 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2a3a746-5ef0-4a67-b50c-caad050febc2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:43.832785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2a3a746-5ef0-4a67-b50c-caad050febc2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:43.833516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2a3a746-5ef0-4a67-b50c-caad050febc2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:43.833985 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2a3a746-5ef0-4a67-b50c-caad050febc2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:43.834419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a2a3a746-5ef0-4a67-b50c-caad050febc2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:43.990692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a2a3a746-5ef0-4a67-b50c-caad050febc2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:31:43.999367 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a2a3a746-5ef0-4a67-b50c-caad050febc2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1677 microversion: 2.1 time: 0.178428 Oct 05 03:31:43.999960 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3570/7153] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:31:43 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:31:45.024589 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-af485615-9ec4-4ee0-a4c0-6903090b29e3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:31:45.025323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-af485615-9ec4-4ee0-a4c0-6903090b29e3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:31:45.032831 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af485615-9ec4-4ee0-a4c0-6903090b29e3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:45.033352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af485615-9ec4-4ee0-a4c0-6903090b29e3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:45.033898 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af485615-9ec4-4ee0-a4c0-6903090b29e3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:45.034593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af485615-9ec4-4ee0-a4c0-6903090b29e3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:45.035250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af485615-9ec4-4ee0-a4c0-6903090b29e3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:45.035650 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af485615-9ec4-4ee0-a4c0-6903090b29e3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:45.209099 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-af485615-9ec4-4ee0-a4c0-6903090b29e3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:31:45.216840 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-af485615-9ec4-4ee0-a4c0-6903090b29e3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1677 microversion: 2.1 time: 0.197081 Oct 05 03:31:45.217449 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3584/7154] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:31:45 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1677 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:31:46.240742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f5180015-f3a1-445f-b53d-702ebb508732 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:31:46.241338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f5180015-f3a1-445f-b53d-702ebb508732 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:31:46.248262 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5180015-f3a1-445f-b53d-702ebb508732 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:46.248768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5180015-f3a1-445f-b53d-702ebb508732 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:46.249253 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5180015-f3a1-445f-b53d-702ebb508732 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:46.249962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5180015-f3a1-445f-b53d-702ebb508732 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:46.250436 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5180015-f3a1-445f-b53d-702ebb508732 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:46.250877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f5180015-f3a1-445f-b53d-702ebb508732 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:46.385797 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f5180015-f3a1-445f-b53d-702ebb508732 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:31:46.394149 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f5180015-f3a1-445f-b53d-702ebb508732 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1682 microversion: 2.1 time: 0.157375 Oct 05 03:31:46.394719 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3571/7155] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:31:46 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:31:47.418855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-37c749aa-28c3-4ca9-bbbe-f8d0738dffd3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:31:47.419495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-37c749aa-28c3-4ca9-bbbe-f8d0738dffd3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:31:47.426272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37c749aa-28c3-4ca9-bbbe-f8d0738dffd3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:47.426753 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37c749aa-28c3-4ca9-bbbe-f8d0738dffd3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:47.427186 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37c749aa-28c3-4ca9-bbbe-f8d0738dffd3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:47.427871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37c749aa-28c3-4ca9-bbbe-f8d0738dffd3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:47.428323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37c749aa-28c3-4ca9-bbbe-f8d0738dffd3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:47.428746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37c749aa-28c3-4ca9-bbbe-f8d0738dffd3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:47.561227 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-37c749aa-28c3-4ca9-bbbe-f8d0738dffd3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:31:47.568928 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-37c749aa-28c3-4ca9-bbbe-f8d0738dffd3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1682 microversion: 2.1 time: 0.154643 Oct 05 03:31:47.569529 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3585/7156] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:31:47 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:31:48.592693 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d2eb3b1b-29b4-4829-90ac-925d2072264b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:31:48.593366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d2eb3b1b-29b4-4829-90ac-925d2072264b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:31:48.599558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2eb3b1b-29b4-4829-90ac-925d2072264b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:48.600058 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2eb3b1b-29b4-4829-90ac-925d2072264b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:48.600515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2eb3b1b-29b4-4829-90ac-925d2072264b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:48.601250 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2eb3b1b-29b4-4829-90ac-925d2072264b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:48.601984 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2eb3b1b-29b4-4829-90ac-925d2072264b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:48.602427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2eb3b1b-29b4-4829-90ac-925d2072264b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:48.737464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d2eb3b1b-29b4-4829-90ac-925d2072264b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:31:48.745142 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d2eb3b1b-29b4-4829-90ac-925d2072264b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1682 microversion: 2.1 time: 0.156610 Oct 05 03:31:48.745714 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3572/7157] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:31:48 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:31:49.769229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e8cda394-e793-4e47-8a6c-591ebba9626a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:31:49.769848 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e8cda394-e793-4e47-8a6c-591ebba9626a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:31:49.777735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8cda394-e793-4e47-8a6c-591ebba9626a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:49.778240 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8cda394-e793-4e47-8a6c-591ebba9626a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:49.778674 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8cda394-e793-4e47-8a6c-591ebba9626a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:49.779379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8cda394-e793-4e47-8a6c-591ebba9626a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:49.779832 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8cda394-e793-4e47-8a6c-591ebba9626a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:49.780262 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8cda394-e793-4e47-8a6c-591ebba9626a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:49.912345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e8cda394-e793-4e47-8a6c-591ebba9626a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:31:49.920738 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e8cda394-e793-4e47-8a6c-591ebba9626a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1682 microversion: 2.1 time: 0.155386 Oct 05 03:31:49.921300 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3586/7158] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:31:49 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:31:50.944009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cf3a4139-3301-4589-af8f-6ec6e0505626 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:31:50.944650 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cf3a4139-3301-4589-af8f-6ec6e0505626 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:31:50.951790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf3a4139-3301-4589-af8f-6ec6e0505626 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:50.952309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf3a4139-3301-4589-af8f-6ec6e0505626 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:50.952763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf3a4139-3301-4589-af8f-6ec6e0505626 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:50.953495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf3a4139-3301-4589-af8f-6ec6e0505626 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:50.953973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf3a4139-3301-4589-af8f-6ec6e0505626 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:50.954417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf3a4139-3301-4589-af8f-6ec6e0505626 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:51.085739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cf3a4139-3301-4589-af8f-6ec6e0505626 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:31:51.094295 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cf3a4139-3301-4589-af8f-6ec6e0505626 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1682 microversion: 2.1 time: 0.154549 Oct 05 03:31:51.094870 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3573/7159] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:31:50 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:31:52.120010 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5f5da65a-2e37-4e78-9415-3943180b7bc1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:31:52.120654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5f5da65a-2e37-4e78-9415-3943180b7bc1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:31:52.128311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f5da65a-2e37-4e78-9415-3943180b7bc1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:52.128835 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f5da65a-2e37-4e78-9415-3943180b7bc1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:52.129334 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f5da65a-2e37-4e78-9415-3943180b7bc1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:52.130037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f5da65a-2e37-4e78-9415-3943180b7bc1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:52.130496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f5da65a-2e37-4e78-9415-3943180b7bc1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:52.130931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f5da65a-2e37-4e78-9415-3943180b7bc1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:52.262323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5f5da65a-2e37-4e78-9415-3943180b7bc1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:31:52.270106 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5f5da65a-2e37-4e78-9415-3943180b7bc1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1682 microversion: 2.1 time: 0.155679 Oct 05 03:31:52.270694 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3587/7160] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:31:52 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:31:53.294450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4e0963cd-9cd6-4a9b-897e-52e46c0dd38e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:31:53.295078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4e0963cd-9cd6-4a9b-897e-52e46c0dd38e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:31:53.302053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e0963cd-9cd6-4a9b-897e-52e46c0dd38e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:53.302553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e0963cd-9cd6-4a9b-897e-52e46c0dd38e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:53.303056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e0963cd-9cd6-4a9b-897e-52e46c0dd38e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:53.303777 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e0963cd-9cd6-4a9b-897e-52e46c0dd38e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:53.304248 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e0963cd-9cd6-4a9b-897e-52e46c0dd38e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:53.304685 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e0963cd-9cd6-4a9b-897e-52e46c0dd38e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:53.435317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4e0963cd-9cd6-4a9b-897e-52e46c0dd38e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:31:53.443156 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4e0963cd-9cd6-4a9b-897e-52e46c0dd38e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1682 microversion: 2.1 time: 0.153197 Oct 05 03:31:53.443737 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3574/7161] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:31:53 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:31:54.467725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9d4cfb8a-3507-4aef-ac7e-bab8bed6d7d1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:31:54.468513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9d4cfb8a-3507-4aef-ac7e-bab8bed6d7d1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:31:54.475610 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d4cfb8a-3507-4aef-ac7e-bab8bed6d7d1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:54.476106 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d4cfb8a-3507-4aef-ac7e-bab8bed6d7d1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:54.476551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d4cfb8a-3507-4aef-ac7e-bab8bed6d7d1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:54.477526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d4cfb8a-3507-4aef-ac7e-bab8bed6d7d1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:54.477988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d4cfb8a-3507-4aef-ac7e-bab8bed6d7d1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:54.478457 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d4cfb8a-3507-4aef-ac7e-bab8bed6d7d1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:54.611896 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9d4cfb8a-3507-4aef-ac7e-bab8bed6d7d1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:31:54.619585 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9d4cfb8a-3507-4aef-ac7e-bab8bed6d7d1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1682 microversion: 2.1 time: 0.156455 Oct 05 03:31:54.620158 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3588/7162] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:31:54 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:31:55.643368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e8909839-1f69-44c5-9ad2-f8d1d7f151e6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:31:55.643943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e8909839-1f69-44c5-9ad2-f8d1d7f151e6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:31:55.650839 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8909839-1f69-44c5-9ad2-f8d1d7f151e6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:55.651344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8909839-1f69-44c5-9ad2-f8d1d7f151e6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:55.652404 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8909839-1f69-44c5-9ad2-f8d1d7f151e6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:55.653168 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8909839-1f69-44c5-9ad2-f8d1d7f151e6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:55.653624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8909839-1f69-44c5-9ad2-f8d1d7f151e6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:55.654060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8909839-1f69-44c5-9ad2-f8d1d7f151e6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:55.784319 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e8909839-1f69-44c5-9ad2-f8d1d7f151e6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:31:55.794576 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e8909839-1f69-44c5-9ad2-f8d1d7f151e6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1682 microversion: 2.1 time: 0.152929 Oct 05 03:31:55.795179 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3575/7163] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:31:55 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:31:56.818202 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f66e416b-1d8a-47ea-a244-d038592deef6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:31:56.818819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f66e416b-1d8a-47ea-a244-d038592deef6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:31:56.826346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f66e416b-1d8a-47ea-a244-d038592deef6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:56.826860 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f66e416b-1d8a-47ea-a244-d038592deef6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:56.827282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f66e416b-1d8a-47ea-a244-d038592deef6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:56.827988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f66e416b-1d8a-47ea-a244-d038592deef6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:56.828442 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f66e416b-1d8a-47ea-a244-d038592deef6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:56.828871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f66e416b-1d8a-47ea-a244-d038592deef6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:56.965575 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f66e416b-1d8a-47ea-a244-d038592deef6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:31:56.973333 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f66e416b-1d8a-47ea-a244-d038592deef6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1682 microversion: 2.1 time: 0.159037 Oct 05 03:31:56.973901 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3589/7164] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:31:56 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:31:57.998749 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f075ea6b-1458-4c38-afe6-0899169962bd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:31:57.999399 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f075ea6b-1458-4c38-afe6-0899169962bd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:31:58.006531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f075ea6b-1458-4c38-afe6-0899169962bd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:58.007039 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f075ea6b-1458-4c38-afe6-0899169962bd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:58.007496 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f075ea6b-1458-4c38-afe6-0899169962bd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:58.008214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f075ea6b-1458-4c38-afe6-0899169962bd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:58.008692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f075ea6b-1458-4c38-afe6-0899169962bd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:58.009164 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f075ea6b-1458-4c38-afe6-0899169962bd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:58.227889 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f075ea6b-1458-4c38-afe6-0899169962bd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:31:58.236448 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f075ea6b-1458-4c38-afe6-0899169962bd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1681 microversion: 2.1 time: 0.242564 Oct 05 03:31:58.237064 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3576/7165] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:31:57 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1681 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:31:58.355656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-3782e6af-bef3-4f69-96fc-7098f055f5b1 req-47e26285-3acd-4aa1-bb37-383c48e0b774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd06f250-ceb9-4d45-bc1d-842f06cb7589", "name": "network-vif-unplugged", "status": "completed", "tag": "09f9c901-45ce-4a1d-a0f5-bf3dd1f43e7c"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:31:58.365384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-3782e6af-bef3-4f69-96fc-7098f055f5b1 req-47e26285-3acd-4aa1-bb37-383c48e0b774 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:58.366524 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-3782e6af-bef3-4f69-96fc-7098f055f5b1 req-47e26285-3acd-4aa1-bb37-383c48e0b774 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:58.366998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-3782e6af-bef3-4f69-96fc-7098f055f5b1 req-47e26285-3acd-4aa1-bb37-383c48e0b774 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:58.380162 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-3782e6af-bef3-4f69-96fc-7098f055f5b1 req-47e26285-3acd-4aa1-bb37-383c48e0b774 service nova] Creating event network-vif-unplugged:09f9c901-45ce-4a1d-a0f5-bf3dd1f43e7c for instance bd06f250-ceb9-4d45-bc1d-842f06cb7589 on n-h2-858272-3 Oct 05 03:31:58.386594 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [req-3782e6af-bef3-4f69-96fc-7098f055f5b1 req-47e26285-3acd-4aa1-bb37-383c48e0b774 service nova] Instance bd06f250-ceb9-4d45-bc1d-842f06cb7589 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122319) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 03:31:58.398280 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-3782e6af-bef3-4f69-96fc-7098f055f5b1 req-47e26285-3acd-4aa1-bb37-383c48e0b774 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103479 Oct 05 03:31:58.398893 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3590/7166] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:31:59.259897 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a488dcc7-95d3-4492-a401-b82994b2ccec tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:31:59.260634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a488dcc7-95d3-4492-a401-b82994b2ccec tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:31:59.268006 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a488dcc7-95d3-4492-a401-b82994b2ccec tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:59.268507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a488dcc7-95d3-4492-a401-b82994b2ccec tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:59.268991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a488dcc7-95d3-4492-a401-b82994b2ccec tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:59.269745 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a488dcc7-95d3-4492-a401-b82994b2ccec tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:31:59.270163 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a488dcc7-95d3-4492-a401-b82994b2ccec tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:31:59.270624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a488dcc7-95d3-4492-a401-b82994b2ccec tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:31:59.487501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a488dcc7-95d3-4492-a401-b82994b2ccec tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:31:59.495260 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a488dcc7-95d3-4492-a401-b82994b2ccec tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1681 microversion: 2.1 time: 0.239501 Oct 05 03:31:59.495888 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3577/7167] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:31:59 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1681 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:32:00.420619 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-fbf75546-c724-427c-be00-e241679cc274 req-49c94b2f-a0b0-4803-957c-23a394c0bf37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd06f250-ceb9-4d45-bc1d-842f06cb7589", "tag": "09f9c901-45ce-4a1d-a0f5-bf3dd1f43e7c"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:32:00.430825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-fbf75546-c724-427c-be00-e241679cc274 req-49c94b2f-a0b0-4803-957c-23a394c0bf37 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:00.431296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-fbf75546-c724-427c-be00-e241679cc274 req-49c94b2f-a0b0-4803-957c-23a394c0bf37 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:00.431747 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-fbf75546-c724-427c-be00-e241679cc274 req-49c94b2f-a0b0-4803-957c-23a394c0bf37 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:00.443228 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-fbf75546-c724-427c-be00-e241679cc274 req-49c94b2f-a0b0-4803-957c-23a394c0bf37 service nova] Creating event network-changed:09f9c901-45ce-4a1d-a0f5-bf3dd1f43e7c for instance bd06f250-ceb9-4d45-bc1d-842f06cb7589 on n-h2-858272-3 Oct 05 03:32:00.448460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [req-fbf75546-c724-427c-be00-e241679cc274 req-49c94b2f-a0b0-4803-957c-23a394c0bf37 service nova] Instance bd06f250-ceb9-4d45-bc1d-842f06cb7589 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122319) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 03:32:00.459028 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-fbf75546-c724-427c-be00-e241679cc274 req-49c94b2f-a0b0-4803-957c-23a394c0bf37 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043169 Oct 05 03:32:00.459649 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3591/7168] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:32:00.519163 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e493ffd1-61a1-4f4a-ada0-b4b872ef8bd3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:32:00.519944 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e493ffd1-61a1-4f4a-ada0-b4b872ef8bd3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:32:00.527018 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e493ffd1-61a1-4f4a-ada0-b4b872ef8bd3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:00.527527 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e493ffd1-61a1-4f4a-ada0-b4b872ef8bd3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:00.527975 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e493ffd1-61a1-4f4a-ada0-b4b872ef8bd3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:00.528687 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e493ffd1-61a1-4f4a-ada0-b4b872ef8bd3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:00.529187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e493ffd1-61a1-4f4a-ada0-b4b872ef8bd3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:00.529628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e493ffd1-61a1-4f4a-ada0-b4b872ef8bd3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:00.735925 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e493ffd1-61a1-4f4a-ada0-b4b872ef8bd3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:32:00.743702 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e493ffd1-61a1-4f4a-ada0-b4b872ef8bd3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1679 microversion: 2.1 time: 0.228432 Oct 05 03:32:00.744292 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3578/7169] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:32:00 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1679 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:32:01.769533 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d5515e58-96d9-4551-adcb-9e17b536d58f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:32:01.770235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d5515e58-96d9-4551-adcb-9e17b536d58f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:32:01.776690 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5515e58-96d9-4551-adcb-9e17b536d58f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:01.777217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5515e58-96d9-4551-adcb-9e17b536d58f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:01.777663 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5515e58-96d9-4551-adcb-9e17b536d58f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:01.778387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5515e58-96d9-4551-adcb-9e17b536d58f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:01.778843 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5515e58-96d9-4551-adcb-9e17b536d58f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:01.779270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5515e58-96d9-4551-adcb-9e17b536d58f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:01.911943 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d5515e58-96d9-4551-adcb-9e17b536d58f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:32:01.920556 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d5515e58-96d9-4551-adcb-9e17b536d58f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1679 microversion: 2.1 time: 0.156090 Oct 05 03:32:01.921116 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3592/7170] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:32:01 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:32:02.943853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ea2146df-d90b-4540-baf6-fdde98f9484d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:32:02.944508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ea2146df-d90b-4540-baf6-fdde98f9484d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:32:02.952003 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea2146df-d90b-4540-baf6-fdde98f9484d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:02.952510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea2146df-d90b-4540-baf6-fdde98f9484d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:02.953013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea2146df-d90b-4540-baf6-fdde98f9484d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:02.953728 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea2146df-d90b-4540-baf6-fdde98f9484d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:02.954201 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea2146df-d90b-4540-baf6-fdde98f9484d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:02.954649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea2146df-d90b-4540-baf6-fdde98f9484d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:03.166605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ea2146df-d90b-4540-baf6-fdde98f9484d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:32:03.175860 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ea2146df-d90b-4540-baf6-fdde98f9484d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1676 microversion: 2.1 time: 0.235947 Oct 05 03:32:03.176530 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3579/7171] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:32:02 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1676 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:32:03.199496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9aa51227-1484-4009-9695-704d0a09d3aa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:32:03.200178 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9aa51227-1484-4009-9695-704d0a09d3aa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:32:03.207136 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9aa51227-1484-4009-9695-704d0a09d3aa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:03.207622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9aa51227-1484-4009-9695-704d0a09d3aa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:03.208058 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9aa51227-1484-4009-9695-704d0a09d3aa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:03.208750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9aa51227-1484-4009-9695-704d0a09d3aa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:03.209235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9aa51227-1484-4009-9695-704d0a09d3aa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:03.209660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9aa51227-1484-4009-9695-704d0a09d3aa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:03.270533 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9aa51227-1484-4009-9695-704d0a09d3aa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "POST /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589/action" status: 204 len: 0 microversion: 2.1 time: 0.074900 Oct 05 03:32:03.271231 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3593/7172] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:32:03 2022] POST /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:32:03.281494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b929448b-b479-4e56-b1aa-2294af14a075 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:32:03.282489 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b929448b-b479-4e56-b1aa-2294af14a075 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:32:03.289957 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b929448b-b479-4e56-b1aa-2294af14a075 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:03.290475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b929448b-b479-4e56-b1aa-2294af14a075 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:03.290976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b929448b-b479-4e56-b1aa-2294af14a075 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:03.291927 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b929448b-b479-4e56-b1aa-2294af14a075 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:03.293049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b929448b-b479-4e56-b1aa-2294af14a075 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:03.293701 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b929448b-b479-4e56-b1aa-2294af14a075 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:03.905698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b929448b-b479-4e56-b1aa-2294af14a075 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:32:03.913646 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b929448b-b479-4e56-b1aa-2294af14a075 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1676 microversion: 2.1 time: 0.638096 Oct 05 03:32:03.914307 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3580/7173] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:32:03 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1676 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:32:04.937651 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5ca0f483-670f-4c48-98d4-936b8b3f8619 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:32:04.938373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5ca0f483-670f-4c48-98d4-936b8b3f8619 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:32:04.944596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ca0f483-670f-4c48-98d4-936b8b3f8619 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:04.945128 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ca0f483-670f-4c48-98d4-936b8b3f8619 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:04.945547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ca0f483-670f-4c48-98d4-936b8b3f8619 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:04.946226 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ca0f483-670f-4c48-98d4-936b8b3f8619 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:04.946673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ca0f483-670f-4c48-98d4-936b8b3f8619 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:04.947091 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5ca0f483-670f-4c48-98d4-936b8b3f8619 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:05.081477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5ca0f483-670f-4c48-98d4-936b8b3f8619 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:32:05.089443 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5ca0f483-670f-4c48-98d4-936b8b3f8619 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1676 microversion: 2.1 time: 0.156906 Oct 05 03:32:05.089986 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3594/7174] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:32:04 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:32:05.560307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-8c963a68-c5ad-4ed1-98ca-05397d0b0102 req-96ed9c4c-a101-4b3c-bb64-462266b25397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd06f250-ceb9-4d45-bc1d-842f06cb7589", "name": "network-vif-plugged", "status": "completed", "tag": "09f9c901-45ce-4a1d-a0f5-bf3dd1f43e7c"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:32:05.572571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-8c963a68-c5ad-4ed1-98ca-05397d0b0102 req-96ed9c4c-a101-4b3c-bb64-462266b25397 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:05.573139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-8c963a68-c5ad-4ed1-98ca-05397d0b0102 req-96ed9c4c-a101-4b3c-bb64-462266b25397 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:05.573869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-8c963a68-c5ad-4ed1-98ca-05397d0b0102 req-96ed9c4c-a101-4b3c-bb64-462266b25397 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:05.587687 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-8c963a68-c5ad-4ed1-98ca-05397d0b0102 req-96ed9c4c-a101-4b3c-bb64-462266b25397 service nova] Creating event network-vif-plugged:09f9c901-45ce-4a1d-a0f5-bf3dd1f43e7c for instance bd06f250-ceb9-4d45-bc1d-842f06cb7589 on n-h2-858272-3 Oct 05 03:32:05.594100 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-8c963a68-c5ad-4ed1-98ca-05397d0b0102 req-96ed9c4c-a101-4b3c-bb64-462266b25397 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037549 Oct 05 03:32:05.594724 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3581/7175] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:32:06.121776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f342bf91-26dd-4571-ab94-42bde1f3fd92 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:32:06.122399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f342bf91-26dd-4571-ab94-42bde1f3fd92 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:32:06.129463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f342bf91-26dd-4571-ab94-42bde1f3fd92 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:06.129949 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f342bf91-26dd-4571-ab94-42bde1f3fd92 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:06.130386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f342bf91-26dd-4571-ab94-42bde1f3fd92 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:06.131073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f342bf91-26dd-4571-ab94-42bde1f3fd92 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:06.131525 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f342bf91-26dd-4571-ab94-42bde1f3fd92 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:06.131952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f342bf91-26dd-4571-ab94-42bde1f3fd92 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:06.261837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f342bf91-26dd-4571-ab94-42bde1f3fd92 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:32:06.270346 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f342bf91-26dd-4571-ab94-42bde1f3fd92 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1668 microversion: 2.1 time: 0.152435 Oct 05 03:32:06.270940 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3595/7176] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:32:06 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:32:06.293894 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3948823d-93aa-4828-90cf-f24f40f72916 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:32:06.294638 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3948823d-93aa-4828-90cf-f24f40f72916 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:32:06.300834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3948823d-93aa-4828-90cf-f24f40f72916 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:06.301359 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3948823d-93aa-4828-90cf-f24f40f72916 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:06.301834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3948823d-93aa-4828-90cf-f24f40f72916 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:06.302527 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3948823d-93aa-4828-90cf-f24f40f72916 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:06.302993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3948823d-93aa-4828-90cf-f24f40f72916 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:06.303430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3948823d-93aa-4828-90cf-f24f40f72916 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:06.435310 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3948823d-93aa-4828-90cf-f24f40f72916 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:32:06.443055 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3948823d-93aa-4828-90cf-f24f40f72916 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1668 microversion: 2.1 time: 0.153492 Oct 05 03:32:06.443676 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3582/7177] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:32:06 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:32:06.465782 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b9020fff-42e4-4b69-9610-5a4e427c225c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:32:06.466406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b9020fff-42e4-4b69-9610-5a4e427c225c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:32:06.472318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9020fff-42e4-4b69-9610-5a4e427c225c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:06.472809 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9020fff-42e4-4b69-9610-5a4e427c225c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:06.473320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9020fff-42e4-4b69-9610-5a4e427c225c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:06.474012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9020fff-42e4-4b69-9610-5a4e427c225c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:06.474470 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9020fff-42e4-4b69-9610-5a4e427c225c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:06.474908 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9020fff-42e4-4b69-9610-5a4e427c225c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:06.606902 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b9020fff-42e4-4b69-9610-5a4e427c225c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:32:06.609428 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:32:06.616581 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b9020fff-42e4-4b69-9610-5a4e427c225c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1668 microversion: 2.1 time: 0.154655 Oct 05 03:32:06.617219 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3596/7178] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:32:06 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:32:06.640016 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-17cbf87d-0e73-4e6c-85ac-eca664be1f85 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:32:06.640532 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-17cbf87d-0e73-4e6c-85ac-eca664be1f85 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:32:06.647390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17cbf87d-0e73-4e6c-85ac-eca664be1f85 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:06.647897 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17cbf87d-0e73-4e6c-85ac-eca664be1f85 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:06.648343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17cbf87d-0e73-4e6c-85ac-eca664be1f85 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:06.649072 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17cbf87d-0e73-4e6c-85ac-eca664be1f85 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:06.649543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17cbf87d-0e73-4e6c-85ac-eca664be1f85 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:06.649978 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17cbf87d-0e73-4e6c-85ac-eca664be1f85 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:06.675536 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-17cbf87d-0e73-4e6c-85ac-eca664be1f85 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:32:06.720568 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:32:06.752746 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-17cbf87d-0e73-4e6c-85ac-eca664be1f85 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 204 len: 0 microversion: 2.1 time: 0.117093 Oct 05 03:32:06.753369 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3583/7179] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:32:06 2022] DELETE /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:32:06.762013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3be2e205-7731-4b46-bf7d-203a7890462b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:32:06.762748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3be2e205-7731-4b46-bf7d-203a7890462b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:32:06.770133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3be2e205-7731-4b46-bf7d-203a7890462b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:06.770625 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3be2e205-7731-4b46-bf7d-203a7890462b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:06.771069 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3be2e205-7731-4b46-bf7d-203a7890462b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:06.771768 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3be2e205-7731-4b46-bf7d-203a7890462b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:06.772228 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3be2e205-7731-4b46-bf7d-203a7890462b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:06.772655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3be2e205-7731-4b46-bf7d-203a7890462b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:06.900782 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3be2e205-7731-4b46-bf7d-203a7890462b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:32:06.908593 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3be2e205-7731-4b46-bf7d-203a7890462b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1674 microversion: 2.1 time: 0.150695 Oct 05 03:32:06.909198 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3597/7180] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:32:06 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:32:07.932558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ace99b4a-e7e3-4d4f-aab7-4c0c59566efc tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:32:07.933221 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ace99b4a-e7e3-4d4f-aab7-4c0c59566efc tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:32:07.940609 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ace99b4a-e7e3-4d4f-aab7-4c0c59566efc tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:07.941238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ace99b4a-e7e3-4d4f-aab7-4c0c59566efc tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:07.941784 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ace99b4a-e7e3-4d4f-aab7-4c0c59566efc tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:07.942616 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ace99b4a-e7e3-4d4f-aab7-4c0c59566efc tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:07.943140 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ace99b4a-e7e3-4d4f-aab7-4c0c59566efc tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:07.943762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ace99b4a-e7e3-4d4f-aab7-4c0c59566efc tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:08.075804 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ace99b4a-e7e3-4d4f-aab7-4c0c59566efc tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:32:08.083637 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ace99b4a-e7e3-4d4f-aab7-4c0c59566efc tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1674 microversion: 2.1 time: 0.155624 Oct 05 03:32:08.084221 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3584/7181] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:32:07 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:32:09.044269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-ac499aa1-1b3d-4df9-b2a6-ead07aaa2129 req-db927202-39c6-4988-b89a-d7a2bd7ecf6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd06f250-ceb9-4d45-bc1d-842f06cb7589", "name": "network-vif-deleted", "tag": "09f9c901-45ce-4a1d-a0f5-bf3dd1f43e7c"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:32:09.054137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ac499aa1-1b3d-4df9-b2a6-ead07aaa2129 req-db927202-39c6-4988-b89a-d7a2bd7ecf6c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:09.054617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ac499aa1-1b3d-4df9-b2a6-ead07aaa2129 req-db927202-39c6-4988-b89a-d7a2bd7ecf6c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:09.055042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ac499aa1-1b3d-4df9-b2a6-ead07aaa2129 req-db927202-39c6-4988-b89a-d7a2bd7ecf6c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:09.067537 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-ac499aa1-1b3d-4df9-b2a6-ead07aaa2129 req-db927202-39c6-4988-b89a-d7a2bd7ecf6c service nova] Creating event network-vif-deleted:09f9c901-45ce-4a1d-a0f5-bf3dd1f43e7c for instance bd06f250-ceb9-4d45-bc1d-842f06cb7589 on n-h2-858272-3 Oct 05 03:32:09.072862 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-ac499aa1-1b3d-4df9-b2a6-ead07aaa2129 req-db927202-39c6-4988-b89a-d7a2bd7ecf6c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033058 Oct 05 03:32:09.073509 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3598/7182] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:32:09.109441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e8a5373d-b13b-4790-80fd-7996230f9c4a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:32:09.110084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e8a5373d-b13b-4790-80fd-7996230f9c4a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:32:09.119606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8a5373d-b13b-4790-80fd-7996230f9c4a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:09.123394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8a5373d-b13b-4790-80fd-7996230f9c4a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:09.124057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8a5373d-b13b-4790-80fd-7996230f9c4a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:09.124890 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8a5373d-b13b-4790-80fd-7996230f9c4a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:09.125660 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8a5373d-b13b-4790-80fd-7996230f9c4a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:09.126119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e8a5373d-b13b-4790-80fd-7996230f9c4a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:09.194291 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e8a5373d-b13b-4790-80fd-7996230f9c4a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:32:09.202402 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e8a5373d-b13b-4790-80fd-7996230f9c4a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 200 len: 1321 microversion: 2.1 time: 0.098914 Oct 05 03:32:09.202990 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3585/7183] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:32:09 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 1321 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:32:10.227021 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bc449604-5f7b-40cc-af1e-0b4f947a3759 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:32:10.227638 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bc449604-5f7b-40cc-af1e-0b4f947a3759 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:32:10.234619 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bc449604-5f7b-40cc-af1e-0b4f947a3759 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:10.235108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bc449604-5f7b-40cc-af1e-0b4f947a3759 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:10.235548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bc449604-5f7b-40cc-af1e-0b4f947a3759 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:10.236239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bc449604-5f7b-40cc-af1e-0b4f947a3759 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:10.236696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bc449604-5f7b-40cc-af1e-0b4f947a3759 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:10.237146 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bc449604-5f7b-40cc-af1e-0b4f947a3759 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:10.250385 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-bc449604-5f7b-40cc-af1e-0b4f947a3759 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] HTTP exception thrown: Instance bd06f250-ceb9-4d45-bc1d-842f06cb7589 could not be found. Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bc449604-5f7b-40cc-af1e-0b4f947a3759 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Request method failure captured: Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 HTTP/1.1 Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPpOjo3UoOtQ-Bs93Auly_6sXh8lfDtgrSY0udxfQzVZtNtMSUx1jRG2ewnriCtcRUrnJaHmLaLcz0mVVG5b9vEZRuG06925WdPWiQLXMx8sJPVOF2G8G35VQEtfcoJQaOleL8MsseS-M06VqanojXWiUqJgAvvCm3KftD0h1N4k_LM Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: cb907a92ab7949ebb3cb2e3b5d372ece Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: cb907a92ab7949ebb3cb2e3b5d372ece Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerActionsTestJSON-2031640985-project Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 64375d765c0949dbb75c91906f8bca3c Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerActionsTestJSON-2031640985-project Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance bd06f250-ceb9-4d45-bc1d-842f06cb7589 could not be found. Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'bd06f250-ceb9-4d45-bc1d-842f06cb7589'} Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd06f250-ceb9-4d45-bc1d-842f06cb7589 could not be found. Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd06f250-ceb9-4d45-bc1d-842f06cb7589 could not be found. Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:32:10.251983 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:32:10.256623 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:32:10.256623 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:32:10.256623 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:32:10.256623 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:32:10.256623 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:32:10.256623 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd06f250-ceb9-4d45-bc1d-842f06cb7589 could not be found. Oct 05 03:32:10.256623 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:32:10.256623 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bc449604-5f7b-40cc-af1e-0b4f947a3759 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Returning 404 to user: Instance bd06f250-ceb9-4d45-bc1d-842f06cb7589 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:32:10.256623 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bc449604-5f7b-40cc-af1e-0b4f947a3759 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 404 len: 111 microversion: 2.1 time: 0.031966 Oct 05 03:32:10.256623 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3599/7184] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:32:10 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:32:10.266197 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bbf9882c-6c95-401b-96d2-a1fc535e893c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:32:10.266853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bbf9882c-6c95-401b-96d2-a1fc535e893c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:32:10.274101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bbf9882c-6c95-401b-96d2-a1fc535e893c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:10.274596 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bbf9882c-6c95-401b-96d2-a1fc535e893c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:10.275041 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bbf9882c-6c95-401b-96d2-a1fc535e893c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:10.275998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bbf9882c-6c95-401b-96d2-a1fc535e893c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:10.276471 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bbf9882c-6c95-401b-96d2-a1fc535e893c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:10.276925 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bbf9882c-6c95-401b-96d2-a1fc535e893c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:10.291054 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-bbf9882c-6c95-401b-96d2-a1fc535e893c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] HTTP exception thrown: Instance bd06f250-ceb9-4d45-bc1d-842f06cb7589 could not be found. Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bbf9882c-6c95-401b-96d2-a1fc535e893c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Request method failure captured: Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 HTTP/1.1 Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPpOjo3UoOtQ-Bs93Auly_6sXh8lfDtgrSY0udxfQzVZtNtMSUx1jRG2ewnriCtcRUrnJaHmLaLcz0mVVG5b9vEZRuG06925WdPWiQLXMx8sJPVOF2G8G35VQEtfcoJQaOleL8MsseS-M06VqanojXWiUqJgAvvCm3KftD0h1N4k_LM Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: cb907a92ab7949ebb3cb2e3b5d372ece Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: cb907a92ab7949ebb3cb2e3b5d372ece Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServerActionsTestJSON-2031640985-project Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 64375d765c0949dbb75c91906f8bca3c Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServerActionsTestJSON-2031640985-project Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance bd06f250-ceb9-4d45-bc1d-842f06cb7589 could not be found. Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'bd06f250-ceb9-4d45-bc1d-842f06cb7589'} Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd06f250-ceb9-4d45-bc1d-842f06cb7589 could not be found. Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd06f250-ceb9-4d45-bc1d-842f06cb7589 could not be found. Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:32:10.292758 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:32:10.299068 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:32:10.299068 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:32:10.299068 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:32:10.299068 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:32:10.299068 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:32:10.299068 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd06f250-ceb9-4d45-bc1d-842f06cb7589 could not be found. Oct 05 03:32:10.299068 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:32:10.299068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bbf9882c-6c95-401b-96d2-a1fc535e893c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Returning 404 to user: Instance bd06f250-ceb9-4d45-bc1d-842f06cb7589 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:32:10.299068 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bbf9882c-6c95-401b-96d2-a1fc535e893c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 404 len: 111 microversion: 2.1 time: 0.032706 Oct 05 03:32:10.299068 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3586/7185] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:32:10 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:32:10.342641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-04b7f420-da0a-4391-9155-59d4e7d652b3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1399531644", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "e3e1b2b6-bb43-4574-b227-e8169188bcd9"}], "security_groups": [{"name": "tempest-securitygroup--711774869"}], "key_name": "tempest-keypair-904238654", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:32:10.451384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-04b7f420-da0a-4391-9155-59d4e7d652b3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] validate_networks() for [('e3e1b2b6-bb43-4574-b227-e8169188bcd9', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:32:10.818492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-04b7f420-da0a-4391-9155-59d4e7d652b3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:32:10.818924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-04b7f420-da0a-4391-9155-59d4e7d652b3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:32:10.819406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-04b7f420-da0a-4391-9155-59d4e7d652b3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:32:10.819824 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-04b7f420-da0a-4391-9155-59d4e7d652b3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:32:10.820244 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-04b7f420-da0a-4391-9155-59d4e7d652b3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:32:10.829792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-04b7f420-da0a-4391-9155-59d4e7d652b3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:10.830283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-04b7f420-da0a-4391-9155-59d4e7d652b3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:10.830728 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-04b7f420-da0a-4391-9155-59d4e7d652b3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:10.831468 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-04b7f420-da0a-4391-9155-59d4e7d652b3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:10.831932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-04b7f420-da0a-4391-9155-59d4e7d652b3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:10.832368 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-04b7f420-da0a-4391-9155-59d4e7d652b3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:10.849650 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-04b7f420-da0a-4391-9155-59d4e7d652b3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Getting quotas for project cb907a92ab7949ebb3cb2e3b5d372ece. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:32:10.855095 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-04b7f420-da0a-4391-9155-59d4e7d652b3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Getting quotas for user 64375d765c0949dbb75c91906f8bca3c and project cb907a92ab7949ebb3cb2e3b5d372ece. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:32:10.867614 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-04b7f420-da0a-4391-9155-59d4e7d652b3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:32:10.869974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-04b7f420-da0a-4391-9155-59d4e7d652b3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:32:10.916656 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-04b7f420-da0a-4391-9155-59d4e7d652b3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.578374 Oct 05 03:32:10.917343 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3600/7186] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:32:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:32:10.928569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2d4e0f7f-0f1a-49d3-b342-f0f634e6b48e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:32:10.929239 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2d4e0f7f-0f1a-49d3-b342-f0f634e6b48e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:32:10.984729 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2d4e0f7f-0f1a-49d3-b342-f0f634e6b48e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:32:10.991599 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2d4e0f7f-0f1a-49d3-b342-f0f634e6b48e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1238 microversion: 2.1 time: 0.066890 Oct 05 03:32:10.992178 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3587/7187] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:32:10 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:32:12.016589 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-867622af-dda1-401a-ab81-53c535a1d0fe tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:32:12.017373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-867622af-dda1-401a-ab81-53c535a1d0fe tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:32:12.028104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-867622af-dda1-401a-ab81-53c535a1d0fe tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:12.028824 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-867622af-dda1-401a-ab81-53c535a1d0fe tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:12.029313 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-867622af-dda1-401a-ab81-53c535a1d0fe tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:12.030130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-867622af-dda1-401a-ab81-53c535a1d0fe tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:12.030676 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-867622af-dda1-401a-ab81-53c535a1d0fe tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:12.031203 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-867622af-dda1-401a-ab81-53c535a1d0fe tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:12.109275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-867622af-dda1-401a-ab81-53c535a1d0fe tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:32:12.117038 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-867622af-dda1-401a-ab81-53c535a1d0fe tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1308 microversion: 2.1 time: 0.105434 Oct 05 03:32:12.117746 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3601/7188] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:32:12 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:32:13.141657 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ae67fb43-945b-4787-a1a7-f40dfac2acb4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:32:13.142303 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ae67fb43-945b-4787-a1a7-f40dfac2acb4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:32:13.146083 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:32:13.151403 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae67fb43-945b-4787-a1a7-f40dfac2acb4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:13.151925 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae67fb43-945b-4787-a1a7-f40dfac2acb4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:13.152397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae67fb43-945b-4787-a1a7-f40dfac2acb4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:13.153774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae67fb43-945b-4787-a1a7-f40dfac2acb4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:13.154260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae67fb43-945b-4787-a1a7-f40dfac2acb4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:13.154711 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ae67fb43-945b-4787-a1a7-f40dfac2acb4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:13.354493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ae67fb43-945b-4787-a1a7-f40dfac2acb4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:32:13.367733 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ae67fb43-945b-4787-a1a7-f40dfac2acb4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1363 microversion: 2.1 time: 0.230010 Oct 05 03:32:13.368377 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3588/7189] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:32:13 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:32:13.456730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-3548fffd-5aba-4cce-8c63-efb2833bcfc1 req-4b7a66e5-f281-40ce-bdaa-7e11ad3aef3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "086fbcfc-2a6b-458f-9520-eb3652662458", "tag": "27200f4a-9292-4a93-8543-173fe05bac97"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:32:13.463277 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:32:13.470361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-3548fffd-5aba-4cce-8c63-efb2833bcfc1 req-4b7a66e5-f281-40ce-bdaa-7e11ad3aef3b service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:13.470836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-3548fffd-5aba-4cce-8c63-efb2833bcfc1 req-4b7a66e5-f281-40ce-bdaa-7e11ad3aef3b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:13.471270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-3548fffd-5aba-4cce-8c63-efb2833bcfc1 req-4b7a66e5-f281-40ce-bdaa-7e11ad3aef3b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:13.484409 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-3548fffd-5aba-4cce-8c63-efb2833bcfc1 req-4b7a66e5-f281-40ce-bdaa-7e11ad3aef3b service nova] Creating event network-changed:27200f4a-9292-4a93-8543-173fe05bac97 for instance 086fbcfc-2a6b-458f-9520-eb3652662458 on n-h1-858272-3 Oct 05 03:32:13.489368 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-3548fffd-5aba-4cce-8c63-efb2833bcfc1 req-4b7a66e5-f281-40ce-bdaa-7e11ad3aef3b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036388 Oct 05 03:32:13.490192 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3602/7190] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:32:14.392312 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9be2d465-26ad-4d45-a8e5-9374b48b67e5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:32:14.392999 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9be2d465-26ad-4d45-a8e5-9374b48b67e5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:32:14.399882 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9be2d465-26ad-4d45-a8e5-9374b48b67e5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:14.400390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9be2d465-26ad-4d45-a8e5-9374b48b67e5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:14.400845 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9be2d465-26ad-4d45-a8e5-9374b48b67e5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:14.401590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9be2d465-26ad-4d45-a8e5-9374b48b67e5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:14.402063 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9be2d465-26ad-4d45-a8e5-9374b48b67e5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:14.403178 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9be2d465-26ad-4d45-a8e5-9374b48b67e5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:14.538574 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9be2d465-26ad-4d45-a8e5-9374b48b67e5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:32:14.546317 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9be2d465-26ad-4d45-a8e5-9374b48b67e5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1363 microversion: 2.1 time: 0.157940 Oct 05 03:32:14.546905 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3589/7191] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:32:14 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:32:15.570987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d8315afa-5f48-4074-bef6-8de3796c45a1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:32:15.571685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d8315afa-5f48-4074-bef6-8de3796c45a1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:32:15.578710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8315afa-5f48-4074-bef6-8de3796c45a1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:15.579196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8315afa-5f48-4074-bef6-8de3796c45a1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:15.579631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8315afa-5f48-4074-bef6-8de3796c45a1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:15.580319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8315afa-5f48-4074-bef6-8de3796c45a1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:15.580772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8315afa-5f48-4074-bef6-8de3796c45a1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:15.581399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8315afa-5f48-4074-bef6-8de3796c45a1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:15.712998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d8315afa-5f48-4074-bef6-8de3796c45a1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:32:15.722532 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d8315afa-5f48-4074-bef6-8de3796c45a1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1363 microversion: 2.1 time: 0.156590 Oct 05 03:32:15.723109 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3603/7192] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:32:15 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:32:16.747250 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d4378a60-3cfa-4120-af1c-b661500d2f12 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:32:16.747878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d4378a60-3cfa-4120-af1c-b661500d2f12 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:32:16.753983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4378a60-3cfa-4120-af1c-b661500d2f12 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:16.754480 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4378a60-3cfa-4120-af1c-b661500d2f12 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:16.754928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4378a60-3cfa-4120-af1c-b661500d2f12 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:16.755622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4378a60-3cfa-4120-af1c-b661500d2f12 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:16.756089 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4378a60-3cfa-4120-af1c-b661500d2f12 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:16.756523 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4378a60-3cfa-4120-af1c-b661500d2f12 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:16.886365 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d4378a60-3cfa-4120-af1c-b661500d2f12 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:32:16.894659 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d4378a60-3cfa-4120-af1c-b661500d2f12 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1363 microversion: 2.1 time: 0.151718 Oct 05 03:32:16.895233 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3590/7193] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:32:16 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:32:17.917544 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ebb992c5-efa4-4236-b28f-2c4df0b5e6af tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:32:17.918153 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ebb992c5-efa4-4236-b28f-2c4df0b5e6af tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:32:17.925250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ebb992c5-efa4-4236-b28f-2c4df0b5e6af tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:17.925738 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ebb992c5-efa4-4236-b28f-2c4df0b5e6af tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:17.926166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ebb992c5-efa4-4236-b28f-2c4df0b5e6af tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:17.926851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ebb992c5-efa4-4236-b28f-2c4df0b5e6af tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:17.927298 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ebb992c5-efa4-4236-b28f-2c4df0b5e6af tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:17.927716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ebb992c5-efa4-4236-b28f-2c4df0b5e6af tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:18.057269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ebb992c5-efa4-4236-b28f-2c4df0b5e6af tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:32:18.065668 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ebb992c5-efa4-4236-b28f-2c4df0b5e6af tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1363 microversion: 2.1 time: 0.152116 Oct 05 03:32:18.066434 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3604/7194] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:32:17 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:32:19.092143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e1e7744c-772c-4cbc-9169-905f08c57473 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:32:19.092787 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e1e7744c-772c-4cbc-9169-905f08c57473 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:32:19.099944 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1e7744c-772c-4cbc-9169-905f08c57473 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:19.100451 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1e7744c-772c-4cbc-9169-905f08c57473 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:19.100925 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1e7744c-772c-4cbc-9169-905f08c57473 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:19.101905 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1e7744c-772c-4cbc-9169-905f08c57473 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:19.102378 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1e7744c-772c-4cbc-9169-905f08c57473 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:19.102820 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e1e7744c-772c-4cbc-9169-905f08c57473 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:19.230056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e1e7744c-772c-4cbc-9169-905f08c57473 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:32:19.237844 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e1e7744c-772c-4cbc-9169-905f08c57473 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1363 microversion: 2.1 time: 0.152892 Oct 05 03:32:19.238412 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3591/7195] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:32:19 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:32:19.829669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-90466b39-0d40-4cab-b60e-2204e5ffe36e req-3027ef8c-97c8-4733-b510-fffef0f43322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "086fbcfc-2a6b-458f-9520-eb3652662458", "name": "network-vif-plugged", "status": "completed", "tag": "27200f4a-9292-4a93-8543-173fe05bac97"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:32:19.839384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-90466b39-0d40-4cab-b60e-2204e5ffe36e req-3027ef8c-97c8-4733-b510-fffef0f43322 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:19.841056 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-90466b39-0d40-4cab-b60e-2204e5ffe36e req-3027ef8c-97c8-4733-b510-fffef0f43322 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:19.841503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-90466b39-0d40-4cab-b60e-2204e5ffe36e req-3027ef8c-97c8-4733-b510-fffef0f43322 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:19.852741 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-90466b39-0d40-4cab-b60e-2204e5ffe36e req-3027ef8c-97c8-4733-b510-fffef0f43322 service nova] Creating event network-vif-plugged:27200f4a-9292-4a93-8543-173fe05bac97 for instance 086fbcfc-2a6b-458f-9520-eb3652662458 on n-h1-858272-3 Oct 05 03:32:19.858433 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-90466b39-0d40-4cab-b60e-2204e5ffe36e req-3027ef8c-97c8-4733-b510-fffef0f43322 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101423 Oct 05 03:32:19.859015 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3605/7196] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:32:20.260814 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f95a9dc3-5744-4a91-a0ae-d222cc7b3b28 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:32:20.261404 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f95a9dc3-5744-4a91-a0ae-d222cc7b3b28 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:32:20.269525 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f95a9dc3-5744-4a91-a0ae-d222cc7b3b28 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:20.270458 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f95a9dc3-5744-4a91-a0ae-d222cc7b3b28 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:20.271050 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f95a9dc3-5744-4a91-a0ae-d222cc7b3b28 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:20.271774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f95a9dc3-5744-4a91-a0ae-d222cc7b3b28 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:20.272262 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f95a9dc3-5744-4a91-a0ae-d222cc7b3b28 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:20.272711 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f95a9dc3-5744-4a91-a0ae-d222cc7b3b28 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:20.403130 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f95a9dc3-5744-4a91-a0ae-d222cc7b3b28 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:32:20.410886 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f95a9dc3-5744-4a91-a0ae-d222cc7b3b28 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1363 microversion: 2.1 time: 0.154101 Oct 05 03:32:20.411461 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3592/7197] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:32:20 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:32:21.438273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8d38b960-c037-4cd5-9f43-91432488e3b5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:32:21.439063 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8d38b960-c037-4cd5-9f43-91432488e3b5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:32:21.442295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:32:21.443059 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:32:21.451181 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d38b960-c037-4cd5-9f43-91432488e3b5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:21.451674 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d38b960-c037-4cd5-9f43-91432488e3b5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:21.452110 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d38b960-c037-4cd5-9f43-91432488e3b5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:21.452817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d38b960-c037-4cd5-9f43-91432488e3b5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:21.453304 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d38b960-c037-4cd5-9f43-91432488e3b5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:21.453727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8d38b960-c037-4cd5-9f43-91432488e3b5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:21.593068 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8d38b960-c037-4cd5-9f43-91432488e3b5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:32:21.602534 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8d38b960-c037-4cd5-9f43-91432488e3b5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1551 microversion: 2.1 time: 0.170628 Oct 05 03:32:21.603283 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3606/7198] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:32:21 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1551 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:32:21.627124 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1daaaf63-8c56-4b31-8aca-85320d83ac2f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:32:21.627677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1daaaf63-8c56-4b31-8aca-85320d83ac2f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:32:21.629613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:32:21.635817 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1daaaf63-8c56-4b31-8aca-85320d83ac2f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:21.636329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1daaaf63-8c56-4b31-8aca-85320d83ac2f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:21.637553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1daaaf63-8c56-4b31-8aca-85320d83ac2f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:21.638757 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1daaaf63-8c56-4b31-8aca-85320d83ac2f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:21.639250 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1daaaf63-8c56-4b31-8aca-85320d83ac2f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:21.639700 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1daaaf63-8c56-4b31-8aca-85320d83ac2f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:21.716336 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1daaaf63-8c56-4b31-8aca-85320d83ac2f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093148 Oct 05 03:32:21.716961 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3593/7199] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 03:32:21 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:32:22.957132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-9a042f29-9980-4a36-9ea9-c3d78956f2ac req-9bd6786a-4a22-415a-8ed3-f953c5cc65cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "086fbcfc-2a6b-458f-9520-eb3652662458", "tag": "27200f4a-9292-4a93-8543-173fe05bac97"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:32:22.970893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9a042f29-9980-4a36-9ea9-c3d78956f2ac req-9bd6786a-4a22-415a-8ed3-f953c5cc65cf service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:32:22.971372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9a042f29-9980-4a36-9ea9-c3d78956f2ac req-9bd6786a-4a22-415a-8ed3-f953c5cc65cf service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:32:22.971917 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9a042f29-9980-4a36-9ea9-c3d78956f2ac req-9bd6786a-4a22-415a-8ed3-f953c5cc65cf service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:32:22.986407 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-9a042f29-9980-4a36-9ea9-c3d78956f2ac req-9bd6786a-4a22-415a-8ed3-f953c5cc65cf service nova] Creating event network-changed:27200f4a-9292-4a93-8543-173fe05bac97 for instance 086fbcfc-2a6b-458f-9520-eb3652662458 on n-h1-858272-3 Oct 05 03:32:22.991312 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-9a042f29-9980-4a36-9ea9-c3d78956f2ac req-9bd6786a-4a22-415a-8ed3-f953c5cc65cf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038022 Oct 05 03:32:22.991930 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3607/7200] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:33:35.002750 n-d-858272-3 devstack@n-api.service[122320]: ERROR oslo.messaging._drivers.impl_rabbit [-] [478c9060-5882-4902-b074-d751d7d6fe39] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 03:33:35.003767 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=11 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:33:35.004584 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:33:35.005480 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 03:33:35.005679 n-d-858272-3 devstack@n-api.service[122320]: Wed Oct 5 03:33:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458/action (ip 10.222.0.16) !!! Oct 05 03:33:35.006667 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 03:33:35.006795 n-d-858272-3 devstack@n-api.service[122320]: Wed Oct 5 03:33:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458/action (ip 10.222.0.16) !!! Oct 05 03:33:35.013619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e34dbff9-5b74-424c-bd51-0ea5506beddb tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:33:35.024434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e34dbff9-5b74-424c-bd51-0ea5506beddb tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:35.024970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e34dbff9-5b74-424c-bd51-0ea5506beddb tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:35.025428 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e34dbff9-5b74-424c-bd51-0ea5506beddb tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:35.048090 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e34dbff9-5b74-424c-bd51-0ea5506beddb tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Going to try to stop instance {{(pid=122320) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 05 03:33:35.090234 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e34dbff9-5b74-424c-bd51-0ea5506beddb tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "POST /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458/action" status: 202 len: 0 microversion: 2.1 time: 0.088413 Oct 05 03:33:35.090905 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3594/7201] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:33:34 2022] POST /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:33:35.097919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=11 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:33:35.099250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=43 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:33:35.100485 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 03:33:35.100623 n-d-858272-3 devstack@n-api.service[122319]: Wed Oct 5 03:33:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 (ip 10.222.0.16) !!! Oct 05 03:33:35.108023 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-583fed86-7c55-46ba-92b3-17148ec751d7 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:33:35.108795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-583fed86-7c55-46ba-92b3-17148ec751d7 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:33:35.117322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-583fed86-7c55-46ba-92b3-17148ec751d7 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:35.117812 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-583fed86-7c55-46ba-92b3-17148ec751d7 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:35.118249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-583fed86-7c55-46ba-92b3-17148ec751d7 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:35.118936 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-583fed86-7c55-46ba-92b3-17148ec751d7 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:35.119388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-583fed86-7c55-46ba-92b3-17148ec751d7 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:35.119813 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-583fed86-7c55-46ba-92b3-17148ec751d7 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:35.252894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-583fed86-7c55-46ba-92b3-17148ec751d7 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:33:35.260528 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-583fed86-7c55-46ba-92b3-17148ec751d7 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1680 microversion: 2.1 time: 0.165287 Oct 05 03:33:35.261151 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3608/7202] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:33:35 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:33:36.288556 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7794dc8e-15fc-4ce4-9f69-47786a78d982 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:33:36.289240 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7794dc8e-15fc-4ce4-9f69-47786a78d982 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:33:36.298318 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [-] [478c9060-5882-4902-b074-d751d7d6fe39] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 44774. Oct 05 03:33:36.300442 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7794dc8e-15fc-4ce4-9f69-47786a78d982 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:36.300974 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7794dc8e-15fc-4ce4-9f69-47786a78d982 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:36.301431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7794dc8e-15fc-4ce4-9f69-47786a78d982 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:36.302142 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7794dc8e-15fc-4ce4-9f69-47786a78d982 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:36.302618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7794dc8e-15fc-4ce4-9f69-47786a78d982 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:36.303080 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7794dc8e-15fc-4ce4-9f69-47786a78d982 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:36.434728 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7794dc8e-15fc-4ce4-9f69-47786a78d982 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:33:36.442579 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7794dc8e-15fc-4ce4-9f69-47786a78d982 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1680 microversion: 2.1 time: 0.162063 Oct 05 03:33:36.443162 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3595/7203] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:33:36 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:33:37.469198 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3a645b86-f7b7-47d3-b811-312b4c17d035 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:33:37.469813 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3a645b86-f7b7-47d3-b811-312b4c17d035 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:33:37.476862 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a645b86-f7b7-47d3-b811-312b4c17d035 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:37.477374 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a645b86-f7b7-47d3-b811-312b4c17d035 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:37.477807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a645b86-f7b7-47d3-b811-312b4c17d035 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:37.478494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a645b86-f7b7-47d3-b811-312b4c17d035 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:37.478943 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a645b86-f7b7-47d3-b811-312b4c17d035 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:37.479361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a645b86-f7b7-47d3-b811-312b4c17d035 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:37.623654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3a645b86-f7b7-47d3-b811-312b4c17d035 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:33:37.631654 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3a645b86-f7b7-47d3-b811-312b4c17d035 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1680 microversion: 2.1 time: 0.167048 Oct 05 03:33:37.632236 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3609/7204] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:33:37 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:33:38.656519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-40ba79b3-f558-4dc4-88a0-dc252e487135 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:33:38.657181 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-40ba79b3-f558-4dc4-88a0-dc252e487135 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:33:38.664027 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-40ba79b3-f558-4dc4-88a0-dc252e487135 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:38.664533 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-40ba79b3-f558-4dc4-88a0-dc252e487135 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:38.665008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-40ba79b3-f558-4dc4-88a0-dc252e487135 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:38.665737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-40ba79b3-f558-4dc4-88a0-dc252e487135 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:38.666172 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-40ba79b3-f558-4dc4-88a0-dc252e487135 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:38.666608 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-40ba79b3-f558-4dc4-88a0-dc252e487135 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:38.798401 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-40ba79b3-f558-4dc4-88a0-dc252e487135 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:33:38.806134 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-40ba79b3-f558-4dc4-88a0-dc252e487135 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1680 microversion: 2.1 time: 0.154474 Oct 05 03:33:38.806725 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3596/7205] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:33:38 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:33:39.829306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b3fc3ce2-7e64-40df-bed9-93201b492181 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:33:39.829932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b3fc3ce2-7e64-40df-bed9-93201b492181 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:33:39.835935 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3fc3ce2-7e64-40df-bed9-93201b492181 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:39.836424 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3fc3ce2-7e64-40df-bed9-93201b492181 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:39.836864 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3fc3ce2-7e64-40df-bed9-93201b492181 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:39.837579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3fc3ce2-7e64-40df-bed9-93201b492181 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:39.838041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3fc3ce2-7e64-40df-bed9-93201b492181 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:39.838465 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3fc3ce2-7e64-40df-bed9-93201b492181 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:39.973995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b3fc3ce2-7e64-40df-bed9-93201b492181 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:33:39.982300 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b3fc3ce2-7e64-40df-bed9-93201b492181 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1680 microversion: 2.1 time: 0.157305 Oct 05 03:33:39.982888 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3610/7206] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:33:39 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:33:41.006409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1c37b088-aae3-410a-8869-54075ccb6e6e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:33:41.007067 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1c37b088-aae3-410a-8869-54075ccb6e6e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:33:41.014930 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c37b088-aae3-410a-8869-54075ccb6e6e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:41.015436 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c37b088-aae3-410a-8869-54075ccb6e6e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:41.015886 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c37b088-aae3-410a-8869-54075ccb6e6e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:41.016597 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c37b088-aae3-410a-8869-54075ccb6e6e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:41.017094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c37b088-aae3-410a-8869-54075ccb6e6e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:41.017534 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1c37b088-aae3-410a-8869-54075ccb6e6e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:41.149665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1c37b088-aae3-410a-8869-54075ccb6e6e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:33:41.158296 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1c37b088-aae3-410a-8869-54075ccb6e6e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1680 microversion: 2.1 time: 0.155746 Oct 05 03:33:41.158890 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3597/7207] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:33:41 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:33:42.181843 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-031ad73a-3e3d-4520-bac6-9fc11eb6a11a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:33:42.182476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-031ad73a-3e3d-4520-bac6-9fc11eb6a11a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:33:42.190026 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-031ad73a-3e3d-4520-bac6-9fc11eb6a11a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:42.190480 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-031ad73a-3e3d-4520-bac6-9fc11eb6a11a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:42.190920 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-031ad73a-3e3d-4520-bac6-9fc11eb6a11a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:42.191641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-031ad73a-3e3d-4520-bac6-9fc11eb6a11a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:42.192095 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-031ad73a-3e3d-4520-bac6-9fc11eb6a11a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:42.192517 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-031ad73a-3e3d-4520-bac6-9fc11eb6a11a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:42.333273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-031ad73a-3e3d-4520-bac6-9fc11eb6a11a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:33:42.341642 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-031ad73a-3e3d-4520-bac6-9fc11eb6a11a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1680 microversion: 2.1 time: 0.163766 Oct 05 03:33:42.342210 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3611/7208] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:33:42 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:33:43.365722 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7db09208-1f46-40e3-ad1a-3039eeca8b01 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:33:43.366346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7db09208-1f46-40e3-ad1a-3039eeca8b01 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:33:43.374328 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7db09208-1f46-40e3-ad1a-3039eeca8b01 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:43.374837 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7db09208-1f46-40e3-ad1a-3039eeca8b01 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:43.375292 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7db09208-1f46-40e3-ad1a-3039eeca8b01 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:43.376015 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7db09208-1f46-40e3-ad1a-3039eeca8b01 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:43.376541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7db09208-1f46-40e3-ad1a-3039eeca8b01 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:43.377061 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7db09208-1f46-40e3-ad1a-3039eeca8b01 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:43.506710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7db09208-1f46-40e3-ad1a-3039eeca8b01 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:33:43.514754 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7db09208-1f46-40e3-ad1a-3039eeca8b01 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1680 microversion: 2.1 time: 0.153046 Oct 05 03:33:43.515329 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3598/7209] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:33:43 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:33:44.538839 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-757b4cfe-673d-4f7e-81ab-c97d3191e72c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:33:44.539386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-757b4cfe-673d-4f7e-81ab-c97d3191e72c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:33:44.546242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-757b4cfe-673d-4f7e-81ab-c97d3191e72c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:44.546723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-757b4cfe-673d-4f7e-81ab-c97d3191e72c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:44.547165 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-757b4cfe-673d-4f7e-81ab-c97d3191e72c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:44.547876 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-757b4cfe-673d-4f7e-81ab-c97d3191e72c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:44.548330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-757b4cfe-673d-4f7e-81ab-c97d3191e72c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:44.548751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-757b4cfe-673d-4f7e-81ab-c97d3191e72c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:44.676518 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-757b4cfe-673d-4f7e-81ab-c97d3191e72c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:33:44.684866 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-757b4cfe-673d-4f7e-81ab-c97d3191e72c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1680 microversion: 2.1 time: 0.150055 Oct 05 03:33:44.685461 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3612/7210] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:33:44 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:33:45.708509 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ee7359d3-7639-49a6-9e6e-bc283ca60836 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:33:45.709138 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ee7359d3-7639-49a6-9e6e-bc283ca60836 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:33:45.716733 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ee7359d3-7639-49a6-9e6e-bc283ca60836 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:45.717269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ee7359d3-7639-49a6-9e6e-bc283ca60836 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:45.717728 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ee7359d3-7639-49a6-9e6e-bc283ca60836 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:45.718441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ee7359d3-7639-49a6-9e6e-bc283ca60836 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:45.718917 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ee7359d3-7639-49a6-9e6e-bc283ca60836 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:45.719363 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ee7359d3-7639-49a6-9e6e-bc283ca60836 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:45.854201 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ee7359d3-7639-49a6-9e6e-bc283ca60836 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:33:45.862649 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ee7359d3-7639-49a6-9e6e-bc283ca60836 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1657 microversion: 2.1 time: 0.158230 Oct 05 03:33:45.863226 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3599/7211] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:33:45 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1657 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:33:45.885194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4ffc1ec4-bfdc-4e71-84f4-c7496fa70f5a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:33:45.887511 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4ffc1ec4-bfdc-4e71-84f4-c7496fa70f5a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:33:45.894559 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ffc1ec4-bfdc-4e71-84f4-c7496fa70f5a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:45.895043 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ffc1ec4-bfdc-4e71-84f4-c7496fa70f5a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:45.895478 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ffc1ec4-bfdc-4e71-84f4-c7496fa70f5a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:45.896179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ffc1ec4-bfdc-4e71-84f4-c7496fa70f5a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:45.896636 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ffc1ec4-bfdc-4e71-84f4-c7496fa70f5a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:45.897092 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ffc1ec4-bfdc-4e71-84f4-c7496fa70f5a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:45.928571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4ffc1ec4-bfdc-4e71-84f4-c7496fa70f5a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:33:45.934359 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4ffc1ec4-bfdc-4e71-84f4-c7496fa70f5a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Old instance type m1.heat2, new instance type m1.heat {{(pid=122319) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 05 03:33:45.941265 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-4ffc1ec4-bfdc-4e71-84f4-c7496fa70f5a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:33:45.941690 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-4ffc1ec4-bfdc-4e71-84f4-c7496fa70f5a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:33:45.942165 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-4ffc1ec4-bfdc-4e71-84f4-c7496fa70f5a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:33:45.942575 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-4ffc1ec4-bfdc-4e71-84f4-c7496fa70f5a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:33:45.942987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-4ffc1ec4-bfdc-4e71-84f4-c7496fa70f5a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:33:46.007454 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4ffc1ec4-bfdc-4e71-84f4-c7496fa70f5a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "POST /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458/action" status: 202 len: 0 microversion: 2.1 time: 0.126158 Oct 05 03:33:46.008509 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3613/7212] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:33:45 2022] POST /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:33:46.016936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9be31818-e320-4a21-87a2-c51fb7099fe9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:33:46.017573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9be31818-e320-4a21-87a2-c51fb7099fe9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:33:46.023983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9be31818-e320-4a21-87a2-c51fb7099fe9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:46.024560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9be31818-e320-4a21-87a2-c51fb7099fe9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:46.025037 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9be31818-e320-4a21-87a2-c51fb7099fe9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:46.025744 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9be31818-e320-4a21-87a2-c51fb7099fe9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:46.026379 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9be31818-e320-4a21-87a2-c51fb7099fe9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:46.027396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9be31818-e320-4a21-87a2-c51fb7099fe9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:46.163079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9be31818-e320-4a21-87a2-c51fb7099fe9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:33:46.171767 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9be31818-e320-4a21-87a2-c51fb7099fe9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1680 microversion: 2.1 time: 0.158769 Oct 05 03:33:46.172359 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3600/7213] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:33:46 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:33:47.195609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fefce5ce-1cec-4837-b9b0-6a0632699e5e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:33:47.196233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fefce5ce-1cec-4837-b9b0-6a0632699e5e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:33:47.204577 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fefce5ce-1cec-4837-b9b0-6a0632699e5e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:47.205101 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fefce5ce-1cec-4837-b9b0-6a0632699e5e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:47.205551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fefce5ce-1cec-4837-b9b0-6a0632699e5e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:47.206259 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fefce5ce-1cec-4837-b9b0-6a0632699e5e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:47.206726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fefce5ce-1cec-4837-b9b0-6a0632699e5e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:47.207157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fefce5ce-1cec-4837-b9b0-6a0632699e5e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:47.343384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fefce5ce-1cec-4837-b9b0-6a0632699e5e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:33:47.351774 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fefce5ce-1cec-4837-b9b0-6a0632699e5e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1680 microversion: 2.1 time: 0.159827 Oct 05 03:33:47.352377 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3614/7214] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:33:47 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:33:48.376140 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-58af2c34-b332-4fcf-a9fc-0e1f67fdf519 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:33:48.376746 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-58af2c34-b332-4fcf-a9fc-0e1f67fdf519 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:33:48.383495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58af2c34-b332-4fcf-a9fc-0e1f67fdf519 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:48.383990 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58af2c34-b332-4fcf-a9fc-0e1f67fdf519 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:48.384435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58af2c34-b332-4fcf-a9fc-0e1f67fdf519 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:48.385157 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58af2c34-b332-4fcf-a9fc-0e1f67fdf519 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:48.385624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58af2c34-b332-4fcf-a9fc-0e1f67fdf519 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:48.386058 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-58af2c34-b332-4fcf-a9fc-0e1f67fdf519 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:48.514454 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-58af2c34-b332-4fcf-a9fc-0e1f67fdf519 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:33:48.522226 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-58af2c34-b332-4fcf-a9fc-0e1f67fdf519 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1685 microversion: 2.1 time: 0.149976 Oct 05 03:33:48.522806 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3601/7215] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:33:48 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1685 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:33:49.545815 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f921d077-daed-487e-93cb-12beee2c982a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:33:49.546436 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f921d077-daed-487e-93cb-12beee2c982a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:33:49.553315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f921d077-daed-487e-93cb-12beee2c982a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:49.553799 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f921d077-daed-487e-93cb-12beee2c982a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:49.554236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f921d077-daed-487e-93cb-12beee2c982a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:49.554927 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f921d077-daed-487e-93cb-12beee2c982a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:49.555384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f921d077-daed-487e-93cb-12beee2c982a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:49.555810 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f921d077-daed-487e-93cb-12beee2c982a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:49.689780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f921d077-daed-487e-93cb-12beee2c982a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:33:49.697555 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f921d077-daed-487e-93cb-12beee2c982a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1685 microversion: 2.1 time: 0.155699 Oct 05 03:33:49.698130 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3615/7216] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:33:49 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:33:50.722009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5980becc-c9bf-4ef2-b5b6-8e8f419c433f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:33:50.722648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5980becc-c9bf-4ef2-b5b6-8e8f419c433f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:33:50.730397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5980becc-c9bf-4ef2-b5b6-8e8f419c433f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:50.730929 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5980becc-c9bf-4ef2-b5b6-8e8f419c433f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:50.731384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5980becc-c9bf-4ef2-b5b6-8e8f419c433f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:50.732102 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5980becc-c9bf-4ef2-b5b6-8e8f419c433f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:50.732574 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5980becc-c9bf-4ef2-b5b6-8e8f419c433f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:50.733050 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5980becc-c9bf-4ef2-b5b6-8e8f419c433f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:50.938229 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5980becc-c9bf-4ef2-b5b6-8e8f419c433f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:33:50.946256 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5980becc-c9bf-4ef2-b5b6-8e8f419c433f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1684 microversion: 2.1 time: 0.228251 Oct 05 03:33:50.946849 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3602/7217] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:33:50 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1684 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:33:50.988140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-2739dbb3-4cf3-4f79-b621-dda1c71dc2aa req-8ada9dd7-adff-400e-bf0d-667093f8b7c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "086fbcfc-2a6b-458f-9520-eb3652662458", "name": "network-vif-unplugged", "status": "completed", "tag": "27200f4a-9292-4a93-8543-173fe05bac97"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:33:50.998400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-2739dbb3-4cf3-4f79-b621-dda1c71dc2aa req-8ada9dd7-adff-400e-bf0d-667093f8b7c8 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:50.999088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-2739dbb3-4cf3-4f79-b621-dda1c71dc2aa req-8ada9dd7-adff-400e-bf0d-667093f8b7c8 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:50.999524 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-2739dbb3-4cf3-4f79-b621-dda1c71dc2aa req-8ada9dd7-adff-400e-bf0d-667093f8b7c8 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:51.011590 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-2739dbb3-4cf3-4f79-b621-dda1c71dc2aa req-8ada9dd7-adff-400e-bf0d-667093f8b7c8 service nova] Creating event network-vif-unplugged:27200f4a-9292-4a93-8543-173fe05bac97 for instance 086fbcfc-2a6b-458f-9520-eb3652662458 on n-h2-858272-3 Oct 05 03:33:51.017665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [req-2739dbb3-4cf3-4f79-b621-dda1c71dc2aa req-8ada9dd7-adff-400e-bf0d-667093f8b7c8 service nova] Instance 086fbcfc-2a6b-458f-9520-eb3652662458 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122319) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 03:33:51.029188 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-2739dbb3-4cf3-4f79-b621-dda1c71dc2aa req-8ada9dd7-adff-400e-bf0d-667093f8b7c8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044878 Oct 05 03:33:51.029804 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3616/7218] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:33:51.970983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-33ee1bb3-7b17-427d-9d0a-e64b8c5ac3d9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:33:51.971614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-33ee1bb3-7b17-427d-9d0a-e64b8c5ac3d9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:33:51.978634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33ee1bb3-7b17-427d-9d0a-e64b8c5ac3d9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:51.979133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33ee1bb3-7b17-427d-9d0a-e64b8c5ac3d9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:51.979583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33ee1bb3-7b17-427d-9d0a-e64b8c5ac3d9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:51.980287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33ee1bb3-7b17-427d-9d0a-e64b8c5ac3d9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:51.980749 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33ee1bb3-7b17-427d-9d0a-e64b8c5ac3d9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:51.981217 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33ee1bb3-7b17-427d-9d0a-e64b8c5ac3d9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:52.117903 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-33ee1bb3-7b17-427d-9d0a-e64b8c5ac3d9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:33:52.125962 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-33ee1bb3-7b17-427d-9d0a-e64b8c5ac3d9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1684 microversion: 2.1 time: 0.159014 Oct 05 03:33:52.126542 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3603/7219] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:33:51 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:33:53.066626 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-f5171901-11ad-4e25-b1fa-a16cb20e49a7 req-0e8156fd-9b9c-4e83-a790-8c95e752b82e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "086fbcfc-2a6b-458f-9520-eb3652662458", "tag": "27200f4a-9292-4a93-8543-173fe05bac97"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:33:53.076691 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f5171901-11ad-4e25-b1fa-a16cb20e49a7 req-0e8156fd-9b9c-4e83-a790-8c95e752b82e service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:53.077186 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f5171901-11ad-4e25-b1fa-a16cb20e49a7 req-0e8156fd-9b9c-4e83-a790-8c95e752b82e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:53.077616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f5171901-11ad-4e25-b1fa-a16cb20e49a7 req-0e8156fd-9b9c-4e83-a790-8c95e752b82e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:53.089562 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-f5171901-11ad-4e25-b1fa-a16cb20e49a7 req-0e8156fd-9b9c-4e83-a790-8c95e752b82e service nova] Creating event network-changed:27200f4a-9292-4a93-8543-173fe05bac97 for instance 086fbcfc-2a6b-458f-9520-eb3652662458 on n-h2-858272-3 Oct 05 03:33:53.094861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [req-f5171901-11ad-4e25-b1fa-a16cb20e49a7 req-0e8156fd-9b9c-4e83-a790-8c95e752b82e service nova] Instance 086fbcfc-2a6b-458f-9520-eb3652662458 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122319) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 03:33:53.105677 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-f5171901-11ad-4e25-b1fa-a16cb20e49a7 req-0e8156fd-9b9c-4e83-a790-8c95e752b82e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044141 Oct 05 03:33:53.106272 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3617/7220] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:33:53.149836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-89a24e3d-9849-4ddd-b5ad-b06afb2f5711 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:33:53.150470 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-89a24e3d-9849-4ddd-b5ad-b06afb2f5711 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:33:53.158158 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89a24e3d-9849-4ddd-b5ad-b06afb2f5711 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:53.158675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89a24e3d-9849-4ddd-b5ad-b06afb2f5711 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:53.159133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89a24e3d-9849-4ddd-b5ad-b06afb2f5711 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:53.159845 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89a24e3d-9849-4ddd-b5ad-b06afb2f5711 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:53.160322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89a24e3d-9849-4ddd-b5ad-b06afb2f5711 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:53.160762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89a24e3d-9849-4ddd-b5ad-b06afb2f5711 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:53.369198 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-89a24e3d-9849-4ddd-b5ad-b06afb2f5711 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:33:53.380653 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-89a24e3d-9849-4ddd-b5ad-b06afb2f5711 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1682 microversion: 2.1 time: 0.234632 Oct 05 03:33:53.392942 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3604/7221] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:33:53 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1682 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:33:54.408196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5489b4ca-22d2-4e70-a1cf-96bdb12b1620 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:33:54.409133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5489b4ca-22d2-4e70-a1cf-96bdb12b1620 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:33:54.415312 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5489b4ca-22d2-4e70-a1cf-96bdb12b1620 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:54.415793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5489b4ca-22d2-4e70-a1cf-96bdb12b1620 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:54.416221 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5489b4ca-22d2-4e70-a1cf-96bdb12b1620 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:54.416978 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5489b4ca-22d2-4e70-a1cf-96bdb12b1620 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:54.417611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5489b4ca-22d2-4e70-a1cf-96bdb12b1620 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:54.418035 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5489b4ca-22d2-4e70-a1cf-96bdb12b1620 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:54.553976 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5489b4ca-22d2-4e70-a1cf-96bdb12b1620 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:33:54.562454 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5489b4ca-22d2-4e70-a1cf-96bdb12b1620 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1682 microversion: 2.1 time: 0.159642 Oct 05 03:33:54.572585 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3618/7222] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:33:54 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:33:55.587010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-53046b9b-3f92-42c2-8165-b80f0d084caa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:33:55.587649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-53046b9b-3f92-42c2-8165-b80f0d084caa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:33:55.595176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-53046b9b-3f92-42c2-8165-b80f0d084caa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:55.595621 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-53046b9b-3f92-42c2-8165-b80f0d084caa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:55.596071 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-53046b9b-3f92-42c2-8165-b80f0d084caa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:55.596782 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-53046b9b-3f92-42c2-8165-b80f0d084caa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:55.597280 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-53046b9b-3f92-42c2-8165-b80f0d084caa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:55.597724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-53046b9b-3f92-42c2-8165-b80f0d084caa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:55.730913 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-53046b9b-3f92-42c2-8165-b80f0d084caa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:33:55.738787 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-53046b9b-3f92-42c2-8165-b80f0d084caa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1678 microversion: 2.1 time: 0.155782 Oct 05 03:33:55.739372 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3605/7223] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:33:55 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:33:55.762578 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-46556d13-9b7b-450e-b524-6b916487cba3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:33:55.763124 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-46556d13-9b7b-450e-b524-6b916487cba3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:33:55.769966 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46556d13-9b7b-450e-b524-6b916487cba3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:55.770461 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46556d13-9b7b-450e-b524-6b916487cba3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:55.770906 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46556d13-9b7b-450e-b524-6b916487cba3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:55.771640 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46556d13-9b7b-450e-b524-6b916487cba3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:55.772102 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46556d13-9b7b-450e-b524-6b916487cba3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:55.772533 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-46556d13-9b7b-450e-b524-6b916487cba3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:55.830409 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-46556d13-9b7b-450e-b524-6b916487cba3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "POST /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458/action" status: 204 len: 0 microversion: 2.1 time: 0.072000 Oct 05 03:33:55.831042 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3619/7224] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:33:55 2022] POST /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:33:55.839998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-875ae14d-fc2e-4527-949b-fd15146caf10 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:33:55.840857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-875ae14d-fc2e-4527-949b-fd15146caf10 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:33:55.847426 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-875ae14d-fc2e-4527-949b-fd15146caf10 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:55.847967 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-875ae14d-fc2e-4527-949b-fd15146caf10 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:55.848475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-875ae14d-fc2e-4527-949b-fd15146caf10 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:55.849411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-875ae14d-fc2e-4527-949b-fd15146caf10 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:55.849748 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-875ae14d-fc2e-4527-949b-fd15146caf10 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:55.850186 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-875ae14d-fc2e-4527-949b-fd15146caf10 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:56.066891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-875ae14d-fc2e-4527-949b-fd15146caf10 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:33:56.075557 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-875ae14d-fc2e-4527-949b-fd15146caf10 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1678 microversion: 2.1 time: 0.240134 Oct 05 03:33:56.076717 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3606/7225] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:33:55 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1678 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:33:57.101294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c127ddf8-4f2a-4f27-8105-f9a4d7943866 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:33:57.102408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c127ddf8-4f2a-4f27-8105-f9a4d7943866 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:33:57.109381 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c127ddf8-4f2a-4f27-8105-f9a4d7943866 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:57.109870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c127ddf8-4f2a-4f27-8105-f9a4d7943866 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:57.110311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c127ddf8-4f2a-4f27-8105-f9a4d7943866 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:57.111015 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c127ddf8-4f2a-4f27-8105-f9a4d7943866 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:57.111472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c127ddf8-4f2a-4f27-8105-f9a4d7943866 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:57.111904 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c127ddf8-4f2a-4f27-8105-f9a4d7943866 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:57.267646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c127ddf8-4f2a-4f27-8105-f9a4d7943866 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:33:57.278278 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c127ddf8-4f2a-4f27-8105-f9a4d7943866 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1678 microversion: 2.1 time: 0.182229 Oct 05 03:33:57.279253 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3620/7226] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:33:57 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1678 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:33:58.049711 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-39d9285b-9f4e-4ea1-9428-73b6b4b582cd req-1e71ec25-db68-4c90-a8b1-b6d1ea85db4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "086fbcfc-2a6b-458f-9520-eb3652662458", "name": "network-vif-plugged", "status": "completed", "tag": "27200f4a-9292-4a93-8543-173fe05bac97"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:33:58.061576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-39d9285b-9f4e-4ea1-9428-73b6b4b582cd req-1e71ec25-db68-4c90-a8b1-b6d1ea85db4f service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:58.062079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-39d9285b-9f4e-4ea1-9428-73b6b4b582cd req-1e71ec25-db68-4c90-a8b1-b6d1ea85db4f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:58.062519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-39d9285b-9f4e-4ea1-9428-73b6b4b582cd req-1e71ec25-db68-4c90-a8b1-b6d1ea85db4f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:58.074438 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-39d9285b-9f4e-4ea1-9428-73b6b4b582cd req-1e71ec25-db68-4c90-a8b1-b6d1ea85db4f service nova] Creating event network-vif-plugged:27200f4a-9292-4a93-8543-173fe05bac97 for instance 086fbcfc-2a6b-458f-9520-eb3652662458 on n-h2-858272-3 Oct 05 03:33:58.079406 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-39d9285b-9f4e-4ea1-9428-73b6b4b582cd req-1e71ec25-db68-4c90-a8b1-b6d1ea85db4f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033582 Oct 05 03:33:58.080198 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3607/7227] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:33:58.309622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0ed43a87-2c16-4a53-bb7f-56e62d916882 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:33:58.310247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0ed43a87-2c16-4a53-bb7f-56e62d916882 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:33:58.317115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ed43a87-2c16-4a53-bb7f-56e62d916882 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:58.317607 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ed43a87-2c16-4a53-bb7f-56e62d916882 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:58.318046 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ed43a87-2c16-4a53-bb7f-56e62d916882 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:58.318737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ed43a87-2c16-4a53-bb7f-56e62d916882 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:58.319192 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ed43a87-2c16-4a53-bb7f-56e62d916882 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:58.319623 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0ed43a87-2c16-4a53-bb7f-56e62d916882 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:58.455779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0ed43a87-2c16-4a53-bb7f-56e62d916882 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:33:58.463607 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0ed43a87-2c16-4a53-bb7f-56e62d916882 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1657 microversion: 2.1 time: 0.158532 Oct 05 03:33:58.465036 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3621/7228] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:33:58 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1657 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:33:58.488010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8472f1d8-8c69-4b22-951c-5c76f8966893 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:33:58.488725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8472f1d8-8c69-4b22-951c-5c76f8966893 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:33:58.494797 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8472f1d8-8c69-4b22-951c-5c76f8966893 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:58.495319 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8472f1d8-8c69-4b22-951c-5c76f8966893 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:58.495763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8472f1d8-8c69-4b22-951c-5c76f8966893 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:58.496457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8472f1d8-8c69-4b22-951c-5c76f8966893 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:58.496949 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8472f1d8-8c69-4b22-951c-5c76f8966893 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:58.497392 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8472f1d8-8c69-4b22-951c-5c76f8966893 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:58.628661 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8472f1d8-8c69-4b22-951c-5c76f8966893 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:33:58.636963 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8472f1d8-8c69-4b22-951c-5c76f8966893 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1657 microversion: 2.1 time: 0.153093 Oct 05 03:33:58.637554 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3608/7229] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:33:58 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1657 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:33:58.661438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8663401d-d22f-46f3-bacb-356584396db9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:33:58.669249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8663401d-d22f-46f3-bacb-356584396db9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:58.670158 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8663401d-d22f-46f3-bacb-356584396db9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:58.670491 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8663401d-d22f-46f3-bacb-356584396db9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:58.703098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8663401d-d22f-46f3-bacb-356584396db9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Going to try to start instance {{(pid=122319) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 05 03:33:58.710000 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:33:58.756089 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8663401d-d22f-46f3-bacb-356584396db9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "POST /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458/action" status: 202 len: 0 microversion: 2.1 time: 0.099649 Oct 05 03:33:58.756691 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3622/7230] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:33:58 2022] POST /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:33:58.765671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7a462838-4781-497a-bfe2-85cdbb84ecaa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:33:58.766309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7a462838-4781-497a-bfe2-85cdbb84ecaa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:33:58.772588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a462838-4781-497a-bfe2-85cdbb84ecaa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:58.773144 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a462838-4781-497a-bfe2-85cdbb84ecaa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:58.773600 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a462838-4781-497a-bfe2-85cdbb84ecaa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:58.774332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a462838-4781-497a-bfe2-85cdbb84ecaa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:58.774783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a462838-4781-497a-bfe2-85cdbb84ecaa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:58.775227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a462838-4781-497a-bfe2-85cdbb84ecaa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:58.952260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7a462838-4781-497a-bfe2-85cdbb84ecaa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:33:58.960280 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7a462838-4781-497a-bfe2-85cdbb84ecaa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1666 microversion: 2.1 time: 0.198492 Oct 05 03:33:58.960866 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3609/7231] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:33:58 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1666 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:33:59.985875 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3c128820-1a42-4b6b-84aa-e80a2776c9db tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:33:59.986582 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3c128820-1a42-4b6b-84aa-e80a2776c9db tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:33:59.993014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c128820-1a42-4b6b-84aa-e80a2776c9db tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:59.993499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c128820-1a42-4b6b-84aa-e80a2776c9db tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:59.993929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c128820-1a42-4b6b-84aa-e80a2776c9db tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:33:59.994613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c128820-1a42-4b6b-84aa-e80a2776c9db tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:33:59.995091 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c128820-1a42-4b6b-84aa-e80a2776c9db tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:33:59.995514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c128820-1a42-4b6b-84aa-e80a2776c9db tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:00.122938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3c128820-1a42-4b6b-84aa-e80a2776c9db tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:34:00.130729 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3c128820-1a42-4b6b-84aa-e80a2776c9db tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1666 microversion: 2.1 time: 0.150069 Oct 05 03:34:00.131306 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3623/7232] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:33:59 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1666 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:34:01.154448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b17e0978-9b07-4501-8cab-ce8738861d0d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:34:01.155088 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b17e0978-9b07-4501-8cab-ce8738861d0d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:34:01.162032 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b17e0978-9b07-4501-8cab-ce8738861d0d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:01.162533 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b17e0978-9b07-4501-8cab-ce8738861d0d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:01.162985 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b17e0978-9b07-4501-8cab-ce8738861d0d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:01.163688 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b17e0978-9b07-4501-8cab-ce8738861d0d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:01.164158 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b17e0978-9b07-4501-8cab-ce8738861d0d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:01.164598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b17e0978-9b07-4501-8cab-ce8738861d0d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:01.168963 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:34:01.300877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b17e0978-9b07-4501-8cab-ce8738861d0d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:34:01.308850 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b17e0978-9b07-4501-8cab-ce8738861d0d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1670 microversion: 2.1 time: 0.158991 Oct 05 03:34:01.309451 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3610/7233] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:34:01 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:34:01.331876 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-918b3f42-23f4-4ab0-9959-ee26d2bb62b6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:34:01.332391 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-918b3f42-23f4-4ab0-9959-ee26d2bb62b6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:34:01.341558 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-918b3f42-23f4-4ab0-9959-ee26d2bb62b6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:01.342050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-918b3f42-23f4-4ab0-9959-ee26d2bb62b6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:01.342483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-918b3f42-23f4-4ab0-9959-ee26d2bb62b6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:01.343176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-918b3f42-23f4-4ab0-9959-ee26d2bb62b6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:01.343631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-918b3f42-23f4-4ab0-9959-ee26d2bb62b6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:01.344054 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-918b3f42-23f4-4ab0-9959-ee26d2bb62b6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:01.370062 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-918b3f42-23f4-4ab0-9959-ee26d2bb62b6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:34:01.443084 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-918b3f42-23f4-4ab0-9959-ee26d2bb62b6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "DELETE /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 204 len: 0 microversion: 2.1 time: 0.114671 Oct 05 03:34:01.443600 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3624/7234] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:34:01 2022] DELETE /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:34:01.453397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-507e01c2-ebeb-4869-ae3d-83c5b18bf5a8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:34:01.454156 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-507e01c2-ebeb-4869-ae3d-83c5b18bf5a8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:34:01.460387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-507e01c2-ebeb-4869-ae3d-83c5b18bf5a8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:01.460913 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-507e01c2-ebeb-4869-ae3d-83c5b18bf5a8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:01.461408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-507e01c2-ebeb-4869-ae3d-83c5b18bf5a8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:01.462122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-507e01c2-ebeb-4869-ae3d-83c5b18bf5a8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:01.462594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-507e01c2-ebeb-4869-ae3d-83c5b18bf5a8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:01.463032 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-507e01c2-ebeb-4869-ae3d-83c5b18bf5a8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:01.598669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-507e01c2-ebeb-4869-ae3d-83c5b18bf5a8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:34:01.606906 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-507e01c2-ebeb-4869-ae3d-83c5b18bf5a8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1676 microversion: 2.1 time: 0.158704 Oct 05 03:34:01.607482 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3611/7235] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:34:01 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:34:02.631634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1c1ab955-1b06-4a04-9b79-304c8ff76ae2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:34:02.632373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1c1ab955-1b06-4a04-9b79-304c8ff76ae2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:34:02.639190 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c1ab955-1b06-4a04-9b79-304c8ff76ae2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:02.639677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c1ab955-1b06-4a04-9b79-304c8ff76ae2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:02.640111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c1ab955-1b06-4a04-9b79-304c8ff76ae2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:02.640803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c1ab955-1b06-4a04-9b79-304c8ff76ae2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:02.641285 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c1ab955-1b06-4a04-9b79-304c8ff76ae2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:02.641712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c1ab955-1b06-4a04-9b79-304c8ff76ae2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:02.774251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1c1ab955-1b06-4a04-9b79-304c8ff76ae2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:34:02.782095 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1c1ab955-1b06-4a04-9b79-304c8ff76ae2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1676 microversion: 2.1 time: 0.154837 Oct 05 03:34:02.782672 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3625/7236] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:34:02 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:34:03.806223 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-48af2c79-a609-41c4-82d0-546afbf0180d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:34:03.806878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-48af2c79-a609-41c4-82d0-546afbf0180d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:34:03.814581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48af2c79-a609-41c4-82d0-546afbf0180d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:03.814826 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48af2c79-a609-41c4-82d0-546afbf0180d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:03.815277 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48af2c79-a609-41c4-82d0-546afbf0180d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:03.815996 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48af2c79-a609-41c4-82d0-546afbf0180d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:03.816610 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48af2c79-a609-41c4-82d0-546afbf0180d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:03.817080 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-48af2c79-a609-41c4-82d0-546afbf0180d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:03.863710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-2332090a-c6ca-48ca-ad47-00ea7c3fdba3 req-40aefb7b-fabb-4eab-9c89-3a3d07bac1b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "086fbcfc-2a6b-458f-9520-eb3652662458", "name": "network-vif-deleted", "tag": "27200f4a-9292-4a93-8543-173fe05bac97"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:34:03.877339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-2332090a-c6ca-48ca-ad47-00ea7c3fdba3 req-40aefb7b-fabb-4eab-9c89-3a3d07bac1b6 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:03.877819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-2332090a-c6ca-48ca-ad47-00ea7c3fdba3 req-40aefb7b-fabb-4eab-9c89-3a3d07bac1b6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:03.878246 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-2332090a-c6ca-48ca-ad47-00ea7c3fdba3 req-40aefb7b-fabb-4eab-9c89-3a3d07bac1b6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:03.892857 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-2332090a-c6ca-48ca-ad47-00ea7c3fdba3 req-40aefb7b-fabb-4eab-9c89-3a3d07bac1b6 service nova] Creating event network-vif-deleted:27200f4a-9292-4a93-8543-173fe05bac97 for instance 086fbcfc-2a6b-458f-9520-eb3652662458 on n-h2-858272-3 Oct 05 03:34:03.894755 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-48af2c79-a609-41c4-82d0-546afbf0180d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:34:03.897975 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-2332090a-c6ca-48ca-ad47-00ea7c3fdba3 req-40aefb7b-fabb-4eab-9c89-3a3d07bac1b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039017 Oct 05 03:34:03.899859 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3626/7237] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:34:03.904672 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-48af2c79-a609-41c4-82d0-546afbf0180d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 200 len: 1609 microversion: 2.1 time: 0.102467 Oct 05 03:34:03.905201 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3612/7238] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:34:03 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 1609 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:34:04.929107 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-877ca263-fee3-4439-96af-97f1def2a4f8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:34:04.929814 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-877ca263-fee3-4439-96af-97f1def2a4f8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:34:04.937005 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-877ca263-fee3-4439-96af-97f1def2a4f8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:04.937496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-877ca263-fee3-4439-96af-97f1def2a4f8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:04.937932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-877ca263-fee3-4439-96af-97f1def2a4f8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:04.938622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-877ca263-fee3-4439-96af-97f1def2a4f8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:04.939078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-877ca263-fee3-4439-96af-97f1def2a4f8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:04.939506 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-877ca263-fee3-4439-96af-97f1def2a4f8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:04.952800 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-877ca263-fee3-4439-96af-97f1def2a4f8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] HTTP exception thrown: Instance 086fbcfc-2a6b-458f-9520-eb3652662458 could not be found. Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-877ca263-fee3-4439-96af-97f1def2a4f8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Request method failure captured: Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 HTTP/1.1 Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPpOjo3UoOtQ-Bs93Auly_6sXh8lfDtgrSY0udxfQzVZtNtMSUx1jRG2ewnriCtcRUrnJaHmLaLcz0mVVG5b9vEZRuG06925WdPWiQLXMx8sJPVOF2G8G35VQEtfcoJQaOleL8MsseS-M06VqanojXWiUqJgAvvCm3KftD0h1N4k_LM Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: cb907a92ab7949ebb3cb2e3b5d372ece Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: cb907a92ab7949ebb3cb2e3b5d372ece Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerActionsTestJSON-2031640985-project Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 64375d765c0949dbb75c91906f8bca3c Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerActionsTestJSON-2031640985-project Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 086fbcfc-2a6b-458f-9520-eb3652662458 could not be found. Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '086fbcfc-2a6b-458f-9520-eb3652662458'} Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 086fbcfc-2a6b-458f-9520-eb3652662458 could not be found. Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 086fbcfc-2a6b-458f-9520-eb3652662458 could not be found. Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:34:04.954424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:34:04.959542 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:34:04.959542 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:34:04.959542 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:34:04.959542 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:34:04.959542 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:34:04.959542 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 086fbcfc-2a6b-458f-9520-eb3652662458 could not be found. Oct 05 03:34:04.959542 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:34:04.959542 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-877ca263-fee3-4439-96af-97f1def2a4f8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Returning 404 to user: Instance 086fbcfc-2a6b-458f-9520-eb3652662458 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:34:04.959542 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-877ca263-fee3-4439-96af-97f1def2a4f8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 404 len: 111 microversion: 2.1 time: 0.031924 Oct 05 03:34:04.959542 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3627/7239] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:34:04 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:34:04.971609 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4e7b9ef3-43c6-468b-9b2b-b483bf0114e9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:34:04.972243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4e7b9ef3-43c6-468b-9b2b-b483bf0114e9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:34:04.980291 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e7b9ef3-43c6-468b-9b2b-b483bf0114e9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:04.980793 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e7b9ef3-43c6-468b-9b2b-b483bf0114e9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:04.981330 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e7b9ef3-43c6-468b-9b2b-b483bf0114e9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:04.982035 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e7b9ef3-43c6-468b-9b2b-b483bf0114e9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:04.982504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e7b9ef3-43c6-468b-9b2b-b483bf0114e9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:04.982944 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e7b9ef3-43c6-468b-9b2b-b483bf0114e9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:04.996823 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-4e7b9ef3-43c6-468b-9b2b-b483bf0114e9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] HTTP exception thrown: Instance 086fbcfc-2a6b-458f-9520-eb3652662458 could not be found. Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4e7b9ef3-43c6-468b-9b2b-b483bf0114e9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Request method failure captured: Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 HTTP/1.1 Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPpOjo3UoOtQ-Bs93Auly_6sXh8lfDtgrSY0udxfQzVZtNtMSUx1jRG2ewnriCtcRUrnJaHmLaLcz0mVVG5b9vEZRuG06925WdPWiQLXMx8sJPVOF2G8G35VQEtfcoJQaOleL8MsseS-M06VqanojXWiUqJgAvvCm3KftD0h1N4k_LM Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: cb907a92ab7949ebb3cb2e3b5d372ece Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: cb907a92ab7949ebb3cb2e3b5d372ece Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServerActionsTestJSON-2031640985-project Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 64375d765c0949dbb75c91906f8bca3c Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServerActionsTestJSON-2031640985-project Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 086fbcfc-2a6b-458f-9520-eb3652662458 could not be found. Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '086fbcfc-2a6b-458f-9520-eb3652662458'} Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 086fbcfc-2a6b-458f-9520-eb3652662458 could not be found. Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 086fbcfc-2a6b-458f-9520-eb3652662458 could not be found. Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:34:04.998495 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:34:05.002673 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:34:05.002673 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:34:05.002673 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:34:05.002673 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:34:05.002673 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:34:05.002673 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 086fbcfc-2a6b-458f-9520-eb3652662458 could not be found. Oct 05 03:34:05.002673 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:34:05.002673 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4e7b9ef3-43c6-468b-9b2b-b483bf0114e9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Returning 404 to user: Instance 086fbcfc-2a6b-458f-9520-eb3652662458 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:34:05.002673 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4e7b9ef3-43c6-468b-9b2b-b483bf0114e9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 404 len: 111 microversion: 2.1 time: 0.032194 Oct 05 03:34:05.002673 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3613/7240] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:34:04 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:34:05.047924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1c4fa060-6777-4f68-8a27-c143f5fadffd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1986568797", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "e3e1b2b6-bb43-4574-b227-e8169188bcd9"}], "security_groups": [{"name": "tempest-securitygroup--711774869"}], "key_name": "tempest-keypair-904238654", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:34:05.154617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-1c4fa060-6777-4f68-8a27-c143f5fadffd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] validate_networks() for [('e3e1b2b6-bb43-4574-b227-e8169188bcd9', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:34:05.331093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:34:05.573514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-1c4fa060-6777-4f68-8a27-c143f5fadffd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:34:05.574006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-1c4fa060-6777-4f68-8a27-c143f5fadffd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:34:05.574484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-1c4fa060-6777-4f68-8a27-c143f5fadffd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:34:05.574901 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-1c4fa060-6777-4f68-8a27-c143f5fadffd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:34:05.575316 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-1c4fa060-6777-4f68-8a27-c143f5fadffd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:34:05.584225 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c4fa060-6777-4f68-8a27-c143f5fadffd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:05.584649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c4fa060-6777-4f68-8a27-c143f5fadffd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:05.585127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c4fa060-6777-4f68-8a27-c143f5fadffd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:05.585853 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c4fa060-6777-4f68-8a27-c143f5fadffd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:05.586312 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c4fa060-6777-4f68-8a27-c143f5fadffd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:05.586738 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c4fa060-6777-4f68-8a27-c143f5fadffd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:05.604566 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-1c4fa060-6777-4f68-8a27-c143f5fadffd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Getting quotas for project cb907a92ab7949ebb3cb2e3b5d372ece. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:34:05.609889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-1c4fa060-6777-4f68-8a27-c143f5fadffd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Getting quotas for user 64375d765c0949dbb75c91906f8bca3c and project cb907a92ab7949ebb3cb2e3b5d372ece. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:34:05.625399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1c4fa060-6777-4f68-8a27-c143f5fadffd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:34:05.627860 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1c4fa060-6777-4f68-8a27-c143f5fadffd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:34:05.674584 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1c4fa060-6777-4f68-8a27-c143f5fadffd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.630426 Oct 05 03:34:05.675250 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3628/7241] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:34:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:34:05.686843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c61616ed-8782-49b7-83c0-e540df66c325 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:34:05.687472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c61616ed-8782-49b7-83c0-e540df66c325 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:34:05.690376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=41 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:34:05.743480 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c61616ed-8782-49b7-83c0-e540df66c325 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:34:05.750613 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c61616ed-8782-49b7-83c0-e540df66c325 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1238 microversion: 2.1 time: 0.067949 Oct 05 03:34:05.751224 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3614/7242] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:34:05 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:34:06.775753 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-696133c9-fd64-418f-967e-a2f59cd9b3e8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:34:06.776942 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-696133c9-fd64-418f-967e-a2f59cd9b3e8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:34:06.784097 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-696133c9-fd64-418f-967e-a2f59cd9b3e8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:06.784687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-696133c9-fd64-418f-967e-a2f59cd9b3e8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:06.785219 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-696133c9-fd64-418f-967e-a2f59cd9b3e8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:06.785986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-696133c9-fd64-418f-967e-a2f59cd9b3e8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:06.786507 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-696133c9-fd64-418f-967e-a2f59cd9b3e8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:06.787279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-696133c9-fd64-418f-967e-a2f59cd9b3e8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:06.862165 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-696133c9-fd64-418f-967e-a2f59cd9b3e8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:34:06.870584 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-696133c9-fd64-418f-967e-a2f59cd9b3e8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1308 microversion: 2.1 time: 0.099162 Oct 05 03:34:06.871362 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3629/7243] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:34:06 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:34:07.897127 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5aeb24ee-26ad-477d-97c7-c4b423a72f84 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:34:07.897983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5aeb24ee-26ad-477d-97c7-c4b423a72f84 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:34:07.905846 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5aeb24ee-26ad-477d-97c7-c4b423a72f84 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:07.906443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5aeb24ee-26ad-477d-97c7-c4b423a72f84 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:07.906966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5aeb24ee-26ad-477d-97c7-c4b423a72f84 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:07.907751 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5aeb24ee-26ad-477d-97c7-c4b423a72f84 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:07.908404 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5aeb24ee-26ad-477d-97c7-c4b423a72f84 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:07.908945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5aeb24ee-26ad-477d-97c7-c4b423a72f84 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:08.127967 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5aeb24ee-26ad-477d-97c7-c4b423a72f84 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:34:08.136302 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5aeb24ee-26ad-477d-97c7-c4b423a72f84 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1363 microversion: 2.1 time: 0.244440 Oct 05 03:34:08.136889 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3615/7244] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:34:07 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:34:08.225646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-4888ae79-8053-48c9-a068-fbc4d5932416 req-f25df58f-a1c0-403a-a881-cc5e36be162a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3fe481a-aa94-4784-9110-17b861d9478d", "tag": "48782612-24dd-4164-a700-53f7ba58ac79"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:34:08.237500 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4888ae79-8053-48c9-a068-fbc4d5932416 req-f25df58f-a1c0-403a-a881-cc5e36be162a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:08.237908 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4888ae79-8053-48c9-a068-fbc4d5932416 req-f25df58f-a1c0-403a-a881-cc5e36be162a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:08.238390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4888ae79-8053-48c9-a068-fbc4d5932416 req-f25df58f-a1c0-403a-a881-cc5e36be162a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:08.250386 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-4888ae79-8053-48c9-a068-fbc4d5932416 req-f25df58f-a1c0-403a-a881-cc5e36be162a service nova] Creating event network-changed:48782612-24dd-4164-a700-53f7ba58ac79 for instance e3fe481a-aa94-4784-9110-17b861d9478d on n-h2-858272-3 Oct 05 03:34:08.255031 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-4888ae79-8053-48c9-a068-fbc4d5932416 req-f25df58f-a1c0-403a-a881-cc5e36be162a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033219 Oct 05 03:34:08.255632 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3630/7245] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:34:09.160644 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8e30a4ef-7e3a-4c85-972a-f1597c7dc48d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:34:09.161300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8e30a4ef-7e3a-4c85-972a-f1597c7dc48d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:34:09.169098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e30a4ef-7e3a-4c85-972a-f1597c7dc48d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:09.169599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e30a4ef-7e3a-4c85-972a-f1597c7dc48d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:09.170048 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e30a4ef-7e3a-4c85-972a-f1597c7dc48d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:09.170751 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e30a4ef-7e3a-4c85-972a-f1597c7dc48d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:09.171214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e30a4ef-7e3a-4c85-972a-f1597c7dc48d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:09.171649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e30a4ef-7e3a-4c85-972a-f1597c7dc48d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:09.309097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8e30a4ef-7e3a-4c85-972a-f1597c7dc48d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:34:09.316869 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8e30a4ef-7e3a-4c85-972a-f1597c7dc48d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1363 microversion: 2.1 time: 0.160396 Oct 05 03:34:09.317531 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3616/7246] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:34:09 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:34:10.342772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f9c2a859-f777-45a7-b5c7-410814436393 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:34:10.343473 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f9c2a859-f777-45a7-b5c7-410814436393 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:34:10.349687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9c2a859-f777-45a7-b5c7-410814436393 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:10.350157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9c2a859-f777-45a7-b5c7-410814436393 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:10.350594 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9c2a859-f777-45a7-b5c7-410814436393 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:10.351284 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9c2a859-f777-45a7-b5c7-410814436393 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:10.352005 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9c2a859-f777-45a7-b5c7-410814436393 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:10.352432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f9c2a859-f777-45a7-b5c7-410814436393 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:10.486356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f9c2a859-f777-45a7-b5c7-410814436393 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:34:10.494216 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f9c2a859-f777-45a7-b5c7-410814436393 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1363 microversion: 2.1 time: 0.156735 Oct 05 03:34:10.495481 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3631/7247] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:34:10 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:34:11.519574 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-596d5433-6e66-487c-872a-979907e0ddc0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:34:11.520128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-596d5433-6e66-487c-872a-979907e0ddc0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:34:11.526964 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-596d5433-6e66-487c-872a-979907e0ddc0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:11.527454 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-596d5433-6e66-487c-872a-979907e0ddc0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:11.527902 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-596d5433-6e66-487c-872a-979907e0ddc0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:11.528595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-596d5433-6e66-487c-872a-979907e0ddc0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:11.529104 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-596d5433-6e66-487c-872a-979907e0ddc0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:11.529536 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-596d5433-6e66-487c-872a-979907e0ddc0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:11.657396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-596d5433-6e66-487c-872a-979907e0ddc0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:34:11.665137 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-596d5433-6e66-487c-872a-979907e0ddc0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1363 microversion: 2.1 time: 0.149522 Oct 05 03:34:11.665855 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3617/7248] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:34:11 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:34:12.689124 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-40abc7f7-70f4-4baa-a90b-7f0ab7d32188 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:34:12.689748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-40abc7f7-70f4-4baa-a90b-7f0ab7d32188 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:34:12.696631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40abc7f7-70f4-4baa-a90b-7f0ab7d32188 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:12.697150 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40abc7f7-70f4-4baa-a90b-7f0ab7d32188 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:12.698316 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40abc7f7-70f4-4baa-a90b-7f0ab7d32188 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:12.698826 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40abc7f7-70f4-4baa-a90b-7f0ab7d32188 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:12.699281 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40abc7f7-70f4-4baa-a90b-7f0ab7d32188 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:12.699708 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40abc7f7-70f4-4baa-a90b-7f0ab7d32188 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:12.830078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-40abc7f7-70f4-4baa-a90b-7f0ab7d32188 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:34:12.838169 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-40abc7f7-70f4-4baa-a90b-7f0ab7d32188 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1363 microversion: 2.1 time: 0.152965 Oct 05 03:34:12.838770 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3632/7249] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:34:12 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:34:13.861851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-759a7d1e-ab44-404d-afe3-23ebc8dee125 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:34:13.862478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-759a7d1e-ab44-404d-afe3-23ebc8dee125 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:34:13.869262 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-759a7d1e-ab44-404d-afe3-23ebc8dee125 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:13.869821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-759a7d1e-ab44-404d-afe3-23ebc8dee125 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:13.870269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-759a7d1e-ab44-404d-afe3-23ebc8dee125 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:13.870970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-759a7d1e-ab44-404d-afe3-23ebc8dee125 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:13.871441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-759a7d1e-ab44-404d-afe3-23ebc8dee125 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:13.871878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-759a7d1e-ab44-404d-afe3-23ebc8dee125 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:14.002001 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-759a7d1e-ab44-404d-afe3-23ebc8dee125 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:34:14.009724 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-759a7d1e-ab44-404d-afe3-23ebc8dee125 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1363 microversion: 2.1 time: 0.151865 Oct 05 03:34:14.010837 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3618/7250] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:34:13 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:34:14.094121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-175c2ff0-afdf-4958-87d5-9ed3f77d41e6 req-8b405d55-24f4-4ee0-b47b-54df966edada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3fe481a-aa94-4784-9110-17b861d9478d", "name": "network-vif-plugged", "status": "completed", "tag": "48782612-24dd-4164-a700-53f7ba58ac79"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:34:14.105514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-175c2ff0-afdf-4958-87d5-9ed3f77d41e6 req-8b405d55-24f4-4ee0-b47b-54df966edada service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:14.106004 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-175c2ff0-afdf-4958-87d5-9ed3f77d41e6 req-8b405d55-24f4-4ee0-b47b-54df966edada service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:14.107434 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-175c2ff0-afdf-4958-87d5-9ed3f77d41e6 req-8b405d55-24f4-4ee0-b47b-54df966edada service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:14.123614 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-175c2ff0-afdf-4958-87d5-9ed3f77d41e6 req-8b405d55-24f4-4ee0-b47b-54df966edada service nova] Creating event network-vif-plugged:48782612-24dd-4164-a700-53f7ba58ac79 for instance e3fe481a-aa94-4784-9110-17b861d9478d on n-h2-858272-3 Oct 05 03:34:14.128807 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-175c2ff0-afdf-4958-87d5-9ed3f77d41e6 req-8b405d55-24f4-4ee0-b47b-54df966edada service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038565 Oct 05 03:34:14.129469 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3633/7251] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:34:15.034323 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b1b5d577-dd2b-4711-a41c-103fe9723099 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:34:15.034951 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b1b5d577-dd2b-4711-a41c-103fe9723099 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:34:15.042564 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b1b5d577-dd2b-4711-a41c-103fe9723099 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:15.043066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b1b5d577-dd2b-4711-a41c-103fe9723099 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:15.043515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b1b5d577-dd2b-4711-a41c-103fe9723099 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:15.044215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b1b5d577-dd2b-4711-a41c-103fe9723099 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:15.044683 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b1b5d577-dd2b-4711-a41c-103fe9723099 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:15.045144 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b1b5d577-dd2b-4711-a41c-103fe9723099 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:15.174939 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b1b5d577-dd2b-4711-a41c-103fe9723099 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:34:15.182696 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b1b5d577-dd2b-4711-a41c-103fe9723099 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1363 microversion: 2.1 time: 0.152171 Oct 05 03:34:15.183270 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3619/7252] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:34:15 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:34:16.204303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:34:16.205161 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:34:16.209239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-99d7c321-3cdf-4cdb-b440-abbb39418fb5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:34:16.209978 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-99d7c321-3cdf-4cdb-b440-abbb39418fb5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:34:16.217197 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99d7c321-3cdf-4cdb-b440-abbb39418fb5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:16.217688 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99d7c321-3cdf-4cdb-b440-abbb39418fb5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:16.218125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99d7c321-3cdf-4cdb-b440-abbb39418fb5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:16.218824 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99d7c321-3cdf-4cdb-b440-abbb39418fb5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:16.219277 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99d7c321-3cdf-4cdb-b440-abbb39418fb5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:16.219703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99d7c321-3cdf-4cdb-b440-abbb39418fb5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:16.348443 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-99d7c321-3cdf-4cdb-b440-abbb39418fb5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:34:16.357247 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-99d7c321-3cdf-4cdb-b440-abbb39418fb5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1551 microversion: 2.1 time: 0.154718 Oct 05 03:34:16.357819 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3634/7253] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:34:16 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1551 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:34:16.381671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-227d91cc-6e27-4fc4-bd2a-1c432a63b556 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:34:16.382329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-227d91cc-6e27-4fc4-bd2a-1c432a63b556 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:34:16.384302 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:34:16.390928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-227d91cc-6e27-4fc4-bd2a-1c432a63b556 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:16.391440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-227d91cc-6e27-4fc4-bd2a-1c432a63b556 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:16.391903 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-227d91cc-6e27-4fc4-bd2a-1c432a63b556 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:16.392623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-227d91cc-6e27-4fc4-bd2a-1c432a63b556 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:16.393134 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-227d91cc-6e27-4fc4-bd2a-1c432a63b556 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:16.393584 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-227d91cc-6e27-4fc4-bd2a-1c432a63b556 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:16.473376 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-227d91cc-6e27-4fc4-bd2a-1c432a63b556 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095546 Oct 05 03:34:16.474021 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3620/7254] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 03:34:16 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:34:17.390970 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-ef9e43a7-8205-401d-aca1-a887dc1e78df req-db93bd2f-4931-4d6e-a1b2-6039f5b5668d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3fe481a-aa94-4784-9110-17b861d9478d", "tag": "48782612-24dd-4164-a700-53f7ba58ac79"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:34:17.401262 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ef9e43a7-8205-401d-aca1-a887dc1e78df req-db93bd2f-4931-4d6e-a1b2-6039f5b5668d service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:34:17.401829 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ef9e43a7-8205-401d-aca1-a887dc1e78df req-db93bd2f-4931-4d6e-a1b2-6039f5b5668d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:34:17.402259 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ef9e43a7-8205-401d-aca1-a887dc1e78df req-db93bd2f-4931-4d6e-a1b2-6039f5b5668d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:34:17.415209 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-ef9e43a7-8205-401d-aca1-a887dc1e78df req-db93bd2f-4931-4d6e-a1b2-6039f5b5668d service nova] Creating event network-changed:48782612-24dd-4164-a700-53f7ba58ac79 for instance e3fe481a-aa94-4784-9110-17b861d9478d on n-h2-858272-3 Oct 05 03:34:17.420285 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-ef9e43a7-8205-401d-aca1-a887dc1e78df req-db93bd2f-4931-4d6e-a1b2-6039f5b5668d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033024 Oct 05 03:34:17.420954 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3635/7255] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:35:29.404273 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=15 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:35:29.405127 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=52 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:35:29.462073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c6219859-aaf4-49ab-8a13-64e687796f3e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:35:29.464435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c6219859-aaf4-49ab-8a13-64e687796f3e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:35:29.471917 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c6219859-aaf4-49ab-8a13-64e687796f3e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:29.472422 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c6219859-aaf4-49ab-8a13-64e687796f3e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:29.472876 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c6219859-aaf4-49ab-8a13-64e687796f3e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:29.473681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c6219859-aaf4-49ab-8a13-64e687796f3e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:29.474159 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c6219859-aaf4-49ab-8a13-64e687796f3e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:29.474603 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c6219859-aaf4-49ab-8a13-64e687796f3e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:29.502833 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c6219859-aaf4-49ab-8a13-64e687796f3e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:35:29.508316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c6219859-aaf4-49ab-8a13-64e687796f3e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Old instance type m1.heat2, new instance type m1.heat {{(pid=122320) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 05 03:35:29.515432 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-c6219859-aaf4-49ab-8a13-64e687796f3e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:35:29.515872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-c6219859-aaf4-49ab-8a13-64e687796f3e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:35:29.516364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-c6219859-aaf4-49ab-8a13-64e687796f3e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:35:29.516790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-c6219859-aaf4-49ab-8a13-64e687796f3e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:35:29.517834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-c6219859-aaf4-49ab-8a13-64e687796f3e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:35:29.580481 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c6219859-aaf4-49ab-8a13-64e687796f3e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "POST /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d/action" status: 202 len: 0 microversion: 2.1 time: 0.180193 Oct 05 03:35:29.581125 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3621/7256] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:35:29 2022] POST /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:35:29.588939 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:35:29.589706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:35:29.596564 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-35d1b3e5-19fe-4773-8aea-0b4cb5eb66d6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:35:29.597286 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-35d1b3e5-19fe-4773-8aea-0b4cb5eb66d6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:35:29.605460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35d1b3e5-19fe-4773-8aea-0b4cb5eb66d6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:29.606089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35d1b3e5-19fe-4773-8aea-0b4cb5eb66d6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:29.606931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35d1b3e5-19fe-4773-8aea-0b4cb5eb66d6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:29.607723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35d1b3e5-19fe-4773-8aea-0b4cb5eb66d6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:29.608207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35d1b3e5-19fe-4773-8aea-0b4cb5eb66d6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:29.608639 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-35d1b3e5-19fe-4773-8aea-0b4cb5eb66d6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:29.761272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-35d1b3e5-19fe-4773-8aea-0b4cb5eb66d6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:35:29.770008 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-35d1b3e5-19fe-4773-8aea-0b4cb5eb66d6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1679 microversion: 2.1 time: 0.184406 Oct 05 03:35:29.770587 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3636/7257] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:35:29 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1679 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:35:30.797176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5af2e6a7-913e-45ea-b298-fcfb6a638e93 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:35:30.797821 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5af2e6a7-913e-45ea-b298-fcfb6a638e93 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:35:30.808629 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5af2e6a7-913e-45ea-b298-fcfb6a638e93 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:30.809746 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5af2e6a7-913e-45ea-b298-fcfb6a638e93 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:30.810203 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5af2e6a7-913e-45ea-b298-fcfb6a638e93 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:30.810906 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5af2e6a7-913e-45ea-b298-fcfb6a638e93 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:30.811377 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5af2e6a7-913e-45ea-b298-fcfb6a638e93 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:30.811813 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5af2e6a7-913e-45ea-b298-fcfb6a638e93 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:31.041585 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5af2e6a7-913e-45ea-b298-fcfb6a638e93 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:35:31.052954 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5af2e6a7-913e-45ea-b298-fcfb6a638e93 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1679 microversion: 2.1 time: 0.262835 Oct 05 03:35:31.053815 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3622/7258] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:35:30 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1679 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:35:32.084998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a29577a4-da0c-483f-b9d2-8ecc51851a0c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:35:32.085627 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a29577a4-da0c-483f-b9d2-8ecc51851a0c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:35:32.092730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a29577a4-da0c-483f-b9d2-8ecc51851a0c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:32.093257 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a29577a4-da0c-483f-b9d2-8ecc51851a0c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:32.093697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a29577a4-da0c-483f-b9d2-8ecc51851a0c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:32.094385 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a29577a4-da0c-483f-b9d2-8ecc51851a0c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:32.094843 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a29577a4-da0c-483f-b9d2-8ecc51851a0c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:32.095266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a29577a4-da0c-483f-b9d2-8ecc51851a0c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:32.229484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a29577a4-da0c-483f-b9d2-8ecc51851a0c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:35:32.239062 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a29577a4-da0c-483f-b9d2-8ecc51851a0c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1684 microversion: 2.1 time: 0.158005 Oct 05 03:35:32.239716 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3637/7259] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:35:32 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:35:33.264265 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a148eedd-553c-4449-b885-ab37e34571d0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:35:33.264812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a148eedd-553c-4449-b885-ab37e34571d0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:35:33.271741 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a148eedd-553c-4449-b885-ab37e34571d0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:33.272250 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a148eedd-553c-4449-b885-ab37e34571d0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:33.272706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a148eedd-553c-4449-b885-ab37e34571d0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:33.273442 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a148eedd-553c-4449-b885-ab37e34571d0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:33.273916 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a148eedd-553c-4449-b885-ab37e34571d0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:33.274356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a148eedd-553c-4449-b885-ab37e34571d0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:33.404647 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a148eedd-553c-4449-b885-ab37e34571d0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:35:33.412469 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a148eedd-553c-4449-b885-ab37e34571d0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1684 microversion: 2.1 time: 0.152709 Oct 05 03:35:33.413078 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3623/7260] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:35:33 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:35:34.435573 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-de1c4a1b-c456-4a05-aac6-ca439781a2c9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:35:34.436204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-de1c4a1b-c456-4a05-aac6-ca439781a2c9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:35:34.443051 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de1c4a1b-c456-4a05-aac6-ca439781a2c9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:34.443541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de1c4a1b-c456-4a05-aac6-ca439781a2c9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:34.443980 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de1c4a1b-c456-4a05-aac6-ca439781a2c9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:34.444671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de1c4a1b-c456-4a05-aac6-ca439781a2c9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:34.445154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de1c4a1b-c456-4a05-aac6-ca439781a2c9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:34.445586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-de1c4a1b-c456-4a05-aac6-ca439781a2c9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:34.576682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-de1c4a1b-c456-4a05-aac6-ca439781a2c9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:35:34.584605 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-de1c4a1b-c456-4a05-aac6-ca439781a2c9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1684 microversion: 2.1 time: 0.152944 Oct 05 03:35:34.585206 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3638/7261] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:35:34 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:35:35.609166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-28882913-5cd0-4070-9d42-e78985ed88f9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:35:35.609789 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-28882913-5cd0-4070-9d42-e78985ed88f9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:35:35.616792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28882913-5cd0-4070-9d42-e78985ed88f9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:35.617332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28882913-5cd0-4070-9d42-e78985ed88f9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:35.617790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28882913-5cd0-4070-9d42-e78985ed88f9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:35.618498 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28882913-5cd0-4070-9d42-e78985ed88f9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:35.618975 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28882913-5cd0-4070-9d42-e78985ed88f9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:35.619415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28882913-5cd0-4070-9d42-e78985ed88f9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:35.750214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-28882913-5cd0-4070-9d42-e78985ed88f9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:35:35.757967 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-28882913-5cd0-4070-9d42-e78985ed88f9 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1684 microversion: 2.1 time: 0.153366 Oct 05 03:35:35.758539 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3624/7262] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:35:35 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:35:36.781338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5719d7b9-7ca5-49e9-8a37-e31234cd9456 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:35:36.781983 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5719d7b9-7ca5-49e9-8a37-e31234cd9456 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:35:36.788770 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5719d7b9-7ca5-49e9-8a37-e31234cd9456 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:36.789288 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5719d7b9-7ca5-49e9-8a37-e31234cd9456 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:36.789719 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5719d7b9-7ca5-49e9-8a37-e31234cd9456 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:36.790404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5719d7b9-7ca5-49e9-8a37-e31234cd9456 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:36.790853 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5719d7b9-7ca5-49e9-8a37-e31234cd9456 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:36.791274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5719d7b9-7ca5-49e9-8a37-e31234cd9456 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:36.918772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5719d7b9-7ca5-49e9-8a37-e31234cd9456 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:35:36.926595 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5719d7b9-7ca5-49e9-8a37-e31234cd9456 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1684 microversion: 2.1 time: 0.149187 Oct 05 03:35:36.927167 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3639/7263] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:35:36 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1684 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:35:37.950715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-81ee4779-c8b5-45d4-8cb4-ae3285bb1ea1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:35:37.951348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-81ee4779-c8b5-45d4-8cb4-ae3285bb1ea1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:35:37.958128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81ee4779-c8b5-45d4-8cb4-ae3285bb1ea1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:37.958648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81ee4779-c8b5-45d4-8cb4-ae3285bb1ea1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:37.959087 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81ee4779-c8b5-45d4-8cb4-ae3285bb1ea1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:37.959792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81ee4779-c8b5-45d4-8cb4-ae3285bb1ea1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:37.960268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81ee4779-c8b5-45d4-8cb4-ae3285bb1ea1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:37.960742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81ee4779-c8b5-45d4-8cb4-ae3285bb1ea1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:38.092170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-81ee4779-c8b5-45d4-8cb4-ae3285bb1ea1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:35:38.099973 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-81ee4779-c8b5-45d4-8cb4-ae3285bb1ea1 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1684 microversion: 2.1 time: 0.154006 Oct 05 03:35:38.100749 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3625/7264] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:35:37 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:35:39.123654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1bb21f3d-0086-4b2b-84b2-5fea73d37633 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:35:39.124269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1bb21f3d-0086-4b2b-84b2-5fea73d37633 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:35:39.130497 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1bb21f3d-0086-4b2b-84b2-5fea73d37633 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:39.130984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1bb21f3d-0086-4b2b-84b2-5fea73d37633 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:39.131422 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1bb21f3d-0086-4b2b-84b2-5fea73d37633 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:39.132113 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1bb21f3d-0086-4b2b-84b2-5fea73d37633 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:39.132568 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1bb21f3d-0086-4b2b-84b2-5fea73d37633 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:39.133020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1bb21f3d-0086-4b2b-84b2-5fea73d37633 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:39.259296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1bb21f3d-0086-4b2b-84b2-5fea73d37633 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:35:39.267607 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1bb21f3d-0086-4b2b-84b2-5fea73d37633 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1684 microversion: 2.1 time: 0.148016 Oct 05 03:35:39.268185 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3640/7265] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:35:39 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1684 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:35:40.291304 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9b7390eb-2f38-47b0-81ae-865b032795ef tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:35:40.291834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9b7390eb-2f38-47b0-81ae-865b032795ef tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:35:40.299888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b7390eb-2f38-47b0-81ae-865b032795ef tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:40.300389 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b7390eb-2f38-47b0-81ae-865b032795ef tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:40.300837 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b7390eb-2f38-47b0-81ae-865b032795ef tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:40.301558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b7390eb-2f38-47b0-81ae-865b032795ef tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:40.302025 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b7390eb-2f38-47b0-81ae-865b032795ef tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:40.302461 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9b7390eb-2f38-47b0-81ae-865b032795ef tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:40.433080 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9b7390eb-2f38-47b0-81ae-865b032795ef tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:35:40.441442 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9b7390eb-2f38-47b0-81ae-865b032795ef tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1684 microversion: 2.1 time: 0.154109 Oct 05 03:35:40.442036 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3626/7266] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:35:40 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:35:41.466918 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9cbab2f4-e3d3-4348-aa74-a211177c316b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:35:41.467543 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9cbab2f4-e3d3-4348-aa74-a211177c316b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:35:41.474860 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cbab2f4-e3d3-4348-aa74-a211177c316b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:41.475403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cbab2f4-e3d3-4348-aa74-a211177c316b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:41.475846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cbab2f4-e3d3-4348-aa74-a211177c316b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:41.476809 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cbab2f4-e3d3-4348-aa74-a211177c316b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:41.477291 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cbab2f4-e3d3-4348-aa74-a211177c316b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:41.477716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9cbab2f4-e3d3-4348-aa74-a211177c316b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:41.613661 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9cbab2f4-e3d3-4348-aa74-a211177c316b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:35:41.622797 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9cbab2f4-e3d3-4348-aa74-a211177c316b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1684 microversion: 2.1 time: 0.160033 Oct 05 03:35:41.623395 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3641/7267] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:35:41 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:35:42.647138 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2f962777-2e40-4444-bb0d-ac0c534882a2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:35:42.647778 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2f962777-2e40-4444-bb0d-ac0c534882a2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:35:42.655314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f962777-2e40-4444-bb0d-ac0c534882a2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:42.655830 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f962777-2e40-4444-bb0d-ac0c534882a2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:42.656289 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f962777-2e40-4444-bb0d-ac0c534882a2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:42.657111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f962777-2e40-4444-bb0d-ac0c534882a2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:42.657592 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f962777-2e40-4444-bb0d-ac0c534882a2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:42.658036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2f962777-2e40-4444-bb0d-ac0c534882a2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:42.792290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2f962777-2e40-4444-bb0d-ac0c534882a2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:35:42.800801 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2f962777-2e40-4444-bb0d-ac0c534882a2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1684 microversion: 2.1 time: 0.157633 Oct 05 03:35:42.801408 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3627/7268] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:35:42 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:35:43.824836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-44d86b8f-87d2-44db-bbf8-69eae1e98870 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:35:43.826080 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-44d86b8f-87d2-44db-bbf8-69eae1e98870 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:35:43.832918 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44d86b8f-87d2-44db-bbf8-69eae1e98870 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:43.833410 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44d86b8f-87d2-44db-bbf8-69eae1e98870 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:43.833844 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44d86b8f-87d2-44db-bbf8-69eae1e98870 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:43.834532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44d86b8f-87d2-44db-bbf8-69eae1e98870 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:43.834981 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44d86b8f-87d2-44db-bbf8-69eae1e98870 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:43.835405 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-44d86b8f-87d2-44db-bbf8-69eae1e98870 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:44.064806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-44d86b8f-87d2-44db-bbf8-69eae1e98870 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:35:44.073593 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-44d86b8f-87d2-44db-bbf8-69eae1e98870 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1683 microversion: 2.1 time: 0.252599 Oct 05 03:35:44.074171 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3642/7269] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:35:43 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1683 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:35:44.240432 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-deffc715-eb32-437f-a9e9-dfd93a0670f2 req-b36b02f6-89b4-450b-810f-20fa5f6459e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3fe481a-aa94-4784-9110-17b861d9478d", "name": "network-vif-unplugged", "status": "completed", "tag": "48782612-24dd-4164-a700-53f7ba58ac79"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:35:44.252282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-deffc715-eb32-437f-a9e9-dfd93a0670f2 req-b36b02f6-89b4-450b-810f-20fa5f6459e8 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:44.252783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-deffc715-eb32-437f-a9e9-dfd93a0670f2 req-b36b02f6-89b4-450b-810f-20fa5f6459e8 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:44.253292 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-deffc715-eb32-437f-a9e9-dfd93a0670f2 req-b36b02f6-89b4-450b-810f-20fa5f6459e8 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:44.266280 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-deffc715-eb32-437f-a9e9-dfd93a0670f2 req-b36b02f6-89b4-450b-810f-20fa5f6459e8 service nova] Creating event network-vif-unplugged:48782612-24dd-4164-a700-53f7ba58ac79 for instance e3fe481a-aa94-4784-9110-17b861d9478d on n-h1-858272-3 Oct 05 03:35:44.272097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [req-deffc715-eb32-437f-a9e9-dfd93a0670f2 req-b36b02f6-89b4-450b-810f-20fa5f6459e8 service nova] Instance e3fe481a-aa94-4784-9110-17b861d9478d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 03:35:44.283531 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-deffc715-eb32-437f-a9e9-dfd93a0670f2 req-b36b02f6-89b4-450b-810f-20fa5f6459e8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047034 Oct 05 03:35:44.284329 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3628/7270] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:35:45.098411 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-40076802-1b7a-4e58-b1e2-10ffeb82e997 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:35:45.099107 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-40076802-1b7a-4e58-b1e2-10ffeb82e997 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:35:45.106417 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40076802-1b7a-4e58-b1e2-10ffeb82e997 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:45.106922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40076802-1b7a-4e58-b1e2-10ffeb82e997 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:45.107414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40076802-1b7a-4e58-b1e2-10ffeb82e997 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:45.108156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40076802-1b7a-4e58-b1e2-10ffeb82e997 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:45.108642 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40076802-1b7a-4e58-b1e2-10ffeb82e997 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:45.109104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-40076802-1b7a-4e58-b1e2-10ffeb82e997 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:45.604219 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-40076802-1b7a-4e58-b1e2-10ffeb82e997 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:35:45.613241 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-40076802-1b7a-4e58-b1e2-10ffeb82e997 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1683 microversion: 2.1 time: 0.518753 Oct 05 03:35:45.613827 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3643/7271] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:35:45 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1683 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:35:46.318053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-572861cf-63c4-4678-b9c9-f7fd4d2c0df5 req-e4981ed5-dfcc-4860-96ec-826db36830ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3fe481a-aa94-4784-9110-17b861d9478d", "tag": "48782612-24dd-4164-a700-53f7ba58ac79"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:35:46.328348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-572861cf-63c4-4678-b9c9-f7fd4d2c0df5 req-e4981ed5-dfcc-4860-96ec-826db36830ab service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:46.328847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-572861cf-63c4-4678-b9c9-f7fd4d2c0df5 req-e4981ed5-dfcc-4860-96ec-826db36830ab service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:46.329324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-572861cf-63c4-4678-b9c9-f7fd4d2c0df5 req-e4981ed5-dfcc-4860-96ec-826db36830ab service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:46.344341 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-572861cf-63c4-4678-b9c9-f7fd4d2c0df5 req-e4981ed5-dfcc-4860-96ec-826db36830ab service nova] Creating event network-changed:48782612-24dd-4164-a700-53f7ba58ac79 for instance e3fe481a-aa94-4784-9110-17b861d9478d on n-h1-858272-3 Oct 05 03:35:46.349727 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [req-572861cf-63c4-4678-b9c9-f7fd4d2c0df5 req-e4981ed5-dfcc-4860-96ec-826db36830ab service nova] Instance e3fe481a-aa94-4784-9110-17b861d9478d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 03:35:46.361774 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-572861cf-63c4-4678-b9c9-f7fd4d2c0df5 req-e4981ed5-dfcc-4860-96ec-826db36830ab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048663 Oct 05 03:35:46.362393 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3629/7272] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:35:46.635527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1ef793b1-da2f-4c78-8327-687daecb35e0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:35:46.636224 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1ef793b1-da2f-4c78-8327-687daecb35e0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:35:46.643337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ef793b1-da2f-4c78-8327-687daecb35e0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:46.643829 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ef793b1-da2f-4c78-8327-687daecb35e0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:46.644267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ef793b1-da2f-4c78-8327-687daecb35e0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:46.645001 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ef793b1-da2f-4c78-8327-687daecb35e0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:46.645465 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ef793b1-da2f-4c78-8327-687daecb35e0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:46.645892 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1ef793b1-da2f-4c78-8327-687daecb35e0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:46.857907 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1ef793b1-da2f-4c78-8327-687daecb35e0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:35:46.868283 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1ef793b1-da2f-4c78-8327-687daecb35e0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1681 microversion: 2.1 time: 0.236504 Oct 05 03:35:46.869128 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3644/7273] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:35:46 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1681 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:35:47.896112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a1a3fa6f-d8fd-4966-b7f8-0ad138e3db36 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:35:47.896825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a1a3fa6f-d8fd-4966-b7f8-0ad138e3db36 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:35:47.904218 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a1a3fa6f-d8fd-4966-b7f8-0ad138e3db36 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:47.904952 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a1a3fa6f-d8fd-4966-b7f8-0ad138e3db36 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:47.905421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a1a3fa6f-d8fd-4966-b7f8-0ad138e3db36 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:47.906168 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a1a3fa6f-d8fd-4966-b7f8-0ad138e3db36 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:47.906647 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a1a3fa6f-d8fd-4966-b7f8-0ad138e3db36 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:47.907094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a1a3fa6f-d8fd-4966-b7f8-0ad138e3db36 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:48.039427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a1a3fa6f-d8fd-4966-b7f8-0ad138e3db36 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:35:48.047416 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a1a3fa6f-d8fd-4966-b7f8-0ad138e3db36 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1681 microversion: 2.1 time: 0.156450 Oct 05 03:35:48.047999 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3630/7274] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:35:47 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:35:49.070268 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f72936c9-2bf4-443e-8ba0-d6076428b79e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:35:49.070891 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f72936c9-2bf4-443e-8ba0-d6076428b79e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:35:49.078409 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f72936c9-2bf4-443e-8ba0-d6076428b79e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:49.078899 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f72936c9-2bf4-443e-8ba0-d6076428b79e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:49.079341 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f72936c9-2bf4-443e-8ba0-d6076428b79e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:49.080039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f72936c9-2bf4-443e-8ba0-d6076428b79e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:49.080494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f72936c9-2bf4-443e-8ba0-d6076428b79e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:49.080940 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f72936c9-2bf4-443e-8ba0-d6076428b79e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:49.215546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f72936c9-2bf4-443e-8ba0-d6076428b79e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:35:49.224010 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f72936c9-2bf4-443e-8ba0-d6076428b79e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1678 microversion: 2.1 time: 0.157624 Oct 05 03:35:49.224599 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3645/7275] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:35:49 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:35:49.246878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0b361952-2c48-40dd-b1b3-802c4614f0aa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:35:49.247940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0b361952-2c48-40dd-b1b3-802c4614f0aa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:35:49.254770 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b361952-2c48-40dd-b1b3-802c4614f0aa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:49.255267 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b361952-2c48-40dd-b1b3-802c4614f0aa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:49.255717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b361952-2c48-40dd-b1b3-802c4614f0aa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:49.256420 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b361952-2c48-40dd-b1b3-802c4614f0aa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:49.256886 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b361952-2c48-40dd-b1b3-802c4614f0aa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:49.257345 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b361952-2c48-40dd-b1b3-802c4614f0aa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:49.293634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b361952-2c48-40dd-b1b3-802c4614f0aa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:49.294169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b361952-2c48-40dd-b1b3-802c4614f0aa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:49.294620 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b361952-2c48-40dd-b1b3-802c4614f0aa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:49.295341 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b361952-2c48-40dd-b1b3-802c4614f0aa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:49.295807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b361952-2c48-40dd-b1b3-802c4614f0aa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:49.296237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b361952-2c48-40dd-b1b3-802c4614f0aa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:49.316797 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-0b361952-2c48-40dd-b1b3-802c4614f0aa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Getting quotas for project cb907a92ab7949ebb3cb2e3b5d372ece. Resources: {'cores', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:35:49.322073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-0b361952-2c48-40dd-b1b3-802c4614f0aa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Getting quotas for user 64375d765c0949dbb75c91906f8bca3c and project cb907a92ab7949ebb3cb2e3b5d372ece. Resources: {'cores', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:35:49.425749 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0b361952-2c48-40dd-b1b3-802c4614f0aa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "POST /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d/action" status: 202 len: 0 microversion: 2.1 time: 0.182428 Oct 05 03:35:49.426285 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3631/7276] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:35:49 2022] POST /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:35:49.436097 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f505be47-e93a-46ac-bf46-c6c7ad0c12db tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:35:49.436718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f505be47-e93a-46ac-bf46-c6c7ad0c12db tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:35:49.442778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f505be47-e93a-46ac-bf46-c6c7ad0c12db tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:49.443273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f505be47-e93a-46ac-bf46-c6c7ad0c12db tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:49.443712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f505be47-e93a-46ac-bf46-c6c7ad0c12db tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:49.444416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f505be47-e93a-46ac-bf46-c6c7ad0c12db tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:49.444872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f505be47-e93a-46ac-bf46-c6c7ad0c12db tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:49.445327 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f505be47-e93a-46ac-bf46-c6c7ad0c12db tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:49.652531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f505be47-e93a-46ac-bf46-c6c7ad0c12db tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:35:49.660527 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f505be47-e93a-46ac-bf46-c6c7ad0c12db tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1677 microversion: 2.1 time: 0.229694 Oct 05 03:35:49.661141 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3646/7277] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:35:49 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1677 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:35:50.685969 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e7cd3d9a-46da-43c8-bcb2-0dfbf43d7104 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:35:50.686691 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e7cd3d9a-46da-43c8-bcb2-0dfbf43d7104 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:35:50.693018 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7cd3d9a-46da-43c8-bcb2-0dfbf43d7104 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:50.693525 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7cd3d9a-46da-43c8-bcb2-0dfbf43d7104 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:50.693981 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7cd3d9a-46da-43c8-bcb2-0dfbf43d7104 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:50.694687 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7cd3d9a-46da-43c8-bcb2-0dfbf43d7104 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:50.695161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7cd3d9a-46da-43c8-bcb2-0dfbf43d7104 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:50.695604 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7cd3d9a-46da-43c8-bcb2-0dfbf43d7104 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:50.834146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e7cd3d9a-46da-43c8-bcb2-0dfbf43d7104 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:35:50.842633 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e7cd3d9a-46da-43c8-bcb2-0dfbf43d7104 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1677 microversion: 2.1 time: 0.162006 Oct 05 03:35:50.843436 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3632/7278] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:35:50 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:35:50.870402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-5a5e49c3-0f5a-49e6-93f6-4bde4713e8e3 req-fb4408dd-8cfc-4c48-9b08-fcb27f7a8488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3fe481a-aa94-4784-9110-17b861d9478d", "name": "network-vif-plugged", "status": "completed", "tag": "48782612-24dd-4164-a700-53f7ba58ac79"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:35:50.881900 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5a5e49c3-0f5a-49e6-93f6-4bde4713e8e3 req-fb4408dd-8cfc-4c48-9b08-fcb27f7a8488 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:50.882327 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5a5e49c3-0f5a-49e6-93f6-4bde4713e8e3 req-fb4408dd-8cfc-4c48-9b08-fcb27f7a8488 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:50.882787 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5a5e49c3-0f5a-49e6-93f6-4bde4713e8e3 req-fb4408dd-8cfc-4c48-9b08-fcb27f7a8488 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:50.895825 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-5a5e49c3-0f5a-49e6-93f6-4bde4713e8e3 req-fb4408dd-8cfc-4c48-9b08-fcb27f7a8488 service nova] Creating event network-vif-plugged:48782612-24dd-4164-a700-53f7ba58ac79 for instance e3fe481a-aa94-4784-9110-17b861d9478d on n-h1-858272-3 Oct 05 03:35:50.901305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [req-5a5e49c3-0f5a-49e6-93f6-4bde4713e8e3 req-fb4408dd-8cfc-4c48-9b08-fcb27f7a8488 service nova] Instance e3fe481a-aa94-4784-9110-17b861d9478d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122319) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 03:35:50.913098 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-5a5e49c3-0f5a-49e6-93f6-4bde4713e8e3 req-fb4408dd-8cfc-4c48-9b08-fcb27f7a8488 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046367 Oct 05 03:35:50.913709 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3647/7279] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:35:51.867186 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4c120e75-ab95-4141-b4d4-d9b45c86c46c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:35:51.867946 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4c120e75-ab95-4141-b4d4-d9b45c86c46c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:35:51.875598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c120e75-ab95-4141-b4d4-d9b45c86c46c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:51.876113 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c120e75-ab95-4141-b4d4-d9b45c86c46c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:51.876566 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c120e75-ab95-4141-b4d4-d9b45c86c46c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:51.877312 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c120e75-ab95-4141-b4d4-d9b45c86c46c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:51.877783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c120e75-ab95-4141-b4d4-d9b45c86c46c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:51.878224 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4c120e75-ab95-4141-b4d4-d9b45c86c46c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:52.010246 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4c120e75-ab95-4141-b4d4-d9b45c86c46c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:35:52.014561 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:35:52.019708 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4c120e75-ab95-4141-b4d4-d9b45c86c46c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1677 microversion: 2.1 time: 0.156488 Oct 05 03:35:52.020287 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3633/7280] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:35:51 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:35:52.789868 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-715a77b4-b329-484a-ac74-850fe8a50a37 req-a43fe14d-86ff-4317-914b-f38fb89634f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3fe481a-aa94-4784-9110-17b861d9478d", "name": "network-vif-unplugged", "status": "completed", "tag": "48782612-24dd-4164-a700-53f7ba58ac79"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:35:52.801603 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-715a77b4-b329-484a-ac74-850fe8a50a37 req-a43fe14d-86ff-4317-914b-f38fb89634f9 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:52.802079 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-715a77b4-b329-484a-ac74-850fe8a50a37 req-a43fe14d-86ff-4317-914b-f38fb89634f9 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:52.802505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-715a77b4-b329-484a-ac74-850fe8a50a37 req-a43fe14d-86ff-4317-914b-f38fb89634f9 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:52.814952 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-715a77b4-b329-484a-ac74-850fe8a50a37 req-a43fe14d-86ff-4317-914b-f38fb89634f9 service nova] Creating event network-vif-unplugged:48782612-24dd-4164-a700-53f7ba58ac79 for instance e3fe481a-aa94-4784-9110-17b861d9478d on n-h2-858272-3 Oct 05 03:35:52.820299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [req-715a77b4-b329-484a-ac74-850fe8a50a37 req-a43fe14d-86ff-4317-914b-f38fb89634f9 service nova] Instance e3fe481a-aa94-4784-9110-17b861d9478d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122319) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 03:35:52.831701 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-715a77b4-b329-484a-ac74-850fe8a50a37 req-a43fe14d-86ff-4317-914b-f38fb89634f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047626 Oct 05 03:35:52.832312 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3648/7281] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:35:53.043555 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b2713dd9-9cc7-4d44-a68d-d5eeef065d71 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:35:53.044242 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b2713dd9-9cc7-4d44-a68d-d5eeef065d71 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:35:53.052793 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2713dd9-9cc7-4d44-a68d-d5eeef065d71 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:53.053320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2713dd9-9cc7-4d44-a68d-d5eeef065d71 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:53.053768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2713dd9-9cc7-4d44-a68d-d5eeef065d71 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:53.054472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2713dd9-9cc7-4d44-a68d-d5eeef065d71 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:53.054938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2713dd9-9cc7-4d44-a68d-d5eeef065d71 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:53.055373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2713dd9-9cc7-4d44-a68d-d5eeef065d71 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:53.261474 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b2713dd9-9cc7-4d44-a68d-d5eeef065d71 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:35:53.269472 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b2713dd9-9cc7-4d44-a68d-d5eeef065d71 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1677 microversion: 2.1 time: 0.229816 Oct 05 03:35:53.270007 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3634/7282] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:35:53 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1677 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:35:54.295116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e3e5fb92-ef81-405a-ae53-630a46c2da6a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:35:54.295817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e3e5fb92-ef81-405a-ae53-630a46c2da6a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:35:54.302838 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e3e5fb92-ef81-405a-ae53-630a46c2da6a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:54.303324 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e3e5fb92-ef81-405a-ae53-630a46c2da6a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:54.303792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e3e5fb92-ef81-405a-ae53-630a46c2da6a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:54.304480 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e3e5fb92-ef81-405a-ae53-630a46c2da6a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:54.304956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e3e5fb92-ef81-405a-ae53-630a46c2da6a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:54.305386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e3e5fb92-ef81-405a-ae53-630a46c2da6a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:54.441847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e3e5fb92-ef81-405a-ae53-630a46c2da6a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:35:54.449490 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e3e5fb92-ef81-405a-ae53-630a46c2da6a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1677 microversion: 2.1 time: 0.159171 Oct 05 03:35:54.450084 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3649/7283] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:35:54 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:35:54.871883 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-748a512e-fc16-4a75-a71b-f8d15b8cd574 req-74400d26-a8d3-4c7d-94b2-7511ba9dea21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3fe481a-aa94-4784-9110-17b861d9478d", "tag": "48782612-24dd-4164-a700-53f7ba58ac79"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:35:54.882012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-748a512e-fc16-4a75-a71b-f8d15b8cd574 req-74400d26-a8d3-4c7d-94b2-7511ba9dea21 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:54.882499 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-748a512e-fc16-4a75-a71b-f8d15b8cd574 req-74400d26-a8d3-4c7d-94b2-7511ba9dea21 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:54.882937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-748a512e-fc16-4a75-a71b-f8d15b8cd574 req-74400d26-a8d3-4c7d-94b2-7511ba9dea21 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:54.897864 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-748a512e-fc16-4a75-a71b-f8d15b8cd574 req-74400d26-a8d3-4c7d-94b2-7511ba9dea21 service nova] Creating event network-changed:48782612-24dd-4164-a700-53f7ba58ac79 for instance e3fe481a-aa94-4784-9110-17b861d9478d on n-h2-858272-3 Oct 05 03:35:54.903801 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [req-748a512e-fc16-4a75-a71b-f8d15b8cd574 req-74400d26-a8d3-4c7d-94b2-7511ba9dea21 service nova] Instance e3fe481a-aa94-4784-9110-17b861d9478d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 03:35:54.914645 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-748a512e-fc16-4a75-a71b-f8d15b8cd574 req-74400d26-a8d3-4c7d-94b2-7511ba9dea21 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046786 Oct 05 03:35:54.915321 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3635/7284] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:35:55.471759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2b5dc330-3c38-42b6-92e5-88efb9821a96 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:35:55.472342 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2b5dc330-3c38-42b6-92e5-88efb9821a96 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:35:55.479441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b5dc330-3c38-42b6-92e5-88efb9821a96 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:55.479927 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b5dc330-3c38-42b6-92e5-88efb9821a96 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:55.480367 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b5dc330-3c38-42b6-92e5-88efb9821a96 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:55.481091 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b5dc330-3c38-42b6-92e5-88efb9821a96 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:55.482094 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b5dc330-3c38-42b6-92e5-88efb9821a96 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:55.482520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b5dc330-3c38-42b6-92e5-88efb9821a96 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:55.610431 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2b5dc330-3c38-42b6-92e5-88efb9821a96 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:35:55.618171 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2b5dc330-3c38-42b6-92e5-88efb9821a96 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1677 microversion: 2.1 time: 0.150444 Oct 05 03:35:55.618752 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3650/7285] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:35:55 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:35:56.647136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-510eecce-dca9-406f-b469-4a0bc8bff229 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:35:56.647852 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-510eecce-dca9-406f-b469-4a0bc8bff229 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:35:56.654550 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-510eecce-dca9-406f-b469-4a0bc8bff229 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:56.655073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-510eecce-dca9-406f-b469-4a0bc8bff229 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:56.655506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-510eecce-dca9-406f-b469-4a0bc8bff229 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:56.656218 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-510eecce-dca9-406f-b469-4a0bc8bff229 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:56.656680 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-510eecce-dca9-406f-b469-4a0bc8bff229 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:56.657137 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-510eecce-dca9-406f-b469-4a0bc8bff229 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:57.207226 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-510eecce-dca9-406f-b469-4a0bc8bff229 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:35:57.214910 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-510eecce-dca9-406f-b469-4a0bc8bff229 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1677 microversion: 2.1 time: 0.575827 Oct 05 03:35:57.215730 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3636/7286] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:35:56 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1677 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:35:58.238263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5461dca3-ce8a-481e-b161-4348fa5a8156 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:35:58.238895 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5461dca3-ce8a-481e-b161-4348fa5a8156 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:35:58.245824 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5461dca3-ce8a-481e-b161-4348fa5a8156 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:58.246306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5461dca3-ce8a-481e-b161-4348fa5a8156 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:58.247261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5461dca3-ce8a-481e-b161-4348fa5a8156 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:58.247951 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5461dca3-ce8a-481e-b161-4348fa5a8156 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:58.248395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5461dca3-ce8a-481e-b161-4348fa5a8156 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:58.248811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5461dca3-ce8a-481e-b161-4348fa5a8156 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:58.407960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5461dca3-ce8a-481e-b161-4348fa5a8156 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:35:58.416092 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5461dca3-ce8a-481e-b161-4348fa5a8156 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1670 microversion: 2.1 time: 0.181716 Oct 05 03:35:58.416723 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3651/7287] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:35:58 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1670 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:35:58.445331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-eac4e38c-a7ea-4430-a094-7fb659a347d3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:35:58.446267 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-eac4e38c-a7ea-4430-a094-7fb659a347d3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:35:58.456183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eac4e38c-a7ea-4430-a094-7fb659a347d3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:58.456884 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eac4e38c-a7ea-4430-a094-7fb659a347d3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:58.457551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eac4e38c-a7ea-4430-a094-7fb659a347d3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:58.458545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eac4e38c-a7ea-4430-a094-7fb659a347d3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:58.459274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eac4e38c-a7ea-4430-a094-7fb659a347d3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:58.459897 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eac4e38c-a7ea-4430-a094-7fb659a347d3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:58.603096 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-eac4e38c-a7ea-4430-a094-7fb659a347d3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:35:58.616153 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-eac4e38c-a7ea-4430-a094-7fb659a347d3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1670 microversion: 2.1 time: 0.176854 Oct 05 03:35:58.617721 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3637/7288] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:35:58 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1670 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:35:58.642080 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bafb447a-be0d-4c6e-a143-f5682517e65a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:35:58.642767 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bafb447a-be0d-4c6e-a143-f5682517e65a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:35:58.649417 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bafb447a-be0d-4c6e-a143-f5682517e65a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:58.650010 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bafb447a-be0d-4c6e-a143-f5682517e65a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:58.650459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bafb447a-be0d-4c6e-a143-f5682517e65a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:58.652372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bafb447a-be0d-4c6e-a143-f5682517e65a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:58.652372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bafb447a-be0d-4c6e-a143-f5682517e65a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:58.652372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bafb447a-be0d-4c6e-a143-f5682517e65a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:58.666507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-5e076a29-735f-4f98-8937-5ca9de17918a req-93f773d7-2671-4d53-ab00-778448085151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3fe481a-aa94-4784-9110-17b861d9478d", "name": "network-vif-plugged", "status": "completed", "tag": "48782612-24dd-4164-a700-53f7ba58ac79"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:35:58.680124 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-5e076a29-735f-4f98-8937-5ca9de17918a req-93f773d7-2671-4d53-ab00-778448085151 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:58.682759 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-5e076a29-735f-4f98-8937-5ca9de17918a req-93f773d7-2671-4d53-ab00-778448085151 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:58.682759 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-5e076a29-735f-4f98-8937-5ca9de17918a req-93f773d7-2671-4d53-ab00-778448085151 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:58.693799 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-5e076a29-735f-4f98-8937-5ca9de17918a req-93f773d7-2671-4d53-ab00-778448085151 service nova] Creating event network-vif-plugged:48782612-24dd-4164-a700-53f7ba58ac79 for instance e3fe481a-aa94-4784-9110-17b861d9478d on n-h2-858272-3 Oct 05 03:35:58.698887 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-5e076a29-735f-4f98-8937-5ca9de17918a req-93f773d7-2671-4d53-ab00-778448085151 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042683 Oct 05 03:35:58.699694 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3638/7289] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:35:58.801201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bafb447a-be0d-4c6e-a143-f5682517e65a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:35:58.809207 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bafb447a-be0d-4c6e-a143-f5682517e65a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1670 microversion: 2.1 time: 0.171639 Oct 05 03:35:58.810463 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3652/7290] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:35:58 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1670 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:35:58.838370 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1f6a96f9-cba3-41f4-b736-a1c029caa273 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:35:58.839162 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1f6a96f9-cba3-41f4-b736-a1c029caa273 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:35:58.846698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1f6a96f9-cba3-41f4-b736-a1c029caa273 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:58.847199 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1f6a96f9-cba3-41f4-b736-a1c029caa273 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:58.847656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1f6a96f9-cba3-41f4-b736-a1c029caa273 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:58.848356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1f6a96f9-cba3-41f4-b736-a1c029caa273 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:58.848833 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1f6a96f9-cba3-41f4-b736-a1c029caa273 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:58.849336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1f6a96f9-cba3-41f4-b736-a1c029caa273 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:58.879976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1f6a96f9-cba3-41f4-b736-a1c029caa273 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:35:58.983328 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1f6a96f9-cba3-41f4-b736-a1c029caa273 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 204 len: 0 microversion: 2.1 time: 0.152271 Oct 05 03:35:58.984106 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3639/7291] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:35:58 2022] DELETE /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:35:58.992422 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e971b8b5-4ed7-4a50-936a-3313b4335ff4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:35:58.993073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e971b8b5-4ed7-4a50-936a-3313b4335ff4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:35:58.999765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e971b8b5-4ed7-4a50-936a-3313b4335ff4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:59.000305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e971b8b5-4ed7-4a50-936a-3313b4335ff4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:59.000737 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e971b8b5-4ed7-4a50-936a-3313b4335ff4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:59.001457 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e971b8b5-4ed7-4a50-936a-3313b4335ff4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:35:59.001907 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e971b8b5-4ed7-4a50-936a-3313b4335ff4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:35:59.002329 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e971b8b5-4ed7-4a50-936a-3313b4335ff4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:35:59.006553 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:35:59.138567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e971b8b5-4ed7-4a50-936a-3313b4335ff4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:35:59.147435 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e971b8b5-4ed7-4a50-936a-3313b4335ff4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1676 microversion: 2.1 time: 0.158744 Oct 05 03:35:59.148308 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3653/7292] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:35:58 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:36:00.173118 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-09ac8eee-6ffd-47c0-89d1-c4c988bbe59c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:36:00.173843 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-09ac8eee-6ffd-47c0-89d1-c4c988bbe59c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:36:00.175830 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:36:00.177410 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:36:00.183460 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09ac8eee-6ffd-47c0-89d1-c4c988bbe59c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:00.183989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09ac8eee-6ffd-47c0-89d1-c4c988bbe59c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:00.185116 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09ac8eee-6ffd-47c0-89d1-c4c988bbe59c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:00.185849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09ac8eee-6ffd-47c0-89d1-c4c988bbe59c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:00.186318 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09ac8eee-6ffd-47c0-89d1-c4c988bbe59c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:00.186753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-09ac8eee-6ffd-47c0-89d1-c4c988bbe59c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:00.321389 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-09ac8eee-6ffd-47c0-89d1-c4c988bbe59c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:36:00.332466 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-09ac8eee-6ffd-47c0-89d1-c4c988bbe59c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1676 microversion: 2.1 time: 0.164171 Oct 05 03:36:00.333362 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3640/7293] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:36:00 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:36:01.364126 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9ffcc755-e4dd-4cba-bf13-fe47f93b95c5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:36:01.364747 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9ffcc755-e4dd-4cba-bf13-fe47f93b95c5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:36:01.366622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=37 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:36:01.372124 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ffcc755-e4dd-4cba-bf13-fe47f93b95c5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:01.372795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ffcc755-e4dd-4cba-bf13-fe47f93b95c5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:01.373261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ffcc755-e4dd-4cba-bf13-fe47f93b95c5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:01.373963 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ffcc755-e4dd-4cba-bf13-fe47f93b95c5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:01.374418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ffcc755-e4dd-4cba-bf13-fe47f93b95c5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:01.374843 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9ffcc755-e4dd-4cba-bf13-fe47f93b95c5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:01.459191 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9ffcc755-e4dd-4cba-bf13-fe47f93b95c5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:36:01.467727 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9ffcc755-e4dd-4cba-bf13-fe47f93b95c5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 200 len: 1609 microversion: 2.1 time: 0.108420 Oct 05 03:36:01.468689 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3654/7294] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:36:01 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 1609 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:36:01.525873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-dbf00424-6c56-40ca-bf37-96e091379445 req-810899b6-914f-45e6-b845-49728bd8392f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3fe481a-aa94-4784-9110-17b861d9478d", "name": "network-vif-deleted", "tag": "48782612-24dd-4164-a700-53f7ba58ac79"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:36:01.540364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-dbf00424-6c56-40ca-bf37-96e091379445 req-810899b6-914f-45e6-b845-49728bd8392f service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:01.540861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-dbf00424-6c56-40ca-bf37-96e091379445 req-810899b6-914f-45e6-b845-49728bd8392f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:01.541453 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-dbf00424-6c56-40ca-bf37-96e091379445 req-810899b6-914f-45e6-b845-49728bd8392f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:01.556584 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-dbf00424-6c56-40ca-bf37-96e091379445 req-810899b6-914f-45e6-b845-49728bd8392f service nova] Creating event network-vif-deleted:48782612-24dd-4164-a700-53f7ba58ac79 for instance e3fe481a-aa94-4784-9110-17b861d9478d on n-h2-858272-3 Oct 05 03:36:01.562567 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-dbf00424-6c56-40ca-bf37-96e091379445 req-810899b6-914f-45e6-b845-49728bd8392f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040578 Oct 05 03:36:01.563235 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3641/7295] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:36:02.491452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-007e1d9d-6fb0-4c91-b37e-dafce3d56ee0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:36:02.492072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-007e1d9d-6fb0-4c91-b37e-dafce3d56ee0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:36:02.500194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-007e1d9d-6fb0-4c91-b37e-dafce3d56ee0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:02.500772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-007e1d9d-6fb0-4c91-b37e-dafce3d56ee0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:02.501296 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-007e1d9d-6fb0-4c91-b37e-dafce3d56ee0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:02.502076 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-007e1d9d-6fb0-4c91-b37e-dafce3d56ee0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:02.502594 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-007e1d9d-6fb0-4c91-b37e-dafce3d56ee0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:02.503042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-007e1d9d-6fb0-4c91-b37e-dafce3d56ee0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:02.518333 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-007e1d9d-6fb0-4c91-b37e-dafce3d56ee0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] HTTP exception thrown: Instance e3fe481a-aa94-4784-9110-17b861d9478d could not be found. Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-007e1d9d-6fb0-4c91-b37e-dafce3d56ee0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Request method failure captured: Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d HTTP/1.1 Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPpOjo3UoOtQ-Bs93Auly_6sXh8lfDtgrSY0udxfQzVZtNtMSUx1jRG2ewnriCtcRUrnJaHmLaLcz0mVVG5b9vEZRuG06925WdPWiQLXMx8sJPVOF2G8G35VQEtfcoJQaOleL8MsseS-M06VqanojXWiUqJgAvvCm3KftD0h1N4k_LM Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: cb907a92ab7949ebb3cb2e3b5d372ece Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: cb907a92ab7949ebb3cb2e3b5d372ece Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerActionsTestJSON-2031640985-project Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 64375d765c0949dbb75c91906f8bca3c Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerActionsTestJSON-2031640985-project Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance e3fe481a-aa94-4784-9110-17b861d9478d could not be found. Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'e3fe481a-aa94-4784-9110-17b861d9478d'} Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3fe481a-aa94-4784-9110-17b861d9478d could not be found. Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3fe481a-aa94-4784-9110-17b861d9478d could not be found. Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:36:02.520115 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:36:02.524694 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:36:02.524694 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:36:02.524694 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:36:02.524694 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:36:02.524694 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:36:02.524694 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3fe481a-aa94-4784-9110-17b861d9478d could not be found. Oct 05 03:36:02.524694 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:36:02.524694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-007e1d9d-6fb0-4c91-b37e-dafce3d56ee0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Returning 404 to user: Instance e3fe481a-aa94-4784-9110-17b861d9478d could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:36:02.524694 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-007e1d9d-6fb0-4c91-b37e-dafce3d56ee0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 404 len: 111 microversion: 2.1 time: 0.034773 Oct 05 03:36:02.524694 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3655/7296] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:36:02 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:36:02.540684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b27fb5c2-9f8b-46f1-b420-c2f8c3422646 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:36:02.541494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b27fb5c2-9f8b-46f1-b420-c2f8c3422646 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:36:02.550563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b27fb5c2-9f8b-46f1-b420-c2f8c3422646 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:02.551071 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b27fb5c2-9f8b-46f1-b420-c2f8c3422646 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:02.551523 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b27fb5c2-9f8b-46f1-b420-c2f8c3422646 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:02.552245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b27fb5c2-9f8b-46f1-b420-c2f8c3422646 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:02.552715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b27fb5c2-9f8b-46f1-b420-c2f8c3422646 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:02.553186 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b27fb5c2-9f8b-46f1-b420-c2f8c3422646 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:02.570773 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-b27fb5c2-9f8b-46f1-b420-c2f8c3422646 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] HTTP exception thrown: Instance e3fe481a-aa94-4784-9110-17b861d9478d could not be found. Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b27fb5c2-9f8b-46f1-b420-c2f8c3422646 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Request method failure captured: Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d HTTP/1.1 Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPpOjo3UoOtQ-Bs93Auly_6sXh8lfDtgrSY0udxfQzVZtNtMSUx1jRG2ewnriCtcRUrnJaHmLaLcz0mVVG5b9vEZRuG06925WdPWiQLXMx8sJPVOF2G8G35VQEtfcoJQaOleL8MsseS-M06VqanojXWiUqJgAvvCm3KftD0h1N4k_LM Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: cb907a92ab7949ebb3cb2e3b5d372ece Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: cb907a92ab7949ebb3cb2e3b5d372ece Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServerActionsTestJSON-2031640985-project Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 64375d765c0949dbb75c91906f8bca3c Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServerActionsTestJSON-2031640985-project Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance e3fe481a-aa94-4784-9110-17b861d9478d could not be found. Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'e3fe481a-aa94-4784-9110-17b861d9478d'} Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3fe481a-aa94-4784-9110-17b861d9478d could not be found. Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3fe481a-aa94-4784-9110-17b861d9478d could not be found. Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:36:02.572485 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:36:02.577415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:36:02.577415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:36:02.577415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:36:02.577415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:36:02.577415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:36:02.577415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3fe481a-aa94-4784-9110-17b861d9478d could not be found. Oct 05 03:36:02.577415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:36:02.577415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b27fb5c2-9f8b-46f1-b420-c2f8c3422646 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Returning 404 to user: Instance e3fe481a-aa94-4784-9110-17b861d9478d could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:36:02.577415 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b27fb5c2-9f8b-46f1-b420-c2f8c3422646 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 404 len: 111 microversion: 2.1 time: 0.037527 Oct 05 03:36:02.577415 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3642/7297] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:36:02 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:36:02.624300 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3c4f7e82-ae9d-46eb-81b2-da880a59c017 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1760859343", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "e3e1b2b6-bb43-4574-b227-e8169188bcd9"}], "security_groups": [{"name": "tempest-securitygroup--711774869"}], "key_name": "tempest-keypair-904238654", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:36:02.739493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-3c4f7e82-ae9d-46eb-81b2-da880a59c017 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] validate_networks() for [('e3e1b2b6-bb43-4574-b227-e8169188bcd9', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:36:03.119823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-3c4f7e82-ae9d-46eb-81b2-da880a59c017 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:36:03.120274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-3c4f7e82-ae9d-46eb-81b2-da880a59c017 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:36:03.120747 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-3c4f7e82-ae9d-46eb-81b2-da880a59c017 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:36:03.121176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-3c4f7e82-ae9d-46eb-81b2-da880a59c017 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:36:03.121865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-3c4f7e82-ae9d-46eb-81b2-da880a59c017 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:36:03.130915 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c4f7e82-ae9d-46eb-81b2-da880a59c017 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:03.131721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c4f7e82-ae9d-46eb-81b2-da880a59c017 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:03.132158 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c4f7e82-ae9d-46eb-81b2-da880a59c017 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:03.132883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c4f7e82-ae9d-46eb-81b2-da880a59c017 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:03.133356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c4f7e82-ae9d-46eb-81b2-da880a59c017 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:03.133780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c4f7e82-ae9d-46eb-81b2-da880a59c017 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:03.152150 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-3c4f7e82-ae9d-46eb-81b2-da880a59c017 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Getting quotas for project cb907a92ab7949ebb3cb2e3b5d372ece. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:36:03.158074 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-3c4f7e82-ae9d-46eb-81b2-da880a59c017 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Getting quotas for user 64375d765c0949dbb75c91906f8bca3c and project cb907a92ab7949ebb3cb2e3b5d372ece. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:36:03.171096 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3c4f7e82-ae9d-46eb-81b2-da880a59c017 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:36:03.173525 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3c4f7e82-ae9d-46eb-81b2-da880a59c017 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:36:03.222963 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3c4f7e82-ae9d-46eb-81b2-da880a59c017 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.603194 Oct 05 03:36:03.223632 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3656/7298] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:36:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:36:03.235963 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dbf45b5d-426c-458e-a159-1426e687e045 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:36:03.237667 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dbf45b5d-426c-458e-a159-1426e687e045 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:36:03.307500 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dbf45b5d-426c-458e-a159-1426e687e045 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:36:03.314589 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dbf45b5d-426c-458e-a159-1426e687e045 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1238 microversion: 2.1 time: 0.082590 Oct 05 03:36:03.315157 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3643/7299] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:36:03 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1238 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:36:04.338211 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-eb4df0a0-2628-490c-b839-785f9846982a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:36:04.338979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-eb4df0a0-2628-490c-b839-785f9846982a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:36:04.347516 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb4df0a0-2628-490c-b839-785f9846982a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:04.348096 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb4df0a0-2628-490c-b839-785f9846982a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:04.348595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb4df0a0-2628-490c-b839-785f9846982a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:04.349549 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb4df0a0-2628-490c-b839-785f9846982a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:04.351834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb4df0a0-2628-490c-b839-785f9846982a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:04.352353 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-eb4df0a0-2628-490c-b839-785f9846982a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:04.443561 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-eb4df0a0-2628-490c-b839-785f9846982a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:36:04.454316 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-eb4df0a0-2628-490c-b839-785f9846982a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1298 microversion: 2.1 time: 0.119970 Oct 05 03:36:04.454915 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3657/7300] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:36:04 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1298 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:36:05.483007 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-be311df1-496c-4280-b965-d143ef3368a6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:36:05.484424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-be311df1-496c-4280-b965-d143ef3368a6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:36:05.492993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be311df1-496c-4280-b965-d143ef3368a6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:05.493491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be311df1-496c-4280-b965-d143ef3368a6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:05.493962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be311df1-496c-4280-b965-d143ef3368a6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:05.494647 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be311df1-496c-4280-b965-d143ef3368a6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:05.495114 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be311df1-496c-4280-b965-d143ef3368a6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:05.495554 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be311df1-496c-4280-b965-d143ef3368a6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:05.740983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-be311df1-496c-4280-b965-d143ef3368a6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:36:05.749631 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-be311df1-496c-4280-b965-d143ef3368a6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1363 microversion: 2.1 time: 0.274860 Oct 05 03:36:05.750253 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3644/7301] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:36:05 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:36:05.903665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-5ee93fde-3f4a-4a76-bc1d-8101855adf49 req-6ff55399-7b62-41fe-bc5b-de375d5fadea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06de9057-ed46-4d2d-bdce-c4f61c25c638", "tag": "f093399c-5158-4c33-8e5d-f2171bf4eeb7"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:36:05.914217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5ee93fde-3f4a-4a76-bc1d-8101855adf49 req-6ff55399-7b62-41fe-bc5b-de375d5fadea service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:05.914721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5ee93fde-3f4a-4a76-bc1d-8101855adf49 req-6ff55399-7b62-41fe-bc5b-de375d5fadea service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:05.915139 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5ee93fde-3f4a-4a76-bc1d-8101855adf49 req-6ff55399-7b62-41fe-bc5b-de375d5fadea service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:05.927823 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-5ee93fde-3f4a-4a76-bc1d-8101855adf49 req-6ff55399-7b62-41fe-bc5b-de375d5fadea service nova] Creating event network-changed:f093399c-5158-4c33-8e5d-f2171bf4eeb7 for instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 on n-h2-858272-3 Oct 05 03:36:05.932887 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-5ee93fde-3f4a-4a76-bc1d-8101855adf49 req-6ff55399-7b62-41fe-bc5b-de375d5fadea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033489 Oct 05 03:36:05.933779 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3658/7302] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:36:06.774086 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6b695159-840d-4407-b7bc-1dc97b669d7d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:36:06.774722 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6b695159-840d-4407-b7bc-1dc97b669d7d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:36:06.782036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b695159-840d-4407-b7bc-1dc97b669d7d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:06.782544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b695159-840d-4407-b7bc-1dc97b669d7d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:06.783000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b695159-840d-4407-b7bc-1dc97b669d7d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:06.783705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b695159-840d-4407-b7bc-1dc97b669d7d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:06.784177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b695159-840d-4407-b7bc-1dc97b669d7d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:06.784623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b695159-840d-4407-b7bc-1dc97b669d7d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:06.918115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6b695159-840d-4407-b7bc-1dc97b669d7d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:36:06.926457 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6b695159-840d-4407-b7bc-1dc97b669d7d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1363 microversion: 2.1 time: 0.156239 Oct 05 03:36:06.927081 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3645/7303] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:36:06 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:36:07.951496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-60659184-8bd9-4a20-8964-b73baf4793b2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:36:07.952193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-60659184-8bd9-4a20-8964-b73baf4793b2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:36:07.958351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60659184-8bd9-4a20-8964-b73baf4793b2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:07.958855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60659184-8bd9-4a20-8964-b73baf4793b2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:07.959394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60659184-8bd9-4a20-8964-b73baf4793b2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:07.960118 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60659184-8bd9-4a20-8964-b73baf4793b2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:07.960629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60659184-8bd9-4a20-8964-b73baf4793b2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:07.961196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-60659184-8bd9-4a20-8964-b73baf4793b2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:08.089706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-60659184-8bd9-4a20-8964-b73baf4793b2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:36:08.098128 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-60659184-8bd9-4a20-8964-b73baf4793b2 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1363 microversion: 2.1 time: 0.151641 Oct 05 03:36:08.098705 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3659/7304] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:36:07 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:36:09.123260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b8bf7f38-7b79-4866-abb6-6d9450a38533 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:36:09.123921 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b8bf7f38-7b79-4866-abb6-6d9450a38533 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:36:09.130880 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8bf7f38-7b79-4866-abb6-6d9450a38533 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:09.131384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8bf7f38-7b79-4866-abb6-6d9450a38533 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:09.131835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8bf7f38-7b79-4866-abb6-6d9450a38533 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:09.132544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8bf7f38-7b79-4866-abb6-6d9450a38533 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:09.133042 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8bf7f38-7b79-4866-abb6-6d9450a38533 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:09.133486 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8bf7f38-7b79-4866-abb6-6d9450a38533 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:09.260112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b8bf7f38-7b79-4866-abb6-6d9450a38533 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:36:09.267842 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b8bf7f38-7b79-4866-abb6-6d9450a38533 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1363 microversion: 2.1 time: 0.149209 Oct 05 03:36:09.268420 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3646/7305] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:36:09 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:36:10.291377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8e36ed15-85db-457e-a9d1-ca2d323b98dd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:36:10.292000 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8e36ed15-85db-457e-a9d1-ca2d323b98dd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:36:10.299175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8e36ed15-85db-457e-a9d1-ca2d323b98dd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:10.299696 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8e36ed15-85db-457e-a9d1-ca2d323b98dd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:10.300135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8e36ed15-85db-457e-a9d1-ca2d323b98dd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:10.300823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8e36ed15-85db-457e-a9d1-ca2d323b98dd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:10.301305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8e36ed15-85db-457e-a9d1-ca2d323b98dd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:10.301732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8e36ed15-85db-457e-a9d1-ca2d323b98dd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:10.441426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8e36ed15-85db-457e-a9d1-ca2d323b98dd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:36:10.451072 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8e36ed15-85db-457e-a9d1-ca2d323b98dd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1363 microversion: 2.1 time: 0.163895 Oct 05 03:36:10.451651 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3660/7306] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:36:10 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:36:11.474509 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6b8677f1-6ee4-4b83-adc3-8d7894e8a387 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:36:11.475049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6b8677f1-6ee4-4b83-adc3-8d7894e8a387 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:36:11.482807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b8677f1-6ee4-4b83-adc3-8d7894e8a387 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:11.483306 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b8677f1-6ee4-4b83-adc3-8d7894e8a387 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:11.483756 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b8677f1-6ee4-4b83-adc3-8d7894e8a387 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:11.484453 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b8677f1-6ee4-4b83-adc3-8d7894e8a387 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:11.484945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b8677f1-6ee4-4b83-adc3-8d7894e8a387 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:11.485389 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b8677f1-6ee4-4b83-adc3-8d7894e8a387 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:11.614448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6b8677f1-6ee4-4b83-adc3-8d7894e8a387 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:36:11.622432 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6b8677f1-6ee4-4b83-adc3-8d7894e8a387 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1363 microversion: 2.1 time: 0.151921 Oct 05 03:36:11.623002 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3647/7307] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:36:11 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:36:12.645878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d11f9182-eab1-4b88-82bf-b45635d0ac45 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:36:12.646503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d11f9182-eab1-4b88-82bf-b45635d0ac45 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:36:12.654712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d11f9182-eab1-4b88-82bf-b45635d0ac45 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:12.655213 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d11f9182-eab1-4b88-82bf-b45635d0ac45 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:12.655659 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d11f9182-eab1-4b88-82bf-b45635d0ac45 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:12.656372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d11f9182-eab1-4b88-82bf-b45635d0ac45 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:12.656839 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d11f9182-eab1-4b88-82bf-b45635d0ac45 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:12.657298 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d11f9182-eab1-4b88-82bf-b45635d0ac45 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:12.697571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-5db3a882-e7c8-4995-b4a9-07afc6791185 req-81817ae1-dc42-4aae-b536-fbef51d30328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06de9057-ed46-4d2d-bdce-c4f61c25c638", "name": "network-vif-plugged", "status": "completed", "tag": "f093399c-5158-4c33-8e5d-f2171bf4eeb7"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:36:12.710273 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-5db3a882-e7c8-4995-b4a9-07afc6791185 req-81817ae1-dc42-4aae-b536-fbef51d30328 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:12.710822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-5db3a882-e7c8-4995-b4a9-07afc6791185 req-81817ae1-dc42-4aae-b536-fbef51d30328 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:12.711327 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-5db3a882-e7c8-4995-b4a9-07afc6791185 req-81817ae1-dc42-4aae-b536-fbef51d30328 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:12.725939 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-5db3a882-e7c8-4995-b4a9-07afc6791185 req-81817ae1-dc42-4aae-b536-fbef51d30328 service nova] Creating event network-vif-plugged:f093399c-5158-4c33-8e5d-f2171bf4eeb7 for instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 on n-h2-858272-3 Oct 05 03:36:12.731535 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-5db3a882-e7c8-4995-b4a9-07afc6791185 req-81817ae1-dc42-4aae-b536-fbef51d30328 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037591 Oct 05 03:36:12.732135 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3648/7308] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:36:12.800725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d11f9182-eab1-4b88-82bf-b45635d0ac45 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:36:12.809082 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d11f9182-eab1-4b88-82bf-b45635d0ac45 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1363 microversion: 2.1 time: 0.167002 Oct 05 03:36:12.809673 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3661/7309] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:36:12 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:36:13.830408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:36:13.836058 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8f7cf2b6-baac-4366-a76a-8ef2616db3c0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:36:13.836772 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8f7cf2b6-baac-4366-a76a-8ef2616db3c0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:36:13.843722 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f7cf2b6-baac-4366-a76a-8ef2616db3c0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:13.844219 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f7cf2b6-baac-4366-a76a-8ef2616db3c0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:13.844669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f7cf2b6-baac-4366-a76a-8ef2616db3c0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:13.845392 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f7cf2b6-baac-4366-a76a-8ef2616db3c0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:13.845863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f7cf2b6-baac-4366-a76a-8ef2616db3c0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:13.846299 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8f7cf2b6-baac-4366-a76a-8ef2616db3c0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:13.975401 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8f7cf2b6-baac-4366-a76a-8ef2616db3c0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:36:13.984211 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8f7cf2b6-baac-4366-a76a-8ef2616db3c0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1363 microversion: 2.1 time: 0.154806 Oct 05 03:36:13.984778 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3649/7310] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:36:13 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:36:15.007553 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5cb93ff9-2a4e-4d49-8bc0-9bb2d3ffb953 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:36:15.008103 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5cb93ff9-2a4e-4d49-8bc0-9bb2d3ffb953 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:36:15.010078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:36:15.010761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:36:15.017395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5cb93ff9-2a4e-4d49-8bc0-9bb2d3ffb953 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:15.017907 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5cb93ff9-2a4e-4d49-8bc0-9bb2d3ffb953 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:15.018345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5cb93ff9-2a4e-4d49-8bc0-9bb2d3ffb953 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:15.019041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5cb93ff9-2a4e-4d49-8bc0-9bb2d3ffb953 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:15.019499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5cb93ff9-2a4e-4d49-8bc0-9bb2d3ffb953 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:15.019926 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5cb93ff9-2a4e-4d49-8bc0-9bb2d3ffb953 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:15.154245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5cb93ff9-2a4e-4d49-8bc0-9bb2d3ffb953 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:36:15.161976 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5cb93ff9-2a4e-4d49-8bc0-9bb2d3ffb953 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1551 microversion: 2.1 time: 0.158381 Oct 05 03:36:15.162552 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3662/7311] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:36:15 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1551 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:36:15.185967 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8779e726-50dd-4dd2-83b8-c60617ec0d5d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:36:15.186487 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8779e726-50dd-4dd2-83b8-c60617ec0d5d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:36:15.193291 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8779e726-50dd-4dd2-83b8-c60617ec0d5d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:15.193787 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8779e726-50dd-4dd2-83b8-c60617ec0d5d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:15.194239 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8779e726-50dd-4dd2-83b8-c60617ec0d5d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:15.194942 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8779e726-50dd-4dd2-83b8-c60617ec0d5d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:15.195410 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8779e726-50dd-4dd2-83b8-c60617ec0d5d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:15.195848 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8779e726-50dd-4dd2-83b8-c60617ec0d5d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:15.275124 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8779e726-50dd-4dd2-83b8-c60617ec0d5d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093639 Oct 05 03:36:15.275803 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3650/7312] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 03:36:15 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:36:16.530011 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-fc27d572-642a-443d-9295-f5b66ff73226 req-ec11174f-68d7-4121-845f-da7fd2f62f10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06de9057-ed46-4d2d-bdce-c4f61c25c638", "tag": "f093399c-5158-4c33-8e5d-f2171bf4eeb7"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:36:16.540031 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-fc27d572-642a-443d-9295-f5b66ff73226 req-ec11174f-68d7-4121-845f-da7fd2f62f10 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:36:16.540507 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-fc27d572-642a-443d-9295-f5b66ff73226 req-ec11174f-68d7-4121-845f-da7fd2f62f10 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:36:16.540953 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-fc27d572-642a-443d-9295-f5b66ff73226 req-ec11174f-68d7-4121-845f-da7fd2f62f10 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:36:16.552800 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-fc27d572-642a-443d-9295-f5b66ff73226 req-ec11174f-68d7-4121-845f-da7fd2f62f10 service nova] Creating event network-changed:f093399c-5158-4c33-8e5d-f2171bf4eeb7 for instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 on n-h2-858272-3 Oct 05 03:36:16.557876 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-fc27d572-642a-443d-9295-f5b66ff73226 req-ec11174f-68d7-4121-845f-da7fd2f62f10 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031715 Oct 05 03:36:16.558486 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3663/7313] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:37:19.614980 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=23 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:37:19.615784 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:37:19.617228 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 03:37:19.617410 n-d-858272-3 devstack@n-api.service[122320]: Wed Oct 5 03:37:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 (ip 10.222.0.16) !!! Oct 05 03:37:19.622628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bd5472c2-2d51-43fd-af73-33f0953cd25e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:37:19.623256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bd5472c2-2d51-43fd-af73-33f0953cd25e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:37:19.632195 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd5472c2-2d51-43fd-af73-33f0953cd25e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:19.632612 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd5472c2-2d51-43fd-af73-33f0953cd25e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:19.633096 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd5472c2-2d51-43fd-af73-33f0953cd25e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:19.633806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd5472c2-2d51-43fd-af73-33f0953cd25e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:19.634278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd5472c2-2d51-43fd-af73-33f0953cd25e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:19.634722 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd5472c2-2d51-43fd-af73-33f0953cd25e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:19.849223 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bd5472c2-2d51-43fd-af73-33f0953cd25e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:37:19.857234 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bd5472c2-2d51-43fd-af73-33f0953cd25e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1670 microversion: 2.1 time: 0.244884 Oct 05 03:37:19.857822 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3651/7314] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:37:19 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1670 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:37:19.878805 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:37:19.879560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=48 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:37:19.880846 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 03:37:19.881008 n-d-858272-3 devstack@n-api.service[122319]: Wed Oct 5 03:37:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638/os-volume_attachments (ip 10.222.0.16) !!! Oct 05 03:37:19.887504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-166b72c0-2754-48d4-bc1c-d9df84419079 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0bcb72b1-7db2-4202-a408-beba2c5c7d6e"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:37:19.890799 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-166b72c0-2754-48d4-bc1c-d9df84419079 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:37:19.900073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-166b72c0-2754-48d4-bc1c-d9df84419079 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:19.900561 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-166b72c0-2754-48d4-bc1c-d9df84419079 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:19.901025 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-166b72c0-2754-48d4-bc1c-d9df84419079 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:19.901725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-166b72c0-2754-48d4-bc1c-d9df84419079 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:19.902180 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-166b72c0-2754-48d4-bc1c-d9df84419079 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:19.902641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-166b72c0-2754-48d4-bc1c-d9df84419079 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:20.302474 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-166b72c0-2754-48d4-bc1c-d9df84419079 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "POST /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.426085 Oct 05 03:37:20.303111 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3664/7315] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 03:37:19 2022] POST /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638/os-volume_attachments => generated 194 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:37:32.075839 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3d409b8f-6a1e-447f-b1b0-0b209b1655fb tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:37:32.078491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3d409b8f-6a1e-447f-b1b0-0b209b1655fb tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:37:32.081344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:37:32.082128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:37:32.087924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d409b8f-6a1e-447f-b1b0-0b209b1655fb tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:32.088431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d409b8f-6a1e-447f-b1b0-0b209b1655fb tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:32.088885 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d409b8f-6a1e-447f-b1b0-0b209b1655fb tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:32.089617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d409b8f-6a1e-447f-b1b0-0b209b1655fb tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:32.090116 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d409b8f-6a1e-447f-b1b0-0b209b1655fb tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:32.090558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d409b8f-6a1e-447f-b1b0-0b209b1655fb tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:32.184693 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3d409b8f-6a1e-447f-b1b0-0b209b1655fb tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:37:32.191541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3d409b8f-6a1e-447f-b1b0-0b209b1655fb tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Old instance type m1.heat2, new instance type m1.heat {{(pid=122320) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 05 03:37:32.198658 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-3d409b8f-6a1e-447f-b1b0-0b209b1655fb tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:37:32.199102 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-3d409b8f-6a1e-447f-b1b0-0b209b1655fb tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:37:32.199591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-3d409b8f-6a1e-447f-b1b0-0b209b1655fb tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:37:32.200017 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-3d409b8f-6a1e-447f-b1b0-0b209b1655fb tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:37:32.200446 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-3d409b8f-6a1e-447f-b1b0-0b209b1655fb tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:37:32.263094 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3d409b8f-6a1e-447f-b1b0-0b209b1655fb tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "POST /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638/action" status: 202 len: 0 microversion: 2.1 time: 0.191170 Oct 05 03:37:32.263707 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3652/7316] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:37:32 2022] POST /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:37:32.269945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:37:32.270722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:37:32.274800 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0c6e012a-42a5-4663-8990-6a4cbe477237 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:37:32.275530 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0c6e012a-42a5-4663-8990-6a4cbe477237 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:37:32.282836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c6e012a-42a5-4663-8990-6a4cbe477237 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:32.283361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c6e012a-42a5-4663-8990-6a4cbe477237 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:32.283760 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c6e012a-42a5-4663-8990-6a4cbe477237 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:32.284519 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c6e012a-42a5-4663-8990-6a4cbe477237 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:32.284920 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c6e012a-42a5-4663-8990-6a4cbe477237 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:32.285349 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c6e012a-42a5-4663-8990-6a4cbe477237 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:32.423943 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0c6e012a-42a5-4663-8990-6a4cbe477237 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:37:32.432564 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0c6e012a-42a5-4663-8990-6a4cbe477237 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1725 microversion: 2.1 time: 0.164404 Oct 05 03:37:32.433137 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3665/7317] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:37:32 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:37:33.457863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-24348cb5-5b20-4349-92da-9040db941cdf tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:37:33.458488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-24348cb5-5b20-4349-92da-9040db941cdf tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:37:33.465334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24348cb5-5b20-4349-92da-9040db941cdf tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:33.465828 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24348cb5-5b20-4349-92da-9040db941cdf tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:33.466277 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24348cb5-5b20-4349-92da-9040db941cdf tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:33.466999 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24348cb5-5b20-4349-92da-9040db941cdf tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:33.467464 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24348cb5-5b20-4349-92da-9040db941cdf tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:33.467899 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-24348cb5-5b20-4349-92da-9040db941cdf tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:33.600661 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-24348cb5-5b20-4349-92da-9040db941cdf tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:37:33.610167 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-24348cb5-5b20-4349-92da-9040db941cdf tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1725 microversion: 2.1 time: 0.157555 Oct 05 03:37:33.610770 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3653/7318] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:37:33 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:37:34.633716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ed7b94d0-24cb-44b4-a81c-07b553d84a6e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:37:34.634343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ed7b94d0-24cb-44b4-a81c-07b553d84a6e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:37:34.641922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed7b94d0-24cb-44b4-a81c-07b553d84a6e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:34.642420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed7b94d0-24cb-44b4-a81c-07b553d84a6e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:34.642865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed7b94d0-24cb-44b4-a81c-07b553d84a6e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:34.643566 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed7b94d0-24cb-44b4-a81c-07b553d84a6e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:34.644097 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed7b94d0-24cb-44b4-a81c-07b553d84a6e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:34.644531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ed7b94d0-24cb-44b4-a81c-07b553d84a6e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:34.782278 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ed7b94d0-24cb-44b4-a81c-07b553d84a6e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:37:34.790738 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ed7b94d0-24cb-44b4-a81c-07b553d84a6e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1730 microversion: 2.1 time: 0.160957 Oct 05 03:37:34.791345 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3666/7319] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:37:34 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:37:35.815947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e7c6a399-1228-4b6a-aa03-d1564107d640 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:37:35.816583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e7c6a399-1228-4b6a-aa03-d1564107d640 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:37:35.823538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7c6a399-1228-4b6a-aa03-d1564107d640 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:35.824041 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7c6a399-1228-4b6a-aa03-d1564107d640 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:35.824496 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7c6a399-1228-4b6a-aa03-d1564107d640 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:35.825233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7c6a399-1228-4b6a-aa03-d1564107d640 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:35.825709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7c6a399-1228-4b6a-aa03-d1564107d640 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:35.826150 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7c6a399-1228-4b6a-aa03-d1564107d640 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:35.954258 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e7c6a399-1228-4b6a-aa03-d1564107d640 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:37:35.962512 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e7c6a399-1228-4b6a-aa03-d1564107d640 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1730 microversion: 2.1 time: 0.151084 Oct 05 03:37:35.963091 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3654/7320] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:37:35 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:37:36.987889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-37463729-b485-4c86-b85e-5c2186b58784 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:37:36.988423 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-37463729-b485-4c86-b85e-5c2186b58784 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:37:36.995225 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37463729-b485-4c86-b85e-5c2186b58784 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:36.995703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37463729-b485-4c86-b85e-5c2186b58784 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:36.996142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37463729-b485-4c86-b85e-5c2186b58784 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:36.996825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37463729-b485-4c86-b85e-5c2186b58784 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:36.997307 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37463729-b485-4c86-b85e-5c2186b58784 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:36.997730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37463729-b485-4c86-b85e-5c2186b58784 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:37.128532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-37463729-b485-4c86-b85e-5c2186b58784 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:37:37.137013 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-37463729-b485-4c86-b85e-5c2186b58784 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1730 microversion: 2.1 time: 0.153814 Oct 05 03:37:37.137596 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3667/7321] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:37:36 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:37:38.161011 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cbadf2dc-2998-4f47-8205-c5bebe0d3332 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:37:38.161623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cbadf2dc-2998-4f47-8205-c5bebe0d3332 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:37:38.167535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbadf2dc-2998-4f47-8205-c5bebe0d3332 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:38.168032 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbadf2dc-2998-4f47-8205-c5bebe0d3332 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:38.168481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbadf2dc-2998-4f47-8205-c5bebe0d3332 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:38.169227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbadf2dc-2998-4f47-8205-c5bebe0d3332 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:38.169696 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbadf2dc-2998-4f47-8205-c5bebe0d3332 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:38.170131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cbadf2dc-2998-4f47-8205-c5bebe0d3332 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:38.298626 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cbadf2dc-2998-4f47-8205-c5bebe0d3332 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:37:38.306944 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cbadf2dc-2998-4f47-8205-c5bebe0d3332 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1730 microversion: 2.1 time: 0.151189 Oct 05 03:37:38.307527 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3655/7322] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:37:38 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:37:39.330817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fdf0e6f2-2031-4c35-993e-d2581c4f7d76 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:37:39.331429 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fdf0e6f2-2031-4c35-993e-d2581c4f7d76 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:37:39.338003 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fdf0e6f2-2031-4c35-993e-d2581c4f7d76 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:39.338491 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fdf0e6f2-2031-4c35-993e-d2581c4f7d76 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:39.338924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fdf0e6f2-2031-4c35-993e-d2581c4f7d76 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:39.339609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fdf0e6f2-2031-4c35-993e-d2581c4f7d76 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:39.340062 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fdf0e6f2-2031-4c35-993e-d2581c4f7d76 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:39.340487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fdf0e6f2-2031-4c35-993e-d2581c4f7d76 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:39.467688 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fdf0e6f2-2031-4c35-993e-d2581c4f7d76 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:37:39.476609 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fdf0e6f2-2031-4c35-993e-d2581c4f7d76 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1730 microversion: 2.1 time: 0.150068 Oct 05 03:37:39.477216 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3668/7323] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:37:39 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:37:40.500487 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ff9aa349-1212-4a5f-b1f6-ad398d1e5bfe tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:37:40.501134 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ff9aa349-1212-4a5f-b1f6-ad398d1e5bfe tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:37:40.507923 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff9aa349-1212-4a5f-b1f6-ad398d1e5bfe tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:40.508422 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff9aa349-1212-4a5f-b1f6-ad398d1e5bfe tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:40.508868 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff9aa349-1212-4a5f-b1f6-ad398d1e5bfe tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:40.509590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff9aa349-1212-4a5f-b1f6-ad398d1e5bfe tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:40.510056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff9aa349-1212-4a5f-b1f6-ad398d1e5bfe tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:40.510493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ff9aa349-1212-4a5f-b1f6-ad398d1e5bfe tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:40.645378 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ff9aa349-1212-4a5f-b1f6-ad398d1e5bfe tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:37:40.654284 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ff9aa349-1212-4a5f-b1f6-ad398d1e5bfe tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1730 microversion: 2.1 time: 0.158292 Oct 05 03:37:40.654876 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3656/7324] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:37:40 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:37:41.678366 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e845f4d4-a4f8-4490-a7f8-7e779e66dc0e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:37:41.678987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e845f4d4-a4f8-4490-a7f8-7e779e66dc0e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:37:41.685925 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e845f4d4-a4f8-4490-a7f8-7e779e66dc0e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:41.686419 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e845f4d4-a4f8-4490-a7f8-7e779e66dc0e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:41.687393 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e845f4d4-a4f8-4490-a7f8-7e779e66dc0e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:41.688094 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e845f4d4-a4f8-4490-a7f8-7e779e66dc0e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:41.688552 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e845f4d4-a4f8-4490-a7f8-7e779e66dc0e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:41.689019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e845f4d4-a4f8-4490-a7f8-7e779e66dc0e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:41.819044 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e845f4d4-a4f8-4490-a7f8-7e779e66dc0e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:37:41.827607 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e845f4d4-a4f8-4490-a7f8-7e779e66dc0e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1730 microversion: 2.1 time: 0.152977 Oct 05 03:37:41.828373 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3669/7325] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:37:41 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:37:42.850942 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-35308740-1921-4c6c-802a-4a23b4dd8c52 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:37:42.851830 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-35308740-1921-4c6c-802a-4a23b4dd8c52 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:37:42.859889 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-35308740-1921-4c6c-802a-4a23b4dd8c52 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:42.860401 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-35308740-1921-4c6c-802a-4a23b4dd8c52 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:42.860893 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-35308740-1921-4c6c-802a-4a23b4dd8c52 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:42.861829 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-35308740-1921-4c6c-802a-4a23b4dd8c52 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:42.862093 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-35308740-1921-4c6c-802a-4a23b4dd8c52 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:42.862582 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-35308740-1921-4c6c-802a-4a23b4dd8c52 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:42.998462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-35308740-1921-4c6c-802a-4a23b4dd8c52 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:37:43.006972 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-35308740-1921-4c6c-802a-4a23b4dd8c52 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1730 microversion: 2.1 time: 0.160041 Oct 05 03:37:43.007556 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3657/7326] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:37:42 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:37:44.030799 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b9d69437-6e8d-4dd4-b17d-fe38bc2ec4a0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:37:44.031418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b9d69437-6e8d-4dd4-b17d-fe38bc2ec4a0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:37:44.038444 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9d69437-6e8d-4dd4-b17d-fe38bc2ec4a0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:44.038924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9d69437-6e8d-4dd4-b17d-fe38bc2ec4a0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:44.039357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9d69437-6e8d-4dd4-b17d-fe38bc2ec4a0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:44.040042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9d69437-6e8d-4dd4-b17d-fe38bc2ec4a0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:44.040495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9d69437-6e8d-4dd4-b17d-fe38bc2ec4a0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:44.040930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b9d69437-6e8d-4dd4-b17d-fe38bc2ec4a0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:44.178348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b9d69437-6e8d-4dd4-b17d-fe38bc2ec4a0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:37:44.187319 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b9d69437-6e8d-4dd4-b17d-fe38bc2ec4a0 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1730 microversion: 2.1 time: 0.159824 Oct 05 03:37:44.187897 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3670/7327] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:37:44 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:37:45.210423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c46ecdef-5bc5-49a2-bd90-d7c40d7ff8b4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:37:45.211081 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c46ecdef-5bc5-49a2-bd90-d7c40d7ff8b4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:37:45.218005 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c46ecdef-5bc5-49a2-bd90-d7c40d7ff8b4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:45.218511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c46ecdef-5bc5-49a2-bd90-d7c40d7ff8b4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:45.218965 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c46ecdef-5bc5-49a2-bd90-d7c40d7ff8b4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:45.219666 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c46ecdef-5bc5-49a2-bd90-d7c40d7ff8b4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:45.220139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c46ecdef-5bc5-49a2-bd90-d7c40d7ff8b4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:45.220577 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c46ecdef-5bc5-49a2-bd90-d7c40d7ff8b4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:45.348513 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c46ecdef-5bc5-49a2-bd90-d7c40d7ff8b4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:37:45.357078 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c46ecdef-5bc5-49a2-bd90-d7c40d7ff8b4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1730 microversion: 2.1 time: 0.150656 Oct 05 03:37:45.357659 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3658/7328] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:37:45 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:37:46.380530 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4c8a4779-c781-4ce6-92f4-66f779823f03 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:37:46.381154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4c8a4779-c781-4ce6-92f4-66f779823f03 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:37:46.387916 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c8a4779-c781-4ce6-92f4-66f779823f03 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:46.388394 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c8a4779-c781-4ce6-92f4-66f779823f03 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:46.388822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c8a4779-c781-4ce6-92f4-66f779823f03 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:46.389540 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c8a4779-c781-4ce6-92f4-66f779823f03 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:46.389991 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c8a4779-c781-4ce6-92f4-66f779823f03 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:46.390417 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4c8a4779-c781-4ce6-92f4-66f779823f03 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:46.523853 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4c8a4779-c781-4ce6-92f4-66f779823f03 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:37:46.532416 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4c8a4779-c781-4ce6-92f4-66f779823f03 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1730 microversion: 2.1 time: 0.155724 Oct 05 03:37:46.533008 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3671/7329] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:37:46 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:37:47.555669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bc1d396c-54e3-4fe5-937c-b99b5ebbee53 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:37:47.556324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bc1d396c-54e3-4fe5-937c-b99b5ebbee53 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:37:47.563776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bc1d396c-54e3-4fe5-937c-b99b5ebbee53 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:47.564277 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bc1d396c-54e3-4fe5-937c-b99b5ebbee53 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:47.564733 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bc1d396c-54e3-4fe5-937c-b99b5ebbee53 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:47.565465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bc1d396c-54e3-4fe5-937c-b99b5ebbee53 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:47.565937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bc1d396c-54e3-4fe5-937c-b99b5ebbee53 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:47.566376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bc1d396c-54e3-4fe5-937c-b99b5ebbee53 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:47.696238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bc1d396c-54e3-4fe5-937c-b99b5ebbee53 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:37:47.705115 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bc1d396c-54e3-4fe5-937c-b99b5ebbee53 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1730 microversion: 2.1 time: 0.153348 Oct 05 03:37:47.705718 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3659/7330] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:37:47 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:37:48.729021 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d8f1ce16-f424-4e56-832d-7127b1a19e0d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:37:48.729636 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d8f1ce16-f424-4e56-832d-7127b1a19e0d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:37:48.736772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8f1ce16-f424-4e56-832d-7127b1a19e0d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:48.737288 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8f1ce16-f424-4e56-832d-7127b1a19e0d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:48.737722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8f1ce16-f424-4e56-832d-7127b1a19e0d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:48.738404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8f1ce16-f424-4e56-832d-7127b1a19e0d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:48.738857 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8f1ce16-f424-4e56-832d-7127b1a19e0d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:48.739277 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8f1ce16-f424-4e56-832d-7127b1a19e0d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:48.875712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d8f1ce16-f424-4e56-832d-7127b1a19e0d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:37:48.884108 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d8f1ce16-f424-4e56-832d-7127b1a19e0d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1730 microversion: 2.1 time: 0.159317 Oct 05 03:37:48.884696 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3672/7331] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:37:48 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:37:49.909099 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b61f1294-4702-48b4-9c16-a25d24d98e0d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:37:49.909644 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b61f1294-4702-48b4-9c16-a25d24d98e0d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:37:49.916475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b61f1294-4702-48b4-9c16-a25d24d98e0d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:49.917009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b61f1294-4702-48b4-9c16-a25d24d98e0d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:49.917460 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b61f1294-4702-48b4-9c16-a25d24d98e0d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:49.918157 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b61f1294-4702-48b4-9c16-a25d24d98e0d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:49.918622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b61f1294-4702-48b4-9c16-a25d24d98e0d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:49.919058 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b61f1294-4702-48b4-9c16-a25d24d98e0d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:50.050614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b61f1294-4702-48b4-9c16-a25d24d98e0d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:37:50.058676 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b61f1294-4702-48b4-9c16-a25d24d98e0d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1730 microversion: 2.1 time: 0.154180 Oct 05 03:37:50.059264 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3660/7332] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:37:49 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:37:51.083170 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6025fa88-c772-4b4b-aa89-217a03b270d8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:37:51.083794 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6025fa88-c772-4b4b-aa89-217a03b270d8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:37:51.090672 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6025fa88-c772-4b4b-aa89-217a03b270d8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:51.091157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6025fa88-c772-4b4b-aa89-217a03b270d8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:51.091597 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6025fa88-c772-4b4b-aa89-217a03b270d8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:51.092288 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6025fa88-c772-4b4b-aa89-217a03b270d8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:51.092745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6025fa88-c772-4b4b-aa89-217a03b270d8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:51.093202 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6025fa88-c772-4b4b-aa89-217a03b270d8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:51.226966 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6025fa88-c772-4b4b-aa89-217a03b270d8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:37:51.235406 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6025fa88-c772-4b4b-aa89-217a03b270d8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1730 microversion: 2.1 time: 0.156364 Oct 05 03:37:51.235982 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3673/7333] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:37:51 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:37:52.259701 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-64e639b7-b945-427a-b872-28649449137c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:37:52.260271 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-64e639b7-b945-427a-b872-28649449137c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:37:52.268055 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64e639b7-b945-427a-b872-28649449137c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:52.268586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64e639b7-b945-427a-b872-28649449137c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:52.269046 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64e639b7-b945-427a-b872-28649449137c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:52.269765 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64e639b7-b945-427a-b872-28649449137c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:52.270239 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64e639b7-b945-427a-b872-28649449137c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:52.270675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64e639b7-b945-427a-b872-28649449137c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:52.406777 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-64e639b7-b945-427a-b872-28649449137c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:37:52.415147 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-64e639b7-b945-427a-b872-28649449137c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1730 microversion: 2.1 time: 0.159830 Oct 05 03:37:52.415721 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3661/7334] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:37:52 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:37:53.440250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-96fc1dc0-e7f9-4519-bc79-0a6c57939f5e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:37:53.440793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-96fc1dc0-e7f9-4519-bc79-0a6c57939f5e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:37:53.447545 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96fc1dc0-e7f9-4519-bc79-0a6c57939f5e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:53.448049 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96fc1dc0-e7f9-4519-bc79-0a6c57939f5e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:53.448462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96fc1dc0-e7f9-4519-bc79-0a6c57939f5e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:53.449177 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96fc1dc0-e7f9-4519-bc79-0a6c57939f5e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:53.449633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96fc1dc0-e7f9-4519-bc79-0a6c57939f5e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:53.450057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96fc1dc0-e7f9-4519-bc79-0a6c57939f5e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:53.663657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-96fc1dc0-e7f9-4519-bc79-0a6c57939f5e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:37:53.672061 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-96fc1dc0-e7f9-4519-bc79-0a6c57939f5e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1729 microversion: 2.1 time: 0.236587 Oct 05 03:37:53.672635 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3674/7335] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:37:53 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1729 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:37:53.944607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-aafd97a8-bedc-49c6-9481-6f98b9a6dbd1 req-e5324137-5246-4167-869e-b71e045708b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06de9057-ed46-4d2d-bdce-c4f61c25c638", "name": "network-vif-unplugged", "status": "completed", "tag": "f093399c-5158-4c33-8e5d-f2171bf4eeb7"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:37:53.954845 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-aafd97a8-bedc-49c6-9481-6f98b9a6dbd1 req-e5324137-5246-4167-869e-b71e045708b2 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:53.955362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-aafd97a8-bedc-49c6-9481-6f98b9a6dbd1 req-e5324137-5246-4167-869e-b71e045708b2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:53.955812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-aafd97a8-bedc-49c6-9481-6f98b9a6dbd1 req-e5324137-5246-4167-869e-b71e045708b2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:53.972041 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-aafd97a8-bedc-49c6-9481-6f98b9a6dbd1 req-e5324137-5246-4167-869e-b71e045708b2 service nova] Creating event network-vif-unplugged:f093399c-5158-4c33-8e5d-f2171bf4eeb7 for instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 on n-h1-858272-3 Oct 05 03:37:53.977899 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [req-aafd97a8-bedc-49c6-9481-6f98b9a6dbd1 req-e5324137-5246-4167-869e-b71e045708b2 service nova] Instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 03:37:53.989231 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-aafd97a8-bedc-49c6-9481-6f98b9a6dbd1 req-e5324137-5246-4167-869e-b71e045708b2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101285 Oct 05 03:37:53.989857 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3662/7336] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:37:54.696733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ad16ea33-8534-4705-adc3-59f274f0cbfd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:37:54.697431 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ad16ea33-8534-4705-adc3-59f274f0cbfd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:37:54.704651 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad16ea33-8534-4705-adc3-59f274f0cbfd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:54.705193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad16ea33-8534-4705-adc3-59f274f0cbfd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:54.705641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad16ea33-8534-4705-adc3-59f274f0cbfd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:54.706343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad16ea33-8534-4705-adc3-59f274f0cbfd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:54.706802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad16ea33-8534-4705-adc3-59f274f0cbfd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:54.707230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad16ea33-8534-4705-adc3-59f274f0cbfd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:54.917974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ad16ea33-8534-4705-adc3-59f274f0cbfd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:37:54.927972 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ad16ea33-8534-4705-adc3-59f274f0cbfd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1729 microversion: 2.1 time: 0.235106 Oct 05 03:37:54.928577 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3675/7337] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:37:54 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1729 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:37:55.956411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5dcf65c7-8fd9-404d-b58b-f94022315120 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:37:55.957144 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5dcf65c7-8fd9-404d-b58b-f94022315120 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:37:55.963292 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5dcf65c7-8fd9-404d-b58b-f94022315120 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:55.963802 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5dcf65c7-8fd9-404d-b58b-f94022315120 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:55.964259 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5dcf65c7-8fd9-404d-b58b-f94022315120 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:55.964997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5dcf65c7-8fd9-404d-b58b-f94022315120 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:55.965478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5dcf65c7-8fd9-404d-b58b-f94022315120 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:55.965923 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5dcf65c7-8fd9-404d-b58b-f94022315120 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:56.006011 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-456287ee-d9fc-459e-af44-e52596f153e3 req-c77c110a-4d11-42f5-8fea-37490da87aaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06de9057-ed46-4d2d-bdce-c4f61c25c638", "tag": "f093399c-5158-4c33-8e5d-f2171bf4eeb7"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:37:56.017473 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-456287ee-d9fc-459e-af44-e52596f153e3 req-c77c110a-4d11-42f5-8fea-37490da87aaa service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:56.017972 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-456287ee-d9fc-459e-af44-e52596f153e3 req-c77c110a-4d11-42f5-8fea-37490da87aaa service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:56.018416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-456287ee-d9fc-459e-af44-e52596f153e3 req-c77c110a-4d11-42f5-8fea-37490da87aaa service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:56.030832 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-456287ee-d9fc-459e-af44-e52596f153e3 req-c77c110a-4d11-42f5-8fea-37490da87aaa service nova] Creating event network-changed:f093399c-5158-4c33-8e5d-f2171bf4eeb7 for instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 on n-h1-858272-3 Oct 05 03:37:56.037342 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [req-456287ee-d9fc-459e-af44-e52596f153e3 req-c77c110a-4d11-42f5-8fea-37490da87aaa service nova] Instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122319) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 03:37:56.048379 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-456287ee-d9fc-459e-af44-e52596f153e3 req-c77c110a-4d11-42f5-8fea-37490da87aaa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046024 Oct 05 03:37:56.049354 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3676/7338] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:37:56.105431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5dcf65c7-8fd9-404d-b58b-f94022315120 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:37:56.115584 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5dcf65c7-8fd9-404d-b58b-f94022315120 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1727 microversion: 2.1 time: 0.164968 Oct 05 03:37:56.116402 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3663/7339] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:37:55 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:37:57.141722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-55a4800e-faf0-4b7c-ad59-ef78c56b5b7e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:37:57.143050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-55a4800e-faf0-4b7c-ad59-ef78c56b5b7e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:37:57.149773 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55a4800e-faf0-4b7c-ad59-ef78c56b5b7e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:57.150266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55a4800e-faf0-4b7c-ad59-ef78c56b5b7e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:57.150703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55a4800e-faf0-4b7c-ad59-ef78c56b5b7e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:57.151554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55a4800e-faf0-4b7c-ad59-ef78c56b5b7e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:57.152014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55a4800e-faf0-4b7c-ad59-ef78c56b5b7e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:57.152442 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-55a4800e-faf0-4b7c-ad59-ef78c56b5b7e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:57.385987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-55a4800e-faf0-4b7c-ad59-ef78c56b5b7e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:37:57.396742 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-55a4800e-faf0-4b7c-ad59-ef78c56b5b7e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1727 microversion: 2.1 time: 0.260788 Oct 05 03:37:57.397398 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3677/7340] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:37:57 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1727 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:37:58.420502 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a0462007-651c-44b9-a5bf-b4bdae7c0c82 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:37:58.421397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a0462007-651c-44b9-a5bf-b4bdae7c0c82 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:37:58.431044 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a0462007-651c-44b9-a5bf-b4bdae7c0c82 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:58.431877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a0462007-651c-44b9-a5bf-b4bdae7c0c82 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:58.432344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a0462007-651c-44b9-a5bf-b4bdae7c0c82 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:58.433102 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a0462007-651c-44b9-a5bf-b4bdae7c0c82 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:58.433583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a0462007-651c-44b9-a5bf-b4bdae7c0c82 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:58.434028 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a0462007-651c-44b9-a5bf-b4bdae7c0c82 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:58.572823 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a0462007-651c-44b9-a5bf-b4bdae7c0c82 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:37:58.582079 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a0462007-651c-44b9-a5bf-b4bdae7c0c82 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1727 microversion: 2.1 time: 0.166145 Oct 05 03:37:58.582748 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3664/7341] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:37:58 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:37:59.607777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2431c867-b4f6-4850-9f86-08a21bf4807f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:37:59.608501 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2431c867-b4f6-4850-9f86-08a21bf4807f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:37:59.616256 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2431c867-b4f6-4850-9f86-08a21bf4807f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:59.616751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2431c867-b4f6-4850-9f86-08a21bf4807f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:59.617221 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2431c867-b4f6-4850-9f86-08a21bf4807f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:59.617935 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2431c867-b4f6-4850-9f86-08a21bf4807f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:37:59.618396 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2431c867-b4f6-4850-9f86-08a21bf4807f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:37:59.618830 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2431c867-b4f6-4850-9f86-08a21bf4807f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:37:59.763710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2431c867-b4f6-4850-9f86-08a21bf4807f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:37:59.773066 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2431c867-b4f6-4850-9f86-08a21bf4807f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1727 microversion: 2.1 time: 0.169175 Oct 05 03:37:59.773652 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3678/7342] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:37:59 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:00.795825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5d8d34f8-aa81-44b2-b20e-feb2ccd7b434 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:00.797027 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5d8d34f8-aa81-44b2-b20e-feb2ccd7b434 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:00.803867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d8d34f8-aa81-44b2-b20e-feb2ccd7b434 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:00.804390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d8d34f8-aa81-44b2-b20e-feb2ccd7b434 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:00.804844 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d8d34f8-aa81-44b2-b20e-feb2ccd7b434 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:00.805567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d8d34f8-aa81-44b2-b20e-feb2ccd7b434 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:00.806040 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d8d34f8-aa81-44b2-b20e-feb2ccd7b434 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:00.806479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d8d34f8-aa81-44b2-b20e-feb2ccd7b434 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:00.938752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5d8d34f8-aa81-44b2-b20e-feb2ccd7b434 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:00.947052 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5d8d34f8-aa81-44b2-b20e-feb2ccd7b434 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1727 microversion: 2.1 time: 0.155161 Oct 05 03:38:00.947637 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3665/7343] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:00 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:01.971858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5e7087d0-5444-4f0f-8d6a-e514efe678d5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:01.972410 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5e7087d0-5444-4f0f-8d6a-e514efe678d5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:01.979581 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e7087d0-5444-4f0f-8d6a-e514efe678d5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:01.980070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e7087d0-5444-4f0f-8d6a-e514efe678d5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:01.980512 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e7087d0-5444-4f0f-8d6a-e514efe678d5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:01.981242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e7087d0-5444-4f0f-8d6a-e514efe678d5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:01.981704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e7087d0-5444-4f0f-8d6a-e514efe678d5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:01.982138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e7087d0-5444-4f0f-8d6a-e514efe678d5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:02.120560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5e7087d0-5444-4f0f-8d6a-e514efe678d5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:02.128878 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5e7087d0-5444-4f0f-8d6a-e514efe678d5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1727 microversion: 2.1 time: 0.162576 Oct 05 03:38:02.129471 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3679/7344] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:01 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:03.152332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dd6083fe-82cb-4a80-8395-67ed963d59fa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:03.152993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dd6083fe-82cb-4a80-8395-67ed963d59fa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:03.156351 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=33 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:38:03.161876 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd6083fe-82cb-4a80-8395-67ed963d59fa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:03.162379 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd6083fe-82cb-4a80-8395-67ed963d59fa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:03.162829 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd6083fe-82cb-4a80-8395-67ed963d59fa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:03.163534 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd6083fe-82cb-4a80-8395-67ed963d59fa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:03.164004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd6083fe-82cb-4a80-8395-67ed963d59fa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:03.164447 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dd6083fe-82cb-4a80-8395-67ed963d59fa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:03.168420 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:38:03.294518 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dd6083fe-82cb-4a80-8395-67ed963d59fa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:03.303338 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dd6083fe-82cb-4a80-8395-67ed963d59fa tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1727 microversion: 2.1 time: 0.154964 Oct 05 03:38:03.303920 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3666/7345] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:03 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:04.326618 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3eef9bd5-b0b5-4dca-8bf6-ac4d0aace1fe tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:04.327272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3eef9bd5-b0b5-4dca-8bf6-ac4d0aace1fe tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:04.330226 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=31 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:38:04.335549 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3eef9bd5-b0b5-4dca-8bf6-ac4d0aace1fe tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:04.336038 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3eef9bd5-b0b5-4dca-8bf6-ac4d0aace1fe tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:04.336477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3eef9bd5-b0b5-4dca-8bf6-ac4d0aace1fe tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:04.337199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3eef9bd5-b0b5-4dca-8bf6-ac4d0aace1fe tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:04.337658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3eef9bd5-b0b5-4dca-8bf6-ac4d0aace1fe tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:04.338084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3eef9bd5-b0b5-4dca-8bf6-ac4d0aace1fe tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:04.340829 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=89 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:38:04.471255 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3eef9bd5-b0b5-4dca-8bf6-ac4d0aace1fe tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:04.479770 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3eef9bd5-b0b5-4dca-8bf6-ac4d0aace1fe tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1727 microversion: 2.1 time: 0.157058 Oct 05 03:38:04.480343 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3680/7346] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:04 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:05.504175 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-50ea8d22-2276-42d1-9c25-c75e08a1c3b3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:05.504818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-50ea8d22-2276-42d1-9c25-c75e08a1c3b3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:05.511950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-50ea8d22-2276-42d1-9c25-c75e08a1c3b3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:05.512449 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-50ea8d22-2276-42d1-9c25-c75e08a1c3b3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:05.512927 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-50ea8d22-2276-42d1-9c25-c75e08a1c3b3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:05.513627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-50ea8d22-2276-42d1-9c25-c75e08a1c3b3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:05.514103 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-50ea8d22-2276-42d1-9c25-c75e08a1c3b3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:05.514544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-50ea8d22-2276-42d1-9c25-c75e08a1c3b3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:05.653136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-50ea8d22-2276-42d1-9c25-c75e08a1c3b3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:05.661659 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-50ea8d22-2276-42d1-9c25-c75e08a1c3b3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1727 microversion: 2.1 time: 0.162323 Oct 05 03:38:05.662453 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3667/7347] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:05 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:06.685404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7f051fd0-90df-4b75-a1e3-998fc870845d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:06.686020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7f051fd0-90df-4b75-a1e3-998fc870845d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:06.693157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f051fd0-90df-4b75-a1e3-998fc870845d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:06.693639 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f051fd0-90df-4b75-a1e3-998fc870845d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:06.694075 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f051fd0-90df-4b75-a1e3-998fc870845d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:06.694757 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f051fd0-90df-4b75-a1e3-998fc870845d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:06.695215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f051fd0-90df-4b75-a1e3-998fc870845d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:06.695637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7f051fd0-90df-4b75-a1e3-998fc870845d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:06.825952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7f051fd0-90df-4b75-a1e3-998fc870845d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:06.835419 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7f051fd0-90df-4b75-a1e3-998fc870845d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1727 microversion: 2.1 time: 0.153866 Oct 05 03:38:06.836005 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3681/7348] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:06 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:07.859669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-873309ed-4f1c-4885-ab31-aad9e1d0bebf tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:07.860293 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-873309ed-4f1c-4885-ab31-aad9e1d0bebf tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:07.867010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-873309ed-4f1c-4885-ab31-aad9e1d0bebf tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:07.867502 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-873309ed-4f1c-4885-ab31-aad9e1d0bebf tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:07.867946 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-873309ed-4f1c-4885-ab31-aad9e1d0bebf tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:07.868638 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-873309ed-4f1c-4885-ab31-aad9e1d0bebf tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:07.869164 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-873309ed-4f1c-4885-ab31-aad9e1d0bebf tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:07.869598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-873309ed-4f1c-4885-ab31-aad9e1d0bebf tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:08.012052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-873309ed-4f1c-4885-ab31-aad9e1d0bebf tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:08.020702 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-873309ed-4f1c-4885-ab31-aad9e1d0bebf tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1727 microversion: 2.1 time: 0.165059 Oct 05 03:38:08.021305 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3668/7349] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:07 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:09.043947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a3fc12bc-d50c-4e39-ada0-5ba7fb62a512 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:09.044677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a3fc12bc-d50c-4e39-ada0-5ba7fb62a512 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:09.050828 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3fc12bc-d50c-4e39-ada0-5ba7fb62a512 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:09.051413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3fc12bc-d50c-4e39-ada0-5ba7fb62a512 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:09.051859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3fc12bc-d50c-4e39-ada0-5ba7fb62a512 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:09.052553 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3fc12bc-d50c-4e39-ada0-5ba7fb62a512 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:09.053048 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3fc12bc-d50c-4e39-ada0-5ba7fb62a512 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:09.053483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a3fc12bc-d50c-4e39-ada0-5ba7fb62a512 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:09.190922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a3fc12bc-d50c-4e39-ada0-5ba7fb62a512 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:09.199173 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a3fc12bc-d50c-4e39-ada0-5ba7fb62a512 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1724 microversion: 2.1 time: 0.159506 Oct 05 03:38:09.199758 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3682/7350] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:09 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:09.222557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3d8b47a0-26ca-49da-b356-473830ad0c8c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:38:09.223111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3d8b47a0-26ca-49da-b356-473830ad0c8c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:09.230177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d8b47a0-26ca-49da-b356-473830ad0c8c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:09.230676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d8b47a0-26ca-49da-b356-473830ad0c8c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:09.231123 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d8b47a0-26ca-49da-b356-473830ad0c8c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:09.231814 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d8b47a0-26ca-49da-b356-473830ad0c8c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:09.232279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d8b47a0-26ca-49da-b356-473830ad0c8c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:09.232712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d8b47a0-26ca-49da-b356-473830ad0c8c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:09.271409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d8b47a0-26ca-49da-b356-473830ad0c8c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:09.271803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d8b47a0-26ca-49da-b356-473830ad0c8c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:09.272279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d8b47a0-26ca-49da-b356-473830ad0c8c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:09.273028 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d8b47a0-26ca-49da-b356-473830ad0c8c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:09.273495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d8b47a0-26ca-49da-b356-473830ad0c8c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:09.273927 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d8b47a0-26ca-49da-b356-473830ad0c8c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:09.293693 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-3d8b47a0-26ca-49da-b356-473830ad0c8c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Getting quotas for project cb907a92ab7949ebb3cb2e3b5d372ece. Resources: {'cores', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:38:09.298744 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-3d8b47a0-26ca-49da-b356-473830ad0c8c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Getting quotas for user 64375d765c0949dbb75c91906f8bca3c and project cb907a92ab7949ebb3cb2e3b5d372ece. Resources: {'cores', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:38:09.399493 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3d8b47a0-26ca-49da-b356-473830ad0c8c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "POST /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638/action" status: 202 len: 0 microversion: 2.1 time: 0.180767 Oct 05 03:38:09.401070 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3669/7351] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:38:09 2022] POST /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:38:09.408534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4f67b505-057a-4577-b9eb-eeb11b408ece tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:09.409288 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4f67b505-057a-4577-b9eb-eeb11b408ece tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:09.415453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f67b505-057a-4577-b9eb-eeb11b408ece tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:09.415943 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f67b505-057a-4577-b9eb-eeb11b408ece tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:09.416378 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f67b505-057a-4577-b9eb-eeb11b408ece tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:09.417146 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f67b505-057a-4577-b9eb-eeb11b408ece tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:09.417664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f67b505-057a-4577-b9eb-eeb11b408ece tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:09.418089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f67b505-057a-4577-b9eb-eeb11b408ece tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:09.622276 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4f67b505-057a-4577-b9eb-eeb11b408ece tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:09.631796 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4f67b505-057a-4577-b9eb-eeb11b408ece tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1723 microversion: 2.1 time: 0.227252 Oct 05 03:38:09.632413 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3683/7352] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:09 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:09.891404 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-0f13ce26-74e6-4dfb-8382-3ae571e244ef req-78b90a63-6e2a-490c-bab0-8c184dc35ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06de9057-ed46-4d2d-bdce-c4f61c25c638", "name": "network-vif-plugged", "status": "completed", "tag": "f093399c-5158-4c33-8e5d-f2171bf4eeb7"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:38:09.901580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-0f13ce26-74e6-4dfb-8382-3ae571e244ef req-78b90a63-6e2a-490c-bab0-8c184dc35ab2 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:09.902180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-0f13ce26-74e6-4dfb-8382-3ae571e244ef req-78b90a63-6e2a-490c-bab0-8c184dc35ab2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:09.902719 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-0f13ce26-74e6-4dfb-8382-3ae571e244ef req-78b90a63-6e2a-490c-bab0-8c184dc35ab2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:09.916414 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-0f13ce26-74e6-4dfb-8382-3ae571e244ef req-78b90a63-6e2a-490c-bab0-8c184dc35ab2 service nova] Creating event network-vif-plugged:f093399c-5158-4c33-8e5d-f2171bf4eeb7 for instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 on n-h1-858272-3 Oct 05 03:38:09.922540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [req-0f13ce26-74e6-4dfb-8382-3ae571e244ef req-78b90a63-6e2a-490c-bab0-8c184dc35ab2 service nova] Instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 03:38:09.933425 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-0f13ce26-74e6-4dfb-8382-3ae571e244ef req-78b90a63-6e2a-490c-bab0-8c184dc35ab2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098463 Oct 05 03:38:09.934118 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3670/7353] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:38:10.654983 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-dfc67abb-684a-469a-9552-0cb4a428e9b4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:10.656575 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-dfc67abb-684a-469a-9552-0cb4a428e9b4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:10.663260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dfc67abb-684a-469a-9552-0cb4a428e9b4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:10.663747 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dfc67abb-684a-469a-9552-0cb4a428e9b4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:10.664176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dfc67abb-684a-469a-9552-0cb4a428e9b4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:10.664869 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dfc67abb-684a-469a-9552-0cb4a428e9b4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:10.665338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dfc67abb-684a-469a-9552-0cb4a428e9b4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:10.666063 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-dfc67abb-684a-469a-9552-0cb4a428e9b4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:10.798917 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-dfc67abb-684a-469a-9552-0cb4a428e9b4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:10.807123 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-dfc67abb-684a-469a-9552-0cb4a428e9b4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1723 microversion: 2.1 time: 0.156190 Oct 05 03:38:10.807692 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3684/7354] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:10 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:11.833959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6b8cb66f-8190-469b-92db-18453561cdfd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:11.834717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6b8cb66f-8190-469b-92db-18453561cdfd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:11.841192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b8cb66f-8190-469b-92db-18453561cdfd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:11.841643 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b8cb66f-8190-469b-92db-18453561cdfd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:11.842477 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b8cb66f-8190-469b-92db-18453561cdfd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:11.842797 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b8cb66f-8190-469b-92db-18453561cdfd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:11.843273 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b8cb66f-8190-469b-92db-18453561cdfd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:11.843718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6b8cb66f-8190-469b-92db-18453561cdfd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:11.982309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6b8cb66f-8190-469b-92db-18453561cdfd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:11.990690 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6b8cb66f-8190-469b-92db-18453561cdfd tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1723 microversion: 2.1 time: 0.163503 Oct 05 03:38:11.991282 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3671/7355] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:11 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:13.014187 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0e4fd7c1-d68e-4d5c-9b29-f37fe590f030 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:13.014741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0e4fd7c1-d68e-4d5c-9b29-f37fe590f030 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:13.022339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e4fd7c1-d68e-4d5c-9b29-f37fe590f030 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:13.022827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e4fd7c1-d68e-4d5c-9b29-f37fe590f030 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:13.023267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e4fd7c1-d68e-4d5c-9b29-f37fe590f030 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:13.023965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e4fd7c1-d68e-4d5c-9b29-f37fe590f030 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:13.024422 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e4fd7c1-d68e-4d5c-9b29-f37fe590f030 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:13.024849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e4fd7c1-d68e-4d5c-9b29-f37fe590f030 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:13.156231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0e4fd7c1-d68e-4d5c-9b29-f37fe590f030 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:13.165113 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0e4fd7c1-d68e-4d5c-9b29-f37fe590f030 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1723 microversion: 2.1 time: 0.154952 Oct 05 03:38:13.165684 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3685/7356] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:13 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:38:14.187465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fb089c69-96bc-4510-b09c-5cfcbcf1d94d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:14.188111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fb089c69-96bc-4510-b09c-5cfcbcf1d94d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:14.194964 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb089c69-96bc-4510-b09c-5cfcbcf1d94d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:14.195473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb089c69-96bc-4510-b09c-5cfcbcf1d94d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:14.195929 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb089c69-96bc-4510-b09c-5cfcbcf1d94d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:14.196722 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb089c69-96bc-4510-b09c-5cfcbcf1d94d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:14.197137 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb089c69-96bc-4510-b09c-5cfcbcf1d94d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:14.197585 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fb089c69-96bc-4510-b09c-5cfcbcf1d94d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:14.363108 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fb089c69-96bc-4510-b09c-5cfcbcf1d94d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:14.371297 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fb089c69-96bc-4510-b09c-5cfcbcf1d94d tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1723 microversion: 2.1 time: 0.187686 Oct 05 03:38:14.371872 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3672/7357] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:14 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:14.728341 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-4c0ea2d7-c853-4339-a83c-a5b5416efa0a req-ceaa7694-271c-4cf7-a1d8-cc404cbd97d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06de9057-ed46-4d2d-bdce-c4f61c25c638", "name": "network-vif-unplugged", "status": "completed", "tag": "f093399c-5158-4c33-8e5d-f2171bf4eeb7"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:38:14.739345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4c0ea2d7-c853-4339-a83c-a5b5416efa0a req-ceaa7694-271c-4cf7-a1d8-cc404cbd97d2 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:14.740003 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4c0ea2d7-c853-4339-a83c-a5b5416efa0a req-ceaa7694-271c-4cf7-a1d8-cc404cbd97d2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:14.740516 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4c0ea2d7-c853-4339-a83c-a5b5416efa0a req-ceaa7694-271c-4cf7-a1d8-cc404cbd97d2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:14.752928 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-4c0ea2d7-c853-4339-a83c-a5b5416efa0a req-ceaa7694-271c-4cf7-a1d8-cc404cbd97d2 service nova] Creating event network-vif-unplugged:f093399c-5158-4c33-8e5d-f2171bf4eeb7 for instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 on n-h2-858272-3 Oct 05 03:38:14.758418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [req-4c0ea2d7-c853-4339-a83c-a5b5416efa0a req-ceaa7694-271c-4cf7-a1d8-cc404cbd97d2 service nova] Instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122319) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 03:38:14.770147 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-4c0ea2d7-c853-4339-a83c-a5b5416efa0a req-ceaa7694-271c-4cf7-a1d8-cc404cbd97d2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045949 Oct 05 03:38:14.770762 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3686/7358] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:38:15.395200 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6606b2fc-e1cb-45dd-a085-468d17e2496c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:15.395833 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6606b2fc-e1cb-45dd-a085-468d17e2496c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:15.402660 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6606b2fc-e1cb-45dd-a085-468d17e2496c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:15.403184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6606b2fc-e1cb-45dd-a085-468d17e2496c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:15.403628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6606b2fc-e1cb-45dd-a085-468d17e2496c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:15.404338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6606b2fc-e1cb-45dd-a085-468d17e2496c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:15.404802 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6606b2fc-e1cb-45dd-a085-468d17e2496c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:15.405269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6606b2fc-e1cb-45dd-a085-468d17e2496c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:15.626618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6606b2fc-e1cb-45dd-a085-468d17e2496c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:15.634948 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6606b2fc-e1cb-45dd-a085-468d17e2496c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1723 microversion: 2.1 time: 0.243842 Oct 05 03:38:15.635536 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3673/7359] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:15 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:16.659962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ff0f5764-15d6-461f-b515-ca5653e4040a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:16.661375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ff0f5764-15d6-461f-b515-ca5653e4040a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:16.668700 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff0f5764-15d6-461f-b515-ca5653e4040a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:16.669223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff0f5764-15d6-461f-b515-ca5653e4040a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:16.669855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff0f5764-15d6-461f-b515-ca5653e4040a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:16.670566 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff0f5764-15d6-461f-b515-ca5653e4040a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:16.671021 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff0f5764-15d6-461f-b515-ca5653e4040a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:16.671444 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff0f5764-15d6-461f-b515-ca5653e4040a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:16.804219 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ff0f5764-15d6-461f-b515-ca5653e4040a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:16.811548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-070988b5-fe08-418a-a097-7676d330a187 req-d15e8474-ecec-4da5-bad1-5de13d97bc62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06de9057-ed46-4d2d-bdce-c4f61c25c638", "tag": "f093399c-5158-4c33-8e5d-f2171bf4eeb7"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:38:16.813628 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ff0f5764-15d6-461f-b515-ca5653e4040a tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1723 microversion: 2.1 time: 0.158221 Oct 05 03:38:16.814433 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3687/7360] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:16 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:16.822414 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-070988b5-fe08-418a-a097-7676d330a187 req-d15e8474-ecec-4da5-bad1-5de13d97bc62 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:16.823026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-070988b5-fe08-418a-a097-7676d330a187 req-d15e8474-ecec-4da5-bad1-5de13d97bc62 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:16.823678 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-070988b5-fe08-418a-a097-7676d330a187 req-d15e8474-ecec-4da5-bad1-5de13d97bc62 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:16.836312 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-070988b5-fe08-418a-a097-7676d330a187 req-d15e8474-ecec-4da5-bad1-5de13d97bc62 service nova] Creating event network-changed:f093399c-5158-4c33-8e5d-f2171bf4eeb7 for instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 on n-h2-858272-3 Oct 05 03:38:16.841756 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [req-070988b5-fe08-418a-a097-7676d330a187 req-d15e8474-ecec-4da5-bad1-5de13d97bc62 service nova] Instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 03:38:16.855372 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-070988b5-fe08-418a-a097-7676d330a187 req-d15e8474-ecec-4da5-bad1-5de13d97bc62 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047455 Oct 05 03:38:16.856331 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3674/7361] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:38:17.839683 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-005605ca-1ebe-4d6b-9980-66f19989676c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:17.840219 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-005605ca-1ebe-4d6b-9980-66f19989676c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:17.848494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-005605ca-1ebe-4d6b-9980-66f19989676c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:17.849017 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-005605ca-1ebe-4d6b-9980-66f19989676c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:17.849660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-005605ca-1ebe-4d6b-9980-66f19989676c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:17.850560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-005605ca-1ebe-4d6b-9980-66f19989676c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:17.851033 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-005605ca-1ebe-4d6b-9980-66f19989676c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:17.851709 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-005605ca-1ebe-4d6b-9980-66f19989676c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:18.163103 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-005605ca-1ebe-4d6b-9980-66f19989676c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:18.171972 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-005605ca-1ebe-4d6b-9980-66f19989676c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1723 microversion: 2.1 time: 0.336771 Oct 05 03:38:18.172640 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3688/7362] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:17 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1723 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:19.197309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3150d881-3923-499b-99ab-001dc2375d1e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:19.197963 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3150d881-3923-499b-99ab-001dc2375d1e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:19.204991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3150d881-3923-499b-99ab-001dc2375d1e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:19.205441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3150d881-3923-499b-99ab-001dc2375d1e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:19.205892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3150d881-3923-499b-99ab-001dc2375d1e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:19.206597 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3150d881-3923-499b-99ab-001dc2375d1e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:19.207068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3150d881-3923-499b-99ab-001dc2375d1e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:19.207511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3150d881-3923-499b-99ab-001dc2375d1e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:19.284729 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:38:19.350486 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3150d881-3923-499b-99ab-001dc2375d1e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:19.359034 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3150d881-3923-499b-99ab-001dc2375d1e tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1723 microversion: 2.1 time: 0.167149 Oct 05 03:38:19.360131 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3675/7363] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:19 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:20.383549 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0a26d57a-5af6-4b7b-ba7e-1036ad9e2031 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:20.384167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0a26d57a-5af6-4b7b-ba7e-1036ad9e2031 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:20.391727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a26d57a-5af6-4b7b-ba7e-1036ad9e2031 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:20.392220 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a26d57a-5af6-4b7b-ba7e-1036ad9e2031 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:20.392657 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a26d57a-5af6-4b7b-ba7e-1036ad9e2031 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:20.393397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a26d57a-5af6-4b7b-ba7e-1036ad9e2031 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:20.393850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a26d57a-5af6-4b7b-ba7e-1036ad9e2031 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:20.394272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0a26d57a-5af6-4b7b-ba7e-1036ad9e2031 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:20.536275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0a26d57a-5af6-4b7b-ba7e-1036ad9e2031 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:20.544878 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0a26d57a-5af6-4b7b-ba7e-1036ad9e2031 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1723 microversion: 2.1 time: 0.165270 Oct 05 03:38:20.545492 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3689/7364] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:20 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:21.569966 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-572b6929-05f2-482c-92f9-a2c0e99a8c48 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:21.570634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-572b6929-05f2-482c-92f9-a2c0e99a8c48 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:21.577386 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-572b6929-05f2-482c-92f9-a2c0e99a8c48 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:21.577881 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-572b6929-05f2-482c-92f9-a2c0e99a8c48 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:21.578451 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-572b6929-05f2-482c-92f9-a2c0e99a8c48 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:21.579220 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-572b6929-05f2-482c-92f9-a2c0e99a8c48 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:21.579687 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-572b6929-05f2-482c-92f9-a2c0e99a8c48 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:21.580123 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-572b6929-05f2-482c-92f9-a2c0e99a8c48 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:21.710069 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-572b6929-05f2-482c-92f9-a2c0e99a8c48 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:21.718305 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-572b6929-05f2-482c-92f9-a2c0e99a8c48 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1723 microversion: 2.1 time: 0.152390 Oct 05 03:38:21.719033 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3676/7365] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:21 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:22.741571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b1bd6fe9-7905-48aa-9783-6f7e191d9919 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:22.742186 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b1bd6fe9-7905-48aa-9783-6f7e191d9919 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:22.749017 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b1bd6fe9-7905-48aa-9783-6f7e191d9919 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:22.749498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b1bd6fe9-7905-48aa-9783-6f7e191d9919 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:22.749950 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b1bd6fe9-7905-48aa-9783-6f7e191d9919 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:22.750636 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b1bd6fe9-7905-48aa-9783-6f7e191d9919 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:22.751085 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b1bd6fe9-7905-48aa-9783-6f7e191d9919 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:22.751505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b1bd6fe9-7905-48aa-9783-6f7e191d9919 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:22.885706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b1bd6fe9-7905-48aa-9783-6f7e191d9919 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:22.894851 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b1bd6fe9-7905-48aa-9783-6f7e191d9919 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1723 microversion: 2.1 time: 0.157149 Oct 05 03:38:22.895738 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3690/7366] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:22 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:23.919764 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fd67d1e1-9a5c-4f44-aba5-d8428766abf5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:23.920301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fd67d1e1-9a5c-4f44-aba5-d8428766abf5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:23.927610 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fd67d1e1-9a5c-4f44-aba5-d8428766abf5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:23.928161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fd67d1e1-9a5c-4f44-aba5-d8428766abf5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:23.928619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fd67d1e1-9a5c-4f44-aba5-d8428766abf5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:23.929365 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fd67d1e1-9a5c-4f44-aba5-d8428766abf5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:23.929844 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fd67d1e1-9a5c-4f44-aba5-d8428766abf5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:23.930292 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fd67d1e1-9a5c-4f44-aba5-d8428766abf5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:24.060244 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fd67d1e1-9a5c-4f44-aba5-d8428766abf5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:24.068774 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fd67d1e1-9a5c-4f44-aba5-d8428766abf5 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1723 microversion: 2.1 time: 0.153009 Oct 05 03:38:24.069387 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3677/7367] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:23 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:25.092306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1966cb5c-b761-4c33-b82d-2496211abd1f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:25.092938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1966cb5c-b761-4c33-b82d-2496211abd1f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:25.100220 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1966cb5c-b761-4c33-b82d-2496211abd1f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:25.100703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1966cb5c-b761-4c33-b82d-2496211abd1f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:25.101169 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1966cb5c-b761-4c33-b82d-2496211abd1f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:25.102107 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1966cb5c-b761-4c33-b82d-2496211abd1f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:25.102581 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1966cb5c-b761-4c33-b82d-2496211abd1f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:25.103003 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1966cb5c-b761-4c33-b82d-2496211abd1f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:25.240706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1966cb5c-b761-4c33-b82d-2496211abd1f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:25.249040 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1966cb5c-b761-4c33-b82d-2496211abd1f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1723 microversion: 2.1 time: 0.160600 Oct 05 03:38:25.249658 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3691/7368] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:25 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:26.272294 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1ef29b1c-2279-41ae-a16b-290d28448176 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:26.272943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1ef29b1c-2279-41ae-a16b-290d28448176 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:26.279914 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1ef29b1c-2279-41ae-a16b-290d28448176 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:26.280415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1ef29b1c-2279-41ae-a16b-290d28448176 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:26.281716 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1ef29b1c-2279-41ae-a16b-290d28448176 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:26.282498 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1ef29b1c-2279-41ae-a16b-290d28448176 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:26.282955 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1ef29b1c-2279-41ae-a16b-290d28448176 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:26.283431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1ef29b1c-2279-41ae-a16b-290d28448176 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:26.410364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1ef29b1c-2279-41ae-a16b-290d28448176 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:26.418717 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1ef29b1c-2279-41ae-a16b-290d28448176 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1723 microversion: 2.1 time: 0.150359 Oct 05 03:38:26.419293 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3678/7369] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:26 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:27.496488 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6b2135d5-1138-4de8-b58f-37106d0a11d4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:27.497128 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6b2135d5-1138-4de8-b58f-37106d0a11d4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:27.504360 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b2135d5-1138-4de8-b58f-37106d0a11d4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:27.504842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b2135d5-1138-4de8-b58f-37106d0a11d4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:27.505304 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b2135d5-1138-4de8-b58f-37106d0a11d4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:27.506006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b2135d5-1138-4de8-b58f-37106d0a11d4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:27.506458 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b2135d5-1138-4de8-b58f-37106d0a11d4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:27.506879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b2135d5-1138-4de8-b58f-37106d0a11d4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:27.635788 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6b2135d5-1138-4de8-b58f-37106d0a11d4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:27.644824 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6b2135d5-1138-4de8-b58f-37106d0a11d4 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1723 microversion: 2.1 time: 0.152286 Oct 05 03:38:27.645435 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3692/7370] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:27 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:28.669511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f4904a41-9e93-4825-ba4c-13ce464bf579 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:28.670438 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f4904a41-9e93-4825-ba4c-13ce464bf579 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:28.678428 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4904a41-9e93-4825-ba4c-13ce464bf579 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:28.678934 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4904a41-9e93-4825-ba4c-13ce464bf579 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:28.679387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4904a41-9e93-4825-ba4c-13ce464bf579 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:28.680100 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4904a41-9e93-4825-ba4c-13ce464bf579 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:28.680573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4904a41-9e93-4825-ba4c-13ce464bf579 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:28.681043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f4904a41-9e93-4825-ba4c-13ce464bf579 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:28.831144 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f4904a41-9e93-4825-ba4c-13ce464bf579 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:28.839435 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f4904a41-9e93-4825-ba4c-13ce464bf579 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1723 microversion: 2.1 time: 0.173872 Oct 05 03:38:28.840009 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3679/7371] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:28 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:29.864178 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-12bca5fa-5286-4886-a691-2a4e32492c21 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:29.864845 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-12bca5fa-5286-4886-a691-2a4e32492c21 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:29.872886 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12bca5fa-5286-4886-a691-2a4e32492c21 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:29.873414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12bca5fa-5286-4886-a691-2a4e32492c21 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:29.873858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12bca5fa-5286-4886-a691-2a4e32492c21 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:29.875217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12bca5fa-5286-4886-a691-2a4e32492c21 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:29.875733 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12bca5fa-5286-4886-a691-2a4e32492c21 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:29.876190 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12bca5fa-5286-4886-a691-2a4e32492c21 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:30.007078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-12bca5fa-5286-4886-a691-2a4e32492c21 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:30.015414 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-12bca5fa-5286-4886-a691-2a4e32492c21 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1716 microversion: 2.1 time: 0.155133 Oct 05 03:38:30.015989 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3693/7372] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:29 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:30.037775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-28405fff-5bda-4127-800a-c8abe831468f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:30.038411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-28405fff-5bda-4127-800a-c8abe831468f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:30.045349 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28405fff-5bda-4127-800a-c8abe831468f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:30.045854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28405fff-5bda-4127-800a-c8abe831468f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:30.046311 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28405fff-5bda-4127-800a-c8abe831468f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:30.047516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28405fff-5bda-4127-800a-c8abe831468f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:30.047988 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28405fff-5bda-4127-800a-c8abe831468f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:30.048431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-28405fff-5bda-4127-800a-c8abe831468f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:30.063711 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:38:30.182472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-28405fff-5bda-4127-800a-c8abe831468f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:30.190832 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-28405fff-5bda-4127-800a-c8abe831468f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1716 microversion: 2.1 time: 0.156918 Oct 05 03:38:30.191413 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3680/7373] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:30 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:30.213707 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2b04151a-e9c0-4df2-b287-139ecadd729f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:30.214247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2b04151a-e9c0-4df2-b287-139ecadd729f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:30.221155 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b04151a-e9c0-4df2-b287-139ecadd729f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:30.221636 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b04151a-e9c0-4df2-b287-139ecadd729f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:30.222069 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b04151a-e9c0-4df2-b287-139ecadd729f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:30.222754 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b04151a-e9c0-4df2-b287-139ecadd729f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:30.223205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b04151a-e9c0-4df2-b287-139ecadd729f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:30.223624 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b04151a-e9c0-4df2-b287-139ecadd729f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:30.352364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2b04151a-e9c0-4df2-b287-139ecadd729f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:30.361691 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2b04151a-e9c0-4df2-b287-139ecadd729f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1716 microversion: 2.1 time: 0.152532 Oct 05 03:38:30.362283 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3694/7374] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:30 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1716 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:30.384853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3f462e09-4437-40d2-8a71-cb5e99bd20ed tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:30.385402 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3f462e09-4437-40d2-8a71-cb5e99bd20ed tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:30.391854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f462e09-4437-40d2-8a71-cb5e99bd20ed tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:30.392344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f462e09-4437-40d2-8a71-cb5e99bd20ed tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:30.392786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f462e09-4437-40d2-8a71-cb5e99bd20ed tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:30.393506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f462e09-4437-40d2-8a71-cb5e99bd20ed tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:30.393973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f462e09-4437-40d2-8a71-cb5e99bd20ed tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:30.394415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3f462e09-4437-40d2-8a71-cb5e99bd20ed tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:30.422964 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3f462e09-4437-40d2-8a71-cb5e99bd20ed tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:38:30.497535 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3f462e09-4437-40d2-8a71-cb5e99bd20ed tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "DELETE /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 204 len: 0 microversion: 2.1 time: 0.116099 Oct 05 03:38:30.498063 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3681/7375] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:38:30 2022] DELETE /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:38:30.508037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-26373b7f-23eb-45c1-a634-18659364582c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:30.508661 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-26373b7f-23eb-45c1-a634-18659364582c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:30.514720 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26373b7f-23eb-45c1-a634-18659364582c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:30.516532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26373b7f-23eb-45c1-a634-18659364582c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:30.517016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26373b7f-23eb-45c1-a634-18659364582c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:30.517717 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26373b7f-23eb-45c1-a634-18659364582c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:30.518186 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26373b7f-23eb-45c1-a634-18659364582c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:30.518617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26373b7f-23eb-45c1-a634-18659364582c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:30.649619 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-26373b7f-23eb-45c1-a634-18659364582c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:30.658633 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-26373b7f-23eb-45c1-a634-18659364582c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1722 microversion: 2.1 time: 0.154764 Oct 05 03:38:30.659222 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3695/7376] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:30 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:31.427613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-3bb06b1d-5ed8-486d-81b7-0f709e32ff41 req-dcb56336-4789-4741-9ed6-c37a78d0f7af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06de9057-ed46-4d2d-bdce-c4f61c25c638", "name": "network-vif-plugged", "status": "completed", "tag": "f093399c-5158-4c33-8e5d-f2171bf4eeb7"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:38:31.438617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3bb06b1d-5ed8-486d-81b7-0f709e32ff41 req-dcb56336-4789-4741-9ed6-c37a78d0f7af service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:31.439125 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3bb06b1d-5ed8-486d-81b7-0f709e32ff41 req-dcb56336-4789-4741-9ed6-c37a78d0f7af service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:31.439576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3bb06b1d-5ed8-486d-81b7-0f709e32ff41 req-dcb56336-4789-4741-9ed6-c37a78d0f7af service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:31.451002 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-3bb06b1d-5ed8-486d-81b7-0f709e32ff41 req-dcb56336-4789-4741-9ed6-c37a78d0f7af service nova] Creating event network-vif-plugged:f093399c-5158-4c33-8e5d-f2171bf4eeb7 for instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 on n-h2-858272-3 Oct 05 03:38:31.456309 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-3bb06b1d-5ed8-486d-81b7-0f709e32ff41 req-dcb56336-4789-4741-9ed6-c37a78d0f7af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032876 Oct 05 03:38:31.456941 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3682/7377] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:38:31.682127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e3e3b3be-8124-458f-ad90-dc275c68bf41 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:31.683002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e3e3b3be-8124-458f-ad90-dc275c68bf41 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:31.691104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e3e3b3be-8124-458f-ad90-dc275c68bf41 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:31.691592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e3e3b3be-8124-458f-ad90-dc275c68bf41 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:31.692026 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e3e3b3be-8124-458f-ad90-dc275c68bf41 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:31.692719 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e3e3b3be-8124-458f-ad90-dc275c68bf41 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:31.693203 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e3e3b3be-8124-458f-ad90-dc275c68bf41 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:31.693627 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e3e3b3be-8124-458f-ad90-dc275c68bf41 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:31.825973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e3e3b3be-8124-458f-ad90-dc275c68bf41 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:31.835358 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e3e3b3be-8124-458f-ad90-dc275c68bf41 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1722 microversion: 2.1 time: 0.157119 Oct 05 03:38:31.835934 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3696/7378] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:31 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:32.862994 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0da564f2-576b-4512-90d1-229229842086 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:32.863807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0da564f2-576b-4512-90d1-229229842086 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:32.870103 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0da564f2-576b-4512-90d1-229229842086 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:32.870603 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0da564f2-576b-4512-90d1-229229842086 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:32.871251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0da564f2-576b-4512-90d1-229229842086 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:32.871965 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0da564f2-576b-4512-90d1-229229842086 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:32.872444 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0da564f2-576b-4512-90d1-229229842086 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:32.872892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0da564f2-576b-4512-90d1-229229842086 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:32.978747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0da564f2-576b-4512-90d1-229229842086 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:32.987341 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0da564f2-576b-4512-90d1-229229842086 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1655 microversion: 2.1 time: 0.130795 Oct 05 03:38:32.987931 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3683/7379] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:32 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1655 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:33.208064 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-0ed43681-5da7-45d5-8bc5-0ee92060a01d req-f0581c3a-a714-4744-a117-02d5872e12aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06de9057-ed46-4d2d-bdce-c4f61c25c638", "name": "network-vif-deleted", "tag": "f093399c-5158-4c33-8e5d-f2171bf4eeb7"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:38:33.218204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-0ed43681-5da7-45d5-8bc5-0ee92060a01d req-f0581c3a-a714-4744-a117-02d5872e12aa service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:33.218690 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-0ed43681-5da7-45d5-8bc5-0ee92060a01d req-f0581c3a-a714-4744-a117-02d5872e12aa service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:33.219124 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-0ed43681-5da7-45d5-8bc5-0ee92060a01d req-f0581c3a-a714-4744-a117-02d5872e12aa service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:33.224032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=100 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:38:33.234231 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-0ed43681-5da7-45d5-8bc5-0ee92060a01d req-f0581c3a-a714-4744-a117-02d5872e12aa service nova] Creating event network-vif-deleted:f093399c-5158-4c33-8e5d-f2171bf4eeb7 for instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 on n-h2-858272-3 Oct 05 03:38:33.239255 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-0ed43681-5da7-45d5-8bc5-0ee92060a01d req-f0581c3a-a714-4744-a117-02d5872e12aa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034841 Oct 05 03:38:33.239941 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3697/7380] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:38:34.010334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6100c0d6-5767-4063-aa9f-66d507f0da7f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:34.011111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6100c0d6-5767-4063-aa9f-66d507f0da7f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:34.014143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:38:34.021766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6100c0d6-5767-4063-aa9f-66d507f0da7f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:34.022313 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6100c0d6-5767-4063-aa9f-66d507f0da7f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:34.022931 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6100c0d6-5767-4063-aa9f-66d507f0da7f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:34.023895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6100c0d6-5767-4063-aa9f-66d507f0da7f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:34.024375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6100c0d6-5767-4063-aa9f-66d507f0da7f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:34.024846 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6100c0d6-5767-4063-aa9f-66d507f0da7f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:34.102010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6100c0d6-5767-4063-aa9f-66d507f0da7f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:34.113214 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6100c0d6-5767-4063-aa9f-66d507f0da7f tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1369 microversion: 2.1 time: 0.106707 Oct 05 03:38:34.122457 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3684/7381] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:34 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:35.137322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3c5f19c6-5940-4740-bd43-45673b856837 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:35.138032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3c5f19c6-5940-4740-bd43-45673b856837 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:35.140011 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=36 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:38:35.146263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c5f19c6-5940-4740-bd43-45673b856837 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:35.146862 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c5f19c6-5940-4740-bd43-45673b856837 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:35.147369 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c5f19c6-5940-4740-bd43-45673b856837 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:35.148156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c5f19c6-5940-4740-bd43-45673b856837 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:35.148676 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c5f19c6-5940-4740-bd43-45673b856837 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:35.149202 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3c5f19c6-5940-4740-bd43-45673b856837 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:35.212688 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3c5f19c6-5940-4740-bd43-45673b856837 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:35.221644 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3c5f19c6-5940-4740-bd43-45673b856837 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1369 microversion: 2.1 time: 0.089690 Oct 05 03:38:35.222229 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3698/7382] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:35 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:36.245557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9f8b7e89-bdb8-495b-a8d1-cdd24ed1dcb3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:36.246192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9f8b7e89-bdb8-495b-a8d1-cdd24ed1dcb3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:36.253212 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9f8b7e89-bdb8-495b-a8d1-cdd24ed1dcb3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:36.253709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9f8b7e89-bdb8-495b-a8d1-cdd24ed1dcb3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:36.254168 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9f8b7e89-bdb8-495b-a8d1-cdd24ed1dcb3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:36.254911 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9f8b7e89-bdb8-495b-a8d1-cdd24ed1dcb3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:36.255457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9f8b7e89-bdb8-495b-a8d1-cdd24ed1dcb3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:36.256076 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9f8b7e89-bdb8-495b-a8d1-cdd24ed1dcb3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:36.325531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9f8b7e89-bdb8-495b-a8d1-cdd24ed1dcb3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:36.335682 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9f8b7e89-bdb8-495b-a8d1-cdd24ed1dcb3 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1369 microversion: 2.1 time: 0.093958 Oct 05 03:38:36.336288 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3685/7383] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:36 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:37.359592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-38b1697c-3c53-4310-b4f7-9ed2b38fb091 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:37.360233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-38b1697c-3c53-4310-b4f7-9ed2b38fb091 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:37.367242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-38b1697c-3c53-4310-b4f7-9ed2b38fb091 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:37.367734 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-38b1697c-3c53-4310-b4f7-9ed2b38fb091 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:37.368173 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-38b1697c-3c53-4310-b4f7-9ed2b38fb091 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:37.368869 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-38b1697c-3c53-4310-b4f7-9ed2b38fb091 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:37.369352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-38b1697c-3c53-4310-b4f7-9ed2b38fb091 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:37.369782 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-38b1697c-3c53-4310-b4f7-9ed2b38fb091 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:37.435177 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-38b1697c-3c53-4310-b4f7-9ed2b38fb091 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64375d765c0949dbb75c91906f8bca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:37.445878 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-38b1697c-3c53-4310-b4f7-9ed2b38fb091 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 200 len: 1369 microversion: 2.1 time: 0.090578 Oct 05 03:38:37.446584 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3699/7384] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:37 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:38.471491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a4711643-efbc-465a-8008-0a5633eecbb6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:38.472147 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a4711643-efbc-465a-8008-0a5633eecbb6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:38.479289 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a4711643-efbc-465a-8008-0a5633eecbb6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:38.479787 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a4711643-efbc-465a-8008-0a5633eecbb6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:38.480235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a4711643-efbc-465a-8008-0a5633eecbb6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:38.480952 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a4711643-efbc-465a-8008-0a5633eecbb6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:38.481419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a4711643-efbc-465a-8008-0a5633eecbb6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:38.481880 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a4711643-efbc-465a-8008-0a5633eecbb6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:38.494987 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-a4711643-efbc-465a-8008-0a5633eecbb6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] HTTP exception thrown: Instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 could not be found. Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a4711643-efbc-465a-8008-0a5633eecbb6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Request method failure captured: Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 HTTP/1.1 Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPpOjo3UoOtQ-Bs93Auly_6sXh8lfDtgrSY0udxfQzVZtNtMSUx1jRG2ewnriCtcRUrnJaHmLaLcz0mVVG5b9vEZRuG06925WdPWiQLXMx8sJPVOF2G8G35VQEtfcoJQaOleL8MsseS-M06VqanojXWiUqJgAvvCm3KftD0h1N4k_LM Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: cb907a92ab7949ebb3cb2e3b5d372ece Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: cb907a92ab7949ebb3cb2e3b5d372ece Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServerActionsTestJSON-2031640985-project Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 64375d765c0949dbb75c91906f8bca3c Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServerActionsTestJSON-2031640985-project Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 could not be found. Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '06de9057-ed46-4d2d-bdce-c4f61c25c638'} Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 could not be found. Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 could not be found. Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:38:38.496636 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:38:38.502499 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:38:38.502499 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:38:38.502499 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:38:38.502499 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:38:38.502499 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:38:38.502499 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 could not be found. Oct 05 03:38:38.502499 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:38:38.502499 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a4711643-efbc-465a-8008-0a5633eecbb6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Returning 404 to user: Instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:38:38.502499 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a4711643-efbc-465a-8008-0a5633eecbb6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 404 len: 111 microversion: 2.1 time: 0.030548 Oct 05 03:38:38.502499 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3686/7385] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:38 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:38:38.559203 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2f37d724-7a29-499b-9b36-1cb4946b45f8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:38.561466 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2f37d724-7a29-499b-9b36-1cb4946b45f8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:38.568774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f37d724-7a29-499b-9b36-1cb4946b45f8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:38.569299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f37d724-7a29-499b-9b36-1cb4946b45f8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:38.569742 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f37d724-7a29-499b-9b36-1cb4946b45f8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:38.570438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f37d724-7a29-499b-9b36-1cb4946b45f8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:38.570898 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f37d724-7a29-499b-9b36-1cb4946b45f8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:38.571336 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f37d724-7a29-499b-9b36-1cb4946b45f8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:38.585492 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-2f37d724-7a29-499b-9b36-1cb4946b45f8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] HTTP exception thrown: Instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 could not be found. Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2f37d724-7a29-499b-9b36-1cb4946b45f8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Request method failure captured: Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638/os-volume_attachments HTTP/1.1 Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPpOjo3UoOtQ-Bs93Auly_6sXh8lfDtgrSY0udxfQzVZtNtMSUx1jRG2ewnriCtcRUrnJaHmLaLcz0mVVG5b9vEZRuG06925WdPWiQLXMx8sJPVOF2G8G35VQEtfcoJQaOleL8MsseS-M06VqanojXWiUqJgAvvCm3KftD0h1N4k_LM Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: cb907a92ab7949ebb3cb2e3b5d372ece Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: cb907a92ab7949ebb3cb2e3b5d372ece Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerActionsTestJSON-2031640985-project Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 64375d765c0949dbb75c91906f8bca3c Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerActionsTestJSON-2031640985-project Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 could not be found. Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'server_id': '06de9057-ed46-4d2d-bdce-c4f61c25c638'} Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 could not be found. Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:38:38.587199 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:38:38.591682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 could not be found. Oct 05 03:38:38.591682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:38:38.591682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:38:38.591682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:38:38.591682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:38:38.591682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:38:38.591682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:38:38.591682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:38:38.591682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:38:38.591682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 could not be found. Oct 05 03:38:38.591682 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:38:38.591682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2f37d724-7a29-499b-9b36-1cb4946b45f8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Returning 404 to user: Instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:38:38.591682 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2f37d724-7a29-499b-9b36-1cb4946b45f8 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033724 Oct 05 03:38:38.591682 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3700/7386] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:38:38 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:38:41.915942 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b32925e2-a232-4107-8325-84cf970cda1c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:41.916489 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b32925e2-a232-4107-8325-84cf970cda1c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:41.924169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b32925e2-a232-4107-8325-84cf970cda1c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:41.924671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b32925e2-a232-4107-8325-84cf970cda1c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:41.925146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b32925e2-a232-4107-8325-84cf970cda1c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:41.925848 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b32925e2-a232-4107-8325-84cf970cda1c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:41.926314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b32925e2-a232-4107-8325-84cf970cda1c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:41.926773 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b32925e2-a232-4107-8325-84cf970cda1c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:41.941243 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-b32925e2-a232-4107-8325-84cf970cda1c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] HTTP exception thrown: Instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 could not be found. Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b32925e2-a232-4107-8325-84cf970cda1c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Request method failure captured: Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 HTTP/1.1 Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPpOjo3UoOtQ-Bs93Auly_6sXh8lfDtgrSY0udxfQzVZtNtMSUx1jRG2ewnriCtcRUrnJaHmLaLcz0mVVG5b9vEZRuG06925WdPWiQLXMx8sJPVOF2G8G35VQEtfcoJQaOleL8MsseS-M06VqanojXWiUqJgAvvCm3KftD0h1N4k_LM Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: cb907a92ab7949ebb3cb2e3b5d372ece Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: cb907a92ab7949ebb3cb2e3b5d372ece Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServerActionsTestJSON-2031640985-project Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 64375d765c0949dbb75c91906f8bca3c Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServerActionsTestJSON-2031640985-project Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 could not be found. Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '06de9057-ed46-4d2d-bdce-c4f61c25c638'} Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 could not be found. Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:38:41.942816 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:38:41.947168 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 could not be found. Oct 05 03:38:41.947168 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:38:41.947168 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:38:41.947168 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:38:41.947168 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:38:41.947168 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:38:41.947168 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:38:41.947168 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:38:41.947168 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:38:41.947168 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 could not be found. Oct 05 03:38:41.947168 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:38:41.947168 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b32925e2-a232-4107-8325-84cf970cda1c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Returning 404 to user: Instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:38:41.947168 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b32925e2-a232-4107-8325-84cf970cda1c tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "DELETE /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 404 len: 111 microversion: 2.1 time: 0.032433 Oct 05 03:38:41.947168 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3687/7387] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:38:41 2022] DELETE /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:38:41.953067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d5c73049-3be0-4d2d-9770-33b1ca320d94 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:41.953693 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d5c73049-3be0-4d2d-9770-33b1ca320d94 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 06de9057-ed46-4d2d-bdce-c4f61c25c638] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:41.961040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5c73049-3be0-4d2d-9770-33b1ca320d94 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:41.961535 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5c73049-3be0-4d2d-9770-33b1ca320d94 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:41.961972 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5c73049-3be0-4d2d-9770-33b1ca320d94 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:41.962688 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5c73049-3be0-4d2d-9770-33b1ca320d94 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:41.963143 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5c73049-3be0-4d2d-9770-33b1ca320d94 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:41.963567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5c73049-3be0-4d2d-9770-33b1ca320d94 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:41.980163 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-d5c73049-3be0-4d2d-9770-33b1ca320d94 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] HTTP exception thrown: Instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 could not be found. Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d5c73049-3be0-4d2d-9770-33b1ca320d94 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Request method failure captured: Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 HTTP/1.1 Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPpOjo3UoOtQ-Bs93Auly_6sXh8lfDtgrSY0udxfQzVZtNtMSUx1jRG2ewnriCtcRUrnJaHmLaLcz0mVVG5b9vEZRuG06925WdPWiQLXMx8sJPVOF2G8G35VQEtfcoJQaOleL8MsseS-M06VqanojXWiUqJgAvvCm3KftD0h1N4k_LM Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: cb907a92ab7949ebb3cb2e3b5d372ece Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: cb907a92ab7949ebb3cb2e3b5d372ece Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerActionsTestJSON-2031640985-project Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 64375d765c0949dbb75c91906f8bca3c Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerActionsTestJSON-2031640985-project Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 could not be found. Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '06de9057-ed46-4d2d-bdce-c4f61c25c638'} Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 could not be found. Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 could not be found. Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:38:41.982275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:38:41.987591 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:38:41.987591 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:38:41.987591 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:38:41.987591 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:38:41.987591 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:38:41.987591 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 could not be found. Oct 05 03:38:41.987591 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:38:41.988907 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d5c73049-3be0-4d2d-9770-33b1ca320d94 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Returning 404 to user: Instance 06de9057-ed46-4d2d-bdce-c4f61c25c638 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:38:41.990361 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d5c73049-3be0-4d2d-9770-33b1ca320d94 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638" status: 404 len: 111 microversion: 2.1 time: 0.041537 Oct 05 03:38:41.991534 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3701/7388] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:41 2022] GET /compute/v2.1/servers/06de9057-ed46-4d2d-bdce-c4f61c25c638 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 03:38:42.000257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1bf71c4c-72cf-4c78-beef-fafb18c33a4b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:42.001017 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1bf71c4c-72cf-4c78-beef-fafb18c33a4b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:42.007620 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bf71c4c-72cf-4c78-beef-fafb18c33a4b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:42.008359 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bf71c4c-72cf-4c78-beef-fafb18c33a4b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:42.008969 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bf71c4c-72cf-4c78-beef-fafb18c33a4b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:42.009796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bf71c4c-72cf-4c78-beef-fafb18c33a4b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:42.010729 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bf71c4c-72cf-4c78-beef-fafb18c33a4b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:42.011272 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bf71c4c-72cf-4c78-beef-fafb18c33a4b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:42.027315 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-1bf71c4c-72cf-4c78-beef-fafb18c33a4b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] HTTP exception thrown: Instance e3fe481a-aa94-4784-9110-17b861d9478d could not be found. Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1bf71c4c-72cf-4c78-beef-fafb18c33a4b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Request method failure captured: Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d HTTP/1.1 Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPpOjo3UoOtQ-Bs93Auly_6sXh8lfDtgrSY0udxfQzVZtNtMSUx1jRG2ewnriCtcRUrnJaHmLaLcz0mVVG5b9vEZRuG06925WdPWiQLXMx8sJPVOF2G8G35VQEtfcoJQaOleL8MsseS-M06VqanojXWiUqJgAvvCm3KftD0h1N4k_LM Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: cb907a92ab7949ebb3cb2e3b5d372ece Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: cb907a92ab7949ebb3cb2e3b5d372ece Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServerActionsTestJSON-2031640985-project Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 64375d765c0949dbb75c91906f8bca3c Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServerActionsTestJSON-2031640985-project Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance e3fe481a-aa94-4784-9110-17b861d9478d could not be found. Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'e3fe481a-aa94-4784-9110-17b861d9478d'} Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3fe481a-aa94-4784-9110-17b861d9478d could not be found. Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:38:42.029103 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:38:42.033225 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3fe481a-aa94-4784-9110-17b861d9478d could not be found. Oct 05 03:38:42.033225 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:38:42.033225 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:38:42.033225 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:38:42.033225 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:38:42.033225 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:38:42.033225 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:38:42.033225 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:38:42.033225 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:38:42.033225 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3fe481a-aa94-4784-9110-17b861d9478d could not be found. Oct 05 03:38:42.033225 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:38:42.033225 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1bf71c4c-72cf-4c78-beef-fafb18c33a4b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Returning 404 to user: Instance e3fe481a-aa94-4784-9110-17b861d9478d could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:38:42.033225 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1bf71c4c-72cf-4c78-beef-fafb18c33a4b tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 404 len: 111 microversion: 2.1 time: 0.036827 Oct 05 03:38:42.036037 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3688/7389] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:38:41 2022] DELETE /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 03:38:42.042156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d4eef83a-5b36-4332-be5d-5874e79d03c6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:42.042771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d4eef83a-5b36-4332-be5d-5874e79d03c6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: e3fe481a-aa94-4784-9110-17b861d9478d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:42.049908 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4eef83a-5b36-4332-be5d-5874e79d03c6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:42.050397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4eef83a-5b36-4332-be5d-5874e79d03c6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:42.050832 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4eef83a-5b36-4332-be5d-5874e79d03c6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:42.051526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4eef83a-5b36-4332-be5d-5874e79d03c6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:42.051976 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4eef83a-5b36-4332-be5d-5874e79d03c6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:42.052401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4eef83a-5b36-4332-be5d-5874e79d03c6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:42.067310 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-d4eef83a-5b36-4332-be5d-5874e79d03c6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] HTTP exception thrown: Instance e3fe481a-aa94-4784-9110-17b861d9478d could not be found. Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d4eef83a-5b36-4332-be5d-5874e79d03c6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Request method failure captured: Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d HTTP/1.1 Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPpOjo3UoOtQ-Bs93Auly_6sXh8lfDtgrSY0udxfQzVZtNtMSUx1jRG2ewnriCtcRUrnJaHmLaLcz0mVVG5b9vEZRuG06925WdPWiQLXMx8sJPVOF2G8G35VQEtfcoJQaOleL8MsseS-M06VqanojXWiUqJgAvvCm3KftD0h1N4k_LM Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: cb907a92ab7949ebb3cb2e3b5d372ece Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: cb907a92ab7949ebb3cb2e3b5d372ece Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerActionsTestJSON-2031640985-project Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 64375d765c0949dbb75c91906f8bca3c Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerActionsTestJSON-2031640985-project Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance e3fe481a-aa94-4784-9110-17b861d9478d could not be found. Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'e3fe481a-aa94-4784-9110-17b861d9478d'} Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3fe481a-aa94-4784-9110-17b861d9478d could not be found. Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3fe481a-aa94-4784-9110-17b861d9478d could not be found. Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:38:42.068839 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:38:42.072746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:38:42.072746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:38:42.072746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:38:42.072746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:38:42.072746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:38:42.072746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3fe481a-aa94-4784-9110-17b861d9478d could not be found. Oct 05 03:38:42.072746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:38:42.072746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d4eef83a-5b36-4332-be5d-5874e79d03c6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Returning 404 to user: Instance e3fe481a-aa94-4784-9110-17b861d9478d could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:38:42.072746 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d4eef83a-5b36-4332-be5d-5874e79d03c6 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d" status: 404 len: 111 microversion: 2.1 time: 0.033239 Oct 05 03:38:42.072746 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3702/7390] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:42 2022] GET /compute/v2.1/servers/e3fe481a-aa94-4784-9110-17b861d9478d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 03:38:42.079145 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6e3b6000-b6b7-450c-bacb-29f952730d98 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:42.079740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6e3b6000-b6b7-450c-bacb-29f952730d98 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:42.086214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e3b6000-b6b7-450c-bacb-29f952730d98 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:42.086724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e3b6000-b6b7-450c-bacb-29f952730d98 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:42.087180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e3b6000-b6b7-450c-bacb-29f952730d98 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:42.088107 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e3b6000-b6b7-450c-bacb-29f952730d98 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:42.088748 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e3b6000-b6b7-450c-bacb-29f952730d98 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:42.089378 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e3b6000-b6b7-450c-bacb-29f952730d98 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:42.107170 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-6e3b6000-b6b7-450c-bacb-29f952730d98 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] HTTP exception thrown: Instance 086fbcfc-2a6b-458f-9520-eb3652662458 could not be found. Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6e3b6000-b6b7-450c-bacb-29f952730d98 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Request method failure captured: Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 HTTP/1.1 Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPpOjo3UoOtQ-Bs93Auly_6sXh8lfDtgrSY0udxfQzVZtNtMSUx1jRG2ewnriCtcRUrnJaHmLaLcz0mVVG5b9vEZRuG06925WdPWiQLXMx8sJPVOF2G8G35VQEtfcoJQaOleL8MsseS-M06VqanojXWiUqJgAvvCm3KftD0h1N4k_LM Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: cb907a92ab7949ebb3cb2e3b5d372ece Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: cb907a92ab7949ebb3cb2e3b5d372ece Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServerActionsTestJSON-2031640985-project Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 64375d765c0949dbb75c91906f8bca3c Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServerActionsTestJSON-2031640985-project Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 086fbcfc-2a6b-458f-9520-eb3652662458 could not be found. Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '086fbcfc-2a6b-458f-9520-eb3652662458'} Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 086fbcfc-2a6b-458f-9520-eb3652662458 could not be found. Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:38:42.109575 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:38:42.114415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 086fbcfc-2a6b-458f-9520-eb3652662458 could not be found. Oct 05 03:38:42.114415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:38:42.114415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:38:42.114415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:38:42.114415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:38:42.114415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:38:42.114415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:38:42.114415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:38:42.114415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:38:42.114415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 086fbcfc-2a6b-458f-9520-eb3652662458 could not be found. Oct 05 03:38:42.114415 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:38:42.114415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6e3b6000-b6b7-450c-bacb-29f952730d98 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Returning 404 to user: Instance 086fbcfc-2a6b-458f-9520-eb3652662458 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:38:42.114415 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6e3b6000-b6b7-450c-bacb-29f952730d98 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "DELETE /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 404 len: 111 microversion: 2.1 time: 0.035572 Oct 05 03:38:42.114415 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3689/7391] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:38:42 2022] DELETE /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:38:42.119416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f0128f4e-6c3d-4c97-bc5a-f8ffcba10d46 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:42.120034 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f0128f4e-6c3d-4c97-bc5a-f8ffcba10d46 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: 086fbcfc-2a6b-458f-9520-eb3652662458] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:42.127398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0128f4e-6c3d-4c97-bc5a-f8ffcba10d46 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:42.127894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0128f4e-6c3d-4c97-bc5a-f8ffcba10d46 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:42.128344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0128f4e-6c3d-4c97-bc5a-f8ffcba10d46 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:42.129083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0128f4e-6c3d-4c97-bc5a-f8ffcba10d46 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:42.129547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0128f4e-6c3d-4c97-bc5a-f8ffcba10d46 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:42.129980 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f0128f4e-6c3d-4c97-bc5a-f8ffcba10d46 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:42.144743 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-f0128f4e-6c3d-4c97-bc5a-f8ffcba10d46 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] HTTP exception thrown: Instance 086fbcfc-2a6b-458f-9520-eb3652662458 could not be found. Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f0128f4e-6c3d-4c97-bc5a-f8ffcba10d46 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Request method failure captured: Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 HTTP/1.1 Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPpOjo3UoOtQ-Bs93Auly_6sXh8lfDtgrSY0udxfQzVZtNtMSUx1jRG2ewnriCtcRUrnJaHmLaLcz0mVVG5b9vEZRuG06925WdPWiQLXMx8sJPVOF2G8G35VQEtfcoJQaOleL8MsseS-M06VqanojXWiUqJgAvvCm3KftD0h1N4k_LM Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: cb907a92ab7949ebb3cb2e3b5d372ece Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: cb907a92ab7949ebb3cb2e3b5d372ece Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerActionsTestJSON-2031640985-project Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 64375d765c0949dbb75c91906f8bca3c Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerActionsTestJSON-2031640985-project Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 086fbcfc-2a6b-458f-9520-eb3652662458 could not be found. Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '086fbcfc-2a6b-458f-9520-eb3652662458'} Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 086fbcfc-2a6b-458f-9520-eb3652662458 could not be found. Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 086fbcfc-2a6b-458f-9520-eb3652662458 could not be found. Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:38:42.146246 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:38:42.151197 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:38:42.151197 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:38:42.151197 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:38:42.151197 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:38:42.151197 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:38:42.151197 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 086fbcfc-2a6b-458f-9520-eb3652662458 could not be found. Oct 05 03:38:42.151197 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:38:42.151197 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f0128f4e-6c3d-4c97-bc5a-f8ffcba10d46 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Returning 404 to user: Instance 086fbcfc-2a6b-458f-9520-eb3652662458 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:38:42.151197 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f0128f4e-6c3d-4c97-bc5a-f8ffcba10d46 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458" status: 404 len: 111 microversion: 2.1 time: 0.032272 Oct 05 03:38:42.151197 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3703/7392] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:42 2022] GET /compute/v2.1/servers/086fbcfc-2a6b-458f-9520-eb3652662458 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:38:42.156849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c15ebef5-db91-43b4-b27f-a04815506095 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:42.157441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c15ebef5-db91-43b4-b27f-a04815506095 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:42.163645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c15ebef5-db91-43b4-b27f-a04815506095 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:42.164154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c15ebef5-db91-43b4-b27f-a04815506095 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:42.164612 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c15ebef5-db91-43b4-b27f-a04815506095 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:42.165351 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c15ebef5-db91-43b4-b27f-a04815506095 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:42.165832 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c15ebef5-db91-43b4-b27f-a04815506095 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:42.166276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c15ebef5-db91-43b4-b27f-a04815506095 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:42.181003 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-c15ebef5-db91-43b4-b27f-a04815506095 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] HTTP exception thrown: Instance bd06f250-ceb9-4d45-bc1d-842f06cb7589 could not be found. Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c15ebef5-db91-43b4-b27f-a04815506095 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Request method failure captured: Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 HTTP/1.1 Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPpOjo3UoOtQ-Bs93Auly_6sXh8lfDtgrSY0udxfQzVZtNtMSUx1jRG2ewnriCtcRUrnJaHmLaLcz0mVVG5b9vEZRuG06925WdPWiQLXMx8sJPVOF2G8G35VQEtfcoJQaOleL8MsseS-M06VqanojXWiUqJgAvvCm3KftD0h1N4k_LM Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: cb907a92ab7949ebb3cb2e3b5d372ece Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: cb907a92ab7949ebb3cb2e3b5d372ece Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServerActionsTestJSON-2031640985-project Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 64375d765c0949dbb75c91906f8bca3c Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServerActionsTestJSON-2031640985-project Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance bd06f250-ceb9-4d45-bc1d-842f06cb7589 could not be found. Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'bd06f250-ceb9-4d45-bc1d-842f06cb7589'} Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd06f250-ceb9-4d45-bc1d-842f06cb7589 could not be found. Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:38:42.182590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:38:42.187176 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd06f250-ceb9-4d45-bc1d-842f06cb7589 could not be found. Oct 05 03:38:42.187176 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:38:42.187176 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:38:42.187176 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:38:42.187176 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:38:42.187176 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:38:42.187176 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:38:42.187176 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:38:42.187176 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:38:42.187176 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd06f250-ceb9-4d45-bc1d-842f06cb7589 could not be found. Oct 05 03:38:42.187176 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:38:42.187176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c15ebef5-db91-43b4-b27f-a04815506095 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Returning 404 to user: Instance bd06f250-ceb9-4d45-bc1d-842f06cb7589 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:38:42.187176 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c15ebef5-db91-43b4-b27f-a04815506095 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 404 len: 111 microversion: 2.1 time: 0.031978 Oct 05 03:38:42.188273 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3690/7393] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:38:42 2022] DELETE /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:38:42.193836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8c5c60bb-d91b-4c03-ac99-247891152601 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:42.194456 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8c5c60bb-d91b-4c03-ac99-247891152601 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] [instance: bd06f250-ceb9-4d45-bc1d-842f06cb7589] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:42.200800 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c5c60bb-d91b-4c03-ac99-247891152601 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:42.201315 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c5c60bb-d91b-4c03-ac99-247891152601 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:42.201757 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c5c60bb-d91b-4c03-ac99-247891152601 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:42.202451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c5c60bb-d91b-4c03-ac99-247891152601 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:42.202929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c5c60bb-d91b-4c03-ac99-247891152601 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:42.203417 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c5c60bb-d91b-4c03-ac99-247891152601 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:42.219322 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-8c5c60bb-d91b-4c03-ac99-247891152601 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] HTTP exception thrown: Instance bd06f250-ceb9-4d45-bc1d-842f06cb7589 could not be found. Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8c5c60bb-d91b-4c03-ac99-247891152601 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Request method failure captured: Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 HTTP/1.1 Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPpOjo3UoOtQ-Bs93Auly_6sXh8lfDtgrSY0udxfQzVZtNtMSUx1jRG2ewnriCtcRUrnJaHmLaLcz0mVVG5b9vEZRuG06925WdPWiQLXMx8sJPVOF2G8G35VQEtfcoJQaOleL8MsseS-M06VqanojXWiUqJgAvvCm3KftD0h1N4k_LM Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: cb907a92ab7949ebb3cb2e3b5d372ece Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb907a92ab7949ebb3cb2e3b5d372ece"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: cb907a92ab7949ebb3cb2e3b5d372ece Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServerActionsTestJSON-2031640985 Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServerActionsTestJSON-2031640985-project Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 64375d765c0949dbb75c91906f8bca3c Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServerActionsTestJSON-2031640985-project Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance bd06f250-ceb9-4d45-bc1d-842f06cb7589 could not be found. Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'bd06f250-ceb9-4d45-bc1d-842f06cb7589'} Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd06f250-ceb9-4d45-bc1d-842f06cb7589 could not be found. Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd06f250-ceb9-4d45-bc1d-842f06cb7589 could not be found. Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:38:42.220945 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:38:42.225196 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:38:42.225196 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:38:42.225196 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:38:42.225196 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:38:42.225196 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:38:42.225196 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd06f250-ceb9-4d45-bc1d-842f06cb7589 could not be found. Oct 05 03:38:42.225196 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:38:42.225196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8c5c60bb-d91b-4c03-ac99-247891152601 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Returning 404 to user: Instance bd06f250-ceb9-4d45-bc1d-842f06cb7589 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:38:42.225196 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8c5c60bb-d91b-4c03-ac99-247891152601 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589" status: 404 len: 111 microversion: 2.1 time: 0.032437 Oct 05 03:38:42.225196 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3704/7394] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:42 2022] GET /compute/v2.1/servers/bd06f250-ceb9-4d45-bc1d-842f06cb7589 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:38:42.231668 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7515331c-2323-4f17-ab2c-aedc47767ba7 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] Calling method '.version_select at 0x7fccc4771c10>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:42.258635 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7515331c-2323-4f17-ab2c-aedc47767ba7 tempest-ServerActionsTestJSON-2031640985 tempest-ServerActionsTestJSON-2031640985-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-904238654" status: 202 len: 0 microversion: 2.1 time: 0.030821 Oct 05 03:38:42.262687 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3691/7395] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 5 03:38:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-904238654 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:38:51.406137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-62e6dd6c-774a-4f70-96df-c9bbd1987fff tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1245897897", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "aa6099dd-a9ac-4f6d-9117-eb49afc8ab43"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:38:51.470213 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-62e6dd6c-774a-4f70-96df-c9bbd1987fff tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] validate_networks() for [('aa6099dd-a9ac-4f6d-9117-eb49afc8ab43', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:38:51.894408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-62e6dd6c-774a-4f70-96df-c9bbd1987fff tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:38:51.894835 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-62e6dd6c-774a-4f70-96df-c9bbd1987fff tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:38:51.895309 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-62e6dd6c-774a-4f70-96df-c9bbd1987fff tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:38:51.895720 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-62e6dd6c-774a-4f70-96df-c9bbd1987fff tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:38:51.896317 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-62e6dd6c-774a-4f70-96df-c9bbd1987fff tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:38:51.906802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62e6dd6c-774a-4f70-96df-c9bbd1987fff tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:51.907550 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62e6dd6c-774a-4f70-96df-c9bbd1987fff tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:51.908207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62e6dd6c-774a-4f70-96df-c9bbd1987fff tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:51.908987 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62e6dd6c-774a-4f70-96df-c9bbd1987fff tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:51.909455 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62e6dd6c-774a-4f70-96df-c9bbd1987fff tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:51.909895 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62e6dd6c-774a-4f70-96df-c9bbd1987fff tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:51.927714 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-62e6dd6c-774a-4f70-96df-c9bbd1987fff tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Getting quotas for project 926dfcc8429e4fdd99cb433569c494bc. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:38:51.933224 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-62e6dd6c-774a-4f70-96df-c9bbd1987fff tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Getting quotas for user 377b0fcd349d4c3eae51feadde81b59f and project 926dfcc8429e4fdd99cb433569c494bc. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:38:51.947145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-62e6dd6c-774a-4f70-96df-c9bbd1987fff tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:38:51.949868 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-62e6dd6c-774a-4f70-96df-c9bbd1987fff tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: a06d8596-1845-427b-ac96-e04047813867] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:38:51.998494 n-d-858272-3 devstack@n-api.service[122319]: ERROR oslo.messaging._drivers.impl_rabbit [None req-62e6dd6c-774a-4f70-96df-c9bbd1987fff tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [e2f8a52c-0323-4127-b51d-0a7fb39b66df] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 03:38:53.009120 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [None req-62e6dd6c-774a-4f70-96df-c9bbd1987fff tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [e2f8a52c-0323-4127-b51d-0a7fb39b66df] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 45496. Oct 05 03:38:53.013028 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-62e6dd6c-774a-4f70-96df-c9bbd1987fff tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.744836 Oct 05 03:38:53.014015 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3705/7396] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:38:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:38:53.027722 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-eb7cbda6-eb9c-40af-b671-3e40d8840378 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:53.028515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-eb7cbda6-eb9c-40af-b671-3e40d8840378 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: a06d8596-1845-427b-ac96-e04047813867] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:53.035376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:38:53.036426 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:38:53.087110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-eb7cbda6-eb9c-40af-b671-3e40d8840378 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b0fcd349d4c3eae51feadde81b59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926dfcc8429e4fdd99cb433569c494bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:53.096193 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-eb7cbda6-eb9c-40af-b671-3e40d8840378 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867" status: 200 len: 1217 microversion: 2.1 time: 0.072520 Oct 05 03:38:53.096793 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3692/7397] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:53 2022] GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867 => generated 1217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:54.125767 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e23f15f3-529a-434a-8af7-0ff55602db84 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:54.126906 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e23f15f3-529a-434a-8af7-0ff55602db84 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: a06d8596-1845-427b-ac96-e04047813867] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:54.134029 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e23f15f3-529a-434a-8af7-0ff55602db84 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:54.134533 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e23f15f3-529a-434a-8af7-0ff55602db84 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:54.134974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e23f15f3-529a-434a-8af7-0ff55602db84 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:54.136755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e23f15f3-529a-434a-8af7-0ff55602db84 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:54.137628 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e23f15f3-529a-434a-8af7-0ff55602db84 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:54.138590 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e23f15f3-529a-434a-8af7-0ff55602db84 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:54.237462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e23f15f3-529a-434a-8af7-0ff55602db84 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b0fcd349d4c3eae51feadde81b59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926dfcc8429e4fdd99cb433569c494bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:54.252473 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e23f15f3-529a-434a-8af7-0ff55602db84 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867" status: 200 len: 1277 microversion: 2.1 time: 0.133410 Oct 05 03:38:54.253817 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3706/7398] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:54 2022] GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867 => generated 1277 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:38:55.276200 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f1373319-c7d7-4a79-8885-03deab7842f8 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:55.277454 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f1373319-c7d7-4a79-8885-03deab7842f8 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: a06d8596-1845-427b-ac96-e04047813867] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:55.284796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f1373319-c7d7-4a79-8885-03deab7842f8 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:55.285355 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f1373319-c7d7-4a79-8885-03deab7842f8 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:55.285807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f1373319-c7d7-4a79-8885-03deab7842f8 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:55.286526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f1373319-c7d7-4a79-8885-03deab7842f8 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:55.287173 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f1373319-c7d7-4a79-8885-03deab7842f8 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:55.287632 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f1373319-c7d7-4a79-8885-03deab7842f8 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:55.518873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f1373319-c7d7-4a79-8885-03deab7842f8 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b0fcd349d4c3eae51feadde81b59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926dfcc8429e4fdd99cb433569c494bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:55.535171 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f1373319-c7d7-4a79-8885-03deab7842f8 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867" status: 200 len: 1317 microversion: 2.1 time: 0.262956 Oct 05 03:38:55.535771 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3693/7399] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:55 2022] GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867 => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:55.766400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-2763162d-b2f2-4016-a533-527616b33a0d req-8304dbd9-5549-4095-a0b2-5ca0f64ef06f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a06d8596-1845-427b-ac96-e04047813867", "tag": "b4c494bb-094b-4e32-8000-e04fbd07dc73"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:38:55.777998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-2763162d-b2f2-4016-a533-527616b33a0d req-8304dbd9-5549-4095-a0b2-5ca0f64ef06f service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:55.778402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-2763162d-b2f2-4016-a533-527616b33a0d req-8304dbd9-5549-4095-a0b2-5ca0f64ef06f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:55.778831 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-2763162d-b2f2-4016-a533-527616b33a0d req-8304dbd9-5549-4095-a0b2-5ca0f64ef06f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:55.801693 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-2763162d-b2f2-4016-a533-527616b33a0d req-8304dbd9-5549-4095-a0b2-5ca0f64ef06f service nova] Creating event network-changed:b4c494bb-094b-4e32-8000-e04fbd07dc73 for instance a06d8596-1845-427b-ac96-e04047813867 on n-h1-858272-3 Oct 05 03:38:55.807811 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-2763162d-b2f2-4016-a533-527616b33a0d req-8304dbd9-5549-4095-a0b2-5ca0f64ef06f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045174 Oct 05 03:38:55.808575 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3707/7400] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:38:56.558736 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-378b71cf-3989-4b85-b13e-b669696de426 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:56.559364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-378b71cf-3989-4b85-b13e-b669696de426 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: a06d8596-1845-427b-ac96-e04047813867] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:56.566675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-378b71cf-3989-4b85-b13e-b669696de426 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:56.567173 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-378b71cf-3989-4b85-b13e-b669696de426 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:56.567620 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-378b71cf-3989-4b85-b13e-b669696de426 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:56.568316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-378b71cf-3989-4b85-b13e-b669696de426 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:56.568782 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-378b71cf-3989-4b85-b13e-b669696de426 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:56.569249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-378b71cf-3989-4b85-b13e-b669696de426 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:56.701278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-378b71cf-3989-4b85-b13e-b669696de426 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b0fcd349d4c3eae51feadde81b59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926dfcc8429e4fdd99cb433569c494bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:56.709583 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-378b71cf-3989-4b85-b13e-b669696de426 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867" status: 200 len: 1317 microversion: 2.1 time: 0.154810 Oct 05 03:38:56.710156 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3694/7401] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:56 2022] GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:57.733761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-06c1eaae-03ce-4ca2-8214-728630fc7507 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:57.734463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-06c1eaae-03ce-4ca2-8214-728630fc7507 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: a06d8596-1845-427b-ac96-e04047813867] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:57.740664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06c1eaae-03ce-4ca2-8214-728630fc7507 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:57.741176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06c1eaae-03ce-4ca2-8214-728630fc7507 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:57.741607 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06c1eaae-03ce-4ca2-8214-728630fc7507 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:57.742292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06c1eaae-03ce-4ca2-8214-728630fc7507 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:57.742836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06c1eaae-03ce-4ca2-8214-728630fc7507 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:57.743257 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06c1eaae-03ce-4ca2-8214-728630fc7507 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:57.873118 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-06c1eaae-03ce-4ca2-8214-728630fc7507 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b0fcd349d4c3eae51feadde81b59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926dfcc8429e4fdd99cb433569c494bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:57.881494 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-06c1eaae-03ce-4ca2-8214-728630fc7507 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867" status: 200 len: 1317 microversion: 2.1 time: 0.152896 Oct 05 03:38:57.882087 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3708/7402] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:57 2022] GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:38:58.903731 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-92b88aea-7c27-40e5-b777-77542a08db3d tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:38:58.904393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-92b88aea-7c27-40e5-b777-77542a08db3d tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: a06d8596-1845-427b-ac96-e04047813867] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:38:58.911849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92b88aea-7c27-40e5-b777-77542a08db3d tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:58.912351 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92b88aea-7c27-40e5-b777-77542a08db3d tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:58.912804 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92b88aea-7c27-40e5-b777-77542a08db3d tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:58.913531 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92b88aea-7c27-40e5-b777-77542a08db3d tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:38:58.914004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92b88aea-7c27-40e5-b777-77542a08db3d tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:38:58.914445 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-92b88aea-7c27-40e5-b777-77542a08db3d tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:38:59.049281 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-92b88aea-7c27-40e5-b777-77542a08db3d tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b0fcd349d4c3eae51feadde81b59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926dfcc8429e4fdd99cb433569c494bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:38:59.056927 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-92b88aea-7c27-40e5-b777-77542a08db3d tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867" status: 200 len: 1317 microversion: 2.1 time: 0.157187 Oct 05 03:38:59.057521 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3695/7403] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:38:58 2022] GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:39:00.080172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-08cfe54e-59ee-4c21-8ba7-bb97add03a6a tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:00.080801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-08cfe54e-59ee-4c21-8ba7-bb97add03a6a tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: a06d8596-1845-427b-ac96-e04047813867] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:00.088225 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08cfe54e-59ee-4c21-8ba7-bb97add03a6a tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:00.088718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08cfe54e-59ee-4c21-8ba7-bb97add03a6a tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:00.089185 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08cfe54e-59ee-4c21-8ba7-bb97add03a6a tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:00.089906 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08cfe54e-59ee-4c21-8ba7-bb97add03a6a tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:00.090356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08cfe54e-59ee-4c21-8ba7-bb97add03a6a tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:00.090787 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08cfe54e-59ee-4c21-8ba7-bb97add03a6a tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:00.235551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-08cfe54e-59ee-4c21-8ba7-bb97add03a6a tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b0fcd349d4c3eae51feadde81b59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926dfcc8429e4fdd99cb433569c494bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:39:00.243308 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-08cfe54e-59ee-4c21-8ba7-bb97add03a6a tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867" status: 200 len: 1317 microversion: 2.1 time: 0.167535 Oct 05 03:39:00.243876 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3709/7404] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:39:00 2022] GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:39:01.267284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ea9452cb-65d7-4bc7-9190-afde2537bbf9 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:01.267959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ea9452cb-65d7-4bc7-9190-afde2537bbf9 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: a06d8596-1845-427b-ac96-e04047813867] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:01.275415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea9452cb-65d7-4bc7-9190-afde2537bbf9 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:01.275918 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea9452cb-65d7-4bc7-9190-afde2537bbf9 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:01.276372 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea9452cb-65d7-4bc7-9190-afde2537bbf9 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:01.277113 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea9452cb-65d7-4bc7-9190-afde2537bbf9 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:01.277589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea9452cb-65d7-4bc7-9190-afde2537bbf9 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:01.278035 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea9452cb-65d7-4bc7-9190-afde2537bbf9 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:01.406575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ea9452cb-65d7-4bc7-9190-afde2537bbf9 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b0fcd349d4c3eae51feadde81b59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926dfcc8429e4fdd99cb433569c494bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:39:01.414369 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ea9452cb-65d7-4bc7-9190-afde2537bbf9 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867" status: 200 len: 1317 microversion: 2.1 time: 0.152417 Oct 05 03:39:01.414937 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3696/7405] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:39:01 2022] GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:39:02.057214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-c46ae00d-9c04-4aba-b294-9640915192bd req-6b1b557f-8bc3-4a16-b79c-5ee34775d54a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a06d8596-1845-427b-ac96-e04047813867", "name": "network-vif-plugged", "status": "completed", "tag": "b4c494bb-094b-4e32-8000-e04fbd07dc73"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:39:02.063653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:39:02.064377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:39:02.071023 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c46ae00d-9c04-4aba-b294-9640915192bd req-6b1b557f-8bc3-4a16-b79c-5ee34775d54a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:02.071530 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c46ae00d-9c04-4aba-b294-9640915192bd req-6b1b557f-8bc3-4a16-b79c-5ee34775d54a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:02.071962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c46ae00d-9c04-4aba-b294-9640915192bd req-6b1b557f-8bc3-4a16-b79c-5ee34775d54a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:02.083530 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-c46ae00d-9c04-4aba-b294-9640915192bd req-6b1b557f-8bc3-4a16-b79c-5ee34775d54a service nova] Creating event network-vif-plugged:b4c494bb-094b-4e32-8000-e04fbd07dc73 for instance a06d8596-1845-427b-ac96-e04047813867 on n-h1-858272-3 Oct 05 03:39:02.088472 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-c46ae00d-9c04-4aba-b294-9640915192bd req-6b1b557f-8bc3-4a16-b79c-5ee34775d54a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035196 Oct 05 03:39:02.089099 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3710/7406] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:39:02.437428 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-be30ae8d-309c-4885-8642-68423c0c5fb0 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:02.437987 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-be30ae8d-309c-4885-8642-68423c0c5fb0 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: a06d8596-1845-427b-ac96-e04047813867] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:02.444888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be30ae8d-309c-4885-8642-68423c0c5fb0 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:02.445416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be30ae8d-309c-4885-8642-68423c0c5fb0 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:02.445870 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be30ae8d-309c-4885-8642-68423c0c5fb0 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:02.446600 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be30ae8d-309c-4885-8642-68423c0c5fb0 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:02.447068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be30ae8d-309c-4885-8642-68423c0c5fb0 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:02.447507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-be30ae8d-309c-4885-8642-68423c0c5fb0 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:02.577415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-be30ae8d-309c-4885-8642-68423c0c5fb0 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b0fcd349d4c3eae51feadde81b59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926dfcc8429e4fdd99cb433569c494bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:39:02.585094 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-be30ae8d-309c-4885-8642-68423c0c5fb0 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867" status: 200 len: 1317 microversion: 2.1 time: 0.151967 Oct 05 03:39:02.585681 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3697/7407] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:39:02 2022] GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:39:03.611566 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8623e184-f0de-4295-ab25-afe5f8f049ed tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:03.612463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8623e184-f0de-4295-ab25-afe5f8f049ed tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: a06d8596-1845-427b-ac96-e04047813867] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:03.619905 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8623e184-f0de-4295-ab25-afe5f8f049ed tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:03.620402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8623e184-f0de-4295-ab25-afe5f8f049ed tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:03.620847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8623e184-f0de-4295-ab25-afe5f8f049ed tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:03.621581 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8623e184-f0de-4295-ab25-afe5f8f049ed tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:03.622041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8623e184-f0de-4295-ab25-afe5f8f049ed tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:03.622475 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8623e184-f0de-4295-ab25-afe5f8f049ed tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:03.755012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8623e184-f0de-4295-ab25-afe5f8f049ed tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b0fcd349d4c3eae51feadde81b59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926dfcc8429e4fdd99cb433569c494bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:39:03.762673 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8623e184-f0de-4295-ab25-afe5f8f049ed tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867" status: 200 len: 1507 microversion: 2.1 time: 0.156844 Oct 05 03:39:03.763245 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3711/7408] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:39:03 2022] GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:39:03.824712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-23264950-b474-4467-8ac1-67e902476d7c tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-168612291", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "aa6099dd-a9ac-4f6d-9117-eb49afc8ab43"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:39:03.833900 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:39:03.884188 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-23264950-b474-4467-8ac1-67e902476d7c tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] validate_networks() for [('aa6099dd-a9ac-4f6d-9117-eb49afc8ab43', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:39:04.266669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-23264950-b474-4467-8ac1-67e902476d7c tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:39:04.267116 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-23264950-b474-4467-8ac1-67e902476d7c tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:39:04.267642 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-23264950-b474-4467-8ac1-67e902476d7c tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:39:04.268078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-23264950-b474-4467-8ac1-67e902476d7c tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:39:04.268513 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-23264950-b474-4467-8ac1-67e902476d7c tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:39:04.277639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23264950-b474-4467-8ac1-67e902476d7c tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:04.278146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23264950-b474-4467-8ac1-67e902476d7c tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:04.278608 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23264950-b474-4467-8ac1-67e902476d7c tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:04.279359 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23264950-b474-4467-8ac1-67e902476d7c tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:04.279836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23264950-b474-4467-8ac1-67e902476d7c tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:04.280283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-23264950-b474-4467-8ac1-67e902476d7c tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:04.300691 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-23264950-b474-4467-8ac1-67e902476d7c tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Getting quotas for project 926dfcc8429e4fdd99cb433569c494bc. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:39:04.305856 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-23264950-b474-4467-8ac1-67e902476d7c tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Getting quotas for user 377b0fcd349d4c3eae51feadde81b59f and project 926dfcc8429e4fdd99cb433569c494bc. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:39:04.318841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-23264950-b474-4467-8ac1-67e902476d7c tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:39:04.321166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-23264950-b474-4467-8ac1-67e902476d7c tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: 90af1b77-e790-4879-b0a1-e87ac2fbf7c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:39:04.366552 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-23264950-b474-4467-8ac1-67e902476d7c tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.545699 Oct 05 03:39:04.367217 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3698/7409] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:39:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:39:04.378580 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-36f6e679-f6a2-430c-b795-dbc00f6f2d15 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:04.379197 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-36f6e679-f6a2-430c-b795-dbc00f6f2d15 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: 90af1b77-e790-4879-b0a1-e87ac2fbf7c6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:04.431458 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-36f6e679-f6a2-430c-b795-dbc00f6f2d15 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b0fcd349d4c3eae51feadde81b59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926dfcc8429e4fdd99cb433569c494bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:39:04.438916 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-36f6e679-f6a2-430c-b795-dbc00f6f2d15 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6" status: 200 len: 1216 microversion: 2.1 time: 0.064189 Oct 05 03:39:04.439504 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3712/7410] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:39:04 2022] GET /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6 => generated 1216 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:39:05.462243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-21f6f0f7-953d-4302-b1b4-72e5f29a3f85 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:05.462938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-21f6f0f7-953d-4302-b1b4-72e5f29a3f85 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: 90af1b77-e790-4879-b0a1-e87ac2fbf7c6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:05.470109 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-21f6f0f7-953d-4302-b1b4-72e5f29a3f85 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:05.470638 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-21f6f0f7-953d-4302-b1b4-72e5f29a3f85 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:05.471086 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-21f6f0f7-953d-4302-b1b4-72e5f29a3f85 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:05.471786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-21f6f0f7-953d-4302-b1b4-72e5f29a3f85 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:05.472258 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-21f6f0f7-953d-4302-b1b4-72e5f29a3f85 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:05.472702 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-21f6f0f7-953d-4302-b1b4-72e5f29a3f85 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:05.535629 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-21f6f0f7-953d-4302-b1b4-72e5f29a3f85 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b0fcd349d4c3eae51feadde81b59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926dfcc8429e4fdd99cb433569c494bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:39:05.543470 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-21f6f0f7-953d-4302-b1b4-72e5f29a3f85 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6" status: 200 len: 1268 microversion: 2.1 time: 0.086349 Oct 05 03:39:05.544373 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3699/7411] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:39:05 2022] GET /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6 => generated 1268 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:39:06.569111 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-578829f1-172e-415f-bd32-b269c5906522 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:06.569717 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-578829f1-172e-415f-bd32-b269c5906522 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: 90af1b77-e790-4879-b0a1-e87ac2fbf7c6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:06.572833 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:39:06.580629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-578829f1-172e-415f-bd32-b269c5906522 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:06.581270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-578829f1-172e-415f-bd32-b269c5906522 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:06.582123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-578829f1-172e-415f-bd32-b269c5906522 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:06.582841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-578829f1-172e-415f-bd32-b269c5906522 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:06.583303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-578829f1-172e-415f-bd32-b269c5906522 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:06.583730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-578829f1-172e-415f-bd32-b269c5906522 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:06.587681 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=54 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:39:06.892435 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-578829f1-172e-415f-bd32-b269c5906522 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b0fcd349d4c3eae51feadde81b59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926dfcc8429e4fdd99cb433569c494bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:39:06.906337 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-578829f1-172e-415f-bd32-b269c5906522 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6" status: 200 len: 1316 microversion: 2.1 time: 0.341163 Oct 05 03:39:06.907006 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3713/7412] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:39:06 2022] GET /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6 => generated 1316 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:39:07.431491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-d56bd44c-54bd-4648-bb57-f35623d441c9 req-eee9fd7f-688b-4657-9263-e93a23949ddc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90af1b77-e790-4879-b0a1-e87ac2fbf7c6", "tag": "c1914f39-2651-4af3-8a1e-3259999695a3"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:39:07.442950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d56bd44c-54bd-4648-bb57-f35623d441c9 req-eee9fd7f-688b-4657-9263-e93a23949ddc service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:07.443454 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d56bd44c-54bd-4648-bb57-f35623d441c9 req-eee9fd7f-688b-4657-9263-e93a23949ddc service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:07.443909 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d56bd44c-54bd-4648-bb57-f35623d441c9 req-eee9fd7f-688b-4657-9263-e93a23949ddc service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:07.456647 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-d56bd44c-54bd-4648-bb57-f35623d441c9 req-eee9fd7f-688b-4657-9263-e93a23949ddc service nova] Creating event network-changed:c1914f39-2651-4af3-8a1e-3259999695a3 for instance 90af1b77-e790-4879-b0a1-e87ac2fbf7c6 on n-h2-858272-3 Oct 05 03:39:07.462335 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-d56bd44c-54bd-4648-bb57-f35623d441c9 req-eee9fd7f-688b-4657-9263-e93a23949ddc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034698 Oct 05 03:39:07.463215 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3700/7413] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:39:07.929087 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-762ebd9f-baa1-48f0-bb9f-46e8311b2045 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:07.929616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-762ebd9f-baa1-48f0-bb9f-46e8311b2045 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: 90af1b77-e790-4879-b0a1-e87ac2fbf7c6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:07.936477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-762ebd9f-baa1-48f0-bb9f-46e8311b2045 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:07.937058 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-762ebd9f-baa1-48f0-bb9f-46e8311b2045 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:07.937496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-762ebd9f-baa1-48f0-bb9f-46e8311b2045 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:07.938176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-762ebd9f-baa1-48f0-bb9f-46e8311b2045 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:07.938625 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-762ebd9f-baa1-48f0-bb9f-46e8311b2045 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:07.939044 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-762ebd9f-baa1-48f0-bb9f-46e8311b2045 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:08.068499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-762ebd9f-baa1-48f0-bb9f-46e8311b2045 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b0fcd349d4c3eae51feadde81b59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926dfcc8429e4fdd99cb433569c494bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:39:08.076852 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-762ebd9f-baa1-48f0-bb9f-46e8311b2045 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6" status: 200 len: 1316 microversion: 2.1 time: 0.151241 Oct 05 03:39:08.077477 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3714/7414] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:39:07 2022] GET /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6 => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:39:09.101622 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8e12772a-7900-42ba-a41a-bff78f344a35 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:09.102344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8e12772a-7900-42ba-a41a-bff78f344a35 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: 90af1b77-e790-4879-b0a1-e87ac2fbf7c6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:09.109385 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e12772a-7900-42ba-a41a-bff78f344a35 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:09.109894 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e12772a-7900-42ba-a41a-bff78f344a35 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:09.110346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e12772a-7900-42ba-a41a-bff78f344a35 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:09.111050 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e12772a-7900-42ba-a41a-bff78f344a35 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:09.111524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e12772a-7900-42ba-a41a-bff78f344a35 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:09.111964 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8e12772a-7900-42ba-a41a-bff78f344a35 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:09.245465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8e12772a-7900-42ba-a41a-bff78f344a35 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b0fcd349d4c3eae51feadde81b59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926dfcc8429e4fdd99cb433569c494bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:39:09.253033 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8e12772a-7900-42ba-a41a-bff78f344a35 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6" status: 200 len: 1316 microversion: 2.1 time: 0.156816 Oct 05 03:39:09.253613 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3701/7415] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:39:09 2022] GET /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:39:10.276016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cfe30454-df9b-4b5e-8d33-8528a66d6e6c tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:10.276633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cfe30454-df9b-4b5e-8d33-8528a66d6e6c tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: 90af1b77-e790-4879-b0a1-e87ac2fbf7c6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:10.282739 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cfe30454-df9b-4b5e-8d33-8528a66d6e6c tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:10.283225 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cfe30454-df9b-4b5e-8d33-8528a66d6e6c tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:10.283654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cfe30454-df9b-4b5e-8d33-8528a66d6e6c tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:10.284340 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cfe30454-df9b-4b5e-8d33-8528a66d6e6c tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:10.284789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cfe30454-df9b-4b5e-8d33-8528a66d6e6c tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:10.285231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cfe30454-df9b-4b5e-8d33-8528a66d6e6c tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:10.457593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cfe30454-df9b-4b5e-8d33-8528a66d6e6c tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b0fcd349d4c3eae51feadde81b59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926dfcc8429e4fdd99cb433569c494bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:39:10.467369 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cfe30454-df9b-4b5e-8d33-8528a66d6e6c tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6" status: 200 len: 1316 microversion: 2.1 time: 0.195551 Oct 05 03:39:10.467949 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3715/7416] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:39:10 2022] GET /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6 => generated 1316 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:39:11.491023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-17bd3346-53ce-49b4-8b6b-4f9f512b1b15 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:11.491633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-17bd3346-53ce-49b4-8b6b-4f9f512b1b15 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: 90af1b77-e790-4879-b0a1-e87ac2fbf7c6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:11.499956 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17bd3346-53ce-49b4-8b6b-4f9f512b1b15 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:11.500458 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17bd3346-53ce-49b4-8b6b-4f9f512b1b15 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:11.500923 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17bd3346-53ce-49b4-8b6b-4f9f512b1b15 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:11.501638 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17bd3346-53ce-49b4-8b6b-4f9f512b1b15 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:11.502101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17bd3346-53ce-49b4-8b6b-4f9f512b1b15 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:11.502538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-17bd3346-53ce-49b4-8b6b-4f9f512b1b15 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:11.642413 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-17bd3346-53ce-49b4-8b6b-4f9f512b1b15 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b0fcd349d4c3eae51feadde81b59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926dfcc8429e4fdd99cb433569c494bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:39:11.650135 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-17bd3346-53ce-49b4-8b6b-4f9f512b1b15 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6" status: 200 len: 1316 microversion: 2.1 time: 0.163433 Oct 05 03:39:11.651299 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3702/7417] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:39:11 2022] GET /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:39:12.674437 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c166e133-e2c0-46c6-88d6-2a4771a7ddfa tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:12.674990 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c166e133-e2c0-46c6-88d6-2a4771a7ddfa tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: 90af1b77-e790-4879-b0a1-e87ac2fbf7c6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:12.681928 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c166e133-e2c0-46c6-88d6-2a4771a7ddfa tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:12.682414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c166e133-e2c0-46c6-88d6-2a4771a7ddfa tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:12.682849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c166e133-e2c0-46c6-88d6-2a4771a7ddfa tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:12.683539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c166e133-e2c0-46c6-88d6-2a4771a7ddfa tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:12.683994 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c166e133-e2c0-46c6-88d6-2a4771a7ddfa tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:12.684420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c166e133-e2c0-46c6-88d6-2a4771a7ddfa tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:12.814118 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c166e133-e2c0-46c6-88d6-2a4771a7ddfa tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b0fcd349d4c3eae51feadde81b59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926dfcc8429e4fdd99cb433569c494bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:39:12.821786 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c166e133-e2c0-46c6-88d6-2a4771a7ddfa tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6" status: 200 len: 1316 microversion: 2.1 time: 0.152078 Oct 05 03:39:12.822365 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3716/7418] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:39:12 2022] GET /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6 => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:39:13.581592 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-73196a48-2d2d-4f18-9543-e40a11bb1554 req-4a2dffe7-40de-4e35-8a65-d2ef767b17f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90af1b77-e790-4879-b0a1-e87ac2fbf7c6", "name": "network-vif-plugged", "status": "completed", "tag": "c1914f39-2651-4af3-8a1e-3259999695a3"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:39:13.592796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-73196a48-2d2d-4f18-9543-e40a11bb1554 req-4a2dffe7-40de-4e35-8a65-d2ef767b17f2 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:13.593331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-73196a48-2d2d-4f18-9543-e40a11bb1554 req-4a2dffe7-40de-4e35-8a65-d2ef767b17f2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:13.593799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-73196a48-2d2d-4f18-9543-e40a11bb1554 req-4a2dffe7-40de-4e35-8a65-d2ef767b17f2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:13.605345 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-73196a48-2d2d-4f18-9543-e40a11bb1554 req-4a2dffe7-40de-4e35-8a65-d2ef767b17f2 service nova] Creating event network-vif-plugged:c1914f39-2651-4af3-8a1e-3259999695a3 for instance 90af1b77-e790-4879-b0a1-e87ac2fbf7c6 on n-h2-858272-3 Oct 05 03:39:13.610220 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-73196a48-2d2d-4f18-9543-e40a11bb1554 req-4a2dffe7-40de-4e35-8a65-d2ef767b17f2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033741 Oct 05 03:39:13.611009 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3703/7419] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:39:13.844949 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-42fca6e7-3d7a-4e76-882a-05c481851497 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:13.845562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-42fca6e7-3d7a-4e76-882a-05c481851497 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: 90af1b77-e790-4879-b0a1-e87ac2fbf7c6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:13.852635 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42fca6e7-3d7a-4e76-882a-05c481851497 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:13.853146 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42fca6e7-3d7a-4e76-882a-05c481851497 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:13.853579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42fca6e7-3d7a-4e76-882a-05c481851497 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:13.854259 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42fca6e7-3d7a-4e76-882a-05c481851497 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:13.854707 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42fca6e7-3d7a-4e76-882a-05c481851497 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:13.855128 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-42fca6e7-3d7a-4e76-882a-05c481851497 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:13.983495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-42fca6e7-3d7a-4e76-882a-05c481851497 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b0fcd349d4c3eae51feadde81b59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926dfcc8429e4fdd99cb433569c494bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:39:13.991814 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-42fca6e7-3d7a-4e76-882a-05c481851497 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6" status: 200 len: 1316 microversion: 2.1 time: 0.150801 Oct 05 03:39:13.992387 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3717/7420] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:39:13 2022] GET /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6 => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:39:15.013998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:39:15.014790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:39:15.020629 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c8a97ada-7009-4e6d-8eb5-74638c831a5e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:15.021937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c8a97ada-7009-4e6d-8eb5-74638c831a5e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: 90af1b77-e790-4879-b0a1-e87ac2fbf7c6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:15.029114 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8a97ada-7009-4e6d-8eb5-74638c831a5e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:15.029613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8a97ada-7009-4e6d-8eb5-74638c831a5e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:15.030059 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8a97ada-7009-4e6d-8eb5-74638c831a5e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:15.030768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8a97ada-7009-4e6d-8eb5-74638c831a5e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:15.031234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8a97ada-7009-4e6d-8eb5-74638c831a5e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:15.032443 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8a97ada-7009-4e6d-8eb5-74638c831a5e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:15.175121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c8a97ada-7009-4e6d-8eb5-74638c831a5e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b0fcd349d4c3eae51feadde81b59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926dfcc8429e4fdd99cb433569c494bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:39:15.182922 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c8a97ada-7009-4e6d-8eb5-74638c831a5e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6" status: 200 len: 1316 microversion: 2.1 time: 0.169921 Oct 05 03:39:15.183506 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3704/7421] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:39:15 2022] GET /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6 => generated 1316 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:39:16.206762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c4aa00f6-9f8c-410a-90c0-b98124a56e66 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:16.207398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c4aa00f6-9f8c-410a-90c0-b98124a56e66 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: 90af1b77-e790-4879-b0a1-e87ac2fbf7c6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:16.209277 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:39:16.215244 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4aa00f6-9f8c-410a-90c0-b98124a56e66 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:16.215730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4aa00f6-9f8c-410a-90c0-b98124a56e66 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:16.216171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4aa00f6-9f8c-410a-90c0-b98124a56e66 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:16.216863 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4aa00f6-9f8c-410a-90c0-b98124a56e66 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:16.217344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4aa00f6-9f8c-410a-90c0-b98124a56e66 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:16.217771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c4aa00f6-9f8c-410a-90c0-b98124a56e66 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:16.347032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c4aa00f6-9f8c-410a-90c0-b98124a56e66 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b0fcd349d4c3eae51feadde81b59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926dfcc8429e4fdd99cb433569c494bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:39:16.355136 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c4aa00f6-9f8c-410a-90c0-b98124a56e66 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6" status: 200 len: 1505 microversion: 2.1 time: 0.153157 Oct 05 03:39:16.355716 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3718/7422] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:39:16 2022] GET /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:39:16.378245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-30ac7742-cb0d-4ccd-ba5f-6d9d757ad074 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:16.379421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-30ac7742-cb0d-4ccd-ba5f-6d9d757ad074 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: 90af1b77-e790-4879-b0a1-e87ac2fbf7c6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:16.386552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30ac7742-cb0d-4ccd-ba5f-6d9d757ad074 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:16.387061 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30ac7742-cb0d-4ccd-ba5f-6d9d757ad074 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:16.387517 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30ac7742-cb0d-4ccd-ba5f-6d9d757ad074 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:16.388231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30ac7742-cb0d-4ccd-ba5f-6d9d757ad074 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:16.388708 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30ac7742-cb0d-4ccd-ba5f-6d9d757ad074 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:16.389180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30ac7742-cb0d-4ccd-ba5f-6d9d757ad074 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:16.419448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-30ac7742-cb0d-4ccd-ba5f-6d9d757ad074 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: 90af1b77-e790-4879-b0a1-e87ac2fbf7c6] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:39:16.495482 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-30ac7742-cb0d-4ccd-ba5f-6d9d757ad074 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "DELETE /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6" status: 204 len: 0 microversion: 2.1 time: 0.121373 Oct 05 03:39:16.496144 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3705/7423] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:39:16 2022] DELETE /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:39:16.504798 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-79bdd188-965d-4fbd-9f4a-d70edcf8d101 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:16.505452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-79bdd188-965d-4fbd-9f4a-d70edcf8d101 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: 90af1b77-e790-4879-b0a1-e87ac2fbf7c6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:16.511423 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79bdd188-965d-4fbd-9f4a-d70edcf8d101 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:16.511916 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79bdd188-965d-4fbd-9f4a-d70edcf8d101 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:16.512358 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79bdd188-965d-4fbd-9f4a-d70edcf8d101 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:16.513090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79bdd188-965d-4fbd-9f4a-d70edcf8d101 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:16.513553 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79bdd188-965d-4fbd-9f4a-d70edcf8d101 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:16.513983 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79bdd188-965d-4fbd-9f4a-d70edcf8d101 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:16.640716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-79bdd188-965d-4fbd-9f4a-d70edcf8d101 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b0fcd349d4c3eae51feadde81b59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926dfcc8429e4fdd99cb433569c494bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:39:16.649162 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-79bdd188-965d-4fbd-9f4a-d70edcf8d101 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6" status: 200 len: 1511 microversion: 2.1 time: 0.148751 Oct 05 03:39:16.649745 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3719/7424] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:39:16 2022] GET /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6 => generated 1511 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:39:17.675265 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-273f1d1a-f132-498f-9291-2c30c11a2310 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:17.675986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-273f1d1a-f132-498f-9291-2c30c11a2310 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: 90af1b77-e790-4879-b0a1-e87ac2fbf7c6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:17.682439 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-273f1d1a-f132-498f-9291-2c30c11a2310 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:17.682939 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-273f1d1a-f132-498f-9291-2c30c11a2310 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:17.683388 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-273f1d1a-f132-498f-9291-2c30c11a2310 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:17.684092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-273f1d1a-f132-498f-9291-2c30c11a2310 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:17.684563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-273f1d1a-f132-498f-9291-2c30c11a2310 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:17.685036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-273f1d1a-f132-498f-9291-2c30c11a2310 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:17.819947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-273f1d1a-f132-498f-9291-2c30c11a2310 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b0fcd349d4c3eae51feadde81b59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926dfcc8429e4fdd99cb433569c494bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:39:17.829192 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-273f1d1a-f132-498f-9291-2c30c11a2310 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6" status: 200 len: 1511 microversion: 2.1 time: 0.157807 Oct 05 03:39:17.830131 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3706/7425] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:39:17 2022] GET /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6 => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:39:18.556770 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-13100d77-3d4b-4637-8e70-a15b05c22032 req-92a58676-030c-4ad0-8101-4b9fd4f25a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90af1b77-e790-4879-b0a1-e87ac2fbf7c6", "name": "network-vif-deleted", "tag": "c1914f39-2651-4af3-8a1e-3259999695a3"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:39:18.572788 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-13100d77-3d4b-4637-8e70-a15b05c22032 req-92a58676-030c-4ad0-8101-4b9fd4f25a03 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:18.573297 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-13100d77-3d4b-4637-8e70-a15b05c22032 req-92a58676-030c-4ad0-8101-4b9fd4f25a03 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:18.573772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-13100d77-3d4b-4637-8e70-a15b05c22032 req-92a58676-030c-4ad0-8101-4b9fd4f25a03 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:18.588320 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-13100d77-3d4b-4637-8e70-a15b05c22032 req-92a58676-030c-4ad0-8101-4b9fd4f25a03 service nova] Creating event network-vif-deleted:c1914f39-2651-4af3-8a1e-3259999695a3 for instance 90af1b77-e790-4879-b0a1-e87ac2fbf7c6 on n-h2-858272-3 Oct 05 03:39:18.597149 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-13100d77-3d4b-4637-8e70-a15b05c22032 req-92a58676-030c-4ad0-8101-4b9fd4f25a03 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047894 Oct 05 03:39:18.598087 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3720/7426] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:39:18.854634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5bcbe878-76f4-47d8-9a60-50040f78fc5e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:18.855297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5bcbe878-76f4-47d8-9a60-50040f78fc5e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: 90af1b77-e790-4879-b0a1-e87ac2fbf7c6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:18.862908 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5bcbe878-76f4-47d8-9a60-50040f78fc5e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:18.863412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5bcbe878-76f4-47d8-9a60-50040f78fc5e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:18.863865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5bcbe878-76f4-47d8-9a60-50040f78fc5e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:18.864568 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5bcbe878-76f4-47d8-9a60-50040f78fc5e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:18.865076 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5bcbe878-76f4-47d8-9a60-50040f78fc5e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:18.865519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5bcbe878-76f4-47d8-9a60-50040f78fc5e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:18.896819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5bcbe878-76f4-47d8-9a60-50040f78fc5e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:18.897355 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5bcbe878-76f4-47d8-9a60-50040f78fc5e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:18.897807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5bcbe878-76f4-47d8-9a60-50040f78fc5e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:18.898270 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-5bcbe878-76f4-47d8-9a60-50040f78fc5e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lazy-loading 'fault' on Instance uuid 90af1b77-e790-4879-b0a1-e87ac2fbf7c6 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:39:18.950730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5bcbe878-76f4-47d8-9a60-50040f78fc5e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b0fcd349d4c3eae51feadde81b59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926dfcc8429e4fdd99cb433569c494bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:39:18.958638 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5bcbe878-76f4-47d8-9a60-50040f78fc5e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6" status: 200 len: 1306 microversion: 2.1 time: 0.108644 Oct 05 03:39:18.959228 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3707/7427] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:39:18 2022] GET /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6 => generated 1306 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:39:19.988178 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9a530db7-9540-43d1-8cf5-4be8ec34c5cb tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:19.989120 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9a530db7-9540-43d1-8cf5-4be8ec34c5cb tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: 90af1b77-e790-4879-b0a1-e87ac2fbf7c6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:19.997207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a530db7-9540-43d1-8cf5-4be8ec34c5cb tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:19.997693 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a530db7-9540-43d1-8cf5-4be8ec34c5cb tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:19.998132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a530db7-9540-43d1-8cf5-4be8ec34c5cb tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:19.998903 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a530db7-9540-43d1-8cf5-4be8ec34c5cb tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:19.999380 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a530db7-9540-43d1-8cf5-4be8ec34c5cb tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:19.999806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a530db7-9540-43d1-8cf5-4be8ec34c5cb tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:20.014110 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-9a530db7-9540-43d1-8cf5-4be8ec34c5cb tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] HTTP exception thrown: Instance 90af1b77-e790-4879-b0a1-e87ac2fbf7c6 could not be found. Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9a530db7-9540-43d1-8cf5-4be8ec34c5cb tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Request method failure captured: Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6 HTTP/1.1 Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPxLkr2yX460fU292L_IAJDARAiilkR0icqE7mlIyvPAXnR3gHM8IMzRJ8viABcOFNwcYz-CGH1rG2T0PbDYV_FEB84ocTz8sQJO4Jjunv5AlqnJFPmH9wYvSB1dEuz7A-yyh2CpsHyS0DHt-y76JSNOsnVDtKc0GT5M8Piy0MFC-Cs Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 926dfcc8429e4fdd99cb433569c494bc Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersNegativeTestJSON-138757177 Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/926dfcc8429e4fdd99cb433569c494bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/926dfcc8429e4fdd99cb433569c494bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/926dfcc8429e4fdd99cb433569c494bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_926dfcc8429e4fdd99cb433569c494bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersNegativeTestJSON-138757177 Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 926dfcc8429e4fdd99cb433569c494bc Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersNegativeTestJSON-138757177 Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersNegativeTestJSON-138757177-project Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 377b0fcd349d4c3eae51feadde81b59f Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersNegativeTestJSON-138757177-project Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 90af1b77-e790-4879-b0a1-e87ac2fbf7c6 could not be found. Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '90af1b77-e790-4879-b0a1-e87ac2fbf7c6'} Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90af1b77-e790-4879-b0a1-e87ac2fbf7c6 could not be found. Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90af1b77-e790-4879-b0a1-e87ac2fbf7c6 could not be found. Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:39:20.015759 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:39:20.020751 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:39:20.020751 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:39:20.020751 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:39:20.020751 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:39:20.020751 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:39:20.020751 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90af1b77-e790-4879-b0a1-e87ac2fbf7c6 could not be found. Oct 05 03:39:20.020751 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:39:20.020751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9a530db7-9540-43d1-8cf5-4be8ec34c5cb tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Returning 404 to user: Instance 90af1b77-e790-4879-b0a1-e87ac2fbf7c6 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:39:20.020751 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9a530db7-9540-43d1-8cf5-4be8ec34c5cb tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6" status: 404 len: 111 microversion: 2.1 time: 0.037197 Oct 05 03:39:20.020751 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3721/7428] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:39:19 2022] GET /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:39:20.027235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f6ee7684-2976-4247-8d24-6ed900ccf4b2 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:20.027864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f6ee7684-2976-4247-8d24-6ed900ccf4b2 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: a06d8596-1845-427b-ac96-e04047813867] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:20.035378 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6ee7684-2976-4247-8d24-6ed900ccf4b2 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:20.035878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6ee7684-2976-4247-8d24-6ed900ccf4b2 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:20.036325 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6ee7684-2976-4247-8d24-6ed900ccf4b2 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:20.037065 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6ee7684-2976-4247-8d24-6ed900ccf4b2 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:20.037535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6ee7684-2976-4247-8d24-6ed900ccf4b2 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:20.037971 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f6ee7684-2976-4247-8d24-6ed900ccf4b2 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:20.166362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f6ee7684-2976-4247-8d24-6ed900ccf4b2 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b0fcd349d4c3eae51feadde81b59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926dfcc8429e4fdd99cb433569c494bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:39:20.174636 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f6ee7684-2976-4247-8d24-6ed900ccf4b2 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867" status: 200 len: 1507 microversion: 2.1 time: 0.151341 Oct 05 03:39:20.175205 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3708/7429] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:39:20 2022] GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:39:20.197944 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-352683ac-f712-474c-aa87-e94d34ceee15 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:39:20.200153 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-352683ac-f712-474c-aa87-e94d34ceee15 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: bf2be979-d9a7-45ee-9003-ea75e02278fe] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:20.205815 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-352683ac-f712-474c-aa87-e94d34ceee15 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] HTTP exception thrown: Instance bf2be979-d9a7-45ee-9003-ea75e02278fe could not be found. Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-352683ac-f712-474c-aa87-e94d34ceee15 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Request method failure captured: Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers/bf2be979-d9a7-45ee-9003-ea75e02278fe/action HTTP/1.1 Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 32 Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPxLkr2yX460fU292L_IAJDARAiilkR0icqE7mlIyvPAXnR3gHM8IMzRJ8viABcOFNwcYz-CGH1rG2T0PbDYV_FEB84ocTz8sQJO4Jjunv5AlqnJFPmH9wYvSB1dEuz7A-yyh2CpsHyS0DHt-y76JSNOsnVDtKc0GT5M8Piy0MFC-Cs Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 926dfcc8429e4fdd99cb433569c494bc Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersNegativeTestJSON-138757177 Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/926dfcc8429e4fdd99cb433569c494bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/926dfcc8429e4fdd99cb433569c494bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/926dfcc8429e4fdd99cb433569c494bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_926dfcc8429e4fdd99cb433569c494bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersNegativeTestJSON-138757177 Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 926dfcc8429e4fdd99cb433569c494bc Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersNegativeTestJSON-138757177 Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersNegativeTestJSON-138757177-project Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 377b0fcd349d4c3eae51feadde81b59f Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersNegativeTestJSON-138757177-project Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: {"resize": {"flavorRef": "452"}} Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance bf2be979-d9a7-45ee-9003-ea75e02278fe could not be found. Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'bf2be979-d9a7-45ee-9003-ea75e02278fe', 'body': {'resize': {'flavorRef': '452'}}} Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf2be979-d9a7-45ee-9003-ea75e02278fe could not be found. Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:39:20.207730 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:39:20.212424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf2be979-d9a7-45ee-9003-ea75e02278fe could not be found. Oct 05 03:39:20.212424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:39:20.212424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:39:20.212424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:39:20.212424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:39:20.212424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:39:20.212424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:39:20.212424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:39:20.212424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:39:20.212424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf2be979-d9a7-45ee-9003-ea75e02278fe could not be found. Oct 05 03:39:20.212424 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:39:20.212424 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-352683ac-f712-474c-aa87-e94d34ceee15 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Returning 404 to user: Instance bf2be979-d9a7-45ee-9003-ea75e02278fe could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:39:20.212424 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-352683ac-f712-474c-aa87-e94d34ceee15 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "POST /compute/v2.1/servers/bf2be979-d9a7-45ee-9003-ea75e02278fe/action" status: 404 len: 111 microversion: 2.1 time: 0.015050 Oct 05 03:39:20.212424 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3722/7430] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:39:20 2022] POST /compute/v2.1/servers/bf2be979-d9a7-45ee-9003-ea75e02278fe/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:39:20.217619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-53fd3a8b-b878-4df1-9acd-d44b9459d519 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:20.218256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-53fd3a8b-b878-4df1-9acd-d44b9459d519 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: a06d8596-1845-427b-ac96-e04047813867] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:20.224660 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-53fd3a8b-b878-4df1-9acd-d44b9459d519 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:20.225263 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-53fd3a8b-b878-4df1-9acd-d44b9459d519 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:20.225725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-53fd3a8b-b878-4df1-9acd-d44b9459d519 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:20.226697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-53fd3a8b-b878-4df1-9acd-d44b9459d519 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:20.227175 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-53fd3a8b-b878-4df1-9acd-d44b9459d519 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:20.227619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-53fd3a8b-b878-4df1-9acd-d44b9459d519 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:20.246968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:39:20.361899 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-53fd3a8b-b878-4df1-9acd-d44b9459d519 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b0fcd349d4c3eae51feadde81b59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926dfcc8429e4fdd99cb433569c494bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:39:20.369702 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-53fd3a8b-b878-4df1-9acd-d44b9459d519 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867" status: 200 len: 1507 microversion: 2.1 time: 0.155905 Oct 05 03:39:20.370282 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3709/7431] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:39:20 2022] GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:39:20.392421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7ac515a7-c2c0-42fb-b6ea-23e2568443d8 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:20.393066 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7ac515a7-c2c0-42fb-b6ea-23e2568443d8 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: a06d8596-1845-427b-ac96-e04047813867] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:20.402342 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ac515a7-c2c0-42fb-b6ea-23e2568443d8 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:20.402834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ac515a7-c2c0-42fb-b6ea-23e2568443d8 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:20.403281 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ac515a7-c2c0-42fb-b6ea-23e2568443d8 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:20.403975 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ac515a7-c2c0-42fb-b6ea-23e2568443d8 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:20.404439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ac515a7-c2c0-42fb-b6ea-23e2568443d8 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:20.404868 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ac515a7-c2c0-42fb-b6ea-23e2568443d8 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:20.536192 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7ac515a7-c2c0-42fb-b6ea-23e2568443d8 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b0fcd349d4c3eae51feadde81b59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926dfcc8429e4fdd99cb433569c494bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:39:20.543971 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7ac515a7-c2c0-42fb-b6ea-23e2568443d8 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867" status: 200 len: 1507 microversion: 2.1 time: 0.155375 Oct 05 03:39:20.544552 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3723/7432] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:39:20 2022] GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:39:20.567364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-71001227-7460-481d-b63b-ce29bda03d9e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "31d9f8b7-71cb-451a-9c5e-af8437628dd9"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:39:20.569785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-71001227-7460-481d-b63b-ce29bda03d9e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: a06d8596-1845-427b-ac96-e04047813867] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:20.575765 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71001227-7460-481d-b63b-ce29bda03d9e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:20.576265 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71001227-7460-481d-b63b-ce29bda03d9e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:20.576719 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71001227-7460-481d-b63b-ce29bda03d9e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:20.577523 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71001227-7460-481d-b63b-ce29bda03d9e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:20.578069 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71001227-7460-481d-b63b-ce29bda03d9e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:20.578603 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-71001227-7460-481d-b63b-ce29bda03d9e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:20.611475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-71001227-7460-481d-b63b-ce29bda03d9e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '377b0fcd349d4c3eae51feadde81b59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926dfcc8429e4fdd99cb433569c494bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:39:20.616244 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-71001227-7460-481d-b63b-ce29bda03d9e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] HTTP exception thrown: Flavor 31d9f8b7-71cb-451a-9c5e-af8437628dd9 could not be found. Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-71001227-7460-481d-b63b-ce29bda03d9e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Request method failure captured: Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: request: POST /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867/action HTTP/1.1 Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 65 Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPxLkr2yX460fU292L_IAJDARAiilkR0icqE7mlIyvPAXnR3gHM8IMzRJ8viABcOFNwcYz-CGH1rG2T0PbDYV_FEB84ocTz8sQJO4Jjunv5AlqnJFPmH9wYvSB1dEuz7A-yyh2CpsHyS0DHt-y76JSNOsnVDtKc0GT5M8Piy0MFC-Cs Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 926dfcc8429e4fdd99cb433569c494bc Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersNegativeTestJSON-138757177 Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/926dfcc8429e4fdd99cb433569c494bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/926dfcc8429e4fdd99cb433569c494bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/926dfcc8429e4fdd99cb433569c494bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_926dfcc8429e4fdd99cb433569c494bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersNegativeTestJSON-138757177 Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 926dfcc8429e4fdd99cb433569c494bc Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-138757177 Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersNegativeTestJSON-138757177-project Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 377b0fcd349d4c3eae51feadde81b59f Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersNegativeTestJSON-138757177-project Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: {"resize": {"flavorRef": "31d9f8b7-71cb-451a-9c5e-af8437628dd9"}} Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: exception: Flavor 31d9f8b7-71cb-451a-9c5e-af8437628dd9 could not be found. Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'a06d8596-1845-427b-ac96-e04047813867', 'body': {'resize': {'flavorRef': '31d9f8b7-71cb-451a-9c5e-af8437628dd9'}}} Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:39:20.618171 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 05 03:39:20.622718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 05 03:39:20.622718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 31d9f8b7-71cb-451a-9c5e-af8437628dd9 could not be found. Oct 05 03:39:20.622718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:39:20.622718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:39:20.622718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:39:20.622718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:39:20.622718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:39:20.622718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:39:20.622718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:39:20.622718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:39:20.622718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:39:20.622718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:39:20.622718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 03:39:20.622718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 03:39:20.622718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 05 03:39:20.622718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 05 03:39:20.622718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 05 03:39:20.622718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 05 03:39:20.622718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 31d9f8b7-71cb-451a-9c5e-af8437628dd9 could not be found. Oct 05 03:39:20.622718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:39:20.622718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:39:20.622718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:39:20.622718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:39:20.622718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:39:20.622718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:39:20.622718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:39:20.622718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:39:20.622718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 31d9f8b7-71cb-451a-9c5e-af8437628dd9 could not be found. Oct 05 03:39:20.622718 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:39:20.622718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-71001227-7460-481d-b63b-ce29bda03d9e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Returning 400 to user: Flavor 31d9f8b7-71cb-451a-9c5e-af8437628dd9 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:39:20.622718 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-71001227-7460-481d-b63b-ce29bda03d9e tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "POST /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867/action" status: 400 len: 107 microversion: 2.1 time: 0.056312 Oct 05 03:39:20.622718 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3710/7433] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:39:20 2022] POST /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867/action => generated 107 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 03:39:20.628427 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e5ff589d-73de-44bb-b8a8-7d09043f8f1a tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:20.629133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e5ff589d-73de-44bb-b8a8-7d09043f8f1a tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: a06d8596-1845-427b-ac96-e04047813867] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:20.635023 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5ff589d-73de-44bb-b8a8-7d09043f8f1a tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:20.635505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5ff589d-73de-44bb-b8a8-7d09043f8f1a tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:20.635936 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5ff589d-73de-44bb-b8a8-7d09043f8f1a tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:20.636612 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5ff589d-73de-44bb-b8a8-7d09043f8f1a tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:20.637089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5ff589d-73de-44bb-b8a8-7d09043f8f1a tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:20.637509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e5ff589d-73de-44bb-b8a8-7d09043f8f1a tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:20.763479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e5ff589d-73de-44bb-b8a8-7d09043f8f1a tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b0fcd349d4c3eae51feadde81b59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926dfcc8429e4fdd99cb433569c494bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:39:20.771922 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e5ff589d-73de-44bb-b8a8-7d09043f8f1a tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867" status: 200 len: 1507 microversion: 2.1 time: 0.147327 Oct 05 03:39:20.772490 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3724/7434] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:39:20 2022] GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867 => generated 1507 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:39:20.794873 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-83241a08-19a0-4cda-99a7-4a8baf44efbf tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:20.795492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-83241a08-19a0-4cda-99a7-4a8baf44efbf tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: a06d8596-1845-427b-ac96-e04047813867] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:20.802014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83241a08-19a0-4cda-99a7-4a8baf44efbf tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:20.802504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83241a08-19a0-4cda-99a7-4a8baf44efbf tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:20.802949 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83241a08-19a0-4cda-99a7-4a8baf44efbf tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:20.803638 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83241a08-19a0-4cda-99a7-4a8baf44efbf tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:20.804104 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83241a08-19a0-4cda-99a7-4a8baf44efbf tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:20.804539 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-83241a08-19a0-4cda-99a7-4a8baf44efbf tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:20.935306 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-83241a08-19a0-4cda-99a7-4a8baf44efbf tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b0fcd349d4c3eae51feadde81b59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926dfcc8429e4fdd99cb433569c494bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:39:20.943108 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-83241a08-19a0-4cda-99a7-4a8baf44efbf tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867" status: 200 len: 1507 microversion: 2.1 time: 0.152031 Oct 05 03:39:20.943686 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3711/7435] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:39:20 2022] GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:39:20.965749 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0214888c-bf74-4a1b-8329-ab7c1fe7458b tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0214888c-bf74-4a1b-8329-ab7c1fe7458b tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Request method failure captured: Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: request: POST /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867/action HTTP/1.1 Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 29 Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPxLkr2yX460fU292L_IAJDARAiilkR0icqE7mlIyvPAXnR3gHM8IMzRJ8viABcOFNwcYz-CGH1rG2T0PbDYV_FEB84ocTz8sQJO4Jjunv5AlqnJFPmH9wYvSB1dEuz7A-yyh2CpsHyS0DHt-y76JSNOsnVDtKc0GT5M8Piy0MFC-Cs Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 926dfcc8429e4fdd99cb433569c494bc Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersNegativeTestJSON-138757177 Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/926dfcc8429e4fdd99cb433569c494bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/926dfcc8429e4fdd99cb433569c494bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/926dfcc8429e4fdd99cb433569c494bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_926dfcc8429e4fdd99cb433569c494bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersNegativeTestJSON-138757177 Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 926dfcc8429e4fdd99cb433569c494bc Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersNegativeTestJSON-138757177 Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersNegativeTestJSON-138757177-project Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 377b0fcd349d4c3eae51feadde81b59f Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersNegativeTestJSON-138757177-project Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: {"resize": {"flavorRef": ""}} Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'a06d8596-1845-427b-ac96-e04047813867', 'body': {'resize': {'flavorRef': ''}}} Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise error Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi '' Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:39:20.969933 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:39:20.975204 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:39:20.975204 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:39:20.975204 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:39:20.975204 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:39:20.975204 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 03:39:20.975204 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 03:39:20.975204 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 05 03:39:20.975204 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:39:20.975204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0214888c-bf74-4a1b-8329-ab7c1fe7458b tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:39:20.975204 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0214888c-bf74-4a1b-8329-ab7c1fe7458b tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "POST /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867/action" status: 400 len: 113 microversion: 2.1 time: 0.009571 Oct 05 03:39:20.975204 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3725/7436] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:39:20 2022] POST /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 03:39:20.980681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1df6d72e-ebfd-40b6-b600-6173b7e79783 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:20.981349 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1df6d72e-ebfd-40b6-b600-6173b7e79783 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: a06d8596-1845-427b-ac96-e04047813867] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:20.987711 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1df6d72e-ebfd-40b6-b600-6173b7e79783 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:20.988217 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1df6d72e-ebfd-40b6-b600-6173b7e79783 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:20.989328 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1df6d72e-ebfd-40b6-b600-6173b7e79783 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:20.990041 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1df6d72e-ebfd-40b6-b600-6173b7e79783 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:20.990522 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1df6d72e-ebfd-40b6-b600-6173b7e79783 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:20.990970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1df6d72e-ebfd-40b6-b600-6173b7e79783 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:21.118241 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1df6d72e-ebfd-40b6-b600-6173b7e79783 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b0fcd349d4c3eae51feadde81b59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926dfcc8429e4fdd99cb433569c494bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:39:21.126728 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1df6d72e-ebfd-40b6-b600-6173b7e79783 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867" status: 200 len: 1507 microversion: 2.1 time: 0.150525 Oct 05 03:39:21.127301 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3712/7437] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:39:20 2022] GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:39:21.154144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5aa3a193-bc6c-4885-b37c-a818d4f0e702 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:21.154659 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5aa3a193-bc6c-4885-b37c-a818d4f0e702 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: 90af1b77-e790-4879-b0a1-e87ac2fbf7c6] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:21.162032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5aa3a193-bc6c-4885-b37c-a818d4f0e702 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:21.162522 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5aa3a193-bc6c-4885-b37c-a818d4f0e702 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:21.162961 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5aa3a193-bc6c-4885-b37c-a818d4f0e702 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:21.163653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5aa3a193-bc6c-4885-b37c-a818d4f0e702 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:21.164113 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5aa3a193-bc6c-4885-b37c-a818d4f0e702 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:21.164542 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5aa3a193-bc6c-4885-b37c-a818d4f0e702 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:21.177726 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-5aa3a193-bc6c-4885-b37c-a818d4f0e702 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] HTTP exception thrown: Instance 90af1b77-e790-4879-b0a1-e87ac2fbf7c6 could not be found. Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5aa3a193-bc6c-4885-b37c-a818d4f0e702 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Request method failure captured: Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6 HTTP/1.1 Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPxLkr2yX460fU292L_IAJDARAiilkR0icqE7mlIyvPAXnR3gHM8IMzRJ8viABcOFNwcYz-CGH1rG2T0PbDYV_FEB84ocTz8sQJO4Jjunv5AlqnJFPmH9wYvSB1dEuz7A-yyh2CpsHyS0DHt-y76JSNOsnVDtKc0GT5M8Piy0MFC-Cs Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 926dfcc8429e4fdd99cb433569c494bc Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-ServersNegativeTestJSON-138757177 Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/926dfcc8429e4fdd99cb433569c494bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/926dfcc8429e4fdd99cb433569c494bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/926dfcc8429e4fdd99cb433569c494bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_926dfcc8429e4fdd99cb433569c494bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-ServersNegativeTestJSON-138757177 Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 926dfcc8429e4fdd99cb433569c494bc Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-ServersNegativeTestJSON-138757177 Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-ServersNegativeTestJSON-138757177-project Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 377b0fcd349d4c3eae51feadde81b59f Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-ServersNegativeTestJSON-138757177-project Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 90af1b77-e790-4879-b0a1-e87ac2fbf7c6 could not be found. Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '90af1b77-e790-4879-b0a1-e87ac2fbf7c6'} Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90af1b77-e790-4879-b0a1-e87ac2fbf7c6 could not be found. Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:39:21.179305 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:39:21.183390 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90af1b77-e790-4879-b0a1-e87ac2fbf7c6 could not be found. Oct 05 03:39:21.183390 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:39:21.183390 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:39:21.183390 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:39:21.183390 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:39:21.183390 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:39:21.183390 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:39:21.183390 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:39:21.183390 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:39:21.183390 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90af1b77-e790-4879-b0a1-e87ac2fbf7c6 could not be found. Oct 05 03:39:21.183390 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:39:21.183390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5aa3a193-bc6c-4885-b37c-a818d4f0e702 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Returning 404 to user: Instance 90af1b77-e790-4879-b0a1-e87ac2fbf7c6 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:39:21.183390 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5aa3a193-bc6c-4885-b37c-a818d4f0e702 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "DELETE /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6" status: 404 len: 111 microversion: 2.1 time: 0.031529 Oct 05 03:39:21.183390 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3726/7438] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:39:21 2022] DELETE /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:39:21.190121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5e007aaf-d90b-4f9a-90d4-a367cbb784ec tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:21.190784 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5e007aaf-d90b-4f9a-90d4-a367cbb784ec tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: 90af1b77-e790-4879-b0a1-e87ac2fbf7c6] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:21.196694 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e007aaf-d90b-4f9a-90d4-a367cbb784ec tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:21.197270 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e007aaf-d90b-4f9a-90d4-a367cbb784ec tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:21.197720 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e007aaf-d90b-4f9a-90d4-a367cbb784ec tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:21.198453 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e007aaf-d90b-4f9a-90d4-a367cbb784ec tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:21.198928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e007aaf-d90b-4f9a-90d4-a367cbb784ec tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:21.199368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e007aaf-d90b-4f9a-90d4-a367cbb784ec tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:21.213546 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-5e007aaf-d90b-4f9a-90d4-a367cbb784ec tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] HTTP exception thrown: Instance 90af1b77-e790-4879-b0a1-e87ac2fbf7c6 could not be found. Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5e007aaf-d90b-4f9a-90d4-a367cbb784ec tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Request method failure captured: Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6 HTTP/1.1 Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPxLkr2yX460fU292L_IAJDARAiilkR0icqE7mlIyvPAXnR3gHM8IMzRJ8viABcOFNwcYz-CGH1rG2T0PbDYV_FEB84ocTz8sQJO4Jjunv5AlqnJFPmH9wYvSB1dEuz7A-yyh2CpsHyS0DHt-y76JSNOsnVDtKc0GT5M8Piy0MFC-Cs Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 926dfcc8429e4fdd99cb433569c494bc Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersNegativeTestJSON-138757177 Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/926dfcc8429e4fdd99cb433569c494bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/926dfcc8429e4fdd99cb433569c494bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/926dfcc8429e4fdd99cb433569c494bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_926dfcc8429e4fdd99cb433569c494bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersNegativeTestJSON-138757177 Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 926dfcc8429e4fdd99cb433569c494bc Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-138757177 Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersNegativeTestJSON-138757177-project Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 377b0fcd349d4c3eae51feadde81b59f Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersNegativeTestJSON-138757177-project Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 90af1b77-e790-4879-b0a1-e87ac2fbf7c6 could not be found. Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': '90af1b77-e790-4879-b0a1-e87ac2fbf7c6'} Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90af1b77-e790-4879-b0a1-e87ac2fbf7c6 could not be found. Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90af1b77-e790-4879-b0a1-e87ac2fbf7c6 could not be found. Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:39:21.215092 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:39:21.219553 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:39:21.219553 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:39:21.219553 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:39:21.219553 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:39:21.219553 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:39:21.219553 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90af1b77-e790-4879-b0a1-e87ac2fbf7c6 could not be found. Oct 05 03:39:21.219553 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:39:21.219553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5e007aaf-d90b-4f9a-90d4-a367cbb784ec tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Returning 404 to user: Instance 90af1b77-e790-4879-b0a1-e87ac2fbf7c6 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:39:21.219553 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5e007aaf-d90b-4f9a-90d4-a367cbb784ec tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6" status: 404 len: 111 microversion: 2.1 time: 0.030946 Oct 05 03:39:21.219553 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3713/7439] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:39:21 2022] GET /compute/v2.1/servers/90af1b77-e790-4879-b0a1-e87ac2fbf7c6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:39:21.224922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c63558ad-0bf2-4500-8ed6-828b499de694 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:21.225473 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c63558ad-0bf2-4500-8ed6-828b499de694 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: a06d8596-1845-427b-ac96-e04047813867] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:21.231645 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c63558ad-0bf2-4500-8ed6-828b499de694 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:21.232128 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c63558ad-0bf2-4500-8ed6-828b499de694 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:21.232564 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c63558ad-0bf2-4500-8ed6-828b499de694 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:21.233287 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c63558ad-0bf2-4500-8ed6-828b499de694 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:21.233744 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c63558ad-0bf2-4500-8ed6-828b499de694 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:21.234166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c63558ad-0bf2-4500-8ed6-828b499de694 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:21.261166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c63558ad-0bf2-4500-8ed6-828b499de694 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: a06d8596-1845-427b-ac96-e04047813867] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:39:21.336735 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c63558ad-0bf2-4500-8ed6-828b499de694 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867" status: 204 len: 0 microversion: 2.1 time: 0.115205 Oct 05 03:39:21.337168 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3727/7440] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:39:21 2022] DELETE /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:39:21.345710 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4a9ef912-f0bf-4b5d-8c0a-25e2fe48ab3f tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:21.346434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4a9ef912-f0bf-4b5d-8c0a-25e2fe48ab3f tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: a06d8596-1845-427b-ac96-e04047813867] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:21.354008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a9ef912-f0bf-4b5d-8c0a-25e2fe48ab3f tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:21.354880 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a9ef912-f0bf-4b5d-8c0a-25e2fe48ab3f tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:21.355341 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a9ef912-f0bf-4b5d-8c0a-25e2fe48ab3f tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:21.356046 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a9ef912-f0bf-4b5d-8c0a-25e2fe48ab3f tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:21.356519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a9ef912-f0bf-4b5d-8c0a-25e2fe48ab3f tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:21.356986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4a9ef912-f0bf-4b5d-8c0a-25e2fe48ab3f tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:21.487819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4a9ef912-f0bf-4b5d-8c0a-25e2fe48ab3f tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b0fcd349d4c3eae51feadde81b59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926dfcc8429e4fdd99cb433569c494bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:39:21.495557 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4a9ef912-f0bf-4b5d-8c0a-25e2fe48ab3f tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867" status: 200 len: 1513 microversion: 2.1 time: 0.154221 Oct 05 03:39:21.496129 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3714/7441] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:39:21 2022] GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:39:22.519658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1c3a2b16-8ecb-4c1d-805a-ee797f1cd59a tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:22.520410 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1c3a2b16-8ecb-4c1d-805a-ee797f1cd59a tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: a06d8596-1845-427b-ac96-e04047813867] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:22.527276 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c3a2b16-8ecb-4c1d-805a-ee797f1cd59a tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:22.527764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c3a2b16-8ecb-4c1d-805a-ee797f1cd59a tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:22.528200 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c3a2b16-8ecb-4c1d-805a-ee797f1cd59a tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:22.528886 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c3a2b16-8ecb-4c1d-805a-ee797f1cd59a tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:22.529361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c3a2b16-8ecb-4c1d-805a-ee797f1cd59a tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:22.529785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c3a2b16-8ecb-4c1d-805a-ee797f1cd59a tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:22.673225 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1c3a2b16-8ecb-4c1d-805a-ee797f1cd59a tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b0fcd349d4c3eae51feadde81b59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926dfcc8429e4fdd99cb433569c494bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:39:22.681103 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1c3a2b16-8ecb-4c1d-805a-ee797f1cd59a tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867" status: 200 len: 1513 microversion: 2.1 time: 0.165883 Oct 05 03:39:22.681676 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3728/7442] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:39:22 2022] GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:39:23.512682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-ac4cf09c-9f62-4022-867c-5d90434fce82 req-72e8633e-1736-467f-b2d0-0e79c61d2b6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a06d8596-1845-427b-ac96-e04047813867", "name": "network-vif-deleted", "tag": "b4c494bb-094b-4e32-8000-e04fbd07dc73"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:39:23.519866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:39:23.526408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ac4cf09c-9f62-4022-867c-5d90434fce82 req-72e8633e-1736-467f-b2d0-0e79c61d2b6a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:23.527276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ac4cf09c-9f62-4022-867c-5d90434fce82 req-72e8633e-1736-467f-b2d0-0e79c61d2b6a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:23.528053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ac4cf09c-9f62-4022-867c-5d90434fce82 req-72e8633e-1736-467f-b2d0-0e79c61d2b6a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:23.541706 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-ac4cf09c-9f62-4022-867c-5d90434fce82 req-72e8633e-1736-467f-b2d0-0e79c61d2b6a service nova] Creating event network-vif-deleted:b4c494bb-094b-4e32-8000-e04fbd07dc73 for instance a06d8596-1845-427b-ac96-e04047813867 on n-h1-858272-3 Oct 05 03:39:23.551151 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-ac4cf09c-9f62-4022-867c-5d90434fce82 req-72e8633e-1736-467f-b2d0-0e79c61d2b6a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042147 Oct 05 03:39:23.552020 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3715/7443] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:39:23.704442 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8c0d8717-0b62-4aea-a86e-da2e1b5f1e49 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:23.705097 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8c0d8717-0b62-4aea-a86e-da2e1b5f1e49 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: a06d8596-1845-427b-ac96-e04047813867] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:23.713461 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c0d8717-0b62-4aea-a86e-da2e1b5f1e49 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:23.713950 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c0d8717-0b62-4aea-a86e-da2e1b5f1e49 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:23.714734 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c0d8717-0b62-4aea-a86e-da2e1b5f1e49 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:23.715688 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c0d8717-0b62-4aea-a86e-da2e1b5f1e49 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:23.716142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c0d8717-0b62-4aea-a86e-da2e1b5f1e49 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:23.716563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c0d8717-0b62-4aea-a86e-da2e1b5f1e49 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:23.751382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c0d8717-0b62-4aea-a86e-da2e1b5f1e49 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:23.751779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c0d8717-0b62-4aea-a86e-da2e1b5f1e49 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:23.752212 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c0d8717-0b62-4aea-a86e-da2e1b5f1e49 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:23.752649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-8c0d8717-0b62-4aea-a86e-da2e1b5f1e49 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lazy-loading 'fault' on Instance uuid a06d8596-1845-427b-ac96-e04047813867 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:39:23.797677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8c0d8717-0b62-4aea-a86e-da2e1b5f1e49 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '377b0fcd349d4c3eae51feadde81b59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926dfcc8429e4fdd99cb433569c494bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:39:23.805499 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8c0d8717-0b62-4aea-a86e-da2e1b5f1e49 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867" status: 200 len: 1307 microversion: 2.1 time: 0.105629 Oct 05 03:39:23.806062 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3729/7444] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:39:23 2022] GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867 => generated 1307 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:39:24.830999 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-db554c82-46ce-403e-b0a4-5d2d076c3839 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:24.831717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-db554c82-46ce-403e-b0a4-5d2d076c3839 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] [instance: a06d8596-1845-427b-ac96-e04047813867] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:24.837871 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db554c82-46ce-403e-b0a4-5d2d076c3839 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:24.838365 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db554c82-46ce-403e-b0a4-5d2d076c3839 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:24.838809 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db554c82-46ce-403e-b0a4-5d2d076c3839 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:24.839497 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db554c82-46ce-403e-b0a4-5d2d076c3839 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:24.839962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db554c82-46ce-403e-b0a4-5d2d076c3839 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:24.840391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-db554c82-46ce-403e-b0a4-5d2d076c3839 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:24.853738 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-db554c82-46ce-403e-b0a4-5d2d076c3839 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] HTTP exception thrown: Instance a06d8596-1845-427b-ac96-e04047813867 could not be found. Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-db554c82-46ce-403e-b0a4-5d2d076c3839 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Request method failure captured: Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867 HTTP/1.1 Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPxLkr2yX460fU292L_IAJDARAiilkR0icqE7mlIyvPAXnR3gHM8IMzRJ8viABcOFNwcYz-CGH1rG2T0PbDYV_FEB84ocTz8sQJO4Jjunv5AlqnJFPmH9wYvSB1dEuz7A-yyh2CpsHyS0DHt-y76JSNOsnVDtKc0GT5M8Piy0MFC-Cs Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 926dfcc8429e4fdd99cb433569c494bc Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-ServersNegativeTestJSON-138757177 Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/926dfcc8429e4fdd99cb433569c494bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/926dfcc8429e4fdd99cb433569c494bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/926dfcc8429e4fdd99cb433569c494bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_926dfcc8429e4fdd99cb433569c494bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-ServersNegativeTestJSON-138757177 Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 926dfcc8429e4fdd99cb433569c494bc Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-138757177 Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-ServersNegativeTestJSON-138757177-project Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 377b0fcd349d4c3eae51feadde81b59f Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-ServersNegativeTestJSON-138757177-project Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance a06d8596-1845-427b-ac96-e04047813867 could not be found. Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'a06d8596-1845-427b-ac96-e04047813867'} Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a06d8596-1845-427b-ac96-e04047813867 could not be found. Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a06d8596-1845-427b-ac96-e04047813867 could not be found. Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:39:24.855356 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:39:24.860797 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:39:24.860797 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:39:24.860797 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:39:24.860797 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:39:24.860797 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:39:24.860797 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a06d8596-1845-427b-ac96-e04047813867 could not be found. Oct 05 03:39:24.860797 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:39:24.860797 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-db554c82-46ce-403e-b0a4-5d2d076c3839 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] Returning 404 to user: Instance a06d8596-1845-427b-ac96-e04047813867 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:39:24.860797 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-db554c82-46ce-403e-b0a4-5d2d076c3839 tempest-ServersNegativeTestJSON-138757177 tempest-ServersNegativeTestJSON-138757177-project] 10.222.0.16 "GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867" status: 404 len: 111 microversion: 2.1 time: 0.031632 Oct 05 03:39:24.860797 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3716/7445] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:39:24 2022] GET /compute/v2.1/servers/a06d8596-1845-427b-ac96-e04047813867 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:39:57.379097 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:39:57.380515 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:39:57.579989 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8876f2fa-1c1f-4a64-9722-b9d37c593399 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Action: 'create', calling method: .version_select at 0x7fccdec88280>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-419237976", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL16zfHZJMs2/KyekkkDp95eRZDNi/GKHqPf86QyVntwrTIrcEDzcfrjP+jNTabxMYEzd5MYan2z+NE8J56tJCeLWJAtUrhuzG3caCT173lTy10UWufkjjGqDxAGn+Fknw=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:39:57.596797 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-8876f2fa-1c1f-4a64-9722-b9d37c593399 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Getting quotas for project 9c6019d6170d4feea446e485314eaf43. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:39:57.602642 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-8876f2fa-1c1f-4a64-9722-b9d37c593399 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Getting quotas for user a456f2c35f924b058073a994cfdfb8c2 and project 9c6019d6170d4feea446e485314eaf43. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:39:57.633438 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8876f2fa-1c1f-4a64-9722-b9d37c593399 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.260512 Oct 05 03:39:57.634138 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3730/7446] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 03:39:57 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:39:57.692033 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e095cb97-31d6-4455-9ba7-dd985715e68b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1929074760", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-419237976", "networks": [{"uuid": "256d6ebe-5f15-46a1-ac1f-dac7fab91823"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:39:57.701366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:39:57.702049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=30 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:39:57.754127 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-e095cb97-31d6-4455-9ba7-dd985715e68b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] validate_networks() for [('256d6ebe-5f15-46a1-ac1f-dac7fab91823', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:39:58.141494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-e095cb97-31d6-4455-9ba7-dd985715e68b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:39:58.141947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-e095cb97-31d6-4455-9ba7-dd985715e68b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:39:58.142444 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-e095cb97-31d6-4455-9ba7-dd985715e68b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:39:58.142871 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-e095cb97-31d6-4455-9ba7-dd985715e68b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:39:58.143303 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-e095cb97-31d6-4455-9ba7-dd985715e68b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:39:58.152329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e095cb97-31d6-4455-9ba7-dd985715e68b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:58.152834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e095cb97-31d6-4455-9ba7-dd985715e68b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:58.153627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e095cb97-31d6-4455-9ba7-dd985715e68b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:58.154391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e095cb97-31d6-4455-9ba7-dd985715e68b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:58.154874 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e095cb97-31d6-4455-9ba7-dd985715e68b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:58.155317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e095cb97-31d6-4455-9ba7-dd985715e68b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:58.173635 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-e095cb97-31d6-4455-9ba7-dd985715e68b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Getting quotas for project 9c6019d6170d4feea446e485314eaf43. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:39:58.179059 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-e095cb97-31d6-4455-9ba7-dd985715e68b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Getting quotas for user a456f2c35f924b058073a994cfdfb8c2 and project 9c6019d6170d4feea446e485314eaf43. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:39:58.192248 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e095cb97-31d6-4455-9ba7-dd985715e68b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:39:58.194676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e095cb97-31d6-4455-9ba7-dd985715e68b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: d4c34883-c414-4311-a1e0-09512bdb04c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:39:58.243602 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e095cb97-31d6-4455-9ba7-dd985715e68b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.555631 Oct 05 03:39:58.244588 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3717/7447] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:39:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:39:58.256018 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-488e02f5-66ca-47a2-aaf2-1a734cf5f6bd tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:58.256375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-488e02f5-66ca-47a2-aaf2-1a734cf5f6bd tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: d4c34883-c414-4311-a1e0-09512bdb04c4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:58.317982 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-488e02f5-66ca-47a2-aaf2-1a734cf5f6bd tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:39:58.325309 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-488e02f5-66ca-47a2-aaf2-1a734cf5f6bd tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4" status: 200 len: 1262 microversion: 2.1 time: 0.073349 Oct 05 03:39:58.326115 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3731/7448] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:39:58 2022] GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4 => generated 1262 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:39:59.351991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-466b5a1d-143d-4de9-91df-5d7b2515908e tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:39:59.353448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-466b5a1d-143d-4de9-91df-5d7b2515908e tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: d4c34883-c414-4311-a1e0-09512bdb04c4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:39:59.360667 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-466b5a1d-143d-4de9-91df-5d7b2515908e tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:59.361202 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-466b5a1d-143d-4de9-91df-5d7b2515908e tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:59.361841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-466b5a1d-143d-4de9-91df-5d7b2515908e tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:59.362563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-466b5a1d-143d-4de9-91df-5d7b2515908e tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:39:59.363085 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-466b5a1d-143d-4de9-91df-5d7b2515908e tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:39:59.363504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-466b5a1d-143d-4de9-91df-5d7b2515908e tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:39:59.489092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-466b5a1d-143d-4de9-91df-5d7b2515908e tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:39:59.508727 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-466b5a1d-143d-4de9-91df-5d7b2515908e tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4" status: 200 len: 1322 microversion: 2.1 time: 0.162227 Oct 05 03:39:59.511042 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3718/7449] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:39:59 2022] GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:40:00.533463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e4fd096d-7857-4d0a-b07d-f8c41ed11b33 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:00.534080 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e4fd096d-7857-4d0a-b07d-f8c41ed11b33 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: d4c34883-c414-4311-a1e0-09512bdb04c4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:00.545405 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4fd096d-7857-4d0a-b07d-f8c41ed11b33 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:00.545901 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4fd096d-7857-4d0a-b07d-f8c41ed11b33 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:00.546365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4fd096d-7857-4d0a-b07d-f8c41ed11b33 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:00.547649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4fd096d-7857-4d0a-b07d-f8c41ed11b33 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:00.548125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4fd096d-7857-4d0a-b07d-f8c41ed11b33 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:00.548551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e4fd096d-7857-4d0a-b07d-f8c41ed11b33 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:00.760997 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e4fd096d-7857-4d0a-b07d-f8c41ed11b33 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:40:00.769407 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e4fd096d-7857-4d0a-b07d-f8c41ed11b33 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4" status: 200 len: 1362 microversion: 2.1 time: 0.240774 Oct 05 03:40:00.769986 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3732/7450] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:40:00 2022] GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4 => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:40:01.042778 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-5df140ec-9cfb-4236-9cdc-b5f62b9a6974 req-75b58691-05bf-4099-89b0-b1596063c5d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4c34883-c414-4311-a1e0-09512bdb04c4", "tag": "e8b028d1-3e4d-488b-8abc-5b6c002f38b8"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:40:01.055893 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-5df140ec-9cfb-4236-9cdc-b5f62b9a6974 req-75b58691-05bf-4099-89b0-b1596063c5d7 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:01.056436 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-5df140ec-9cfb-4236-9cdc-b5f62b9a6974 req-75b58691-05bf-4099-89b0-b1596063c5d7 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:01.056882 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-5df140ec-9cfb-4236-9cdc-b5f62b9a6974 req-75b58691-05bf-4099-89b0-b1596063c5d7 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:01.070283 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-5df140ec-9cfb-4236-9cdc-b5f62b9a6974 req-75b58691-05bf-4099-89b0-b1596063c5d7 service nova] Creating event network-changed:e8b028d1-3e4d-488b-8abc-5b6c002f38b8 for instance d4c34883-c414-4311-a1e0-09512bdb04c4 on n-h2-858272-3 Oct 05 03:40:01.076150 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-5df140ec-9cfb-4236-9cdc-b5f62b9a6974 req-75b58691-05bf-4099-89b0-b1596063c5d7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038059 Oct 05 03:40:01.076945 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3719/7451] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:40:01.793072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5db8b934-ac52-48cd-b818-e3c70b498906 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:01.793690 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5db8b934-ac52-48cd-b818-e3c70b498906 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: d4c34883-c414-4311-a1e0-09512bdb04c4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:01.801172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5db8b934-ac52-48cd-b818-e3c70b498906 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:01.801660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5db8b934-ac52-48cd-b818-e3c70b498906 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:01.802092 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5db8b934-ac52-48cd-b818-e3c70b498906 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:01.802782 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5db8b934-ac52-48cd-b818-e3c70b498906 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:01.803230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5db8b934-ac52-48cd-b818-e3c70b498906 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:01.803644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5db8b934-ac52-48cd-b818-e3c70b498906 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:01.941029 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5db8b934-ac52-48cd-b818-e3c70b498906 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:40:01.949892 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5db8b934-ac52-48cd-b818-e3c70b498906 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4" status: 200 len: 1362 microversion: 2.1 time: 0.160732 Oct 05 03:40:01.950489 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3733/7452] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:40:01 2022] GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:40:02.974825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-375e0cb2-4b3d-4a23-9db9-7b69c4676ff1 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:02.975535 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-375e0cb2-4b3d-4a23-9db9-7b69c4676ff1 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: d4c34883-c414-4311-a1e0-09512bdb04c4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:02.983233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-375e0cb2-4b3d-4a23-9db9-7b69c4676ff1 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:02.983729 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-375e0cb2-4b3d-4a23-9db9-7b69c4676ff1 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:02.984291 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-375e0cb2-4b3d-4a23-9db9-7b69c4676ff1 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:02.985626 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-375e0cb2-4b3d-4a23-9db9-7b69c4676ff1 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:02.986098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-375e0cb2-4b3d-4a23-9db9-7b69c4676ff1 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:02.986536 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-375e0cb2-4b3d-4a23-9db9-7b69c4676ff1 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:03.115292 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-375e0cb2-4b3d-4a23-9db9-7b69c4676ff1 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:40:03.122945 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-375e0cb2-4b3d-4a23-9db9-7b69c4676ff1 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4" status: 200 len: 1362 microversion: 2.1 time: 0.152400 Oct 05 03:40:03.123518 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3720/7453] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:40:02 2022] GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:40:04.145839 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3ca0939d-b495-482d-b3e8-e007a0504288 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:04.146404 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3ca0939d-b495-482d-b3e8-e007a0504288 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: d4c34883-c414-4311-a1e0-09512bdb04c4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:04.153671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3ca0939d-b495-482d-b3e8-e007a0504288 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:04.154163 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3ca0939d-b495-482d-b3e8-e007a0504288 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:04.154601 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3ca0939d-b495-482d-b3e8-e007a0504288 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:04.155306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3ca0939d-b495-482d-b3e8-e007a0504288 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:04.155767 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3ca0939d-b495-482d-b3e8-e007a0504288 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:04.156405 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3ca0939d-b495-482d-b3e8-e007a0504288 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:04.375108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3ca0939d-b495-482d-b3e8-e007a0504288 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:40:04.383779 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3ca0939d-b495-482d-b3e8-e007a0504288 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4" status: 200 len: 1362 microversion: 2.1 time: 0.241934 Oct 05 03:40:04.384378 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3734/7454] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:40:04 2022] GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4 => generated 1362 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:40:05.408703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1e7af11b-6088-48b2-889a-eb3d1371a931 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:05.417388 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1e7af11b-6088-48b2-889a-eb3d1371a931 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: d4c34883-c414-4311-a1e0-09512bdb04c4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:05.423695 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e7af11b-6088-48b2-889a-eb3d1371a931 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:05.424196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e7af11b-6088-48b2-889a-eb3d1371a931 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:05.424642 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e7af11b-6088-48b2-889a-eb3d1371a931 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:05.425380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e7af11b-6088-48b2-889a-eb3d1371a931 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:05.425846 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e7af11b-6088-48b2-889a-eb3d1371a931 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:05.426309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1e7af11b-6088-48b2-889a-eb3d1371a931 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:05.558108 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1e7af11b-6088-48b2-889a-eb3d1371a931 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:40:05.565797 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1e7af11b-6088-48b2-889a-eb3d1371a931 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4" status: 200 len: 1362 microversion: 2.1 time: 0.162787 Oct 05 03:40:05.566367 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3721/7455] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:40:05 2022] GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:40:05.739841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-aa9a39bf-3c04-4477-9bc3-156d30a1f596 req-db52a656-62f0-49df-ab14-8c9550edf18b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4c34883-c414-4311-a1e0-09512bdb04c4", "name": "network-vif-plugged", "status": "completed", "tag": "e8b028d1-3e4d-488b-8abc-5b6c002f38b8"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:40:05.752013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-aa9a39bf-3c04-4477-9bc3-156d30a1f596 req-db52a656-62f0-49df-ab14-8c9550edf18b service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:05.752687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-aa9a39bf-3c04-4477-9bc3-156d30a1f596 req-db52a656-62f0-49df-ab14-8c9550edf18b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:05.753172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-aa9a39bf-3c04-4477-9bc3-156d30a1f596 req-db52a656-62f0-49df-ab14-8c9550edf18b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:05.774607 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-aa9a39bf-3c04-4477-9bc3-156d30a1f596 req-db52a656-62f0-49df-ab14-8c9550edf18b service nova] Creating event network-vif-plugged:e8b028d1-3e4d-488b-8abc-5b6c002f38b8 for instance d4c34883-c414-4311-a1e0-09512bdb04c4 on n-h2-858272-3 Oct 05 03:40:05.779596 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-aa9a39bf-3c04-4477-9bc3-156d30a1f596 req-db52a656-62f0-49df-ab14-8c9550edf18b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043670 Oct 05 03:40:05.780424 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3735/7456] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:40:06.589317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-36b8f5d5-b52a-4745-8485-135afcdfec0b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:06.589955 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-36b8f5d5-b52a-4745-8485-135afcdfec0b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: d4c34883-c414-4311-a1e0-09512bdb04c4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:06.597538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36b8f5d5-b52a-4745-8485-135afcdfec0b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:06.598046 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36b8f5d5-b52a-4745-8485-135afcdfec0b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:06.598507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36b8f5d5-b52a-4745-8485-135afcdfec0b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:06.599242 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36b8f5d5-b52a-4745-8485-135afcdfec0b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:06.599733 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36b8f5d5-b52a-4745-8485-135afcdfec0b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:06.600207 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36b8f5d5-b52a-4745-8485-135afcdfec0b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:06.766416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-36b8f5d5-b52a-4745-8485-135afcdfec0b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:40:06.774248 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-36b8f5d5-b52a-4745-8485-135afcdfec0b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4" status: 200 len: 1362 microversion: 2.1 time: 0.189054 Oct 05 03:40:06.774829 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3722/7457] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:40:06 2022] GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:40:07.801514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6b321e92-918e-4c1d-a998-1a9b845d381d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:07.802206 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6b321e92-918e-4c1d-a998-1a9b845d381d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: d4c34883-c414-4311-a1e0-09512bdb04c4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:07.808356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b321e92-918e-4c1d-a998-1a9b845d381d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:07.808836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b321e92-918e-4c1d-a998-1a9b845d381d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:07.809300 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b321e92-918e-4c1d-a998-1a9b845d381d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:07.809980 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b321e92-918e-4c1d-a998-1a9b845d381d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:07.810427 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b321e92-918e-4c1d-a998-1a9b845d381d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:07.810847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b321e92-918e-4c1d-a998-1a9b845d381d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:07.941344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6b321e92-918e-4c1d-a998-1a9b845d381d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:40:07.949124 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6b321e92-918e-4c1d-a998-1a9b845d381d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4" status: 200 len: 1553 microversion: 2.1 time: 0.153257 Oct 05 03:40:07.949691 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3736/7458] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:40:07 2022] GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:40:07.973086 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fe2f9920-42eb-4082-b848-76e76ceae883 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:07.973718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fe2f9920-42eb-4082-b848-76e76ceae883 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: d4c34883-c414-4311-a1e0-09512bdb04c4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:07.980877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe2f9920-42eb-4082-b848-76e76ceae883 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:07.981407 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe2f9920-42eb-4082-b848-76e76ceae883 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:07.981882 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe2f9920-42eb-4082-b848-76e76ceae883 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:07.982581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe2f9920-42eb-4082-b848-76e76ceae883 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:07.983046 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe2f9920-42eb-4082-b848-76e76ceae883 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:07.983481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fe2f9920-42eb-4082-b848-76e76ceae883 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:08.113685 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fe2f9920-42eb-4082-b848-76e76ceae883 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:40:08.121549 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fe2f9920-42eb-4082-b848-76e76ceae883 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4" status: 200 len: 1553 microversion: 2.1 time: 0.153391 Oct 05 03:40:08.122119 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3723/7459] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:40:07 2022] GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:40:09.749356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-009751cd-708d-4461-a30f-05b5e520e5fd tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2af8b87b-e5e3-44d5-aef8-7153f21de1fd"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:40:09.751938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-009751cd-708d-4461-a30f-05b5e520e5fd tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: d4c34883-c414-4311-a1e0-09512bdb04c4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:09.754318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:40:09.759654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-009751cd-708d-4461-a30f-05b5e520e5fd tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:09.760141 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-009751cd-708d-4461-a30f-05b5e520e5fd tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:09.760578 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-009751cd-708d-4461-a30f-05b5e520e5fd tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:09.761317 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-009751cd-708d-4461-a30f-05b5e520e5fd tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:09.761776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-009751cd-708d-4461-a30f-05b5e520e5fd tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:09.762201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-009751cd-708d-4461-a30f-05b5e520e5fd tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:10.033616 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-009751cd-708d-4461-a30f-05b5e520e5fd tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "POST /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287960 Oct 05 03:40:10.034261 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3737/7460] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 03:40:09 2022] POST /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:40:20.764071 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fabb7802-fd78-42f7-9620-55b6e102b6f2 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:20.764601 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fabb7802-fd78-42f7-9620-55b6e102b6f2 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: d4c34883-c414-4311-a1e0-09512bdb04c4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:20.767307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:40:20.768130 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:40:20.769571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:40:20.770435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=34 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:40:20.778049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fabb7802-fd78-42f7-9620-55b6e102b6f2 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:20.778552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fabb7802-fd78-42f7-9620-55b6e102b6f2 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:20.779009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fabb7802-fd78-42f7-9620-55b6e102b6f2 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:20.779717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fabb7802-fd78-42f7-9620-55b6e102b6f2 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:20.780189 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fabb7802-fd78-42f7-9620-55b6e102b6f2 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:20.780626 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fabb7802-fd78-42f7-9620-55b6e102b6f2 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:20.861145 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-fabb7802-fd78-42f7-9620-55b6e102b6f2 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lazy-loading 'services' on Instance uuid d4c34883-c414-4311-a1e0-09512bdb04c4 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:40:20.934350 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fabb7802-fd78-42f7-9620-55b6e102b6f2 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4/os-volume_attachments/2af8b87b-e5e3-44d5-aef8-7153f21de1fd" status: 202 len: 0 microversion: 2.1 time: 0.174180 Oct 05 03:40:20.935053 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3724/7461] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 03:40:20 2022] DELETE /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4/os-volume_attachments/2af8b87b-e5e3-44d5-aef8-7153f21de1fd => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:40:20.944699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2e806a4e-8bf0-40d7-8d26-d447097b57c5 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:20.947304 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2e806a4e-8bf0-40d7-8d26-d447097b57c5 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: d4c34883-c414-4311-a1e0-09512bdb04c4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:20.950303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:40:20.951184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:40:20.959210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e806a4e-8bf0-40d7-8d26-d447097b57c5 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:20.959708 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e806a4e-8bf0-40d7-8d26-d447097b57c5 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:20.960148 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e806a4e-8bf0-40d7-8d26-d447097b57c5 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:20.960867 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e806a4e-8bf0-40d7-8d26-d447097b57c5 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:20.961360 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e806a4e-8bf0-40d7-8d26-d447097b57c5 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:20.961792 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2e806a4e-8bf0-40d7-8d26-d447097b57c5 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:20.995753 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2e806a4e-8bf0-40d7-8d26-d447097b57c5 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055471 Oct 05 03:40:20.996327 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3738/7462] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:40:20 2022] GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:40:22.010649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6a0c6e50-f5c7-4f7e-a0c0-4ed0391902c7 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:22.013240 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6a0c6e50-f5c7-4f7e-a0c0-4ed0391902c7 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: d4c34883-c414-4311-a1e0-09512bdb04c4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:22.019654 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a0c6e50-f5c7-4f7e-a0c0-4ed0391902c7 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:22.020160 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a0c6e50-f5c7-4f7e-a0c0-4ed0391902c7 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:22.020617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a0c6e50-f5c7-4f7e-a0c0-4ed0391902c7 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:22.021372 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a0c6e50-f5c7-4f7e-a0c0-4ed0391902c7 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:22.021853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a0c6e50-f5c7-4f7e-a0c0-4ed0391902c7 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:22.022295 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6a0c6e50-f5c7-4f7e-a0c0-4ed0391902c7 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:22.056021 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6a0c6e50-f5c7-4f7e-a0c0-4ed0391902c7 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050677 Oct 05 03:40:22.056592 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3725/7463] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:40:22 2022] GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:40:23.068384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d5baca15-7e64-45d5-872b-3d6b65473ca5 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:23.070923 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d5baca15-7e64-45d5-872b-3d6b65473ca5 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: d4c34883-c414-4311-a1e0-09512bdb04c4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:23.078133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5baca15-7e64-45d5-872b-3d6b65473ca5 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:23.078629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5baca15-7e64-45d5-872b-3d6b65473ca5 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:23.079072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5baca15-7e64-45d5-872b-3d6b65473ca5 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:23.079784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5baca15-7e64-45d5-872b-3d6b65473ca5 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:23.080241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5baca15-7e64-45d5-872b-3d6b65473ca5 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:23.080670 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d5baca15-7e64-45d5-872b-3d6b65473ca5 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:23.117111 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d5baca15-7e64-45d5-872b-3d6b65473ca5 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052827 Oct 05 03:40:23.117723 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3739/7464] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:40:23 2022] GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:40:24.130481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-72164020-1f9e-408c-a95b-05a1b8e7e7dd tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:24.132770 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-72164020-1f9e-408c-a95b-05a1b8e7e7dd tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: d4c34883-c414-4311-a1e0-09512bdb04c4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:24.139666 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72164020-1f9e-408c-a95b-05a1b8e7e7dd tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:24.140166 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72164020-1f9e-408c-a95b-05a1b8e7e7dd tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:24.140660 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72164020-1f9e-408c-a95b-05a1b8e7e7dd tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:24.141399 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72164020-1f9e-408c-a95b-05a1b8e7e7dd tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:24.141871 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72164020-1f9e-408c-a95b-05a1b8e7e7dd tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:24.142309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72164020-1f9e-408c-a95b-05a1b8e7e7dd tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:24.172667 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-72164020-1f9e-408c-a95b-05a1b8e7e7dd tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045211 Oct 05 03:40:24.172667 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3726/7465] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:40:24 2022] GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:40:25.183886 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-48ab1462-4279-445e-bb3d-2459ec0a2be2 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:25.186027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-48ab1462-4279-445e-bb3d-2459ec0a2be2 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: d4c34883-c414-4311-a1e0-09512bdb04c4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:25.193669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48ab1462-4279-445e-bb3d-2459ec0a2be2 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:25.194151 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48ab1462-4279-445e-bb3d-2459ec0a2be2 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:25.194585 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48ab1462-4279-445e-bb3d-2459ec0a2be2 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:25.195277 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48ab1462-4279-445e-bb3d-2459ec0a2be2 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:25.195728 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48ab1462-4279-445e-bb3d-2459ec0a2be2 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:25.196148 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48ab1462-4279-445e-bb3d-2459ec0a2be2 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:25.227127 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-48ab1462-4279-445e-bb3d-2459ec0a2be2 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047003 Oct 05 03:40:25.227906 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3740/7466] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:40:25 2022] GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:40:26.239730 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-89eff65d-df2c-4585-a653-ab335059baf8 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:26.241968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-89eff65d-df2c-4585-a653-ab335059baf8 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: d4c34883-c414-4311-a1e0-09512bdb04c4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:26.248762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89eff65d-df2c-4585-a653-ab335059baf8 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:26.249307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89eff65d-df2c-4585-a653-ab335059baf8 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:26.250283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89eff65d-df2c-4585-a653-ab335059baf8 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:26.251038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89eff65d-df2c-4585-a653-ab335059baf8 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:26.251508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89eff65d-df2c-4585-a653-ab335059baf8 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:26.251950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-89eff65d-df2c-4585-a653-ab335059baf8 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:26.281945 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-89eff65d-df2c-4585-a653-ab335059baf8 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046165 Oct 05 03:40:26.282514 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3727/7467] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:40:26 2022] GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 03:40:26.292994 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-faa6dc4f-ec25-47f0-a450-c1a66758ba72 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:26.293582 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-faa6dc4f-ec25-47f0-a450-c1a66758ba72 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: d4c34883-c414-4311-a1e0-09512bdb04c4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:26.300847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-faa6dc4f-ec25-47f0-a450-c1a66758ba72 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:26.301363 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-faa6dc4f-ec25-47f0-a450-c1a66758ba72 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:26.301797 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-faa6dc4f-ec25-47f0-a450-c1a66758ba72 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:26.302480 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-faa6dc4f-ec25-47f0-a450-c1a66758ba72 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:26.302933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-faa6dc4f-ec25-47f0-a450-c1a66758ba72 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:26.303360 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-faa6dc4f-ec25-47f0-a450-c1a66758ba72 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:26.378855 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-faa6dc4f-ec25-47f0-a450-c1a66758ba72 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] HTTP exception thrown: Instance d4c34883-c414-4311-a1e0-09512bdb04c4 is not attached to volume 2af8b87b-e5e3-44d5-aef8-7153f21de1fd Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-faa6dc4f-ec25-47f0-a450-c1a66758ba72 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Request method failure captured: Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4/os-volume_attachments/2af8b87b-e5e3-44d5-aef8-7153f21de1fd HTTP/1.1 Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPyIjAtnTZXYSozwvFuAQ76_NaGIOV8-MKLfTRWSmedDBCMkvoCwwZL1JSQeolUmHB0Pmmv1sKQwivaq-b9iG5vk5c0yg_KO5Wnpt7PNt35R3TxWVH9QppGM0MXkHjkaVu1fpxfVVxUy4MIwrGr2VPCh1OvwmsFQXGlhazzRKxTIVqY Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 9c6019d6170d4feea446e485314eaf43 Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TestEncryptedCinderVolumes-388256451 Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c6019d6170d4feea446e485314eaf43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c6019d6170d4feea446e485314eaf43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9c6019d6170d4feea446e485314eaf43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9c6019d6170d4feea446e485314eaf43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TestEncryptedCinderVolumes-388256451 Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 9c6019d6170d4feea446e485314eaf43 Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-388256451 Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TestEncryptedCinderVolumes-388256451-project Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: a456f2c35f924b058073a994cfdfb8c2 Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TestEncryptedCinderVolumes-388256451-project Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance d4c34883-c414-4311-a1e0-09512bdb04c4 is not attached to volume 2af8b87b-e5e3-44d5-aef8-7153f21de1fd Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'server_id': 'd4c34883-c414-4311-a1e0-09512bdb04c4', 'id': '2af8b87b-e5e3-44d5-aef8-7153f21de1fd'} Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2af8b87b-e5e3-44d5-aef8-7153f21de1fd. Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4c34883-c414-4311-a1e0-09512bdb04c4 is not attached to volume 2af8b87b-e5e3-44d5-aef8-7153f21de1fd Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:40:26.388986 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:40:26.394038 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:40:26.394038 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:40:26.394038 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4c34883-c414-4311-a1e0-09512bdb04c4 is not attached to volume 2af8b87b-e5e3-44d5-aef8-7153f21de1fd Oct 05 03:40:26.394038 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:40:26.394038 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-faa6dc4f-ec25-47f0-a450-c1a66758ba72 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Returning 404 to user: Instance d4c34883-c414-4311-a1e0-09512bdb04c4 is not attached to volume 2af8b87b-e5e3-44d5-aef8-7153f21de1fd {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:40:26.394038 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-faa6dc4f-ec25-47f0-a450-c1a66758ba72 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4/os-volume_attachments/2af8b87b-e5e3-44d5-aef8-7153f21de1fd" status: 404 len: 154 microversion: 2.1 time: 0.101398 Oct 05 03:40:26.394038 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3741/7468] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 03:40:26 2022] DELETE /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4/os-volume_attachments/2af8b87b-e5e3-44d5-aef8-7153f21de1fd => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:40:29.739362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-30f46a62-3693-48f8-9495-9af6d75439ba tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:29.739938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-30f46a62-3693-48f8-9495-9af6d75439ba tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: d4c34883-c414-4311-a1e0-09512bdb04c4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:29.746872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30f46a62-3693-48f8-9495-9af6d75439ba tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:29.747388 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30f46a62-3693-48f8-9495-9af6d75439ba tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:29.747846 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30f46a62-3693-48f8-9495-9af6d75439ba tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:29.748574 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30f46a62-3693-48f8-9495-9af6d75439ba tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:29.749087 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30f46a62-3693-48f8-9495-9af6d75439ba tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:29.749659 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-30f46a62-3693-48f8-9495-9af6d75439ba tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:29.776557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-30f46a62-3693-48f8-9495-9af6d75439ba tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: d4c34883-c414-4311-a1e0-09512bdb04c4] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:40:29.857012 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-30f46a62-3693-48f8-9495-9af6d75439ba tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4" status: 204 len: 0 microversion: 2.1 time: 0.121108 Oct 05 03:40:29.860984 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3728/7469] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:40:29 2022] DELETE /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:40:29.866413 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7ec46f6e-ec3a-4f00-a14a-e408b494390f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:29.867358 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7ec46f6e-ec3a-4f00-a14a-e408b494390f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: d4c34883-c414-4311-a1e0-09512bdb04c4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:29.875844 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ec46f6e-ec3a-4f00-a14a-e408b494390f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:29.876243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ec46f6e-ec3a-4f00-a14a-e408b494390f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:29.876695 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ec46f6e-ec3a-4f00-a14a-e408b494390f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:29.877439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ec46f6e-ec3a-4f00-a14a-e408b494390f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:29.877903 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ec46f6e-ec3a-4f00-a14a-e408b494390f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:29.878337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ec46f6e-ec3a-4f00-a14a-e408b494390f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:30.011902 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7ec46f6e-ec3a-4f00-a14a-e408b494390f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:40:30.020170 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7ec46f6e-ec3a-4f00-a14a-e408b494390f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4" status: 200 len: 1559 microversion: 2.1 time: 0.157759 Oct 05 03:40:30.020746 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3742/7470] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:40:29 2022] GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:40:31.044212 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7a4a9bd2-a71b-4fdc-b778-5ad9dd18c74f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:31.044952 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7a4a9bd2-a71b-4fdc-b778-5ad9dd18c74f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: d4c34883-c414-4311-a1e0-09512bdb04c4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:31.052367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a4a9bd2-a71b-4fdc-b778-5ad9dd18c74f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:31.052861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a4a9bd2-a71b-4fdc-b778-5ad9dd18c74f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:31.053339 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a4a9bd2-a71b-4fdc-b778-5ad9dd18c74f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:31.054041 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a4a9bd2-a71b-4fdc-b778-5ad9dd18c74f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:31.054505 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a4a9bd2-a71b-4fdc-b778-5ad9dd18c74f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:31.054934 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7a4a9bd2-a71b-4fdc-b778-5ad9dd18c74f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:31.185824 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7a4a9bd2-a71b-4fdc-b778-5ad9dd18c74f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:40:31.193578 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7a4a9bd2-a71b-4fdc-b778-5ad9dd18c74f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4" status: 200 len: 1559 microversion: 2.1 time: 0.153687 Oct 05 03:40:31.194152 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3729/7471] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:40:31 2022] GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:40:32.188811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-924a461c-1c58-45f0-af71-4341cb2d32d5 req-b052aa4e-6e91-4802-8045-791b9f10ae35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4c34883-c414-4311-a1e0-09512bdb04c4", "name": "network-vif-deleted", "tag": "e8b028d1-3e4d-488b-8abc-5b6c002f38b8"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:40:32.200266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-924a461c-1c58-45f0-af71-4341cb2d32d5 req-b052aa4e-6e91-4802-8045-791b9f10ae35 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:32.200806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-924a461c-1c58-45f0-af71-4341cb2d32d5 req-b052aa4e-6e91-4802-8045-791b9f10ae35 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:32.201401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-924a461c-1c58-45f0-af71-4341cb2d32d5 req-b052aa4e-6e91-4802-8045-791b9f10ae35 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:32.219771 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-916a2946-03ef-4859-a752-b11dbc1082d3 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:32.220624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-916a2946-03ef-4859-a752-b11dbc1082d3 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: d4c34883-c414-4311-a1e0-09512bdb04c4] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:32.221348 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-924a461c-1c58-45f0-af71-4341cb2d32d5 req-b052aa4e-6e91-4802-8045-791b9f10ae35 service nova] Creating event network-vif-deleted:e8b028d1-3e4d-488b-8abc-5b6c002f38b8 for instance d4c34883-c414-4311-a1e0-09512bdb04c4 on n-h2-858272-3 Oct 05 03:40:32.227337 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-924a461c-1c58-45f0-af71-4341cb2d32d5 req-b052aa4e-6e91-4802-8045-791b9f10ae35 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042271 Oct 05 03:40:32.229053 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3743/7472] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:40:32.238776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-916a2946-03ef-4859-a752-b11dbc1082d3 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:32.239308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-916a2946-03ef-4859-a752-b11dbc1082d3 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:32.239776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-916a2946-03ef-4859-a752-b11dbc1082d3 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:32.241153 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-916a2946-03ef-4859-a752-b11dbc1082d3 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:32.241642 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-916a2946-03ef-4859-a752-b11dbc1082d3 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:32.242083 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-916a2946-03ef-4859-a752-b11dbc1082d3 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:32.338646 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-916a2946-03ef-4859-a752-b11dbc1082d3 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:40:32.348001 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-916a2946-03ef-4859-a752-b11dbc1082d3 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4" status: 200 len: 1347 microversion: 2.1 time: 0.132974 Oct 05 03:40:32.348607 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3730/7473] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:40:32 2022] GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4 => generated 1347 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:40:33.376196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7d31f7e4-21a7-423b-a79a-fea374a29194 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:33.376953 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7d31f7e4-21a7-423b-a79a-fea374a29194 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: d4c34883-c414-4311-a1e0-09512bdb04c4] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:33.384007 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d31f7e4-21a7-423b-a79a-fea374a29194 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:33.384490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d31f7e4-21a7-423b-a79a-fea374a29194 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:33.384947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d31f7e4-21a7-423b-a79a-fea374a29194 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:33.385636 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d31f7e4-21a7-423b-a79a-fea374a29194 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:33.386091 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d31f7e4-21a7-423b-a79a-fea374a29194 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:33.386517 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7d31f7e4-21a7-423b-a79a-fea374a29194 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:33.402454 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-7d31f7e4-21a7-423b-a79a-fea374a29194 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] HTTP exception thrown: Instance d4c34883-c414-4311-a1e0-09512bdb04c4 could not be found. Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7d31f7e4-21a7-423b-a79a-fea374a29194 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Request method failure captured: Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4 HTTP/1.1 Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPyIjAtnTZXYSozwvFuAQ76_NaGIOV8-MKLfTRWSmedDBCMkvoCwwZL1JSQeolUmHB0Pmmv1sKQwivaq-b9iG5vk5c0yg_KO5Wnpt7PNt35R3TxWVH9QppGM0MXkHjkaVu1fpxfVVxUy4MIwrGr2VPCh1OvwmsFQXGlhazzRKxTIVqY Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 9c6019d6170d4feea446e485314eaf43 Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TestEncryptedCinderVolumes-388256451 Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c6019d6170d4feea446e485314eaf43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c6019d6170d4feea446e485314eaf43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9c6019d6170d4feea446e485314eaf43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9c6019d6170d4feea446e485314eaf43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TestEncryptedCinderVolumes-388256451 Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 9c6019d6170d4feea446e485314eaf43 Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-388256451 Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TestEncryptedCinderVolumes-388256451-project Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: a456f2c35f924b058073a994cfdfb8c2 Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TestEncryptedCinderVolumes-388256451-project Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance d4c34883-c414-4311-a1e0-09512bdb04c4 could not be found. Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'd4c34883-c414-4311-a1e0-09512bdb04c4'} Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4c34883-c414-4311-a1e0-09512bdb04c4 could not be found. Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4c34883-c414-4311-a1e0-09512bdb04c4 could not be found. Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:40:33.404123 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:40:33.408652 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:40:33.408652 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:40:33.408652 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:40:33.408652 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:40:33.408652 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:40:33.408652 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4c34883-c414-4311-a1e0-09512bdb04c4 could not be found. Oct 05 03:40:33.408652 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:40:33.408652 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7d31f7e4-21a7-423b-a79a-fea374a29194 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Returning 404 to user: Instance d4c34883-c414-4311-a1e0-09512bdb04c4 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:40:33.408652 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7d31f7e4-21a7-423b-a79a-fea374a29194 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4" status: 404 len: 111 microversion: 2.1 time: 0.033925 Oct 05 03:40:33.408652 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3744/7474] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:40:33 2022] GET /compute/v2.1/servers/d4c34883-c414-4311-a1e0-09512bdb04c4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 03:40:33.415649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cd12a0ad-cf03-4f2b-9c6c-1c805cf59f98 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '.version_select at 0x7fcce8171280>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:33.436359 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cd12a0ad-cf03-4f2b-9c6c-1c805cf59f98 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-419237976" status: 202 len: 0 microversion: 2.1 time: 0.024548 Oct 05 03:40:33.437520 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3731/7475] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 03:40:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-419237976 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 03:40:33.455492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-464eba70-64b9-4cd6-84de-c3bf96b6fffb tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Action: 'create', calling method: .version_select at 0x7fccdeab2f70>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1291069055", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWsYmPYE1Vc6OZjwwx9Z8ktM1wfGwYfhxg1weTdAoyumj0k8d7L2o/Qc4xMniyMvTPE9hHEa5rCI6Wp54pN68BPZdGVfuTLwQfHiDN0Apkn61ZNXSFWzflBHtZ99y+RJw=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:40:33.471593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-464eba70-64b9-4cd6-84de-c3bf96b6fffb tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Getting quotas for project 9c6019d6170d4feea446e485314eaf43. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:40:33.477758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-464eba70-64b9-4cd6-84de-c3bf96b6fffb tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Getting quotas for user a456f2c35f924b058073a994cfdfb8c2 and project 9c6019d6170d4feea446e485314eaf43. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:40:33.501661 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-464eba70-64b9-4cd6-84de-c3bf96b6fffb tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.051280 Oct 05 03:40:33.502250 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3745/7476] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 03:40:33 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:40:33.553214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7e11cc7e-8ff5-414c-8b23-77421f0d5575 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1695538435", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1291069055", "networks": [{"uuid": "256d6ebe-5f15-46a1-ac1f-dac7fab91823"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:40:33.607787 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-7e11cc7e-8ff5-414c-8b23-77421f0d5575 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] validate_networks() for [('256d6ebe-5f15-46a1-ac1f-dac7fab91823', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:40:34.001196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-7e11cc7e-8ff5-414c-8b23-77421f0d5575 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:40:34.001649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-7e11cc7e-8ff5-414c-8b23-77421f0d5575 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:40:34.002144 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-7e11cc7e-8ff5-414c-8b23-77421f0d5575 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:40:34.002573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-7e11cc7e-8ff5-414c-8b23-77421f0d5575 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:40:34.003030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-7e11cc7e-8ff5-414c-8b23-77421f0d5575 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:40:34.014412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e11cc7e-8ff5-414c-8b23-77421f0d5575 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:34.014920 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e11cc7e-8ff5-414c-8b23-77421f0d5575 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:34.015888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e11cc7e-8ff5-414c-8b23-77421f0d5575 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:34.016633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e11cc7e-8ff5-414c-8b23-77421f0d5575 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:34.017126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e11cc7e-8ff5-414c-8b23-77421f0d5575 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:34.017568 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7e11cc7e-8ff5-414c-8b23-77421f0d5575 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:34.041139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-7e11cc7e-8ff5-414c-8b23-77421f0d5575 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Getting quotas for project 9c6019d6170d4feea446e485314eaf43. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:40:34.046583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-7e11cc7e-8ff5-414c-8b23-77421f0d5575 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Getting quotas for user a456f2c35f924b058073a994cfdfb8c2 and project 9c6019d6170d4feea446e485314eaf43. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:40:34.059293 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7e11cc7e-8ff5-414c-8b23-77421f0d5575 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:40:34.061639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7e11cc7e-8ff5-414c-8b23-77421f0d5575 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 4dc845bf-7442-4e22-bdb4-76dc2a47457d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:40:34.108703 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7e11cc7e-8ff5-414c-8b23-77421f0d5575 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.559411 Oct 05 03:40:34.109409 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3732/7477] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:40:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:40:34.120772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5d7e1594-2ea2-44e9-956e-2a92466c10d5 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:34.121534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5d7e1594-2ea2-44e9-956e-2a92466c10d5 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 4dc845bf-7442-4e22-bdb4-76dc2a47457d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:34.176224 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5d7e1594-2ea2-44e9-956e-2a92466c10d5 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:40:34.183250 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5d7e1594-2ea2-44e9-956e-2a92466c10d5 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d" status: 200 len: 1263 microversion: 2.1 time: 0.066522 Oct 05 03:40:34.183821 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3746/7478] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:40:34 2022] GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d => generated 1263 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:40:35.207381 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5fb8f3f6-b901-4c3c-9341-b9dc0adca32e tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:35.208774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5fb8f3f6-b901-4c3c-9341-b9dc0adca32e tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 4dc845bf-7442-4e22-bdb4-76dc2a47457d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:35.219577 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5fb8f3f6-b901-4c3c-9341-b9dc0adca32e tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:35.220107 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5fb8f3f6-b901-4c3c-9341-b9dc0adca32e tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:35.220573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5fb8f3f6-b901-4c3c-9341-b9dc0adca32e tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:35.221377 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5fb8f3f6-b901-4c3c-9341-b9dc0adca32e tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:35.222675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5fb8f3f6-b901-4c3c-9341-b9dc0adca32e tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:35.223394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5fb8f3f6-b901-4c3c-9341-b9dc0adca32e tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:35.303110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5fb8f3f6-b901-4c3c-9341-b9dc0adca32e tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:40:35.313191 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5fb8f3f6-b901-4c3c-9341-b9dc0adca32e tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d" status: 200 len: 1323 microversion: 2.1 time: 0.109528 Oct 05 03:40:35.313800 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3733/7479] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:40:35 2022] GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d => generated 1323 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:40:36.337979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9075b249-242b-475b-8fb0-546d4e4abfa7 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:36.338765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9075b249-242b-475b-8fb0-546d4e4abfa7 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 4dc845bf-7442-4e22-bdb4-76dc2a47457d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:36.346962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9075b249-242b-475b-8fb0-546d4e4abfa7 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:36.347466 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9075b249-242b-475b-8fb0-546d4e4abfa7 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:36.347906 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9075b249-242b-475b-8fb0-546d4e4abfa7 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:36.348655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9075b249-242b-475b-8fb0-546d4e4abfa7 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:36.349554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9075b249-242b-475b-8fb0-546d4e4abfa7 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:36.349554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9075b249-242b-475b-8fb0-546d4e4abfa7 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:36.548274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9075b249-242b-475b-8fb0-546d4e4abfa7 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:40:36.556124 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9075b249-242b-475b-8fb0-546d4e4abfa7 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d" status: 200 len: 1363 microversion: 2.1 time: 0.222106 Oct 05 03:40:36.556702 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3747/7480] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:40:36 2022] GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:40:36.637814 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-4919b076-13d4-4568-9a0b-5442dec61b92 req-d02ba190-254e-4807-a4b6-1fb1a31b12d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dc845bf-7442-4e22-bdb4-76dc2a47457d", "tag": "72397808-4e41-4bd9-8e75-c5f4b6508303"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:40:36.648830 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4919b076-13d4-4568-9a0b-5442dec61b92 req-d02ba190-254e-4807-a4b6-1fb1a31b12d5 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:36.649368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4919b076-13d4-4568-9a0b-5442dec61b92 req-d02ba190-254e-4807-a4b6-1fb1a31b12d5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:36.649813 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4919b076-13d4-4568-9a0b-5442dec61b92 req-d02ba190-254e-4807-a4b6-1fb1a31b12d5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:36.663271 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-4919b076-13d4-4568-9a0b-5442dec61b92 req-d02ba190-254e-4807-a4b6-1fb1a31b12d5 service nova] Creating event network-changed:72397808-4e41-4bd9-8e75-c5f4b6508303 for instance 4dc845bf-7442-4e22-bdb4-76dc2a47457d on n-h2-858272-3 Oct 05 03:40:36.668599 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-4919b076-13d4-4568-9a0b-5442dec61b92 req-d02ba190-254e-4807-a4b6-1fb1a31b12d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034778 Oct 05 03:40:36.669267 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3734/7481] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:40:37.580127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-02ddc418-f476-42f8-a569-0158454b3227 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:37.580759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-02ddc418-f476-42f8-a569-0158454b3227 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 4dc845bf-7442-4e22-bdb4-76dc2a47457d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:37.587574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-02ddc418-f476-42f8-a569-0158454b3227 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:37.588070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-02ddc418-f476-42f8-a569-0158454b3227 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:37.588508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-02ddc418-f476-42f8-a569-0158454b3227 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:37.589232 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-02ddc418-f476-42f8-a569-0158454b3227 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:37.589690 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-02ddc418-f476-42f8-a569-0158454b3227 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:37.590115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-02ddc418-f476-42f8-a569-0158454b3227 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:37.723612 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-02ddc418-f476-42f8-a569-0158454b3227 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:40:37.731605 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-02ddc418-f476-42f8-a569-0158454b3227 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d" status: 200 len: 1363 microversion: 2.1 time: 0.155922 Oct 05 03:40:37.732189 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3748/7482] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:40:37 2022] GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:40:38.756232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0b1b32bf-008f-4bc7-a091-3ad45176a22d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:38.756963 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0b1b32bf-008f-4bc7-a091-3ad45176a22d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 4dc845bf-7442-4e22-bdb4-76dc2a47457d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:38.763156 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b1b32bf-008f-4bc7-a091-3ad45176a22d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:38.763650 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b1b32bf-008f-4bc7-a091-3ad45176a22d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:38.764095 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b1b32bf-008f-4bc7-a091-3ad45176a22d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:38.765534 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b1b32bf-008f-4bc7-a091-3ad45176a22d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:38.766055 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b1b32bf-008f-4bc7-a091-3ad45176a22d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:38.766506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b1b32bf-008f-4bc7-a091-3ad45176a22d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:38.893206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0b1b32bf-008f-4bc7-a091-3ad45176a22d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:40:38.901056 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0b1b32bf-008f-4bc7-a091-3ad45176a22d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d" status: 200 len: 1363 microversion: 2.1 time: 0.149890 Oct 05 03:40:38.901639 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3735/7483] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:40:38 2022] GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:40:39.924350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a8ed5015-c744-408f-aca7-6ff09a6f5131 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:39.924917 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a8ed5015-c744-408f-aca7-6ff09a6f5131 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 4dc845bf-7442-4e22-bdb4-76dc2a47457d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:39.931756 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8ed5015-c744-408f-aca7-6ff09a6f5131 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:39.932249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8ed5015-c744-408f-aca7-6ff09a6f5131 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:39.932688 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8ed5015-c744-408f-aca7-6ff09a6f5131 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:39.933420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8ed5015-c744-408f-aca7-6ff09a6f5131 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:39.933879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8ed5015-c744-408f-aca7-6ff09a6f5131 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:39.934306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8ed5015-c744-408f-aca7-6ff09a6f5131 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:40.074237 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a8ed5015-c744-408f-aca7-6ff09a6f5131 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:40:40.082654 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a8ed5015-c744-408f-aca7-6ff09a6f5131 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d" status: 200 len: 1363 microversion: 2.1 time: 0.162748 Oct 05 03:40:40.083250 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3749/7484] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:40:39 2022] GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:40:41.107060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6dea1005-2a68-469e-9290-bce12aba7c1c tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:41.107594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6dea1005-2a68-469e-9290-bce12aba7c1c tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 4dc845bf-7442-4e22-bdb4-76dc2a47457d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:41.114542 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6dea1005-2a68-469e-9290-bce12aba7c1c tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:41.115041 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6dea1005-2a68-469e-9290-bce12aba7c1c tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:41.115489 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6dea1005-2a68-469e-9290-bce12aba7c1c tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:41.116214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6dea1005-2a68-469e-9290-bce12aba7c1c tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:41.116676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6dea1005-2a68-469e-9290-bce12aba7c1c tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:41.117137 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6dea1005-2a68-469e-9290-bce12aba7c1c tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:41.246886 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6dea1005-2a68-469e-9290-bce12aba7c1c tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:40:41.255409 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6dea1005-2a68-469e-9290-bce12aba7c1c tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d" status: 200 len: 1363 microversion: 2.1 time: 0.152397 Oct 05 03:40:41.255979 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3736/7485] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:40:41 2022] GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:40:41.925553 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-426f481f-e514-4fb3-854c-667ce17c6e28 req-b71b4ad9-cf3b-4829-8c9e-f26d37cd3d87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dc845bf-7442-4e22-bdb4-76dc2a47457d", "name": "network-vif-plugged", "status": "completed", "tag": "72397808-4e41-4bd9-8e75-c5f4b6508303"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:40:41.941844 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-426f481f-e514-4fb3-854c-667ce17c6e28 req-b71b4ad9-cf3b-4829-8c9e-f26d37cd3d87 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:41.942751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-426f481f-e514-4fb3-854c-667ce17c6e28 req-b71b4ad9-cf3b-4829-8c9e-f26d37cd3d87 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:41.943338 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-426f481f-e514-4fb3-854c-667ce17c6e28 req-b71b4ad9-cf3b-4829-8c9e-f26d37cd3d87 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:41.963301 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-426f481f-e514-4fb3-854c-667ce17c6e28 req-b71b4ad9-cf3b-4829-8c9e-f26d37cd3d87 service nova] Creating event network-vif-plugged:72397808-4e41-4bd9-8e75-c5f4b6508303 for instance 4dc845bf-7442-4e22-bdb4-76dc2a47457d on n-h2-858272-3 Oct 05 03:40:41.969758 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-426f481f-e514-4fb3-854c-667ce17c6e28 req-b71b4ad9-cf3b-4829-8c9e-f26d37cd3d87 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049156 Oct 05 03:40:41.970690 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3750/7486] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:40:42.279752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-19185d78-1916-4927-be4e-40813a9aa628 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:42.281013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-19185d78-1916-4927-be4e-40813a9aa628 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 4dc845bf-7442-4e22-bdb4-76dc2a47457d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:42.288977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19185d78-1916-4927-be4e-40813a9aa628 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:42.289655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19185d78-1916-4927-be4e-40813a9aa628 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:42.290173 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19185d78-1916-4927-be4e-40813a9aa628 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:42.290960 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19185d78-1916-4927-be4e-40813a9aa628 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:42.291424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19185d78-1916-4927-be4e-40813a9aa628 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:42.291859 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-19185d78-1916-4927-be4e-40813a9aa628 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:42.423021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-19185d78-1916-4927-be4e-40813a9aa628 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:40:42.432376 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-19185d78-1916-4927-be4e-40813a9aa628 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d" status: 200 len: 1363 microversion: 2.1 time: 0.156446 Oct 05 03:40:42.433822 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3737/7487] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:40:42 2022] GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:40:43.458447 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c00bc199-8408-41ac-9406-742cc48ff206 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:43.459143 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c00bc199-8408-41ac-9406-742cc48ff206 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 4dc845bf-7442-4e22-bdb4-76dc2a47457d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:43.466301 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c00bc199-8408-41ac-9406-742cc48ff206 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:43.466788 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c00bc199-8408-41ac-9406-742cc48ff206 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:43.467218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c00bc199-8408-41ac-9406-742cc48ff206 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:43.468451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c00bc199-8408-41ac-9406-742cc48ff206 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:43.468887 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c00bc199-8408-41ac-9406-742cc48ff206 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:43.469331 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c00bc199-8408-41ac-9406-742cc48ff206 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:43.606292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c00bc199-8408-41ac-9406-742cc48ff206 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:40:43.614381 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c00bc199-8408-41ac-9406-742cc48ff206 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d" status: 200 len: 1363 microversion: 2.1 time: 0.160109 Oct 05 03:40:43.614968 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3751/7488] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:40:43 2022] GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:40:44.638034 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6c447a28-0707-45fa-9dc9-f0740696f7f1 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:44.638663 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6c447a28-0707-45fa-9dc9-f0740696f7f1 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 4dc845bf-7442-4e22-bdb4-76dc2a47457d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:44.642078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:40:44.642776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:40:44.648522 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c447a28-0707-45fa-9dc9-f0740696f7f1 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:44.649061 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c447a28-0707-45fa-9dc9-f0740696f7f1 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:44.649516 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c447a28-0707-45fa-9dc9-f0740696f7f1 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:44.650258 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c447a28-0707-45fa-9dc9-f0740696f7f1 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:44.650731 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c447a28-0707-45fa-9dc9-f0740696f7f1 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:44.651172 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c447a28-0707-45fa-9dc9-f0740696f7f1 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:44.779546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6c447a28-0707-45fa-9dc9-f0740696f7f1 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:40:44.787354 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6c447a28-0707-45fa-9dc9-f0740696f7f1 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d" status: 200 len: 1554 microversion: 2.1 time: 0.153323 Oct 05 03:40:44.787934 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3738/7489] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:40:44 2022] GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:40:44.810229 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d481eff0-7c29-458f-9c24-5e04a31abcca tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:44.811048 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d481eff0-7c29-458f-9c24-5e04a31abcca tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 4dc845bf-7442-4e22-bdb4-76dc2a47457d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:44.813524 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:40:44.819789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d481eff0-7c29-458f-9c24-5e04a31abcca tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:44.820273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d481eff0-7c29-458f-9c24-5e04a31abcca tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:44.820707 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d481eff0-7c29-458f-9c24-5e04a31abcca tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:44.821421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d481eff0-7c29-458f-9c24-5e04a31abcca tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:44.821871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d481eff0-7c29-458f-9c24-5e04a31abcca tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:44.822290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d481eff0-7c29-458f-9c24-5e04a31abcca tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:44.949188 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d481eff0-7c29-458f-9c24-5e04a31abcca tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:40:44.957508 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d481eff0-7c29-458f-9c24-5e04a31abcca tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d" status: 200 len: 1554 microversion: 2.1 time: 0.151656 Oct 05 03:40:44.958082 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3752/7490] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:40:44 2022] GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:40:46.454686 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f9afa020-22ea-4ae0-be8c-b2de8385861d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5157719e-68c0-42e6-8a61-2bdd69b947b8"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:40:46.457201 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f9afa020-22ea-4ae0-be8c-b2de8385861d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 4dc845bf-7442-4e22-bdb4-76dc2a47457d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:46.464238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9afa020-22ea-4ae0-be8c-b2de8385861d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:46.464735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9afa020-22ea-4ae0-be8c-b2de8385861d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:46.465217 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9afa020-22ea-4ae0-be8c-b2de8385861d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:46.465919 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9afa020-22ea-4ae0-be8c-b2de8385861d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:46.466388 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9afa020-22ea-4ae0-be8c-b2de8385861d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:46.466825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f9afa020-22ea-4ae0-be8c-b2de8385861d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:46.709226 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:40:46.731890 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f9afa020-22ea-4ae0-be8c-b2de8385861d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "POST /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281816 Oct 05 03:40:46.732782 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3739/7491] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 03:40:46 2022] POST /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:40:57.450061 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2f274095-9585-4260-b9f0-9050dc8fec1f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:57.450597 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2f274095-9585-4260-b9f0-9050dc8fec1f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 4dc845bf-7442-4e22-bdb4-76dc2a47457d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:57.454057 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:40:57.454776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=66 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:40:57.461010 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f274095-9585-4260-b9f0-9050dc8fec1f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:57.461497 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f274095-9585-4260-b9f0-9050dc8fec1f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:57.461931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f274095-9585-4260-b9f0-9050dc8fec1f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:57.462619 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f274095-9585-4260-b9f0-9050dc8fec1f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:57.463067 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f274095-9585-4260-b9f0-9050dc8fec1f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:57.463489 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2f274095-9585-4260-b9f0-9050dc8fec1f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:57.546843 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-2f274095-9585-4260-b9f0-9050dc8fec1f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lazy-loading 'services' on Instance uuid 4dc845bf-7442-4e22-bdb4-76dc2a47457d {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:40:57.617753 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2f274095-9585-4260-b9f0-9050dc8fec1f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d/os-volume_attachments/5157719e-68c0-42e6-8a61-2bdd69b947b8" status: 202 len: 0 microversion: 2.1 time: 0.171527 Oct 05 03:40:57.618425 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3753/7492] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 03:40:57 2022] DELETE /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d/os-volume_attachments/5157719e-68c0-42e6-8a61-2bdd69b947b8 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:40:57.627950 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bd22b2d6-0391-414d-87aa-59a08bab58bb tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:57.630380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bd22b2d6-0391-414d-87aa-59a08bab58bb tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 4dc845bf-7442-4e22-bdb4-76dc2a47457d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:57.633521 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:40:57.634210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=2,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:40:57.640159 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd22b2d6-0391-414d-87aa-59a08bab58bb tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:57.640674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd22b2d6-0391-414d-87aa-59a08bab58bb tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:57.641167 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd22b2d6-0391-414d-87aa-59a08bab58bb tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:57.642562 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd22b2d6-0391-414d-87aa-59a08bab58bb tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:57.643058 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd22b2d6-0391-414d-87aa-59a08bab58bb tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:57.643504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd22b2d6-0391-414d-87aa-59a08bab58bb tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:57.678473 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bd22b2d6-0391-414d-87aa-59a08bab58bb tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055328 Oct 05 03:40:57.678996 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3740/7493] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:40:57 2022] GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:40:58.692585 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-134a5eb8-be58-436a-8c6c-b1f70e8f5c62 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:58.694926 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-134a5eb8-be58-436a-8c6c-b1f70e8f5c62 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 4dc845bf-7442-4e22-bdb4-76dc2a47457d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:58.701203 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-134a5eb8-be58-436a-8c6c-b1f70e8f5c62 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:58.701692 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-134a5eb8-be58-436a-8c6c-b1f70e8f5c62 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:58.702133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-134a5eb8-be58-436a-8c6c-b1f70e8f5c62 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:58.703539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-134a5eb8-be58-436a-8c6c-b1f70e8f5c62 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:58.704009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-134a5eb8-be58-436a-8c6c-b1f70e8f5c62 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:58.704434 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-134a5eb8-be58-436a-8c6c-b1f70e8f5c62 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:58.737912 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-134a5eb8-be58-436a-8c6c-b1f70e8f5c62 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050539 Oct 05 03:40:58.738511 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3754/7494] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:40:58 2022] GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:40:59.751310 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cfadb635-1b90-476a-95d7-f19ebc746cfe tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:40:59.753571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cfadb635-1b90-476a-95d7-f19ebc746cfe tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 4dc845bf-7442-4e22-bdb4-76dc2a47457d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:40:59.760628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cfadb635-1b90-476a-95d7-f19ebc746cfe tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:59.761182 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cfadb635-1b90-476a-95d7-f19ebc746cfe tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:59.761640 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cfadb635-1b90-476a-95d7-f19ebc746cfe tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:59.762356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cfadb635-1b90-476a-95d7-f19ebc746cfe tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:40:59.762825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cfadb635-1b90-476a-95d7-f19ebc746cfe tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:40:59.763268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cfadb635-1b90-476a-95d7-f19ebc746cfe tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:40:59.796389 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cfadb635-1b90-476a-95d7-f19ebc746cfe tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049708 Oct 05 03:40:59.797187 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3741/7495] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:40:59 2022] GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:41:00.808477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b3ef7698-9794-40b2-8756-ae127ae524d4 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:00.810668 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b3ef7698-9794-40b2-8756-ae127ae524d4 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 4dc845bf-7442-4e22-bdb4-76dc2a47457d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:00.818368 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3ef7698-9794-40b2-8756-ae127ae524d4 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:00.818858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3ef7698-9794-40b2-8756-ae127ae524d4 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:00.819299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3ef7698-9794-40b2-8756-ae127ae524d4 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:00.819998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3ef7698-9794-40b2-8756-ae127ae524d4 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:00.820458 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3ef7698-9794-40b2-8756-ae127ae524d4 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:00.820886 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b3ef7698-9794-40b2-8756-ae127ae524d4 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:00.850611 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b3ef7698-9794-40b2-8756-ae127ae524d4 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046160 Oct 05 03:41:00.851189 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3755/7496] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:41:00 2022] GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:41:01.863440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-42b6f536-e28f-4544-8163-e1d6baf44280 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:01.865706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-42b6f536-e28f-4544-8163-e1d6baf44280 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 4dc845bf-7442-4e22-bdb4-76dc2a47457d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:01.872698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42b6f536-e28f-4544-8163-e1d6baf44280 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:01.873250 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42b6f536-e28f-4544-8163-e1d6baf44280 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:01.873709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42b6f536-e28f-4544-8163-e1d6baf44280 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:01.874424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42b6f536-e28f-4544-8163-e1d6baf44280 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:01.875645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42b6f536-e28f-4544-8163-e1d6baf44280 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:01.875948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-42b6f536-e28f-4544-8163-e1d6baf44280 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:01.907104 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-42b6f536-e28f-4544-8163-e1d6baf44280 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047676 Oct 05 03:41:01.907682 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3742/7497] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:41:01 2022] GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:41:02.918644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8b971595-d207-4402-90b8-f2bc2cb11976 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:02.920790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8b971595-d207-4402-90b8-f2bc2cb11976 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 4dc845bf-7442-4e22-bdb4-76dc2a47457d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:02.928386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b971595-d207-4402-90b8-f2bc2cb11976 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:02.928867 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b971595-d207-4402-90b8-f2bc2cb11976 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:02.929339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b971595-d207-4402-90b8-f2bc2cb11976 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:02.930022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b971595-d207-4402-90b8-f2bc2cb11976 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:02.930474 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b971595-d207-4402-90b8-f2bc2cb11976 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:02.930890 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b971595-d207-4402-90b8-f2bc2cb11976 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:02.959215 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8b971595-d207-4402-90b8-f2bc2cb11976 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044667 Oct 05 03:41:02.959776 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3756/7498] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:41:02 2022] GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 03:41:02.970802 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0cdc87af-58ff-4ac4-bef1-2c96bcceb25f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:02.971300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0cdc87af-58ff-4ac4-bef1-2c96bcceb25f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 4dc845bf-7442-4e22-bdb4-76dc2a47457d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:02.978356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0cdc87af-58ff-4ac4-bef1-2c96bcceb25f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:02.978850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0cdc87af-58ff-4ac4-bef1-2c96bcceb25f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:02.979293 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0cdc87af-58ff-4ac4-bef1-2c96bcceb25f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:02.979988 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0cdc87af-58ff-4ac4-bef1-2c96bcceb25f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:02.980450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0cdc87af-58ff-4ac4-bef1-2c96bcceb25f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:02.980883 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0cdc87af-58ff-4ac4-bef1-2c96bcceb25f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:03.056636 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-0cdc87af-58ff-4ac4-bef1-2c96bcceb25f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] HTTP exception thrown: Instance 4dc845bf-7442-4e22-bdb4-76dc2a47457d is not attached to volume 5157719e-68c0-42e6-8a61-2bdd69b947b8 Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0cdc87af-58ff-4ac4-bef1-2c96bcceb25f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Request method failure captured: Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d/os-volume_attachments/5157719e-68c0-42e6-8a61-2bdd69b947b8 HTTP/1.1 Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPPyIjAtnTZXYSozwvFuAQ76_NaGIOV8-MKLfTRWSmedDBCMkvoCwwZL1JSQeolUmHB0Pmmv1sKQwivaq-b9iG5vk5c0yg_KO5Wnpt7PNt35R3TxWVH9QppGM0MXkHjkaVu1fpxfVVxUy4MIwrGr2VPCh1OvwmsFQXGlhazzRKxTIVqY Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 9c6019d6170d4feea446e485314eaf43 Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-TestEncryptedCinderVolumes-388256451 Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c6019d6170d4feea446e485314eaf43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c6019d6170d4feea446e485314eaf43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9c6019d6170d4feea446e485314eaf43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9c6019d6170d4feea446e485314eaf43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-TestEncryptedCinderVolumes-388256451 Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 9c6019d6170d4feea446e485314eaf43 Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-388256451 Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-TestEncryptedCinderVolumes-388256451-project Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: a456f2c35f924b058073a994cfdfb8c2 Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-TestEncryptedCinderVolumes-388256451-project Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance 4dc845bf-7442-4e22-bdb4-76dc2a47457d is not attached to volume 5157719e-68c0-42e6-8a61-2bdd69b947b8 Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'server_id': '4dc845bf-7442-4e22-bdb4-76dc2a47457d', 'id': '5157719e-68c0-42e6-8a61-2bdd69b947b8'} Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5157719e-68c0-42e6-8a61-2bdd69b947b8. Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dc845bf-7442-4e22-bdb4-76dc2a47457d is not attached to volume 5157719e-68c0-42e6-8a61-2bdd69b947b8 Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:41:03.058624 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:41:03.062885 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:41:03.062885 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:41:03.062885 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dc845bf-7442-4e22-bdb4-76dc2a47457d is not attached to volume 5157719e-68c0-42e6-8a61-2bdd69b947b8 Oct 05 03:41:03.062885 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:41:03.062885 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0cdc87af-58ff-4ac4-bef1-2c96bcceb25f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Returning 404 to user: Instance 4dc845bf-7442-4e22-bdb4-76dc2a47457d is not attached to volume 5157719e-68c0-42e6-8a61-2bdd69b947b8 {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:41:03.062885 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0cdc87af-58ff-4ac4-bef1-2c96bcceb25f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d/os-volume_attachments/5157719e-68c0-42e6-8a61-2bdd69b947b8" status: 404 len: 154 microversion: 2.1 time: 0.093829 Oct 05 03:41:03.062885 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3743/7499] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 03:41:02 2022] DELETE /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d/os-volume_attachments/5157719e-68c0-42e6-8a61-2bdd69b947b8 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:41:06.412505 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e1df0a5c-d045-47d4-9bd8-452398295c9b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:06.413178 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e1df0a5c-d045-47d4-9bd8-452398295c9b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 4dc845bf-7442-4e22-bdb4-76dc2a47457d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:06.420133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e1df0a5c-d045-47d4-9bd8-452398295c9b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:06.420626 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e1df0a5c-d045-47d4-9bd8-452398295c9b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:06.421114 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e1df0a5c-d045-47d4-9bd8-452398295c9b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:06.421916 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e1df0a5c-d045-47d4-9bd8-452398295c9b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:06.422376 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e1df0a5c-d045-47d4-9bd8-452398295c9b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:06.422811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e1df0a5c-d045-47d4-9bd8-452398295c9b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:06.451820 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e1df0a5c-d045-47d4-9bd8-452398295c9b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 4dc845bf-7442-4e22-bdb4-76dc2a47457d] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:41:06.559834 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e1df0a5c-d045-47d4-9bd8-452398295c9b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d" status: 204 len: 0 microversion: 2.1 time: 0.150544 Oct 05 03:41:06.562421 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3757/7500] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:41:06 2022] DELETE /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:41:06.572505 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c71dc556-e174-471b-8972-24fb773383ac tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:06.573489 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c71dc556-e174-471b-8972-24fb773383ac tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 4dc845bf-7442-4e22-bdb4-76dc2a47457d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:06.581735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c71dc556-e174-471b-8972-24fb773383ac tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:06.582237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c71dc556-e174-471b-8972-24fb773383ac tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:06.582690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c71dc556-e174-471b-8972-24fb773383ac tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:06.583396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c71dc556-e174-471b-8972-24fb773383ac tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:06.583864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c71dc556-e174-471b-8972-24fb773383ac tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:06.584299 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c71dc556-e174-471b-8972-24fb773383ac tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:06.720062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c71dc556-e174-471b-8972-24fb773383ac tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:41:06.728119 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c71dc556-e174-471b-8972-24fb773383ac tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d" status: 200 len: 1560 microversion: 2.1 time: 0.161312 Oct 05 03:41:06.728697 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3744/7501] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:41:06 2022] GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:41:07.752210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4e2715c3-0bfb-4575-a607-9b72bd0f1757 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:07.752924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4e2715c3-0bfb-4575-a607-9b72bd0f1757 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 4dc845bf-7442-4e22-bdb4-76dc2a47457d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:07.759797 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e2715c3-0bfb-4575-a607-9b72bd0f1757 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:07.760276 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e2715c3-0bfb-4575-a607-9b72bd0f1757 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:07.760709 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e2715c3-0bfb-4575-a607-9b72bd0f1757 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:07.761416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e2715c3-0bfb-4575-a607-9b72bd0f1757 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:07.761873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e2715c3-0bfb-4575-a607-9b72bd0f1757 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:07.762295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4e2715c3-0bfb-4575-a607-9b72bd0f1757 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:07.889350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4e2715c3-0bfb-4575-a607-9b72bd0f1757 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:41:07.897822 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4e2715c3-0bfb-4575-a607-9b72bd0f1757 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d" status: 200 len: 1560 microversion: 2.1 time: 0.149931 Oct 05 03:41:07.898398 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3758/7502] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:41:07 2022] GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:41:08.921936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-878339d9-96ba-4fef-a21b-fbcac8519268 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:08.923195 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-878339d9-96ba-4fef-a21b-fbcac8519268 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 4dc845bf-7442-4e22-bdb4-76dc2a47457d] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:08.930491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-878339d9-96ba-4fef-a21b-fbcac8519268 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:08.931012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-878339d9-96ba-4fef-a21b-fbcac8519268 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:08.931470 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-878339d9-96ba-4fef-a21b-fbcac8519268 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:08.932193 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-878339d9-96ba-4fef-a21b-fbcac8519268 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:08.932693 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-878339d9-96ba-4fef-a21b-fbcac8519268 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:08.933173 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-878339d9-96ba-4fef-a21b-fbcac8519268 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:09.139540 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-302328b4-09f8-4b0f-b4ca-88560accb4bc req-7da41a65-ca24-4b9d-b165-0b94da4b0041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dc845bf-7442-4e22-bdb4-76dc2a47457d", "name": "network-vif-deleted", "tag": "72397808-4e41-4bd9-8e75-c5f4b6508303"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:41:09.153707 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-302328b4-09f8-4b0f-b4ca-88560accb4bc req-7da41a65-ca24-4b9d-b165-0b94da4b0041 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:09.154216 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-302328b4-09f8-4b0f-b4ca-88560accb4bc req-7da41a65-ca24-4b9d-b165-0b94da4b0041 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:09.154644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-302328b4-09f8-4b0f-b4ca-88560accb4bc req-7da41a65-ca24-4b9d-b165-0b94da4b0041 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:09.168164 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-302328b4-09f8-4b0f-b4ca-88560accb4bc req-7da41a65-ca24-4b9d-b165-0b94da4b0041 service nova] Creating event network-vif-deleted:72397808-4e41-4bd9-8e75-c5f4b6508303 for instance 4dc845bf-7442-4e22-bdb4-76dc2a47457d on n-h2-858272-3 Oct 05 03:41:09.175140 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-302328b4-09f8-4b0f-b4ca-88560accb4bc req-7da41a65-ca24-4b9d-b165-0b94da4b0041 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040765 Oct 05 03:41:09.175714 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-878339d9-96ba-4fef-a21b-fbcac8519268 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:41:09.176808 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3759/7503] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:41:09.185004 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-878339d9-96ba-4fef-a21b-fbcac8519268 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d" status: 200 len: 1560 microversion: 2.1 time: 0.267682 Oct 05 03:41:09.185745 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3745/7504] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:41:08 2022] GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d => generated 1560 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:41:10.210547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0707d08d-3cb2-40bf-a2a1-b9ca60302ce1 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:10.211249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0707d08d-3cb2-40bf-a2a1-b9ca60302ce1 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 4dc845bf-7442-4e22-bdb4-76dc2a47457d] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:10.218748 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0707d08d-3cb2-40bf-a2a1-b9ca60302ce1 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:10.219602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0707d08d-3cb2-40bf-a2a1-b9ca60302ce1 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:10.220415 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0707d08d-3cb2-40bf-a2a1-b9ca60302ce1 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:10.221674 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0707d08d-3cb2-40bf-a2a1-b9ca60302ce1 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:10.222522 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0707d08d-3cb2-40bf-a2a1-b9ca60302ce1 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:10.223322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0707d08d-3cb2-40bf-a2a1-b9ca60302ce1 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:10.238456 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-0707d08d-3cb2-40bf-a2a1-b9ca60302ce1 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] HTTP exception thrown: Instance 4dc845bf-7442-4e22-bdb4-76dc2a47457d could not be found. Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0707d08d-3cb2-40bf-a2a1-b9ca60302ce1 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Request method failure captured: Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d HTTP/1.1 Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPyIjAtnTZXYSozwvFuAQ76_NaGIOV8-MKLfTRWSmedDBCMkvoCwwZL1JSQeolUmHB0Pmmv1sKQwivaq-b9iG5vk5c0yg_KO5Wnpt7PNt35R3TxWVH9QppGM0MXkHjkaVu1fpxfVVxUy4MIwrGr2VPCh1OvwmsFQXGlhazzRKxTIVqY Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 9c6019d6170d4feea446e485314eaf43 Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TestEncryptedCinderVolumes-388256451 Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c6019d6170d4feea446e485314eaf43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c6019d6170d4feea446e485314eaf43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9c6019d6170d4feea446e485314eaf43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9c6019d6170d4feea446e485314eaf43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TestEncryptedCinderVolumes-388256451 Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 9c6019d6170d4feea446e485314eaf43 Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-388256451 Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TestEncryptedCinderVolumes-388256451-project Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: a456f2c35f924b058073a994cfdfb8c2 Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TestEncryptedCinderVolumes-388256451-project Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 4dc845bf-7442-4e22-bdb4-76dc2a47457d could not be found. Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '4dc845bf-7442-4e22-bdb4-76dc2a47457d'} Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dc845bf-7442-4e22-bdb4-76dc2a47457d could not be found. Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dc845bf-7442-4e22-bdb4-76dc2a47457d could not be found. Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:41:10.240275 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:41:10.245221 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:41:10.245221 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:41:10.245221 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:41:10.245221 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:41:10.245221 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:41:10.245221 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dc845bf-7442-4e22-bdb4-76dc2a47457d could not be found. Oct 05 03:41:10.245221 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:41:10.245221 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0707d08d-3cb2-40bf-a2a1-b9ca60302ce1 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Returning 404 to user: Instance 4dc845bf-7442-4e22-bdb4-76dc2a47457d could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:41:10.245221 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0707d08d-3cb2-40bf-a2a1-b9ca60302ce1 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d" status: 404 len: 111 microversion: 2.1 time: 0.035634 Oct 05 03:41:10.245221 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3760/7505] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:41:10 2022] GET /compute/v2.1/servers/4dc845bf-7442-4e22-bdb4-76dc2a47457d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:41:10.253017 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-75d6939e-eded-4327-893d-4fb2691b078a tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '.version_select at 0x7fcce82020d0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:10.274914 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-75d6939e-eded-4327-893d-4fb2691b078a tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1291069055" status: 202 len: 0 microversion: 2.1 time: 0.027880 Oct 05 03:41:10.275503 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3746/7506] 10.222.0.16 () {58 vars in 1278 bytes} [Wed Oct 5 03:41:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1291069055 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:41:10.293182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0663b98a-538a-4281-b0b5-c37d8f49548c tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Action: 'create', calling method: .version_select at 0x7fccdea941f0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-453863510", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpEC5DjJzdOBCft2sAO3EFsT9EA0j2SHBb56AM6yhzX2JZalTaje+8cLlalASJ6kO6luKWyNR5KYdMOJ0pTPYe8Db/Ksp8FaD4tjuwF/llhR5y+12GxEd5uy2xMIAMdLA=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:41:10.308508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-0663b98a-538a-4281-b0b5-c37d8f49548c tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Getting quotas for project 9c6019d6170d4feea446e485314eaf43. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:41:10.314830 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-0663b98a-538a-4281-b0b5-c37d8f49548c tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Getting quotas for user a456f2c35f924b058073a994cfdfb8c2 and project 9c6019d6170d4feea446e485314eaf43. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:41:10.338010 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0663b98a-538a-4281-b0b5-c37d8f49548c tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.048829 Oct 05 03:41:10.338596 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3761/7507] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 03:41:10 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:41:10.387941 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bb970dd0-711c-4500-aea0-41ebb5d68d4f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-343025354", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-453863510", "networks": [{"uuid": "256d6ebe-5f15-46a1-ac1f-dac7fab91823"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:41:10.442150 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-bb970dd0-711c-4500-aea0-41ebb5d68d4f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] validate_networks() for [('256d6ebe-5f15-46a1-ac1f-dac7fab91823', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:41:10.827440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-bb970dd0-711c-4500-aea0-41ebb5d68d4f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:41:10.828024 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-bb970dd0-711c-4500-aea0-41ebb5d68d4f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:41:10.828515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-bb970dd0-711c-4500-aea0-41ebb5d68d4f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:41:10.828973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-bb970dd0-711c-4500-aea0-41ebb5d68d4f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:41:10.829428 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-bb970dd0-711c-4500-aea0-41ebb5d68d4f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:41:10.838076 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb970dd0-711c-4500-aea0-41ebb5d68d4f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:10.838572 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb970dd0-711c-4500-aea0-41ebb5d68d4f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:10.839019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb970dd0-711c-4500-aea0-41ebb5d68d4f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:10.839754 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb970dd0-711c-4500-aea0-41ebb5d68d4f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:10.840224 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb970dd0-711c-4500-aea0-41ebb5d68d4f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:10.840688 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb970dd0-711c-4500-aea0-41ebb5d68d4f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:10.857917 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-bb970dd0-711c-4500-aea0-41ebb5d68d4f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Getting quotas for project 9c6019d6170d4feea446e485314eaf43. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:41:10.863645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-bb970dd0-711c-4500-aea0-41ebb5d68d4f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Getting quotas for user a456f2c35f924b058073a994cfdfb8c2 and project 9c6019d6170d4feea446e485314eaf43. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:41:10.876320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bb970dd0-711c-4500-aea0-41ebb5d68d4f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:41:10.878636 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bb970dd0-711c-4500-aea0-41ebb5d68d4f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:41:10.926699 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bb970dd0-711c-4500-aea0-41ebb5d68d4f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.542688 Oct 05 03:41:10.927369 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3747/7508] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:41:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:41:10.939703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5e384297-7e03-464c-ba84-9352525762b9 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:10.940331 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5e384297-7e03-464c-ba84-9352525762b9 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:11.003207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5e384297-7e03-464c-ba84-9352525762b9 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:41:11.010137 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5e384297-7e03-464c-ba84-9352525762b9 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00" status: 200 len: 1261 microversion: 2.1 time: 0.075154 Oct 05 03:41:11.010719 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3762/7509] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:41:10 2022] GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00 => generated 1261 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:41:12.034908 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-04b8a944-33fb-4e12-8613-dfc7c83aba7b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:12.035555 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-04b8a944-33fb-4e12-8613-dfc7c83aba7b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:12.042830 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04b8a944-33fb-4e12-8613-dfc7c83aba7b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:12.043363 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04b8a944-33fb-4e12-8613-dfc7c83aba7b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:12.043815 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04b8a944-33fb-4e12-8613-dfc7c83aba7b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:12.044543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04b8a944-33fb-4e12-8613-dfc7c83aba7b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:12.045019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04b8a944-33fb-4e12-8613-dfc7c83aba7b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:12.045460 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04b8a944-33fb-4e12-8613-dfc7c83aba7b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:12.126310 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-04b8a944-33fb-4e12-8613-dfc7c83aba7b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:41:12.134528 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-04b8a944-33fb-4e12-8613-dfc7c83aba7b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00" status: 200 len: 1321 microversion: 2.1 time: 0.104599 Oct 05 03:41:12.135433 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3748/7510] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:41:12 2022] GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00 => generated 1321 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:41:13.159281 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fdd42edf-771e-44b1-b9ab-cee11613a6cb tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:13.159903 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fdd42edf-771e-44b1-b9ab-cee11613a6cb tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:13.166444 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fdd42edf-771e-44b1-b9ab-cee11613a6cb tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:13.166937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fdd42edf-771e-44b1-b9ab-cee11613a6cb tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:13.167376 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fdd42edf-771e-44b1-b9ab-cee11613a6cb tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:13.168093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fdd42edf-771e-44b1-b9ab-cee11613a6cb tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:13.168528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fdd42edf-771e-44b1-b9ab-cee11613a6cb tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:13.168976 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fdd42edf-771e-44b1-b9ab-cee11613a6cb tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:13.394416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fdd42edf-771e-44b1-b9ab-cee11613a6cb tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:41:13.402189 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fdd42edf-771e-44b1-b9ab-cee11613a6cb tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00" status: 200 len: 1361 microversion: 2.1 time: 0.247369 Oct 05 03:41:13.402793 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3763/7511] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:41:13 2022] GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00 => generated 1361 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:41:13.928547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-ea8fe099-f8f1-4449-ae62-5eff4f336303 req-bfab42f5-f005-48f7-aeac-2ce605c56a97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b8f0fe0-7561-4bb7-8dc9-21408ad04e00", "tag": "3736cd10-cab9-45dc-878d-72227b889219"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:41:13.940013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ea8fe099-f8f1-4449-ae62-5eff4f336303 req-bfab42f5-f005-48f7-aeac-2ce605c56a97 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:13.940517 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ea8fe099-f8f1-4449-ae62-5eff4f336303 req-bfab42f5-f005-48f7-aeac-2ce605c56a97 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:13.940983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-ea8fe099-f8f1-4449-ae62-5eff4f336303 req-bfab42f5-f005-48f7-aeac-2ce605c56a97 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:13.952078 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-ea8fe099-f8f1-4449-ae62-5eff4f336303 req-bfab42f5-f005-48f7-aeac-2ce605c56a97 service nova] Creating event network-changed:3736cd10-cab9-45dc-878d-72227b889219 for instance 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00 on n-h2-858272-3 Oct 05 03:41:13.957101 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-ea8fe099-f8f1-4449-ae62-5eff4f336303 req-bfab42f5-f005-48f7-aeac-2ce605c56a97 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032376 Oct 05 03:41:13.957877 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3749/7512] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:41:14.427556 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-72637132-549a-4062-b7f3-3e89e6b37bbc tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:14.428109 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-72637132-549a-4062-b7f3-3e89e6b37bbc tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:14.434907 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72637132-549a-4062-b7f3-3e89e6b37bbc tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:14.435399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72637132-549a-4062-b7f3-3e89e6b37bbc tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:14.435842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72637132-549a-4062-b7f3-3e89e6b37bbc tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:14.436541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72637132-549a-4062-b7f3-3e89e6b37bbc tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:14.437705 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72637132-549a-4062-b7f3-3e89e6b37bbc tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:14.438142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72637132-549a-4062-b7f3-3e89e6b37bbc tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:14.571901 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-72637132-549a-4062-b7f3-3e89e6b37bbc tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:41:14.580101 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-72637132-549a-4062-b7f3-3e89e6b37bbc tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00" status: 200 len: 1361 microversion: 2.1 time: 0.156489 Oct 05 03:41:14.580686 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3764/7513] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:41:14 2022] GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:41:15.604612 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a9d7df5c-26c3-4d64-8777-297c3d00668c tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:15.605512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a9d7df5c-26c3-4d64-8777-297c3d00668c tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:15.612022 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9d7df5c-26c3-4d64-8777-297c3d00668c tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:15.612525 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9d7df5c-26c3-4d64-8777-297c3d00668c tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:15.613006 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9d7df5c-26c3-4d64-8777-297c3d00668c tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:15.613719 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9d7df5c-26c3-4d64-8777-297c3d00668c tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:15.614187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9d7df5c-26c3-4d64-8777-297c3d00668c tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:15.614627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a9d7df5c-26c3-4d64-8777-297c3d00668c tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:15.746223 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a9d7df5c-26c3-4d64-8777-297c3d00668c tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:41:15.754700 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a9d7df5c-26c3-4d64-8777-297c3d00668c tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00" status: 200 len: 1361 microversion: 2.1 time: 0.155444 Oct 05 03:41:15.755277 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3750/7514] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:41:15 2022] GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:41:16.778589 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5f017647-30a6-4589-b82a-5588bbdfaef8 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:16.779210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5f017647-30a6-4589-b82a-5588bbdfaef8 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:16.786858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f017647-30a6-4589-b82a-5588bbdfaef8 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:16.787374 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f017647-30a6-4589-b82a-5588bbdfaef8 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:16.787816 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f017647-30a6-4589-b82a-5588bbdfaef8 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:16.788542 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f017647-30a6-4589-b82a-5588bbdfaef8 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:16.789015 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f017647-30a6-4589-b82a-5588bbdfaef8 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:16.789439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5f017647-30a6-4589-b82a-5588bbdfaef8 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:16.996013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5f017647-30a6-4589-b82a-5588bbdfaef8 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:41:17.003970 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5f017647-30a6-4589-b82a-5588bbdfaef8 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00" status: 200 len: 1361 microversion: 2.1 time: 0.229306 Oct 05 03:41:17.004548 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3765/7515] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:41:16 2022] GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00 => generated 1361 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:41:18.027626 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f12a4624-5a2b-4241-acc0-5366c5551265 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:18.028370 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f12a4624-5a2b-4241-acc0-5366c5551265 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:18.035904 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f12a4624-5a2b-4241-acc0-5366c5551265 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:18.036557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f12a4624-5a2b-4241-acc0-5366c5551265 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:18.037111 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f12a4624-5a2b-4241-acc0-5366c5551265 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:18.037892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f12a4624-5a2b-4241-acc0-5366c5551265 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:18.038368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f12a4624-5a2b-4241-acc0-5366c5551265 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:18.038811 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f12a4624-5a2b-4241-acc0-5366c5551265 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:18.179119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f12a4624-5a2b-4241-acc0-5366c5551265 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:41:18.188625 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f12a4624-5a2b-4241-acc0-5366c5551265 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00" status: 200 len: 1361 microversion: 2.1 time: 0.165181 Oct 05 03:41:18.189181 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3751/7516] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:41:18 2022] GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:41:19.211539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c546b09d-03b2-4874-94f4-f651e21b7230 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:19.212185 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c546b09d-03b2-4874-94f4-f651e21b7230 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:19.219670 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c546b09d-03b2-4874-94f4-f651e21b7230 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:19.220158 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c546b09d-03b2-4874-94f4-f651e21b7230 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:19.220596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c546b09d-03b2-4874-94f4-f651e21b7230 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:19.221326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c546b09d-03b2-4874-94f4-f651e21b7230 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:19.221778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c546b09d-03b2-4874-94f4-f651e21b7230 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:19.222225 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c546b09d-03b2-4874-94f4-f651e21b7230 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:19.355146 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c546b09d-03b2-4874-94f4-f651e21b7230 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:41:19.363059 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c546b09d-03b2-4874-94f4-f651e21b7230 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00" status: 200 len: 1361 microversion: 2.1 time: 0.155464 Oct 05 03:41:19.363631 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3766/7517] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:41:19 2022] GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:41:20.120560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-272d8b0c-c5bd-467f-8820-cecb734dd53b req-3b96637d-e14a-431c-9cb0-411bf2d67e1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b8f0fe0-7561-4bb7-8dc9-21408ad04e00", "name": "network-vif-plugged", "status": "completed", "tag": "3736cd10-cab9-45dc-878d-72227b889219"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:41:20.133477 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-272d8b0c-c5bd-467f-8820-cecb734dd53b req-3b96637d-e14a-431c-9cb0-411bf2d67e1f service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:20.133980 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-272d8b0c-c5bd-467f-8820-cecb734dd53b req-3b96637d-e14a-431c-9cb0-411bf2d67e1f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:20.134425 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-272d8b0c-c5bd-467f-8820-cecb734dd53b req-3b96637d-e14a-431c-9cb0-411bf2d67e1f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:20.146278 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-272d8b0c-c5bd-467f-8820-cecb734dd53b req-3b96637d-e14a-431c-9cb0-411bf2d67e1f service nova] Creating event network-vif-plugged:3736cd10-cab9-45dc-878d-72227b889219 for instance 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00 on n-h2-858272-3 Oct 05 03:41:20.151741 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-272d8b0c-c5bd-467f-8820-cecb734dd53b req-3b96637d-e14a-431c-9cb0-411bf2d67e1f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034504 Oct 05 03:41:20.152357 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3752/7518] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:41:20.386669 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e6cb85da-94c0-4363-b435-e55e94c2e070 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:20.387318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e6cb85da-94c0-4363-b435-e55e94c2e070 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:20.394473 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6cb85da-94c0-4363-b435-e55e94c2e070 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:20.394963 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6cb85da-94c0-4363-b435-e55e94c2e070 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:20.395428 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6cb85da-94c0-4363-b435-e55e94c2e070 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:20.396117 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6cb85da-94c0-4363-b435-e55e94c2e070 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:20.396570 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6cb85da-94c0-4363-b435-e55e94c2e070 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:20.397033 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6cb85da-94c0-4363-b435-e55e94c2e070 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:20.523670 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e6cb85da-94c0-4363-b435-e55e94c2e070 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:41:20.531374 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e6cb85da-94c0-4363-b435-e55e94c2e070 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00" status: 200 len: 1361 microversion: 2.1 time: 0.148606 Oct 05 03:41:20.531942 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3767/7519] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:41:20 2022] GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:41:21.555405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-588e8147-c1cc-43c9-b48e-8fdf8988e616 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:21.556120 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-588e8147-c1cc-43c9-b48e-8fdf8988e616 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:21.558163 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:41:21.558871 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:41:21.566326 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-588e8147-c1cc-43c9-b48e-8fdf8988e616 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:21.566832 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-588e8147-c1cc-43c9-b48e-8fdf8988e616 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:21.567282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-588e8147-c1cc-43c9-b48e-8fdf8988e616 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:21.567976 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-588e8147-c1cc-43c9-b48e-8fdf8988e616 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:21.568439 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-588e8147-c1cc-43c9-b48e-8fdf8988e616 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:21.568872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-588e8147-c1cc-43c9-b48e-8fdf8988e616 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:21.717191 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-588e8147-c1cc-43c9-b48e-8fdf8988e616 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:41:21.727007 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-588e8147-c1cc-43c9-b48e-8fdf8988e616 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00" status: 200 len: 1361 microversion: 2.1 time: 0.175505 Oct 05 03:41:21.727617 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3753/7520] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:41:21 2022] GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00 => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:41:22.752322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4692c465-64a3-486a-b4a0-6547ff94aa6f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:22.752988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4692c465-64a3-486a-b4a0-6547ff94aa6f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:22.754967 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:41:22.761006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4692c465-64a3-486a-b4a0-6547ff94aa6f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:22.761492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4692c465-64a3-486a-b4a0-6547ff94aa6f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:22.761933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4692c465-64a3-486a-b4a0-6547ff94aa6f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:22.762619 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4692c465-64a3-486a-b4a0-6547ff94aa6f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:22.763068 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4692c465-64a3-486a-b4a0-6547ff94aa6f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:22.763492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4692c465-64a3-486a-b4a0-6547ff94aa6f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:22.893004 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4692c465-64a3-486a-b4a0-6547ff94aa6f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:41:22.900666 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4692c465-64a3-486a-b4a0-6547ff94aa6f tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00" status: 200 len: 1552 microversion: 2.1 time: 0.152902 Oct 05 03:41:22.901272 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3768/7521] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:41:22 2022] GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00 => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:41:22.924638 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-05592b3d-b1ba-431e-9974-3de18a05a63d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:22.925200 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-05592b3d-b1ba-431e-9974-3de18a05a63d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:22.931986 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-05592b3d-b1ba-431e-9974-3de18a05a63d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:22.932858 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-05592b3d-b1ba-431e-9974-3de18a05a63d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:22.933333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-05592b3d-b1ba-431e-9974-3de18a05a63d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:22.934026 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-05592b3d-b1ba-431e-9974-3de18a05a63d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:22.934492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-05592b3d-b1ba-431e-9974-3de18a05a63d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:22.934924 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-05592b3d-b1ba-431e-9974-3de18a05a63d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:23.066041 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-05592b3d-b1ba-431e-9974-3de18a05a63d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:41:23.073994 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-05592b3d-b1ba-431e-9974-3de18a05a63d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00" status: 200 len: 1552 microversion: 2.1 time: 0.154170 Oct 05 03:41:23.074570 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3754/7522] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:41:22 2022] GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00 => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:41:24.573532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-81c88093-6c80-430a-aac3-4cd327929640 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a0557bb-1ea6-49a7-993f-10bc2f382c1f"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:41:24.575973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-81c88093-6c80-430a-aac3-4cd327929640 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:24.583135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81c88093-6c80-430a-aac3-4cd327929640 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:24.583629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81c88093-6c80-430a-aac3-4cd327929640 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:24.584070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81c88093-6c80-430a-aac3-4cd327929640 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:24.584766 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81c88093-6c80-430a-aac3-4cd327929640 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:24.585253 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81c88093-6c80-430a-aac3-4cd327929640 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:24.585684 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-81c88093-6c80-430a-aac3-4cd327929640 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:24.825393 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:41:24.846915 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-81c88093-6c80-430a-aac3-4cd327929640 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "POST /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277255 Oct 05 03:41:24.847577 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3769/7523] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 03:41:24 2022] POST /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:41:35.570061 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d4ab725b-8789-4776-ae31-90cf97036239 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:35.570575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d4ab725b-8789-4776-ae31-90cf97036239 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:35.573456 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:41:35.574170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=72 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:41:35.580758 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4ab725b-8789-4776-ae31-90cf97036239 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:35.581288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4ab725b-8789-4776-ae31-90cf97036239 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:35.581746 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4ab725b-8789-4776-ae31-90cf97036239 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:35.582455 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4ab725b-8789-4776-ae31-90cf97036239 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:35.582928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4ab725b-8789-4776-ae31-90cf97036239 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:35.583370 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d4ab725b-8789-4776-ae31-90cf97036239 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:35.670063 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-d4ab725b-8789-4776-ae31-90cf97036239 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lazy-loading 'services' on Instance uuid 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:41:35.740533 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d4ab725b-8789-4776-ae31-90cf97036239 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00/os-volume_attachments/0a0557bb-1ea6-49a7-993f-10bc2f382c1f" status: 202 len: 0 microversion: 2.1 time: 0.174200 Oct 05 03:41:35.741176 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3755/7524] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 03:41:35 2022] DELETE /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00/os-volume_attachments/0a0557bb-1ea6-49a7-993f-10bc2f382c1f => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 03:41:35.747540 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:41:35.748411 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=2,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:41:35.752598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f5f84a7c-ac4a-40d0-a074-ab6107b5879b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:35.754989 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f5f84a7c-ac4a-40d0-a074-ab6107b5879b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:35.762610 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5f84a7c-ac4a-40d0-a074-ab6107b5879b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:35.763120 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5f84a7c-ac4a-40d0-a074-ab6107b5879b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:35.763540 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5f84a7c-ac4a-40d0-a074-ab6107b5879b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:35.764555 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5f84a7c-ac4a-40d0-a074-ab6107b5879b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:35.765061 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5f84a7c-ac4a-40d0-a074-ab6107b5879b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:35.765491 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f5f84a7c-ac4a-40d0-a074-ab6107b5879b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:35.799665 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f5f84a7c-ac4a-40d0-a074-ab6107b5879b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053943 Oct 05 03:41:35.800242 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3770/7525] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:41:35 2022] GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:41:36.814584 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7499ea71-21af-4df2-a363-d48560460996 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:36.817060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7499ea71-21af-4df2-a363-d48560460996 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:36.823449 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7499ea71-21af-4df2-a363-d48560460996 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:36.823953 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7499ea71-21af-4df2-a363-d48560460996 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:36.824409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7499ea71-21af-4df2-a363-d48560460996 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:36.825156 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7499ea71-21af-4df2-a363-d48560460996 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:36.825632 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7499ea71-21af-4df2-a363-d48560460996 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:36.826070 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7499ea71-21af-4df2-a363-d48560460996 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:36.857031 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7499ea71-21af-4df2-a363-d48560460996 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048418 Oct 05 03:41:36.858079 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3756/7526] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:41:36 2022] GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:41:37.870071 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d86509b6-4a20-4f66-83a5-4e35bb1d3108 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:37.872245 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d86509b6-4a20-4f66-83a5-4e35bb1d3108 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:37.879781 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d86509b6-4a20-4f66-83a5-4e35bb1d3108 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:37.880267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d86509b6-4a20-4f66-83a5-4e35bb1d3108 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:37.880702 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d86509b6-4a20-4f66-83a5-4e35bb1d3108 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:37.881422 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d86509b6-4a20-4f66-83a5-4e35bb1d3108 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:37.881876 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d86509b6-4a20-4f66-83a5-4e35bb1d3108 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:37.882300 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d86509b6-4a20-4f66-83a5-4e35bb1d3108 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:37.913398 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d86509b6-4a20-4f66-83a5-4e35bb1d3108 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047217 Oct 05 03:41:37.913985 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3771/7527] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:41:37 2022] GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:41:38.926200 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a3561c00-77dc-4cfd-ac1b-4c02f6ea33bd tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:38.928306 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a3561c00-77dc-4cfd-ac1b-4c02f6ea33bd tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:38.935253 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3561c00-77dc-4cfd-ac1b-4c02f6ea33bd tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:38.936242 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3561c00-77dc-4cfd-ac1b-4c02f6ea33bd tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:38.936694 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3561c00-77dc-4cfd-ac1b-4c02f6ea33bd tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:38.937433 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3561c00-77dc-4cfd-ac1b-4c02f6ea33bd tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:38.937898 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3561c00-77dc-4cfd-ac1b-4c02f6ea33bd tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:38.938331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3561c00-77dc-4cfd-ac1b-4c02f6ea33bd tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:38.968872 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a3561c00-77dc-4cfd-ac1b-4c02f6ea33bd tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046806 Oct 05 03:41:38.969467 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3757/7528] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:41:38 2022] GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:41:39.981757 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a9cfbb2c-01ab-4111-9707-edcb0f7af714 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:39.984376 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a9cfbb2c-01ab-4111-9707-edcb0f7af714 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:39.990866 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9cfbb2c-01ab-4111-9707-edcb0f7af714 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:39.991350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9cfbb2c-01ab-4111-9707-edcb0f7af714 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:39.991788 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9cfbb2c-01ab-4111-9707-edcb0f7af714 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:39.992483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9cfbb2c-01ab-4111-9707-edcb0f7af714 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:39.992952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9cfbb2c-01ab-4111-9707-edcb0f7af714 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:39.993380 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a9cfbb2c-01ab-4111-9707-edcb0f7af714 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:40.023529 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a9cfbb2c-01ab-4111-9707-edcb0f7af714 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045953 Oct 05 03:41:40.024095 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3772/7529] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:41:39 2022] GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:41:41.036805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ca280f82-1025-44b8-b30e-15f85b3c7192 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:41.039197 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ca280f82-1025-44b8-b30e-15f85b3c7192 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:41.046694 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca280f82-1025-44b8-b30e-15f85b3c7192 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:41.047265 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca280f82-1025-44b8-b30e-15f85b3c7192 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:41.047711 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca280f82-1025-44b8-b30e-15f85b3c7192 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:41.048512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca280f82-1025-44b8-b30e-15f85b3c7192 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:41.049006 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca280f82-1025-44b8-b30e-15f85b3c7192 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:41.049463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ca280f82-1025-44b8-b30e-15f85b3c7192 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:41.085632 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ca280f82-1025-44b8-b30e-15f85b3c7192 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052999 Oct 05 03:41:41.086214 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3758/7530] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:41:41 2022] GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 03:41:41.097407 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9b730c57-65ae-4386-be60-677781218925 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:41.097949 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9b730c57-65ae-4386-be60-677781218925 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:41.105377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b730c57-65ae-4386-be60-677781218925 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:41.105911 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b730c57-65ae-4386-be60-677781218925 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:41.106396 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b730c57-65ae-4386-be60-677781218925 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:41.107094 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b730c57-65ae-4386-be60-677781218925 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:41.107548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b730c57-65ae-4386-be60-677781218925 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:41.107975 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9b730c57-65ae-4386-be60-677781218925 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:41.183337 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-9b730c57-65ae-4386-be60-677781218925 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] HTTP exception thrown: Instance 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00 is not attached to volume 0a0557bb-1ea6-49a7-993f-10bc2f382c1f Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9b730c57-65ae-4386-be60-677781218925 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Request method failure captured: Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00/os-volume_attachments/0a0557bb-1ea6-49a7-993f-10bc2f382c1f HTTP/1.1 Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPyIjAtnTZXYSozwvFuAQ76_NaGIOV8-MKLfTRWSmedDBCMkvoCwwZL1JSQeolUmHB0Pmmv1sKQwivaq-b9iG5vk5c0yg_KO5Wnpt7PNt35R3TxWVH9QppGM0MXkHjkaVu1fpxfVVxUy4MIwrGr2VPCh1OvwmsFQXGlhazzRKxTIVqY Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 9c6019d6170d4feea446e485314eaf43 Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TestEncryptedCinderVolumes-388256451 Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c6019d6170d4feea446e485314eaf43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c6019d6170d4feea446e485314eaf43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9c6019d6170d4feea446e485314eaf43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9c6019d6170d4feea446e485314eaf43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TestEncryptedCinderVolumes-388256451 Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 9c6019d6170d4feea446e485314eaf43 Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-388256451 Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TestEncryptedCinderVolumes-388256451-project Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: a456f2c35f924b058073a994cfdfb8c2 Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TestEncryptedCinderVolumes-388256451-project Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00 is not attached to volume 0a0557bb-1ea6-49a7-993f-10bc2f382c1f Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'server_id': '7b8f0fe0-7561-4bb7-8dc9-21408ad04e00', 'id': '0a0557bb-1ea6-49a7-993f-10bc2f382c1f'} Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0a0557bb-1ea6-49a7-993f-10bc2f382c1f. Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00 is not attached to volume 0a0557bb-1ea6-49a7-993f-10bc2f382c1f Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:41:41.184960 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:41:41.189754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:41:41.189754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:41:41.189754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00 is not attached to volume 0a0557bb-1ea6-49a7-993f-10bc2f382c1f Oct 05 03:41:41.189754 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:41:41.189754 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9b730c57-65ae-4386-be60-677781218925 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Returning 404 to user: Instance 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00 is not attached to volume 0a0557bb-1ea6-49a7-993f-10bc2f382c1f {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:41:41.189754 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9b730c57-65ae-4386-be60-677781218925 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00/os-volume_attachments/0a0557bb-1ea6-49a7-993f-10bc2f382c1f" status: 404 len: 154 microversion: 2.1 time: 0.093142 Oct 05 03:41:41.189754 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3773/7531] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 03:41:41 2022] DELETE /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00/os-volume_attachments/0a0557bb-1ea6-49a7-993f-10bc2f382c1f => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:41:44.550723 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-025dcb83-1240-4a27-b143-a6ba64d654b6 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:44.551245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-025dcb83-1240-4a27-b143-a6ba64d654b6 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:44.557983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-025dcb83-1240-4a27-b143-a6ba64d654b6 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:44.558478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-025dcb83-1240-4a27-b143-a6ba64d654b6 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:44.558920 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-025dcb83-1240-4a27-b143-a6ba64d654b6 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:44.559609 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-025dcb83-1240-4a27-b143-a6ba64d654b6 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:44.560072 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-025dcb83-1240-4a27-b143-a6ba64d654b6 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:44.560503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-025dcb83-1240-4a27-b143-a6ba64d654b6 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:44.586674 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-025dcb83-1240-4a27-b143-a6ba64d654b6 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:41:44.677164 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-025dcb83-1240-4a27-b143-a6ba64d654b6 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00" status: 204 len: 0 microversion: 2.1 time: 0.129743 Oct 05 03:41:44.677908 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3759/7532] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:41:44 2022] DELETE /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:41:44.687101 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3a345a59-b7db-4b55-a674-a1388be80e16 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:44.687725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3a345a59-b7db-4b55-a674-a1388be80e16 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:44.697216 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a345a59-b7db-4b55-a674-a1388be80e16 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:44.697705 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a345a59-b7db-4b55-a674-a1388be80e16 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:44.698146 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a345a59-b7db-4b55-a674-a1388be80e16 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:44.698849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a345a59-b7db-4b55-a674-a1388be80e16 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:44.699306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a345a59-b7db-4b55-a674-a1388be80e16 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:44.699732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a345a59-b7db-4b55-a674-a1388be80e16 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:44.839433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3a345a59-b7db-4b55-a674-a1388be80e16 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:41:44.848810 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3a345a59-b7db-4b55-a674-a1388be80e16 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00" status: 200 len: 1558 microversion: 2.1 time: 0.165863 Oct 05 03:41:44.849417 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3774/7533] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:41:44 2022] GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:41:45.874348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e7844401-9968-4330-89eb-9e01820651e2 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:45.875060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e7844401-9968-4330-89eb-9e01820651e2 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:45.882013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7844401-9968-4330-89eb-9e01820651e2 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:45.882506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7844401-9968-4330-89eb-9e01820651e2 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:45.882951 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7844401-9968-4330-89eb-9e01820651e2 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:45.883645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7844401-9968-4330-89eb-9e01820651e2 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:45.884104 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7844401-9968-4330-89eb-9e01820651e2 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:45.884537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e7844401-9968-4330-89eb-9e01820651e2 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:46.018254 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e7844401-9968-4330-89eb-9e01820651e2 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:41:46.025927 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e7844401-9968-4330-89eb-9e01820651e2 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00" status: 200 len: 1558 microversion: 2.1 time: 0.155858 Oct 05 03:41:46.026505 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3760/7534] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:41:45 2022] GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:41:46.947460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-b04d1ddb-715a-4aed-a825-fc4e078ca3a0 req-449e9cd5-b8a9-45d9-a50f-68fd3406604f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b8f0fe0-7561-4bb7-8dc9-21408ad04e00", "name": "network-vif-deleted", "tag": "3736cd10-cab9-45dc-878d-72227b889219"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:41:46.958821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b04d1ddb-715a-4aed-a825-fc4e078ca3a0 req-449e9cd5-b8a9-45d9-a50f-68fd3406604f service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:46.959645 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b04d1ddb-715a-4aed-a825-fc4e078ca3a0 req-449e9cd5-b8a9-45d9-a50f-68fd3406604f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:46.960085 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b04d1ddb-715a-4aed-a825-fc4e078ca3a0 req-449e9cd5-b8a9-45d9-a50f-68fd3406604f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:46.973324 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-b04d1ddb-715a-4aed-a825-fc4e078ca3a0 req-449e9cd5-b8a9-45d9-a50f-68fd3406604f service nova] Creating event network-vif-deleted:3736cd10-cab9-45dc-878d-72227b889219 for instance 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00 on n-h2-858272-3 Oct 05 03:41:46.979756 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-b04d1ddb-715a-4aed-a825-fc4e078ca3a0 req-449e9cd5-b8a9-45d9-a50f-68fd3406604f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035973 Oct 05 03:41:46.980572 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3775/7535] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:41:47.050503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a30c64bb-e05a-47fd-9f2a-76a76058d78b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:47.051109 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a30c64bb-e05a-47fd-9f2a-76a76058d78b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:47.058624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a30c64bb-e05a-47fd-9f2a-76a76058d78b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:47.059154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a30c64bb-e05a-47fd-9f2a-76a76058d78b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:47.059641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a30c64bb-e05a-47fd-9f2a-76a76058d78b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:47.060387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a30c64bb-e05a-47fd-9f2a-76a76058d78b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:47.060842 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a30c64bb-e05a-47fd-9f2a-76a76058d78b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:47.061917 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a30c64bb-e05a-47fd-9f2a-76a76058d78b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:47.095041 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a30c64bb-e05a-47fd-9f2a-76a76058d78b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:47.095470 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a30c64bb-e05a-47fd-9f2a-76a76058d78b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:47.095919 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a30c64bb-e05a-47fd-9f2a-76a76058d78b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:47.096383 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-a30c64bb-e05a-47fd-9f2a-76a76058d78b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lazy-loading 'fault' on Instance uuid 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:41:47.138654 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a30c64bb-e05a-47fd-9f2a-76a76058d78b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a456f2c35f924b058073a994cfdfb8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6019d6170d4feea446e485314eaf43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:41:47.146682 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a30c64bb-e05a-47fd-9f2a-76a76058d78b tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00" status: 200 len: 1351 microversion: 2.1 time: 0.100451 Oct 05 03:41:47.147251 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3761/7536] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:41:47 2022] GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00 => generated 1351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:41:48.172382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-62b0e0d4-7718-4a2a-9d08-3887e7bc2dd4 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:48.173108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-62b0e0d4-7718-4a2a-9d08-3887e7bc2dd4 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] [instance: 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:41:48.179287 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62b0e0d4-7718-4a2a-9d08-3887e7bc2dd4 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:48.179777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62b0e0d4-7718-4a2a-9d08-3887e7bc2dd4 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:48.180214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62b0e0d4-7718-4a2a-9d08-3887e7bc2dd4 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:48.180913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62b0e0d4-7718-4a2a-9d08-3887e7bc2dd4 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:41:48.181377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62b0e0d4-7718-4a2a-9d08-3887e7bc2dd4 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:41:48.181831 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-62b0e0d4-7718-4a2a-9d08-3887e7bc2dd4 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:41:48.195605 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-62b0e0d4-7718-4a2a-9d08-3887e7bc2dd4 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] HTTP exception thrown: Instance 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00 could not be found. Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-62b0e0d4-7718-4a2a-9d08-3887e7bc2dd4 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Request method failure captured: Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00 HTTP/1.1 Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPPyIjAtnTZXYSozwvFuAQ76_NaGIOV8-MKLfTRWSmedDBCMkvoCwwZL1JSQeolUmHB0Pmmv1sKQwivaq-b9iG5vk5c0yg_KO5Wnpt7PNt35R3TxWVH9QppGM0MXkHjkaVu1fpxfVVxUy4MIwrGr2VPCh1OvwmsFQXGlhazzRKxTIVqY Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 9c6019d6170d4feea446e485314eaf43 Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TestEncryptedCinderVolumes-388256451 Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c6019d6170d4feea446e485314eaf43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c6019d6170d4feea446e485314eaf43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9c6019d6170d4feea446e485314eaf43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9c6019d6170d4feea446e485314eaf43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TestEncryptedCinderVolumes-388256451 Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 9c6019d6170d4feea446e485314eaf43 Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-388256451 Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TestEncryptedCinderVolumes-388256451-project Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: a456f2c35f924b058073a994cfdfb8c2 Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TestEncryptedCinderVolumes-388256451-project Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00 could not be found. Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '7b8f0fe0-7561-4bb7-8dc9-21408ad04e00'} Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00 could not be found. Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00 could not be found. Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:41:48.197224 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:41:48.202751 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:41:48.202751 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:41:48.202751 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:41:48.202751 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:41:48.202751 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:41:48.202751 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00 could not be found. Oct 05 03:41:48.202751 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:41:48.202751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-62b0e0d4-7718-4a2a-9d08-3887e7bc2dd4 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Returning 404 to user: Instance 7b8f0fe0-7561-4bb7-8dc9-21408ad04e00 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:41:48.202751 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-62b0e0d4-7718-4a2a-9d08-3887e7bc2dd4 tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00" status: 404 len: 111 microversion: 2.1 time: 0.031898 Oct 05 03:41:48.202751 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3776/7537] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:41:48 2022] GET /compute/v2.1/servers/7b8f0fe0-7561-4bb7-8dc9-21408ad04e00 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:41:48.207340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c9b22f05-0a9d-44e7-a664-937a3bf1e60d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] Calling method '.version_select at 0x7fcce8202820>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:41:48.227785 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c9b22f05-0a9d-44e7-a664-937a3bf1e60d tempest-TestEncryptedCinderVolumes-388256451 tempest-TestEncryptedCinderVolumes-388256451-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-453863510" status: 202 len: 0 microversion: 2.1 time: 0.024019 Oct 05 03:41:48.228378 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3762/7538] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 03:41:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-453863510 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:42:15.429814 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-498a9f85-7db0-48fa-9cb2-3fec419e4d5b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Action: 'create', calling method: .version_select at 0x7fccdea46d30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-664079361", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGVg8XXZOkwOhBnFzHHIFzsvjOyY/HAJlychnwqluDE009aldXUC6J0nzWlU8MFVokyZL7PEF3gfzXKF2Agf7vmPqnXW9/PhTXuf+YmI3BLGCJbGTF3TsQ9K8ZsL/lmQw=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:42:15.435941 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=14 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:42:15.436820 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=34 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:42:15.448290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-498a9f85-7db0-48fa-9cb2-3fec419e4d5b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Getting quotas for project 2e22d6e1c9a5495b8c152d7c7e5b1aff. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:42:15.453477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-498a9f85-7db0-48fa-9cb2-3fec419e4d5b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Getting quotas for user cf1e0670dd7341d0a2c237722f903537 and project 2e22d6e1c9a5495b8c152d7c7e5b1aff. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:42:15.478777 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-498a9f85-7db0-48fa-9cb2-3fec419e4d5b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.053047 Oct 05 03:42:15.479375 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3777/7539] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 03:42:15 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:42:15.526159 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:42:15.526943 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:42:15.531928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7deaf011-ed9f-42a5-a9d4-f2896bdc7b3b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1213633703", "imageRef": "f7a6523c-840e-4f86-ad1d-a2cc5c7b5d7a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-664079361", "networks": [{"uuid": "b4bbcf64-d570-4155-9061-823e5463e91e"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:42:15.584356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-7deaf011-ed9f-42a5-a9d4-f2896bdc7b3b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] validate_networks() for [('b4bbcf64-d570-4155-9061-823e5463e91e', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:42:15.956707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-7deaf011-ed9f-42a5-a9d4-f2896bdc7b3b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:42:15.957178 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-7deaf011-ed9f-42a5-a9d4-f2896bdc7b3b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:42:15.957664 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-7deaf011-ed9f-42a5-a9d4-f2896bdc7b3b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:42:15.958084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-7deaf011-ed9f-42a5-a9d4-f2896bdc7b3b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:42:15.958503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-7deaf011-ed9f-42a5-a9d4-f2896bdc7b3b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:42:15.968101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7deaf011-ed9f-42a5-a9d4-f2896bdc7b3b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:15.968597 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7deaf011-ed9f-42a5-a9d4-f2896bdc7b3b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:15.969151 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7deaf011-ed9f-42a5-a9d4-f2896bdc7b3b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:15.969890 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7deaf011-ed9f-42a5-a9d4-f2896bdc7b3b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:15.970356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7deaf011-ed9f-42a5-a9d4-f2896bdc7b3b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:15.970791 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7deaf011-ed9f-42a5-a9d4-f2896bdc7b3b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:15.989394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-7deaf011-ed9f-42a5-a9d4-f2896bdc7b3b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Getting quotas for project 2e22d6e1c9a5495b8c152d7c7e5b1aff. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:42:15.995334 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-7deaf011-ed9f-42a5-a9d4-f2896bdc7b3b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Getting quotas for user cf1e0670dd7341d0a2c237722f903537 and project 2e22d6e1c9a5495b8c152d7c7e5b1aff. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:42:16.007549 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7deaf011-ed9f-42a5-a9d4-f2896bdc7b3b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:42:16.009973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7deaf011-ed9f-42a5-a9d4-f2896bdc7b3b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f7a6523c-840e-4f86-ad1d-a2cc5c7b5d7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:42:16.056431 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7deaf011-ed9f-42a5-a9d4-f2896bdc7b3b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.532267 Oct 05 03:42:16.057127 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3763/7540] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:42:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:42:16.068142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9c63382c-d813-4383-9b2e-bb9b634bc409 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:42:16.068759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9c63382c-d813-4383-9b2e-bb9b634bc409 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:42:16.130961 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9c63382c-d813-4383-9b2e-bb9b634bc409 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:42:16.137903 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9c63382c-d813-4383-9b2e-bb9b634bc409 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577" status: 200 len: 1258 microversion: 2.1 time: 0.073708 Oct 05 03:42:16.139315 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3778/7541] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:42:16 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577 => generated 1258 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:42:17.161739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-aa63c7f7-3960-4609-9df0-a91f9a0ac551 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:42:17.163008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-aa63c7f7-3960-4609-9df0-a91f9a0ac551 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:42:17.169844 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa63c7f7-3960-4609-9df0-a91f9a0ac551 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:17.170344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa63c7f7-3960-4609-9df0-a91f9a0ac551 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:17.170787 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa63c7f7-3960-4609-9df0-a91f9a0ac551 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:17.171681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa63c7f7-3960-4609-9df0-a91f9a0ac551 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:17.172339 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa63c7f7-3960-4609-9df0-a91f9a0ac551 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:17.172781 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-aa63c7f7-3960-4609-9df0-a91f9a0ac551 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:17.250230 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-aa63c7f7-3960-4609-9df0-a91f9a0ac551 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:42:17.258879 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-aa63c7f7-3960-4609-9df0-a91f9a0ac551 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577" status: 200 len: 1318 microversion: 2.1 time: 0.100994 Oct 05 03:42:17.259471 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3764/7542] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:42:17 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577 => generated 1318 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:42:18.284007 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-01e2c1f4-40d0-4be0-ba70-570c86892bd6 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:42:18.284685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-01e2c1f4-40d0-4be0-ba70-570c86892bd6 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:42:18.294602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01e2c1f4-40d0-4be0-ba70-570c86892bd6 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:18.295507 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01e2c1f4-40d0-4be0-ba70-570c86892bd6 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:18.296169 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01e2c1f4-40d0-4be0-ba70-570c86892bd6 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:18.297293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01e2c1f4-40d0-4be0-ba70-570c86892bd6 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:18.297870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01e2c1f4-40d0-4be0-ba70-570c86892bd6 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:18.298372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01e2c1f4-40d0-4be0-ba70-570c86892bd6 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:18.504595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-01e2c1f4-40d0-4be0-ba70-570c86892bd6 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:42:18.514683 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-01e2c1f4-40d0-4be0-ba70-570c86892bd6 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577" status: 200 len: 1358 microversion: 2.1 time: 0.235923 Oct 05 03:42:18.523440 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3779/7543] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:42:18 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577 => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:42:19.538386 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c8c41061-6904-4754-9372-fd0c58c71657 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:42:19.539027 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c8c41061-6904-4754-9372-fd0c58c71657 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:42:19.546655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8c41061-6904-4754-9372-fd0c58c71657 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:19.547161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8c41061-6904-4754-9372-fd0c58c71657 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:19.547880 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8c41061-6904-4754-9372-fd0c58c71657 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:19.548600 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8c41061-6904-4754-9372-fd0c58c71657 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:19.549115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8c41061-6904-4754-9372-fd0c58c71657 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:19.549558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c8c41061-6904-4754-9372-fd0c58c71657 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:19.922180 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c8c41061-6904-4754-9372-fd0c58c71657 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:42:19.930196 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c8c41061-6904-4754-9372-fd0c58c71657 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577" status: 200 len: 1358 microversion: 2.1 time: 0.395926 Oct 05 03:42:19.930821 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3765/7544] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:42:19 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577 => generated 1358 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:42:20.956458 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cdb711f9-3294-458c-8af9-d7cc10a15ef2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:42:20.958071 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cdb711f9-3294-458c-8af9-d7cc10a15ef2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:42:20.966000 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdb711f9-3294-458c-8af9-d7cc10a15ef2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:20.968302 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdb711f9-3294-458c-8af9-d7cc10a15ef2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:20.969575 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdb711f9-3294-458c-8af9-d7cc10a15ef2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:20.971391 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdb711f9-3294-458c-8af9-d7cc10a15ef2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:20.972399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdb711f9-3294-458c-8af9-d7cc10a15ef2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:20.973059 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdb711f9-3294-458c-8af9-d7cc10a15ef2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:21.174879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cdb711f9-3294-458c-8af9-d7cc10a15ef2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:42:21.182972 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cdb711f9-3294-458c-8af9-d7cc10a15ef2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577" status: 200 len: 1358 microversion: 2.1 time: 0.232472 Oct 05 03:42:21.183559 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3780/7545] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:42:20 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577 => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:42:22.207688 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2d1580ee-49b7-4952-8a73-89754c73bbc9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:42:22.208408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2d1580ee-49b7-4952-8a73-89754c73bbc9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:42:22.215767 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d1580ee-49b7-4952-8a73-89754c73bbc9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:22.216495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d1580ee-49b7-4952-8a73-89754c73bbc9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:22.217150 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d1580ee-49b7-4952-8a73-89754c73bbc9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:22.217847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d1580ee-49b7-4952-8a73-89754c73bbc9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:22.218332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d1580ee-49b7-4952-8a73-89754c73bbc9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:22.218772 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2d1580ee-49b7-4952-8a73-89754c73bbc9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:22.385589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2d1580ee-49b7-4952-8a73-89754c73bbc9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:42:22.395994 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2d1580ee-49b7-4952-8a73-89754c73bbc9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577" status: 200 len: 1358 microversion: 2.1 time: 0.192272 Oct 05 03:42:22.396591 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3766/7546] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:42:22 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:42:23.419056 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-96677478-ed46-4b88-962b-544ca2e43576 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:42:23.420822 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-96677478-ed46-4b88-962b-544ca2e43576 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:42:23.428386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96677478-ed46-4b88-962b-544ca2e43576 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:23.428886 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96677478-ed46-4b88-962b-544ca2e43576 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:23.429347 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96677478-ed46-4b88-962b-544ca2e43576 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:23.430069 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96677478-ed46-4b88-962b-544ca2e43576 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:23.430530 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96677478-ed46-4b88-962b-544ca2e43576 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:23.430963 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-96677478-ed46-4b88-962b-544ca2e43576 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:23.588434 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-96677478-ed46-4b88-962b-544ca2e43576 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:42:23.597769 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-96677478-ed46-4b88-962b-544ca2e43576 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577" status: 200 len: 1358 microversion: 2.1 time: 0.182529 Oct 05 03:42:23.598369 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3781/7547] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:42:23 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:42:24.621436 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c84c5a5b-ad7f-4296-aace-688a59e68c4c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:42:24.622069 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c84c5a5b-ad7f-4296-aace-688a59e68c4c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:42:24.630006 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c84c5a5b-ad7f-4296-aace-688a59e68c4c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:24.630511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c84c5a5b-ad7f-4296-aace-688a59e68c4c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:24.630967 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c84c5a5b-ad7f-4296-aace-688a59e68c4c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:24.631673 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c84c5a5b-ad7f-4296-aace-688a59e68c4c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:24.632146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c84c5a5b-ad7f-4296-aace-688a59e68c4c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:24.632588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c84c5a5b-ad7f-4296-aace-688a59e68c4c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:24.767194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c84c5a5b-ad7f-4296-aace-688a59e68c4c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:42:24.774947 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c84c5a5b-ad7f-4296-aace-688a59e68c4c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577" status: 200 len: 1358 microversion: 2.1 time: 0.157509 Oct 05 03:42:24.775526 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3767/7548] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:42:24 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:42:25.798883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ab8e0ee5-12e7-4526-9957-237d67af1b69 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:42:25.799527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ab8e0ee5-12e7-4526-9957-237d67af1b69 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:42:25.806554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab8e0ee5-12e7-4526-9957-237d67af1b69 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:25.807041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab8e0ee5-12e7-4526-9957-237d67af1b69 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:25.807470 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab8e0ee5-12e7-4526-9957-237d67af1b69 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:25.808156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab8e0ee5-12e7-4526-9957-237d67af1b69 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:25.808604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab8e0ee5-12e7-4526-9957-237d67af1b69 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:25.809053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ab8e0ee5-12e7-4526-9957-237d67af1b69 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:25.936512 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ab8e0ee5-12e7-4526-9957-237d67af1b69 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:42:25.944444 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ab8e0ee5-12e7-4526-9957-237d67af1b69 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577" status: 200 len: 1358 microversion: 2.1 time: 0.149615 Oct 05 03:42:25.945040 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3782/7549] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:42:25 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:42:26.969363 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-307afb58-326e-4bd1-be0c-f5cf65cbb508 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:42:26.970002 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-307afb58-326e-4bd1-be0c-f5cf65cbb508 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:42:26.972757 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:42:26.973479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:42:26.980441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-307afb58-326e-4bd1-be0c-f5cf65cbb508 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:26.980965 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-307afb58-326e-4bd1-be0c-f5cf65cbb508 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:26.981428 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-307afb58-326e-4bd1-be0c-f5cf65cbb508 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:26.983314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-307afb58-326e-4bd1-be0c-f5cf65cbb508 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:26.983795 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-307afb58-326e-4bd1-be0c-f5cf65cbb508 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:26.984243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-307afb58-326e-4bd1-be0c-f5cf65cbb508 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:27.123684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-307afb58-326e-4bd1-be0c-f5cf65cbb508 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:42:27.131729 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-307afb58-326e-4bd1-be0c-f5cf65cbb508 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577" status: 200 len: 1358 microversion: 2.1 time: 0.167560 Oct 05 03:42:27.132303 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3768/7550] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:42:26 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:42:28.155351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-91a750ff-472b-4521-beb8-a6f1b1c517b3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:42:28.155973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-91a750ff-472b-4521-beb8-a6f1b1c517b3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:42:28.157882 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:42:28.163962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91a750ff-472b-4521-beb8-a6f1b1c517b3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:28.164451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91a750ff-472b-4521-beb8-a6f1b1c517b3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:28.164888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91a750ff-472b-4521-beb8-a6f1b1c517b3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:28.165601 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91a750ff-472b-4521-beb8-a6f1b1c517b3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:28.166058 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91a750ff-472b-4521-beb8-a6f1b1c517b3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:28.166485 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-91a750ff-472b-4521-beb8-a6f1b1c517b3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:28.295043 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-91a750ff-472b-4521-beb8-a6f1b1c517b3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:42:28.303068 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-91a750ff-472b-4521-beb8-a6f1b1c517b3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577" status: 200 len: 1358 microversion: 2.1 time: 0.151805 Oct 05 03:42:28.303645 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3783/7551] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:42:28 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:42:29.060261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-db6cb997-ba9f-4c2d-964a-3716c4c33f37 req-26dee43a-e464-486e-bd79-9acc1a965517 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc605f8f-2129-42d1-8d6c-92d2066df577", "tag": "939980ce-fc8e-412d-bcaf-9726b0b526be"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:42:29.070909 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-db6cb997-ba9f-4c2d-964a-3716c4c33f37 req-26dee43a-e464-486e-bd79-9acc1a965517 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:29.071407 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-db6cb997-ba9f-4c2d-964a-3716c4c33f37 req-26dee43a-e464-486e-bd79-9acc1a965517 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:29.071851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-db6cb997-ba9f-4c2d-964a-3716c4c33f37 req-26dee43a-e464-486e-bd79-9acc1a965517 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:29.084145 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-db6cb997-ba9f-4c2d-964a-3716c4c33f37 req-26dee43a-e464-486e-bd79-9acc1a965517 service nova] Creating event network-changed:939980ce-fc8e-412d-bcaf-9726b0b526be for instance cc605f8f-2129-42d1-8d6c-92d2066df577 on n-h2-858272-3 Oct 05 03:42:29.089098 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-db6cb997-ba9f-4c2d-964a-3716c4c33f37 req-26dee43a-e464-486e-bd79-9acc1a965517 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032733 Oct 05 03:42:29.089771 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3769/7552] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:42:29.326739 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-10c4ac91-9376-4d72-9f0b-159c96798ab2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:42:29.327353 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-10c4ac91-9376-4d72-9f0b-159c96798ab2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:42:29.334965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-10c4ac91-9376-4d72-9f0b-159c96798ab2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:29.335458 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-10c4ac91-9376-4d72-9f0b-159c96798ab2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:29.335926 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-10c4ac91-9376-4d72-9f0b-159c96798ab2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:29.336637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-10c4ac91-9376-4d72-9f0b-159c96798ab2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:29.337117 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-10c4ac91-9376-4d72-9f0b-159c96798ab2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:29.337544 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-10c4ac91-9376-4d72-9f0b-159c96798ab2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:29.546875 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-10c4ac91-9376-4d72-9f0b-159c96798ab2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:42:29.554746 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-10c4ac91-9376-4d72-9f0b-159c96798ab2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577" status: 200 len: 1358 microversion: 2.1 time: 0.232636 Oct 05 03:42:29.555323 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3784/7553] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:42:29 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577 => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:42:30.579384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1b293b8c-1507-4519-9851-afa83ef9ab92 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:42:30.580101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1b293b8c-1507-4519-9851-afa83ef9ab92 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:42:30.586357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b293b8c-1507-4519-9851-afa83ef9ab92 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:30.586858 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b293b8c-1507-4519-9851-afa83ef9ab92 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:30.587308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b293b8c-1507-4519-9851-afa83ef9ab92 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:30.588007 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b293b8c-1507-4519-9851-afa83ef9ab92 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:30.588476 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b293b8c-1507-4519-9851-afa83ef9ab92 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:30.588935 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1b293b8c-1507-4519-9851-afa83ef9ab92 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:30.719158 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1b293b8c-1507-4519-9851-afa83ef9ab92 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:42:30.727113 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1b293b8c-1507-4519-9851-afa83ef9ab92 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577" status: 200 len: 1358 microversion: 2.1 time: 0.152710 Oct 05 03:42:30.727691 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3770/7554] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:42:30 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:42:31.751698 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-88fcfb09-b75e-46e6-82e0-1f8a37ce5a64 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:42:31.752239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-88fcfb09-b75e-46e6-82e0-1f8a37ce5a64 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:42:31.759041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88fcfb09-b75e-46e6-82e0-1f8a37ce5a64 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:31.759526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88fcfb09-b75e-46e6-82e0-1f8a37ce5a64 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:31.759960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88fcfb09-b75e-46e6-82e0-1f8a37ce5a64 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:31.760649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88fcfb09-b75e-46e6-82e0-1f8a37ce5a64 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:31.761125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88fcfb09-b75e-46e6-82e0-1f8a37ce5a64 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:31.761553 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88fcfb09-b75e-46e6-82e0-1f8a37ce5a64 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:32.302818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-88fcfb09-b75e-46e6-82e0-1f8a37ce5a64 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:42:32.311645 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-88fcfb09-b75e-46e6-82e0-1f8a37ce5a64 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577" status: 200 len: 1358 microversion: 2.1 time: 0.564509 Oct 05 03:42:32.312239 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3785/7555] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:42:31 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577 => generated 1358 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:42:33.335641 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-661b4a40-5184-4ec9-9ee1-2049d55acc78 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:42:33.336251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-661b4a40-5184-4ec9-9ee1-2049d55acc78 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:42:33.343530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-661b4a40-5184-4ec9-9ee1-2049d55acc78 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:33.344033 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-661b4a40-5184-4ec9-9ee1-2049d55acc78 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:33.344489 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-661b4a40-5184-4ec9-9ee1-2049d55acc78 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:33.345312 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-661b4a40-5184-4ec9-9ee1-2049d55acc78 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:33.345780 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-661b4a40-5184-4ec9-9ee1-2049d55acc78 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:33.346238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-661b4a40-5184-4ec9-9ee1-2049d55acc78 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:33.484349 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-661b4a40-5184-4ec9-9ee1-2049d55acc78 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:42:33.492111 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-661b4a40-5184-4ec9-9ee1-2049d55acc78 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577" status: 200 len: 1358 microversion: 2.1 time: 0.160421 Oct 05 03:42:33.492718 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3771/7556] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:42:33 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:42:34.516542 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6078e69a-619e-4862-8410-4b57ed6dc484 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:42:34.517174 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6078e69a-619e-4862-8410-4b57ed6dc484 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:42:34.524007 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6078e69a-619e-4862-8410-4b57ed6dc484 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:34.524634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6078e69a-619e-4862-8410-4b57ed6dc484 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:34.525104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6078e69a-619e-4862-8410-4b57ed6dc484 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:34.525973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6078e69a-619e-4862-8410-4b57ed6dc484 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:34.526785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6078e69a-619e-4862-8410-4b57ed6dc484 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:34.527572 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6078e69a-619e-4862-8410-4b57ed6dc484 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:34.673508 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6078e69a-619e-4862-8410-4b57ed6dc484 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:42:34.683391 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6078e69a-619e-4862-8410-4b57ed6dc484 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577" status: 200 len: 1358 microversion: 2.1 time: 0.171421 Oct 05 03:42:34.684071 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3786/7557] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:42:34 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:42:35.707022 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-34cf5919-e80d-46d4-9aa4-20d8936faba9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:42:35.707654 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-34cf5919-e80d-46d4-9aa4-20d8936faba9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:42:35.714555 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34cf5919-e80d-46d4-9aa4-20d8936faba9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:35.715064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34cf5919-e80d-46d4-9aa4-20d8936faba9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:35.716053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34cf5919-e80d-46d4-9aa4-20d8936faba9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:35.716973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34cf5919-e80d-46d4-9aa4-20d8936faba9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:35.717451 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34cf5919-e80d-46d4-9aa4-20d8936faba9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:35.717893 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34cf5919-e80d-46d4-9aa4-20d8936faba9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:35.853114 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-34cf5919-e80d-46d4-9aa4-20d8936faba9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:42:35.861381 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-34cf5919-e80d-46d4-9aa4-20d8936faba9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577" status: 200 len: 1358 microversion: 2.1 time: 0.158263 Oct 05 03:42:35.861958 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3772/7558] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:42:35 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:42:36.476982 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-ed661469-2051-4f71-bb3d-522675546605 req-833322e5-8421-4b73-8925-53fea9942a25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc605f8f-2129-42d1-8d6c-92d2066df577", "name": "network-vif-plugged", "status": "completed", "tag": "939980ce-fc8e-412d-bcaf-9726b0b526be"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:42:36.489275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ed661469-2051-4f71-bb3d-522675546605 req-833322e5-8421-4b73-8925-53fea9942a25 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:36.489951 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ed661469-2051-4f71-bb3d-522675546605 req-833322e5-8421-4b73-8925-53fea9942a25 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:36.490663 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ed661469-2051-4f71-bb3d-522675546605 req-833322e5-8421-4b73-8925-53fea9942a25 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:36.504083 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-ed661469-2051-4f71-bb3d-522675546605 req-833322e5-8421-4b73-8925-53fea9942a25 service nova] Creating event network-vif-plugged:939980ce-fc8e-412d-bcaf-9726b0b526be for instance cc605f8f-2129-42d1-8d6c-92d2066df577 on n-h2-858272-3 Oct 05 03:42:36.509135 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-ed661469-2051-4f71-bb3d-522675546605 req-833322e5-8421-4b73-8925-53fea9942a25 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036775 Oct 05 03:42:36.509913 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3787/7559] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:42:36.883938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e94f2403-d7ef-41a0-97ea-9663078ecad7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:42:36.884567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e94f2403-d7ef-41a0-97ea-9663078ecad7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:42:36.891332 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e94f2403-d7ef-41a0-97ea-9663078ecad7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:36.891776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e94f2403-d7ef-41a0-97ea-9663078ecad7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:36.892229 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e94f2403-d7ef-41a0-97ea-9663078ecad7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:36.892951 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e94f2403-d7ef-41a0-97ea-9663078ecad7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:36.893426 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e94f2403-d7ef-41a0-97ea-9663078ecad7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:36.893897 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e94f2403-d7ef-41a0-97ea-9663078ecad7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:37.021982 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e94f2403-d7ef-41a0-97ea-9663078ecad7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:42:37.029948 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e94f2403-d7ef-41a0-97ea-9663078ecad7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577" status: 200 len: 1358 microversion: 2.1 time: 0.150166 Oct 05 03:42:37.030524 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3773/7560] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:42:36 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:42:38.054020 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-04b136b7-dc6d-4aa2-85bd-9ebb38e4e22a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:42:38.054718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-04b136b7-dc6d-4aa2-85bd-9ebb38e4e22a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:42:38.062191 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-04b136b7-dc6d-4aa2-85bd-9ebb38e4e22a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:38.062671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-04b136b7-dc6d-4aa2-85bd-9ebb38e4e22a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:38.063106 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-04b136b7-dc6d-4aa2-85bd-9ebb38e4e22a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:38.063790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-04b136b7-dc6d-4aa2-85bd-9ebb38e4e22a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:38.064240 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-04b136b7-dc6d-4aa2-85bd-9ebb38e4e22a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:38.064663 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-04b136b7-dc6d-4aa2-85bd-9ebb38e4e22a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:38.198842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-04b136b7-dc6d-4aa2-85bd-9ebb38e4e22a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:42:38.207172 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-04b136b7-dc6d-4aa2-85bd-9ebb38e4e22a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577" status: 200 len: 1358 microversion: 2.1 time: 0.157397 Oct 05 03:42:38.207750 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3788/7561] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:42:38 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:42:39.232099 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-354effd0-2466-4964-b4ea-40b36b7ad2d7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:42:39.232829 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-354effd0-2466-4964-b4ea-40b36b7ad2d7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:42:39.239749 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-354effd0-2466-4964-b4ea-40b36b7ad2d7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:39.240250 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-354effd0-2466-4964-b4ea-40b36b7ad2d7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:39.240702 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-354effd0-2466-4964-b4ea-40b36b7ad2d7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:39.241427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-354effd0-2466-4964-b4ea-40b36b7ad2d7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:39.241900 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-354effd0-2466-4964-b4ea-40b36b7ad2d7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:39.242343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-354effd0-2466-4964-b4ea-40b36b7ad2d7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:39.369344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-354effd0-2466-4964-b4ea-40b36b7ad2d7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:42:39.377929 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-354effd0-2466-4964-b4ea-40b36b7ad2d7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577" status: 200 len: 1548 microversion: 2.1 time: 0.150393 Oct 05 03:42:39.378507 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3774/7562] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:42:39 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:42:39.401521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d91cca4d-14af-47df-9c77-fca94b9ef005 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:42:39.402138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d91cca4d-14af-47df-9c77-fca94b9ef005 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:42:39.409032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d91cca4d-14af-47df-9c77-fca94b9ef005 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:39.409632 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d91cca4d-14af-47df-9c77-fca94b9ef005 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:39.410075 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d91cca4d-14af-47df-9c77-fca94b9ef005 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:39.410769 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d91cca4d-14af-47df-9c77-fca94b9ef005 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:39.411254 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d91cca4d-14af-47df-9c77-fca94b9ef005 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:39.411680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d91cca4d-14af-47df-9c77-fca94b9ef005 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:39.544981 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d91cca4d-14af-47df-9c77-fca94b9ef005 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:42:39.552682 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d91cca4d-14af-47df-9c77-fca94b9ef005 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577" status: 200 len: 1548 microversion: 2.1 time: 0.155353 Oct 05 03:42:39.553333 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3789/7563] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:42:39 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:42:39.574119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dff5a9dc-4159-4ddf-a4a7-2a77d983875d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:42:39.578878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dff5a9dc-4159-4ddf-a4a7-2a77d983875d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:42:39.579658 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dff5a9dc-4159-4ddf-a4a7-2a77d983875d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Searching by: {'deleted': False, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff'} {{(pid=122320) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 03:42:39.584891 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dff5a9dc-4159-4ddf-a4a7-2a77d983875d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:39.585432 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dff5a9dc-4159-4ddf-a4a7-2a77d983875d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:39.585881 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dff5a9dc-4159-4ddf-a4a7-2a77d983875d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:39.586609 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dff5a9dc-4159-4ddf-a4a7-2a77d983875d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:39.587077 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dff5a9dc-4159-4ddf-a4a7-2a77d983875d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:39.587511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dff5a9dc-4159-4ddf-a4a7-2a77d983875d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:39.611563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.multi_cell_list [None req-dff5a9dc-4159-4ddf-a4a7-2a77d983875d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 03:42:39.637481 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dff5a9dc-4159-4ddf-a4a7-2a77d983875d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.067165 Oct 05 03:42:39.638060 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3775/7564] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 5 03:42:39 2022] GET /compute/v2.1/servers => generated 343 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:42:39.649566 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-065230fb-deda-4429-904d-4c3ae4b63a63 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:42:39.650207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-065230fb-deda-4429-904d-4c3ae4b63a63 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:42:39.656711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-065230fb-deda-4429-904d-4c3ae4b63a63 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:39.657238 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-065230fb-deda-4429-904d-4c3ae4b63a63 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:39.657683 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-065230fb-deda-4429-904d-4c3ae4b63a63 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:39.658386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-065230fb-deda-4429-904d-4c3ae4b63a63 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:39.658848 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-065230fb-deda-4429-904d-4c3ae4b63a63 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:39.659281 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-065230fb-deda-4429-904d-4c3ae4b63a63 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:39.788091 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-065230fb-deda-4429-904d-4c3ae4b63a63 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:42:39.795934 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-065230fb-deda-4429-904d-4c3ae4b63a63 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577" status: 200 len: 1548 microversion: 2.1 time: 0.150248 Oct 05 03:42:39.796508 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3790/7565] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:42:39 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:42:41.353128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-967f658d-fe21-4f79-8717-87a3076d1e4f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a6ebd37-8839-4c8d-8615-38df0b6e0253"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:42:41.355586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-967f658d-fe21-4f79-8717-87a3076d1e4f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:42:41.362801 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-967f658d-fe21-4f79-8717-87a3076d1e4f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:41.363370 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-967f658d-fe21-4f79-8717-87a3076d1e4f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:41.363830 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-967f658d-fe21-4f79-8717-87a3076d1e4f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:41.364549 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-967f658d-fe21-4f79-8717-87a3076d1e4f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:41.365053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-967f658d-fe21-4f79-8717-87a3076d1e4f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:41.365498 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-967f658d-fe21-4f79-8717-87a3076d1e4f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:41.634960 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-967f658d-fe21-4f79-8717-87a3076d1e4f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "POST /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286055 Oct 05 03:42:41.635614 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3776/7566] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 03:42:41 2022] POST /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:42:54.700434 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-db074c17-3f98-4fa1-852d-e7d913693598 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:42:54.701052 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-db074c17-3f98-4fa1-852d-e7d913693598 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:42:54.704017 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:42:54.704677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=68 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:42:54.711233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db074c17-3f98-4fa1-852d-e7d913693598 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:54.711780 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db074c17-3f98-4fa1-852d-e7d913693598 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:54.712214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db074c17-3f98-4fa1-852d-e7d913693598 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:54.712916 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db074c17-3f98-4fa1-852d-e7d913693598 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:54.713376 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db074c17-3f98-4fa1-852d-e7d913693598 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:54.713798 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-db074c17-3f98-4fa1-852d-e7d913693598 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:54.861796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-db074c17-3f98-4fa1-852d-e7d913693598 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:42:54.870738 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-db074c17-3f98-4fa1-852d-e7d913693598 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577" status: 200 len: 1594 microversion: 2.1 time: 0.174103 Oct 05 03:42:54.871370 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3791/7567] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:42:54 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577 => generated 1594 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:42:56.494785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:42:56.498530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:42:56.498530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:42:56.570904 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-1c7a359a-fa1a-4267-b3b7-8a687fc17a3c req-f425789e-10d8-4768-a387-9dcf7be8dc58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc605f8f-2129-42d1-8d6c-92d2066df577", "tag": "939980ce-fc8e-412d-bcaf-9726b0b526be"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:42:56.581609 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1c7a359a-fa1a-4267-b3b7-8a687fc17a3c req-f425789e-10d8-4768-a387-9dcf7be8dc58 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:56.582217 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1c7a359a-fa1a-4267-b3b7-8a687fc17a3c req-f425789e-10d8-4768-a387-9dcf7be8dc58 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:56.582764 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1c7a359a-fa1a-4267-b3b7-8a687fc17a3c req-f425789e-10d8-4768-a387-9dcf7be8dc58 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:56.597735 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-1c7a359a-fa1a-4267-b3b7-8a687fc17a3c req-f425789e-10d8-4768-a387-9dcf7be8dc58 service nova] Creating event network-changed:939980ce-fc8e-412d-bcaf-9726b0b526be for instance cc605f8f-2129-42d1-8d6c-92d2066df577 on n-h2-858272-3 Oct 05 03:42:56.604136 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-1c7a359a-fa1a-4267-b3b7-8a687fc17a3c req-f425789e-10d8-4768-a387-9dcf7be8dc58 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111069 Oct 05 03:42:56.605336 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3777/7568] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:42:57.602463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1de1d239-3d83-4b3f-9793-3d32dc61414a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-313925037"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:42:57.603033 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1de1d239-3d83-4b3f-9793-3d32dc61414a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:42:57.610670 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1de1d239-3d83-4b3f-9793-3d32dc61414a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:57.611168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1de1d239-3d83-4b3f-9793-3d32dc61414a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:57.611613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1de1d239-3d83-4b3f-9793-3d32dc61414a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:57.612330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1de1d239-3d83-4b3f-9793-3d32dc61414a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:57.612791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1de1d239-3d83-4b3f-9793-3d32dc61414a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:57.613248 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1de1d239-3d83-4b3f-9793-3d32dc61414a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:57.754516 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.network.security_group_api [None req-1de1d239-3d83-4b3f-9793-3d32dc61414a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Adding security group 6ee96fb4-34c8-467e-a425-016c299f4254 to port 939980ce-fc8e-412d-bcaf-9726b0b526be Oct 05 03:42:58.079455 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1de1d239-3d83-4b3f-9793-3d32dc61414a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "POST /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577/action" status: 202 len: 0 microversion: 2.1 time: 0.481392 Oct 05 03:42:58.080078 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3792/7569] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:42:57 2022] POST /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577/action => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:42:58.089634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dfebc389-568f-4fb0-aade-ae62ccc44c0a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:42:58.091307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dfebc389-568f-4fb0-aade-ae62ccc44c0a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:42:58.098588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfebc389-568f-4fb0-aade-ae62ccc44c0a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:58.099098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfebc389-568f-4fb0-aade-ae62ccc44c0a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:58.099553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfebc389-568f-4fb0-aade-ae62ccc44c0a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:58.100275 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfebc389-568f-4fb0-aade-ae62ccc44c0a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:58.100748 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfebc389-568f-4fb0-aade-ae62ccc44c0a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:58.101211 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dfebc389-568f-4fb0-aade-ae62ccc44c0a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:58.250481 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dfebc389-568f-4fb0-aade-ae62ccc44c0a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:42:58.258829 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dfebc389-568f-4fb0-aade-ae62ccc44c0a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577" status: 200 len: 1758 microversion: 2.1 time: 0.174270 Oct 05 03:42:58.259405 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3778/7570] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:42:58 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577 => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:42:58.622137 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-aefe36eb-7dcc-41fb-aab8-d9f5ad417dcb req-4d9160a0-2ad2-4cdc-8500-d07d75d27033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc605f8f-2129-42d1-8d6c-92d2066df577", "tag": "939980ce-fc8e-412d-bcaf-9726b0b526be"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:42:58.631767 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-aefe36eb-7dcc-41fb-aab8-d9f5ad417dcb req-4d9160a0-2ad2-4cdc-8500-d07d75d27033 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:42:58.632248 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-aefe36eb-7dcc-41fb-aab8-d9f5ad417dcb req-4d9160a0-2ad2-4cdc-8500-d07d75d27033 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:42:58.632797 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-aefe36eb-7dcc-41fb-aab8-d9f5ad417dcb req-4d9160a0-2ad2-4cdc-8500-d07d75d27033 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:42:58.643960 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-aefe36eb-7dcc-41fb-aab8-d9f5ad417dcb req-4d9160a0-2ad2-4cdc-8500-d07d75d27033 service nova] Creating event network-changed:939980ce-fc8e-412d-bcaf-9726b0b526be for instance cc605f8f-2129-42d1-8d6c-92d2066df577 on n-h2-858272-3 Oct 05 03:42:58.648872 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-aefe36eb-7dcc-41fb-aab8-d9f5ad417dcb req-4d9160a0-2ad2-4cdc-8500-d07d75d27033 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031966 Oct 05 03:42:58.649698 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3793/7571] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:45:10.549042 n-d-858272-3 devstack@n-api.service[122320]: ERROR oslo.messaging._drivers.impl_rabbit [-] [478c9060-5882-4902-b074-d751d7d6fe39] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 05 03:45:10.549618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:45:10.550245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=8 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:45:10.551594 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 05 03:45:10.551757 n-d-858272-3 devstack@n-api.service[122320]: Wed Oct 5 03:45:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577/action (ip 10.222.0.16) !!! Oct 05 03:45:10.552920 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 03:45:10.553053 n-d-858272-3 devstack@n-api.service[122320]: Wed Oct 5 03:45:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577/action (ip 10.222.0.16) !!! Oct 05 03:45:10.553947 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 03:45:10.554058 n-d-858272-3 devstack@n-api.service[122320]: Wed Oct 5 03:45:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577/action (ip 10.222.0.16) !!! Oct 05 03:45:10.558790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0b6d6a78-ecef-45d4-90af-4fd199725ffb tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:45:10.561194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0b6d6a78-ecef-45d4-90af-4fd199725ffb tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:45:10.575868 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b6d6a78-ecef-45d4-90af-4fd199725ffb tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:45:10.576379 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b6d6a78-ecef-45d4-90af-4fd199725ffb tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:45:10.576867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b6d6a78-ecef-45d4-90af-4fd199725ffb tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:45:10.577610 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b6d6a78-ecef-45d4-90af-4fd199725ffb tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:45:10.578072 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b6d6a78-ecef-45d4-90af-4fd199725ffb tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:45:10.578514 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b6d6a78-ecef-45d4-90af-4fd199725ffb tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:45:10.653889 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0b6d6a78-ecef-45d4-90af-4fd199725ffb tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "POST /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577/action" status: 202 len: 0 microversion: 2.1 time: 0.107501 Oct 05 03:45:10.654773 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3779/7572] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:45:10 2022] POST /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 03:45:10.662335 n-d-858272-3 devstack@n-api.service[122319]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6905525b-80d2-47ff-94c4-6512d0d2e7d6] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 03:45:10.663268 n-d-858272-3 devstack@n-api.service[122319]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9ea01e0c-5288-45ec-999a-5c236fd0352e] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 03:45:10.663975 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:45:10.664775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=12 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:45:10.666243 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 03:45:10.666243 n-d-858272-3 devstack@n-api.service[122319]: Wed Oct 5 03:45:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577 (ip 10.222.0.16) !!! Oct 05 03:45:10.667722 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 03:45:10.667849 n-d-858272-3 devstack@n-api.service[122319]: Wed Oct 5 03:45:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577 (ip 10.222.0.16) !!! Oct 05 03:45:10.676293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ddf6370e-b3a5-4e29-90f1-3c9d2963b18d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:45:10.677036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ddf6370e-b3a5-4e29-90f1-3c9d2963b18d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:45:10.695308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ddf6370e-b3a5-4e29-90f1-3c9d2963b18d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:45:10.695804 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ddf6370e-b3a5-4e29-90f1-3c9d2963b18d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:45:10.696420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ddf6370e-b3a5-4e29-90f1-3c9d2963b18d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:45:10.697743 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ddf6370e-b3a5-4e29-90f1-3c9d2963b18d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:45:10.698611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ddf6370e-b3a5-4e29-90f1-3c9d2963b18d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:45:10.699121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ddf6370e-b3a5-4e29-90f1-3c9d2963b18d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:45:10.946202 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ddf6370e-b3a5-4e29-90f1-3c9d2963b18d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:45:10.954640 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ddf6370e-b3a5-4e29-90f1-3c9d2963b18d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577" status: 200 len: 1760 microversion: 2.1 time: 0.294899 Oct 05 03:45:10.955239 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3794/7573] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:45:10 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577 => generated 1760 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:45:11.981075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a4468398-9520-49eb-b0e7-5fa83cb40e0b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:45:11.981705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a4468398-9520-49eb-b0e7-5fa83cb40e0b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:45:11.989598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a4468398-9520-49eb-b0e7-5fa83cb40e0b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:45:11.990091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a4468398-9520-49eb-b0e7-5fa83cb40e0b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:45:11.990532 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a4468398-9520-49eb-b0e7-5fa83cb40e0b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:45:11.991238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a4468398-9520-49eb-b0e7-5fa83cb40e0b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:45:11.991701 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a4468398-9520-49eb-b0e7-5fa83cb40e0b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:45:11.992134 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a4468398-9520-49eb-b0e7-5fa83cb40e0b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:45:11.998435 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [-] [478c9060-5882-4902-b074-d751d7d6fe39] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 46732. Oct 05 03:45:12.139791 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a4468398-9520-49eb-b0e7-5fa83cb40e0b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:45:12.148070 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a4468398-9520-49eb-b0e7-5fa83cb40e0b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577" status: 200 len: 1758 microversion: 2.1 time: 0.173182 Oct 05 03:45:12.148648 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3780/7574] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:45:11 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:46:43.503690 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:46:43.504560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:46:43.508520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-076db340-64fb-4350-b57c-d6bc4cccb4c0 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-313925037"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:46:43.509127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-076db340-64fb-4350-b57c-d6bc4cccb4c0 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:46:43.519266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-076db340-64fb-4350-b57c-d6bc4cccb4c0 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:46:43.519752 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-076db340-64fb-4350-b57c-d6bc4cccb4c0 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:46:43.520186 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-076db340-64fb-4350-b57c-d6bc4cccb4c0 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:46:43.520878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-076db340-64fb-4350-b57c-d6bc4cccb4c0 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:46:43.521361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-076db340-64fb-4350-b57c-d6bc4cccb4c0 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:46:43.521783 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-076db340-64fb-4350-b57c-d6bc4cccb4c0 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:46:43.526707 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] [6905525b-80d2-47ff-94c4-6512d0d2e7d6] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 46766. Oct 05 03:46:43.527407 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] [9ea01e0c-5288-45ec-999a-5c236fd0352e] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 46768. Oct 05 03:46:43.654973 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.network.security_group_api [None req-076db340-64fb-4350-b57c-d6bc4cccb4c0 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Removing security group 6ee96fb4-34c8-467e-a425-016c299f4254 from port 939980ce-fc8e-412d-bcaf-9726b0b526be Oct 05 03:46:43.954403 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-076db340-64fb-4350-b57c-d6bc4cccb4c0 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "POST /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577/action" status: 202 len: 0 microversion: 2.1 time: 0.453264 Oct 05 03:46:43.955028 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3795/7575] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:46:43 2022] POST /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577/action => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:46:43.962441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:46:43.963227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:46:43.967670 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-a860b270-a167-42d4-b8da-6283e2182fd5 req-45db2985-41f4-475a-a07d-992f7ddf8d09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc605f8f-2129-42d1-8d6c-92d2066df577", "tag": "939980ce-fc8e-412d-bcaf-9726b0b526be"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:46:43.979178 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a860b270-a167-42d4-b8da-6283e2182fd5 req-45db2985-41f4-475a-a07d-992f7ddf8d09 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:46:43.980653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a860b270-a167-42d4-b8da-6283e2182fd5 req-45db2985-41f4-475a-a07d-992f7ddf8d09 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:46:43.980653 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a860b270-a167-42d4-b8da-6283e2182fd5 req-45db2985-41f4-475a-a07d-992f7ddf8d09 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:46:43.994060 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-a860b270-a167-42d4-b8da-6283e2182fd5 req-45db2985-41f4-475a-a07d-992f7ddf8d09 service nova] Creating event network-changed:939980ce-fc8e-412d-bcaf-9726b0b526be for instance cc605f8f-2129-42d1-8d6c-92d2066df577 on n-h2-858272-3 Oct 05 03:46:44.000069 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-a860b270-a167-42d4-b8da-6283e2182fd5 req-45db2985-41f4-475a-a07d-992f7ddf8d09 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039826 Oct 05 03:46:44.000990 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3781/7576] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:46:45.392206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-33cf5f1a-89ae-43d3-ba24-50a92ebcb782 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:46:45.393632 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-33cf5f1a-89ae-43d3-ba24-50a92ebcb782 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:46:45.400399 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33cf5f1a-89ae-43d3-ba24-50a92ebcb782 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:46:45.400929 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33cf5f1a-89ae-43d3-ba24-50a92ebcb782 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:46:45.401385 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33cf5f1a-89ae-43d3-ba24-50a92ebcb782 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:46:45.402101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33cf5f1a-89ae-43d3-ba24-50a92ebcb782 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:46:45.402601 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33cf5f1a-89ae-43d3-ba24-50a92ebcb782 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:46:45.403041 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33cf5f1a-89ae-43d3-ba24-50a92ebcb782 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:46:45.404867 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-3e9f8904-68af-49ed-aaee-c8a5d6464b6a req-3a0f082d-e53c-4bce-a3e6-94535214a9c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc605f8f-2129-42d1-8d6c-92d2066df577", "tag": "939980ce-fc8e-412d-bcaf-9726b0b526be"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:46:45.414961 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-3e9f8904-68af-49ed-aaee-c8a5d6464b6a req-3a0f082d-e53c-4bce-a3e6-94535214a9c0 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:46:45.415447 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-3e9f8904-68af-49ed-aaee-c8a5d6464b6a req-3a0f082d-e53c-4bce-a3e6-94535214a9c0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:46:45.415863 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-3e9f8904-68af-49ed-aaee-c8a5d6464b6a req-3a0f082d-e53c-4bce-a3e6-94535214a9c0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:46:45.428174 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-3e9f8904-68af-49ed-aaee-c8a5d6464b6a req-3a0f082d-e53c-4bce-a3e6-94535214a9c0 service nova] Creating event network-changed:939980ce-fc8e-412d-bcaf-9726b0b526be for instance cc605f8f-2129-42d1-8d6c-92d2066df577 on n-h2-858272-3 Oct 05 03:46:45.431814 n-d-858272-3 devstack@n-api.service[122319]: ERROR oslo.messaging._drivers.impl_rabbit [req-3e9f8904-68af-49ed-aaee-c8a5d6464b6a req-3a0f082d-e53c-4bce-a3e6-94535214a9c0 service nova] [5cff455d-a098-4278-a006-5197493fca8a] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 03:46:45.486427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-33cf5f1a-89ae-43d3-ba24-50a92ebcb782 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lazy-loading 'services' on Instance uuid cc605f8f-2129-42d1-8d6c-92d2066df577 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:46:45.559495 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-33cf5f1a-89ae-43d3-ba24-50a92ebcb782 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577/os-volume_attachments/9a6ebd37-8839-4c8d-8615-38df0b6e0253" status: 202 len: 0 microversion: 2.1 time: 0.174344 Oct 05 03:46:45.560215 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3782/7577] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 03:46:45 2022] DELETE /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577/os-volume_attachments/9a6ebd37-8839-4c8d-8615-38df0b6e0253 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:46:45.569162 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8a4a0e06-088b-481c-a6d8-5253ef9203ab tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:46:45.572803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8a4a0e06-088b-481c-a6d8-5253ef9203ab tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:46:45.580683 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a4a0e06-088b-481c-a6d8-5253ef9203ab tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:46:45.580683 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a4a0e06-088b-481c-a6d8-5253ef9203ab tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:46:45.581048 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a4a0e06-088b-481c-a6d8-5253ef9203ab tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:46:45.582304 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a4a0e06-088b-481c-a6d8-5253ef9203ab tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:46:45.582869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a4a0e06-088b-481c-a6d8-5253ef9203ab tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:46:45.583252 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8a4a0e06-088b-481c-a6d8-5253ef9203ab tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:46:45.617865 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8a4a0e06-088b-481c-a6d8-5253ef9203ab tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053246 Oct 05 03:46:45.622809 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3783/7578] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:46:45 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:46:46.439987 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [req-3e9f8904-68af-49ed-aaee-c8a5d6464b6a req-3a0f082d-e53c-4bce-a3e6-94535214a9c0 service nova] [5cff455d-a098-4278-a006-5197493fca8a] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 46800. Oct 05 03:46:46.444668 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-3e9f8904-68af-49ed-aaee-c8a5d6464b6a req-3a0f082d-e53c-4bce-a3e6-94535214a9c0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.109289 Oct 05 03:46:46.445743 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3796/7579] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:46:46.631846 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-26c1abb1-2a10-445c-bf0a-db5bea77eb58 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:46:46.634176 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-26c1abb1-2a10-445c-bf0a-db5bea77eb58 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:46:46.641220 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-26c1abb1-2a10-445c-bf0a-db5bea77eb58 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:46:46.641815 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-26c1abb1-2a10-445c-bf0a-db5bea77eb58 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:46:46.642341 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-26c1abb1-2a10-445c-bf0a-db5bea77eb58 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:46:46.643128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-26c1abb1-2a10-445c-bf0a-db5bea77eb58 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:46:46.643806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-26c1abb1-2a10-445c-bf0a-db5bea77eb58 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:46:46.644579 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-26c1abb1-2a10-445c-bf0a-db5bea77eb58 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:46:46.680704 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-26c1abb1-2a10-445c-bf0a-db5bea77eb58 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053975 Oct 05 03:46:46.681422 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3784/7580] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:46:46 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:46:47.697548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-20c9a001-6708-4792-bc32-141bac3cfcc0 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:46:47.701021 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-20c9a001-6708-4792-bc32-141bac3cfcc0 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:46:47.711373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20c9a001-6708-4792-bc32-141bac3cfcc0 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:46:47.711861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20c9a001-6708-4792-bc32-141bac3cfcc0 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:46:47.712306 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20c9a001-6708-4792-bc32-141bac3cfcc0 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:46:47.713213 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20c9a001-6708-4792-bc32-141bac3cfcc0 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:46:47.714005 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20c9a001-6708-4792-bc32-141bac3cfcc0 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:46:47.714614 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-20c9a001-6708-4792-bc32-141bac3cfcc0 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:46:47.747347 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-20c9a001-6708-4792-bc32-141bac3cfcc0 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057711 Oct 05 03:46:47.748163 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3797/7581] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:46:47 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:46:48.760360 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e4386ef9-fc28-4c9a-a19a-4c391b35fac2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:46:48.762665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e4386ef9-fc28-4c9a-a19a-4c391b35fac2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:46:48.770263 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4386ef9-fc28-4c9a-a19a-4c391b35fac2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:46:48.770759 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4386ef9-fc28-4c9a-a19a-4c391b35fac2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:46:48.771234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4386ef9-fc28-4c9a-a19a-4c391b35fac2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:46:48.771930 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4386ef9-fc28-4c9a-a19a-4c391b35fac2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:46:48.772394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4386ef9-fc28-4c9a-a19a-4c391b35fac2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:46:48.772829 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4386ef9-fc28-4c9a-a19a-4c391b35fac2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:46:48.803200 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e4386ef9-fc28-4c9a-a19a-4c391b35fac2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046710 Oct 05 03:46:48.803653 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3785/7582] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:46:48 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:46:49.815735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c1b5bc0a-9961-4488-be33-5ef1c10f0dc0 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:46:49.818123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c1b5bc0a-9961-4488-be33-5ef1c10f0dc0 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:46:49.825034 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1b5bc0a-9961-4488-be33-5ef1c10f0dc0 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:46:49.825514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1b5bc0a-9961-4488-be33-5ef1c10f0dc0 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:46:49.825947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1b5bc0a-9961-4488-be33-5ef1c10f0dc0 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:46:49.826635 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1b5bc0a-9961-4488-be33-5ef1c10f0dc0 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:46:49.827087 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1b5bc0a-9961-4488-be33-5ef1c10f0dc0 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:46:49.827507 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c1b5bc0a-9961-4488-be33-5ef1c10f0dc0 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:46:49.858249 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c1b5bc0a-9961-4488-be33-5ef1c10f0dc0 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046031 Oct 05 03:46:49.858550 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3798/7583] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:46:49 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:46:50.870202 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ea13f3a5-d730-49fe-9240-7184982edaf9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:46:50.872392 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ea13f3a5-d730-49fe-9240-7184982edaf9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:46:50.881107 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea13f3a5-d730-49fe-9240-7184982edaf9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:46:50.881605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea13f3a5-d730-49fe-9240-7184982edaf9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:46:50.882053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea13f3a5-d730-49fe-9240-7184982edaf9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:46:50.882746 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea13f3a5-d730-49fe-9240-7184982edaf9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:46:50.883214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea13f3a5-d730-49fe-9240-7184982edaf9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:46:50.883645 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea13f3a5-d730-49fe-9240-7184982edaf9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:46:50.912055 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ea13f3a5-d730-49fe-9240-7184982edaf9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045846 Oct 05 03:46:50.912612 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3786/7584] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:46:50 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 03:46:50.923340 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-52311d92-4f5e-4f7d-8f15-10e2220f6a75 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:46:50.923821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-52311d92-4f5e-4f7d-8f15-10e2220f6a75 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:46:50.932056 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52311d92-4f5e-4f7d-8f15-10e2220f6a75 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:46:50.932537 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52311d92-4f5e-4f7d-8f15-10e2220f6a75 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:46:50.932995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52311d92-4f5e-4f7d-8f15-10e2220f6a75 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:46:50.933683 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52311d92-4f5e-4f7d-8f15-10e2220f6a75 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:46:50.934133 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52311d92-4f5e-4f7d-8f15-10e2220f6a75 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:46:50.934557 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-52311d92-4f5e-4f7d-8f15-10e2220f6a75 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:46:51.011835 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-52311d92-4f5e-4f7d-8f15-10e2220f6a75 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] HTTP exception thrown: Instance cc605f8f-2129-42d1-8d6c-92d2066df577 is not attached to volume 9a6ebd37-8839-4c8d-8615-38df0b6e0253 Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-52311d92-4f5e-4f7d-8f15-10e2220f6a75 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Request method failure captured: Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: request: DELETE /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577/os-volume_attachments/9a6ebd37-8839-4c8d-8615-38df0b6e0253 HTTP/1.1 Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPP0I285xzgP1quSPWEDKcl0umeTubKUyPVeQMS3UXXieWDJ1ngtA_0UC1yFKQlA4hdQLPQoL9uRqYQ8Wa6LOuNJ7nBwiDc3AkFcdbgWk6UvlZ2Yut6SyNTXO1LRklyUbiAwmlR6z0Dbgn5I9hlEdBPGuBEQSNw0ebaHNk-qmDnD9KBo Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 2e22d6e1c9a5495b8c152d7c7e5b1aff Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TestMinimumBasicScenario-1436608884 Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e22d6e1c9a5495b8c152d7c7e5b1aff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e22d6e1c9a5495b8c152d7c7e5b1aff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2e22d6e1c9a5495b8c152d7c7e5b1aff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2e22d6e1c9a5495b8c152d7c7e5b1aff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TestMinimumBasicScenario-1436608884 Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 2e22d6e1c9a5495b8c152d7c7e5b1aff Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1436608884 Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TestMinimumBasicScenario-1436608884-project Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: cf1e0670dd7341d0a2c237722f903537 Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TestMinimumBasicScenario-1436608884-project Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance cc605f8f-2129-42d1-8d6c-92d2066df577 is not attached to volume 9a6ebd37-8839-4c8d-8615-38df0b6e0253 Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'server_id': 'cc605f8f-2129-42d1-8d6c-92d2066df577', 'id': '9a6ebd37-8839-4c8d-8615-38df0b6e0253'} Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9a6ebd37-8839-4c8d-8615-38df0b6e0253. Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc605f8f-2129-42d1-8d6c-92d2066df577 is not attached to volume 9a6ebd37-8839-4c8d-8615-38df0b6e0253 Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:46:51.013637 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:46:51.021977 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:46:51.021977 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:46:51.021977 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc605f8f-2129-42d1-8d6c-92d2066df577 is not attached to volume 9a6ebd37-8839-4c8d-8615-38df0b6e0253 Oct 05 03:46:51.021977 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:46:51.021977 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-52311d92-4f5e-4f7d-8f15-10e2220f6a75 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Returning 404 to user: Instance cc605f8f-2129-42d1-8d6c-92d2066df577 is not attached to volume 9a6ebd37-8839-4c8d-8615-38df0b6e0253 {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:46:51.021977 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-52311d92-4f5e-4f7d-8f15-10e2220f6a75 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577/os-volume_attachments/9a6ebd37-8839-4c8d-8615-38df0b6e0253" status: 404 len: 154 microversion: 2.1 time: 0.095890 Oct 05 03:46:51.021977 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3799/7585] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 03:46:50 2022] DELETE /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577/os-volume_attachments/9a6ebd37-8839-4c8d-8615-38df0b6e0253 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:46:54.269870 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b78361ae-793c-4c2f-9b85-294638b0880a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:46:54.270380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b78361ae-793c-4c2f-9b85-294638b0880a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:46:54.277256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b78361ae-793c-4c2f-9b85-294638b0880a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:46:54.277747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b78361ae-793c-4c2f-9b85-294638b0880a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:46:54.278190 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b78361ae-793c-4c2f-9b85-294638b0880a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:46:54.278886 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b78361ae-793c-4c2f-9b85-294638b0880a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:46:54.279351 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b78361ae-793c-4c2f-9b85-294638b0880a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:46:54.279788 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b78361ae-793c-4c2f-9b85-294638b0880a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:46:54.306596 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b78361ae-793c-4c2f-9b85-294638b0880a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:46:54.387392 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b78361ae-793c-4c2f-9b85-294638b0880a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577" status: 204 len: 0 microversion: 2.1 time: 0.121815 Oct 05 03:46:54.391760 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3787/7586] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:46:54 2022] DELETE /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:46:54.397750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a47346b2-a9c9-40ff-8c55-8d4491feeaa9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:46:54.398398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a47346b2-a9c9-40ff-8c55-8d4491feeaa9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:46:54.406269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a47346b2-a9c9-40ff-8c55-8d4491feeaa9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:46:54.406785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a47346b2-a9c9-40ff-8c55-8d4491feeaa9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:46:54.407225 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a47346b2-a9c9-40ff-8c55-8d4491feeaa9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:46:54.407920 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a47346b2-a9c9-40ff-8c55-8d4491feeaa9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:46:54.408375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a47346b2-a9c9-40ff-8c55-8d4491feeaa9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:46:54.408801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a47346b2-a9c9-40ff-8c55-8d4491feeaa9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:46:54.540817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a47346b2-a9c9-40ff-8c55-8d4491feeaa9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:46:54.548838 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a47346b2-a9c9-40ff-8c55-8d4491feeaa9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577" status: 200 len: 1554 microversion: 2.1 time: 0.156049 Oct 05 03:46:54.549427 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3800/7587] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:46:54 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:46:55.572865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4f6b24ca-4c94-410b-9791-d556051b4c9d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:46:55.573620 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4f6b24ca-4c94-410b-9791-d556051b4c9d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:46:55.581963 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f6b24ca-4c94-410b-9791-d556051b4c9d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:46:55.582409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f6b24ca-4c94-410b-9791-d556051b4c9d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:46:55.582864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f6b24ca-4c94-410b-9791-d556051b4c9d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:46:55.583578 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f6b24ca-4c94-410b-9791-d556051b4c9d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:46:55.584074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f6b24ca-4c94-410b-9791-d556051b4c9d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:46:55.584520 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f6b24ca-4c94-410b-9791-d556051b4c9d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:46:55.710302 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4f6b24ca-4c94-410b-9791-d556051b4c9d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:46:55.718603 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4f6b24ca-4c94-410b-9791-d556051b4c9d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577" status: 200 len: 1554 microversion: 2.1 time: 0.149992 Oct 05 03:46:55.719185 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3788/7588] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:46:55 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:46:56.680937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-3614a89a-ec53-4345-b3d5-0e1c71ea6c7e req-de2f93aa-88e0-43a1-8a35-ecde7d151eac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc605f8f-2129-42d1-8d6c-92d2066df577", "name": "network-vif-deleted", "tag": "939980ce-fc8e-412d-bcaf-9726b0b526be"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:46:56.692884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-3614a89a-ec53-4345-b3d5-0e1c71ea6c7e req-de2f93aa-88e0-43a1-8a35-ecde7d151eac service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:46:56.693452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-3614a89a-ec53-4345-b3d5-0e1c71ea6c7e req-de2f93aa-88e0-43a1-8a35-ecde7d151eac service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:46:56.693918 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-3614a89a-ec53-4345-b3d5-0e1c71ea6c7e req-de2f93aa-88e0-43a1-8a35-ecde7d151eac service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:46:56.706259 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-3614a89a-ec53-4345-b3d5-0e1c71ea6c7e req-de2f93aa-88e0-43a1-8a35-ecde7d151eac service nova] Creating event network-vif-deleted:939980ce-fc8e-412d-bcaf-9726b0b526be for instance cc605f8f-2129-42d1-8d6c-92d2066df577 on n-h2-858272-3 Oct 05 03:46:56.711451 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-3614a89a-ec53-4345-b3d5-0e1c71ea6c7e req-de2f93aa-88e0-43a1-8a35-ecde7d151eac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034323 Oct 05 03:46:56.712373 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3801/7589] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:46:56.744278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-52caecc6-b590-4fc0-b43c-196779f8fb71 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:46:56.745020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-52caecc6-b590-4fc0-b43c-196779f8fb71 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:46:56.752297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52caecc6-b590-4fc0-b43c-196779f8fb71 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:46:56.753089 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52caecc6-b590-4fc0-b43c-196779f8fb71 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:46:56.753888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52caecc6-b590-4fc0-b43c-196779f8fb71 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:46:56.754672 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52caecc6-b590-4fc0-b43c-196779f8fb71 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:46:56.755368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52caecc6-b590-4fc0-b43c-196779f8fb71 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:46:56.755878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-52caecc6-b590-4fc0-b43c-196779f8fb71 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:46:56.819265 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-52caecc6-b590-4fc0-b43c-196779f8fb71 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:46:56.827110 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-52caecc6-b590-4fc0-b43c-196779f8fb71 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577" status: 200 len: 1343 microversion: 2.1 time: 0.086765 Oct 05 03:46:56.828821 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3789/7590] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:46:56 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577 => generated 1343 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:46:57.852787 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e974ba16-ce72-4a8b-a45d-07a2b276527d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:46:57.853518 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e974ba16-ce72-4a8b-a45d-07a2b276527d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: cc605f8f-2129-42d1-8d6c-92d2066df577] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:46:57.860007 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e974ba16-ce72-4a8b-a45d-07a2b276527d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:46:57.860492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e974ba16-ce72-4a8b-a45d-07a2b276527d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:46:57.860953 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e974ba16-ce72-4a8b-a45d-07a2b276527d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:46:57.861682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e974ba16-ce72-4a8b-a45d-07a2b276527d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:46:57.862583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e974ba16-ce72-4a8b-a45d-07a2b276527d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:46:57.863008 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e974ba16-ce72-4a8b-a45d-07a2b276527d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:46:57.876446 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-e974ba16-ce72-4a8b-a45d-07a2b276527d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] HTTP exception thrown: Instance cc605f8f-2129-42d1-8d6c-92d2066df577 could not be found. Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e974ba16-ce72-4a8b-a45d-07a2b276527d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Request method failure captured: Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577 HTTP/1.1 Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPP0I285xzgP1quSPWEDKcl0umeTubKUyPVeQMS3UXXieWDJ1ngtA_0UC1yFKQlA4hdQLPQoL9uRqYQ8Wa6LOuNJ7nBwiDc3AkFcdbgWk6UvlZ2Yut6SyNTXO1LRklyUbiAwmlR6z0Dbgn5I9hlEdBPGuBEQSNw0ebaHNk-qmDnD9KBo Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 2e22d6e1c9a5495b8c152d7c7e5b1aff Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TestMinimumBasicScenario-1436608884 Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e22d6e1c9a5495b8c152d7c7e5b1aff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e22d6e1c9a5495b8c152d7c7e5b1aff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2e22d6e1c9a5495b8c152d7c7e5b1aff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2e22d6e1c9a5495b8c152d7c7e5b1aff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TestMinimumBasicScenario-1436608884 Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 2e22d6e1c9a5495b8c152d7c7e5b1aff Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1436608884 Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TestMinimumBasicScenario-1436608884-project Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: cf1e0670dd7341d0a2c237722f903537 Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TestMinimumBasicScenario-1436608884-project Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance cc605f8f-2129-42d1-8d6c-92d2066df577 could not be found. Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'cc605f8f-2129-42d1-8d6c-92d2066df577'} Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc605f8f-2129-42d1-8d6c-92d2066df577 could not be found. Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc605f8f-2129-42d1-8d6c-92d2066df577 could not be found. Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:46:57.878885 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:46:57.883290 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:46:57.883290 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:46:57.883290 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:46:57.883290 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:46:57.883290 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:46:57.883290 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc605f8f-2129-42d1-8d6c-92d2066df577 could not be found. Oct 05 03:46:57.883290 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:46:57.883290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e974ba16-ce72-4a8b-a45d-07a2b276527d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Returning 404 to user: Instance cc605f8f-2129-42d1-8d6c-92d2066df577 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:46:57.883290 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e974ba16-ce72-4a8b-a45d-07a2b276527d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577" status: 404 len: 111 microversion: 2.1 time: 0.032562 Oct 05 03:46:57.883290 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3802/7591] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:46:57 2022] GET /compute/v2.1/servers/cc605f8f-2129-42d1-8d6c-92d2066df577 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:46:57.888973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-391188a0-7654-45f7-a7ae-8e5a94f62ea8 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '.version_select at 0x7fcce82318b0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:46:57.912605 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-391188a0-7654-45f7-a7ae-8e5a94f62ea8 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-664079361" status: 202 len: 0 microversion: 2.1 time: 0.027442 Oct 05 03:46:57.913218 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3790/7592] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 5 03:46:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-664079361 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:47:06.916718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1e8080b0-8503-488c-9a60-62793bf587d3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Action: 'create', calling method: .version_select at 0x7fccdea0b040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1530781148", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5JnBUz5FcSPmNZee5wFrp4KjCWDUs9l9/81uEk5zkeoCJFJZQp+G/E4vUdok2Gk454epCkTBBDNxK8JcQdc+trp3fAw8sFo64GDMgRuyMKkD0q6qtvcN/sH2fZGki2xw=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:47:06.935831 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-1e8080b0-8503-488c-9a60-62793bf587d3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Getting quotas for project 2e22d6e1c9a5495b8c152d7c7e5b1aff. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:47:06.940967 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-1e8080b0-8503-488c-9a60-62793bf587d3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Getting quotas for user cf1e0670dd7341d0a2c237722f903537 and project 2e22d6e1c9a5495b8c152d7c7e5b1aff. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:47:06.967797 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1e8080b0-8503-488c-9a60-62793bf587d3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.101080 Oct 05 03:47:06.968401 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3803/7593] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 03:47:06 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:47:07.015739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:47:07.020511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-621d3c6d-ceaa-45bb-b743-ab8a353e4bbb tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1945424528", "imageRef": "555e2a93-b6aa-4406-bf9b-e4cd2d26d0b7", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1530781148", "networks": [{"uuid": "b4bbcf64-d570-4155-9061-823e5463e91e"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:47:07.078741 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-621d3c6d-ceaa-45bb-b743-ab8a353e4bbb tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] validate_networks() for [('b4bbcf64-d570-4155-9061-823e5463e91e', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:47:07.486790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-621d3c6d-ceaa-45bb-b743-ab8a353e4bbb tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:47:07.487600 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-621d3c6d-ceaa-45bb-b743-ab8a353e4bbb tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:47:07.488127 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-621d3c6d-ceaa-45bb-b743-ab8a353e4bbb tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:47:07.488546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-621d3c6d-ceaa-45bb-b743-ab8a353e4bbb tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:47:07.489002 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-621d3c6d-ceaa-45bb-b743-ab8a353e4bbb tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:47:07.497837 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-621d3c6d-ceaa-45bb-b743-ab8a353e4bbb tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:07.498328 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-621d3c6d-ceaa-45bb-b743-ab8a353e4bbb tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:07.498772 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-621d3c6d-ceaa-45bb-b743-ab8a353e4bbb tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:07.499497 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-621d3c6d-ceaa-45bb-b743-ab8a353e4bbb tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:07.499964 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-621d3c6d-ceaa-45bb-b743-ab8a353e4bbb tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:07.500398 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-621d3c6d-ceaa-45bb-b743-ab8a353e4bbb tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:07.518170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-621d3c6d-ceaa-45bb-b743-ab8a353e4bbb tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Getting quotas for project 2e22d6e1c9a5495b8c152d7c7e5b1aff. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:47:07.524154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-621d3c6d-ceaa-45bb-b743-ab8a353e4bbb tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Getting quotas for user cf1e0670dd7341d0a2c237722f903537 and project 2e22d6e1c9a5495b8c152d7c7e5b1aff. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:47:07.536866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-621d3c6d-ceaa-45bb-b743-ab8a353e4bbb tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:47:07.539116 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-621d3c6d-ceaa-45bb-b743-ab8a353e4bbb tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='555e2a93-b6aa-4406-bf9b-e4cd2d26d0b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:47:07.585855 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-621d3c6d-ceaa-45bb-b743-ab8a353e4bbb tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571900 Oct 05 03:47:07.586524 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3791/7594] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:47:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:47:07.597439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-467d85c8-5551-4a93-b67f-2d4a84cb8268 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:47:07.598050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-467d85c8-5551-4a93-b67f-2d4a84cb8268 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:47:07.662498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-467d85c8-5551-4a93-b67f-2d4a84cb8268 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:47:07.669930 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-467d85c8-5551-4a93-b67f-2d4a84cb8268 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1259 microversion: 2.1 time: 0.076366 Oct 05 03:47:07.670942 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3804/7595] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:47:07 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1259 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:47:08.695768 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-13849417-9de2-4ef4-8f15-d6628c21c0ef tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:47:08.696583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-13849417-9de2-4ef4-8f15-d6628c21c0ef tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:47:08.702772 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13849417-9de2-4ef4-8f15-d6628c21c0ef tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:08.703530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13849417-9de2-4ef4-8f15-d6628c21c0ef tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:08.703988 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13849417-9de2-4ef4-8f15-d6628c21c0ef tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:08.704708 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13849417-9de2-4ef4-8f15-d6628c21c0ef tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:08.705291 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13849417-9de2-4ef4-8f15-d6628c21c0ef tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:08.706369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-13849417-9de2-4ef4-8f15-d6628c21c0ef tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:08.780257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-13849417-9de2-4ef4-8f15-d6628c21c0ef tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:47:08.789116 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-13849417-9de2-4ef4-8f15-d6628c21c0ef tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1319 microversion: 2.1 time: 0.098660 Oct 05 03:47:08.796423 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3792/7596] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:47:08 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1319 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:47:09.814494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-da93285a-8564-43d1-bac7-809038d9cba5 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:47:09.815774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-da93285a-8564-43d1-bac7-809038d9cba5 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:47:09.818959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=34 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:47:09.825618 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da93285a-8564-43d1-bac7-809038d9cba5 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:09.826189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da93285a-8564-43d1-bac7-809038d9cba5 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:09.826633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da93285a-8564-43d1-bac7-809038d9cba5 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:09.827824 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da93285a-8564-43d1-bac7-809038d9cba5 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:09.828284 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da93285a-8564-43d1-bac7-809038d9cba5 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:09.828713 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-da93285a-8564-43d1-bac7-809038d9cba5 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:09.980199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-da93285a-8564-43d1-bac7-809038d9cba5 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:47:09.988652 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-da93285a-8564-43d1-bac7-809038d9cba5 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1359 microversion: 2.1 time: 0.178909 Oct 05 03:47:09.989265 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3805/7597] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:47:09 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:47:11.012440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5e45cef9-358c-4333-a2d7-6a5ba8067b5c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:47:11.013004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5e45cef9-358c-4333-a2d7-6a5ba8067b5c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:47:11.021381 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e45cef9-358c-4333-a2d7-6a5ba8067b5c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:11.021886 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e45cef9-358c-4333-a2d7-6a5ba8067b5c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:11.022341 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e45cef9-358c-4333-a2d7-6a5ba8067b5c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:11.023047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e45cef9-358c-4333-a2d7-6a5ba8067b5c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:11.023519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e45cef9-358c-4333-a2d7-6a5ba8067b5c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:11.023962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e45cef9-358c-4333-a2d7-6a5ba8067b5c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:11.163629 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5e45cef9-358c-4333-a2d7-6a5ba8067b5c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:47:11.171512 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5e45cef9-358c-4333-a2d7-6a5ba8067b5c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1359 microversion: 2.1 time: 0.163060 Oct 05 03:47:11.172111 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3793/7598] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:47:11 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:47:12.196033 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bce646af-ebf4-4099-821b-168cbcc9cd9c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:47:12.197974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bce646af-ebf4-4099-821b-168cbcc9cd9c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:47:12.205182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bce646af-ebf4-4099-821b-168cbcc9cd9c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:12.206454 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bce646af-ebf4-4099-821b-168cbcc9cd9c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:12.206454 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bce646af-ebf4-4099-821b-168cbcc9cd9c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:12.207571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bce646af-ebf4-4099-821b-168cbcc9cd9c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:12.208073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bce646af-ebf4-4099-821b-168cbcc9cd9c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:12.208494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bce646af-ebf4-4099-821b-168cbcc9cd9c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:12.353575 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bce646af-ebf4-4099-821b-168cbcc9cd9c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:47:12.362302 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bce646af-ebf4-4099-821b-168cbcc9cd9c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1359 microversion: 2.1 time: 0.171144 Oct 05 03:47:12.377236 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3806/7599] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:47:12 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:47:13.386047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-78965f30-3565-4e5d-b88e-92d5b79f7774 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:47:13.386677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-78965f30-3565-4e5d-b88e-92d5b79f7774 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:47:13.393389 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78965f30-3565-4e5d-b88e-92d5b79f7774 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:13.393863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78965f30-3565-4e5d-b88e-92d5b79f7774 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:13.394321 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78965f30-3565-4e5d-b88e-92d5b79f7774 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:13.395035 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78965f30-3565-4e5d-b88e-92d5b79f7774 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:13.395510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78965f30-3565-4e5d-b88e-92d5b79f7774 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:13.395952 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-78965f30-3565-4e5d-b88e-92d5b79f7774 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:13.562861 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-78965f30-3565-4e5d-b88e-92d5b79f7774 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:47:13.570771 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-78965f30-3565-4e5d-b88e-92d5b79f7774 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1359 microversion: 2.1 time: 0.188812 Oct 05 03:47:13.571349 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3794/7600] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:47:13 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:47:14.597421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-28920eca-110e-48e6-94ca-69e519ac5f3f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:47:14.598867 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-28920eca-110e-48e6-94ca-69e519ac5f3f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:47:14.606329 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:47:14.607767 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28920eca-110e-48e6-94ca-69e519ac5f3f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:14.608373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28920eca-110e-48e6-94ca-69e519ac5f3f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:14.608829 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28920eca-110e-48e6-94ca-69e519ac5f3f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:14.609606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28920eca-110e-48e6-94ca-69e519ac5f3f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:14.610071 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28920eca-110e-48e6-94ca-69e519ac5f3f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:14.610504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28920eca-110e-48e6-94ca-69e519ac5f3f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:14.742472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-28920eca-110e-48e6-94ca-69e519ac5f3f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:47:14.750307 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-28920eca-110e-48e6-94ca-69e519ac5f3f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1359 microversion: 2.1 time: 0.159815 Oct 05 03:47:14.751107 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3807/7601] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:47:14 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:47:15.773926 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0e1fe0ac-4879-4862-929c-a55fd909cb9c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:47:15.774503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0e1fe0ac-4879-4862-929c-a55fd909cb9c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:47:15.777161 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:47:15.782304 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e1fe0ac-4879-4862-929c-a55fd909cb9c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:15.782800 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e1fe0ac-4879-4862-929c-a55fd909cb9c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:15.783245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e1fe0ac-4879-4862-929c-a55fd909cb9c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:15.784474 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e1fe0ac-4879-4862-929c-a55fd909cb9c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:15.784991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e1fe0ac-4879-4862-929c-a55fd909cb9c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:15.785429 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0e1fe0ac-4879-4862-929c-a55fd909cb9c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:15.928682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0e1fe0ac-4879-4862-929c-a55fd909cb9c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:47:15.936416 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0e1fe0ac-4879-4862-929c-a55fd909cb9c tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1359 microversion: 2.1 time: 0.166469 Oct 05 03:47:15.937071 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3795/7602] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:47:15 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:47:16.960527 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bfbb5818-1954-466c-8532-df603d36a94b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:47:16.961201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bfbb5818-1954-466c-8532-df603d36a94b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:47:16.968444 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bfbb5818-1954-466c-8532-df603d36a94b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:16.968961 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bfbb5818-1954-466c-8532-df603d36a94b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:16.969398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bfbb5818-1954-466c-8532-df603d36a94b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:16.970119 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bfbb5818-1954-466c-8532-df603d36a94b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:16.970570 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bfbb5818-1954-466c-8532-df603d36a94b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:16.970990 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bfbb5818-1954-466c-8532-df603d36a94b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:17.101450 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bfbb5818-1954-466c-8532-df603d36a94b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:47:17.109323 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bfbb5818-1954-466c-8532-df603d36a94b tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1359 microversion: 2.1 time: 0.153241 Oct 05 03:47:17.109896 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3808/7603] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:47:16 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:47:18.130873 n-d-858272-3 devstack@n-api.service[122320]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f8dec5f5-af45-49c2-a8e7-bbd40c1c5148] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 05 03:47:18.134384 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bff4028e-88a9-4bfa-8e00-777686327d29 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:47:18.135009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bff4028e-88a9-4bfa-8e00-777686327d29 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:47:18.137369 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:47:18.138066 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:47:18.144281 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bff4028e-88a9-4bfa-8e00-777686327d29 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:18.144776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bff4028e-88a9-4bfa-8e00-777686327d29 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:18.145251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bff4028e-88a9-4bfa-8e00-777686327d29 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:18.145948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bff4028e-88a9-4bfa-8e00-777686327d29 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:18.146411 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bff4028e-88a9-4bfa-8e00-777686327d29 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:18.146846 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bff4028e-88a9-4bfa-8e00-777686327d29 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:18.275493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bff4028e-88a9-4bfa-8e00-777686327d29 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:47:18.286165 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bff4028e-88a9-4bfa-8e00-777686327d29 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1359 microversion: 2.1 time: 0.156536 Oct 05 03:47:18.286778 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3796/7604] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:47:18 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:47:19.312473 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-004bed72-a7c6-4f9d-b4d1-91fb9fe0aba9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:47:19.313125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-004bed72-a7c6-4f9d-b4d1-91fb9fe0aba9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:47:19.315968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:47:19.322196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-004bed72-a7c6-4f9d-b4d1-91fb9fe0aba9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:19.322691 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-004bed72-a7c6-4f9d-b4d1-91fb9fe0aba9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:19.323134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-004bed72-a7c6-4f9d-b4d1-91fb9fe0aba9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:19.323833 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-004bed72-a7c6-4f9d-b4d1-91fb9fe0aba9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:19.324294 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-004bed72-a7c6-4f9d-b4d1-91fb9fe0aba9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:19.324725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-004bed72-a7c6-4f9d-b4d1-91fb9fe0aba9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:19.459323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-004bed72-a7c6-4f9d-b4d1-91fb9fe0aba9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:47:19.467009 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-004bed72-a7c6-4f9d-b4d1-91fb9fe0aba9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1359 microversion: 2.1 time: 0.158432 Oct 05 03:47:19.467584 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3809/7605] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:47:19 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:47:20.491581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-81644a14-2778-4c45-9478-99702bafff16 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:47:20.492364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-81644a14-2778-4c45-9478-99702bafff16 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:47:20.507766 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [-] [f8dec5f5-af45-49c2-a8e7-bbd40c1c5148] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 47004. Oct 05 03:47:20.510486 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81644a14-2778-4c45-9478-99702bafff16 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:20.510998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81644a14-2778-4c45-9478-99702bafff16 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:20.511455 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81644a14-2778-4c45-9478-99702bafff16 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:20.512216 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81644a14-2778-4c45-9478-99702bafff16 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:20.512698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81644a14-2778-4c45-9478-99702bafff16 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:20.513242 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-81644a14-2778-4c45-9478-99702bafff16 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:20.769843 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-efe02ce5-0743-4aed-be98-b25503ca5e65 req-25312561-9b6b-4be0-9425-eb63c77b1917 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c797529f-7bda-4a25-a915-a4b55051be4e", "tag": "3536017a-da1c-489c-a18f-edb9d8ce8b19"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:47:20.781046 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-efe02ce5-0743-4aed-be98-b25503ca5e65 req-25312561-9b6b-4be0-9425-eb63c77b1917 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:20.781462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-efe02ce5-0743-4aed-be98-b25503ca5e65 req-25312561-9b6b-4be0-9425-eb63c77b1917 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:20.782007 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-efe02ce5-0743-4aed-be98-b25503ca5e65 req-25312561-9b6b-4be0-9425-eb63c77b1917 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:20.794264 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-efe02ce5-0743-4aed-be98-b25503ca5e65 req-25312561-9b6b-4be0-9425-eb63c77b1917 service nova] Creating event network-changed:3536017a-da1c-489c-a18f-edb9d8ce8b19 for instance c797529f-7bda-4a25-a915-a4b55051be4e on n-h2-858272-3 Oct 05 03:47:20.799878 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-efe02ce5-0743-4aed-be98-b25503ca5e65 req-25312561-9b6b-4be0-9425-eb63c77b1917 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033380 Oct 05 03:47:20.800679 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3810/7606] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:47:20.838101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-81644a14-2778-4c45-9478-99702bafff16 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:47:20.848992 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-81644a14-2778-4c45-9478-99702bafff16 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1359 microversion: 2.1 time: 0.362071 Oct 05 03:47:20.849691 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3797/7607] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:47:20 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1359 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:47:21.874177 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-754f793c-43e5-4f8a-bfab-20d5e31963b9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:47:21.874879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-754f793c-43e5-4f8a-bfab-20d5e31963b9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:47:21.881968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-754f793c-43e5-4f8a-bfab-20d5e31963b9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:21.882459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-754f793c-43e5-4f8a-bfab-20d5e31963b9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:21.882896 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-754f793c-43e5-4f8a-bfab-20d5e31963b9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:21.883639 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-754f793c-43e5-4f8a-bfab-20d5e31963b9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:21.884026 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-754f793c-43e5-4f8a-bfab-20d5e31963b9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:21.884450 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-754f793c-43e5-4f8a-bfab-20d5e31963b9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:22.072988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-754f793c-43e5-4f8a-bfab-20d5e31963b9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:47:22.080751 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-754f793c-43e5-4f8a-bfab-20d5e31963b9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1359 microversion: 2.1 time: 0.211482 Oct 05 03:47:22.081371 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3811/7608] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:47:21 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:47:23.121792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-68316761-99c2-494b-8986-66fff1c4bff3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:47:23.122424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-68316761-99c2-494b-8986-66fff1c4bff3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:47:23.129812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68316761-99c2-494b-8986-66fff1c4bff3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:23.130322 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68316761-99c2-494b-8986-66fff1c4bff3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:23.130776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68316761-99c2-494b-8986-66fff1c4bff3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:23.131652 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68316761-99c2-494b-8986-66fff1c4bff3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:23.132129 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68316761-99c2-494b-8986-66fff1c4bff3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:23.132570 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-68316761-99c2-494b-8986-66fff1c4bff3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:23.258379 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-68316761-99c2-494b-8986-66fff1c4bff3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:47:23.266191 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-68316761-99c2-494b-8986-66fff1c4bff3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1359 microversion: 2.1 time: 0.148350 Oct 05 03:47:23.266775 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3798/7609] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:47:23 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:47:24.289140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e66ec9dc-ed9b-4cfc-8b74-7ebafc2a3187 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:47:24.289701 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e66ec9dc-ed9b-4cfc-8b74-7ebafc2a3187 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:47:24.296373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e66ec9dc-ed9b-4cfc-8b74-7ebafc2a3187 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:24.296858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e66ec9dc-ed9b-4cfc-8b74-7ebafc2a3187 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:24.297329 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e66ec9dc-ed9b-4cfc-8b74-7ebafc2a3187 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:24.298014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e66ec9dc-ed9b-4cfc-8b74-7ebafc2a3187 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:24.298463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e66ec9dc-ed9b-4cfc-8b74-7ebafc2a3187 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:24.298889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e66ec9dc-ed9b-4cfc-8b74-7ebafc2a3187 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:24.431758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e66ec9dc-ed9b-4cfc-8b74-7ebafc2a3187 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:47:24.439432 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e66ec9dc-ed9b-4cfc-8b74-7ebafc2a3187 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1359 microversion: 2.1 time: 0.154287 Oct 05 03:47:24.440660 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3812/7610] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:47:24 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:47:25.464244 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4acf8524-27b1-4e30-b030-9ea10ea5346e tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:47:25.464869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4acf8524-27b1-4e30-b030-9ea10ea5346e tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:47:25.472230 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4acf8524-27b1-4e30-b030-9ea10ea5346e tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:25.472719 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4acf8524-27b1-4e30-b030-9ea10ea5346e tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:25.473195 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4acf8524-27b1-4e30-b030-9ea10ea5346e tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:25.473888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4acf8524-27b1-4e30-b030-9ea10ea5346e tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:25.474353 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4acf8524-27b1-4e30-b030-9ea10ea5346e tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:25.474784 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4acf8524-27b1-4e30-b030-9ea10ea5346e tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:25.605830 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4acf8524-27b1-4e30-b030-9ea10ea5346e tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:47:25.613692 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4acf8524-27b1-4e30-b030-9ea10ea5346e tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1359 microversion: 2.1 time: 0.153360 Oct 05 03:47:25.614258 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3799/7611] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:47:25 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:47:26.636579 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-acd1cd22-4b5a-4bf1-8dbe-f30aa903e00a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:47:26.637226 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-acd1cd22-4b5a-4bf1-8dbe-f30aa903e00a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:47:26.644494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-acd1cd22-4b5a-4bf1-8dbe-f30aa903e00a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:26.645010 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-acd1cd22-4b5a-4bf1-8dbe-f30aa903e00a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:26.645451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-acd1cd22-4b5a-4bf1-8dbe-f30aa903e00a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:26.646146 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-acd1cd22-4b5a-4bf1-8dbe-f30aa903e00a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:26.646603 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-acd1cd22-4b5a-4bf1-8dbe-f30aa903e00a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:26.647032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-acd1cd22-4b5a-4bf1-8dbe-f30aa903e00a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:26.778723 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-acd1cd22-4b5a-4bf1-8dbe-f30aa903e00a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:47:26.787024 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-acd1cd22-4b5a-4bf1-8dbe-f30aa903e00a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1359 microversion: 2.1 time: 0.154335 Oct 05 03:47:26.787603 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3813/7612] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:47:26 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:47:27.810491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d2cc5818-206e-448a-af79-a7166f42d7dc tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:47:27.811126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d2cc5818-206e-448a-af79-a7166f42d7dc tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:47:27.819148 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2cc5818-206e-448a-af79-a7166f42d7dc tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:27.819658 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2cc5818-206e-448a-af79-a7166f42d7dc tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:27.820114 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2cc5818-206e-448a-af79-a7166f42d7dc tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:27.820827 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2cc5818-206e-448a-af79-a7166f42d7dc tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:27.821325 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2cc5818-206e-448a-af79-a7166f42d7dc tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:27.821766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d2cc5818-206e-448a-af79-a7166f42d7dc tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:27.925097 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-a5530509-d81e-4a8c-9c9c-88a55d9bc625 req-70828d98-748f-4aef-985a-31378e8e6af5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c797529f-7bda-4a25-a915-a4b55051be4e", "name": "network-vif-plugged", "status": "completed", "tag": "3536017a-da1c-489c-a18f-edb9d8ce8b19"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:47:27.934495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a5530509-d81e-4a8c-9c9c-88a55d9bc625 req-70828d98-748f-4aef-985a-31378e8e6af5 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:27.934973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a5530509-d81e-4a8c-9c9c-88a55d9bc625 req-70828d98-748f-4aef-985a-31378e8e6af5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:27.935397 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-a5530509-d81e-4a8c-9c9c-88a55d9bc625 req-70828d98-748f-4aef-985a-31378e8e6af5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:27.946954 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-a5530509-d81e-4a8c-9c9c-88a55d9bc625 req-70828d98-748f-4aef-985a-31378e8e6af5 service nova] Creating event network-vif-plugged:3536017a-da1c-489c-a18f-edb9d8ce8b19 for instance c797529f-7bda-4a25-a915-a4b55051be4e on n-h2-858272-3 Oct 05 03:47:27.952207 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-a5530509-d81e-4a8c-9c9c-88a55d9bc625 req-70828d98-748f-4aef-985a-31378e8e6af5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127518 Oct 05 03:47:27.952936 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3814/7613] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:47:27.963282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d2cc5818-206e-448a-af79-a7166f42d7dc tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:47:27.971323 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d2cc5818-206e-448a-af79-a7166f42d7dc tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1359 microversion: 2.1 time: 0.164510 Oct 05 03:47:27.971909 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3800/7614] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:47:27 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:47:28.996488 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-15a44c63-9949-47a7-a5ab-6efd749c5e1f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:47:28.997172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-15a44c63-9949-47a7-a5ab-6efd749c5e1f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:47:29.004036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15a44c63-9949-47a7-a5ab-6efd749c5e1f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:29.004522 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15a44c63-9949-47a7-a5ab-6efd749c5e1f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:29.004991 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15a44c63-9949-47a7-a5ab-6efd749c5e1f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:29.005718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15a44c63-9949-47a7-a5ab-6efd749c5e1f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:29.006174 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15a44c63-9949-47a7-a5ab-6efd749c5e1f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:29.006600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-15a44c63-9949-47a7-a5ab-6efd749c5e1f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:29.140153 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-15a44c63-9949-47a7-a5ab-6efd749c5e1f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:47:29.148675 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-15a44c63-9949-47a7-a5ab-6efd749c5e1f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1359 microversion: 2.1 time: 0.157282 Oct 05 03:47:29.149280 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3815/7615] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:47:28 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:47:30.170906 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c2a41206-219c-4189-8630-f76649c28369 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:47:30.171530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c2a41206-219c-4189-8630-f76649c28369 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:47:30.178655 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2a41206-219c-4189-8630-f76649c28369 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:30.179154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2a41206-219c-4189-8630-f76649c28369 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:30.179600 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2a41206-219c-4189-8630-f76649c28369 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:30.180297 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2a41206-219c-4189-8630-f76649c28369 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:30.180761 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2a41206-219c-4189-8630-f76649c28369 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:30.181221 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c2a41206-219c-4189-8630-f76649c28369 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:30.307879 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c2a41206-219c-4189-8630-f76649c28369 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:47:30.315972 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c2a41206-219c-4189-8630-f76649c28369 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1549 microversion: 2.1 time: 0.148927 Oct 05 03:47:30.316557 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3801/7616] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:47:30 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:47:30.339156 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-455d1747-489f-4dbf-9556-6b858571582f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:47:30.339783 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-455d1747-489f-4dbf-9556-6b858571582f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:47:30.348074 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-455d1747-489f-4dbf-9556-6b858571582f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:30.348562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-455d1747-489f-4dbf-9556-6b858571582f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:30.349043 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-455d1747-489f-4dbf-9556-6b858571582f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:30.349743 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-455d1747-489f-4dbf-9556-6b858571582f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:30.350207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-455d1747-489f-4dbf-9556-6b858571582f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:30.350638 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-455d1747-489f-4dbf-9556-6b858571582f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:30.483840 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-455d1747-489f-4dbf-9556-6b858571582f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:47:30.492191 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-455d1747-489f-4dbf-9556-6b858571582f tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1549 microversion: 2.1 time: 0.156866 Oct 05 03:47:30.492761 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3816/7617] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:47:30 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:47:30.513848 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9df32c4c-079b-483b-bb58-d9b61113c689 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:47:30.518776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9df32c4c-079b-483b-bb58-d9b61113c689 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:47:30.519533 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9df32c4c-079b-483b-bb58-d9b61113c689 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Searching by: {'deleted': False, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff'} {{(pid=122320) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 03:47:30.524755 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9df32c4c-079b-483b-bb58-d9b61113c689 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:30.525288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9df32c4c-079b-483b-bb58-d9b61113c689 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:30.525740 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9df32c4c-079b-483b-bb58-d9b61113c689 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:30.526476 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9df32c4c-079b-483b-bb58-d9b61113c689 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:30.526954 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9df32c4c-079b-483b-bb58-d9b61113c689 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:30.527394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9df32c4c-079b-483b-bb58-d9b61113c689 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:30.551800 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.multi_cell_list [None req-9df32c4c-079b-483b-bb58-d9b61113c689 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 03:47:30.577899 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9df32c4c-079b-483b-bb58-d9b61113c689 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.067837 Oct 05 03:47:30.578486 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3802/7618] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 5 03:47:30 2022] GET /compute/v2.1/servers => generated 343 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:47:30.590301 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7ea7360a-b607-4f0a-a364-dcbc8053e2b5 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:47:30.590917 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7ea7360a-b607-4f0a-a364-dcbc8053e2b5 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:47:30.597520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ea7360a-b607-4f0a-a364-dcbc8053e2b5 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:30.598004 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ea7360a-b607-4f0a-a364-dcbc8053e2b5 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:30.598438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ea7360a-b607-4f0a-a364-dcbc8053e2b5 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:30.599150 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ea7360a-b607-4f0a-a364-dcbc8053e2b5 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:30.599606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ea7360a-b607-4f0a-a364-dcbc8053e2b5 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:30.600026 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7ea7360a-b607-4f0a-a364-dcbc8053e2b5 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:30.726670 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7ea7360a-b607-4f0a-a364-dcbc8053e2b5 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:47:30.734664 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7ea7360a-b607-4f0a-a364-dcbc8053e2b5 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1549 microversion: 2.1 time: 0.148152 Oct 05 03:47:30.735228 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3817/7619] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:47:30 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:47:32.242930 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e60b9ace-6947-46df-b9a9-f93a87c85f1a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7982ed67-e983-4afb-8089-73d1bf8a5189"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:47:32.245412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e60b9ace-6947-46df-b9a9-f93a87c85f1a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:47:32.252895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e60b9ace-6947-46df-b9a9-f93a87c85f1a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:32.253575 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e60b9ace-6947-46df-b9a9-f93a87c85f1a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:32.254030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e60b9ace-6947-46df-b9a9-f93a87c85f1a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:32.254744 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e60b9ace-6947-46df-b9a9-f93a87c85f1a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:32.255348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e60b9ace-6947-46df-b9a9-f93a87c85f1a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:32.255791 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e60b9ace-6947-46df-b9a9-f93a87c85f1a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:32.520687 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e60b9ace-6947-46df-b9a9-f93a87c85f1a tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "POST /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281265 Oct 05 03:47:32.521464 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3803/7620] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Oct 5 03:47:32 2022] POST /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:47:43.298800 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3f3cc4c7-3e4f-4d7d-93bb-a5af177d5a87 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:47:43.300182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3f3cc4c7-3e4f-4d7d-93bb-a5af177d5a87 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:47:43.303172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=21 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:47:43.303978 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=70 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:47:43.309543 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f3cc4c7-3e4f-4d7d-93bb-a5af177d5a87 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:43.310028 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f3cc4c7-3e4f-4d7d-93bb-a5af177d5a87 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:43.310464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f3cc4c7-3e4f-4d7d-93bb-a5af177d5a87 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:43.311152 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f3cc4c7-3e4f-4d7d-93bb-a5af177d5a87 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:43.311604 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f3cc4c7-3e4f-4d7d-93bb-a5af177d5a87 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:43.312027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f3cc4c7-3e4f-4d7d-93bb-a5af177d5a87 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:43.439959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3f3cc4c7-3e4f-4d7d-93bb-a5af177d5a87 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:47:43.448154 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3f3cc4c7-3e4f-4d7d-93bb-a5af177d5a87 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1595 microversion: 2.1 time: 0.153117 Oct 05 03:47:43.448739 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3818/7621] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:47:43 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1595 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:47:45.060885 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-dda08c84-078f-4cb9-9a9e-8a4cf5846232 req-b28c8380-e08b-413a-b51f-ea19bd0b2c24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c797529f-7bda-4a25-a915-a4b55051be4e", "tag": "3536017a-da1c-489c-a18f-edb9d8ce8b19"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:47:45.072366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:47:45.072366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=17 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:47:45.072366 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:47:45.076206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-dda08c84-078f-4cb9-9a9e-8a4cf5846232 req-b28c8380-e08b-413a-b51f-ea19bd0b2c24 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:45.076706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-dda08c84-078f-4cb9-9a9e-8a4cf5846232 req-b28c8380-e08b-413a-b51f-ea19bd0b2c24 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:45.077175 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-dda08c84-078f-4cb9-9a9e-8a4cf5846232 req-b28c8380-e08b-413a-b51f-ea19bd0b2c24 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:45.091281 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-dda08c84-078f-4cb9-9a9e-8a4cf5846232 req-b28c8380-e08b-413a-b51f-ea19bd0b2c24 service nova] Creating event network-changed:3536017a-da1c-489c-a18f-edb9d8ce8b19 for instance c797529f-7bda-4a25-a915-a4b55051be4e on n-h2-858272-3 Oct 05 03:47:45.097335 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-dda08c84-078f-4cb9-9a9e-8a4cf5846232 req-b28c8380-e08b-413a-b51f-ea19bd0b2c24 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048108 Oct 05 03:47:45.098308 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3804/7622] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:47:46.131040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3a3d5a3f-7043-4b02-bcf6-21239eb1a3e1 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-521611220"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:47:46.131597 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3a3d5a3f-7043-4b02-bcf6-21239eb1a3e1 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:47:46.138412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a3d5a3f-7043-4b02-bcf6-21239eb1a3e1 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:46.139161 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a3d5a3f-7043-4b02-bcf6-21239eb1a3e1 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:46.139602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a3d5a3f-7043-4b02-bcf6-21239eb1a3e1 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:46.140333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a3d5a3f-7043-4b02-bcf6-21239eb1a3e1 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:46.140786 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a3d5a3f-7043-4b02-bcf6-21239eb1a3e1 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:46.141403 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a3d5a3f-7043-4b02-bcf6-21239eb1a3e1 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:46.278684 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.network.security_group_api [None req-3a3d5a3f-7043-4b02-bcf6-21239eb1a3e1 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Adding security group f409baec-3e38-4351-b424-8da4027e5651 to port 3536017a-da1c-489c-a18f-edb9d8ce8b19 Oct 05 03:47:46.589739 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3a3d5a3f-7043-4b02-bcf6-21239eb1a3e1 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "POST /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e/action" status: 202 len: 0 microversion: 2.1 time: 0.463336 Oct 05 03:47:46.593293 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3819/7623] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:47:46 2022] POST /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e/action => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:47:46.601569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-25301339-9f3e-4288-99a3-be582e601acf tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:47:46.602288 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-25301339-9f3e-4288-99a3-be582e601acf tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:47:46.609956 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-60f2453f-20ed-4cf2-9133-520686123b41 req-e4a5599d-a74e-4a27-a6f7-ade58e0f614a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c797529f-7bda-4a25-a915-a4b55051be4e", "tag": "3536017a-da1c-489c-a18f-edb9d8ce8b19"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:47:46.620483 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25301339-9f3e-4288-99a3-be582e601acf tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:46.620985 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25301339-9f3e-4288-99a3-be582e601acf tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:46.621441 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25301339-9f3e-4288-99a3-be582e601acf tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:46.622148 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25301339-9f3e-4288-99a3-be582e601acf tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:46.622613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25301339-9f3e-4288-99a3-be582e601acf tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:46.623528 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25301339-9f3e-4288-99a3-be582e601acf tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:46.628910 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-60f2453f-20ed-4cf2-9133-520686123b41 req-e4a5599d-a74e-4a27-a6f7-ade58e0f614a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:47:46.629389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-60f2453f-20ed-4cf2-9133-520686123b41 req-e4a5599d-a74e-4a27-a6f7-ade58e0f614a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:47:46.629813 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-60f2453f-20ed-4cf2-9133-520686123b41 req-e4a5599d-a74e-4a27-a6f7-ade58e0f614a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:47:46.644671 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-60f2453f-20ed-4cf2-9133-520686123b41 req-e4a5599d-a74e-4a27-a6f7-ade58e0f614a service nova] Creating event network-changed:3536017a-da1c-489c-a18f-edb9d8ce8b19 for instance c797529f-7bda-4a25-a915-a4b55051be4e on n-h2-858272-3 Oct 05 03:47:46.652157 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-60f2453f-20ed-4cf2-9133-520686123b41 req-e4a5599d-a74e-4a27-a6f7-ade58e0f614a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045722 Oct 05 03:47:46.654740 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3820/7624] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:47:46.893908 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-25301339-9f3e-4288-99a3-be582e601acf tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:47:46.905087 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-25301339-9f3e-4288-99a3-be582e601acf tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1759 microversion: 2.1 time: 0.310107 Oct 05 03:47:46.917049 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3805/7625] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:47:46 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1759 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:48:34.770658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:48:34.771414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=12 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:48:34.772471 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 03:48:34.772650 n-d-858272-3 devstack@n-api.service[122319]: Wed Oct 5 03:48:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e/action (ip 10.222.0.16) !!! Oct 05 03:48:34.777914 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-63faf521-4a73-4757-8bfb-e3ea45606d06 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:48:34.780182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-63faf521-4a73-4757-8bfb-e3ea45606d06 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:48:34.790617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-63faf521-4a73-4757-8bfb-e3ea45606d06 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:48:34.791104 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-63faf521-4a73-4757-8bfb-e3ea45606d06 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:48:34.791551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-63faf521-4a73-4757-8bfb-e3ea45606d06 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:48:34.792235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-63faf521-4a73-4757-8bfb-e3ea45606d06 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:48:34.792686 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-63faf521-4a73-4757-8bfb-e3ea45606d06 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:48:34.793143 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-63faf521-4a73-4757-8bfb-e3ea45606d06 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:48:34.864959 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-63faf521-4a73-4757-8bfb-e3ea45606d06 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "POST /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e/action" status: 202 len: 0 microversion: 2.1 time: 0.095603 Oct 05 03:48:34.865582 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3821/7626] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:48:34 2022] POST /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:48:34.874997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4320312f-1f96-4901-bad3-36c2c38b63c8 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:48:34.875648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4320312f-1f96-4901-bad3-36c2c38b63c8 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:48:34.877956 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:48:34.878828 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=8 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:48:34.886689 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4320312f-1f96-4901-bad3-36c2c38b63c8 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:48:34.887517 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4320312f-1f96-4901-bad3-36c2c38b63c8 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:48:34.887979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4320312f-1f96-4901-bad3-36c2c38b63c8 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:48:34.888687 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4320312f-1f96-4901-bad3-36c2c38b63c8 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:48:34.889178 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4320312f-1f96-4901-bad3-36c2c38b63c8 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:48:34.889614 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4320312f-1f96-4901-bad3-36c2c38b63c8 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:48:35.124850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4320312f-1f96-4901-bad3-36c2c38b63c8 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:48:35.133592 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4320312f-1f96-4901-bad3-36c2c38b63c8 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1751 microversion: 2.1 time: 0.263743 Oct 05 03:48:35.134176 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3806/7627] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:48:34 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1751 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:48:36.158233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0e22105c-a62d-4e9d-aef2-a208f3a8bd34 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:48:36.159100 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0e22105c-a62d-4e9d-aef2-a208f3a8bd34 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:48:36.165699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e22105c-a62d-4e9d-aef2-a208f3a8bd34 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:48:36.166196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e22105c-a62d-4e9d-aef2-a208f3a8bd34 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:48:36.166647 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e22105c-a62d-4e9d-aef2-a208f3a8bd34 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:48:36.167401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e22105c-a62d-4e9d-aef2-a208f3a8bd34 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:48:36.167852 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e22105c-a62d-4e9d-aef2-a208f3a8bd34 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:48:36.168510 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0e22105c-a62d-4e9d-aef2-a208f3a8bd34 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:48:36.311163 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0e22105c-a62d-4e9d-aef2-a208f3a8bd34 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:48:36.319964 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0e22105c-a62d-4e9d-aef2-a208f3a8bd34 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1756 microversion: 2.1 time: 0.166887 Oct 05 03:48:36.320529 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3822/7628] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:48:36 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:48:37.343479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4aadbc98-05a6-4c16-8030-7fda2d22ee24 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:48:37.344098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4aadbc98-05a6-4c16-8030-7fda2d22ee24 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:48:37.351916 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4aadbc98-05a6-4c16-8030-7fda2d22ee24 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:48:37.352410 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4aadbc98-05a6-4c16-8030-7fda2d22ee24 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:48:37.352852 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4aadbc98-05a6-4c16-8030-7fda2d22ee24 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:48:37.353566 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4aadbc98-05a6-4c16-8030-7fda2d22ee24 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:48:37.354029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4aadbc98-05a6-4c16-8030-7fda2d22ee24 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:48:37.354462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4aadbc98-05a6-4c16-8030-7fda2d22ee24 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:48:37.502405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4aadbc98-05a6-4c16-8030-7fda2d22ee24 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:48:37.511210 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4aadbc98-05a6-4c16-8030-7fda2d22ee24 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1756 microversion: 2.1 time: 0.171683 Oct 05 03:48:37.511821 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3807/7629] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:48:37 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:48:38.534916 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-053ba11a-f5ff-46c6-881a-1bd258d9fd6e tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:48:38.535640 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-053ba11a-f5ff-46c6-881a-1bd258d9fd6e tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:48:38.542611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-053ba11a-f5ff-46c6-881a-1bd258d9fd6e tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:48:38.543093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-053ba11a-f5ff-46c6-881a-1bd258d9fd6e tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:48:38.543530 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-053ba11a-f5ff-46c6-881a-1bd258d9fd6e tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:48:38.544249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-053ba11a-f5ff-46c6-881a-1bd258d9fd6e tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:48:38.544703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-053ba11a-f5ff-46c6-881a-1bd258d9fd6e tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:48:38.545160 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-053ba11a-f5ff-46c6-881a-1bd258d9fd6e tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:48:38.694668 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-053ba11a-f5ff-46c6-881a-1bd258d9fd6e tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:48:38.702882 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-053ba11a-f5ff-46c6-881a-1bd258d9fd6e tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1756 microversion: 2.1 time: 0.172118 Oct 05 03:48:38.703443 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3823/7630] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:48:38 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:48:39.725940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-08063802-0746-424c-b363-dbec877ca2b7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:48:39.726568 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-08063802-0746-424c-b363-dbec877ca2b7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:48:39.733607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08063802-0746-424c-b363-dbec877ca2b7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:48:39.734102 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08063802-0746-424c-b363-dbec877ca2b7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:48:39.734550 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08063802-0746-424c-b363-dbec877ca2b7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:48:39.735251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08063802-0746-424c-b363-dbec877ca2b7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:48:39.735721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08063802-0746-424c-b363-dbec877ca2b7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:48:39.736153 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-08063802-0746-424c-b363-dbec877ca2b7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:48:39.879246 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-08063802-0746-424c-b363-dbec877ca2b7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:48:39.888746 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-08063802-0746-424c-b363-dbec877ca2b7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1756 microversion: 2.1 time: 0.166690 Oct 05 03:48:39.889358 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3808/7631] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:48:39 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:48:40.911479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-06a2622f-029f-44fc-aed5-9331e52c46d9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:48:40.912799 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-06a2622f-029f-44fc-aed5-9331e52c46d9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:48:40.919625 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06a2622f-029f-44fc-aed5-9331e52c46d9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:48:40.920027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06a2622f-029f-44fc-aed5-9331e52c46d9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:48:40.920460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06a2622f-029f-44fc-aed5-9331e52c46d9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:48:40.921169 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06a2622f-029f-44fc-aed5-9331e52c46d9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:48:40.921624 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06a2622f-029f-44fc-aed5-9331e52c46d9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:48:40.922047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06a2622f-029f-44fc-aed5-9331e52c46d9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:48:41.065251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-06a2622f-029f-44fc-aed5-9331e52c46d9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:48:41.074049 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-06a2622f-029f-44fc-aed5-9331e52c46d9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1756 microversion: 2.1 time: 0.166368 Oct 05 03:48:41.074637 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3824/7632] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:48:40 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:48:42.097836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-eae1d826-a575-4274-8763-b8770d82bb00 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:48:42.098552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-eae1d826-a575-4274-8763-b8770d82bb00 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:48:42.106494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eae1d826-a575-4274-8763-b8770d82bb00 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:48:42.107012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eae1d826-a575-4274-8763-b8770d82bb00 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:48:42.107467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eae1d826-a575-4274-8763-b8770d82bb00 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:48:42.108198 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eae1d826-a575-4274-8763-b8770d82bb00 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:48:42.108676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eae1d826-a575-4274-8763-b8770d82bb00 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:48:42.109187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eae1d826-a575-4274-8763-b8770d82bb00 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:48:42.252888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-eae1d826-a575-4274-8763-b8770d82bb00 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:48:42.261277 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-eae1d826-a575-4274-8763-b8770d82bb00 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1756 microversion: 2.1 time: 0.167341 Oct 05 03:48:42.261862 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3809/7633] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:48:42 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:48:43.286303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9855f6b4-f47e-489f-b0a6-e685c6c482b4 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:48:43.287582 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9855f6b4-f47e-489f-b0a6-e685c6c482b4 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:48:43.294818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9855f6b4-f47e-489f-b0a6-e685c6c482b4 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:48:43.295305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9855f6b4-f47e-489f-b0a6-e685c6c482b4 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:48:43.295741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9855f6b4-f47e-489f-b0a6-e685c6c482b4 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:48:43.296438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9855f6b4-f47e-489f-b0a6-e685c6c482b4 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:48:43.296894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9855f6b4-f47e-489f-b0a6-e685c6c482b4 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:48:43.297343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9855f6b4-f47e-489f-b0a6-e685c6c482b4 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:48:43.458215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9855f6b4-f47e-489f-b0a6-e685c6c482b4 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:48:43.471411 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9855f6b4-f47e-489f-b0a6-e685c6c482b4 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1756 microversion: 2.1 time: 0.188906 Oct 05 03:48:43.472212 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3825/7634] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:48:43 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:48:44.495699 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-df5fc2e9-85d2-45cf-b3b2-ef3ca1b687a2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:48:44.496268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-df5fc2e9-85d2-45cf-b3b2-ef3ca1b687a2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:48:44.503168 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df5fc2e9-85d2-45cf-b3b2-ef3ca1b687a2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:48:44.503669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df5fc2e9-85d2-45cf-b3b2-ef3ca1b687a2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:48:44.504121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df5fc2e9-85d2-45cf-b3b2-ef3ca1b687a2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:48:44.504830 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df5fc2e9-85d2-45cf-b3b2-ef3ca1b687a2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:48:44.505876 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df5fc2e9-85d2-45cf-b3b2-ef3ca1b687a2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:48:44.506330 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-df5fc2e9-85d2-45cf-b3b2-ef3ca1b687a2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:48:44.649696 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-df5fc2e9-85d2-45cf-b3b2-ef3ca1b687a2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:48:44.658174 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-df5fc2e9-85d2-45cf-b3b2-ef3ca1b687a2 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1756 microversion: 2.1 time: 0.166417 Oct 05 03:48:44.658770 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3810/7635] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:48:44 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:48:45.683049 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0170a5f4-7b2a-4ccc-ba72-d7c20f408a61 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:48:45.683661 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0170a5f4-7b2a-4ccc-ba72-d7c20f408a61 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:48:45.689990 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0170a5f4-7b2a-4ccc-ba72-d7c20f408a61 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:48:45.690513 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0170a5f4-7b2a-4ccc-ba72-d7c20f408a61 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:48:45.690953 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0170a5f4-7b2a-4ccc-ba72-d7c20f408a61 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:48:45.691642 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0170a5f4-7b2a-4ccc-ba72-d7c20f408a61 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:48:45.692099 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0170a5f4-7b2a-4ccc-ba72-d7c20f408a61 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:48:45.692528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0170a5f4-7b2a-4ccc-ba72-d7c20f408a61 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:48:45.835762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0170a5f4-7b2a-4ccc-ba72-d7c20f408a61 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:48:45.843961 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0170a5f4-7b2a-4ccc-ba72-d7c20f408a61 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1756 microversion: 2.1 time: 0.164947 Oct 05 03:48:45.844528 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3826/7636] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:48:45 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:48:46.867828 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6405c88f-d26a-46cf-8e93-eea9a47ceab9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:48:46.868450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6405c88f-d26a-46cf-8e93-eea9a47ceab9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:48:46.875631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6405c88f-d26a-46cf-8e93-eea9a47ceab9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:48:46.876132 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6405c88f-d26a-46cf-8e93-eea9a47ceab9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:48:46.876581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6405c88f-d26a-46cf-8e93-eea9a47ceab9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:48:46.877311 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6405c88f-d26a-46cf-8e93-eea9a47ceab9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:48:46.877779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6405c88f-d26a-46cf-8e93-eea9a47ceab9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:48:46.878279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6405c88f-d26a-46cf-8e93-eea9a47ceab9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:48:47.019840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6405c88f-d26a-46cf-8e93-eea9a47ceab9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:48:47.034238 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6405c88f-d26a-46cf-8e93-eea9a47ceab9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1759 microversion: 2.1 time: 0.170393 Oct 05 03:48:47.034830 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3811/7637] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:48:46 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1759 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:49:42.457115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9c164566-449a-46c1-89f3-731011337607 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-521611220"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:49:42.457633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9c164566-449a-46c1-89f3-731011337607 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:49:42.460247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=12 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:49:42.460954 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:49:42.467034 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c164566-449a-46c1-89f3-731011337607 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:49:42.467526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c164566-449a-46c1-89f3-731011337607 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:49:42.467963 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c164566-449a-46c1-89f3-731011337607 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:49:42.468662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c164566-449a-46c1-89f3-731011337607 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:49:42.469146 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c164566-449a-46c1-89f3-731011337607 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:49:42.469583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c164566-449a-46c1-89f3-731011337607 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:49:42.600892 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.network.security_group_api [None req-9c164566-449a-46c1-89f3-731011337607 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Removing security group f409baec-3e38-4351-b424-8da4027e5651 from port 3536017a-da1c-489c-a18f-edb9d8ce8b19 Oct 05 03:49:42.900286 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9c164566-449a-46c1-89f3-731011337607 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "POST /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e/action" status: 202 len: 0 microversion: 2.1 time: 0.447426 Oct 05 03:49:42.904300 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3827/7638] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:49:42 2022] POST /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:49:42.910179 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=12 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:49:42.910942 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=36 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:49:42.998363 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-f7eb9896-012d-49cb-9445-1736f5203af5 req-393b0228-d33c-4d1a-93c1-feded4ed98cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c797529f-7bda-4a25-a915-a4b55051be4e", "tag": "3536017a-da1c-489c-a18f-edb9d8ce8b19"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:49:43.010796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f7eb9896-012d-49cb-9445-1736f5203af5 req-393b0228-d33c-4d1a-93c1-feded4ed98cb service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:49:43.011620 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f7eb9896-012d-49cb-9445-1736f5203af5 req-393b0228-d33c-4d1a-93c1-feded4ed98cb service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:49:43.012248 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f7eb9896-012d-49cb-9445-1736f5203af5 req-393b0228-d33c-4d1a-93c1-feded4ed98cb service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:49:43.026529 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-f7eb9896-012d-49cb-9445-1736f5203af5 req-393b0228-d33c-4d1a-93c1-feded4ed98cb service nova] Creating event network-changed:3536017a-da1c-489c-a18f-edb9d8ce8b19 for instance c797529f-7bda-4a25-a915-a4b55051be4e on n-h2-858272-3 Oct 05 03:49:43.033925 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-f7eb9896-012d-49cb-9445-1736f5203af5 req-393b0228-d33c-4d1a-93c1-feded4ed98cb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128806 Oct 05 03:49:43.034988 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3812/7639] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:49:43.975617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b94ae72a-17a3-40ba-9eb7-9b782b4f9e70 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:49:43.976447 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b94ae72a-17a3-40ba-9eb7-9b782b4f9e70 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:49:43.977451 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-273b5af7-f7c3-44e4-bf9d-4dd9729ff281 req-018e5645-8fac-413d-a7f0-38b5b3ae750a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c797529f-7bda-4a25-a915-a4b55051be4e", "tag": "3536017a-da1c-489c-a18f-edb9d8ce8b19"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:49:43.983551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b94ae72a-17a3-40ba-9eb7-9b782b4f9e70 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:49:43.984119 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b94ae72a-17a3-40ba-9eb7-9b782b4f9e70 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:49:43.984655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b94ae72a-17a3-40ba-9eb7-9b782b4f9e70 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:49:43.985456 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b94ae72a-17a3-40ba-9eb7-9b782b4f9e70 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:49:43.986106 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b94ae72a-17a3-40ba-9eb7-9b782b4f9e70 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:49:43.986699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b94ae72a-17a3-40ba-9eb7-9b782b4f9e70 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:49:43.989552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-273b5af7-f7c3-44e4-bf9d-4dd9729ff281 req-018e5645-8fac-413d-a7f0-38b5b3ae750a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:49:43.990146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-273b5af7-f7c3-44e4-bf9d-4dd9729ff281 req-018e5645-8fac-413d-a7f0-38b5b3ae750a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:49:43.990919 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-273b5af7-f7c3-44e4-bf9d-4dd9729ff281 req-018e5645-8fac-413d-a7f0-38b5b3ae750a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:49:44.002194 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-273b5af7-f7c3-44e4-bf9d-4dd9729ff281 req-018e5645-8fac-413d-a7f0-38b5b3ae750a service nova] Creating event network-changed:3536017a-da1c-489c-a18f-edb9d8ce8b19 for instance c797529f-7bda-4a25-a915-a4b55051be4e on n-h2-858272-3 Oct 05 03:49:44.009919 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-273b5af7-f7c3-44e4-bf9d-4dd9729ff281 req-018e5645-8fac-413d-a7f0-38b5b3ae750a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036770 Oct 05 03:49:44.010632 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3813/7640] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:49:44.103638 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-b94ae72a-17a3-40ba-9eb7-9b782b4f9e70 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lazy-loading 'services' on Instance uuid c797529f-7bda-4a25-a915-a4b55051be4e {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:49:44.203297 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b94ae72a-17a3-40ba-9eb7-9b782b4f9e70 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e/os-volume_attachments/7982ed67-e983-4afb-8089-73d1bf8a5189" status: 202 len: 0 microversion: 2.1 time: 0.232532 Oct 05 03:49:44.217738 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f12e33ee-c481-4283-9387-5e4c75f12ccd tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:49:44.220445 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f12e33ee-c481-4283-9387-5e4c75f12ccd tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:49:44.222555 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3828/7641] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 03:49:43 2022] DELETE /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e/os-volume_attachments/7982ed67-e983-4afb-8089-73d1bf8a5189 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:49:44.228536 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f12e33ee-c481-4283-9387-5e4c75f12ccd tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:49:44.229356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f12e33ee-c481-4283-9387-5e4c75f12ccd tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:49:44.229809 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f12e33ee-c481-4283-9387-5e4c75f12ccd tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:49:44.230620 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f12e33ee-c481-4283-9387-5e4c75f12ccd tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:49:44.231336 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f12e33ee-c481-4283-9387-5e4c75f12ccd tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:49:44.231773 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f12e33ee-c481-4283-9387-5e4c75f12ccd tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:49:44.268642 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f12e33ee-c481-4283-9387-5e4c75f12ccd tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056231 Oct 05 03:49:44.269289 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3814/7642] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:49:44 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:49:45.282823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c9decd6b-c393-48e9-8138-aabe165b57d3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:49:45.285322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c9decd6b-c393-48e9-8138-aabe165b57d3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:49:45.292521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9decd6b-c393-48e9-8138-aabe165b57d3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:49:45.293023 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9decd6b-c393-48e9-8138-aabe165b57d3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:49:45.293486 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9decd6b-c393-48e9-8138-aabe165b57d3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:49:45.294172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9decd6b-c393-48e9-8138-aabe165b57d3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:49:45.294619 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9decd6b-c393-48e9-8138-aabe165b57d3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:49:45.295038 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c9decd6b-c393-48e9-8138-aabe165b57d3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:49:45.326744 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c9decd6b-c393-48e9-8138-aabe165b57d3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048487 Oct 05 03:49:45.327221 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3829/7643] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:49:45 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:49:46.340613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ac0ce8fb-fc32-4544-930b-5b258601273d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:49:46.342915 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ac0ce8fb-fc32-4544-930b-5b258601273d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:49:46.350073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac0ce8fb-fc32-4544-930b-5b258601273d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:49:46.350848 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac0ce8fb-fc32-4544-930b-5b258601273d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:49:46.351323 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac0ce8fb-fc32-4544-930b-5b258601273d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:49:46.352039 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac0ce8fb-fc32-4544-930b-5b258601273d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:49:46.352515 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac0ce8fb-fc32-4544-930b-5b258601273d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:49:46.352979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ac0ce8fb-fc32-4544-930b-5b258601273d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:49:46.386315 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ac0ce8fb-fc32-4544-930b-5b258601273d tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049767 Oct 05 03:49:46.386919 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3815/7644] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:49:46 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:49:47.398839 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fa7deebe-acd3-4c47-9024-68700a124639 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:49:47.401135 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fa7deebe-acd3-4c47-9024-68700a124639 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:49:47.407958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa7deebe-acd3-4c47-9024-68700a124639 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:49:47.408735 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa7deebe-acd3-4c47-9024-68700a124639 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:49:47.409217 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa7deebe-acd3-4c47-9024-68700a124639 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:49:47.409934 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa7deebe-acd3-4c47-9024-68700a124639 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:49:47.410390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa7deebe-acd3-4c47-9024-68700a124639 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:49:47.410818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fa7deebe-acd3-4c47-9024-68700a124639 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:49:47.441319 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fa7deebe-acd3-4c47-9024-68700a124639 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047086 Oct 05 03:49:47.441889 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3830/7645] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:49:47 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:49:48.453560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ba36b00c-8957-4eb5-85eb-68a54f8dc6a7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:49:48.455646 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ba36b00c-8957-4eb5-85eb-68a54f8dc6a7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:49:48.463243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ba36b00c-8957-4eb5-85eb-68a54f8dc6a7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:49:48.463739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ba36b00c-8957-4eb5-85eb-68a54f8dc6a7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:49:48.464184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ba36b00c-8957-4eb5-85eb-68a54f8dc6a7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:49:48.464885 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ba36b00c-8957-4eb5-85eb-68a54f8dc6a7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:49:48.465372 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ba36b00c-8957-4eb5-85eb-68a54f8dc6a7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:49:48.465804 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ba36b00c-8957-4eb5-85eb-68a54f8dc6a7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:49:48.496248 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ba36b00c-8957-4eb5-85eb-68a54f8dc6a7 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046793 Oct 05 03:49:48.496824 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3816/7646] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:49:48 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:49:49.508463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5af9d1a2-34d8-4789-a8bc-042e5230e0fc tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:49:49.510685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5af9d1a2-34d8-4789-a8bc-042e5230e0fc tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:49:49.517547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5af9d1a2-34d8-4789-a8bc-042e5230e0fc tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:49:49.518030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5af9d1a2-34d8-4789-a8bc-042e5230e0fc tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:49:49.518464 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5af9d1a2-34d8-4789-a8bc-042e5230e0fc tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:49:49.519147 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5af9d1a2-34d8-4789-a8bc-042e5230e0fc tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:49:49.519600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5af9d1a2-34d8-4789-a8bc-042e5230e0fc tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:49:49.520025 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5af9d1a2-34d8-4789-a8bc-042e5230e0fc tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:49:49.549566 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5af9d1a2-34d8-4789-a8bc-042e5230e0fc tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045330 Oct 05 03:49:49.550113 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3831/7647] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 03:49:49 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 03:49:49.560573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8cfe076d-bb06-460f-8c00-64460776b1a8 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:49:49.561126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8cfe076d-bb06-460f-8c00-64460776b1a8 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:49:49.567898 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8cfe076d-bb06-460f-8c00-64460776b1a8 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:49:49.568393 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8cfe076d-bb06-460f-8c00-64460776b1a8 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:49:49.569259 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8cfe076d-bb06-460f-8c00-64460776b1a8 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:49:49.569572 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8cfe076d-bb06-460f-8c00-64460776b1a8 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:49:49.570036 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8cfe076d-bb06-460f-8c00-64460776b1a8 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:49:49.570472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8cfe076d-bb06-460f-8c00-64460776b1a8 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:49:49.650403 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-8cfe076d-bb06-460f-8c00-64460776b1a8 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] HTTP exception thrown: Instance c797529f-7bda-4a25-a915-a4b55051be4e is not attached to volume 7982ed67-e983-4afb-8089-73d1bf8a5189 Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8cfe076d-bb06-460f-8c00-64460776b1a8 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Request method failure captured: Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: request: DELETE /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e/os-volume_attachments/7982ed67-e983-4afb-8089-73d1bf8a5189 HTTP/1.1 Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPP0I285xzgP1quSPWEDKcl0umeTubKUyPVeQMS3UXXieWDJ1ngtA_0UC1yFKQlA4hdQLPQoL9uRqYQ8Wa6LOuNJ7nBwiDc3AkFcdbgWk6UvlZ2Yut6SyNTXO1LRklyUbiAwmlR6z0Dbgn5I9hlEdBPGuBEQSNw0ebaHNk-qmDnD9KBo Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 2e22d6e1c9a5495b8c152d7c7e5b1aff Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-TestMinimumBasicScenario-1436608884 Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e22d6e1c9a5495b8c152d7c7e5b1aff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e22d6e1c9a5495b8c152d7c7e5b1aff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2e22d6e1c9a5495b8c152d7c7e5b1aff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2e22d6e1c9a5495b8c152d7c7e5b1aff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-TestMinimumBasicScenario-1436608884 Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 2e22d6e1c9a5495b8c152d7c7e5b1aff Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1436608884 Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-TestMinimumBasicScenario-1436608884-project Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: cf1e0670dd7341d0a2c237722f903537 Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-TestMinimumBasicScenario-1436608884-project Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance c797529f-7bda-4a25-a915-a4b55051be4e is not attached to volume 7982ed67-e983-4afb-8089-73d1bf8a5189 Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'server_id': 'c797529f-7bda-4a25-a915-a4b55051be4e', 'id': '7982ed67-e983-4afb-8089-73d1bf8a5189'} Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7982ed67-e983-4afb-8089-73d1bf8a5189. Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c797529f-7bda-4a25-a915-a4b55051be4e is not attached to volume 7982ed67-e983-4afb-8089-73d1bf8a5189 Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:49:49.652030 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:49:49.657053 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:49:49.657053 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:49:49.657053 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c797529f-7bda-4a25-a915-a4b55051be4e is not attached to volume 7982ed67-e983-4afb-8089-73d1bf8a5189 Oct 05 03:49:49.657053 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:49:49.657053 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8cfe076d-bb06-460f-8c00-64460776b1a8 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Returning 404 to user: Instance c797529f-7bda-4a25-a915-a4b55051be4e is not attached to volume 7982ed67-e983-4afb-8089-73d1bf8a5189 {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:49:49.657053 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8cfe076d-bb06-460f-8c00-64460776b1a8 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e/os-volume_attachments/7982ed67-e983-4afb-8089-73d1bf8a5189" status: 404 len: 154 microversion: 2.1 time: 0.096888 Oct 05 03:49:49.657053 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3817/7648] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Oct 5 03:49:49 2022] DELETE /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e/os-volume_attachments/7982ed67-e983-4afb-8089-73d1bf8a5189 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:49:52.906622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-796ea116-9d97-4847-a208-8f79a62303f3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:49:52.906622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-796ea116-9d97-4847-a208-8f79a62303f3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:49:52.916272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-796ea116-9d97-4847-a208-8f79a62303f3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:49:52.916819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-796ea116-9d97-4847-a208-8f79a62303f3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:49:52.917321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-796ea116-9d97-4847-a208-8f79a62303f3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:49:52.918061 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-796ea116-9d97-4847-a208-8f79a62303f3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:49:52.918517 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-796ea116-9d97-4847-a208-8f79a62303f3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:49:52.918940 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-796ea116-9d97-4847-a208-8f79a62303f3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:49:52.953793 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-796ea116-9d97-4847-a208-8f79a62303f3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:49:53.039681 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-796ea116-9d97-4847-a208-8f79a62303f3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 204 len: 0 microversion: 2.1 time: 0.137171 Oct 05 03:49:53.040359 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3832/7649] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:49:52 2022] DELETE /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:49:53.048542 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3083cba2-6a4f-4554-898f-c6c0048cc1a3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:49:53.049286 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3083cba2-6a4f-4554-898f-c6c0048cc1a3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:49:53.056830 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3083cba2-6a4f-4554-898f-c6c0048cc1a3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:49:53.057380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3083cba2-6a4f-4554-898f-c6c0048cc1a3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:49:53.057833 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3083cba2-6a4f-4554-898f-c6c0048cc1a3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:49:53.058530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3083cba2-6a4f-4554-898f-c6c0048cc1a3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:49:53.058992 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3083cba2-6a4f-4554-898f-c6c0048cc1a3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:49:53.059459 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3083cba2-6a4f-4554-898f-c6c0048cc1a3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:49:53.195282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3083cba2-6a4f-4554-898f-c6c0048cc1a3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:49:53.203355 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3083cba2-6a4f-4554-898f-c6c0048cc1a3 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1555 microversion: 2.1 time: 0.158706 Oct 05 03:49:53.203952 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3818/7650] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:49:53 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:49:54.231303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fcc2e7a6-72bf-49c2-90ca-9d50a442e822 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:49:54.232054 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fcc2e7a6-72bf-49c2-90ca-9d50a442e822 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:49:54.238872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fcc2e7a6-72bf-49c2-90ca-9d50a442e822 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:49:54.239356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fcc2e7a6-72bf-49c2-90ca-9d50a442e822 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:49:54.239789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fcc2e7a6-72bf-49c2-90ca-9d50a442e822 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:49:54.240546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fcc2e7a6-72bf-49c2-90ca-9d50a442e822 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:49:54.241100 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fcc2e7a6-72bf-49c2-90ca-9d50a442e822 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:49:54.241528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fcc2e7a6-72bf-49c2-90ca-9d50a442e822 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:49:54.374602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fcc2e7a6-72bf-49c2-90ca-9d50a442e822 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:49:54.382884 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fcc2e7a6-72bf-49c2-90ca-9d50a442e822 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1555 microversion: 2.1 time: 0.156204 Oct 05 03:49:54.383455 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3833/7651] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:49:54 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:49:55.404097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-e5a17ba4-d951-40ce-84e0-ab1339c97afa req-ad328d40-a77d-4dcd-84f4-c19bbfad297b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c797529f-7bda-4a25-a915-a4b55051be4e", "name": "network-vif-deleted", "tag": "3536017a-da1c-489c-a18f-edb9d8ce8b19"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:49:55.407919 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5b01580c-29f5-48cd-a76d-7409c8df82f8 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:49:55.408537 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5b01580c-29f5-48cd-a76d-7409c8df82f8 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:49:55.416102 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e5a17ba4-d951-40ce-84e0-ab1339c97afa req-ad328d40-a77d-4dcd-84f4-c19bbfad297b service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:49:55.416587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5b01580c-29f5-48cd-a76d-7409c8df82f8 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:49:55.416717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e5a17ba4-d951-40ce-84e0-ab1339c97afa req-ad328d40-a77d-4dcd-84f4-c19bbfad297b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:49:55.417112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e5a17ba4-d951-40ce-84e0-ab1339c97afa req-ad328d40-a77d-4dcd-84f4-c19bbfad297b service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:49:55.417273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5b01580c-29f5-48cd-a76d-7409c8df82f8 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:49:55.417554 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5b01580c-29f5-48cd-a76d-7409c8df82f8 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:49:55.418301 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5b01580c-29f5-48cd-a76d-7409c8df82f8 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:49:55.419373 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5b01580c-29f5-48cd-a76d-7409c8df82f8 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:49:55.419825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5b01580c-29f5-48cd-a76d-7409c8df82f8 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:49:55.429817 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-e5a17ba4-d951-40ce-84e0-ab1339c97afa req-ad328d40-a77d-4dcd-84f4-c19bbfad297b service nova] Creating event network-vif-deleted:3536017a-da1c-489c-a18f-edb9d8ce8b19 for instance c797529f-7bda-4a25-a915-a4b55051be4e on n-h2-858272-3 Oct 05 03:49:55.435513 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-e5a17ba4-d951-40ce-84e0-ab1339c97afa req-ad328d40-a77d-4dcd-84f4-c19bbfad297b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035354 Oct 05 03:49:55.436479 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3819/7652] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:49:55.490934 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5b01580c-29f5-48cd-a76d-7409c8df82f8 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1e0670dd7341d0a2c237722f903537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:49:55.500730 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5b01580c-29f5-48cd-a76d-7409c8df82f8 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 200 len: 1513 microversion: 2.1 time: 0.097867 Oct 05 03:49:55.501975 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3834/7653] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:49:55 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 1513 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:49:56.527510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-36606c38-cc63-4097-8e35-0148f8a550e9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:49:56.528142 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-36606c38-cc63-4097-8e35-0148f8a550e9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [instance: c797529f-7bda-4a25-a915-a4b55051be4e] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:49:56.534373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36606c38-cc63-4097-8e35-0148f8a550e9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:49:56.534869 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36606c38-cc63-4097-8e35-0148f8a550e9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:49:56.535323 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36606c38-cc63-4097-8e35-0148f8a550e9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:49:56.536028 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36606c38-cc63-4097-8e35-0148f8a550e9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:49:56.536496 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36606c38-cc63-4097-8e35-0148f8a550e9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:49:56.536956 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36606c38-cc63-4097-8e35-0148f8a550e9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:49:56.551007 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-36606c38-cc63-4097-8e35-0148f8a550e9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] HTTP exception thrown: Instance c797529f-7bda-4a25-a915-a4b55051be4e could not be found. Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-36606c38-cc63-4097-8e35-0148f8a550e9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Request method failure captured: Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e HTTP/1.1 Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPP0I285xzgP1quSPWEDKcl0umeTubKUyPVeQMS3UXXieWDJ1ngtA_0UC1yFKQlA4hdQLPQoL9uRqYQ8Wa6LOuNJ7nBwiDc3AkFcdbgWk6UvlZ2Yut6SyNTXO1LRklyUbiAwmlR6z0Dbgn5I9hlEdBPGuBEQSNw0ebaHNk-qmDnD9KBo Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 2e22d6e1c9a5495b8c152d7c7e5b1aff Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-TestMinimumBasicScenario-1436608884 Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e22d6e1c9a5495b8c152d7c7e5b1aff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e22d6e1c9a5495b8c152d7c7e5b1aff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2e22d6e1c9a5495b8c152d7c7e5b1aff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2e22d6e1c9a5495b8c152d7c7e5b1aff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-TestMinimumBasicScenario-1436608884 Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 2e22d6e1c9a5495b8c152d7c7e5b1aff Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1436608884 Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-TestMinimumBasicScenario-1436608884-project Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: cf1e0670dd7341d0a2c237722f903537 Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-TestMinimumBasicScenario-1436608884-project Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance c797529f-7bda-4a25-a915-a4b55051be4e could not be found. Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'c797529f-7bda-4a25-a915-a4b55051be4e'} Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c797529f-7bda-4a25-a915-a4b55051be4e could not be found. Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c797529f-7bda-4a25-a915-a4b55051be4e could not be found. Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:49:56.552627 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:49:56.557779 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:49:56.557779 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:49:56.557779 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:49:56.557779 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:49:56.557779 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:49:56.557779 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c797529f-7bda-4a25-a915-a4b55051be4e could not be found. Oct 05 03:49:56.557779 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:49:56.557779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-36606c38-cc63-4097-8e35-0148f8a550e9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Returning 404 to user: Instance c797529f-7bda-4a25-a915-a4b55051be4e could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:49:56.557779 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-36606c38-cc63-4097-8e35-0148f8a550e9 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e" status: 404 len: 111 microversion: 2.1 time: 0.032992 Oct 05 03:49:56.557779 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3820/7654] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:49:56 2022] GET /compute/v2.1/servers/c797529f-7bda-4a25-a915-a4b55051be4e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:49:56.563061 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cf5a9116-dad5-4a59-8f60-08191a5371b5 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] Calling method '.version_select at 0x7fccdeb4b8b0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:49:56.567470 n-d-858272-3 devstack@n-api.service[122319]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cf5a9116-dad5-4a59-8f60-08191a5371b5 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [ce481bc8-1d21-44a0-a4de-d328b7ac9251] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 03:49:57.575209 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [None req-cf5a9116-dad5-4a59-8f60-08191a5371b5 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] [ce481bc8-1d21-44a0-a4de-d328b7ac9251] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 47246. Oct 05 03:49:57.596669 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cf5a9116-dad5-4a59-8f60-08191a5371b5 tempest-TestMinimumBasicScenario-1436608884 tempest-TestMinimumBasicScenario-1436608884-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1530781148" status: 202 len: 0 microversion: 2.1 time: 1.037309 Oct 05 03:49:57.597280 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3835/7655] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Oct 5 03:49:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1530781148 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:50:06.559816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=18 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:50:06.560577 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=38 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:50:06.734135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cda49a0c-1904-4e72-92f2-ff5088b8d99b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Action: 'create', calling method: .version_select at 0x7fcce82318b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1059676734", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMIHDFoYQMeKZaz+eWH13m/H/yivx0Gc26SZxeIZZMx8dz+3oHhSXyJVG737p+EsbqAP8ir/gJD7kqImByjBRGeavx9m7tn1sM4uqCUgsrUtR0WPOoUFoL6BxWRpNzYrw=="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:50:06.749914 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-cda49a0c-1904-4e72-92f2-ff5088b8d99b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Getting quotas for project c62f31970d95490d8329d9f1a2583256. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:50:06.756484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-cda49a0c-1904-4e72-92f2-ff5088b8d99b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Getting quotas for user 830bf52116814aa283b1a5d20f643682 and project c62f31970d95490d8329d9f1a2583256. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:50:06.769617 n-d-858272-3 devstack@n-api.service[122320]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cda49a0c-1904-4e72-92f2-ff5088b8d99b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [8a8df7a1-9fb5-4319-8aad-cf438823f16a] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 03:50:07.776762 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [None req-cda49a0c-1904-4e72-92f2-ff5088b8d99b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [8a8df7a1-9fb5-4319-8aad-cf438823f16a] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 47372. Oct 05 03:50:07.792500 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cda49a0c-1904-4e72-92f2-ff5088b8d99b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.238171 Oct 05 03:50:07.793162 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3821/7656] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 03:50:06 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:50:13.473127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:50:13.473805 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:50:13.478781 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-762c5c33-343a-4f2a-a2c0-85524ca9d7b2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1468117767", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "9c97eae4-dc02-4ebe-8953-8cd33bf9911a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1059676734", "security_groups": [{"name": "tempest-secgroup-smoke-1195389068"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:50:13.613819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-762c5c33-343a-4f2a-a2c0-85524ca9d7b2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] validate_networks() for [('9c97eae4-dc02-4ebe-8953-8cd33bf9911a', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:50:14.114169 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-762c5c33-343a-4f2a-a2c0-85524ca9d7b2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:50:14.114883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-762c5c33-343a-4f2a-a2c0-85524ca9d7b2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:50:14.115751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-762c5c33-343a-4f2a-a2c0-85524ca9d7b2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:50:14.116401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-762c5c33-343a-4f2a-a2c0-85524ca9d7b2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:50:14.116798 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-762c5c33-343a-4f2a-a2c0-85524ca9d7b2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:50:14.127022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-762c5c33-343a-4f2a-a2c0-85524ca9d7b2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:50:14.127022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-762c5c33-343a-4f2a-a2c0-85524ca9d7b2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:50:14.127354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-762c5c33-343a-4f2a-a2c0-85524ca9d7b2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:50:14.128150 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-762c5c33-343a-4f2a-a2c0-85524ca9d7b2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:50:14.128673 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-762c5c33-343a-4f2a-a2c0-85524ca9d7b2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:50:14.129227 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-762c5c33-343a-4f2a-a2c0-85524ca9d7b2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:50:14.148254 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-762c5c33-343a-4f2a-a2c0-85524ca9d7b2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Getting quotas for project c62f31970d95490d8329d9f1a2583256. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:50:14.153765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-762c5c33-343a-4f2a-a2c0-85524ca9d7b2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Getting quotas for user 830bf52116814aa283b1a5d20f643682 and project c62f31970d95490d8329d9f1a2583256. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:50:14.166725 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-762c5c33-343a-4f2a-a2c0-85524ca9d7b2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:50:14.169045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-762c5c33-343a-4f2a-a2c0-85524ca9d7b2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: 0fa3b454-9d2a-42eb-af04-a024f043530b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:50:14.218651 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-762c5c33-343a-4f2a-a2c0-85524ca9d7b2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.747374 Oct 05 03:50:14.219484 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3836/7657] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:50:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:50:14.232313 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b9f7bd95-7a0a-4a79-be85-9814b1078668 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:50:14.232947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b9f7bd95-7a0a-4a79-be85-9814b1078668 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: 0fa3b454-9d2a-42eb-af04-a024f043530b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:50:14.295675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b9f7bd95-7a0a-4a79-be85-9814b1078668 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:50:14.305194 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b9f7bd95-7a0a-4a79-be85-9814b1078668 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b" status: 200 len: 1267 microversion: 2.1 time: 0.078182 Oct 05 03:50:14.305996 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3822/7658] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:50:14 2022] GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b => generated 1267 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:50:15.329775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3ac6d397-19e6-428c-97f7-f2fc4bf184f6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:50:15.330399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3ac6d397-19e6-428c-97f7-f2fc4bf184f6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: 0fa3b454-9d2a-42eb-af04-a024f043530b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:50:15.340444 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3ac6d397-19e6-428c-97f7-f2fc4bf184f6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:50:15.342098 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3ac6d397-19e6-428c-97f7-f2fc4bf184f6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:50:15.342937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3ac6d397-19e6-428c-97f7-f2fc4bf184f6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:50:15.343683 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3ac6d397-19e6-428c-97f7-f2fc4bf184f6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:50:15.344161 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3ac6d397-19e6-428c-97f7-f2fc4bf184f6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:50:15.344602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3ac6d397-19e6-428c-97f7-f2fc4bf184f6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:50:15.429249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3ac6d397-19e6-428c-97f7-f2fc4bf184f6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:50:15.441724 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3ac6d397-19e6-428c-97f7-f2fc4bf184f6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b" status: 200 len: 1319 microversion: 2.1 time: 0.115800 Oct 05 03:50:15.442321 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3837/7659] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:50:15 2022] GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b => generated 1319 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:50:16.465948 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-433fe8ee-9f98-4736-b799-e129b07f33d3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:50:16.467590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-433fe8ee-9f98-4736-b799-e129b07f33d3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: 0fa3b454-9d2a-42eb-af04-a024f043530b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:50:16.469961 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 03:50:16.470356 n-d-858272-3 devstack@n-api.service[122320]: Wed Oct 5 03:50:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b (ip 10.222.0.16) !!! Oct 05 03:50:16.490126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-433fe8ee-9f98-4736-b799-e129b07f33d3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:50:16.490820 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-433fe8ee-9f98-4736-b799-e129b07f33d3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:50:16.500617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-433fe8ee-9f98-4736-b799-e129b07f33d3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:50:16.502649 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-433fe8ee-9f98-4736-b799-e129b07f33d3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:50:16.504990 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-433fe8ee-9f98-4736-b799-e129b07f33d3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:50:16.512975 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-433fe8ee-9f98-4736-b799-e129b07f33d3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:50:16.774017 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-433fe8ee-9f98-4736-b799-e129b07f33d3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:50:16.782730 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-433fe8ee-9f98-4736-b799-e129b07f33d3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b" status: 200 len: 1393 microversion: 2.1 time: 0.320698 Oct 05 03:50:16.784165 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3823/7660] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:50:16 2022] GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b => generated 1393 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:50:17.272062 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-5dbb3853-fd82-49f6-81ab-5f09601bf35c req-33b27ff1-9e94-438f-a650-61043cacfd50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fa3b454-9d2a-42eb-af04-a024f043530b", "tag": "d30aff3d-e57f-4bc8-87b5-34b4b4767882"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:50:17.282309 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5dbb3853-fd82-49f6-81ab-5f09601bf35c req-33b27ff1-9e94-438f-a650-61043cacfd50 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:50:17.282818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5dbb3853-fd82-49f6-81ab-5f09601bf35c req-33b27ff1-9e94-438f-a650-61043cacfd50 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:50:17.283243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5dbb3853-fd82-49f6-81ab-5f09601bf35c req-33b27ff1-9e94-438f-a650-61043cacfd50 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:50:17.294368 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-5dbb3853-fd82-49f6-81ab-5f09601bf35c req-33b27ff1-9e94-438f-a650-61043cacfd50 service nova] Creating event network-changed:d30aff3d-e57f-4bc8-87b5-34b4b4767882 for instance 0fa3b454-9d2a-42eb-af04-a024f043530b on n-h1-858272-3 Oct 05 03:50:17.299793 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-5dbb3853-fd82-49f6-81ab-5f09601bf35c req-33b27ff1-9e94-438f-a650-61043cacfd50 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031501 Oct 05 03:50:17.300376 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3838/7661] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:50:17.807426 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-473cce00-b758-4d46-80b6-3b83a1eaf8de tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:50:17.808056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-473cce00-b758-4d46-80b6-3b83a1eaf8de tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: 0fa3b454-9d2a-42eb-af04-a024f043530b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:50:17.815096 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-473cce00-b758-4d46-80b6-3b83a1eaf8de tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:50:17.815626 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-473cce00-b758-4d46-80b6-3b83a1eaf8de tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:50:17.816079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-473cce00-b758-4d46-80b6-3b83a1eaf8de tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:50:17.816780 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-473cce00-b758-4d46-80b6-3b83a1eaf8de tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:50:17.817286 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-473cce00-b758-4d46-80b6-3b83a1eaf8de tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:50:17.818237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-473cce00-b758-4d46-80b6-3b83a1eaf8de tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:50:18.280997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-473cce00-b758-4d46-80b6-3b83a1eaf8de tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:50:18.288877 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-473cce00-b758-4d46-80b6-3b83a1eaf8de tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b" status: 200 len: 1393 microversion: 2.1 time: 0.485421 Oct 05 03:50:18.289954 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3824/7662] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:50:17 2022] GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b => generated 1393 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:50:19.314703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0f7b4a25-4762-471b-baa2-33af9585b267 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:50:19.315441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0f7b4a25-4762-471b-baa2-33af9585b267 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: 0fa3b454-9d2a-42eb-af04-a024f043530b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:50:19.322193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0f7b4a25-4762-471b-baa2-33af9585b267 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:50:19.322680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0f7b4a25-4762-471b-baa2-33af9585b267 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:50:19.323117 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0f7b4a25-4762-471b-baa2-33af9585b267 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:50:19.323802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0f7b4a25-4762-471b-baa2-33af9585b267 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:50:19.324256 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0f7b4a25-4762-471b-baa2-33af9585b267 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:50:19.324681 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0f7b4a25-4762-471b-baa2-33af9585b267 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:50:19.454855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0f7b4a25-4762-471b-baa2-33af9585b267 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:50:19.463178 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0f7b4a25-4762-471b-baa2-33af9585b267 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b" status: 200 len: 1393 microversion: 2.1 time: 0.153519 Oct 05 03:50:19.463754 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3839/7663] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:50:19 2022] GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:50:20.486251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-85902ce6-632d-4d07-a965-de1c6815a35b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:50:20.486842 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-85902ce6-632d-4d07-a965-de1c6815a35b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: 0fa3b454-9d2a-42eb-af04-a024f043530b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:50:20.494139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85902ce6-632d-4d07-a965-de1c6815a35b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:50:20.494637 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85902ce6-632d-4d07-a965-de1c6815a35b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:50:20.495085 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85902ce6-632d-4d07-a965-de1c6815a35b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:50:20.495772 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85902ce6-632d-4d07-a965-de1c6815a35b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:50:20.496237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85902ce6-632d-4d07-a965-de1c6815a35b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:50:20.496668 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-85902ce6-632d-4d07-a965-de1c6815a35b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:50:20.630309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-85902ce6-632d-4d07-a965-de1c6815a35b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:50:20.637851 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-85902ce6-632d-4d07-a965-de1c6815a35b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b" status: 200 len: 1393 microversion: 2.1 time: 0.155509 Oct 05 03:50:20.638434 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3825/7664] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:50:20 2022] GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:50:21.661665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7000ba7f-b285-45ad-b8a0-a86b3d693552 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:50:21.662438 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7000ba7f-b285-45ad-b8a0-a86b3d693552 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: 0fa3b454-9d2a-42eb-af04-a024f043530b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:50:21.669414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7000ba7f-b285-45ad-b8a0-a86b3d693552 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:50:21.669900 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7000ba7f-b285-45ad-b8a0-a86b3d693552 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:50:21.670339 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7000ba7f-b285-45ad-b8a0-a86b3d693552 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:50:21.671042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7000ba7f-b285-45ad-b8a0-a86b3d693552 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:50:21.671495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7000ba7f-b285-45ad-b8a0-a86b3d693552 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:50:21.671921 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7000ba7f-b285-45ad-b8a0-a86b3d693552 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:50:22.087610 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7000ba7f-b285-45ad-b8a0-a86b3d693552 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:50:22.096683 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7000ba7f-b285-45ad-b8a0-a86b3d693552 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b" status: 200 len: 1393 microversion: 2.1 time: 0.439586 Oct 05 03:50:22.097375 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3840/7665] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:50:21 2022] GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b => generated 1393 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:50:23.120282 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-191b1eea-5ba3-4872-971a-49f25ee1426d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:50:23.121012 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-191b1eea-5ba3-4872-971a-49f25ee1426d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: 0fa3b454-9d2a-42eb-af04-a024f043530b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:50:23.127839 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-191b1eea-5ba3-4872-971a-49f25ee1426d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:50:23.128338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-191b1eea-5ba3-4872-971a-49f25ee1426d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:50:23.128789 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-191b1eea-5ba3-4872-971a-49f25ee1426d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:50:23.129521 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-191b1eea-5ba3-4872-971a-49f25ee1426d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:50:23.129993 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-191b1eea-5ba3-4872-971a-49f25ee1426d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:50:23.130505 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-191b1eea-5ba3-4872-971a-49f25ee1426d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:50:23.277842 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-191b1eea-5ba3-4872-971a-49f25ee1426d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:50:23.285440 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-191b1eea-5ba3-4872-971a-49f25ee1426d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b" status: 200 len: 1393 microversion: 2.1 time: 0.169036 Oct 05 03:50:23.295639 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3826/7666] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:50:23 2022] GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:50:23.320541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-bedbdd3f-a177-405c-af5f-9b5f15a7f941 req-bc802b99-1e72-4603-a27b-37f769be2155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fa3b454-9d2a-42eb-af04-a024f043530b", "name": "network-vif-plugged", "status": "completed", "tag": "d30aff3d-e57f-4bc8-87b5-34b4b4767882"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:50:23.331038 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-bedbdd3f-a177-405c-af5f-9b5f15a7f941 req-bc802b99-1e72-4603-a27b-37f769be2155 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:50:23.331549 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-bedbdd3f-a177-405c-af5f-9b5f15a7f941 req-bc802b99-1e72-4603-a27b-37f769be2155 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:50:23.331967 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-bedbdd3f-a177-405c-af5f-9b5f15a7f941 req-bc802b99-1e72-4603-a27b-37f769be2155 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:50:23.343984 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-bedbdd3f-a177-405c-af5f-9b5f15a7f941 req-bc802b99-1e72-4603-a27b-37f769be2155 service nova] Creating event network-vif-plugged:d30aff3d-e57f-4bc8-87b5-34b4b4767882 for instance 0fa3b454-9d2a-42eb-af04-a024f043530b on n-h1-858272-3 Oct 05 03:50:23.349694 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-bedbdd3f-a177-405c-af5f-9b5f15a7f941 req-bc802b99-1e72-4603-a27b-37f769be2155 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032340 Oct 05 03:50:23.350619 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3841/7667] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:50:24.310378 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5106d7ad-9fcb-404a-baf8-a9696552592b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:50:24.311011 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5106d7ad-9fcb-404a-baf8-a9696552592b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: 0fa3b454-9d2a-42eb-af04-a024f043530b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:50:24.313795 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:50:24.320140 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5106d7ad-9fcb-404a-baf8-a9696552592b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:50:24.320646 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5106d7ad-9fcb-404a-baf8-a9696552592b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:50:24.321128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5106d7ad-9fcb-404a-baf8-a9696552592b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:50:24.321845 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5106d7ad-9fcb-404a-baf8-a9696552592b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:50:24.322317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5106d7ad-9fcb-404a-baf8-a9696552592b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:50:24.322785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5106d7ad-9fcb-404a-baf8-a9696552592b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:50:24.453568 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5106d7ad-9fcb-404a-baf8-a9696552592b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:50:24.461599 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5106d7ad-9fcb-404a-baf8-a9696552592b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b" status: 200 len: 1393 microversion: 2.1 time: 0.155152 Oct 05 03:50:24.462184 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3827/7668] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:50:24 2022] GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:50:25.485578 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1acdba1a-c7ff-4a16-b32d-a38c8f9430f0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:50:25.486190 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1acdba1a-c7ff-4a16-b32d-a38c8f9430f0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: 0fa3b454-9d2a-42eb-af04-a024f043530b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:50:25.488221 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:50:25.488888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:50:25.499493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1acdba1a-c7ff-4a16-b32d-a38c8f9430f0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:50:25.499493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1acdba1a-c7ff-4a16-b32d-a38c8f9430f0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:50:25.499493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1acdba1a-c7ff-4a16-b32d-a38c8f9430f0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:50:25.499493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1acdba1a-c7ff-4a16-b32d-a38c8f9430f0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:50:25.499493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1acdba1a-c7ff-4a16-b32d-a38c8f9430f0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:50:25.499493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1acdba1a-c7ff-4a16-b32d-a38c8f9430f0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:50:25.638813 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1acdba1a-c7ff-4a16-b32d-a38c8f9430f0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:50:25.646673 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1acdba1a-c7ff-4a16-b32d-a38c8f9430f0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b" status: 200 len: 1566 microversion: 2.1 time: 0.165622 Oct 05 03:50:25.647243 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3842/7669] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:50:25 2022] GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:50:25.668835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c19d128a-1481-4cac-a00c-96c1fff065c7 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:50:25.669495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c19d128a-1481-4cac-a00c-96c1fff065c7 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: 0fa3b454-9d2a-42eb-af04-a024f043530b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:50:25.676340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c19d128a-1481-4cac-a00c-96c1fff065c7 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:50:25.677377 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c19d128a-1481-4cac-a00c-96c1fff065c7 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:50:25.677985 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c19d128a-1481-4cac-a00c-96c1fff065c7 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:50:25.678687 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c19d128a-1481-4cac-a00c-96c1fff065c7 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:50:25.679162 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c19d128a-1481-4cac-a00c-96c1fff065c7 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:50:25.679599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c19d128a-1481-4cac-a00c-96c1fff065c7 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:50:25.807997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c19d128a-1481-4cac-a00c-96c1fff065c7 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:50:25.815742 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c19d128a-1481-4cac-a00c-96c1fff065c7 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b" status: 200 len: 1566 microversion: 2.1 time: 0.150748 Oct 05 03:50:25.816322 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3828/7670] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:50:25 2022] GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:50:27.408852 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0deb9592-f13a-4681-890c-bc04141f2169 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:50:27.409603 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0deb9592-f13a-4681-890c-bc04141f2169 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: 0fa3b454-9d2a-42eb-af04-a024f043530b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:50:27.411801 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-d25885a2-b1c6-4b7d-9b46-05a09c5f801e req-ce1cea69-192f-489c-b129-3fc83bbbbbc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fa3b454-9d2a-42eb-af04-a024f043530b", "tag": "d30aff3d-e57f-4bc8-87b5-34b4b4767882"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:50:27.417095 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0deb9592-f13a-4681-890c-bc04141f2169 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:50:27.417949 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0deb9592-f13a-4681-890c-bc04141f2169 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:50:27.418395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0deb9592-f13a-4681-890c-bc04141f2169 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:50:27.419119 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0deb9592-f13a-4681-890c-bc04141f2169 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:50:27.419742 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0deb9592-f13a-4681-890c-bc04141f2169 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:50:27.420171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0deb9592-f13a-4681-890c-bc04141f2169 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:50:27.423102 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d25885a2-b1c6-4b7d-9b46-05a09c5f801e req-ce1cea69-192f-489c-b129-3fc83bbbbbc9 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:50:27.423609 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d25885a2-b1c6-4b7d-9b46-05a09c5f801e req-ce1cea69-192f-489c-b129-3fc83bbbbbc9 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:50:27.424090 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-d25885a2-b1c6-4b7d-9b46-05a09c5f801e req-ce1cea69-192f-489c-b129-3fc83bbbbbc9 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:50:27.436681 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-d25885a2-b1c6-4b7d-9b46-05a09c5f801e req-ce1cea69-192f-489c-b129-3fc83bbbbbc9 service nova] Creating event network-changed:d30aff3d-e57f-4bc8-87b5-34b4b4767882 for instance 0fa3b454-9d2a-42eb-af04-a024f043530b on n-h1-858272-3 Oct 05 03:50:27.442153 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-d25885a2-b1c6-4b7d-9b46-05a09c5f801e req-ce1cea69-192f-489c-b129-3fc83bbbbbc9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034534 Oct 05 03:50:27.443193 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3829/7671] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:50:27.643742 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0deb9592-f13a-4681-890c-bc04141f2169 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:50:27.656704 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0deb9592-f13a-4681-890c-bc04141f2169 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b" status: 200 len: 1566 microversion: 2.1 time: 0.251922 Oct 05 03:50:27.678539 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3843/7672] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:50:27 2022] GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b => generated 1566 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:51:00.991771 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:51:00.992539 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=38 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:51:00.997240 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-feb5f5bc-4ab6-49ef-8331-840a0ca297b4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:51:00.999532 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-feb5f5bc-4ab6-49ef-8331-840a0ca297b4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: 0fa3b454-9d2a-42eb-af04-a024f043530b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:51:01.008054 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-feb5f5bc-4ab6-49ef-8331-840a0ca297b4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:01.008565 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-feb5f5bc-4ab6-49ef-8331-840a0ca297b4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:01.009048 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-feb5f5bc-4ab6-49ef-8331-840a0ca297b4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:01.009755 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-feb5f5bc-4ab6-49ef-8331-840a0ca297b4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:01.010221 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-feb5f5bc-4ab6-49ef-8331-840a0ca297b4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:01.010657 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-feb5f5bc-4ab6-49ef-8331-840a0ca297b4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:01.077922 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-feb5f5bc-4ab6-49ef-8331-840a0ca297b4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "POST /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b/action" status: 200 len: 24570 microversion: 2.1 time: 0.088310 Oct 05 03:51:01.078741 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3830/7673] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:51:00 2022] POST /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b/action => generated 24570 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 03:51:31.503048 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:51:31.503805 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=36 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:51:31.508278 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-28aa1656-b157-4c07-8cb4-b5ccffa927f0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:51:31.508889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-28aa1656-b157-4c07-8cb4-b5ccffa927f0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: 0fa3b454-9d2a-42eb-af04-a024f043530b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:51:31.516658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28aa1656-b157-4c07-8cb4-b5ccffa927f0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:31.517177 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28aa1656-b157-4c07-8cb4-b5ccffa927f0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:31.517621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28aa1656-b157-4c07-8cb4-b5ccffa927f0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:31.518320 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28aa1656-b157-4c07-8cb4-b5ccffa927f0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:31.518781 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28aa1656-b157-4c07-8cb4-b5ccffa927f0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:31.519237 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-28aa1656-b157-4c07-8cb4-b5ccffa927f0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:31.584876 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-28aa1656-b157-4c07-8cb4-b5ccffa927f0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "POST /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b/action" status: 202 len: 0 microversion: 2.1 time: 0.083493 Oct 05 03:51:31.585564 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3844/7674] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:51:31 2022] POST /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:51:31.594796 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8fa594f7-10e6-4101-b9c2-ed89aef79328 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:51:31.595373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8fa594f7-10e6-4101-b9c2-ed89aef79328 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: 0fa3b454-9d2a-42eb-af04-a024f043530b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:51:31.598417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:51:31.599143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:51:31.607356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8fa594f7-10e6-4101-b9c2-ed89aef79328 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:31.608230 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8fa594f7-10e6-4101-b9c2-ed89aef79328 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:31.608690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8fa594f7-10e6-4101-b9c2-ed89aef79328 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:31.609479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8fa594f7-10e6-4101-b9c2-ed89aef79328 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:31.610064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8fa594f7-10e6-4101-b9c2-ed89aef79328 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:31.610510 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8fa594f7-10e6-4101-b9c2-ed89aef79328 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:31.751832 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-8fa594f7-10e6-4101-b9c2-ed89aef79328 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:51:31.763964 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8fa594f7-10e6-4101-b9c2-ed89aef79328 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b" status: 200 len: 1690 microversion: 2.1 time: 0.173575 Oct 05 03:51:31.764478 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3831/7675] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:51:31 2022] GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:51:32.788784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5e9d82e7-fc56-4dbe-a7a5-7f16d1300938 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:51:32.789536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5e9d82e7-fc56-4dbe-a7a5-7f16d1300938 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: 0fa3b454-9d2a-42eb-af04-a024f043530b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:51:32.797487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e9d82e7-fc56-4dbe-a7a5-7f16d1300938 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:32.797979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e9d82e7-fc56-4dbe-a7a5-7f16d1300938 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:32.798422 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e9d82e7-fc56-4dbe-a7a5-7f16d1300938 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:32.799116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e9d82e7-fc56-4dbe-a7a5-7f16d1300938 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:32.799573 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e9d82e7-fc56-4dbe-a7a5-7f16d1300938 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:32.800001 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e9d82e7-fc56-4dbe-a7a5-7f16d1300938 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:32.931449 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5e9d82e7-fc56-4dbe-a7a5-7f16d1300938 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:51:32.939572 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5e9d82e7-fc56-4dbe-a7a5-7f16d1300938 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b" status: 200 len: 1670 microversion: 2.1 time: 0.154871 Oct 05 03:51:32.940148 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3845/7676] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:51:32 2022] GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:51:34.038082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8aa2e642-b5f8-4085-b181-95eee997a4a8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:51:34.041013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8aa2e642-b5f8-4085-b181-95eee997a4a8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: 0fa3b454-9d2a-42eb-af04-a024f043530b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:51:34.048718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8aa2e642-b5f8-4085-b181-95eee997a4a8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:34.049256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8aa2e642-b5f8-4085-b181-95eee997a4a8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:34.049712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8aa2e642-b5f8-4085-b181-95eee997a4a8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:34.050429 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8aa2e642-b5f8-4085-b181-95eee997a4a8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:34.050914 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8aa2e642-b5f8-4085-b181-95eee997a4a8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:34.051361 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8aa2e642-b5f8-4085-b181-95eee997a4a8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:34.120143 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8aa2e642-b5f8-4085-b181-95eee997a4a8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "POST /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b/action" status: 200 len: 32641 microversion: 2.1 time: 0.085416 Oct 05 03:51:34.121285 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3832/7677] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:51:34 2022] POST /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b/action => generated 32641 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 03:51:34.132858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-aad4f334-5993-4775-b98c-4a3ae15f340e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:51:34.133462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-aad4f334-5993-4775-b98c-4a3ae15f340e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: 0fa3b454-9d2a-42eb-af04-a024f043530b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:51:34.140460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aad4f334-5993-4775-b98c-4a3ae15f340e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:34.140984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aad4f334-5993-4775-b98c-4a3ae15f340e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:34.141429 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aad4f334-5993-4775-b98c-4a3ae15f340e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:34.142134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aad4f334-5993-4775-b98c-4a3ae15f340e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:34.142598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aad4f334-5993-4775-b98c-4a3ae15f340e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:34.143030 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aad4f334-5993-4775-b98c-4a3ae15f340e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:34.210935 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-aad4f334-5993-4775-b98c-4a3ae15f340e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "POST /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b/action" status: 202 len: 0 microversion: 2.1 time: 0.081913 Oct 05 03:51:34.213792 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3846/7678] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:51:34 2022] POST /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:51:34.220403 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-75fce6bb-af70-4ffa-8ea6-5b87f260f29c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:51:34.221177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-75fce6bb-af70-4ffa-8ea6-5b87f260f29c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: 0fa3b454-9d2a-42eb-af04-a024f043530b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:51:34.228445 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75fce6bb-af70-4ffa-8ea6-5b87f260f29c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:34.229137 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75fce6bb-af70-4ffa-8ea6-5b87f260f29c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:34.229593 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75fce6bb-af70-4ffa-8ea6-5b87f260f29c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:34.230305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75fce6bb-af70-4ffa-8ea6-5b87f260f29c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:34.230793 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75fce6bb-af70-4ffa-8ea6-5b87f260f29c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:34.231234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75fce6bb-af70-4ffa-8ea6-5b87f260f29c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:34.365566 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-75fce6bb-af70-4ffa-8ea6-5b87f260f29c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:51:34.374171 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-75fce6bb-af70-4ffa-8ea6-5b87f260f29c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b" status: 200 len: 1677 microversion: 2.1 time: 0.157928 Oct 05 03:51:34.374745 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3833/7679] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:51:34 2022] GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:51:35.401832 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8c9a59db-1fb9-42b3-9e4e-b76fdbd7a108 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:51:35.402531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8c9a59db-1fb9-42b3-9e4e-b76fdbd7a108 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: 0fa3b454-9d2a-42eb-af04-a024f043530b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:51:35.408762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c9a59db-1fb9-42b3-9e4e-b76fdbd7a108 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:35.409286 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c9a59db-1fb9-42b3-9e4e-b76fdbd7a108 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:35.409724 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c9a59db-1fb9-42b3-9e4e-b76fdbd7a108 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:35.410420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c9a59db-1fb9-42b3-9e4e-b76fdbd7a108 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:35.410876 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c9a59db-1fb9-42b3-9e4e-b76fdbd7a108 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:35.411299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8c9a59db-1fb9-42b3-9e4e-b76fdbd7a108 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:35.546295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8c9a59db-1fb9-42b3-9e4e-b76fdbd7a108 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:51:35.554098 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8c9a59db-1fb9-42b3-9e4e-b76fdbd7a108 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b" status: 200 len: 1685 microversion: 2.1 time: 0.158234 Oct 05 03:51:35.554667 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3847/7680] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:51:35 2022] GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:51:35.657325 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9046b726-c169-4126-8f8a-98f673864a2c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:51:35.659543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9046b726-c169-4126-8f8a-98f673864a2c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: 0fa3b454-9d2a-42eb-af04-a024f043530b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:51:35.667971 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9046b726-c169-4126-8f8a-98f673864a2c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:35.668480 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9046b726-c169-4126-8f8a-98f673864a2c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:35.668964 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9046b726-c169-4126-8f8a-98f673864a2c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:35.669680 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9046b726-c169-4126-8f8a-98f673864a2c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:35.670155 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9046b726-c169-4126-8f8a-98f673864a2c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:35.670598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9046b726-c169-4126-8f8a-98f673864a2c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:35.732516 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9046b726-c169-4126-8f8a-98f673864a2c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "POST /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b/action" status: 200 len: 36602 microversion: 2.1 time: 0.081284 Oct 05 03:51:35.733387 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3834/7681] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:51:35 2022] POST /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b/action => generated 36602 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 03:51:36.754652 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5748064c-82e2-4552-842a-06b42984c6d7 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:51:36.760218 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-e0acdfb8-66f3-4612-bdf6-46e72275048e req-ed85f3b3-1b0b-45c5-8297-7cd26ae8a5e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fa3b454-9d2a-42eb-af04-a024f043530b", "tag": "d30aff3d-e57f-4bc8-87b5-34b4b4767882"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:51:36.761538 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5748064c-82e2-4552-842a-06b42984c6d7 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: 0fa3b454-9d2a-42eb-af04-a024f043530b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:51:36.768808 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5748064c-82e2-4552-842a-06b42984c6d7 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:36.769359 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5748064c-82e2-4552-842a-06b42984c6d7 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:36.769801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5748064c-82e2-4552-842a-06b42984c6d7 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:36.770665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5748064c-82e2-4552-842a-06b42984c6d7 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:36.771126 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5748064c-82e2-4552-842a-06b42984c6d7 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:36.771849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5748064c-82e2-4552-842a-06b42984c6d7 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:36.776299 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e0acdfb8-66f3-4612-bdf6-46e72275048e req-ed85f3b3-1b0b-45c5-8297-7cd26ae8a5e3 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:36.776882 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e0acdfb8-66f3-4612-bdf6-46e72275048e req-ed85f3b3-1b0b-45c5-8297-7cd26ae8a5e3 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:36.777423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e0acdfb8-66f3-4612-bdf6-46e72275048e req-ed85f3b3-1b0b-45c5-8297-7cd26ae8a5e3 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:36.789329 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-e0acdfb8-66f3-4612-bdf6-46e72275048e req-ed85f3b3-1b0b-45c5-8297-7cd26ae8a5e3 service nova] Creating event network-changed:d30aff3d-e57f-4bc8-87b5-34b4b4767882 for instance 0fa3b454-9d2a-42eb-af04-a024f043530b on n-h1-858272-3 Oct 05 03:51:36.795120 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-e0acdfb8-66f3-4612-bdf6-46e72275048e req-ed85f3b3-1b0b-45c5-8297-7cd26ae8a5e3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038841 Oct 05 03:51:36.796058 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3835/7682] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:51:36.800077 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5748064c-82e2-4552-842a-06b42984c6d7 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: 0fa3b454-9d2a-42eb-af04-a024f043530b] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:51:36.888328 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5748064c-82e2-4552-842a-06b42984c6d7 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b" status: 204 len: 0 microversion: 2.1 time: 0.136624 Oct 05 03:51:36.889193 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3848/7683] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:51:36 2022] DELETE /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:51:36.898501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e16d48c3-604b-437c-992a-3090d5e21ed8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:51:36.899269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e16d48c3-604b-437c-992a-3090d5e21ed8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: 0fa3b454-9d2a-42eb-af04-a024f043530b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:51:36.905858 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e16d48c3-604b-437c-992a-3090d5e21ed8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:36.906611 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e16d48c3-604b-437c-992a-3090d5e21ed8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:36.907069 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e16d48c3-604b-437c-992a-3090d5e21ed8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:36.907774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e16d48c3-604b-437c-992a-3090d5e21ed8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:36.908241 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e16d48c3-604b-437c-992a-3090d5e21ed8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:36.908682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e16d48c3-604b-437c-992a-3090d5e21ed8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:37.052742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e16d48c3-604b-437c-992a-3090d5e21ed8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:51:37.061389 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e16d48c3-604b-437c-992a-3090d5e21ed8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b" status: 200 len: 1691 microversion: 2.1 time: 0.167600 Oct 05 03:51:37.061970 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3836/7684] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:51:36 2022] GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:51:38.085592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ce172c5c-f411-49b6-ac81-2178b76f84ae tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:51:38.086299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ce172c5c-f411-49b6-ac81-2178b76f84ae tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: 0fa3b454-9d2a-42eb-af04-a024f043530b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:51:38.093985 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce172c5c-f411-49b6-ac81-2178b76f84ae tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:38.094473 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce172c5c-f411-49b6-ac81-2178b76f84ae tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:38.094911 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce172c5c-f411-49b6-ac81-2178b76f84ae tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:38.095608 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce172c5c-f411-49b6-ac81-2178b76f84ae tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:38.096063 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce172c5c-f411-49b6-ac81-2178b76f84ae tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:38.096489 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce172c5c-f411-49b6-ac81-2178b76f84ae tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:38.288798 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ce172c5c-f411-49b6-ac81-2178b76f84ae tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:51:38.296960 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ce172c5c-f411-49b6-ac81-2178b76f84ae tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b" status: 200 len: 1691 microversion: 2.1 time: 0.215651 Oct 05 03:51:38.297537 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3849/7685] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:51:38 2022] GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b => generated 1691 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:51:39.321961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-25614ed8-2b1c-4032-ad40-61c8aac7ccf0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:51:39.323216 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-25614ed8-2b1c-4032-ad40-61c8aac7ccf0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: 0fa3b454-9d2a-42eb-af04-a024f043530b] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:51:39.331806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25614ed8-2b1c-4032-ad40-61c8aac7ccf0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:39.332560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25614ed8-2b1c-4032-ad40-61c8aac7ccf0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:39.333296 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25614ed8-2b1c-4032-ad40-61c8aac7ccf0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:39.334434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25614ed8-2b1c-4032-ad40-61c8aac7ccf0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:39.335561 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25614ed8-2b1c-4032-ad40-61c8aac7ccf0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:39.336581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25614ed8-2b1c-4032-ad40-61c8aac7ccf0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:39.412491 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-d6a608c0-8ee2-481f-8f56-ba12bc259fdc req-4e361aac-9668-46bb-9ce7-ee8caa8492f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fa3b454-9d2a-42eb-af04-a024f043530b", "name": "network-vif-deleted", "tag": "d30aff3d-e57f-4bc8-87b5-34b4b4767882"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:51:39.423567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d6a608c0-8ee2-481f-8f56-ba12bc259fdc req-4e361aac-9668-46bb-9ce7-ee8caa8492f9 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:39.424084 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d6a608c0-8ee2-481f-8f56-ba12bc259fdc req-4e361aac-9668-46bb-9ce7-ee8caa8492f9 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:39.424515 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-d6a608c0-8ee2-481f-8f56-ba12bc259fdc req-4e361aac-9668-46bb-9ce7-ee8caa8492f9 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:39.436863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-25614ed8-2b1c-4032-ad40-61c8aac7ccf0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:51:39.437236 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-d6a608c0-8ee2-481f-8f56-ba12bc259fdc req-4e361aac-9668-46bb-9ce7-ee8caa8492f9 service nova] Creating event network-vif-deleted:d30aff3d-e57f-4bc8-87b5-34b4b4767882 for instance 0fa3b454-9d2a-42eb-af04-a024f043530b on n-h1-858272-3 Oct 05 03:51:39.442328 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-d6a608c0-8ee2-481f-8f56-ba12bc259fdc req-4e361aac-9668-46bb-9ce7-ee8caa8492f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033746 Oct 05 03:51:39.442961 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3850/7686] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:51:39.447879 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-25614ed8-2b1c-4032-ad40-61c8aac7ccf0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b" status: 200 len: 1504 microversion: 2.1 time: 0.129205 Oct 05 03:51:39.448711 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3837/7687] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:51:39 2022] GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b => generated 1504 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:51:40.474586 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cd40a4bb-958a-4dd3-83e0-24d5a7dd4e35 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:51:40.475327 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cd40a4bb-958a-4dd3-83e0-24d5a7dd4e35 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: 0fa3b454-9d2a-42eb-af04-a024f043530b] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:51:40.481518 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd40a4bb-958a-4dd3-83e0-24d5a7dd4e35 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:40.482282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd40a4bb-958a-4dd3-83e0-24d5a7dd4e35 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:40.482719 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd40a4bb-958a-4dd3-83e0-24d5a7dd4e35 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:40.483408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd40a4bb-958a-4dd3-83e0-24d5a7dd4e35 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:40.483862 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd40a4bb-958a-4dd3-83e0-24d5a7dd4e35 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:40.484292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cd40a4bb-958a-4dd3-83e0-24d5a7dd4e35 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:40.498019 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-cd40a4bb-958a-4dd3-83e0-24d5a7dd4e35 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] HTTP exception thrown: Instance 0fa3b454-9d2a-42eb-af04-a024f043530b could not be found. Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cd40a4bb-958a-4dd3-83e0-24d5a7dd4e35 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Request method failure captured: Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b HTTP/1.1 Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPP7t75QoFC_cP5HwioD_odBrlcEgV1-V5Rs5FLCvkADbW5MpREEMSMdghaEC_Y9GJl526rfMTWs_KEbVUknAzYVkt8erJl73U2sRPdQb-PAjHyVtgAOdx-oxTvsCWduFNaqBjuDJ_DOf4K2FkPK6jN6v3nnTQojPxC3Z_RoZ9eVHZz8 Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: c62f31970d95490d8329d9f1a2583256 Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-530340361 Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c62f31970d95490d8329d9f1a2583256"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c62f31970d95490d8329d9f1a2583256"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c62f31970d95490d8329d9f1a2583256"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c62f31970d95490d8329d9f1a2583256"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TestNetworkAdvancedServerOps-530340361 Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: c62f31970d95490d8329d9f1a2583256 Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-530340361 Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TestNetworkAdvancedServerOps-530340361-project Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 830bf52116814aa283b1a5d20f643682 Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TestNetworkAdvancedServerOps-530340361-project Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 0fa3b454-9d2a-42eb-af04-a024f043530b could not be found. Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '0fa3b454-9d2a-42eb-af04-a024f043530b'} Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fa3b454-9d2a-42eb-af04-a024f043530b could not be found. Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fa3b454-9d2a-42eb-af04-a024f043530b could not be found. Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:51:40.499632 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:51:40.504841 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:51:40.504841 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:51:40.504841 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:51:40.504841 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:51:40.504841 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:51:40.504841 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:51:40.504841 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fa3b454-9d2a-42eb-af04-a024f043530b could not be found. Oct 05 03:51:40.504841 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:51:40.504841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cd40a4bb-958a-4dd3-83e0-24d5a7dd4e35 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Returning 404 to user: Instance 0fa3b454-9d2a-42eb-af04-a024f043530b could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:51:40.504841 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cd40a4bb-958a-4dd3-83e0-24d5a7dd4e35 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b" status: 404 len: 111 microversion: 2.1 time: 0.031566 Oct 05 03:51:40.504841 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3851/7688] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:51:40 2022] GET /compute/v2.1/servers/0fa3b454-9d2a-42eb-af04-a024f043530b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:51:43.882479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d4b4b1e0-cf90-44d7-a4f0-a6c4ffbe41bb tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '.version_select at 0x7fccdf265310>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:51:43.903397 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d4b4b1e0-cf90-44d7-a4f0-a6c4ffbe41bb tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1059676734" status: 202 len: 0 microversion: 2.1 time: 0.024965 Oct 05 03:51:43.903989 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3838/7689] 10.222.0.16 () {58 vars in 1284 bytes} [Wed Oct 5 03:51:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1059676734 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:51:43.931136 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-638a83d2-6128-4e1d-860b-fe4270ea6b30 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Action: 'create', calling method: .version_select at 0x7fccde9c0940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1689346674", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKS1U3T4gv3nnzIXEk2CUp9UZwwDIFrkGqx8SRGEYc1W/337+vRJk93f4J4ylxHj9jluZYZqAYvoyyfuqxe9RKy66cx2q4oNT870FVchWyGyIxgfweplXX5sW39uXAAhwQ=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:51:43.948823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-638a83d2-6128-4e1d-860b-fe4270ea6b30 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Getting quotas for project c62f31970d95490d8329d9f1a2583256. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:51:43.954790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-638a83d2-6128-4e1d-860b-fe4270ea6b30 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Getting quotas for user 830bf52116814aa283b1a5d20f643682 and project c62f31970d95490d8329d9f1a2583256. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:51:43.979281 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-638a83d2-6128-4e1d-860b-fe4270ea6b30 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052759 Oct 05 03:51:43.980067 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3852/7690] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 03:51:43 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:51:49.453840 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=34 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:51:49.458573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f8f807ea-41e3-4b68-834b-605f5487be81 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-784552664", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "8b26031c-31ec-491b-b293-408499ac1954"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1689346674", "security_groups": [{"name": "tempest-secgroup-smoke-1187809932"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:51:49.588511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-f8f807ea-41e3-4b68-834b-605f5487be81 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] validate_networks() for [('8b26031c-31ec-491b-b293-408499ac1954', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:51:50.003605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-f8f807ea-41e3-4b68-834b-605f5487be81 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:51:50.003793 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-f8f807ea-41e3-4b68-834b-605f5487be81 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:51:50.004808 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-f8f807ea-41e3-4b68-834b-605f5487be81 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:51:50.005462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-f8f807ea-41e3-4b68-834b-605f5487be81 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:51:50.014897 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-f8f807ea-41e3-4b68-834b-605f5487be81 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:51:50.042273 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8f807ea-41e3-4b68-834b-605f5487be81 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:50.042823 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8f807ea-41e3-4b68-834b-605f5487be81 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:50.043545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8f807ea-41e3-4b68-834b-605f5487be81 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:50.044511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8f807ea-41e3-4b68-834b-605f5487be81 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:50.045018 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8f807ea-41e3-4b68-834b-605f5487be81 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:50.045473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f8f807ea-41e3-4b68-834b-605f5487be81 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:50.083776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-f8f807ea-41e3-4b68-834b-605f5487be81 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Getting quotas for project c62f31970d95490d8329d9f1a2583256. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:51:50.090764 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-f8f807ea-41e3-4b68-834b-605f5487be81 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Getting quotas for user 830bf52116814aa283b1a5d20f643682 and project c62f31970d95490d8329d9f1a2583256. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:51:50.104829 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f8f807ea-41e3-4b68-834b-605f5487be81 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:51:50.107667 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f8f807ea-41e3-4b68-834b-605f5487be81 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: b93c9f56-fc17-4e93-b6a8-bc57b18402a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:51:50.185236 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f8f807ea-41e3-4b68-834b-605f5487be81 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.732958 Oct 05 03:51:50.185905 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3839/7691] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:51:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:51:50.198263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b8df515f-7294-4107-8826-4ee58125e04e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:51:50.199480 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b8df515f-7294-4107-8826-4ee58125e04e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: b93c9f56-fc17-4e93-b6a8-bc57b18402a5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:51:50.282178 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b8df515f-7294-4107-8826-4ee58125e04e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:51:50.294861 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b8df515f-7294-4107-8826-4ee58125e04e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5" status: 200 len: 1266 microversion: 2.1 time: 0.101298 Oct 05 03:51:50.296073 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3853/7692] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:51:50 2022] GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5 => generated 1266 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:51:51.323944 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-64f6e0e5-128a-4ca3-8a2b-4ff6c9b70674 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:51:51.324571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-64f6e0e5-128a-4ca3-8a2b-4ff6c9b70674 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: b93c9f56-fc17-4e93-b6a8-bc57b18402a5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:51:51.331520 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64f6e0e5-128a-4ca3-8a2b-4ff6c9b70674 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:51.332019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64f6e0e5-128a-4ca3-8a2b-4ff6c9b70674 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:51.332465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64f6e0e5-128a-4ca3-8a2b-4ff6c9b70674 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:51.333192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64f6e0e5-128a-4ca3-8a2b-4ff6c9b70674 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:51.333660 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64f6e0e5-128a-4ca3-8a2b-4ff6c9b70674 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:51.334091 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64f6e0e5-128a-4ca3-8a2b-4ff6c9b70674 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:51.409623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-64f6e0e5-128a-4ca3-8a2b-4ff6c9b70674 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:51:51.418260 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-64f6e0e5-128a-4ca3-8a2b-4ff6c9b70674 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5" status: 200 len: 1318 microversion: 2.1 time: 0.099316 Oct 05 03:51:51.419163 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3840/7693] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:51:51 2022] GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5 => generated 1318 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:51:52.444785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fd6ab639-ce0d-4b53-a439-56f20e3bc5ee tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:51:52.445736 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fd6ab639-ce0d-4b53-a439-56f20e3bc5ee tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: b93c9f56-fc17-4e93-b6a8-bc57b18402a5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:51:52.453056 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:51:52.456086 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fd6ab639-ce0d-4b53-a439-56f20e3bc5ee tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:52.457196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fd6ab639-ce0d-4b53-a439-56f20e3bc5ee tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:52.458024 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fd6ab639-ce0d-4b53-a439-56f20e3bc5ee tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:52.458960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fd6ab639-ce0d-4b53-a439-56f20e3bc5ee tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:52.459617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fd6ab639-ce0d-4b53-a439-56f20e3bc5ee tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:52.460242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fd6ab639-ce0d-4b53-a439-56f20e3bc5ee tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:52.721219 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fd6ab639-ce0d-4b53-a439-56f20e3bc5ee tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:51:52.735659 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fd6ab639-ce0d-4b53-a439-56f20e3bc5ee tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5" status: 200 len: 1392 microversion: 2.1 time: 0.295841 Oct 05 03:51:52.736301 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3854/7694] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:51:52 2022] GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5 => generated 1392 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:51:53.466225 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-342b3dad-e696-418a-b324-24cb3d7e02e4 req-fed98188-22d6-4730-9a40-777df55cc2a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b93c9f56-fc17-4e93-b6a8-bc57b18402a5", "tag": "ab015e2c-8131-4e76-aacd-34eba2713e02"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:51:53.476892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-342b3dad-e696-418a-b324-24cb3d7e02e4 req-fed98188-22d6-4730-9a40-777df55cc2a0 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:53.477423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-342b3dad-e696-418a-b324-24cb3d7e02e4 req-fed98188-22d6-4730-9a40-777df55cc2a0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:53.478058 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-342b3dad-e696-418a-b324-24cb3d7e02e4 req-fed98188-22d6-4730-9a40-777df55cc2a0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:53.493309 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-342b3dad-e696-418a-b324-24cb3d7e02e4 req-fed98188-22d6-4730-9a40-777df55cc2a0 service nova] Creating event network-changed:ab015e2c-8131-4e76-aacd-34eba2713e02 for instance b93c9f56-fc17-4e93-b6a8-bc57b18402a5 on n-h2-858272-3 Oct 05 03:51:53.499877 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-342b3dad-e696-418a-b324-24cb3d7e02e4 req-fed98188-22d6-4730-9a40-777df55cc2a0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037991 Oct 05 03:51:53.500513 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3841/7695] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:51:53.759502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-99f95ad5-eaaf-420c-a589-712355b9f3c8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:51:53.760154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-99f95ad5-eaaf-420c-a589-712355b9f3c8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: b93c9f56-fc17-4e93-b6a8-bc57b18402a5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:51:53.767028 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99f95ad5-eaaf-420c-a589-712355b9f3c8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:53.767516 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99f95ad5-eaaf-420c-a589-712355b9f3c8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:53.767952 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99f95ad5-eaaf-420c-a589-712355b9f3c8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:53.768644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99f95ad5-eaaf-420c-a589-712355b9f3c8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:53.769125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99f95ad5-eaaf-420c-a589-712355b9f3c8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:53.769549 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-99f95ad5-eaaf-420c-a589-712355b9f3c8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:53.974036 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-99f95ad5-eaaf-420c-a589-712355b9f3c8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:51:53.982874 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-99f95ad5-eaaf-420c-a589-712355b9f3c8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5" status: 200 len: 1392 microversion: 2.1 time: 0.227320 Oct 05 03:51:53.983485 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3855/7696] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:51:53 2022] GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5 => generated 1392 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:51:55.008375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5dd98a68-521f-46bf-9fd9-fe96ccb8365d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:51:55.009034 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5dd98a68-521f-46bf-9fd9-fe96ccb8365d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: b93c9f56-fc17-4e93-b6a8-bc57b18402a5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:51:55.015708 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5dd98a68-521f-46bf-9fd9-fe96ccb8365d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:55.016210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5dd98a68-521f-46bf-9fd9-fe96ccb8365d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:55.016661 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5dd98a68-521f-46bf-9fd9-fe96ccb8365d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:55.017386 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5dd98a68-521f-46bf-9fd9-fe96ccb8365d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:55.017858 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5dd98a68-521f-46bf-9fd9-fe96ccb8365d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:55.018296 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5dd98a68-521f-46bf-9fd9-fe96ccb8365d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:55.159238 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5dd98a68-521f-46bf-9fd9-fe96ccb8365d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:51:55.166962 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5dd98a68-521f-46bf-9fd9-fe96ccb8365d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5" status: 200 len: 1392 microversion: 2.1 time: 0.163806 Oct 05 03:51:55.167538 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3842/7697] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:51:55 2022] GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:51:56.195520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-47efeb45-f9ff-4edf-8211-68ccee212666 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:51:56.196155 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-47efeb45-f9ff-4edf-8211-68ccee212666 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: b93c9f56-fc17-4e93-b6a8-bc57b18402a5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:51:56.209147 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-47efeb45-f9ff-4edf-8211-68ccee212666 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:56.209920 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-47efeb45-f9ff-4edf-8211-68ccee212666 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:56.210537 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-47efeb45-f9ff-4edf-8211-68ccee212666 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:56.211108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-47efeb45-f9ff-4edf-8211-68ccee212666 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:56.211537 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-47efeb45-f9ff-4edf-8211-68ccee212666 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:56.211997 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-47efeb45-f9ff-4edf-8211-68ccee212666 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:56.419440 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-47efeb45-f9ff-4edf-8211-68ccee212666 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:51:56.427229 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-47efeb45-f9ff-4edf-8211-68ccee212666 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5" status: 200 len: 1392 microversion: 2.1 time: 0.241014 Oct 05 03:51:56.427807 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3856/7698] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:51:56 2022] GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5 => generated 1392 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:51:57.451172 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1cc881d4-c285-4744-8056-11e5c3d61fe6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:51:57.451803 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1cc881d4-c285-4744-8056-11e5c3d61fe6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: b93c9f56-fc17-4e93-b6a8-bc57b18402a5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:51:57.459283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1cc881d4-c285-4744-8056-11e5c3d61fe6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:57.459790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1cc881d4-c285-4744-8056-11e5c3d61fe6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:57.460252 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1cc881d4-c285-4744-8056-11e5c3d61fe6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:57.460987 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1cc881d4-c285-4744-8056-11e5c3d61fe6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:57.461491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1cc881d4-c285-4744-8056-11e5c3d61fe6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:57.461935 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1cc881d4-c285-4744-8056-11e5c3d61fe6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:57.598250 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1cc881d4-c285-4744-8056-11e5c3d61fe6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:51:57.606773 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1cc881d4-c285-4744-8056-11e5c3d61fe6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5" status: 200 len: 1392 microversion: 2.1 time: 0.160088 Oct 05 03:51:57.607630 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3843/7699] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:51:57 2022] GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:51:58.630412 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-92a2fe63-088b-42d4-a7a1-9e461b8264b6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:51:58.631009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-92a2fe63-088b-42d4-a7a1-9e461b8264b6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: b93c9f56-fc17-4e93-b6a8-bc57b18402a5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:51:58.638596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92a2fe63-088b-42d4-a7a1-9e461b8264b6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:58.639078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92a2fe63-088b-42d4-a7a1-9e461b8264b6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:58.639516 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92a2fe63-088b-42d4-a7a1-9e461b8264b6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:58.640205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92a2fe63-088b-42d4-a7a1-9e461b8264b6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:58.640658 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92a2fe63-088b-42d4-a7a1-9e461b8264b6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:58.641123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-92a2fe63-088b-42d4-a7a1-9e461b8264b6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:58.771422 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-92a2fe63-088b-42d4-a7a1-9e461b8264b6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:51:58.779363 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-92a2fe63-088b-42d4-a7a1-9e461b8264b6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5" status: 200 len: 1392 microversion: 2.1 time: 0.152868 Oct 05 03:51:58.779949 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3857/7700] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:51:58 2022] GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:51:58.925007 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-a3077bf0-7c09-451a-af11-d7ef7da7c787 req-66f91743-fe63-4c35-9c03-20742799b2ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b93c9f56-fc17-4e93-b6a8-bc57b18402a5", "name": "network-vif-plugged", "status": "completed", "tag": "ab015e2c-8131-4e76-aacd-34eba2713e02"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:51:58.936952 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a3077bf0-7c09-451a-af11-d7ef7da7c787 req-66f91743-fe63-4c35-9c03-20742799b2ad service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:58.937462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a3077bf0-7c09-451a-af11-d7ef7da7c787 req-66f91743-fe63-4c35-9c03-20742799b2ad service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:58.937900 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-a3077bf0-7c09-451a-af11-d7ef7da7c787 req-66f91743-fe63-4c35-9c03-20742799b2ad service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:58.949469 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-a3077bf0-7c09-451a-af11-d7ef7da7c787 req-66f91743-fe63-4c35-9c03-20742799b2ad service nova] Creating event network-vif-plugged:ab015e2c-8131-4e76-aacd-34eba2713e02 for instance b93c9f56-fc17-4e93-b6a8-bc57b18402a5 on n-h2-858272-3 Oct 05 03:51:58.954370 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-a3077bf0-7c09-451a-af11-d7ef7da7c787 req-66f91743-fe63-4c35-9c03-20742799b2ad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033246 Oct 05 03:51:58.954969 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3844/7701] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:51:59.803056 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7b33fa52-ac3e-47ba-8734-ef851e7ff4af tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:51:59.803670 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7b33fa52-ac3e-47ba-8734-ef851e7ff4af tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: b93c9f56-fc17-4e93-b6a8-bc57b18402a5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:51:59.811166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b33fa52-ac3e-47ba-8734-ef851e7ff4af tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:59.811649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b33fa52-ac3e-47ba-8734-ef851e7ff4af tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:59.812086 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b33fa52-ac3e-47ba-8734-ef851e7ff4af tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:59.812771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b33fa52-ac3e-47ba-8734-ef851e7ff4af tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:51:59.813255 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b33fa52-ac3e-47ba-8734-ef851e7ff4af tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:51:59.813680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7b33fa52-ac3e-47ba-8734-ef851e7ff4af tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:51:59.947898 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7b33fa52-ac3e-47ba-8734-ef851e7ff4af tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:51:59.955640 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7b33fa52-ac3e-47ba-8734-ef851e7ff4af tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5" status: 200 len: 1392 microversion: 2.1 time: 0.156484 Oct 05 03:51:59.956215 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3858/7702] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:51:59 2022] GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:52:01.053968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:52:01.054964 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:52:01.060487 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b8ac70e7-ff05-4a1b-ad56-76fd62a7bd74 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:52:01.061349 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b8ac70e7-ff05-4a1b-ad56-76fd62a7bd74 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: b93c9f56-fc17-4e93-b6a8-bc57b18402a5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:52:01.069052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8ac70e7-ff05-4a1b-ad56-76fd62a7bd74 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:52:01.069552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8ac70e7-ff05-4a1b-ad56-76fd62a7bd74 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:52:01.069999 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8ac70e7-ff05-4a1b-ad56-76fd62a7bd74 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:52:01.070699 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8ac70e7-ff05-4a1b-ad56-76fd62a7bd74 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:52:01.071380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8ac70e7-ff05-4a1b-ad56-76fd62a7bd74 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:52:01.071910 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b8ac70e7-ff05-4a1b-ad56-76fd62a7bd74 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:52:01.206799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b8ac70e7-ff05-4a1b-ad56-76fd62a7bd74 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:52:01.214848 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b8ac70e7-ff05-4a1b-ad56-76fd62a7bd74 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5" status: 200 len: 1564 microversion: 2.1 time: 0.163276 Oct 05 03:52:01.215419 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3845/7703] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:52:01 2022] GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5 => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:52:01.238233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3a0df72a-a60e-49cc-bd25-4b567ce697e2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:52:01.238852 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3a0df72a-a60e-49cc-bd25-4b567ce697e2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: b93c9f56-fc17-4e93-b6a8-bc57b18402a5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:52:01.240738 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:52:01.247697 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a0df72a-a60e-49cc-bd25-4b567ce697e2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:52:01.248179 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a0df72a-a60e-49cc-bd25-4b567ce697e2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:52:01.248621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a0df72a-a60e-49cc-bd25-4b567ce697e2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:52:01.249359 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a0df72a-a60e-49cc-bd25-4b567ce697e2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:52:01.249819 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a0df72a-a60e-49cc-bd25-4b567ce697e2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:52:01.250247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3a0df72a-a60e-49cc-bd25-4b567ce697e2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:52:01.387619 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3a0df72a-a60e-49cc-bd25-4b567ce697e2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:52:01.395477 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3a0df72a-a60e-49cc-bd25-4b567ce697e2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5" status: 200 len: 1564 microversion: 2.1 time: 0.161092 Oct 05 03:52:01.396059 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3859/7704] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:52:01 2022] GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:52:02.992019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b6f44ce6-2042-418b-9bf5-635b1e95da81 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:52:02.992652 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b6f44ce6-2042-418b-9bf5-635b1e95da81 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: b93c9f56-fc17-4e93-b6a8-bc57b18402a5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:52:02.994115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-96001497-f446-4df5-b848-74eba2a808b3 req-1fe40491-2a67-47c2-818c-78d26900697c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b93c9f56-fc17-4e93-b6a8-bc57b18402a5", "tag": "ab015e2c-8131-4e76-aacd-34eba2713e02"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:52:02.999792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:52:03.001921 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6f44ce6-2042-418b-9bf5-635b1e95da81 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:52:03.002606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6f44ce6-2042-418b-9bf5-635b1e95da81 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:52:03.003087 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6f44ce6-2042-418b-9bf5-635b1e95da81 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:52:03.004013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6f44ce6-2042-418b-9bf5-635b1e95da81 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:52:03.004434 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:52:03.004642 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6f44ce6-2042-418b-9bf5-635b1e95da81 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:52:03.004918 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b6f44ce6-2042-418b-9bf5-635b1e95da81 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:52:03.011012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-96001497-f446-4df5-b848-74eba2a808b3 req-1fe40491-2a67-47c2-818c-78d26900697c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:52:03.011746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-96001497-f446-4df5-b848-74eba2a808b3 req-1fe40491-2a67-47c2-818c-78d26900697c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:52:03.012357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-96001497-f446-4df5-b848-74eba2a808b3 req-1fe40491-2a67-47c2-818c-78d26900697c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:52:03.026123 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-96001497-f446-4df5-b848-74eba2a808b3 req-1fe40491-2a67-47c2-818c-78d26900697c service nova] Creating event network-changed:ab015e2c-8131-4e76-aacd-34eba2713e02 for instance b93c9f56-fc17-4e93-b6a8-bc57b18402a5 on n-h2-858272-3 Oct 05 03:52:03.032363 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-96001497-f446-4df5-b848-74eba2a808b3 req-1fe40491-2a67-47c2-818c-78d26900697c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042031 Oct 05 03:52:03.033152 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3860/7705] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:52:03.247772 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b6f44ce6-2042-418b-9bf5-635b1e95da81 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:52:03.257532 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b6f44ce6-2042-418b-9bf5-635b1e95da81 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5" status: 200 len: 1564 microversion: 2.1 time: 0.269686 Oct 05 03:52:03.272925 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3846/7706] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:52:02 2022] GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5 => generated 1564 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:52:34.549801 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=38 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:52:34.554068 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-05e5f979-ec40-48c9-9987-8e7c1a74c259 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:52:34.556981 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-05e5f979-ec40-48c9-9987-8e7c1a74c259 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: b93c9f56-fc17-4e93-b6a8-bc57b18402a5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:52:34.563965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05e5f979-ec40-48c9-9987-8e7c1a74c259 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:52:34.564443 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05e5f979-ec40-48c9-9987-8e7c1a74c259 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:52:34.564880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05e5f979-ec40-48c9-9987-8e7c1a74c259 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:52:34.565588 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05e5f979-ec40-48c9-9987-8e7c1a74c259 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:52:34.566039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05e5f979-ec40-48c9-9987-8e7c1a74c259 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:52:34.566462 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05e5f979-ec40-48c9-9987-8e7c1a74c259 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:52:34.636205 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-05e5f979-ec40-48c9-9987-8e7c1a74c259 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "POST /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5/action" status: 200 len: 24575 microversion: 2.1 time: 0.088445 Oct 05 03:52:34.637877 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3861/7707] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:52:34 2022] POST /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5/action => generated 24575 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 03:53:04.978226 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:53:04.979466 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=36 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:53:04.983801 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-34281784-b31e-41b1-a40d-48ec2705bc86 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:53:04.986059 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-34281784-b31e-41b1-a40d-48ec2705bc86 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: b93c9f56-fc17-4e93-b6a8-bc57b18402a5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:53:04.992753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34281784-b31e-41b1-a40d-48ec2705bc86 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:53:04.993287 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34281784-b31e-41b1-a40d-48ec2705bc86 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:53:04.993744 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34281784-b31e-41b1-a40d-48ec2705bc86 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:53:04.994449 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34281784-b31e-41b1-a40d-48ec2705bc86 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:53:04.994921 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34281784-b31e-41b1-a40d-48ec2705bc86 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:53:04.995363 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34281784-b31e-41b1-a40d-48ec2705bc86 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:53:05.068485 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-34281784-b31e-41b1-a40d-48ec2705bc86 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "POST /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5/action" status: 202 len: 0 microversion: 2.1 time: 0.091992 Oct 05 03:53:05.072167 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3847/7708] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:53:04 2022] POST /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:53:05.079500 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d51631a0-7e4f-4570-b15f-584dfce94874 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:53:05.080212 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d51631a0-7e4f-4570-b15f-584dfce94874 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: b93c9f56-fc17-4e93-b6a8-bc57b18402a5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:53:05.082948 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:53:05.083741 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=4 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:53:05.092546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d51631a0-7e4f-4570-b15f-584dfce94874 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:53:05.093236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d51631a0-7e4f-4570-b15f-584dfce94874 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:53:05.093683 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d51631a0-7e4f-4570-b15f-584dfce94874 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:53:05.094391 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d51631a0-7e4f-4570-b15f-584dfce94874 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:53:05.094850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d51631a0-7e4f-4570-b15f-584dfce94874 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:53:05.095277 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d51631a0-7e4f-4570-b15f-584dfce94874 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:53:05.367679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d51631a0-7e4f-4570-b15f-584dfce94874 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:53:05.375706 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d51631a0-7e4f-4570-b15f-584dfce94874 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5" status: 200 len: 1675 microversion: 2.1 time: 0.300809 Oct 05 03:53:05.376292 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3862/7709] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:53:05 2022] GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5 => generated 1675 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:53:06.401493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dad1396a-6d72-4d3f-9cd5-4b8e53daf120 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:53:06.402074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dad1396a-6d72-4d3f-9cd5-4b8e53daf120 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: b93c9f56-fc17-4e93-b6a8-bc57b18402a5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:53:06.408242 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dad1396a-6d72-4d3f-9cd5-4b8e53daf120 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:53:06.408741 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dad1396a-6d72-4d3f-9cd5-4b8e53daf120 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:53:06.409210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dad1396a-6d72-4d3f-9cd5-4b8e53daf120 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:53:06.409910 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dad1396a-6d72-4d3f-9cd5-4b8e53daf120 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:53:06.410365 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dad1396a-6d72-4d3f-9cd5-4b8e53daf120 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:53:06.410797 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dad1396a-6d72-4d3f-9cd5-4b8e53daf120 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:53:06.596678 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dad1396a-6d72-4d3f-9cd5-4b8e53daf120 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:53:06.605000 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dad1396a-6d72-4d3f-9cd5-4b8e53daf120 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5" status: 200 len: 1680 microversion: 2.1 time: 0.208289 Oct 05 03:53:06.605573 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3848/7710] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:53:06 2022] GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5 => generated 1680 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:53:07.629898 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-372886ff-cbd0-435d-a7be-652bbbaaf36f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:53:07.630520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-372886ff-cbd0-435d-a7be-652bbbaaf36f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: b93c9f56-fc17-4e93-b6a8-bc57b18402a5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:53:07.638774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-372886ff-cbd0-435d-a7be-652bbbaaf36f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:53:07.639295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-372886ff-cbd0-435d-a7be-652bbbaaf36f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:53:07.639721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-372886ff-cbd0-435d-a7be-652bbbaaf36f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:53:07.640429 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-372886ff-cbd0-435d-a7be-652bbbaaf36f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:53:07.640892 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-372886ff-cbd0-435d-a7be-652bbbaaf36f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:53:07.641346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-372886ff-cbd0-435d-a7be-652bbbaaf36f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:53:07.771805 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-372886ff-cbd0-435d-a7be-652bbbaaf36f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:53:07.779665 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-372886ff-cbd0-435d-a7be-652bbbaaf36f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5" status: 200 len: 1680 microversion: 2.1 time: 0.153802 Oct 05 03:53:07.780251 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3863/7711] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:53:07 2022] GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:53:08.803574 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a7fb6689-c299-45ba-83ea-18547c06501f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:53:08.804203 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a7fb6689-c299-45ba-83ea-18547c06501f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: b93c9f56-fc17-4e93-b6a8-bc57b18402a5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:53:08.812485 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7fb6689-c299-45ba-83ea-18547c06501f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:53:08.813015 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7fb6689-c299-45ba-83ea-18547c06501f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:53:08.813465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7fb6689-c299-45ba-83ea-18547c06501f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:53:08.814174 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7fb6689-c299-45ba-83ea-18547c06501f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:53:08.814737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7fb6689-c299-45ba-83ea-18547c06501f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:53:08.815171 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7fb6689-c299-45ba-83ea-18547c06501f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:53:08.946130 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a7fb6689-c299-45ba-83ea-18547c06501f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:53:08.953872 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a7fb6689-c299-45ba-83ea-18547c06501f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5" status: 200 len: 1680 microversion: 2.1 time: 0.154539 Oct 05 03:53:08.954447 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3849/7712] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:53:08 2022] GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:53:09.977442 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-06691aad-40e2-41e1-812c-ec6bd9e66a14 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:53:09.977999 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-06691aad-40e2-41e1-812c-ec6bd9e66a14 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: b93c9f56-fc17-4e93-b6a8-bc57b18402a5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:53:09.985165 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06691aad-40e2-41e1-812c-ec6bd9e66a14 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:53:09.985655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06691aad-40e2-41e1-812c-ec6bd9e66a14 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:53:09.986096 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06691aad-40e2-41e1-812c-ec6bd9e66a14 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:53:09.986786 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06691aad-40e2-41e1-812c-ec6bd9e66a14 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:53:09.987242 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06691aad-40e2-41e1-812c-ec6bd9e66a14 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:53:09.987671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-06691aad-40e2-41e1-812c-ec6bd9e66a14 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:53:10.123433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-06691aad-40e2-41e1-812c-ec6bd9e66a14 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:53:10.131219 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-06691aad-40e2-41e1-812c-ec6bd9e66a14 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5" status: 200 len: 1680 microversion: 2.1 time: 0.157808 Oct 05 03:53:10.131792 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3864/7713] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:53:09 2022] GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:53:11.155807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4ee212e7-600c-4f27-9f43-16140a946c92 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:53:11.156466 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4ee212e7-600c-4f27-9f43-16140a946c92 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: b93c9f56-fc17-4e93-b6a8-bc57b18402a5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:53:11.163338 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ee212e7-600c-4f27-9f43-16140a946c92 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:53:11.163835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ee212e7-600c-4f27-9f43-16140a946c92 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:53:11.164285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ee212e7-600c-4f27-9f43-16140a946c92 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:53:11.165038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ee212e7-600c-4f27-9f43-16140a946c92 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:53:11.165505 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ee212e7-600c-4f27-9f43-16140a946c92 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:53:11.165940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4ee212e7-600c-4f27-9f43-16140a946c92 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:53:11.296735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4ee212e7-600c-4f27-9f43-16140a946c92 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:53:11.304424 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4ee212e7-600c-4f27-9f43-16140a946c92 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5" status: 200 len: 1680 microversion: 2.1 time: 0.152531 Oct 05 03:53:11.305051 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3850/7714] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:53:11 2022] GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:53:12.329260 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8772c987-8a50-476c-b79f-18b9743ff969 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:53:12.329807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8772c987-8a50-476c-b79f-18b9743ff969 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: b93c9f56-fc17-4e93-b6a8-bc57b18402a5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:53:12.336552 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8772c987-8a50-476c-b79f-18b9743ff969 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:53:12.337078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8772c987-8a50-476c-b79f-18b9743ff969 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:53:12.337518 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8772c987-8a50-476c-b79f-18b9743ff969 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:53:12.338201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8772c987-8a50-476c-b79f-18b9743ff969 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:53:12.338654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8772c987-8a50-476c-b79f-18b9743ff969 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:53:12.339080 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8772c987-8a50-476c-b79f-18b9743ff969 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:53:12.485197 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8772c987-8a50-476c-b79f-18b9743ff969 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:53:12.493107 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8772c987-8a50-476c-b79f-18b9743ff969 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5" status: 200 len: 1680 microversion: 2.1 time: 0.167871 Oct 05 03:53:12.493687 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3865/7715] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:53:12 2022] GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:53:13.517617 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-25e9e8d7-db1b-4d82-a53f-d400147108c2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:53:13.518261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-25e9e8d7-db1b-4d82-a53f-d400147108c2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: b93c9f56-fc17-4e93-b6a8-bc57b18402a5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:53:13.524753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25e9e8d7-db1b-4d82-a53f-d400147108c2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:53:13.525290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25e9e8d7-db1b-4d82-a53f-d400147108c2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:53:13.525738 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25e9e8d7-db1b-4d82-a53f-d400147108c2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:53:13.526435 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25e9e8d7-db1b-4d82-a53f-d400147108c2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:53:13.526902 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25e9e8d7-db1b-4d82-a53f-d400147108c2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:53:13.527999 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25e9e8d7-db1b-4d82-a53f-d400147108c2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:53:13.656595 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-25e9e8d7-db1b-4d82-a53f-d400147108c2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:53:13.664483 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-25e9e8d7-db1b-4d82-a53f-d400147108c2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5" status: 200 len: 1680 microversion: 2.1 time: 0.150983 Oct 05 03:53:13.665228 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3851/7716] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:53:13 2022] GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:53:14.687834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-83dafffe-d1c1-413b-87a2-5403fe9c4e5c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:53:14.688448 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-83dafffe-d1c1-413b-87a2-5403fe9c4e5c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: b93c9f56-fc17-4e93-b6a8-bc57b18402a5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:53:14.694911 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-83dafffe-d1c1-413b-87a2-5403fe9c4e5c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:53:14.695395 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-83dafffe-d1c1-413b-87a2-5403fe9c4e5c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:53:14.695830 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-83dafffe-d1c1-413b-87a2-5403fe9c4e5c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:53:14.696699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-83dafffe-d1c1-413b-87a2-5403fe9c4e5c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:53:14.697178 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-83dafffe-d1c1-413b-87a2-5403fe9c4e5c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:53:14.697630 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-83dafffe-d1c1-413b-87a2-5403fe9c4e5c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:53:14.834391 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-83dafffe-d1c1-413b-87a2-5403fe9c4e5c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:53:14.843312 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-83dafffe-d1c1-413b-87a2-5403fe9c4e5c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5" status: 200 len: 1680 microversion: 2.1 time: 0.159550 Oct 05 03:53:14.843874 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3866/7717] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:53:14 2022] GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:53:15.867236 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-51055951-9df0-4e10-9d6e-b86697ccb1d3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:53:15.867862 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-51055951-9df0-4e10-9d6e-b86697ccb1d3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: b93c9f56-fc17-4e93-b6a8-bc57b18402a5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:53:15.875347 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51055951-9df0-4e10-9d6e-b86697ccb1d3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:53:15.875844 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51055951-9df0-4e10-9d6e-b86697ccb1d3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:53:15.876295 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51055951-9df0-4e10-9d6e-b86697ccb1d3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:53:15.877023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51055951-9df0-4e10-9d6e-b86697ccb1d3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:53:15.877488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51055951-9df0-4e10-9d6e-b86697ccb1d3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:53:15.877922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-51055951-9df0-4e10-9d6e-b86697ccb1d3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:53:16.009879 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-51055951-9df0-4e10-9d6e-b86697ccb1d3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:53:16.018191 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-51055951-9df0-4e10-9d6e-b86697ccb1d3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5" status: 200 len: 1680 microversion: 2.1 time: 0.155029 Oct 05 03:53:16.018771 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3852/7718] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:53:15 2022] GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:53:17.041597 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-718bbf9c-db6b-4bb0-9d5d-d5d57c1f92e9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:53:17.042212 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-718bbf9c-db6b-4bb0-9d5d-d5d57c1f92e9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: b93c9f56-fc17-4e93-b6a8-bc57b18402a5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:53:17.049783 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-718bbf9c-db6b-4bb0-9d5d-d5d57c1f92e9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:53:17.050364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-718bbf9c-db6b-4bb0-9d5d-d5d57c1f92e9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:53:17.050907 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-718bbf9c-db6b-4bb0-9d5d-d5d57c1f92e9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:53:17.051856 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-718bbf9c-db6b-4bb0-9d5d-d5d57c1f92e9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:53:17.052305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-718bbf9c-db6b-4bb0-9d5d-d5d57c1f92e9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:53:17.052848 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-718bbf9c-db6b-4bb0-9d5d-d5d57c1f92e9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:53:17.183926 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-718bbf9c-db6b-4bb0-9d5d-d5d57c1f92e9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:53:17.192279 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-718bbf9c-db6b-4bb0-9d5d-d5d57c1f92e9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5" status: 200 len: 1683 microversion: 2.1 time: 0.154605 Oct 05 03:53:17.192851 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3867/7719] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:53:17 2022] GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:53:49.415540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6e85dc6d-7edb-4b60-a8de-8a761521bff3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:53:49.417790 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6e85dc6d-7edb-4b60-a8de-8a761521bff3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: b93c9f56-fc17-4e93-b6a8-bc57b18402a5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:53:49.419963 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=12 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:53:49.420689 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:53:49.429246 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e85dc6d-7edb-4b60-a8de-8a761521bff3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:53:49.429756 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e85dc6d-7edb-4b60-a8de-8a761521bff3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:53:49.430211 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e85dc6d-7edb-4b60-a8de-8a761521bff3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:53:49.430930 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e85dc6d-7edb-4b60-a8de-8a761521bff3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:53:49.431409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e85dc6d-7edb-4b60-a8de-8a761521bff3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:53:49.431854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6e85dc6d-7edb-4b60-a8de-8a761521bff3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:53:49.509264 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6e85dc6d-7edb-4b60-a8de-8a761521bff3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "POST /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5/action" status: 200 len: 69131 microversion: 2.1 time: 0.097724 Oct 05 03:53:49.509946 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3853/7720] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:53:49 2022] POST /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5/action => generated 69131 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 03:54:06.514680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-663f00b8-0a3e-412f-bba2-7a965d66f6ba tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:54:06.515222 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-663f00b8-0a3e-412f-bba2-7a965d66f6ba tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: b93c9f56-fc17-4e93-b6a8-bc57b18402a5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:54:06.517678 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=12 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:54:06.518372 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-02ef140f-f0cd-4972-8b9a-f9f080576c81 req-4e91ba9a-7ca4-40c8-bd37-0395b0c2aa74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b93c9f56-fc17-4e93-b6a8-bc57b18402a5", "tag": "ab015e2c-8131-4e76-aacd-34eba2713e02"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:54:06.518802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=36 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:54:06.519355 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 03:54:06.520327 n-d-858272-3 devstack@n-api.service[122319]: Wed Oct 5 03:54:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5 (ip 10.222.0.16) !!! Oct 05 03:54:06.524602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:54:06.525312 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:54:06.534724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-02ef140f-f0cd-4972-8b9a-f9f080576c81 req-4e91ba9a-7ca4-40c8-bd37-0395b0c2aa74 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:06.535072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-663f00b8-0a3e-412f-bba2-7a965d66f6ba tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:06.535205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-02ef140f-f0cd-4972-8b9a-f9f080576c81 req-4e91ba9a-7ca4-40c8-bd37-0395b0c2aa74 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:06.535567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-663f00b8-0a3e-412f-bba2-7a965d66f6ba tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:06.535698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-02ef140f-f0cd-4972-8b9a-f9f080576c81 req-4e91ba9a-7ca4-40c8-bd37-0395b0c2aa74 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:06.536004 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-663f00b8-0a3e-412f-bba2-7a965d66f6ba tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:06.536712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-663f00b8-0a3e-412f-bba2-7a965d66f6ba tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:06.537205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-663f00b8-0a3e-412f-bba2-7a965d66f6ba tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:06.537632 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-663f00b8-0a3e-412f-bba2-7a965d66f6ba tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:06.547302 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-02ef140f-f0cd-4972-8b9a-f9f080576c81 req-4e91ba9a-7ca4-40c8-bd37-0395b0c2aa74 service nova] Creating event network-changed:ab015e2c-8131-4e76-aacd-34eba2713e02 for instance b93c9f56-fc17-4e93-b6a8-bc57b18402a5 on n-h2-858272-3 Oct 05 03:54:06.553595 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-02ef140f-f0cd-4972-8b9a-f9f080576c81 req-4e91ba9a-7ca4-40c8-bd37-0395b0c2aa74 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039851 Oct 05 03:54:06.554403 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3854/7721] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:54:06.569124 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-663f00b8-0a3e-412f-bba2-7a965d66f6ba tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: b93c9f56-fc17-4e93-b6a8-bc57b18402a5] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:54:06.664187 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-663f00b8-0a3e-412f-bba2-7a965d66f6ba tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5" status: 204 len: 0 microversion: 2.1 time: 0.153166 Oct 05 03:54:06.668379 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3868/7722] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:54:06 2022] DELETE /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:54:06.674530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-16870b48-f333-47c9-bc6f-83c47804fca0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:54:06.675361 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-16870b48-f333-47c9-bc6f-83c47804fca0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: b93c9f56-fc17-4e93-b6a8-bc57b18402a5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:54:06.683056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16870b48-f333-47c9-bc6f-83c47804fca0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:06.683679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16870b48-f333-47c9-bc6f-83c47804fca0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:06.684231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16870b48-f333-47c9-bc6f-83c47804fca0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:06.685051 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16870b48-f333-47c9-bc6f-83c47804fca0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:06.685743 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16870b48-f333-47c9-bc6f-83c47804fca0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:06.686263 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-16870b48-f333-47c9-bc6f-83c47804fca0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:06.859440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-16870b48-f333-47c9-bc6f-83c47804fca0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:54:06.867527 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-16870b48-f333-47c9-bc6f-83c47804fca0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5" status: 200 len: 1689 microversion: 2.1 time: 0.197402 Oct 05 03:54:06.868132 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3855/7723] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:54:06 2022] GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5 => generated 1689 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:54:07.894377 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-17116aa5-05b5-4d9b-888f-5dcac13438d9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:54:07.895000 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-17116aa5-05b5-4d9b-888f-5dcac13438d9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: b93c9f56-fc17-4e93-b6a8-bc57b18402a5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:54:07.902228 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17116aa5-05b5-4d9b-888f-5dcac13438d9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:07.902719 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17116aa5-05b5-4d9b-888f-5dcac13438d9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:07.903191 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17116aa5-05b5-4d9b-888f-5dcac13438d9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:07.903892 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17116aa5-05b5-4d9b-888f-5dcac13438d9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:07.904392 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17116aa5-05b5-4d9b-888f-5dcac13438d9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:07.904821 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-17116aa5-05b5-4d9b-888f-5dcac13438d9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:08.124995 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-17116aa5-05b5-4d9b-888f-5dcac13438d9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:54:08.133749 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-17116aa5-05b5-4d9b-888f-5dcac13438d9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5" status: 200 len: 1689 microversion: 2.1 time: 0.244528 Oct 05 03:54:08.134345 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3869/7724] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:54:07 2022] GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5 => generated 1689 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:54:08.892648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-18bace05-ab52-419b-be70-c8c42faca3d4 req-d797e7a4-776c-46e3-80b4-8d9ac1420baa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b93c9f56-fc17-4e93-b6a8-bc57b18402a5", "name": "network-vif-deleted", "tag": "ab015e2c-8131-4e76-aacd-34eba2713e02"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:54:08.903260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-18bace05-ab52-419b-be70-c8c42faca3d4 req-d797e7a4-776c-46e3-80b4-8d9ac1420baa service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:08.903778 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-18bace05-ab52-419b-be70-c8c42faca3d4 req-d797e7a4-776c-46e3-80b4-8d9ac1420baa service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:08.904324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-18bace05-ab52-419b-be70-c8c42faca3d4 req-d797e7a4-776c-46e3-80b4-8d9ac1420baa service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:08.916316 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-18bace05-ab52-419b-be70-c8c42faca3d4 req-d797e7a4-776c-46e3-80b4-8d9ac1420baa service nova] Creating event network-vif-deleted:ab015e2c-8131-4e76-aacd-34eba2713e02 for instance b93c9f56-fc17-4e93-b6a8-bc57b18402a5 on n-h2-858272-3 Oct 05 03:54:08.921631 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-18bace05-ab52-419b-be70-c8c42faca3d4 req-d797e7a4-776c-46e3-80b4-8d9ac1420baa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032809 Oct 05 03:54:08.922349 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3856/7725] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:54:09.158751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5e0e3901-6bfc-42d4-880b-357696dd78f2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:54:09.159452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5e0e3901-6bfc-42d4-880b-357696dd78f2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: b93c9f56-fc17-4e93-b6a8-bc57b18402a5] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:54:09.166694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e0e3901-6bfc-42d4-880b-357696dd78f2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:09.167263 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e0e3901-6bfc-42d4-880b-357696dd78f2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:09.167613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e0e3901-6bfc-42d4-880b-357696dd78f2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:09.168317 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e0e3901-6bfc-42d4-880b-357696dd78f2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:09.168771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e0e3901-6bfc-42d4-880b-357696dd78f2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:09.169227 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e0e3901-6bfc-42d4-880b-357696dd78f2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:09.202539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e0e3901-6bfc-42d4-880b-357696dd78f2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:09.203027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e0e3901-6bfc-42d4-880b-357696dd78f2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:09.203463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5e0e3901-6bfc-42d4-880b-357696dd78f2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:09.203911 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-5e0e3901-6bfc-42d4-880b-357696dd78f2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lazy-loading 'fault' on Instance uuid b93c9f56-fc17-4e93-b6a8-bc57b18402a5 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:54:09.250430 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5e0e3901-6bfc-42d4-880b-357696dd78f2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:54:09.258594 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5e0e3901-6bfc-42d4-880b-357696dd78f2 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5" status: 200 len: 1356 microversion: 2.1 time: 0.104477 Oct 05 03:54:09.259393 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3870/7726] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:54:09 2022] GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5 => generated 1356 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:54:10.284811 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9277cc41-a59d-46aa-9696-e4f436643d2b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:54:10.285547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9277cc41-a59d-46aa-9696-e4f436643d2b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: b93c9f56-fc17-4e93-b6a8-bc57b18402a5] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:54:10.291684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9277cc41-a59d-46aa-9696-e4f436643d2b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:10.292179 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9277cc41-a59d-46aa-9696-e4f436643d2b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:10.292625 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9277cc41-a59d-46aa-9696-e4f436643d2b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:10.293351 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9277cc41-a59d-46aa-9696-e4f436643d2b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:10.293822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9277cc41-a59d-46aa-9696-e4f436643d2b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:10.294254 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9277cc41-a59d-46aa-9696-e4f436643d2b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:10.307977 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-9277cc41-a59d-46aa-9696-e4f436643d2b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] HTTP exception thrown: Instance b93c9f56-fc17-4e93-b6a8-bc57b18402a5 could not be found. Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9277cc41-a59d-46aa-9696-e4f436643d2b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Request method failure captured: Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5 HTTP/1.1 Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPP7t75QoFC_cP5HwioD_odBrlcEgV1-V5Rs5FLCvkADbW5MpREEMSMdghaEC_Y9GJl526rfMTWs_KEbVUknAzYVkt8erJl73U2sRPdQb-PAjHyVtgAOdx-oxTvsCWduFNaqBjuDJ_DOf4K2FkPK6jN6v3nnTQojPxC3Z_RoZ9eVHZz8 Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c62f31970d95490d8329d9f1a2583256 Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-530340361 Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c62f31970d95490d8329d9f1a2583256"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c62f31970d95490d8329d9f1a2583256"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c62f31970d95490d8329d9f1a2583256"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c62f31970d95490d8329d9f1a2583256"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-TestNetworkAdvancedServerOps-530340361 Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c62f31970d95490d8329d9f1a2583256 Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-530340361 Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-TestNetworkAdvancedServerOps-530340361-project Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 830bf52116814aa283b1a5d20f643682 Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-TestNetworkAdvancedServerOps-530340361-project Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance b93c9f56-fc17-4e93-b6a8-bc57b18402a5 could not be found. Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'b93c9f56-fc17-4e93-b6a8-bc57b18402a5'} Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b93c9f56-fc17-4e93-b6a8-bc57b18402a5 could not be found. Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b93c9f56-fc17-4e93-b6a8-bc57b18402a5 could not be found. Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:54:10.309657 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:54:10.315386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:54:10.315386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:54:10.315386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:54:10.315386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:54:10.315386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:54:10.315386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:54:10.315386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b93c9f56-fc17-4e93-b6a8-bc57b18402a5 could not be found. Oct 05 03:54:10.315386 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:54:10.315386 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9277cc41-a59d-46aa-9696-e4f436643d2b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Returning 404 to user: Instance b93c9f56-fc17-4e93-b6a8-bc57b18402a5 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:54:10.315386 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9277cc41-a59d-46aa-9696-e4f436643d2b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5" status: 404 len: 111 microversion: 2.1 time: 0.031896 Oct 05 03:54:10.315386 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3857/7727] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:54:10 2022] GET /compute/v2.1/servers/b93c9f56-fc17-4e93-b6a8-bc57b18402a5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:54:13.617528 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0198af0d-df3b-4007-9147-4bd75ba29f78 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '.version_select at 0x7fccdea43790>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:54:13.642806 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0198af0d-df3b-4007-9147-4bd75ba29f78 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1689346674" status: 202 len: 0 microversion: 2.1 time: 0.030114 Oct 05 03:54:13.643341 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3871/7728] 10.222.0.16 () {58 vars in 1284 bytes} [Wed Oct 5 03:54:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1689346674 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:54:13.670352 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5fe83d1c-68b1-4a9c-8dfa-2da87d4af712 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Action: 'create', calling method: .version_select at 0x7fcce45af700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1898718718", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUiwYJsZPCjLG9trcNgllYQLjr1UNFsrdt/UPOIJ64mHfnOGw4X2/5CFbAb8lzpn6IfrprJvg2+TyJiWl93TeDvOF8yM+4yljJW/8LOUCQol/iVKzST3xtYiVIX9nYxPA=="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:54:13.686832 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-5fe83d1c-68b1-4a9c-8dfa-2da87d4af712 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Getting quotas for project c62f31970d95490d8329d9f1a2583256. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:54:13.693203 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-5fe83d1c-68b1-4a9c-8dfa-2da87d4af712 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Getting quotas for user 830bf52116814aa283b1a5d20f643682 and project c62f31970d95490d8329d9f1a2583256. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:54:13.715808 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5fe83d1c-68b1-4a9c-8dfa-2da87d4af712 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.049372 Oct 05 03:54:13.716748 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3858/7729] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 03:54:13 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:54:19.394007 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ef3a0dae-fe33-4e68-97aa-7012f5865fab tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1263124880", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "962bb2ca-a734-4441-9f77-d4eddcea00eb"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1898718718", "security_groups": [{"name": "tempest-secgroup-smoke-666614481"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:54:19.405441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:54:19.520280 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-ef3a0dae-fe33-4e68-97aa-7012f5865fab tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] validate_networks() for [('962bb2ca-a734-4441-9f77-d4eddcea00eb', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:54:19.912557 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-ef3a0dae-fe33-4e68-97aa-7012f5865fab tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:54:19.912816 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-ef3a0dae-fe33-4e68-97aa-7012f5865fab tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:54:19.913175 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-ef3a0dae-fe33-4e68-97aa-7012f5865fab tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:54:19.913595 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-ef3a0dae-fe33-4e68-97aa-7012f5865fab tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:54:19.914012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-ef3a0dae-fe33-4e68-97aa-7012f5865fab tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:54:19.923132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef3a0dae-fe33-4e68-97aa-7012f5865fab tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:19.923616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef3a0dae-fe33-4e68-97aa-7012f5865fab tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:19.924063 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef3a0dae-fe33-4e68-97aa-7012f5865fab tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:19.924796 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef3a0dae-fe33-4e68-97aa-7012f5865fab tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:19.925290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef3a0dae-fe33-4e68-97aa-7012f5865fab tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:19.925720 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ef3a0dae-fe33-4e68-97aa-7012f5865fab tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:19.943171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-ef3a0dae-fe33-4e68-97aa-7012f5865fab tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Getting quotas for project c62f31970d95490d8329d9f1a2583256. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:54:19.948452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-ef3a0dae-fe33-4e68-97aa-7012f5865fab tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Getting quotas for user 830bf52116814aa283b1a5d20f643682 and project c62f31970d95490d8329d9f1a2583256. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:54:19.961428 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ef3a0dae-fe33-4e68-97aa-7012f5865fab tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:54:19.963740 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ef3a0dae-fe33-4e68-97aa-7012f5865fab tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:54:20.010632 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ef3a0dae-fe33-4e68-97aa-7012f5865fab tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.620740 Oct 05 03:54:20.011622 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3872/7730] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:54:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:54:20.024605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d6c2391c-6c3a-4b15-a6fc-0ee0b736dff3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:54:20.025189 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d6c2391c-6c3a-4b15-a6fc-0ee0b736dff3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:54:20.082775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d6c2391c-6c3a-4b15-a6fc-0ee0b736dff3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:54:20.091645 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d6c2391c-6c3a-4b15-a6fc-0ee0b736dff3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 200 len: 1267 microversion: 2.1 time: 0.071520 Oct 05 03:54:20.106619 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3859/7731] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:54:20 2022] GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:54:21.117420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d8c66ffb-d983-4d9e-818b-26a5996b2b4e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:54:21.118858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d8c66ffb-d983-4d9e-818b-26a5996b2b4e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:54:21.125275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8c66ffb-d983-4d9e-818b-26a5996b2b4e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:21.126086 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8c66ffb-d983-4d9e-818b-26a5996b2b4e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:21.126534 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8c66ffb-d983-4d9e-818b-26a5996b2b4e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:21.127445 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8c66ffb-d983-4d9e-818b-26a5996b2b4e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:21.128073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8c66ffb-d983-4d9e-818b-26a5996b2b4e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:21.128752 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d8c66ffb-d983-4d9e-818b-26a5996b2b4e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:21.257518 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d8c66ffb-d983-4d9e-818b-26a5996b2b4e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:54:21.274221 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d8c66ffb-d983-4d9e-818b-26a5996b2b4e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 200 len: 1327 microversion: 2.1 time: 0.161712 Oct 05 03:54:21.275159 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3873/7732] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:54:21 2022] GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 1327 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:54:22.299918 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d60da320-0b97-4988-893c-f158e80ee635 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:54:22.300556 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d60da320-0b97-4988-893c-f158e80ee635 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:54:22.311448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=12 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:54:22.314834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d60da320-0b97-4988-893c-f158e80ee635 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:22.317547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d60da320-0b97-4988-893c-f158e80ee635 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:22.318013 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d60da320-0b97-4988-893c-f158e80ee635 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:22.322493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d60da320-0b97-4988-893c-f158e80ee635 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:22.323098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d60da320-0b97-4988-893c-f158e80ee635 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:22.323594 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d60da320-0b97-4988-893c-f158e80ee635 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:22.546625 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d60da320-0b97-4988-893c-f158e80ee635 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:54:22.561914 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d60da320-0b97-4988-893c-f158e80ee635 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 200 len: 1392 microversion: 2.1 time: 0.260614 Oct 05 03:54:22.562564 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3860/7733] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:54:22 2022] GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 1392 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:54:22.805892 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-48e8c6e9-d879-4019-9566-eb4430ea9c0a req-4ccac9a0-56c5-4a8c-89b1-ff9d95ecadfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc29b356-957e-46c1-ba13-29b683cefa59", "tag": "f63b5300-ec2b-41f1-8880-4041c054bb49"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:54:22.818826 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-48e8c6e9-d879-4019-9566-eb4430ea9c0a req-4ccac9a0-56c5-4a8c-89b1-ff9d95ecadfd service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:22.819376 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-48e8c6e9-d879-4019-9566-eb4430ea9c0a req-4ccac9a0-56c5-4a8c-89b1-ff9d95ecadfd service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:22.819817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-48e8c6e9-d879-4019-9566-eb4430ea9c0a req-4ccac9a0-56c5-4a8c-89b1-ff9d95ecadfd service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:22.831925 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-48e8c6e9-d879-4019-9566-eb4430ea9c0a req-4ccac9a0-56c5-4a8c-89b1-ff9d95ecadfd service nova] Creating event network-changed:f63b5300-ec2b-41f1-8880-4041c054bb49 for instance cc29b356-957e-46c1-ba13-29b683cefa59 on n-h2-858272-3 Oct 05 03:54:22.836838 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-48e8c6e9-d879-4019-9566-eb4430ea9c0a req-4ccac9a0-56c5-4a8c-89b1-ff9d95ecadfd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034903 Oct 05 03:54:22.837668 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3874/7734] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:54:23.585932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0b4f7c68-627c-403b-8282-11b41e5bee75 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:54:23.586581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0b4f7c68-627c-403b-8282-11b41e5bee75 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:54:23.593367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b4f7c68-627c-403b-8282-11b41e5bee75 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:23.593866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b4f7c68-627c-403b-8282-11b41e5bee75 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:23.594314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b4f7c68-627c-403b-8282-11b41e5bee75 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:23.595606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b4f7c68-627c-403b-8282-11b41e5bee75 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:23.596070 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b4f7c68-627c-403b-8282-11b41e5bee75 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:23.596507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b4f7c68-627c-403b-8282-11b41e5bee75 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:23.732548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0b4f7c68-627c-403b-8282-11b41e5bee75 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:54:23.740563 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0b4f7c68-627c-403b-8282-11b41e5bee75 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 200 len: 1392 microversion: 2.1 time: 0.158487 Oct 05 03:54:23.741107 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3861/7735] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:54:23 2022] GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:54:24.765210 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e997850a-11ee-4729-b4bd-9d9a5de11f47 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:54:24.765921 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e997850a-11ee-4729-b4bd-9d9a5de11f47 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:54:24.772951 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e997850a-11ee-4729-b4bd-9d9a5de11f47 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:24.773441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e997850a-11ee-4729-b4bd-9d9a5de11f47 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:24.773880 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e997850a-11ee-4729-b4bd-9d9a5de11f47 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:24.774568 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e997850a-11ee-4729-b4bd-9d9a5de11f47 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:24.775022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e997850a-11ee-4729-b4bd-9d9a5de11f47 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:24.775446 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e997850a-11ee-4729-b4bd-9d9a5de11f47 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:24.908846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e997850a-11ee-4729-b4bd-9d9a5de11f47 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:54:24.916672 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e997850a-11ee-4729-b4bd-9d9a5de11f47 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 200 len: 1392 microversion: 2.1 time: 0.156564 Oct 05 03:54:24.917214 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3875/7736] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:54:24 2022] GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:54:25.939639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-222600bb-d046-4c46-ae0b-18eba9794ccf tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:54:25.940272 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-222600bb-d046-4c46-ae0b-18eba9794ccf tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:54:25.947124 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-222600bb-d046-4c46-ae0b-18eba9794ccf tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:25.947652 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-222600bb-d046-4c46-ae0b-18eba9794ccf tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:25.948103 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-222600bb-d046-4c46-ae0b-18eba9794ccf tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:25.948805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-222600bb-d046-4c46-ae0b-18eba9794ccf tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:25.949299 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-222600bb-d046-4c46-ae0b-18eba9794ccf tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:25.949739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-222600bb-d046-4c46-ae0b-18eba9794ccf tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:26.086427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-222600bb-d046-4c46-ae0b-18eba9794ccf tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:54:26.094323 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-222600bb-d046-4c46-ae0b-18eba9794ccf tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 200 len: 1392 microversion: 2.1 time: 0.158596 Oct 05 03:54:26.095810 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3862/7737] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:54:25 2022] GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:54:27.118621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f6cdc11a-1bd1-43ad-a0ba-1d51ca8ef330 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:54:27.119282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f6cdc11a-1bd1-43ad-a0ba-1d51ca8ef330 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:54:27.126248 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6cdc11a-1bd1-43ad-a0ba-1d51ca8ef330 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:27.126730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6cdc11a-1bd1-43ad-a0ba-1d51ca8ef330 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:27.127168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6cdc11a-1bd1-43ad-a0ba-1d51ca8ef330 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:27.127854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6cdc11a-1bd1-43ad-a0ba-1d51ca8ef330 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:27.128308 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6cdc11a-1bd1-43ad-a0ba-1d51ca8ef330 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:27.128729 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f6cdc11a-1bd1-43ad-a0ba-1d51ca8ef330 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:27.260878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f6cdc11a-1bd1-43ad-a0ba-1d51ca8ef330 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:54:27.269054 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f6cdc11a-1bd1-43ad-a0ba-1d51ca8ef330 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 200 len: 1392 microversion: 2.1 time: 0.154316 Oct 05 03:54:27.269649 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3876/7738] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:54:27 2022] GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:54:27.820675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-4e0ec162-6475-4b69-bee7-4aace6494cfc req-39967d4c-81f3-4ee9-9127-07a055acae1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc29b356-957e-46c1-ba13-29b683cefa59", "name": "network-vif-plugged", "status": "completed", "tag": "f63b5300-ec2b-41f1-8880-4041c054bb49"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:54:27.831365 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4e0ec162-6475-4b69-bee7-4aace6494cfc req-39967d4c-81f3-4ee9-9127-07a055acae1f service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:27.831863 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4e0ec162-6475-4b69-bee7-4aace6494cfc req-39967d4c-81f3-4ee9-9127-07a055acae1f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:27.832310 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4e0ec162-6475-4b69-bee7-4aace6494cfc req-39967d4c-81f3-4ee9-9127-07a055acae1f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:27.843627 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-4e0ec162-6475-4b69-bee7-4aace6494cfc req-39967d4c-81f3-4ee9-9127-07a055acae1f service nova] Creating event network-vif-plugged:f63b5300-ec2b-41f1-8880-4041c054bb49 for instance cc29b356-957e-46c1-ba13-29b683cefa59 on n-h2-858272-3 Oct 05 03:54:27.848754 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-4e0ec162-6475-4b69-bee7-4aace6494cfc req-39967d4c-81f3-4ee9-9127-07a055acae1f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086705 Oct 05 03:54:27.849380 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3863/7739] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:54:28.292432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8190ab9f-66c0-4600-8794-1e3b11e03a0e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:54:28.293090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8190ab9f-66c0-4600-8794-1e3b11e03a0e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:54:28.301535 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8190ab9f-66c0-4600-8794-1e3b11e03a0e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:28.302032 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8190ab9f-66c0-4600-8794-1e3b11e03a0e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:28.302480 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8190ab9f-66c0-4600-8794-1e3b11e03a0e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:28.303180 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8190ab9f-66c0-4600-8794-1e3b11e03a0e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:28.303645 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8190ab9f-66c0-4600-8794-1e3b11e03a0e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:28.304076 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8190ab9f-66c0-4600-8794-1e3b11e03a0e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:28.434299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8190ab9f-66c0-4600-8794-1e3b11e03a0e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:54:28.442612 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8190ab9f-66c0-4600-8794-1e3b11e03a0e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 200 len: 1392 microversion: 2.1 time: 0.154165 Oct 05 03:54:28.443183 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3877/7740] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:54:28 2022] GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:54:29.467313 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-972f00b5-9764-476d-9ebe-a1227f36d476 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:54:29.468040 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-972f00b5-9764-476d-9ebe-a1227f36d476 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:54:29.474463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-972f00b5-9764-476d-9ebe-a1227f36d476 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:29.474968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-972f00b5-9764-476d-9ebe-a1227f36d476 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:29.475466 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-972f00b5-9764-476d-9ebe-a1227f36d476 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:29.476251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-972f00b5-9764-476d-9ebe-a1227f36d476 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:29.476723 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-972f00b5-9764-476d-9ebe-a1227f36d476 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:29.477220 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-972f00b5-9764-476d-9ebe-a1227f36d476 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:29.615069 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-972f00b5-9764-476d-9ebe-a1227f36d476 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:54:29.622905 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-972f00b5-9764-476d-9ebe-a1227f36d476 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 200 len: 1564 microversion: 2.1 time: 0.160707 Oct 05 03:54:29.623424 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3864/7741] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:54:29 2022] GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:54:29.646225 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1b0a455e-1eae-428e-b1bb-b4cab38d75bb tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:54:29.646884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1b0a455e-1eae-428e-b1bb-b4cab38d75bb tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:54:29.654313 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b0a455e-1eae-428e-b1bb-b4cab38d75bb tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:29.654807 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b0a455e-1eae-428e-b1bb-b4cab38d75bb tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:29.655251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b0a455e-1eae-428e-b1bb-b4cab38d75bb tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:29.655955 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b0a455e-1eae-428e-b1bb-b4cab38d75bb tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:29.656415 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b0a455e-1eae-428e-b1bb-b4cab38d75bb tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:29.656855 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1b0a455e-1eae-428e-b1bb-b4cab38d75bb tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:29.789622 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1b0a455e-1eae-428e-b1bb-b4cab38d75bb tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:54:29.798099 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1b0a455e-1eae-428e-b1bb-b4cab38d75bb tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 200 len: 1564 microversion: 2.1 time: 0.155508 Oct 05 03:54:29.798818 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3878/7742] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:54:29 2022] GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:54:32.178697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-72c1914f-63eb-4b0b-8e5c-5724f3798d34 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:54:32.179491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-72c1914f-63eb-4b0b-8e5c-5724f3798d34 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:54:32.185852 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:54:32.187186 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-f527193e-db65-4f0b-a69c-705ef0490109 req-1ed8e30b-cf67-4aab-ba2b-d903090174bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc29b356-957e-46c1-ba13-29b683cefa59", "tag": "f63b5300-ec2b-41f1-8880-4041c054bb49"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:54:32.190115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72c1914f-63eb-4b0b-8e5c-5724f3798d34 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:32.190789 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72c1914f-63eb-4b0b-8e5c-5724f3798d34 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:32.191320 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72c1914f-63eb-4b0b-8e5c-5724f3798d34 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:32.192417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72c1914f-63eb-4b0b-8e5c-5724f3798d34 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:32.193235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72c1914f-63eb-4b0b-8e5c-5724f3798d34 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:32.193974 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-72c1914f-63eb-4b0b-8e5c-5724f3798d34 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:32.203171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:54:32.205321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:54:32.211683 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f527193e-db65-4f0b-a69c-705ef0490109 req-1ed8e30b-cf67-4aab-ba2b-d903090174bf service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:54:32.212745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f527193e-db65-4f0b-a69c-705ef0490109 req-1ed8e30b-cf67-4aab-ba2b-d903090174bf service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:54:32.213318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-f527193e-db65-4f0b-a69c-705ef0490109 req-1ed8e30b-cf67-4aab-ba2b-d903090174bf service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:54:32.230056 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-f527193e-db65-4f0b-a69c-705ef0490109 req-1ed8e30b-cf67-4aab-ba2b-d903090174bf service nova] Creating event network-changed:f63b5300-ec2b-41f1-8880-4041c054bb49 for instance cc29b356-957e-46c1-ba13-29b683cefa59 on n-h2-858272-3 Oct 05 03:54:32.237462 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-f527193e-db65-4f0b-a69c-705ef0490109 req-1ed8e30b-cf67-4aab-ba2b-d903090174bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054548 Oct 05 03:54:32.238884 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3879/7743] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:54:32.440209 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-72c1914f-63eb-4b0b-8e5c-5724f3798d34 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:54:32.448515 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-72c1914f-63eb-4b0b-8e5c-5724f3798d34 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 200 len: 1564 microversion: 2.1 time: 0.274165 Oct 05 03:54:32.449328 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3865/7744] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:54:32 2022] GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 1564 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:55:03.723907 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-01a470c2-b6ca-477b-b79a-ce1729baf127 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:55:03.726318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-01a470c2-b6ca-477b-b79a-ce1729baf127 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:55:03.728721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:55:03.729469 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=36 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:55:03.737085 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01a470c2-b6ca-477b-b79a-ce1729baf127 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:03.738239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01a470c2-b6ca-477b-b79a-ce1729baf127 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:03.738747 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01a470c2-b6ca-477b-b79a-ce1729baf127 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:03.739442 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01a470c2-b6ca-477b-b79a-ce1729baf127 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:03.739905 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01a470c2-b6ca-477b-b79a-ce1729baf127 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:03.740335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-01a470c2-b6ca-477b-b79a-ce1729baf127 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:03.810072 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-01a470c2-b6ca-477b-b79a-ce1729baf127 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "POST /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59/action" status: 200 len: 24570 microversion: 2.1 time: 0.090908 Oct 05 03:55:03.810719 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3880/7745] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:55:03 2022] POST /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59/action => generated 24570 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 03:55:34.015199 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:55:34.016035 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=32 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:55:34.068298 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b0784661-7800-4288-a169-6dde8c86a8a4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:55:34.070718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b0784661-7800-4288-a169-6dde8c86a8a4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:55:34.076835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0784661-7800-4288-a169-6dde8c86a8a4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:34.077365 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0784661-7800-4288-a169-6dde8c86a8a4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:34.077818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0784661-7800-4288-a169-6dde8c86a8a4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:34.078524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0784661-7800-4288-a169-6dde8c86a8a4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:34.078997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0784661-7800-4288-a169-6dde8c86a8a4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:34.079444 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b0784661-7800-4288-a169-6dde8c86a8a4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:34.171325 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b0784661-7800-4288-a169-6dde8c86a8a4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:55:34.177817 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b0784661-7800-4288-a169-6dde8c86a8a4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Old instance type m1.heat2, new instance type m1.heat {{(pid=122320) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 05 03:55:34.184467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-b0784661-7800-4288-a169-6dde8c86a8a4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:55:34.184929 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-b0784661-7800-4288-a169-6dde8c86a8a4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:55:34.185412 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-b0784661-7800-4288-a169-6dde8c86a8a4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:55:34.185838 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-b0784661-7800-4288-a169-6dde8c86a8a4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:55:34.186266 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-b0784661-7800-4288-a169-6dde8c86a8a4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:55:34.249246 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b0784661-7800-4288-a169-6dde8c86a8a4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "POST /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59/action" status: 202 len: 0 microversion: 2.1 time: 0.235787 Oct 05 03:55:34.249862 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3866/7746] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:55:34 2022] POST /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:55:34.259347 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6b0763e8-01b9-4397-a0d9-e515816cfb1d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:55:34.260062 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6b0763e8-01b9-4397-a0d9-e515816cfb1d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:55:34.262615 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=4 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:55:34.263258 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:55:34.269518 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b0763e8-01b9-4397-a0d9-e515816cfb1d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:34.269943 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b0763e8-01b9-4397-a0d9-e515816cfb1d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:34.270388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b0763e8-01b9-4397-a0d9-e515816cfb1d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:34.271790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b0763e8-01b9-4397-a0d9-e515816cfb1d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:34.272391 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b0763e8-01b9-4397-a0d9-e515816cfb1d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:34.272872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b0763e8-01b9-4397-a0d9-e515816cfb1d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:34.415094 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6b0763e8-01b9-4397-a0d9-e515816cfb1d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:55:34.423230 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6b0763e8-01b9-4397-a0d9-e515816cfb1d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 200 len: 1692 microversion: 2.1 time: 0.168916 Oct 05 03:55:34.423807 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3881/7747] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:55:34 2022] GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:55:35.449889 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a1a4eb66-73ad-466c-bbc5-b2c61a862f73 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:55:35.450507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a1a4eb66-73ad-466c-bbc5-b2c61a862f73 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:55:35.457447 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a1a4eb66-73ad-466c-bbc5-b2c61a862f73 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:35.457946 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a1a4eb66-73ad-466c-bbc5-b2c61a862f73 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:35.458511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a1a4eb66-73ad-466c-bbc5-b2c61a862f73 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:35.459364 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a1a4eb66-73ad-466c-bbc5-b2c61a862f73 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:35.459857 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a1a4eb66-73ad-466c-bbc5-b2c61a862f73 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:35.460436 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a1a4eb66-73ad-466c-bbc5-b2c61a862f73 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:35.603568 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a1a4eb66-73ad-466c-bbc5-b2c61a862f73 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:55:35.611498 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a1a4eb66-73ad-466c-bbc5-b2c61a862f73 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 200 len: 1692 microversion: 2.1 time: 0.167208 Oct 05 03:55:35.612098 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3867/7748] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:55:35 2022] GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:55:36.637509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b2f01b23-c6cd-4c9e-814f-6820cd6a99b0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:55:36.638126 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b2f01b23-c6cd-4c9e-814f-6820cd6a99b0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:55:36.645944 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2f01b23-c6cd-4c9e-814f-6820cd6a99b0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:36.646512 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2f01b23-c6cd-4c9e-814f-6820cd6a99b0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:36.646947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2f01b23-c6cd-4c9e-814f-6820cd6a99b0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:36.647632 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2f01b23-c6cd-4c9e-814f-6820cd6a99b0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:36.648083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2f01b23-c6cd-4c9e-814f-6820cd6a99b0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:36.648588 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b2f01b23-c6cd-4c9e-814f-6820cd6a99b0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:36.778837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b2f01b23-c6cd-4c9e-814f-6820cd6a99b0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:55:36.787265 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b2f01b23-c6cd-4c9e-814f-6820cd6a99b0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 200 len: 1697 microversion: 2.1 time: 0.153233 Oct 05 03:55:36.787855 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3882/7749] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:55:36 2022] GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:55:37.811453 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5068352b-7f79-4fe5-bb9f-bc8c1abd438d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:55:37.812078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5068352b-7f79-4fe5-bb9f-bc8c1abd438d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:55:37.819459 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5068352b-7f79-4fe5-bb9f-bc8c1abd438d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:37.819955 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5068352b-7f79-4fe5-bb9f-bc8c1abd438d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:37.820399 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5068352b-7f79-4fe5-bb9f-bc8c1abd438d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:37.821119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5068352b-7f79-4fe5-bb9f-bc8c1abd438d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:37.821584 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5068352b-7f79-4fe5-bb9f-bc8c1abd438d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:37.822019 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5068352b-7f79-4fe5-bb9f-bc8c1abd438d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:37.957266 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5068352b-7f79-4fe5-bb9f-bc8c1abd438d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:55:37.965264 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5068352b-7f79-4fe5-bb9f-bc8c1abd438d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 200 len: 1697 microversion: 2.1 time: 0.157725 Oct 05 03:55:37.965843 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3868/7750] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:55:37 2022] GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:55:38.988950 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2bf3491b-f0fa-4fa0-8633-dce080ae7545 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:55:38.990171 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2bf3491b-f0fa-4fa0-8633-dce080ae7545 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:55:38.996999 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2bf3491b-f0fa-4fa0-8633-dce080ae7545 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:38.997495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2bf3491b-f0fa-4fa0-8633-dce080ae7545 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:38.997937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2bf3491b-f0fa-4fa0-8633-dce080ae7545 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:38.998634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2bf3491b-f0fa-4fa0-8633-dce080ae7545 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:38.999093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2bf3491b-f0fa-4fa0-8633-dce080ae7545 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:38.999521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2bf3491b-f0fa-4fa0-8633-dce080ae7545 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:39.131833 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2bf3491b-f0fa-4fa0-8633-dce080ae7545 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:55:39.139826 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2bf3491b-f0fa-4fa0-8633-dce080ae7545 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 200 len: 1697 microversion: 2.1 time: 0.154920 Oct 05 03:55:39.140396 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3883/7751] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:55:38 2022] GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:55:40.164059 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b1e66ec3-dee3-4325-a23a-f5761ee86ae8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:55:40.164685 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b1e66ec3-dee3-4325-a23a-f5761ee86ae8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:55:40.171541 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b1e66ec3-dee3-4325-a23a-f5761ee86ae8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:40.172042 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b1e66ec3-dee3-4325-a23a-f5761ee86ae8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:40.172519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b1e66ec3-dee3-4325-a23a-f5761ee86ae8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:40.173245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b1e66ec3-dee3-4325-a23a-f5761ee86ae8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:40.173713 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b1e66ec3-dee3-4325-a23a-f5761ee86ae8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:40.174150 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b1e66ec3-dee3-4325-a23a-f5761ee86ae8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:40.305422 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b1e66ec3-dee3-4325-a23a-f5761ee86ae8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:55:40.313113 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b1e66ec3-dee3-4325-a23a-f5761ee86ae8 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 200 len: 1697 microversion: 2.1 time: 0.153434 Oct 05 03:55:40.313697 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3869/7752] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:55:40 2022] GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:55:41.336240 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-66bb61a1-53ba-4a8d-84af-575bd66d0ec7 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:55:41.336865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-66bb61a1-53ba-4a8d-84af-575bd66d0ec7 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:55:41.343835 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-66bb61a1-53ba-4a8d-84af-575bd66d0ec7 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:41.344327 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-66bb61a1-53ba-4a8d-84af-575bd66d0ec7 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:41.344763 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-66bb61a1-53ba-4a8d-84af-575bd66d0ec7 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:41.345568 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-66bb61a1-53ba-4a8d-84af-575bd66d0ec7 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:41.346027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-66bb61a1-53ba-4a8d-84af-575bd66d0ec7 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:41.346456 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-66bb61a1-53ba-4a8d-84af-575bd66d0ec7 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:41.488350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-66bb61a1-53ba-4a8d-84af-575bd66d0ec7 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:55:41.496427 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-66bb61a1-53ba-4a8d-84af-575bd66d0ec7 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 200 len: 1697 microversion: 2.1 time: 0.164723 Oct 05 03:55:41.497116 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3884/7753] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:55:41 2022] GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:55:42.519932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fd5435b8-e5fc-476b-bc60-3b5154f6f738 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:55:42.520498 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fd5435b8-e5fc-476b-bc60-3b5154f6f738 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:55:42.527284 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fd5435b8-e5fc-476b-bc60-3b5154f6f738 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:42.527782 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fd5435b8-e5fc-476b-bc60-3b5154f6f738 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:42.528231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fd5435b8-e5fc-476b-bc60-3b5154f6f738 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:42.528953 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fd5435b8-e5fc-476b-bc60-3b5154f6f738 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:42.529419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fd5435b8-e5fc-476b-bc60-3b5154f6f738 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:42.529853 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fd5435b8-e5fc-476b-bc60-3b5154f6f738 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:42.661096 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fd5435b8-e5fc-476b-bc60-3b5154f6f738 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:55:42.669471 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fd5435b8-e5fc-476b-bc60-3b5154f6f738 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 200 len: 1697 microversion: 2.1 time: 0.153513 Oct 05 03:55:42.670053 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3870/7754] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:55:42 2022] GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:55:43.693064 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0600174c-8a4d-4df4-b296-e8f63f8c2b59 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:55:43.693659 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0600174c-8a4d-4df4-b296-e8f63f8c2b59 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:55:43.699871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0600174c-8a4d-4df4-b296-e8f63f8c2b59 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:43.700366 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0600174c-8a4d-4df4-b296-e8f63f8c2b59 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:43.700806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0600174c-8a4d-4df4-b296-e8f63f8c2b59 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:43.701531 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0600174c-8a4d-4df4-b296-e8f63f8c2b59 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:43.701988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0600174c-8a4d-4df4-b296-e8f63f8c2b59 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:43.702420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0600174c-8a4d-4df4-b296-e8f63f8c2b59 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:44.161931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0600174c-8a4d-4df4-b296-e8f63f8c2b59 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:55:44.169692 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0600174c-8a4d-4df4-b296-e8f63f8c2b59 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 200 len: 1697 microversion: 2.1 time: 0.481394 Oct 05 03:55:44.170261 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3885/7755] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:55:43 2022] GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 1697 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:55:45.193690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-36e6d1af-9d7f-48c9-b310-b9b43aa5e6b0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:55:45.194342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-36e6d1af-9d7f-48c9-b310-b9b43aa5e6b0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:55:45.201401 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36e6d1af-9d7f-48c9-b310-b9b43aa5e6b0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:45.201903 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36e6d1af-9d7f-48c9-b310-b9b43aa5e6b0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:45.202353 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36e6d1af-9d7f-48c9-b310-b9b43aa5e6b0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:45.203274 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36e6d1af-9d7f-48c9-b310-b9b43aa5e6b0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:45.203592 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36e6d1af-9d7f-48c9-b310-b9b43aa5e6b0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:45.203979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-36e6d1af-9d7f-48c9-b310-b9b43aa5e6b0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:45.336376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-36e6d1af-9d7f-48c9-b310-b9b43aa5e6b0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:55:45.344209 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-36e6d1af-9d7f-48c9-b310-b9b43aa5e6b0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 200 len: 1697 microversion: 2.1 time: 0.155369 Oct 05 03:55:45.344796 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3871/7756] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:55:45 2022] GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:55:46.369261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0269bd5e-a316-4267-b265-3c1abe81e4e9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:55:46.369886 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0269bd5e-a316-4267-b265-3c1abe81e4e9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:55:46.376958 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0269bd5e-a316-4267-b265-3c1abe81e4e9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:46.377400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0269bd5e-a316-4267-b265-3c1abe81e4e9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:46.377844 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0269bd5e-a316-4267-b265-3c1abe81e4e9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:46.378537 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0269bd5e-a316-4267-b265-3c1abe81e4e9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:46.379040 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0269bd5e-a316-4267-b265-3c1abe81e4e9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:46.379460 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0269bd5e-a316-4267-b265-3c1abe81e4e9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:46.521871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0269bd5e-a316-4267-b265-3c1abe81e4e9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:55:46.529726 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0269bd5e-a316-4267-b265-3c1abe81e4e9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 200 len: 1697 microversion: 2.1 time: 0.165020 Oct 05 03:55:46.530332 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3886/7757] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:55:46 2022] GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:55:47.553538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dff34ae9-5306-4dc8-b6aa-ad5ccc43f587 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:55:47.554212 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dff34ae9-5306-4dc8-b6aa-ad5ccc43f587 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:55:47.561225 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dff34ae9-5306-4dc8-b6aa-ad5ccc43f587 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:47.561731 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dff34ae9-5306-4dc8-b6aa-ad5ccc43f587 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:47.562414 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dff34ae9-5306-4dc8-b6aa-ad5ccc43f587 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:47.562928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dff34ae9-5306-4dc8-b6aa-ad5ccc43f587 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:47.563397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dff34ae9-5306-4dc8-b6aa-ad5ccc43f587 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:47.563830 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dff34ae9-5306-4dc8-b6aa-ad5ccc43f587 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:47.697858 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dff34ae9-5306-4dc8-b6aa-ad5ccc43f587 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:55:47.705625 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dff34ae9-5306-4dc8-b6aa-ad5ccc43f587 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 200 len: 1697 microversion: 2.1 time: 0.157145 Oct 05 03:55:47.706200 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3872/7758] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:55:47 2022] GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:55:48.729335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1f4d5e2a-23eb-40ea-8310-d8b31f15199e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:55:48.729930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1f4d5e2a-23eb-40ea-8310-d8b31f15199e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:55:48.738035 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f4d5e2a-23eb-40ea-8310-d8b31f15199e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:48.738526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f4d5e2a-23eb-40ea-8310-d8b31f15199e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:48.738967 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f4d5e2a-23eb-40ea-8310-d8b31f15199e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:48.739791 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f4d5e2a-23eb-40ea-8310-d8b31f15199e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:48.740226 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f4d5e2a-23eb-40ea-8310-d8b31f15199e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:48.740651 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1f4d5e2a-23eb-40ea-8310-d8b31f15199e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:48.888351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-1f4d5e2a-23eb-40ea-8310-d8b31f15199e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:55:48.896837 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1f4d5e2a-23eb-40ea-8310-d8b31f15199e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 200 len: 1697 microversion: 2.1 time: 0.171473 Oct 05 03:55:48.897446 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3887/7759] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:55:48 2022] GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 1697 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:55:49.324639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-36320b9d-e3fe-4dab-8fc9-547f83fab89a req-b32f17b7-5ba9-4ffb-943c-ae8eebf89e15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc29b356-957e-46c1-ba13-29b683cefa59", "name": "network-vif-unplugged", "status": "completed", "tag": "f63b5300-ec2b-41f1-8880-4041c054bb49"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:55:49.334893 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-36320b9d-e3fe-4dab-8fc9-547f83fab89a req-b32f17b7-5ba9-4ffb-943c-ae8eebf89e15 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:49.335397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-36320b9d-e3fe-4dab-8fc9-547f83fab89a req-b32f17b7-5ba9-4ffb-943c-ae8eebf89e15 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:49.335867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-36320b9d-e3fe-4dab-8fc9-547f83fab89a req-b32f17b7-5ba9-4ffb-943c-ae8eebf89e15 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:49.347622 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-36320b9d-e3fe-4dab-8fc9-547f83fab89a req-b32f17b7-5ba9-4ffb-943c-ae8eebf89e15 service nova] Creating event network-vif-unplugged:f63b5300-ec2b-41f1-8880-4041c054bb49 for instance cc29b356-957e-46c1-ba13-29b683cefa59 on n-h1-858272-3 Oct 05 03:55:49.354553 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [req-36320b9d-e3fe-4dab-8fc9-547f83fab89a req-b32f17b7-5ba9-4ffb-943c-ae8eebf89e15 service nova] Instance cc29b356-957e-46c1-ba13-29b683cefa59 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 03:55:49.368006 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-36320b9d-e3fe-4dab-8fc9-547f83fab89a req-b32f17b7-5ba9-4ffb-943c-ae8eebf89e15 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103946 Oct 05 03:55:49.368924 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3873/7760] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:55:49.921392 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-408d1110-e460-42d4-a0d0-bb04ba3bc935 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:55:49.922004 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-408d1110-e460-42d4-a0d0-bb04ba3bc935 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:55:49.929076 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-408d1110-e460-42d4-a0d0-bb04ba3bc935 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:49.929571 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-408d1110-e460-42d4-a0d0-bb04ba3bc935 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:49.930009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-408d1110-e460-42d4-a0d0-bb04ba3bc935 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:49.930706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-408d1110-e460-42d4-a0d0-bb04ba3bc935 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:49.931189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-408d1110-e460-42d4-a0d0-bb04ba3bc935 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:49.931617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-408d1110-e460-42d4-a0d0-bb04ba3bc935 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:50.133661 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-408d1110-e460-42d4-a0d0-bb04ba3bc935 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:55:50.141649 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-408d1110-e460-42d4-a0d0-bb04ba3bc935 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 200 len: 1696 microversion: 2.1 time: 0.224387 Oct 05 03:55:50.142321 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3888/7761] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:55:49 2022] GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 1696 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:55:51.167899 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1060e8b1-3ee6-490c-9788-d77286876a85 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:55:51.168648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1060e8b1-3ee6-490c-9788-d77286876a85 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:55:51.175487 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1060e8b1-3ee6-490c-9788-d77286876a85 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:51.175989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1060e8b1-3ee6-490c-9788-d77286876a85 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:51.176491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1060e8b1-3ee6-490c-9788-d77286876a85 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:51.177235 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1060e8b1-3ee6-490c-9788-d77286876a85 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:51.177707 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1060e8b1-3ee6-490c-9788-d77286876a85 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:51.178150 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1060e8b1-3ee6-490c-9788-d77286876a85 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:51.325634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1060e8b1-3ee6-490c-9788-d77286876a85 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:55:51.334237 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1060e8b1-3ee6-490c-9788-d77286876a85 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 200 len: 1694 microversion: 2.1 time: 0.170767 Oct 05 03:55:51.334835 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3874/7762] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:55:51 2022] GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 1694 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:55:51.386924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-e20e8681-1c28-45b5-8c2d-9735bc4184b6 req-c3d2b964-ee31-42fa-b604-7fbb1fd37dfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc29b356-957e-46c1-ba13-29b683cefa59", "tag": "f63b5300-ec2b-41f1-8880-4041c054bb49"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:55:51.398348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e20e8681-1c28-45b5-8c2d-9735bc4184b6 req-c3d2b964-ee31-42fa-b604-7fbb1fd37dfb service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:51.398825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e20e8681-1c28-45b5-8c2d-9735bc4184b6 req-c3d2b964-ee31-42fa-b604-7fbb1fd37dfb service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:51.399255 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e20e8681-1c28-45b5-8c2d-9735bc4184b6 req-c3d2b964-ee31-42fa-b604-7fbb1fd37dfb service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:51.412059 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-e20e8681-1c28-45b5-8c2d-9735bc4184b6 req-c3d2b964-ee31-42fa-b604-7fbb1fd37dfb service nova] Creating event network-changed:f63b5300-ec2b-41f1-8880-4041c054bb49 for instance cc29b356-957e-46c1-ba13-29b683cefa59 on n-h1-858272-3 Oct 05 03:55:51.417591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [req-e20e8681-1c28-45b5-8c2d-9735bc4184b6 req-c3d2b964-ee31-42fa-b604-7fbb1fd37dfb service nova] Instance cc29b356-957e-46c1-ba13-29b683cefa59 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858272-3', 'n-h2-858272-3'} {{(pid=122319) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 03:55:51.428692 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-e20e8681-1c28-45b5-8c2d-9735bc4184b6 req-c3d2b964-ee31-42fa-b604-7fbb1fd37dfb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045570 Oct 05 03:55:51.429264 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3889/7763] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:55:52.359244 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5e4992c1-2b28-4d6b-981b-d55386e6d575 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:55:52.359874 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5e4992c1-2b28-4d6b-981b-d55386e6d575 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:55:52.367519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e4992c1-2b28-4d6b-981b-d55386e6d575 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:52.368023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e4992c1-2b28-4d6b-981b-d55386e6d575 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:52.368473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e4992c1-2b28-4d6b-981b-d55386e6d575 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:52.369216 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e4992c1-2b28-4d6b-981b-d55386e6d575 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:52.369683 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e4992c1-2b28-4d6b-981b-d55386e6d575 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:52.370122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5e4992c1-2b28-4d6b-981b-d55386e6d575 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:52.506834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5e4992c1-2b28-4d6b-981b-d55386e6d575 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:55:52.514590 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5e4992c1-2b28-4d6b-981b-d55386e6d575 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 200 len: 1694 microversion: 2.1 time: 0.159549 Oct 05 03:55:52.515178 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3875/7764] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:55:52 2022] GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:55:53.540643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-79a6b976-a9be-4339-8278-2442f09fda54 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:55:53.541491 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-79a6b976-a9be-4339-8278-2442f09fda54 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:55:53.547883 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79a6b976-a9be-4339-8278-2442f09fda54 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:53.548459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79a6b976-a9be-4339-8278-2442f09fda54 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:53.549006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79a6b976-a9be-4339-8278-2442f09fda54 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:53.549776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79a6b976-a9be-4339-8278-2442f09fda54 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:53.550309 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79a6b976-a9be-4339-8278-2442f09fda54 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:53.550808 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-79a6b976-a9be-4339-8278-2442f09fda54 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:53.714420 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-79a6b976-a9be-4339-8278-2442f09fda54 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:55:53.722386 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-79a6b976-a9be-4339-8278-2442f09fda54 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 200 len: 1691 microversion: 2.1 time: 0.187287 Oct 05 03:55:53.722972 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3890/7765] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:55:53 2022] GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 1691 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:55:53.745405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-944c6ec7-7d11-4c43-abab-e5efc347d048 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:55:53.745973 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-944c6ec7-7d11-4c43-abab-e5efc347d048 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:55:53.752862 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-944c6ec7-7d11-4c43-abab-e5efc347d048 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:53.753395 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-944c6ec7-7d11-4c43-abab-e5efc347d048 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:53.753848 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-944c6ec7-7d11-4c43-abab-e5efc347d048 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:53.755055 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-944c6ec7-7d11-4c43-abab-e5efc347d048 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:53.755524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-944c6ec7-7d11-4c43-abab-e5efc347d048 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:53.755961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-944c6ec7-7d11-4c43-abab-e5efc347d048 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:53.812925 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-944c6ec7-7d11-4c43-abab-e5efc347d048 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "POST /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59/action" status: 204 len: 0 microversion: 2.1 time: 0.071258 Oct 05 03:55:53.813689 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3876/7766] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:55:53 2022] POST /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:55:53.822340 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0c5d71a4-e7b8-407b-808e-cf6b4f01570e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:55:53.822959 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0c5d71a4-e7b8-407b-808e-cf6b4f01570e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:55:53.829025 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c5d71a4-e7b8-407b-808e-cf6b4f01570e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:53.829689 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c5d71a4-e7b8-407b-808e-cf6b4f01570e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:53.829963 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c5d71a4-e7b8-407b-808e-cf6b4f01570e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:53.830663 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c5d71a4-e7b8-407b-808e-cf6b4f01570e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:53.831123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c5d71a4-e7b8-407b-808e-cf6b4f01570e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:53.831547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0c5d71a4-e7b8-407b-808e-cf6b4f01570e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:54.036587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0c5d71a4-e7b8-407b-808e-cf6b4f01570e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:55:54.044555 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0c5d71a4-e7b8-407b-808e-cf6b4f01570e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 200 len: 1691 microversion: 2.1 time: 0.226061 Oct 05 03:55:54.045187 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3891/7767] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:55:53 2022] GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 1691 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:55:54.070626 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-824b8904-e7ed-416e-a8a0-ab80c04d3d33 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:55:54.071342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-824b8904-e7ed-416e-a8a0-ab80c04d3d33 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:55:54.077546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-824b8904-e7ed-416e-a8a0-ab80c04d3d33 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:54.078049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-824b8904-e7ed-416e-a8a0-ab80c04d3d33 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:54.078495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-824b8904-e7ed-416e-a8a0-ab80c04d3d33 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:54.079203 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-824b8904-e7ed-416e-a8a0-ab80c04d3d33 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:54.079673 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-824b8904-e7ed-416e-a8a0-ab80c04d3d33 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:54.080109 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-824b8904-e7ed-416e-a8a0-ab80c04d3d33 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:54.299823 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-824b8904-e7ed-416e-a8a0-ab80c04d3d33 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:55:54.308256 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-824b8904-e7ed-416e-a8a0-ab80c04d3d33 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 200 len: 1691 microversion: 2.1 time: 0.242482 Oct 05 03:55:54.308835 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3877/7768] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:55:54 2022] GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 1691 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:55:55.332352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-479a5a40-1987-4527-8a8c-591dbc317f56 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:55:55.334055 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-479a5a40-1987-4527-8a8c-591dbc317f56 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:55:55.340945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-479a5a40-1987-4527-8a8c-591dbc317f56 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:55.341440 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-479a5a40-1987-4527-8a8c-591dbc317f56 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:55.341894 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-479a5a40-1987-4527-8a8c-591dbc317f56 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:55.343832 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-479a5a40-1987-4527-8a8c-591dbc317f56 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:55.344318 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-479a5a40-1987-4527-8a8c-591dbc317f56 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:55.344761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-479a5a40-1987-4527-8a8c-591dbc317f56 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:55.479998 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-479a5a40-1987-4527-8a8c-591dbc317f56 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:55:55.488375 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-479a5a40-1987-4527-8a8c-591dbc317f56 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 200 len: 1683 microversion: 2.1 time: 0.160009 Oct 05 03:55:55.489659 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3892/7769] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:55:55 2022] GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:55:56.846020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-09d5d9a8-ca30-4635-8069-eafa74bab42c req-943bf594-b86b-43f9-8712-a02d9fe0a577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc29b356-957e-46c1-ba13-29b683cefa59", "name": "network-vif-plugged", "status": "completed", "tag": "f63b5300-ec2b-41f1-8880-4041c054bb49"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:55:56.858408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-09d5d9a8-ca30-4635-8069-eafa74bab42c req-943bf594-b86b-43f9-8712-a02d9fe0a577 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:55:56.859160 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-09d5d9a8-ca30-4635-8069-eafa74bab42c req-943bf594-b86b-43f9-8712-a02d9fe0a577 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:55:56.859600 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-09d5d9a8-ca30-4635-8069-eafa74bab42c req-943bf594-b86b-43f9-8712-a02d9fe0a577 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:55:56.871560 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-09d5d9a8-ca30-4635-8069-eafa74bab42c req-943bf594-b86b-43f9-8712-a02d9fe0a577 service nova] Creating event network-vif-plugged:f63b5300-ec2b-41f1-8880-4041c054bb49 for instance cc29b356-957e-46c1-ba13-29b683cefa59 on n-h1-858272-3 Oct 05 03:55:56.876740 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-09d5d9a8-ca30-4635-8069-eafa74bab42c req-943bf594-b86b-43f9-8712-a02d9fe0a577 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034595 Oct 05 03:55:56.877881 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3878/7770] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:56:27.709947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-214a094c-8f37-4e9e-8eac-c64682317641 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:56:27.712214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-214a094c-8f37-4e9e-8eac-c64682317641 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:56:27.714449 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=24 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:56:27.715262 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=70 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:56:27.720937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-214a094c-8f37-4e9e-8eac-c64682317641 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:56:27.721478 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-214a094c-8f37-4e9e-8eac-c64682317641 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:56:27.721922 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-214a094c-8f37-4e9e-8eac-c64682317641 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:56:27.722625 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-214a094c-8f37-4e9e-8eac-c64682317641 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:56:27.723159 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-214a094c-8f37-4e9e-8eac-c64682317641 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:56:27.723592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-214a094c-8f37-4e9e-8eac-c64682317641 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:56:27.789406 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-214a094c-8f37-4e9e-8eac-c64682317641 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "POST /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59/action" status: 200 len: 24578 microversion: 2.1 time: 0.084087 Oct 05 03:56:27.790086 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3893/7771] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:56:27 2022] POST /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59/action => generated 24578 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 03:56:44.808920 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cb56a652-e8dd-499f-b03b-99c05ebe1d9d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:56:44.809836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cb56a652-e8dd-499f-b03b-99c05ebe1d9d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:56:44.810895 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-95f1b922-7ccf-46dc-a6a4-44e70fb8d174 req-e1686d70-66a5-4acd-ad25-5489cad501d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc29b356-957e-46c1-ba13-29b683cefa59", "tag": "f63b5300-ec2b-41f1-8880-4041c054bb49"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:56:44.813342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=30 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:56:44.814151 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:56:44.816686 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:56:44.817392 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=4 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:56:44.820451 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cb56a652-e8dd-499f-b03b-99c05ebe1d9d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:56:44.820989 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cb56a652-e8dd-499f-b03b-99c05ebe1d9d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:56:44.821609 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cb56a652-e8dd-499f-b03b-99c05ebe1d9d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:56:44.822423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cb56a652-e8dd-499f-b03b-99c05ebe1d9d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:56:44.822882 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cb56a652-e8dd-499f-b03b-99c05ebe1d9d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:56:44.823324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cb56a652-e8dd-499f-b03b-99c05ebe1d9d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:56:44.825335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-95f1b922-7ccf-46dc-a6a4-44e70fb8d174 req-e1686d70-66a5-4acd-ad25-5489cad501d8 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:56:44.825824 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-95f1b922-7ccf-46dc-a6a4-44e70fb8d174 req-e1686d70-66a5-4acd-ad25-5489cad501d8 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:56:44.826364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-95f1b922-7ccf-46dc-a6a4-44e70fb8d174 req-e1686d70-66a5-4acd-ad25-5489cad501d8 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:56:44.838349 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-95f1b922-7ccf-46dc-a6a4-44e70fb8d174 req-e1686d70-66a5-4acd-ad25-5489cad501d8 service nova] Creating event network-changed:f63b5300-ec2b-41f1-8880-4041c054bb49 for instance cc29b356-957e-46c1-ba13-29b683cefa59 on n-h1-858272-3 Oct 05 03:56:44.843530 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-95f1b922-7ccf-46dc-a6a4-44e70fb8d174 req-e1686d70-66a5-4acd-ad25-5489cad501d8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036970 Oct 05 03:56:44.844332 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3894/7772] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:56:44.854717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cb56a652-e8dd-499f-b03b-99c05ebe1d9d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:56:44.941905 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cb56a652-e8dd-499f-b03b-99c05ebe1d9d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 204 len: 0 microversion: 2.1 time: 0.137384 Oct 05 03:56:44.942786 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3879/7773] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:56:44 2022] DELETE /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:56:44.953322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ad719cac-b6b6-4adf-a4f3-86509640e489 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:56:44.954043 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ad719cac-b6b6-4adf-a4f3-86509640e489 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:56:44.960674 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad719cac-b6b6-4adf-a4f3-86509640e489 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:56:44.961191 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad719cac-b6b6-4adf-a4f3-86509640e489 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:56:44.961634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad719cac-b6b6-4adf-a4f3-86509640e489 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:56:44.962341 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad719cac-b6b6-4adf-a4f3-86509640e489 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:56:44.962802 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad719cac-b6b6-4adf-a4f3-86509640e489 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:56:44.963232 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ad719cac-b6b6-4adf-a4f3-86509640e489 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:56:45.467311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ad719cac-b6b6-4adf-a4f3-86509640e489 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:56:45.475640 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ad719cac-b6b6-4adf-a4f3-86509640e489 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 200 len: 1689 microversion: 2.1 time: 0.527006 Oct 05 03:56:45.476138 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3895/7774] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:56:44 2022] GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 1689 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:56:46.500199 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-38d04c36-c59d-4664-9fda-638efd0d0a30 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:56:46.500998 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-38d04c36-c59d-4664-9fda-638efd0d0a30 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:56:46.508552 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38d04c36-c59d-4664-9fda-638efd0d0a30 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:56:46.509088 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38d04c36-c59d-4664-9fda-638efd0d0a30 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:56:46.509540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38d04c36-c59d-4664-9fda-638efd0d0a30 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:56:46.510237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38d04c36-c59d-4664-9fda-638efd0d0a30 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:56:46.510709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38d04c36-c59d-4664-9fda-638efd0d0a30 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:56:46.511148 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-38d04c36-c59d-4664-9fda-638efd0d0a30 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:56:46.641563 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-38d04c36-c59d-4664-9fda-638efd0d0a30 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:56:46.649547 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-38d04c36-c59d-4664-9fda-638efd0d0a30 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 200 len: 1689 microversion: 2.1 time: 0.153650 Oct 05 03:56:46.650127 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3880/7775] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:56:46 2022] GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:56:47.138971 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-fd7e0f16-591b-484a-9b3c-68fc49a59f53 req-9b8e3711-d320-4b2b-a427-56c5b1cc9bcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc29b356-957e-46c1-ba13-29b683cefa59", "name": "network-vif-deleted", "tag": "f63b5300-ec2b-41f1-8880-4041c054bb49"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:56:47.151862 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-fd7e0f16-591b-484a-9b3c-68fc49a59f53 req-9b8e3711-d320-4b2b-a427-56c5b1cc9bcf service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:56:47.152275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-fd7e0f16-591b-484a-9b3c-68fc49a59f53 req-9b8e3711-d320-4b2b-a427-56c5b1cc9bcf service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:56:47.152771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-fd7e0f16-591b-484a-9b3c-68fc49a59f53 req-9b8e3711-d320-4b2b-a427-56c5b1cc9bcf service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:56:47.164127 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-fd7e0f16-591b-484a-9b3c-68fc49a59f53 req-9b8e3711-d320-4b2b-a427-56c5b1cc9bcf service nova] Creating event network-vif-deleted:f63b5300-ec2b-41f1-8880-4041c054bb49 for instance cc29b356-957e-46c1-ba13-29b683cefa59 on n-h1-858272-3 Oct 05 03:56:47.170556 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-fd7e0f16-591b-484a-9b3c-68fc49a59f53 req-9b8e3711-d320-4b2b-a427-56c5b1cc9bcf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035310 Oct 05 03:56:47.171178 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3896/7776] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:56:47.674890 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-562a8d23-77f3-48a2-b5d6-efc54d5da9f4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:56:47.675706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-562a8d23-77f3-48a2-b5d6-efc54d5da9f4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: cc29b356-957e-46c1-ba13-29b683cefa59] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:56:47.683052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-562a8d23-77f3-48a2-b5d6-efc54d5da9f4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:56:47.683574 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-562a8d23-77f3-48a2-b5d6-efc54d5da9f4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:56:47.684004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-562a8d23-77f3-48a2-b5d6-efc54d5da9f4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:56:47.684855 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-562a8d23-77f3-48a2-b5d6-efc54d5da9f4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:56:47.685346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-562a8d23-77f3-48a2-b5d6-efc54d5da9f4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:56:47.685917 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-562a8d23-77f3-48a2-b5d6-efc54d5da9f4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:56:47.702359 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-562a8d23-77f3-48a2-b5d6-efc54d5da9f4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] HTTP exception thrown: Instance cc29b356-957e-46c1-ba13-29b683cefa59 could not be found. Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-562a8d23-77f3-48a2-b5d6-efc54d5da9f4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Request method failure captured: Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 HTTP/1.1 Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPP7t75QoFC_cP5HwioD_odBrlcEgV1-V5Rs5FLCvkADbW5MpREEMSMdghaEC_Y9GJl526rfMTWs_KEbVUknAzYVkt8erJl73U2sRPdQb-PAjHyVtgAOdx-oxTvsCWduFNaqBjuDJ_DOf4K2FkPK6jN6v3nnTQojPxC3Z_RoZ9eVHZz8 Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c62f31970d95490d8329d9f1a2583256 Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-530340361 Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c62f31970d95490d8329d9f1a2583256"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c62f31970d95490d8329d9f1a2583256"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c62f31970d95490d8329d9f1a2583256"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c62f31970d95490d8329d9f1a2583256"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-TestNetworkAdvancedServerOps-530340361 Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c62f31970d95490d8329d9f1a2583256 Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-530340361 Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-TestNetworkAdvancedServerOps-530340361-project Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 830bf52116814aa283b1a5d20f643682 Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-TestNetworkAdvancedServerOps-530340361-project Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance cc29b356-957e-46c1-ba13-29b683cefa59 could not be found. Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'cc29b356-957e-46c1-ba13-29b683cefa59'} Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc29b356-957e-46c1-ba13-29b683cefa59 could not be found. Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc29b356-957e-46c1-ba13-29b683cefa59 could not be found. Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:56:47.704522 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:56:47.710590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:56:47.710590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:56:47.710590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:56:47.710590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:56:47.710590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:56:47.710590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:56:47.710590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc29b356-957e-46c1-ba13-29b683cefa59 could not be found. Oct 05 03:56:47.710590 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 03:56:47.711962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-562a8d23-77f3-48a2-b5d6-efc54d5da9f4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Returning 404 to user: Instance cc29b356-957e-46c1-ba13-29b683cefa59 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:56:47.712862 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-562a8d23-77f3-48a2-b5d6-efc54d5da9f4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59" status: 404 len: 111 microversion: 2.1 time: 0.042377 Oct 05 03:56:47.713459 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3881/7777] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:56:47 2022] GET /compute/v2.1/servers/cc29b356-957e-46c1-ba13-29b683cefa59 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:56:50.775827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1f3c1818-b04f-4b36-a367-0183163e370a tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '.version_select at 0x7fccdea6bdc0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:56:50.806860 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1f3c1818-b04f-4b36-a367-0183163e370a tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1898718718" status: 202 len: 0 microversion: 2.1 time: 0.036786 Oct 05 03:56:50.807503 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3897/7778] 10.222.0.16 () {58 vars in 1284 bytes} [Wed Oct 5 03:56:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1898718718 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:56:50.829196 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cf2159a8-8bf6-41d7-af3d-f0e4c9148e51 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Action: 'create', calling method: .version_select at 0x7fccdf1df1f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1832745776", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyFiV5J6BH7++3M4ER77HmG1avP0vMQaXhQXCkemQOm438Z5aUfwmG2ZvSY/aSdiQTPCeCp034tGbHwEC0f20dgmThLJ7KCmJHQuTlcnSaotVFEOKMWI93Mws38BAGJsg=="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:56:50.850918 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-cf2159a8-8bf6-41d7-af3d-f0e4c9148e51 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Getting quotas for project c62f31970d95490d8329d9f1a2583256. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:56:50.859994 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-cf2159a8-8bf6-41d7-af3d-f0e4c9148e51 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Getting quotas for user 830bf52116814aa283b1a5d20f643682 and project c62f31970d95490d8329d9f1a2583256. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:56:50.884032 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cf2159a8-8bf6-41d7-af3d-f0e4c9148e51 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.059005 Oct 05 03:56:50.884627 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3882/7779] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 03:56:50 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:56:56.698182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e6af9046-80f6-478b-b8eb-1ff04ca87a5e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-930547976", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "5788c0bd-e719-43a5-aa4b-2b00b5a8b584"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1832745776", "security_groups": [{"name": "tempest-secgroup-smoke-2011718414"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:56:56.825243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-e6af9046-80f6-478b-b8eb-1ff04ca87a5e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] validate_networks() for [('5788c0bd-e719-43a5-aa4b-2b00b5a8b584', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:56:57.157739 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=10 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:56:57.350481 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e6af9046-80f6-478b-b8eb-1ff04ca87a5e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:56:57.351715 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e6af9046-80f6-478b-b8eb-1ff04ca87a5e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:56:57.352472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e6af9046-80f6-478b-b8eb-1ff04ca87a5e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:56:57.352925 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e6af9046-80f6-478b-b8eb-1ff04ca87a5e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:56:57.353341 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-e6af9046-80f6-478b-b8eb-1ff04ca87a5e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:56:57.363546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6af9046-80f6-478b-b8eb-1ff04ca87a5e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:56:57.364303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6af9046-80f6-478b-b8eb-1ff04ca87a5e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:56:57.364853 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6af9046-80f6-478b-b8eb-1ff04ca87a5e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:56:57.366476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6af9046-80f6-478b-b8eb-1ff04ca87a5e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:56:57.367058 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6af9046-80f6-478b-b8eb-1ff04ca87a5e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:56:57.367751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6af9046-80f6-478b-b8eb-1ff04ca87a5e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:56:57.387239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-e6af9046-80f6-478b-b8eb-1ff04ca87a5e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Getting quotas for project c62f31970d95490d8329d9f1a2583256. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:56:57.393512 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-e6af9046-80f6-478b-b8eb-1ff04ca87a5e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Getting quotas for user 830bf52116814aa283b1a5d20f643682 and project c62f31970d95490d8329d9f1a2583256. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:56:57.409033 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e6af9046-80f6-478b-b8eb-1ff04ca87a5e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:56:57.411520 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e6af9046-80f6-478b-b8eb-1ff04ca87a5e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:56:57.459286 n-d-858272-3 devstack@n-api.service[122319]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e6af9046-80f6-478b-b8eb-1ff04ca87a5e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [e2f8a52c-0323-4127-b51d-0a7fb39b66df] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 03:56:58.469425 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [None req-e6af9046-80f6-478b-b8eb-1ff04ca87a5e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [e2f8a52c-0323-4127-b51d-0a7fb39b66df] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 48078. Oct 05 03:56:58.473881 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e6af9046-80f6-478b-b8eb-1ff04ca87a5e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.781009 Oct 05 03:56:58.474545 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3898/7780] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:56:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 1782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:56:58.486715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4a5a041d-1d52-46d9-af4d-0692cc6cc9bf tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:56:58.487347 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4a5a041d-1d52-46d9-af4d-0692cc6cc9bf tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:56:58.499131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:56:58.565306 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4a5a041d-1d52-46d9-af4d-0692cc6cc9bf tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:56:58.573180 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4a5a041d-1d52-46d9-af4d-0692cc6cc9bf tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19" status: 200 len: 1266 microversion: 2.1 time: 0.090522 Oct 05 03:56:58.573857 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3883/7781] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:56:58 2022] GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:56:59.598068 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-987e8118-44da-4293-af4f-00f3e711eda5 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:56:59.598649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-987e8118-44da-4293-af4f-00f3e711eda5 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:56:59.609237 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-987e8118-44da-4293-af4f-00f3e711eda5 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:56:59.609734 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-987e8118-44da-4293-af4f-00f3e711eda5 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:56:59.610178 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-987e8118-44da-4293-af4f-00f3e711eda5 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:56:59.610884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-987e8118-44da-4293-af4f-00f3e711eda5 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:56:59.611386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-987e8118-44da-4293-af4f-00f3e711eda5 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:56:59.611778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-987e8118-44da-4293-af4f-00f3e711eda5 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:56:59.690255 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-987e8118-44da-4293-af4f-00f3e711eda5 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:56:59.698219 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-987e8118-44da-4293-af4f-00f3e711eda5 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19" status: 200 len: 1318 microversion: 2.1 time: 0.105081 Oct 05 03:56:59.699285 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3899/7782] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:56:59 2022] GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19 => generated 1318 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:57:00.721023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-25a098ec-187c-4091-bb76-e2604b1ded01 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:57:00.721659 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-25a098ec-187c-4091-bb76-e2604b1ded01 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:57:00.729616 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25a098ec-187c-4091-bb76-e2604b1ded01 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:57:00.730121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25a098ec-187c-4091-bb76-e2604b1ded01 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:57:00.730627 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25a098ec-187c-4091-bb76-e2604b1ded01 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:57:00.731343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25a098ec-187c-4091-bb76-e2604b1ded01 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:57:00.731882 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25a098ec-187c-4091-bb76-e2604b1ded01 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:57:00.732440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-25a098ec-187c-4091-bb76-e2604b1ded01 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:57:00.914081 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-25a098ec-187c-4091-bb76-e2604b1ded01 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:57:00.922072 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-25a098ec-187c-4091-bb76-e2604b1ded01 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19" status: 200 len: 1392 microversion: 2.1 time: 0.204962 Oct 05 03:57:00.922593 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3884/7783] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:57:00 2022] GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19 => generated 1392 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:57:01.262914 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-5e0c91d9-bf8d-4867-94a1-e49280dcc97c req-533efd06-40a3-45f0-ab86-333dd6721fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f407a84a-b6bd-44d2-ba9f-33b75d853d19", "tag": "a0aee87e-3bb7-4b94-91d8-fbbb15389a0e"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:57:01.275425 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5e0c91d9-bf8d-4867-94a1-e49280dcc97c req-533efd06-40a3-45f0-ab86-333dd6721fb1 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:57:01.275914 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5e0c91d9-bf8d-4867-94a1-e49280dcc97c req-533efd06-40a3-45f0-ab86-333dd6721fb1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:57:01.276359 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-5e0c91d9-bf8d-4867-94a1-e49280dcc97c req-533efd06-40a3-45f0-ab86-333dd6721fb1 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:57:01.289100 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-5e0c91d9-bf8d-4867-94a1-e49280dcc97c req-533efd06-40a3-45f0-ab86-333dd6721fb1 service nova] Creating event network-changed:a0aee87e-3bb7-4b94-91d8-fbbb15389a0e for instance f407a84a-b6bd-44d2-ba9f-33b75d853d19 on n-h2-858272-3 Oct 05 03:57:01.294139 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-5e0c91d9-bf8d-4867-94a1-e49280dcc97c req-533efd06-40a3-45f0-ab86-333dd6721fb1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035003 Oct 05 03:57:01.294910 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3900/7784] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:57:01.946704 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-46a58521-3f90-441e-affd-0ae3c5572eba tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:57:01.947330 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-46a58521-3f90-441e-affd-0ae3c5572eba tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:57:01.954215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-46a58521-3f90-441e-affd-0ae3c5572eba tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:57:01.954712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-46a58521-3f90-441e-affd-0ae3c5572eba tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:57:01.955165 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-46a58521-3f90-441e-affd-0ae3c5572eba tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:57:01.955858 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-46a58521-3f90-441e-affd-0ae3c5572eba tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:57:01.956363 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-46a58521-3f90-441e-affd-0ae3c5572eba tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:57:01.956799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-46a58521-3f90-441e-affd-0ae3c5572eba tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:57:02.093348 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-46a58521-3f90-441e-affd-0ae3c5572eba tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:57:02.101338 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-46a58521-3f90-441e-affd-0ae3c5572eba tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19" status: 200 len: 1392 microversion: 2.1 time: 0.159217 Oct 05 03:57:02.101923 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3885/7785] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:57:01 2022] GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:57:03.126625 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-51ed96fd-2360-435d-92f9-b97632ca6e71 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:57:03.127330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-51ed96fd-2360-435d-92f9-b97632ca6e71 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:57:03.134258 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-51ed96fd-2360-435d-92f9-b97632ca6e71 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:57:03.134746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-51ed96fd-2360-435d-92f9-b97632ca6e71 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:57:03.135187 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-51ed96fd-2360-435d-92f9-b97632ca6e71 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:57:03.135879 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-51ed96fd-2360-435d-92f9-b97632ca6e71 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:57:03.136333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-51ed96fd-2360-435d-92f9-b97632ca6e71 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:57:03.136759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-51ed96fd-2360-435d-92f9-b97632ca6e71 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:57:03.282878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-51ed96fd-2360-435d-92f9-b97632ca6e71 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:57:03.291369 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-51ed96fd-2360-435d-92f9-b97632ca6e71 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19" status: 200 len: 1392 microversion: 2.1 time: 0.169857 Oct 05 03:57:03.292163 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3901/7786] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:57:03 2022] GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:57:04.314439 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-333aa5a5-9914-4d19-9ef3-cac997a82d93 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:57:04.314979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-333aa5a5-9914-4d19-9ef3-cac997a82d93 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:57:04.322127 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-333aa5a5-9914-4d19-9ef3-cac997a82d93 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:57:04.322632 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-333aa5a5-9914-4d19-9ef3-cac997a82d93 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:57:04.323086 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-333aa5a5-9914-4d19-9ef3-cac997a82d93 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:57:04.323823 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-333aa5a5-9914-4d19-9ef3-cac997a82d93 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:57:04.324295 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-333aa5a5-9914-4d19-9ef3-cac997a82d93 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:57:04.324737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-333aa5a5-9914-4d19-9ef3-cac997a82d93 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:57:04.456317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-333aa5a5-9914-4d19-9ef3-cac997a82d93 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:57:04.464828 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-333aa5a5-9914-4d19-9ef3-cac997a82d93 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19" status: 200 len: 1392 microversion: 2.1 time: 0.154452 Oct 05 03:57:04.465443 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3886/7787] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:57:04 2022] GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:57:05.488799 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f86a3cc6-da99-4b0f-b26e-1e366510207f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:57:05.489453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f86a3cc6-da99-4b0f-b26e-1e366510207f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:57:05.496480 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f86a3cc6-da99-4b0f-b26e-1e366510207f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:57:05.497013 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f86a3cc6-da99-4b0f-b26e-1e366510207f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:57:05.497463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f86a3cc6-da99-4b0f-b26e-1e366510207f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:57:05.498160 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f86a3cc6-da99-4b0f-b26e-1e366510207f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:57:05.498631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f86a3cc6-da99-4b0f-b26e-1e366510207f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:57:05.499065 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f86a3cc6-da99-4b0f-b26e-1e366510207f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:57:05.635606 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f86a3cc6-da99-4b0f-b26e-1e366510207f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:57:05.643396 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f86a3cc6-da99-4b0f-b26e-1e366510207f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19" status: 200 len: 1392 microversion: 2.1 time: 0.158574 Oct 05 03:57:05.643979 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3902/7788] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:57:05 2022] GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:57:06.668170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a6ac75b7-53f7-4779-9dac-e4e09dc26791 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:57:06.668805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a6ac75b7-53f7-4779-9dac-e4e09dc26791 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:57:06.675934 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6ac75b7-53f7-4779-9dac-e4e09dc26791 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:57:06.676439 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6ac75b7-53f7-4779-9dac-e4e09dc26791 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:57:06.676889 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6ac75b7-53f7-4779-9dac-e4e09dc26791 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:57:06.677618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6ac75b7-53f7-4779-9dac-e4e09dc26791 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:57:06.678709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6ac75b7-53f7-4779-9dac-e4e09dc26791 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:57:06.679389 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a6ac75b7-53f7-4779-9dac-e4e09dc26791 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:57:06.778655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-1610c7f9-d964-4add-8594-28c58a5fa6b1 req-274ac9f7-6a3b-460a-8e96-1b5d5d912063 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f407a84a-b6bd-44d2-ba9f-33b75d853d19", "name": "network-vif-plugged", "status": "completed", "tag": "a0aee87e-3bb7-4b94-91d8-fbbb15389a0e"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:57:06.792837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1610c7f9-d964-4add-8594-28c58a5fa6b1 req-274ac9f7-6a3b-460a-8e96-1b5d5d912063 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:57:06.793551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1610c7f9-d964-4add-8594-28c58a5fa6b1 req-274ac9f7-6a3b-460a-8e96-1b5d5d912063 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:57:06.794064 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-1610c7f9-d964-4add-8594-28c58a5fa6b1 req-274ac9f7-6a3b-460a-8e96-1b5d5d912063 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:57:06.806394 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-1610c7f9-d964-4add-8594-28c58a5fa6b1 req-274ac9f7-6a3b-460a-8e96-1b5d5d912063 service nova] Creating event network-vif-plugged:a0aee87e-3bb7-4b94-91d8-fbbb15389a0e for instance f407a84a-b6bd-44d2-ba9f-33b75d853d19 on n-h2-858272-3 Oct 05 03:57:06.811836 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-1610c7f9-d964-4add-8594-28c58a5fa6b1 req-274ac9f7-6a3b-460a-8e96-1b5d5d912063 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037529 Oct 05 03:57:06.812542 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3903/7789] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:57:06.819733 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a6ac75b7-53f7-4779-9dac-e4e09dc26791 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:57:06.827481 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a6ac75b7-53f7-4779-9dac-e4e09dc26791 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19" status: 200 len: 1392 microversion: 2.1 time: 0.164229 Oct 05 03:57:06.828058 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3887/7790] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:57:06 2022] GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:57:07.851157 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6a9272e7-bfec-44ae-b3ee-678caec822fb tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:57:07.851858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6a9272e7-bfec-44ae-b3ee-678caec822fb tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:57:07.853858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:57:07.854525 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:57:07.861982 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a9272e7-bfec-44ae-b3ee-678caec822fb tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:57:07.862521 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a9272e7-bfec-44ae-b3ee-678caec822fb tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:57:07.862957 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a9272e7-bfec-44ae-b3ee-678caec822fb tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:57:07.863649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a9272e7-bfec-44ae-b3ee-678caec822fb tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:57:07.864101 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a9272e7-bfec-44ae-b3ee-678caec822fb tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:57:07.864522 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a9272e7-bfec-44ae-b3ee-678caec822fb tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:57:07.995745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6a9272e7-bfec-44ae-b3ee-678caec822fb tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:57:08.003451 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6a9272e7-bfec-44ae-b3ee-678caec822fb tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19" status: 200 len: 1392 microversion: 2.1 time: 0.156706 Oct 05 03:57:08.004022 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3904/7791] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:57:07 2022] GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:57:09.026834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ad14dd9a-52c4-486f-a383-922404c451c9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:57:09.027467 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ad14dd9a-52c4-486f-a383-922404c451c9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:57:09.030227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:57:09.035767 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad14dd9a-52c4-486f-a383-922404c451c9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:57:09.036793 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad14dd9a-52c4-486f-a383-922404c451c9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:57:09.036793 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad14dd9a-52c4-486f-a383-922404c451c9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:57:09.037425 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad14dd9a-52c4-486f-a383-922404c451c9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:57:09.037897 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad14dd9a-52c4-486f-a383-922404c451c9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:57:09.038333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad14dd9a-52c4-486f-a383-922404c451c9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:57:09.174896 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ad14dd9a-52c4-486f-a383-922404c451c9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:57:09.183428 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ad14dd9a-52c4-486f-a383-922404c451c9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19" status: 200 len: 1565 microversion: 2.1 time: 0.160555 Oct 05 03:57:09.184005 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3888/7792] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:57:09 2022] GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19 => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:57:09.205845 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f2512c49-dc42-4e07-b725-2cb6b40d3a71 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:57:09.206402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f2512c49-dc42-4e07-b725-2cb6b40d3a71 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:57:09.213227 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f2512c49-dc42-4e07-b725-2cb6b40d3a71 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:57:09.213717 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f2512c49-dc42-4e07-b725-2cb6b40d3a71 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:57:09.214155 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f2512c49-dc42-4e07-b725-2cb6b40d3a71 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:57:09.214852 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f2512c49-dc42-4e07-b725-2cb6b40d3a71 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:57:09.215311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f2512c49-dc42-4e07-b725-2cb6b40d3a71 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:57:09.215759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f2512c49-dc42-4e07-b725-2cb6b40d3a71 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:57:09.344795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f2512c49-dc42-4e07-b725-2cb6b40d3a71 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:57:09.353316 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f2512c49-dc42-4e07-b725-2cb6b40d3a71 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19" status: 200 len: 1565 microversion: 2.1 time: 0.151336 Oct 05 03:57:09.353892 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3905/7793] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:57:09 2022] GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:57:11.221439 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-013ccd5d-8813-46cc-8958-f84f19dd9493 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:57:11.222101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-013ccd5d-8813-46cc-8958-f84f19dd9493 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:57:11.223861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-82130d67-4b2a-4b20-a36b-0b61604b102e req-ce62f544-4e0f-4407-b40a-43b00f0eae52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f407a84a-b6bd-44d2-ba9f-33b75d853d19", "tag": "a0aee87e-3bb7-4b94-91d8-fbbb15389a0e"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:57:11.231405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-013ccd5d-8813-46cc-8958-f84f19dd9493 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:57:11.233522 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-013ccd5d-8813-46cc-8958-f84f19dd9493 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:57:11.234534 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-013ccd5d-8813-46cc-8958-f84f19dd9493 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:57:11.235703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-82130d67-4b2a-4b20-a36b-0b61604b102e req-ce62f544-4e0f-4407-b40a-43b00f0eae52 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:57:11.235824 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-013ccd5d-8813-46cc-8958-f84f19dd9493 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:57:11.236183 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-82130d67-4b2a-4b20-a36b-0b61604b102e req-ce62f544-4e0f-4407-b40a-43b00f0eae52 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:57:11.236685 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-82130d67-4b2a-4b20-a36b-0b61604b102e req-ce62f544-4e0f-4407-b40a-43b00f0eae52 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:57:11.237079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-013ccd5d-8813-46cc-8958-f84f19dd9493 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:57:11.237829 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-013ccd5d-8813-46cc-8958-f84f19dd9493 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:57:11.252111 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-82130d67-4b2a-4b20-a36b-0b61604b102e req-ce62f544-4e0f-4407-b40a-43b00f0eae52 service nova] Creating event network-changed:a0aee87e-3bb7-4b94-91d8-fbbb15389a0e for instance f407a84a-b6bd-44d2-ba9f-33b75d853d19 on n-h2-858272-3 Oct 05 03:57:11.257952 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-82130d67-4b2a-4b20-a36b-0b61604b102e req-ce62f544-4e0f-4407-b40a-43b00f0eae52 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037871 Oct 05 03:57:11.258821 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3906/7794] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 03:57:11.471765 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-013ccd5d-8813-46cc-8958-f84f19dd9493 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:57:11.481300 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-013ccd5d-8813-46cc-8958-f84f19dd9493 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19" status: 200 len: 1565 microversion: 2.1 time: 0.263537 Oct 05 03:57:11.482202 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3889/7795] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:57:11 2022] GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19 => generated 1565 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:57:44.806283 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:57:44.807587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=38 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:57:44.812715 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3f461c8c-4508-489e-84de-12eb0b2592ae tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:57:44.814984 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3f461c8c-4508-489e-84de-12eb0b2592ae tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:57:44.823476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f461c8c-4508-489e-84de-12eb0b2592ae tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:57:44.823961 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f461c8c-4508-489e-84de-12eb0b2592ae tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:57:44.824399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f461c8c-4508-489e-84de-12eb0b2592ae tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:57:44.825126 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f461c8c-4508-489e-84de-12eb0b2592ae tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:57:44.825585 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f461c8c-4508-489e-84de-12eb0b2592ae tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:57:44.826011 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3f461c8c-4508-489e-84de-12eb0b2592ae tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:57:44.893275 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3f461c8c-4508-489e-84de-12eb0b2592ae tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "POST /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19/action" status: 200 len: 24570 microversion: 2.1 time: 0.088934 Oct 05 03:57:44.893905 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3907/7796] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:57:44 2022] POST /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19/action => generated 24570 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 03:58:15.316738 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:58:15.317977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=36 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:58:15.322460 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cba64a38-04c2-44ee-a5ad-8ddbf377ca1e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:58:15.331181 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cba64a38-04c2-44ee-a5ad-8ddbf377ca1e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:58:15.331688 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cba64a38-04c2-44ee-a5ad-8ddbf377ca1e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:58:15.332139 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cba64a38-04c2-44ee-a5ad-8ddbf377ca1e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:58:15.356367 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cba64a38-04c2-44ee-a5ad-8ddbf377ca1e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Going to try to stop instance {{(pid=122320) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 05 03:58:15.398952 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cba64a38-04c2-44ee-a5ad-8ddbf377ca1e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "POST /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19/action" status: 202 len: 0 microversion: 2.1 time: 0.085024 Oct 05 03:58:15.399487 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3890/7797] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:58:15 2022] POST /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:58:15.409167 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9a90ae7a-4f1d-4bec-a26b-171f214eeb12 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:58:15.409869 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9a90ae7a-4f1d-4bec-a26b-171f214eeb12 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:58:15.412436 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:58:15.413380 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=4 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:58:15.418962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a90ae7a-4f1d-4bec-a26b-171f214eeb12 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:58:15.419451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a90ae7a-4f1d-4bec-a26b-171f214eeb12 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:58:15.419903 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a90ae7a-4f1d-4bec-a26b-171f214eeb12 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:58:15.420674 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a90ae7a-4f1d-4bec-a26b-171f214eeb12 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:58:15.421174 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a90ae7a-4f1d-4bec-a26b-171f214eeb12 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:58:15.421600 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9a90ae7a-4f1d-4bec-a26b-171f214eeb12 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:58:15.652041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9a90ae7a-4f1d-4bec-a26b-171f214eeb12 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:58:15.661112 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9a90ae7a-4f1d-4bec-a26b-171f214eeb12 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19" status: 200 len: 1694 microversion: 2.1 time: 0.256260 Oct 05 03:58:15.661812 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3908/7798] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:58:15 2022] GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19 => generated 1694 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:58:16.686715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-143364c9-eea0-4cfe-a5cc-94e8b727405c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:58:16.687432 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-143364c9-eea0-4cfe-a5cc-94e8b727405c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:58:16.693752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-143364c9-eea0-4cfe-a5cc-94e8b727405c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:58:16.694253 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-143364c9-eea0-4cfe-a5cc-94e8b727405c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:58:16.694708 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-143364c9-eea0-4cfe-a5cc-94e8b727405c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:58:16.695423 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-143364c9-eea0-4cfe-a5cc-94e8b727405c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:58:16.695876 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-143364c9-eea0-4cfe-a5cc-94e8b727405c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:58:16.696319 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-143364c9-eea0-4cfe-a5cc-94e8b727405c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:58:16.888043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-143364c9-eea0-4cfe-a5cc-94e8b727405c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:58:16.895794 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-143364c9-eea0-4cfe-a5cc-94e8b727405c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19" status: 200 len: 1694 microversion: 2.1 time: 0.214579 Oct 05 03:58:16.896362 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3891/7799] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:58:16 2022] GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19 => generated 1694 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:58:17.919852 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-71dc680d-3d0a-4b52-9f80-8c6dc4f7873d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:58:17.920418 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-71dc680d-3d0a-4b52-9f80-8c6dc4f7873d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:58:17.927674 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71dc680d-3d0a-4b52-9f80-8c6dc4f7873d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:58:17.928163 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71dc680d-3d0a-4b52-9f80-8c6dc4f7873d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:58:17.928601 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71dc680d-3d0a-4b52-9f80-8c6dc4f7873d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:58:17.929360 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71dc680d-3d0a-4b52-9f80-8c6dc4f7873d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:58:17.929843 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71dc680d-3d0a-4b52-9f80-8c6dc4f7873d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:58:17.930267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-71dc680d-3d0a-4b52-9f80-8c6dc4f7873d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:58:18.060932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-71dc680d-3d0a-4b52-9f80-8c6dc4f7873d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:58:18.068747 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-71dc680d-3d0a-4b52-9f80-8c6dc4f7873d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19" status: 200 len: 1694 microversion: 2.1 time: 0.153069 Oct 05 03:58:18.069353 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3909/7800] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:58:17 2022] GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19 => generated 1694 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:58:19.092110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9e721661-4ad0-4253-a61b-ea40079e15ee tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:58:19.092735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9e721661-4ad0-4253-a61b-ea40079e15ee tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:58:19.099524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e721661-4ad0-4253-a61b-ea40079e15ee tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:58:19.100021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e721661-4ad0-4253-a61b-ea40079e15ee tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:58:19.100495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e721661-4ad0-4253-a61b-ea40079e15ee tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:58:19.101224 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e721661-4ad0-4253-a61b-ea40079e15ee tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:58:19.101724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e721661-4ad0-4253-a61b-ea40079e15ee tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:58:19.102160 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9e721661-4ad0-4253-a61b-ea40079e15ee tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:58:19.235475 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9e721661-4ad0-4253-a61b-ea40079e15ee tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:58:19.243224 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9e721661-4ad0-4253-a61b-ea40079e15ee tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19" status: 200 len: 1694 microversion: 2.1 time: 0.155016 Oct 05 03:58:19.243798 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3892/7801] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:58:19 2022] GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19 => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:58:20.267354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b4493441-859d-44da-bf8b-19085591ff9c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:58:20.267972 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b4493441-859d-44da-bf8b-19085591ff9c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:58:20.276706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4493441-859d-44da-bf8b-19085591ff9c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:58:20.277228 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4493441-859d-44da-bf8b-19085591ff9c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:58:20.277668 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4493441-859d-44da-bf8b-19085591ff9c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:58:20.278532 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4493441-859d-44da-bf8b-19085591ff9c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:58:20.279249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4493441-859d-44da-bf8b-19085591ff9c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:58:20.279684 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4493441-859d-44da-bf8b-19085591ff9c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:58:20.410518 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b4493441-859d-44da-bf8b-19085591ff9c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:58:20.418557 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b4493441-859d-44da-bf8b-19085591ff9c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19" status: 200 len: 1694 microversion: 2.1 time: 0.155283 Oct 05 03:58:20.419135 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3910/7802] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:58:20 2022] GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19 => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:58:21.441445 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fc268d44-412d-4e60-bd36-78855a93e1a6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:58:21.442069 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fc268d44-412d-4e60-bd36-78855a93e1a6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:58:21.449764 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc268d44-412d-4e60-bd36-78855a93e1a6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:58:21.450279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc268d44-412d-4e60-bd36-78855a93e1a6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:58:21.450729 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc268d44-412d-4e60-bd36-78855a93e1a6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:58:21.451434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc268d44-412d-4e60-bd36-78855a93e1a6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:58:21.451902 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc268d44-412d-4e60-bd36-78855a93e1a6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:58:21.452372 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fc268d44-412d-4e60-bd36-78855a93e1a6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:58:21.603547 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-fc268d44-412d-4e60-bd36-78855a93e1a6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:58:21.612691 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fc268d44-412d-4e60-bd36-78855a93e1a6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19" status: 200 len: 1694 microversion: 2.1 time: 0.175340 Oct 05 03:58:21.613299 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3893/7803] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:58:21 2022] GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19 => generated 1694 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:58:22.636379 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-32799da3-3e6e-41f0-871c-259998ce9d3f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:58:22.637037 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-32799da3-3e6e-41f0-871c-259998ce9d3f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:58:22.643923 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32799da3-3e6e-41f0-871c-259998ce9d3f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:58:22.644402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32799da3-3e6e-41f0-871c-259998ce9d3f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:58:22.644834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32799da3-3e6e-41f0-871c-259998ce9d3f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:58:22.645551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32799da3-3e6e-41f0-871c-259998ce9d3f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:58:22.646004 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32799da3-3e6e-41f0-871c-259998ce9d3f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:58:22.646430 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-32799da3-3e6e-41f0-871c-259998ce9d3f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:58:22.776273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-32799da3-3e6e-41f0-871c-259998ce9d3f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:58:22.784317 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-32799da3-3e6e-41f0-871c-259998ce9d3f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19" status: 200 len: 1694 microversion: 2.1 time: 0.152555 Oct 05 03:58:22.784887 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3911/7804] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:58:22 2022] GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19 => generated 1694 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:58:23.807906 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c99fc2da-0e30-47ed-a3cd-10c95f785f6a tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:58:23.808538 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c99fc2da-0e30-47ed-a3cd-10c95f785f6a tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:58:23.815550 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c99fc2da-0e30-47ed-a3cd-10c95f785f6a tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:58:23.816050 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c99fc2da-0e30-47ed-a3cd-10c95f785f6a tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:58:23.816499 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c99fc2da-0e30-47ed-a3cd-10c95f785f6a tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:58:23.817230 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c99fc2da-0e30-47ed-a3cd-10c95f785f6a tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:58:23.817703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c99fc2da-0e30-47ed-a3cd-10c95f785f6a tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:58:23.818143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c99fc2da-0e30-47ed-a3cd-10c95f785f6a tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:58:23.952403 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c99fc2da-0e30-47ed-a3cd-10c95f785f6a tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:58:23.960287 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c99fc2da-0e30-47ed-a3cd-10c95f785f6a tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19" status: 200 len: 1694 microversion: 2.1 time: 0.156418 Oct 05 03:58:23.960869 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3894/7805] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:58:23 2022] GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19 => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:58:24.984785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-26f1192c-cf95-4035-a263-a7aa2b540900 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:58:24.985375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-26f1192c-cf95-4035-a263-a7aa2b540900 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:58:24.992538 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26f1192c-cf95-4035-a263-a7aa2b540900 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:58:24.993060 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26f1192c-cf95-4035-a263-a7aa2b540900 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:58:24.993495 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26f1192c-cf95-4035-a263-a7aa2b540900 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:58:24.994184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26f1192c-cf95-4035-a263-a7aa2b540900 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:58:24.995247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26f1192c-cf95-4035-a263-a7aa2b540900 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:58:24.995670 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-26f1192c-cf95-4035-a263-a7aa2b540900 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:58:25.129184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-26f1192c-cf95-4035-a263-a7aa2b540900 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:58:25.137206 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-26f1192c-cf95-4035-a263-a7aa2b540900 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19" status: 200 len: 1694 microversion: 2.1 time: 0.156693 Oct 05 03:58:25.137851 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3912/7806] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:58:24 2022] GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19 => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:58:26.160877 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-47a130e2-e589-44d2-8a46-84c4f2a9ff78 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:58:26.161530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-47a130e2-e589-44d2-8a46-84c4f2a9ff78 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:58:26.168745 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47a130e2-e589-44d2-8a46-84c4f2a9ff78 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:58:26.169413 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47a130e2-e589-44d2-8a46-84c4f2a9ff78 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:58:26.170005 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47a130e2-e589-44d2-8a46-84c4f2a9ff78 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:58:26.170878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47a130e2-e589-44d2-8a46-84c4f2a9ff78 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:58:26.171350 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47a130e2-e589-44d2-8a46-84c4f2a9ff78 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:58:26.171792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47a130e2-e589-44d2-8a46-84c4f2a9ff78 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:58:26.306187 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-47a130e2-e589-44d2-8a46-84c4f2a9ff78 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:58:26.314590 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-47a130e2-e589-44d2-8a46-84c4f2a9ff78 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19" status: 200 len: 1671 microversion: 2.1 time: 0.157617 Oct 05 03:58:26.315176 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3895/7807] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:58:26 2022] GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19 => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:58:27.410687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-af9e2fa3-9321-4c0b-be38-99c41b54bcc9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:58:27.412889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-af9e2fa3-9321-4c0b-be38-99c41b54bcc9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:58:27.419905 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af9e2fa3-9321-4c0b-be38-99c41b54bcc9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:58:27.420384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af9e2fa3-9321-4c0b-be38-99c41b54bcc9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:58:27.420814 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af9e2fa3-9321-4c0b-be38-99c41b54bcc9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:58:27.421523 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af9e2fa3-9321-4c0b-be38-99c41b54bcc9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:58:27.421983 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af9e2fa3-9321-4c0b-be38-99c41b54bcc9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:58:27.422405 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-af9e2fa3-9321-4c0b-be38-99c41b54bcc9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:58:27.486245 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-af9e2fa3-9321-4c0b-be38-99c41b54bcc9 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "POST /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19/action" status: 200 len: 36778 microversion: 2.1 time: 0.079379 Oct 05 03:58:27.487160 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3913/7808] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:58:27 2022] POST /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19/action => generated 36778 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 03:58:27.499271 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c5263d91-8731-4817-a19d-6504c8deec16 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:58:27.506186 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5263d91-8731-4817-a19d-6504c8deec16 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:58:27.506684 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5263d91-8731-4817-a19d-6504c8deec16 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:58:27.507132 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c5263d91-8731-4817-a19d-6504c8deec16 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:58:27.529340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c5263d91-8731-4817-a19d-6504c8deec16 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Going to try to start instance {{(pid=122320) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 05 03:58:27.570124 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c5263d91-8731-4817-a19d-6504c8deec16 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "POST /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19/action" status: 202 len: 0 microversion: 2.1 time: 0.074540 Oct 05 03:58:27.570736 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3896/7809] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:58:27 2022] POST /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:58:27.581186 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b36ce8e6-3b0b-444b-b5e6-e73eacb74065 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:58:27.582487 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b36ce8e6-3b0b-444b-b5e6-e73eacb74065 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:58:27.589846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b36ce8e6-3b0b-444b-b5e6-e73eacb74065 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:58:27.590342 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b36ce8e6-3b0b-444b-b5e6-e73eacb74065 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:58:27.590775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b36ce8e6-3b0b-444b-b5e6-e73eacb74065 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:58:27.591788 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b36ce8e6-3b0b-444b-b5e6-e73eacb74065 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:58:27.592243 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b36ce8e6-3b0b-444b-b5e6-e73eacb74065 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:58:27.592667 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b36ce8e6-3b0b-444b-b5e6-e73eacb74065 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:58:27.816549 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b36ce8e6-3b0b-444b-b5e6-e73eacb74065 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:58:27.824671 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b36ce8e6-3b0b-444b-b5e6-e73eacb74065 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19" status: 200 len: 1680 microversion: 2.1 time: 0.248377 Oct 05 03:58:27.825302 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3914/7810] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:58:27 2022] GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19 => generated 1680 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:58:28.848144 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a44b692c-d4be-45c3-a2c2-1a1f9da06775 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:58:28.848856 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a44b692c-d4be-45c3-a2c2-1a1f9da06775 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:58:28.855906 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a44b692c-d4be-45c3-a2c2-1a1f9da06775 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:58:28.856406 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a44b692c-d4be-45c3-a2c2-1a1f9da06775 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:58:28.856854 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a44b692c-d4be-45c3-a2c2-1a1f9da06775 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:58:28.857585 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a44b692c-d4be-45c3-a2c2-1a1f9da06775 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:58:28.861355 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a44b692c-d4be-45c3-a2c2-1a1f9da06775 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:58:28.861835 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a44b692c-d4be-45c3-a2c2-1a1f9da06775 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:58:28.995737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a44b692c-d4be-45c3-a2c2-1a1f9da06775 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:58:29.003483 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a44b692c-d4be-45c3-a2c2-1a1f9da06775 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19" status: 200 len: 1684 microversion: 2.1 time: 0.159560 Oct 05 03:58:29.004054 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3897/7811] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:58:28 2022] GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19 => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:59:01.228406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-50244117-c42b-448e-94c8-3faaa063ae6d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:59:01.230759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-50244117-c42b-448e-94c8-3faaa063ae6d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:59:01.233592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=14 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:59:01.234266 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=40 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:59:01.240129 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50244117-c42b-448e-94c8-3faaa063ae6d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:01.240616 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50244117-c42b-448e-94c8-3faaa063ae6d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:01.241092 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50244117-c42b-448e-94c8-3faaa063ae6d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:01.241790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50244117-c42b-448e-94c8-3faaa063ae6d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:01.242249 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50244117-c42b-448e-94c8-3faaa063ae6d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:01.242674 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-50244117-c42b-448e-94c8-3faaa063ae6d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:01.314526 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-50244117-c42b-448e-94c8-3faaa063ae6d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "POST /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19/action" status: 200 len: 61341 microversion: 2.1 time: 0.089992 Oct 05 03:59:01.315182 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3915/7812] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 03:59:01 2022] POST /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19/action => generated 61341 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 03:59:18.556934 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1173beb3-c45a-4e77-b325-3e9f3afca5ae tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:59:18.557488 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1173beb3-c45a-4e77-b325-3e9f3afca5ae tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:59:18.560040 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=16 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:59:18.560653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-c108c08e-1f52-4460-9933-b36aa3a407a3 req-d7bb7401-68d9-444e-94fc-9510c4372dc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f407a84a-b6bd-44d2-ba9f-33b75d853d19", "tag": "a0aee87e-3bb7-4b94-91d8-fbbb15389a0e"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:59:18.561140 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:59:18.567051 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1173beb3-c45a-4e77-b325-3e9f3afca5ae tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:18.567560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1173beb3-c45a-4e77-b325-3e9f3afca5ae tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:18.568008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1173beb3-c45a-4e77-b325-3e9f3afca5ae tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:18.568717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1173beb3-c45a-4e77-b325-3e9f3afca5ae tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:18.569215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1173beb3-c45a-4e77-b325-3e9f3afca5ae tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:18.569652 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1173beb3-c45a-4e77-b325-3e9f3afca5ae tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:18.570918 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:59:18.571596 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=4 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:59:18.575644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c108c08e-1f52-4460-9933-b36aa3a407a3 req-d7bb7401-68d9-444e-94fc-9510c4372dc5 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:18.576515 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c108c08e-1f52-4460-9933-b36aa3a407a3 req-d7bb7401-68d9-444e-94fc-9510c4372dc5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:18.577220 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c108c08e-1f52-4460-9933-b36aa3a407a3 req-d7bb7401-68d9-444e-94fc-9510c4372dc5 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:18.592373 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-c108c08e-1f52-4460-9933-b36aa3a407a3 req-d7bb7401-68d9-444e-94fc-9510c4372dc5 service nova] Creating event network-changed:a0aee87e-3bb7-4b94-91d8-fbbb15389a0e for instance f407a84a-b6bd-44d2-ba9f-33b75d853d19 on n-h2-858272-3 Oct 05 03:59:18.597868 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-c108c08e-1f52-4460-9933-b36aa3a407a3 req-d7bb7401-68d9-444e-94fc-9510c4372dc5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042591 Oct 05 03:59:18.598747 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3916/7813] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:59:18.602967 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1173beb3-c45a-4e77-b325-3e9f3afca5ae tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 03:59:18.697101 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1173beb3-c45a-4e77-b325-3e9f3afca5ae tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19" status: 204 len: 0 microversion: 2.1 time: 0.144240 Oct 05 03:59:18.700274 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3898/7814] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 03:59:18 2022] DELETE /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 03:59:18.710351 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b4fd747c-0591-4060-9c5c-16630abf0492 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:59:18.711142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b4fd747c-0591-4060-9c5c-16630abf0492 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:59:18.718375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4fd747c-0591-4060-9c5c-16630abf0492 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:18.718953 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4fd747c-0591-4060-9c5c-16630abf0492 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:18.719465 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4fd747c-0591-4060-9c5c-16630abf0492 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:18.720234 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4fd747c-0591-4060-9c5c-16630abf0492 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:18.720798 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4fd747c-0591-4060-9c5c-16630abf0492 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:18.721362 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b4fd747c-0591-4060-9c5c-16630abf0492 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:18.870417 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b4fd747c-0591-4060-9c5c-16630abf0492 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:59:18.878302 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b4fd747c-0591-4060-9c5c-16630abf0492 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19" status: 200 len: 1690 microversion: 2.1 time: 0.173294 Oct 05 03:59:18.879118 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3917/7815] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:59:18 2022] GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19 => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:59:19.902206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3d5c23da-8a6a-4711-b8db-3d0420482780 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:59:19.902931 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3d5c23da-8a6a-4711-b8db-3d0420482780 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:59:19.909970 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d5c23da-8a6a-4711-b8db-3d0420482780 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:19.910476 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d5c23da-8a6a-4711-b8db-3d0420482780 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:19.910931 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d5c23da-8a6a-4711-b8db-3d0420482780 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:19.911640 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d5c23da-8a6a-4711-b8db-3d0420482780 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:19.912112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d5c23da-8a6a-4711-b8db-3d0420482780 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:19.912554 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3d5c23da-8a6a-4711-b8db-3d0420482780 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:20.148879 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3d5c23da-8a6a-4711-b8db-3d0420482780 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:59:20.156769 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3d5c23da-8a6a-4711-b8db-3d0420482780 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19" status: 200 len: 1690 microversion: 2.1 time: 0.258818 Oct 05 03:59:20.157311 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3899/7816] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:59:19 2022] GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19 => generated 1690 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:59:21.016485 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-b778eeea-290b-48d6-9da2-ec68b11c7a22 req-8f18efdc-8a38-4a12-ae84-d9b749d9ec3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f407a84a-b6bd-44d2-ba9f-33b75d853d19", "name": "network-vif-deleted", "tag": "a0aee87e-3bb7-4b94-91d8-fbbb15389a0e"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:59:21.027711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b778eeea-290b-48d6-9da2-ec68b11c7a22 req-8f18efdc-8a38-4a12-ae84-d9b749d9ec3c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:21.028199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b778eeea-290b-48d6-9da2-ec68b11c7a22 req-8f18efdc-8a38-4a12-ae84-d9b749d9ec3c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:21.028643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b778eeea-290b-48d6-9da2-ec68b11c7a22 req-8f18efdc-8a38-4a12-ae84-d9b749d9ec3c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:21.039646 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-b778eeea-290b-48d6-9da2-ec68b11c7a22 req-8f18efdc-8a38-4a12-ae84-d9b749d9ec3c service nova] Creating event network-vif-deleted:a0aee87e-3bb7-4b94-91d8-fbbb15389a0e for instance f407a84a-b6bd-44d2-ba9f-33b75d853d19 on n-h2-858272-3 Oct 05 03:59:21.044684 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-b778eeea-290b-48d6-9da2-ec68b11c7a22 req-8f18efdc-8a38-4a12-ae84-d9b749d9ec3c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125052 Oct 05 03:59:21.045501 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3918/7817] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:59:21.181452 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b32cd2bb-aaa5-468b-a969-099af12b6926 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:59:21.182401 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b32cd2bb-aaa5-468b-a969-099af12b6926 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:59:21.189608 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b32cd2bb-aaa5-468b-a969-099af12b6926 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:21.190124 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b32cd2bb-aaa5-468b-a969-099af12b6926 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:21.190581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b32cd2bb-aaa5-468b-a969-099af12b6926 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:21.191308 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b32cd2bb-aaa5-468b-a969-099af12b6926 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:21.191783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b32cd2bb-aaa5-468b-a969-099af12b6926 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:21.192232 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b32cd2bb-aaa5-468b-a969-099af12b6926 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:21.227530 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b32cd2bb-aaa5-468b-a969-099af12b6926 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:21.228043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b32cd2bb-aaa5-468b-a969-099af12b6926 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:21.228625 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b32cd2bb-aaa5-468b-a969-099af12b6926 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:21.229227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-b32cd2bb-aaa5-468b-a969-099af12b6926 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lazy-loading 'fault' on Instance uuid f407a84a-b6bd-44d2-ba9f-33b75d853d19 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 03:59:21.273064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b32cd2bb-aaa5-468b-a969-099af12b6926 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:59:21.282238 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b32cd2bb-aaa5-468b-a969-099af12b6926 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19" status: 200 len: 1356 microversion: 2.1 time: 0.104692 Oct 05 03:59:21.282835 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3900/7818] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:59:21 2022] GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19 => generated 1356 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:59:22.308235 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1d426588-47ab-406b-9496-d4043448214c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:59:22.308949 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1d426588-47ab-406b-9496-d4043448214c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: f407a84a-b6bd-44d2-ba9f-33b75d853d19] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:59:22.315181 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d426588-47ab-406b-9496-d4043448214c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:22.315668 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d426588-47ab-406b-9496-d4043448214c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:22.316108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d426588-47ab-406b-9496-d4043448214c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:22.316789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d426588-47ab-406b-9496-d4043448214c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:22.317272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d426588-47ab-406b-9496-d4043448214c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:22.317703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1d426588-47ab-406b-9496-d4043448214c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:22.331765 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-1d426588-47ab-406b-9496-d4043448214c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] HTTP exception thrown: Instance f407a84a-b6bd-44d2-ba9f-33b75d853d19 could not be found. Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1d426588-47ab-406b-9496-d4043448214c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Request method failure captured: Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19 HTTP/1.1 Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPP7t75QoFC_cP5HwioD_odBrlcEgV1-V5Rs5FLCvkADbW5MpREEMSMdghaEC_Y9GJl526rfMTWs_KEbVUknAzYVkt8erJl73U2sRPdQb-PAjHyVtgAOdx-oxTvsCWduFNaqBjuDJ_DOf4K2FkPK6jN6v3nnTQojPxC3Z_RoZ9eVHZz8 Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: c62f31970d95490d8329d9f1a2583256 Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-530340361 Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c62f31970d95490d8329d9f1a2583256"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c62f31970d95490d8329d9f1a2583256"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c62f31970d95490d8329d9f1a2583256"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c62f31970d95490d8329d9f1a2583256"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TestNetworkAdvancedServerOps-530340361 Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: c62f31970d95490d8329d9f1a2583256 Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-530340361 Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TestNetworkAdvancedServerOps-530340361-project Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 830bf52116814aa283b1a5d20f643682 Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TestNetworkAdvancedServerOps-530340361-project Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance f407a84a-b6bd-44d2-ba9f-33b75d853d19 could not be found. Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'f407a84a-b6bd-44d2-ba9f-33b75d853d19'} Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f407a84a-b6bd-44d2-ba9f-33b75d853d19 could not be found. Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f407a84a-b6bd-44d2-ba9f-33b75d853d19 could not be found. Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:59:22.333384 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 03:59:22.338656 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:59:22.338656 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 03:59:22.338656 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 03:59:22.338656 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 03:59:22.338656 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 03:59:22.338656 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 03:59:22.338656 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f407a84a-b6bd-44d2-ba9f-33b75d853d19 could not be found. Oct 05 03:59:22.338656 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 03:59:22.338656 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1d426588-47ab-406b-9496-d4043448214c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Returning 404 to user: Instance f407a84a-b6bd-44d2-ba9f-33b75d853d19 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 03:59:22.338656 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1d426588-47ab-406b-9496-d4043448214c tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19" status: 404 len: 111 microversion: 2.1 time: 0.032563 Oct 05 03:59:22.338656 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3919/7819] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:59:22 2022] GET /compute/v2.1/servers/f407a84a-b6bd-44d2-ba9f-33b75d853d19 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 03:59:25.660355 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c466daf8-ee35-49d1-825c-aa1c9e82bd62 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '.version_select at 0x7fccdf3ccee0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:59:25.667962 n-d-858272-3 devstack@n-api.service[122320]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c466daf8-ee35-49d1-825c-aa1c9e82bd62 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [8a8df7a1-9fb5-4319-8aad-cf438823f16a] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 03:59:26.675411 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [None req-c466daf8-ee35-49d1-825c-aa1c9e82bd62 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [8a8df7a1-9fb5-4319-8aad-cf438823f16a] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 48254. Oct 05 03:59:26.695532 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c466daf8-ee35-49d1-825c-aa1c9e82bd62 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1832745776" status: 202 len: 0 microversion: 2.1 time: 1.043233 Oct 05 03:59:26.696150 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3901/7820] 10.222.0.16 () {58 vars in 1284 bytes} [Wed Oct 5 03:59:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1832745776 => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 03:59:26.728196 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3f421dd5-d7d4-4375-a1ea-6f55fade8e9b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Action: 'create', calling method: .version_select at 0x7fcce45ff790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1118966425", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9xQKsZFgB2tzamMEk8CyCpbHRpDVHE0T1QlTqSD2YXpRfP1+dzl1yLmFinTPbvFgHus156+sVd84kUrj06wRDb4mkJNVaYlf8BMvVNEsCgqmsTYZjOHZhpe6xpPhFNYA=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:59:26.735874 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 03:59:26.736008 n-d-858272-3 devstack@n-api.service[122319]: Wed Oct 5 03:59:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.16) !!! Oct 05 03:59:26.753684 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-3f421dd5-d7d4-4375-a1ea-6f55fade8e9b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Getting quotas for project c62f31970d95490d8329d9f1a2583256. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:59:26.758834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-3f421dd5-d7d4-4375-a1ea-6f55fade8e9b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Getting quotas for user 830bf52116814aa283b1a5d20f643682 and project c62f31970d95490d8329d9f1a2583256. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:59:26.784994 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3f421dd5-d7d4-4375-a1ea-6f55fade8e9b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.060771 Oct 05 03:59:26.785530 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3920/7821] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 03:59:26 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:59:32.205318 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:59:32.215189 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5cd7ccbc-a96b-4969-8246-7f706de6acc1 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-461717528", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "networks": [{"uuid": "5359162c-0be5-4c7b-a625-89661c97b46d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1118966425", "security_groups": [{"name": "tempest-secgroup-smoke-1212505285"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:59:32.345310 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-5cd7ccbc-a96b-4969-8246-7f706de6acc1 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] validate_networks() for [('5359162c-0be5-4c7b-a625-89661c97b46d', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 03:59:32.786690 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-5cd7ccbc-a96b-4969-8246-7f706de6acc1 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 03:59:32.787405 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-5cd7ccbc-a96b-4969-8246-7f706de6acc1 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 03:59:32.788082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-5cd7ccbc-a96b-4969-8246-7f706de6acc1 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 03:59:32.788745 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-5cd7ccbc-a96b-4969-8246-7f706de6acc1 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 03:59:32.789285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-5cd7ccbc-a96b-4969-8246-7f706de6acc1 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 03:59:32.800496 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5cd7ccbc-a96b-4969-8246-7f706de6acc1 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:32.801439 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5cd7ccbc-a96b-4969-8246-7f706de6acc1 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:32.801899 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5cd7ccbc-a96b-4969-8246-7f706de6acc1 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:32.802761 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5cd7ccbc-a96b-4969-8246-7f706de6acc1 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:32.803119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5cd7ccbc-a96b-4969-8246-7f706de6acc1 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:32.803571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5cd7ccbc-a96b-4969-8246-7f706de6acc1 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:32.821834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-5cd7ccbc-a96b-4969-8246-7f706de6acc1 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Getting quotas for project c62f31970d95490d8329d9f1a2583256. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 03:59:32.828379 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-5cd7ccbc-a96b-4969-8246-7f706de6acc1 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Getting quotas for user 830bf52116814aa283b1a5d20f643682 and project c62f31970d95490d8329d9f1a2583256. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 03:59:32.842044 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5cd7ccbc-a96b-4969-8246-7f706de6acc1 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 03:59:32.844392 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5cd7ccbc-a96b-4969-8246-7f706de6acc1 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: c3b57baa-1c9e-4892-a0ba-97e3ed8eed60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 03:59:32.892671 n-d-858272-3 devstack@n-api.service[122320]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5cd7ccbc-a96b-4969-8246-7f706de6acc1 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [ca7cabca-df40-471d-99a3-ac55a439d93a] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 03:59:33.900646 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [None req-5cd7ccbc-a96b-4969-8246-7f706de6acc1 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [ca7cabca-df40-471d-99a3-ac55a439d93a] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 48304. Oct 05 03:59:33.909859 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5cd7ccbc-a96b-4969-8246-7f706de6acc1 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.706356 Oct 05 03:59:33.910524 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3902/7822] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 03:59:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 1708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 03:59:33.920750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=12 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:59:33.927161 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3c4b9da8-6610-464c-9c33-be6072c5fbdc tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:59:33.928255 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3c4b9da8-6610-464c-9c33-be6072c5fbdc tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: c3b57baa-1c9e-4892-a0ba-97e3ed8eed60] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:59:33.997454 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-3c4b9da8-6610-464c-9c33-be6072c5fbdc tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:59:34.004292 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3c4b9da8-6610-464c-9c33-be6072c5fbdc tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60" status: 200 len: 1266 microversion: 2.1 time: 0.085225 Oct 05 03:59:34.005437 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3921/7823] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:59:33 2022] GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:59:35.031027 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bb56c1b2-5c64-40ce-9c42-f9b216af74b3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:59:35.031664 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bb56c1b2-5c64-40ce-9c42-f9b216af74b3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: c3b57baa-1c9e-4892-a0ba-97e3ed8eed60] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:59:35.039270 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb56c1b2-5c64-40ce-9c42-f9b216af74b3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:35.039774 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb56c1b2-5c64-40ce-9c42-f9b216af74b3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:35.040221 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb56c1b2-5c64-40ce-9c42-f9b216af74b3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:35.041572 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb56c1b2-5c64-40ce-9c42-f9b216af74b3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:35.042145 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb56c1b2-5c64-40ce-9c42-f9b216af74b3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:35.042589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb56c1b2-5c64-40ce-9c42-f9b216af74b3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:35.115171 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bb56c1b2-5c64-40ce-9c42-f9b216af74b3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:59:35.126300 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bb56c1b2-5c64-40ce-9c42-f9b216af74b3 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60" status: 200 len: 1318 microversion: 2.1 time: 0.102310 Oct 05 03:59:35.140718 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3903/7824] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:59:35 2022] GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 => generated 1318 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:59:36.150524 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f06add41-017d-499b-b006-dfa7b777c36e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:59:36.151400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f06add41-017d-499b-b006-dfa7b777c36e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: c3b57baa-1c9e-4892-a0ba-97e3ed8eed60] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:59:36.159643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f06add41-017d-499b-b006-dfa7b777c36e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:36.160134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f06add41-017d-499b-b006-dfa7b777c36e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:36.160577 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f06add41-017d-499b-b006-dfa7b777c36e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:36.161401 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f06add41-017d-499b-b006-dfa7b777c36e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:36.161858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f06add41-017d-499b-b006-dfa7b777c36e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:36.162282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f06add41-017d-499b-b006-dfa7b777c36e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:36.394476 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f06add41-017d-499b-b006-dfa7b777c36e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:59:36.404437 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f06add41-017d-499b-b006-dfa7b777c36e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60" status: 200 len: 1392 microversion: 2.1 time: 0.258402 Oct 05 03:59:36.409978 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3922/7825] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:59:36 2022] GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 => generated 1392 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:59:36.671218 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-50e52ebf-9f7e-4847-a1e4-8f492416150d req-aa398b50-cacc-42b1-8824-c2034c60fdbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3b57baa-1c9e-4892-a0ba-97e3ed8eed60", "tag": "aad2a043-87d6-430c-9a05-16317afb3ce7"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:59:36.683233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-50e52ebf-9f7e-4847-a1e4-8f492416150d req-aa398b50-cacc-42b1-8824-c2034c60fdbd service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:36.684047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-50e52ebf-9f7e-4847-a1e4-8f492416150d req-aa398b50-cacc-42b1-8824-c2034c60fdbd service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:36.684689 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-50e52ebf-9f7e-4847-a1e4-8f492416150d req-aa398b50-cacc-42b1-8824-c2034c60fdbd service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:36.696553 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-50e52ebf-9f7e-4847-a1e4-8f492416150d req-aa398b50-cacc-42b1-8824-c2034c60fdbd service nova] Creating event network-changed:aad2a043-87d6-430c-9a05-16317afb3ce7 for instance c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 on n-h2-858272-3 Oct 05 03:59:36.702089 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-50e52ebf-9f7e-4847-a1e4-8f492416150d req-aa398b50-cacc-42b1-8824-c2034c60fdbd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034708 Oct 05 03:59:36.702700 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3904/7826] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:59:37.434052 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-cdfbfec6-634d-47e1-b8d5-d53e4f009a78 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:59:37.434726 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-cdfbfec6-634d-47e1-b8d5-d53e4f009a78 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: c3b57baa-1c9e-4892-a0ba-97e3ed8eed60] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:59:37.441645 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdfbfec6-634d-47e1-b8d5-d53e4f009a78 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:37.442131 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdfbfec6-634d-47e1-b8d5-d53e4f009a78 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:37.442572 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdfbfec6-634d-47e1-b8d5-d53e4f009a78 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:37.443267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdfbfec6-634d-47e1-b8d5-d53e4f009a78 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:37.443722 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdfbfec6-634d-47e1-b8d5-d53e4f009a78 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:37.444152 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-cdfbfec6-634d-47e1-b8d5-d53e4f009a78 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:37.585449 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-cdfbfec6-634d-47e1-b8d5-d53e4f009a78 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:59:37.594537 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-cdfbfec6-634d-47e1-b8d5-d53e4f009a78 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60" status: 200 len: 1392 microversion: 2.1 time: 0.165051 Oct 05 03:59:37.595134 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3923/7827] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:59:37 2022] GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:59:38.626923 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bd41db2d-5d18-4074-a3c1-5119504c6a70 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:59:38.627979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bd41db2d-5d18-4074-a3c1-5119504c6a70 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: c3b57baa-1c9e-4892-a0ba-97e3ed8eed60] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:59:38.635072 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd41db2d-5d18-4074-a3c1-5119504c6a70 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:38.635574 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd41db2d-5d18-4074-a3c1-5119504c6a70 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:38.636023 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd41db2d-5d18-4074-a3c1-5119504c6a70 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:38.636721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd41db2d-5d18-4074-a3c1-5119504c6a70 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:38.637218 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd41db2d-5d18-4074-a3c1-5119504c6a70 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:38.637654 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bd41db2d-5d18-4074-a3c1-5119504c6a70 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:38.768999 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bd41db2d-5d18-4074-a3c1-5119504c6a70 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:59:38.776889 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bd41db2d-5d18-4074-a3c1-5119504c6a70 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60" status: 200 len: 1392 microversion: 2.1 time: 0.155295 Oct 05 03:59:38.777507 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3905/7828] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:59:38 2022] GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:59:39.800226 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e8302ca7-1df2-4d66-b9c5-a5b4f53cfc0f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:59:39.800841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e8302ca7-1df2-4d66-b9c5-a5b4f53cfc0f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: c3b57baa-1c9e-4892-a0ba-97e3ed8eed60] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:59:39.807920 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8302ca7-1df2-4d66-b9c5-a5b4f53cfc0f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:39.808400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8302ca7-1df2-4d66-b9c5-a5b4f53cfc0f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:39.808838 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8302ca7-1df2-4d66-b9c5-a5b4f53cfc0f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:39.809623 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8302ca7-1df2-4d66-b9c5-a5b4f53cfc0f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:39.810083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8302ca7-1df2-4d66-b9c5-a5b4f53cfc0f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:39.810545 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e8302ca7-1df2-4d66-b9c5-a5b4f53cfc0f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:39.947316 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e8302ca7-1df2-4d66-b9c5-a5b4f53cfc0f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:59:39.955060 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e8302ca7-1df2-4d66-b9c5-a5b4f53cfc0f tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60" status: 200 len: 1392 microversion: 2.1 time: 0.158685 Oct 05 03:59:39.955647 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3924/7829] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:59:39 2022] GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:59:40.978431 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-123bb453-37ae-4775-b633-a49c2f9b8c5d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:59:40.978982 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-123bb453-37ae-4775-b633-a49c2f9b8c5d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: c3b57baa-1c9e-4892-a0ba-97e3ed8eed60] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:59:40.986102 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-123bb453-37ae-4775-b633-a49c2f9b8c5d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:40.986609 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-123bb453-37ae-4775-b633-a49c2f9b8c5d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:40.987062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-123bb453-37ae-4775-b633-a49c2f9b8c5d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:40.987766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-123bb453-37ae-4775-b633-a49c2f9b8c5d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:40.988239 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-123bb453-37ae-4775-b633-a49c2f9b8c5d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:40.988681 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-123bb453-37ae-4775-b633-a49c2f9b8c5d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:41.128175 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-123bb453-37ae-4775-b633-a49c2f9b8c5d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:59:41.137107 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-123bb453-37ae-4775-b633-a49c2f9b8c5d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60" status: 200 len: 1392 microversion: 2.1 time: 0.162548 Oct 05 03:59:41.137771 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3906/7830] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:59:40 2022] GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:59:41.430846 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-9fe18133-ebc7-4640-add6-de55176c6e97 req-a3e1ab0c-8f7c-4e00-ad81-7110c83d94b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3b57baa-1c9e-4892-a0ba-97e3ed8eed60", "name": "network-vif-plugged", "status": "completed", "tag": "aad2a043-87d6-430c-9a05-16317afb3ce7"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:59:41.441481 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9fe18133-ebc7-4640-add6-de55176c6e97 req-a3e1ab0c-8f7c-4e00-ad81-7110c83d94b7 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:41.442044 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9fe18133-ebc7-4640-add6-de55176c6e97 req-a3e1ab0c-8f7c-4e00-ad81-7110c83d94b7 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:41.442762 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-9fe18133-ebc7-4640-add6-de55176c6e97 req-a3e1ab0c-8f7c-4e00-ad81-7110c83d94b7 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:41.454675 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-9fe18133-ebc7-4640-add6-de55176c6e97 req-a3e1ab0c-8f7c-4e00-ad81-7110c83d94b7 service nova] Creating event network-vif-plugged:aad2a043-87d6-430c-9a05-16317afb3ce7 for instance c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 on n-h2-858272-3 Oct 05 03:59:41.460102 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-9fe18133-ebc7-4640-add6-de55176c6e97 req-a3e1ab0c-8f7c-4e00-ad81-7110c83d94b7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118715 Oct 05 03:59:41.461218 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3925/7831] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:59:42.159750 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-faf15f17-7927-4898-8336-7b6281f2fd1a tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:59:42.160374 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-faf15f17-7927-4898-8336-7b6281f2fd1a tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: c3b57baa-1c9e-4892-a0ba-97e3ed8eed60] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:59:42.167340 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-faf15f17-7927-4898-8336-7b6281f2fd1a tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:42.167841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-faf15f17-7927-4898-8336-7b6281f2fd1a tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:42.168285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-faf15f17-7927-4898-8336-7b6281f2fd1a tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:42.169000 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-faf15f17-7927-4898-8336-7b6281f2fd1a tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:42.169463 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-faf15f17-7927-4898-8336-7b6281f2fd1a tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:42.169895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-faf15f17-7927-4898-8336-7b6281f2fd1a tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:42.312955 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-faf15f17-7927-4898-8336-7b6281f2fd1a tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:59:42.320603 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-faf15f17-7927-4898-8336-7b6281f2fd1a tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60" status: 200 len: 1392 microversion: 2.1 time: 0.164884 Oct 05 03:59:42.321213 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3907/7832] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:59:42 2022] GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:59:43.343885 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ac48a569-c842-483d-9bcd-7aa932020e4b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:59:43.344598 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ac48a569-c842-483d-9bcd-7aa932020e4b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: c3b57baa-1c9e-4892-a0ba-97e3ed8eed60] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:59:43.351709 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac48a569-c842-483d-9bcd-7aa932020e4b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:43.352198 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac48a569-c842-483d-9bcd-7aa932020e4b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:43.352636 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac48a569-c842-483d-9bcd-7aa932020e4b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:43.353353 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac48a569-c842-483d-9bcd-7aa932020e4b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:43.353812 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac48a569-c842-483d-9bcd-7aa932020e4b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:43.354376 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ac48a569-c842-483d-9bcd-7aa932020e4b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:43.487479 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ac48a569-c842-483d-9bcd-7aa932020e4b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:59:43.495497 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ac48a569-c842-483d-9bcd-7aa932020e4b tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60" status: 200 len: 1564 microversion: 2.1 time: 0.155911 Oct 05 03:59:43.496070 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3926/7833] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:59:43 2022] GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 03:59:43.518720 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bfb06d4d-e9f9-4072-9c2f-0049be67becd tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:59:43.519709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bfb06d4d-e9f9-4072-9c2f-0049be67becd tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: c3b57baa-1c9e-4892-a0ba-97e3ed8eed60] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:59:43.521520 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:59:43.523309 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:59:43.530983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bfb06d4d-e9f9-4072-9c2f-0049be67becd tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:43.531491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bfb06d4d-e9f9-4072-9c2f-0049be67becd tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:43.531932 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bfb06d4d-e9f9-4072-9c2f-0049be67becd tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:43.532637 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bfb06d4d-e9f9-4072-9c2f-0049be67becd tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:43.533129 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bfb06d4d-e9f9-4072-9c2f-0049be67becd tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:43.533567 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bfb06d4d-e9f9-4072-9c2f-0049be67becd tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:43.664373 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bfb06d4d-e9f9-4072-9c2f-0049be67becd tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:59:43.672282 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bfb06d4d-e9f9-4072-9c2f-0049be67becd tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60" status: 200 len: 1564 microversion: 2.1 time: 0.157389 Oct 05 03:59:43.672866 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3908/7834] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:59:43 2022] GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 03:59:45.589628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-42269ab4-1060-46d6-bf2c-ef9422f284af req-7a9f7535-98d6-4a79-9944-477fc6b2a5c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3b57baa-1c9e-4892-a0ba-97e3ed8eed60", "tag": "aad2a043-87d6-430c-9a05-16317afb3ce7"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 03:59:45.600994 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-86d76171-94c2-4451-9df9-f19285922ece tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 03:59:45.601653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-86d76171-94c2-4451-9df9-f19285922ece tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: c3b57baa-1c9e-4892-a0ba-97e3ed8eed60] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 03:59:45.604106 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:59:45.613453 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86d76171-94c2-4451-9df9-f19285922ece tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:45.613948 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86d76171-94c2-4451-9df9-f19285922ece tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:45.614390 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86d76171-94c2-4451-9df9-f19285922ece tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:45.615091 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86d76171-94c2-4451-9df9-f19285922ece tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:45.615549 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86d76171-94c2-4451-9df9-f19285922ece tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:45.615973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-86d76171-94c2-4451-9df9-f19285922ece tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:45.620263 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-42269ab4-1060-46d6-bf2c-ef9422f284af req-7a9f7535-98d6-4a79-9944-477fc6b2a5c6 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 03:59:45.620759 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-42269ab4-1060-46d6-bf2c-ef9422f284af req-7a9f7535-98d6-4a79-9944-477fc6b2a5c6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 03:59:45.621227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-42269ab4-1060-46d6-bf2c-ef9422f284af req-7a9f7535-98d6-4a79-9944-477fc6b2a5c6 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 03:59:45.636161 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-42269ab4-1060-46d6-bf2c-ef9422f284af req-7a9f7535-98d6-4a79-9944-477fc6b2a5c6 service nova] Creating event network-changed:aad2a043-87d6-430c-9a05-16317afb3ce7 for instance c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 on n-h2-858272-3 Oct 05 03:59:45.641637 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-42269ab4-1060-46d6-bf2c-ef9422f284af req-7a9f7535-98d6-4a79-9944-477fc6b2a5c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055789 Oct 05 03:59:45.642571 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3909/7835] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 03:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 03:59:45.848758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-86d76171-94c2-4451-9df9-f19285922ece tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 03:59:45.857502 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-86d76171-94c2-4451-9df9-f19285922ece tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60" status: 200 len: 1564 microversion: 2.1 time: 0.275835 Oct 05 03:59:45.858097 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3927/7836] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 03:59:45 2022] GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 => generated 1564 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:00:19.149084 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:00:19.149849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=36 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:00:19.154833 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7c505d7a-9b2f-4b18-98bb-8fb0a5f2d859 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:00:19.157113 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7c505d7a-9b2f-4b18-98bb-8fb0a5f2d859 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: c3b57baa-1c9e-4892-a0ba-97e3ed8eed60] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:00:19.164667 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c505d7a-9b2f-4b18-98bb-8fb0a5f2d859 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:00:19.165231 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c505d7a-9b2f-4b18-98bb-8fb0a5f2d859 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:00:19.165682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c505d7a-9b2f-4b18-98bb-8fb0a5f2d859 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:00:19.166377 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c505d7a-9b2f-4b18-98bb-8fb0a5f2d859 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:00:19.166841 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c505d7a-9b2f-4b18-98bb-8fb0a5f2d859 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:00:19.167967 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7c505d7a-9b2f-4b18-98bb-8fb0a5f2d859 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:00:19.236751 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7c505d7a-9b2f-4b18-98bb-8fb0a5f2d859 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "POST /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60/action" status: 200 len: 24571 microversion: 2.1 time: 0.090083 Oct 05 04:00:19.237453 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3910/7837] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 04:00:19 2022] POST /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60/action => generated 24571 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 04:00:58.243542 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:00:58.244375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=32 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:00:58.434830 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f60fb4b7-a9a9-42d7-8f40-e20c2652dd21 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:00:58.435361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f60fb4b7-a9a9-42d7-8f40-e20c2652dd21 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: c3b57baa-1c9e-4892-a0ba-97e3ed8eed60] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:00:58.442044 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f60fb4b7-a9a9-42d7-8f40-e20c2652dd21 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:00:58.442533 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f60fb4b7-a9a9-42d7-8f40-e20c2652dd21 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:00:58.442974 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f60fb4b7-a9a9-42d7-8f40-e20c2652dd21 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:00:58.443665 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f60fb4b7-a9a9-42d7-8f40-e20c2652dd21 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:00:58.444121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f60fb4b7-a9a9-42d7-8f40-e20c2652dd21 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:00:58.444567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f60fb4b7-a9a9-42d7-8f40-e20c2652dd21 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:00:58.468131 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-f60fb4b7-a9a9-42d7-8f40-e20c2652dd21 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lazy-loading 'flavor' on Instance uuid c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 04:00:58.533438 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f60fb4b7-a9a9-42d7-8f40-e20c2652dd21 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "POST /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60/action" status: 202 len: 0 microversion: 2.1 time: 0.291372 Oct 05 04:00:58.533975 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3928/7838] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 04:00:58 2022] POST /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 04:00:58.543138 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ad894258-f7e2-4605-993a-a2613a49c9c5 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:00:58.543945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ad894258-f7e2-4605-993a-a2613a49c9c5 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: c3b57baa-1c9e-4892-a0ba-97e3ed8eed60] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:00:58.546731 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:00:58.547397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:00:58.555285 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad894258-f7e2-4605-993a-a2613a49c9c5 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:00:58.555791 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad894258-f7e2-4605-993a-a2613a49c9c5 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:00:58.556245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad894258-f7e2-4605-993a-a2613a49c9c5 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:00:58.557065 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad894258-f7e2-4605-993a-a2613a49c9c5 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:00:58.557537 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad894258-f7e2-4605-993a-a2613a49c9c5 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:00:58.557979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ad894258-f7e2-4605-993a-a2613a49c9c5 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:00:58.696635 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ad894258-f7e2-4605-993a-a2613a49c9c5 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:00:58.704467 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ad894258-f7e2-4605-993a-a2613a49c9c5 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60" status: 200 len: 1691 microversion: 2.1 time: 0.165959 Oct 05 04:00:58.705062 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3911/7839] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:00:58 2022] GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:00:59.731710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5d92b4fc-83b5-4262-aa14-b2d09789e92d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:00:59.732405 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5d92b4fc-83b5-4262-aa14-b2d09789e92d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: c3b57baa-1c9e-4892-a0ba-97e3ed8eed60] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:00:59.739730 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d92b4fc-83b5-4262-aa14-b2d09789e92d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:00:59.740209 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d92b4fc-83b5-4262-aa14-b2d09789e92d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:00:59.740643 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d92b4fc-83b5-4262-aa14-b2d09789e92d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:00:59.741352 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d92b4fc-83b5-4262-aa14-b2d09789e92d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:00:59.741803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d92b4fc-83b5-4262-aa14-b2d09789e92d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:00:59.742248 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5d92b4fc-83b5-4262-aa14-b2d09789e92d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:00:59.872201 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5d92b4fc-83b5-4262-aa14-b2d09789e92d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:00:59.880002 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5d92b4fc-83b5-4262-aa14-b2d09789e92d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60" status: 200 len: 1691 microversion: 2.1 time: 0.154207 Oct 05 04:00:59.880569 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3929/7840] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:00:59 2022] GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:01:00.903314 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-9448709d-f68a-490a-873d-170a64ac1f4e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:01:00.903945 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-9448709d-f68a-490a-873d-170a64ac1f4e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: c3b57baa-1c9e-4892-a0ba-97e3ed8eed60] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:01:00.911390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9448709d-f68a-490a-873d-170a64ac1f4e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:00.911888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9448709d-f68a-490a-873d-170a64ac1f4e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:00.912333 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9448709d-f68a-490a-873d-170a64ac1f4e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:00.913059 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9448709d-f68a-490a-873d-170a64ac1f4e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:00.913524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9448709d-f68a-490a-873d-170a64ac1f4e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:00.913957 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-9448709d-f68a-490a-873d-170a64ac1f4e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:01.048478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-9448709d-f68a-490a-873d-170a64ac1f4e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:01:01.056341 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-9448709d-f68a-490a-873d-170a64ac1f4e tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60" status: 200 len: 1674 microversion: 2.1 time: 0.156918 Oct 05 04:01:01.056950 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3912/7841] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:01:00 2022] GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:01:02.151761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8494a070-7eb4-43c1-a36c-cbdb7b3758c6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:01:02.154173 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8494a070-7eb4-43c1-a36c-cbdb7b3758c6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: c3b57baa-1c9e-4892-a0ba-97e3ed8eed60] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:01:02.161236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8494a070-7eb4-43c1-a36c-cbdb7b3758c6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:02.161721 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8494a070-7eb4-43c1-a36c-cbdb7b3758c6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:02.162160 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8494a070-7eb4-43c1-a36c-cbdb7b3758c6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:02.162856 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8494a070-7eb4-43c1-a36c-cbdb7b3758c6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:02.163314 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8494a070-7eb4-43c1-a36c-cbdb7b3758c6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:02.163739 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8494a070-7eb4-43c1-a36c-cbdb7b3758c6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:02.228219 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8494a070-7eb4-43c1-a36c-cbdb7b3758c6 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "POST /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60/action" status: 200 len: 38351 microversion: 2.1 time: 0.080212 Oct 05 04:01:02.228877 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3930/7842] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 04:01:02 2022] POST /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60/action => generated 38351 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 04:01:02.241637 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-14531afe-13f4-4dd4-826f-75917e79b9da tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:01:02.242160 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-14531afe-13f4-4dd4-826f-75917e79b9da tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: c3b57baa-1c9e-4892-a0ba-97e3ed8eed60] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:01:02.249512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14531afe-13f4-4dd4-826f-75917e79b9da tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:02.250010 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14531afe-13f4-4dd4-826f-75917e79b9da tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:02.250465 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14531afe-13f4-4dd4-826f-75917e79b9da tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:02.251170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14531afe-13f4-4dd4-826f-75917e79b9da tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:02.251651 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14531afe-13f4-4dd4-826f-75917e79b9da tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:02.252089 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-14531afe-13f4-4dd4-826f-75917e79b9da tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:02.317232 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-14531afe-13f4-4dd4-826f-75917e79b9da tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "POST /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60/action" status: 202 len: 0 microversion: 2.1 time: 0.079072 Oct 05 04:01:02.317685 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3913/7843] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 04:01:02 2022] POST /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 04:01:02.326434 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-94992b45-5384-4197-80be-d448044edf89 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:01:02.327144 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-94992b45-5384-4197-80be-d448044edf89 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: c3b57baa-1c9e-4892-a0ba-97e3ed8eed60] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:01:02.334417 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94992b45-5384-4197-80be-d448044edf89 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:02.334913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94992b45-5384-4197-80be-d448044edf89 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:02.335356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94992b45-5384-4197-80be-d448044edf89 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:02.336062 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94992b45-5384-4197-80be-d448044edf89 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:02.336515 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94992b45-5384-4197-80be-d448044edf89 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:02.337254 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94992b45-5384-4197-80be-d448044edf89 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:02.512273 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-94992b45-5384-4197-80be-d448044edf89 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:01:02.520529 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-94992b45-5384-4197-80be-d448044edf89 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60" status: 200 len: 1680 microversion: 2.1 time: 0.198357 Oct 05 04:01:02.521160 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3931/7844] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:01:02 2022] GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 => generated 1680 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:01:03.546365 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-70ae095b-aa63-4ade-a529-de5b097fd792 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:01:03.547074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-70ae095b-aa63-4ade-a529-de5b097fd792 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: c3b57baa-1c9e-4892-a0ba-97e3ed8eed60] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:01:03.553240 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-70ae095b-aa63-4ade-a529-de5b097fd792 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:03.553737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-70ae095b-aa63-4ade-a529-de5b097fd792 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:03.554518 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-70ae095b-aa63-4ade-a529-de5b097fd792 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:03.555229 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-70ae095b-aa63-4ade-a529-de5b097fd792 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:03.555697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-70ae095b-aa63-4ade-a529-de5b097fd792 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:03.556261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-70ae095b-aa63-4ade-a529-de5b097fd792 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:03.693697 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-70ae095b-aa63-4ade-a529-de5b097fd792 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:01:03.701772 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-70ae095b-aa63-4ade-a529-de5b097fd792 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60" status: 200 len: 1680 microversion: 2.1 time: 0.161352 Oct 05 04:01:03.702346 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3914/7845] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:01:03 2022] GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:01:04.724853 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-82f7600d-ad29-4a7f-812d-e3c0c07ecc07 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:01:04.725504 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-82f7600d-ad29-4a7f-812d-e3c0c07ecc07 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: c3b57baa-1c9e-4892-a0ba-97e3ed8eed60] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:01:04.732305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-82f7600d-ad29-4a7f-812d-e3c0c07ecc07 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:04.732787 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-82f7600d-ad29-4a7f-812d-e3c0c07ecc07 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:04.733402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-82f7600d-ad29-4a7f-812d-e3c0c07ecc07 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:04.734092 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-82f7600d-ad29-4a7f-812d-e3c0c07ecc07 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:04.734544 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-82f7600d-ad29-4a7f-812d-e3c0c07ecc07 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:04.734965 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-82f7600d-ad29-4a7f-812d-e3c0c07ecc07 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:04.867432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-82f7600d-ad29-4a7f-812d-e3c0c07ecc07 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:01:04.875617 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-82f7600d-ad29-4a7f-812d-e3c0c07ecc07 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60" status: 200 len: 1683 microversion: 2.1 time: 0.154705 Oct 05 04:01:04.876185 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3932/7846] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:01:04 2022] GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:01:04.973492 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-75a985c2-88cc-477f-8de2-26c3b2dfa098 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:01:04.975744 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-75a985c2-88cc-477f-8de2-26c3b2dfa098 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: c3b57baa-1c9e-4892-a0ba-97e3ed8eed60] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:01:04.983280 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75a985c2-88cc-477f-8de2-26c3b2dfa098 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:04.983786 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75a985c2-88cc-477f-8de2-26c3b2dfa098 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:04.984244 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75a985c2-88cc-477f-8de2-26c3b2dfa098 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:04.984995 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75a985c2-88cc-477f-8de2-26c3b2dfa098 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:04.985728 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75a985c2-88cc-477f-8de2-26c3b2dfa098 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:04.986169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-75a985c2-88cc-477f-8de2-26c3b2dfa098 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:05.052594 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-75a985c2-88cc-477f-8de2-26c3b2dfa098 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "POST /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60/action" status: 200 len: 38351 microversion: 2.1 time: 0.082998 Oct 05 04:01:05.053291 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3915/7847] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 04:01:04 2022] POST /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60/action => generated 38351 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 04:01:06.021250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c7094a57-7a14-4209-87fa-0160a9a8e7bf tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:01:06.021779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c7094a57-7a14-4209-87fa-0160a9a8e7bf tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: c3b57baa-1c9e-4892-a0ba-97e3ed8eed60] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:01:06.024246 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-591bc1bb-2850-4be1-ba76-bb39f132d89d req-21d320a6-ba37-4b0a-bb57-1948c21e7717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3b57baa-1c9e-4892-a0ba-97e3ed8eed60", "tag": "aad2a043-87d6-430c-9a05-16317afb3ce7"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:01:06.028957 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c7094a57-7a14-4209-87fa-0160a9a8e7bf tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:06.030149 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c7094a57-7a14-4209-87fa-0160a9a8e7bf tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:06.030587 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c7094a57-7a14-4209-87fa-0160a9a8e7bf tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:06.031555 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c7094a57-7a14-4209-87fa-0160a9a8e7bf tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:06.032016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c7094a57-7a14-4209-87fa-0160a9a8e7bf tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:06.032443 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c7094a57-7a14-4209-87fa-0160a9a8e7bf tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:06.037216 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-591bc1bb-2850-4be1-ba76-bb39f132d89d req-21d320a6-ba37-4b0a-bb57-1948c21e7717 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:06.037836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-591bc1bb-2850-4be1-ba76-bb39f132d89d req-21d320a6-ba37-4b0a-bb57-1948c21e7717 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:06.038270 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-591bc1bb-2850-4be1-ba76-bb39f132d89d req-21d320a6-ba37-4b0a-bb57-1948c21e7717 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:06.049555 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-591bc1bb-2850-4be1-ba76-bb39f132d89d req-21d320a6-ba37-4b0a-bb57-1948c21e7717 service nova] Creating event network-changed:aad2a043-87d6-430c-9a05-16317afb3ce7 for instance c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 on n-h2-858272-3 Oct 05 04:01:06.054968 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-591bc1bb-2850-4be1-ba76-bb39f132d89d req-21d320a6-ba37-4b0a-bb57-1948c21e7717 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034844 Oct 05 04:01:06.055589 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3916/7848] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 04:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 04:01:06.063545 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c7094a57-7a14-4209-87fa-0160a9a8e7bf tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: c3b57baa-1c9e-4892-a0ba-97e3ed8eed60] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 04:01:06.156829 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c7094a57-7a14-4209-87fa-0160a9a8e7bf tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60" status: 204 len: 0 microversion: 2.1 time: 0.139240 Oct 05 04:01:06.157464 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3933/7849] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 04:01:06 2022] DELETE /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 04:01:06.167888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c4f3f5cf-6252-4a17-af01-f42b123b7b2d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:01:06.168609 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c4f3f5cf-6252-4a17-af01-f42b123b7b2d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: c3b57baa-1c9e-4892-a0ba-97e3ed8eed60] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:01:06.175114 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4f3f5cf-6252-4a17-af01-f42b123b7b2d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:06.175618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4f3f5cf-6252-4a17-af01-f42b123b7b2d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:06.176068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4f3f5cf-6252-4a17-af01-f42b123b7b2d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:06.176783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4f3f5cf-6252-4a17-af01-f42b123b7b2d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:06.177283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4f3f5cf-6252-4a17-af01-f42b123b7b2d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:06.177722 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4f3f5cf-6252-4a17-af01-f42b123b7b2d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:06.347713 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c4f3f5cf-6252-4a17-af01-f42b123b7b2d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:01:06.355765 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c4f3f5cf-6252-4a17-af01-f42b123b7b2d tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60" status: 200 len: 1689 microversion: 2.1 time: 0.193440 Oct 05 04:01:06.356455 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3917/7850] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:01:06 2022] GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 => generated 1689 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 04:01:07.382803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-48d2f8a7-9421-4155-a4ef-e26568b34eb0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:01:07.383509 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-48d2f8a7-9421-4155-a4ef-e26568b34eb0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: c3b57baa-1c9e-4892-a0ba-97e3ed8eed60] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:01:07.392467 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48d2f8a7-9421-4155-a4ef-e26568b34eb0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:07.393050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48d2f8a7-9421-4155-a4ef-e26568b34eb0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:07.393498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48d2f8a7-9421-4155-a4ef-e26568b34eb0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:07.394194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48d2f8a7-9421-4155-a4ef-e26568b34eb0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:07.394650 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48d2f8a7-9421-4155-a4ef-e26568b34eb0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:07.395077 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-48d2f8a7-9421-4155-a4ef-e26568b34eb0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:07.597964 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-48d2f8a7-9421-4155-a4ef-e26568b34eb0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:01:07.605852 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-48d2f8a7-9421-4155-a4ef-e26568b34eb0 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60" status: 200 len: 1689 microversion: 2.1 time: 0.227443 Oct 05 04:01:07.606433 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3934/7851] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:01:07 2022] GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 => generated 1689 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:01:08.551420 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-48255091-0bda-4dd7-b253-a257d7e24d99 req-80ba6e00-03f5-4e39-885f-7a473ff2261c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3b57baa-1c9e-4892-a0ba-97e3ed8eed60", "name": "network-vif-deleted", "tag": "aad2a043-87d6-430c-9a05-16317afb3ce7"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:01:08.562585 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-48255091-0bda-4dd7-b253-a257d7e24d99 req-80ba6e00-03f5-4e39-885f-7a473ff2261c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:08.563079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-48255091-0bda-4dd7-b253-a257d7e24d99 req-80ba6e00-03f5-4e39-885f-7a473ff2261c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:08.563527 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-48255091-0bda-4dd7-b253-a257d7e24d99 req-80ba6e00-03f5-4e39-885f-7a473ff2261c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:08.574703 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-48255091-0bda-4dd7-b253-a257d7e24d99 req-80ba6e00-03f5-4e39-885f-7a473ff2261c service nova] Creating event network-vif-deleted:aad2a043-87d6-430c-9a05-16317afb3ce7 for instance c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 on n-h2-858272-3 Oct 05 04:01:08.580349 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-48255091-0bda-4dd7-b253-a257d7e24d99 req-80ba6e00-03f5-4e39-885f-7a473ff2261c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165161 Oct 05 04:01:08.581198 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3918/7852] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 04:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 04:01:08.629810 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c375700e-7527-4064-a733-8a92a3b042c4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:01:08.630365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c375700e-7527-4064-a733-8a92a3b042c4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: c3b57baa-1c9e-4892-a0ba-97e3ed8eed60] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:01:08.637323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c375700e-7527-4064-a733-8a92a3b042c4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:08.637834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c375700e-7527-4064-a733-8a92a3b042c4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:08.638272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c375700e-7527-4064-a733-8a92a3b042c4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:08.639203 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c375700e-7527-4064-a733-8a92a3b042c4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:08.639671 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c375700e-7527-4064-a733-8a92a3b042c4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:08.640101 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c375700e-7527-4064-a733-8a92a3b042c4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:08.672933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c375700e-7527-4064-a733-8a92a3b042c4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:08.673447 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c375700e-7527-4064-a733-8a92a3b042c4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:08.673887 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c375700e-7527-4064-a733-8a92a3b042c4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:08.674337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-c375700e-7527-4064-a733-8a92a3b042c4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lazy-loading 'fault' on Instance uuid c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 04:01:08.716154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c375700e-7527-4064-a733-8a92a3b042c4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830bf52116814aa283b1a5d20f643682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62f31970d95490d8329d9f1a2583256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:01:08.724667 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c375700e-7527-4064-a733-8a92a3b042c4 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60" status: 200 len: 1356 microversion: 2.1 time: 0.098717 Oct 05 04:01:08.725282 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3935/7853] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:01:08 2022] GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 => generated 1356 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:01:09.751686 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1bfcc424-fe3b-41ab-b784-8f0a70fdb94a tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:01:09.752395 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1bfcc424-fe3b-41ab-b784-8f0a70fdb94a tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] [instance: c3b57baa-1c9e-4892-a0ba-97e3ed8eed60] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:01:09.758607 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bfcc424-fe3b-41ab-b784-8f0a70fdb94a tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:09.759104 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bfcc424-fe3b-41ab-b784-8f0a70fdb94a tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:09.759549 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bfcc424-fe3b-41ab-b784-8f0a70fdb94a tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:09.760444 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bfcc424-fe3b-41ab-b784-8f0a70fdb94a tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:09.760946 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bfcc424-fe3b-41ab-b784-8f0a70fdb94a tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:09.761391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1bfcc424-fe3b-41ab-b784-8f0a70fdb94a tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:09.774306 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-1bfcc424-fe3b-41ab-b784-8f0a70fdb94a tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] HTTP exception thrown: Instance c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 could not be found. Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1bfcc424-fe3b-41ab-b784-8f0a70fdb94a tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Request method failure captured: Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 HTTP/1.1 Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPP7t75QoFC_cP5HwioD_odBrlcEgV1-V5Rs5FLCvkADbW5MpREEMSMdghaEC_Y9GJl526rfMTWs_KEbVUknAzYVkt8erJl73U2sRPdQb-PAjHyVtgAOdx-oxTvsCWduFNaqBjuDJ_DOf4K2FkPK6jN6v3nnTQojPxC3Z_RoZ9eVHZz8 Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: c62f31970d95490d8329d9f1a2583256 Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-530340361 Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c62f31970d95490d8329d9f1a2583256"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c62f31970d95490d8329d9f1a2583256"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c62f31970d95490d8329d9f1a2583256"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c62f31970d95490d8329d9f1a2583256"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-TestNetworkAdvancedServerOps-530340361 Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: c62f31970d95490d8329d9f1a2583256 Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-530340361 Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-TestNetworkAdvancedServerOps-530340361-project Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: 830bf52116814aa283b1a5d20f643682 Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-TestNetworkAdvancedServerOps-530340361-project Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 could not be found. Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'c3b57baa-1c9e-4892-a0ba-97e3ed8eed60'} Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 could not be found. Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 could not be found. Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 04:01:09.775922 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 04:01:09.781503 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 04:01:09.781503 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 04:01:09.781503 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 04:01:09.781503 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 04:01:09.781503 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 04:01:09.781503 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 04:01:09.781503 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 could not be found. Oct 05 04:01:09.781503 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 04:01:09.781503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1bfcc424-fe3b-41ab-b784-8f0a70fdb94a tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Returning 404 to user: Instance c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 04:01:09.781503 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1bfcc424-fe3b-41ab-b784-8f0a70fdb94a tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60" status: 404 len: 111 microversion: 2.1 time: 0.031646 Oct 05 04:01:09.781503 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3919/7854] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:01:09 2022] GET /compute/v2.1/servers/c3b57baa-1c9e-4892-a0ba-97e3ed8eed60 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 04:01:13.085110 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-513b8de3-5826-4de7-8ac2-0b1df300f007 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] Calling method '.version_select at 0x7fccdfd1d4c0>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:01:13.107607 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-513b8de3-5826-4de7-8ac2-0b1df300f007 tempest-TestNetworkAdvancedServerOps-530340361 tempest-TestNetworkAdvancedServerOps-530340361-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1118966425" status: 202 len: 0 microversion: 2.1 time: 0.025134 Oct 05 04:01:13.108478 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3936/7855] 10.222.0.16 () {58 vars in 1284 bytes} [Wed Oct 5 04:01:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1118966425 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 04:01:24.155482 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=18 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:01:24.156476 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:01:24.340451 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-89be95f2-9d26-4630-b44c-ce07fafdc986 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Action: 'create', calling method: .version_select at 0x7fccdf3cc430>, body: {"keypair": {"name": "tempest-TestShelveInstance-1039365775", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLf/h+49YHfVkf0aMUa59tIUB/6Inlf3BRIgO0Gpjstr26rvx/iDJ6bKXAPbTZHj3EHqdzRjp+gZ8sPpJpqUky3RjfjumPDK/h2ybNuryDECoDS8CxrT6/tYWcT4tBDoPA=="}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:01:24.357448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-89be95f2-9d26-4630-b44c-ce07fafdc986 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Getting quotas for project 8270dd7d19da4edc9b1a5e7598e0e1cf. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 04:01:24.367801 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-89be95f2-9d26-4630-b44c-ce07fafdc986 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Getting quotas for user 60d6950cfc304bebbb08fc94704b34a6 and project 8270dd7d19da4edc9b1a5e7598e0e1cf. Resources: {'key_pairs'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 04:01:24.399469 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-89be95f2-9d26-4630-b44c-ce07fafdc986 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.249745 Oct 05 04:01:24.400478 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3920/7856] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 04:01:24 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 04:01:25.427239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6a66dae6-b0d1-4869-a390-9ad1c2b038e8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1307413954", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1039365775", "security_groups": [{"name": "tempest-secgroup-smoke-146321460"}], "networks": [{"uuid": "1b09aa57-2434-44e2-9305-4da7618914b6"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:01:25.441204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:01:25.441876 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:01:25.573651 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-6a66dae6-b0d1-4869-a390-9ad1c2b038e8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] validate_networks() for [('1b09aa57-2434-44e2-9305-4da7618914b6', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 04:01:25.989834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-6a66dae6-b0d1-4869-a390-9ad1c2b038e8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 04:01:25.990257 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-6a66dae6-b0d1-4869-a390-9ad1c2b038e8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 04:01:25.990729 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-6a66dae6-b0d1-4869-a390-9ad1c2b038e8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 04:01:25.991164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-6a66dae6-b0d1-4869-a390-9ad1c2b038e8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 04:01:25.991575 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-6a66dae6-b0d1-4869-a390-9ad1c2b038e8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 04:01:26.000966 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a66dae6-b0d1-4869-a390-9ad1c2b038e8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:26.001415 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a66dae6-b0d1-4869-a390-9ad1c2b038e8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:26.001851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a66dae6-b0d1-4869-a390-9ad1c2b038e8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:26.002575 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a66dae6-b0d1-4869-a390-9ad1c2b038e8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:26.003031 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a66dae6-b0d1-4869-a390-9ad1c2b038e8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:26.003456 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6a66dae6-b0d1-4869-a390-9ad1c2b038e8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:26.021566 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-6a66dae6-b0d1-4869-a390-9ad1c2b038e8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Getting quotas for project 8270dd7d19da4edc9b1a5e7598e0e1cf. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 04:01:26.027112 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-6a66dae6-b0d1-4869-a390-9ad1c2b038e8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Getting quotas for user 60d6950cfc304bebbb08fc94704b34a6 and project 8270dd7d19da4edc9b1a5e7598e0e1cf. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 04:01:26.040576 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6a66dae6-b0d1-4869-a390-9ad1c2b038e8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 04:01:26.042930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6a66dae6-b0d1-4869-a390-9ad1c2b038e8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 04:01:26.093448 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6a66dae6-b0d1-4869-a390-9ad1c2b038e8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.669902 Oct 05 04:01:26.094562 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3937/7857] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 04:01:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 04:01:26.106247 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-31a4fb1a-4fb5-4433-aa95-dc6aec556729 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:01:26.107007 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-31a4fb1a-4fb5-4433-aa95-dc6aec556729 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:01:26.176782 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-31a4fb1a-4fb5-4433-aa95-dc6aec556729 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:01:26.184134 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-31a4fb1a-4fb5-4433-aa95-dc6aec556729 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1247 microversion: 2.1 time: 0.082602 Oct 05 04:01:26.185232 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3921/7858] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:01:26 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1247 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:01:27.208638 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2b2c14ce-31f4-42fd-8b03-c41020b98b1f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:01:27.209239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2b2c14ce-31f4-42fd-8b03-c41020b98b1f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:01:27.218969 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b2c14ce-31f4-42fd-8b03-c41020b98b1f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:27.219500 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b2c14ce-31f4-42fd-8b03-c41020b98b1f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:27.220192 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b2c14ce-31f4-42fd-8b03-c41020b98b1f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:27.221075 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b2c14ce-31f4-42fd-8b03-c41020b98b1f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:27.221389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b2c14ce-31f4-42fd-8b03-c41020b98b1f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:27.221817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b2c14ce-31f4-42fd-8b03-c41020b98b1f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:27.336295 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2b2c14ce-31f4-42fd-8b03-c41020b98b1f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:01:27.346340 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2b2c14ce-31f4-42fd-8b03-c41020b98b1f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1307 microversion: 2.1 time: 0.142277 Oct 05 04:01:27.347128 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3938/7859] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:01:27 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1307 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:01:28.374261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5d2a7bfc-304b-4e03-a2cd-41190b542c26 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:01:28.375503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5d2a7bfc-304b-4e03-a2cd-41190b542c26 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:01:28.384773 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d2a7bfc-304b-4e03-a2cd-41190b542c26 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:28.385509 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d2a7bfc-304b-4e03-a2cd-41190b542c26 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:28.386148 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d2a7bfc-304b-4e03-a2cd-41190b542c26 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:28.387163 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d2a7bfc-304b-4e03-a2cd-41190b542c26 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:28.390418 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d2a7bfc-304b-4e03-a2cd-41190b542c26 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:28.391107 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5d2a7bfc-304b-4e03-a2cd-41190b542c26 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:28.708137 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5d2a7bfc-304b-4e03-a2cd-41190b542c26 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:01:28.718226 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5d2a7bfc-304b-4e03-a2cd-41190b542c26 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1372 microversion: 2.1 time: 0.348125 Oct 05 04:01:28.718884 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3922/7860] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:01:28 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1372 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:01:28.975183 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-ede83543-680e-4914-94f3-6a973256a2c7 req-76e4141d-da3f-45c0-945a-a9ad53949f0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b39bf6c3-d041-48b4-b27a-388d6c2f7b7f", "tag": "070725cd-09d8-4df5-8632-579bdd28f163"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:01:28.986705 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ede83543-680e-4914-94f3-6a973256a2c7 req-76e4141d-da3f-45c0-945a-a9ad53949f0d service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:28.988230 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ede83543-680e-4914-94f3-6a973256a2c7 req-76e4141d-da3f-45c0-945a-a9ad53949f0d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:28.988688 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-ede83543-680e-4914-94f3-6a973256a2c7 req-76e4141d-da3f-45c0-945a-a9ad53949f0d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:29.000894 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-ede83543-680e-4914-94f3-6a973256a2c7 req-76e4141d-da3f-45c0-945a-a9ad53949f0d service nova] Creating event network-changed:070725cd-09d8-4df5-8632-579bdd28f163 for instance b39bf6c3-d041-48b4-b27a-388d6c2f7b7f on n-h1-858272-3 Oct 05 04:01:29.005922 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-ede83543-680e-4914-94f3-6a973256a2c7 req-76e4141d-da3f-45c0-945a-a9ad53949f0d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035437 Oct 05 04:01:29.006527 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3939/7861] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 04:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 04:01:29.743668 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0b8516ef-adc8-4544-9b10-434b9e1e75a1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:01:29.744298 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0b8516ef-adc8-4544-9b10-434b9e1e75a1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:01:29.751450 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b8516ef-adc8-4544-9b10-434b9e1e75a1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:29.751951 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b8516ef-adc8-4544-9b10-434b9e1e75a1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:29.752403 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b8516ef-adc8-4544-9b10-434b9e1e75a1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:29.753135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b8516ef-adc8-4544-9b10-434b9e1e75a1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:29.753606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b8516ef-adc8-4544-9b10-434b9e1e75a1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:29.754045 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b8516ef-adc8-4544-9b10-434b9e1e75a1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:29.886733 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0b8516ef-adc8-4544-9b10-434b9e1e75a1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:01:29.895489 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0b8516ef-adc8-4544-9b10-434b9e1e75a1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1372 microversion: 2.1 time: 0.155478 Oct 05 04:01:29.896101 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3923/7862] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:01:29 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:01:30.920827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6ea6a4aa-3a13-4954-bf51-bed0640ba4d1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:01:30.921518 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6ea6a4aa-3a13-4954-bf51-bed0640ba4d1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:01:30.928715 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ea6a4aa-3a13-4954-bf51-bed0640ba4d1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:30.929354 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ea6a4aa-3a13-4954-bf51-bed0640ba4d1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:30.929814 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ea6a4aa-3a13-4954-bf51-bed0640ba4d1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:30.930516 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ea6a4aa-3a13-4954-bf51-bed0640ba4d1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:30.930976 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ea6a4aa-3a13-4954-bf51-bed0640ba4d1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:30.931406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6ea6a4aa-3a13-4954-bf51-bed0640ba4d1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:31.066009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6ea6a4aa-3a13-4954-bf51-bed0640ba4d1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:01:31.073847 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6ea6a4aa-3a13-4954-bf51-bed0640ba4d1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1372 microversion: 2.1 time: 0.158470 Oct 05 04:01:31.074421 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3940/7863] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:01:30 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:01:32.097368 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b2263bb7-baf0-4d41-b515-796cac162b26 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:01:32.097929 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b2263bb7-baf0-4d41-b515-796cac162b26 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:01:32.104718 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2263bb7-baf0-4d41-b515-796cac162b26 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:32.105262 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2263bb7-baf0-4d41-b515-796cac162b26 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:32.105715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2263bb7-baf0-4d41-b515-796cac162b26 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:32.106925 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2263bb7-baf0-4d41-b515-796cac162b26 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:32.107403 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2263bb7-baf0-4d41-b515-796cac162b26 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:32.107842 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b2263bb7-baf0-4d41-b515-796cac162b26 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:32.322133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b2263bb7-baf0-4d41-b515-796cac162b26 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:01:32.332207 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b2263bb7-baf0-4d41-b515-796cac162b26 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1372 microversion: 2.1 time: 0.238604 Oct 05 04:01:32.332889 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3924/7864] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:01:32 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1372 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:01:33.355154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-096cde20-2c22-4521-91d9-cbb1bfae2bcd tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:01:33.355772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-096cde20-2c22-4521-91d9-cbb1bfae2bcd tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:01:33.369993 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-096cde20-2c22-4521-91d9-cbb1bfae2bcd tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:33.370477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-096cde20-2c22-4521-91d9-cbb1bfae2bcd tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:33.371006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-096cde20-2c22-4521-91d9-cbb1bfae2bcd tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:33.371771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-096cde20-2c22-4521-91d9-cbb1bfae2bcd tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:33.372473 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-096cde20-2c22-4521-91d9-cbb1bfae2bcd tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:33.373079 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-096cde20-2c22-4521-91d9-cbb1bfae2bcd tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:33.502118 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-096cde20-2c22-4521-91d9-cbb1bfae2bcd tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:01:33.510006 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-096cde20-2c22-4521-91d9-cbb1bfae2bcd tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1372 microversion: 2.1 time: 0.158789 Oct 05 04:01:33.510578 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3941/7865] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:01:33 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:01:34.533738 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-801d0a15-617e-43ae-9425-e68028e5814b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:01:34.534376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-801d0a15-617e-43ae-9425-e68028e5814b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:01:34.541270 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-801d0a15-617e-43ae-9425-e68028e5814b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:34.541720 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-801d0a15-617e-43ae-9425-e68028e5814b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:34.542175 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-801d0a15-617e-43ae-9425-e68028e5814b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:34.543001 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-801d0a15-617e-43ae-9425-e68028e5814b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:34.543470 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-801d0a15-617e-43ae-9425-e68028e5814b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:34.543912 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-801d0a15-617e-43ae-9425-e68028e5814b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:34.571485 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-c1604262-b195-4960-aea0-ff3a0e9b410d req-5fec0d6a-6358-47c0-af7c-bd88bb338db0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b39bf6c3-d041-48b4-b27a-388d6c2f7b7f", "name": "network-vif-plugged", "status": "completed", "tag": "070725cd-09d8-4df5-8632-579bdd28f163"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:01:34.583829 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c1604262-b195-4960-aea0-ff3a0e9b410d req-5fec0d6a-6358-47c0-af7c-bd88bb338db0 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:34.584334 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c1604262-b195-4960-aea0-ff3a0e9b410d req-5fec0d6a-6358-47c0-af7c-bd88bb338db0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:34.584842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c1604262-b195-4960-aea0-ff3a0e9b410d req-5fec0d6a-6358-47c0-af7c-bd88bb338db0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:34.598562 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-c1604262-b195-4960-aea0-ff3a0e9b410d req-5fec0d6a-6358-47c0-af7c-bd88bb338db0 service nova] Creating event network-vif-plugged:070725cd-09d8-4df5-8632-579bdd28f163 for instance b39bf6c3-d041-48b4-b27a-388d6c2f7b7f on n-h1-858272-3 Oct 05 04:01:34.603712 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-c1604262-b195-4960-aea0-ff3a0e9b410d req-5fec0d6a-6358-47c0-af7c-bd88bb338db0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036664 Oct 05 04:01:34.604485 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3942/7866] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 04:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 04:01:34.690296 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-801d0a15-617e-43ae-9425-e68028e5814b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:01:34.698081 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-801d0a15-617e-43ae-9425-e68028e5814b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1372 microversion: 2.1 time: 0.168296 Oct 05 04:01:34.698677 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3925/7867] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:01:34 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 04:01:35.721973 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f3566c03-5611-44f6-80d6-b47d2c84162b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:01:35.722681 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f3566c03-5611-44f6-80d6-b47d2c84162b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:01:35.729005 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3566c03-5611-44f6-80d6-b47d2c84162b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:35.729490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3566c03-5611-44f6-80d6-b47d2c84162b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:35.729929 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3566c03-5611-44f6-80d6-b47d2c84162b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:35.730615 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3566c03-5611-44f6-80d6-b47d2c84162b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:35.731072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3566c03-5611-44f6-80d6-b47d2c84162b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:35.731496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f3566c03-5611-44f6-80d6-b47d2c84162b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:35.864968 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f3566c03-5611-44f6-80d6-b47d2c84162b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:01:35.872727 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f3566c03-5611-44f6-80d6-b47d2c84162b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1372 microversion: 2.1 time: 0.156141 Oct 05 04:01:35.873336 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3943/7868] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:01:35 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:01:36.896439 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0ef3b915-07fe-4462-832f-49b73fe51de8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:01:36.897147 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0ef3b915-07fe-4462-832f-49b73fe51de8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:01:36.899903 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:01:36.905679 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ef3b915-07fe-4462-832f-49b73fe51de8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:36.906177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ef3b915-07fe-4462-832f-49b73fe51de8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:36.906624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ef3b915-07fe-4462-832f-49b73fe51de8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:36.907317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ef3b915-07fe-4462-832f-49b73fe51de8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:36.907778 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ef3b915-07fe-4462-832f-49b73fe51de8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:36.908214 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0ef3b915-07fe-4462-832f-49b73fe51de8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:37.039002 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0ef3b915-07fe-4462-832f-49b73fe51de8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:01:37.046733 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0ef3b915-07fe-4462-832f-49b73fe51de8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1556 microversion: 2.1 time: 0.154245 Oct 05 04:01:37.047305 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3926/7869] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:01:36 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:01:37.069503 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a53cf25e-e176-4091-a693-401157940a16 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:01:37.070120 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a53cf25e-e176-4091-a693-401157940a16 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:01:37.072077 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:01:37.072753 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:01:37.080663 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a53cf25e-e176-4091-a693-401157940a16 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:37.081182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a53cf25e-e176-4091-a693-401157940a16 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:37.081647 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a53cf25e-e176-4091-a693-401157940a16 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:37.082337 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a53cf25e-e176-4091-a693-401157940a16 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:37.082789 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a53cf25e-e176-4091-a693-401157940a16 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:37.083212 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a53cf25e-e176-4091-a693-401157940a16 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:37.260868 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a53cf25e-e176-4091-a693-401157940a16 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:01:37.268728 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a53cf25e-e176-4091-a693-401157940a16 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1556 microversion: 2.1 time: 0.203048 Oct 05 04:01:37.269587 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3944/7870] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:01:37 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1556 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:01:39.587921 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-5e6f6dce-9aeb-451b-abba-9c02d15ac474 req-b8119820-7082-4f79-b1ed-ab95334260d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b39bf6c3-d041-48b4-b27a-388d6c2f7b7f", "tag": "070725cd-09d8-4df5-8632-579bdd28f163"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:01:39.599114 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-5e6f6dce-9aeb-451b-abba-9c02d15ac474 req-b8119820-7082-4f79-b1ed-ab95334260d2 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:01:39.599608 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-5e6f6dce-9aeb-451b-abba-9c02d15ac474 req-b8119820-7082-4f79-b1ed-ab95334260d2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:01:39.600049 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-5e6f6dce-9aeb-451b-abba-9c02d15ac474 req-b8119820-7082-4f79-b1ed-ab95334260d2 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:01:39.611698 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-5e6f6dce-9aeb-451b-abba-9c02d15ac474 req-b8119820-7082-4f79-b1ed-ab95334260d2 service nova] Creating event network-changed:070725cd-09d8-4df5-8632-579bdd28f163 for instance b39bf6c3-d041-48b4-b27a-388d6c2f7b7f on n-h1-858272-3 Oct 05 04:01:39.616800 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-5e6f6dce-9aeb-451b-abba-9c02d15ac474 req-b8119820-7082-4f79-b1ed-ab95334260d2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032596 Oct 05 04:01:39.617590 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3927/7871] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 04:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 04:04:05.766318 n-d-858272-3 devstack@n-api.service[122319]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9ea01e0c-5288-45ec-999a-5c236fd0352e] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 05 04:04:05.767265 n-d-858272-3 devstack@n-api.service[122319]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6905525b-80d2-47ff-94c4-6512d0d2e7d6] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 05 04:04:05.767985 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:04:05.769642 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=36 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:04:05.770643 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 05 04:04:05.770784 n-d-858272-3 devstack@n-api.service[122319]: Wed Oct 5 04:04:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f/action (ip 10.222.0.16) !!! Oct 05 04:04:05.773422 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 05 04:04:05.773553 n-d-858272-3 devstack@n-api.service[122319]: Wed Oct 5 04:04:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f/action (ip 10.222.0.16) !!! Oct 05 04:04:05.775214 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 05 04:04:05.775339 n-d-858272-3 devstack@n-api.service[122319]: Wed Oct 5 04:04:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f/action (ip 10.222.0.16) !!! Oct 05 04:04:05.781441 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-633573aa-99e6-40db-a150-6030809a4c12 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:04:05.782008 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-633573aa-99e6-40db-a150-6030809a4c12 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:05.793634 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-633573aa-99e6-40db-a150-6030809a4c12 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:05.794121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-633573aa-99e6-40db-a150-6030809a4c12 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:05.794557 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-633573aa-99e6-40db-a150-6030809a4c12 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:05.795254 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-633573aa-99e6-40db-a150-6030809a4c12 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:05.795712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-633573aa-99e6-40db-a150-6030809a4c12 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:05.796140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-633573aa-99e6-40db-a150-6030809a4c12 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:05.821165 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.objects.instance [None req-633573aa-99e6-40db-a150-6030809a4c12 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lazy-loading 'flavor' on Instance uuid b39bf6c3-d041-48b4-b27a-388d6c2f7b7f {{(pid=122319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 04:04:06.142704 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-633573aa-99e6-40db-a150-6030809a4c12 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "POST /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f/action" status: 202 len: 0 microversion: 2.1 time: 0.378109 Oct 05 04:04:06.143389 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3945/7872] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 04:04:05 2022] POST /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 04:04:06.150583 n-d-858272-3 devstack@n-api.service[122320]: ERROR oslo.messaging._drivers.impl_rabbit [-] [478c9060-5882-4902-b074-d751d7d6fe39] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 04:04:06.151486 n-d-858272-3 devstack@n-api.service[122320]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f8dec5f5-af45-49c2-a8e7-bbd40c1c5148] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 04:04:06.152121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:04:06.152892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=32 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:04:06.154369 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 05 04:04:06.154369 n-d-858272-3 devstack@n-api.service[122320]: Wed Oct 5 04:04:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f (ip 10.222.0.16) !!! Oct 05 04:04:06.157094 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 04:04:06.157277 n-d-858272-3 devstack@n-api.service[122320]: Wed Oct 5 04:04:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f (ip 10.222.0.16) !!! Oct 05 04:04:06.167217 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4e798bb4-5705-44d0-864c-1011451bb8b8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:06.167972 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4e798bb4-5705-44d0-864c-1011451bb8b8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:06.181063 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e798bb4-5705-44d0-864c-1011451bb8b8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:06.181572 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e798bb4-5705-44d0-864c-1011451bb8b8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:06.182029 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e798bb4-5705-44d0-864c-1011451bb8b8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:06.182745 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e798bb4-5705-44d0-864c-1011451bb8b8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:06.183222 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e798bb4-5705-44d0-864c-1011451bb8b8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:06.183670 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4e798bb4-5705-44d0-864c-1011451bb8b8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:06.370513 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4e798bb4-5705-44d0-864c-1011451bb8b8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:06.378891 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4e798bb4-5705-44d0-864c-1011451bb8b8 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1681 microversion: 2.1 time: 0.229722 Oct 05 04:04:06.379462 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3928/7873] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:06 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1681 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:07.405115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-11f0dbc1-63cf-4035-aae0-2be14bad8d37 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:07.405818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-11f0dbc1-63cf-4035-aae0-2be14bad8d37 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:07.416188 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11f0dbc1-63cf-4035-aae0-2be14bad8d37 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:07.416693 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11f0dbc1-63cf-4035-aae0-2be14bad8d37 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:07.417136 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11f0dbc1-63cf-4035-aae0-2be14bad8d37 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:07.417834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11f0dbc1-63cf-4035-aae0-2be14bad8d37 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:07.418293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11f0dbc1-63cf-4035-aae0-2be14bad8d37 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:07.418718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-11f0dbc1-63cf-4035-aae0-2be14bad8d37 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:07.419766 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] [9ea01e0c-5288-45ec-999a-5c236fd0352e] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 48662. Oct 05 04:04:07.425634 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] [6905525b-80d2-47ff-94c4-6512d0d2e7d6] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 48664. Oct 05 04:04:07.551015 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-11f0dbc1-63cf-4035-aae0-2be14bad8d37 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:07.558794 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-11f0dbc1-63cf-4035-aae0-2be14bad8d37 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1681 microversion: 2.1 time: 0.159731 Oct 05 04:04:07.559371 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3946/7874] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:07 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:08.582192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0c7bb448-f8d0-4360-b5f6-a6e4c97f56e3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:08.582819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0c7bb448-f8d0-4360-b5f6-a6e4c97f56e3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:08.593733 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c7bb448-f8d0-4360-b5f6-a6e4c97f56e3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:08.594241 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c7bb448-f8d0-4360-b5f6-a6e4c97f56e3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:08.594691 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c7bb448-f8d0-4360-b5f6-a6e4c97f56e3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:08.595427 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c7bb448-f8d0-4360-b5f6-a6e4c97f56e3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:08.595921 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c7bb448-f8d0-4360-b5f6-a6e4c97f56e3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:08.596360 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0c7bb448-f8d0-4360-b5f6-a6e4c97f56e3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:08.603653 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [-] [478c9060-5882-4902-b074-d751d7d6fe39] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 48668. Oct 05 04:04:08.604479 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [-] [f8dec5f5-af45-49c2-a8e7-bbd40c1c5148] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 48670. Oct 05 04:04:08.729902 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0c7bb448-f8d0-4360-b5f6-a6e4c97f56e3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:08.738646 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0c7bb448-f8d0-4360-b5f6-a6e4c97f56e3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1681 microversion: 2.1 time: 0.160420 Oct 05 04:04:08.739224 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3929/7875] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:08 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:09.763041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-be5d0beb-3960-4a24-8972-d3e82c4cbb0d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:09.763650 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-be5d0beb-3960-4a24-8972-d3e82c4cbb0d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:09.771159 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be5d0beb-3960-4a24-8972-d3e82c4cbb0d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:09.771637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be5d0beb-3960-4a24-8972-d3e82c4cbb0d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:09.772072 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be5d0beb-3960-4a24-8972-d3e82c4cbb0d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:09.772754 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be5d0beb-3960-4a24-8972-d3e82c4cbb0d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:09.773233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be5d0beb-3960-4a24-8972-d3e82c4cbb0d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:09.773655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-be5d0beb-3960-4a24-8972-d3e82c4cbb0d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:09.913948 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-be5d0beb-3960-4a24-8972-d3e82c4cbb0d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:09.921855 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-be5d0beb-3960-4a24-8972-d3e82c4cbb0d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1681 microversion: 2.1 time: 0.162831 Oct 05 04:04:09.922363 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3947/7876] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:09 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:10.946454 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-1dfc25f5-fe4b-4ccb-b97b-1c978f335402 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:10.947149 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-1dfc25f5-fe4b-4ccb-b97b-1c978f335402 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:10.953997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1dfc25f5-fe4b-4ccb-b97b-1c978f335402 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:10.954508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1dfc25f5-fe4b-4ccb-b97b-1c978f335402 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:10.954967 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1dfc25f5-fe4b-4ccb-b97b-1c978f335402 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:10.955677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1dfc25f5-fe4b-4ccb-b97b-1c978f335402 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:10.956268 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1dfc25f5-fe4b-4ccb-b97b-1c978f335402 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:10.956724 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-1dfc25f5-fe4b-4ccb-b97b-1c978f335402 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:11.087712 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-1dfc25f5-fe4b-4ccb-b97b-1c978f335402 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:11.095478 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-1dfc25f5-fe4b-4ccb-b97b-1c978f335402 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1681 microversion: 2.1 time: 0.153053 Oct 05 04:04:11.096066 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3930/7877] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:10 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:12.121251 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-056f5ec5-2470-40e0-9ee6-d5e3967b2f9f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:12.121978 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-056f5ec5-2470-40e0-9ee6-d5e3967b2f9f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:12.129188 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-056f5ec5-2470-40e0-9ee6-d5e3967b2f9f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:12.129703 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-056f5ec5-2470-40e0-9ee6-d5e3967b2f9f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:12.130140 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-056f5ec5-2470-40e0-9ee6-d5e3967b2f9f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:12.130824 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-056f5ec5-2470-40e0-9ee6-d5e3967b2f9f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:12.131279 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-056f5ec5-2470-40e0-9ee6-d5e3967b2f9f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:12.131699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-056f5ec5-2470-40e0-9ee6-d5e3967b2f9f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:12.264747 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-056f5ec5-2470-40e0-9ee6-d5e3967b2f9f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:12.273630 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-056f5ec5-2470-40e0-9ee6-d5e3967b2f9f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1681 microversion: 2.1 time: 0.156326 Oct 05 04:04:12.274215 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3948/7878] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:12 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:13.298200 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-34eab851-d64d-42f2-92c2-0505a39839e6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:13.298866 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-34eab851-d64d-42f2-92c2-0505a39839e6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:13.307138 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34eab851-d64d-42f2-92c2-0505a39839e6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:13.308025 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34eab851-d64d-42f2-92c2-0505a39839e6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:13.308682 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34eab851-d64d-42f2-92c2-0505a39839e6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:13.309417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34eab851-d64d-42f2-92c2-0505a39839e6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:13.309892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34eab851-d64d-42f2-92c2-0505a39839e6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:13.310330 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-34eab851-d64d-42f2-92c2-0505a39839e6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:13.447145 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-34eab851-d64d-42f2-92c2-0505a39839e6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:13.455040 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-34eab851-d64d-42f2-92c2-0505a39839e6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1681 microversion: 2.1 time: 0.160786 Oct 05 04:04:13.455610 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3931/7879] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:13 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:14.478713 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bac1ef76-7c0b-4e37-98af-776d08738724 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:14.479342 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bac1ef76-7c0b-4e37-98af-776d08738724 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:14.486265 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bac1ef76-7c0b-4e37-98af-776d08738724 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:14.487082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bac1ef76-7c0b-4e37-98af-776d08738724 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:14.488052 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bac1ef76-7c0b-4e37-98af-776d08738724 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:14.488777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bac1ef76-7c0b-4e37-98af-776d08738724 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:14.489267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bac1ef76-7c0b-4e37-98af-776d08738724 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:14.489699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bac1ef76-7c0b-4e37-98af-776d08738724 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:14.624027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bac1ef76-7c0b-4e37-98af-776d08738724 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:14.631906 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bac1ef76-7c0b-4e37-98af-776d08738724 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1681 microversion: 2.1 time: 0.157169 Oct 05 04:04:14.632487 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3949/7880] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:14 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:15.655701 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bb8fc814-9559-49fb-8757-99131f827ac9 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:15.656356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bb8fc814-9559-49fb-8757-99131f827ac9 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:15.663909 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb8fc814-9559-49fb-8757-99131f827ac9 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:15.664415 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb8fc814-9559-49fb-8757-99131f827ac9 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:15.664867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb8fc814-9559-49fb-8757-99131f827ac9 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:15.665628 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb8fc814-9559-49fb-8757-99131f827ac9 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:15.666056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb8fc814-9559-49fb-8757-99131f827ac9 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:15.666494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bb8fc814-9559-49fb-8757-99131f827ac9 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:15.805215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bb8fc814-9559-49fb-8757-99131f827ac9 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:15.813062 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bb8fc814-9559-49fb-8757-99131f827ac9 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1681 microversion: 2.1 time: 0.161304 Oct 05 04:04:15.813643 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3932/7881] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:15 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:16.836498 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-251505c2-e17f-4d53-8183-c1830f1f452d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:16.837164 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-251505c2-e17f-4d53-8183-c1830f1f452d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:16.844119 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-251505c2-e17f-4d53-8183-c1830f1f452d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:16.844608 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-251505c2-e17f-4d53-8183-c1830f1f452d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:16.845089 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-251505c2-e17f-4d53-8183-c1830f1f452d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:16.845784 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-251505c2-e17f-4d53-8183-c1830f1f452d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:16.846239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-251505c2-e17f-4d53-8183-c1830f1f452d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:16.846664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-251505c2-e17f-4d53-8183-c1830f1f452d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:16.984971 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-251505c2-e17f-4d53-8183-c1830f1f452d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:16.993887 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-251505c2-e17f-4d53-8183-c1830f1f452d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1681 microversion: 2.1 time: 0.161392 Oct 05 04:04:16.994467 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3950/7882] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:16 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:18.019062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d6471192-4a95-4a39-971a-f12516ca693f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:18.019705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d6471192-4a95-4a39-971a-f12516ca693f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:18.026804 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d6471192-4a95-4a39-971a-f12516ca693f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:18.027310 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d6471192-4a95-4a39-971a-f12516ca693f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:18.027792 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d6471192-4a95-4a39-971a-f12516ca693f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:18.028491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d6471192-4a95-4a39-971a-f12516ca693f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:18.028984 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d6471192-4a95-4a39-971a-f12516ca693f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:18.029426 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d6471192-4a95-4a39-971a-f12516ca693f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:18.163777 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d6471192-4a95-4a39-971a-f12516ca693f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:18.171556 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d6471192-4a95-4a39-971a-f12516ca693f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1702 microversion: 2.1 time: 0.157262 Oct 05 04:04:18.172132 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3933/7883] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:18 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1702 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:19.195380 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-05412a1a-8fbd-408b-8f12-652da2e950b1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:19.195976 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-05412a1a-8fbd-408b-8f12-652da2e950b1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:19.202790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05412a1a-8fbd-408b-8f12-652da2e950b1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:19.203271 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05412a1a-8fbd-408b-8f12-652da2e950b1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:19.203705 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05412a1a-8fbd-408b-8f12-652da2e950b1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:19.204387 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05412a1a-8fbd-408b-8f12-652da2e950b1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:19.204837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05412a1a-8fbd-408b-8f12-652da2e950b1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:19.205280 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-05412a1a-8fbd-408b-8f12-652da2e950b1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:19.337079 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-05412a1a-8fbd-408b-8f12-652da2e950b1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:19.345886 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-05412a1a-8fbd-408b-8f12-652da2e950b1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1702 microversion: 2.1 time: 0.154431 Oct 05 04:04:19.347628 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3951/7884] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:19 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1702 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:20.369826 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c39ca541-c535-48a9-b084-43fe2a0d45f7 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:20.370437 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c39ca541-c535-48a9-b084-43fe2a0d45f7 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:20.379771 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c39ca541-c535-48a9-b084-43fe2a0d45f7 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:20.380271 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c39ca541-c535-48a9-b084-43fe2a0d45f7 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:20.380721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c39ca541-c535-48a9-b084-43fe2a0d45f7 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:20.381455 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c39ca541-c535-48a9-b084-43fe2a0d45f7 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:20.382014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c39ca541-c535-48a9-b084-43fe2a0d45f7 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:20.382459 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c39ca541-c535-48a9-b084-43fe2a0d45f7 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:20.514564 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c39ca541-c535-48a9-b084-43fe2a0d45f7 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:20.522683 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c39ca541-c535-48a9-b084-43fe2a0d45f7 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1702 microversion: 2.1 time: 0.156787 Oct 05 04:04:20.523256 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3934/7885] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:20 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1702 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:21.447429 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-30af6dd9-9d5d-436c-99df-fd473a9f460a req-8d8e9aeb-a31a-4dac-9dca-df308b050c20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b39bf6c3-d041-48b4-b27a-388d6c2f7b7f", "name": "network-vif-plugged", "status": "completed", "tag": "070725cd-09d8-4df5-8632-579bdd28f163"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:04:21.457841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-30af6dd9-9d5d-436c-99df-fd473a9f460a req-8d8e9aeb-a31a-4dac-9dca-df308b050c20 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:21.458317 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-30af6dd9-9d5d-436c-99df-fd473a9f460a req-8d8e9aeb-a31a-4dac-9dca-df308b050c20 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:21.458777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-30af6dd9-9d5d-436c-99df-fd473a9f460a req-8d8e9aeb-a31a-4dac-9dca-df308b050c20 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:21.470162 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-30af6dd9-9d5d-436c-99df-fd473a9f460a req-8d8e9aeb-a31a-4dac-9dca-df308b050c20 service nova] Creating event network-vif-plugged:070725cd-09d8-4df5-8632-579bdd28f163 for instance b39bf6c3-d041-48b4-b27a-388d6c2f7b7f on n-h1-858272-3 Oct 05 04:04:21.475434 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-30af6dd9-9d5d-436c-99df-fd473a9f460a req-8d8e9aeb-a31a-4dac-9dca-df308b050c20 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031767 Oct 05 04:04:21.476226 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3952/7886] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 04:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 04:04:21.546511 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a8f52434-33a4-4cd4-a08f-d95dc5b9b141 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:21.547142 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a8f52434-33a4-4cd4-a08f-d95dc5b9b141 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:21.554709 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8f52434-33a4-4cd4-a08f-d95dc5b9b141 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:21.555204 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8f52434-33a4-4cd4-a08f-d95dc5b9b141 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:21.555648 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8f52434-33a4-4cd4-a08f-d95dc5b9b141 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:21.556345 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8f52434-33a4-4cd4-a08f-d95dc5b9b141 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:21.556808 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8f52434-33a4-4cd4-a08f-d95dc5b9b141 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:21.557281 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a8f52434-33a4-4cd4-a08f-d95dc5b9b141 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:21.687204 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a8f52434-33a4-4cd4-a08f-d95dc5b9b141 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:21.695118 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a8f52434-33a4-4cd4-a08f-d95dc5b9b141 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1702 microversion: 2.1 time: 0.152505 Oct 05 04:04:21.695689 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3935/7887] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:21 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1702 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:22.719937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a10a2ef2-003a-4564-920a-f0435600b97e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:22.720644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a10a2ef2-003a-4564-920a-f0435600b97e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:22.727371 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a10a2ef2-003a-4564-920a-f0435600b97e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:22.727864 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a10a2ef2-003a-4564-920a-f0435600b97e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:22.728305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a10a2ef2-003a-4564-920a-f0435600b97e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:22.729022 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a10a2ef2-003a-4564-920a-f0435600b97e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:22.729484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a10a2ef2-003a-4564-920a-f0435600b97e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:22.729912 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a10a2ef2-003a-4564-920a-f0435600b97e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:22.867960 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a10a2ef2-003a-4564-920a-f0435600b97e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:22.878608 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a10a2ef2-003a-4564-920a-f0435600b97e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1697 microversion: 2.1 time: 0.162640 Oct 05 04:04:22.879631 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3953/7888] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:22 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:23.904858 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bf76fffd-4646-4062-9d3d-c350f1d198f3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:23.905666 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bf76fffd-4646-4062-9d3d-c350f1d198f3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:23.913631 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf76fffd-4646-4062-9d3d-c350f1d198f3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:23.914503 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf76fffd-4646-4062-9d3d-c350f1d198f3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:23.915062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf76fffd-4646-4062-9d3d-c350f1d198f3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:23.915916 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf76fffd-4646-4062-9d3d-c350f1d198f3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:23.916524 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf76fffd-4646-4062-9d3d-c350f1d198f3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:23.917021 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bf76fffd-4646-4062-9d3d-c350f1d198f3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:24.066959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bf76fffd-4646-4062-9d3d-c350f1d198f3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:24.076176 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bf76fffd-4646-4062-9d3d-c350f1d198f3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1697 microversion: 2.1 time: 0.175514 Oct 05 04:04:24.076769 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3936/7889] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:23 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1697 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:25.101005 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ee8c7ca4-8f9a-4348-964f-520333082f1e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:25.102128 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ee8c7ca4-8f9a-4348-964f-520333082f1e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:25.110991 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee8c7ca4-8f9a-4348-964f-520333082f1e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:25.111931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee8c7ca4-8f9a-4348-964f-520333082f1e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:25.112388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee8c7ca4-8f9a-4348-964f-520333082f1e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:25.113128 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee8c7ca4-8f9a-4348-964f-520333082f1e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:25.113594 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee8c7ca4-8f9a-4348-964f-520333082f1e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:25.114025 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ee8c7ca4-8f9a-4348-964f-520333082f1e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:25.258771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ee8c7ca4-8f9a-4348-964f-520333082f1e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:25.267131 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ee8c7ca4-8f9a-4348-964f-520333082f1e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1697 microversion: 2.1 time: 0.171418 Oct 05 04:04:25.267810 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3954/7890] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:25 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:26.291783 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-98702136-cd0a-4bbf-b49e-21c17e241631 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:26.292349 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-98702136-cd0a-4bbf-b49e-21c17e241631 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:26.299983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98702136-cd0a-4bbf-b49e-21c17e241631 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:26.301173 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98702136-cd0a-4bbf-b49e-21c17e241631 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:26.301635 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98702136-cd0a-4bbf-b49e-21c17e241631 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:26.302355 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98702136-cd0a-4bbf-b49e-21c17e241631 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:26.302819 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98702136-cd0a-4bbf-b49e-21c17e241631 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:26.303254 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-98702136-cd0a-4bbf-b49e-21c17e241631 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:26.464354 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-98702136-cd0a-4bbf-b49e-21c17e241631 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:26.472993 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-98702136-cd0a-4bbf-b49e-21c17e241631 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1697 microversion: 2.1 time: 0.185197 Oct 05 04:04:26.485536 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3937/7891] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:26 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1697 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:27.497644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-37175fe4-af86-4773-bfb1-27d55fe229a5 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:27.498941 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-37175fe4-af86-4773-bfb1-27d55fe229a5 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:27.506562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37175fe4-af86-4773-bfb1-27d55fe229a5 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:27.507356 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37175fe4-af86-4773-bfb1-27d55fe229a5 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:27.508159 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37175fe4-af86-4773-bfb1-27d55fe229a5 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:27.508990 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37175fe4-af86-4773-bfb1-27d55fe229a5 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:27.509523 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37175fe4-af86-4773-bfb1-27d55fe229a5 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:27.510024 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-37175fe4-af86-4773-bfb1-27d55fe229a5 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:27.675454 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-37175fe4-af86-4773-bfb1-27d55fe229a5 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:27.683669 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-37175fe4-af86-4773-bfb1-27d55fe229a5 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1697 microversion: 2.1 time: 0.189890 Oct 05 04:04:27.684577 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3955/7892] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:27 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1697 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:28.710252 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4f5d39c6-28a3-438b-8829-f25e7a721748 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:28.711566 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4f5d39c6-28a3-438b-8829-f25e7a721748 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:28.719109 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f5d39c6-28a3-438b-8829-f25e7a721748 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:28.719867 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f5d39c6-28a3-438b-8829-f25e7a721748 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:28.720325 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f5d39c6-28a3-438b-8829-f25e7a721748 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:28.721167 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f5d39c6-28a3-438b-8829-f25e7a721748 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:28.721635 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f5d39c6-28a3-438b-8829-f25e7a721748 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:28.722391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4f5d39c6-28a3-438b-8829-f25e7a721748 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:28.890968 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4f5d39c6-28a3-438b-8829-f25e7a721748 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:28.898281 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4f5d39c6-28a3-438b-8829-f25e7a721748 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1697 microversion: 2.1 time: 0.193947 Oct 05 04:04:28.898867 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3938/7893] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:28 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1697 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:29.926628 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9d01f1f0-45ac-492b-a8b7-75cb54b06309 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:29.928017 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9d01f1f0-45ac-492b-a8b7-75cb54b06309 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:29.935049 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d01f1f0-45ac-492b-a8b7-75cb54b06309 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:29.935803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d01f1f0-45ac-492b-a8b7-75cb54b06309 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:29.936483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d01f1f0-45ac-492b-a8b7-75cb54b06309 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:29.937451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d01f1f0-45ac-492b-a8b7-75cb54b06309 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:29.938150 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d01f1f0-45ac-492b-a8b7-75cb54b06309 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:29.938640 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9d01f1f0-45ac-492b-a8b7-75cb54b06309 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:30.083551 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9d01f1f0-45ac-492b-a8b7-75cb54b06309 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:30.094554 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9d01f1f0-45ac-492b-a8b7-75cb54b06309 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1697 microversion: 2.1 time: 0.173091 Oct 05 04:04:30.096565 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3956/7894] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:29 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1697 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:31.121490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-765b3880-9ecb-48b6-823c-8aac623a753d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:31.122468 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-765b3880-9ecb-48b6-823c-8aac623a753d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:31.130825 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-765b3880-9ecb-48b6-823c-8aac623a753d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:31.131343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-765b3880-9ecb-48b6-823c-8aac623a753d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:31.131794 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-765b3880-9ecb-48b6-823c-8aac623a753d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:31.132527 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-765b3880-9ecb-48b6-823c-8aac623a753d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:31.133030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-765b3880-9ecb-48b6-823c-8aac623a753d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:31.133473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-765b3880-9ecb-48b6-823c-8aac623a753d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:31.282045 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-765b3880-9ecb-48b6-823c-8aac623a753d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:31.290131 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-765b3880-9ecb-48b6-823c-8aac623a753d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1697 microversion: 2.1 time: 0.172802 Oct 05 04:04:31.290720 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3939/7895] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:31 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1697 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:32.313765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8b6a9e57-e726-4888-bf64-fb3588030932 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:32.314382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8b6a9e57-e726-4888-bf64-fb3588030932 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:32.321950 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b6a9e57-e726-4888-bf64-fb3588030932 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:32.322432 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b6a9e57-e726-4888-bf64-fb3588030932 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:32.322867 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b6a9e57-e726-4888-bf64-fb3588030932 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:32.323561 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b6a9e57-e726-4888-bf64-fb3588030932 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:32.324012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b6a9e57-e726-4888-bf64-fb3588030932 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:32.324434 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8b6a9e57-e726-4888-bf64-fb3588030932 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:32.461449 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8b6a9e57-e726-4888-bf64-fb3588030932 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:32.469245 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8b6a9e57-e726-4888-bf64-fb3588030932 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1697 microversion: 2.1 time: 0.159368 Oct 05 04:04:32.469835 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3957/7896] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:32 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:33.493251 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dc617684-634d-4bb4-b587-eeba8a714e72 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:33.493938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dc617684-634d-4bb4-b587-eeba8a714e72 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:33.500955 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dc617684-634d-4bb4-b587-eeba8a714e72 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:33.501459 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dc617684-634d-4bb4-b587-eeba8a714e72 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:33.501913 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dc617684-634d-4bb4-b587-eeba8a714e72 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:33.502689 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dc617684-634d-4bb4-b587-eeba8a714e72 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:33.503451 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dc617684-634d-4bb4-b587-eeba8a714e72 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:33.503676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dc617684-634d-4bb4-b587-eeba8a714e72 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:34.055444 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dc617684-634d-4bb4-b587-eeba8a714e72 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:34.063258 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dc617684-634d-4bb4-b587-eeba8a714e72 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1679 microversion: 2.1 time: 0.573937 Oct 05 04:04:34.064061 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3940/7897] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:33 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1679 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:35.087997 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7fd50650-0ea5-4355-b5dc-f0e6e1ed509e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:35.088611 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7fd50650-0ea5-4355-b5dc-f0e6e1ed509e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:35.095577 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fd50650-0ea5-4355-b5dc-f0e6e1ed509e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:35.096073 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fd50650-0ea5-4355-b5dc-f0e6e1ed509e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:35.097075 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fd50650-0ea5-4355-b5dc-f0e6e1ed509e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:35.097777 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fd50650-0ea5-4355-b5dc-f0e6e1ed509e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:35.098236 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fd50650-0ea5-4355-b5dc-f0e6e1ed509e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:35.098661 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7fd50650-0ea5-4355-b5dc-f0e6e1ed509e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:35.231451 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7fd50650-0ea5-4355-b5dc-f0e6e1ed509e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:35.240188 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7fd50650-0ea5-4355-b5dc-f0e6e1ed509e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1679 microversion: 2.1 time: 0.156118 Oct 05 04:04:35.240767 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3958/7898] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:35 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:36.263882 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d87575cf-57b7-4e54-a691-74e9fbb88123 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:36.264501 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d87575cf-57b7-4e54-a691-74e9fbb88123 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:36.267265 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=27 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:04:36.273102 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d87575cf-57b7-4e54-a691-74e9fbb88123 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:36.273597 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d87575cf-57b7-4e54-a691-74e9fbb88123 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:36.274040 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d87575cf-57b7-4e54-a691-74e9fbb88123 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:36.274735 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d87575cf-57b7-4e54-a691-74e9fbb88123 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:36.275198 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d87575cf-57b7-4e54-a691-74e9fbb88123 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:36.275629 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d87575cf-57b7-4e54-a691-74e9fbb88123 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:36.279733 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=79 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:04:36.406388 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d87575cf-57b7-4e54-a691-74e9fbb88123 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:36.414746 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d87575cf-57b7-4e54-a691-74e9fbb88123 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1622 microversion: 2.1 time: 0.154761 Oct 05 04:04:36.415328 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3941/7899] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:36 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1622 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:36.437692 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-1c157a63-9f41-4f3f-8209-74013f17339a tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:04:36.438343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1c157a63-9f41-4f3f-8209-74013f17339a tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:36.441615 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=29 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:04:36.447048 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c157a63-9f41-4f3f-8209-74013f17339a tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:36.447529 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c157a63-9f41-4f3f-8209-74013f17339a tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:36.447963 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c157a63-9f41-4f3f-8209-74013f17339a tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:36.448651 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c157a63-9f41-4f3f-8209-74013f17339a tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:36.449134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c157a63-9f41-4f3f-8209-74013f17339a tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:36.449559 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-1c157a63-9f41-4f3f-8209-74013f17339a tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:36.453344 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:04:36.538557 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-1c157a63-9f41-4f3f-8209-74013f17339a tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122319) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 05 04:04:36.607758 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-1c157a63-9f41-4f3f-8209-74013f17339a tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "POST /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f/action" status: 202 len: 0 microversion: 2.1 time: 0.174074 Oct 05 04:04:36.608610 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3959/7900] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 04:04:36 2022] POST /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 04:04:36.616723 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a29116b0-f0b8-4bce-b32d-3e3c66385284 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:36.617380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a29116b0-f0b8-4bce-b32d-3e3c66385284 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:36.623324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a29116b0-f0b8-4bce-b32d-3e3c66385284 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:36.623826 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a29116b0-f0b8-4bce-b32d-3e3c66385284 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:36.624280 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a29116b0-f0b8-4bce-b32d-3e3c66385284 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:36.625020 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a29116b0-f0b8-4bce-b32d-3e3c66385284 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:36.625495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a29116b0-f0b8-4bce-b32d-3e3c66385284 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:36.625937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a29116b0-f0b8-4bce-b32d-3e3c66385284 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:36.766930 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a29116b0-f0b8-4bce-b32d-3e3c66385284 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:36.775286 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a29116b0-f0b8-4bce-b32d-3e3c66385284 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1630 microversion: 2.1 time: 0.162402 Oct 05 04:04:36.775980 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3942/7901] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:36 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1630 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:37.494268 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-242df297-6092-4b01-b244-44ab1fe96f73 req-41847e68-d25b-4315-ae75-3bc932beb398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b39bf6c3-d041-48b4-b27a-388d6c2f7b7f", "name": "network-vif-unplugged", "status": "completed", "tag": "070725cd-09d8-4df5-8632-579bdd28f163"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:04:37.505734 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-242df297-6092-4b01-b244-44ab1fe96f73 req-41847e68-d25b-4315-ae75-3bc932beb398 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:37.506223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-242df297-6092-4b01-b244-44ab1fe96f73 req-41847e68-d25b-4315-ae75-3bc932beb398 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:37.506660 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-242df297-6092-4b01-b244-44ab1fe96f73 req-41847e68-d25b-4315-ae75-3bc932beb398 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:37.517207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.compute.server_external_events [req-242df297-6092-4b01-b244-44ab1fe96f73 req-41847e68-d25b-4315-ae75-3bc932beb398 service nova] Unable to find a host for instance b39bf6c3-d041-48b4-b27a-388d6c2f7b7f. Dropping event network-vif-unplugged {{(pid=122319) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 05 04:04:37.518167 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-242df297-6092-4b01-b244-44ab1fe96f73 req-41847e68-d25b-4315-ae75-3bc932beb398 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028636 Oct 05 04:04:37.518811 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3960/7902] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 04:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 05 04:04:37.799609 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2577c530-87f1-456e-92df-1256c3bfd2b6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:37.800261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2577c530-87f1-456e-92df-1256c3bfd2b6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:37.807119 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2577c530-87f1-456e-92df-1256c3bfd2b6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:37.807611 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2577c530-87f1-456e-92df-1256c3bfd2b6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:37.808052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2577c530-87f1-456e-92df-1256c3bfd2b6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:37.808744 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2577c530-87f1-456e-92df-1256c3bfd2b6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:37.809229 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2577c530-87f1-456e-92df-1256c3bfd2b6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:37.809664 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2577c530-87f1-456e-92df-1256c3bfd2b6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:37.945495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2577c530-87f1-456e-92df-1256c3bfd2b6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:37.953182 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2577c530-87f1-456e-92df-1256c3bfd2b6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1630 microversion: 2.1 time: 0.157519 Oct 05 04:04:37.953763 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3943/7903] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:37 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1630 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:38.977901 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-12f61223-5f1b-4d32-a2e1-99df17b13608 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:38.978518 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-12f61223-5f1b-4d32-a2e1-99df17b13608 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:38.985486 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12f61223-5f1b-4d32-a2e1-99df17b13608 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:38.985970 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12f61223-5f1b-4d32-a2e1-99df17b13608 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:38.986405 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12f61223-5f1b-4d32-a2e1-99df17b13608 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:38.987381 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12f61223-5f1b-4d32-a2e1-99df17b13608 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:38.987837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12f61223-5f1b-4d32-a2e1-99df17b13608 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:38.988937 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-12f61223-5f1b-4d32-a2e1-99df17b13608 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:39.127134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-12f61223-5f1b-4d32-a2e1-99df17b13608 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:39.134820 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-12f61223-5f1b-4d32-a2e1-99df17b13608 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1630 microversion: 2.1 time: 0.161013 Oct 05 04:04:39.135390 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3961/7904] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:38 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1630 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:40.158319 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-04230f41-16f6-4c2a-99d1-164e0240b934 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:40.158952 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-04230f41-16f6-4c2a-99d1-164e0240b934 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:40.165692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04230f41-16f6-4c2a-99d1-164e0240b934 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:40.166190 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04230f41-16f6-4c2a-99d1-164e0240b934 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:40.166637 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04230f41-16f6-4c2a-99d1-164e0240b934 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:40.167341 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04230f41-16f6-4c2a-99d1-164e0240b934 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:40.167806 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04230f41-16f6-4c2a-99d1-164e0240b934 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:40.168245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-04230f41-16f6-4c2a-99d1-164e0240b934 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:40.303633 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-04230f41-16f6-4c2a-99d1-164e0240b934 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:40.311715 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-04230f41-16f6-4c2a-99d1-164e0240b934 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1630 microversion: 2.1 time: 0.157510 Oct 05 04:04:40.312304 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3944/7905] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:40 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1630 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:41.336130 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d4eca61a-a85f-4c97-9b0a-3bbf4e9429d9 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:41.336756 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d4eca61a-a85f-4c97-9b0a-3bbf4e9429d9 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:41.343689 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4eca61a-a85f-4c97-9b0a-3bbf4e9429d9 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:41.344593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4eca61a-a85f-4c97-9b0a-3bbf4e9429d9 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:41.344593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4eca61a-a85f-4c97-9b0a-3bbf4e9429d9 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:41.345326 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4eca61a-a85f-4c97-9b0a-3bbf4e9429d9 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:41.345779 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4eca61a-a85f-4c97-9b0a-3bbf4e9429d9 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:41.346204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d4eca61a-a85f-4c97-9b0a-3bbf4e9429d9 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:41.615768 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d4eca61a-a85f-4c97-9b0a-3bbf4e9429d9 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:41.624304 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d4eca61a-a85f-4c97-9b0a-3bbf4e9429d9 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1688 microversion: 2.1 time: 0.292535 Oct 05 04:04:41.640721 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3962/7906] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:41 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1688 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:41.962378 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-49b10b81-dfe3-499f-8cdf-a80ab69f4f64 req-94eed6db-6c3a-42f0-823f-657e82c3a66f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b39bf6c3-d041-48b4-b27a-388d6c2f7b7f", "tag": "070725cd-09d8-4df5-8632-579bdd28f163"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:04:41.973939 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-49b10b81-dfe3-499f-8cdf-a80ab69f4f64 req-94eed6db-6c3a-42f0-823f-657e82c3a66f service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:41.974657 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-49b10b81-dfe3-499f-8cdf-a80ab69f4f64 req-94eed6db-6c3a-42f0-823f-657e82c3a66f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:41.981959 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-49b10b81-dfe3-499f-8cdf-a80ab69f4f64 req-94eed6db-6c3a-42f0-823f-657e82c3a66f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:41.999926 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-49b10b81-dfe3-499f-8cdf-a80ab69f4f64 req-94eed6db-6c3a-42f0-823f-657e82c3a66f service nova] Creating event network-changed:070725cd-09d8-4df5-8632-579bdd28f163 for instance b39bf6c3-d041-48b4-b27a-388d6c2f7b7f on n-h2-858272-3 Oct 05 04:04:42.003749 n-d-858272-3 devstack@n-api.service[122320]: ERROR oslo.messaging._drivers.impl_rabbit [req-49b10b81-dfe3-499f-8cdf-a80ab69f4f64 req-94eed6db-6c3a-42f0-823f-657e82c3a66f service nova] [ba0744e0-e253-48ab-83ab-2414e969b274] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 04:04:42.649247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b08c96f9-2c28-4286-aa91-b29e7c8a0ca2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:42.649903 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b08c96f9-2c28-4286-aa91-b29e7c8a0ca2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:42.657652 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b08c96f9-2c28-4286-aa91-b29e7c8a0ca2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:42.658151 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b08c96f9-2c28-4286-aa91-b29e7c8a0ca2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:42.658620 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b08c96f9-2c28-4286-aa91-b29e7c8a0ca2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:42.659333 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b08c96f9-2c28-4286-aa91-b29e7c8a0ca2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:42.659847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b08c96f9-2c28-4286-aa91-b29e7c8a0ca2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:42.660282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b08c96f9-2c28-4286-aa91-b29e7c8a0ca2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:42.808559 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b08c96f9-2c28-4286-aa91-b29e7c8a0ca2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:42.821283 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b08c96f9-2c28-4286-aa91-b29e7c8a0ca2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1688 microversion: 2.1 time: 0.173802 Oct 05 04:04:42.822721 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3963/7907] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:42 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1688 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 04:04:43.013496 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [req-49b10b81-dfe3-499f-8cdf-a80ab69f4f64 req-94eed6db-6c3a-42f0-823f-657e82c3a66f service nova] [ba0744e0-e253-48ab-83ab-2414e969b274] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 48842. Oct 05 04:04:43.019513 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-49b10b81-dfe3-499f-8cdf-a80ab69f4f64 req-94eed6db-6c3a-42f0-823f-657e82c3a66f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.060648 Oct 05 04:04:43.020637 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3945/7908] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 04:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 04:04:43.846537 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-18728321-38c6-41d3-899a-b35518bfbe93 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:43.847926 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-18728321-38c6-41d3-899a-b35518bfbe93 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:43.855319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-18728321-38c6-41d3-899a-b35518bfbe93 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:43.855809 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-18728321-38c6-41d3-899a-b35518bfbe93 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:43.856246 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-18728321-38c6-41d3-899a-b35518bfbe93 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:43.856961 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-18728321-38c6-41d3-899a-b35518bfbe93 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:43.857415 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-18728321-38c6-41d3-899a-b35518bfbe93 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:43.857837 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-18728321-38c6-41d3-899a-b35518bfbe93 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:44.011060 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-18728321-38c6-41d3-899a-b35518bfbe93 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:44.019855 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-18728321-38c6-41d3-899a-b35518bfbe93 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1688 microversion: 2.1 time: 0.176688 Oct 05 04:04:44.020988 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3964/7909] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:43 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1688 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:45.045991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-7b9f95db-6eec-4d98-8da2-28e546b1d7a9 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:45.047479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-7b9f95db-6eec-4d98-8da2-28e546b1d7a9 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:45.055736 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7b9f95db-6eec-4d98-8da2-28e546b1d7a9 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:45.056602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7b9f95db-6eec-4d98-8da2-28e546b1d7a9 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:45.057318 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7b9f95db-6eec-4d98-8da2-28e546b1d7a9 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:45.058462 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7b9f95db-6eec-4d98-8da2-28e546b1d7a9 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:45.059170 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7b9f95db-6eec-4d98-8da2-28e546b1d7a9 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:45.059886 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-7b9f95db-6eec-4d98-8da2-28e546b1d7a9 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:45.217902 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-7b9f95db-6eec-4d98-8da2-28e546b1d7a9 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:45.226799 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-7b9f95db-6eec-4d98-8da2-28e546b1d7a9 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1688 microversion: 2.1 time: 0.186273 Oct 05 04:04:45.236316 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3946/7910] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:45 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1688 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:46.250924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-f97681ed-ef5c-451a-8170-c33412f8cd67 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:46.251524 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-f97681ed-ef5c-451a-8170-c33412f8cd67 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:46.259264 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f97681ed-ef5c-451a-8170-c33412f8cd67 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:46.259746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f97681ed-ef5c-451a-8170-c33412f8cd67 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:46.260189 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f97681ed-ef5c-451a-8170-c33412f8cd67 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:46.260893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f97681ed-ef5c-451a-8170-c33412f8cd67 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:46.261372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f97681ed-ef5c-451a-8170-c33412f8cd67 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:46.261795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-f97681ed-ef5c-451a-8170-c33412f8cd67 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:46.434805 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-f97681ed-ef5c-451a-8170-c33412f8cd67 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:46.444773 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-f97681ed-ef5c-451a-8170-c33412f8cd67 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1688 microversion: 2.1 time: 0.197654 Oct 05 04:04:46.445405 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3965/7911] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:46 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1688 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:47.468278 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ddb5c962-6ae8-4084-b949-7f7e4a6d5564 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:47.469142 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ddb5c962-6ae8-4084-b949-7f7e4a6d5564 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:47.476606 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ddb5c962-6ae8-4084-b949-7f7e4a6d5564 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:47.477135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ddb5c962-6ae8-4084-b949-7f7e4a6d5564 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:47.477592 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ddb5c962-6ae8-4084-b949-7f7e4a6d5564 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:47.478300 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ddb5c962-6ae8-4084-b949-7f7e4a6d5564 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:47.478766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ddb5c962-6ae8-4084-b949-7f7e4a6d5564 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:47.479200 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ddb5c962-6ae8-4084-b949-7f7e4a6d5564 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:47.626830 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ddb5c962-6ae8-4084-b949-7f7e4a6d5564 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:47.639041 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ddb5c962-6ae8-4084-b949-7f7e4a6d5564 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1688 microversion: 2.1 time: 0.174606 Oct 05 04:04:47.640483 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3947/7912] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:47 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:48.670679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a54fc5a1-c56b-4403-9cdf-82b49e7e715e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:48.672512 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a54fc5a1-c56b-4403-9cdf-82b49e7e715e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:48.683206 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a54fc5a1-c56b-4403-9cdf-82b49e7e715e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:48.683707 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a54fc5a1-c56b-4403-9cdf-82b49e7e715e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:48.684218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a54fc5a1-c56b-4403-9cdf-82b49e7e715e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:48.684979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a54fc5a1-c56b-4403-9cdf-82b49e7e715e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:48.685423 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a54fc5a1-c56b-4403-9cdf-82b49e7e715e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:48.685856 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a54fc5a1-c56b-4403-9cdf-82b49e7e715e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:48.829141 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a54fc5a1-c56b-4403-9cdf-82b49e7e715e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:48.837582 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a54fc5a1-c56b-4403-9cdf-82b49e7e715e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1688 microversion: 2.1 time: 0.173631 Oct 05 04:04:48.838923 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3966/7913] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:48 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1688 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:49.863831 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f551f3a1-17ab-472b-a69c-27cfdc8c7a9e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:49.864675 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f551f3a1-17ab-472b-a69c-27cfdc8c7a9e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:49.871926 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f551f3a1-17ab-472b-a69c-27cfdc8c7a9e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:49.872523 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f551f3a1-17ab-472b-a69c-27cfdc8c7a9e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:49.873068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f551f3a1-17ab-472b-a69c-27cfdc8c7a9e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:49.873807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f551f3a1-17ab-472b-a69c-27cfdc8c7a9e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:49.874271 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f551f3a1-17ab-472b-a69c-27cfdc8c7a9e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:49.874706 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f551f3a1-17ab-472b-a69c-27cfdc8c7a9e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:50.018345 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f551f3a1-17ab-472b-a69c-27cfdc8c7a9e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:50.027677 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f551f3a1-17ab-472b-a69c-27cfdc8c7a9e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1688 microversion: 2.1 time: 0.168654 Oct 05 04:04:50.028282 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3948/7914] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:49 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:51.051484 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d25a64b7-5021-43b1-899e-c8e7642a14bf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:51.052126 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d25a64b7-5021-43b1-899e-c8e7642a14bf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:51.059006 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d25a64b7-5021-43b1-899e-c8e7642a14bf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:51.059494 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d25a64b7-5021-43b1-899e-c8e7642a14bf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:51.059932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d25a64b7-5021-43b1-899e-c8e7642a14bf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:51.060620 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d25a64b7-5021-43b1-899e-c8e7642a14bf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:51.061109 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d25a64b7-5021-43b1-899e-c8e7642a14bf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:51.061536 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d25a64b7-5021-43b1-899e-c8e7642a14bf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:51.194174 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d25a64b7-5021-43b1-899e-c8e7642a14bf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:51.202161 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d25a64b7-5021-43b1-899e-c8e7642a14bf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1688 microversion: 2.1 time: 0.154861 Oct 05 04:04:51.202741 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3967/7915] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:51 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:52.226339 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0d8520dd-5085-4091-915e-e98965c9a5bb tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:52.226991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0d8520dd-5085-4091-915e-e98965c9a5bb tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:52.234064 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d8520dd-5085-4091-915e-e98965c9a5bb tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:52.234560 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d8520dd-5085-4091-915e-e98965c9a5bb tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:52.235009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d8520dd-5085-4091-915e-e98965c9a5bb tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:52.235702 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d8520dd-5085-4091-915e-e98965c9a5bb tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:52.236173 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d8520dd-5085-4091-915e-e98965c9a5bb tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:52.236850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d8520dd-5085-4091-915e-e98965c9a5bb tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:52.375132 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0d8520dd-5085-4091-915e-e98965c9a5bb tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:52.383513 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0d8520dd-5085-4091-915e-e98965c9a5bb tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1688 microversion: 2.1 time: 0.161085 Oct 05 04:04:52.384108 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3949/7916] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:52 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:53.408591 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fdb629b2-1b0c-4e6c-a156-99bb288fdfaf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:53.409241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fdb629b2-1b0c-4e6c-a156-99bb288fdfaf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:53.416738 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fdb629b2-1b0c-4e6c-a156-99bb288fdfaf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:53.417259 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fdb629b2-1b0c-4e6c-a156-99bb288fdfaf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:53.417701 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fdb629b2-1b0c-4e6c-a156-99bb288fdfaf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:53.418402 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fdb629b2-1b0c-4e6c-a156-99bb288fdfaf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:53.418858 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fdb629b2-1b0c-4e6c-a156-99bb288fdfaf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:53.419289 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-fdb629b2-1b0c-4e6c-a156-99bb288fdfaf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:53.614593 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fdb629b2-1b0c-4e6c-a156-99bb288fdfaf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:53.622371 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fdb629b2-1b0c-4e6c-a156-99bb288fdfaf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1688 microversion: 2.1 time: 0.217679 Oct 05 04:04:53.622946 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3968/7917] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:53 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1688 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:54.647526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-280829d5-743f-48c1-b0c2-56df552ab26f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:54.648154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-280829d5-743f-48c1-b0c2-56df552ab26f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:54.655082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-280829d5-743f-48c1-b0c2-56df552ab26f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:54.655584 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-280829d5-743f-48c1-b0c2-56df552ab26f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:54.656031 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-280829d5-743f-48c1-b0c2-56df552ab26f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:54.656733 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-280829d5-743f-48c1-b0c2-56df552ab26f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:54.657224 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-280829d5-743f-48c1-b0c2-56df552ab26f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:54.657665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-280829d5-743f-48c1-b0c2-56df552ab26f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:54.791493 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-280829d5-743f-48c1-b0c2-56df552ab26f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:54.799095 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-280829d5-743f-48c1-b0c2-56df552ab26f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1688 microversion: 2.1 time: 0.156222 Oct 05 04:04:54.799667 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3950/7918] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:54 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 04:04:55.822247 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9c8b9865-8b63-430c-b1c6-bee4184d0912 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:55.822878 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9c8b9865-8b63-430c-b1c6-bee4184d0912 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:55.829769 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c8b9865-8b63-430c-b1c6-bee4184d0912 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:55.830269 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c8b9865-8b63-430c-b1c6-bee4184d0912 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:55.830714 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c8b9865-8b63-430c-b1c6-bee4184d0912 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:55.832028 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c8b9865-8b63-430c-b1c6-bee4184d0912 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:55.832496 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c8b9865-8b63-430c-b1c6-bee4184d0912 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:55.832946 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9c8b9865-8b63-430c-b1c6-bee4184d0912 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:55.966647 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9c8b9865-8b63-430c-b1c6-bee4184d0912 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:55.975115 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9c8b9865-8b63-430c-b1c6-bee4184d0912 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1688 microversion: 2.1 time: 0.156791 Oct 05 04:04:55.975703 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3969/7919] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:55 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:56.998636 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6c0f51a5-e607-42c2-b6cf-800189d97419 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:56.999261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6c0f51a5-e607-42c2-b6cf-800189d97419 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:57.006249 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c0f51a5-e607-42c2-b6cf-800189d97419 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:57.006739 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c0f51a5-e607-42c2-b6cf-800189d97419 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:57.007183 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c0f51a5-e607-42c2-b6cf-800189d97419 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:57.007874 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c0f51a5-e607-42c2-b6cf-800189d97419 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:57.008394 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c0f51a5-e607-42c2-b6cf-800189d97419 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:57.008827 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c0f51a5-e607-42c2-b6cf-800189d97419 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:57.143533 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6c0f51a5-e607-42c2-b6cf-800189d97419 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:57.152006 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6c0f51a5-e607-42c2-b6cf-800189d97419 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1688 microversion: 2.1 time: 0.157304 Oct 05 04:04:57.152583 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3951/7920] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:56 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 04:04:58.175794 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-88f50272-33f7-4046-9c40-ae00fc167be6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:58.176444 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-88f50272-33f7-4046-9c40-ae00fc167be6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:58.183389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88f50272-33f7-4046-9c40-ae00fc167be6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:58.183873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88f50272-33f7-4046-9c40-ae00fc167be6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:58.184312 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88f50272-33f7-4046-9c40-ae00fc167be6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:58.185026 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88f50272-33f7-4046-9c40-ae00fc167be6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:58.185485 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88f50272-33f7-4046-9c40-ae00fc167be6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:58.185910 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-88f50272-33f7-4046-9c40-ae00fc167be6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:58.317298 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-88f50272-33f7-4046-9c40-ae00fc167be6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:58.325057 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-88f50272-33f7-4046-9c40-ae00fc167be6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1688 microversion: 2.1 time: 0.153258 Oct 05 04:04:58.325634 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3970/7921] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:58 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:04:59.349949 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-f32f73ac-a622-4fc1-9215-968f090e18e0 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:04:59.350544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-f32f73ac-a622-4fc1-9215-968f090e18e0 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:04:59.357471 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f32f73ac-a622-4fc1-9215-968f090e18e0 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:59.357974 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f32f73ac-a622-4fc1-9215-968f090e18e0 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:59.358442 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f32f73ac-a622-4fc1-9215-968f090e18e0 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:59.359135 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f32f73ac-a622-4fc1-9215-968f090e18e0 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:04:59.359608 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f32f73ac-a622-4fc1-9215-968f090e18e0 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:04:59.360047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-f32f73ac-a622-4fc1-9215-968f090e18e0 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:04:59.492056 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-f32f73ac-a622-4fc1-9215-968f090e18e0 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:04:59.499825 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-f32f73ac-a622-4fc1-9215-968f090e18e0 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1688 microversion: 2.1 time: 0.154545 Oct 05 04:04:59.500401 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3952/7922] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:04:59 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:05:00.523070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b067fee4-7189-47d7-bbd3-8891fa80007d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:05:00.523720 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b067fee4-7189-47d7-bbd3-8891fa80007d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:05:00.530750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b067fee4-7189-47d7-bbd3-8891fa80007d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:05:00.531239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b067fee4-7189-47d7-bbd3-8891fa80007d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:05:00.531679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b067fee4-7189-47d7-bbd3-8891fa80007d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:05:00.532374 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b067fee4-7189-47d7-bbd3-8891fa80007d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:05:00.532835 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b067fee4-7189-47d7-bbd3-8891fa80007d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:05:00.533287 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b067fee4-7189-47d7-bbd3-8891fa80007d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:05:00.668629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b067fee4-7189-47d7-bbd3-8891fa80007d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:05:00.676787 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b067fee4-7189-47d7-bbd3-8891fa80007d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1688 microversion: 2.1 time: 0.158165 Oct 05 04:05:00.677407 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3971/7923] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:05:00 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:05:00.940041 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-bfffe843-db46-41f1-836b-3057ade492e4 req-6a5d1457-2e1e-43fd-85aa-61dcdb0c631d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b39bf6c3-d041-48b4-b27a-388d6c2f7b7f", "name": "network-vif-plugged", "status": "completed", "tag": "070725cd-09d8-4df5-8632-579bdd28f163"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:05:00.950430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-bfffe843-db46-41f1-836b-3057ade492e4 req-6a5d1457-2e1e-43fd-85aa-61dcdb0c631d service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:05:00.950931 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-bfffe843-db46-41f1-836b-3057ade492e4 req-6a5d1457-2e1e-43fd-85aa-61dcdb0c631d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:05:00.951379 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-bfffe843-db46-41f1-836b-3057ade492e4 req-6a5d1457-2e1e-43fd-85aa-61dcdb0c631d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:05:00.963177 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-bfffe843-db46-41f1-836b-3057ade492e4 req-6a5d1457-2e1e-43fd-85aa-61dcdb0c631d service nova] Creating event network-vif-plugged:070725cd-09d8-4df5-8632-579bdd28f163 for instance b39bf6c3-d041-48b4-b27a-388d6c2f7b7f on n-h2-858272-3 Oct 05 04:05:00.968328 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-bfffe843-db46-41f1-836b-3057ade492e4 req-6a5d1457-2e1e-43fd-85aa-61dcdb0c631d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087896 Oct 05 04:05:00.968944 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3953/7924] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 04:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 04:05:01.700511 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-8143cc0b-4ca5-4977-a4a1-1edce63210bf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:05:01.701090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-8143cc0b-4ca5-4977-a4a1-1edce63210bf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:05:01.708543 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8143cc0b-4ca5-4977-a4a1-1edce63210bf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:05:01.709060 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8143cc0b-4ca5-4977-a4a1-1edce63210bf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:05:01.709493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8143cc0b-4ca5-4977-a4a1-1edce63210bf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:05:01.710176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8143cc0b-4ca5-4977-a4a1-1edce63210bf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:05:01.710626 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8143cc0b-4ca5-4977-a4a1-1edce63210bf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:05:01.711045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-8143cc0b-4ca5-4977-a4a1-1edce63210bf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:05:01.844212 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-8143cc0b-4ca5-4977-a4a1-1edce63210bf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:05:01.852701 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-8143cc0b-4ca5-4977-a4a1-1edce63210bf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1688 microversion: 2.1 time: 0.156210 Oct 05 04:05:01.853312 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3972/7925] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:05:01 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:05:02.879078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-46948d91-df16-4ed2-908b-341973935a89 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:05:02.879818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-46948d91-df16-4ed2-908b-341973935a89 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:05:02.886082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-46948d91-df16-4ed2-908b-341973935a89 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:05:02.886579 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-46948d91-df16-4ed2-908b-341973935a89 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:05:02.887024 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-46948d91-df16-4ed2-908b-341973935a89 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:05:02.887722 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-46948d91-df16-4ed2-908b-341973935a89 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:05:02.888184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-46948d91-df16-4ed2-908b-341973935a89 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:05:02.888615 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-46948d91-df16-4ed2-908b-341973935a89 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:05:03.048152 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-46948d91-df16-4ed2-908b-341973935a89 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:05:03.057263 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-46948d91-df16-4ed2-908b-341973935a89 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1688 microversion: 2.1 time: 0.183723 Oct 05 04:05:03.065741 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3954/7926] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:05:02 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1688 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:05:04.083172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-08a2ba58-bd20-44cd-94dc-8a21f0266b03 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:05:04.083799 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-08a2ba58-bd20-44cd-94dc-8a21f0266b03 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:05:04.090776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08a2ba58-bd20-44cd-94dc-8a21f0266b03 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:05:04.091270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08a2ba58-bd20-44cd-94dc-8a21f0266b03 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:05:04.091712 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08a2ba58-bd20-44cd-94dc-8a21f0266b03 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:05:04.092414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08a2ba58-bd20-44cd-94dc-8a21f0266b03 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:05:04.092872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08a2ba58-bd20-44cd-94dc-8a21f0266b03 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:05:04.093327 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08a2ba58-bd20-44cd-94dc-8a21f0266b03 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:05:04.227829 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-08a2ba58-bd20-44cd-94dc-8a21f0266b03 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:05:04.235619 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-08a2ba58-bd20-44cd-94dc-8a21f0266b03 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1675 microversion: 2.1 time: 0.157634 Oct 05 04:05:04.236192 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3973/7927] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:05:04 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:06:49.402194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=27 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:06:49.409884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:06:49.410654 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:06:49.413885 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=75 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:06:49.419027 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-fec9a199-1ed5-43db-aeb5-5f0962f816cb tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:06:49.419545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fec9a199-1ed5-43db-aeb5-5f0962f816cb tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:06:49.430396 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fec9a199-1ed5-43db-aeb5-5f0962f816cb tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:06:49.430907 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fec9a199-1ed5-43db-aeb5-5f0962f816cb tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:06:49.431358 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fec9a199-1ed5-43db-aeb5-5f0962f816cb tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:06:49.432074 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fec9a199-1ed5-43db-aeb5-5f0962f816cb tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:06:49.432548 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fec9a199-1ed5-43db-aeb5-5f0962f816cb tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:06:49.433009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-fec9a199-1ed5-43db-aeb5-5f0962f816cb tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:06:49.464073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-fec9a199-1ed5-43db-aeb5-5f0962f816cb tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 04:06:49.482812 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-0c2c6b8a-1dec-466d-bb1f-12a001a584a0 req-22c5a90b-9874-41ed-b8c0-f8da7081eed4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b39bf6c3-d041-48b4-b27a-388d6c2f7b7f", "tag": "070725cd-09d8-4df5-8632-579bdd28f163"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:06:49.493601 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-0c2c6b8a-1dec-466d-bb1f-12a001a584a0 req-22c5a90b-9874-41ed-b8c0-f8da7081eed4 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:06:49.494092 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-0c2c6b8a-1dec-466d-bb1f-12a001a584a0 req-22c5a90b-9874-41ed-b8c0-f8da7081eed4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:06:49.494526 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-0c2c6b8a-1dec-466d-bb1f-12a001a584a0 req-22c5a90b-9874-41ed-b8c0-f8da7081eed4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:06:49.506801 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-0c2c6b8a-1dec-466d-bb1f-12a001a584a0 req-22c5a90b-9874-41ed-b8c0-f8da7081eed4 service nova] Creating event network-changed:070725cd-09d8-4df5-8632-579bdd28f163 for instance b39bf6c3-d041-48b4-b27a-388d6c2f7b7f on n-h2-858272-3 Oct 05 04:06:49.512713 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-0c2c6b8a-1dec-466d-bb1f-12a001a584a0 req-22c5a90b-9874-41ed-b8c0-f8da7081eed4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108458 Oct 05 04:06:49.513433 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3974/7928] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 04:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 04:06:49.559639 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-fec9a199-1ed5-43db-aeb5-5f0962f816cb tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 204 len: 0 microversion: 2.1 time: 0.159358 Oct 05 04:06:49.562014 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3955/7929] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 04:06:49 2022] DELETE /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 04:06:49.573711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e65fab5b-931a-48bf-a081-23a48609b048 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:06:49.574849 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e65fab5b-931a-48bf-a081-23a48609b048 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:06:49.581400 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e65fab5b-931a-48bf-a081-23a48609b048 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:06:49.581886 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e65fab5b-931a-48bf-a081-23a48609b048 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:06:49.582321 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e65fab5b-931a-48bf-a081-23a48609b048 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:06:49.583138 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e65fab5b-931a-48bf-a081-23a48609b048 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:06:49.584286 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e65fab5b-931a-48bf-a081-23a48609b048 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:06:49.584771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e65fab5b-931a-48bf-a081-23a48609b048 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:06:49.734570 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e65fab5b-931a-48bf-a081-23a48609b048 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:06:49.743183 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e65fab5b-931a-48bf-a081-23a48609b048 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1681 microversion: 2.1 time: 0.176987 Oct 05 04:06:49.743769 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3975/7930] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:06:49 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:06:50.768160 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-434854f9-6504-4c5f-b40d-2fc8a13cab33 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:06:50.768871 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-434854f9-6504-4c5f-b40d-2fc8a13cab33 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:06:50.776743 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-434854f9-6504-4c5f-b40d-2fc8a13cab33 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:06:50.777273 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-434854f9-6504-4c5f-b40d-2fc8a13cab33 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:06:50.777719 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-434854f9-6504-4c5f-b40d-2fc8a13cab33 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:06:50.778421 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-434854f9-6504-4c5f-b40d-2fc8a13cab33 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:06:50.778895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-434854f9-6504-4c5f-b40d-2fc8a13cab33 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:06:50.779317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-434854f9-6504-4c5f-b40d-2fc8a13cab33 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:06:50.970689 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-434854f9-6504-4c5f-b40d-2fc8a13cab33 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:06:50.979083 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-434854f9-6504-4c5f-b40d-2fc8a13cab33 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1681 microversion: 2.1 time: 0.215088 Oct 05 04:06:50.979683 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3956/7931] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:06:50 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1681 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:06:51.865132 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-3cf79850-cb06-4e35-ada6-fc90bd6d4ef9 req-8054074d-cf77-43a5-9d60-83b9d72258ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b39bf6c3-d041-48b4-b27a-388d6c2f7b7f", "name": "network-vif-deleted", "tag": "070725cd-09d8-4df5-8632-579bdd28f163"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:06:51.877184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-3cf79850-cb06-4e35-ada6-fc90bd6d4ef9 req-8054074d-cf77-43a5-9d60-83b9d72258ab service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:06:51.877664 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-3cf79850-cb06-4e35-ada6-fc90bd6d4ef9 req-8054074d-cf77-43a5-9d60-83b9d72258ab service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:06:51.878090 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-3cf79850-cb06-4e35-ada6-fc90bd6d4ef9 req-8054074d-cf77-43a5-9d60-83b9d72258ab service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:06:51.893867 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-3cf79850-cb06-4e35-ada6-fc90bd6d4ef9 req-8054074d-cf77-43a5-9d60-83b9d72258ab service nova] Creating event network-vif-deleted:070725cd-09d8-4df5-8632-579bdd28f163 for instance b39bf6c3-d041-48b4-b27a-388d6c2f7b7f on n-h2-858272-3 Oct 05 04:06:51.898857 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-3cf79850-cb06-4e35-ada6-fc90bd6d4ef9 req-8054074d-cf77-43a5-9d60-83b9d72258ab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037624 Oct 05 04:06:51.899464 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3976/7932] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 04:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 04:06:52.004237 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d3b7d0b8-a77c-4477-a2a9-f2ca8c8341fb tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:06:52.005035 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d3b7d0b8-a77c-4477-a2a9-f2ca8c8341fb tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:06:52.013762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3b7d0b8-a77c-4477-a2a9-f2ca8c8341fb tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:06:52.014267 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3b7d0b8-a77c-4477-a2a9-f2ca8c8341fb tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:06:52.014719 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3b7d0b8-a77c-4477-a2a9-f2ca8c8341fb tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:06:52.015671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3b7d0b8-a77c-4477-a2a9-f2ca8c8341fb tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:06:52.016144 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3b7d0b8-a77c-4477-a2a9-f2ca8c8341fb tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:06:52.016583 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3b7d0b8-a77c-4477-a2a9-f2ca8c8341fb tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:06:52.051380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3b7d0b8-a77c-4477-a2a9-f2ca8c8341fb tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:06:52.051805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3b7d0b8-a77c-4477-a2a9-f2ca8c8341fb tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:06:52.052335 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3b7d0b8-a77c-4477-a2a9-f2ca8c8341fb tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:06:52.052713 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-d3b7d0b8-a77c-4477-a2a9-f2ca8c8341fb tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lazy-loading 'fault' on Instance uuid b39bf6c3-d041-48b4-b27a-388d6c2f7b7f {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 04:06:52.095266 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d3b7d0b8-a77c-4477-a2a9-f2ca8c8341fb tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:06:52.104138 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d3b7d0b8-a77c-4477-a2a9-f2ca8c8341fb tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 200 len: 1337 microversion: 2.1 time: 0.105436 Oct 05 04:06:52.104713 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3957/7933] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:06:51 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 1337 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:06:53.129070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c38e9a70-48a2-46e0-b4b4-637bf612c661 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:06:53.129781 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c38e9a70-48a2-46e0-b4b4-637bf612c661 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: b39bf6c3-d041-48b4-b27a-388d6c2f7b7f] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:06:53.137115 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c38e9a70-48a2-46e0-b4b4-637bf612c661 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:06:53.137618 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c38e9a70-48a2-46e0-b4b4-637bf612c661 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:06:53.138058 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c38e9a70-48a2-46e0-b4b4-637bf612c661 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:06:53.138755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c38e9a70-48a2-46e0-b4b4-637bf612c661 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:06:53.139218 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c38e9a70-48a2-46e0-b4b4-637bf612c661 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:06:53.139649 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c38e9a70-48a2-46e0-b4b4-637bf612c661 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:06:53.154120 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-c38e9a70-48a2-46e0-b4b4-637bf612c661 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] HTTP exception thrown: Instance b39bf6c3-d041-48b4-b27a-388d6c2f7b7f could not be found. Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c38e9a70-48a2-46e0-b4b4-637bf612c661 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Request method failure captured: Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f HTTP/1.1 Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPQGPRPQnlNT_v30C5torN91hZQNkDS45jegpOTqWfVKNAlWZt-x5ErlO6jUb-kTNZRiNAMrWhkj2jony7Z8xHk14ko0bxro-M4MtPLpET7kSttRAg1Yeaa8zYnbXQ1Vb7hgDT3k-ZifMleEGiBrfNt1RKuFcjdmvEMaB_TLLLvoqlRk Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 8270dd7d19da4edc9b1a5e7598e0e1cf Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TestShelveInstance-1546434659 Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8270dd7d19da4edc9b1a5e7598e0e1cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8270dd7d19da4edc9b1a5e7598e0e1cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8270dd7d19da4edc9b1a5e7598e0e1cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8270dd7d19da4edc9b1a5e7598e0e1cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TestShelveInstance-1546434659 Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 8270dd7d19da4edc9b1a5e7598e0e1cf Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TestShelveInstance-1546434659 Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TestShelveInstance-1546434659-project Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 60d6950cfc304bebbb08fc94704b34a6 Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TestShelveInstance-1546434659-project Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance b39bf6c3-d041-48b4-b27a-388d6c2f7b7f could not be found. Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'b39bf6c3-d041-48b4-b27a-388d6c2f7b7f'} Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b39bf6c3-d041-48b4-b27a-388d6c2f7b7f could not be found. Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b39bf6c3-d041-48b4-b27a-388d6c2f7b7f could not be found. Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 04:06:53.155746 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 04:06:53.161350 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 04:06:53.161350 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 04:06:53.161350 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 04:06:53.161350 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 04:06:53.161350 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 04:06:53.161350 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b39bf6c3-d041-48b4-b27a-388d6c2f7b7f could not be found. Oct 05 04:06:53.161350 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 04:06:53.161350 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c38e9a70-48a2-46e0-b4b4-637bf612c661 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Returning 404 to user: Instance b39bf6c3-d041-48b4-b27a-388d6c2f7b7f could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 04:06:53.161350 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c38e9a70-48a2-46e0-b4b4-637bf612c661 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f" status: 404 len: 111 microversion: 2.1 time: 0.033280 Oct 05 04:06:53.161350 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3977/7934] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:06:53 2022] GET /compute/v2.1/servers/b39bf6c3-d041-48b4-b27a-388d6c2f7b7f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 04:06:53.328880 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-84aa969e-6b9f-4b04-b248-55ceb85c27f7 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '.version_select at 0x7fcce43e11f0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:06:53.353672 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-84aa969e-6b9f-4b04-b248-55ceb85c27f7 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1039365775" status: 202 len: 0 microversion: 2.1 time: 0.028324 Oct 05 04:06:53.354052 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3958/7935] 10.222.0.16 () {58 vars in 1254 bytes} [Wed Oct 5 04:06:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1039365775 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 04:06:53.382867 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6b434c73-4190-4ec0-a1c4-b436a3769082 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Action: 'create', calling method: .version_select at 0x7fccdec61940>, body: {"keypair": {"name": "tempest-TestShelveInstance-663487803", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCihzOvYGZzBFZ4a3V7OvYiM02gGucgBSo60lmUqitwSx3ulrtG4pIaiPUR4CVBCFy56qxc/yQTAdT05Hs1nx3gYs7tfEefWscltbUvMmemnloljLUHMqCU3lTpOPwl09g=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:06:53.398359 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-6b434c73-4190-4ec0-a1c4-b436a3769082 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Getting quotas for project 8270dd7d19da4edc9b1a5e7598e0e1cf. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 04:06:53.403450 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-6b434c73-4190-4ec0-a1c4-b436a3769082 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Getting quotas for user 60d6950cfc304bebbb08fc94704b34a6 and project 8270dd7d19da4edc9b1a5e7598e0e1cf. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 04:06:53.429828 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6b434c73-4190-4ec0-a1c4-b436a3769082 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.050915 Oct 05 04:06:53.430440 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3978/7936] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 04:06:53 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 04:07:09.591146 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-445595c5-5663-4101-8635-81472cb6b89e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-349296529", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-663487803", "security_groups": [{"name": "tempest-secgroup-smoke-2011570402"}], "networks": [{"uuid": "1b09aa57-2434-44e2-9305-4da7618914b6"}], "block_device_mapping_v2": [{"uuid": "96b96c1a-f541-4267-82ea-3223a3e240f9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:07:09.602215 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:07:09.602881 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:07:09.708656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-445595c5-5663-4101-8635-81472cb6b89e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] validate_networks() for [('1b09aa57-2434-44e2-9305-4da7618914b6', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 04:07:10.123068 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-445595c5-5663-4101-8635-81472cb6b89e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 04:07:10.123507 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-445595c5-5663-4101-8635-81472cb6b89e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 04:07:10.124052 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-445595c5-5663-4101-8635-81472cb6b89e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 04:07:10.124476 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-445595c5-5663-4101-8635-81472cb6b89e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 04:07:10.124917 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-445595c5-5663-4101-8635-81472cb6b89e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 04:07:10.134376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-445595c5-5663-4101-8635-81472cb6b89e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:10.134882 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-445595c5-5663-4101-8635-81472cb6b89e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:10.135329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-445595c5-5663-4101-8635-81472cb6b89e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:10.136075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-445595c5-5663-4101-8635-81472cb6b89e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:10.136546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-445595c5-5663-4101-8635-81472cb6b89e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:10.137017 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-445595c5-5663-4101-8635-81472cb6b89e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:10.154082 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-445595c5-5663-4101-8635-81472cb6b89e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Getting quotas for project 8270dd7d19da4edc9b1a5e7598e0e1cf. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 04:07:10.159245 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-445595c5-5663-4101-8635-81472cb6b89e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Getting quotas for user 60d6950cfc304bebbb08fc94704b34a6 and project 8270dd7d19da4edc9b1a5e7598e0e1cf. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 04:07:10.217942 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-445595c5-5663-4101-8635-81472cb6b89e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 04:07:10.220130 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-445595c5-5663-4101-8635-81472cb6b89e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='96b96c1a-f541-4267-82ea-3223a3e240f9',volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 04:07:10.342548 n-d-858272-3 devstack@n-api.service[122320]: ERROR oslo.messaging._drivers.impl_rabbit [None req-445595c5-5663-4101-8635-81472cb6b89e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [ca7cabca-df40-471d-99a3-ac55a439d93a] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 04:07:11.350006 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [None req-445595c5-5663-4101-8635-81472cb6b89e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [ca7cabca-df40-471d-99a3-ac55a439d93a] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 49146. Oct 05 04:07:11.354301 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-445595c5-5663-4101-8635-81472cb6b89e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.767404 Oct 05 04:07:11.357976 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3959/7937] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 04:07:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 04:07:11.364367 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=12 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:07:11.365162 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=4 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:07:11.365913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:07:11.372045 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e7aca06e-d86e-41c0-87a7-3ea4649a3c69 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:07:11.372847 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e7aca06e-d86e-41c0-87a7-3ea4649a3c69 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:07:11.431169 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e7aca06e-d86e-41c0-87a7-3ea4649a3c69 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:07:11.438298 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e7aca06e-d86e-41c0-87a7-3ea4649a3c69 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1087 microversion: 2.1 time: 0.076082 Oct 05 04:07:11.438870 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3979/7938] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:07:11 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1087 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:07:12.463490 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4b82536e-3e12-40e3-9b9a-72a20ba2bf63 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:07:12.464306 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4b82536e-3e12-40e3-9b9a-72a20ba2bf63 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:07:12.472085 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b82536e-3e12-40e3-9b9a-72a20ba2bf63 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:12.472747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b82536e-3e12-40e3-9b9a-72a20ba2bf63 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:12.473321 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b82536e-3e12-40e3-9b9a-72a20ba2bf63 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:12.474136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b82536e-3e12-40e3-9b9a-72a20ba2bf63 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:12.474725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b82536e-3e12-40e3-9b9a-72a20ba2bf63 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:12.475329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4b82536e-3e12-40e3-9b9a-72a20ba2bf63 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:12.571307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4b82536e-3e12-40e3-9b9a-72a20ba2bf63 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:07:12.579770 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4b82536e-3e12-40e3-9b9a-72a20ba2bf63 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1193 microversion: 2.1 time: 0.121707 Oct 05 04:07:12.580536 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3960/7939] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:07:12 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1193 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:07:13.603677 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-49b76d5d-e000-41ac-84ac-a04ce64e767b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:07:13.604550 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-49b76d5d-e000-41ac-84ac-a04ce64e767b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:07:13.611809 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-49b76d5d-e000-41ac-84ac-a04ce64e767b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:13.612776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-49b76d5d-e000-41ac-84ac-a04ce64e767b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:13.613463 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-49b76d5d-e000-41ac-84ac-a04ce64e767b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:13.614439 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-49b76d5d-e000-41ac-84ac-a04ce64e767b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:13.615204 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-49b76d5d-e000-41ac-84ac-a04ce64e767b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:13.616423 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-49b76d5d-e000-41ac-84ac-a04ce64e767b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:13.843059 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-49b76d5d-e000-41ac-84ac-a04ce64e767b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:07:13.852780 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-49b76d5d-e000-41ac-84ac-a04ce64e767b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1271 microversion: 2.1 time: 0.253212 Oct 05 04:07:13.864374 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3980/7940] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:07:13 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1271 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:07:14.039890 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-bea19e5b-f030-4b24-a114-dd7468c9632b req-508bf2c0-401c-4d20-ae65-ba1dfb0cd4d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27fe9596-7a76-46e2-9e25-91395adcd069", "tag": "bb180f7a-065b-4bb7-a61c-9fcd540cd5b2"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:07:14.056426 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-bea19e5b-f030-4b24-a114-dd7468c9632b req-508bf2c0-401c-4d20-ae65-ba1dfb0cd4d4 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:14.056957 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-bea19e5b-f030-4b24-a114-dd7468c9632b req-508bf2c0-401c-4d20-ae65-ba1dfb0cd4d4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:14.057596 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-bea19e5b-f030-4b24-a114-dd7468c9632b req-508bf2c0-401c-4d20-ae65-ba1dfb0cd4d4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:14.071523 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-bea19e5b-f030-4b24-a114-dd7468c9632b req-508bf2c0-401c-4d20-ae65-ba1dfb0cd4d4 service nova] Creating event network-changed:bb180f7a-065b-4bb7-a61c-9fcd540cd5b2 for instance 27fe9596-7a76-46e2-9e25-91395adcd069 on n-h1-858272-3 Oct 05 04:07:14.077952 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-bea19e5b-f030-4b24-a114-dd7468c9632b req-508bf2c0-401c-4d20-ae65-ba1dfb0cd4d4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041952 Oct 05 04:07:14.078882 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3961/7941] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 04:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 04:07:14.877670 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4ed9a97d-3a5e-474b-88ca-3e1b568178bc tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:07:14.878478 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4ed9a97d-3a5e-474b-88ca-3e1b568178bc tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:07:14.885773 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ed9a97d-3a5e-474b-88ca-3e1b568178bc tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:14.886389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ed9a97d-3a5e-474b-88ca-3e1b568178bc tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:14.886905 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ed9a97d-3a5e-474b-88ca-3e1b568178bc tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:14.887704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ed9a97d-3a5e-474b-88ca-3e1b568178bc tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:14.888239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ed9a97d-3a5e-474b-88ca-3e1b568178bc tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:14.888764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4ed9a97d-3a5e-474b-88ca-3e1b568178bc tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:15.102009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4ed9a97d-3a5e-474b-88ca-3e1b568178bc tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:07:15.110231 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4ed9a97d-3a5e-474b-88ca-3e1b568178bc tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1271 microversion: 2.1 time: 0.238193 Oct 05 04:07:15.110828 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3981/7942] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:07:14 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1271 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:07:16.136171 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-33157f11-3786-4702-b0cf-3c90db8ac6fa tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:07:16.136882 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-33157f11-3786-4702-b0cf-3c90db8ac6fa tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:07:16.143136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33157f11-3786-4702-b0cf-3c90db8ac6fa tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:16.143626 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33157f11-3786-4702-b0cf-3c90db8ac6fa tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:16.144075 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33157f11-3786-4702-b0cf-3c90db8ac6fa tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:16.144770 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33157f11-3786-4702-b0cf-3c90db8ac6fa tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:16.145260 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33157f11-3786-4702-b0cf-3c90db8ac6fa tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:16.145693 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-33157f11-3786-4702-b0cf-3c90db8ac6fa tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:16.279386 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-33157f11-3786-4702-b0cf-3c90db8ac6fa tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:07:16.287268 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-33157f11-3786-4702-b0cf-3c90db8ac6fa tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1271 microversion: 2.1 time: 0.156849 Oct 05 04:07:16.288073 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3962/7943] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:07:16 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1271 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:07:17.310938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5be79bc6-2328-45b1-ad7a-2918b07c1879 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:07:17.311644 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5be79bc6-2328-45b1-ad7a-2918b07c1879 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:07:17.318695 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5be79bc6-2328-45b1-ad7a-2918b07c1879 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:17.319193 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5be79bc6-2328-45b1-ad7a-2918b07c1879 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:17.319827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5be79bc6-2328-45b1-ad7a-2918b07c1879 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:17.320516 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5be79bc6-2328-45b1-ad7a-2918b07c1879 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:17.321002 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5be79bc6-2328-45b1-ad7a-2918b07c1879 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:17.321433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5be79bc6-2328-45b1-ad7a-2918b07c1879 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:17.459710 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5be79bc6-2328-45b1-ad7a-2918b07c1879 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:07:17.467897 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5be79bc6-2328-45b1-ad7a-2918b07c1879 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1271 microversion: 2.1 time: 0.160788 Oct 05 04:07:17.468485 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3982/7944] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:07:17 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1271 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:07:18.491647 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cf40c680-0e0c-4e1b-9900-eb2b00094abe tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:07:18.492203 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cf40c680-0e0c-4e1b-9900-eb2b00094abe tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:07:18.499062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf40c680-0e0c-4e1b-9900-eb2b00094abe tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:18.499556 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf40c680-0e0c-4e1b-9900-eb2b00094abe tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:18.500003 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf40c680-0e0c-4e1b-9900-eb2b00094abe tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:18.500691 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf40c680-0e0c-4e1b-9900-eb2b00094abe tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:18.501184 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf40c680-0e0c-4e1b-9900-eb2b00094abe tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:18.501618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cf40c680-0e0c-4e1b-9900-eb2b00094abe tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:18.634787 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cf40c680-0e0c-4e1b-9900-eb2b00094abe tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:07:18.643093 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cf40c680-0e0c-4e1b-9900-eb2b00094abe tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1259 microversion: 2.1 time: 0.155694 Oct 05 04:07:18.643676 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3963/7945] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:07:18 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:07:19.668481 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-deb2196b-f7c1-415b-868b-48c7c0944ea3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:07:19.669134 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-deb2196b-f7c1-415b-868b-48c7c0944ea3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:07:19.676088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-deb2196b-f7c1-415b-868b-48c7c0944ea3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:19.676585 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-deb2196b-f7c1-415b-868b-48c7c0944ea3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:19.677059 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-deb2196b-f7c1-415b-868b-48c7c0944ea3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:19.677767 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-deb2196b-f7c1-415b-868b-48c7c0944ea3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:19.678232 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-deb2196b-f7c1-415b-868b-48c7c0944ea3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:19.679370 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-deb2196b-f7c1-415b-868b-48c7c0944ea3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:19.815288 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-deb2196b-f7c1-415b-868b-48c7c0944ea3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:07:19.823210 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-deb2196b-f7c1-415b-868b-48c7c0944ea3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1259 microversion: 2.1 time: 0.159328 Oct 05 04:07:19.823785 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3983/7946] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:07:19 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:07:20.846194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-ea184ba1-5e3a-4048-9608-c22d81b1093f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:07:20.846828 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-ea184ba1-5e3a-4048-9608-c22d81b1093f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:07:20.849708 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:07:20.850404 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:07:20.857172 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea184ba1-5e3a-4048-9608-c22d81b1093f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:20.857680 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea184ba1-5e3a-4048-9608-c22d81b1093f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:20.858136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea184ba1-5e3a-4048-9608-c22d81b1093f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:20.858844 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea184ba1-5e3a-4048-9608-c22d81b1093f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:20.859318 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea184ba1-5e3a-4048-9608-c22d81b1093f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:20.859759 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-ea184ba1-5e3a-4048-9608-c22d81b1093f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:20.994621 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-ea184ba1-5e3a-4048-9608-c22d81b1093f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:07:21.002356 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-ea184ba1-5e3a-4048-9608-c22d81b1093f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1259 microversion: 2.1 time: 0.160156 Oct 05 04:07:21.002949 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3964/7947] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:07:20 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:07:22.025776 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-7a7352cf-32c7-4368-8145-e20fadfa6614 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:07:22.026348 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-7a7352cf-32c7-4368-8145-e20fadfa6614 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:07:22.029125 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:07:22.034583 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7a7352cf-32c7-4368-8145-e20fadfa6614 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:22.035070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7a7352cf-32c7-4368-8145-e20fadfa6614 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:22.035502 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7a7352cf-32c7-4368-8145-e20fadfa6614 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:22.036192 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7a7352cf-32c7-4368-8145-e20fadfa6614 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:22.036642 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7a7352cf-32c7-4368-8145-e20fadfa6614 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:22.037101 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-7a7352cf-32c7-4368-8145-e20fadfa6614 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:22.176687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-7a7352cf-32c7-4368-8145-e20fadfa6614 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:07:22.185049 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-7a7352cf-32c7-4368-8145-e20fadfa6614 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1259 microversion: 2.1 time: 0.164003 Oct 05 04:07:22.185631 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3984/7948] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:07:22 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:07:23.209233 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-291556c2-dc68-4e1a-a617-5661953e4398 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:07:23.210540 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-291556c2-dc68-4e1a-a617-5661953e4398 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:07:23.218858 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-291556c2-dc68-4e1a-a617-5661953e4398 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:23.219357 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-291556c2-dc68-4e1a-a617-5661953e4398 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:23.219805 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-291556c2-dc68-4e1a-a617-5661953e4398 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:23.220512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-291556c2-dc68-4e1a-a617-5661953e4398 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:23.221004 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-291556c2-dc68-4e1a-a617-5661953e4398 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:23.221446 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-291556c2-dc68-4e1a-a617-5661953e4398 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:23.358657 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-291556c2-dc68-4e1a-a617-5661953e4398 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:07:23.368025 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-291556c2-dc68-4e1a-a617-5661953e4398 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1259 microversion: 2.1 time: 0.163183 Oct 05 04:07:23.368612 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3965/7949] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:07:23 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:07:24.390948 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a2b558e5-7f56-4ae4-907e-91309b51d02a tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:07:24.391547 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a2b558e5-7f56-4ae4-907e-91309b51d02a tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:07:24.398942 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a2b558e5-7f56-4ae4-907e-91309b51d02a tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:24.399422 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a2b558e5-7f56-4ae4-907e-91309b51d02a tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:24.399861 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a2b558e5-7f56-4ae4-907e-91309b51d02a tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:24.400568 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a2b558e5-7f56-4ae4-907e-91309b51d02a tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:24.401058 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a2b558e5-7f56-4ae4-907e-91309b51d02a tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:24.401482 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a2b558e5-7f56-4ae4-907e-91309b51d02a tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:24.531966 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a2b558e5-7f56-4ae4-907e-91309b51d02a tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:07:24.540407 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a2b558e5-7f56-4ae4-907e-91309b51d02a tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1259 microversion: 2.1 time: 0.153403 Oct 05 04:07:24.540997 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3985/7950] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:07:24 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:07:25.563346 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-529c0814-e379-4224-938d-026bcdeedbff tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:07:25.563978 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-529c0814-e379-4224-938d-026bcdeedbff tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:07:25.571125 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-529c0814-e379-4224-938d-026bcdeedbff tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:25.571634 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-529c0814-e379-4224-938d-026bcdeedbff tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:25.572085 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-529c0814-e379-4224-938d-026bcdeedbff tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:25.572799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-529c0814-e379-4224-938d-026bcdeedbff tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:25.573382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-529c0814-e379-4224-938d-026bcdeedbff tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:25.573795 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-529c0814-e379-4224-938d-026bcdeedbff tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:25.710892 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-529c0814-e379-4224-938d-026bcdeedbff tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:07:25.718716 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-529c0814-e379-4224-938d-026bcdeedbff tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1259 microversion: 2.1 time: 0.159387 Oct 05 04:07:25.719292 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3966/7951] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:07:25 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:07:26.743580 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-67cd37e3-ff98-4278-9771-4b399426ae5d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:07:26.744192 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-67cd37e3-ff98-4278-9771-4b399426ae5d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:07:26.751160 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-67cd37e3-ff98-4278-9771-4b399426ae5d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:26.751651 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-67cd37e3-ff98-4278-9771-4b399426ae5d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:26.752085 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-67cd37e3-ff98-4278-9771-4b399426ae5d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:26.752769 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-67cd37e3-ff98-4278-9771-4b399426ae5d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:26.753257 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-67cd37e3-ff98-4278-9771-4b399426ae5d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:26.753680 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-67cd37e3-ff98-4278-9771-4b399426ae5d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:26.885362 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-67cd37e3-ff98-4278-9771-4b399426ae5d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:07:26.893152 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-67cd37e3-ff98-4278-9771-4b399426ae5d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1259 microversion: 2.1 time: 0.154592 Oct 05 04:07:26.893729 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3986/7952] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:07:26 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 04:07:27.916738 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a3755f12-0501-4526-affa-f56b9f775fe2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:07:27.917315 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a3755f12-0501-4526-affa-f56b9f775fe2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:07:27.924121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3755f12-0501-4526-affa-f56b9f775fe2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:27.924624 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3755f12-0501-4526-affa-f56b9f775fe2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:27.925109 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3755f12-0501-4526-affa-f56b9f775fe2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:27.925802 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3755f12-0501-4526-affa-f56b9f775fe2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:27.926267 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3755f12-0501-4526-affa-f56b9f775fe2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:27.926702 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a3755f12-0501-4526-affa-f56b9f775fe2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:28.059912 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a3755f12-0501-4526-affa-f56b9f775fe2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:07:28.067598 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a3755f12-0501-4526-affa-f56b9f775fe2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1259 microversion: 2.1 time: 0.155017 Oct 05 04:07:28.068170 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3967/7953] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:07:27 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:07:29.091646 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-4f838acd-18a1-4312-a785-9e2d65531082 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:07:29.092244 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-4f838acd-18a1-4312-a785-9e2d65531082 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:07:29.099148 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f838acd-18a1-4312-a785-9e2d65531082 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:29.099635 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f838acd-18a1-4312-a785-9e2d65531082 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:29.100070 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f838acd-18a1-4312-a785-9e2d65531082 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:29.100753 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f838acd-18a1-4312-a785-9e2d65531082 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:29.101411 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f838acd-18a1-4312-a785-9e2d65531082 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:29.101841 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-4f838acd-18a1-4312-a785-9e2d65531082 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:29.232152 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-4f838acd-18a1-4312-a785-9e2d65531082 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:07:29.240184 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-4f838acd-18a1-4312-a785-9e2d65531082 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1259 microversion: 2.1 time: 0.152467 Oct 05 04:07:29.240760 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3987/7954] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:07:29 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:07:30.239417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-1578915c-1210-4f87-8c95-96a826743d35 req-5aead9c8-91d5-4c66-a887-6e18cd7af81d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27fe9596-7a76-46e2-9e25-91395adcd069", "name": "network-vif-plugged", "status": "completed", "tag": "bb180f7a-065b-4bb7-a61c-9fcd540cd5b2"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:07:30.250295 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1578915c-1210-4f87-8c95-96a826743d35 req-5aead9c8-91d5-4c66-a887-6e18cd7af81d service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:30.250793 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1578915c-1210-4f87-8c95-96a826743d35 req-5aead9c8-91d5-4c66-a887-6e18cd7af81d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:30.251234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1578915c-1210-4f87-8c95-96a826743d35 req-5aead9c8-91d5-4c66-a887-6e18cd7af81d service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:30.263482 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-1578915c-1210-4f87-8c95-96a826743d35 req-5aead9c8-91d5-4c66-a887-6e18cd7af81d service nova] Creating event network-vif-plugged:bb180f7a-065b-4bb7-a61c-9fcd540cd5b2 for instance 27fe9596-7a76-46e2-9e25-91395adcd069 on n-h1-858272-3 Oct 05 04:07:30.264682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5a1ab084-3829-4894-935d-c5e7c883e7b3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:07:30.265372 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5a1ab084-3829-4894-935d-c5e7c883e7b3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:07:30.268448 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-1578915c-1210-4f87-8c95-96a826743d35 req-5aead9c8-91d5-4c66-a887-6e18cd7af81d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033874 Oct 05 04:07:30.269087 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3968/7955] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 04:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 04:07:30.275825 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a1ab084-3829-4894-935d-c5e7c883e7b3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:30.276316 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a1ab084-3829-4894-935d-c5e7c883e7b3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:30.276752 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a1ab084-3829-4894-935d-c5e7c883e7b3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:30.277486 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a1ab084-3829-4894-935d-c5e7c883e7b3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:30.277942 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a1ab084-3829-4894-935d-c5e7c883e7b3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:30.278366 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5a1ab084-3829-4894-935d-c5e7c883e7b3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:30.461617 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5a1ab084-3829-4894-935d-c5e7c883e7b3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:07:30.469612 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5a1ab084-3829-4894-935d-c5e7c883e7b3 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1259 microversion: 2.1 time: 0.209353 Oct 05 04:07:30.470290 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3988/7956] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:07:30 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1259 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:07:31.494638 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-3a8efadd-0526-471d-863d-2f2f94250caf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:07:31.495353 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-3a8efadd-0526-471d-863d-2f2f94250caf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:07:31.501480 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3a8efadd-0526-471d-863d-2f2f94250caf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:31.501978 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3a8efadd-0526-471d-863d-2f2f94250caf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:31.502424 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3a8efadd-0526-471d-863d-2f2f94250caf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:31.503112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3a8efadd-0526-471d-863d-2f2f94250caf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:31.503578 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3a8efadd-0526-471d-863d-2f2f94250caf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:31.504008 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-3a8efadd-0526-471d-863d-2f2f94250caf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:31.638205 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-3a8efadd-0526-471d-863d-2f2f94250caf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:07:31.645965 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-3a8efadd-0526-471d-863d-2f2f94250caf tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1259 microversion: 2.1 time: 0.157123 Oct 05 04:07:31.646556 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3969/7957] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:07:31 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:07:32.669911 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-493f4ba1-f172-4b26-9e2a-7ee8e6a36645 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:07:32.670524 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-493f4ba1-f172-4b26-9e2a-7ee8e6a36645 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:07:32.677848 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-493f4ba1-f172-4b26-9e2a-7ee8e6a36645 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:32.678384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-493f4ba1-f172-4b26-9e2a-7ee8e6a36645 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:32.678823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-493f4ba1-f172-4b26-9e2a-7ee8e6a36645 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:32.680258 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-493f4ba1-f172-4b26-9e2a-7ee8e6a36645 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:32.680851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-493f4ba1-f172-4b26-9e2a-7ee8e6a36645 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:32.681310 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-493f4ba1-f172-4b26-9e2a-7ee8e6a36645 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:32.814729 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-493f4ba1-f172-4b26-9e2a-7ee8e6a36645 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:07:32.823122 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-493f4ba1-f172-4b26-9e2a-7ee8e6a36645 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1444 microversion: 2.1 time: 0.157429 Oct 05 04:07:32.823709 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3989/7958] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:07:32 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1444 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:07:32.845177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-eab16099-0983-4b1a-af05-f5e8eaccde36 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:07:32.845811 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-eab16099-0983-4b1a-af05-f5e8eaccde36 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:07:32.852766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eab16099-0983-4b1a-af05-f5e8eaccde36 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:32.853324 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eab16099-0983-4b1a-af05-f5e8eaccde36 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:32.853777 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eab16099-0983-4b1a-af05-f5e8eaccde36 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:32.854506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eab16099-0983-4b1a-af05-f5e8eaccde36 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:32.854979 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eab16099-0983-4b1a-af05-f5e8eaccde36 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:32.855419 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-eab16099-0983-4b1a-af05-f5e8eaccde36 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:32.983256 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-eab16099-0983-4b1a-af05-f5e8eaccde36 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:07:32.991596 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-eab16099-0983-4b1a-af05-f5e8eaccde36 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1444 microversion: 2.1 time: 0.150239 Oct 05 04:07:32.992195 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3970/7959] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:07:32 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1444 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:07:34.645078 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-7f3e8f77-f7dd-49fa-a1e1-d7f546dab632 req-535fb6f4-9d10-4f28-bc09-f15717f66688 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27fe9596-7a76-46e2-9e25-91395adcd069", "tag": "bb180f7a-065b-4bb7-a61c-9fcd540cd5b2"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:07:34.655376 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7f3e8f77-f7dd-49fa-a1e1-d7f546dab632 req-535fb6f4-9d10-4f28-bc09-f15717f66688 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:07:34.655862 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7f3e8f77-f7dd-49fa-a1e1-d7f546dab632 req-535fb6f4-9d10-4f28-bc09-f15717f66688 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:07:34.656319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7f3e8f77-f7dd-49fa-a1e1-d7f546dab632 req-535fb6f4-9d10-4f28-bc09-f15717f66688 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:07:34.668603 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-7f3e8f77-f7dd-49fa-a1e1-d7f546dab632 req-535fb6f4-9d10-4f28-bc09-f15717f66688 service nova] Creating event network-changed:bb180f7a-065b-4bb7-a61c-9fcd540cd5b2 for instance 27fe9596-7a76-46e2-9e25-91395adcd069 on n-h1-858272-3 Oct 05 04:07:34.673775 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-7f3e8f77-f7dd-49fa-a1e1-d7f546dab632 req-535fb6f4-9d10-4f28-bc09-f15717f66688 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089242 Oct 05 04:07:34.674400 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3990/7960] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 04:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 04:09:30.084210 n-d-858272-3 devstack@n-api.service[122320]: ERROR oslo.messaging._drivers.impl_rabbit [-] [478c9060-5882-4902-b074-d751d7d6fe39] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 05 04:09:30.085166 n-d-858272-3 devstack@n-api.service[122320]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f8dec5f5-af45-49c2-a8e7-bbd40c1c5148] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 05 04:09:30.085736 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:09:30.086498 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=60 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:09:30.088023 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 05 04:09:30.088175 n-d-858272-3 devstack@n-api.service[122320]: Wed Oct 5 04:09:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069/action (ip 10.222.0.16) !!! Oct 05 04:09:30.093389 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-18abf427-01f2-44df-ae19-0ffd73661cec tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:09:30.093940 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-18abf427-01f2-44df-ae19-0ffd73661cec tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:09:30.102003 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18abf427-01f2-44df-ae19-0ffd73661cec tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:30.102506 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18abf427-01f2-44df-ae19-0ffd73661cec tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:30.102956 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18abf427-01f2-44df-ae19-0ffd73661cec tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:30.103664 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18abf427-01f2-44df-ae19-0ffd73661cec tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:30.104131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18abf427-01f2-44df-ae19-0ffd73661cec tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:30.104569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-18abf427-01f2-44df-ae19-0ffd73661cec tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:30.130133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-18abf427-01f2-44df-ae19-0ffd73661cec tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lazy-loading 'flavor' on Instance uuid 27fe9596-7a76-46e2-9e25-91395adcd069 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 04:09:30.200893 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-18abf427-01f2-44df-ae19-0ffd73661cec tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "POST /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069/action" status: 202 len: 0 microversion: 2.1 time: 0.118602 Oct 05 04:09:30.201537 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3971/7961] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 04:09:30 2022] POST /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 04:09:30.208263 n-d-858272-3 devstack@n-api.service[122319]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9ea01e0c-5288-45ec-999a-5c236fd0352e] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 04:09:30.209109 n-d-858272-3 devstack@n-api.service[122319]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6905525b-80d2-47ff-94c4-6512d0d2e7d6] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 04:09:30.209718 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=26 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:09:30.210458 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=62 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:09:30.211641 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 05 04:09:30.211812 n-d-858272-3 devstack@n-api.service[122319]: Wed Oct 5 04:09:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 (ip 10.222.0.16) !!! Oct 05 04:09:30.212738 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 04:09:30.212925 n-d-858272-3 devstack@n-api.service[122319]: Wed Oct 5 04:09:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 (ip 10.222.0.16) !!! Oct 05 04:09:30.217945 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ce36d13e-01fa-417a-ad92-131d3673a861 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:09:30.218679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ce36d13e-01fa-417a-ad92-131d3673a861 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:09:30.232541 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce36d13e-01fa-417a-ad92-131d3673a861 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:30.233048 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce36d13e-01fa-417a-ad92-131d3673a861 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:30.233481 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce36d13e-01fa-417a-ad92-131d3673a861 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:30.234184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce36d13e-01fa-417a-ad92-131d3673a861 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:30.234635 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce36d13e-01fa-417a-ad92-131d3673a861 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:30.235059 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ce36d13e-01fa-417a-ad92-131d3673a861 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:30.429550 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ce36d13e-01fa-417a-ad92-131d3673a861 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:09:30.437971 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ce36d13e-01fa-417a-ad92-131d3673a861 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1569 microversion: 2.1 time: 0.231860 Oct 05 04:09:30.438569 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3991/7962] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:09:30 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1569 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 04:09:31.462471 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-96b6275f-f4ee-4d21-bbd3-b4e75a812142 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:09:31.463186 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-96b6275f-f4ee-4d21-bbd3-b4e75a812142 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:09:31.473659 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96b6275f-f4ee-4d21-bbd3-b4e75a812142 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:31.473659 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96b6275f-f4ee-4d21-bbd3-b4e75a812142 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:31.474279 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96b6275f-f4ee-4d21-bbd3-b4e75a812142 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:31.474856 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96b6275f-f4ee-4d21-bbd3-b4e75a812142 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:31.475329 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96b6275f-f4ee-4d21-bbd3-b4e75a812142 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:31.475770 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-96b6275f-f4ee-4d21-bbd3-b4e75a812142 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:31.483935 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [-] [f8dec5f5-af45-49c2-a8e7-bbd40c1c5148] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 49256. Oct 05 04:09:31.495091 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [-] [478c9060-5882-4902-b074-d751d7d6fe39] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 49254. Oct 05 04:09:31.656920 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-96b6275f-f4ee-4d21-bbd3-b4e75a812142 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:09:31.664854 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-96b6275f-f4ee-4d21-bbd3-b4e75a812142 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1569 microversion: 2.1 time: 0.206614 Oct 05 04:09:31.665788 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3972/7963] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:09:31 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1569 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:09:32.687941 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-9798d73c-2e2e-41dc-8849-09a17a105385 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:09:32.688563 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-9798d73c-2e2e-41dc-8849-09a17a105385 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:09:32.697786 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9798d73c-2e2e-41dc-8849-09a17a105385 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:32.698275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9798d73c-2e2e-41dc-8849-09a17a105385 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:32.698716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9798d73c-2e2e-41dc-8849-09a17a105385 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:32.699416 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9798d73c-2e2e-41dc-8849-09a17a105385 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:32.699872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9798d73c-2e2e-41dc-8849-09a17a105385 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:32.700299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-9798d73c-2e2e-41dc-8849-09a17a105385 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:32.704783 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] [9ea01e0c-5288-45ec-999a-5c236fd0352e] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 49262. Oct 05 04:09:32.707930 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] [6905525b-80d2-47ff-94c4-6512d0d2e7d6] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 49264. Oct 05 04:09:32.838291 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-9798d73c-2e2e-41dc-8849-09a17a105385 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:09:32.846695 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-9798d73c-2e2e-41dc-8849-09a17a105385 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1569 microversion: 2.1 time: 0.162959 Oct 05 04:09:32.847281 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3992/7964] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:09:32 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:09:33.870128 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e4846cee-36bb-497f-a075-30eef32fd209 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:09:33.870770 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e4846cee-36bb-497f-a075-30eef32fd209 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:09:33.877587 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4846cee-36bb-497f-a075-30eef32fd209 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:33.878089 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4846cee-36bb-497f-a075-30eef32fd209 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:33.878543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4846cee-36bb-497f-a075-30eef32fd209 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:33.879246 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4846cee-36bb-497f-a075-30eef32fd209 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:33.879715 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4846cee-36bb-497f-a075-30eef32fd209 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:33.880153 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e4846cee-36bb-497f-a075-30eef32fd209 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:34.011468 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e4846cee-36bb-497f-a075-30eef32fd209 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:09:34.019864 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e4846cee-36bb-497f-a075-30eef32fd209 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1569 microversion: 2.1 time: 0.153706 Oct 05 04:09:34.020439 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3973/7965] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:09:33 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 04:09:35.042778 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-336945a0-3f54-4619-b6f8-a937278bbdfe tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:09:35.043361 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-336945a0-3f54-4619-b6f8-a937278bbdfe tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:09:35.050278 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-336945a0-3f54-4619-b6f8-a937278bbdfe tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:35.050770 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-336945a0-3f54-4619-b6f8-a937278bbdfe tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:35.051214 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-336945a0-3f54-4619-b6f8-a937278bbdfe tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:35.051912 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-336945a0-3f54-4619-b6f8-a937278bbdfe tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:35.052369 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-336945a0-3f54-4619-b6f8-a937278bbdfe tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:35.052806 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-336945a0-3f54-4619-b6f8-a937278bbdfe tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:35.189962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-336945a0-3f54-4619-b6f8-a937278bbdfe tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:09:35.197863 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-336945a0-3f54-4619-b6f8-a937278bbdfe tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1569 microversion: 2.1 time: 0.159122 Oct 05 04:09:35.198446 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3993/7966] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:09:35 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:09:36.222136 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d3040ae8-ec19-47f6-9890-f4f903f530a1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:09:36.222762 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d3040ae8-ec19-47f6-9890-f4f903f530a1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:09:36.229713 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3040ae8-ec19-47f6-9890-f4f903f530a1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:36.230358 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3040ae8-ec19-47f6-9890-f4f903f530a1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:36.230822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3040ae8-ec19-47f6-9890-f4f903f530a1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:36.231512 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3040ae8-ec19-47f6-9890-f4f903f530a1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:36.231977 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3040ae8-ec19-47f6-9890-f4f903f530a1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:36.233223 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d3040ae8-ec19-47f6-9890-f4f903f530a1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:36.363703 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d3040ae8-ec19-47f6-9890-f4f903f530a1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:09:36.371581 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d3040ae8-ec19-47f6-9890-f4f903f530a1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1569 microversion: 2.1 time: 0.153383 Oct 05 04:09:36.372167 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3974/7967] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:09:36 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:09:37.395653 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-784acf39-6e70-4879-a22e-a24db80a83dd tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:09:37.396274 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-784acf39-6e70-4879-a22e-a24db80a83dd tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:09:37.403177 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-784acf39-6e70-4879-a22e-a24db80a83dd tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:37.403661 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-784acf39-6e70-4879-a22e-a24db80a83dd tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:37.404227 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-784acf39-6e70-4879-a22e-a24db80a83dd tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:37.404949 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-784acf39-6e70-4879-a22e-a24db80a83dd tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:37.405414 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-784acf39-6e70-4879-a22e-a24db80a83dd tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:37.405843 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-784acf39-6e70-4879-a22e-a24db80a83dd tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:37.537704 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-784acf39-6e70-4879-a22e-a24db80a83dd tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:09:37.546085 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-784acf39-6e70-4879-a22e-a24db80a83dd tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1569 microversion: 2.1 time: 0.154418 Oct 05 04:09:37.546668 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3994/7968] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:09:37 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:09:38.569156 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6c96d10d-f256-4e65-afaa-33f3c8ff92c1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:09:38.569771 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6c96d10d-f256-4e65-afaa-33f3c8ff92c1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:09:38.577317 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c96d10d-f256-4e65-afaa-33f3c8ff92c1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:38.577813 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c96d10d-f256-4e65-afaa-33f3c8ff92c1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:38.578261 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c96d10d-f256-4e65-afaa-33f3c8ff92c1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:38.578955 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c96d10d-f256-4e65-afaa-33f3c8ff92c1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:38.579418 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c96d10d-f256-4e65-afaa-33f3c8ff92c1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:38.579849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6c96d10d-f256-4e65-afaa-33f3c8ff92c1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:38.711417 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6c96d10d-f256-4e65-afaa-33f3c8ff92c1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:09:38.719325 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6c96d10d-f256-4e65-afaa-33f3c8ff92c1 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1569 microversion: 2.1 time: 0.154103 Oct 05 04:09:38.719899 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3975/7969] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:09:38 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:09:39.741979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-72aba4b4-ef08-48f0-9eb4-83616515ad69 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:09:39.742629 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-72aba4b4-ef08-48f0-9eb4-83616515ad69 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:09:39.749781 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72aba4b4-ef08-48f0-9eb4-83616515ad69 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:39.750271 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72aba4b4-ef08-48f0-9eb4-83616515ad69 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:39.750714 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72aba4b4-ef08-48f0-9eb4-83616515ad69 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:39.751408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72aba4b4-ef08-48f0-9eb4-83616515ad69 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:39.751864 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72aba4b4-ef08-48f0-9eb4-83616515ad69 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:39.752292 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72aba4b4-ef08-48f0-9eb4-83616515ad69 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:39.888859 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-72aba4b4-ef08-48f0-9eb4-83616515ad69 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:09:39.896832 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-72aba4b4-ef08-48f0-9eb4-83616515ad69 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1569 microversion: 2.1 time: 0.158998 Oct 05 04:09:39.897454 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3995/7970] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:09:39 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:09:40.921810 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-41e7797a-c5f2-4536-9fc9-0f577a5eb954 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:09:40.922381 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-41e7797a-c5f2-4536-9fc9-0f577a5eb954 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:09:40.929408 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-41e7797a-c5f2-4536-9fc9-0f577a5eb954 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:40.929906 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-41e7797a-c5f2-4536-9fc9-0f577a5eb954 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:40.930347 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-41e7797a-c5f2-4536-9fc9-0f577a5eb954 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:40.931043 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-41e7797a-c5f2-4536-9fc9-0f577a5eb954 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:40.931508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-41e7797a-c5f2-4536-9fc9-0f577a5eb954 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:40.931937 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-41e7797a-c5f2-4536-9fc9-0f577a5eb954 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:41.158047 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-41e7797a-c5f2-4536-9fc9-0f577a5eb954 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:09:41.166205 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-41e7797a-c5f2-4536-9fc9-0f577a5eb954 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1569 microversion: 2.1 time: 0.249114 Oct 05 04:09:41.167005 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3976/7971] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:09:40 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1569 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:09:42.190088 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-38002fab-3453-4d76-af23-7baae4d56575 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:09:42.190706 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-38002fab-3453-4d76-af23-7baae4d56575 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:09:42.197999 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-38002fab-3453-4d76-af23-7baae4d56575 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:42.198493 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-38002fab-3453-4d76-af23-7baae4d56575 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:42.198932 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-38002fab-3453-4d76-af23-7baae4d56575 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:42.199633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-38002fab-3453-4d76-af23-7baae4d56575 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:42.200376 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-38002fab-3453-4d76-af23-7baae4d56575 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:42.200492 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-38002fab-3453-4d76-af23-7baae4d56575 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:42.333142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-38002fab-3453-4d76-af23-7baae4d56575 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:09:42.342536 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-38002fab-3453-4d76-af23-7baae4d56575 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1569 microversion: 2.1 time: 0.156506 Oct 05 04:09:42.343134 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3996/7972] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:09:42 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:09:43.367073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-cdd3b402-e430-4b3f-9ec4-9937b08037d2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:09:43.367834 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-cdd3b402-e430-4b3f-9ec4-9937b08037d2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:09:43.376822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdd3b402-e430-4b3f-9ec4-9937b08037d2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:43.377389 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdd3b402-e430-4b3f-9ec4-9937b08037d2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:43.377850 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdd3b402-e430-4b3f-9ec4-9937b08037d2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:43.378605 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdd3b402-e430-4b3f-9ec4-9937b08037d2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:43.379081 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdd3b402-e430-4b3f-9ec4-9937b08037d2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:43.379557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-cdd3b402-e430-4b3f-9ec4-9937b08037d2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:43.521769 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-cdd3b402-e430-4b3f-9ec4-9937b08037d2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:09:43.530156 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-cdd3b402-e430-4b3f-9ec4-9937b08037d2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1569 microversion: 2.1 time: 0.167390 Oct 05 04:09:43.530745 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3977/7973] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:09:43 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:09:44.553709 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-aab9e5a6-e7d8-4393-9c8c-829bfabaca23 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:09:44.554330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-aab9e5a6-e7d8-4393-9c8c-829bfabaca23 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:09:44.563609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aab9e5a6-e7d8-4393-9c8c-829bfabaca23 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:44.564330 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aab9e5a6-e7d8-4393-9c8c-829bfabaca23 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:44.564803 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aab9e5a6-e7d8-4393-9c8c-829bfabaca23 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:44.565574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aab9e5a6-e7d8-4393-9c8c-829bfabaca23 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:44.566029 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aab9e5a6-e7d8-4393-9c8c-829bfabaca23 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:44.566454 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aab9e5a6-e7d8-4393-9c8c-829bfabaca23 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:44.706913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-aab9e5a6-e7d8-4393-9c8c-829bfabaca23 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:09:44.714852 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-aab9e5a6-e7d8-4393-9c8c-829bfabaca23 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1569 microversion: 2.1 time: 0.164958 Oct 05 04:09:44.715441 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3997/7974] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:09:44 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:09:45.738623 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-12e8739d-b795-4974-ae9f-121710fce858 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:09:45.739164 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-12e8739d-b795-4974-ae9f-121710fce858 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:09:45.745994 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12e8739d-b795-4974-ae9f-121710fce858 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:45.746491 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12e8739d-b795-4974-ae9f-121710fce858 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:45.746935 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12e8739d-b795-4974-ae9f-121710fce858 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:45.748676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12e8739d-b795-4974-ae9f-121710fce858 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:45.749177 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12e8739d-b795-4974-ae9f-121710fce858 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:45.749618 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-12e8739d-b795-4974-ae9f-121710fce858 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:45.881776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-12e8739d-b795-4974-ae9f-121710fce858 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:09:45.889601 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-12e8739d-b795-4974-ae9f-121710fce858 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1510 microversion: 2.1 time: 0.155255 Oct 05 04:09:45.890181 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3978/7975] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:09:45 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:09:45.912924 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-483d9a8c-3f49-4197-b527-399191fec9a6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:09:45.913540 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-483d9a8c-3f49-4197-b527-399191fec9a6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:09:45.921079 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-483d9a8c-3f49-4197-b527-399191fec9a6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:45.921567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-483d9a8c-3f49-4197-b527-399191fec9a6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:45.922007 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-483d9a8c-3f49-4197-b527-399191fec9a6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:45.922700 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-483d9a8c-3f49-4197-b527-399191fec9a6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:45.923155 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-483d9a8c-3f49-4197-b527-399191fec9a6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:45.923578 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-483d9a8c-3f49-4197-b527-399191fec9a6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:45.951971 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-483d9a8c-3f49-4197-b527-399191fec9a6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122319) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 05 04:09:46.022719 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-483d9a8c-3f49-4197-b527-399191fec9a6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "POST /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069/action" status: 202 len: 0 microversion: 2.1 time: 0.113534 Oct 05 04:09:46.023252 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3998/7976] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 04:09:45 2022] POST /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 04:09:46.031900 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dc763b65-87da-488c-bc85-3a721a3bbf84 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:09:46.032528 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dc763b65-87da-488c-bc85-3a721a3bbf84 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:09:46.038479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dc763b65-87da-488c-bc85-3a721a3bbf84 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:46.038978 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dc763b65-87da-488c-bc85-3a721a3bbf84 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:46.039426 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dc763b65-87da-488c-bc85-3a721a3bbf84 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:46.040126 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dc763b65-87da-488c-bc85-3a721a3bbf84 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:46.040590 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dc763b65-87da-488c-bc85-3a721a3bbf84 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:46.041050 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-dc763b65-87da-488c-bc85-3a721a3bbf84 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:46.181613 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dc763b65-87da-488c-bc85-3a721a3bbf84 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:09:46.189533 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dc763b65-87da-488c-bc85-3a721a3bbf84 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1518 microversion: 2.1 time: 0.162034 Oct 05 04:09:46.190114 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3979/7977] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:09:46 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:09:46.980546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-4c43608d-4253-42bf-a705-6936c221a0c4 req-5425abdb-8da4-40bf-a038-fe093c17728a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27fe9596-7a76-46e2-9e25-91395adcd069", "name": "network-vif-unplugged", "status": "completed", "tag": "bb180f7a-065b-4bb7-a61c-9fcd540cd5b2"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:09:46.993442 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4c43608d-4253-42bf-a705-6936c221a0c4 req-5425abdb-8da4-40bf-a038-fe093c17728a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:46.994258 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4c43608d-4253-42bf-a705-6936c221a0c4 req-5425abdb-8da4-40bf-a038-fe093c17728a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:46.995038 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-4c43608d-4253-42bf-a705-6936c221a0c4 req-5425abdb-8da4-40bf-a038-fe093c17728a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:47.017346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.compute.server_external_events [req-4c43608d-4253-42bf-a705-6936c221a0c4 req-5425abdb-8da4-40bf-a038-fe093c17728a service nova] Unable to find a host for instance 27fe9596-7a76-46e2-9e25-91395adcd069. Dropping event network-vif-unplugged {{(pid=122319) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 05 04:09:47.018982 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-4c43608d-4253-42bf-a705-6936c221a0c4 req-5425abdb-8da4-40bf-a038-fe093c17728a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.042843 Oct 05 04:09:47.020039 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 3999/7978] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 04:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 45 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 05 04:09:47.212764 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-47a14c31-5191-44c6-83d5-2c78a19924ca tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:09:47.213457 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-47a14c31-5191-44c6-83d5-2c78a19924ca tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:09:47.220813 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47a14c31-5191-44c6-83d5-2c78a19924ca tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:47.221344 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47a14c31-5191-44c6-83d5-2c78a19924ca tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:47.221791 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47a14c31-5191-44c6-83d5-2c78a19924ca tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:47.222495 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47a14c31-5191-44c6-83d5-2c78a19924ca tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:47.222961 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47a14c31-5191-44c6-83d5-2c78a19924ca tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:47.223395 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-47a14c31-5191-44c6-83d5-2c78a19924ca tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:47.357195 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-47a14c31-5191-44c6-83d5-2c78a19924ca tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:09:47.365641 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-47a14c31-5191-44c6-83d5-2c78a19924ca tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1518 microversion: 2.1 time: 0.157381 Oct 05 04:09:47.366231 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3980/7979] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:09:47 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:09:48.391580 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e6d73c2c-f0f5-4549-b503-fc71b9bb43ad tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:09:48.392213 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e6d73c2c-f0f5-4549-b503-fc71b9bb43ad tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:09:48.399123 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6d73c2c-f0f5-4549-b503-fc71b9bb43ad tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:48.399612 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6d73c2c-f0f5-4549-b503-fc71b9bb43ad tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:48.400252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6d73c2c-f0f5-4549-b503-fc71b9bb43ad tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:48.401311 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6d73c2c-f0f5-4549-b503-fc71b9bb43ad tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:48.401775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6d73c2c-f0f5-4549-b503-fc71b9bb43ad tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:48.402205 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6d73c2c-f0f5-4549-b503-fc71b9bb43ad tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:48.548637 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e6d73c2c-f0f5-4549-b503-fc71b9bb43ad tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:09:48.557975 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e6d73c2c-f0f5-4549-b503-fc71b9bb43ad tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1518 microversion: 2.1 time: 0.172508 Oct 05 04:09:48.558596 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4000/7980] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:09:48 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1518 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:09:49.583936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a72efec6-9548-42bc-9c0d-1bbf8b4c0742 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:09:49.584564 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a72efec6-9548-42bc-9c0d-1bbf8b4c0742 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:09:49.591598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a72efec6-9548-42bc-9c0d-1bbf8b4c0742 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:49.592097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a72efec6-9548-42bc-9c0d-1bbf8b4c0742 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:49.592544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a72efec6-9548-42bc-9c0d-1bbf8b4c0742 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:49.593281 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a72efec6-9548-42bc-9c0d-1bbf8b4c0742 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:49.593763 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a72efec6-9548-42bc-9c0d-1bbf8b4c0742 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:49.594181 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a72efec6-9548-42bc-9c0d-1bbf8b4c0742 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:49.732698 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a72efec6-9548-42bc-9c0d-1bbf8b4c0742 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:09:49.741354 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a72efec6-9548-42bc-9c0d-1bbf8b4c0742 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1518 microversion: 2.1 time: 0.162445 Oct 05 04:09:49.742392 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3981/7981] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:09:49 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 04:09:50.765290 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-75b466a7-d817-4d34-b314-19f16e130166 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:09:50.765873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-75b466a7-d817-4d34-b314-19f16e130166 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:09:50.772759 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75b466a7-d817-4d34-b314-19f16e130166 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:50.773278 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75b466a7-d817-4d34-b314-19f16e130166 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:50.773724 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75b466a7-d817-4d34-b314-19f16e130166 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:50.774421 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75b466a7-d817-4d34-b314-19f16e130166 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:50.774874 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75b466a7-d817-4d34-b314-19f16e130166 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:50.775299 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-75b466a7-d817-4d34-b314-19f16e130166 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:50.910322 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-75b466a7-d817-4d34-b314-19f16e130166 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:09:50.918264 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-75b466a7-d817-4d34-b314-19f16e130166 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1520 microversion: 2.1 time: 0.157617 Oct 05 04:09:50.918841 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4001/7982] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:09:50 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:09:51.941571 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a7ad7959-58a3-42af-bb57-a01953618a10 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:09:51.942133 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a7ad7959-58a3-42af-bb57-a01953618a10 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:09:51.949602 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7ad7959-58a3-42af-bb57-a01953618a10 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:51.950112 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7ad7959-58a3-42af-bb57-a01953618a10 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:51.950782 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7ad7959-58a3-42af-bb57-a01953618a10 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:51.951705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7ad7959-58a3-42af-bb57-a01953618a10 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:51.952217 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7ad7959-58a3-42af-bb57-a01953618a10 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:51.952660 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a7ad7959-58a3-42af-bb57-a01953618a10 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:52.095225 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a7ad7959-58a3-42af-bb57-a01953618a10 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:09:52.103151 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a7ad7959-58a3-42af-bb57-a01953618a10 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1520 microversion: 2.1 time: 0.165613 Oct 05 04:09:52.103746 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3982/7983] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:09:51 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:09:53.127808 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-399b7433-b854-4dbe-ae1b-c7232af52da6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:09:53.128553 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-399b7433-b854-4dbe-ae1b-c7232af52da6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:09:53.135631 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-399b7433-b854-4dbe-ae1b-c7232af52da6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:53.136114 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-399b7433-b854-4dbe-ae1b-c7232af52da6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:53.136548 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-399b7433-b854-4dbe-ae1b-c7232af52da6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:53.137267 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-399b7433-b854-4dbe-ae1b-c7232af52da6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:53.138246 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-399b7433-b854-4dbe-ae1b-c7232af52da6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:53.139016 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-399b7433-b854-4dbe-ae1b-c7232af52da6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:53.268278 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-399b7433-b854-4dbe-ae1b-c7232af52da6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:09:53.276137 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-399b7433-b854-4dbe-ae1b-c7232af52da6 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1520 microversion: 2.1 time: 0.152259 Oct 05 04:09:53.276717 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4002/7984] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:09:53 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 04:09:54.299775 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-2b7957a9-0674-4b26-8dc2-07429b1c7f8f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:09:54.300539 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-2b7957a9-0674-4b26-8dc2-07429b1c7f8f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:09:54.307831 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b7957a9-0674-4b26-8dc2-07429b1c7f8f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:54.308345 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b7957a9-0674-4b26-8dc2-07429b1c7f8f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:54.308798 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b7957a9-0674-4b26-8dc2-07429b1c7f8f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:54.310057 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b7957a9-0674-4b26-8dc2-07429b1c7f8f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:54.310753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b7957a9-0674-4b26-8dc2-07429b1c7f8f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:54.311301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-2b7957a9-0674-4b26-8dc2-07429b1c7f8f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:54.452242 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-2b7957a9-0674-4b26-8dc2-07429b1c7f8f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:09:54.460188 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-2b7957a9-0674-4b26-8dc2-07429b1c7f8f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1520 microversion: 2.1 time: 0.164393 Oct 05 04:09:54.460765 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3983/7985] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:09:54 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:09:55.484445 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-aa508768-3851-46c0-92db-c4c11c6be368 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:09:55.485086 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-aa508768-3851-46c0-92db-c4c11c6be368 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:09:55.492757 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa508768-3851-46c0-92db-c4c11c6be368 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:55.493275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa508768-3851-46c0-92db-c4c11c6be368 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:55.493711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa508768-3851-46c0-92db-c4c11c6be368 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:55.494415 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa508768-3851-46c0-92db-c4c11c6be368 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:55.494865 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa508768-3851-46c0-92db-c4c11c6be368 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:55.495289 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-aa508768-3851-46c0-92db-c4c11c6be368 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:55.762544 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-aa508768-3851-46c0-92db-c4c11c6be368 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:09:55.770631 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-aa508768-3851-46c0-92db-c4c11c6be368 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1576 microversion: 2.1 time: 0.290836 Oct 05 04:09:55.771207 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4003/7986] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:09:55 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1576 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:09:55.987099 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-7618625c-9792-45e6-963f-6f95dec509b5 req-2575e065-8481-44b1-b026-88ca9ec6ddff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27fe9596-7a76-46e2-9e25-91395adcd069", "tag": "bb180f7a-065b-4bb7-a61c-9fcd540cd5b2"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:09:55.998254 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-7618625c-9792-45e6-963f-6f95dec509b5 req-2575e065-8481-44b1-b026-88ca9ec6ddff service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:55.998761 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-7618625c-9792-45e6-963f-6f95dec509b5 req-2575e065-8481-44b1-b026-88ca9ec6ddff service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:55.999210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-7618625c-9792-45e6-963f-6f95dec509b5 req-2575e065-8481-44b1-b026-88ca9ec6ddff service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:56.011219 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-7618625c-9792-45e6-963f-6f95dec509b5 req-2575e065-8481-44b1-b026-88ca9ec6ddff service nova] Creating event network-changed:bb180f7a-065b-4bb7-a61c-9fcd540cd5b2 for instance 27fe9596-7a76-46e2-9e25-91395adcd069 on n-h2-858272-3 Oct 05 04:09:56.017015 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-7618625c-9792-45e6-963f-6f95dec509b5 req-2575e065-8481-44b1-b026-88ca9ec6ddff service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033808 Oct 05 04:09:56.017634 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3984/7987] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 04:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 04:09:56.795121 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2483811a-3036-4aea-9fa6-49f243a4ab4c tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:09:56.795740 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2483811a-3036-4aea-9fa6-49f243a4ab4c tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:09:56.802817 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2483811a-3036-4aea-9fa6-49f243a4ab4c tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:56.803314 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2483811a-3036-4aea-9fa6-49f243a4ab4c tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:56.803755 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2483811a-3036-4aea-9fa6-49f243a4ab4c tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:56.804452 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2483811a-3036-4aea-9fa6-49f243a4ab4c tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:56.804931 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2483811a-3036-4aea-9fa6-49f243a4ab4c tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:56.805365 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2483811a-3036-4aea-9fa6-49f243a4ab4c tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:56.942836 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2483811a-3036-4aea-9fa6-49f243a4ab4c tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:09:56.950600 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2483811a-3036-4aea-9fa6-49f243a4ab4c tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1576 microversion: 2.1 time: 0.159981 Oct 05 04:09:56.951187 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4004/7988] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:09:56 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:09:57.975479 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-295666ab-cfea-4a40-aa09-831759f0199c tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:09:57.976195 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-295666ab-cfea-4a40-aa09-831759f0199c tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:09:57.982328 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-295666ab-cfea-4a40-aa09-831759f0199c tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:57.982830 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-295666ab-cfea-4a40-aa09-831759f0199c tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:57.983276 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-295666ab-cfea-4a40-aa09-831759f0199c tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:57.983981 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-295666ab-cfea-4a40-aa09-831759f0199c tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:57.984448 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-295666ab-cfea-4a40-aa09-831759f0199c tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:57.984880 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-295666ab-cfea-4a40-aa09-831759f0199c tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:58.167736 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-295666ab-cfea-4a40-aa09-831759f0199c tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:09:58.175834 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-295666ab-cfea-4a40-aa09-831759f0199c tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1576 microversion: 2.1 time: 0.205625 Oct 05 04:09:58.176418 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3985/7989] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:09:57 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1576 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:09:59.200716 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5c28f61e-6a9d-48d4-970b-b973ccf20af0 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:09:59.201368 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5c28f61e-6a9d-48d4-970b-b973ccf20af0 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:09:59.208272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c28f61e-6a9d-48d4-970b-b973ccf20af0 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:59.208758 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c28f61e-6a9d-48d4-970b-b973ccf20af0 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:59.209233 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c28f61e-6a9d-48d4-970b-b973ccf20af0 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:59.209928 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c28f61e-6a9d-48d4-970b-b973ccf20af0 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:09:59.210384 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c28f61e-6a9d-48d4-970b-b973ccf20af0 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:09:59.210810 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-5c28f61e-6a9d-48d4-970b-b973ccf20af0 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:09:59.349599 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5c28f61e-6a9d-48d4-970b-b973ccf20af0 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:09:59.357447 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5c28f61e-6a9d-48d4-970b-b973ccf20af0 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1576 microversion: 2.1 time: 0.161185 Oct 05 04:09:59.358031 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4005/7990] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:09:59 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:10:00.380922 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0b303e43-2ac6-4637-a522-720e3fc35cab tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:10:00.381609 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0b303e43-2ac6-4637-a522-720e3fc35cab tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:10:00.384430 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=31 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:10:00.390478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b303e43-2ac6-4637-a522-720e3fc35cab tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:10:00.390987 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b303e43-2ac6-4637-a522-720e3fc35cab tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:10:00.391444 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b303e43-2ac6-4637-a522-720e3fc35cab tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:10:00.392144 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b303e43-2ac6-4637-a522-720e3fc35cab tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:10:00.392616 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b303e43-2ac6-4637-a522-720e3fc35cab tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:10:00.393098 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b303e43-2ac6-4637-a522-720e3fc35cab tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:10:00.395667 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:10:00.522576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0b303e43-2ac6-4637-a522-720e3fc35cab tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:10:00.530521 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0b303e43-2ac6-4637-a522-720e3fc35cab tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1576 microversion: 2.1 time: 0.153567 Oct 05 04:10:00.531096 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3986/7991] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:10:00 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:10:01.554145 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-58afbed0-362d-4cd3-89e8-ccf0accc0f9b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:10:01.554757 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-58afbed0-362d-4cd3-89e8-ccf0accc0f9b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:10:01.557477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:10:01.563359 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58afbed0-362d-4cd3-89e8-ccf0accc0f9b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:10:01.563856 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58afbed0-362d-4cd3-89e8-ccf0accc0f9b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:10:01.564302 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58afbed0-362d-4cd3-89e8-ccf0accc0f9b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:10:01.565033 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58afbed0-362d-4cd3-89e8-ccf0accc0f9b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:10:01.565499 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58afbed0-362d-4cd3-89e8-ccf0accc0f9b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:10:01.565930 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-58afbed0-362d-4cd3-89e8-ccf0accc0f9b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:10:01.569614 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:10:01.705093 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-58afbed0-362d-4cd3-89e8-ccf0accc0f9b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:10:01.713045 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-58afbed0-362d-4cd3-89e8-ccf0accc0f9b tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1576 microversion: 2.1 time: 0.162830 Oct 05 04:10:01.713616 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4006/7992] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:10:01 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:10:02.736773 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-6f01fef3-4a52-4714-a87a-6e2e81e1c4d4 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:10:02.737474 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-6f01fef3-4a52-4714-a87a-6e2e81e1c4d4 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:10:02.744190 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f01fef3-4a52-4714-a87a-6e2e81e1c4d4 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:10:02.744695 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f01fef3-4a52-4714-a87a-6e2e81e1c4d4 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:10:02.745178 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f01fef3-4a52-4714-a87a-6e2e81e1c4d4 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:10:02.745882 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f01fef3-4a52-4714-a87a-6e2e81e1c4d4 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:10:02.746356 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f01fef3-4a52-4714-a87a-6e2e81e1c4d4 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:10:02.747319 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-6f01fef3-4a52-4714-a87a-6e2e81e1c4d4 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:10:02.877529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-6f01fef3-4a52-4714-a87a-6e2e81e1c4d4 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:10:02.885531 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-6f01fef3-4a52-4714-a87a-6e2e81e1c4d4 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1576 microversion: 2.1 time: 0.152634 Oct 05 04:10:02.886108 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3987/7993] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:10:02 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:10:03.909964 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-b7a58662-f095-4736-a2e5-d84634d8d104 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:10:03.910603 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-b7a58662-f095-4736-a2e5-d84634d8d104 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:10:03.916771 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7a58662-f095-4736-a2e5-d84634d8d104 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:10:03.917228 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7a58662-f095-4736-a2e5-d84634d8d104 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:10:03.917662 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7a58662-f095-4736-a2e5-d84634d8d104 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:10:03.918346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7a58662-f095-4736-a2e5-d84634d8d104 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:10:03.919562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7a58662-f095-4736-a2e5-d84634d8d104 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:10:03.920091 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-b7a58662-f095-4736-a2e5-d84634d8d104 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:10:04.050797 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-b7a58662-f095-4736-a2e5-d84634d8d104 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:10:04.059101 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-b7a58662-f095-4736-a2e5-d84634d8d104 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1576 microversion: 2.1 time: 0.153311 Oct 05 04:10:04.059891 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4007/7994] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:10:03 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:10:05.086024 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-c4287378-3da5-442e-bca4-99ed2f293a9f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:10:05.086657 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-c4287378-3da5-442e-bca4-99ed2f293a9f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:10:05.094107 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4287378-3da5-442e-bca4-99ed2f293a9f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:10:05.094610 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4287378-3da5-442e-bca4-99ed2f293a9f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:10:05.095061 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4287378-3da5-442e-bca4-99ed2f293a9f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:10:05.095793 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4287378-3da5-442e-bca4-99ed2f293a9f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:10:05.096264 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4287378-3da5-442e-bca4-99ed2f293a9f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:10:05.096704 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-c4287378-3da5-442e-bca4-99ed2f293a9f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:10:05.227812 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-c4287378-3da5-442e-bca4-99ed2f293a9f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:10:05.236078 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-c4287378-3da5-442e-bca4-99ed2f293a9f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1576 microversion: 2.1 time: 0.153983 Oct 05 04:10:05.236655 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3988/7995] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:10:05 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:10:06.260185 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a8d891cd-d020-4b87-9571-2662d4283294 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:10:06.260811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a8d891cd-d020-4b87-9571-2662d4283294 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:10:06.268061 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8d891cd-d020-4b87-9571-2662d4283294 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:10:06.268626 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8d891cd-d020-4b87-9571-2662d4283294 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:10:06.269096 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8d891cd-d020-4b87-9571-2662d4283294 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:10:06.269808 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8d891cd-d020-4b87-9571-2662d4283294 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:10:06.271957 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8d891cd-d020-4b87-9571-2662d4283294 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:10:06.272426 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a8d891cd-d020-4b87-9571-2662d4283294 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:10:06.447064 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a8d891cd-d020-4b87-9571-2662d4283294 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:10:06.456393 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a8d891cd-d020-4b87-9571-2662d4283294 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1576 microversion: 2.1 time: 0.200176 Oct 05 04:10:06.457107 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4008/7996] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:10:06 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1576 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 04:10:07.480131 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-54658caa-af25-4292-a181-94f3215e7d85 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:10:07.480845 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-54658caa-af25-4292-a181-94f3215e7d85 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:10:07.487897 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54658caa-af25-4292-a181-94f3215e7d85 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:10:07.488656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54658caa-af25-4292-a181-94f3215e7d85 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:10:07.489138 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54658caa-af25-4292-a181-94f3215e7d85 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:10:07.489838 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54658caa-af25-4292-a181-94f3215e7d85 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:10:07.490305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54658caa-af25-4292-a181-94f3215e7d85 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:10:07.490743 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-54658caa-af25-4292-a181-94f3215e7d85 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:10:07.627676 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-54658caa-af25-4292-a181-94f3215e7d85 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:10:07.636074 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-54658caa-af25-4292-a181-94f3215e7d85 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1576 microversion: 2.1 time: 0.159685 Oct 05 04:10:07.636747 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3989/7997] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:10:07 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:10:08.459014 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-b96f6dd6-b156-47c5-a0fb-a3f90ef6f31b req-845fa32a-aaed-4a1f-92c9-0fed221e3507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27fe9596-7a76-46e2-9e25-91395adcd069", "name": "network-vif-plugged", "status": "completed", "tag": "bb180f7a-065b-4bb7-a61c-9fcd540cd5b2"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:10:08.469309 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b96f6dd6-b156-47c5-a0fb-a3f90ef6f31b req-845fa32a-aaed-4a1f-92c9-0fed221e3507 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:10:08.469790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b96f6dd6-b156-47c5-a0fb-a3f90ef6f31b req-845fa32a-aaed-4a1f-92c9-0fed221e3507 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:10:08.470220 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-b96f6dd6-b156-47c5-a0fb-a3f90ef6f31b req-845fa32a-aaed-4a1f-92c9-0fed221e3507 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:10:08.481873 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-b96f6dd6-b156-47c5-a0fb-a3f90ef6f31b req-845fa32a-aaed-4a1f-92c9-0fed221e3507 service nova] Creating event network-vif-plugged:bb180f7a-065b-4bb7-a61c-9fcd540cd5b2 for instance 27fe9596-7a76-46e2-9e25-91395adcd069 on n-h2-858272-3 Oct 05 04:10:08.485472 n-d-858272-3 devstack@n-api.service[122319]: ERROR oslo.messaging._drivers.impl_rabbit [req-b96f6dd6-b156-47c5-a0fb-a3f90ef6f31b req-845fa32a-aaed-4a1f-92c9-0fed221e3507 service nova] [5cff455d-a098-4278-a006-5197493fca8a] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 04:10:08.660375 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4db6aefd-2a0d-497e-861c-788b585c6298 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:10:08.661062 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4db6aefd-2a0d-497e-861c-788b585c6298 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:10:08.668127 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4db6aefd-2a0d-497e-861c-788b585c6298 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:10:08.669295 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4db6aefd-2a0d-497e-861c-788b585c6298 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:10:08.669927 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4db6aefd-2a0d-497e-861c-788b585c6298 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:10:08.670646 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4db6aefd-2a0d-497e-861c-788b585c6298 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:10:08.671121 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4db6aefd-2a0d-497e-861c-788b585c6298 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:10:08.671562 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4db6aefd-2a0d-497e-861c-788b585c6298 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:10:08.805283 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4db6aefd-2a0d-497e-861c-788b585c6298 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:10:08.813271 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4db6aefd-2a0d-497e-861c-788b585c6298 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1576 microversion: 2.1 time: 0.156785 Oct 05 04:10:08.813858 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3990/7998] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:10:08 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 04:10:09.492763 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [req-b96f6dd6-b156-47c5-a0fb-a3f90ef6f31b req-845fa32a-aaed-4a1f-92c9-0fed221e3507 service nova] [5cff455d-a098-4278-a006-5197493fca8a] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 49368. Oct 05 04:10:09.497094 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-b96f6dd6-b156-47c5-a0fb-a3f90ef6f31b req-845fa32a-aaed-4a1f-92c9-0fed221e3507 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.091978 Oct 05 04:10:09.497950 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4009/7999] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 04:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 04:10:09.837025 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5f05a3a3-175d-4372-b244-02b911c1e69e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:10:09.837654 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5f05a3a3-175d-4372-b244-02b911c1e69e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:10:09.844818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5f05a3a3-175d-4372-b244-02b911c1e69e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:10:09.845349 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5f05a3a3-175d-4372-b244-02b911c1e69e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:10:09.845798 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5f05a3a3-175d-4372-b244-02b911c1e69e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:10:09.846494 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5f05a3a3-175d-4372-b244-02b911c1e69e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:10:09.846965 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5f05a3a3-175d-4372-b244-02b911c1e69e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:10:09.847404 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5f05a3a3-175d-4372-b244-02b911c1e69e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:10:09.977646 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5f05a3a3-175d-4372-b244-02b911c1e69e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:10:09.985636 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5f05a3a3-175d-4372-b244-02b911c1e69e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1576 microversion: 2.1 time: 0.152570 Oct 05 04:10:09.986225 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3991/8000] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:10:09 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:10:11.011475 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a6771d30-dc23-4f49-a881-c8b30b5d147d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:10:11.012096 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a6771d30-dc23-4f49-a881-c8b30b5d147d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:10:11.019445 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6771d30-dc23-4f49-a881-c8b30b5d147d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:10:11.019933 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6771d30-dc23-4f49-a881-c8b30b5d147d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:10:11.020374 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6771d30-dc23-4f49-a881-c8b30b5d147d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:10:11.021107 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6771d30-dc23-4f49-a881-c8b30b5d147d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:10:11.021560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6771d30-dc23-4f49-a881-c8b30b5d147d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:10:11.021982 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a6771d30-dc23-4f49-a881-c8b30b5d147d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:10:11.155015 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a6771d30-dc23-4f49-a881-c8b30b5d147d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:10:11.162942 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a6771d30-dc23-4f49-a881-c8b30b5d147d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1576 microversion: 2.1 time: 0.156699 Oct 05 04:10:11.163521 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4010/8001] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:10:11 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:10:12.188173 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e08ce4f1-ecf9-430a-95c3-90146b0bfc30 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:10:12.188798 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e08ce4f1-ecf9-430a-95c3-90146b0bfc30 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:10:12.195860 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e08ce4f1-ecf9-430a-95c3-90146b0bfc30 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:10:12.196359 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e08ce4f1-ecf9-430a-95c3-90146b0bfc30 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:10:12.196807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e08ce4f1-ecf9-430a-95c3-90146b0bfc30 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:10:12.197528 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e08ce4f1-ecf9-430a-95c3-90146b0bfc30 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:10:12.197991 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e08ce4f1-ecf9-430a-95c3-90146b0bfc30 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:10:12.198425 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e08ce4f1-ecf9-430a-95c3-90146b0bfc30 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:10:12.332190 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e08ce4f1-ecf9-430a-95c3-90146b0bfc30 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:10:12.339924 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e08ce4f1-ecf9-430a-95c3-90146b0bfc30 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1563 microversion: 2.1 time: 0.156296 Oct 05 04:10:12.340682 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3992/8002] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:10:12 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:11:23.490050 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=9 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:11:23.490829 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=25 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:11:23.495872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d86b17c1-4895-48ed-b78f-34720fa31f9e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:11:23.496378 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d86b17c1-4895-48ed-b78f-34720fa31f9e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:11:23.497385 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-4bbc7fb7-fc89-4c71-b91e-e8c23c2d2f0f req-4232ffd2-aaa6-48fc-85c9-d0b5d2630e82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27fe9596-7a76-46e2-9e25-91395adcd069", "tag": "bb180f7a-065b-4bb7-a61c-9fcd540cd5b2"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:11:23.504872 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d86b17c1-4895-48ed-b78f-34720fa31f9e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:23.505154 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=13 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:11:23.505406 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d86b17c1-4895-48ed-b78f-34720fa31f9e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:23.505964 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=41 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:11:23.506152 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d86b17c1-4895-48ed-b78f-34720fa31f9e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:23.506818 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d86b17c1-4895-48ed-b78f-34720fa31f9e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:23.507270 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d86b17c1-4895-48ed-b78f-34720fa31f9e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:23.507812 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 04:11:23.507961 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d86b17c1-4895-48ed-b78f-34720fa31f9e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:23.508059 n-d-858272-3 devstack@n-api.service[122320]: Wed Oct 5 04:11:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 05 04:11:23.520115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4bbc7fb7-fc89-4c71-b91e-e8c23c2d2f0f req-4232ffd2-aaa6-48fc-85c9-d0b5d2630e82 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:23.521070 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4bbc7fb7-fc89-4c71-b91e-e8c23c2d2f0f req-4232ffd2-aaa6-48fc-85c9-d0b5d2630e82 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:23.521736 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-4bbc7fb7-fc89-4c71-b91e-e8c23c2d2f0f req-4232ffd2-aaa6-48fc-85c9-d0b5d2630e82 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:23.535616 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-4bbc7fb7-fc89-4c71-b91e-e8c23c2d2f0f req-4232ffd2-aaa6-48fc-85c9-d0b5d2630e82 service nova] Creating event network-changed:bb180f7a-065b-4bb7-a61c-9fcd540cd5b2 for instance 27fe9596-7a76-46e2-9e25-91395adcd069 on n-h2-858272-3 Oct 05 04:11:23.538284 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d86b17c1-4895-48ed-b78f-34720fa31f9e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Going to try to terminate instance {{(pid=122319) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 04:11:23.541369 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-4bbc7fb7-fc89-4c71-b91e-e8c23c2d2f0f req-4232ffd2-aaa6-48fc-85c9-d0b5d2630e82 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050209 Oct 05 04:11:23.542538 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3993/8003] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 04:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 04:11:23.640227 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d86b17c1-4895-48ed-b78f-34720fa31f9e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "DELETE /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 204 len: 0 microversion: 2.1 time: 0.152826 Oct 05 04:11:23.641169 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4011/8004] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 04:11:23 2022] DELETE /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 04:11:23.652544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-87bf1781-56e2-4eb2-b59f-a6cbd7fc5857 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:11:23.652544 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-87bf1781-56e2-4eb2-b59f-a6cbd7fc5857 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:11:23.658691 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-87bf1781-56e2-4eb2-b59f-a6cbd7fc5857 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:23.659997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-87bf1781-56e2-4eb2-b59f-a6cbd7fc5857 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:23.660701 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-87bf1781-56e2-4eb2-b59f-a6cbd7fc5857 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:23.661449 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-87bf1781-56e2-4eb2-b59f-a6cbd7fc5857 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:23.662172 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-87bf1781-56e2-4eb2-b59f-a6cbd7fc5857 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:23.662849 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-87bf1781-56e2-4eb2-b59f-a6cbd7fc5857 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:23.801836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-87bf1781-56e2-4eb2-b59f-a6cbd7fc5857 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:11:23.810157 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-87bf1781-56e2-4eb2-b59f-a6cbd7fc5857 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1569 microversion: 2.1 time: 0.164208 Oct 05 04:11:23.810745 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3994/8005] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:11:23 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:11:24.834873 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-34129958-4d0b-4dde-9d3d-8caa28e9a9d2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:11:24.835732 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-34129958-4d0b-4dde-9d3d-8caa28e9a9d2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:11:24.842764 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-34129958-4d0b-4dde-9d3d-8caa28e9a9d2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:24.843253 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-34129958-4d0b-4dde-9d3d-8caa28e9a9d2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:24.843692 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-34129958-4d0b-4dde-9d3d-8caa28e9a9d2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:24.844391 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-34129958-4d0b-4dde-9d3d-8caa28e9a9d2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:24.844850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-34129958-4d0b-4dde-9d3d-8caa28e9a9d2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:24.845303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-34129958-4d0b-4dde-9d3d-8caa28e9a9d2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:24.976785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-34129958-4d0b-4dde-9d3d-8caa28e9a9d2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:11:24.984755 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-34129958-4d0b-4dde-9d3d-8caa28e9a9d2 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1569 microversion: 2.1 time: 0.154972 Oct 05 04:11:24.985358 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4012/8006] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:11:24 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:11:25.952106 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-1e716ea7-b717-4902-bcd6-69c515c93ab5 req-9a8fc49c-52cf-4177-86ad-fe0850f52059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27fe9596-7a76-46e2-9e25-91395adcd069", "name": "network-vif-deleted", "tag": "bb180f7a-065b-4bb7-a61c-9fcd540cd5b2"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:11:25.962887 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1e716ea7-b717-4902-bcd6-69c515c93ab5 req-9a8fc49c-52cf-4177-86ad-fe0850f52059 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:25.963307 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1e716ea7-b717-4902-bcd6-69c515c93ab5 req-9a8fc49c-52cf-4177-86ad-fe0850f52059 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:25.963742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-1e716ea7-b717-4902-bcd6-69c515c93ab5 req-9a8fc49c-52cf-4177-86ad-fe0850f52059 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:25.975195 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-1e716ea7-b717-4902-bcd6-69c515c93ab5 req-9a8fc49c-52cf-4177-86ad-fe0850f52059 service nova] Creating event network-vif-deleted:bb180f7a-065b-4bb7-a61c-9fcd540cd5b2 for instance 27fe9596-7a76-46e2-9e25-91395adcd069 on n-h2-858272-3 Oct 05 04:11:25.980411 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-1e716ea7-b717-4902-bcd6-69c515c93ab5 req-9a8fc49c-52cf-4177-86ad-fe0850f52059 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031986 Oct 05 04:11:25.981238 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3995/8007] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 04:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 04:11:26.009540 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-6b807c6b-60a8-4149-bba4-8a7948c37c5e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:11:26.010228 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-6b807c6b-60a8-4149-bba4-8a7948c37c5e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:11:26.017363 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b807c6b-60a8-4149-bba4-8a7948c37c5e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:26.017850 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b807c6b-60a8-4149-bba4-8a7948c37c5e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:26.018293 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b807c6b-60a8-4149-bba4-8a7948c37c5e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:26.019184 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b807c6b-60a8-4149-bba4-8a7948c37c5e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:26.019638 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b807c6b-60a8-4149-bba4-8a7948c37c5e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:26.020065 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-6b807c6b-60a8-4149-bba4-8a7948c37c5e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:26.426240 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-6b807c6b-60a8-4149-bba4-8a7948c37c5e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:11:26.434233 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-6b807c6b-60a8-4149-bba4-8a7948c37c5e tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1218 microversion: 2.1 time: 0.428653 Oct 05 04:11:26.434808 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4013/8008] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:11:26 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1218 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:11:27.460089 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-15fcf753-4340-4277-926b-a9c05cede85d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:11:27.460811 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-15fcf753-4340-4277-926b-a9c05cede85d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:11:27.467355 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-15fcf753-4340-4277-926b-a9c05cede85d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:27.467864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-15fcf753-4340-4277-926b-a9c05cede85d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:27.468316 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-15fcf753-4340-4277-926b-a9c05cede85d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:27.469060 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-15fcf753-4340-4277-926b-a9c05cede85d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:27.469534 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-15fcf753-4340-4277-926b-a9c05cede85d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:27.469978 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-15fcf753-4340-4277-926b-a9c05cede85d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:27.538909 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-15fcf753-4340-4277-926b-a9c05cede85d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:11:27.547092 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-15fcf753-4340-4277-926b-a9c05cede85d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1218 microversion: 2.1 time: 0.093218 Oct 05 04:11:27.547699 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3996/8009] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:11:27 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:11:28.570303 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-a865f82b-e4c2-4240-8504-56e14169653d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:11:28.570923 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-a865f82b-e4c2-4240-8504-56e14169653d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:11:28.577840 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a865f82b-e4c2-4240-8504-56e14169653d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:28.578334 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a865f82b-e4c2-4240-8504-56e14169653d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:28.578767 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a865f82b-e4c2-4240-8504-56e14169653d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:28.579459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a865f82b-e4c2-4240-8504-56e14169653d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:28.579913 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a865f82b-e4c2-4240-8504-56e14169653d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:28.580335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-a865f82b-e4c2-4240-8504-56e14169653d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:28.643108 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-a865f82b-e4c2-4240-8504-56e14169653d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:11:28.656782 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-a865f82b-e4c2-4240-8504-56e14169653d tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1218 microversion: 2.1 time: 0.090503 Oct 05 04:11:28.657405 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4014/8010] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:11:28 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 04:11:29.680395 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0d592059-176a-4b9c-82d4-452ce669e4fa tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:11:29.681094 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0d592059-176a-4b9c-82d4-452ce669e4fa tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:11:29.687888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d592059-176a-4b9c-82d4-452ce669e4fa tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:29.688391 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d592059-176a-4b9c-82d4-452ce669e4fa tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:29.688851 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d592059-176a-4b9c-82d4-452ce669e4fa tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:29.689580 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d592059-176a-4b9c-82d4-452ce669e4fa tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:29.690051 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d592059-176a-4b9c-82d4-452ce669e4fa tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:29.690543 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0d592059-176a-4b9c-82d4-452ce669e4fa tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:29.751936 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0d592059-176a-4b9c-82d4-452ce669e4fa tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60d6950cfc304bebbb08fc94704b34a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:11:29.760211 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0d592059-176a-4b9c-82d4-452ce669e4fa tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 200 len: 1218 microversion: 2.1 time: 0.083779 Oct 05 04:11:29.760795 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3997/8011] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:11:29 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:11:30.783312 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-df680954-e062-4656-a9a5-97a328648904 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:11:30.784083 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-df680954-e062-4656-a9a5-97a328648904 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] [instance: 27fe9596-7a76-46e2-9e25-91395adcd069] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:11:30.791087 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-df680954-e062-4656-a9a5-97a328648904 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:30.791574 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-df680954-e062-4656-a9a5-97a328648904 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:30.792009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-df680954-e062-4656-a9a5-97a328648904 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:30.793335 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-df680954-e062-4656-a9a5-97a328648904 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:30.793823 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-df680954-e062-4656-a9a5-97a328648904 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:30.794252 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-df680954-e062-4656-a9a5-97a328648904 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:30.808557 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-df680954-e062-4656-a9a5-97a328648904 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] HTTP exception thrown: Instance 27fe9596-7a76-46e2-9e25-91395adcd069 could not be found. Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-df680954-e062-4656-a9a5-97a328648904 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Request method failure captured: Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 HTTP/1.1 Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPQGPRPQnlNT_v30C5torN91hZQNkDS45jegpOTqWfVKNAlWZt-x5ErlO6jUb-kTNZRiNAMrWhkj2jony7Z8xHk14ko0bxro-M4MtPLpET7kSttRAg1Yeaa8zYnbXQ1Vb7hgDT3k-ZifMleEGiBrfNt1RKuFcjdmvEMaB_TLLLvoqlRk Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 8270dd7d19da4edc9b1a5e7598e0e1cf Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TestShelveInstance-1546434659 Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8270dd7d19da4edc9b1a5e7598e0e1cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8270dd7d19da4edc9b1a5e7598e0e1cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8270dd7d19da4edc9b1a5e7598e0e1cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8270dd7d19da4edc9b1a5e7598e0e1cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TestShelveInstance-1546434659 Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 8270dd7d19da4edc9b1a5e7598e0e1cf Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TestShelveInstance-1546434659 Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TestShelveInstance-1546434659-project Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: 60d6950cfc304bebbb08fc94704b34a6 Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TestShelveInstance-1546434659-project Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance 27fe9596-7a76-46e2-9e25-91395adcd069 could not be found. Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': '27fe9596-7a76-46e2-9e25-91395adcd069'} Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27fe9596-7a76-46e2-9e25-91395adcd069 could not be found. Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27fe9596-7a76-46e2-9e25-91395adcd069 could not be found. Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 04:11:30.810159 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 04:11:30.815048 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 04:11:30.815048 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 04:11:30.815048 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 04:11:30.815048 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 04:11:30.815048 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 04:11:30.815048 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27fe9596-7a76-46e2-9e25-91395adcd069 could not be found. Oct 05 04:11:30.815048 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 04:11:30.815048 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-df680954-e062-4656-a9a5-97a328648904 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Returning 404 to user: Instance 27fe9596-7a76-46e2-9e25-91395adcd069 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 04:11:30.815048 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-df680954-e062-4656-a9a5-97a328648904 tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069" status: 404 len: 111 microversion: 2.1 time: 0.032173 Oct 05 04:11:30.815048 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4015/8012] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:11:30 2022] GET /compute/v2.1/servers/27fe9596-7a76-46e2-9e25-91395adcd069 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 04:11:30.978748 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dfae7020-17e6-4346-8af5-33b01921d83f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] Calling method '.version_select at 0x7fccdf5684c0>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:11:31.014070 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dfae7020-17e6-4346-8af5-33b01921d83f tempest-TestShelveInstance-1546434659 tempest-TestShelveInstance-1546434659-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-663487803" status: 202 len: 0 microversion: 2.1 time: 0.038758 Oct 05 04:11:31.014733 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3998/8013] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 5 04:11:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-663487803 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 04:11:48.099461 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:11:48.100410 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:11:48.289319 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-80745e3e-61b2-4638-8992-12c9d3f11550 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Action: 'create', calling method: .version_select at 0x7fccdf24c700>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1862632936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHFejQ5093N7jDAsJVXL6D1g+1gwcw/cQgfqr2TP8IHb9RqT3668CE/MPiR/oJlJPUsKhdfPaB9EuelOpM88NY8LDD+UZNXRENx4zeG1mhdd0cBpcqSuOcoJDGnMH5ZGA=="}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:11:48.306127 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-80745e3e-61b2-4638-8992-12c9d3f11550 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Getting quotas for project 3f290aa28fa24d1eb2840c871ecdd853. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 04:11:48.311641 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-80745e3e-61b2-4638-8992-12c9d3f11550 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Getting quotas for user d0a624b8f35f4e60a36f6fe36e189f0d and project 3f290aa28fa24d1eb2840c871ecdd853. Resources: {'key_pairs'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 04:11:48.341701 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-80745e3e-61b2-4638-8992-12c9d3f11550 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.248316 Oct 05 04:11:48.342487 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4016/8014] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Oct 5 04:11:48 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 04:11:49.433252 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-acfaf588-744d-4390-a614-3030dcb130f8 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1660518671", "imageRef": "adad3215-1ca6-43bb-9981-0d01aff146ab", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1862632936", "security_groups": [{"name": "tempest-secgroup-smoke-1621979104"}], "networks": [{"uuid": "7cbd9ab9-5d00-4bee-a722-a83ab83e059b"}]}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:11:49.442743 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=22 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:11:49.443557 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:11:49.544097 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.network.neutron [None req-acfaf588-744d-4390-a614-3030dcb130f8 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] validate_networks() for [('7cbd9ab9-5d00-4bee-a722-a83ab83e059b', None, None, None, None, None)] {{(pid=122320) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 04:11:49.942745 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-acfaf588-744d-4390-a614-3030dcb130f8 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Flavor limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 04:11:49.943257 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-acfaf588-744d-4390-a614-3030dcb130f8 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Image limits 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 04:11:49.943865 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-acfaf588-744d-4390-a614-3030dcb130f8 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Flavor pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 04:11:49.944380 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-acfaf588-744d-4390-a614-3030dcb130f8 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Image pref 0:0:0 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 04:11:49.944881 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.virt.hardware [None req-acfaf588-744d-4390-a614-3030dcb130f8 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 04:11:49.954101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-acfaf588-744d-4390-a614-3030dcb130f8 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:49.955965 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-acfaf588-744d-4390-a614-3030dcb130f8 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:49.956440 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-acfaf588-744d-4390-a614-3030dcb130f8 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:49.957270 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-acfaf588-744d-4390-a614-3030dcb130f8 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:49.957753 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-acfaf588-744d-4390-a614-3030dcb130f8 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:49.958199 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-acfaf588-744d-4390-a614-3030dcb130f8 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:49.976038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-acfaf588-744d-4390-a614-3030dcb130f8 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Getting quotas for project 3f290aa28fa24d1eb2840c871ecdd853. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 04:11:49.981399 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.quota [None req-acfaf588-744d-4390-a614-3030dcb130f8 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Getting quotas for user d0a624b8f35f4e60a36f6fe36e189f0d and project 3f290aa28fa24d1eb2840c871ecdd853. Resources: {'cores', 'instances', 'ram'} {{(pid=122320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 04:11:49.995046 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-acfaf588-744d-4390-a614-3030dcb130f8 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Going to run 1 instances... {{(pid=122320) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 04:11:49.997416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-acfaf588-744d-4390-a614-3030dcb130f8 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: eaab82ce-f3e4-4d28-91b1-01ae28bcfd79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='adad3215-1ca6-43bb-9981-0d01aff146ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 04:11:50.046613 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-acfaf588-744d-4390-a614-3030dcb130f8 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.617538 Oct 05 04:11:50.047586 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 3999/8015] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 04:11:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 04:11:50.060082 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-fed26607-3622-4bf5-a1c0-47a06ae4621e tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:11:50.060711 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-fed26607-3622-4bf5-a1c0-47a06ae4621e tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: eaab82ce-f3e4-4d28-91b1-01ae28bcfd79] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:11:50.120305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-fed26607-3622-4bf5-a1c0-47a06ae4621e tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:11:50.128741 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-fed26607-3622-4bf5-a1c0-47a06ae4621e tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79" status: 200 len: 1249 microversion: 2.1 time: 0.073581 Oct 05 04:11:50.129365 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4017/8016] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:11:50 2022] GET /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79 => generated 1249 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:11:51.153983 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0cd3fdfe-1e23-44d3-8add-468421de938d tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:11:51.154776 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0cd3fdfe-1e23-44d3-8add-468421de938d tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: eaab82ce-f3e4-4d28-91b1-01ae28bcfd79] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:11:51.162726 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0cd3fdfe-1e23-44d3-8add-468421de938d tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:51.163313 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0cd3fdfe-1e23-44d3-8add-468421de938d tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:51.163836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0cd3fdfe-1e23-44d3-8add-468421de938d tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:51.164619 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0cd3fdfe-1e23-44d3-8add-468421de938d tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:51.165190 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0cd3fdfe-1e23-44d3-8add-468421de938d tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:51.165721 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0cd3fdfe-1e23-44d3-8add-468421de938d tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:51.271292 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-0cd3fdfe-1e23-44d3-8add-468421de938d tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:11:51.284814 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0cd3fdfe-1e23-44d3-8add-468421de938d tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79" status: 200 len: 1309 microversion: 2.1 time: 0.135154 Oct 05 04:11:51.297055 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 4000/8017] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:11:51 2022] GET /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79 => generated 1309 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:11:52.307820 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ff19bbc0-6300-4911-842f-75b164c8e424 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:11:52.309699 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ff19bbc0-6300-4911-842f-75b164c8e424 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: eaab82ce-f3e4-4d28-91b1-01ae28bcfd79] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:11:52.319176 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff19bbc0-6300-4911-842f-75b164c8e424 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:52.319966 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff19bbc0-6300-4911-842f-75b164c8e424 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:52.320597 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff19bbc0-6300-4911-842f-75b164c8e424 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:52.321621 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff19bbc0-6300-4911-842f-75b164c8e424 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:52.322388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff19bbc0-6300-4911-842f-75b164c8e424 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:52.322982 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff19bbc0-6300-4911-842f-75b164c8e424 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:52.566264 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ff19bbc0-6300-4911-842f-75b164c8e424 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:11:52.574832 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ff19bbc0-6300-4911-842f-75b164c8e424 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79" status: 200 len: 1375 microversion: 2.1 time: 0.270833 Oct 05 04:11:52.575435 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4018/8018] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:11:52 2022] GET /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79 => generated 1375 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:11:53.277824 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-3d27d502-9590-4fe4-98ec-c45b89b1804f req-6ddb4772-e50d-4842-a000-92194375e48e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaab82ce-f3e4-4d28-91b1-01ae28bcfd79", "tag": "89c9ba06-3dbe-4b86-a46e-8b5f0be0767d"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:11:53.288573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3d27d502-9590-4fe4-98ec-c45b89b1804f req-6ddb4772-e50d-4842-a000-92194375e48e service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:53.289104 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3d27d502-9590-4fe4-98ec-c45b89b1804f req-6ddb4772-e50d-4842-a000-92194375e48e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:53.289546 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-3d27d502-9590-4fe4-98ec-c45b89b1804f req-6ddb4772-e50d-4842-a000-92194375e48e service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:53.302349 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-3d27d502-9590-4fe4-98ec-c45b89b1804f req-6ddb4772-e50d-4842-a000-92194375e48e service nova] Creating event network-changed:89c9ba06-3dbe-4b86-a46e-8b5f0be0767d for instance eaab82ce-f3e4-4d28-91b1-01ae28bcfd79 on n-h2-858272-3 Oct 05 04:11:53.307382 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-3d27d502-9590-4fe4-98ec-c45b89b1804f req-6ddb4772-e50d-4842-a000-92194375e48e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100520 Oct 05 04:11:53.307988 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 4001/8019] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 04:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 04:11:53.599962 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ba4a3a13-5b71-45b4-b118-197fc21e132b tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:11:53.600745 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ba4a3a13-5b71-45b4-b118-197fc21e132b tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: eaab82ce-f3e4-4d28-91b1-01ae28bcfd79] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:11:53.607683 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ba4a3a13-5b71-45b4-b118-197fc21e132b tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:53.608110 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ba4a3a13-5b71-45b4-b118-197fc21e132b tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:53.608544 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ba4a3a13-5b71-45b4-b118-197fc21e132b tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:53.609276 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ba4a3a13-5b71-45b4-b118-197fc21e132b tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:53.609731 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ba4a3a13-5b71-45b4-b118-197fc21e132b tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:53.610172 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ba4a3a13-5b71-45b4-b118-197fc21e132b tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:53.750286 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ba4a3a13-5b71-45b4-b118-197fc21e132b tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:11:53.758680 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ba4a3a13-5b71-45b4-b118-197fc21e132b tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79" status: 200 len: 1375 microversion: 2.1 time: 0.163402 Oct 05 04:11:53.759271 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4019/8020] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:11:53 2022] GET /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79 => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:11:54.784204 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-296a01c5-2021-4183-be87-4671dbd10a8e tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:11:54.784985 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-296a01c5-2021-4183-be87-4671dbd10a8e tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: eaab82ce-f3e4-4d28-91b1-01ae28bcfd79] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:11:54.791165 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-296a01c5-2021-4183-be87-4671dbd10a8e tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:54.791665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-296a01c5-2021-4183-be87-4671dbd10a8e tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:54.792113 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-296a01c5-2021-4183-be87-4671dbd10a8e tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:54.792813 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-296a01c5-2021-4183-be87-4671dbd10a8e tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:54.793304 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-296a01c5-2021-4183-be87-4671dbd10a8e tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:54.793742 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-296a01c5-2021-4183-be87-4671dbd10a8e tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:54.935281 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-296a01c5-2021-4183-be87-4671dbd10a8e tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:11:54.943129 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-296a01c5-2021-4183-be87-4671dbd10a8e tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79" status: 200 len: 1375 microversion: 2.1 time: 0.164652 Oct 05 04:11:54.943704 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 4002/8021] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:11:54 2022] GET /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79 => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:11:55.966560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-98616345-2db0-41e9-9557-0dd52f59445d tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:11:55.967334 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-98616345-2db0-41e9-9557-0dd52f59445d tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: eaab82ce-f3e4-4d28-91b1-01ae28bcfd79] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:11:55.974761 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98616345-2db0-41e9-9557-0dd52f59445d tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:55.975248 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98616345-2db0-41e9-9557-0dd52f59445d tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:55.975682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98616345-2db0-41e9-9557-0dd52f59445d tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:55.976382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98616345-2db0-41e9-9557-0dd52f59445d tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:55.976834 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98616345-2db0-41e9-9557-0dd52f59445d tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:55.977310 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-98616345-2db0-41e9-9557-0dd52f59445d tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:56.182264 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-98616345-2db0-41e9-9557-0dd52f59445d tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:11:56.190113 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-98616345-2db0-41e9-9557-0dd52f59445d tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79" status: 200 len: 1375 microversion: 2.1 time: 0.227728 Oct 05 04:11:56.190699 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4020/8022] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:11:55 2022] GET /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79 => generated 1375 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:11:57.212760 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-859cf3ba-4b6c-4fe0-93b1-ba834357d934 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:11:57.213519 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-859cf3ba-4b6c-4fe0-93b1-ba834357d934 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: eaab82ce-f3e4-4d28-91b1-01ae28bcfd79] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:11:57.220169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-859cf3ba-4b6c-4fe0-93b1-ba834357d934 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:57.220667 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-859cf3ba-4b6c-4fe0-93b1-ba834357d934 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:57.221143 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-859cf3ba-4b6c-4fe0-93b1-ba834357d934 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:57.221844 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-859cf3ba-4b6c-4fe0-93b1-ba834357d934 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:57.222305 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-859cf3ba-4b6c-4fe0-93b1-ba834357d934 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:57.222737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-859cf3ba-4b6c-4fe0-93b1-ba834357d934 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:57.360122 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-859cf3ba-4b6c-4fe0-93b1-ba834357d934 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:11:57.369252 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-859cf3ba-4b6c-4fe0-93b1-ba834357d934 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79" status: 200 len: 1375 microversion: 2.1 time: 0.160290 Oct 05 04:11:57.369848 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 4003/8023] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:11:57 2022] GET /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79 => generated 1375 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:11:58.391765 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-e6980851-a25e-4f31-8b2d-02bbb23abd97 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:11:58.392971 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-e6980851-a25e-4f31-8b2d-02bbb23abd97 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: eaab82ce-f3e4-4d28-91b1-01ae28bcfd79] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:11:58.400181 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6980851-a25e-4f31-8b2d-02bbb23abd97 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:58.400676 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6980851-a25e-4f31-8b2d-02bbb23abd97 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:58.401146 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6980851-a25e-4f31-8b2d-02bbb23abd97 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:58.401853 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6980851-a25e-4f31-8b2d-02bbb23abd97 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:58.402317 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6980851-a25e-4f31-8b2d-02bbb23abd97 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:58.402750 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-e6980851-a25e-4f31-8b2d-02bbb23abd97 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:58.543024 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-e6980851-a25e-4f31-8b2d-02bbb23abd97 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:11:58.551458 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-e6980851-a25e-4f31-8b2d-02bbb23abd97 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79" status: 200 len: 1375 microversion: 2.1 time: 0.163716 Oct 05 04:11:58.552038 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4021/8024] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:11:58 2022] GET /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79 => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:11:58.951527 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-e71eb8ae-2c19-4456-b2ec-bfc6c00566b9 req-b2371654-5317-4208-86da-84c7541336e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaab82ce-f3e4-4d28-91b1-01ae28bcfd79", "name": "network-vif-plugged", "status": "completed", "tag": "89c9ba06-3dbe-4b86-a46e-8b5f0be0767d"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:11:58.961880 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e71eb8ae-2c19-4456-b2ec-bfc6c00566b9 req-b2371654-5317-4208-86da-84c7541336e3 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:58.962376 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e71eb8ae-2c19-4456-b2ec-bfc6c00566b9 req-b2371654-5317-4208-86da-84c7541336e3 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:58.962816 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-e71eb8ae-2c19-4456-b2ec-bfc6c00566b9 req-b2371654-5317-4208-86da-84c7541336e3 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:58.974785 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-e71eb8ae-2c19-4456-b2ec-bfc6c00566b9 req-b2371654-5317-4208-86da-84c7541336e3 service nova] Creating event network-vif-plugged:89c9ba06-3dbe-4b86-a46e-8b5f0be0767d for instance eaab82ce-f3e4-4d28-91b1-01ae28bcfd79 on n-h2-858272-3 Oct 05 04:11:58.980146 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-e71eb8ae-2c19-4456-b2ec-bfc6c00566b9 req-b2371654-5317-4208-86da-84c7541336e3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032515 Oct 05 04:11:58.980750 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 4004/8025] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 04:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 04:11:59.575241 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ea4fe374-7987-48a9-8fa9-714bf19bdbff tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:11:59.575884 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ea4fe374-7987-48a9-8fa9-714bf19bdbff tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: eaab82ce-f3e4-4d28-91b1-01ae28bcfd79] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:11:59.583286 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ea4fe374-7987-48a9-8fa9-714bf19bdbff tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:59.583775 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ea4fe374-7987-48a9-8fa9-714bf19bdbff tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:59.584207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ea4fe374-7987-48a9-8fa9-714bf19bdbff tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:59.584892 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ea4fe374-7987-48a9-8fa9-714bf19bdbff tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:11:59.585388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ea4fe374-7987-48a9-8fa9-714bf19bdbff tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:11:59.585811 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ea4fe374-7987-48a9-8fa9-714bf19bdbff tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:11:59.721302 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-ea4fe374-7987-48a9-8fa9-714bf19bdbff tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:11:59.728974 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ea4fe374-7987-48a9-8fa9-714bf19bdbff tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79" status: 200 len: 1375 microversion: 2.1 time: 0.157711 Oct 05 04:11:59.729543 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4022/8026] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:11:59 2022] GET /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79 => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:12:00.750397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:12:00.751110 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=6 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:12:00.755175 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-e0dc2c6a-809e-4e78-9aa2-8397c5780fb7 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:12:00.755888 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-e0dc2c6a-809e-4e78-9aa2-8397c5780fb7 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: eaab82ce-f3e4-4d28-91b1-01ae28bcfd79] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:12:00.762942 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0dc2c6a-809e-4e78-9aa2-8397c5780fb7 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:12:00.763432 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0dc2c6a-809e-4e78-9aa2-8397c5780fb7 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:12:00.763881 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0dc2c6a-809e-4e78-9aa2-8397c5780fb7 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:12:00.764576 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0dc2c6a-809e-4e78-9aa2-8397c5780fb7 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:12:00.765079 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0dc2c6a-809e-4e78-9aa2-8397c5780fb7 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:12:00.765520 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-e0dc2c6a-809e-4e78-9aa2-8397c5780fb7 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:12:00.897928 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-e0dc2c6a-809e-4e78-9aa2-8397c5780fb7 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:12:00.905585 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-e0dc2c6a-809e-4e78-9aa2-8397c5780fb7 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79" status: 200 len: 1560 microversion: 2.1 time: 0.157093 Oct 05 04:12:00.906156 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 4005/8027] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:12:00 2022] GET /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:12:00.928467 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-bcd1a9d8-1569-4da0-95c2-a0be2abf4f12 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:12:00.929207 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-bcd1a9d8-1569-4da0-95c2-a0be2abf4f12 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: eaab82ce-f3e4-4d28-91b1-01ae28bcfd79] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:12:00.931109 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=6 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:12:00.937567 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bcd1a9d8-1569-4da0-95c2-a0be2abf4f12 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:12:00.938065 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bcd1a9d8-1569-4da0-95c2-a0be2abf4f12 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:12:00.938510 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bcd1a9d8-1569-4da0-95c2-a0be2abf4f12 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:12:00.939221 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bcd1a9d8-1569-4da0-95c2-a0be2abf4f12 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:12:00.939679 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bcd1a9d8-1569-4da0-95c2-a0be2abf4f12 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:12:00.940116 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-bcd1a9d8-1569-4da0-95c2-a0be2abf4f12 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:12:01.072195 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-bcd1a9d8-1569-4da0-95c2-a0be2abf4f12 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:12:01.080736 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-bcd1a9d8-1569-4da0-95c2-a0be2abf4f12 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79" status: 200 len: 1560 microversion: 2.1 time: 0.156353 Oct 05 04:12:01.081349 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4023/8028] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:12:00 2022] GET /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:12:02.738677 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-f474ec74-c6af-4c02-bf30-59872e6a5500 req-fc94fb57-d66b-46f1-bfab-c95c009bbbf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaab82ce-f3e4-4d28-91b1-01ae28bcfd79", "tag": "89c9ba06-3dbe-4b86-a46e-8b5f0be0767d"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:12:02.748864 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f474ec74-c6af-4c02-bf30-59872e6a5500 req-fc94fb57-d66b-46f1-bfab-c95c009bbbf3 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:12:02.749390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f474ec74-c6af-4c02-bf30-59872e6a5500 req-fc94fb57-d66b-46f1-bfab-c95c009bbbf3 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:12:02.749836 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-f474ec74-c6af-4c02-bf30-59872e6a5500 req-fc94fb57-d66b-46f1-bfab-c95c009bbbf3 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:12:02.761724 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-f474ec74-c6af-4c02-bf30-59872e6a5500 req-fc94fb57-d66b-46f1-bfab-c95c009bbbf3 service nova] Creating event network-changed:89c9ba06-3dbe-4b86-a46e-8b5f0be0767d for instance eaab82ce-f3e4-4d28-91b1-01ae28bcfd79 on n-h2-858272-3 Oct 05 04:12:02.766769 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-f474ec74-c6af-4c02-bf30-59872e6a5500 req-fc94fb57-d66b-46f1-bfab-c95c009bbbf3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031995 Oct 05 04:12:02.768442 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 4006/8029] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 04:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 04:14:29.590925 n-d-858272-3 devstack@n-api.service[122319]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6905525b-80d2-47ff-94c4-6512d0d2e7d6] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 05 04:14:29.592688 n-d-858272-3 devstack@n-api.service[122319]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9ea01e0c-5288-45ec-999a-5c236fd0352e] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 05 04:14:29.593223 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:14:29.594062 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=36 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:14:29.595009 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 05 04:14:29.595195 n-d-858272-3 devstack@n-api.service[122319]: Wed Oct 5 04:14:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79/action (ip 10.222.0.16) !!! Oct 05 04:14:29.596352 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 04:14:29.596958 n-d-858272-3 devstack@n-api.service[122319]: Wed Oct 5 04:14:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79/action (ip 10.222.0.16) !!! Oct 05 04:14:29.603477 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-ff7a0fed-0f0a-4197-b3e7-5e717b88d74d tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-177136984"}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:14:29.605867 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-ff7a0fed-0f0a-4197-b3e7-5e717b88d74d tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: eaab82ce-f3e4-4d28-91b1-01ae28bcfd79] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:14:29.620382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff7a0fed-0f0a-4197-b3e7-5e717b88d74d tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:14:29.620870 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff7a0fed-0f0a-4197-b3e7-5e717b88d74d tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:14:29.621346 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff7a0fed-0f0a-4197-b3e7-5e717b88d74d tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:14:29.622047 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff7a0fed-0f0a-4197-b3e7-5e717b88d74d tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:14:29.622506 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff7a0fed-0f0a-4197-b3e7-5e717b88d74d tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:14:29.622936 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-ff7a0fed-0f0a-4197-b3e7-5e717b88d74d tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:14:29.958763 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-ff7a0fed-0f0a-4197-b3e7-5e717b88d74d tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "POST /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79/action" status: 202 len: 0 microversion: 2.1 time: 0.369479 Oct 05 04:14:29.960159 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4024/8030] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 04:14:29 2022] POST /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 05 04:14:37.540059 n-d-858272-3 devstack@n-api.service[122320]: ERROR oslo.messaging._drivers.impl_rabbit [-] [478c9060-5882-4902-b074-d751d7d6fe39] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 05 04:14:37.541030 n-d-858272-3 devstack@n-api.service[122320]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f8dec5f5-af45-49c2-a8e7-bbd40c1c5148] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 05 04:14:37.541665 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:14:37.542573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=32 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:14:37.543972 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 05 04:14:37.544198 n-d-858272-3 devstack@n-api.service[122320]: Wed Oct 5 04:14:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 05 04:14:37.546727 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 05 04:14:37.546874 n-d-858272-3 devstack@n-api.service[122320]: Wed Oct 5 04:14:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 05 04:14:37.558656 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-c5ccdc72-c295-4c5e-b974-15a554f103cc req-bc78226e-008a-4f93-b76b-da088c644585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaab82ce-f3e4-4d28-91b1-01ae28bcfd79", "name": "network-vif-plugged", "status": "completed", "tag": "89c9ba06-3dbe-4b86-a46e-8b5f0be0767d"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:14:37.575755 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-c5ccdc72-c295-4c5e-b974-15a554f103cc req-bc78226e-008a-4f93-b76b-da088c644585 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:14:37.576513 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-c5ccdc72-c295-4c5e-b974-15a554f103cc req-bc78226e-008a-4f93-b76b-da088c644585 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:14:37.577129 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-c5ccdc72-c295-4c5e-b974-15a554f103cc req-bc78226e-008a-4f93-b76b-da088c644585 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:14:37.589534 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-c5ccdc72-c295-4c5e-b974-15a554f103cc req-bc78226e-008a-4f93-b76b-da088c644585 service nova] Creating event network-vif-plugged:89c9ba06-3dbe-4b86-a46e-8b5f0be0767d for instance eaab82ce-f3e4-4d28-91b1-01ae28bcfd79 on n-h2-858272-3 Oct 05 04:14:37.595211 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-c5ccdc72-c295-4c5e-b974-15a554f103cc req-bc78226e-008a-4f93-b76b-da088c644585 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056966 Oct 05 04:14:37.596251 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 4007/8031] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 04:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 04:14:48.645805 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-3cd20074-d85f-43d5-8ca4-bef84d4a2ea9 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1351585200", "imageRef": "111d150f-e19d-4616-9467-acc7f52b84a4", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1862632936", "security_groups": [{"name": "tempest-secgroup-smoke-1621979104"}], "networks": [{"uuid": "7cbd9ab9-5d00-4bee-a722-a83ab83e059b"}]}} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:14:48.655893 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:14:48.656592 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:14:48.674211 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] [6905525b-80d2-47ff-94c4-6512d0d2e7d6] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 49818. Oct 05 04:14:48.676294 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] [9ea01e0c-5288-45ec-999a-5c236fd0352e] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 49820. Oct 05 04:14:48.759613 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.network.neutron [None req-3cd20074-d85f-43d5-8ca4-bef84d4a2ea9 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] validate_networks() for [('7cbd9ab9-5d00-4bee-a722-a83ab83e059b', None, None, None, None, None)] {{(pid=122319) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 04:14:49.249633 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-3cd20074-d85f-43d5-8ca4-bef84d4a2ea9 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Flavor limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 04:14:49.250065 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-3cd20074-d85f-43d5-8ca4-bef84d4a2ea9 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Image limits 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 04:14:49.250545 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-3cd20074-d85f-43d5-8ca4-bef84d4a2ea9 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Flavor pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 04:14:49.250957 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-3cd20074-d85f-43d5-8ca4-bef84d4a2ea9 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Image pref 0:0:0 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 04:14:49.251374 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.virt.hardware [None req-3cd20074-d85f-43d5-8ca4-bef84d4a2ea9 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 04:14:49.260190 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3cd20074-d85f-43d5-8ca4-bef84d4a2ea9 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:14:49.260681 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3cd20074-d85f-43d5-8ca4-bef84d4a2ea9 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:14:49.261166 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3cd20074-d85f-43d5-8ca4-bef84d4a2ea9 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:14:49.261898 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3cd20074-d85f-43d5-8ca4-bef84d4a2ea9 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:14:49.262357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3cd20074-d85f-43d5-8ca4-bef84d4a2ea9 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:14:49.262831 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-3cd20074-d85f-43d5-8ca4-bef84d4a2ea9 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:14:49.280253 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-3cd20074-d85f-43d5-8ca4-bef84d4a2ea9 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Getting quotas for project 3f290aa28fa24d1eb2840c871ecdd853. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 04:14:49.285560 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.quota [None req-3cd20074-d85f-43d5-8ca4-bef84d4a2ea9 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Getting quotas for user d0a624b8f35f4e60a36f6fe36e189f0d and project 3f290aa28fa24d1eb2840c871ecdd853. Resources: {'cores', 'instances', 'ram'} {{(pid=122319) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 04:14:49.298388 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3cd20074-d85f-43d5-8ca4-bef84d4a2ea9 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Going to run 1 instances... {{(pid=122319) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 04:14:49.300941 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-3cd20074-d85f-43d5-8ca4-bef84d4a2ea9 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: b7dc9fe4-ac06-4524-974b-8f19ec8ed167] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='111d150f-e19d-4616-9467-acc7f52b84a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122319) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 04:14:49.348255 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-3cd20074-d85f-43d5-8ca4-bef84d4a2ea9 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.706715 Oct 05 04:14:49.348925 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4025/8032] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 04:14:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 04:14:49.361747 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-80e48c4e-bbab-4001-89f4-f388c3512a88 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:14:49.362526 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-80e48c4e-bbab-4001-89f4-f388c3512a88 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: b7dc9fe4-ac06-4524-974b-8f19ec8ed167] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:14:49.369942 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:14:49.370639 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:14:49.386727 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [-] [f8dec5f5-af45-49c2-a8e7-bbd40c1c5148] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 49838. Oct 05 04:14:49.401977 n-d-858272-3 devstack@n-api.service[122320]: INFO oslo.messaging._drivers.impl_rabbit [-] [478c9060-5882-4902-b074-d751d7d6fe39] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 49836. Oct 05 04:14:49.488878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-80e48c4e-bbab-4001-89f4-f388c3512a88 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:14:49.496588 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-80e48c4e-bbab-4001-89f4-f388c3512a88 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167" status: 200 len: 1249 microversion: 2.1 time: 0.140252 Oct 05 04:14:49.497285 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 4008/8033] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:14:49 2022] GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167 => generated 1249 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:14:50.521053 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-5711dfba-2581-4e6b-b622-d737ee05b43f tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:14:50.521695 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-5711dfba-2581-4e6b-b622-d737ee05b43f tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: b7dc9fe4-ac06-4524-974b-8f19ec8ed167] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:14:50.575194 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-5711dfba-2581-4e6b-b622-d737ee05b43f tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:14:50.583290 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-5711dfba-2581-4e6b-b622-d737ee05b43f tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167" status: 200 len: 1249 microversion: 2.1 time: 0.067013 Oct 05 04:14:50.583860 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4026/8034] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:14:50 2022] GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167 => generated 1249 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 04:14:51.607919 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-dfb9b8bd-0a8c-4d5a-9f09-bb80cafa1dd2 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:14:51.608500 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-dfb9b8bd-0a8c-4d5a-9f09-bb80cafa1dd2 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: b7dc9fe4-ac06-4524-974b-8f19ec8ed167] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:14:51.661705 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-dfb9b8bd-0a8c-4d5a-9f09-bb80cafa1dd2 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:14:51.668635 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-dfb9b8bd-0a8c-4d5a-9f09-bb80cafa1dd2 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167" status: 200 len: 1249 microversion: 2.1 time: 0.065455 Oct 05 04:14:51.669816 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 4009/8035] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:14:51 2022] GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167 => generated 1249 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:14:52.692343 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-af59b315-0a38-48f8-8add-681311b36084 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:14:52.692992 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-af59b315-0a38-48f8-8add-681311b36084 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: b7dc9fe4-ac06-4524-974b-8f19ec8ed167] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:14:52.751785 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-af59b315-0a38-48f8-8add-681311b36084 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:14:52.759031 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-af59b315-0a38-48f8-8add-681311b36084 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167" status: 200 len: 1249 microversion: 2.1 time: 0.070627 Oct 05 04:14:52.759608 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4027/8036] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:14:52 2022] GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167 => generated 1249 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:14:53.737382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-7a8fca73-435c-4e56-a60f-c8b83f1965cb req-dfcd7a19-7d1c-4355-83d8-0d8e283d852c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaab82ce-f3e4-4d28-91b1-01ae28bcfd79", "name": "network-vif-unplugged", "status": "completed", "tag": "89c9ba06-3dbe-4b86-a46e-8b5f0be0767d"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:14:53.749904 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-7a8fca73-435c-4e56-a60f-c8b83f1965cb req-dfcd7a19-7d1c-4355-83d8-0d8e283d852c service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:14:53.750402 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-7a8fca73-435c-4e56-a60f-c8b83f1965cb req-dfcd7a19-7d1c-4355-83d8-0d8e283d852c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:14:53.750847 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-7a8fca73-435c-4e56-a60f-c8b83f1965cb req-dfcd7a19-7d1c-4355-83d8-0d8e283d852c service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:14:53.761647 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-7a8fca73-435c-4e56-a60f-c8b83f1965cb req-dfcd7a19-7d1c-4355-83d8-0d8e283d852c service nova] Creating event network-vif-unplugged:89c9ba06-3dbe-4b86-a46e-8b5f0be0767d for instance eaab82ce-f3e4-4d28-91b1-01ae28bcfd79 on n-h2-858272-3 Oct 05 04:14:53.767100 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-7a8fca73-435c-4e56-a60f-c8b83f1965cb req-dfcd7a19-7d1c-4355-83d8-0d8e283d852c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033651 Oct 05 04:14:53.767699 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 4010/8037] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 04:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 04:14:53.782655 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-980d0de7-82ba-49b1-b7ed-c6ad8db41400 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:14:53.783382 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-980d0de7-82ba-49b1-b7ed-c6ad8db41400 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: b7dc9fe4-ac06-4524-974b-8f19ec8ed167] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:14:53.791727 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-980d0de7-82ba-49b1-b7ed-c6ad8db41400 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:14:53.792389 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-980d0de7-82ba-49b1-b7ed-c6ad8db41400 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:14:53.792935 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-980d0de7-82ba-49b1-b7ed-c6ad8db41400 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:14:53.794561 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-980d0de7-82ba-49b1-b7ed-c6ad8db41400 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:14:53.795947 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-980d0de7-82ba-49b1-b7ed-c6ad8db41400 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:14:53.796490 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-980d0de7-82ba-49b1-b7ed-c6ad8db41400 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:14:53.881396 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-980d0de7-82ba-49b1-b7ed-c6ad8db41400 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:14:53.890512 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-980d0de7-82ba-49b1-b7ed-c6ad8db41400 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167" status: 200 len: 1307 microversion: 2.1 time: 0.112739 Oct 05 04:14:53.891848 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4028/8038] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:14:53 2022] GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167 => generated 1307 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:14:54.915545 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-d5a47889-3b54-47eb-8547-03496bb7f691 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:14:54.916432 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-d5a47889-3b54-47eb-8547-03496bb7f691 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: b7dc9fe4-ac06-4524-974b-8f19ec8ed167] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:14:54.924164 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5a47889-3b54-47eb-8547-03496bb7f691 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:14:54.924670 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5a47889-3b54-47eb-8547-03496bb7f691 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:14:54.925140 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5a47889-3b54-47eb-8547-03496bb7f691 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:14:54.925879 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5a47889-3b54-47eb-8547-03496bb7f691 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:14:54.926362 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5a47889-3b54-47eb-8547-03496bb7f691 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:14:54.926799 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-d5a47889-3b54-47eb-8547-03496bb7f691 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:14:55.072234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-d5a47889-3b54-47eb-8547-03496bb7f691 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:14:55.082467 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-d5a47889-3b54-47eb-8547-03496bb7f691 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167" status: 200 len: 1375 microversion: 2.1 time: 0.172016 Oct 05 04:14:55.083073 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 4011/8039] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:14:54 2022] GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167 => generated 1375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:14:56.108408 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d83ca176-386f-4423-bca4-0a3bcd134b26 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:14:56.109774 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d83ca176-386f-4423-bca4-0a3bcd134b26 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: b7dc9fe4-ac06-4524-974b-8f19ec8ed167] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:14:56.117457 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d83ca176-386f-4423-bca4-0a3bcd134b26 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:14:56.118199 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d83ca176-386f-4423-bca4-0a3bcd134b26 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:14:56.118702 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d83ca176-386f-4423-bca4-0a3bcd134b26 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:14:56.119483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d83ca176-386f-4423-bca4-0a3bcd134b26 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:14:56.120023 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d83ca176-386f-4423-bca4-0a3bcd134b26 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:14:56.120512 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d83ca176-386f-4423-bca4-0a3bcd134b26 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:14:56.265154 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d83ca176-386f-4423-bca4-0a3bcd134b26 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:14:56.273709 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d83ca176-386f-4423-bca4-0a3bcd134b26 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167" status: 200 len: 1375 microversion: 2.1 time: 0.171400 Oct 05 04:14:56.274564 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4029/8040] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:14:56 2022] GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167 => generated 1375 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:14:57.297831 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-b72fcd2f-1305-4503-955c-f1fc353c0dc2 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:14:57.299328 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-b72fcd2f-1305-4503-955c-f1fc353c0dc2 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: b7dc9fe4-ac06-4524-974b-8f19ec8ed167] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:14:57.306885 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b72fcd2f-1305-4503-955c-f1fc353c0dc2 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:14:57.307502 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b72fcd2f-1305-4503-955c-f1fc353c0dc2 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:14:57.307955 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b72fcd2f-1305-4503-955c-f1fc353c0dc2 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:14:57.308670 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b72fcd2f-1305-4503-955c-f1fc353c0dc2 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:14:57.309159 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b72fcd2f-1305-4503-955c-f1fc353c0dc2 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:14:57.309598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-b72fcd2f-1305-4503-955c-f1fc353c0dc2 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:14:57.454911 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-b72fcd2f-1305-4503-955c-f1fc353c0dc2 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:14:57.464198 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-b72fcd2f-1305-4503-955c-f1fc353c0dc2 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167" status: 200 len: 1375 microversion: 2.1 time: 0.170312 Oct 05 04:14:57.465150 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 4012/8041] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:14:57 2022] GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167 => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:14:58.492312 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-2b3daaa7-8d2d-4f78-9f1f-ac1617f7e3ca tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:14:58.492988 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-2b3daaa7-8d2d-4f78-9f1f-ac1617f7e3ca tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: b7dc9fe4-ac06-4524-974b-8f19ec8ed167] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:14:58.500514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b3daaa7-8d2d-4f78-9f1f-ac1617f7e3ca tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:14:58.501041 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b3daaa7-8d2d-4f78-9f1f-ac1617f7e3ca tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:14:58.501483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b3daaa7-8d2d-4f78-9f1f-ac1617f7e3ca tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:14:58.502191 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b3daaa7-8d2d-4f78-9f1f-ac1617f7e3ca tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:14:58.502647 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b3daaa7-8d2d-4f78-9f1f-ac1617f7e3ca tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:14:58.503076 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-2b3daaa7-8d2d-4f78-9f1f-ac1617f7e3ca tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:14:58.641694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-2b3daaa7-8d2d-4f78-9f1f-ac1617f7e3ca tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:14:58.649631 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-2b3daaa7-8d2d-4f78-9f1f-ac1617f7e3ca tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167" status: 200 len: 1375 microversion: 2.1 time: 0.161419 Oct 05 04:14:58.657185 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4030/8042] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:14:58 2022] GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167 => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:14:59.678210 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-4bdb3bea-e65e-44c4-8dcf-fec4e4097e56 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:14:59.678820 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-4bdb3bea-e65e-44c4-8dcf-fec4e4097e56 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: b7dc9fe4-ac06-4524-974b-8f19ec8ed167] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:14:59.686927 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4bdb3bea-e65e-44c4-8dcf-fec4e4097e56 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:14:59.687433 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4bdb3bea-e65e-44c4-8dcf-fec4e4097e56 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:14:59.687878 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4bdb3bea-e65e-44c4-8dcf-fec4e4097e56 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:14:59.688589 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4bdb3bea-e65e-44c4-8dcf-fec4e4097e56 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:14:59.689092 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4bdb3bea-e65e-44c4-8dcf-fec4e4097e56 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:14:59.689529 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-4bdb3bea-e65e-44c4-8dcf-fec4e4097e56 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:14:59.838234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-4bdb3bea-e65e-44c4-8dcf-fec4e4097e56 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:14:59.846881 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-4bdb3bea-e65e-44c4-8dcf-fec4e4097e56 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167" status: 200 len: 1375 microversion: 2.1 time: 0.172369 Oct 05 04:14:59.847876 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 4013/8043] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:14:59 2022] GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167 => generated 1375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:15:00.872831 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0547e769-518c-4625-ab46-4b8bfb2e7674 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:15:00.873842 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0547e769-518c-4625-ab46-4b8bfb2e7674 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: b7dc9fe4-ac06-4524-974b-8f19ec8ed167] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:15:00.875851 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:15:00.882888 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0547e769-518c-4625-ab46-4b8bfb2e7674 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:15:00.883589 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0547e769-518c-4625-ab46-4b8bfb2e7674 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:15:00.884027 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0547e769-518c-4625-ab46-4b8bfb2e7674 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:15:00.886262 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0547e769-518c-4625-ab46-4b8bfb2e7674 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:15:00.886262 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0547e769-518c-4625-ab46-4b8bfb2e7674 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:15:00.886262 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0547e769-518c-4625-ab46-4b8bfb2e7674 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:15:01.049605 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0547e769-518c-4625-ab46-4b8bfb2e7674 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:15:01.057481 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0547e769-518c-4625-ab46-4b8bfb2e7674 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167" status: 200 len: 1375 microversion: 2.1 time: 0.189358 Oct 05 04:15:01.058263 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4031/8044] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:15:00 2022] GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167 => generated 1375 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:15:02.081350 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-813b50f5-8d7d-4eb6-b5ec-41cca3886fb7 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:15:02.081987 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-813b50f5-8d7d-4eb6-b5ec-41cca3886fb7 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: b7dc9fe4-ac06-4524-974b-8f19ec8ed167] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:15:02.084800 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell0:SELECT=4 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:15:02.090378 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-813b50f5-8d7d-4eb6-b5ec-41cca3886fb7 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:15:02.091588 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-813b50f5-8d7d-4eb6-b5ec-41cca3886fb7 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:15:02.092115 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-813b50f5-8d7d-4eb6-b5ec-41cca3886fb7 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:15:02.092813 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-813b50f5-8d7d-4eb6-b5ec-41cca3886fb7 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:15:02.093302 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-813b50f5-8d7d-4eb6-b5ec-41cca3886fb7 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:15:02.093737 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-813b50f5-8d7d-4eb6-b5ec-41cca3886fb7 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:15:02.228871 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-813b50f5-8d7d-4eb6-b5ec-41cca3886fb7 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:15:02.237284 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-813b50f5-8d7d-4eb6-b5ec-41cca3886fb7 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167" status: 200 len: 1375 microversion: 2.1 time: 0.159799 Oct 05 04:15:02.237861 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 4014/8045] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:15:02 2022] GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167 => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:15:03.259562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d2ddb5b6-533f-4d29-a505-b9443302a156 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:15:03.260182 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d2ddb5b6-533f-4d29-a505-b9443302a156 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: b7dc9fe4-ac06-4524-974b-8f19ec8ed167] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:15:03.262996 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell0:SELECT=10 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:15:03.268688 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2ddb5b6-533f-4d29-a505-b9443302a156 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:15:03.269239 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2ddb5b6-533f-4d29-a505-b9443302a156 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:15:03.269682 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2ddb5b6-533f-4d29-a505-b9443302a156 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:15:03.270375 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2ddb5b6-533f-4d29-a505-b9443302a156 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:15:03.270828 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2ddb5b6-533f-4d29-a505-b9443302a156 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:15:03.271272 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d2ddb5b6-533f-4d29-a505-b9443302a156 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:15:03.727398 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d2ddb5b6-533f-4d29-a505-b9443302a156 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:15:03.735850 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d2ddb5b6-533f-4d29-a505-b9443302a156 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167" status: 200 len: 1375 microversion: 2.1 time: 0.480212 Oct 05 04:15:03.736437 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4032/8046] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:15:03 2022] GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167 => generated 1375 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:15:04.681736 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-68ba2849-86f6-4455-beac-ec031ecbf635 req-54d6256e-fb97-4ea0-b6f2-eb9efd28aa5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7dc9fe4-ac06-4524-974b-8f19ec8ed167", "tag": "9342accf-5fcb-4928-87f3-41ec4893ce21"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:15:04.694179 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-68ba2849-86f6-4455-beac-ec031ecbf635 req-54d6256e-fb97-4ea0-b6f2-eb9efd28aa5f service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:15:04.694785 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-68ba2849-86f6-4455-beac-ec031ecbf635 req-54d6256e-fb97-4ea0-b6f2-eb9efd28aa5f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:15:04.695439 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-68ba2849-86f6-4455-beac-ec031ecbf635 req-54d6256e-fb97-4ea0-b6f2-eb9efd28aa5f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:15:04.707443 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-68ba2849-86f6-4455-beac-ec031ecbf635 req-54d6256e-fb97-4ea0-b6f2-eb9efd28aa5f service nova] Creating event network-changed:9342accf-5fcb-4928-87f3-41ec4893ce21 for instance b7dc9fe4-ac06-4524-974b-8f19ec8ed167 on n-h1-858272-3 Oct 05 04:15:04.712417 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-68ba2849-86f6-4455-beac-ec031ecbf635 req-54d6256e-fb97-4ea0-b6f2-eb9efd28aa5f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035858 Oct 05 04:15:04.713065 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 4015/8047] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 04:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 04:15:04.759034 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-08ea28a1-93ac-499a-8f20-d6c3a8b7c3f4 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:15:04.759687 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-08ea28a1-93ac-499a-8f20-d6c3a8b7c3f4 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: b7dc9fe4-ac06-4524-974b-8f19ec8ed167] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:15:04.767364 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08ea28a1-93ac-499a-8f20-d6c3a8b7c3f4 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:15:04.767976 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08ea28a1-93ac-499a-8f20-d6c3a8b7c3f4 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:15:04.768506 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08ea28a1-93ac-499a-8f20-d6c3a8b7c3f4 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:15:04.769562 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08ea28a1-93ac-499a-8f20-d6c3a8b7c3f4 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:15:04.770136 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08ea28a1-93ac-499a-8f20-d6c3a8b7c3f4 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:15:04.770433 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-08ea28a1-93ac-499a-8f20-d6c3a8b7c3f4 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:15:04.995332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-08ea28a1-93ac-499a-8f20-d6c3a8b7c3f4 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:15:05.003158 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-08ea28a1-93ac-499a-8f20-d6c3a8b7c3f4 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167" status: 200 len: 1375 microversion: 2.1 time: 0.248215 Oct 05 04:15:05.003748 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4033/8048] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:15:04 2022] GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167 => generated 1375 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:15:06.027436 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-22e83890-8be9-44ed-91fe-42a11276afce tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:15:06.028504 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-22e83890-8be9-44ed-91fe-42a11276afce tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: b7dc9fe4-ac06-4524-974b-8f19ec8ed167] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:15:06.034938 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22e83890-8be9-44ed-91fe-42a11276afce tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:15:06.035445 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22e83890-8be9-44ed-91fe-42a11276afce tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:15:06.035899 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22e83890-8be9-44ed-91fe-42a11276afce tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:15:06.036599 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22e83890-8be9-44ed-91fe-42a11276afce tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:15:06.037107 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22e83890-8be9-44ed-91fe-42a11276afce tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:15:06.037551 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-22e83890-8be9-44ed-91fe-42a11276afce tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:15:06.186194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-22e83890-8be9-44ed-91fe-42a11276afce tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:15:06.198018 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-22e83890-8be9-44ed-91fe-42a11276afce tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167" status: 200 len: 1375 microversion: 2.1 time: 0.175313 Oct 05 04:15:06.199108 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 4016/8049] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:15:06 2022] GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167 => generated 1375 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:15:07.224209 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0039bebe-dfe1-4b51-90f1-1d8e738dfbad tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:15:07.224824 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0039bebe-dfe1-4b51-90f1-1d8e738dfbad tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: b7dc9fe4-ac06-4524-974b-8f19ec8ed167] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:15:07.232042 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0039bebe-dfe1-4b51-90f1-1d8e738dfbad tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:15:07.232546 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0039bebe-dfe1-4b51-90f1-1d8e738dfbad tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:15:07.233009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0039bebe-dfe1-4b51-90f1-1d8e738dfbad tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:15:07.234286 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0039bebe-dfe1-4b51-90f1-1d8e738dfbad tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:15:07.234286 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0039bebe-dfe1-4b51-90f1-1d8e738dfbad tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:15:07.235582 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0039bebe-dfe1-4b51-90f1-1d8e738dfbad tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:15:07.453459 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-0039bebe-dfe1-4b51-90f1-1d8e738dfbad tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:15:07.461313 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0039bebe-dfe1-4b51-90f1-1d8e738dfbad tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167" status: 200 len: 1375 microversion: 2.1 time: 0.240955 Oct 05 04:15:07.461896 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4034/8050] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:15:07 2022] GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167 => generated 1375 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:15:08.486055 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-64d8a4d8-82f2-466e-95da-8fd1e28ee1d1 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:15:08.486717 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-64d8a4d8-82f2-466e-95da-8fd1e28ee1d1 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: b7dc9fe4-ac06-4524-974b-8f19ec8ed167] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:15:08.493831 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64d8a4d8-82f2-466e-95da-8fd1e28ee1d1 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:15:08.494331 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64d8a4d8-82f2-466e-95da-8fd1e28ee1d1 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:15:08.494779 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64d8a4d8-82f2-466e-95da-8fd1e28ee1d1 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:15:08.495484 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64d8a4d8-82f2-466e-95da-8fd1e28ee1d1 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:15:08.495952 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64d8a4d8-82f2-466e-95da-8fd1e28ee1d1 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:15:08.496390 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-64d8a4d8-82f2-466e-95da-8fd1e28ee1d1 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:15:08.634997 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-64d8a4d8-82f2-466e-95da-8fd1e28ee1d1 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:15:08.642908 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-64d8a4d8-82f2-466e-95da-8fd1e28ee1d1 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167" status: 200 len: 1375 microversion: 2.1 time: 0.160942 Oct 05 04:15:08.643484 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 4017/8051] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:15:08 2022] GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167 => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:15:09.665950 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-72e71a07-90e2-48b8-817f-11d5f3b1e56f tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:15:09.666380 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-72e71a07-90e2-48b8-817f-11d5f3b1e56f tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: b7dc9fe4-ac06-4524-974b-8f19ec8ed167] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:15:09.673772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72e71a07-90e2-48b8-817f-11d5f3b1e56f tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:15:09.674261 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72e71a07-90e2-48b8-817f-11d5f3b1e56f tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:15:09.674702 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72e71a07-90e2-48b8-817f-11d5f3b1e56f tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:15:09.675399 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72e71a07-90e2-48b8-817f-11d5f3b1e56f tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:15:09.675854 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72e71a07-90e2-48b8-817f-11d5f3b1e56f tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:15:09.676282 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-72e71a07-90e2-48b8-817f-11d5f3b1e56f tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:15:09.806539 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-72e71a07-90e2-48b8-817f-11d5f3b1e56f tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:15:09.814689 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-72e71a07-90e2-48b8-817f-11d5f3b1e56f tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167" status: 200 len: 1375 microversion: 2.1 time: 0.153367 Oct 05 04:15:09.815269 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4035/8052] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:15:09 2022] GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167 => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:15:10.565472 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [req-732885f4-bd2c-48d1-85af-e419ff1e86cf req-da0c8845-85de-4e2c-9c5a-e7a279d5f7c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7dc9fe4-ac06-4524-974b-8f19ec8ed167", "name": "network-vif-plugged", "status": "completed", "tag": "9342accf-5fcb-4928-87f3-41ec4893ce21"}]} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:15:10.576009 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-732885f4-bd2c-48d1-85af-e419ff1e86cf req-da0c8845-85de-4e2c-9c5a-e7a279d5f7c4 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:15:10.576508 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-732885f4-bd2c-48d1-85af-e419ff1e86cf req-da0c8845-85de-4e2c-9c5a-e7a279d5f7c4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:15:10.576987 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [req-732885f4-bd2c-48d1-85af-e419ff1e86cf req-da0c8845-85de-4e2c-9c5a-e7a279d5f7c4 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:15:10.587916 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.compute.server_external_events [req-732885f4-bd2c-48d1-85af-e419ff1e86cf req-da0c8845-85de-4e2c-9c5a-e7a279d5f7c4 service nova] Creating event network-vif-plugged:9342accf-5fcb-4928-87f3-41ec4893ce21 for instance b7dc9fe4-ac06-4524-974b-8f19ec8ed167 on n-h1-858272-3 Oct 05 04:15:10.593417 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [req-732885f4-bd2c-48d1-85af-e419ff1e86cf req-da0c8845-85de-4e2c-9c5a-e7a279d5f7c4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089510 Oct 05 04:15:10.594004 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 4018/8053] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 04:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 04:15:10.838068 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-c763a47f-9fbf-48b6-a404-758de4d56df6 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:15:10.838694 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-c763a47f-9fbf-48b6-a404-758de4d56df6 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: b7dc9fe4-ac06-4524-974b-8f19ec8ed167] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:15:10.845675 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c763a47f-9fbf-48b6-a404-758de4d56df6 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:15:10.846168 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c763a47f-9fbf-48b6-a404-758de4d56df6 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:15:10.846609 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c763a47f-9fbf-48b6-a404-758de4d56df6 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:15:10.847304 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c763a47f-9fbf-48b6-a404-758de4d56df6 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:15:10.847763 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c763a47f-9fbf-48b6-a404-758de4d56df6 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:15:10.848190 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-c763a47f-9fbf-48b6-a404-758de4d56df6 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:15:10.979345 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-c763a47f-9fbf-48b6-a404-758de4d56df6 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:15:10.987363 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-c763a47f-9fbf-48b6-a404-758de4d56df6 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167" status: 200 len: 1375 microversion: 2.1 time: 0.153250 Oct 05 04:15:10.987950 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4036/8054] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:15:10 2022] GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167 => generated 1375 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:15:12.014272 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-bcf89f4c-6584-4811-9307-fdda3557bf68 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:15:12.014899 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-bcf89f4c-6584-4811-9307-fdda3557bf68 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: b7dc9fe4-ac06-4524-974b-8f19ec8ed167] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:15:12.021168 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bcf89f4c-6584-4811-9307-fdda3557bf68 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:15:12.021669 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bcf89f4c-6584-4811-9307-fdda3557bf68 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:15:12.022118 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bcf89f4c-6584-4811-9307-fdda3557bf68 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:15:12.022818 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bcf89f4c-6584-4811-9307-fdda3557bf68 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:15:12.023290 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bcf89f4c-6584-4811-9307-fdda3557bf68 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:15:12.023725 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-bcf89f4c-6584-4811-9307-fdda3557bf68 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:15:12.161895 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-bcf89f4c-6584-4811-9307-fdda3557bf68 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:15:12.171457 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-bcf89f4c-6584-4811-9307-fdda3557bf68 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167" status: 200 len: 1375 microversion: 2.1 time: 0.163935 Oct 05 04:15:12.172066 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 4019/8055] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:15:12 2022] GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167 => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:15:13.194602 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-d946b814-cb0f-457d-876c-3f021995df38 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:15:13.195211 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-d946b814-cb0f-457d-876c-3f021995df38 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: b7dc9fe4-ac06-4524-974b-8f19ec8ed167] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:15:13.202896 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d946b814-cb0f-457d-876c-3f021995df38 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:15:13.203386 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d946b814-cb0f-457d-876c-3f021995df38 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:15:13.203827 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d946b814-cb0f-457d-876c-3f021995df38 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:15:13.204524 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d946b814-cb0f-457d-876c-3f021995df38 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:15:13.205012 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d946b814-cb0f-457d-876c-3f021995df38 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:15:13.205440 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-d946b814-cb0f-457d-876c-3f021995df38 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:15:13.343999 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-d946b814-cb0f-457d-876c-3f021995df38 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:15:13.351847 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-d946b814-cb0f-457d-876c-3f021995df38 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167" status: 200 len: 1559 microversion: 2.1 time: 0.161202 Oct 05 04:15:13.352420 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4037/8056] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:15:13 2022] GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:15:13.374752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-a439db46-9084-4dc7-8e31-e3fac6274d43 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:15:13.375379 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-a439db46-9084-4dc7-8e31-e3fac6274d43 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: b7dc9fe4-ac06-4524-974b-8f19ec8ed167] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:15:13.382301 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a439db46-9084-4dc7-8e31-e3fac6274d43 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:15:13.382797 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a439db46-9084-4dc7-8e31-e3fac6274d43 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:15:13.383241 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a439db46-9084-4dc7-8e31-e3fac6274d43 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:15:13.383929 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a439db46-9084-4dc7-8e31-e3fac6274d43 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:15:13.384392 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a439db46-9084-4dc7-8e31-e3fac6274d43 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:15:13.384822 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-a439db46-9084-4dc7-8e31-e3fac6274d43 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:15:13.518767 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-a439db46-9084-4dc7-8e31-e3fac6274d43 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:15:13.526605 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-a439db46-9084-4dc7-8e31-e3fac6274d43 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167" status: 200 len: 1559 microversion: 2.1 time: 0.156329 Oct 05 04:15:13.527193 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 4020/8057] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:15:13 2022] GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:15:15.085751 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-c72d320c-b8ef-4e09-b2ff-be87e273c1ae req-e3615854-eb83-4e05-91a8-1db2061a40c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7dc9fe4-ac06-4524-974b-8f19ec8ed167", "tag": "9342accf-5fcb-4928-87f3-41ec4893ce21"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:15:15.097624 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c72d320c-b8ef-4e09-b2ff-be87e273c1ae req-e3615854-eb83-4e05-91a8-1db2061a40c8 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:15:15.098197 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c72d320c-b8ef-4e09-b2ff-be87e273c1ae req-e3615854-eb83-4e05-91a8-1db2061a40c8 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:15:15.098739 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-c72d320c-b8ef-4e09-b2ff-be87e273c1ae req-e3615854-eb83-4e05-91a8-1db2061a40c8 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:15:15.110377 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-c72d320c-b8ef-4e09-b2ff-be87e273c1ae req-e3615854-eb83-4e05-91a8-1db2061a40c8 service nova] Creating event network-changed:9342accf-5fcb-4928-87f3-41ec4893ce21 for instance b7dc9fe4-ac06-4524-974b-8f19ec8ed167 on n-h1-858272-3 Oct 05 04:15:15.116012 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-c72d320c-b8ef-4e09-b2ff-be87e273c1ae req-e3615854-eb83-4e05-91a8-1db2061a40c8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034602 Oct 05 04:15:15.116954 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4038/8058] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 04:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 04:17:15.796387 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=32 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:17:15.797227 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=54 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:17:15.851756 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-8daaf024-614b-4add-bd1c-472459fd4bef tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-2122048253"}} {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:17:15.854269 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-8daaf024-614b-4add-bd1c-472459fd4bef tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: b7dc9fe4-ac06-4524-974b-8f19ec8ed167] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:17:15.861090 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8daaf024-614b-4add-bd1c-472459fd4bef tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:17:15.861534 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8daaf024-614b-4add-bd1c-472459fd4bef tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:17:15.861978 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8daaf024-614b-4add-bd1c-472459fd4bef tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:17:15.862670 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8daaf024-614b-4add-bd1c-472459fd4bef tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:17:15.863157 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8daaf024-614b-4add-bd1c-472459fd4bef tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:17:15.863591 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-8daaf024-614b-4add-bd1c-472459fd4bef tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:17:16.065606 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-8daaf024-614b-4add-bd1c-472459fd4bef tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "POST /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167/action" status: 202 len: 0 microversion: 2.1 time: 0.271848 Oct 05 04:17:16.066259 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 4021/8059] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Oct 5 04:17:15 2022] POST /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 05 04:17:23.170770 n-d-858272-3 devstack@n-api.service[122319]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6905525b-80d2-47ff-94c4-6512d0d2e7d6] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 05 04:17:23.173297 n-d-858272-3 devstack@n-api.service[122319]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9ea01e0c-5288-45ec-999a-5c236fd0352e] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 05 04:17:23.174143 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:17:23.174938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=64 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:17:23.175931 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 04:17:23.176118 n-d-858272-3 devstack@n-api.service[122319]: Wed Oct 5 04:17:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 05 04:17:23.191676 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-e17f73ca-a509-42de-b1c8-201e14640c07 req-66760bf9-0f1a-4ce4-8d4b-ed7ee0f7cfea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7dc9fe4-ac06-4524-974b-8f19ec8ed167", "name": "network-vif-plugged", "status": "completed", "tag": "9342accf-5fcb-4928-87f3-41ec4893ce21"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:17:23.207250 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e17f73ca-a509-42de-b1c8-201e14640c07 req-66760bf9-0f1a-4ce4-8d4b-ed7ee0f7cfea service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:17:23.207731 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e17f73ca-a509-42de-b1c8-201e14640c07 req-66760bf9-0f1a-4ce4-8d4b-ed7ee0f7cfea service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:17:23.208161 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e17f73ca-a509-42de-b1c8-201e14640c07 req-66760bf9-0f1a-4ce4-8d4b-ed7ee0f7cfea service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:17:23.218954 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-e17f73ca-a509-42de-b1c8-201e14640c07 req-66760bf9-0f1a-4ce4-8d4b-ed7ee0f7cfea service nova] Creating event network-vif-plugged:9342accf-5fcb-4928-87f3-41ec4893ce21 for instance b7dc9fe4-ac06-4524-974b-8f19ec8ed167 on n-h1-858272-3 Oct 05 04:17:23.224117 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-e17f73ca-a509-42de-b1c8-201e14640c07 req-66760bf9-0f1a-4ce4-8d4b-ed7ee0f7cfea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057511 Oct 05 04:17:23.224794 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4039/8060] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 04:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 04:17:34.781598 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-092930ef-0256-4856-b69c-3a90ec4b1faf tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:17:34.782573 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-092930ef-0256-4856-b69c-3a90ec4b1faf tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: b7dc9fe4-ac06-4524-974b-8f19ec8ed167] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:17:34.785160 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_api:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:17:34.786979 n-d-858272-3 devstack@n-api.service[122319]: DEBUG dbcounter [-] [122319] Writing DB stats nova_cell1:SELECT=2 {{(pid=122319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:17:34.796703 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] [6905525b-80d2-47ff-94c4-6512d0d2e7d6] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 50196. Oct 05 04:17:34.797244 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_api:SELECT=2 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:17:34.799152 n-d-858272-3 devstack@n-api.service[122319]: INFO oslo.messaging._drivers.impl_rabbit [-] [9ea01e0c-5288-45ec-999a-5c236fd0352e] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 50198. Oct 05 04:17:34.799558 n-d-858272-3 devstack@n-api.service[122320]: DEBUG dbcounter [-] [122320] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:17:34.810382 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-092930ef-0256-4856-b69c-3a90ec4b1faf tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:17:34.811030 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-092930ef-0256-4856-b69c-3a90ec4b1faf tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:17:34.811741 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-092930ef-0256-4856-b69c-3a90ec4b1faf tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:17:34.812586 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-092930ef-0256-4856-b69c-3a90ec4b1faf tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:17:34.813243 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-092930ef-0256-4856-b69c-3a90ec4b1faf tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:17:34.813807 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-092930ef-0256-4856-b69c-3a90ec4b1faf tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:17:34.843981 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-092930ef-0256-4856-b69c-3a90ec4b1faf tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: b7dc9fe4-ac06-4524-974b-8f19ec8ed167] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 04:17:34.854572 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-6f8e35f7-0374-4207-84bc-c34e011edbab req-c008fd88-475b-4e8d-877a-9179ff25c37a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7dc9fe4-ac06-4524-974b-8f19ec8ed167", "tag": "9342accf-5fcb-4928-87f3-41ec4893ce21"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:17:34.865514 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6f8e35f7-0374-4207-84bc-c34e011edbab req-c008fd88-475b-4e8d-877a-9179ff25c37a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:17:34.866310 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6f8e35f7-0374-4207-84bc-c34e011edbab req-c008fd88-475b-4e8d-877a-9179ff25c37a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:17:34.866746 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-6f8e35f7-0374-4207-84bc-c34e011edbab req-c008fd88-475b-4e8d-877a-9179ff25c37a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:17:34.878906 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-6f8e35f7-0374-4207-84bc-c34e011edbab req-c008fd88-475b-4e8d-877a-9179ff25c37a service nova] Creating event network-changed:9342accf-5fcb-4928-87f3-41ec4893ce21 for instance b7dc9fe4-ac06-4524-974b-8f19ec8ed167 on n-h1-858272-3 Oct 05 04:17:34.884773 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-6f8e35f7-0374-4207-84bc-c34e011edbab req-c008fd88-475b-4e8d-877a-9179ff25c37a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106438 Oct 05 04:17:34.885652 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4040/8061] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 04:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 04:17:34.925177 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-092930ef-0256-4856-b69c-3a90ec4b1faf tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167" status: 204 len: 0 microversion: 2.1 time: 0.149061 Oct 05 04:17:34.926092 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 4022/8062] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 04:17:34 2022] DELETE /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 04:17:34.936152 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-94d90d36-21f4-4716-ad32-242e7646c4d1 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:17:34.936871 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-94d90d36-21f4-4716-ad32-242e7646c4d1 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: b7dc9fe4-ac06-4524-974b-8f19ec8ed167] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:17:34.943276 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94d90d36-21f4-4716-ad32-242e7646c4d1 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:17:34.943772 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94d90d36-21f4-4716-ad32-242e7646c4d1 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:17:34.944231 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94d90d36-21f4-4716-ad32-242e7646c4d1 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:17:34.944938 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94d90d36-21f4-4716-ad32-242e7646c4d1 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:17:34.945612 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94d90d36-21f4-4716-ad32-242e7646c4d1 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:17:34.946039 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-94d90d36-21f4-4716-ad32-242e7646c4d1 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:17:35.085153 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-94d90d36-21f4-4716-ad32-242e7646c4d1 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:17:35.093703 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-94d90d36-21f4-4716-ad32-242e7646c4d1 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167" status: 200 len: 1684 microversion: 2.1 time: 0.162415 Oct 05 04:17:35.094286 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4041/8063] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:17:34 2022] GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167 => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:17:36.118473 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-69d7b3e9-9dba-496f-8eaa-f3e42443c4f6 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:17:36.119192 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-69d7b3e9-9dba-496f-8eaa-f3e42443c4f6 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: b7dc9fe4-ac06-4524-974b-8f19ec8ed167] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:17:36.126446 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69d7b3e9-9dba-496f-8eaa-f3e42443c4f6 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:17:36.126947 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69d7b3e9-9dba-496f-8eaa-f3e42443c4f6 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:17:36.127397 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69d7b3e9-9dba-496f-8eaa-f3e42443c4f6 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:17:36.128101 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69d7b3e9-9dba-496f-8eaa-f3e42443c4f6 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:17:36.128569 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69d7b3e9-9dba-496f-8eaa-f3e42443c4f6 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:17:36.129038 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-69d7b3e9-9dba-496f-8eaa-f3e42443c4f6 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:17:36.330872 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-69d7b3e9-9dba-496f-8eaa-f3e42443c4f6 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:17:36.338656 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-69d7b3e9-9dba-496f-8eaa-f3e42443c4f6 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167" status: 200 len: 1684 microversion: 2.1 time: 0.224756 Oct 05 04:17:36.339230 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 4023/8064] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:17:36 2022] GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167 => generated 1684 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:17:37.192812 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-e2acfe13-bd30-4d76-97ae-ebb06b61fb6f req-99af032d-fbe5-40d7-a1bd-36e00ac3f93f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7dc9fe4-ac06-4524-974b-8f19ec8ed167", "name": "network-vif-deleted", "tag": "9342accf-5fcb-4928-87f3-41ec4893ce21"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:17:37.202529 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e2acfe13-bd30-4d76-97ae-ebb06b61fb6f req-99af032d-fbe5-40d7-a1bd-36e00ac3f93f service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:17:37.203009 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e2acfe13-bd30-4d76-97ae-ebb06b61fb6f req-99af032d-fbe5-40d7-a1bd-36e00ac3f93f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:17:37.203437 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-e2acfe13-bd30-4d76-97ae-ebb06b61fb6f req-99af032d-fbe5-40d7-a1bd-36e00ac3f93f service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:17:37.214798 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-e2acfe13-bd30-4d76-97ae-ebb06b61fb6f req-99af032d-fbe5-40d7-a1bd-36e00ac3f93f service nova] Creating event network-vif-deleted:9342accf-5fcb-4928-87f3-41ec4893ce21 for instance b7dc9fe4-ac06-4524-974b-8f19ec8ed167 on n-h1-858272-3 Oct 05 04:17:37.220604 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-e2acfe13-bd30-4d76-97ae-ebb06b61fb6f req-99af032d-fbe5-40d7-a1bd-36e00ac3f93f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090881 Oct 05 04:17:37.221260 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4042/8065] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 04:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 04:17:37.362073 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-571b48ce-d003-4a3c-bc65-49dd885c0855 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:17:37.362632 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-571b48ce-d003-4a3c-bc65-49dd885c0855 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: b7dc9fe4-ac06-4524-974b-8f19ec8ed167] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:17:37.369692 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-571b48ce-d003-4a3c-bc65-49dd885c0855 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:17:37.370185 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-571b48ce-d003-4a3c-bc65-49dd885c0855 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:17:37.370629 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-571b48ce-d003-4a3c-bc65-49dd885c0855 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:17:37.371342 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-571b48ce-d003-4a3c-bc65-49dd885c0855 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:17:37.371810 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-571b48ce-d003-4a3c-bc65-49dd885c0855 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:17:37.372318 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-571b48ce-d003-4a3c-bc65-49dd885c0855 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:17:37.404777 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-571b48ce-d003-4a3c-bc65-49dd885c0855 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:17:37.405311 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-571b48ce-d003-4a3c-bc65-49dd885c0855 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:17:37.405752 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-571b48ce-d003-4a3c-bc65-49dd885c0855 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:17:37.406203 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.objects.instance [None req-571b48ce-d003-4a3c-bc65-49dd885c0855 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lazy-loading 'fault' on Instance uuid b7dc9fe4-ac06-4524-974b-8f19ec8ed167 {{(pid=122320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 04:17:37.447343 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-571b48ce-d003-4a3c-bc65-49dd885c0855 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:17:37.455751 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-571b48ce-d003-4a3c-bc65-49dd885c0855 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167" status: 200 len: 1339 microversion: 2.1 time: 0.097508 Oct 05 04:17:37.456340 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 4024/8066] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:17:37 2022] GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167 => generated 1339 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:17:38.482473 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0cb18002-86d0-4de7-821d-1a34de33c0ad tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:17:38.483215 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-0cb18002-86d0-4de7-821d-1a34de33c0ad tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: b7dc9fe4-ac06-4524-974b-8f19ec8ed167] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:17:38.489543 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0cb18002-86d0-4de7-821d-1a34de33c0ad tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:17:38.490038 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0cb18002-86d0-4de7-821d-1a34de33c0ad tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:17:38.490483 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0cb18002-86d0-4de7-821d-1a34de33c0ad tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:17:38.491437 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0cb18002-86d0-4de7-821d-1a34de33c0ad tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:17:38.491898 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0cb18002-86d0-4de7-821d-1a34de33c0ad tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:17:38.492332 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-0cb18002-86d0-4de7-821d-1a34de33c0ad tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:17:38.506401 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.wsgi [None req-0cb18002-86d0-4de7-821d-1a34de33c0ad tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] HTTP exception thrown: Instance b7dc9fe4-ac06-4524-974b-8f19ec8ed167 could not be found. Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0cb18002-86d0-4de7-821d-1a34de33c0ad tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Request method failure captured: Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: request: GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167 HTTP/1.1 Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: Accept: application/json Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: Accept-Encoding: identity Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: Connection: close Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: Content-Length: 0 Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: Content-Type: application/json Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: Host: 10.222.0.16 Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: Openstack-System-Scope: None Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: User-Agent: python-urllib3/1.26.12 Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: X-Auth-Token: gAAAAABjPQP_xFpzLZ2dkDaa1nxOXc6YLRV0N1_GViDIy1ti4MhZvQ3XmEsofIo6ODwwuV3AYjcBxmTignPEWdt828Bntdczf_guyjJs9ySJQYlS7HC_y8lXg_Mc2a2tvHiPgyxaGoY4j_c4Am8VKEgv5VMCeijESSQWJUsBUMX_GOHcRynmHeY Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Id: None Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: X-Domain-Name: None Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: X-Identity-Status: Confirmed Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: X-Is-Admin-Project: True Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Id: default Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Domain-Name: Default Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Id: 3f290aa28fa24d1eb2840c871ecdd853 Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: X-Project-Name: tempest-TestSnapshotPattern-388101797 Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: X-Role: member,reader Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: X-Roles: member,reader Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f290aa28fa24d1eb2840c871ecdd853"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f290aa28fa24d1eb2840c871ecdd853"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f290aa28fa24d1eb2840c871ecdd853"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f290aa28fa24d1eb2840c871ecdd853"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant: tempest-TestSnapshotPattern-388101797 Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Id: 3f290aa28fa24d1eb2840c871ecdd853 Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: X-Tenant-Name: tempest-TestSnapshotPattern-388101797 Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: X-User: tempest-TestSnapshotPattern-388101797-project Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Id: default Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: X-User-Domain-Name: Default Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: X-User-Id: d0a624b8f35f4e60a36f6fe36e189f0d Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: X-User-Name: tempest-TestSnapshotPattern-388101797-project Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: method: > Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: exception: Instance b7dc9fe4-ac06-4524-974b-8f19ec8ed167 could not be found. Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: action_args: {'id': 'b7dc9fe4-ac06-4524-974b-8f19ec8ed167'} Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7dc9fe4-ac06-4524-974b-8f19ec8ed167 could not be found. Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7dc9fe4-ac06-4524-974b-8f19ec8ed167 could not be found. Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 04:17:38.508019 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 04:17:38.514091 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 04:17:38.514091 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 04:17:38.514091 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 04:17:38.514091 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 04:17:38.514091 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 04:17:38.514091 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7dc9fe4-ac06-4524-974b-8f19ec8ed167 could not be found. Oct 05 04:17:38.514091 n-d-858272-3 devstack@n-api.service[122319]: ERROR nova.api.openstack.wsgi Oct 05 04:17:38.514091 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-0cb18002-86d0-4de7-821d-1a34de33c0ad tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Returning 404 to user: Instance b7dc9fe4-ac06-4524-974b-8f19ec8ed167 could not be found. {{(pid=122319) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 04:17:38.514091 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-0cb18002-86d0-4de7-821d-1a34de33c0ad tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167" status: 404 len: 111 microversion: 2.1 time: 0.032639 Oct 05 04:17:38.514091 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4043/8067] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:17:38 2022] GET /compute/v2.1/servers/b7dc9fe4-ac06-4524-974b-8f19ec8ed167 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 04:17:39.861206 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-60898f3f-4bac-4c83-a850-67b77083665a tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:17:39.861795 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-69fa5627-068f-40cb-920e-94616795edfd req-999fac45-56c5-49c0-bc99-98ebac1e22a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaab82ce-f3e4-4d28-91b1-01ae28bcfd79", "tag": "89c9ba06-3dbe-4b86-a46e-8b5f0be0767d"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:17:39.862194 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-60898f3f-4bac-4c83-a850-67b77083665a tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: eaab82ce-f3e4-4d28-91b1-01ae28bcfd79] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:17:39.869310 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60898f3f-4bac-4c83-a850-67b77083665a tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:17:39.870108 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60898f3f-4bac-4c83-a850-67b77083665a tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:17:39.870644 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60898f3f-4bac-4c83-a850-67b77083665a tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:17:39.871604 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60898f3f-4bac-4c83-a850-67b77083665a tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:17:39.872142 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60898f3f-4bac-4c83-a850-67b77083665a tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:17:39.872275 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-69fa5627-068f-40cb-920e-94616795edfd req-999fac45-56c5-49c0-bc99-98ebac1e22a0 service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:17:39.872664 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-60898f3f-4bac-4c83-a850-67b77083665a tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:17:39.872790 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-69fa5627-068f-40cb-920e-94616795edfd req-999fac45-56c5-49c0-bc99-98ebac1e22a0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:17:39.873151 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-69fa5627-068f-40cb-920e-94616795edfd req-999fac45-56c5-49c0-bc99-98ebac1e22a0 service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:17:39.885570 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-69fa5627-068f-40cb-920e-94616795edfd req-999fac45-56c5-49c0-bc99-98ebac1e22a0 service nova] Creating event network-changed:89c9ba06-3dbe-4b86-a46e-8b5f0be0767d for instance eaab82ce-f3e4-4d28-91b1-01ae28bcfd79 on n-h2-858272-3 Oct 05 04:17:39.891707 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-69fa5627-068f-40cb-920e-94616795edfd req-999fac45-56c5-49c0-bc99-98ebac1e22a0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034187 Oct 05 04:17:39.892647 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4044/8068] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 04:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 04:17:39.903962 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-60898f3f-4bac-4c83-a850-67b77083665a tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: eaab82ce-f3e4-4d28-91b1-01ae28bcfd79] Going to try to terminate instance {{(pid=122320) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 04:17:40.005488 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-60898f3f-4bac-4c83-a850-67b77083665a tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79" status: 204 len: 0 microversion: 2.1 time: 0.149279 Oct 05 04:17:40.006529 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 4025/8069] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 04:17:39 2022] DELETE /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 04:17:40.016323 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-66f1ef4c-76ac-4c69-ae9e-2e503c822008 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:17:40.017357 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.compute.api [None req-66f1ef4c-76ac-4c69-ae9e-2e503c822008 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: eaab82ce-f3e4-4d28-91b1-01ae28bcfd79] Fetching instance by UUID {{(pid=122319) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:17:40.024278 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-66f1ef4c-76ac-4c69-ae9e-2e503c822008 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:17:40.024889 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-66f1ef4c-76ac-4c69-ae9e-2e503c822008 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:17:40.025472 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-66f1ef4c-76ac-4c69-ae9e-2e503c822008 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:17:40.026305 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-66f1ef4c-76ac-4c69-ae9e-2e503c822008 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:17:40.026857 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-66f1ef4c-76ac-4c69-ae9e-2e503c822008 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:17:40.027729 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [None req-66f1ef4c-76ac-4c69-ae9e-2e503c822008 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:17:40.190142 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.policy [None req-66f1ef4c-76ac-4c69-ae9e-2e503c822008 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122319) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:17:40.198164 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-66f1ef4c-76ac-4c69-ae9e-2e503c822008 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79" status: 200 len: 1685 microversion: 2.1 time: 0.187171 Oct 05 04:17:40.198680 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4045/8070] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:17:40 2022] GET /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79 => generated 1685 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 04:17:41.223169 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-5c2f8470-14ee-4633-97f0-36f5d79e4509 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:17:41.223882 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-5c2f8470-14ee-4633-97f0-36f5d79e4509 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: eaab82ce-f3e4-4d28-91b1-01ae28bcfd79] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:17:41.231293 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c2f8470-14ee-4633-97f0-36f5d79e4509 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:17:41.232028 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c2f8470-14ee-4633-97f0-36f5d79e4509 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:17:41.232478 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c2f8470-14ee-4633-97f0-36f5d79e4509 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:17:41.233409 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c2f8470-14ee-4633-97f0-36f5d79e4509 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:17:41.233880 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c2f8470-14ee-4633-97f0-36f5d79e4509 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:17:41.234434 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-5c2f8470-14ee-4633-97f0-36f5d79e4509 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:17:41.447287 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [req-7c38cb4d-edb7-4ef9-b88e-992001824571 req-2f8c37d5-d9d7-48c0-b686-fbd650f0523a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaab82ce-f3e4-4d28-91b1-01ae28bcfd79", "name": "network-vif-deleted", "tag": "89c9ba06-3dbe-4b86-a46e-8b5f0be0767d"}]} {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 04:17:41.461416 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.policy [None req-5c2f8470-14ee-4633-97f0-36f5d79e4509 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a624b8f35f4e60a36f6fe36e189f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f290aa28fa24d1eb2840c871ecdd853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122320) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 04:17:41.469224 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7c38cb4d-edb7-4ef9-b88e-992001824571 req-2f8c37d5-d9d7-48c0-b686-fbd650f0523a service nova] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:17:41.469719 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7c38cb4d-edb7-4ef9-b88e-992001824571 req-2f8c37d5-d9d7-48c0-b686-fbd650f0523a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:17:41.470163 n-d-858272-3 devstack@n-api.service[122319]: DEBUG oslo_concurrency.lockutils [req-7c38cb4d-edb7-4ef9-b88e-992001824571 req-2f8c37d5-d9d7-48c0-b686-fbd650f0523a service nova] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122319) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:17:41.471662 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-5c2f8470-14ee-4633-97f0-36f5d79e4509 tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79" status: 200 len: 1566 microversion: 2.1 time: 0.252734 Oct 05 04:17:41.472257 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 4026/8071] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:17:41 2022] GET /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79 => generated 1566 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 04:17:41.490103 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.compute.server_external_events [req-7c38cb4d-edb7-4ef9-b88e-992001824571 req-2f8c37d5-d9d7-48c0-b686-fbd650f0523a service nova] Creating event network-vif-deleted:89c9ba06-3dbe-4b86-a46e-8b5f0be0767d for instance eaab82ce-f3e4-4d28-91b1-01ae28bcfd79 on n-h2-858272-3 Oct 05 04:17:41.495505 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [req-7c38cb4d-edb7-4ef9-b88e-992001824571 req-2f8c37d5-d9d7-48c0-b686-fbd650f0523a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052861 Oct 05 04:17:41.496340 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4046/8072] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Oct 5 04:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 04:17:42.495952 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0b8c07ce-58ec-45dd-a8f3-b0b18907b39e tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '>' {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:17:42.496587 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.compute.api [None req-0b8c07ce-58ec-45dd-a8f3-b0b18907b39e tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] [instance: eaab82ce-f3e4-4d28-91b1-01ae28bcfd79] Fetching instance by UUID {{(pid=122320) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 04:17:42.504078 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b8c07ce-58ec-45dd-a8f3-b0b18907b39e tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:17:42.504581 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b8c07ce-58ec-45dd-a8f3-b0b18907b39e tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:17:42.505059 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b8c07ce-58ec-45dd-a8f3-b0b18907b39e tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:17:42.505766 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b8c07ce-58ec-45dd-a8f3-b0b18907b39e tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Acquiring lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 04:17:42.506234 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b8c07ce-58ec-45dd-a8f3-b0b18907b39e tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 04:17:42.506671 n-d-858272-3 devstack@n-api.service[122320]: DEBUG oslo_concurrency.lockutils [None req-0b8c07ce-58ec-45dd-a8f3-b0b18907b39e tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Lock "d1723b23-1631-4a56-b9ad-72e4c39197cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 04:17:42.521325 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.wsgi [None req-0b8c07ce-58ec-45dd-a8f3-b0b18907b39e tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] HTTP exception thrown: Instance eaab82ce-f3e4-4d28-91b1-01ae28bcfd79 could not be found. Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0b8c07ce-58ec-45dd-a8f3-b0b18907b39e tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Request method failure captured: Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: request: GET /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79 HTTP/1.1 Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: Accept: application/json Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: Accept-Encoding: identity Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: Connection: close Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: Content-Length: 0 Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: Content-Type: application/json Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: Host: 10.222.0.16 Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: Openstack-System-Scope: None Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: User-Agent: python-urllib3/1.26.12 Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: X-Auth-Token: gAAAAABjPQP_xFpzLZ2dkDaa1nxOXc6YLRV0N1_GViDIy1ti4MhZvQ3XmEsofIo6ODwwuV3AYjcBxmTignPEWdt828Bntdczf_guyjJs9ySJQYlS7HC_y8lXg_Mc2a2tvHiPgyxaGoY4j_c4Am8VKEgv5VMCeijESSQWJUsBUMX_GOHcRynmHeY Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Id: None Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: X-Domain-Name: None Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: X-Identity-Status: Confirmed Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: X-Is-Admin-Project: True Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Id: default Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Domain-Name: Default Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Id: 3f290aa28fa24d1eb2840c871ecdd853 Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: X-Project-Name: tempest-TestSnapshotPattern-388101797 Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: X-Role: member,reader Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: X-Roles: member,reader Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f290aa28fa24d1eb2840c871ecdd853"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f290aa28fa24d1eb2840c871ecdd853"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f290aa28fa24d1eb2840c871ecdd853"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f290aa28fa24d1eb2840c871ecdd853"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant: tempest-TestSnapshotPattern-388101797 Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Id: 3f290aa28fa24d1eb2840c871ecdd853 Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: X-Tenant-Name: tempest-TestSnapshotPattern-388101797 Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: X-User: tempest-TestSnapshotPattern-388101797-project Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Id: default Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: X-User-Domain-Name: Default Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: X-User-Id: d0a624b8f35f4e60a36f6fe36e189f0d Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: X-User-Name: tempest-TestSnapshotPattern-388101797-project Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: method: > Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: exception: Instance eaab82ce-f3e4-4d28-91b1-01ae28bcfd79 could not be found. Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: action_args: {'id': 'eaab82ce-f3e4-4d28-91b1-01ae28bcfd79'} Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: {{(pid=122320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaab82ce-f3e4-4d28-91b1-01ae28bcfd79 could not be found. Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaab82ce-f3e4-4d28-91b1-01ae28bcfd79 could not be found. Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 04:17:42.523014 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 04:17:42.528751 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 04:17:42.528751 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 04:17:42.528751 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 04:17:42.528751 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 04:17:42.528751 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 04:17:42.528751 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaab82ce-f3e4-4d28-91b1-01ae28bcfd79 could not be found. Oct 05 04:17:42.528751 n-d-858272-3 devstack@n-api.service[122320]: ERROR nova.api.openstack.wsgi Oct 05 04:17:42.528751 n-d-858272-3 devstack@n-api.service[122320]: DEBUG nova.api.openstack.wsgi [None req-0b8c07ce-58ec-45dd-a8f3-b0b18907b39e tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Returning 404 to user: Instance eaab82ce-f3e4-4d28-91b1-01ae28bcfd79 could not be found. {{(pid=122320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 04:17:42.528751 n-d-858272-3 devstack@n-api.service[122320]: INFO nova.api.openstack.requestlog [None req-0b8c07ce-58ec-45dd-a8f3-b0b18907b39e tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "GET /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79" status: 404 len: 111 microversion: 2.1 time: 0.032423 Oct 05 04:17:42.528751 n-d-858272-3 devstack@n-api.service[122320]: [pid: 122320|app: 0|req: 4027/8073] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 04:17:42 2022] GET /compute/v2.1/servers/eaab82ce-f3e4-4d28-91b1-01ae28bcfd79 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 04:17:42.687385 n-d-858272-3 devstack@n-api.service[122319]: DEBUG nova.api.openstack.wsgi [None req-848d3732-2d7c-46eb-81e3-a8c8db1c2abf tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] Calling method '.version_select at 0x7fccdf09f040>' {{(pid=122319) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 04:17:42.709664 n-d-858272-3 devstack@n-api.service[122319]: INFO nova.api.openstack.requestlog [None req-848d3732-2d7c-46eb-81e3-a8c8db1c2abf tempest-TestSnapshotPattern-388101797 tempest-TestSnapshotPattern-388101797-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1862632936" status: 202 len: 0 microversion: 2.1 time: 0.027948 Oct 05 04:17:42.710270 n-d-858272-3 devstack@n-api.service[122319]: [pid: 122319|app: 0|req: 4047/8074] 10.222.0.16 () {58 vars in 1257 bytes} [Wed Oct 5 04:17:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1862632936 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)